2024-04-25T08:49:01.801 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T08:49:01.802 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_neesingh@teuthology --archive /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673005 --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/forward-scrub} --verbose --name neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi -- /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673005/orig.config.yaml 2024-04-25T08:49:01.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T08:49:01.929 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673005 branch: wip-neesingh-testing-240416 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/forward-scrub} email: neesingh@redhat.com first_in_suite: false job_id: '7673005' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-neesingh-testing-240416 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec kclient: syntax: v1 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62537 sha1: 5787d42d10024ba410e822a8aba474331cb9af02 owner: scheduled_neesingh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5869 sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-62537 suite_path: /home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa suite_relpath: qa suite_repo: https://github.com/neesingh-rh/ceph suite_sha1: 5787d42d10024ba410e822a8aba474331cb9af02 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM+LNu+nr1q8JDenVCcWwWpzV94O4mY7Vl1Pwc5FQl3wwMAIzMj0TQMUjgTZ97JCWW4Bc1TT+4tHN2KrvXEwzGE= smithi177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMBzCn23xb/DHJPXNLBCLQvjCziIK5v37US6IM1+vvI7q7GShIj/pj1fAoVNabsFIcKxPJaHonmySj3I//ynMkc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_08:15:18 tube: smithi user: neesingh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T08:49:01.929 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa; will attempt to use it 2024-04-25T08:49:01.929 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa/tasks 2024-04-25T08:49:01.930 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T08:49:01.931 INFO:teuthology.task.internal:Checking packages... 2024-04-25T08:49:01.956 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec' 2024-04-25T08:49:01.956 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T08:49:01.956 INFO:teuthology.packaging:ref: None 2024-04-25T08:49:01.956 INFO:teuthology.packaging:tag: None 2024-04-25T08:49:01.956 INFO:teuthology.packaging:branch: wip-neesingh-testing-240416 2024-04-25T08:49:01.956 INFO:teuthology.packaging:sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:49:01.956 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-neesingh-testing-240416 2024-04-25T08:49:02.093 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T08:49:02.095 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T08:49:02.101 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T08:49:02.101 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T08:49:02.125 INFO:teuthology.task.internal:Saving configuration 2024-04-25T08:49:02.141 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T08:49:02.151 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T08:49:02.177 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673005', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:43:32.483679', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICDi4gc2N7YgSsEWdlSCyds9SRyc9K7o6mvwp6OatB62'} 2024-04-25T08:49:02.199 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673005', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:43:32.482267', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFQlhb8lZG19fSqQkX4JNri/GVUETYTVTNmxLzXcvAFz'} 2024-04-25T08:49:02.199 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T08:49:02.205 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-25T08:49:02.205 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-25T08:49:02.205 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T08:49:02.297 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd3937230d0>, signals=[15]) 2024-04-25T08:49:02.298 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T08:49:02.303 INFO:teuthology.task.internal:Opening connections... 2024-04-25T08:49:02.304 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T08:49:02.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:49:02.385 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi177.front.sepia.ceph.com 2024-04-25T08:49:02.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:49:02.465 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T08:49:02.474 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-04-25T08:49:02.479 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-04-25T08:49:02.479 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-04-25T08:49:02.526 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T08:49:02.526 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Ubuntu" 2024-04-25T08:49:02.527 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="22.04" 2024-04-25T08:49:02.527 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T08:49:02.527 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_CODENAME=jammy 2024-04-25T08:49:02.527 INFO:teuthology.orchestra.run.smithi175.stdout:ID=ubuntu 2024-04-25T08:49:02.527 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE=debian 2024-04-25T08:49:02.527 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T08:49:02.527 INFO:teuthology.orchestra.run.smithi175.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T08:49:02.527 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T08:49:02.527 INFO:teuthology.orchestra.run.smithi175.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T08:49:02.527 INFO:teuthology.orchestra.run.smithi175.stdout:UBUNTU_CODENAME=jammy 2024-04-25T08:49:02.528 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-04-25T08:49:02.552 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-04-25T08:49:02.557 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-04-25T08:49:02.557 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-04-25T08:49:02.603 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T08:49:02.603 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Ubuntu" 2024-04-25T08:49:02.604 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="22.04" 2024-04-25T08:49:02.604 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T08:49:02.604 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_CODENAME=jammy 2024-04-25T08:49:02.604 INFO:teuthology.orchestra.run.smithi177.stdout:ID=ubuntu 2024-04-25T08:49:02.604 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE=debian 2024-04-25T08:49:02.604 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T08:49:02.604 INFO:teuthology.orchestra.run.smithi177.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T08:49:02.604 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T08:49:02.604 INFO:teuthology.orchestra.run.smithi177.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T08:49:02.604 INFO:teuthology.orchestra.run.smithi177.stdout:UBUNTU_CODENAME=jammy 2024-04-25T08:49:02.604 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-04-25T08:49:02.627 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T08:49:02.638 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T08:49:02.658 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T08:49:02.659 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-04-25T08:49:02.661 DEBUG:teuthology.orchestra.run.smithi177:> test '!' -e /home/ubuntu/cephtest 2024-04-25T08:49:02.666 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T08:49:02.683 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T08:49:02.683 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-04-25T08:49:02.708 DEBUG:teuthology.orchestra.run.smithi177:> test -z $(ls -A /var/lib/ceph) 2024-04-25T08:49:02.728 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T08:49:02.783 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T08:49:02.800 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-04-25T08:49:02.801 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-04-25T08:49:02.801 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-04-25T08:49:02.801 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T08:49:02.801 DEBUG:teuthology.orchestra.run.smithi177:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T08:49:02.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:49:02.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:49:02.807 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-25T08:49:02.808 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-25T08:49:02.995 DEBUG:teuthology.task.kernel:sha1 for client.1 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T08:49:02.997 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-25T08:49:02.997 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-04-25T08:49:03.001 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T08:49:03.001 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-25T08:49:03.001 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-04-25T08:49:03.003 INFO:teuthology.orchestra.run.smithi177.stdout:5.15.0-56-generic 2024-04-25T08:49:03.003 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T08:49:03.003 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-25T08:49:03.003 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-04-25T08:49:03.004 DEBUG:teuthology.orchestra.run.smithi177:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-25T08:49:03.008 INFO:teuthology.orchestra.run.smithi175.stdout:5.15.0-56-generic 2024-04-25T08:49:03.008 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T08:49:03.009 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-25T08:49:03.009 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-04-25T08:49:03.009 DEBUG:teuthology.orchestra.run.smithi175:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-25T08:49:03.064 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-25T08:49:03.079 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-25T08:49:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-25T08:49:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-25T08:49:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-25T08:49:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:hint: 2024-04-25T08:49:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:hint: git config --global init.defaultBranch 2024-04-25T08:49:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:hint: 2024-04-25T08:49:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-25T08:49:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-25T08:49:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:hint: 2024-04-25T08:49:03.191 INFO:teuthology.orchestra.run.smithi177.stderr:hint: git branch -m 2024-04-25T08:49:03.192 INFO:teuthology.orchestra.run.smithi177.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-25T08:49:03.195 DEBUG:teuthology.orchestra.run.smithi177:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-25T08:49:03.248 INFO:teuthology.orchestra.run.smithi175.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-25T08:49:03.249 INFO:teuthology.orchestra.run.smithi175.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-25T08:49:03.249 INFO:teuthology.orchestra.run.smithi175.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-25T08:49:03.249 INFO:teuthology.orchestra.run.smithi175.stderr:hint: 2024-04-25T08:49:03.249 INFO:teuthology.orchestra.run.smithi175.stderr:hint: git config --global init.defaultBranch 2024-04-25T08:49:03.249 INFO:teuthology.orchestra.run.smithi175.stderr:hint: 2024-04-25T08:49:03.249 INFO:teuthology.orchestra.run.smithi175.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-25T08:49:03.249 INFO:teuthology.orchestra.run.smithi175.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-25T08:49:03.249 INFO:teuthology.orchestra.run.smithi175.stderr:hint: 2024-04-25T08:49:03.249 INFO:teuthology.orchestra.run.smithi175.stderr:hint: git branch -m 2024-04-25T08:49:03.250 INFO:teuthology.orchestra.run.smithi175.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-25T08:49:03.253 DEBUG:teuthology.orchestra.run.smithi175:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-25T08:49:03.264 DEBUG:teuthology.orchestra.run.smithi177:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-25T08:49:03.320 DEBUG:teuthology.orchestra.run.smithi177:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-25T08:49:03.331 DEBUG:teuthology.orchestra.run.smithi175:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-25T08:49:03.386 DEBUG:teuthology.orchestra.run.smithi175:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-25T08:49:36.113 INFO:teuthology.orchestra.run.smithi177.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-25T08:49:36.114 INFO:teuthology.orchestra.run.smithi177.stderr: * [new branch] main -> origin/main 2024-04-25T08:49:36.147 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190312 -> 20190312 2024-04-25T08:49:36.147 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190416 -> 20190416 2024-04-25T08:49:36.147 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190514 -> 20190514 2024-04-25T08:49:36.147 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190618 -> 20190618 2024-04-25T08:49:36.147 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190717 -> 20190717 2024-04-25T08:49:36.147 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190815 -> 20190815 2024-04-25T08:49:36.148 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20190923 -> 20190923 2024-04-25T08:49:36.148 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20191022 -> 20191022 2024-04-25T08:49:36.148 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20191215 -> 20191215 2024-04-25T08:49:36.148 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200122 -> 20200122 2024-04-25T08:49:36.150 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200316 -> 20200316 2024-04-25T08:49:36.150 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200421 -> 20200421 2024-04-25T08:49:36.150 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200519 -> 20200519 2024-04-25T08:49:36.150 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200619 -> 20200619 2024-04-25T08:49:36.151 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200721 -> 20200721 2024-04-25T08:49:36.151 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200817 -> 20200817 2024-04-25T08:49:36.151 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20200918 -> 20200918 2024-04-25T08:49:36.151 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20201022 -> 20201022 2024-04-25T08:49:36.151 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20201118 -> 20201118 2024-04-25T08:49:36.151 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20201218 -> 20201218 2024-04-25T08:49:36.151 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20210208 -> 20210208 2024-04-25T08:49:36.151 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20210315 -> 20210315 2024-04-25T08:49:36.151 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20210511 -> 20210511 2024-04-25T08:49:36.151 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20210716 -> 20210716 2024-04-25T08:49:36.151 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20210818 -> 20210818 2024-04-25T08:49:36.151 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20210919 -> 20210919 2024-04-25T08:49:36.151 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20211027 -> 20211027 2024-04-25T08:49:36.151 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20211216 -> 20211216 2024-04-25T08:49:36.151 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220209 -> 20220209 2024-04-25T08:49:36.152 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220310 -> 20220310 2024-04-25T08:49:36.152 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220411 -> 20220411 2024-04-25T08:49:36.152 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220509 -> 20220509 2024-04-25T08:49:36.154 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220610 -> 20220610 2024-04-25T08:49:36.154 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220708 -> 20220708 2024-04-25T08:49:36.154 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220815 -> 20220815 2024-04-25T08:49:36.154 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20220913 -> 20220913 2024-04-25T08:49:36.154 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20221012 -> 20221012 2024-04-25T08:49:36.154 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20221109 -> 20221109 2024-04-25T08:49:36.155 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20221214 -> 20221214 2024-04-25T08:49:36.155 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230117 -> 20230117 2024-04-25T08:49:36.155 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230210 -> 20230210 2024-04-25T08:49:36.155 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230310 -> 20230310 2024-04-25T08:49:36.155 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230404 -> 20230404 2024-04-25T08:49:36.155 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230515 -> 20230515 2024-04-25T08:49:36.155 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230625 -> 20230625 2024-04-25T08:49:36.155 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230804 -> 20230804 2024-04-25T08:49:36.155 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20230919 -> 20230919 2024-04-25T08:49:36.155 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20231030 -> 20231030 2024-04-25T08:49:36.155 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20231111 -> 20231111 2024-04-25T08:49:36.155 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20231211 -> 20231211 2024-04-25T08:49:36.155 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20240115 -> 20240115 2024-04-25T08:49:36.155 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20240220 -> 20240220 2024-04-25T08:49:36.155 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20240312 -> 20240312 2024-04-25T08:49:36.156 INFO:teuthology.orchestra.run.smithi177.stderr: * [new tag] 20240410 -> 20240410 2024-04-25T08:49:36.394 INFO:teuthology.orchestra.run.smithi175.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-25T08:49:36.394 INFO:teuthology.orchestra.run.smithi175.stderr: * [new branch] main -> origin/main 2024-04-25T08:49:36.422 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20190312 -> 20190312 2024-04-25T08:49:36.422 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20190416 -> 20190416 2024-04-25T08:49:36.423 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20190514 -> 20190514 2024-04-25T08:49:36.423 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20190618 -> 20190618 2024-04-25T08:49:36.423 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20190717 -> 20190717 2024-04-25T08:49:36.423 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20190815 -> 20190815 2024-04-25T08:49:36.423 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20190923 -> 20190923 2024-04-25T08:49:36.423 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20191022 -> 20191022 2024-04-25T08:49:36.423 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20191215 -> 20191215 2024-04-25T08:49:36.423 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20200122 -> 20200122 2024-04-25T08:49:36.423 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20200316 -> 20200316 2024-04-25T08:49:36.423 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20200421 -> 20200421 2024-04-25T08:49:36.426 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20200519 -> 20200519 2024-04-25T08:49:36.426 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20200619 -> 20200619 2024-04-25T08:49:36.426 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20200721 -> 20200721 2024-04-25T08:49:36.426 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20200817 -> 20200817 2024-04-25T08:49:36.426 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20200918 -> 20200918 2024-04-25T08:49:36.426 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20201022 -> 20201022 2024-04-25T08:49:36.426 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20201118 -> 20201118 2024-04-25T08:49:36.426 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20201218 -> 20201218 2024-04-25T08:49:36.426 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20210208 -> 20210208 2024-04-25T08:49:36.426 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20210315 -> 20210315 2024-04-25T08:49:36.426 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20210511 -> 20210511 2024-04-25T08:49:36.426 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20210716 -> 20210716 2024-04-25T08:49:36.427 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20210818 -> 20210818 2024-04-25T08:49:36.427 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20210919 -> 20210919 2024-04-25T08:49:36.427 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20211027 -> 20211027 2024-04-25T08:49:36.427 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20211216 -> 20211216 2024-04-25T08:49:36.427 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20220209 -> 20220209 2024-04-25T08:49:36.427 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20220310 -> 20220310 2024-04-25T08:49:36.427 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20220411 -> 20220411 2024-04-25T08:49:36.427 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20220509 -> 20220509 2024-04-25T08:49:36.427 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20220610 -> 20220610 2024-04-25T08:49:36.427 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20220708 -> 20220708 2024-04-25T08:49:36.429 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20220815 -> 20220815 2024-04-25T08:49:36.429 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20220913 -> 20220913 2024-04-25T08:49:36.429 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20221012 -> 20221012 2024-04-25T08:49:36.430 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20221109 -> 20221109 2024-04-25T08:49:36.430 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20221214 -> 20221214 2024-04-25T08:49:36.430 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20230117 -> 20230117 2024-04-25T08:49:36.430 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20230210 -> 20230210 2024-04-25T08:49:36.430 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20230310 -> 20230310 2024-04-25T08:49:36.430 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20230404 -> 20230404 2024-04-25T08:49:36.430 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20230515 -> 20230515 2024-04-25T08:49:36.430 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20230625 -> 20230625 2024-04-25T08:49:36.430 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20230804 -> 20230804 2024-04-25T08:49:36.430 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20230919 -> 20230919 2024-04-25T08:49:36.430 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20231030 -> 20231030 2024-04-25T08:49:36.430 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20231111 -> 20231111 2024-04-25T08:49:36.430 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20231211 -> 20231211 2024-04-25T08:49:36.431 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20240115 -> 20240115 2024-04-25T08:49:36.431 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20240220 -> 20240220 2024-04-25T08:49:36.431 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20240312 -> 20240312 2024-04-25T08:49:36.431 INFO:teuthology.orchestra.run.smithi175.stderr: * [new tag] 20240410 -> 20240410 2024-04-25T08:49:40.432 INFO:teuthology.orchestra.run.smithi177.stderr:Updating files: 44% (1511/3381) Updating files: 45% (1522/3381) Updating files: 46% (1556/3381) Updating files: 47% (1590/3381) Updating files: 48% (1623/3381) Updating files: 49% (1657/3381) Updating files: 50% (1691/3381) Updating files: 51% (1725/3381) Updating files: 52% (1759/3381) Updating files: 53% (1792/3381) Updating files: 54% (1826/3381) Updating files: 55% (1860/3381) Updating files: 56% (1894/3381) Updating files: 57% (1928/3381) Updating files: 58% (1961/3381) Updating files: 59% (1995/3381) Updating files: 59% (2003/3381) Updating files: 60% (2029/3381) Updating files: 61% (2063/3381) Updating files: 62% (2097/3381) Updating files: 63% (2131/3381) Updating files: 64% (2164/3381) Updating files: 65% (2198/3381) Updating files: 66% (2232/3381) Updating files: 67% (2266/3381) Updating files: 68% (2300/3381) Updating files: 69% (2333/3381) Updating files: 69% (2362/3381) Updating files: 70% (2367/3381) Updating files: 71% (2401/3381) Updating files: 72% (2435/3381) Updating files: 73% (2469/3381) Updating files: 74% (2502/3381) Updating files: 75% (2536/3381) Updating files: 76% (2570/3381) Updating files: 77% (2604/3381) Updating files: 78% (2638/3381) Updating files: 79% (2671/3381) Updating files: 80% (2705/3381) Updating files: 81% (2739/3381) Updating files: 82% (2773/3381) Updating files: 83% (2807/3381) Updating files: 83% (2809/3381) Updating files: 84% (2841/3381) Updating files: 85% (2874/3381) Updating files: 86% (2908/3381) Updating files: 87% (2942/3381) Updating files: 88% (2976/3381) Updating files: 89% (3010/3381) Updating files: 90% (3043/3381) Updating files: 91% (3077/3381) Updating files: 92% (3111/3381) Updating files: 93% (3145/3381) Updating files: 94% (3179/3381) Updating files: 95% (3212/3381) Updating files: 96% (3246/3381) Updating files: 97% (3280/3381) Updating files: 98% (3314/3381) Updating files: 99% (3348/3381) Updating files: 100% (3381/3381) Updating files: 100% (3381/3381), done. 2024-04-25T08:49:40.437 INFO:teuthology.orchestra.run.smithi177.stdout:HEAD is now at 63a66b66 Merge branch 'robot/pr-0-1713990671' into 'main' 2024-04-25T08:49:40.458 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-25T08:49:40.459 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T08:49:40.600 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-25T08:49:40.601 DEBUG:teuthology.orchestra.run.smithi177:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-25T08:49:40.603 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi177.front.sepia.ceph.com to complete... 2024-04-25T08:49:40.734 INFO:teuthology.orchestra.run.smithi175.stderr:Updating files: 44% (1511/3381) Updating files: 45% (1522/3381) Updating files: 46% (1556/3381) Updating files: 47% (1590/3381) Updating files: 48% (1623/3381) Updating files: 49% (1657/3381) Updating files: 50% (1691/3381) Updating files: 51% (1725/3381) Updating files: 52% (1759/3381) Updating files: 53% (1792/3381) Updating files: 54% (1826/3381) Updating files: 55% (1860/3381) Updating files: 56% (1894/3381) Updating files: 57% (1928/3381) Updating files: 58% (1961/3381) Updating files: 59% (1995/3381) Updating files: 59% (2001/3381) Updating files: 60% (2029/3381) Updating files: 61% (2063/3381) Updating files: 62% (2097/3381) Updating files: 63% (2131/3381) Updating files: 64% (2164/3381) Updating files: 65% (2198/3381) Updating files: 66% (2232/3381) Updating files: 67% (2266/3381) Updating files: 68% (2300/3381) Updating files: 69% (2333/3381) Updating files: 69% (2362/3381) Updating files: 70% (2367/3381) Updating files: 71% (2401/3381) Updating files: 72% (2435/3381) Updating files: 73% (2469/3381) Updating files: 74% (2502/3381) Updating files: 75% (2536/3381) Updating files: 76% (2570/3381) Updating files: 77% (2604/3381) Updating files: 78% (2638/3381) Updating files: 79% (2671/3381) Updating files: 80% (2705/3381) Updating files: 81% (2739/3381) Updating files: 82% (2773/3381) Updating files: 82% (2805/3381) Updating files: 83% (2807/3381) Updating files: 84% (2841/3381) Updating files: 85% (2874/3381) Updating files: 86% (2908/3381) Updating files: 87% (2942/3381) Updating files: 88% (2976/3381) Updating files: 89% (3010/3381) Updating files: 90% (3043/3381) Updating files: 91% (3077/3381) Updating files: 92% (3111/3381) Updating files: 93% (3145/3381) Updating files: 94% (3179/3381) Updating files: 95% (3212/3381) Updating files: 96% (3246/3381) Updating files: 97% (3280/3381) Updating files: 98% (3314/3381) Updating files: 99% (3348/3381) Updating files: 100% (3381/3381) Updating files: 100% (3381/3381), done. 2024-04-25T08:49:40.739 INFO:teuthology.orchestra.run.smithi175.stdout:HEAD is now at 63a66b66 Merge branch 'robot/pr-0-1713990671' into 'main' 2024-04-25T08:49:40.761 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T08:49:40.761 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T08:49:40.927 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-25T08:49:40.928 DEBUG:teuthology.orchestra.run.smithi175:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-25T08:49:40.930 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi175.front.sepia.ceph.com to complete... 2024-04-25T08:49:43.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25 08:49:43 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-25T08:49:43.292 INFO:teuthology.orchestra.run.smithi177.stderr:FINISHED --2024-04-25 08:49:43-- 2024-04-25T08:49:43.292 INFO:teuthology.orchestra.run.smithi177.stderr:Total wall clock time: 2.7s 2024-04-25T08:49:43.292 INFO:teuthology.orchestra.run.smithi177.stderr:Downloaded: 1 files, 43M in 2.5s (17.2 MB/s) 2024-04-25T08:49:43.296 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-25T08:49:43.296 DEBUG:teuthology.orchestra.run.smithi177:> sudo dpkg -i /tmp/linux-image.deb 2024-04-25T08:49:43.564 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-25T08:49:43.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25 08:49:44 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-25T08:49:43.922 INFO:teuthology.orchestra.run.smithi175.stderr:FINISHED --2024-04-25 08:49:44-- 2024-04-25T08:49:43.922 INFO:teuthology.orchestra.run.smithi175.stderr:Total wall clock time: 3.0s 2024-04-25T08:49:43.922 INFO:teuthology.orchestra.run.smithi175.stderr:Downloaded: 1 files, 43M in 2.8s (15.1 MB/s) 2024-04-25T08:49:43.926 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T08:49:43.926 DEBUG:teuthology.orchestra.run.smithi175:> sudo dpkg -i /tmp/linux-image.deb 2024-04-25T08:49:44.184 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-25T08:49:45.554 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-25T08:49:45.558 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-25T08:49:45.752 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T08:49:46.103 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-25T08:49:46.107 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-25T08:49:46.237 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T08:49:49.212 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T08:49:49.317 INFO:teuthology.orchestra.run.smithi177.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T08:49:50.241 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T08:49:50.358 INFO:teuthology.orchestra.run.smithi175.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:10.272 INFO:teuthology.orchestra.run.smithi177.stderr:Sourcing file `/etc/default/grub' 2024-04-25T08:50:10.287 INFO:teuthology.orchestra.run.smithi177.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T08:50:10.311 INFO:teuthology.orchestra.run.smithi177.stderr:Generating grub configuration file ... 2024-04-25T08:50:10.629 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:10.646 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:10.903 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T08:50:10.912 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T08:50:10.983 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T08:50:10.988 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T08:50:11.132 INFO:teuthology.orchestra.run.smithi177.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T08:50:11.132 INFO:teuthology.orchestra.run.smithi177.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T08:50:11.132 INFO:teuthology.orchestra.run.smithi177.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T08:50:11.174 INFO:teuthology.orchestra.run.smithi177.stderr:done 2024-04-25T08:50:11.335 DEBUG:teuthology.orchestra.run.smithi177:> dpkg-deb -c /tmp/linux-image.deb 2024-04-25T08:50:11.343 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-25T08:50:11.343 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-25T08:50:11.343 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:11.361 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:11.361 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:11.383 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-25T08:50:11.383 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-25T08:50:11.383 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-25T08:50:11.383 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-25T08:50:11.383 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-25T08:50:11.383 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-25T08:50:11.383 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-25T08:50:11.383 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-25T08:50:11.384 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-25T08:50:11.384 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-25T08:50:11.384 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-25T08:50:11.384 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-25T08:50:11.384 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-25T08:50:11.384 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-25T08:50:11.386 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-25T08:50:11.386 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-25T08:50:11.386 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-25T08:50:11.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-25T08:50:11.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-25T08:50:11.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-25T08:50:11.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-25T08:50:11.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-25T08:50:11.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-25T08:50:11.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-25T08:50:11.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-25T08:50:11.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-25T08:50:11.387 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-25T08:50:11.388 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-25T08:50:11.388 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-25T08:50:11.388 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-25T08:50:11.388 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-25T08:50:11.388 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-25T08:50:11.388 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-25T08:50:11.388 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-25T08:50:11.388 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-25T08:50:11.388 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-25T08:50:11.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-25T08:50:11.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-25T08:50:11.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-25T08:50:11.389 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-25T08:50:11.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-25T08:50:11.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-25T08:50:11.389 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-25T08:50:11.405 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-25T08:50:11.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-25T08:50:11.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-25T08:50:11.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-25T08:50:11.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-25T08:50:11.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-25T08:50:11.405 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-25T08:50:11.406 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-25T08:50:11.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-25T08:50:11.406 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-25T08:50:11.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-25T08:50:11.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-25T08:50:11.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-25T08:50:11.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-25T08:50:11.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-25T08:50:11.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-25T08:50:11.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-25T08:50:11.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-25T08:50:11.406 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-25T08:50:11.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-25T08:50:11.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-25T08:50:11.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-25T08:50:11.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-25T08:50:11.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-25T08:50:11.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-25T08:50:11.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-25T08:50:11.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-25T08:50:11.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-25T08:50:11.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-25T08:50:11.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-25T08:50:11.407 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-25T08:50:11.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-25T08:50:11.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-25T08:50:11.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-25T08:50:11.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-25T08:50:11.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-25T08:50:11.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-25T08:50:11.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-25T08:50:11.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-25T08:50:11.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-25T08:50:11.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-25T08:50:11.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-25T08:50:11.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-25T08:50:11.408 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-25T08:50:11.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-25T08:50:11.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-25T08:50:11.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-25T08:50:11.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-25T08:50:11.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-25T08:50:11.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-25T08:50:11.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-25T08:50:11.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-25T08:50:11.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-25T08:50:11.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-25T08:50:11.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-25T08:50:11.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-25T08:50:11.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-25T08:50:11.409 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-25T08:50:11.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-25T08:50:11.410 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-25T08:50:11.410 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-25T08:50:11.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-25T08:50:11.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-25T08:50:11.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-25T08:50:11.410 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-25T08:50:11.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-25T08:50:11.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-25T08:50:11.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-25T08:50:11.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-25T08:50:11.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-25T08:50:11.410 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-25T08:50:11.411 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-25T08:50:11.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-25T08:50:11.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-25T08:50:11.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-25T08:50:11.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-25T08:50:11.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-25T08:50:11.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-25T08:50:11.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-25T08:50:11.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-25T08:50:11.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-25T08:50:11.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-25T08:50:11.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-25T08:50:11.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-25T08:50:11.411 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-25T08:50:11.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-25T08:50:11.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-25T08:50:11.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-25T08:50:11.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-25T08:50:11.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-25T08:50:11.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-25T08:50:11.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-25T08:50:11.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-25T08:50:11.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-25T08:50:11.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-25T08:50:11.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-25T08:50:11.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-25T08:50:11.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-25T08:50:11.412 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-25T08:50:11.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-25T08:50:11.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-25T08:50:11.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-25T08:50:11.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-25T08:50:11.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-25T08:50:11.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-25T08:50:11.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-25T08:50:11.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-25T08:50:11.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-25T08:50:11.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-25T08:50:11.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-25T08:50:11.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-25T08:50:11.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-25T08:50:11.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-25T08:50:11.413 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-25T08:50:11.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-25T08:50:11.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-25T08:50:11.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-25T08:50:11.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-25T08:50:11.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-25T08:50:11.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-25T08:50:11.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-25T08:50:11.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-25T08:50:11.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-25T08:50:11.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-25T08:50:11.414 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-25T08:50:11.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-25T08:50:11.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-25T08:50:11.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-25T08:50:11.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-25T08:50:11.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-25T08:50:11.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-25T08:50:11.415 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-25T08:50:11.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-25T08:50:11.415 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-25T08:50:11.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-25T08:50:11.415 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-25T08:50:11.415 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-25T08:50:11.415 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-25T08:50:11.415 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-25T08:50:11.416 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-25T08:50:11.416 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-25T08:50:11.416 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-25T08:50:11.416 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-25T08:50:11.416 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-25T08:50:11.416 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-25T08:50:11.416 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-25T08:50:11.416 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-25T08:50:11.416 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-25T08:50:11.468 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-25T08:50:11.468 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-25T08:50:11.468 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-25T08:50:11.468 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-25T08:50:11.468 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-25T08:50:11.468 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-25T08:50:11.468 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-25T08:50:11.468 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-25T08:50:11.468 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-25T08:50:11.469 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-25T08:50:11.469 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-25T08:50:11.469 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-25T08:50:11.469 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-25T08:50:11.469 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-25T08:50:11.469 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-25T08:50:11.469 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-25T08:50:11.469 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-25T08:50:11.469 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-25T08:50:11.469 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-25T08:50:11.469 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-25T08:50:11.469 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-25T08:50:11.469 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-25T08:50:11.470 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-25T08:50:11.470 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-25T08:50:11.470 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-25T08:50:11.470 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-25T08:50:11.470 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-25T08:50:11.470 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-25T08:50:11.470 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-25T08:50:11.470 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-25T08:50:11.470 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-25T08:50:11.470 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-25T08:50:11.470 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-25T08:50:11.470 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-25T08:50:11.470 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-25T08:50:11.470 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-25T08:50:11.471 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-25T08:50:11.471 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-25T08:50:11.471 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-25T08:50:11.471 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-25T08:50:11.471 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-25T08:50:11.471 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-25T08:50:11.471 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-25T08:50:11.471 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-25T08:50:11.471 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-25T08:50:11.471 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-25T08:50:11.471 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-25T08:50:11.471 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-25T08:50:11.471 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-25T08:50:11.471 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-25T08:50:11.472 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-25T08:50:11.472 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-25T08:50:11.472 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-25T08:50:11.472 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-25T08:50:11.472 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-25T08:50:11.472 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-25T08:50:11.472 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-25T08:50:11.472 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-25T08:50:11.472 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-25T08:50:11.472 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-25T08:50:11.472 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-25T08:50:11.472 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-25T08:50:11.472 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-25T08:50:11.473 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-25T08:50:11.473 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-25T08:50:11.473 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-25T08:50:11.473 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-25T08:50:11.473 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-25T08:50:11.473 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-25T08:50:11.473 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-25T08:50:11.473 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-25T08:50:11.473 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-25T08:50:11.473 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-25T08:50:11.473 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-25T08:50:11.473 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-25T08:50:11.473 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-25T08:50:11.474 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-25T08:50:11.474 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-25T08:50:11.474 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-25T08:50:11.474 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-25T08:50:11.474 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-25T08:50:11.474 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-25T08:50:11.474 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-25T08:50:11.474 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-25T08:50:11.474 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-25T08:50:11.475 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-25T08:50:11.475 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-25T08:50:11.475 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-25T08:50:11.475 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-25T08:50:11.475 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-25T08:50:11.475 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-25T08:50:11.475 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-25T08:50:11.475 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-25T08:50:11.475 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-25T08:50:11.475 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-25T08:50:11.475 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-25T08:50:11.475 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-25T08:50:11.476 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-25T08:50:11.476 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-25T08:50:11.476 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-25T08:50:11.476 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-25T08:50:11.476 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-25T08:50:11.476 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-25T08:50:11.476 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-25T08:50:11.476 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-25T08:50:11.476 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-25T08:50:11.476 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-25T08:50:11.476 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-25T08:50:11.476 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-25T08:50:11.476 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-25T08:50:11.476 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-25T08:50:11.476 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-25T08:50:11.477 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-25T08:50:11.477 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-25T08:50:11.477 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-25T08:50:11.477 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-25T08:50:11.477 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-25T08:50:11.477 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-25T08:50:11.477 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-25T08:50:11.477 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-25T08:50:11.477 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-25T08:50:11.477 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-25T08:50:11.477 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-25T08:50:11.477 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-25T08:50:11.477 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-25T08:50:11.477 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-25T08:50:11.478 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-25T08:50:11.478 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-25T08:50:11.478 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-25T08:50:11.478 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-25T08:50:11.478 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-25T08:50:11.478 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-25T08:50:11.478 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-25T08:50:11.478 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-25T08:50:11.478 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-25T08:50:11.478 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-25T08:50:11.478 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-25T08:50:11.478 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-25T08:50:11.479 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-25T08:50:11.479 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-25T08:50:11.479 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-25T08:50:11.479 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-25T08:50:11.479 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-25T08:50:11.479 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-25T08:50:11.479 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-25T08:50:11.479 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-25T08:50:11.479 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-25T08:50:11.479 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-25T08:50:11.479 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-25T08:50:11.479 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-25T08:50:11.479 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-25T08:50:11.479 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-25T08:50:11.480 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-25T08:50:11.480 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-25T08:50:11.480 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-25T08:50:11.480 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-25T08:50:11.480 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-25T08:50:11.480 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-25T08:50:11.480 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-25T08:50:11.480 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-25T08:50:11.480 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-25T08:50:11.480 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-25T08:50:11.480 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-25T08:50:11.480 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-25T08:50:11.480 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-25T08:50:11.481 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-25T08:50:11.481 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-25T08:50:11.481 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-25T08:50:11.481 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-25T08:50:11.481 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-25T08:50:11.481 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-25T08:50:11.481 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-25T08:50:11.481 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-25T08:50:11.481 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-25T08:50:11.481 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-25T08:50:11.481 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-25T08:50:11.482 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-25T08:50:11.482 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-25T08:50:11.482 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-25T08:50:11.482 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-25T08:50:11.482 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-25T08:50:11.482 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-25T08:50:11.482 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-25T08:50:11.482 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-25T08:50:11.482 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-25T08:50:11.482 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-25T08:50:11.482 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-25T08:50:11.482 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-25T08:50:11.483 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-25T08:50:11.483 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-25T08:50:11.483 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-25T08:50:11.483 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-25T08:50:11.483 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-25T08:50:11.483 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-25T08:50:11.483 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-25T08:50:11.483 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-25T08:50:11.483 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-25T08:50:11.483 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-25T08:50:11.483 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-25T08:50:11.483 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-25T08:50:11.484 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-25T08:50:11.484 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-25T08:50:11.484 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-25T08:50:11.484 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-25T08:50:11.484 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-25T08:50:11.484 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-25T08:50:11.484 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-25T08:50:11.484 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-25T08:50:11.484 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-25T08:50:11.484 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-25T08:50:11.484 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-25T08:50:11.484 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-25T08:50:11.484 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-25T08:50:11.485 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-25T08:50:11.485 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-25T08:50:11.485 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-25T08:50:11.485 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-25T08:50:11.485 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-25T08:50:11.485 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-25T08:50:11.485 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-25T08:50:11.485 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-25T08:50:11.485 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-25T08:50:11.485 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-25T08:50:11.485 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-25T08:50:11.485 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-25T08:50:11.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-25T08:50:11.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-25T08:50:11.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-25T08:50:11.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-25T08:50:11.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-25T08:50:11.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-25T08:50:11.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-25T08:50:11.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-25T08:50:11.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-25T08:50:11.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-25T08:50:11.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-25T08:50:11.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-25T08:50:11.486 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-25T08:50:11.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-25T08:50:11.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-25T08:50:11.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-25T08:50:11.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-25T08:50:11.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-25T08:50:11.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-25T08:50:11.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-25T08:50:11.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-25T08:50:11.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-25T08:50:11.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-25T08:50:11.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-25T08:50:11.487 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-25T08:50:11.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-25T08:50:11.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-25T08:50:11.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-25T08:50:11.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-25T08:50:11.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-25T08:50:11.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-25T08:50:11.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-25T08:50:11.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-25T08:50:11.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-25T08:50:11.488 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-25T08:50:11.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-25T08:50:11.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-25T08:50:11.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-25T08:50:11.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-25T08:50:11.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-25T08:50:11.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-25T08:50:11.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-25T08:50:11.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-25T08:50:11.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-25T08:50:11.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-25T08:50:11.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-25T08:50:11.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-25T08:50:11.489 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-25T08:50:11.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-25T08:50:11.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-25T08:50:11.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-25T08:50:11.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-25T08:50:11.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-25T08:50:11.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-25T08:50:11.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-25T08:50:11.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-25T08:50:11.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-25T08:50:11.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-25T08:50:11.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-25T08:50:11.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-25T08:50:11.490 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-25T08:50:11.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-25T08:50:11.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-25T08:50:11.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-25T08:50:11.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-25T08:50:11.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-25T08:50:11.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-25T08:50:11.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-25T08:50:11.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-25T08:50:11.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-25T08:50:11.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-25T08:50:11.491 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-25T08:50:11.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-25T08:50:11.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-25T08:50:11.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-25T08:50:11.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-25T08:50:11.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-25T08:50:11.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-25T08:50:11.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-25T08:50:11.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-25T08:50:11.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-25T08:50:11.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-25T08:50:11.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-25T08:50:11.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-25T08:50:11.492 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-25T08:50:11.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-25T08:50:11.493 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-25T08:50:11.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-25T08:50:11.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-25T08:50:11.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-25T08:50:11.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-25T08:50:11.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-25T08:50:11.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-25T08:50:11.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-25T08:50:11.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-25T08:50:11.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-25T08:50:11.493 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-25T08:50:11.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-25T08:50:11.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-25T08:50:11.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-25T08:50:11.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-25T08:50:11.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-25T08:50:11.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-25T08:50:11.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-25T08:50:11.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-25T08:50:11.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-25T08:50:11.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-25T08:50:11.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-25T08:50:11.494 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-25T08:50:11.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-25T08:50:11.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-25T08:50:11.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-25T08:50:11.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-25T08:50:11.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-25T08:50:11.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-25T08:50:11.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-25T08:50:11.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-25T08:50:11.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-25T08:50:11.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-25T08:50:11.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-25T08:50:11.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-25T08:50:11.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-25T08:50:11.495 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-25T08:50:11.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-25T08:50:11.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-25T08:50:11.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-25T08:50:11.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-25T08:50:11.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-25T08:50:11.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-25T08:50:11.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-25T08:50:11.496 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-25T08:50:11.496 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-25T08:50:11.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-25T08:50:11.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-25T08:50:11.496 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-25T08:50:11.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-25T08:50:11.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-25T08:50:11.496 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-25T08:50:11.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-25T08:50:11.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-25T08:50:11.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-25T08:50:11.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-25T08:50:11.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-25T08:50:11.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-25T08:50:11.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-25T08:50:11.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-25T08:50:11.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-25T08:50:11.497 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-25T08:50:11.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-25T08:50:11.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-25T08:50:11.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-25T08:50:11.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-25T08:50:11.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-25T08:50:11.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-25T08:50:11.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-25T08:50:11.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-25T08:50:11.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-25T08:50:11.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-25T08:50:11.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-25T08:50:11.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-25T08:50:11.498 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-25T08:50:11.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-25T08:50:11.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-25T08:50:11.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-25T08:50:11.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-25T08:50:11.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-25T08:50:11.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-25T08:50:11.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-25T08:50:11.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-25T08:50:11.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-25T08:50:11.499 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-25T08:50:11.500 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-25T08:50:11.500 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-25T08:50:11.500 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-25T08:50:11.500 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-25T08:50:11.500 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-25T08:50:11.500 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-25T08:50:11.500 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-25T08:50:11.500 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-25T08:50:11.500 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-25T08:50:11.500 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-25T08:50:11.500 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-25T08:50:11.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-25T08:50:11.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-25T08:50:11.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-25T08:50:11.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-25T08:50:11.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-25T08:50:11.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-25T08:50:11.501 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-25T08:50:11.501 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-25T08:50:11.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-25T08:50:11.501 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-25T08:50:11.501 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-25T08:50:11.501 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-25T08:50:11.502 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-25T08:50:11.502 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-25T08:50:11.502 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-25T08:50:11.502 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-25T08:50:11.502 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-25T08:50:11.502 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-25T08:50:11.502 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-25T08:50:11.502 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-25T08:50:11.502 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-25T08:50:11.502 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-25T08:50:11.503 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-25T08:50:11.503 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-25T08:50:11.503 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-25T08:50:11.503 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-25T08:50:11.503 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-25T08:50:11.503 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-25T08:50:11.503 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-25T08:50:11.503 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-25T08:50:11.503 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-25T08:50:11.503 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-25T08:50:11.503 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-25T08:50:11.503 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-25T08:50:11.503 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-25T08:50:11.503 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-25T08:50:11.504 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-25T08:50:11.504 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-25T08:50:11.504 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-25T08:50:11.504 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-25T08:50:11.504 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-25T08:50:11.504 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-25T08:50:11.504 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-25T08:50:11.504 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-25T08:50:11.504 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-25T08:50:11.504 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-25T08:50:11.504 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-25T08:50:11.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-25T08:50:11.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-25T08:50:11.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-25T08:50:11.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-25T08:50:11.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-25T08:50:11.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-25T08:50:11.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-25T08:50:11.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-25T08:50:11.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-25T08:50:11.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-25T08:50:11.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-25T08:50:11.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-25T08:50:11.505 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-25T08:50:11.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-25T08:50:11.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-25T08:50:11.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-25T08:50:11.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-25T08:50:11.506 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-25T08:50:11.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-25T08:50:11.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-25T08:50:11.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-25T08:50:11.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-25T08:50:11.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-25T08:50:11.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-25T08:50:11.506 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-25T08:50:11.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-25T08:50:11.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-25T08:50:11.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-25T08:50:11.507 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-25T08:50:11.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-25T08:50:11.507 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-25T08:50:11.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-25T08:50:11.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-25T08:50:11.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-25T08:50:11.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-25T08:50:11.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-25T08:50:11.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-25T08:50:11.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-25T08:50:11.507 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-25T08:50:11.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-25T08:50:11.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-25T08:50:11.508 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-25T08:50:11.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-25T08:50:11.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-25T08:50:11.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-25T08:50:11.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-25T08:50:11.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-25T08:50:11.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-25T08:50:11.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-25T08:50:11.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-25T08:50:11.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-25T08:50:11.508 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-25T08:50:11.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-25T08:50:11.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-25T08:50:11.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-25T08:50:11.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-25T08:50:11.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-25T08:50:11.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-25T08:50:11.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-25T08:50:11.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-25T08:50:11.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-25T08:50:11.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-25T08:50:11.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-25T08:50:11.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-25T08:50:11.509 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-25T08:50:11.509 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-25T08:50:11.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-25T08:50:11.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-25T08:50:11.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-25T08:50:11.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-25T08:50:11.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-25T08:50:11.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-25T08:50:11.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-25T08:50:11.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-25T08:50:11.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-25T08:50:11.510 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-25T08:50:11.510 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-25T08:50:11.510 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-25T08:50:11.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-25T08:50:11.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-25T08:50:11.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-25T08:50:11.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-25T08:50:11.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-25T08:50:11.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-25T08:50:11.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-25T08:50:11.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-25T08:50:11.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-25T08:50:11.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-25T08:50:11.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-25T08:50:11.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-25T08:50:11.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-25T08:50:11.511 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-25T08:50:11.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-25T08:50:11.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-25T08:50:11.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-25T08:50:11.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-25T08:50:11.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-25T08:50:11.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-25T08:50:11.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-25T08:50:11.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-25T08:50:11.512 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-25T08:50:11.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-25T08:50:11.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-25T08:50:11.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-25T08:50:11.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-25T08:50:11.512 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-25T08:50:11.513 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-25T08:50:11.513 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-25T08:50:11.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-25T08:50:11.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-25T08:50:11.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-25T08:50:11.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-25T08:50:11.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-25T08:50:11.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-25T08:50:11.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-25T08:50:11.513 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-25T08:50:11.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-25T08:50:11.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-25T08:50:11.513 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-25T08:50:11.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-25T08:50:11.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-25T08:50:11.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-25T08:50:11.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-25T08:50:11.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-25T08:50:11.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-25T08:50:11.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-25T08:50:11.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-25T08:50:11.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-25T08:50:11.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-25T08:50:11.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-25T08:50:11.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-25T08:50:11.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-25T08:50:11.514 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-25T08:50:11.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-25T08:50:11.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-25T08:50:11.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-25T08:50:11.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-25T08:50:11.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-25T08:50:11.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-25T08:50:11.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-25T08:50:11.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-25T08:50:11.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-25T08:50:11.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-25T08:50:11.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-25T08:50:11.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-25T08:50:11.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-25T08:50:11.515 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-25T08:50:11.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-25T08:50:11.516 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-25T08:50:11.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-25T08:50:11.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-25T08:50:11.516 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-25T08:50:11.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-25T08:50:11.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-25T08:50:11.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-25T08:50:11.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-25T08:50:11.516 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-25T08:50:11.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-25T08:50:11.516 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-25T08:50:11.516 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-25T08:50:11.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-25T08:50:11.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-25T08:50:11.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-25T08:50:11.517 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-25T08:50:11.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-25T08:50:11.517 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-25T08:50:11.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-25T08:50:11.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-25T08:50:11.517 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-25T08:50:11.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-25T08:50:11.518 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-25T08:50:11.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-25T08:50:11.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-25T08:50:11.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-25T08:50:11.518 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-25T08:50:11.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-25T08:50:11.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-25T08:50:11.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-25T08:50:11.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-25T08:50:11.518 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-25T08:50:11.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-25T08:50:11.518 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-25T08:50:11.519 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-25T08:50:11.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-25T08:50:11.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-25T08:50:11.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-25T08:50:11.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-25T08:50:11.519 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-25T08:50:11.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-25T08:50:11.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-25T08:50:11.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-25T08:50:11.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-25T08:50:11.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-25T08:50:11.519 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-25T08:50:11.519 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-25T08:50:11.520 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-25T08:50:11.520 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-25T08:50:11.520 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-25T08:50:11.520 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-25T08:50:11.520 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-25T08:50:11.520 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-25T08:50:11.520 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-25T08:50:11.520 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-25T08:50:11.520 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-25T08:50:11.520 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-25T08:50:11.520 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-25T08:50:11.520 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-25T08:50:11.520 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-25T08:50:11.520 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-25T08:50:11.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-25T08:50:11.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-25T08:50:11.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-25T08:50:11.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-25T08:50:11.521 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-25T08:50:11.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-25T08:50:11.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-25T08:50:11.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-25T08:50:11.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-25T08:50:11.521 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-25T08:50:11.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-25T08:50:11.521 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-25T08:50:11.521 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-25T08:50:11.522 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-25T08:50:11.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-25T08:50:11.522 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-25T08:50:11.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-25T08:50:11.522 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-25T08:50:11.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-25T08:50:11.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-25T08:50:11.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-25T08:50:11.522 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-25T08:50:11.522 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-25T08:50:11.522 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-25T08:50:11.522 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-25T08:50:11.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-25T08:50:11.523 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-25T08:50:11.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-25T08:50:11.523 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-25T08:50:11.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-25T08:50:11.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-25T08:50:11.523 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-25T08:50:11.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-25T08:50:11.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-25T08:50:11.523 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-25T08:50:11.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-25T08:50:11.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-25T08:50:11.523 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-25T08:50:11.523 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-25T08:50:11.596 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-25T08:50:11.596 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-25T08:50:11.596 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-25T08:50:11.596 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-25T08:50:11.596 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-25T08:50:11.596 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-25T08:50:11.596 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-25T08:50:11.596 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-25T08:50:11.597 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-25T08:50:11.597 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-25T08:50:11.597 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-25T08:50:11.597 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-25T08:50:11.597 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-25T08:50:11.597 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-25T08:50:11.597 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-25T08:50:11.597 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-25T08:50:11.597 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-25T08:50:11.597 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-25T08:50:11.597 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-25T08:50:11.597 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-25T08:50:11.597 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-25T08:50:11.597 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-25T08:50:11.598 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-25T08:50:11.598 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-25T08:50:11.598 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-25T08:50:11.598 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-25T08:50:11.598 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-25T08:50:11.598 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-25T08:50:11.598 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-25T08:50:11.598 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-25T08:50:11.598 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-25T08:50:11.598 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-25T08:50:11.598 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-25T08:50:11.598 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-25T08:50:11.599 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-25T08:50:11.599 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-25T08:50:11.599 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-25T08:50:11.599 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-25T08:50:11.599 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-25T08:50:11.599 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-25T08:50:11.599 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-25T08:50:11.599 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-25T08:50:11.599 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-25T08:50:11.599 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-25T08:50:11.599 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-25T08:50:11.599 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-25T08:50:11.599 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-25T08:50:11.600 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-25T08:50:11.600 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-25T08:50:11.600 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-25T08:50:11.600 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-25T08:50:11.600 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-25T08:50:11.600 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-25T08:50:11.600 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-25T08:50:11.600 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-25T08:50:11.600 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-25T08:50:11.600 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-25T08:50:11.600 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-25T08:50:11.600 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-25T08:50:11.600 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-25T08:50:11.600 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-25T08:50:11.601 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-25T08:50:11.601 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-25T08:50:11.601 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-25T08:50:11.601 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-25T08:50:11.601 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-25T08:50:11.601 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-25T08:50:11.601 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-25T08:50:11.601 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-25T08:50:11.601 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-25T08:50:11.601 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-25T08:50:11.601 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-25T08:50:11.601 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-25T08:50:11.602 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-25T08:50:11.602 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-25T08:50:11.602 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-25T08:50:11.602 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-25T08:50:11.602 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-25T08:50:11.602 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-25T08:50:11.602 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-25T08:50:11.602 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-25T08:50:11.602 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-25T08:50:11.602 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-25T08:50:11.602 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-25T08:50:11.602 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-25T08:50:11.603 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-25T08:50:11.603 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-25T08:50:11.603 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-25T08:50:11.603 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-25T08:50:11.603 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-25T08:50:11.603 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-25T08:50:11.603 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-25T08:50:11.603 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-25T08:50:11.603 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-25T08:50:11.603 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-25T08:50:11.603 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-25T08:50:11.603 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-25T08:50:11.603 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-25T08:50:11.604 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-25T08:50:11.604 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-25T08:50:11.604 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-25T08:50:11.604 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-25T08:50:11.604 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-25T08:50:11.604 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-25T08:50:11.604 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-25T08:50:11.604 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-25T08:50:11.604 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-25T08:50:11.604 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-25T08:50:11.604 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-25T08:50:11.604 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-25T08:50:11.605 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-25T08:50:11.605 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-25T08:50:11.605 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-25T08:50:11.605 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-25T08:50:11.605 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-25T08:50:11.605 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-25T08:50:11.605 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-25T08:50:11.605 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-25T08:50:11.605 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-25T08:50:11.605 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-25T08:50:11.605 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-25T08:50:11.605 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-25T08:50:11.605 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-25T08:50:11.605 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-25T08:50:11.606 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-25T08:50:11.606 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-25T08:50:11.606 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-25T08:50:11.606 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-25T08:50:11.606 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-25T08:50:11.606 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-25T08:50:11.606 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-25T08:50:11.606 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-25T08:50:11.606 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-25T08:50:11.606 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-25T08:50:11.606 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-25T08:50:11.606 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-25T08:50:11.606 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-25T08:50:11.607 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-25T08:50:11.607 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-25T08:50:11.607 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-25T08:50:11.607 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-25T08:50:11.607 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-25T08:50:11.607 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-25T08:50:11.607 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-25T08:50:11.607 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-25T08:50:11.607 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-25T08:50:11.607 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-25T08:50:11.607 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-25T08:50:11.607 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-25T08:50:11.607 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-25T08:50:11.607 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-25T08:50:11.608 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-25T08:50:11.608 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-25T08:50:11.608 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-25T08:50:11.608 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-25T08:50:11.608 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-25T08:50:11.608 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-25T08:50:11.608 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-25T08:50:11.608 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-25T08:50:11.608 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-25T08:50:11.608 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-25T08:50:11.608 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-25T08:50:11.608 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-25T08:50:11.609 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-25T08:50:11.609 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-25T08:50:11.609 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-25T08:50:11.609 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-25T08:50:11.609 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-25T08:50:11.609 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-25T08:50:11.609 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-25T08:50:11.609 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-25T08:50:11.609 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-25T08:50:11.609 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-25T08:50:11.609 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-25T08:50:11.609 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-25T08:50:11.609 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-25T08:50:11.609 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-25T08:50:11.610 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-25T08:50:11.610 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-25T08:50:11.610 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-25T08:50:11.610 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-25T08:50:11.610 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-25T08:50:11.610 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-25T08:50:11.610 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-25T08:50:11.610 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-25T08:50:11.610 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-25T08:50:11.610 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-25T08:50:11.610 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-25T08:50:11.610 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-25T08:50:11.611 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-25T08:50:11.611 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-25T08:50:11.611 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-25T08:50:11.611 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-25T08:50:11.611 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-25T08:50:11.611 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-25T08:50:11.611 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-25T08:50:11.611 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-25T08:50:11.611 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-25T08:50:11.611 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-25T08:50:11.611 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-25T08:50:11.612 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-25T08:50:11.612 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-25T08:50:11.612 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-25T08:50:11.612 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-25T08:50:11.612 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-25T08:50:11.612 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-25T08:50:11.612 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-25T08:50:11.612 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-25T08:50:11.612 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-25T08:50:11.612 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-25T08:50:11.612 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-25T08:50:11.612 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-25T08:50:11.613 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-25T08:50:11.613 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-25T08:50:11.613 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-25T08:50:11.613 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-25T08:50:11.613 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-25T08:50:11.613 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-25T08:50:11.613 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-25T08:50:11.613 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-25T08:50:11.613 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-25T08:50:11.613 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-25T08:50:11.613 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-25T08:50:11.613 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-25T08:50:11.614 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-25T08:50:11.614 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-25T08:50:11.614 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-25T08:50:11.614 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-25T08:50:11.614 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-25T08:50:11.614 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-25T08:50:11.614 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-25T08:50:11.614 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-25T08:50:11.614 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-25T08:50:11.614 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-25T08:50:11.614 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-25T08:50:11.614 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-25T08:50:11.614 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-25T08:50:11.615 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-25T08:50:11.615 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-25T08:50:11.615 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-25T08:50:11.615 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-25T08:50:11.615 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-25T08:50:11.615 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-25T08:50:11.615 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-25T08:50:11.615 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-25T08:50:11.615 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-25T08:50:11.615 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-25T08:50:11.615 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-25T08:50:11.615 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-25T08:50:11.615 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-25T08:50:11.616 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-25T08:50:11.616 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-25T08:50:11.616 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-25T08:50:11.616 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-25T08:50:11.616 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-25T08:50:11.616 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-25T08:50:11.616 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-25T08:50:11.616 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-25T08:50:11.616 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-25T08:50:11.616 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-25T08:50:11.616 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-25T08:50:11.616 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-25T08:50:11.616 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-25T08:50:11.617 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-25T08:50:11.617 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-25T08:50:11.617 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-25T08:50:11.617 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-25T08:50:11.617 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-25T08:50:11.617 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-25T08:50:11.617 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-25T08:50:11.617 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-25T08:50:11.617 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-25T08:50:11.617 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-25T08:50:11.617 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-25T08:50:11.618 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-25T08:50:11.618 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-25T08:50:11.618 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-25T08:50:11.618 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-25T08:50:11.618 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-25T08:50:11.618 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-25T08:50:11.618 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-25T08:50:11.618 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-25T08:50:11.618 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-25T08:50:11.618 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-25T08:50:11.618 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-25T08:50:11.619 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-25T08:50:11.619 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-25T08:50:11.619 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-25T08:50:11.619 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-25T08:50:11.619 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-25T08:50:11.619 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-25T08:50:11.619 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-25T08:50:11.619 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-25T08:50:11.619 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-25T08:50:11.619 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-25T08:50:11.619 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-25T08:50:11.619 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-25T08:50:11.620 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-25T08:50:11.620 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-25T08:50:11.620 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-25T08:50:11.620 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-25T08:50:11.620 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-25T08:50:11.620 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-25T08:50:11.620 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-25T08:50:11.620 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-25T08:50:11.620 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-25T08:50:11.620 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-25T08:50:11.620 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-25T08:50:11.621 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-25T08:50:11.621 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-25T08:50:11.621 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-25T08:50:11.621 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-25T08:50:11.621 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-25T08:50:11.621 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-25T08:50:11.621 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-25T08:50:11.621 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-25T08:50:11.621 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-25T08:50:11.621 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-25T08:50:11.621 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-25T08:50:11.621 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-25T08:50:11.621 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-25T08:50:11.621 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-25T08:50:11.621 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-25T08:50:11.622 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-25T08:50:11.622 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-25T08:50:11.622 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-25T08:50:11.622 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-25T08:50:11.622 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-25T08:50:11.622 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-25T08:50:11.622 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-25T08:50:11.622 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-25T08:50:11.622 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-25T08:50:11.622 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-25T08:50:11.622 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-25T08:50:11.622 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-25T08:50:11.622 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-25T08:50:11.622 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-25T08:50:11.623 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-25T08:50:11.623 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-25T08:50:11.623 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-25T08:50:11.623 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-25T08:50:11.623 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-25T08:50:11.623 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-25T08:50:11.623 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-25T08:50:11.623 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-25T08:50:11.623 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-25T08:50:11.623 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-25T08:50:11.623 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-25T08:50:11.623 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-25T08:50:11.623 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-25T08:50:11.623 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-25T08:50:11.623 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-25T08:50:11.623 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-25T08:50:11.624 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-25T08:50:11.624 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-25T08:50:11.624 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-25T08:50:11.624 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-25T08:50:11.624 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-25T08:50:11.624 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-25T08:50:11.624 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-25T08:50:11.624 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-25T08:50:11.624 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-25T08:50:11.624 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-25T08:50:11.624 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-25T08:50:11.624 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-25T08:50:11.624 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-25T08:50:11.624 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-25T08:50:11.624 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-25T08:50:11.625 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-25T08:50:11.625 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-25T08:50:11.625 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-25T08:50:11.625 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-25T08:50:11.625 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-25T08:50:11.625 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-25T08:50:11.625 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-25T08:50:11.625 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-25T08:50:11.625 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-25T08:50:11.625 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-25T08:50:11.625 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-25T08:50:11.625 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-25T08:50:11.625 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-25T08:50:11.625 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-25T08:50:11.626 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-25T08:50:11.626 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-25T08:50:11.626 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-25T08:50:11.626 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-25T08:50:11.626 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-25T08:50:11.626 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-25T08:50:11.626 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-25T08:50:11.626 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-25T08:50:11.626 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-25T08:50:11.626 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-25T08:50:11.626 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-25T08:50:11.626 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-25T08:50:11.626 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-25T08:50:11.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-25T08:50:11.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-25T08:50:11.627 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-25T08:50:11.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-25T08:50:11.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-25T08:50:11.627 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-25T08:50:11.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-25T08:50:11.627 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-25T08:50:11.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-25T08:50:11.627 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-25T08:50:11.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-25T08:50:11.627 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-25T08:50:11.627 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-25T08:50:11.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-25T08:50:11.628 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-25T08:50:11.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-25T08:50:11.628 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-25T08:50:11.628 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-25T08:50:11.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-25T08:50:11.628 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-25T08:50:11.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-25T08:50:11.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-25T08:50:11.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-25T08:50:11.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-25T08:50:11.628 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-25T08:50:11.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-25T08:50:11.628 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-25T08:50:11.629 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-25T08:50:11.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-25T08:50:11.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-25T08:50:11.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-25T08:50:11.629 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-25T08:50:11.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-25T08:50:11.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-25T08:50:11.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-25T08:50:11.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-25T08:50:11.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-25T08:50:11.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-25T08:50:11.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-25T08:50:11.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-25T08:50:11.629 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-25T08:50:11.629 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-25T08:50:11.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-25T08:50:11.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-25T08:50:11.630 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-25T08:50:11.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-25T08:50:11.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-25T08:50:11.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-25T08:50:11.630 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-25T08:50:11.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-25T08:50:11.630 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-25T08:50:11.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-25T08:50:11.630 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-25T08:50:11.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-25T08:50:11.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-25T08:50:11.630 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-25T08:50:11.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-25T08:50:11.631 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-25T08:50:11.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-25T08:50:11.631 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-25T08:50:11.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-25T08:50:11.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-25T08:50:11.631 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-25T08:50:11.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-25T08:50:11.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-25T08:50:11.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-25T08:50:11.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-25T08:50:11.631 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-25T08:50:11.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-25T08:50:11.631 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-25T08:50:11.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-25T08:50:11.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-25T08:50:11.632 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-25T08:50:11.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-25T08:50:11.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-25T08:50:11.632 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-25T08:50:11.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-25T08:50:11.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-25T08:50:11.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-25T08:50:11.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-25T08:50:11.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-25T08:50:11.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-25T08:50:11.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-25T08:50:11.632 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-25T08:50:11.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-25T08:50:11.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-25T08:50:11.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-25T08:50:11.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-25T08:50:11.633 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-25T08:50:11.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-25T08:50:11.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-25T08:50:11.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-25T08:50:11.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-25T08:50:11.633 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-25T08:50:11.633 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-25T08:50:11.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-25T08:50:11.634 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-25T08:50:11.634 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-25T08:50:11.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-25T08:50:11.634 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-25T08:50:11.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-25T08:50:11.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-25T08:50:11.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-25T08:50:11.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-25T08:50:11.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-25T08:50:11.634 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-25T08:50:11.635 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-25T08:50:11.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-25T08:50:11.635 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-25T08:50:11.635 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-25T08:50:11.635 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-25T08:50:11.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-25T08:50:11.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-25T08:50:11.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-25T08:50:11.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-25T08:50:11.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-25T08:50:11.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-25T08:50:11.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-25T08:50:11.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-25T08:50:11.635 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-25T08:50:11.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-25T08:50:11.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-25T08:50:11.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-25T08:50:11.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-25T08:50:11.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-25T08:50:11.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-25T08:50:11.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-25T08:50:11.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-25T08:50:11.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-25T08:50:11.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-25T08:50:11.636 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-25T08:50:11.636 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-25T08:50:11.636 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-25T08:50:11.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-25T08:50:11.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-25T08:50:11.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-25T08:50:11.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-25T08:50:11.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-25T08:50:11.637 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-25T08:50:11.637 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-25T08:50:11.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-25T08:50:11.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-25T08:50:11.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-25T08:50:11.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-25T08:50:11.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-25T08:50:11.637 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-25T08:50:11.637 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-25T08:50:11.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-25T08:50:11.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-25T08:50:11.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-25T08:50:11.638 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-25T08:50:11.638 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-25T08:50:11.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-25T08:50:11.638 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-25T08:50:11.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-25T08:50:11.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-25T08:50:11.638 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-25T08:50:11.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-25T08:50:11.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-25T08:50:11.638 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-25T08:50:11.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-25T08:50:11.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-25T08:50:11.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-25T08:50:11.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-25T08:50:11.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-25T08:50:11.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-25T08:50:11.639 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-25T08:50:11.639 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-25T08:50:11.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-25T08:50:11.639 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-25T08:50:11.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-25T08:50:11.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-25T08:50:11.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-25T08:50:11.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-25T08:50:11.639 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-25T08:50:11.640 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-25T08:50:11.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-25T08:50:11.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-25T08:50:11.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-25T08:50:11.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-25T08:50:11.640 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-25T08:50:11.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-25T08:50:11.640 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-25T08:50:11.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-25T08:50:11.640 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-25T08:50:11.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-25T08:50:11.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-25T08:50:11.640 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-25T08:50:11.640 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-25T08:50:11.641 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-25T08:50:11.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-25T08:50:11.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-25T08:50:11.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-25T08:50:11.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-25T08:50:11.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-25T08:50:11.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-25T08:50:11.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-25T08:50:11.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-25T08:50:11.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-25T08:50:11.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-25T08:50:11.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-25T08:50:11.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-25T08:50:11.641 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-25T08:50:11.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-25T08:50:11.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-25T08:50:11.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-25T08:50:11.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-25T08:50:11.642 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-25T08:50:11.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-25T08:50:11.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-25T08:50:11.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-25T08:50:11.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-25T08:50:11.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-25T08:50:11.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-25T08:50:11.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-25T08:50:11.642 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-25T08:50:11.643 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-25T08:50:11.643 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-25T08:50:11.643 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-25T08:50:11.643 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-25T08:50:11.643 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-25T08:50:11.643 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-25T08:50:11.643 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-25T08:50:11.643 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-25T08:50:11.643 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-25T08:50:11.643 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-25T08:50:11.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-25T08:50:11.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-25T08:50:11.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-25T08:50:11.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-25T08:50:11.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-25T08:50:11.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-25T08:50:11.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-25T08:50:11.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-25T08:50:11.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-25T08:50:11.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-25T08:50:11.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-25T08:50:11.644 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-25T08:50:11.645 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-25T08:50:11.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-25T08:50:11.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-25T08:50:11.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-25T08:50:11.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-25T08:50:11.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-25T08:50:11.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-25T08:50:11.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-25T08:50:11.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-25T08:50:11.645 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-25T08:50:11.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-25T08:50:11.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-25T08:50:11.645 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-25T08:50:11.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-25T08:50:11.645 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-25T08:50:11.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-25T08:50:11.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-25T08:50:11.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-25T08:50:11.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-25T08:50:11.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-25T08:50:11.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-25T08:50:11.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-25T08:50:11.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-25T08:50:11.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-25T08:50:11.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-25T08:50:11.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-25T08:50:11.646 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-25T08:50:11.647 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-25T08:50:11.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-25T08:50:11.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-25T08:50:11.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-25T08:50:11.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-25T08:50:11.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-25T08:50:11.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-25T08:50:11.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-25T08:50:11.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-25T08:50:11.647 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-25T08:50:11.647 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-25T08:50:11.647 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-25T08:50:11.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-25T08:50:11.648 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-25T08:50:11.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-25T08:50:11.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-25T08:50:11.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-25T08:50:11.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-25T08:50:11.648 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-25T08:50:11.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-25T08:50:11.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-25T08:50:11.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-25T08:50:11.648 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-25T08:50:11.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-25T08:50:11.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-25T08:50:11.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-25T08:50:11.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-25T08:50:11.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-25T08:50:11.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-25T08:50:11.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-25T08:50:11.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-25T08:50:11.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-25T08:50:11.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-25T08:50:11.649 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-25T08:50:11.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-25T08:50:11.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-25T08:50:11.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-25T08:50:11.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-25T08:50:11.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-25T08:50:11.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-25T08:50:11.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-25T08:50:11.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-25T08:50:11.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-25T08:50:11.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-25T08:50:11.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-25T08:50:11.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-25T08:50:11.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-25T08:50:11.650 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-25T08:50:11.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-25T08:50:11.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-25T08:50:11.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-25T08:50:11.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-25T08:50:11.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-25T08:50:11.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-25T08:50:11.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-25T08:50:11.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-25T08:50:11.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-25T08:50:11.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-25T08:50:11.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-25T08:50:11.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-25T08:50:11.651 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-25T08:50:11.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-25T08:50:11.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-25T08:50:11.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-25T08:50:11.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-25T08:50:11.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-25T08:50:11.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-25T08:50:11.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-25T08:50:11.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-25T08:50:11.652 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-25T08:50:11.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-25T08:50:11.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-25T08:50:11.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-25T08:50:11.652 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-25T08:50:11.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-25T08:50:11.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-25T08:50:11.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-25T08:50:11.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-25T08:50:11.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-25T08:50:11.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-25T08:50:11.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-25T08:50:11.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-25T08:50:11.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-25T08:50:11.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-25T08:50:11.653 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-25T08:50:11.653 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-25T08:50:11.654 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-25T08:50:11.654 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-25T08:50:11.654 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-25T08:50:11.654 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-25T08:50:11.654 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-25T08:50:11.654 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-25T08:50:11.654 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-25T08:50:11.654 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-25T08:50:11.654 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-25T08:50:11.654 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-25T08:50:11.654 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-25T08:50:11.654 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-25T08:50:11.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-25T08:50:11.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-25T08:50:11.655 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-25T08:50:11.655 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-25T08:50:11.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-25T08:50:11.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-25T08:50:11.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-25T08:50:11.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-25T08:50:11.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-25T08:50:11.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-25T08:50:11.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-25T08:50:11.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-25T08:50:11.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-25T08:50:11.655 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-25T08:50:11.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-25T08:50:11.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-25T08:50:11.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-25T08:50:11.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-25T08:50:11.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-25T08:50:11.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-25T08:50:11.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-25T08:50:11.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-25T08:50:11.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-25T08:50:11.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-25T08:50:11.656 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-25T08:50:11.656 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-25T08:50:11.656 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-25T08:50:11.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-25T08:50:11.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-25T08:50:11.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-25T08:50:11.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-25T08:50:11.657 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-25T08:50:11.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-25T08:50:11.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-25T08:50:11.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-25T08:50:11.657 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-25T08:50:11.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-25T08:50:11.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-25T08:50:11.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-25T08:50:11.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-25T08:50:11.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-25T08:50:11.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-25T08:50:11.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-25T08:50:11.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-25T08:50:11.658 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-25T08:50:11.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-25T08:50:11.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-25T08:50:11.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-25T08:50:11.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-25T08:50:11.658 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-25T08:50:11.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-25T08:50:11.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-25T08:50:11.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-25T08:50:11.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-25T08:50:11.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-25T08:50:11.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-25T08:50:11.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-25T08:50:11.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-25T08:50:11.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-25T08:50:11.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-25T08:50:11.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-25T08:50:11.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-25T08:50:11.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-25T08:50:11.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-25T08:50:11.659 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-25T08:50:11.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-25T08:50:11.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-25T08:50:11.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-25T08:50:11.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-25T08:50:11.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-25T08:50:11.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-25T08:50:11.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-25T08:50:11.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-25T08:50:11.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-25T08:50:11.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-25T08:50:11.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-25T08:50:11.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-25T08:50:11.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-25T08:50:11.660 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-25T08:50:11.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-25T08:50:11.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-25T08:50:11.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-25T08:50:11.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-25T08:50:11.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-25T08:50:11.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-25T08:50:11.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-25T08:50:11.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-25T08:50:11.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-25T08:50:11.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-25T08:50:11.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-25T08:50:11.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-25T08:50:11.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-25T08:50:11.661 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-25T08:50:11.662 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-25T08:50:11.662 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-25T08:50:11.662 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-25T08:50:11.662 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-25T08:50:11.662 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-25T08:50:11.662 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-25T08:50:11.662 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-25T08:50:11.662 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-25T08:50:11.662 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-25T08:50:11.662 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-25T08:50:11.662 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-25T08:50:11.662 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-25T08:50:11.662 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-25T08:50:11.663 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-25T08:50:11.663 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-25T08:50:11.663 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-25T08:50:11.663 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-25T08:50:11.663 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-25T08:50:11.663 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-25T08:50:11.663 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-25T08:50:11.663 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-25T08:50:11.663 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-25T08:50:11.663 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-25T08:50:11.663 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-25T08:50:11.663 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-25T08:50:11.663 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-25T08:50:11.663 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-25T08:50:11.663 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-25T08:50:11.664 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-25T08:50:11.664 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-25T08:50:11.664 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-25T08:50:11.664 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-25T08:50:11.664 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-25T08:50:11.664 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-25T08:50:11.664 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-25T08:50:11.664 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-25T08:50:11.664 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-25T08:50:11.664 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-25T08:50:11.664 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-25T08:50:11.664 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-25T08:50:11.664 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-25T08:50:11.664 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-25T08:50:11.665 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-25T08:50:11.665 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-25T08:50:11.712 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-25T08:50:11.712 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-25T08:50:11.712 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-25T08:50:11.712 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-25T08:50:11.712 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-25T08:50:11.712 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-25T08:50:11.712 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-25T08:50:11.712 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-25T08:50:11.712 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-25T08:50:11.712 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-25T08:50:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-25T08:50:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-25T08:50:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-25T08:50:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-25T08:50:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-25T08:50:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-25T08:50:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-25T08:50:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-25T08:50:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-25T08:50:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-25T08:50:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-25T08:50:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-25T08:50:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-25T08:50:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-25T08:50:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-25T08:50:11.714 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-25T08:50:11.714 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-25T08:50:11.714 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-25T08:50:11.714 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-25T08:50:11.714 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-25T08:50:11.714 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-25T08:50:11.714 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-25T08:50:11.714 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-25T08:50:11.714 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-25T08:50:11.714 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-25T08:50:11.714 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-25T08:50:11.714 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-25T08:50:11.714 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-25T08:50:11.715 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-25T08:50:11.715 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-25T08:50:11.715 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-25T08:50:11.715 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-25T08:50:11.715 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-25T08:50:11.715 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-25T08:50:11.715 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-25T08:50:11.715 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-25T08:50:11.715 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-25T08:50:11.715 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-25T08:50:11.715 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-25T08:50:11.715 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-25T08:50:11.715 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-25T08:50:11.715 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-25T08:50:11.716 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-25T08:50:11.716 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-25T08:50:11.716 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-25T08:50:11.716 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-25T08:50:11.716 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-25T08:50:11.716 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-25T08:50:11.716 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-25T08:50:11.716 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-25T08:50:11.716 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-25T08:50:11.716 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-25T08:50:11.716 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-25T08:50:11.716 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-25T08:50:11.716 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-25T08:50:11.716 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-25T08:50:11.716 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-25T08:50:11.716 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-25T08:50:11.717 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-25T08:50:11.717 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-25T08:50:11.717 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-25T08:50:11.717 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-25T08:50:11.717 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-25T08:50:11.717 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-25T08:50:11.717 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-25T08:50:11.717 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-25T08:50:11.717 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-25T08:50:11.717 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-25T08:50:11.717 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-25T08:50:11.717 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-25T08:50:11.717 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-25T08:50:11.717 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-25T08:50:11.718 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-25T08:50:11.718 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-25T08:50:11.718 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-25T08:50:11.718 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-25T08:50:11.718 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-25T08:50:11.718 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-25T08:50:11.718 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-25T08:50:11.718 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-25T08:50:11.718 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-25T08:50:11.718 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-25T08:50:11.718 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-25T08:50:11.718 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-25T08:50:11.718 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-25T08:50:11.719 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-25T08:50:11.719 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-25T08:50:11.719 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-25T08:50:11.719 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-25T08:50:11.719 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-25T08:50:11.719 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-25T08:50:11.719 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-25T08:50:11.719 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-25T08:50:11.719 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-25T08:50:11.719 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-25T08:50:11.719 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-25T08:50:11.719 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-25T08:50:11.719 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-25T08:50:11.719 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-25T08:50:11.720 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-25T08:50:11.720 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-25T08:50:11.720 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-25T08:50:11.720 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-25T08:50:11.720 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-25T08:50:11.720 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-25T08:50:11.720 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-25T08:50:11.720 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-25T08:50:11.720 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-25T08:50:11.720 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-25T08:50:11.720 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-25T08:50:11.720 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-25T08:50:11.720 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-25T08:50:11.720 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-25T08:50:11.720 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-25T08:50:11.720 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-25T08:50:11.721 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-25T08:50:11.721 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-25T08:50:11.721 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-25T08:50:11.721 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-25T08:50:11.721 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-25T08:50:11.721 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-25T08:50:11.721 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-25T08:50:11.721 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-25T08:50:11.721 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-25T08:50:11.721 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-25T08:50:11.721 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-25T08:50:11.721 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-25T08:50:11.721 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-25T08:50:11.721 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-25T08:50:11.721 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-25T08:50:11.721 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-25T08:50:11.722 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-25T08:50:11.722 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-25T08:50:11.722 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-25T08:50:11.722 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-25T08:50:11.722 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-25T08:50:11.722 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-25T08:50:11.722 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-25T08:50:11.722 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-25T08:50:11.722 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-25T08:50:11.722 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-25T08:50:11.722 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-25T08:50:11.722 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-25T08:50:11.722 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-25T08:50:11.722 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-25T08:50:11.723 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-25T08:50:11.723 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-25T08:50:11.723 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-25T08:50:11.723 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-25T08:50:11.723 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-25T08:50:11.723 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-25T08:50:11.723 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-25T08:50:11.723 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-25T08:50:11.723 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-25T08:50:11.723 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-25T08:50:11.723 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-25T08:50:11.723 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-25T08:50:11.723 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-25T08:50:11.724 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-25T08:50:11.724 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-25T08:50:11.724 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-25T08:50:11.724 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-25T08:50:11.724 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-25T08:50:11.724 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-25T08:50:11.724 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-25T08:50:11.724 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-25T08:50:11.724 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-25T08:50:11.724 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-25T08:50:11.724 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-25T08:50:11.724 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-25T08:50:11.724 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-25T08:50:11.724 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-25T08:50:11.725 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-25T08:50:11.725 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-25T08:50:11.725 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-25T08:50:11.725 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-25T08:50:11.725 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-25T08:50:11.725 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-25T08:50:11.725 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-25T08:50:11.725 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-25T08:50:11.725 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-25T08:50:11.725 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-25T08:50:11.725 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-25T08:50:11.725 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-25T08:50:11.725 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-25T08:50:11.725 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-25T08:50:11.725 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-25T08:50:11.726 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-25T08:50:11.726 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-25T08:50:11.726 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-25T08:50:11.726 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-25T08:50:11.726 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-25T08:50:11.726 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-25T08:50:11.726 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-25T08:50:11.726 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-25T08:50:11.726 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-25T08:50:11.726 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-25T08:50:11.726 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-25T08:50:11.726 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-25T08:50:11.726 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-25T08:50:11.726 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-25T08:50:11.726 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-25T08:50:11.727 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-25T08:50:11.727 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-25T08:50:11.727 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-25T08:50:11.727 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-25T08:50:11.727 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-25T08:50:11.727 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-25T08:50:11.727 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-25T08:50:11.727 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-25T08:50:11.727 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-25T08:50:11.727 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-25T08:50:11.727 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-25T08:50:11.727 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-25T08:50:11.727 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-25T08:50:11.727 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-25T08:50:11.727 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-25T08:50:11.727 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-25T08:50:11.728 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-25T08:50:11.728 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-25T08:50:11.728 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-25T08:50:11.728 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-25T08:50:11.728 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-25T08:50:11.728 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-25T08:50:11.728 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-25T08:50:11.728 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-25T08:50:11.728 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-25T08:50:11.728 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-25T08:50:11.728 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-25T08:50:11.728 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-25T08:50:11.728 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-25T08:50:11.728 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-25T08:50:11.729 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-25T08:50:11.729 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-25T08:50:11.729 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-25T08:50:11.729 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-25T08:50:11.729 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-25T08:50:11.729 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-25T08:50:11.729 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-25T08:50:11.729 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-25T08:50:11.729 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-25T08:50:11.729 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-25T08:50:11.729 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-25T08:50:11.729 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-25T08:50:11.729 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-25T08:50:11.729 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-25T08:50:11.729 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-25T08:50:11.729 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-25T08:50:11.730 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-25T08:50:11.730 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-25T08:50:11.730 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-25T08:50:11.730 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-25T08:50:11.730 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-25T08:50:11.730 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-25T08:50:11.730 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-25T08:50:11.730 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-25T08:50:11.730 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-25T08:50:11.730 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-25T08:50:11.730 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-25T08:50:11.730 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-25T08:50:11.730 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-25T08:50:11.731 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-25T08:50:11.731 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-25T08:50:11.731 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-25T08:50:11.731 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-25T08:50:11.731 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-25T08:50:11.731 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-25T08:50:11.731 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-25T08:50:11.731 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-25T08:50:11.731 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-25T08:50:11.731 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-25T08:50:11.731 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-25T08:50:11.731 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-25T08:50:11.731 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-25T08:50:11.731 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-25T08:50:11.732 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-25T08:50:11.732 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-25T08:50:11.732 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-25T08:50:11.732 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-25T08:50:11.732 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-25T08:50:11.732 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-25T08:50:11.732 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-25T08:50:11.732 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-25T08:50:11.732 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-25T08:50:11.732 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-25T08:50:11.732 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-25T08:50:11.732 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-25T08:50:11.732 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-25T08:50:11.732 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-25T08:50:11.733 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-25T08:50:11.733 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-25T08:50:11.733 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-25T08:50:11.733 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-25T08:50:11.733 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-25T08:50:11.733 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-25T08:50:11.733 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-25T08:50:11.733 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-25T08:50:11.733 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-25T08:50:11.733 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-25T08:50:11.733 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-25T08:50:11.733 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-25T08:50:11.733 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-25T08:50:11.734 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-25T08:50:11.734 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-25T08:50:11.734 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-25T08:50:11.734 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-25T08:50:11.734 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-25T08:50:11.734 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-25T08:50:11.734 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-25T08:50:11.734 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-25T08:50:11.734 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-25T08:50:11.734 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-25T08:50:11.734 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-25T08:50:11.734 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-25T08:50:11.734 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-25T08:50:11.734 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-25T08:50:11.735 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-25T08:50:11.735 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-25T08:50:11.735 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-25T08:50:11.735 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-25T08:50:11.735 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-25T08:50:11.735 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-25T08:50:11.735 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-25T08:50:11.735 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-25T08:50:11.735 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-25T08:50:11.735 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-25T08:50:11.735 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-25T08:50:11.735 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-25T08:50:11.735 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-25T08:50:11.736 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-25T08:50:11.736 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-25T08:50:11.736 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-25T08:50:11.736 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-25T08:50:11.736 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-25T08:50:11.736 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-25T08:50:11.736 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-25T08:50:11.736 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-25T08:50:11.736 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-25T08:50:11.736 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-25T08:50:11.736 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-25T08:50:11.736 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-25T08:50:11.736 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-25T08:50:11.736 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-25T08:50:11.736 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-25T08:50:11.737 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-25T08:50:11.737 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-25T08:50:11.737 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-25T08:50:11.737 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-25T08:50:11.737 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-25T08:50:11.737 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-25T08:50:11.737 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-25T08:50:11.737 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-25T08:50:11.737 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-25T08:50:11.737 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-25T08:50:11.737 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-25T08:50:11.737 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-25T08:50:11.738 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-25T08:50:11.738 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-25T08:50:11.738 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-25T08:50:11.738 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-25T08:50:11.738 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-25T08:50:11.738 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-25T08:50:11.738 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-25T08:50:11.738 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-25T08:50:11.738 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-25T08:50:11.738 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-25T08:50:11.738 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-25T08:50:11.738 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-25T08:50:11.738 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-25T08:50:11.738 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-25T08:50:11.739 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-25T08:50:11.739 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-25T08:50:11.739 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-25T08:50:11.739 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-25T08:50:11.739 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-25T08:50:11.739 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-25T08:50:11.739 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-25T08:50:11.739 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-25T08:50:11.739 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-25T08:50:11.739 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-25T08:50:11.739 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-25T08:50:11.739 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-25T08:50:11.739 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-25T08:50:11.739 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-25T08:50:11.740 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-25T08:50:11.740 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-25T08:50:11.740 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-25T08:50:11.740 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-25T08:50:11.740 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-25T08:50:11.740 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-25T08:50:11.740 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-25T08:50:11.740 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-25T08:50:11.740 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-25T08:50:11.740 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-25T08:50:11.740 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-25T08:50:11.740 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-25T08:50:11.740 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-25T08:50:11.741 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-25T08:50:11.741 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-25T08:50:11.741 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-25T08:50:11.741 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-25T08:50:11.741 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-25T08:50:11.741 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-25T08:50:11.741 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-25T08:50:11.741 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-25T08:50:11.741 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-25T08:50:11.741 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-25T08:50:11.741 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-25T08:50:11.741 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-25T08:50:11.741 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-25T08:50:11.741 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-25T08:50:11.742 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-25T08:50:11.742 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-25T08:50:11.742 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-25T08:50:11.742 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-25T08:50:11.742 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-25T08:50:11.742 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-25T08:50:11.742 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-25T08:50:11.742 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-25T08:50:11.742 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-25T08:50:11.742 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-25T08:50:11.742 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-25T08:50:11.742 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-25T08:50:11.743 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-25T08:50:11.743 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-25T08:50:11.743 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-25T08:50:11.743 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-25T08:50:11.743 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-25T08:50:11.743 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-25T08:50:11.743 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-25T08:50:11.743 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-25T08:50:11.743 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-25T08:50:11.743 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-25T08:50:11.743 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-25T08:50:11.743 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-25T08:50:11.743 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-25T08:50:11.743 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-25T08:50:11.744 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-25T08:50:11.744 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-25T08:50:11.744 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-25T08:50:11.744 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-25T08:50:11.744 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-25T08:50:11.744 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-25T08:50:11.744 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-25T08:50:11.744 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-25T08:50:11.744 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-25T08:50:11.744 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-25T08:50:11.744 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-25T08:50:11.744 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-25T08:50:11.745 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-25T08:50:11.745 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-25T08:50:11.745 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-25T08:50:11.745 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-25T08:50:11.745 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-25T08:50:11.745 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-25T08:50:11.745 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-25T08:50:11.745 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-25T08:50:11.745 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-25T08:50:11.745 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-25T08:50:11.745 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-25T08:50:11.745 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-25T08:50:11.745 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-25T08:50:11.745 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-25T08:50:11.746 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-25T08:50:11.746 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-25T08:50:11.746 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-25T08:50:11.746 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-25T08:50:11.746 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-25T08:50:11.746 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-25T08:50:11.746 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-25T08:50:11.746 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-25T08:50:11.746 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-25T08:50:11.746 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-25T08:50:11.746 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-25T08:50:11.746 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-25T08:50:11.746 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-25T08:50:11.747 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-25T08:50:11.747 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-25T08:50:11.747 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-25T08:50:11.747 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-25T08:50:11.747 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-25T08:50:11.747 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-25T08:50:11.747 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-25T08:50:11.747 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-25T08:50:11.747 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-25T08:50:11.747 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-25T08:50:11.747 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-25T08:50:11.747 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-25T08:50:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-25T08:50:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-25T08:50:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-25T08:50:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-25T08:50:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-25T08:50:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-25T08:50:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-25T08:50:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-25T08:50:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-25T08:50:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-25T08:50:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-25T08:50:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-25T08:50:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-25T08:50:11.749 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-25T08:50:11.749 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-25T08:50:11.749 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-25T08:50:11.749 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-25T08:50:11.749 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-25T08:50:11.749 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-25T08:50:11.749 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-25T08:50:11.749 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-25T08:50:11.749 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-25T08:50:11.749 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-25T08:50:11.749 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-25T08:50:11.749 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-25T08:50:11.749 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-25T08:50:11.749 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-25T08:50:11.749 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-25T08:50:11.750 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-25T08:50:11.750 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-25T08:50:11.750 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-25T08:50:11.750 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-25T08:50:11.750 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-25T08:50:11.750 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-25T08:50:11.750 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-25T08:50:11.750 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-25T08:50:11.750 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-25T08:50:11.750 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-25T08:50:11.750 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-25T08:50:11.750 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-25T08:50:11.750 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-25T08:50:11.751 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-25T08:50:11.751 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-25T08:50:11.751 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-25T08:50:11.751 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-25T08:50:11.751 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-25T08:50:11.751 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-25T08:50:11.751 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-25T08:50:11.751 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-25T08:50:11.751 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-25T08:50:11.751 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-25T08:50:11.751 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-25T08:50:11.751 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-25T08:50:11.751 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-25T08:50:11.751 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-25T08:50:11.751 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-25T08:50:11.751 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-25T08:50:11.752 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-25T08:50:11.752 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-25T08:50:11.752 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-25T08:50:11.752 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-25T08:50:11.753 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-25T08:50:11.753 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-25T08:50:11.753 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-25T08:50:11.753 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-25T08:50:11.753 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-25T08:50:11.753 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-25T08:50:11.753 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-25T08:50:11.753 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-25T08:50:11.753 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-25T08:50:11.753 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-25T08:50:11.753 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-25T08:50:11.753 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-25T08:50:11.754 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-25T08:50:11.754 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-25T08:50:11.754 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-25T08:50:11.754 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-25T08:50:11.754 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-25T08:50:11.754 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-25T08:50:11.754 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-25T08:50:11.754 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-25T08:50:11.754 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-25T08:50:11.754 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-25T08:50:11.754 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-25T08:50:11.754 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-25T08:50:11.754 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-25T08:50:11.754 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-25T08:50:11.755 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-25T08:50:11.755 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-25T08:50:11.755 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-25T08:50:11.755 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-25T08:50:11.755 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-25T08:50:11.755 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-25T08:50:11.755 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-25T08:50:11.755 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-25T08:50:11.755 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-25T08:50:11.755 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-25T08:50:11.755 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-25T08:50:11.755 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-25T08:50:11.755 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-25T08:50:11.755 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-25T08:50:11.755 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-25T08:50:11.755 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-25T08:50:11.756 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-25T08:50:11.756 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-25T08:50:11.756 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-25T08:50:11.756 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-25T08:50:11.756 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-25T08:50:11.756 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-25T08:50:11.756 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-25T08:50:11.756 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-25T08:50:11.756 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-25T08:50:11.756 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-25T08:50:11.756 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-25T08:50:11.756 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-25T08:50:11.756 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-25T08:50:11.756 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-25T08:50:11.756 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-25T08:50:11.757 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-25T08:50:11.757 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-25T08:50:11.757 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-25T08:50:11.757 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-25T08:50:11.757 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-25T08:50:11.757 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-25T08:50:11.757 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-25T08:50:11.757 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-25T08:50:11.757 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-25T08:50:11.757 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-25T08:50:11.757 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-25T08:50:11.757 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-25T08:50:11.757 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-25T08:50:11.757 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-25T08:50:11.757 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-25T08:50:11.757 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-25T08:50:11.757 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-25T08:50:11.758 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-25T08:50:11.758 INFO:teuthology.orchestra.run.smithi177.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-25T08:50:11.758 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-25T08:50:11.758 INFO:teuthology.orchestra.run.smithi177.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-25T08:50:11.762 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:11.763 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:11.763 DEBUG:teuthology.orchestra.run.smithi177:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-25T08:50:11.769 INFO:teuthology.orchestra.run.smithi177.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T08:50:11.769 INFO:teuthology.orchestra.run.smithi177.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T08:50:11.770 INFO:teuthology.orchestra.run.smithi177.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T08:50:11.770 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-25T08:50:11.770 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:11.770 DEBUG:teuthology.orchestra.run.smithi177:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-25T08:50:11.812 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi177.front.sepia.ceph.com to complete... 2024-04-25T08:50:12.185 INFO:teuthology.orchestra.run.smithi177.stderr:Sourcing file `/etc/default/grub' 2024-04-25T08:50:12.186 INFO:teuthology.orchestra.run.smithi177.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T08:50:12.204 INFO:teuthology.orchestra.run.smithi177.stderr:Generating grub configuration file ... 2024-04-25T08:50:12.412 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:12.417 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:12.622 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T08:50:12.628 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T08:50:12.673 INFO:teuthology.orchestra.run.smithi177.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T08:50:12.679 INFO:teuthology.orchestra.run.smithi177.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T08:50:12.795 INFO:teuthology.orchestra.run.smithi177.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T08:50:12.795 INFO:teuthology.orchestra.run.smithi177.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T08:50:12.795 INFO:teuthology.orchestra.run.smithi177.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T08:50:12.812 INFO:teuthology.orchestra.run.smithi177.stderr:done 2024-04-25T08:50:12.878 INFO:teuthology.orchestra.run.smithi175.stderr:Sourcing file `/etc/default/grub' 2024-04-25T08:50:12.891 INFO:teuthology.orchestra.run.smithi175.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T08:50:12.952 INFO:teuthology.orchestra.run.smithi175.stderr:Generating grub configuration file ... 2024-04-25T08:50:13.274 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:13.292 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:13.659 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T08:50:13.676 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T08:50:13.740 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T08:50:13.745 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T08:50:13.904 INFO:teuthology.orchestra.run.smithi175.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T08:50:13.904 INFO:teuthology.orchestra.run.smithi175.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T08:50:13.904 INFO:teuthology.orchestra.run.smithi175.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T08:50:13.940 INFO:teuthology.orchestra.run.smithi175.stderr:done 2024-04-25T08:50:14.114 DEBUG:teuthology.orchestra.run.smithi175:> dpkg-deb -c /tmp/linux-image.deb 2024-04-25T08:50:14.122 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-25T08:50:14.122 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-25T08:50:14.122 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:14.140 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:14.140 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:14.161 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-25T08:50:14.161 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-25T08:50:14.161 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-25T08:50:14.161 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-25T08:50:14.161 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-25T08:50:14.162 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-25T08:50:14.162 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-25T08:50:14.162 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-25T08:50:14.162 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-25T08:50:14.162 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-25T08:50:14.162 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-25T08:50:14.162 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-25T08:50:14.162 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-25T08:50:14.162 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-25T08:50:14.165 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-25T08:50:14.165 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-25T08:50:14.165 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-25T08:50:14.165 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-25T08:50:14.165 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-25T08:50:14.165 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-25T08:50:14.166 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-25T08:50:14.166 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-25T08:50:14.166 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-25T08:50:14.166 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-25T08:50:14.166 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-25T08:50:14.166 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-25T08:50:14.166 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-25T08:50:14.166 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-25T08:50:14.166 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-25T08:50:14.166 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-25T08:50:14.167 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-25T08:50:14.167 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-25T08:50:14.167 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-25T08:50:14.167 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-25T08:50:14.167 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-25T08:50:14.167 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-25T08:50:14.167 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-25T08:50:14.167 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-25T08:50:14.167 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-25T08:50:14.167 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-25T08:50:14.167 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-25T08:50:14.167 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-25T08:50:14.168 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-25T08:50:14.185 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-25T08:50:14.185 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-25T08:50:14.185 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-25T08:50:14.185 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-25T08:50:14.186 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-25T08:50:14.186 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-25T08:50:14.186 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-25T08:50:14.186 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-25T08:50:14.186 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-25T08:50:14.186 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-25T08:50:14.186 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-25T08:50:14.186 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-25T08:50:14.186 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-25T08:50:14.186 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-25T08:50:14.186 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-25T08:50:14.187 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-25T08:50:14.187 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-25T08:50:14.187 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-25T08:50:14.187 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-25T08:50:14.187 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-25T08:50:14.187 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-25T08:50:14.187 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-25T08:50:14.187 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-25T08:50:14.187 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-25T08:50:14.187 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-25T08:50:14.187 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-25T08:50:14.188 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-25T08:50:14.188 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-25T08:50:14.188 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-25T08:50:14.188 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-25T08:50:14.188 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-25T08:50:14.188 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-25T08:50:14.188 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-25T08:50:14.188 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-25T08:50:14.188 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-25T08:50:14.188 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-25T08:50:14.188 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-25T08:50:14.188 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-25T08:50:14.189 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-25T08:50:14.189 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-25T08:50:14.189 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-25T08:50:14.189 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-25T08:50:14.189 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-25T08:50:14.189 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-25T08:50:14.189 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-25T08:50:14.189 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-25T08:50:14.189 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-25T08:50:14.189 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-25T08:50:14.189 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-25T08:50:14.190 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-25T08:50:14.190 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-25T08:50:14.190 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-25T08:50:14.190 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-25T08:50:14.190 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-25T08:50:14.190 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-25T08:50:14.190 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-25T08:50:14.190 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-25T08:50:14.190 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-25T08:50:14.190 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-25T08:50:14.190 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-25T08:50:14.190 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-25T08:50:14.191 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-25T08:50:14.191 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-25T08:50:14.191 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-25T08:50:14.191 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-25T08:50:14.191 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-25T08:50:14.191 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-25T08:50:14.191 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-25T08:50:14.191 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-25T08:50:14.191 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-25T08:50:14.191 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-25T08:50:14.191 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-25T08:50:14.191 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-25T08:50:14.192 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-25T08:50:14.192 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-25T08:50:14.192 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-25T08:50:14.192 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-25T08:50:14.192 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-25T08:50:14.192 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-25T08:50:14.192 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-25T08:50:14.192 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-25T08:50:14.192 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-25T08:50:14.192 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-25T08:50:14.192 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-25T08:50:14.193 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-25T08:50:14.193 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-25T08:50:14.193 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-25T08:50:14.193 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-25T08:50:14.193 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-25T08:50:14.193 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-25T08:50:14.193 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-25T08:50:14.193 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-25T08:50:14.193 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-25T08:50:14.193 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-25T08:50:14.193 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-25T08:50:14.194 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-25T08:50:14.194 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-25T08:50:14.194 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-25T08:50:14.194 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-25T08:50:14.194 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-25T08:50:14.194 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-25T08:50:14.194 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-25T08:50:14.194 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-25T08:50:14.194 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-25T08:50:14.194 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-25T08:50:14.194 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-25T08:50:14.195 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-25T08:50:14.195 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-25T08:50:14.195 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-25T08:50:14.195 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-25T08:50:14.195 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-25T08:50:14.195 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-25T08:50:14.195 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-25T08:50:14.195 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-25T08:50:14.195 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-25T08:50:14.195 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-25T08:50:14.196 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-25T08:50:14.196 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-25T08:50:14.196 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-25T08:50:14.196 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-25T08:50:14.196 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-25T08:50:14.196 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-25T08:50:14.196 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-25T08:50:14.196 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-25T08:50:14.196 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-25T08:50:14.196 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-25T08:50:14.196 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-25T08:50:14.196 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-25T08:50:14.197 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-25T08:50:14.197 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-25T08:50:14.197 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-25T08:50:14.197 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-25T08:50:14.197 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-25T08:50:14.197 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-25T08:50:14.197 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-25T08:50:14.197 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-25T08:50:14.197 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-25T08:50:14.197 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-25T08:50:14.197 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-25T08:50:14.198 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-25T08:50:14.198 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-25T08:50:14.198 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-25T08:50:14.198 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-25T08:50:14.198 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-25T08:50:14.198 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-25T08:50:14.198 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-25T08:50:14.198 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-25T08:50:14.198 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-25T08:50:14.274 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-25T08:50:14.274 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-25T08:50:14.275 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-25T08:50:14.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-25T08:50:14.275 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-25T08:50:14.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-25T08:50:14.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-25T08:50:14.275 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-25T08:50:14.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-25T08:50:14.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-25T08:50:14.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-25T08:50:14.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-25T08:50:14.275 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-25T08:50:14.276 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-25T08:50:14.276 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-25T08:50:14.276 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-25T08:50:14.276 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-25T08:50:14.276 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-25T08:50:14.276 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-25T08:50:14.276 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-25T08:50:14.276 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-25T08:50:14.276 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-25T08:50:14.276 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-25T08:50:14.276 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-25T08:50:14.276 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-25T08:50:14.276 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-25T08:50:14.277 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-25T08:50:14.277 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-25T08:50:14.277 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-25T08:50:14.277 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-25T08:50:14.277 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-25T08:50:14.277 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-25T08:50:14.277 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-25T08:50:14.277 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-25T08:50:14.277 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-25T08:50:14.277 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-25T08:50:14.277 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-25T08:50:14.277 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-25T08:50:14.277 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-25T08:50:14.278 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-25T08:50:14.278 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-25T08:50:14.278 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-25T08:50:14.278 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-25T08:50:14.278 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-25T08:50:14.278 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-25T08:50:14.278 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-25T08:50:14.278 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-25T08:50:14.278 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-25T08:50:14.278 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-25T08:50:14.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-25T08:50:14.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-25T08:50:14.279 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-25T08:50:14.279 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-25T08:50:14.279 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-25T08:50:14.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-25T08:50:14.279 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-25T08:50:14.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-25T08:50:14.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-25T08:50:14.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-25T08:50:14.279 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-25T08:50:14.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-25T08:50:14.279 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-25T08:50:14.279 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-25T08:50:14.280 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-25T08:50:14.280 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-25T08:50:14.280 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-25T08:50:14.280 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-25T08:50:14.280 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-25T08:50:14.280 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-25T08:50:14.280 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-25T08:50:14.280 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-25T08:50:14.280 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-25T08:50:14.280 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-25T08:50:14.280 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-25T08:50:14.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-25T08:50:14.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-25T08:50:14.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-25T08:50:14.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-25T08:50:14.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-25T08:50:14.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-25T08:50:14.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-25T08:50:14.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-25T08:50:14.281 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-25T08:50:14.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-25T08:50:14.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-25T08:50:14.281 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-25T08:50:14.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-25T08:50:14.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-25T08:50:14.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-25T08:50:14.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-25T08:50:14.282 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-25T08:50:14.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-25T08:50:14.282 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-25T08:50:14.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-25T08:50:14.282 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-25T08:50:14.282 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-25T08:50:14.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-25T08:50:14.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-25T08:50:14.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-25T08:50:14.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-25T08:50:14.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-25T08:50:14.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-25T08:50:14.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-25T08:50:14.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-25T08:50:14.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-25T08:50:14.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-25T08:50:14.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-25T08:50:14.283 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-25T08:50:14.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-25T08:50:14.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-25T08:50:14.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-25T08:50:14.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-25T08:50:14.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-25T08:50:14.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-25T08:50:14.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-25T08:50:14.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-25T08:50:14.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-25T08:50:14.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-25T08:50:14.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-25T08:50:14.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-25T08:50:14.284 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-25T08:50:14.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-25T08:50:14.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-25T08:50:14.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-25T08:50:14.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-25T08:50:14.285 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-25T08:50:14.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-25T08:50:14.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-25T08:50:14.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-25T08:50:14.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-25T08:50:14.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-25T08:50:14.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-25T08:50:14.285 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-25T08:50:14.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-25T08:50:14.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-25T08:50:14.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-25T08:50:14.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-25T08:50:14.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-25T08:50:14.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-25T08:50:14.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-25T08:50:14.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-25T08:50:14.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-25T08:50:14.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-25T08:50:14.286 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-25T08:50:14.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-25T08:50:14.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-25T08:50:14.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-25T08:50:14.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-25T08:50:14.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-25T08:50:14.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-25T08:50:14.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-25T08:50:14.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-25T08:50:14.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-25T08:50:14.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-25T08:50:14.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-25T08:50:14.287 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-25T08:50:14.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-25T08:50:14.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-25T08:50:14.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-25T08:50:14.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-25T08:50:14.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-25T08:50:14.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-25T08:50:14.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-25T08:50:14.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-25T08:50:14.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-25T08:50:14.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-25T08:50:14.288 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-25T08:50:14.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-25T08:50:14.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-25T08:50:14.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-25T08:50:14.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-25T08:50:14.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-25T08:50:14.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-25T08:50:14.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-25T08:50:14.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-25T08:50:14.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-25T08:50:14.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-25T08:50:14.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-25T08:50:14.289 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-25T08:50:14.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-25T08:50:14.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-25T08:50:14.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-25T08:50:14.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-25T08:50:14.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-25T08:50:14.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-25T08:50:14.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-25T08:50:14.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-25T08:50:14.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-25T08:50:14.290 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-25T08:50:14.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-25T08:50:14.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-25T08:50:14.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-25T08:50:14.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-25T08:50:14.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-25T08:50:14.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-25T08:50:14.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-25T08:50:14.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-25T08:50:14.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-25T08:50:14.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-25T08:50:14.291 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-25T08:50:14.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-25T08:50:14.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-25T08:50:14.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-25T08:50:14.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-25T08:50:14.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-25T08:50:14.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-25T08:50:14.292 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-25T08:50:14.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-25T08:50:14.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-25T08:50:14.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-25T08:50:14.292 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-25T08:50:14.292 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-25T08:50:14.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-25T08:50:14.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-25T08:50:14.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-25T08:50:14.293 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-25T08:50:14.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-25T08:50:14.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-25T08:50:14.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-25T08:50:14.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-25T08:50:14.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-25T08:50:14.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-25T08:50:14.293 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-25T08:50:14.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-25T08:50:14.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-25T08:50:14.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-25T08:50:14.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-25T08:50:14.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-25T08:50:14.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-25T08:50:14.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-25T08:50:14.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-25T08:50:14.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-25T08:50:14.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-25T08:50:14.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-25T08:50:14.294 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-25T08:50:14.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-25T08:50:14.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-25T08:50:14.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-25T08:50:14.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-25T08:50:14.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-25T08:50:14.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-25T08:50:14.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-25T08:50:14.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-25T08:50:14.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-25T08:50:14.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-25T08:50:14.295 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-25T08:50:14.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-25T08:50:14.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-25T08:50:14.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-25T08:50:14.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-25T08:50:14.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-25T08:50:14.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-25T08:50:14.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-25T08:50:14.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-25T08:50:14.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-25T08:50:14.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-25T08:50:14.296 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-25T08:50:14.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-25T08:50:14.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-25T08:50:14.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-25T08:50:14.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-25T08:50:14.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-25T08:50:14.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-25T08:50:14.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-25T08:50:14.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-25T08:50:14.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-25T08:50:14.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-25T08:50:14.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-25T08:50:14.297 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-25T08:50:14.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-25T08:50:14.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-25T08:50:14.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-25T08:50:14.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-25T08:50:14.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-25T08:50:14.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-25T08:50:14.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-25T08:50:14.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-25T08:50:14.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-25T08:50:14.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-25T08:50:14.298 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-25T08:50:14.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-25T08:50:14.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-25T08:50:14.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-25T08:50:14.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-25T08:50:14.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-25T08:50:14.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-25T08:50:14.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-25T08:50:14.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-25T08:50:14.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-25T08:50:14.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-25T08:50:14.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-25T08:50:14.299 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-25T08:50:14.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-25T08:50:14.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-25T08:50:14.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-25T08:50:14.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-25T08:50:14.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-25T08:50:14.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-25T08:50:14.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-25T08:50:14.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-25T08:50:14.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-25T08:50:14.300 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-25T08:50:14.301 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-25T08:50:14.301 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-25T08:50:14.301 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-25T08:50:14.301 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-25T08:50:14.301 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-25T08:50:14.301 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-25T08:50:14.301 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-25T08:50:14.301 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-25T08:50:14.301 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-25T08:50:14.301 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-25T08:50:14.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-25T08:50:14.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-25T08:50:14.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-25T08:50:14.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-25T08:50:14.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-25T08:50:14.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-25T08:50:14.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-25T08:50:14.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-25T08:50:14.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-25T08:50:14.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-25T08:50:14.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-25T08:50:14.302 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-25T08:50:14.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-25T08:50:14.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-25T08:50:14.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-25T08:50:14.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-25T08:50:14.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-25T08:50:14.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-25T08:50:14.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-25T08:50:14.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-25T08:50:14.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-25T08:50:14.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-25T08:50:14.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-25T08:50:14.303 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-25T08:50:14.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-25T08:50:14.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-25T08:50:14.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-25T08:50:14.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-25T08:50:14.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-25T08:50:14.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-25T08:50:14.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-25T08:50:14.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-25T08:50:14.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-25T08:50:14.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-25T08:50:14.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-25T08:50:14.304 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-25T08:50:14.305 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-25T08:50:14.305 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-25T08:50:14.305 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-25T08:50:14.305 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-25T08:50:14.305 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-25T08:50:14.305 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-25T08:50:14.305 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-25T08:50:14.305 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-25T08:50:14.305 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-25T08:50:14.305 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-25T08:50:14.305 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-25T08:50:14.305 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-25T08:50:14.306 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-25T08:50:14.306 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-25T08:50:14.306 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-25T08:50:14.306 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-25T08:50:14.306 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-25T08:50:14.306 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-25T08:50:14.306 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-25T08:50:14.306 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-25T08:50:14.306 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-25T08:50:14.306 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-25T08:50:14.306 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-25T08:50:14.306 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-25T08:50:14.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-25T08:50:14.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-25T08:50:14.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-25T08:50:14.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-25T08:50:14.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-25T08:50:14.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-25T08:50:14.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-25T08:50:14.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-25T08:50:14.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-25T08:50:14.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-25T08:50:14.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-25T08:50:14.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-25T08:50:14.307 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-25T08:50:14.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-25T08:50:14.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-25T08:50:14.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-25T08:50:14.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-25T08:50:14.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-25T08:50:14.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-25T08:50:14.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-25T08:50:14.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-25T08:50:14.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-25T08:50:14.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-25T08:50:14.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-25T08:50:14.308 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-25T08:50:14.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-25T08:50:14.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-25T08:50:14.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-25T08:50:14.309 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-25T08:50:14.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-25T08:50:14.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-25T08:50:14.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-25T08:50:14.309 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-25T08:50:14.309 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-25T08:50:14.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-25T08:50:14.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-25T08:50:14.309 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-25T08:50:14.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-25T08:50:14.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-25T08:50:14.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-25T08:50:14.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-25T08:50:14.310 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-25T08:50:14.310 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-25T08:50:14.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-25T08:50:14.310 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-25T08:50:14.310 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-25T08:50:14.310 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-25T08:50:14.311 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-25T08:50:14.311 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-25T08:50:14.311 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-25T08:50:14.311 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-25T08:50:14.311 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-25T08:50:14.311 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-25T08:50:14.311 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-25T08:50:14.311 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-25T08:50:14.311 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-25T08:50:14.311 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-25T08:50:14.311 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-25T08:50:14.312 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-25T08:50:14.312 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-25T08:50:14.312 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-25T08:50:14.312 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-25T08:50:14.312 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-25T08:50:14.312 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-25T08:50:14.312 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-25T08:50:14.312 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-25T08:50:14.312 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-25T08:50:14.312 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-25T08:50:14.312 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-25T08:50:14.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-25T08:50:14.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-25T08:50:14.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-25T08:50:14.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-25T08:50:14.313 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-25T08:50:14.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-25T08:50:14.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-25T08:50:14.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-25T08:50:14.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-25T08:50:14.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-25T08:50:14.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-25T08:50:14.313 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-25T08:50:14.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-25T08:50:14.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-25T08:50:14.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-25T08:50:14.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-25T08:50:14.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-25T08:50:14.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-25T08:50:14.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-25T08:50:14.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-25T08:50:14.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-25T08:50:14.314 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-25T08:50:14.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-25T08:50:14.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-25T08:50:14.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-25T08:50:14.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-25T08:50:14.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-25T08:50:14.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-25T08:50:14.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-25T08:50:14.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-25T08:50:14.315 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-25T08:50:14.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-25T08:50:14.315 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-25T08:50:14.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-25T08:50:14.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-25T08:50:14.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-25T08:50:14.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-25T08:50:14.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-25T08:50:14.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-25T08:50:14.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-25T08:50:14.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-25T08:50:14.316 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-25T08:50:14.316 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-25T08:50:14.316 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-25T08:50:14.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-25T08:50:14.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-25T08:50:14.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-25T08:50:14.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-25T08:50:14.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-25T08:50:14.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-25T08:50:14.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-25T08:50:14.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-25T08:50:14.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-25T08:50:14.317 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-25T08:50:14.318 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-25T08:50:14.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-25T08:50:14.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-25T08:50:14.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-25T08:50:14.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-25T08:50:14.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-25T08:50:14.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-25T08:50:14.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-25T08:50:14.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-25T08:50:14.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-25T08:50:14.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-25T08:50:14.318 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-25T08:50:14.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-25T08:50:14.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-25T08:50:14.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-25T08:50:14.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-25T08:50:14.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-25T08:50:14.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-25T08:50:14.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-25T08:50:14.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-25T08:50:14.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-25T08:50:14.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-25T08:50:14.319 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-25T08:50:14.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-25T08:50:14.320 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-25T08:50:14.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-25T08:50:14.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-25T08:50:14.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-25T08:50:14.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-25T08:50:14.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-25T08:50:14.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-25T08:50:14.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-25T08:50:14.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-25T08:50:14.320 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-25T08:50:14.320 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-25T08:50:14.321 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-25T08:50:14.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-25T08:50:14.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-25T08:50:14.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-25T08:50:14.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-25T08:50:14.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-25T08:50:14.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-25T08:50:14.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-25T08:50:14.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-25T08:50:14.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-25T08:50:14.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-25T08:50:14.321 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-25T08:50:14.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-25T08:50:14.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-25T08:50:14.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-25T08:50:14.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-25T08:50:14.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-25T08:50:14.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-25T08:50:14.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-25T08:50:14.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-25T08:50:14.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-25T08:50:14.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-25T08:50:14.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-25T08:50:14.322 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-25T08:50:14.323 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-25T08:50:14.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-25T08:50:14.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-25T08:50:14.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-25T08:50:14.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-25T08:50:14.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-25T08:50:14.323 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-25T08:50:14.323 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-25T08:50:14.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-25T08:50:14.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-25T08:50:14.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-25T08:50:14.323 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-25T08:50:14.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-25T08:50:14.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-25T08:50:14.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-25T08:50:14.324 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-25T08:50:14.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-25T08:50:14.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-25T08:50:14.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-25T08:50:14.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-25T08:50:14.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-25T08:50:14.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-25T08:50:14.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-25T08:50:14.324 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-25T08:50:14.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-25T08:50:14.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-25T08:50:14.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-25T08:50:14.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-25T08:50:14.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-25T08:50:14.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-25T08:50:14.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-25T08:50:14.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-25T08:50:14.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-25T08:50:14.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-25T08:50:14.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-25T08:50:14.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-25T08:50:14.325 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-25T08:50:14.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-25T08:50:14.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-25T08:50:14.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-25T08:50:14.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-25T08:50:14.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-25T08:50:14.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-25T08:50:14.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-25T08:50:14.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-25T08:50:14.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-25T08:50:14.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-25T08:50:14.326 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-25T08:50:14.327 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-25T08:50:14.327 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-25T08:50:14.327 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-25T08:50:14.327 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-25T08:50:14.327 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-25T08:50:14.327 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-25T08:50:14.327 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-25T08:50:14.327 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-25T08:50:14.327 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-25T08:50:14.327 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-25T08:50:14.327 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-25T08:50:14.327 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-25T08:50:14.327 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-25T08:50:14.327 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-25T08:50:14.328 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-25T08:50:14.328 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-25T08:50:14.328 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-25T08:50:14.328 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-25T08:50:14.328 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-25T08:50:14.328 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-25T08:50:14.328 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-25T08:50:14.328 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-25T08:50:14.328 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-25T08:50:14.328 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-25T08:50:14.328 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-25T08:50:14.328 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-25T08:50:14.328 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-25T08:50:14.329 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-25T08:50:14.329 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-25T08:50:14.329 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-25T08:50:14.329 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-25T08:50:14.329 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-25T08:50:14.329 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-25T08:50:14.329 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-25T08:50:14.329 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-25T08:50:14.330 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-25T08:50:14.330 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-25T08:50:14.330 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-25T08:50:14.330 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-25T08:50:14.330 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-25T08:50:14.330 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-25T08:50:14.330 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-25T08:50:14.330 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-25T08:50:14.330 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-25T08:50:14.330 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-25T08:50:14.331 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-25T08:50:14.331 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-25T08:50:14.331 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-25T08:50:14.331 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-25T08:50:14.331 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-25T08:50:14.331 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-25T08:50:14.331 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-25T08:50:14.331 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-25T08:50:14.331 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-25T08:50:14.331 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-25T08:50:14.331 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-25T08:50:14.331 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-25T08:50:14.332 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-25T08:50:14.332 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-25T08:50:14.332 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-25T08:50:14.332 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-25T08:50:14.332 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-25T08:50:14.332 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-25T08:50:14.332 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-25T08:50:14.332 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-25T08:50:14.332 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-25T08:50:14.332 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-25T08:50:14.332 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-25T08:50:14.332 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-25T08:50:14.333 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-25T08:50:14.333 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-25T08:50:14.333 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-25T08:50:14.333 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-25T08:50:14.333 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-25T08:50:14.333 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-25T08:50:14.333 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-25T08:50:14.333 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-25T08:50:14.333 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-25T08:50:14.333 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-25T08:50:14.333 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-25T08:50:14.333 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-25T08:50:14.334 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-25T08:50:14.334 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-25T08:50:14.334 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-25T08:50:14.334 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-25T08:50:14.334 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-25T08:50:14.334 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-25T08:50:14.334 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-25T08:50:14.334 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-25T08:50:14.334 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-25T08:50:14.334 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-25T08:50:14.334 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-25T08:50:14.334 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-25T08:50:14.335 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-25T08:50:14.335 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-25T08:50:14.335 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-25T08:50:14.335 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-25T08:50:14.335 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-25T08:50:14.335 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-25T08:50:14.335 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-25T08:50:14.335 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-25T08:50:14.335 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-25T08:50:14.335 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-25T08:50:14.335 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-25T08:50:14.336 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-25T08:50:14.336 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-25T08:50:14.336 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-25T08:50:14.336 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-25T08:50:14.336 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-25T08:50:14.336 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-25T08:50:14.336 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-25T08:50:14.336 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-25T08:50:14.336 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-25T08:50:14.336 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-25T08:50:14.336 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-25T08:50:14.336 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-25T08:50:14.336 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-25T08:50:14.337 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-25T08:50:14.337 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-25T08:50:14.337 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-25T08:50:14.337 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-25T08:50:14.337 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-25T08:50:14.337 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-25T08:50:14.337 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-25T08:50:14.337 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-25T08:50:14.337 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-25T08:50:14.337 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-25T08:50:14.337 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-25T08:50:14.337 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-25T08:50:14.338 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-25T08:50:14.338 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-25T08:50:14.338 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-25T08:50:14.338 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-25T08:50:14.338 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-25T08:50:14.338 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-25T08:50:14.338 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-25T08:50:14.338 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-25T08:50:14.338 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-25T08:50:14.338 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-25T08:50:14.338 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-25T08:50:14.338 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-25T08:50:14.339 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-25T08:50:14.339 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-25T08:50:14.339 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-25T08:50:14.339 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-25T08:50:14.339 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-25T08:50:14.339 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-25T08:50:14.339 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-25T08:50:14.339 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-25T08:50:14.339 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-25T08:50:14.339 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-25T08:50:14.339 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-25T08:50:14.339 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-25T08:50:14.340 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-25T08:50:14.340 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-25T08:50:14.340 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-25T08:50:14.438 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-25T08:50:14.438 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-25T08:50:14.438 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-25T08:50:14.438 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-25T08:50:14.438 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-25T08:50:14.439 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-25T08:50:14.439 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-25T08:50:14.439 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-25T08:50:14.439 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-25T08:50:14.439 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-25T08:50:14.439 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-25T08:50:14.439 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-25T08:50:14.439 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-25T08:50:14.439 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-25T08:50:14.439 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-25T08:50:14.439 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-25T08:50:14.439 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-25T08:50:14.440 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-25T08:50:14.440 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-25T08:50:14.440 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-25T08:50:14.440 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-25T08:50:14.440 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-25T08:50:14.440 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-25T08:50:14.440 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-25T08:50:14.440 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-25T08:50:14.440 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-25T08:50:14.440 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-25T08:50:14.440 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-25T08:50:14.441 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-25T08:50:14.441 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-25T08:50:14.441 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-25T08:50:14.441 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-25T08:50:14.441 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-25T08:50:14.441 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-25T08:50:14.441 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-25T08:50:14.441 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-25T08:50:14.441 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-25T08:50:14.442 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-25T08:50:14.442 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-25T08:50:14.442 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-25T08:50:14.442 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-25T08:50:14.442 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-25T08:50:14.442 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-25T08:50:14.442 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-25T08:50:14.442 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-25T08:50:14.442 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-25T08:50:14.442 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-25T08:50:14.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-25T08:50:14.443 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-25T08:50:14.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-25T08:50:14.443 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-25T08:50:14.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-25T08:50:14.443 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-25T08:50:14.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-25T08:50:14.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-25T08:50:14.443 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-25T08:50:14.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-25T08:50:14.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-25T08:50:14.443 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-25T08:50:14.444 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-25T08:50:14.444 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-25T08:50:14.444 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-25T08:50:14.444 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-25T08:50:14.444 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-25T08:50:14.444 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-25T08:50:14.444 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-25T08:50:14.444 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-25T08:50:14.444 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-25T08:50:14.444 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-25T08:50:14.445 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-25T08:50:14.445 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-25T08:50:14.445 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-25T08:50:14.445 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-25T08:50:14.445 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-25T08:50:14.445 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-25T08:50:14.445 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-25T08:50:14.445 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-25T08:50:14.445 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-25T08:50:14.445 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-25T08:50:14.445 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-25T08:50:14.446 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-25T08:50:14.446 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-25T08:50:14.446 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-25T08:50:14.446 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-25T08:50:14.446 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-25T08:50:14.446 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-25T08:50:14.446 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-25T08:50:14.446 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-25T08:50:14.446 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-25T08:50:14.446 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-25T08:50:14.447 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-25T08:50:14.447 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-25T08:50:14.447 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-25T08:50:14.447 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-25T08:50:14.447 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-25T08:50:14.447 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-25T08:50:14.447 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-25T08:50:14.447 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-25T08:50:14.447 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-25T08:50:14.447 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-25T08:50:14.447 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-25T08:50:14.448 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-25T08:50:14.448 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-25T08:50:14.448 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-25T08:50:14.448 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-25T08:50:14.448 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-25T08:50:14.448 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-25T08:50:14.448 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-25T08:50:14.448 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-25T08:50:14.448 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-25T08:50:14.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-25T08:50:14.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-25T08:50:14.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-25T08:50:14.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-25T08:50:14.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-25T08:50:14.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-25T08:50:14.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-25T08:50:14.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-25T08:50:14.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-25T08:50:14.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-25T08:50:14.449 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-25T08:50:14.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-25T08:50:14.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-25T08:50:14.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-25T08:50:14.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-25T08:50:14.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-25T08:50:14.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-25T08:50:14.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-25T08:50:14.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-25T08:50:14.450 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-25T08:50:14.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-25T08:50:14.450 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-25T08:50:14.450 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-25T08:50:14.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-25T08:50:14.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-25T08:50:14.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-25T08:50:14.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-25T08:50:14.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-25T08:50:14.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-25T08:50:14.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-25T08:50:14.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-25T08:50:14.451 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-25T08:50:14.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-25T08:50:14.451 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-25T08:50:14.452 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-25T08:50:14.452 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-25T08:50:14.452 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-25T08:50:14.452 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-25T08:50:14.452 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-25T08:50:14.452 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-25T08:50:14.452 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-25T08:50:14.452 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-25T08:50:14.452 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-25T08:50:14.452 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-25T08:50:14.452 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-25T08:50:14.452 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-25T08:50:14.453 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-25T08:50:14.453 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-25T08:50:14.453 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-25T08:50:14.453 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-25T08:50:14.453 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-25T08:50:14.453 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-25T08:50:14.453 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-25T08:50:14.453 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-25T08:50:14.453 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-25T08:50:14.453 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-25T08:50:14.453 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-25T08:50:14.454 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-25T08:50:14.454 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-25T08:50:14.454 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-25T08:50:14.454 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-25T08:50:14.454 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-25T08:50:14.454 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-25T08:50:14.454 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-25T08:50:14.454 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-25T08:50:14.454 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-25T08:50:14.454 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-25T08:50:14.454 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-25T08:50:14.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-25T08:50:14.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-25T08:50:14.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-25T08:50:14.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-25T08:50:14.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-25T08:50:14.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-25T08:50:14.455 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-25T08:50:14.455 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-25T08:50:14.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-25T08:50:14.455 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-25T08:50:14.455 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-25T08:50:14.456 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-25T08:50:14.456 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-25T08:50:14.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-25T08:50:14.456 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-25T08:50:14.456 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-25T08:50:14.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-25T08:50:14.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-25T08:50:14.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-25T08:50:14.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-25T08:50:14.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-25T08:50:14.456 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-25T08:50:14.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-25T08:50:14.457 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-25T08:50:14.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-25T08:50:14.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-25T08:50:14.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-25T08:50:14.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-25T08:50:14.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-25T08:50:14.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-25T08:50:14.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-25T08:50:14.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-25T08:50:14.457 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-25T08:50:14.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-25T08:50:14.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-25T08:50:14.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-25T08:50:14.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-25T08:50:14.458 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-25T08:50:14.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-25T08:50:14.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-25T08:50:14.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-25T08:50:14.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-25T08:50:14.458 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-25T08:50:14.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-25T08:50:14.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-25T08:50:14.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-25T08:50:14.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-25T08:50:14.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-25T08:50:14.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-25T08:50:14.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-25T08:50:14.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-25T08:50:14.459 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-25T08:50:14.459 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-25T08:50:14.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-25T08:50:14.459 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-25T08:50:14.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-25T08:50:14.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-25T08:50:14.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-25T08:50:14.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-25T08:50:14.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-25T08:50:14.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-25T08:50:14.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-25T08:50:14.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-25T08:50:14.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-25T08:50:14.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-25T08:50:14.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-25T08:50:14.460 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-25T08:50:14.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-25T08:50:14.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-25T08:50:14.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-25T08:50:14.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-25T08:50:14.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-25T08:50:14.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-25T08:50:14.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-25T08:50:14.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-25T08:50:14.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-25T08:50:14.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-25T08:50:14.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-25T08:50:14.461 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-25T08:50:14.462 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-25T08:50:14.462 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-25T08:50:14.462 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-25T08:50:14.462 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-25T08:50:14.462 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-25T08:50:14.462 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-25T08:50:14.462 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-25T08:50:14.462 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-25T08:50:14.462 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-25T08:50:14.462 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-25T08:50:14.462 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-25T08:50:14.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-25T08:50:14.463 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-25T08:50:14.463 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-25T08:50:14.463 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-25T08:50:14.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-25T08:50:14.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-25T08:50:14.463 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-25T08:50:14.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-25T08:50:14.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-25T08:50:14.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-25T08:50:14.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-25T08:50:14.463 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-25T08:50:14.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-25T08:50:14.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-25T08:50:14.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-25T08:50:14.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-25T08:50:14.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-25T08:50:14.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-25T08:50:14.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-25T08:50:14.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-25T08:50:14.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-25T08:50:14.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-25T08:50:14.464 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-25T08:50:14.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-25T08:50:14.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-25T08:50:14.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-25T08:50:14.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-25T08:50:14.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-25T08:50:14.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-25T08:50:14.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-25T08:50:14.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-25T08:50:14.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-25T08:50:14.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-25T08:50:14.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-25T08:50:14.465 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-25T08:50:14.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-25T08:50:14.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-25T08:50:14.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-25T08:50:14.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-25T08:50:14.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-25T08:50:14.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-25T08:50:14.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-25T08:50:14.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-25T08:50:14.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-25T08:50:14.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-25T08:50:14.466 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-25T08:50:14.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-25T08:50:14.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-25T08:50:14.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-25T08:50:14.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-25T08:50:14.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-25T08:50:14.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-25T08:50:14.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-25T08:50:14.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-25T08:50:14.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-25T08:50:14.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-25T08:50:14.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-25T08:50:14.467 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-25T08:50:14.467 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-25T08:50:14.468 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-25T08:50:14.468 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-25T08:50:14.468 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-25T08:50:14.468 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-25T08:50:14.468 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-25T08:50:14.468 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-25T08:50:14.468 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-25T08:50:14.468 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-25T08:50:14.468 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-25T08:50:14.468 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-25T08:50:14.468 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-25T08:50:14.469 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-25T08:50:14.469 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-25T08:50:14.469 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-25T08:50:14.469 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-25T08:50:14.469 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-25T08:50:14.469 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-25T08:50:14.469 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-25T08:50:14.469 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-25T08:50:14.469 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-25T08:50:14.469 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-25T08:50:14.469 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-25T08:50:14.469 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-25T08:50:14.470 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-25T08:50:14.470 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-25T08:50:14.470 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-25T08:50:14.470 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-25T08:50:14.470 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-25T08:50:14.470 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-25T08:50:14.470 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-25T08:50:14.470 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-25T08:50:14.471 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-25T08:50:14.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-25T08:50:14.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-25T08:50:14.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-25T08:50:14.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-25T08:50:14.471 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-25T08:50:14.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-25T08:50:14.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-25T08:50:14.471 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-25T08:50:14.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-25T08:50:14.471 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-25T08:50:14.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-25T08:50:14.472 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-25T08:50:14.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-25T08:50:14.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-25T08:50:14.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-25T08:50:14.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-25T08:50:14.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-25T08:50:14.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-25T08:50:14.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-25T08:50:14.472 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-25T08:50:14.473 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-25T08:50:14.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-25T08:50:14.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-25T08:50:14.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-25T08:50:14.473 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-25T08:50:14.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-25T08:50:14.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-25T08:50:14.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-25T08:50:14.473 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-25T08:50:14.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-25T08:50:14.473 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-25T08:50:14.473 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-25T08:50:14.474 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-25T08:50:14.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-25T08:50:14.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-25T08:50:14.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-25T08:50:14.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-25T08:50:14.474 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-25T08:50:14.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-25T08:50:14.474 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-25T08:50:14.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-25T08:50:14.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-25T08:50:14.474 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-25T08:50:14.474 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-25T08:50:14.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-25T08:50:14.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-25T08:50:14.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-25T08:50:14.475 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-25T08:50:14.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-25T08:50:14.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-25T08:50:14.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-25T08:50:14.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-25T08:50:14.475 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-25T08:50:14.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-25T08:50:14.475 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-25T08:50:14.475 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-25T08:50:14.476 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-25T08:50:14.476 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-25T08:50:14.476 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-25T08:50:14.476 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-25T08:50:14.476 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-25T08:50:14.476 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-25T08:50:14.476 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-25T08:50:14.476 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-25T08:50:14.476 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-25T08:50:14.476 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-25T08:50:14.476 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-25T08:50:14.476 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-25T08:50:14.477 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-25T08:50:14.477 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-25T08:50:14.477 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-25T08:50:14.477 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-25T08:50:14.477 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-25T08:50:14.477 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-25T08:50:14.477 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-25T08:50:14.477 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-25T08:50:14.477 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-25T08:50:14.477 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-25T08:50:14.477 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-25T08:50:14.478 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-25T08:50:14.478 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-25T08:50:14.478 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-25T08:50:14.478 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-25T08:50:14.478 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-25T08:50:14.478 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-25T08:50:14.478 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-25T08:50:14.478 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-25T08:50:14.478 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-25T08:50:14.478 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-25T08:50:14.478 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-25T08:50:14.479 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-25T08:50:14.479 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-25T08:50:14.479 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-25T08:50:14.479 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-25T08:50:14.479 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-25T08:50:14.479 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-25T08:50:14.479 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-25T08:50:14.479 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-25T08:50:14.479 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-25T08:50:14.479 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-25T08:50:14.479 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-25T08:50:14.479 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-25T08:50:14.480 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-25T08:50:14.480 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-25T08:50:14.480 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-25T08:50:14.480 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-25T08:50:14.480 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-25T08:50:14.480 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-25T08:50:14.480 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-25T08:50:14.480 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-25T08:50:14.480 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-25T08:50:14.480 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-25T08:50:14.480 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-25T08:50:14.480 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-25T08:50:14.481 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-25T08:50:14.481 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-25T08:50:14.481 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-25T08:50:14.481 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-25T08:50:14.481 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-25T08:50:14.481 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-25T08:50:14.481 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-25T08:50:14.481 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-25T08:50:14.481 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-25T08:50:14.481 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-25T08:50:14.481 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-25T08:50:14.482 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-25T08:50:14.482 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-25T08:50:14.482 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-25T08:50:14.482 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-25T08:50:14.482 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-25T08:50:14.482 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-25T08:50:14.482 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-25T08:50:14.482 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-25T08:50:14.482 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-25T08:50:14.482 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-25T08:50:14.482 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-25T08:50:14.483 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-25T08:50:14.483 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-25T08:50:14.483 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-25T08:50:14.483 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-25T08:50:14.483 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-25T08:50:14.483 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-25T08:50:14.483 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-25T08:50:14.483 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-25T08:50:14.483 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-25T08:50:14.483 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-25T08:50:14.483 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-25T08:50:14.483 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-25T08:50:14.484 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-25T08:50:14.484 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-25T08:50:14.484 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-25T08:50:14.484 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-25T08:50:14.484 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-25T08:50:14.484 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-25T08:50:14.484 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-25T08:50:14.484 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-25T08:50:14.484 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-25T08:50:14.484 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-25T08:50:14.484 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-25T08:50:14.485 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-25T08:50:14.485 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-25T08:50:14.485 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-25T08:50:14.485 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-25T08:50:14.485 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-25T08:50:14.485 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-25T08:50:14.485 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-25T08:50:14.485 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-25T08:50:14.485 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-25T08:50:14.485 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-25T08:50:14.485 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-25T08:50:14.485 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-25T08:50:14.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-25T08:50:14.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-25T08:50:14.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-25T08:50:14.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-25T08:50:14.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-25T08:50:14.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-25T08:50:14.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-25T08:50:14.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-25T08:50:14.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-25T08:50:14.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-25T08:50:14.486 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-25T08:50:14.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-25T08:50:14.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-25T08:50:14.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-25T08:50:14.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-25T08:50:14.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-25T08:50:14.487 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-25T08:50:14.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-25T08:50:14.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-25T08:50:14.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-25T08:50:14.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-25T08:50:14.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-25T08:50:14.487 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-25T08:50:14.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-25T08:50:14.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-25T08:50:14.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-25T08:50:14.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-25T08:50:14.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-25T08:50:14.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-25T08:50:14.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-25T08:50:14.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-25T08:50:14.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-25T08:50:14.488 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-25T08:50:14.488 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-25T08:50:14.488 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-25T08:50:14.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-25T08:50:14.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-25T08:50:14.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-25T08:50:14.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-25T08:50:14.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-25T08:50:14.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-25T08:50:14.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-25T08:50:14.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-25T08:50:14.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-25T08:50:14.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-25T08:50:14.489 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-25T08:50:14.490 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-25T08:50:14.490 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-25T08:50:14.490 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-25T08:50:14.490 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-25T08:50:14.490 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-25T08:50:14.490 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-25T08:50:14.490 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-25T08:50:14.490 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-25T08:50:14.490 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-25T08:50:14.490 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-25T08:50:14.490 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-25T08:50:14.491 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-25T08:50:14.491 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-25T08:50:14.491 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-25T08:50:14.491 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-25T08:50:14.491 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-25T08:50:14.491 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-25T08:50:14.491 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-25T08:50:14.491 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-25T08:50:14.491 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-25T08:50:14.491 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-25T08:50:14.491 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-25T08:50:14.492 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-25T08:50:14.492 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-25T08:50:14.492 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-25T08:50:14.492 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-25T08:50:14.492 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-25T08:50:14.492 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-25T08:50:14.492 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-25T08:50:14.492 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-25T08:50:14.492 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-25T08:50:14.492 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-25T08:50:14.493 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-25T08:50:14.493 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-25T08:50:14.493 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-25T08:50:14.493 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-25T08:50:14.493 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-25T08:50:14.493 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-25T08:50:14.493 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-25T08:50:14.493 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-25T08:50:14.493 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-25T08:50:14.493 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-25T08:50:14.493 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-25T08:50:14.494 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-25T08:50:14.494 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-25T08:50:14.494 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-25T08:50:14.494 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-25T08:50:14.494 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-25T08:50:14.494 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-25T08:50:14.494 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-25T08:50:14.494 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-25T08:50:14.494 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-25T08:50:14.494 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-25T08:50:14.495 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-25T08:50:14.495 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-25T08:50:14.495 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-25T08:50:14.495 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-25T08:50:14.495 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-25T08:50:14.495 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-25T08:50:14.495 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-25T08:50:14.495 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-25T08:50:14.495 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-25T08:50:14.495 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-25T08:50:14.495 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-25T08:50:14.496 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-25T08:50:14.496 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-25T08:50:14.496 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-25T08:50:14.496 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-25T08:50:14.496 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-25T08:50:14.496 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-25T08:50:14.496 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-25T08:50:14.496 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-25T08:50:14.496 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-25T08:50:14.496 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-25T08:50:14.496 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-25T08:50:14.496 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-25T08:50:14.497 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-25T08:50:14.497 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-25T08:50:14.497 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-25T08:50:14.497 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-25T08:50:14.497 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-25T08:50:14.497 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-25T08:50:14.497 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-25T08:50:14.497 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-25T08:50:14.497 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-25T08:50:14.497 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-25T08:50:14.497 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-25T08:50:14.497 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-25T08:50:14.498 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-25T08:50:14.498 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-25T08:50:14.498 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-25T08:50:14.498 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-25T08:50:14.498 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-25T08:50:14.498 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-25T08:50:14.498 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-25T08:50:14.498 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-25T08:50:14.498 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-25T08:50:14.498 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-25T08:50:14.498 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-25T08:50:14.499 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-25T08:50:14.499 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-25T08:50:14.499 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-25T08:50:14.499 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-25T08:50:14.499 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-25T08:50:14.499 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-25T08:50:14.499 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-25T08:50:14.499 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-25T08:50:14.499 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-25T08:50:14.499 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-25T08:50:14.499 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-25T08:50:14.499 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-25T08:50:14.500 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-25T08:50:14.500 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-25T08:50:14.500 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-25T08:50:14.500 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-25T08:50:14.500 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-25T08:50:14.500 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-25T08:50:14.500 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-25T08:50:14.500 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-25T08:50:14.500 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-25T08:50:14.500 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-25T08:50:14.500 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-25T08:50:14.500 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-25T08:50:14.501 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-25T08:50:14.501 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-25T08:50:14.501 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-25T08:50:14.501 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-25T08:50:14.501 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-25T08:50:14.501 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-25T08:50:14.501 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-25T08:50:14.501 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-25T08:50:14.501 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-25T08:50:14.501 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-25T08:50:14.501 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-25T08:50:14.501 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-25T08:50:14.502 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-25T08:50:14.502 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-25T08:50:14.502 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-25T08:50:14.502 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-25T08:50:14.502 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-25T08:50:14.502 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-25T08:50:14.502 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-25T08:50:14.502 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-25T08:50:14.502 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-25T08:50:14.502 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-25T08:50:14.502 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-25T08:50:14.503 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-25T08:50:14.503 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-25T08:50:14.503 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-25T08:50:14.503 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-25T08:50:14.503 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-25T08:50:14.503 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-25T08:50:14.503 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-25T08:50:14.503 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-25T08:50:14.504 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-25T08:50:14.504 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-25T08:50:14.504 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-25T08:50:14.504 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-25T08:50:14.504 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-25T08:50:14.504 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-25T08:50:14.504 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-25T08:50:14.504 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-25T08:50:14.504 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-25T08:50:14.505 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-25T08:50:14.505 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-25T08:50:14.505 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-25T08:50:14.505 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-25T08:50:14.505 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-25T08:50:14.505 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-25T08:50:14.505 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-25T08:50:14.505 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-25T08:50:14.505 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-25T08:50:14.505 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-25T08:50:14.505 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-25T08:50:14.506 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-25T08:50:14.506 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-25T08:50:14.506 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-25T08:50:14.506 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-25T08:50:14.506 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-25T08:50:14.506 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-25T08:50:14.506 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-25T08:50:14.506 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-25T08:50:14.506 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-25T08:50:14.506 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-25T08:50:14.506 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-25T08:50:14.506 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-25T08:50:14.507 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-25T08:50:14.507 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-25T08:50:14.507 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-25T08:50:14.507 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-25T08:50:14.507 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-25T08:50:14.507 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-25T08:50:14.507 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-25T08:50:14.507 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-25T08:50:14.507 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-25T08:50:14.507 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-25T08:50:14.507 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-25T08:50:14.507 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-25T08:50:14.508 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-25T08:50:14.508 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-25T08:50:14.508 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-25T08:50:14.508 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-25T08:50:14.508 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-25T08:50:14.508 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-25T08:50:14.508 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-25T08:50:14.508 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-25T08:50:14.508 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-25T08:50:14.508 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-25T08:50:14.508 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-25T08:50:14.508 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-25T08:50:14.508 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-25T08:50:14.509 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-25T08:50:14.509 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-25T08:50:14.509 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-25T08:50:14.509 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-25T08:50:14.509 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-25T08:50:14.509 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-25T08:50:14.509 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-25T08:50:14.509 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-25T08:50:14.509 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-25T08:50:14.509 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-25T08:50:14.509 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-25T08:50:14.509 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-25T08:50:14.510 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-25T08:50:14.510 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-25T08:50:14.510 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-25T08:50:14.510 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-25T08:50:14.510 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-25T08:50:14.510 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-25T08:50:14.510 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-25T08:50:14.510 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-25T08:50:14.510 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-25T08:50:14.510 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-25T08:50:14.510 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-25T08:50:14.511 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-25T08:50:14.511 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-25T08:50:14.511 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-25T08:50:14.511 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-25T08:50:14.511 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-25T08:50:14.511 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-25T08:50:14.511 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-25T08:50:14.511 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-25T08:50:14.511 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-25T08:50:14.511 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-25T08:50:14.511 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-25T08:50:14.511 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-25T08:50:14.512 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-25T08:50:14.512 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-25T08:50:14.512 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-25T08:50:14.512 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-25T08:50:14.512 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-25T08:50:14.512 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-25T08:50:14.512 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-25T08:50:14.512 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-25T08:50:14.512 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-25T08:50:14.512 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-25T08:50:14.512 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-25T08:50:14.512 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-25T08:50:14.513 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-25T08:50:14.513 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-25T08:50:14.513 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-25T08:50:14.513 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-25T08:50:14.513 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-25T08:50:14.513 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-25T08:50:14.513 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-25T08:50:14.513 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-25T08:50:14.513 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-25T08:50:14.513 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-25T08:50:14.513 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-25T08:50:14.513 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-25T08:50:14.513 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-25T08:50:14.513 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-25T08:50:14.514 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-25T08:50:14.514 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-25T08:50:14.514 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-25T08:50:14.514 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-25T08:50:14.514 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-25T08:50:14.514 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-25T08:50:14.514 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-25T08:50:14.514 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-25T08:50:14.514 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-25T08:50:14.514 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-25T08:50:14.514 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-25T08:50:14.514 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-25T08:50:14.515 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-25T08:50:14.515 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-25T08:50:14.515 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-25T08:50:14.515 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-25T08:50:14.515 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-25T08:50:14.515 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-25T08:50:14.515 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-25T08:50:14.515 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-25T08:50:14.515 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-25T08:50:14.515 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-25T08:50:14.515 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-25T08:50:14.515 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-25T08:50:14.516 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-25T08:50:14.516 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-25T08:50:14.516 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-25T08:50:14.516 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-25T08:50:14.516 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-25T08:50:14.516 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-25T08:50:14.516 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-25T08:50:14.516 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-25T08:50:14.516 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-25T08:50:14.516 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-25T08:50:14.516 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-25T08:50:14.516 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-25T08:50:14.517 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-25T08:50:14.517 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-25T08:50:14.517 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-25T08:50:14.517 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-25T08:50:14.517 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-25T08:50:14.517 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-25T08:50:14.517 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-25T08:50:14.517 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-25T08:50:14.517 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-25T08:50:14.517 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-25T08:50:14.517 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-25T08:50:14.517 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-25T08:50:14.517 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-25T08:50:14.518 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-25T08:50:14.518 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-25T08:50:14.518 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-25T08:50:14.518 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-25T08:50:14.518 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-25T08:50:14.518 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-25T08:50:14.518 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-25T08:50:14.518 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-25T08:50:14.518 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-25T08:50:14.518 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-25T08:50:14.518 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-25T08:50:14.519 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-25T08:50:14.519 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-25T08:50:14.519 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-25T08:50:14.519 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-25T08:50:14.519 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-25T08:50:14.519 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-25T08:50:14.519 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-25T08:50:14.519 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-25T08:50:14.519 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-25T08:50:14.519 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-25T08:50:14.519 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-25T08:50:14.519 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-25T08:50:14.519 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-25T08:50:14.520 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-25T08:50:14.520 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-25T08:50:14.520 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-25T08:50:14.520 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-25T08:50:14.520 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-25T08:50:14.520 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-25T08:50:14.520 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-25T08:50:14.520 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-25T08:50:14.520 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-25T08:50:14.520 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-25T08:50:14.520 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-25T08:50:14.520 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-25T08:50:14.521 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-25T08:50:14.521 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-25T08:50:14.521 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-25T08:50:14.521 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-25T08:50:14.521 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-25T08:50:14.521 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-25T08:50:14.521 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-25T08:50:14.521 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-25T08:50:14.521 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-25T08:50:14.522 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-25T08:50:14.522 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-25T08:50:14.522 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-25T08:50:14.522 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-25T08:50:14.522 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-25T08:50:14.522 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-25T08:50:14.522 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-25T08:50:14.522 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-25T08:50:14.522 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-25T08:50:14.522 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-25T08:50:14.522 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-25T08:50:14.523 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-25T08:50:14.523 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-25T08:50:14.523 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-25T08:50:14.523 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-25T08:50:14.523 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-25T08:50:14.523 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-25T08:50:14.523 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-25T08:50:14.523 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-25T08:50:14.523 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-25T08:50:14.523 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-25T08:50:14.523 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-25T08:50:14.524 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-25T08:50:14.524 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-25T08:50:14.524 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-25T08:50:14.524 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-25T08:50:14.524 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-25T08:50:14.524 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-25T08:50:14.524 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-25T08:50:14.524 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-25T08:50:14.524 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-25T08:50:14.524 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-25T08:50:14.524 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-25T08:50:14.524 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-25T08:50:14.525 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-25T08:50:14.525 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-25T08:50:14.574 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-25T08:50:14.574 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-25T08:50:14.574 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-25T08:50:14.574 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-25T08:50:14.574 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-25T08:50:14.575 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-25T08:50:14.575 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-25T08:50:14.575 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-25T08:50:14.575 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-25T08:50:14.575 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-25T08:50:14.575 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-25T08:50:14.575 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-25T08:50:14.575 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-25T08:50:14.575 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-25T08:50:14.575 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-25T08:50:14.575 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-25T08:50:14.575 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-25T08:50:14.576 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-25T08:50:14.576 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-25T08:50:14.576 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-25T08:50:14.576 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-25T08:50:14.576 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-25T08:50:14.576 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-25T08:50:14.576 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-25T08:50:14.576 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-25T08:50:14.576 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-25T08:50:14.576 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-25T08:50:14.576 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-25T08:50:14.576 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-25T08:50:14.577 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-25T08:50:14.577 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-25T08:50:14.577 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-25T08:50:14.577 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-25T08:50:14.577 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-25T08:50:14.577 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-25T08:50:14.577 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-25T08:50:14.577 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-25T08:50:14.577 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-25T08:50:14.577 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-25T08:50:14.577 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-25T08:50:14.577 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-25T08:50:14.578 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-25T08:50:14.578 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-25T08:50:14.578 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-25T08:50:14.578 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-25T08:50:14.578 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-25T08:50:14.578 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-25T08:50:14.578 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-25T08:50:14.578 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-25T08:50:14.578 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-25T08:50:14.578 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-25T08:50:14.578 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-25T08:50:14.579 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-25T08:50:14.579 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-25T08:50:14.579 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-25T08:50:14.579 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-25T08:50:14.579 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-25T08:50:14.579 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-25T08:50:14.579 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-25T08:50:14.579 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-25T08:50:14.579 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-25T08:50:14.579 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-25T08:50:14.579 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-25T08:50:14.579 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-25T08:50:14.579 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-25T08:50:14.579 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-25T08:50:14.580 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-25T08:50:14.580 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-25T08:50:14.580 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-25T08:50:14.580 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-25T08:50:14.580 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-25T08:50:14.580 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-25T08:50:14.580 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-25T08:50:14.580 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-25T08:50:14.580 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-25T08:50:14.580 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-25T08:50:14.581 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-25T08:50:14.581 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-25T08:50:14.581 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-25T08:50:14.581 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-25T08:50:14.581 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-25T08:50:14.581 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-25T08:50:14.581 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-25T08:50:14.581 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-25T08:50:14.581 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-25T08:50:14.581 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-25T08:50:14.581 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-25T08:50:14.582 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-25T08:50:14.582 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-25T08:50:14.582 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-25T08:50:14.582 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-25T08:50:14.582 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-25T08:50:14.582 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-25T08:50:14.582 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-25T08:50:14.582 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-25T08:50:14.582 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-25T08:50:14.582 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-25T08:50:14.582 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-25T08:50:14.583 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-25T08:50:14.583 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-25T08:50:14.583 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-25T08:50:14.583 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-25T08:50:14.583 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-25T08:50:14.583 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-25T08:50:14.583 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-25T08:50:14.583 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-25T08:50:14.583 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-25T08:50:14.583 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-25T08:50:14.583 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-25T08:50:14.584 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-25T08:50:14.584 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-25T08:50:14.584 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-25T08:50:14.584 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-25T08:50:14.584 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-25T08:50:14.584 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-25T08:50:14.584 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-25T08:50:14.584 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-25T08:50:14.584 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-25T08:50:14.584 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-25T08:50:14.584 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-25T08:50:14.584 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-25T08:50:14.585 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-25T08:50:14.585 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-25T08:50:14.585 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-25T08:50:14.585 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-25T08:50:14.585 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-25T08:50:14.585 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-25T08:50:14.585 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-25T08:50:14.585 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-25T08:50:14.585 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-25T08:50:14.585 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-25T08:50:14.585 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-25T08:50:14.586 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-25T08:50:14.586 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-25T08:50:14.586 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-25T08:50:14.586 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-25T08:50:14.586 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-25T08:50:14.586 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-25T08:50:14.586 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-25T08:50:14.586 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-25T08:50:14.586 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-25T08:50:14.586 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-25T08:50:14.586 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-25T08:50:14.586 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-25T08:50:14.587 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-25T08:50:14.587 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-25T08:50:14.587 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-25T08:50:14.587 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-25T08:50:14.587 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-25T08:50:14.587 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-25T08:50:14.587 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-25T08:50:14.587 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-25T08:50:14.587 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-25T08:50:14.587 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-25T08:50:14.587 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-25T08:50:14.587 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-25T08:50:14.588 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-25T08:50:14.588 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-25T08:50:14.588 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-25T08:50:14.588 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-25T08:50:14.588 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-25T08:50:14.588 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-25T08:50:14.588 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-25T08:50:14.588 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-25T08:50:14.588 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-25T08:50:14.588 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-25T08:50:14.588 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-25T08:50:14.589 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-25T08:50:14.589 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-25T08:50:14.589 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-25T08:50:14.589 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-25T08:50:14.589 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-25T08:50:14.589 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-25T08:50:14.589 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-25T08:50:14.589 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-25T08:50:14.589 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-25T08:50:14.589 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-25T08:50:14.589 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-25T08:50:14.590 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-25T08:50:14.590 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-25T08:50:14.590 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-25T08:50:14.590 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-25T08:50:14.590 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-25T08:50:14.590 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-25T08:50:14.590 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-25T08:50:14.590 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-25T08:50:14.590 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-25T08:50:14.590 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-25T08:50:14.590 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-25T08:50:14.591 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-25T08:50:14.591 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-25T08:50:14.591 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-25T08:50:14.591 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-25T08:50:14.591 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-25T08:50:14.591 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-25T08:50:14.591 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-25T08:50:14.591 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-25T08:50:14.591 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-25T08:50:14.591 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-25T08:50:14.591 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-25T08:50:14.592 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-25T08:50:14.592 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-25T08:50:14.592 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-25T08:50:14.592 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-25T08:50:14.592 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-25T08:50:14.592 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-25T08:50:14.592 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-25T08:50:14.592 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-25T08:50:14.592 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-25T08:50:14.592 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-25T08:50:14.592 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-25T08:50:14.592 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-25T08:50:14.593 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-25T08:50:14.593 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-25T08:50:14.593 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-25T08:50:14.593 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-25T08:50:14.593 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-25T08:50:14.593 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-25T08:50:14.593 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-25T08:50:14.593 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-25T08:50:14.593 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-25T08:50:14.593 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-25T08:50:14.593 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-25T08:50:14.593 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-25T08:50:14.594 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-25T08:50:14.594 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-25T08:50:14.594 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-25T08:50:14.594 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-25T08:50:14.594 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-25T08:50:14.594 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-25T08:50:14.594 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-25T08:50:14.594 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-25T08:50:14.594 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-25T08:50:14.594 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-25T08:50:14.594 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-25T08:50:14.595 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-25T08:50:14.595 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-25T08:50:14.595 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-25T08:50:14.595 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-25T08:50:14.595 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-25T08:50:14.595 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-25T08:50:14.595 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-25T08:50:14.595 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-25T08:50:14.595 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-25T08:50:14.595 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-25T08:50:14.595 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-25T08:50:14.595 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-25T08:50:14.596 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-25T08:50:14.596 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-25T08:50:14.596 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-25T08:50:14.596 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-25T08:50:14.596 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-25T08:50:14.596 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-25T08:50:14.596 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-25T08:50:14.596 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-25T08:50:14.596 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-25T08:50:14.596 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-25T08:50:14.596 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-25T08:50:14.597 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-25T08:50:14.597 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-25T08:50:14.597 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-25T08:50:14.597 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-25T08:50:14.597 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-25T08:50:14.597 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-25T08:50:14.597 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-25T08:50:14.597 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-25T08:50:14.597 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-25T08:50:14.597 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-25T08:50:14.597 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-25T08:50:14.598 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-25T08:50:14.598 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-25T08:50:14.598 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-25T08:50:14.598 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-25T08:50:14.598 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-25T08:50:14.598 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-25T08:50:14.598 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-25T08:50:14.598 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-25T08:50:14.598 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-25T08:50:14.598 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-25T08:50:14.598 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-25T08:50:14.598 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-25T08:50:14.599 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-25T08:50:14.599 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-25T08:50:14.599 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-25T08:50:14.599 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-25T08:50:14.599 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-25T08:50:14.599 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-25T08:50:14.599 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-25T08:50:14.599 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-25T08:50:14.599 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-25T08:50:14.599 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-25T08:50:14.599 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-25T08:50:14.599 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-25T08:50:14.600 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-25T08:50:14.600 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-25T08:50:14.600 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-25T08:50:14.600 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-25T08:50:14.600 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-25T08:50:14.600 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-25T08:50:14.600 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-25T08:50:14.600 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-25T08:50:14.600 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-25T08:50:14.600 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-25T08:50:14.600 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-25T08:50:14.601 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-25T08:50:14.601 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-25T08:50:14.601 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-25T08:50:14.601 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-25T08:50:14.601 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-25T08:50:14.601 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-25T08:50:14.601 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-25T08:50:14.601 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-25T08:50:14.601 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-25T08:50:14.601 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-25T08:50:14.601 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-25T08:50:14.601 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-25T08:50:14.602 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-25T08:50:14.602 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-25T08:50:14.602 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-25T08:50:14.602 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-25T08:50:14.602 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-25T08:50:14.602 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-25T08:50:14.602 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-25T08:50:14.602 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-25T08:50:14.602 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-25T08:50:14.602 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-25T08:50:14.602 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-25T08:50:14.602 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-25T08:50:14.603 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-25T08:50:14.603 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-25T08:50:14.603 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-25T08:50:14.603 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-25T08:50:14.603 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-25T08:50:14.603 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-25T08:50:14.603 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-25T08:50:14.603 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-25T08:50:14.603 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-25T08:50:14.603 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-25T08:50:14.603 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-25T08:50:14.603 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-25T08:50:14.603 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-25T08:50:14.604 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-25T08:50:14.604 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-25T08:50:14.604 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-25T08:50:14.604 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-25T08:50:14.604 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-25T08:50:14.604 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-25T08:50:14.604 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-25T08:50:14.604 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-25T08:50:14.604 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-25T08:50:14.604 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-25T08:50:14.604 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-25T08:50:14.604 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-25T08:50:14.605 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-25T08:50:14.605 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-25T08:50:14.605 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-25T08:50:14.605 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-25T08:50:14.605 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-25T08:50:14.605 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-25T08:50:14.605 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-25T08:50:14.605 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-25T08:50:14.605 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-25T08:50:14.605 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-25T08:50:14.605 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-25T08:50:14.606 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-25T08:50:14.606 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-25T08:50:14.606 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-25T08:50:14.606 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-25T08:50:14.606 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-25T08:50:14.606 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-25T08:50:14.606 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-25T08:50:14.606 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-25T08:50:14.606 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-25T08:50:14.606 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-25T08:50:14.606 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-25T08:50:14.607 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-25T08:50:14.607 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-25T08:50:14.607 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-25T08:50:14.607 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-25T08:50:14.607 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-25T08:50:14.607 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-25T08:50:14.607 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-25T08:50:14.607 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-25T08:50:14.607 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-25T08:50:14.607 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-25T08:50:14.607 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-25T08:50:14.607 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-25T08:50:14.608 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-25T08:50:14.608 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-25T08:50:14.608 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-25T08:50:14.608 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-25T08:50:14.608 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-25T08:50:14.608 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-25T08:50:14.608 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-25T08:50:14.608 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-25T08:50:14.608 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-25T08:50:14.608 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-25T08:50:14.608 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-25T08:50:14.608 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-25T08:50:14.609 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-25T08:50:14.609 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-25T08:50:14.609 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-25T08:50:14.609 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-25T08:50:14.609 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-25T08:50:14.609 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-25T08:50:14.609 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-25T08:50:14.609 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-25T08:50:14.609 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-25T08:50:14.609 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-25T08:50:14.609 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-25T08:50:14.609 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-25T08:50:14.610 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-25T08:50:14.610 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-25T08:50:14.610 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-25T08:50:14.610 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-25T08:50:14.610 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-25T08:50:14.610 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-25T08:50:14.610 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-25T08:50:14.610 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-25T08:50:14.610 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-25T08:50:14.610 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-25T08:50:14.610 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-25T08:50:14.611 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-25T08:50:14.611 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-25T08:50:14.611 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-25T08:50:14.611 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-25T08:50:14.611 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-25T08:50:14.611 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-25T08:50:14.611 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-25T08:50:14.611 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-25T08:50:14.611 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-25T08:50:14.611 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-25T08:50:14.611 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-25T08:50:14.611 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-25T08:50:14.612 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-25T08:50:14.612 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-25T08:50:14.612 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-25T08:50:14.612 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-25T08:50:14.612 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-25T08:50:14.612 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-25T08:50:14.612 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-25T08:50:14.612 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-25T08:50:14.612 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-25T08:50:14.612 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-25T08:50:14.612 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-25T08:50:14.613 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-25T08:50:14.613 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-25T08:50:14.613 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-25T08:50:14.613 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-25T08:50:14.613 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-25T08:50:14.613 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-25T08:50:14.613 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-25T08:50:14.613 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-25T08:50:14.613 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-25T08:50:14.613 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-25T08:50:14.613 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-25T08:50:14.614 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-25T08:50:14.614 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-25T08:50:14.614 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-25T08:50:14.614 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-25T08:50:14.614 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-25T08:50:14.614 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-25T08:50:14.614 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-25T08:50:14.614 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-25T08:50:14.614 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-25T08:50:14.614 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-25T08:50:14.614 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-25T08:50:14.614 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-25T08:50:14.615 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-25T08:50:14.615 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-25T08:50:14.617 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-25T08:50:14.617 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-25T08:50:14.617 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-25T08:50:14.617 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-25T08:50:14.617 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-25T08:50:14.617 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-25T08:50:14.618 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-25T08:50:14.618 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-25T08:50:14.618 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-25T08:50:14.618 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-25T08:50:14.618 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-25T08:50:14.618 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-25T08:50:14.618 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-25T08:50:14.618 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-25T08:50:14.618 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-25T08:50:14.618 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-25T08:50:14.618 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-25T08:50:14.619 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-25T08:50:14.619 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-25T08:50:14.619 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-25T08:50:14.619 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-25T08:50:14.619 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-25T08:50:14.619 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-25T08:50:14.619 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-25T08:50:14.619 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-25T08:50:14.619 INFO:teuthology.orchestra.run.smithi175.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-25T08:50:14.619 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-25T08:50:14.619 INFO:teuthology.orchestra.run.smithi175.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-25T08:50:14.624 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:14.624 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:14.625 DEBUG:teuthology.orchestra.run.smithi175:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-25T08:50:14.632 INFO:teuthology.orchestra.run.smithi175.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T08:50:14.632 INFO:teuthology.orchestra.run.smithi175.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T08:50:14.632 INFO:teuthology.orchestra.run.smithi175.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T08:50:14.632 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-25T08:50:14.633 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:14.633 DEBUG:teuthology.orchestra.run.smithi175:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-25T08:50:14.675 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi175.front.sepia.ceph.com to complete... 2024-04-25T08:50:15.102 INFO:teuthology.orchestra.run.smithi175.stderr:Sourcing file `/etc/default/grub' 2024-04-25T08:50:15.102 INFO:teuthology.orchestra.run.smithi175.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T08:50:15.153 INFO:teuthology.orchestra.run.smithi175.stderr:Generating grub configuration file ... 2024-04-25T08:50:15.385 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:15.392 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T08:50:15.676 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T08:50:15.682 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T08:50:15.724 INFO:teuthology.orchestra.run.smithi175.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T08:50:15.729 INFO:teuthology.orchestra.run.smithi175.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T08:50:15.885 INFO:teuthology.orchestra.run.smithi175.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T08:50:15.885 INFO:teuthology.orchestra.run.smithi175.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T08:50:15.885 INFO:teuthology.orchestra.run.smithi175.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T08:50:15.899 INFO:teuthology.orchestra.run.smithi175.stderr:done 2024-04-25T08:50:43.928 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-25T08:50:43.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-04-25T08:50:43.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:50:47.016 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-25T08:50:47.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-25T08:50:47.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:51:02.302 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-04-25T08:51:05.374 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-25T08:51:11.307 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-04-25T08:51:11.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:51:14.366 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-04-25T08:51:14.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-25T08:51:14.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:51:17.438 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-25T08:51:26.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-04-25T08:51:26.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:51:29.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-25T08:51:29.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:51:47.874 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-25T08:51:58.129 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-04-25T08:51:58.709 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-04-25T08:51:58.709 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g806ec36b2112"... 2024-04-25T08:51:58.709 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-04-25T08:51:58.757 INFO:teuthology.orchestra.run.smithi177.stdout:6.9.0-rc3-g806ec36b2112 2024-04-25T08:51:58.757 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-25T08:51:58.757 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T08:51:58.757 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T08:51:59.758 DEBUG:teuthology.parallel:result is None 2024-04-25T08:52:02.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-25T08:52:02.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:52:02.878 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-25T08:52:20.879 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-25T08:52:20.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:52:21.160 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-04-25T08:52:21.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-25T08:52:21.809 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-25T08:52:21.810 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-04-25T08:52:21.859 INFO:teuthology.orchestra.run.smithi175.stdout:6.9.0-rc3-g806ec36b2112 2024-04-25T08:52:21.860 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-25T08:52:21.860 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T08:52:21.860 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T08:52:22.861 DEBUG:teuthology.parallel:result is None 2024-04-25T08:52:22.862 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T08:52:22.873 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T08:52:22.873 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T08:52:22.877 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T08:52:22.885 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T08:52:22.906 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T08:52:23.025 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T08:52:23.025 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T08:52:23.028 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T08:52:23.053 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T08:52:23.077 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T08:52:23.078 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T08:52:23.083 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T08:52:23.146 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:52:23.174 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:52:23.198 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:52:23.224 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:52:23.227 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T08:52:23.234 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T08:52:23.235 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T08:52:23.238 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T08:52:23.259 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T08:52:23.380 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T08:52:23.380 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T08:52:23.383 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T08:52:23.393 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T08:52:23.441 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T08:52:23.493 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T08:52:23.493 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T08:52:23.565 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T08:52:23.575 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T08:52:23.631 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T08:52:23.631 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T08:52:23.704 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-04-25T08:52:23.708 DEBUG:teuthology.orchestra.run.smithi177:> sudo service rsyslog restart 2024-04-25T08:52:23.832 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T08:52:23.840 INFO:teuthology.task.internal:Starting timer... 2024-04-25T08:52:23.840 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T08:52:23.885 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T08:52:23.934 DEBUG:teuthology.task.selinux:Excluding smithi175: OS 'ubuntu' does not support SELinux 2024-04-25T08:52:23.934 DEBUG:teuthology.task.selinux:Excluding smithi177: OS 'ubuntu' does not support SELinux 2024-04-25T08:52:23.935 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T08:52:23.935 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-25T08:52:23.935 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T08:52:23.935 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T08:52:23.984 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T08:52:23.990 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T08:52:24.123 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T08:52:24.139 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T08:52:24.140 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi175.front.sepia.ceph.com,smithi177.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T09:00:02.463 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi175.front.sepia.ceph.com'), Remote(name='ubuntu@smithi177.front.sepia.ceph.com')] 2024-04-25T09:00:02.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-25T09:00:02.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:00:02.545 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-04-25T09:00:02.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-25T09:00:02.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-04-25T09:00:02.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:00:02.784 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-04-25T09:00:02.909 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-04-25T09:00:02.910 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T09:00:02.921 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T09:00:02.921 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T09:00:02.922 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:00:02.925 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T09:00:02.925 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:00:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T09:00:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: Command line: ntpd -gq 2024-04-25T09:00:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: ---------------------------------------------------- 2024-04-25T09:00:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T09:00:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T09:00:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: corporation. Support and training for ntp-4 are 2024-04-25T09:00:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: available at https://www.nwtime.org/support 2024-04-25T09:00:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: ---------------------------------------------------- 2024-04-25T09:00:02.961 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: proto: precision = 0.041 usec (-24) 2024-04-25T09:00:02.961 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: basedate set to 2022-02-04 2024-04-25T09:00:02.961 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: gps base set to 2022-02-06 (week 2196) 2024-04-25T09:00:02.962 INFO:teuthology.orchestra.run.smithi175.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T09:00:02.962 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T09:00:02.962 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T09:00:02.962 INFO:teuthology.orchestra.run.smithi175.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T09:00:02.963 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T09:00:02.963 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T09:00:02.963 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T09:00:02.964 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: Listen normally on 3 enp3s0f1 172.21.15.175:123 2024-04-25T09:00:02.964 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: Listen normally on 4 lo [::1]:123 2024-04-25T09:00:02.964 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:71f1%5]:123 2024-04-25T09:00:02.964 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:02 ntpd[17214]: Listening on routing socket on fd #22 for interface updates 2024-04-25T09:00:02.992 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T09:00:02.992 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: Command line: ntpd -gq 2024-04-25T09:00:02.992 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: ---------------------------------------------------- 2024-04-25T09:00:02.992 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T09:00:02.992 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T09:00:02.993 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: corporation. Support and training for ntp-4 are 2024-04-25T09:00:02.993 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: available at https://www.nwtime.org/support 2024-04-25T09:00:02.993 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: ---------------------------------------------------- 2024-04-25T09:00:02.993 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: proto: precision = 0.041 usec (-24) 2024-04-25T09:00:02.993 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: basedate set to 2022-02-04 2024-04-25T09:00:02.994 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: gps base set to 2022-02-06 (week 2196) 2024-04-25T09:00:02.994 INFO:teuthology.orchestra.run.smithi177.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T09:00:02.994 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T09:00:02.994 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T09:00:02.995 INFO:teuthology.orchestra.run.smithi177.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T09:00:02.995 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T09:00:02.996 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T09:00:02.996 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T09:00:02.996 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: Listen normally on 3 enp3s0f1 172.21.15.177:123 2024-04-25T09:00:02.996 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: Listen normally on 4 lo [::1]:123 2024-04-25T09:00:02.996 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feea:b04b%5]:123 2024-04-25T09:00:02.996 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:03 ntpd[17215]: Listening on routing socket on fd #22 for interface updates 2024-04-25T09:00:03.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:03 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:03.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:03 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:04.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:04 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:04.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:04 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:04.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:04 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:04.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:04 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:04.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:04 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:04.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:04 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:05.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:05 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:05.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:05 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:05.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:05 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:05.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:05 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:05.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:05 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:05.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:05 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:06.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:06 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:06.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:06 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:06.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:06 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:06.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:06 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:06.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:06 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:06.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:06 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:06.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:06 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:06.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:06 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:06.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:06 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:06.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:06 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:06.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:06 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:06.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:06 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:06.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:07 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:06.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:07 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:06.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:07 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:06.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:07 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:06.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:07 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:06.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:07 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:06.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:07 ntpd[17215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:06.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:07 ntpd[17215]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:06.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:07 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:06.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:07 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:06.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:07 ntpd[17215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:06.995 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:07 ntpd[17215]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:07.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:07 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:07.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:07 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:07.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:07 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:07.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:07 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:07.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:07 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:07.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:07 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:07.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:08 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:07.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:08 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:07.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:08 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:07.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:08 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:07.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:08 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:07.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:08 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:07.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:08 ntpd[17215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:07.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:08 ntpd[17215]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:08.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:08 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:08.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:08 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:08.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:08 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:08.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:08 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:08.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:08 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:08.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:08 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:08.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:08 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:08.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:08 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:08.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:08 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:08.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:08 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:08.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:08 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:08.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:08 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:08.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:09 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:08.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:09 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:08.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:09 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:08.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:09 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:08.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:09 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:08.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:09 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:08.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:09 ntpd[17215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:08.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:09 ntpd[17215]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:08.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:09 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:08.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:09 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:08.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:09 ntpd[17215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:08.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:09 ntpd[17215]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:09.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:09 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:09.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:09 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:09.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:09 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:09.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:09 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:09.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:09 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:09.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:09 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:10 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:10 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:10 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:10 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:10 ntpd[17215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:10 ntpd[17215]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:10.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:10 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:10.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:10 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:10.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:10 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:10.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:10 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:10.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:10 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:10.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:10 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:10.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:10 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:10.961 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:10 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:10.962 INFO:teuthology.orchestra.run.smithi175.stdout:25 Apr 09:00:10 ntpd[17214]: ntpd: time slew -0.000504 s 2024-04-25T09:00:10.962 INFO:teuthology.orchestra.run.smithi175.stdout:ntpd: time slew -0.000504s 2024-04-25T09:00:10.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:10 ntpd[17214]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T09:00:10.962 INFO:teuthology.orchestra.run.smithi175.stderr:25 Apr 09:00:10 ntpd[17214]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T09:00:10.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:11 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:10.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:11 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:10.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:11 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:10.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:11 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:10.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:11 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:10.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:11 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:10.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:11 ntpd[17215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:10.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:11 ntpd[17215]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:10.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:11 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:10.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:11 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:10.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:11 ntpd[17215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:10.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:11 ntpd[17215]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T09:00:11.044 INFO:teuthology.orchestra.run.smithi175.stdout:============================================================================== 2024-04-25T09:00:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T09:00:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T09:00:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T09:00:11.044 INFO:teuthology.orchestra.run.smithi175.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T09:00:11.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:12 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:11.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:12 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:11.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:12 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:11.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:12 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:11.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:12 ntpd[17215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:11.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:12 ntpd[17215]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:12.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:13 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:12.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:13 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:12.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:13 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:12.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:13 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:12.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:13 ntpd[17215]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:00:12.993 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:13 ntpd[17215]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:00:12.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:13 ntpd[17215]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:00:12.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:13 ntpd[17215]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:00:12.994 INFO:teuthology.orchestra.run.smithi177.stdout:25 Apr 09:00:13 ntpd[17215]: ntpd: time slew -0.000014 s 2024-04-25T09:00:12.994 INFO:teuthology.orchestra.run.smithi177.stdout:ntpd: time slew -0.000014s 2024-04-25T09:00:12.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:13 ntpd[17215]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T09:00:12.994 INFO:teuthology.orchestra.run.smithi177.stderr:25 Apr 09:00:13 ntpd[17215]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T09:00:13.087 INFO:teuthology.orchestra.run.smithi177.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T09:00:13.087 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================== 2024-04-25T09:00:13.088 INFO:teuthology.orchestra.run.smithi177.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T09:00:13.088 INFO:teuthology.orchestra.run.smithi177.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T09:00:13.088 INFO:teuthology.orchestra.run.smithi177.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T09:00:13.088 INFO:teuthology.orchestra.run.smithi177.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T09:00:13.089 INFO:teuthology.run_tasks:Running task install... 2024-04-25T09:00:13.102 DEBUG:teuthology.task.install:project ceph 2024-04-25T09:00:13.103 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}} 2024-04-25T09:00:13.103 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'} 2024-04-25T09:00:13.103 INFO:teuthology.task.install:Using flavor: default 2024-04-25T09:00:13.109 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T09:00:13.109 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T09:00:13.109 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-key list | grep Ceph 2024-04-25T09:00:13.110 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-key list | grep Ceph 2024-04-25T09:00:13.215 INFO:teuthology.orchestra.run.smithi175.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T09:00:13.229 INFO:teuthology.orchestra.run.smithi177.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T09:00:13.266 INFO:teuthology.orchestra.run.smithi175.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T09:00:13.266 INFO:teuthology.orchestra.run.smithi175.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T09:00:13.267 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T09:00:13.267 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T09:00:13.267 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T09:00:13.280 INFO:teuthology.orchestra.run.smithi177.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T09:00:13.280 INFO:teuthology.orchestra.run.smithi177.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T09:00:13.281 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T09:00:13.281 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T09:00:13.281 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T09:00:13.446 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default/ 2024-04-25T09:00:13.446 INFO:teuthology.task.install.deb:Package version is 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T09:00:13.450 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default/ 2024-04-25T09:00:13.450 INFO:teuthology.task.install.deb:Package version is 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T09:00:13.580 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:00:13.580 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T09:00:13.589 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:00:13.590 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T09:00:13.600 DEBUG:teuthology.orchestra.run.smithi175:> sudo apt-get update 2024-04-25T09:00:13.608 DEBUG:teuthology.orchestra.run.smithi177:> sudo apt-get update 2024-04-25T09:00:13.851 INFO:teuthology.orchestra.run.smithi175.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T09:00:13.871 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T09:00:13.878 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T09:00:13.906 INFO:teuthology.orchestra.run.smithi175.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T09:00:13.907 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T09:00:13.918 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T09:00:13.934 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-25T09:00:13.946 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T09:00:13.971 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,398 B] 2024-04-25T09:00:13.981 INFO:teuthology.orchestra.run.smithi177.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T09:00:14.048 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T09:00:14.111 INFO:teuthology.orchestra.run.smithi177.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T09:00:14.149 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-25T09:00:14.220 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,398 B] 2024-04-25T09:00:14.424 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T09:00:14.456 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 28.9 kB in 1s (46.1 kB/s) 2024-04-25T09:00:15.446 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2024-04-25T09:00:15.461 DEBUG:teuthology.orchestra.run.smithi177:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1628-g97ae6cc9-1jammy cephadm=19.0.0-1628-g97ae6cc9-1jammy ceph-mds=19.0.0-1628-g97ae6cc9-1jammy ceph-mgr=19.0.0-1628-g97ae6cc9-1jammy ceph-common=19.0.0-1628-g97ae6cc9-1jammy ceph-fuse=19.0.0-1628-g97ae6cc9-1jammy ceph-test=19.0.0-1628-g97ae6cc9-1jammy ceph-volume=19.0.0-1628-g97ae6cc9-1jammy radosgw=19.0.0-1628-g97ae6cc9-1jammy python3-rados=19.0.0-1628-g97ae6cc9-1jammy python3-rgw=19.0.0-1628-g97ae6cc9-1jammy python3-cephfs=19.0.0-1628-g97ae6cc9-1jammy python3-rbd=19.0.0-1628-g97ae6cc9-1jammy libcephfs2=19.0.0-1628-g97ae6cc9-1jammy libcephfs-dev=19.0.0-1628-g97ae6cc9-1jammy librados2=19.0.0-1628-g97ae6cc9-1jammy librbd1=19.0.0-1628-g97ae6cc9-1jammy rbd-fuse=19.0.0-1628-g97ae6cc9-1jammy python3-cephfs=19.0.0-1628-g97ae6cc9-1jammy cephfs-shell=19.0.0-1628-g97ae6cc9-1jammy cephfs-top=19.0.0-1628-g97ae6cc9-1jammy cephfs-mirror=19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T09:00:15.535 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2024-04-25T09:00:15.710 INFO:teuthology.orchestra.run.smithi177.stdout:Building dependency tree... 2024-04-25T09:00:15.711 INFO:teuthology.orchestra.run.smithi177.stdout:Reading state information... 2024-04-25T09:00:15.884 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T09:00:15.884 INFO:teuthology.orchestra.run.smithi177.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T09:00:15.884 INFO:teuthology.orchestra.run.smithi177.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T09:00:15.884 INFO:teuthology.orchestra.run.smithi177.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T09:00:15.884 INFO:teuthology.orchestra.run.smithi177.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T09:00:15.884 INFO:teuthology.orchestra.run.smithi177.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T09:00:15.885 INFO:teuthology.orchestra.run.smithi177.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T09:00:15.887 INFO:teuthology.orchestra.run.smithi177.stdout:The following additional packages will be installed: 2024-04-25T09:00:15.887 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T09:00:15.887 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T09:00:15.887 INFO:teuthology.orchestra.run.smithi177.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T09:00:15.887 INFO:teuthology.orchestra.run.smithi177.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T09:00:15.887 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T09:00:15.887 INFO:teuthology.orchestra.run.smithi177.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T09:00:15.887 INFO:teuthology.orchestra.run.smithi177.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T09:00:15.888 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T09:00:15.888 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T09:00:15.888 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T09:00:15.888 INFO:teuthology.orchestra.run.smithi177.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T09:00:15.888 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T09:00:15.888 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T09:00:15.888 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T09:00:15.888 INFO:teuthology.orchestra.run.smithi177.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T09:00:15.888 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T09:00:15.888 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T09:00:15.888 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T09:00:15.889 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T09:00:15.889 INFO:teuthology.orchestra.run.smithi177.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T09:00:15.889 INFO:teuthology.orchestra.run.smithi177.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T09:00:15.889 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T09:00:15.889 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T09:00:15.889 INFO:teuthology.orchestra.run.smithi177.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T09:00:15.889 INFO:teuthology.orchestra.run.smithi177.stdout:Suggested packages: 2024-04-25T09:00:15.889 INFO:teuthology.orchestra.run.smithi177.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T09:00:15.889 INFO:teuthology.orchestra.run.smithi177.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T09:00:15.889 INFO:teuthology.orchestra.run.smithi177.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T09:00:15.889 INFO:teuthology.orchestra.run.smithi177.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T09:00:15.889 INFO:teuthology.orchestra.run.smithi177.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T09:00:15.889 INFO:teuthology.orchestra.run.smithi177.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T09:00:15.890 INFO:teuthology.orchestra.run.smithi177.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T09:00:15.890 INFO:teuthology.orchestra.run.smithi177.stdout:Recommended packages: 2024-04-25T09:00:15.890 INFO:teuthology.orchestra.run.smithi177.stdout: btrfs-tools 2024-04-25T09:00:16.038 INFO:teuthology.orchestra.run.smithi177.stdout:The following NEW packages will be installed: 2024-04-25T09:00:16.038 INFO:teuthology.orchestra.run.smithi177.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T09:00:16.038 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T09:00:16.038 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T09:00:16.039 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T09:00:16.039 INFO:teuthology.orchestra.run.smithi177.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T09:00:16.039 INFO:teuthology.orchestra.run.smithi177.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T09:00:16.039 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T09:00:16.039 INFO:teuthology.orchestra.run.smithi177.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T09:00:16.040 INFO:teuthology.orchestra.run.smithi177.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T09:00:16.040 INFO:teuthology.orchestra.run.smithi177.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T09:00:16.040 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T09:00:16.040 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T09:00:16.040 INFO:teuthology.orchestra.run.smithi177.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T09:00:16.041 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T09:00:16.041 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T09:00:16.041 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T09:00:16.041 INFO:teuthology.orchestra.run.smithi177.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T09:00:16.041 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T09:00:16.041 INFO:teuthology.orchestra.run.smithi177.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T09:00:16.041 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T09:00:16.041 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T09:00:16.041 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T09:00:16.041 INFO:teuthology.orchestra.run.smithi177.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T09:00:16.041 INFO:teuthology.orchestra.run.smithi177.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T09:00:16.041 INFO:teuthology.orchestra.run.smithi177.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T09:00:16.041 INFO:teuthology.orchestra.run.smithi177.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T09:00:16.041 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T09:00:16.041 INFO:teuthology.orchestra.run.smithi177.stdout: socat unzip xmlstarlet zip 2024-04-25T09:00:16.245 INFO:teuthology.orchestra.run.smithi177.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-25T09:00:16.245 INFO:teuthology.orchestra.run.smithi177.stdout:Need to get 176 MB of archives. 2024-04-25T09:00:16.245 INFO:teuthology.orchestra.run.smithi177.stdout:After this operation, 732 MB of additional disk space will be used. 2024-04-25T09:00:16.245 INFO:teuthology.orchestra.run.smithi177.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1628-g97ae6cc9-1jammy [3,533 kB] 2024-04-25T09:00:16.248 INFO:teuthology.orchestra.run.smithi177.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T09:00:16.343 INFO:teuthology.orchestra.run.smithi177.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T09:00:16.396 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T09:00:16.612 INFO:teuthology.orchestra.run.smithi177.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T09:00:16.713 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T09:00:16.729 INFO:teuthology.orchestra.run.smithi177.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T09:00:16.786 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T09:00:16.937 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1628-g97ae6cc9-1jammy [3,217 kB] 2024-04-25T09:00:16.981 INFO:teuthology.orchestra.run.smithi177.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T09:00:16.991 INFO:teuthology.orchestra.run.smithi177.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T09:00:17.023 INFO:teuthology.orchestra.run.smithi177.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T09:00:17.031 INFO:teuthology.orchestra.run.smithi177.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T09:00:17.206 INFO:teuthology.orchestra.run.smithi177.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T09:00:17.238 INFO:teuthology.orchestra.run.smithi177.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1628-g97ae6cc9-1jammy [709 kB] 2024-04-25T09:00:17.278 INFO:teuthology.orchestra.run.smithi177.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1628-g97ae6cc9-1jammy [356 kB] 2024-04-25T09:00:17.308 INFO:teuthology.orchestra.run.smithi177.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1628-g97ae6cc9-1jammy [32.8 kB] 2024-04-25T09:00:17.309 INFO:teuthology.orchestra.run.smithi177.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1628-g97ae6cc9-1jammy [180 kB] 2024-04-25T09:00:17.312 INFO:teuthology.orchestra.run.smithi177.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1628-g97ae6cc9-1jammy [64.8 kB] 2024-04-25T09:00:17.313 INFO:teuthology.orchestra.run.smithi177.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1628-g97ae6cc9-1jammy [330 kB] 2024-04-25T09:00:17.344 INFO:teuthology.orchestra.run.smithi177.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1628-g97ae6cc9-1jammy [6,575 kB] 2024-04-25T09:00:17.396 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T09:00:17.422 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T09:00:17.447 INFO:teuthology.orchestra.run.smithi175.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T09:00:17.685 INFO:teuthology.orchestra.run.smithi177.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1628-g97ae6cc9-1jammy [112 kB] 2024-04-25T09:00:17.686 INFO:teuthology.orchestra.run.smithi177.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1628-g97ae6cc9-1jammy [467 kB] 2024-04-25T09:00:17.700 INFO:teuthology.orchestra.run.smithi177.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1628-g97ae6cc9-1jammy [24.1 MB] 2024-04-25T09:00:17.843 INFO:teuthology.orchestra.run.smithi177.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T09:00:17.858 INFO:teuthology.orchestra.run.smithi177.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T09:00:17.871 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 28.9 kB in 4s (7,118 B/s) 2024-04-25T09:00:17.878 INFO:teuthology.orchestra.run.smithi177.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T09:00:17.886 INFO:teuthology.orchestra.run.smithi177.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T09:00:17.888 INFO:teuthology.orchestra.run.smithi177.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T09:00:17.905 INFO:teuthology.orchestra.run.smithi177.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T09:00:17.947 INFO:teuthology.orchestra.run.smithi177.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T09:00:17.960 INFO:teuthology.orchestra.run.smithi177.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T09:00:17.964 INFO:teuthology.orchestra.run.smithi177.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T09:00:17.966 INFO:teuthology.orchestra.run.smithi177.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T09:00:18.149 INFO:teuthology.orchestra.run.smithi177.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T09:00:18.241 INFO:teuthology.orchestra.run.smithi177.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T09:00:18.258 INFO:teuthology.orchestra.run.smithi177.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T09:00:18.326 INFO:teuthology.orchestra.run.smithi177.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T09:00:18.363 INFO:teuthology.orchestra.run.smithi177.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T09:00:18.387 INFO:teuthology.orchestra.run.smithi177.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T09:00:18.411 INFO:teuthology.orchestra.run.smithi177.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T09:00:18.509 INFO:teuthology.orchestra.run.smithi177.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1628-g97ae6cc9-1jammy [5,076 kB] 2024-04-25T09:00:18.599 INFO:teuthology.orchestra.run.smithi177.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T09:00:18.614 INFO:teuthology.orchestra.run.smithi177.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T09:00:18.621 INFO:teuthology.orchestra.run.smithi177.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T09:00:18.628 INFO:teuthology.orchestra.run.smithi177.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T09:00:18.668 INFO:teuthology.orchestra.run.smithi177.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1628-g97ae6cc9-1jammy [243 kB] 2024-04-25T09:00:18.674 INFO:teuthology.orchestra.run.smithi177.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1628-g97ae6cc9-1jammy [124 kB] 2024-04-25T09:00:18.678 INFO:teuthology.orchestra.run.smithi177.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1628-g97ae6cc9-1jammy [1,520 kB] 2024-04-25T09:00:18.727 INFO:teuthology.orchestra.run.smithi177.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1628-g97ae6cc9-1jammy [6,237 kB] 2024-04-25T09:00:18.819 INFO:teuthology.orchestra.run.smithi177.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T09:00:18.850 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-25T09:00:18.865 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1628-g97ae6cc9-1jammy cephadm=19.0.0-1628-g97ae6cc9-1jammy ceph-mds=19.0.0-1628-g97ae6cc9-1jammy ceph-mgr=19.0.0-1628-g97ae6cc9-1jammy ceph-common=19.0.0-1628-g97ae6cc9-1jammy ceph-fuse=19.0.0-1628-g97ae6cc9-1jammy ceph-test=19.0.0-1628-g97ae6cc9-1jammy ceph-volume=19.0.0-1628-g97ae6cc9-1jammy radosgw=19.0.0-1628-g97ae6cc9-1jammy python3-rados=19.0.0-1628-g97ae6cc9-1jammy python3-rgw=19.0.0-1628-g97ae6cc9-1jammy python3-cephfs=19.0.0-1628-g97ae6cc9-1jammy python3-rbd=19.0.0-1628-g97ae6cc9-1jammy libcephfs2=19.0.0-1628-g97ae6cc9-1jammy libcephfs-dev=19.0.0-1628-g97ae6cc9-1jammy librados2=19.0.0-1628-g97ae6cc9-1jammy librbd1=19.0.0-1628-g97ae6cc9-1jammy rbd-fuse=19.0.0-1628-g97ae6cc9-1jammy python3-cephfs=19.0.0-1628-g97ae6cc9-1jammy cephfs-shell=19.0.0-1628-g97ae6cc9-1jammy cephfs-top=19.0.0-1628-g97ae6cc9-1jammy cephfs-mirror=19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T09:00:18.920 INFO:teuthology.orchestra.run.smithi177.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T09:00:18.934 INFO:teuthology.orchestra.run.smithi177.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T09:00:18.940 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-25T09:00:19.013 INFO:teuthology.orchestra.run.smithi177.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1628-g97ae6cc9-1jammy [22.7 MB] 2024-04-25T09:00:19.116 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2024-04-25T09:00:19.116 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2024-04-25T09:00:19.126 INFO:teuthology.orchestra.run.smithi177.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T09:00:19.178 INFO:teuthology.orchestra.run.smithi177.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T09:00:19.192 INFO:teuthology.orchestra.run.smithi177.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T09:00:19.289 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T09:00:19.289 INFO:teuthology.orchestra.run.smithi175.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T09:00:19.289 INFO:teuthology.orchestra.run.smithi175.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T09:00:19.289 INFO:teuthology.orchestra.run.smithi175.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T09:00:19.290 INFO:teuthology.orchestra.run.smithi175.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T09:00:19.290 INFO:teuthology.orchestra.run.smithi175.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T09:00:19.290 INFO:teuthology.orchestra.run.smithi175.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T09:00:19.292 INFO:teuthology.orchestra.run.smithi175.stdout:The following additional packages will be installed: 2024-04-25T09:00:19.292 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T09:00:19.292 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T09:00:19.292 INFO:teuthology.orchestra.run.smithi175.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T09:00:19.292 INFO:teuthology.orchestra.run.smithi175.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T09:00:19.292 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T09:00:19.292 INFO:teuthology.orchestra.run.smithi175.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T09:00:19.292 INFO:teuthology.orchestra.run.smithi175.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T09:00:19.292 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T09:00:19.292 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T09:00:19.292 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T09:00:19.293 INFO:teuthology.orchestra.run.smithi175.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T09:00:19.293 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T09:00:19.293 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T09:00:19.293 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T09:00:19.293 INFO:teuthology.orchestra.run.smithi175.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T09:00:19.293 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T09:00:19.293 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T09:00:19.293 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T09:00:19.293 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T09:00:19.293 INFO:teuthology.orchestra.run.smithi175.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T09:00:19.293 INFO:teuthology.orchestra.run.smithi175.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T09:00:19.293 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T09:00:19.293 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T09:00:19.293 INFO:teuthology.orchestra.run.smithi175.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T09:00:19.294 INFO:teuthology.orchestra.run.smithi175.stdout:Suggested packages: 2024-04-25T09:00:19.294 INFO:teuthology.orchestra.run.smithi175.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T09:00:19.294 INFO:teuthology.orchestra.run.smithi175.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T09:00:19.294 INFO:teuthology.orchestra.run.smithi175.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T09:00:19.294 INFO:teuthology.orchestra.run.smithi175.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T09:00:19.294 INFO:teuthology.orchestra.run.smithi175.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T09:00:19.294 INFO:teuthology.orchestra.run.smithi175.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T09:00:19.295 INFO:teuthology.orchestra.run.smithi175.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T09:00:19.295 INFO:teuthology.orchestra.run.smithi175.stdout:Recommended packages: 2024-04-25T09:00:19.295 INFO:teuthology.orchestra.run.smithi175.stdout: btrfs-tools 2024-04-25T09:00:19.376 INFO:teuthology.orchestra.run.smithi177.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T09:00:19.377 INFO:teuthology.orchestra.run.smithi177.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T09:00:19.382 INFO:teuthology.orchestra.run.smithi177.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T09:00:19.388 INFO:teuthology.orchestra.run.smithi177.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T09:00:19.405 INFO:teuthology.orchestra.run.smithi177.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T09:00:19.444 INFO:teuthology.orchestra.run.smithi175.stdout:The following NEW packages will be installed: 2024-04-25T09:00:19.444 INFO:teuthology.orchestra.run.smithi175.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T09:00:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T09:00:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T09:00:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T09:00:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T09:00:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T09:00:19.445 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T09:00:19.446 INFO:teuthology.orchestra.run.smithi175.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T09:00:19.446 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T09:00:19.446 INFO:teuthology.orchestra.run.smithi175.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T09:00:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T09:00:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T09:00:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T09:00:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T09:00:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T09:00:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T09:00:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T09:00:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T09:00:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T09:00:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T09:00:19.447 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T09:00:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T09:00:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T09:00:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T09:00:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T09:00:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T09:00:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T09:00:19.448 INFO:teuthology.orchestra.run.smithi175.stdout: socat unzip xmlstarlet zip 2024-04-25T09:00:19.605 INFO:teuthology.orchestra.run.smithi177.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T09:00:19.699 INFO:teuthology.orchestra.run.smithi177.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1628-g97ae6cc9-1jammy [14.0 kB] 2024-04-25T09:00:19.700 INFO:teuthology.orchestra.run.smithi177.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1628-g97ae6cc9-1jammy [866 kB] 2024-04-25T09:00:19.720 INFO:teuthology.orchestra.run.smithi177.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1628-g97ae6cc9-1jammy [2,191 kB] 2024-04-25T09:00:19.792 INFO:teuthology.orchestra.run.smithi177.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1628-g97ae6cc9-1jammy [776 kB] 2024-04-25T09:00:19.808 INFO:teuthology.orchestra.run.smithi175.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-25T09:00:19.809 INFO:teuthology.orchestra.run.smithi175.stdout:Need to get 176 MB of archives. 2024-04-25T09:00:19.809 INFO:teuthology.orchestra.run.smithi175.stdout:After this operation, 732 MB of additional disk space will be used. 2024-04-25T09:00:19.809 INFO:teuthology.orchestra.run.smithi175.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1628-g97ae6cc9-1jammy [3,533 kB] 2024-04-25T09:00:19.819 INFO:teuthology.orchestra.run.smithi177.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1628-g97ae6cc9-1jammy [144 kB] 2024-04-25T09:00:19.824 INFO:teuthology.orchestra.run.smithi177.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1628-g97ae6cc9-1jammy [1,921 kB] 2024-04-25T09:00:19.875 INFO:teuthology.orchestra.run.smithi177.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T09:00:19.898 INFO:teuthology.orchestra.run.smithi177.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1628-g97ae6cc9-1jammy [8,625 kB] 2024-04-25T09:00:20.015 INFO:teuthology.orchestra.run.smithi177.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T09:00:20.058 INFO:teuthology.orchestra.run.smithi177.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T09:00:20.151 INFO:teuthology.orchestra.run.smithi177.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T09:00:20.162 INFO:teuthology.orchestra.run.smithi177.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T09:00:20.176 INFO:teuthology.orchestra.run.smithi177.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T09:00:20.221 INFO:teuthology.orchestra.run.smithi177.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T09:00:20.254 INFO:teuthology.orchestra.run.smithi177.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1628-g97ae6cc9-1jammy [14.2 kB] 2024-04-25T09:00:20.254 INFO:teuthology.orchestra.run.smithi177.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1628-g97ae6cc9-1jammy [49.9 MB] 2024-04-25T09:00:20.514 INFO:teuthology.orchestra.run.smithi177.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T09:00:20.515 INFO:teuthology.orchestra.run.smithi177.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T09:00:20.517 INFO:teuthology.orchestra.run.smithi177.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T09:00:20.577 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1628-g97ae6cc9-1jammy [3,217 kB] 2024-04-25T09:00:20.697 INFO:teuthology.orchestra.run.smithi177.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T09:00:20.884 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1628-g97ae6cc9-1jammy [709 kB] 2024-04-25T09:00:20.912 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1628-g97ae6cc9-1jammy [356 kB] 2024-04-25T09:00:20.970 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1628-g97ae6cc9-1jammy [32.8 kB] 2024-04-25T09:00:20.971 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1628-g97ae6cc9-1jammy [180 kB] 2024-04-25T09:00:20.978 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1628-g97ae6cc9-1jammy [64.8 kB] 2024-04-25T09:00:20.981 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1628-g97ae6cc9-1jammy [330 kB] 2024-04-25T09:00:20.992 INFO:teuthology.orchestra.run.smithi175.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1628-g97ae6cc9-1jammy [6,575 kB] 2024-04-25T09:00:21.073 INFO:teuthology.orchestra.run.smithi177.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T09:00:21.525 INFO:teuthology.orchestra.run.smithi177.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T09:00:21.536 INFO:teuthology.orchestra.run.smithi177.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T09:00:21.537 INFO:teuthology.orchestra.run.smithi177.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T09:00:21.543 INFO:teuthology.orchestra.run.smithi175.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1628-g97ae6cc9-1jammy [112 kB] 2024-04-25T09:00:21.565 INFO:teuthology.orchestra.run.smithi175.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1628-g97ae6cc9-1jammy [467 kB] 2024-04-25T09:00:21.616 INFO:teuthology.orchestra.run.smithi177.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T09:00:21.616 INFO:teuthology.orchestra.run.smithi177.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T09:00:21.617 INFO:teuthology.orchestra.run.smithi175.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1628-g97ae6cc9-1jammy [24.1 MB] 2024-04-25T09:00:21.617 INFO:teuthology.orchestra.run.smithi177.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T09:00:21.618 INFO:teuthology.orchestra.run.smithi177.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T09:00:21.619 INFO:teuthology.orchestra.run.smithi177.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T09:00:21.620 INFO:teuthology.orchestra.run.smithi177.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T09:00:21.796 INFO:teuthology.orchestra.run.smithi177.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T09:00:22.023 INFO:teuthology.orchestra.run.smithi177.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T09:00:22.381 INFO:teuthology.orchestra.run.smithi177.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T09:00:22.432 INFO:teuthology.orchestra.run.smithi177.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T09:00:22.461 INFO:teuthology.orchestra.run.smithi177.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T09:00:22.470 INFO:teuthology.orchestra.run.smithi177.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T09:00:22.522 INFO:teuthology.orchestra.run.smithi177.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T09:00:22.552 INFO:teuthology.orchestra.run.smithi177.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T09:00:22.555 INFO:teuthology.orchestra.run.smithi177.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T09:00:22.561 INFO:teuthology.orchestra.run.smithi177.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T09:00:22.566 INFO:teuthology.orchestra.run.smithi177.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T09:00:22.694 INFO:teuthology.orchestra.run.smithi175.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T09:00:22.745 INFO:teuthology.orchestra.run.smithi175.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T09:00:22.768 INFO:teuthology.orchestra.run.smithi175.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T09:00:22.779 INFO:teuthology.orchestra.run.smithi177.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T09:00:22.942 INFO:teuthology.orchestra.run.smithi175.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T09:00:23.027 INFO:teuthology.orchestra.run.smithi175.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1628-g97ae6cc9-1jammy [5,076 kB] 2024-04-25T09:00:23.059 INFO:teuthology.orchestra.run.smithi175.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T09:00:23.061 INFO:teuthology.orchestra.run.smithi177.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T09:00:23.069 INFO:teuthology.orchestra.run.smithi175.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T09:00:23.135 INFO:teuthology.orchestra.run.smithi175.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T09:00:23.349 INFO:teuthology.orchestra.run.smithi175.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1628-g97ae6cc9-1jammy [243 kB] 2024-04-25T09:00:23.360 INFO:teuthology.orchestra.run.smithi175.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1628-g97ae6cc9-1jammy [124 kB] 2024-04-25T09:00:23.368 INFO:teuthology.orchestra.run.smithi175.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1628-g97ae6cc9-1jammy [1,520 kB] 2024-04-25T09:00:23.371 INFO:teuthology.orchestra.run.smithi177.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T09:00:23.374 INFO:teuthology.orchestra.run.smithi177.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T09:00:23.383 INFO:teuthology.orchestra.run.smithi175.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T09:00:23.391 INFO:teuthology.orchestra.run.smithi175.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T09:00:23.397 INFO:teuthology.orchestra.run.smithi177.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T09:00:23.404 INFO:teuthology.orchestra.run.smithi177.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T09:00:23.440 INFO:teuthology.orchestra.run.smithi175.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T09:00:23.450 INFO:teuthology.orchestra.run.smithi175.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T09:00:23.451 INFO:teuthology.orchestra.run.smithi175.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T09:00:23.457 INFO:teuthology.orchestra.run.smithi177.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T09:00:23.472 INFO:teuthology.orchestra.run.smithi175.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T09:00:23.483 INFO:teuthology.orchestra.run.smithi175.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T09:00:23.484 INFO:teuthology.orchestra.run.smithi177.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T09:00:23.490 INFO:teuthology.orchestra.run.smithi175.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T09:00:23.494 INFO:teuthology.orchestra.run.smithi175.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T09:00:23.494 INFO:teuthology.orchestra.run.smithi175.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T09:00:23.508 INFO:teuthology.orchestra.run.smithi175.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1628-g97ae6cc9-1jammy [6,237 kB] 2024-04-25T09:00:23.510 INFO:teuthology.orchestra.run.smithi175.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T09:00:23.515 INFO:teuthology.orchestra.run.smithi175.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T09:00:23.597 INFO:teuthology.orchestra.run.smithi177.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T09:00:23.600 INFO:teuthology.orchestra.run.smithi177.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T09:00:23.601 INFO:teuthology.orchestra.run.smithi177.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T09:00:23.607 INFO:teuthology.orchestra.run.smithi175.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T09:00:23.607 INFO:teuthology.orchestra.run.smithi175.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T09:00:23.608 INFO:teuthology.orchestra.run.smithi175.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T09:00:23.609 INFO:teuthology.orchestra.run.smithi175.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T09:00:23.609 INFO:teuthology.orchestra.run.smithi175.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T09:00:23.610 INFO:teuthology.orchestra.run.smithi175.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T09:00:23.610 INFO:teuthology.orchestra.run.smithi175.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T09:00:23.611 INFO:teuthology.orchestra.run.smithi175.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T09:00:23.612 INFO:teuthology.orchestra.run.smithi175.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T09:00:23.654 INFO:teuthology.orchestra.run.smithi175.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T09:00:23.659 INFO:teuthology.orchestra.run.smithi175.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T09:00:23.660 INFO:teuthology.orchestra.run.smithi175.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T09:00:23.660 INFO:teuthology.orchestra.run.smithi175.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T09:00:23.661 INFO:teuthology.orchestra.run.smithi175.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T09:00:23.662 INFO:teuthology.orchestra.run.smithi175.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T09:00:23.662 INFO:teuthology.orchestra.run.smithi175.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T09:00:23.663 INFO:teuthology.orchestra.run.smithi175.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T09:00:23.664 INFO:teuthology.orchestra.run.smithi175.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T09:00:23.706 INFO:teuthology.orchestra.run.smithi175.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T09:00:23.710 INFO:teuthology.orchestra.run.smithi175.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T09:00:23.719 INFO:teuthology.orchestra.run.smithi175.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T09:00:23.720 INFO:teuthology.orchestra.run.smithi175.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T09:00:23.721 INFO:teuthology.orchestra.run.smithi175.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T09:00:23.721 INFO:teuthology.orchestra.run.smithi175.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T09:00:23.724 INFO:teuthology.orchestra.run.smithi175.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T09:00:23.727 INFO:teuthology.orchestra.run.smithi175.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T09:00:23.728 INFO:teuthology.orchestra.run.smithi175.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T09:00:23.753 INFO:teuthology.orchestra.run.smithi175.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T09:00:23.767 INFO:teuthology.orchestra.run.smithi175.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T09:00:23.769 INFO:teuthology.orchestra.run.smithi175.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T09:00:23.770 INFO:teuthology.orchestra.run.smithi175.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T09:00:23.771 INFO:teuthology.orchestra.run.smithi175.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T09:00:23.774 INFO:teuthology.orchestra.run.smithi175.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T09:00:23.805 INFO:teuthology.orchestra.run.smithi177.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T09:00:23.850 INFO:teuthology.orchestra.run.smithi177.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1628-g97ae6cc9-1jammy [121 kB] 2024-04-25T09:00:23.864 INFO:teuthology.orchestra.run.smithi177.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-1628-g97ae6cc9-1jammy [228 kB] 2024-04-25T09:00:23.866 INFO:teuthology.orchestra.run.smithi175.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T09:00:23.867 INFO:teuthology.orchestra.run.smithi175.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T09:00:23.876 INFO:teuthology.orchestra.run.smithi175.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T09:00:23.876 INFO:teuthology.orchestra.run.smithi175.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T09:00:23.877 INFO:teuthology.orchestra.run.smithi175.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T09:00:23.904 INFO:teuthology.orchestra.run.smithi175.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T09:00:23.906 INFO:teuthology.orchestra.run.smithi175.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T09:00:23.907 INFO:teuthology.orchestra.run.smithi175.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T09:00:23.912 INFO:teuthology.orchestra.run.smithi177.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-1628-g97ae6cc9-1jammy [34.0 kB] 2024-04-25T09:00:23.912 INFO:teuthology.orchestra.run.smithi177.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-1628-g97ae6cc9-1jammy [23.4 kB] 2024-04-25T09:00:23.913 INFO:teuthology.orchestra.run.smithi177.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1628-g97ae6cc9-1jammy [38.4 kB] 2024-04-25T09:00:23.917 INFO:teuthology.orchestra.run.smithi177.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1628-g97ae6cc9-1jammy [13.0 MB] 2024-04-25T09:00:23.941 INFO:teuthology.orchestra.run.smithi175.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T09:00:23.941 INFO:teuthology.orchestra.run.smithi175.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T09:00:23.958 INFO:teuthology.orchestra.run.smithi175.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T09:00:23.959 INFO:teuthology.orchestra.run.smithi175.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T09:00:23.959 INFO:teuthology.orchestra.run.smithi175.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T09:00:23.960 INFO:teuthology.orchestra.run.smithi175.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T09:00:23.961 INFO:teuthology.orchestra.run.smithi175.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T09:00:23.962 INFO:teuthology.orchestra.run.smithi175.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T09:00:23.966 INFO:teuthology.orchestra.run.smithi175.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T09:00:23.991 INFO:teuthology.orchestra.run.smithi175.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T09:00:23.993 INFO:teuthology.orchestra.run.smithi175.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T09:00:23.994 INFO:teuthology.orchestra.run.smithi175.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T09:00:24.024 INFO:teuthology.orchestra.run.smithi175.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T09:00:24.028 INFO:teuthology.orchestra.run.smithi175.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T09:00:24.029 INFO:teuthology.orchestra.run.smithi175.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T09:00:24.030 INFO:teuthology.orchestra.run.smithi175.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T09:00:24.031 INFO:teuthology.orchestra.run.smithi175.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T09:00:24.035 INFO:teuthology.orchestra.run.smithi175.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T09:00:24.036 INFO:teuthology.orchestra.run.smithi175.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T09:00:24.063 INFO:teuthology.orchestra.run.smithi175.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1628-g97ae6cc9-1jammy [22.7 MB] 2024-04-25T09:00:24.065 INFO:teuthology.orchestra.run.smithi175.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T09:00:24.066 INFO:teuthology.orchestra.run.smithi175.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T09:00:24.067 INFO:teuthology.orchestra.run.smithi175.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T09:00:24.098 INFO:teuthology.orchestra.run.smithi175.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T09:00:24.101 INFO:teuthology.orchestra.run.smithi175.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T09:00:24.102 INFO:teuthology.orchestra.run.smithi175.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T09:00:24.107 INFO:teuthology.orchestra.run.smithi177.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T09:00:24.115 INFO:teuthology.orchestra.run.smithi175.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T09:00:24.116 INFO:teuthology.orchestra.run.smithi175.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T09:00:24.116 INFO:teuthology.orchestra.run.smithi175.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T09:00:24.118 INFO:teuthology.orchestra.run.smithi175.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T09:00:24.147 INFO:teuthology.orchestra.run.smithi175.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T09:00:26.334 INFO:teuthology.orchestra.run.smithi177.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1628-g97ae6cc9-1jammy [91.5 kB] 2024-04-25T09:00:26.974 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 176 MB in 10s (17.2 MB/s) 2024-04-25T09:00:27.097 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T09:00:27.162 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-25T09:00:27.165 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T09:00:27.204 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T09:00:27.276 INFO:teuthology.orchestra.run.smithi175.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1628-g97ae6cc9-1jammy [14.0 kB] 2024-04-25T09:00:27.276 INFO:teuthology.orchestra.run.smithi175.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1628-g97ae6cc9-1jammy [866 kB] 2024-04-25T09:00:27.440 INFO:teuthology.orchestra.run.smithi175.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1628-g97ae6cc9-1jammy [2,191 kB] 2024-04-25T09:00:27.489 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T09:00:27.503 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T09:00:27.548 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T09:00:27.892 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T09:00:27.905 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T09:00:27.950 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T09:00:28.070 INFO:teuthology.orchestra.run.smithi175.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1628-g97ae6cc9-1jammy [776 kB] 2024-04-25T09:00:28.303 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T09:00:28.317 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T09:00:28.381 INFO:teuthology.orchestra.run.smithi175.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1628-g97ae6cc9-1jammy [144 kB] 2024-04-25T09:00:28.428 INFO:teuthology.orchestra.run.smithi175.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1628-g97ae6cc9-1jammy [1,921 kB] 2024-04-25T09:00:28.428 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T09:00:28.765 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T09:00:28.778 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T09:00:28.832 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T09:00:28.922 INFO:teuthology.orchestra.run.smithi175.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1628-g97ae6cc9-1jammy [8,625 kB] 2024-04-25T09:00:29.151 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T09:00:29.165 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T09:00:29.201 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T09:00:29.654 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T09:00:29.669 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T09:00:29.720 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T09:00:30.341 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T09:00:30.356 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T09:00:30.400 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T09:00:30.547 INFO:teuthology.orchestra.run.smithi175.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1628-g97ae6cc9-1jammy [14.2 kB] 2024-04-25T09:00:30.547 INFO:teuthology.orchestra.run.smithi175.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1628-g97ae6cc9-1jammy [49.9 MB] 2024-04-25T09:00:30.727 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T09:00:30.742 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T09:00:30.777 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T09:00:31.155 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T09:00:31.170 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T09:00:31.214 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T09:00:31.541 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librados2. 2024-04-25T09:00:31.556 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../010-librados2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:31.600 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librados2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:32.052 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librbd1. 2024-04-25T09:00:32.066 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../011-librbd1_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:32.110 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librbd1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:32.555 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T09:00:32.568 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:32.613 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libcephfs2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:32.890 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rados. 2024-04-25T09:00:32.904 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../013-python3-rados_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:32.949 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rados (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:33.251 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T09:00:33.266 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:00:33.310 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-ceph-argparse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:33.587 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T09:00:33.602 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:33.645 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cephfs (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:33.948 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T09:00:33.962 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:00:33.998 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:34.251 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T09:00:34.265 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T09:00:34.301 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T09:00:34.553 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T09:00:34.718 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:34.718 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rbd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:34.934 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T09:00:34.945 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T09:00:35.022 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T09:00:35.308 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T09:00:35.323 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T09:00:35.366 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T09:00:35.678 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T09:00:35.692 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T09:00:35.736 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T09:00:36.022 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package lua5.1. 2024-04-25T09:00:36.037 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T09:00:36.090 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T09:00:36.400 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package lua-any. 2024-04-25T09:00:36.415 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T09:00:36.458 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T09:00:36.753 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package zip. 2024-04-25T09:00:36.767 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T09:00:36.811 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T09:00:37.097 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package unzip. 2024-04-25T09:00:37.112 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T09:00:37.147 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T09:00:37.535 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package luarocks. 2024-04-25T09:00:37.549 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T09:00:37.592 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T09:00:37.797 INFO:teuthology.orchestra.run.smithi175.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1628-g97ae6cc9-1jammy [121 kB] 2024-04-25T09:00:37.804 INFO:teuthology.orchestra.run.smithi175.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-1628-g97ae6cc9-1jammy [228 kB] 2024-04-25T09:00:37.832 INFO:teuthology.orchestra.run.smithi175.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-1628-g97ae6cc9-1jammy [34.0 kB] 2024-04-25T09:00:37.832 INFO:teuthology.orchestra.run.smithi175.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-1628-g97ae6cc9-1jammy [23.4 kB] 2024-04-25T09:00:37.833 INFO:teuthology.orchestra.run.smithi175.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1628-g97ae6cc9-1jammy [38.4 kB] 2024-04-25T09:00:37.835 INFO:teuthology.orchestra.run.smithi175.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1628-g97ae6cc9-1jammy [13.0 MB] 2024-04-25T09:00:38.017 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librgw2. 2024-04-25T09:00:38.030 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../027-librgw2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:38.075 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librgw2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:38.577 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T09:00:38.592 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:38.635 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:38.938 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T09:00:38.953 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T09:00:38.988 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T09:00:39.266 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T09:00:39.280 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:39.290 INFO:teuthology.orchestra.run.smithi175.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1628-g97ae6cc9-1jammy [91.5 kB] 2024-04-25T09:00:39.332 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libradosstriper1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:39.777 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-common. 2024-04-25T09:00:39.792 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../031-ceph-common_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:39.835 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:39.936 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 176 MB in 20s (8,891 kB/s) 2024-04-25T09:00:40.078 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T09:00:40.145 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-25T09:00:40.148 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T09:00:40.193 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T09:00:40.496 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T09:00:40.509 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T09:00:40.546 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T09:00:40.848 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T09:00:40.862 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T09:00:40.907 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T09:00:41.124 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-base. 2024-04-25T09:00:41.139 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../032-ceph-base_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:41.183 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-base (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:41.368 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T09:00:41.382 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T09:00:41.460 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T09:00:41.755 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T09:00:41.769 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T09:00:41.786 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T09:00:41.800 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T09:00:41.805 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T09:00:41.836 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T09:00:42.141 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T09:00:42.147 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T09:00:42.156 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T09:00:42.161 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T09:00:42.199 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T09:00:42.205 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T09:00:42.542 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T09:00:42.557 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T09:00:42.600 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T09:00:42.661 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T09:00:42.675 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T09:00:42.727 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T09:00:42.911 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T09:00:42.926 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T09:00:42.969 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T09:00:43.114 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T09:00:43.128 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T09:00:43.172 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T09:00:43.255 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T09:00:43.270 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T09:00:43.305 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T09:00:43.517 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T09:00:43.532 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T09:00:43.575 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T09:00:43.575 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T09:00:43.590 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T09:00:43.633 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T09:00:43.903 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T09:00:43.918 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T09:00:43.961 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T09:00:43.986 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-portend. 2024-04-25T09:00:44.001 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T09:00:44.044 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T09:00:44.297 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librados2. 2024-04-25T09:00:44.312 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../010-librados2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:44.355 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librados2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:44.372 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T09:00:44.387 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T09:00:44.430 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T09:00:44.667 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T09:00:44.681 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T09:00:44.716 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T09:00:44.808 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librbd1. 2024-04-25T09:00:44.824 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../011-librbd1_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:44.866 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librbd1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:45.095 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T09:00:45.109 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T09:00:45.153 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T09:00:45.261 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T09:00:45.275 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:45.310 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libcephfs2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:45.473 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T09:00:45.487 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T09:00:45.522 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T09:00:45.563 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rados. 2024-04-25T09:00:45.577 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../013-python3-rados_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:45.621 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rados (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:45.794 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T09:00:45.809 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T09:00:45.852 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T09:00:45.957 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T09:00:45.972 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:00:46.024 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-ceph-argparse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:46.197 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-mako. 2024-04-25T09:00:46.211 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T09:00:46.255 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T09:00:46.276 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T09:00:46.291 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:46.443 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cephfs (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:46.608 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T09:00:46.623 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T09:00:46.666 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T09:00:46.779 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T09:00:46.794 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:00:46.829 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:46.977 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T09:00:46.992 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T09:00:47.061 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T09:00:47.140 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T09:00:47.154 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T09:00:47.190 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T09:00:47.363 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-webob. 2024-04-25T09:00:47.378 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T09:00:47.421 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T09:00:47.451 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T09:00:47.465 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:47.509 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rbd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:47.757 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T09:00:47.772 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T09:00:47.810 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T09:00:47.870 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T09:00:47.885 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T09:00:47.928 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T09:00:48.144 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T09:00:48.159 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T09:00:48.202 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T09:00:48.206 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T09:00:48.221 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T09:00:48.266 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T09:00:48.505 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-paste. 2024-04-25T09:00:48.520 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T09:00:48.563 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T09:00:48.575 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T09:00:48.590 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T09:00:48.633 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T09:00:48.900 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T09:00:48.914 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T09:00:48.954 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package lua5.1. 2024-04-25T09:00:48.957 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T09:00:48.968 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T09:00:49.003 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T09:00:49.306 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package lua-any. 2024-04-25T09:00:49.321 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T09:00:49.364 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T09:00:49.619 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package zip. 2024-04-25T09:00:49.634 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T09:00:49.677 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T09:00:49.969 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T09:00:49.986 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T09:00:49.997 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package unzip. 2024-04-25T09:00:50.012 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T09:00:50.047 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T09:00:50.061 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T09:00:50.381 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T09:00:50.395 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T09:00:50.417 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package luarocks. 2024-04-25T09:00:50.432 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T09:00:50.439 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T09:00:50.475 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T09:00:50.775 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T09:00:50.785 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T09:00:50.824 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T09:00:50.899 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package librgw2. 2024-04-25T09:00:50.913 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../027-librgw2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:50.958 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking librgw2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:51.388 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T09:00:51.401 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T09:00:51.446 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T09:00:51.510 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T09:00:51.525 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:51.619 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:51.757 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-idna. 2024-04-25T09:00:51.767 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T09:00:51.798 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T09:00:51.913 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T09:00:51.927 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T09:00:51.971 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T09:00:52.084 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T09:00:52.095 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T09:00:52.143 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T09:00:52.282 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T09:00:52.297 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:52.340 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libradosstriper1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:52.488 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-requests. 2024-04-25T09:00:52.499 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T09:00:52.537 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T09:00:52.769 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-common. 2024-04-25T09:00:52.784 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../031-ceph-common_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:52.827 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:52.874 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T09:00:52.885 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T09:00:52.923 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T09:00:53.218 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T09:00:53.228 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:00:53.276 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:53.681 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T09:00:53.691 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:53.731 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:54.009 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T09:00:54.019 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T09:00:54.058 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T09:00:54.387 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T09:00:54.399 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T09:00:54.445 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T09:00:54.532 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-base. 2024-04-25T09:00:54.546 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../032-ceph-base_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:54.599 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-base (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:54.781 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T09:00:54.792 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:54.831 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:55.161 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T09:00:55.174 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T09:00:55.209 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T09:00:55.219 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T09:00:55.220 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:55.258 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mon (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:55.522 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T09:00:55.536 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T09:00:55.580 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T09:00:55.820 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T09:00:55.831 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:55.870 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-osd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:55.883 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T09:00:55.898 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T09:00:55.941 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T09:00:56.302 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T09:00:56.317 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T09:00:56.360 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T09:00:56.647 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T09:00:56.662 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T09:00:56.673 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph. 2024-04-25T09:00:56.687 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../068-ceph_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:56.705 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T09:00:56.731 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:56.957 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T09:00:56.972 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T09:00:57.032 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T09:00:57.050 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T09:00:57.063 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:57.117 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:57.344 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-portend. 2024-04-25T09:00:57.358 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T09:00:57.402 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T09:00:57.445 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T09:00:57.457 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:57.486 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mds (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:57.704 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T09:00:57.719 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T09:00:57.762 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T09:00:57.856 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package cephadm. 2024-04-25T09:00:57.868 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../071-cephadm_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:00:57.906 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:00:58.074 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T09:00:58.088 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T09:00:58.125 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T09:00:58.242 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T09:00:58.254 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T09:00:58.292 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T09:00:58.452 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T09:00:58.467 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T09:00:58.510 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T09:00:58.603 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T09:00:58.615 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T09:00:58.652 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T09:00:58.821 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T09:00:58.836 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T09:00:58.880 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T09:00:59.191 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T09:00:59.206 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T09:00:59.249 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T09:00:59.494 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-mako. 2024-04-25T09:00:59.508 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T09:00:59.543 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T09:00:59.682 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-babel. 2024-04-25T09:00:59.693 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T09:00:59.734 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T09:00:59.847 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T09:00:59.861 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T09:00:59.896 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T09:01:00.085 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T09:01:00.096 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T09:01:00.143 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T09:01:00.224 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T09:01:00.238 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T09:01:00.282 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T09:01:00.513 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T09:01:00.524 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:01:00.562 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:00.577 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-webob. 2024-04-25T09:01:00.591 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T09:01:00.635 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T09:01:00.899 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T09:01:00.907 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T09:01:00.974 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T09:01:00.979 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T09:01:00.994 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T09:01:01.040 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T09:01:01.276 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-routes. 2024-04-25T09:01:01.285 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T09:01:01.327 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T09:01:01.332 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T09:01:01.347 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T09:01:01.382 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T09:01:01.879 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-paste. 2024-04-25T09:01:01.888 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T09:01:01.894 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T09:01:01.897 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:01:01.935 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T09:01:01.938 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:02.271 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T09:01:02.286 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T09:01:02.330 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T09:01:02.349 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T09:01:02.358 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T09:01:02.399 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T09:01:02.607 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T09:01:02.622 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T09:01:02.657 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T09:01:02.894 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T09:01:02.906 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T09:01:02.918 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T09:01:02.933 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T09:01:02.944 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T09:01:02.976 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T09:01:03.321 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T09:01:03.322 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T09:01:03.332 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T09:01:03.336 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T09:01:03.379 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T09:01:03.458 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T09:01:03.711 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T09:01:03.727 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T09:01:03.750 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T09:01:03.765 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T09:01:03.794 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T09:01:03.808 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T09:01:04.128 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-idna. 2024-04-25T09:01:04.143 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T09:01:04.211 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T09:01:04.454 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T09:01:04.464 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:01:04.489 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T09:01:04.502 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:04.504 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T09:01:04.539 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T09:01:04.825 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-requests. 2024-04-25T09:01:04.840 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T09:01:04.875 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T09:01:05.145 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T09:01:05.160 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T09:01:05.211 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T09:01:05.439 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T09:01:05.451 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T09:01:05.623 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T09:01:05.623 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T09:01:05.623 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:01:05.623 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:05.783 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T09:01:05.796 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T09:01:05.833 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T09:01:05.886 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T09:01:05.900 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:01:05.943 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:06.187 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T09:01:06.199 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T09:01:06.236 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T09:01:06.288 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T09:01:06.301 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T09:01:06.338 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T09:01:06.547 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T09:01:06.559 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T09:01:06.616 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T09:01:06.628 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T09:01:06.631 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T09:01:06.657 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T09:01:06.951 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T09:01:06.963 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T09:01:06.968 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T09:01:06.984 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:01:07.001 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T09:01:07.027 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:07.421 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T09:01:07.433 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T09:01:07.470 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T09:01:07.580 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T09:01:07.593 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:01:07.638 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mon (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:07.723 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T09:01:07.736 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T09:01:07.773 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T09:01:08.085 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T09:01:08.098 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T09:01:08.142 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T09:01:08.208 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T09:01:08.220 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:01:08.258 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-osd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:08.798 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T09:01:08.810 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:01:08.873 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:09.003 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph. 2024-04-25T09:01:09.016 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../068-ceph_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:01:09.061 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:09.192 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T09:01:09.204 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T09:01:09.242 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T09:01:09.480 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T09:01:09.493 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:01:09.546 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:09.562 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T09:01:09.573 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T09:01:09.603 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T09:01:09.856 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package jq. 2024-04-25T09:01:09.867 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T09:01:09.906 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T09:01:10.000 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T09:01:10.013 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:01:10.066 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mds (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:10.200 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package socat. 2024-04-25T09:01:10.212 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T09:01:10.250 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T09:01:10.477 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package cephadm. 2024-04-25T09:01:10.491 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../071-cephadm_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:01:10.535 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:10.561 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T09:01:10.573 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T09:01:10.611 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T09:01:10.788 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T09:01:10.801 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T09:01:10.846 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T09:01:10.965 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-test. 2024-04-25T09:01:10.977 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../099-ceph-test_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:01:11.038 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-test (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:11.165 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T09:01:11.180 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T09:01:11.224 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T09:01:12.162 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-babel. 2024-04-25T09:01:12.174 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T09:01:12.228 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T09:01:12.598 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T09:01:12.610 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T09:01:12.648 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T09:01:12.953 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T09:01:12.965 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:01:12.984 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T09:01:12.996 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:01:13.002 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-volume (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:13.034 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:13.362 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T09:01:13.374 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T09:01:13.415 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T09:01:13.428 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:01:13.445 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T09:01:13.473 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking cephfs-mirror (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:13.748 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-routes. 2024-04-25T09:01:13.760 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T09:01:13.784 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T09:01:13.797 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T09:01:13.797 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T09:01:13.842 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T09:01:14.078 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T09:01:14.091 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:01:14.119 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking cephfs-shell (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:14.134 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T09:01:14.147 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:01:14.184 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:14.364 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T09:01:14.377 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:01:14.413 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking cephfs-top (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:14.579 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T09:01:14.591 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T09:01:14.620 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T09:01:14.649 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T09:01:14.662 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:01:14.707 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libcephfs-dev (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:15.026 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T09:01:15.039 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T09:01:15.082 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T09:01:15.084 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T09:01:15.094 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T09:01:15.132 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T09:01:15.422 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T09:01:15.435 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T09:01:15.472 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T09:01:15.527 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T09:01:15.539 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T09:01:15.654 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T09:01:15.834 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T09:01:15.850 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T09:01:15.892 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T09:01:15.931 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T09:01:15.940 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T09:01:15.982 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T09:01:16.339 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package pkg-config. 2024-04-25T09:01:16.352 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T09:01:16.397 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T09:01:16.623 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T09:01:16.636 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:01:16.673 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:16.683 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T09:01:16.698 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T09:01:16.733 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T09:01:17.428 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T09:01:17.442 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T09:01:17.486 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T09:01:17.781 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T09:01:17.794 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T09:01:17.826 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T09:01:17.830 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T09:01:17.840 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T09:01:17.885 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T09:01:18.109 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T09:01:18.123 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T09:01:18.146 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T09:01:18.157 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T09:01:18.158 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T09:01:18.196 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T09:01:18.474 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T09:01:18.486 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T09:01:18.511 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T09:01:18.524 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T09:01:18.526 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T09:01:18.569 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T09:01:18.834 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T09:01:18.847 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T09:01:18.893 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T09:01:18.930 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-py. 2024-04-25T09:01:18.945 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T09:01:18.990 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T09:01:19.130 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T09:01:19.141 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T09:01:19.171 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T09:01:19.350 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T09:01:19.364 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T09:01:19.408 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T09:01:19.474 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T09:01:19.486 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T09:01:19.524 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T09:01:19.869 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T09:01:19.879 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T09:01:19.881 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T09:01:19.892 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T09:01:19.919 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T09:01:19.937 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T09:01:20.214 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T09:01:20.226 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T09:01:20.231 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-toml. 2024-04-25T09:01:20.244 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T09:01:20.263 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T09:01:20.281 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T09:01:20.592 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T09:01:20.605 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T09:01:20.642 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T09:01:21.012 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T09:01:21.019 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T09:01:21.025 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T09:01:21.030 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:01:21.060 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:21.070 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T09:01:21.348 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T09:01:21.354 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T09:01:21.361 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T09:01:21.365 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T09:01:21.404 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T09:01:21.406 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T09:01:21.766 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T09:01:21.777 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T09:01:21.815 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T09:01:22.085 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package jq. 2024-04-25T09:01:22.097 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T09:01:22.135 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T09:01:22.168 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package radosgw. 2024-04-25T09:01:22.181 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../122-radosgw_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:01:22.218 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking radosgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:22.346 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package socat. 2024-04-25T09:01:22.358 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T09:01:22.387 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T09:01:22.674 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T09:01:22.686 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T09:01:22.724 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T09:01:22.813 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T09:01:22.825 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:01:22.862 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking rbd-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:23.044 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-test. 2024-04-25T09:01:23.055 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../099-ceph-test_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:01:23.086 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-test (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:23.196 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T09:01:23.459 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T09:01:23.594 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T09:01:23.879 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T09:01:24.285 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T09:01:24.867 INFO:teuthology.orchestra.run.smithi177.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T09:01:24.902 INFO:teuthology.orchestra.run.smithi177.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-25T09:01:24.954 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:24.990 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T09:01:25.002 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:01:25.040 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ceph-volume (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:25.411 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T09:01:25.422 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:01:25.460 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking cephfs-mirror (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:25.488 INFO:teuthology.orchestra.run.smithi177.stdout:Adding system user cephadm....done 2024-04-25T09:01:25.609 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T09:01:25.730 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T09:01:25.741 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T09:01:25.780 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T09:01:25.896 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T09:01:26.024 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T09:01:26.036 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:01:26.065 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking cephfs-shell (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:26.155 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T09:01:26.281 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T09:01:26.326 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T09:01:26.338 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T09:01:26.377 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking cephfs-top (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:26.540 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T09:01:26.630 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T09:01:26.642 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:01:26.680 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libcephfs-dev (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:26.808 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T09:01:26.959 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T09:01:26.994 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T09:01:27.004 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T09:01:27.033 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T09:01:27.269 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T09:01:27.388 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T09:01:27.402 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T09:01:27.437 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T09:01:27.621 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T09:01:27.889 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T09:01:28.025 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T09:01:28.040 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T09:01:28.083 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T09:01:28.149 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T09:01:28.425 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T09:01:28.455 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package pkg-config. 2024-04-25T09:01:28.467 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T09:01:28.504 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T09:01:28.668 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T09:01:28.741 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T09:01:28.753 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T09:01:28.790 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T09:01:28.927 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T09:01:29.219 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T09:01:29.231 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T09:01:29.262 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T09:01:29.268 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T09:01:29.513 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-ceph-argparse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:29.538 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T09:01:29.550 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T09:01:29.580 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T09:01:29.797 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T09:01:29.875 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T09:01:29.887 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T09:01:29.923 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T09:01:29.924 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T09:01:30.049 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T09:01:30.269 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T09:01:30.281 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T09:01:30.309 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T09:01:30.319 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T09:01:30.434 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T09:01:30.647 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-py. 2024-04-25T09:01:30.659 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T09:01:30.693 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T09:01:30.697 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T09:01:31.042 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T09:01:31.054 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T09:01:31.092 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T09:01:31.119 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T09:01:31.149 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T09:01:31.213 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T09:01:31.356 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T09:01:31.554 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T09:01:31.566 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T09:01:31.604 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T09:01:31.732 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T09:01:31.891 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T09:01:31.915 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-toml. 2024-04-25T09:01:31.926 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T09:01:31.965 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T09:01:32.151 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T09:01:32.276 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T09:01:32.287 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T09:01:32.317 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T09:01:32.427 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T09:01:32.646 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T09:01:32.658 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T09:01:32.696 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T09:01:32.978 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T09:01:32.982 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T09:01:32.993 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T09:01:33.063 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T09:01:33.088 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T09:01:33.736 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package radosgw. 2024-04-25T09:01:33.747 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../122-radosgw_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:01:33.781 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T09:01:33.785 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking radosgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:34.049 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T09:01:34.175 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T09:01:34.301 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T09:01:34.389 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T09:01:34.400 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T09:01:34.438 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking rbd-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:34.618 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T09:01:34.730 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T09:01:34.985 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T09:01:35.019 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T09:01:35.111 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T09:01:35.304 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T09:01:35.410 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T09:01:35.706 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T09:01:35.818 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T09:01:36.007 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T09:01:36.325 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T09:01:36.432 INFO:teuthology.orchestra.run.smithi175.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T09:01:36.466 INFO:teuthology.orchestra.run.smithi175.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-25T09:01:36.513 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:36.676 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T09:01:36.969 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T09:01:37.073 INFO:teuthology.orchestra.run.smithi175.stdout:Adding system user cephadm....done 2024-04-25T09:01:37.103 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:37.252 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T09:01:37.405 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T09:01:37.537 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T09:01:37.747 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T09:01:37.805 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T09:01:37.931 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T09:01:38.207 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T09:01:38.492 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T09:01:38.618 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T09:01:38.928 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T09:01:38.994 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T09:01:39.221 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T09:01:39.305 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T09:01:39.355 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T09:01:39.564 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T09:01:39.648 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T09:01:39.757 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T09:01:39.824 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T09:01:39.867 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T09:01:40.095 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T09:01:40.168 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T09:01:40.352 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T09:01:40.427 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T09:01:40.729 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T09:01:40.753 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T09:01:40.854 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T09:01:41.021 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T09:01:41.164 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T09:01:41.322 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-ceph-argparse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:41.432 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T09:01:41.589 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T09:01:41.691 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T09:01:41.691 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T09:01:41.808 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T09:01:41.959 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T09:01:42.076 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T09:01:42.202 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T09:01:42.227 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T09:01:42.461 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T09:01:42.495 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T09:01:42.604 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T09:01:42.857 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T09:01:42.911 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T09:01:42.981 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T09:01:42.997 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T09:01:43.082 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T09:01:43.123 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T09:01:43.424 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T09:01:43.450 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T09:01:43.559 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T09:01:43.750 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T09:01:43.836 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T09:01:44.051 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T09:01:44.120 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T09:01:44.169 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T09:01:44.278 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T09:01:44.392 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T09:01:44.463 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T09:01:44.572 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T09:01:44.638 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T09:01:44.764 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T09:01:45.157 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T09:01:45.258 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T09:01:45.442 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T09:01:45.517 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T09:01:45.567 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T09:01:45.643 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T09:01:45.769 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T09:01:45.827 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T09:01:45.995 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T09:01:46.095 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T09:01:46.321 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T09:01:46.497 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T09:01:46.639 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T09:01:46.764 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T09:01:46.923 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T09:01:47.132 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T09:01:47.134 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T09:01:47.402 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T09:01:47.425 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T09:01:47.687 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T09:01:47.768 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T09:01:47.963 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T09:01:48.349 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T09:01:48.378 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T09:01:48.624 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T09:01:48.662 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T09:01:48.788 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:49.018 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T09:01:49.090 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T09:01:49.153 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librados2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:49.304 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:49.407 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T09:01:49.430 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T09:01:49.733 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libcephfs2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:49.884 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libradosstriper1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:50.010 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T09:01:50.303 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librbd1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:50.446 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-modules-core (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:50.571 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:50.655 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T09:01:50.784 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T09:01:50.784 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T09:01:50.915 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T09:01:51.041 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T09:01:51.300 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T09:01:51.426 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T09:01:51.448 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libcephfs-dev (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:51.565 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rados (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:51.577 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T09:01:51.674 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librgw2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:51.800 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up cephfs-top (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:51.887 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T09:01:51.926 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T09:01:52.146 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T09:01:52.389 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T09:01:52.515 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T09:01:52.850 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T09:01:53.110 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T09:01:53.238 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rbd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:53.365 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up rbd-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:53.402 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T09:01:53.490 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:53.641 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cephfs (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:53.695 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T09:01:53.759 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up cephfs-shell (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:53.877 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:53.955 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T09:01:54.222 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T09:01:54.349 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T09:01:54.447 INFO:teuthology.orchestra.run.smithi177.stdout:Adding group ceph....done 2024-04-25T09:01:54.658 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T09:01:54.767 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T09:01:54.839 INFO:teuthology.orchestra.run.smithi177.stdout:Adding system user ceph....done 2024-04-25T09:01:55.008 INFO:teuthology.orchestra.run.smithi177.stdout:Setting system user ceph properties....done 2024-04-25T09:01:55.026 INFO:teuthology.orchestra.run.smithi177.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T09:01:55.068 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T09:01:55.167 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T09:01:55.378 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T09:01:55.580 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T09:01:55.671 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T09:01:55.796 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T09:01:55.922 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T09:01:56.011 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T09:01:56.241 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T09:01:56.367 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T09:01:56.412 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up cephfs-mirror (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:56.621 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T09:01:56.621 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T09:01:56.768 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T09:01:57.053 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T09:01:57.179 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T09:01:57.238 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-test (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:57.364 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up radosgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:57.430 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T09:01:57.556 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T09:01:57.882 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T09:01:57.937 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:01:57.937 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:01:58.191 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T09:01:58.484 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T09:01:58.574 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-base (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:58.713 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T09:01:58.923 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T09:01:58.972 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T09:01:59.240 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T09:01:59.508 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T09:01:59.629 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mds (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:01:59.859 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T09:01:59.859 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T09:01:59.885 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T09:02:00.178 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T09:02:00.522 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:00.530 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T09:02:00.656 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librados2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:00.718 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T09:02:00.718 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T09:02:00.790 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:00.891 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T09:02:01.236 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libcephfs2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:01.340 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-osd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:01.362 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libradosstriper1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:01.488 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T09:02:01.683 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T09:02:01.683 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T09:02:01.815 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librbd1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:01.916 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-modules-core (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:02.017 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:02.212 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T09:02:02.212 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T09:02:02.383 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:02.509 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:02.635 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mon (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:02.844 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T09:02:02.844 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T09:02:02.910 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libcephfs-dev (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:03.036 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rados (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:03.162 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up librgw2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:03.288 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up cephfs-top (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:03.422 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T09:02:03.470 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:03.757 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:03.883 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-dashboard (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:04.051 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-volume (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:04.404 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T09:02:04.529 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T09:02:04.673 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T09:02:04.701 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rbd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:04.828 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up rbd-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:04.986 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-rgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:05.113 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up python3-cephfs (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:05.238 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up cephfs-shell (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:05.364 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:05.782 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T09:02:05.934 INFO:teuthology.orchestra.run.smithi175.stdout:Adding group ceph....done 2024-04-25T09:02:06.394 INFO:teuthology.orchestra.run.smithi175.stdout:Adding system user ceph....done 2024-04-25T09:02:06.517 INFO:teuthology.orchestra.run.smithi177.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T09:02:06.522 DEBUG:teuthology.orchestra.run.smithi177:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T09:02:06.529 INFO:teuthology.orchestra.run.smithi175.stdout:Setting system user ceph properties....done 2024-04-25T09:02:06.544 INFO:teuthology.orchestra.run.smithi175.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T09:02:06.595 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2024-04-25T09:02:06.687 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T09:02:06.772 INFO:teuthology.orchestra.run.smithi177.stdout:Building dependency tree... 2024-04-25T09:02:06.773 INFO:teuthology.orchestra.run.smithi177.stdout:Reading state information... 2024-04-25T09:02:06.948 INFO:teuthology.orchestra.run.smithi177.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T09:02:06.948 INFO:teuthology.orchestra.run.smithi177.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T09:02:06.948 INFO:teuthology.orchestra.run.smithi177.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T09:02:06.948 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T09:02:06.948 INFO:teuthology.orchestra.run.smithi177.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T09:02:06.948 INFO:teuthology.orchestra.run.smithi177.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T09:02:06.948 INFO:teuthology.orchestra.run.smithi177.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T09:02:06.949 INFO:teuthology.orchestra.run.smithi177.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T09:02:06.949 INFO:teuthology.orchestra.run.smithi177.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T09:02:06.949 INFO:teuthology.orchestra.run.smithi177.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T09:02:06.950 INFO:teuthology.orchestra.run.smithi177.stdout:The following additional packages will be installed: 2024-04-25T09:02:06.950 INFO:teuthology.orchestra.run.smithi177.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T09:02:06.950 INFO:teuthology.orchestra.run.smithi177.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T09:02:06.950 INFO:teuthology.orchestra.run.smithi177.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T09:02:06.951 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T09:02:06.951 INFO:teuthology.orchestra.run.smithi177.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T09:02:06.952 INFO:teuthology.orchestra.run.smithi177.stdout:Suggested packages: 2024-04-25T09:02:06.952 INFO:teuthology.orchestra.run.smithi177.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T09:02:06.952 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T09:02:06.952 INFO:teuthology.orchestra.run.smithi177.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T09:02:07.006 INFO:teuthology.orchestra.run.smithi177.stdout:The following NEW packages will be installed: 2024-04-25T09:02:07.007 INFO:teuthology.orchestra.run.smithi177.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T09:02:07.007 INFO:teuthology.orchestra.run.smithi177.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T09:02:07.007 INFO:teuthology.orchestra.run.smithi177.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T09:02:07.007 INFO:teuthology.orchestra.run.smithi177.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T09:02:07.007 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T09:02:07.007 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T09:02:07.008 INFO:teuthology.orchestra.run.smithi177.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T09:02:07.008 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages will be upgraded: 2024-04-25T09:02:07.009 INFO:teuthology.orchestra.run.smithi177.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T09:02:07.072 INFO:teuthology.orchestra.run.smithi177.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-25T09:02:07.072 INFO:teuthology.orchestra.run.smithi177.stdout:Need to get 55.7 MB of archives. 2024-04-25T09:02:07.072 INFO:teuthology.orchestra.run.smithi177.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T09:02:07.072 INFO:teuthology.orchestra.run.smithi177.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T09:02:07.117 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T09:02:07.236 INFO:teuthology.orchestra.run.smithi177.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T09:02:07.240 INFO:teuthology.orchestra.run.smithi177.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T09:02:07.273 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T09:02:07.273 INFO:teuthology.orchestra.run.smithi177.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T09:02:07.274 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T09:02:07.282 INFO:teuthology.orchestra.run.smithi177.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T09:02:07.282 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T09:02:07.284 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T09:02:07.285 INFO:teuthology.orchestra.run.smithi177.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T09:02:07.286 INFO:teuthology.orchestra.run.smithi177.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T09:02:07.287 INFO:teuthology.orchestra.run.smithi177.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T09:02:07.299 INFO:teuthology.orchestra.run.smithi177.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T09:02:07.299 INFO:teuthology.orchestra.run.smithi177.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T09:02:07.299 INFO:teuthology.orchestra.run.smithi177.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T09:02:07.319 INFO:teuthology.orchestra.run.smithi177.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T09:02:07.549 INFO:teuthology.orchestra.run.smithi177.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T09:02:07.551 INFO:teuthology.orchestra.run.smithi177.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T09:02:07.551 INFO:teuthology.orchestra.run.smithi177.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T09:02:07.554 INFO:teuthology.orchestra.run.smithi177.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T09:02:07.554 INFO:teuthology.orchestra.run.smithi177.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T09:02:07.560 INFO:teuthology.orchestra.run.smithi177.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T09:02:07.561 INFO:teuthology.orchestra.run.smithi177.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T09:02:07.569 INFO:teuthology.orchestra.run.smithi177.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T09:02:07.570 INFO:teuthology.orchestra.run.smithi177.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T09:02:07.591 INFO:teuthology.orchestra.run.smithi177.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T09:02:07.592 INFO:teuthology.orchestra.run.smithi177.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T09:02:07.603 INFO:teuthology.orchestra.run.smithi177.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T09:02:07.625 INFO:teuthology.orchestra.run.smithi177.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T09:02:07.629 INFO:teuthology.orchestra.run.smithi177.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T09:02:07.629 INFO:teuthology.orchestra.run.smithi177.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T09:02:07.630 INFO:teuthology.orchestra.run.smithi177.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T09:02:07.631 INFO:teuthology.orchestra.run.smithi177.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T09:02:07.643 INFO:teuthology.orchestra.run.smithi177.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T09:02:07.646 INFO:teuthology.orchestra.run.smithi177.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T09:02:07.807 INFO:teuthology.orchestra.run.smithi177.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T09:02:07.807 INFO:teuthology.orchestra.run.smithi177.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T09:02:07.807 INFO:teuthology.orchestra.run.smithi177.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T09:02:07.807 INFO:teuthology.orchestra.run.smithi177.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T09:02:07.808 INFO:teuthology.orchestra.run.smithi177.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T09:02:07.808 INFO:teuthology.orchestra.run.smithi177.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T09:02:07.821 INFO:teuthology.orchestra.run.smithi177.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T09:02:07.821 INFO:teuthology.orchestra.run.smithi177.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T09:02:08.000 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up cephfs-mirror (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:08.196 INFO:teuthology.orchestra.run.smithi177.stdout:Preconfiguring packages ... 2024-04-25T09:02:08.214 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T09:02:08.214 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T09:02:08.363 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 55.7 MB in 1s (69.3 MB/s) 2024-04-25T09:02:08.669 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140582 files and directories currently installed.) 2024-04-25T09:02:08.673 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T09:02:08.796 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T09:02:09.109 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-test (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:09.232 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up radosgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:09.436 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T09:02:09.771 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:02:09.771 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T09:02:10.425 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-base (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:10.514 INFO:teuthology.orchestra.run.smithi177.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T09:02:10.766 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package flex. 2024-04-25T09:02:10.784 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T09:02:10.837 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140582 files and directories currently installed.) 2024-04-25T09:02:10.840 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T09:02:10.881 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T09:02:11.408 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T09:02:11.485 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mds (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:11.725 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T09:02:11.725 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T09:02:11.737 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T09:02:12.143 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T09:02:12.362 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:12.575 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T09:02:12.575 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T09:02:12.641 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140655 files and directories currently installed.) 2024-04-25T09:02:12.645 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T09:02:12.753 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T09:02:13.164 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T09:02:13.271 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-osd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:13.309 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T09:02:13.585 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T09:02:13.585 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T09:02:13.597 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T09:02:14.018 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package bison. 2024-04-25T09:02:14.090 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140655 files and directories currently installed.) 2024-04-25T09:02:14.094 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T09:02:14.136 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T09:02:14.240 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:14.366 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:14.492 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mon (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:14.571 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T09:02:14.585 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T09:02:14.629 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T09:02:14.684 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T09:02:14.684 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T09:02:14.965 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package dump. 2024-04-25T09:02:14.979 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T09:02:15.015 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T09:02:15.260 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package indent. 2024-04-25T09:02:15.275 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:02:15.327 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T09:02:15.335 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:15.495 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:15.630 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T09:02:15.637 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-mgr-dashboard (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:15.646 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T09:02:15.688 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T09:02:15.780 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ceph-volume (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T09:02:16.033 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T09:02:16.049 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T09:02:16.092 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T09:02:16.134 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T09:02:16.295 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T09:02:16.310 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T09:02:16.327 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T09:02:16.344 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T09:02:16.581 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T09:02:16.706 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T09:02:16.722 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T09:02:16.764 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T09:02:17.050 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T09:02:17.066 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T09:02:17.108 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T09:02:17.355 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T09:02:17.371 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T09:02:17.413 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T09:02:17.741 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T09:02:17.756 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T09:02:17.799 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T09:02:17.930 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T09:02:18.649 INFO:teuthology.orchestra.run.smithi175.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T09:02:18.654 DEBUG:teuthology.orchestra.run.smithi175:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T09:02:18.727 INFO:teuthology.orchestra.run.smithi175.stdout:Reading package lists... 2024-04-25T09:02:18.902 INFO:teuthology.orchestra.run.smithi175.stdout:Building dependency tree... 2024-04-25T09:02:18.903 INFO:teuthology.orchestra.run.smithi175.stdout:Reading state information... 2024-04-25T09:02:19.073 INFO:teuthology.orchestra.run.smithi175.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T09:02:19.073 INFO:teuthology.orchestra.run.smithi175.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T09:02:19.073 INFO:teuthology.orchestra.run.smithi175.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T09:02:19.073 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T09:02:19.073 INFO:teuthology.orchestra.run.smithi175.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T09:02:19.073 INFO:teuthology.orchestra.run.smithi175.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T09:02:19.073 INFO:teuthology.orchestra.run.smithi175.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T09:02:19.073 INFO:teuthology.orchestra.run.smithi175.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T09:02:19.074 INFO:teuthology.orchestra.run.smithi175.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T09:02:19.074 INFO:teuthology.orchestra.run.smithi175.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T09:02:19.074 INFO:teuthology.orchestra.run.smithi175.stdout:The following additional packages will be installed: 2024-04-25T09:02:19.074 INFO:teuthology.orchestra.run.smithi175.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T09:02:19.074 INFO:teuthology.orchestra.run.smithi175.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T09:02:19.075 INFO:teuthology.orchestra.run.smithi175.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T09:02:19.075 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T09:02:19.075 INFO:teuthology.orchestra.run.smithi175.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T09:02:19.076 INFO:teuthology.orchestra.run.smithi175.stdout:Suggested packages: 2024-04-25T09:02:19.076 INFO:teuthology.orchestra.run.smithi175.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T09:02:19.076 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T09:02:19.076 INFO:teuthology.orchestra.run.smithi175.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T09:02:19.110 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T09:02:19.126 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T09:02:19.130 INFO:teuthology.orchestra.run.smithi175.stdout:The following NEW packages will be installed: 2024-04-25T09:02:19.131 INFO:teuthology.orchestra.run.smithi175.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T09:02:19.131 INFO:teuthology.orchestra.run.smithi175.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T09:02:19.131 INFO:teuthology.orchestra.run.smithi175.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T09:02:19.131 INFO:teuthology.orchestra.run.smithi175.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T09:02:19.131 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T09:02:19.132 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T09:02:19.132 INFO:teuthology.orchestra.run.smithi175.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T09:02:19.133 INFO:teuthology.orchestra.run.smithi175.stdout:The following packages will be upgraded: 2024-04-25T09:02:19.133 INFO:teuthology.orchestra.run.smithi175.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T09:02:19.169 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:02:19.198 INFO:teuthology.orchestra.run.smithi175.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-25T09:02:19.198 INFO:teuthology.orchestra.run.smithi175.stdout:Need to get 55.7 MB of archives. 2024-04-25T09:02:19.198 INFO:teuthology.orchestra.run.smithi175.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T09:02:19.198 INFO:teuthology.orchestra.run.smithi175.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T09:02:19.363 INFO:teuthology.orchestra.run.smithi175.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T09:02:19.368 INFO:teuthology.orchestra.run.smithi175.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T09:02:19.400 INFO:teuthology.orchestra.run.smithi175.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T09:02:19.400 INFO:teuthology.orchestra.run.smithi175.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T09:02:19.401 INFO:teuthology.orchestra.run.smithi175.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T09:02:19.409 INFO:teuthology.orchestra.run.smithi175.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T09:02:19.410 INFO:teuthology.orchestra.run.smithi175.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T09:02:19.412 INFO:teuthology.orchestra.run.smithi175.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T09:02:19.413 INFO:teuthology.orchestra.run.smithi175.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T09:02:19.413 INFO:teuthology.orchestra.run.smithi175.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T09:02:19.415 INFO:teuthology.orchestra.run.smithi175.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T09:02:19.426 INFO:teuthology.orchestra.run.smithi175.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T09:02:19.427 INFO:teuthology.orchestra.run.smithi175.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T09:02:19.427 INFO:teuthology.orchestra.run.smithi175.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T09:02:19.451 INFO:teuthology.orchestra.run.smithi175.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T09:02:19.471 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T09:02:19.487 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T09:02:19.530 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:02:19.703 INFO:teuthology.orchestra.run.smithi175.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T09:02:19.705 INFO:teuthology.orchestra.run.smithi175.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T09:02:19.705 INFO:teuthology.orchestra.run.smithi175.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T09:02:19.709 INFO:teuthology.orchestra.run.smithi175.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T09:02:19.709 INFO:teuthology.orchestra.run.smithi175.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T09:02:19.714 INFO:teuthology.orchestra.run.smithi175.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T09:02:19.716 INFO:teuthology.orchestra.run.smithi175.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T09:02:19.723 INFO:teuthology.orchestra.run.smithi175.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T09:02:19.724 INFO:teuthology.orchestra.run.smithi175.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T09:02:19.750 INFO:teuthology.orchestra.run.smithi175.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T09:02:19.753 INFO:teuthology.orchestra.run.smithi175.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T09:02:19.764 INFO:teuthology.orchestra.run.smithi175.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T09:02:19.788 INFO:teuthology.orchestra.run.smithi175.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T09:02:19.792 INFO:teuthology.orchestra.run.smithi175.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T09:02:19.792 INFO:teuthology.orchestra.run.smithi175.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T09:02:19.793 INFO:teuthology.orchestra.run.smithi175.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T09:02:19.794 INFO:teuthology.orchestra.run.smithi175.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T09:02:19.810 INFO:teuthology.orchestra.run.smithi175.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T09:02:19.818 INFO:teuthology.orchestra.run.smithi175.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T09:02:19.849 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T09:02:19.865 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T09:02:19.930 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:02:20.027 INFO:teuthology.orchestra.run.smithi175.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T09:02:20.027 INFO:teuthology.orchestra.run.smithi175.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T09:02:20.027 INFO:teuthology.orchestra.run.smithi175.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T09:02:20.027 INFO:teuthology.orchestra.run.smithi175.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T09:02:20.028 INFO:teuthology.orchestra.run.smithi175.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T09:02:20.028 INFO:teuthology.orchestra.run.smithi175.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T09:02:20.042 INFO:teuthology.orchestra.run.smithi175.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T09:02:20.043 INFO:teuthology.orchestra.run.smithi175.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T09:02:20.268 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T09:02:20.284 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T09:02:20.318 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T09:02:20.418 INFO:teuthology.orchestra.run.smithi175.stdout:Preconfiguring packages ... 2024-04-25T09:02:20.563 INFO:teuthology.orchestra.run.smithi175.stdout:Fetched 55.7 MB in 1s (61.8 MB/s) 2024-04-25T09:02:20.646 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T09:02:20.662 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T09:02:20.713 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T09:02:20.867 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140582 files and directories currently installed.) 2024-04-25T09:02:20.871 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T09:02:21.013 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T09:02:21.091 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T09:02:21.107 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:02:21.149 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:02:21.502 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T09:02:21.517 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:02:21.585 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:02:21.595 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T09:02:21.846 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T09:02:21.861 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:02:21.912 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:02:22.182 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T09:02:22.197 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T09:02:22.240 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T09:02:22.702 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T09:02:22.715 INFO:teuthology.orchestra.run.smithi175.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T09:02:22.716 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T09:02:22.752 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T09:02:22.975 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package flex. 2024-04-25T09:02:23.045 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140582 files and directories currently installed.) 2024-04-25T09:02:23.049 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T09:02:23.098 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T09:02:23.105 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package modemmanager. 2024-04-25T09:02:23.119 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T09:02:23.163 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:02:23.626 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T09:02:23.778 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package network-manager. 2024-04-25T09:02:23.793 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T09:02:23.812 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T09:02:23.844 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T09:02:24.192 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T09:02:24.502 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ppp. 2024-04-25T09:02:24.516 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T09:02:24.749 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140655 files and directories currently installed.) 2024-04-25T09:02:24.753 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T09:02:24.861 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T09:02:24.876 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T09:02:25.206 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T09:02:25.221 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T09:02:25.266 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T09:02:25.307 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T09:02:25.493 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T09:02:25.534 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T09:02:25.548 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T09:02:25.592 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T09:02:25.858 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T09:02:25.933 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T09:02:25.947 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T09:02:25.987 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T09:02:26.282 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T09:02:26.293 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package bison. 2024-04-25T09:02:26.297 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:02:26.344 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:02:26.372 INFO:teuthology.orchestra.run.smithi175.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140655 files and directories currently installed.) 2024-04-25T09:02:26.376 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T09:02:26.428 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T09:02:26.878 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T09:02:26.892 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T09:02:26.937 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T09:02:26.945 INFO:teuthology.orchestra.run.smithi177.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T09:02:26.952 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T09:02:26.976 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-common (238) ... 2024-04-25T09:02:27.004 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T09:02:27.415 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package dump. 2024-04-25T09:02:27.418 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T09:02:27.430 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T09:02:27.432 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:02:27.474 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T09:02:27.479 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:02:27.794 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package indent. 2024-04-25T09:02:27.808 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:02:27.852 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T09:02:28.088 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T09:02:28.103 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T09:02:28.146 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T09:02:28.508 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T09:02:28.524 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T09:02:28.575 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T09:02:28.579 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql. 2024-04-25T09:02:28.594 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T09:02:28.629 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql (14+238) ... 2024-04-25T09:02:28.828 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T09:02:28.843 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T09:02:28.886 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T09:02:28.890 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T09:02:28.904 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T09:02:28.948 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T09:02:29.223 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T09:02:29.238 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T09:02:29.281 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T09:02:29.517 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T09:02:29.533 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T09:02:29.584 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T09:02:29.591 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T09:02:29.598 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T09:02:29.641 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T09:02:29.819 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T09:02:29.834 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T09:02:29.877 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T09:02:30.002 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T09:02:30.018 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T09:02:30.060 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T09:02:30.181 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T09:02:30.197 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T09:02:30.239 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T09:02:30.313 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package tcl. 2024-04-25T09:02:30.328 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T09:02:30.376 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T09:02:30.741 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T09:02:30.757 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T09:02:30.799 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T09:02:31.178 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T09:02:31.193 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T09:02:31.286 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T09:02:31.559 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T09:02:31.574 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T09:02:31.642 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:02:31.656 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T09:02:31.672 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T09:02:31.723 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T09:02:31.903 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T09:02:31.918 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T09:02:31.961 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:02:31.966 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T09:02:32.212 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T09:02:32.272 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T09:02:32.287 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T09:02:32.330 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:02:32.337 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T09:02:32.472 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:02:32.619 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T09:02:32.700 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T09:02:32.715 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T09:02:32.724 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T09:02:32.758 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T09:02:32.825 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:02:33.086 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T09:02:33.101 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T09:02:33.144 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T09:02:33.455 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T09:02:33.471 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:02:33.505 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:02:33.776 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T09:02:33.858 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T09:02:33.874 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:02:33.880 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T09:02:33.916 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:02:34.210 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T09:02:34.226 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:02:34.258 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T09:02:34.258 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T09:02:34.270 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:02:34.496 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T09:02:34.512 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T09:02:34.546 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T09:02:34.958 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T09:02:35.049 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T09:02:35.059 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T09:02:35.064 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T09:02:35.108 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T09:02:35.160 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T09:02:35.269 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T09:02:35.429 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T09:02:35.461 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package modemmanager. 2024-04-25T09:02:35.475 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T09:02:35.519 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:02:35.554 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T09:02:35.672 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T09:02:35.790 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T09:02:36.175 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package network-manager. 2024-04-25T09:02:36.190 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T09:02:36.241 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T09:02:36.578 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T09:02:36.707 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T09:02:36.799 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T09:02:36.824 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package ppp. 2024-04-25T09:02:36.840 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T09:02:36.856 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:02:37.007 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T09:02:37.133 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T09:02:37.193 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T09:02:37.259 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T09:02:37.385 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T09:02:37.474 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T09:02:37.520 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T09:02:37.535 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T09:02:37.569 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T09:02:37.587 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T09:02:37.695 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T09:02:37.880 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T09:02:37.881 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T09:02:37.896 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T09:02:37.939 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T09:02:37.989 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:02:38.124 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T09:02:38.226 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T09:02:38.240 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T09:02:38.284 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T09:02:38.292 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T09:02:38.418 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T09:02:38.596 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T09:02:38.611 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:02:38.655 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:02:38.995 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:02:38.995 INFO:teuthology.orchestra.run.smithi177.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T09:02:38.995 INFO:teuthology.orchestra.run.smithi177.stdout:which means they are currently configured by ifupdown: 2024-04-25T09:02:38.995 INFO:teuthology.orchestra.run.smithi177.stdout:- enp3s0f1 2024-04-25T09:02:38.995 INFO:teuthology.orchestra.run.smithi177.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T09:02:38.995 INFO:teuthology.orchestra.run.smithi177.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T09:02:38.996 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:02:39.127 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T09:02:39.242 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T09:02:39.257 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T09:02:39.310 INFO:teuthology.orchestra.run.smithi175.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T09:02:39.332 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-common (238) ... 2024-04-25T09:02:39.521 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T09:02:39.976 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T09:02:40.241 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T09:02:40.256 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T09:02:40.301 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:02:40.704 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:02:40.838 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T09:02:40.948 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T09:02:41.080 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-common (238) ... 2024-04-25T09:02:41.477 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql. 2024-04-25T09:02:41.491 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T09:02:41.535 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql (14+238) ... 2024-04-25T09:02:41.778 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T09:02:41.793 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T09:02:41.828 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T09:02:42.045 INFO:teuthology.orchestra.run.smithi177.stdout:Adding user postgres to group ssl-cert 2024-04-25T09:02:42.089 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T09:02:42.104 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T09:02:42.147 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T09:02:42.287 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:02:42.287 INFO:teuthology.orchestra.run.smithi177.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T09:02:42.467 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T09:02:42.482 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T09:02:42.525 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T09:02:42.547 INFO:teuthology.orchestra.run.smithi177.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T09:02:42.547 INFO:teuthology.orchestra.run.smithi177.stdout:Removing obsolete dictionary files: 2024-04-25T09:02:42.811 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package tcl. 2024-04-25T09:02:42.827 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T09:02:42.873 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T09:02:43.247 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T09:02:43.263 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T09:02:43.270 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T09:02:43.305 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T09:02:43.636 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T09:02:43.648 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T09:02:43.692 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T09:02:43.716 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:02:44.102 INFO:teuthology.orchestra.run.smithi175.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T09:02:44.117 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T09:02:44.169 INFO:teuthology.orchestra.run.smithi175.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T09:02:44.198 INFO:teuthology.orchestra.run.smithi177.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T09:02:44.213 INFO:teuthology.orchestra.run.smithi177.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T09:02:44.275 INFO:teuthology.orchestra.run.smithi177.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T09:02:44.275 INFO:teuthology.orchestra.run.smithi177.stdout:This user must also own the server process. 2024-04-25T09:02:44.275 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:02:44.275 INFO:teuthology.orchestra.run.smithi177.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T09:02:44.275 INFO:teuthology.orchestra.run.smithi177.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T09:02:44.276 INFO:teuthology.orchestra.run.smithi177.stdout:The default text search configuration will be set to "english". 2024-04-25T09:02:44.276 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:02:44.276 INFO:teuthology.orchestra.run.smithi177.stdout:Data page checksums are disabled. 2024-04-25T09:02:44.276 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:02:44.276 INFO:teuthology.orchestra.run.smithi177.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T09:02:44.277 INFO:teuthology.orchestra.run.smithi177.stdout:creating subdirectories ... ok 2024-04-25T09:02:44.277 INFO:teuthology.orchestra.run.smithi177.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T09:02:44.301 INFO:teuthology.orchestra.run.smithi177.stdout:selecting default max_connections ... 100 2024-04-25T09:02:44.334 INFO:teuthology.orchestra.run.smithi177.stdout:selecting default shared_buffers ... 128MB 2024-04-25T09:02:44.348 INFO:teuthology.orchestra.run.smithi177.stdout:selecting default time zone ... Etc/UTC 2024-04-25T09:02:44.348 INFO:teuthology.orchestra.run.smithi177.stdout:creating configuration files ... ok 2024-04-25T09:02:44.455 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T09:02:44.513 INFO:teuthology.orchestra.run.smithi177.stdout:running bootstrap script ... ok 2024-04-25T09:02:44.667 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T09:02:44.793 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T09:02:44.920 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:02:45.045 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T09:02:45.130 INFO:teuthology.orchestra.run.smithi177.stdout:performing post-bootstrap initialization ... ok 2024-04-25T09:02:45.205 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T09:02:45.306 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:02:45.664 INFO:teuthology.orchestra.run.smithi177.stdout:syncing data to disk ... ok 2024-04-25T09:02:46.181 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T09:02:46.252 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T09:02:46.361 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T09:02:46.748 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T09:02:46.748 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T09:02:47.447 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T09:02:47.565 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T09:02:47.691 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T09:02:47.817 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T09:02:47.942 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T09:02:48.068 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T09:02:48.219 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T09:02:48.345 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T09:02:49.125 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T09:02:49.140 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:02:49.249 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T09:02:49.293 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T09:02:49.375 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up postgresql (14+238) ... 2024-04-25T09:02:49.388 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T09:02:49.461 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:02:49.501 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:02:49.596 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T09:02:49.627 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:02:49.722 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T09:02:49.856 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T09:02:49.887 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T09:02:49.887 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T09:02:50.366 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T09:02:50.472 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T09:02:50.551 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T09:02:50.660 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T09:02:50.671 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T09:02:50.763 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T09:02:50.836 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T09:02:50.979 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:02:51.113 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T09:02:51.115 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T09:02:51.258 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T09:02:51.290 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T09:02:51.465 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T09:02:52.082 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:02:52.082 INFO:teuthology.orchestra.run.smithi175.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T09:02:52.082 INFO:teuthology.orchestra.run.smithi175.stdout:which means they are currently configured by ifupdown: 2024-04-25T09:02:52.082 INFO:teuthology.orchestra.run.smithi175.stdout:- enp3s0f1 2024-04-25T09:02:52.082 INFO:teuthology.orchestra.run.smithi175.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T09:02:52.082 INFO:teuthology.orchestra.run.smithi175.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T09:02:52.082 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:02:52.214 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T09:02:52.636 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T09:02:52.637 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T09:02:52.736 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T09:02:53.048 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T09:02:53.285 INFO:teuthology.orchestra.run.smithi177.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T09:02:53.292 DEBUG:teuthology.parallel:result is None 2024-04-25T09:02:53.784 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:02:53.945 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T09:02:54.078 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T09:02:54.205 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-common (238) ... 2024-04-25T09:02:55.184 INFO:teuthology.orchestra.run.smithi175.stdout:Adding user postgres to group ssl-cert 2024-04-25T09:02:55.441 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:02:55.442 INFO:teuthology.orchestra.run.smithi175.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T09:02:55.702 INFO:teuthology.orchestra.run.smithi175.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T09:02:55.702 INFO:teuthology.orchestra.run.smithi175.stdout:Removing obsolete dictionary files: 2024-04-25T09:02:56.429 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T09:02:57.041 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:02:57.375 INFO:teuthology.orchestra.run.smithi175.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T09:02:57.390 INFO:teuthology.orchestra.run.smithi175.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T09:02:57.439 INFO:teuthology.orchestra.run.smithi175.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T09:02:57.439 INFO:teuthology.orchestra.run.smithi175.stdout:This user must also own the server process. 2024-04-25T09:02:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:02:57.439 INFO:teuthology.orchestra.run.smithi175.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T09:02:57.439 INFO:teuthology.orchestra.run.smithi175.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T09:02:57.439 INFO:teuthology.orchestra.run.smithi175.stdout:The default text search configuration will be set to "english". 2024-04-25T09:02:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:02:57.439 INFO:teuthology.orchestra.run.smithi175.stdout:Data page checksums are disabled. 2024-04-25T09:02:57.439 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:02:57.439 INFO:teuthology.orchestra.run.smithi175.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T09:02:57.440 INFO:teuthology.orchestra.run.smithi175.stdout:creating subdirectories ... ok 2024-04-25T09:02:57.440 INFO:teuthology.orchestra.run.smithi175.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T09:02:57.464 INFO:teuthology.orchestra.run.smithi175.stdout:selecting default max_connections ... 100 2024-04-25T09:02:57.497 INFO:teuthology.orchestra.run.smithi175.stdout:selecting default shared_buffers ... 128MB 2024-04-25T09:02:57.511 INFO:teuthology.orchestra.run.smithi175.stdout:selecting default time zone ... Etc/UTC 2024-04-25T09:02:57.512 INFO:teuthology.orchestra.run.smithi175.stdout:creating configuration files ... ok 2024-04-25T09:02:57.678 INFO:teuthology.orchestra.run.smithi175.stdout:running bootstrap script ... ok 2024-04-25T09:02:58.297 INFO:teuthology.orchestra.run.smithi175.stdout:performing post-bootstrap initialization ... ok 2024-04-25T09:02:58.849 INFO:teuthology.orchestra.run.smithi175.stdout:syncing data to disk ... ok 2024-04-25T09:02:59.364 INFO:teuthology.orchestra.run.smithi175.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T09:03:02.464 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:03:02.590 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T09:03:02.716 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up postgresql (14+238) ... 2024-04-25T09:03:02.875 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:03:03.001 INFO:teuthology.orchestra.run.smithi175.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:03:03.237 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T09:03:03.237 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T09:03:03.987 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T09:03:04.104 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T09:03:04.448 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T09:03:04.616 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T09:03:06.011 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T09:03:06.111 INFO:teuthology.orchestra.run.smithi175.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T09:03:06.673 INFO:teuthology.orchestra.run.smithi175.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T09:03:06.680 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:06.681 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T09:03:06.869 DEBUG:teuthology.orchestra.run.smithi175:> dpkg-query -W -f '${Version}' ceph 2024-04-25T09:03:06.891 INFO:teuthology.orchestra.run.smithi175.stdout:19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T09:03:06.892 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T09:03:06.892 INFO:teuthology.task.install:The correct ceph version 19.0.0-1628-g97ae6cc9-1jammy is installed. 2024-04-25T09:03:06.894 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T09:03:07.141 DEBUG:teuthology.orchestra.run.smithi177:> dpkg-query -W -f '${Version}' ceph 2024-04-25T09:03:07.165 INFO:teuthology.orchestra.run.smithi177.stdout:19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T09:03:07.165 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T09:03:07.165 INFO:teuthology.task.install:The correct ceph version 19.0.0-1628-g97ae6cc9-1jammy is installed. 2024-04-25T09:03:07.167 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T09:03:07.168 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:07.168 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T09:03:07.188 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:07.188 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T09:03:07.230 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T09:03:07.231 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:07.231 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T09:03:07.250 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T09:03:07.309 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:07.309 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T09:03:07.330 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T09:03:07.394 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T09:03:07.394 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:07.394 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T09:03:07.413 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T09:03:07.475 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:07.475 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T09:03:07.495 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T09:03:07.562 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T09:03:07.562 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:07.562 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T09:03:07.581 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T09:03:07.641 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:07.642 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T09:03:07.662 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T09:03:07.726 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T09:03:07.811 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T09:03:07.811 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /var/log/ceph 2024-04-25T09:03:07.814 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 777 /var/log/ceph 2024-04-25T09:03:07.835 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T09:03:07.835 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T09:03:07.873 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T09:03:07.901 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T09:03:07.902 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T09:03:07.933 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T09:03:07.976 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T09:03:07.976 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T09:03:07.976 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T09:03:07.977 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:07.977 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T09:03:07.998 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:08.086 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:08.086 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T09:03:08.095 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:08.196 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T09:03:08.196 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T09:03:08.197 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673005', 'branch': 'wip-neesingh-testing-240416', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/forward-scrub}', 'email': 'neesingh@redhat.com', 'first_in_suite': False, 'job_id': '7673005', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-neesingh-testing-240416'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}}, 'kclient': {'syntax': 'v1'}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62537', 'sha1': '5787d42d10024ba410e822a8aba474331cb9af02'}}, 'owner': 'scheduled_neesingh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5869, 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-62537', 'suite_path': '/home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/neesingh-rh/ceph', 'suite_sha1': '5787d42d10024ba410e822a8aba474331cb9af02', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi175.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM+LNu+nr1q8JDenVCcWwWpzV94O4mY7Vl1Pwc5FQl3wwMAIzMj0TQMUjgTZ97JCWW4Bc1TT+4tHN2KrvXEwzGE=', 'smithi177.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMBzCn23xb/DHJPXNLBCLQvjCziIK5v37US6IM1+vvI7q7GShIj/pj1fAoVNabsFIcKxPJaHonmySj3I//ynMkc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_08:15:18', 'tube': 'smithi', 'user': 'neesingh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T09:03:08.197 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T09:03:08.200 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T09:03:08.209 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T09:03:08.249 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T09:03:08.274 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:08.274 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T09:03:08.315 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T09:03:08.316 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-04-25T09:03:08.367 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T09:03:08.397 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:03:08.397 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 885 Links: 1 2024-04-25T09:03:08.397 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:03:08.398 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-25 08:56:34.918292000 +0000 2024-04-25T09:03:08.398 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-25 08:56:34.654294356 +0000 2024-04-25T09:03:08.398 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-25 08:56:34.654294356 +0000 2024-04-25T09:03:08.398 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-25 08:56:34.654294356 +0000 2024-04-25T09:03:08.398 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T09:03:08.428 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-25T09:03:08.428 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-25T09:03:08.428 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000398427 s, 1.3 MB/s 2024-04-25T09:03:08.430 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T09:03:08.481 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-04-25T09:03:08.531 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T09:03:08.531 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:03:08.531 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 901 Links: 1 2024-04-25T09:03:08.531 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:03:08.531 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-25 08:56:35.442287319 +0000 2024-04-25T09:03:08.531 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-25 08:56:35.178289676 +0000 2024-04-25T09:03:08.531 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-25 08:56:35.178289676 +0000 2024-04-25T09:03:08.531 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-25 08:56:35.178289676 +0000 2024-04-25T09:03:08.531 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T09:03:08.591 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-25T09:03:08.591 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-25T09:03:08.591 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000325632 s, 1.6 MB/s 2024-04-25T09:03:08.593 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T09:03:08.644 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-04-25T09:03:08.698 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T09:03:08.699 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:03:08.699 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 919 Links: 1 2024-04-25T09:03:08.699 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:03:08.699 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-25 08:56:35.714284888 +0000 2024-04-25T09:03:08.699 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-25 08:56:35.710284925 +0000 2024-04-25T09:03:08.699 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-25 08:56:35.710284925 +0000 2024-04-25T09:03:08.699 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-25 08:56:35.710284925 +0000 2024-04-25T09:03:08.699 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T09:03:08.759 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-25T09:03:08.760 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-25T09:03:08.760 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.00038426 s, 1.3 MB/s 2024-04-25T09:03:08.761 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T09:03:08.816 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-04-25T09:03:08.866 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T09:03:08.867 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:03:08.867 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 6h/6d Inode: 934 Links: 1 2024-04-25T09:03:08.867 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:03:08.867 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-25 08:56:36.594277029 +0000 2024-04-25T09:03:08.867 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-25 08:56:36.322279458 +0000 2024-04-25T09:03:08.867 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-25 08:56:36.322279458 +0000 2024-04-25T09:03:08.867 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-25 08:56:36.322279458 +0000 2024-04-25T09:03:08.867 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T09:03:08.927 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-25T09:03:08.927 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-25T09:03:08.927 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000338629 s, 1.5 MB/s 2024-04-25T09:03:08.929 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T09:03:08.980 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:03:08.980 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:08.980 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T09:03:08.989 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T09:03:08.989 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_1 2024-04-25T09:03:09.042 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T09:03:09.042 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:03:09.042 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 880 Links: 1 2024-04-25T09:03:09.042 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:03:09.042 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-04-25 08:56:34.118240303 +0000 2024-04-25T09:03:09.042 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-04-25 08:56:33.838242803 +0000 2024-04-25T09:03:09.042 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-04-25 08:56:33.838242803 +0000 2024-04-25T09:03:09.042 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-04-25 08:56:33.838242803 +0000 2024-04-25T09:03:09.043 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T09:03:09.104 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-04-25T09:03:09.104 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-04-25T09:03:09.104 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000385149 s, 1.3 MB/s 2024-04-25T09:03:09.106 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T09:03:09.159 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_2 2024-04-25T09:03:09.209 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T09:03:09.210 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:03:09.210 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 898 Links: 1 2024-04-25T09:03:09.210 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:03:09.210 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-04-25 08:56:34.690235193 +0000 2024-04-25T09:03:09.210 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-04-25 08:56:34.422237587 +0000 2024-04-25T09:03:09.210 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-04-25 08:56:34.422237587 +0000 2024-04-25T09:03:09.210 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-04-25 08:56:34.422237587 +0000 2024-04-25T09:03:09.210 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T09:03:09.271 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-04-25T09:03:09.271 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-04-25T09:03:09.271 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000371997 s, 1.4 MB/s 2024-04-25T09:03:09.273 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T09:03:09.327 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_3 2024-04-25T09:03:09.382 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T09:03:09.382 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:03:09.382 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 915 Links: 1 2024-04-25T09:03:09.382 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:03:09.382 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-04-25 08:56:34.990232514 +0000 2024-04-25T09:03:09.382 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-04-25 08:56:34.986232550 +0000 2024-04-25T09:03:09.382 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-04-25 08:56:34.986232550 +0000 2024-04-25T09:03:09.382 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-04-25 08:56:34.986232550 +0000 2024-04-25T09:03:09.383 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T09:03:09.448 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-04-25T09:03:09.448 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-04-25T09:03:09.448 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000374512 s, 1.4 MB/s 2024-04-25T09:03:09.450 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T09:03:09.504 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_4 2024-04-25T09:03:09.558 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T09:03:09.558 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:03:09.558 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 931 Links: 1 2024-04-25T09:03:09.558 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:03:09.558 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-04-25 08:56:35.786225404 +0000 2024-04-25T09:03:09.558 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-04-25 08:56:35.530227690 +0000 2024-04-25T09:03:09.558 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-04-25 08:56:35.530227690 +0000 2024-04-25T09:03:09.558 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-04-25 08:56:35.530227690 +0000 2024-04-25T09:03:09.559 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T09:03:09.620 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-04-25T09:03:09.620 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-04-25T09:03:09.620 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000388188 s, 1.3 MB/s 2024-04-25T09:03:09.622 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T09:03:09.676 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:03:09.676 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T09:03:09.676 INFO:tasks.ceph:Generating config... 2024-04-25T09:03:09.677 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T09:03:09.677 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T09:03:09.677 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T09:03:09.677 INFO:tasks.ceph:[client] pid file = 2024-04-25T09:03:09.678 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T09:03:09.678 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T09:03:09.678 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T09:03:09.678 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T09:03:09.678 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T09:03:09.678 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T09:03:09.678 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T09:03:09.678 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T09:03:09.678 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T09:03:09.678 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T09:03:09.678 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T09:03:09.678 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T09:03:09.678 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T09:03:09.678 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T09:03:09.678 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T09:03:09.679 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T09:03:09.679 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T09:03:09.679 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T09:03:09.679 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T09:03:09.679 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-25T09:03:09.679 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-25T09:03:09.679 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-25T09:03:09.679 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T09:03:09.679 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T09:03:09.679 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T09:03:09.679 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T09:03:09.679 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T09:03:09.679 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T09:03:09.679 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T09:03:09.679 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T09:03:09.679 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T09:03:09.679 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T09:03:09.680 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T09:03:09.680 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T09:03:09.680 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T09:03:09.680 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T09:03:09.680 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T09:03:09.724 INFO:teuthology.orchestra.run.smithi175.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T09:03:09.737 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T09:03:09.826 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T09:03:09.845 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.175'), ('mon.b', '172.21.15.177'), ('mon.c', '[v2:172.21.15.177:3301,v1:172.21.15.177:6790]')] 2024-04-25T09:03:09.845 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.175,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T09:03:09.846 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:09.846 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T09:03:09.894 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.175 --add b 172.21.15.177 --addv c '[v2:172.21.15.177:3301,v1:172.21.15.177:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:03:09.984 INFO:teuthology.orchestra.run.smithi175.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:03:09.984 INFO:teuthology.orchestra.run.smithi175.stdout:monmaptool: generated fsid 8caed986-ca08-40e2-b5a5-12e2aade6223 2024-04-25T09:03:09.985 INFO:teuthology.orchestra.run.smithi175.stdout:setting min_mon_release = quincy 2024-04-25T09:03:09.985 INFO:teuthology.orchestra.run.smithi175.stdout:epoch 0 2024-04-25T09:03:09.985 INFO:teuthology.orchestra.run.smithi175.stdout:fsid 8caed986-ca08-40e2-b5a5-12e2aade6223 2024-04-25T09:03:09.985 INFO:teuthology.orchestra.run.smithi175.stdout:last_changed 2024-04-25T09:03:09.999032+0000 2024-04-25T09:03:09.985 INFO:teuthology.orchestra.run.smithi175.stdout:created 2024-04-25T09:03:09.999032+0000 2024-04-25T09:03:09.985 INFO:teuthology.orchestra.run.smithi175.stdout:min_mon_release 17 (quincy) 2024-04-25T09:03:09.985 INFO:teuthology.orchestra.run.smithi175.stdout:election_strategy: 1 2024-04-25T09:03:09.985 INFO:teuthology.orchestra.run.smithi175.stdout:0: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.a 2024-04-25T09:03:09.985 INFO:teuthology.orchestra.run.smithi175.stdout:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2024-04-25T09:03:09.985 INFO:teuthology.orchestra.run.smithi175.stdout:2: [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] mon.c 2024-04-25T09:03:09.985 INFO:teuthology.orchestra.run.smithi175.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T09:03:09.988 DEBUG:teuthology.orchestra.run.smithi175:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T09:03:09.996 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8caed986-ca08-40e2-b5a5-12e2aade6223... 2024-04-25T09:03:09.996 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:03:10.041 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:03:10.080 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2024-04-25T09:03:10.080 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2024-04-25T09:03:10.080 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:03:10.080 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2024-04-25T09:03:10.080 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.080 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2024-04-25T09:03:10.080 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.080 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2024-04-25T09:03:10.081 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.081 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2024-04-25T09:03:10.081 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2024-04-25T09:03:10.081 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.081 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2024-04-25T09:03:10.081 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2024-04-25T09:03:10.081 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.081 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:03:10.081 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2024-04-25T09:03:10.081 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.081 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:03:10.081 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:03:10.081 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.081 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2024-04-25T09:03:10.082 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.082 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2024-04-25T09:03:10.082 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2024-04-25T09:03:10.082 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:03:10.082 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:03:10.082 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2024-04-25T09:03:10.082 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:03:10.082 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2024-04-25T09:03:10.082 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:03:10.082 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:03:10.082 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2024-04-25T09:03:10.082 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.082 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:03:10.083 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.083 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2024-04-25T09:03:10.083 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.083 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2024-04-25T09:03:10.083 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.083 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2024-04-25T09:03:10.083 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2024-04-25T09:03:10.083 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2024-04-25T09:03:10.083 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.175,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]" 2024-04-25T09:03:10.083 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on skipped message = False 2024-04-25T09:03:10.083 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = 8caed986-ca08-40e2-b5a5-12e2aade6223 2024-04-25T09:03:10.083 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.083 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2024-04-25T09:03:10.083 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2024-04-25T09:03:10.083 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.083 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2024-04-25T09:03:10.084 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2024-04-25T09:03:10.084 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:03:10.084 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.084 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2024-04-25T09:03:10.084 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2024-04-25T09:03:10.084 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.084 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2024-04-25T09:03:10.084 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2024-04-25T09:03:10.084 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2024-04-25T09:03:10.084 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug trim objects = true 2024-04-25T09:03:10.084 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.084 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2024-04-25T09:03:10.084 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2024-04-25T09:03:10.084 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.084 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:03:10.084 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.085 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2024-04-25T09:03:10.085 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.085 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2024-04-25T09:03:10.085 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.085 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:03:10.085 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2024-04-25T09:03:10.085 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.085 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2024-04-25T09:03:10.085 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2024-04-25T09:03:10.085 INFO:teuthology.orchestra.run.smithi175.stdout: bdev async discard = True 2024-04-25T09:03:10.085 INFO:teuthology.orchestra.run.smithi175.stdout: bdev enable discard = True 2024-04-25T09:03:10.085 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore allocator = bitmap 2024-04-25T09:03:10.085 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2024-04-25T09:03:10.085 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2024-04-25T09:03:10.085 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 1/20 2024-04-25T09:03:10.085 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 1/20 2024-04-25T09:03:10.086 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:03:10.086 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2024-04-25T09:03:10.086 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 4/10 2024-04-25T09:03:10.086 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:03:10.086 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2024-04-25T09:03:10.086 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:03:10.086 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:03:10.086 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2024-04-25T09:03:10.086 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-04-25T09:03:10.086 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.086 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2024-04-25T09:03:10.086 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:03:10.086 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2024-04-25T09:03:10.086 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-25T09:03:10.087 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-25T09:03:10.087 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:10.087 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:10.087 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2024-04-25T09:03:10.087 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.087 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2024-04-25T09:03:10.087 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:03:10.087 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-25T09:03:10.087 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2024-04-25T09:03:10.087 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-25T09:03:10.087 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2024-04-25T09:03:10.087 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2024-04-25T09:03:10.087 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:10.087 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2024-04-25T09:03:10.088 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2024-04-25T09:03:10.088 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:10.088 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.088 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:03:10.088 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:03:10.088 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:03:10.088 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.088 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:03:10.088 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:03:10.088 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:03:10.088 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.088 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2024-04-25T09:03:10.088 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:03:10.088 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.089 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:03:10.089 INFO:teuthology.orchestra.run.smithi175.stdout: mon op complaint time = 120 2024-04-25T09:03:10.089 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:10.089 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2024-04-25T09:03:10.089 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2024-04-25T09:03:10.089 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2024-04-25T09:03:10.089 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2024-04-25T09:03:10.089 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:03:10.089 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:03:10.089 INFO:teuthology.orchestra.run.smithi175.stdout: client mount timeout = 600 2024-04-25T09:03:10.089 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2024-04-25T09:03:10.089 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:03:10.089 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = "" 2024-04-25T09:03:10.089 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-04-25T09:03:10.089 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-04-25T09:03:10.090 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2024-04-25T09:03:10.090 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2024-04-25T09:03:10.090 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2024-04-25T09:03:10.090 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-04-25T09:03:10.090 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2024-04-25T09:03:10.090 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-04-25T09:03:10.090 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2024-04-25T09:03:10.090 INFO:teuthology.orchestra.run.smithi175.stdout:[mds] 2024-04-25T09:03:10.090 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds = 20 2024-04-25T09:03:10.090 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds balancer = 20 2024-04-25T09:03:10.090 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:03:10.090 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug frag = True 2024-04-25T09:03:10.090 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug scatterstat = True 2024-04-25T09:03:10.090 INFO:teuthology.orchestra.run.smithi175.stdout: mds op complaint time = 180 2024-04-25T09:03:10.091 INFO:teuthology.orchestra.run.smithi175.stdout: mds verify scatter = True 2024-04-25T09:03:10.091 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-04-25T09:03:10.091 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-04-25T09:03:10.091 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-04-25T09:03:10.091 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2024-04-25T09:03:10.091 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2024-04-25T09:03:10.091 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:03:10.091 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2024-04-25T09:03:10.091 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.092 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2024-04-25T09:03:10.092 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.092 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2024-04-25T09:03:10.092 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.092 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2024-04-25T09:03:10.092 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2024-04-25T09:03:10.092 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.092 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2024-04-25T09:03:10.092 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2024-04-25T09:03:10.092 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.092 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:03:10.092 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2024-04-25T09:03:10.092 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.092 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:03:10.093 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:03:10.093 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.093 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2024-04-25T09:03:10.093 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.093 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2024-04-25T09:03:10.093 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2024-04-25T09:03:10.093 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:03:10.093 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:03:10.093 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2024-04-25T09:03:10.093 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:03:10.093 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2024-04-25T09:03:10.093 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:03:10.093 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:03:10.093 INFO:teuthology.orchestra.run.smithi177.stdout: mon_allow_pool_size_one = true 2024-04-25T09:03:10.093 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.094 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:03:10.094 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.094 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2024-04-25T09:03:10.094 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.094 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2024-04-25T09:03:10.094 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.094 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2024-04-25T09:03:10.094 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2024-04-25T09:03:10.094 INFO:teuthology.orchestra.run.smithi177.stdout: mon health detail to clog = false 2024-04-25T09:03:10.094 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = "172.21.15.175,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]" 2024-04-25T09:03:10.094 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on skipped message = False 2024-04-25T09:03:10.094 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = 8caed986-ca08-40e2-b5a5-12e2aade6223 2024-04-25T09:03:10.094 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.094 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2024-04-25T09:03:10.094 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2024-04-25T09:03:10.094 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.095 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2024-04-25T09:03:10.095 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2024-04-25T09:03:10.095 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:03:10.095 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.095 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2024-04-25T09:03:10.095 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2024-04-25T09:03:10.095 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.095 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2024-04-25T09:03:10.095 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2024-04-25T09:03:10.095 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2024-04-25T09:03:10.095 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug trim objects = true 2024-04-25T09:03:10.095 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.095 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2024-04-25T09:03:10.095 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2024-04-25T09:03:10.095 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.096 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:03:10.096 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.096 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2024-04-25T09:03:10.096 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.096 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2024-04-25T09:03:10.096 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.096 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:03:10.096 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2024-04-25T09:03:10.096 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.096 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2024-04-25T09:03:10.096 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2024-04-25T09:03:10.096 INFO:teuthology.orchestra.run.smithi177.stdout: bdev async discard = True 2024-04-25T09:03:10.096 INFO:teuthology.orchestra.run.smithi177.stdout: bdev enable discard = True 2024-04-25T09:03:10.096 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore allocator = bitmap 2024-04-25T09:03:10.096 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2024-04-25T09:03:10.096 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2024-04-25T09:03:10.097 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 1/20 2024-04-25T09:03:10.097 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 1/20 2024-04-25T09:03:10.097 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:03:10.097 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 20 2024-04-25T09:03:10.097 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 4/10 2024-04-25T09:03:10.097 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:03:10.097 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2024-04-25T09:03:10.097 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:03:10.097 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:03:10.097 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = bluestore 2024-04-25T09:03:10.097 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2024-04-25T09:03:10.097 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.097 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2024-04-25T09:03:10.097 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:03:10.097 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2024-04-25T09:03:10.097 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-04-25T09:03:10.098 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-04-25T09:03:10.098 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:10.098 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:10.098 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2024-04-25T09:03:10.098 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.098 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2024-04-25T09:03:10.098 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:03:10.098 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-04-25T09:03:10.098 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2024-04-25T09:03:10.098 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-04-25T09:03:10.098 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2024-04-25T09:03:10.098 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2024-04-25T09:03:10.098 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:03:10.098 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2024-04-25T09:03:10.098 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2024-04-25T09:03:10.099 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:03:10.099 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.099 INFO:teuthology.orchestra.run.smithi177.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:03:10.099 INFO:teuthology.orchestra.run.smithi177.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:03:10.099 INFO:teuthology.orchestra.run.smithi177.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:03:10.099 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.099 INFO:teuthology.orchestra.run.smithi177.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:03:10.099 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:03:10.099 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:03:10.099 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.099 INFO:teuthology.orchestra.run.smithi177.stdout: # 1m isn't quite enough 2024-04-25T09:03:10.099 INFO:teuthology.orchestra.run.smithi177.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:03:10.099 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.099 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:03:10.099 INFO:teuthology.orchestra.run.smithi177.stdout: mon op complaint time = 120 2024-04-25T09:03:10.099 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:03:10.100 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2024-04-25T09:03:10.100 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2024-04-25T09:03:10.100 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2024-04-25T09:03:10.100 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2024-04-25T09:03:10.100 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:03:10.100 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:03:10.100 INFO:teuthology.orchestra.run.smithi177.stdout: client mount timeout = 600 2024-04-25T09:03:10.100 INFO:teuthology.orchestra.run.smithi177.stdout: debug client = 20 2024-04-25T09:03:10.100 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:03:10.100 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = "" 2024-04-25T09:03:10.100 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2024-04-25T09:03:10.100 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2024-04-25T09:03:10.100 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2024-04-25T09:03:10.100 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.b] 2024-04-25T09:03:10.100 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.c] 2024-04-25T09:03:10.101 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2024-04-25T09:03:10.101 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2024-04-25T09:03:10.101 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2024-04-25T09:03:10.101 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2024-04-25T09:03:10.101 INFO:teuthology.orchestra.run.smithi177.stdout:[mds] 2024-04-25T09:03:10.101 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds = 20 2024-04-25T09:03:10.101 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds balancer = 20 2024-04-25T09:03:10.101 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:03:10.101 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug frag = True 2024-04-25T09:03:10.101 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug scatterstat = True 2024-04-25T09:03:10.101 INFO:teuthology.orchestra.run.smithi177.stdout: mds op complaint time = 180 2024-04-25T09:03:10.101 INFO:teuthology.orchestra.run.smithi177.stdout: mds verify scatter = True 2024-04-25T09:03:10.101 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2024-04-25T09:03:10.101 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2024-04-25T09:03:10.101 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2024-04-25T09:03:10.103 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T09:03:10.103 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T09:03:10.209 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T09:03:10.210 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:10.210 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T09:03:10.218 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:10.219 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T09:03:10.270 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:03:10.270 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:10.271 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T09:03:10.271 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T09:03:10.375 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:10.375 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:03:10.430 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi177.front.sepia.ceph.com 2024-04-25T09:03:10.431 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:10.431 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T09:03:10.431 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T09:03:10.466 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:10.466 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:03:10.521 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T09:03:10.522 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T09:03:10.522 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T09:03:10.575 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T09:03:10.580 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T09:03:10.640 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T09:03:10.654 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T09:03:10.654 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T09:03:10.709 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T09:03:10.713 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T09:03:10.733 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T09:03:10.827 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T09:03:10.832 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T09:03:10.851 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T09:03:10.907 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T09:03:10.911 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T09:03:10.931 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T09:03:11.030 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T09:03:11.034 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T09:03:11.053 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T09:03:11.053 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T09:03:11.095 INFO:teuthology.orchestra.run.smithi175.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T09:03:11.112 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-25T09:03:11.196 INFO:teuthology.orchestra.run.smithi175.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-25T09:03:11.213 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T09:03:11.254 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T09:03:11.271 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-25T09:03:11.359 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-25T09:03:11.375 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T09:03:11.375 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T09:03:11.376 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T09:03:11.395 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:03:11.395 INFO:tasks.ceph:role: osd.0 2024-04-25T09:03:11.395 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:03:11.395 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T09:03:11.468 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:03:11.468 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:03:11.468 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:03:11.469 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:03:11.469 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:03:11.469 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:03:11.469 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:03:11.469 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:03:11.469 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:03:11.469 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:03:11.876 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-25T09:03:11.878 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-25T09:03:11.878 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T09:03:11.994 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T09:03:12.009 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:03:12.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:03:12.011 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T09:03:12.074 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:03:12.074 INFO:tasks.ceph:role: osd.1 2024-04-25T09:03:12.074 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:03:12.074 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T09:03:12.141 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:03:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:03:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:03:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:03:12.141 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:03:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:03:12.141 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:03:12.141 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:03:12.141 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:03:12.142 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:03:12.513 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-25T09:03:12.516 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-25T09:03:12.516 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T09:03:12.592 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T09:03:12.654 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:03:12.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:03:12.655 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T09:03:12.718 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:03:12.718 INFO:tasks.ceph:role: osd.2 2024-04-25T09:03:12.718 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:03:12.718 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T09:03:12.788 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:03:12.789 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:03:12.789 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:03:12.789 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:03:12.789 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:03:12.789 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:03:12.789 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:03:12.789 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:03:12.789 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:03:12.789 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:03:13.178 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-25T09:03:13.181 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-25T09:03:13.181 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T09:03:13.271 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T09:03:13.287 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:03:13.288 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:03:13.288 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T09:03:13.349 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:03:13.349 INFO:tasks.ceph:role: osd.3 2024-04-25T09:03:13.349 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:03:13.349 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T09:03:13.417 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:03:13.417 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:03:13.417 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:03:13.417 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:03:13.417 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:03:13.417 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:03:13.417 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:03:13.417 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:03:13.418 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:03:13.418 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:03:13.806 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-25T09:03:13.809 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-25T09:03:13.809 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T09:03:13.906 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T09:03:13.922 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:03:13.922 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:03:13.923 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:03:14.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:14.058+0000 7fef640697c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T09:03:14.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:14.062+0000 7fef640697c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T09:03:14.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:14.062+0000 7fef640697c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T09:03:14.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:14.062+0000 7fef640697c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T09:03:14.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:14.062+0000 7fef640697c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T09:03:14.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:14.070+0000 7fef640697c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T09:03:17.102 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T09:03:17.122 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:03:17.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:17.222+0000 7f58a5d867c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T09:03:17.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:17.222+0000 7f58a5d867c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T09:03:17.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:17.222+0000 7f58a5d867c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T09:03:17.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:17.222+0000 7f58a5d867c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T09:03:17.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:17.222+0000 7f58a5d867c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T09:03:17.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:17.226+0000 7f58a5d867c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T09:03:20.258 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T09:03:20.278 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:03:20.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:20.382+0000 7f870d9887c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T09:03:20.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:20.382+0000 7f870d9887c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T09:03:20.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:20.382+0000 7f870d9887c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T09:03:20.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:20.382+0000 7f870d9887c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T09:03:20.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:20.382+0000 7f870d9887c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T09:03:20.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:20.386+0000 7f870d9887c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T09:03:23.389 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T09:03:23.409 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:03:23.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:23.510+0000 7fbe5aef07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T09:03:23.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:23.510+0000 7fbe5aef07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T09:03:23.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:23.510+0000 7fbe5aef07c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T09:03:23.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:23.510+0000 7fbe5aef07c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T09:03:23.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:23.510+0000 7fbe5aef07c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T09:03:23.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:23.514+0000 7fbe5aef07c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T09:03:26.560 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T09:03:26.581 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T09:03:26.603 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:03:26.603 INFO:tasks.ceph:role: osd.4 2024-04-25T09:03:26.603 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com 2024-04-25T09:03:26.604 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T09:03:26.673 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:03:26.673 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:03:26.673 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:03:26.673 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:03:26.673 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:03:26.673 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:03:26.674 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:03:26.674 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:03:26.674 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:03:26.674 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:03:27.050 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-04-25T09:03:27.053 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-04-25T09:03:27.053 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T09:03:27.149 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T09:03:27.165 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:03:27.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:03:27.167 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T09:03:27.229 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:03:27.229 INFO:tasks.ceph:role: osd.5 2024-04-25T09:03:27.229 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com 2024-04-25T09:03:27.229 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T09:03:27.300 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:03:27.300 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:03:27.301 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:03:27.301 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:03:27.301 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:03:27.301 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:03:27.301 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:03:27.301 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:03:27.301 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:03:27.301 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:03:27.704 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-04-25T09:03:27.707 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-04-25T09:03:27.707 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T09:03:27.833 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T09:03:27.850 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:03:27.851 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:03:27.852 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T09:03:27.918 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:03:27.918 INFO:tasks.ceph:role: osd.6 2024-04-25T09:03:27.919 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com 2024-04-25T09:03:27.919 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:03:27.990 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:03:27.991 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:03:28.393 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-04-25T09:03:28.396 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-04-25T09:03:28.396 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T09:03:28.545 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T09:03:28.562 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:03:28.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:03:28.564 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T09:03:28.629 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:03:28.629 INFO:tasks.ceph:role: osd.7 2024-04-25T09:03:28.629 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com 2024-04-25T09:03:28.630 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:03:28.702 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:03:28.702 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:03:28.702 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:03:29.056 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-04-25T09:03:29.059 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-04-25T09:03:29.059 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T09:03:29.145 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T09:03:29.205 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:03:29.206 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:03:29.207 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:03:29.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:29.352+0000 7fde90f847c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T09:03:29.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:29.352+0000 7fde90f847c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T09:03:29.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:29.352+0000 7fde90f847c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T09:03:29.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:29.352+0000 7fde90f847c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T09:03:29.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:29.352+0000 7fde90f847c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T09:03:29.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:29.356+0000 7fde90f847c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T09:03:32.365 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T09:03:32.387 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:03:32.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:32.492+0000 7ff243d657c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T09:03:32.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:32.492+0000 7ff243d657c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T09:03:32.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:32.492+0000 7ff243d657c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T09:03:32.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:32.492+0000 7ff243d657c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T09:03:32.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:32.492+0000 7ff243d657c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T09:03:32.486 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:32.496+0000 7ff243d657c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T09:03:35.505 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T09:03:35.524 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:03:35.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:35.632+0000 7f00c67a77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T09:03:35.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:35.632+0000 7f00c67a77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T09:03:35.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:35.632+0000 7f00c67a77c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T09:03:35.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:35.632+0000 7f00c67a77c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T09:03:35.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:35.632+0000 7f00c67a77c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T09:03:35.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:35.636+0000 7f00c67a77c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T09:03:38.199 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:38.202 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:38.675 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T09:03:38.695 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:03:38.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:38.803+0000 7fdb37cfd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T09:03:38.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:38.803+0000 7fdb37cfd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T09:03:38.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:38.803+0000 7fdb37cfd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T09:03:38.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:38.803+0000 7fdb37cfd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T09:03:38.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:38.803+0000 7fdb37cfd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T09:03:38.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:38.807+0000 7fdb37cfd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T09:03:41.867 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T09:03:41.888 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T09:03:41.888 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:41.888 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T09:03:41.910 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:41.910 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T09:03:41.972 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:41.972 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T09:03:42.036 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:42.036 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T09:03:42.100 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:42.100 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T09:03:42.167 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:42.167 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T09:03:42.231 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:42.231 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T09:03:42.295 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:42.295 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T09:03:42.316 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:42.316 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T09:03:42.378 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:42.378 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T09:03:42.447 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:42.447 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T09:03:42.510 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:42.510 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T09:03:42.570 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:42.570 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T09:03:42.630 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:42.630 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T09:03:42.694 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:42.694 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T09:03:42.703 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:42.703 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-25T09:03:42.756 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:42.756 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T09:03:42.764 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:42.764 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-25T09:03:42.814 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T09:03:42.814 DEBUG:teuthology.orchestra.run.smithi175:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T09:03:42.817 DEBUG:teuthology.orchestra.run.smithi177:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T09:03:42.862 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.y] 2024-04-25T09:03:42.862 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBOHCpmMLIqIxAAiMo8+3lU0fXNoI6kBrro+Q== 2024-04-25T09:03:42.862 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-04-25T09:03:42.862 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBOHCpm3usiKxAAROh+31LaNyuh2SdeW6pKjQ== 2024-04-25T09:03:42.862 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2024-04-25T09:03:42.862 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBOHCpmk8M3MhAA6aIN33aWvVcvVEFtHL8SWA== 2024-04-25T09:03:42.862 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.0] 2024-04-25T09:03:42.863 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBSHCpm2xftAxAAxs9n8AE2H3HpPHEUZA4Cng== 2024-04-25T09:03:42.863 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.1] 2024-04-25T09:03:42.863 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBVHCpm/OOlDRAAA7zaD8qsqS2TOCKhDFheJw== 2024-04-25T09:03:42.863 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.2] 2024-04-25T09:03:42.863 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBYHCpmy/kmFxAAwCADFI/jMe27gAmyuAJZHQ== 2024-04-25T09:03:42.863 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.3] 2024-04-25T09:03:42.863 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBbHCpm89a7HhAAVTueOuS0/Ksf8SdWK+Nm1g== 2024-04-25T09:03:42.863 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.x] 2024-04-25T09:03:42.863 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBOHCpm5q4gJxAA9zPRlimxM0+Rb5RQkcoxzQ== 2024-04-25T09:03:42.863 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-04-25T09:03:42.863 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBOHCpmYJoRNxAAZfRvDn1aoR0wa2mEKBrr+A== 2024-04-25T09:03:42.863 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2024-04-25T09:03:42.863 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBPHCpmLAHLAhAA+mWUfpb6izHixJa073r9Jw== 2024-04-25T09:03:42.864 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.4] 2024-04-25T09:03:42.864 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBhHCpm5EAtFRAAeADhjja0BOIvxY3RB+n6+A== 2024-04-25T09:03:42.864 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.5] 2024-04-25T09:03:42.864 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBkHCpmrLilHRAA+H8Bejnk49YfaUvl3Nrrhw== 2024-04-25T09:03:42.864 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.6] 2024-04-25T09:03:42.864 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBnHCpm6uDxJRAAX5EwEelnZXwEHnNnv+XQ6A== 2024-04-25T09:03:42.864 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.7] 2024-04-25T09:03:42.864 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBqHCpmwow5MBAA7b/Q9DiPO6Bfldq1+rf+/w== 2024-04-25T09:03:42.864 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2024-04-25T09:03:42.864 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBPHCpmhyCUBhAA8k9xLKIw8R04i6HSJykDfw== 2024-04-25T09:03:42.864 INFO:teuthology.orchestra.run.smithi175.stdout:[client.2] 2024-04-25T09:03:42.864 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBPHCpm0xaSDBAAup34GS3pnMwjksVuuUGOkw== 2024-04-25T09:03:42.865 INFO:teuthology.orchestra.run.smithi175.stdout:[client.1] 2024-04-25T09:03:42.865 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBPHCpmQigrEBAAoWfP1ZEosbLELev5z+C9/g== 2024-04-25T09:03:42.865 INFO:teuthology.orchestra.run.smithi175.stdout:[client.3] 2024-04-25T09:03:42.865 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBPHCpm6+doFhAAA18OgwfM8gXgQ6g0KUo7Hw== 2024-04-25T09:03:42.876 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.y] 2024-04-25T09:03:42.876 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBOHCpmMLIqIxAAiMo8+3lU0fXNoI6kBrro+Q== 2024-04-25T09:03:42.876 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2024-04-25T09:03:42.876 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBOHCpm3usiKxAAROh+31LaNyuh2SdeW6pKjQ== 2024-04-25T09:03:42.876 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2024-04-25T09:03:42.876 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBOHCpmk8M3MhAA6aIN33aWvVcvVEFtHL8SWA== 2024-04-25T09:03:42.877 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.0] 2024-04-25T09:03:42.877 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBSHCpm2xftAxAAxs9n8AE2H3HpPHEUZA4Cng== 2024-04-25T09:03:42.877 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.1] 2024-04-25T09:03:42.877 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBVHCpm/OOlDRAAA7zaD8qsqS2TOCKhDFheJw== 2024-04-25T09:03:42.877 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.2] 2024-04-25T09:03:42.877 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBYHCpmy/kmFxAAwCADFI/jMe27gAmyuAJZHQ== 2024-04-25T09:03:42.877 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.3] 2024-04-25T09:03:42.877 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBbHCpm89a7HhAAVTueOuS0/Ksf8SdWK+Nm1g== 2024-04-25T09:03:42.877 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.x] 2024-04-25T09:03:42.877 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBOHCpm5q4gJxAA9zPRlimxM0+Rb5RQkcoxzQ== 2024-04-25T09:03:42.877 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2024-04-25T09:03:42.877 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBOHCpmYJoRNxAAZfRvDn1aoR0wa2mEKBrr+A== 2024-04-25T09:03:42.877 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2024-04-25T09:03:42.877 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBPHCpmLAHLAhAA+mWUfpb6izHixJa073r9Jw== 2024-04-25T09:03:42.878 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.4] 2024-04-25T09:03:42.878 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBhHCpm5EAtFRAAeADhjja0BOIvxY3RB+n6+A== 2024-04-25T09:03:42.878 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.5] 2024-04-25T09:03:42.878 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBkHCpmrLilHRAA+H8Bejnk49YfaUvl3Nrrhw== 2024-04-25T09:03:42.878 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.6] 2024-04-25T09:03:42.878 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBnHCpm6uDxJRAAX5EwEelnZXwEHnNnv+XQ6A== 2024-04-25T09:03:42.878 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.7] 2024-04-25T09:03:42.878 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBqHCpmwow5MBAA7b/Q9DiPO6Bfldq1+rf+/w== 2024-04-25T09:03:42.878 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2024-04-25T09:03:42.878 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBPHCpmhyCUBhAA8k9xLKIw8R04i6HSJykDfw== 2024-04-25T09:03:42.878 INFO:teuthology.orchestra.run.smithi177.stdout:[client.2] 2024-04-25T09:03:42.878 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBPHCpm0xaSDBAAup34GS3pnMwjksVuuUGOkw== 2024-04-25T09:03:42.878 INFO:teuthology.orchestra.run.smithi177.stdout:[client.1] 2024-04-25T09:03:42.878 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBPHCpmQigrEBAAoWfP1ZEosbLELev5z+C9/g== 2024-04-25T09:03:42.879 INFO:teuthology.orchestra.run.smithi177.stdout:[client.3] 2024-04-25T09:03:42.879 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBPHCpm6+doFhAAA18OgwfM8gXgQ6g0KUo7Hw== 2024-04-25T09:03:42.880 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T09:03:42.910 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T09:03:42.978 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:03:42.982 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:03:43.039 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:03:43.042 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:03:43.098 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:03:43.101 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:03:43.153 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:03:43.156 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:03:43.209 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:03:43.212 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:03:43.264 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:03:43.267 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:03:43.319 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T09:03:43.323 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T09:03:43.374 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:03:43.377 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:03:43.432 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:03:43.435 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:03:43.492 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:03:43.496 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:03:43.549 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:03:43.552 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:03:43.604 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:03:43.608 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:03:43.660 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:03:43.663 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:03:43.717 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:03:43.721 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:03:43.776 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:03:43.779 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:03:43.835 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:03:43.839 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:03:43.895 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:03:43.898 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:03:43.954 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T09:03:43.954 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T09:03:43.974 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T09:03:44.081 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T09:03:44.100 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T09:03:44.120 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T09:03:44.231 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T09:03:44.250 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T09:03:44.316 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T09:03:44.424 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T09:03:44.443 DEBUG:teuthology.orchestra.run.smithi175:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:03:44.446 DEBUG:teuthology.orchestra.run.smithi177:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:03:44.494 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T09:03:44.494 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T09:03:44.494 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T09:03:44.498 INFO:tasks.ceph.mon.a:Started 2024-04-25T09:03:44.498 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T09:03:44.498 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T09:03:44.537 INFO:tasks.ceph.mon.b:Started 2024-04-25T09:03:44.537 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T09:03:44.537 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T09:03:44.540 INFO:tasks.ceph.mon.c:Started 2024-04-25T09:03:44.540 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T09:03:44.541 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T09:03:44.541 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T09:03:44.544 INFO:tasks.ceph.mgr.y:Started 2024-04-25T09:03:44.544 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T09:03:44.544 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T09:03:44.547 INFO:tasks.ceph.mgr.x:Started 2024-04-25T09:03:44.547 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T09:03:44.547 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T09:03:44.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85de00640 1 Processor -- start 2024-04-25T09:03:44.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85de00640 1 -- start start 2024-04-25T09:03:44.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85de00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff85815da60 0x7ff8580b1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85de00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff8580d03e0 0x7ff85806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85de00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8580b26e0 con 0x7ff85815de40 2024-04-25T09:03:44.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85de00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff85806c320 con 0x7ff8580d03e0 2024-04-25T09:03:44.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85de00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8580b0ed0 con 0x7ff85815da60 2024-04-25T09:03:44.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85d400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff8580d03e0 0x7ff85806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85ca00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff85815da60 0x7ff8580b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85ca00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff85815da60 0x7ff8580b1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:49508/0 (socket says 172.21.15.175:49508) 2024-04-25T09:03:44.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85ca00640 1 -- 172.21.15.175:0/594384874 learned_addr learned my addr 172.21.15.175:0/594384874 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:03:44.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff857e00640 1 --1- 172.21.15.175:0/594384874 >> v1:172.21.15.177:6789/0 conn(0x7ff85815de40 0x7ff8580cfcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:44362/0 (socket says 172.21.15.175:44362) 2024-04-25T09:03:44.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85ca00640 1 -- 172.21.15.175:0/594384874 >> v2:172.21.15.177:3300/0 conn(0x7ff85815da60 msgr2=0x7ff8580b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T09:03:44.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85ca00640 1 -- 172.21.15.175:0/594384874 >> v2:172.21.15.177:3300/0 conn(0x7ff85815da60 msgr2=0x7ff8580b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:03:44.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85d400640 1 -- 172.21.15.175:0/594384874 >> v2:172.21.15.175:3300/0 conn(0x7ff8580d03e0 msgr2=0x7ff85806ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T09:03:44.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85ca00640 1 --2- 172.21.15.175:0/594384874 >> v2:172.21.15.177:3300/0 conn(0x7ff85815da60 0x7ff8580b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:03:44.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85d400640 1 -- 172.21.15.175:0/594384874 >> v2:172.21.15.175:3300/0 conn(0x7ff8580d03e0 msgr2=0x7ff85806ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:03:44.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85d400640 1 --2- 172.21.15.175:0/594384874 >> v2:172.21.15.175:3300/0 conn(0x7ff8580d03e0 0x7ff85806ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:03:44.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85ca00640 1 --2- 172.21.15.175:0/594384874 >> v2:172.21.15.177:3300/0 conn(0x7ff85815da60 0x7ff8580b1380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T09:03:44.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.697+0000 7ff85d400640 1 --2- 172.21.15.175:0/594384874 >> v2:172.21.15.175:3300/0 conn(0x7ff8580d03e0 0x7ff85806ca30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T09:03:44.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.865+0000 7ff857400640 1 -- 172.21.15.175:0/594384874 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574640490 0 0) 0x7ff8580b26e0 con 0x7ff85815de40 2024-04-25T09:03:44.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.865+0000 7ff857400640 1 -- 172.21.15.175:0/594384874 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff840003530 con 0x7ff85815de40 2024-04-25T09:03:44.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff857400640 1 -- 172.21.15.175:0/594384874 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3493213945 0 0) 0x7ff840003530 con 0x7ff85815de40 2024-04-25T09:03:44.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff857400640 1 -- 172.21.15.175:0/594384874 >> v2:172.21.15.177:3300/0 conn(0x7ff85815da60 msgr2=0x7ff8580b1380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T09:03:44.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff857400640 1 --2- 172.21.15.175:0/594384874 >> v2:172.21.15.177:3300/0 conn(0x7ff85815da60 0x7ff8580b1380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff857400640 1 -- 172.21.15.175:0/594384874 >> v2:172.21.15.175:3300/0 conn(0x7ff8580d03e0 msgr2=0x7ff85806ca30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T09:03:44.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff857400640 1 --2- 172.21.15.175:0/594384874 >> v2:172.21.15.175:3300/0 conn(0x7ff8580d03e0 0x7ff85806ca30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff857400640 1 -- 172.21.15.175:0/594384874 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85806c550 con 0x7ff85815de40 2024-04-25T09:03:44.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff857400640 1 -- 172.21.15.175:0/594384874 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7ff844001680 con 0x7ff85815de40 2024-04-25T09:03:44.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff857400640 1 -- 172.21.15.175:0/594384874 >> v1:172.21.15.177:6789/0 conn(0x7ff85815de40 legacy=0x7ff8580cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff857400640 1 --2- 172.21.15.175:0/594384874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff840003a10 0x7ff840003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff857400640 1 --2- 172.21.15.175:0/594384874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff840004810 0x7ff840004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff857400640 1 --2- 172.21.15.175:0/594384874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8400051d0 0x7ff84000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff857400640 1 -- 172.21.15.175:0/594384874 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580b0ed0 con 0x7ff8400051d0 2024-04-25T09:03:44.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff857400640 1 -- 172.21.15.175:0/594384874 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84000c0a0 con 0x7ff840004810 2024-04-25T09:03:44.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff857400640 1 -- 172.21.15.175:0/594384874 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84000c2a0 con 0x7ff840003a10 2024-04-25T09:03:44.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff85d400640 1 --2- 172.21.15.175:0/594384874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8400051d0 0x7ff84000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff857e00640 1 --2- 172.21.15.175:0/594384874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff840004810 0x7ff840004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff85ca00640 1 --2- 172.21.15.175:0/594384874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff840003a10 0x7ff840003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff85d400640 1 -- 172.21.15.175:0/594384874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff840003a10 msgr2=0x7ff840003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:44.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff85d400640 1 --2- 172.21.15.175:0/594384874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff840003a10 0x7ff840003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff85d400640 1 -- 172.21.15.175:0/594384874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff840004810 msgr2=0x7ff840004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:44.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff85d400640 1 --2- 172.21.15.175:0/594384874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff840004810 0x7ff840004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.869+0000 7ff85d400640 1 -- 172.21.15.175:0/594384874 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff840003530 con 0x7ff8400051d0 2024-04-25T09:03:44.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.873+0000 7ff85d400640 1 -- 172.21.15.175:0/594384874 reap_dead start 2024-04-25T09:03:44.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.873+0000 7ff85d400640 1 --2- 172.21.15.175:0/594384874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8400051d0 0x7ff84000b9d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff850009fd0 tx=0x7ff85001ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0809a2654120b76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:44.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.873+0000 7ff857400640 1 -- 172.21.15.175:0/594384874 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff850009bd0 con 0x7ff8400051d0 2024-04-25T09:03:44.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.873+0000 7ff857400640 1 -- 172.21.15.175:0/594384874 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8500a5d60 con 0x7ff8400051d0 2024-04-25T09:03:44.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.873+0000 7ff857400640 1 -- 172.21.15.175:0/594384874 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8500ad630 con 0x7ff8400051d0 2024-04-25T09:03:44.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.873+0000 7ff85de00640 1 -- 172.21.15.175:0/594384874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8400051d0 msgr2=0x7ff84000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.873+0000 7ff85de00640 1 --2- 172.21.15.175:0/594384874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8400051d0 0x7ff84000b9d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff850009fd0 tx=0x7ff85001ce40 comp rx=0 tx=0).stop 2024-04-25T09:03:44.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.873+0000 7ff85de00640 1 -- 172.21.15.175:0/594384874 shutdown_connections 2024-04-25T09:03:44.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.873+0000 7ff85de00640 1 --2- 172.21.15.175:0/594384874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8400051d0 0x7ff84000b9d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.873+0000 7ff85de00640 1 -- 172.21.15.175:0/594384874 >> 172.21.15.175:0/594384874 conn(0x7ff8580d16f0 msgr2=0x7ff8580d1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:44.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.873+0000 7ff85de00640 1 -- 172.21.15.175:0/594384874 shutdown_connections 2024-04-25T09:03:44.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.873+0000 7ff85de00640 1 -- 172.21.15.175:0/594384874 wait complete. 2024-04-25T09:03:44.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85de00640 1 Processor -- start 2024-04-25T09:03:44.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85de00640 1 -- start start 2024-04-25T09:03:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8400051d0 0x7ff8581481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85de00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8580b6b90 0x7ff8581f6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85de00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff858145750 0x7ff858145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85de00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580cfcd0 con 0x7ff8400051d0 2024-04-25T09:03:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85de00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580b2400 con 0x7ff8580b6b90 2024-04-25T09:03:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85de00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580cfe50 con 0x7ff858145750 2024-04-25T09:03:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85ca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8400051d0 0x7ff8581481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85ca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8400051d0 0x7ff8581481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:56696/0 (socket says 172.21.15.175:56696) 2024-04-25T09:03:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85ca00640 1 -- 172.21.15.175:0/3158989049 learned_addr learned my addr 172.21.15.175:0/3158989049 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:03:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85d400640 1 --2- 172.21.15.175:0/3158989049 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff858145750 0x7ff858145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff857e00640 1 --2- 172.21.15.175:0/3158989049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8580b6b90 0x7ff8581f6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85ca00640 1 -- 172.21.15.175:0/3158989049 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff858145750 msgr2=0x7ff858145bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85ca00640 1 --2- 172.21.15.175:0/3158989049 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff858145750 0x7ff858145bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85ca00640 1 -- 172.21.15.175:0/3158989049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8580b6b90 msgr2=0x7ff8581f6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85ca00640 1 --2- 172.21.15.175:0/3158989049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8580b6b90 0x7ff8581f6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85ca00640 1 -- 172.21.15.175:0/3158989049 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8580c85d0 con 0x7ff8400051d0 2024-04-25T09:03:44.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff857e00640 1 --2- 172.21.15.175:0/3158989049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8580b6b90 0x7ff8581f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:44.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85ca00640 1 --2- 172.21.15.175:0/3158989049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8400051d0 0x7ff8581481f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff84c010860 tx=0x7ff84c010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:44.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff854c00640 1 -- 172.21.15.175:0/3158989049 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c01a030 con 0x7ff8400051d0 2024-04-25T09:03:44.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff854c00640 1 -- 172.21.15.175:0/3158989049 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84c010e50 con 0x7ff8400051d0 2024-04-25T09:03:44.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85de00640 1 -- 172.21.15.175:0/3158989049 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff858148730 con 0x7ff8400051d0 2024-04-25T09:03:44.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff854c00640 1 -- 172.21.15.175:0/3158989049 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c00f040 con 0x7ff8400051d0 2024-04-25T09:03:44.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff85de00640 1 -- 172.21.15.175:0/3158989049 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8580c6da0 con 0x7ff8400051d0 2024-04-25T09:03:44.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.877+0000 7ff854c00640 1 -- 172.21.15.175:0/3158989049 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ff84c01d070 con 0x7ff8400051d0 2024-04-25T09:03:44.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.881+0000 7ff854c00640 1 -- 172.21.15.175:0/3158989049 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff84c015470 con 0x7ff8400051d0 2024-04-25T09:03:44.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.881+0000 7ff85de00640 1 -- 172.21.15.175:0/3158989049 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff858074a60 con 0x7ff8400051d0 2024-04-25T09:03:44.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.889+0000 7ff854c00640 1 -- 172.21.15.175:0/3158989049 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7ff858148730 con 0x7ff8400051d0 2024-04-25T09:03:44.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.949+0000 7ff85de00640 1 -- 172.21.15.175:0/3158989049 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff8580c74c0 con 0x7ff8400051d0 2024-04-25T09:03:44.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.949+0000 7ff854c00640 1 -- 172.21.15.175:0/3158989049 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff84c0156c0 con 0x7ff8400051d0 2024-04-25T09:03:44.939 INFO:teuthology.orchestra.run.smithi175.stderr:adjusted tunables profile to default 2024-04-25T09:03:44.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.953+0000 7ff85de00640 1 -- 172.21.15.175:0/3158989049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8400051d0 msgr2=0x7ff8581481f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:44.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.953+0000 7ff85de00640 1 --2- 172.21.15.175:0/3158989049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8400051d0 0x7ff8581481f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff84c010860 tx=0x7ff84c010d20 comp rx=0 tx=0).stop 2024-04-25T09:03:44.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.953+0000 7ff85de00640 1 -- 172.21.15.175:0/3158989049 shutdown_connections 2024-04-25T09:03:44.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.953+0000 7ff85de00640 1 --2- 172.21.15.175:0/3158989049 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff858145750 0x7ff858145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.953+0000 7ff85de00640 1 --2- 172.21.15.175:0/3158989049 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8580b6b90 0x7ff8581f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.953+0000 7ff85de00640 1 --2- 172.21.15.175:0/3158989049 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8400051d0 0x7ff8581481f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:44.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.953+0000 7ff85de00640 1 -- 172.21.15.175:0/3158989049 >> 172.21.15.175:0/3158989049 conn(0x7ff8580d16f0 msgr2=0x7ff85806cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:44.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.953+0000 7ff85de00640 1 -- 172.21.15.175:0/3158989049 shutdown_connections 2024-04-25T09:03:44.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:44.953+0000 7ff85de00640 1 -- 172.21.15.175:0/3158989049 wait complete. 2024-04-25T09:03:44.959 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T09:03:44.959 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T09:03:44.960 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:44.960 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T09:03:44.979 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:44.979 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T09:03:45.042 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:45.042 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T09:03:45.065 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:45.077+0000 7ff933c76180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T09:03:45.073 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:45.083+0000 7f466ac8d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T09:03:45.084 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:03:45.084 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T09:03:45.151 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:45.151 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T09:03:45.170 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:45.171 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T09:03:45.233 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:45.233 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T09:03:45.293 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:03:45.294 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T09:03:45.353 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 0745fb32-c2e9-448d-bdad-37261e394426 0 2024-04-25T09:03:45.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.539+0000 7ff3bc200640 1 Processor -- start 2024-04-25T09:03:45.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.539+0000 7ff3bc200640 1 -- start start 2024-04-25T09:03:45.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.539+0000 7ff3bc200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff3b415ddb0 0x7ff3b409a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.539+0000 7ff3bc200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b40cfe40 con 0x7ff3b40d0c00 2024-04-25T09:03:45.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.539+0000 7ff3bc200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b40d0120 con 0x7ff3b406bd60 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.539+0000 7ff3bc200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b409aa50 con 0x7ff3b415ddb0 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.539+0000 7ff3b9800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff3b415ddb0 0x7ff3b409a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.539+0000 7ff3b9800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff3b415ddb0 0x7ff3b409a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:60504/0 (socket says 172.21.15.177:60504) 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.539+0000 7ff3b9800640 1 -- 172.21.15.177:0/1064652518 learned_addr learned my addr 172.21.15.177:0/1064652518 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.543+0000 7ff3b9800640 1 -- 172.21.15.177:0/1064652518 >> v1:172.21.15.177:6789/0 conn(0x7ff3b406bd60 legacy=0x7ff3b40cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.543+0000 7ff3b9800640 1 -- 172.21.15.177:0/1064652518 >> v1:172.21.15.175:6789/0 conn(0x7ff3b40d0c00 legacy=0x7ff3b406c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.543+0000 7ff3b9800640 1 -- 172.21.15.177:0/1064652518 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b40d0400 con 0x7ff3b415ddb0 2024-04-25T09:03:45.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.543+0000 7ff3b3e00640 1 -- 172.21.15.177:0/1064652518 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171079599 0 0) 0x7ff3b40d0120 con 0x7ff3b406bd60 2024-04-25T09:03:45.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.543+0000 7ff3b9800640 1 --2- 172.21.15.177:0/1064652518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b415ddb0 0x7ff3b409a510 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009870 tx=0x7ff3a801c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4b50d40422257e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.543+0000 7ff3b3e00640 1 -- 172.21.15.177:0/1064652518 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a80b2070 con 0x7ff3b415ddb0 2024-04-25T09:03:45.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.543+0000 7ff3b3e00640 1 -- 172.21.15.177:0/1064652518 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a80a9070 con 0x7ff3b415ddb0 2024-04-25T09:03:45.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.543+0000 7ff3b3e00640 1 -- 172.21.15.177:0/1064652518 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a80ad880 con 0x7ff3b415ddb0 2024-04-25T09:03:45.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.543+0000 7ff3bc200640 1 -- 172.21.15.177:0/1064652518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b415ddb0 msgr2=0x7ff3b409a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.543+0000 7ff3bc200640 1 --2- 172.21.15.177:0/1064652518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b415ddb0 0x7ff3b409a510 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009870 tx=0x7ff3a801c560 comp rx=0 tx=0).stop 2024-04-25T09:03:45.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3bc200640 1 -- 172.21.15.177:0/1064652518 shutdown_connections 2024-04-25T09:03:45.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3bc200640 1 --2- 172.21.15.177:0/1064652518 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b415ddb0 0x7ff3b409a510 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3bc200640 1 -- 172.21.15.177:0/1064652518 >> 172.21.15.177:0/1064652518 conn(0x7ff3b40b33c0 msgr2=0x7ff3b40b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:45.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3bc200640 1 -- 172.21.15.177:0/1064652518 shutdown_connections 2024-04-25T09:03:45.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3bc200640 1 -- 172.21.15.177:0/1064652518 wait complete. 2024-04-25T09:03:45.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3bc200640 1 Processor -- start 2024-04-25T09:03:45.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3bc200640 1 -- start start 2024-04-25T09:03:45.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3bc200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3b406bd60 0x7ff3b415d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3bc200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3b40d0c00 0x7ff3b41563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3bc200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b415ddb0 0x7ff3b414c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3bc200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b40d0770 con 0x7ff3b406bd60 2024-04-25T09:03:45.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3bc200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b406cd80 con 0x7ff3b415ddb0 2024-04-25T09:03:45.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3bc200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b40d1010 con 0x7ff3b40d0c00 2024-04-25T09:03:45.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3b8e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3b40d0c00 0x7ff3b41563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3ba200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b415ddb0 0x7ff3b414c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3b8e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3b40d0c00 0x7ff3b41563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:36782/0 (socket says 172.21.15.177:36782) 2024-04-25T09:03:45.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3b8e00640 1 -- 172.21.15.177:0/3435772312 learned_addr learned my addr 172.21.15.177:0/3435772312 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-04-25T09:03:45.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3b9800640 1 --2- 172.21.15.177:0/3435772312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3b406bd60 0x7ff3b415d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3b8e00640 1 -- 172.21.15.177:0/3435772312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b415ddb0 msgr2=0x7ff3b414c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3b8e00640 1 --2- 172.21.15.177:0/3435772312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b415ddb0 0x7ff3b414c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3b8e00640 1 -- 172.21.15.177:0/3435772312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3b406bd60 msgr2=0x7ff3b415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3b8e00640 1 --2- 172.21.15.177:0/3435772312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3b406bd60 0x7ff3b415d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3b8e00640 1 -- 172.21.15.177:0/3435772312 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b41568f0 con 0x7ff3b40d0c00 2024-04-25T09:03:45.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3ba200640 1 --2- 172.21.15.177:0/3435772312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b415ddb0 0x7ff3b414c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:45.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.547+0000 7ff3b8e00640 1 --2- 172.21.15.177:0/3435772312 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3b40d0c00 0x7ff3b41563b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000c480 tx=0x7ff3a000c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.551+0000 7ff3b1600640 1 -- 172.21.15.177:0/3435772312 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a0005480 con 0x7ff3b40d0c00 2024-04-25T09:03:45.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.551+0000 7ff3b1600640 1 -- 172.21.15.177:0/3435772312 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a0003600 con 0x7ff3b40d0c00 2024-04-25T09:03:45.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.551+0000 7ff3bc200640 1 -- 172.21.15.177:0/3435772312 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b40afdf0 con 0x7ff3b40d0c00 2024-04-25T09:03:45.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.551+0000 7ff3b1600640 1 -- 172.21.15.177:0/3435772312 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a00039f0 con 0x7ff3b40d0c00 2024-04-25T09:03:45.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.551+0000 7ff3bc200640 1 -- 172.21.15.177:0/3435772312 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b4157150 con 0x7ff3b40d0c00 2024-04-25T09:03:45.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.551+0000 7ff3b1600640 1 -- 172.21.15.177:0/3435772312 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ff3a0003b90 con 0x7ff3b40d0c00 2024-04-25T09:03:45.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.551+0000 7ff3b1600640 1 -- 172.21.15.177:0/3435772312 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff3a0012930 con 0x7ff3b40d0c00 2024-04-25T09:03:45.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.551+0000 7ff3bc200640 1 -- 172.21.15.177:0/3435772312 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b4075160 con 0x7ff3b40d0c00 2024-04-25T09:03:45.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.567+0000 7ff3b1600640 1 -- 172.21.15.177:0/3435772312 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7ff3a0012c00 con 0x7ff3b40d0c00 2024-04-25T09:03:45.562 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:45.573+0000 7ff933c76180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T09:03:45.577 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:45.587+0000 7f466ac8d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T09:03:45.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.635+0000 7ff3bc200640 1 -- 172.21.15.177:0/3435772312 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0745fb32-c2e9-448d-bdad-37261e394426", "id": 0} v 0) v1 -- 0x7ff3b40b3130 con 0x7ff3b40d0c00 2024-04-25T09:03:45.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.639+0000 7ff3b1600640 1 -- 172.21.15.177:0/3435772312 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0745fb32-c2e9-448d-bdad-37261e394426", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff3a001b400 con 0x7ff3b40d0c00 2024-04-25T09:03:45.628 INFO:teuthology.orchestra.run.smithi177.stdout:0 2024-04-25T09:03:45.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.639+0000 7ff3bc200640 1 -- 172.21.15.177:0/3435772312 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3b40d0c00 msgr2=0x7ff3b41563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.639+0000 7ff3bc200640 1 --2- 172.21.15.177:0/3435772312 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3b40d0c00 0x7ff3b41563b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000c480 tx=0x7ff3a000c940 comp rx=0 tx=0).stop 2024-04-25T09:03:45.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.639+0000 7ff3bc200640 1 -- 172.21.15.177:0/3435772312 shutdown_connections 2024-04-25T09:03:45.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.639+0000 7ff3bc200640 1 --2- 172.21.15.177:0/3435772312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3b415ddb0 0x7ff3b414c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.639+0000 7ff3bc200640 1 --2- 172.21.15.177:0/3435772312 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3b40d0c00 0x7ff3b41563b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.639+0000 7ff3bc200640 1 --2- 172.21.15.177:0/3435772312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3b406bd60 0x7ff3b415d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.639+0000 7ff3bc200640 1 -- 172.21.15.177:0/3435772312 >> 172.21.15.177:0/3435772312 conn(0x7ff3b40b33c0 msgr2=0x7ff3b40b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:45.630 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.639+0000 7ff3bc200640 1 -- 172.21.15.177:0/3435772312 shutdown_connections 2024-04-25T09:03:45.630 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.639+0000 7ff3bc200640 1 -- 172.21.15.177:0/3435772312 wait complete. 2024-04-25T09:03:45.648 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 2e55658c-2693-49a6-b05b-589449c3a37a 1 2024-04-25T09:03:45.764 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:45.777+0000 7ff933c76180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T09:03:45.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.791+0000 7f4152600640 1 Processor -- start 2024-04-25T09:03:45.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.791+0000 7f4152600640 1 -- start start 2024-04-25T09:03:45.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.795+0000 7f4152600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f414c15ddb0 0x7f414c09a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.795+0000 7f4152600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f414c0d0c00 0x7f414c0d1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.795+0000 7f4152600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414c0cfe40 con 0x7f414c06bd60 2024-04-25T09:03:45.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.795+0000 7f4152600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414c09aa50 con 0x7f414c0d0c00 2024-04-25T09:03:45.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.795+0000 7f4152600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c0d0770 con 0x7f414c15ddb0 2024-04-25T09:03:45.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.795+0000 7f414b400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f414c15ddb0 0x7f414c09a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.795+0000 7f414be00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f414c0d0c00 0x7f414c0d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.795+0000 7f414b400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f414c15ddb0 0x7f414c09a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:36796/0 (socket says 172.21.15.177:36796) 2024-04-25T09:03:45.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.795+0000 7f414b400640 1 -- 172.21.15.177:0/1224782034 learned_addr learned my addr 172.21.15.177:0/1224782034 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-04-25T09:03:45.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.795+0000 7f414be00640 1 -- 172.21.15.177:0/1224782034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f414c15ddb0 msgr2=0x7f414c09a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:45.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.795+0000 7f414be00640 1 --2- 172.21.15.177:0/1224782034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f414c15ddb0 0x7f414c09a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.795+0000 7f414be00640 1 -- 172.21.15.177:0/1224782034 >> v1:172.21.15.175:6789/0 conn(0x7f414c06bd60 legacy=0x7f414c0cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.795+0000 7f414be00640 1 -- 172.21.15.177:0/1224782034 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c0d0120 con 0x7f414c0d0c00 2024-04-25T09:03:45.790 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.799+0000 7f414be00640 1 --2- 172.21.15.177:0/1224782034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f414c0d0c00 0x7f414c0d1090 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4144009d90 tx=0x7f414401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a1161d78e1943d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.790 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.799+0000 7f414aa00640 1 -- 172.21.15.177:0/1224782034 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41440b2070 con 0x7f414c0d0c00 2024-04-25T09:03:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.799+0000 7f414aa00640 1 -- 172.21.15.177:0/1224782034 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41440a5830 con 0x7f414c0d0c00 2024-04-25T09:03:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.799+0000 7f414aa00640 1 -- 172.21.15.177:0/1224782034 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41440a5c00 con 0x7f414c0d0c00 2024-04-25T09:03:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.799+0000 7f4152600640 1 -- 172.21.15.177:0/1224782034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f414c0d0c00 msgr2=0x7f414c0d1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.799+0000 7f4152600640 1 --2- 172.21.15.177:0/1224782034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f414c0d0c00 0x7f414c0d1090 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4144009d90 tx=0x7f414401c970 comp rx=0 tx=0).stop 2024-04-25T09:03:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.799+0000 7f4152600640 1 -- 172.21.15.177:0/1224782034 shutdown_connections 2024-04-25T09:03:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.799+0000 7f4152600640 1 --2- 172.21.15.177:0/1224782034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f414c0d0c00 0x7f414c0d1090 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.799+0000 7f4152600640 1 --2- 172.21.15.177:0/1224782034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f414c15ddb0 0x7f414c09a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.799+0000 7f4152600640 1 -- 172.21.15.177:0/1224782034 >> 172.21.15.177:0/1224782034 conn(0x7f414c0b33c0 msgr2=0x7f414c0b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.799+0000 7f4152600640 1 -- 172.21.15.177:0/1224782034 shutdown_connections 2024-04-25T09:03:45.791 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.799+0000 7f4152600640 1 -- 172.21.15.177:0/1224782034 wait complete. 2024-04-25T09:03:45.792 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4152600640 1 Processor -- start 2024-04-25T09:03:45.792 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4152600640 1 -- start start 2024-04-25T09:03:45.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4152600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f414c06bd60 0x7f414c0ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4152600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f414c0d0c00 0x7f414c15e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4152600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f414c15ddb0 0x7f414c158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:45.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4152600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c16acf0 con 0x7f414c15ddb0 2024-04-25T09:03:45.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4152600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414c16ab70 con 0x7f414c06bd60 2024-04-25T09:03:45.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4152600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414c16ae70 con 0x7f414c0d0c00 2024-04-25T09:03:45.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f414b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f414c06bd60 0x7f414c0ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4143e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f414c0d0c00 0x7f414c15e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f414b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f414c06bd60 0x7f414c0ceed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:60534/0 (socket says 172.21.15.177:60534) 2024-04-25T09:03:45.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f414b400640 1 -- 172.21.15.177:0/1950017152 learned_addr learned my addr 172.21.15.177:0/1950017152 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-04-25T09:03:45.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f414be00640 1 --2- 172.21.15.177:0/1950017152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f414c15ddb0 0x7f414c158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:45.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4143e00640 1 -- 172.21.15.177:0/1950017152 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f414c06bd60 msgr2=0x7f414c0ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4143e00640 1 --2- 172.21.15.177:0/1950017152 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f414c06bd60 0x7f414c0ceed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4143e00640 1 -- 172.21.15.177:0/1950017152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f414c15ddb0 msgr2=0x7f414c158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4143e00640 1 --2- 172.21.15.177:0/1950017152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f414c15ddb0 0x7f414c158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4143e00640 1 -- 172.21.15.177:0/1950017152 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c15e9b0 con 0x7f414c0d0c00 2024-04-25T09:03:45.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f414b400640 1 --2- 172.21.15.177:0/1950017152 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f414c06bd60 0x7f414c0ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:45.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4143e00640 1 --2- 172.21.15.177:0/1950017152 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f414c0d0c00 0x7f414c15e2d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f413400c3c0 tx=0x7f413400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:45.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4143400640 1 -- 172.21.15.177:0/1950017152 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41340052d0 con 0x7f414c0d0c00 2024-04-25T09:03:45.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4143400640 1 -- 172.21.15.177:0/1950017152 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4134005470 con 0x7f414c0d0c00 2024-04-25T09:03:45.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4143400640 1 -- 172.21.15.177:0/1950017152 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4134007260 con 0x7f414c0d0c00 2024-04-25T09:03:45.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4152600640 1 -- 172.21.15.177:0/1950017152 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414c15ec90 con 0x7f414c0d0c00 2024-04-25T09:03:45.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4152600640 1 -- 172.21.15.177:0/1950017152 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414c15f250 con 0x7f414c0d0c00 2024-04-25T09:03:45.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4143400640 1 -- 172.21.15.177:0/1950017152 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f4134007400 con 0x7f414c0d0c00 2024-04-25T09:03:45.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.803+0000 7f4143400640 1 -- 172.21.15.177:0/1950017152 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f4134003ae0 con 0x7f414c0d0c00 2024-04-25T09:03:45.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.807+0000 7f4152600640 1 -- 172.21.15.177:0/1950017152 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414c075160 con 0x7f414c0d0c00 2024-04-25T09:03:45.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.807+0000 7f4143400640 1 -- 172.21.15.177:0/1950017152 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f4134003600 con 0x7f414c0d0c00 2024-04-25T09:03:45.805 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:45.815+0000 7f466ac8d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T09:03:45.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.875+0000 7f4152600640 1 -- 172.21.15.177:0/1950017152 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2e55658c-2693-49a6-b05b-589449c3a37a", "id": 1} v 0) v1 -- 0x7f414c09a040 con 0x7f414c0d0c00 2024-04-25T09:03:45.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.883+0000 7f4143400640 1 -- 172.21.15.177:0/1950017152 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2e55658c-2693-49a6-b05b-589449c3a37a", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4134003ce0 con 0x7f414c0d0c00 2024-04-25T09:03:45.872 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-04-25T09:03:45.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.883+0000 7f4152600640 1 -- 172.21.15.177:0/1950017152 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f414c0d0c00 msgr2=0x7f414c15e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:45.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.883+0000 7f4152600640 1 --2- 172.21.15.177:0/1950017152 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f414c0d0c00 0x7f414c15e2d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f413400c3c0 tx=0x7f413400c880 comp rx=0 tx=0).stop 2024-04-25T09:03:45.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.883+0000 7f4152600640 1 -- 172.21.15.177:0/1950017152 shutdown_connections 2024-04-25T09:03:45.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.883+0000 7f4152600640 1 --2- 172.21.15.177:0/1950017152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f414c15ddb0 0x7f414c158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.883+0000 7f4152600640 1 --2- 172.21.15.177:0/1950017152 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f414c0d0c00 0x7f414c15e2d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.883+0000 7f4152600640 1 --2- 172.21.15.177:0/1950017152 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f414c06bd60 0x7f414c0ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:45.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.883+0000 7f4152600640 1 -- 172.21.15.177:0/1950017152 >> 172.21.15.177:0/1950017152 conn(0x7f414c0b33c0 msgr2=0x7f414c0700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:45.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.883+0000 7f4152600640 1 -- 172.21.15.177:0/1950017152 shutdown_connections 2024-04-25T09:03:45.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:45.883+0000 7f4152600640 1 -- 172.21.15.177:0/1950017152 wait complete. 2024-04-25T09:03:45.892 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 6a9d68da-55da-412f-9054-627d879d9686 2 2024-04-25T09:03:46.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.035+0000 7fbb7b200640 1 Processor -- start 2024-04-25T09:03:46.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.035+0000 7fbb7b200640 1 -- start start 2024-04-25T09:03:46.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.039+0000 7fbb7b200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbb7415da10 0x7fbb7406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.039+0000 7fbb7b200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb740ade90 0x7fbb740ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.039+0000 7fbb7b200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbb7406bc60 0x7fbb7406c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.039+0000 7fbb7b200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb740b2db0 con 0x7fbb7406bc60 2024-04-25T09:03:46.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.039+0000 7fbb7b200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb740b3070 con 0x7fbb7415da10 2024-04-25T09:03:46.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.039+0000 7fbb7b200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb740b3350 con 0x7fbb740ade90 2024-04-25T09:03:46.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.039+0000 7fbb6be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb740ade90 0x7fbb740ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.039+0000 7fbb73e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbb7415da10 0x7fbb7406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.039+0000 7fbb6be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb740ade90 0x7fbb740ae2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:36814/0 (socket says 172.21.15.177:36814) 2024-04-25T09:03:46.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.039+0000 7fbb6be00640 1 -- 172.21.15.177:0/4279420146 learned_addr learned my addr 172.21.15.177:0/4279420146 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-04-25T09:03:46.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.039+0000 7fbb79200640 1 --2- 172.21.15.177:0/4279420146 >> v2:172.21.15.175:3300/0 conn(0x7fbb7406bc60 0x7fbb7406c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.039+0000 7fbb6be00640 1 -- 172.21.15.177:0/4279420146 >> v2:172.21.15.177:3300/0 conn(0x7fbb7415da10 msgr2=0x7fbb7406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:46.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.039+0000 7fbb6be00640 1 --2- 172.21.15.177:0/4279420146 >> v2:172.21.15.177:3300/0 conn(0x7fbb7415da10 0x7fbb7406db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.039+0000 7fbb6be00640 1 -- 172.21.15.177:0/4279420146 >> v2:172.21.15.175:3300/0 conn(0x7fbb7406bc60 msgr2=0x7fbb7406c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:46.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.039+0000 7fbb6be00640 1 --2- 172.21.15.177:0/4279420146 >> v2:172.21.15.175:3300/0 conn(0x7fbb7406bc60 0x7fbb7406c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.039+0000 7fbb6be00640 1 -- 172.21.15.177:0/4279420146 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb740b3630 con 0x7fbb740ade90 2024-04-25T09:03:46.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.039+0000 7fbb6be00640 1 --2- 172.21.15.177:0/4279420146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb740ade90 0x7fbb740ae2f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbb74067520 tx=0x7fbb5c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44b0c213ce696131 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb73400640 1 -- 172.21.15.177:0/4279420146 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c0b0070 con 0x7fbb740ade90 2024-04-25T09:03:46.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb73400640 1 -- 172.21.15.177:0/4279420146 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5c0ab600 con 0x7fbb740ade90 2024-04-25T09:03:46.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb73400640 1 -- 172.21.15.177:0/4279420146 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c0ab9d0 con 0x7fbb740ade90 2024-04-25T09:03:46.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb7b200640 1 -- 172.21.15.177:0/4279420146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb740ade90 msgr2=0x7fbb740ae2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb7b200640 1 --2- 172.21.15.177:0/4279420146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb740ade90 0x7fbb740ae2f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbb74067520 tx=0x7fbb5c01c490 comp rx=0 tx=0).stop 2024-04-25T09:03:46.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb7b200640 1 -- 172.21.15.177:0/4279420146 shutdown_connections 2024-04-25T09:03:46.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb7b200640 1 --2- 172.21.15.177:0/4279420146 >> v2:172.21.15.175:3300/0 conn(0x7fbb7406bc60 0x7fbb7406c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb7b200640 1 --2- 172.21.15.177:0/4279420146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb740ade90 0x7fbb740ae2f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb7b200640 1 --2- 172.21.15.177:0/4279420146 >> v2:172.21.15.177:3300/0 conn(0x7fbb7415da10 0x7fbb7406db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb7b200640 1 -- 172.21.15.177:0/4279420146 >> 172.21.15.177:0/4279420146 conn(0x7fbb74071b70 msgr2=0x7fbb74071f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb7b200640 1 -- 172.21.15.177:0/4279420146 shutdown_connections 2024-04-25T09:03:46.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb7b200640 1 -- 172.21.15.177:0/4279420146 wait complete. 2024-04-25T09:03:46.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb7b200640 1 Processor -- start 2024-04-25T09:03:46.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb7b200640 1 -- start start 2024-04-25T09:03:46.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb7b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb7406bc60 0x7fbb74151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb7b200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb740ade90 0x7fbb74156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb7b200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb7415da10 0x7fbb74154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb7b200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb740b4920 con 0x7fbb7406bc60 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb7b200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7406e0a0 con 0x7fbb740ade90 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.043+0000 7fbb7b200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb740b4aa0 con 0x7fbb7415da10 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb6be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb740ade90 0x7fbb74156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb79200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb7415da10 0x7fbb74154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb79200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb7415da10 0x7fbb74154450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:36824/0 (socket says 172.21.15.177:36824) 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb79200640 1 -- 172.21.15.177:0/1915912551 learned_addr learned my addr 172.21.15.177:0/1915912551 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb73e00640 1 --2- 172.21.15.177:0/1915912551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb7406bc60 0x7fbb74151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb6be00640 1 -- 172.21.15.177:0/1915912551 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb7415da10 msgr2=0x7fbb74154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb6be00640 1 --2- 172.21.15.177:0/1915912551 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb7415da10 0x7fbb74154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb6be00640 1 -- 172.21.15.177:0/1915912551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb7406bc60 msgr2=0x7fbb74151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb6be00640 1 --2- 172.21.15.177:0/1915912551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb7406bc60 0x7fbb74151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb6be00640 1 -- 172.21.15.177:0/1915912551 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb74070510 con 0x7fbb740ade90 2024-04-25T09:03:46.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb79200640 1 --2- 172.21.15.177:0/1915912551 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb7415da10 0x7fbb74154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:46.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb6be00640 1 --2- 172.21.15.177:0/1915912551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb740ade90 0x7fbb74156dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0a4fd0 tx=0x7fbb5c019230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb70c00640 1 -- 172.21.15.177:0/1915912551 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c0b9070 con 0x7fbb740ade90 2024-04-25T09:03:46.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb70c00640 1 -- 172.21.15.177:0/1915912551 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5c0b4420 con 0x7fbb740ade90 2024-04-25T09:03:46.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb70c00640 1 -- 172.21.15.177:0/1915912551 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c0b0040 con 0x7fbb740ade90 2024-04-25T09:03:46.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb7b200640 1 -- 172.21.15.177:0/1915912551 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb7415a280 con 0x7fbb740ade90 2024-04-25T09:03:46.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb7b200640 1 -- 172.21.15.177:0/1915912551 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb740cd050 con 0x7fbb740ade90 2024-04-25T09:03:46.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb70c00640 1 -- 172.21.15.177:0/1915912551 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fbb5c0b4810 con 0x7fbb740ade90 2024-04-25T09:03:46.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb70c00640 1 -- 172.21.15.177:0/1915912551 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fbb5c0bd3f0 con 0x7fbb740ade90 2024-04-25T09:03:46.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.047+0000 7fbb7b200640 1 -- 172.21.15.177:0/1915912551 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb74075160 con 0x7fbb740ade90 2024-04-25T09:03:46.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.051+0000 7fbb70c00640 1 -- 172.21.15.177:0/1915912551 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fbb5c0c2080 con 0x7fbb740ade90 2024-04-25T09:03:46.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.115+0000 7fbb7b200640 1 -- 172.21.15.177:0/1915912551 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6a9d68da-55da-412f-9054-627d879d9686", "id": 2} v 0) v1 -- 0x7fbb740b0f60 con 0x7fbb740ade90 2024-04-25T09:03:46.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.123+0000 7fbb70c00640 1 -- 172.21.15.177:0/1915912551 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6a9d68da-55da-412f-9054-627d879d9686", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbb7415a280 con 0x7fbb740ade90 2024-04-25T09:03:46.112 INFO:teuthology.orchestra.run.smithi177.stdout:2 2024-04-25T09:03:46.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.123+0000 7fbb7b200640 1 -- 172.21.15.177:0/1915912551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb740ade90 msgr2=0x7fbb74156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.123+0000 7fbb7b200640 1 --2- 172.21.15.177:0/1915912551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb740ade90 0x7fbb74156dd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0a4fd0 tx=0x7fbb5c019230 comp rx=0 tx=0).stop 2024-04-25T09:03:46.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.123+0000 7fbb7b200640 1 -- 172.21.15.177:0/1915912551 shutdown_connections 2024-04-25T09:03:46.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.123+0000 7fbb7b200640 1 --2- 172.21.15.177:0/1915912551 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb7415da10 0x7fbb74154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.123+0000 7fbb7b200640 1 --2- 172.21.15.177:0/1915912551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb740ade90 0x7fbb74156dd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.123+0000 7fbb7b200640 1 --2- 172.21.15.177:0/1915912551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb7406bc60 0x7fbb74151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.123+0000 7fbb7b200640 1 -- 172.21.15.177:0/1915912551 >> 172.21.15.177:0/1915912551 conn(0x7fbb74071b70 msgr2=0x7fbb740acd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.123+0000 7fbb7b200640 1 -- 172.21.15.177:0/1915912551 shutdown_connections 2024-04-25T09:03:46.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.123+0000 7fbb7b200640 1 -- 172.21.15.177:0/1915912551 wait complete. 2024-04-25T09:03:46.132 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 56d615ab-66a8-4730-bd43-25c1d1d76b68 3 2024-04-25T09:03:46.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.279+0000 7f46c9800640 1 Processor -- start 2024-04-25T09:03:46.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.279+0000 7f46c9800640 1 -- start start 2024-04-25T09:03:46.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.279+0000 7f46c9800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f46c40b0db0 0x7f46c4168c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.279+0000 7f46c9800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c40cd280 con 0x7f46c415db40 2024-04-25T09:03:46.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.279+0000 7f46c9800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c40cd560 con 0x7f46c415df20 2024-04-25T09:03:46.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.279+0000 7f46c9800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c40cd840 con 0x7f46c40b0db0 2024-04-25T09:03:46.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.279+0000 7f46c3400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f46c40b0db0 0x7f46c4168c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.279+0000 7f46c3400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f46c40b0db0 0x7f46c4168c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:60574/0 (socket says 172.21.15.177:60574) 2024-04-25T09:03:46.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.279+0000 7f46c3400640 1 -- 172.21.15.177:0/2781229118 learned_addr learned my addr 172.21.15.177:0/2781229118 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-04-25T09:03:46.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.279+0000 7f46c3400640 1 -- 172.21.15.177:0/2781229118 >> v1:172.21.15.177:6789/0 conn(0x7f46c415df20 legacy=0x7f46c40cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.279+0000 7f46c3400640 1 -- 172.21.15.177:0/2781229118 >> v1:172.21.15.175:6789/0 conn(0x7f46c415db40 legacy=0x7f46c40b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.279+0000 7f46c3400640 1 -- 172.21.15.177:0/2781229118 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c40cdb20 con 0x7f46c40b0db0 2024-04-25T09:03:46.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.283+0000 7f46c3400640 1 --2- 172.21.15.177:0/2781229118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c40b0db0 0x7f46c4168c50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009e50 tx=0x7f46bc01c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c1861b8390e17b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.283+0000 7f46c2000640 1 -- 172.21.15.177:0/2781229118 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc0a5660 con 0x7f46c40b0db0 2024-04-25T09:03:46.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.283+0000 7f46c2000640 1 -- 172.21.15.177:0/2781229118 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc0a5800 con 0x7f46c40b0db0 2024-04-25T09:03:46.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.283+0000 7f46c2000640 1 -- 172.21.15.177:0/2781229118 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc0a5bd0 con 0x7f46c40b0db0 2024-04-25T09:03:46.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.283+0000 7f46c9800640 1 -- 172.21.15.177:0/2781229118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c40b0db0 msgr2=0x7f46c4168c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.283+0000 7f46c9800640 1 --2- 172.21.15.177:0/2781229118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c40b0db0 0x7f46c4168c50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009e50 tx=0x7f46bc01c9a0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.283+0000 7f46c9800640 1 -- 172.21.15.177:0/2781229118 shutdown_connections 2024-04-25T09:03:46.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.283+0000 7f46c9800640 1 --2- 172.21.15.177:0/2781229118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c40b0db0 0x7f46c4168c50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.283+0000 7f46c9800640 1 -- 172.21.15.177:0/2781229118 >> 172.21.15.177:0/2781229118 conn(0x7f46c4099a50 msgr2=0x7f46c40d0810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.283+0000 7f46c9800640 1 -- 172.21.15.177:0/2781229118 shutdown_connections 2024-04-25T09:03:46.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.283+0000 7f46c9800640 1 -- 172.21.15.177:0/2781229118 wait complete. 2024-04-25T09:03:46.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46c9800640 1 Processor -- start 2024-04-25T09:03:46.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46c9800640 1 -- start start 2024-04-25T09:03:46.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46c9800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c40b0db0 0x7f46c4141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46c9800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c415db40 0x7f46c40b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46c9800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46c415df20 0x7f46c40b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46c9800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c416bd40 con 0x7f46c415df20 2024-04-25T09:03:46.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46c9800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c416bbc0 con 0x7f46c40b0db0 2024-04-25T09:03:46.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46c9800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c416bec0 con 0x7f46c415db40 2024-04-25T09:03:46.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46c2a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c40b0db0 0x7f46c4141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46bbe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c415db40 0x7f46c40b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46c2a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c40b0db0 0x7f46c4141990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:60588/0 (socket says 172.21.15.177:60588) 2024-04-25T09:03:46.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46c2a00640 1 -- 172.21.15.177:0/3730896830 learned_addr learned my addr 172.21.15.177:0/3730896830 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-04-25T09:03:46.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46bbe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c415db40 0x7f46c40b5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:36826/0 (socket says 172.21.15.177:36826) 2024-04-25T09:03:46.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46c3400640 1 --2- 172.21.15.177:0/3730896830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46c415df20 0x7f46c40b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46c2a00640 1 -- 172.21.15.177:0/3730896830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c415db40 msgr2=0x7f46c40b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46c2a00640 1 --2- 172.21.15.177:0/3730896830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c415db40 0x7f46c40b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46c2a00640 1 -- 172.21.15.177:0/3730896830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46c415df20 msgr2=0x7f46c40b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46c2a00640 1 --2- 172.21.15.177:0/3730896830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46c415df20 0x7f46c40b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46c2a00640 1 -- 172.21.15.177:0/3730896830 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c40c48a0 con 0x7f46c40b0db0 2024-04-25T09:03:46.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46bbe00640 1 --2- 172.21.15.177:0/3730896830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c415db40 0x7f46c40b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:46.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.287+0000 7f46c2a00640 1 --2- 172.21.15.177:0/3730896830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c40b0db0 0x7f46c4141990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f46b400c420 tx=0x7f46b400c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.291+0000 7f46baa00640 1 -- 172.21.15.177:0/3730896830 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b40052d0 con 0x7f46c40b0db0 2024-04-25T09:03:46.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.291+0000 7f46baa00640 1 -- 172.21.15.177:0/3730896830 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b4005470 con 0x7f46c40b0db0 2024-04-25T09:03:46.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.291+0000 7f46baa00640 1 -- 172.21.15.177:0/3730896830 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4007260 con 0x7f46c40b0db0 2024-04-25T09:03:46.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.291+0000 7f46c9800640 1 -- 172.21.15.177:0/3730896830 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c40c4b80 con 0x7f46c40b0db0 2024-04-25T09:03:46.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.291+0000 7f46c9800640 1 -- 172.21.15.177:0/3730896830 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c40c5140 con 0x7f46c40b0db0 2024-04-25T09:03:46.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.291+0000 7f46baa00640 1 -- 172.21.15.177:0/3730896830 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f46b4007400 con 0x7f46c40b0db0 2024-04-25T09:03:46.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.291+0000 7f46baa00640 1 -- 172.21.15.177:0/3730896830 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f46b40067e0 con 0x7f46c40b0db0 2024-04-25T09:03:46.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.291+0000 7f46c9800640 1 -- 172.21.15.177:0/3730896830 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c4075160 con 0x7f46c40b0db0 2024-04-25T09:03:46.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.295+0000 7f46baa00640 1 -- 172.21.15.177:0/3730896830 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f46b4006ab0 con 0x7f46c40b0db0 2024-04-25T09:03:46.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.359+0000 7f46c9800640 1 -- 172.21.15.177:0/3730896830 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "56d615ab-66a8-4730-bd43-25c1d1d76b68", "id": 3} v 0) v1 -- 0x7f46c40d14e0 con 0x7f46c40b0db0 2024-04-25T09:03:46.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.367+0000 7f46baa00640 1 -- 172.21.15.177:0/3730896830 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "56d615ab-66a8-4730-bd43-25c1d1d76b68", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f46b4006d70 con 0x7f46c40b0db0 2024-04-25T09:03:46.357 INFO:teuthology.orchestra.run.smithi177.stdout:3 2024-04-25T09:03:46.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.367+0000 7f46c9800640 1 -- 172.21.15.177:0/3730896830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c40b0db0 msgr2=0x7f46c4141990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.367+0000 7f46c9800640 1 --2- 172.21.15.177:0/3730896830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c40b0db0 0x7f46c4141990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f46b400c420 tx=0x7f46b400c8e0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.367+0000 7f46c9800640 1 -- 172.21.15.177:0/3730896830 shutdown_connections 2024-04-25T09:03:46.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.367+0000 7f46c9800640 1 --2- 172.21.15.177:0/3730896830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46c415df20 0x7f46c40b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.367+0000 7f46c9800640 1 --2- 172.21.15.177:0/3730896830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c415db40 0x7f46c40b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.367+0000 7f46c9800640 1 --2- 172.21.15.177:0/3730896830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c40b0db0 0x7f46c4141990 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.367+0000 7f46c9800640 1 -- 172.21.15.177:0/3730896830 >> 172.21.15.177:0/3730896830 conn(0x7f46c4099a50 msgr2=0x7f46c40b22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.367+0000 7f46c9800640 1 -- 172.21.15.177:0/3730896830 shutdown_connections 2024-04-25T09:03:46.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.367+0000 7f46c9800640 1 -- 172.21.15.177:0/3730896830 wait complete. 2024-04-25T09:03:46.376 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 7900a8ee-9817-4cfe-900d-6cee224d1472 4 2024-04-25T09:03:46.377 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:46.388+0000 7ff933c76180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T09:03:46.438 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:46.448+0000 7ff933c76180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T09:03:46.455 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:46.467+0000 7f466ac8d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T09:03:46.498 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:46.508+0000 7ff933c76180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T09:03:46.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.523+0000 7f9c43600640 1 Processor -- start 2024-04-25T09:03:46.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.523+0000 7f9c43600640 1 -- start start 2024-04-25T09:03:46.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.523+0000 7f9c43600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9c3c1454f0 0x7f9c3c0cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.523+0000 7f9c43600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c3c0cf490 0x7f9c3c0d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.523+0000 7f9c43600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3c0b4430 con 0x7f9c3c0d12a0 2024-04-25T09:03:46.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.523+0000 7f9c43600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c3c0b4940 con 0x7f9c3c1454f0 2024-04-25T09:03:46.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.523+0000 7f9c43600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c0cf8f0 con 0x7f9c3c0cf490 2024-04-25T09:03:46.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.523+0000 7f9c3be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c3c0cf490 0x7f9c3c0d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.523+0000 7f9c41600640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f9c3c0d12a0 0x7f9c3c15f610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:49972/0 (socket says 172.21.15.177:49972) 2024-04-25T09:03:46.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.523+0000 7f9c41600640 1 -- 172.21.15.177:0/3063783383 learned_addr learned my addr 172.21.15.177:0/3063783383 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-04-25T09:03:46.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.523+0000 7f9c40c00640 1 --2- 172.21.15.177:0/3063783383 >> v2:172.21.15.175:3300/0 conn(0x7f9c3c1454f0 0x7f9c3c0cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.523+0000 7f9c3be00640 1 -- 172.21.15.177:0/3063783383 >> v2:172.21.15.175:3300/0 conn(0x7f9c3c1454f0 msgr2=0x7f9c3c0cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:46.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.523+0000 7f9c3be00640 1 --2- 172.21.15.177:0/3063783383 >> v2:172.21.15.175:3300/0 conn(0x7f9c3c1454f0 0x7f9c3c0cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.523+0000 7f9c3be00640 1 -- 172.21.15.177:0/3063783383 >> v1:172.21.15.177:6789/0 conn(0x7f9c3c0d12a0 legacy=0x7f9c3c15f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.523+0000 7f9c3be00640 1 -- 172.21.15.177:0/3063783383 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c070eb0 con 0x7f9c3c0cf490 2024-04-25T09:03:46.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.523+0000 7f9c3b400640 1 -- 172.21.15.177:0/3063783383 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891668651 0 0) 0x7f9c3c0b4430 con 0x7f9c3c0d12a0 2024-04-25T09:03:46.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.527+0000 7f9c3be00640 1 --2- 172.21.15.177:0/3063783383 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c3c0cf490 0x7f9c3c0d0d60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9c280097c0 tx=0x7f9c2801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50000fe328271946 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.527+0000 7f9c3b400640 1 -- 172.21.15.177:0/3063783383 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c280a7070 con 0x7f9c3c0cf490 2024-04-25T09:03:46.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.527+0000 7f9c3b400640 1 -- 172.21.15.177:0/3063783383 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c280b0070 con 0x7f9c3c0cf490 2024-04-25T09:03:46.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.527+0000 7f9c3b400640 1 -- 172.21.15.177:0/3063783383 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c280ab890 con 0x7f9c3c0cf490 2024-04-25T09:03:46.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.527+0000 7f9c43600640 1 -- 172.21.15.177:0/3063783383 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c3c0cf490 msgr2=0x7f9c3c0d0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.527+0000 7f9c43600640 1 --2- 172.21.15.177:0/3063783383 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c3c0cf490 0x7f9c3c0d0d60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9c280097c0 tx=0x7f9c2801c470 comp rx=0 tx=0).stop 2024-04-25T09:03:46.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.527+0000 7f9c43600640 1 -- 172.21.15.177:0/3063783383 shutdown_connections 2024-04-25T09:03:46.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.527+0000 7f9c43600640 1 --2- 172.21.15.177:0/3063783383 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c3c0cf490 0x7f9c3c0d0d60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.527+0000 7f9c43600640 1 --2- 172.21.15.177:0/3063783383 >> v2:172.21.15.175:3300/0 conn(0x7f9c3c1454f0 0x7f9c3c0cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.518 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.527+0000 7f9c43600640 1 -- 172.21.15.177:0/3063783383 >> 172.21.15.177:0/3063783383 conn(0x7f9c3c0b3510 msgr2=0x7f9c3c0b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.518 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.527+0000 7f9c43600640 1 -- 172.21.15.177:0/3063783383 shutdown_connections 2024-04-25T09:03:46.518 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.527+0000 7f9c43600640 1 -- 172.21.15.177:0/3063783383 wait complete. 2024-04-25T09:03:46.519 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c43600640 1 Processor -- start 2024-04-25T09:03:46.519 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c43600640 1 -- start start 2024-04-25T09:03:46.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c43600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c3c0cf490 0x7f9c3c06c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c43600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c3c0d12a0 0x7f9c3c143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c43600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3c1454f0 0x7f9c3c164db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c43600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c0d16e0 con 0x7f9c3c0cf490 2024-04-25T09:03:46.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c43600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c1458d0 con 0x7f9c3c1454f0 2024-04-25T09:03:46.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c43600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c1687a0 con 0x7f9c3c0d12a0 2024-04-25T09:03:46.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c41600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3c1454f0 0x7f9c3c164db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c41600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3c1454f0 0x7f9c3c164db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:60596/0 (socket says 172.21.15.177:60596) 2024-04-25T09:03:46.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c41600640 1 -- 172.21.15.177:0/1436729658 learned_addr learned my addr 172.21.15.177:0/1436729658 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-04-25T09:03:46.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c3be00640 1 --2- 172.21.15.177:0/1436729658 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c3c0d12a0 0x7f9c3c143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c40c00640 1 --2- 172.21.15.177:0/1436729658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c3c0cf490 0x7f9c3c06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c41600640 1 -- 172.21.15.177:0/1436729658 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c3c0d12a0 msgr2=0x7f9c3c143140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c41600640 1 --2- 172.21.15.177:0/1436729658 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c3c0d12a0 0x7f9c3c143140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c41600640 1 -- 172.21.15.177:0/1436729658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c3c0cf490 msgr2=0x7f9c3c06c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c41600640 1 --2- 172.21.15.177:0/1436729658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c3c0cf490 0x7f9c3c06c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c41600640 1 -- 172.21.15.177:0/1436729658 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c143680 con 0x7f9c3c1454f0 2024-04-25T09:03:46.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c41600640 1 --2- 172.21.15.177:0/1436729658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3c1454f0 0x7f9c3c164db0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c7a0 tx=0x7f9c3400cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.522 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f466ac8d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T09:03:46.523 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c38c00640 1 -- 172.21.15.177:0/1436729658 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34018070 con 0x7f9c3c1454f0 2024-04-25T09:03:46.523 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c38c00640 1 -- 172.21.15.177:0/1436729658 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3400a640 con 0x7f9c3c1454f0 2024-04-25T09:03:46.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c38c00640 1 -- 172.21.15.177:0/1436729658 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3400aab0 con 0x7f9c3c1454f0 2024-04-25T09:03:46.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c43600640 1 -- 172.21.15.177:0/1436729658 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3c1426b0 con 0x7f9c3c1454f0 2024-04-25T09:03:46.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c43600640 1 -- 172.21.15.177:0/1436729658 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3c142c30 con 0x7f9c3c1454f0 2024-04-25T09:03:46.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c38c00640 1 -- 172.21.15.177:0/1436729658 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f9c3401b070 con 0x7f9c3c1454f0 2024-04-25T09:03:46.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c38c00640 1 -- 172.21.15.177:0/1436729658 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f9c34007850 con 0x7f9c3c1454f0 2024-04-25T09:03:46.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.531+0000 7f9c43600640 1 -- 172.21.15.177:0/1436729658 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3c075160 con 0x7f9c3c1454f0 2024-04-25T09:03:46.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.535+0000 7f9c38c00640 1 -- 172.21.15.177:0/1436729658 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f9c3400ac50 con 0x7f9c3c1454f0 2024-04-25T09:03:46.584 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:46.594+0000 7f466ac8d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T09:03:46.585 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:46.596+0000 7ff933c76180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T09:03:46.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.602+0000 7f9c43600640 1 -- 172.21.15.177:0/1436729658 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7900a8ee-9817-4cfe-900d-6cee224d1472", "id": 4} v 0) v1 -- 0x7f9c3c0b08e0 con 0x7f9c3c1454f0 2024-04-25T09:03:46.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.606+0000 7f9c38c00640 1 -- 172.21.15.177:0/1436729658 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7900a8ee-9817-4cfe-900d-6cee224d1472", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9c340070d0 con 0x7f9c3c1454f0 2024-04-25T09:03:46.597 INFO:teuthology.orchestra.run.smithi177.stdout:4 2024-04-25T09:03:46.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.606+0000 7f9c43600640 1 -- 172.21.15.177:0/1436729658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3c1454f0 msgr2=0x7f9c3c164db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.606+0000 7f9c43600640 1 --2- 172.21.15.177:0/1436729658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3c1454f0 0x7f9c3c164db0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9c3400c7a0 tx=0x7f9c3400cc60 comp rx=0 tx=0).stop 2024-04-25T09:03:46.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.606+0000 7f9c43600640 1 -- 172.21.15.177:0/1436729658 shutdown_connections 2024-04-25T09:03:46.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.606+0000 7f9c43600640 1 --2- 172.21.15.177:0/1436729658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c3c1454f0 0x7f9c3c164db0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.606+0000 7f9c43600640 1 --2- 172.21.15.177:0/1436729658 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c3c0d12a0 0x7f9c3c143140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.606+0000 7f9c43600640 1 --2- 172.21.15.177:0/1436729658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c3c0cf490 0x7f9c3c06c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.606+0000 7f9c43600640 1 -- 172.21.15.177:0/1436729658 >> 172.21.15.177:0/1436729658 conn(0x7f9c3c0b3510 msgr2=0x7f9c3c0d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.606+0000 7f9c43600640 1 -- 172.21.15.177:0/1436729658 shutdown_connections 2024-04-25T09:03:46.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.606+0000 7f9c43600640 1 -- 172.21.15.177:0/1436729658 wait complete. 2024-04-25T09:03:46.617 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd 5 2024-04-25T09:03:46.646 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:46.656+0000 7ff933c76180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T09:03:46.677 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:46.686+0000 7f466ac8d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T09:03:46.733 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:46.744+0000 7ff933c76180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T09:03:46.739 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:46.746+0000 7f466ac8d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T09:03:46.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.762+0000 7f74bca00640 1 Processor -- start 2024-04-25T09:03:46.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.762+0000 7f74bca00640 1 -- start start 2024-04-25T09:03:46.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.762+0000 7f74bca00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f74b8070e10 0x7f74b80b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.762+0000 7f74bca00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f74b80b4810 0x7f74b80711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.762+0000 7f74bca00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b806dd80 con 0x7f74b806bd60 2024-04-25T09:03:46.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.762+0000 7f74bca00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b806d8f0 con 0x7f74b8070e10 2024-04-25T09:03:46.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.762+0000 7f74bca00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b8071730 con 0x7f74b80b4810 2024-04-25T09:03:46.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.762+0000 7f74afe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f74b80b4810 0x7f74b80711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.762+0000 7f74b5e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f74b8070e10 0x7f74b80b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.762+0000 7f74afe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f74b80b4810 0x7f74b80711f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:60612/0 (socket says 172.21.15.177:60612) 2024-04-25T09:03:46.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.762+0000 7f74afe00640 1 -- 172.21.15.177:0/950557189 learned_addr learned my addr 172.21.15.177:0/950557189 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-04-25T09:03:46.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.762+0000 7f74afe00640 1 -- 172.21.15.177:0/950557189 >> v2:172.21.15.175:3300/0 conn(0x7f74b8070e10 msgr2=0x7f74b80b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:46.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.762+0000 7f74afe00640 1 --2- 172.21.15.177:0/950557189 >> v2:172.21.15.175:3300/0 conn(0x7f74b8070e10 0x7f74b80b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.762+0000 7f74b5400640 1 -- 172.21.15.177:0/950557189 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192201651 0 0) 0x7f74b806dd80 con 0x7f74b806bd60 2024-04-25T09:03:46.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.762+0000 7f74afe00640 1 -- 172.21.15.177:0/950557189 >> v1:172.21.15.175:6789/0 conn(0x7f74b806bd60 legacy=0x7f74b806c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.762+0000 7f74afe00640 1 -- 172.21.15.177:0/950557189 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b806cfc0 con 0x7f74b80b4810 2024-04-25T09:03:46.759 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.766+0000 7f74afe00640 1 --2- 172.21.15.177:0/950557189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74b80b4810 0x7f74b80711f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f74b8074020 tx=0x7f74a001c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cee0e707633f035d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.759 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74b5400640 1 -- 172.21.15.177:0/950557189 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a00aa650 con 0x7f74b80b4810 2024-04-25T09:03:46.759 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74b5400640 1 -- 172.21.15.177:0/950557189 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a00af070 con 0x7f74b80b4810 2024-04-25T09:03:46.759 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74b5400640 1 -- 172.21.15.177:0/950557189 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a00aaa10 con 0x7f74b80b4810 2024-04-25T09:03:46.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74bca00640 1 -- 172.21.15.177:0/950557189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74b80b4810 msgr2=0x7f74b80711f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74bca00640 1 --2- 172.21.15.177:0/950557189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74b80b4810 0x7f74b80711f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f74b8074020 tx=0x7f74a001c4f0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74bca00640 1 -- 172.21.15.177:0/950557189 shutdown_connections 2024-04-25T09:03:46.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74bca00640 1 --2- 172.21.15.177:0/950557189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74b80b4810 0x7f74b80711f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74bca00640 1 --2- 172.21.15.177:0/950557189 >> v2:172.21.15.175:3300/0 conn(0x7f74b8070e10 0x7f74b80b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74bca00640 1 -- 172.21.15.177:0/950557189 >> 172.21.15.177:0/950557189 conn(0x7f74b80b3510 msgr2=0x7f74b80b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74bca00640 1 -- 172.21.15.177:0/950557189 shutdown_connections 2024-04-25T09:03:46.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74bca00640 1 -- 172.21.15.177:0/950557189 wait complete. 2024-04-25T09:03:46.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74bca00640 1 Processor -- start 2024-04-25T09:03:46.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74bca00640 1 -- start start 2024-04-25T09:03:46.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74bca00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74b806bd60 0x7f74b80cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74bca00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74b8070e10 0x7f74b80d0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74bca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74b80b4810 0x7f74b8145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:46.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74bca00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b815e110 con 0x7f74b80b4810 2024-04-25T09:03:46.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74bca00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b80b0960 con 0x7f74b806bd60 2024-04-25T09:03:46.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.770+0000 7f74bca00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b80cfb60 con 0x7f74b8070e10 2024-04-25T09:03:46.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74afe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74b8070e10 0x7f74b80d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74afe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74b8070e10 0x7f74b80d0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:36836/0 (socket says 172.21.15.177:36836) 2024-04-25T09:03:46.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74afe00640 1 -- 172.21.15.177:0/1754737763 learned_addr learned my addr 172.21.15.177:0/1754737763 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-04-25T09:03:46.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74b5e00640 1 --2- 172.21.15.177:0/1754737763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74b806bd60 0x7f74b80cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74b6800640 1 --2- 172.21.15.177:0/1754737763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74b80b4810 0x7f74b8145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:46.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74afe00640 1 -- 172.21.15.177:0/1754737763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74b806bd60 msgr2=0x7f74b80cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74afe00640 1 --2- 172.21.15.177:0/1754737763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74b806bd60 0x7f74b80cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74afe00640 1 -- 172.21.15.177:0/1754737763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74b80b4810 msgr2=0x7f74b8145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74afe00640 1 --2- 172.21.15.177:0/1754737763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74b80b4810 0x7f74b8145f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74afe00640 1 -- 172.21.15.177:0/1754737763 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b80cd9e0 con 0x7f74b8070e10 2024-04-25T09:03:46.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74afe00640 1 --2- 172.21.15.177:0/1754737763 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74b8070e10 0x7f74b80d0120 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f74a00ac040 tx=0x7f74a0019290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74ae000640 1 -- 172.21.15.177:0/1754737763 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a00be610 con 0x7f74b8070e10 2024-04-25T09:03:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74ae000640 1 -- 172.21.15.177:0/1754737763 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a00a6040 con 0x7f74b8070e10 2024-04-25T09:03:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74ae000640 1 -- 172.21.15.177:0/1754737763 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a00be9f0 con 0x7f74b8070e10 2024-04-25T09:03:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74bca00640 1 -- 172.21.15.177:0/1754737763 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b80cbf50 con 0x7f74b8070e10 2024-04-25T09:03:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74bca00640 1 -- 172.21.15.177:0/1754737763 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b80cc510 con 0x7f74b8070e10 2024-04-25T09:03:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74ae000640 1 -- 172.21.15.177:0/1754737763 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f74a00bc020 con 0x7f74b8070e10 2024-04-25T09:03:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74ae000640 1 -- 172.21.15.177:0/1754737763 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f74a00b4d10 con 0x7f74b8070e10 2024-04-25T09:03:46.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.774+0000 7f74bca00640 1 -- 172.21.15.177:0/1754737763 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b8075160 con 0x7f74b8070e10 2024-04-25T09:03:46.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.778+0000 7f74ae000640 1 -- 172.21.15.177:0/1754737763 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f74a0016110 con 0x7f74b8070e10 2024-04-25T09:03:46.797 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:46.804+0000 7ff933c76180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T09:03:46.834 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:46.842+0000 7f466ac8d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T09:03:46.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.842+0000 7f74bca00640 1 -- 172.21.15.177:0/1754737763 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd", "id": 5} v 0) v1 -- 0x7f74b80b0740 con 0x7f74b8070e10 2024-04-25T09:03:46.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.850+0000 7f74ae000640 1 -- 172.21.15.177:0/1754737763 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f74a00b4400 con 0x7f74b8070e10 2024-04-25T09:03:46.842 INFO:teuthology.orchestra.run.smithi177.stdout:5 2024-04-25T09:03:46.843 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.850+0000 7f74bca00640 1 -- 172.21.15.177:0/1754737763 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74b8070e10 msgr2=0x7f74b80d0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:46.843 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.850+0000 7f74bca00640 1 --2- 172.21.15.177:0/1754737763 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74b8070e10 0x7f74b80d0120 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f74a00ac040 tx=0x7f74a0019290 comp rx=0 tx=0).stop 2024-04-25T09:03:46.843 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.850+0000 7f74bca00640 1 -- 172.21.15.177:0/1754737763 shutdown_connections 2024-04-25T09:03:46.843 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.850+0000 7f74bca00640 1 --2- 172.21.15.177:0/1754737763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74b80b4810 0x7f74b8145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.843 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.850+0000 7f74bca00640 1 --2- 172.21.15.177:0/1754737763 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74b8070e10 0x7f74b80d0120 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.843 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.850+0000 7f74bca00640 1 --2- 172.21.15.177:0/1754737763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74b806bd60 0x7f74b80cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:46.843 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.850+0000 7f74bca00640 1 -- 172.21.15.177:0/1754737763 >> 172.21.15.177:0/1754737763 conn(0x7f74b80b3510 msgr2=0x7f74b80b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:46.843 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.850+0000 7f74bca00640 1 -- 172.21.15.177:0/1754737763 shutdown_connections 2024-04-25T09:03:46.843 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:46.854+0000 7f74bca00640 1 -- 172.21.15.177:0/1754737763 wait complete. 2024-04-25T09:03:46.863 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new af876c6d-e1a3-41fc-98ec-c69d63c38e1c 6 2024-04-25T09:03:46.899 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:46.910+0000 7f466ac8d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T09:03:46.962 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:46.972+0000 7ff933c76180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T09:03:46.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.006+0000 7f8cd7600640 1 Processor -- start 2024-04-25T09:03:46.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.006+0000 7f8cd7600640 1 -- start start 2024-04-25T09:03:47.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.010+0000 7f8cd7600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8cd0070e10 0x7f8cd00b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.010+0000 7f8cd7600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8cd00b4810 0x7f8cd00711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.010+0000 7f8cd7600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd006dd80 con 0x7f8cd006bd60 2024-04-25T09:03:47.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.010+0000 7f8cd7600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd006d8f0 con 0x7f8cd00b4810 2024-04-25T09:03:47.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.010+0000 7f8cd7600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd0071730 con 0x7f8cd0070e10 2024-04-25T09:03:47.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.010+0000 7f8cd4c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8cd0070e10 0x7f8cd00b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.010+0000 7f8cd4c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8cd0070e10 0x7f8cd00b0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:60632/0 (socket says 172.21.15.177:60632) 2024-04-25T09:03:47.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.010+0000 7f8cd4c00640 1 -- 172.21.15.177:0/1176358296 learned_addr learned my addr 172.21.15.177:0/1176358296 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-04-25T09:03:47.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.010+0000 7f8cd5600640 1 --1- 172.21.15.177:0/1176358296 >> v1:172.21.15.177:6789/0 conn(0x7f8cd006bd60 0x7f8cd006c1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:49980/0 (socket says 172.21.15.177:49980) 2024-04-25T09:03:47.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.010+0000 7f8ccfe00640 1 --2- 172.21.15.177:0/1176358296 >> v2:172.21.15.175:3300/0 conn(0x7f8cd00b4810 0x7f8cd00711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.010+0000 7f8cd4c00640 1 -- 172.21.15.177:0/1176358296 >> v2:172.21.15.175:3300/0 conn(0x7f8cd00b4810 msgr2=0x7f8cd00711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:47.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.010+0000 7f8cd4c00640 1 --2- 172.21.15.177:0/1176358296 >> v2:172.21.15.175:3300/0 conn(0x7f8cd00b4810 0x7f8cd00711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.002 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.010+0000 7f8cd4c00640 1 -- 172.21.15.177:0/1176358296 >> v1:172.21.15.177:6789/0 conn(0x7f8cd006bd60 legacy=0x7f8cd006c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.002 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.010+0000 7f8cd4c00640 1 -- 172.21.15.177:0/1176358296 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd006cfc0 con 0x7f8cd0070e10 2024-04-25T09:03:47.002 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.010+0000 7f8ccf400640 1 -- 172.21.15.177:0/1176358296 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531472974 0 0) 0x7f8cd006dd80 con 0x7f8cd006bd60 2024-04-25T09:03:47.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.014+0000 7f8cd4c00640 1 --2- 172.21.15.177:0/1176358296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd0070e10 0x7f8cd00b0e20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0050060 tx=0x7f8cc401c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4474c4458a68389 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.014+0000 7f8ccf400640 1 -- 172.21.15.177:0/1176358296 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40aa650 con 0x7f8cd0070e10 2024-04-25T09:03:47.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.014+0000 7f8ccf400640 1 -- 172.21.15.177:0/1176358296 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc40af070 con 0x7f8cd0070e10 2024-04-25T09:03:47.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.014+0000 7f8ccf400640 1 -- 172.21.15.177:0/1176358296 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40aaa10 con 0x7f8cd0070e10 2024-04-25T09:03:47.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.014+0000 7f8cd7600640 1 -- 172.21.15.177:0/1176358296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd0070e10 msgr2=0x7f8cd00b0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.014+0000 7f8cd7600640 1 --2- 172.21.15.177:0/1176358296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd0070e10 0x7f8cd00b0e20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0050060 tx=0x7f8cc401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.014+0000 7f8cd7600640 1 -- 172.21.15.177:0/1176358296 shutdown_connections 2024-04-25T09:03:47.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.014+0000 7f8cd7600640 1 --2- 172.21.15.177:0/1176358296 >> v2:172.21.15.175:3300/0 conn(0x7f8cd00b4810 0x7f8cd00711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.014+0000 7f8cd7600640 1 --2- 172.21.15.177:0/1176358296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd0070e10 0x7f8cd00b0e20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.014+0000 7f8cd7600640 1 -- 172.21.15.177:0/1176358296 >> 172.21.15.177:0/1176358296 conn(0x7f8cd00b3510 msgr2=0x7f8cd00b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:47.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.014+0000 7f8cd7600640 1 -- 172.21.15.177:0/1176358296 shutdown_connections 2024-04-25T09:03:47.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.014+0000 7f8cd7600640 1 -- 172.21.15.177:0/1176358296 wait complete. 2024-04-25T09:03:47.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cd7600640 1 Processor -- start 2024-04-25T09:03:47.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cd7600640 1 -- start start 2024-04-25T09:03:47.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cd7600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd006bd60 0x7f8cd00d2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cd7600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd0070e10 0x7f8cd00d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cd7600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd00b4810 0x7f8cd015aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cd7600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd015e110 con 0x7f8cd0070e10 2024-04-25T09:03:47.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cd7600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd00b0960 con 0x7f8cd00b4810 2024-04-25T09:03:47.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cd7600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd00cfb60 con 0x7f8cd006bd60 2024-04-25T09:03:47.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cd4c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd006bd60 0x7f8cd00d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cd5600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd00b4810 0x7f8cd015aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cd4c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd006bd60 0x7f8cd00d2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:36852/0 (socket says 172.21.15.177:36852) 2024-04-25T09:03:47.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cd4c00640 1 -- 172.21.15.177:0/2097324898 learned_addr learned my addr 172.21.15.177:0/2097324898 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-04-25T09:03:47.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8ccfe00640 1 --2- 172.21.15.177:0/2097324898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd0070e10 0x7f8cd00d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8ccfe00640 1 -- 172.21.15.177:0/2097324898 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd006bd60 msgr2=0x7f8cd00d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8ccfe00640 1 --2- 172.21.15.177:0/2097324898 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd006bd60 0x7f8cd00d2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8ccfe00640 1 -- 172.21.15.177:0/2097324898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd00b4810 msgr2=0x7f8cd015aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8ccfe00640 1 --2- 172.21.15.177:0/2097324898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd00b4810 0x7f8cd015aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8ccfe00640 1 -- 172.21.15.177:0/2097324898 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd0147300 con 0x7f8cd0070e10 2024-04-25T09:03:47.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cd5600640 1 --2- 172.21.15.177:0/2097324898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd00b4810 0x7f8cd015aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:47.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8ccfe00640 1 --2- 172.21.15.177:0/2097324898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd0070e10 0x7f8cd00d02e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00e870 tx=0x7f8cbc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cccc00640 1 -- 172.21.15.177:0/2097324898 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc017070 con 0x7f8cd0070e10 2024-04-25T09:03:47.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cccc00640 1 -- 172.21.15.177:0/2097324898 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc00c8e0 con 0x7f8cd0070e10 2024-04-25T09:03:47.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cccc00640 1 -- 172.21.15.177:0/2097324898 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc00cc90 con 0x7f8cd0070e10 2024-04-25T09:03:47.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cd7600640 1 -- 172.21.15.177:0/2097324898 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd015b350 con 0x7f8cd0070e10 2024-04-25T09:03:47.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cd7600640 1 -- 172.21.15.177:0/2097324898 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd015b910 con 0x7f8cd0070e10 2024-04-25T09:03:47.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cccc00640 1 -- 172.21.15.177:0/2097324898 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f8cbc01a070 con 0x7f8cd0070e10 2024-04-25T09:03:47.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cccc00640 1 -- 172.21.15.177:0/2097324898 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f8cbc006020 con 0x7f8cd0070e10 2024-04-25T09:03:47.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.018+0000 7f8cd7600640 1 -- 172.21.15.177:0/2097324898 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd0075160 con 0x7f8cd0070e10 2024-04-25T09:03:47.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.022+0000 7f8cccc00640 1 -- 172.21.15.177:0/2097324898 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f8cbc0065c0 con 0x7f8cd0070e10 2024-04-25T09:03:47.032 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:47.044+0000 7ff933c76180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T09:03:47.074 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:47.082+0000 7f466ac8d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T09:03:47.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.094+0000 7f8cd7600640 1 -- 172.21.15.177:0/2097324898 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "af876c6d-e1a3-41fc-98ec-c69d63c38e1c", "id": 6} v 0) v1 -- 0x7f8cd00b1480 con 0x7f8cd0070e10 2024-04-25T09:03:47.086 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.094+0000 7f8cccc00640 1 -- 172.21.15.177:0/2097324898 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "af876c6d-e1a3-41fc-98ec-c69d63c38e1c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8cbc0067a0 con 0x7f8cd0070e10 2024-04-25T09:03:47.086 INFO:teuthology.orchestra.run.smithi177.stdout:6 2024-04-25T09:03:47.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.098+0000 7f8cd7600640 1 -- 172.21.15.177:0/2097324898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd0070e10 msgr2=0x7f8cd00d02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.098+0000 7f8cd7600640 1 --2- 172.21.15.177:0/2097324898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd0070e10 0x7f8cd00d02e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00e870 tx=0x7f8cbc00ed30 comp rx=0 tx=0).stop 2024-04-25T09:03:47.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.098+0000 7f8cd7600640 1 -- 172.21.15.177:0/2097324898 shutdown_connections 2024-04-25T09:03:47.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.098+0000 7f8cd7600640 1 --2- 172.21.15.177:0/2097324898 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd00b4810 0x7f8cd015aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.098+0000 7f8cd7600640 1 --2- 172.21.15.177:0/2097324898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd0070e10 0x7f8cd00d02e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.098+0000 7f8cd7600640 1 --2- 172.21.15.177:0/2097324898 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd006bd60 0x7f8cd00d2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.098+0000 7f8cd7600640 1 -- 172.21.15.177:0/2097324898 >> 172.21.15.177:0/2097324898 conn(0x7f8cd00b3510 msgr2=0x7f8cd00741d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:47.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.098+0000 7f8cd7600640 1 -- 172.21.15.177:0/2097324898 shutdown_connections 2024-04-25T09:03:47.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.098+0000 7f8cd7600640 1 -- 172.21.15.177:0/2097324898 wait complete. 2024-04-25T09:03:47.113 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new cd2847a7-6ddb-4bee-9011-f15f7d592435 7 2024-04-25T09:03:47.157 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:47.166+0000 7f466ac8d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T09:03:47.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.298+0000 7fd384800640 1 Processor -- start 2024-04-25T09:03:47.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.298+0000 7fd384800640 1 -- start start 2024-04-25T09:03:47.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.298+0000 7fd384800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd37c1454f0 0x7fd37c0cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.298+0000 7fd384800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd37c0d1470 0x7fd37c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.298+0000 7fd384800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37c0b4430 con 0x7fd37c0cf490 2024-04-25T09:03:47.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.298+0000 7fd384800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37c0b4940 con 0x7fd37c1454f0 2024-04-25T09:03:47.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.298+0000 7fd384800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0cf8f0 con 0x7fd37c0d1470 2024-04-25T09:03:47.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.298+0000 7fd382800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd37c0d1470 0x7fd37c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.298+0000 7fd382800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd37c0d1470 0x7fd37c0b4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:36858/0 (socket says 172.21.15.177:36858) 2024-04-25T09:03:47.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.298+0000 7fd382800640 1 -- 172.21.15.177:0/3253896502 learned_addr learned my addr 172.21.15.177:0/3253896502 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-04-25T09:03:47.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.298+0000 7fd381e00640 1 --2- 172.21.15.177:0/3253896502 >> v2:172.21.15.175:3300/0 conn(0x7fd37c1454f0 0x7fd37c0cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.302+0000 7fd380a00640 1 -- 172.21.15.177:0/3253896502 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378722891 0 0) 0x7fd37c0b4430 con 0x7fd37c0cf490 2024-04-25T09:03:47.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.302+0000 7fd380a00640 1 -- 172.21.15.177:0/3253896502 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd364003530 con 0x7fd37c0cf490 2024-04-25T09:03:47.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.302+0000 7fd381e00640 1 -- 172.21.15.177:0/3253896502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd37c0d1470 msgr2=0x7fd37c0b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:47.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.302+0000 7fd381e00640 1 --2- 172.21.15.177:0/3253896502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd37c0d1470 0x7fd37c0b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.302+0000 7fd381e00640 1 -- 172.21.15.177:0/3253896502 >> v1:172.21.15.175:6789/0 conn(0x7fd37c0cf490 legacy=0x7fd37c0d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.302+0000 7fd381e00640 1 -- 172.21.15.177:0/3253896502 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c070eb0 con 0x7fd37c1454f0 2024-04-25T09:03:47.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.302+0000 7fd382800640 1 --2- 172.21.15.177:0/3253896502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd37c0d1470 0x7fd37c0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:47.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.302+0000 7fd381e00640 1 --2- 172.21.15.177:0/3253896502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c1454f0 0x7fd37c0cef50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd3700097c0 tx=0x7fd37001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8d898ff84fda2f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.302+0000 7fd380a00640 1 -- 172.21.15.177:0/3253896502 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3700aa5f0 con 0x7fd37c1454f0 2024-04-25T09:03:47.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.302+0000 7fd380a00640 1 -- 172.21.15.177:0/3253896502 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3700af070 con 0x7fd37c1454f0 2024-04-25T09:03:47.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.302+0000 7fd380a00640 1 -- 172.21.15.177:0/3253896502 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3700aa990 con 0x7fd37c1454f0 2024-04-25T09:03:47.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd384800640 1 -- 172.21.15.177:0/3253896502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c1454f0 msgr2=0x7fd37c0cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd384800640 1 --2- 172.21.15.177:0/3253896502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c1454f0 0x7fd37c0cef50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd3700097c0 tx=0x7fd37001c470 comp rx=0 tx=0).stop 2024-04-25T09:03:47.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd384800640 1 -- 172.21.15.177:0/3253896502 shutdown_connections 2024-04-25T09:03:47.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd384800640 1 --2- 172.21.15.177:0/3253896502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd37c0d1470 0x7fd37c0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd384800640 1 --2- 172.21.15.177:0/3253896502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c1454f0 0x7fd37c0cef50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd384800640 1 -- 172.21.15.177:0/3253896502 >> 172.21.15.177:0/3253896502 conn(0x7fd37c0b3510 msgr2=0x7fd37c0b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:47.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd384800640 1 -- 172.21.15.177:0/3253896502 shutdown_connections 2024-04-25T09:03:47.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd384800640 1 -- 172.21.15.177:0/3253896502 wait complete. 2024-04-25T09:03:47.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd384800640 1 Processor -- start 2024-04-25T09:03:47.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd384800640 1 -- start start 2024-04-25T09:03:47.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd384800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd37c0cf490 0x7fd37c13eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd384800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd37c0d1470 0x7fd37c143bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd384800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c1454f0 0x7fd37c161d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd384800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0b5b20 con 0x7fd37c1454f0 2024-04-25T09:03:47.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd384800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c1458d0 con 0x7fd37c0cf490 2024-04-25T09:03:47.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd384800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0b5ca0 con 0x7fd37c0d1470 2024-04-25T09:03:47.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd381e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd37c0cf490 0x7fd37c13eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd381e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd37c0cf490 0x7fd37c13eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:60644/0 (socket says 172.21.15.177:60644) 2024-04-25T09:03:47.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd381e00640 1 -- 172.21.15.177:0/3684518689 learned_addr learned my addr 172.21.15.177:0/3684518689 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-04-25T09:03:47.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd381400640 1 --2- 172.21.15.177:0/3684518689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd37c0d1470 0x7fd37c143bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd382800640 1 --2- 172.21.15.177:0/3684518689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c1454f0 0x7fd37c161d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd381e00640 1 -- 172.21.15.177:0/3684518689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd37c0d1470 msgr2=0x7fd37c143bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd381e00640 1 --2- 172.21.15.177:0/3684518689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd37c0d1470 0x7fd37c143bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd381e00640 1 -- 172.21.15.177:0/3684518689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c1454f0 msgr2=0x7fd37c161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd381e00640 1 --2- 172.21.15.177:0/3684518689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c1454f0 0x7fd37c161d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd381e00640 1 -- 172.21.15.177:0/3684518689 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c13f070 con 0x7fd37c0cf490 2024-04-25T09:03:47.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.306+0000 7fd381e00640 1 --2- 172.21.15.177:0/3684518689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd37c0cf490 0x7fd37c13eb30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd37001cd10 tx=0x7fd37001acb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.310+0000 7fd376000640 1 -- 172.21.15.177:0/3684518689 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd370006e20 con 0x7fd37c0cf490 2024-04-25T09:03:47.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.310+0000 7fd376000640 1 -- 172.21.15.177:0/3684518689 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3700be410 con 0x7fd37c0cf490 2024-04-25T09:03:47.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.310+0000 7fd384800640 1 -- 172.21.15.177:0/3684518689 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c15e180 con 0x7fd37c0cf490 2024-04-25T09:03:47.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.310+0000 7fd376000640 1 -- 172.21.15.177:0/3684518689 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3700be7c0 con 0x7fd37c0cf490 2024-04-25T09:03:47.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.310+0000 7fd384800640 1 -- 172.21.15.177:0/3684518689 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c15ea20 con 0x7fd37c0cf490 2024-04-25T09:03:47.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.310+0000 7fd376000640 1 -- 172.21.15.177:0/3684518689 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd3700bc020 con 0x7fd37c0cf490 2024-04-25T09:03:47.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.310+0000 7fd376000640 1 -- 172.21.15.177:0/3684518689 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fd3700becf0 con 0x7fd37c0cf490 2024-04-25T09:03:47.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.310+0000 7fd384800640 1 -- 172.21.15.177:0/3684518689 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c15e570 con 0x7fd37c0cf490 2024-04-25T09:03:47.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.310+0000 7fd376000640 1 -- 172.21.15.177:0/3684518689 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd370016090 con 0x7fd37c0cf490 2024-04-25T09:03:47.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.378+0000 7fd384800640 1 -- 172.21.15.177:0/3684518689 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cd2847a7-6ddb-4bee-9011-f15f7d592435", "id": 7} v 0) v1 -- 0x7fd37c075160 con 0x7fd37c0cf490 2024-04-25T09:03:47.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.390+0000 7fd376000640 1 -- 172.21.15.177:0/3684518689 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cd2847a7-6ddb-4bee-9011-f15f7d592435", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd3700b4bd0 con 0x7fd37c0cf490 2024-04-25T09:03:47.380 INFO:teuthology.orchestra.run.smithi177.stdout:7 2024-04-25T09:03:47.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.390+0000 7fd384800640 1 -- 172.21.15.177:0/3684518689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd37c0cf490 msgr2=0x7fd37c13eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.390+0000 7fd384800640 1 --2- 172.21.15.177:0/3684518689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd37c0cf490 0x7fd37c13eb30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd37001cd10 tx=0x7fd37001acb0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.390+0000 7fd384800640 1 -- 172.21.15.177:0/3684518689 shutdown_connections 2024-04-25T09:03:47.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.390+0000 7fd384800640 1 --2- 172.21.15.177:0/3684518689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd37c1454f0 0x7fd37c161d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.390+0000 7fd384800640 1 --2- 172.21.15.177:0/3684518689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd37c0d1470 0x7fd37c143bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.390+0000 7fd384800640 1 --2- 172.21.15.177:0/3684518689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd37c0cf490 0x7fd37c13eb30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.390+0000 7fd384800640 1 -- 172.21.15.177:0/3684518689 >> 172.21.15.177:0/3684518689 conn(0x7fd37c0b3510 msgr2=0x7fd37c165f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:47.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.390+0000 7fd384800640 1 -- 172.21.15.177:0/3684518689 shutdown_connections 2024-04-25T09:03:47.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-04-25T09:03:47.390+0000 7fd384800640 1 -- 172.21.15.177:0/3684518689 wait complete. 2024-04-25T09:03:47.398 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T09:03:47.399 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T09:03:47.406 INFO:tasks.ceph.osd.0:Started 2024-04-25T09:03:47.406 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T09:03:47.406 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T09:03:47.411 INFO:tasks.ceph.osd.1:Started 2024-04-25T09:03:47.411 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T09:03:47.412 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T09:03:47.422 INFO:tasks.ceph.osd.2:Started 2024-04-25T09:03:47.422 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T09:03:47.423 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T09:03:47.426 INFO:tasks.ceph.osd.3:Started 2024-04-25T09:03:47.426 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T09:03:47.426 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T09:03:47.429 INFO:tasks.ceph.osd.4:Started 2024-04-25T09:03:47.429 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T09:03:47.429 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T09:03:47.432 INFO:tasks.ceph.osd.5:Started 2024-04-25T09:03:47.432 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T09:03:47.432 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T09:03:47.435 INFO:tasks.ceph.osd.6:Started 2024-04-25T09:03:47.435 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T09:03:47.435 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T09:03:47.441 INFO:tasks.ceph.osd.7:Started 2024-04-25T09:03:47.442 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:47.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f0806600640 1 Processor -- start 2024-04-25T09:03:47.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f0806600640 1 -- start start 2024-04-25T09:03:47.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f0806600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08000cece0 0x7f08000ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f0806600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f08000cf0c0 0x7f080015e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f0806600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f080015e8e0 0x7f08000cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f0806600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0800066d40 con 0x7f080015e8e0 2024-04-25T09:03:47.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f0806600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08000ceaf0 con 0x7f08000cf0c0 2024-04-25T09:03:47.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f0806600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080015ed50 con 0x7f08000cece0 2024-04-25T09:03:47.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f07ffe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f080015e8e0 0x7f08000cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f07ffe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f080015e8e0 0x7f08000cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:56704/0 (socket says 172.21.15.175:56704) 2024-04-25T09:03:47.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f07ffe00640 1 -- 172.21.15.175:0/1273323064 learned_addr learned my addr 172.21.15.175:0/1273323064 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:03:47.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f07ff400640 1 --2- 172.21.15.175:0/1273323064 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08000cece0 0x7f08000ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f07f6a00640 1 --2- 172.21.15.175:0/1273323064 >> v2:172.21.15.177:3300/0 conn(0x7f08000cf0c0 0x7f080015e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f07ffe00640 1 -- 172.21.15.175:0/1273323064 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08000cece0 msgr2=0x7f08000ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:47.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f07ffe00640 1 --2- 172.21.15.175:0/1273323064 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08000cece0 0x7f08000ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f07ffe00640 1 -- 172.21.15.175:0/1273323064 >> v2:172.21.15.177:3300/0 conn(0x7f08000cf0c0 msgr2=0x7f080015e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:47.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f07ffe00640 1 --2- 172.21.15.175:0/1273323064 >> v2:172.21.15.177:3300/0 conn(0x7f08000cf0c0 0x7f080015e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f07ffe00640 1 -- 172.21.15.175:0/1273323064 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080015f2b0 con 0x7f080015e8e0 2024-04-25T09:03:47.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.628+0000 7f07ff400640 1 --2- 172.21.15.175:0/1273323064 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08000cece0 0x7f08000ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:47.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.632+0000 7f07ffe00640 1 --2- 172.21.15.175:0/1273323064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f080015e8e0 0x7f08000cb430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f080006fb60 tx=0x7f07f801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855aab4471dbe3a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.632+0000 7f07fea00640 1 -- 172.21.15.175:0/1273323064 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f80ab620 con 0x7f080015e8e0 2024-04-25T09:03:47.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.632+0000 7f07fea00640 1 -- 172.21.15.175:0/1273323064 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f80b0070 con 0x7f080015e8e0 2024-04-25T09:03:47.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.632+0000 7f07fea00640 1 -- 172.21.15.175:0/1273323064 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f80ab9e0 con 0x7f080015e8e0 2024-04-25T09:03:47.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.632+0000 7f0806600640 1 -- 172.21.15.175:0/1273323064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f080015e8e0 msgr2=0x7f08000cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.632+0000 7f0806600640 1 --2- 172.21.15.175:0/1273323064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f080015e8e0 0x7f08000cb430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f080006fb60 tx=0x7f07f801c460 comp rx=0 tx=0).stop 2024-04-25T09:03:47.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.632+0000 7f0806600640 1 -- 172.21.15.175:0/1273323064 shutdown_connections 2024-04-25T09:03:47.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.632+0000 7f0806600640 1 --2- 172.21.15.175:0/1273323064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f080015e8e0 0x7f08000cb430 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.632+0000 7f0806600640 1 --2- 172.21.15.175:0/1273323064 >> v2:172.21.15.177:3300/0 conn(0x7f08000cf0c0 0x7f080015e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.632+0000 7f0806600640 1 --2- 172.21.15.175:0/1273323064 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08000cece0 0x7f08000ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.632+0000 7f0806600640 1 -- 172.21.15.175:0/1273323064 >> 172.21.15.175:0/1273323064 conn(0x7f08000cc8e0 msgr2=0x7f08000cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:47.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.632+0000 7f0806600640 1 -- 172.21.15.175:0/1273323064 shutdown_connections 2024-04-25T09:03:47.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.632+0000 7f0806600640 1 -- 172.21.15.175:0/1273323064 wait complete. 2024-04-25T09:03:47.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f0806600640 1 Processor -- start 2024-04-25T09:03:47.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f0806600640 1 -- start start 2024-04-25T09:03:47.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f0806600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08000cece0 0x7f080014f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f0806600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08000cf0c0 0x7f0800153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f0806600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f080015e8e0 0x7f0800071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f0806600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08000cf4a0 con 0x7f080015e8e0 2024-04-25T09:03:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f0806600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08000ce090 con 0x7f08000cece0 2024-04-25T09:03:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f0806600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08000cf620 con 0x7f08000cf0c0 2024-04-25T09:03:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f07ffe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f080015e8e0 0x7f0800071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f07f6a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08000cf0c0 0x7f0800153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f07ffe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f080015e8e0 0x7f0800071ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:56716/0 (socket says 172.21.15.175:56716) 2024-04-25T09:03:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f07ffe00640 1 -- 172.21.15.175:0/3266056926 learned_addr learned my addr 172.21.15.175:0/3266056926 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:03:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f07ff400640 1 --2- 172.21.15.175:0/3266056926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08000cece0 0x7f080014f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f07ffe00640 1 -- 172.21.15.175:0/3266056926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08000cf0c0 msgr2=0x7f0800153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f07ffe00640 1 --2- 172.21.15.175:0/3266056926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08000cf0c0 0x7f0800153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f07ffe00640 1 -- 172.21.15.175:0/3266056926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08000cece0 msgr2=0x7f080014f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f07ffe00640 1 --2- 172.21.15.175:0/3266056926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08000cece0 0x7f080014f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f07ffe00640 1 -- 172.21.15.175:0/3266056926 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08000b0600 con 0x7f080015e8e0 2024-04-25T09:03:47.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f07ffe00640 1 --2- 172.21.15.175:0/3266056926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f080015e8e0 0x7f0800071ab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f07f80097c0 tx=0x7f07f801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:47.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f07f7e00640 1 -- 172.21.15.175:0/3266056926 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f80abc50 con 0x7f080015e8e0 2024-04-25T09:03:47.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f07f7e00640 1 -- 172.21.15.175:0/3266056926 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f80abdf0 con 0x7f080015e8e0 2024-04-25T09:03:47.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f07f7e00640 1 -- 172.21.15.175:0/3266056926 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f80be630 con 0x7f080015e8e0 2024-04-25T09:03:47.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f0806600640 1 -- 172.21.15.175:0/3266056926 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08000b08a0 con 0x7f080015e8e0 2024-04-25T09:03:47.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f0806600640 1 -- 172.21.15.175:0/3266056926 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08000b0e60 con 0x7f080015e8e0 2024-04-25T09:03:47.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f07f7e00640 1 -- 172.21.15.175:0/3266056926 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f07f80beb60 con 0x7f080015e8e0 2024-04-25T09:03:47.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.636+0000 7f07f7e00640 1 -- 172.21.15.175:0/3266056926 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f07f80b4d00 con 0x7f080015e8e0 2024-04-25T09:03:47.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.640+0000 7f0806600640 1 -- 172.21.15.175:0/3266056926 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0800074a60 con 0x7f080015e8e0 2024-04-25T09:03:47.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.640+0000 7f07f7e00640 1 -- 172.21.15.175:0/3266056926 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f07f80c4060 con 0x7f080015e8e0 2024-04-25T09:03:47.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.696+0000 7f0806600640 1 -- 172.21.15.175:0/3266056926 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f080015a760 con 0x7f080015e8e0 2024-04-25T09:03:47.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.696+0000 7f07f7e00640 1 -- 172.21.15.175:0/3266056926 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f07f8016110 con 0x7f080015e8e0 2024-04-25T09:03:47.687 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:03:47.687 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":10,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:03:47.383066+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:47.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.696+0000 7f0806600640 1 -- 172.21.15.175:0/3266056926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f080015e8e0 msgr2=0x7f0800071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:47.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.696+0000 7f0806600640 1 --2- 172.21.15.175:0/3266056926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f080015e8e0 0x7f0800071ab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f07f80097c0 tx=0x7f07f801aca0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.696+0000 7f0806600640 1 -- 172.21.15.175:0/3266056926 shutdown_connections 2024-04-25T09:03:47.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.696+0000 7f0806600640 1 --2- 172.21.15.175:0/3266056926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f080015e8e0 0x7f0800071ab0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.696+0000 7f0806600640 1 --2- 172.21.15.175:0/3266056926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08000cf0c0 0x7f0800153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.696+0000 7f0806600640 1 --2- 172.21.15.175:0/3266056926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08000cece0 0x7f080014f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:47.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.696+0000 7f0806600640 1 -- 172.21.15.175:0/3266056926 >> 172.21.15.175:0/3266056926 conn(0x7f08000cc8e0 msgr2=0x7f080006eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:47.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.696+0000 7f0806600640 1 -- 172.21.15.175:0/3266056926 shutdown_connections 2024-04-25T09:03:47.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:03:47.696+0000 7f0806600640 1 -- 172.21.15.175:0/3266056926 wait complete. 2024-04-25T09:03:47.695 INFO:tasks.ceph.mgr.y.smithi175.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T09:03:47.695 INFO:tasks.ceph.mgr.y.smithi175.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T09:03:47.695 INFO:tasks.ceph.mgr.y.smithi175.stderr: from numpy import show_config as show_numpy_config 2024-04-25T09:03:47.706 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T09:03:47.707 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T09:03:47.750 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:47.760+0000 7ff933c76180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T09:03:47.800 INFO:tasks.ceph.mgr.x.smithi177.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T09:03:47.800 INFO:tasks.ceph.mgr.x.smithi177.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T09:03:47.801 INFO:tasks.ceph.mgr.x.smithi177.stderr: from numpy import show_config as show_numpy_config 2024-04-25T09:03:47.846 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:47.858+0000 7f466ac8d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T09:03:47.898 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:47.908+0000 7ff933c76180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:03:47.994 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:48.006+0000 7f466ac8d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:03:48.065 INFO:tasks.ceph.osd.0.smithi175.stderr:2024-04-25T09:03:48.076+0000 7f9ecff6e7c0 -1 Falling back to public interface 2024-04-25T09:03:48.065 INFO:tasks.ceph.osd.1.smithi175.stderr:2024-04-25T09:03:48.076+0000 7ffb6f9197c0 -1 Falling back to public interface 2024-04-25T09:03:48.066 INFO:tasks.ceph.osd.0.smithi175.stderr:2024-04-25T09:03:48.076+0000 7f9ecea00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2024-04-25T09:03:48.079 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:48.088+0000 7ff933c76180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T09:03:48.093 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-25T09:03:48.104+0000 7f3d90c807c0 -1 Falling back to public interface 2024-04-25T09:03:48.097 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-25T09:03:48.108+0000 7f65c00047c0 -1 Falling back to public interface 2024-04-25T09:03:48.104 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-04-25T09:03:48.118+0000 7fad4b4577c0 -1 Falling back to public interface 2024-04-25T09:03:48.117 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-04-25T09:03:48.130+0000 7fdbaaf197c0 -1 Falling back to public interface 2024-04-25T09:03:48.124 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-04-25T09:03:48.138+0000 7f61d0f3c7c0 -1 Falling back to public interface 2024-04-25T09:03:48.128 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-04-25T09:03:48.142+0000 7f3f727b67c0 -1 Falling back to public interface 2024-04-25T09:03:48.158 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:48.168+0000 7ff933c76180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T09:03:48.169 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:48.182+0000 7f466ac8d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T09:03:48.242 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:48.254+0000 7f466ac8d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T09:03:48.305 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:48.316+0000 7ff933c76180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:03:48.395 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:48.406+0000 7f466ac8d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:03:48.513 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:48.639 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.648+0000 7f1d72c00640 1 Processor -- start 2024-04-25T09:03:48.639 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.648+0000 7f1d72c00640 1 -- start start 2024-04-25T09:03:48.641 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.652+0000 7f1d72c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1d6c09a600 0x7f1d6c0d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.641 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.652+0000 7f1d72c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d6c06cf60 con 0x7f1d6c099b10 2024-04-25T09:03:48.641 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.652+0000 7f1d72c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d6c0cff40 con 0x7f1d6c0cc000 2024-04-25T09:03:48.641 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.652+0000 7f1d72c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6c0d0220 con 0x7f1d6c09a600 2024-04-25T09:03:48.641 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.652+0000 7f1d70c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1d6c09a600 0x7f1d6c0d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.641 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.652+0000 7f1d6be00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f1d6c099b10 0x7f1d6c06c730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38096/0 (socket says 172.21.15.175:38096) 2024-04-25T09:03:48.641 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.652+0000 7f1d6be00640 1 -- 172.21.15.175:0/3422823600 learned_addr learned my addr 172.21.15.175:0/3422823600 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:03:48.642 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.652+0000 7f1d70c00640 1 -- 172.21.15.175:0/3422823600 >> v1:172.21.15.177:6789/0 conn(0x7f1d6c0cc000 legacy=0x7f1d6c099ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.642 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.652+0000 7f1d70c00640 1 -- 172.21.15.175:0/3422823600 >> v1:172.21.15.175:6789/0 conn(0x7f1d6c099b10 legacy=0x7f1d6c06c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.642 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.652+0000 7f1d70c00640 1 -- 172.21.15.175:0/3422823600 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c0d0500 con 0x7f1d6c09a600 2024-04-25T09:03:48.645 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d70c00640 1 --2- 172.21.15.175:0/3422823600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d6c09a600 0x7f1d6c0d0a20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009d90 tx=0x7f1d6401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fb07590f546bfd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:48.645 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d6b400640 1 -- 172.21.15.175:0/3422823600 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d640b2070 con 0x7f1d6c09a600 2024-04-25T09:03:48.646 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d6b400640 1 -- 172.21.15.175:0/3422823600 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d640a5940 con 0x7f1d6c09a600 2024-04-25T09:03:48.646 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d6b400640 1 -- 172.21.15.175:0/3422823600 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d640a5d10 con 0x7f1d6c09a600 2024-04-25T09:03:48.646 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d72c00640 1 -- 172.21.15.175:0/3422823600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d6c09a600 msgr2=0x7f1d6c0d0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.646 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d72c00640 1 --2- 172.21.15.175:0/3422823600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d6c09a600 0x7f1d6c0d0a20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009d90 tx=0x7f1d6401c970 comp rx=0 tx=0).stop 2024-04-25T09:03:48.646 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d72c00640 1 -- 172.21.15.175:0/3422823600 shutdown_connections 2024-04-25T09:03:48.646 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d72c00640 1 --2- 172.21.15.175:0/3422823600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d6c09a600 0x7f1d6c0d0a20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.646 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d72c00640 1 -- 172.21.15.175:0/3422823600 >> 172.21.15.175:0/3422823600 conn(0x7f1d6c0b34a0 msgr2=0x7f1d6c0b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:48.646 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d72c00640 1 -- 172.21.15.175:0/3422823600 shutdown_connections 2024-04-25T09:03:48.646 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d72c00640 1 -- 172.21.15.175:0/3422823600 wait complete. 2024-04-25T09:03:48.647 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d72c00640 1 Processor -- start 2024-04-25T09:03:48.647 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d72c00640 1 -- start start 2024-04-25T09:03:48.648 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d72c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d6c099b10 0x7f1d6c14f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.648 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d72c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d6c09a600 0x7f1d6c15e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.648 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d72c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d6c0cc000 0x7f1d6c15e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:48.648 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d72c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c16c520 con 0x7f1d6c0cc000 2024-04-25T09:03:48.648 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d72c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c16c3a0 con 0x7f1d6c099b10 2024-04-25T09:03:48.649 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.656+0000 7f1d72c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c16c6a0 con 0x7f1d6c09a600 2024-04-25T09:03:48.649 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d70c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d6c0cc000 0x7f1d6c15e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.649 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d6be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d6c099b10 0x7f1d6c14f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.649 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d70c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d6c0cc000 0x7f1d6c15e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:56744/0 (socket says 172.21.15.175:56744) 2024-04-25T09:03:48.649 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d70c00640 1 -- 172.21.15.175:0/3781039460 learned_addr learned my addr 172.21.15.175:0/3781039460 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:03:48.649 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d63e00640 1 --2- 172.21.15.175:0/3781039460 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d6c09a600 0x7f1d6c15e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:48.649 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d70c00640 1 -- 172.21.15.175:0/3781039460 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d6c09a600 msgr2=0x7f1d6c15e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.649 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d70c00640 1 --2- 172.21.15.175:0/3781039460 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d6c09a600 0x7f1d6c15e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.649 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d70c00640 1 -- 172.21.15.175:0/3781039460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d6c099b10 msgr2=0x7f1d6c14f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.649 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d70c00640 1 --2- 172.21.15.175:0/3781039460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d6c099b10 0x7f1d6c14f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.649 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d70c00640 1 -- 172.21.15.175:0/3781039460 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c14fe50 con 0x7f1d6c0cc000 2024-04-25T09:03:48.650 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d70c00640 1 --2- 172.21.15.175:0/3781039460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d6c0cc000 0x7f1d6c15e880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1d640b0040 tx=0x7f1d64019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:48.650 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d68c00640 1 -- 172.21.15.175:0/3781039460 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d640bd020 con 0x7f1d6c0cc000 2024-04-25T09:03:48.651 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d68c00640 1 -- 172.21.15.175:0/3781039460 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d640ad7c0 con 0x7f1d6c0cc000 2024-04-25T09:03:48.651 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d68c00640 1 -- 172.21.15.175:0/3781039460 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d640b2040 con 0x7f1d6c0cc000 2024-04-25T09:03:48.651 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d72c00640 1 -- 172.21.15.175:0/3781039460 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d6c150130 con 0x7f1d6c0cc000 2024-04-25T09:03:48.651 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d72c00640 1 -- 172.21.15.175:0/3781039460 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6c1506f0 con 0x7f1d6c0cc000 2024-04-25T09:03:48.651 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d68c00640 1 -- 172.21.15.175:0/3781039460 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f1d640c0020 con 0x7f1d6c0cc000 2024-04-25T09:03:48.651 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d68c00640 1 -- 172.21.15.175:0/3781039460 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1d640b9420 con 0x7f1d6c0cc000 2024-04-25T09:03:48.651 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.660+0000 7f1d72c00640 1 -- 172.21.15.175:0/3781039460 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6c0685e0 con 0x7f1d6c0cc000 2024-04-25T09:03:48.652 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.664+0000 7f1d68c00640 1 -- 172.21.15.175:0/3781039460 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f1d640c7030 con 0x7f1d6c0cc000 2024-04-25T09:03:48.709 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.720+0000 7f1d72c00640 1 -- 172.21.15.175:0/3781039460 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d6c09aec0 con 0x7f1d6c0cc000 2024-04-25T09:03:48.709 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.720+0000 7f1d68c00640 1 -- 172.21.15.175:0/3781039460 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f1d64016560 con 0x7f1d6c0cc000 2024-04-25T09:03:48.710 INFO:teuthology.misc.health.smithi175.stdout: 2024-04-25T09:03:48.710 INFO:teuthology.misc.health.smithi175.stdout:{"epoch":10,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:03:47.383066+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:48.711 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.720+0000 7f1d72c00640 1 -- 172.21.15.175:0/3781039460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d6c0cc000 msgr2=0x7f1d6c15e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:48.711 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.720+0000 7f1d72c00640 1 --2- 172.21.15.175:0/3781039460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d6c0cc000 0x7f1d6c15e880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1d640b0040 tx=0x7f1d64019710 comp rx=0 tx=0).stop 2024-04-25T09:03:48.711 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.720+0000 7f1d72c00640 1 -- 172.21.15.175:0/3781039460 shutdown_connections 2024-04-25T09:03:48.711 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.720+0000 7f1d72c00640 1 --2- 172.21.15.175:0/3781039460 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d6c0cc000 0x7f1d6c15e880 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.711 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.720+0000 7f1d72c00640 1 --2- 172.21.15.175:0/3781039460 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d6c09a600 0x7f1d6c15e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.711 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.720+0000 7f1d72c00640 1 --2- 172.21.15.175:0/3781039460 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d6c099b10 0x7f1d6c14f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:48.711 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.720+0000 7f1d72c00640 1 -- 172.21.15.175:0/3781039460 >> 172.21.15.175:0/3781039460 conn(0x7f1d6c0b34a0 msgr2=0x7f1d6c152670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:48.711 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.720+0000 7f1d72c00640 1 -- 172.21.15.175:0/3781039460 shutdown_connections 2024-04-25T09:03:48.711 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:48.720+0000 7f1d72c00640 1 -- 172.21.15.175:0/3781039460 wait complete. 2024-04-25T09:03:48.727 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T09:03:48.995 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:49.004+0000 7ff933c76180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T09:03:49.064 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:49.078+0000 7f466ac8d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T09:03:49.082 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:49.092+0000 7ff933c76180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T09:03:49.151 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:49.166+0000 7f466ac8d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T09:03:49.281 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:49.292+0000 7ff933c76180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T09:03:49.352 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:49.366+0000 7f466ac8d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T09:03:49.366 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:49.376+0000 7ff933c76180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T09:03:49.438 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:49.450+0000 7f466ac8d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T09:03:49.693 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:49.704+0000 7ff933c76180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T09:03:49.763 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:49.772+0000 7ff933c76180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T09:03:49.765 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:49.778+0000 7f466ac8d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T09:03:49.843 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-04-25T09:03:49.854+0000 7f466ac8d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T09:03:50.780 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:50.792+0000 7ff8d9e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T09:03:50.783 INFO:tasks.ceph.mgr.y.smithi175.stderr:2024-04-25T09:03:50.792+0000 7ff8d9e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T09:03:51.967 INFO:tasks.ceph.osd.1.smithi175.stderr:2024-04-25T09:03:51.976+0000 7ffb6f9197c0 -1 osd.1 0 log_to_monitors true 2024-04-25T09:03:51.968 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-04-25T09:03:51.982+0000 7fad4b4577c0 -1 osd.7 0 log_to_monitors true 2024-04-25T09:03:51.987 INFO:tasks.ceph.osd.0.smithi175.stderr:2024-04-25T09:03:51.996+0000 7f9ecff6e7c0 -1 osd.0 0 log_to_monitors true 2024-04-25T09:03:52.044 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-25T09:03:52.056+0000 7f3d90c807c0 -1 osd.3 0 log_to_monitors true 2024-04-25T09:03:52.058 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-04-25T09:03:52.070+0000 7fdbaaf197c0 -1 osd.4 0 log_to_monitors true 2024-04-25T09:03:52.116 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-25T09:03:52.124+0000 7f65c00047c0 -1 osd.2 0 log_to_monitors true 2024-04-25T09:03:52.138 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-04-25T09:03:52.150+0000 7f3f727b67c0 -1 osd.6 0 log_to_monitors true 2024-04-25T09:03:52.151 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-04-25T09:03:52.162+0000 7f61d0f3c7c0 -1 osd.5 0 log_to_monitors true 2024-04-25T09:03:55.534 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:55.735 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.744+0000 7f29ba600640 1 Processor -- start 2024-04-25T09:03:55.736 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.744+0000 7f29ba600640 1 -- start start 2024-04-25T09:03:55.738 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.748+0000 7f29ba600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29b406aec0 0x7f29b40af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.738 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.748+0000 7f29ba600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f29b406b2a0 0x7f29b406fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.738 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.748+0000 7f29ba600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f29b40700d0 0x7f29b4070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.738 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.748+0000 7f29ba600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b415dec0 con 0x7f29b406b2a0 2024-04-25T09:03:55.738 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.748+0000 7f29ba600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b40b4530 con 0x7f29b40700d0 2024-04-25T09:03:55.738 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.748+0000 7f29ba600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40b4810 con 0x7f29b406aec0 2024-04-25T09:03:55.739 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.748+0000 7f29b9c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f29b40700d0 0x7f29b4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.739 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.748+0000 7f29b3e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f29b406b2a0 0x7f29b406fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.739 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.748+0000 7f29b3e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f29b406b2a0 0x7f29b406fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39736/0 (socket says 172.21.15.175:39736) 2024-04-25T09:03:55.739 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.748+0000 7f29b3e00640 1 -- 172.21.15.175:0/458768272 learned_addr learned my addr 172.21.15.175:0/458768272 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:03:55.740 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.748+0000 7f29b3e00640 1 -- 172.21.15.175:0/458768272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29b406aec0 msgr2=0x7f29b40af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:55.740 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.748+0000 7f29b3e00640 1 --2- 172.21.15.175:0/458768272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29b406aec0 0x7f29b40af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.740 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.748+0000 7f29b3e00640 1 -- 172.21.15.175:0/458768272 >> v2:172.21.15.177:3300/0 conn(0x7f29b40700d0 msgr2=0x7f29b4070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:55.740 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.748+0000 7f29b3e00640 1 --2- 172.21.15.175:0/458768272 >> v2:172.21.15.177:3300/0 conn(0x7f29b40700d0 0x7f29b4070560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.740 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.748+0000 7f29b3e00640 1 -- 172.21.15.175:0/458768272 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40b52f0 con 0x7f29b406b2a0 2024-04-25T09:03:55.744 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.752+0000 7f29b3e00640 1 --2- 172.21.15.175:0/458768272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29b406b2a0 0x7f29b406fb90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f29b40b4c30 tx=0x7f29a001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58d7eaac2ba93ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:55.744 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.756+0000 7f29b3400640 1 -- 172.21.15.175:0/458768272 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00b0070 con 0x7f29b406b2a0 2024-04-25T09:03:55.744 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.756+0000 7f29b3400640 1 -- 172.21.15.175:0/458768272 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a00ab600 con 0x7f29b406b2a0 2024-04-25T09:03:55.744 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.756+0000 7f29b3400640 1 -- 172.21.15.175:0/458768272 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00ab9d0 con 0x7f29b406b2a0 2024-04-25T09:03:55.745 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.756+0000 7f29ba600640 1 -- 172.21.15.175:0/458768272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29b406b2a0 msgr2=0x7f29b406fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.745 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.756+0000 7f29ba600640 1 --2- 172.21.15.175:0/458768272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29b406b2a0 0x7f29b406fb90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f29b40b4c30 tx=0x7f29a001c490 comp rx=0 tx=0).stop 2024-04-25T09:03:55.746 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.756+0000 7f29ba600640 1 -- 172.21.15.175:0/458768272 shutdown_connections 2024-04-25T09:03:55.746 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.756+0000 7f29ba600640 1 --2- 172.21.15.175:0/458768272 >> v2:172.21.15.177:3300/0 conn(0x7f29b40700d0 0x7f29b4070560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.746 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.756+0000 7f29ba600640 1 --2- 172.21.15.175:0/458768272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29b406b2a0 0x7f29b406fb90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.746 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.756+0000 7f29ba600640 1 --2- 172.21.15.175:0/458768272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29b406aec0 0x7f29b40af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.746 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.756+0000 7f29ba600640 1 -- 172.21.15.175:0/458768272 >> 172.21.15.175:0/458768272 conn(0x7f29b40b2440 msgr2=0x7f29b40b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:55.746 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.756+0000 7f29ba600640 1 -- 172.21.15.175:0/458768272 shutdown_connections 2024-04-25T09:03:55.747 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.756+0000 7f29ba600640 1 -- 172.21.15.175:0/458768272 wait complete. 2024-04-25T09:03:55.748 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.760+0000 7f29ba600640 1 Processor -- start 2024-04-25T09:03:55.750 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.760+0000 7f29ba600640 1 -- start start 2024-04-25T09:03:55.750 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.760+0000 7f29ba600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29b406aec0 0x7f29b4137ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.751 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.760+0000 7f29ba600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29b406b2a0 0x7f29b41591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.751 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.760+0000 7f29ba600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29b40700d0 0x7f29b40b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.751 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.760+0000 7f29ba600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40b01c0 con 0x7f29b406b2a0 2024-04-25T09:03:55.751 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.760+0000 7f29ba600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40b0040 con 0x7f29b406aec0 2024-04-25T09:03:55.751 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.760+0000 7f29ba600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40cf1b0 con 0x7f29b40700d0 2024-04-25T09:03:55.751 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.760+0000 7f29b3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29b406b2a0 0x7f29b41591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.751 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.760+0000 7f29b9200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29b406aec0 0x7f29b4137ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.751 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.760+0000 7f29b9200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29b406aec0 0x7f29b4137ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:39818/0 (socket says 172.21.15.175:39818) 2024-04-25T09:03:55.751 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.760+0000 7f29b9200640 1 -- 172.21.15.175:0/2527525425 learned_addr learned my addr 172.21.15.175:0/2527525425 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:03:55.752 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.760+0000 7f29b3e00640 1 -- 172.21.15.175:0/2527525425 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29b40700d0 msgr2=0x7f29b40b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.752 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.760+0000 7f29b3e00640 1 --2- 172.21.15.175:0/2527525425 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29b40700d0 0x7f29b40b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.752 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.760+0000 7f29b3e00640 1 -- 172.21.15.175:0/2527525425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29b406aec0 msgr2=0x7f29b4137ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:55.752 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.760+0000 7f29b3e00640 1 --2- 172.21.15.175:0/2527525425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29b406aec0 0x7f29b4137ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:55.752 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.760+0000 7f29b3e00640 1 -- 172.21.15.175:0/2527525425 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b4138420 con 0x7f29b406b2a0 2024-04-25T09:03:55.752 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.760+0000 7f29b9200640 1 --2- 172.21.15.175:0/2527525425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29b406aec0 0x7f29b4137ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:55.752 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.764+0000 7f29b3e00640 1 --2- 172.21.15.175:0/2527525425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29b406b2a0 0x7f29b41591b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f29b4071ed0 tx=0x7f29a0019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:55.753 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.764+0000 7f29b0c00640 1 -- 172.21.15.175:0/2527525425 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00bb070 con 0x7f29b406b2a0 2024-04-25T09:03:55.754 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.764+0000 7f29b0c00640 1 -- 172.21.15.175:0/2527525425 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a00b6440 con 0x7f29b406b2a0 2024-04-25T09:03:55.754 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.764+0000 7f29b0c00640 1 -- 172.21.15.175:0/2527525425 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00bb070 con 0x7f29b406b2a0 2024-04-25T09:03:55.754 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.764+0000 7f29ba600640 1 -- 172.21.15.175:0/2527525425 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b4159c70 con 0x7f29b406b2a0 2024-04-25T09:03:55.754 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.764+0000 7f29ba600640 1 -- 172.21.15.175:0/2527525425 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b415a230 con 0x7f29b406b2a0 2024-04-25T09:03:55.757 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.768+0000 7f29b0c00640 1 -- 172.21.15.175:0/2527525425 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 4) v1 ==== 86671+0+0 (secure 0 0 0) 0x7f29a00b4430 con 0x7f29b406b2a0 2024-04-25T09:03:55.757 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.768+0000 7f29ba600640 1 -- 172.21.15.175:0/2527525425 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b4074fc0 con 0x7f29b406b2a0 2024-04-25T09:03:55.759 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.768+0000 7f29b0c00640 1 --2- 172.21.15.175:0/2527525425 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f29940670d0 0x7f2994069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:55.759 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.768+0000 7f29b0c00640 1 -- 172.21.15.175:0/2527525425 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f29a011d560 con 0x7f29b406b2a0 2024-04-25T09:03:55.759 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.768+0000 7f29b9200640 1 --2- 172.21.15.175:0/2527525425 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f29940670d0 0x7f2994069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:55.760 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.772+0000 7f29b9200640 1 --2- 172.21.15.175:0/2527525425 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f29940670d0 0x7f2994069590 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009e20 tx=0x7f29a8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:55.766 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:55.776+0000 7f29b0c00640 1 -- 172.21.15.175:0/2527525425 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f29a0016110 con 0x7f29b406b2a0 2024-04-25T09:03:55.931 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-04-25T09:03:55.942+0000 7f61cd200640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T09:03:55.954 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-04-25T09:03:55.966+0000 7f3f6ea00640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T09:03:55.958 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-04-25T09:03:55.970+0000 7fdba5400640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T09:03:55.969 INFO:tasks.ceph.osd.5.smithi177.stderr:2024-04-25T09:03:55.982+0000 7f61c1e00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:03:55.985 INFO:tasks.ceph.osd.6.smithi177.stderr:2024-04-25T09:03:55.998+0000 7f3f63600640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:03:55.997 INFO:tasks.ceph.osd.4.smithi177.stderr:2024-04-25T09:03:56.010+0000 7fdb9be00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:03:56.047 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-04-25T09:03:56.058+0000 7fad45a00640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T09:03:56.053 INFO:tasks.ceph.osd.0.smithi175.stderr:2024-04-25T09:03:56.064+0000 7f9eca400640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T09:03:56.069 INFO:tasks.ceph.osd.7.smithi177.stderr:2024-04-25T09:03:56.082+0000 7fad3c400640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:03:56.086 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-25T09:03:56.096+0000 7f65ba400640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T09:03:56.091 INFO:tasks.ceph.osd.0.smithi175.stderr:2024-04-25T09:03:56.100+0000 7f9ec0e00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:03:56.091 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:56.100+0000 7f29ba600640 1 -- 172.21.15.175:0/2527525425 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29b40b1810 con 0x7f29b406b2a0 2024-04-25T09:03:56.093 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:56.104+0000 7f29b0c00640 1 -- 172.21.15.175:0/2527525425 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f29a00f50e0 con 0x7f29b406b2a0 2024-04-25T09:03:56.093 INFO:teuthology.misc.health.smithi175.stdout: 2024-04-25T09:03:56.093 INFO:teuthology.misc.health.smithi175.stdout:{"epoch":12,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:03:53.794926+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:56.096 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:56.104+0000 7f29ba600640 1 -- 172.21.15.175:0/2527525425 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f29940670d0 msgr2=0x7f2994069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.096 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:56.104+0000 7f29ba600640 1 --2- 172.21.15.175:0/2527525425 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f29940670d0 0x7f2994069590 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009e20 tx=0x7f29a8009210 comp rx=0 tx=0).stop 2024-04-25T09:03:56.096 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:56.104+0000 7f29ba600640 1 -- 172.21.15.175:0/2527525425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29b406b2a0 msgr2=0x7f29b41591b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:56.096 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:56.104+0000 7f29ba600640 1 --2- 172.21.15.175:0/2527525425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29b406b2a0 0x7f29b41591b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f29b4071ed0 tx=0x7f29a0019230 comp rx=0 tx=0).stop 2024-04-25T09:03:56.096 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:56.104+0000 7f29ba600640 1 -- 172.21.15.175:0/2527525425 shutdown_connections 2024-04-25T09:03:56.096 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:56.108+0000 7f29ba600640 1 --2- 172.21.15.175:0/2527525425 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f29940670d0 0x7f2994069590 secure :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009e20 tx=0x7f29a8009210 comp rx=0 tx=0).stop 2024-04-25T09:03:56.096 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:56.108+0000 7f29ba600640 1 --2- 172.21.15.175:0/2527525425 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29b40700d0 0x7f29b40b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.097 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:56.108+0000 7f29ba600640 1 --2- 172.21.15.175:0/2527525425 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f29b406b2a0 0x7f29b41591b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.097 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:56.108+0000 7f29ba600640 1 --2- 172.21.15.175:0/2527525425 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29b406aec0 0x7f29b4137ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:56.097 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:56.108+0000 7f29ba600640 1 -- 172.21.15.175:0/2527525425 >> 172.21.15.175:0/2527525425 conn(0x7f29b40b2440 msgr2=0x7f29b40b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:56.097 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:56.108+0000 7f29ba600640 1 -- 172.21.15.175:0/2527525425 shutdown_connections 2024-04-25T09:03:56.097 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:03:56.108+0000 7f29ba600640 1 -- 172.21.15.175:0/2527525425 wait complete. 2024-04-25T09:03:56.125 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T09:03:56.126 INFO:tasks.ceph.osd.2.smithi175.stderr:2024-04-25T09:03:56.136+0000 7f65b0e00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:03:56.132 INFO:tasks.ceph.osd.1.smithi175.stderr:2024-04-25T09:03:56.144+0000 7ffb69e00640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T09:03:56.137 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-25T09:03:56.148+0000 7f3d8b200640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T09:03:56.185 INFO:tasks.ceph.osd.3.smithi175.stderr:2024-04-25T09:03:56.196+0000 7f3d81c00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:03:56.186 INFO:tasks.ceph.osd.1.smithi175.stderr:2024-04-25T09:03:56.196+0000 7ffb60800640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:04:02.932 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:03.068 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.076+0000 7fa99f200640 1 Processor -- start 2024-04-25T09:04:03.068 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.076+0000 7fa99f200640 1 -- start start 2024-04-25T09:04:03.069 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa99f200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa99815df00 0x7fa9980add50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.070 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa99f200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99806fdf0 con 0x7fa9980aeab0 2024-04-25T09:04:03.070 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa99f200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa998072370 con 0x7fa998071af0 2024-04-25T09:04:03.070 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa99f200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9980ad040 con 0x7fa99815df00 2024-04-25T09:04:03.070 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa997400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa9980aeab0 0x7fa9980713e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:48240/0 (socket says 172.21.15.175:48240) 2024-04-25T09:04:03.070 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa997400640 1 -- 172.21.15.175:0/3221981887 learned_addr learned my addr 172.21.15.175:0/3221981887 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:03.072 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa997e00640 1 --2- 172.21.15.175:0/3221981887 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa99815df00 0x7fa9980add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.072 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa996a00640 1 -- 172.21.15.175:0/3221981887 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287362906 0 0) 0x7fa99806fdf0 con 0x7fa9980aeab0 2024-04-25T09:04:03.072 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa996a00640 1 -- 172.21.15.175:0/3221981887 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa97c003530 con 0x7fa9980aeab0 2024-04-25T09:04:03.072 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa996a00640 1 -- 172.21.15.175:0/3221981887 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3875387766 0 0) 0x7fa97c003530 con 0x7fa9980aeab0 2024-04-25T09:04:03.072 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa996a00640 1 -- 172.21.15.175:0/3221981887 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa99815df00 msgr2=0x7fa9980add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.072 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa996a00640 1 --2- 172.21.15.175:0/3221981887 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa99815df00 0x7fa9980add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.072 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa996a00640 1 -- 172.21.15.175:0/3221981887 >> v1:172.21.15.177:6789/0 conn(0x7fa998071af0 legacy=0x7fa99806d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.072 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa996a00640 1 -- 172.21.15.175:0/3221981887 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9980ad270 con 0x7fa9980aeab0 2024-04-25T09:04:03.072 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa996a00640 1 -- 172.21.15.175:0/3221981887 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fa988001680 con 0x7fa9980aeab0 2024-04-25T09:04:03.072 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa996a00640 1 -- 172.21.15.175:0/3221981887 >> v1:172.21.15.175:6789/0 conn(0x7fa9980aeab0 legacy=0x7fa9980713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.072 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa996a00640 1 --2- 172.21.15.175:0/3221981887 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa99815df00 0x7fa97c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.072 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa996a00640 1 --2- 172.21.15.175:0/3221981887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa97c003f70 0x7fa97c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.073 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa996a00640 1 --2- 172.21.15.175:0/3221981887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa97c004d50 0x7fa97c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.073 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa996a00640 1 -- 172.21.15.175:0/3221981887 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c00ba80 con 0x7fa97c004d50 2024-04-25T09:04:03.073 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa996a00640 1 -- 172.21.15.175:0/3221981887 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c00bc30 con 0x7fa97c003f70 2024-04-25T09:04:03.073 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa996a00640 1 -- 172.21.15.175:0/3221981887 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c00be30 con 0x7fa99815df00 2024-04-25T09:04:03.073 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa99d200640 1 --2- 172.21.15.175:0/3221981887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa97c004d50 0x7fa97c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.073 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa997e00640 1 --2- 172.21.15.175:0/3221981887 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa99815df00 0x7fa97c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.073 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa997400640 1 --2- 172.21.15.175:0/3221981887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa97c003f70 0x7fa97c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.073 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa99d200640 1 -- 172.21.15.175:0/3221981887 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa99815df00 msgr2=0x7fa97c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.073 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa99d200640 1 --2- 172.21.15.175:0/3221981887 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa99815df00 0x7fa97c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.073 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa99d200640 1 -- 172.21.15.175:0/3221981887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa97c003f70 msgr2=0x7fa97c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.073 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa99d200640 1 --2- 172.21.15.175:0/3221981887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa97c003f70 0x7fa97c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.073 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.080+0000 7fa99d200640 1 -- 172.21.15.175:0/3221981887 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97c003530 con 0x7fa97c004d50 2024-04-25T09:04:03.074 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.084+0000 7fa99d200640 1 --2- 172.21.15.175:0/3221981887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa97c004d50 0x7fa97c0051d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa990001e40 tx=0x7fa99001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35fb1895185736e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.074 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.084+0000 7fa996a00640 1 -- 172.21.15.175:0/3221981887 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990001a90 con 0x7fa97c004d50 2024-04-25T09:04:03.074 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.084+0000 7fa996a00640 1 -- 172.21.15.175:0/3221981887 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa990003b80 con 0x7fa97c004d50 2024-04-25T09:04:03.074 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.084+0000 7fa996a00640 1 -- 172.21.15.175:0/3221981887 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990005080 con 0x7fa97c004d50 2024-04-25T09:04:03.075 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.084+0000 7fa99f200640 1 -- 172.21.15.175:0/3221981887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa97c004d50 msgr2=0x7fa97c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.075 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.084+0000 7fa99f200640 1 --2- 172.21.15.175:0/3221981887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa97c004d50 0x7fa97c0051d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa990001e40 tx=0x7fa99001c760 comp rx=0 tx=0).stop 2024-04-25T09:04:03.075 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.084+0000 7fa99d200640 1 -- 172.21.15.175:0/3221981887 reap_dead start 2024-04-25T09:04:03.076 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.084+0000 7fa99f200640 1 -- 172.21.15.175:0/3221981887 shutdown_connections 2024-04-25T09:04:03.076 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.084+0000 7fa99f200640 1 -- 172.21.15.175:0/3221981887 >> 172.21.15.175:0/3221981887 conn(0x7fa99806ac60 msgr2=0x7fa99806b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.076 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.084+0000 7fa99f200640 1 -- 172.21.15.175:0/3221981887 shutdown_connections 2024-04-25T09:04:03.076 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.084+0000 7fa99f200640 1 -- 172.21.15.175:0/3221981887 wait complete. 2024-04-25T09:04:03.077 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa99f200640 1 Processor -- start 2024-04-25T09:04:03.077 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa99f200640 1 -- start start 2024-04-25T09:04:03.079 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa99f200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa97c004d50 0x7fa998154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.079 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa99f200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa99815a3b0 0x7fa9981f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.079 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa99f200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9981f3b30 0x7fa99815b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.079 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa99f200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa998072650 con 0x7fa99815a3b0 2024-04-25T09:04:03.079 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa99f200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa998072120 con 0x7fa9981f3b30 2024-04-25T09:04:03.079 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa99f200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9980ad8c0 con 0x7fa97c004d50 2024-04-25T09:04:03.080 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa997400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa99815a3b0 0x7fa9981f35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.080 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa997400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa99815a3b0 0x7fa9981f35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35542/0 (socket says 172.21.15.175:35542) 2024-04-25T09:04:03.080 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa997400640 1 -- 172.21.15.175:0/3840460032 learned_addr learned my addr 172.21.15.175:0/3840460032 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:03.080 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa997e00640 1 --2- 172.21.15.175:0/3840460032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa97c004d50 0x7fa998154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.080 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa99d200640 1 --2- 172.21.15.175:0/3840460032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9981f3b30 0x7fa99815b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.080 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa997400640 1 -- 172.21.15.175:0/3840460032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa97c004d50 msgr2=0x7fa998154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.080 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa997400640 1 --2- 172.21.15.175:0/3840460032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa97c004d50 0x7fa998154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.080 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa997400640 1 -- 172.21.15.175:0/3840460032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9981f3b30 msgr2=0x7fa99815b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.080 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa997400640 1 --2- 172.21.15.175:0/3840460032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9981f3b30 0x7fa99815b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.080 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa997400640 1 -- 172.21.15.175:0/3840460032 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99815e480 con 0x7fa99815a3b0 2024-04-25T09:04:03.080 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa99d200640 1 --2- 172.21.15.175:0/3840460032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9981f3b30 0x7fa99815b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:03.080 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa997400640 1 --2- 172.21.15.175:0/3840460032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa99815a3b0 0x7fa9981f35f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa988007fd0 tx=0x7fa988007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.080 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa98fe00640 1 -- 172.21.15.175:0/3840460032 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98800f9c0 con 0x7fa99815a3b0 2024-04-25T09:04:03.080 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa98fe00640 1 -- 172.21.15.175:0/3840460032 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa988018070 con 0x7fa99815a3b0 2024-04-25T09:04:03.080 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa98fe00640 1 -- 172.21.15.175:0/3840460032 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98800fd60 con 0x7fa99815a3b0 2024-04-25T09:04:03.081 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa99f200640 1 -- 172.21.15.175:0/3840460032 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99815e760 con 0x7fa99815a3b0 2024-04-25T09:04:03.081 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.088+0000 7fa99f200640 1 -- 172.21.15.175:0/3840460032 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99815ed20 con 0x7fa99815a3b0 2024-04-25T09:04:03.081 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.092+0000 7fa99f200640 1 -- 172.21.15.175:0/3840460032 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa998068180 con 0x7fa99815a3b0 2024-04-25T09:04:03.081 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.092+0000 7fa98fe00640 1 -- 172.21.15.175:0/3840460032 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa98801d460 con 0x7fa99815a3b0 2024-04-25T09:04:03.083 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.092+0000 7fa98fe00640 1 --2- 172.21.15.175:0/3840460032 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa974066f60 0x7fa974069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.083 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.092+0000 7fa98fe00640 1 -- 172.21.15.175:0/3840460032 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa988084f20 con 0x7fa99815a3b0 2024-04-25T09:04:03.083 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.092+0000 7fa997e00640 1 --2- 172.21.15.175:0/3840460032 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa974066f60 0x7fa974069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.083 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.092+0000 7fa997e00640 1 --2- 172.21.15.175:0/3840460032 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa974066f60 0x7fa974069420 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa980009b20 tx=0x7fa980008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.087 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.096+0000 7fa98fe00640 1 -- 172.21.15.175:0/3840460032 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa988056270 con 0x7fa99815a3b0 2024-04-25T09:04:03.242 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.252+0000 7fa99f200640 1 -- 172.21.15.175:0/3840460032 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa99806f560 con 0x7fa99815a3b0 2024-04-25T09:04:03.242 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.252+0000 7fa98fe00640 1 -- 172.21.15.175:0/3840460032 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12920 (secure 0 0 0) 0x7fa988055b70 con 0x7fa99815a3b0 2024-04-25T09:04:03.243 INFO:teuthology.misc.health.smithi175.stdout: 2024-04-25T09:04:03.243 INFO:teuthology.misc.health.smithi175.stdout:{"epoch":16,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:03:59.989147+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:03.245 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.256+0000 7fa99f200640 1 -- 172.21.15.175:0/3840460032 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa974066f60 msgr2=0x7fa974069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.245 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.256+0000 7fa99f200640 1 --2- 172.21.15.175:0/3840460032 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa974066f60 0x7fa974069420 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa980009b20 tx=0x7fa980008040 comp rx=0 tx=0).stop 2024-04-25T09:04:03.245 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.256+0000 7fa99f200640 1 -- 172.21.15.175:0/3840460032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa99815a3b0 msgr2=0x7fa9981f35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.245 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.256+0000 7fa99f200640 1 --2- 172.21.15.175:0/3840460032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa99815a3b0 0x7fa9981f35f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa988007fd0 tx=0x7fa988007720 comp rx=0 tx=0).stop 2024-04-25T09:04:03.245 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.256+0000 7fa99f200640 1 -- 172.21.15.175:0/3840460032 shutdown_connections 2024-04-25T09:04:03.246 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.256+0000 7fa99f200640 1 --2- 172.21.15.175:0/3840460032 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa974066f60 0x7fa974069420 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.246 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.256+0000 7fa99f200640 1 --2- 172.21.15.175:0/3840460032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9981f3b30 0x7fa99815b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.246 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.256+0000 7fa99f200640 1 --2- 172.21.15.175:0/3840460032 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa99815a3b0 0x7fa9981f35f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.246 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.256+0000 7fa99f200640 1 --2- 172.21.15.175:0/3840460032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa97c004d50 0x7fa998154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.246 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.256+0000 7fa99f200640 1 -- 172.21.15.175:0/3840460032 >> 172.21.15.175:0/3840460032 conn(0x7fa99806ac60 msgr2=0x7fa99806d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.246 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.256+0000 7fa99f200640 1 -- 172.21.15.175:0/3840460032 shutdown_connections 2024-04-25T09:04:03.246 INFO:teuthology.misc.health.smithi175.stderr:2024-04-25T09:04:03.256+0000 7fa99f200640 1 -- 172.21.15.175:0/3840460032 wait complete. 2024-04-25T09:04:03.262 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T09:04:03.262 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T09:04:03.263 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:04:03.263 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:04:03.266 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:04:03.266 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:04:03.266 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:04:03.269 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:04:03.269 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:04:03.269 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:04:03.273 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:04:03.273 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:04:03.273 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:04:03.276 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:04:03.277 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T09:04:03.277 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:03.366 INFO:tasks.ceph.mds.c.smithi175.stdout:starting mds.c at 2024-04-25T09:04:03.366 INFO:tasks.ceph.mds.a.smithi175.stdout:starting mds.a at 2024-04-25T09:04:03.385 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-04-25T09:04:03.386 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-04-25T09:04:03.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.432+0000 7f7c8bc00640 1 Processor -- start 2024-04-25T09:04:03.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.432+0000 7f7c8bc00640 1 -- start start 2024-04-25T09:04:03.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.432+0000 7f7c8bc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c841453a0 0x7f7c8415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.432+0000 7f7c8bc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7c8415c410 0x7f7c840cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.432+0000 7f7c8bc00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c8415cd00 con 0x7f7c84144fc0 2024-04-25T09:04:03.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.432+0000 7f7c8bc00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c840ce660 con 0x7f7c8415c410 2024-04-25T09:04:03.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.432+0000 7f7c8bc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8415c840 con 0x7f7c841453a0 2024-04-25T09:04:03.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.432+0000 7f7c89c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7c8415c410 0x7f7c840cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.432+0000 7f7c89c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7c8415c410 0x7f7c840cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35564/0 (socket says 172.21.15.175:35564) 2024-04-25T09:04:03.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.432+0000 7f7c89c00640 1 -- 172.21.15.175:0/1059686866 learned_addr learned my addr 172.21.15.175:0/1059686866 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:03.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.432+0000 7f7c89200640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7c84144fc0 0x7f7c840cbe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:48268/0 (socket says 172.21.15.175:48268) 2024-04-25T09:04:03.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.432+0000 7f7c7be00640 1 --2- 172.21.15.175:0/1059686866 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c841453a0 0x7f7c8415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.436+0000 7f7c89c00640 1 -- 172.21.15.175:0/1059686866 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c841453a0 msgr2=0x7f7c8415bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.436+0000 7f7c89c00640 1 --2- 172.21.15.175:0/1059686866 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c841453a0 0x7f7c8415bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.436+0000 7f7c89c00640 1 -- 172.21.15.175:0/1059686866 >> v1:172.21.15.175:6789/0 conn(0x7f7c84144fc0 legacy=0x7f7c840cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.436+0000 7f7c89c00640 1 -- 172.21.15.175:0/1059686866 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c840cc930 con 0x7f7c8415c410 2024-04-25T09:04:03.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.436+0000 7f7c83e00640 1 -- 172.21.15.175:0/1059686866 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512311389 0 0) 0x7f7c8415cd00 con 0x7f7c84144fc0 2024-04-25T09:04:03.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.436+0000 7f7c89c00640 1 --2- 172.21.15.175:0/1059686866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c8415c410 0x7f7c840cee20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c009e50 tx=0x7f7c7c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cbffb3f0d1c083 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.436+0000 7f7c83e00640 1 -- 172.21.15.175:0/1059686866 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c0a57f0 con 0x7f7c8415c410 2024-04-25T09:04:03.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.436+0000 7f7c83e00640 1 -- 172.21.15.175:0/1059686866 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7c0a5990 con 0x7f7c8415c410 2024-04-25T09:04:03.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.436+0000 7f7c83e00640 1 -- 172.21.15.175:0/1059686866 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c0a5d60 con 0x7f7c8415c410 2024-04-25T09:04:03.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.436+0000 7f7c8bc00640 1 -- 172.21.15.175:0/1059686866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c8415c410 msgr2=0x7f7c840cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.436+0000 7f7c8bc00640 1 --2- 172.21.15.175:0/1059686866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c8415c410 0x7f7c840cee20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c009e50 tx=0x7f7c7c01ca30 comp rx=0 tx=0).stop 2024-04-25T09:04:03.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.436+0000 7f7c8bc00640 1 -- 172.21.15.175:0/1059686866 shutdown_connections 2024-04-25T09:04:03.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.436+0000 7f7c8bc00640 1 --2- 172.21.15.175:0/1059686866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c8415c410 0x7f7c840cee20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.436+0000 7f7c8bc00640 1 --2- 172.21.15.175:0/1059686866 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c841453a0 0x7f7c8415bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.436+0000 7f7c8bc00640 1 -- 172.21.15.175:0/1059686866 >> 172.21.15.175:0/1059686866 conn(0x7f7c84067150 msgr2=0x7f7c8406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c8bc00640 1 -- 172.21.15.175:0/1059686866 shutdown_connections 2024-04-25T09:04:03.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c8bc00640 1 -- 172.21.15.175:0/1059686866 wait complete. 2024-04-25T09:04:03.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c8bc00640 1 Processor -- start 2024-04-25T09:04:03.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c8bc00640 1 -- start start 2024-04-25T09:04:03.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c8bc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c841453a0 0x7f7c840afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c8bc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c8415c410 0x7f7c84159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c8bc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c8415ed70 0x7f7c8415f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c8bc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c840cc580 con 0x7f7c8415c410 2024-04-25T09:04:03.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c8bc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c840cfb70 con 0x7f7c841453a0 2024-04-25T09:04:03.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c8bc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8415f760 con 0x7f7c8415ed70 2024-04-25T09:04:03.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c7be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c8415c410 0x7f7c84159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c7be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c8415c410 0x7f7c84159240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35574/0 (socket says 172.21.15.175:35574) 2024-04-25T09:04:03.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c7be00640 1 -- 172.21.15.175:0/593012729 learned_addr learned my addr 172.21.15.175:0/593012729 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:03.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c89c00640 1 --2- 172.21.15.175:0/593012729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c8415ed70 0x7f7c8415f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c89200640 1 --2- 172.21.15.175:0/593012729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c841453a0 0x7f7c840afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c7be00640 1 -- 172.21.15.175:0/593012729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c8415ed70 msgr2=0x7f7c8415f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c7be00640 1 --2- 172.21.15.175:0/593012729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c8415ed70 0x7f7c8415f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c7be00640 1 -- 172.21.15.175:0/593012729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c841453a0 msgr2=0x7f7c840afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c7be00640 1 --2- 172.21.15.175:0/593012729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c841453a0 0x7f7c840afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c7be00640 1 -- 172.21.15.175:0/593012729 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c84141770 con 0x7f7c8415c410 2024-04-25T09:04:03.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c89200640 1 --2- 172.21.15.175:0/593012729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c841453a0 0x7f7c840afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:03.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c7be00640 1 --2- 172.21.15.175:0/593012729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c8415c410 0x7f7c84159240 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00e930 tx=0x7f7c6c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c81600640 1 -- 172.21.15.175:0/593012729 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c017070 con 0x7f7c8415c410 2024-04-25T09:04:03.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c81600640 1 -- 172.21.15.175:0/593012729 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c00ca00 con 0x7f7c8415c410 2024-04-25T09:04:03.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c81600640 1 -- 172.21.15.175:0/593012729 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c00cdb0 con 0x7f7c8415c410 2024-04-25T09:04:03.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.440+0000 7f7c8bc00640 1 -- 172.21.15.175:0/593012729 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c840b0700 con 0x7f7c8415c410 2024-04-25T09:04:03.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.444+0000 7f7c8bc00640 1 -- 172.21.15.175:0/593012729 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c840b0cc0 con 0x7f7c8415c410 2024-04-25T09:04:03.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.444+0000 7f7c8bc00640 1 -- 172.21.15.175:0/593012729 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c84074a60 con 0x7f7c8415c410 2024-04-25T09:04:03.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.444+0000 7f7c81600640 1 -- 172.21.15.175:0/593012729 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7c6c01a070 con 0x7f7c8415c410 2024-04-25T09:04:03.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.444+0000 7f7c81600640 1 --2- 172.21.15.175:0/593012729 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7c60066f60 0x7f7c60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.444+0000 7f7c81600640 1 -- 172.21.15.175:0/593012729 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7c6c0850a0 con 0x7f7c8415c410 2024-04-25T09:04:03.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.444+0000 7f7c89200640 1 --2- 172.21.15.175:0/593012729 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7c60066f60 0x7f7c60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.444+0000 7f7c89200640 1 --2- 172.21.15.175:0/593012729 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7c60066f60 0x7f7c60069420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7c74000f70 tx=0x7f7c74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.448+0000 7f7c81600640 1 -- 172.21.15.175:0/593012729 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7c6c0564b0 con 0x7f7c8415c410 2024-04-25T09:04:03.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.608+0000 7f7c8bc00640 1 -- 172.21.15.175:0/593012729 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c84142740 con 0x7f7c8415c410 2024-04-25T09:04:03.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.608+0000 7f7c81600640 1 -- 172.21.15.175:0/593012729 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12920 (secure 0 0 0) 0x7f7c6c05ae20 con 0x7f7c8415c410 2024-04-25T09:04:03.599 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:03.599 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":16,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:03:59.989147+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:03.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.612+0000 7f7c8bc00640 1 -- 172.21.15.175:0/593012729 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7c60066f60 msgr2=0x7f7c60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.612+0000 7f7c8bc00640 1 --2- 172.21.15.175:0/593012729 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7c60066f60 0x7f7c60069420 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7c74000f70 tx=0x7f7c74009040 comp rx=0 tx=0).stop 2024-04-25T09:04:03.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.612+0000 7f7c8bc00640 1 -- 172.21.15.175:0/593012729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c8415c410 msgr2=0x7f7c84159240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.612+0000 7f7c8bc00640 1 --2- 172.21.15.175:0/593012729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c8415c410 0x7f7c84159240 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00e930 tx=0x7f7c6c00edf0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.612+0000 7f7c8bc00640 1 -- 172.21.15.175:0/593012729 shutdown_connections 2024-04-25T09:04:03.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.612+0000 7f7c8bc00640 1 --2- 172.21.15.175:0/593012729 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7c60066f60 0x7f7c60069420 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.612+0000 7f7c8bc00640 1 --2- 172.21.15.175:0/593012729 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c8415ed70 0x7f7c8415f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.612+0000 7f7c8bc00640 1 --2- 172.21.15.175:0/593012729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c8415c410 0x7f7c84159240 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.612+0000 7f7c8bc00640 1 --2- 172.21.15.175:0/593012729 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c841453a0 0x7f7c840afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.612+0000 7f7c8bc00640 1 -- 172.21.15.175:0/593012729 >> 172.21.15.175:0/593012729 conn(0x7f7c84144fc0 msgr2=0x7f7c8413a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.612+0000 7f7c8bc00640 1 -- 172.21.15.175:0/593012729 shutdown_connections 2024-04-25T09:04:03.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.612+0000 7f7c8bc00640 1 -- 172.21.15.175:0/593012729 wait complete. 2024-04-25T09:04:03.619 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:03.619 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:03.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.768+0000 7f9eb3e00640 1 Processor -- start 2024-04-25T09:04:03.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.768+0000 7f9eb3e00640 1 -- start start 2024-04-25T09:04:03.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.768+0000 7f9eb3e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9eac15af20 0x7f9eac0b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.768+0000 7f9eb3e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9eac0b4630 0x7f9eac15c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.768+0000 7f9eb3e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eac06db60 con 0x7f9eac0cbe60 2024-04-25T09:04:03.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.768+0000 7f9eb3e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac06de40 con 0x7f9eac15af20 2024-04-25T09:04:03.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.768+0000 7f9eb3e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac06e120 con 0x7f9eac0b4630 2024-04-25T09:04:03.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.768+0000 7f9eb0a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9eac15af20 0x7f9eac0b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.768+0000 7f9eb1400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f9eac0cbe60 0x7f9eac06d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:56764/0 (socket says 172.21.15.175:56764) 2024-04-25T09:04:03.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.768+0000 7f9eb1400640 1 -- 172.21.15.175:0/1801814833 learned_addr learned my addr 172.21.15.175:0/1801814833 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:03.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.768+0000 7f9eb1e00640 1 --2- 172.21.15.175:0/1801814833 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9eac0b4630 0x7f9eac15c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eabe00640 1 -- 172.21.15.175:0/1801814833 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868303250 0 0) 0x7f9eac06db60 con 0x7f9eac0cbe60 2024-04-25T09:04:03.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eabe00640 1 -- 172.21.15.175:0/1801814833 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e94005740 con 0x7f9eac0cbe60 2024-04-25T09:04:03.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eb0a00640 1 -- 172.21.15.175:0/1801814833 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9eac0b4630 msgr2=0x7f9eac15c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:03.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eb0a00640 1 --2- 172.21.15.175:0/1801814833 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9eac0b4630 0x7f9eac15c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eb0a00640 1 -- 172.21.15.175:0/1801814833 >> v1:172.21.15.177:6789/0 conn(0x7f9eac0cbe60 legacy=0x7f9eac06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eb0a00640 1 -- 172.21.15.175:0/1801814833 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac15c2f0 con 0x7f9eac15af20 2024-04-25T09:04:03.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eb1e00640 1 --2- 172.21.15.175:0/1801814833 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9eac0b4630 0x7f9eac15c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:03.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eb0a00640 1 --2- 172.21.15.175:0/1801814833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eac15af20 0x7f9eac0b40f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9e980097c0 tx=0x7f9e9801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccef13529402300c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eabe00640 1 -- 172.21.15.175:0/1801814833 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e980b0070 con 0x7f9eac15af20 2024-04-25T09:04:03.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eabe00640 1 -- 172.21.15.175:0/1801814833 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e980ab600 con 0x7f9eac15af20 2024-04-25T09:04:03.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eabe00640 1 -- 172.21.15.175:0/1801814833 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e980ab9d0 con 0x7f9eac15af20 2024-04-25T09:04:03.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eb3e00640 1 -- 172.21.15.175:0/1801814833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eac15af20 msgr2=0x7f9eac0b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eb3e00640 1 --2- 172.21.15.175:0/1801814833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eac15af20 0x7f9eac0b40f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9e980097c0 tx=0x7f9e9801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eb3e00640 1 -- 172.21.15.175:0/1801814833 shutdown_connections 2024-04-25T09:04:03.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eb3e00640 1 --2- 172.21.15.175:0/1801814833 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9eac0b4630 0x7f9eac15c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eb3e00640 1 --2- 172.21.15.175:0/1801814833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eac15af20 0x7f9eac0b40f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eb3e00640 1 -- 172.21.15.175:0/1801814833 >> 172.21.15.175:0/1801814833 conn(0x7f9eac06ac50 msgr2=0x7f9eac06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eb3e00640 1 -- 172.21.15.175:0/1801814833 shutdown_connections 2024-04-25T09:04:03.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.772+0000 7f9eb3e00640 1 -- 172.21.15.175:0/1801814833 wait complete. 2024-04-25T09:04:03.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb3e00640 1 Processor -- start 2024-04-25T09:04:03.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb3e00640 1 -- start start 2024-04-25T09:04:03.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eac0b4630 0x7f9eac0ce210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb3e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9eac0cbe60 0x7f9eac159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9eac15af20 0x7f9eac159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb3e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac15d970 con 0x7f9eac0b4630 2024-04-25T09:04:03.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb3e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac15d7f0 con 0x7f9eac15af20 2024-04-25T09:04:03.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb3e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac15daf0 con 0x7f9eac0cbe60 2024-04-25T09:04:03.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb1400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eac0b4630 0x7f9eac0ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb1400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eac0b4630 0x7f9eac0ce210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35598/0 (socket says 172.21.15.175:35598) 2024-04-25T09:04:03.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb1400640 1 -- 172.21.15.175:0/1913672193 learned_addr learned my addr 172.21.15.175:0/1913672193 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:03.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb0a00640 1 --2- 172.21.15.175:0/1913672193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9eac0cbe60 0x7f9eac159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb1e00640 1 --2- 172.21.15.175:0/1913672193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9eac15af20 0x7f9eac159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb1400640 1 -- 172.21.15.175:0/1913672193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9eac0cbe60 msgr2=0x7f9eac159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb1400640 1 --2- 172.21.15.175:0/1913672193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9eac0cbe60 0x7f9eac159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb1400640 1 -- 172.21.15.175:0/1913672193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9eac15af20 msgr2=0x7f9eac159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb1400640 1 --2- 172.21.15.175:0/1913672193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9eac15af20 0x7f9eac159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb1400640 1 -- 172.21.15.175:0/1913672193 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac1519e0 con 0x7f9eac0b4630 2024-04-25T09:04:03.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb1400640 1 --2- 172.21.15.175:0/1913672193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eac0b4630 0x7f9eac0ce210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000c3c0 tx=0x7f9ea000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9ea9600640 1 -- 172.21.15.175:0/1913672193 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0017070 con 0x7f9eac0b4630 2024-04-25T09:04:03.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9ea9600640 1 -- 172.21.15.175:0/1913672193 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea0005db0 con 0x7f9eac0b4630 2024-04-25T09:04:03.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9ea9600640 1 -- 172.21.15.175:0/1913672193 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea00072f0 con 0x7f9eac0b4630 2024-04-25T09:04:03.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb3e00640 1 -- 172.21.15.175:0/1913672193 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eac151cc0 con 0x7f9eac0b4630 2024-04-25T09:04:03.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.776+0000 7f9eb3e00640 1 -- 172.21.15.175:0/1913672193 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac152280 con 0x7f9eac0b4630 2024-04-25T09:04:03.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.780+0000 7f9eb3e00640 1 -- 172.21.15.175:0/1913672193 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eac075160 con 0x7f9eac0b4630 2024-04-25T09:04:03.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.780+0000 7f9ea9600640 1 -- 172.21.15.175:0/1913672193 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9ea001a070 con 0x7f9eac0b4630 2024-04-25T09:04:03.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.780+0000 7f9ea9600640 1 --2- 172.21.15.175:0/1913672193 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9e8c066f60 0x7f9e8c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:03.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.780+0000 7f9ea9600640 1 -- 172.21.15.175:0/1913672193 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9ea00840a0 con 0x7f9eac0b4630 2024-04-25T09:04:03.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.780+0000 7f9eb0a00640 1 --2- 172.21.15.175:0/1913672193 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9e8c066f60 0x7f9e8c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:03.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.780+0000 7f9eb0a00640 1 --2- 172.21.15.175:0/1913672193 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9e8c066f60 0x7f9e8c069420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9e980ad000 tx=0x7f9e98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:03.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.784+0000 7f9ea9600640 1 -- 172.21.15.175:0/1913672193 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9ea0054da0 con 0x7f9eac0b4630 2024-04-25T09:04:03.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.940+0000 7f9eb3e00640 1 -- 172.21.15.175:0/1913672193 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9eac06c2d0 con 0x7f9eac0b4630 2024-04-25T09:04:03.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.940+0000 7f9ea9600640 1 -- 172.21.15.175:0/1913672193 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ea0058e40 con 0x7f9eac0b4630 2024-04-25T09:04:03.931 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:04:03.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.944+0000 7f9eb3e00640 1 -- 172.21.15.175:0/1913672193 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9e8c066f60 msgr2=0x7f9e8c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.944+0000 7f9eb3e00640 1 --2- 172.21.15.175:0/1913672193 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9e8c066f60 0x7f9e8c069420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9e980ad000 tx=0x7f9e98008040 comp rx=0 tx=0).stop 2024-04-25T09:04:03.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.944+0000 7f9eb3e00640 1 -- 172.21.15.175:0/1913672193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eac0b4630 msgr2=0x7f9eac0ce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:03.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.944+0000 7f9eb3e00640 1 --2- 172.21.15.175:0/1913672193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eac0b4630 0x7f9eac0ce210 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000c3c0 tx=0x7f9ea000c7c0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.944+0000 7f9eb3e00640 1 -- 172.21.15.175:0/1913672193 shutdown_connections 2024-04-25T09:04:03.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.944+0000 7f9eb3e00640 1 --2- 172.21.15.175:0/1913672193 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9e8c066f60 0x7f9e8c069420 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.944+0000 7f9eb3e00640 1 --2- 172.21.15.175:0/1913672193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9eac15af20 0x7f9eac159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.944+0000 7f9eb3e00640 1 --2- 172.21.15.175:0/1913672193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9eac0cbe60 0x7f9eac159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.944+0000 7f9eb3e00640 1 --2- 172.21.15.175:0/1913672193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9eac0b4630 0x7f9eac0ce210 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:03.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.944+0000 7f9eb3e00640 1 -- 172.21.15.175:0/1913672193 >> 172.21.15.175:0/1913672193 conn(0x7f9eac06ac50 msgr2=0x7f9eac15a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:03.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.944+0000 7f9eb3e00640 1 -- 172.21.15.175:0/1913672193 shutdown_connections 2024-04-25T09:04:03.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:03.944+0000 7f9eb3e00640 1 -- 172.21.15.175:0/1913672193 wait complete. 2024-04-25T09:04:03.952 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:04.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.096+0000 7f0dd3c00640 1 Processor -- start 2024-04-25T09:04:04.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.096+0000 7f0dd3c00640 1 -- start start 2024-04-25T09:04:04.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.100+0000 7f0dd3c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0dcc06c070 0x7f0dcc06f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.100+0000 7f0dd3c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0dcc0acfa0 0x7f0dcc0ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.100+0000 7f0dd3c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dcc06e080 con 0x7f0dcc0af0f0 2024-04-25T09:04:04.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.100+0000 7f0dd3c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dcc0ad930 con 0x7f0dcc0acfa0 2024-04-25T09:04:04.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.100+0000 7f0dd3c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dcc06ec50 con 0x7f0dcc06c070 2024-04-25T09:04:04.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.100+0000 7f0dd1c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0dcc0acfa0 0x7f0dcc0ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.100+0000 7f0dd1200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0dcc06c070 0x7f0dcc06f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.100+0000 7f0dd1c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0dcc0acfa0 0x7f0dcc0ad3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35602/0 (socket says 172.21.15.175:35602) 2024-04-25T09:04:04.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.100+0000 7f0dc3e00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f0dcc0af0f0 0x7f0dcc15ca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:56766/0 (socket says 172.21.15.175:56766) 2024-04-25T09:04:04.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.100+0000 7f0dd1c00640 1 -- 172.21.15.175:0/3497584949 learned_addr learned my addr 172.21.15.175:0/3497584949 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:04.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.100+0000 7f0dd1200640 1 -- 172.21.15.175:0/3497584949 >> v2:172.21.15.175:3300/0 conn(0x7f0dcc0acfa0 msgr2=0x7f0dcc0ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:04.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.100+0000 7f0dd1200640 1 --2- 172.21.15.175:0/3497584949 >> v2:172.21.15.175:3300/0 conn(0x7f0dcc0acfa0 0x7f0dcc0ad3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.100+0000 7f0dd1200640 1 -- 172.21.15.175:0/3497584949 >> v1:172.21.15.177:6789/0 conn(0x7f0dcc0af0f0 legacy=0x7f0dcc15ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.100+0000 7f0dd1200640 1 -- 172.21.15.175:0/3497584949 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc06e320 con 0x7f0dcc06c070 2024-04-25T09:04:04.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.100+0000 7f0dd1c00640 1 --2- 172.21.15.175:0/3497584949 >> v2:172.21.15.175:3300/0 conn(0x7f0dcc0acfa0 0x7f0dcc0ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:04.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.100+0000 7f0dcbe00640 1 -- 172.21.15.175:0/3497584949 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 449665734 0 0) 0x7f0dcc06e080 con 0x7f0dcc0af0f0 2024-04-25T09:04:04.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dd1200640 1 --2- 172.21.15.175:0/3497584949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dcc06c070 0x7f0dcc06f0e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc066e60 tx=0x7f0dbc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac5fb034cad68aad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:04.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dcbe00640 1 -- 172.21.15.175:0/3497584949 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0b0070 con 0x7f0dcc06c070 2024-04-25T09:04:04.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dcbe00640 1 -- 172.21.15.175:0/3497584949 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dbc0ab600 con 0x7f0dcc06c070 2024-04-25T09:04:04.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dcbe00640 1 -- 172.21.15.175:0/3497584949 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dbc0ab9d0 con 0x7f0dcc06c070 2024-04-25T09:04:04.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dd3c00640 1 -- 172.21.15.175:0/3497584949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dcc06c070 msgr2=0x7f0dcc06f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dd3c00640 1 --2- 172.21.15.175:0/3497584949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dcc06c070 0x7f0dcc06f0e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc066e60 tx=0x7f0dbc01c480 comp rx=0 tx=0).stop 2024-04-25T09:04:04.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dd3c00640 1 -- 172.21.15.175:0/3497584949 shutdown_connections 2024-04-25T09:04:04.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dd3c00640 1 --2- 172.21.15.175:0/3497584949 >> v2:172.21.15.175:3300/0 conn(0x7f0dcc0acfa0 0x7f0dcc0ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dd3c00640 1 --2- 172.21.15.175:0/3497584949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dcc06c070 0x7f0dcc06f0e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dd3c00640 1 -- 172.21.15.175:0/3497584949 >> 172.21.15.175:0/3497584949 conn(0x7f0dcc0b2200 msgr2=0x7f0dcc0cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:04.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dd3c00640 1 -- 172.21.15.175:0/3497584949 shutdown_connections 2024-04-25T09:04:04.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dd3c00640 1 -- 172.21.15.175:0/3497584949 wait complete. 2024-04-25T09:04:04.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dd3c00640 1 Processor -- start 2024-04-25T09:04:04.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dd3c00640 1 -- start start 2024-04-25T09:04:04.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dd3c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dcc06c070 0x7f0dcc0cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dd3c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dcc0acfa0 0x7f0dcc156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dd3c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dcc0af0f0 0x7f0dcc1581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dd3c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc06b460 con 0x7f0dcc0acfa0 2024-04-25T09:04:04.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dd3c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc06c660 con 0x7f0dcc06c070 2024-04-25T09:04:04.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.104+0000 7f0dd3c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc06b5e0 con 0x7f0dcc0af0f0 2024-04-25T09:04:04.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dc3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dcc0acfa0 0x7f0dcc156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dc3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dcc0acfa0 0x7f0dcc156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35604/0 (socket says 172.21.15.175:35604) 2024-04-25T09:04:04.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dc3e00640 1 -- 172.21.15.175:0/2156946768 learned_addr learned my addr 172.21.15.175:0/2156946768 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:04.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dd1200640 1 --2- 172.21.15.175:0/2156946768 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dcc06c070 0x7f0dcc0cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dd1c00640 1 --2- 172.21.15.175:0/2156946768 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dcc0af0f0 0x7f0dcc1581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dc3e00640 1 -- 172.21.15.175:0/2156946768 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dcc0af0f0 msgr2=0x7f0dcc1581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dc3e00640 1 --2- 172.21.15.175:0/2156946768 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dcc0af0f0 0x7f0dcc1581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dc3e00640 1 -- 172.21.15.175:0/2156946768 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dcc06c070 msgr2=0x7f0dcc0cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dc3e00640 1 --2- 172.21.15.175:0/2156946768 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dcc06c070 0x7f0dcc0cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dc3e00640 1 -- 172.21.15.175:0/2156946768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc0cbdb0 con 0x7f0dcc0acfa0 2024-04-25T09:04:04.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dc3e00640 1 --2- 172.21.15.175:0/2156946768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dcc0acfa0 0x7f0dcc156680 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c480 tx=0x7f0db400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:04.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dc9600640 1 -- 172.21.15.175:0/2156946768 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4018070 con 0x7f0dcc0acfa0 2024-04-25T09:04:04.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dc9600640 1 -- 172.21.15.175:0/2156946768 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db4007500 con 0x7f0dcc0acfa0 2024-04-25T09:04:04.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dd3c00640 1 -- 172.21.15.175:0/2156946768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dcc159280 con 0x7f0dcc0acfa0 2024-04-25T09:04:04.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dc9600640 1 -- 172.21.15.175:0/2156946768 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4004a30 con 0x7f0dcc0acfa0 2024-04-25T09:04:04.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dd3c00640 1 -- 172.21.15.175:0/2156946768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc0b3ef0 con 0x7f0dcc0acfa0 2024-04-25T09:04:04.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dd3c00640 1 -- 172.21.15.175:0/2156946768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dcc074a60 con 0x7f0dcc0acfa0 2024-04-25T09:04:04.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dc9600640 1 -- 172.21.15.175:0/2156946768 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0db4004bd0 con 0x7f0dcc0acfa0 2024-04-25T09:04:04.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.108+0000 7f0dc9600640 1 --2- 172.21.15.175:0/2156946768 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0da8066f60 0x7f0da8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:04.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.112+0000 7f0dc9600640 1 -- 172.21.15.175:0/2156946768 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0db4083f40 con 0x7f0dcc0acfa0 2024-04-25T09:04:04.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.112+0000 7f0dd1200640 1 --2- 172.21.15.175:0/2156946768 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0da8066f60 0x7f0da8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:04.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.112+0000 7f0dd1200640 1 --2- 172.21.15.175:0/2156946768 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0da8066f60 0x7f0da8069420 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0ad000 tx=0x7f0dbc0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:04.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.112+0000 7f0dc9600640 1 -- 172.21.15.175:0/2156946768 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0db4054bc0 con 0x7f0dcc0acfa0 2024-04-25T09:04:04.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.300+0000 7f0dd3c00640 1 -- 172.21.15.175:0/2156946768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0dcc0d0b50 con 0x7f0dcc0acfa0 2024-04-25T09:04:04.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.300+0000 7f0dc9600640 1 -- 172.21.15.175:0/2156946768 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f0db4058c60 con 0x7f0dcc0acfa0 2024-04-25T09:04:04.291 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:04.291 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2613139594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2613139594},{"type":"v1","addr":"172.21.15.175:6836","nonce":2613139594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-04-25T09:04:04.292 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 2 2024-04-25T09:04:04.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.304+0000 7f0dd3c00640 1 -- 172.21.15.175:0/2156946768 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0da8066f60 msgr2=0x7f0da8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.304+0000 7f0dd3c00640 1 --2- 172.21.15.175:0/2156946768 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0da8066f60 0x7f0da8069420 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0ad000 tx=0x7f0dbc0a6000 comp rx=0 tx=0).stop 2024-04-25T09:04:04.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.304+0000 7f0dd3c00640 1 -- 172.21.15.175:0/2156946768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dcc0acfa0 msgr2=0x7f0dcc156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:04.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.304+0000 7f0dd3c00640 1 --2- 172.21.15.175:0/2156946768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dcc0acfa0 0x7f0dcc156680 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c480 tx=0x7f0db400c940 comp rx=0 tx=0).stop 2024-04-25T09:04:04.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.304+0000 7f0dd3c00640 1 -- 172.21.15.175:0/2156946768 shutdown_connections 2024-04-25T09:04:04.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.304+0000 7f0dd3c00640 1 --2- 172.21.15.175:0/2156946768 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0da8066f60 0x7f0da8069420 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.304+0000 7f0dd3c00640 1 --2- 172.21.15.175:0/2156946768 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dcc0af0f0 0x7f0dcc1581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.304+0000 7f0dd3c00640 1 --2- 172.21.15.175:0/2156946768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dcc0acfa0 0x7f0dcc156680 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.304+0000 7f0dd3c00640 1 --2- 172.21.15.175:0/2156946768 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dcc06c070 0x7f0dcc0cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:04.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.304+0000 7f0dd3c00640 1 -- 172.21.15.175:0/2156946768 >> 172.21.15.175:0/2156946768 conn(0x7f0dcc0b2200 msgr2=0x7f0dcc15b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:04.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.304+0000 7f0dd3c00640 1 -- 172.21.15.175:0/2156946768 shutdown_connections 2024-04-25T09:04:04.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:04.304+0000 7f0dd3c00640 1 -- 172.21.15.175:0/2156946768 wait complete. 2024-04-25T09:04:06.313 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:06.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6e0e00640 1 Processor -- start 2024-04-25T09:04:06.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6e0e00640 1 -- start start 2024-04-25T09:04:06.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6e0e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6dc09a5f0 0x7fe6dc0cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6e0e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6dc0cf9a0 con 0x7fe6dc0d01e0 2024-04-25T09:04:06.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6e0e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6dc0b2030 con 0x7fe6dc15b930 2024-04-25T09:04:06.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6e0e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc0d0650 con 0x7fe6dc09a5f0 2024-04-25T09:04:06.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6dbe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe6dc0d01e0 0x7fe6dc0b2480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:48274/0 (socket says 172.21.15.175:48274) 2024-04-25T09:04:06.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6dbe00640 1 -- 172.21.15.175:0/2662325245 learned_addr learned my addr 172.21.15.175:0/2662325245 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:06.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6daa00640 1 --2- 172.21.15.175:0/2662325245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6dc09a5f0 0x7fe6dc0cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6da000640 1 -- 172.21.15.175:0/2662325245 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3550040713 0 0) 0x7fe6dc0cf9a0 con 0x7fe6dc0d01e0 2024-04-25T09:04:06.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6da000640 1 -- 172.21.15.175:0/2662325245 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6c0003530 con 0x7fe6dc0d01e0 2024-04-25T09:04:06.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6da000640 1 -- 172.21.15.175:0/2662325245 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444703416 0 0) 0x7fe6dc0b2030 con 0x7fe6dc15b930 2024-04-25T09:04:06.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6da000640 1 -- 172.21.15.175:0/2662325245 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6dc0cf9a0 con 0x7fe6dc15b930 2024-04-25T09:04:06.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6da000640 1 -- 172.21.15.175:0/2662325245 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4193019259 0 0) 0x7fe6c0003530 con 0x7fe6dc0d01e0 2024-04-25T09:04:06.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6da000640 1 -- 172.21.15.175:0/2662325245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6dc09a5f0 msgr2=0x7fe6dc0cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:06.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6da000640 1 --2- 172.21.15.175:0/2662325245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6dc09a5f0 0x7fe6dc0cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6da000640 1 -- 172.21.15.175:0/2662325245 >> v1:172.21.15.177:6789/0 conn(0x7fe6dc15b930 legacy=0x7fe6dc0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6da000640 1 -- 172.21.15.175:0/2662325245 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6dc0cc400 con 0x7fe6dc0d01e0 2024-04-25T09:04:06.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6da000640 1 -- 172.21.15.175:0/2662325245 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fe6d4001a00 con 0x7fe6dc0d01e0 2024-04-25T09:04:06.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6daa00640 1 --2- 172.21.15.175:0/2662325245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6dc09a5f0 0x7fe6dc0cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:06.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6da000640 1 -- 172.21.15.175:0/2662325245 >> v1:172.21.15.175:6789/0 conn(0x7fe6dc0d01e0 legacy=0x7fe6dc0b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6da000640 1 --2- 172.21.15.175:0/2662325245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6c0003bf0 0x7fe6c0003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6da000640 1 --2- 172.21.15.175:0/2662325245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c0004810 0x7fe6c0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6da000640 1 --2- 172.21.15.175:0/2662325245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6c00051d0 0x7fe6c000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6da000640 1 -- 172.21.15.175:0/2662325245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc0d0650 con 0x7fe6c0004810 2024-04-25T09:04:06.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6da000640 1 -- 172.21.15.175:0/2662325245 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c000bf10 con 0x7fe6c0003bf0 2024-04-25T09:04:06.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6da000640 1 -- 172.21.15.175:0/2662325245 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c000c0c0 con 0x7fe6c00051d0 2024-04-25T09:04:06.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6daa00640 1 --2- 172.21.15.175:0/2662325245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c0004810 0x7fe6c0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6db400640 1 --2- 172.21.15.175:0/2662325245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6c0003bf0 0x7fe6c0003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6dbe00640 1 --2- 172.21.15.175:0/2662325245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6c00051d0 0x7fe6c000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6daa00640 1 -- 172.21.15.175:0/2662325245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6c00051d0 msgr2=0x7fe6c000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:06.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6daa00640 1 --2- 172.21.15.175:0/2662325245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6c00051d0 0x7fe6c000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6daa00640 1 -- 172.21.15.175:0/2662325245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6c0003bf0 msgr2=0x7fe6c0003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:06.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6daa00640 1 --2- 172.21.15.175:0/2662325245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6c0003bf0 0x7fe6c0003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6daa00640 1 -- 172.21.15.175:0/2662325245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c0003530 con 0x7fe6c0004810 2024-04-25T09:04:06.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.471+0000 7fe6db400640 1 --2- 172.21.15.175:0/2662325245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6c0003bf0 0x7fe6c0003ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:06.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.475+0000 7fe6daa00640 1 --2- 172.21.15.175:0/2662325245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c0004810 0x7fe6c0004c90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8009cb0 tx=0x7fe6c801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fcfa530938f4c74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.475+0000 7fe6da000640 1 -- 172.21.15.175:0/2662325245 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c80b2070 con 0x7fe6c0004810 2024-04-25T09:04:06.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.475+0000 7fe6da000640 1 -- 172.21.15.175:0/2662325245 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c80a58d0 con 0x7fe6c0004810 2024-04-25T09:04:06.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.475+0000 7fe6da000640 1 -- 172.21.15.175:0/2662325245 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8009880 con 0x7fe6c0004810 2024-04-25T09:04:06.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.475+0000 7fe6e0e00640 1 -- 172.21.15.175:0/2662325245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c0004810 msgr2=0x7fe6c0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.475+0000 7fe6e0e00640 1 --2- 172.21.15.175:0/2662325245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c0004810 0x7fe6c0004c90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe6c8009cb0 tx=0x7fe6c801cc10 comp rx=0 tx=0).stop 2024-04-25T09:04:06.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.475+0000 7fe6dbe00640 1 -- 172.21.15.175:0/2662325245 reap_dead start 2024-04-25T09:04:06.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.475+0000 7fe6e0e00640 1 -- 172.21.15.175:0/2662325245 shutdown_connections 2024-04-25T09:04:06.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.475+0000 7fe6e0e00640 1 -- 172.21.15.175:0/2662325245 >> 172.21.15.175:0/2662325245 conn(0x7fe6dc0b31b0 msgr2=0x7fe6dc0b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:06.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.475+0000 7fe6e0e00640 1 -- 172.21.15.175:0/2662325245 shutdown_connections 2024-04-25T09:04:06.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.475+0000 7fe6e0e00640 1 -- 172.21.15.175:0/2662325245 wait complete. 2024-04-25T09:04:06.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6e0e00640 1 Processor -- start 2024-04-25T09:04:06.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6e0e00640 1 -- start start 2024-04-25T09:04:06.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6e0e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6c0004810 0x7fe6dc157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6e0e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6dc0c6410 0x7fe6dc1f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6e0e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6dc1f68a0 0x7fe6dc159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6e0e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc0cc9c0 con 0x7fe6dc0c6410 2024-04-25T09:04:06.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6e0e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc0ccca0 con 0x7fe6dc1f68a0 2024-04-25T09:04:06.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6e0e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc0ccf80 con 0x7fe6c0004810 2024-04-25T09:04:06.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6daa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6dc0c6410 0x7fe6dc1f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6daa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6dc0c6410 0x7fe6dc1f3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35624/0 (socket says 172.21.15.175:35624) 2024-04-25T09:04:06.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6daa00640 1 -- 172.21.15.175:0/530339388 learned_addr learned my addr 172.21.15.175:0/530339388 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:06.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6dbe00640 1 --2- 172.21.15.175:0/530339388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6dc1f68a0 0x7fe6dc159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6daa00640 1 -- 172.21.15.175:0/530339388 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6c0004810 msgr2=0x7fe6dc157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6db400640 1 --2- 172.21.15.175:0/530339388 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6c0004810 0x7fe6dc157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6daa00640 1 --2- 172.21.15.175:0/530339388 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6c0004810 0x7fe6dc157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6daa00640 1 -- 172.21.15.175:0/530339388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6dc1f68a0 msgr2=0x7fe6dc159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6daa00640 1 --2- 172.21.15.175:0/530339388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6dc1f68a0 0x7fe6dc159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6daa00640 1 -- 172.21.15.175:0/530339388 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6dc158300 con 0x7fe6dc0c6410 2024-04-25T09:04:06.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6dbe00640 1 --2- 172.21.15.175:0/530339388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6dc1f68a0 0x7fe6dc159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:06.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6db400640 1 --2- 172.21.15.175:0/530339388 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6c0004810 0x7fe6dc157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:06.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6daa00640 1 --2- 172.21.15.175:0/530339388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6dc0c6410 0x7fe6dc1f3cc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe6c801c680 tx=0x7fe6c0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6d3400640 1 -- 172.21.15.175:0/530339388 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c80b2040 con 0x7fe6dc0c6410 2024-04-25T09:04:06.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6d3400640 1 -- 172.21.15.175:0/530339388 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c8009400 con 0x7fe6dc0c6410 2024-04-25T09:04:06.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6d3400640 1 -- 172.21.15.175:0/530339388 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c8004220 con 0x7fe6dc0c6410 2024-04-25T09:04:06.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6e0e00640 1 -- 172.21.15.175:0/530339388 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6dc1f4200 con 0x7fe6dc0c6410 2024-04-25T09:04:06.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.479+0000 7fe6e0e00640 1 -- 172.21.15.175:0/530339388 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6dc1f74d0 con 0x7fe6dc0c6410 2024-04-25T09:04:06.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.483+0000 7fe6e0e00640 1 -- 172.21.15.175:0/530339388 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6dc1f7710 con 0x7fe6dc0c6410 2024-04-25T09:04:06.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.483+0000 7fe6d3400640 1 -- 172.21.15.175:0/530339388 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe6c80c0060 con 0x7fe6dc0c6410 2024-04-25T09:04:06.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.483+0000 7fe6d3400640 1 --2- 172.21.15.175:0/530339388 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe6bc066f60 0x7fe6bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.483+0000 7fe6d3400640 1 -- 172.21.15.175:0/530339388 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe6c811e7c0 con 0x7fe6dc0c6410 2024-04-25T09:04:06.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.483+0000 7fe6db400640 1 --2- 172.21.15.175:0/530339388 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe6bc066f60 0x7fe6bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.483+0000 7fe6db400640 1 --2- 172.21.15.175:0/530339388 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe6bc066f60 0x7fe6bc069420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc000f70 tx=0x7fe6cc000ee0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.487+0000 7fe6d3400640 1 -- 172.21.15.175:0/530339388 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe6dc1f7710 con 0x7fe6dc0c6410 2024-04-25T09:04:06.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.675+0000 7fe6e0e00640 1 -- 172.21.15.175:0/530339388 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6dc074a60 con 0x7fe6dc0c6410 2024-04-25T09:04:06.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.675+0000 7fe6d3400640 1 -- 172.21.15.175:0/530339388 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7fe6dc1f4200 con 0x7fe6dc0c6410 2024-04-25T09:04:06.666 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:06.666 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/989886914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":989886914},{"type":"v1","addr":"172.21.15.175:6837","nonce":989886914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/611556493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":611556493},{"type":"v1","addr":"172.21.15.177:6833","nonce":611556493}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1366486960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1366486960},{"type":"v1","addr":"172.21.15.177:6835","nonce":1366486960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2613139594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2613139594},{"type":"v1","addr":"172.21.15.175:6836","nonce":2613139594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-04-25T09:04:06.666 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 3 2024-04-25T09:04:06.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.675+0000 7fe6e0e00640 1 -- 172.21.15.175:0/530339388 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe6bc066f60 msgr2=0x7fe6bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.675+0000 7fe6e0e00640 1 --2- 172.21.15.175:0/530339388 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe6bc066f60 0x7fe6bc069420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc000f70 tx=0x7fe6cc000ee0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.675+0000 7fe6e0e00640 1 -- 172.21.15.175:0/530339388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6dc0c6410 msgr2=0x7fe6dc1f3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.675+0000 7fe6e0e00640 1 --2- 172.21.15.175:0/530339388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6dc0c6410 0x7fe6dc1f3cc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe6c801c680 tx=0x7fe6c0005840 comp rx=0 tx=0).stop 2024-04-25T09:04:06.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.675+0000 7fe6e0e00640 1 -- 172.21.15.175:0/530339388 shutdown_connections 2024-04-25T09:04:06.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.675+0000 7fe6e0e00640 1 --2- 172.21.15.175:0/530339388 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe6bc066f60 0x7fe6bc069420 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.675+0000 7fe6e0e00640 1 --2- 172.21.15.175:0/530339388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6dc1f68a0 0x7fe6dc159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.675+0000 7fe6e0e00640 1 --2- 172.21.15.175:0/530339388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6dc0c6410 0x7fe6dc1f3cc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.675+0000 7fe6e0e00640 1 --2- 172.21.15.175:0/530339388 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6c0004810 0x7fe6dc157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.675+0000 7fe6e0e00640 1 -- 172.21.15.175:0/530339388 >> 172.21.15.175:0/530339388 conn(0x7fe6dc0b31b0 msgr2=0x7fe6dc0ce140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:06.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.675+0000 7fe6e0e00640 1 -- 172.21.15.175:0/530339388 shutdown_connections 2024-04-25T09:04:06.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.675+0000 7fe6e0e00640 1 -- 172.21.15.175:0/530339388 wait complete. 2024-04-25T09:04:06.686 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:06.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.831+0000 7f004b200640 1 Processor -- start 2024-04-25T09:04:06.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.831+0000 7f004b200640 1 -- start start 2024-04-25T09:04:06.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.831+0000 7f004b200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f004c15b930 0x7f004c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.831+0000 7f004b200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004c0b2030 con 0x7f004c09a5f0 2024-04-25T09:04:06.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.831+0000 7f004b200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004c0cc400 con 0x7f004c0d03b0 2024-04-25T09:04:06.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.831+0000 7f004b200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004c0cc1d0 con 0x7f004c15b930 2024-04-25T09:04:06.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.831+0000 7f0049400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f004c09a5f0 0x7f004c0cfca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:48284/0 (socket says 172.21.15.175:48284) 2024-04-25T09:04:06.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.831+0000 7f0049400640 1 -- 172.21.15.175:0/1031683368 learned_addr learned my addr 172.21.15.175:0/1031683368 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.831+0000 7f0049e00640 1 --2- 172.21.15.175:0/1031683368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f004c15b930 0x7f004c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.831+0000 7f0048a00640 1 -- 172.21.15.175:0/1031683368 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555373210 0 0) 0x7f004c0b2030 con 0x7f004c09a5f0 2024-04-25T09:04:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.831+0000 7f0048a00640 1 -- 172.21.15.175:0/1031683368 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0030003530 con 0x7f004c09a5f0 2024-04-25T09:04:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.831+0000 7f0048a00640 1 -- 172.21.15.175:0/1031683368 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172277724 0 0) 0x7f004c0cc400 con 0x7f004c0d03b0 2024-04-25T09:04:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.831+0000 7f0048a00640 1 -- 172.21.15.175:0/1031683368 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f004c0b2030 con 0x7f004c0d03b0 2024-04-25T09:04:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.831+0000 7f0049e00640 1 -- 172.21.15.175:0/1031683368 >> v1:172.21.15.177:6789/0 conn(0x7f004c0d03b0 legacy=0x7f004c0b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.831+0000 7f0049e00640 1 -- 172.21.15.175:0/1031683368 >> v1:172.21.15.175:6789/0 conn(0x7f004c09a5f0 legacy=0x7f004c0cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.831+0000 7f0049e00640 1 -- 172.21.15.175:0/1031683368 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c0cc6e0 con 0x7f004c15b930 2024-04-25T09:04:06.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.835+0000 7f0049e00640 1 --2- 172.21.15.175:0/1031683368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f004c15b930 0x7f004c0cf290 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f003c0097f0 tx=0x7f003c01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=510725e79477c521 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.835+0000 7f0048a00640 1 -- 172.21.15.175:0/1031683368 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c0ab5f0 con 0x7f004c15b930 2024-04-25T09:04:06.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.835+0000 7f0048a00640 1 -- 172.21.15.175:0/1031683368 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c0b0070 con 0x7f004c15b930 2024-04-25T09:04:06.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.835+0000 7f0048a00640 1 -- 172.21.15.175:0/1031683368 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c0ab9b0 con 0x7f004c15b930 2024-04-25T09:04:06.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.835+0000 7f004b200640 1 -- 172.21.15.175:0/1031683368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f004c15b930 msgr2=0x7f004c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.835+0000 7f004b200640 1 --2- 172.21.15.175:0/1031683368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f004c15b930 0x7f004c0cf290 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f003c0097f0 tx=0x7f003c01c4e0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.835+0000 7f004b200640 1 -- 172.21.15.175:0/1031683368 shutdown_connections 2024-04-25T09:04:06.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.835+0000 7f004b200640 1 --2- 172.21.15.175:0/1031683368 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f004c15b930 0x7f004c0cf290 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.835+0000 7f004b200640 1 -- 172.21.15.175:0/1031683368 >> 172.21.15.175:0/1031683368 conn(0x7f004c0b31b0 msgr2=0x7f004c0b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:06.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.835+0000 7f004b200640 1 -- 172.21.15.175:0/1031683368 shutdown_connections 2024-04-25T09:04:06.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.835+0000 7f004b200640 1 -- 172.21.15.175:0/1031683368 wait complete. 2024-04-25T09:04:06.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.835+0000 7f004b200640 1 Processor -- start 2024-04-25T09:04:06.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f004b200640 1 -- start start 2024-04-25T09:04:06.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f004b200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f004c0d03b0 0x7f004c156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f004b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f004c15b930 0x7f004c0b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f004b200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f004c06d4f0 0x7f004c06d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f004b200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c0cd4a0 con 0x7f004c15b930 2024-04-25T09:04:06.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f004b200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c0ccf80 con 0x7f004c0d03b0 2024-04-25T09:04:06.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f004b200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004c0cd620 con 0x7f004c06d4f0 2024-04-25T09:04:06.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f0049400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f004c15b930 0x7f004c0b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f0049400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f004c15b930 0x7f004c0b6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35634/0 (socket says 172.21.15.175:35634) 2024-04-25T09:04:06.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f0049400640 1 -- 172.21.15.175:0/3036715969 learned_addr learned my addr 172.21.15.175:0/3036715969 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:06.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f0049e00640 1 --2- 172.21.15.175:0/3036715969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f004c0d03b0 0x7f004c156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f004a800640 1 --2- 172.21.15.175:0/3036715969 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f004c06d4f0 0x7f004c06d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f0049400640 1 -- 172.21.15.175:0/3036715969 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f004c06d4f0 msgr2=0x7f004c06d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f0049400640 1 --2- 172.21.15.175:0/3036715969 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f004c06d4f0 0x7f004c06d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f0049400640 1 -- 172.21.15.175:0/3036715969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f004c0d03b0 msgr2=0x7f004c156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f0049400640 1 --2- 172.21.15.175:0/3036715969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f004c0d03b0 0x7f004c156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f0049400640 1 -- 172.21.15.175:0/3036715969 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c0b5330 con 0x7f004c15b930 2024-04-25T09:04:06.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f004a800640 1 --2- 172.21.15.175:0/3036715969 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f004c06d4f0 0x7f004c06d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:06.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f0049400640 1 --2- 172.21.15.175:0/3036715969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f004c15b930 0x7f004c0b6670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f003800c520 tx=0x7f003800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f0042000640 1 -- 172.21.15.175:0/3036715969 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038017070 con 0x7f004c15b930 2024-04-25T09:04:06.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f0042000640 1 -- 172.21.15.175:0/3036715969 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0038005cf0 con 0x7f004c15b930 2024-04-25T09:04:06.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f004b200640 1 -- 172.21.15.175:0/3036715969 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004c0b55d0 con 0x7f004c15b930 2024-04-25T09:04:06.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f0042000640 1 -- 172.21.15.175:0/3036715969 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038007270 con 0x7f004c15b930 2024-04-25T09:04:06.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f004b200640 1 -- 172.21.15.175:0/3036715969 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004c0b5b90 con 0x7f004c15b930 2024-04-25T09:04:06.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.839+0000 7f004b200640 1 -- 172.21.15.175:0/3036715969 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f004c0cbdb0 con 0x7f004c15b930 2024-04-25T09:04:06.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.843+0000 7f0042000640 1 -- 172.21.15.175:0/3036715969 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f003801a070 con 0x7f004c15b930 2024-04-25T09:04:06.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.843+0000 7f0042000640 1 --2- 172.21.15.175:0/3036715969 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f002c066f60 0x7f002c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:06.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.843+0000 7f0042000640 1 -- 172.21.15.175:0/3036715969 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0038083f90 con 0x7f004c15b930 2024-04-25T09:04:06.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.843+0000 7f0049e00640 1 --2- 172.21.15.175:0/3036715969 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f002c066f60 0x7f002c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:06.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.843+0000 7f0049e00640 1 --2- 172.21.15.175:0/3036715969 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f002c066f60 0x7f002c069420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f003c0af000 tx=0x7f003c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:06.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:06.847+0000 7f0042000640 1 -- 172.21.15.175:0/3036715969 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0038054ca0 con 0x7f004c15b930 2024-04-25T09:04:06.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.003+0000 7f004b200640 1 -- 172.21.15.175:0/3036715969 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f004c0cffe0 con 0x7f004c15b930 2024-04-25T09:04:06.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.003+0000 7f0042000640 1 -- 172.21.15.175:0/3036715969 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12920 (secure 0 0 0) 0x7f0038058d40 con 0x7f004c15b930 2024-04-25T09:04:06.994 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:06.994 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":16,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:03:59.989147+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:06.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.003+0000 7f004b200640 1 -- 172.21.15.175:0/3036715969 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f002c066f60 msgr2=0x7f002c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.003+0000 7f004b200640 1 --2- 172.21.15.175:0/3036715969 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f002c066f60 0x7f002c069420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f003c0af000 tx=0x7f003c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:04:06.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.003+0000 7f004b200640 1 -- 172.21.15.175:0/3036715969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f004c15b930 msgr2=0x7f004c0b6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:06.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.003+0000 7f004b200640 1 --2- 172.21.15.175:0/3036715969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f004c15b930 0x7f004c0b6670 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f003800c520 tx=0x7f003800c9e0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.003+0000 7f004b200640 1 -- 172.21.15.175:0/3036715969 shutdown_connections 2024-04-25T09:04:06.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.003+0000 7f004b200640 1 --2- 172.21.15.175:0/3036715969 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f002c066f60 0x7f002c069420 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.003+0000 7f004b200640 1 --2- 172.21.15.175:0/3036715969 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f004c06d4f0 0x7f004c06d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.003+0000 7f004b200640 1 --2- 172.21.15.175:0/3036715969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f004c15b930 0x7f004c0b6670 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.003+0000 7f004b200640 1 --2- 172.21.15.175:0/3036715969 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f004c0d03b0 0x7f004c156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:06.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.003+0000 7f004b200640 1 -- 172.21.15.175:0/3036715969 >> 172.21.15.175:0/3036715969 conn(0x7f004c0b31b0 msgr2=0x7f004c0c7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:06.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.003+0000 7f004b200640 1 -- 172.21.15.175:0/3036715969 shutdown_connections 2024-04-25T09:04:06.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.003+0000 7f004b200640 1 -- 172.21.15.175:0/3036715969 wait complete. 2024-04-25T09:04:07.014 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:07.015 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:07.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.163+0000 7f6713200640 1 Processor -- start 2024-04-25T09:04:07.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.163+0000 7f6713200640 1 -- start start 2024-04-25T09:04:07.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.163+0000 7f6713200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f670c0cf6b0 0x7f670c1600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.163+0000 7f6713200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f670c0ce970 0x7f670c0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.163+0000 7f6713200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670c0cfd10 con 0x7f670c145250 2024-04-25T09:04:07.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.163+0000 7f6713200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670c1605e0 con 0x7f670c0ce970 2024-04-25T09:04:07.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.163+0000 7f6713200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670c15f650 con 0x7f670c0cf6b0 2024-04-25T09:04:07.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.163+0000 7f6711200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f670c0ce970 0x7f670c0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.163+0000 7f670b400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f670c0cf6b0 0x7f670c1600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.163+0000 7f670be00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f670c145250 0x7f670c0cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:56796/0 (socket says 172.21.15.175:56796) 2024-04-25T09:04:07.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.163+0000 7f670be00640 1 -- 172.21.15.175:0/20416283 learned_addr learned my addr 172.21.15.175:0/20416283 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:07.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.163+0000 7f6711200640 1 -- 172.21.15.175:0/20416283 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f670c0cf6b0 msgr2=0x7f670c1600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.163+0000 7f6711200640 1 --2- 172.21.15.175:0/20416283 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f670c0cf6b0 0x7f670c1600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.163+0000 7f6711200640 1 -- 172.21.15.175:0/20416283 >> v1:172.21.15.177:6789/0 conn(0x7f670c145250 legacy=0x7f670c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.163+0000 7f6711200640 1 -- 172.21.15.175:0/20416283 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c0cfff0 con 0x7f670c0ce970 2024-04-25T09:04:07.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.167+0000 7f6711200640 1 --2- 172.21.15.175:0/20416283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f670c0ce970 0x7f670c0cee00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6704009d90 tx=0x7f670401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ce7bfb8f21b82f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.167+0000 7f670aa00640 1 -- 172.21.15.175:0/20416283 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67040b2070 con 0x7f670c0ce970 2024-04-25T09:04:07.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.167+0000 7f670aa00640 1 -- 172.21.15.175:0/20416283 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67040a5890 con 0x7f670c0ce970 2024-04-25T09:04:07.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.167+0000 7f670aa00640 1 -- 172.21.15.175:0/20416283 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67040a5c60 con 0x7f670c0ce970 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.167+0000 7f6713200640 1 -- 172.21.15.175:0/20416283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f670c0ce970 msgr2=0x7f670c0cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.167+0000 7f6713200640 1 --2- 172.21.15.175:0/20416283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f670c0ce970 0x7f670c0cee00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6704009d90 tx=0x7f670401c8e0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.167+0000 7f6713200640 1 -- 172.21.15.175:0/20416283 shutdown_connections 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.167+0000 7f6713200640 1 --2- 172.21.15.175:0/20416283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f670c0ce970 0x7f670c0cee00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.167+0000 7f6713200640 1 --2- 172.21.15.175:0/20416283 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f670c0cf6b0 0x7f670c1600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.167+0000 7f6713200640 1 -- 172.21.15.175:0/20416283 >> 172.21.15.175:0/20416283 conn(0x7f670c06ac50 msgr2=0x7f670c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.167+0000 7f6713200640 1 -- 172.21.15.175:0/20416283 shutdown_connections 2024-04-25T09:04:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.167+0000 7f6713200640 1 -- 172.21.15.175:0/20416283 wait complete. 2024-04-25T09:04:07.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f6713200640 1 Processor -- start 2024-04-25T09:04:07.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f6713200640 1 -- start start 2024-04-25T09:04:07.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f6713200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f670c0ce970 0x7f670c165e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f6713200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f670c0cf6b0 0x7f670c13d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f6713200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f670c145250 0x7f670c1f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f6713200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670c15c870 con 0x7f670c0cf6b0 2024-04-25T09:04:07.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f6713200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670c145630 con 0x7f670c0ce970 2024-04-25T09:04:07.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f6713200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670c15c9f0 con 0x7f670c145250 2024-04-25T09:04:07.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f670b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f670c0cf6b0 0x7f670c13d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f670b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f670c0cf6b0 0x7f670c13d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35648/0 (socket says 172.21.15.175:35648) 2024-04-25T09:04:07.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f670b400640 1 -- 172.21.15.175:0/2874696047 learned_addr learned my addr 172.21.15.175:0/2874696047 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:07.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f670be00640 1 --2- 172.21.15.175:0/2874696047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f670c0ce970 0x7f670c165e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f6711200640 1 --2- 172.21.15.175:0/2874696047 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f670c145250 0x7f670c1f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f670b400640 1 -- 172.21.15.175:0/2874696047 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f670c145250 msgr2=0x7f670c1f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f670b400640 1 --2- 172.21.15.175:0/2874696047 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f670c145250 0x7f670c1f6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f670b400640 1 -- 172.21.15.175:0/2874696047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f670c0ce970 msgr2=0x7f670c165e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f670b400640 1 --2- 172.21.15.175:0/2874696047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f670c0ce970 0x7f670c165e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f670b400640 1 -- 172.21.15.175:0/2874696047 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c1663b0 con 0x7f670c0cf6b0 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f670b400640 1 --2- 172.21.15.175:0/2874696047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f670c0cf6b0 0x7f670c13d140 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f66f800e930 tx=0x7f66f800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f6703e00640 1 -- 172.21.15.175:0/2874696047 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f8017070 con 0x7f670c0cf6b0 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f6703e00640 1 -- 172.21.15.175:0/2874696047 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f800ca00 con 0x7f670c0cf6b0 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f6713200640 1 -- 172.21.15.175:0/2874696047 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f670c0b2900 con 0x7f670c0cf6b0 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f6703e00640 1 -- 172.21.15.175:0/2874696047 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f800cdb0 con 0x7f670c0cf6b0 2024-04-25T09:04:07.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f6713200640 1 -- 172.21.15.175:0/2874696047 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f670c0b2ec0 con 0x7f670c0cf6b0 2024-04-25T09:04:07.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.171+0000 7f6713200640 1 -- 172.21.15.175:0/2874696047 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670c075160 con 0x7f670c0cf6b0 2024-04-25T09:04:07.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.175+0000 7f6703e00640 1 -- 172.21.15.175:0/2874696047 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f66f801a070 con 0x7f670c0cf6b0 2024-04-25T09:04:07.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.175+0000 7f6703e00640 1 --2- 172.21.15.175:0/2874696047 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f66ec066f60 0x7f66ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.175+0000 7f6703e00640 1 -- 172.21.15.175:0/2874696047 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f66f8084c60 con 0x7f670c0cf6b0 2024-04-25T09:04:07.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.175+0000 7f670be00640 1 --2- 172.21.15.175:0/2874696047 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f66ec066f60 0x7f66ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.175+0000 7f670be00640 1 --2- 172.21.15.175:0/2874696047 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f66ec066f60 0x7f66ec069420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f66fc000f70 tx=0x7f66fc007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.179+0000 7f6703e00640 1 -- 172.21.15.175:0/2874696047 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f670c1663b0 con 0x7f670c0cf6b0 2024-04-25T09:04:07.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.331+0000 7f6713200640 1 -- 172.21.15.175:0/2874696047 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f670c15be40 con 0x7f670c0cf6b0 2024-04-25T09:04:07.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.331+0000 7f6703e00640 1 -- 172.21.15.175:0/2874696047 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66f8055a30 con 0x7f670c0cf6b0 2024-04-25T09:04:07.324 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:04:07.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.335+0000 7f6713200640 1 -- 172.21.15.175:0/2874696047 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f66ec066f60 msgr2=0x7f66ec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.335+0000 7f6713200640 1 --2- 172.21.15.175:0/2874696047 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f66ec066f60 0x7f66ec069420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f66fc000f70 tx=0x7f66fc007e90 comp rx=0 tx=0).stop 2024-04-25T09:04:07.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.335+0000 7f6713200640 1 -- 172.21.15.175:0/2874696047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f670c0cf6b0 msgr2=0x7f670c13d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.335+0000 7f6713200640 1 --2- 172.21.15.175:0/2874696047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f670c0cf6b0 0x7f670c13d140 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f66f800e930 tx=0x7f66f800edf0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.335+0000 7f6713200640 1 -- 172.21.15.175:0/2874696047 shutdown_connections 2024-04-25T09:04:07.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.335+0000 7f6713200640 1 --2- 172.21.15.175:0/2874696047 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f66ec066f60 0x7f66ec069420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.335+0000 7f6713200640 1 --2- 172.21.15.175:0/2874696047 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f670c145250 0x7f670c1f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.335+0000 7f6713200640 1 --2- 172.21.15.175:0/2874696047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f670c0cf6b0 0x7f670c13d140 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.335+0000 7f6713200640 1 --2- 172.21.15.175:0/2874696047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f670c0ce970 0x7f670c165e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.335+0000 7f6713200640 1 -- 172.21.15.175:0/2874696047 >> 172.21.15.175:0/2874696047 conn(0x7f670c06ac50 msgr2=0x7f670c13e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.335+0000 7f6713200640 1 -- 172.21.15.175:0/2874696047 shutdown_connections 2024-04-25T09:04:07.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.335+0000 7f6713200640 1 -- 172.21.15.175:0/2874696047 wait complete. 2024-04-25T09:04:07.345 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:04:07.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.491+0000 7fde78c00640 1 Processor -- start 2024-04-25T09:04:07.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.491+0000 7fde78c00640 1 -- start start 2024-04-25T09:04:07.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.491+0000 7fde78c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fde74099a50 0x7fde740cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.491+0000 7fde78c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde7415bc10 0x7fde74099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.491+0000 7fde78c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7409a370 con 0x7fde7409abb0 2024-04-25T09:04:07.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.491+0000 7fde78c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde740d06f0 con 0x7fde74099a50 2024-04-25T09:04:07.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.491+0000 7fde78c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde740cc4c0 con 0x7fde7415bc10 2024-04-25T09:04:07.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.491+0000 7fde71400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde7415bc10 0x7fde74099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.491+0000 7fde71e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fde74099a50 0x7fde740cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.491+0000 7fde71400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde7415bc10 0x7fde74099e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:60160/0 (socket says 172.21.15.175:60160) 2024-04-25T09:04:07.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.491+0000 7fde71400640 1 -- 172.21.15.175:0/777422071 learned_addr learned my addr 172.21.15.175:0/777422071 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:07.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.491+0000 7fde72800640 1 --1- 172.21.15.175:0/777422071 >> v1:172.21.15.177:6789/0 conn(0x7fde7409abb0 0x7fde740cfdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:56812/0 (socket says 172.21.15.175:56812) 2024-04-25T09:04:07.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.491+0000 7fde71e00640 1 -- 172.21.15.175:0/777422071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde7415bc10 msgr2=0x7fde74099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.491+0000 7fde71e00640 1 --2- 172.21.15.175:0/777422071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde7415bc10 0x7fde74099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.491+0000 7fde71e00640 1 -- 172.21.15.175:0/777422071 >> v1:172.21.15.177:6789/0 conn(0x7fde7409abb0 legacy=0x7fde740cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.491+0000 7fde71e00640 1 -- 172.21.15.175:0/777422071 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde740cc7a0 con 0x7fde74099a50 2024-04-25T09:04:07.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.495+0000 7fde71e00640 1 --2- 172.21.15.175:0/777422071 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde74099a50 0x7fde740cd280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fde64009d90 tx=0x7fde6401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c7612a945af9759 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.495+0000 7fde70a00640 1 -- 172.21.15.175:0/777422071 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde640b2070 con 0x7fde74099a50 2024-04-25T09:04:07.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.495+0000 7fde70a00640 1 -- 172.21.15.175:0/777422071 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde640a5940 con 0x7fde74099a50 2024-04-25T09:04:07.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.495+0000 7fde70a00640 1 -- 172.21.15.175:0/777422071 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde640a5d10 con 0x7fde74099a50 2024-04-25T09:04:07.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.495+0000 7fde78c00640 1 -- 172.21.15.175:0/777422071 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde74099a50 msgr2=0x7fde740cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.495+0000 7fde78c00640 1 --2- 172.21.15.175:0/777422071 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde74099a50 0x7fde740cd280 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fde64009d90 tx=0x7fde6401c970 comp rx=0 tx=0).stop 2024-04-25T09:04:07.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.495+0000 7fde78c00640 1 -- 172.21.15.175:0/777422071 shutdown_connections 2024-04-25T09:04:07.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.495+0000 7fde78c00640 1 --2- 172.21.15.175:0/777422071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde7415bc10 0x7fde74099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.495+0000 7fde78c00640 1 --2- 172.21.15.175:0/777422071 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde74099a50 0x7fde740cd280 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.495+0000 7fde78c00640 1 -- 172.21.15.175:0/777422071 >> 172.21.15.175:0/777422071 conn(0x7fde740b3300 msgr2=0x7fde740b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.495+0000 7fde78c00640 1 -- 172.21.15.175:0/777422071 shutdown_connections 2024-04-25T09:04:07.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.495+0000 7fde78c00640 1 -- 172.21.15.175:0/777422071 wait complete. 2024-04-25T09:04:07.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde78c00640 1 Processor -- start 2024-04-25T09:04:07.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde78c00640 1 -- start start 2024-04-25T09:04:07.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde78c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde74099a50 0x7fde74152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde78c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde7409abb0 0x7fde7415c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde78c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde7415bc10 0x7fde74157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde78c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde740c5f00 con 0x7fde7409abb0 2024-04-25T09:04:07.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde78c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde740c5d80 con 0x7fde74099a50 2024-04-25T09:04:07.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde78c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde74168850 con 0x7fde7415bc10 2024-04-25T09:04:07.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde71400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde7409abb0 0x7fde7415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde71400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde7409abb0 0x7fde7415c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35662/0 (socket says 172.21.15.175:35662) 2024-04-25T09:04:07.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde71400640 1 -- 172.21.15.175:0/4092788301 learned_addr learned my addr 172.21.15.175:0/4092788301 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:07.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde71e00640 1 --2- 172.21.15.175:0/4092788301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde74099a50 0x7fde74152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde72800640 1 --2- 172.21.15.175:0/4092788301 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde7415bc10 0x7fde74157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde71400640 1 -- 172.21.15.175:0/4092788301 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde7415bc10 msgr2=0x7fde74157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde71400640 1 --2- 172.21.15.175:0/4092788301 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde7415bc10 0x7fde74157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde71400640 1 -- 172.21.15.175:0/4092788301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde74099a50 msgr2=0x7fde74152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde71400640 1 --2- 172.21.15.175:0/4092788301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde74099a50 0x7fde74152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde71400640 1 -- 172.21.15.175:0/4092788301 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7415cb10 con 0x7fde7409abb0 2024-04-25T09:04:07.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde71400640 1 --2- 172.21.15.175:0/4092788301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde7409abb0 0x7fde7415c380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde6000e7f0 tx=0x7fde6000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde6a000640 1 -- 172.21.15.175:0/4092788301 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde60017070 con 0x7fde7409abb0 2024-04-25T09:04:07.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde78c00640 1 -- 172.21.15.175:0/4092788301 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7415cdf0 con 0x7fde7409abb0 2024-04-25T09:04:07.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde6a000640 1 -- 172.21.15.175:0/4092788301 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6000c940 con 0x7fde7409abb0 2024-04-25T09:04:07.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde6a000640 1 -- 172.21.15.175:0/4092788301 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6000cd30 con 0x7fde7409abb0 2024-04-25T09:04:07.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde78c00640 1 -- 172.21.15.175:0/4092788301 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7415d3b0 con 0x7fde7409abb0 2024-04-25T09:04:07.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.499+0000 7fde78c00640 1 -- 172.21.15.175:0/4092788301 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7415a0c0 con 0x7fde7409abb0 2024-04-25T09:04:07.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.503+0000 7fde6a000640 1 -- 172.21.15.175:0/4092788301 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fde6001a070 con 0x7fde7409abb0 2024-04-25T09:04:07.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.503+0000 7fde6a000640 1 --2- 172.21.15.175:0/4092788301 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde54066f60 0x7fde54069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.503+0000 7fde6a000640 1 -- 172.21.15.175:0/4092788301 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fde60084f50 con 0x7fde7409abb0 2024-04-25T09:04:07.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.503+0000 7fde71e00640 1 --2- 172.21.15.175:0/4092788301 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde54066f60 0x7fde54069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.503+0000 7fde71e00640 1 --2- 172.21.15.175:0/4092788301 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde54066f60 0x7fde54069420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fde640af000 tx=0x7fde640a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.507+0000 7fde6a000640 1 -- 172.21.15.175:0/4092788301 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fde7415a0c0 con 0x7fde7409abb0 2024-04-25T09:04:07.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.663+0000 7fde78c00640 1 -- 172.21.15.175:0/4092788301 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fde740cdc40 con 0x7fde7409abb0 2024-04-25T09:04:07.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.667+0000 7fde6a000640 1 -- 172.21.15.175:0/4092788301 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fde60055be0 con 0x7fde7409abb0 2024-04-25T09:04:07.657 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:07.657 INFO:teuthology.orchestra.run.smithi175.stdout:[ 2024-04-25T09:04:07.657 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:07.657 INFO:teuthology.orchestra.run.smithi175.stdout: "poolnum": 1, 2024-04-25T09:04:07.657 INFO:teuthology.orchestra.run.smithi175.stdout: "poolname": ".mgr" 2024-04-25T09:04:07.657 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:07.657 INFO:teuthology.orchestra.run.smithi175.stdout:] 2024-04-25T09:04:07.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.667+0000 7fde78c00640 1 -- 172.21.15.175:0/4092788301 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde54066f60 msgr2=0x7fde54069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.667+0000 7fde78c00640 1 --2- 172.21.15.175:0/4092788301 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde54066f60 0x7fde54069420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fde640af000 tx=0x7fde640a7070 comp rx=0 tx=0).stop 2024-04-25T09:04:07.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.667+0000 7fde78c00640 1 -- 172.21.15.175:0/4092788301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde7409abb0 msgr2=0x7fde7415c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.667+0000 7fde78c00640 1 --2- 172.21.15.175:0/4092788301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde7409abb0 0x7fde7415c380 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde6000e7f0 tx=0x7fde6000ecb0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.667+0000 7fde78c00640 1 -- 172.21.15.175:0/4092788301 shutdown_connections 2024-04-25T09:04:07.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.667+0000 7fde78c00640 1 --2- 172.21.15.175:0/4092788301 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde54066f60 0x7fde54069420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.667+0000 7fde78c00640 1 --2- 172.21.15.175:0/4092788301 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde7415bc10 0x7fde74157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.667+0000 7fde78c00640 1 --2- 172.21.15.175:0/4092788301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde7409abb0 0x7fde7415c380 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.667+0000 7fde78c00640 1 --2- 172.21.15.175:0/4092788301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde74099a50 0x7fde74152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.667+0000 7fde78c00640 1 -- 172.21.15.175:0/4092788301 >> 172.21.15.175:0/4092788301 conn(0x7fde740b3300 msgr2=0x7fde7406d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.667+0000 7fde78c00640 1 -- 172.21.15.175:0/4092788301 shutdown_connections 2024-04-25T09:04:07.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.667+0000 7fde78c00640 1 -- 172.21.15.175:0/4092788301 wait complete. 2024-04-25T09:04:07.679 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:04:07.679 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:04:07.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.827+0000 7f46a0e00640 1 Processor -- start 2024-04-25T09:04:07.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.827+0000 7f46a0e00640 1 -- start start 2024-04-25T09:04:07.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.831+0000 7f46a0e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f469c147650 0x7f469c0adda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.831+0000 7f46a0e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f469c0acf60 0x7f469c06e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.831+0000 7f46a0e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469c0ae6f0 con 0x7f469c06edf0 2024-04-25T09:04:07.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.831+0000 7f46a0e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c0b2aa0 con 0x7f469c0acf60 2024-04-25T09:04:07.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.831+0000 7f46a0e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c06f230 con 0x7f469c147650 2024-04-25T09:04:07.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.831+0000 7f4699400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f469c0acf60 0x7f469c06e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.831+0000 7f469a800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f469c06edf0 0x7f469c06d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:48298/0 (socket says 172.21.15.175:48298) 2024-04-25T09:04:07.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.831+0000 7f469a800640 1 -- 172.21.15.175:0/1133441853 learned_addr learned my addr 172.21.15.175:0/1133441853 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:07.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.831+0000 7f4699e00640 1 --2- 172.21.15.175:0/1133441853 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f469c147650 0x7f469c0adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.831+0000 7f4699400640 1 -- 172.21.15.175:0/1133441853 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f469c147650 msgr2=0x7f469c0adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:07.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.831+0000 7f4699400640 1 --2- 172.21.15.175:0/1133441853 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f469c147650 0x7f469c0adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.831+0000 7f4699400640 1 -- 172.21.15.175:0/1133441853 >> v1:172.21.15.175:6789/0 conn(0x7f469c06edf0 legacy=0x7f469c06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.831+0000 7f4699400640 1 -- 172.21.15.175:0/1133441853 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c0ae9d0 con 0x7f469c0acf60 2024-04-25T09:04:07.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.831+0000 7f4698a00640 1 -- 172.21.15.175:0/1133441853 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048962180 0 0) 0x7f469c0ae6f0 con 0x7f469c06edf0 2024-04-25T09:04:07.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.831+0000 7f4699400640 1 --2- 172.21.15.175:0/1133441853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469c0acf60 0x7f469c06e8b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f46880097c0 tx=0x7f468801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75c35e93041e1dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f4698a00640 1 -- 172.21.15.175:0/1133441853 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46880b1070 con 0x7f469c0acf60 2024-04-25T09:04:07.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f4698a00640 1 -- 172.21.15.175:0/1133441853 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46880a8050 con 0x7f469c0acf60 2024-04-25T09:04:07.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f4698a00640 1 -- 172.21.15.175:0/1133441853 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46880ac860 con 0x7f469c0acf60 2024-04-25T09:04:07.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f46a0e00640 1 -- 172.21.15.175:0/1133441853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469c0acf60 msgr2=0x7f469c06e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f46a0e00640 1 --2- 172.21.15.175:0/1133441853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469c0acf60 0x7f469c06e8b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f46880097c0 tx=0x7f468801c3e0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f46a0e00640 1 -- 172.21.15.175:0/1133441853 shutdown_connections 2024-04-25T09:04:07.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f46a0e00640 1 --2- 172.21.15.175:0/1133441853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469c0acf60 0x7f469c06e8b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f46a0e00640 1 --2- 172.21.15.175:0/1133441853 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f469c147650 0x7f469c0adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f46a0e00640 1 -- 172.21.15.175:0/1133441853 >> 172.21.15.175:0/1133441853 conn(0x7f469c06ac50 msgr2=0x7f469c06b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:07.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f46a0e00640 1 -- 172.21.15.175:0/1133441853 shutdown_connections 2024-04-25T09:04:07.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f46a0e00640 1 -- 172.21.15.175:0/1133441853 wait complete. 2024-04-25T09:04:07.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f46a0e00640 1 Processor -- start 2024-04-25T09:04:07.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f46a0e00640 1 -- start start 2024-04-25T09:04:07.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f46a0e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469c06edf0 0x7f469c1683c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f46a0e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f469c0acf60 0x7f469c140830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f46a0e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f469c147650 0x7f469c15ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f46a0e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0ae460 con 0x7f469c06edf0 2024-04-25T09:04:07.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f46a0e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0ae2e0 con 0x7f469c147650 2024-04-25T09:04:07.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f46a0e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c16a910 con 0x7f469c0acf60 2024-04-25T09:04:07.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f4699e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469c06edf0 0x7f469c1683c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f4699e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469c06edf0 0x7f469c1683c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35678/0 (socket says 172.21.15.175:35678) 2024-04-25T09:04:07.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f4699e00640 1 -- 172.21.15.175:0/2033508062 learned_addr learned my addr 172.21.15.175:0/2033508062 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:07.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f4699e00640 1 -- 172.21.15.175:0/2033508062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f469c0acf60 msgr2=0x7f469c140830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.835+0000 7f4699e00640 1 --2- 172.21.15.175:0/2033508062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f469c0acf60 0x7f469c140830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.839+0000 7f4699e00640 1 -- 172.21.15.175:0/2033508062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f469c147650 msgr2=0x7f469c15ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.839+0000 7f4699e00640 1 --2- 172.21.15.175:0/2033508062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f469c147650 0x7f469c15ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.839+0000 7f4699e00640 1 -- 172.21.15.175:0/2033508062 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c0ccc60 con 0x7f469c06edf0 2024-04-25T09:04:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.839+0000 7f4699e00640 1 --2- 172.21.15.175:0/2033508062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469c06edf0 0x7f469c1683c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f468c007e40 tx=0x7f468c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.839+0000 7f4692000640 1 -- 172.21.15.175:0/2033508062 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c014620 con 0x7f469c06edf0 2024-04-25T09:04:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.839+0000 7f4692000640 1 -- 172.21.15.175:0/2033508062 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c019070 con 0x7f469c06edf0 2024-04-25T09:04:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.839+0000 7f4692000640 1 -- 172.21.15.175:0/2033508062 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c014a00 con 0x7f469c06edf0 2024-04-25T09:04:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.839+0000 7f46a0e00640 1 -- 172.21.15.175:0/2033508062 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469c13fde0 con 0x7f469c06edf0 2024-04-25T09:04:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.839+0000 7f46a0e00640 1 -- 172.21.15.175:0/2033508062 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c1403a0 con 0x7f469c06edf0 2024-04-25T09:04:07.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.839+0000 7f46a0e00640 1 -- 172.21.15.175:0/2033508062 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c075160 con 0x7f469c06edf0 2024-04-25T09:04:07.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.839+0000 7f4692000640 1 -- 172.21.15.175:0/2033508062 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f468c014ba0 con 0x7f469c06edf0 2024-04-25T09:04:07.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.839+0000 7f4692000640 1 --2- 172.21.15.175:0/2033508062 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f467c066f90 0x7f467c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:07.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.839+0000 7f4692000640 1 -- 172.21.15.175:0/2033508062 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f468c085610 con 0x7f469c06edf0 2024-04-25T09:04:07.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.839+0000 7f4699400640 1 --2- 172.21.15.175:0/2033508062 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f467c066f90 0x7f467c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:07.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.843+0000 7f4699400640 1 --2- 172.21.15.175:0/2033508062 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f467c066f90 0x7f467c069450 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f46880ae000 tx=0x7f4688004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:07.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.843+0000 7f4692000640 1 -- 172.21.15.175:0/2033508062 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f468c0568d0 con 0x7f469c06edf0 2024-04-25T09:04:07.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:07.999+0000 7f46a0e00640 1 -- 172.21.15.175:0/2033508062 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f469c15f130 con 0x7f469c06edf0 2024-04-25T09:04:08.272 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:08.276 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:08.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.407+0000 7f4692000640 1 -- 172.21.15.175:0/2033508062 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f468c0561d0 con 0x7f469c06edf0 2024-04-25T09:04:08.398 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_metadata' created 2024-04-25T09:04:08.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.407+0000 7f46a0e00640 1 -- 172.21.15.175:0/2033508062 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f467c066f90 msgr2=0x7f467c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.407+0000 7f46a0e00640 1 --2- 172.21.15.175:0/2033508062 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f467c066f90 0x7f467c069450 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f46880ae000 tx=0x7f4688004740 comp rx=0 tx=0).stop 2024-04-25T09:04:08.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.407+0000 7f46a0e00640 1 -- 172.21.15.175:0/2033508062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469c06edf0 msgr2=0x7f469c1683c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.407+0000 7f46a0e00640 1 --2- 172.21.15.175:0/2033508062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469c06edf0 0x7f469c1683c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f468c007e40 tx=0x7f468c00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.407+0000 7f46a0e00640 1 -- 172.21.15.175:0/2033508062 shutdown_connections 2024-04-25T09:04:08.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.407+0000 7f46a0e00640 1 --2- 172.21.15.175:0/2033508062 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f467c066f90 0x7f467c069450 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.407+0000 7f46a0e00640 1 --2- 172.21.15.175:0/2033508062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f469c147650 0x7f469c15ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.407+0000 7f46a0e00640 1 --2- 172.21.15.175:0/2033508062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f469c0acf60 0x7f469c140830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.407+0000 7f46a0e00640 1 --2- 172.21.15.175:0/2033508062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f469c06edf0 0x7f469c1683c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.407+0000 7f46a0e00640 1 -- 172.21.15.175:0/2033508062 >> 172.21.15.175:0/2033508062 conn(0x7f469c06ac50 msgr2=0x7f469c0cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.411+0000 7f46a0e00640 1 -- 172.21.15.175:0/2033508062 shutdown_connections 2024-04-25T09:04:08.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.411+0000 7f46a0e00640 1 -- 172.21.15.175:0/2033508062 wait complete. 2024-04-25T09:04:08.426 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:04:08.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.575+0000 7f8771600640 1 Processor -- start 2024-04-25T09:04:08.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.575+0000 7f8771600640 1 -- start start 2024-04-25T09:04:08.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.575+0000 7f8771600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f876c071510 0x7f876c0cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.575+0000 7f8771600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f876c06dd90 0x7f876c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.579+0000 7f8771600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876c0cc310 con 0x7f876c071e30 2024-04-25T09:04:08.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.579+0000 7f8771600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f876c0ccc40 con 0x7f876c06dd90 2024-04-25T09:04:08.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.579+0000 7f8771600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0cc5f0 con 0x7f876c071510 2024-04-25T09:04:08.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.579+0000 7f8762000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f876c06dd90 0x7f876c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.579+0000 7f8762000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f876c06dd90 0x7f876c0718f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35694/0 (socket says 172.21.15.175:35694) 2024-04-25T09:04:08.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.579+0000 7f8762000640 1 -- 172.21.15.175:0/3133579908 learned_addr learned my addr 172.21.15.175:0/3133579908 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:08.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.579+0000 7f8762000640 1 -- 172.21.15.175:0/3133579908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f876c071510 msgr2=0x7f876c0cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.579+0000 7f8762000640 1 --2- 172.21.15.175:0/3133579908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f876c071510 0x7f876c0cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.579+0000 7f8762000640 1 -- 172.21.15.175:0/3133579908 >> v1:172.21.15.177:6789/0 conn(0x7f876c071e30 legacy=0x7f876c0ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:08.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.579+0000 7f8762000640 1 -- 172.21.15.175:0/3133579908 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c0cc8d0 con 0x7f876c06dd90 2024-04-25T09:04:08.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.579+0000 7f8762000640 1 --2- 172.21.15.175:0/3133579908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f876c06dd90 0x7f876c0718f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8754009870 tx=0x7f875401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df155825684a20a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.579+0000 7f876a000640 1 -- 172.21.15.175:0/3133579908 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540ab600 con 0x7f876c06dd90 2024-04-25T09:04:08.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.579+0000 7f876a000640 1 -- 172.21.15.175:0/3133579908 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87540b0070 con 0x7f876c06dd90 2024-04-25T09:04:08.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.579+0000 7f876a000640 1 -- 172.21.15.175:0/3133579908 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540ab9c0 con 0x7f876c06dd90 2024-04-25T09:04:08.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f8771600640 1 -- 172.21.15.175:0/3133579908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f876c06dd90 msgr2=0x7f876c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f8771600640 1 --2- 172.21.15.175:0/3133579908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f876c06dd90 0x7f876c0718f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8754009870 tx=0x7f875401c520 comp rx=0 tx=0).stop 2024-04-25T09:04:08.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f8771600640 1 -- 172.21.15.175:0/3133579908 shutdown_connections 2024-04-25T09:04:08.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f8771600640 1 --2- 172.21.15.175:0/3133579908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f876c06dd90 0x7f876c0718f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f8771600640 1 --2- 172.21.15.175:0/3133579908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f876c071510 0x7f876c0cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f8771600640 1 -- 172.21.15.175:0/3133579908 >> 172.21.15.175:0/3133579908 conn(0x7f876c06ac50 msgr2=0x7f876c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:08.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f8771600640 1 -- 172.21.15.175:0/3133579908 shutdown_connections 2024-04-25T09:04:08.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f8771600640 1 -- 172.21.15.175:0/3133579908 wait complete. 2024-04-25T09:04:08.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f8771600640 1 Processor -- start 2024-04-25T09:04:08.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f8771600640 1 -- start start 2024-04-25T09:04:08.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f8771600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f876c06dd90 0x7f876c15eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f8771600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f876c071510 0x7f876c156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f8771600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f876c071e30 0x7f876c0b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f8771600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c168640 con 0x7f876c06dd90 2024-04-25T09:04:08.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f8771600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c1684c0 con 0x7f876c071e30 2024-04-25T09:04:08.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f8771600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c1687c0 con 0x7f876c071510 2024-04-25T09:04:08.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f876aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f876c06dd90 0x7f876c15eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f876aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f876c06dd90 0x7f876c15eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35710/0 (socket says 172.21.15.175:35710) 2024-04-25T09:04:08.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f876aa00640 1 -- 172.21.15.175:0/4120027757 learned_addr learned my addr 172.21.15.175:0/4120027757 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:08.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f8762000640 1 --2- 172.21.15.175:0/4120027757 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f876c071510 0x7f876c156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f876b400640 1 --2- 172.21.15.175:0/4120027757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f876c071e30 0x7f876c0b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f876aa00640 1 -- 172.21.15.175:0/4120027757 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f876c071510 msgr2=0x7f876c156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f876aa00640 1 --2- 172.21.15.175:0/4120027757 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f876c071510 0x7f876c156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f876aa00640 1 -- 172.21.15.175:0/4120027757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f876c071e30 msgr2=0x7f876c0b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:08.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f876aa00640 1 --2- 172.21.15.175:0/4120027757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f876c071e30 0x7f876c0b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:08.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.583+0000 7f876aa00640 1 -- 172.21.15.175:0/4120027757 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c0b4750 con 0x7f876c06dd90 2024-04-25T09:04:08.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.587+0000 7f876aa00640 1 --2- 172.21.15.175:0/4120027757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f876c06dd90 0x7f876c15eb70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f875c00b550 tx=0x7f875c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.587+0000 7f8763400640 1 -- 172.21.15.175:0/4120027757 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c014070 con 0x7f876c06dd90 2024-04-25T09:04:08.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.587+0000 7f8763400640 1 -- 172.21.15.175:0/4120027757 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c010890 con 0x7f876c06dd90 2024-04-25T09:04:08.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.587+0000 7f8763400640 1 -- 172.21.15.175:0/4120027757 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c010c80 con 0x7f876c06dd90 2024-04-25T09:04:08.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.587+0000 7f8771600640 1 -- 172.21.15.175:0/4120027757 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876c15ce00 con 0x7f876c06dd90 2024-04-25T09:04:08.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.587+0000 7f8771600640 1 -- 172.21.15.175:0/4120027757 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876c15d380 con 0x7f876c06dd90 2024-04-25T09:04:08.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.587+0000 7f8771600640 1 -- 172.21.15.175:0/4120027757 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876c15d550 con 0x7f876c06dd90 2024-04-25T09:04:08.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.587+0000 7f8763400640 1 -- 172.21.15.175:0/4120027757 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f875c017070 con 0x7f876c06dd90 2024-04-25T09:04:08.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.587+0000 7f8763400640 1 --2- 172.21.15.175:0/4120027757 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8748066f60 0x7f8748069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:08.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.587+0000 7f8763400640 1 -- 172.21.15.175:0/4120027757 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f875c084ff0 con 0x7f876c06dd90 2024-04-25T09:04:08.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.587+0000 7f8762000640 1 --2- 172.21.15.175:0/4120027757 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8748066f60 0x7f8748069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:08.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.591+0000 7f8762000640 1 --2- 172.21.15.175:0/4120027757 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8748066f60 0x7f8748069420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f87540af000 tx=0x7f87540a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:08.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.591+0000 7f8763400640 1 -- 172.21.15.175:0/4120027757 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f876c0b4750 con 0x7f876c06dd90 2024-04-25T09:04:08.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:08.747+0000 7f8771600640 1 -- 172.21.15.175:0/4120027757 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f876c074a60 con 0x7f876c06dd90 2024-04-25T09:04:09.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.411+0000 7f8763400640 1 -- 172.21.15.175:0/4120027757 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f875c010e20 con 0x7f876c06dd90 2024-04-25T09:04:09.401 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_data' created 2024-04-25T09:04:09.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.411+0000 7f8771600640 1 -- 172.21.15.175:0/4120027757 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8748066f60 msgr2=0x7f8748069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.411+0000 7f8771600640 1 --2- 172.21.15.175:0/4120027757 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8748066f60 0x7f8748069420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f87540af000 tx=0x7f87540a7000 comp rx=0 tx=0).stop 2024-04-25T09:04:09.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.411+0000 7f8771600640 1 -- 172.21.15.175:0/4120027757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f876c06dd90 msgr2=0x7f876c15eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.411+0000 7f8771600640 1 --2- 172.21.15.175:0/4120027757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f876c06dd90 0x7f876c15eb70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f875c00b550 tx=0x7f875c00ba10 comp rx=0 tx=0).stop 2024-04-25T09:04:09.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.411+0000 7f8771600640 1 -- 172.21.15.175:0/4120027757 shutdown_connections 2024-04-25T09:04:09.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.411+0000 7f8771600640 1 --2- 172.21.15.175:0/4120027757 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8748066f60 0x7f8748069420 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.411+0000 7f8771600640 1 --2- 172.21.15.175:0/4120027757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f876c071e30 0x7f876c0b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.411+0000 7f8771600640 1 --2- 172.21.15.175:0/4120027757 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f876c071510 0x7f876c156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.411+0000 7f8771600640 1 --2- 172.21.15.175:0/4120027757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f876c06dd90 0x7f876c15eb70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.411+0000 7f8771600640 1 -- 172.21.15.175:0/4120027757 >> 172.21.15.175:0/4120027757 conn(0x7f876c06ac50 msgr2=0x7f876c13ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:09.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.415+0000 7f8771600640 1 -- 172.21.15.175:0/4120027757 shutdown_connections 2024-04-25T09:04:09.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.415+0000 7f8771600640 1 -- 172.21.15.175:0/4120027757 wait complete. 2024-04-25T09:04:09.447 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:04:09.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.595+0000 7f0244a00640 1 Processor -- start 2024-04-25T09:04:09.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.595+0000 7f0244a00640 1 -- start start 2024-04-25T09:04:09.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f0244a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f024015b8e0 0x7f024009a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f0244a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02401601b0 0x7f024015f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f0244a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0240099b80 con 0x7f024015bcc0 2024-04-25T09:04:09.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f0244a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f024009a4b0 con 0x7f024015b8e0 2024-04-25T09:04:09.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f0244a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02400d0340 con 0x7f02401601b0 2024-04-25T09:04:09.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f0237e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f024015bcc0 0x7f02400cfc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59148/0 (socket says 172.21.15.175:59148) 2024-04-25T09:04:09.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f0237e00640 1 -- 172.21.15.175:0/2500789139 learned_addr learned my addr 172.21.15.175:0/2500789139 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:09.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023e800640 1 --2- 172.21.15.175:0/2500789139 >> v2:172.21.15.177:3300/0 conn(0x7f024015b8e0 0x7f024009a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023f200640 1 --2- 172.21.15.175:0/2500789139 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02401601b0 0x7f024015f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023de00640 1 -- 172.21.15.175:0/2500789139 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177294990 0 0) 0x7f0240099b80 con 0x7f024015bcc0 2024-04-25T09:04:09.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023de00640 1 -- 172.21.15.175:0/2500789139 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0224003530 con 0x7f024015bcc0 2024-04-25T09:04:09.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023de00640 1 -- 172.21.15.175:0/2500789139 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 428092737 0 0) 0x7f0224003530 con 0x7f024015bcc0 2024-04-25T09:04:09.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023de00640 1 -- 172.21.15.175:0/2500789139 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02401601b0 msgr2=0x7f024015f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:09.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023de00640 1 --2- 172.21.15.175:0/2500789139 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02401601b0 0x7f024015f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023de00640 1 -- 172.21.15.175:0/2500789139 >> v2:172.21.15.177:3300/0 conn(0x7f024015b8e0 msgr2=0x7f024009a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:09.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023de00640 1 --2- 172.21.15.175:0/2500789139 >> v2:172.21.15.177:3300/0 conn(0x7f024015b8e0 0x7f024009a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023de00640 1 -- 172.21.15.175:0/2500789139 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0240099e60 con 0x7f024015bcc0 2024-04-25T09:04:09.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023de00640 1 -- 172.21.15.175:0/2500789139 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f0228001680 con 0x7f024015bcc0 2024-04-25T09:04:09.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023de00640 1 -- 172.21.15.175:0/2500789139 >> v1:172.21.15.175:6789/0 conn(0x7f024015bcc0 legacy=0x7f02400cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023de00640 1 --2- 172.21.15.175:0/2500789139 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02401601b0 0x7f02240039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023de00640 1 --2- 172.21.15.175:0/2500789139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0224003f40 0x7f0224004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023de00640 1 --2- 172.21.15.175:0/2500789139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0224004d50 0x7f02240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023de00640 1 -- 172.21.15.175:0/2500789139 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024009a4b0 con 0x7f0224003f40 2024-04-25T09:04:09.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023de00640 1 -- 172.21.15.175:0/2500789139 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02400d0340 con 0x7f0224004d50 2024-04-25T09:04:09.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023de00640 1 -- 172.21.15.175:0/2500789139 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022400ba20 con 0x7f02401601b0 2024-04-25T09:04:09.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f0237e00640 1 --2- 172.21.15.175:0/2500789139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0224003f40 0x7f0224004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023e800640 1 --2- 172.21.15.175:0/2500789139 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02401601b0 0x7f02240039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f023f200640 1 --2- 172.21.15.175:0/2500789139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0224004d50 0x7f02240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f0237e00640 1 -- 172.21.15.175:0/2500789139 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02401601b0 msgr2=0x7f02240039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:09.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f0237e00640 1 --2- 172.21.15.175:0/2500789139 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02401601b0 0x7f02240039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f0237e00640 1 -- 172.21.15.175:0/2500789139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0224004d50 msgr2=0x7f02240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:09.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f0237e00640 1 --2- 172.21.15.175:0/2500789139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0224004d50 0x7f02240051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.599+0000 7f0237e00640 1 -- 172.21.15.175:0/2500789139 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0224003530 con 0x7f0224003f40 2024-04-25T09:04:09.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.603+0000 7f0237e00640 1 --2- 172.21.15.175:0/2500789139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0224003f40 0x7f0224004810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f022800c270 tx=0x7f022801cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b862a4f1c704df6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:09.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.603+0000 7f023de00640 1 -- 172.21.15.175:0/2500789139 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228007d60 con 0x7f0224003f40 2024-04-25T09:04:09.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.603+0000 7f023de00640 1 -- 172.21.15.175:0/2500789139 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02280a9020 con 0x7f0224003f40 2024-04-25T09:04:09.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.603+0000 7f023de00640 1 -- 172.21.15.175:0/2500789139 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02280a5b90 con 0x7f0224003f40 2024-04-25T09:04:09.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.603+0000 7f0244a00640 1 -- 172.21.15.175:0/2500789139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0224003f40 msgr2=0x7f0224004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.603+0000 7f0244a00640 1 --2- 172.21.15.175:0/2500789139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0224003f40 0x7f0224004810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f022800c270 tx=0x7f022801cc90 comp rx=0 tx=0).stop 2024-04-25T09:04:09.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.603+0000 7f023f200640 1 -- 172.21.15.175:0/2500789139 reap_dead start 2024-04-25T09:04:09.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.603+0000 7f0244a00640 1 -- 172.21.15.175:0/2500789139 shutdown_connections 2024-04-25T09:04:09.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.603+0000 7f0244a00640 1 -- 172.21.15.175:0/2500789139 >> 172.21.15.175:0/2500789139 conn(0x7f02400b3140 msgr2=0x7f02400b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:09.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.603+0000 7f0244a00640 1 -- 172.21.15.175:0/2500789139 shutdown_connections 2024-04-25T09:04:09.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.603+0000 7f0244a00640 1 -- 172.21.15.175:0/2500789139 wait complete. 2024-04-25T09:04:09.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.603+0000 7f0244a00640 1 Processor -- start 2024-04-25T09:04:09.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.603+0000 7f0244a00640 1 -- start start 2024-04-25T09:04:09.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0244a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0224003f40 0x7f024014ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0244a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0240162390 0x7f02400c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0244a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02401627f0 0x7f02400c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0244a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02400c5320 con 0x7f0224003f40 2024-04-25T09:04:09.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0244a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02400c51a0 con 0x7f0240162390 2024-04-25T09:04:09.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0244a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02400c54a0 con 0x7f02401627f0 2024-04-25T09:04:09.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f023e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0224003f40 0x7f024014ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f023e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0224003f40 0x7f024014ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36230/0 (socket says 172.21.15.175:36230) 2024-04-25T09:04:09.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f023e800640 1 -- 172.21.15.175:0/3397969398 learned_addr learned my addr 172.21.15.175:0/3397969398 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:09.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0237e00640 1 --2- 172.21.15.175:0/3397969398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0240162390 0x7f02400c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f023f200640 1 --2- 172.21.15.175:0/3397969398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02401627f0 0x7f02400c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0237e00640 1 -- 172.21.15.175:0/3397969398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02401627f0 msgr2=0x7f02400c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0237e00640 1 --2- 172.21.15.175:0/3397969398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02401627f0 0x7f02400c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0237e00640 1 -- 172.21.15.175:0/3397969398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0224003f40 msgr2=0x7f024014ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:09.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0237e00640 1 --2- 172.21.15.175:0/3397969398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0224003f40 0x7f024014ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:09.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0237e00640 1 -- 172.21.15.175:0/3397969398 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0240162d80 con 0x7f0240162390 2024-04-25T09:04:09.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f023e800640 1 --2- 172.21.15.175:0/3397969398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0224003f40 0x7f024014ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:09.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0237e00640 1 --2- 172.21.15.175:0/3397969398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0240162390 0x7f02400c8720 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0224004750 tx=0x7f0224005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:09.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0236a00640 1 -- 172.21.15.175:0/3397969398 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02280a5b90 con 0x7f0240162390 2024-04-25T09:04:09.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0236a00640 1 -- 172.21.15.175:0/3397969398 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02280b3030 con 0x7f0240162390 2024-04-25T09:04:09.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0236a00640 1 -- 172.21.15.175:0/3397969398 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02280047f0 con 0x7f0240162390 2024-04-25T09:04:09.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0244a00640 1 -- 172.21.15.175:0/3397969398 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0240163060 con 0x7f0240162390 2024-04-25T09:04:09.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0244a00640 1 -- 172.21.15.175:0/3397969398 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0240163620 con 0x7f0240162390 2024-04-25T09:04:09.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.607+0000 7f0244a00640 1 -- 172.21.15.175:0/3397969398 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0240074a60 con 0x7f0240162390 2024-04-25T09:04:09.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.611+0000 7f0236a00640 1 -- 172.21.15.175:0/3397969398 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0228004990 con 0x7f0240162390 2024-04-25T09:04:09.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.611+0000 7f0236a00640 1 --2- 172.21.15.175:0/3397969398 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f021c066f60 0x7f021c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:09.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.611+0000 7f0236a00640 1 -- 172.21.15.175:0/3397969398 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f022811e620 con 0x7f0240162390 2024-04-25T09:04:09.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.611+0000 7f023e800640 1 --2- 172.21.15.175:0/3397969398 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f021c066f60 0x7f021c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:09.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.611+0000 7f023e800640 1 --2- 172.21.15.175:0/3397969398 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f021c066f60 0x7f021c069420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0230009fd0 tx=0x7f0230009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:09.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.615+0000 7f0236a00640 1 -- 172.21.15.175:0/3397969398 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f02280169d0 con 0x7f0240162390 2024-04-25T09:04:09.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:09.803+0000 7f0244a00640 1 -- 172.21.15.175:0/3397969398 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f02400cfd60 con 0x7f0240162390 2024-04-25T09:04:10.424 INFO:teuthology.orchestra.run.smithi175.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T09:04:10.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.431+0000 7f0236a00640 1 -- 172.21.15.175:0/3397969398 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f02280ef0b0 con 0x7f0240162390 2024-04-25T09:04:10.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.439+0000 7f0244a00640 1 -- 172.21.15.175:0/3397969398 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f021c066f60 msgr2=0x7f021c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.439+0000 7f0244a00640 1 --2- 172.21.15.175:0/3397969398 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f021c066f60 0x7f021c069420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0230009fd0 tx=0x7f0230009190 comp rx=0 tx=0).stop 2024-04-25T09:04:10.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.439+0000 7f0244a00640 1 -- 172.21.15.175:0/3397969398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0240162390 msgr2=0x7f02400c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.439+0000 7f0244a00640 1 --2- 172.21.15.175:0/3397969398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0240162390 0x7f02400c8720 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0224004750 tx=0x7f0224005840 comp rx=0 tx=0).stop 2024-04-25T09:04:10.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.439+0000 7f0244a00640 1 -- 172.21.15.175:0/3397969398 shutdown_connections 2024-04-25T09:04:10.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.439+0000 7f0244a00640 1 --2- 172.21.15.175:0/3397969398 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f021c066f60 0x7f021c069420 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.439+0000 7f0244a00640 1 --2- 172.21.15.175:0/3397969398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02401627f0 0x7f02400c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.439+0000 7f0244a00640 1 --2- 172.21.15.175:0/3397969398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0240162390 0x7f02400c8720 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.439+0000 7f0244a00640 1 --2- 172.21.15.175:0/3397969398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0224003f40 0x7f024014ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.439+0000 7f0244a00640 1 -- 172.21.15.175:0/3397969398 >> 172.21.15.175:0/3397969398 conn(0x7f02400b3140 msgr2=0x7f02400c7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:10.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.439+0000 7f0244a00640 1 -- 172.21.15.175:0/3397969398 shutdown_connections 2024-04-25T09:04:10.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.443+0000 7f0244a00640 1 -- 172.21.15.175:0/3397969398 wait complete. 2024-04-25T09:04:10.473 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:10.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.619+0000 7f9c23e00640 1 Processor -- start 2024-04-25T09:04:10.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.619+0000 7f9c23e00640 1 -- start start 2024-04-25T09:04:10.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.619+0000 7f9c23e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c240d03b0 0x7f9c240b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.619+0000 7f9c23e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c240cf9a0 con 0x7f9c2409a5f0 2024-04-25T09:04:10.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.619+0000 7f9c23e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c240b2030 con 0x7f9c2415b930 2024-04-25T09:04:10.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.619+0000 7f9c23e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c240cc1d0 con 0x7f9c240d03b0 2024-04-25T09:04:10.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.619+0000 7f9c1be00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f9c2409a5f0 0x7f9c240cfca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59164/0 (socket says 172.21.15.175:59164) 2024-04-25T09:04:10.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.619+0000 7f9c1be00640 1 -- 172.21.15.175:0/3013371716 learned_addr learned my addr 172.21.15.175:0/3013371716 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:10.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.619+0000 7f9c23400640 1 --2- 172.21.15.175:0/3013371716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c240d03b0 0x7f9c240b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.619+0000 7f9c22000640 1 -- 172.21.15.175:0/3013371716 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947165571 0 0) 0x7f9c240cf9a0 con 0x7f9c2409a5f0 2024-04-25T09:04:10.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.619+0000 7f9c22000640 1 -- 172.21.15.175:0/3013371716 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c08003530 con 0x7f9c2409a5f0 2024-04-25T09:04:10.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.619+0000 7f9c22000640 1 -- 172.21.15.175:0/3013371716 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997060740 0 0) 0x7f9c240b2030 con 0x7f9c2415b930 2024-04-25T09:04:10.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.619+0000 7f9c22000640 1 -- 172.21.15.175:0/3013371716 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c240cf9a0 con 0x7f9c2415b930 2024-04-25T09:04:10.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.619+0000 7f9c23400640 1 -- 172.21.15.175:0/3013371716 >> v1:172.21.15.177:6789/0 conn(0x7f9c2415b930 legacy=0x7f9c240cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.619+0000 7f9c23400640 1 -- 172.21.15.175:0/3013371716 >> v1:172.21.15.175:6789/0 conn(0x7f9c2409a5f0 legacy=0x7f9c240cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.619+0000 7f9c23400640 1 -- 172.21.15.175:0/3013371716 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c240cc400 con 0x7f9c240d03b0 2024-04-25T09:04:10.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.623+0000 7f9c23400640 1 --2- 172.21.15.175:0/3013371716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c240d03b0 0x7f9c240b2480 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009dc0 tx=0x7f9c1c01c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e73a098409a90b79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:10.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.623+0000 7f9c22000640 1 -- 172.21.15.175:0/3013371716 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c0b2070 con 0x7f9c240d03b0 2024-04-25T09:04:10.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.623+0000 7f9c22000640 1 -- 172.21.15.175:0/3013371716 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c0a5940 con 0x7f9c240d03b0 2024-04-25T09:04:10.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.623+0000 7f9c22000640 1 -- 172.21.15.175:0/3013371716 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c0a5cf0 con 0x7f9c240d03b0 2024-04-25T09:04:10.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.623+0000 7f9c23e00640 1 -- 172.21.15.175:0/3013371716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c240d03b0 msgr2=0x7f9c240b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.623+0000 7f9c23e00640 1 --2- 172.21.15.175:0/3013371716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c240d03b0 0x7f9c240b2480 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009dc0 tx=0x7f9c1c01c990 comp rx=0 tx=0).stop 2024-04-25T09:04:10.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.623+0000 7f9c23e00640 1 -- 172.21.15.175:0/3013371716 shutdown_connections 2024-04-25T09:04:10.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.623+0000 7f9c23e00640 1 --2- 172.21.15.175:0/3013371716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c240d03b0 0x7f9c240b2480 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.623+0000 7f9c23e00640 1 -- 172.21.15.175:0/3013371716 >> 172.21.15.175:0/3013371716 conn(0x7f9c240b31b0 msgr2=0x7f9c240b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:10.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.623+0000 7f9c23e00640 1 -- 172.21.15.175:0/3013371716 shutdown_connections 2024-04-25T09:04:10.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.623+0000 7f9c23e00640 1 -- 172.21.15.175:0/3013371716 wait complete. 2024-04-25T09:04:10.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.623+0000 7f9c23e00640 1 Processor -- start 2024-04-25T09:04:10.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c23e00640 1 -- start start 2024-04-25T09:04:10.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c23e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c240d03b0 0x7f9c2415de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c23e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c2415b930 0x7f9c24166710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c23e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c240c7ca0 0x7f9c2415be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c23e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c240cd4a0 con 0x7f9c240d03b0 2024-04-25T09:04:10.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c23e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c240ccf80 con 0x7f9c2415b930 2024-04-25T09:04:10.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c23e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c240cd620 con 0x7f9c240c7ca0 2024-04-25T09:04:10.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c22a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c240d03b0 0x7f9c2415de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c22a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c240d03b0 0x7f9c2415de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36242/0 (socket says 172.21.15.175:36242) 2024-04-25T09:04:10.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c22a00640 1 -- 172.21.15.175:0/107205872 learned_addr learned my addr 172.21.15.175:0/107205872 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:10.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c22a00640 1 -- 172.21.15.175:0/107205872 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c240c7ca0 msgr2=0x7f9c2415be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c22a00640 1 --2- 172.21.15.175:0/107205872 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c240c7ca0 0x7f9c2415be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c22a00640 1 -- 172.21.15.175:0/107205872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c2415b930 msgr2=0x7f9c24166710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c22a00640 1 --2- 172.21.15.175:0/107205872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c2415b930 0x7f9c24166710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c22a00640 1 -- 172.21.15.175:0/107205872 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2414f870 con 0x7f9c240d03b0 2024-04-25T09:04:10.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c22a00640 1 --2- 172.21.15.175:0/107205872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c240d03b0 0x7f9c2415de10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400c460 tx=0x7f9c1400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:10.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c1b400640 1 -- 172.21.15.175:0/107205872 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c14017070 con 0x7f9c240d03b0 2024-04-25T09:04:10.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c1b400640 1 -- 172.21.15.175:0/107205872 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c140052f0 con 0x7f9c240d03b0 2024-04-25T09:04:10.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c1b400640 1 -- 172.21.15.175:0/107205872 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c14011890 con 0x7f9c240d03b0 2024-04-25T09:04:10.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c23e00640 1 -- 172.21.15.175:0/107205872 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2415e840 con 0x7f9c240d03b0 2024-04-25T09:04:10.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c23e00640 1 -- 172.21.15.175:0/107205872 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c240c5440 con 0x7f9c240d03b0 2024-04-25T09:04:10.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.627+0000 7f9c23e00640 1 -- 172.21.15.175:0/107205872 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c24074a60 con 0x7f9c240d03b0 2024-04-25T09:04:10.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.631+0000 7f9c1b400640 1 -- 172.21.15.175:0/107205872 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9c1401a070 con 0x7f9c240d03b0 2024-04-25T09:04:10.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.631+0000 7f9c1b400640 1 --2- 172.21.15.175:0/107205872 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9c00066f60 0x7f9c00069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.631+0000 7f9c1b400640 1 -- 172.21.15.175:0/107205872 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c14084350 con 0x7f9c240d03b0 2024-04-25T09:04:10.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.631+0000 7f9c1be00640 1 --2- 172.21.15.175:0/107205872 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9c00066f60 0x7f9c00069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.631+0000 7f9c1be00640 1 --2- 172.21.15.175:0/107205872 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9c00066f60 0x7f9c00069420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c007fd0 tx=0x7f9c0c007940 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:10.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.635+0000 7f9c1b400640 1 -- 172.21.15.175:0/107205872 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9c140553f0 con 0x7f9c240d03b0 2024-04-25T09:04:10.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.791+0000 7f9c23e00640 1 -- 172.21.15.175:0/107205872 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c240b0990 con 0x7f9c240d03b0 2024-04-25T09:04:10.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.791+0000 7f9c1b400640 1 -- 172.21.15.175:0/107205872 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16654 (secure 0 0 0) 0x7f9c14054cf0 con 0x7f9c240d03b0 2024-04-25T09:04:10.783 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:10.783 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":19,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:09.809724+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:10.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.791+0000 7f9c23e00640 1 -- 172.21.15.175:0/107205872 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9c00066f60 msgr2=0x7f9c00069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.791+0000 7f9c23e00640 1 --2- 172.21.15.175:0/107205872 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9c00066f60 0x7f9c00069420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c007fd0 tx=0x7f9c0c007940 comp rx=0 tx=0).stop 2024-04-25T09:04:10.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.791+0000 7f9c23e00640 1 -- 172.21.15.175:0/107205872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c240d03b0 msgr2=0x7f9c2415de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.791+0000 7f9c23e00640 1 --2- 172.21.15.175:0/107205872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c240d03b0 0x7f9c2415de10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400c460 tx=0x7f9c1400c920 comp rx=0 tx=0).stop 2024-04-25T09:04:10.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.791+0000 7f9c23e00640 1 -- 172.21.15.175:0/107205872 shutdown_connections 2024-04-25T09:04:10.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.791+0000 7f9c23e00640 1 --2- 172.21.15.175:0/107205872 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9c00066f60 0x7f9c00069420 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.791+0000 7f9c23e00640 1 --2- 172.21.15.175:0/107205872 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c240c7ca0 0x7f9c2415be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.791+0000 7f9c23e00640 1 --2- 172.21.15.175:0/107205872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c2415b930 0x7f9c24166710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.791+0000 7f9c23e00640 1 --2- 172.21.15.175:0/107205872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c240d03b0 0x7f9c2415de10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.791+0000 7f9c23e00640 1 -- 172.21.15.175:0/107205872 >> 172.21.15.175:0/107205872 conn(0x7f9c240b31b0 msgr2=0x7f9c240ce140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:10.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.795+0000 7f9c23e00640 1 -- 172.21.15.175:0/107205872 shutdown_connections 2024-04-25T09:04:10.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.795+0000 7f9c23e00640 1 -- 172.21.15.175:0/107205872 wait complete. 2024-04-25T09:04:10.803 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:10.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.947+0000 7f0029000640 1 Processor -- start 2024-04-25T09:04:10.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.947+0000 7f0029000640 1 -- start start 2024-04-25T09:04:10.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.947+0000 7f0029000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f002415a900 0x7f002406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.947+0000 7f0029000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00240cd520 0x7f00240ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.947+0000 7f0029000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00240cda00 con 0x7f00240cf560 2024-04-25T09:04:10.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.947+0000 7f0029000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f002415bcf0 con 0x7f002415a900 2024-04-25T09:04:10.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.947+0000 7f0029000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00240cdce0 con 0x7f00240cd520 2024-04-25T09:04:10.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.947+0000 7f0019400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00240cd520 0x7f00240ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.947+0000 7f0019400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00240cd520 0x7f00240ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:43910/0 (socket says 172.21.15.175:43910) 2024-04-25T09:04:10.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.947+0000 7f0019400640 1 -- 172.21.15.175:0/3971342454 learned_addr learned my addr 172.21.15.175:0/3971342454 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:10.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.947+0000 7f0021e00640 1 --2- 172.21.15.175:0/3971342454 >> v2:172.21.15.177:3300/0 conn(0x7f002415a900 0x7f002406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.947+0000 7f0019400640 1 -- 172.21.15.175:0/3971342454 >> v2:172.21.15.177:3300/0 conn(0x7f002415a900 msgr2=0x7f002406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:10.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.947+0000 7f0019400640 1 --2- 172.21.15.175:0/3971342454 >> v2:172.21.15.177:3300/0 conn(0x7f002415a900 0x7f002406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.947+0000 7f0019400640 1 -- 172.21.15.175:0/3971342454 >> v1:172.21.15.177:6789/0 conn(0x7f00240cf560 legacy=0x7f002415bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.947+0000 7f0019400640 1 -- 172.21.15.175:0/3971342454 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00240cdfc0 con 0x7f00240cd520 2024-04-25T09:04:10.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.951+0000 7f0019400640 1 --2- 172.21.15.175:0/3971342454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00240cd520 0x7f00240ceaa0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f000c009870 tx=0x7f000c01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f372b246906567bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:10.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.951+0000 7f0021400640 1 -- 172.21.15.175:0/3971342454 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c0ab640 con 0x7f00240cd520 2024-04-25T09:04:10.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.951+0000 7f0021400640 1 -- 172.21.15.175:0/3971342454 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c0b0070 con 0x7f00240cd520 2024-04-25T09:04:10.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.951+0000 7f0021400640 1 -- 172.21.15.175:0/3971342454 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c0aba00 con 0x7f00240cd520 2024-04-25T09:04:10.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.951+0000 7f0029000640 1 -- 172.21.15.175:0/3971342454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00240cd520 msgr2=0x7f00240ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.951+0000 7f0029000640 1 --2- 172.21.15.175:0/3971342454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00240cd520 0x7f00240ceaa0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f000c009870 tx=0x7f000c01c530 comp rx=0 tx=0).stop 2024-04-25T09:04:10.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.951+0000 7f0029000640 1 -- 172.21.15.175:0/3971342454 shutdown_connections 2024-04-25T09:04:10.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.951+0000 7f0029000640 1 --2- 172.21.15.175:0/3971342454 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00240cd520 0x7f00240ceaa0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.951+0000 7f0029000640 1 --2- 172.21.15.175:0/3971342454 >> v2:172.21.15.177:3300/0 conn(0x7f002415a900 0x7f002406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.951+0000 7f0029000640 1 -- 172.21.15.175:0/3971342454 >> 172.21.15.175:0/3971342454 conn(0x7f0024067150 msgr2=0x7f002406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:10.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.951+0000 7f0029000640 1 -- 172.21.15.175:0/3971342454 shutdown_connections 2024-04-25T09:04:10.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.951+0000 7f0029000640 1 -- 172.21.15.175:0/3971342454 wait complete. 2024-04-25T09:04:10.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0029000640 1 Processor -- start 2024-04-25T09:04:10.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0029000640 1 -- start start 2024-04-25T09:04:10.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0029000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00240cf560 0x7f00241458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0029000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f002415a900 0x7f00240b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0029000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00240b1160 0x7f00240b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0029000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00240cf160 con 0x7f002415a900 2024-04-25T09:04:10.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0029000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00240cefe0 con 0x7f00240cf560 2024-04-25T09:04:10.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0029000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002406d3b0 con 0x7f00240b1160 2024-04-25T09:04:10.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0019400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f002415a900 0x7f00240b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0019400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f002415a900 0x7f00240b0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36250/0 (socket says 172.21.15.175:36250) 2024-04-25T09:04:10.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0019400640 1 -- 172.21.15.175:0/932480482 learned_addr learned my addr 172.21.15.175:0/932480482 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:10.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0021e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00240cf560 0x7f00241458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0022800640 1 --2- 172.21.15.175:0/932480482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00240b1160 0x7f00240b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0019400640 1 -- 172.21.15.175:0/932480482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00240b1160 msgr2=0x7f00240b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0019400640 1 --2- 172.21.15.175:0/932480482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00240b1160 0x7f00240b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0019400640 1 -- 172.21.15.175:0/932480482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00240cf560 msgr2=0x7f00241458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:10.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0019400640 1 --2- 172.21.15.175:0/932480482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00240cf560 0x7f00241458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:10.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0019400640 1 -- 172.21.15.175:0/932480482 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0024145df0 con 0x7f002415a900 2024-04-25T09:04:10.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0022800640 1 --2- 172.21.15.175:0/932480482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00240b1160 0x7f00240b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:10.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0019400640 1 --2- 172.21.15.175:0/932480482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f002415a900 0x7f00240b0c20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f000c0ad040 tx=0x7f000c01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:10.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f001aa00640 1 -- 172.21.15.175:0/932480482 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c0be3f0 con 0x7f002415a900 2024-04-25T09:04:10.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f001aa00640 1 -- 172.21.15.175:0/932480482 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c0be590 con 0x7f002415a900 2024-04-25T09:04:10.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f001aa00640 1 -- 172.21.15.175:0/932480482 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c0be980 con 0x7f002415a900 2024-04-25T09:04:10.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0029000640 1 -- 172.21.15.175:0/932480482 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00241575f0 con 0x7f002415a900 2024-04-25T09:04:10.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.955+0000 7f0029000640 1 -- 172.21.15.175:0/932480482 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00240af430 con 0x7f002415a900 2024-04-25T09:04:10.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.959+0000 7f0029000640 1 -- 172.21.15.175:0/932480482 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0024074a60 con 0x7f002415a900 2024-04-25T09:04:10.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.959+0000 7f001aa00640 1 -- 172.21.15.175:0/932480482 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f000c0c7440 con 0x7f002415a900 2024-04-25T09:04:10.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.959+0000 7f001aa00640 1 --2- 172.21.15.175:0/932480482 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0000066f60 0x7f0000069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:10.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.959+0000 7f001aa00640 1 -- 172.21.15.175:0/932480482 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f000c11f580 con 0x7f002415a900 2024-04-25T09:04:10.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.959+0000 7f0021e00640 1 --2- 172.21.15.175:0/932480482 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0000066f60 0x7f0000069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:10.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.959+0000 7f0021e00640 1 --2- 172.21.15.175:0/932480482 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0000066f60 0x7f0000069420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f00241467c0 tx=0x7f001400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:10.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:10.963+0000 7f001aa00640 1 -- 172.21.15.175:0/932480482 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f000c016150 con 0x7f002415a900 2024-04-25T09:04:11.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.119+0000 7f0029000640 1 -- 172.21.15.175:0/932480482 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00240008e0 con 0x7f002415a900 2024-04-25T09:04:11.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.119+0000 7f001aa00640 1 -- 172.21.15.175:0/932480482 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16654 (secure 0 0 0) 0x7f000c0effd0 con 0x7f002415a900 2024-04-25T09:04:11.111 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:11.112 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":19,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:09.809724+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:11.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.123+0000 7f0029000640 1 -- 172.21.15.175:0/932480482 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0000066f60 msgr2=0x7f0000069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.123+0000 7f0029000640 1 --2- 172.21.15.175:0/932480482 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0000066f60 0x7f0000069420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f00241467c0 tx=0x7f001400b040 comp rx=0 tx=0).stop 2024-04-25T09:04:11.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.123+0000 7f0029000640 1 -- 172.21.15.175:0/932480482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f002415a900 msgr2=0x7f00240b0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.123+0000 7f0029000640 1 --2- 172.21.15.175:0/932480482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f002415a900 0x7f00240b0c20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f000c0ad040 tx=0x7f000c01ad70 comp rx=0 tx=0).stop 2024-04-25T09:04:11.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.123+0000 7f0029000640 1 -- 172.21.15.175:0/932480482 shutdown_connections 2024-04-25T09:04:11.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.123+0000 7f0029000640 1 --2- 172.21.15.175:0/932480482 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0000066f60 0x7f0000069420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.123+0000 7f0029000640 1 --2- 172.21.15.175:0/932480482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00240b1160 0x7f00240b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.123+0000 7f0029000640 1 --2- 172.21.15.175:0/932480482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f002415a900 0x7f00240b0c20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.123+0000 7f0029000640 1 --2- 172.21.15.175:0/932480482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00240cf560 0x7f00241458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.123+0000 7f0029000640 1 -- 172.21.15.175:0/932480482 >> 172.21.15.175:0/932480482 conn(0x7f00240cd520 msgr2=0x7f002406d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:11.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.123+0000 7f0029000640 1 -- 172.21.15.175:0/932480482 shutdown_connections 2024-04-25T09:04:11.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.123+0000 7f0029000640 1 -- 172.21.15.175:0/932480482 wait complete. 2024-04-25T09:04:11.133 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:04:11.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.279+0000 7f0109c00640 1 Processor -- start 2024-04-25T09:04:11.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.279+0000 7f0109c00640 1 -- start start 2024-04-25T09:04:11.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.279+0000 7f0109c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f010415a9f0 0x7f01040b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.279+0000 7f0109c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01040ce8c0 con 0x7f01040af8d0 2024-04-25T09:04:11.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.279+0000 7f0109c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01040ceba0 con 0x7f01040b5520 2024-04-25T09:04:11.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.279+0000 7f0109c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01040b4640 con 0x7f010415a9f0 2024-04-25T09:04:11.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.279+0000 7f0102a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f010415a9f0 0x7f01040b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.279+0000 7f0103400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f01040b5520 0x7f01040cf960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:46404/0 (socket says 172.21.15.175:46404) 2024-04-25T09:04:11.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.279+0000 7f0103400640 1 -- 172.21.15.175:0/1596759008 learned_addr learned my addr 172.21.15.175:0/1596759008 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:11.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.279+0000 7f0101600640 1 -- 172.21.15.175:0/1596759008 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545089767 0 0) 0x7f01040ceba0 con 0x7f01040b5520 2024-04-25T09:04:11.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.279+0000 7f0101600640 1 -- 172.21.15.175:0/1596759008 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00e8003530 con 0x7f01040b5520 2024-04-25T09:04:11.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.279+0000 7f0102a00640 1 -- 172.21.15.175:0/1596759008 >> v1:172.21.15.177:6789/0 conn(0x7f01040b5520 legacy=0x7f01040cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.279+0000 7f0102a00640 1 -- 172.21.15.175:0/1596759008 >> v1:172.21.15.175:6789/0 conn(0x7f01040af8d0 legacy=0x7f01040b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.279+0000 7f0102a00640 1 -- 172.21.15.175:0/1596759008 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01040cee80 con 0x7f010415a9f0 2024-04-25T09:04:11.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.283+0000 7f0102a00640 1 --2- 172.21.15.175:0/1596759008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f010415a9f0 0x7f01040b4100 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009d90 tx=0x7f00f401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9edf99785857833 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.283+0000 7f0101600640 1 -- 172.21.15.175:0/1596759008 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f40b2070 con 0x7f010415a9f0 2024-04-25T09:04:11.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.283+0000 7f0101600640 1 -- 172.21.15.175:0/1596759008 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f40a5990 con 0x7f010415a9f0 2024-04-25T09:04:11.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.283+0000 7f0101600640 1 -- 172.21.15.175:0/1596759008 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f40a5d60 con 0x7f010415a9f0 2024-04-25T09:04:11.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.283+0000 7f0109c00640 1 -- 172.21.15.175:0/1596759008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f010415a9f0 msgr2=0x7f01040b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.283+0000 7f0109c00640 1 --2- 172.21.15.175:0/1596759008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f010415a9f0 0x7f01040b4100 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009d90 tx=0x7f00f401c8b0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.283+0000 7f0109c00640 1 -- 172.21.15.175:0/1596759008 shutdown_connections 2024-04-25T09:04:11.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.283+0000 7f0109c00640 1 --2- 172.21.15.175:0/1596759008 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f010415a9f0 0x7f01040b4100 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.283+0000 7f0109c00640 1 -- 172.21.15.175:0/1596759008 >> 172.21.15.175:0/1596759008 conn(0x7f010406e420 msgr2=0x7f010406e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:11.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.283+0000 7f0109c00640 1 -- 172.21.15.175:0/1596759008 shutdown_connections 2024-04-25T09:04:11.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.283+0000 7f0109c00640 1 -- 172.21.15.175:0/1596759008 wait complete. 2024-04-25T09:04:11.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0109c00640 1 Processor -- start 2024-04-25T09:04:11.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0109c00640 1 -- start start 2024-04-25T09:04:11.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0109c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01040af8d0 0x7f01041400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0109c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01040b5520 0x7f0104152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0109c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f010415a9f0 0x7f0104152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0109c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01040d0c90 con 0x7f01040b5520 2024-04-25T09:04:11.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0109c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01040d0b10 con 0x7f010415a9f0 2024-04-25T09:04:11.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0109c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0104168440 con 0x7f01040af8d0 2024-04-25T09:04:11.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0102000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01040b5520 0x7f0104152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0102000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01040b5520 0x7f0104152710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36268/0 (socket says 172.21.15.175:36268) 2024-04-25T09:04:11.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0102000640 1 -- 172.21.15.175:0/802260832 learned_addr learned my addr 172.21.15.175:0/802260832 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:11.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0102a00640 1 --2- 172.21.15.175:0/802260832 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01040af8d0 0x7f01041400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0103400640 1 --2- 172.21.15.175:0/802260832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f010415a9f0 0x7f0104152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0102000640 1 -- 172.21.15.175:0/802260832 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01040af8d0 msgr2=0x7f01041400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0102000640 1 --2- 172.21.15.175:0/802260832 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01040af8d0 0x7f01041400e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0102000640 1 -- 172.21.15.175:0/802260832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f010415a9f0 msgr2=0x7f0104152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0102000640 1 --2- 172.21.15.175:0/802260832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f010415a9f0 0x7f0104152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0102000640 1 -- 172.21.15.175:0/802260832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0104150e50 con 0x7f01040b5520 2024-04-25T09:04:11.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0103400640 1 --2- 172.21.15.175:0/802260832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f010415a9f0 0x7f0104152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:11.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0102000640 1 --2- 172.21.15.175:0/802260832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01040b5520 0x7f0104152710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f00f000c450 tx=0x7f00f000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f00faa00640 1 -- 172.21.15.175:0/802260832 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0016020 con 0x7f01040b5520 2024-04-25T09:04:11.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f00faa00640 1 -- 172.21.15.175:0/802260832 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f00052d0 con 0x7f01040b5520 2024-04-25T09:04:11.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f00faa00640 1 -- 172.21.15.175:0/802260832 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0007260 con 0x7f01040b5520 2024-04-25T09:04:11.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0109c00640 1 -- 172.21.15.175:0/802260832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01041534c0 con 0x7f01040b5520 2024-04-25T09:04:11.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.287+0000 7f0109c00640 1 -- 172.21.15.175:0/802260832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0104153a80 con 0x7f01040b5520 2024-04-25T09:04:11.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.291+0000 7f0109c00640 1 -- 172.21.15.175:0/802260832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0104075160 con 0x7f01040b5520 2024-04-25T09:04:11.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.291+0000 7f00faa00640 1 -- 172.21.15.175:0/802260832 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f00f0007400 con 0x7f01040b5520 2024-04-25T09:04:11.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.291+0000 7f00faa00640 1 --2- 172.21.15.175:0/802260832 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f00e4066f60 0x7f00e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.291+0000 7f00faa00640 1 -- 172.21.15.175:0/802260832 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00f0084960 con 0x7f01040b5520 2024-04-25T09:04:11.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.291+0000 7f0102a00640 1 --2- 172.21.15.175:0/802260832 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f00e4066f60 0x7f00e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.291+0000 7f0102a00640 1 --2- 172.21.15.175:0/802260832 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f00e4066f60 0x7f00e4069420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f00f40af000 tx=0x7f00f40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.295+0000 7f00faa00640 1 -- 172.21.15.175:0/802260832 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f00f0020020 con 0x7f01040b5520 2024-04-25T09:04:11.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:11.483+0000 7f0109c00640 1 -- 172.21.15.175:0/802260832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f01040b2fa0 con 0x7f01040b5520 2024-04-25T09:04:12.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.447+0000 7f00faa00640 1 -- 172.21.15.175:0/802260832 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f00f0005480 con 0x7f01040b5520 2024-04-25T09:04:12.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.451+0000 7f0109c00640 1 -- 172.21.15.175:0/802260832 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f00e4066f60 msgr2=0x7f00e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.451+0000 7f0109c00640 1 --2- 172.21.15.175:0/802260832 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f00e4066f60 0x7f00e4069420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f00f40af000 tx=0x7f00f40a7070 comp rx=0 tx=0).stop 2024-04-25T09:04:12.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.451+0000 7f0109c00640 1 -- 172.21.15.175:0/802260832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01040b5520 msgr2=0x7f0104152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.451+0000 7f0109c00640 1 --2- 172.21.15.175:0/802260832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01040b5520 0x7f0104152710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f00f000c450 tx=0x7f00f000c910 comp rx=0 tx=0).stop 2024-04-25T09:04:12.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.451+0000 7f0109c00640 1 -- 172.21.15.175:0/802260832 shutdown_connections 2024-04-25T09:04:12.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.451+0000 7f0109c00640 1 --2- 172.21.15.175:0/802260832 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f00e4066f60 0x7f00e4069420 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.451+0000 7f0109c00640 1 --2- 172.21.15.175:0/802260832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f010415a9f0 0x7f0104152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.451+0000 7f0109c00640 1 --2- 172.21.15.175:0/802260832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01040b5520 0x7f0104152710 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.451+0000 7f0109c00640 1 --2- 172.21.15.175:0/802260832 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01040af8d0 0x7f01041400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.451+0000 7f0109c00640 1 -- 172.21.15.175:0/802260832 >> 172.21.15.175:0/802260832 conn(0x7f010406e420 msgr2=0x7f01040b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:12.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.451+0000 7f0109c00640 1 -- 172.21.15.175:0/802260832 shutdown_connections 2024-04-25T09:04:12.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.451+0000 7f0109c00640 1 -- 172.21.15.175:0/802260832 wait complete. 2024-04-25T09:04:12.464 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:04:12.464 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:04:12.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.611+0000 7fd7ae200640 1 Processor -- start 2024-04-25T09:04:12.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.611+0000 7fd7ae200640 1 -- start start 2024-04-25T09:04:12.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.611+0000 7fd7ae200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a80b0c00 0x7fd7a80afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.611+0000 7fd7ae200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd7a806b510 0x7fd7a815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.611+0000 7fd7ae200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a80ccc80 con 0x7fd7a80af980 2024-04-25T09:04:12.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.611+0000 7fd7ae200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a80b2010 con 0x7fd7a806b510 2024-04-25T09:04:12.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.611+0000 7fd7ae200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a80ce6d0 con 0x7fd7a80b0c00 2024-04-25T09:04:12.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.611+0000 7fd7a7e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd7a806b510 0x7fd7a815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.611+0000 7fd79ea00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd7a80af980 0x7fd7a806ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59192/0 (socket says 172.21.15.175:59192) 2024-04-25T09:04:12.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.611+0000 7fd79ea00640 1 -- 172.21.15.175:0/2500515595 learned_addr learned my addr 172.21.15.175:0/2500515595 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:12.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.611+0000 7fd7a7e00640 1 --2- 172.21.15.175:0/2500515595 >> v2:172.21.15.175:3300/0 conn(0x7fd7a806b510 0x7fd7a815d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36276/0 (socket says 172.21.15.175:36276) 2024-04-25T09:04:12.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.615+0000 7fd7a7400640 1 --2- 172.21.15.175:0/2500515595 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a80b0c00 0x7fd7a80afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.615+0000 7fd7a7e00640 1 -- 172.21.15.175:0/2500515595 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a80b0c00 msgr2=0x7fd7a80afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:12.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.615+0000 7fd7a7e00640 1 --2- 172.21.15.175:0/2500515595 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a80b0c00 0x7fd7a80afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.615+0000 7fd7a7e00640 1 -- 172.21.15.175:0/2500515595 >> v1:172.21.15.175:6789/0 conn(0x7fd7a80af980 legacy=0x7fd7a806ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.615+0000 7fd7a7e00640 1 -- 172.21.15.175:0/2500515595 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a80ccf60 con 0x7fd7a806b510 2024-04-25T09:04:12.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.615+0000 7fd7a7e00640 1 --2- 172.21.15.175:0/2500515595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a806b510 0x7fd7a815d460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009d90 tx=0x7fd7a001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0b206eccd298b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.615+0000 7fd7a6a00640 1 -- 172.21.15.175:0/2500515595 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a00b2070 con 0x7fd7a806b510 2024-04-25T09:04:12.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.615+0000 7fd7a6a00640 1 -- 172.21.15.175:0/2500515595 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a00a5910 con 0x7fd7a806b510 2024-04-25T09:04:12.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.615+0000 7fd7a6a00640 1 -- 172.21.15.175:0/2500515595 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a00a5ce0 con 0x7fd7a806b510 2024-04-25T09:04:12.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.615+0000 7fd7ae200640 1 -- 172.21.15.175:0/2500515595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a806b510 msgr2=0x7fd7a815d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.615+0000 7fd7ae200640 1 --2- 172.21.15.175:0/2500515595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a806b510 0x7fd7a815d460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009d90 tx=0x7fd7a001c940 comp rx=0 tx=0).stop 2024-04-25T09:04:12.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7ae200640 1 -- 172.21.15.175:0/2500515595 shutdown_connections 2024-04-25T09:04:12.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7ae200640 1 --2- 172.21.15.175:0/2500515595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a806b510 0x7fd7a815d460 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7ae200640 1 --2- 172.21.15.175:0/2500515595 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a80b0c00 0x7fd7a80afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7ae200640 1 -- 172.21.15.175:0/2500515595 >> 172.21.15.175:0/2500515595 conn(0x7fd7a80d07e0 msgr2=0x7fd7a80d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:12.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7ae200640 1 -- 172.21.15.175:0/2500515595 shutdown_connections 2024-04-25T09:04:12.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7ae200640 1 -- 172.21.15.175:0/2500515595 wait complete. 2024-04-25T09:04:12.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7ae200640 1 Processor -- start 2024-04-25T09:04:12.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7ae200640 1 -- start start 2024-04-25T09:04:12.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7ae200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a806b510 0x7fd7a8154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7ae200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a80af980 0x7fd7a815e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7ae200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a80b0c00 0x7fd7a8160660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7ae200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a806bb20 con 0x7fd7a80b0c00 2024-04-25T09:04:12.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7ae200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a806b9a0 con 0x7fd7a80af980 2024-04-25T09:04:12.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7ae200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a80cd1c0 con 0x7fd7a806b510 2024-04-25T09:04:12.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7a7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a80b0c00 0x7fd7a8160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7a7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a80b0c00 0x7fd7a8160660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36292/0 (socket says 172.21.15.175:36292) 2024-04-25T09:04:12.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7a7e00640 1 -- 172.21.15.175:0/3321865691 learned_addr learned my addr 172.21.15.175:0/3321865691 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:12.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7a7400640 1 --2- 172.21.15.175:0/3321865691 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a806b510 0x7fd7a8154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd79ea00640 1 --2- 172.21.15.175:0/3321865691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a80af980 0x7fd7a815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7a7e00640 1 -- 172.21.15.175:0/3321865691 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a806b510 msgr2=0x7fd7a8154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7a7e00640 1 --2- 172.21.15.175:0/3321865691 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a806b510 0x7fd7a8154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7a7e00640 1 -- 172.21.15.175:0/3321865691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a80af980 msgr2=0x7fd7a815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7a7e00640 1 --2- 172.21.15.175:0/3321865691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a80af980 0x7fd7a815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7a7e00640 1 -- 172.21.15.175:0/3321865691 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a81551b0 con 0x7fd7a80b0c00 2024-04-25T09:04:12.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd79ea00640 1 --2- 172.21.15.175:0/3321865691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a80af980 0x7fd7a815e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:12.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7a7e00640 1 --2- 172.21.15.175:0/3321865691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a80b0c00 0x7fd7a8160660 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7a00b0040 tx=0x7fd7a00196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd79fe00640 1 -- 172.21.15.175:0/3321865691 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a00b2050 con 0x7fd7a80b0c00 2024-04-25T09:04:12.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd79fe00640 1 -- 172.21.15.175:0/3321865691 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a00be070 con 0x7fd7a80b0c00 2024-04-25T09:04:12.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd79fe00640 1 -- 172.21.15.175:0/3321865691 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a00ada70 con 0x7fd7a80b0c00 2024-04-25T09:04:12.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.619+0000 7fd7ae200640 1 -- 172.21.15.175:0/3321865691 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a8155490 con 0x7fd7a80b0c00 2024-04-25T09:04:12.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.623+0000 7fd7ae200640 1 -- 172.21.15.175:0/3321865691 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a8155a50 con 0x7fd7a80b0c00 2024-04-25T09:04:12.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.623+0000 7fd7ae200640 1 -- 172.21.15.175:0/3321865691 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a806ccf0 con 0x7fd7a80b0c00 2024-04-25T09:04:12.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.623+0000 7fd79fe00640 1 -- 172.21.15.175:0/3321865691 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd7a00adc10 con 0x7fd7a80b0c00 2024-04-25T09:04:12.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.623+0000 7fd79fe00640 1 --2- 172.21.15.175:0/3321865691 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd784066f60 0x7fd784069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.623+0000 7fd79fe00640 1 -- 172.21.15.175:0/3321865691 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7a0120250 con 0x7fd7a80b0c00 2024-04-25T09:04:12.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.623+0000 7fd7a7400640 1 --2- 172.21.15.175:0/3321865691 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd784066f60 0x7fd784069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.623+0000 7fd7a7400640 1 --2- 172.21.15.175:0/3321865691 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd784066f60 0x7fd784069420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd7980079c0 tx=0x7fd798008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.627+0000 7fd79fe00640 1 -- 172.21.15.175:0/3321865691 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd7a0016560 con 0x7fd7a80b0c00 2024-04-25T09:04:12.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:12.815+0000 7fd7ae200640 1 -- 172.21.15.175:0/3321865691 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd7a80b6250 con 0x7fd7a80b0c00 2024-04-25T09:04:13.383 INFO:tasks.ceph.mds.c.smithi175.stderr:2024-04-25T09:04:13.391+0000 7f15e0200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:04:13.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.459+0000 7fd79fe00640 1 -- 172.21.15.175:0/3321865691 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd7a00f11d0 con 0x7fd7a80b0c00 2024-04-25T09:04:13.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.459+0000 7fd7ae200640 1 -- 172.21.15.175:0/3321865691 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd784066f60 msgr2=0x7fd784069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.459+0000 7fd7ae200640 1 --2- 172.21.15.175:0/3321865691 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd784066f60 0x7fd784069420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd7980079c0 tx=0x7fd798008040 comp rx=0 tx=0).stop 2024-04-25T09:04:13.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.459+0000 7fd7ae200640 1 -- 172.21.15.175:0/3321865691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a80b0c00 msgr2=0x7fd7a8160660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.459+0000 7fd7ae200640 1 --2- 172.21.15.175:0/3321865691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a80b0c00 0x7fd7a8160660 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7a00b0040 tx=0x7fd7a00196e0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.459+0000 7fd7ae200640 1 -- 172.21.15.175:0/3321865691 shutdown_connections 2024-04-25T09:04:13.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.459+0000 7fd7ae200640 1 --2- 172.21.15.175:0/3321865691 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd784066f60 0x7fd784069420 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.459+0000 7fd7ae200640 1 --2- 172.21.15.175:0/3321865691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a80b0c00 0x7fd7a8160660 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.459+0000 7fd7ae200640 1 --2- 172.21.15.175:0/3321865691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a80af980 0x7fd7a815e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.459+0000 7fd7ae200640 1 --2- 172.21.15.175:0/3321865691 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a806b510 0x7fd7a8154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.459+0000 7fd7ae200640 1 -- 172.21.15.175:0/3321865691 >> 172.21.15.175:0/3321865691 conn(0x7fd7a80d07e0 msgr2=0x7fd7a806e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.459+0000 7fd7ae200640 1 -- 172.21.15.175:0/3321865691 shutdown_connections 2024-04-25T09:04:13.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.459+0000 7fd7ae200640 1 -- 172.21.15.175:0/3321865691 wait complete. 2024-04-25T09:04:13.473 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:04:13.474 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:13.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.619+0000 7f103a800640 1 Processor -- start 2024-04-25T09:04:13.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.619+0000 7f103a800640 1 -- start start 2024-04-25T09:04:13.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.619+0000 7f103a800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1034099a50 0x7f103406cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.619+0000 7f103a800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f103406bd60 0x7f1034099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.619+0000 7f103a800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10340d0d50 0x7f10340cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.619+0000 7f103a800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103409a370 con 0x7f1034099a50 2024-04-25T09:04:13.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.619+0000 7f103a800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10340cfcb0 con 0x7f103406bd60 2024-04-25T09:04:13.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.619+0000 7f103a800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10340cff90 con 0x7f10340d0d50 2024-04-25T09:04:13.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.619+0000 7f1033400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1034099a50 0x7f103406cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.619+0000 7f1033400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1034099a50 0x7f103406cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36296/0 (socket says 172.21.15.175:36296) 2024-04-25T09:04:13.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.619+0000 7f1033400640 1 -- 172.21.15.175:0/3602153267 learned_addr learned my addr 172.21.15.175:0/3602153267 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:13.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.619+0000 7f1033e00640 1 --2- 172.21.15.175:0/3602153267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10340d0d50 0x7f10340cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.619+0000 7f1032a00640 1 --2- 172.21.15.175:0/3602153267 >> v2:172.21.15.177:3300/0 conn(0x7f103406bd60 0x7f1034099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.619+0000 7f1033400640 1 -- 172.21.15.175:0/3602153267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10340d0d50 msgr2=0x7f10340cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.619+0000 7f1033400640 1 --2- 172.21.15.175:0/3602153267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10340d0d50 0x7f10340cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.619+0000 7f1033400640 1 -- 172.21.15.175:0/3602153267 >> v2:172.21.15.177:3300/0 conn(0x7f103406bd60 msgr2=0x7f1034099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.619+0000 7f1033400640 1 --2- 172.21.15.175:0/3602153267 >> v2:172.21.15.177:3300/0 conn(0x7f103406bd60 0x7f1034099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.619+0000 7f1033400640 1 -- 172.21.15.175:0/3602153267 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10340d0270 con 0x7f1034099a50 2024-04-25T09:04:13.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.623+0000 7f1033400640 1 --2- 172.21.15.175:0/3602153267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1034099a50 0x7f103406cc50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1034067440 tx=0x7f102401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd6b0857065b62d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.623+0000 7f1032000640 1 -- 172.21.15.175:0/3602153267 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10240b0070 con 0x7f1034099a50 2024-04-25T09:04:13.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.623+0000 7f1032000640 1 -- 172.21.15.175:0/3602153267 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10240ab600 con 0x7f1034099a50 2024-04-25T09:04:13.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.623+0000 7f1032000640 1 -- 172.21.15.175:0/3602153267 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10240ab9d0 con 0x7f1034099a50 2024-04-25T09:04:13.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.623+0000 7f103a800640 1 -- 172.21.15.175:0/3602153267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1034099a50 msgr2=0x7f103406cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.623+0000 7f103a800640 1 --2- 172.21.15.175:0/3602153267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1034099a50 0x7f103406cc50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1034067440 tx=0x7f102401c520 comp rx=0 tx=0).stop 2024-04-25T09:04:13.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.623+0000 7f103a800640 1 -- 172.21.15.175:0/3602153267 shutdown_connections 2024-04-25T09:04:13.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.623+0000 7f103a800640 1 --2- 172.21.15.175:0/3602153267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10340d0d50 0x7f10340cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.623+0000 7f103a800640 1 --2- 172.21.15.175:0/3602153267 >> v2:172.21.15.177:3300/0 conn(0x7f103406bd60 0x7f1034099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.623+0000 7f103a800640 1 --2- 172.21.15.175:0/3602153267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1034099a50 0x7f103406cc50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.623+0000 7f103a800640 1 -- 172.21.15.175:0/3602153267 >> 172.21.15.175:0/3602153267 conn(0x7f10340b3300 msgr2=0x7f10340b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.623+0000 7f103a800640 1 -- 172.21.15.175:0/3602153267 shutdown_connections 2024-04-25T09:04:13.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.623+0000 7f103a800640 1 -- 172.21.15.175:0/3602153267 wait complete. 2024-04-25T09:04:13.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f103a800640 1 Processor -- start 2024-04-25T09:04:13.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f103a800640 1 -- start start 2024-04-25T09:04:13.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f103a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f103406bd60 0x7f10340c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f103a800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1034099a50 0x7f1034147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f103a800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10340d0d50 0x7f1034147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f103a800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10340cc930 con 0x7f103406bd60 2024-04-25T09:04:13.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f103a800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10340cc7b0 con 0x7f10340d0d50 2024-04-25T09:04:13.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f103a800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103415de60 con 0x7f1034099a50 2024-04-25T09:04:13.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f1033400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f103406bd60 0x7f10340c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f1033400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f103406bd60 0x7f10340c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36312/0 (socket says 172.21.15.175:36312) 2024-04-25T09:04:13.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f1033400640 1 -- 172.21.15.175:0/3523184407 learned_addr learned my addr 172.21.15.175:0/3523184407 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:13.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f1033400640 1 -- 172.21.15.175:0/3523184407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1034099a50 msgr2=0x7f1034147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f1033400640 1 --2- 172.21.15.175:0/3523184407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1034099a50 0x7f1034147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f1033400640 1 -- 172.21.15.175:0/3523184407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10340d0d50 msgr2=0x7f1034147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f1033400640 1 --2- 172.21.15.175:0/3523184407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10340d0d50 0x7f1034147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f1033400640 1 -- 172.21.15.175:0/3523184407 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10340c6530 con 0x7f103406bd60 2024-04-25T09:04:13.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f1033400640 1 --2- 172.21.15.175:0/3523184407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f103406bd60 0x7f10340c75b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1024000c10 tx=0x7f10240192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f102b400640 1 -- 172.21.15.175:0/3523184407 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10240ba070 con 0x7f103406bd60 2024-04-25T09:04:13.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f102b400640 1 -- 172.21.15.175:0/3523184407 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10240b43f0 con 0x7f103406bd60 2024-04-25T09:04:13.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f103a800640 1 -- 172.21.15.175:0/3523184407 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10340c6810 con 0x7f103406bd60 2024-04-25T09:04:13.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f102b400640 1 -- 172.21.15.175:0/3523184407 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10240b0040 con 0x7f103406bd60 2024-04-25T09:04:13.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f103a800640 1 -- 172.21.15.175:0/3523184407 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10340c6dd0 con 0x7f103406bd60 2024-04-25T09:04:13.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.627+0000 7f103a800640 1 -- 172.21.15.175:0/3523184407 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1034074a60 con 0x7f103406bd60 2024-04-25T09:04:13.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.631+0000 7f102b400640 1 -- 172.21.15.175:0/3523184407 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f10240bd070 con 0x7f103406bd60 2024-04-25T09:04:13.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.631+0000 7f102b400640 1 --2- 172.21.15.175:0/3523184407 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1014066f60 0x7f1014069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.631+0000 7f102b400640 1 -- 172.21.15.175:0/3523184407 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f102411e0c0 con 0x7f103406bd60 2024-04-25T09:04:13.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.631+0000 7f1032a00640 1 --2- 172.21.15.175:0/3523184407 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1014066f60 0x7f1014069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.631+0000 7f1032a00640 1 --2- 172.21.15.175:0/3523184407 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1014066f60 0x7f1014069420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f10340c7ef0 tx=0x7f1020008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.635+0000 7f102b400640 1 -- 172.21.15.175:0/3523184407 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1024016110 con 0x7f103406bd60 2024-04-25T09:04:13.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.819+0000 7f103a800640 1 -- 172.21.15.175:0/3523184407 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f103406e450 con 0x7f103406bd60 2024-04-25T09:04:13.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.819+0000 7f102b400640 1 -- 172.21.15.175:0/3523184407 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4938 (secure 0 0 0) 0x7f10240ef040 con 0x7f103406bd60 2024-04-25T09:04:13.813 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:13.813 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/989886914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":989886914},{"type":"v1","addr":"172.21.15.175:6837","nonce":989886914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/611556493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":611556493},{"type":"v1","addr":"172.21.15.177:6833","nonce":611556493}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1366486960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1366486960},{"type":"v1","addr":"172.21.15.177:6835","nonce":1366486960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:09.810111+0000","modified":"2024-04-25T09:04:12.820376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6836/2613139594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2613139594},{"type":"v1","addr":"172.21.15.175:6836","nonce":2613139594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:04:13.813 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 8 2024-04-25T09:04:13.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.823+0000 7f103a800640 1 -- 172.21.15.175:0/3523184407 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1014066f60 msgr2=0x7f1014069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.823+0000 7f103a800640 1 --2- 172.21.15.175:0/3523184407 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1014066f60 0x7f1014069420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f10340c7ef0 tx=0x7f1020008040 comp rx=0 tx=0).stop 2024-04-25T09:04:13.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.823+0000 7f103a800640 1 -- 172.21.15.175:0/3523184407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f103406bd60 msgr2=0x7f10340c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.823+0000 7f103a800640 1 --2- 172.21.15.175:0/3523184407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f103406bd60 0x7f10340c75b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1024000c10 tx=0x7f10240192c0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.823+0000 7f103a800640 1 -- 172.21.15.175:0/3523184407 shutdown_connections 2024-04-25T09:04:13.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.823+0000 7f103a800640 1 --2- 172.21.15.175:0/3523184407 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1014066f60 0x7f1014069420 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.823+0000 7f103a800640 1 --2- 172.21.15.175:0/3523184407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10340d0d50 0x7f1034147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.823+0000 7f103a800640 1 --2- 172.21.15.175:0/3523184407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1034099a50 0x7f1034147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.823+0000 7f103a800640 1 --2- 172.21.15.175:0/3523184407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f103406bd60 0x7f10340c75b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.823+0000 7f103a800640 1 -- 172.21.15.175:0/3523184407 >> 172.21.15.175:0/3523184407 conn(0x7f10340b3300 msgr2=0x7f10340af420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.823+0000 7f103a800640 1 -- 172.21.15.175:0/3523184407 shutdown_connections 2024-04-25T09:04:13.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.823+0000 7f103a800640 1 -- 172.21.15.175:0/3523184407 wait complete. 2024-04-25T09:04:13.834 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:13.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d2c400640 1 Processor -- start 2024-04-25T09:04:13.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d2c400640 1 -- start start 2024-04-25T09:04:13.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d2c400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4d2406bd60 0x7f4d2406cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d2c400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d240cfcb0 con 0x7f4d240d0d50 2024-04-25T09:04:13.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d2c400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d240cff90 con 0x7f4d24099a50 2024-04-25T09:04:13.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d2c400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d240d0270 con 0x7f4d2406bd60 2024-04-25T09:04:13.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d2a400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4d240d0d50 0x7f4d240cbe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59202/0 (socket says 172.21.15.175:59202) 2024-04-25T09:04:13.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d2a400640 1 -- 172.21.15.175:0/2917894604 learned_addr learned my addr 172.21.15.175:0/2917894604 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:13.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d29000640 1 --2- 172.21.15.175:0/2917894604 >> v2:172.21.15.177:3300/0 conn(0x7f4d2406bd60 0x7f4d2406cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d23e00640 1 -- 172.21.15.175:0/2917894604 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923956805 0 0) 0x7f4d240cfcb0 con 0x7f4d240d0d50 2024-04-25T09:04:13.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d23e00640 1 -- 172.21.15.175:0/2917894604 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d0c003530 con 0x7f4d240d0d50 2024-04-25T09:04:13.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d23e00640 1 -- 172.21.15.175:0/2917894604 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696201218 0 0) 0x7f4d240cff90 con 0x7f4d24099a50 2024-04-25T09:04:13.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d23e00640 1 -- 172.21.15.175:0/2917894604 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d240cfcb0 con 0x7f4d24099a50 2024-04-25T09:04:13.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d23e00640 1 -- 172.21.15.175:0/2917894604 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1318022837 0 0) 0x7f4d0c003530 con 0x7f4d240d0d50 2024-04-25T09:04:13.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d23e00640 1 -- 172.21.15.175:0/2917894604 >> v2:172.21.15.177:3300/0 conn(0x7f4d2406bd60 msgr2=0x7f4d2406cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d23e00640 1 --2- 172.21.15.175:0/2917894604 >> v2:172.21.15.177:3300/0 conn(0x7f4d2406bd60 0x7f4d2406cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d23e00640 1 -- 172.21.15.175:0/2917894604 >> v1:172.21.15.177:6789/0 conn(0x7f4d24099a50 legacy=0x7f4d24099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d23e00640 1 -- 172.21.15.175:0/2917894604 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d240d0550 con 0x7f4d240d0d50 2024-04-25T09:04:13.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d23e00640 1 -- 172.21.15.175:0/2917894604 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f4d1c001a00 con 0x7f4d240d0d50 2024-04-25T09:04:13.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d23e00640 1 -- 172.21.15.175:0/2917894604 >> v1:172.21.15.175:6789/0 conn(0x7f4d240d0d50 legacy=0x7f4d240cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d23e00640 1 --2- 172.21.15.175:0/2917894604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d0c003b50 0x7f4d0c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.979+0000 7f4d23e00640 1 --2- 172.21.15.175:0/2917894604 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d0c004810 0x7f4d0c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.983+0000 7f4d23e00640 1 --2- 172.21.15.175:0/2917894604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d0c0051d0 0x7f4d0c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.983+0000 7f4d23e00640 1 -- 172.21.15.175:0/2917894604 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d240d0270 con 0x7f4d0c003b50 2024-04-25T09:04:13.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.983+0000 7f4d23e00640 1 -- 172.21.15.175:0/2917894604 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c00c050 con 0x7f4d0c0051d0 2024-04-25T09:04:13.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.983+0000 7f4d23e00640 1 -- 172.21.15.175:0/2917894604 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c00c250 con 0x7f4d0c004810 2024-04-25T09:04:13.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.983+0000 7f4d29a00640 1 --2- 172.21.15.175:0/2917894604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d0c003b50 0x7f4d0c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.983+0000 7f4d29000640 1 --2- 172.21.15.175:0/2917894604 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d0c004810 0x7f4d0c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.983+0000 7f4d2a400640 1 --2- 172.21.15.175:0/2917894604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d0c0051d0 0x7f4d0c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.983+0000 7f4d29a00640 1 -- 172.21.15.175:0/2917894604 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d0c004810 msgr2=0x7f4d0c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.983+0000 7f4d29a00640 1 --2- 172.21.15.175:0/2917894604 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d0c004810 0x7f4d0c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.983+0000 7f4d29a00640 1 -- 172.21.15.175:0/2917894604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d0c0051d0 msgr2=0x7f4d0c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.983+0000 7f4d29a00640 1 --2- 172.21.15.175:0/2917894604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d0c0051d0 0x7f4d0c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.983+0000 7f4d29a00640 1 -- 172.21.15.175:0/2917894604 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c003530 con 0x7f4d0c003b50 2024-04-25T09:04:13.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.983+0000 7f4d2a400640 1 --2- 172.21.15.175:0/2917894604 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d0c0051d0 0x7f4d0c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:13.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.983+0000 7f4d2a400640 1 -- 172.21.15.175:0/2917894604 reap_dead start 2024-04-25T09:04:13.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.983+0000 7f4d29a00640 1 --2- 172.21.15.175:0/2917894604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d0c003b50 0x7f4d0c003f50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4d180018d0 tx=0x7f4d1801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c733228ec13294 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.983+0000 7f4d23e00640 1 -- 172.21.15.175:0/2917894604 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18001520 con 0x7f4d0c003b50 2024-04-25T09:04:13.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.983+0000 7f4d23e00640 1 -- 172.21.15.175:0/2917894604 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d180052f0 con 0x7f4d0c003b50 2024-04-25T09:04:13.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.983+0000 7f4d23e00640 1 -- 172.21.15.175:0/2917894604 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18003840 con 0x7f4d0c003b50 2024-04-25T09:04:13.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2c400640 1 -- 172.21.15.175:0/2917894604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d0c003b50 msgr2=0x7f4d0c003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2c400640 1 --2- 172.21.15.175:0/2917894604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d0c003b50 0x7f4d0c003f50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4d180018d0 tx=0x7f4d1801c560 comp rx=0 tx=0).stop 2024-04-25T09:04:13.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2c400640 1 -- 172.21.15.175:0/2917894604 shutdown_connections 2024-04-25T09:04:13.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2c400640 1 --2- 172.21.15.175:0/2917894604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d0c003b50 0x7f4d0c003f50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2c400640 1 -- 172.21.15.175:0/2917894604 >> 172.21.15.175:0/2917894604 conn(0x7f4d240b3300 msgr2=0x7f4d240b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2c400640 1 -- 172.21.15.175:0/2917894604 shutdown_connections 2024-04-25T09:04:13.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2c400640 1 -- 172.21.15.175:0/2917894604 wait complete. 2024-04-25T09:04:13.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2c400640 1 Processor -- start 2024-04-25T09:04:13.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2c400640 1 -- start start 2024-04-25T09:04:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2c400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d0c003b50 0x7f4d241eb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2c400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d2415c870 0x7f4d240b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2c400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d2415ccf0 0x7f4d240b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2c400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2415dfe0 con 0x7f4d2415ccf0 2024-04-25T09:04:13.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2c400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2415de60 con 0x7f4d0c003b50 2024-04-25T09:04:13.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2c400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d240cc670 con 0x7f4d2415c870 2024-04-25T09:04:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2a400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d2415ccf0 0x7f4d240b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2a400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d2415ccf0 0x7f4d240b16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36326/0 (socket says 172.21.15.175:36326) 2024-04-25T09:04:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2a400640 1 -- 172.21.15.175:0/2366283342 learned_addr learned my addr 172.21.15.175:0/2366283342 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d29000640 1 --2- 172.21.15.175:0/2366283342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d2415c870 0x7f4d240b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d29a00640 1 --2- 172.21.15.175:0/2366283342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d0c003b50 0x7f4d241eb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2a400640 1 -- 172.21.15.175:0/2366283342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d2415c870 msgr2=0x7f4d240b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2a400640 1 --2- 172.21.15.175:0/2366283342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d2415c870 0x7f4d240b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2a400640 1 -- 172.21.15.175:0/2366283342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d0c003b50 msgr2=0x7f4d241eb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2a400640 1 --2- 172.21.15.175:0/2366283342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d0c003b50 0x7f4d241eb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.987+0000 7f4d2a400640 1 -- 172.21.15.175:0/2366283342 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d240c9b90 con 0x7f4d2415ccf0 2024-04-25T09:04:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.991+0000 7f4d2a400640 1 --2- 172.21.15.175:0/2366283342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d2415ccf0 0x7f4d240b16b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c000f90 tx=0x7f4d1c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.991+0000 7f4d21600640 1 -- 172.21.15.175:0/2366283342 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c007ae0 con 0x7f4d2415ccf0 2024-04-25T09:04:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.991+0000 7f4d21600640 1 -- 172.21.15.175:0/2366283342 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c018070 con 0x7f4d2415ccf0 2024-04-25T09:04:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.991+0000 7f4d2c400640 1 -- 172.21.15.175:0/2366283342 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d240c9e70 con 0x7f4d2415ccf0 2024-04-25T09:04:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.991+0000 7f4d21600640 1 -- 172.21.15.175:0/2366283342 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c013420 con 0x7f4d2415ccf0 2024-04-25T09:04:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.991+0000 7f4d2c400640 1 -- 172.21.15.175:0/2366283342 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d240ca430 con 0x7f4d2415ccf0 2024-04-25T09:04:13.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.991+0000 7f4d2c400640 1 -- 172.21.15.175:0/2366283342 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d24074a60 con 0x7f4d2415ccf0 2024-04-25T09:04:13.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.991+0000 7f4d21600640 1 -- 172.21.15.175:0/2366283342 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4d1c0135c0 con 0x7f4d2415ccf0 2024-04-25T09:04:13.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.991+0000 7f4d21600640 1 --2- 172.21.15.175:0/2366283342 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4d04066f90 0x7f4d04069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.991+0000 7f4d21600640 1 -- 172.21.15.175:0/2366283342 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d1c0852e0 con 0x7f4d2415ccf0 2024-04-25T09:04:13.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.991+0000 7f4d29a00640 1 --2- 172.21.15.175:0/2366283342 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4d04066f90 0x7f4d04069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.995+0000 7f4d29a00640 1 --2- 172.21.15.175:0/2366283342 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4d04066f90 0x7f4d04069450 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4d180ac000 tx=0x7f4d18009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:13.995+0000 7f4d21600640 1 -- 172.21.15.175:0/2366283342 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4d1c0562f0 con 0x7f4d2415ccf0 2024-04-25T09:04:14.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.151+0000 7f4d2c400640 1 -- 172.21.15.175:0/2366283342 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d240b2300 con 0x7f4d2415ccf0 2024-04-25T09:04:14.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.151+0000 7f4d21600640 1 -- 172.21.15.175:0/2366283342 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f4d1c055bf0 con 0x7f4d2415ccf0 2024-04-25T09:04:14.143 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:14.143 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":20,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:11.440551+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:14.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.155+0000 7f4d2c400640 1 -- 172.21.15.175:0/2366283342 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4d04066f90 msgr2=0x7f4d04069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.155+0000 7f4d2c400640 1 --2- 172.21.15.175:0/2366283342 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4d04066f90 0x7f4d04069450 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4d180ac000 tx=0x7f4d18009040 comp rx=0 tx=0).stop 2024-04-25T09:04:14.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.155+0000 7f4d2c400640 1 -- 172.21.15.175:0/2366283342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d2415ccf0 msgr2=0x7f4d240b16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.155+0000 7f4d2c400640 1 --2- 172.21.15.175:0/2366283342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d2415ccf0 0x7f4d240b16b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c000f90 tx=0x7f4d1c00e530 comp rx=0 tx=0).stop 2024-04-25T09:04:14.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.155+0000 7f4d2c400640 1 -- 172.21.15.175:0/2366283342 shutdown_connections 2024-04-25T09:04:14.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.155+0000 7f4d2c400640 1 --2- 172.21.15.175:0/2366283342 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4d04066f90 0x7f4d04069450 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.155+0000 7f4d2c400640 1 --2- 172.21.15.175:0/2366283342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d2415ccf0 0x7f4d240b16b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.155+0000 7f4d2c400640 1 --2- 172.21.15.175:0/2366283342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d2415c870 0x7f4d240b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.155+0000 7f4d2c400640 1 --2- 172.21.15.175:0/2366283342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d0c003b50 0x7f4d241eb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.155+0000 7f4d2c400640 1 -- 172.21.15.175:0/2366283342 >> 172.21.15.175:0/2366283342 conn(0x7f4d240b3300 msgr2=0x7f4d2406c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.155+0000 7f4d2c400640 1 -- 172.21.15.175:0/2366283342 shutdown_connections 2024-04-25T09:04:14.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.155+0000 7f4d2c400640 1 -- 172.21.15.175:0/2366283342 wait complete. 2024-04-25T09:04:14.165 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:04:14.165 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:04:14.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.311+0000 7f94a7200640 1 Processor -- start 2024-04-25T09:04:14.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.311+0000 7f94a7200640 1 -- start start 2024-04-25T09:04:14.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.311+0000 7f94a7200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f94a0099a50 0x7f94a006cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.311+0000 7f94a7200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94a00d0d50 0x7f94a00cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.311+0000 7f94a7200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a00cfcb0 con 0x7f94a006bd60 2024-04-25T09:04:14.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.311+0000 7f94a7200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a00cff90 con 0x7f94a0099a50 2024-04-25T09:04:14.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.311+0000 7f94a7200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a00d0270 con 0x7f94a00d0d50 2024-04-25T09:04:14.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.311+0000 7f949fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f94a0099a50 0x7f94a006cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.311+0000 7f949fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f94a0099a50 0x7f94a006cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36332/0 (socket says 172.21.15.175:36332) 2024-04-25T09:04:14.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.311+0000 7f949fe00640 1 -- 172.21.15.175:0/1900138672 learned_addr learned my addr 172.21.15.175:0/1900138672 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:14.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.311+0000 7f949fe00640 1 -- 172.21.15.175:0/1900138672 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94a00d0d50 msgr2=0x7f94a00cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.311+0000 7f949fe00640 1 --2- 172.21.15.175:0/1900138672 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94a00d0d50 0x7f94a00cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.311+0000 7f949fe00640 1 -- 172.21.15.175:0/1900138672 >> v1:172.21.15.177:6789/0 conn(0x7f94a006bd60 legacy=0x7f94a0099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.311+0000 7f949fe00640 1 -- 172.21.15.175:0/1900138672 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a00d0550 con 0x7f94a0099a50 2024-04-25T09:04:14.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.315+0000 7f949fe00640 1 --2- 172.21.15.175:0/1900138672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94a0099a50 0x7f94a006cc50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9490009870 tx=0x7f949001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5d4830eee84fe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.315+0000 7f949f400640 1 -- 172.21.15.175:0/1900138672 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94900b0070 con 0x7f94a0099a50 2024-04-25T09:04:14.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.315+0000 7f949f400640 1 -- 172.21.15.175:0/1900138672 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94900ab600 con 0x7f94a0099a50 2024-04-25T09:04:14.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.315+0000 7f949f400640 1 -- 172.21.15.175:0/1900138672 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94900ab9d0 con 0x7f94a0099a50 2024-04-25T09:04:14.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.315+0000 7f94a7200640 1 -- 172.21.15.175:0/1900138672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94a0099a50 msgr2=0x7f94a006cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.315+0000 7f94a7200640 1 --2- 172.21.15.175:0/1900138672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94a0099a50 0x7f94a006cc50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9490009870 tx=0x7f949001c520 comp rx=0 tx=0).stop 2024-04-25T09:04:14.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.315+0000 7f94a7200640 1 -- 172.21.15.175:0/1900138672 shutdown_connections 2024-04-25T09:04:14.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.315+0000 7f94a7200640 1 --2- 172.21.15.175:0/1900138672 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94a00d0d50 0x7f94a00cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.315+0000 7f94a7200640 1 --2- 172.21.15.175:0/1900138672 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94a0099a50 0x7f94a006cc50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.315+0000 7f94a7200640 1 -- 172.21.15.175:0/1900138672 >> 172.21.15.175:0/1900138672 conn(0x7f94a00b3300 msgr2=0x7f94a00b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.315+0000 7f94a7200640 1 -- 172.21.15.175:0/1900138672 shutdown_connections 2024-04-25T09:04:14.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.315+0000 7f94a7200640 1 -- 172.21.15.175:0/1900138672 wait complete. 2024-04-25T09:04:14.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f94a7200640 1 Processor -- start 2024-04-25T09:04:14.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f94a7200640 1 -- start start 2024-04-25T09:04:14.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f94a7200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94a006bd60 0x7f94a0156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f94a7200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94a0099a50 0x7f94a01456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f94a7200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94a00d0d50 0x7f94a00b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f94a7200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a015dfe0 con 0x7f94a006bd60 2024-04-25T09:04:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f94a7200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a015de60 con 0x7f94a0099a50 2024-04-25T09:04:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f94a7200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a016b260 con 0x7f94a00d0d50 2024-04-25T09:04:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f949fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94a006bd60 0x7f94a0156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f949fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94a006bd60 0x7f94a0156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36338/0 (socket says 172.21.15.175:36338) 2024-04-25T09:04:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f949fe00640 1 -- 172.21.15.175:0/2014706092 learned_addr learned my addr 172.21.15.175:0/2014706092 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f949fe00640 1 -- 172.21.15.175:0/2014706092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94a00d0d50 msgr2=0x7f94a00b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f949fe00640 1 --2- 172.21.15.175:0/2014706092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94a00d0d50 0x7f94a00b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f949fe00640 1 -- 172.21.15.175:0/2014706092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94a0099a50 msgr2=0x7f94a01456c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f949fe00640 1 --2- 172.21.15.175:0/2014706092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94a0099a50 0x7f94a01456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f949fe00640 1 -- 172.21.15.175:0/2014706092 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a0145c00 con 0x7f94a006bd60 2024-04-25T09:04:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f949fe00640 1 --2- 172.21.15.175:0/2014706092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94a006bd60 0x7f94a0156640 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f94900ae040 tx=0x7f949001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f949cc00640 1 -- 172.21.15.175:0/2014706092 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94900b0040 con 0x7f94a006bd60 2024-04-25T09:04:14.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f949cc00640 1 -- 172.21.15.175:0/2014706092 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94900bc070 con 0x7f94a006bd60 2024-04-25T09:04:14.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f949cc00640 1 -- 172.21.15.175:0/2014706092 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94900b68a0 con 0x7f94a006bd60 2024-04-25T09:04:14.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f94a7200640 1 -- 172.21.15.175:0/2014706092 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a01fb390 con 0x7f94a006bd60 2024-04-25T09:04:14.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f94a7200640 1 -- 172.21.15.175:0/2014706092 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a01fb950 con 0x7f94a006bd60 2024-04-25T09:04:14.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.319+0000 7f94a7200640 1 -- 172.21.15.175:0/2014706092 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a00cdbe0 con 0x7f94a006bd60 2024-04-25T09:04:14.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.323+0000 7f949cc00640 1 -- 172.21.15.175:0/2014706092 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f94900b6a40 con 0x7f94a006bd60 2024-04-25T09:04:14.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.323+0000 7f949cc00640 1 --2- 172.21.15.175:0/2014706092 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f947c066f60 0x7f947c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.323+0000 7f949cc00640 1 -- 172.21.15.175:0/2014706092 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f949011f470 con 0x7f94a006bd60 2024-04-25T09:04:14.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.323+0000 7f9497e00640 1 --2- 172.21.15.175:0/2014706092 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f947c066f60 0x7f947c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.323+0000 7f9497e00640 1 --2- 172.21.15.175:0/2014706092 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f947c066f60 0x7f947c069420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9488007fd0 tx=0x7f94880079a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.327+0000 7f949cc00640 1 -- 172.21.15.175:0/2014706092 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f94a0145c00 con 0x7f94a006bd60 2024-04-25T09:04:14.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.479+0000 7f94a7200640 1 -- 172.21.15.175:0/2014706092 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94a009aee0 con 0x7f947c066f60 2024-04-25T09:04:14.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.487+0000 7f949cc00640 1 -- 172.21.15.175:0/2014706092 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251923 (secure 0 0 0) 0x7f94a009aee0 con 0x7f947c066f60 2024-04-25T09:04:14.483 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:14.485 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:04:14.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.491+0000 7f94a7200640 1 -- 172.21.15.175:0/2014706092 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f947c066f60 msgr2=0x7f947c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.491+0000 7f94a7200640 1 --2- 172.21.15.175:0/2014706092 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f947c066f60 0x7f947c069420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9488007fd0 tx=0x7f94880079a0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.491+0000 7f94a7200640 1 -- 172.21.15.175:0/2014706092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94a006bd60 msgr2=0x7f94a0156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.491+0000 7f94a7200640 1 --2- 172.21.15.175:0/2014706092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94a006bd60 0x7f94a0156640 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f94900ae040 tx=0x7f949001ad60 comp rx=0 tx=0).stop 2024-04-25T09:04:14.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.491+0000 7f94a7200640 1 -- 172.21.15.175:0/2014706092 shutdown_connections 2024-04-25T09:04:14.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.491+0000 7f94a7200640 1 --2- 172.21.15.175:0/2014706092 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f947c066f60 0x7f947c069420 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.491+0000 7f94a7200640 1 --2- 172.21.15.175:0/2014706092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94a00d0d50 0x7f94a00b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.491+0000 7f94a7200640 1 --2- 172.21.15.175:0/2014706092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94a0099a50 0x7f94a01456c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.491+0000 7f94a7200640 1 --2- 172.21.15.175:0/2014706092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94a006bd60 0x7f94a0156640 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.491+0000 7f94a7200640 1 -- 172.21.15.175:0/2014706092 >> 172.21.15.175:0/2014706092 conn(0x7f94a00b3300 msgr2=0x7f94a00cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.491+0000 7f94a7200640 1 -- 172.21.15.175:0/2014706092 shutdown_connections 2024-04-25T09:04:14.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.491+0000 7f94a7200640 1 -- 172.21.15.175:0/2014706092 wait complete. 2024-04-25T09:04:14.502 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-25T09:04:13.790698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218952,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755768,"statfs":{"total":773094113280,"available":772869906432,"internally_reserved":0,"allocated":2842624,"data_stored":1727828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.379229"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491395+0000","last_change":"2024-04-25T09:04:10.462062+0000","last_active":"2024-04-25T09:04:12.491395+0000","last_peered":"2024-04-25T09:04:12.491395+0000","last_clean":"2024-04-25T09:04:12.491395+0000","last_became_active":"2024-04-25T09:04:10.461771+0000","last_became_peered":"2024-04-25T09:04:10.461771+0000","last_unstale":"2024-04-25T09:04:12.491395+0000","last_undegraded":"2024-04-25T09:04:12.491395+0000","last_fullsized":"2024-04-25T09:04:12.491395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:38.704801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453592+0000","last_change":"2024-04-25T09:04:10.454772+0000","last_active":"2024-04-25T09:04:11.453592+0000","last_peered":"2024-04-25T09:04:11.453592+0000","last_clean":"2024-04-25T09:04:11.453592+0000","last_became_active":"2024-04-25T09:04:10.454462+0000","last_became_peered":"2024-04-25T09:04:10.454462+0000","last_unstale":"2024-04-25T09:04:11.453592+0000","last_undegraded":"2024-04-25T09:04:11.453592+0000","last_fullsized":"2024-04-25T09:04:11.453592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:59.964799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.460624+0000","last_change":"2024-04-25T09:04:10.455469+0000","last_active":"2024-04-25T09:04:10.460624+0000","last_peered":"2024-04-25T09:04:10.460624+0000","last_clean":"2024-04-25T09:04:10.460624+0000","last_became_active":"2024-04-25T09:04:10.455164+0000","last_became_peered":"2024-04-25T09:04:10.455164+0000","last_unstale":"2024-04-25T09:04:10.460624+0000","last_undegraded":"2024-04-25T09:04:10.460624+0000","last_fullsized":"2024-04-25T09:04:10.460624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:46.591632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.470834+0000","last_change":"2024-04-25T09:04:10.468612+0000","last_active":"2024-04-25T09:04:10.470834+0000","last_peered":"2024-04-25T09:04:10.470834+0000","last_clean":"2024-04-25T09:04:10.470834+0000","last_became_active":"2024-04-25T09:04:10.468241+0000","last_became_peered":"2024-04-25T09:04:10.468241+0000","last_unstale":"2024-04-25T09:04:10.470834+0000","last_undegraded":"2024-04-25T09:04:10.470834+0000","last_fullsized":"2024-04-25T09:04:10.470834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:03.161885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491349+0000","last_change":"2024-04-25T09:04:10.460849+0000","last_active":"2024-04-25T09:04:12.491349+0000","last_peered":"2024-04-25T09:04:12.491349+0000","last_clean":"2024-04-25T09:04:12.491349+0000","last_became_active":"2024-04-25T09:04:10.460521+0000","last_became_peered":"2024-04-25T09:04:10.460521+0000","last_unstale":"2024-04-25T09:04:12.491349+0000","last_undegraded":"2024-04-25T09:04:12.491349+0000","last_fullsized":"2024-04-25T09:04:12.491349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:41.363774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.463677+0000","last_change":"2024-04-25T09:04:10.452925+0000","last_active":"2024-04-25T09:04:10.463677+0000","last_peered":"2024-04-25T09:04:10.463677+0000","last_clean":"2024-04-25T09:04:10.463677+0000","last_became_active":"2024-04-25T09:04:10.450322+0000","last_became_peered":"2024-04-25T09:04:10.450322+0000","last_unstale":"2024-04-25T09:04:10.463677+0000","last_undegraded":"2024-04-25T09:04:10.463677+0000","last_fullsized":"2024-04-25T09:04:10.463677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:46.591632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.490891+0000","last_change":"2024-04-25T09:04:10.464505+0000","last_active":"2024-04-25T09:04:12.490891+0000","last_peered":"2024-04-25T09:04:12.490891+0000","last_clean":"2024-04-25T09:04:12.490891+0000","last_became_active":"2024-04-25T09:04:10.460449+0000","last_became_peered":"2024-04-25T09:04:10.460449+0000","last_unstale":"2024-04-25T09:04:12.490891+0000","last_undegraded":"2024-04-25T09:04:12.490891+0000","last_fullsized":"2024-04-25T09:04:12.490891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:53.844663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766242+0000","last_change":"2024-04-25T09:04:10.455495+0000","last_active":"2024-04-25T09:04:11.766242+0000","last_peered":"2024-04-25T09:04:11.766242+0000","last_clean":"2024-04-25T09:04:11.766242+0000","last_became_active":"2024-04-25T09:04:10.454824+0000","last_became_peered":"2024-04-25T09:04:10.454824+0000","last_unstale":"2024-04-25T09:04:11.766242+0000","last_undegraded":"2024-04-25T09:04:11.766242+0000","last_fullsized":"2024-04-25T09:04:11.766242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:06.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491385+0000","last_change":"2024-04-25T09:04:10.467947+0000","last_active":"2024-04-25T09:04:12.491385+0000","last_peered":"2024-04-25T09:04:12.491385+0000","last_clean":"2024-04-25T09:04:12.491385+0000","last_became_active":"2024-04-25T09:04:10.467620+0000","last_became_peered":"2024-04-25T09:04:10.467620+0000","last_unstale":"2024-04-25T09:04:12.491385+0000","last_undegraded":"2024-04-25T09:04:12.491385+0000","last_fullsized":"2024-04-25T09:04:12.491385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:38.966776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454350+0000","last_change":"2024-04-25T09:04:10.456157+0000","last_active":"2024-04-25T09:04:11.454350+0000","last_peered":"2024-04-25T09:04:11.454350+0000","last_clean":"2024-04-25T09:04:11.454350+0000","last_became_active":"2024-04-25T09:04:10.455814+0000","last_became_peered":"2024-04-25T09:04:10.455814+0000","last_unstale":"2024-04-25T09:04:11.454350+0000","last_undegraded":"2024-04-25T09:04:11.454350+0000","last_fullsized":"2024-04-25T09:04:11.454350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:10.572493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454102+0000","last_change":"2024-04-25T09:04:10.453100+0000","last_active":"2024-04-25T09:04:11.454102+0000","last_peered":"2024-04-25T09:04:11.454102+0000","last_clean":"2024-04-25T09:04:11.454102+0000","last_became_active":"2024-04-25T09:04:10.452835+0000","last_became_peered":"2024-04-25T09:04:10.452835+0000","last_unstale":"2024-04-25T09:04:11.454102+0000","last_undegraded":"2024-04-25T09:04:11.454102+0000","last_fullsized":"2024-04-25T09:04:11.454102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:03.161885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453763+0000","last_change":"2024-04-25T09:04:10.454612+0000","last_active":"2024-04-25T09:04:11.453763+0000","last_peered":"2024-04-25T09:04:11.453763+0000","last_clean":"2024-04-25T09:04:11.453763+0000","last_became_active":"2024-04-25T09:04:10.449834+0000","last_became_peered":"2024-04-25T09:04:10.449834+0000","last_unstale":"2024-04-25T09:04:11.453763+0000","last_undegraded":"2024-04-25T09:04:11.453763+0000","last_fullsized":"2024-04-25T09:04:11.453763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:33.347350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766581+0000","last_change":"2024-04-25T09:04:10.449404+0000","last_active":"2024-04-25T09:04:11.766581+0000","last_peered":"2024-04-25T09:04:11.766581+0000","last_clean":"2024-04-25T09:04:11.766581+0000","last_became_active":"2024-04-25T09:04:10.449123+0000","last_became_peered":"2024-04-25T09:04:10.449123+0000","last_unstale":"2024-04-25T09:04:11.766581+0000","last_undegraded":"2024-04-25T09:04:11.766581+0000","last_fullsized":"2024-04-25T09:04:11.766581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:59.964799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.453952+0000","last_change":"2024-04-25T09:04:10.448367+0000","last_active":"2024-04-25T09:04:10.453952+0000","last_peered":"2024-04-25T09:04:10.453952+0000","last_clean":"2024-04-25T09:04:10.453952+0000","last_became_active":"2024-04-25T09:04:10.448103+0000","last_became_peered":"2024-04-25T09:04:10.448103+0000","last_unstale":"2024-04-25T09:04:10.453952+0000","last_undegraded":"2024-04-25T09:04:10.453952+0000","last_fullsized":"2024-04-25T09:04:10.453952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:50.475565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453172+0000","last_change":"2024-04-25T09:04:10.461500+0000","last_active":"2024-04-25T09:04:11.453172+0000","last_peered":"2024-04-25T09:04:11.453172+0000","last_clean":"2024-04-25T09:04:11.453172+0000","last_became_active":"2024-04-25T09:04:10.461218+0000","last_became_peered":"2024-04-25T09:04:10.461218+0000","last_unstale":"2024-04-25T09:04:11.453172+0000","last_undegraded":"2024-04-25T09:04:11.453172+0000","last_fullsized":"2024-04-25T09:04:11.453172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:06.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.469088+0000","last_change":"2024-04-25T09:04:10.465078+0000","last_active":"2024-04-25T09:04:10.469088+0000","last_peered":"2024-04-25T09:04:10.469088+0000","last_clean":"2024-04-25T09:04:10.469088+0000","last_became_active":"2024-04-25T09:04:10.464292+0000","last_became_peered":"2024-04-25T09:04:10.464292+0000","last_unstale":"2024-04-25T09:04:10.469088+0000","last_undegraded":"2024-04-25T09:04:10.469088+0000","last_fullsized":"2024-04-25T09:04:10.469088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:35.448558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.469493+0000","last_change":"2024-04-25T09:04:10.465873+0000","last_active":"2024-04-25T09:04:10.469493+0000","last_peered":"2024-04-25T09:04:10.469493+0000","last_clean":"2024-04-25T09:04:10.469493+0000","last_became_active":"2024-04-25T09:04:10.465139+0000","last_became_peered":"2024-04-25T09:04:10.465139+0000","last_unstale":"2024-04-25T09:04:10.469493+0000","last_undegraded":"2024-04-25T09:04:10.469493+0000","last_fullsized":"2024-04-25T09:04:10.469493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:21.063821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437157+0000","last_change":"2024-04-25T09:04:10.457277+0000","last_active":"2024-04-25T09:04:12.437157+0000","last_peered":"2024-04-25T09:04:12.437157+0000","last_clean":"2024-04-25T09:04:12.437157+0000","last_became_active":"2024-04-25T09:04:10.456983+0000","last_became_peered":"2024-04-25T09:04:10.456983+0000","last_unstale":"2024-04-25T09:04:12.437157+0000","last_undegraded":"2024-04-25T09:04:12.437157+0000","last_fullsized":"2024-04-25T09:04:12.437157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:17.359486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491405+0000","last_change":"2024-04-25T09:04:10.467087+0000","last_active":"2024-04-25T09:04:12.491405+0000","last_peered":"2024-04-25T09:04:12.491405+0000","last_clean":"2024-04-25T09:04:12.491405+0000","last_became_active":"2024-04-25T09:04:10.466783+0000","last_became_peered":"2024-04-25T09:04:10.466783+0000","last_unstale":"2024-04-25T09:04:12.491405+0000","last_undegraded":"2024-04-25T09:04:12.491405+0000","last_fullsized":"2024-04-25T09:04:12.491405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:15.921248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453460+0000","last_change":"2024-04-25T09:04:10.458537+0000","last_active":"2024-04-25T09:04:11.453460+0000","last_peered":"2024-04-25T09:04:11.453460+0000","last_clean":"2024-04-25T09:04:11.453460+0000","last_became_active":"2024-04-25T09:04:10.458180+0000","last_became_peered":"2024-04-25T09:04:10.458180+0000","last_unstale":"2024-04-25T09:04:11.453460+0000","last_undegraded":"2024-04-25T09:04:11.453460+0000","last_fullsized":"2024-04-25T09:04:11.453460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:47.704816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.462728+0000","last_change":"2024-04-25T09:04:10.458711+0000","last_active":"2024-04-25T09:04:10.462728+0000","last_peered":"2024-04-25T09:04:10.462728+0000","last_clean":"2024-04-25T09:04:10.462728+0000","last_became_active":"2024-04-25T09:04:10.458450+0000","last_became_peered":"2024-04-25T09:04:10.458450+0000","last_unstale":"2024-04-25T09:04:10.462728+0000","last_undegraded":"2024-04-25T09:04:10.462728+0000","last_fullsized":"2024-04-25T09:04:10.462728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.228938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.464507+0000","last_change":"2024-04-25T09:04:10.455142+0000","last_active":"2024-04-25T09:04:10.464507+0000","last_peered":"2024-04-25T09:04:10.464507+0000","last_clean":"2024-04-25T09:04:10.464507+0000","last_became_active":"2024-04-25T09:04:10.454776+0000","last_became_peered":"2024-04-25T09:04:10.454776+0000","last_unstale":"2024-04-25T09:04:10.464507+0000","last_undegraded":"2024-04-25T09:04:10.464507+0000","last_fullsized":"2024-04-25T09:04:10.464507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.228938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766510+0000","last_change":"2024-04-25T09:04:10.462091+0000","last_active":"2024-04-25T09:04:11.766510+0000","last_peered":"2024-04-25T09:04:11.766510+0000","last_clean":"2024-04-25T09:04:11.766510+0000","last_became_active":"2024-04-25T09:04:10.460956+0000","last_became_peered":"2024-04-25T09:04:10.460956+0000","last_unstale":"2024-04-25T09:04:11.766510+0000","last_undegraded":"2024-04-25T09:04:11.766510+0000","last_fullsized":"2024-04-25T09:04:11.766510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:03.161885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.466339+0000","last_change":"2024-04-25T09:04:10.456817+0000","last_active":"2024-04-25T09:04:10.466339+0000","last_peered":"2024-04-25T09:04:10.466339+0000","last_clean":"2024-04-25T09:04:10.466339+0000","last_became_active":"2024-04-25T09:04:10.456515+0000","last_became_peered":"2024-04-25T09:04:10.456515+0000","last_unstale":"2024-04-25T09:04:10.466339+0000","last_undegraded":"2024-04-25T09:04:10.466339+0000","last_fullsized":"2024-04-25T09:04:10.466339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:17.359486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766945+0000","last_change":"2024-04-25T09:04:10.467130+0000","last_active":"2024-04-25T09:04:11.766945+0000","last_peered":"2024-04-25T09:04:11.766945+0000","last_clean":"2024-04-25T09:04:11.766945+0000","last_became_active":"2024-04-25T09:04:10.466843+0000","last_became_peered":"2024-04-25T09:04:10.466843+0000","last_unstale":"2024-04-25T09:04:11.766945+0000","last_undegraded":"2024-04-25T09:04:11.766945+0000","last_fullsized":"2024-04-25T09:04:11.766945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:38.453486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454457+0000","last_change":"2024-04-25T09:04:10.461159+0000","last_active":"2024-04-25T09:04:11.454457+0000","last_peered":"2024-04-25T09:04:11.454457+0000","last_clean":"2024-04-25T09:04:11.454457+0000","last_became_active":"2024-04-25T09:04:10.460871+0000","last_became_peered":"2024-04-25T09:04:10.460871+0000","last_unstale":"2024-04-25T09:04:11.454457+0000","last_undegraded":"2024-04-25T09:04:11.454457+0000","last_fullsized":"2024-04-25T09:04:11.454457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:59.964799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453551+0000","last_change":"2024-04-25T09:04:10.462566+0000","last_active":"2024-04-25T09:04:11.453551+0000","last_peered":"2024-04-25T09:04:11.453551+0000","last_clean":"2024-04-25T09:04:11.453551+0000","last_became_active":"2024-04-25T09:04:10.461856+0000","last_became_peered":"2024-04-25T09:04:10.461856+0000","last_unstale":"2024-04-25T09:04:11.453551+0000","last_undegraded":"2024-04-25T09:04:11.453551+0000","last_fullsized":"2024-04-25T09:04:11.453551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:10.572493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766880+0000","last_change":"2024-04-25T09:04:10.461850+0000","last_active":"2024-04-25T09:04:11.766880+0000","last_peered":"2024-04-25T09:04:11.766880+0000","last_clean":"2024-04-25T09:04:11.766880+0000","last_became_active":"2024-04-25T09:04:10.460707+0000","last_became_peered":"2024-04-25T09:04:10.460707+0000","last_unstale":"2024-04-25T09:04:11.766880+0000","last_undegraded":"2024-04-25T09:04:11.766880+0000","last_fullsized":"2024-04-25T09:04:11.766880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:25.970653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.467599+0000","last_change":"2024-04-25T09:04:10.464541+0000","last_active":"2024-04-25T09:04:10.467599+0000","last_peered":"2024-04-25T09:04:10.467599+0000","last_clean":"2024-04-25T09:04:10.467599+0000","last_became_active":"2024-04-25T09:04:10.464252+0000","last_became_peered":"2024-04-25T09:04:10.464252+0000","last_unstale":"2024-04-25T09:04:10.467599+0000","last_undegraded":"2024-04-25T09:04:10.467599+0000","last_fullsized":"2024-04-25T09:04:10.467599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:35.448558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.469063+0000","last_change":"2024-04-25T09:04:10.465260+0000","last_active":"2024-04-25T09:04:10.469063+0000","last_peered":"2024-04-25T09:04:10.469063+0000","last_clean":"2024-04-25T09:04:10.469063+0000","last_became_active":"2024-04-25T09:04:10.464698+0000","last_became_peered":"2024-04-25T09:04:10.464698+0000","last_unstale":"2024-04-25T09:04:10.469063+0000","last_undegraded":"2024-04-25T09:04:10.469063+0000","last_fullsized":"2024-04-25T09:04:10.469063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:24.135986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437050+0000","last_change":"2024-04-25T09:04:10.455699+0000","last_active":"2024-04-25T09:04:12.437050+0000","last_peered":"2024-04-25T09:04:12.437050+0000","last_clean":"2024-04-25T09:04:12.437050+0000","last_became_active":"2024-04-25T09:04:10.455417+0000","last_became_peered":"2024-04-25T09:04:10.455417+0000","last_unstale":"2024-04-25T09:04:12.437050+0000","last_undegraded":"2024-04-25T09:04:12.437050+0000","last_fullsized":"2024-04-25T09:04:12.437050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.228938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453241+0000","last_change":"2024-04-25T09:04:10.451620+0000","last_active":"2024-04-25T09:04:11.453241+0000","last_peered":"2024-04-25T09:04:11.453241+0000","last_clean":"2024-04-25T09:04:11.453241+0000","last_became_active":"2024-04-25T09:04:10.451273+0000","last_became_peered":"2024-04-25T09:04:10.451273+0000","last_unstale":"2024-04-25T09:04:11.453241+0000","last_undegraded":"2024-04-25T09:04:11.453241+0000","last_fullsized":"2024-04-25T09:04:11.453241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:12.826732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453920+0000","last_change":"2024-04-25T09:04:10.449559+0000","last_active":"2024-04-25T09:04:11.453920+0000","last_peered":"2024-04-25T09:04:11.453920+0000","last_clean":"2024-04-25T09:04:11.453920+0000","last_became_active":"2024-04-25T09:04:10.448300+0000","last_became_peered":"2024-04-25T09:04:10.448300+0000","last_unstale":"2024-04-25T09:04:11.453920+0000","last_undegraded":"2024-04-25T09:04:11.453920+0000","last_fullsized":"2024-04-25T09:04:11.453920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:46.591632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766688+0000","last_change":"2024-04-25T09:04:09.443692+0000","last_active":"2024-04-25T09:04:11.766688+0000","last_peered":"2024-04-25T09:04:11.766688+0000","last_clean":"2024-04-25T09:04:11.766688+0000","last_became_active":"2024-04-25T09:04:09.443223+0000","last_became_peered":"2024-04-25T09:04:09.443223+0000","last_unstale":"2024-04-25T09:04:11.766688+0000","last_undegraded":"2024-04-25T09:04:11.766688+0000","last_fullsized":"2024-04-25T09:04:11.766688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:52.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.453826+0000","last_change":"2024-04-25T09:04:10.445977+0000","last_active":"2024-04-25T09:04:10.453826+0000","last_peered":"2024-04-25T09:04:10.453826+0000","last_clean":"2024-04-25T09:04:10.453826+0000","last_became_active":"2024-04-25T09:04:10.445685+0000","last_became_peered":"2024-04-25T09:04:10.445685+0000","last_unstale":"2024-04-25T09:04:10.453826+0000","last_undegraded":"2024-04-25T09:04:10.453826+0000","last_fullsized":"2024-04-25T09:04:10.453826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:53.473022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453359+0000","last_change":"2024-04-25T09:04:09.428583+0000","last_active":"2024-04-25T09:04:11.453359+0000","last_peered":"2024-04-25T09:04:11.453359+0000","last_clean":"2024-04-25T09:04:11.453359+0000","last_became_active":"2024-04-25T09:04:09.428043+0000","last_became_peered":"2024-04-25T09:04:09.428043+0000","last_unstale":"2024-04-25T09:04:11.453359+0000","last_undegraded":"2024-04-25T09:04:11.453359+0000","last_fullsized":"2024-04-25T09:04:11.453359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766378+0000","last_change":"2024-04-25T09:04:09.440384+0000","last_active":"2024-04-25T09:04:11.766378+0000","last_peered":"2024-04-25T09:04:11.766378+0000","last_clean":"2024-04-25T09:04:11.766378+0000","last_became_active":"2024-04-25T09:04:09.439952+0000","last_became_peered":"2024-04-25T09:04:09.439952+0000","last_unstale":"2024-04-25T09:04:11.766378+0000","last_undegraded":"2024-04-25T09:04:11.766378+0000","last_fullsized":"2024-04-25T09:04:11.766378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:59.824337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766347+0000","last_change":"2024-04-25T09:04:10.455692+0000","last_active":"2024-04-25T09:04:11.766347+0000","last_peered":"2024-04-25T09:04:11.766347+0000","last_clean":"2024-04-25T09:04:11.766347+0000","last_became_active":"2024-04-25T09:04:10.455212+0000","last_became_peered":"2024-04-25T09:04:10.455212+0000","last_unstale":"2024-04-25T09:04:11.766347+0000","last_undegraded":"2024-04-25T09:04:11.766347+0000","last_fullsized":"2024-04-25T09:04:11.766347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:47.704816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.443581+0000","last_change":"2024-04-25T09:04:09.438700+0000","last_active":"2024-04-25T09:04:10.443581+0000","last_peered":"2024-04-25T09:04:10.443581+0000","last_clean":"2024-04-25T09:04:10.443581+0000","last_became_active":"2024-04-25T09:04:09.438424+0000","last_became_peered":"2024-04-25T09:04:09.438424+0000","last_unstale":"2024-04-25T09:04:10.443581+0000","last_undegraded":"2024-04-25T09:04:10.443581+0000","last_fullsized":"2024-04-25T09:04:10.443581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:52.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453190+0000","last_change":"2024-04-25T09:04:10.455298+0000","last_active":"2024-04-25T09:04:11.453190+0000","last_peered":"2024-04-25T09:04:11.453190+0000","last_clean":"2024-04-25T09:04:11.453190+0000","last_became_active":"2024-04-25T09:04:10.455044+0000","last_became_peered":"2024-04-25T09:04:10.455044+0000","last_unstale":"2024-04-25T09:04:11.453190+0000","last_undegraded":"2024-04-25T09:04:11.453190+0000","last_fullsized":"2024-04-25T09:04:11.453190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:47.704816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454284+0000","last_change":"2024-04-25T09:04:09.441197+0000","last_active":"2024-04-25T09:04:11.454284+0000","last_peered":"2024-04-25T09:04:11.454284+0000","last_clean":"2024-04-25T09:04:11.454284+0000","last_became_active":"2024-04-25T09:04:09.440752+0000","last_became_peered":"2024-04-25T09:04:09.440752+0000","last_unstale":"2024-04-25T09:04:11.454284+0000","last_undegraded":"2024-04-25T09:04:11.454284+0000","last_fullsized":"2024-04-25T09:04:11.454284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:52.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.470124+0000","last_change":"2024-04-25T09:04:10.466060+0000","last_active":"2024-04-25T09:04:10.470124+0000","last_peered":"2024-04-25T09:04:10.470124+0000","last_clean":"2024-04-25T09:04:10.470124+0000","last_became_active":"2024-04-25T09:04:10.465550+0000","last_became_peered":"2024-04-25T09:04:10.465550+0000","last_unstale":"2024-04-25T09:04:10.470124+0000","last_undegraded":"2024-04-25T09:04:10.470124+0000","last_fullsized":"2024-04-25T09:04:10.470124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:44.285991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.444796+0000","last_change":"2024-04-25T09:04:09.444181+0000","last_active":"2024-04-25T09:04:10.444796+0000","last_peered":"2024-04-25T09:04:10.444796+0000","last_clean":"2024-04-25T09:04:10.444796+0000","last_became_active":"2024-04-25T09:04:09.443601+0000","last_became_peered":"2024-04-25T09:04:09.443601+0000","last_unstale":"2024-04-25T09:04:10.444796+0000","last_undegraded":"2024-04-25T09:04:10.444796+0000","last_fullsized":"2024-04-25T09:04:10.444796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:23.622773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.459492+0000","last_change":"2024-04-25T09:04:10.451240+0000","last_active":"2024-04-25T09:04:10.459492+0000","last_peered":"2024-04-25T09:04:10.459492+0000","last_clean":"2024-04-25T09:04:10.459492+0000","last_became_active":"2024-04-25T09:04:10.451065+0000","last_became_peered":"2024-04-25T09:04:10.451065+0000","last_unstale":"2024-04-25T09:04:10.459492+0000","last_undegraded":"2024-04-25T09:04:10.459492+0000","last_fullsized":"2024-04-25T09:04:10.459492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:12.563435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453491+0000","last_change":"2024-04-25T09:04:09.441559+0000","last_active":"2024-04-25T09:04:11.453491+0000","last_peered":"2024-04-25T09:04:11.453491+0000","last_clean":"2024-04-25T09:04:11.453491+0000","last_became_active":"2024-04-25T09:04:09.441288+0000","last_became_peered":"2024-04-25T09:04:09.441288+0000","last_unstale":"2024-04-25T09:04:11.453491+0000","last_undegraded":"2024-04-25T09:04:11.453491+0000","last_fullsized":"2024-04-25T09:04:11.453491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454256+0000","last_change":"2024-04-25T09:04:10.460810+0000","last_active":"2024-04-25T09:04:11.454256+0000","last_peered":"2024-04-25T09:04:11.454256+0000","last_clean":"2024-04-25T09:04:11.454256+0000","last_became_active":"2024-04-25T09:04:10.458726+0000","last_became_peered":"2024-04-25T09:04:10.458726+0000","last_unstale":"2024-04-25T09:04:11.454256+0000","last_undegraded":"2024-04-25T09:04:11.454256+0000","last_fullsized":"2024-04-25T09:04:11.454256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.228938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453432+0000","last_change":"2024-04-25T09:04:09.436321+0000","last_active":"2024-04-25T09:04:11.453432+0000","last_peered":"2024-04-25T09:04:11.453432+0000","last_clean":"2024-04-25T09:04:11.453432+0000","last_became_active":"2024-04-25T09:04:09.435708+0000","last_became_peered":"2024-04-25T09:04:09.435708+0000","last_unstale":"2024-04-25T09:04:11.453432+0000","last_undegraded":"2024-04-25T09:04:11.453432+0000","last_fullsized":"2024-04-25T09:04:11.453432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:23.622773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491036+0000","last_change":"2024-04-25T09:04:10.469991+0000","last_active":"2024-04-25T09:04:12.491036+0000","last_peered":"2024-04-25T09:04:12.491036+0000","last_clean":"2024-04-25T09:04:12.491036+0000","last_became_active":"2024-04-25T09:04:10.469673+0000","last_became_peered":"2024-04-25T09:04:10.469673+0000","last_unstale":"2024-04-25T09:04:12.491036+0000","last_undegraded":"2024-04-25T09:04:12.491036+0000","last_fullsized":"2024-04-25T09:04:12.491036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:25.970653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.469764+0000","last_change":"2024-04-25T09:04:09.445342+0000","last_active":"2024-04-25T09:04:10.469764+0000","last_peered":"2024-04-25T09:04:10.469764+0000","last_clean":"2024-04-25T09:04:10.469764+0000","last_became_active":"2024-04-25T09:04:09.445036+0000","last_became_peered":"2024-04-25T09:04:09.445036+0000","last_unstale":"2024-04-25T09:04:10.469764+0000","last_undegraded":"2024-04-25T09:04:10.469764+0000","last_fullsized":"2024-04-25T09:04:10.469764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:42.962745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.465777+0000","last_change":"2024-04-25T09:04:10.460039+0000","last_active":"2024-04-25T09:04:10.465777+0000","last_peered":"2024-04-25T09:04:10.465777+0000","last_clean":"2024-04-25T09:04:10.465777+0000","last_became_active":"2024-04-25T09:04:10.459802+0000","last_became_peered":"2024-04-25T09:04:10.459802+0000","last_unstale":"2024-04-25T09:04:10.465777+0000","last_undegraded":"2024-04-25T09:04:10.465777+0000","last_fullsized":"2024-04-25T09:04:10.465777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:17.359486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.443824+0000","last_change":"2024-04-25T09:04:09.448990+0000","last_active":"2024-04-25T09:04:10.443824+0000","last_peered":"2024-04-25T09:04:10.443824+0000","last_clean":"2024-04-25T09:04:10.443824+0000","last_became_active":"2024-04-25T09:04:09.447328+0000","last_became_peered":"2024-04-25T09:04:09.447328+0000","last_unstale":"2024-04-25T09:04:10.443824+0000","last_undegraded":"2024-04-25T09:04:10.443824+0000","last_fullsized":"2024-04-25T09:04:10.443824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491268+0000","last_change":"2024-04-25T09:04:10.470501+0000","last_active":"2024-04-25T09:04:12.491268+0000","last_peered":"2024-04-25T09:04:12.491268+0000","last_clean":"2024-04-25T09:04:12.491268+0000","last_became_active":"2024-04-25T09:04:10.470149+0000","last_became_peered":"2024-04-25T09:04:10.470149+0000","last_unstale":"2024-04-25T09:04:12.491268+0000","last_undegraded":"2024-04-25T09:04:12.491268+0000","last_fullsized":"2024-04-25T09:04:12.491268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:38.453486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453361+0000","last_change":"2024-04-25T09:04:09.428421+0000","last_active":"2024-04-25T09:04:11.453361+0000","last_peered":"2024-04-25T09:04:11.453361+0000","last_clean":"2024-04-25T09:04:11.453361+0000","last_became_active":"2024-04-25T09:04:09.428088+0000","last_became_peered":"2024-04-25T09:04:09.428088+0000","last_unstale":"2024-04-25T09:04:11.453361+0000","last_undegraded":"2024-04-25T09:04:11.453361+0000","last_fullsized":"2024-04-25T09:04:11.453361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:11.557908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454070+0000","last_change":"2024-04-25T09:04:10.452284+0000","last_active":"2024-04-25T09:04:11.454070+0000","last_peered":"2024-04-25T09:04:11.454070+0000","last_clean":"2024-04-25T09:04:11.454070+0000","last_became_active":"2024-04-25T09:04:10.451470+0000","last_became_peered":"2024-04-25T09:04:10.451470+0000","last_unstale":"2024-04-25T09:04:11.454070+0000","last_undegraded":"2024-04-25T09:04:11.454070+0000","last_fullsized":"2024-04-25T09:04:11.454070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:36.421524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437004+0000","last_change":"2024-04-25T09:04:09.437062+0000","last_active":"2024-04-25T09:04:12.437004+0000","last_peered":"2024-04-25T09:04:12.437004+0000","last_clean":"2024-04-25T09:04:12.437004+0000","last_became_active":"2024-04-25T09:04:09.436793+0000","last_became_peered":"2024-04-25T09:04:09.436793+0000","last_unstale":"2024-04-25T09:04:12.437004+0000","last_undegraded":"2024-04-25T09:04:12.437004+0000","last_fullsized":"2024-04-25T09:04:12.437004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.490890+0000","last_change":"2024-04-25T09:04:10.462986+0000","last_active":"2024-04-25T09:04:12.490890+0000","last_peered":"2024-04-25T09:04:12.490890+0000","last_clean":"2024-04-25T09:04:12.490890+0000","last_became_active":"2024-04-25T09:04:10.462639+0000","last_became_peered":"2024-04-25T09:04:10.462639+0000","last_unstale":"2024-04-25T09:04:12.490890+0000","last_undegraded":"2024-04-25T09:04:12.490890+0000","last_fullsized":"2024-04-25T09:04:12.490890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.022253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454237+0000","last_change":"2024-04-25T09:04:09.435053+0000","last_active":"2024-04-25T09:04:11.454237+0000","last_peered":"2024-04-25T09:04:11.454237+0000","last_clean":"2024-04-25T09:04:11.454237+0000","last_became_active":"2024-04-25T09:04:09.434661+0000","last_became_peered":"2024-04-25T09:04:09.434661+0000","last_unstale":"2024-04-25T09:04:11.454237+0000","last_undegraded":"2024-04-25T09:04:11.454237+0000","last_fullsized":"2024-04-25T09:04:11.454237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:50.779717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491308+0000","last_change":"2024-04-25T09:04:10.472088+0000","last_active":"2024-04-25T09:04:12.491308+0000","last_peered":"2024-04-25T09:04:12.491308+0000","last_clean":"2024-04-25T09:04:12.491308+0000","last_became_active":"2024-04-25T09:04:10.471765+0000","last_became_peered":"2024-04-25T09:04:10.471765+0000","last_unstale":"2024-04-25T09:04:12.491308+0000","last_undegraded":"2024-04-25T09:04:12.491308+0000","last_fullsized":"2024-04-25T09:04:12.491308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:56.330375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437211+0000","last_change":"2024-04-25T09:04:09.444431+0000","last_active":"2024-04-25T09:04:12.437211+0000","last_peered":"2024-04-25T09:04:12.437211+0000","last_clean":"2024-04-25T09:04:12.437211+0000","last_became_active":"2024-04-25T09:04:09.444192+0000","last_became_peered":"2024-04-25T09:04:09.444192+0000","last_unstale":"2024-04-25T09:04:12.437211+0000","last_undegraded":"2024-04-25T09:04:12.437211+0000","last_fullsized":"2024-04-25T09:04:12.437211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491563+0000","last_change":"2024-04-25T09:04:10.472130+0000","last_active":"2024-04-25T09:04:12.491563+0000","last_peered":"2024-04-25T09:04:12.491563+0000","last_clean":"2024-04-25T09:04:12.491563+0000","last_became_active":"2024-04-25T09:04:10.471819+0000","last_became_peered":"2024-04-25T09:04:10.471819+0000","last_unstale":"2024-04-25T09:04:12.491563+0000","last_undegraded":"2024-04-25T09:04:12.491563+0000","last_fullsized":"2024-04-25T09:04:12.491563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:08.225883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453585+0000","last_change":"2024-04-25T09:04:09.435777+0000","last_active":"2024-04-25T09:04:11.453585+0000","last_peered":"2024-04-25T09:04:11.453585+0000","last_clean":"2024-04-25T09:04:11.453585+0000","last_became_active":"2024-04-25T09:04:09.433156+0000","last_became_peered":"2024-04-25T09:04:09.433156+0000","last_unstale":"2024-04-25T09:04:11.453585+0000","last_undegraded":"2024-04-25T09:04:11.453585+0000","last_fullsized":"2024-04-25T09:04:11.453585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:11.557908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.470795+0000","last_change":"2024-04-25T09:04:10.467199+0000","last_active":"2024-04-25T09:04:10.470795+0000","last_peered":"2024-04-25T09:04:10.470795+0000","last_clean":"2024-04-25T09:04:10.470795+0000","last_became_active":"2024-04-25T09:04:10.466426+0000","last_became_peered":"2024-04-25T09:04:10.466426+0000","last_unstale":"2024-04-25T09:04:10.470795+0000","last_undegraded":"2024-04-25T09:04:10.470795+0000","last_fullsized":"2024-04-25T09:04:10.470795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:06.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437060+0000","last_change":"2024-04-25T09:04:09.438805+0000","last_active":"2024-04-25T09:04:12.437060+0000","last_peered":"2024-04-25T09:04:12.437060+0000","last_clean":"2024-04-25T09:04:12.437060+0000","last_became_active":"2024-04-25T09:04:09.438519+0000","last_became_peered":"2024-04-25T09:04:09.438519+0000","last_unstale":"2024-04-25T09:04:12.437060+0000","last_undegraded":"2024-04-25T09:04:12.437060+0000","last_fullsized":"2024-04-25T09:04:12.437060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:52.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491190+0000","last_change":"2024-04-25T09:04:10.467799+0000","last_active":"2024-04-25T09:04:12.491190+0000","last_peered":"2024-04-25T09:04:12.491190+0000","last_clean":"2024-04-25T09:04:12.491190+0000","last_became_active":"2024-04-25T09:04:10.467524+0000","last_became_peered":"2024-04-25T09:04:10.467524+0000","last_unstale":"2024-04-25T09:04:12.491190+0000","last_undegraded":"2024-04-25T09:04:12.491190+0000","last_fullsized":"2024-04-25T09:04:12.491190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:59.917069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.490943+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:04:12.490943+0000","last_peered":"2024-04-25T09:04:12.490943+0000","last_clean":"2024-04-25T09:04:12.490943+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:04:12.490943+0000","last_undegraded":"2024-04-25T09:04:12.490943+0000","last_fullsized":"2024-04-25T09:04:12.490943+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.443736+0000","last_change":"2024-04-25T09:04:09.443155+0000","last_active":"2024-04-25T09:04:10.443736+0000","last_peered":"2024-04-25T09:04:10.443736+0000","last_clean":"2024-04-25T09:04:10.443736+0000","last_became_active":"2024-04-25T09:04:09.441937+0000","last_became_peered":"2024-04-25T09:04:09.441937+0000","last_unstale":"2024-04-25T09:04:10.443736+0000","last_undegraded":"2024-04-25T09:04:10.443736+0000","last_fullsized":"2024-04-25T09:04:10.443736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766523+0000","last_change":"2024-04-25T09:04:10.455462+0000","last_active":"2024-04-25T09:04:11.766523+0000","last_peered":"2024-04-25T09:04:11.766523+0000","last_clean":"2024-04-25T09:04:11.766523+0000","last_became_active":"2024-04-25T09:04:10.455118+0000","last_became_peered":"2024-04-25T09:04:10.455118+0000","last_unstale":"2024-04-25T09:04:11.766523+0000","last_undegraded":"2024-04-25T09:04:11.766523+0000","last_fullsized":"2024-04-25T09:04:11.766523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:10.572493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.490794+0000","last_change":"2024-04-25T09:04:09.446062+0000","last_active":"2024-04-25T09:04:12.490794+0000","last_peered":"2024-04-25T09:04:12.490794+0000","last_clean":"2024-04-25T09:04:12.490794+0000","last_became_active":"2024-04-25T09:04:09.445786+0000","last_became_peered":"2024-04-25T09:04:09.445786+0000","last_unstale":"2024-04-25T09:04:12.490794+0000","last_undegraded":"2024-04-25T09:04:12.490794+0000","last_fullsized":"2024-04-25T09:04:12.490794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.453794+0000","last_change":"2024-04-25T09:04:10.444069+0000","last_active":"2024-04-25T09:04:10.453794+0000","last_peered":"2024-04-25T09:04:10.453794+0000","last_clean":"2024-04-25T09:04:10.453794+0000","last_became_active":"2024-04-25T09:04:10.443785+0000","last_became_peered":"2024-04-25T09:04:10.443785+0000","last_unstale":"2024-04-25T09:04:10.453794+0000","last_undegraded":"2024-04-25T09:04:10.453794+0000","last_fullsized":"2024-04-25T09:04:10.453794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:00.829864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437094+0000","last_change":"2024-04-25T09:04:09.434207+0000","last_active":"2024-04-25T09:04:12.437094+0000","last_peered":"2024-04-25T09:04:12.437094+0000","last_clean":"2024-04-25T09:04:12.437094+0000","last_became_active":"2024-04-25T09:04:09.433751+0000","last_became_peered":"2024-04-25T09:04:09.433751+0000","last_unstale":"2024-04-25T09:04:12.437094+0000","last_undegraded":"2024-04-25T09:04:12.437094+0000","last_fullsized":"2024-04-25T09:04:12.437094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:59.824337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453395+0000","last_change":"2024-04-25T09:04:10.460017+0000","last_active":"2024-04-25T09:04:11.453395+0000","last_peered":"2024-04-25T09:04:11.453395+0000","last_clean":"2024-04-25T09:04:11.453395+0000","last_became_active":"2024-04-25T09:04:10.459722+0000","last_became_peered":"2024-04-25T09:04:10.459722+0000","last_unstale":"2024-04-25T09:04:11.453395+0000","last_undegraded":"2024-04-25T09:04:11.453395+0000","last_fullsized":"2024-04-25T09:04:11.453395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:03.161885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.443958+0000","last_change":"2024-04-25T09:04:09.445889+0000","last_active":"2024-04-25T09:04:10.443958+0000","last_peered":"2024-04-25T09:04:10.443958+0000","last_clean":"2024-04-25T09:04:10.443958+0000","last_became_active":"2024-04-25T09:04:09.445008+0000","last_became_peered":"2024-04-25T09:04:09.445008+0000","last_unstale":"2024-04-25T09:04:10.443958+0000","last_undegraded":"2024-04-25T09:04:10.443958+0000","last_fullsized":"2024-04-25T09:04:10.443958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:11.557908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453904+0000","last_change":"2024-04-25T09:04:10.457749+0000","last_active":"2024-04-25T09:04:11.453904+0000","last_peered":"2024-04-25T09:04:11.453904+0000","last_clean":"2024-04-25T09:04:11.453904+0000","last_became_active":"2024-04-25T09:04:10.454687+0000","last_became_peered":"2024-04-25T09:04:10.454687+0000","last_unstale":"2024-04-25T09:04:11.453904+0000","last_undegraded":"2024-04-25T09:04:11.453904+0000","last_fullsized":"2024-04-25T09:04:11.453904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:12.563435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453313+0000","last_change":"2024-04-25T09:04:09.448524+0000","last_active":"2024-04-25T09:04:11.453313+0000","last_peered":"2024-04-25T09:04:11.453313+0000","last_clean":"2024-04-25T09:04:11.453313+0000","last_became_active":"2024-04-25T09:04:09.448200+0000","last_became_peered":"2024-04-25T09:04:09.448200+0000","last_unstale":"2024-04-25T09:04:11.453313+0000","last_undegraded":"2024-04-25T09:04:11.453313+0000","last_fullsized":"2024-04-25T09:04:11.453313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.470516+0000","last_change":"2024-04-25T09:04:10.466591+0000","last_active":"2024-04-25T09:04:10.470516+0000","last_peered":"2024-04-25T09:04:10.470516+0000","last_clean":"2024-04-25T09:04:10.470516+0000","last_became_active":"2024-04-25T09:04:10.466280+0000","last_became_peered":"2024-04-25T09:04:10.466280+0000","last_unstale":"2024-04-25T09:04:10.470516+0000","last_undegraded":"2024-04-25T09:04:10.470516+0000","last_fullsized":"2024-04-25T09:04:10.470516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:12.826732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491422+0000","last_change":"2024-04-25T09:04:09.450624+0000","last_active":"2024-04-25T09:04:12.491422+0000","last_peered":"2024-04-25T09:04:12.491422+0000","last_clean":"2024-04-25T09:04:12.491422+0000","last_became_active":"2024-04-25T09:04:09.450247+0000","last_became_peered":"2024-04-25T09:04:09.450247+0000","last_unstale":"2024-04-25T09:04:12.491422+0000","last_undegraded":"2024-04-25T09:04:12.491422+0000","last_fullsized":"2024-04-25T09:04:12.491422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:06.223411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453226+0000","last_change":"2024-04-25T09:04:10.456100+0000","last_active":"2024-04-25T09:04:11.453226+0000","last_peered":"2024-04-25T09:04:11.453226+0000","last_clean":"2024-04-25T09:04:11.453226+0000","last_became_active":"2024-04-25T09:04:10.455713+0000","last_became_peered":"2024-04-25T09:04:10.455713+0000","last_unstale":"2024-04-25T09:04:11.453226+0000","last_undegraded":"2024-04-25T09:04:11.453226+0000","last_fullsized":"2024-04-25T09:04:11.453226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:36.421524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.435073+0000","last_change":"2024-04-25T09:04:09.440316+0000","last_active":"2024-04-25T09:04:12.435073+0000","last_peered":"2024-04-25T09:04:12.435073+0000","last_clean":"2024-04-25T09:04:12.435073+0000","last_became_active":"2024-04-25T09:04:09.437292+0000","last_became_peered":"2024-04-25T09:04:09.437292+0000","last_unstale":"2024-04-25T09:04:12.435073+0000","last_undegraded":"2024-04-25T09:04:12.435073+0000","last_fullsized":"2024-04-25T09:04:12.435073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.586105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766908+0000","last_change":"2024-04-25T09:04:10.459918+0000","last_active":"2024-04-25T09:04:11.766908+0000","last_peered":"2024-04-25T09:04:11.766908+0000","last_clean":"2024-04-25T09:04:11.766908+0000","last_became_active":"2024-04-25T09:04:10.459598+0000","last_became_peered":"2024-04-25T09:04:10.459598+0000","last_unstale":"2024-04-25T09:04:11.766908+0000","last_undegraded":"2024-04-25T09:04:11.766908+0000","last_fullsized":"2024-04-25T09:04:11.766908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:59.917069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454406+0000","last_change":"2024-04-25T09:04:09.447004+0000","last_active":"2024-04-25T09:04:11.454406+0000","last_peered":"2024-04-25T09:04:11.454406+0000","last_clean":"2024-04-25T09:04:11.454406+0000","last_became_active":"2024-04-25T09:04:09.446720+0000","last_became_peered":"2024-04-25T09:04:09.446720+0000","last_unstale":"2024-04-25T09:04:11.454406+0000","last_undegraded":"2024-04-25T09:04:11.454406+0000","last_fullsized":"2024-04-25T09:04:11.454406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.453982+0000","last_change":"2024-04-25T09:04:10.448395+0000","last_active":"2024-04-25T09:04:10.453982+0000","last_peered":"2024-04-25T09:04:10.453982+0000","last_clean":"2024-04-25T09:04:10.453982+0000","last_became_active":"2024-04-25T09:04:10.448092+0000","last_became_peered":"2024-04-25T09:04:10.448092+0000","last_unstale":"2024-04-25T09:04:10.453982+0000","last_undegraded":"2024-04-25T09:04:10.453982+0000","last_fullsized":"2024-04-25T09:04:10.453982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:33.347350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491035+0000","last_change":"2024-04-25T09:04:09.450871+0000","last_active":"2024-04-25T09:04:12.491035+0000","last_peered":"2024-04-25T09:04:12.491035+0000","last_clean":"2024-04-25T09:04:12.491035+0000","last_became_active":"2024-04-25T09:04:09.450420+0000","last_became_peered":"2024-04-25T09:04:09.450420+0000","last_unstale":"2024-04-25T09:04:12.491035+0000","last_undegraded":"2024-04-25T09:04:12.491035+0000","last_fullsized":"2024-04-25T09:04:12.491035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453905+0000","last_change":"2024-04-25T09:04:10.461790+0000","last_active":"2024-04-25T09:04:11.453905+0000","last_peered":"2024-04-25T09:04:11.453905+0000","last_clean":"2024-04-25T09:04:11.453905+0000","last_became_active":"2024-04-25T09:04:10.459834+0000","last_became_peered":"2024-04-25T09:04:10.459834+0000","last_unstale":"2024-04-25T09:04:11.453905+0000","last_undegraded":"2024-04-25T09:04:11.453905+0000","last_fullsized":"2024-04-25T09:04:11.453905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:24.628300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453268+0000","last_change":"2024-04-25T09:04:09.443781+0000","last_active":"2024-04-25T09:04:11.453268+0000","last_peered":"2024-04-25T09:04:11.453268+0000","last_clean":"2024-04-25T09:04:11.453268+0000","last_became_active":"2024-04-25T09:04:09.443436+0000","last_became_peered":"2024-04-25T09:04:09.443436+0000","last_unstale":"2024-04-25T09:04:11.453268+0000","last_undegraded":"2024-04-25T09:04:11.453268+0000","last_fullsized":"2024-04-25T09:04:11.453268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:06.223411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766429+0000","last_change":"2024-04-25T09:04:10.453062+0000","last_active":"2024-04-25T09:04:11.766429+0000","last_peered":"2024-04-25T09:04:11.766429+0000","last_clean":"2024-04-25T09:04:11.766429+0000","last_became_active":"2024-04-25T09:04:10.452791+0000","last_became_peered":"2024-04-25T09:04:10.452791+0000","last_unstale":"2024-04-25T09:04:11.766429+0000","last_undegraded":"2024-04-25T09:04:11.766429+0000","last_fullsized":"2024-04-25T09:04:11.766429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:36.421524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453381+0000","last_change":"2024-04-25T09:04:09.434154+0000","last_active":"2024-04-25T09:04:11.453381+0000","last_peered":"2024-04-25T09:04:11.453381+0000","last_clean":"2024-04-25T09:04:11.453381+0000","last_became_active":"2024-04-25T09:04:09.433848+0000","last_became_peered":"2024-04-25T09:04:09.433848+0000","last_unstale":"2024-04-25T09:04:11.453381+0000","last_undegraded":"2024-04-25T09:04:11.453381+0000","last_fullsized":"2024-04-25T09:04:11.453381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:23.622773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766744+0000","last_change":"2024-04-25T09:04:10.449393+0000","last_active":"2024-04-25T09:04:11.766744+0000","last_peered":"2024-04-25T09:04:11.766744+0000","last_clean":"2024-04-25T09:04:11.766744+0000","last_became_active":"2024-04-25T09:04:10.449096+0000","last_became_peered":"2024-04-25T09:04:10.449096+0000","last_unstale":"2024-04-25T09:04:11.766744+0000","last_undegraded":"2024-04-25T09:04:11.766744+0000","last_fullsized":"2024-04-25T09:04:11.766744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.022253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491405+0000","last_change":"2024-04-25T09:04:09.448660+0000","last_active":"2024-04-25T09:04:12.491405+0000","last_peered":"2024-04-25T09:04:12.491405+0000","last_clean":"2024-04-25T09:04:12.491405+0000","last_became_active":"2024-04-25T09:04:09.448294+0000","last_became_peered":"2024-04-25T09:04:09.448294+0000","last_unstale":"2024-04-25T09:04:12.491405+0000","last_undegraded":"2024-04-25T09:04:12.491405+0000","last_fullsized":"2024-04-25T09:04:12.491405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:11.557908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453289+0000","last_change":"2024-04-25T09:04:10.447970+0000","last_active":"2024-04-25T09:04:11.453289+0000","last_peered":"2024-04-25T09:04:11.453289+0000","last_clean":"2024-04-25T09:04:11.453289+0000","last_became_active":"2024-04-25T09:04:10.447382+0000","last_became_peered":"2024-04-25T09:04:10.447382+0000","last_unstale":"2024-04-25T09:04:11.453289+0000","last_undegraded":"2024-04-25T09:04:11.453289+0000","last_fullsized":"2024-04-25T09:04:11.453289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:06.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.470541+0000","last_change":"2024-04-25T09:04:10.467264+0000","last_active":"2024-04-25T09:04:10.470541+0000","last_peered":"2024-04-25T09:04:10.470541+0000","last_clean":"2024-04-25T09:04:10.470541+0000","last_became_active":"2024-04-25T09:04:10.466902+0000","last_became_peered":"2024-04-25T09:04:10.466902+0000","last_unstale":"2024-04-25T09:04:10.470541+0000","last_undegraded":"2024-04-25T09:04:10.470541+0000","last_fullsized":"2024-04-25T09:04:10.470541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:47.704816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491091+0000","last_change":"2024-04-25T09:04:09.451766+0000","last_active":"2024-04-25T09:04:12.491091+0000","last_peered":"2024-04-25T09:04:12.491091+0000","last_clean":"2024-04-25T09:04:12.491091+0000","last_became_active":"2024-04-25T09:04:09.451360+0000","last_became_peered":"2024-04-25T09:04:09.451360+0000","last_unstale":"2024-04-25T09:04:12.491091+0000","last_undegraded":"2024-04-25T09:04:12.491091+0000","last_fullsized":"2024-04-25T09:04:12.491091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:23.622773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.470815+0000","last_change":"2024-04-25T09:04:10.467782+0000","last_active":"2024-04-25T09:04:10.470815+0000","last_peered":"2024-04-25T09:04:10.470815+0000","last_clean":"2024-04-25T09:04:10.470815+0000","last_became_active":"2024-04-25T09:04:10.467514+0000","last_became_peered":"2024-04-25T09:04:10.467514+0000","last_unstale":"2024-04-25T09:04:10.470815+0000","last_undegraded":"2024-04-25T09:04:10.470815+0000","last_fullsized":"2024-04-25T09:04:10.470815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:36.421524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491249+0000","last_change":"2024-04-25T09:04:09.451747+0000","last_active":"2024-04-25T09:04:12.491249+0000","last_peered":"2024-04-25T09:04:12.491249+0000","last_clean":"2024-04-25T09:04:12.491249+0000","last_became_active":"2024-04-25T09:04:09.451001+0000","last_became_peered":"2024-04-25T09:04:09.451001+0000","last_unstale":"2024-04-25T09:04:12.491249+0000","last_undegraded":"2024-04-25T09:04:12.491249+0000","last_fullsized":"2024-04-25T09:04:12.491249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.586105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.459513+0000","last_change":"2024-04-25T09:04:10.451528+0000","last_active":"2024-04-25T09:04:10.459513+0000","last_peered":"2024-04-25T09:04:10.459513+0000","last_clean":"2024-04-25T09:04:10.459513+0000","last_became_active":"2024-04-25T09:04:10.451248+0000","last_became_peered":"2024-04-25T09:04:10.451248+0000","last_unstale":"2024-04-25T09:04:10.459513+0000","last_undegraded":"2024-04-25T09:04:10.459513+0000","last_fullsized":"2024-04-25T09:04:10.459513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:24.628300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766853+0000","last_change":"2024-04-25T09:04:09.447550+0000","last_active":"2024-04-25T09:04:11.766853+0000","last_peered":"2024-04-25T09:04:11.766853+0000","last_clean":"2024-04-25T09:04:11.766853+0000","last_became_active":"2024-04-25T09:04:09.447290+0000","last_became_peered":"2024-04-25T09:04:09.447290+0000","last_unstale":"2024-04-25T09:04:11.766853+0000","last_undegraded":"2024-04-25T09:04:11.766853+0000","last_fullsized":"2024-04-25T09:04:11.766853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:37.664377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766592+0000","last_change":"2024-04-25T09:04:10.448757+0000","last_active":"2024-04-25T09:04:11.766592+0000","last_peered":"2024-04-25T09:04:11.766592+0000","last_clean":"2024-04-25T09:04:11.766592+0000","last_became_active":"2024-04-25T09:04:10.448463+0000","last_became_peered":"2024-04-25T09:04:10.448463+0000","last_unstale":"2024-04-25T09:04:11.766592+0000","last_undegraded":"2024-04-25T09:04:11.766592+0000","last_fullsized":"2024-04-25T09:04:11.766592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:53.844663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.471821+0000","last_change":"2024-04-25T09:04:09.446106+0000","last_active":"2024-04-25T09:04:10.471821+0000","last_peered":"2024-04-25T09:04:10.471821+0000","last_clean":"2024-04-25T09:04:10.471821+0000","last_became_active":"2024-04-25T09:04:09.445783+0000","last_became_peered":"2024-04-25T09:04:09.445783+0000","last_unstale":"2024-04-25T09:04:10.471821+0000","last_undegraded":"2024-04-25T09:04:10.471821+0000","last_fullsized":"2024-04-25T09:04:10.471821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:37.664377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:04:14.507 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:04:14.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.687+0000 7fb476e00640 1 Processor -- start 2024-04-25T09:04:14.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.687+0000 7fb476e00640 1 -- start start 2024-04-25T09:04:14.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb476e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4700cfc70 0x7fb47006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb476e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4700cda00 con 0x7fb47015a900 2024-04-25T09:04:14.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb476e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4700cdce0 con 0x7fb4700cd520 2024-04-25T09:04:14.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb476e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47015bcf0 con 0x7fb4700cfc70 2024-04-25T09:04:14.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46fe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb47015a900 0x7fb4700ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59204/0 (socket says 172.21.15.175:59204) 2024-04-25T09:04:14.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46fe00640 1 -- 172.21.15.175:0/919325652 learned_addr learned my addr 172.21.15.175:0/919325652 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:14.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46ea00640 1 -- 172.21.15.175:0/919325652 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793518078 0 0) 0x7fb4700cda00 con 0x7fb47015a900 2024-04-25T09:04:14.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb474e00640 1 --2- 172.21.15.175:0/919325652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4700cfc70 0x7fb47006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46ea00640 1 -- 172.21.15.175:0/919325652 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb454003530 con 0x7fb47015a900 2024-04-25T09:04:14.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46ea00640 1 -- 172.21.15.175:0/919325652 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1989326037 0 0) 0x7fb454003530 con 0x7fb47015a900 2024-04-25T09:04:14.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46ea00640 1 -- 172.21.15.175:0/919325652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4700cfc70 msgr2=0x7fb47006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46ea00640 1 --2- 172.21.15.175:0/919325652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4700cfc70 0x7fb47006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46ea00640 1 -- 172.21.15.175:0/919325652 >> v1:172.21.15.177:6789/0 conn(0x7fb4700cd520 legacy=0x7fb4700cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46ea00640 1 -- 172.21.15.175:0/919325652 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4700cdfc0 con 0x7fb47015a900 2024-04-25T09:04:14.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46ea00640 1 -- 172.21.15.175:0/919325652 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fb460001a00 con 0x7fb47015a900 2024-04-25T09:04:14.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46ea00640 1 -- 172.21.15.175:0/919325652 >> v1:172.21.15.175:6789/0 conn(0x7fb47015a900 legacy=0x7fb4700ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46ea00640 1 --2- 172.21.15.175:0/919325652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4540039f0 0x7fb454003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46ea00640 1 --2- 172.21.15.175:0/919325652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4700cfc70 0x7fb454004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46ea00640 1 --2- 172.21.15.175:0/919325652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb454004d50 0x7fb4540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46ea00640 1 -- 172.21.15.175:0/919325652 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45400ba80 con 0x7fb4540039f0 2024-04-25T09:04:14.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46ea00640 1 -- 172.21.15.175:0/919325652 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45400bc30 con 0x7fb454004d50 2024-04-25T09:04:14.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46ea00640 1 -- 172.21.15.175:0/919325652 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45400e040 con 0x7fb4700cfc70 2024-04-25T09:04:14.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46fe00640 1 --2- 172.21.15.175:0/919325652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4540039f0 0x7fb454003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46f400640 1 --2- 172.21.15.175:0/919325652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4700cfc70 0x7fb454004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb474e00640 1 --2- 172.21.15.175:0/919325652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb454004d50 0x7fb4540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46fe00640 1 -- 172.21.15.175:0/919325652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4700cfc70 msgr2=0x7fb454004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46fe00640 1 --2- 172.21.15.175:0/919325652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4700cfc70 0x7fb454004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46fe00640 1 -- 172.21.15.175:0/919325652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb454004d50 msgr2=0x7fb4540051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46fe00640 1 --2- 172.21.15.175:0/919325652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb454004d50 0x7fb4540051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46fe00640 1 -- 172.21.15.175:0/919325652 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb454003530 con 0x7fb4540039f0 2024-04-25T09:04:14.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb46f400640 1 --2- 172.21.15.175:0/919325652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4700cfc70 0x7fb454004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:14.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.691+0000 7fb474e00640 1 --2- 172.21.15.175:0/919325652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb454004d50 0x7fb4540051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:14.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.695+0000 7fb46fe00640 1 --2- 172.21.15.175:0/919325652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4540039f0 0x7fb454003e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb46000a810 tx=0x7fb46001d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee44887271a5cf23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.695+0000 7fb46ea00640 1 -- 172.21.15.175:0/919325652 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46000a460 con 0x7fb4540039f0 2024-04-25T09:04:14.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.695+0000 7fb46ea00640 1 -- 172.21.15.175:0/919325652 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4600ad650 con 0x7fb4540039f0 2024-04-25T09:04:14.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.695+0000 7fb46ea00640 1 -- 172.21.15.175:0/919325652 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4600ada40 con 0x7fb4540039f0 2024-04-25T09:04:14.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.695+0000 7fb476e00640 1 -- 172.21.15.175:0/919325652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4540039f0 msgr2=0x7fb454003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.695+0000 7fb476e00640 1 --2- 172.21.15.175:0/919325652 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4540039f0 0x7fb454003e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb46000a810 tx=0x7fb46001d340 comp rx=0 tx=0).stop 2024-04-25T09:04:14.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.695+0000 7fb474e00640 1 -- 172.21.15.175:0/919325652 reap_dead start 2024-04-25T09:04:14.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.695+0000 7fb476e00640 1 -- 172.21.15.175:0/919325652 shutdown_connections 2024-04-25T09:04:14.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.695+0000 7fb476e00640 1 -- 172.21.15.175:0/919325652 >> 172.21.15.175:0/919325652 conn(0x7fb470067150 msgr2=0x7fb47006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.695+0000 7fb476e00640 1 -- 172.21.15.175:0/919325652 shutdown_connections 2024-04-25T09:04:14.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.695+0000 7fb476e00640 1 -- 172.21.15.175:0/919325652 wait complete. 2024-04-25T09:04:14.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb476e00640 1 Processor -- start 2024-04-25T09:04:14.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb476e00640 1 -- start start 2024-04-25T09:04:14.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb476e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4701f9ab0 0x7fb47014d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb476e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb47014c0e0 0x7fb470153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb476e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb470153b60 0x7fb470162750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb476e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47006d530 con 0x7fb470153b60 2024-04-25T09:04:14.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb476e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47006d3b0 con 0x7fb47014c0e0 2024-04-25T09:04:14.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb476e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47015c790 con 0x7fb4701f9ab0 2024-04-25T09:04:14.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb474e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb470153b60 0x7fb470162750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb474e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb470153b60 0x7fb470162750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36354/0 (socket says 172.21.15.175:36354) 2024-04-25T09:04:14.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb474e00640 1 -- 172.21.15.175:0/2035786710 learned_addr learned my addr 172.21.15.175:0/2035786710 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:14.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb46fe00640 1 --2- 172.21.15.175:0/2035786710 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4701f9ab0 0x7fb47014d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb474e00640 1 -- 172.21.15.175:0/2035786710 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4701f9ab0 msgr2=0x7fb47014d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb46f400640 1 --2- 172.21.15.175:0/2035786710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb47014c0e0 0x7fb470153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb474e00640 1 --2- 172.21.15.175:0/2035786710 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4701f9ab0 0x7fb47014d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb474e00640 1 -- 172.21.15.175:0/2035786710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb47014c0e0 msgr2=0x7fb470153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb474e00640 1 --2- 172.21.15.175:0/2035786710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb47014c0e0 0x7fb470153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb474e00640 1 -- 172.21.15.175:0/2035786710 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb470155300 con 0x7fb470153b60 2024-04-25T09:04:14.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb46fe00640 1 --2- 172.21.15.175:0/2035786710 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4701f9ab0 0x7fb47014d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:14.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb46f400640 1 --2- 172.21.15.175:0/2035786710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb47014c0e0 0x7fb470153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:14.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb474e00640 1 --2- 172.21.15.175:0/2035786710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb470153b60 0x7fb470162750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb4700cf4e0 tx=0x7fb468011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb467e00640 1 -- 172.21.15.175:0/2035786710 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46801d070 con 0x7fb470153b60 2024-04-25T09:04:14.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb467e00640 1 -- 172.21.15.175:0/2035786710 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb468004250 con 0x7fb470153b60 2024-04-25T09:04:14.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb476e00640 1 -- 172.21.15.175:0/2035786710 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4701555e0 con 0x7fb470153b60 2024-04-25T09:04:14.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb467e00640 1 -- 172.21.15.175:0/2035786710 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4680157f0 con 0x7fb470153b60 2024-04-25T09:04:14.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb476e00640 1 -- 172.21.15.175:0/2035786710 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb470153fe0 con 0x7fb470153b60 2024-04-25T09:04:14.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.699+0000 7fb476e00640 1 -- 172.21.15.175:0/2035786710 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb470074a60 con 0x7fb470153b60 2024-04-25T09:04:14.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.703+0000 7fb467e00640 1 -- 172.21.15.175:0/2035786710 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb468020070 con 0x7fb470153b60 2024-04-25T09:04:14.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.703+0000 7fb467e00640 1 --2- 172.21.15.175:0/2035786710 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb44c066f90 0x7fb44c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.703+0000 7fb467e00640 1 -- 172.21.15.175:0/2035786710 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4680846c0 con 0x7fb470153b60 2024-04-25T09:04:14.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.703+0000 7fb46fe00640 1 --2- 172.21.15.175:0/2035786710 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb44c066f90 0x7fb44c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.703+0000 7fb46fe00640 1 --2- 172.21.15.175:0/2035786710 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb44c066f90 0x7fb44c069450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb4600ad000 tx=0x7fb4700cdbd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.707+0000 7fb467e00640 1 -- 172.21.15.175:0/2035786710 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb4680555a0 con 0x7fb470153b60 2024-04-25T09:04:14.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.859+0000 7fb476e00640 1 -- 172.21.15.175:0/2035786710 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb4701550b0 con 0x7fb44c066f90 2024-04-25T09:04:14.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.863+0000 7fb467e00640 1 -- 172.21.15.175:0/2035786710 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251923 (secure 0 0 0) 0x7fb4701550b0 con 0x7fb44c066f90 2024-04-25T09:04:14.859 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:14.860 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:04:14.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.867+0000 7fb476e00640 1 -- 172.21.15.175:0/2035786710 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb44c066f90 msgr2=0x7fb44c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.867+0000 7fb476e00640 1 --2- 172.21.15.175:0/2035786710 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb44c066f90 0x7fb44c069450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb4600ad000 tx=0x7fb4700cdbd0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.867+0000 7fb476e00640 1 -- 172.21.15.175:0/2035786710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb470153b60 msgr2=0x7fb470162750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.867+0000 7fb476e00640 1 --2- 172.21.15.175:0/2035786710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb470153b60 0x7fb470162750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb4700cf4e0 tx=0x7fb468011920 comp rx=0 tx=0).stop 2024-04-25T09:04:14.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.867+0000 7fb476e00640 1 -- 172.21.15.175:0/2035786710 shutdown_connections 2024-04-25T09:04:14.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.867+0000 7fb476e00640 1 --2- 172.21.15.175:0/2035786710 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb44c066f90 0x7fb44c069450 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.867+0000 7fb476e00640 1 --2- 172.21.15.175:0/2035786710 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb470153b60 0x7fb470162750 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.867+0000 7fb476e00640 1 --2- 172.21.15.175:0/2035786710 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb47014c0e0 0x7fb470153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.867+0000 7fb476e00640 1 --2- 172.21.15.175:0/2035786710 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4701f9ab0 0x7fb47014d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.867+0000 7fb476e00640 1 -- 172.21.15.175:0/2035786710 >> 172.21.15.175:0/2035786710 conn(0x7fb4540039f0 msgr2=0x7fb4700b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.867+0000 7fb476e00640 1 -- 172.21.15.175:0/2035786710 shutdown_connections 2024-04-25T09:04:14.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:14.867+0000 7fb476e00640 1 -- 172.21.15.175:0/2035786710 wait complete. 2024-04-25T09:04:14.879 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-25T09:04:13.790698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218952,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755768,"statfs":{"total":773094113280,"available":772869906432,"internally_reserved":0,"allocated":2842624,"data_stored":1727828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.379229"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491395+0000","last_change":"2024-04-25T09:04:10.462062+0000","last_active":"2024-04-25T09:04:12.491395+0000","last_peered":"2024-04-25T09:04:12.491395+0000","last_clean":"2024-04-25T09:04:12.491395+0000","last_became_active":"2024-04-25T09:04:10.461771+0000","last_became_peered":"2024-04-25T09:04:10.461771+0000","last_unstale":"2024-04-25T09:04:12.491395+0000","last_undegraded":"2024-04-25T09:04:12.491395+0000","last_fullsized":"2024-04-25T09:04:12.491395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:38.704801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453592+0000","last_change":"2024-04-25T09:04:10.454772+0000","last_active":"2024-04-25T09:04:11.453592+0000","last_peered":"2024-04-25T09:04:11.453592+0000","last_clean":"2024-04-25T09:04:11.453592+0000","last_became_active":"2024-04-25T09:04:10.454462+0000","last_became_peered":"2024-04-25T09:04:10.454462+0000","last_unstale":"2024-04-25T09:04:11.453592+0000","last_undegraded":"2024-04-25T09:04:11.453592+0000","last_fullsized":"2024-04-25T09:04:11.453592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:59.964799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.460624+0000","last_change":"2024-04-25T09:04:10.455469+0000","last_active":"2024-04-25T09:04:10.460624+0000","last_peered":"2024-04-25T09:04:10.460624+0000","last_clean":"2024-04-25T09:04:10.460624+0000","last_became_active":"2024-04-25T09:04:10.455164+0000","last_became_peered":"2024-04-25T09:04:10.455164+0000","last_unstale":"2024-04-25T09:04:10.460624+0000","last_undegraded":"2024-04-25T09:04:10.460624+0000","last_fullsized":"2024-04-25T09:04:10.460624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:46.591632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.470834+0000","last_change":"2024-04-25T09:04:10.468612+0000","last_active":"2024-04-25T09:04:10.470834+0000","last_peered":"2024-04-25T09:04:10.470834+0000","last_clean":"2024-04-25T09:04:10.470834+0000","last_became_active":"2024-04-25T09:04:10.468241+0000","last_became_peered":"2024-04-25T09:04:10.468241+0000","last_unstale":"2024-04-25T09:04:10.470834+0000","last_undegraded":"2024-04-25T09:04:10.470834+0000","last_fullsized":"2024-04-25T09:04:10.470834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:03.161885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491349+0000","last_change":"2024-04-25T09:04:10.460849+0000","last_active":"2024-04-25T09:04:12.491349+0000","last_peered":"2024-04-25T09:04:12.491349+0000","last_clean":"2024-04-25T09:04:12.491349+0000","last_became_active":"2024-04-25T09:04:10.460521+0000","last_became_peered":"2024-04-25T09:04:10.460521+0000","last_unstale":"2024-04-25T09:04:12.491349+0000","last_undegraded":"2024-04-25T09:04:12.491349+0000","last_fullsized":"2024-04-25T09:04:12.491349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:41.363774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.463677+0000","last_change":"2024-04-25T09:04:10.452925+0000","last_active":"2024-04-25T09:04:10.463677+0000","last_peered":"2024-04-25T09:04:10.463677+0000","last_clean":"2024-04-25T09:04:10.463677+0000","last_became_active":"2024-04-25T09:04:10.450322+0000","last_became_peered":"2024-04-25T09:04:10.450322+0000","last_unstale":"2024-04-25T09:04:10.463677+0000","last_undegraded":"2024-04-25T09:04:10.463677+0000","last_fullsized":"2024-04-25T09:04:10.463677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:46.591632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.490891+0000","last_change":"2024-04-25T09:04:10.464505+0000","last_active":"2024-04-25T09:04:12.490891+0000","last_peered":"2024-04-25T09:04:12.490891+0000","last_clean":"2024-04-25T09:04:12.490891+0000","last_became_active":"2024-04-25T09:04:10.460449+0000","last_became_peered":"2024-04-25T09:04:10.460449+0000","last_unstale":"2024-04-25T09:04:12.490891+0000","last_undegraded":"2024-04-25T09:04:12.490891+0000","last_fullsized":"2024-04-25T09:04:12.490891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:53.844663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766242+0000","last_change":"2024-04-25T09:04:10.455495+0000","last_active":"2024-04-25T09:04:11.766242+0000","last_peered":"2024-04-25T09:04:11.766242+0000","last_clean":"2024-04-25T09:04:11.766242+0000","last_became_active":"2024-04-25T09:04:10.454824+0000","last_became_peered":"2024-04-25T09:04:10.454824+0000","last_unstale":"2024-04-25T09:04:11.766242+0000","last_undegraded":"2024-04-25T09:04:11.766242+0000","last_fullsized":"2024-04-25T09:04:11.766242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:06.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491385+0000","last_change":"2024-04-25T09:04:10.467947+0000","last_active":"2024-04-25T09:04:12.491385+0000","last_peered":"2024-04-25T09:04:12.491385+0000","last_clean":"2024-04-25T09:04:12.491385+0000","last_became_active":"2024-04-25T09:04:10.467620+0000","last_became_peered":"2024-04-25T09:04:10.467620+0000","last_unstale":"2024-04-25T09:04:12.491385+0000","last_undegraded":"2024-04-25T09:04:12.491385+0000","last_fullsized":"2024-04-25T09:04:12.491385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:38.966776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454350+0000","last_change":"2024-04-25T09:04:10.456157+0000","last_active":"2024-04-25T09:04:11.454350+0000","last_peered":"2024-04-25T09:04:11.454350+0000","last_clean":"2024-04-25T09:04:11.454350+0000","last_became_active":"2024-04-25T09:04:10.455814+0000","last_became_peered":"2024-04-25T09:04:10.455814+0000","last_unstale":"2024-04-25T09:04:11.454350+0000","last_undegraded":"2024-04-25T09:04:11.454350+0000","last_fullsized":"2024-04-25T09:04:11.454350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:10.572493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454102+0000","last_change":"2024-04-25T09:04:10.453100+0000","last_active":"2024-04-25T09:04:11.454102+0000","last_peered":"2024-04-25T09:04:11.454102+0000","last_clean":"2024-04-25T09:04:11.454102+0000","last_became_active":"2024-04-25T09:04:10.452835+0000","last_became_peered":"2024-04-25T09:04:10.452835+0000","last_unstale":"2024-04-25T09:04:11.454102+0000","last_undegraded":"2024-04-25T09:04:11.454102+0000","last_fullsized":"2024-04-25T09:04:11.454102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:03.161885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453763+0000","last_change":"2024-04-25T09:04:10.454612+0000","last_active":"2024-04-25T09:04:11.453763+0000","last_peered":"2024-04-25T09:04:11.453763+0000","last_clean":"2024-04-25T09:04:11.453763+0000","last_became_active":"2024-04-25T09:04:10.449834+0000","last_became_peered":"2024-04-25T09:04:10.449834+0000","last_unstale":"2024-04-25T09:04:11.453763+0000","last_undegraded":"2024-04-25T09:04:11.453763+0000","last_fullsized":"2024-04-25T09:04:11.453763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:33.347350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766581+0000","last_change":"2024-04-25T09:04:10.449404+0000","last_active":"2024-04-25T09:04:11.766581+0000","last_peered":"2024-04-25T09:04:11.766581+0000","last_clean":"2024-04-25T09:04:11.766581+0000","last_became_active":"2024-04-25T09:04:10.449123+0000","last_became_peered":"2024-04-25T09:04:10.449123+0000","last_unstale":"2024-04-25T09:04:11.766581+0000","last_undegraded":"2024-04-25T09:04:11.766581+0000","last_fullsized":"2024-04-25T09:04:11.766581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:59.964799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.453952+0000","last_change":"2024-04-25T09:04:10.448367+0000","last_active":"2024-04-25T09:04:10.453952+0000","last_peered":"2024-04-25T09:04:10.453952+0000","last_clean":"2024-04-25T09:04:10.453952+0000","last_became_active":"2024-04-25T09:04:10.448103+0000","last_became_peered":"2024-04-25T09:04:10.448103+0000","last_unstale":"2024-04-25T09:04:10.453952+0000","last_undegraded":"2024-04-25T09:04:10.453952+0000","last_fullsized":"2024-04-25T09:04:10.453952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:50.475565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453172+0000","last_change":"2024-04-25T09:04:10.461500+0000","last_active":"2024-04-25T09:04:11.453172+0000","last_peered":"2024-04-25T09:04:11.453172+0000","last_clean":"2024-04-25T09:04:11.453172+0000","last_became_active":"2024-04-25T09:04:10.461218+0000","last_became_peered":"2024-04-25T09:04:10.461218+0000","last_unstale":"2024-04-25T09:04:11.453172+0000","last_undegraded":"2024-04-25T09:04:11.453172+0000","last_fullsized":"2024-04-25T09:04:11.453172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:06.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.469088+0000","last_change":"2024-04-25T09:04:10.465078+0000","last_active":"2024-04-25T09:04:10.469088+0000","last_peered":"2024-04-25T09:04:10.469088+0000","last_clean":"2024-04-25T09:04:10.469088+0000","last_became_active":"2024-04-25T09:04:10.464292+0000","last_became_peered":"2024-04-25T09:04:10.464292+0000","last_unstale":"2024-04-25T09:04:10.469088+0000","last_undegraded":"2024-04-25T09:04:10.469088+0000","last_fullsized":"2024-04-25T09:04:10.469088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:35.448558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.469493+0000","last_change":"2024-04-25T09:04:10.465873+0000","last_active":"2024-04-25T09:04:10.469493+0000","last_peered":"2024-04-25T09:04:10.469493+0000","last_clean":"2024-04-25T09:04:10.469493+0000","last_became_active":"2024-04-25T09:04:10.465139+0000","last_became_peered":"2024-04-25T09:04:10.465139+0000","last_unstale":"2024-04-25T09:04:10.469493+0000","last_undegraded":"2024-04-25T09:04:10.469493+0000","last_fullsized":"2024-04-25T09:04:10.469493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:21.063821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437157+0000","last_change":"2024-04-25T09:04:10.457277+0000","last_active":"2024-04-25T09:04:12.437157+0000","last_peered":"2024-04-25T09:04:12.437157+0000","last_clean":"2024-04-25T09:04:12.437157+0000","last_became_active":"2024-04-25T09:04:10.456983+0000","last_became_peered":"2024-04-25T09:04:10.456983+0000","last_unstale":"2024-04-25T09:04:12.437157+0000","last_undegraded":"2024-04-25T09:04:12.437157+0000","last_fullsized":"2024-04-25T09:04:12.437157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:17.359486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491405+0000","last_change":"2024-04-25T09:04:10.467087+0000","last_active":"2024-04-25T09:04:12.491405+0000","last_peered":"2024-04-25T09:04:12.491405+0000","last_clean":"2024-04-25T09:04:12.491405+0000","last_became_active":"2024-04-25T09:04:10.466783+0000","last_became_peered":"2024-04-25T09:04:10.466783+0000","last_unstale":"2024-04-25T09:04:12.491405+0000","last_undegraded":"2024-04-25T09:04:12.491405+0000","last_fullsized":"2024-04-25T09:04:12.491405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:15.921248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453460+0000","last_change":"2024-04-25T09:04:10.458537+0000","last_active":"2024-04-25T09:04:11.453460+0000","last_peered":"2024-04-25T09:04:11.453460+0000","last_clean":"2024-04-25T09:04:11.453460+0000","last_became_active":"2024-04-25T09:04:10.458180+0000","last_became_peered":"2024-04-25T09:04:10.458180+0000","last_unstale":"2024-04-25T09:04:11.453460+0000","last_undegraded":"2024-04-25T09:04:11.453460+0000","last_fullsized":"2024-04-25T09:04:11.453460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:47.704816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.462728+0000","last_change":"2024-04-25T09:04:10.458711+0000","last_active":"2024-04-25T09:04:10.462728+0000","last_peered":"2024-04-25T09:04:10.462728+0000","last_clean":"2024-04-25T09:04:10.462728+0000","last_became_active":"2024-04-25T09:04:10.458450+0000","last_became_peered":"2024-04-25T09:04:10.458450+0000","last_unstale":"2024-04-25T09:04:10.462728+0000","last_undegraded":"2024-04-25T09:04:10.462728+0000","last_fullsized":"2024-04-25T09:04:10.462728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.228938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.464507+0000","last_change":"2024-04-25T09:04:10.455142+0000","last_active":"2024-04-25T09:04:10.464507+0000","last_peered":"2024-04-25T09:04:10.464507+0000","last_clean":"2024-04-25T09:04:10.464507+0000","last_became_active":"2024-04-25T09:04:10.454776+0000","last_became_peered":"2024-04-25T09:04:10.454776+0000","last_unstale":"2024-04-25T09:04:10.464507+0000","last_undegraded":"2024-04-25T09:04:10.464507+0000","last_fullsized":"2024-04-25T09:04:10.464507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.228938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766510+0000","last_change":"2024-04-25T09:04:10.462091+0000","last_active":"2024-04-25T09:04:11.766510+0000","last_peered":"2024-04-25T09:04:11.766510+0000","last_clean":"2024-04-25T09:04:11.766510+0000","last_became_active":"2024-04-25T09:04:10.460956+0000","last_became_peered":"2024-04-25T09:04:10.460956+0000","last_unstale":"2024-04-25T09:04:11.766510+0000","last_undegraded":"2024-04-25T09:04:11.766510+0000","last_fullsized":"2024-04-25T09:04:11.766510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:03.161885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.466339+0000","last_change":"2024-04-25T09:04:10.456817+0000","last_active":"2024-04-25T09:04:10.466339+0000","last_peered":"2024-04-25T09:04:10.466339+0000","last_clean":"2024-04-25T09:04:10.466339+0000","last_became_active":"2024-04-25T09:04:10.456515+0000","last_became_peered":"2024-04-25T09:04:10.456515+0000","last_unstale":"2024-04-25T09:04:10.466339+0000","last_undegraded":"2024-04-25T09:04:10.466339+0000","last_fullsized":"2024-04-25T09:04:10.466339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:17.359486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766945+0000","last_change":"2024-04-25T09:04:10.467130+0000","last_active":"2024-04-25T09:04:11.766945+0000","last_peered":"2024-04-25T09:04:11.766945+0000","last_clean":"2024-04-25T09:04:11.766945+0000","last_became_active":"2024-04-25T09:04:10.466843+0000","last_became_peered":"2024-04-25T09:04:10.466843+0000","last_unstale":"2024-04-25T09:04:11.766945+0000","last_undegraded":"2024-04-25T09:04:11.766945+0000","last_fullsized":"2024-04-25T09:04:11.766945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:38.453486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454457+0000","last_change":"2024-04-25T09:04:10.461159+0000","last_active":"2024-04-25T09:04:11.454457+0000","last_peered":"2024-04-25T09:04:11.454457+0000","last_clean":"2024-04-25T09:04:11.454457+0000","last_became_active":"2024-04-25T09:04:10.460871+0000","last_became_peered":"2024-04-25T09:04:10.460871+0000","last_unstale":"2024-04-25T09:04:11.454457+0000","last_undegraded":"2024-04-25T09:04:11.454457+0000","last_fullsized":"2024-04-25T09:04:11.454457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:59.964799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453551+0000","last_change":"2024-04-25T09:04:10.462566+0000","last_active":"2024-04-25T09:04:11.453551+0000","last_peered":"2024-04-25T09:04:11.453551+0000","last_clean":"2024-04-25T09:04:11.453551+0000","last_became_active":"2024-04-25T09:04:10.461856+0000","last_became_peered":"2024-04-25T09:04:10.461856+0000","last_unstale":"2024-04-25T09:04:11.453551+0000","last_undegraded":"2024-04-25T09:04:11.453551+0000","last_fullsized":"2024-04-25T09:04:11.453551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:10.572493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766880+0000","last_change":"2024-04-25T09:04:10.461850+0000","last_active":"2024-04-25T09:04:11.766880+0000","last_peered":"2024-04-25T09:04:11.766880+0000","last_clean":"2024-04-25T09:04:11.766880+0000","last_became_active":"2024-04-25T09:04:10.460707+0000","last_became_peered":"2024-04-25T09:04:10.460707+0000","last_unstale":"2024-04-25T09:04:11.766880+0000","last_undegraded":"2024-04-25T09:04:11.766880+0000","last_fullsized":"2024-04-25T09:04:11.766880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:25.970653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.467599+0000","last_change":"2024-04-25T09:04:10.464541+0000","last_active":"2024-04-25T09:04:10.467599+0000","last_peered":"2024-04-25T09:04:10.467599+0000","last_clean":"2024-04-25T09:04:10.467599+0000","last_became_active":"2024-04-25T09:04:10.464252+0000","last_became_peered":"2024-04-25T09:04:10.464252+0000","last_unstale":"2024-04-25T09:04:10.467599+0000","last_undegraded":"2024-04-25T09:04:10.467599+0000","last_fullsized":"2024-04-25T09:04:10.467599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:35.448558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.469063+0000","last_change":"2024-04-25T09:04:10.465260+0000","last_active":"2024-04-25T09:04:10.469063+0000","last_peered":"2024-04-25T09:04:10.469063+0000","last_clean":"2024-04-25T09:04:10.469063+0000","last_became_active":"2024-04-25T09:04:10.464698+0000","last_became_peered":"2024-04-25T09:04:10.464698+0000","last_unstale":"2024-04-25T09:04:10.469063+0000","last_undegraded":"2024-04-25T09:04:10.469063+0000","last_fullsized":"2024-04-25T09:04:10.469063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:24.135986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437050+0000","last_change":"2024-04-25T09:04:10.455699+0000","last_active":"2024-04-25T09:04:12.437050+0000","last_peered":"2024-04-25T09:04:12.437050+0000","last_clean":"2024-04-25T09:04:12.437050+0000","last_became_active":"2024-04-25T09:04:10.455417+0000","last_became_peered":"2024-04-25T09:04:10.455417+0000","last_unstale":"2024-04-25T09:04:12.437050+0000","last_undegraded":"2024-04-25T09:04:12.437050+0000","last_fullsized":"2024-04-25T09:04:12.437050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.228938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453241+0000","last_change":"2024-04-25T09:04:10.451620+0000","last_active":"2024-04-25T09:04:11.453241+0000","last_peered":"2024-04-25T09:04:11.453241+0000","last_clean":"2024-04-25T09:04:11.453241+0000","last_became_active":"2024-04-25T09:04:10.451273+0000","last_became_peered":"2024-04-25T09:04:10.451273+0000","last_unstale":"2024-04-25T09:04:11.453241+0000","last_undegraded":"2024-04-25T09:04:11.453241+0000","last_fullsized":"2024-04-25T09:04:11.453241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:12.826732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453920+0000","last_change":"2024-04-25T09:04:10.449559+0000","last_active":"2024-04-25T09:04:11.453920+0000","last_peered":"2024-04-25T09:04:11.453920+0000","last_clean":"2024-04-25T09:04:11.453920+0000","last_became_active":"2024-04-25T09:04:10.448300+0000","last_became_peered":"2024-04-25T09:04:10.448300+0000","last_unstale":"2024-04-25T09:04:11.453920+0000","last_undegraded":"2024-04-25T09:04:11.453920+0000","last_fullsized":"2024-04-25T09:04:11.453920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:46.591632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766688+0000","last_change":"2024-04-25T09:04:09.443692+0000","last_active":"2024-04-25T09:04:11.766688+0000","last_peered":"2024-04-25T09:04:11.766688+0000","last_clean":"2024-04-25T09:04:11.766688+0000","last_became_active":"2024-04-25T09:04:09.443223+0000","last_became_peered":"2024-04-25T09:04:09.443223+0000","last_unstale":"2024-04-25T09:04:11.766688+0000","last_undegraded":"2024-04-25T09:04:11.766688+0000","last_fullsized":"2024-04-25T09:04:11.766688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:52.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.453826+0000","last_change":"2024-04-25T09:04:10.445977+0000","last_active":"2024-04-25T09:04:10.453826+0000","last_peered":"2024-04-25T09:04:10.453826+0000","last_clean":"2024-04-25T09:04:10.453826+0000","last_became_active":"2024-04-25T09:04:10.445685+0000","last_became_peered":"2024-04-25T09:04:10.445685+0000","last_unstale":"2024-04-25T09:04:10.453826+0000","last_undegraded":"2024-04-25T09:04:10.453826+0000","last_fullsized":"2024-04-25T09:04:10.453826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:53.473022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453359+0000","last_change":"2024-04-25T09:04:09.428583+0000","last_active":"2024-04-25T09:04:11.453359+0000","last_peered":"2024-04-25T09:04:11.453359+0000","last_clean":"2024-04-25T09:04:11.453359+0000","last_became_active":"2024-04-25T09:04:09.428043+0000","last_became_peered":"2024-04-25T09:04:09.428043+0000","last_unstale":"2024-04-25T09:04:11.453359+0000","last_undegraded":"2024-04-25T09:04:11.453359+0000","last_fullsized":"2024-04-25T09:04:11.453359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766378+0000","last_change":"2024-04-25T09:04:09.440384+0000","last_active":"2024-04-25T09:04:11.766378+0000","last_peered":"2024-04-25T09:04:11.766378+0000","last_clean":"2024-04-25T09:04:11.766378+0000","last_became_active":"2024-04-25T09:04:09.439952+0000","last_became_peered":"2024-04-25T09:04:09.439952+0000","last_unstale":"2024-04-25T09:04:11.766378+0000","last_undegraded":"2024-04-25T09:04:11.766378+0000","last_fullsized":"2024-04-25T09:04:11.766378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:59.824337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766347+0000","last_change":"2024-04-25T09:04:10.455692+0000","last_active":"2024-04-25T09:04:11.766347+0000","last_peered":"2024-04-25T09:04:11.766347+0000","last_clean":"2024-04-25T09:04:11.766347+0000","last_became_active":"2024-04-25T09:04:10.455212+0000","last_became_peered":"2024-04-25T09:04:10.455212+0000","last_unstale":"2024-04-25T09:04:11.766347+0000","last_undegraded":"2024-04-25T09:04:11.766347+0000","last_fullsized":"2024-04-25T09:04:11.766347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:47.704816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.443581+0000","last_change":"2024-04-25T09:04:09.438700+0000","last_active":"2024-04-25T09:04:10.443581+0000","last_peered":"2024-04-25T09:04:10.443581+0000","last_clean":"2024-04-25T09:04:10.443581+0000","last_became_active":"2024-04-25T09:04:09.438424+0000","last_became_peered":"2024-04-25T09:04:09.438424+0000","last_unstale":"2024-04-25T09:04:10.443581+0000","last_undegraded":"2024-04-25T09:04:10.443581+0000","last_fullsized":"2024-04-25T09:04:10.443581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:52.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453190+0000","last_change":"2024-04-25T09:04:10.455298+0000","last_active":"2024-04-25T09:04:11.453190+0000","last_peered":"2024-04-25T09:04:11.453190+0000","last_clean":"2024-04-25T09:04:11.453190+0000","last_became_active":"2024-04-25T09:04:10.455044+0000","last_became_peered":"2024-04-25T09:04:10.455044+0000","last_unstale":"2024-04-25T09:04:11.453190+0000","last_undegraded":"2024-04-25T09:04:11.453190+0000","last_fullsized":"2024-04-25T09:04:11.453190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:47.704816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454284+0000","last_change":"2024-04-25T09:04:09.441197+0000","last_active":"2024-04-25T09:04:11.454284+0000","last_peered":"2024-04-25T09:04:11.454284+0000","last_clean":"2024-04-25T09:04:11.454284+0000","last_became_active":"2024-04-25T09:04:09.440752+0000","last_became_peered":"2024-04-25T09:04:09.440752+0000","last_unstale":"2024-04-25T09:04:11.454284+0000","last_undegraded":"2024-04-25T09:04:11.454284+0000","last_fullsized":"2024-04-25T09:04:11.454284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:52.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.470124+0000","last_change":"2024-04-25T09:04:10.466060+0000","last_active":"2024-04-25T09:04:10.470124+0000","last_peered":"2024-04-25T09:04:10.470124+0000","last_clean":"2024-04-25T09:04:10.470124+0000","last_became_active":"2024-04-25T09:04:10.465550+0000","last_became_peered":"2024-04-25T09:04:10.465550+0000","last_unstale":"2024-04-25T09:04:10.470124+0000","last_undegraded":"2024-04-25T09:04:10.470124+0000","last_fullsized":"2024-04-25T09:04:10.470124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:44.285991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.444796+0000","last_change":"2024-04-25T09:04:09.444181+0000","last_active":"2024-04-25T09:04:10.444796+0000","last_peered":"2024-04-25T09:04:10.444796+0000","last_clean":"2024-04-25T09:04:10.444796+0000","last_became_active":"2024-04-25T09:04:09.443601+0000","last_became_peered":"2024-04-25T09:04:09.443601+0000","last_unstale":"2024-04-25T09:04:10.444796+0000","last_undegraded":"2024-04-25T09:04:10.444796+0000","last_fullsized":"2024-04-25T09:04:10.444796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:23.622773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.459492+0000","last_change":"2024-04-25T09:04:10.451240+0000","last_active":"2024-04-25T09:04:10.459492+0000","last_peered":"2024-04-25T09:04:10.459492+0000","last_clean":"2024-04-25T09:04:10.459492+0000","last_became_active":"2024-04-25T09:04:10.451065+0000","last_became_peered":"2024-04-25T09:04:10.451065+0000","last_unstale":"2024-04-25T09:04:10.459492+0000","last_undegraded":"2024-04-25T09:04:10.459492+0000","last_fullsized":"2024-04-25T09:04:10.459492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:12.563435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453491+0000","last_change":"2024-04-25T09:04:09.441559+0000","last_active":"2024-04-25T09:04:11.453491+0000","last_peered":"2024-04-25T09:04:11.453491+0000","last_clean":"2024-04-25T09:04:11.453491+0000","last_became_active":"2024-04-25T09:04:09.441288+0000","last_became_peered":"2024-04-25T09:04:09.441288+0000","last_unstale":"2024-04-25T09:04:11.453491+0000","last_undegraded":"2024-04-25T09:04:11.453491+0000","last_fullsized":"2024-04-25T09:04:11.453491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454256+0000","last_change":"2024-04-25T09:04:10.460810+0000","last_active":"2024-04-25T09:04:11.454256+0000","last_peered":"2024-04-25T09:04:11.454256+0000","last_clean":"2024-04-25T09:04:11.454256+0000","last_became_active":"2024-04-25T09:04:10.458726+0000","last_became_peered":"2024-04-25T09:04:10.458726+0000","last_unstale":"2024-04-25T09:04:11.454256+0000","last_undegraded":"2024-04-25T09:04:11.454256+0000","last_fullsized":"2024-04-25T09:04:11.454256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.228938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453432+0000","last_change":"2024-04-25T09:04:09.436321+0000","last_active":"2024-04-25T09:04:11.453432+0000","last_peered":"2024-04-25T09:04:11.453432+0000","last_clean":"2024-04-25T09:04:11.453432+0000","last_became_active":"2024-04-25T09:04:09.435708+0000","last_became_peered":"2024-04-25T09:04:09.435708+0000","last_unstale":"2024-04-25T09:04:11.453432+0000","last_undegraded":"2024-04-25T09:04:11.453432+0000","last_fullsized":"2024-04-25T09:04:11.453432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:23.622773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491036+0000","last_change":"2024-04-25T09:04:10.469991+0000","last_active":"2024-04-25T09:04:12.491036+0000","last_peered":"2024-04-25T09:04:12.491036+0000","last_clean":"2024-04-25T09:04:12.491036+0000","last_became_active":"2024-04-25T09:04:10.469673+0000","last_became_peered":"2024-04-25T09:04:10.469673+0000","last_unstale":"2024-04-25T09:04:12.491036+0000","last_undegraded":"2024-04-25T09:04:12.491036+0000","last_fullsized":"2024-04-25T09:04:12.491036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:25.970653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.469764+0000","last_change":"2024-04-25T09:04:09.445342+0000","last_active":"2024-04-25T09:04:10.469764+0000","last_peered":"2024-04-25T09:04:10.469764+0000","last_clean":"2024-04-25T09:04:10.469764+0000","last_became_active":"2024-04-25T09:04:09.445036+0000","last_became_peered":"2024-04-25T09:04:09.445036+0000","last_unstale":"2024-04-25T09:04:10.469764+0000","last_undegraded":"2024-04-25T09:04:10.469764+0000","last_fullsized":"2024-04-25T09:04:10.469764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:42.962745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.465777+0000","last_change":"2024-04-25T09:04:10.460039+0000","last_active":"2024-04-25T09:04:10.465777+0000","last_peered":"2024-04-25T09:04:10.465777+0000","last_clean":"2024-04-25T09:04:10.465777+0000","last_became_active":"2024-04-25T09:04:10.459802+0000","last_became_peered":"2024-04-25T09:04:10.459802+0000","last_unstale":"2024-04-25T09:04:10.465777+0000","last_undegraded":"2024-04-25T09:04:10.465777+0000","last_fullsized":"2024-04-25T09:04:10.465777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:17.359486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.443824+0000","last_change":"2024-04-25T09:04:09.448990+0000","last_active":"2024-04-25T09:04:10.443824+0000","last_peered":"2024-04-25T09:04:10.443824+0000","last_clean":"2024-04-25T09:04:10.443824+0000","last_became_active":"2024-04-25T09:04:09.447328+0000","last_became_peered":"2024-04-25T09:04:09.447328+0000","last_unstale":"2024-04-25T09:04:10.443824+0000","last_undegraded":"2024-04-25T09:04:10.443824+0000","last_fullsized":"2024-04-25T09:04:10.443824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491268+0000","last_change":"2024-04-25T09:04:10.470501+0000","last_active":"2024-04-25T09:04:12.491268+0000","last_peered":"2024-04-25T09:04:12.491268+0000","last_clean":"2024-04-25T09:04:12.491268+0000","last_became_active":"2024-04-25T09:04:10.470149+0000","last_became_peered":"2024-04-25T09:04:10.470149+0000","last_unstale":"2024-04-25T09:04:12.491268+0000","last_undegraded":"2024-04-25T09:04:12.491268+0000","last_fullsized":"2024-04-25T09:04:12.491268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:38.453486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453361+0000","last_change":"2024-04-25T09:04:09.428421+0000","last_active":"2024-04-25T09:04:11.453361+0000","last_peered":"2024-04-25T09:04:11.453361+0000","last_clean":"2024-04-25T09:04:11.453361+0000","last_became_active":"2024-04-25T09:04:09.428088+0000","last_became_peered":"2024-04-25T09:04:09.428088+0000","last_unstale":"2024-04-25T09:04:11.453361+0000","last_undegraded":"2024-04-25T09:04:11.453361+0000","last_fullsized":"2024-04-25T09:04:11.453361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:11.557908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454070+0000","last_change":"2024-04-25T09:04:10.452284+0000","last_active":"2024-04-25T09:04:11.454070+0000","last_peered":"2024-04-25T09:04:11.454070+0000","last_clean":"2024-04-25T09:04:11.454070+0000","last_became_active":"2024-04-25T09:04:10.451470+0000","last_became_peered":"2024-04-25T09:04:10.451470+0000","last_unstale":"2024-04-25T09:04:11.454070+0000","last_undegraded":"2024-04-25T09:04:11.454070+0000","last_fullsized":"2024-04-25T09:04:11.454070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:36.421524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437004+0000","last_change":"2024-04-25T09:04:09.437062+0000","last_active":"2024-04-25T09:04:12.437004+0000","last_peered":"2024-04-25T09:04:12.437004+0000","last_clean":"2024-04-25T09:04:12.437004+0000","last_became_active":"2024-04-25T09:04:09.436793+0000","last_became_peered":"2024-04-25T09:04:09.436793+0000","last_unstale":"2024-04-25T09:04:12.437004+0000","last_undegraded":"2024-04-25T09:04:12.437004+0000","last_fullsized":"2024-04-25T09:04:12.437004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.490890+0000","last_change":"2024-04-25T09:04:10.462986+0000","last_active":"2024-04-25T09:04:12.490890+0000","last_peered":"2024-04-25T09:04:12.490890+0000","last_clean":"2024-04-25T09:04:12.490890+0000","last_became_active":"2024-04-25T09:04:10.462639+0000","last_became_peered":"2024-04-25T09:04:10.462639+0000","last_unstale":"2024-04-25T09:04:12.490890+0000","last_undegraded":"2024-04-25T09:04:12.490890+0000","last_fullsized":"2024-04-25T09:04:12.490890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.022253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454237+0000","last_change":"2024-04-25T09:04:09.435053+0000","last_active":"2024-04-25T09:04:11.454237+0000","last_peered":"2024-04-25T09:04:11.454237+0000","last_clean":"2024-04-25T09:04:11.454237+0000","last_became_active":"2024-04-25T09:04:09.434661+0000","last_became_peered":"2024-04-25T09:04:09.434661+0000","last_unstale":"2024-04-25T09:04:11.454237+0000","last_undegraded":"2024-04-25T09:04:11.454237+0000","last_fullsized":"2024-04-25T09:04:11.454237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:50.779717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491308+0000","last_change":"2024-04-25T09:04:10.472088+0000","last_active":"2024-04-25T09:04:12.491308+0000","last_peered":"2024-04-25T09:04:12.491308+0000","last_clean":"2024-04-25T09:04:12.491308+0000","last_became_active":"2024-04-25T09:04:10.471765+0000","last_became_peered":"2024-04-25T09:04:10.471765+0000","last_unstale":"2024-04-25T09:04:12.491308+0000","last_undegraded":"2024-04-25T09:04:12.491308+0000","last_fullsized":"2024-04-25T09:04:12.491308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:56.330375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437211+0000","last_change":"2024-04-25T09:04:09.444431+0000","last_active":"2024-04-25T09:04:12.437211+0000","last_peered":"2024-04-25T09:04:12.437211+0000","last_clean":"2024-04-25T09:04:12.437211+0000","last_became_active":"2024-04-25T09:04:09.444192+0000","last_became_peered":"2024-04-25T09:04:09.444192+0000","last_unstale":"2024-04-25T09:04:12.437211+0000","last_undegraded":"2024-04-25T09:04:12.437211+0000","last_fullsized":"2024-04-25T09:04:12.437211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491563+0000","last_change":"2024-04-25T09:04:10.472130+0000","last_active":"2024-04-25T09:04:12.491563+0000","last_peered":"2024-04-25T09:04:12.491563+0000","last_clean":"2024-04-25T09:04:12.491563+0000","last_became_active":"2024-04-25T09:04:10.471819+0000","last_became_peered":"2024-04-25T09:04:10.471819+0000","last_unstale":"2024-04-25T09:04:12.491563+0000","last_undegraded":"2024-04-25T09:04:12.491563+0000","last_fullsized":"2024-04-25T09:04:12.491563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:08.225883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453585+0000","last_change":"2024-04-25T09:04:09.435777+0000","last_active":"2024-04-25T09:04:11.453585+0000","last_peered":"2024-04-25T09:04:11.453585+0000","last_clean":"2024-04-25T09:04:11.453585+0000","last_became_active":"2024-04-25T09:04:09.433156+0000","last_became_peered":"2024-04-25T09:04:09.433156+0000","last_unstale":"2024-04-25T09:04:11.453585+0000","last_undegraded":"2024-04-25T09:04:11.453585+0000","last_fullsized":"2024-04-25T09:04:11.453585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:11.557908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.470795+0000","last_change":"2024-04-25T09:04:10.467199+0000","last_active":"2024-04-25T09:04:10.470795+0000","last_peered":"2024-04-25T09:04:10.470795+0000","last_clean":"2024-04-25T09:04:10.470795+0000","last_became_active":"2024-04-25T09:04:10.466426+0000","last_became_peered":"2024-04-25T09:04:10.466426+0000","last_unstale":"2024-04-25T09:04:10.470795+0000","last_undegraded":"2024-04-25T09:04:10.470795+0000","last_fullsized":"2024-04-25T09:04:10.470795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:06.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437060+0000","last_change":"2024-04-25T09:04:09.438805+0000","last_active":"2024-04-25T09:04:12.437060+0000","last_peered":"2024-04-25T09:04:12.437060+0000","last_clean":"2024-04-25T09:04:12.437060+0000","last_became_active":"2024-04-25T09:04:09.438519+0000","last_became_peered":"2024-04-25T09:04:09.438519+0000","last_unstale":"2024-04-25T09:04:12.437060+0000","last_undegraded":"2024-04-25T09:04:12.437060+0000","last_fullsized":"2024-04-25T09:04:12.437060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:52.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491190+0000","last_change":"2024-04-25T09:04:10.467799+0000","last_active":"2024-04-25T09:04:12.491190+0000","last_peered":"2024-04-25T09:04:12.491190+0000","last_clean":"2024-04-25T09:04:12.491190+0000","last_became_active":"2024-04-25T09:04:10.467524+0000","last_became_peered":"2024-04-25T09:04:10.467524+0000","last_unstale":"2024-04-25T09:04:12.491190+0000","last_undegraded":"2024-04-25T09:04:12.491190+0000","last_fullsized":"2024-04-25T09:04:12.491190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:59.917069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.490943+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:04:12.490943+0000","last_peered":"2024-04-25T09:04:12.490943+0000","last_clean":"2024-04-25T09:04:12.490943+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:04:12.490943+0000","last_undegraded":"2024-04-25T09:04:12.490943+0000","last_fullsized":"2024-04-25T09:04:12.490943+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.443736+0000","last_change":"2024-04-25T09:04:09.443155+0000","last_active":"2024-04-25T09:04:10.443736+0000","last_peered":"2024-04-25T09:04:10.443736+0000","last_clean":"2024-04-25T09:04:10.443736+0000","last_became_active":"2024-04-25T09:04:09.441937+0000","last_became_peered":"2024-04-25T09:04:09.441937+0000","last_unstale":"2024-04-25T09:04:10.443736+0000","last_undegraded":"2024-04-25T09:04:10.443736+0000","last_fullsized":"2024-04-25T09:04:10.443736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766523+0000","last_change":"2024-04-25T09:04:10.455462+0000","last_active":"2024-04-25T09:04:11.766523+0000","last_peered":"2024-04-25T09:04:11.766523+0000","last_clean":"2024-04-25T09:04:11.766523+0000","last_became_active":"2024-04-25T09:04:10.455118+0000","last_became_peered":"2024-04-25T09:04:10.455118+0000","last_unstale":"2024-04-25T09:04:11.766523+0000","last_undegraded":"2024-04-25T09:04:11.766523+0000","last_fullsized":"2024-04-25T09:04:11.766523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:10.572493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.490794+0000","last_change":"2024-04-25T09:04:09.446062+0000","last_active":"2024-04-25T09:04:12.490794+0000","last_peered":"2024-04-25T09:04:12.490794+0000","last_clean":"2024-04-25T09:04:12.490794+0000","last_became_active":"2024-04-25T09:04:09.445786+0000","last_became_peered":"2024-04-25T09:04:09.445786+0000","last_unstale":"2024-04-25T09:04:12.490794+0000","last_undegraded":"2024-04-25T09:04:12.490794+0000","last_fullsized":"2024-04-25T09:04:12.490794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.453794+0000","last_change":"2024-04-25T09:04:10.444069+0000","last_active":"2024-04-25T09:04:10.453794+0000","last_peered":"2024-04-25T09:04:10.453794+0000","last_clean":"2024-04-25T09:04:10.453794+0000","last_became_active":"2024-04-25T09:04:10.443785+0000","last_became_peered":"2024-04-25T09:04:10.443785+0000","last_unstale":"2024-04-25T09:04:10.453794+0000","last_undegraded":"2024-04-25T09:04:10.453794+0000","last_fullsized":"2024-04-25T09:04:10.453794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:00.829864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437094+0000","last_change":"2024-04-25T09:04:09.434207+0000","last_active":"2024-04-25T09:04:12.437094+0000","last_peered":"2024-04-25T09:04:12.437094+0000","last_clean":"2024-04-25T09:04:12.437094+0000","last_became_active":"2024-04-25T09:04:09.433751+0000","last_became_peered":"2024-04-25T09:04:09.433751+0000","last_unstale":"2024-04-25T09:04:12.437094+0000","last_undegraded":"2024-04-25T09:04:12.437094+0000","last_fullsized":"2024-04-25T09:04:12.437094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:59.824337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453395+0000","last_change":"2024-04-25T09:04:10.460017+0000","last_active":"2024-04-25T09:04:11.453395+0000","last_peered":"2024-04-25T09:04:11.453395+0000","last_clean":"2024-04-25T09:04:11.453395+0000","last_became_active":"2024-04-25T09:04:10.459722+0000","last_became_peered":"2024-04-25T09:04:10.459722+0000","last_unstale":"2024-04-25T09:04:11.453395+0000","last_undegraded":"2024-04-25T09:04:11.453395+0000","last_fullsized":"2024-04-25T09:04:11.453395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:03.161885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.443958+0000","last_change":"2024-04-25T09:04:09.445889+0000","last_active":"2024-04-25T09:04:10.443958+0000","last_peered":"2024-04-25T09:04:10.443958+0000","last_clean":"2024-04-25T09:04:10.443958+0000","last_became_active":"2024-04-25T09:04:09.445008+0000","last_became_peered":"2024-04-25T09:04:09.445008+0000","last_unstale":"2024-04-25T09:04:10.443958+0000","last_undegraded":"2024-04-25T09:04:10.443958+0000","last_fullsized":"2024-04-25T09:04:10.443958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:11.557908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453904+0000","last_change":"2024-04-25T09:04:10.457749+0000","last_active":"2024-04-25T09:04:11.453904+0000","last_peered":"2024-04-25T09:04:11.453904+0000","last_clean":"2024-04-25T09:04:11.453904+0000","last_became_active":"2024-04-25T09:04:10.454687+0000","last_became_peered":"2024-04-25T09:04:10.454687+0000","last_unstale":"2024-04-25T09:04:11.453904+0000","last_undegraded":"2024-04-25T09:04:11.453904+0000","last_fullsized":"2024-04-25T09:04:11.453904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:12.563435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453313+0000","last_change":"2024-04-25T09:04:09.448524+0000","last_active":"2024-04-25T09:04:11.453313+0000","last_peered":"2024-04-25T09:04:11.453313+0000","last_clean":"2024-04-25T09:04:11.453313+0000","last_became_active":"2024-04-25T09:04:09.448200+0000","last_became_peered":"2024-04-25T09:04:09.448200+0000","last_unstale":"2024-04-25T09:04:11.453313+0000","last_undegraded":"2024-04-25T09:04:11.453313+0000","last_fullsized":"2024-04-25T09:04:11.453313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.470516+0000","last_change":"2024-04-25T09:04:10.466591+0000","last_active":"2024-04-25T09:04:10.470516+0000","last_peered":"2024-04-25T09:04:10.470516+0000","last_clean":"2024-04-25T09:04:10.470516+0000","last_became_active":"2024-04-25T09:04:10.466280+0000","last_became_peered":"2024-04-25T09:04:10.466280+0000","last_unstale":"2024-04-25T09:04:10.470516+0000","last_undegraded":"2024-04-25T09:04:10.470516+0000","last_fullsized":"2024-04-25T09:04:10.470516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:12.826732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491422+0000","last_change":"2024-04-25T09:04:09.450624+0000","last_active":"2024-04-25T09:04:12.491422+0000","last_peered":"2024-04-25T09:04:12.491422+0000","last_clean":"2024-04-25T09:04:12.491422+0000","last_became_active":"2024-04-25T09:04:09.450247+0000","last_became_peered":"2024-04-25T09:04:09.450247+0000","last_unstale":"2024-04-25T09:04:12.491422+0000","last_undegraded":"2024-04-25T09:04:12.491422+0000","last_fullsized":"2024-04-25T09:04:12.491422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:06.223411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453226+0000","last_change":"2024-04-25T09:04:10.456100+0000","last_active":"2024-04-25T09:04:11.453226+0000","last_peered":"2024-04-25T09:04:11.453226+0000","last_clean":"2024-04-25T09:04:11.453226+0000","last_became_active":"2024-04-25T09:04:10.455713+0000","last_became_peered":"2024-04-25T09:04:10.455713+0000","last_unstale":"2024-04-25T09:04:11.453226+0000","last_undegraded":"2024-04-25T09:04:11.453226+0000","last_fullsized":"2024-04-25T09:04:11.453226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:36.421524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.435073+0000","last_change":"2024-04-25T09:04:09.440316+0000","last_active":"2024-04-25T09:04:12.435073+0000","last_peered":"2024-04-25T09:04:12.435073+0000","last_clean":"2024-04-25T09:04:12.435073+0000","last_became_active":"2024-04-25T09:04:09.437292+0000","last_became_peered":"2024-04-25T09:04:09.437292+0000","last_unstale":"2024-04-25T09:04:12.435073+0000","last_undegraded":"2024-04-25T09:04:12.435073+0000","last_fullsized":"2024-04-25T09:04:12.435073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.586105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766908+0000","last_change":"2024-04-25T09:04:10.459918+0000","last_active":"2024-04-25T09:04:11.766908+0000","last_peered":"2024-04-25T09:04:11.766908+0000","last_clean":"2024-04-25T09:04:11.766908+0000","last_became_active":"2024-04-25T09:04:10.459598+0000","last_became_peered":"2024-04-25T09:04:10.459598+0000","last_unstale":"2024-04-25T09:04:11.766908+0000","last_undegraded":"2024-04-25T09:04:11.766908+0000","last_fullsized":"2024-04-25T09:04:11.766908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:59.917069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454406+0000","last_change":"2024-04-25T09:04:09.447004+0000","last_active":"2024-04-25T09:04:11.454406+0000","last_peered":"2024-04-25T09:04:11.454406+0000","last_clean":"2024-04-25T09:04:11.454406+0000","last_became_active":"2024-04-25T09:04:09.446720+0000","last_became_peered":"2024-04-25T09:04:09.446720+0000","last_unstale":"2024-04-25T09:04:11.454406+0000","last_undegraded":"2024-04-25T09:04:11.454406+0000","last_fullsized":"2024-04-25T09:04:11.454406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.453982+0000","last_change":"2024-04-25T09:04:10.448395+0000","last_active":"2024-04-25T09:04:10.453982+0000","last_peered":"2024-04-25T09:04:10.453982+0000","last_clean":"2024-04-25T09:04:10.453982+0000","last_became_active":"2024-04-25T09:04:10.448092+0000","last_became_peered":"2024-04-25T09:04:10.448092+0000","last_unstale":"2024-04-25T09:04:10.453982+0000","last_undegraded":"2024-04-25T09:04:10.453982+0000","last_fullsized":"2024-04-25T09:04:10.453982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:33.347350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491035+0000","last_change":"2024-04-25T09:04:09.450871+0000","last_active":"2024-04-25T09:04:12.491035+0000","last_peered":"2024-04-25T09:04:12.491035+0000","last_clean":"2024-04-25T09:04:12.491035+0000","last_became_active":"2024-04-25T09:04:09.450420+0000","last_became_peered":"2024-04-25T09:04:09.450420+0000","last_unstale":"2024-04-25T09:04:12.491035+0000","last_undegraded":"2024-04-25T09:04:12.491035+0000","last_fullsized":"2024-04-25T09:04:12.491035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453905+0000","last_change":"2024-04-25T09:04:10.461790+0000","last_active":"2024-04-25T09:04:11.453905+0000","last_peered":"2024-04-25T09:04:11.453905+0000","last_clean":"2024-04-25T09:04:11.453905+0000","last_became_active":"2024-04-25T09:04:10.459834+0000","last_became_peered":"2024-04-25T09:04:10.459834+0000","last_unstale":"2024-04-25T09:04:11.453905+0000","last_undegraded":"2024-04-25T09:04:11.453905+0000","last_fullsized":"2024-04-25T09:04:11.453905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:24.628300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453268+0000","last_change":"2024-04-25T09:04:09.443781+0000","last_active":"2024-04-25T09:04:11.453268+0000","last_peered":"2024-04-25T09:04:11.453268+0000","last_clean":"2024-04-25T09:04:11.453268+0000","last_became_active":"2024-04-25T09:04:09.443436+0000","last_became_peered":"2024-04-25T09:04:09.443436+0000","last_unstale":"2024-04-25T09:04:11.453268+0000","last_undegraded":"2024-04-25T09:04:11.453268+0000","last_fullsized":"2024-04-25T09:04:11.453268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:06.223411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766429+0000","last_change":"2024-04-25T09:04:10.453062+0000","last_active":"2024-04-25T09:04:11.766429+0000","last_peered":"2024-04-25T09:04:11.766429+0000","last_clean":"2024-04-25T09:04:11.766429+0000","last_became_active":"2024-04-25T09:04:10.452791+0000","last_became_peered":"2024-04-25T09:04:10.452791+0000","last_unstale":"2024-04-25T09:04:11.766429+0000","last_undegraded":"2024-04-25T09:04:11.766429+0000","last_fullsized":"2024-04-25T09:04:11.766429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:36.421524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453381+0000","last_change":"2024-04-25T09:04:09.434154+0000","last_active":"2024-04-25T09:04:11.453381+0000","last_peered":"2024-04-25T09:04:11.453381+0000","last_clean":"2024-04-25T09:04:11.453381+0000","last_became_active":"2024-04-25T09:04:09.433848+0000","last_became_peered":"2024-04-25T09:04:09.433848+0000","last_unstale":"2024-04-25T09:04:11.453381+0000","last_undegraded":"2024-04-25T09:04:11.453381+0000","last_fullsized":"2024-04-25T09:04:11.453381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:23.622773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766744+0000","last_change":"2024-04-25T09:04:10.449393+0000","last_active":"2024-04-25T09:04:11.766744+0000","last_peered":"2024-04-25T09:04:11.766744+0000","last_clean":"2024-04-25T09:04:11.766744+0000","last_became_active":"2024-04-25T09:04:10.449096+0000","last_became_peered":"2024-04-25T09:04:10.449096+0000","last_unstale":"2024-04-25T09:04:11.766744+0000","last_undegraded":"2024-04-25T09:04:11.766744+0000","last_fullsized":"2024-04-25T09:04:11.766744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.022253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491405+0000","last_change":"2024-04-25T09:04:09.448660+0000","last_active":"2024-04-25T09:04:12.491405+0000","last_peered":"2024-04-25T09:04:12.491405+0000","last_clean":"2024-04-25T09:04:12.491405+0000","last_became_active":"2024-04-25T09:04:09.448294+0000","last_became_peered":"2024-04-25T09:04:09.448294+0000","last_unstale":"2024-04-25T09:04:12.491405+0000","last_undegraded":"2024-04-25T09:04:12.491405+0000","last_fullsized":"2024-04-25T09:04:12.491405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:11.557908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453289+0000","last_change":"2024-04-25T09:04:10.447970+0000","last_active":"2024-04-25T09:04:11.453289+0000","last_peered":"2024-04-25T09:04:11.453289+0000","last_clean":"2024-04-25T09:04:11.453289+0000","last_became_active":"2024-04-25T09:04:10.447382+0000","last_became_peered":"2024-04-25T09:04:10.447382+0000","last_unstale":"2024-04-25T09:04:11.453289+0000","last_undegraded":"2024-04-25T09:04:11.453289+0000","last_fullsized":"2024-04-25T09:04:11.453289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:06.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.470541+0000","last_change":"2024-04-25T09:04:10.467264+0000","last_active":"2024-04-25T09:04:10.470541+0000","last_peered":"2024-04-25T09:04:10.470541+0000","last_clean":"2024-04-25T09:04:10.470541+0000","last_became_active":"2024-04-25T09:04:10.466902+0000","last_became_peered":"2024-04-25T09:04:10.466902+0000","last_unstale":"2024-04-25T09:04:10.470541+0000","last_undegraded":"2024-04-25T09:04:10.470541+0000","last_fullsized":"2024-04-25T09:04:10.470541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:47.704816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491091+0000","last_change":"2024-04-25T09:04:09.451766+0000","last_active":"2024-04-25T09:04:12.491091+0000","last_peered":"2024-04-25T09:04:12.491091+0000","last_clean":"2024-04-25T09:04:12.491091+0000","last_became_active":"2024-04-25T09:04:09.451360+0000","last_became_peered":"2024-04-25T09:04:09.451360+0000","last_unstale":"2024-04-25T09:04:12.491091+0000","last_undegraded":"2024-04-25T09:04:12.491091+0000","last_fullsized":"2024-04-25T09:04:12.491091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:23.622773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.470815+0000","last_change":"2024-04-25T09:04:10.467782+0000","last_active":"2024-04-25T09:04:10.470815+0000","last_peered":"2024-04-25T09:04:10.470815+0000","last_clean":"2024-04-25T09:04:10.470815+0000","last_became_active":"2024-04-25T09:04:10.467514+0000","last_became_peered":"2024-04-25T09:04:10.467514+0000","last_unstale":"2024-04-25T09:04:10.470815+0000","last_undegraded":"2024-04-25T09:04:10.470815+0000","last_fullsized":"2024-04-25T09:04:10.470815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:36.421524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491249+0000","last_change":"2024-04-25T09:04:09.451747+0000","last_active":"2024-04-25T09:04:12.491249+0000","last_peered":"2024-04-25T09:04:12.491249+0000","last_clean":"2024-04-25T09:04:12.491249+0000","last_became_active":"2024-04-25T09:04:09.451001+0000","last_became_peered":"2024-04-25T09:04:09.451001+0000","last_unstale":"2024-04-25T09:04:12.491249+0000","last_undegraded":"2024-04-25T09:04:12.491249+0000","last_fullsized":"2024-04-25T09:04:12.491249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.586105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.459513+0000","last_change":"2024-04-25T09:04:10.451528+0000","last_active":"2024-04-25T09:04:10.459513+0000","last_peered":"2024-04-25T09:04:10.459513+0000","last_clean":"2024-04-25T09:04:10.459513+0000","last_became_active":"2024-04-25T09:04:10.451248+0000","last_became_peered":"2024-04-25T09:04:10.451248+0000","last_unstale":"2024-04-25T09:04:10.459513+0000","last_undegraded":"2024-04-25T09:04:10.459513+0000","last_fullsized":"2024-04-25T09:04:10.459513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:24.628300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766853+0000","last_change":"2024-04-25T09:04:09.447550+0000","last_active":"2024-04-25T09:04:11.766853+0000","last_peered":"2024-04-25T09:04:11.766853+0000","last_clean":"2024-04-25T09:04:11.766853+0000","last_became_active":"2024-04-25T09:04:09.447290+0000","last_became_peered":"2024-04-25T09:04:09.447290+0000","last_unstale":"2024-04-25T09:04:11.766853+0000","last_undegraded":"2024-04-25T09:04:11.766853+0000","last_fullsized":"2024-04-25T09:04:11.766853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:37.664377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766592+0000","last_change":"2024-04-25T09:04:10.448757+0000","last_active":"2024-04-25T09:04:11.766592+0000","last_peered":"2024-04-25T09:04:11.766592+0000","last_clean":"2024-04-25T09:04:11.766592+0000","last_became_active":"2024-04-25T09:04:10.448463+0000","last_became_peered":"2024-04-25T09:04:10.448463+0000","last_unstale":"2024-04-25T09:04:11.766592+0000","last_undegraded":"2024-04-25T09:04:11.766592+0000","last_fullsized":"2024-04-25T09:04:11.766592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:53.844663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T09:04:10.471821+0000","last_change":"2024-04-25T09:04:09.446106+0000","last_active":"2024-04-25T09:04:10.471821+0000","last_peered":"2024-04-25T09:04:10.471821+0000","last_clean":"2024-04-25T09:04:10.471821+0000","last_became_active":"2024-04-25T09:04:09.445783+0000","last_became_peered":"2024-04-25T09:04:09.445783+0000","last_unstale":"2024-04-25T09:04:10.471821+0000","last_undegraded":"2024-04-25T09:04:10.471821+0000","last_fullsized":"2024-04-25T09:04:10.471821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:37.664377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27792,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344048,"statfs":{"total":96636764160,"available":96608305152,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:04:14.883 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:04:14.939 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T09:04:14.939 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T09:04:14.939 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T09:04:14.940 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T09:04:15.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.083+0000 7f0dc5c00640 1 Processor -- start 2024-04-25T09:04:15.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.083+0000 7f0dc5c00640 1 -- start start 2024-04-25T09:04:15.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.087+0000 7f0dc5c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0dc015a900 0x7f0dc006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.087+0000 7f0dc5c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cd520 0x7f0dc00ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.087+0000 7f0dc5c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc00cda00 con 0x7f0dc00cf560 2024-04-25T09:04:15.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.087+0000 7f0dc5c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc015bcf0 con 0x7f0dc015a900 2024-04-25T09:04:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.087+0000 7f0dc5c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00cdce0 con 0x7f0dc00cd520 2024-04-25T09:04:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.087+0000 7f0dbea00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0dc015a900 0x7f0dc006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.087+0000 7f0dbea00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0dc015a900 0x7f0dc006e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36358/0 (socket says 172.21.15.175:36358) 2024-04-25T09:04:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.087+0000 7f0dbea00640 1 -- 172.21.15.175:0/3164602847 learned_addr learned my addr 172.21.15.175:0/3164602847 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.087+0000 7f0db6000640 1 --2- 172.21.15.175:0/3164602847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cd520 0x7f0dc00ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.087+0000 7f0dbea00640 1 -- 172.21.15.175:0/3164602847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cd520 msgr2=0x7f0dc00ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.087+0000 7f0dbea00640 1 --2- 172.21.15.175:0/3164602847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cd520 0x7f0dc00ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.087+0000 7f0dbea00640 1 -- 172.21.15.175:0/3164602847 >> v1:172.21.15.177:6789/0 conn(0x7f0dc00cf560 legacy=0x7f0dc015bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.087+0000 7f0dbea00640 1 -- 172.21.15.175:0/3164602847 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc00cdfc0 con 0x7f0dc015a900 2024-04-25T09:04:15.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dbea00640 1 --2- 172.21.15.175:0/3164602847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dc015a900 0x7f0dc006e150 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009870 tx=0x7f0db001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa8088a10f47641 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dbe000640 1 -- 172.21.15.175:0/3164602847 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db00ab640 con 0x7f0dc015a900 2024-04-25T09:04:15.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dbe000640 1 -- 172.21.15.175:0/3164602847 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db00b0070 con 0x7f0dc015a900 2024-04-25T09:04:15.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dbe000640 1 -- 172.21.15.175:0/3164602847 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db00aba00 con 0x7f0dc015a900 2024-04-25T09:04:15.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dc5c00640 1 -- 172.21.15.175:0/3164602847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dc015a900 msgr2=0x7f0dc006e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dc5c00640 1 --2- 172.21.15.175:0/3164602847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dc015a900 0x7f0dc006e150 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009870 tx=0x7f0db001c530 comp rx=0 tx=0).stop 2024-04-25T09:04:15.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dc5c00640 1 -- 172.21.15.175:0/3164602847 shutdown_connections 2024-04-25T09:04:15.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dc5c00640 1 --2- 172.21.15.175:0/3164602847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cd520 0x7f0dc00ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dc5c00640 1 --2- 172.21.15.175:0/3164602847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dc015a900 0x7f0dc006e150 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dc5c00640 1 -- 172.21.15.175:0/3164602847 >> 172.21.15.175:0/3164602847 conn(0x7f0dc0067150 msgr2=0x7f0dc006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:15.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dc5c00640 1 -- 172.21.15.175:0/3164602847 shutdown_connections 2024-04-25T09:04:15.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dc5c00640 1 -- 172.21.15.175:0/3164602847 wait complete. 2024-04-25T09:04:15.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dc5c00640 1 Processor -- start 2024-04-25T09:04:15.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dc5c00640 1 -- start start 2024-04-25T09:04:15.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dc5c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cf560 0x7f0dc00b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dc5c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dc015a900 0x7f0dc013a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dc5c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dc013ac00 0x7f0dc0158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dc5c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00cf160 con 0x7f0dc013ac00 2024-04-25T09:04:15.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dc5c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00cefe0 con 0x7f0dc015a900 2024-04-25T09:04:15.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.091+0000 7f0dc5c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc006d3b0 con 0x7f0dc00cf560 2024-04-25T09:04:15.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0dbf400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dc013ac00 0x7f0dc0158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0dbea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cf560 0x7f0dc00b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0db6000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dc015a900 0x7f0dc013a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0dbf400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dc013ac00 0x7f0dc0158710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36374/0 (socket says 172.21.15.175:36374) 2024-04-25T09:04:15.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0dbea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cf560 0x7f0dc00b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44060/0 (socket says 172.21.15.175:44060) 2024-04-25T09:04:15.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0dbf400640 1 -- 172.21.15.175:0/2728810101 learned_addr learned my addr 172.21.15.175:0/2728810101 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:15.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0dbf400640 1 -- 172.21.15.175:0/2728810101 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cf560 msgr2=0x7f0dc00b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0dbf400640 1 --2- 172.21.15.175:0/2728810101 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cf560 0x7f0dc00b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0dbf400640 1 -- 172.21.15.175:0/2728810101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dc015a900 msgr2=0x7f0dc013a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0dbf400640 1 --2- 172.21.15.175:0/2728810101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dc015a900 0x7f0dc013a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0dbf400640 1 -- 172.21.15.175:0/2728810101 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc013df70 con 0x7f0dc013ac00 2024-04-25T09:04:15.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0dbf400640 1 --2- 172.21.15.175:0/2728810101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dc013ac00 0x7f0dc0158710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0db800c770 tx=0x7f0db800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0db7400640 1 -- 172.21.15.175:0/2728810101 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db8003b80 con 0x7f0dc013ac00 2024-04-25T09:04:15.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0db7400640 1 -- 172.21.15.175:0/2728810101 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db8003d20 con 0x7f0dc013ac00 2024-04-25T09:04:15.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0db7400640 1 -- 172.21.15.175:0/2728810101 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db800aa90 con 0x7f0dc013ac00 2024-04-25T09:04:15.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0dc5c00640 1 -- 172.21.15.175:0/2728810101 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc01f8490 con 0x7f0dc013ac00 2024-04-25T09:04:15.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0dc5c00640 1 -- 172.21.15.175:0/2728810101 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc01f8a50 con 0x7f0dc013ac00 2024-04-25T09:04:15.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0dc5c00640 1 -- 172.21.15.175:0/2728810101 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc0074a60 con 0x7f0dc013ac00 2024-04-25T09:04:15.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0db7400640 1 -- 172.21.15.175:0/2728810101 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0db800ac30 con 0x7f0dc013ac00 2024-04-25T09:04:15.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0db7400640 1 --2- 172.21.15.175:0/2728810101 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0d9c066f60 0x7f0d9c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.095+0000 7f0db7400640 1 -- 172.21.15.175:0/2728810101 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0db8084e30 con 0x7f0dc013ac00 2024-04-25T09:04:15.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.099+0000 7f0dbea00640 1 --2- 172.21.15.175:0/2728810101 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0d9c066f60 0x7f0d9c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.099+0000 7f0dbea00640 1 --2- 172.21.15.175:0/2728810101 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0d9c066f60 0x7f0d9c069420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0db00af000 tx=0x7f0db00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.099+0000 7f0db7400640 1 -- 172.21.15.175:0/2728810101 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0db80557e0 con 0x7f0dc013ac00 2024-04-25T09:04:15.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.291+0000 7f0dc5c00640 1 -- 172.21.15.175:0/2728810101 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0dc015a070 con 0x7f0dc013ac00 2024-04-25T09:04:15.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.295+0000 7f0db7400640 1 -- 172.21.15.175:0/2728810101 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+165735 (secure 0 0 0) 0x7f0db8059880 con 0x7f0dc013ac00 2024-04-25T09:04:15.288 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:15.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.299+0000 7f0dc5c00640 1 -- 172.21.15.175:0/2728810101 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0d9c066f60 msgr2=0x7f0d9c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.299+0000 7f0dc5c00640 1 --2- 172.21.15.175:0/2728810101 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0d9c066f60 0x7f0d9c069420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0db00af000 tx=0x7f0db00a7000 comp rx=0 tx=0).stop 2024-04-25T09:04:15.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.299+0000 7f0dc5c00640 1 -- 172.21.15.175:0/2728810101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dc013ac00 msgr2=0x7f0dc0158710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.299+0000 7f0dc5c00640 1 --2- 172.21.15.175:0/2728810101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dc013ac00 0x7f0dc0158710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0db800c770 tx=0x7f0db800cc30 comp rx=0 tx=0).stop 2024-04-25T09:04:15.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.299+0000 7f0dc5c00640 1 -- 172.21.15.175:0/2728810101 shutdown_connections 2024-04-25T09:04:15.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.299+0000 7f0dc5c00640 1 --2- 172.21.15.175:0/2728810101 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0d9c066f60 0x7f0d9c069420 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.299+0000 7f0dc5c00640 1 --2- 172.21.15.175:0/2728810101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0dc013ac00 0x7f0dc0158710 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.299+0000 7f0dc5c00640 1 --2- 172.21.15.175:0/2728810101 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dc015a900 0x7f0dc013a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.299+0000 7f0dc5c00640 1 --2- 172.21.15.175:0/2728810101 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dc00cf560 0x7f0dc00b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.299+0000 7f0dc5c00640 1 -- 172.21.15.175:0/2728810101 >> 172.21.15.175:0/2728810101 conn(0x7f0dc00cd520 msgr2=0x7f0dc015bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:15.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.299+0000 7f0dc5c00640 1 -- 172.21.15.175:0/2728810101 shutdown_connections 2024-04-25T09:04:15.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.299+0000 7f0dc5c00640 1 -- 172.21.15.175:0/2728810101 wait complete. 2024-04-25T09:04:15.309 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":768986364},{"type":"v1","addr":"172.21.15.175:6833","nonce":768986364}]},"active_addr":"172.21.15.175:6833/768986364","active_change":"2024-04-25T09:03:49.778378+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":316385388}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":1274731996}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":329002015}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":2761112059}]}]} 2024-04-25T09:04:15.312 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T09:04:15.312 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T09:04:15.313 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:15.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.455+0000 7fcc07a00640 1 Processor -- start 2024-04-25T09:04:15.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.455+0000 7fcc07a00640 1 -- start start 2024-04-25T09:04:15.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.459+0000 7fcc07a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcc0006cc50 0x7fcc000cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.459+0000 7fcc07a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc000cfcb0 con 0x7fcc0006bd60 2024-04-25T09:04:15.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.459+0000 7fcc07a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc000cff90 con 0x7fcc00099a50 2024-04-25T09:04:15.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.459+0000 7fcc07a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc000d1460 con 0x7fcc0006cc50 2024-04-25T09:04:15.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.459+0000 7fcbffe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fcc0006bd60 0x7fcc000d0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59218/0 (socket says 172.21.15.175:59218) 2024-04-25T09:04:15.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.459+0000 7fcbffe00640 1 -- 172.21.15.175:0/2444379270 learned_addr learned my addr 172.21.15.175:0/2444379270 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:15.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.459+0000 7fcc05a00640 1 --2- 172.21.15.175:0/2444379270 >> v2:172.21.15.177:3300/0 conn(0x7fcc0006cc50 0x7fcc000cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.459+0000 7fcbff400640 1 -- 172.21.15.175:0/2444379270 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535003910 0 0) 0x7fcc000cfcb0 con 0x7fcc0006bd60 2024-04-25T09:04:15.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.459+0000 7fcbff400640 1 -- 172.21.15.175:0/2444379270 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbe4003530 con 0x7fcc0006bd60 2024-04-25T09:04:15.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.459+0000 7fcc05a00640 1 -- 172.21.15.175:0/2444379270 >> v1:172.21.15.177:6789/0 conn(0x7fcc00099a50 legacy=0x7fcc00099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.459+0000 7fcc05a00640 1 -- 172.21.15.175:0/2444379270 >> v1:172.21.15.175:6789/0 conn(0x7fcc0006bd60 legacy=0x7fcc000d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.459+0000 7fcc05a00640 1 -- 172.21.15.175:0/2444379270 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc000d0270 con 0x7fcc0006cc50 2024-04-25T09:04:15.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.463+0000 7fcc05a00640 1 --2- 172.21.15.175:0/2444379270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc0006cc50 0x7fcc000cbe60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8009d90 tx=0x7fcbf801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ba4df97fc152099 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.463+0000 7fcbff400640 1 -- 172.21.15.175:0/2444379270 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf80b2070 con 0x7fcc0006cc50 2024-04-25T09:04:15.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.463+0000 7fcbff400640 1 -- 172.21.15.175:0/2444379270 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf80a5920 con 0x7fcc0006cc50 2024-04-25T09:04:15.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.463+0000 7fcbff400640 1 -- 172.21.15.175:0/2444379270 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf80a5cd0 con 0x7fcc0006cc50 2024-04-25T09:04:15.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.463+0000 7fcc07a00640 1 -- 172.21.15.175:0/2444379270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc0006cc50 msgr2=0x7fcc000cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.463+0000 7fcc07a00640 1 --2- 172.21.15.175:0/2444379270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc0006cc50 0x7fcc000cbe60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8009d90 tx=0x7fcbf801c970 comp rx=0 tx=0).stop 2024-04-25T09:04:15.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.463+0000 7fcc07a00640 1 -- 172.21.15.175:0/2444379270 shutdown_connections 2024-04-25T09:04:15.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.463+0000 7fcc07a00640 1 --2- 172.21.15.175:0/2444379270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc0006cc50 0x7fcc000cbe60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.463+0000 7fcc07a00640 1 -- 172.21.15.175:0/2444379270 >> 172.21.15.175:0/2444379270 conn(0x7fcc000b3300 msgr2=0x7fcc000b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:15.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.463+0000 7fcc07a00640 1 -- 172.21.15.175:0/2444379270 shutdown_connections 2024-04-25T09:04:15.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.463+0000 7fcc07a00640 1 -- 172.21.15.175:0/2444379270 wait complete. 2024-04-25T09:04:15.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.463+0000 7fcc07a00640 1 Processor -- start 2024-04-25T09:04:15.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.463+0000 7fcc07a00640 1 -- start start 2024-04-25T09:04:15.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcc07a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc0006bd60 0x7fcc000b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcc07a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc0006cc50 0x7fcc0014b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcc07a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcc00099a50 0x7fcc000b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcc07a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000cc7b0 con 0x7fcc0006cc50 2024-04-25T09:04:15.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcc07a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0006d060 con 0x7fcc0006bd60 2024-04-25T09:04:15.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcc07a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000cc930 con 0x7fcc00099a50 2024-04-25T09:04:15.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcbffe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc0006cc50 0x7fcc0014b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcbffe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc0006cc50 0x7fcc0014b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36380/0 (socket says 172.21.15.175:36380) 2024-04-25T09:04:15.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcbffe00640 1 -- 172.21.15.175:0/2784718514 learned_addr learned my addr 172.21.15.175:0/2784718514 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:15.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcc05000640 1 --2- 172.21.15.175:0/2784718514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc0006bd60 0x7fcc000b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcc05a00640 1 --2- 172.21.15.175:0/2784718514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcc00099a50 0x7fcc000b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcbffe00640 1 -- 172.21.15.175:0/2784718514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcc00099a50 msgr2=0x7fcc000b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcbffe00640 1 --2- 172.21.15.175:0/2784718514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcc00099a50 0x7fcc000b6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcbffe00640 1 -- 172.21.15.175:0/2784718514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc0006bd60 msgr2=0x7fcc000b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcbffe00640 1 --2- 172.21.15.175:0/2784718514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc0006bd60 0x7fcc000b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcbffe00640 1 -- 172.21.15.175:0/2784718514 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc00156ad0 con 0x7fcc0006cc50 2024-04-25T09:04:15.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcc05a00640 1 --2- 172.21.15.175:0/2784718514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcc00099a50 0x7fcc000b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:15.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcbffe00640 1 --2- 172.21.15.175:0/2784718514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc0006cc50 0x7fcc0014b530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcbec00c500 tx=0x7fcbec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcbfcc00640 1 -- 172.21.15.175:0/2784718514 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec017070 con 0x7fcc0006cc50 2024-04-25T09:04:15.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcbfcc00640 1 -- 172.21.15.175:0/2784718514 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbec005cf0 con 0x7fcc0006cc50 2024-04-25T09:04:15.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcc07a00640 1 -- 172.21.15.175:0/2784718514 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc00156db0 con 0x7fcc0006cc50 2024-04-25T09:04:15.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcbfcc00640 1 -- 172.21.15.175:0/2784718514 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec0072f0 con 0x7fcc0006cc50 2024-04-25T09:04:15.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcc07a00640 1 -- 172.21.15.175:0/2784718514 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc00157370 con 0x7fcc0006cc50 2024-04-25T09:04:15.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcc07a00640 1 -- 172.21.15.175:0/2784718514 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc00074a60 con 0x7fcc0006cc50 2024-04-25T09:04:15.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.467+0000 7fcbfcc00640 1 -- 172.21.15.175:0/2784718514 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcbec01a070 con 0x7fcc0006cc50 2024-04-25T09:04:15.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.471+0000 7fcbfcc00640 1 --2- 172.21.15.175:0/2784718514 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcbe0066f60 0x7fcbe0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.471+0000 7fcbfcc00640 1 -- 172.21.15.175:0/2784718514 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbec0843c0 con 0x7fcc0006cc50 2024-04-25T09:04:15.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.471+0000 7fcc05000640 1 --2- 172.21.15.175:0/2784718514 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcbe0066f60 0x7fcbe0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.471+0000 7fcc05000640 1 --2- 172.21.15.175:0/2784718514 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcbe0066f60 0x7fcbe0069420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0001770 tx=0x7fcbf0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.475+0000 7fcbfcc00640 1 -- 172.21.15.175:0/2784718514 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcbec054d70 con 0x7fcc0006cc50 2024-04-25T09:04:15.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.631+0000 7fcc07a00640 1 -- 172.21.15.175:0/2784718514 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc0009aee0 con 0x7fcc0006cc50 2024-04-25T09:04:15.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.631+0000 7fcbfcc00640 1 -- 172.21.15.175:0/2784718514 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7fcbec058e10 con 0x7fcc0006cc50 2024-04-25T09:04:15.622 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:15.622 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":20,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:11.440551+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:15.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.631+0000 7fcc07a00640 1 -- 172.21.15.175:0/2784718514 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcbe0066f60 msgr2=0x7fcbe0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.631+0000 7fcc07a00640 1 --2- 172.21.15.175:0/2784718514 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcbe0066f60 0x7fcbe0069420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0001770 tx=0x7fcbf0009040 comp rx=0 tx=0).stop 2024-04-25T09:04:15.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.631+0000 7fcc07a00640 1 -- 172.21.15.175:0/2784718514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc0006cc50 msgr2=0x7fcc0014b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.631+0000 7fcc07a00640 1 --2- 172.21.15.175:0/2784718514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc0006cc50 0x7fcc0014b530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcbec00c500 tx=0x7fcbec00c9c0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.631+0000 7fcc07a00640 1 -- 172.21.15.175:0/2784718514 shutdown_connections 2024-04-25T09:04:15.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.631+0000 7fcc07a00640 1 --2- 172.21.15.175:0/2784718514 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcbe0066f60 0x7fcbe0069420 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.631+0000 7fcc07a00640 1 --2- 172.21.15.175:0/2784718514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcc00099a50 0x7fcc000b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.631+0000 7fcc07a00640 1 --2- 172.21.15.175:0/2784718514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc0006cc50 0x7fcc0014b530 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.631+0000 7fcc07a00640 1 --2- 172.21.15.175:0/2784718514 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcc0006bd60 0x7fcc000b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.631+0000 7fcc07a00640 1 -- 172.21.15.175:0/2784718514 >> 172.21.15.175:0/2784718514 conn(0x7fcc000b3300 msgr2=0x7fcc000af120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:15.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.631+0000 7fcc07a00640 1 -- 172.21.15.175:0/2784718514 shutdown_connections 2024-04-25T09:04:15.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.635+0000 7fcc07a00640 1 -- 172.21.15.175:0/2784718514 wait complete. 2024-04-25T09:04:15.643 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T09:04:15.643 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:15.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.787+0000 7f960a000640 1 Processor -- start 2024-04-25T09:04:15.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.787+0000 7f960a000640 1 -- start start 2024-04-25T09:04:15.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.787+0000 7f960a000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f960415da20 0x7f96040cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.787+0000 7f960a000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96041622f0 0x7f96040cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.787+0000 7f960a000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96040cdd90 con 0x7f960415de00 2024-04-25T09:04:15.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.787+0000 7f960a000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96040ce070 con 0x7f960415da20 2024-04-25T09:04:15.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.787+0000 7f960a000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9604161810 con 0x7f96041622f0 2024-04-25T09:04:15.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.787+0000 7f9608c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f960415da20 0x7f96040cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.787+0000 7f9608c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f960415da20 0x7f96040cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36392/0 (socket says 172.21.15.175:36392) 2024-04-25T09:04:15.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.787+0000 7f9608c00640 1 -- 172.21.15.175:0/118214613 learned_addr learned my addr 172.21.15.175:0/118214613 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:15.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.787+0000 7f9608c00640 1 -- 172.21.15.175:0/118214613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96041622f0 msgr2=0x7f96040cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:15.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.787+0000 7f9608c00640 1 --2- 172.21.15.175:0/118214613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96041622f0 0x7f96040cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.787+0000 7f9608c00640 1 -- 172.21.15.175:0/118214613 >> v1:172.21.15.177:6789/0 conn(0x7f960415de00 legacy=0x7f96040cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:15.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.787+0000 7f9608c00640 1 -- 172.21.15.175:0/118214613 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9604161af0 con 0x7f960415da20 2024-04-25T09:04:15.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.791+0000 7f9608c00640 1 --2- 172.21.15.175:0/118214613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f960415da20 0x7f96040cd540 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009e50 tx=0x7f95f401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ebaf5446dc673b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.791+0000 7f9603400640 1 -- 172.21.15.175:0/118214613 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40a5660 con 0x7f960415da20 2024-04-25T09:04:15.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.791+0000 7f9603400640 1 -- 172.21.15.175:0/118214613 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f40a5800 con 0x7f960415da20 2024-04-25T09:04:15.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.791+0000 7f9603400640 1 -- 172.21.15.175:0/118214613 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40a5bd0 con 0x7f960415da20 2024-04-25T09:04:15.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.791+0000 7f960a000640 1 -- 172.21.15.175:0/118214613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f960415da20 msgr2=0x7f96040cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.791+0000 7f960a000640 1 --2- 172.21.15.175:0/118214613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f960415da20 0x7f96040cd540 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009e50 tx=0x7f95f401c8d0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.791+0000 7f960a000640 1 -- 172.21.15.175:0/118214613 shutdown_connections 2024-04-25T09:04:15.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.791+0000 7f960a000640 1 --2- 172.21.15.175:0/118214613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96041622f0 0x7f96040cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.791+0000 7f960a000640 1 --2- 172.21.15.175:0/118214613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f960415da20 0x7f96040cd540 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.791+0000 7f960a000640 1 -- 172.21.15.175:0/118214613 >> 172.21.15.175:0/118214613 conn(0x7f9604072760 msgr2=0x7f9604099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:15.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.791+0000 7f960a000640 1 -- 172.21.15.175:0/118214613 shutdown_connections 2024-04-25T09:04:15.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.791+0000 7f960a000640 1 -- 172.21.15.175:0/118214613 wait complete. 2024-04-25T09:04:15.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f960a000640 1 Processor -- start 2024-04-25T09:04:15.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f960a000640 1 -- start start 2024-04-25T09:04:15.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f960a000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f960415da20 0x7f96040b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f960a000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f960415de00 0x7f96040b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f960a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96041622f0 0x7f96040b5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f960a000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960416aba0 con 0x7f96041622f0 2024-04-25T09:04:15.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f960a000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960416aa20 con 0x7f960415da20 2024-04-25T09:04:15.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f960a000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960416ad20 con 0x7f960415de00 2024-04-25T09:04:15.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f9609600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96041622f0 0x7f96040b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f9609600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96041622f0 0x7f96040b5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36408/0 (socket says 172.21.15.175:36408) 2024-04-25T09:04:15.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f9609600640 1 -- 172.21.15.175:0/2074468244 learned_addr learned my addr 172.21.15.175:0/2074468244 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:15.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f9608c00640 1 --2- 172.21.15.175:0/2074468244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f960415da20 0x7f96040b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f9603e00640 1 --2- 172.21.15.175:0/2074468244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f960415de00 0x7f96040b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f9609600640 1 -- 172.21.15.175:0/2074468244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f960415de00 msgr2=0x7f96040b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f9609600640 1 --2- 172.21.15.175:0/2074468244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f960415de00 0x7f96040b53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f9609600640 1 -- 172.21.15.175:0/2074468244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f960415da20 msgr2=0x7f96040b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f9609600640 1 --2- 172.21.15.175:0/2074468244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f960415da20 0x7f96040b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f9609600640 1 -- 172.21.15.175:0/2074468244 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96040b5fc0 con 0x7f96041622f0 2024-04-25T09:04:15.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f9609600640 1 --2- 172.21.15.175:0/2074468244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96041622f0 0x7f96040b5930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00b430 tx=0x7f95fc00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f9600c00640 1 -- 172.21.15.175:0/2074468244 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc015020 con 0x7f96041622f0 2024-04-25T09:04:15.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f9600c00640 1 -- 172.21.15.175:0/2074468244 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc011830 con 0x7f96041622f0 2024-04-25T09:04:15.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f960a000640 1 -- 172.21.15.175:0/2074468244 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96040b62a0 con 0x7f96041622f0 2024-04-25T09:04:15.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f9600c00640 1 -- 172.21.15.175:0/2074468244 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc011c20 con 0x7f96041622f0 2024-04-25T09:04:15.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.795+0000 7f960a000640 1 -- 172.21.15.175:0/2074468244 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96040ad8c0 con 0x7f96041622f0 2024-04-25T09:04:15.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.799+0000 7f960a000640 1 -- 172.21.15.175:0/2074468244 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9604067900 con 0x7f96041622f0 2024-04-25T09:04:15.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.799+0000 7f9600c00640 1 -- 172.21.15.175:0/2074468244 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f95fc018020 con 0x7f96041622f0 2024-04-25T09:04:15.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.799+0000 7f9600c00640 1 --2- 172.21.15.175:0/2074468244 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f95e4066f60 0x7f95e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.799+0000 7f9600c00640 1 -- 172.21.15.175:0/2074468244 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95fc085070 con 0x7f96041622f0 2024-04-25T09:04:15.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.799+0000 7f9608c00640 1 --2- 172.21.15.175:0/2074468244 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f95e4066f60 0x7f95e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.799+0000 7f9608c00640 1 --2- 172.21.15.175:0/2074468244 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f95e4066f60 0x7f95e4069420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f95f40ae000 tx=0x7f95f40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.803+0000 7f9600c00640 1 -- 172.21.15.175:0/2074468244 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f95fc01f020 con 0x7f96041622f0 2024-04-25T09:04:15.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.959+0000 7f960a000640 1 -- 172.21.15.175:0/2074468244 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f960415d250 con 0x7f96041622f0 2024-04-25T09:04:15.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.959+0000 7f9600c00640 1 -- 172.21.15.175:0/2074468244 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f95fc0172c0 con 0x7f96041622f0 2024-04-25T09:04:15.952 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:15.952 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":20,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:11.440551+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:15.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.963+0000 7f960a000640 1 -- 172.21.15.175:0/2074468244 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f95e4066f60 msgr2=0x7f95e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.963+0000 7f960a000640 1 --2- 172.21.15.175:0/2074468244 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f95e4066f60 0x7f95e4069420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f95f40ae000 tx=0x7f95f40a7070 comp rx=0 tx=0).stop 2024-04-25T09:04:15.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.963+0000 7f960a000640 1 -- 172.21.15.175:0/2074468244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96041622f0 msgr2=0x7f96040b5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.963+0000 7f960a000640 1 --2- 172.21.15.175:0/2074468244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96041622f0 0x7f96040b5930 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00b430 tx=0x7f95fc00b8f0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.963+0000 7f960a000640 1 -- 172.21.15.175:0/2074468244 shutdown_connections 2024-04-25T09:04:15.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.963+0000 7f960a000640 1 --2- 172.21.15.175:0/2074468244 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f95e4066f60 0x7f95e4069420 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.963+0000 7f960a000640 1 --2- 172.21.15.175:0/2074468244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96041622f0 0x7f96040b5930 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.963+0000 7f960a000640 1 --2- 172.21.15.175:0/2074468244 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f960415de00 0x7f96040b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.963+0000 7f960a000640 1 --2- 172.21.15.175:0/2074468244 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f960415da20 0x7f96040b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.963+0000 7f960a000640 1 -- 172.21.15.175:0/2074468244 >> 172.21.15.175:0/2074468244 conn(0x7f9604072760 msgr2=0x7f960406e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:15.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.963+0000 7f960a000640 1 -- 172.21.15.175:0/2074468244 shutdown_connections 2024-04-25T09:04:15.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:15.963+0000 7f960a000640 1 -- 172.21.15.175:0/2074468244 wait complete. 2024-04-25T09:04:15.974 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T09:04:15.975 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T09:04:15.975 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T09:04:15.975 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T09:04:15.976 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T09:04:15.976 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T09:04:15.976 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T09:04:15.977 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T09:04:16.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.223+0000 7f185b000640 1 Processor -- start 2024-04-25T09:04:16.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f185b000640 1 -- start start 2024-04-25T09:04:16.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f4f3cc00640 1 Processor -- start 2024-04-25T09:04:16.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f4f3cc00640 1 -- start start 2024-04-25T09:04:16.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f185b000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f185409aaf0 0x7f18540c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f185b000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f185415f4e0 0x7f185415f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f185b000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1854099a50 con 0x7f185415b970 2024-04-25T09:04:16.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f185b000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1854099d30 con 0x7f185409aaf0 2024-04-25T09:04:16.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f185b000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185409a010 con 0x7f185415f4e0 2024-04-25T09:04:16.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f31e4e00640 1 Processor -- start 2024-04-25T09:04:16.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f31e4e00640 1 -- start start 2024-04-25T09:04:16.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f4f3cc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4f30033e40 0x7f4f300eb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f4f3cc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f30005ea0 0x7f4f300062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f4f3cc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f30034220 con 0x7f4f30047c20 2024-04-25T09:04:16.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f4f3cc00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f30050210 con 0x7f4f30033e40 2024-04-25T09:04:16.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f4f3cc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f30037bc0 con 0x7f4f30005ea0 2024-04-25T09:04:16.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f31e4e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f31e0166b10 0x7f31e00ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f31e4e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e00cfca0 con 0x7f31e00cec30 2024-04-25T09:04:16.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f31e4e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e00cff80 con 0x7f31e01624c0 2024-04-25T09:04:16.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.227+0000 7f31e4e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e00cfa50 con 0x7f31e0166b10 2024-04-25T09:04:16.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f31dde00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f31e01624c0 0x7f31e00b6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:46478/0 (socket says 172.21.15.175:46478) 2024-04-25T09:04:16.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f31dde00640 1 -- 172.21.15.175:0/164570141 learned_addr learned my addr 172.21.15.175:0/164570141 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:16.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f185a600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f185415f4e0 0x7f185415f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f185a600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f185415f4e0 0x7f185415f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:48214/0 (socket says 172.21.15.175:48214) 2024-04-25T09:04:16.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f185a600640 1 -- 172.21.15.175:0/3870961396 learned_addr learned my addr 172.21.15.175:0/3870961396 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f1859200640 1 --2- 172.21.15.175:0/3870961396 >> v2:172.21.15.175:3300/0 conn(0x7f185409aaf0 0x7f18540c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f4f36800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f30005ea0 0x7f4f300062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f4f35400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f4f30047c20 0x7f4f300eb6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:46474/0 (socket says 172.21.15.175:46474) 2024-04-25T09:04:16.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f4f35400640 1 -- 172.21.15.175:0/3712427135 learned_addr learned my addr 172.21.15.175:0/3712427135 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:16.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f4f35e00640 1 --2- 172.21.15.175:0/3712427135 >> v2:172.21.15.175:3300/0 conn(0x7f4f30033e40 0x7f4f300eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f1859200640 1 -- 172.21.15.175:0/3870961396 >> v2:172.21.15.177:3300/0 conn(0x7f185415f4e0 msgr2=0x7f185415f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f31dd400640 1 --2- 172.21.15.175:0/164570141 >> v2:172.21.15.175:3300/0 conn(0x7f31e0166b10 0x7f31e00ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f31dca00640 1 -- 172.21.15.175:0/164570141 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737759225 0 0) 0x7f31e00cff80 con 0x7f31e01624c0 2024-04-25T09:04:16.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f1859200640 1 --2- 172.21.15.175:0/3870961396 >> v2:172.21.15.177:3300/0 conn(0x7f185415f4e0 0x7f185415f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f1859200640 1 -- 172.21.15.175:0/3870961396 >> v1:172.21.15.175:6789/0 conn(0x7f185415b970 legacy=0x7f18540c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f31dca00640 1 -- 172.21.15.175:0/164570141 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31c4003530 con 0x7f31e01624c0 2024-04-25T09:04:16.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f1859200640 1 -- 172.21.15.175:0/3870961396 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185409a2f0 con 0x7f185409aaf0 2024-04-25T09:04:16.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f185a600640 1 --2- 172.21.15.175:0/3870961396 >> v2:172.21.15.177:3300/0 conn(0x7f185415f4e0 0x7f185415f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:16.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f31dd400640 1 -- 172.21.15.175:0/164570141 >> v1:172.21.15.177:6789/0 conn(0x7f31e01624c0 legacy=0x7f31e00b6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f31dd400640 1 -- 172.21.15.175:0/164570141 >> v1:172.21.15.175:6789/0 conn(0x7f31e00cec30 legacy=0x7f31e00b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f31dd400640 1 -- 172.21.15.175:0/164570141 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e00b5b70 con 0x7f31e0166b10 2024-04-25T09:04:16.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f4f35e00640 1 -- 172.21.15.175:0/3712427135 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f30005ea0 msgr2=0x7f4f300062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f4f35e00640 1 --2- 172.21.15.175:0/3712427135 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f30005ea0 0x7f4f300062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f4f35e00640 1 -- 172.21.15.175:0/3712427135 >> v1:172.21.15.177:6789/0 conn(0x7f4f30047c20 legacy=0x7f4f300eb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.231+0000 7f4f35e00640 1 -- 172.21.15.175:0/3712427135 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3004fa30 con 0x7f4f30033e40 2024-04-25T09:04:16.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f70d9000640 1 Processor -- start 2024-04-25T09:04:16.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f70d9000640 1 -- start start 2024-04-25T09:04:16.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f880dc00640 1 Processor -- start 2024-04-25T09:04:16.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f70d9000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f70d406ac50 0x7f70d406b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f70d9000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70d415d4a0 0x7f70d415fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f70d9000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d406b570 con 0x7f70d4099e60 2024-04-25T09:04:16.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f70d9000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d415c4a0 con 0x7f70d406ac50 2024-04-25T09:04:16.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f70d9000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d415c760 con 0x7f70d415d4a0 2024-04-25T09:04:16.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f1859200640 1 --2- 172.21.15.175:0/3870961396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185409aaf0 0x7f18540c7b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f185415f420 tx=0x7f184001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4023f9eb734ac751 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f880dc00640 1 -- start start 2024-04-25T09:04:16.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f70d1400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f70d4099e60 0x7f70d415bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59248/0 (socket says 172.21.15.175:59248) 2024-04-25T09:04:16.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f70d1400640 1 -- 172.21.15.175:0/1040073654 learned_addr learned my addr 172.21.15.175:0/1040073654 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:16.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f31dd400640 1 --2- 172.21.15.175:0/164570141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e0166b10 0x7f31e00ce6f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009740 tx=0x7f31d001c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dee95ac3d90b55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f4f35e00640 1 --2- 172.21.15.175:0/3712427135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f30033e40 0x7f4f300eb180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4f280097c0 tx=0x7f4f2801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3ad8917bd87fec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f70d2800640 1 --2- 172.21.15.175:0/1040073654 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70d415d4a0 0x7f70d415fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f70d1e00640 1 --2- 172.21.15.175:0/1040073654 >> v2:172.21.15.177:3300/0 conn(0x7f70d406ac50 0x7f70d406b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f70d0a00640 1 -- 172.21.15.175:0/1040073654 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732535179 0 0) 0x7f70d406b570 con 0x7f70d4099e60 2024-04-25T09:04:16.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f70d2800640 1 -- 172.21.15.175:0/1040073654 >> v2:172.21.15.177:3300/0 conn(0x7f70d406ac50 msgr2=0x7f70d406b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f70d2800640 1 --2- 172.21.15.175:0/1040073654 >> v2:172.21.15.177:3300/0 conn(0x7f70d406ac50 0x7f70d406b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f70d2800640 1 -- 172.21.15.175:0/1040073654 >> v1:172.21.15.175:6789/0 conn(0x7f70d4099e60 legacy=0x7f70d415bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f70d2800640 1 -- 172.21.15.175:0/1040073654 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d415ca40 con 0x7f70d415d4a0 2024-04-25T09:04:16.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f70d1e00640 1 --2- 172.21.15.175:0/1040073654 >> v2:172.21.15.177:3300/0 conn(0x7f70d406ac50 0x7f70d406b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:16.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f4f34a00640 1 -- 172.21.15.175:0/3712427135 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f280b5070 con 0x7f4f30033e40 2024-04-25T09:04:16.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f4f34a00640 1 -- 172.21.15.175:0/3712427135 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f280a8810 con 0x7f4f30033e40 2024-04-25T09:04:16.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f4f34a00640 1 -- 172.21.15.175:0/3712427135 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f280a8be0 con 0x7f4f30033e40 2024-04-25T09:04:16.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f31dca00640 1 -- 172.21.15.175:0/164570141 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d00b0070 con 0x7f31e0166b10 2024-04-25T09:04:16.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f31dca00640 1 -- 172.21.15.175:0/164570141 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d00ab400 con 0x7f31e0166b10 2024-04-25T09:04:16.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f31dca00640 1 -- 172.21.15.175:0/164570141 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc001680 con 0x7f31e0166b10 2024-04-25T09:04:16.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f1853e00640 1 -- 172.21.15.175:0/3870961396 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18400b0070 con 0x7f185409aaf0 2024-04-25T09:04:16.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f1853e00640 1 -- 172.21.15.175:0/3870961396 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18400ab600 con 0x7f185409aaf0 2024-04-25T09:04:16.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.235+0000 7f1853e00640 1 -- 172.21.15.175:0/3870961396 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18400ab9d0 con 0x7f185409aaf0 2024-04-25T09:04:16.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f6c40200640 1 Processor -- start 2024-04-25T09:04:16.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f880dc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8808159b00 0x7f88080b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f185b000640 1 -- 172.21.15.175:0/3870961396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185409aaf0 msgr2=0x7f18540c7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f185b000640 1 --2- 172.21.15.175:0/3870961396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185409aaf0 0x7f18540c7b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f185415f420 tx=0x7f184001c3b0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f31e4e00640 1 -- 172.21.15.175:0/164570141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e0166b10 msgr2=0x7f31e00ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f31e4e00640 1 --2- 172.21.15.175:0/164570141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e0166b10 0x7f31e00ce6f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f31d0009740 tx=0x7f31d001c2a0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f4f3cc00640 1 -- 172.21.15.175:0/3712427135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f30033e40 msgr2=0x7f4f300eb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f4f3cc00640 1 --2- 172.21.15.175:0/3712427135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f30033e40 0x7f4f300eb180 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4f280097c0 tx=0x7f4f2801ec70 comp rx=0 tx=0).stop 2024-04-25T09:04:16.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f185b000640 1 -- 172.21.15.175:0/3870961396 shutdown_connections 2024-04-25T09:04:16.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f185b000640 1 --2- 172.21.15.175:0/3870961396 >> v2:172.21.15.177:3300/0 conn(0x7f185415f4e0 0x7f185415f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f185b000640 1 --2- 172.21.15.175:0/3870961396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185409aaf0 0x7f18540c7b50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f185b000640 1 -- 172.21.15.175:0/3870961396 >> 172.21.15.175:0/3870961396 conn(0x7f18540b3160 msgr2=0x7f18540b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f6c40200640 1 -- start start 2024-04-25T09:04:16.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f185b000640 1 -- 172.21.15.175:0/3870961396 shutdown_connections 2024-04-25T09:04:16.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f880dc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88080719e0 0x7f88080cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f880dc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880806e530 con 0x7f88080ccb20 2024-04-25T09:04:16.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f880dc00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8808072120 con 0x7f8808159b00 2024-04-25T09:04:16.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f185b000640 1 -- 172.21.15.175:0/3870961396 wait complete. 2024-04-25T09:04:16.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f880dc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880806e810 con 0x7f88080719e0 2024-04-25T09:04:16.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f31e4e00640 1 -- 172.21.15.175:0/164570141 shutdown_connections 2024-04-25T09:04:16.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f31e4e00640 1 --2- 172.21.15.175:0/164570141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e0166b10 0x7f31e00ce6f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f31e4e00640 1 -- 172.21.15.175:0/164570141 >> 172.21.15.175:0/164570141 conn(0x7f31e00d0460 msgr2=0x7f31e00d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f4f3cc00640 1 -- 172.21.15.175:0/3712427135 shutdown_connections 2024-04-25T09:04:16.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f4f3cc00640 1 --2- 172.21.15.175:0/3712427135 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f30005ea0 0x7f4f300062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f4f3cc00640 1 --2- 172.21.15.175:0/3712427135 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f30033e40 0x7f4f300eb180 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f4f3cc00640 1 -- 172.21.15.175:0/3712427135 >> 172.21.15.175:0/3712427135 conn(0x7f4f30009fc0 msgr2=0x7f4f3000a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f4f3cc00640 1 -- 172.21.15.175:0/3712427135 shutdown_connections 2024-04-25T09:04:16.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f4f3cc00640 1 -- 172.21.15.175:0/3712427135 wait complete. 2024-04-25T09:04:16.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f8806000640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f88080ccb20 0x7f88080712d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:46484/0 (socket says 172.21.15.175:46484) 2024-04-25T09:04:16.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f8806000640 1 -- 172.21.15.175:0/3199759445 learned_addr learned my addr 172.21.15.175:0/3199759445 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:16.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f8806a00640 1 --2- 172.21.15.175:0/3199759445 >> v2:172.21.15.175:3300/0 conn(0x7f8808159b00 0x7f88080b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f8807400640 1 --2- 172.21.15.175:0/3199759445 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88080719e0 0x7f88080cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f6c40200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6c380ccb20 0x7f6c380712d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f6c40200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6c38159ee0 0x7f6c38071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f6c40200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3806e530 con 0x7f6c38159b00 2024-04-25T09:04:16.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f6c40200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c38072120 con 0x7f6c380ccb20 2024-04-25T09:04:16.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f6c40200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c3806e810 con 0x7f6c38159ee0 2024-04-25T09:04:16.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f31e4e00640 1 -- 172.21.15.175:0/164570141 shutdown_connections 2024-04-25T09:04:16.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f8807400640 1 -- 172.21.15.175:0/3199759445 >> v2:172.21.15.175:3300/0 conn(0x7f8808159b00 msgr2=0x7f88080b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f46ed800640 1 Processor -- start 2024-04-25T09:04:16.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f6c3e200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6c38159ee0 0x7f6c38071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f185b000640 1 Processor -- start 2024-04-25T09:04:16.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f8807400640 1 --2- 172.21.15.175:0/3199759445 >> v2:172.21.15.175:3300/0 conn(0x7f8808159b00 0x7f88080b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f8807400640 1 -- 172.21.15.175:0/3199759445 >> v1:172.21.15.177:6789/0 conn(0x7f88080ccb20 legacy=0x7f88080712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f8807400640 1 -- 172.21.15.175:0/3199759445 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880806eaf0 con 0x7f88080719e0 2024-04-25T09:04:16.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f46ed800640 1 -- start start 2024-04-25T09:04:16.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f8806a00640 1 --2- 172.21.15.175:0/3199759445 >> v2:172.21.15.175:3300/0 conn(0x7f8808159b00 0x7f88080b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:16.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f185b000640 1 -- start start 2024-04-25T09:04:16.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f6c3e200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6c38159ee0 0x7f6c38071810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:48238/0 (socket says 172.21.15.175:48238) 2024-04-25T09:04:16.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f70d2800640 1 --2- 172.21.15.175:0/1040073654 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70d415d4a0 0x7f70d415fc80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f70cc009d90 tx=0x7f70cc01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7bd833376ee00a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f70d0a00640 1 -- 172.21.15.175:0/1040073654 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc0b2070 con 0x7f70d415d4a0 2024-04-25T09:04:16.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f70d0a00640 1 -- 172.21.15.175:0/1040073654 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc0a57a0 con 0x7f70d415d4a0 2024-04-25T09:04:16.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f70d0a00640 1 -- 172.21.15.175:0/1040073654 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc0a5b70 con 0x7f70d415d4a0 2024-04-25T09:04:16.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f6c3e200640 1 -- 172.21.15.175:0/3713894225 learned_addr learned my addr 172.21.15.175:0/3713894225 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f6c3ce00640 1 --2- 172.21.15.175:0/3713894225 >> v2:172.21.15.175:3300/0 conn(0x7f6c380ccb20 0x7f6c380712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f4f3cc00640 1 Processor -- start 2024-04-25T09:04:16.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f6c3ce00640 1 -- 172.21.15.175:0/3713894225 >> v2:172.21.15.177:3300/0 conn(0x7f6c38159ee0 msgr2=0x7f6c38071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f6c3ce00640 1 --2- 172.21.15.175:0/3713894225 >> v2:172.21.15.177:3300/0 conn(0x7f6c38159ee0 0x7f6c38071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f4f3cc00640 1 -- start start 2024-04-25T09:04:16.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.239+0000 7f31e4e00640 1 -- 172.21.15.175:0/164570141 wait complete. 2024-04-25T09:04:16.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f6c3ce00640 1 -- 172.21.15.175:0/3713894225 >> v1:172.21.15.175:6789/0 conn(0x7f6c38159b00 legacy=0x7f6c380b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f6c3ce00640 1 -- 172.21.15.175:0/3713894225 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3806eaf0 con 0x7f6c380ccb20 2024-04-25T09:04:16.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f185b000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185409aaf0 0x7f18540cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f185b000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f185415b970 0x7f185406c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f185b000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185415f4e0 0x7f185414d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f185b000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18540ccaa0 con 0x7f185415f4e0 2024-04-25T09:04:16.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f185b000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18540cc920 con 0x7f185415b970 2024-04-25T09:04:16.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f185b000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18540ccc20 con 0x7f185409aaf0 2024-04-25T09:04:16.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f31e4e00640 1 Processor -- start 2024-04-25T09:04:16.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f46ed800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46e80b3880 0x7f46e8169c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f46ed800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f46e80b2660 0x7f46e816c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f46ed800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e8162630 con 0x7f46e815c6e0 2024-04-25T09:04:16.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f46ed800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e815cac0 con 0x7f46e80b2660 2024-04-25T09:04:16.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f46ed800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e81628f0 con 0x7f46e80b3880 2024-04-25T09:04:16.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f31e4e00640 1 -- start start 2024-04-25T09:04:16.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f1859c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185409aaf0 0x7f18540cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f1859c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185409aaf0 0x7f18540cb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44136/0 (socket says 172.21.15.175:44136) 2024-04-25T09:04:16.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f1859c00640 1 -- 172.21.15.175:0/538247661 learned_addr learned my addr 172.21.15.175:0/538247661 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f1859200640 1 --2- 172.21.15.175:0/538247661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f185415b970 0x7f185406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f46e6000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46e80b3880 0x7f46e8169c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f46e6000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46e80b3880 0x7f46e8169c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44144/0 (socket says 172.21.15.175:44144) 2024-04-25T09:04:16.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f46e6000640 1 -- 172.21.15.175:0/3320887026 learned_addr learned my addr 172.21.15.175:0/3320887026 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f4f3cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f30005ea0 0x7f4f300dbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f70d9000640 1 -- 172.21.15.175:0/1040073654 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70d415d4a0 msgr2=0x7f70d415fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f70d9000640 1 --2- 172.21.15.175:0/1040073654 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70d415d4a0 0x7f70d415fc80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f70cc009d90 tx=0x7f70cc01c8e0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f70d9000640 1 -- 172.21.15.175:0/1040073654 shutdown_connections 2024-04-25T09:04:16.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f70d9000640 1 --2- 172.21.15.175:0/1040073654 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70d415d4a0 0x7f70d415fc80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f70d9000640 1 --2- 172.21.15.175:0/1040073654 >> v2:172.21.15.177:3300/0 conn(0x7f70d406ac50 0x7f70d406b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f70d9000640 1 -- 172.21.15.175:0/1040073654 >> 172.21.15.175:0/1040073654 conn(0x7f70d4099a50 msgr2=0x7f70d40b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f46e6000640 1 -- 172.21.15.175:0/3320887026 >> v2:172.21.15.175:3300/0 conn(0x7f46e80b2660 msgr2=0x7f46e816c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f46e6000640 1 --2- 172.21.15.175:0/3320887026 >> v2:172.21.15.175:3300/0 conn(0x7f46e80b2660 0x7f46e816c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f46e6000640 1 -- 172.21.15.175:0/3320887026 >> v1:172.21.15.177:6789/0 conn(0x7f46e815c6e0 legacy=0x7f46e80b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f46e6000640 1 -- 172.21.15.175:0/3320887026 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e8162bd0 con 0x7f46e80b3880 2024-04-25T09:04:16.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f46e5600640 1 -- 172.21.15.175:0/3320887026 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989921376 0 0) 0x7f46e8162630 con 0x7f46e815c6e0 2024-04-25T09:04:16.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f185a600640 1 --2- 172.21.15.175:0/538247661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185415f4e0 0x7f185414d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.243+0000 7f31e4e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e00cec30 0x7f31e015c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31e4e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e01624c0 0x7f31e0156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31e4e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e0166b10 0x7f31e00cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f185a600640 1 -- 172.21.15.175:0/538247661 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185409aaf0 msgr2=0x7f18540cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f185a600640 1 --2- 172.21.15.175:0/538247661 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185409aaf0 0x7f18540cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f185a600640 1 -- 172.21.15.175:0/538247661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f185415b970 msgr2=0x7f185406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f185a600640 1 --2- 172.21.15.175:0/538247661 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f185415b970 0x7f185406c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f185a600640 1 -- 172.21.15.175:0/538247661 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18540c8740 con 0x7f185415f4e0 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f185a600640 1 --2- 172.21.15.175:0/538247661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185415f4e0 0x7f185414d6a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f184800e7f0 tx=0x7f184800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f1851600640 1 -- 172.21.15.175:0/538247661 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1848017070 con 0x7f185415f4e0 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f1851600640 1 -- 172.21.15.175:0/538247661 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1848004020 con 0x7f185415f4e0 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f185b000640 1 -- 172.21.15.175:0/538247661 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18540c8a00 con 0x7f185415f4e0 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f185b000640 1 -- 172.21.15.175:0/538247661 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185415d7a0 con 0x7f185415f4e0 2024-04-25T09:04:16.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f1851600640 1 -- 172.21.15.175:0/538247661 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1848017070 con 0x7f185415f4e0 2024-04-25T09:04:16.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31de800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e0166b10 0x7f31e00cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31de800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e0166b10 0x7f31e00cc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:48254/0 (socket says 172.21.15.175:48254) 2024-04-25T09:04:16.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31dd400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e01624c0 0x7f31e0156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31dd400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e01624c0 0x7f31e0156fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44160/0 (socket says 172.21.15.175:44160) 2024-04-25T09:04:16.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31de800640 1 -- 172.21.15.175:0/3416899594 learned_addr learned my addr 172.21.15.175:0/3416899594 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31e4e00640 1 -- 172.21.15.175:0/3416899594 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e01628a0 con 0x7f31e00cec30 2024-04-25T09:04:16.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31e4e00640 1 -- 172.21.15.175:0/3416899594 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00ce260 con 0x7f31e0166b10 2024-04-25T09:04:16.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31e4e00640 1 -- 172.21.15.175:0/3416899594 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e0170db0 con 0x7f31e01624c0 2024-04-25T09:04:16.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31dd400640 1 -- 172.21.15.175:0/3416899594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e0166b10 msgr2=0x7f31e00cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31dd400640 1 --2- 172.21.15.175:0/3416899594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e0166b10 0x7f31e00cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31dd400640 1 -- 172.21.15.175:0/3416899594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e00cec30 msgr2=0x7f31e015c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31dd400640 1 --2- 172.21.15.175:0/3416899594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e00cec30 0x7f31e015c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31dd400640 1 -- 172.21.15.175:0/3416899594 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e0154d00 con 0x7f31e01624c0 2024-04-25T09:04:16.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31dd400640 1 --2- 172.21.15.175:0/3416899594 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e01624c0 0x7f31e0156fc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f31d00ab000 tx=0x7f31d0019040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31d6000640 1 -- 172.21.15.175:0/3416899594 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d00b9070 con 0x7f31e01624c0 2024-04-25T09:04:16.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31d6000640 1 -- 172.21.15.175:0/3416899594 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d00b5680 con 0x7f31e01624c0 2024-04-25T09:04:16.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f3cc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f30033e40 0x7f4f30180c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f3cc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f30047c20 0x7f4f3004c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f3cc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3004fd80 con 0x7f4f30005ea0 2024-04-25T09:04:16.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f3cc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3004f090 con 0x7f4f30033e40 2024-04-25T09:04:16.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f3cc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3004f5c0 con 0x7f4f30047c20 2024-04-25T09:04:16.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f36800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f30047c20 0x7f4f3004c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f36800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f30047c20 0x7f4f3004c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44170/0 (socket says 172.21.15.175:44170) 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f36800640 1 -- 172.21.15.175:0/955281959 learned_addr learned my addr 172.21.15.175:0/955281959 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f35e00640 1 --2- 172.21.15.175:0/955281959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f30005ea0 0x7f4f300dbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f36800640 1 -- 172.21.15.175:0/955281959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f30033e40 msgr2=0x7f4f30180c90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f36800640 1 --2- 172.21.15.175:0/955281959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f30033e40 0x7f4f30180c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f36800640 1 -- 172.21.15.175:0/955281959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f30005ea0 msgr2=0x7f4f300dbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f36800640 1 --2- 172.21.15.175:0/955281959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f30005ea0 0x7f4f300dbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f36800640 1 -- 172.21.15.175:0/955281959 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f301816e0 con 0x7f4f30047c20 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f35e00640 1 --2- 172.21.15.175:0/955281959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f30005ea0 0x7f4f300dbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f36800640 1 --2- 172.21.15.175:0/955281959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f30047c20 0x7f4f3004c620 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4f38069830 tx=0x7f4f38068790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f2e000640 1 -- 172.21.15.175:0/955281959 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f38097070 con 0x7f4f30047c20 2024-04-25T09:04:16.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f70d9000640 1 -- 172.21.15.175:0/1040073654 shutdown_connections 2024-04-25T09:04:16.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f70d9000640 1 -- 172.21.15.175:0/1040073654 wait complete. 2024-04-25T09:04:16.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f70d9000640 1 Processor -- start 2024-04-25T09:04:16.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f8807400640 1 --2- 172.21.15.175:0/3199759445 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88080719e0 0x7f88080cf550 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f87f80097c0 tx=0x7f87f801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95f98ffc8ed439de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f8805600640 1 -- 172.21.15.175:0/3199759445 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f80b1070 con 0x7f88080719e0 2024-04-25T09:04:16.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f8805600640 1 -- 172.21.15.175:0/3199759445 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f80a8050 con 0x7f88080719e0 2024-04-25T09:04:16.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f8805600640 1 -- 172.21.15.175:0/3199759445 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f80b1070 con 0x7f88080719e0 2024-04-25T09:04:16.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f880dc00640 1 -- 172.21.15.175:0/3199759445 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88080719e0 msgr2=0x7f88080cf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f880dc00640 1 --2- 172.21.15.175:0/3199759445 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88080719e0 0x7f88080cf550 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f87f80097c0 tx=0x7f87f801c3e0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31e4e00640 1 -- 172.21.15.175:0/3416899594 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e01551c0 con 0x7f31e01624c0 2024-04-25T09:04:16.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f31e4e00640 1 -- 172.21.15.175:0/3416899594 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e0155780 con 0x7f31e01624c0 2024-04-25T09:04:16.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f6c3ce00640 1 --2- 172.21.15.175:0/3713894225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c380ccb20 0x7f6c380712d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6c3806d590 tx=0x7f6c3001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b06174cedaf80a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f0c5ba00640 1 Processor -- start 2024-04-25T09:04:16.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f0c5ba00640 1 -- start start 2024-04-25T09:04:16.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f3cc00640 1 -- 172.21.15.175:0/955281959 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f301819c0 con 0x7f4f30047c20 2024-04-25T09:04:16.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.247+0000 7f4f3cc00640 1 -- 172.21.15.175:0/955281959 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f30035c20 con 0x7f4f30047c20 2024-04-25T09:04:16.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f70d9000640 1 -- start start 2024-04-25T09:04:16.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f46e6000640 1 --2- 172.21.15.175:0/3320887026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46e80b3880 0x7f46e8169c50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009870 tx=0x7f46d401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=478dbfd4b82480eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f4f2e000640 1 -- 172.21.15.175:0/955281959 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f38074930 con 0x7f4f30047c20 2024-04-25T09:04:16.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f880dc00640 1 -- 172.21.15.175:0/3199759445 shutdown_connections 2024-04-25T09:04:16.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f880dc00640 1 --2- 172.21.15.175:0/3199759445 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88080719e0 0x7f88080cf550 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f4f2e000640 1 -- 172.21.15.175:0/955281959 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f380923f0 con 0x7f4f30047c20 2024-04-25T09:04:16.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f880dc00640 1 --2- 172.21.15.175:0/3199759445 >> v2:172.21.15.175:3300/0 conn(0x7f8808159b00 0x7f88080b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f6c37e00640 1 -- 172.21.15.175:0/3713894225 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c300b0070 con 0x7f6c380ccb20 2024-04-25T09:04:16.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f880dc00640 1 -- 172.21.15.175:0/3199759445 >> 172.21.15.175:0/3199759445 conn(0x7f8808067010 msgr2=0x7f880806ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f31d6000640 1 -- 172.21.15.175:0/3416899594 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d00b0040 con 0x7f31e01624c0 2024-04-25T09:04:16.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f31e4e00640 1 -- 172.21.15.175:0/3416899594 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31b8001040 con 0x7f31e01624c0 2024-04-25T09:04:16.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f6c37e00640 1 -- 172.21.15.175:0/3713894225 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c300ab600 con 0x7f6c380ccb20 2024-04-25T09:04:16.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f6c37e00640 1 -- 172.21.15.175:0/3713894225 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c300b0070 con 0x7f6c380ccb20 2024-04-25T09:04:16.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f1851600640 1 -- 172.21.15.175:0/538247661 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f18480041d0 con 0x7f185415f4e0 2024-04-25T09:04:16.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f880dc00640 1 -- 172.21.15.175:0/3199759445 shutdown_connections 2024-04-25T09:04:16.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f4f3cc00640 1 -- 172.21.15.175:0/955281959 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4f30035790 con 0x7f4f30047c20 2024-04-25T09:04:16.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f70d9000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70d406ac50 0x7f70d4154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f46e5600640 1 -- 172.21.15.175:0/3320887026 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d40a7070 con 0x7f46e80b3880 2024-04-25T09:04:16.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f46e5600640 1 -- 172.21.15.175:0/3320887026 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d40b0070 con 0x7f46e80b3880 2024-04-25T09:04:16.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f46e5600640 1 -- 172.21.15.175:0/3320887026 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d40ab890 con 0x7f46e80b3880 2024-04-25T09:04:16.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f70d9000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70d4099e60 0x7f70d40b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f70d9000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70d415d4a0 0x7f70d414b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f70d9000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d4167260 con 0x7f70d406ac50 2024-04-25T09:04:16.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f70d9000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d40b3010 con 0x7f70d4099e60 2024-04-25T09:04:16.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f70d9000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d41673e0 con 0x7f70d415d4a0 2024-04-25T09:04:16.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f70d2800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70d415d4a0 0x7f70d414b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f70d2800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70d415d4a0 0x7f70d414b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44172/0 (socket says 172.21.15.175:44172) 2024-04-25T09:04:16.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f70d2800640 1 -- 172.21.15.175:0/2417158132 learned_addr learned my addr 172.21.15.175:0/2417158132 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f70d1400640 1 --2- 172.21.15.175:0/2417158132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70d4099e60 0x7f70d40b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f70d2800640 1 -- 172.21.15.175:0/2417158132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70d4099e60 msgr2=0x7f70d40b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f70d2800640 1 --2- 172.21.15.175:0/2417158132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70d4099e60 0x7f70d40b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f70d2800640 1 -- 172.21.15.175:0/2417158132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70d406ac50 msgr2=0x7f70d4154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f70d1e00640 1 --2- 172.21.15.175:0/2417158132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70d406ac50 0x7f70d4154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f70d2800640 1 --2- 172.21.15.175:0/2417158132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70d406ac50 0x7f70d4154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f70d2800640 1 -- 172.21.15.175:0/2417158132 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d40b4610 con 0x7f70d415d4a0 2024-04-25T09:04:16.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f70d1e00640 1 --2- 172.21.15.175:0/2417158132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70d406ac50 0x7f70d4154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:16.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f1851600640 1 --2- 172.21.15.175:0/538247661 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1834067160 0x7f1834069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f1851600640 1 -- 172.21.15.175:0/538247661 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1848084910 con 0x7f185415f4e0 2024-04-25T09:04:16.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f185b000640 1 --2- 172.21.15.175:0/538247661 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x7f1830001660 0x7f1830003b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f185b000640 1 -- 172.21.15.175:0/538247661 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1830006bc0 con 0x7f1830001660 2024-04-25T09:04:16.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f1859c00640 1 --2- 172.21.15.175:0/538247661 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1834067160 0x7f1834069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f46ed800640 1 -- 172.21.15.175:0/3320887026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46e80b3880 msgr2=0x7f46e8169c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f46ed800640 1 --2- 172.21.15.175:0/3320887026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46e80b3880 0x7f46e8169c50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009870 tx=0x7f46d401c560 comp rx=0 tx=0).stop 2024-04-25T09:04:16.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f46ed800640 1 -- 172.21.15.175:0/3320887026 shutdown_connections 2024-04-25T09:04:16.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f46ed800640 1 --2- 172.21.15.175:0/3320887026 >> v2:172.21.15.175:3300/0 conn(0x7f46e80b2660 0x7f46e816c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f46ed800640 1 --2- 172.21.15.175:0/3320887026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46e80b3880 0x7f46e8169c50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f46ed800640 1 -- 172.21.15.175:0/3320887026 >> 172.21.15.175:0/3320887026 conn(0x7f46e806ac50 msgr2=0x7f46e806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f0c5ba00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0c541544d0 0x7f0c540712d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f0c5ba00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0c54071810 0x7f0c540b3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f0c5ba00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5406f1c0 con 0x7f0c541540f0 2024-04-25T09:04:16.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f0c5ba00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c540b2df0 con 0x7f0c541544d0 2024-04-25T09:04:16.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f0c5ba00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5406ec00 con 0x7f0c54071810 2024-04-25T09:04:16.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f880dc00640 1 -- 172.21.15.175:0/3199759445 wait complete. 2024-04-25T09:04:16.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f46ed800640 1 -- 172.21.15.175:0/3320887026 shutdown_connections 2024-04-25T09:04:16.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f0c53e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0c541544d0 0x7f0c540712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f0c53e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0c541544d0 0x7f0c540712d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36498/0 (socket says 172.21.15.175:36498) 2024-04-25T09:04:16.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f0c53e00640 1 -- 172.21.15.175:0/2411178911 learned_addr learned my addr 172.21.15.175:0/2411178911 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f0c59a00640 1 --2- 172.21.15.175:0/2411178911 >> v2:172.21.15.177:3300/0 conn(0x7f0c54071810 0x7f0c540b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.251+0000 7f46ed800640 1 -- 172.21.15.175:0/3320887026 wait complete. 2024-04-25T09:04:16.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f0c59a00640 1 -- 172.21.15.175:0/2411178911 >> v2:172.21.15.175:3300/0 conn(0x7f0c541544d0 msgr2=0x7f0c540712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f0c53400640 1 -- 172.21.15.175:0/2411178911 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201068941 0 0) 0x7f0c5406f1c0 con 0x7f0c541540f0 2024-04-25T09:04:16.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f70d2800640 1 --2- 172.21.15.175:0/2417158132 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70d415d4a0 0x7f70d414b8d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0b0040 tx=0x7f70cc019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f4f2e000640 1 -- 172.21.15.175:0/955281959 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4f3809a070 con 0x7f4f30047c20 2024-04-25T09:04:16.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f0c59a00640 1 --2- 172.21.15.175:0/2411178911 >> v2:172.21.15.175:3300/0 conn(0x7f0c541544d0 0x7f0c540712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f0c59a00640 1 -- 172.21.15.175:0/2411178911 >> v1:172.21.15.177:6789/0 conn(0x7f0c541540f0 legacy=0x7f0c5406e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f6c40200640 1 -- 172.21.15.175:0/3713894225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c380ccb20 msgr2=0x7f6c380712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f6c40200640 1 --2- 172.21.15.175:0/3713894225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c380ccb20 0x7f6c380712d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6c3806d590 tx=0x7f6c3001c380 comp rx=0 tx=0).stop 2024-04-25T09:04:16.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f0c59a00640 1 -- 172.21.15.175:0/2411178911 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5406eee0 con 0x7f0c54071810 2024-04-25T09:04:16.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f0c53e00640 1 --2- 172.21.15.175:0/2411178911 >> v2:172.21.15.175:3300/0 conn(0x7f0c541544d0 0x7f0c540712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:16.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f6c40200640 1 -- 172.21.15.175:0/3713894225 shutdown_connections 2024-04-25T09:04:16.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f6c40200640 1 --2- 172.21.15.175:0/3713894225 >> v2:172.21.15.177:3300/0 conn(0x7f6c38159ee0 0x7f6c38071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f6c40200640 1 --2- 172.21.15.175:0/3713894225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c380ccb20 0x7f6c380712d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f6c40200640 1 -- 172.21.15.175:0/3713894225 >> 172.21.15.175:0/3713894225 conn(0x7f6c38067010 msgr2=0x7f6c3806ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f6c40200640 1 -- 172.21.15.175:0/3713894225 shutdown_connections 2024-04-25T09:04:16.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f1859200640 1 --2- 172.21.15.175:0/538247661 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x7f1830001660 0x7f1830003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f1859c00640 1 --2- 172.21.15.175:0/538247661 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1834067160 0x7f1834069620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f184c007fd0 tx=0x7f184c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f1859200640 1 --2- 172.21.15.175:0/538247661 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x7f1830001660 0x7f1830003b20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f46ed800640 1 Processor -- start 2024-04-25T09:04:16.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f6c40200640 1 -- 172.21.15.175:0/3713894225 wait complete. 2024-04-25T09:04:16.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f31d6000640 1 -- 172.21.15.175:0/3416899594 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f31d00bc070 con 0x7f31e01624c0 2024-04-25T09:04:16.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f46ed800640 1 -- start start 2024-04-25T09:04:16.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f1851600640 1 -- 172.21.15.175:0/538247661 <== osd.0 v2:172.21.15.175:6800/1093269849 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1830006bc0 con 0x7f1830001660 2024-04-25T09:04:16.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f4f2e000640 1 --2- 172.21.15.175:0/955281959 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4f18067060 0x7f4f18069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f46ed800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46e80b2660 0x7f46e81fbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f4f2e000640 1 -- 172.21.15.175:0/955281959 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f380ff380 con 0x7f4f30047c20 2024-04-25T09:04:16.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f31d6000640 1 --2- 172.21.15.175:0/3416899594 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f31c0066f60 0x7f31c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f70ca000640 1 -- 172.21.15.175:0/2417158132 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc0c9070 con 0x7f70d415d4a0 2024-04-25T09:04:16.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f70ca000640 1 -- 172.21.15.175:0/2417158132 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc0a5950 con 0x7f70d415d4a0 2024-04-25T09:04:16.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f70ca000640 1 -- 172.21.15.175:0/2417158132 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc0a5d20 con 0x7f70d415d4a0 2024-04-25T09:04:16.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f70d9000640 1 -- 172.21.15.175:0/2417158132 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d40b48f0 con 0x7f70d415d4a0 2024-04-25T09:04:16.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f70d9000640 1 -- 172.21.15.175:0/2417158132 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d40b4eb0 con 0x7f70d415d4a0 2024-04-25T09:04:16.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.255+0000 7f70d9000640 1 -- 172.21.15.175:0/2417158132 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70d4075160 con 0x7f70d415d4a0 2024-04-25T09:04:16.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f880dc00640 1 Processor -- start 2024-04-25T09:04:16.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f4f2e000640 1 --2- 172.21.15.175:0/955281959 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x7f4f1806f280 0x7f4f180716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46ed800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e815c6e0 0x7f46e81fc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46ed800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46e815bbb0 0x7f46e80cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f4f2e000640 1 -- 172.21.15.175:0/955281959 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4f38093e80 con 0x7f4f1806f280 2024-04-25T09:04:16.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f4f2e000640 1 -- 172.21.15.175:0/955281959 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f38106050 con 0x7f4f30047c20 2024-04-25T09:04:16.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46ed800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e8165980 con 0x7f46e80b2660 2024-04-25T09:04:16.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46e6a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46e80b2660 0x7f46e81fbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46e6a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46e80b2660 0x7f46e81fbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36506/0 (socket says 172.21.15.175:36506) 2024-04-25T09:04:16.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46e6a00640 1 -- 172.21.15.175:0/2548573086 learned_addr learned my addr 172.21.15.175:0/2548573086 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f880dc00640 1 -- start start 2024-04-25T09:04:16.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46ed800640 1 -- 172.21.15.175:0/2548573086 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e8165800 con 0x7f46e815c6e0 2024-04-25T09:04:16.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46ed800640 1 -- 172.21.15.175:0/2548573086 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e816ef00 con 0x7f46e815bbb0 2024-04-25T09:04:16.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46e7400640 1 --2- 172.21.15.175:0/2548573086 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46e815bbb0 0x7f46e80cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46e6000640 1 --2- 172.21.15.175:0/2548573086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e815c6e0 0x7f46e81fc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f4f35400640 1 --2- 172.21.15.175:0/955281959 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x7f4f1806f280 0x7f4f180716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46e6a00640 1 -- 172.21.15.175:0/2548573086 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46e815bbb0 msgr2=0x7f46e80cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46e6a00640 1 --2- 172.21.15.175:0/2548573086 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46e815bbb0 0x7f46e80cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46e6a00640 1 -- 172.21.15.175:0/2548573086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e815c6e0 msgr2=0x7f46e81fc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46e6a00640 1 --2- 172.21.15.175:0/2548573086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e815c6e0 0x7f46e81fc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46e6a00640 1 -- 172.21.15.175:0/2548573086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e80d0360 con 0x7f46e80b2660 2024-04-25T09:04:16.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46e7400640 1 --2- 172.21.15.175:0/2548573086 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46e815bbb0 0x7f46e80cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:16.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46e6a00640 1 --2- 172.21.15.175:0/2548573086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46e80b2660 0x7f46e81fbc30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f46e000c790 tx=0x7f46e000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f6c40200640 1 Processor -- start 2024-04-25T09:04:16.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f880dc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88080719e0 0x7f88081689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f880dc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88080ccb20 0x7f8808167e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f880dc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8808159b00 0x7f8808168370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f880dc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88080b42b0 con 0x7f8808159b00 2024-04-25T09:04:16.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f880dc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88080b4130 con 0x7f88080719e0 2024-04-25T09:04:16.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f880dc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88080d02a0 con 0x7f88080ccb20 2024-04-25T09:04:16.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f4f35400640 1 --2- 172.21.15.175:0/955281959 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x7f4f1806f280 0x7f4f180716a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46dea00640 1 -- 172.21.15.175:0/2548573086 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0003db0 con 0x7f46e80b2660 2024-04-25T09:04:16.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f8806000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88080ccb20 0x7f8808167e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f8806000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88080ccb20 0x7f8808167e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44190/0 (socket says 172.21.15.175:44190) 2024-04-25T09:04:16.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f8806000640 1 -- 172.21.15.175:0/207422121 learned_addr learned my addr 172.21.15.175:0/207422121 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46ed800640 1 -- 172.21.15.175:0/2548573086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e815c020 con 0x7f46e80b2660 2024-04-25T09:04:16.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46ed800640 1 -- 172.21.15.175:0/2548573086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e80cdc00 con 0x7f46e80b2660 2024-04-25T09:04:16.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f4f2e000640 1 -- 172.21.15.175:0/955281959 <== osd.2 v2:172.21.15.175:6821/3247063283 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4f38093e80 con 0x7f4f1806f280 2024-04-25T09:04:16.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f8806000640 1 -- 172.21.15.175:0/207422121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88080719e0 msgr2=0x7f88081689b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T09:04:16.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f8806000640 1 --2- 172.21.15.175:0/207422121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88080719e0 0x7f88081689b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f8806000640 1 -- 172.21.15.175:0/207422121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8808159b00 msgr2=0x7f8808168370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T09:04:16.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f8806000640 1 --2- 172.21.15.175:0/207422121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8808159b00 0x7f8808168370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f8806000640 1 -- 172.21.15.175:0/207422121 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8808166dd0 con 0x7f88080ccb20 2024-04-25T09:04:16.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f46ed800640 1 -- 172.21.15.175:0/2548573086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46e8075160 con 0x7f46e80b2660 2024-04-25T09:04:16.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f8806000640 1 --2- 172.21.15.175:0/207422121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88080ccb20 0x7f8808167e30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f880000cbf0 tx=0x7f880000a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f31d6000640 1 -- 172.21.15.175:0/3416899594 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31d011f250 con 0x7f31e01624c0 2024-04-25T09:04:16.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f31d6000640 1 --2- 172.21.15.175:0/3416899594 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x7f31c006f180 0x7f31c00715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f31d6000640 1 -- 172.21.15.175:0/3416899594 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31d0007e50 con 0x7f31c006f180 2024-04-25T09:04:16.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f31d6000640 1 -- 172.21.15.175:0/3416899594 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31d0126050 con 0x7f31e01624c0 2024-04-25T09:04:16.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f31de800640 1 --2- 172.21.15.175:0/3416899594 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x7f31c006f180 0x7f31c00715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f4f35e00640 1 --2- 172.21.15.175:0/955281959 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4f18067060 0x7f4f18069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.259+0000 7f6c40200640 1 -- start start 2024-04-25T09:04:16.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f6c40200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c380ccb20 0x7f6c38158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f6c40200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c38159b00 0x7f6c381462b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f6c40200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c38159ee0 0x7f6c381467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f6c40200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3806b4e0 con 0x7f6c38159ee0 2024-04-25T09:04:16.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f6c40200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3806b360 con 0x7f6c380ccb20 2024-04-25T09:04:16.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f6c40200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c380cfd60 con 0x7f6c38159b00 2024-04-25T09:04:16.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f6c3ce00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c38159b00 0x7f6c381462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f6c3d800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c380ccb20 0x7f6c38158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f6c3d800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c380ccb20 0x7f6c38158150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:48300/0 (socket says 172.21.15.175:48300) 2024-04-25T09:04:16.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f6c3d800640 1 -- 172.21.15.175:0/4130351960 learned_addr learned my addr 172.21.15.175:0/4130351960 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f6c3e200640 1 --2- 172.21.15.175:0/4130351960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c38159ee0 0x7f6c381467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f6c3ce00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c38159b00 0x7f6c381462b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44204/0 (socket says 172.21.15.175:44204) 2024-04-25T09:04:16.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f46dea00640 1 -- 172.21.15.175:0/2548573086 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e8075160 con 0x7f46e80b2660 2024-04-25T09:04:16.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f46dea00640 1 -- 172.21.15.175:0/2548573086 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0005270 con 0x7f46e80b2660 2024-04-25T09:04:16.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f0c59a00640 1 --2- 172.21.15.175:0/2411178911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c54071810 0x7f0c540b3280 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00c310 tx=0x7f0c4c01de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2824526db0ae88a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f0c53400640 1 -- 172.21.15.175:0/2411178911 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c0a6d50 con 0x7f0c54071810 2024-04-25T09:04:16.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f0c53400640 1 -- 172.21.15.175:0/2411178911 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c00a0d0 con 0x7f0c54071810 2024-04-25T09:04:16.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f0c53400640 1 -- 172.21.15.175:0/2411178911 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c00a4a0 con 0x7f0c54071810 2024-04-25T09:04:16.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f0c5ba00640 1 -- 172.21.15.175:0/2411178911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c54071810 msgr2=0x7f0c540b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f0c5ba00640 1 --2- 172.21.15.175:0/2411178911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c54071810 0x7f0c540b3280 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c00c310 tx=0x7f0c4c01de10 comp rx=0 tx=0).stop 2024-04-25T09:04:16.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f0c5ba00640 1 -- 172.21.15.175:0/2411178911 shutdown_connections 2024-04-25T09:04:16.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f0c5ba00640 1 --2- 172.21.15.175:0/2411178911 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c54071810 0x7f0c540b3280 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f0c5ba00640 1 --2- 172.21.15.175:0/2411178911 >> v2:172.21.15.175:3300/0 conn(0x7f0c541544d0 0x7f0c540712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f0c5ba00640 1 -- 172.21.15.175:0/2411178911 >> 172.21.15.175:0/2411178911 conn(0x7f0c5406ac50 msgr2=0x7f0c5406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f0c5ba00640 1 -- 172.21.15.175:0/2411178911 shutdown_connections 2024-04-25T09:04:16.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f4f35e00640 1 --2- 172.21.15.175:0/955281959 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4f18067060 0x7f4f18069520 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4f280b2000 tx=0x7f4f280aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f0c5ba00640 1 -- 172.21.15.175:0/2411178911 wait complete. 2024-04-25T09:04:16.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f31dde00640 1 --2- 172.21.15.175:0/3416899594 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f31c0066f60 0x7f31c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f31de800640 1 --2- 172.21.15.175:0/3416899594 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x7f31c006f180 0x7f31c00715a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f70ca000640 1 -- 172.21.15.175:0/2417158132 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f70cc0cc070 con 0x7f70d415d4a0 2024-04-25T09:04:16.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f70ca000640 1 --2- 172.21.15.175:0/2417158132 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f70b4066fb0 0x7f70b4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f6c3e200640 1 -- 172.21.15.175:0/4130351960 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c38159b00 msgr2=0x7f6c381462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f6c3e200640 1 --2- 172.21.15.175:0/4130351960 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c38159b00 0x7f6c381462b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f6c3e200640 1 -- 172.21.15.175:0/4130351960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c380ccb20 msgr2=0x7f6c38158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f6c3e200640 1 --2- 172.21.15.175:0/4130351960 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c380ccb20 0x7f6c38158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f6c3e200640 1 -- 172.21.15.175:0/4130351960 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c38158b30 con 0x7f6c38159ee0 2024-04-25T09:04:16.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f6c3e200640 1 --2- 172.21.15.175:0/4130351960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c38159ee0 0x7f6c381467f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400d5a0 tx=0x7f6c2400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f87fea00640 1 -- 172.21.15.175:0/207422121 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800017070 con 0x7f88080ccb20 2024-04-25T09:04:16.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f87fea00640 1 -- 172.21.15.175:0/207422121 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880000ad50 con 0x7f88080ccb20 2024-04-25T09:04:16.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f87fea00640 1 -- 172.21.15.175:0/207422121 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800012600 con 0x7f88080ccb20 2024-04-25T09:04:16.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f880dc00640 1 -- 172.21.15.175:0/207422121 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8808167070 con 0x7f88080ccb20 2024-04-25T09:04:16.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f880dc00640 1 -- 172.21.15.175:0/207422121 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8808167630 con 0x7f88080ccb20 2024-04-25T09:04:16.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.263+0000 7f880dc00640 1 -- 172.21.15.175:0/207422121 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f87e0001040 con 0x7f88080ccb20 2024-04-25T09:04:16.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f70ca000640 1 -- 172.21.15.175:0/2417158132 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70cc127e20 con 0x7f70d415d4a0 2024-04-25T09:04:16.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f70ca000640 1 --2- 172.21.15.175:0/2417158132 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x7f70b406f1d0 0x7f70b40715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f70ca000640 1 -- 172.21.15.175:0/2417158132 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70cc0afe90 con 0x7f70b406f1d0 2024-04-25T09:04:16.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f70ca000640 1 -- 172.21.15.175:0/2417158132 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70cc128300 con 0x7f70d415d4a0 2024-04-25T09:04:16.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f87fea00640 1 -- 172.21.15.175:0/207422121 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f880001a070 con 0x7f88080ccb20 2024-04-25T09:04:16.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f0c5ba00640 1 Processor -- start 2024-04-25T09:04:16.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f0c5ba00640 1 -- start start 2024-04-25T09:04:16.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f70d1e00640 1 --2- 172.21.15.175:0/2417158132 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f70b4066fb0 0x7f70b4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f31dde00640 1 --2- 172.21.15.175:0/3416899594 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f31c0066f60 0x7f31c0069420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f31cc000c10 tx=0x7f31cc0014c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f6c35600640 1 -- 172.21.15.175:0/4130351960 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24018030 con 0x7f6c38159ee0 2024-04-25T09:04:16.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f6c35600640 1 -- 172.21.15.175:0/4130351960 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c24004020 con 0x7f6c38159ee0 2024-04-25T09:04:16.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f6c35600640 1 -- 172.21.15.175:0/4130351960 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c240041f0 con 0x7f6c38159ee0 2024-04-25T09:04:16.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f70d1400640 1 --2- 172.21.15.175:0/2417158132 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x7f70b406f1d0 0x7f70b40715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f70d1e00640 1 --2- 172.21.15.175:0/2417158132 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f70b4066fb0 0x7f70b4069470 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f70d40cef40 tx=0x7f70c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f0c5ba00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c54071810 0x7f0c541ff0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f0c5ba00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c541540f0 0x7f0c5414ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f0c5ba00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c541544d0 0x7f0c540cf250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f0c5ba00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5415b530 con 0x7f0c54071810 2024-04-25T09:04:16.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f0c5ba00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5415b3b0 con 0x7f0c541544d0 2024-04-25T09:04:16.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f0c5ba00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c540b3fd0 con 0x7f0c541540f0 2024-04-25T09:04:16.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f87fea00640 1 --2- 172.21.15.175:0/207422121 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f87e8066fb0 0x7f87e8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f0c59a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c541544d0 0x7f0c540cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f0c59a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c541544d0 0x7f0c540cf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:48316/0 (socket says 172.21.15.175:48316) 2024-04-25T09:04:16.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f0c59a00640 1 -- 172.21.15.175:0/3445349330 learned_addr learned my addr 172.21.15.175:0/3445349330 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f6c40200640 1 -- 172.21.15.175:0/4130351960 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c381fe5b0 con 0x7f6c38159ee0 2024-04-25T09:04:16.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f6c40200640 1 -- 172.21.15.175:0/4130351960 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c381feb70 con 0x7f6c38159ee0 2024-04-25T09:04:16.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f87fea00640 1 -- 172.21.15.175:0/207422121 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8800085520 con 0x7f88080ccb20 2024-04-25T09:04:16.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f0c53e00640 1 --2- 172.21.15.175:0/3445349330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c541540f0 0x7f0c5414ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f46dea00640 1 -- 172.21.15.175:0/2548573086 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f46e00054d0 con 0x7f46e80b2660 2024-04-25T09:04:16.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f46dea00640 1 --2- 172.21.15.175:0/2548573086 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f46c8066f60 0x7f46c8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.267+0000 7f46dea00640 1 -- 172.21.15.175:0/2548573086 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46e0085650 con 0x7f46e80b2660 2024-04-25T09:04:16.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f46dea00640 1 --2- 172.21.15.175:0/2548573086 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x7f46c806f100 0x7f46c8071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f31d6000640 1 -- 172.21.15.175:0/3416899594 <== osd.1 v2:172.21.15.175:6802/594808902 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f31d0007e50 con 0x7f31c006f180 2024-04-25T09:04:16.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f46dea00640 1 -- 172.21.15.175:0/2548573086 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46c8071bd0 con 0x7f46c806f100 2024-04-25T09:04:16.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f46dea00640 1 -- 172.21.15.175:0/2548573086 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46e0085ae0 con 0x7f46e80b2660 2024-04-25T09:04:16.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f8806a00640 1 --2- 172.21.15.175:0/207422121 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f87e8066fb0 0x7f87e8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f0c59a00640 1 -- 172.21.15.175:0/3445349330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c541540f0 msgr2=0x7f0c5414ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f0c59a00640 1 --2- 172.21.15.175:0/3445349330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c541540f0 0x7f0c5414ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f0c59a00640 1 -- 172.21.15.175:0/3445349330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c54071810 msgr2=0x7f0c541ff0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f0c59a00640 1 --2- 172.21.15.175:0/3445349330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c54071810 0x7f0c541ff0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f46e6000640 1 --2- 172.21.15.175:0/2548573086 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f46c8066f60 0x7f46c8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f0c59a00640 1 -- 172.21.15.175:0/3445349330 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c541ff5f0 con 0x7f0c541544d0 2024-04-25T09:04:16.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f70d1400640 1 --2- 172.21.15.175:0/2417158132 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x7f70b406f1d0 0x7f70b40715f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f6c40200640 1 -- 172.21.15.175:0/4130351960 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6c38075160 con 0x7f6c38159ee0 2024-04-25T09:04:16.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f46e7400640 1 --2- 172.21.15.175:0/2548573086 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x7f46c806f100 0x7f46c8071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f0c59a00640 1 --2- 172.21.15.175:0/3445349330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c541544d0 0x7f0c540cf250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c01aa20 tx=0x7f0c4c01abb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f0c50c00640 1 -- 172.21.15.175:0/3445349330 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c00a480 con 0x7f0c541544d0 2024-04-25T09:04:16.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f0c50c00640 1 -- 172.21.15.175:0/3445349330 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c0be070 con 0x7f0c541544d0 2024-04-25T09:04:16.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f0c50c00640 1 -- 172.21.15.175:0/3445349330 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c00a880 con 0x7f0c541544d0 2024-04-25T09:04:16.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f0c5ba00640 1 -- 172.21.15.175:0/3445349330 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c54154a50 con 0x7f0c541544d0 2024-04-25T09:04:16.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f87fea00640 1 --2- 172.21.15.175:0/207422121 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x7f87e806f1d0 0x7f87e80715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f87fea00640 1 -- 172.21.15.175:0/207422121 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8800013e50 con 0x7f87e806f1d0 2024-04-25T09:04:16.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f87fea00640 1 -- 172.21.15.175:0/207422121 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88000858d0 con 0x7f88080ccb20 2024-04-25T09:04:16.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f0c5ba00640 1 -- 172.21.15.175:0/3445349330 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c54155010 con 0x7f0c541544d0 2024-04-25T09:04:16.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f8807400640 1 --2- 172.21.15.175:0/207422121 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x7f87e806f1d0 0x7f87e80715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f8806a00640 1 --2- 172.21.15.175:0/207422121 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f87e8066fb0 0x7f87e8069470 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009970 tx=0x7f87f4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f70ca000640 1 -- 172.21.15.175:0/2417158132 <== osd.3 v2:172.21.15.175:6816/4078277957 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f70cc0afe90 con 0x7f70b406f1d0 2024-04-25T09:04:16.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.271+0000 7f0c5ba00640 1 -- 172.21.15.175:0/3445349330 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c54075160 con 0x7f0c541544d0 2024-04-25T09:04:16.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.275+0000 7f46e6000640 1 --2- 172.21.15.175:0/2548573086 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f46c8066f60 0x7f46c8069420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f46d40af000 tx=0x7f46d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.275+0000 7f46e7400640 1 --2- 172.21.15.175:0/2548573086 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x7f46c806f100 0x7f46c8071520 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.275+0000 7f8807400640 1 --2- 172.21.15.175:0/207422121 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x7f87e806f1d0 0x7f87e80715f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.275+0000 7f87fea00640 1 -- 172.21.15.175:0/207422121 <== osd.5 v2:172.21.15.177:6816/3311807078 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8800013e50 con 0x7f87e806f1d0 2024-04-25T09:04:16.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.275+0000 7f46dea00640 1 -- 172.21.15.175:0/2548573086 <== osd.6 v2:172.21.15.177:6822/4132808595 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f46c8071bd0 con 0x7f46c806f100 2024-04-25T09:04:16.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.275+0000 7f0c50c00640 1 -- 172.21.15.175:0/3445349330 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0c4c0c3460 con 0x7f0c541544d0 2024-04-25T09:04:16.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.275+0000 7f6c35600640 1 -- 172.21.15.175:0/4130351960 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6c2401b070 con 0x7f6c38159ee0 2024-04-25T09:04:16.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.275+0000 7f6c35600640 1 --2- 172.21.15.175:0/4130351960 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6c18066fe0 0x7f6c180694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.275+0000 7f6c3d800640 1 --2- 172.21.15.175:0/4130351960 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6c18066fe0 0x7f6c180694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.275+0000 7f6c35600640 1 -- 172.21.15.175:0/4130351960 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c24054280 con 0x7f6c38159ee0 2024-04-25T09:04:16.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.275+0000 7f0c50c00640 1 --2- 172.21.15.175:0/3445349330 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0c34066f60 0x7f0c34069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.275+0000 7f6c35600640 1 --2- 172.21.15.175:0/4130351960 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x7f6c1806fee0 0x7f6c18072380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.275+0000 7f6c35600640 1 -- 172.21.15.175:0/4130351960 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c18072a50 con 0x7f6c1806fee0 2024-04-25T09:04:16.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.275+0000 7f6c35600640 1 -- 172.21.15.175:0/4130351960 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c24052c10 con 0x7f6c38159ee0 2024-04-25T09:04:16.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.275+0000 7f0c50c00640 1 -- 172.21.15.175:0/3445349330 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c4c120fe0 con 0x7f0c541544d0 2024-04-25T09:04:16.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.275+0000 7f0c50c00640 1 --2- 172.21.15.175:0/3445349330 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x7f0c3406f180 0x7f0c340715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.275+0000 7f0c50c00640 1 -- 172.21.15.175:0/3445349330 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c4c00a0d0 con 0x7f0c3406f180 2024-04-25T09:04:16.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.275+0000 7f0c50c00640 1 -- 172.21.15.175:0/3445349330 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c4c1213d0 con 0x7f0c541544d0 2024-04-25T09:04:16.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.279+0000 7f6c3ce00640 1 --2- 172.21.15.175:0/4130351960 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x7f6c1806fee0 0x7f6c18072380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.279+0000 7f0c59000640 1 --2- 172.21.15.175:0/3445349330 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0c34066f60 0x7f0c34069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.279+0000 7f0c53e00640 1 --2- 172.21.15.175:0/3445349330 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x7f0c3406f180 0x7f0c340715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.279+0000 7f6c3d800640 1 --2- 172.21.15.175:0/4130351960 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6c18066fe0 0x7f6c180694a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c001f60 tx=0x7f6c2c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.279+0000 7f0c53e00640 1 --2- 172.21.15.175:0/3445349330 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x7f0c3406f180 0x7f0c340715a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.279+0000 7f6c3ce00640 1 --2- 172.21.15.175:0/4130351960 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x7f6c1806fee0 0x7f6c18072380 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.279+0000 7f0c59000640 1 --2- 172.21.15.175:0/3445349330 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0c34066f60 0x7f0c34069420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0c48007fd0 tx=0x7f0c48007920 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.279+0000 7f6c35600640 1 -- 172.21.15.175:0/4130351960 <== osd.4 v2:172.21.15.177:6808/236493968 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6c18072a50 con 0x7f6c1806fee0 2024-04-25T09:04:16.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.283+0000 7f0c50c00640 1 -- 172.21.15.175:0/3445349330 <== osd.7 v2:172.21.15.177:6800/3881136076 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0c4c00a0d0 con 0x7f0c3406f180 2024-04-25T09:04:16.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.283+0000 7f4f3cc00640 1 -- 172.21.15.175:0/955281959 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4f30035e20 con 0x7f4f1806f280 2024-04-25T09:04:16.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.287+0000 7f4f2e000640 1 -- 172.21.15.175:0/955281959 <== osd.2 v2:172.21.15.175:6821/3247063283 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4f30035e20 con 0x7f4f1806f280 2024-04-25T09:04:16.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.291+0000 7f4f3cc00640 1 -- 172.21.15.175:0/955281959 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x7f4f1806f280 msgr2=0x7f4f180716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.291+0000 7f4f3cc00640 1 --2- 172.21.15.175:0/955281959 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x7f4f1806f280 0x7f4f180716a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.291+0000 7f4f3cc00640 1 -- 172.21.15.175:0/955281959 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4f18067060 msgr2=0x7f4f18069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.291+0000 7f4f3cc00640 1 --2- 172.21.15.175:0/955281959 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4f18067060 0x7f4f18069520 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4f280b2000 tx=0x7f4f280aa070 comp rx=0 tx=0).stop 2024-04-25T09:04:16.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.291+0000 7f4f3cc00640 1 -- 172.21.15.175:0/955281959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f30047c20 msgr2=0x7f4f3004c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.291+0000 7f4f3cc00640 1 --2- 172.21.15.175:0/955281959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f30047c20 0x7f4f3004c620 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4f38069830 tx=0x7f4f38068790 comp rx=0 tx=0).stop 2024-04-25T09:04:16.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.291+0000 7f4f36800640 1 -- 172.21.15.175:0/955281959 reap_dead start 2024-04-25T09:04:16.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.291+0000 7f4f3cc00640 1 -- 172.21.15.175:0/955281959 shutdown_connections 2024-04-25T09:04:16.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.291+0000 7f4f3cc00640 1 -- 172.21.15.175:0/955281959 >> 172.21.15.175:0/955281959 conn(0x7f4f30009fc0 msgr2=0x7f4f30037d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.291+0000 7f4f3cc00640 1 -- 172.21.15.175:0/955281959 shutdown_connections 2024-04-25T09:04:16.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.291+0000 7f4f3cc00640 1 -- 172.21.15.175:0/955281959 wait complete. 2024-04-25T09:04:16.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.291+0000 7f185b000640 1 -- 172.21.15.175:0/538247661 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1830005c50 con 0x7f1830001660 2024-04-25T09:04:16.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.295+0000 7f1851600640 1 -- 172.21.15.175:0/538247661 <== osd.0 v2:172.21.15.175:6800/1093269849 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1830005c50 con 0x7f1830001660 2024-04-25T09:04:16.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.295+0000 7f185b000640 1 -- 172.21.15.175:0/538247661 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x7f1830001660 msgr2=0x7f1830003b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.295+0000 7f185b000640 1 --2- 172.21.15.175:0/538247661 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x7f1830001660 0x7f1830003b20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.295+0000 7f185b000640 1 -- 172.21.15.175:0/538247661 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1834067160 msgr2=0x7f1834069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.295+0000 7f185b000640 1 --2- 172.21.15.175:0/538247661 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1834067160 0x7f1834069620 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f184c007fd0 tx=0x7f184c009040 comp rx=0 tx=0).stop 2024-04-25T09:04:16.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.295+0000 7f185b000640 1 -- 172.21.15.175:0/538247661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185415f4e0 msgr2=0x7f185414d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.295+0000 7f185b000640 1 --2- 172.21.15.175:0/538247661 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185415f4e0 0x7f185414d6a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f184800e7f0 tx=0x7f184800ecb0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.295+0000 7f185a600640 1 -- 172.21.15.175:0/538247661 reap_dead start 2024-04-25T09:04:16.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.295+0000 7f185b000640 1 -- 172.21.15.175:0/538247661 shutdown_connections 2024-04-25T09:04:16.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.295+0000 7f185b000640 1 -- 172.21.15.175:0/538247661 >> 172.21.15.175:0/538247661 conn(0x7f18540b3160 msgr2=0x7f1854166760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.295+0000 7f185b000640 1 -- 172.21.15.175:0/538247661 shutdown_connections 2024-04-25T09:04:16.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.295+0000 7f185b000640 1 -- 172.21.15.175:0/538247661 wait complete. 2024-04-25T09:04:16.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.299+0000 7f31e4e00640 1 -- 172.21.15.175:0/3416899594 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f31b8002de0 con 0x7f31c006f180 2024-04-25T09:04:16.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.303+0000 7f31d6000640 1 -- 172.21.15.175:0/3416899594 <== osd.1 v2:172.21.15.175:6802/594808902 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f31b8002de0 con 0x7f31c006f180 2024-04-25T09:04:16.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.299+0000 7f70d9000640 1 -- 172.21.15.175:0/2417158132 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f70d415c280 con 0x7f70b406f1d0 2024-04-25T09:04:16.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.303+0000 7f31e4e00640 1 -- 172.21.15.175:0/3416899594 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x7f31c006f180 msgr2=0x7f31c00715a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.303+0000 7f31e4e00640 1 --2- 172.21.15.175:0/3416899594 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x7f31c006f180 0x7f31c00715a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.303+0000 7f31e4e00640 1 -- 172.21.15.175:0/3416899594 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f31c0066f60 msgr2=0x7f31c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.303+0000 7f31e4e00640 1 --2- 172.21.15.175:0/3416899594 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f31c0066f60 0x7f31c0069420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f31cc000c10 tx=0x7f31cc0014c0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.303+0000 7f46ed800640 1 -- 172.21.15.175:0/2548573086 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f46e80ce090 con 0x7f46c806f100 2024-04-25T09:04:16.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.303+0000 7f31e4e00640 1 -- 172.21.15.175:0/3416899594 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e01624c0 msgr2=0x7f31e0156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.303+0000 7f31e4e00640 1 --2- 172.21.15.175:0/3416899594 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e01624c0 0x7f31e0156fc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f31d00ab000 tx=0x7f31d0019040 comp rx=0 tx=0).stop 2024-04-25T09:04:16.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.303+0000 7f31de800640 1 -- 172.21.15.175:0/3416899594 reap_dead start 2024-04-25T09:04:16.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.303+0000 7f46dea00640 1 -- 172.21.15.175:0/2548573086 <== osd.6 v2:172.21.15.177:6822/4132808595 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f46e80ce090 con 0x7f46c806f100 2024-04-25T09:04:16.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.303+0000 7f70ca000640 1 -- 172.21.15.175:0/2417158132 <== osd.3 v2:172.21.15.175:6816/4078277957 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f70d415c280 con 0x7f70b406f1d0 2024-04-25T09:04:16.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.303+0000 7f46ed800640 1 -- 172.21.15.175:0/2548573086 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x7f46c806f100 msgr2=0x7f46c8071520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.303+0000 7f46ed800640 1 --2- 172.21.15.175:0/2548573086 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x7f46c806f100 0x7f46c8071520 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f31e4e00640 1 -- 172.21.15.175:0/3416899594 shutdown_connections 2024-04-25T09:04:16.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f31e4e00640 1 -- 172.21.15.175:0/3416899594 >> 172.21.15.175:0/3416899594 conn(0x7f31e00d0460 msgr2=0x7f31e00c7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f70d9000640 1 -- 172.21.15.175:0/2417158132 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x7f70b406f1d0 msgr2=0x7f70b40715f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f70d9000640 1 --2- 172.21.15.175:0/2417158132 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x7f70b406f1d0 0x7f70b40715f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f31e4e00640 1 -- 172.21.15.175:0/3416899594 shutdown_connections 2024-04-25T09:04:16.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f70d9000640 1 -- 172.21.15.175:0/2417158132 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f70b4066fb0 msgr2=0x7f70b4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f70d9000640 1 --2- 172.21.15.175:0/2417158132 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f70b4066fb0 0x7f70b4069470 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f70d40cef40 tx=0x7f70c4008040 comp rx=0 tx=0).stop 2024-04-25T09:04:16.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f70d9000640 1 -- 172.21.15.175:0/2417158132 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70d415d4a0 msgr2=0x7f70d414b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f31e4e00640 1 -- 172.21.15.175:0/3416899594 wait complete. 2024-04-25T09:04:16.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f70d9000640 1 --2- 172.21.15.175:0/2417158132 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70d415d4a0 0x7f70d414b8d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f70cc0b0040 tx=0x7f70cc019680 comp rx=0 tx=0).stop 2024-04-25T09:04:16.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f46ed800640 1 -- 172.21.15.175:0/2548573086 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f46c8066f60 msgr2=0x7f46c8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f70d2800640 1 -- 172.21.15.175:0/2417158132 reap_dead start 2024-04-25T09:04:16.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f46ed800640 1 --2- 172.21.15.175:0/2548573086 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f46c8066f60 0x7f46c8069420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f46d40af000 tx=0x7f46d4008040 comp rx=0 tx=0).stop 2024-04-25T09:04:16.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f46ed800640 1 -- 172.21.15.175:0/2548573086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46e80b2660 msgr2=0x7f46e81fbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f46ed800640 1 --2- 172.21.15.175:0/2548573086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46e80b2660 0x7f46e81fbc30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f46e000c790 tx=0x7f46e000cc50 comp rx=0 tx=0).stop 2024-04-25T09:04:16.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f46e7400640 1 -- 172.21.15.175:0/2548573086 reap_dead start 2024-04-25T09:04:16.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f70d9000640 1 -- 172.21.15.175:0/2417158132 shutdown_connections 2024-04-25T09:04:16.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f70d9000640 1 -- 172.21.15.175:0/2417158132 >> 172.21.15.175:0/2417158132 conn(0x7f70d4099a50 msgr2=0x7f70d40cfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f70d9000640 1 -- 172.21.15.175:0/2417158132 shutdown_connections 2024-04-25T09:04:16.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f70d9000640 1 -- 172.21.15.175:0/2417158132 wait complete. 2024-04-25T09:04:16.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f880dc00640 1 -- 172.21.15.175:0/207422121 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f87e0002de0 con 0x7f87e806f1d0 2024-04-25T09:04:16.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f46ed800640 1 -- 172.21.15.175:0/2548573086 shutdown_connections 2024-04-25T09:04:16.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f46ed800640 1 -- 172.21.15.175:0/2548573086 >> 172.21.15.175:0/2548573086 conn(0x7f46e806ac50 msgr2=0x7f46e80b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f46ed800640 1 -- 172.21.15.175:0/2548573086 shutdown_connections 2024-04-25T09:04:16.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f46ed800640 1 -- 172.21.15.175:0/2548573086 wait complete. 2024-04-25T09:04:16.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.307+0000 7f87fea00640 1 -- 172.21.15.175:0/207422121 <== osd.5 v2:172.21.15.177:6816/3311807078 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f87e0002de0 con 0x7f87e806f1d0 2024-04-25T09:04:16.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f880dc00640 1 -- 172.21.15.175:0/207422121 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x7f87e806f1d0 msgr2=0x7f87e80715f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f880dc00640 1 --2- 172.21.15.175:0/207422121 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x7f87e806f1d0 0x7f87e80715f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f880dc00640 1 -- 172.21.15.175:0/207422121 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f87e8066fb0 msgr2=0x7f87e8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f880dc00640 1 --2- 172.21.15.175:0/207422121 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f87e8066fb0 0x7f87e8069470 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009970 tx=0x7f87f4009190 comp rx=0 tx=0).stop 2024-04-25T09:04:16.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f880dc00640 1 -- 172.21.15.175:0/207422121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88080ccb20 msgr2=0x7f8808167e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f880dc00640 1 --2- 172.21.15.175:0/207422121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88080ccb20 0x7f8808167e30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f880000cbf0 tx=0x7f880000a430 comp rx=0 tx=0).stop 2024-04-25T09:04:16.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f8807400640 1 -- 172.21.15.175:0/207422121 reap_dead start 2024-04-25T09:04:16.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f880dc00640 1 -- 172.21.15.175:0/207422121 shutdown_connections 2024-04-25T09:04:16.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f880dc00640 1 -- 172.21.15.175:0/207422121 >> 172.21.15.175:0/207422121 conn(0x7f8808067010 msgr2=0x7f88080712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f6c40200640 1 -- 172.21.15.175:0/4130351960 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6c380b10d0 con 0x7f6c1806fee0 2024-04-25T09:04:16.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f0c5ba00640 1 -- 172.21.15.175:0/3445349330 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0c540d02d0 con 0x7f0c3406f180 2024-04-25T09:04:16.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f880dc00640 1 -- 172.21.15.175:0/207422121 shutdown_connections 2024-04-25T09:04:16.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f880dc00640 1 -- 172.21.15.175:0/207422121 wait complete. 2024-04-25T09:04:16.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f6c35600640 1 -- 172.21.15.175:0/4130351960 <== osd.4 v2:172.21.15.177:6808/236493968 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6c380b10d0 con 0x7f6c1806fee0 2024-04-25T09:04:16.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f0c50c00640 1 -- 172.21.15.175:0/3445349330 <== osd.7 v2:172.21.15.177:6800/3881136076 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0c540d02d0 con 0x7f0c3406f180 2024-04-25T09:04:16.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f6c40200640 1 -- 172.21.15.175:0/4130351960 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x7f6c1806fee0 msgr2=0x7f6c18072380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f6c40200640 1 --2- 172.21.15.175:0/4130351960 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x7f6c1806fee0 0x7f6c18072380 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f6c40200640 1 -- 172.21.15.175:0/4130351960 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6c18066fe0 msgr2=0x7f6c180694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f6c40200640 1 --2- 172.21.15.175:0/4130351960 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6c18066fe0 0x7f6c180694a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c001f60 tx=0x7f6c2c009040 comp rx=0 tx=0).stop 2024-04-25T09:04:16.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f6c40200640 1 -- 172.21.15.175:0/4130351960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c38159ee0 msgr2=0x7f6c381467f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f6c40200640 1 --2- 172.21.15.175:0/4130351960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c38159ee0 0x7f6c381467f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400d5a0 tx=0x7f6c2400da60 comp rx=0 tx=0).stop 2024-04-25T09:04:16.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f6c3e200640 1 -- 172.21.15.175:0/4130351960 reap_dead start 2024-04-25T09:04:16.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f6c40200640 1 -- 172.21.15.175:0/4130351960 shutdown_connections 2024-04-25T09:04:16.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f6c40200640 1 -- 172.21.15.175:0/4130351960 >> 172.21.15.175:0/4130351960 conn(0x7f6c38067010 msgr2=0x7f6c380b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.311+0000 7f6c40200640 1 -- 172.21.15.175:0/4130351960 shutdown_connections 2024-04-25T09:04:16.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.315+0000 7f6c40200640 1 -- 172.21.15.175:0/4130351960 wait complete. 2024-04-25T09:04:16.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.315+0000 7f0c5ba00640 1 -- 172.21.15.175:0/3445349330 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x7f0c3406f180 msgr2=0x7f0c340715a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.315+0000 7f0c5ba00640 1 --2- 172.21.15.175:0/3445349330 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x7f0c3406f180 0x7f0c340715a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.315+0000 7f0c5ba00640 1 -- 172.21.15.175:0/3445349330 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0c34066f60 msgr2=0x7f0c34069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.315+0000 7f0c5ba00640 1 --2- 172.21.15.175:0/3445349330 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0c34066f60 0x7f0c34069420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0c48007fd0 tx=0x7f0c48007920 comp rx=0 tx=0).stop 2024-04-25T09:04:16.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.315+0000 7f0c5ba00640 1 -- 172.21.15.175:0/3445349330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c541544d0 msgr2=0x7f0c540cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.315+0000 7f0c5ba00640 1 --2- 172.21.15.175:0/3445349330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c541544d0 0x7f0c540cf250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c01aa20 tx=0x7f0c4c01abb0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.315+0000 7f0c59a00640 1 -- 172.21.15.175:0/3445349330 reap_dead start 2024-04-25T09:04:16.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.315+0000 7f0c5ba00640 1 -- 172.21.15.175:0/3445349330 shutdown_connections 2024-04-25T09:04:16.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.315+0000 7f0c5ba00640 1 -- 172.21.15.175:0/3445349330 >> 172.21.15.175:0/3445349330 conn(0x7f0c5406ac50 msgr2=0x7f0c541504c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.323+0000 7f0c5ba00640 1 -- 172.21.15.175:0/3445349330 shutdown_connections 2024-04-25T09:04:16.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.323+0000 7f0c5ba00640 1 -- 172.21.15.175:0/3445349330 wait complete. 2024-04-25T09:04:16.324 INFO:teuthology.orchestra.run.smithi175.stdout:55834574855 2024-04-25T09:04:16.324 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T09:04:16.332 INFO:teuthology.orchestra.run.smithi175.stdout:55834574857 2024-04-25T09:04:16.332 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T09:04:16.342 INFO:teuthology.orchestra.run.smithi175.stdout:55834574855 2024-04-25T09:04:16.342 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T09:04:16.345 INFO:teuthology.orchestra.run.smithi175.stdout:55834574853 2024-04-25T09:04:16.345 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T09:04:16.352 INFO:teuthology.orchestra.run.smithi175.stdout:55834574854 2024-04-25T09:04:16.352 INFO:teuthology.orchestra.run.smithi175.stdout:55834574856 2024-04-25T09:04:16.352 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T09:04:16.353 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T09:04:16.354 INFO:teuthology.orchestra.run.smithi175.stdout:55834574853 2024-04-25T09:04:16.355 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T09:04:16.356 INFO:teuthology.orchestra.run.smithi175.stdout:55834574854 2024-04-25T09:04:16.356 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T09:04:16.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.555+0000 7fa177200640 1 Processor -- start 2024-04-25T09:04:16.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.555+0000 7fa177200640 1 -- start start 2024-04-25T09:04:16.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.559+0000 7fa177200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa170054460 0x7fa170053420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.559+0000 7fa177200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa170101180 con 0x7fa1701050e0 2024-04-25T09:04:16.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.559+0000 7fa177200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa170053960 con 0x7fa17004faf0 2024-04-25T09:04:16.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.559+0000 7fa177200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa170005ea0 con 0x7fa170054460 2024-04-25T09:04:16.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.559+0000 7fa175e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa170054460 0x7fa170053420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.559+0000 7fa175e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa170054460 0x7fa170053420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:48324/0 (socket says 172.21.15.175:48324) 2024-04-25T09:04:16.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.559+0000 7fa175e00640 1 -- 172.21.15.175:0/3197780235 learned_addr learned my addr 172.21.15.175:0/3197780235 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.559+0000 7fa175e00640 1 -- 172.21.15.175:0/3197780235 >> v1:172.21.15.177:6789/0 conn(0x7fa17004faf0 legacy=0x7fa17010bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.559+0000 7fa175e00640 1 -- 172.21.15.175:0/3197780235 >> v1:172.21.15.175:6789/0 conn(0x7fa1701050e0 legacy=0x7fa17004f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.559+0000 7fa175e00640 1 -- 172.21.15.175:0/3197780235 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17003a5c0 con 0x7fa170054460 2024-04-25T09:04:16.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.571+0000 7fa175e00640 1 --2- 172.21.15.175:0/3197780235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa170054460 0x7fa170053420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa164009870 tx=0x7fa16401d750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec8136a6fc550601 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.571+0000 7fa174a00640 1 -- 172.21.15.175:0/3197780235 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1640a9610 con 0x7fa170054460 2024-04-25T09:04:16.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.571+0000 7fa174a00640 1 -- 172.21.15.175:0/3197780235 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1640a97b0 con 0x7fa170054460 2024-04-25T09:04:16.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.571+0000 7fa174a00640 1 -- 172.21.15.175:0/3197780235 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1640a9b80 con 0x7fa170054460 2024-04-25T09:04:16.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.571+0000 7fa177200640 1 -- 172.21.15.175:0/3197780235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa170054460 msgr2=0x7fa170053420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.571+0000 7fa177200640 1 --2- 172.21.15.175:0/3197780235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa170054460 0x7fa170053420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa164009870 tx=0x7fa16401d750 comp rx=0 tx=0).stop 2024-04-25T09:04:16.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.571+0000 7fa177200640 1 -- 172.21.15.175:0/3197780235 shutdown_connections 2024-04-25T09:04:16.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.571+0000 7fa177200640 1 --2- 172.21.15.175:0/3197780235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa170054460 0x7fa170053420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.571+0000 7fa177200640 1 -- 172.21.15.175:0/3197780235 >> 172.21.15.175:0/3197780235 conn(0x7fa170009fc0 msgr2=0x7fa17000a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.571+0000 7fa177200640 1 -- 172.21.15.175:0/3197780235 shutdown_connections 2024-04-25T09:04:16.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.571+0000 7fa177200640 1 -- 172.21.15.175:0/3197780235 wait complete. 2024-04-25T09:04:16.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.575+0000 7fa177200640 1 Processor -- start 2024-04-25T09:04:16.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7fa177200640 1 -- start start 2024-04-25T09:04:16.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.575+0000 7f6c38c00640 1 Processor -- start 2024-04-25T09:04:16.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7f6c38c00640 1 -- start start 2024-04-25T09:04:16.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7fa177200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa17004faf0 0x7fa1700f3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7fa177200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa170054460 0x7fa170037da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7fa177200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1701050e0 0x7fa1700382e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7fa177200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1701054c0 con 0x7fa170054460 2024-04-25T09:04:16.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7f6c33400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f6c34165450 0x7f6c340b5450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:46522/0 (socket says 172.21.15.175:46522) 2024-04-25T09:04:16.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7f6c33400640 1 -- 172.21.15.175:0/2931251594 learned_addr learned my addr 172.21.15.175:0/2931251594 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:16.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7fa177200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa170105640 con 0x7fa17004faf0 2024-04-25T09:04:16.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7fa177200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17010d2a0 con 0x7fa1701050e0 2024-04-25T09:04:16.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7fa176800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1701050e0 0x7fa1700382e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7fa176800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1701050e0 0x7fa1700382e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44230/0 (socket says 172.21.15.175:44230) 2024-04-25T09:04:16.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7fa176800640 1 -- 172.21.15.175:0/274687820 learned_addr learned my addr 172.21.15.175:0/274687820 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7fa175e00640 1 --2- 172.21.15.175:0/274687820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa17004faf0 0x7fa1700f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7f6c38c00640 1 --2- 172.21.15.175:0/2931251594 >> v2:172.21.15.175:3300/0 conn(0x7f6c340ce020 0x7f6c340b8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7fa176800640 1 -- 172.21.15.175:0/274687820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa17004faf0 msgr2=0x7fa1700f3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7fa176800640 1 --2- 172.21.15.175:0/274687820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa17004faf0 0x7fa1700f3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7fa176800640 1 -- 172.21.15.175:0/274687820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa170054460 msgr2=0x7fa170037da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T09:04:16.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7fa175400640 1 --2- 172.21.15.175:0/274687820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa170054460 0x7fa170037da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7f6c33e00640 1 --2- 172.21.15.175:0/2931251594 >> v2:172.21.15.175:3300/0 conn(0x7f6c340ce020 0x7f6c340b8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.579+0000 7f6c38c00640 1 -- 172.21.15.175:0/2931251594 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c340ce590 con 0x7f6c340b5b60 2024-04-25T09:04:16.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7f6c38c00640 1 -- 172.21.15.175:0/2931251594 --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c340ce870 con 0x7f6c34165450 2024-04-25T09:04:16.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7f6c38c00640 1 -- 172.21.15.175:0/2931251594 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c34165830 con 0x7f6c340ce020 2024-04-25T09:04:16.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7fa176800640 1 --2- 172.21.15.175:0/274687820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa170054460 0x7fa170037da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7fa176800640 1 -- 172.21.15.175:0/274687820 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1701014f0 con 0x7fa1701050e0 2024-04-25T09:04:16.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7f6c32000640 1 -- 172.21.15.175:0/2931251594 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328804266 0 0) 0x7f6c340ce870 con 0x7f6c34165450 2024-04-25T09:04:16.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7f6c32000640 1 -- 172.21.15.175:0/2931251594 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c18003530 con 0x7f6c34165450 2024-04-25T09:04:16.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7f6c32000640 1 -- 172.21.15.175:0/2931251594 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399161429 0 0) 0x7f6c340ce590 con 0x7f6c340b5b60 2024-04-25T09:04:16.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7f6c32000640 1 -- 172.21.15.175:0/2931251594 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c340ce870 con 0x7f6c340b5b60 2024-04-25T09:04:16.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7fa175400640 1 --2- 172.21.15.175:0/274687820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa170054460 0x7fa170037da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:16.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7fa176800640 1 --2- 172.21.15.175:0/274687820 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1701050e0 0x7fa1700382e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa178064760 tx=0x7fa1780745a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7f6c33e00640 1 -- 172.21.15.175:0/2931251594 >> v1:172.21.15.177:6789/0 conn(0x7f6c34165450 legacy=0x7f6c340b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7f6c32000640 1 -- 172.21.15.175:0/2931251594 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3309931643 0 0) 0x7f6c340ce870 con 0x7f6c340b5b60 2024-04-25T09:04:16.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7f6c33e00640 1 -- 172.21.15.175:0/2931251594 >> v1:172.21.15.175:6789/0 conn(0x7f6c340b5b60 legacy=0x7f6c340b7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7fa16e000640 1 -- 172.21.15.175:0/274687820 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1780731c0 con 0x7fa1701050e0 2024-04-25T09:04:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7fa16e000640 1 -- 172.21.15.175:0/274687820 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa178081400 con 0x7fa1701050e0 2024-04-25T09:04:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7fa16e000640 1 -- 172.21.15.175:0/274687820 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1780817f0 con 0x7fa1701050e0 2024-04-25T09:04:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7fa177200640 1 -- 172.21.15.175:0/274687820 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1701017d0 con 0x7fa1701050e0 2024-04-25T09:04:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7fa177200640 1 -- 172.21.15.175:0/274687820 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa170101d90 con 0x7fa1701050e0 2024-04-25T09:04:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.583+0000 7f6c33e00640 1 -- 172.21.15.175:0/2931251594 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c340ceb50 con 0x7f6c340ce020 2024-04-25T09:04:16.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.587+0000 7fa177200640 1 -- 172.21.15.175:0/274687820 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1500052a0 con 0x7fa1701050e0 2024-04-25T09:04:16.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.587+0000 7fa16e000640 1 -- 172.21.15.175:0/274687820 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa178081990 con 0x7fa1701050e0 2024-04-25T09:04:16.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.587+0000 7fa16e000640 1 --2- 172.21.15.175:0/274687820 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa158066f60 0x7fa158069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.587+0000 7fa175e00640 1 --2- 172.21.15.175:0/274687820 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa158066f60 0x7fa158069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.587+0000 7f6c33e00640 1 --2- 172.21.15.175:0/2931251594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c340ce020 0x7f6c340b8550 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009d90 tx=0x7f6c2c01f080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47cc09c82a28910 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.587+0000 7fa16e000640 1 -- 172.21.15.175:0/274687820 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1780ee610 con 0x7fa1701050e0 2024-04-25T09:04:16.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.591+0000 7f6c32000640 1 -- 172.21.15.175:0/2931251594 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0b5070 con 0x7f6c340ce020 2024-04-25T09:04:16.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.591+0000 7f6c32000640 1 -- 172.21.15.175:0/2931251594 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c0a8c10 con 0x7f6c340ce020 2024-04-25T09:04:16.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.591+0000 7f6c32000640 1 -- 172.21.15.175:0/2931251594 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20001680 con 0x7f6c340ce020 2024-04-25T09:04:16.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.591+0000 7fa175e00640 1 --2- 172.21.15.175:0/274687820 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa158066f60 0x7fa158069420 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa1640b0000 tx=0x7fa1640b7040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.591+0000 7fa5c2000640 1 Processor -- start 2024-04-25T09:04:16.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.591+0000 7f6c38c00640 1 -- 172.21.15.175:0/2931251594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c340ce020 msgr2=0x7f6c340b8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.591+0000 7f6c38c00640 1 --2- 172.21.15.175:0/2931251594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c340ce020 0x7f6c340b8550 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009d90 tx=0x7f6c2c01f080 comp rx=0 tx=0).stop 2024-04-25T09:04:16.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.591+0000 7fa5c2000640 1 -- start start 2024-04-25T09:04:16.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.591+0000 7f6c38c00640 1 -- 172.21.15.175:0/2931251594 shutdown_connections 2024-04-25T09:04:16.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.591+0000 7f6c38c00640 1 --2- 172.21.15.175:0/2931251594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c340ce020 0x7f6c340b8550 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.591+0000 7f6c38c00640 1 -- 172.21.15.175:0/2931251594 >> 172.21.15.175:0/2931251594 conn(0x7f6c340d0450 msgr2=0x7f6c340d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.591+0000 7f6c38c00640 1 -- 172.21.15.175:0/2931251594 shutdown_connections 2024-04-25T09:04:16.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.591+0000 7f6c38c00640 1 -- 172.21.15.175:0/2931251594 wait complete. 2024-04-25T09:04:16.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.591+0000 7fa16e000640 1 -- 172.21.15.175:0/274687820 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa17807d030 con 0x7fa1701050e0 2024-04-25T09:04:16.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.591+0000 7fa5c2000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa5bc0b9360 0x7fa5bc161d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.591+0000 7fa5c2000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc15e850 con 0x7fa5bc162280 2024-04-25T09:04:16.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.591+0000 7fa5c2000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc15eb30 con 0x7fa5bc1582c0 2024-04-25T09:04:16.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.591+0000 7fa5c2000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5bc0d0e70 con 0x7fa5bc0b9360 2024-04-25T09:04:16.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.595+0000 7fa5c0c00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fa5bc1582c0 0x7fa5bc15e040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:46528/0 (socket says 172.21.15.175:46528) 2024-04-25T09:04:16.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.595+0000 7f6c38c00640 1 Processor -- start 2024-04-25T09:04:16.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.595+0000 7fa5bbe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa5bc0b9360 0x7fa5bc161d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.595+0000 7fa5bbe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa5bc0b9360 0x7fa5bc161d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:48348/0 (socket says 172.21.15.175:48348) 2024-04-25T09:04:16.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.595+0000 7fa5bbe00640 1 -- 172.21.15.175:0/524430763 learned_addr learned my addr 172.21.15.175:0/524430763 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.595+0000 7fa5bbe00640 1 -- 172.21.15.175:0/524430763 >> v1:172.21.15.177:6789/0 conn(0x7fa5bc1582c0 legacy=0x7fa5bc15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.595+0000 7f6c38c00640 1 -- start start 2024-04-25T09:04:16.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.595+0000 7fa5bbe00640 1 -- 172.21.15.175:0/524430763 >> v1:172.21.15.175:6789/0 conn(0x7fa5bc162280 legacy=0x7fa5bc0d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.595+0000 7fa5bbe00640 1 -- 172.21.15.175:0/524430763 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc15ee10 con 0x7fa5bc0b9360 2024-04-25T09:04:16.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.595+0000 7f6c38c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c340b5b60 0x7f6c3406da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.595+0000 7f6c38c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c340ce020 0x7f6c340726a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.595+0000 7f6c38c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34165450 0x7f6c340c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.595+0000 7f6c38c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340d2890 con 0x7f6c340b5b60 2024-04-25T09:04:16.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.595+0000 7f6c38c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340cf1a0 con 0x7f6c34165450 2024-04-25T09:04:16.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.595+0000 7f6c38c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340d2a10 con 0x7f6c340ce020 2024-04-25T09:04:16.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.599+0000 7f6c32a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c340ce020 0x7f6c340726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.599+0000 7f6c32a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c340ce020 0x7f6c340726a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44238/0 (socket says 172.21.15.175:44238) 2024-04-25T09:04:16.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.599+0000 7f6c32a00640 1 -- 172.21.15.175:0/3356563122 learned_addr learned my addr 172.21.15.175:0/3356563122 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.599+0000 7f6c33e00640 1 --2- 172.21.15.175:0/3356563122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34165450 0x7f6c340c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.599+0000 7f6c32a00640 1 -- 172.21.15.175:0/3356563122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34165450 msgr2=0x7f6c340c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.599+0000 7f6c32a00640 1 --2- 172.21.15.175:0/3356563122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34165450 0x7f6c340c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.599+0000 7f6c32a00640 1 -- 172.21.15.175:0/3356563122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c340b5b60 msgr2=0x7f6c3406da70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T09:04:16.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.599+0000 7f6c32a00640 1 --2- 172.21.15.175:0/3356563122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c340b5b60 0x7f6c3406da70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.599+0000 7f6c32a00640 1 -- 172.21.15.175:0/3356563122 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3406dfb0 con 0x7f6c340ce020 2024-04-25T09:04:16.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.599+0000 7f6c32a00640 1 --2- 172.21.15.175:0/3356563122 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c340ce020 0x7f6c340726a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000c700 tx=0x7f6c2000cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.599+0000 7f6c2b400640 1 -- 172.21.15.175:0/3356563122 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20016020 con 0x7f6c340ce020 2024-04-25T09:04:16.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.599+0000 7f6c2b400640 1 -- 172.21.15.175:0/3356563122 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2000a840 con 0x7f6c340ce020 2024-04-25T09:04:16.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.599+0000 7f6c2b400640 1 -- 172.21.15.175:0/3356563122 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2000ac30 con 0x7f6c340ce020 2024-04-25T09:04:16.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.599+0000 7fa5bbe00640 1 --2- 172.21.15.175:0/524430763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5bc0b9360 0x7fa5bc161d40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009e50 tx=0x7fa5b401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98fba9fe00be85e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.599+0000 7f6c38c00640 1 -- 172.21.15.175:0/3356563122 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c341f87f0 con 0x7f6c340ce020 2024-04-25T09:04:16.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.603+0000 7f6c38c00640 1 -- 172.21.15.175:0/3356563122 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c340cafd0 con 0x7f6c340ce020 2024-04-25T09:04:16.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.603+0000 7fa5bb400640 1 -- 172.21.15.175:0/524430763 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40a5520 con 0x7fa5bc0b9360 2024-04-25T09:04:16.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.603+0000 7fa5bb400640 1 -- 172.21.15.175:0/524430763 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b40a56c0 con 0x7fa5bc0b9360 2024-04-25T09:04:16.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.603+0000 7fa5bb400640 1 -- 172.21.15.175:0/524430763 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40a5a90 con 0x7fa5bc0b9360 2024-04-25T09:04:16.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.603+0000 7f6c38c00640 1 -- 172.21.15.175:0/3356563122 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c34074a60 con 0x7f6c340ce020 2024-04-25T09:04:16.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.603+0000 7fa5c2000640 1 -- 172.21.15.175:0/524430763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5bc0b9360 msgr2=0x7fa5bc161d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.603+0000 7fa5c2000640 1 --2- 172.21.15.175:0/524430763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5bc0b9360 0x7fa5bc161d40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009e50 tx=0x7fa5b401c8e0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.603+0000 7fa5c2000640 1 -- 172.21.15.175:0/524430763 shutdown_connections 2024-04-25T09:04:16.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.603+0000 7fa5c2000640 1 --2- 172.21.15.175:0/524430763 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5bc0b9360 0x7fa5bc161d40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.603+0000 7fa5c2000640 1 -- 172.21.15.175:0/524430763 >> 172.21.15.175:0/524430763 conn(0x7fa5bc06bf80 msgr2=0x7fa5bc06c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.603+0000 7f6c2b400640 1 -- 172.21.15.175:0/3356563122 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6c20019020 con 0x7f6c340ce020 2024-04-25T09:04:16.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.603+0000 7fa5c2000640 1 -- 172.21.15.175:0/524430763 shutdown_connections 2024-04-25T09:04:16.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.603+0000 7fa5c2000640 1 -- 172.21.15.175:0/524430763 wait complete. 2024-04-25T09:04:16.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.607+0000 7f6c2b400640 1 --2- 172.21.15.175:0/3356563122 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6c14066fb0 0x7f6c14069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.607+0000 7f6c2b400640 1 -- 172.21.15.175:0/3356563122 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c20085190 con 0x7f6c340ce020 2024-04-25T09:04:16.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.607+0000 7fa9b9000640 1 Processor -- start 2024-04-25T09:04:16.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.607+0000 7f6c33400640 1 --2- 172.21.15.175:0/3356563122 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6c14066fb0 0x7f6c14069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.607+0000 7fa9b9000640 1 -- start start 2024-04-25T09:04:16.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.607+0000 7fa5c2000640 1 Processor -- start 2024-04-25T09:04:16.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.607+0000 7f6c33400640 1 --2- 172.21.15.175:0/3356563122 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6c14066fb0 0x7f6c14069470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c24007fd0 tx=0x7f6c24007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.607+0000 7fa5c2000640 1 -- start start 2024-04-25T09:04:16.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.607+0000 7fa9b9000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9b415c6e0 0x7fa9b40b3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.607+0000 7fa9b9000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa9b40b2660 0x7fa9b40b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.607+0000 7fa9b9000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa9b406e7d0 0x7fa9b40712d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.607+0000 7fa9b9000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b4162630 con 0x7fa9b40b2660 2024-04-25T09:04:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.607+0000 7fa9b9000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b415cac0 con 0x7fa9b406e7d0 2024-04-25T09:04:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.607+0000 7fa9b9000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b41628f0 con 0x7fa9b415c6e0 2024-04-25T09:04:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.607+0000 7fa9b1e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9b415c6e0 0x7fa9b40b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa9b1e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9b415c6e0 0x7fa9b40b3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44248/0 (socket says 172.21.15.175:44248) 2024-04-25T09:04:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa9b1e00640 1 -- 172.21.15.175:0/1953991821 learned_addr learned my addr 172.21.15.175:0/1953991821 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa9b2800640 1 --2- 172.21.15.175:0/1953991821 >> v2:172.21.15.177:3300/0 conn(0x7fa9b406e7d0 0x7fa9b40712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7f2d3a200640 1 Processor -- start 2024-04-25T09:04:16.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa9b1400640 1 --2- 172.21.15.175:0/1953991821 >> v2:172.21.15.175:3300/0 conn(0x7fa9b40b2660 0x7fa9b40b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa9b1e00640 1 -- 172.21.15.175:0/1953991821 >> v2:172.21.15.177:3300/0 conn(0x7fa9b406e7d0 msgr2=0x7fa9b40712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa9b1e00640 1 --2- 172.21.15.175:0/1953991821 >> v2:172.21.15.177:3300/0 conn(0x7fa9b406e7d0 0x7fa9b40712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa9b1e00640 1 -- 172.21.15.175:0/1953991821 >> v2:172.21.15.175:3300/0 conn(0x7fa9b40b2660 msgr2=0x7fa9b40b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa9b1e00640 1 --2- 172.21.15.175:0/1953991821 >> v2:172.21.15.175:3300/0 conn(0x7fa9b40b2660 0x7fa9b40b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa9b1e00640 1 -- 172.21.15.175:0/1953991821 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b4162bd0 con 0x7fa9b415c6e0 2024-04-25T09:04:16.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7f6c2b400640 1 -- 172.21.15.175:0/3356563122 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6c20020020 con 0x7f6c340ce020 2024-04-25T09:04:16.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa5c2000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5bc0b9360 0x7fa5bc203150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa5c2000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc1582c0 0x7fa5bc0b8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa5c2000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5bc162280 0x7fa5bc0b8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7f2d3a200640 1 -- start start 2024-04-25T09:04:16.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa5bbe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc1582c0 0x7fa5bc0b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa5c1600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5bc162280 0x7fa5bc0b8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa5bbe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc1582c0 0x7fa5bc0b8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44262/0 (socket says 172.21.15.175:44262) 2024-04-25T09:04:16.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa5c1600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5bc162280 0x7fa5bc0b8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36566/0 (socket says 172.21.15.175:36566) 2024-04-25T09:04:16.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa5bbe00640 1 -- 172.21.15.175:0/1911253553 learned_addr learned my addr 172.21.15.175:0/1911253553 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa5c2000640 1 -- 172.21.15.175:0/1911253553 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc16bc40 con 0x7fa5bc162280 2024-04-25T09:04:16.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa5c2000640 1 -- 172.21.15.175:0/1911253553 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0d2710 con 0x7fa5bc0b9360 2024-04-25T09:04:16.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa5c0c00640 1 --2- 172.21.15.175:0/1911253553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5bc0b9360 0x7fa5bc203150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa5c2000640 1 -- 172.21.15.175:0/1911253553 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc16bdc0 con 0x7fa5bc1582c0 2024-04-25T09:04:16.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7f2d3a200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2d3406b360 0x7f2d340b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7f2d3a200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d340719e0 0x7f2d340cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7f2d3a200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3406e810 con 0x7f2d340ccb20 2024-04-25T09:04:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7f2d3a200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d34072120 con 0x7f2d3406b360 2024-04-25T09:04:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7f2d3a200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3406eaf0 con 0x7f2d340719e0 2024-04-25T09:04:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7ffa60c00640 1 Processor -- start 2024-04-25T09:04:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7ffa60c00640 1 -- start start 2024-04-25T09:04:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa5bbe00640 1 -- 172.21.15.175:0/1911253553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5bc0b9360 msgr2=0x7fa5bc203150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa5bbe00640 1 --2- 172.21.15.175:0/1911253553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5bc0b9360 0x7fa5bc203150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa5bbe00640 1 -- 172.21.15.175:0/1911253553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5bc162280 msgr2=0x7fa5bc0b8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa5bbe00640 1 --2- 172.21.15.175:0/1911253553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5bc162280 0x7fa5bc0b8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa5bbe00640 1 -- 172.21.15.175:0/1911253553 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc0cc4b0 con 0x7fa5bc1582c0 2024-04-25T09:04:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7fa5c0c00640 1 --2- 172.21.15.175:0/1911253553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5bc0b9360 0x7fa5bc203150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7f2d32a00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f2d340ccb20 0x7f2d340712d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:46536/0 (socket says 172.21.15.175:46536) 2024-04-25T09:04:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.611+0000 7f2d32a00640 1 -- 172.21.15.175:0/933123490 learned_addr learned my addr 172.21.15.175:0/933123490 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7f2d33400640 1 --2- 172.21.15.175:0/933123490 >> v2:172.21.15.177:3300/0 conn(0x7f2d3406b360 0x7f2d340b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7fa5bbe00640 1 --2- 172.21.15.175:0/1911253553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc1582c0 0x7fa5bc0b8250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40194f0 tx=0x7fa5b4019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7f2d33e00640 1 --2- 172.21.15.175:0/933123490 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d340719e0 0x7f2d340cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7f2d32000640 1 -- 172.21.15.175:0/933123490 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2278461008 0 0) 0x7f2d3406e810 con 0x7f2d340ccb20 2024-04-25T09:04:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7f2d32000640 1 -- 172.21.15.175:0/933123490 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d18003530 con 0x7f2d340ccb20 2024-04-25T09:04:16.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7fa5b8c00640 1 -- 172.21.15.175:0/1911253553 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40bc020 con 0x7fa5bc1582c0 2024-04-25T09:04:16.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7f2d32000640 1 -- 172.21.15.175:0/933123490 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 237354880 0 0) 0x7f2d18003530 con 0x7f2d340ccb20 2024-04-25T09:04:16.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7fa5c2000640 1 -- 172.21.15.175:0/1911253553 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc0cc790 con 0x7fa5bc1582c0 2024-04-25T09:04:16.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7fa5c2000640 1 -- 172.21.15.175:0/1911253553 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5bc0ccd50 con 0x7fa5bc1582c0 2024-04-25T09:04:16.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7fa5b8c00640 1 -- 172.21.15.175:0/1911253553 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b40b86b0 con 0x7fa5bc1582c0 2024-04-25T09:04:16.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7f2d32000640 1 -- 172.21.15.175:0/933123490 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d340719e0 msgr2=0x7f2d340cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7fa5b8c00640 1 -- 172.21.15.175:0/1911253553 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40b8aa0 con 0x7fa5bc1582c0 2024-04-25T09:04:16.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7fa9b1e00640 1 --2- 172.21.15.175:0/1953991821 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9b415c6e0 0x7fa9b40b3170 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa9b406f4f0 tx=0x7fa9a001c260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db57aa64c38c61ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7ffa60c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa5c0b3880 0x7ffa5c169c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7ffa60c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ffa5c0b2660 0x7ffa5c16c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7ffa60c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c162630 con 0x7ffa5c15c6e0 2024-04-25T09:04:16.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7ffa60c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5c15cac0 con 0x7ffa5c0b2660 2024-04-25T09:04:16.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7ffa60c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c1628f0 con 0x7ffa5c0b3880 2024-04-25T09:04:16.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7fa9b0a00640 1 -- 172.21.15.175:0/1953991821 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00b0070 con 0x7fa9b415c6e0 2024-04-25T09:04:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7ffa59400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa5c0b3880 0x7ffa5c169c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7ffa59e00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ffa5c15c6e0 0x7ffa5c0b3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:46540/0 (socket says 172.21.15.175:46540) 2024-04-25T09:04:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7ffa59e00640 1 -- 172.21.15.175:0/2031276442 learned_addr learned my addr 172.21.15.175:0/2031276442 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7ffa59400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa5c0b3880 0x7ffa5c169c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44286/0 (socket says 172.21.15.175:44286) 2024-04-25T09:04:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7ffa5a800640 1 --2- 172.21.15.175:0/2031276442 >> v2:172.21.15.177:3300/0 conn(0x7ffa5c0b2660 0x7ffa5c16c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7ffa59400640 1 -- 172.21.15.175:0/2031276442 >> v2:172.21.15.177:3300/0 conn(0x7ffa5c0b2660 msgr2=0x7ffa5c16c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7ffa59400640 1 --2- 172.21.15.175:0/2031276442 >> v2:172.21.15.177:3300/0 conn(0x7ffa5c0b2660 0x7ffa5c16c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7ffa59400640 1 -- 172.21.15.175:0/2031276442 >> v1:172.21.15.177:6789/0 conn(0x7ffa5c15c6e0 legacy=0x7ffa5c0b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7ffa59400640 1 -- 172.21.15.175:0/2031276442 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c162bd0 con 0x7ffa5c0b3880 2024-04-25T09:04:16.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7fa9b0a00640 1 -- 172.21.15.175:0/1953991821 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a00ab600 con 0x7fa9b415c6e0 2024-04-25T09:04:16.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7fa9b0a00640 1 -- 172.21.15.175:0/1953991821 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00b0070 con 0x7fa9b415c6e0 2024-04-25T09:04:16.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7fa9b9000640 1 -- 172.21.15.175:0/1953991821 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9b415c6e0 msgr2=0x7fa9b40b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7fa9b9000640 1 --2- 172.21.15.175:0/1953991821 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9b415c6e0 0x7fa9b40b3170 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa9b406f4f0 tx=0x7fa9a001c260 comp rx=0 tx=0).stop 2024-04-25T09:04:16.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7f2d32000640 1 --2- 172.21.15.175:0/933123490 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d340719e0 0x7f2d340cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7f2d32000640 1 -- 172.21.15.175:0/933123490 >> v2:172.21.15.177:3300/0 conn(0x7f2d3406b360 msgr2=0x7f2d340b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7f2d32000640 1 --2- 172.21.15.175:0/933123490 >> v2:172.21.15.177:3300/0 conn(0x7f2d3406b360 0x7f2d340b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7f2d32000640 1 -- 172.21.15.175:0/933123490 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3406edd0 con 0x7f2d340ccb20 2024-04-25T09:04:16.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7f2d32000640 1 -- 172.21.15.175:0/933123490 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f2d2c001a00 con 0x7f2d340ccb20 2024-04-25T09:04:16.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.615+0000 7f2d32000640 1 -- 172.21.15.175:0/933123490 >> v1:172.21.15.177:6789/0 conn(0x7f2d340ccb20 legacy=0x7f2d340712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7fa9b9000640 1 -- 172.21.15.175:0/1953991821 shutdown_connections 2024-04-25T09:04:16.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7fa9b9000640 1 --2- 172.21.15.175:0/1953991821 >> v2:172.21.15.177:3300/0 conn(0x7fa9b406e7d0 0x7fa9b40712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7fa9b9000640 1 --2- 172.21.15.175:0/1953991821 >> v2:172.21.15.175:3300/0 conn(0x7fa9b40b2660 0x7fa9b40b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7fa9b9000640 1 --2- 172.21.15.175:0/1953991821 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9b415c6e0 0x7fa9b40b3170 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7fa9b9000640 1 -- 172.21.15.175:0/1953991821 >> 172.21.15.175:0/1953991821 conn(0x7fa9b406ac50 msgr2=0x7fa9b406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7fa5c2000640 1 -- 172.21.15.175:0/1911253553 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5940052a0 con 0x7fa5bc1582c0 2024-04-25T09:04:16.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7f2d32000640 1 --2- 172.21.15.175:0/933123490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d180039c0 0x7f2d18003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7f2d32000640 1 --2- 172.21.15.175:0/933123490 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d180043b0 0x7f2d18004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7f2d32000640 1 --2- 172.21.15.175:0/933123490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d18005040 0x7f2d1800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7f2d32000640 1 -- 172.21.15.175:0/933123490 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d34072120 con 0x7f2d180039c0 2024-04-25T09:04:16.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7f2d32000640 1 -- 172.21.15.175:0/933123490 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3406eaf0 con 0x7f2d18005040 2024-04-25T09:04:16.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7f2d32000640 1 -- 172.21.15.175:0/933123490 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1800bf90 con 0x7f2d180043b0 2024-04-25T09:04:16.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7f2d33400640 1 --2- 172.21.15.175:0/933123490 >> v2:172.21.15.177:3300/0 conn(0x7f2d3406b360 0x7f2d340b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:16.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7f2d33e00640 1 --2- 172.21.15.175:0/933123490 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d340719e0 0x7f2d340cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:16.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7fa9b9000640 1 -- 172.21.15.175:0/1953991821 shutdown_connections 2024-04-25T09:04:16.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7fa9b9000640 1 -- 172.21.15.175:0/1953991821 wait complete. 2024-04-25T09:04:16.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7f2d32a00640 1 --2- 172.21.15.175:0/933123490 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d180043b0 0x7f2d18004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7f2d33400640 1 --2- 172.21.15.175:0/933123490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d180039c0 0x7f2d18003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7f2d32a00640 1 -- 172.21.15.175:0/933123490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d18005040 msgr2=0x7f2d1800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7f2d32a00640 1 --2- 172.21.15.175:0/933123490 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d18005040 0x7f2d1800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7f2d32a00640 1 -- 172.21.15.175:0/933123490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d180039c0 msgr2=0x7f2d18003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7f2d32a00640 1 --2- 172.21.15.175:0/933123490 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d180039c0 0x7f2d18003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7f2d32a00640 1 -- 172.21.15.175:0/933123490 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3406edd0 con 0x7f2d180043b0 2024-04-25T09:04:16.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7ffa59400640 1 --2- 172.21.15.175:0/2031276442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa5c0b3880 0x7ffa5c169c50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c0097c0 tx=0x7ffa4c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71d9928c3ee3ff24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b9000640 1 Processor -- start 2024-04-25T09:04:16.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7fa5b8c00640 1 -- 172.21.15.175:0/1911253553 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa5b40bf020 con 0x7fa5bc1582c0 2024-04-25T09:04:16.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.619+0000 7fa5b8c00640 1 --2- 172.21.15.175:0/1911253553 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa59c067030 0x7fa59c0694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b9000640 1 -- start start 2024-04-25T09:04:16.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa5c0c00640 1 --2- 172.21.15.175:0/1911253553 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa59c067030 0x7fa59c0694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa5b8c00640 1 -- 172.21.15.175:0/1911253553 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5b411fd20 con 0x7fa5bc1582c0 2024-04-25T09:04:16.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b9000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9b406e7d0 0x7fa9b41566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa5c0c00640 1 --2- 172.21.15.175:0/1911253553 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa59c067030 0x7fa59c0694f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8000f70 tx=0x7fa5a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b9000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9b40b2660 0x7fa9b415d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b9000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9b415c6e0 0x7fa9b415de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b1e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9b406e7d0 0x7fa9b41566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b9000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b4165980 con 0x7fa9b40b2660 2024-04-25T09:04:16.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b9000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b4165800 con 0x7fa9b415c6e0 2024-04-25T09:04:16.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b9000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b416dc70 con 0x7fa9b406e7d0 2024-04-25T09:04:16.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b1e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9b406e7d0 0x7fa9b41566d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44318/0 (socket says 172.21.15.175:44318) 2024-04-25T09:04:16.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b1e00640 1 -- 172.21.15.175:0/1440474494 learned_addr learned my addr 172.21.15.175:0/1440474494 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b1400640 1 --2- 172.21.15.175:0/1440474494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9b40b2660 0x7fa9b415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b2800640 1 --2- 172.21.15.175:0/1440474494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9b415c6e0 0x7fa9b415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b1e00640 1 -- 172.21.15.175:0/1440474494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9b415c6e0 msgr2=0x7fa9b415de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b1e00640 1 --2- 172.21.15.175:0/1440474494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9b415c6e0 0x7fa9b415de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b1e00640 1 -- 172.21.15.175:0/1440474494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9b40b2660 msgr2=0x7fa9b415d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b1e00640 1 --2- 172.21.15.175:0/1440474494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9b40b2660 0x7fa9b415d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b1e00640 1 -- 172.21.15.175:0/1440474494 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b415e560 con 0x7fa9b406e7d0 2024-04-25T09:04:16.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7ffa58a00640 1 -- 172.21.15.175:0/2031276442 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c0b1070 con 0x7ffa5c0b3880 2024-04-25T09:04:16.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7ffa58a00640 1 -- 172.21.15.175:0/2031276442 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c0ac410 con 0x7ffa5c0b3880 2024-04-25T09:04:16.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7ffa58a00640 1 -- 172.21.15.175:0/2031276442 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c0ac7e0 con 0x7ffa5c0b3880 2024-04-25T09:04:16.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b1400640 1 --2- 172.21.15.175:0/1440474494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9b40b2660 0x7fa9b415d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:16.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa5b8c00640 1 -- 172.21.15.175:0/1911253553 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa5b4016560 con 0x7fa5bc1582c0 2024-04-25T09:04:16.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.623+0000 7fa9b1e00640 1 --2- 172.21.15.175:0/1440474494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9b406e7d0 0x7fa9b41566d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00ae040 tx=0x7fa9a0019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7fa9aa000640 1 -- 172.21.15.175:0/1440474494 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00b9070 con 0x7fa9b406e7d0 2024-04-25T09:04:16.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7fa9aa000640 1 -- 172.21.15.175:0/1440474494 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a00ab9b0 con 0x7fa9b406e7d0 2024-04-25T09:04:16.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7fa9aa000640 1 -- 172.21.15.175:0/1440474494 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00b0040 con 0x7fa9b406e7d0 2024-04-25T09:04:16.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7f2d32a00640 1 --2- 172.21.15.175:0/933123490 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d180043b0 0x7f2d18004890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00a9e0 tx=0x7f2d2c01d490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d290e7340435d982 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7fa9b9000640 1 -- 172.21.15.175:0/1440474494 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b415ff50 con 0x7fa9b406e7d0 2024-04-25T09:04:16.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7ffa60c00640 1 -- 172.21.15.175:0/2031276442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa5c0b3880 msgr2=0x7ffa5c169c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7ffa60c00640 1 --2- 172.21.15.175:0/2031276442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa5c0b3880 0x7ffa5c169c50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c0097c0 tx=0x7ffa4c01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7ffa60c00640 1 -- 172.21.15.175:0/2031276442 shutdown_connections 2024-04-25T09:04:16.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7ffa60c00640 1 --2- 172.21.15.175:0/2031276442 >> v2:172.21.15.177:3300/0 conn(0x7ffa5c0b2660 0x7ffa5c16c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7ffa60c00640 1 --2- 172.21.15.175:0/2031276442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa5c0b3880 0x7ffa5c169c50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7ffa60c00640 1 -- 172.21.15.175:0/2031276442 >> 172.21.15.175:0/2031276442 conn(0x7ffa5c06ac50 msgr2=0x7ffa5c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7ffa60c00640 1 -- 172.21.15.175:0/2031276442 shutdown_connections 2024-04-25T09:04:16.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7ffa60c00640 1 -- 172.21.15.175:0/2031276442 wait complete. 2024-04-25T09:04:16.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7fa9b9000640 1 -- 172.21.15.175:0/1440474494 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b4160510 con 0x7fa9b406e7d0 2024-04-25T09:04:16.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7ffa60c00640 1 Processor -- start 2024-04-25T09:04:16.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7ffa60c00640 1 -- start start 2024-04-25T09:04:16.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7f2d32000640 1 -- 172.21.15.175:0/933123490 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c00a5e0 con 0x7f2d180043b0 2024-04-25T09:04:16.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7f2d32000640 1 -- 172.21.15.175:0/933123490 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c0a9070 con 0x7f2d180043b0 2024-04-25T09:04:16.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7f2d32000640 1 -- 172.21.15.175:0/933123490 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c0ad830 con 0x7f2d180043b0 2024-04-25T09:04:16.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7f2d3a200640 1 -- 172.21.15.175:0/933123490 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d180043b0 msgr2=0x7f2d18004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7f2d3a200640 1 --2- 172.21.15.175:0/933123490 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d180043b0 0x7f2d18004890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00a9e0 tx=0x7f2d2c01d490 comp rx=0 tx=0).stop 2024-04-25T09:04:16.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7f2d33e00640 1 -- 172.21.15.175:0/933123490 reap_dead start 2024-04-25T09:04:16.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7fa9b9000640 1 -- 172.21.15.175:0/1440474494 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b4160710 con 0x7fa9b406e7d0 2024-04-25T09:04:16.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.627+0000 7fa9aa000640 1 -- 172.21.15.175:0/1440474494 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa9a00bc070 con 0x7fa9b406e7d0 2024-04-25T09:04:16.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7fa9aa000640 1 --2- 172.21.15.175:0/1440474494 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa994066fb0 0x7fa994069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa60c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa5c0b2660 0x7ffa5c15bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa60c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa5c0b3880 0x7ffa5c0cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa60c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c15c6e0 0x7ffa5c0a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa59400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa5c0b3880 0x7ffa5c0cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa59400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa5c0b3880 0x7ffa5c0cf3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44334/0 (socket says 172.21.15.175:44334) 2024-04-25T09:04:16.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa59e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa5c0b2660 0x7ffa5c15bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa59e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa5c0b2660 0x7ffa5c15bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36582/0 (socket says 172.21.15.175:36582) 2024-04-25T09:04:16.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa59400640 1 -- 172.21.15.175:0/4108952439 learned_addr learned my addr 172.21.15.175:0/4108952439 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa60c00640 1 -- 172.21.15.175:0/4108952439 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c165980 con 0x7ffa5c0b2660 2024-04-25T09:04:16.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa60c00640 1 -- 172.21.15.175:0/4108952439 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c165800 con 0x7ffa5c15c6e0 2024-04-25T09:04:16.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7fa9aa000640 1 -- 172.21.15.175:0/1440474494 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9a011dff0 con 0x7fa9b406e7d0 2024-04-25T09:04:16.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa5a800640 1 --2- 172.21.15.175:0/4108952439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c15c6e0 0x7ffa5c0a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa60c00640 1 -- 172.21.15.175:0/4108952439 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c16ef00 con 0x7ffa5c0b3880 2024-04-25T09:04:16.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7f2d3a200640 1 -- 172.21.15.175:0/933123490 shutdown_connections 2024-04-25T09:04:16.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7fa9b1400640 1 --2- 172.21.15.175:0/1440474494 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa994066fb0 0x7fa994069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7f2d3a200640 1 -- 172.21.15.175:0/933123490 >> 172.21.15.175:0/933123490 conn(0x7f2d34067010 msgr2=0x7f2d3406ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7f2d3a200640 1 -- 172.21.15.175:0/933123490 shutdown_connections 2024-04-25T09:04:16.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7f2d3a200640 1 -- 172.21.15.175:0/933123490 wait complete. 2024-04-25T09:04:16.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa5a800640 1 -- 172.21.15.175:0/4108952439 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa5c0b3880 msgr2=0x7ffa5c0cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa5a800640 1 --2- 172.21.15.175:0/4108952439 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa5c0b3880 0x7ffa5c0cf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa5a800640 1 -- 172.21.15.175:0/4108952439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa5c0b2660 msgr2=0x7ffa5c15bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa5a800640 1 --2- 172.21.15.175:0/4108952439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa5c0b2660 0x7ffa5c15bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa5a800640 1 -- 172.21.15.175:0/4108952439 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c0cebc0 con 0x7ffa5c15c6e0 2024-04-25T09:04:16.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa5a800640 1 --2- 172.21.15.175:0/4108952439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c15c6e0 0x7ffa5c0a9f30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa54007cf0 tx=0x7ffa5400e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa52000640 1 -- 172.21.15.175:0/4108952439 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5400edd0 con 0x7ffa5c15c6e0 2024-04-25T09:04:16.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa52000640 1 -- 172.21.15.175:0/4108952439 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa540039a0 con 0x7ffa5c15c6e0 2024-04-25T09:04:16.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa52000640 1 -- 172.21.15.175:0/4108952439 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa54003d90 con 0x7ffa5c15c6e0 2024-04-25T09:04:16.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa60c00640 1 -- 172.21.15.175:0/4108952439 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5c0ceea0 con 0x7ffa5c15c6e0 2024-04-25T09:04:16.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.631+0000 7ffa60c00640 1 -- 172.21.15.175:0/4108952439 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5c0a9320 con 0x7ffa5c15c6e0 2024-04-25T09:04:16.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.635+0000 7fa9b1400640 1 --2- 172.21.15.175:0/1440474494 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa994066fb0 0x7fa994069470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4159010 tx=0x7fa9a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.635+0000 7fa9aa000640 1 -- 172.21.15.175:0/1440474494 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa9b4160710 con 0x7fa9b406e7d0 2024-04-25T09:04:16.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.635+0000 7f2d3a200640 1 Processor -- start 2024-04-25T09:04:16.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.635+0000 7ffa52000640 1 -- 172.21.15.175:0/4108952439 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffa5401b020 con 0x7ffa5c15c6e0 2024-04-25T09:04:16.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.635+0000 7f2d3a200640 1 -- start start 2024-04-25T09:04:16.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.635+0000 7ffa60c00640 1 -- 172.21.15.175:0/4108952439 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa340052a0 con 0x7ffa5c15c6e0 2024-04-25T09:04:16.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.639+0000 7ffa52000640 1 --2- 172.21.15.175:0/4108952439 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffa3c066fb0 0x7ffa3c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.639+0000 7f2d3a200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d180043b0 0x7f2d3413f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.639+0000 7f2d3a200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d34153760 0x7f2d3415be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.639+0000 7f2d3a200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d34151340 0x7f2d341517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.639+0000 7ffa59e00640 1 --2- 172.21.15.175:0/4108952439 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffa3c066fb0 0x7ffa3c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.639+0000 7f2d3a200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340cf6d0 con 0x7f2d34151340 2024-04-25T09:04:16.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.639+0000 7f2d3a200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340cf550 con 0x7f2d180043b0 2024-04-25T09:04:16.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.639+0000 7f2d3a200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340cf850 con 0x7f2d34153760 2024-04-25T09:04:16.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.639+0000 7f2d33e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d34151340 0x7f2d341517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.639+0000 7ffa52000640 1 -- 172.21.15.175:0/4108952439 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa54084ee0 con 0x7ffa5c15c6e0 2024-04-25T09:04:16.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.639+0000 7f2d33e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d34151340 0x7f2d341517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36584/0 (socket says 172.21.15.175:36584) 2024-04-25T09:04:16.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.639+0000 7f2d33e00640 1 -- 172.21.15.175:0/3716713002 learned_addr learned my addr 172.21.15.175:0/3716713002 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.639+0000 7f2d33e00640 1 -- 172.21.15.175:0/3716713002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d34153760 msgr2=0x7f2d3415be30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T09:04:16.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.639+0000 7f2d33e00640 1 --2- 172.21.15.175:0/3716713002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d34153760 0x7f2d3415be30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.639+0000 7f2d33e00640 1 -- 172.21.15.175:0/3716713002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d180043b0 msgr2=0x7f2d3413f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.639+0000 7f2d33e00640 1 --2- 172.21.15.175:0/3716713002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d180043b0 0x7f2d3413f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.639+0000 7f2d33e00640 1 -- 172.21.15.175:0/3716713002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3415c7a0 con 0x7f2d34151340 2024-04-25T09:04:16.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.639+0000 7f2d33e00640 1 --2- 172.21.15.175:0/3716713002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d34151340 0x7f2d341517d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2d340aeb10 tx=0x7f2d2000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.643+0000 7ffa59e00640 1 --2- 172.21.15.175:0/4108952439 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffa3c066fb0 0x7ffa3c069470 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffa48005890 tx=0x7ffa48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.643+0000 7f2d2b400640 1 -- 172.21.15.175:0/3716713002 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d20015070 con 0x7f2d34151340 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.643+0000 7f2d3a200640 1 -- 172.21.15.175:0/3716713002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3415ca80 con 0x7f2d34151340 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.643+0000 7f2d2b400640 1 -- 172.21.15.175:0/3716713002 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d20011800 con 0x7f2d34151340 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.643+0000 7f2d3a200640 1 -- 172.21.15.175:0/3716713002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3414ef00 con 0x7f2d34151340 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.643+0000 7f2d2b400640 1 -- 172.21.15.175:0/3716713002 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d20015070 con 0x7f2d34151340 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.643+0000 7ffa52000640 1 -- 172.21.15.175:0/4108952439 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffa54055980 con 0x7ffa5c15c6e0 2024-04-25T09:04:16.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.643+0000 7f2d3a200640 1 -- 172.21.15.175:0/3716713002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0c0052a0 con 0x7f2d34151340 2024-04-25T09:04:16.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.647+0000 7f2d2b400640 1 -- 172.21.15.175:0/3716713002 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2d20018070 con 0x7f2d34151340 2024-04-25T09:04:16.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.647+0000 7f2d2b400640 1 --2- 172.21.15.175:0/3716713002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2d14067160 0x7f2d14069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.655+0000 7f2d33400640 1 --2- 172.21.15.175:0/3716713002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2d14067160 0x7f2d14069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.655+0000 7f2d33400640 1 --2- 172.21.15.175:0/3716713002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2d14067160 0x7f2d14069620 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009bf0 tx=0x7f2d24009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.655+0000 7f2d2b400640 1 -- 172.21.15.175:0/3716713002 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d20052fd0 con 0x7f2d34151340 2024-04-25T09:04:16.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.659+0000 7f2d2b400640 1 -- 172.21.15.175:0/3716713002 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2d20055630 con 0x7f2d34151340 2024-04-25T09:04:16.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.675+0000 7f871f600640 1 Processor -- start 2024-04-25T09:04:16.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.675+0000 7f871f600640 1 -- start start 2024-04-25T09:04:16.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.675+0000 7f871f600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100df2b0 0x7f871004faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.675+0000 7f871f600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8710033d00 0x7f871004ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.675+0000 7f871cc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100df2b0 0x7f871004faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.675+0000 7f871cc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100df2b0 0x7f871004faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44346/0 (socket says 172.21.15.175:44346) 2024-04-25T09:04:16.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.679+0000 7f0f59200640 1 Processor -- start 2024-04-25T09:04:16.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.675+0000 7f871cc00640 1 -- 172.21.15.175:0/2894804242 learned_addr learned my addr 172.21.15.175:0/2894804242 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.679+0000 7f8717e00640 1 --2- 172.21.15.175:0/2894804242 >> v2:172.21.15.177:3300/0 conn(0x7f8710033d00 0x7f871004ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.679+0000 7f0f59200640 1 -- start start 2024-04-25T09:04:16.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.679+0000 7f871f600640 1 -- 172.21.15.175:0/2894804242 --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8710054120 con 0x7f87100e2d10 2024-04-25T09:04:16.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.679+0000 7f871f600640 1 -- 172.21.15.175:0/2894804242 --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87100df690 con 0x7f8710033d00 2024-04-25T09:04:16.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.679+0000 7f871f600640 1 -- 172.21.15.175:0/2894804242 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8710054400 con 0x7f87100df2b0 2024-04-25T09:04:16.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.679+0000 7f0f59200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0f540ac9e0 0x7f0f5406d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.679+0000 7f0f59200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f5415dc00 0x7f0f5406f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.679+0000 7f0f59200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f54161580 con 0x7f0f5415d820 2024-04-25T09:04:16.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.679+0000 7f0f59200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f54161860 con 0x7f0f540ac9e0 2024-04-25T09:04:16.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.679+0000 7f0f59200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f54161b40 con 0x7f0f5415dc00 2024-04-25T09:04:16.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.679+0000 7f0f52a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0f540ac9e0 0x7f0f5406d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.679+0000 7f0f52a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0f540ac9e0 0x7f0f5406d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36592/0 (socket says 172.21.15.175:36592) 2024-04-25T09:04:16.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.679+0000 7f0f52a00640 1 -- 172.21.15.175:0/529146920 learned_addr learned my addr 172.21.15.175:0/529146920 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.679+0000 7f8717e00640 1 -- 172.21.15.175:0/2894804242 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100df2b0 msgr2=0x7f871004faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.679+0000 7f8717e00640 1 --2- 172.21.15.175:0/2894804242 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100df2b0 0x7f871004faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.679+0000 7f8717e00640 1 -- 172.21.15.175:0/2894804242 >> v1:172.21.15.177:6789/0 conn(0x7f87100e2d10 legacy=0x7f87100e31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.679+0000 7f8717e00640 1 -- 172.21.15.175:0/2894804242 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87100546e0 con 0x7f8710033d00 2024-04-25T09:04:16.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.683+0000 7f0f53e00640 1 --2- 172.21.15.175:0/529146920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f5415dc00 0x7f0f5406f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.683+0000 7f0f52000640 1 -- 172.21.15.175:0/529146920 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234964527 0 0) 0x7f0f54161580 con 0x7f0f5415d820 2024-04-25T09:04:16.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.683+0000 7f0f52a00640 1 -- 172.21.15.175:0/529146920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f5415dc00 msgr2=0x7f0f5406f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.683+0000 7f0f52a00640 1 --2- 172.21.15.175:0/529146920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f5415dc00 0x7f0f5406f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.683+0000 7f0f52a00640 1 -- 172.21.15.175:0/529146920 >> v1:172.21.15.177:6789/0 conn(0x7f0f5415d820 legacy=0x7f0f54071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.683+0000 7f0f52a00640 1 -- 172.21.15.175:0/529146920 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f54161e20 con 0x7f0f540ac9e0 2024-04-25T09:04:16.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.683+0000 7f0f53e00640 1 --2- 172.21.15.175:0/529146920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f5415dc00 0x7f0f5406f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:16.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.683+0000 7f8717e00640 1 --2- 172.21.15.175:0/2894804242 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8710033d00 0x7f871004ffe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f870c00ba60 tx=0x7f870c01ea50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be95bc48b6a498c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.683+0000 7f8717400640 1 -- 172.21.15.175:0/2894804242 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c0b4070 con 0x7f8710033d00 2024-04-25T09:04:16.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.687+0000 7f8717400640 1 -- 172.21.15.175:0/2894804242 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c0a79f0 con 0x7f8710033d00 2024-04-25T09:04:16.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.687+0000 7f871f600640 1 -- 172.21.15.175:0/2894804242 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8710033d00 msgr2=0x7f871004ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.687+0000 7f8717400640 1 -- 172.21.15.175:0/2894804242 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c0b4070 con 0x7f8710033d00 2024-04-25T09:04:16.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.687+0000 7f871f600640 1 --2- 172.21.15.175:0/2894804242 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8710033d00 0x7f871004ffe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f870c00ba60 tx=0x7f870c01ea50 comp rx=0 tx=0).stop 2024-04-25T09:04:16.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.687+0000 7f871f600640 1 -- 172.21.15.175:0/2894804242 shutdown_connections 2024-04-25T09:04:16.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.687+0000 7f871f600640 1 --2- 172.21.15.175:0/2894804242 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8710033d00 0x7f871004ffe0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.687+0000 7f0f52a00640 1 --2- 172.21.15.175:0/529146920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f540ac9e0 0x7f0f5406d7a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0f40009870 tx=0x7f0f4001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c45b09535a8d49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.687+0000 7f871f600640 1 --2- 172.21.15.175:0/2894804242 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100df2b0 0x7f871004faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.687+0000 7f871f600640 1 -- 172.21.15.175:0/2894804242 >> 172.21.15.175:0/2894804242 conn(0x7f8710009fc0 msgr2=0x7f871000a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.687+0000 7f871f600640 1 -- 172.21.15.175:0/2894804242 shutdown_connections 2024-04-25T09:04:16.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.687+0000 7f871f600640 1 -- 172.21.15.175:0/2894804242 wait complete. 2024-04-25T09:04:16.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.687+0000 7f0f52000640 1 -- 172.21.15.175:0/529146920 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f400b2070 con 0x7f0f540ac9e0 2024-04-25T09:04:16.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.687+0000 7f0f52000640 1 -- 172.21.15.175:0/529146920 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f400a9070 con 0x7f0f540ac9e0 2024-04-25T09:04:16.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.687+0000 7f0f52000640 1 -- 172.21.15.175:0/529146920 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f400ad880 con 0x7f0f540ac9e0 2024-04-25T09:04:16.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.691+0000 7f0f59200640 1 -- 172.21.15.175:0/529146920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f540ac9e0 msgr2=0x7f0f5406d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.691+0000 7f0f59200640 1 --2- 172.21.15.175:0/529146920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f540ac9e0 0x7f0f5406d7a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0f40009870 tx=0x7f0f4001c560 comp rx=0 tx=0).stop 2024-04-25T09:04:16.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.691+0000 7f871f600640 1 Processor -- start 2024-04-25T09:04:16.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.691+0000 7f0f59200640 1 -- 172.21.15.175:0/529146920 shutdown_connections 2024-04-25T09:04:16.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.691+0000 7f0f59200640 1 --2- 172.21.15.175:0/529146920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f5415dc00 0x7f0f5406f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.691+0000 7f0f59200640 1 --2- 172.21.15.175:0/529146920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f540ac9e0 0x7f0f5406d7a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.691+0000 7f0f59200640 1 -- 172.21.15.175:0/529146920 >> 172.21.15.175:0/529146920 conn(0x7f0f540b1350 msgr2=0x7f0f540b1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.691+0000 7f0f59200640 1 -- 172.21.15.175:0/529146920 shutdown_connections 2024-04-25T09:04:16.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.691+0000 7f0f59200640 1 -- 172.21.15.175:0/529146920 wait complete. 2024-04-25T09:04:16.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.691+0000 7f871f600640 1 -- start start 2024-04-25T09:04:16.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.691+0000 7f871f600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8710033d00 0x7f871004af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f871cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8710033d00 0x7f871004af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f871f600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100df2b0 0x7f871004fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f0f59200640 1 Processor -- start 2024-04-25T09:04:16.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f0f59200640 1 -- start start 2024-04-25T09:04:16.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f8717e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100df2b0 0x7f871004fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f8717e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100df2b0 0x7f871004fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44364/0 (socket says 172.21.15.175:44364) 2024-04-25T09:04:16.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f8717e00640 1 -- 172.21.15.175:0/1982377289 learned_addr learned my addr 172.21.15.175:0/1982377289 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f871f600640 1 --2- 172.21.15.175:0/1982377289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87100e2d10 0x7f87100d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f871f600640 1 -- 172.21.15.175:0/1982377289 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871004f7e0 con 0x7f8710033d00 2024-04-25T09:04:16.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f871f600640 1 -- 172.21.15.175:0/1982377289 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871004f660 con 0x7f87100e2d10 2024-04-25T09:04:16.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f871f600640 1 -- 172.21.15.175:0/1982377289 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87100e38b0 con 0x7f87100df2b0 2024-04-25T09:04:16.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f871d600640 1 --2- 172.21.15.175:0/1982377289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87100e2d10 0x7f87100d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f8717e00640 1 -- 172.21.15.175:0/1982377289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87100e2d10 msgr2=0x7f87100d2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f8717e00640 1 --2- 172.21.15.175:0/1982377289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87100e2d10 0x7f87100d2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f8717e00640 1 -- 172.21.15.175:0/1982377289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8710033d00 msgr2=0x7f871004af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f8717e00640 1 --2- 172.21.15.175:0/1982377289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8710033d00 0x7f871004af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f8717e00640 1 -- 172.21.15.175:0/1982377289 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871003a340 con 0x7f87100df2b0 2024-04-25T09:04:16.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f0f59200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f5415d820 0x7f0f541f97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f0f59200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f5415dc00 0x7f0f54157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f0f59200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f54158240 0x7f0f5415f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f0f52a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f5415dc00 0x7f0f54157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f0f52a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f5415dc00 0x7f0f54157d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44374/0 (socket says 172.21.15.175:44374) 2024-04-25T09:04:16.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f0f52a00640 1 -- 172.21.15.175:0/2522566526 learned_addr learned my addr 172.21.15.175:0/2522566526 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:16.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f0f53e00640 1 --2- 172.21.15.175:0/2522566526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f54158240 0x7f0f5415f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f0f59200640 1 -- 172.21.15.175:0/2522566526 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540b2ed0 con 0x7f0f5415d820 2024-04-25T09:04:16.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f8717e00640 1 --2- 172.21.15.175:0/1982377289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100df2b0 0x7f871004fd00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f870c000c10 tx=0x7f870c01b7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f8714c00640 1 -- 172.21.15.175:0/1982377289 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c0bd070 con 0x7f87100df2b0 2024-04-25T09:04:16.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.695+0000 7f8714c00640 1 -- 172.21.15.175:0/1982377289 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870c0043c0 con 0x7f87100df2b0 2024-04-25T09:04:16.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f8714c00640 1 -- 172.21.15.175:0/1982377289 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870c0b4040 con 0x7f87100df2b0 2024-04-25T09:04:16.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f871f600640 1 -- 172.21.15.175:0/1982377289 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8710049ed0 con 0x7f87100df2b0 2024-04-25T09:04:16.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f0f59200640 1 -- 172.21.15.175:0/2522566526 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f54071a60 con 0x7f0f54158240 2024-04-25T09:04:16.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f0f59200640 1 -- 172.21.15.175:0/2522566526 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540b3050 con 0x7f0f5415dc00 2024-04-25T09:04:16.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f0f53400640 1 --2- 172.21.15.175:0/2522566526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f5415d820 0x7f0f541f97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f871f600640 1 -- 172.21.15.175:0/1982377289 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871004a490 con 0x7f87100df2b0 2024-04-25T09:04:16.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f0f53e00640 1 -- 172.21.15.175:0/2522566526 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f5415dc00 msgr2=0x7f0f54157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f0f53e00640 1 --2- 172.21.15.175:0/2522566526 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f5415dc00 0x7f0f54157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f0f53e00640 1 -- 172.21.15.175:0/2522566526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f5415d820 msgr2=0x7f0f541f97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f0f53e00640 1 --2- 172.21.15.175:0/2522566526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f5415d820 0x7f0f541f97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f0f53e00640 1 -- 172.21.15.175:0/2522566526 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5415b0b0 con 0x7f0f54158240 2024-04-25T09:04:16.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f0f53e00640 1 --2- 172.21.15.175:0/2522566526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f54158240 0x7f0f5415f4a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00efc0 tx=0x7f0f4c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f0f4b400640 1 -- 172.21.15.175:0/2522566526 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c018030 con 0x7f0f54158240 2024-04-25T09:04:16.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f0f4b400640 1 -- 172.21.15.175:0/2522566526 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c00cd30 con 0x7f0f54158240 2024-04-25T09:04:16.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f0f4b400640 1 -- 172.21.15.175:0/2522566526 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c003bc0 con 0x7f0f54158240 2024-04-25T09:04:16.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f0f59200640 1 -- 172.21.15.175:0/2522566526 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5415b390 con 0x7f0f54158240 2024-04-25T09:04:16.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f0f59200640 1 -- 172.21.15.175:0/2522566526 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5415b950 con 0x7f0f54158240 2024-04-25T09:04:16.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.699+0000 7f871f600640 1 -- 172.21.15.175:0/1982377289 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87100053a0 con 0x7f87100df2b0 2024-04-25T09:04:16.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.703+0000 7f8714c00640 1 -- 172.21.15.175:0/1982377289 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f870c0c0070 con 0x7f87100df2b0 2024-04-25T09:04:16.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.703+0000 7f8714c00640 1 --2- 172.21.15.175:0/1982377289 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86fc067030 0x7f86fc0694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.703+0000 7f8714c00640 1 -- 172.21.15.175:0/1982377289 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f870c11ecc0 con 0x7f87100df2b0 2024-04-25T09:04:16.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.703+0000 7f871cc00640 1 --2- 172.21.15.175:0/1982377289 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86fc067030 0x7f86fc0694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.703+0000 7f0f4b400640 1 -- 172.21.15.175:0/2522566526 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0f4c01b070 con 0x7f0f54158240 2024-04-25T09:04:16.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.703+0000 7f0f4b400640 1 --2- 172.21.15.175:0/2522566526 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f34067030 0x7f0f340694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.703+0000 7f0f4b400640 1 -- 172.21.15.175:0/2522566526 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f4c085900 con 0x7f0f54158240 2024-04-25T09:04:16.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.703+0000 7f0f59200640 1 -- 172.21.15.175:0/2522566526 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f54074a60 con 0x7f0f54158240 2024-04-25T09:04:16.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.707+0000 7f0f53400640 1 --2- 172.21.15.175:0/2522566526 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f34067030 0x7f0f340694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.707+0000 7f8714c00640 1 -- 172.21.15.175:0/1982377289 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f870c018760 con 0x7f87100df2b0 2024-04-25T09:04:16.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.707+0000 7f871cc00640 1 --2- 172.21.15.175:0/1982377289 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86fc067030 0x7f86fc0694f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8710039a80 tx=0x7f8708008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.707+0000 7f0f53400640 1 --2- 172.21.15.175:0/2522566526 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f34067030 0x7f0f340694f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0f44000f70 tx=0x7f0f44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.711+0000 7f0f4b400640 1 -- 172.21.15.175:0/2522566526 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0f4c010040 con 0x7f0f54158240 2024-04-25T09:04:16.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.931+0000 7fa177200640 1 -- 172.21.15.175:0/274687820 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa150005590 con 0x7fa1701050e0 2024-04-25T09:04:16.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.931+0000 7f6c38c00640 1 -- 172.21.15.175:0/3356563122 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6c340b5720 con 0x7f6c340ce020 2024-04-25T09:04:16.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.935+0000 7fa16e000640 1 -- 172.21.15.175:0/274687820 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa1780bf620 con 0x7fa1701050e0 2024-04-25T09:04:16.925 INFO:teuthology.orchestra.run.smithi175.stdout:55834574854 2024-04-25T09:04:16.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.935+0000 7f6c2b400640 1 -- 172.21.15.175:0/3356563122 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c200102e0 con 0x7f6c340ce020 2024-04-25T09:04:16.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.935+0000 7fa177200640 1 -- 172.21.15.175:0/274687820 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa158066f60 msgr2=0x7fa158069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.935+0000 7fa177200640 1 --2- 172.21.15.175:0/274687820 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa158066f60 0x7fa158069420 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa1640b0000 tx=0x7fa1640b7040 comp rx=0 tx=0).stop 2024-04-25T09:04:16.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.935+0000 7fa177200640 1 -- 172.21.15.175:0/274687820 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1701050e0 msgr2=0x7fa1700382e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.935+0000 7fa177200640 1 --2- 172.21.15.175:0/274687820 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1701050e0 0x7fa1700382e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa178064760 tx=0x7fa1780745a0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.939+0000 7fa177200640 1 -- 172.21.15.175:0/274687820 shutdown_connections 2024-04-25T09:04:16.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.939+0000 7fa177200640 1 --2- 172.21.15.175:0/274687820 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa158066f60 0x7fa158069420 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.939+0000 7fa177200640 1 --2- 172.21.15.175:0/274687820 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa1701050e0 0x7fa1700382e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.939+0000 7fa177200640 1 --2- 172.21.15.175:0/274687820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa170054460 0x7fa170037da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.939+0000 7fa177200640 1 --2- 172.21.15.175:0/274687820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa17004faf0 0x7fa1700f3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.939+0000 7fa177200640 1 -- 172.21.15.175:0/274687820 >> 172.21.15.175:0/274687820 conn(0x7fa170009fc0 msgr2=0x7fa170049d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.939+0000 7fa177200640 1 -- 172.21.15.175:0/274687820 shutdown_connections 2024-04-25T09:04:16.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.939+0000 7fa177200640 1 -- 172.21.15.175:0/274687820 wait complete. 2024-04-25T09:04:16.930 INFO:teuthology.orchestra.run.smithi175.stdout:55834574854 2024-04-25T09:04:16.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.939+0000 7f6c38c00640 1 -- 172.21.15.175:0/3356563122 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6c14066fb0 msgr2=0x7f6c14069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.939+0000 7f6c38c00640 1 --2- 172.21.15.175:0/3356563122 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6c14066fb0 0x7f6c14069470 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c24007fd0 tx=0x7f6c24007900 comp rx=0 tx=0).stop 2024-04-25T09:04:16.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.939+0000 7f6c38c00640 1 -- 172.21.15.175:0/3356563122 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c340ce020 msgr2=0x7f6c340726a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.939+0000 7f6c38c00640 1 --2- 172.21.15.175:0/3356563122 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c340ce020 0x7f6c340726a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000c700 tx=0x7f6c2000cbc0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.943+0000 7f6c38c00640 1 -- 172.21.15.175:0/3356563122 shutdown_connections 2024-04-25T09:04:16.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.943+0000 7f6c38c00640 1 --2- 172.21.15.175:0/3356563122 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6c14066fb0 0x7f6c14069470 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.943+0000 7f6c38c00640 1 --2- 172.21.15.175:0/3356563122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34165450 0x7f6c340c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.943+0000 7f6c38c00640 1 --2- 172.21.15.175:0/3356563122 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c340ce020 0x7f6c340726a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.943+0000 7f6c38c00640 1 --2- 172.21.15.175:0/3356563122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c340b5b60 0x7f6c3406da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.943+0000 7f6c38c00640 1 -- 172.21.15.175:0/3356563122 >> 172.21.15.175:0/3356563122 conn(0x7f6c340d0450 msgr2=0x7f6c3415fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.943+0000 7f6c38c00640 1 -- 172.21.15.175:0/3356563122 shutdown_connections 2024-04-25T09:04:16.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.943+0000 7f6c38c00640 1 -- 172.21.15.175:0/3356563122 wait complete. 2024-04-25T09:04:16.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.963+0000 7fa5c2000640 1 -- 172.21.15.175:0/1911253553 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa594005590 con 0x7fa5bc1582c0 2024-04-25T09:04:16.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.963+0000 7fa5b8c00640 1 -- 172.21.15.175:0/1911253553 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa5b40f0da0 con 0x7fa5bc1582c0 2024-04-25T09:04:16.955 INFO:teuthology.orchestra.run.smithi175.stdout:55834574856 2024-04-25T09:04:16.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.967+0000 7fa5c2000640 1 -- 172.21.15.175:0/1911253553 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa59c067030 msgr2=0x7fa59c0694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.967+0000 7fa5c2000640 1 --2- 172.21.15.175:0/1911253553 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa59c067030 0x7fa59c0694f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8000f70 tx=0x7fa5a8009040 comp rx=0 tx=0).stop 2024-04-25T09:04:16.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.967+0000 7fa5c2000640 1 -- 172.21.15.175:0/1911253553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc1582c0 msgr2=0x7fa5bc0b8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.967+0000 7fa5c2000640 1 --2- 172.21.15.175:0/1911253553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc1582c0 0x7fa5bc0b8250 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40194f0 tx=0x7fa5b4019680 comp rx=0 tx=0).stop 2024-04-25T09:04:16.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.967+0000 7fa5c2000640 1 -- 172.21.15.175:0/1911253553 shutdown_connections 2024-04-25T09:04:16.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.967+0000 7fa5c2000640 1 --2- 172.21.15.175:0/1911253553 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa59c067030 0x7fa59c0694f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.967+0000 7fa5c2000640 1 --2- 172.21.15.175:0/1911253553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5bc162280 0x7fa5bc0b8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.967+0000 7fa5c2000640 1 --2- 172.21.15.175:0/1911253553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5bc1582c0 0x7fa5bc0b8250 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.967+0000 7fa5c2000640 1 --2- 172.21.15.175:0/1911253553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5bc0b9360 0x7fa5bc203150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.967+0000 7fa5c2000640 1 -- 172.21.15.175:0/1911253553 >> 172.21.15.175:0/1911253553 conn(0x7fa5bc06bf80 msgr2=0x7fa5bc154a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.967+0000 7fa5c2000640 1 -- 172.21.15.175:0/1911253553 shutdown_connections 2024-04-25T09:04:16.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.967+0000 7fa5c2000640 1 -- 172.21.15.175:0/1911253553 wait complete. 2024-04-25T09:04:16.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2024-04-25T09:04:16.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.975+0000 7ffa60c00640 1 -- 172.21.15.175:0/4108952439 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ffa34005860 con 0x7ffa5c15c6e0 2024-04-25T09:04:16.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.979+0000 7ffa52000640 1 -- 172.21.15.175:0/4108952439 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa54059a20 con 0x7ffa5c15c6e0 2024-04-25T09:04:16.969 INFO:teuthology.orchestra.run.smithi175.stdout:55834574855 2024-04-25T09:04:16.970 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-04-25T09:04:16.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.979+0000 7fa9b9000640 1 -- 172.21.15.175:0/1440474494 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa9b4075140 con 0x7fa9b406e7d0 2024-04-25T09:04:16.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.979+0000 7fa9aa000640 1 -- 172.21.15.175:0/1440474494 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa9a0016110 con 0x7fa9b406e7d0 2024-04-25T09:04:16.972 INFO:teuthology.orchestra.run.smithi175.stdout:55834574852 2024-04-25T09:04:16.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.979+0000 7ffa60c00640 1 -- 172.21.15.175:0/4108952439 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffa3c066fb0 msgr2=0x7ffa3c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.979+0000 7ffa60c00640 1 --2- 172.21.15.175:0/4108952439 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffa3c066fb0 0x7ffa3c069470 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffa48005890 tx=0x7ffa48009040 comp rx=0 tx=0).stop 2024-04-25T09:04:16.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.983+0000 7ffa60c00640 1 -- 172.21.15.175:0/4108952439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c15c6e0 msgr2=0x7ffa5c0a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.983+0000 7ffa60c00640 1 --2- 172.21.15.175:0/4108952439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c15c6e0 0x7ffa5c0a9f30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffa54007cf0 tx=0x7ffa5400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.983+0000 7ffa60c00640 1 -- 172.21.15.175:0/4108952439 shutdown_connections 2024-04-25T09:04:16.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.983+0000 7ffa60c00640 1 --2- 172.21.15.175:0/4108952439 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffa3c066fb0 0x7ffa3c069470 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.983+0000 7ffa60c00640 1 --2- 172.21.15.175:0/4108952439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa5c15c6e0 0x7ffa5c0a9f30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.983+0000 7ffa60c00640 1 --2- 172.21.15.175:0/4108952439 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa5c0b3880 0x7ffa5c0cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.983+0000 7ffa60c00640 1 --2- 172.21.15.175:0/4108952439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa5c0b2660 0x7ffa5c15bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.983+0000 7ffa60c00640 1 -- 172.21.15.175:0/4108952439 >> 172.21.15.175:0/4108952439 conn(0x7ffa5c06ac50 msgr2=0x7ffa5c0ae720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.983+0000 7ffa60c00640 1 -- 172.21.15.175:0/4108952439 shutdown_connections 2024-04-25T09:04:16.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.983+0000 7ffa60c00640 1 -- 172.21.15.175:0/4108952439 wait complete. 2024-04-25T09:04:16.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.987+0000 7fa9b9000640 1 -- 172.21.15.175:0/1440474494 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa994066fb0 msgr2=0x7fa994069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.987+0000 7fa9b9000640 1 --2- 172.21.15.175:0/1440474494 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa994066fb0 0x7fa994069470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4159010 tx=0x7fa9a4008040 comp rx=0 tx=0).stop 2024-04-25T09:04:16.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.987+0000 7fa9b9000640 1 -- 172.21.15.175:0/1440474494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9b406e7d0 msgr2=0x7fa9b41566d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.987+0000 7fa9b9000640 1 --2- 172.21.15.175:0/1440474494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9b406e7d0 0x7fa9b41566d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00ae040 tx=0x7fa9a0019000 comp rx=0 tx=0).stop 2024-04-25T09:04:16.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.987+0000 7fa9b9000640 1 -- 172.21.15.175:0/1440474494 shutdown_connections 2024-04-25T09:04:16.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.987+0000 7fa9b9000640 1 --2- 172.21.15.175:0/1440474494 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa994066fb0 0x7fa994069470 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4159010 tx=0x7fa9a4008040 comp rx=0 tx=0).stop 2024-04-25T09:04:16.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.987+0000 7fa9b9000640 1 --2- 172.21.15.175:0/1440474494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9b415c6e0 0x7fa9b415de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.987+0000 7fa9b9000640 1 --2- 172.21.15.175:0/1440474494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9b40b2660 0x7fa9b415d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.987+0000 7fa9b9000640 1 --2- 172.21.15.175:0/1440474494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9b406e7d0 0x7fa9b41566d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.987+0000 7fa9b9000640 1 -- 172.21.15.175:0/1440474494 >> 172.21.15.175:0/1440474494 conn(0x7fa9b406ac50 msgr2=0x7fa9b415ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.987+0000 7fa9b9000640 1 -- 172.21.15.175:0/1440474494 shutdown_connections 2024-04-25T09:04:16.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.987+0000 7fa9b9000640 1 -- 172.21.15.175:0/1440474494 wait complete. 2024-04-25T09:04:16.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.987+0000 7f2d3a200640 1 -- 172.21.15.175:0/3716713002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2d0c005590 con 0x7f2d34151340 2024-04-25T09:04:16.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.987+0000 7f2d2b400640 1 -- 172.21.15.175:0/3716713002 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2d20054f30 con 0x7f2d34151340 2024-04-25T09:04:16.979 INFO:teuthology.orchestra.run.smithi175.stdout:55834574853 2024-04-25T09:04:16.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.991+0000 7f2d3a200640 1 -- 172.21.15.175:0/3716713002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2d14067160 msgr2=0x7f2d14069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.991+0000 7f2d3a200640 1 --2- 172.21.15.175:0/3716713002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2d14067160 0x7f2d14069620 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009bf0 tx=0x7f2d24009190 comp rx=0 tx=0).stop 2024-04-25T09:04:16.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.991+0000 7f2d3a200640 1 -- 172.21.15.175:0/3716713002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d34151340 msgr2=0x7f2d341517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.991+0000 7f2d3a200640 1 --2- 172.21.15.175:0/3716713002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d34151340 0x7f2d341517d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2d340aeb10 tx=0x7f2d2000c810 comp rx=0 tx=0).stop 2024-04-25T09:04:16.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.991+0000 7f2d3a200640 1 -- 172.21.15.175:0/3716713002 shutdown_connections 2024-04-25T09:04:16.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.991+0000 7f2d3a200640 1 --2- 172.21.15.175:0/3716713002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2d14067160 0x7f2d14069620 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.991+0000 7f2d3a200640 1 --2- 172.21.15.175:0/3716713002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d34151340 0x7f2d341517d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.991+0000 7f2d3a200640 1 --2- 172.21.15.175:0/3716713002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d34153760 0x7f2d3415be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.991+0000 7f2d3a200640 1 --2- 172.21.15.175:0/3716713002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d180043b0 0x7f2d3413f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.991+0000 7f2d3a200640 1 -- 172.21.15.175:0/3716713002 >> 172.21.15.175:0/3716713002 conn(0x7f2d34067010 msgr2=0x7f2d3406ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.991+0000 7f2d3a200640 1 -- 172.21.15.175:0/3716713002 shutdown_connections 2024-04-25T09:04:16.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:16.991+0000 7f2d3a200640 1 -- 172.21.15.175:0/3716713002 wait complete. 2024-04-25T09:04:16.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2024-04-25T09:04:17.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-04-25T09:04:17.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2024-04-25T09:04:17.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-04-25T09:04:17.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.027+0000 7f871f600640 1 -- 172.21.15.175:0/1982377289 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f87100dc2c0 con 0x7f87100df2b0 2024-04-25T09:04:17.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.027+0000 7f8714c00640 1 -- 172.21.15.175:0/1982377289 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f870c0efcb0 con 0x7f87100df2b0 2024-04-25T09:04:17.020 INFO:teuthology.orchestra.run.smithi175.stdout:55834574852 2024-04-25T09:04:17.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f871f600640 1 -- 172.21.15.175:0/1982377289 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86fc067030 msgr2=0x7f86fc0694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f871f600640 1 --2- 172.21.15.175:0/1982377289 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86fc067030 0x7f86fc0694f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8710039a80 tx=0x7f8708008040 comp rx=0 tx=0).stop 2024-04-25T09:04:17.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f871f600640 1 -- 172.21.15.175:0/1982377289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100df2b0 msgr2=0x7f871004fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f871f600640 1 --2- 172.21.15.175:0/1982377289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100df2b0 0x7f871004fd00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f870c000c10 tx=0x7f870c01b7f0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f0f59200640 1 -- 172.21.15.175:0/2522566526 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0f54168630 con 0x7f0f54158240 2024-04-25T09:04:17.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f871f600640 1 -- 172.21.15.175:0/1982377289 shutdown_connections 2024-04-25T09:04:17.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f871f600640 1 --2- 172.21.15.175:0/1982377289 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86fc067030 0x7f86fc0694f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f871f600640 1 --2- 172.21.15.175:0/1982377289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87100e2d10 0x7f87100d2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f871f600640 1 --2- 172.21.15.175:0/1982377289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100df2b0 0x7f871004fd00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f871f600640 1 --2- 172.21.15.175:0/1982377289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8710033d00 0x7f871004af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f871f600640 1 -- 172.21.15.175:0/1982377289 >> 172.21.15.175:0/1982377289 conn(0x7f8710009fc0 msgr2=0x7f8710050940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:17.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f871f600640 1 -- 172.21.15.175:0/1982377289 shutdown_connections 2024-04-25T09:04:17.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f871f600640 1 -- 172.21.15.175:0/1982377289 wait complete. 2024-04-25T09:04:17.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f0f4b400640 1 -- 172.21.15.175:0/2522566526 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0f4c0568f0 con 0x7f0f54158240 2024-04-25T09:04:17.023 INFO:teuthology.orchestra.run.smithi175.stdout:55834574853 2024-04-25T09:04:17.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f0f59200640 1 -- 172.21.15.175:0/2522566526 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f34067030 msgr2=0x7f0f340694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f0f59200640 1 --2- 172.21.15.175:0/2522566526 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f34067030 0x7f0f340694f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0f44000f70 tx=0x7f0f44009040 comp rx=0 tx=0).stop 2024-04-25T09:04:17.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f0f59200640 1 -- 172.21.15.175:0/2522566526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f54158240 msgr2=0x7f0f5415f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f0f59200640 1 --2- 172.21.15.175:0/2522566526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f54158240 0x7f0f5415f4a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00efc0 tx=0x7f0f4c00c490 comp rx=0 tx=0).stop 2024-04-25T09:04:17.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f0f59200640 1 -- 172.21.15.175:0/2522566526 shutdown_connections 2024-04-25T09:04:17.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f0f59200640 1 --2- 172.21.15.175:0/2522566526 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f34067030 0x7f0f340694f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f0f59200640 1 --2- 172.21.15.175:0/2522566526 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f54158240 0x7f0f5415f4a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f0f59200640 1 --2- 172.21.15.175:0/2522566526 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f5415dc00 0x7f0f54157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f0f59200640 1 --2- 172.21.15.175:0/2522566526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f5415d820 0x7f0f541f97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f0f59200640 1 -- 172.21.15.175:0/2522566526 >> 172.21.15.175:0/2522566526 conn(0x7f0f540b1350 msgr2=0x7f0f540aeff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:17.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f0f59200640 1 -- 172.21.15.175:0/2522566526 shutdown_connections 2024-04-25T09:04:17.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:17.031+0000 7f0f59200640 1 -- 172.21.15.175:0/2522566526 wait complete. 2024-04-25T09:04:17.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-04-25T09:04:17.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-04-25T09:04:17.967 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T09:04:17.971 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T09:04:17.991 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T09:04:18.008 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T09:04:18.012 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T09:04:18.016 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T09:04:18.045 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T09:04:18.046 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T09:04:18.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.187+0000 7f514a200640 1 Processor -- start 2024-04-25T09:04:18.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.187+0000 7f514a200640 1 -- start start 2024-04-25T09:04:18.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.187+0000 7f514a200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5144159b00 0x7f51440b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.187+0000 7f514a200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514406e530 con 0x7f51440719e0 2024-04-25T09:04:18.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.187+0000 7f514a200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514406e810 con 0x7f51440ccb20 2024-04-25T09:04:18.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.187+0000 7f514a200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5144072120 con 0x7f5144159b00 2024-04-25T09:04:18.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5143e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f51440719e0 0x7f51440cf550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59306/0 (socket says 172.21.15.175:59306) 2024-04-25T09:04:18.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5143e00640 1 -- 172.21.15.175:0/1786631965 learned_addr learned my addr 172.21.15.175:0/1786631965 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:18.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5143400640 1 --2- 172.21.15.175:0/1786631965 >> v2:172.21.15.175:3300/0 conn(0x7f5144159b00 0x7f51440b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5142000640 1 -- 172.21.15.175:0/1786631965 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269893960 0 0) 0x7f514406e530 con 0x7f51440719e0 2024-04-25T09:04:18.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5142000640 1 -- 172.21.15.175:0/1786631965 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5128003450 con 0x7f51440719e0 2024-04-25T09:04:18.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5142000640 1 -- 172.21.15.175:0/1786631965 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4181536741 0 0) 0x7f5128003450 con 0x7f51440719e0 2024-04-25T09:04:18.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5142000640 1 -- 172.21.15.175:0/1786631965 >> v2:172.21.15.175:3300/0 conn(0x7f5144159b00 msgr2=0x7f51440b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5142000640 1 --2- 172.21.15.175:0/1786631965 >> v2:172.21.15.175:3300/0 conn(0x7f5144159b00 0x7f51440b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5142000640 1 -- 172.21.15.175:0/1786631965 >> v1:172.21.15.177:6789/0 conn(0x7f51440ccb20 legacy=0x7f51440712d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T09:04:18.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5142000640 1 -- 172.21.15.175:0/1786631965 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514406eaf0 con 0x7f51440719e0 2024-04-25T09:04:18.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5142000640 1 -- 172.21.15.175:0/1786631965 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f5134004ce0 con 0x7f51440719e0 2024-04-25T09:04:18.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5142000640 1 -- 172.21.15.175:0/1786631965 >> v1:172.21.15.175:6789/0 conn(0x7f51440719e0 legacy=0x7f51440cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5142000640 1 --2- 172.21.15.175:0/1786631965 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5128003ab0 0x7f5128003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5142000640 1 --2- 172.21.15.175:0/1786631965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5128008980 0x7f512800ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5142000640 1 --2- 172.21.15.175:0/1786631965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f512800b6b0 0x7f512800db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5142000640 1 -- 172.21.15.175:0/1786631965 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5144072120 con 0x7f5128008980 2024-04-25T09:04:18.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5142000640 1 -- 172.21.15.175:0/1786631965 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512800e450 con 0x7f512800b6b0 2024-04-25T09:04:18.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5142000640 1 -- 172.21.15.175:0/1786631965 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512800e650 con 0x7f5128003ab0 2024-04-25T09:04:18.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f369b200640 1 Processor -- start 2024-04-25T09:04:18.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5143e00640 1 --2- 172.21.15.175:0/1786631965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f512800b6b0 0x7f512800db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5142a00640 1 --2- 172.21.15.175:0/1786631965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5128008980 0x7f512800ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f5143400640 1 --2- 172.21.15.175:0/1786631965 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5128003ab0 0x7f5128003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.195+0000 7f5143e00640 1 -- 172.21.15.175:0/1786631965 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5128003ab0 msgr2=0x7f5128003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.195+0000 7f5143e00640 1 --2- 172.21.15.175:0/1786631965 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5128003ab0 0x7f5128003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.195+0000 7f5143e00640 1 -- 172.21.15.175:0/1786631965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5128008980 msgr2=0x7f512800ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.195+0000 7f5143e00640 1 --2- 172.21.15.175:0/1786631965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5128008980 0x7f512800ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.195+0000 7f5143e00640 1 -- 172.21.15.175:0/1786631965 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5128003450 con 0x7f512800b6b0 2024-04-25T09:04:18.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.191+0000 7f369b200640 1 -- start start 2024-04-25T09:04:18.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.199+0000 7f5143e00640 1 -- 172.21.15.175:0/1786631965 reap_dead start 2024-04-25T09:04:18.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.199+0000 7f5143e00640 1 --2- 172.21.15.175:0/1786631965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f512800b6b0 0x7f512800db70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5134001aa0 tx=0x7f5134021660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a608f68b94c35e53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.199+0000 7f5142000640 1 -- 172.21.15.175:0/1786631965 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134007050 con 0x7f512800b6b0 2024-04-25T09:04:18.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.195+0000 7f369b200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f369415df10 0x7f36940b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.199+0000 7f5142000640 1 -- 172.21.15.175:0/1786631965 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51340b2070 con 0x7f512800b6b0 2024-04-25T09:04:18.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.199+0000 7f514a200640 1 -- 172.21.15.175:0/1786631965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f512800b6b0 msgr2=0x7f512800db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.199+0000 7f5142000640 1 -- 172.21.15.175:0/1786631965 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134007050 con 0x7f512800b6b0 2024-04-25T09:04:18.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.199+0000 7f514a200640 1 --2- 172.21.15.175:0/1786631965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f512800b6b0 0x7f512800db70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5134001aa0 tx=0x7f5134021660 comp rx=0 tx=0).stop 2024-04-25T09:04:18.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.195+0000 7f369b200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f36940d0840 0x7f3694161f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.195+0000 7f369b200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36940b5820 con 0x7f36940ce030 2024-04-25T09:04:18.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.195+0000 7f369b200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36940b5b00 con 0x7f36940d0840 2024-04-25T09:04:18.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.195+0000 7f369b200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36940b5de0 con 0x7f369415df10 2024-04-25T09:04:18.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.195+0000 7f3693e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f369415df10 0x7f36940b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.195+0000 7f3693e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f369415df10 0x7f36940b70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44400/0 (socket says 172.21.15.175:44400) 2024-04-25T09:04:18.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.195+0000 7f3693e00640 1 -- 172.21.15.175:0/1266857341 learned_addr learned my addr 172.21.15.175:0/1266857341 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:18.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.195+0000 7f3699200640 1 --2- 172.21.15.175:0/1266857341 >> v2:172.21.15.175:3300/0 conn(0x7f36940d0840 0x7f3694161f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.195+0000 7f3693e00640 1 -- 172.21.15.175:0/1266857341 >> v2:172.21.15.175:3300/0 conn(0x7f36940d0840 msgr2=0x7f3694161f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.195+0000 7f3693e00640 1 --2- 172.21.15.175:0/1266857341 >> v2:172.21.15.175:3300/0 conn(0x7f36940d0840 0x7f3694161f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.195+0000 7f3693e00640 1 -- 172.21.15.175:0/1266857341 >> v1:172.21.15.175:6789/0 conn(0x7f36940ce030 legacy=0x7f36940d0130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T09:04:18.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.195+0000 7f3693e00640 1 -- 172.21.15.175:0/1266857341 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36940b60c0 con 0x7f369415df10 2024-04-25T09:04:18.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.203+0000 7f514a200640 1 -- 172.21.15.175:0/1786631965 shutdown_connections 2024-04-25T09:04:18.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.203+0000 7f514a200640 1 --2- 172.21.15.175:0/1786631965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f512800b6b0 0x7f512800db70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.203+0000 7f514a200640 1 -- 172.21.15.175:0/1786631965 >> 172.21.15.175:0/1786631965 conn(0x7f5144067010 msgr2=0x7f514406ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.203+0000 7f3693e00640 1 --2- 172.21.15.175:0/1266857341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f369415df10 0x7f36940b70d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3680014420 tx=0x7f368002dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e4d93b915051145 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.203+0000 7f3692a00640 1 -- 172.21.15.175:0/1266857341 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36800c3070 con 0x7f369415df10 2024-04-25T09:04:18.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.203+0000 7f3692a00640 1 -- 172.21.15.175:0/1266857341 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36800b6ca0 con 0x7f369415df10 2024-04-25T09:04:18.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.203+0000 7f3692a00640 1 -- 172.21.15.175:0/1266857341 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36800be660 con 0x7f369415df10 2024-04-25T09:04:18.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.203+0000 7f369b200640 1 -- 172.21.15.175:0/1266857341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f369415df10 msgr2=0x7f36940b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.203+0000 7f369b200640 1 --2- 172.21.15.175:0/1266857341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f369415df10 0x7f36940b70d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3680014420 tx=0x7f368002dd40 comp rx=0 tx=0).stop 2024-04-25T09:04:18.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.203+0000 7f369b200640 1 -- 172.21.15.175:0/1266857341 shutdown_connections 2024-04-25T09:04:18.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.203+0000 7f369b200640 1 --2- 172.21.15.175:0/1266857341 >> v2:172.21.15.175:3300/0 conn(0x7f36940d0840 0x7f3694161f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.203+0000 7f369b200640 1 --2- 172.21.15.175:0/1266857341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f369415df10 0x7f36940b70d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.203+0000 7f369b200640 1 -- 172.21.15.175:0/1266857341 >> 172.21.15.175:0/1266857341 conn(0x7f369406c870 msgr2=0x7f3694072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.203+0000 7f369b200640 1 -- 172.21.15.175:0/1266857341 shutdown_connections 2024-04-25T09:04:18.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.203+0000 7f514a200640 1 -- 172.21.15.175:0/1786631965 shutdown_connections 2024-04-25T09:04:18.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.203+0000 7f514a200640 1 -- 172.21.15.175:0/1786631965 wait complete. 2024-04-25T09:04:18.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.203+0000 7f514a200640 1 Processor -- start 2024-04-25T09:04:18.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.207+0000 7f514a200640 1 -- start start 2024-04-25T09:04:18.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.203+0000 7f369b200640 1 -- 172.21.15.175:0/1266857341 wait complete. 2024-04-25T09:04:18.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.207+0000 7f369b200640 1 Processor -- start 2024-04-25T09:04:18.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.207+0000 7f369b200640 1 -- start start 2024-04-25T09:04:18.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.207+0000 7f514a200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f512800b6b0 0x7f5144158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.207+0000 7f514a200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51441567c0 0x7f5144156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.207+0000 7f514a200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51441f7d30 0x7f51441f81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.207+0000 7f5143400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f512800b6b0 0x7f5144158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.207+0000 7f5143400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f512800b6b0 0x7f5144158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44410/0 (socket says 172.21.15.175:44410) 2024-04-25T09:04:18.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.207+0000 7f5143400640 1 -- 172.21.15.175:0/624819748 learned_addr learned my addr 172.21.15.175:0/624819748 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:18.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.207+0000 7f514a200640 1 -- 172.21.15.175:0/624819748 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51440cf550 con 0x7f51441567c0 2024-04-25T09:04:18.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.207+0000 7f514a200640 1 -- 172.21.15.175:0/624819748 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51440d0470 con 0x7f51441f7d30 2024-04-25T09:04:18.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.207+0000 7f514a200640 1 -- 172.21.15.175:0/624819748 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51440cf6d0 con 0x7f512800b6b0 2024-04-25T09:04:18.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.207+0000 7f5143e00640 1 --2- 172.21.15.175:0/624819748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51441f7d30 0x7f51441f81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f5142a00640 1 --2- 172.21.15.175:0/624819748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51441567c0 0x7f5144156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f5143e00640 1 -- 172.21.15.175:0/624819748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f512800b6b0 msgr2=0x7f5144158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f5143e00640 1 --2- 172.21.15.175:0/624819748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f512800b6b0 0x7f5144158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f5143e00640 1 -- 172.21.15.175:0/624819748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51441567c0 msgr2=0x7f5144156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f5143e00640 1 --2- 172.21.15.175:0/624819748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51441567c0 0x7f5144156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f5143e00640 1 -- 172.21.15.175:0/624819748 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5144157510 con 0x7f51441f7d30 2024-04-25T09:04:18.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f369b200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36940ce030 0x7f36940cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f369b200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36940d0840 0x7f36941577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f5143e00640 1 --2- 172.21.15.175:0/624819748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51441f7d30 0x7f51441f81a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51440d07d0 tx=0x7f5128003740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f3693e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36940ce030 0x7f36940cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f3693e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36940ce030 0x7f36940cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:48488/0 (socket says 172.21.15.175:48488) 2024-04-25T09:04:18.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f3693e00640 1 -- 172.21.15.175:0/1166988722 learned_addr learned my addr 172.21.15.175:0/1166988722 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:18.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f3693400640 1 --2- 172.21.15.175:0/1166988722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36940d0840 0x7f36941577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f369b200640 1 --2- 172.21.15.175:0/1166988722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f369415df10 0x7f36940c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f513b400640 1 -- 172.21.15.175:0/624819748 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134001ae0 con 0x7f51441f7d30 2024-04-25T09:04:18.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f513b400640 1 -- 172.21.15.175:0/624819748 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51340bb070 con 0x7f51441f7d30 2024-04-25T09:04:18.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f513b400640 1 -- 172.21.15.175:0/624819748 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134001380 con 0x7f51441f7d30 2024-04-25T09:04:18.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f514a200640 1 -- 172.21.15.175:0/624819748 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51441577f0 con 0x7f51441f7d30 2024-04-25T09:04:18.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f514a200640 1 -- 172.21.15.175:0/624819748 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5144157db0 con 0x7f51441f7d30 2024-04-25T09:04:18.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f3699200640 1 --2- 172.21.15.175:0/1166988722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f369415df10 0x7f36940c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f369b200640 1 -- 172.21.15.175:0/1166988722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3694070100 con 0x7f369415df10 2024-04-25T09:04:18.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f369b200640 1 -- 172.21.15.175:0/1166988722 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369406ff80 con 0x7f36940ce030 2024-04-25T09:04:18.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f369b200640 1 -- 172.21.15.175:0/1166988722 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3694070280 con 0x7f36940d0840 2024-04-25T09:04:18.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f3693400640 1 -- 172.21.15.175:0/1166988722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36940ce030 msgr2=0x7f36940cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f3693400640 1 --2- 172.21.15.175:0/1166988722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36940ce030 0x7f36940cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f3693400640 1 -- 172.21.15.175:0/1166988722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f369415df10 msgr2=0x7f36940c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f3693400640 1 --2- 172.21.15.175:0/1166988722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f369415df10 0x7f36940c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f3693400640 1 -- 172.21.15.175:0/1166988722 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36940cbff0 con 0x7f36940d0840 2024-04-25T09:04:18.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.211+0000 7f5138c00640 1 -- 172.21.15.175:0/624819748 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5144075160 con 0x7f51441f7d30 2024-04-25T09:04:18.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.215+0000 7f5143400640 1 --2- 172.21.15.175:0/624819748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f512800b6b0 0x7f5144158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:18.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.215+0000 7f513b400640 1 -- 172.21.15.175:0/624819748 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f51340ab660 con 0x7f51441f7d30 2024-04-25T09:04:18.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.215+0000 7f3693400640 1 --2- 172.21.15.175:0/1166988722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36940d0840 0x7f36941577f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f368c00bd50 tx=0x7f368c00be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.215+0000 7f368be00640 1 -- 172.21.15.175:0/1166988722 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c019070 con 0x7f36940d0840 2024-04-25T09:04:18.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.215+0000 7f369b200640 1 -- 172.21.15.175:0/1166988722 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3694157d30 con 0x7f36940d0840 2024-04-25T09:04:18.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.215+0000 7f368be00640 1 -- 172.21.15.175:0/1166988722 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368c014440 con 0x7f36940d0840 2024-04-25T09:04:18.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.215+0000 7f368be00640 1 -- 172.21.15.175:0/1166988722 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c0148b0 con 0x7f36940d0840 2024-04-25T09:04:18.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.215+0000 7f369b200640 1 -- 172.21.15.175:0/1166988722 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3694161060 con 0x7f36940d0840 2024-04-25T09:04:18.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.215+0000 7f513b400640 1 --2- 172.21.15.175:0/624819748 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5124066fb0 0x7f5124069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.215+0000 7f369b200640 1 -- 172.21.15.175:0/1166988722 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3694074a60 con 0x7f36940d0840 2024-04-25T09:04:18.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.219+0000 7f513b400640 1 -- 172.21.15.175:0/624819748 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f513411ff90 con 0x7f51441f7d30 2024-04-25T09:04:18.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.219+0000 7f5143400640 1 --2- 172.21.15.175:0/624819748 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5124066fb0 0x7f5124069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.219+0000 7f368be00640 1 -- 172.21.15.175:0/1166988722 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f368c01c070 con 0x7f36940d0840 2024-04-25T09:04:18.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.219+0000 7f368be00640 1 --2- 172.21.15.175:0/1166988722 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3674066f60 0x7f3674069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.219+0000 7f5143400640 1 --2- 172.21.15.175:0/624819748 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5124066fb0 0x7f5124069470 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5130004660 tx=0x7f5130008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.219+0000 7f3693e00640 1 --2- 172.21.15.175:0/1166988722 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3674066f60 0x7f3674069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.223+0000 7f368be00640 1 -- 172.21.15.175:0/1166988722 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f368c084f70 con 0x7f36940d0840 2024-04-25T09:04:18.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.223+0000 7f513b400640 1 -- 172.21.15.175:0/624819748 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f513401b3a0 con 0x7f51441f7d30 2024-04-25T09:04:18.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.223+0000 7f3693e00640 1 --2- 172.21.15.175:0/1166988722 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3674066f60 0x7f3674069420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f368002dd80 tx=0x7f36800b8070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.223+0000 7f368be00640 1 -- 172.21.15.175:0/1166988722 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f368c055930 con 0x7f36940d0840 2024-04-25T09:04:18.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.247+0000 7fc7ac400640 1 Processor -- start 2024-04-25T09:04:18.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.247+0000 7fc7ac400640 1 -- start start 2024-04-25T09:04:18.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.251+0000 7fc7ac400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc7a415dd50 0x7fc7a40ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.251+0000 7fc7ac400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a40b6dc0 0x7fc7a40b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.251+0000 7fc7ac400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a40cf3c0 con 0x7fc7a40ce880 2024-04-25T09:04:18.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.251+0000 7fc7ac400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a40d3900 con 0x7fc7a415dd50 2024-04-25T09:04:18.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.251+0000 7fc7ac400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a40cee00 con 0x7fc7a40b6dc0 2024-04-25T09:04:18.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.251+0000 7fc7a9a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc7a415dd50 0x7fc7a40ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.251+0000 7fc7a9a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc7a415dd50 0x7fc7a40ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:48490/0 (socket says 172.21.15.175:48490) 2024-04-25T09:04:18.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.251+0000 7fc7a9a00640 1 -- 172.21.15.175:0/941820790 learned_addr learned my addr 172.21.15.175:0/941820790 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:18.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.251+0000 7fc7a3e00640 1 -- 172.21.15.175:0/941820790 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134341986 0 0) 0x7fc79c001120 con 0x7fc7a40ce880 2024-04-25T09:04:18.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.251+0000 7fc7a3e00640 1 -- 172.21.15.175:0/941820790 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc78c003530 con 0x7fc7a40ce880 2024-04-25T09:04:18.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.251+0000 7fc7a9a00640 1 -- 172.21.15.175:0/941820790 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a40b6dc0 msgr2=0x7fc7a40b5560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T09:04:18.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.251+0000 7fc7a9a00640 1 --2- 172.21.15.175:0/941820790 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a40b6dc0 0x7fc7a40b5560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.251+0000 7fc7a9a00640 1 -- 172.21.15.175:0/941820790 >> v1:172.21.15.177:6789/0 conn(0x7fc7a40ce880 legacy=0x7fc7a406c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.251+0000 7fc7a9a00640 1 -- 172.21.15.175:0/941820790 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a40cf0e0 con 0x7fc7a415dd50 2024-04-25T09:04:18.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.259+0000 7fc7a9a00640 1 --2- 172.21.15.175:0/941820790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a415dd50 0x7fc7a40ce340 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc790009870 tx=0x7fc79001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39cba8956c23fa4c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.259+0000 7fc7a3e00640 1 -- 172.21.15.175:0/941820790 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7900b1070 con 0x7fc7a415dd50 2024-04-25T09:04:18.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.259+0000 7fc7a3e00640 1 -- 172.21.15.175:0/941820790 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7900a8050 con 0x7fc7a415dd50 2024-04-25T09:04:18.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.259+0000 7fc7a3e00640 1 -- 172.21.15.175:0/941820790 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7900ac860 con 0x7fc7a415dd50 2024-04-25T09:04:18.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.259+0000 7fc7ac400640 1 -- 172.21.15.175:0/941820790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a415dd50 msgr2=0x7fc7a40ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.259+0000 7fc7ac400640 1 --2- 172.21.15.175:0/941820790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a415dd50 0x7fc7a40ce340 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc790009870 tx=0x7fc79001c510 comp rx=0 tx=0).stop 2024-04-25T09:04:18.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.259+0000 7fc7ac400640 1 -- 172.21.15.175:0/941820790 shutdown_connections 2024-04-25T09:04:18.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.259+0000 7fc7ac400640 1 --2- 172.21.15.175:0/941820790 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a40b6dc0 0x7fc7a40b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.259+0000 7fc7ac400640 1 --2- 172.21.15.175:0/941820790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a415dd50 0x7fc7a40ce340 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.259+0000 7fc7ac400640 1 -- 172.21.15.175:0/941820790 >> 172.21.15.175:0/941820790 conn(0x7fc7a40d0560 msgr2=0x7fc7a40d0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.259+0000 7fc7ac400640 1 -- 172.21.15.175:0/941820790 shutdown_connections 2024-04-25T09:04:18.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.259+0000 7fc7ac400640 1 -- 172.21.15.175:0/941820790 wait complete. 2024-04-25T09:04:18.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.263+0000 7f7a10c00640 1 Processor -- start 2024-04-25T09:04:18.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.263+0000 7fc7ac400640 1 Processor -- start 2024-04-25T09:04:18.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.263+0000 7fc7ac400640 1 -- start start 2024-04-25T09:04:18.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.263+0000 7f7a10c00640 1 -- start start 2024-04-25T09:04:18.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.263+0000 7fdf70e00640 1 Processor -- start 2024-04-25T09:04:18.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.263+0000 7fdf70e00640 1 -- start start 2024-04-25T09:04:18.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.263+0000 7fdf70e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf6c06b360 0x7fdf6c159df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.263+0000 7fdf70e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdf6c0b2480 0x7fdf6c0b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fdf6b400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fdf6c159a10 0x7fdf6c06ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:46572/0 (socket says 172.21.15.175:46572) 2024-04-25T09:04:18.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fdf6b400640 1 -- 172.21.15.175:0/1828326423 learned_addr learned my addr 172.21.15.175:0/1828326423 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:18.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fdf6be00640 1 --2- 172.21.15.175:0/1828326423 >> v2:172.21.15.177:3300/0 conn(0x7fdf6c0b2480 0x7fdf6c0b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fdf70e00640 1 -- 172.21.15.175:0/1828326423 --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf6c0cf230 con 0x7fdf6c159a10 2024-04-25T09:04:18.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.263+0000 7fc7ac400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7a40b6dc0 0x7fc7a40ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fc7a9a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7a40b6dc0 0x7fc7a40ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fc7a9a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7a40b6dc0 0x7fc7a40ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36682/0 (socket says 172.21.15.175:36682) 2024-04-25T09:04:18.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fc7a9a00640 1 -- 172.21.15.175:0/4079051177 learned_addr learned my addr 172.21.15.175:0/4079051177 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:18.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fc7ac400640 1 --2- 172.21.15.175:0/4079051177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a40ce880 0x7fc7a4207000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fc7ac400640 1 --2- 172.21.15.175:0/4079051177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a415dd50 0x7fc7a4207540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fc7ac400640 1 -- 172.21.15.175:0/4079051177 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a415e2b0 con 0x7fc7a40b6dc0 2024-04-25T09:04:18.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fc7ac400640 1 -- 172.21.15.175:0/4079051177 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a415e130 con 0x7fc7a40ce880 2024-04-25T09:04:18.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fc7ac400640 1 -- 172.21.15.175:0/4079051177 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a416ac90 con 0x7fc7a415dd50 2024-04-25T09:04:18.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fc7a9000640 1 --2- 172.21.15.175:0/4079051177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a40ce880 0x7fc7a4207000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fdf70e00640 1 -- 172.21.15.175:0/1828326423 --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6c15d6d0 con 0x7fdf6c0b2480 2024-04-25T09:04:18.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fdf70e00640 1 -- 172.21.15.175:0/1828326423 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c15d9b0 con 0x7fdf6c06b360 2024-04-25T09:04:18.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a10c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7a0c06b360 0x7f7a0c159df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a10c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0c0cf230 con 0x7f7a0c159a10 2024-04-25T09:04:18.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a10c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0c15d6d0 con 0x7f7a0c0b2480 2024-04-25T09:04:18.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a10c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a0c15d9b0 con 0x7f7a0c06b360 2024-04-25T09:04:18.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fc7aa400640 1 --2- 172.21.15.175:0/4079051177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a415dd50 0x7fc7a4207540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fdf6aa00640 1 --2- 172.21.15.175:0/1828326423 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf6c06b360 0x7fdf6c159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fdf6be00640 1 -- 172.21.15.175:0/1828326423 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf6c06b360 msgr2=0x7fdf6c159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fdf6be00640 1 --2- 172.21.15.175:0/1828326423 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf6c06b360 0x7fdf6c159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fdf6be00640 1 -- 172.21.15.175:0/1828326423 >> v1:172.21.15.177:6789/0 conn(0x7fdf6c159a10 legacy=0x7fdf6c06ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fdf6be00640 1 -- 172.21.15.175:0/1828326423 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c15dc90 con 0x7fdf6c0b2480 2024-04-25T09:04:18.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fdf6aa00640 1 --2- 172.21.15.175:0/1828326423 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf6c06b360 0x7fdf6c159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:18.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a0b400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7a0c159a10 0x7f7a0c06ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59320/0 (socket says 172.21.15.175:59320) 2024-04-25T09:04:18.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a0b400640 1 -- 172.21.15.175:0/1160723645 learned_addr learned my addr 172.21.15.175:0/1160723645 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:18.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fc7a9a00640 1 -- 172.21.15.175:0/4079051177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a415dd50 msgr2=0x7fc7a4207540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a0a000640 1 -- 172.21.15.175:0/1160723645 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678121064 0 0) 0x7f7a0c15d6d0 con 0x7f7a0c0b2480 2024-04-25T09:04:18.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fc7a9a00640 1 --2- 172.21.15.175:0/4079051177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a415dd50 0x7fc7a4207540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fc7a9a00640 1 -- 172.21.15.175:0/4079051177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a40ce880 msgr2=0x7fc7a4207000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fc7a9a00640 1 --2- 172.21.15.175:0/4079051177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a40ce880 0x7fc7a4207000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7fc7a9a00640 1 -- 172.21.15.175:0/4079051177 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a4207a80 con 0x7fc7a40b6dc0 2024-04-25T09:04:18.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a0a000640 1 -- 172.21.15.175:0/1160723645 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79f0003530 con 0x7f7a0c0b2480 2024-04-25T09:04:18.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a0a000640 1 -- 172.21.15.175:0/1160723645 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3843923385 0 0) 0x7f79f0003530 con 0x7f7a0c0b2480 2024-04-25T09:04:18.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a0a000640 1 -- 172.21.15.175:0/1160723645 >> v2:172.21.15.175:3300/0 conn(0x7f7a0c06b360 msgr2=0x7f7a0c159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7fc7a9a00640 1 --2- 172.21.15.175:0/4079051177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7a40b6dc0 0x7fc7a40ccfe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc79001abc0 tx=0x7fc79001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a0a000640 1 --2- 172.21.15.175:0/1160723645 >> v2:172.21.15.175:3300/0 conn(0x7f7a0c06b360 0x7f7a0c159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a0a000640 1 -- 172.21.15.175:0/1160723645 >> v1:172.21.15.175:6789/0 conn(0x7f7a0c159a10 legacy=0x7f7a0c06ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a0a000640 1 -- 172.21.15.175:0/1160723645 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c15dc90 con 0x7f7a0c0b2480 2024-04-25T09:04:18.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a0a000640 1 -- 172.21.15.175:0/1160723645 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f79fc001680 con 0x7f7a0c0b2480 2024-04-25T09:04:18.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a0a000640 1 -- 172.21.15.175:0/1160723645 >> v1:172.21.15.177:6789/0 conn(0x7f7a0c0b2480 legacy=0x7f7a0c0b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a0a000640 1 --2- 172.21.15.175:0/1160723645 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79f0004ba0 0x7f79f00037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a0a000640 1 --2- 172.21.15.175:0/1160723645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79f0003f40 0x7f79f0009010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a0a000640 1 --2- 172.21.15.175:0/1160723645 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79f0009550 0x7f79f0009a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a0a000640 1 -- 172.21.15.175:0/1160723645 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c15d9b0 con 0x7f79f0003f40 2024-04-25T09:04:18.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a0a000640 1 -- 172.21.15.175:0/1160723645 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f000a240 con 0x7f79f0009550 2024-04-25T09:04:18.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.267+0000 7f7a0a000640 1 -- 172.21.15.175:0/1160723645 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f000a440 con 0x7f79f0004ba0 2024-04-25T09:04:18.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7f7a0b400640 1 --2- 172.21.15.175:0/1160723645 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79f0004ba0 0x7f79f00037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7f7a0be00640 1 --2- 172.21.15.175:0/1160723645 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79f0009550 0x7f79f0009a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7f7a0aa00640 1 --2- 172.21.15.175:0/1160723645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79f0003f40 0x7f79f0009010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7f7a0b400640 1 -- 172.21.15.175:0/1160723645 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79f0009550 msgr2=0x7f79f0009a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7f7a0b400640 1 --2- 172.21.15.175:0/1160723645 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79f0009550 0x7f79f0009a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7f7a0b400640 1 -- 172.21.15.175:0/1160723645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79f0003f40 msgr2=0x7f79f0009010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7f7a0b400640 1 --2- 172.21.15.175:0/1160723645 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79f0003f40 0x7f79f0009010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7f7a0b400640 1 -- 172.21.15.175:0/1160723645 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c0cf230 con 0x7f79f0004ba0 2024-04-25T09:04:18.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7fc7a1600640 1 -- 172.21.15.175:0/4079051177 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7900b1040 con 0x7fc7a40b6dc0 2024-04-25T09:04:18.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7fea12e00640 1 Processor -- start 2024-04-25T09:04:18.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7f7a0be00640 1 --2- 172.21.15.175:0/1160723645 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79f0009550 0x7f79f0009a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:18.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7f7a0be00640 1 -- 172.21.15.175:0/1160723645 reap_dead start 2024-04-25T09:04:18.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7fea12e00640 1 -- start start 2024-04-25T09:04:18.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7fc7a1600640 1 -- 172.21.15.175:0/4079051177 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7900bd070 con 0x7fc7a40b6dc0 2024-04-25T09:04:18.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7fc7ac400640 1 -- 172.21.15.175:0/4079051177 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a4207d10 con 0x7fc7a40b6dc0 2024-04-25T09:04:18.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7fc7ac400640 1 -- 172.21.15.175:0/4079051177 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a40c1af0 con 0x7fc7a40b6dc0 2024-04-25T09:04:18.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7fc7a1600640 1 -- 172.21.15.175:0/4079051177 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7900b7660 con 0x7fc7a40b6dc0 2024-04-25T09:04:18.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7fea12e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fea0c0b2bc0 0x7fea0c0b8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7fea12e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fea0c0b6960 0x7fea0c0b8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.271+0000 7fea12e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea0c0d3430 0x7fea0c0d16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fea12e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea0c0b9170 con 0x7fea0c0b2bc0 2024-04-25T09:04:18.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fea12e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea0c0b9450 con 0x7fea0c0b6960 2024-04-25T09:04:18.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fea12e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c0b9730 con 0x7fea0c0d3430 2024-04-25T09:04:18.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fea0be00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fea0c0b2bc0 0x7fea0c0b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fea0be00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fea0c0b2bc0 0x7fea0c0b8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36702/0 (socket says 172.21.15.175:36702) 2024-04-25T09:04:18.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fea0be00640 1 -- 172.21.15.175:0/3755749153 learned_addr learned my addr 172.21.15.175:0/3755749153 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:18.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fea0b400640 1 --2- 172.21.15.175:0/3755749153 >> v2:172.21.15.177:3300/0 conn(0x7fea0c0b6960 0x7fea0c0b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fea10e00640 1 --2- 172.21.15.175:0/3755749153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea0c0d3430 0x7fea0c0d16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fc7ac400640 1 -- 172.21.15.175:0/4079051177 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7800052a0 con 0x7fc7a40b6dc0 2024-04-25T09:04:18.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fdf6be00640 1 --2- 172.21.15.175:0/1828326423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6c0b2480 0x7fdf6c0b2c80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009d90 tx=0x7fdf6401c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6963332f39df8cee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fdf6a000640 1 -- 172.21.15.175:0/1828326423 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf640ad070 con 0x7fdf6c0b2480 2024-04-25T09:04:18.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7f7a0b400640 1 --2- 172.21.15.175:0/1160723645 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79f0004ba0 0x7f79f00037b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7a0401d520 tx=0x7f7a04030550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85537a7841d171e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fdf6a000640 1 -- 172.21.15.175:0/1828326423 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf640a9680 con 0x7fdf6c0b2480 2024-04-25T09:04:18.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fdf6a000640 1 -- 172.21.15.175:0/1828326423 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf640a9a50 con 0x7fdf6c0b2480 2024-04-25T09:04:18.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fea10e00640 1 -- 172.21.15.175:0/3755749153 >> v2:172.21.15.177:3300/0 conn(0x7fea0c0b6960 msgr2=0x7fea0c0b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fea10e00640 1 --2- 172.21.15.175:0/3755749153 >> v2:172.21.15.177:3300/0 conn(0x7fea0c0b6960 0x7fea0c0b8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fdf70e00640 1 -- 172.21.15.175:0/1828326423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6c0b2480 msgr2=0x7fdf6c0b2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7f7a0a000640 1 -- 172.21.15.175:0/1160723645 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0401d0f0 con 0x7f79f0004ba0 2024-04-25T09:04:18.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7f7a0a000640 1 -- 172.21.15.175:0/1160723645 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a040c1650 con 0x7f79f0004ba0 2024-04-25T09:04:18.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7f7a0a000640 1 -- 172.21.15.175:0/1160723645 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a040c1a40 con 0x7f79f0004ba0 2024-04-25T09:04:18.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7f7a10c00640 1 -- 172.21.15.175:0/1160723645 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79f0004ba0 msgr2=0x7f79f00037b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fdf70e00640 1 --2- 172.21.15.175:0/1828326423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6c0b2480 0x7fdf6c0b2c80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009d90 tx=0x7fdf6401c770 comp rx=0 tx=0).stop 2024-04-25T09:04:18.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7f7a10c00640 1 --2- 172.21.15.175:0/1160723645 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79f0004ba0 0x7f79f00037b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7a0401d520 tx=0x7f7a04030550 comp rx=0 tx=0).stop 2024-04-25T09:04:18.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7f7a10c00640 1 -- 172.21.15.175:0/1160723645 shutdown_connections 2024-04-25T09:04:18.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7f7a10c00640 1 --2- 172.21.15.175:0/1160723645 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79f0004ba0 0x7f79f00037b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7f7a10c00640 1 -- 172.21.15.175:0/1160723645 >> 172.21.15.175:0/1160723645 conn(0x7f7a0c067070 msgr2=0x7f7a0c0b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fc7a1600640 1 -- 172.21.15.175:0/4079051177 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc7900b7800 con 0x7fc7a40b6dc0 2024-04-25T09:04:18.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fea10e00640 1 -- 172.21.15.175:0/3755749153 >> v2:172.21.15.175:3300/0 conn(0x7fea0c0b2bc0 msgr2=0x7fea0c0b8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fea10e00640 1 --2- 172.21.15.175:0/3755749153 >> v2:172.21.15.175:3300/0 conn(0x7fea0c0b2bc0 0x7fea0c0b8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.275+0000 7fea10e00640 1 -- 172.21.15.175:0/3755749153 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0c0ce200 con 0x7fea0c0d3430 2024-04-25T09:04:18.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.279+0000 7fdf70e00640 1 -- 172.21.15.175:0/1828326423 shutdown_connections 2024-04-25T09:04:18.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.279+0000 7fdf70e00640 1 --2- 172.21.15.175:0/1828326423 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6c0b2480 0x7fdf6c0b2c80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.279+0000 7fdf70e00640 1 --2- 172.21.15.175:0/1828326423 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf6c06b360 0x7fdf6c159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.279+0000 7fdf70e00640 1 -- 172.21.15.175:0/1828326423 >> 172.21.15.175:0/1828326423 conn(0x7fdf6c067070 msgr2=0x7fdf6c0b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.279+0000 7fc7a1600640 1 --2- 172.21.15.175:0/4079051177 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc784066f60 0x7fc784069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.279+0000 7fc7a1600640 1 -- 172.21.15.175:0/4079051177 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc79011f0d0 con 0x7fc7a40b6dc0 2024-04-25T09:04:18.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.279+0000 7fdf70e00640 1 -- 172.21.15.175:0/1828326423 shutdown_connections 2024-04-25T09:04:18.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.279+0000 7fc7a9000640 1 --2- 172.21.15.175:0/4079051177 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc784066f60 0x7fc784069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.279+0000 7fc7a9000640 1 --2- 172.21.15.175:0/4079051177 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc784066f60 0x7fc784069420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40ca5b0 tx=0x7fc7980094f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.279+0000 7fdf70e00640 1 -- 172.21.15.175:0/1828326423 wait complete. 2024-04-25T09:04:18.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fea10e00640 1 --2- 172.21.15.175:0/3755749153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea0c0d3430 0x7fea0c0d16e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0b5590 tx=0x7fe9fc01ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=100f295266877b79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7f7a10c00640 1 -- 172.21.15.175:0/1160723645 shutdown_connections 2024-04-25T09:04:18.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7f7a10c00640 1 -- 172.21.15.175:0/1160723645 wait complete. 2024-04-25T09:04:18.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fdf70e00640 1 Processor -- start 2024-04-25T09:04:18.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fdf70e00640 1 -- start start 2024-04-25T09:04:18.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fea0aa00640 1 -- 172.21.15.175:0/3755749153 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc0b5070 con 0x7fea0c0d3430 2024-04-25T09:04:18.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fea0aa00640 1 -- 172.21.15.175:0/3755749153 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9fc0a8930 con 0x7fea0c0d3430 2024-04-25T09:04:18.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fea0aa00640 1 -- 172.21.15.175:0/3755749153 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc0a8d00 con 0x7fea0c0d3430 2024-04-25T09:04:18.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fea12e00640 1 -- 172.21.15.175:0/3755749153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea0c0d3430 msgr2=0x7fea0c0d16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fea12e00640 1 --2- 172.21.15.175:0/3755749153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea0c0d3430 0x7fea0c0d16e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fea0c0b5590 tx=0x7fe9fc01ec70 comp rx=0 tx=0).stop 2024-04-25T09:04:18.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fea12e00640 1 -- 172.21.15.175:0/3755749153 shutdown_connections 2024-04-25T09:04:18.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fea12e00640 1 --2- 172.21.15.175:0/3755749153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea0c0d3430 0x7fea0c0d16e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fdf70e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf6c06b360 0x7fdf6c157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fdf70e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6c0b2480 0x7fdf6c14acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fdf70e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf6c159a10 0x7fdf6c14d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fdf70e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c166890 con 0x7fdf6c159a10 2024-04-25T09:04:18.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fdf70e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c0b3be0 con 0x7fdf6c0b2480 2024-04-25T09:04:18.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fdf70e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c166a10 con 0x7fdf6c06b360 2024-04-25T09:04:18.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fea12e00640 1 --2- 172.21.15.175:0/3755749153 >> v2:172.21.15.177:3300/0 conn(0x7fea0c0b6960 0x7fea0c0b8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fea12e00640 1 --2- 172.21.15.175:0/3755749153 >> v2:172.21.15.175:3300/0 conn(0x7fea0c0b2bc0 0x7fea0c0b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fea12e00640 1 -- 172.21.15.175:0/3755749153 >> 172.21.15.175:0/3755749153 conn(0x7fea0c0b5600 msgr2=0x7fea0c0b5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fdf6aa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6c0b2480 0x7fdf6c14acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fdf6aa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6c0b2480 0x7fdf6c14acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:48530/0 (socket says 172.21.15.175:48530) 2024-04-25T09:04:18.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7f7a10c00640 1 Processor -- start 2024-04-25T09:04:18.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7f7a10c00640 1 -- start start 2024-04-25T09:04:18.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fdf6aa00640 1 -- 172.21.15.175:0/1421186743 learned_addr learned my addr 172.21.15.175:0/1421186743 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:18.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7fea12e00640 1 -- 172.21.15.175:0/3755749153 shutdown_connections 2024-04-25T09:04:18.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fdf6b400640 1 --2- 172.21.15.175:0/1421186743 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf6c06b360 0x7fdf6c157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.283+0000 7fdf6be00640 1 --2- 172.21.15.175:0/1421186743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf6c159a10 0x7fdf6c14d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7fea12e00640 1 -- 172.21.15.175:0/3755749153 wait complete. 2024-04-25T09:04:18.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7f7a10c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79f0004ba0 0x7f7a0c0add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7f7a10c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a0c15a770 0x7f7a0c1ef0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7f7a0b400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79f0004ba0 0x7f7a0c0add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7f7a0b400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79f0004ba0 0x7f7a0c0add70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44468/0 (socket says 172.21.15.175:44468) 2024-04-25T09:04:18.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7f7a0b400640 1 -- 172.21.15.175:0/533451535 learned_addr learned my addr 172.21.15.175:0/533451535 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:18.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7f7a10c00640 1 --2- 172.21.15.175:0/533451535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a0c1ef620 0x7f7a0c15b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7fdf6be00640 1 -- 172.21.15.175:0/1421186743 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf6c06b360 msgr2=0x7fdf6c157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7fdf6be00640 1 --2- 172.21.15.175:0/1421186743 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf6c06b360 0x7fdf6c157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7fdf6be00640 1 -- 172.21.15.175:0/1421186743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6c0b2480 msgr2=0x7fdf6c14acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7fdf6be00640 1 --2- 172.21.15.175:0/1421186743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6c0b2480 0x7fdf6c14acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7fdf6be00640 1 -- 172.21.15.175:0/1421186743 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c1508c0 con 0x7fdf6c159a10 2024-04-25T09:04:18.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7f7a10c00640 1 -- 172.21.15.175:0/533451535 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c06f1f0 con 0x7f7a0c15a770 2024-04-25T09:04:18.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7f7a0aa00640 1 --2- 172.21.15.175:0/533451535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a0c15a770 0x7f7a0c1ef0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7f7a10c00640 1 -- 172.21.15.175:0/533451535 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c06d810 con 0x7f7a0c1ef620 2024-04-25T09:04:18.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7f7a10c00640 1 -- 172.21.15.175:0/533451535 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c06f370 con 0x7f79f0004ba0 2024-04-25T09:04:18.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7f7a0be00640 1 --2- 172.21.15.175:0/533451535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a0c1ef620 0x7f7a0c15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7fdf6be00640 1 --2- 172.21.15.175:0/1421186743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf6c159a10 0x7fdf6c14d570 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf640ac000 tx=0x7fdf64019510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7fdf6b400640 1 --2- 172.21.15.175:0/1421186743 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf6c06b360 0x7fdf6c157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:18.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7f7a0aa00640 1 -- 172.21.15.175:0/533451535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79f0004ba0 msgr2=0x7f7a0c0add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7f7a0aa00640 1 --2- 172.21.15.175:0/533451535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79f0004ba0 0x7f7a0c0add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7f7a0aa00640 1 -- 172.21.15.175:0/533451535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a0c1ef620 msgr2=0x7f7a0c15b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7f7a0aa00640 1 --2- 172.21.15.175:0/533451535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a0c1ef620 0x7f7a0c15b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7f7a0aa00640 1 -- 172.21.15.175:0/533451535 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c1efb30 con 0x7f7a0c15a770 2024-04-25T09:04:18.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7f7a0be00640 1 --2- 172.21.15.175:0/533451535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a0c1ef620 0x7f7a0c15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:18.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7fdf63400640 1 -- 172.21.15.175:0/1421186743 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf640ad040 con 0x7fdf6c159a10 2024-04-25T09:04:18.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7fdf63400640 1 -- 172.21.15.175:0/1421186743 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf640b2660 con 0x7fdf6c159a10 2024-04-25T09:04:18.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7fdf63400640 1 -- 172.21.15.175:0/1421186743 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf640b2a10 con 0x7fdf6c159a10 2024-04-25T09:04:18.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7fc7a1600640 1 -- 172.21.15.175:0/4079051177 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc790016130 con 0x7fc7a40b6dc0 2024-04-25T09:04:18.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7fdf70e00640 1 -- 172.21.15.175:0/1421186743 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf6c150ba0 con 0x7fdf6c159a10 2024-04-25T09:04:18.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7fdf70e00640 1 -- 172.21.15.175:0/1421186743 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6c151160 con 0x7fdf6c159a10 2024-04-25T09:04:18.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7f7a0aa00640 1 --2- 172.21.15.175:0/533451535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a0c15a770 0x7f7a0c1ef0e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f79f800d530 tx=0x7f79f800d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7f7a03400640 1 -- 172.21.15.175:0/533451535 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8018030 con 0x7f7a0c15a770 2024-04-25T09:04:18.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7f7a03400640 1 -- 172.21.15.175:0/533451535 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f8004020 con 0x7f7a0c15a770 2024-04-25T09:04:18.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7f7a03400640 1 -- 172.21.15.175:0/533451535 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f80041f0 con 0x7f7a0c15a770 2024-04-25T09:04:18.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7f7a10c00640 1 -- 172.21.15.175:0/533451535 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a0c1efe10 con 0x7f7a0c15a770 2024-04-25T09:04:18.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7fea12e00640 1 Processor -- start 2024-04-25T09:04:18.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.287+0000 7fea12e00640 1 -- start start 2024-04-25T09:04:18.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea12e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea0c0b2bc0 0x7fea0c0c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea12e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea0c0b6960 0x7fea0c0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea12e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea0c0d3430 0x7fea0c1526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea0be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea0c0b2bc0 0x7fea0c0c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea0b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea0c0b6960 0x7fea0c0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea0b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea0c0b6960 0x7fea0c0cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:48542/0 (socket says 172.21.15.175:48542) 2024-04-25T09:04:18.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea0be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea0c0b2bc0 0x7fea0c0c9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44482/0 (socket says 172.21.15.175:44482) 2024-04-25T09:04:18.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea10e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea0c0d3430 0x7fea0c1526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea10e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea0c0d3430 0x7fea0c1526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36720/0 (socket says 172.21.15.175:36720) 2024-04-25T09:04:18.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea0b400640 1 -- 172.21.15.175:0/1174782844 learned_addr learned my addr 172.21.15.175:0/1174782844 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:18.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea12e00640 1 -- 172.21.15.175:0/1174782844 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c0b3120 con 0x7fea0c0d3430 2024-04-25T09:04:18.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea12e00640 1 -- 172.21.15.175:0/1174782844 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c0b2fa0 con 0x7fea0c0b6960 2024-04-25T09:04:18.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea12e00640 1 -- 172.21.15.175:0/1174782844 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c0b8ba0 con 0x7fea0c0b2bc0 2024-04-25T09:04:18.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea10e00640 1 -- 172.21.15.175:0/1174782844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea0c0b2bc0 msgr2=0x7fea0c0c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea10e00640 1 --2- 172.21.15.175:0/1174782844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea0c0b2bc0 0x7fea0c0c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea10e00640 1 -- 172.21.15.175:0/1174782844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea0c0b6960 msgr2=0x7fea0c0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea10e00640 1 --2- 172.21.15.175:0/1174782844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea0c0b6960 0x7fea0c0cabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea10e00640 1 -- 172.21.15.175:0/1174782844 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0c15d7e0 con 0x7fea0c0d3430 2024-04-25T09:04:18.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fea10e00640 1 --2- 172.21.15.175:0/1174782844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea0c0d3430 0x7fea0c1526f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0af000 tx=0x7fe9fc01ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.295+0000 7f7a10c00640 1 -- 172.21.15.175:0/533451535 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a0c15a250 con 0x7f7a0c15a770 2024-04-25T09:04:18.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.291+0000 7fdf63400640 1 -- 172.21.15.175:0/1421186743 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdf640b0070 con 0x7fdf6c159a10 2024-04-25T09:04:18.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.295+0000 7fea03e00640 1 -- 172.21.15.175:0/1174782844 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc0e4070 con 0x7fea0c0d3430 2024-04-25T09:04:18.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.295+0000 7fea12e00640 1 -- 172.21.15.175:0/1174782844 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea0c15dac0 con 0x7fea0c0d3430 2024-04-25T09:04:18.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.295+0000 7fea12e00640 1 -- 172.21.15.175:0/1174782844 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea0c15e080 con 0x7fea0c0d3430 2024-04-25T09:04:18.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.295+0000 7fea03e00640 1 -- 172.21.15.175:0/1174782844 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9fc0a8870 con 0x7fea0c0d3430 2024-04-25T09:04:18.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.295+0000 7f7a10c00640 1 -- 172.21.15.175:0/533451535 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0c1f0010 con 0x7f7a0c15a770 2024-04-25T09:04:18.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.295+0000 7f7a03400640 1 -- 172.21.15.175:0/533451535 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f79f801b070 con 0x7f7a0c15a770 2024-04-25T09:04:18.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.299+0000 7f7a03400640 1 --2- 172.21.15.175:0/533451535 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f79ec067030 0x7f79ec0694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.299+0000 7f7a03400640 1 -- 172.21.15.175:0/533451535 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79f8084e50 con 0x7f7a0c15a770 2024-04-25T09:04:18.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.299+0000 7f7a0b400640 1 --2- 172.21.15.175:0/533451535 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f79ec067030 0x7f79ec0694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.299+0000 7f7a0b400640 1 --2- 172.21.15.175:0/533451535 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f79ec067030 0x7f79ec0694f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7a04030590 tx=0x7f7a04007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.295+0000 7fdf70e00640 1 -- 172.21.15.175:0/1421186743 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf6c074a60 con 0x7fdf6c159a10 2024-04-25T09:04:18.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.295+0000 7fdf63400640 1 --2- 172.21.15.175:0/1421186743 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdf4c066f60 0x7fdf4c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.295+0000 7fdf63400640 1 -- 172.21.15.175:0/1421186743 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf64124060 con 0x7fdf6c159a10 2024-04-25T09:04:18.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.299+0000 7fdf6b400640 1 --2- 172.21.15.175:0/1421186743 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdf4c066f60 0x7fdf4c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.299+0000 7fdf6b400640 1 --2- 172.21.15.175:0/1421186743 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdf4c066f60 0x7fdf4c069420 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c00f2a0 tx=0x7fdf5c00a2e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.299+0000 7fea12e00640 1 -- 172.21.15.175:0/1174782844 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e40052a0 con 0x7fea0c0d3430 2024-04-25T09:04:18.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.299+0000 7fea03e00640 1 -- 172.21.15.175:0/1174782844 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc0ed060 con 0x7fea0c0d3430 2024-04-25T09:04:18.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.303+0000 7fdf63400640 1 -- 172.21.15.175:0/1421186743 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdf64016480 con 0x7fdf6c159a10 2024-04-25T09:04:18.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.315+0000 7f7a03400640 1 -- 172.21.15.175:0/533451535 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f79f80557f0 con 0x7f7a0c15a770 2024-04-25T09:04:18.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.319+0000 7fea03e00640 1 -- 172.21.15.175:0/1174782844 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe9fc0dca60 con 0x7fea0c0d3430 2024-04-25T09:04:18.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.319+0000 7fea03e00640 1 --2- 172.21.15.175:0/1174782844 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe9f00670b0 0x7fe9f0069570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.319+0000 7fea03e00640 1 -- 172.21.15.175:0/1174782844 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9fc144d60 con 0x7fea0c0d3430 2024-04-25T09:04:18.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.323+0000 7fea0be00640 1 --2- 172.21.15.175:0/1174782844 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe9f00670b0 0x7fe9f0069570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.323+0000 7fea0be00640 1 --2- 172.21.15.175:0/1174782844 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe9f00670b0 0x7fe9f0069570 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fea04011360 tx=0x7fea0400d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.327+0000 7fea03e00640 1 -- 172.21.15.175:0/1174782844 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe9fc0187d0 con 0x7fea0c0d3430 2024-04-25T09:04:18.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.343+0000 7f418be00640 1 Processor -- start 2024-04-25T09:04:18.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.343+0000 7f418be00640 1 -- start start 2024-04-25T09:04:18.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f0c6f200640 1 Processor -- start 2024-04-25T09:04:18.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f418be00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4184034850 0x7f4184034c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f418be00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4184007f20 con 0x7f41840df930 2024-04-25T09:04:18.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f418be00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41840081c0 con 0x7f41840529b0 2024-04-25T09:04:18.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f418be00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418403a250 con 0x7f4184034850 2024-04-25T09:04:18.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f0c6f200640 1 -- start start 2024-04-25T09:04:18.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f0c6f200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0c600501b0 0x7f0c60006540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f0c6f200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0c60033d00 0x7f0c60006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f0c6f200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c60054120 con 0x7f0c600df2b0 2024-04-25T09:04:18.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f0c6f200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c600df690 con 0x7f0c60033d00 2024-04-25T09:04:18.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f0c6f200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c60054400 con 0x7f0c600501b0 2024-04-25T09:04:18.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f418a000640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f41840529b0 0x7f4184055d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:46598/0 (socket says 172.21.15.175:46598) 2024-04-25T09:04:18.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f418a000640 1 -- 172.21.15.175:0/2065294220 learned_addr learned my addr 172.21.15.175:0/2065294220 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:18.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f0c67e00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f0c600df2b0 0x7f0c6004faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:46610/0 (socket says 172.21.15.175:46610) 2024-04-25T09:04:18.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f0c67e00640 1 -- 172.21.15.175:0/2649600171 learned_addr learned my addr 172.21.15.175:0/2649600171 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:18.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f0c67400640 1 --2- 172.21.15.175:0/2649600171 >> v2:172.21.15.177:3300/0 conn(0x7f0c600501b0 0x7f0c60006540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f4189600640 1 -- 172.21.15.175:0/2065294220 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574244560 0 0) 0x7f41840081c0 con 0x7f41840529b0 2024-04-25T09:04:18.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f4189600640 1 -- 172.21.15.175:0/2065294220 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4170003530 con 0x7f41840529b0 2024-04-25T09:04:18.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f0c66a00640 1 -- 172.21.15.175:0/2649600171 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89721217 0 0) 0x7f0c60054120 con 0x7f0c600df2b0 2024-04-25T09:04:18.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f0c66a00640 1 -- 172.21.15.175:0/2649600171 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c50003530 con 0x7f0c600df2b0 2024-04-25T09:04:18.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c66a00640 1 -- 172.21.15.175:0/2649600171 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1533466987 0 0) 0x7f0c50003530 con 0x7f0c600df2b0 2024-04-25T09:04:18.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f4189600640 1 -- 172.21.15.175:0/2065294220 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3119789594 0 0) 0x7f4170003530 con 0x7f41840529b0 2024-04-25T09:04:18.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f4189600640 1 -- 172.21.15.175:0/2065294220 >> v2:172.21.15.175:3300/0 conn(0x7f4184034850 msgr2=0x7f4184034c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f4189600640 1 --2- 172.21.15.175:0/2065294220 >> v2:172.21.15.175:3300/0 conn(0x7f4184034850 0x7f4184034c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f4189600640 1 -- 172.21.15.175:0/2065294220 >> v1:172.21.15.175:6789/0 conn(0x7f41840df930 legacy=0x7f418403aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f4189600640 1 -- 172.21.15.175:0/2065294220 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418403a530 con 0x7f41840529b0 2024-04-25T09:04:18.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.347+0000 7f4189600640 1 -- 172.21.15.175:0/2065294220 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f418c04f780 con 0x7f41840529b0 2024-04-25T09:04:18.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f4189600640 1 -- 172.21.15.175:0/2065294220 >> v1:172.21.15.177:6789/0 conn(0x7f41840529b0 legacy=0x7f4184055d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f4189600640 1 --2- 172.21.15.175:0/2065294220 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41700039c0 0x7f4170003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f4189600640 1 --2- 172.21.15.175:0/2065294220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4170004810 0x7f4170004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f4189600640 1 --2- 172.21.15.175:0/2065294220 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4170005220 0x7f417000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f4189600640 1 -- 172.21.15.175:0/2065294220 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418403a250 con 0x7f4170004810 2024-04-25T09:04:18.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f4189600640 1 -- 172.21.15.175:0/2065294220 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417000c180 con 0x7f41700039c0 2024-04-25T09:04:18.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f4189600640 1 -- 172.21.15.175:0/2065294220 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417000c380 con 0x7f4170005220 2024-04-25T09:04:18.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f418b400640 1 --2- 172.21.15.175:0/2065294220 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4170005220 0x7f417000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c66a00640 1 -- 172.21.15.175:0/2649600171 >> v2:172.21.15.177:3300/0 conn(0x7f0c600501b0 msgr2=0x7f0c60006540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c66a00640 1 --2- 172.21.15.175:0/2649600171 >> v2:172.21.15.177:3300/0 conn(0x7f0c600501b0 0x7f0c60006540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c66a00640 1 -- 172.21.15.175:0/2649600171 >> v2:172.21.15.175:3300/0 conn(0x7f0c60033d00 msgr2=0x7f0c60006a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f418aa00640 1 --2- 172.21.15.175:0/2065294220 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41700039c0 0x7f4170003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f418a000640 1 --2- 172.21.15.175:0/2065294220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4170004810 0x7f4170004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c66a00640 1 --2- 172.21.15.175:0/2649600171 >> v2:172.21.15.175:3300/0 conn(0x7f0c60033d00 0x7f0c60006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c66a00640 1 -- 172.21.15.175:0/2649600171 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c600546e0 con 0x7f0c600df2b0 2024-04-25T09:04:18.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c66a00640 1 -- 172.21.15.175:0/2649600171 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f0c54000ee0 con 0x7f0c600df2b0 2024-04-25T09:04:18.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c66a00640 1 -- 172.21.15.175:0/2649600171 >> v1:172.21.15.177:6789/0 conn(0x7f0c600df2b0 legacy=0x7f0c6004faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c66a00640 1 --2- 172.21.15.175:0/2649600171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c500039c0 0x7f0c50003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c66a00640 1 --2- 172.21.15.175:0/2649600171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c50004810 0x7f0c50004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c66a00640 1 --2- 172.21.15.175:0/2649600171 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c50005420 0x7f0c5000ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c66a00640 1 -- 172.21.15.175:0/2649600171 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600df690 con 0x7f0c500039c0 2024-04-25T09:04:18.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c66a00640 1 -- 172.21.15.175:0/2649600171 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c60054400 con 0x7f0c50004810 2024-04-25T09:04:18.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c66a00640 1 -- 172.21.15.175:0/2649600171 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5000c3b0 con 0x7f0c50005420 2024-04-25T09:04:18.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f418a000640 1 -- 172.21.15.175:0/2065294220 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4170005220 msgr2=0x7f417000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f418a000640 1 --2- 172.21.15.175:0/2065294220 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4170005220 0x7f417000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f418a000640 1 -- 172.21.15.175:0/2065294220 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41700039c0 msgr2=0x7f4170003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f418a000640 1 --2- 172.21.15.175:0/2065294220 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41700039c0 0x7f4170003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f418a000640 1 -- 172.21.15.175:0/2065294220 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418403a530 con 0x7f4170004810 2024-04-25T09:04:18.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f418aa00640 1 --2- 172.21.15.175:0/2065294220 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41700039c0 0x7f4170003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:18.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f418b400640 1 -- 172.21.15.175:0/2065294220 reap_dead start 2024-04-25T09:04:18.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c67400640 1 --2- 172.21.15.175:0/2649600171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c50004810 0x7f0c50004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c6d200640 1 --2- 172.21.15.175:0/2649600171 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c50005420 0x7f0c5000ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c67400640 1 -- 172.21.15.175:0/2649600171 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c50005420 msgr2=0x7f0c5000ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c67400640 1 --2- 172.21.15.175:0/2649600171 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c50005420 0x7f0c5000ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c67400640 1 -- 172.21.15.175:0/2649600171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c500039c0 msgr2=0x7f0c50003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c67400640 1 --2- 172.21.15.175:0/2649600171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c500039c0 0x7f0c50003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.351+0000 7f0c67400640 1 -- 172.21.15.175:0/2649600171 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c600546e0 con 0x7f0c50004810 2024-04-25T09:04:18.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.355+0000 7f0c6d200640 1 -- 172.21.15.175:0/2649600171 reap_dead start 2024-04-25T09:04:18.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.355+0000 7f418a000640 1 --2- 172.21.15.175:0/2065294220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4170004810 0x7f4170004c90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f418c062830 tx=0x7f418c097c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6950955eadf7384 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f4189600640 1 -- 172.21.15.175:0/2065294220 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c067cb0 con 0x7f4170004810 2024-04-25T09:04:18.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f0c67400640 1 --2- 172.21.15.175:0/2649600171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c50004810 0x7f0c50004c90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0c68050870 tx=0x7f0c68098ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=114420c25a755316 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f0c66a00640 1 -- 172.21.15.175:0/2649600171 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6812e070 con 0x7f0c50004810 2024-04-25T09:04:18.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f0c66a00640 1 -- 172.21.15.175:0/2649600171 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c68121930 con 0x7f0c50004810 2024-04-25T09:04:18.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f0c6f200640 1 -- 172.21.15.175:0/2649600171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c50004810 msgr2=0x7f0c50004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f0c6f200640 1 --2- 172.21.15.175:0/2649600171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c50004810 0x7f0c50004c90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0c68050870 tx=0x7f0c68098ab0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f4189600640 1 -- 172.21.15.175:0/2065294220 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c124070 con 0x7f4170004810 2024-04-25T09:04:18.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f4189600640 1 -- 172.21.15.175:0/2065294220 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c120b10 con 0x7f4170004810 2024-04-25T09:04:18.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f418be00640 1 -- 172.21.15.175:0/2065294220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4170004810 msgr2=0x7f4170004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f418be00640 1 --2- 172.21.15.175:0/2065294220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4170004810 0x7f4170004c90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f418c062830 tx=0x7f418c097c10 comp rx=0 tx=0).stop 2024-04-25T09:04:18.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f418be00640 1 -- 172.21.15.175:0/2065294220 shutdown_connections 2024-04-25T09:04:18.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f418be00640 1 --2- 172.21.15.175:0/2065294220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4170004810 0x7f4170004c90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f418be00640 1 -- 172.21.15.175:0/2065294220 >> 172.21.15.175:0/2065294220 conn(0x7f418401e6d0 msgr2=0x7f4184055400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f418be00640 1 -- 172.21.15.175:0/2065294220 shutdown_connections 2024-04-25T09:04:18.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f0c6f200640 1 -- 172.21.15.175:0/2649600171 shutdown_connections 2024-04-25T09:04:18.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f0c6f200640 1 --2- 172.21.15.175:0/2649600171 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c50004810 0x7f0c50004c90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f0c6f200640 1 -- 172.21.15.175:0/2649600171 >> 172.21.15.175:0/2649600171 conn(0x7f0c60009fc0 msgr2=0x7f0c6000a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f418be00640 1 -- 172.21.15.175:0/2065294220 wait complete. 2024-04-25T09:04:18.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.363+0000 7f418be00640 1 Processor -- start 2024-04-25T09:04:18.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.363+0000 7f418be00640 1 -- start start 2024-04-25T09:04:18.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f0c6f200640 1 -- 172.21.15.175:0/2649600171 shutdown_connections 2024-04-25T09:04:18.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.359+0000 7f0c6f200640 1 -- 172.21.15.175:0/2649600171 wait complete. 2024-04-25T09:04:18.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.363+0000 7f0c6f200640 1 Processor -- start 2024-04-25T09:04:18.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.363+0000 7f0c6f200640 1 -- start start 2024-04-25T09:04:18.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.363+0000 7f418be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4170004810 0x7f418417f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.363+0000 7f418be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f418404a3e0 0x7f418404a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.363+0000 7f0c6f200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c50004810 0x7f0c6018d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.363+0000 7f0c6f200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c600df810 0x7f0c600065f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.363+0000 7f0c6f200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c600e1450 0x7f0c60038810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f418be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41840dc970 0x7f41840dce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f418be00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418403ade0 con 0x7f4170004810 2024-04-25T09:04:18.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c67e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c50004810 0x7f0c6018d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c67e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c50004810 0x7f0c6018d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44498/0 (socket says 172.21.15.175:44498) 2024-04-25T09:04:18.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c67400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c600df810 0x7f0c600065f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f418b400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41840dc970 0x7f41840dce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f418b400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41840dc970 0x7f41840dce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44504/0 (socket says 172.21.15.175:44504) 2024-04-25T09:04:18.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f418b400640 1 -- 172.21.15.175:0/4192243129 learned_addr learned my addr 172.21.15.175:0/4192243129 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:18.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f418be00640 1 -- 172.21.15.175:0/4192243129 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418403ac60 con 0x7f418404a3e0 2024-04-25T09:04:18.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f418be00640 1 -- 172.21.15.175:0/4192243129 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418403af60 con 0x7f41840dc970 2024-04-25T09:04:18.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c67400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c600df810 0x7f0c600065f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:48576/0 (socket says 172.21.15.175:48576) 2024-04-25T09:04:18.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c6f200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c60050030 con 0x7f0c600e1450 2024-04-25T09:04:18.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c6f200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6004feb0 con 0x7f0c600df810 2024-04-25T09:04:18.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c6f200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6004f660 con 0x7f0c50004810 2024-04-25T09:04:18.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c67e00640 1 -- 172.21.15.175:0/2974822112 learned_addr learned my addr 172.21.15.175:0/2974822112 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:18.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c67400640 1 -- 172.21.15.175:0/2974822112 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c50004810 msgr2=0x7f0c6018d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f418b400640 1 -- 172.21.15.175:0/4192243129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f418404a3e0 msgr2=0x7f418404a860 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T09:04:18.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f418b400640 1 --2- 172.21.15.175:0/4192243129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f418404a3e0 0x7f418404a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f418b400640 1 -- 172.21.15.175:0/4192243129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4170004810 msgr2=0x7f418417f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f418b400640 1 --2- 172.21.15.175:0/4192243129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4170004810 0x7f418417f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f418b400640 1 -- 172.21.15.175:0/4192243129 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4184049a80 con 0x7f41840dc970 2024-04-25T09:04:18.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c67400640 1 --2- 172.21.15.175:0/2974822112 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c50004810 0x7f0c6018d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c67400640 1 -- 172.21.15.175:0/2974822112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c600e1450 msgr2=0x7f0c60038810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c67400640 1 --2- 172.21.15.175:0/2974822112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c600e1450 0x7f0c60038810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c67400640 1 -- 172.21.15.175:0/2974822112 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c60048310 con 0x7f0c600df810 2024-04-25T09:04:18.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f418b400640 1 --2- 172.21.15.175:0/4192243129 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41840dc970 0x7f41840dce20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f418400f510 tx=0x7f417c00e9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c67400640 1 --2- 172.21.15.175:0/2974822112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c600df810 0x7f0c600065f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0c68064760 tx=0x7f0c68095950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f4182a00640 1 -- 172.21.15.175:0/4192243129 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4178001250 con 0x7f41840dc970 2024-04-25T09:04:18.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f4182a00640 1 -- 172.21.15.175:0/4192243129 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417c01a070 con 0x7f41840dc970 2024-04-25T09:04:18.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f4182a00640 1 -- 172.21.15.175:0/4192243129 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c0138a0 con 0x7f41840dc970 2024-04-25T09:04:18.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c5be00640 1 -- 172.21.15.175:0/2974822112 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6812e070 con 0x7f0c600df810 2024-04-25T09:04:18.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c6f200640 1 -- 172.21.15.175:0/2974822112 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6003a100 con 0x7f0c600df810 2024-04-25T09:04:18.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c6f200640 1 -- 172.21.15.175:0/2974822112 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c60039b40 con 0x7f0c600df810 2024-04-25T09:04:18.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c5be00640 1 -- 172.21.15.175:0/2974822112 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6812f040 con 0x7f0c600df810 2024-04-25T09:04:18.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.367+0000 7f0c5be00640 1 -- 172.21.15.175:0/2974822112 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68067440 con 0x7f0c600df810 2024-04-25T09:04:18.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.371+0000 7f418be00640 1 -- 172.21.15.175:0/4192243129 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41840d8970 con 0x7f41840dc970 2024-04-25T09:04:18.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.371+0000 7f418be00640 1 -- 172.21.15.175:0/4192243129 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418417fcc0 con 0x7f41840dc970 2024-04-25T09:04:18.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.371+0000 7f0c5be00640 1 -- 172.21.15.175:0/2974822112 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0c681217f0 con 0x7f0c600df810 2024-04-25T09:04:18.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.375+0000 7f0c5be00640 1 --2- 172.21.15.175:0/2974822112 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0c48066fb0 0x7f0c48069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.375+0000 7f4182a00640 1 -- 172.21.15.175:0/4192243129 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f417c013a40 con 0x7f41840dc970 2024-04-25T09:04:18.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.375+0000 7f0c59600640 1 -- 172.21.15.175:0/2974822112 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c600053a0 con 0x7f0c600df810 2024-04-25T09:04:18.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.375+0000 7f0c5be00640 1 -- 172.21.15.175:0/2974822112 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c68121ba0 con 0x7f0c600df810 2024-04-25T09:04:18.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.375+0000 7f0c67e00640 1 --2- 172.21.15.175:0/2974822112 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0c48066fb0 0x7f0c48069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.375+0000 7f4182a00640 1 --2- 172.21.15.175:0/4192243129 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f416c067060 0x7f416c069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.375+0000 7f4182a00640 1 -- 172.21.15.175:0/4192243129 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f417c0844c0 con 0x7f41840dc970 2024-04-25T09:04:18.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.379+0000 7f418aa00640 1 --2- 172.21.15.175:0/4192243129 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f416c067060 0x7f416c069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.379+0000 7f418be00640 1 -- 172.21.15.175:0/4192243129 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41840057f0 con 0x7f41840dc970 2024-04-25T09:04:18.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.379+0000 7f0c67e00640 1 --2- 172.21.15.175:0/2974822112 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0c48066fb0 0x7f0c48069470 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0c600dd970 tx=0x7f0c54001260 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.379+0000 7f418aa00640 1 --2- 172.21.15.175:0/4192243129 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f416c067060 0x7f416c069520 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4184033790 tx=0x7f4178009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.379+0000 7f0c5be00640 1 -- 172.21.15.175:0/2974822112 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0c68137020 con 0x7f0c600df810 2024-04-25T09:04:18.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.383+0000 7f4182a00640 1 -- 172.21.15.175:0/4192243129 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f417c023020 con 0x7f41840dc970 2024-04-25T09:04:18.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.563+0000 7f369b200640 1 -- 172.21.15.175:0/1166988722 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f36940b69f0 con 0x7f36940d0840 2024-04-25T09:04:18.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.563+0000 7f368be00640 1 -- 172.21.15.175:0/1166988722 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f368c0599d0 con 0x7f36940d0840 2024-04-25T09:04:18.556 INFO:teuthology.orchestra.run.smithi175.stdout:55834574855 2024-04-25T09:04:18.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.567+0000 7f369b200640 1 -- 172.21.15.175:0/1166988722 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3674066f60 msgr2=0x7f3674069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.567+0000 7f369b200640 1 --2- 172.21.15.175:0/1166988722 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3674066f60 0x7f3674069420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f368002dd80 tx=0x7f36800b8070 comp rx=0 tx=0).stop 2024-04-25T09:04:18.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.567+0000 7f369b200640 1 -- 172.21.15.175:0/1166988722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36940d0840 msgr2=0x7f36941577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.567+0000 7f369b200640 1 --2- 172.21.15.175:0/1166988722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36940d0840 0x7f36941577f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f368c00bd50 tx=0x7f368c00be40 comp rx=0 tx=0).stop 2024-04-25T09:04:18.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.567+0000 7f369b200640 1 -- 172.21.15.175:0/1166988722 shutdown_connections 2024-04-25T09:04:18.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.567+0000 7f369b200640 1 --2- 172.21.15.175:0/1166988722 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3674066f60 0x7f3674069420 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.567+0000 7f369b200640 1 --2- 172.21.15.175:0/1166988722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f369415df10 0x7f36940c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.567+0000 7f369b200640 1 --2- 172.21.15.175:0/1166988722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36940d0840 0x7f36941577f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.567+0000 7f369b200640 1 --2- 172.21.15.175:0/1166988722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36940ce030 0x7f36940cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.567+0000 7f369b200640 1 -- 172.21.15.175:0/1166988722 >> 172.21.15.175:0/1166988722 conn(0x7f369406c870 msgr2=0x7f369415c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.571+0000 7f369b200640 1 -- 172.21.15.175:0/1166988722 shutdown_connections 2024-04-25T09:04:18.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.571+0000 7f369b200640 1 -- 172.21.15.175:0/1166988722 wait complete. 2024-04-25T09:04:18.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.575+0000 7f5138c00640 1 -- 172.21.15.175:0/624819748 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f51440b0d50 con 0x7f51441f7d30 2024-04-25T09:04:18.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.575+0000 7f513b400640 1 -- 172.21.15.175:0/624819748 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f51340f1030 con 0x7f51441f7d30 2024-04-25T09:04:18.570 INFO:teuthology.orchestra.run.smithi175.stdout:55834574855 2024-04-25T09:04:18.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.579+0000 7f514a200640 1 -- 172.21.15.175:0/624819748 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5124066fb0 msgr2=0x7f5124069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.579+0000 7f514a200640 1 --2- 172.21.15.175:0/624819748 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5124066fb0 0x7f5124069470 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5130004660 tx=0x7f5130008040 comp rx=0 tx=0).stop 2024-04-25T09:04:18.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.579+0000 7f514a200640 1 -- 172.21.15.175:0/624819748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51441f7d30 msgr2=0x7f51441f81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.579+0000 7f514a200640 1 --2- 172.21.15.175:0/624819748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51441f7d30 0x7f51441f81a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51440d07d0 tx=0x7f5128003740 comp rx=0 tx=0).stop 2024-04-25T09:04:18.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.579+0000 7f514a200640 1 -- 172.21.15.175:0/624819748 shutdown_connections 2024-04-25T09:04:18.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.579+0000 7f514a200640 1 --2- 172.21.15.175:0/624819748 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5124066fb0 0x7f5124069470 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.579+0000 7f514a200640 1 --2- 172.21.15.175:0/624819748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51441f7d30 0x7f51441f81a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.579+0000 7f514a200640 1 --2- 172.21.15.175:0/624819748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51441567c0 0x7f5144156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.579+0000 7f514a200640 1 --2- 172.21.15.175:0/624819748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f512800b6b0 0x7f5144158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.579+0000 7f514a200640 1 -- 172.21.15.175:0/624819748 >> 172.21.15.175:0/624819748 conn(0x7f5144067010 msgr2=0x7f51440cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.579+0000 7f514a200640 1 -- 172.21.15.175:0/624819748 shutdown_connections 2024-04-25T09:04:18.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.579+0000 7f514a200640 1 -- 172.21.15.175:0/624819748 wait complete. 2024-04-25T09:04:18.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-04-25T09:04:18.600 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:18.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-04-25T09:04:18.605 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:18.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.631+0000 7fc7ac400640 1 -- 172.21.15.175:0/4079051177 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc780005590 con 0x7fc7a40b6dc0 2024-04-25T09:04:18.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.631+0000 7fc7a1600640 1 -- 172.21.15.175:0/4079051177 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc7900f0040 con 0x7fc7a40b6dc0 2024-04-25T09:04:18.623 INFO:teuthology.orchestra.run.smithi175.stdout:55834574857 2024-04-25T09:04:18.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.635+0000 7fc7ac400640 1 -- 172.21.15.175:0/4079051177 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc784066f60 msgr2=0x7fc784069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.635+0000 7fc7ac400640 1 --2- 172.21.15.175:0/4079051177 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc784066f60 0x7fc784069420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40ca5b0 tx=0x7fc7980094f0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.635+0000 7fc7ac400640 1 -- 172.21.15.175:0/4079051177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7a40b6dc0 msgr2=0x7fc7a40ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.635+0000 7fc7ac400640 1 --2- 172.21.15.175:0/4079051177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7a40b6dc0 0x7fc7a40ccfe0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc79001abc0 tx=0x7fc79001ad50 comp rx=0 tx=0).stop 2024-04-25T09:04:18.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.635+0000 7fc7ac400640 1 -- 172.21.15.175:0/4079051177 shutdown_connections 2024-04-25T09:04:18.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.635+0000 7fc7ac400640 1 --2- 172.21.15.175:0/4079051177 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc784066f60 0x7fc784069420 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.635+0000 7fc7ac400640 1 --2- 172.21.15.175:0/4079051177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7a415dd50 0x7fc7a4207540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.635+0000 7fc7ac400640 1 --2- 172.21.15.175:0/4079051177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7a40ce880 0x7fc7a4207000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.635+0000 7fc7ac400640 1 --2- 172.21.15.175:0/4079051177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7a40b6dc0 0x7fc7a40ccfe0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.635+0000 7fc7ac400640 1 -- 172.21.15.175:0/4079051177 >> 172.21.15.175:0/4079051177 conn(0x7fc7a40d0560 msgr2=0x7fc7a40d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.635+0000 7fc7ac400640 1 -- 172.21.15.175:0/4079051177 shutdown_connections 2024-04-25T09:04:18.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.635+0000 7fc7ac400640 1 -- 172.21.15.175:0/4079051177 wait complete. 2024-04-25T09:04:18.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.639+0000 7fea12e00640 1 -- 172.21.15.175:0/1174782844 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe9e4005860 con 0x7fea0c0d3430 2024-04-25T09:04:18.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.639+0000 7fea03e00640 1 -- 172.21.15.175:0/1174782844 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9fc115830 con 0x7fea0c0d3430 2024-04-25T09:04:18.632 INFO:teuthology.orchestra.run.smithi175.stdout:55834574854 2024-04-25T09:04:18.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.643+0000 7fea12e00640 1 -- 172.21.15.175:0/1174782844 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe9f00670b0 msgr2=0x7fe9f0069570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.643+0000 7fea12e00640 1 --2- 172.21.15.175:0/1174782844 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe9f00670b0 0x7fe9f0069570 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fea04011360 tx=0x7fea0400d040 comp rx=0 tx=0).stop 2024-04-25T09:04:18.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.643+0000 7fea12e00640 1 -- 172.21.15.175:0/1174782844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea0c0d3430 msgr2=0x7fea0c1526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.643+0000 7fea12e00640 1 --2- 172.21.15.175:0/1174782844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea0c0d3430 0x7fea0c1526f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0af000 tx=0x7fe9fc01ba10 comp rx=0 tx=0).stop 2024-04-25T09:04:18.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.643+0000 7fea12e00640 1 -- 172.21.15.175:0/1174782844 shutdown_connections 2024-04-25T09:04:18.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.643+0000 7fea12e00640 1 --2- 172.21.15.175:0/1174782844 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe9f00670b0 0x7fe9f0069570 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.643+0000 7fea12e00640 1 --2- 172.21.15.175:0/1174782844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea0c0d3430 0x7fea0c1526f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.643+0000 7fea12e00640 1 --2- 172.21.15.175:0/1174782844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea0c0b6960 0x7fea0c0cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.643+0000 7fea12e00640 1 --2- 172.21.15.175:0/1174782844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea0c0b2bc0 0x7fea0c0c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.643+0000 7fea12e00640 1 -- 172.21.15.175:0/1174782844 >> 172.21.15.175:0/1174782844 conn(0x7fea0c0b5600 msgr2=0x7fea0c0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.643+0000 7fea12e00640 1 -- 172.21.15.175:0/1174782844 shutdown_connections 2024-04-25T09:04:18.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.643+0000 7fea12e00640 1 -- 172.21.15.175:0/1174782844 wait complete. 2024-04-25T09:04:18.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.643+0000 7fdf70e00640 1 -- 172.21.15.175:0/1421186743 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdf6c06d5f0 con 0x7fdf6c159a10 2024-04-25T09:04:18.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.643+0000 7fdf63400640 1 -- 172.21.15.175:0/1421186743 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdf640efad0 con 0x7fdf6c159a10 2024-04-25T09:04:18.636 INFO:teuthology.orchestra.run.smithi175.stdout:55834574853 2024-04-25T09:04:18.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.647+0000 7fdf70e00640 1 -- 172.21.15.175:0/1421186743 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdf4c066f60 msgr2=0x7fdf4c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.647+0000 7fdf70e00640 1 --2- 172.21.15.175:0/1421186743 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdf4c066f60 0x7fdf4c069420 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c00f2a0 tx=0x7fdf5c00a2e0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.647+0000 7fdf70e00640 1 -- 172.21.15.175:0/1421186743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf6c159a10 msgr2=0x7fdf6c14d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.647+0000 7fdf70e00640 1 --2- 172.21.15.175:0/1421186743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf6c159a10 0x7fdf6c14d570 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf640ac000 tx=0x7fdf64019510 comp rx=0 tx=0).stop 2024-04-25T09:04:18.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.647+0000 7fdf70e00640 1 -- 172.21.15.175:0/1421186743 shutdown_connections 2024-04-25T09:04:18.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.647+0000 7fdf70e00640 1 --2- 172.21.15.175:0/1421186743 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdf4c066f60 0x7fdf4c069420 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.647+0000 7fdf70e00640 1 --2- 172.21.15.175:0/1421186743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdf6c159a10 0x7fdf6c14d570 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.647+0000 7fdf70e00640 1 --2- 172.21.15.175:0/1421186743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf6c0b2480 0x7fdf6c14acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.647+0000 7fdf70e00640 1 --2- 172.21.15.175:0/1421186743 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf6c06b360 0x7fdf6c157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.647+0000 7fdf70e00640 1 -- 172.21.15.175:0/1421186743 >> 172.21.15.175:0/1421186743 conn(0x7fdf6c067070 msgr2=0x7fdf6c0afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.647+0000 7fdf70e00640 1 -- 172.21.15.175:0/1421186743 shutdown_connections 2024-04-25T09:04:18.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.647+0000 7fdf70e00640 1 -- 172.21.15.175:0/1421186743 wait complete. 2024-04-25T09:04:18.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.651+0000 7f7a10c00640 1 -- 172.21.15.175:0/533451535 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7a0c074a60 con 0x7f7a0c15a770 2024-04-25T09:04:18.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.651+0000 7f7a03400640 1 -- 172.21.15.175:0/533451535 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f79f8059890 con 0x7f7a0c15a770 2024-04-25T09:04:18.643 INFO:teuthology.orchestra.run.smithi175.stdout:55834574856 2024-04-25T09:04:18.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.655+0000 7f7a10c00640 1 -- 172.21.15.175:0/533451535 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f79ec067030 msgr2=0x7f79ec0694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.655+0000 7f7a10c00640 1 --2- 172.21.15.175:0/533451535 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f79ec067030 0x7f79ec0694f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7a04030590 tx=0x7f7a04007040 comp rx=0 tx=0).stop 2024-04-25T09:04:18.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.655+0000 7f7a10c00640 1 -- 172.21.15.175:0/533451535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a0c15a770 msgr2=0x7f7a0c1ef0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.655+0000 7f7a10c00640 1 --2- 172.21.15.175:0/533451535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a0c15a770 0x7f7a0c1ef0e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f79f800d530 tx=0x7f79f800d9f0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.659+0000 7f7a10c00640 1 -- 172.21.15.175:0/533451535 shutdown_connections 2024-04-25T09:04:18.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.659+0000 7f7a10c00640 1 --2- 172.21.15.175:0/533451535 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f79ec067030 0x7f79ec0694f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.659+0000 7f7a10c00640 1 --2- 172.21.15.175:0/533451535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a0c1ef620 0x7f7a0c15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.659+0000 7f7a10c00640 1 --2- 172.21.15.175:0/533451535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a0c15a770 0x7f7a0c1ef0e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.659+0000 7f7a10c00640 1 --2- 172.21.15.175:0/533451535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79f0004ba0 0x7f7a0c0add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.659+0000 7f7a10c00640 1 -- 172.21.15.175:0/533451535 >> 172.21.15.175:0/533451535 conn(0x7f7a0c067070 msgr2=0x7f7a0c0af1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.659+0000 7f7a10c00640 1 -- 172.21.15.175:0/533451535 shutdown_connections 2024-04-25T09:04:18.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.659+0000 7f7a10c00640 1 -- 172.21.15.175:0/533451535 wait complete. 2024-04-25T09:04:18.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-04-25T09:04:18.664 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:18.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-04-25T09:04:18.668 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:18.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2024-04-25T09:04:18.673 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:18.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-04-25T09:04:18.674 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:18.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.683+0000 7f0c59600640 1 -- 172.21.15.175:0/2974822112 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0c600e9920 con 0x7f0c600df810 2024-04-25T09:04:18.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.683+0000 7f0c5be00640 1 -- 172.21.15.175:0/2974822112 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0c68121e20 con 0x7f0c600df810 2024-04-25T09:04:18.676 INFO:teuthology.orchestra.run.smithi175.stdout:55834574854 2024-04-25T09:04:18.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.687+0000 7f0c59600640 1 -- 172.21.15.175:0/2974822112 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0c48066fb0 msgr2=0x7f0c48069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.687+0000 7f0c59600640 1 --2- 172.21.15.175:0/2974822112 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0c48066fb0 0x7f0c48069470 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0c600dd970 tx=0x7f0c54001260 comp rx=0 tx=0).stop 2024-04-25T09:04:18.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.687+0000 7f0c59600640 1 -- 172.21.15.175:0/2974822112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c600df810 msgr2=0x7f0c600065f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.687+0000 7f0c59600640 1 --2- 172.21.15.175:0/2974822112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c600df810 0x7f0c600065f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0c68064760 tx=0x7f0c68095950 comp rx=0 tx=0).stop 2024-04-25T09:04:18.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.687+0000 7f0c59600640 1 -- 172.21.15.175:0/2974822112 shutdown_connections 2024-04-25T09:04:18.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.687+0000 7f0c59600640 1 --2- 172.21.15.175:0/2974822112 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0c48066fb0 0x7f0c48069470 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.687+0000 7f0c59600640 1 --2- 172.21.15.175:0/2974822112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c600e1450 0x7f0c60038810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.687+0000 7f0c59600640 1 --2- 172.21.15.175:0/2974822112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c600df810 0x7f0c600065f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.687+0000 7f0c59600640 1 --2- 172.21.15.175:0/2974822112 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c50004810 0x7f0c6018d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.687+0000 7f0c59600640 1 -- 172.21.15.175:0/2974822112 >> 172.21.15.175:0/2974822112 conn(0x7f0c60009fc0 msgr2=0x7f0c600e9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.687+0000 7f0c59600640 1 -- 172.21.15.175:0/2974822112 shutdown_connections 2024-04-25T09:04:18.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.687+0000 7f0c59600640 1 -- 172.21.15.175:0/2974822112 wait complete. 2024-04-25T09:04:18.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.691+0000 7f418be00640 1 -- 172.21.15.175:0/4192243129 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4184036a60 con 0x7f41840dc970 2024-04-25T09:04:18.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.691+0000 7f4182a00640 1 -- 172.21.15.175:0/4192243129 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f417c055540 con 0x7f41840dc970 2024-04-25T09:04:18.683 INFO:teuthology.orchestra.run.smithi175.stdout:55834574853 2024-04-25T09:04:18.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.695+0000 7f418be00640 1 -- 172.21.15.175:0/4192243129 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f416c067060 msgr2=0x7f416c069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.695+0000 7f418be00640 1 --2- 172.21.15.175:0/4192243129 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f416c067060 0x7f416c069520 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4184033790 tx=0x7f4178009040 comp rx=0 tx=0).stop 2024-04-25T09:04:18.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.695+0000 7f418be00640 1 -- 172.21.15.175:0/4192243129 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41840dc970 msgr2=0x7f41840dce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.695+0000 7f418be00640 1 --2- 172.21.15.175:0/4192243129 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41840dc970 0x7f41840dce20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f418400f510 tx=0x7f417c00e9b0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.695+0000 7f418be00640 1 -- 172.21.15.175:0/4192243129 shutdown_connections 2024-04-25T09:04:18.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.695+0000 7f418be00640 1 --2- 172.21.15.175:0/4192243129 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f416c067060 0x7f416c069520 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.695+0000 7f418be00640 1 --2- 172.21.15.175:0/4192243129 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41840dc970 0x7f41840dce20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.695+0000 7f418be00640 1 --2- 172.21.15.175:0/4192243129 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f418404a3e0 0x7f418404a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.695+0000 7f418be00640 1 --2- 172.21.15.175:0/4192243129 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4170004810 0x7f418417f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.695+0000 7f418be00640 1 -- 172.21.15.175:0/4192243129 >> 172.21.15.175:0/4192243129 conn(0x7f418401e6d0 msgr2=0x7f41840de770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.695+0000 7f418be00640 1 -- 172.21.15.175:0/4192243129 shutdown_connections 2024-04-25T09:04:18.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.695+0000 7f418be00640 1 -- 172.21.15.175:0/4192243129 wait complete. 2024-04-25T09:04:18.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-04-25T09:04:18.701 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:18.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-04-25T09:04:18.705 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:18.705 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T09:04:18.705 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:04:18.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.895+0000 7fae1d800640 1 Processor -- start 2024-04-25T09:04:18.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.895+0000 7fae1d800640 1 -- start start 2024-04-25T09:04:18.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.895+0000 7fae1d800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fae1815dab0 0x7fae18161490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.895+0000 7fae1d800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae180b2330 0x7fae180d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.895+0000 7fae1d800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae18161e30 con 0x7fae180b1ea0 2024-04-25T09:04:18.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.895+0000 7fae1d800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae180b1a10 con 0x7fae1815dab0 2024-04-25T09:04:18.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.895+0000 7fae1d800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae18162110 con 0x7fae180b2330 2024-04-25T09:04:18.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.895+0000 7fae17e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fae1815dab0 0x7fae18161490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.895+0000 7fae17e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fae1815dab0 0x7fae18161490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36800/0 (socket says 172.21.15.175:36800) 2024-04-25T09:04:18.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.895+0000 7fae17e00640 1 -- 172.21.15.175:0/2219245251 learned_addr learned my addr 172.21.15.175:0/2219245251 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:18.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.895+0000 7fae1ce00640 1 --2- 172.21.15.175:0/2219245251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae180b2330 0x7fae180d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.895+0000 7fae17e00640 1 -- 172.21.15.175:0/2219245251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae180b2330 msgr2=0x7fae180d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.895+0000 7fae17e00640 1 --2- 172.21.15.175:0/2219245251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae180b2330 0x7fae180d0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.895+0000 7fae17e00640 1 -- 172.21.15.175:0/2219245251 >> v1:172.21.15.177:6789/0 conn(0x7fae180b1ea0 legacy=0x7fae180cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.895+0000 7fae17e00640 1 -- 172.21.15.175:0/2219245251 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae180b16a0 con 0x7fae1815dab0 2024-04-25T09:04:18.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.895+0000 7fae1ce00640 1 --2- 172.21.15.175:0/2219245251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae180b2330 0x7fae180d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:18.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.899+0000 7fae17e00640 1 --2- 172.21.15.175:0/2219245251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae1815dab0 0x7fae18161490 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fae08009870 tx=0x7fae0801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b22c06280a2fcd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.899+0000 7fae16a00640 1 -- 172.21.15.175:0/2219245251 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae080aa660 con 0x7fae1815dab0 2024-04-25T09:04:18.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.899+0000 7fae16a00640 1 -- 172.21.15.175:0/2219245251 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae080af070 con 0x7fae1815dab0 2024-04-25T09:04:18.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.899+0000 7fae16a00640 1 -- 172.21.15.175:0/2219245251 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae080aaa20 con 0x7fae1815dab0 2024-04-25T09:04:18.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.899+0000 7fae1d800640 1 -- 172.21.15.175:0/2219245251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae1815dab0 msgr2=0x7fae18161490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.899+0000 7fae1d800640 1 --2- 172.21.15.175:0/2219245251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae1815dab0 0x7fae18161490 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fae08009870 tx=0x7fae0801c520 comp rx=0 tx=0).stop 2024-04-25T09:04:18.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.899+0000 7fae1d800640 1 -- 172.21.15.175:0/2219245251 shutdown_connections 2024-04-25T09:04:18.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.899+0000 7fae1d800640 1 --2- 172.21.15.175:0/2219245251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae180b2330 0x7fae180d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.899+0000 7fae1d800640 1 --2- 172.21.15.175:0/2219245251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae1815dab0 0x7fae18161490 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.899+0000 7fae1d800640 1 -- 172.21.15.175:0/2219245251 >> 172.21.15.175:0/2219245251 conn(0x7fae1808afe0 msgr2=0x7fae1808b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.899+0000 7fae1d800640 1 -- 172.21.15.175:0/2219245251 shutdown_connections 2024-04-25T09:04:18.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.899+0000 7fae1d800640 1 -- 172.21.15.175:0/2219245251 wait complete. 2024-04-25T09:04:18.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.899+0000 7fae1d800640 1 Processor -- start 2024-04-25T09:04:18.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.899+0000 7fae1d800640 1 -- start start 2024-04-25T09:04:18.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae1d800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae180b1ea0 0x7fae1815ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae1d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae180b2330 0x7fae18152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae1d800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae1815dab0 0x7fae18155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae1d800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1806cec0 con 0x7fae180b2330 2024-04-25T09:04:18.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae1d800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1806cd40 con 0x7fae1815dab0 2024-04-25T09:04:18.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae1d800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1806d040 con 0x7fae180b1ea0 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae17400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae180b2330 0x7fae18152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae17400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae180b2330 0x7fae18152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36802/0 (socket says 172.21.15.175:36802) 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae17400640 1 -- 172.21.15.175:0/1240327621 learned_addr learned my addr 172.21.15.175:0/1240327621 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae17e00640 1 --2- 172.21.15.175:0/1240327621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae180b1ea0 0x7fae1815ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae1ce00640 1 --2- 172.21.15.175:0/1240327621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae1815dab0 0x7fae18155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae17400640 1 -- 172.21.15.175:0/1240327621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae180b1ea0 msgr2=0x7fae1815ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae17400640 1 --2- 172.21.15.175:0/1240327621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae180b1ea0 0x7fae1815ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae17400640 1 -- 172.21.15.175:0/1240327621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae1815dab0 msgr2=0x7fae18155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae17400640 1 --2- 172.21.15.175:0/1240327621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae1815dab0 0x7fae18155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae17400640 1 -- 172.21.15.175:0/1240327621 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae18152eb0 con 0x7fae180b2330 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae17400640 1 --2- 172.21.15.175:0/1240327621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae180b2330 0x7fae18152970 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fae0400b440 tx=0x7fae0400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae0fe00640 1 -- 172.21.15.175:0/1240327621 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04015020 con 0x7fae180b2330 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae0fe00640 1 -- 172.21.15.175:0/1240327621 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae04011890 con 0x7fae180b2330 2024-04-25T09:04:18.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae1d800640 1 -- 172.21.15.175:0/1240327621 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1815b170 con 0x7fae180b2330 2024-04-25T09:04:18.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae0fe00640 1 -- 172.21.15.175:0/1240327621 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04011c80 con 0x7fae180b2330 2024-04-25T09:04:18.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae1d800640 1 -- 172.21.15.175:0/1240327621 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1815b730 con 0x7fae180b2330 2024-04-25T09:04:18.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae1d800640 1 -- 172.21.15.175:0/1240327621 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae18074a60 con 0x7fae180b2330 2024-04-25T09:04:18.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.903+0000 7fae0fe00640 1 -- 172.21.15.175:0/1240327621 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fae04018020 con 0x7fae180b2330 2024-04-25T09:04:18.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.907+0000 7fae0fe00640 1 --2- 172.21.15.175:0/1240327621 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fadf8066f60 0x7fadf8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.907+0000 7fae0fe00640 1 -- 172.21.15.175:0/1240327621 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae04084e80 con 0x7fae180b2330 2024-04-25T09:04:18.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.907+0000 7fae17e00640 1 --2- 172.21.15.175:0/1240327621 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fadf8066f60 0x7fadf8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.907+0000 7fae17e00640 1 --2- 172.21.15.175:0/1240327621 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fadf8066f60 0x7fadf8069420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fae080ae000 tx=0x7fae080a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:18.911+0000 7fae0fe00640 1 -- 172.21.15.175:0/1240327621 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fae0401f030 con 0x7fae180b2330 2024-04-25T09:04:19.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.059+0000 7fae1d800640 1 -- 172.21.15.175:0/1240327621 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae181540c0 con 0x7fadf8066f60 2024-04-25T09:04:19.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.063+0000 7fae0fe00640 1 -- 172.21.15.175:0/1240327621 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251872 (secure 0 0 0) 0x7fae181540c0 con 0x7fadf8066f60 2024-04-25T09:04:19.060 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:19.063 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:04:19.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.067+0000 7fae1d800640 1 -- 172.21.15.175:0/1240327621 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fadf8066f60 msgr2=0x7fadf8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.067+0000 7fae1d800640 1 --2- 172.21.15.175:0/1240327621 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fadf8066f60 0x7fadf8069420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fae080ae000 tx=0x7fae080a7000 comp rx=0 tx=0).stop 2024-04-25T09:04:19.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.067+0000 7fae1d800640 1 -- 172.21.15.175:0/1240327621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae180b2330 msgr2=0x7fae18152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.067+0000 7fae1d800640 1 --2- 172.21.15.175:0/1240327621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae180b2330 0x7fae18152970 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fae0400b440 tx=0x7fae0400b900 comp rx=0 tx=0).stop 2024-04-25T09:04:19.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.067+0000 7fae1d800640 1 -- 172.21.15.175:0/1240327621 shutdown_connections 2024-04-25T09:04:19.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.067+0000 7fae1d800640 1 --2- 172.21.15.175:0/1240327621 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fadf8066f60 0x7fadf8069420 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.067+0000 7fae1d800640 1 --2- 172.21.15.175:0/1240327621 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fae1815dab0 0x7fae18155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.067+0000 7fae1d800640 1 --2- 172.21.15.175:0/1240327621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae180b2330 0x7fae18152970 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.067+0000 7fae1d800640 1 --2- 172.21.15.175:0/1240327621 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fae180b1ea0 0x7fae1815ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.067+0000 7fae1d800640 1 -- 172.21.15.175:0/1240327621 >> 172.21.15.175:0/1240327621 conn(0x7fae1808afe0 msgr2=0x7fae180705e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.067+0000 7fae1d800640 1 -- 172.21.15.175:0/1240327621 shutdown_connections 2024-04-25T09:04:19.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.067+0000 7fae1d800640 1 -- 172.21.15.175:0/1240327621 wait complete. 2024-04-25T09:04:19.079 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-25T09:04:17.791510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219012,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001431"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491395+0000","last_change":"2024-04-25T09:04:10.462062+0000","last_active":"2024-04-25T09:04:12.491395+0000","last_peered":"2024-04-25T09:04:12.491395+0000","last_clean":"2024-04-25T09:04:12.491395+0000","last_became_active":"2024-04-25T09:04:10.461771+0000","last_became_peered":"2024-04-25T09:04:10.461771+0000","last_unstale":"2024-04-25T09:04:12.491395+0000","last_undegraded":"2024-04-25T09:04:12.491395+0000","last_fullsized":"2024-04-25T09:04:12.491395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:38.704801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453592+0000","last_change":"2024-04-25T09:04:10.454772+0000","last_active":"2024-04-25T09:04:11.453592+0000","last_peered":"2024-04-25T09:04:11.453592+0000","last_clean":"2024-04-25T09:04:11.453592+0000","last_became_active":"2024-04-25T09:04:10.454462+0000","last_became_peered":"2024-04-25T09:04:10.454462+0000","last_unstale":"2024-04-25T09:04:11.453592+0000","last_undegraded":"2024-04-25T09:04:11.453592+0000","last_fullsized":"2024-04-25T09:04:11.453592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:59.964799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467360+0000","last_change":"2024-04-25T09:04:10.455469+0000","last_active":"2024-04-25T09:04:13.467360+0000","last_peered":"2024-04-25T09:04:13.467360+0000","last_clean":"2024-04-25T09:04:13.467360+0000","last_became_active":"2024-04-25T09:04:10.455164+0000","last_became_peered":"2024-04-25T09:04:10.455164+0000","last_unstale":"2024-04-25T09:04:13.467360+0000","last_undegraded":"2024-04-25T09:04:13.467360+0000","last_fullsized":"2024-04-25T09:04:13.467360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:44.285991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976752+0000","last_change":"2024-04-25T09:04:10.468612+0000","last_active":"2024-04-25T09:04:12.976752+0000","last_peered":"2024-04-25T09:04:12.976752+0000","last_clean":"2024-04-25T09:04:12.976752+0000","last_became_active":"2024-04-25T09:04:10.468241+0000","last_became_peered":"2024-04-25T09:04:10.468241+0000","last_unstale":"2024-04-25T09:04:12.976752+0000","last_undegraded":"2024-04-25T09:04:12.976752+0000","last_fullsized":"2024-04-25T09:04:12.976752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:56.330375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491349+0000","last_change":"2024-04-25T09:04:10.460849+0000","last_active":"2024-04-25T09:04:12.491349+0000","last_peered":"2024-04-25T09:04:12.491349+0000","last_clean":"2024-04-25T09:04:12.491349+0000","last_became_active":"2024-04-25T09:04:10.460521+0000","last_became_peered":"2024-04-25T09:04:10.460521+0000","last_unstale":"2024-04-25T09:04:12.491349+0000","last_undegraded":"2024-04-25T09:04:12.491349+0000","last_fullsized":"2024-04-25T09:04:12.491349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:41.363774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976485+0000","last_change":"2024-04-25T09:04:10.452925+0000","last_active":"2024-04-25T09:04:12.976485+0000","last_peered":"2024-04-25T09:04:12.976485+0000","last_clean":"2024-04-25T09:04:12.976485+0000","last_became_active":"2024-04-25T09:04:10.450322+0000","last_became_peered":"2024-04-25T09:04:10.450322+0000","last_unstale":"2024-04-25T09:04:12.976485+0000","last_undegraded":"2024-04-25T09:04:12.976485+0000","last_fullsized":"2024-04-25T09:04:12.976485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.022253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.490891+0000","last_change":"2024-04-25T09:04:10.464505+0000","last_active":"2024-04-25T09:04:12.490891+0000","last_peered":"2024-04-25T09:04:12.490891+0000","last_clean":"2024-04-25T09:04:12.490891+0000","last_became_active":"2024-04-25T09:04:10.460449+0000","last_became_peered":"2024-04-25T09:04:10.460449+0000","last_unstale":"2024-04-25T09:04:12.490891+0000","last_undegraded":"2024-04-25T09:04:12.490891+0000","last_fullsized":"2024-04-25T09:04:12.490891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:53.844663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766242+0000","last_change":"2024-04-25T09:04:10.455495+0000","last_active":"2024-04-25T09:04:11.766242+0000","last_peered":"2024-04-25T09:04:11.766242+0000","last_clean":"2024-04-25T09:04:11.766242+0000","last_became_active":"2024-04-25T09:04:10.454824+0000","last_became_peered":"2024-04-25T09:04:10.454824+0000","last_unstale":"2024-04-25T09:04:11.766242+0000","last_undegraded":"2024-04-25T09:04:11.766242+0000","last_fullsized":"2024-04-25T09:04:11.766242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:06.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491385+0000","last_change":"2024-04-25T09:04:10.467947+0000","last_active":"2024-04-25T09:04:12.491385+0000","last_peered":"2024-04-25T09:04:12.491385+0000","last_clean":"2024-04-25T09:04:12.491385+0000","last_became_active":"2024-04-25T09:04:10.467620+0000","last_became_peered":"2024-04-25T09:04:10.467620+0000","last_unstale":"2024-04-25T09:04:12.491385+0000","last_undegraded":"2024-04-25T09:04:12.491385+0000","last_fullsized":"2024-04-25T09:04:12.491385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:38.966776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454350+0000","last_change":"2024-04-25T09:04:10.456157+0000","last_active":"2024-04-25T09:04:11.454350+0000","last_peered":"2024-04-25T09:04:11.454350+0000","last_clean":"2024-04-25T09:04:11.454350+0000","last_became_active":"2024-04-25T09:04:10.455814+0000","last_became_peered":"2024-04-25T09:04:10.455814+0000","last_unstale":"2024-04-25T09:04:11.454350+0000","last_undegraded":"2024-04-25T09:04:11.454350+0000","last_fullsized":"2024-04-25T09:04:11.454350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:10.572493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454102+0000","last_change":"2024-04-25T09:04:10.453100+0000","last_active":"2024-04-25T09:04:11.454102+0000","last_peered":"2024-04-25T09:04:11.454102+0000","last_clean":"2024-04-25T09:04:11.454102+0000","last_became_active":"2024-04-25T09:04:10.452835+0000","last_became_peered":"2024-04-25T09:04:10.452835+0000","last_unstale":"2024-04-25T09:04:11.454102+0000","last_undegraded":"2024-04-25T09:04:11.454102+0000","last_fullsized":"2024-04-25T09:04:11.454102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:03.161885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453763+0000","last_change":"2024-04-25T09:04:10.454612+0000","last_active":"2024-04-25T09:04:11.453763+0000","last_peered":"2024-04-25T09:04:11.453763+0000","last_clean":"2024-04-25T09:04:11.453763+0000","last_became_active":"2024-04-25T09:04:10.449834+0000","last_became_peered":"2024-04-25T09:04:10.449834+0000","last_unstale":"2024-04-25T09:04:11.453763+0000","last_undegraded":"2024-04-25T09:04:11.453763+0000","last_fullsized":"2024-04-25T09:04:11.453763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:33.347350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766581+0000","last_change":"2024-04-25T09:04:10.449404+0000","last_active":"2024-04-25T09:04:11.766581+0000","last_peered":"2024-04-25T09:04:11.766581+0000","last_clean":"2024-04-25T09:04:11.766581+0000","last_became_active":"2024-04-25T09:04:10.449123+0000","last_became_peered":"2024-04-25T09:04:10.449123+0000","last_unstale":"2024-04-25T09:04:11.766581+0000","last_undegraded":"2024-04-25T09:04:11.766581+0000","last_fullsized":"2024-04-25T09:04:11.766581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:59.964799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467147+0000","last_change":"2024-04-25T09:04:10.448367+0000","last_active":"2024-04-25T09:04:13.467147+0000","last_peered":"2024-04-25T09:04:13.467147+0000","last_clean":"2024-04-25T09:04:13.467147+0000","last_became_active":"2024-04-25T09:04:10.448103+0000","last_became_peered":"2024-04-25T09:04:10.448103+0000","last_unstale":"2024-04-25T09:04:13.467147+0000","last_undegraded":"2024-04-25T09:04:13.467147+0000","last_fullsized":"2024-04-25T09:04:13.467147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:21.063821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453172+0000","last_change":"2024-04-25T09:04:10.461500+0000","last_active":"2024-04-25T09:04:11.453172+0000","last_peered":"2024-04-25T09:04:11.453172+0000","last_clean":"2024-04-25T09:04:11.453172+0000","last_became_active":"2024-04-25T09:04:10.461218+0000","last_became_peered":"2024-04-25T09:04:10.461218+0000","last_unstale":"2024-04-25T09:04:11.453172+0000","last_undegraded":"2024-04-25T09:04:11.453172+0000","last_fullsized":"2024-04-25T09:04:11.453172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:06.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976416+0000","last_change":"2024-04-25T09:04:10.465078+0000","last_active":"2024-04-25T09:04:12.976416+0000","last_peered":"2024-04-25T09:04:12.976416+0000","last_clean":"2024-04-25T09:04:12.976416+0000","last_became_active":"2024-04-25T09:04:10.464292+0000","last_became_peered":"2024-04-25T09:04:10.464292+0000","last_unstale":"2024-04-25T09:04:12.976416+0000","last_undegraded":"2024-04-25T09:04:12.976416+0000","last_fullsized":"2024-04-25T09:04:12.976416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:53.844663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.977294+0000","last_change":"2024-04-25T09:04:10.465873+0000","last_active":"2024-04-25T09:04:12.977294+0000","last_peered":"2024-04-25T09:04:12.977294+0000","last_clean":"2024-04-25T09:04:12.977294+0000","last_became_active":"2024-04-25T09:04:10.465139+0000","last_became_peered":"2024-04-25T09:04:10.465139+0000","last_unstale":"2024-04-25T09:04:12.977294+0000","last_undegraded":"2024-04-25T09:04:12.977294+0000","last_fullsized":"2024-04-25T09:04:12.977294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:30.123868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437157+0000","last_change":"2024-04-25T09:04:10.457277+0000","last_active":"2024-04-25T09:04:12.437157+0000","last_peered":"2024-04-25T09:04:12.437157+0000","last_clean":"2024-04-25T09:04:12.437157+0000","last_became_active":"2024-04-25T09:04:10.456983+0000","last_became_peered":"2024-04-25T09:04:10.456983+0000","last_unstale":"2024-04-25T09:04:12.437157+0000","last_undegraded":"2024-04-25T09:04:12.437157+0000","last_fullsized":"2024-04-25T09:04:12.437157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:17.359486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491405+0000","last_change":"2024-04-25T09:04:10.467087+0000","last_active":"2024-04-25T09:04:12.491405+0000","last_peered":"2024-04-25T09:04:12.491405+0000","last_clean":"2024-04-25T09:04:12.491405+0000","last_became_active":"2024-04-25T09:04:10.466783+0000","last_became_peered":"2024-04-25T09:04:10.466783+0000","last_unstale":"2024-04-25T09:04:12.491405+0000","last_undegraded":"2024-04-25T09:04:12.491405+0000","last_fullsized":"2024-04-25T09:04:12.491405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:15.921248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453460+0000","last_change":"2024-04-25T09:04:10.458537+0000","last_active":"2024-04-25T09:04:11.453460+0000","last_peered":"2024-04-25T09:04:11.453460+0000","last_clean":"2024-04-25T09:04:11.453460+0000","last_became_active":"2024-04-25T09:04:10.458180+0000","last_became_peered":"2024-04-25T09:04:10.458180+0000","last_unstale":"2024-04-25T09:04:11.453460+0000","last_undegraded":"2024-04-25T09:04:11.453460+0000","last_fullsized":"2024-04-25T09:04:11.453460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:47.704816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467481+0000","last_change":"2024-04-25T09:04:10.458711+0000","last_active":"2024-04-25T09:04:13.467481+0000","last_peered":"2024-04-25T09:04:13.467481+0000","last_clean":"2024-04-25T09:04:13.467481+0000","last_became_active":"2024-04-25T09:04:10.458450+0000","last_became_peered":"2024-04-25T09:04:10.458450+0000","last_unstale":"2024-04-25T09:04:13.467481+0000","last_undegraded":"2024-04-25T09:04:13.467481+0000","last_fullsized":"2024-04-25T09:04:13.467481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:47.704816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976582+0000","last_change":"2024-04-25T09:04:10.455142+0000","last_active":"2024-04-25T09:04:12.976582+0000","last_peered":"2024-04-25T09:04:12.976582+0000","last_clean":"2024-04-25T09:04:12.976582+0000","last_became_active":"2024-04-25T09:04:10.454776+0000","last_became_peered":"2024-04-25T09:04:10.454776+0000","last_unstale":"2024-04-25T09:04:12.976582+0000","last_undegraded":"2024-04-25T09:04:12.976582+0000","last_fullsized":"2024-04-25T09:04:12.976582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:59.917069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766510+0000","last_change":"2024-04-25T09:04:10.462091+0000","last_active":"2024-04-25T09:04:11.766510+0000","last_peered":"2024-04-25T09:04:11.766510+0000","last_clean":"2024-04-25T09:04:11.766510+0000","last_became_active":"2024-04-25T09:04:10.460956+0000","last_became_peered":"2024-04-25T09:04:10.460956+0000","last_unstale":"2024-04-25T09:04:11.766510+0000","last_undegraded":"2024-04-25T09:04:11.766510+0000","last_fullsized":"2024-04-25T09:04:11.766510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:03.161885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976550+0000","last_change":"2024-04-25T09:04:10.456817+0000","last_active":"2024-04-25T09:04:12.976550+0000","last_peered":"2024-04-25T09:04:12.976550+0000","last_clean":"2024-04-25T09:04:12.976550+0000","last_became_active":"2024-04-25T09:04:10.456515+0000","last_became_peered":"2024-04-25T09:04:10.456515+0000","last_unstale":"2024-04-25T09:04:12.976550+0000","last_undegraded":"2024-04-25T09:04:12.976550+0000","last_fullsized":"2024-04-25T09:04:12.976550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:25.970653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766945+0000","last_change":"2024-04-25T09:04:10.467130+0000","last_active":"2024-04-25T09:04:11.766945+0000","last_peered":"2024-04-25T09:04:11.766945+0000","last_clean":"2024-04-25T09:04:11.766945+0000","last_became_active":"2024-04-25T09:04:10.466843+0000","last_became_peered":"2024-04-25T09:04:10.466843+0000","last_unstale":"2024-04-25T09:04:11.766945+0000","last_undegraded":"2024-04-25T09:04:11.766945+0000","last_fullsized":"2024-04-25T09:04:11.766945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:38.453486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454457+0000","last_change":"2024-04-25T09:04:10.461159+0000","last_active":"2024-04-25T09:04:11.454457+0000","last_peered":"2024-04-25T09:04:11.454457+0000","last_clean":"2024-04-25T09:04:11.454457+0000","last_became_active":"2024-04-25T09:04:10.460871+0000","last_became_peered":"2024-04-25T09:04:10.460871+0000","last_unstale":"2024-04-25T09:04:11.454457+0000","last_undegraded":"2024-04-25T09:04:11.454457+0000","last_fullsized":"2024-04-25T09:04:11.454457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:59.964799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453551+0000","last_change":"2024-04-25T09:04:10.462566+0000","last_active":"2024-04-25T09:04:11.453551+0000","last_peered":"2024-04-25T09:04:11.453551+0000","last_clean":"2024-04-25T09:04:11.453551+0000","last_became_active":"2024-04-25T09:04:10.461856+0000","last_became_peered":"2024-04-25T09:04:10.461856+0000","last_unstale":"2024-04-25T09:04:11.453551+0000","last_undegraded":"2024-04-25T09:04:11.453551+0000","last_fullsized":"2024-04-25T09:04:11.453551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:10.572493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766880+0000","last_change":"2024-04-25T09:04:10.461850+0000","last_active":"2024-04-25T09:04:11.766880+0000","last_peered":"2024-04-25T09:04:11.766880+0000","last_clean":"2024-04-25T09:04:11.766880+0000","last_became_active":"2024-04-25T09:04:10.460707+0000","last_became_peered":"2024-04-25T09:04:10.460707+0000","last_unstale":"2024-04-25T09:04:11.766880+0000","last_undegraded":"2024-04-25T09:04:11.766880+0000","last_fullsized":"2024-04-25T09:04:11.766880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:25.970653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467386+0000","last_change":"2024-04-25T09:04:10.464541+0000","last_active":"2024-04-25T09:04:13.467386+0000","last_peered":"2024-04-25T09:04:13.467386+0000","last_clean":"2024-04-25T09:04:13.467386+0000","last_became_active":"2024-04-25T09:04:10.464252+0000","last_became_peered":"2024-04-25T09:04:10.464252+0000","last_unstale":"2024-04-25T09:04:13.467386+0000","last_undegraded":"2024-04-25T09:04:13.467386+0000","last_fullsized":"2024-04-25T09:04:13.467386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:06.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976682+0000","last_change":"2024-04-25T09:04:10.465260+0000","last_active":"2024-04-25T09:04:12.976682+0000","last_peered":"2024-04-25T09:04:12.976682+0000","last_clean":"2024-04-25T09:04:12.976682+0000","last_became_active":"2024-04-25T09:04:10.464698+0000","last_became_peered":"2024-04-25T09:04:10.464698+0000","last_unstale":"2024-04-25T09:04:12.976682+0000","last_undegraded":"2024-04-25T09:04:12.976682+0000","last_fullsized":"2024-04-25T09:04:12.976682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:38.453486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437050+0000","last_change":"2024-04-25T09:04:10.455699+0000","last_active":"2024-04-25T09:04:12.437050+0000","last_peered":"2024-04-25T09:04:12.437050+0000","last_clean":"2024-04-25T09:04:12.437050+0000","last_became_active":"2024-04-25T09:04:10.455417+0000","last_became_peered":"2024-04-25T09:04:10.455417+0000","last_unstale":"2024-04-25T09:04:12.437050+0000","last_undegraded":"2024-04-25T09:04:12.437050+0000","last_fullsized":"2024-04-25T09:04:12.437050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.228938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453241+0000","last_change":"2024-04-25T09:04:10.451620+0000","last_active":"2024-04-25T09:04:11.453241+0000","last_peered":"2024-04-25T09:04:11.453241+0000","last_clean":"2024-04-25T09:04:11.453241+0000","last_became_active":"2024-04-25T09:04:10.451273+0000","last_became_peered":"2024-04-25T09:04:10.451273+0000","last_unstale":"2024-04-25T09:04:11.453241+0000","last_undegraded":"2024-04-25T09:04:11.453241+0000","last_fullsized":"2024-04-25T09:04:11.453241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:12.826732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453920+0000","last_change":"2024-04-25T09:04:10.449559+0000","last_active":"2024-04-25T09:04:11.453920+0000","last_peered":"2024-04-25T09:04:11.453920+0000","last_clean":"2024-04-25T09:04:11.453920+0000","last_became_active":"2024-04-25T09:04:10.448300+0000","last_became_peered":"2024-04-25T09:04:10.448300+0000","last_unstale":"2024-04-25T09:04:11.453920+0000","last_undegraded":"2024-04-25T09:04:11.453920+0000","last_fullsized":"2024-04-25T09:04:11.453920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:46.591632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766688+0000","last_change":"2024-04-25T09:04:09.443692+0000","last_active":"2024-04-25T09:04:11.766688+0000","last_peered":"2024-04-25T09:04:11.766688+0000","last_clean":"2024-04-25T09:04:11.766688+0000","last_became_active":"2024-04-25T09:04:09.443223+0000","last_became_peered":"2024-04-25T09:04:09.443223+0000","last_unstale":"2024-04-25T09:04:11.766688+0000","last_undegraded":"2024-04-25T09:04:11.766688+0000","last_fullsized":"2024-04-25T09:04:11.766688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:52.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467575+0000","last_change":"2024-04-25T09:04:10.445977+0000","last_active":"2024-04-25T09:04:13.467575+0000","last_peered":"2024-04-25T09:04:13.467575+0000","last_clean":"2024-04-25T09:04:13.467575+0000","last_became_active":"2024-04-25T09:04:10.445685+0000","last_became_peered":"2024-04-25T09:04:10.445685+0000","last_unstale":"2024-04-25T09:04:13.467575+0000","last_undegraded":"2024-04-25T09:04:13.467575+0000","last_fullsized":"2024-04-25T09:04:13.467575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:59.964799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453359+0000","last_change":"2024-04-25T09:04:09.428583+0000","last_active":"2024-04-25T09:04:11.453359+0000","last_peered":"2024-04-25T09:04:11.453359+0000","last_clean":"2024-04-25T09:04:11.453359+0000","last_became_active":"2024-04-25T09:04:09.428043+0000","last_became_peered":"2024-04-25T09:04:09.428043+0000","last_unstale":"2024-04-25T09:04:11.453359+0000","last_undegraded":"2024-04-25T09:04:11.453359+0000","last_fullsized":"2024-04-25T09:04:11.453359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766378+0000","last_change":"2024-04-25T09:04:09.440384+0000","last_active":"2024-04-25T09:04:11.766378+0000","last_peered":"2024-04-25T09:04:11.766378+0000","last_clean":"2024-04-25T09:04:11.766378+0000","last_became_active":"2024-04-25T09:04:09.439952+0000","last_became_peered":"2024-04-25T09:04:09.439952+0000","last_unstale":"2024-04-25T09:04:11.766378+0000","last_undegraded":"2024-04-25T09:04:11.766378+0000","last_fullsized":"2024-04-25T09:04:11.766378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:59.824337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766347+0000","last_change":"2024-04-25T09:04:10.455692+0000","last_active":"2024-04-25T09:04:11.766347+0000","last_peered":"2024-04-25T09:04:11.766347+0000","last_clean":"2024-04-25T09:04:11.766347+0000","last_became_active":"2024-04-25T09:04:10.455212+0000","last_became_peered":"2024-04-25T09:04:10.455212+0000","last_unstale":"2024-04-25T09:04:11.766347+0000","last_undegraded":"2024-04-25T09:04:11.766347+0000","last_fullsized":"2024-04-25T09:04:11.766347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:47.704816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976560+0000","last_change":"2024-04-25T09:04:09.438700+0000","last_active":"2024-04-25T09:04:12.976560+0000","last_peered":"2024-04-25T09:04:12.976560+0000","last_clean":"2024-04-25T09:04:12.976560+0000","last_became_active":"2024-04-25T09:04:09.438424+0000","last_became_peered":"2024-04-25T09:04:09.438424+0000","last_unstale":"2024-04-25T09:04:12.976560+0000","last_undegraded":"2024-04-25T09:04:12.976560+0000","last_fullsized":"2024-04-25T09:04:12.976560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:52.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453190+0000","last_change":"2024-04-25T09:04:10.455298+0000","last_active":"2024-04-25T09:04:11.453190+0000","last_peered":"2024-04-25T09:04:11.453190+0000","last_clean":"2024-04-25T09:04:11.453190+0000","last_became_active":"2024-04-25T09:04:10.455044+0000","last_became_peered":"2024-04-25T09:04:10.455044+0000","last_unstale":"2024-04-25T09:04:11.453190+0000","last_undegraded":"2024-04-25T09:04:11.453190+0000","last_fullsized":"2024-04-25T09:04:11.453190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:47.704816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454284+0000","last_change":"2024-04-25T09:04:09.441197+0000","last_active":"2024-04-25T09:04:11.454284+0000","last_peered":"2024-04-25T09:04:11.454284+0000","last_clean":"2024-04-25T09:04:11.454284+0000","last_became_active":"2024-04-25T09:04:09.440752+0000","last_became_peered":"2024-04-25T09:04:09.440752+0000","last_unstale":"2024-04-25T09:04:11.454284+0000","last_undegraded":"2024-04-25T09:04:11.454284+0000","last_fullsized":"2024-04-25T09:04:11.454284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:52.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.977125+0000","last_change":"2024-04-25T09:04:10.466060+0000","last_active":"2024-04-25T09:04:12.977125+0000","last_peered":"2024-04-25T09:04:12.977125+0000","last_clean":"2024-04-25T09:04:12.977125+0000","last_became_active":"2024-04-25T09:04:10.465550+0000","last_became_peered":"2024-04-25T09:04:10.465550+0000","last_unstale":"2024-04-25T09:04:12.977125+0000","last_undegraded":"2024-04-25T09:04:12.977125+0000","last_fullsized":"2024-04-25T09:04:12.977125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:08.225883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.977181+0000","last_change":"2024-04-25T09:04:09.444181+0000","last_active":"2024-04-25T09:04:12.977181+0000","last_peered":"2024-04-25T09:04:12.977181+0000","last_clean":"2024-04-25T09:04:12.977181+0000","last_became_active":"2024-04-25T09:04:09.443601+0000","last_became_peered":"2024-04-25T09:04:09.443601+0000","last_unstale":"2024-04-25T09:04:12.977181+0000","last_undegraded":"2024-04-25T09:04:12.977181+0000","last_fullsized":"2024-04-25T09:04:12.977181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:23.622773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467492+0000","last_change":"2024-04-25T09:04:10.451240+0000","last_active":"2024-04-25T09:04:13.467492+0000","last_peered":"2024-04-25T09:04:13.467492+0000","last_clean":"2024-04-25T09:04:13.467492+0000","last_became_active":"2024-04-25T09:04:10.451065+0000","last_became_peered":"2024-04-25T09:04:10.451065+0000","last_unstale":"2024-04-25T09:04:13.467492+0000","last_undegraded":"2024-04-25T09:04:13.467492+0000","last_fullsized":"2024-04-25T09:04:13.467492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:03.161885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453491+0000","last_change":"2024-04-25T09:04:09.441559+0000","last_active":"2024-04-25T09:04:11.453491+0000","last_peered":"2024-04-25T09:04:11.453491+0000","last_clean":"2024-04-25T09:04:11.453491+0000","last_became_active":"2024-04-25T09:04:09.441288+0000","last_became_peered":"2024-04-25T09:04:09.441288+0000","last_unstale":"2024-04-25T09:04:11.453491+0000","last_undegraded":"2024-04-25T09:04:11.453491+0000","last_fullsized":"2024-04-25T09:04:11.453491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454256+0000","last_change":"2024-04-25T09:04:10.460810+0000","last_active":"2024-04-25T09:04:11.454256+0000","last_peered":"2024-04-25T09:04:11.454256+0000","last_clean":"2024-04-25T09:04:11.454256+0000","last_became_active":"2024-04-25T09:04:10.458726+0000","last_became_peered":"2024-04-25T09:04:10.458726+0000","last_unstale":"2024-04-25T09:04:11.454256+0000","last_undegraded":"2024-04-25T09:04:11.454256+0000","last_fullsized":"2024-04-25T09:04:11.454256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.228938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453432+0000","last_change":"2024-04-25T09:04:09.436321+0000","last_active":"2024-04-25T09:04:11.453432+0000","last_peered":"2024-04-25T09:04:11.453432+0000","last_clean":"2024-04-25T09:04:11.453432+0000","last_became_active":"2024-04-25T09:04:09.435708+0000","last_became_peered":"2024-04-25T09:04:09.435708+0000","last_unstale":"2024-04-25T09:04:11.453432+0000","last_undegraded":"2024-04-25T09:04:11.453432+0000","last_fullsized":"2024-04-25T09:04:11.453432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:23.622773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491036+0000","last_change":"2024-04-25T09:04:10.469991+0000","last_active":"2024-04-25T09:04:12.491036+0000","last_peered":"2024-04-25T09:04:12.491036+0000","last_clean":"2024-04-25T09:04:12.491036+0000","last_became_active":"2024-04-25T09:04:10.469673+0000","last_became_peered":"2024-04-25T09:04:10.469673+0000","last_unstale":"2024-04-25T09:04:12.491036+0000","last_undegraded":"2024-04-25T09:04:12.491036+0000","last_fullsized":"2024-04-25T09:04:12.491036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:25.970653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467600+0000","last_change":"2024-04-25T09:04:09.445342+0000","last_active":"2024-04-25T09:04:13.467600+0000","last_peered":"2024-04-25T09:04:13.467600+0000","last_clean":"2024-04-25T09:04:13.467600+0000","last_became_active":"2024-04-25T09:04:09.445036+0000","last_became_peered":"2024-04-25T09:04:09.445036+0000","last_unstale":"2024-04-25T09:04:13.467600+0000","last_undegraded":"2024-04-25T09:04:13.467600+0000","last_fullsized":"2024-04-25T09:04:13.467600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:42.962745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467486+0000","last_change":"2024-04-25T09:04:10.460039+0000","last_active":"2024-04-25T09:04:13.467486+0000","last_peered":"2024-04-25T09:04:13.467486+0000","last_clean":"2024-04-25T09:04:13.467486+0000","last_became_active":"2024-04-25T09:04:10.459802+0000","last_became_peered":"2024-04-25T09:04:10.459802+0000","last_unstale":"2024-04-25T09:04:13.467486+0000","last_undegraded":"2024-04-25T09:04:13.467486+0000","last_fullsized":"2024-04-25T09:04:13.467486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:36.421524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976673+0000","last_change":"2024-04-25T09:04:09.448990+0000","last_active":"2024-04-25T09:04:12.976673+0000","last_peered":"2024-04-25T09:04:12.976673+0000","last_clean":"2024-04-25T09:04:12.976673+0000","last_became_active":"2024-04-25T09:04:09.447328+0000","last_became_peered":"2024-04-25T09:04:09.447328+0000","last_unstale":"2024-04-25T09:04:12.976673+0000","last_undegraded":"2024-04-25T09:04:12.976673+0000","last_fullsized":"2024-04-25T09:04:12.976673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491268+0000","last_change":"2024-04-25T09:04:10.470501+0000","last_active":"2024-04-25T09:04:12.491268+0000","last_peered":"2024-04-25T09:04:12.491268+0000","last_clean":"2024-04-25T09:04:12.491268+0000","last_became_active":"2024-04-25T09:04:10.470149+0000","last_became_peered":"2024-04-25T09:04:10.470149+0000","last_unstale":"2024-04-25T09:04:12.491268+0000","last_undegraded":"2024-04-25T09:04:12.491268+0000","last_fullsized":"2024-04-25T09:04:12.491268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:38.453486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453361+0000","last_change":"2024-04-25T09:04:09.428421+0000","last_active":"2024-04-25T09:04:11.453361+0000","last_peered":"2024-04-25T09:04:11.453361+0000","last_clean":"2024-04-25T09:04:11.453361+0000","last_became_active":"2024-04-25T09:04:09.428088+0000","last_became_peered":"2024-04-25T09:04:09.428088+0000","last_unstale":"2024-04-25T09:04:11.453361+0000","last_undegraded":"2024-04-25T09:04:11.453361+0000","last_fullsized":"2024-04-25T09:04:11.453361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:11.557908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454070+0000","last_change":"2024-04-25T09:04:10.452284+0000","last_active":"2024-04-25T09:04:11.454070+0000","last_peered":"2024-04-25T09:04:11.454070+0000","last_clean":"2024-04-25T09:04:11.454070+0000","last_became_active":"2024-04-25T09:04:10.451470+0000","last_became_peered":"2024-04-25T09:04:10.451470+0000","last_unstale":"2024-04-25T09:04:11.454070+0000","last_undegraded":"2024-04-25T09:04:11.454070+0000","last_fullsized":"2024-04-25T09:04:11.454070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:36.421524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437004+0000","last_change":"2024-04-25T09:04:09.437062+0000","last_active":"2024-04-25T09:04:12.437004+0000","last_peered":"2024-04-25T09:04:12.437004+0000","last_clean":"2024-04-25T09:04:12.437004+0000","last_became_active":"2024-04-25T09:04:09.436793+0000","last_became_peered":"2024-04-25T09:04:09.436793+0000","last_unstale":"2024-04-25T09:04:12.437004+0000","last_undegraded":"2024-04-25T09:04:12.437004+0000","last_fullsized":"2024-04-25T09:04:12.437004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.490890+0000","last_change":"2024-04-25T09:04:10.462986+0000","last_active":"2024-04-25T09:04:12.490890+0000","last_peered":"2024-04-25T09:04:12.490890+0000","last_clean":"2024-04-25T09:04:12.490890+0000","last_became_active":"2024-04-25T09:04:10.462639+0000","last_became_peered":"2024-04-25T09:04:10.462639+0000","last_unstale":"2024-04-25T09:04:12.490890+0000","last_undegraded":"2024-04-25T09:04:12.490890+0000","last_fullsized":"2024-04-25T09:04:12.490890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.022253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454237+0000","last_change":"2024-04-25T09:04:09.435053+0000","last_active":"2024-04-25T09:04:11.454237+0000","last_peered":"2024-04-25T09:04:11.454237+0000","last_clean":"2024-04-25T09:04:11.454237+0000","last_became_active":"2024-04-25T09:04:09.434661+0000","last_became_peered":"2024-04-25T09:04:09.434661+0000","last_unstale":"2024-04-25T09:04:11.454237+0000","last_undegraded":"2024-04-25T09:04:11.454237+0000","last_fullsized":"2024-04-25T09:04:11.454237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:50.779717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491308+0000","last_change":"2024-04-25T09:04:10.472088+0000","last_active":"2024-04-25T09:04:12.491308+0000","last_peered":"2024-04-25T09:04:12.491308+0000","last_clean":"2024-04-25T09:04:12.491308+0000","last_became_active":"2024-04-25T09:04:10.471765+0000","last_became_peered":"2024-04-25T09:04:10.471765+0000","last_unstale":"2024-04-25T09:04:12.491308+0000","last_undegraded":"2024-04-25T09:04:12.491308+0000","last_fullsized":"2024-04-25T09:04:12.491308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:56.330375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437211+0000","last_change":"2024-04-25T09:04:09.444431+0000","last_active":"2024-04-25T09:04:12.437211+0000","last_peered":"2024-04-25T09:04:12.437211+0000","last_clean":"2024-04-25T09:04:12.437211+0000","last_became_active":"2024-04-25T09:04:09.444192+0000","last_became_peered":"2024-04-25T09:04:09.444192+0000","last_unstale":"2024-04-25T09:04:12.437211+0000","last_undegraded":"2024-04-25T09:04:12.437211+0000","last_fullsized":"2024-04-25T09:04:12.437211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491563+0000","last_change":"2024-04-25T09:04:10.472130+0000","last_active":"2024-04-25T09:04:12.491563+0000","last_peered":"2024-04-25T09:04:12.491563+0000","last_clean":"2024-04-25T09:04:12.491563+0000","last_became_active":"2024-04-25T09:04:10.471819+0000","last_became_peered":"2024-04-25T09:04:10.471819+0000","last_unstale":"2024-04-25T09:04:12.491563+0000","last_undegraded":"2024-04-25T09:04:12.491563+0000","last_fullsized":"2024-04-25T09:04:12.491563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:08.225883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453585+0000","last_change":"2024-04-25T09:04:09.435777+0000","last_active":"2024-04-25T09:04:11.453585+0000","last_peered":"2024-04-25T09:04:11.453585+0000","last_clean":"2024-04-25T09:04:11.453585+0000","last_became_active":"2024-04-25T09:04:09.433156+0000","last_became_peered":"2024-04-25T09:04:09.433156+0000","last_unstale":"2024-04-25T09:04:11.453585+0000","last_undegraded":"2024-04-25T09:04:11.453585+0000","last_fullsized":"2024-04-25T09:04:11.453585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:11.557908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.977006+0000","last_change":"2024-04-25T09:04:10.467199+0000","last_active":"2024-04-25T09:04:12.977006+0000","last_peered":"2024-04-25T09:04:12.977006+0000","last_clean":"2024-04-25T09:04:12.977006+0000","last_became_active":"2024-04-25T09:04:10.466426+0000","last_became_peered":"2024-04-25T09:04:10.466426+0000","last_unstale":"2024-04-25T09:04:12.977006+0000","last_undegraded":"2024-04-25T09:04:12.977006+0000","last_fullsized":"2024-04-25T09:04:12.977006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:38.966776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437060+0000","last_change":"2024-04-25T09:04:09.438805+0000","last_active":"2024-04-25T09:04:12.437060+0000","last_peered":"2024-04-25T09:04:12.437060+0000","last_clean":"2024-04-25T09:04:12.437060+0000","last_became_active":"2024-04-25T09:04:09.438519+0000","last_became_peered":"2024-04-25T09:04:09.438519+0000","last_unstale":"2024-04-25T09:04:12.437060+0000","last_undegraded":"2024-04-25T09:04:12.437060+0000","last_fullsized":"2024-04-25T09:04:12.437060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:52.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491190+0000","last_change":"2024-04-25T09:04:10.467799+0000","last_active":"2024-04-25T09:04:12.491190+0000","last_peered":"2024-04-25T09:04:12.491190+0000","last_clean":"2024-04-25T09:04:12.491190+0000","last_became_active":"2024-04-25T09:04:10.467524+0000","last_became_peered":"2024-04-25T09:04:10.467524+0000","last_unstale":"2024-04-25T09:04:12.491190+0000","last_undegraded":"2024-04-25T09:04:12.491190+0000","last_fullsized":"2024-04-25T09:04:12.491190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:59.917069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.490943+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:04:12.490943+0000","last_peered":"2024-04-25T09:04:12.490943+0000","last_clean":"2024-04-25T09:04:12.490943+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:04:12.490943+0000","last_undegraded":"2024-04-25T09:04:12.490943+0000","last_fullsized":"2024-04-25T09:04:12.490943+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976528+0000","last_change":"2024-04-25T09:04:09.443155+0000","last_active":"2024-04-25T09:04:12.976528+0000","last_peered":"2024-04-25T09:04:12.976528+0000","last_clean":"2024-04-25T09:04:12.976528+0000","last_became_active":"2024-04-25T09:04:09.441937+0000","last_became_peered":"2024-04-25T09:04:09.441937+0000","last_unstale":"2024-04-25T09:04:12.976528+0000","last_undegraded":"2024-04-25T09:04:12.976528+0000","last_fullsized":"2024-04-25T09:04:12.976528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766523+0000","last_change":"2024-04-25T09:04:10.455462+0000","last_active":"2024-04-25T09:04:11.766523+0000","last_peered":"2024-04-25T09:04:11.766523+0000","last_clean":"2024-04-25T09:04:11.766523+0000","last_became_active":"2024-04-25T09:04:10.455118+0000","last_became_peered":"2024-04-25T09:04:10.455118+0000","last_unstale":"2024-04-25T09:04:11.766523+0000","last_undegraded":"2024-04-25T09:04:11.766523+0000","last_fullsized":"2024-04-25T09:04:11.766523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:10.572493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.490794+0000","last_change":"2024-04-25T09:04:09.446062+0000","last_active":"2024-04-25T09:04:12.490794+0000","last_peered":"2024-04-25T09:04:12.490794+0000","last_clean":"2024-04-25T09:04:12.490794+0000","last_became_active":"2024-04-25T09:04:09.445786+0000","last_became_peered":"2024-04-25T09:04:09.445786+0000","last_unstale":"2024-04-25T09:04:12.490794+0000","last_undegraded":"2024-04-25T09:04:12.490794+0000","last_fullsized":"2024-04-25T09:04:12.490794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467096+0000","last_change":"2024-04-25T09:04:10.444069+0000","last_active":"2024-04-25T09:04:13.467096+0000","last_peered":"2024-04-25T09:04:13.467096+0000","last_clean":"2024-04-25T09:04:13.467096+0000","last_became_active":"2024-04-25T09:04:10.443785+0000","last_became_peered":"2024-04-25T09:04:10.443785+0000","last_unstale":"2024-04-25T09:04:13.467096+0000","last_undegraded":"2024-04-25T09:04:13.467096+0000","last_fullsized":"2024-04-25T09:04:13.467096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:24.135986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437094+0000","last_change":"2024-04-25T09:04:09.434207+0000","last_active":"2024-04-25T09:04:12.437094+0000","last_peered":"2024-04-25T09:04:12.437094+0000","last_clean":"2024-04-25T09:04:12.437094+0000","last_became_active":"2024-04-25T09:04:09.433751+0000","last_became_peered":"2024-04-25T09:04:09.433751+0000","last_unstale":"2024-04-25T09:04:12.437094+0000","last_undegraded":"2024-04-25T09:04:12.437094+0000","last_fullsized":"2024-04-25T09:04:12.437094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:59.824337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453395+0000","last_change":"2024-04-25T09:04:10.460017+0000","last_active":"2024-04-25T09:04:11.453395+0000","last_peered":"2024-04-25T09:04:11.453395+0000","last_clean":"2024-04-25T09:04:11.453395+0000","last_became_active":"2024-04-25T09:04:10.459722+0000","last_became_peered":"2024-04-25T09:04:10.459722+0000","last_unstale":"2024-04-25T09:04:11.453395+0000","last_undegraded":"2024-04-25T09:04:11.453395+0000","last_fullsized":"2024-04-25T09:04:11.453395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:03.161885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976789+0000","last_change":"2024-04-25T09:04:09.445889+0000","last_active":"2024-04-25T09:04:12.976789+0000","last_peered":"2024-04-25T09:04:12.976789+0000","last_clean":"2024-04-25T09:04:12.976789+0000","last_became_active":"2024-04-25T09:04:09.445008+0000","last_became_peered":"2024-04-25T09:04:09.445008+0000","last_unstale":"2024-04-25T09:04:12.976789+0000","last_undegraded":"2024-04-25T09:04:12.976789+0000","last_fullsized":"2024-04-25T09:04:12.976789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:11.557908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453904+0000","last_change":"2024-04-25T09:04:10.457749+0000","last_active":"2024-04-25T09:04:11.453904+0000","last_peered":"2024-04-25T09:04:11.453904+0000","last_clean":"2024-04-25T09:04:11.453904+0000","last_became_active":"2024-04-25T09:04:10.454687+0000","last_became_peered":"2024-04-25T09:04:10.454687+0000","last_unstale":"2024-04-25T09:04:11.453904+0000","last_undegraded":"2024-04-25T09:04:11.453904+0000","last_fullsized":"2024-04-25T09:04:11.453904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:12.563435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453313+0000","last_change":"2024-04-25T09:04:09.448524+0000","last_active":"2024-04-25T09:04:11.453313+0000","last_peered":"2024-04-25T09:04:11.453313+0000","last_clean":"2024-04-25T09:04:11.453313+0000","last_became_active":"2024-04-25T09:04:09.448200+0000","last_became_peered":"2024-04-25T09:04:09.448200+0000","last_unstale":"2024-04-25T09:04:11.453313+0000","last_undegraded":"2024-04-25T09:04:11.453313+0000","last_fullsized":"2024-04-25T09:04:11.453313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.977103+0000","last_change":"2024-04-25T09:04:10.466591+0000","last_active":"2024-04-25T09:04:12.977103+0000","last_peered":"2024-04-25T09:04:12.977103+0000","last_clean":"2024-04-25T09:04:12.977103+0000","last_became_active":"2024-04-25T09:04:10.466280+0000","last_became_peered":"2024-04-25T09:04:10.466280+0000","last_unstale":"2024-04-25T09:04:12.977103+0000","last_undegraded":"2024-04-25T09:04:12.977103+0000","last_fullsized":"2024-04-25T09:04:12.977103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:38.704801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491422+0000","last_change":"2024-04-25T09:04:09.450624+0000","last_active":"2024-04-25T09:04:12.491422+0000","last_peered":"2024-04-25T09:04:12.491422+0000","last_clean":"2024-04-25T09:04:12.491422+0000","last_became_active":"2024-04-25T09:04:09.450247+0000","last_became_peered":"2024-04-25T09:04:09.450247+0000","last_unstale":"2024-04-25T09:04:12.491422+0000","last_undegraded":"2024-04-25T09:04:12.491422+0000","last_fullsized":"2024-04-25T09:04:12.491422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:06.223411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453226+0000","last_change":"2024-04-25T09:04:10.456100+0000","last_active":"2024-04-25T09:04:11.453226+0000","last_peered":"2024-04-25T09:04:11.453226+0000","last_clean":"2024-04-25T09:04:11.453226+0000","last_became_active":"2024-04-25T09:04:10.455713+0000","last_became_peered":"2024-04-25T09:04:10.455713+0000","last_unstale":"2024-04-25T09:04:11.453226+0000","last_undegraded":"2024-04-25T09:04:11.453226+0000","last_fullsized":"2024-04-25T09:04:11.453226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:36.421524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.435073+0000","last_change":"2024-04-25T09:04:09.440316+0000","last_active":"2024-04-25T09:04:12.435073+0000","last_peered":"2024-04-25T09:04:12.435073+0000","last_clean":"2024-04-25T09:04:12.435073+0000","last_became_active":"2024-04-25T09:04:09.437292+0000","last_became_peered":"2024-04-25T09:04:09.437292+0000","last_unstale":"2024-04-25T09:04:12.435073+0000","last_undegraded":"2024-04-25T09:04:12.435073+0000","last_fullsized":"2024-04-25T09:04:12.435073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.586105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766908+0000","last_change":"2024-04-25T09:04:10.459918+0000","last_active":"2024-04-25T09:04:11.766908+0000","last_peered":"2024-04-25T09:04:11.766908+0000","last_clean":"2024-04-25T09:04:11.766908+0000","last_became_active":"2024-04-25T09:04:10.459598+0000","last_became_peered":"2024-04-25T09:04:10.459598+0000","last_unstale":"2024-04-25T09:04:11.766908+0000","last_undegraded":"2024-04-25T09:04:11.766908+0000","last_fullsized":"2024-04-25T09:04:11.766908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:59.917069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454406+0000","last_change":"2024-04-25T09:04:09.447004+0000","last_active":"2024-04-25T09:04:11.454406+0000","last_peered":"2024-04-25T09:04:11.454406+0000","last_clean":"2024-04-25T09:04:11.454406+0000","last_became_active":"2024-04-25T09:04:09.446720+0000","last_became_peered":"2024-04-25T09:04:09.446720+0000","last_unstale":"2024-04-25T09:04:11.454406+0000","last_undegraded":"2024-04-25T09:04:11.454406+0000","last_fullsized":"2024-04-25T09:04:11.454406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467529+0000","last_change":"2024-04-25T09:04:10.448395+0000","last_active":"2024-04-25T09:04:13.467529+0000","last_peered":"2024-04-25T09:04:13.467529+0000","last_clean":"2024-04-25T09:04:13.467529+0000","last_became_active":"2024-04-25T09:04:10.448092+0000","last_became_peered":"2024-04-25T09:04:10.448092+0000","last_unstale":"2024-04-25T09:04:13.467529+0000","last_undegraded":"2024-04-25T09:04:13.467529+0000","last_fullsized":"2024-04-25T09:04:13.467529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:10.572493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491035+0000","last_change":"2024-04-25T09:04:09.450871+0000","last_active":"2024-04-25T09:04:12.491035+0000","last_peered":"2024-04-25T09:04:12.491035+0000","last_clean":"2024-04-25T09:04:12.491035+0000","last_became_active":"2024-04-25T09:04:09.450420+0000","last_became_peered":"2024-04-25T09:04:09.450420+0000","last_unstale":"2024-04-25T09:04:12.491035+0000","last_undegraded":"2024-04-25T09:04:12.491035+0000","last_fullsized":"2024-04-25T09:04:12.491035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453905+0000","last_change":"2024-04-25T09:04:10.461790+0000","last_active":"2024-04-25T09:04:11.453905+0000","last_peered":"2024-04-25T09:04:11.453905+0000","last_clean":"2024-04-25T09:04:11.453905+0000","last_became_active":"2024-04-25T09:04:10.459834+0000","last_became_peered":"2024-04-25T09:04:10.459834+0000","last_unstale":"2024-04-25T09:04:11.453905+0000","last_undegraded":"2024-04-25T09:04:11.453905+0000","last_fullsized":"2024-04-25T09:04:11.453905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:24.628300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453268+0000","last_change":"2024-04-25T09:04:09.443781+0000","last_active":"2024-04-25T09:04:11.453268+0000","last_peered":"2024-04-25T09:04:11.453268+0000","last_clean":"2024-04-25T09:04:11.453268+0000","last_became_active":"2024-04-25T09:04:09.443436+0000","last_became_peered":"2024-04-25T09:04:09.443436+0000","last_unstale":"2024-04-25T09:04:11.453268+0000","last_undegraded":"2024-04-25T09:04:11.453268+0000","last_fullsized":"2024-04-25T09:04:11.453268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:06.223411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766429+0000","last_change":"2024-04-25T09:04:10.453062+0000","last_active":"2024-04-25T09:04:11.766429+0000","last_peered":"2024-04-25T09:04:11.766429+0000","last_clean":"2024-04-25T09:04:11.766429+0000","last_became_active":"2024-04-25T09:04:10.452791+0000","last_became_peered":"2024-04-25T09:04:10.452791+0000","last_unstale":"2024-04-25T09:04:11.766429+0000","last_undegraded":"2024-04-25T09:04:11.766429+0000","last_fullsized":"2024-04-25T09:04:11.766429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:36.421524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453381+0000","last_change":"2024-04-25T09:04:09.434154+0000","last_active":"2024-04-25T09:04:11.453381+0000","last_peered":"2024-04-25T09:04:11.453381+0000","last_clean":"2024-04-25T09:04:11.453381+0000","last_became_active":"2024-04-25T09:04:09.433848+0000","last_became_peered":"2024-04-25T09:04:09.433848+0000","last_unstale":"2024-04-25T09:04:11.453381+0000","last_undegraded":"2024-04-25T09:04:11.453381+0000","last_fullsized":"2024-04-25T09:04:11.453381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:23.622773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766744+0000","last_change":"2024-04-25T09:04:10.449393+0000","last_active":"2024-04-25T09:04:11.766744+0000","last_peered":"2024-04-25T09:04:11.766744+0000","last_clean":"2024-04-25T09:04:11.766744+0000","last_became_active":"2024-04-25T09:04:10.449096+0000","last_became_peered":"2024-04-25T09:04:10.449096+0000","last_unstale":"2024-04-25T09:04:11.766744+0000","last_undegraded":"2024-04-25T09:04:11.766744+0000","last_fullsized":"2024-04-25T09:04:11.766744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.022253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491405+0000","last_change":"2024-04-25T09:04:09.448660+0000","last_active":"2024-04-25T09:04:12.491405+0000","last_peered":"2024-04-25T09:04:12.491405+0000","last_clean":"2024-04-25T09:04:12.491405+0000","last_became_active":"2024-04-25T09:04:09.448294+0000","last_became_peered":"2024-04-25T09:04:09.448294+0000","last_unstale":"2024-04-25T09:04:12.491405+0000","last_undegraded":"2024-04-25T09:04:12.491405+0000","last_fullsized":"2024-04-25T09:04:12.491405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:11.557908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453289+0000","last_change":"2024-04-25T09:04:10.447970+0000","last_active":"2024-04-25T09:04:11.453289+0000","last_peered":"2024-04-25T09:04:11.453289+0000","last_clean":"2024-04-25T09:04:11.453289+0000","last_became_active":"2024-04-25T09:04:10.447382+0000","last_became_peered":"2024-04-25T09:04:10.447382+0000","last_unstale":"2024-04-25T09:04:11.453289+0000","last_undegraded":"2024-04-25T09:04:11.453289+0000","last_fullsized":"2024-04-25T09:04:11.453289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:06.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.977103+0000","last_change":"2024-04-25T09:04:10.467264+0000","last_active":"2024-04-25T09:04:12.977103+0000","last_peered":"2024-04-25T09:04:12.977103+0000","last_clean":"2024-04-25T09:04:12.977103+0000","last_became_active":"2024-04-25T09:04:10.466902+0000","last_became_peered":"2024-04-25T09:04:10.466902+0000","last_unstale":"2024-04-25T09:04:12.977103+0000","last_undegraded":"2024-04-25T09:04:12.977103+0000","last_fullsized":"2024-04-25T09:04:12.977103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:15.921248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491091+0000","last_change":"2024-04-25T09:04:09.451766+0000","last_active":"2024-04-25T09:04:12.491091+0000","last_peered":"2024-04-25T09:04:12.491091+0000","last_clean":"2024-04-25T09:04:12.491091+0000","last_became_active":"2024-04-25T09:04:09.451360+0000","last_became_peered":"2024-04-25T09:04:09.451360+0000","last_unstale":"2024-04-25T09:04:12.491091+0000","last_undegraded":"2024-04-25T09:04:12.491091+0000","last_fullsized":"2024-04-25T09:04:12.491091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:23.622773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976810+0000","last_change":"2024-04-25T09:04:10.467782+0000","last_active":"2024-04-25T09:04:12.976810+0000","last_peered":"2024-04-25T09:04:12.976810+0000","last_clean":"2024-04-25T09:04:12.976810+0000","last_became_active":"2024-04-25T09:04:10.467514+0000","last_became_peered":"2024-04-25T09:04:10.467514+0000","last_unstale":"2024-04-25T09:04:12.976810+0000","last_undegraded":"2024-04-25T09:04:12.976810+0000","last_fullsized":"2024-04-25T09:04:12.976810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:41.363774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491249+0000","last_change":"2024-04-25T09:04:09.451747+0000","last_active":"2024-04-25T09:04:12.491249+0000","last_peered":"2024-04-25T09:04:12.491249+0000","last_clean":"2024-04-25T09:04:12.491249+0000","last_became_active":"2024-04-25T09:04:09.451001+0000","last_became_peered":"2024-04-25T09:04:09.451001+0000","last_unstale":"2024-04-25T09:04:12.491249+0000","last_undegraded":"2024-04-25T09:04:12.491249+0000","last_fullsized":"2024-04-25T09:04:12.491249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.586105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467381+0000","last_change":"2024-04-25T09:04:10.451528+0000","last_active":"2024-04-25T09:04:13.467381+0000","last_peered":"2024-04-25T09:04:13.467381+0000","last_clean":"2024-04-25T09:04:13.467381+0000","last_became_active":"2024-04-25T09:04:10.451248+0000","last_became_peered":"2024-04-25T09:04:10.451248+0000","last_unstale":"2024-04-25T09:04:13.467381+0000","last_undegraded":"2024-04-25T09:04:13.467381+0000","last_fullsized":"2024-04-25T09:04:13.467381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:12.826732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766853+0000","last_change":"2024-04-25T09:04:09.447550+0000","last_active":"2024-04-25T09:04:11.766853+0000","last_peered":"2024-04-25T09:04:11.766853+0000","last_clean":"2024-04-25T09:04:11.766853+0000","last_became_active":"2024-04-25T09:04:09.447290+0000","last_became_peered":"2024-04-25T09:04:09.447290+0000","last_unstale":"2024-04-25T09:04:11.766853+0000","last_undegraded":"2024-04-25T09:04:11.766853+0000","last_fullsized":"2024-04-25T09:04:11.766853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:37.664377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766592+0000","last_change":"2024-04-25T09:04:10.448757+0000","last_active":"2024-04-25T09:04:11.766592+0000","last_peered":"2024-04-25T09:04:11.766592+0000","last_clean":"2024-04-25T09:04:11.766592+0000","last_became_active":"2024-04-25T09:04:10.448463+0000","last_became_peered":"2024-04-25T09:04:10.448463+0000","last_unstale":"2024-04-25T09:04:11.766592+0000","last_undegraded":"2024-04-25T09:04:11.766592+0000","last_fullsized":"2024-04-25T09:04:11.766592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:53.844663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467600+0000","last_change":"2024-04-25T09:04:09.446106+0000","last_active":"2024-04-25T09:04:13.467600+0000","last_peered":"2024-04-25T09:04:13.467600+0000","last_clean":"2024-04-25T09:04:13.467600+0000","last_became_active":"2024-04-25T09:04:09.445783+0000","last_became_peered":"2024-04-25T09:04:09.445783+0000","last_unstale":"2024-04-25T09:04:13.467600+0000","last_undegraded":"2024-04-25T09:04:13.467600+0000","last_fullsized":"2024-04-25T09:04:13.467600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:37.664377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:04:19.084 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:04:19.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.267+0000 7f42b9a00640 1 Processor -- start 2024-04-25T09:04:19.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.267+0000 7f42b9a00640 1 -- start start 2024-04-25T09:04:19.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.267+0000 7f42b9a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f42b40b1090 0x7f42b40b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.267+0000 7f42b9a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b40d01d0 con 0x7f42b406b0e0 2024-04-25T09:04:19.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.267+0000 7f42b9a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b40d0450 con 0x7f42b40b0c50 2024-04-25T09:04:19.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.267+0000 7f42b9a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b406bbd0 con 0x7f42b40b1090 2024-04-25T09:04:19.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.271+0000 7f42b2a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f42b406b0e0 0x7f42b406b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59334/0 (socket says 172.21.15.175:59334) 2024-04-25T09:04:19.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.271+0000 7f42b2a00640 1 -- 172.21.15.175:0/4290386279 learned_addr learned my addr 172.21.15.175:0/4290386279 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:19.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.271+0000 7f42b3400640 1 --2- 172.21.15.175:0/4290386279 >> v2:172.21.15.175:3300/0 conn(0x7f42b40b1090 0x7f42b40b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.271+0000 7f42b2000640 1 -- 172.21.15.175:0/4290386279 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357256431 0 0) 0x7f42a4001120 con 0x7f42b406b0e0 2024-04-25T09:04:19.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.271+0000 7f42b3400640 1 -- 172.21.15.175:0/4290386279 >> v1:172.21.15.177:6789/0 conn(0x7f42b40b0c50 legacy=0x7f42b40cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:19.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.271+0000 7f42b3400640 1 -- 172.21.15.175:0/4290386279 >> v1:172.21.15.175:6789/0 conn(0x7f42b406b0e0 legacy=0x7f42b406b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.271+0000 7f42b3400640 1 -- 172.21.15.175:0/4290386279 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b40afe90 con 0x7f42b40b1090 2024-04-25T09:04:19.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.271+0000 7f42b3400640 1 --2- 172.21.15.175:0/4290386279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42b40b1090 0x7f42b40b1610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009d90 tx=0x7f42ac01f120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e222dc7334fb953 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.271+0000 7f42b2000640 1 -- 172.21.15.175:0/4290386279 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac0b4070 con 0x7f42b40b1090 2024-04-25T09:04:19.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.271+0000 7f42b2000640 1 -- 172.21.15.175:0/4290386279 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac0af600 con 0x7f42b40b1090 2024-04-25T09:04:19.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.271+0000 7f42b2000640 1 -- 172.21.15.175:0/4290386279 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac0af9d0 con 0x7f42b40b1090 2024-04-25T09:04:19.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b9a00640 1 -- 172.21.15.175:0/4290386279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42b40b1090 msgr2=0x7f42b40b1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b9a00640 1 --2- 172.21.15.175:0/4290386279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42b40b1090 0x7f42b40b1610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009d90 tx=0x7f42ac01f120 comp rx=0 tx=0).stop 2024-04-25T09:04:19.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b9a00640 1 -- 172.21.15.175:0/4290386279 shutdown_connections 2024-04-25T09:04:19.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b9a00640 1 --2- 172.21.15.175:0/4290386279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42b40b1090 0x7f42b40b1610 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b9a00640 1 -- 172.21.15.175:0/4290386279 >> 172.21.15.175:0/4290386279 conn(0x7f42b40d06c0 msgr2=0x7f42b40d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b9a00640 1 -- 172.21.15.175:0/4290386279 shutdown_connections 2024-04-25T09:04:19.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b9a00640 1 -- 172.21.15.175:0/4290386279 wait complete. 2024-04-25T09:04:19.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b9a00640 1 Processor -- start 2024-04-25T09:04:19.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b9a00640 1 -- start start 2024-04-25T09:04:19.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b9a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42b406b0e0 0x7f42b41f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b9a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42b40b0c50 0x7f42b4150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b9a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42b40b1090 0x7f42b40af0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b9a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40b0450 con 0x7f42b40b1090 2024-04-25T09:04:19.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b9a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40b07c0 con 0x7f42b406b0e0 2024-04-25T09:04:19.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b9a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40b1b50 con 0x7f42b40b0c50 2024-04-25T09:04:19.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42b40b1090 0x7f42b40af0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42b40b1090 0x7f42b40af0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36818/0 (socket says 172.21.15.175:36818) 2024-04-25T09:04:19.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b3400640 1 -- 172.21.15.175:0/3425793836 learned_addr learned my addr 172.21.15.175:0/3425793836 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:19.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b2a00640 1 --2- 172.21.15.175:0/3425793836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42b406b0e0 0x7f42b41f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42aa000640 1 --2- 172.21.15.175:0/3425793836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42b40b0c50 0x7f42b4150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b3400640 1 -- 172.21.15.175:0/3425793836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42b40b0c50 msgr2=0x7f42b4150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b3400640 1 --2- 172.21.15.175:0/3425793836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42b40b0c50 0x7f42b4150270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b3400640 1 -- 172.21.15.175:0/3425793836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42b406b0e0 msgr2=0x7f42b41f77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b3400640 1 --2- 172.21.15.175:0/3425793836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42b406b0e0 0x7f42b41f77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.275+0000 7f42b3400640 1 -- 172.21.15.175:0/3425793836 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b41f7d10 con 0x7f42b40b1090 2024-04-25T09:04:19.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.279+0000 7f42b3400640 1 --2- 172.21.15.175:0/3425793836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42b40b1090 0x7f42b40af0e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0b2040 tx=0x7f42ac01bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.279+0000 7f42ab400640 1 -- 172.21.15.175:0/3425793836 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac0b4040 con 0x7f42b40b1090 2024-04-25T09:04:19.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.279+0000 7f42ab400640 1 -- 172.21.15.175:0/3425793836 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac0c2070 con 0x7f42b40b1090 2024-04-25T09:04:19.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.279+0000 7f42ab400640 1 -- 172.21.15.175:0/3425793836 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac0ba680 con 0x7f42b40b1090 2024-04-25T09:04:19.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.279+0000 7f42b9a00640 1 -- 172.21.15.175:0/3425793836 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b41507b0 con 0x7f42b40b1090 2024-04-25T09:04:19.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.279+0000 7f42b9a00640 1 -- 172.21.15.175:0/3425793836 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b41f8290 con 0x7f42b40b1090 2024-04-25T09:04:19.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.279+0000 7f42b9a00640 1 -- 172.21.15.175:0/3425793836 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b4074a60 con 0x7f42b40b1090 2024-04-25T09:04:19.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.279+0000 7f42ab400640 1 -- 172.21.15.175:0/3425793836 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f42ac0ba820 con 0x7f42b40b1090 2024-04-25T09:04:19.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.279+0000 7f42ab400640 1 --2- 172.21.15.175:0/3425793836 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4290066f90 0x7f4290069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.279+0000 7f42ab400640 1 -- 172.21.15.175:0/3425793836 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42ac123630 con 0x7f42b40b1090 2024-04-25T09:04:19.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.279+0000 7f42b2a00640 1 --2- 172.21.15.175:0/3425793836 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4290066f90 0x7f4290069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.283+0000 7f42b2a00640 1 --2- 172.21.15.175:0/3425793836 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4290066f90 0x7f4290069450 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f42a4000f70 tx=0x7f42a4007b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.283+0000 7f42ab400640 1 -- 172.21.15.175:0/3425793836 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f42ac018c80 con 0x7f42b40b1090 2024-04-25T09:04:19.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.435+0000 7f42b9a00640 1 -- 172.21.15.175:0/3425793836 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f42b4070bd0 con 0x7f4290066f90 2024-04-25T09:04:19.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.443+0000 7f42ab400640 1 -- 172.21.15.175:0/3425793836 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251872 (secure 0 0 0) 0x7f42b4070bd0 con 0x7f4290066f90 2024-04-25T09:04:19.437 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:19.438 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:04:19.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.447+0000 7f42b9a00640 1 -- 172.21.15.175:0/3425793836 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4290066f90 msgr2=0x7f4290069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.447+0000 7f42b9a00640 1 --2- 172.21.15.175:0/3425793836 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4290066f90 0x7f4290069450 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f42a4000f70 tx=0x7f42a4007b60 comp rx=0 tx=0).stop 2024-04-25T09:04:19.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.447+0000 7f42b9a00640 1 -- 172.21.15.175:0/3425793836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42b40b1090 msgr2=0x7f42b40af0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.447+0000 7f42b9a00640 1 --2- 172.21.15.175:0/3425793836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42b40b1090 0x7f42b40af0e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0b2040 tx=0x7f42ac01bec0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.447+0000 7f42b9a00640 1 -- 172.21.15.175:0/3425793836 shutdown_connections 2024-04-25T09:04:19.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.447+0000 7f42b9a00640 1 --2- 172.21.15.175:0/3425793836 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4290066f90 0x7f4290069450 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.447+0000 7f42b9a00640 1 --2- 172.21.15.175:0/3425793836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42b40b1090 0x7f42b40af0e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.447+0000 7f42b9a00640 1 --2- 172.21.15.175:0/3425793836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42b40b0c50 0x7f42b4150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.447+0000 7f42b9a00640 1 --2- 172.21.15.175:0/3425793836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42b406b0e0 0x7f42b41f77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.447+0000 7f42b9a00640 1 -- 172.21.15.175:0/3425793836 >> 172.21.15.175:0/3425793836 conn(0x7f42b40d06c0 msgr2=0x7f42b40ad990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.447+0000 7f42b9a00640 1 -- 172.21.15.175:0/3425793836 shutdown_connections 2024-04-25T09:04:19.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.447+0000 7f42b9a00640 1 -- 172.21.15.175:0/3425793836 wait complete. 2024-04-25T09:04:19.458 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-25T09:04:17.791510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219012,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001431"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491395+0000","last_change":"2024-04-25T09:04:10.462062+0000","last_active":"2024-04-25T09:04:12.491395+0000","last_peered":"2024-04-25T09:04:12.491395+0000","last_clean":"2024-04-25T09:04:12.491395+0000","last_became_active":"2024-04-25T09:04:10.461771+0000","last_became_peered":"2024-04-25T09:04:10.461771+0000","last_unstale":"2024-04-25T09:04:12.491395+0000","last_undegraded":"2024-04-25T09:04:12.491395+0000","last_fullsized":"2024-04-25T09:04:12.491395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:38.704801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453592+0000","last_change":"2024-04-25T09:04:10.454772+0000","last_active":"2024-04-25T09:04:11.453592+0000","last_peered":"2024-04-25T09:04:11.453592+0000","last_clean":"2024-04-25T09:04:11.453592+0000","last_became_active":"2024-04-25T09:04:10.454462+0000","last_became_peered":"2024-04-25T09:04:10.454462+0000","last_unstale":"2024-04-25T09:04:11.453592+0000","last_undegraded":"2024-04-25T09:04:11.453592+0000","last_fullsized":"2024-04-25T09:04:11.453592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:59.964799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467360+0000","last_change":"2024-04-25T09:04:10.455469+0000","last_active":"2024-04-25T09:04:13.467360+0000","last_peered":"2024-04-25T09:04:13.467360+0000","last_clean":"2024-04-25T09:04:13.467360+0000","last_became_active":"2024-04-25T09:04:10.455164+0000","last_became_peered":"2024-04-25T09:04:10.455164+0000","last_unstale":"2024-04-25T09:04:13.467360+0000","last_undegraded":"2024-04-25T09:04:13.467360+0000","last_fullsized":"2024-04-25T09:04:13.467360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:44.285991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976752+0000","last_change":"2024-04-25T09:04:10.468612+0000","last_active":"2024-04-25T09:04:12.976752+0000","last_peered":"2024-04-25T09:04:12.976752+0000","last_clean":"2024-04-25T09:04:12.976752+0000","last_became_active":"2024-04-25T09:04:10.468241+0000","last_became_peered":"2024-04-25T09:04:10.468241+0000","last_unstale":"2024-04-25T09:04:12.976752+0000","last_undegraded":"2024-04-25T09:04:12.976752+0000","last_fullsized":"2024-04-25T09:04:12.976752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:56.330375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491349+0000","last_change":"2024-04-25T09:04:10.460849+0000","last_active":"2024-04-25T09:04:12.491349+0000","last_peered":"2024-04-25T09:04:12.491349+0000","last_clean":"2024-04-25T09:04:12.491349+0000","last_became_active":"2024-04-25T09:04:10.460521+0000","last_became_peered":"2024-04-25T09:04:10.460521+0000","last_unstale":"2024-04-25T09:04:12.491349+0000","last_undegraded":"2024-04-25T09:04:12.491349+0000","last_fullsized":"2024-04-25T09:04:12.491349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:41.363774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976485+0000","last_change":"2024-04-25T09:04:10.452925+0000","last_active":"2024-04-25T09:04:12.976485+0000","last_peered":"2024-04-25T09:04:12.976485+0000","last_clean":"2024-04-25T09:04:12.976485+0000","last_became_active":"2024-04-25T09:04:10.450322+0000","last_became_peered":"2024-04-25T09:04:10.450322+0000","last_unstale":"2024-04-25T09:04:12.976485+0000","last_undegraded":"2024-04-25T09:04:12.976485+0000","last_fullsized":"2024-04-25T09:04:12.976485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.022253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.490891+0000","last_change":"2024-04-25T09:04:10.464505+0000","last_active":"2024-04-25T09:04:12.490891+0000","last_peered":"2024-04-25T09:04:12.490891+0000","last_clean":"2024-04-25T09:04:12.490891+0000","last_became_active":"2024-04-25T09:04:10.460449+0000","last_became_peered":"2024-04-25T09:04:10.460449+0000","last_unstale":"2024-04-25T09:04:12.490891+0000","last_undegraded":"2024-04-25T09:04:12.490891+0000","last_fullsized":"2024-04-25T09:04:12.490891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:53.844663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766242+0000","last_change":"2024-04-25T09:04:10.455495+0000","last_active":"2024-04-25T09:04:11.766242+0000","last_peered":"2024-04-25T09:04:11.766242+0000","last_clean":"2024-04-25T09:04:11.766242+0000","last_became_active":"2024-04-25T09:04:10.454824+0000","last_became_peered":"2024-04-25T09:04:10.454824+0000","last_unstale":"2024-04-25T09:04:11.766242+0000","last_undegraded":"2024-04-25T09:04:11.766242+0000","last_fullsized":"2024-04-25T09:04:11.766242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:06.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491385+0000","last_change":"2024-04-25T09:04:10.467947+0000","last_active":"2024-04-25T09:04:12.491385+0000","last_peered":"2024-04-25T09:04:12.491385+0000","last_clean":"2024-04-25T09:04:12.491385+0000","last_became_active":"2024-04-25T09:04:10.467620+0000","last_became_peered":"2024-04-25T09:04:10.467620+0000","last_unstale":"2024-04-25T09:04:12.491385+0000","last_undegraded":"2024-04-25T09:04:12.491385+0000","last_fullsized":"2024-04-25T09:04:12.491385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:38.966776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454350+0000","last_change":"2024-04-25T09:04:10.456157+0000","last_active":"2024-04-25T09:04:11.454350+0000","last_peered":"2024-04-25T09:04:11.454350+0000","last_clean":"2024-04-25T09:04:11.454350+0000","last_became_active":"2024-04-25T09:04:10.455814+0000","last_became_peered":"2024-04-25T09:04:10.455814+0000","last_unstale":"2024-04-25T09:04:11.454350+0000","last_undegraded":"2024-04-25T09:04:11.454350+0000","last_fullsized":"2024-04-25T09:04:11.454350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:10.572493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454102+0000","last_change":"2024-04-25T09:04:10.453100+0000","last_active":"2024-04-25T09:04:11.454102+0000","last_peered":"2024-04-25T09:04:11.454102+0000","last_clean":"2024-04-25T09:04:11.454102+0000","last_became_active":"2024-04-25T09:04:10.452835+0000","last_became_peered":"2024-04-25T09:04:10.452835+0000","last_unstale":"2024-04-25T09:04:11.454102+0000","last_undegraded":"2024-04-25T09:04:11.454102+0000","last_fullsized":"2024-04-25T09:04:11.454102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:03.161885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453763+0000","last_change":"2024-04-25T09:04:10.454612+0000","last_active":"2024-04-25T09:04:11.453763+0000","last_peered":"2024-04-25T09:04:11.453763+0000","last_clean":"2024-04-25T09:04:11.453763+0000","last_became_active":"2024-04-25T09:04:10.449834+0000","last_became_peered":"2024-04-25T09:04:10.449834+0000","last_unstale":"2024-04-25T09:04:11.453763+0000","last_undegraded":"2024-04-25T09:04:11.453763+0000","last_fullsized":"2024-04-25T09:04:11.453763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:33.347350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766581+0000","last_change":"2024-04-25T09:04:10.449404+0000","last_active":"2024-04-25T09:04:11.766581+0000","last_peered":"2024-04-25T09:04:11.766581+0000","last_clean":"2024-04-25T09:04:11.766581+0000","last_became_active":"2024-04-25T09:04:10.449123+0000","last_became_peered":"2024-04-25T09:04:10.449123+0000","last_unstale":"2024-04-25T09:04:11.766581+0000","last_undegraded":"2024-04-25T09:04:11.766581+0000","last_fullsized":"2024-04-25T09:04:11.766581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:59.964799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467147+0000","last_change":"2024-04-25T09:04:10.448367+0000","last_active":"2024-04-25T09:04:13.467147+0000","last_peered":"2024-04-25T09:04:13.467147+0000","last_clean":"2024-04-25T09:04:13.467147+0000","last_became_active":"2024-04-25T09:04:10.448103+0000","last_became_peered":"2024-04-25T09:04:10.448103+0000","last_unstale":"2024-04-25T09:04:13.467147+0000","last_undegraded":"2024-04-25T09:04:13.467147+0000","last_fullsized":"2024-04-25T09:04:13.467147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:21.063821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453172+0000","last_change":"2024-04-25T09:04:10.461500+0000","last_active":"2024-04-25T09:04:11.453172+0000","last_peered":"2024-04-25T09:04:11.453172+0000","last_clean":"2024-04-25T09:04:11.453172+0000","last_became_active":"2024-04-25T09:04:10.461218+0000","last_became_peered":"2024-04-25T09:04:10.461218+0000","last_unstale":"2024-04-25T09:04:11.453172+0000","last_undegraded":"2024-04-25T09:04:11.453172+0000","last_fullsized":"2024-04-25T09:04:11.453172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:06.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976416+0000","last_change":"2024-04-25T09:04:10.465078+0000","last_active":"2024-04-25T09:04:12.976416+0000","last_peered":"2024-04-25T09:04:12.976416+0000","last_clean":"2024-04-25T09:04:12.976416+0000","last_became_active":"2024-04-25T09:04:10.464292+0000","last_became_peered":"2024-04-25T09:04:10.464292+0000","last_unstale":"2024-04-25T09:04:12.976416+0000","last_undegraded":"2024-04-25T09:04:12.976416+0000","last_fullsized":"2024-04-25T09:04:12.976416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:53.844663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.977294+0000","last_change":"2024-04-25T09:04:10.465873+0000","last_active":"2024-04-25T09:04:12.977294+0000","last_peered":"2024-04-25T09:04:12.977294+0000","last_clean":"2024-04-25T09:04:12.977294+0000","last_became_active":"2024-04-25T09:04:10.465139+0000","last_became_peered":"2024-04-25T09:04:10.465139+0000","last_unstale":"2024-04-25T09:04:12.977294+0000","last_undegraded":"2024-04-25T09:04:12.977294+0000","last_fullsized":"2024-04-25T09:04:12.977294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:30.123868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437157+0000","last_change":"2024-04-25T09:04:10.457277+0000","last_active":"2024-04-25T09:04:12.437157+0000","last_peered":"2024-04-25T09:04:12.437157+0000","last_clean":"2024-04-25T09:04:12.437157+0000","last_became_active":"2024-04-25T09:04:10.456983+0000","last_became_peered":"2024-04-25T09:04:10.456983+0000","last_unstale":"2024-04-25T09:04:12.437157+0000","last_undegraded":"2024-04-25T09:04:12.437157+0000","last_fullsized":"2024-04-25T09:04:12.437157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:17.359486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491405+0000","last_change":"2024-04-25T09:04:10.467087+0000","last_active":"2024-04-25T09:04:12.491405+0000","last_peered":"2024-04-25T09:04:12.491405+0000","last_clean":"2024-04-25T09:04:12.491405+0000","last_became_active":"2024-04-25T09:04:10.466783+0000","last_became_peered":"2024-04-25T09:04:10.466783+0000","last_unstale":"2024-04-25T09:04:12.491405+0000","last_undegraded":"2024-04-25T09:04:12.491405+0000","last_fullsized":"2024-04-25T09:04:12.491405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:15.921248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453460+0000","last_change":"2024-04-25T09:04:10.458537+0000","last_active":"2024-04-25T09:04:11.453460+0000","last_peered":"2024-04-25T09:04:11.453460+0000","last_clean":"2024-04-25T09:04:11.453460+0000","last_became_active":"2024-04-25T09:04:10.458180+0000","last_became_peered":"2024-04-25T09:04:10.458180+0000","last_unstale":"2024-04-25T09:04:11.453460+0000","last_undegraded":"2024-04-25T09:04:11.453460+0000","last_fullsized":"2024-04-25T09:04:11.453460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:47.704816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467481+0000","last_change":"2024-04-25T09:04:10.458711+0000","last_active":"2024-04-25T09:04:13.467481+0000","last_peered":"2024-04-25T09:04:13.467481+0000","last_clean":"2024-04-25T09:04:13.467481+0000","last_became_active":"2024-04-25T09:04:10.458450+0000","last_became_peered":"2024-04-25T09:04:10.458450+0000","last_unstale":"2024-04-25T09:04:13.467481+0000","last_undegraded":"2024-04-25T09:04:13.467481+0000","last_fullsized":"2024-04-25T09:04:13.467481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:47.704816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976582+0000","last_change":"2024-04-25T09:04:10.455142+0000","last_active":"2024-04-25T09:04:12.976582+0000","last_peered":"2024-04-25T09:04:12.976582+0000","last_clean":"2024-04-25T09:04:12.976582+0000","last_became_active":"2024-04-25T09:04:10.454776+0000","last_became_peered":"2024-04-25T09:04:10.454776+0000","last_unstale":"2024-04-25T09:04:12.976582+0000","last_undegraded":"2024-04-25T09:04:12.976582+0000","last_fullsized":"2024-04-25T09:04:12.976582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:59.917069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766510+0000","last_change":"2024-04-25T09:04:10.462091+0000","last_active":"2024-04-25T09:04:11.766510+0000","last_peered":"2024-04-25T09:04:11.766510+0000","last_clean":"2024-04-25T09:04:11.766510+0000","last_became_active":"2024-04-25T09:04:10.460956+0000","last_became_peered":"2024-04-25T09:04:10.460956+0000","last_unstale":"2024-04-25T09:04:11.766510+0000","last_undegraded":"2024-04-25T09:04:11.766510+0000","last_fullsized":"2024-04-25T09:04:11.766510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:03.161885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976550+0000","last_change":"2024-04-25T09:04:10.456817+0000","last_active":"2024-04-25T09:04:12.976550+0000","last_peered":"2024-04-25T09:04:12.976550+0000","last_clean":"2024-04-25T09:04:12.976550+0000","last_became_active":"2024-04-25T09:04:10.456515+0000","last_became_peered":"2024-04-25T09:04:10.456515+0000","last_unstale":"2024-04-25T09:04:12.976550+0000","last_undegraded":"2024-04-25T09:04:12.976550+0000","last_fullsized":"2024-04-25T09:04:12.976550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:25.970653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766945+0000","last_change":"2024-04-25T09:04:10.467130+0000","last_active":"2024-04-25T09:04:11.766945+0000","last_peered":"2024-04-25T09:04:11.766945+0000","last_clean":"2024-04-25T09:04:11.766945+0000","last_became_active":"2024-04-25T09:04:10.466843+0000","last_became_peered":"2024-04-25T09:04:10.466843+0000","last_unstale":"2024-04-25T09:04:11.766945+0000","last_undegraded":"2024-04-25T09:04:11.766945+0000","last_fullsized":"2024-04-25T09:04:11.766945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:38.453486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454457+0000","last_change":"2024-04-25T09:04:10.461159+0000","last_active":"2024-04-25T09:04:11.454457+0000","last_peered":"2024-04-25T09:04:11.454457+0000","last_clean":"2024-04-25T09:04:11.454457+0000","last_became_active":"2024-04-25T09:04:10.460871+0000","last_became_peered":"2024-04-25T09:04:10.460871+0000","last_unstale":"2024-04-25T09:04:11.454457+0000","last_undegraded":"2024-04-25T09:04:11.454457+0000","last_fullsized":"2024-04-25T09:04:11.454457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:59.964799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453551+0000","last_change":"2024-04-25T09:04:10.462566+0000","last_active":"2024-04-25T09:04:11.453551+0000","last_peered":"2024-04-25T09:04:11.453551+0000","last_clean":"2024-04-25T09:04:11.453551+0000","last_became_active":"2024-04-25T09:04:10.461856+0000","last_became_peered":"2024-04-25T09:04:10.461856+0000","last_unstale":"2024-04-25T09:04:11.453551+0000","last_undegraded":"2024-04-25T09:04:11.453551+0000","last_fullsized":"2024-04-25T09:04:11.453551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:10.572493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766880+0000","last_change":"2024-04-25T09:04:10.461850+0000","last_active":"2024-04-25T09:04:11.766880+0000","last_peered":"2024-04-25T09:04:11.766880+0000","last_clean":"2024-04-25T09:04:11.766880+0000","last_became_active":"2024-04-25T09:04:10.460707+0000","last_became_peered":"2024-04-25T09:04:10.460707+0000","last_unstale":"2024-04-25T09:04:11.766880+0000","last_undegraded":"2024-04-25T09:04:11.766880+0000","last_fullsized":"2024-04-25T09:04:11.766880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:25.970653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467386+0000","last_change":"2024-04-25T09:04:10.464541+0000","last_active":"2024-04-25T09:04:13.467386+0000","last_peered":"2024-04-25T09:04:13.467386+0000","last_clean":"2024-04-25T09:04:13.467386+0000","last_became_active":"2024-04-25T09:04:10.464252+0000","last_became_peered":"2024-04-25T09:04:10.464252+0000","last_unstale":"2024-04-25T09:04:13.467386+0000","last_undegraded":"2024-04-25T09:04:13.467386+0000","last_fullsized":"2024-04-25T09:04:13.467386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:06.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976682+0000","last_change":"2024-04-25T09:04:10.465260+0000","last_active":"2024-04-25T09:04:12.976682+0000","last_peered":"2024-04-25T09:04:12.976682+0000","last_clean":"2024-04-25T09:04:12.976682+0000","last_became_active":"2024-04-25T09:04:10.464698+0000","last_became_peered":"2024-04-25T09:04:10.464698+0000","last_unstale":"2024-04-25T09:04:12.976682+0000","last_undegraded":"2024-04-25T09:04:12.976682+0000","last_fullsized":"2024-04-25T09:04:12.976682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:38.453486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437050+0000","last_change":"2024-04-25T09:04:10.455699+0000","last_active":"2024-04-25T09:04:12.437050+0000","last_peered":"2024-04-25T09:04:12.437050+0000","last_clean":"2024-04-25T09:04:12.437050+0000","last_became_active":"2024-04-25T09:04:10.455417+0000","last_became_peered":"2024-04-25T09:04:10.455417+0000","last_unstale":"2024-04-25T09:04:12.437050+0000","last_undegraded":"2024-04-25T09:04:12.437050+0000","last_fullsized":"2024-04-25T09:04:12.437050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.228938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453241+0000","last_change":"2024-04-25T09:04:10.451620+0000","last_active":"2024-04-25T09:04:11.453241+0000","last_peered":"2024-04-25T09:04:11.453241+0000","last_clean":"2024-04-25T09:04:11.453241+0000","last_became_active":"2024-04-25T09:04:10.451273+0000","last_became_peered":"2024-04-25T09:04:10.451273+0000","last_unstale":"2024-04-25T09:04:11.453241+0000","last_undegraded":"2024-04-25T09:04:11.453241+0000","last_fullsized":"2024-04-25T09:04:11.453241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:12.826732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453920+0000","last_change":"2024-04-25T09:04:10.449559+0000","last_active":"2024-04-25T09:04:11.453920+0000","last_peered":"2024-04-25T09:04:11.453920+0000","last_clean":"2024-04-25T09:04:11.453920+0000","last_became_active":"2024-04-25T09:04:10.448300+0000","last_became_peered":"2024-04-25T09:04:10.448300+0000","last_unstale":"2024-04-25T09:04:11.453920+0000","last_undegraded":"2024-04-25T09:04:11.453920+0000","last_fullsized":"2024-04-25T09:04:11.453920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:46.591632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766688+0000","last_change":"2024-04-25T09:04:09.443692+0000","last_active":"2024-04-25T09:04:11.766688+0000","last_peered":"2024-04-25T09:04:11.766688+0000","last_clean":"2024-04-25T09:04:11.766688+0000","last_became_active":"2024-04-25T09:04:09.443223+0000","last_became_peered":"2024-04-25T09:04:09.443223+0000","last_unstale":"2024-04-25T09:04:11.766688+0000","last_undegraded":"2024-04-25T09:04:11.766688+0000","last_fullsized":"2024-04-25T09:04:11.766688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:52.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467575+0000","last_change":"2024-04-25T09:04:10.445977+0000","last_active":"2024-04-25T09:04:13.467575+0000","last_peered":"2024-04-25T09:04:13.467575+0000","last_clean":"2024-04-25T09:04:13.467575+0000","last_became_active":"2024-04-25T09:04:10.445685+0000","last_became_peered":"2024-04-25T09:04:10.445685+0000","last_unstale":"2024-04-25T09:04:13.467575+0000","last_undegraded":"2024-04-25T09:04:13.467575+0000","last_fullsized":"2024-04-25T09:04:13.467575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:59.964799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453359+0000","last_change":"2024-04-25T09:04:09.428583+0000","last_active":"2024-04-25T09:04:11.453359+0000","last_peered":"2024-04-25T09:04:11.453359+0000","last_clean":"2024-04-25T09:04:11.453359+0000","last_became_active":"2024-04-25T09:04:09.428043+0000","last_became_peered":"2024-04-25T09:04:09.428043+0000","last_unstale":"2024-04-25T09:04:11.453359+0000","last_undegraded":"2024-04-25T09:04:11.453359+0000","last_fullsized":"2024-04-25T09:04:11.453359+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766378+0000","last_change":"2024-04-25T09:04:09.440384+0000","last_active":"2024-04-25T09:04:11.766378+0000","last_peered":"2024-04-25T09:04:11.766378+0000","last_clean":"2024-04-25T09:04:11.766378+0000","last_became_active":"2024-04-25T09:04:09.439952+0000","last_became_peered":"2024-04-25T09:04:09.439952+0000","last_unstale":"2024-04-25T09:04:11.766378+0000","last_undegraded":"2024-04-25T09:04:11.766378+0000","last_fullsized":"2024-04-25T09:04:11.766378+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:59.824337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766347+0000","last_change":"2024-04-25T09:04:10.455692+0000","last_active":"2024-04-25T09:04:11.766347+0000","last_peered":"2024-04-25T09:04:11.766347+0000","last_clean":"2024-04-25T09:04:11.766347+0000","last_became_active":"2024-04-25T09:04:10.455212+0000","last_became_peered":"2024-04-25T09:04:10.455212+0000","last_unstale":"2024-04-25T09:04:11.766347+0000","last_undegraded":"2024-04-25T09:04:11.766347+0000","last_fullsized":"2024-04-25T09:04:11.766347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:47.704816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976560+0000","last_change":"2024-04-25T09:04:09.438700+0000","last_active":"2024-04-25T09:04:12.976560+0000","last_peered":"2024-04-25T09:04:12.976560+0000","last_clean":"2024-04-25T09:04:12.976560+0000","last_became_active":"2024-04-25T09:04:09.438424+0000","last_became_peered":"2024-04-25T09:04:09.438424+0000","last_unstale":"2024-04-25T09:04:12.976560+0000","last_undegraded":"2024-04-25T09:04:12.976560+0000","last_fullsized":"2024-04-25T09:04:12.976560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:52.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453190+0000","last_change":"2024-04-25T09:04:10.455298+0000","last_active":"2024-04-25T09:04:11.453190+0000","last_peered":"2024-04-25T09:04:11.453190+0000","last_clean":"2024-04-25T09:04:11.453190+0000","last_became_active":"2024-04-25T09:04:10.455044+0000","last_became_peered":"2024-04-25T09:04:10.455044+0000","last_unstale":"2024-04-25T09:04:11.453190+0000","last_undegraded":"2024-04-25T09:04:11.453190+0000","last_fullsized":"2024-04-25T09:04:11.453190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:47.704816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454284+0000","last_change":"2024-04-25T09:04:09.441197+0000","last_active":"2024-04-25T09:04:11.454284+0000","last_peered":"2024-04-25T09:04:11.454284+0000","last_clean":"2024-04-25T09:04:11.454284+0000","last_became_active":"2024-04-25T09:04:09.440752+0000","last_became_peered":"2024-04-25T09:04:09.440752+0000","last_unstale":"2024-04-25T09:04:11.454284+0000","last_undegraded":"2024-04-25T09:04:11.454284+0000","last_fullsized":"2024-04-25T09:04:11.454284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:52.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.977125+0000","last_change":"2024-04-25T09:04:10.466060+0000","last_active":"2024-04-25T09:04:12.977125+0000","last_peered":"2024-04-25T09:04:12.977125+0000","last_clean":"2024-04-25T09:04:12.977125+0000","last_became_active":"2024-04-25T09:04:10.465550+0000","last_became_peered":"2024-04-25T09:04:10.465550+0000","last_unstale":"2024-04-25T09:04:12.977125+0000","last_undegraded":"2024-04-25T09:04:12.977125+0000","last_fullsized":"2024-04-25T09:04:12.977125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:08.225883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.977181+0000","last_change":"2024-04-25T09:04:09.444181+0000","last_active":"2024-04-25T09:04:12.977181+0000","last_peered":"2024-04-25T09:04:12.977181+0000","last_clean":"2024-04-25T09:04:12.977181+0000","last_became_active":"2024-04-25T09:04:09.443601+0000","last_became_peered":"2024-04-25T09:04:09.443601+0000","last_unstale":"2024-04-25T09:04:12.977181+0000","last_undegraded":"2024-04-25T09:04:12.977181+0000","last_fullsized":"2024-04-25T09:04:12.977181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:23.622773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467492+0000","last_change":"2024-04-25T09:04:10.451240+0000","last_active":"2024-04-25T09:04:13.467492+0000","last_peered":"2024-04-25T09:04:13.467492+0000","last_clean":"2024-04-25T09:04:13.467492+0000","last_became_active":"2024-04-25T09:04:10.451065+0000","last_became_peered":"2024-04-25T09:04:10.451065+0000","last_unstale":"2024-04-25T09:04:13.467492+0000","last_undegraded":"2024-04-25T09:04:13.467492+0000","last_fullsized":"2024-04-25T09:04:13.467492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:03.161885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453491+0000","last_change":"2024-04-25T09:04:09.441559+0000","last_active":"2024-04-25T09:04:11.453491+0000","last_peered":"2024-04-25T09:04:11.453491+0000","last_clean":"2024-04-25T09:04:11.453491+0000","last_became_active":"2024-04-25T09:04:09.441288+0000","last_became_peered":"2024-04-25T09:04:09.441288+0000","last_unstale":"2024-04-25T09:04:11.453491+0000","last_undegraded":"2024-04-25T09:04:11.453491+0000","last_fullsized":"2024-04-25T09:04:11.453491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454256+0000","last_change":"2024-04-25T09:04:10.460810+0000","last_active":"2024-04-25T09:04:11.454256+0000","last_peered":"2024-04-25T09:04:11.454256+0000","last_clean":"2024-04-25T09:04:11.454256+0000","last_became_active":"2024-04-25T09:04:10.458726+0000","last_became_peered":"2024-04-25T09:04:10.458726+0000","last_unstale":"2024-04-25T09:04:11.454256+0000","last_undegraded":"2024-04-25T09:04:11.454256+0000","last_fullsized":"2024-04-25T09:04:11.454256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:07.228938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453432+0000","last_change":"2024-04-25T09:04:09.436321+0000","last_active":"2024-04-25T09:04:11.453432+0000","last_peered":"2024-04-25T09:04:11.453432+0000","last_clean":"2024-04-25T09:04:11.453432+0000","last_became_active":"2024-04-25T09:04:09.435708+0000","last_became_peered":"2024-04-25T09:04:09.435708+0000","last_unstale":"2024-04-25T09:04:11.453432+0000","last_undegraded":"2024-04-25T09:04:11.453432+0000","last_fullsized":"2024-04-25T09:04:11.453432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:23.622773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491036+0000","last_change":"2024-04-25T09:04:10.469991+0000","last_active":"2024-04-25T09:04:12.491036+0000","last_peered":"2024-04-25T09:04:12.491036+0000","last_clean":"2024-04-25T09:04:12.491036+0000","last_became_active":"2024-04-25T09:04:10.469673+0000","last_became_peered":"2024-04-25T09:04:10.469673+0000","last_unstale":"2024-04-25T09:04:12.491036+0000","last_undegraded":"2024-04-25T09:04:12.491036+0000","last_fullsized":"2024-04-25T09:04:12.491036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:25.970653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467600+0000","last_change":"2024-04-25T09:04:09.445342+0000","last_active":"2024-04-25T09:04:13.467600+0000","last_peered":"2024-04-25T09:04:13.467600+0000","last_clean":"2024-04-25T09:04:13.467600+0000","last_became_active":"2024-04-25T09:04:09.445036+0000","last_became_peered":"2024-04-25T09:04:09.445036+0000","last_unstale":"2024-04-25T09:04:13.467600+0000","last_undegraded":"2024-04-25T09:04:13.467600+0000","last_fullsized":"2024-04-25T09:04:13.467600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:42.962745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467486+0000","last_change":"2024-04-25T09:04:10.460039+0000","last_active":"2024-04-25T09:04:13.467486+0000","last_peered":"2024-04-25T09:04:13.467486+0000","last_clean":"2024-04-25T09:04:13.467486+0000","last_became_active":"2024-04-25T09:04:10.459802+0000","last_became_peered":"2024-04-25T09:04:10.459802+0000","last_unstale":"2024-04-25T09:04:13.467486+0000","last_undegraded":"2024-04-25T09:04:13.467486+0000","last_fullsized":"2024-04-25T09:04:13.467486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:36.421524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976673+0000","last_change":"2024-04-25T09:04:09.448990+0000","last_active":"2024-04-25T09:04:12.976673+0000","last_peered":"2024-04-25T09:04:12.976673+0000","last_clean":"2024-04-25T09:04:12.976673+0000","last_became_active":"2024-04-25T09:04:09.447328+0000","last_became_peered":"2024-04-25T09:04:09.447328+0000","last_unstale":"2024-04-25T09:04:12.976673+0000","last_undegraded":"2024-04-25T09:04:12.976673+0000","last_fullsized":"2024-04-25T09:04:12.976673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491268+0000","last_change":"2024-04-25T09:04:10.470501+0000","last_active":"2024-04-25T09:04:12.491268+0000","last_peered":"2024-04-25T09:04:12.491268+0000","last_clean":"2024-04-25T09:04:12.491268+0000","last_became_active":"2024-04-25T09:04:10.470149+0000","last_became_peered":"2024-04-25T09:04:10.470149+0000","last_unstale":"2024-04-25T09:04:12.491268+0000","last_undegraded":"2024-04-25T09:04:12.491268+0000","last_fullsized":"2024-04-25T09:04:12.491268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:38.453486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453361+0000","last_change":"2024-04-25T09:04:09.428421+0000","last_active":"2024-04-25T09:04:11.453361+0000","last_peered":"2024-04-25T09:04:11.453361+0000","last_clean":"2024-04-25T09:04:11.453361+0000","last_became_active":"2024-04-25T09:04:09.428088+0000","last_became_peered":"2024-04-25T09:04:09.428088+0000","last_unstale":"2024-04-25T09:04:11.453361+0000","last_undegraded":"2024-04-25T09:04:11.453361+0000","last_fullsized":"2024-04-25T09:04:11.453361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:11.557908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454070+0000","last_change":"2024-04-25T09:04:10.452284+0000","last_active":"2024-04-25T09:04:11.454070+0000","last_peered":"2024-04-25T09:04:11.454070+0000","last_clean":"2024-04-25T09:04:11.454070+0000","last_became_active":"2024-04-25T09:04:10.451470+0000","last_became_peered":"2024-04-25T09:04:10.451470+0000","last_unstale":"2024-04-25T09:04:11.454070+0000","last_undegraded":"2024-04-25T09:04:11.454070+0000","last_fullsized":"2024-04-25T09:04:11.454070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:36.421524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437004+0000","last_change":"2024-04-25T09:04:09.437062+0000","last_active":"2024-04-25T09:04:12.437004+0000","last_peered":"2024-04-25T09:04:12.437004+0000","last_clean":"2024-04-25T09:04:12.437004+0000","last_became_active":"2024-04-25T09:04:09.436793+0000","last_became_peered":"2024-04-25T09:04:09.436793+0000","last_unstale":"2024-04-25T09:04:12.437004+0000","last_undegraded":"2024-04-25T09:04:12.437004+0000","last_fullsized":"2024-04-25T09:04:12.437004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.490890+0000","last_change":"2024-04-25T09:04:10.462986+0000","last_active":"2024-04-25T09:04:12.490890+0000","last_peered":"2024-04-25T09:04:12.490890+0000","last_clean":"2024-04-25T09:04:12.490890+0000","last_became_active":"2024-04-25T09:04:10.462639+0000","last_became_peered":"2024-04-25T09:04:10.462639+0000","last_unstale":"2024-04-25T09:04:12.490890+0000","last_undegraded":"2024-04-25T09:04:12.490890+0000","last_fullsized":"2024-04-25T09:04:12.490890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.022253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454237+0000","last_change":"2024-04-25T09:04:09.435053+0000","last_active":"2024-04-25T09:04:11.454237+0000","last_peered":"2024-04-25T09:04:11.454237+0000","last_clean":"2024-04-25T09:04:11.454237+0000","last_became_active":"2024-04-25T09:04:09.434661+0000","last_became_peered":"2024-04-25T09:04:09.434661+0000","last_unstale":"2024-04-25T09:04:11.454237+0000","last_undegraded":"2024-04-25T09:04:11.454237+0000","last_fullsized":"2024-04-25T09:04:11.454237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:14:50.779717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491308+0000","last_change":"2024-04-25T09:04:10.472088+0000","last_active":"2024-04-25T09:04:12.491308+0000","last_peered":"2024-04-25T09:04:12.491308+0000","last_clean":"2024-04-25T09:04:12.491308+0000","last_became_active":"2024-04-25T09:04:10.471765+0000","last_became_peered":"2024-04-25T09:04:10.471765+0000","last_unstale":"2024-04-25T09:04:12.491308+0000","last_undegraded":"2024-04-25T09:04:12.491308+0000","last_fullsized":"2024-04-25T09:04:12.491308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:56.330375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437211+0000","last_change":"2024-04-25T09:04:09.444431+0000","last_active":"2024-04-25T09:04:12.437211+0000","last_peered":"2024-04-25T09:04:12.437211+0000","last_clean":"2024-04-25T09:04:12.437211+0000","last_became_active":"2024-04-25T09:04:09.444192+0000","last_became_peered":"2024-04-25T09:04:09.444192+0000","last_unstale":"2024-04-25T09:04:12.437211+0000","last_undegraded":"2024-04-25T09:04:12.437211+0000","last_fullsized":"2024-04-25T09:04:12.437211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491563+0000","last_change":"2024-04-25T09:04:10.472130+0000","last_active":"2024-04-25T09:04:12.491563+0000","last_peered":"2024-04-25T09:04:12.491563+0000","last_clean":"2024-04-25T09:04:12.491563+0000","last_became_active":"2024-04-25T09:04:10.471819+0000","last_became_peered":"2024-04-25T09:04:10.471819+0000","last_unstale":"2024-04-25T09:04:12.491563+0000","last_undegraded":"2024-04-25T09:04:12.491563+0000","last_fullsized":"2024-04-25T09:04:12.491563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:08.225883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453585+0000","last_change":"2024-04-25T09:04:09.435777+0000","last_active":"2024-04-25T09:04:11.453585+0000","last_peered":"2024-04-25T09:04:11.453585+0000","last_clean":"2024-04-25T09:04:11.453585+0000","last_became_active":"2024-04-25T09:04:09.433156+0000","last_became_peered":"2024-04-25T09:04:09.433156+0000","last_unstale":"2024-04-25T09:04:11.453585+0000","last_undegraded":"2024-04-25T09:04:11.453585+0000","last_fullsized":"2024-04-25T09:04:11.453585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:11.557908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.977006+0000","last_change":"2024-04-25T09:04:10.467199+0000","last_active":"2024-04-25T09:04:12.977006+0000","last_peered":"2024-04-25T09:04:12.977006+0000","last_clean":"2024-04-25T09:04:12.977006+0000","last_became_active":"2024-04-25T09:04:10.466426+0000","last_became_peered":"2024-04-25T09:04:10.466426+0000","last_unstale":"2024-04-25T09:04:12.977006+0000","last_undegraded":"2024-04-25T09:04:12.977006+0000","last_fullsized":"2024-04-25T09:04:12.977006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:38.966776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437060+0000","last_change":"2024-04-25T09:04:09.438805+0000","last_active":"2024-04-25T09:04:12.437060+0000","last_peered":"2024-04-25T09:04:12.437060+0000","last_clean":"2024-04-25T09:04:12.437060+0000","last_became_active":"2024-04-25T09:04:09.438519+0000","last_became_peered":"2024-04-25T09:04:09.438519+0000","last_unstale":"2024-04-25T09:04:12.437060+0000","last_undegraded":"2024-04-25T09:04:12.437060+0000","last_fullsized":"2024-04-25T09:04:12.437060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:52.467495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491190+0000","last_change":"2024-04-25T09:04:10.467799+0000","last_active":"2024-04-25T09:04:12.491190+0000","last_peered":"2024-04-25T09:04:12.491190+0000","last_clean":"2024-04-25T09:04:12.491190+0000","last_became_active":"2024-04-25T09:04:10.467524+0000","last_became_peered":"2024-04-25T09:04:10.467524+0000","last_unstale":"2024-04-25T09:04:12.491190+0000","last_undegraded":"2024-04-25T09:04:12.491190+0000","last_fullsized":"2024-04-25T09:04:12.491190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:59.917069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.490943+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:04:12.490943+0000","last_peered":"2024-04-25T09:04:12.490943+0000","last_clean":"2024-04-25T09:04:12.490943+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:04:12.490943+0000","last_undegraded":"2024-04-25T09:04:12.490943+0000","last_fullsized":"2024-04-25T09:04:12.490943+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976528+0000","last_change":"2024-04-25T09:04:09.443155+0000","last_active":"2024-04-25T09:04:12.976528+0000","last_peered":"2024-04-25T09:04:12.976528+0000","last_clean":"2024-04-25T09:04:12.976528+0000","last_became_active":"2024-04-25T09:04:09.441937+0000","last_became_peered":"2024-04-25T09:04:09.441937+0000","last_unstale":"2024-04-25T09:04:12.976528+0000","last_undegraded":"2024-04-25T09:04:12.976528+0000","last_fullsized":"2024-04-25T09:04:12.976528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766523+0000","last_change":"2024-04-25T09:04:10.455462+0000","last_active":"2024-04-25T09:04:11.766523+0000","last_peered":"2024-04-25T09:04:11.766523+0000","last_clean":"2024-04-25T09:04:11.766523+0000","last_became_active":"2024-04-25T09:04:10.455118+0000","last_became_peered":"2024-04-25T09:04:10.455118+0000","last_unstale":"2024-04-25T09:04:11.766523+0000","last_undegraded":"2024-04-25T09:04:11.766523+0000","last_fullsized":"2024-04-25T09:04:11.766523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:10.572493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.490794+0000","last_change":"2024-04-25T09:04:09.446062+0000","last_active":"2024-04-25T09:04:12.490794+0000","last_peered":"2024-04-25T09:04:12.490794+0000","last_clean":"2024-04-25T09:04:12.490794+0000","last_became_active":"2024-04-25T09:04:09.445786+0000","last_became_peered":"2024-04-25T09:04:09.445786+0000","last_unstale":"2024-04-25T09:04:12.490794+0000","last_undegraded":"2024-04-25T09:04:12.490794+0000","last_fullsized":"2024-04-25T09:04:12.490794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:32.341824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467096+0000","last_change":"2024-04-25T09:04:10.444069+0000","last_active":"2024-04-25T09:04:13.467096+0000","last_peered":"2024-04-25T09:04:13.467096+0000","last_clean":"2024-04-25T09:04:13.467096+0000","last_became_active":"2024-04-25T09:04:10.443785+0000","last_became_peered":"2024-04-25T09:04:10.443785+0000","last_unstale":"2024-04-25T09:04:13.467096+0000","last_undegraded":"2024-04-25T09:04:13.467096+0000","last_fullsized":"2024-04-25T09:04:13.467096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:24.135986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.437094+0000","last_change":"2024-04-25T09:04:09.434207+0000","last_active":"2024-04-25T09:04:12.437094+0000","last_peered":"2024-04-25T09:04:12.437094+0000","last_clean":"2024-04-25T09:04:12.437094+0000","last_became_active":"2024-04-25T09:04:09.433751+0000","last_became_peered":"2024-04-25T09:04:09.433751+0000","last_unstale":"2024-04-25T09:04:12.437094+0000","last_undegraded":"2024-04-25T09:04:12.437094+0000","last_fullsized":"2024-04-25T09:04:12.437094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:59.824337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453395+0000","last_change":"2024-04-25T09:04:10.460017+0000","last_active":"2024-04-25T09:04:11.453395+0000","last_peered":"2024-04-25T09:04:11.453395+0000","last_clean":"2024-04-25T09:04:11.453395+0000","last_became_active":"2024-04-25T09:04:10.459722+0000","last_became_peered":"2024-04-25T09:04:10.459722+0000","last_unstale":"2024-04-25T09:04:11.453395+0000","last_undegraded":"2024-04-25T09:04:11.453395+0000","last_fullsized":"2024-04-25T09:04:11.453395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:03.161885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976789+0000","last_change":"2024-04-25T09:04:09.445889+0000","last_active":"2024-04-25T09:04:12.976789+0000","last_peered":"2024-04-25T09:04:12.976789+0000","last_clean":"2024-04-25T09:04:12.976789+0000","last_became_active":"2024-04-25T09:04:09.445008+0000","last_became_peered":"2024-04-25T09:04:09.445008+0000","last_unstale":"2024-04-25T09:04:12.976789+0000","last_undegraded":"2024-04-25T09:04:12.976789+0000","last_fullsized":"2024-04-25T09:04:12.976789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:11.557908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453904+0000","last_change":"2024-04-25T09:04:10.457749+0000","last_active":"2024-04-25T09:04:11.453904+0000","last_peered":"2024-04-25T09:04:11.453904+0000","last_clean":"2024-04-25T09:04:11.453904+0000","last_became_active":"2024-04-25T09:04:10.454687+0000","last_became_peered":"2024-04-25T09:04:10.454687+0000","last_unstale":"2024-04-25T09:04:11.453904+0000","last_undegraded":"2024-04-25T09:04:11.453904+0000","last_fullsized":"2024-04-25T09:04:11.453904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:12.563435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453313+0000","last_change":"2024-04-25T09:04:09.448524+0000","last_active":"2024-04-25T09:04:11.453313+0000","last_peered":"2024-04-25T09:04:11.453313+0000","last_clean":"2024-04-25T09:04:11.453313+0000","last_became_active":"2024-04-25T09:04:09.448200+0000","last_became_peered":"2024-04-25T09:04:09.448200+0000","last_unstale":"2024-04-25T09:04:11.453313+0000","last_undegraded":"2024-04-25T09:04:11.453313+0000","last_fullsized":"2024-04-25T09:04:11.453313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.977103+0000","last_change":"2024-04-25T09:04:10.466591+0000","last_active":"2024-04-25T09:04:12.977103+0000","last_peered":"2024-04-25T09:04:12.977103+0000","last_clean":"2024-04-25T09:04:12.977103+0000","last_became_active":"2024-04-25T09:04:10.466280+0000","last_became_peered":"2024-04-25T09:04:10.466280+0000","last_unstale":"2024-04-25T09:04:12.977103+0000","last_undegraded":"2024-04-25T09:04:12.977103+0000","last_fullsized":"2024-04-25T09:04:12.977103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:38.704801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491422+0000","last_change":"2024-04-25T09:04:09.450624+0000","last_active":"2024-04-25T09:04:12.491422+0000","last_peered":"2024-04-25T09:04:12.491422+0000","last_clean":"2024-04-25T09:04:12.491422+0000","last_became_active":"2024-04-25T09:04:09.450247+0000","last_became_peered":"2024-04-25T09:04:09.450247+0000","last_unstale":"2024-04-25T09:04:12.491422+0000","last_undegraded":"2024-04-25T09:04:12.491422+0000","last_fullsized":"2024-04-25T09:04:12.491422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:06.223411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453226+0000","last_change":"2024-04-25T09:04:10.456100+0000","last_active":"2024-04-25T09:04:11.453226+0000","last_peered":"2024-04-25T09:04:11.453226+0000","last_clean":"2024-04-25T09:04:11.453226+0000","last_became_active":"2024-04-25T09:04:10.455713+0000","last_became_peered":"2024-04-25T09:04:10.455713+0000","last_unstale":"2024-04-25T09:04:11.453226+0000","last_undegraded":"2024-04-25T09:04:11.453226+0000","last_fullsized":"2024-04-25T09:04:11.453226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:36.421524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.435073+0000","last_change":"2024-04-25T09:04:09.440316+0000","last_active":"2024-04-25T09:04:12.435073+0000","last_peered":"2024-04-25T09:04:12.435073+0000","last_clean":"2024-04-25T09:04:12.435073+0000","last_became_active":"2024-04-25T09:04:09.437292+0000","last_became_peered":"2024-04-25T09:04:09.437292+0000","last_unstale":"2024-04-25T09:04:12.435073+0000","last_undegraded":"2024-04-25T09:04:12.435073+0000","last_fullsized":"2024-04-25T09:04:12.435073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.586105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766908+0000","last_change":"2024-04-25T09:04:10.459918+0000","last_active":"2024-04-25T09:04:11.766908+0000","last_peered":"2024-04-25T09:04:11.766908+0000","last_clean":"2024-04-25T09:04:11.766908+0000","last_became_active":"2024-04-25T09:04:10.459598+0000","last_became_peered":"2024-04-25T09:04:10.459598+0000","last_unstale":"2024-04-25T09:04:11.766908+0000","last_undegraded":"2024-04-25T09:04:11.766908+0000","last_fullsized":"2024-04-25T09:04:11.766908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:59.917069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.454406+0000","last_change":"2024-04-25T09:04:09.447004+0000","last_active":"2024-04-25T09:04:11.454406+0000","last_peered":"2024-04-25T09:04:11.454406+0000","last_clean":"2024-04-25T09:04:11.454406+0000","last_became_active":"2024-04-25T09:04:09.446720+0000","last_became_peered":"2024-04-25T09:04:09.446720+0000","last_unstale":"2024-04-25T09:04:11.454406+0000","last_undegraded":"2024-04-25T09:04:11.454406+0000","last_fullsized":"2024-04-25T09:04:11.454406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467529+0000","last_change":"2024-04-25T09:04:10.448395+0000","last_active":"2024-04-25T09:04:13.467529+0000","last_peered":"2024-04-25T09:04:13.467529+0000","last_clean":"2024-04-25T09:04:13.467529+0000","last_became_active":"2024-04-25T09:04:10.448092+0000","last_became_peered":"2024-04-25T09:04:10.448092+0000","last_unstale":"2024-04-25T09:04:13.467529+0000","last_undegraded":"2024-04-25T09:04:13.467529+0000","last_fullsized":"2024-04-25T09:04:13.467529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:10.572493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491035+0000","last_change":"2024-04-25T09:04:09.450871+0000","last_active":"2024-04-25T09:04:12.491035+0000","last_peered":"2024-04-25T09:04:12.491035+0000","last_clean":"2024-04-25T09:04:12.491035+0000","last_became_active":"2024-04-25T09:04:09.450420+0000","last_became_peered":"2024-04-25T09:04:09.450420+0000","last_unstale":"2024-04-25T09:04:12.491035+0000","last_undegraded":"2024-04-25T09:04:12.491035+0000","last_fullsized":"2024-04-25T09:04:12.491035+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:49.470038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453905+0000","last_change":"2024-04-25T09:04:10.461790+0000","last_active":"2024-04-25T09:04:11.453905+0000","last_peered":"2024-04-25T09:04:11.453905+0000","last_clean":"2024-04-25T09:04:11.453905+0000","last_became_active":"2024-04-25T09:04:10.459834+0000","last_became_peered":"2024-04-25T09:04:10.459834+0000","last_unstale":"2024-04-25T09:04:11.453905+0000","last_undegraded":"2024-04-25T09:04:11.453905+0000","last_fullsized":"2024-04-25T09:04:11.453905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:24.628300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453268+0000","last_change":"2024-04-25T09:04:09.443781+0000","last_active":"2024-04-25T09:04:11.453268+0000","last_peered":"2024-04-25T09:04:11.453268+0000","last_clean":"2024-04-25T09:04:11.453268+0000","last_became_active":"2024-04-25T09:04:09.443436+0000","last_became_peered":"2024-04-25T09:04:09.443436+0000","last_unstale":"2024-04-25T09:04:11.453268+0000","last_undegraded":"2024-04-25T09:04:11.453268+0000","last_fullsized":"2024-04-25T09:04:11.453268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:06.223411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766429+0000","last_change":"2024-04-25T09:04:10.453062+0000","last_active":"2024-04-25T09:04:11.766429+0000","last_peered":"2024-04-25T09:04:11.766429+0000","last_clean":"2024-04-25T09:04:11.766429+0000","last_became_active":"2024-04-25T09:04:10.452791+0000","last_became_peered":"2024-04-25T09:04:10.452791+0000","last_unstale":"2024-04-25T09:04:11.766429+0000","last_undegraded":"2024-04-25T09:04:11.766429+0000","last_fullsized":"2024-04-25T09:04:11.766429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:48:36.421524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453381+0000","last_change":"2024-04-25T09:04:09.434154+0000","last_active":"2024-04-25T09:04:11.453381+0000","last_peered":"2024-04-25T09:04:11.453381+0000","last_clean":"2024-04-25T09:04:11.453381+0000","last_became_active":"2024-04-25T09:04:09.433848+0000","last_became_peered":"2024-04-25T09:04:09.433848+0000","last_unstale":"2024-04-25T09:04:11.453381+0000","last_undegraded":"2024-04-25T09:04:11.453381+0000","last_fullsized":"2024-04-25T09:04:11.453381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:23.622773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766744+0000","last_change":"2024-04-25T09:04:10.449393+0000","last_active":"2024-04-25T09:04:11.766744+0000","last_peered":"2024-04-25T09:04:11.766744+0000","last_clean":"2024-04-25T09:04:11.766744+0000","last_became_active":"2024-04-25T09:04:10.449096+0000","last_became_peered":"2024-04-25T09:04:10.449096+0000","last_unstale":"2024-04-25T09:04:11.766744+0000","last_undegraded":"2024-04-25T09:04:11.766744+0000","last_fullsized":"2024-04-25T09:04:11.766744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:55.022253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491405+0000","last_change":"2024-04-25T09:04:09.448660+0000","last_active":"2024-04-25T09:04:12.491405+0000","last_peered":"2024-04-25T09:04:12.491405+0000","last_clean":"2024-04-25T09:04:12.491405+0000","last_became_active":"2024-04-25T09:04:09.448294+0000","last_became_peered":"2024-04-25T09:04:09.448294+0000","last_unstale":"2024-04-25T09:04:12.491405+0000","last_undegraded":"2024-04-25T09:04:12.491405+0000","last_fullsized":"2024-04-25T09:04:12.491405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:11.557908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.453289+0000","last_change":"2024-04-25T09:04:10.447970+0000","last_active":"2024-04-25T09:04:11.453289+0000","last_peered":"2024-04-25T09:04:11.453289+0000","last_clean":"2024-04-25T09:04:11.453289+0000","last_became_active":"2024-04-25T09:04:10.447382+0000","last_became_peered":"2024-04-25T09:04:10.447382+0000","last_unstale":"2024-04-25T09:04:11.453289+0000","last_undegraded":"2024-04-25T09:04:11.453289+0000","last_fullsized":"2024-04-25T09:04:11.453289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:06.661836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.977103+0000","last_change":"2024-04-25T09:04:10.467264+0000","last_active":"2024-04-25T09:04:12.977103+0000","last_peered":"2024-04-25T09:04:12.977103+0000","last_clean":"2024-04-25T09:04:12.977103+0000","last_became_active":"2024-04-25T09:04:10.466902+0000","last_became_peered":"2024-04-25T09:04:10.466902+0000","last_unstale":"2024-04-25T09:04:12.977103+0000","last_undegraded":"2024-04-25T09:04:12.977103+0000","last_fullsized":"2024-04-25T09:04:12.977103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:15.921248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491091+0000","last_change":"2024-04-25T09:04:09.451766+0000","last_active":"2024-04-25T09:04:12.491091+0000","last_peered":"2024-04-25T09:04:12.491091+0000","last_clean":"2024-04-25T09:04:12.491091+0000","last_became_active":"2024-04-25T09:04:09.451360+0000","last_became_peered":"2024-04-25T09:04:09.451360+0000","last_unstale":"2024-04-25T09:04:12.491091+0000","last_undegraded":"2024-04-25T09:04:12.491091+0000","last_fullsized":"2024-04-25T09:04:12.491091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:23.622773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.976810+0000","last_change":"2024-04-25T09:04:10.467782+0000","last_active":"2024-04-25T09:04:12.976810+0000","last_peered":"2024-04-25T09:04:12.976810+0000","last_clean":"2024-04-25T09:04:12.976810+0000","last_became_active":"2024-04-25T09:04:10.467514+0000","last_became_peered":"2024-04-25T09:04:10.467514+0000","last_unstale":"2024-04-25T09:04:12.976810+0000","last_undegraded":"2024-04-25T09:04:12.976810+0000","last_fullsized":"2024-04-25T09:04:12.976810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:41.363774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:12.491249+0000","last_change":"2024-04-25T09:04:09.451747+0000","last_active":"2024-04-25T09:04:12.491249+0000","last_peered":"2024-04-25T09:04:12.491249+0000","last_clean":"2024-04-25T09:04:12.491249+0000","last_became_active":"2024-04-25T09:04:09.451001+0000","last_became_peered":"2024-04-25T09:04:09.451001+0000","last_unstale":"2024-04-25T09:04:12.491249+0000","last_undegraded":"2024-04-25T09:04:12.491249+0000","last_fullsized":"2024-04-25T09:04:12.491249+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:08:45.586105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467381+0000","last_change":"2024-04-25T09:04:10.451528+0000","last_active":"2024-04-25T09:04:13.467381+0000","last_peered":"2024-04-25T09:04:13.467381+0000","last_clean":"2024-04-25T09:04:13.467381+0000","last_became_active":"2024-04-25T09:04:10.451248+0000","last_became_peered":"2024-04-25T09:04:10.451248+0000","last_unstale":"2024-04-25T09:04:13.467381+0000","last_undegraded":"2024-04-25T09:04:13.467381+0000","last_fullsized":"2024-04-25T09:04:13.467381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:12.826732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766853+0000","last_change":"2024-04-25T09:04:09.447550+0000","last_active":"2024-04-25T09:04:11.766853+0000","last_peered":"2024-04-25T09:04:11.766853+0000","last_clean":"2024-04-25T09:04:11.766853+0000","last_became_active":"2024-04-25T09:04:09.447290+0000","last_became_peered":"2024-04-25T09:04:09.447290+0000","last_unstale":"2024-04-25T09:04:11.766853+0000","last_undegraded":"2024-04-25T09:04:11.766853+0000","last_fullsized":"2024-04-25T09:04:11.766853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:37.664377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:11.766592+0000","last_change":"2024-04-25T09:04:10.448757+0000","last_active":"2024-04-25T09:04:11.766592+0000","last_peered":"2024-04-25T09:04:11.766592+0000","last_clean":"2024-04-25T09:04:11.766592+0000","last_became_active":"2024-04-25T09:04:10.448463+0000","last_became_peered":"2024-04-25T09:04:10.448463+0000","last_unstale":"2024-04-25T09:04:11.766592+0000","last_undegraded":"2024-04-25T09:04:11.766592+0000","last_fullsized":"2024-04-25T09:04:11.766592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:09.410797+0000","last_clean_scrub_stamp":"2024-04-25T09:04:09.410797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:53.844663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T09:04:13.467600+0000","last_change":"2024-04-25T09:04:09.446106+0000","last_active":"2024-04-25T09:04:13.467600+0000","last_peered":"2024-04-25T09:04:13.467600+0000","last_clean":"2024-04-25T09:04:13.467600+0000","last_became_active":"2024-04-25T09:04:09.445783+0000","last_became_peered":"2024-04-25T09:04:09.445783+0000","last_unstale":"2024-04-25T09:04:13.467600+0000","last_undegraded":"2024-04-25T09:04:13.467600+0000","last_fullsized":"2024-04-25T09:04:13.467600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:08.405270+0000","last_clean_scrub_stamp":"2024-04-25T09:04:08.405270+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:37.664377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:04:19.461 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T09:04:19.462 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T09:04:19.462 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T09:04:19.462 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:04:19.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.643+0000 7f2a2a800640 1 Processor -- start 2024-04-25T09:04:19.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.643+0000 7f2a2a800640 1 -- start start 2024-04-25T09:04:19.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.643+0000 7f2a2a800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2a2415a900 0x7f2a2406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.643+0000 7f2a2a800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a240cf560 0x7f2a240cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.643+0000 7f2a2a800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a240cda00 con 0x7f2a240cd520 2024-04-25T09:04:19.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.643+0000 7f2a2a800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2415bcf0 con 0x7f2a2415a900 2024-04-25T09:04:19.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.643+0000 7f2a2a800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240cfef0 con 0x7f2a240cf560 2024-04-25T09:04:19.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.643+0000 7f2a23e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a240cf560 0x7f2a240cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.643+0000 7f2a23e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a240cf560 0x7f2a240cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:39590/0 (socket says 172.21.15.175:39590) 2024-04-25T09:04:19.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.643+0000 7f2a23e00640 1 -- 172.21.15.175:0/3253297879 learned_addr learned my addr 172.21.15.175:0/3253297879 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:19.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.647+0000 7f2a23400640 1 --2- 172.21.15.175:0/3253297879 >> v2:172.21.15.177:3300/0 conn(0x7f2a2415a900 0x7f2a2406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.647+0000 7f2a23e00640 1 -- 172.21.15.175:0/3253297879 >> v2:172.21.15.177:3300/0 conn(0x7f2a2415a900 msgr2=0x7f2a2406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:19.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.647+0000 7f2a23e00640 1 --2- 172.21.15.175:0/3253297879 >> v2:172.21.15.177:3300/0 conn(0x7f2a2415a900 0x7f2a2406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.647+0000 7f2a23e00640 1 -- 172.21.15.175:0/3253297879 >> v1:172.21.15.177:6789/0 conn(0x7f2a240cd520 legacy=0x7f2a240ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.647+0000 7f2a23e00640 1 -- 172.21.15.175:0/3253297879 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a240cdce0 con 0x7f2a240cf560 2024-04-25T09:04:19.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.647+0000 7f2a23e00640 1 --2- 172.21.15.175:0/3253297879 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a240cf560 0x7f2a240cf9b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009e50 tx=0x7f2a1c01ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8b9e12923f775e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.647+0000 7f2a22000640 1 -- 172.21.15.175:0/3253297879 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c0a57f0 con 0x7f2a240cf560 2024-04-25T09:04:19.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.647+0000 7f2a22000640 1 -- 172.21.15.175:0/3253297879 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c0a5990 con 0x7f2a240cf560 2024-04-25T09:04:19.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.647+0000 7f2a22000640 1 -- 172.21.15.175:0/3253297879 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c0a5d60 con 0x7f2a240cf560 2024-04-25T09:04:19.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a2a800640 1 -- 172.21.15.175:0/3253297879 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a240cf560 msgr2=0x7f2a240cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a2a800640 1 --2- 172.21.15.175:0/3253297879 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a240cf560 0x7f2a240cf9b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009e50 tx=0x7f2a1c01ca30 comp rx=0 tx=0).stop 2024-04-25T09:04:19.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a2a800640 1 -- 172.21.15.175:0/3253297879 shutdown_connections 2024-04-25T09:04:19.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a2a800640 1 --2- 172.21.15.175:0/3253297879 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a240cf560 0x7f2a240cf9b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a2a800640 1 --2- 172.21.15.175:0/3253297879 >> v2:172.21.15.177:3300/0 conn(0x7f2a2415a900 0x7f2a2406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a2a800640 1 -- 172.21.15.175:0/3253297879 >> 172.21.15.175:0/3253297879 conn(0x7f2a24067150 msgr2=0x7f2a2406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a2a800640 1 -- 172.21.15.175:0/3253297879 shutdown_connections 2024-04-25T09:04:19.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a2a800640 1 -- 172.21.15.175:0/3253297879 wait complete. 2024-04-25T09:04:19.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a2a800640 1 Processor -- start 2024-04-25T09:04:19.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a2a800640 1 -- start start 2024-04-25T09:04:19.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a2a800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a240cf560 0x7f2a2414c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a2a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a2415a900 0x7f2a240af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a2a800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a24146e80 0x7f2a240b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a2a800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2406d530 con 0x7f2a2415a900 2024-04-25T09:04:19.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a2a800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2406d3b0 con 0x7f2a240cf560 2024-04-25T09:04:19.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a2a800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2415c790 con 0x7f2a24146e80 2024-04-25T09:04:19.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a22a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a2415a900 0x7f2a240af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a23400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a240cf560 0x7f2a2414c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a22a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a2415a900 0x7f2a240af2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46228/0 (socket says 172.21.15.175:46228) 2024-04-25T09:04:19.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a22a00640 1 -- 172.21.15.175:0/1316965743 learned_addr learned my addr 172.21.15.175:0/1316965743 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:19.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a23e00640 1 --2- 172.21.15.175:0/1316965743 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a24146e80 0x7f2a240b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a22a00640 1 -- 172.21.15.175:0/1316965743 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a24146e80 msgr2=0x7f2a240b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a22a00640 1 --2- 172.21.15.175:0/1316965743 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a24146e80 0x7f2a240b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a22a00640 1 -- 172.21.15.175:0/1316965743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a240cf560 msgr2=0x7f2a2414c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a22a00640 1 --2- 172.21.15.175:0/1316965743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a240cf560 0x7f2a2414c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a22a00640 1 -- 172.21.15.175:0/1316965743 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2414ac00 con 0x7f2a2415a900 2024-04-25T09:04:19.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a22a00640 1 --2- 172.21.15.175:0/1316965743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a2415a900 0x7f2a240af2d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000c430 tx=0x7f2a1000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.651+0000 7f2a1b400640 1 -- 172.21.15.175:0/1316965743 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a100052d0 con 0x7f2a2415a900 2024-04-25T09:04:19.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.655+0000 7f2a1b400640 1 -- 172.21.15.175:0/1316965743 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a10005470 con 0x7f2a2415a900 2024-04-25T09:04:19.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.655+0000 7f2a1b400640 1 -- 172.21.15.175:0/1316965743 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10007260 con 0x7f2a2415a900 2024-04-25T09:04:19.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.655+0000 7f2a2a800640 1 -- 172.21.15.175:0/1316965743 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a240af9c0 con 0x7f2a2415a900 2024-04-25T09:04:19.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.655+0000 7f2a2a800640 1 -- 172.21.15.175:0/1316965743 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a240aff80 con 0x7f2a2415a900 2024-04-25T09:04:19.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.655+0000 7f2a2a800640 1 -- 172.21.15.175:0/1316965743 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a24074a60 con 0x7f2a2415a900 2024-04-25T09:04:19.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.655+0000 7f2a1b400640 1 -- 172.21.15.175:0/1316965743 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2a10007400 con 0x7f2a2415a900 2024-04-25T09:04:19.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.655+0000 7f2a1b400640 1 --2- 172.21.15.175:0/1316965743 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2a04066f90 0x7f2a04069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.655+0000 7f2a1b400640 1 -- 172.21.15.175:0/1316965743 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a100844f0 con 0x7f2a2415a900 2024-04-25T09:04:19.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.655+0000 7f2a23400640 1 --2- 172.21.15.175:0/1316965743 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2a04066f90 0x7f2a04069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.655+0000 7f2a23400640 1 --2- 172.21.15.175:0/1316965743 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2a04066f90 0x7f2a04069450 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2a14009ac0 tx=0x7f2a14009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.659+0000 7f2a1b400640 1 -- 172.21.15.175:0/1316965743 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2a10054e10 con 0x7f2a2415a900 2024-04-25T09:04:19.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.843+0000 7f2a2a800640 1 -- 172.21.15.175:0/1316965743 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2a240cb770 con 0x7f2a2415a900 2024-04-25T09:04:19.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.843+0000 7f2a1b400640 1 -- 172.21.15.175:0/1316965743 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f2a10058eb0 con 0x7f2a2415a900 2024-04-25T09:04:19.837 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:19.837 INFO:teuthology.orchestra.run.smithi175.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T09:04:19.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.847+0000 7f2a2a800640 1 -- 172.21.15.175:0/1316965743 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2a04066f90 msgr2=0x7f2a04069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.847+0000 7f2a2a800640 1 --2- 172.21.15.175:0/1316965743 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2a04066f90 0x7f2a04069450 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2a14009ac0 tx=0x7f2a14009190 comp rx=0 tx=0).stop 2024-04-25T09:04:19.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.847+0000 7f2a2a800640 1 -- 172.21.15.175:0/1316965743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a2415a900 msgr2=0x7f2a240af2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.847+0000 7f2a2a800640 1 --2- 172.21.15.175:0/1316965743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a2415a900 0x7f2a240af2d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000c430 tx=0x7f2a1000c8f0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.847+0000 7f2a2a800640 1 -- 172.21.15.175:0/1316965743 shutdown_connections 2024-04-25T09:04:19.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.847+0000 7f2a2a800640 1 --2- 172.21.15.175:0/1316965743 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2a04066f90 0x7f2a04069450 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.847+0000 7f2a2a800640 1 --2- 172.21.15.175:0/1316965743 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a24146e80 0x7f2a240b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.847+0000 7f2a2a800640 1 --2- 172.21.15.175:0/1316965743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a2415a900 0x7f2a240af2d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.847+0000 7f2a2a800640 1 --2- 172.21.15.175:0/1316965743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a240cf560 0x7f2a2414c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.847+0000 7f2a2a800640 1 -- 172.21.15.175:0/1316965743 >> 172.21.15.175:0/1316965743 conn(0x7f2a240cd520 msgr2=0x7f2a2406ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.847+0000 7f2a2a800640 1 -- 172.21.15.175:0/1316965743 shutdown_connections 2024-04-25T09:04:19.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:19.847+0000 7f2a2a800640 1 -- 172.21.15.175:0/1316965743 wait complete. 2024-04-25T09:04:19.857 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T09:04:19.858 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:19.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.003+0000 7f6400600640 1 Processor -- start 2024-04-25T09:04:19.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.003+0000 7f6400600640 1 -- start start 2024-04-25T09:04:19.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.003+0000 7f6400600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63f815bc70 0x7f63f80b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.003+0000 7f6400600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f63f80b1610 0x7f63f80b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.003+0000 7f6400600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f80b0000 con 0x7f63f806b780 2024-04-25T09:04:19.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.003+0000 7f6400600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f80b08f0 con 0x7f63f80b1610 2024-04-25T09:04:19.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.003+0000 7f6400600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f80b02a0 con 0x7f63f815bc70 2024-04-25T09:04:19.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.003+0000 7f63fe600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f63f80b1610 0x7f63f80b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.003+0000 7f63fd200640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f63f806b780 0x7f63f80cc3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44184/0 (socket says 172.21.15.175:44184) 2024-04-25T09:04:19.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.003+0000 7f63fd200640 1 -- 172.21.15.175:0/3013507239 learned_addr learned my addr 172.21.15.175:0/3013507239 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:19.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.003+0000 7f63fe600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f63f80b1610 0x7f63f80b1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46232/0 (socket says 172.21.15.175:46232) 2024-04-25T09:04:19.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.003+0000 7f63fdc00640 1 --2- 172.21.15.175:0/3013507239 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63f815bc70 0x7f63f80b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.003+0000 7f63fe600640 1 -- 172.21.15.175:0/3013507239 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63f815bc70 msgr2=0x7f63f80b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:19.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.003+0000 7f63fe600640 1 --2- 172.21.15.175:0/3013507239 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63f815bc70 0x7f63f80b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.003+0000 7f63fe600640 1 -- 172.21.15.175:0/3013507239 >> v1:172.21.15.175:6789/0 conn(0x7f63f806b780 legacy=0x7f63f80cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.003+0000 7f63f7e00640 1 -- 172.21.15.175:0/3013507239 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638967510 0 0) 0x7f63f80b0000 con 0x7f63f806b780 2024-04-25T09:04:19.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.003+0000 7f63fe600640 1 -- 172.21.15.175:0/3013507239 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f80b0580 con 0x7f63f80b1610 2024-04-25T09:04:19.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.007+0000 7f63fe600640 1 --2- 172.21.15.175:0/3013507239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63f80b1610 0x7f63f80b1aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009d90 tx=0x7f63f001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729970fda52e1f92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.007+0000 7f63f7e00640 1 -- 172.21.15.175:0/3013507239 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f00b4070 con 0x7f63f80b1610 2024-04-25T09:04:19.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.007+0000 7f63f7e00640 1 -- 172.21.15.175:0/3013507239 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f00af600 con 0x7f63f80b1610 2024-04-25T09:04:19.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.007+0000 7f63f7e00640 1 -- 172.21.15.175:0/3013507239 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f00af9d0 con 0x7f63f80b1610 2024-04-25T09:04:20.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.007+0000 7f6400600640 1 -- 172.21.15.175:0/3013507239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63f80b1610 msgr2=0x7f63f80b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.007+0000 7f6400600640 1 --2- 172.21.15.175:0/3013507239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63f80b1610 0x7f63f80b1aa0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009d90 tx=0x7f63f001f150 comp rx=0 tx=0).stop 2024-04-25T09:04:20.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.007+0000 7f6400600640 1 -- 172.21.15.175:0/3013507239 shutdown_connections 2024-04-25T09:04:20.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.007+0000 7f6400600640 1 --2- 172.21.15.175:0/3013507239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63f80b1610 0x7f63f80b1aa0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.007+0000 7f6400600640 1 --2- 172.21.15.175:0/3013507239 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63f815bc70 0x7f63f80b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.007+0000 7f6400600640 1 -- 172.21.15.175:0/3013507239 >> 172.21.15.175:0/3013507239 conn(0x7f63f80d06c0 msgr2=0x7f63f80d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.007+0000 7f6400600640 1 -- 172.21.15.175:0/3013507239 shutdown_connections 2024-04-25T09:04:20.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.007+0000 7f6400600640 1 -- 172.21.15.175:0/3013507239 wait complete. 2024-04-25T09:04:20.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f6400600640 1 Processor -- start 2024-04-25T09:04:20.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f6400600640 1 -- start start 2024-04-25T09:04:20.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f6400600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63f806b780 0x7f63f8150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f6400600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63f80b1610 0x7f63f80c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f6400600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63f815bc70 0x7f63f80c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f6400600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f80cde30 con 0x7f63f80b1610 2024-04-25T09:04:20.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f6400600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f80ccae0 con 0x7f63f806b780 2024-04-25T09:04:20.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f6400600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f80b12c0 con 0x7f63f815bc70 2024-04-25T09:04:20.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f63fd200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63f80b1610 0x7f63f80c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f63fd200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63f80b1610 0x7f63f80c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46234/0 (socket says 172.21.15.175:46234) 2024-04-25T09:04:20.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f63fd200640 1 -- 172.21.15.175:0/1611577722 learned_addr learned my addr 172.21.15.175:0/1611577722 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:20.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f63fd200640 1 -- 172.21.15.175:0/1611577722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63f815bc70 msgr2=0x7f63f80c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f63fd200640 1 --2- 172.21.15.175:0/1611577722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63f815bc70 0x7f63f80c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f63fd200640 1 -- 172.21.15.175:0/1611577722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63f806b780 msgr2=0x7f63f8150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f63fd200640 1 --2- 172.21.15.175:0/1611577722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63f806b780 0x7f63f8150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f63fd200640 1 -- 172.21.15.175:0/1611577722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f815dc90 con 0x7f63f80b1610 2024-04-25T09:04:20.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f63fd200640 1 --2- 172.21.15.175:0/1611577722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63f80b1610 0x7f63f80c8c40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f63e400c450 tx=0x7f63e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f63f5600640 1 -- 172.21.15.175:0/1611577722 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4018070 con 0x7f63f80b1610 2024-04-25T09:04:20.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f63f5600640 1 -- 172.21.15.175:0/1611577722 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e40074e0 con 0x7f63f80b1610 2024-04-25T09:04:20.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f63f5600640 1 -- 172.21.15.175:0/1611577722 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e40049f0 con 0x7f63f80b1610 2024-04-25T09:04:20.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f6400600640 1 -- 172.21.15.175:0/1611577722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f815df70 con 0x7f63f80b1610 2024-04-25T09:04:20.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f6400600640 1 -- 172.21.15.175:0/1611577722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f815e530 con 0x7f63f80b1610 2024-04-25T09:04:20.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.011+0000 7f6400600640 1 -- 172.21.15.175:0/1611577722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f8074a60 con 0x7f63f80b1610 2024-04-25T09:04:20.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.015+0000 7f63f5600640 1 -- 172.21.15.175:0/1611577722 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f63e4004b90 con 0x7f63f80b1610 2024-04-25T09:04:20.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.015+0000 7f63f5600640 1 --2- 172.21.15.175:0/1611577722 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f63d8066f60 0x7f63d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.015+0000 7f63f5600640 1 -- 172.21.15.175:0/1611577722 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63e40843a0 con 0x7f63f80b1610 2024-04-25T09:04:20.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.015+0000 7f63fdc00640 1 --2- 172.21.15.175:0/1611577722 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f63d8066f60 0x7f63d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.015+0000 7f63fdc00640 1 --2- 172.21.15.175:0/1611577722 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f63d8066f60 0x7f63d8069420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f63f815f710 tx=0x7f63ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.019+0000 7f63f5600640 1 -- 172.21.15.175:0/1611577722 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f63e4055310 con 0x7f63f80b1610 2024-04-25T09:04:20.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.187+0000 7f6400600640 1 -- 172.21.15.175:0/1611577722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63f815b380 con 0x7f63f80b1610 2024-04-25T09:04:20.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.187+0000 7f63f5600640 1 -- 172.21.15.175:0/1611577722 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f63e4054c10 con 0x7f63f80b1610 2024-04-25T09:04:20.180 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:20.180 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":20,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:11.440551+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:20.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.191+0000 7f6400600640 1 -- 172.21.15.175:0/1611577722 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f63d8066f60 msgr2=0x7f63d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.191+0000 7f6400600640 1 --2- 172.21.15.175:0/1611577722 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f63d8066f60 0x7f63d8069420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f63f815f710 tx=0x7f63ec008040 comp rx=0 tx=0).stop 2024-04-25T09:04:20.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.191+0000 7f6400600640 1 -- 172.21.15.175:0/1611577722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63f80b1610 msgr2=0x7f63f80c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.191+0000 7f6400600640 1 --2- 172.21.15.175:0/1611577722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63f80b1610 0x7f63f80c8c40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f63e400c450 tx=0x7f63e400c910 comp rx=0 tx=0).stop 2024-04-25T09:04:20.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.191+0000 7f6400600640 1 -- 172.21.15.175:0/1611577722 shutdown_connections 2024-04-25T09:04:20.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.191+0000 7f6400600640 1 --2- 172.21.15.175:0/1611577722 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f63d8066f60 0x7f63d8069420 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.191+0000 7f6400600640 1 --2- 172.21.15.175:0/1611577722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63f815bc70 0x7f63f80c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.191+0000 7f6400600640 1 --2- 172.21.15.175:0/1611577722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63f80b1610 0x7f63f80c8c40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.191+0000 7f6400600640 1 --2- 172.21.15.175:0/1611577722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63f806b780 0x7f63f8150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.191+0000 7f6400600640 1 -- 172.21.15.175:0/1611577722 >> 172.21.15.175:0/1611577722 conn(0x7f63f80d06c0 msgr2=0x7f63f80ad4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.191+0000 7f6400600640 1 -- 172.21.15.175:0/1611577722 shutdown_connections 2024-04-25T09:04:20.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.191+0000 7f6400600640 1 -- 172.21.15.175:0/1611577722 wait complete. 2024-04-25T09:04:20.201 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:08.047706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:04:08.795449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:20.201 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:20.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.347+0000 7f844a600640 1 Processor -- start 2024-04-25T09:04:20.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.347+0000 7f844a600640 1 -- start start 2024-04-25T09:04:20.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.347+0000 7f844a600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f844415dd90 0x7f8444162340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.347+0000 7f844a600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f844406b9a0 0x7f844406ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.347+0000 7f844a600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84440cc3a0 con 0x7f844406ee70 2024-04-25T09:04:20.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.347+0000 7f844a600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8444161eb0 con 0x7f844415dd90 2024-04-25T09:04:20.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.347+0000 7f844a600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84440cc0c0 con 0x7f844406b9a0 2024-04-25T09:04:20.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.347+0000 7f8443400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f844415dd90 0x7f8444162340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.347+0000 7f8443400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f844415dd90 0x7f8444162340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46240/0 (socket says 172.21.15.175:46240) 2024-04-25T09:04:20.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.347+0000 7f8443400640 1 -- 172.21.15.175:0/634512937 learned_addr learned my addr 172.21.15.175:0/634512937 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:20.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.347+0000 7f843aa00640 1 --2- 172.21.15.175:0/634512937 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f844406b9a0 0x7f844406ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.347+0000 7f8443400640 1 -- 172.21.15.175:0/634512937 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f844406b9a0 msgr2=0x7f844406ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:20.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.347+0000 7f8443400640 1 --2- 172.21.15.175:0/634512937 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f844406b9a0 0x7f844406ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.347+0000 7f8443400640 1 -- 172.21.15.175:0/634512937 >> v1:172.21.15.177:6789/0 conn(0x7f844406ee70 legacy=0x7f844415e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:20.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.347+0000 7f8443400640 1 -- 172.21.15.175:0/634512937 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8444161860 con 0x7f844415dd90 2024-04-25T09:04:20.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.351+0000 7f8443400640 1 --2- 172.21.15.175:0/634512937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f844415dd90 0x7f8444162340 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8434009870 tx=0x7f843401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90747c08dd26d552 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.351+0000 7f8442a00640 1 -- 172.21.15.175:0/634512937 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84340ab640 con 0x7f844415dd90 2024-04-25T09:04:20.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.351+0000 7f8442a00640 1 -- 172.21.15.175:0/634512937 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84340b0070 con 0x7f844415dd90 2024-04-25T09:04:20.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.351+0000 7f8442a00640 1 -- 172.21.15.175:0/634512937 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84340aba00 con 0x7f844415dd90 2024-04-25T09:04:20.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.351+0000 7f844a600640 1 -- 172.21.15.175:0/634512937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f844415dd90 msgr2=0x7f8444162340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.351+0000 7f844a600640 1 --2- 172.21.15.175:0/634512937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f844415dd90 0x7f8444162340 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8434009870 tx=0x7f843401c530 comp rx=0 tx=0).stop 2024-04-25T09:04:20.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.351+0000 7f844a600640 1 -- 172.21.15.175:0/634512937 shutdown_connections 2024-04-25T09:04:20.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.351+0000 7f844a600640 1 --2- 172.21.15.175:0/634512937 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f844406b9a0 0x7f844406ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.351+0000 7f844a600640 1 --2- 172.21.15.175:0/634512937 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f844415dd90 0x7f8444162340 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.351+0000 7f844a600640 1 -- 172.21.15.175:0/634512937 >> 172.21.15.175:0/634512937 conn(0x7f84440cc5f0 msgr2=0x7f84440cca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.351+0000 7f844a600640 1 -- 172.21.15.175:0/634512937 shutdown_connections 2024-04-25T09:04:20.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.351+0000 7f844a600640 1 -- 172.21.15.175:0/634512937 wait complete. 2024-04-25T09:04:20.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f844a600640 1 Processor -- start 2024-04-25T09:04:20.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f844a600640 1 -- start start 2024-04-25T09:04:20.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f844a600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f844406b9a0 0x7f8444143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f844a600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f844406ee70 0x7f8444157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f844a600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f844415dd90 0x7f84440ad430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f844a600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844416aef0 con 0x7f844406b9a0 2024-04-25T09:04:20.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f844a600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844416ad70 con 0x7f844415dd90 2024-04-25T09:04:20.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f844a600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844416b070 con 0x7f844406ee70 2024-04-25T09:04:20.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f8443400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f844406b9a0 0x7f8444143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f8443400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f844406b9a0 0x7f8444143530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46252/0 (socket says 172.21.15.175:46252) 2024-04-25T09:04:20.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f8443400640 1 -- 172.21.15.175:0/287430491 learned_addr learned my addr 172.21.15.175:0/287430491 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:20.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f843aa00640 1 --2- 172.21.15.175:0/287430491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f844406ee70 0x7f8444157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f8443e00640 1 --2- 172.21.15.175:0/287430491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f844415dd90 0x7f84440ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f8443400640 1 -- 172.21.15.175:0/287430491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f844406ee70 msgr2=0x7f8444157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f8443400640 1 --2- 172.21.15.175:0/287430491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f844406ee70 0x7f8444157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f8443400640 1 -- 172.21.15.175:0/287430491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f844415dd90 msgr2=0x7f84440ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f8443400640 1 --2- 172.21.15.175:0/287430491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f844415dd90 0x7f84440ad430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f8443400640 1 -- 172.21.15.175:0/287430491 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8444152750 con 0x7f844406b9a0 2024-04-25T09:04:20.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f843aa00640 1 --2- 172.21.15.175:0/287430491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f844406ee70 0x7f8444157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:20.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f8443400640 1 --2- 172.21.15.175:0/287430491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f844406b9a0 0x7f8444143530 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f84340ad040 tx=0x7f843401ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f843be00640 1 -- 172.21.15.175:0/287430491 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84340be3f0 con 0x7f844406b9a0 2024-04-25T09:04:20.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f843be00640 1 -- 172.21.15.175:0/287430491 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84340be590 con 0x7f844406b9a0 2024-04-25T09:04:20.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f843be00640 1 -- 172.21.15.175:0/287430491 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84340be980 con 0x7f844406b9a0 2024-04-25T09:04:20.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f844a600640 1 -- 172.21.15.175:0/287430491 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8444151eb0 con 0x7f844406b9a0 2024-04-25T09:04:20.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.355+0000 7f844a600640 1 -- 172.21.15.175:0/287430491 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8444152470 con 0x7f844406b9a0 2024-04-25T09:04:20.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.359+0000 7f844a600640 1 -- 172.21.15.175:0/287430491 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8444075160 con 0x7f844406b9a0 2024-04-25T09:04:20.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.359+0000 7f843be00640 1 -- 172.21.15.175:0/287430491 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f84340b43f0 con 0x7f844406b9a0 2024-04-25T09:04:20.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.359+0000 7f843be00640 1 --2- 172.21.15.175:0/287430491 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8420066f60 0x7f8420069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.359+0000 7f843be00640 1 -- 172.21.15.175:0/287430491 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f843411e9a0 con 0x7f844406b9a0 2024-04-25T09:04:20.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.359+0000 7f843aa00640 1 --2- 172.21.15.175:0/287430491 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8420066f60 0x7f8420069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.359+0000 7f843aa00640 1 --2- 172.21.15.175:0/287430491 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8420066f60 0x7f8420069420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8444155f40 tx=0x7f842c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.363+0000 7f843be00640 1 -- 172.21.15.175:0/287430491 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f84340c7060 con 0x7f844406b9a0 2024-04-25T09:04:20.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.519+0000 7f844a600640 1 -- 172.21.15.175:0/287430491 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f844406b780 con 0x7f844406b9a0 2024-04-25T09:04:20.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.519+0000 7f843be00640 1 -- 172.21.15.175:0/287430491 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8434016150 con 0x7f844406b9a0 2024-04-25T09:04:20.512 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:04:20.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.523+0000 7f844a600640 1 -- 172.21.15.175:0/287430491 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8420066f60 msgr2=0x7f8420069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.523+0000 7f844a600640 1 --2- 172.21.15.175:0/287430491 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8420066f60 0x7f8420069420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8444155f40 tx=0x7f842c008040 comp rx=0 tx=0).stop 2024-04-25T09:04:20.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.523+0000 7f844a600640 1 -- 172.21.15.175:0/287430491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f844406b9a0 msgr2=0x7f8444143530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.523+0000 7f844a600640 1 --2- 172.21.15.175:0/287430491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f844406b9a0 0x7f8444143530 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f84340ad040 tx=0x7f843401ad70 comp rx=0 tx=0).stop 2024-04-25T09:04:20.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.523+0000 7f844a600640 1 -- 172.21.15.175:0/287430491 shutdown_connections 2024-04-25T09:04:20.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.523+0000 7f844a600640 1 --2- 172.21.15.175:0/287430491 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8420066f60 0x7f8420069420 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.523+0000 7f844a600640 1 --2- 172.21.15.175:0/287430491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f844415dd90 0x7f84440ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.523+0000 7f844a600640 1 --2- 172.21.15.175:0/287430491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f844406ee70 0x7f8444157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.523+0000 7f844a600640 1 --2- 172.21.15.175:0/287430491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f844406b9a0 0x7f8444143530 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.523+0000 7f844a600640 1 -- 172.21.15.175:0/287430491 >> 172.21.15.175:0/287430491 conn(0x7f84440cc5f0 msgr2=0x7f84440d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.523+0000 7f844a600640 1 -- 172.21.15.175:0/287430491 shutdown_connections 2024-04-25T09:04:20.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.523+0000 7f844a600640 1 -- 172.21.15.175:0/287430491 wait complete. 2024-04-25T09:04:20.534 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:20.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.679+0000 7f7074400640 1 Processor -- start 2024-04-25T09:04:20.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.679+0000 7f7074400640 1 -- start start 2024-04-25T09:04:20.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.679+0000 7f7074400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f706c0cf080 0x7f706c1600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.679+0000 7f7074400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706c0cfd10 con 0x7f706c145250 2024-04-25T09:04:20.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.679+0000 7f7074400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f706c0cfff0 con 0x7f706c0cf6b0 2024-04-25T09:04:20.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f7074400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706c1605e0 con 0x7f706c0cf080 2024-04-25T09:04:20.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f7071a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f706c145250 0x7f706c0cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44196/0 (socket says 172.21.15.175:44196) 2024-04-25T09:04:20.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f7071a00640 1 -- 172.21.15.175:0/2053612001 learned_addr learned my addr 172.21.15.175:0/2053612001 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:20.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f7072400640 1 --2- 172.21.15.175:0/2053612001 >> v2:172.21.15.177:3300/0 conn(0x7f706c0cf080 0x7f706c1600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f706be00640 1 -- 172.21.15.175:0/2053612001 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320894546 0 0) 0x7f706c0cfd10 con 0x7f706c145250 2024-04-25T09:04:20.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f706be00640 1 -- 172.21.15.175:0/2053612001 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7054003530 con 0x7f706c145250 2024-04-25T09:04:20.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f706be00640 1 -- 172.21.15.175:0/2053612001 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1124004590 0 0) 0x7f7054003530 con 0x7f706c145250 2024-04-25T09:04:20.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f706be00640 1 -- 172.21.15.175:0/2053612001 >> v2:172.21.15.177:3300/0 conn(0x7f706c0cf080 msgr2=0x7f706c1600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:20.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f706be00640 1 --2- 172.21.15.175:0/2053612001 >> v2:172.21.15.177:3300/0 conn(0x7f706c0cf080 0x7f706c1600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f706be00640 1 -- 172.21.15.175:0/2053612001 >> v1:172.21.15.177:6789/0 conn(0x7f706c0cf6b0 legacy=0x7f706c0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f706be00640 1 -- 172.21.15.175:0/2053612001 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c15f8a0 con 0x7f706c145250 2024-04-25T09:04:20.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f706be00640 1 -- 172.21.15.175:0/2053612001 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f7060001680 con 0x7f706c145250 2024-04-25T09:04:20.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f706be00640 1 -- 172.21.15.175:0/2053612001 >> v1:172.21.15.175:6789/0 conn(0x7f706c145250 legacy=0x7f706c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f706be00640 1 --2- 172.21.15.175:0/2053612001 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70540039c0 0x7f7054003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f706be00640 1 --2- 172.21.15.175:0/2053612001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70540043c0 0x7f7054004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f706be00640 1 --2- 172.21.15.175:0/2053612001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7054005130 0x7f705400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f706be00640 1 -- 172.21.15.175:0/2053612001 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c1605e0 con 0x7f7054005130 2024-04-25T09:04:20.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f706be00640 1 -- 172.21.15.175:0/2053612001 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f705400c070 con 0x7f70540043c0 2024-04-25T09:04:20.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f706be00640 1 -- 172.21.15.175:0/2053612001 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f705400c270 con 0x7f70540039c0 2024-04-25T09:04:20.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f7072400640 1 --2- 172.21.15.175:0/2053612001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7054005130 0x7f705400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f7071000640 1 --2- 172.21.15.175:0/2053612001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70540043c0 0x7f7054004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f7071a00640 1 --2- 172.21.15.175:0/2053612001 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70540039c0 0x7f7054003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f7072400640 1 -- 172.21.15.175:0/2053612001 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70540039c0 msgr2=0x7f7054003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:20.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f7072400640 1 --2- 172.21.15.175:0/2053612001 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70540039c0 0x7f7054003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f7072400640 1 -- 172.21.15.175:0/2053612001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70540043c0 msgr2=0x7f7054004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:20.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f7072400640 1 --2- 172.21.15.175:0/2053612001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70540043c0 0x7f7054004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.683+0000 7f7072400640 1 -- 172.21.15.175:0/2053612001 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7054003530 con 0x7f7054005130 2024-04-25T09:04:20.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.687+0000 7f7072400640 1 -- 172.21.15.175:0/2053612001 reap_dead start 2024-04-25T09:04:20.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.687+0000 7f7072400640 1 --2- 172.21.15.175:0/2053612001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7054005130 0x7f705400b9d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7064009fc0 tx=0x7f706401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40646ddc016dc06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.687+0000 7f706be00640 1 -- 172.21.15.175:0/2053612001 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7064009c10 con 0x7f7054005130 2024-04-25T09:04:20.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.687+0000 7f706be00640 1 -- 172.21.15.175:0/2053612001 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70640a5d10 con 0x7f7054005130 2024-04-25T09:04:20.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.687+0000 7f706be00640 1 -- 172.21.15.175:0/2053612001 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7064003be0 con 0x7f7054005130 2024-04-25T09:04:20.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.687+0000 7f7074400640 1 -- 172.21.15.175:0/2053612001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7054005130 msgr2=0x7f705400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.687+0000 7f7074400640 1 --2- 172.21.15.175:0/2053612001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7054005130 0x7f705400b9d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7064009fc0 tx=0x7f706401ccc0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.687+0000 7f7074400640 1 -- 172.21.15.175:0/2053612001 shutdown_connections 2024-04-25T09:04:20.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.687+0000 7f7074400640 1 --2- 172.21.15.175:0/2053612001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7054005130 0x7f705400b9d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.687+0000 7f7074400640 1 -- 172.21.15.175:0/2053612001 >> 172.21.15.175:0/2053612001 conn(0x7f706c06ac50 msgr2=0x7f706c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.687+0000 7f7074400640 1 -- 172.21.15.175:0/2053612001 shutdown_connections 2024-04-25T09:04:20.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.687+0000 7f7074400640 1 -- 172.21.15.175:0/2053612001 wait complete. 2024-04-25T09:04:20.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.687+0000 7f7074400640 1 Processor -- start 2024-04-25T09:04:20.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.687+0000 7f7074400640 1 -- start start 2024-04-25T09:04:20.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7074400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7054005130 0x7f706c06e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7074400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f706c141b50 0x7f706c141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7074400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f706c0b2760 0x7f706c0b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7074400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c0cfb40 con 0x7f706c141b50 2024-04-25T09:04:20.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7074400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c15f650 con 0x7f7054005130 2024-04-25T09:04:20.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7074400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706c145630 con 0x7f706c0b2760 2024-04-25T09:04:20.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7071000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f706c141b50 0x7f706c141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7071000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f706c141b50 0x7f706c141fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46272/0 (socket says 172.21.15.175:46272) 2024-04-25T09:04:20.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7071000640 1 -- 172.21.15.175:0/2363772592 learned_addr learned my addr 172.21.15.175:0/2363772592 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:20.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7071a00640 1 --2- 172.21.15.175:0/2363772592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7054005130 0x7f706c06e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7072400640 1 --2- 172.21.15.175:0/2363772592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f706c0b2760 0x7f706c0b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7071000640 1 -- 172.21.15.175:0/2363772592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f706c0b2760 msgr2=0x7f706c0b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7071000640 1 --2- 172.21.15.175:0/2363772592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f706c0b2760 0x7f706c0b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7071000640 1 -- 172.21.15.175:0/2363772592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7054005130 msgr2=0x7f706c06e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7071000640 1 --2- 172.21.15.175:0/2363772592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7054005130 0x7f706c06e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7071000640 1 -- 172.21.15.175:0/2363772592 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c142510 con 0x7f706c141b50 2024-04-25T09:04:20.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7071000640 1 --2- 172.21.15.175:0/2363772592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f706c141b50 0x7f706c141fd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7058011c40 tx=0x7f705800f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7069600640 1 -- 172.21.15.175:0/2363772592 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7058019020 con 0x7f706c141b50 2024-04-25T09:04:20.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7069600640 1 -- 172.21.15.175:0/2363772592 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7058011c70 con 0x7f706c141b50 2024-04-25T09:04:20.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7069600640 1 -- 172.21.15.175:0/2363772592 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70580050d0 con 0x7f706c141b50 2024-04-25T09:04:20.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7074400640 1 -- 172.21.15.175:0/2363772592 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706c0b3450 con 0x7f706c141b50 2024-04-25T09:04:20.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7074400640 1 -- 172.21.15.175:0/2363772592 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706c0b3a10 con 0x7f706c141b50 2024-04-25T09:04:20.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7074400640 1 -- 172.21.15.175:0/2363772592 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706c075160 con 0x7f706c141b50 2024-04-25T09:04:20.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.691+0000 7f7069600640 1 -- 172.21.15.175:0/2363772592 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f705801c020 con 0x7f706c141b50 2024-04-25T09:04:20.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.695+0000 7f7069600640 1 --2- 172.21.15.175:0/2363772592 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f704c066f60 0x7f704c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.695+0000 7f7069600640 1 -- 172.21.15.175:0/2363772592 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7058088640 con 0x7f706c141b50 2024-04-25T09:04:20.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.695+0000 7f7071a00640 1 --2- 172.21.15.175:0/2363772592 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f704c066f60 0x7f704c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.695+0000 7f7071a00640 1 --2- 172.21.15.175:0/2363772592 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f704c066f60 0x7f704c069420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7060000c10 tx=0x7f7060007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.699+0000 7f7069600640 1 -- 172.21.15.175:0/2363772592 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7058023020 con 0x7f706c141b50 2024-04-25T09:04:20.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.851+0000 7f7074400640 1 -- 172.21.15.175:0/2363772592 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f706c0cfcc0 con 0x7f706c141b50 2024-04-25T09:04:20.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.851+0000 7f7069600640 1 -- 172.21.15.175:0/2363772592 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70580595b0 con 0x7f706c141b50 2024-04-25T09:04:20.842 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:04:20.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.851+0000 7f7074400640 1 -- 172.21.15.175:0/2363772592 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f704c066f60 msgr2=0x7f704c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.851+0000 7f7074400640 1 --2- 172.21.15.175:0/2363772592 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f704c066f60 0x7f704c069420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7060000c10 tx=0x7f7060007900 comp rx=0 tx=0).stop 2024-04-25T09:04:20.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.851+0000 7f7074400640 1 -- 172.21.15.175:0/2363772592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f706c141b50 msgr2=0x7f706c141fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.851+0000 7f7074400640 1 --2- 172.21.15.175:0/2363772592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f706c141b50 0x7f706c141fd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7058011c40 tx=0x7f705800f5a0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.851+0000 7f7074400640 1 -- 172.21.15.175:0/2363772592 shutdown_connections 2024-04-25T09:04:20.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.851+0000 7f7074400640 1 --2- 172.21.15.175:0/2363772592 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f704c066f60 0x7f704c069420 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.851+0000 7f7074400640 1 --2- 172.21.15.175:0/2363772592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f706c0b2760 0x7f706c0b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.851+0000 7f7074400640 1 --2- 172.21.15.175:0/2363772592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f706c141b50 0x7f706c141fd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.851+0000 7f7074400640 1 --2- 172.21.15.175:0/2363772592 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7054005130 0x7f706c06e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.851+0000 7f7074400640 1 -- 172.21.15.175:0/2363772592 >> 172.21.15.175:0/2363772592 conn(0x7f706c06ac50 msgr2=0x7f706c06d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.851+0000 7f7074400640 1 -- 172.21.15.175:0/2363772592 shutdown_connections 2024-04-25T09:04:20.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:20.851+0000 7f7074400640 1 -- 172.21.15.175:0/2363772592 wait complete. 2024-04-25T09:04:20.863 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:21.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.011+0000 7fccb6c00640 1 Processor -- start 2024-04-25T09:04:21.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.011+0000 7fccb6c00640 1 -- start start 2024-04-25T09:04:21.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.011+0000 7fccb6c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccb0161360 0x7fccb00ad990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.011+0000 7fccb6c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fccb00712d0 0x7fccb0071700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.011+0000 7fccb6c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb00ae250 con 0x7fccb00ae660 2024-04-25T09:04:21.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.011+0000 7fccb6c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb0071c40 con 0x7fccb00712d0 2024-04-25T09:04:21.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.011+0000 7fccb6c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb006f0e0 con 0x7fccb0161360 2024-04-25T09:04:21.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.011+0000 7fccafe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccb0161360 0x7fccb00ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.011+0000 7fccb4c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fccb00712d0 0x7fccb0071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.011+0000 7fccafe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccb0161360 0x7fccb00ad990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:39654/0 (socket says 172.21.15.175:39654) 2024-04-25T09:04:21.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.011+0000 7fccafe00640 1 -- 172.21.15.175:0/3375357690 learned_addr learned my addr 172.21.15.175:0/3375357690 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:21.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.011+0000 7fcca7400640 1 --1- 172.21.15.175:0/3375357690 >> v1:172.21.15.177:6789/0 conn(0x7fccb00ae660 0x7fccb006e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:47034/0 (socket says 172.21.15.175:47034) 2024-04-25T09:04:21.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.011+0000 7fccafe00640 1 -- 172.21.15.175:0/3375357690 >> v2:172.21.15.177:3300/0 conn(0x7fccb00712d0 msgr2=0x7fccb0071700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:21.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.011+0000 7fccafe00640 1 --2- 172.21.15.175:0/3375357690 >> v2:172.21.15.177:3300/0 conn(0x7fccb00712d0 0x7fccb0071700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.011+0000 7fccafe00640 1 -- 172.21.15.175:0/3375357690 >> v1:172.21.15.177:6789/0 conn(0x7fccb00ae660 legacy=0x7fccb006e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.011+0000 7fccafe00640 1 -- 172.21.15.175:0/3375357690 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb00adf70 con 0x7fccb0161360 2024-04-25T09:04:21.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.015+0000 7fccafe00640 1 --2- 172.21.15.175:0/3375357690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccb0161360 0x7fccb00ad990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009870 tx=0x7fcca001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=753bf5f712343ee5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.015+0000 7fccaf400640 1 -- 172.21.15.175:0/3375357690 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca00aa600 con 0x7fccb0161360 2024-04-25T09:04:21.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.015+0000 7fccaf400640 1 -- 172.21.15.175:0/3375357690 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca00af070 con 0x7fccb0161360 2024-04-25T09:04:21.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.015+0000 7fccaf400640 1 -- 172.21.15.175:0/3375357690 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca00aa9c0 con 0x7fccb0161360 2024-04-25T09:04:21.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.015+0000 7fccb6c00640 1 -- 172.21.15.175:0/3375357690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccb0161360 msgr2=0x7fccb00ad990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.015+0000 7fccb6c00640 1 --2- 172.21.15.175:0/3375357690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccb0161360 0x7fccb00ad990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009870 tx=0x7fcca001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.015+0000 7fccb6c00640 1 -- 172.21.15.175:0/3375357690 shutdown_connections 2024-04-25T09:04:21.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.015+0000 7fccb6c00640 1 --2- 172.21.15.175:0/3375357690 >> v2:172.21.15.177:3300/0 conn(0x7fccb00712d0 0x7fccb0071700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.015+0000 7fccb6c00640 1 --2- 172.21.15.175:0/3375357690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccb0161360 0x7fccb00ad990 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.015+0000 7fccb6c00640 1 -- 172.21.15.175:0/3375357690 >> 172.21.15.175:0/3375357690 conn(0x7fccb006ac50 msgr2=0x7fccb006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.015+0000 7fccb6c00640 1 -- 172.21.15.175:0/3375357690 shutdown_connections 2024-04-25T09:04:21.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.015+0000 7fccb6c00640 1 -- 172.21.15.175:0/3375357690 wait complete. 2024-04-25T09:04:21.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccb6c00640 1 Processor -- start 2024-04-25T09:04:21.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccb6c00640 1 -- start start 2024-04-25T09:04:21.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccb6c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccb00712d0 0x7fccb014cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccb6c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccb00ae660 0x7fccb014ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccb6c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccb0161360 0x7fccb0148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccb6c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb0072110 con 0x7fccb00712d0 2024-04-25T09:04:21.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccb6c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb0071f90 con 0x7fccb00ae660 2024-04-25T09:04:21.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccb6c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb016a900 con 0x7fccb0161360 2024-04-25T09:04:21.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccafe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccb00712d0 0x7fccb014cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccafe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccb00712d0 0x7fccb014cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46280/0 (socket says 172.21.15.175:46280) 2024-04-25T09:04:21.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccafe00640 1 -- 172.21.15.175:0/1832902636 learned_addr learned my addr 172.21.15.175:0/1832902636 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:21.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fcca7400640 1 --2- 172.21.15.175:0/1832902636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccb00ae660 0x7fccb014ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccb4c00640 1 --2- 172.21.15.175:0/1832902636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccb0161360 0x7fccb0148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccafe00640 1 -- 172.21.15.175:0/1832902636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccb0161360 msgr2=0x7fccb0148e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccafe00640 1 --2- 172.21.15.175:0/1832902636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccb0161360 0x7fccb0148e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccafe00640 1 -- 172.21.15.175:0/1832902636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccb00ae660 msgr2=0x7fccb014ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccafe00640 1 --2- 172.21.15.175:0/1832902636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccb00ae660 0x7fccb014ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccafe00640 1 -- 172.21.15.175:0/1832902636 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb0153f80 con 0x7fccb00712d0 2024-04-25T09:04:21.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccafe00640 1 --2- 172.21.15.175:0/1832902636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccb00712d0 0x7fccb014cd90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcca00ac040 tx=0x7fcca001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccacc00640 1 -- 172.21.15.175:0/1832902636 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca00bd5f0 con 0x7fccb00712d0 2024-04-25T09:04:21.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccacc00640 1 -- 172.21.15.175:0/1832902636 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca00bd790 con 0x7fccb00712d0 2024-04-25T09:04:21.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccacc00640 1 -- 172.21.15.175:0/1832902636 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca00bdb80 con 0x7fccb00712d0 2024-04-25T09:04:21.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccb6c00640 1 -- 172.21.15.175:0/1832902636 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb01541f0 con 0x7fccb00712d0 2024-04-25T09:04:21.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccb6c00640 1 -- 172.21.15.175:0/1832902636 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb01547b0 con 0x7fccb00712d0 2024-04-25T09:04:21.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.019+0000 7fccb6c00640 1 -- 172.21.15.175:0/1832902636 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb0075160 con 0x7fccb00712d0 2024-04-25T09:04:21.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.023+0000 7fccacc00640 1 -- 172.21.15.175:0/1832902636 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcca00a9070 con 0x7fccb00712d0 2024-04-25T09:04:21.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.023+0000 7fccacc00640 1 --2- 172.21.15.175:0/1832902636 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcc8c066f60 0x7fcc8c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.023+0000 7fccacc00640 1 -- 172.21.15.175:0/1832902636 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcca011f520 con 0x7fccb00712d0 2024-04-25T09:04:21.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.023+0000 7fcca7400640 1 --2- 172.21.15.175:0/1832902636 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcc8c066f60 0x7fcc8c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.023+0000 7fcca7400640 1 --2- 172.21.15.175:0/1832902636 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcc8c066f60 0x7fcc8c069420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fccb00d00d0 tx=0x7fcc98007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.027+0000 7fccacc00640 1 -- 172.21.15.175:0/1832902636 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcca0016150 con 0x7fccb00712d0 2024-04-25T09:04:21.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.179+0000 7fccb6c00640 1 -- 172.21.15.175:0/1832902636 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fccb0160880 con 0x7fccb00712d0 2024-04-25T09:04:21.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.179+0000 7fccacc00640 1 -- 172.21.15.175:0/1832902636 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcca00efdb0 con 0x7fccb00712d0 2024-04-25T09:04:21.173 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:04:21.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.183+0000 7fccb6c00640 1 -- 172.21.15.175:0/1832902636 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcc8c066f60 msgr2=0x7fcc8c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.183+0000 7fccb6c00640 1 --2- 172.21.15.175:0/1832902636 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcc8c066f60 0x7fcc8c069420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fccb00d00d0 tx=0x7fcc98007e90 comp rx=0 tx=0).stop 2024-04-25T09:04:21.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.183+0000 7fccb6c00640 1 -- 172.21.15.175:0/1832902636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccb00712d0 msgr2=0x7fccb014cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.183+0000 7fccb6c00640 1 --2- 172.21.15.175:0/1832902636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccb00712d0 0x7fccb014cd90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcca00ac040 tx=0x7fcca001ace0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.183+0000 7fccb6c00640 1 -- 172.21.15.175:0/1832902636 shutdown_connections 2024-04-25T09:04:21.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.183+0000 7fccb6c00640 1 --2- 172.21.15.175:0/1832902636 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcc8c066f60 0x7fcc8c069420 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.183+0000 7fccb6c00640 1 --2- 172.21.15.175:0/1832902636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccb0161360 0x7fccb0148e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.183+0000 7fccb6c00640 1 --2- 172.21.15.175:0/1832902636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccb00ae660 0x7fccb014ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.183+0000 7fccb6c00640 1 --2- 172.21.15.175:0/1832902636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccb00712d0 0x7fccb014cd90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.183+0000 7fccb6c00640 1 -- 172.21.15.175:0/1832902636 >> 172.21.15.175:0/1832902636 conn(0x7fccb006ac50 msgr2=0x7fccb015e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.183+0000 7fccb6c00640 1 -- 172.21.15.175:0/1832902636 shutdown_connections 2024-04-25T09:04:21.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.183+0000 7fccb6c00640 1 -- 172.21.15.175:0/1832902636 wait complete. 2024-04-25T09:04:21.193 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:21.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.335+0000 7f368e200640 1 Processor -- start 2024-04-25T09:04:21.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.335+0000 7f368e200640 1 -- start start 2024-04-25T09:04:21.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.339+0000 7f368e200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3688144fc0 0x7f36880cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.339+0000 7f368e200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f36881453a0 0x7f368815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.339+0000 7f368e200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f368815cd00 con 0x7f36880cc3b0 2024-04-25T09:04:21.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.339+0000 7f368e200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36880ce660 con 0x7f36881453a0 2024-04-25T09:04:21.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.339+0000 7f368e200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36880cc930 con 0x7f3688144fc0 2024-04-25T09:04:21.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.339+0000 7f3687400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3688144fc0 0x7f36880cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.339+0000 7f367fe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f36881453a0 0x7f368815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.339+0000 7f3687e00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f36880cc3b0 0x7f368815f480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:47038/0 (socket says 172.21.15.175:47038) 2024-04-25T09:04:21.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.339+0000 7f3687e00640 1 -- 172.21.15.175:0/3965606963 learned_addr learned my addr 172.21.15.175:0/3965606963 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:21.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.339+0000 7f3687400640 1 -- 172.21.15.175:0/3965606963 >> v2:172.21.15.177:3300/0 conn(0x7f36881453a0 msgr2=0x7f368815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:21.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.339+0000 7f3687400640 1 --2- 172.21.15.175:0/3965606963 >> v2:172.21.15.177:3300/0 conn(0x7f36881453a0 0x7f368815bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.339+0000 7f3687400640 1 -- 172.21.15.175:0/3965606963 >> v1:172.21.15.177:6789/0 conn(0x7f36880cc3b0 legacy=0x7f368815f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.339+0000 7f3686a00640 1 -- 172.21.15.175:0/3965606963 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182891728 0 0) 0x7f368815cd00 con 0x7f36880cc3b0 2024-04-25T09:04:21.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.339+0000 7f3687400640 1 -- 172.21.15.175:0/3965606963 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36880ccc10 con 0x7f3688144fc0 2024-04-25T09:04:21.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.343+0000 7f3687400640 1 --2- 172.21.15.175:0/3965606963 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3688144fc0 0x7f36880cbe70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f36780097c0 tx=0x7f367801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5105a04dcca99a41 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.343+0000 7f3686a00640 1 -- 172.21.15.175:0/3965606963 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780b2070 con 0x7f3688144fc0 2024-04-25T09:04:21.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.343+0000 7f3686a00640 1 -- 172.21.15.175:0/3965606963 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36780ad640 con 0x7f3688144fc0 2024-04-25T09:04:21.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.343+0000 7f3686a00640 1 -- 172.21.15.175:0/3965606963 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780ada10 con 0x7f3688144fc0 2024-04-25T09:04:21.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.343+0000 7f368e200640 1 -- 172.21.15.175:0/3965606963 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3688144fc0 msgr2=0x7f36880cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.343+0000 7f368e200640 1 --2- 172.21.15.175:0/3965606963 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3688144fc0 0x7f36880cbe70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f36780097c0 tx=0x7f367801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.343+0000 7f368e200640 1 -- 172.21.15.175:0/3965606963 shutdown_connections 2024-04-25T09:04:21.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.343+0000 7f368e200640 1 --2- 172.21.15.175:0/3965606963 >> v2:172.21.15.177:3300/0 conn(0x7f36881453a0 0x7f368815bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.343+0000 7f368e200640 1 --2- 172.21.15.175:0/3965606963 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3688144fc0 0x7f36880cbe70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.343+0000 7f368e200640 1 -- 172.21.15.175:0/3965606963 >> 172.21.15.175:0/3965606963 conn(0x7f3688067150 msgr2=0x7f368806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.343+0000 7f368e200640 1 -- 172.21.15.175:0/3965606963 shutdown_connections 2024-04-25T09:04:21.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.343+0000 7f368e200640 1 -- 172.21.15.175:0/3965606963 wait complete. 2024-04-25T09:04:21.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.343+0000 7f368e200640 1 Processor -- start 2024-04-25T09:04:21.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.343+0000 7f368e200640 1 -- start start 2024-04-25T09:04:21.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f368e200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3688144fc0 0x7f3688139080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f368e200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36881453a0 0x7f36881649c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f368e200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f368815b1c0 0x7f3688164f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f368e200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36880cffb0 con 0x7f3688144fc0 2024-04-25T09:04:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f368e200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36880cfe30 con 0x7f36881453a0 2024-04-25T09:04:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f368e200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36881685f0 con 0x7f368815b1c0 2024-04-25T09:04:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f3687400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3688144fc0 0x7f3688139080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f3687400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3688144fc0 0x7f3688139080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46296/0 (socket says 172.21.15.175:46296) 2024-04-25T09:04:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f3687400640 1 -- 172.21.15.175:0/1904382186 learned_addr learned my addr 172.21.15.175:0/1904382186 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f367fe00640 1 --2- 172.21.15.175:0/1904382186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36881453a0 0x7f36881649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f3687e00640 1 --2- 172.21.15.175:0/1904382186 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f368815b1c0 0x7f3688164f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f3687400640 1 -- 172.21.15.175:0/1904382186 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f368815b1c0 msgr2=0x7f3688164f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f3687400640 1 --2- 172.21.15.175:0/1904382186 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f368815b1c0 0x7f3688164f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f3687400640 1 -- 172.21.15.175:0/1904382186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36881453a0 msgr2=0x7f36881649c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f3687400640 1 --2- 172.21.15.175:0/1904382186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36881453a0 0x7f36881649c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f3687400640 1 -- 172.21.15.175:0/1904382186 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f368813dc70 con 0x7f3688144fc0 2024-04-25T09:04:21.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f367fe00640 1 --2- 172.21.15.175:0/1904382186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36881453a0 0x7f36881649c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:21.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f3687400640 1 --2- 172.21.15.175:0/1904382186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3688144fc0 0x7f3688139080 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f36780b0040 tx=0x7f3678019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f367f400640 1 -- 172.21.15.175:0/1904382186 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780ba020 con 0x7f3688144fc0 2024-04-25T09:04:21.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f367f400640 1 -- 172.21.15.175:0/1904382186 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36780b6410 con 0x7f3688144fc0 2024-04-25T09:04:21.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f367f400640 1 -- 172.21.15.175:0/1904382186 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780b2040 con 0x7f3688144fc0 2024-04-25T09:04:21.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f368e200640 1 -- 172.21.15.175:0/1904382186 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368813df50 con 0x7f3688144fc0 2024-04-25T09:04:21.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f368e200640 1 -- 172.21.15.175:0/1904382186 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368813e510 con 0x7f3688144fc0 2024-04-25T09:04:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f368e200640 1 -- 172.21.15.175:0/1904382186 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3688074a60 con 0x7f3688144fc0 2024-04-25T09:04:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.347+0000 7f367f400640 1 -- 172.21.15.175:0/1904382186 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f36780bd020 con 0x7f3688144fc0 2024-04-25T09:04:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.351+0000 7f367f400640 1 --2- 172.21.15.175:0/1904382186 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3664066f60 0x7f3664069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.351+0000 7f367f400640 1 -- 172.21.15.175:0/1904382186 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f367811efe0 con 0x7f3688144fc0 2024-04-25T09:04:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.351+0000 7f367fe00640 1 --2- 172.21.15.175:0/1904382186 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3664066f60 0x7f3664069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.351+0000 7f367fe00640 1 --2- 172.21.15.175:0/1904382186 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3664066f60 0x7f3664069420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f368813d5f0 tx=0x7f3670008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.355+0000 7f367f400640 1 -- 172.21.15.175:0/1904382186 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f36780c4030 con 0x7f3688144fc0 2024-04-25T09:04:21.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.539+0000 7f368e200640 1 -- 172.21.15.175:0/1904382186 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36880cbf10 con 0x7f3688144fc0 2024-04-25T09:04:21.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.539+0000 7f367f400640 1 -- 172.21.15.175:0/1904382186 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4938 (secure 0 0 0) 0x7f3678016090 con 0x7f3688144fc0 2024-04-25T09:04:21.532 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:21.532 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/989886914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":989886914},{"type":"v1","addr":"172.21.15.175:6837","nonce":989886914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/611556493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":611556493},{"type":"v1","addr":"172.21.15.177:6833","nonce":611556493}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1366486960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1366486960},{"type":"v1","addr":"172.21.15.177:6835","nonce":1366486960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:09.810111+0000","modified":"2024-04-25T09:04:12.820376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6836/2613139594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2613139594},{"type":"v1","addr":"172.21.15.175:6836","nonce":2613139594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:04:21.533 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 8 2024-04-25T09:04:21.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.543+0000 7f368e200640 1 -- 172.21.15.175:0/1904382186 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3664066f60 msgr2=0x7f3664069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.543+0000 7f368e200640 1 --2- 172.21.15.175:0/1904382186 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3664066f60 0x7f3664069420 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f368813d5f0 tx=0x7f3670008040 comp rx=0 tx=0).stop 2024-04-25T09:04:21.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.543+0000 7f368e200640 1 -- 172.21.15.175:0/1904382186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3688144fc0 msgr2=0x7f3688139080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.543+0000 7f368e200640 1 --2- 172.21.15.175:0/1904382186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3688144fc0 0x7f3688139080 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f36780b0040 tx=0x7f3678019240 comp rx=0 tx=0).stop 2024-04-25T09:04:21.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.543+0000 7f368e200640 1 -- 172.21.15.175:0/1904382186 shutdown_connections 2024-04-25T09:04:21.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.543+0000 7f368e200640 1 --2- 172.21.15.175:0/1904382186 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3664066f60 0x7f3664069420 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.543+0000 7f368e200640 1 --2- 172.21.15.175:0/1904382186 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f368815b1c0 0x7f3688164f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.543+0000 7f368e200640 1 --2- 172.21.15.175:0/1904382186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36881453a0 0x7f36881649c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.543+0000 7f368e200640 1 --2- 172.21.15.175:0/1904382186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3688144fc0 0x7f3688139080 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.543+0000 7f368e200640 1 -- 172.21.15.175:0/1904382186 >> 172.21.15.175:0/1904382186 conn(0x7f36880cc3b0 msgr2=0x7f368806e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.543+0000 7f368e200640 1 -- 172.21.15.175:0/1904382186 shutdown_connections 2024-04-25T09:04:21.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.543+0000 7f368e200640 1 -- 172.21.15.175:0/1904382186 wait complete. 2024-04-25T09:04:21.554 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:21.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.699+0000 7fe494000640 1 Processor -- start 2024-04-25T09:04:21.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.699+0000 7fe494000640 1 -- start start 2024-04-25T09:04:21.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.699+0000 7fe494000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe48c15a900 0x7fe48c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.699+0000 7fe494000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c0cf560 0x7fe48c0cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.699+0000 7fe494000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48c0cda00 con 0x7fe48c0cd520 2024-04-25T09:04:21.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.699+0000 7fe494000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48c15bcf0 con 0x7fe48c15a900 2024-04-25T09:04:21.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.699+0000 7fe494000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c0cfef0 con 0x7fe48c0cf560 2024-04-25T09:04:21.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.699+0000 7fe491600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe48c15a900 0x7fe48c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.699+0000 7fe490c00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe48c0cd520 0x7fe48c0ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:47042/0 (socket says 172.21.15.175:47042) 2024-04-25T09:04:21.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.699+0000 7fe490c00640 1 -- 172.21.15.175:0/1093910874 learned_addr learned my addr 172.21.15.175:0/1093910874 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:21.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.699+0000 7fe492000640 1 --2- 172.21.15.175:0/1093910874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c0cf560 0x7fe48c0cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.699+0000 7fe491600640 1 -- 172.21.15.175:0/1093910874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c0cf560 msgr2=0x7fe48c0cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:21.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.699+0000 7fe491600640 1 --2- 172.21.15.175:0/1093910874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c0cf560 0x7fe48c0cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.699+0000 7fe491600640 1 -- 172.21.15.175:0/1093910874 >> v1:172.21.15.177:6789/0 conn(0x7fe48c0cd520 legacy=0x7fe48c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.699+0000 7fe491600640 1 -- 172.21.15.175:0/1093910874 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c0cdce0 con 0x7fe48c15a900 2024-04-25T09:04:21.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.699+0000 7fe48be00640 1 -- 172.21.15.175:0/1093910874 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363787481 0 0) 0x7fe48c0cda00 con 0x7fe48c0cd520 2024-04-25T09:04:21.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.703+0000 7fe491600640 1 --2- 172.21.15.175:0/1093910874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c15a900 0x7fe48c06e150 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe4800097c0 tx=0x7fe48001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8d7693f692359c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.703+0000 7fe48be00640 1 -- 172.21.15.175:0/1093910874 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4800b2070 con 0x7fe48c15a900 2024-04-25T09:04:21.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.703+0000 7fe48be00640 1 -- 172.21.15.175:0/1093910874 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4800ad640 con 0x7fe48c15a900 2024-04-25T09:04:21.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.703+0000 7fe48be00640 1 -- 172.21.15.175:0/1093910874 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4800ada10 con 0x7fe48c15a900 2024-04-25T09:04:21.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.703+0000 7fe494000640 1 -- 172.21.15.175:0/1093910874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c15a900 msgr2=0x7fe48c06e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.703+0000 7fe494000640 1 --2- 172.21.15.175:0/1093910874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c15a900 0x7fe48c06e150 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe4800097c0 tx=0x7fe48001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.703+0000 7fe494000640 1 -- 172.21.15.175:0/1093910874 shutdown_connections 2024-04-25T09:04:21.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.703+0000 7fe494000640 1 --2- 172.21.15.175:0/1093910874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c0cf560 0x7fe48c0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.703+0000 7fe494000640 1 --2- 172.21.15.175:0/1093910874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c15a900 0x7fe48c06e150 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.703+0000 7fe494000640 1 -- 172.21.15.175:0/1093910874 >> 172.21.15.175:0/1093910874 conn(0x7fe48c067150 msgr2=0x7fe48c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.703+0000 7fe494000640 1 -- 172.21.15.175:0/1093910874 shutdown_connections 2024-04-25T09:04:21.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.703+0000 7fe494000640 1 -- 172.21.15.175:0/1093910874 wait complete. 2024-04-25T09:04:21.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe494000640 1 Processor -- start 2024-04-25T09:04:21.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe494000640 1 -- start start 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe494000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c0cf560 0x7fe48c0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe494000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe48c15a900 0x7fe48c0afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe494000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c142840 0x7fe48c141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe494000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c06d530 con 0x7fe48c15a900 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe494000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c06d3b0 con 0x7fe48c0cf560 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe494000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48c15c790 con 0x7fe48c142840 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe490c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe48c15a900 0x7fe48c0afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe490c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe48c15a900 0x7fe48c0afc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46304/0 (socket says 172.21.15.175:46304) 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe490c00640 1 -- 172.21.15.175:0/144612767 learned_addr learned my addr 172.21.15.175:0/144612767 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe491600640 1 --2- 172.21.15.175:0/144612767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c0cf560 0x7fe48c0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe492000640 1 --2- 172.21.15.175:0/144612767 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c142840 0x7fe48c141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe490c00640 1 -- 172.21.15.175:0/144612767 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c142840 msgr2=0x7fe48c141bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe490c00640 1 --2- 172.21.15.175:0/144612767 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c142840 0x7fe48c141bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe490c00640 1 -- 172.21.15.175:0/144612767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c0cf560 msgr2=0x7fe48c0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe490c00640 1 --2- 172.21.15.175:0/144612767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c0cf560 0x7fe48c0b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe490c00640 1 -- 172.21.15.175:0/144612767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c158100 con 0x7fe48c15a900 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe490c00640 1 --2- 172.21.15.175:0/144612767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe48c15a900 0x7fe48c0afc30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe47800c4e0 tx=0x7fe47800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe489600640 1 -- 172.21.15.175:0/144612767 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe478018070 con 0x7fe48c15a900 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe489600640 1 -- 172.21.15.175:0/144612767 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe478007500 con 0x7fe48c15a900 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe489600640 1 -- 172.21.15.175:0/144612767 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe478004a30 con 0x7fe48c15a900 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe494000640 1 -- 172.21.15.175:0/144612767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48c1583a0 con 0x7fe48c15a900 2024-04-25T09:04:21.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.707+0000 7fe494000640 1 -- 172.21.15.175:0/144612767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48c158960 con 0x7fe48c15a900 2024-04-25T09:04:21.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.711+0000 7fe494000640 1 -- 172.21.15.175:0/144612767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48c074a60 con 0x7fe48c15a900 2024-04-25T09:04:21.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.711+0000 7fe489600640 1 -- 172.21.15.175:0/144612767 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe478004bd0 con 0x7fe48c15a900 2024-04-25T09:04:21.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.711+0000 7fe489600640 1 --2- 172.21.15.175:0/144612767 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe46c066f60 0x7fe46c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.711+0000 7fe489600640 1 -- 172.21.15.175:0/144612767 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4780842c0 con 0x7fe48c15a900 2024-04-25T09:04:21.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.711+0000 7fe491600640 1 --2- 172.21.15.175:0/144612767 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe46c066f60 0x7fe46c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.711+0000 7fe491600640 1 --2- 172.21.15.175:0/144612767 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe46c066f60 0x7fe46c069420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe4800af000 tx=0x7fe480008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.715+0000 7fe489600640 1 -- 172.21.15.175:0/144612767 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe478054d30 con 0x7fe48c15a900 2024-04-25T09:04:21.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.867+0000 7fe494000640 1 -- 172.21.15.175:0/144612767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe48c071fc0 con 0x7fe48c15a900 2024-04-25T09:04:21.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.871+0000 7fe489600640 1 -- 172.21.15.175:0/144612767 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7fe47805b080 con 0x7fe48c15a900 2024-04-25T09:04:21.861 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:21.862 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":20,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:11.440551+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:21.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.871+0000 7fe494000640 1 -- 172.21.15.175:0/144612767 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe46c066f60 msgr2=0x7fe46c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.871+0000 7fe494000640 1 --2- 172.21.15.175:0/144612767 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe46c066f60 0x7fe46c069420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe4800af000 tx=0x7fe480008040 comp rx=0 tx=0).stop 2024-04-25T09:04:21.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.871+0000 7fe494000640 1 -- 172.21.15.175:0/144612767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe48c15a900 msgr2=0x7fe48c0afc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.871+0000 7fe494000640 1 --2- 172.21.15.175:0/144612767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe48c15a900 0x7fe48c0afc30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe47800c4e0 tx=0x7fe47800c9a0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.871+0000 7fe494000640 1 -- 172.21.15.175:0/144612767 shutdown_connections 2024-04-25T09:04:21.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.871+0000 7fe494000640 1 --2- 172.21.15.175:0/144612767 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe46c066f60 0x7fe46c069420 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.871+0000 7fe494000640 1 --2- 172.21.15.175:0/144612767 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe48c142840 0x7fe48c141bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.871+0000 7fe494000640 1 --2- 172.21.15.175:0/144612767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe48c15a900 0x7fe48c0afc30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.871+0000 7fe494000640 1 --2- 172.21.15.175:0/144612767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe48c0cf560 0x7fe48c0b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.871+0000 7fe494000640 1 -- 172.21.15.175:0/144612767 >> 172.21.15.175:0/144612767 conn(0x7fe48c0cd520 msgr2=0x7fe48c15b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.871+0000 7fe494000640 1 -- 172.21.15.175:0/144612767 shutdown_connections 2024-04-25T09:04:21.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:21.871+0000 7fe494000640 1 -- 172.21.15.175:0/144612767 wait complete. 2024-04-25T09:04:21.883 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:08.047706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:04:08.795449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:21.883 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:22.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.027+0000 7ffa37000640 1 Processor -- start 2024-04-25T09:04:22.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.027+0000 7ffa37000640 1 -- start start 2024-04-25T09:04:22.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.031+0000 7ffa37000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffa300b0c00 0x7ffa300afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.031+0000 7ffa37000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ffa300af980 0x7ffa3006ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.031+0000 7ffa37000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa3006b340 0x7ffa3006b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.031+0000 7ffa37000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa300b2010 con 0x7ffa300b0c00 2024-04-25T09:04:22.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.031+0000 7ffa37000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa300ce6d0 con 0x7ffa300af980 2024-04-25T09:04:22.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.031+0000 7ffa37000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa300ccc80 con 0x7ffa3006b340 2024-04-25T09:04:22.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.031+0000 7ffa35000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa3006b340 0x7ffa3006b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.031+0000 7ffa2f400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ffa300af980 0x7ffa3006ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.031+0000 7ffa2fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffa300b0c00 0x7ffa300afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.031+0000 7ffa2f400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ffa300af980 0x7ffa3006ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:59824/0 (socket says 172.21.15.175:59824) 2024-04-25T09:04:22.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.031+0000 7ffa2f400640 1 -- 172.21.15.175:0/1593827255 learned_addr learned my addr 172.21.15.175:0/1593827255 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:22.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.031+0000 7ffa35000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa3006b340 0x7ffa3006b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:39718/0 (socket says 172.21.15.175:39718) 2024-04-25T09:04:22.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.031+0000 7ffa2f400640 1 -- 172.21.15.175:0/1593827255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa3006b340 msgr2=0x7ffa3006b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:22.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.031+0000 7ffa2f400640 1 --2- 172.21.15.175:0/1593827255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa3006b340 0x7ffa3006b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.031+0000 7ffa2f400640 1 -- 172.21.15.175:0/1593827255 >> v2:172.21.15.175:3300/0 conn(0x7ffa300b0c00 msgr2=0x7ffa300afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:22.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.031+0000 7ffa2f400640 1 --2- 172.21.15.175:0/1593827255 >> v2:172.21.15.175:3300/0 conn(0x7ffa300b0c00 0x7ffa300afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.031+0000 7ffa2f400640 1 -- 172.21.15.175:0/1593827255 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa300ccf60 con 0x7ffa300af980 2024-04-25T09:04:22.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.031+0000 7ffa2fe00640 1 --2- 172.21.15.175:0/1593827255 >> v2:172.21.15.175:3300/0 conn(0x7ffa300b0c00 0x7ffa300afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:22.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.035+0000 7ffa2f400640 1 --2- 172.21.15.175:0/1593827255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa300af980 0x7ffa3006ae00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa3006cf90 tx=0x7ffa1c01c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e340c6cf56792013 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.035+0000 7ffa2ea00640 1 -- 172.21.15.175:0/1593827255 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c0aa610 con 0x7ffa300af980 2024-04-25T09:04:22.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.035+0000 7ffa2ea00640 1 -- 172.21.15.175:0/1593827255 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1c0af070 con 0x7ffa300af980 2024-04-25T09:04:22.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.035+0000 7ffa2ea00640 1 -- 172.21.15.175:0/1593827255 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c0aa9d0 con 0x7ffa300af980 2024-04-25T09:04:22.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.035+0000 7ffa37000640 1 -- 172.21.15.175:0/1593827255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa300af980 msgr2=0x7ffa3006ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.035+0000 7ffa37000640 1 --2- 172.21.15.175:0/1593827255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa300af980 0x7ffa3006ae00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa3006cf90 tx=0x7ffa1c01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.035+0000 7ffa37000640 1 -- 172.21.15.175:0/1593827255 shutdown_connections 2024-04-25T09:04:22.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.035+0000 7ffa37000640 1 --2- 172.21.15.175:0/1593827255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa3006b340 0x7ffa3006b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.035+0000 7ffa37000640 1 --2- 172.21.15.175:0/1593827255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa300af980 0x7ffa3006ae00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.035+0000 7ffa37000640 1 --2- 172.21.15.175:0/1593827255 >> v2:172.21.15.175:3300/0 conn(0x7ffa300b0c00 0x7ffa300afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.035+0000 7ffa37000640 1 -- 172.21.15.175:0/1593827255 >> 172.21.15.175:0/1593827255 conn(0x7ffa300d07e0 msgr2=0x7ffa300d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.035+0000 7ffa37000640 1 -- 172.21.15.175:0/1593827255 shutdown_connections 2024-04-25T09:04:22.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.035+0000 7ffa37000640 1 -- 172.21.15.175:0/1593827255 wait complete. 2024-04-25T09:04:22.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.035+0000 7ffa37000640 1 Processor -- start 2024-04-25T09:04:22.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.035+0000 7ffa37000640 1 -- start start 2024-04-25T09:04:22.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa37000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa3006b340 0x7ffa30157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa37000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa300af980 0x7ffa3014cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa37000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa300b0c00 0x7ffa30152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa37000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa30162340 con 0x7ffa300af980 2024-04-25T09:04:22.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa37000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa301621c0 con 0x7ffa300b0c00 2024-04-25T09:04:22.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa37000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa301624c0 con 0x7ffa3006b340 2024-04-25T09:04:22.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa2f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa300af980 0x7ffa3014cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa2f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa300af980 0x7ffa3014cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46326/0 (socket says 172.21.15.175:46326) 2024-04-25T09:04:22.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa2f400640 1 -- 172.21.15.175:0/3682142466 learned_addr learned my addr 172.21.15.175:0/3682142466 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:22.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa2fe00640 1 --2- 172.21.15.175:0/3682142466 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa3006b340 0x7ffa30157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa35000640 1 --2- 172.21.15.175:0/3682142466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa300b0c00 0x7ffa30152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa2f400640 1 -- 172.21.15.175:0/3682142466 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa3006b340 msgr2=0x7ffa30157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa2f400640 1 --2- 172.21.15.175:0/3682142466 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa3006b340 0x7ffa30157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa2f400640 1 -- 172.21.15.175:0/3682142466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa300b0c00 msgr2=0x7ffa30152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa2f400640 1 --2- 172.21.15.175:0/3682142466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa300b0c00 0x7ffa30152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa2f400640 1 -- 172.21.15.175:0/3682142466 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa30157ad0 con 0x7ffa300af980 2024-04-25T09:04:22.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa35000640 1 --2- 172.21.15.175:0/3682142466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa300b0c00 0x7ffa30152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:22.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa2f400640 1 --2- 172.21.15.175:0/3682142466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa300af980 0x7ffa3014cec0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c01aba0 tx=0x7ffa1c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa27e00640 1 -- 172.21.15.175:0/3682142466 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c0bd3f0 con 0x7ffa300af980 2024-04-25T09:04:22.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa27e00640 1 -- 172.21.15.175:0/3682142466 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1c0bd590 con 0x7ffa300af980 2024-04-25T09:04:22.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa27e00640 1 -- 172.21.15.175:0/3682142466 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c0bd980 con 0x7ffa300af980 2024-04-25T09:04:22.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa37000640 1 -- 172.21.15.175:0/3682142466 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa30157db0 con 0x7ffa300af980 2024-04-25T09:04:22.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa37000640 1 -- 172.21.15.175:0/3682142466 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa30158370 con 0x7ffa300af980 2024-04-25T09:04:22.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa37000640 1 -- 172.21.15.175:0/3682142466 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa3006ccf0 con 0x7ffa300af980 2024-04-25T09:04:22.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.039+0000 7ffa27e00640 1 -- 172.21.15.175:0/3682142466 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffa1c0b33f0 con 0x7ffa300af980 2024-04-25T09:04:22.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.043+0000 7ffa27e00640 1 --2- 172.21.15.175:0/3682142466 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffa10066f60 0x7ffa10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.043+0000 7ffa27e00640 1 -- 172.21.15.175:0/3682142466 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa1c11f5e0 con 0x7ffa300af980 2024-04-25T09:04:22.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.043+0000 7ffa2fe00640 1 --2- 172.21.15.175:0/3682142466 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffa10066f60 0x7ffa10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.043+0000 7ffa2fe00640 1 --2- 172.21.15.175:0/3682142466 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffa10066f60 0x7ffa10069420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffa20009580 tx=0x7ffa20009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.047+0000 7ffa27e00640 1 -- 172.21.15.175:0/3682142466 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffa1c0c3060 con 0x7ffa300af980 2024-04-25T09:04:22.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.199+0000 7ffa37000640 1 -- 172.21.15.175:0/3682142466 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa30075160 con 0x7ffa300af980 2024-04-25T09:04:22.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.199+0000 7ffa27e00640 1 -- 172.21.15.175:0/3682142466 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa1c0a7070 con 0x7ffa300af980 2024-04-25T09:04:22.191 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:04:22.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.203+0000 7ffa37000640 1 -- 172.21.15.175:0/3682142466 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffa10066f60 msgr2=0x7ffa10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.203+0000 7ffa37000640 1 --2- 172.21.15.175:0/3682142466 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffa10066f60 0x7ffa10069420 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffa20009580 tx=0x7ffa20009190 comp rx=0 tx=0).stop 2024-04-25T09:04:22.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.203+0000 7ffa37000640 1 -- 172.21.15.175:0/3682142466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa300af980 msgr2=0x7ffa3014cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.203+0000 7ffa37000640 1 --2- 172.21.15.175:0/3682142466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa300af980 0x7ffa3014cec0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c01aba0 tx=0x7ffa1c01ad30 comp rx=0 tx=0).stop 2024-04-25T09:04:22.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.203+0000 7ffa37000640 1 -- 172.21.15.175:0/3682142466 shutdown_connections 2024-04-25T09:04:22.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.203+0000 7ffa37000640 1 --2- 172.21.15.175:0/3682142466 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffa10066f60 0x7ffa10069420 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.203+0000 7ffa37000640 1 --2- 172.21.15.175:0/3682142466 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa300b0c00 0x7ffa30152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.203+0000 7ffa37000640 1 --2- 172.21.15.175:0/3682142466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa300af980 0x7ffa3014cec0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.203+0000 7ffa37000640 1 --2- 172.21.15.175:0/3682142466 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa3006b340 0x7ffa30157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.203+0000 7ffa37000640 1 -- 172.21.15.175:0/3682142466 >> 172.21.15.175:0/3682142466 conn(0x7ffa300d07e0 msgr2=0x7ffa300d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.203+0000 7ffa37000640 1 -- 172.21.15.175:0/3682142466 shutdown_connections 2024-04-25T09:04:22.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.203+0000 7ffa37000640 1 -- 172.21.15.175:0/3682142466 wait complete. 2024-04-25T09:04:22.212 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:22.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.359+0000 7f45dee00640 1 Processor -- start 2024-04-25T09:04:22.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.359+0000 7f45dee00640 1 -- start start 2024-04-25T09:04:22.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.359+0000 7f45dee00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d815dcb0 0x7f45d806ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.359+0000 7f45dee00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f45d80cd730 0x7f45d806b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.359+0000 7f45dee00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d81619f0 con 0x7f45d80af730 2024-04-25T09:04:22.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.359+0000 7f45dee00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d8070d40 con 0x7f45d80cd730 2024-04-25T09:04:22.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.359+0000 7f45dee00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d815e090 con 0x7f45d815dcb0 2024-04-25T09:04:22.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.359+0000 7f45d7400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f45d80cd730 0x7f45d806b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.359+0000 7f45dce00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f45d80af730 0x7f45d80d06a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:47044/0 (socket says 172.21.15.175:47044) 2024-04-25T09:04:22.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.359+0000 7f45dce00640 1 -- 172.21.15.175:0/2870773698 learned_addr learned my addr 172.21.15.175:0/2870773698 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:22.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.359+0000 7f45d7e00640 1 --2- 172.21.15.175:0/2870773698 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d815dcb0 0x7f45d806ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.363+0000 7f45d7400640 1 -- 172.21.15.175:0/2870773698 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d815dcb0 msgr2=0x7f45d806ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:22.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.363+0000 7f45d7400640 1 --2- 172.21.15.175:0/2870773698 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d815dcb0 0x7f45d806ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.363+0000 7f45d7400640 1 -- 172.21.15.175:0/2870773698 >> v1:172.21.15.177:6789/0 conn(0x7f45d80af730 legacy=0x7f45d80d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.363+0000 7f45d7400640 1 -- 172.21.15.175:0/2870773698 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d8161cd0 con 0x7f45d80cd730 2024-04-25T09:04:22.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.363+0000 7f45d7400640 1 --2- 172.21.15.175:0/2870773698 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45d80cd730 0x7f45d806b340 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f45c40097c0 tx=0x7f45c401c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8a3fe2c4a7c0f8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.363+0000 7f45d6a00640 1 -- 172.21.15.175:0/2870773698 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c40b0070 con 0x7f45d80cd730 2024-04-25T09:04:22.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.363+0000 7f45d6a00640 1 -- 172.21.15.175:0/2870773698 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c40ab600 con 0x7f45d80cd730 2024-04-25T09:04:22.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.363+0000 7f45d6a00640 1 -- 172.21.15.175:0/2870773698 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c40ab9d0 con 0x7f45d80cd730 2024-04-25T09:04:22.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.363+0000 7f45dee00640 1 -- 172.21.15.175:0/2870773698 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45d80cd730 msgr2=0x7f45d806b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.363+0000 7f45dee00640 1 --2- 172.21.15.175:0/2870773698 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45d80cd730 0x7f45d806b340 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f45c40097c0 tx=0x7f45c401c330 comp rx=0 tx=0).stop 2024-04-25T09:04:22.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45dee00640 1 -- 172.21.15.175:0/2870773698 shutdown_connections 2024-04-25T09:04:22.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45dee00640 1 --2- 172.21.15.175:0/2870773698 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45d80cd730 0x7f45d806b340 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45dee00640 1 --2- 172.21.15.175:0/2870773698 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d815dcb0 0x7f45d806ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45dee00640 1 -- 172.21.15.175:0/2870773698 >> 172.21.15.175:0/2870773698 conn(0x7f45d806e420 msgr2=0x7f45d806e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45dee00640 1 -- 172.21.15.175:0/2870773698 shutdown_connections 2024-04-25T09:04:22.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45dee00640 1 -- 172.21.15.175:0/2870773698 wait complete. 2024-04-25T09:04:22.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45dee00640 1 Processor -- start 2024-04-25T09:04:22.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45dee00640 1 -- start start 2024-04-25T09:04:22.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45dee00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d80af730 0x7f45d814c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45dee00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45d80cd730 0x7f45d8155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45dee00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d815dcb0 0x7f45d80cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45dee00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d8162600 con 0x7f45d815dcb0 2024-04-25T09:04:22.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45dee00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d81617a0 con 0x7f45d80cd730 2024-04-25T09:04:22.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45dee00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d8162290 con 0x7f45d80af730 2024-04-25T09:04:22.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45dce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d815dcb0 0x7f45d80cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45d7e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d80af730 0x7f45d814c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45dce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d815dcb0 0x7f45d80cecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46340/0 (socket says 172.21.15.175:46340) 2024-04-25T09:04:22.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45dce00640 1 -- 172.21.15.175:0/1547638373 learned_addr learned my addr 172.21.15.175:0/1547638373 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:22.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45d7400640 1 --2- 172.21.15.175:0/1547638373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45d80cd730 0x7f45d8155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45d7400640 1 -- 172.21.15.175:0/1547638373 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d80af730 msgr2=0x7f45d814c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45d7400640 1 --2- 172.21.15.175:0/1547638373 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d80af730 0x7f45d814c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45d7400640 1 -- 172.21.15.175:0/1547638373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d815dcb0 msgr2=0x7f45d80cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45d7400640 1 --2- 172.21.15.175:0/1547638373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d815dcb0 0x7f45d80cecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45d7400640 1 -- 172.21.15.175:0/1547638373 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d8153b50 con 0x7f45d80cd730 2024-04-25T09:04:22.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45dce00640 1 --2- 172.21.15.175:0/1547638373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d815dcb0 0x7f45d80cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:22.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.367+0000 7f45d7400640 1 --2- 172.21.15.175:0/1547638373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45d80cd730 0x7f45d8155450 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f45d806f030 tx=0x7f45c40190d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.371+0000 7f45cfe00640 1 -- 172.21.15.175:0/1547638373 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c40b0040 con 0x7f45d80cd730 2024-04-25T09:04:22.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.371+0000 7f45cfe00640 1 -- 172.21.15.175:0/1547638373 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c40ba070 con 0x7f45d80cd730 2024-04-25T09:04:22.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.371+0000 7f45cfe00640 1 -- 172.21.15.175:0/1547638373 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c40aaa10 con 0x7f45d80cd730 2024-04-25T09:04:22.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.371+0000 7f45dee00640 1 -- 172.21.15.175:0/1547638373 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d8153df0 con 0x7f45d80cd730 2024-04-25T09:04:22.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.371+0000 7f45dee00640 1 -- 172.21.15.175:0/1547638373 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d81543b0 con 0x7f45d80cd730 2024-04-25T09:04:22.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.371+0000 7f45dee00640 1 -- 172.21.15.175:0/1547638373 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d8075160 con 0x7f45d80cd730 2024-04-25T09:04:22.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.371+0000 7f45cfe00640 1 -- 172.21.15.175:0/1547638373 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f45c40aabb0 con 0x7f45d80cd730 2024-04-25T09:04:22.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.371+0000 7f45cfe00640 1 --2- 172.21.15.175:0/1547638373 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f45b8066f60 0x7f45b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.371+0000 7f45cfe00640 1 -- 172.21.15.175:0/1547638373 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45c411faf0 con 0x7f45d80cd730 2024-04-25T09:04:22.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.371+0000 7f45d7e00640 1 --2- 172.21.15.175:0/1547638373 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f45b8066f60 0x7f45b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.375+0000 7f45d7e00640 1 --2- 172.21.15.175:0/1547638373 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f45b8066f60 0x7f45b8069420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009ac0 tx=0x7f45c8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.375+0000 7f45cfe00640 1 -- 172.21.15.175:0/1547638373 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f45c4015fb0 con 0x7f45d80cd730 2024-04-25T09:04:22.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.539+0000 7f45dee00640 1 -- 172.21.15.175:0/1547638373 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45d815d4e0 con 0x7f45d80cd730 2024-04-25T09:04:22.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.539+0000 7f45cfe00640 1 -- 172.21.15.175:0/1547638373 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45c40f0490 con 0x7f45d80cd730 2024-04-25T09:04:22.530 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:04:22.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.539+0000 7f45dee00640 1 -- 172.21.15.175:0/1547638373 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f45b8066f60 msgr2=0x7f45b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.539+0000 7f45dee00640 1 --2- 172.21.15.175:0/1547638373 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f45b8066f60 0x7f45b8069420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009ac0 tx=0x7f45c8009190 comp rx=0 tx=0).stop 2024-04-25T09:04:22.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.539+0000 7f45dee00640 1 -- 172.21.15.175:0/1547638373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45d80cd730 msgr2=0x7f45d8155450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.539+0000 7f45dee00640 1 --2- 172.21.15.175:0/1547638373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45d80cd730 0x7f45d8155450 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f45d806f030 tx=0x7f45c40190d0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.539+0000 7f45dee00640 1 -- 172.21.15.175:0/1547638373 shutdown_connections 2024-04-25T09:04:22.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.539+0000 7f45dee00640 1 --2- 172.21.15.175:0/1547638373 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f45b8066f60 0x7f45b8069420 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.539+0000 7f45dee00640 1 --2- 172.21.15.175:0/1547638373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d815dcb0 0x7f45d80cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.539+0000 7f45dee00640 1 --2- 172.21.15.175:0/1547638373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45d80cd730 0x7f45d8155450 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.539+0000 7f45dee00640 1 --2- 172.21.15.175:0/1547638373 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d80af730 0x7f45d814c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.539+0000 7f45dee00640 1 -- 172.21.15.175:0/1547638373 >> 172.21.15.175:0/1547638373 conn(0x7f45d806e420 msgr2=0x7f45d80b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.539+0000 7f45dee00640 1 -- 172.21.15.175:0/1547638373 shutdown_connections 2024-04-25T09:04:22.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.539+0000 7f45dee00640 1 -- 172.21.15.175:0/1547638373 wait complete. 2024-04-25T09:04:22.551 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:22.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.695+0000 7f38ebe00640 1 Processor -- start 2024-04-25T09:04:22.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.695+0000 7f38ebe00640 1 -- start start 2024-04-25T09:04:22.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.699+0000 7f38ebe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f38e406b1e0 0x7f38e406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.699+0000 7f38ebe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38e4145160 0x7f38e40ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.699+0000 7f38ebe00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38e406bbd0 con 0x7f38e40cab20 2024-04-25T09:04:22.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.699+0000 7f38ebe00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e406beb0 con 0x7f38e406b1e0 2024-04-25T09:04:22.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.699+0000 7f38ebe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e406c190 con 0x7f38e4145160 2024-04-25T09:04:22.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.699+0000 7f38e9400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f38e406b1e0 0x7f38e406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.699+0000 7f38e9e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f38e40cab20 0x7f38e415f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44204/0 (socket says 172.21.15.175:44204) 2024-04-25T09:04:22.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.699+0000 7f38e9e00640 1 -- 172.21.15.175:0/3773665076 learned_addr learned my addr 172.21.15.175:0/3773665076 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:22.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.699+0000 7f38e8a00640 1 --2- 172.21.15.175:0/3773665076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38e4145160 0x7f38e40ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.699+0000 7f38e9400640 1 -- 172.21.15.175:0/3773665076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38e4145160 msgr2=0x7f38e40ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:22.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.699+0000 7f38e9400640 1 --2- 172.21.15.175:0/3773665076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38e4145160 0x7f38e40ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.699+0000 7f38e9400640 1 -- 172.21.15.175:0/3773665076 >> v1:172.21.15.175:6789/0 conn(0x7f38e40cab20 legacy=0x7f38e415f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.699+0000 7f38e3e00640 1 -- 172.21.15.175:0/3773665076 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567636024 0 0) 0x7f38e406bbd0 con 0x7f38e40cab20 2024-04-25T09:04:22.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.699+0000 7f38e9400640 1 -- 172.21.15.175:0/3773665076 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e406c470 con 0x7f38e406b1e0 2024-04-25T09:04:22.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.703+0000 7f38e9400640 1 --2- 172.21.15.175:0/3773665076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e406b1e0 0x7f38e406b5c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009d90 tx=0x7f38d801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd0901ff40a32173 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.703+0000 7f38e3e00640 1 -- 172.21.15.175:0/3773665076 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d80b2070 con 0x7f38e406b1e0 2024-04-25T09:04:22.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.703+0000 7f38e3e00640 1 -- 172.21.15.175:0/3773665076 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d80a5830 con 0x7f38e406b1e0 2024-04-25T09:04:22.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.703+0000 7f38e3e00640 1 -- 172.21.15.175:0/3773665076 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d80a5c00 con 0x7f38e406b1e0 2024-04-25T09:04:22.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.703+0000 7f38ebe00640 1 -- 172.21.15.175:0/3773665076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e406b1e0 msgr2=0x7f38e406b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.703+0000 7f38ebe00640 1 --2- 172.21.15.175:0/3773665076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e406b1e0 0x7f38e406b5c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f38d8009d90 tx=0x7f38d801c970 comp rx=0 tx=0).stop 2024-04-25T09:04:22.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.703+0000 7f38ebe00640 1 -- 172.21.15.175:0/3773665076 shutdown_connections 2024-04-25T09:04:22.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.703+0000 7f38ebe00640 1 --2- 172.21.15.175:0/3773665076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38e4145160 0x7f38e40ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.703+0000 7f38ebe00640 1 --2- 172.21.15.175:0/3773665076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e406b1e0 0x7f38e406b5c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.703+0000 7f38ebe00640 1 -- 172.21.15.175:0/3773665076 >> 172.21.15.175:0/3773665076 conn(0x7f38e40cca10 msgr2=0x7f38e40cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.703+0000 7f38ebe00640 1 -- 172.21.15.175:0/3773665076 shutdown_connections 2024-04-25T09:04:22.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.703+0000 7f38ebe00640 1 -- 172.21.15.175:0/3773665076 wait complete. 2024-04-25T09:04:22.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.703+0000 7f38ebe00640 1 Processor -- start 2024-04-25T09:04:22.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.703+0000 7f38ebe00640 1 -- start start 2024-04-25T09:04:22.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38ebe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38e406b1e0 0x7f38e415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38ebe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38e40cab20 0x7f38e40c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38ebe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e4145160 0x7f38e415a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38ebe00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e4168be0 con 0x7f38e4145160 2024-04-25T09:04:22.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38ebe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e4168a60 con 0x7f38e406b1e0 2024-04-25T09:04:22.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38ebe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e4168d60 con 0x7f38e40cab20 2024-04-25T09:04:22.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38e9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e4145160 0x7f38e415a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38e9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e4145160 0x7f38e415a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46360/0 (socket says 172.21.15.175:46360) 2024-04-25T09:04:22.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38e9400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38e406b1e0 0x7f38e415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38e9e00640 1 -- 172.21.15.175:0/682657781 learned_addr learned my addr 172.21.15.175:0/682657781 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:22.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38e8a00640 1 --2- 172.21.15.175:0/682657781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38e40cab20 0x7f38e40c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38e9e00640 1 -- 172.21.15.175:0/682657781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38e40cab20 msgr2=0x7f38e40c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38e9e00640 1 --2- 172.21.15.175:0/682657781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38e40cab20 0x7f38e40c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38e9e00640 1 -- 172.21.15.175:0/682657781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38e406b1e0 msgr2=0x7f38e415ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38e9e00640 1 --2- 172.21.15.175:0/682657781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38e406b1e0 0x7f38e415ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38e9e00640 1 -- 172.21.15.175:0/682657781 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e40c6760 con 0x7f38e4145160 2024-04-25T09:04:22.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38e9e00640 1 --2- 172.21.15.175:0/682657781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e4145160 0x7f38e415a5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00c4b0 tx=0x7f38dc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38e1600640 1 -- 172.21.15.175:0/682657781 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc018070 con 0x7f38e4145160 2024-04-25T09:04:22.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38e1600640 1 -- 172.21.15.175:0/682657781 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38dc0074e0 con 0x7f38e4145160 2024-04-25T09:04:22.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38ebe00640 1 -- 172.21.15.175:0/682657781 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e40c9310 con 0x7f38e4145160 2024-04-25T09:04:22.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38e1600640 1 -- 172.21.15.175:0/682657781 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc004a30 con 0x7f38e4145160 2024-04-25T09:04:22.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38ebe00640 1 -- 172.21.15.175:0/682657781 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e40c98d0 con 0x7f38e4145160 2024-04-25T09:04:22.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38ebe00640 1 -- 172.21.15.175:0/682657781 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38e40c9ad0 con 0x7f38e4145160 2024-04-25T09:04:22.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.707+0000 7f38e1600640 1 -- 172.21.15.175:0/682657781 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f38dc01b070 con 0x7f38e4145160 2024-04-25T09:04:22.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.711+0000 7f38e1600640 1 --2- 172.21.15.175:0/682657781 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f38c4066f60 0x7f38c4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.711+0000 7f38e1600640 1 -- 172.21.15.175:0/682657781 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38dc084240 con 0x7f38e4145160 2024-04-25T09:04:22.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.711+0000 7f38e9400640 1 --2- 172.21.15.175:0/682657781 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f38c4066f60 0x7f38c4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.711+0000 7f38e9400640 1 --2- 172.21.15.175:0/682657781 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f38c4066f60 0x7f38c4069420 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38d80af000 tx=0x7f38d80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.715+0000 7f38e1600640 1 -- 172.21.15.175:0/682657781 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f38e40c9ad0 con 0x7f38e4145160 2024-04-25T09:04:22.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.871+0000 7f38ebe00640 1 -- 172.21.15.175:0/682657781 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f38e4075160 con 0x7f38e4145160 2024-04-25T09:04:22.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.871+0000 7f38e1600640 1 -- 172.21.15.175:0/682657781 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f38dc054c00 con 0x7f38e4145160 2024-04-25T09:04:22.862 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:04:22.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.871+0000 7f38ebe00640 1 -- 172.21.15.175:0/682657781 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f38c4066f60 msgr2=0x7f38c4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.871+0000 7f38ebe00640 1 --2- 172.21.15.175:0/682657781 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f38c4066f60 0x7f38c4069420 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f38d80af000 tx=0x7f38d80a7070 comp rx=0 tx=0).stop 2024-04-25T09:04:22.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.871+0000 7f38ebe00640 1 -- 172.21.15.175:0/682657781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e4145160 msgr2=0x7f38e415a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.871+0000 7f38ebe00640 1 --2- 172.21.15.175:0/682657781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e4145160 0x7f38e415a5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00c4b0 tx=0x7f38dc00c970 comp rx=0 tx=0).stop 2024-04-25T09:04:22.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.871+0000 7f38ebe00640 1 -- 172.21.15.175:0/682657781 shutdown_connections 2024-04-25T09:04:22.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.871+0000 7f38ebe00640 1 --2- 172.21.15.175:0/682657781 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f38c4066f60 0x7f38c4069420 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.871+0000 7f38ebe00640 1 --2- 172.21.15.175:0/682657781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38e4145160 0x7f38e415a5a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.871+0000 7f38ebe00640 1 --2- 172.21.15.175:0/682657781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38e40cab20 0x7f38e40c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.871+0000 7f38ebe00640 1 --2- 172.21.15.175:0/682657781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38e406b1e0 0x7f38e415ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.871+0000 7f38ebe00640 1 -- 172.21.15.175:0/682657781 >> 172.21.15.175:0/682657781 conn(0x7f38e40cca10 msgr2=0x7f38e40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.871+0000 7f38ebe00640 1 -- 172.21.15.175:0/682657781 shutdown_connections 2024-04-25T09:04:22.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:22.871+0000 7f38ebe00640 1 -- 172.21.15.175:0/682657781 wait complete. 2024-04-25T09:04:22.883 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:23.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.027+0000 7f91f9000640 1 Processor -- start 2024-04-25T09:04:23.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.027+0000 7f91f9000640 1 -- start start 2024-04-25T09:04:23.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.027+0000 7f91f9000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f91f41453a0 0x7f91f415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.027+0000 7f91f9000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91f415c410 0x7f91f40cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.027+0000 7f91f9000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f415c8a0 con 0x7f91f4144fc0 2024-04-25T09:04:23.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.027+0000 7f91f9000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f415cd00 con 0x7f91f41453a0 2024-04-25T09:04:23.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.027+0000 7f91f9000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f40ce660 con 0x7f91f415c410 2024-04-25T09:04:23.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.027+0000 7f91f1400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f91f41453a0 0x7f91f415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.027+0000 7f91f1e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f91f4144fc0 0x7f91f40cbe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44214/0 (socket says 172.21.15.175:44214) 2024-04-25T09:04:23.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.027+0000 7f91f1e00640 1 -- 172.21.15.175:0/4145101857 learned_addr learned my addr 172.21.15.175:0/4145101857 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:23.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.031+0000 7f91f2800640 1 --2- 172.21.15.175:0/4145101857 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91f415c410 0x7f91f40cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.031+0000 7f91f1400640 1 -- 172.21.15.175:0/4145101857 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91f415c410 msgr2=0x7f91f40cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:23.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.031+0000 7f91f1400640 1 --2- 172.21.15.175:0/4145101857 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91f415c410 0x7f91f40cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.031+0000 7f91f1400640 1 -- 172.21.15.175:0/4145101857 >> v1:172.21.15.175:6789/0 conn(0x7f91f4144fc0 legacy=0x7f91f40cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.031+0000 7f91f1400640 1 -- 172.21.15.175:0/4145101857 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f40cc930 con 0x7f91f41453a0 2024-04-25T09:04:23.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.031+0000 7f91f0a00640 1 -- 172.21.15.175:0/4145101857 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636900343 0 0) 0x7f91f415c8a0 con 0x7f91f4144fc0 2024-04-25T09:04:23.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.031+0000 7f91f1400640 1 --2- 172.21.15.175:0/4145101857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91f41453a0 0x7f91f415bed0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f91e00097f0 tx=0x7f91e001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf82ba2bc111265a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.031+0000 7f91f0a00640 1 -- 172.21.15.175:0/4145101857 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e00b2070 con 0x7f91f41453a0 2024-04-25T09:04:23.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.031+0000 7f91f0a00640 1 -- 172.21.15.175:0/4145101857 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e00ad640 con 0x7f91f41453a0 2024-04-25T09:04:23.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.031+0000 7f91f0a00640 1 -- 172.21.15.175:0/4145101857 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e00ada10 con 0x7f91f41453a0 2024-04-25T09:04:23.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.031+0000 7f91f9000640 1 -- 172.21.15.175:0/4145101857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91f41453a0 msgr2=0x7f91f415bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.031+0000 7f91f9000640 1 --2- 172.21.15.175:0/4145101857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91f41453a0 0x7f91f415bed0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f91e00097f0 tx=0x7f91e001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.031+0000 7f91f9000640 1 -- 172.21.15.175:0/4145101857 shutdown_connections 2024-04-25T09:04:23.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.031+0000 7f91f9000640 1 --2- 172.21.15.175:0/4145101857 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91f415c410 0x7f91f40cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.031+0000 7f91f9000640 1 --2- 172.21.15.175:0/4145101857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91f41453a0 0x7f91f415bed0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.031+0000 7f91f9000640 1 -- 172.21.15.175:0/4145101857 >> 172.21.15.175:0/4145101857 conn(0x7f91f4067150 msgr2=0x7f91f406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:23.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f9000640 1 -- 172.21.15.175:0/4145101857 shutdown_connections 2024-04-25T09:04:23.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f9000640 1 -- 172.21.15.175:0/4145101857 wait complete. 2024-04-25T09:04:23.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f9000640 1 Processor -- start 2024-04-25T09:04:23.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f9000640 1 -- start start 2024-04-25T09:04:23.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f9000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91f41453a0 0x7f91f4138250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f9000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91f415c410 0x7f91f41f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f9000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91f41393d0 0x7f91f40af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f9000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f40cc580 con 0x7f91f41393d0 2024-04-25T09:04:23.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f9000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f40cfb70 con 0x7f91f41453a0 2024-04-25T09:04:23.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f9000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f4142ef0 con 0x7f91f415c410 2024-04-25T09:04:23.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f2800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91f41393d0 0x7f91f40af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f2800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91f41393d0 0x7f91f40af5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46386/0 (socket says 172.21.15.175:46386) 2024-04-25T09:04:23.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f2800640 1 -- 172.21.15.175:0/311112344 learned_addr learned my addr 172.21.15.175:0/311112344 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:23.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f1e00640 1 --2- 172.21.15.175:0/311112344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91f41453a0 0x7f91f4138250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f1400640 1 --2- 172.21.15.175:0/311112344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91f415c410 0x7f91f41f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f2800640 1 -- 172.21.15.175:0/311112344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91f415c410 msgr2=0x7f91f41f5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f2800640 1 --2- 172.21.15.175:0/311112344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91f415c410 0x7f91f41f5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f2800640 1 -- 172.21.15.175:0/311112344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91f41453a0 msgr2=0x7f91f4138250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f2800640 1 --2- 172.21.15.175:0/311112344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91f41453a0 0x7f91f4138250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f2800640 1 -- 172.21.15.175:0/311112344 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f41398d0 con 0x7f91f41393d0 2024-04-25T09:04:23.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f2800640 1 --2- 172.21.15.175:0/311112344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91f41393d0 0x7f91f40af5f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00d560 tx=0x7f91ec00da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91ea000640 1 -- 172.21.15.175:0/311112344 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec0125f0 con 0x7f91f41393d0 2024-04-25T09:04:23.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91ea000640 1 -- 172.21.15.175:0/311112344 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ec019070 con 0x7f91f41393d0 2024-04-25T09:04:23.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91ea000640 1 -- 172.21.15.175:0/311112344 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec0129f0 con 0x7f91f41393d0 2024-04-25T09:04:23.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.035+0000 7f91f9000640 1 -- 172.21.15.175:0/311112344 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f41425c0 con 0x7f91f41393d0 2024-04-25T09:04:23.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.039+0000 7f91f9000640 1 -- 172.21.15.175:0/311112344 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f4142b80 con 0x7f91f41393d0 2024-04-25T09:04:23.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.039+0000 7f91f9000640 1 -- 172.21.15.175:0/311112344 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f4074a60 con 0x7f91f41393d0 2024-04-25T09:04:23.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.039+0000 7f91ea000640 1 -- 172.21.15.175:0/311112344 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f91ec012b90 con 0x7f91f41393d0 2024-04-25T09:04:23.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.039+0000 7f91ea000640 1 --2- 172.21.15.175:0/311112344 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f91d4066f90 0x7f91d4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.039+0000 7f91ea000640 1 -- 172.21.15.175:0/311112344 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91ec085320 con 0x7f91f41393d0 2024-04-25T09:04:23.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.039+0000 7f91f1e00640 1 --2- 172.21.15.175:0/311112344 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f91d4066f90 0x7f91d4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.039+0000 7f91f1e00640 1 --2- 172.21.15.175:0/311112344 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f91d4066f90 0x7f91d4069450 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f91e40012f0 tx=0x7f91e4001770 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.043+0000 7f91ea000640 1 -- 172.21.15.175:0/311112344 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f91ec055c40 con 0x7f91f41393d0 2024-04-25T09:04:23.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.231+0000 7f91f9000640 1 -- 172.21.15.175:0/311112344 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91f4143070 con 0x7f91f41393d0 2024-04-25T09:04:23.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.231+0000 7f91ea000640 1 -- 172.21.15.175:0/311112344 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4938 (secure 0 0 0) 0x7f91ec059ce0 con 0x7f91f41393d0 2024-04-25T09:04:23.222 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:23.222 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/989886914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":989886914},{"type":"v1","addr":"172.21.15.175:6837","nonce":989886914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/611556493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":611556493},{"type":"v1","addr":"172.21.15.177:6833","nonce":611556493}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1366486960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1366486960},{"type":"v1","addr":"172.21.15.177:6835","nonce":1366486960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:09.810111+0000","modified":"2024-04-25T09:04:12.820376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6836/2613139594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2613139594},{"type":"v1","addr":"172.21.15.175:6836","nonce":2613139594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:04:23.223 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 8 2024-04-25T09:04:23.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.231+0000 7f91f9000640 1 -- 172.21.15.175:0/311112344 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f91d4066f90 msgr2=0x7f91d4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.231+0000 7f91f9000640 1 --2- 172.21.15.175:0/311112344 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f91d4066f90 0x7f91d4069450 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f91e40012f0 tx=0x7f91e4001770 comp rx=0 tx=0).stop 2024-04-25T09:04:23.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.231+0000 7f91f9000640 1 -- 172.21.15.175:0/311112344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91f41393d0 msgr2=0x7f91f40af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.231+0000 7f91f9000640 1 --2- 172.21.15.175:0/311112344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91f41393d0 0x7f91f40af5f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00d560 tx=0x7f91ec00da20 comp rx=0 tx=0).stop 2024-04-25T09:04:23.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.231+0000 7f91f9000640 1 -- 172.21.15.175:0/311112344 shutdown_connections 2024-04-25T09:04:23.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.231+0000 7f91f9000640 1 --2- 172.21.15.175:0/311112344 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f91d4066f90 0x7f91d4069450 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.231+0000 7f91f9000640 1 --2- 172.21.15.175:0/311112344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91f41393d0 0x7f91f40af5f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.231+0000 7f91f9000640 1 --2- 172.21.15.175:0/311112344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f91f415c410 0x7f91f41f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.231+0000 7f91f9000640 1 --2- 172.21.15.175:0/311112344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91f41453a0 0x7f91f4138250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.231+0000 7f91f9000640 1 -- 172.21.15.175:0/311112344 >> 172.21.15.175:0/311112344 conn(0x7f91f4144fc0 msgr2=0x7f91f413a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:23.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.231+0000 7f91f9000640 1 -- 172.21.15.175:0/311112344 shutdown_connections 2024-04-25T09:04:23.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.231+0000 7f91f9000640 1 -- 172.21.15.175:0/311112344 wait complete. 2024-04-25T09:04:23.247 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:23.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.391+0000 7feec4600640 1 Processor -- start 2024-04-25T09:04:23.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.391+0000 7feec4600640 1 -- start start 2024-04-25T09:04:23.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.391+0000 7feec4600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feebc144fc0 0x7feebc0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.391+0000 7feec4600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feebc15c5e0 0x7feebc0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.391+0000 7feec4600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feebc15cd00 con 0x7feebc1453a0 2024-04-25T09:04:23.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.391+0000 7feec4600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feebc0ce660 con 0x7feebc144fc0 2024-04-25T09:04:23.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.391+0000 7feec4600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc0cc930 con 0x7feebc15c5e0 2024-04-25T09:04:23.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.391+0000 7feec1c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feebc144fc0 0x7feebc0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.391+0000 7feec1200640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7feebc1453a0 0x7feebc15bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44228/0 (socket says 172.21.15.175:44228) 2024-04-25T09:04:23.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.391+0000 7feec1200640 1 -- 172.21.15.175:0/3317479884 learned_addr learned my addr 172.21.15.175:0/3317479884 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:23.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.391+0000 7feec2600640 1 --2- 172.21.15.175:0/3317479884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feebc15c5e0 0x7feebc0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.395+0000 7feec1c00640 1 -- 172.21.15.175:0/3317479884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feebc15c5e0 msgr2=0x7feebc0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:23.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.395+0000 7feec1c00640 1 --2- 172.21.15.175:0/3317479884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feebc15c5e0 0x7feebc0cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.395+0000 7feec1c00640 1 -- 172.21.15.175:0/3317479884 >> v1:172.21.15.175:6789/0 conn(0x7feebc1453a0 legacy=0x7feebc15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.395+0000 7feebbe00640 1 -- 172.21.15.175:0/3317479884 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 604654153 0 0) 0x7feebc15cd00 con 0x7feebc1453a0 2024-04-25T09:04:23.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.395+0000 7feec1c00640 1 -- 172.21.15.175:0/3317479884 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc0ccc10 con 0x7feebc144fc0 2024-04-25T09:04:23.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.395+0000 7feec1c00640 1 --2- 172.21.15.175:0/3317479884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feebc144fc0 0x7feebc0cbe70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feeb00097f0 tx=0x7feeb001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91e488881e2a2a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.395+0000 7feebbe00640 1 -- 172.21.15.175:0/3317479884 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00b2070 con 0x7feebc144fc0 2024-04-25T09:04:23.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.395+0000 7feebbe00640 1 -- 172.21.15.175:0/3317479884 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb00ad640 con 0x7feebc144fc0 2024-04-25T09:04:23.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.395+0000 7feebbe00640 1 -- 172.21.15.175:0/3317479884 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00ada10 con 0x7feebc144fc0 2024-04-25T09:04:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.395+0000 7feec4600640 1 -- 172.21.15.175:0/3317479884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feebc144fc0 msgr2=0x7feebc0cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.395+0000 7feec4600640 1 --2- 172.21.15.175:0/3317479884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feebc144fc0 0x7feebc0cbe70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feeb00097f0 tx=0x7feeb001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.395+0000 7feec4600640 1 -- 172.21.15.175:0/3317479884 shutdown_connections 2024-04-25T09:04:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.395+0000 7feec4600640 1 --2- 172.21.15.175:0/3317479884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feebc15c5e0 0x7feebc0cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.395+0000 7feec4600640 1 --2- 172.21.15.175:0/3317479884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feebc144fc0 0x7feebc0cbe70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec4600640 1 -- 172.21.15.175:0/3317479884 >> 172.21.15.175:0/3317479884 conn(0x7feebc067150 msgr2=0x7feebc06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec4600640 1 -- 172.21.15.175:0/3317479884 shutdown_connections 2024-04-25T09:04:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec4600640 1 -- 172.21.15.175:0/3317479884 wait complete. 2024-04-25T09:04:23.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec4600640 1 Processor -- start 2024-04-25T09:04:23.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec4600640 1 -- start start 2024-04-25T09:04:23.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec4600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feebc1453a0 0x7feebc13b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec4600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feebc15c5e0 0x7feebc142d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec4600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feebc143e60 0x7feebc143240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec4600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc0cff40 con 0x7feebc143e60 2024-04-25T09:04:23.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec4600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc0cfdc0 con 0x7feebc1453a0 2024-04-25T09:04:23.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec4600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc1685f0 con 0x7feebc15c5e0 2024-04-25T09:04:23.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec2600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feebc143e60 0x7feebc143240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec2600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feebc143e60 0x7feebc143240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46404/0 (socket says 172.21.15.175:46404) 2024-04-25T09:04:23.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec2600640 1 -- 172.21.15.175:0/2821155523 learned_addr learned my addr 172.21.15.175:0/2821155523 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:23.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec1200640 1 --2- 172.21.15.175:0/2821155523 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feebc15c5e0 0x7feebc142d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec1c00640 1 --2- 172.21.15.175:0/2821155523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feebc1453a0 0x7feebc13b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec2600640 1 -- 172.21.15.175:0/2821155523 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feebc15c5e0 msgr2=0x7feebc142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec2600640 1 --2- 172.21.15.175:0/2821155523 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feebc15c5e0 0x7feebc142d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec2600640 1 -- 172.21.15.175:0/2821155523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feebc1453a0 msgr2=0x7feebc13b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec2600640 1 --2- 172.21.15.175:0/2821155523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feebc1453a0 0x7feebc13b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec2600640 1 -- 172.21.15.175:0/2821155523 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc0af960 con 0x7feebc143e60 2024-04-25T09:04:23.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec1c00640 1 --2- 172.21.15.175:0/2821155523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feebc1453a0 0x7feebc13b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:23.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec2600640 1 --2- 172.21.15.175:0/2821155523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feebc143e60 0x7feebc143240 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7feeb4007e40 tx=0x7feeb400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feeb9600640 1 -- 172.21.15.175:0/2821155523 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4014620 con 0x7feebc143e60 2024-04-25T09:04:23.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feeb9600640 1 -- 172.21.15.175:0/2821155523 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb4019070 con 0x7feebc143e60 2024-04-25T09:04:23.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feeb9600640 1 -- 172.21.15.175:0/2821155523 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4014a20 con 0x7feebc143e60 2024-04-25T09:04:23.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec4600640 1 -- 172.21.15.175:0/2821155523 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feebc0afc40 con 0x7feebc143e60 2024-04-25T09:04:23.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.399+0000 7feec4600640 1 -- 172.21.15.175:0/2821155523 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feebc13bc10 con 0x7feebc143e60 2024-04-25T09:04:23.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.403+0000 7feec4600640 1 -- 172.21.15.175:0/2821155523 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feebc074a60 con 0x7feebc143e60 2024-04-25T09:04:23.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.403+0000 7feeb9600640 1 -- 172.21.15.175:0/2821155523 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feeb4014bc0 con 0x7feebc143e60 2024-04-25T09:04:23.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.403+0000 7feeb9600640 1 --2- 172.21.15.175:0/2821155523 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fee9c066f60 0x7fee9c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.403+0000 7feeb9600640 1 -- 172.21.15.175:0/2821155523 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feeb4085970 con 0x7feebc143e60 2024-04-25T09:04:23.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.403+0000 7feec1c00640 1 --2- 172.21.15.175:0/2821155523 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fee9c066f60 0x7fee9c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.403+0000 7feec1c00640 1 --2- 172.21.15.175:0/2821155523 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fee9c066f60 0x7fee9c069420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feeb00af000 tx=0x7feeb0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.407+0000 7feeb9600640 1 -- 172.21.15.175:0/2821155523 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feeb4056970 con 0x7feebc143e60 2024-04-25T09:04:23.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.563+0000 7feec4600640 1 -- 172.21.15.175:0/2821155523 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feebc15f950 con 0x7feebc143e60 2024-04-25T09:04:23.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.563+0000 7feeb9600640 1 -- 172.21.15.175:0/2821155523 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7feeb4056270 con 0x7feebc143e60 2024-04-25T09:04:23.559 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:23.559 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":20,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:11.440551+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:23.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.567+0000 7feec4600640 1 -- 172.21.15.175:0/2821155523 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fee9c066f60 msgr2=0x7fee9c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.567+0000 7feec4600640 1 --2- 172.21.15.175:0/2821155523 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fee9c066f60 0x7fee9c069420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feeb00af000 tx=0x7feeb0008040 comp rx=0 tx=0).stop 2024-04-25T09:04:23.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.567+0000 7feec4600640 1 -- 172.21.15.175:0/2821155523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feebc143e60 msgr2=0x7feebc143240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.567+0000 7feec4600640 1 --2- 172.21.15.175:0/2821155523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feebc143e60 0x7feebc143240 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7feeb4007e40 tx=0x7feeb400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.567+0000 7feec4600640 1 -- 172.21.15.175:0/2821155523 shutdown_connections 2024-04-25T09:04:23.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.567+0000 7feec4600640 1 --2- 172.21.15.175:0/2821155523 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fee9c066f60 0x7fee9c069420 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.567+0000 7feec4600640 1 --2- 172.21.15.175:0/2821155523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feebc143e60 0x7feebc143240 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.567+0000 7feec4600640 1 --2- 172.21.15.175:0/2821155523 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feebc15c5e0 0x7feebc142d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.567+0000 7feec4600640 1 --2- 172.21.15.175:0/2821155523 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feebc1453a0 0x7feebc13b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.567+0000 7feec4600640 1 -- 172.21.15.175:0/2821155523 >> 172.21.15.175:0/2821155523 conn(0x7feebc144fc0 msgr2=0x7feebc06ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:23.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.567+0000 7feec4600640 1 -- 172.21.15.175:0/2821155523 shutdown_connections 2024-04-25T09:04:23.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.567+0000 7feec4600640 1 -- 172.21.15.175:0/2821155523 wait complete. 2024-04-25T09:04:23.578 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:23.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.723+0000 7fc024c00640 1 Processor -- start 2024-04-25T09:04:23.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.723+0000 7fc024c00640 1 -- start start 2024-04-25T09:04:23.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.723+0000 7fc024c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc02006b0e0 0x7fc02006b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.723+0000 7fc024c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc0200b0c50 0x7fc0200cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.723+0000 7fc024c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0200d0450 con 0x7fc0200b1090 2024-04-25T09:04:23.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.723+0000 7fc024c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0200b07c0 con 0x7fc02006b0e0 2024-04-25T09:04:23.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.723+0000 7fc024c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0200afe90 con 0x7fc0200b0c50 2024-04-25T09:04:23.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.723+0000 7fc01de00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc02006b0e0 0x7fc02006b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.723+0000 7fc01de00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc02006b0e0 0x7fc02006b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46408/0 (socket says 172.21.15.175:46408) 2024-04-25T09:04:23.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.723+0000 7fc01de00640 1 -- 172.21.15.175:0/3637608941 learned_addr learned my addr 172.21.15.175:0/3637608941 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:23.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.723+0000 7fc015400640 1 --2- 172.21.15.175:0/3637608941 >> v2:172.21.15.177:3300/0 conn(0x7fc0200b0c50 0x7fc0200cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.723+0000 7fc01de00640 1 -- 172.21.15.175:0/3637608941 >> v2:172.21.15.177:3300/0 conn(0x7fc0200b0c50 msgr2=0x7fc0200cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:23.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.723+0000 7fc01de00640 1 --2- 172.21.15.175:0/3637608941 >> v2:172.21.15.177:3300/0 conn(0x7fc0200b0c50 0x7fc0200cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.723+0000 7fc01de00640 1 -- 172.21.15.175:0/3637608941 >> v1:172.21.15.175:6789/0 conn(0x7fc0200b1090 legacy=0x7fc0200b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.723+0000 7fc01de00640 1 -- 172.21.15.175:0/3637608941 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0200b0170 con 0x7fc02006b0e0 2024-04-25T09:04:23.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.727+0000 7fc01de00640 1 --2- 172.21.15.175:0/3637608941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc02006b0e0 0x7fc02006b4c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc010009870 tx=0x7fc01001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1e063d09e1c052 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.727+0000 7fc01d400640 1 -- 172.21.15.175:0/3637608941 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100b5070 con 0x7fc02006b0e0 2024-04-25T09:04:23.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.727+0000 7fc01d400640 1 -- 172.21.15.175:0/3637608941 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0100a8a10 con 0x7fc02006b0e0 2024-04-25T09:04:23.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.727+0000 7fc01d400640 1 -- 172.21.15.175:0/3637608941 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100a8de0 con 0x7fc02006b0e0 2024-04-25T09:04:23.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.727+0000 7fc024c00640 1 -- 172.21.15.175:0/3637608941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc02006b0e0 msgr2=0x7fc02006b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.727+0000 7fc024c00640 1 --2- 172.21.15.175:0/3637608941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc02006b0e0 0x7fc02006b4c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc010009870 tx=0x7fc01001ed10 comp rx=0 tx=0).stop 2024-04-25T09:04:23.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.727+0000 7fc024c00640 1 -- 172.21.15.175:0/3637608941 shutdown_connections 2024-04-25T09:04:23.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.727+0000 7fc024c00640 1 --2- 172.21.15.175:0/3637608941 >> v2:172.21.15.177:3300/0 conn(0x7fc0200b0c50 0x7fc0200cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.727+0000 7fc024c00640 1 --2- 172.21.15.175:0/3637608941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc02006b0e0 0x7fc02006b4c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.727+0000 7fc024c00640 1 -- 172.21.15.175:0/3637608941 >> 172.21.15.175:0/3637608941 conn(0x7fc0200d06c0 msgr2=0x7fc0200d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:23.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.727+0000 7fc024c00640 1 -- 172.21.15.175:0/3637608941 shutdown_connections 2024-04-25T09:04:23.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.727+0000 7fc024c00640 1 -- 172.21.15.175:0/3637608941 wait complete. 2024-04-25T09:04:23.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.727+0000 7fc024c00640 1 Processor -- start 2024-04-25T09:04:23.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc024c00640 1 -- start start 2024-04-25T09:04:23.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc024c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc02006b0e0 0x7fc0200c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc024c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0200b0c50 0x7fc0200b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc024c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0200b1090 0x7fc02014ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc024c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02006bb80 con 0x7fc0200b1090 2024-04-25T09:04:23.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc024c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02006ba00 con 0x7fc0200b0c50 2024-04-25T09:04:23.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc024c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0200d0000 con 0x7fc02006b0e0 2024-04-25T09:04:23.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc01e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0200b1090 0x7fc02014ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc01e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0200b1090 0x7fc02014ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46420/0 (socket says 172.21.15.175:46420) 2024-04-25T09:04:23.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc01e800640 1 -- 172.21.15.175:0/1228747352 learned_addr learned my addr 172.21.15.175:0/1228747352 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:23.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc015400640 1 --2- 172.21.15.175:0/1228747352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0200b0c50 0x7fc0200b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc01de00640 1 --2- 172.21.15.175:0/1228747352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc02006b0e0 0x7fc0200c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc01e800640 1 -- 172.21.15.175:0/1228747352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc02006b0e0 msgr2=0x7fc0200c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc01e800640 1 --2- 172.21.15.175:0/1228747352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc02006b0e0 0x7fc0200c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc01e800640 1 -- 172.21.15.175:0/1228747352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0200b0c50 msgr2=0x7fc0200b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc01e800640 1 --2- 172.21.15.175:0/1228747352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0200b0c50 0x7fc0200b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc01e800640 1 -- 172.21.15.175:0/1228747352 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0200b3800 con 0x7fc0200b1090 2024-04-25T09:04:23.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc01de00640 1 --2- 172.21.15.175:0/1228747352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc02006b0e0 0x7fc0200c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:23.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc015400640 1 --2- 172.21.15.175:0/1228747352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0200b0c50 0x7fc0200b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:23.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc01e800640 1 --2- 172.21.15.175:0/1228747352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0200b1090 0x7fc02014ba70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc01800c730 tx=0x7fc01800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc016a00640 1 -- 172.21.15.175:0/1228747352 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018016020 con 0x7fc0200b1090 2024-04-25T09:04:23.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc016a00640 1 -- 172.21.15.175:0/1228747352 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc018006d60 con 0x7fc0200b1090 2024-04-25T09:04:23.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc024c00640 1 -- 172.21.15.175:0/1228747352 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0200c5b20 con 0x7fc0200b1090 2024-04-25T09:04:23.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc016a00640 1 -- 172.21.15.175:0/1228747352 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc018003bc0 con 0x7fc0200b1090 2024-04-25T09:04:23.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc024c00640 1 -- 172.21.15.175:0/1228747352 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0200c60e0 con 0x7fc0200b1090 2024-04-25T09:04:23.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.731+0000 7fc024c00640 1 -- 172.21.15.175:0/1228747352 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc020074a60 con 0x7fc0200b1090 2024-04-25T09:04:23.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.735+0000 7fc016a00640 1 -- 172.21.15.175:0/1228747352 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc0180050d0 con 0x7fc0200b1090 2024-04-25T09:04:23.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.735+0000 7fc016a00640 1 --2- 172.21.15.175:0/1228747352 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbffc066f60 0x7fbffc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.735+0000 7fc016a00640 1 -- 172.21.15.175:0/1228747352 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc018084c70 con 0x7fc0200b1090 2024-04-25T09:04:23.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.735+0000 7fc01de00640 1 --2- 172.21.15.175:0/1228747352 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbffc066f60 0x7fbffc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.735+0000 7fc01de00640 1 --2- 172.21.15.175:0/1228747352 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbffc066f60 0x7fbffc069420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc0100b2000 tx=0x7fc0100aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.739+0000 7fc016a00640 1 -- 172.21.15.175:0/1228747352 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc018020020 con 0x7fc0200b1090 2024-04-25T09:04:23.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.923+0000 7fc024c00640 1 -- 172.21.15.175:0/1228747352 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc020070bd0 con 0x7fc0200b1090 2024-04-25T09:04:23.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.923+0000 7fc016a00640 1 -- 172.21.15.175:0/1228747352 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4938 (secure 0 0 0) 0x7fc018055be0 con 0x7fc0200b1090 2024-04-25T09:04:23.917 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:23.917 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/989886914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":989886914},{"type":"v1","addr":"172.21.15.175:6837","nonce":989886914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/611556493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":611556493},{"type":"v1","addr":"172.21.15.177:6833","nonce":611556493}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1366486960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1366486960},{"type":"v1","addr":"172.21.15.177:6835","nonce":1366486960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:09.810111+0000","modified":"2024-04-25T09:04:12.820376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6836/2613139594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2613139594},{"type":"v1","addr":"172.21.15.175:6836","nonce":2613139594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:04:23.917 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 8 2024-04-25T09:04:23.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.927+0000 7fc024c00640 1 -- 172.21.15.175:0/1228747352 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbffc066f60 msgr2=0x7fbffc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.927+0000 7fc024c00640 1 --2- 172.21.15.175:0/1228747352 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbffc066f60 0x7fbffc069420 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc0100b2000 tx=0x7fc0100aa070 comp rx=0 tx=0).stop 2024-04-25T09:04:23.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.927+0000 7fc024c00640 1 -- 172.21.15.175:0/1228747352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0200b1090 msgr2=0x7fc02014ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.927+0000 7fc024c00640 1 --2- 172.21.15.175:0/1228747352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0200b1090 0x7fc02014ba70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc01800c730 tx=0x7fc01800cbf0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.927+0000 7fc024c00640 1 -- 172.21.15.175:0/1228747352 shutdown_connections 2024-04-25T09:04:23.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.927+0000 7fc024c00640 1 --2- 172.21.15.175:0/1228747352 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbffc066f60 0x7fbffc069420 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.927+0000 7fc024c00640 1 --2- 172.21.15.175:0/1228747352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0200b1090 0x7fc02014ba70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.927+0000 7fc024c00640 1 --2- 172.21.15.175:0/1228747352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0200b0c50 0x7fc0200b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.927+0000 7fc024c00640 1 --2- 172.21.15.175:0/1228747352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc02006b0e0 0x7fc0200c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.927+0000 7fc024c00640 1 -- 172.21.15.175:0/1228747352 >> 172.21.15.175:0/1228747352 conn(0x7fc0200d06c0 msgr2=0x7fc0200d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:23.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.927+0000 7fc024c00640 1 -- 172.21.15.175:0/1228747352 shutdown_connections 2024-04-25T09:04:23.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:23.927+0000 7fc024c00640 1 -- 172.21.15.175:0/1228747352 wait complete. 2024-04-25T09:04:24.341 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:04:09.810111+0000', 'modified': '2024-04-25T09:04:12.820376+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6836/2613139594', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 2613139594}, {'type': 'v1', 'addr': '172.21.15.175:6836', 'nonce': 2613139594}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:04:24.341 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:04:24.342 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:04:24.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.491+0000 7fd851800640 1 Processor -- start 2024-04-25T09:04:24.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.491+0000 7fd851800640 1 -- start start 2024-04-25T09:04:24.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.495+0000 7fd851800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd84c0af980 0x7fd84c0afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.495+0000 7fd851800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84c0ccc80 con 0x7fd84c06b510 2024-04-25T09:04:24.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.495+0000 7fd851800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84c0ccf60 con 0x7fd84c0b0c00 2024-04-25T09:04:24.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.495+0000 7fd851800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84c0b2010 con 0x7fd84c0af980 2024-04-25T09:04:24.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.495+0000 7fd843e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd84c0af980 0x7fd84c0afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.495+0000 7fd84b400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd84c06b510 0x7fd84c15d460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44236/0 (socket says 172.21.15.175:44236) 2024-04-25T09:04:24.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.495+0000 7fd84b400640 1 -- 172.21.15.175:0/3801962831 learned_addr learned my addr 172.21.15.175:0/3801962831 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:24.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.495+0000 7fd843e00640 1 -- 172.21.15.175:0/3801962831 >> v1:172.21.15.177:6789/0 conn(0x7fd84c0b0c00 legacy=0x7fd84c06ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.495+0000 7fd843e00640 1 -- 172.21.15.175:0/3801962831 >> v1:172.21.15.175:6789/0 conn(0x7fd84c06b510 legacy=0x7fd84c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.495+0000 7fd843e00640 1 -- 172.21.15.175:0/3801962831 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c0b19c0 con 0x7fd84c0af980 2024-04-25T09:04:24.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.495+0000 7fd843e00640 1 --2- 172.21.15.175:0/3801962831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd84c0af980 0x7fd84c0afed0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd8340097c0 tx=0x7fd83401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1510370365a617 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd84a000640 1 -- 172.21.15.175:0/3801962831 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8340b0070 con 0x7fd84c0af980 2024-04-25T09:04:24.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd84a000640 1 -- 172.21.15.175:0/3801962831 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd834004230 con 0x7fd84c0af980 2024-04-25T09:04:24.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd84a000640 1 -- 172.21.15.175:0/3801962831 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834003620 con 0x7fd84c0af980 2024-04-25T09:04:24.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd851800640 1 -- 172.21.15.175:0/3801962831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd84c0af980 msgr2=0x7fd84c0afed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd851800640 1 --2- 172.21.15.175:0/3801962831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd84c0af980 0x7fd84c0afed0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd8340097c0 tx=0x7fd83401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd851800640 1 -- 172.21.15.175:0/3801962831 shutdown_connections 2024-04-25T09:04:24.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd851800640 1 --2- 172.21.15.175:0/3801962831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd84c0af980 0x7fd84c0afed0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd851800640 1 -- 172.21.15.175:0/3801962831 >> 172.21.15.175:0/3801962831 conn(0x7fd84c0d07e0 msgr2=0x7fd84c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:24.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd851800640 1 -- 172.21.15.175:0/3801962831 shutdown_connections 2024-04-25T09:04:24.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd851800640 1 -- 172.21.15.175:0/3801962831 wait complete. 2024-04-25T09:04:24.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd851800640 1 Processor -- start 2024-04-25T09:04:24.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd851800640 1 -- start start 2024-04-25T09:04:24.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd851800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd84c06b510 0x7fd84c150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd851800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd84c0af980 0x7fd84c154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd851800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd84c0b0c00 0x7fd84c1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd851800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c16c090 con 0x7fd84c0af980 2024-04-25T09:04:24.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd851800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c16bf10 con 0x7fd84c0b0c00 2024-04-25T09:04:24.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd851800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c16c210 con 0x7fd84c06b510 2024-04-25T09:04:24.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd843e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd84c0af980 0x7fd84c154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd843e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd84c0af980 0x7fd84c154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46436/0 (socket says 172.21.15.175:46436) 2024-04-25T09:04:24.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd843e00640 1 -- 172.21.15.175:0/1865893511 learned_addr learned my addr 172.21.15.175:0/1865893511 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:24.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd84b400640 1 --2- 172.21.15.175:0/1865893511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd84c0b0c00 0x7fd84c1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd84aa00640 1 --2- 172.21.15.175:0/1865893511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd84c06b510 0x7fd84c150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd843e00640 1 -- 172.21.15.175:0/1865893511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd84c06b510 msgr2=0x7fd84c150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd843e00640 1 --2- 172.21.15.175:0/1865893511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd84c06b510 0x7fd84c150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd843e00640 1 -- 172.21.15.175:0/1865893511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd84c0b0c00 msgr2=0x7fd84c1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.499+0000 7fd843e00640 1 --2- 172.21.15.175:0/1865893511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd84c0b0c00 0x7fd84c1550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.503+0000 7fd843e00640 1 -- 172.21.15.175:0/1865893511 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c1514d0 con 0x7fd84c0af980 2024-04-25T09:04:24.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.503+0000 7fd84b400640 1 --2- 172.21.15.175:0/1865893511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd84c0b0c00 0x7fd84c1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:24.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.503+0000 7fd843e00640 1 --2- 172.21.15.175:0/1865893511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd84c0af980 0x7fd84c154b80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd8340ae040 tx=0x7fd834019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.503+0000 7fd842a00640 1 -- 172.21.15.175:0/1865893511 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8340b0040 con 0x7fd84c0af980 2024-04-25T09:04:24.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.503+0000 7fd842a00640 1 -- 172.21.15.175:0/1865893511 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8340bb070 con 0x7fd84c0af980 2024-04-25T09:04:24.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.503+0000 7fd842a00640 1 -- 172.21.15.175:0/1865893511 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8340b5480 con 0x7fd84c0af980 2024-04-25T09:04:24.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.503+0000 7fd851800640 1 -- 172.21.15.175:0/1865893511 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84c0b4d70 con 0x7fd84c0af980 2024-04-25T09:04:24.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.503+0000 7fd851800640 1 -- 172.21.15.175:0/1865893511 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84c0b5330 con 0x7fd84c0af980 2024-04-25T09:04:24.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.503+0000 7fd842a00640 1 -- 172.21.15.175:0/1865893511 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd8340b3070 con 0x7fd84c0af980 2024-04-25T09:04:24.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.503+0000 7fd842a00640 1 --2- 172.21.15.175:0/1865893511 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd828066f60 0x7fd828069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.503+0000 7fd842a00640 1 -- 172.21.15.175:0/1865893511 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd83411ef20 con 0x7fd84c0af980 2024-04-25T09:04:24.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.503+0000 7fd84aa00640 1 --2- 172.21.15.175:0/1865893511 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd828066f60 0x7fd828069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd854c68000 1 Processor -- start 2024-04-25T09:04:24.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd854c68000 1 -- start start 2024-04-25T09:04:24.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd84aa00640 1 --2- 172.21.15.175:0/1865893511 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd828066f60 0x7fd828069420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd83c000f70 tx=0x7fd83c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd854c68000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d65cb920 0x5565d65cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd854c68000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d65cc240 0x5565d65819f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd854c68000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d6581f30 0x5565d6582310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd854c68000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565d64695f0 con 0x5565d65cb920 2024-04-25T09:04:24.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd854c68000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565d63d0da0 con 0x5565d6581f30 2024-04-25T09:04:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd854c68000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5565d6359150 con 0x5565d65cc240 2024-04-25T09:04:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd84aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d65cb920 0x5565d65cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd84aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d65cb920 0x5565d65cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46450/0 (socket says 172.21.15.175:46450) 2024-04-25T09:04:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd84aa00640 1 -- 172.21.15.175:0/2763360179 learned_addr learned my addr 172.21.15.175:0/2763360179 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd843e00640 1 --2- 172.21.15.175:0/2763360179 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d65cc240 0x5565d65819f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd84b400640 1 --2- 172.21.15.175:0/2763360179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d6581f30 0x5565d6582310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd84aa00640 1 -- 172.21.15.175:0/2763360179 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d65cc240 msgr2=0x5565d65819f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd84aa00640 1 --2- 172.21.15.175:0/2763360179 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d65cc240 0x5565d65819f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd84aa00640 1 -- 172.21.15.175:0/2763360179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d6581f30 msgr2=0x5565d6582310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd84aa00640 1 --2- 172.21.15.175:0/2763360179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d6581f30 0x5565d6582310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd84aa00640 1 -- 172.21.15.175:0/2763360179 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565d6372ca0 con 0x5565d65cb920 2024-04-25T09:04:24.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd843e00640 1 --2- 172.21.15.175:0/2763360179 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d65cc240 0x5565d65819f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:24.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd84b400640 1 --2- 172.21.15.175:0/2763360179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d6581f30 0x5565d6582310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:24.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd84aa00640 1 --2- 172.21.15.175:0/2763360179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d65cb920 0x5565d65cbd00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0052a0 tx=0x7fd83c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee23c27b22deeef6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd83b400640 1 -- 172.21.15.175:0/2763360179 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00e6e0 con 0x5565d65cb920 2024-04-25T09:04:24.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd83b400640 1 -- 172.21.15.175:0/2763360179 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c00e880 con 0x5565d65cb920 2024-04-25T09:04:24.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd83b400640 1 -- 172.21.15.175:0/2763360179 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00ec30 con 0x5565d65cb920 2024-04-25T09:04:24.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd854c68000 1 -- 172.21.15.175:0/2763360179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d65cb920 msgr2=0x5565d65cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd854c68000 1 --2- 172.21.15.175:0/2763360179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d65cb920 0x5565d65cbd00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd83c0052a0 tx=0x7fd83c011000 comp rx=0 tx=0).stop 2024-04-25T09:04:24.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd854c68000 1 -- 172.21.15.175:0/2763360179 shutdown_connections 2024-04-25T09:04:24.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd854c68000 1 --2- 172.21.15.175:0/2763360179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d6581f30 0x5565d6582310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd854c68000 1 --2- 172.21.15.175:0/2763360179 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d65cc240 0x5565d65819f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd854c68000 1 --2- 172.21.15.175:0/2763360179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d65cb920 0x5565d65cbd00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd854c68000 1 -- 172.21.15.175:0/2763360179 >> 172.21.15.175:0/2763360179 conn(0x5565d65882a0 msgr2=0x5565d65802d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:24.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd854c68000 1 -- 172.21.15.175:0/2763360179 shutdown_connections 2024-04-25T09:04:24.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd854c68000 1 -- 172.21.15.175:0/2763360179 wait complete. 2024-04-25T09:04:24.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.507+0000 7fd854c68000 1 -- start start 2024-04-25T09:04:24.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd854c68000 1 Processor -- start 2024-04-25T09:04:24.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd854c68000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d6581f30 0x5565d65d2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd854c68000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d65cb920 0x5565d65d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd854c68000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d65cc240 0x5565d6585aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd854c68000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565d638b990 con 0x5565d6581f30 2024-04-25T09:04:24.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd854c68000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565d63cce40 con 0x5565d65cc240 2024-04-25T09:04:24.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd854c68000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5565d635c900 con 0x5565d65cb920 2024-04-25T09:04:24.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd854c68000 10 client.0 _ll_register_callbacks cb 0x5565d64841c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:24.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd84aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d6581f30 0x5565d65d2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd84aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d6581f30 0x5565d65d2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46460/0 (socket says 172.21.15.175:46460) 2024-04-25T09:04:24.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd84aa00640 1 -- 172.21.15.175:0/129149376 learned_addr learned my addr 172.21.15.175:0/129149376 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:24.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd843e00640 1 --2- 172.21.15.175:0/129149376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d65cb920 0x5565d65d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd84b400640 1 --2- 172.21.15.175:0/129149376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d65cc240 0x5565d6585aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd84aa00640 1 -- 172.21.15.175:0/129149376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d65cb920 msgr2=0x5565d65d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd84aa00640 1 --2- 172.21.15.175:0/129149376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d65cb920 0x5565d65d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd84aa00640 1 -- 172.21.15.175:0/129149376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d65cc240 msgr2=0x5565d6585aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd84aa00640 1 --2- 172.21.15.175:0/129149376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d65cc240 0x5565d6585aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd84aa00640 1 -- 172.21.15.175:0/129149376 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565d6389630 con 0x5565d6581f30 2024-04-25T09:04:24.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd84aa00640 1 --2- 172.21.15.175:0/129149376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d6581f30 0x5565d65d2ed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd83c003fd0 tx=0x7fd83c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b8f4a1faa7fcd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd82fe00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:04:24.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd82fe00640 1 -- 172.21.15.175:0/129149376 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c021450 con 0x5565d6581f30 2024-04-25T09:04:24.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd82fe00640 1 -- 172.21.15.175:0/129149376 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd83c010050 con 0x5565d6581f30 2024-04-25T09:04:24.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd854c68000 1 -- 172.21.15.175:0/129149376 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd83c00e880 con 0x5565d6581f30 2024-04-25T09:04:24.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd82fe00640 1 -- 172.21.15.175:0/129149376 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd83c031050 con 0x5565d6581f30 2024-04-25T09:04:24.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd854c68000 10 client.4629 fetch_fsmap learned FSMap version 8 2024-04-25T09:04:24.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd854c68000 1 -- 172.21.15.175:0/129149376 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5565d63593a0 con 0x5565d6581f30 2024-04-25T09:04:24.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd82fe00640 1 -- 172.21.15.175:0/129149376 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c00e880 con 0x5565d6581f30 2024-04-25T09:04:24.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd82fe00640 1 -- 172.21.15.175:0/129149376 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd83c034020 con 0x5565d6581f30 2024-04-25T09:04:24.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd854c68000 10 client.4629 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T09:04:24.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd854c68000 10 client.4629 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:04:24.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd854c68000 20 client.4629 populate_metadata read hostname 'smithi175' 2024-04-25T09:04:24.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd854c68000 1 --2- 172.21.15.175:0/129149376 >> [v2:172.21.15.175:6834/2613139594,v1:172.21.15.175:6836/2613139594] conn(0x5565d65864b0 0x5565d6586890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd854c68000 4 client.4629 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:04:24.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd854c68000 1 -- 172.21.15.175:0/129149376 --> [v2:172.21.15.175:6834/2613139594,v1:172.21.15.175:6836/2613139594] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5565d636ca50 con 0x5565d65864b0 2024-04-25T09:04:24.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd843e00640 1 --2- 172.21.15.175:0/129149376 >> [v2:172.21.15.175:6834/2613139594,v1:172.21.15.175:6836/2613139594] conn(0x5565d65864b0 0x5565d6586890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd843e00640 1 --2- 172.21.15.175:0/129149376 >> [v2:172.21.15.175:6834/2613139594,v1:172.21.15.175:6836/2613139594] conn(0x5565d65864b0 0x5565d6586890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=377fc33aebd65c48 server_cookie=9acec4fd8e95141d in_seq=0 out_seq=0 2024-04-25T09:04:24.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.511+0000 7fd82fe00640 10 client.4629 ms_handle_connect on v2:172.21.15.175:6834/2613139594 2024-04-25T09:04:24.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.515+0000 7fd82fe00640 1 -- 172.21.15.175:0/129149376 <== mds.0 v2:172.21.15.175:6834/2613139594 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5565d636ca50 con 0x5565d65864b0 2024-04-25T09:04:24.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.515+0000 7fd82fe00640 10 client.4629 handle_command_reply: tid=0 2024-04-25T09:04:24.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.515+0000 7fd854c68000 1 client.4629 shutdown 2024-04-25T09:04:24.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.515+0000 7fd854c68000 1 -- 172.21.15.175:0/129149376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d6581f30 msgr2=0x5565d65d2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.515+0000 7fd854c68000 1 --2- 172.21.15.175:0/129149376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d6581f30 0x5565d65d2ed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd83c003fd0 tx=0x7fd83c013000 comp rx=0 tx=0).stop 2024-04-25T09:04:24.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.515+0000 7fd854c68000 1 -- 172.21.15.175:0/129149376 shutdown_connections 2024-04-25T09:04:24.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.515+0000 7fd854c68000 1 --2- 172.21.15.175:0/129149376 >> [v2:172.21.15.175:6834/2613139594,v1:172.21.15.175:6836/2613139594] conn(0x5565d65864b0 0x5565d6586890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.515+0000 7fd854c68000 1 --2- 172.21.15.175:0/129149376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d65cc240 0x5565d6585aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.515+0000 7fd854c68000 1 --2- 172.21.15.175:0/129149376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d65cb920 0x5565d65d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.515+0000 7fd854c68000 1 --2- 172.21.15.175:0/129149376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d6581f30 0x5565d65d2ed0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.515+0000 7fd854c68000 1 -- 172.21.15.175:0/129149376 >> 172.21.15.175:0/129149376 conn(0x5565d65882a0 msgr2=0x5565d65809e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.515+0000 7fd82fe00640 0 client.4629 ms_handle_reset on v2:172.21.15.175:6834/2613139594 2024-04-25T09:04:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.515+0000 7fd854c68000 1 -- 172.21.15.175:0/129149376 shutdown_connections 2024-04-25T09:04:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.515+0000 7fd854c68000 1 -- 172.21.15.175:0/129149376 wait complete. 2024-04-25T09:04:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.515+0000 7fd854c68000 20 client.4629 trim_cache size 0 max 16384 2024-04-25T09:04:24.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd854c68000 1 Processor -- start 2024-04-25T09:04:24.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd854c68000 1 -- start start 2024-04-25T09:04:24.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd854c68000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d6581f30 0x5565d65ca310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd854c68000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d65cb920 0x5565d65ca850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd854c68000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d65cc240 0x5565d65d5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd854c68000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c0c9390 con 0x5565d6581f30 2024-04-25T09:04:24.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd854c68000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c0c8790 con 0x5565d65cb920 2024-04-25T09:04:24.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd854c68000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c0c8d90 con 0x5565d65cc240 2024-04-25T09:04:24.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd84aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d6581f30 0x5565d65ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd84aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d6581f30 0x5565d65ca310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46464/0 (socket says 172.21.15.175:46464) 2024-04-25T09:04:24.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd84aa00640 1 -- 172.21.15.175:0/87828442 learned_addr learned my addr 172.21.15.175:0/87828442 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:24.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd84b400640 1 --2- 172.21.15.175:0/87828442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d65cc240 0x5565d65d5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd843e00640 1 --2- 172.21.15.175:0/87828442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d65cb920 0x5565d65ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd84aa00640 1 -- 172.21.15.175:0/87828442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d65cc240 msgr2=0x5565d65d5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd84aa00640 1 --2- 172.21.15.175:0/87828442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d65cc240 0x5565d65d5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd84aa00640 1 -- 172.21.15.175:0/87828442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d65cb920 msgr2=0x5565d65ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd84aa00640 1 --2- 172.21.15.175:0/87828442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d65cb920 0x5565d65ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd84aa00640 1 -- 172.21.15.175:0/87828442 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565d65cc070 con 0x5565d6581f30 2024-04-25T09:04:24.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd84aa00640 1 --2- 172.21.15.175:0/87828442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d6581f30 0x5565d65ca310 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00f010 tx=0x7fd83c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66545d8ac04424b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd83aa00640 1 -- 172.21.15.175:0/87828442 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00e840 con 0x5565d6581f30 2024-04-25T09:04:24.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd83aa00640 1 -- 172.21.15.175:0/87828442 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c0217b0 con 0x5565d6581f30 2024-04-25T09:04:24.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd83aa00640 1 -- 172.21.15.175:0/87828442 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c021450 con 0x5565d6581f30 2024-04-25T09:04:24.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd854c68000 1 -- 172.21.15.175:0/87828442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d6581f30 msgr2=0x5565d65ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd854c68000 1 --2- 172.21.15.175:0/87828442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d6581f30 0x5565d65ca310 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00f010 tx=0x7fd83c01d000 comp rx=0 tx=0).stop 2024-04-25T09:04:24.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd854c68000 1 -- 172.21.15.175:0/87828442 shutdown_connections 2024-04-25T09:04:24.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd854c68000 1 --2- 172.21.15.175:0/87828442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d65cc240 0x5565d65d5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd854c68000 1 --2- 172.21.15.175:0/87828442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d65cb920 0x5565d65ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd854c68000 1 --2- 172.21.15.175:0/87828442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d6581f30 0x5565d65ca310 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd854c68000 1 -- 172.21.15.175:0/87828442 >> 172.21.15.175:0/87828442 conn(0x5565d65882a0 msgr2=0x5565d6585220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:24.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd854c68000 1 -- 172.21.15.175:0/87828442 shutdown_connections 2024-04-25T09:04:24.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.531+0000 7fd854c68000 1 -- 172.21.15.175:0/87828442 wait complete. 2024-04-25T09:04:24.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd854c68000 1 -- start start 2024-04-25T09:04:24.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd854c68000 1 Processor -- start 2024-04-25T09:04:24.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd854c68000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d6581f30 0x5565d662b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd854c68000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d65cb920 0x5565d65d8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd854c68000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d65cc240 0x5565d65d91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd854c68000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565d63d53d0 con 0x5565d65cb920 2024-04-25T09:04:24.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd854c68000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565d648cd50 con 0x5565d65cc240 2024-04-25T09:04:24.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd854c68000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5565d636b980 con 0x5565d6581f30 2024-04-25T09:04:24.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd854c68000 10 client.0 _ll_register_callbacks cb 0x7fd83c001370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:24.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd843e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d65cb920 0x5565d65d8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd843e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d65cb920 0x5565d65d8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46466/0 (socket says 172.21.15.175:46466) 2024-04-25T09:04:24.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd843e00640 1 -- 172.21.15.175:0/3086516356 learned_addr learned my addr 172.21.15.175:0/3086516356 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:24.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd84aa00640 1 --2- 172.21.15.175:0/3086516356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d6581f30 0x5565d662b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd84b400640 1 --2- 172.21.15.175:0/3086516356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d65cc240 0x5565d65d91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd843e00640 1 -- 172.21.15.175:0/3086516356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d6581f30 msgr2=0x5565d662b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd843e00640 1 --2- 172.21.15.175:0/3086516356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d6581f30 0x5565d662b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd843e00640 1 -- 172.21.15.175:0/3086516356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d65cc240 msgr2=0x5565d65d91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd843e00640 1 --2- 172.21.15.175:0/3086516356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d65cc240 0x5565d65d91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd843e00640 1 -- 172.21.15.175:0/3086516356 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565d6452600 con 0x5565d65cb920 2024-04-25T09:04:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd84b400640 1 --2- 172.21.15.175:0/3086516356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d65cc240 0x5565d65d91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd843e00640 1 --2- 172.21.15.175:0/3086516356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d65cb920 0x5565d65d8cb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd834097e80 tx=0x7fd834003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a08a67fb3ea7bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd82fe00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:04:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd82fe00640 1 -- 172.21.15.175:0/3086516356 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8340ef790 con 0x5565d65cb920 2024-04-25T09:04:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd82fe00640 1 -- 172.21.15.175:0/3086516356 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8340ebe00 con 0x5565d65cb920 2024-04-25T09:04:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd854c68000 1 -- 172.21.15.175:0/3086516356 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd83c0217b0 con 0x5565d65cb920 2024-04-25T09:04:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd82fe00640 1 -- 172.21.15.175:0/3086516356 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8340f38e0 con 0x5565d65cb920 2024-04-25T09:04:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd854c68000 10 client.4635 fetch_fsmap learned FSMap version 8 2024-04-25T09:04:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd854c68000 1 -- 172.21.15.175:0/3086516356 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5565d63659b0 con 0x5565d65cb920 2024-04-25T09:04:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd82fe00640 1 -- 172.21.15.175:0/3086516356 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c0217b0 con 0x5565d65cb920 2024-04-25T09:04:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd82fe00640 1 -- 172.21.15.175:0/3086516356 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd8340f7a10 con 0x5565d65cb920 2024-04-25T09:04:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd854c68000 10 client.4635 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T09:04:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd854c68000 10 client.4635 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:04:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd854c68000 20 client.4635 populate_metadata read hostname 'smithi175' 2024-04-25T09:04:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd854c68000 1 --2- 172.21.15.175:0/3086516356 >> [v2:172.21.15.175:6834/2613139594,v1:172.21.15.175:6836/2613139594] conn(0x5565d6632cf0 0x5565d66350e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd854c68000 4 client.4635 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:04:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd854c68000 1 -- 172.21.15.175:0/3086516356 --> [v2:172.21.15.175:6834/2613139594,v1:172.21.15.175:6836/2613139594] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5565d63de2e0 con 0x5565d6632cf0 2024-04-25T09:04:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd84aa00640 1 --2- 172.21.15.175:0/3086516356 >> [v2:172.21.15.175:6834/2613139594,v1:172.21.15.175:6836/2613139594] conn(0x5565d6632cf0 0x5565d66350e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd82fe00640 10 client.4635 ms_handle_connect on v2:172.21.15.175:6834/2613139594 2024-04-25T09:04:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd84aa00640 1 --2- 172.21.15.175:0/3086516356 >> [v2:172.21.15.175:6834/2613139594,v1:172.21.15.175:6836/2613139594] conn(0x5565d6632cf0 0x5565d66350e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd15da76171f3d06 server_cookie=ce51e23e0a74840b in_seq=0 out_seq=0 2024-04-25T09:04:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd82fe00640 1 -- 172.21.15.175:0/3086516356 <== mds.0 v2:172.21.15.175:6834/2613139594 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5565d63de2e0 con 0x5565d6632cf0 2024-04-25T09:04:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.535+0000 7fd82fe00640 10 client.4635 handle_command_reply: tid=0 2024-04-25T09:04:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd854c68000 1 client.4635 shutdown 2024-04-25T09:04:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd854c68000 1 -- 172.21.15.175:0/3086516356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d65cb920 msgr2=0x5565d65d8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd854c68000 1 --2- 172.21.15.175:0/3086516356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d65cb920 0x5565d65d8cb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd834097e80 tx=0x7fd834003f90 comp rx=0 tx=0).stop 2024-04-25T09:04:24.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd854c68000 1 -- 172.21.15.175:0/3086516356 shutdown_connections 2024-04-25T09:04:24.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd854c68000 1 --2- 172.21.15.175:0/3086516356 >> [v2:172.21.15.175:6834/2613139594,v1:172.21.15.175:6836/2613139594] conn(0x5565d6632cf0 0x5565d66350e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd854c68000 1 --2- 172.21.15.175:0/3086516356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5565d65cc240 0x5565d65d91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd854c68000 1 --2- 172.21.15.175:0/3086516356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5565d65cb920 0x5565d65d8cb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd854c68000 1 --2- 172.21.15.175:0/3086516356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5565d6581f30 0x5565d662b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd82fe00640 0 client.4635 ms_handle_reset on v2:172.21.15.175:6834/2613139594 2024-04-25T09:04:24.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd854c68000 1 -- 172.21.15.175:0/3086516356 >> 172.21.15.175:0/3086516356 conn(0x5565d65882a0 msgr2=0x5565d65c9300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:24.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd854c68000 1 -- 172.21.15.175:0/3086516356 shutdown_connections 2024-04-25T09:04:24.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd854c68000 1 -- 172.21.15.175:0/3086516356 wait complete. 2024-04-25T09:04:24.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd854c68000 20 client.4635 trim_cache size 0 max 16384 2024-04-25T09:04:24.542 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:04:24.542 INFO:teuthology.orchestra.run.smithi175.stdout: "cluster_fsid": "8caed986-ca08-40e2-b5a5-12e2aade6223", 2024-04-25T09:04:24.542 INFO:teuthology.orchestra.run.smithi175.stdout: "whoami": 0, 2024-04-25T09:04:24.542 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 4272, 2024-04-25T09:04:24.542 INFO:teuthology.orchestra.run.smithi175.stdout: "want_state": "up:active", 2024-04-25T09:04:24.542 INFO:teuthology.orchestra.run.smithi175.stdout: "state": "up:active", 2024-04-25T09:04:24.542 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs", 2024-04-25T09:04:24.542 INFO:teuthology.orchestra.run.smithi175.stdout: "rank_uptime": 14.113919436, 2024-04-25T09:04:24.542 INFO:teuthology.orchestra.run.smithi175.stdout: "mdsmap_epoch": 8, 2024-04-25T09:04:24.542 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch": 20, 2024-04-25T09:04:24.542 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch_barrier": 20, 2024-04-25T09:04:24.542 INFO:teuthology.orchestra.run.smithi175.stdout: "uptime": 21.158961961999999 2024-04-25T09:04:24.543 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:04:24.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd851800640 1 -- 172.21.15.175:0/1865893511 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd828066f60 msgr2=0x7fd828069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd851800640 1 --2- 172.21.15.175:0/1865893511 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd828066f60 0x7fd828069420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd83c000f70 tx=0x7fd83c009040 comp rx=0 tx=0).stop 2024-04-25T09:04:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd851800640 1 -- 172.21.15.175:0/1865893511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd84c0af980 msgr2=0x7fd84c154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd851800640 1 --2- 172.21.15.175:0/1865893511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd84c0af980 0x7fd84c154b80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd8340ae040 tx=0x7fd834019240 comp rx=0 tx=0).stop 2024-04-25T09:04:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd851800640 1 -- 172.21.15.175:0/1865893511 shutdown_connections 2024-04-25T09:04:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd851800640 1 --2- 172.21.15.175:0/1865893511 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd828066f60 0x7fd828069420 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd851800640 1 --2- 172.21.15.175:0/1865893511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd84c0b0c00 0x7fd84c1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd851800640 1 --2- 172.21.15.175:0/1865893511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd84c0af980 0x7fd84c154b80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd851800640 1 --2- 172.21.15.175:0/1865893511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd84c06b510 0x7fd84c150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd851800640 1 -- 172.21.15.175:0/1865893511 >> 172.21.15.175:0/1865893511 conn(0x7fd84c0d07e0 msgr2=0x7fd84c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd851800640 1 -- 172.21.15.175:0/1865893511 shutdown_connections 2024-04-25T09:04:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:24.539+0000 7fd851800640 1 -- 172.21.15.175:0/1865893511 wait complete. 2024-04-25T09:04:24.549 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T09:04:24.574 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T09:04:24.574 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-25T09:04:24.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:24.574 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:04:24.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:24.584 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2024-04-25T09:04:24.646 INFO:teuthology.orchestra.run.smithi175.stderr:Cannot find device "ceph-brx" 2024-04-25T09:04:24.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:04:24.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:24.649 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:04:24.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:24.705 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2024-04-25T09:04:24.770 INFO:teuthology.orchestra.run.smithi175.stderr:Cannot find device "ceph-brx" 2024-04-25T09:04:24.771 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:04:24.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:24.772 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-04-25T09:04:24.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:24.782 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2024-04-25T09:04:24.848 INFO:teuthology.orchestra.run.smithi177.stderr:Cannot find device "ceph-brx" 2024-04-25T09:04:24.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:04:24.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:24.851 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-04-25T09:04:24.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:24.901 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2024-04-25T09:04:24.966 INFO:teuthology.orchestra.run.smithi177.stderr:Cannot find device "ceph-brx" 2024-04-25T09:04:24.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:04:24.969 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-25T09:04:24.969 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:04:24.969 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:24.969 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:04:25.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.111+0000 7f8f1fc00640 1 Processor -- start 2024-04-25T09:04:25.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.111+0000 7f8f1fc00640 1 -- start start 2024-04-25T09:04:25.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.115+0000 7f8f1fc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f1815a900 0x7f8f1806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:25.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.115+0000 7f8f1fc00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f180cda00 con 0x7f8f180cf560 2024-04-25T09:04:25.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.115+0000 7f8f1fc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f180cdce0 con 0x7f8f180cd520 2024-04-25T09:04:25.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.115+0000 7f8f1fc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1815bcf0 con 0x7f8f1815a900 2024-04-25T09:04:25.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.115+0000 7f8f1dc00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f8f180cf560 0x7f8f1815bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44246/0 (socket says 172.21.15.175:44246) 2024-04-25T09:04:25.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.115+0000 7f8f1dc00640 1 -- 172.21.15.175:0/534627162 learned_addr learned my addr 172.21.15.175:0/534627162 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:25.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.115+0000 7f8f1d200640 1 --2- 172.21.15.175:0/534627162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f1815a900 0x7f8f1806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:25.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.115+0000 7f8f17e00640 1 -- 172.21.15.175:0/534627162 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2948448600 0 0) 0x7f8f180cda00 con 0x7f8f180cf560 2024-04-25T09:04:25.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.115+0000 7f8f17e00640 1 -- 172.21.15.175:0/534627162 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8efc003530 con 0x7f8f180cf560 2024-04-25T09:04:25.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.115+0000 7f8f17e00640 1 -- 172.21.15.175:0/534627162 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593298438 0 0) 0x7f8f180cdce0 con 0x7f8f180cd520 2024-04-25T09:04:25.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.115+0000 7f8f17e00640 1 -- 172.21.15.175:0/534627162 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f180cda00 con 0x7f8f180cd520 2024-04-25T09:04:25.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.115+0000 7f8f17e00640 1 -- 172.21.15.175:0/534627162 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3901322688 0 0) 0x7f8efc003530 con 0x7f8f180cf560 2024-04-25T09:04:25.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.115+0000 7f8f1d200640 1 -- 172.21.15.175:0/534627162 >> v1:172.21.15.177:6789/0 conn(0x7f8f180cd520 legacy=0x7f8f180ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:25.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.115+0000 7f8f1d200640 1 -- 172.21.15.175:0/534627162 >> v1:172.21.15.175:6789/0 conn(0x7f8f180cf560 legacy=0x7f8f1815bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:25.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.115+0000 7f8f1d200640 1 -- 172.21.15.175:0/534627162 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f180cdfc0 con 0x7f8f1815a900 2024-04-25T09:04:25.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.119+0000 7f8f1d200640 1 --2- 172.21.15.175:0/534627162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f1815a900 0x7f8f1806e150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800ba90 tx=0x7f8f0801ead0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f20e881e67debebe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:25.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.119+0000 7f8f17e00640 1 -- 172.21.15.175:0/534627162 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f080b4070 con 0x7f8f1815a900 2024-04-25T09:04:25.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.119+0000 7f8f17e00640 1 -- 172.21.15.175:0/534627162 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f080a7620 con 0x7f8f1815a900 2024-04-25T09:04:25.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.119+0000 7f8f17e00640 1 -- 172.21.15.175:0/534627162 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f10001a00 con 0x7f8f1815a900 2024-04-25T09:04:25.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.119+0000 7f8f1fc00640 1 -- 172.21.15.175:0/534627162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f1815a900 msgr2=0x7f8f1806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:25.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.119+0000 7f8f1fc00640 1 --2- 172.21.15.175:0/534627162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f1815a900 0x7f8f1806e150 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800ba90 tx=0x7f8f0801ead0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.119+0000 7f8f1fc00640 1 -- 172.21.15.175:0/534627162 shutdown_connections 2024-04-25T09:04:25.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.119+0000 7f8f1fc00640 1 --2- 172.21.15.175:0/534627162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f1815a900 0x7f8f1806e150 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.119+0000 7f8f1fc00640 1 -- 172.21.15.175:0/534627162 >> 172.21.15.175:0/534627162 conn(0x7f8f18067150 msgr2=0x7f8f1806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:25.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.119+0000 7f8f1fc00640 1 -- 172.21.15.175:0/534627162 shutdown_connections 2024-04-25T09:04:25.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.119+0000 7f8f1fc00640 1 -- 172.21.15.175:0/534627162 wait complete. 2024-04-25T09:04:25.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.119+0000 7f8f1fc00640 1 Processor -- start 2024-04-25T09:04:25.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.119+0000 7f8f1fc00640 1 -- start start 2024-04-25T09:04:25.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1fc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f180cf560 0x7f8f18157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:25.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1fc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f1815a900 0x7f8f18148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:25.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1fc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f18148cb0 0x7f8f1814a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:25.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1fc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1806d530 con 0x7f8f180cf560 2024-04-25T09:04:25.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1fc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1806d3b0 con 0x7f8f18148cb0 2024-04-25T09:04:25.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1fc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f18071a50 con 0x7f8f1815a900 2024-04-25T09:04:25.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1d200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f180cf560 0x7f8f18157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:25.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1d200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f180cf560 0x7f8f18157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46478/0 (socket says 172.21.15.175:46478) 2024-04-25T09:04:25.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1d200640 1 -- 172.21.15.175:0/1472114930 learned_addr learned my addr 172.21.15.175:0/1472114930 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:25.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f0fe00640 1 --2- 172.21.15.175:0/1472114930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f1815a900 0x7f8f18148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:25.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1dc00640 1 --2- 172.21.15.175:0/1472114930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f18148cb0 0x7f8f1814a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:25.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1d200640 1 -- 172.21.15.175:0/1472114930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f1815a900 msgr2=0x7f8f18148770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:25.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1d200640 1 --2- 172.21.15.175:0/1472114930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f1815a900 0x7f8f18148770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1d200640 1 -- 172.21.15.175:0/1472114930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f18148cb0 msgr2=0x7f8f1814a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:25.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1d200640 1 --2- 172.21.15.175:0/1472114930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f18148cb0 0x7f8f1814a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1d200640 1 -- 172.21.15.175:0/1472114930 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f181491f0 con 0x7f8f180cf560 2024-04-25T09:04:25.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1dc00640 1 --2- 172.21.15.175:0/1472114930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f18148cb0 0x7f8f1814a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:25.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1d200640 1 --2- 172.21.15.175:0/1472114930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f180cf560 0x7f8f18157410 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800ba90 tx=0x7f8f0801b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:25.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f15600640 1 -- 172.21.15.175:0/1472114930 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f080c0020 con 0x7f8f180cf560 2024-04-25T09:04:25.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f15600640 1 -- 172.21.15.175:0/1472114930 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f08004240 con 0x7f8f180cf560 2024-04-25T09:04:25.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f15600640 1 -- 172.21.15.175:0/1472114930 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f080b4040 con 0x7f8f180cf560 2024-04-25T09:04:25.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1fc00640 1 -- 172.21.15.175:0/1472114930 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f181494d0 con 0x7f8f180cf560 2024-04-25T09:04:25.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1fc00640 1 -- 172.21.15.175:0/1472114930 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f18149a90 con 0x7f8f180cf560 2024-04-25T09:04:25.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f1fc00640 1 -- 172.21.15.175:0/1472114930 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f18074a60 con 0x7f8f180cf560 2024-04-25T09:04:25.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.123+0000 7f8f15600640 1 -- 172.21.15.175:0/1472114930 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8f080c3070 con 0x7f8f180cf560 2024-04-25T09:04:25.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.127+0000 7f8f15600640 1 --2- 172.21.15.175:0/1472114930 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8ef4066f60 0x7f8ef4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:25.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.127+0000 7f8f15600640 1 -- 172.21.15.175:0/1472114930 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f08121290 con 0x7f8f180cf560 2024-04-25T09:04:25.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.127+0000 7f8f0fe00640 1 --2- 172.21.15.175:0/1472114930 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8ef4066f60 0x7f8ef4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:25.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.127+0000 7f8f0fe00640 1 --2- 172.21.15.175:0/1472114930 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8ef4066f60 0x7f8ef4069420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8f000011f0 tx=0x7f8f00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:25.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.131+0000 7f8f15600640 1 -- 172.21.15.175:0/1472114930 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8f080186c0 con 0x7f8f180cf560 2024-04-25T09:04:25.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.319+0000 7f8f1fc00640 1 -- 172.21.15.175:0/1472114930 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8f1806aea0 con 0x7f8f180cf560 2024-04-25T09:04:25.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.319+0000 7f8f15600640 1 -- 172.21.15.175:0/1472114930 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8f080f22a0 con 0x7f8f180cf560 2024-04-25T09:04:25.312 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:04:25.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.323+0000 7f8f1fc00640 1 -- 172.21.15.175:0/1472114930 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8ef4066f60 msgr2=0x7f8ef4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:25.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.323+0000 7f8f1fc00640 1 --2- 172.21.15.175:0/1472114930 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8ef4066f60 0x7f8ef4069420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8f000011f0 tx=0x7f8f00009040 comp rx=0 tx=0).stop 2024-04-25T09:04:25.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.323+0000 7f8f1fc00640 1 -- 172.21.15.175:0/1472114930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f180cf560 msgr2=0x7f8f18157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:25.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.323+0000 7f8f1fc00640 1 --2- 172.21.15.175:0/1472114930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f180cf560 0x7f8f18157410 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800ba90 tx=0x7f8f0801b870 comp rx=0 tx=0).stop 2024-04-25T09:04:25.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.323+0000 7f8f1fc00640 1 -- 172.21.15.175:0/1472114930 shutdown_connections 2024-04-25T09:04:25.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.323+0000 7f8f1fc00640 1 --2- 172.21.15.175:0/1472114930 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8ef4066f60 0x7f8ef4069420 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.323+0000 7f8f1fc00640 1 --2- 172.21.15.175:0/1472114930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8f18148cb0 0x7f8f1814a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.323+0000 7f8f1fc00640 1 --2- 172.21.15.175:0/1472114930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8f1815a900 0x7f8f18148770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.323+0000 7f8f1fc00640 1 --2- 172.21.15.175:0/1472114930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f180cf560 0x7f8f18157410 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.323+0000 7f8f1fc00640 1 -- 172.21.15.175:0/1472114930 >> 172.21.15.175:0/1472114930 conn(0x7f8f180cd520 msgr2=0x7f8f1814f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:25.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.323+0000 7f8f1fc00640 1 -- 172.21.15.175:0/1472114930 shutdown_connections 2024-04-25T09:04:25.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:25.323+0000 7f8f1fc00640 1 -- 172.21.15.175:0/1472114930 wait complete. 2024-04-25T09:04:25.333 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T09:04:25.333 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:04:25.333 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-25T09:04:25.333 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:04:25.333 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:25.333 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T09:04:25.333 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:04:25.333 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:04:25.333 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:04:25.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.333 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-25T09:04:25.343 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:04:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:04:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:04:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:04:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:25.343 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:04:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-25T09:04:25.343 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:04:25.343 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-25T09:04:25.344 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:04:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:25.344 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:04:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:04:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42454sec preferred_lft 42454sec 2024-04-25T09:04:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-25T09:04:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:25.344 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:04:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:0d:71:4a:a6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:04:25.344 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:25.345 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T09:04:25.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.345 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:04:25.345 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:04:25.345 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add name ceph-brx type bridge 2024-04-25T09:04:25.345 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip addr flush dev ceph-brx 2024-04-25T09:04:25.345 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set ceph-brx up 2024-04-25T09:04:25.345 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T09:04:25.345 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:04:25.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.454 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:04:25.473 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:04:25.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.475 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-25T09:04:25.556 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-25T09:04:25.556 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:04:25.556 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:04:25.556 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:04:25.556 INFO:teuthology.orchestra.run.smithi175.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:04:25.556 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:04:25.556 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:04:25.556 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:04:25.556 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:04:25.556 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:04:25.557 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:04:25.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.557 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:04:25.557 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:04:25.557 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:04:25.557 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:04:25.557 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:04:25.557 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:04:25.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.645 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:04:25.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.701 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list-id 2024-04-25T09:04:25.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.753 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:04:25.753 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:04:25.753 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:04:25.753 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T09:04:25.753 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:04:25.836 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T09:04:25.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.836 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:04:25.836 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:04:25.836 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T09:04:25.836 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T09:04:25.836 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T09:04:25.837 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T09:04:25.837 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T09:04:25.837 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:04:25.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:25.990 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:04:25.990 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:04:25.990 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-25T09:04:25.990 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T09:04:25.990 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:04:26.030 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:04:26.031 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:26.084 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:04:26.085 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:04:26.085 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:26.139 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:04:26.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:26.140 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:04:26.227 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:04:26.227 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:04:26.227 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:04:26.864 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:04:26.864 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:04:26.864 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:04:26.864 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:04:26.864 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:04:26.877 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:04:26.877 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:04:26.877 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:04:26.877 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:04:26.877 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:04:26.878 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:04:26.878 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:04:26.878 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:04:26.881 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:04:26.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:26.882 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:26.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:26.903 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:04:26.971 INFO:teuthology.orchestra.run.smithi175.stdout:client4618 2024-04-25T09:04:26.971 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:04:26.971 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:27.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:27.021 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:04:27.085 INFO:teuthology.orchestra.run.smithi175.stdout:client4618 2024-04-25T09:04:27.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:27.085 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:04:27.145 INFO:teuthology.orchestra.run.smithi175.stdout:client4618 2024-04-25T09:04:27.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:27.146 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8caed986-ca08-40e2-b5a5-12e2aade6223.client4618/status') 2024-04-25T09:04:27.212 INFO:teuthology.orchestra.run.smithi175.stdout:instance: client.4618 (3)172.21.15.175:0/3571832331 2024-04-25T09:04:27.212 INFO:teuthology.orchestra.run.smithi175.stdout:blocklisted: false 2024-04-25T09:04:27.212 INFO:teuthology.orchestra.run.smithi175.stderr:0+1 records in 2024-04-25T09:04:27.212 INFO:teuthology.orchestra.run.smithi175.stderr:0+1 records out 2024-04-25T09:04:27.212 INFO:teuthology.orchestra.run.smithi175.stderr:71 bytes copied, 5.05e-05 s, 1.4 MB/s 2024-04-25T09:04:27.214 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-25T09:04:27.214 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:04:27.214 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T09:04:27.215 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:04:27.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.399+0000 7fe579a00640 1 Processor -- start 2024-04-25T09:04:27.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.399+0000 7fe579a00640 1 -- start start 2024-04-25T09:04:27.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.403+0000 7fe579a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe574099a50 0x7fe57406cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:27.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.403+0000 7fe579a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe57406bd60 0x7fe574099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:27.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.403+0000 7fe579a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5740d0d50 0x7fe5740cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:27.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.403+0000 7fe579a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57409a370 con 0x7fe574099a50 2024-04-25T09:04:27.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.403+0000 7fe579a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5740cfcb0 con 0x7fe57406bd60 2024-04-25T09:04:27.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.403+0000 7fe579a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5740cff90 con 0x7fe5740d0d50 2024-04-25T09:04:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.403+0000 7fe572a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe574099a50 0x7fe57406cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.403+0000 7fe572a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe574099a50 0x7fe57406cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46492/0 (socket says 172.21.15.175:46492) 2024-04-25T09:04:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.403+0000 7fe572a00640 1 -- 172.21.15.175:0/4202628918 learned_addr learned my addr 172.21.15.175:0/4202628918 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.403+0000 7fe56a000640 1 --2- 172.21.15.175:0/4202628918 >> v2:172.21.15.177:3300/0 conn(0x7fe57406bd60 0x7fe574099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.403+0000 7fe573400640 1 --2- 172.21.15.175:0/4202628918 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5740d0d50 0x7fe5740cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.403+0000 7fe572a00640 1 -- 172.21.15.175:0/4202628918 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5740d0d50 msgr2=0x7fe5740cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.403+0000 7fe572a00640 1 --2- 172.21.15.175:0/4202628918 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5740d0d50 0x7fe5740cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.403+0000 7fe572a00640 1 -- 172.21.15.175:0/4202628918 >> v2:172.21.15.177:3300/0 conn(0x7fe57406bd60 msgr2=0x7fe574099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.403+0000 7fe572a00640 1 --2- 172.21.15.175:0/4202628918 >> v2:172.21.15.177:3300/0 conn(0x7fe57406bd60 0x7fe574099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.403+0000 7fe572a00640 1 -- 172.21.15.175:0/4202628918 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5740d0270 con 0x7fe574099a50 2024-04-25T09:04:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.403+0000 7fe56a000640 1 --2- 172.21.15.175:0/4202628918 >> v2:172.21.15.177:3300/0 conn(0x7fe57406bd60 0x7fe574099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:27.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.407+0000 7fe572a00640 1 --2- 172.21.15.175:0/4202628918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe574099a50 0x7fe57406cc50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe574067440 tx=0x7fe56401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2aa2c4699dea7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:27.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.407+0000 7fe572000640 1 -- 172.21.15.175:0/4202628918 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5640a5670 con 0x7fe574099a50 2024-04-25T09:04:27.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.407+0000 7fe572000640 1 -- 172.21.15.175:0/4202628918 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5640a5810 con 0x7fe574099a50 2024-04-25T09:04:27.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.407+0000 7fe572000640 1 -- 172.21.15.175:0/4202628918 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5640a5be0 con 0x7fe574099a50 2024-04-25T09:04:27.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.407+0000 7fe579a00640 1 -- 172.21.15.175:0/4202628918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe574099a50 msgr2=0x7fe57406cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.407+0000 7fe579a00640 1 --2- 172.21.15.175:0/4202628918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe574099a50 0x7fe57406cc50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe574067440 tx=0x7fe56401c9f0 comp rx=0 tx=0).stop 2024-04-25T09:04:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.407+0000 7fe579a00640 1 -- 172.21.15.175:0/4202628918 shutdown_connections 2024-04-25T09:04:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.407+0000 7fe579a00640 1 --2- 172.21.15.175:0/4202628918 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5740d0d50 0x7fe5740cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.407+0000 7fe579a00640 1 --2- 172.21.15.175:0/4202628918 >> v2:172.21.15.177:3300/0 conn(0x7fe57406bd60 0x7fe574099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.407+0000 7fe579a00640 1 --2- 172.21.15.175:0/4202628918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe574099a50 0x7fe57406cc50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.407+0000 7fe579a00640 1 -- 172.21.15.175:0/4202628918 >> 172.21.15.175:0/4202628918 conn(0x7fe5740b3300 msgr2=0x7fe5740b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.407+0000 7fe579a00640 1 -- 172.21.15.175:0/4202628918 shutdown_connections 2024-04-25T09:04:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.407+0000 7fe579a00640 1 -- 172.21.15.175:0/4202628918 wait complete. 2024-04-25T09:04:27.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.407+0000 7fe579a00640 1 Processor -- start 2024-04-25T09:04:27.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.407+0000 7fe579a00640 1 -- start start 2024-04-25T09:04:27.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe579a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe57406bd60 0x7fe5740b4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:27.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe579a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe574099a50 0x7fe5740b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:27.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe579a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5740d0d50 0x7fe5740b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:27.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe579a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5740cc930 con 0x7fe57406bd60 2024-04-25T09:04:27.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe579a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5740cc7b0 con 0x7fe574099a50 2024-04-25T09:04:27.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe579a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57415de60 con 0x7fe5740d0d50 2024-04-25T09:04:27.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe572a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe57406bd60 0x7fe5740b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:27.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe572a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe57406bd60 0x7fe5740b4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46506/0 (socket says 172.21.15.175:46506) 2024-04-25T09:04:27.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe572a00640 1 -- 172.21.15.175:0/450754177 learned_addr learned my addr 172.21.15.175:0/450754177 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:27.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe573400640 1 --2- 172.21.15.175:0/450754177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5740d0d50 0x7fe5740b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:27.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe56a000640 1 --2- 172.21.15.175:0/450754177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe574099a50 0x7fe5740b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:27.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe572a00640 1 -- 172.21.15.175:0/450754177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5740d0d50 msgr2=0x7fe5740b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:27.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe572a00640 1 --2- 172.21.15.175:0/450754177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5740d0d50 0x7fe5740b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:27.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe572a00640 1 -- 172.21.15.175:0/450754177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe574099a50 msgr2=0x7fe5740b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:27.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe572a00640 1 --2- 172.21.15.175:0/450754177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe574099a50 0x7fe5740b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:27.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe572a00640 1 -- 172.21.15.175:0/450754177 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5740c6250 con 0x7fe57406bd60 2024-04-25T09:04:27.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe573400640 1 --2- 172.21.15.175:0/450754177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5740d0d50 0x7fe5740b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:27.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe56a000640 1 --2- 172.21.15.175:0/450754177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe574099a50 0x7fe5740b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:27.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe572a00640 1 --2- 172.21.15.175:0/450754177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe57406bd60 0x7fe5740b4600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe56401b0a0 tx=0x7fe564019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:27.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe56b400640 1 -- 172.21.15.175:0/450754177 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5640b8670 con 0x7fe57406bd60 2024-04-25T09:04:27.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe56b400640 1 -- 172.21.15.175:0/450754177 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5640be070 con 0x7fe57406bd60 2024-04-25T09:04:27.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe56b400640 1 -- 172.21.15.175:0/450754177 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5640b8a50 con 0x7fe57406bd60 2024-04-25T09:04:27.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe579a00640 1 -- 172.21.15.175:0/450754177 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5740c6530 con 0x7fe57406bd60 2024-04-25T09:04:27.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe579a00640 1 -- 172.21.15.175:0/450754177 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5740c6af0 con 0x7fe57406bd60 2024-04-25T09:04:27.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe579a00640 1 -- 172.21.15.175:0/450754177 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe574074a60 con 0x7fe57406bd60 2024-04-25T09:04:27.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.411+0000 7fe56b400640 1 -- 172.21.15.175:0/450754177 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe5640b8bf0 con 0x7fe57406bd60 2024-04-25T09:04:27.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.415+0000 7fe56b400640 1 --2- 172.21.15.175:0/450754177 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe550066f60 0x7fe550069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:27.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.415+0000 7fe56b400640 1 -- 172.21.15.175:0/450754177 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5641201b0 con 0x7fe57406bd60 2024-04-25T09:04:27.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.415+0000 7fe56a000640 1 --2- 172.21.15.175:0/450754177 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe550066f60 0x7fe550069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:27.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.415+0000 7fe56a000640 1 --2- 172.21.15.175:0/450754177 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe550066f60 0x7fe550069420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe57415d4c0 tx=0x7fe55c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:27.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.419+0000 7fe56b400640 1 -- 172.21.15.175:0/450754177 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe5640165e0 con 0x7fe57406bd60 2024-04-25T09:04:27.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.607+0000 7fe579a00640 1 -- 172.21.15.175:0/450754177 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe5740b00a0 con 0x7fe57406bd60 2024-04-25T09:04:27.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.607+0000 7fe56b400640 1 -- 172.21.15.175:0/450754177 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe5640f1240 con 0x7fe57406bd60 2024-04-25T09:04:27.598 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:04:27.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.607+0000 7fe579a00640 1 -- 172.21.15.175:0/450754177 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe550066f60 msgr2=0x7fe550069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:27.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.607+0000 7fe579a00640 1 --2- 172.21.15.175:0/450754177 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe550066f60 0x7fe550069420 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe57415d4c0 tx=0x7fe55c008040 comp rx=0 tx=0).stop 2024-04-25T09:04:27.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.607+0000 7fe579a00640 1 -- 172.21.15.175:0/450754177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe57406bd60 msgr2=0x7fe5740b4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:27.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.607+0000 7fe579a00640 1 --2- 172.21.15.175:0/450754177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe57406bd60 0x7fe5740b4600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe56401b0a0 tx=0x7fe564019790 comp rx=0 tx=0).stop 2024-04-25T09:04:27.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.607+0000 7fe579a00640 1 -- 172.21.15.175:0/450754177 shutdown_connections 2024-04-25T09:04:27.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.607+0000 7fe579a00640 1 --2- 172.21.15.175:0/450754177 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe550066f60 0x7fe550069420 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:27.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.607+0000 7fe579a00640 1 --2- 172.21.15.175:0/450754177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5740d0d50 0x7fe5740b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:27.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.607+0000 7fe579a00640 1 --2- 172.21.15.175:0/450754177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe574099a50 0x7fe5740b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:27.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.607+0000 7fe579a00640 1 --2- 172.21.15.175:0/450754177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe57406bd60 0x7fe5740b4600 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:27.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.607+0000 7fe579a00640 1 -- 172.21.15.175:0/450754177 >> 172.21.15.175:0/450754177 conn(0x7fe5740b3300 msgr2=0x7fe574070870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:27.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.607+0000 7fe579a00640 1 -- 172.21.15.175:0/450754177 shutdown_connections 2024-04-25T09:04:27.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:27.607+0000 7fe579a00640 1 -- 172.21.15.175:0/450754177 wait complete. 2024-04-25T09:04:27.620 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T09:04:27.620 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:04:27.620 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-25T09:04:27.620 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-25T09:04:27.620 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T09:04:27.620 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T09:04:27.620 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:04:27.620 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:04:27.620 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-25T09:04:27.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:27.620 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-25T09:04:27.629 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:04:27.629 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:04:27.629 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:04:27.629 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:27.629 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:04:27.629 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:27.629 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:04:27.629 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:27.629 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-25T09:04:27.629 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:04:27.630 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:27.630 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-25T09:04:27.630 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:04:27.630 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:27.630 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:04:27.630 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:27.630 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:04:27.630 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42451sec preferred_lft 42451sec 2024-04-25T09:04:27.630 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-25T09:04:27.630 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:27.630 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:04:27.630 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:0d:71:4a:a6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:27.630 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:04:27.630 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:27.631 INFO:teuthology.orchestra.run.smithi175.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:04:27.631 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:27.631 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:04:27.631 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:27.631 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:04:27.631 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:27.631 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:04:27.631 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:04:27.631 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:04:27.631 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:27.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:27.632 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:04:27.698 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:04:27.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:27.700 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-25T09:04:27.757 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-25T09:04:27.757 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:04:27.757 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:04:27.757 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:04:27.757 INFO:teuthology.orchestra.run.smithi175.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:04:27.757 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:04:27.757 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:04:27.758 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:04:27.758 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:04:27.758 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:04:27.758 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:04:27.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:27.758 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:04:27.758 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:04:27.758 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:04:27.758 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:04:27.758 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:04:27.758 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:04:27.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:27.849 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:04:27.858 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:04:27.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:27.859 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list-id 2024-04-25T09:04:27.908 INFO:teuthology.orchestra.run.smithi175.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-25T09:04:27.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:27.909 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:04:27.909 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:04:27.909 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:04:27.909 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-25T09:04:27.909 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:04:27.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:27.991 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T09:04:28.052 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:04:28.052 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:04:28.052 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:04:28.052 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:28.052 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:04:28.052 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:28.052 INFO:teuthology.orchestra.run.smithi175.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:04:28.052 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 72:a4:b4:85:33:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T09:04:28.052 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T09:04:28.053 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:28.053 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::70a4:b4ff:fe85:3339/64 scope link 2024-04-25T09:04:28.053 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:28.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:28.054 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T09:04:28.115 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:04:28.115 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:04:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:04:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:04:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:28.116 INFO:teuthology.orchestra.run.smithi175.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:04:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 72:a4:b4:85:33:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T09:04:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T09:04:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::70a4:b4ff:fe85:3339/64 scope link 2024-04-25T09:04:28.116 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:28.117 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-25T09:04:28.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:28.118 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:04:28.118 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:04:28.118 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-25T09:04:28.118 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T09:04:28.118 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-25T09:04:28.118 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-25T09:04:28.118 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-25T09:04:28.118 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:04:28.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:28.252 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:04:28.252 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:04:28.252 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.1 up 2024-04-25T09:04:28.253 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T09:04:28.253 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:04:28.291 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:04:28.291 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-25T09:04:28.340 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-25T09:04:28.341 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:04:28.341 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-25T09:04:28.392 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:04:28.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:28.392 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T09:04:28.483 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T09:04:28.484 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T09:04:28.484 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:04:28.499 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T09:04:28.499 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T09:04:28.499 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:04:28.499 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:04:28.499 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:04:28.508 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T09:04:28.508 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T09:04:28.508 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:04:28.509 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:04:28.509 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:04:28.509 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:04:28.509 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:04:28.509 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:04:28.512 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:04:28.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:28.512 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-25T09:04:28.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:28.532 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:04:28.587 INFO:teuthology.orchestra.run.smithi175.stdout:client4624 2024-04-25T09:04:28.587 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:04:28.587 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:28.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:28.640 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:04:28.694 INFO:teuthology.orchestra.run.smithi175.stdout:client4624 2024-04-25T09:04:28.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:28.695 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:04:28.750 INFO:teuthology.orchestra.run.smithi175.stdout:client4624 2024-04-25T09:04:28.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:28.751 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8caed986-ca08-40e2-b5a5-12e2aade6223.client4624/status') 2024-04-25T09:04:28.815 INFO:teuthology.orchestra.run.smithi175.stdout:instance: client.4624 (3)172.21.15.175:0/3000738728 2024-04-25T09:04:28.816 INFO:teuthology.orchestra.run.smithi175.stdout:blocklisted: false 2024-04-25T09:04:28.816 INFO:teuthology.orchestra.run.smithi175.stderr:0+1 records in 2024-04-25T09:04:28.816 INFO:teuthology.orchestra.run.smithi175.stderr:0+1 records out 2024-04-25T09:04:28.816 INFO:teuthology.orchestra.run.smithi175.stderr:71 bytes copied, 7.1824e-05 s, 989 kB/s 2024-04-25T09:04:28.818 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-25T09:04:28.818 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:04:28.818 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T09:04:28.818 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:04:28.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.007+0000 7fb863a00640 1 Processor -- start 2024-04-25T09:04:28.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.007+0000 7fb863a00640 1 -- start start 2024-04-25T09:04:29.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.007+0000 7fb863a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb85c144fc0 0x7fb85c0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:29.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.007+0000 7fb863a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb85c1453a0 0x7fb85c15bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:29.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.007+0000 7fb863a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85c15cd00 con 0x7fb85c0cc3b0 2024-04-25T09:04:29.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.007+0000 7fb863a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85c0ce660 con 0x7fb85c1453a0 2024-04-25T09:04:29.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.007+0000 7fb863a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0cc930 con 0x7fb85c144fc0 2024-04-25T09:04:29.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.007+0000 7fb853e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb85c1453a0 0x7fb85c15bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:29.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.007+0000 7fb861a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb85c0cc3b0 0x7fb85c15f480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44254/0 (socket says 172.21.15.175:44254) 2024-04-25T09:04:29.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.007+0000 7fb853e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb85c1453a0 0x7fb85c15bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46522/0 (socket says 172.21.15.175:46522) 2024-04-25T09:04:29.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.007+0000 7fb861a00640 1 -- 172.21.15.175:0/2082774015 learned_addr learned my addr 172.21.15.175:0/2082774015 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:29.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.011+0000 7fb861000640 1 --2- 172.21.15.175:0/2082774015 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb85c144fc0 0x7fb85c0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:29.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.011+0000 7fb853e00640 1 -- 172.21.15.175:0/2082774015 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb85c144fc0 msgr2=0x7fb85c0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:29.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.011+0000 7fb853e00640 1 --2- 172.21.15.175:0/2082774015 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb85c144fc0 0x7fb85c0cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:29.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.011+0000 7fb853e00640 1 -- 172.21.15.175:0/2082774015 >> v1:172.21.15.175:6789/0 conn(0x7fb85c0cc3b0 legacy=0x7fb85c15f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:29.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.011+0000 7fb853e00640 1 -- 172.21.15.175:0/2082774015 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c0ccc10 con 0x7fb85c1453a0 2024-04-25T09:04:29.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.011+0000 7fb85be00640 1 -- 172.21.15.175:0/2082774015 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590538714 0 0) 0x7fb85c15cd00 con 0x7fb85c0cc3b0 2024-04-25T09:04:29.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.011+0000 7fb853e00640 1 --2- 172.21.15.175:0/2082774015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85c1453a0 0x7fb85c15bed0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb8440097c0 tx=0x7fb84401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7511ed0d837e2ebb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:29.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.011+0000 7fb85be00640 1 -- 172.21.15.175:0/2082774015 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8440b2070 con 0x7fb85c1453a0 2024-04-25T09:04:29.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.011+0000 7fb85be00640 1 -- 172.21.15.175:0/2082774015 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8440ad640 con 0x7fb85c1453a0 2024-04-25T09:04:29.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.011+0000 7fb85be00640 1 -- 172.21.15.175:0/2082774015 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8440ada10 con 0x7fb85c1453a0 2024-04-25T09:04:29.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.011+0000 7fb863a00640 1 -- 172.21.15.175:0/2082774015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85c1453a0 msgr2=0x7fb85c15bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:29.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.011+0000 7fb863a00640 1 --2- 172.21.15.175:0/2082774015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85c1453a0 0x7fb85c15bed0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb8440097c0 tx=0x7fb84401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:29.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.011+0000 7fb863a00640 1 -- 172.21.15.175:0/2082774015 shutdown_connections 2024-04-25T09:04:29.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.011+0000 7fb863a00640 1 --2- 172.21.15.175:0/2082774015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85c1453a0 0x7fb85c15bed0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:29.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.011+0000 7fb863a00640 1 --2- 172.21.15.175:0/2082774015 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb85c144fc0 0x7fb85c0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:29.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.011+0000 7fb863a00640 1 -- 172.21.15.175:0/2082774015 >> 172.21.15.175:0/2082774015 conn(0x7fb85c067150 msgr2=0x7fb85c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:29.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb863a00640 1 -- 172.21.15.175:0/2082774015 shutdown_connections 2024-04-25T09:04:29.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb863a00640 1 -- 172.21.15.175:0/2082774015 wait complete. 2024-04-25T09:04:29.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb863a00640 1 Processor -- start 2024-04-25T09:04:29.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb863a00640 1 -- start start 2024-04-25T09:04:29.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb863a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb85c144fc0 0x7fb85c15a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:29.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb863a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb85c1453a0 0x7fb85c1656b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:29.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb863a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85c165bf0 0x7fb85c13f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:29.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb863a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0cffb0 con 0x7fb85c165bf0 2024-04-25T09:04:29.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb863a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0cfe30 con 0x7fb85c144fc0 2024-04-25T09:04:29.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb863a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c1685f0 con 0x7fb85c1453a0 2024-04-25T09:04:29.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb861a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85c165bf0 0x7fb85c13f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:29.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb853e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb85c1453a0 0x7fb85c1656b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:29.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb861a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85c165bf0 0x7fb85c13f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46530/0 (socket says 172.21.15.175:46530) 2024-04-25T09:04:29.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb861a00640 1 -- 172.21.15.175:0/2378262438 learned_addr learned my addr 172.21.15.175:0/2378262438 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:29.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb861000640 1 --2- 172.21.15.175:0/2378262438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb85c144fc0 0x7fb85c15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:29.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb861a00640 1 -- 172.21.15.175:0/2378262438 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb85c1453a0 msgr2=0x7fb85c1656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:29.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb861a00640 1 --2- 172.21.15.175:0/2378262438 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb85c1453a0 0x7fb85c1656b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:29.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb861a00640 1 -- 172.21.15.175:0/2378262438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb85c144fc0 msgr2=0x7fb85c15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:29.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb861a00640 1 --2- 172.21.15.175:0/2378262438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb85c144fc0 0x7fb85c15a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:29.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb861a00640 1 -- 172.21.15.175:0/2378262438 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c13fdc0 con 0x7fb85c165bf0 2024-04-25T09:04:29.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb861a00640 1 --2- 172.21.15.175:0/2378262438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85c165bf0 0x7fb85c13f070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb85400c7d0 tx=0x7fb85400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:29.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb859600640 1 -- 172.21.15.175:0/2378262438 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854018070 con 0x7fb85c165bf0 2024-04-25T09:04:29.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb859600640 1 -- 172.21.15.175:0/2378262438 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85400a640 con 0x7fb85c165bf0 2024-04-25T09:04:29.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb859600640 1 -- 172.21.15.175:0/2378262438 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85400aa70 con 0x7fb85c165bf0 2024-04-25T09:04:29.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb863a00640 1 -- 172.21.15.175:0/2378262438 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85c1400a0 con 0x7fb85c165bf0 2024-04-25T09:04:29.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.015+0000 7fb863a00640 1 -- 172.21.15.175:0/2378262438 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85c0b0640 con 0x7fb85c165bf0 2024-04-25T09:04:29.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.019+0000 7fb863a00640 1 -- 172.21.15.175:0/2378262438 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85c074a60 con 0x7fb85c165bf0 2024-04-25T09:04:29.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.019+0000 7fb859600640 1 -- 172.21.15.175:0/2378262438 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb85400ac10 con 0x7fb85c165bf0 2024-04-25T09:04:29.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.019+0000 7fb859600640 1 --2- 172.21.15.175:0/2378262438 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb838066f60 0x7fb838069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:29.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.019+0000 7fb859600640 1 -- 172.21.15.175:0/2378262438 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8540845c0 con 0x7fb85c165bf0 2024-04-25T09:04:29.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.019+0000 7fb861000640 1 --2- 172.21.15.175:0/2378262438 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb838066f60 0x7fb838069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:29.012 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.019+0000 7fb861000640 1 --2- 172.21.15.175:0/2378262438 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb838066f60 0x7fb838069420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb85c1655d0 tx=0x7fb84c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:29.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.023+0000 7fb859600640 1 -- 172.21.15.175:0/2378262438 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb854054f70 con 0x7fb85c165bf0 2024-04-25T09:04:29.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.211+0000 7fb863a00640 1 -- 172.21.15.175:0/2378262438 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb85c140550 con 0x7fb85c165bf0 2024-04-25T09:04:29.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.211+0000 7fb859600640 1 -- 172.21.15.175:0/2378262438 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb854059010 con 0x7fb85c165bf0 2024-04-25T09:04:29.205 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:04:29.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.215+0000 7fb863a00640 1 -- 172.21.15.175:0/2378262438 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb838066f60 msgr2=0x7fb838069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:29.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.215+0000 7fb863a00640 1 --2- 172.21.15.175:0/2378262438 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb838066f60 0x7fb838069420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb85c1655d0 tx=0x7fb84c008040 comp rx=0 tx=0).stop 2024-04-25T09:04:29.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.215+0000 7fb863a00640 1 -- 172.21.15.175:0/2378262438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85c165bf0 msgr2=0x7fb85c13f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:29.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.215+0000 7fb863a00640 1 --2- 172.21.15.175:0/2378262438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85c165bf0 0x7fb85c13f070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb85400c7d0 tx=0x7fb85400cc90 comp rx=0 tx=0).stop 2024-04-25T09:04:29.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.215+0000 7fb863a00640 1 -- 172.21.15.175:0/2378262438 shutdown_connections 2024-04-25T09:04:29.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.215+0000 7fb863a00640 1 --2- 172.21.15.175:0/2378262438 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb838066f60 0x7fb838069420 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:29.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.215+0000 7fb863a00640 1 --2- 172.21.15.175:0/2378262438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85c165bf0 0x7fb85c13f070 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:29.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.215+0000 7fb863a00640 1 --2- 172.21.15.175:0/2378262438 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb85c1453a0 0x7fb85c1656b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:29.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.215+0000 7fb863a00640 1 --2- 172.21.15.175:0/2378262438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb85c144fc0 0x7fb85c15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:29.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.215+0000 7fb863a00640 1 -- 172.21.15.175:0/2378262438 >> 172.21.15.175:0/2378262438 conn(0x7fb85c0cc3b0 msgr2=0x7fb85c1418c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:29.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.215+0000 7fb863a00640 1 -- 172.21.15.175:0/2378262438 shutdown_connections 2024-04-25T09:04:29.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:29.215+0000 7fb863a00640 1 -- 172.21.15.175:0/2378262438 wait complete. 2024-04-25T09:04:29.225 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T09:04:29.225 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:04:29.225 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-04-25T09:04:29.225 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T09:04:29.225 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T09:04:29.226 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T09:04:29.226 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:04:29.226 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:04:29.226 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T09:04:29.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:29.227 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-04-25T09:04:29.236 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:04:29.237 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:04:29.237 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:04:29.237 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:29.237 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-04-25T09:04:29.237 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:29.237 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:04:29.237 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:29.237 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-04-25T09:04:29.237 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:04:29.237 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:29.237 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-04-25T09:04:29.237 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:04:29.238 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:29.238 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:04:29.238 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:29.238 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:04:29.238 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42441sec preferred_lft 42441sec 2024-04-25T09:04:29.238 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2024-04-25T09:04:29.238 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:29.238 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:04:29.238 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:3d:f9:b0:0a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:29.238 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:04:29.238 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:29.239 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T09:04:29.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:29.239 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-04-25T09:04:29.240 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-04-25T09:04:29.240 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add name ceph-brx type bridge 2024-04-25T09:04:29.240 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip addr flush dev ceph-brx 2024-04-25T09:04:29.240 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set ceph-brx up 2024-04-25T09:04:29.240 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T09:04:29.240 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-04-25T09:04:29.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:29.355 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:04:29.373 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-04-25T09:04:29.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:29.375 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-04-25T09:04:29.444 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-04-25T09:04:29.444 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:04:29.444 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:04:29.444 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:04:29.444 INFO:teuthology.orchestra.run.smithi177.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:04:29.444 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:04:29.444 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:04:29.444 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:04:29.444 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:04:29.444 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:04:29.444 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:04:29.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:29.445 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-04-25T09:04:29.445 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-04-25T09:04:29.445 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:04:29.445 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:04:29.445 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:04:29.445 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-04-25T09:04:29.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:29.541 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-04-25T09:04:29.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:29.550 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list-id 2024-04-25T09:04:29.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:29.604 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-04-25T09:04:29.604 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-04-25T09:04:29.604 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T09:04:29.604 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T09:04:29.604 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-04-25T09:04:29.688 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T09:04:29.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:29.689 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-04-25T09:04:29.689 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-04-25T09:04:29.689 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T09:04:29.689 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T09:04:29.689 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T09:04:29.689 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T09:04:29.689 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T09:04:29.689 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-04-25T09:04:29.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:29.842 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-04-25T09:04:29.842 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-04-25T09:04:29.842 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2024-04-25T09:04:29.842 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T09:04:29.842 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-04-25T09:04:29.881 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:04:29.881 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T09:04:29.935 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T09:04:29.936 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:04:29.936 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T09:04:29.987 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:04:29.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:29.987 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T09:04:30.074 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T09:04:30.075 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T09:04:30.075 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-04-25T09:04:30.680 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T09:04:30.680 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T09:04:30.680 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-04-25T09:04:30.680 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:04:30.680 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:04:30.694 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T09:04:30.694 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T09:04:30.694 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-04-25T09:04:30.694 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:04:30.694 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:04:30.694 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:04:30.694 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:04:30.695 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:04:30.699 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:04:30.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:30.699 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T09:04:30.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:30.719 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:04:30.785 INFO:teuthology.orchestra.run.smithi177.stdout:client4659 2024-04-25T09:04:30.785 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:04:30.785 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:30.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:30.836 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:04:30.891 INFO:teuthology.orchestra.run.smithi177.stdout:client4659 2024-04-25T09:04:30.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:30.892 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:04:30.942 INFO:teuthology.orchestra.run.smithi177.stdout:client4659 2024-04-25T09:04:30.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:30.942 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8caed986-ca08-40e2-b5a5-12e2aade6223.client4659/status') 2024-04-25T09:04:31.002 INFO:teuthology.orchestra.run.smithi177.stdout:instance: client.4659 (3)172.21.15.177:0/134160338 2024-04-25T09:04:31.002 INFO:teuthology.orchestra.run.smithi177.stdout:blocklisted: false 2024-04-25T09:04:31.003 INFO:teuthology.orchestra.run.smithi177.stderr:0+1 records in 2024-04-25T09:04:31.003 INFO:teuthology.orchestra.run.smithi177.stderr:0+1 records out 2024-04-25T09:04:31.003 INFO:teuthology.orchestra.run.smithi177.stderr:70 bytes copied, 5.0984e-05 s, 1.4 MB/s 2024-04-25T09:04:31.004 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-25T09:04:31.005 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:04:31.005 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T09:04:31.005 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:04:31.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.159+0000 7fbbd4600640 1 Processor -- start 2024-04-25T09:04:31.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.159+0000 7fbbd4600640 1 -- start start 2024-04-25T09:04:31.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.159+0000 7fbbd4600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbbcc099a50 0x7fbbcc06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:31.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.159+0000 7fbbd4600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbbcc0d0d50 0x7fbbcc0cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:31.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.159+0000 7fbbd4600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbcc0cfcb0 con 0x7fbbcc06bd60 2024-04-25T09:04:31.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.159+0000 7fbbd4600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbcc0cff90 con 0x7fbbcc0d0d50 2024-04-25T09:04:31.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.159+0000 7fbbd4600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbcc0d0270 con 0x7fbbcc099a50 2024-04-25T09:04:31.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.159+0000 7fbbd1200640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fbbcc06bd60 0x7fbbcc099e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39466/0 (socket says 172.21.15.175:39466) 2024-04-25T09:04:31.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.159+0000 7fbbd1200640 1 -- 172.21.15.175:0/1057896280 learned_addr learned my addr 172.21.15.175:0/1057896280 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:31.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.159+0000 7fbbd2600640 1 --2- 172.21.15.175:0/1057896280 >> v2:172.21.15.175:3300/0 conn(0x7fbbcc0d0d50 0x7fbbcc0cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:31.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.163+0000 7fbbd1c00640 1 --2- 172.21.15.175:0/1057896280 >> v2:172.21.15.177:3300/0 conn(0x7fbbcc099a50 0x7fbbcc06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:31.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.163+0000 7fbbcbe00640 1 -- 172.21.15.175:0/1057896280 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2771505427 0 0) 0x7fbbcc0cfcb0 con 0x7fbbcc06bd60 2024-04-25T09:04:31.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.163+0000 7fbbcbe00640 1 -- 172.21.15.175:0/1057896280 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbb4003530 con 0x7fbbcc06bd60 2024-04-25T09:04:31.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.163+0000 7fbbd2600640 1 -- 172.21.15.175:0/1057896280 >> v2:172.21.15.177:3300/0 conn(0x7fbbcc099a50 msgr2=0x7fbbcc06cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:31.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.163+0000 7fbbd2600640 1 --2- 172.21.15.175:0/1057896280 >> v2:172.21.15.177:3300/0 conn(0x7fbbcc099a50 0x7fbbcc06cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:31.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.163+0000 7fbbd2600640 1 -- 172.21.15.175:0/1057896280 >> v1:172.21.15.175:6789/0 conn(0x7fbbcc06bd60 legacy=0x7fbbcc099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:31.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.163+0000 7fbbd2600640 1 -- 172.21.15.175:0/1057896280 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc0d0550 con 0x7fbbcc0d0d50 2024-04-25T09:04:31.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.163+0000 7fbbd2600640 1 --2- 172.21.15.175:0/1057896280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbcc0d0d50 0x7fbbcc0cbe60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc071ee0 tx=0x7fbbc401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f356fbdd5a0af245 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:31.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.163+0000 7fbbcbe00640 1 -- 172.21.15.175:0/1057896280 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc40b2070 con 0x7fbbcc0d0d50 2024-04-25T09:04:31.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.163+0000 7fbbcbe00640 1 -- 172.21.15.175:0/1057896280 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc40a57f0 con 0x7fbbcc0d0d50 2024-04-25T09:04:31.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.163+0000 7fbbcbe00640 1 -- 172.21.15.175:0/1057896280 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc40a5bc0 con 0x7fbbcc0d0d50 2024-04-25T09:04:31.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd4600640 1 -- 172.21.15.175:0/1057896280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbcc0d0d50 msgr2=0x7fbbcc0cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:31.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd4600640 1 --2- 172.21.15.175:0/1057896280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbcc0d0d50 0x7fbbcc0cbe60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc071ee0 tx=0x7fbbc401c930 comp rx=0 tx=0).stop 2024-04-25T09:04:31.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd4600640 1 -- 172.21.15.175:0/1057896280 shutdown_connections 2024-04-25T09:04:31.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd4600640 1 --2- 172.21.15.175:0/1057896280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbcc0d0d50 0x7fbbcc0cbe60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:31.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd4600640 1 --2- 172.21.15.175:0/1057896280 >> v2:172.21.15.177:3300/0 conn(0x7fbbcc099a50 0x7fbbcc06cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:31.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd4600640 1 -- 172.21.15.175:0/1057896280 >> 172.21.15.175:0/1057896280 conn(0x7fbbcc0b3300 msgr2=0x7fbbcc0b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:31.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd4600640 1 -- 172.21.15.175:0/1057896280 shutdown_connections 2024-04-25T09:04:31.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd4600640 1 -- 172.21.15.175:0/1057896280 wait complete. 2024-04-25T09:04:31.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd4600640 1 Processor -- start 2024-04-25T09:04:31.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd4600640 1 -- start start 2024-04-25T09:04:31.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd4600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbcc06bd60 0x7fbbcc0ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:31.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd4600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbcc099a50 0x7fbbcc0c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:31.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd4600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbbcc0d0d50 0x7fbbcc0c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:31.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd4600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc15dfe0 con 0x7fbbcc099a50 2024-04-25T09:04:31.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd4600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc15de60 con 0x7fbbcc06bd60 2024-04-25T09:04:31.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd4600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc16b260 con 0x7fbbcc0d0d50 2024-04-25T09:04:31.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd1200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbcc099a50 0x7fbbcc0c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:31.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd1200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbcc099a50 0x7fbbcc0c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35942/0 (socket says 172.21.15.175:35942) 2024-04-25T09:04:31.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd1200640 1 -- 172.21.15.175:0/4267300070 learned_addr learned my addr 172.21.15.175:0/4267300070 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:31.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd1c00640 1 --2- 172.21.15.175:0/4267300070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbcc06bd60 0x7fbbcc0ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:31.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd2600640 1 --2- 172.21.15.175:0/4267300070 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbbcc0d0d50 0x7fbbcc0c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:31.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd1200640 1 -- 172.21.15.175:0/4267300070 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbbcc0d0d50 msgr2=0x7fbbcc0c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:31.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd1200640 1 --2- 172.21.15.175:0/4267300070 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbbcc0d0d50 0x7fbbcc0c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:31.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd1200640 1 -- 172.21.15.175:0/4267300070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbcc06bd60 msgr2=0x7fbbcc0ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:31.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd1200640 1 --2- 172.21.15.175:0/4267300070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbcc06bd60 0x7fbbcc0ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:31.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd1200640 1 -- 172.21.15.175:0/4267300070 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc0c9980 con 0x7fbbcc099a50 2024-04-25T09:04:31.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd2600640 1 --2- 172.21.15.175:0/4267300070 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbbcc0d0d50 0x7fbbcc0c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:31.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.167+0000 7fbbd1200640 1 --2- 172.21.15.175:0/4267300070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbcc099a50 0x7fbbcc0c8f00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800c3f0 tx=0x7fbbb800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:31.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.171+0000 7fbbc9600640 1 -- 172.21.15.175:0/4267300070 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8017070 con 0x7fbbcc099a50 2024-04-25T09:04:31.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.171+0000 7fbbc9600640 1 -- 172.21.15.175:0/4267300070 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb8005cf0 con 0x7fbbcc099a50 2024-04-25T09:04:31.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.171+0000 7fbbd4600640 1 -- 172.21.15.175:0/4267300070 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbcc0c9c30 con 0x7fbbcc099a50 2024-04-25T09:04:31.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.171+0000 7fbbc9600640 1 -- 172.21.15.175:0/4267300070 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80072f0 con 0x7fbbcc099a50 2024-04-25T09:04:31.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.171+0000 7fbbd4600640 1 -- 172.21.15.175:0/4267300070 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbcc0ca1f0 con 0x7fbbcc099a50 2024-04-25T09:04:31.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.171+0000 7fbbd4600640 1 -- 172.21.15.175:0/4267300070 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbcc0ca9c0 con 0x7fbbcc099a50 2024-04-25T09:04:31.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.171+0000 7fbbc9600640 1 -- 172.21.15.175:0/4267300070 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbbb801a070 con 0x7fbbcc099a50 2024-04-25T09:04:31.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.171+0000 7fbbc9600640 1 --2- 172.21.15.175:0/4267300070 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbbac066f60 0x7fbbac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:31.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.171+0000 7fbbc9600640 1 -- 172.21.15.175:0/4267300070 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbb80843d0 con 0x7fbbcc099a50 2024-04-25T09:04:31.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.171+0000 7fbbd1c00640 1 --2- 172.21.15.175:0/4267300070 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbbac066f60 0x7fbbac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:31.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.175+0000 7fbbd1c00640 1 --2- 172.21.15.175:0/4267300070 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbbac066f60 0x7fbbac069420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0b74a0 tx=0x7fbbc0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:31.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.175+0000 7fbbc9600640 1 -- 172.21.15.175:0/4267300070 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbbb8054d80 con 0x7fbbcc099a50 2024-04-25T09:04:31.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.363+0000 7fbbd4600640 1 -- 172.21.15.175:0/4267300070 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbbcc074a60 con 0x7fbbcc099a50 2024-04-25T09:04:31.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.363+0000 7fbbc9600640 1 -- 172.21.15.175:0/4267300070 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbbb805b0d0 con 0x7fbbcc099a50 2024-04-25T09:04:31.356 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:04:31.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.367+0000 7fbbd4600640 1 -- 172.21.15.175:0/4267300070 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbbac066f60 msgr2=0x7fbbac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:31.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.367+0000 7fbbd4600640 1 --2- 172.21.15.175:0/4267300070 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbbac066f60 0x7fbbac069420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0b74a0 tx=0x7fbbc0009190 comp rx=0 tx=0).stop 2024-04-25T09:04:31.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.367+0000 7fbbd4600640 1 -- 172.21.15.175:0/4267300070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbcc099a50 msgr2=0x7fbbcc0c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:31.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.367+0000 7fbbd4600640 1 --2- 172.21.15.175:0/4267300070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbcc099a50 0x7fbbcc0c8f00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800c3f0 tx=0x7fbbb800c8b0 comp rx=0 tx=0).stop 2024-04-25T09:04:31.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.367+0000 7fbbd4600640 1 -- 172.21.15.175:0/4267300070 shutdown_connections 2024-04-25T09:04:31.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.367+0000 7fbbd4600640 1 --2- 172.21.15.175:0/4267300070 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbbac066f60 0x7fbbac069420 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:31.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.367+0000 7fbbd4600640 1 --2- 172.21.15.175:0/4267300070 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbbcc0d0d50 0x7fbbcc0c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:31.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.367+0000 7fbbd4600640 1 --2- 172.21.15.175:0/4267300070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbcc099a50 0x7fbbcc0c8f00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:31.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.367+0000 7fbbd4600640 1 --2- 172.21.15.175:0/4267300070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbcc06bd60 0x7fbbcc0ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:31.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.367+0000 7fbbd4600640 1 -- 172.21.15.175:0/4267300070 >> 172.21.15.175:0/4267300070 conn(0x7fbbcc0b3300 msgr2=0x7fbbcc0ae980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:31.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.367+0000 7fbbd4600640 1 -- 172.21.15.175:0/4267300070 shutdown_connections 2024-04-25T09:04:31.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:31.367+0000 7fbbd4600640 1 -- 172.21.15.175:0/4267300070 wait complete. 2024-04-25T09:04:31.376 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T09:04:31.376 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:04:31.377 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2024-04-25T09:04:31.377 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-25T09:04:31.377 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T09:04:31.377 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T09:04:31.377 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:04:31.377 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:04:31.377 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-25T09:04:31.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:31.377 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2024-04-25T09:04:31.388 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:04:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:04:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:04:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-04-25T09:04:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:31.388 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:04:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2024-04-25T09:04:31.388 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:04:31.388 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2024-04-25T09:04:31.389 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:04:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:31.389 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:04:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:04:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42439sec preferred_lft 42439sec 2024-04-25T09:04:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2024-04-25T09:04:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:31.389 INFO:teuthology.orchestra.run.smithi177.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:04:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 02:42:3d:f9:b0:0a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:04:31.389 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:31.389 INFO:teuthology.orchestra.run.smithi177.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:04:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:04:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:04:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:31.390 INFO:teuthology.orchestra.run.smithi177.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:04:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T09:04:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-04-25T09:04:31.390 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:31.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:31.391 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:04:31.450 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-04-25T09:04:31.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:31.452 DEBUG:teuthology.orchestra.run.smithi177:> route 2024-04-25T09:04:31.512 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2024-04-25T09:04:31.512 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:04:31.512 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:04:31.512 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:04:31.512 INFO:teuthology.orchestra.run.smithi177.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:04:31.512 INFO:teuthology.orchestra.run.smithi177.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:04:31.512 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:04:31.513 INFO:teuthology.orchestra.run.smithi177.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:04:31.513 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:04:31.513 INFO:teuthology.orchestra.run.smithi177.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:04:31.513 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:04:31.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:31.513 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-04-25T09:04:31.513 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-04-25T09:04:31.513 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:04:31.513 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:04:31.513 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:04:31.513 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-04-25T09:04:31.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:31.606 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-04-25T09:04:31.614 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T09:04:31.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:31.617 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list-id 2024-04-25T09:04:31.663 INFO:teuthology.orchestra.run.smithi177.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-25T09:04:31.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:31.664 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-04-25T09:04:31.664 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-04-25T09:04:31.665 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T09:04:31.665 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-25T09:04:31.665 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-04-25T09:04:31.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:31.746 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T09:04:31.807 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:04:31.807 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:04:31.808 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:04:31.808 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:31.808 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-04-25T09:04:31.808 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:31.808 INFO:teuthology.orchestra.run.smithi177.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:04:31.808 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether e2:72:67:a1:f6:a6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T09:04:31.808 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T09:04:31.808 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:31.808 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::e072:67ff:fea1:f6a6/64 scope link 2024-04-25T09:04:31.808 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:31.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:31.809 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T09:04:31.876 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:04:31.876 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:04:31.876 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:04:31.876 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:31.876 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2024-04-25T09:04:31.877 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:31.877 INFO:teuthology.orchestra.run.smithi177.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:04:31.877 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether e2:72:67:a1:f6:a6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T09:04:31.877 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T09:04:31.877 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:31.877 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::e072:67ff:fea1:f6a6/64 scope link 2024-04-25T09:04:31.877 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:31.878 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-25T09:04:31.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:31.878 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-04-25T09:04:31.879 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-04-25T09:04:31.879 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-25T09:04:31.879 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T09:04:31.879 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-25T09:04:31.879 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-25T09:04:31.879 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-25T09:04:31.879 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-04-25T09:04:32.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:32.015 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2024-04-25T09:04:32.015 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2024-04-25T09:04:32.015 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.1 up 2024-04-25T09:04:32.015 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T09:04:32.015 DEBUG:teuthology.orchestra.run.smithi177:> ') 2024-04-25T09:04:32.054 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:04:32.054 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-25T09:04:32.108 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-25T09:04:32.108 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:04:32.108 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-25T09:04:32.159 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:04:32.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:32.159 DEBUG:teuthology.orchestra.run.smithi177:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T09:04:32.247 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T09:04:32.247 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T09:04:32.247 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-04-25T09:04:32.262 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T09:04:32.262 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T09:04:32.262 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-04-25T09:04:32.262 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:04:32.262 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:04:32.272 INFO:teuthology.orchestra.run.smithi177.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T09:04:32.272 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T09:04:32.272 INFO:teuthology.orchestra.run.smithi177.stdout:invalid new device string format 2024-04-25T09:04:32.272 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:04:32.272 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:04:32.272 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:04:32.272 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:04:32.272 INFO:teuthology.orchestra.run.smithi177.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:04:32.276 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:04:32.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:32.276 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-25T09:04:32.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:32.343 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:04:32.395 INFO:teuthology.orchestra.run.smithi177.stdout:client4538 2024-04-25T09:04:32.396 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:04:32.396 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:32.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:32.446 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:04:32.499 INFO:teuthology.orchestra.run.smithi177.stdout:client4538 2024-04-25T09:04:32.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:32.499 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:04:32.550 INFO:teuthology.orchestra.run.smithi177.stdout:client4538 2024-04-25T09:04:32.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:32.551 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/8caed986-ca08-40e2-b5a5-12e2aade6223.client4538/status') 2024-04-25T09:04:32.610 INFO:teuthology.orchestra.run.smithi177.stdout:instance: client.4538 (3)192.168.0.2:0/927763671 2024-04-25T09:04:32.610 INFO:teuthology.orchestra.run.smithi177.stdout:blocklisted: false 2024-04-25T09:04:32.611 INFO:teuthology.orchestra.run.smithi177.stderr:0+1 records in 2024-04-25T09:04:32.611 INFO:teuthology.orchestra.run.smithi177.stderr:0+1 records out 2024-04-25T09:04:32.611 INFO:teuthology.orchestra.run.smithi177.stderr:68 bytes copied, 5.5012e-05 s, 1.2 MB/s 2024-04-25T09:04:32.613 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-25T09:04:32.631 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:32.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.787+0000 7fb055600640 1 Processor -- start 2024-04-25T09:04:32.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.787+0000 7fb055600640 1 -- start start 2024-04-25T09:04:32.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.787+0000 7fb055600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb05015a900 0x7fb05006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:32.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.787+0000 7fb055600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb0500cd520 0x7fb0500ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:32.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.787+0000 7fb055600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0500cf560 0x7fb0500cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:32.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.787+0000 7fb055600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0500cfef0 con 0x7fb0500cd520 2024-04-25T09:04:32.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.787+0000 7fb055600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0500cda00 con 0x7fb05015a900 2024-04-25T09:04:32.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.787+0000 7fb055600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500cdce0 con 0x7fb0500cf560 2024-04-25T09:04:32.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.787+0000 7fb04e000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb0500cd520 0x7fb0500ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:32.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.787+0000 7fb04f400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0500cf560 0x7fb0500cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:32.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.787+0000 7fb04ea00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb05015a900 0x7fb05006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:32.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.787+0000 7fb04e000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb0500cd520 0x7fb0500ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35952/0 (socket says 172.21.15.175:35952) 2024-04-25T09:04:32.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.787+0000 7fb04e000640 1 -- 172.21.15.175:0/1982993807 learned_addr learned my addr 172.21.15.175:0/1982993807 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:32.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.791+0000 7fb04e000640 1 -- 172.21.15.175:0/1982993807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0500cf560 msgr2=0x7fb0500cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:32.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.791+0000 7fb04e000640 1 --2- 172.21.15.175:0/1982993807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0500cf560 0x7fb0500cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:32.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.791+0000 7fb04e000640 1 -- 172.21.15.175:0/1982993807 >> v2:172.21.15.177:3300/0 conn(0x7fb05015a900 msgr2=0x7fb05006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:32.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.791+0000 7fb04e000640 1 --2- 172.21.15.175:0/1982993807 >> v2:172.21.15.177:3300/0 conn(0x7fb05015a900 0x7fb05006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:32.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.791+0000 7fb04e000640 1 -- 172.21.15.175:0/1982993807 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0500cdfc0 con 0x7fb0500cd520 2024-04-25T09:04:32.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.791+0000 7fb04e000640 1 --2- 172.21.15.175:0/1982993807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0500cd520 0x7fb0500ceaa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb0500b4c70 tx=0x7fb03c01e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1991f49194578270 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:32.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.791+0000 7fb04d600640 1 -- 172.21.15.175:0/1982993807 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c0ae070 con 0x7fb0500cd520 2024-04-25T09:04:32.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.791+0000 7fb04d600640 1 -- 172.21.15.175:0/1982993807 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c0a8690 con 0x7fb0500cd520 2024-04-25T09:04:32.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.791+0000 7fb04d600640 1 -- 172.21.15.175:0/1982993807 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c0a8a60 con 0x7fb0500cd520 2024-04-25T09:04:32.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.791+0000 7fb055600640 1 -- 172.21.15.175:0/1982993807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0500cd520 msgr2=0x7fb0500ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:32.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.791+0000 7fb055600640 1 --2- 172.21.15.175:0/1982993807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0500cd520 0x7fb0500ceaa0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb0500b4c70 tx=0x7fb03c01e700 comp rx=0 tx=0).stop 2024-04-25T09:04:32.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.791+0000 7fb055600640 1 -- 172.21.15.175:0/1982993807 shutdown_connections 2024-04-25T09:04:32.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.791+0000 7fb055600640 1 --2- 172.21.15.175:0/1982993807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0500cf560 0x7fb0500cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:32.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.791+0000 7fb055600640 1 --2- 172.21.15.175:0/1982993807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0500cd520 0x7fb0500ceaa0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:32.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.791+0000 7fb055600640 1 --2- 172.21.15.175:0/1982993807 >> v2:172.21.15.177:3300/0 conn(0x7fb05015a900 0x7fb05006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:32.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.791+0000 7fb055600640 1 -- 172.21.15.175:0/1982993807 >> 172.21.15.175:0/1982993807 conn(0x7fb050067150 msgr2=0x7fb05006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:32.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb055600640 1 -- 172.21.15.175:0/1982993807 shutdown_connections 2024-04-25T09:04:32.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb055600640 1 -- 172.21.15.175:0/1982993807 wait complete. 2024-04-25T09:04:32.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb055600640 1 Processor -- start 2024-04-25T09:04:32.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb055600640 1 -- start start 2024-04-25T09:04:32.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb055600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0500cf560 0x7fb0500af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:32.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb055600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05015a900 0x7fb05014f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:32.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb055600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05014ff30 0x7fb0500ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:32.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb055600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05006d530 con 0x7fb05014ff30 2024-04-25T09:04:32.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb055600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05006d3b0 con 0x7fb0500cf560 2024-04-25T09:04:32.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb055600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05015c790 con 0x7fb05015a900 2024-04-25T09:04:32.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb04f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05014ff30 0x7fb0500ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:32.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb04ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0500cf560 0x7fb0500af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:32.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb04e000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05015a900 0x7fb05014f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:32.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb04ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0500cf560 0x7fb0500af210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:41084/0 (socket says 172.21.15.175:41084) 2024-04-25T09:04:32.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb04ea00640 1 -- 172.21.15.175:0/1489033421 learned_addr learned my addr 172.21.15.175:0/1489033421 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:32.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb04e000640 1 -- 172.21.15.175:0/1489033421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0500cf560 msgr2=0x7fb0500af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:32.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb04e000640 1 --2- 172.21.15.175:0/1489033421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0500cf560 0x7fb0500af210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:32.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb04e000640 1 -- 172.21.15.175:0/1489033421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05014ff30 msgr2=0x7fb0500ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:32.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb04e000640 1 --2- 172.21.15.175:0/1489033421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05014ff30 0x7fb0500ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:32.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb04e000640 1 -- 172.21.15.175:0/1489033421 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0501503d0 con 0x7fb05015a900 2024-04-25T09:04:32.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb04f400640 1 --2- 172.21.15.175:0/1489033421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05014ff30 0x7fb0500ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:32.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb04e000640 1 --2- 172.21.15.175:0/1489033421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05015a900 0x7fb05014f9f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0ad000 tx=0x7fb03c01b4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:32.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb046a00640 1 -- 172.21.15.175:0/1489033421 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c0ae050 con 0x7fb05015a900 2024-04-25T09:04:32.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb046a00640 1 -- 172.21.15.175:0/1489033421 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c0a8490 con 0x7fb05015a900 2024-04-25T09:04:32.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb046a00640 1 -- 172.21.15.175:0/1489033421 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c0a98a0 con 0x7fb05015a900 2024-04-25T09:04:32.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.795+0000 7fb055600640 1 -- 172.21.15.175:0/1489033421 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0501506b0 con 0x7fb05015a900 2024-04-25T09:04:32.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.799+0000 7fb055600640 1 -- 172.21.15.175:0/1489033421 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb050150c70 con 0x7fb05015a900 2024-04-25T09:04:32.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.799+0000 7fb055600640 1 -- 172.21.15.175:0/1489033421 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb050074a60 con 0x7fb05015a900 2024-04-25T09:04:32.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.799+0000 7fb046a00640 1 -- 172.21.15.175:0/1489033421 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb03c0bc020 con 0x7fb05015a900 2024-04-25T09:04:32.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.799+0000 7fb046a00640 1 --2- 172.21.15.175:0/1489033421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb030066f60 0x7fb030069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:32.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.799+0000 7fb046a00640 1 -- 172.21.15.175:0/1489033421 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb03c11e6e0 con 0x7fb05015a900 2024-04-25T09:04:32.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.799+0000 7fb04ea00640 1 --2- 172.21.15.175:0/1489033421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb030066f60 0x7fb030069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:32.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.799+0000 7fb04ea00640 1 --2- 172.21.15.175:0/1489033421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb030066f60 0x7fb030069420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb0400094c0 tx=0x7fb04000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:32.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.803+0000 7fb046a00640 1 -- 172.21.15.175:0/1489033421 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb03c0c3020 con 0x7fb05015a900 2024-04-25T09:04:32.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.959+0000 7fb055600640 1 -- 172.21.15.175:0/1489033421 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb050151110 con 0x7fb05015a900 2024-04-25T09:04:32.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.963+0000 7fb046a00640 1 -- 172.21.15.175:0/1489033421 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7fb03c018320 con 0x7fb05015a900 2024-04-25T09:04:32.953 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:32.954 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":20,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:11.440551+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:32.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.963+0000 7fb055600640 1 -- 172.21.15.175:0/1489033421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb030066f60 msgr2=0x7fb030069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:32.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.963+0000 7fb055600640 1 --2- 172.21.15.175:0/1489033421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb030066f60 0x7fb030069420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb0400094c0 tx=0x7fb04000b040 comp rx=0 tx=0).stop 2024-04-25T09:04:32.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.963+0000 7fb055600640 1 -- 172.21.15.175:0/1489033421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05015a900 msgr2=0x7fb05014f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:32.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.963+0000 7fb055600640 1 --2- 172.21.15.175:0/1489033421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05015a900 0x7fb05014f9f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0ad000 tx=0x7fb03c01b4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:32.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.963+0000 7fb055600640 1 -- 172.21.15.175:0/1489033421 shutdown_connections 2024-04-25T09:04:32.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.963+0000 7fb055600640 1 --2- 172.21.15.175:0/1489033421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb030066f60 0x7fb030069420 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:32.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.963+0000 7fb055600640 1 --2- 172.21.15.175:0/1489033421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05014ff30 0x7fb0500ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:32.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.963+0000 7fb055600640 1 --2- 172.21.15.175:0/1489033421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05015a900 0x7fb05014f9f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:32.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.963+0000 7fb055600640 1 --2- 172.21.15.175:0/1489033421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0500cf560 0x7fb0500af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:32.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.963+0000 7fb055600640 1 -- 172.21.15.175:0/1489033421 >> 172.21.15.175:0/1489033421 conn(0x7fb0500cd520 msgr2=0x7fb05006ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:32.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.963+0000 7fb055600640 1 -- 172.21.15.175:0/1489033421 shutdown_connections 2024-04-25T09:04:32.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:32.963+0000 7fb055600640 1 -- 172.21.15.175:0/1489033421 wait complete. 2024-04-25T09:04:32.975 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:08.047706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:04:08.795449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:32.975 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:33.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.123+0000 7f420ec00640 1 Processor -- start 2024-04-25T09:04:33.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.123+0000 7f420ec00640 1 -- start start 2024-04-25T09:04:33.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.123+0000 7f420ec00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f42080cbe60 0x7f420815af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.123+0000 7f420ec00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f42080b4800 0x7f420815c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.123+0000 7f420ec00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420806db60 con 0x7f420806d310 2024-04-25T09:04:33.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.123+0000 7f420ec00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420806de40 con 0x7f42080b4800 2024-04-25T09:04:33.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.123+0000 7f420ec00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420806e120 con 0x7f42080cbe60 2024-04-25T09:04:33.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.123+0000 7f4207400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f420806d310 0x7f42080b40f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39478/0 (socket says 172.21.15.175:39478) 2024-04-25T09:04:33.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.123+0000 7f4207e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f42080cbe60 0x7f420815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.123+0000 7f420cc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f42080b4800 0x7f420815c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.123+0000 7f4207400640 1 -- 172.21.15.175:0/2651150197 learned_addr learned my addr 172.21.15.175:0/2651150197 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:33.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.123+0000 7f420cc00640 1 -- 172.21.15.175:0/2651150197 >> v2:172.21.15.177:3300/0 conn(0x7f42080cbe60 msgr2=0x7f420815af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:33.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.123+0000 7f420cc00640 1 --2- 172.21.15.175:0/2651150197 >> v2:172.21.15.177:3300/0 conn(0x7f42080cbe60 0x7f420815af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.123+0000 7f420cc00640 1 -- 172.21.15.175:0/2651150197 >> v1:172.21.15.175:6789/0 conn(0x7f420806d310 legacy=0x7f42080b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.123+0000 7f420cc00640 1 -- 172.21.15.175:0/2651150197 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420815c2f0 con 0x7f42080b4800 2024-04-25T09:04:33.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.123+0000 7f4206a00640 1 -- 172.21.15.175:0/2651150197 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790366705 0 0) 0x7f420806db60 con 0x7f420806d310 2024-04-25T09:04:33.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.123+0000 7f4207e00640 1 --2- 172.21.15.175:0/2651150197 >> v2:172.21.15.177:3300/0 conn(0x7f42080cbe60 0x7f420815af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:33.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.127+0000 7f420cc00640 1 --2- 172.21.15.175:0/2651150197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42080b4800 0x7f420815c810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f42080b4d50 tx=0x7f420001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1536c3ffa820bdc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:33.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.127+0000 7f4206a00640 1 -- 172.21.15.175:0/2651150197 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42000b2070 con 0x7f42080b4800 2024-04-25T09:04:33.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.127+0000 7f4206a00640 1 -- 172.21.15.175:0/2651150197 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42000a57f0 con 0x7f42080b4800 2024-04-25T09:04:33.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.127+0000 7f4206a00640 1 -- 172.21.15.175:0/2651150197 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42000a5bc0 con 0x7f42080b4800 2024-04-25T09:04:33.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.127+0000 7f420ec00640 1 -- 172.21.15.175:0/2651150197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42080b4800 msgr2=0x7f420815c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.127+0000 7f420ec00640 1 --2- 172.21.15.175:0/2651150197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42080b4800 0x7f420815c810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f42080b4d50 tx=0x7f420001c930 comp rx=0 tx=0).stop 2024-04-25T09:04:33.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.127+0000 7f420ec00640 1 -- 172.21.15.175:0/2651150197 shutdown_connections 2024-04-25T09:04:33.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.127+0000 7f420ec00640 1 --2- 172.21.15.175:0/2651150197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42080b4800 0x7f420815c810 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.127+0000 7f420ec00640 1 --2- 172.21.15.175:0/2651150197 >> v2:172.21.15.177:3300/0 conn(0x7f42080cbe60 0x7f420815af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.127+0000 7f420ec00640 1 -- 172.21.15.175:0/2651150197 >> 172.21.15.175:0/2651150197 conn(0x7f420806ac50 msgr2=0x7f420806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:33.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.127+0000 7f420ec00640 1 -- 172.21.15.175:0/2651150197 shutdown_connections 2024-04-25T09:04:33.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.127+0000 7f420ec00640 1 -- 172.21.15.175:0/2651150197 wait complete. 2024-04-25T09:04:33.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420ec00640 1 Processor -- start 2024-04-25T09:04:33.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420ec00640 1 -- start start 2024-04-25T09:04:33.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420ec00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f420806d310 0x7f4208142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420ec00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42080b4800 0x7f42080a8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420ec00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42080cbe60 0x7f42080a9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420ec00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420815d930 con 0x7f42080cbe60 2024-04-25T09:04:33.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420ec00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420815d7b0 con 0x7f42080b4800 2024-04-25T09:04:33.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420ec00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420815dab0 con 0x7f420806d310 2024-04-25T09:04:33.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42080cbe60 0x7f42080a9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42080cbe60 0x7f42080a9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35984/0 (socket says 172.21.15.175:35984) 2024-04-25T09:04:33.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420cc00640 1 -- 172.21.15.175:0/1507373877 learned_addr learned my addr 172.21.15.175:0/1507373877 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:33.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f4207e00640 1 --2- 172.21.15.175:0/1507373877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f420806d310 0x7f4208142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f4207400640 1 --2- 172.21.15.175:0/1507373877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42080b4800 0x7f42080a8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420cc00640 1 -- 172.21.15.175:0/1507373877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f420806d310 msgr2=0x7f4208142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420cc00640 1 --2- 172.21.15.175:0/1507373877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f420806d310 0x7f4208142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420cc00640 1 -- 172.21.15.175:0/1507373877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42080b4800 msgr2=0x7f42080a8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420cc00640 1 --2- 172.21.15.175:0/1507373877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42080b4800 0x7f42080a8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420cc00640 1 -- 172.21.15.175:0/1507373877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4208151d60 con 0x7f42080cbe60 2024-04-25T09:04:33.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420cc00640 1 --2- 172.21.15.175:0/1507373877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42080cbe60 0x7f42080a9170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f42000b0040 tx=0x7f42000196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:33.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f41ffe00640 1 -- 172.21.15.175:0/1507373877 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42000b2050 con 0x7f42080cbe60 2024-04-25T09:04:33.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f41ffe00640 1 -- 172.21.15.175:0/1507373877 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42000be070 con 0x7f42080cbe60 2024-04-25T09:04:33.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f41ffe00640 1 -- 172.21.15.175:0/1507373877 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42000ad890 con 0x7f42080cbe60 2024-04-25T09:04:33.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420ec00640 1 -- 172.21.15.175:0/1507373877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4208152040 con 0x7f42080cbe60 2024-04-25T09:04:33.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420ec00640 1 -- 172.21.15.175:0/1507373877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4208152600 con 0x7f42080cbe60 2024-04-25T09:04:33.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.131+0000 7f420ec00640 1 -- 172.21.15.175:0/1507373877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4208075160 con 0x7f42080cbe60 2024-04-25T09:04:33.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.135+0000 7f41ffe00640 1 -- 172.21.15.175:0/1507373877 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f42000ada30 con 0x7f42080cbe60 2024-04-25T09:04:33.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.135+0000 7f41ffe00640 1 --2- 172.21.15.175:0/1507373877 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f41e8066f90 0x7f41e8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.135+0000 7f41ffe00640 1 -- 172.21.15.175:0/1507373877 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f420011ffd0 con 0x7f42080cbe60 2024-04-25T09:04:33.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.135+0000 7f4207e00640 1 --2- 172.21.15.175:0/1507373877 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f41e8066f90 0x7f41e8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.135+0000 7f4207e00640 1 --2- 172.21.15.175:0/1507373877 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f41e8066f90 0x7f41e8069450 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009580 tx=0x7f41f8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:33.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.139+0000 7f41ffe00640 1 -- 172.21.15.175:0/1507373877 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4200016520 con 0x7f42080cbe60 2024-04-25T09:04:33.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.291+0000 7f420ec00640 1 -- 172.21.15.175:0/1507373877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4208157980 con 0x7f42080cbe60 2024-04-25T09:04:33.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.291+0000 7f41ffe00640 1 -- 172.21.15.175:0/1507373877 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f42000f0980 con 0x7f42080cbe60 2024-04-25T09:04:33.284 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:04:33.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.295+0000 7f420ec00640 1 -- 172.21.15.175:0/1507373877 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f41e8066f90 msgr2=0x7f41e8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.295+0000 7f420ec00640 1 --2- 172.21.15.175:0/1507373877 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f41e8066f90 0x7f41e8069450 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009580 tx=0x7f41f8009190 comp rx=0 tx=0).stop 2024-04-25T09:04:33.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.295+0000 7f420ec00640 1 -- 172.21.15.175:0/1507373877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42080cbe60 msgr2=0x7f42080a9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.295+0000 7f420ec00640 1 --2- 172.21.15.175:0/1507373877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42080cbe60 0x7f42080a9170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f42000b0040 tx=0x7f42000196d0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.295+0000 7f420ec00640 1 -- 172.21.15.175:0/1507373877 shutdown_connections 2024-04-25T09:04:33.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.295+0000 7f420ec00640 1 --2- 172.21.15.175:0/1507373877 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f41e8066f90 0x7f41e8069450 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.295+0000 7f420ec00640 1 --2- 172.21.15.175:0/1507373877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42080cbe60 0x7f42080a9170 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.295+0000 7f420ec00640 1 --2- 172.21.15.175:0/1507373877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42080b4800 0x7f42080a8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.295+0000 7f420ec00640 1 --2- 172.21.15.175:0/1507373877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f420806d310 0x7f4208142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.295+0000 7f420ec00640 1 -- 172.21.15.175:0/1507373877 >> 172.21.15.175:0/1507373877 conn(0x7f420806ac50 msgr2=0x7f42080cd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:33.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.295+0000 7f420ec00640 1 -- 172.21.15.175:0/1507373877 shutdown_connections 2024-04-25T09:04:33.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.295+0000 7f420ec00640 1 -- 172.21.15.175:0/1507373877 wait complete. 2024-04-25T09:04:33.305 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:33.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.455+0000 7f3d55a00640 1 Processor -- start 2024-04-25T09:04:33.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.455+0000 7f3d55a00640 1 -- start start 2024-04-25T09:04:33.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.455+0000 7f3d55a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d50099cb0 0x7f3d5006c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.455+0000 7f3d55a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3d500b27c0 0x7f3d5015d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.455+0000 7f3d55a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5006cef0 con 0x7f3d5009a090 2024-04-25T09:04:33.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.455+0000 7f3d55a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d500cf8b0 con 0x7f3d500b27c0 2024-04-25T09:04:33.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.455+0000 7f3d55a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5006ccb0 con 0x7f3d50099cb0 2024-04-25T09:04:33.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.455+0000 7f3d4f400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f3d5009a090 0x7f3d500cbcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39484/0 (socket says 172.21.15.175:39484) 2024-04-25T09:04:33.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.455+0000 7f3d4f400640 1 -- 172.21.15.175:0/1319039728 learned_addr learned my addr 172.21.15.175:0/1319039728 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:33.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.455+0000 7f3d4fe00640 1 --2- 172.21.15.175:0/1319039728 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d50099cb0 0x7f3d5006c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.455+0000 7f3d55000640 1 --2- 172.21.15.175:0/1319039728 >> v2:172.21.15.177:3300/0 conn(0x7f3d500b27c0 0x7f3d5015d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.455+0000 7f3d4ea00640 1 -- 172.21.15.175:0/1319039728 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435224905 0 0) 0x7f3d5006cef0 con 0x7f3d5009a090 2024-04-25T09:04:33.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.455+0000 7f3d4ea00640 1 -- 172.21.15.175:0/1319039728 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d34003530 con 0x7f3d5009a090 2024-04-25T09:04:33.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.455+0000 7f3d4fe00640 1 -- 172.21.15.175:0/1319039728 >> v2:172.21.15.177:3300/0 conn(0x7f3d500b27c0 msgr2=0x7f3d5015d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:33.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.455+0000 7f3d4fe00640 1 --2- 172.21.15.175:0/1319039728 >> v2:172.21.15.177:3300/0 conn(0x7f3d500b27c0 0x7f3d5015d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.455+0000 7f3d4fe00640 1 -- 172.21.15.175:0/1319039728 >> v1:172.21.15.175:6789/0 conn(0x7f3d5009a090 legacy=0x7f3d500cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.455+0000 7f3d4fe00640 1 -- 172.21.15.175:0/1319039728 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d500cfae0 con 0x7f3d50099cb0 2024-04-25T09:04:33.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.459+0000 7f3d4fe00640 1 --2- 172.21.15.175:0/1319039728 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d50099cb0 0x7f3d5006c770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d400097c0 tx=0x7f3d4001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=393c75547b84e5ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:33.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.459+0000 7f3d4ea00640 1 -- 172.21.15.175:0/1319039728 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d400b0070 con 0x7f3d50099cb0 2024-04-25T09:04:33.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.459+0000 7f3d4ea00640 1 -- 172.21.15.175:0/1319039728 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d400ab600 con 0x7f3d50099cb0 2024-04-25T09:04:33.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.459+0000 7f3d4ea00640 1 -- 172.21.15.175:0/1319039728 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d400ab9b0 con 0x7f3d50099cb0 2024-04-25T09:04:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.459+0000 7f3d55a00640 1 -- 172.21.15.175:0/1319039728 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d50099cb0 msgr2=0x7f3d5006c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.459+0000 7f3d55a00640 1 --2- 172.21.15.175:0/1319039728 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d50099cb0 0x7f3d5006c770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d400097c0 tx=0x7f3d4001c410 comp rx=0 tx=0).stop 2024-04-25T09:04:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.459+0000 7f3d55a00640 1 -- 172.21.15.175:0/1319039728 shutdown_connections 2024-04-25T09:04:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.459+0000 7f3d55a00640 1 --2- 172.21.15.175:0/1319039728 >> v2:172.21.15.177:3300/0 conn(0x7f3d500b27c0 0x7f3d5015d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.459+0000 7f3d55a00640 1 --2- 172.21.15.175:0/1319039728 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d50099cb0 0x7f3d5006c770 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.459+0000 7f3d55a00640 1 -- 172.21.15.175:0/1319039728 >> 172.21.15.175:0/1319039728 conn(0x7f3d500b3160 msgr2=0x7f3d500b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.459+0000 7f3d55a00640 1 -- 172.21.15.175:0/1319039728 shutdown_connections 2024-04-25T09:04:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.459+0000 7f3d55a00640 1 -- 172.21.15.175:0/1319039728 wait complete. 2024-04-25T09:04:33.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d55a00640 1 Processor -- start 2024-04-25T09:04:33.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d55a00640 1 -- start start 2024-04-25T09:04:33.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d55a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d50099cb0 0x7f3d500c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d55a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d5009a090 0x7f3d501550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d55a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d500b27c0 0x7f3d50157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d55a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d500d0dd0 con 0x7f3d500b27c0 2024-04-25T09:04:33.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d55a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5006d1d0 con 0x7f3d5009a090 2024-04-25T09:04:33.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d55a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d500d0f50 con 0x7f3d50099cb0 2024-04-25T09:04:33.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d55000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d500b27c0 0x7f3d50157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d55000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d500b27c0 0x7f3d50157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35990/0 (socket says 172.21.15.175:35990) 2024-04-25T09:04:33.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d55000640 1 -- 172.21.15.175:0/2854884437 learned_addr learned my addr 172.21.15.175:0/2854884437 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:33.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d4f400640 1 --2- 172.21.15.175:0/2854884437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d5009a090 0x7f3d501550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d4fe00640 1 --2- 172.21.15.175:0/2854884437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d50099cb0 0x7f3d500c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d4fe00640 1 -- 172.21.15.175:0/2854884437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d5009a090 msgr2=0x7f3d501550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d4fe00640 1 --2- 172.21.15.175:0/2854884437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d5009a090 0x7f3d501550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d4fe00640 1 -- 172.21.15.175:0/2854884437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d500b27c0 msgr2=0x7f3d50157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d4fe00640 1 --2- 172.21.15.175:0/2854884437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d500b27c0 0x7f3d50157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d4fe00640 1 -- 172.21.15.175:0/2854884437 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d500c8cb0 con 0x7f3d50099cb0 2024-04-25T09:04:33.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d55000640 1 --2- 172.21.15.175:0/2854884437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d500b27c0 0x7f3d50157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:33.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d4fe00640 1 --2- 172.21.15.175:0/2854884437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d50099cb0 0x7f3d500c9d50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3d400ab000 tx=0x7f3d400191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:33.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d47e00640 1 -- 172.21.15.175:0/2854884437 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d400b0040 con 0x7f3d50099cb0 2024-04-25T09:04:33.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d47e00640 1 -- 172.21.15.175:0/2854884437 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d400ab9b0 con 0x7f3d50099cb0 2024-04-25T09:04:33.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d47e00640 1 -- 172.21.15.175:0/2854884437 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d400abda0 con 0x7f3d50099cb0 2024-04-25T09:04:33.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d55a00640 1 -- 172.21.15.175:0/2854884437 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d500c8f90 con 0x7f3d50099cb0 2024-04-25T09:04:33.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.463+0000 7f3d55a00640 1 -- 172.21.15.175:0/2854884437 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d500c9550 con 0x7f3d50099cb0 2024-04-25T09:04:33.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.467+0000 7f3d55a00640 1 -- 172.21.15.175:0/2854884437 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d50074a60 con 0x7f3d50099cb0 2024-04-25T09:04:33.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.467+0000 7f3d47e00640 1 -- 172.21.15.175:0/2854884437 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3d40003620 con 0x7f3d50099cb0 2024-04-25T09:04:33.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.467+0000 7f3d47e00640 1 --2- 172.21.15.175:0/2854884437 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3d30066f60 0x7f3d30069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.467+0000 7f3d47e00640 1 -- 172.21.15.175:0/2854884437 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d4011ec10 con 0x7f3d50099cb0 2024-04-25T09:04:33.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.467+0000 7f3d4f400640 1 --2- 172.21.15.175:0/2854884437 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3d30066f60 0x7f3d30069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.467+0000 7f3d4f400640 1 --2- 172.21.15.175:0/2854884437 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3d30066f60 0x7f3d30069420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c007fd0 tx=0x7f3d3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:33.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.471+0000 7f3d47e00640 1 -- 172.21.15.175:0/2854884437 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3d40016090 con 0x7f3d50099cb0 2024-04-25T09:04:33.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.623+0000 7f3d55a00640 1 -- 172.21.15.175:0/2854884437 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d500b3f70 con 0x7f3d50099cb0 2024-04-25T09:04:33.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.623+0000 7f3d47e00640 1 -- 172.21.15.175:0/2854884437 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3d400ef760 con 0x7f3d50099cb0 2024-04-25T09:04:33.616 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:04:33.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.627+0000 7f3d55a00640 1 -- 172.21.15.175:0/2854884437 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3d30066f60 msgr2=0x7f3d30069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.627+0000 7f3d55a00640 1 --2- 172.21.15.175:0/2854884437 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3d30066f60 0x7f3d30069420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c007fd0 tx=0x7f3d3c009040 comp rx=0 tx=0).stop 2024-04-25T09:04:33.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.627+0000 7f3d55a00640 1 -- 172.21.15.175:0/2854884437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d50099cb0 msgr2=0x7f3d500c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.627+0000 7f3d55a00640 1 --2- 172.21.15.175:0/2854884437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d50099cb0 0x7f3d500c9d50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3d400ab000 tx=0x7f3d400191b0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.627+0000 7f3d55a00640 1 -- 172.21.15.175:0/2854884437 shutdown_connections 2024-04-25T09:04:33.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.627+0000 7f3d55a00640 1 --2- 172.21.15.175:0/2854884437 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3d30066f60 0x7f3d30069420 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.627+0000 7f3d55a00640 1 --2- 172.21.15.175:0/2854884437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d500b27c0 0x7f3d50157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.627+0000 7f3d55a00640 1 --2- 172.21.15.175:0/2854884437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3d5009a090 0x7f3d501550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.627+0000 7f3d55a00640 1 --2- 172.21.15.175:0/2854884437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3d50099cb0 0x7f3d500c9d50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.627+0000 7f3d55a00640 1 -- 172.21.15.175:0/2854884437 >> 172.21.15.175:0/2854884437 conn(0x7f3d500b3160 msgr2=0x7f3d500cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:33.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.627+0000 7f3d55a00640 1 -- 172.21.15.175:0/2854884437 shutdown_connections 2024-04-25T09:04:33.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.627+0000 7f3d55a00640 1 -- 172.21.15.175:0/2854884437 wait complete. 2024-04-25T09:04:33.637 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:33.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f377b800640 1 Processor -- start 2024-04-25T09:04:33.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f377b800640 1 -- start start 2024-04-25T09:04:33.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f377b800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f37740cbe60 0x7f377415af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f377b800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377406db60 con 0x7f377406d310 2024-04-25T09:04:33.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f377b800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377406de40 con 0x7f37740b4800 2024-04-25T09:04:33.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f377b800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377406e120 con 0x7f37740cbe60 2024-04-25T09:04:33.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f3773e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f377406d310 0x7f37740b40f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39500/0 (socket says 172.21.15.175:39500) 2024-04-25T09:04:33.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f3773e00640 1 -- 172.21.15.175:0/1797119873 learned_addr learned my addr 172.21.15.175:0/1797119873 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:33.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f3778e00640 1 --2- 172.21.15.175:0/1797119873 >> v2:172.21.15.177:3300/0 conn(0x7f37740cbe60 0x7f377415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f3773400640 1 -- 172.21.15.175:0/1797119873 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518192730 0 0) 0x7f377406db60 con 0x7f377406d310 2024-04-25T09:04:33.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f3773400640 1 -- 172.21.15.175:0/1797119873 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f375c003530 con 0x7f377406d310 2024-04-25T09:04:33.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f3773400640 1 -- 172.21.15.175:0/1797119873 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2892231179 0 0) 0x7f375c003530 con 0x7f377406d310 2024-04-25T09:04:33.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f3773400640 1 -- 172.21.15.175:0/1797119873 >> v2:172.21.15.177:3300/0 conn(0x7f37740cbe60 msgr2=0x7f377415af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:33.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f3773400640 1 --2- 172.21.15.175:0/1797119873 >> v2:172.21.15.177:3300/0 conn(0x7f37740cbe60 0x7f377415af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f3773400640 1 -- 172.21.15.175:0/1797119873 >> v1:172.21.15.177:6789/0 conn(0x7f37740b4800 legacy=0x7f377415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f3773400640 1 -- 172.21.15.175:0/1797119873 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377415c2f0 con 0x7f377406d310 2024-04-25T09:04:33.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f3773400640 1 -- 172.21.15.175:0/1797119873 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f3760001680 con 0x7f377406d310 2024-04-25T09:04:33.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f3773400640 1 -- 172.21.15.175:0/1797119873 >> v1:172.21.15.175:6789/0 conn(0x7f377406d310 legacy=0x7f37740b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f3773400640 1 --2- 172.21.15.175:0/1797119873 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f375c0039c0 0x7f375c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f3773400640 1 --2- 172.21.15.175:0/1797119873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375c004810 0x7f375c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f3773400640 1 --2- 172.21.15.175:0/1797119873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f375c0051d0 0x7f375c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f3773400640 1 -- 172.21.15.175:0/1797119873 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377406e120 con 0x7f375c004810 2024-04-25T09:04:33.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f3773400640 1 -- 172.21.15.175:0/1797119873 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c00c070 con 0x7f375c0051d0 2024-04-25T09:04:33.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.787+0000 7f3773400640 1 -- 172.21.15.175:0/1797119873 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c00e480 con 0x7f375c0039c0 2024-04-25T09:04:33.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.791+0000 7f3778e00640 1 --2- 172.21.15.175:0/1797119873 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f375c0039c0 0x7f375c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.791+0000 7f3773e00640 1 --2- 172.21.15.175:0/1797119873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375c004810 0x7f375c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.791+0000 7f3779800640 1 --2- 172.21.15.175:0/1797119873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f375c0051d0 0x7f375c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.791+0000 7f3773e00640 1 -- 172.21.15.175:0/1797119873 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f375c0039c0 msgr2=0x7f375c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:33.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.791+0000 7f3773e00640 1 --2- 172.21.15.175:0/1797119873 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f375c0039c0 0x7f375c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.791+0000 7f3773e00640 1 -- 172.21.15.175:0/1797119873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f375c0051d0 msgr2=0x7f375c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:33.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.791+0000 7f3773e00640 1 --2- 172.21.15.175:0/1797119873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f375c0051d0 0x7f375c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.791+0000 7f3773e00640 1 -- 172.21.15.175:0/1797119873 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c003530 con 0x7f375c004810 2024-04-25T09:04:33.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.791+0000 7f3779800640 1 -- 172.21.15.175:0/1797119873 reap_dead start 2024-04-25T09:04:33.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.791+0000 7f3773e00640 1 --2- 172.21.15.175:0/1797119873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375c004810 0x7f375c004c90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f376000c1c0 tx=0x7f376001f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135316711a80a523 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:33.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.791+0000 7f3773400640 1 -- 172.21.15.175:0/1797119873 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760007d00 con 0x7f375c004810 2024-04-25T09:04:33.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.791+0000 7f3773400640 1 -- 172.21.15.175:0/1797119873 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3760005b00 con 0x7f375c004810 2024-04-25T09:04:33.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.791+0000 7f3773400640 1 -- 172.21.15.175:0/1797119873 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760007070 con 0x7f375c004810 2024-04-25T09:04:33.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f377b800640 1 -- 172.21.15.175:0/1797119873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375c004810 msgr2=0x7f375c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f377b800640 1 --2- 172.21.15.175:0/1797119873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375c004810 0x7f375c004c90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f376000c1c0 tx=0x7f376001f3d0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f377b800640 1 -- 172.21.15.175:0/1797119873 shutdown_connections 2024-04-25T09:04:33.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f377b800640 1 --2- 172.21.15.175:0/1797119873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375c004810 0x7f375c004c90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f377b800640 1 -- 172.21.15.175:0/1797119873 >> 172.21.15.175:0/1797119873 conn(0x7f377406ac50 msgr2=0x7f377406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:33.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f377b800640 1 -- 172.21.15.175:0/1797119873 shutdown_connections 2024-04-25T09:04:33.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f377b800640 1 -- 172.21.15.175:0/1797119873 wait complete. 2024-04-25T09:04:33.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f377b800640 1 Processor -- start 2024-04-25T09:04:33.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f377b800640 1 -- start start 2024-04-25T09:04:33.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f377b800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375c004810 0x7f3774149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f377b800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37740adbe0 0x7f3774155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f377b800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3774155b50 0x7f37741534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f377b800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37740cc3c0 con 0x7f375c004810 2024-04-25T09:04:33.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f377b800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37740cc240 con 0x7f3774155b50 2024-04-25T09:04:33.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f377b800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377415af20 con 0x7f37740adbe0 2024-04-25T09:04:33.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f3778e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375c004810 0x7f3774149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f3778e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375c004810 0x7f3774149190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36010/0 (socket says 172.21.15.175:36010) 2024-04-25T09:04:33.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f3778e00640 1 -- 172.21.15.175:0/2850102421 learned_addr learned my addr 172.21.15.175:0/2850102421 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:33.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f3773e00640 1 --2- 172.21.15.175:0/2850102421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37740adbe0 0x7f3774155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f3779800640 1 --2- 172.21.15.175:0/2850102421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3774155b50 0x7f37741534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f3778e00640 1 -- 172.21.15.175:0/2850102421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37740adbe0 msgr2=0x7f3774155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f3778e00640 1 --2- 172.21.15.175:0/2850102421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37740adbe0 0x7f3774155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f3778e00640 1 -- 172.21.15.175:0/2850102421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3774155b50 msgr2=0x7f37741534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f3778e00640 1 --2- 172.21.15.175:0/2850102421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3774155b50 0x7f37741534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f3778e00640 1 -- 172.21.15.175:0/2850102421 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37741531b0 con 0x7f375c004810 2024-04-25T09:04:33.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f3773e00640 1 --2- 172.21.15.175:0/2850102421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37740adbe0 0x7f3774155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:33.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.795+0000 7f3779800640 1 --2- 172.21.15.175:0/2850102421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3774155b50 0x7f37741534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:33.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.799+0000 7f3778e00640 1 --2- 172.21.15.175:0/2850102421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375c004810 0x7f3774149190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3768011900 tx=0x7f3768011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:33.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.799+0000 7f3770c00640 1 -- 172.21.15.175:0/2850102421 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768019070 con 0x7f375c004810 2024-04-25T09:04:33.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.799+0000 7f3770c00640 1 -- 172.21.15.175:0/2850102421 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3768004240 con 0x7f375c004810 2024-04-25T09:04:33.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.799+0000 7f377b800640 1 -- 172.21.15.175:0/2850102421 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3774152bf0 con 0x7f375c004810 2024-04-25T09:04:33.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.799+0000 7f3770c00640 1 -- 172.21.15.175:0/2850102421 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37680095b0 con 0x7f375c004810 2024-04-25T09:04:33.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.799+0000 7f377b800640 1 -- 172.21.15.175:0/2850102421 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37740ad3e0 con 0x7f375c004810 2024-04-25T09:04:33.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.799+0000 7f377b800640 1 -- 172.21.15.175:0/2850102421 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3774075160 con 0x7f375c004810 2024-04-25T09:04:33.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.799+0000 7f3770c00640 1 -- 172.21.15.175:0/2850102421 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f376801c070 con 0x7f375c004810 2024-04-25T09:04:33.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.799+0000 7f3770c00640 1 --2- 172.21.15.175:0/2850102421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3754066f60 0x7f3754069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.799+0000 7f3770c00640 1 -- 172.21.15.175:0/2850102421 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3768085790 con 0x7f375c004810 2024-04-25T09:04:33.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.799+0000 7f3773e00640 1 --2- 172.21.15.175:0/2850102421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3754066f60 0x7f3754069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.803+0000 7f3773e00640 1 --2- 172.21.15.175:0/2850102421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3754066f60 0x7f3754069420 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f37600ae000 tx=0x7f3760007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:33.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.803+0000 7f3770c00640 1 -- 172.21.15.175:0/2850102421 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3768056790 con 0x7f375c004810 2024-04-25T09:04:33.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.959+0000 7f377b800640 1 -- 172.21.15.175:0/2850102421 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3774072010 con 0x7f375c004810 2024-04-25T09:04:33.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.959+0000 7f3770c00640 1 -- 172.21.15.175:0/2850102421 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3768056090 con 0x7f375c004810 2024-04-25T09:04:33.950 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:04:33.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.959+0000 7f377b800640 1 -- 172.21.15.175:0/2850102421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3754066f60 msgr2=0x7f3754069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.959+0000 7f377b800640 1 --2- 172.21.15.175:0/2850102421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3754066f60 0x7f3754069420 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f37600ae000 tx=0x7f3760007040 comp rx=0 tx=0).stop 2024-04-25T09:04:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.959+0000 7f377b800640 1 -- 172.21.15.175:0/2850102421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375c004810 msgr2=0x7f3774149190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.959+0000 7f377b800640 1 --2- 172.21.15.175:0/2850102421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375c004810 0x7f3774149190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3768011900 tx=0x7f3768011dc0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.959+0000 7f377b800640 1 -- 172.21.15.175:0/2850102421 shutdown_connections 2024-04-25T09:04:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.959+0000 7f377b800640 1 --2- 172.21.15.175:0/2850102421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3754066f60 0x7f3754069420 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.959+0000 7f377b800640 1 --2- 172.21.15.175:0/2850102421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3774155b50 0x7f37741534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.959+0000 7f377b800640 1 --2- 172.21.15.175:0/2850102421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37740adbe0 0x7f3774155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.959+0000 7f377b800640 1 --2- 172.21.15.175:0/2850102421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f375c004810 0x7f3774149190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.959+0000 7f377b800640 1 -- 172.21.15.175:0/2850102421 >> 172.21.15.175:0/2850102421 conn(0x7f377406ac50 msgr2=0x7f377415d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.959+0000 7f377b800640 1 -- 172.21.15.175:0/2850102421 shutdown_connections 2024-04-25T09:04:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:33.959+0000 7f377b800640 1 -- 172.21.15.175:0/2850102421 wait complete. 2024-04-25T09:04:33.972 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:34.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.115+0000 7fc491600640 1 Processor -- start 2024-04-25T09:04:34.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.115+0000 7fc491600640 1 -- start start 2024-04-25T09:04:34.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.115+0000 7fc491600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c0cfe30 0x7fc48c1665e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.115+0000 7fc491600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48c15cd00 con 0x7fc48c144fc0 2024-04-25T09:04:34.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.115+0000 7fc491600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48c0ce660 con 0x7fc48c1453a0 2024-04-25T09:04:34.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.115+0000 7fc491600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0cc930 con 0x7fc48c0cfe30 2024-04-25T09:04:34.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.115+0000 7fc48aa00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc48c144fc0 0x7fc48c0cbe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39510/0 (socket says 172.21.15.175:39510) 2024-04-25T09:04:34.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.115+0000 7fc48aa00640 1 -- 172.21.15.175:0/2577484318 learned_addr learned my addr 172.21.15.175:0/2577484318 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:34.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc48b400640 1 --2- 172.21.15.175:0/2577484318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c0cfe30 0x7fc48c1665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc489600640 1 -- 172.21.15.175:0/2577484318 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3701099349 0 0) 0x7fc48c15cd00 con 0x7fc48c144fc0 2024-04-25T09:04:34.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc489600640 1 -- 172.21.15.175:0/2577484318 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc470003530 con 0x7fc48c144fc0 2024-04-25T09:04:34.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc489600640 1 -- 172.21.15.175:0/2577484318 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091519925 0 0) 0x7fc48c0ce660 con 0x7fc48c1453a0 2024-04-25T09:04:34.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc489600640 1 -- 172.21.15.175:0/2577484318 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc48c15cd00 con 0x7fc48c1453a0 2024-04-25T09:04:34.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc489600640 1 -- 172.21.15.175:0/2577484318 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1312247132 0 0) 0x7fc470003530 con 0x7fc48c144fc0 2024-04-25T09:04:34.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc489600640 1 -- 172.21.15.175:0/2577484318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c0cfe30 msgr2=0x7fc48c1665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:34.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc489600640 1 --2- 172.21.15.175:0/2577484318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c0cfe30 0x7fc48c1665e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc489600640 1 -- 172.21.15.175:0/2577484318 >> v1:172.21.15.177:6789/0 conn(0x7fc48c1453a0 legacy=0x7fc48c15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc489600640 1 -- 172.21.15.175:0/2577484318 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c0ccc10 con 0x7fc48c144fc0 2024-04-25T09:04:34.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc489600640 1 -- 172.21.15.175:0/2577484318 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fc47c0019a0 con 0x7fc48c144fc0 2024-04-25T09:04:34.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc489600640 1 -- 172.21.15.175:0/2577484318 >> v1:172.21.15.175:6789/0 conn(0x7fc48c144fc0 legacy=0x7fc48c0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc489600640 1 --2- 172.21.15.175:0/2577484318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc470003b80 0x7fc470003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc489600640 1 --2- 172.21.15.175:0/2577484318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc470004810 0x7fc470004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc489600640 1 --2- 172.21.15.175:0/2577484318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c0cfe30 0x7fc4700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc489600640 1 -- 172.21.15.175:0/2577484318 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0cc930 con 0x7fc470004810 2024-04-25T09:04:34.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc489600640 1 -- 172.21.15.175:0/2577484318 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47000ba80 con 0x7fc470003b80 2024-04-25T09:04:34.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc489600640 1 -- 172.21.15.175:0/2577484318 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47000bc80 con 0x7fc48c0cfe30 2024-04-25T09:04:34.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc48a000640 1 --2- 172.21.15.175:0/2577484318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc470004810 0x7fc470004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc48aa00640 1 --2- 172.21.15.175:0/2577484318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc470003b80 0x7fc470003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc48b400640 1 --2- 172.21.15.175:0/2577484318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c0cfe30 0x7fc4700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc48a000640 1 -- 172.21.15.175:0/2577484318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c0cfe30 msgr2=0x7fc4700051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:34.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc48a000640 1 --2- 172.21.15.175:0/2577484318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c0cfe30 0x7fc4700051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc48a000640 1 -- 172.21.15.175:0/2577484318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc470003b80 msgr2=0x7fc470003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:34.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc48a000640 1 --2- 172.21.15.175:0/2577484318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc470003b80 0x7fc470003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.119+0000 7fc48a000640 1 -- 172.21.15.175:0/2577484318 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc470003530 con 0x7fc470004810 2024-04-25T09:04:34.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc48a000640 1 --2- 172.21.15.175:0/2577484318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc470004810 0x7fc470004c90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc48c06b850 tx=0x7fc47801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deee4791df83db5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:34.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc489600640 1 -- 172.21.15.175:0/2577484318 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc478001520 con 0x7fc470004810 2024-04-25T09:04:34.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc489600640 1 -- 172.21.15.175:0/2577484318 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4780052f0 con 0x7fc470004810 2024-04-25T09:04:34.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc489600640 1 -- 172.21.15.175:0/2577484318 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4780a88f0 con 0x7fc470004810 2024-04-25T09:04:34.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc491600640 1 -- 172.21.15.175:0/2577484318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc470004810 msgr2=0x7fc470004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc491600640 1 --2- 172.21.15.175:0/2577484318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc470004810 0x7fc470004c90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc48c06b850 tx=0x7fc47801ec90 comp rx=0 tx=0).stop 2024-04-25T09:04:34.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc48b400640 1 -- 172.21.15.175:0/2577484318 reap_dead start 2024-04-25T09:04:34.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc491600640 1 -- 172.21.15.175:0/2577484318 shutdown_connections 2024-04-25T09:04:34.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc491600640 1 -- 172.21.15.175:0/2577484318 >> 172.21.15.175:0/2577484318 conn(0x7fc48c067150 msgr2=0x7fc48c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:34.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc491600640 1 -- 172.21.15.175:0/2577484318 shutdown_connections 2024-04-25T09:04:34.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc491600640 1 -- 172.21.15.175:0/2577484318 wait complete. 2024-04-25T09:04:34.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc491600640 1 Processor -- start 2024-04-25T09:04:34.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc491600640 1 -- start start 2024-04-25T09:04:34.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc491600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc48c15b210 0x7fc48c13ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc491600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c0af1d0 0x7fc48c0b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc491600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c0b1960 0x7fc48c1388c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc491600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0cc580 con 0x7fc48c0b1960 2024-04-25T09:04:34.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc491600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0ce900 con 0x7fc48c15b210 2024-04-25T09:04:34.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.123+0000 7fc491600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0af9b0 con 0x7fc48c0af1d0 2024-04-25T09:04:34.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc48b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c0b1960 0x7fc48c1388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc48b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c0b1960 0x7fc48c1388c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36038/0 (socket says 172.21.15.175:36038) 2024-04-25T09:04:34.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc48b400640 1 -- 172.21.15.175:0/3146815873 learned_addr learned my addr 172.21.15.175:0/3146815873 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:34.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc48aa00640 1 --2- 172.21.15.175:0/3146815873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc48c15b210 0x7fc48c13ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc48a000640 1 --2- 172.21.15.175:0/3146815873 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c0af1d0 0x7fc48c0b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc48b400640 1 -- 172.21.15.175:0/3146815873 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c0af1d0 msgr2=0x7fc48c0b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc48b400640 1 --2- 172.21.15.175:0/3146815873 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c0af1d0 0x7fc48c0b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc48b400640 1 -- 172.21.15.175:0/3146815873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc48c15b210 msgr2=0x7fc48c13ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc48b400640 1 --2- 172.21.15.175:0/3146815873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc48c15b210 0x7fc48c13ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc48b400640 1 -- 172.21.15.175:0/3146815873 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c0afc90 con 0x7fc48c0b1960 2024-04-25T09:04:34.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc48b400640 1 --2- 172.21.15.175:0/3146815873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c0b1960 0x7fc48c1388c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0726e0 tx=0x7fc484011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:34.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc482a00640 1 -- 172.21.15.175:0/3146815873 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc484003620 con 0x7fc48c0b1960 2024-04-25T09:04:34.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc482a00640 1 -- 172.21.15.175:0/3146815873 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48401b070 con 0x7fc48c0b1960 2024-04-25T09:04:34.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc482a00640 1 -- 172.21.15.175:0/3146815873 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc484003a00 con 0x7fc48c0b1960 2024-04-25T09:04:34.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc491600640 1 -- 172.21.15.175:0/3146815873 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48c0aff70 con 0x7fc48c0b1960 2024-04-25T09:04:34.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc491600640 1 -- 172.21.15.175:0/3146815873 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48c0b0530 con 0x7fc48c0b1960 2024-04-25T09:04:34.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc491600640 1 -- 172.21.15.175:0/3146815873 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48c074a60 con 0x7fc48c0b1960 2024-04-25T09:04:34.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc482a00640 1 -- 172.21.15.175:0/3146815873 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc484003ba0 con 0x7fc48c0b1960 2024-04-25T09:04:34.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.127+0000 7fc482a00640 1 --2- 172.21.15.175:0/3146815873 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc46c066f60 0x7fc46c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.131+0000 7fc482a00640 1 -- 172.21.15.175:0/3146815873 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc484084ff0 con 0x7fc48c0b1960 2024-04-25T09:04:34.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.131+0000 7fc48aa00640 1 --2- 172.21.15.175:0/3146815873 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc46c066f60 0x7fc46c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.131+0000 7fc48aa00640 1 --2- 172.21.15.175:0/3146815873 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc46c066f60 0x7fc46c069420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc47c0013e0 tx=0x7fc47c006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:34.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.135+0000 7fc482a00640 1 -- 172.21.15.175:0/3146815873 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc484025020 con 0x7fc48c0b1960 2024-04-25T09:04:34.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.287+0000 7fc491600640 1 -- 172.21.15.175:0/3146815873 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc48c141fc0 con 0x7fc48c0b1960 2024-04-25T09:04:34.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.287+0000 7fc482a00640 1 -- 172.21.15.175:0/3146815873 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7fc4840559b0 con 0x7fc48c0b1960 2024-04-25T09:04:34.281 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:34.281 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":20,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:11.440551+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:34.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.291+0000 7fc491600640 1 -- 172.21.15.175:0/3146815873 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc46c066f60 msgr2=0x7fc46c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.291+0000 7fc491600640 1 --2- 172.21.15.175:0/3146815873 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc46c066f60 0x7fc46c069420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc47c0013e0 tx=0x7fc47c006040 comp rx=0 tx=0).stop 2024-04-25T09:04:34.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.291+0000 7fc491600640 1 -- 172.21.15.175:0/3146815873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c0b1960 msgr2=0x7fc48c1388c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.291+0000 7fc491600640 1 --2- 172.21.15.175:0/3146815873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c0b1960 0x7fc48c1388c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0726e0 tx=0x7fc484011920 comp rx=0 tx=0).stop 2024-04-25T09:04:34.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.291+0000 7fc491600640 1 -- 172.21.15.175:0/3146815873 shutdown_connections 2024-04-25T09:04:34.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.291+0000 7fc491600640 1 --2- 172.21.15.175:0/3146815873 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc46c066f60 0x7fc46c069420 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.291+0000 7fc491600640 1 --2- 172.21.15.175:0/3146815873 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c0b1960 0x7fc48c1388c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.291+0000 7fc491600640 1 --2- 172.21.15.175:0/3146815873 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c0af1d0 0x7fc48c0b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.291+0000 7fc491600640 1 --2- 172.21.15.175:0/3146815873 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc48c15b210 0x7fc48c13ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.291+0000 7fc491600640 1 -- 172.21.15.175:0/3146815873 >> 172.21.15.175:0/3146815873 conn(0x7fc48c0b4310 msgr2=0x7fc48c0cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:34.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.291+0000 7fc491600640 1 -- 172.21.15.175:0/3146815873 shutdown_connections 2024-04-25T09:04:34.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.291+0000 7fc491600640 1 -- 172.21.15.175:0/3146815873 wait complete. 2024-04-25T09:04:34.302 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:08.047706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:04:08.795449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:34.302 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:34.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.451+0000 7f0fcc200640 1 Processor -- start 2024-04-25T09:04:34.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.451+0000 7f0fcc200640 1 -- start start 2024-04-25T09:04:34.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.451+0000 7f0fcc200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc40d0630 0x7f0fc406c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.451+0000 7f0fcc200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc40d0b40 con 0x7f0fc409a160 2024-04-25T09:04:34.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.451+0000 7f0fcc200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc40d0e20 con 0x7f0fc415ddf0 2024-04-25T09:04:34.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.451+0000 7f0fcc200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40cbf60 con 0x7f0fc40d0630 2024-04-25T09:04:34.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.451+0000 7f0fc8e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f0fc409a160 0x7f0fc406bd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39514/0 (socket says 172.21.15.175:39514) 2024-04-25T09:04:34.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.451+0000 7f0fc8e00640 1 -- 172.21.15.175:0/2398686256 learned_addr learned my addr 172.21.15.175:0/2398686256 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:34.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.455+0000 7f0fca200640 1 --2- 172.21.15.175:0/2398686256 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc40d0630 0x7f0fc406c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.455+0000 7f0fc3e00640 1 -- 172.21.15.175:0/2398686256 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649449604 0 0) 0x7f0fc40d0b40 con 0x7f0fc409a160 2024-04-25T09:04:34.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.455+0000 7f0fc3e00640 1 -- 172.21.15.175:0/2398686256 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fac003530 con 0x7f0fc409a160 2024-04-25T09:04:34.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.455+0000 7f0fc3e00640 1 -- 172.21.15.175:0/2398686256 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089115873 0 0) 0x7f0fc40d0e20 con 0x7f0fc415ddf0 2024-04-25T09:04:34.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.455+0000 7f0fc3e00640 1 -- 172.21.15.175:0/2398686256 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fc40d0b40 con 0x7f0fc415ddf0 2024-04-25T09:04:34.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.455+0000 7f0fca200640 1 -- 172.21.15.175:0/2398686256 >> v1:172.21.15.177:6789/0 conn(0x7f0fc415ddf0 legacy=0x7f0fc4099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.455+0000 7f0fca200640 1 -- 172.21.15.175:0/2398686256 >> v1:172.21.15.175:6789/0 conn(0x7f0fc409a160 legacy=0x7f0fc406bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.455+0000 7f0fca200640 1 -- 172.21.15.175:0/2398686256 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc40d1100 con 0x7f0fc40d0630 2024-04-25T09:04:34.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.455+0000 7f0fca200640 1 --2- 172.21.15.175:0/2398686256 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc40d0630 0x7f0fc406c470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc009dc0 tx=0x7f0fbc01c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8594dad5c93bb79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:34.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.459+0000 7f0fc3e00640 1 -- 172.21.15.175:0/2398686256 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc0b2070 con 0x7f0fc40d0630 2024-04-25T09:04:34.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.459+0000 7f0fc3e00640 1 -- 172.21.15.175:0/2398686256 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fbc0a5850 con 0x7f0fc40d0630 2024-04-25T09:04:34.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.459+0000 7f0fc3e00640 1 -- 172.21.15.175:0/2398686256 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc406d1c0 con 0x7f0fc40d0630 2024-04-25T09:04:34.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.459+0000 7f0fcc200640 1 -- 172.21.15.175:0/2398686256 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc40d0630 msgr2=0x7f0fc406c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.459+0000 7f0fcc200640 1 --2- 172.21.15.175:0/2398686256 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc40d0630 0x7f0fc406c470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc009dc0 tx=0x7f0fbc01c990 comp rx=0 tx=0).stop 2024-04-25T09:04:34.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.459+0000 7f0fcc200640 1 -- 172.21.15.175:0/2398686256 shutdown_connections 2024-04-25T09:04:34.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.459+0000 7f0fcc200640 1 --2- 172.21.15.175:0/2398686256 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc40d0630 0x7f0fc406c470 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.459+0000 7f0fcc200640 1 -- 172.21.15.175:0/2398686256 >> 172.21.15.175:0/2398686256 conn(0x7f0fc40b3400 msgr2=0x7f0fc40b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:34.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.459+0000 7f0fcc200640 1 -- 172.21.15.175:0/2398686256 shutdown_connections 2024-04-25T09:04:34.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.459+0000 7f0fcc200640 1 -- 172.21.15.175:0/2398686256 wait complete. 2024-04-25T09:04:34.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.459+0000 7f0fcc200640 1 Processor -- start 2024-04-25T09:04:34.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.459+0000 7f0fcc200640 1 -- start start 2024-04-25T09:04:34.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.459+0000 7f0fcc200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc409a160 0x7f0fc4154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.459+0000 7f0fcc200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc40d0630 0x7f0fc40c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.459+0000 7f0fcc200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fc415ddf0 0x7f0fc40af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.459+0000 7f0fcc200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc416bc00 con 0x7f0fc40d0630 2024-04-25T09:04:34.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.459+0000 7f0fcc200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc416ba80 con 0x7f0fc415ddf0 2024-04-25T09:04:34.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.459+0000 7f0fcc200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc416bd80 con 0x7f0fc409a160 2024-04-25T09:04:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fc8e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc40d0630 0x7f0fc40c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fc8e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc40d0630 0x7f0fc40c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36052/0 (socket says 172.21.15.175:36052) 2024-04-25T09:04:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fc8e00640 1 -- 172.21.15.175:0/2225116810 learned_addr learned my addr 172.21.15.175:0/2225116810 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fc9800640 1 --2- 172.21.15.175:0/2225116810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc409a160 0x7f0fc4154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fca200640 1 --2- 172.21.15.175:0/2225116810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fc415ddf0 0x7f0fc40af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fc8e00640 1 -- 172.21.15.175:0/2225116810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc409a160 msgr2=0x7f0fc4154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fc8e00640 1 --2- 172.21.15.175:0/2225116810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc409a160 0x7f0fc4154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fc8e00640 1 -- 172.21.15.175:0/2225116810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fc415ddf0 msgr2=0x7f0fc40af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fc8e00640 1 --2- 172.21.15.175:0/2225116810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fc415ddf0 0x7f0fc40af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fc8e00640 1 -- 172.21.15.175:0/2225116810 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc40c9760 con 0x7f0fc40d0630 2024-04-25T09:04:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fca200640 1 --2- 172.21.15.175:0/2225116810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fc415ddf0 0x7f0fc40af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fc8e00640 1 --2- 172.21.15.175:0/2225116810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc40d0630 0x7f0fc40c7a90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000c4d0 tx=0x7f0fb000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fc1600640 1 -- 172.21.15.175:0/2225116810 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0017070 con 0x7f0fc40d0630 2024-04-25T09:04:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fc1600640 1 -- 172.21.15.175:0/2225116810 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb0005cf0 con 0x7f0fc40d0630 2024-04-25T09:04:34.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fcc200640 1 -- 172.21.15.175:0/2225116810 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc40c9a40 con 0x7f0fc40d0630 2024-04-25T09:04:34.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fc1600640 1 -- 172.21.15.175:0/2225116810 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0007270 con 0x7f0fc40d0630 2024-04-25T09:04:34.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fcc200640 1 -- 172.21.15.175:0/2225116810 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc40ca000 con 0x7f0fc40d0630 2024-04-25T09:04:34.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fcc200640 1 -- 172.21.15.175:0/2225116810 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc40cf3c0 con 0x7f0fc40d0630 2024-04-25T09:04:34.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.463+0000 7f0fc1600640 1 -- 172.21.15.175:0/2225116810 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0fb001a070 con 0x7f0fc40d0630 2024-04-25T09:04:34.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.467+0000 7f0fc1600640 1 --2- 172.21.15.175:0/2225116810 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0fa4066f60 0x7f0fa4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.467+0000 7f0fc1600640 1 -- 172.21.15.175:0/2225116810 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fb00842c0 con 0x7f0fc40d0630 2024-04-25T09:04:34.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.467+0000 7f0fc9800640 1 --2- 172.21.15.175:0/2225116810 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0fa4066f60 0x7f0fa4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.467+0000 7f0fc9800640 1 --2- 172.21.15.175:0/2225116810 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0fa4066f60 0x7f0fa4069420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0fc41fa920 tx=0x7f0fb8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:34.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.471+0000 7f0fc1600640 1 -- 172.21.15.175:0/2225116810 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0fb0054d10 con 0x7f0fc40d0630 2024-04-25T09:04:34.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.623+0000 7f0fcc200640 1 -- 172.21.15.175:0/2225116810 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0fc4075160 con 0x7f0fc40d0630 2024-04-25T09:04:34.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.623+0000 7f0fc1600640 1 -- 172.21.15.175:0/2225116810 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0fb0058db0 con 0x7f0fc40d0630 2024-04-25T09:04:34.615 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:04:34.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.627+0000 7f0fcc200640 1 -- 172.21.15.175:0/2225116810 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0fa4066f60 msgr2=0x7f0fa4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.627+0000 7f0fcc200640 1 --2- 172.21.15.175:0/2225116810 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0fa4066f60 0x7f0fa4069420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0fc41fa920 tx=0x7f0fb8009040 comp rx=0 tx=0).stop 2024-04-25T09:04:34.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.627+0000 7f0fcc200640 1 -- 172.21.15.175:0/2225116810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc40d0630 msgr2=0x7f0fc40c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.627+0000 7f0fcc200640 1 --2- 172.21.15.175:0/2225116810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc40d0630 0x7f0fc40c7a90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000c4d0 tx=0x7f0fb000c990 comp rx=0 tx=0).stop 2024-04-25T09:04:34.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.627+0000 7f0fcc200640 1 -- 172.21.15.175:0/2225116810 shutdown_connections 2024-04-25T09:04:34.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.627+0000 7f0fcc200640 1 --2- 172.21.15.175:0/2225116810 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0fa4066f60 0x7f0fa4069420 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.627+0000 7f0fcc200640 1 --2- 172.21.15.175:0/2225116810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fc415ddf0 0x7f0fc40af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.627+0000 7f0fcc200640 1 --2- 172.21.15.175:0/2225116810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc40d0630 0x7f0fc40c7a90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.627+0000 7f0fcc200640 1 --2- 172.21.15.175:0/2225116810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc409a160 0x7f0fc4154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.627+0000 7f0fcc200640 1 -- 172.21.15.175:0/2225116810 >> 172.21.15.175:0/2225116810 conn(0x7f0fc40b3400 msgr2=0x7f0fc406bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:34.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.627+0000 7f0fcc200640 1 -- 172.21.15.175:0/2225116810 shutdown_connections 2024-04-25T09:04:34.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.627+0000 7f0fcc200640 1 -- 172.21.15.175:0/2225116810 wait complete. 2024-04-25T09:04:34.636 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:34.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.783+0000 7f4bde200640 1 Processor -- start 2024-04-25T09:04:34.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.783+0000 7f4bde200640 1 -- start start 2024-04-25T09:04:34.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.787+0000 7f4bde200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd80b0c00 0x7f4bd80afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.787+0000 7f4bde200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4bd806b510 0x7f4bd815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.787+0000 7f4bde200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd80ccc80 con 0x7f4bd80af980 2024-04-25T09:04:34.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.787+0000 7f4bde200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd80b2010 con 0x7f4bd806b510 2024-04-25T09:04:34.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.787+0000 7f4bde200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80ce6d0 con 0x7f4bd80b0c00 2024-04-25T09:04:34.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.787+0000 7f4bd7e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4bd806b510 0x7f4bd815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.787+0000 7f4bd6a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4bd80af980 0x7f4bd806ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39524/0 (socket says 172.21.15.175:39524) 2024-04-25T09:04:34.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.787+0000 7f4bd6a00640 1 -- 172.21.15.175:0/2557817010 learned_addr learned my addr 172.21.15.175:0/2557817010 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:34.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.787+0000 7f4bd7400640 1 --2- 172.21.15.175:0/2557817010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd80b0c00 0x7f4bd80afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.787+0000 7f4bd7e00640 1 -- 172.21.15.175:0/2557817010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd80b0c00 msgr2=0x7f4bd80afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:34.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.787+0000 7f4bd7e00640 1 --2- 172.21.15.175:0/2557817010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd80b0c00 0x7f4bd80afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.787+0000 7f4bd7e00640 1 -- 172.21.15.175:0/2557817010 >> v1:172.21.15.175:6789/0 conn(0x7f4bd80af980 legacy=0x7f4bd806ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.787+0000 7f4bd7e00640 1 -- 172.21.15.175:0/2557817010 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd80ccf60 con 0x7f4bd806b510 2024-04-25T09:04:34.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.787+0000 7f4bd6000640 1 -- 172.21.15.175:0/2557817010 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545138372 0 0) 0x7f4bd80ccc80 con 0x7f4bd80af980 2024-04-25T09:04:34.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.787+0000 7f4bd7400640 1 --2- 172.21.15.175:0/2557817010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd80b0c00 0x7f4bd80afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:34.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.787+0000 7f4bd7e00640 1 --2- 172.21.15.175:0/2557817010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bd806b510 0x7f4bd815d460 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00097c0 tx=0x7f4bd001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa069787a59f815 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:34.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bd6000640 1 -- 172.21.15.175:0/2557817010 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00b2070 con 0x7f4bd806b510 2024-04-25T09:04:34.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bd6000640 1 -- 172.21.15.175:0/2557817010 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd00ad680 con 0x7f4bd806b510 2024-04-25T09:04:34.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bd6000640 1 -- 172.21.15.175:0/2557817010 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00ada50 con 0x7f4bd806b510 2024-04-25T09:04:34.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bde200640 1 -- 172.21.15.175:0/2557817010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bd806b510 msgr2=0x7f4bd815d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bde200640 1 --2- 172.21.15.175:0/2557817010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bd806b510 0x7f4bd815d460 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00097c0 tx=0x7f4bd001c470 comp rx=0 tx=0).stop 2024-04-25T09:04:34.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bde200640 1 -- 172.21.15.175:0/2557817010 shutdown_connections 2024-04-25T09:04:34.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bde200640 1 --2- 172.21.15.175:0/2557817010 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bd806b510 0x7f4bd815d460 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bde200640 1 --2- 172.21.15.175:0/2557817010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd80b0c00 0x7f4bd80afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bde200640 1 -- 172.21.15.175:0/2557817010 >> 172.21.15.175:0/2557817010 conn(0x7f4bd80d07e0 msgr2=0x7f4bd80d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:34.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bde200640 1 -- 172.21.15.175:0/2557817010 shutdown_connections 2024-04-25T09:04:34.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bde200640 1 -- 172.21.15.175:0/2557817010 wait complete. 2024-04-25T09:04:34.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bde200640 1 Processor -- start 2024-04-25T09:04:34.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bde200640 1 -- start start 2024-04-25T09:04:34.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bde200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd806b510 0x7f4bd815d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bde200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bd80af980 0x7f4bd814e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bde200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bd80b0c00 0x7f4bd80c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bde200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd806bb20 con 0x7f4bd80b0c00 2024-04-25T09:04:34.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bde200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd806b9a0 con 0x7f4bd80af980 2024-04-25T09:04:34.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bde200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80cd1c0 con 0x7f4bd806b510 2024-04-25T09:04:34.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bd7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bd80b0c00 0x7f4bd80c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bd7400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd806b510 0x7f4bd815d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bd7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bd80b0c00 0x7f4bd80c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36074/0 (socket says 172.21.15.175:36074) 2024-04-25T09:04:34.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bd7e00640 1 -- 172.21.15.175:0/1337681951 learned_addr learned my addr 172.21.15.175:0/1337681951 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:34.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.791+0000 7f4bd6a00640 1 --2- 172.21.15.175:0/1337681951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bd80af980 0x7f4bd814e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.795+0000 7f4bd7e00640 1 -- 172.21.15.175:0/1337681951 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd806b510 msgr2=0x7f4bd815d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.795+0000 7f4bd7e00640 1 --2- 172.21.15.175:0/1337681951 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd806b510 0x7f4bd815d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.795+0000 7f4bd7e00640 1 -- 172.21.15.175:0/1337681951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bd80af980 msgr2=0x7f4bd814e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.795+0000 7f4bd7e00640 1 --2- 172.21.15.175:0/1337681951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bd80af980 0x7f4bd814e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.795+0000 7f4bd7e00640 1 -- 172.21.15.175:0/1337681951 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd814e740 con 0x7f4bd80b0c00 2024-04-25T09:04:34.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.795+0000 7f4bd7e00640 1 --2- 172.21.15.175:0/1337681951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bd80b0c00 0x7f4bd80c5bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00b0040 tx=0x7f4bd0019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:34.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.795+0000 7f4bcf400640 1 -- 172.21.15.175:0/1337681951 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00b2040 con 0x7f4bd80b0c00 2024-04-25T09:04:34.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.795+0000 7f4bcf400640 1 -- 172.21.15.175:0/1337681951 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd00adc70 con 0x7f4bd80b0c00 2024-04-25T09:04:34.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.795+0000 7f4bcf400640 1 -- 172.21.15.175:0/1337681951 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0004250 con 0x7f4bd80b0c00 2024-04-25T09:04:34.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.795+0000 7f4bde200640 1 -- 172.21.15.175:0/1337681951 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd81511d0 con 0x7f4bd80b0c00 2024-04-25T09:04:34.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.795+0000 7f4bde200640 1 -- 172.21.15.175:0/1337681951 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd815c600 con 0x7f4bd80b0c00 2024-04-25T09:04:34.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.795+0000 7f4bde200640 1 -- 172.21.15.175:0/1337681951 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd806ccf0 con 0x7f4bd80b0c00 2024-04-25T09:04:34.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.795+0000 7f4bcf400640 1 -- 172.21.15.175:0/1337681951 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4bd0003620 con 0x7f4bd80b0c00 2024-04-25T09:04:34.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.795+0000 7f4bcf400640 1 --2- 172.21.15.175:0/1337681951 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4bb8066f60 0x7f4bb8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.795+0000 7f4bcf400640 1 -- 172.21.15.175:0/1337681951 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bd011ee60 con 0x7f4bd80b0c00 2024-04-25T09:04:34.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.795+0000 7f4bd7400640 1 --2- 172.21.15.175:0/1337681951 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4bb8066f60 0x7f4bb8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.799+0000 7f4bd7400640 1 --2- 172.21.15.175:0/1337681951 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4bb8066f60 0x7f4bb8069420 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4bd81f9fb0 tx=0x7f4bc8007770 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:34.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.799+0000 7f4bcf400640 1 -- 172.21.15.175:0/1337681951 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4bd00ba020 con 0x7f4bd80b0c00 2024-04-25T09:04:34.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.955+0000 7f4bde200640 1 -- 172.21.15.175:0/1337681951 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4bd80cc6b0 con 0x7f4bd80b0c00 2024-04-25T09:04:34.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.955+0000 7f4bcf400640 1 -- 172.21.15.175:0/1337681951 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4bd0016090 con 0x7f4bd80b0c00 2024-04-25T09:04:34.947 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:04:34.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.959+0000 7f4bde200640 1 -- 172.21.15.175:0/1337681951 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4bb8066f60 msgr2=0x7f4bb8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.959+0000 7f4bde200640 1 --2- 172.21.15.175:0/1337681951 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4bb8066f60 0x7f4bb8069420 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4bd81f9fb0 tx=0x7f4bc8007770 comp rx=0 tx=0).stop 2024-04-25T09:04:34.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.959+0000 7f4bde200640 1 -- 172.21.15.175:0/1337681951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bd80b0c00 msgr2=0x7f4bd80c5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.959+0000 7f4bde200640 1 --2- 172.21.15.175:0/1337681951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bd80b0c00 0x7f4bd80c5bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00b0040 tx=0x7f4bd0019210 comp rx=0 tx=0).stop 2024-04-25T09:04:34.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.959+0000 7f4bde200640 1 -- 172.21.15.175:0/1337681951 shutdown_connections 2024-04-25T09:04:34.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.959+0000 7f4bde200640 1 --2- 172.21.15.175:0/1337681951 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4bb8066f60 0x7f4bb8069420 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.959+0000 7f4bde200640 1 --2- 172.21.15.175:0/1337681951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bd80b0c00 0x7f4bd80c5bf0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.959+0000 7f4bde200640 1 --2- 172.21.15.175:0/1337681951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bd80af980 0x7f4bd814e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.959+0000 7f4bde200640 1 --2- 172.21.15.175:0/1337681951 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bd806b510 0x7f4bd815d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.959+0000 7f4bde200640 1 -- 172.21.15.175:0/1337681951 >> 172.21.15.175:0/1337681951 conn(0x7f4bd80d07e0 msgr2=0x7f4bd806ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:34.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.959+0000 7f4bde200640 1 -- 172.21.15.175:0/1337681951 shutdown_connections 2024-04-25T09:04:34.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:34.959+0000 7f4bde200640 1 -- 172.21.15.175:0/1337681951 wait complete. 2024-04-25T09:04:34.968 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:35.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.115+0000 7f2b20800640 1 Processor -- start 2024-04-25T09:04:35.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.115+0000 7f2b20800640 1 -- start start 2024-04-25T09:04:35.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.115+0000 7f2b20800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2b1815af20 0x7f2b180b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.115+0000 7f2b20800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b180b4630 0x7f2b1815c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.115+0000 7f2b20800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b1806db60 con 0x7f2b180cbe60 2024-04-25T09:04:35.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.115+0000 7f2b20800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b1806de40 con 0x7f2b1815af20 2024-04-25T09:04:35.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.115+0000 7f2b20800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1806e120 con 0x7f2b180b4630 2024-04-25T09:04:35.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.115+0000 7f2b1de00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f2b180cbe60 0x7f2b1806d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39534/0 (socket says 172.21.15.175:39534) 2024-04-25T09:04:35.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.115+0000 7f2b1de00640 1 -- 172.21.15.175:0/2510566465 learned_addr learned my addr 172.21.15.175:0/2510566465 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:35.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.115+0000 7f2b1d400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2b1815af20 0x7f2b180b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.115+0000 7f2b1e800640 1 --2- 172.21.15.175:0/2510566465 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b180b4630 0x7f2b1815c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.115+0000 7f2b1d400640 1 -- 172.21.15.175:0/2510566465 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b180b4630 msgr2=0x7f2b1815c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:35.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.115+0000 7f2b1d400640 1 --2- 172.21.15.175:0/2510566465 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b180b4630 0x7f2b1815c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.115+0000 7f2b1d400640 1 -- 172.21.15.175:0/2510566465 >> v1:172.21.15.175:6789/0 conn(0x7f2b180cbe60 legacy=0x7f2b1806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.115+0000 7f2b1d400640 1 -- 172.21.15.175:0/2510566465 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1815c2f0 con 0x7f2b1815af20 2024-04-25T09:04:35.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.115+0000 7f2b1ca00640 1 -- 172.21.15.175:0/2510566465 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248074666 0 0) 0x7f2b1806db60 con 0x7f2b180cbe60 2024-04-25T09:04:35.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.119+0000 7f2b1d400640 1 --2- 172.21.15.175:0/2510566465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b1815af20 0x7f2b180b40f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2b080097c0 tx=0x7f2b0801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e53a055ef4e776 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:35.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.119+0000 7f2b1ca00640 1 -- 172.21.15.175:0/2510566465 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b080b0070 con 0x7f2b1815af20 2024-04-25T09:04:35.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.119+0000 7f2b1ca00640 1 -- 172.21.15.175:0/2510566465 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b080ab600 con 0x7f2b1815af20 2024-04-25T09:04:35.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.119+0000 7f2b1ca00640 1 -- 172.21.15.175:0/2510566465 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b080ab9d0 con 0x7f2b1815af20 2024-04-25T09:04:35.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.119+0000 7f2b20800640 1 -- 172.21.15.175:0/2510566465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b1815af20 msgr2=0x7f2b180b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.119+0000 7f2b20800640 1 --2- 172.21.15.175:0/2510566465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b1815af20 0x7f2b180b40f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2b080097c0 tx=0x7f2b0801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.119+0000 7f2b20800640 1 -- 172.21.15.175:0/2510566465 shutdown_connections 2024-04-25T09:04:35.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.119+0000 7f2b20800640 1 --2- 172.21.15.175:0/2510566465 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b180b4630 0x7f2b1815c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.119+0000 7f2b20800640 1 --2- 172.21.15.175:0/2510566465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b1815af20 0x7f2b180b40f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.119+0000 7f2b20800640 1 -- 172.21.15.175:0/2510566465 >> 172.21.15.175:0/2510566465 conn(0x7f2b1806ac50 msgr2=0x7f2b1806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:35.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.119+0000 7f2b20800640 1 -- 172.21.15.175:0/2510566465 shutdown_connections 2024-04-25T09:04:35.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.119+0000 7f2b20800640 1 -- 172.21.15.175:0/2510566465 wait complete. 2024-04-25T09:04:35.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b20800640 1 Processor -- start 2024-04-25T09:04:35.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b20800640 1 -- start start 2024-04-25T09:04:35.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b20800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b180b4630 0x7f2b1815eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b20800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b180cbe60 0x7f2b180af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b20800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b1815af20 0x7f2b180afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b20800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1815d970 con 0x7f2b180cbe60 2024-04-25T09:04:35.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b20800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1815d7f0 con 0x7f2b180b4630 2024-04-25T09:04:35.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b20800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1815daf0 con 0x7f2b1815af20 2024-04-25T09:04:35.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b1d400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b180cbe60 0x7f2b180af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b1d400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b180cbe60 0x7f2b180af590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36094/0 (socket says 172.21.15.175:36094) 2024-04-25T09:04:35.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b1d400640 1 -- 172.21.15.175:0/3031290516 learned_addr learned my addr 172.21.15.175:0/3031290516 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:35.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b1de00640 1 --2- 172.21.15.175:0/3031290516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b180b4630 0x7f2b1815eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b1e800640 1 --2- 172.21.15.175:0/3031290516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b1815af20 0x7f2b180afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b1d400640 1 -- 172.21.15.175:0/3031290516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b1815af20 msgr2=0x7f2b180afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b1d400640 1 --2- 172.21.15.175:0/3031290516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b1815af20 0x7f2b180afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b1d400640 1 -- 172.21.15.175:0/3031290516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b180b4630 msgr2=0x7f2b1815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b1d400640 1 --2- 172.21.15.175:0/3031290516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b180b4630 0x7f2b1815eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b1d400640 1 -- 172.21.15.175:0/3031290516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b181554e0 con 0x7f2b180cbe60 2024-04-25T09:04:35.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b1d400640 1 --2- 172.21.15.175:0/3031290516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b180cbe60 0x7f2b180af590 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2b080ae040 tx=0x7f2b0801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:35.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b12000640 1 -- 172.21.15.175:0/3031290516 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b080bc070 con 0x7f2b180cbe60 2024-04-25T09:04:35.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b12000640 1 -- 172.21.15.175:0/3031290516 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b080b1040 con 0x7f2b180cbe60 2024-04-25T09:04:35.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b12000640 1 -- 172.21.15.175:0/3031290516 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b080b0050 con 0x7f2b180cbe60 2024-04-25T09:04:35.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b20800640 1 -- 172.21.15.175:0/3031290516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b181557c0 con 0x7f2b180cbe60 2024-04-25T09:04:35.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b20800640 1 -- 172.21.15.175:0/3031290516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1815f0d0 con 0x7f2b180cbe60 2024-04-25T09:04:35.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.123+0000 7f2b20800640 1 -- 172.21.15.175:0/3031290516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b18075160 con 0x7f2b180cbe60 2024-04-25T09:04:35.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.127+0000 7f2b12000640 1 -- 172.21.15.175:0/3031290516 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2b080ab4c0 con 0x7f2b180cbe60 2024-04-25T09:04:35.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.127+0000 7f2b12000640 1 --2- 172.21.15.175:0/3031290516 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2afc066f60 0x7f2afc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.127+0000 7f2b12000640 1 -- 172.21.15.175:0/3031290516 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b0811ee10 con 0x7f2b180cbe60 2024-04-25T09:04:35.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.127+0000 7f2b1de00640 1 --2- 172.21.15.175:0/3031290516 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2afc066f60 0x7f2afc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.127+0000 7f2b1de00640 1 --2- 172.21.15.175:0/3031290516 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2afc066f60 0x7f2afc069420 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c000f70 tx=0x7f2b0c007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:35.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.131+0000 7f2b12000640 1 -- 172.21.15.175:0/3031290516 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2b08016090 con 0x7f2b180cbe60 2024-04-25T09:04:35.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.283+0000 7f2b20800640 1 -- 172.21.15.175:0/3031290516 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2b180b0ed0 con 0x7f2b180cbe60 2024-04-25T09:04:35.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.283+0000 7f2b12000640 1 -- 172.21.15.175:0/3031290516 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2b080efd80 con 0x7f2b180cbe60 2024-04-25T09:04:35.274 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:04:35.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.283+0000 7f2b20800640 1 -- 172.21.15.175:0/3031290516 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2afc066f60 msgr2=0x7f2afc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.283+0000 7f2b20800640 1 --2- 172.21.15.175:0/3031290516 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2afc066f60 0x7f2afc069420 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c000f70 tx=0x7f2b0c007c10 comp rx=0 tx=0).stop 2024-04-25T09:04:35.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.283+0000 7f2b20800640 1 -- 172.21.15.175:0/3031290516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b180cbe60 msgr2=0x7f2b180af590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.283+0000 7f2b20800640 1 --2- 172.21.15.175:0/3031290516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b180cbe60 0x7f2b180af590 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2b080ae040 tx=0x7f2b0801ace0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.283+0000 7f2b20800640 1 -- 172.21.15.175:0/3031290516 shutdown_connections 2024-04-25T09:04:35.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.283+0000 7f2b20800640 1 --2- 172.21.15.175:0/3031290516 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2afc066f60 0x7f2afc069420 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.283+0000 7f2b20800640 1 --2- 172.21.15.175:0/3031290516 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2b1815af20 0x7f2b180afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.283+0000 7f2b20800640 1 --2- 172.21.15.175:0/3031290516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b180cbe60 0x7f2b180af590 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.283+0000 7f2b20800640 1 --2- 172.21.15.175:0/3031290516 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2b180b4630 0x7f2b1815eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.283+0000 7f2b20800640 1 -- 172.21.15.175:0/3031290516 >> 172.21.15.175:0/3031290516 conn(0x7f2b1806ac50 msgr2=0x7f2b1806d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:35.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.283+0000 7f2b20800640 1 -- 172.21.15.175:0/3031290516 shutdown_connections 2024-04-25T09:04:35.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.283+0000 7f2b20800640 1 -- 172.21.15.175:0/3031290516 wait complete. 2024-04-25T09:04:35.296 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:35.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.439+0000 7f1b42c00640 1 Processor -- start 2024-04-25T09:04:35.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.439+0000 7f1b42c00640 1 -- start start 2024-04-25T09:04:35.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.443+0000 7f1b42c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1b3c0b5b70 0x7f1b3c0d3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.443+0000 7f1b42c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1b3c0b9570 0x7f1b3c0d1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.443+0000 7f1b42c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c0d23f0 con 0x7f1b3c15dac0 2024-04-25T09:04:35.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.443+0000 7f1b42c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3c0b9a00 con 0x7f1b3c0b9570 2024-04-25T09:04:35.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.443+0000 7f1b42c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3c0d3000 con 0x7f1b3c0b5b70 2024-04-25T09:04:35.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.443+0000 7f1b3be00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f1b3c15dac0 0x7f1b3c0b5460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39542/0 (socket says 172.21.15.175:39542) 2024-04-25T09:04:35.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.443+0000 7f1b3be00640 1 -- 172.21.15.175:0/387242961 learned_addr learned my addr 172.21.15.175:0/387242961 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:35.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.443+0000 7f1b40c00640 1 --2- 172.21.15.175:0/387242961 >> v2:172.21.15.175:3300/0 conn(0x7f1b3c0b9570 0x7f1b3c0d1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.443+0000 7f1b33400640 1 --2- 172.21.15.175:0/387242961 >> v2:172.21.15.177:3300/0 conn(0x7f1b3c0b5b70 0x7f1b3c0d3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.443+0000 7f1b3b400640 1 -- 172.21.15.175:0/387242961 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3196970565 0 0) 0x7f1b3c0d23f0 con 0x7f1b3c15dac0 2024-04-25T09:04:35.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.443+0000 7f1b3b400640 1 -- 172.21.15.175:0/387242961 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b20003530 con 0x7f1b3c15dac0 2024-04-25T09:04:35.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.443+0000 7f1b40c00640 1 -- 172.21.15.175:0/387242961 >> v2:172.21.15.177:3300/0 conn(0x7f1b3c0b5b70 msgr2=0x7f1b3c0d3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:35.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.443+0000 7f1b40c00640 1 --2- 172.21.15.175:0/387242961 >> v2:172.21.15.177:3300/0 conn(0x7f1b3c0b5b70 0x7f1b3c0d3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.443+0000 7f1b40c00640 1 -- 172.21.15.175:0/387242961 >> v1:172.21.15.175:6789/0 conn(0x7f1b3c15dac0 legacy=0x7f1b3c0b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.443+0000 7f1b40c00640 1 -- 172.21.15.175:0/387242961 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c0d26d0 con 0x7f1b3c0b9570 2024-04-25T09:04:35.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b40c00640 1 --2- 172.21.15.175:0/387242961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c0b9570 0x7f1b3c0d1ce0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c06d070 tx=0x7f1b3401f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccf9ae19046d7b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:35.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b3b400640 1 -- 172.21.15.175:0/387242961 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b340b4070 con 0x7f1b3c0b9570 2024-04-25T09:04:35.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b3b400640 1 -- 172.21.15.175:0/387242961 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b340af600 con 0x7f1b3c0b9570 2024-04-25T09:04:35.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b3b400640 1 -- 172.21.15.175:0/387242961 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b340af9d0 con 0x7f1b3c0b9570 2024-04-25T09:04:35.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b42c00640 1 -- 172.21.15.175:0/387242961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c0b9570 msgr2=0x7f1b3c0d1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b42c00640 1 --2- 172.21.15.175:0/387242961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c0b9570 0x7f1b3c0d1ce0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c06d070 tx=0x7f1b3401f110 comp rx=0 tx=0).stop 2024-04-25T09:04:35.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b42c00640 1 -- 172.21.15.175:0/387242961 shutdown_connections 2024-04-25T09:04:35.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b42c00640 1 --2- 172.21.15.175:0/387242961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c0b9570 0x7f1b3c0d1ce0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b42c00640 1 --2- 172.21.15.175:0/387242961 >> v2:172.21.15.177:3300/0 conn(0x7f1b3c0b5b70 0x7f1b3c0d3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b42c00640 1 -- 172.21.15.175:0/387242961 >> 172.21.15.175:0/387242961 conn(0x7f1b3c072980 msgr2=0x7f1b3c0d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:35.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b42c00640 1 -- 172.21.15.175:0/387242961 shutdown_connections 2024-04-25T09:04:35.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b42c00640 1 -- 172.21.15.175:0/387242961 wait complete. 2024-04-25T09:04:35.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b42c00640 1 Processor -- start 2024-04-25T09:04:35.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b42c00640 1 -- start start 2024-04-25T09:04:35.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b42c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c0b5b70 0x7f1b3c0c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b42c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b3c0b9570 0x7f1b3c14bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b42c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b3c15dac0 0x7f1b3c15fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b42c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c15dea0 con 0x7f1b3c0b5b70 2024-04-25T09:04:35.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b42c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0d2c90 con 0x7f1b3c15dac0 2024-04-25T09:04:35.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b42c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0b69a0 con 0x7f1b3c0b9570 2024-04-25T09:04:35.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.447+0000 7f1b3be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c0b5b70 0x7f1b3c0c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.451+0000 7f1b3be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c0b5b70 0x7f1b3c0c89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36120/0 (socket says 172.21.15.175:36120) 2024-04-25T09:04:35.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.451+0000 7f1b3be00640 1 -- 172.21.15.175:0/2201012753 learned_addr learned my addr 172.21.15.175:0/2201012753 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:35.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.451+0000 7f1b40c00640 1 --2- 172.21.15.175:0/2201012753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b3c15dac0 0x7f1b3c15fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.451+0000 7f1b33400640 1 --2- 172.21.15.175:0/2201012753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b3c0b9570 0x7f1b3c14bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.451+0000 7f1b3be00640 1 -- 172.21.15.175:0/2201012753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b3c0b9570 msgr2=0x7f1b3c14bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.451+0000 7f1b3be00640 1 --2- 172.21.15.175:0/2201012753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b3c0b9570 0x7f1b3c14bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.451+0000 7f1b3be00640 1 -- 172.21.15.175:0/2201012753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b3c15dac0 msgr2=0x7f1b3c15fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.451+0000 7f1b3be00640 1 --2- 172.21.15.175:0/2201012753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b3c15dac0 0x7f1b3c15fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.451+0000 7f1b3be00640 1 -- 172.21.15.175:0/2201012753 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c0c8f10 con 0x7f1b3c0b5b70 2024-04-25T09:04:35.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.451+0000 7f1b40c00640 1 --2- 172.21.15.175:0/2201012753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b3c15dac0 0x7f1b3c15fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:35.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.451+0000 7f1b3be00640 1 --2- 172.21.15.175:0/2201012753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c0b5b70 0x7f1b3c0c89d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00c3c0 tx=0x7f1b2c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:35.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.451+0000 7f1b38c00640 1 -- 172.21.15.175:0/2201012753 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c017070 con 0x7f1b3c0b5b70 2024-04-25T09:04:35.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.451+0000 7f1b38c00640 1 -- 172.21.15.175:0/2201012753 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c005cf0 con 0x7f1b3c0b5b70 2024-04-25T09:04:35.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.451+0000 7f1b42c00640 1 -- 172.21.15.175:0/2201012753 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3c0c7930 con 0x7f1b3c0b5b70 2024-04-25T09:04:35.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.451+0000 7f1b38c00640 1 -- 172.21.15.175:0/2201012753 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0072f0 con 0x7f1b3c0b5b70 2024-04-25T09:04:35.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.451+0000 7f1b42c00640 1 -- 172.21.15.175:0/2201012753 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3c0c7ef0 con 0x7f1b3c0b5b70 2024-04-25T09:04:35.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.451+0000 7f1b42c00640 1 -- 172.21.15.175:0/2201012753 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3c074a60 con 0x7f1b3c0b5b70 2024-04-25T09:04:35.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.451+0000 7f1b38c00640 1 -- 172.21.15.175:0/2201012753 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1b2c01a070 con 0x7f1b3c0b5b70 2024-04-25T09:04:35.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.455+0000 7f1b38c00640 1 --2- 172.21.15.175:0/2201012753 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1b18066f60 0x7f1b18069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.455+0000 7f1b38c00640 1 -- 172.21.15.175:0/2201012753 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b2c084490 con 0x7f1b3c0b5b70 2024-04-25T09:04:35.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.455+0000 7f1b33400640 1 --2- 172.21.15.175:0/2201012753 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1b18066f60 0x7f1b18069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.455+0000 7f1b33400640 1 --2- 172.21.15.175:0/2201012753 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1b18066f60 0x7f1b18069420 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c14c4f0 tx=0x7f1b24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:35.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.459+0000 7f1b38c00640 1 -- 172.21.15.175:0/2201012753 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1b2c055400 con 0x7f1b3c0b5b70 2024-04-25T09:04:35.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.611+0000 7f1b42c00640 1 -- 172.21.15.175:0/2201012753 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b3c0cdef0 con 0x7f1b3c0b5b70 2024-04-25T09:04:35.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.615+0000 7f1b38c00640 1 -- 172.21.15.175:0/2201012753 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f1b2c054d00 con 0x7f1b3c0b5b70 2024-04-25T09:04:35.605 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:35.606 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":20,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:11.440551+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:35.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.615+0000 7f1b42c00640 1 -- 172.21.15.175:0/2201012753 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1b18066f60 msgr2=0x7f1b18069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.615+0000 7f1b42c00640 1 --2- 172.21.15.175:0/2201012753 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1b18066f60 0x7f1b18069420 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c14c4f0 tx=0x7f1b24008040 comp rx=0 tx=0).stop 2024-04-25T09:04:35.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.615+0000 7f1b42c00640 1 -- 172.21.15.175:0/2201012753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c0b5b70 msgr2=0x7f1b3c0c89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.615+0000 7f1b42c00640 1 --2- 172.21.15.175:0/2201012753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c0b5b70 0x7f1b3c0c89d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00c3c0 tx=0x7f1b2c00c880 comp rx=0 tx=0).stop 2024-04-25T09:04:35.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.615+0000 7f1b42c00640 1 -- 172.21.15.175:0/2201012753 shutdown_connections 2024-04-25T09:04:35.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.615+0000 7f1b42c00640 1 --2- 172.21.15.175:0/2201012753 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1b18066f60 0x7f1b18069420 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.615+0000 7f1b42c00640 1 --2- 172.21.15.175:0/2201012753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b3c15dac0 0x7f1b3c15fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.615+0000 7f1b42c00640 1 --2- 172.21.15.175:0/2201012753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b3c0b9570 0x7f1b3c14bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.615+0000 7f1b42c00640 1 --2- 172.21.15.175:0/2201012753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b3c0b5b70 0x7f1b3c0c89d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.615+0000 7f1b42c00640 1 -- 172.21.15.175:0/2201012753 >> 172.21.15.175:0/2201012753 conn(0x7f1b3c072980 msgr2=0x7f1b3c0b6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:35.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.615+0000 7f1b42c00640 1 -- 172.21.15.175:0/2201012753 shutdown_connections 2024-04-25T09:04:35.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.615+0000 7f1b42c00640 1 -- 172.21.15.175:0/2201012753 wait complete. 2024-04-25T09:04:35.627 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:08.047706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:04:08.795449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:35.627 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:35.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb529a00640 1 Processor -- start 2024-04-25T09:04:35.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb529a00640 1 -- start start 2024-04-25T09:04:35.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb529a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb5240ce9c0 0x7fb524168b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb529a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb52406dd70 con 0x7fb52415dc90 2024-04-25T09:04:35.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb529a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5241619a0 con 0x7fb5240cbf90 2024-04-25T09:04:35.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb529a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb524162570 con 0x7fb5240ce9c0 2024-04-25T09:04:35.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb522a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb52415dc90 0x7fb52406d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39544/0 (socket says 172.21.15.175:39544) 2024-04-25T09:04:35.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb522a00640 1 -- 172.21.15.175:0/3845837818 learned_addr learned my addr 172.21.15.175:0/3845837818 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:35.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb523400640 1 --2- 172.21.15.175:0/3845837818 >> v2:172.21.15.177:3300/0 conn(0x7fb5240ce9c0 0x7fb524168b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb521600640 1 -- 172.21.15.175:0/3845837818 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1151282265 0 0) 0x7fb514001120 con 0x7fb52415dc90 2024-04-25T09:04:35.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb521600640 1 -- 172.21.15.175:0/3845837818 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb508003530 con 0x7fb52415dc90 2024-04-25T09:04:35.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb521600640 1 -- 172.21.15.175:0/3845837818 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 930235467 0 0) 0x7fb508003530 con 0x7fb52415dc90 2024-04-25T09:04:35.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb521600640 1 -- 172.21.15.175:0/3845837818 >> v2:172.21.15.177:3300/0 conn(0x7fb5240ce9c0 msgr2=0x7fb524168b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:35.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb521600640 1 --2- 172.21.15.175:0/3845837818 >> v2:172.21.15.177:3300/0 conn(0x7fb5240ce9c0 0x7fb524168b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb521600640 1 -- 172.21.15.175:0/3845837818 >> v1:172.21.15.177:6789/0 conn(0x7fb5240cbf90 legacy=0x7fb5240ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb521600640 1 -- 172.21.15.175:0/3845837818 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb524161c40 con 0x7fb52415dc90 2024-04-25T09:04:35.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb521600640 1 -- 172.21.15.175:0/3845837818 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fb514001850 con 0x7fb52415dc90 2024-04-25T09:04:35.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb521600640 1 -- 172.21.15.175:0/3845837818 >> v1:172.21.15.175:6789/0 conn(0x7fb52415dc90 legacy=0x7fb52406d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb521600640 1 --2- 172.21.15.175:0/3845837818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5080039c0 0x7fb508003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb521600640 1 --2- 172.21.15.175:0/3845837818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb508004810 0x7fb508004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb521600640 1 --2- 172.21.15.175:0/3845837818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5080051d0 0x7fb50800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb521600640 1 -- 172.21.15.175:0/3845837818 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb524162570 con 0x7fb5080051d0 2024-04-25T09:04:35.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb521600640 1 -- 172.21.15.175:0/3845837818 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50800c170 con 0x7fb5080039c0 2024-04-25T09:04:35.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb521600640 1 -- 172.21.15.175:0/3845837818 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50800c370 con 0x7fb508004810 2024-04-25T09:04:35.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb523400640 1 --2- 172.21.15.175:0/3845837818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5080051d0 0x7fb50800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb522a00640 1 --2- 172.21.15.175:0/3845837818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5080039c0 0x7fb508003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.775+0000 7fb522000640 1 --2- 172.21.15.175:0/3845837818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb508004810 0x7fb508004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.779+0000 7fb523400640 1 -- 172.21.15.175:0/3845837818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb508004810 msgr2=0x7fb508004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:35.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.779+0000 7fb523400640 1 --2- 172.21.15.175:0/3845837818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb508004810 0x7fb508004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.779+0000 7fb523400640 1 -- 172.21.15.175:0/3845837818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5080039c0 msgr2=0x7fb508003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:35.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.779+0000 7fb523400640 1 --2- 172.21.15.175:0/3845837818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5080039c0 0x7fb508003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.779+0000 7fb523400640 1 -- 172.21.15.175:0/3845837818 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb508003530 con 0x7fb5080051d0 2024-04-25T09:04:35.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.779+0000 7fb523400640 1 -- 172.21.15.175:0/3845837818 reap_dead start 2024-04-25T09:04:35.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.779+0000 7fb523400640 1 --2- 172.21.15.175:0/3845837818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5080051d0 0x7fb50800b9d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009fc0 tx=0x7fb51c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e2df0a23b9ee42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:35.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.779+0000 7fb521600640 1 -- 172.21.15.175:0/3845837818 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c009c10 con 0x7fb5080051d0 2024-04-25T09:04:35.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.779+0000 7fb521600640 1 -- 172.21.15.175:0/3845837818 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51c0a5c00 con 0x7fb5080051d0 2024-04-25T09:04:35.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.779+0000 7fb521600640 1 -- 172.21.15.175:0/3845837818 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c0039a0 con 0x7fb5080051d0 2024-04-25T09:04:35.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.779+0000 7fb529a00640 1 -- 172.21.15.175:0/3845837818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5080051d0 msgr2=0x7fb50800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.779+0000 7fb529a00640 1 --2- 172.21.15.175:0/3845837818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5080051d0 0x7fb50800b9d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009fc0 tx=0x7fb51c01ccc0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.779+0000 7fb529a00640 1 -- 172.21.15.175:0/3845837818 shutdown_connections 2024-04-25T09:04:35.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.779+0000 7fb529a00640 1 --2- 172.21.15.175:0/3845837818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5080051d0 0x7fb50800b9d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.779+0000 7fb529a00640 1 -- 172.21.15.175:0/3845837818 >> 172.21.15.175:0/3845837818 conn(0x7fb52406f550 msgr2=0x7fb52406f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:35.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.779+0000 7fb529a00640 1 -- 172.21.15.175:0/3845837818 shutdown_connections 2024-04-25T09:04:35.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.779+0000 7fb529a00640 1 -- 172.21.15.175:0/3845837818 wait complete. 2024-04-25T09:04:35.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb529a00640 1 Processor -- start 2024-04-25T09:04:35.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb529a00640 1 -- start start 2024-04-25T09:04:35.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb529a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5080051d0 0x7fb5241f3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb529a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5240b6e10 0x7fb524158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb529a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5240b7250 0x7fb5241592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb529a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb524162200 con 0x7fb5080051d0 2024-04-25T09:04:35.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb529a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb524161800 con 0x7fb5240b6e10 2024-04-25T09:04:35.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb529a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb52415e070 con 0x7fb5240b7250 2024-04-25T09:04:35.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb522a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5080051d0 0x7fb5241f3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb522a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5080051d0 0x7fb5241f3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36140/0 (socket says 172.21.15.175:36140) 2024-04-25T09:04:35.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb522a00640 1 -- 172.21.15.175:0/623836066 learned_addr learned my addr 172.21.15.175:0/623836066 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:35.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb523400640 1 --2- 172.21.15.175:0/623836066 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5240b7250 0x7fb5241592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb522000640 1 --2- 172.21.15.175:0/623836066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5240b6e10 0x7fb524158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb522a00640 1 -- 172.21.15.175:0/623836066 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5240b7250 msgr2=0x7fb5241592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb522a00640 1 --2- 172.21.15.175:0/623836066 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5240b7250 0x7fb5241592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb522a00640 1 -- 172.21.15.175:0/623836066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5240b6e10 msgr2=0x7fb524158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb522a00640 1 --2- 172.21.15.175:0/623836066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5240b6e10 0x7fb524158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb522a00640 1 -- 172.21.15.175:0/623836066 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5240c99b0 con 0x7fb5080051d0 2024-04-25T09:04:35.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb522a00640 1 --2- 172.21.15.175:0/623836066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5080051d0 0x7fb5241f3970 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb5140019c0 tx=0x7fb5140126f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:35.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb51aa00640 1 -- 172.21.15.175:0/623836066 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51401c070 con 0x7fb5080051d0 2024-04-25T09:04:35.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb51aa00640 1 -- 172.21.15.175:0/623836066 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb514014750 con 0x7fb5080051d0 2024-04-25T09:04:35.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb529a00640 1 -- 172.21.15.175:0/623836066 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5240c9c70 con 0x7fb5080051d0 2024-04-25T09:04:35.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb51aa00640 1 -- 172.21.15.175:0/623836066 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb514014b00 con 0x7fb5080051d0 2024-04-25T09:04:35.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.783+0000 7fb529a00640 1 -- 172.21.15.175:0/623836066 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5240ca230 con 0x7fb5080051d0 2024-04-25T09:04:35.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.787+0000 7fb529a00640 1 -- 172.21.15.175:0/623836066 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb524075160 con 0x7fb5080051d0 2024-04-25T09:04:35.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.787+0000 7fb51aa00640 1 -- 172.21.15.175:0/623836066 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb51401f070 con 0x7fb5080051d0 2024-04-25T09:04:35.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.787+0000 7fb51aa00640 1 --2- 172.21.15.175:0/623836066 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb504066f60 0x7fb504069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.787+0000 7fb51aa00640 1 -- 172.21.15.175:0/623836066 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb514087b00 con 0x7fb5080051d0 2024-04-25T09:04:35.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.787+0000 7fb522000640 1 --2- 172.21.15.175:0/623836066 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb504066f60 0x7fb504069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.787+0000 7fb522000640 1 --2- 172.21.15.175:0/623836066 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb504066f60 0x7fb504069420 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb510000c10 tx=0x7fb510009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:35.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.791+0000 7fb51aa00640 1 -- 172.21.15.175:0/623836066 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb52406dd70 con 0x7fb5080051d0 2024-04-25T09:04:35.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.947+0000 7fb529a00640 1 -- 172.21.15.175:0/623836066 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb5240cd490 con 0x7fb5080051d0 2024-04-25T09:04:35.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.947+0000 7fb51aa00640 1 -- 172.21.15.175:0/623836066 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb514058420 con 0x7fb5080051d0 2024-04-25T09:04:35.940 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:04:35.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.951+0000 7fb529a00640 1 -- 172.21.15.175:0/623836066 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb504066f60 msgr2=0x7fb504069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.951+0000 7fb529a00640 1 --2- 172.21.15.175:0/623836066 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb504066f60 0x7fb504069420 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb510000c10 tx=0x7fb510009040 comp rx=0 tx=0).stop 2024-04-25T09:04:35.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.951+0000 7fb529a00640 1 -- 172.21.15.175:0/623836066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5080051d0 msgr2=0x7fb5241f3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.951+0000 7fb529a00640 1 --2- 172.21.15.175:0/623836066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5080051d0 0x7fb5241f3970 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb5140019c0 tx=0x7fb5140126f0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.951+0000 7fb529a00640 1 -- 172.21.15.175:0/623836066 shutdown_connections 2024-04-25T09:04:35.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.951+0000 7fb529a00640 1 --2- 172.21.15.175:0/623836066 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb504066f60 0x7fb504069420 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.951+0000 7fb529a00640 1 --2- 172.21.15.175:0/623836066 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5240b7250 0x7fb5241592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.951+0000 7fb529a00640 1 --2- 172.21.15.175:0/623836066 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5240b6e10 0x7fb524158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.951+0000 7fb529a00640 1 --2- 172.21.15.175:0/623836066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5080051d0 0x7fb5241f3970 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.951+0000 7fb529a00640 1 -- 172.21.15.175:0/623836066 >> 172.21.15.175:0/623836066 conn(0x7fb52406f550 msgr2=0x7fb5241602f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:35.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.951+0000 7fb529a00640 1 -- 172.21.15.175:0/623836066 shutdown_connections 2024-04-25T09:04:35.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:35.951+0000 7fb529a00640 1 -- 172.21.15.175:0/623836066 wait complete. 2024-04-25T09:04:35.960 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:36.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.107+0000 7f6130800640 1 Processor -- start 2024-04-25T09:04:36.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.107+0000 7f6130800640 1 -- start start 2024-04-25T09:04:36.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.107+0000 7f6130800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61280cbe60 0x7f612815af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.107+0000 7f6130800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f612806d310 0x7f61280b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.107+0000 7f6130800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f61280b4630 0x7f61280b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.107+0000 7f6130800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612806db60 con 0x7f612806d310 2024-04-25T09:04:36.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.107+0000 7f6130800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612806de40 con 0x7f61280b4630 2024-04-25T09:04:36.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.107+0000 7f6130800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612806e120 con 0x7f61280cbe60 2024-04-25T09:04:36.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.107+0000 7f612d400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f612806d310 0x7f61280b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.107+0000 7f612d400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f612806d310 0x7f61280b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36142/0 (socket says 172.21.15.175:36142) 2024-04-25T09:04:36.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.107+0000 7f612d400640 1 -- 172.21.15.175:0/2301083403 learned_addr learned my addr 172.21.15.175:0/2301083403 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:36.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.107+0000 7f612de00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61280cbe60 0x7f612815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.107+0000 7f612e800640 1 --2- 172.21.15.175:0/2301083403 >> v2:172.21.15.177:3300/0 conn(0x7f61280b4630 0x7f61280b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.111+0000 7f612d400640 1 -- 172.21.15.175:0/2301083403 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61280cbe60 msgr2=0x7f612815af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:36.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.111+0000 7f612d400640 1 --2- 172.21.15.175:0/2301083403 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61280cbe60 0x7f612815af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.111+0000 7f612d400640 1 -- 172.21.15.175:0/2301083403 >> v2:172.21.15.177:3300/0 conn(0x7f61280b4630 msgr2=0x7f61280b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:36.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.111+0000 7f612d400640 1 --2- 172.21.15.175:0/2301083403 >> v2:172.21.15.177:3300/0 conn(0x7f61280b4630 0x7f61280b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.111+0000 7f612d400640 1 -- 172.21.15.175:0/2301083403 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612815c2f0 con 0x7f612806d310 2024-04-25T09:04:36.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.111+0000 7f612d400640 1 --2- 172.21.15.175:0/2301083403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f612806d310 0x7f61280b40f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f612806ec50 tx=0x7f611801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a269b42009bd2509 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.111+0000 7f612ca00640 1 -- 172.21.15.175:0/2301083403 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61180b0070 con 0x7f612806d310 2024-04-25T09:04:36.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.111+0000 7f612ca00640 1 -- 172.21.15.175:0/2301083403 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61180ab600 con 0x7f612806d310 2024-04-25T09:04:36.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.111+0000 7f612ca00640 1 -- 172.21.15.175:0/2301083403 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61180ab9d0 con 0x7f612806d310 2024-04-25T09:04:36.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.111+0000 7f6130800640 1 -- 172.21.15.175:0/2301083403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f612806d310 msgr2=0x7f61280b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.111+0000 7f6130800640 1 --2- 172.21.15.175:0/2301083403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f612806d310 0x7f61280b40f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f612806ec50 tx=0x7f611801c260 comp rx=0 tx=0).stop 2024-04-25T09:04:36.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.111+0000 7f6130800640 1 -- 172.21.15.175:0/2301083403 shutdown_connections 2024-04-25T09:04:36.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.111+0000 7f6130800640 1 --2- 172.21.15.175:0/2301083403 >> v2:172.21.15.177:3300/0 conn(0x7f61280b4630 0x7f61280b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.111+0000 7f6130800640 1 --2- 172.21.15.175:0/2301083403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f612806d310 0x7f61280b40f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.111+0000 7f6130800640 1 --2- 172.21.15.175:0/2301083403 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f61280cbe60 0x7f612815af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.111+0000 7f6130800640 1 -- 172.21.15.175:0/2301083403 >> 172.21.15.175:0/2301083403 conn(0x7f612806ac50 msgr2=0x7f612806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:36.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.111+0000 7f6130800640 1 -- 172.21.15.175:0/2301083403 shutdown_connections 2024-04-25T09:04:36.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.111+0000 7f6130800640 1 -- 172.21.15.175:0/2301083403 wait complete. 2024-04-25T09:04:36.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f6130800640 1 Processor -- start 2024-04-25T09:04:36.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f6130800640 1 -- start start 2024-04-25T09:04:36.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f6130800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f612806d310 0x7f612814f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f6130800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61280b4630 0x7f612814b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f6130800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61280cbe60 0x7f6128153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f6130800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61280716a0 con 0x7f61280cbe60 2024-04-25T09:04:36.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f6130800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6128071520 con 0x7f61280b4630 2024-04-25T09:04:36.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f6130800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6128071820 con 0x7f612806d310 2024-04-25T09:04:36.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f612e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61280cbe60 0x7f6128153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f612de00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f612806d310 0x7f612814f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f612d400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61280b4630 0x7f612814b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f612de00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f612806d310 0x7f612814f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:53836/0 (socket says 172.21.15.175:53836) 2024-04-25T09:04:36.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f612de00640 1 -- 172.21.15.175:0/1310497267 learned_addr learned my addr 172.21.15.175:0/1310497267 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:36.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f612e800640 1 -- 172.21.15.175:0/1310497267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f612806d310 msgr2=0x7f612814f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f612e800640 1 --2- 172.21.15.175:0/1310497267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f612806d310 0x7f612814f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f612e800640 1 -- 172.21.15.175:0/1310497267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61280b4630 msgr2=0x7f612814b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f612e800640 1 --2- 172.21.15.175:0/1310497267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61280b4630 0x7f612814b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f612e800640 1 -- 172.21.15.175:0/1310497267 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612814a8a0 con 0x7f61280cbe60 2024-04-25T09:04:36.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f612d400640 1 --2- 172.21.15.175:0/1310497267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61280b4630 0x7f612814b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:36.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f612de00640 1 --2- 172.21.15.175:0/1310497267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f612806d310 0x7f612814f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:36.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f612e800640 1 --2- 172.21.15.175:0/1310497267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61280cbe60 0x7f6128153320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6124009d90 tx=0x7f612400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f6122000640 1 -- 172.21.15.175:0/1310497267 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124018020 con 0x7f61280cbe60 2024-04-25T09:04:36.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f6122000640 1 -- 172.21.15.175:0/1310497267 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6124014480 con 0x7f61280cbe60 2024-04-25T09:04:36.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f6122000640 1 -- 172.21.15.175:0/1310497267 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124014870 con 0x7f61280cbe60 2024-04-25T09:04:36.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f6130800640 1 -- 172.21.15.175:0/1310497267 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612814ab80 con 0x7f61280cbe60 2024-04-25T09:04:36.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.115+0000 7f6130800640 1 -- 172.21.15.175:0/1310497267 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6128153a70 con 0x7f61280cbe60 2024-04-25T09:04:36.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.119+0000 7f6130800640 1 -- 172.21.15.175:0/1310497267 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6128075160 con 0x7f61280cbe60 2024-04-25T09:04:36.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.119+0000 7f6122000640 1 -- 172.21.15.175:0/1310497267 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f612401b020 con 0x7f61280cbe60 2024-04-25T09:04:36.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.119+0000 7f6122000640 1 --2- 172.21.15.175:0/1310497267 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f610c066f60 0x7f610c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.119+0000 7f6122000640 1 -- 172.21.15.175:0/1310497267 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6124085d90 con 0x7f61280cbe60 2024-04-25T09:04:36.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.119+0000 7f612de00640 1 --2- 172.21.15.175:0/1310497267 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f610c066f60 0x7f610c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.119+0000 7f612de00640 1 --2- 172.21.15.175:0/1310497267 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f610c066f60 0x7f610c069420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f612814fee0 tx=0x7f611c00b3a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.123+0000 7f6122000640 1 -- 172.21.15.175:0/1310497267 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6124022030 con 0x7f61280cbe60 2024-04-25T09:04:36.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.275+0000 7f6130800640 1 -- 172.21.15.175:0/1310497267 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61280cf860 con 0x7f61280cbe60 2024-04-25T09:04:36.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.275+0000 7f6122000640 1 -- 172.21.15.175:0/1310497267 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6124010040 con 0x7f61280cbe60 2024-04-25T09:04:36.268 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:04:36.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.279+0000 7f6130800640 1 -- 172.21.15.175:0/1310497267 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f610c066f60 msgr2=0x7f610c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.279+0000 7f6130800640 1 --2- 172.21.15.175:0/1310497267 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f610c066f60 0x7f610c069420 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f612814fee0 tx=0x7f611c00b3a0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.279+0000 7f6130800640 1 -- 172.21.15.175:0/1310497267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61280cbe60 msgr2=0x7f6128153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.279+0000 7f6130800640 1 --2- 172.21.15.175:0/1310497267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61280cbe60 0x7f6128153320 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6124009d90 tx=0x7f612400c490 comp rx=0 tx=0).stop 2024-04-25T09:04:36.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.279+0000 7f6130800640 1 -- 172.21.15.175:0/1310497267 shutdown_connections 2024-04-25T09:04:36.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.279+0000 7f6130800640 1 --2- 172.21.15.175:0/1310497267 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f610c066f60 0x7f610c069420 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.279+0000 7f6130800640 1 --2- 172.21.15.175:0/1310497267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f61280cbe60 0x7f6128153320 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.279+0000 7f6130800640 1 --2- 172.21.15.175:0/1310497267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61280b4630 0x7f612814b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.279+0000 7f6130800640 1 --2- 172.21.15.175:0/1310497267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f612806d310 0x7f612814f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.279+0000 7f6130800640 1 -- 172.21.15.175:0/1310497267 >> 172.21.15.175:0/1310497267 conn(0x7f612806ac50 msgr2=0x7f6128071de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:36.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.279+0000 7f6130800640 1 -- 172.21.15.175:0/1310497267 shutdown_connections 2024-04-25T09:04:36.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.279+0000 7f6130800640 1 -- 172.21.15.175:0/1310497267 wait complete. 2024-04-25T09:04:36.288 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:36.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.435+0000 7f673a000640 1 Processor -- start 2024-04-25T09:04:36.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.435+0000 7f673a000640 1 -- start start 2024-04-25T09:04:36.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.439+0000 7f673a000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f673409aaf0 0x7f67340c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.439+0000 7f673a000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6734099a50 con 0x7f673415b970 2024-04-25T09:04:36.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.439+0000 7f673a000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6734099d30 con 0x7f673415f4e0 2024-04-25T09:04:36.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.439+0000 7f673a000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673409a010 con 0x7f673409aaf0 2024-04-25T09:04:36.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.439+0000 7f6738c00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f673415b970 0x7f67340c7440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39556/0 (socket says 172.21.15.175:39556) 2024-04-25T09:04:36.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.439+0000 7f6738c00640 1 -- 172.21.15.175:0/2850190641 learned_addr learned my addr 172.21.15.175:0/2850190641 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:36.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.439+0000 7f672be00640 1 --2- 172.21.15.175:0/2850190641 >> v2:172.21.15.177:3300/0 conn(0x7f673409aaf0 0x7f67340c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.439+0000 7f6733e00640 1 -- 172.21.15.175:0/2850190641 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955474003 0 0) 0x7f6734099a50 con 0x7f673415b970 2024-04-25T09:04:36.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.439+0000 7f6733e00640 1 -- 172.21.15.175:0/2850190641 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6718003530 con 0x7f673415b970 2024-04-25T09:04:36.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.439+0000 7f672be00640 1 -- 172.21.15.175:0/2850190641 >> v1:172.21.15.177:6789/0 conn(0x7f673415f4e0 legacy=0x7f673415f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.439+0000 7f672be00640 1 -- 172.21.15.175:0/2850190641 >> v1:172.21.15.175:6789/0 conn(0x7f673415b970 legacy=0x7f67340c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.439+0000 7f6733e00640 1 -- 172.21.15.175:0/2850190641 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3224420256 0 0) 0x7f6718003530 con 0x7f673415b970 2024-04-25T09:04:36.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.439+0000 7f672be00640 1 -- 172.21.15.175:0/2850190641 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673409a2f0 con 0x7f673409aaf0 2024-04-25T09:04:36.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f672be00640 1 --2- 172.21.15.175:0/2850190641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673409aaf0 0x7f67340c7b50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f671c0097c0 tx=0x7f671c01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=575fad6bb767c571 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f6733e00640 1 -- 172.21.15.175:0/2850190641 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c0b0070 con 0x7f673409aaf0 2024-04-25T09:04:36.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f6733e00640 1 -- 172.21.15.175:0/2850190641 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c0ab400 con 0x7f673409aaf0 2024-04-25T09:04:36.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f6733e00640 1 -- 172.21.15.175:0/2850190641 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6724001680 con 0x7f673409aaf0 2024-04-25T09:04:36.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f673a000640 1 -- 172.21.15.175:0/2850190641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673409aaf0 msgr2=0x7f67340c7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f673a000640 1 --2- 172.21.15.175:0/2850190641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673409aaf0 0x7f67340c7b50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f671c0097c0 tx=0x7f671c01c330 comp rx=0 tx=0).stop 2024-04-25T09:04:36.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f673a000640 1 -- 172.21.15.175:0/2850190641 shutdown_connections 2024-04-25T09:04:36.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f673a000640 1 --2- 172.21.15.175:0/2850190641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673409aaf0 0x7f67340c7b50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f673a000640 1 -- 172.21.15.175:0/2850190641 >> 172.21.15.175:0/2850190641 conn(0x7f67340b3160 msgr2=0x7f67340b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:36.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f673a000640 1 -- 172.21.15.175:0/2850190641 shutdown_connections 2024-04-25T09:04:36.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f673a000640 1 -- 172.21.15.175:0/2850190641 wait complete. 2024-04-25T09:04:36.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f673a000640 1 Processor -- start 2024-04-25T09:04:36.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f673a000640 1 -- start start 2024-04-25T09:04:36.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f673a000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f673409aaf0 0x7f67340b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f673a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f673415b970 0x7f6734152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f673a000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673415f4e0 0x7f67340b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f673a000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673416a040 con 0x7f673415b970 2024-04-25T09:04:36.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f673a000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67340cd530 con 0x7f673415f4e0 2024-04-25T09:04:36.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.443+0000 7f673a000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673416a1c0 con 0x7f673409aaf0 2024-04-25T09:04:36.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f672be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f673415b970 0x7f6734152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f672be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f673415b970 0x7f6734152aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36166/0 (socket says 172.21.15.175:36166) 2024-04-25T09:04:36.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f672be00640 1 -- 172.21.15.175:0/2521616352 learned_addr learned my addr 172.21.15.175:0/2521616352 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:36.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f6738c00640 1 --2- 172.21.15.175:0/2521616352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f673409aaf0 0x7f67340b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f6739600640 1 --2- 172.21.15.175:0/2521616352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673415f4e0 0x7f67340b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f672be00640 1 -- 172.21.15.175:0/2521616352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f673409aaf0 msgr2=0x7f67340b69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f672be00640 1 --2- 172.21.15.175:0/2521616352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f673409aaf0 0x7f67340b69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f672be00640 1 -- 172.21.15.175:0/2521616352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673415f4e0 msgr2=0x7f67340b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f672be00640 1 --2- 172.21.15.175:0/2521616352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673415f4e0 0x7f67340b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f672be00640 1 -- 172.21.15.175:0/2521616352 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6734156920 con 0x7f673415b970 2024-04-25T09:04:36.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f6739600640 1 --2- 172.21.15.175:0/2521616352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673415f4e0 0x7f67340b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:36.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f672be00640 1 --2- 172.21.15.175:0/2521616352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f673415b970 0x7f6734152aa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f671c0097c0 tx=0x7f671c0190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f6731600640 1 -- 172.21.15.175:0/2521616352 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c0b0040 con 0x7f673415b970 2024-04-25T09:04:36.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f6731600640 1 -- 172.21.15.175:0/2521616352 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c004020 con 0x7f673415b970 2024-04-25T09:04:36.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f6731600640 1 -- 172.21.15.175:0/2521616352 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c0043f0 con 0x7f673415b970 2024-04-25T09:04:36.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f673a000640 1 -- 172.21.15.175:0/2521616352 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67340b4380 con 0x7f673415b970 2024-04-25T09:04:36.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f673a000640 1 -- 172.21.15.175:0/2521616352 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67340b4940 con 0x7f673415b970 2024-04-25T09:04:36.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f673a000640 1 -- 172.21.15.175:0/2521616352 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6734074a60 con 0x7f673415b970 2024-04-25T09:04:36.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.447+0000 7f6731600640 1 -- 172.21.15.175:0/2521616352 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f671c003620 con 0x7f673415b970 2024-04-25T09:04:36.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.451+0000 7f6731600640 1 --2- 172.21.15.175:0/2521616352 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6710066f60 0x7f6710069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.451+0000 7f6731600640 1 -- 172.21.15.175:0/2521616352 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f671c11ee90 con 0x7f673415b970 2024-04-25T09:04:36.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.451+0000 7f6738c00640 1 --2- 172.21.15.175:0/2521616352 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6710066f60 0x7f6710069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.451+0000 7f6738c00640 1 --2- 172.21.15.175:0/2521616352 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6710066f60 0x7f6710069420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f67240011f0 tx=0x7f6724009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.455+0000 7f6731600640 1 -- 172.21.15.175:0/2521616352 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f671c0c1030 con 0x7f673415b970 2024-04-25T09:04:36.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.607+0000 7f673a000640 1 -- 172.21.15.175:0/2521616352 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67340b7280 con 0x7f673415b970 2024-04-25T09:04:36.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.607+0000 7f6731600640 1 -- 172.21.15.175:0/2521616352 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f671c1200a0 con 0x7f673415b970 2024-04-25T09:04:36.598 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:04:36.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.607+0000 7f673a000640 1 -- 172.21.15.175:0/2521616352 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6710066f60 msgr2=0x7f6710069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.607+0000 7f673a000640 1 --2- 172.21.15.175:0/2521616352 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6710066f60 0x7f6710069420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f67240011f0 tx=0x7f6724009040 comp rx=0 tx=0).stop 2024-04-25T09:04:36.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.607+0000 7f673a000640 1 -- 172.21.15.175:0/2521616352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f673415b970 msgr2=0x7f6734152aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.607+0000 7f673a000640 1 --2- 172.21.15.175:0/2521616352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f673415b970 0x7f6734152aa0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f671c0097c0 tx=0x7f671c0190d0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.607+0000 7f673a000640 1 -- 172.21.15.175:0/2521616352 shutdown_connections 2024-04-25T09:04:36.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.607+0000 7f673a000640 1 --2- 172.21.15.175:0/2521616352 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6710066f60 0x7f6710069420 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.607+0000 7f673a000640 1 --2- 172.21.15.175:0/2521616352 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f673415f4e0 0x7f67340b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.607+0000 7f673a000640 1 --2- 172.21.15.175:0/2521616352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f673415b970 0x7f6734152aa0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.607+0000 7f673a000640 1 --2- 172.21.15.175:0/2521616352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f673409aaf0 0x7f67340b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.607+0000 7f673a000640 1 -- 172.21.15.175:0/2521616352 >> 172.21.15.175:0/2521616352 conn(0x7f67340b3160 msgr2=0x7f67340c51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:36.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.607+0000 7f673a000640 1 -- 172.21.15.175:0/2521616352 shutdown_connections 2024-04-25T09:04:36.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.607+0000 7f673a000640 1 -- 172.21.15.175:0/2521616352 wait complete. 2024-04-25T09:04:36.619 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:36.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.763+0000 7fb7e1400640 1 Processor -- start 2024-04-25T09:04:36.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.763+0000 7fb7e1400640 1 -- start start 2024-04-25T09:04:36.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.763+0000 7fb7e1400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb7dc15db00 0x7fb7dc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.763+0000 7fb7e1400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb7dc0acd90 0x7fb7dc161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.763+0000 7fb7e1400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc06f280 con 0x7fb7dc161c60 2024-04-25T09:04:36.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.763+0000 7fb7e1400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7dc06acf0 con 0x7fb7dc0acd90 2024-04-25T09:04:36.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.763+0000 7fb7e1400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7dc06afd0 con 0x7fb7dc15db00 2024-04-25T09:04:36.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.763+0000 7fb7d9e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb7dc0acd90 0x7fb7dc161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.763+0000 7fb7d9e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb7dc0acd90 0x7fb7dc161720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36176/0 (socket says 172.21.15.175:36176) 2024-04-25T09:04:36.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.763+0000 7fb7d9e00640 1 -- 172.21.15.175:0/2817768158 learned_addr learned my addr 172.21.15.175:0/2817768158 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:36.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.767+0000 7fb7da800640 1 --2- 172.21.15.175:0/2817768158 >> v2:172.21.15.177:3300/0 conn(0x7fb7dc15db00 0x7fb7dc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.767+0000 7fb7d9e00640 1 -- 172.21.15.175:0/2817768158 >> v2:172.21.15.177:3300/0 conn(0x7fb7dc15db00 msgr2=0x7fb7dc06e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:36.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.767+0000 7fb7d9e00640 1 --2- 172.21.15.175:0/2817768158 >> v2:172.21.15.177:3300/0 conn(0x7fb7dc15db00 0x7fb7dc06e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.767+0000 7fb7d9e00640 1 -- 172.21.15.175:0/2817768158 >> v1:172.21.15.177:6789/0 conn(0x7fb7dc161c60 legacy=0x7fb7dc0b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:36.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.767+0000 7fb7d9e00640 1 -- 172.21.15.175:0/2817768158 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc06b2b0 con 0x7fb7dc0acd90 2024-04-25T09:04:36.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.767+0000 7fb7d9e00640 1 --2- 172.21.15.175:0/2817768158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7dc0acd90 0x7fb7dc161720 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8009870 tx=0x7fb7c801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8f52616e997872 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.767+0000 7fb7d9400640 1 -- 172.21.15.175:0/2817768158 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c80ab640 con 0x7fb7dc0acd90 2024-04-25T09:04:36.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.767+0000 7fb7d9400640 1 -- 172.21.15.175:0/2817768158 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c80b0070 con 0x7fb7dc0acd90 2024-04-25T09:04:36.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.767+0000 7fb7d9400640 1 -- 172.21.15.175:0/2817768158 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c80aba00 con 0x7fb7dc0acd90 2024-04-25T09:04:36.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.767+0000 7fb7e1400640 1 -- 172.21.15.175:0/2817768158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7dc0acd90 msgr2=0x7fb7dc161720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.767+0000 7fb7e1400640 1 --2- 172.21.15.175:0/2817768158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7dc0acd90 0x7fb7dc161720 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb7c8009870 tx=0x7fb7c801c480 comp rx=0 tx=0).stop 2024-04-25T09:04:36.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7e1400640 1 -- 172.21.15.175:0/2817768158 shutdown_connections 2024-04-25T09:04:36.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7e1400640 1 --2- 172.21.15.175:0/2817768158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7dc0acd90 0x7fb7dc161720 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7e1400640 1 --2- 172.21.15.175:0/2817768158 >> v2:172.21.15.177:3300/0 conn(0x7fb7dc15db00 0x7fb7dc06e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7e1400640 1 -- 172.21.15.175:0/2817768158 >> 172.21.15.175:0/2817768158 conn(0x7fb7dc0b2200 msgr2=0x7fb7dc0cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:36.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7e1400640 1 -- 172.21.15.175:0/2817768158 shutdown_connections 2024-04-25T09:04:36.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7e1400640 1 -- 172.21.15.175:0/2817768158 wait complete. 2024-04-25T09:04:36.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7e1400640 1 Processor -- start 2024-04-25T09:04:36.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7e1400640 1 -- start start 2024-04-25T09:04:36.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7e1400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7dc0acd90 0x7fb7dc1467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7e1400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7dc15db00 0x7fb7dc158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7e1400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7dc161c60 0x7fb7dc15fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7e1400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc06f060 con 0x7fb7dc0acd90 2024-04-25T09:04:36.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7e1400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc06eee0 con 0x7fb7dc15db00 2024-04-25T09:04:36.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7e1400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc16aac0 con 0x7fb7dc161c60 2024-04-25T09:04:36.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7da800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7dc0acd90 0x7fb7dc1467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7da800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7dc0acd90 0x7fb7dc1467a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36190/0 (socket says 172.21.15.175:36190) 2024-04-25T09:04:36.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7da800640 1 -- 172.21.15.175:0/3403411009 learned_addr learned my addr 172.21.15.175:0/3403411009 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:36.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7d9e00640 1 --2- 172.21.15.175:0/3403411009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7dc15db00 0x7fb7dc158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7db200640 1 --2- 172.21.15.175:0/3403411009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7dc161c60 0x7fb7dc15fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7da800640 1 -- 172.21.15.175:0/3403411009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7dc161c60 msgr2=0x7fb7dc15fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7da800640 1 --2- 172.21.15.175:0/3403411009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7dc161c60 0x7fb7dc15fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7da800640 1 -- 172.21.15.175:0/3403411009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7dc15db00 msgr2=0x7fb7dc158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7da800640 1 --2- 172.21.15.175:0/3403411009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7dc15db00 0x7fb7dc158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7da800640 1 -- 172.21.15.175:0/3403411009 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc0b41b0 con 0x7fb7dc0acd90 2024-04-25T09:04:36.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.771+0000 7fb7da800640 1 --2- 172.21.15.175:0/3403411009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7dc0acd90 0x7fb7dc1467a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc007f20 tx=0x7fb7cc00e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.775+0000 7fb7d2a00640 1 -- 172.21.15.175:0/3403411009 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc014620 con 0x7fb7dc0acd90 2024-04-25T09:04:36.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.775+0000 7fb7d2a00640 1 -- 172.21.15.175:0/3403411009 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc019070 con 0x7fb7dc0acd90 2024-04-25T09:04:36.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.775+0000 7fb7d2a00640 1 -- 172.21.15.175:0/3403411009 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc014a00 con 0x7fb7dc0acd90 2024-04-25T09:04:36.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.775+0000 7fb7e1400640 1 -- 172.21.15.175:0/3403411009 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7dc160510 con 0x7fb7dc0acd90 2024-04-25T09:04:36.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.775+0000 7fb7e1400640 1 -- 172.21.15.175:0/3403411009 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7dc14bbb0 con 0x7fb7dc0acd90 2024-04-25T09:04:36.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.775+0000 7fb7c7e00640 1 -- 172.21.15.175:0/3403411009 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7dc074a60 con 0x7fb7dc0acd90 2024-04-25T09:04:36.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.775+0000 7fb7d2a00640 1 -- 172.21.15.175:0/3403411009 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb7cc014ba0 con 0x7fb7dc0acd90 2024-04-25T09:04:36.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.775+0000 7fb7d2a00640 1 --2- 172.21.15.175:0/3403411009 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb7bc066f60 0x7fb7bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.775+0000 7fb7d2a00640 1 -- 172.21.15.175:0/3403411009 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7cc085820 con 0x7fb7dc0acd90 2024-04-25T09:04:36.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.775+0000 7fb7d9e00640 1 --2- 172.21.15.175:0/3403411009 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb7bc066f60 0x7fb7bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.779+0000 7fb7d9e00640 1 --2- 172.21.15.175:0/3403411009 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb7bc066f60 0x7fb7bc069420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80af000 tx=0x7fb7c80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.779+0000 7fb7d2a00640 1 -- 172.21.15.175:0/3403411009 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb7cc0561d0 con 0x7fb7dc0acd90 2024-04-25T09:04:36.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.935+0000 7fb7c7e00640 1 -- 172.21.15.175:0/3403411009 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7dc0d0ae0 con 0x7fb7dc0acd90 2024-04-25T09:04:36.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.935+0000 7fb7d2a00640 1 -- 172.21.15.175:0/3403411009 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7fb7cc05a270 con 0x7fb7dc0acd90 2024-04-25T09:04:36.928 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:36.928 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":20,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:11.440551+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:36.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.939+0000 7fb7c7e00640 1 -- 172.21.15.175:0/3403411009 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb7bc066f60 msgr2=0x7fb7bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.939+0000 7fb7c7e00640 1 --2- 172.21.15.175:0/3403411009 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb7bc066f60 0x7fb7bc069420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80af000 tx=0x7fb7c80a7000 comp rx=0 tx=0).stop 2024-04-25T09:04:36.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.939+0000 7fb7c7e00640 1 -- 172.21.15.175:0/3403411009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7dc0acd90 msgr2=0x7fb7dc1467a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.939+0000 7fb7c7e00640 1 --2- 172.21.15.175:0/3403411009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7dc0acd90 0x7fb7dc1467a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc007f20 tx=0x7fb7cc00e570 comp rx=0 tx=0).stop 2024-04-25T09:04:36.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.939+0000 7fb7c7e00640 1 -- 172.21.15.175:0/3403411009 shutdown_connections 2024-04-25T09:04:36.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.939+0000 7fb7c7e00640 1 --2- 172.21.15.175:0/3403411009 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb7bc066f60 0x7fb7bc069420 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.939+0000 7fb7c7e00640 1 --2- 172.21.15.175:0/3403411009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7dc161c60 0x7fb7dc15fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.939+0000 7fb7c7e00640 1 --2- 172.21.15.175:0/3403411009 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7dc15db00 0x7fb7dc158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.939+0000 7fb7c7e00640 1 --2- 172.21.15.175:0/3403411009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7dc0acd90 0x7fb7dc1467a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.939+0000 7fb7c7e00640 1 -- 172.21.15.175:0/3403411009 >> 172.21.15.175:0/3403411009 conn(0x7fb7dc0b2200 msgr2=0x7fb7dc15cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:36.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.939+0000 7fb7c7e00640 1 -- 172.21.15.175:0/3403411009 shutdown_connections 2024-04-25T09:04:36.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:36.939+0000 7fb7c7e00640 1 -- 172.21.15.175:0/3403411009 wait complete. 2024-04-25T09:04:36.949 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:08.047706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:04:08.795449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:36.950 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:37.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.095+0000 7fd2af800640 1 Processor -- start 2024-04-25T09:04:37.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.095+0000 7fd2af800640 1 -- start start 2024-04-25T09:04:37.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.099+0000 7fd2af800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2a815ddf0 0x7fd2a8099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.099+0000 7fd2af800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a80d0b40 con 0x7fd2a80d0630 2024-04-25T09:04:37.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.099+0000 7fd2af800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a80d0e20 con 0x7fd2a806cd70 2024-04-25T09:04:37.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.099+0000 7fd2af800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a80cbf60 con 0x7fd2a815ddf0 2024-04-25T09:04:37.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.099+0000 7fd2a7e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd2a80d0630 0x7fd2a80cc3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39562/0 (socket says 172.21.15.175:39562) 2024-04-25T09:04:37.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.099+0000 7fd2a7e00640 1 -- 172.21.15.175:0/1291189926 learned_addr learned my addr 172.21.15.175:0/1291189926 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:37.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.099+0000 7fd2ace00640 1 --2- 172.21.15.175:0/1291189926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2a815ddf0 0x7fd2a8099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.099+0000 7fd2a7400640 1 -- 172.21.15.175:0/1291189926 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235891513 0 0) 0x7fd2a80d0b40 con 0x7fd2a80d0630 2024-04-25T09:04:37.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.099+0000 7fd2a7400640 1 -- 172.21.15.175:0/1291189926 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd290003530 con 0x7fd2a80d0630 2024-04-25T09:04:37.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.099+0000 7fd2a7400640 1 -- 172.21.15.175:0/1291189926 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372597743 0 0) 0x7fd2a80d0e20 con 0x7fd2a806cd70 2024-04-25T09:04:37.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.099+0000 7fd2a7400640 1 -- 172.21.15.175:0/1291189926 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2a80d0b40 con 0x7fd2a806cd70 2024-04-25T09:04:37.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.099+0000 7fd2ace00640 1 -- 172.21.15.175:0/1291189926 >> v1:172.21.15.177:6789/0 conn(0x7fd2a806cd70 legacy=0x7fd2a80ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.099+0000 7fd2ace00640 1 -- 172.21.15.175:0/1291189926 >> v1:172.21.15.175:6789/0 conn(0x7fd2a80d0630 legacy=0x7fd2a80cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.099+0000 7fd2ace00640 1 -- 172.21.15.175:0/1291189926 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a80d1100 con 0x7fd2a815ddf0 2024-04-25T09:04:37.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2ace00640 1 --2- 172.21.15.175:0/1291189926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2a815ddf0 0x7fd2a8099a50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0097f0 tx=0x7fd29c01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8925ab2feb7f6419 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2a7400640 1 -- 172.21.15.175:0/1291189926 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0b0070 con 0x7fd2a815ddf0 2024-04-25T09:04:37.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2a7400640 1 -- 172.21.15.175:0/1291189926 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c0ab600 con 0x7fd2a815ddf0 2024-04-25T09:04:37.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2a7400640 1 -- 172.21.15.175:0/1291189926 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0ab9d0 con 0x7fd2a815ddf0 2024-04-25T09:04:37.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2af800640 1 -- 172.21.15.175:0/1291189926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2a815ddf0 msgr2=0x7fd2a8099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2af800640 1 --2- 172.21.15.175:0/1291189926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2a815ddf0 0x7fd2a8099a50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0097f0 tx=0x7fd29c01c4e0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2af800640 1 -- 172.21.15.175:0/1291189926 shutdown_connections 2024-04-25T09:04:37.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2af800640 1 --2- 172.21.15.175:0/1291189926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2a815ddf0 0x7fd2a8099a50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2af800640 1 -- 172.21.15.175:0/1291189926 >> 172.21.15.175:0/1291189926 conn(0x7fd2a80b3400 msgr2=0x7fd2a80b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2af800640 1 -- 172.21.15.175:0/1291189926 shutdown_connections 2024-04-25T09:04:37.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2af800640 1 -- 172.21.15.175:0/1291189926 wait complete. 2024-04-25T09:04:37.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2af800640 1 Processor -- start 2024-04-25T09:04:37.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2af800640 1 -- start start 2024-04-25T09:04:37.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2af800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2a806cd70 0x7fd2a80b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2af800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2a80d0630 0x7fd2a81544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2af800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2a815ddf0 0x7fd2a80ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2af800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a816c080 con 0x7fd2a80d0630 2024-04-25T09:04:37.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2af800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a809a3a0 con 0x7fd2a806cd70 2024-04-25T09:04:37.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.103+0000 7fd2af800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a816c200 con 0x7fd2a815ddf0 2024-04-25T09:04:37.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2a7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2a80d0630 0x7fd2a81544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2a7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2a80d0630 0x7fd2a81544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36200/0 (socket says 172.21.15.175:36200) 2024-04-25T09:04:37.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2a7e00640 1 -- 172.21.15.175:0/3160530290 learned_addr learned my addr 172.21.15.175:0/3160530290 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:37.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2ace00640 1 --2- 172.21.15.175:0/3160530290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2a806cd70 0x7fd2a80b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2ad800640 1 --2- 172.21.15.175:0/3160530290 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2a815ddf0 0x7fd2a80ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2a7e00640 1 -- 172.21.15.175:0/3160530290 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2a815ddf0 msgr2=0x7fd2a80ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2a7e00640 1 --2- 172.21.15.175:0/3160530290 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2a815ddf0 0x7fd2a80ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2a7e00640 1 -- 172.21.15.175:0/3160530290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2a806cd70 msgr2=0x7fd2a80b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2a7e00640 1 --2- 172.21.15.175:0/3160530290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2a806cd70 0x7fd2a80b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2a7e00640 1 -- 172.21.15.175:0/3160530290 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a80affe0 con 0x7fd2a80d0630 2024-04-25T09:04:37.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2ace00640 1 --2- 172.21.15.175:0/3160530290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2a806cd70 0x7fd2a80b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:37.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2a7e00640 1 --2- 172.21.15.175:0/3160530290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2a80d0630 0x7fd2a81544a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd29400c4d0 tx=0x7fd29400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2a4c00640 1 -- 172.21.15.175:0/3160530290 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd294017070 con 0x7fd2a80d0630 2024-04-25T09:04:37.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2a4c00640 1 -- 172.21.15.175:0/3160530290 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd294005cf0 con 0x7fd2a80d0630 2024-04-25T09:04:37.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2a4c00640 1 -- 172.21.15.175:0/3160530290 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2940072b0 con 0x7fd2a80d0630 2024-04-25T09:04:37.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2af800640 1 -- 172.21.15.175:0/3160530290 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a80aef40 con 0x7fd2a80d0630 2024-04-25T09:04:37.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2af800640 1 -- 172.21.15.175:0/3160530290 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a80af500 con 0x7fd2a80d0630 2024-04-25T09:04:37.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2af800640 1 -- 172.21.15.175:0/3160530290 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a8075160 con 0x7fd2a80d0630 2024-04-25T09:04:37.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2a4c00640 1 -- 172.21.15.175:0/3160530290 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd29401a070 con 0x7fd2a80d0630 2024-04-25T09:04:37.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.107+0000 7fd2a4c00640 1 --2- 172.21.15.175:0/3160530290 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd288066f90 0x7fd288069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.111+0000 7fd2a4c00640 1 -- 172.21.15.175:0/3160530290 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2940843b0 con 0x7fd2a80d0630 2024-04-25T09:04:37.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.111+0000 7fd2ace00640 1 --2- 172.21.15.175:0/3160530290 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd288066f90 0x7fd288069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.111+0000 7fd2ace00640 1 --2- 172.21.15.175:0/3160530290 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd288066f90 0x7fd288069450 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0ad000 tx=0x7fd29c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.111+0000 7fd2a4c00640 1 -- 172.21.15.175:0/3160530290 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd294054cd0 con 0x7fd2a80d0630 2024-04-25T09:04:37.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.267+0000 7fd2af800640 1 -- 172.21.15.175:0/3160530290 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2a81549e0 con 0x7fd2a80d0630 2024-04-25T09:04:37.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.267+0000 7fd2a4c00640 1 -- 172.21.15.175:0/3160530290 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd294058d70 con 0x7fd2a80d0630 2024-04-25T09:04:37.260 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:04:37.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.271+0000 7fd2af800640 1 -- 172.21.15.175:0/3160530290 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd288066f90 msgr2=0x7fd288069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.271+0000 7fd2af800640 1 --2- 172.21.15.175:0/3160530290 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd288066f90 0x7fd288069450 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd29c0ad000 tx=0x7fd29c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:04:37.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.271+0000 7fd2af800640 1 -- 172.21.15.175:0/3160530290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2a80d0630 msgr2=0x7fd2a81544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.271+0000 7fd2af800640 1 --2- 172.21.15.175:0/3160530290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2a80d0630 0x7fd2a81544a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd29400c4d0 tx=0x7fd29400c990 comp rx=0 tx=0).stop 2024-04-25T09:04:37.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.271+0000 7fd2af800640 1 -- 172.21.15.175:0/3160530290 shutdown_connections 2024-04-25T09:04:37.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.271+0000 7fd2af800640 1 --2- 172.21.15.175:0/3160530290 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd288066f90 0x7fd288069450 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.271+0000 7fd2af800640 1 --2- 172.21.15.175:0/3160530290 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2a815ddf0 0x7fd2a80ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.271+0000 7fd2af800640 1 --2- 172.21.15.175:0/3160530290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2a80d0630 0x7fd2a81544a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.271+0000 7fd2af800640 1 --2- 172.21.15.175:0/3160530290 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2a806cd70 0x7fd2a80b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.271+0000 7fd2af800640 1 -- 172.21.15.175:0/3160530290 >> 172.21.15.175:0/3160530290 conn(0x7fd2a80b3400 msgr2=0x7fd2a80b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.271+0000 7fd2af800640 1 -- 172.21.15.175:0/3160530290 shutdown_connections 2024-04-25T09:04:37.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.271+0000 7fd2af800640 1 -- 172.21.15.175:0/3160530290 wait complete. 2024-04-25T09:04:37.282 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:37.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.427+0000 7f96b2200640 1 Processor -- start 2024-04-25T09:04:37.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.427+0000 7f96b2200640 1 -- start start 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.431+0000 7f96b2200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f96ac15fbe0 0x7f96ac0cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.431+0000 7f96b2200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ac0cd590 con 0x7f96ac160060 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.431+0000 7f96b2200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ac0cc4f0 con 0x7f96ac15baf0 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.431+0000 7f96b2200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ac15cec0 con 0x7f96ac15fbe0 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.431+0000 7f96a3e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f96ac15fbe0 0x7f96ac0cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.431+0000 7f96b1800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f96ac160060 0x7f96ac0cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39568/0 (socket says 172.21.15.175:39568) 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.431+0000 7f96b1800640 1 -- 172.21.15.175:0/1304738763 learned_addr learned my addr 172.21.15.175:0/1304738763 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.431+0000 7f96a3e00640 1 -- 172.21.15.175:0/1304738763 >> v1:172.21.15.177:6789/0 conn(0x7f96ac15baf0 legacy=0x7f96ac15f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.431+0000 7f96a3e00640 1 -- 172.21.15.175:0/1304738763 >> v1:172.21.15.175:6789/0 conn(0x7f96ac160060 legacy=0x7f96ac0cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.431+0000 7f96a3e00640 1 -- 172.21.15.175:0/1304738763 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac0cc7d0 con 0x7f96ac15fbe0 2024-04-25T09:04:37.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.431+0000 7f96a3e00640 1 --2- 172.21.15.175:0/1304738763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ac15fbe0 0x7f96ac0cf2c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f96940097c0 tx=0x7f969401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0a8a94b3f8074 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96abe00640 1 -- 172.21.15.175:0/1304738763 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96940b0070 con 0x7f96ac15fbe0 2024-04-25T09:04:37.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96abe00640 1 -- 172.21.15.175:0/1304738763 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96940ab600 con 0x7f96ac15fbe0 2024-04-25T09:04:37.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96abe00640 1 -- 172.21.15.175:0/1304738763 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96940ab9d0 con 0x7f96ac15fbe0 2024-04-25T09:04:37.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96b2200640 1 -- 172.21.15.175:0/1304738763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ac15fbe0 msgr2=0x7f96ac0cf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96b2200640 1 --2- 172.21.15.175:0/1304738763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ac15fbe0 0x7f96ac0cf2c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f96940097c0 tx=0x7f969401c330 comp rx=0 tx=0).stop 2024-04-25T09:04:37.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96b2200640 1 -- 172.21.15.175:0/1304738763 shutdown_connections 2024-04-25T09:04:37.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96b2200640 1 --2- 172.21.15.175:0/1304738763 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ac15fbe0 0x7f96ac0cf2c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96b2200640 1 -- 172.21.15.175:0/1304738763 >> 172.21.15.175:0/1304738763 conn(0x7f96ac0b31e0 msgr2=0x7f96ac0b35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96b2200640 1 -- 172.21.15.175:0/1304738763 shutdown_connections 2024-04-25T09:04:37.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96b2200640 1 -- 172.21.15.175:0/1304738763 wait complete. 2024-04-25T09:04:37.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96b2200640 1 Processor -- start 2024-04-25T09:04:37.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96b2200640 1 -- start start 2024-04-25T09:04:37.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96b2200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96ac15baf0 0x7f96ac155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96b2200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ac15fbe0 0x7f96ac0c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96b2200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96ac160060 0x7f96ac0b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96b2200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac0cd070 con 0x7f96ac15fbe0 2024-04-25T09:04:37.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96b2200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac0ccd90 con 0x7f96ac15baf0 2024-04-25T09:04:37.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96b2200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ac0cc200 con 0x7f96ac160060 2024-04-25T09:04:37.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.435+0000 7f96a3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ac15fbe0 0x7f96ac0c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.439+0000 7f96a3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ac15fbe0 0x7f96ac0c9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36220/0 (socket says 172.21.15.175:36220) 2024-04-25T09:04:37.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.439+0000 7f96a3e00640 1 -- 172.21.15.175:0/183192291 learned_addr learned my addr 172.21.15.175:0/183192291 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:37.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.439+0000 7f96b0e00640 1 --2- 172.21.15.175:0/183192291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96ac15baf0 0x7f96ac155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.439+0000 7f96b1800640 1 --2- 172.21.15.175:0/183192291 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96ac160060 0x7f96ac0b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.439+0000 7f96a3e00640 1 -- 172.21.15.175:0/183192291 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96ac160060 msgr2=0x7f96ac0b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.439+0000 7f96a3e00640 1 --2- 172.21.15.175:0/183192291 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96ac160060 0x7f96ac0b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.439+0000 7f96a3e00640 1 -- 172.21.15.175:0/183192291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96ac15baf0 msgr2=0x7f96ac155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.439+0000 7f96a3e00640 1 --2- 172.21.15.175:0/183192291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96ac15baf0 0x7f96ac155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.439+0000 7f96a3e00640 1 -- 172.21.15.175:0/183192291 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac0cf060 con 0x7f96ac15fbe0 2024-04-25T09:04:37.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.439+0000 7f96b1800640 1 --2- 172.21.15.175:0/183192291 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96ac160060 0x7f96ac0b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:37.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.439+0000 7f96a3e00640 1 --2- 172.21.15.175:0/183192291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ac15fbe0 0x7f96ac0c9580 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9694018f40 tx=0x7f96940190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.439+0000 7f96a9600640 1 -- 172.21.15.175:0/183192291 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96940b0040 con 0x7f96ac15fbe0 2024-04-25T09:04:37.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.439+0000 7f96a9600640 1 -- 172.21.15.175:0/183192291 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96940ba070 con 0x7f96ac15fbe0 2024-04-25T09:04:37.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.439+0000 7f96a9600640 1 -- 172.21.15.175:0/183192291 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96940aac30 con 0x7f96ac15fbe0 2024-04-25T09:04:37.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.439+0000 7f96b2200640 1 -- 172.21.15.175:0/183192291 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ac0c87c0 con 0x7f96ac15fbe0 2024-04-25T09:04:37.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.439+0000 7f96b2200640 1 -- 172.21.15.175:0/183192291 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ac0c8d80 con 0x7f96ac15fbe0 2024-04-25T09:04:37.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.439+0000 7f96b2200640 1 -- 172.21.15.175:0/183192291 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96ac074a60 con 0x7f96ac15fbe0 2024-04-25T09:04:37.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.439+0000 7f96a9600640 1 -- 172.21.15.175:0/183192291 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f96940ab420 con 0x7f96ac15fbe0 2024-04-25T09:04:37.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.443+0000 7f96a9600640 1 --2- 172.21.15.175:0/183192291 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9688066f60 0x7f9688069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.443+0000 7f96a9600640 1 -- 172.21.15.175:0/183192291 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f969411f200 con 0x7f96ac15fbe0 2024-04-25T09:04:37.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.443+0000 7f96b0e00640 1 --2- 172.21.15.175:0/183192291 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9688066f60 0x7f9688069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.443+0000 7f96b0e00640 1 --2- 172.21.15.175:0/183192291 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9688066f60 0x7f9688069420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f96ac0cff40 tx=0x7f969c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.443+0000 7f96a9600640 1 -- 172.21.15.175:0/183192291 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9694015fb0 con 0x7f96ac15fbe0 2024-04-25T09:04:37.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.599+0000 7f96b2200640 1 -- 172.21.15.175:0/183192291 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f96ac0b40f0 con 0x7f96ac15fbe0 2024-04-25T09:04:37.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.599+0000 7f96a9600640 1 -- 172.21.15.175:0/183192291 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f96940f0200 con 0x7f96ac15fbe0 2024-04-25T09:04:37.591 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:04:37.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.603+0000 7f96b2200640 1 -- 172.21.15.175:0/183192291 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9688066f60 msgr2=0x7f9688069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.603+0000 7f96b2200640 1 --2- 172.21.15.175:0/183192291 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9688066f60 0x7f9688069420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f96ac0cff40 tx=0x7f969c009040 comp rx=0 tx=0).stop 2024-04-25T09:04:37.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.603+0000 7f96b2200640 1 -- 172.21.15.175:0/183192291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ac15fbe0 msgr2=0x7f96ac0c9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.603+0000 7f96b2200640 1 --2- 172.21.15.175:0/183192291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ac15fbe0 0x7f96ac0c9580 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9694018f40 tx=0x7f96940190d0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.603+0000 7f96b2200640 1 -- 172.21.15.175:0/183192291 shutdown_connections 2024-04-25T09:04:37.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.603+0000 7f96b2200640 1 --2- 172.21.15.175:0/183192291 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9688066f60 0x7f9688069420 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.603+0000 7f96b2200640 1 --2- 172.21.15.175:0/183192291 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96ac160060 0x7f96ac0b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.603+0000 7f96b2200640 1 --2- 172.21.15.175:0/183192291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ac15fbe0 0x7f96ac0c9580 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.603+0000 7f96b2200640 1 --2- 172.21.15.175:0/183192291 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96ac15baf0 0x7f96ac155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.603+0000 7f96b2200640 1 -- 172.21.15.175:0/183192291 >> 172.21.15.175:0/183192291 conn(0x7f96ac0b31e0 msgr2=0x7f96ac0cd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.603+0000 7f96b2200640 1 -- 172.21.15.175:0/183192291 shutdown_connections 2024-04-25T09:04:37.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.603+0000 7f96b2200640 1 -- 172.21.15.175:0/183192291 wait complete. 2024-04-25T09:04:37.612 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:37.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.759+0000 7f6023000640 1 Processor -- start 2024-04-25T09:04:37.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.759+0000 7f6023000640 1 -- start start 2024-04-25T09:04:37.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.759+0000 7f6023000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f601c145250 0x7f601c0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.759+0000 7f6023000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f601c1600a0 0x7f601c0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.759+0000 7f6023000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601c0cfd10 con 0x7f601c0ce970 2024-04-25T09:04:37.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.759+0000 7f6023000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f601c15f650 con 0x7f601c145250 2024-04-25T09:04:37.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.759+0000 7f6023000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601c0cfff0 con 0x7f601c1600a0 2024-04-25T09:04:37.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.763+0000 7f6021000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f601c0ce970 0x7f601c0cee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39582/0 (socket says 172.21.15.175:39582) 2024-04-25T09:04:37.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.763+0000 7f6021000640 1 -- 172.21.15.175:0/2137554022 learned_addr learned my addr 172.21.15.175:0/2137554022 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:37.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.763+0000 7f601be00640 1 --2- 172.21.15.175:0/2137554022 >> v2:172.21.15.177:3300/0 conn(0x7f601c145250 0x7f601c0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.763+0000 7f6013400640 1 --2- 172.21.15.175:0/2137554022 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f601c1600a0 0x7f601c0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.763+0000 7f601b400640 1 -- 172.21.15.175:0/2137554022 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553416027 0 0) 0x7f601c0cfd10 con 0x7f601c0ce970 2024-04-25T09:04:37.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.763+0000 7f601b400640 1 -- 172.21.15.175:0/2137554022 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6000003530 con 0x7f601c0ce970 2024-04-25T09:04:37.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.763+0000 7f601be00640 1 -- 172.21.15.175:0/2137554022 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f601c1600a0 msgr2=0x7f601c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.763+0000 7f601be00640 1 --2- 172.21.15.175:0/2137554022 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f601c1600a0 0x7f601c0cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.763+0000 7f601be00640 1 -- 172.21.15.175:0/2137554022 >> v1:172.21.15.175:6789/0 conn(0x7f601c0ce970 legacy=0x7f601c0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.763+0000 7f601be00640 1 -- 172.21.15.175:0/2137554022 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c15f8a0 con 0x7f601c145250 2024-04-25T09:04:37.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.763+0000 7f601be00640 1 --2- 172.21.15.175:0/2137554022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f601c145250 0x7f601c0cf6b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f600c009d90 tx=0x7f600c01c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fb95da9e685701c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f601b400640 1 -- 172.21.15.175:0/2137554022 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c0b2070 con 0x7f601c145250 2024-04-25T09:04:37.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f601b400640 1 -- 172.21.15.175:0/2137554022 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600c0a5990 con 0x7f601c145250 2024-04-25T09:04:37.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f601b400640 1 -- 172.21.15.175:0/2137554022 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c0a5d60 con 0x7f601c145250 2024-04-25T09:04:37.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6023000640 1 -- 172.21.15.175:0/2137554022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f601c145250 msgr2=0x7f601c0cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6023000640 1 --2- 172.21.15.175:0/2137554022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f601c145250 0x7f601c0cf6b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f600c009d90 tx=0x7f600c01c8b0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6023000640 1 -- 172.21.15.175:0/2137554022 shutdown_connections 2024-04-25T09:04:37.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6023000640 1 --2- 172.21.15.175:0/2137554022 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f601c1600a0 0x7f601c0cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6023000640 1 --2- 172.21.15.175:0/2137554022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f601c145250 0x7f601c0cf6b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6023000640 1 -- 172.21.15.175:0/2137554022 >> 172.21.15.175:0/2137554022 conn(0x7f601c06ac50 msgr2=0x7f601c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6023000640 1 -- 172.21.15.175:0/2137554022 shutdown_connections 2024-04-25T09:04:37.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6023000640 1 -- 172.21.15.175:0/2137554022 wait complete. 2024-04-25T09:04:37.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6023000640 1 Processor -- start 2024-04-25T09:04:37.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6023000640 1 -- start start 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6023000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f601c0ce970 0x7f601c15b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6023000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f601c145250 0x7f601c13fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6023000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f601c1600a0 0x7f601c13ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6023000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c160600 con 0x7f601c1600a0 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6023000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c160480 con 0x7f601c0ce970 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6023000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601c15c870 con 0x7f601c145250 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6021000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f601c1600a0 0x7f601c13ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6021000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f601c1600a0 0x7f601c13ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36226/0 (socket says 172.21.15.175:36226) 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6021000640 1 -- 172.21.15.175:0/2080841245 learned_addr learned my addr 172.21.15.175:0/2080841245 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f6013400640 1 --2- 172.21.15.175:0/2080841245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f601c145250 0x7f601c13fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.767+0000 7f601be00640 1 --2- 172.21.15.175:0/2080841245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f601c0ce970 0x7f601c15b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.771+0000 7f6021000640 1 -- 172.21.15.175:0/2080841245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f601c145250 msgr2=0x7f601c13fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.771+0000 7f6021000640 1 --2- 172.21.15.175:0/2080841245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f601c145250 0x7f601c13fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.771+0000 7f6021000640 1 -- 172.21.15.175:0/2080841245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f601c0ce970 msgr2=0x7f601c15b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.771+0000 7f6021000640 1 --2- 172.21.15.175:0/2080841245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f601c0ce970 0x7f601c15b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.771+0000 7f6021000640 1 -- 172.21.15.175:0/2080841245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c15f020 con 0x7f601c1600a0 2024-04-25T09:04:37.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.771+0000 7f6021000640 1 --2- 172.21.15.175:0/2080841245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f601c1600a0 0x7f601c13ff40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f601400c480 tx=0x7f601400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.771+0000 7f6018c00640 1 -- 172.21.15.175:0/2080841245 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014017070 con 0x7f601c1600a0 2024-04-25T09:04:37.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.771+0000 7f6018c00640 1 -- 172.21.15.175:0/2080841245 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6014005cf0 con 0x7f601c1600a0 2024-04-25T09:04:37.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.771+0000 7f6018c00640 1 -- 172.21.15.175:0/2080841245 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60140072b0 con 0x7f601c1600a0 2024-04-25T09:04:37.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.771+0000 7f6023000640 1 -- 172.21.15.175:0/2080841245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601c15cf80 con 0x7f601c1600a0 2024-04-25T09:04:37.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.771+0000 7f6023000640 1 -- 172.21.15.175:0/2080841245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601c15d540 con 0x7f601c1600a0 2024-04-25T09:04:37.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.771+0000 7f6023000640 1 -- 172.21.15.175:0/2080841245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601c075160 con 0x7f601c1600a0 2024-04-25T09:04:37.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.771+0000 7f6018c00640 1 -- 172.21.15.175:0/2080841245 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6014007450 con 0x7f601c1600a0 2024-04-25T09:04:37.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.771+0000 7f6018c00640 1 --2- 172.21.15.175:0/2080841245 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ff8066f60 0x7f5ff8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.775+0000 7f6018c00640 1 -- 172.21.15.175:0/2080841245 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6014084260 con 0x7f601c1600a0 2024-04-25T09:04:37.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.775+0000 7f601be00640 1 --2- 172.21.15.175:0/2080841245 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ff8066f60 0x7f5ff8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.775+0000 7f601be00640 1 --2- 172.21.15.175:0/2080841245 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ff8066f60 0x7f5ff8069420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f600c0af000 tx=0x7f600c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.779+0000 7f6018c00640 1 -- 172.21.15.175:0/2080841245 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6014007740 con 0x7f601c1600a0 2024-04-25T09:04:37.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.935+0000 7f6023000640 1 -- 172.21.15.175:0/2080841245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f601c06b310 con 0x7f601c1600a0 2024-04-25T09:04:37.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.935+0000 7f6018c00640 1 -- 172.21.15.175:0/2080841245 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6014054cb0 con 0x7f601c1600a0 2024-04-25T09:04:37.927 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:04:37.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.935+0000 7f6023000640 1 -- 172.21.15.175:0/2080841245 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ff8066f60 msgr2=0x7f5ff8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.935+0000 7f6023000640 1 --2- 172.21.15.175:0/2080841245 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ff8066f60 0x7f5ff8069420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f600c0af000 tx=0x7f600c0a7070 comp rx=0 tx=0).stop 2024-04-25T09:04:37.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.935+0000 7f6023000640 1 -- 172.21.15.175:0/2080841245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f601c1600a0 msgr2=0x7f601c13ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.935+0000 7f6023000640 1 --2- 172.21.15.175:0/2080841245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f601c1600a0 0x7f601c13ff40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f601400c480 tx=0x7f601400c940 comp rx=0 tx=0).stop 2024-04-25T09:04:37.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.935+0000 7f6023000640 1 -- 172.21.15.175:0/2080841245 shutdown_connections 2024-04-25T09:04:37.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.935+0000 7f6023000640 1 --2- 172.21.15.175:0/2080841245 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ff8066f60 0x7f5ff8069420 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.935+0000 7f6023000640 1 --2- 172.21.15.175:0/2080841245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f601c1600a0 0x7f601c13ff40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.935+0000 7f6023000640 1 --2- 172.21.15.175:0/2080841245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f601c145250 0x7f601c13fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.939+0000 7f6023000640 1 --2- 172.21.15.175:0/2080841245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f601c0ce970 0x7f601c15b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.939+0000 7f6023000640 1 -- 172.21.15.175:0/2080841245 >> 172.21.15.175:0/2080841245 conn(0x7f601c06ac50 msgr2=0x7f601c13f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.939+0000 7f6023000640 1 -- 172.21.15.175:0/2080841245 shutdown_connections 2024-04-25T09:04:37.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:37.939+0000 7f6023000640 1 -- 172.21.15.175:0/2080841245 wait complete. 2024-04-25T09:04:37.954 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:04:37.954 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:38.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01dd400640 1 Processor -- start 2024-04-25T09:04:38.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01dd400640 1 -- start start 2024-04-25T09:04:38.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01dd400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01d81453a0 0x7f01d815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01dd400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d815cd00 con 0x7f01d815c410 2024-04-25T09:04:38.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01dd400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d80ce660 con 0x7f01d8144fc0 2024-04-25T09:04:38.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01dd400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d815c840 con 0x7f01d81453a0 2024-04-25T09:04:38.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d7200640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f01d815c410 0x7f01d80cee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39588/0 (socket says 172.21.15.175:39588) 2024-04-25T09:04:38.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d7200640 1 -- 172.21.15.175:0/3214750535 learned_addr learned my addr 172.21.15.175:0/3214750535 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:38.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d5e00640 1 -- 172.21.15.175:0/3214750535 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291717704 0 0) 0x7f01d815cd00 con 0x7f01d815c410 2024-04-25T09:04:38.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d5e00640 1 -- 172.21.15.175:0/3214750535 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01bc003530 con 0x7f01d815c410 2024-04-25T09:04:38.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01cde00640 1 --2- 172.21.15.175:0/3214750535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01d81453a0 0x7f01d815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d5e00640 1 -- 172.21.15.175:0/3214750535 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1018693986 0 0) 0x7f01bc003530 con 0x7f01d815c410 2024-04-25T09:04:38.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d5e00640 1 -- 172.21.15.175:0/3214750535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01d81453a0 msgr2=0x7f01d815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:38.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d5e00640 1 --2- 172.21.15.175:0/3214750535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01d81453a0 0x7f01d815bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d5e00640 1 -- 172.21.15.175:0/3214750535 >> v1:172.21.15.177:6789/0 conn(0x7f01d8144fc0 legacy=0x7f01d80cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d5e00640 1 -- 172.21.15.175:0/3214750535 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d80cc930 con 0x7f01d815c410 2024-04-25T09:04:38.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d5e00640 1 -- 172.21.15.175:0/3214750535 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f01d0001680 con 0x7f01d815c410 2024-04-25T09:04:38.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d5e00640 1 -- 172.21.15.175:0/3214750535 >> v1:172.21.15.175:6789/0 conn(0x7f01d815c410 legacy=0x7f01d80cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d5e00640 1 --2- 172.21.15.175:0/3214750535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01bc0039f0 0x7f01bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d5e00640 1 --2- 172.21.15.175:0/3214750535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01bc004810 0x7f01bc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d5e00640 1 --2- 172.21.15.175:0/3214750535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01d81453a0 0x7f01bc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d5e00640 1 -- 172.21.15.175:0/3214750535 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d815c840 con 0x7f01bc004810 2024-04-25T09:04:38.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d5e00640 1 -- 172.21.15.175:0/3214750535 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc00ba80 con 0x7f01bc0039f0 2024-04-25T09:04:38.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d5e00640 1 -- 172.21.15.175:0/3214750535 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc00bc30 con 0x7f01d81453a0 2024-04-25T09:04:38.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01cde00640 1 --2- 172.21.15.175:0/3214750535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01bc004810 0x7f01bc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d7200640 1 --2- 172.21.15.175:0/3214750535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01d81453a0 0x7f01bc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d6800640 1 --2- 172.21.15.175:0/3214750535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01bc0039f0 0x7f01bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01cde00640 1 -- 172.21.15.175:0/3214750535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01d81453a0 msgr2=0x7f01bc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:38.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01cde00640 1 --2- 172.21.15.175:0/3214750535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01d81453a0 0x7f01bc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01cde00640 1 -- 172.21.15.175:0/3214750535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01bc0039f0 msgr2=0x7f01bc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:38.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01cde00640 1 --2- 172.21.15.175:0/3214750535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01bc0039f0 0x7f01bc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01cde00640 1 -- 172.21.15.175:0/3214750535 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc003530 con 0x7f01bc004810 2024-04-25T09:04:38.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.099+0000 7f01d6800640 1 --2- 172.21.15.175:0/3214750535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01bc0039f0 0x7f01bc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:38.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.103+0000 7f01cde00640 1 --2- 172.21.15.175:0/3214750535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01bc004810 0x7f01bc004c90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009ab0 tx=0x7f01c001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e67a0a6d12a461d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:38.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.103+0000 7f01d5e00640 1 -- 172.21.15.175:0/3214750535 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c00b2070 con 0x7f01bc004810 2024-04-25T09:04:38.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.103+0000 7f01d5e00640 1 -- 172.21.15.175:0/3214750535 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c00a5620 con 0x7f01bc004810 2024-04-25T09:04:38.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.103+0000 7f01d5e00640 1 -- 172.21.15.175:0/3214750535 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c00096b0 con 0x7f01bc004810 2024-04-25T09:04:38.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.103+0000 7f01dd400640 1 -- 172.21.15.175:0/3214750535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01bc004810 msgr2=0x7f01bc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.103+0000 7f01dd400640 1 --2- 172.21.15.175:0/3214750535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01bc004810 0x7f01bc004c90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009ab0 tx=0x7f01c001c9d0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.103+0000 7f01d7200640 1 -- 172.21.15.175:0/3214750535 reap_dead start 2024-04-25T09:04:38.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.103+0000 7f01dd400640 1 -- 172.21.15.175:0/3214750535 shutdown_connections 2024-04-25T09:04:38.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.103+0000 7f01dd400640 1 -- 172.21.15.175:0/3214750535 >> 172.21.15.175:0/3214750535 conn(0x7f01d8067150 msgr2=0x7f01d806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:38.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.103+0000 7f01dd400640 1 -- 172.21.15.175:0/3214750535 shutdown_connections 2024-04-25T09:04:38.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.103+0000 7f01dd400640 1 -- 172.21.15.175:0/3214750535 wait complete. 2024-04-25T09:04:38.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01dd400640 1 Processor -- start 2024-04-25T09:04:38.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01dd400640 1 -- start start 2024-04-25T09:04:38.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01dd400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01d8139230 0x7f01d81399d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01dd400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01d8150cc0 0x7f01d814ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01dd400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01d814d1f0 0x7f01d81f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01dd400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80ce900 con 0x7f01d8150cc0 2024-04-25T09:04:38.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01dd400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80ccef0 con 0x7f01d8139230 2024-04-25T09:04:38.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01dd400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d80cc580 con 0x7f01d814d1f0 2024-04-25T09:04:38.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01cde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01d8150cc0 0x7f01d814ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01cde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01d8150cc0 0x7f01d814ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36244/0 (socket says 172.21.15.175:36244) 2024-04-25T09:04:38.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01cde00640 1 -- 172.21.15.175:0/3239510174 learned_addr learned my addr 172.21.15.175:0/3239510174 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:38.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01d6800640 1 --2- 172.21.15.175:0/3239510174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01d8139230 0x7f01d81399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01d7200640 1 --2- 172.21.15.175:0/3239510174 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01d814d1f0 0x7f01d81f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01cde00640 1 -- 172.21.15.175:0/3239510174 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01d814d1f0 msgr2=0x7f01d81f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01cde00640 1 --2- 172.21.15.175:0/3239510174 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01d814d1f0 0x7f01d81f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01cde00640 1 -- 172.21.15.175:0/3239510174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01d8139230 msgr2=0x7f01d81399d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01cde00640 1 --2- 172.21.15.175:0/3239510174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01d8139230 0x7f01d81399d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01cde00640 1 -- 172.21.15.175:0/3239510174 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d8151140 con 0x7f01d8150cc0 2024-04-25T09:04:38.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01cde00640 1 --2- 172.21.15.175:0/3239510174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01d8150cc0 0x7f01d814ccb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f01c001ceb0 tx=0x7f01bc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:38.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01cf400640 1 -- 172.21.15.175:0/3239510174 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c00b2040 con 0x7f01d8150cc0 2024-04-25T09:04:38.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01cf400640 1 -- 172.21.15.175:0/3239510174 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c000f000 con 0x7f01d8150cc0 2024-04-25T09:04:38.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01dd400640 1 -- 172.21.15.175:0/3239510174 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d813c170 con 0x7f01d8150cc0 2024-04-25T09:04:38.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01cf400640 1 -- 172.21.15.175:0/3239510174 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0004240 con 0x7f01d8150cc0 2024-04-25T09:04:38.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.107+0000 7f01dd400640 1 -- 172.21.15.175:0/3239510174 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d813c730 con 0x7f01d8150cc0 2024-04-25T09:04:38.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.111+0000 7f01dd400640 1 -- 172.21.15.175:0/3239510174 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d8074a60 con 0x7f01d8150cc0 2024-04-25T09:04:38.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.111+0000 7f01cf400640 1 -- 172.21.15.175:0/3239510174 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f01c00c0030 con 0x7f01d8150cc0 2024-04-25T09:04:38.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.111+0000 7f01cf400640 1 --2- 172.21.15.175:0/3239510174 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f01b4066f90 0x7f01b4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.111+0000 7f01cf400640 1 -- 172.21.15.175:0/3239510174 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01c011eee0 con 0x7f01d8150cc0 2024-04-25T09:04:38.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.111+0000 7f01d6800640 1 --2- 172.21.15.175:0/3239510174 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f01b4066f90 0x7f01b4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.111+0000 7f01d6800640 1 --2- 172.21.15.175:0/3239510174 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f01b4066f90 0x7f01b4069450 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f01c80059b0 tx=0x7f01c80073f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:38.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.115+0000 7f01cf400640 1 -- 172.21.15.175:0/3239510174 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f01c00c7060 con 0x7f01d8150cc0 2024-04-25T09:04:38.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.271+0000 7f01dd400640 1 -- 172.21.15.175:0/3239510174 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01d814d5d0 con 0x7f01d8150cc0 2024-04-25T09:04:38.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.271+0000 7f01cf400640 1 -- 172.21.15.175:0/3239510174 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f01c0016740 con 0x7f01d8150cc0 2024-04-25T09:04:38.263 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:38.263 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":20,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:11.440551+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:38.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.275+0000 7f01dd400640 1 -- 172.21.15.175:0/3239510174 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f01b4066f90 msgr2=0x7f01b4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.275+0000 7f01dd400640 1 --2- 172.21.15.175:0/3239510174 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f01b4066f90 0x7f01b4069450 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f01c80059b0 tx=0x7f01c80073f0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.275+0000 7f01dd400640 1 -- 172.21.15.175:0/3239510174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01d8150cc0 msgr2=0x7f01d814ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.275+0000 7f01dd400640 1 --2- 172.21.15.175:0/3239510174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01d8150cc0 0x7f01d814ccb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f01c001ceb0 tx=0x7f01bc005840 comp rx=0 tx=0).stop 2024-04-25T09:04:38.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.275+0000 7f01dd400640 1 -- 172.21.15.175:0/3239510174 shutdown_connections 2024-04-25T09:04:38.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.275+0000 7f01dd400640 1 --2- 172.21.15.175:0/3239510174 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f01b4066f90 0x7f01b4069450 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.275+0000 7f01dd400640 1 --2- 172.21.15.175:0/3239510174 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01d814d1f0 0x7f01d81f49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.275+0000 7f01dd400640 1 --2- 172.21.15.175:0/3239510174 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01d8150cc0 0x7f01d814ccb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.275+0000 7f01dd400640 1 --2- 172.21.15.175:0/3239510174 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f01d8139230 0x7f01d81399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.275+0000 7f01dd400640 1 -- 172.21.15.175:0/3239510174 >> 172.21.15.175:0/3239510174 conn(0x7f01bc004810 msgr2=0x7f01d815f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:38.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.275+0000 7f01dd400640 1 -- 172.21.15.175:0/3239510174 shutdown_connections 2024-04-25T09:04:38.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.275+0000 7f01dd400640 1 -- 172.21.15.175:0/3239510174 wait complete. 2024-04-25T09:04:38.284 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:08.047706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:04:08.795449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:38.285 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:38.343 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:38.346 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:38.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.435+0000 7f3c55e00640 1 Processor -- start 2024-04-25T09:04:38.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.435+0000 7f3c55e00640 1 -- start start 2024-04-25T09:04:38.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.435+0000 7f3c55e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3c5015ddf0 0x7f3c50099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.435+0000 7f3c55e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3c5006cd70 0x7f3c50099f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.435+0000 7f3c55e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c500d0b40 con 0x7f3c500d0630 2024-04-25T09:04:38.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.435+0000 7f3c55e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5006d1e0 con 0x7f3c5006cd70 2024-04-25T09:04:38.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.435+0000 7f3c55e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c500cbf60 con 0x7f3c5015ddf0 2024-04-25T09:04:38.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.435+0000 7f3c46000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f3c500d0630 0x7f3c500cc3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39604/0 (socket says 172.21.15.175:39604) 2024-04-25T09:04:38.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.435+0000 7f3c4f400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3c5006cd70 0x7f3c50099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.435+0000 7f3c46000640 1 -- 172.21.15.175:0/3286899879 learned_addr learned my addr 172.21.15.175:0/3286899879 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:38.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.435+0000 7f3c4ea00640 1 --2- 172.21.15.175:0/3286899879 >> v2:172.21.15.177:3300/0 conn(0x7f3c5015ddf0 0x7f3c50099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.435+0000 7f3c4f400640 1 -- 172.21.15.175:0/3286899879 >> v2:172.21.15.177:3300/0 conn(0x7f3c5015ddf0 msgr2=0x7f3c50099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:38.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.435+0000 7f3c4f400640 1 --2- 172.21.15.175:0/3286899879 >> v2:172.21.15.177:3300/0 conn(0x7f3c5015ddf0 0x7f3c50099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.435+0000 7f3c4f400640 1 -- 172.21.15.175:0/3286899879 >> v1:172.21.15.175:6789/0 conn(0x7f3c500d0630 legacy=0x7f3c500cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.435+0000 7f3c4f400640 1 -- 172.21.15.175:0/3286899879 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c500d0e20 con 0x7f3c5006cd70 2024-04-25T09:04:38.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.435+0000 7f3c4e000640 1 -- 172.21.15.175:0/3286899879 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973425679 0 0) 0x7f3c500d0b40 con 0x7f3c500d0630 2024-04-25T09:04:38.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.439+0000 7f3c4f400640 1 --2- 172.21.15.175:0/3286899879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c5006cd70 0x7f3c50099f90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3c5009f880 tx=0x7f3c4801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9290af9ae7b175b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:38.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.439+0000 7f3c4e000640 1 -- 172.21.15.175:0/3286899879 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c480b2070 con 0x7f3c5006cd70 2024-04-25T09:04:38.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.439+0000 7f3c4e000640 1 -- 172.21.15.175:0/3286899879 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c480a58e0 con 0x7f3c5006cd70 2024-04-25T09:04:38.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.439+0000 7f3c4e000640 1 -- 172.21.15.175:0/3286899879 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c480a5cb0 con 0x7f3c5006cd70 2024-04-25T09:04:38.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.439+0000 7f3c55e00640 1 -- 172.21.15.175:0/3286899879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c5006cd70 msgr2=0x7f3c50099f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.439+0000 7f3c55e00640 1 --2- 172.21.15.175:0/3286899879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c5006cd70 0x7f3c50099f90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3c5009f880 tx=0x7f3c4801c930 comp rx=0 tx=0).stop 2024-04-25T09:04:38.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.439+0000 7f3c55e00640 1 -- 172.21.15.175:0/3286899879 shutdown_connections 2024-04-25T09:04:38.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.439+0000 7f3c55e00640 1 --2- 172.21.15.175:0/3286899879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c5006cd70 0x7f3c50099f90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.439+0000 7f3c55e00640 1 --2- 172.21.15.175:0/3286899879 >> v2:172.21.15.177:3300/0 conn(0x7f3c5015ddf0 0x7f3c50099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.439+0000 7f3c55e00640 1 -- 172.21.15.175:0/3286899879 >> 172.21.15.175:0/3286899879 conn(0x7f3c500b3400 msgr2=0x7f3c500b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:38.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.439+0000 7f3c55e00640 1 -- 172.21.15.175:0/3286899879 shutdown_connections 2024-04-25T09:04:38.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.439+0000 7f3c55e00640 1 -- 172.21.15.175:0/3286899879 wait complete. 2024-04-25T09:04:38.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.439+0000 7f3c55e00640 1 Processor -- start 2024-04-25T09:04:38.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.439+0000 7f3c55e00640 1 -- start start 2024-04-25T09:04:38.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c55e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c5006cd70 0x7f3c501537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c55e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c500d0630 0x7f3c50153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c55e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c5015ddf0 0x7f3c501543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c55e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c500cd490 con 0x7f3c500d0630 2024-04-25T09:04:38.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c55e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c500cd310 con 0x7f3c5006cd70 2024-04-25T09:04:38.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c55e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c500cd610 con 0x7f3c5015ddf0 2024-04-25T09:04:38.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c46000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c500d0630 0x7f3c50153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c46000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c500d0630 0x7f3c50153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36252/0 (socket says 172.21.15.175:36252) 2024-04-25T09:04:38.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c46000640 1 -- 172.21.15.175:0/1633227664 learned_addr learned my addr 172.21.15.175:0/1633227664 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:38.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c4ea00640 1 --2- 172.21.15.175:0/1633227664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c5006cd70 0x7f3c501537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c4f400640 1 --2- 172.21.15.175:0/1633227664 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c5015ddf0 0x7f3c501543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c46000640 1 -- 172.21.15.175:0/1633227664 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c5015ddf0 msgr2=0x7f3c501543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c46000640 1 --2- 172.21.15.175:0/1633227664 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c5015ddf0 0x7f3c501543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c46000640 1 -- 172.21.15.175:0/1633227664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c5006cd70 msgr2=0x7f3c501537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c46000640 1 --2- 172.21.15.175:0/1633227664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c5006cd70 0x7f3c501537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c46000640 1 -- 172.21.15.175:0/1633227664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c500b0910 con 0x7f3c500d0630 2024-04-25T09:04:38.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c46000640 1 --2- 172.21.15.175:0/1633227664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c500d0630 0x7f3c50153e70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800c4e0 tx=0x7f3c3800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:38.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c47e00640 1 -- 172.21.15.175:0/1633227664 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38018070 con 0x7f3c500d0630 2024-04-25T09:04:38.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c47e00640 1 -- 172.21.15.175:0/1633227664 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c38007500 con 0x7f3c500d0630 2024-04-25T09:04:38.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c47e00640 1 -- 172.21.15.175:0/1633227664 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38004a30 con 0x7f3c500d0630 2024-04-25T09:04:38.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c55e00640 1 -- 172.21.15.175:0/1633227664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c50157f70 con 0x7f3c500d0630 2024-04-25T09:04:38.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c55e00640 1 -- 172.21.15.175:0/1633227664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c50158530 con 0x7f3c500d0630 2024-04-25T09:04:38.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c55e00640 1 -- 172.21.15.175:0/1633227664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c50075160 con 0x7f3c500d0630 2024-04-25T09:04:38.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.443+0000 7f3c47e00640 1 -- 172.21.15.175:0/1633227664 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3c38004bd0 con 0x7f3c500d0630 2024-04-25T09:04:38.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.447+0000 7f3c47e00640 1 --2- 172.21.15.175:0/1633227664 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c2c066f90 0x7f3c2c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.447+0000 7f3c47e00640 1 -- 172.21.15.175:0/1633227664 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c380843c0 con 0x7f3c500d0630 2024-04-25T09:04:38.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.447+0000 7f3c4ea00640 1 --2- 172.21.15.175:0/1633227664 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c2c066f90 0x7f3c2c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.447+0000 7f3c4ea00640 1 --2- 172.21.15.175:0/1633227664 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c2c066f90 0x7f3c2c069450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000b9d0 tx=0x7f3c40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:38.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.451+0000 7f3c47e00640 1 -- 172.21.15.175:0/1633227664 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3c380553f0 con 0x7f3c500d0630 2024-04-25T09:04:38.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.603+0000 7f3c55e00640 1 -- 172.21.15.175:0/1633227664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c50158700 con 0x7f3c500d0630 2024-04-25T09:04:38.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.603+0000 7f3c47e00640 1 -- 172.21.15.175:0/1633227664 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c38054cf0 con 0x7f3c500d0630 2024-04-25T09:04:38.596 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:04:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.607+0000 7f3c55e00640 1 -- 172.21.15.175:0/1633227664 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c2c066f90 msgr2=0x7f3c2c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.607+0000 7f3c55e00640 1 --2- 172.21.15.175:0/1633227664 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c2c066f90 0x7f3c2c069450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000b9d0 tx=0x7f3c40008040 comp rx=0 tx=0).stop 2024-04-25T09:04:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.607+0000 7f3c55e00640 1 -- 172.21.15.175:0/1633227664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c500d0630 msgr2=0x7f3c50153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.607+0000 7f3c55e00640 1 --2- 172.21.15.175:0/1633227664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c500d0630 0x7f3c50153e70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800c4e0 tx=0x7f3c3800c9a0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.607+0000 7f3c55e00640 1 -- 172.21.15.175:0/1633227664 shutdown_connections 2024-04-25T09:04:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.607+0000 7f3c55e00640 1 --2- 172.21.15.175:0/1633227664 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c2c066f90 0x7f3c2c069450 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.607+0000 7f3c55e00640 1 --2- 172.21.15.175:0/1633227664 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c5015ddf0 0x7f3c501543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.607+0000 7f3c55e00640 1 --2- 172.21.15.175:0/1633227664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c500d0630 0x7f3c50153e70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.607+0000 7f3c55e00640 1 --2- 172.21.15.175:0/1633227664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c5006cd70 0x7f3c501537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.607+0000 7f3c55e00640 1 -- 172.21.15.175:0/1633227664 >> 172.21.15.175:0/1633227664 conn(0x7f3c500b3400 msgr2=0x7f3c500cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.607+0000 7f3c55e00640 1 -- 172.21.15.175:0/1633227664 shutdown_connections 2024-04-25T09:04:38.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.607+0000 7f3c55e00640 1 -- 172.21.15.175:0/1633227664 wait complete. 2024-04-25T09:04:38.617 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:38.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.807+0000 7f2896400640 1 Processor -- start 2024-04-25T09:04:38.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.807+0000 7f2896400640 1 -- start start 2024-04-25T09:04:38.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.807+0000 7f2896400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2890145250 0x7f28900cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.807+0000 7f2896400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f28900ce970 0x7f28900cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.807+0000 7f2896400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28900cfd10 con 0x7f28901600a0 2024-04-25T09:04:38.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.807+0000 7f2896400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f289015f650 con 0x7f2890145250 2024-04-25T09:04:38.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.807+0000 7f2896400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28900cfff0 con 0x7f28900ce970 2024-04-25T09:04:38.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.807+0000 7f288f400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2890145250 0x7f28900cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.807+0000 7f2886a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f28901600a0 0x7f28900cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39608/0 (socket says 172.21.15.175:39608) 2024-04-25T09:04:38.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.807+0000 7f2886a00640 1 -- 172.21.15.175:0/2618282237 learned_addr learned my addr 172.21.15.175:0/2618282237 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:38.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.807+0000 7f288fe00640 1 --2- 172.21.15.175:0/2618282237 >> v2:172.21.15.177:3300/0 conn(0x7f28900ce970 0x7f28900cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.807+0000 7f288f400640 1 -- 172.21.15.175:0/2618282237 >> v2:172.21.15.177:3300/0 conn(0x7f28900ce970 msgr2=0x7f28900cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:38.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.807+0000 7f288ea00640 1 -- 172.21.15.175:0/2618282237 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158315269 0 0) 0x7f28900cfd10 con 0x7f28901600a0 2024-04-25T09:04:38.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.807+0000 7f288f400640 1 --2- 172.21.15.175:0/2618282237 >> v2:172.21.15.177:3300/0 conn(0x7f28900ce970 0x7f28900cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.807+0000 7f288f400640 1 -- 172.21.15.175:0/2618282237 >> v1:172.21.15.175:6789/0 conn(0x7f28901600a0 legacy=0x7f28900cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.807+0000 7f288f400640 1 -- 172.21.15.175:0/2618282237 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289015f8a0 con 0x7f2890145250 2024-04-25T09:04:38.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.811+0000 7f288f400640 1 --2- 172.21.15.175:0/2618282237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2890145250 0x7f28900cf6b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2880009d90 tx=0x7f288001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f192e5aa000bb54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:38.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.811+0000 7f288ea00640 1 -- 172.21.15.175:0/2618282237 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28800b2070 con 0x7f2890145250 2024-04-25T09:04:38.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.811+0000 7f288ea00640 1 -- 172.21.15.175:0/2618282237 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28800a58d0 con 0x7f2890145250 2024-04-25T09:04:38.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.811+0000 7f288ea00640 1 -- 172.21.15.175:0/2618282237 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28800a5ca0 con 0x7f2890145250 2024-04-25T09:04:38.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.811+0000 7f2896400640 1 -- 172.21.15.175:0/2618282237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2890145250 msgr2=0x7f28900cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.811+0000 7f2896400640 1 --2- 172.21.15.175:0/2618282237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2890145250 0x7f28900cf6b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2880009d90 tx=0x7f288001c870 comp rx=0 tx=0).stop 2024-04-25T09:04:38.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.811+0000 7f2896400640 1 -- 172.21.15.175:0/2618282237 shutdown_connections 2024-04-25T09:04:38.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.811+0000 7f2896400640 1 --2- 172.21.15.175:0/2618282237 >> v2:172.21.15.177:3300/0 conn(0x7f28900ce970 0x7f28900cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.811+0000 7f2896400640 1 --2- 172.21.15.175:0/2618282237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2890145250 0x7f28900cf6b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.811+0000 7f2896400640 1 -- 172.21.15.175:0/2618282237 >> 172.21.15.175:0/2618282237 conn(0x7f289006ac50 msgr2=0x7f289006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:38.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.811+0000 7f2896400640 1 -- 172.21.15.175:0/2618282237 shutdown_connections 2024-04-25T09:04:38.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.811+0000 7f2896400640 1 -- 172.21.15.175:0/2618282237 wait complete. 2024-04-25T09:04:38.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f2896400640 1 Processor -- start 2024-04-25T09:04:38.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f2896400640 1 -- start start 2024-04-25T09:04:38.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f2896400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28900ce970 0x7f28901f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f2896400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2890145250 0x7f28900ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f2896400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28901600a0 0x7f28900b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f2896400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289015c870 con 0x7f28900ce970 2024-04-25T09:04:38.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f2896400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2890145630 con 0x7f2890145250 2024-04-25T09:04:38.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f2896400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289015c9f0 con 0x7f28901600a0 2024-04-25T09:04:38.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f288f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28900ce970 0x7f28901f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f288f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28900ce970 0x7f28901f6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36278/0 (socket says 172.21.15.175:36278) 2024-04-25T09:04:38.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f288f400640 1 -- 172.21.15.175:0/894074356 learned_addr learned my addr 172.21.15.175:0/894074356 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:38.808 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f288f400640 1 -- 172.21.15.175:0/894074356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28901600a0 msgr2=0x7f28900b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.808 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f288f400640 1 --2- 172.21.15.175:0/894074356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28901600a0 0x7f28900b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f288f400640 1 -- 172.21.15.175:0/894074356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2890145250 msgr2=0x7f28900ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f288f400640 1 --2- 172.21.15.175:0/894074356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2890145250 0x7f28900ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f288f400640 1 -- 172.21.15.175:0/894074356 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28900ae620 con 0x7f28900ce970 2024-04-25T09:04:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f288f400640 1 --2- 172.21.15.175:0/894074356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28900ce970 0x7f28901f6da0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f28800b0040 tx=0x7f2880019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f2887e00640 1 -- 172.21.15.175:0/894074356 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28800bd020 con 0x7f28900ce970 2024-04-25T09:04:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f2887e00640 1 -- 172.21.15.175:0/894074356 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28800b8670 con 0x7f28900ce970 2024-04-25T09:04:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f2896400640 1 -- 172.21.15.175:0/894074356 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28900b4260 con 0x7f28900ce970 2024-04-25T09:04:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f2887e00640 1 -- 172.21.15.175:0/894074356 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28800b2040 con 0x7f28900ce970 2024-04-25T09:04:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.815+0000 7f2896400640 1 -- 172.21.15.175:0/894074356 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28900b34a0 con 0x7f28900ce970 2024-04-25T09:04:38.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.819+0000 7f2896400640 1 -- 172.21.15.175:0/894074356 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2890075160 con 0x7f28900ce970 2024-04-25T09:04:38.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.819+0000 7f2887e00640 1 -- 172.21.15.175:0/894074356 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f28800c0020 con 0x7f28900ce970 2024-04-25T09:04:38.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.819+0000 7f2887e00640 1 --2- 172.21.15.175:0/894074356 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f286c066f60 0x7f286c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.811 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.819+0000 7f2887e00640 1 -- 172.21.15.175:0/894074356 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2880120120 con 0x7f28900ce970 2024-04-25T09:04:38.811 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.819+0000 7f2886a00640 1 --2- 172.21.15.175:0/894074356 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f286c066f60 0x7f286c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.811 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.819+0000 7f2886a00640 1 --2- 172.21.15.175:0/894074356 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f286c066f60 0x7f286c069420 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f28900b44b0 tx=0x7f2878007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:38.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.823+0000 7f2887e00640 1 -- 172.21.15.175:0/894074356 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f28800c7070 con 0x7f28900ce970 2024-04-25T09:04:38.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.975+0000 7f2896400640 1 -- 172.21.15.175:0/894074356 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28901406f0 con 0x7f28900ce970 2024-04-25T09:04:38.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.979+0000 7f2887e00640 1 -- 172.21.15.175:0/894074356 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2880016520 con 0x7f28900ce970 2024-04-25T09:04:38.969 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:04:38.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.979+0000 7f2896400640 1 -- 172.21.15.175:0/894074356 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f286c066f60 msgr2=0x7f286c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.979+0000 7f2896400640 1 --2- 172.21.15.175:0/894074356 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f286c066f60 0x7f286c069420 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f28900b44b0 tx=0x7f2878007970 comp rx=0 tx=0).stop 2024-04-25T09:04:38.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.979+0000 7f2896400640 1 -- 172.21.15.175:0/894074356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28900ce970 msgr2=0x7f28901f6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.979+0000 7f2896400640 1 --2- 172.21.15.175:0/894074356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28900ce970 0x7f28901f6da0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f28800b0040 tx=0x7f2880019610 comp rx=0 tx=0).stop 2024-04-25T09:04:38.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.979+0000 7f2896400640 1 -- 172.21.15.175:0/894074356 shutdown_connections 2024-04-25T09:04:38.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.979+0000 7f2896400640 1 --2- 172.21.15.175:0/894074356 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f286c066f60 0x7f286c069420 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.979+0000 7f2896400640 1 --2- 172.21.15.175:0/894074356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28901600a0 0x7f28900b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.979+0000 7f2896400640 1 --2- 172.21.15.175:0/894074356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2890145250 0x7f28900ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.979+0000 7f2896400640 1 --2- 172.21.15.175:0/894074356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28900ce970 0x7f28901f6da0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.979+0000 7f2896400640 1 -- 172.21.15.175:0/894074356 >> 172.21.15.175:0/894074356 conn(0x7f289006ac50 msgr2=0x7f28900ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:38.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.979+0000 7f2896400640 1 -- 172.21.15.175:0/894074356 shutdown_connections 2024-04-25T09:04:38.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:38.979+0000 7f2896400640 1 -- 172.21.15.175:0/894074356 wait complete. 2024-04-25T09:04:38.991 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:39.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.135+0000 7f88a9600640 1 Processor -- start 2024-04-25T09:04:39.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.135+0000 7f88a9600640 1 -- start start 2024-04-25T09:04:39.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.139+0000 7f88a9600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f88a415af20 0x7f88a40b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.139+0000 7f88a9600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88a40b4630 0x7f88a415c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.139+0000 7f88a9600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a406db60 con 0x7f88a40cbe60 2024-04-25T09:04:39.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.139+0000 7f88a9600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a406de40 con 0x7f88a415af20 2024-04-25T09:04:39.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.139+0000 7f88a9600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a406e120 con 0x7f88a40b4630 2024-04-25T09:04:39.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.139+0000 7f88a3400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88a40b4630 0x7f88a415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.139+0000 7f88a2000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f88a415af20 0x7f88a40b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.139+0000 7f88a3400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88a40b4630 0x7f88a415c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:53944/0 (socket says 172.21.15.175:53944) 2024-04-25T09:04:39.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.139+0000 7f88a3400640 1 -- 172.21.15.175:0/1655361211 learned_addr learned my addr 172.21.15.175:0/1655361211 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:39.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.139+0000 7f88a2000640 1 --2- 172.21.15.175:0/1655361211 >> v2:172.21.15.177:3300/0 conn(0x7f88a415af20 0x7f88a40b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:41428/0 (socket says 172.21.15.175:41428) 2024-04-25T09:04:39.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.139+0000 7f88a3400640 1 -- 172.21.15.175:0/1655361211 >> v2:172.21.15.177:3300/0 conn(0x7f88a415af20 msgr2=0x7f88a40b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:39.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.139+0000 7f88a3400640 1 --2- 172.21.15.175:0/1655361211 >> v2:172.21.15.177:3300/0 conn(0x7f88a415af20 0x7f88a40b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.139+0000 7f88a3400640 1 -- 172.21.15.175:0/1655361211 >> v1:172.21.15.177:6789/0 conn(0x7f88a40cbe60 legacy=0x7f88a406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.139+0000 7f88a3400640 1 -- 172.21.15.175:0/1655361211 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a415c2f0 con 0x7f88a40b4630 2024-04-25T09:04:39.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.143+0000 7f88a3400640 1 --2- 172.21.15.175:0/1655361211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88a40b4630 0x7f88a415c810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f889c009e50 tx=0x7f889c01ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f0cfcf53f3437f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:39.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.143+0000 7f88a1600640 1 -- 172.21.15.175:0/1655361211 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c0a5700 con 0x7f88a40b4630 2024-04-25T09:04:39.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.143+0000 7f88a1600640 1 -- 172.21.15.175:0/1655361211 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c0a58a0 con 0x7f88a40b4630 2024-04-25T09:04:39.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.143+0000 7f88a1600640 1 -- 172.21.15.175:0/1655361211 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c0a5c70 con 0x7f88a40b4630 2024-04-25T09:04:39.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.143+0000 7f88a9600640 1 -- 172.21.15.175:0/1655361211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88a40b4630 msgr2=0x7f88a415c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.143+0000 7f88a9600640 1 --2- 172.21.15.175:0/1655361211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88a40b4630 0x7f88a415c810 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f889c009e50 tx=0x7f889c01ca30 comp rx=0 tx=0).stop 2024-04-25T09:04:39.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.143+0000 7f88a9600640 1 -- 172.21.15.175:0/1655361211 shutdown_connections 2024-04-25T09:04:39.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.143+0000 7f88a9600640 1 --2- 172.21.15.175:0/1655361211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88a40b4630 0x7f88a415c810 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.143+0000 7f88a9600640 1 --2- 172.21.15.175:0/1655361211 >> v2:172.21.15.177:3300/0 conn(0x7f88a415af20 0x7f88a40b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.143+0000 7f88a9600640 1 -- 172.21.15.175:0/1655361211 >> 172.21.15.175:0/1655361211 conn(0x7f88a406ac50 msgr2=0x7f88a406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:39.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.143+0000 7f88a9600640 1 -- 172.21.15.175:0/1655361211 shutdown_connections 2024-04-25T09:04:39.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.143+0000 7f88a9600640 1 -- 172.21.15.175:0/1655361211 wait complete. 2024-04-25T09:04:39.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.143+0000 7f88a9600640 1 Processor -- start 2024-04-25T09:04:39.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.143+0000 7f88a9600640 1 -- start start 2024-04-25T09:04:39.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a9600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88a40b4630 0x7f88a414b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a9600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88a40cbe60 0x7f88a40cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a9600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88a415af20 0x7f88a4154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a9600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a415d930 con 0x7f88a40b4630 2024-04-25T09:04:39.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a9600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a415d7b0 con 0x7f88a415af20 2024-04-25T09:04:39.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a9600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a415dab0 con 0x7f88a40cbe60 2024-04-25T09:04:39.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88a40b4630 0x7f88a414b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88a40b4630 0x7f88a414b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:36294/0 (socket says 172.21.15.175:36294) 2024-04-25T09:04:39.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a2a00640 1 -- 172.21.15.175:0/1306402074 learned_addr learned my addr 172.21.15.175:0/1306402074 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:39.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a3400640 1 --2- 172.21.15.175:0/1306402074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88a415af20 0x7f88a4154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a2000640 1 --2- 172.21.15.175:0/1306402074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88a40cbe60 0x7f88a40cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a2a00640 1 -- 172.21.15.175:0/1306402074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88a40cbe60 msgr2=0x7f88a40cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a2a00640 1 --2- 172.21.15.175:0/1306402074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88a40cbe60 0x7f88a40cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a2a00640 1 -- 172.21.15.175:0/1306402074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88a415af20 msgr2=0x7f88a4154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a2a00640 1 --2- 172.21.15.175:0/1306402074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88a415af20 0x7f88a4154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a2a00640 1 -- 172.21.15.175:0/1306402074 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a414bc20 con 0x7f88a40b4630 2024-04-25T09:04:39.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a2a00640 1 --2- 172.21.15.175:0/1306402074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88a40b4630 0x7f88a414b6e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f888c00c450 tx=0x7f888c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:39.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f889aa00640 1 -- 172.21.15.175:0/1306402074 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c016020 con 0x7f88a40b4630 2024-04-25T09:04:39.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f889aa00640 1 -- 172.21.15.175:0/1306402074 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c0052d0 con 0x7f88a40b4630 2024-04-25T09:04:39.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a9600640 1 -- 172.21.15.175:0/1306402074 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a40ce2f0 con 0x7f88a40b4630 2024-04-25T09:04:39.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f889aa00640 1 -- 172.21.15.175:0/1306402074 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c007260 con 0x7f88a40b4630 2024-04-25T09:04:39.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a9600640 1 -- 172.21.15.175:0/1306402074 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a40ce8b0 con 0x7f88a40b4630 2024-04-25T09:04:39.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.147+0000 7f88a9600640 1 -- 172.21.15.175:0/1306402074 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a4075160 con 0x7f88a40b4630 2024-04-25T09:04:39.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.151+0000 7f889aa00640 1 -- 172.21.15.175:0/1306402074 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f888c007400 con 0x7f88a40b4630 2024-04-25T09:04:39.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.151+0000 7f889aa00640 1 --2- 172.21.15.175:0/1306402074 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8880066f90 0x7f8880069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.151+0000 7f889aa00640 1 -- 172.21.15.175:0/1306402074 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f888c0847e0 con 0x7f88a40b4630 2024-04-25T09:04:39.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.151+0000 7f88a2000640 1 --2- 172.21.15.175:0/1306402074 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8880066f90 0x7f8880069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.151+0000 7f88a2000640 1 --2- 172.21.15.175:0/1306402074 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8880066f90 0x7f8880069450 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f88a41514a0 tx=0x7f8894009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:39.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.155+0000 7f889aa00640 1 -- 172.21.15.175:0/1306402074 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f888c020020 con 0x7f88a40b4630 2024-04-25T09:04:39.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.307+0000 7f88a9600640 1 -- 172.21.15.175:0/1306402074 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f88a4071d90 con 0x7f88a40b4630 2024-04-25T09:04:39.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.307+0000 7f889aa00640 1 -- 172.21.15.175:0/1306402074 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f888c005480 con 0x7f88a40b4630 2024-04-25T09:04:39.299 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:04:39.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.311+0000 7f88a9600640 1 -- 172.21.15.175:0/1306402074 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8880066f90 msgr2=0x7f8880069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.311+0000 7f88a9600640 1 --2- 172.21.15.175:0/1306402074 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8880066f90 0x7f8880069450 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f88a41514a0 tx=0x7f8894009190 comp rx=0 tx=0).stop 2024-04-25T09:04:39.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.311+0000 7f88a9600640 1 -- 172.21.15.175:0/1306402074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88a40b4630 msgr2=0x7f88a414b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.311+0000 7f88a9600640 1 --2- 172.21.15.175:0/1306402074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88a40b4630 0x7f88a414b6e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f888c00c450 tx=0x7f888c00c910 comp rx=0 tx=0).stop 2024-04-25T09:04:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.311+0000 7f88a9600640 1 -- 172.21.15.175:0/1306402074 shutdown_connections 2024-04-25T09:04:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.311+0000 7f88a9600640 1 --2- 172.21.15.175:0/1306402074 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8880066f90 0x7f8880069450 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.311+0000 7f88a9600640 1 --2- 172.21.15.175:0/1306402074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88a415af20 0x7f88a4154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.311+0000 7f88a9600640 1 --2- 172.21.15.175:0/1306402074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88a40cbe60 0x7f88a40cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.311+0000 7f88a9600640 1 --2- 172.21.15.175:0/1306402074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88a40b4630 0x7f88a414b6e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.311+0000 7f88a9600640 1 -- 172.21.15.175:0/1306402074 >> 172.21.15.175:0/1306402074 conn(0x7f88a406ac50 msgr2=0x7f88a40b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.311+0000 7f88a9600640 1 -- 172.21.15.175:0/1306402074 shutdown_connections 2024-04-25T09:04:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.311+0000 7f88a9600640 1 -- 172.21.15.175:0/1306402074 wait complete. 2024-04-25T09:04:39.321 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-04-25T09:04:39.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.467+0000 7feecd600640 1 Processor -- start 2024-04-25T09:04:39.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.467+0000 7feecd600640 1 -- start start 2024-04-25T09:04:39.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.467+0000 7feecd600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feec806fb60 0x7feec806ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.467+0000 7feecd600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feec806b190 0x7feec80cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.467+0000 7feecd600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec806ffc0 con 0x7feec815dcc0 2024-04-25T09:04:39.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.467+0000 7feecd600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec815e480 con 0x7feec806b190 2024-04-25T09:04:39.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.467+0000 7feecd600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec815e760 con 0x7feec806fb60 2024-04-25T09:04:39.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.467+0000 7feec7400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feec806b190 0x7feec80cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.467+0000 7feec7400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feec806b190 0x7feec80cd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53534/0 (socket says 172.21.15.175:53534) 2024-04-25T09:04:39.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.467+0000 7feec7400640 1 -- 172.21.15.175:0/4179531663 learned_addr learned my addr 172.21.15.175:0/4179531663 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:39.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.467+0000 7feebfe00640 1 --2- 172.21.15.175:0/4179531663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feec806fb60 0x7feec806ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.467+0000 7feec7400640 1 -- 172.21.15.175:0/4179531663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feec806fb60 msgr2=0x7feec806ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:39.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.467+0000 7feec7400640 1 --2- 172.21.15.175:0/4179531663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feec806fb60 0x7feec806ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.467+0000 7feec7400640 1 -- 172.21.15.175:0/4179531663 >> v1:172.21.15.177:6789/0 conn(0x7feec815dcc0 legacy=0x7feec8072ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:39.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.467+0000 7feec7400640 1 -- 172.21.15.175:0/4179531663 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec815ea40 con 0x7feec806b190 2024-04-25T09:04:39.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.467+0000 7feebfe00640 1 --2- 172.21.15.175:0/4179531663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feec806fb60 0x7feec806ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:39.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.471+0000 7feec7400640 1 --2- 172.21.15.175:0/4179531663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec806b190 0x7feec80cd340 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7feec0009e80 tx=0x7feec001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdb9620cb4e61e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:39.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.471+0000 7feec6000640 1 -- 172.21.15.175:0/4179531663 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec00a55c0 con 0x7feec806b190 2024-04-25T09:04:39.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.471+0000 7feec6000640 1 -- 172.21.15.175:0/4179531663 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec00a5760 con 0x7feec806b190 2024-04-25T09:04:39.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.471+0000 7feec6000640 1 -- 172.21.15.175:0/4179531663 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec00a5b30 con 0x7feec806b190 2024-04-25T09:04:39.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.471+0000 7feecd600640 1 -- 172.21.15.175:0/4179531663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec806b190 msgr2=0x7feec80cd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.471+0000 7feecd600640 1 --2- 172.21.15.175:0/4179531663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec806b190 0x7feec80cd340 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7feec0009e80 tx=0x7feec001c940 comp rx=0 tx=0).stop 2024-04-25T09:04:39.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.471+0000 7feecd600640 1 -- 172.21.15.175:0/4179531663 shutdown_connections 2024-04-25T09:04:39.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.471+0000 7feecd600640 1 --2- 172.21.15.175:0/4179531663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec806b190 0x7feec80cd340 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.471+0000 7feecd600640 1 --2- 172.21.15.175:0/4179531663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feec806fb60 0x7feec806ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.471+0000 7feecd600640 1 -- 172.21.15.175:0/4179531663 >> 172.21.15.175:0/4179531663 conn(0x7feec80b2380 msgr2=0x7feec80b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:39.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.471+0000 7feecd600640 1 -- 172.21.15.175:0/4179531663 shutdown_connections 2024-04-25T09:04:39.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.471+0000 7feecd600640 1 -- 172.21.15.175:0/4179531663 wait complete. 2024-04-25T09:04:39.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feecd600640 1 Processor -- start 2024-04-25T09:04:39.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feecd600640 1 -- start start 2024-04-25T09:04:39.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feecd600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feec806b190 0x7feec80c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feecd600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec806fb60 0x7feec815b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feecd600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feec815dcc0 0x7feec815bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feecd600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec815e220 con 0x7feec806fb60 2024-04-25T09:04:39.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feecd600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec815e0a0 con 0x7feec815dcc0 2024-04-25T09:04:39.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feecd600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec816aa30 con 0x7feec806b190 2024-04-25T09:04:39.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feebfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec806fb60 0x7feec815b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feebfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec806fb60 0x7feec815b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53536/0 (socket says 172.21.15.175:53536) 2024-04-25T09:04:39.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feebfe00640 1 -- 172.21.15.175:0/1767457966 learned_addr learned my addr 172.21.15.175:0/1767457966 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:39.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feec6a00640 1 --2- 172.21.15.175:0/1767457966 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feec806b190 0x7feec80c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feec7400640 1 --2- 172.21.15.175:0/1767457966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feec815dcc0 0x7feec815bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feebfe00640 1 -- 172.21.15.175:0/1767457966 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feec806b190 msgr2=0x7feec80c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feebfe00640 1 --2- 172.21.15.175:0/1767457966 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feec806b190 0x7feec80c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feebfe00640 1 -- 172.21.15.175:0/1767457966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feec815dcc0 msgr2=0x7feec815bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feebfe00640 1 --2- 172.21.15.175:0/1767457966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feec815dcc0 0x7feec815bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feebfe00640 1 -- 172.21.15.175:0/1767457966 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8156a80 con 0x7feec806fb60 2024-04-25T09:04:39.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feec6a00640 1 --2- 172.21.15.175:0/1767457966 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feec806b190 0x7feec80c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:39.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feebfe00640 1 --2- 172.21.15.175:0/1767457966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec806fb60 0x7feec815b5c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feeb000c7c0 tx=0x7feeb000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:39.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feebea00640 1 -- 172.21.15.175:0/1767457966 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0007a30 con 0x7feec806fb60 2024-04-25T09:04:39.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feebea00640 1 -- 172.21.15.175:0/1767457966 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb0007bd0 con 0x7feec806fb60 2024-04-25T09:04:39.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feecd600640 1 -- 172.21.15.175:0/1767457966 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec81564c0 con 0x7feec806fb60 2024-04-25T09:04:39.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feebea00640 1 -- 172.21.15.175:0/1767457966 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00113f0 con 0x7feec806fb60 2024-04-25T09:04:39.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feecd600640 1 -- 172.21.15.175:0/1767457966 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec81549e0 con 0x7feec806fb60 2024-04-25T09:04:39.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.475+0000 7feecd600640 1 -- 172.21.15.175:0/1767457966 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec8074a60 con 0x7feec806fb60 2024-04-25T09:04:39.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.479+0000 7feebea00640 1 -- 172.21.15.175:0/1767457966 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feeb0011590 con 0x7feec806fb60 2024-04-25T09:04:39.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.479+0000 7feebea00640 1 --2- 172.21.15.175:0/1767457966 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feea4066f90 0x7feea4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.479+0000 7feebea00640 1 -- 172.21.15.175:0/1767457966 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feeb0085140 con 0x7feec806fb60 2024-04-25T09:04:39.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.479+0000 7feec6a00640 1 --2- 172.21.15.175:0/1767457966 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feea4066f90 0x7feea4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.479+0000 7feec6a00640 1 --2- 172.21.15.175:0/1767457966 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feea4066f90 0x7feea4069450 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7feeb8003ec0 tx=0x7feeb8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:39.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.483+0000 7feebea00640 1 -- 172.21.15.175:0/1767457966 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feeb0015020 con 0x7feec806fb60 2024-04-25T09:04:39.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.691+0000 7feecd600640 1 -- 172.21.15.175:0/1767457966 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7feec80724c0 con 0x7feec806fb60 2024-04-25T09:04:39.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.703+0000 7feebea00640 1 -- 172.21.15.175:0/1767457966 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v54) v1 ==== 145+0+0 (secure 0 0 0) 0x7feeb0055af0 con 0x7feec806fb60 2024-04-25T09:04:39.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.707+0000 7feecd600640 1 -- 172.21.15.175:0/1767457966 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feea4066f90 msgr2=0x7feea4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.707+0000 7feecd600640 1 --2- 172.21.15.175:0/1767457966 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feea4066f90 0x7feea4069450 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7feeb8003ec0 tx=0x7feeb8009040 comp rx=0 tx=0).stop 2024-04-25T09:04:39.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.707+0000 7feecd600640 1 -- 172.21.15.175:0/1767457966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec806fb60 msgr2=0x7feec815b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.707+0000 7feecd600640 1 --2- 172.21.15.175:0/1767457966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec806fb60 0x7feec815b5c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feeb000c7c0 tx=0x7feeb000cc80 comp rx=0 tx=0).stop 2024-04-25T09:04:39.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.707+0000 7feecd600640 1 -- 172.21.15.175:0/1767457966 shutdown_connections 2024-04-25T09:04:39.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.707+0000 7feecd600640 1 --2- 172.21.15.175:0/1767457966 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feea4066f90 0x7feea4069450 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.707+0000 7feecd600640 1 --2- 172.21.15.175:0/1767457966 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feec815dcc0 0x7feec815bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.707+0000 7feecd600640 1 --2- 172.21.15.175:0/1767457966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec806fb60 0x7feec815b5c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.707+0000 7feecd600640 1 --2- 172.21.15.175:0/1767457966 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feec806b190 0x7feec80c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.707+0000 7feecd600640 1 -- 172.21.15.175:0/1767457966 >> 172.21.15.175:0/1767457966 conn(0x7feec80b2380 msgr2=0x7feec80cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:39.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.707+0000 7feecd600640 1 -- 172.21.15.175:0/1767457966 shutdown_connections 2024-04-25T09:04:39.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.707+0000 7feecd600640 1 -- 172.21.15.175:0/1767457966 wait complete. 2024-04-25T09:04:39.717 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:04:39.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.863+0000 7f3e37000640 1 Processor -- start 2024-04-25T09:04:39.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.863+0000 7f3e37000640 1 -- start start 2024-04-25T09:04:39.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.867+0000 7f3e37000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e30099cb0 0x7f3e3006c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.867+0000 7f3e37000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3e3009a090 0x7f3e300cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.867+0000 7f3e37000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3006cef0 con 0x7f3e300b27c0 2024-04-25T09:04:39.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.867+0000 7f3e37000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e300cf8b0 con 0x7f3e3009a090 2024-04-25T09:04:39.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.867+0000 7f3e37000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3006ccb0 con 0x7f3e30099cb0 2024-04-25T09:04:39.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.867+0000 7f3e35200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3e3009a090 0x7f3e300cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.867+0000 7f3e35c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e30099cb0 0x7f3e3006c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.867+0000 7f3e35200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3e3009a090 0x7f3e300cbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:56120/0 (socket says 172.21.15.175:56120) 2024-04-25T09:04:39.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.867+0000 7f3e35200640 1 -- 172.21.15.175:0/2169723861 learned_addr learned my addr 172.21.15.175:0/2169723861 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:39.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.867+0000 7f3e35200640 1 -- 172.21.15.175:0/2169723861 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e30099cb0 msgr2=0x7f3e3006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:39.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.867+0000 7f3e35200640 1 --2- 172.21.15.175:0/2169723861 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e30099cb0 0x7f3e3006c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.867+0000 7f3e35200640 1 -- 172.21.15.175:0/2169723861 >> v1:172.21.15.177:6789/0 conn(0x7f3e300b27c0 legacy=0x7f3e3015d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.867+0000 7f3e35200640 1 -- 172.21.15.175:0/2169723861 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e300cfae0 con 0x7f3e3009a090 2024-04-25T09:04:39.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.867+0000 7f3e35c00640 1 --2- 172.21.15.175:0/2169723861 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e30099cb0 0x7f3e3006c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:39.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.871+0000 7f3e35200640 1 --2- 172.21.15.175:0/2169723861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e3009a090 0x7f3e300cbcc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009870 tx=0x7f3e1c01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc70f0d843e73691 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:39.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.871+0000 7f3e2fe00640 1 -- 172.21.15.175:0/2169723861 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0b0070 con 0x7f3e3009a090 2024-04-25T09:04:39.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.871+0000 7f3e2fe00640 1 -- 172.21.15.175:0/2169723861 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c0ab600 con 0x7f3e3009a090 2024-04-25T09:04:39.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.871+0000 7f3e2fe00640 1 -- 172.21.15.175:0/2169723861 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0ab9d0 con 0x7f3e3009a090 2024-04-25T09:04:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.871+0000 7f3e37000640 1 -- 172.21.15.175:0/2169723861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e3009a090 msgr2=0x7f3e300cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.871+0000 7f3e37000640 1 --2- 172.21.15.175:0/2169723861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e3009a090 0x7f3e300cbcc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009870 tx=0x7f3e1c01c4d0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.871+0000 7f3e37000640 1 -- 172.21.15.175:0/2169723861 shutdown_connections 2024-04-25T09:04:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.871+0000 7f3e37000640 1 --2- 172.21.15.175:0/2169723861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e3009a090 0x7f3e300cbcc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.871+0000 7f3e37000640 1 --2- 172.21.15.175:0/2169723861 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e30099cb0 0x7f3e3006c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.871+0000 7f3e37000640 1 -- 172.21.15.175:0/2169723861 >> 172.21.15.175:0/2169723861 conn(0x7f3e300b3160 msgr2=0x7f3e300b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:39.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.871+0000 7f3e37000640 1 -- 172.21.15.175:0/2169723861 shutdown_connections 2024-04-25T09:04:39.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.871+0000 7f3e37000640 1 -- 172.21.15.175:0/2169723861 wait complete. 2024-04-25T09:04:39.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.871+0000 7f3e37000640 1 Processor -- start 2024-04-25T09:04:39.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.871+0000 7f3e37000640 1 -- start start 2024-04-25T09:04:39.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.871+0000 7f3e37000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e30099cb0 0x7f3e30151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.871+0000 7f3e37000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e3009a090 0x7f3e301555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e37000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e300b27c0 0x7f3e3015b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e37000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300d0f50 con 0x7f3e30099cb0 2024-04-25T09:04:39.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e37000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300d0dd0 con 0x7f3e300b27c0 2024-04-25T09:04:39.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e37000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300d10d0 con 0x7f3e3009a090 2024-04-25T09:04:39.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e35c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e30099cb0 0x7f3e30151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e35c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e30099cb0 0x7f3e30151c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53550/0 (socket says 172.21.15.175:53550) 2024-04-25T09:04:39.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e35c00640 1 -- 172.21.15.175:0/3809493704 learned_addr learned my addr 172.21.15.175:0/3809493704 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:39.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e35200640 1 --2- 172.21.15.175:0/3809493704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e3009a090 0x7f3e301555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e36600640 1 --2- 172.21.15.175:0/3809493704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e300b27c0 0x7f3e3015b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e35c00640 1 -- 172.21.15.175:0/3809493704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e3009a090 msgr2=0x7f3e301555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e35c00640 1 --2- 172.21.15.175:0/3809493704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e3009a090 0x7f3e301555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e35c00640 1 -- 172.21.15.175:0/3809493704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e300b27c0 msgr2=0x7f3e3015b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e35c00640 1 --2- 172.21.15.175:0/3809493704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e300b27c0 0x7f3e3015b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e35c00640 1 -- 172.21.15.175:0/3809493704 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e30152140 con 0x7f3e30099cb0 2024-04-25T09:04:39.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e36600640 1 --2- 172.21.15.175:0/3809493704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e300b27c0 0x7f3e3015b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:39.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e35c00640 1 --2- 172.21.15.175:0/3809493704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e30099cb0 0x7f3e30151c00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400ebe0 tx=0x7f3e2400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:39.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e2d600640 1 -- 172.21.15.175:0/3809493704 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e24017070 con 0x7f3e30099cb0 2024-04-25T09:04:39.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e2d600640 1 -- 172.21.15.175:0/3809493704 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2400cc30 con 0x7f3e30099cb0 2024-04-25T09:04:39.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e37000640 1 -- 172.21.15.175:0/3809493704 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e30158dc0 con 0x7f3e30099cb0 2024-04-25T09:04:39.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e2d600640 1 -- 172.21.15.175:0/3809493704 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e24013470 con 0x7f3e30099cb0 2024-04-25T09:04:39.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e37000640 1 -- 172.21.15.175:0/3809493704 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e30159660 con 0x7f3e30099cb0 2024-04-25T09:04:39.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e37000640 1 -- 172.21.15.175:0/3809493704 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e30074a60 con 0x7f3e30099cb0 2024-04-25T09:04:39.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e2d600640 1 -- 172.21.15.175:0/3809493704 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3e2401a070 con 0x7f3e30099cb0 2024-04-25T09:04:39.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.875+0000 7f3e2d600640 1 --2- 172.21.15.175:0/3809493704 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3e10066f60 0x7f3e10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.879+0000 7f3e2d600640 1 -- 172.21.15.175:0/3809493704 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e240852b0 con 0x7f3e30099cb0 2024-04-25T09:04:39.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.879+0000 7f3e35200640 1 --2- 172.21.15.175:0/3809493704 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3e10066f60 0x7f3e10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.879+0000 7f3e35200640 1 --2- 172.21.15.175:0/3809493704 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3e10066f60 0x7f3e10069420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0ad000 tx=0x7f3e1c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:39.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:39.883+0000 7f3e2d600640 1 -- 172.21.15.175:0/3809493704 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3e24055c60 con 0x7f3e30099cb0 2024-04-25T09:04:40.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.035+0000 7f3e37000640 1 -- 172.21.15.175:0/3809493704 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3e300cbac0 con 0x7f3e30099cb0 2024-04-25T09:04:40.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.039+0000 7f3e2d600640 1 -- 172.21.15.175:0/3809493704 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3e24059d00 con 0x7f3e30099cb0 2024-04-25T09:04:40.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.039+0000 7f3e37000640 1 -- 172.21.15.175:0/3809493704 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3e10066f60 msgr2=0x7f3e10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.039+0000 7f3e37000640 1 --2- 172.21.15.175:0/3809493704 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3e10066f60 0x7f3e10069420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0ad000 tx=0x7f3e1c008040 comp rx=0 tx=0).stop 2024-04-25T09:04:40.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.039+0000 7f3e37000640 1 -- 172.21.15.175:0/3809493704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e30099cb0 msgr2=0x7f3e30151c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.039+0000 7f3e37000640 1 --2- 172.21.15.175:0/3809493704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e30099cb0 0x7f3e30151c00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3e2400ebe0 tx=0x7f3e2400c520 comp rx=0 tx=0).stop 2024-04-25T09:04:40.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.039+0000 7f3e37000640 1 -- 172.21.15.175:0/3809493704 shutdown_connections 2024-04-25T09:04:40.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.039+0000 7f3e37000640 1 --2- 172.21.15.175:0/3809493704 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3e10066f60 0x7f3e10069420 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.039+0000 7f3e37000640 1 --2- 172.21.15.175:0/3809493704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e300b27c0 0x7f3e3015b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.039+0000 7f3e37000640 1 --2- 172.21.15.175:0/3809493704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e3009a090 0x7f3e301555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.039+0000 7f3e37000640 1 --2- 172.21.15.175:0/3809493704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e30099cb0 0x7f3e30151c00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.039+0000 7f3e37000640 1 -- 172.21.15.175:0/3809493704 >> 172.21.15.175:0/3809493704 conn(0x7f3e300b3160 msgr2=0x7f3e3015a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:40.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.039+0000 7f3e37000640 1 -- 172.21.15.175:0/3809493704 shutdown_connections 2024-04-25T09:04:40.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.043+0000 7f3e37000640 1 -- 172.21.15.175:0/3809493704 wait complete. 2024-04-25T09:04:40.052 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:04:40.052 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:04:40.151 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:04:40.219 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:04:40.219 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:04:40.219 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:40.228 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:04:40.228 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:40.280 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:04:40.280 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:40.332 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:40.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.519+0000 7f899e600640 1 Processor -- start 2024-04-25T09:04:40.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.519+0000 7f899e600640 1 -- start start 2024-04-25T09:04:40.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.523+0000 7f899e600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f899815db00 0x7f899806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.523+0000 7f899e600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899806f280 con 0x7f89980acd90 2024-04-25T09:04:40.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.523+0000 7f899e600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899806acf0 con 0x7f8998161e30 2024-04-25T09:04:40.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.523+0000 7f899e600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899806afd0 con 0x7f899815db00 2024-04-25T09:04:40.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.523+0000 7f8996a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f89980acd90 0x7f8998161720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:51278/0 (socket says 172.21.15.175:51278) 2024-04-25T09:04:40.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.523+0000 7f8996a00640 1 -- 172.21.15.175:0/3975204106 learned_addr learned my addr 172.21.15.175:0/3975204106 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:40.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.523+0000 7f8997400640 1 --2- 172.21.15.175:0/3975204106 >> v2:172.21.15.175:3300/0 conn(0x7f899815db00 0x7f899806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.523+0000 7f8996000640 1 -- 172.21.15.175:0/3975204106 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481512798 0 0) 0x7f899806f280 con 0x7f89980acd90 2024-04-25T09:04:40.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.523+0000 7f8996000640 1 -- 172.21.15.175:0/3975204106 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f897c003530 con 0x7f89980acd90 2024-04-25T09:04:40.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.523+0000 7f8997400640 1 -- 172.21.15.175:0/3975204106 >> v1:172.21.15.177:6789/0 conn(0x7f8998161e30 legacy=0x7f899806b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.523+0000 7f8997400640 1 -- 172.21.15.175:0/3975204106 >> v1:172.21.15.175:6789/0 conn(0x7f89980acd90 legacy=0x7f8998161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.523+0000 7f8997400640 1 -- 172.21.15.175:0/3975204106 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899806b2b0 con 0x7f899815db00 2024-04-25T09:04:40.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f8997400640 1 --2- 172.21.15.175:0/3975204106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f899815db00 0x7f899806e9a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f89880097f0 tx=0x7f898801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17ad36b67b486f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:40.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f8996000640 1 -- 172.21.15.175:0/3975204106 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89880b0070 con 0x7f899815db00 2024-04-25T09:04:40.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f8996000640 1 -- 172.21.15.175:0/3975204106 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8988004230 con 0x7f899815db00 2024-04-25T09:04:40.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f8996000640 1 -- 172.21.15.175:0/3975204106 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8988003620 con 0x7f899815db00 2024-04-25T09:04:40.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f899e600640 1 -- 172.21.15.175:0/3975204106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f899815db00 msgr2=0x7f899806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f899e600640 1 --2- 172.21.15.175:0/3975204106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f899815db00 0x7f899806e9a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f89880097f0 tx=0x7f898801c440 comp rx=0 tx=0).stop 2024-04-25T09:04:40.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f899e600640 1 -- 172.21.15.175:0/3975204106 shutdown_connections 2024-04-25T09:04:40.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f899e600640 1 --2- 172.21.15.175:0/3975204106 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f899815db00 0x7f899806e9a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f899e600640 1 -- 172.21.15.175:0/3975204106 >> 172.21.15.175:0/3975204106 conn(0x7f89980b2200 msgr2=0x7f89980cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:40.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f899e600640 1 -- 172.21.15.175:0/3975204106 shutdown_connections 2024-04-25T09:04:40.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f899e600640 1 -- 172.21.15.175:0/3975204106 wait complete. 2024-04-25T09:04:40.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f899e600640 1 Processor -- start 2024-04-25T09:04:40.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f899e600640 1 -- start start 2024-04-25T09:04:40.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f899e600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89980acd90 0x7f899815ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f899e600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f899815db00 0x7f899815c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f899e600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8998161e30 0x7f899814b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f899e600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899816bc50 con 0x7f8998161e30 2024-04-25T09:04:40.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f899e600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899816bad0 con 0x7f89980acd90 2024-04-25T09:04:40.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f899e600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899816bdd0 con 0x7f899815db00 2024-04-25T09:04:40.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.527+0000 7f8997e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8998161e30 0x7f899814b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.531+0000 7f8997e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8998161e30 0x7f899814b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53570/0 (socket says 172.21.15.175:53570) 2024-04-25T09:04:40.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.531+0000 7f8997e00640 1 -- 172.21.15.175:0/559003838 learned_addr learned my addr 172.21.15.175:0/559003838 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:40.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.531+0000 7f8997400640 1 --2- 172.21.15.175:0/559003838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89980acd90 0x7f899815ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.531+0000 7f8996a00640 1 --2- 172.21.15.175:0/559003838 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f899815db00 0x7f899815c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.531+0000 7f8997e00640 1 -- 172.21.15.175:0/559003838 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f899815db00 msgr2=0x7f899815c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.531+0000 7f8997e00640 1 --2- 172.21.15.175:0/559003838 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f899815db00 0x7f899815c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.531+0000 7f8997e00640 1 -- 172.21.15.175:0/559003838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89980acd90 msgr2=0x7f899815ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.531+0000 7f8997e00640 1 --2- 172.21.15.175:0/559003838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89980acd90 0x7f899815ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.531+0000 7f8997e00640 1 -- 172.21.15.175:0/559003838 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89980cc800 con 0x7f8998161e30 2024-04-25T09:04:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.531+0000 7f8997e00640 1 --2- 172.21.15.175:0/559003838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8998161e30 0x7f899814b0b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f899000c730 tx=0x7f899000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.531+0000 7f898f400640 1 -- 172.21.15.175:0/559003838 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8990003b80 con 0x7f8998161e30 2024-04-25T09:04:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.531+0000 7f898f400640 1 -- 172.21.15.175:0/559003838 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8990003d20 con 0x7f8998161e30 2024-04-25T09:04:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.531+0000 7f898f400640 1 -- 172.21.15.175:0/559003838 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899000aa30 con 0x7f8998161e30 2024-04-25T09:04:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.531+0000 7f899e600640 1 -- 172.21.15.175:0/559003838 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89980ccae0 con 0x7f8998161e30 2024-04-25T09:04:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.531+0000 7f899e600640 1 -- 172.21.15.175:0/559003838 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89980cd0a0 con 0x7f8998161e30 2024-04-25T09:04:40.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.531+0000 7f899e600640 1 -- 172.21.15.175:0/559003838 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8998074a60 con 0x7f8998161e30 2024-04-25T09:04:40.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.531+0000 7f898f400640 1 -- 172.21.15.175:0/559003838 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f899000abd0 con 0x7f8998161e30 2024-04-25T09:04:40.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.535+0000 7f898f400640 1 --2- 172.21.15.175:0/559003838 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8978066f60 0x7f8978069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.535+0000 7f898f400640 1 -- 172.21.15.175:0/559003838 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8990084cc0 con 0x7f8998161e30 2024-04-25T09:04:40.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.535+0000 7f8997400640 1 --2- 172.21.15.175:0/559003838 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8978066f60 0x7f8978069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.535+0000 7f8997400640 1 --2- 172.21.15.175:0/559003838 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8978066f60 0x7f8978069420 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f89880ad000 tx=0x7f8988008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:40.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.539+0000 7f898f400640 1 -- 172.21.15.175:0/559003838 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8990055710 con 0x7f8998161e30 2024-04-25T09:04:40.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.691+0000 7f899e600640 1 -- 172.21.15.175:0/559003838 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89980d0ae0 con 0x7f8998161e30 2024-04-25T09:04:40.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.691+0000 7f898f400640 1 -- 172.21.15.175:0/559003838 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f89900597b0 con 0x7f8998161e30 2024-04-25T09:04:40.684 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:40.684 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":20,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:11.440551+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:40.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.695+0000 7f899e600640 1 -- 172.21.15.175:0/559003838 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8978066f60 msgr2=0x7f8978069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.695+0000 7f899e600640 1 --2- 172.21.15.175:0/559003838 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8978066f60 0x7f8978069420 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f89880ad000 tx=0x7f8988008040 comp rx=0 tx=0).stop 2024-04-25T09:04:40.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.695+0000 7f899e600640 1 -- 172.21.15.175:0/559003838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8998161e30 msgr2=0x7f899814b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.695+0000 7f899e600640 1 --2- 172.21.15.175:0/559003838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8998161e30 0x7f899814b0b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f899000c730 tx=0x7f899000cbf0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.695+0000 7f899e600640 1 -- 172.21.15.175:0/559003838 shutdown_connections 2024-04-25T09:04:40.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.695+0000 7f899e600640 1 --2- 172.21.15.175:0/559003838 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8978066f60 0x7f8978069420 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.695+0000 7f899e600640 1 --2- 172.21.15.175:0/559003838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8998161e30 0x7f899814b0b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.695+0000 7f899e600640 1 --2- 172.21.15.175:0/559003838 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f899815db00 0x7f899815c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.695+0000 7f899e600640 1 --2- 172.21.15.175:0/559003838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89980acd90 0x7f899815ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.695+0000 7f899e600640 1 -- 172.21.15.175:0/559003838 >> 172.21.15.175:0/559003838 conn(0x7f89980b2200 msgr2=0x7f899806dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:40.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.695+0000 7f899e600640 1 -- 172.21.15.175:0/559003838 shutdown_connections 2024-04-25T09:04:40.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.695+0000 7f899e600640 1 -- 172.21.15.175:0/559003838 wait complete. 2024-04-25T09:04:40.705 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:08.047706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:04:08.795449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:40.706 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:40.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.850+0000 7face4800640 1 Processor -- start 2024-04-25T09:04:40.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.850+0000 7face4800640 1 -- start start 2024-04-25T09:04:40.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.854+0000 7face4800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7facdc06ad50 0x7facdc06bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.854+0000 7face4800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facdc06c080 0x7facdc06eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.854+0000 7face4800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facdc06de20 con 0x7facdc0cdb60 2024-04-25T09:04:40.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.854+0000 7face4800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facdc15dfe0 con 0x7facdc06ad50 2024-04-25T09:04:40.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.854+0000 7face4800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc06e090 con 0x7facdc06c080 2024-04-25T09:04:40.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.854+0000 7face2800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facdc06c080 0x7facdc06eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.854+0000 7face1400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7facdc06ad50 0x7facdc06bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.854+0000 7face1e00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7facdc0cdb60 0x7facdc0cdf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:57680/0 (socket says 172.21.15.175:57680) 2024-04-25T09:04:40.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.854+0000 7face1e00640 1 -- 172.21.15.175:0/100859489 learned_addr learned my addr 172.21.15.175:0/100859489 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:40.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.854+0000 7face1400640 1 -- 172.21.15.175:0/100859489 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facdc06c080 msgr2=0x7facdc06eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:40.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.854+0000 7face1400640 1 --2- 172.21.15.175:0/100859489 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facdc06c080 0x7facdc06eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.854+0000 7face1400640 1 -- 172.21.15.175:0/100859489 >> v1:172.21.15.177:6789/0 conn(0x7facdc0cdb60 legacy=0x7facdc0cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.854+0000 7face1400640 1 -- 172.21.15.175:0/100859489 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc06e370 con 0x7facdc06ad50 2024-04-25T09:04:40.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.854+0000 7face0a00640 1 -- 172.21.15.175:0/100859489 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065400441 0 0) 0x7facdc06de20 con 0x7facdc0cdb60 2024-04-25T09:04:40.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.858+0000 7face1400640 1 --2- 172.21.15.175:0/100859489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facdc06ad50 0x7facdc06bb40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faccc0097c0 tx=0x7faccc01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1d1fa21d9b57e03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:40.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.858+0000 7face0a00640 1 -- 172.21.15.175:0/100859489 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc0aa5f0 con 0x7facdc06ad50 2024-04-25T09:04:40.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.858+0000 7face0a00640 1 -- 172.21.15.175:0/100859489 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc0af070 con 0x7facdc06ad50 2024-04-25T09:04:40.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.858+0000 7face0a00640 1 -- 172.21.15.175:0/100859489 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc0aa9b0 con 0x7facdc06ad50 2024-04-25T09:04:40.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.858+0000 7face4800640 1 -- 172.21.15.175:0/100859489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facdc06ad50 msgr2=0x7facdc06bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.858+0000 7face4800640 1 --2- 172.21.15.175:0/100859489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facdc06ad50 0x7facdc06bb40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faccc0097c0 tx=0x7faccc01c470 comp rx=0 tx=0).stop 2024-04-25T09:04:40.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.858+0000 7face4800640 1 -- 172.21.15.175:0/100859489 shutdown_connections 2024-04-25T09:04:40.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.858+0000 7face4800640 1 --2- 172.21.15.175:0/100859489 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facdc06c080 0x7facdc06eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.858+0000 7face4800640 1 --2- 172.21.15.175:0/100859489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facdc06ad50 0x7facdc06bb40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.858+0000 7face4800640 1 -- 172.21.15.175:0/100859489 >> 172.21.15.175:0/100859489 conn(0x7facdc0cca10 msgr2=0x7facdc0cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:40.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.858+0000 7face4800640 1 -- 172.21.15.175:0/100859489 shutdown_connections 2024-04-25T09:04:40.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.858+0000 7face4800640 1 -- 172.21.15.175:0/100859489 wait complete. 2024-04-25T09:04:40.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face4800640 1 Processor -- start 2024-04-25T09:04:40.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face4800640 1 -- start start 2024-04-25T09:04:40.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face4800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facdc06ad50 0x7facdc1530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face4800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facdc06c080 0x7facdc0c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face4800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facdc0cdb60 0x7facdc154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face4800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc16aa70 con 0x7facdc06ad50 2024-04-25T09:04:40.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face4800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc0aefd0 con 0x7facdc0cdb60 2024-04-25T09:04:40.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face4800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc16abf0 con 0x7facdc06c080 2024-04-25T09:04:40.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face1e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facdc06ad50 0x7facdc1530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face1e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facdc06ad50 0x7facdc1530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53574/0 (socket says 172.21.15.175:53574) 2024-04-25T09:04:40.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face1e00640 1 -- 172.21.15.175:0/1941850924 learned_addr learned my addr 172.21.15.175:0/1941850924 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:40.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face2800640 1 --2- 172.21.15.175:0/1941850924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facdc0cdb60 0x7facdc154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face1400640 1 --2- 172.21.15.175:0/1941850924 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facdc06c080 0x7facdc0c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face1e00640 1 -- 172.21.15.175:0/1941850924 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facdc06c080 msgr2=0x7facdc0c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face1e00640 1 --2- 172.21.15.175:0/1941850924 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facdc06c080 0x7facdc0c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face1e00640 1 -- 172.21.15.175:0/1941850924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facdc0cdb60 msgr2=0x7facdc154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face1e00640 1 --2- 172.21.15.175:0/1941850924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facdc0cdb60 0x7facdc154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face1e00640 1 -- 172.21.15.175:0/1941850924 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc155280 con 0x7facdc06ad50 2024-04-25T09:04:40.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face2800640 1 --2- 172.21.15.175:0/1941850924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facdc0cdb60 0x7facdc154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:40.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face1e00640 1 --2- 172.21.15.175:0/1941850924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facdc06ad50 0x7facdc1530f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7facd000c480 tx=0x7facd000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:40.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7facd6000640 1 -- 172.21.15.175:0/1941850924 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0018070 con 0x7facdc06ad50 2024-04-25T09:04:40.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7facd6000640 1 -- 172.21.15.175:0/1941850924 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd0007500 con 0x7facdc06ad50 2024-04-25T09:04:40.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face4800640 1 -- 172.21.15.175:0/1941850924 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facdc155560 con 0x7facdc06ad50 2024-04-25T09:04:40.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7facd6000640 1 -- 172.21.15.175:0/1941850924 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd0004a30 con 0x7facdc06ad50 2024-04-25T09:04:40.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face4800640 1 -- 172.21.15.175:0/1941850924 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facdc1f6c80 con 0x7facdc06ad50 2024-04-25T09:04:40.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.862+0000 7face4800640 1 -- 172.21.15.175:0/1941850924 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facdc075160 con 0x7facdc06ad50 2024-04-25T09:04:40.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.866+0000 7facd6000640 1 -- 172.21.15.175:0/1941850924 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7facd001b070 con 0x7facdc06ad50 2024-04-25T09:04:40.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.866+0000 7facd6000640 1 --2- 172.21.15.175:0/1941850924 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7facc0066f60 0x7facc0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.866+0000 7facd6000640 1 -- 172.21.15.175:0/1941850924 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facd0084400 con 0x7facdc06ad50 2024-04-25T09:04:40.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.866+0000 7face1400640 1 --2- 172.21.15.175:0/1941850924 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7facc0066f60 0x7facc0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.866+0000 7face1400640 1 --2- 172.21.15.175:0/1941850924 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7facc0066f60 0x7facc0069420 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faccc0ae000 tx=0x7faccc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:40.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:40.870+0000 7facd6000640 1 -- 172.21.15.175:0/1941850924 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7facd0055400 con 0x7facdc06ad50 2024-04-25T09:04:41.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.026+0000 7face4800640 1 -- 172.21.15.175:0/1941850924 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7facdc066bc0 con 0x7facdc06ad50 2024-04-25T09:04:41.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.026+0000 7facd6000640 1 -- 172.21.15.175:0/1941850924 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7facd0054d00 con 0x7facdc06ad50 2024-04-25T09:04:41.018 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:04:41.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.026+0000 7face4800640 1 -- 172.21.15.175:0/1941850924 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7facc0066f60 msgr2=0x7facc0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.026+0000 7face4800640 1 --2- 172.21.15.175:0/1941850924 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7facc0066f60 0x7facc0069420 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faccc0ae000 tx=0x7faccc0a7000 comp rx=0 tx=0).stop 2024-04-25T09:04:41.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.026+0000 7face4800640 1 -- 172.21.15.175:0/1941850924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facdc06ad50 msgr2=0x7facdc1530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.026+0000 7face4800640 1 --2- 172.21.15.175:0/1941850924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facdc06ad50 0x7facdc1530f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7facd000c480 tx=0x7facd000c940 comp rx=0 tx=0).stop 2024-04-25T09:04:41.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.026+0000 7face4800640 1 -- 172.21.15.175:0/1941850924 shutdown_connections 2024-04-25T09:04:41.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.026+0000 7face4800640 1 --2- 172.21.15.175:0/1941850924 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7facc0066f60 0x7facc0069420 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.026+0000 7face4800640 1 --2- 172.21.15.175:0/1941850924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facdc0cdb60 0x7facdc154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.026+0000 7face4800640 1 --2- 172.21.15.175:0/1941850924 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facdc06c080 0x7facdc0c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.026+0000 7face4800640 1 --2- 172.21.15.175:0/1941850924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facdc06ad50 0x7facdc1530f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.026+0000 7face4800640 1 -- 172.21.15.175:0/1941850924 >> 172.21.15.175:0/1941850924 conn(0x7facdc0cca10 msgr2=0x7facdc0ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.026+0000 7face4800640 1 -- 172.21.15.175:0/1941850924 shutdown_connections 2024-04-25T09:04:41.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.026+0000 7face4800640 1 -- 172.21.15.175:0/1941850924 wait complete. 2024-04-25T09:04:41.039 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:41.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.182+0000 7eff46c00640 1 Processor -- start 2024-04-25T09:04:41.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff46c00640 1 -- start start 2024-04-25T09:04:41.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff46c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7eff400cf080 0x7eff401600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff46c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff400cfd10 con 0x7eff400cf6b0 2024-04-25T09:04:41.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff46c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff400cfff0 con 0x7eff40145250 2024-04-25T09:04:41.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff46c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff401605e0 con 0x7eff400cf080 2024-04-25T09:04:41.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff37400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7eff400cf6b0 0x7eff400ce970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:51282/0 (socket says 172.21.15.175:51282) 2024-04-25T09:04:41.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff37400640 1 -- 172.21.15.175:0/2914918827 learned_addr learned my addr 172.21.15.175:0/2914918827 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:41.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff44c00640 1 --2- 172.21.15.175:0/2914918827 >> v2:172.21.15.177:3300/0 conn(0x7eff400cf080 0x7eff401600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff3f400640 1 -- 172.21.15.175:0/2914918827 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363016246 0 0) 0x7eff400cfd10 con 0x7eff400cf6b0 2024-04-25T09:04:41.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff3f400640 1 -- 172.21.15.175:0/2914918827 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff24003530 con 0x7eff400cf6b0 2024-04-25T09:04:41.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff3f400640 1 -- 172.21.15.175:0/2914918827 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1229531358 0 0) 0x7eff24003530 con 0x7eff400cf6b0 2024-04-25T09:04:41.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff3f400640 1 -- 172.21.15.175:0/2914918827 >> v2:172.21.15.177:3300/0 conn(0x7eff400cf080 msgr2=0x7eff401600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff3f400640 1 --2- 172.21.15.175:0/2914918827 >> v2:172.21.15.177:3300/0 conn(0x7eff400cf080 0x7eff401600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff3f400640 1 -- 172.21.15.175:0/2914918827 >> v1:172.21.15.177:6789/0 conn(0x7eff40145250 legacy=0x7eff400cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff3f400640 1 -- 172.21.15.175:0/2914918827 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4015f8a0 con 0x7eff400cf6b0 2024-04-25T09:04:41.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff3f400640 1 -- 172.21.15.175:0/2914918827 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7eff28001680 con 0x7eff400cf6b0 2024-04-25T09:04:41.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff44c00640 1 --2- 172.21.15.175:0/2914918827 >> v2:172.21.15.177:3300/0 conn(0x7eff400cf080 0x7eff401600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:41.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff3f400640 1 -- 172.21.15.175:0/2914918827 >> v1:172.21.15.175:6789/0 conn(0x7eff400cf6b0 legacy=0x7eff400ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff3f400640 1 --2- 172.21.15.175:0/2914918827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff240039c0 0x7eff24003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff3f400640 1 --2- 172.21.15.175:0/2914918827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff24004810 0x7eff24004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff3f400640 1 --2- 172.21.15.175:0/2914918827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff240051d0 0x7eff2400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff3f400640 1 -- 172.21.15.175:0/2914918827 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff401605e0 con 0x7eff24004810 2024-04-25T09:04:41.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff3f400640 1 -- 172.21.15.175:0/2914918827 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2400c170 con 0x7eff240039c0 2024-04-25T09:04:41.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff3f400640 1 -- 172.21.15.175:0/2914918827 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2400c370 con 0x7eff240051d0 2024-04-25T09:04:41.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff37400640 1 --2- 172.21.15.175:0/2914918827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff24004810 0x7eff24004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff3fe00640 1 --2- 172.21.15.175:0/2914918827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff240039c0 0x7eff24003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff44c00640 1 --2- 172.21.15.175:0/2914918827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff240051d0 0x7eff2400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff37400640 1 -- 172.21.15.175:0/2914918827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff240051d0 msgr2=0x7eff2400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff37400640 1 --2- 172.21.15.175:0/2914918827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff240051d0 0x7eff2400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff37400640 1 -- 172.21.15.175:0/2914918827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff240039c0 msgr2=0x7eff24003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff37400640 1 --2- 172.21.15.175:0/2914918827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff240039c0 0x7eff24003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff37400640 1 -- 172.21.15.175:0/2914918827 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff24003530 con 0x7eff24004810 2024-04-25T09:04:41.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.186+0000 7eff44c00640 1 -- 172.21.15.175:0/2914918827 reap_dead start 2024-04-25T09:04:41.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.190+0000 7eff37400640 1 --2- 172.21.15.175:0/2914918827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff24004810 0x7eff24004c90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7eff2800c1c0 tx=0x7eff2801cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118c8dfeff4adc5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.190+0000 7eff3f400640 1 -- 172.21.15.175:0/2914918827 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff280ac070 con 0x7eff24004810 2024-04-25T09:04:41.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.190+0000 7eff3f400640 1 -- 172.21.15.175:0/2914918827 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff28005b00 con 0x7eff24004810 2024-04-25T09:04:41.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.190+0000 7eff3f400640 1 -- 172.21.15.175:0/2914918827 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff28007d00 con 0x7eff24004810 2024-04-25T09:04:41.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.190+0000 7eff46c00640 1 -- 172.21.15.175:0/2914918827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff24004810 msgr2=0x7eff24004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.190+0000 7eff46c00640 1 --2- 172.21.15.175:0/2914918827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff24004810 0x7eff24004c90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7eff2800c1c0 tx=0x7eff2801cbe0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.190+0000 7eff46c00640 1 -- 172.21.15.175:0/2914918827 shutdown_connections 2024-04-25T09:04:41.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.190+0000 7eff46c00640 1 --2- 172.21.15.175:0/2914918827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff24004810 0x7eff24004c90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.190+0000 7eff46c00640 1 -- 172.21.15.175:0/2914918827 >> 172.21.15.175:0/2914918827 conn(0x7eff4006ac50 msgr2=0x7eff4006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.190+0000 7eff46c00640 1 -- 172.21.15.175:0/2914918827 shutdown_connections 2024-04-25T09:04:41.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.190+0000 7eff46c00640 1 -- 172.21.15.175:0/2914918827 wait complete. 2024-04-25T09:04:41.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff46c00640 1 Processor -- start 2024-04-25T09:04:41.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff46c00640 1 -- start start 2024-04-25T09:04:41.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff46c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff24004810 0x7eff401f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff46c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff4013db80 0x7eff40139490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff46c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4015e210 0x7eff4015e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff46c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4015c870 con 0x7eff4015e210 2024-04-25T09:04:41.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff46c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4015f650 con 0x7eff4013db80 2024-04-25T09:04:41.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff46c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4015c9f0 con 0x7eff24004810 2024-04-25T09:04:41.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff44c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4015e210 0x7eff4015e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff44c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4015e210 0x7eff4015e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53578/0 (socket says 172.21.15.175:53578) 2024-04-25T09:04:41.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff44c00640 1 -- 172.21.15.175:0/3012620513 learned_addr learned my addr 172.21.15.175:0/3012620513 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:41.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff37400640 1 --2- 172.21.15.175:0/3012620513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff4013db80 0x7eff40139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff3fe00640 1 --2- 172.21.15.175:0/3012620513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff24004810 0x7eff401f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff44c00640 1 -- 172.21.15.175:0/3012620513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff24004810 msgr2=0x7eff401f49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff44c00640 1 --2- 172.21.15.175:0/3012620513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff24004810 0x7eff401f49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff44c00640 1 -- 172.21.15.175:0/3012620513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff4013db80 msgr2=0x7eff40139490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff44c00640 1 --2- 172.21.15.175:0/3012620513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff4013db80 0x7eff40139490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff44c00640 1 -- 172.21.15.175:0/3012620513 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff401399d0 con 0x7eff4015e210 2024-04-25T09:04:41.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff44c00640 1 --2- 172.21.15.175:0/3012620513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4015e210 0x7eff4015e690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7eff400cd650 tx=0x7eff38009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff3cc00640 1 -- 172.21.15.175:0/3012620513 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff38011e90 con 0x7eff4015e210 2024-04-25T09:04:41.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff3cc00640 1 -- 172.21.15.175:0/3012620513 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3801b070 con 0x7eff4015e210 2024-04-25T09:04:41.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff46c00640 1 -- 172.21.15.175:0/3012620513 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff401f4fe0 con 0x7eff4015e210 2024-04-25T09:04:41.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff3cc00640 1 -- 172.21.15.175:0/3012620513 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff380039a0 con 0x7eff4015e210 2024-04-25T09:04:41.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff46c00640 1 -- 172.21.15.175:0/3012620513 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff401f55a0 con 0x7eff4015e210 2024-04-25T09:04:41.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.194+0000 7eff46c00640 1 -- 172.21.15.175:0/3012620513 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4015ebd0 con 0x7eff4015e210 2024-04-25T09:04:41.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.198+0000 7eff3cc00640 1 -- 172.21.15.175:0/3012620513 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7eff38003b40 con 0x7eff4015e210 2024-04-25T09:04:41.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.198+0000 7eff3cc00640 1 --2- 172.21.15.175:0/3012620513 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7eff1c067100 0x7eff1c0695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.198+0000 7eff3cc00640 1 -- 172.21.15.175:0/3012620513 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff38085af0 con 0x7eff4015e210 2024-04-25T09:04:41.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.198+0000 7eff3fe00640 1 --2- 172.21.15.175:0/3012620513 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7eff1c067100 0x7eff1c0695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.198+0000 7eff3fe00640 1 --2- 172.21.15.175:0/3012620513 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7eff1c067100 0x7eff1c0695c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7eff30000c10 tx=0x7eff30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.202+0000 7eff3cc00640 1 -- 172.21.15.175:0/3012620513 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7eff38056a60 con 0x7eff4015e210 2024-04-25T09:04:41.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.354+0000 7eff46c00640 1 -- 172.21.15.175:0/3012620513 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff40075160 con 0x7eff4015e210 2024-04-25T09:04:41.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.354+0000 7eff3cc00640 1 -- 172.21.15.175:0/3012620513 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff38056360 con 0x7eff4015e210 2024-04-25T09:04:41.347 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:04:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.354+0000 7eff46c00640 1 -- 172.21.15.175:0/3012620513 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7eff1c067100 msgr2=0x7eff1c0695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.354+0000 7eff46c00640 1 --2- 172.21.15.175:0/3012620513 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7eff1c067100 0x7eff1c0695c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7eff30000c10 tx=0x7eff30009040 comp rx=0 tx=0).stop 2024-04-25T09:04:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.354+0000 7eff46c00640 1 -- 172.21.15.175:0/3012620513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4015e210 msgr2=0x7eff4015e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.354+0000 7eff46c00640 1 --2- 172.21.15.175:0/3012620513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4015e210 0x7eff4015e690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7eff400cd650 tx=0x7eff38009f90 comp rx=0 tx=0).stop 2024-04-25T09:04:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.354+0000 7eff46c00640 1 -- 172.21.15.175:0/3012620513 shutdown_connections 2024-04-25T09:04:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.354+0000 7eff46c00640 1 --2- 172.21.15.175:0/3012620513 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7eff1c067100 0x7eff1c0695c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.354+0000 7eff46c00640 1 --2- 172.21.15.175:0/3012620513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4015e210 0x7eff4015e690 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.354+0000 7eff46c00640 1 --2- 172.21.15.175:0/3012620513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff4013db80 0x7eff40139490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.354+0000 7eff46c00640 1 --2- 172.21.15.175:0/3012620513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff24004810 0x7eff401f49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.354+0000 7eff46c00640 1 -- 172.21.15.175:0/3012620513 >> 172.21.15.175:0/3012620513 conn(0x7eff4006ac50 msgr2=0x7eff4006b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.354+0000 7eff46c00640 1 -- 172.21.15.175:0/3012620513 shutdown_connections 2024-04-25T09:04:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.354+0000 7eff46c00640 1 -- 172.21.15.175:0/3012620513 wait complete. 2024-04-25T09:04:41.367 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:41.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.514+0000 7f8b80800640 1 Processor -- start 2024-04-25T09:04:41.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.514+0000 7f8b80800640 1 -- start start 2024-04-25T09:04:41.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.514+0000 7f8b80800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8b78145250 0x7f8b780cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.514+0000 7f8b80800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b780ce970 0x7f8b780cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.514+0000 7f8b80800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b780cfd10 con 0x7f8b781600a0 2024-04-25T09:04:41.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.514+0000 7f8b80800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7815f650 con 0x7f8b78145250 2024-04-25T09:04:41.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.514+0000 7f8b80800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b780cfff0 con 0x7f8b780ce970 2024-04-25T09:04:41.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.518+0000 7f8b7d400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f8b781600a0 0x7f8b780cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:51294/0 (socket says 172.21.15.175:51294) 2024-04-25T09:04:41.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.518+0000 7f8b7d400640 1 -- 172.21.15.175:0/2400839559 learned_addr learned my addr 172.21.15.175:0/2400839559 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:41.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.518+0000 7f8b7e800640 1 --2- 172.21.15.175:0/2400839559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b780ce970 0x7f8b780cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.518+0000 7f8b7de00640 1 --2- 172.21.15.175:0/2400839559 >> v2:172.21.15.177:3300/0 conn(0x7f8b78145250 0x7f8b780cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.518+0000 7f8b7ca00640 1 -- 172.21.15.175:0/2400839559 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191081817 0 0) 0x7f8b780cfd10 con 0x7f8b781600a0 2024-04-25T09:04:41.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.518+0000 7f8b7ca00640 1 -- 172.21.15.175:0/2400839559 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b60003530 con 0x7f8b781600a0 2024-04-25T09:04:41.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.518+0000 7f8b7ca00640 1 -- 172.21.15.175:0/2400839559 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1860271442 0 0) 0x7f8b60003530 con 0x7f8b781600a0 2024-04-25T09:04:41.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.518+0000 7f8b7de00640 1 -- 172.21.15.175:0/2400839559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b780ce970 msgr2=0x7f8b780cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.518+0000 7f8b7de00640 1 --2- 172.21.15.175:0/2400839559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b780ce970 0x7f8b780cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.518+0000 7f8b7de00640 1 -- 172.21.15.175:0/2400839559 >> v1:172.21.15.175:6789/0 conn(0x7f8b781600a0 legacy=0x7f8b780cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.518+0000 7f8b7de00640 1 -- 172.21.15.175:0/2400839559 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7815f8a0 con 0x7f8b78145250 2024-04-25T09:04:41.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.518+0000 7f8b7e800640 1 --2- 172.21.15.175:0/2400839559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b780ce970 0x7f8b780cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:41.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.518+0000 7f8b7de00640 1 --2- 172.21.15.175:0/2400839559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b78145250 0x7f8b780cf6b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0097f0 tx=0x7f8b6c01c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=433f01922e0575c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b7ca00640 1 -- 172.21.15.175:0/2400839559 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c0b0070 con 0x7f8b78145250 2024-04-25T09:04:41.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b7ca00640 1 -- 172.21.15.175:0/2400839559 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c0ab400 con 0x7f8b78145250 2024-04-25T09:04:41.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b7ca00640 1 -- 172.21.15.175:0/2400839559 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b68001680 con 0x7f8b78145250 2024-04-25T09:04:41.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b80800640 1 -- 172.21.15.175:0/2400839559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b78145250 msgr2=0x7f8b780cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b80800640 1 --2- 172.21.15.175:0/2400839559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b78145250 0x7f8b780cf6b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0097f0 tx=0x7f8b6c01c300 comp rx=0 tx=0).stop 2024-04-25T09:04:41.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b80800640 1 -- 172.21.15.175:0/2400839559 shutdown_connections 2024-04-25T09:04:41.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b80800640 1 --2- 172.21.15.175:0/2400839559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b780ce970 0x7f8b780cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b80800640 1 --2- 172.21.15.175:0/2400839559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b78145250 0x7f8b780cf6b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b80800640 1 -- 172.21.15.175:0/2400839559 >> 172.21.15.175:0/2400839559 conn(0x7f8b7806ac50 msgr2=0x7f8b7806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b80800640 1 -- 172.21.15.175:0/2400839559 shutdown_connections 2024-04-25T09:04:41.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b80800640 1 -- 172.21.15.175:0/2400839559 wait complete. 2024-04-25T09:04:41.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b80800640 1 Processor -- start 2024-04-25T09:04:41.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b80800640 1 -- start start 2024-04-25T09:04:41.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b80800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b780ce970 0x7f8b7813ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b80800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b78145250 0x7f8b7815d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b80800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b781600a0 0x7f8b7813fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b80800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7815c870 con 0x7f8b78145250 2024-04-25T09:04:41.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b80800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b78145630 con 0x7f8b780ce970 2024-04-25T09:04:41.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b80800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7815c9f0 con 0x7f8b781600a0 2024-04-25T09:04:41.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b7d400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b78145250 0x7f8b7815d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b7d400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b78145250 0x7f8b7815d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53584/0 (socket says 172.21.15.175:53584) 2024-04-25T09:04:41.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b7d400640 1 -- 172.21.15.175:0/4258770511 learned_addr learned my addr 172.21.15.175:0/4258770511 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:41.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b7de00640 1 --2- 172.21.15.175:0/4258770511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b780ce970 0x7f8b7813ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.522+0000 7f8b7e800640 1 --2- 172.21.15.175:0/4258770511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b781600a0 0x7f8b7813fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.526+0000 7f8b7d400640 1 -- 172.21.15.175:0/4258770511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b781600a0 msgr2=0x7f8b7813fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.526+0000 7f8b7d400640 1 --2- 172.21.15.175:0/4258770511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b781600a0 0x7f8b7813fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.526+0000 7f8b7d400640 1 -- 172.21.15.175:0/4258770511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b780ce970 msgr2=0x7f8b7813ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.526+0000 7f8b7d400640 1 --2- 172.21.15.175:0/4258770511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b780ce970 0x7f8b7813ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.526+0000 7f8b7d400640 1 -- 172.21.15.175:0/4258770511 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7815e1d0 con 0x7f8b78145250 2024-04-25T09:04:41.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.526+0000 7f8b7e800640 1 --2- 172.21.15.175:0/4258770511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b781600a0 0x7f8b7813fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:41.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.526+0000 7f8b7d400640 1 --2- 172.21.15.175:0/4258770511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b78145250 0x7f8b7815d880 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800c700 tx=0x7f8b6800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.526+0000 7f8b72000640 1 -- 172.21.15.175:0/4258770511 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b68017070 con 0x7f8b78145250 2024-04-25T09:04:41.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.526+0000 7f8b72000640 1 -- 172.21.15.175:0/4258770511 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b68005ae0 con 0x7f8b78145250 2024-04-25T09:04:41.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.526+0000 7f8b72000640 1 -- 172.21.15.175:0/4258770511 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b68007070 con 0x7f8b78145250 2024-04-25T09:04:41.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.526+0000 7f8b80800640 1 -- 172.21.15.175:0/4258770511 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7815e4b0 con 0x7f8b78145250 2024-04-25T09:04:41.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.526+0000 7f8b80800640 1 -- 172.21.15.175:0/4258770511 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b781f73d0 con 0x7f8b78145250 2024-04-25T09:04:41.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.526+0000 7f8b80800640 1 -- 172.21.15.175:0/4258770511 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b78075160 con 0x7f8b78145250 2024-04-25T09:04:41.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.526+0000 7f8b72000640 1 -- 172.21.15.175:0/4258770511 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8b6801a070 con 0x7f8b78145250 2024-04-25T09:04:41.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.526+0000 7f8b72000640 1 --2- 172.21.15.175:0/4258770511 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8b5c066f60 0x7f8b5c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.526+0000 7f8b72000640 1 -- 172.21.15.175:0/4258770511 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b68084470 con 0x7f8b78145250 2024-04-25T09:04:41.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.526+0000 7f8b7de00640 1 --2- 172.21.15.175:0/4258770511 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8b5c066f60 0x7f8b5c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.530+0000 7f8b7de00640 1 --2- 172.21.15.175:0/4258770511 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8b5c066f60 0x7f8b5c069420 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0ad000 tx=0x7f8b6c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.530+0000 7f8b72000640 1 -- 172.21.15.175:0/4258770511 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8b68054d90 con 0x7f8b78145250 2024-04-25T09:04:41.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.686+0000 7f8b80800640 1 -- 172.21.15.175:0/4258770511 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b780cc720 con 0x7f8b78145250 2024-04-25T09:04:41.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.686+0000 7f8b72000640 1 -- 172.21.15.175:0/4258770511 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8b68058e30 con 0x7f8b78145250 2024-04-25T09:04:41.678 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:04:41.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.686+0000 7f8b80800640 1 -- 172.21.15.175:0/4258770511 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8b5c066f60 msgr2=0x7f8b5c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.686+0000 7f8b80800640 1 --2- 172.21.15.175:0/4258770511 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8b5c066f60 0x7f8b5c069420 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0ad000 tx=0x7f8b6c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:04:41.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.686+0000 7f8b80800640 1 -- 172.21.15.175:0/4258770511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b78145250 msgr2=0x7f8b7815d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.686+0000 7f8b80800640 1 --2- 172.21.15.175:0/4258770511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b78145250 0x7f8b7815d880 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8b6800c700 tx=0x7f8b6800cbc0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.686+0000 7f8b80800640 1 -- 172.21.15.175:0/4258770511 shutdown_connections 2024-04-25T09:04:41.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.686+0000 7f8b80800640 1 --2- 172.21.15.175:0/4258770511 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8b5c066f60 0x7f8b5c069420 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.686+0000 7f8b80800640 1 --2- 172.21.15.175:0/4258770511 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b781600a0 0x7f8b7813fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.686+0000 7f8b80800640 1 --2- 172.21.15.175:0/4258770511 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b78145250 0x7f8b7815d880 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.686+0000 7f8b80800640 1 --2- 172.21.15.175:0/4258770511 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b780ce970 0x7f8b7813ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.686+0000 7f8b80800640 1 -- 172.21.15.175:0/4258770511 >> 172.21.15.175:0/4258770511 conn(0x7f8b7806ac50 msgr2=0x7f8b780cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.686+0000 7f8b80800640 1 -- 172.21.15.175:0/4258770511 shutdown_connections 2024-04-25T09:04:41.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.686+0000 7f8b80800640 1 -- 172.21.15.175:0/4258770511 wait complete. 2024-04-25T09:04:41.700 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:04:41.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.842+0000 7f8719200640 1 Processor -- start 2024-04-25T09:04:41.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.842+0000 7f8719200640 1 -- start start 2024-04-25T09:04:41.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.846+0000 7f8719200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8714145250 0x7f87140cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.846+0000 7f8719200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f87141600a0 0x7f87140cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.846+0000 7f8719200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87140ce970 0x7f87140cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.846+0000 7f8719200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871415f650 con 0x7f8714145250 2024-04-25T09:04:41.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.846+0000 7f8719200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87140cfd10 con 0x7f87141600a0 2024-04-25T09:04:41.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.846+0000 7f8719200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87140cfff0 con 0x7f87140ce970 2024-04-25T09:04:41.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.846+0000 7f8711e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8714145250 0x7f87140cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.846+0000 7f8711e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8714145250 0x7f87140cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53594/0 (socket says 172.21.15.175:53594) 2024-04-25T09:04:41.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.846+0000 7f8711e00640 1 -- 172.21.15.175:0/3747385985 learned_addr learned my addr 172.21.15.175:0/3747385985 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:41.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.846+0000 7f8709400640 1 --2- 172.21.15.175:0/3747385985 >> v2:172.21.15.177:3300/0 conn(0x7f87141600a0 0x7f87140cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.846+0000 7f8712800640 1 --2- 172.21.15.175:0/3747385985 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87140ce970 0x7f87140cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.846+0000 7f8711e00640 1 -- 172.21.15.175:0/3747385985 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87140ce970 msgr2=0x7f87140cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.846+0000 7f8711e00640 1 --2- 172.21.15.175:0/3747385985 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87140ce970 0x7f87140cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.846+0000 7f8711e00640 1 -- 172.21.15.175:0/3747385985 >> v2:172.21.15.177:3300/0 conn(0x7f87141600a0 msgr2=0x7f87140cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.846+0000 7f8711e00640 1 --2- 172.21.15.175:0/3747385985 >> v2:172.21.15.177:3300/0 conn(0x7f87141600a0 0x7f87140cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.846+0000 7f8711e00640 1 -- 172.21.15.175:0/3747385985 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871415f8a0 con 0x7f8714145250 2024-04-25T09:04:41.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.850+0000 7f8711e00640 1 --2- 172.21.15.175:0/3747385985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8714145250 0x7f87140cf6b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8704009e50 tx=0x7f870401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe0ee2b90e82ebb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.850+0000 7f8711400640 1 -- 172.21.15.175:0/3747385985 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87040a5860 con 0x7f8714145250 2024-04-25T09:04:41.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.850+0000 7f8711400640 1 -- 172.21.15.175:0/3747385985 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87040a5a00 con 0x7f8714145250 2024-04-25T09:04:41.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.850+0000 7f8711400640 1 -- 172.21.15.175:0/3747385985 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87040a5dd0 con 0x7f8714145250 2024-04-25T09:04:41.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.850+0000 7f8719200640 1 -- 172.21.15.175:0/3747385985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8714145250 msgr2=0x7f87140cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.850+0000 7f8719200640 1 --2- 172.21.15.175:0/3747385985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8714145250 0x7f87140cf6b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8704009e50 tx=0x7f870401c9c0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.850+0000 7f8719200640 1 -- 172.21.15.175:0/3747385985 shutdown_connections 2024-04-25T09:04:41.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.850+0000 7f8719200640 1 --2- 172.21.15.175:0/3747385985 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87140ce970 0x7f87140cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.850+0000 7f8719200640 1 --2- 172.21.15.175:0/3747385985 >> v2:172.21.15.177:3300/0 conn(0x7f87141600a0 0x7f87140cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.850+0000 7f8719200640 1 --2- 172.21.15.175:0/3747385985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8714145250 0x7f87140cf6b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.850+0000 7f8719200640 1 -- 172.21.15.175:0/3747385985 >> 172.21.15.175:0/3747385985 conn(0x7f871406ac50 msgr2=0x7f871406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.850+0000 7f8719200640 1 -- 172.21.15.175:0/3747385985 shutdown_connections 2024-04-25T09:04:41.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.850+0000 7f8719200640 1 -- 172.21.15.175:0/3747385985 wait complete. 2024-04-25T09:04:41.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.850+0000 7f8719200640 1 Processor -- start 2024-04-25T09:04:41.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.850+0000 7f8719200640 1 -- start start 2024-04-25T09:04:41.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8719200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87140ce970 0x7f87140ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8719200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8714145250 0x7f871415e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8719200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87141600a0 0x7f871412fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8719200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87141604b0 con 0x7f8714145250 2024-04-25T09:04:41.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8719200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8714145630 con 0x7f87140ce970 2024-04-25T09:04:41.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8719200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871415c870 con 0x7f87141600a0 2024-04-25T09:04:41.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8709400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8714145250 0x7f871415e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8709400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8714145250 0x7f871415e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53598/0 (socket says 172.21.15.175:53598) 2024-04-25T09:04:41.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8709400640 1 -- 172.21.15.175:0/158626693 learned_addr learned my addr 172.21.15.175:0/158626693 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:41.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8711e00640 1 --2- 172.21.15.175:0/158626693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87140ce970 0x7f87140ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8712800640 1 --2- 172.21.15.175:0/158626693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87141600a0 0x7f871412fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8709400640 1 -- 172.21.15.175:0/158626693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87141600a0 msgr2=0x7f871412fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8709400640 1 --2- 172.21.15.175:0/158626693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87141600a0 0x7f871412fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8709400640 1 -- 172.21.15.175:0/158626693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87140ce970 msgr2=0x7f87140ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8709400640 1 --2- 172.21.15.175:0/158626693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87140ce970 0x7f87140ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8709400640 1 -- 172.21.15.175:0/158626693 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87140ae390 con 0x7f8714145250 2024-04-25T09:04:41.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8711e00640 1 --2- 172.21.15.175:0/158626693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87140ce970 0x7f87140ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:41.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8709400640 1 --2- 172.21.15.175:0/158626693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8714145250 0x7f871415e100 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00d5f0 tx=0x7f86fc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f870aa00640 1 -- 172.21.15.175:0/158626693 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0125f0 con 0x7f8714145250 2024-04-25T09:04:41.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f870aa00640 1 -- 172.21.15.175:0/158626693 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc019070 con 0x7f8714145250 2024-04-25T09:04:41.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f870aa00640 1 -- 172.21.15.175:0/158626693 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0129b0 con 0x7f8714145250 2024-04-25T09:04:41.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8719200640 1 -- 172.21.15.175:0/158626693 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871415e640 con 0x7f8714145250 2024-04-25T09:04:41.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8719200640 1 -- 172.21.15.175:0/158626693 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871415d340 con 0x7f8714145250 2024-04-25T09:04:41.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f8719200640 1 -- 172.21.15.175:0/158626693 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8714075160 con 0x7f8714145250 2024-04-25T09:04:41.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.854+0000 7f870aa00640 1 -- 172.21.15.175:0/158626693 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f86fc012b50 con 0x7f8714145250 2024-04-25T09:04:41.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.858+0000 7f870aa00640 1 --2- 172.21.15.175:0/158626693 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86f0066f60 0x7f86f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.858+0000 7f870aa00640 1 -- 172.21.15.175:0/158626693 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86fc0854e0 con 0x7f8714145250 2024-04-25T09:04:41.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.858+0000 7f8711e00640 1 --2- 172.21.15.175:0/158626693 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86f0066f60 0x7f86f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.858+0000 7f8711e00640 1 --2- 172.21.15.175:0/158626693 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86f0066f60 0x7f86f0069420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f87040ae000 tx=0x7f87040a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:41.862+0000 7f870aa00640 1 -- 172.21.15.175:0/158626693 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f87140ae390 con 0x7f8714145250 2024-04-25T09:04:42.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.026+0000 7f8719200640 1 -- 172.21.15.175:0/158626693 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f87140b01d0 con 0x7f8714145250 2024-04-25T09:04:42.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.026+0000 7f870aa00640 1 -- 172.21.15.175:0/158626693 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f86fc056450 con 0x7f8714145250 2024-04-25T09:04:42.020 INFO:teuthology.orchestra.run.smithi175.stderr:listed 0 entries 2024-04-25T09:04:42.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.030+0000 7f8719200640 1 -- 172.21.15.175:0/158626693 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86f0066f60 msgr2=0x7f86f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.030+0000 7f8719200640 1 --2- 172.21.15.175:0/158626693 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86f0066f60 0x7f86f0069420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f87040ae000 tx=0x7f87040a7070 comp rx=0 tx=0).stop 2024-04-25T09:04:42.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.030+0000 7f8719200640 1 -- 172.21.15.175:0/158626693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8714145250 msgr2=0x7f871415e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.030+0000 7f8719200640 1 --2- 172.21.15.175:0/158626693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8714145250 0x7f871415e100 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00d5f0 tx=0x7f86fc00dab0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.030+0000 7f8719200640 1 -- 172.21.15.175:0/158626693 shutdown_connections 2024-04-25T09:04:42.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.030+0000 7f8719200640 1 --2- 172.21.15.175:0/158626693 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86f0066f60 0x7f86f0069420 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.030+0000 7f8719200640 1 --2- 172.21.15.175:0/158626693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87141600a0 0x7f871412fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.030+0000 7f8719200640 1 --2- 172.21.15.175:0/158626693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8714145250 0x7f871415e100 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.030+0000 7f8719200640 1 --2- 172.21.15.175:0/158626693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87140ce970 0x7f87140ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.030+0000 7f8719200640 1 -- 172.21.15.175:0/158626693 >> 172.21.15.175:0/158626693 conn(0x7f871406ac50 msgr2=0x7f8714140ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.030+0000 7f8719200640 1 -- 172.21.15.175:0/158626693 shutdown_connections 2024-04-25T09:04:42.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.030+0000 7f8719200640 1 -- 172.21.15.175:0/158626693 wait complete. 2024-04-25T09:04:42.041 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:04:42.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:42.042 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-25T09:04:42.075 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:04:42.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:42.076 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:04:42.132 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:04:42.133 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:42.142 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:04:42.142 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:42.196 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:04:42.196 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:42.254 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:42.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40fae00640 1 Processor -- start 2024-04-25T09:04:42.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40fae00640 1 -- start start 2024-04-25T09:04:42.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40fae00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f40f406b0e0 0x7f40f406b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40fae00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40f40b1090 0x7f40f40b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40fae00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f40d01d0 con 0x7f40f40b0c50 2024-04-25T09:04:42.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40fae00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f40b07c0 con 0x7f40f406b0e0 2024-04-25T09:04:42.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40fae00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f40d0450 con 0x7f40f40b1090 2024-04-25T09:04:42.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f3400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f40f40b0c50 0x7f40f40cfac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:51310/0 (socket says 172.21.15.175:51310) 2024-04-25T09:04:42.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f3400640 1 -- 172.21.15.175:0/1534553968 learned_addr learned my addr 172.21.15.175:0/1534553968 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:42.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f8e00640 1 --2- 172.21.15.175:0/1534553968 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40f40b1090 0x7f40f40b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f3e00640 1 --2- 172.21.15.175:0/1534553968 >> v2:172.21.15.177:3300/0 conn(0x7f40f406b0e0 0x7f40f406b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f2a00640 1 -- 172.21.15.175:0/1534553968 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491360332 0 0) 0x7f40e0001120 con 0x7f40f40b0c50 2024-04-25T09:04:42.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f2a00640 1 -- 172.21.15.175:0/1534553968 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40d8003530 con 0x7f40f40b0c50 2024-04-25T09:04:42.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f2a00640 1 -- 172.21.15.175:0/1534553968 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1956077917 0 0) 0x7f40d8003530 con 0x7f40f40b0c50 2024-04-25T09:04:42.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f2a00640 1 -- 172.21.15.175:0/1534553968 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40f40b1090 msgr2=0x7f40f40b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f2a00640 1 --2- 172.21.15.175:0/1534553968 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40f40b1090 0x7f40f40b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f2a00640 1 -- 172.21.15.175:0/1534553968 >> v2:172.21.15.177:3300/0 conn(0x7f40f406b0e0 msgr2=0x7f40f406b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f2a00640 1 --2- 172.21.15.175:0/1534553968 >> v2:172.21.15.177:3300/0 conn(0x7f40f406b0e0 0x7f40f406b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f2a00640 1 -- 172.21.15.175:0/1534553968 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f40afe90 con 0x7f40f40b0c50 2024-04-25T09:04:42.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f2a00640 1 -- 172.21.15.175:0/1534553968 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f40e0001850 con 0x7f40f40b0c50 2024-04-25T09:04:42.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f2a00640 1 -- 172.21.15.175:0/1534553968 >> v1:172.21.15.175:6789/0 conn(0x7f40f40b0c50 legacy=0x7f40f40cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f2a00640 1 --2- 172.21.15.175:0/1534553968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40d80039c0 0x7f40d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f2a00640 1 --2- 172.21.15.175:0/1534553968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40d8004810 0x7f40d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f2a00640 1 --2- 172.21.15.175:0/1534553968 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40f40b1090 0x7f40d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f2a00640 1 -- 172.21.15.175:0/1534553968 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f40b07c0 con 0x7f40d8004810 2024-04-25T09:04:42.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f2a00640 1 -- 172.21.15.175:0/1534553968 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f40d0450 con 0x7f40d80039c0 2024-04-25T09:04:42.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f2a00640 1 -- 172.21.15.175:0/1534553968 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d800ba00 con 0x7f40f40b1090 2024-04-25T09:04:42.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f3e00640 1 --2- 172.21.15.175:0/1534553968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40d80039c0 0x7f40d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f3400640 1 --2- 172.21.15.175:0/1534553968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40d8004810 0x7f40d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f8e00640 1 --2- 172.21.15.175:0/1534553968 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40f40b1090 0x7f40d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f3400640 1 -- 172.21.15.175:0/1534553968 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40f40b1090 msgr2=0x7f40d80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f3400640 1 --2- 172.21.15.175:0/1534553968 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40f40b1090 0x7f40d80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f3400640 1 -- 172.21.15.175:0/1534553968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40d80039c0 msgr2=0x7f40d8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f3400640 1 --2- 172.21.15.175:0/1534553968 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40d80039c0 0x7f40d8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.398+0000 7f40f3400640 1 -- 172.21.15.175:0/1534553968 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d8003530 con 0x7f40d8004810 2024-04-25T09:04:42.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.402+0000 7f40f3400640 1 --2- 172.21.15.175:0/1534553968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40d8004810 0x7f40d8004c90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f40e000c4c0 tx=0x7f40e001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b91b57a08057c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.402+0000 7f40f2a00640 1 -- 172.21.15.175:0/1534553968 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e000c0e0 con 0x7f40d8004810 2024-04-25T09:04:42.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.402+0000 7f40f2a00640 1 -- 172.21.15.175:0/1534553968 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e00a9020 con 0x7f40d8004810 2024-04-25T09:04:42.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.402+0000 7f40f2a00640 1 -- 172.21.15.175:0/1534553968 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e0005b00 con 0x7f40d8004810 2024-04-25T09:04:42.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.402+0000 7f40fae00640 1 -- 172.21.15.175:0/1534553968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40d8004810 msgr2=0x7f40d8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.402+0000 7f40fae00640 1 --2- 172.21.15.175:0/1534553968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40d8004810 0x7f40d8004c90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f40e000c4c0 tx=0x7f40e001ccc0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.402+0000 7f40f8e00640 1 -- 172.21.15.175:0/1534553968 reap_dead start 2024-04-25T09:04:42.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.402+0000 7f40fae00640 1 -- 172.21.15.175:0/1534553968 shutdown_connections 2024-04-25T09:04:42.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.402+0000 7f40fae00640 1 -- 172.21.15.175:0/1534553968 >> 172.21.15.175:0/1534553968 conn(0x7f40f40d06c0 msgr2=0x7f40f40d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.402+0000 7f40fae00640 1 -- 172.21.15.175:0/1534553968 shutdown_connections 2024-04-25T09:04:42.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.402+0000 7f40fae00640 1 -- 172.21.15.175:0/1534553968 wait complete. 2024-04-25T09:04:42.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40fae00640 1 Processor -- start 2024-04-25T09:04:42.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40fae00640 1 -- start start 2024-04-25T09:04:42.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40fae00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40d8004810 0x7f40f41e7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40fae00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40f41f78c0 0x7f40f413f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40fae00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40f41524b0 0x7f40f40af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40fae00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f406ba00 con 0x7f40f41524b0 2024-04-25T09:04:42.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40fae00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f40b0450 con 0x7f40f41f78c0 2024-04-25T09:04:42.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40fae00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f406bb80 con 0x7f40d8004810 2024-04-25T09:04:42.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40f8e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40f41524b0 0x7f40f40af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40f8e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40f41524b0 0x7f40f40af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53606/0 (socket says 172.21.15.175:53606) 2024-04-25T09:04:42.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40f8e00640 1 -- 172.21.15.175:0/3946714594 learned_addr learned my addr 172.21.15.175:0/3946714594 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:42.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40f3e00640 1 --2- 172.21.15.175:0/3946714594 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40d8004810 0x7f40f41e7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40f8e00640 1 -- 172.21.15.175:0/3946714594 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40d8004810 msgr2=0x7f40f41e7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40f8e00640 1 --2- 172.21.15.175:0/3946714594 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40d8004810 0x7f40f41e7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40f8e00640 1 -- 172.21.15.175:0/3946714594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40f41f78c0 msgr2=0x7f40f413f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40f8e00640 1 --2- 172.21.15.175:0/3946714594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40f41f78c0 0x7f40f413f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40f8e00640 1 -- 172.21.15.175:0/3946714594 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f41e7bd0 con 0x7f40f41524b0 2024-04-25T09:04:42.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40f3e00640 1 --2- 172.21.15.175:0/3946714594 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40d8004810 0x7f40f41e7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:42.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40f8e00640 1 --2- 172.21.15.175:0/3946714594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40f41524b0 0x7f40f40af030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f40f40d17c0 tx=0x7f40ec00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40ebe00640 1 -- 172.21.15.175:0/3946714594 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec015430 con 0x7f40f41524b0 2024-04-25T09:04:42.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40ebe00640 1 -- 172.21.15.175:0/3946714594 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ec01d070 con 0x7f40f41524b0 2024-04-25T09:04:42.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40ebe00640 1 -- 172.21.15.175:0/3946714594 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ec015830 con 0x7f40f41524b0 2024-04-25T09:04:42.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40fae00640 1 -- 172.21.15.175:0/3946714594 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f41f7d60 con 0x7f40f41524b0 2024-04-25T09:04:42.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.406+0000 7f40fae00640 1 -- 172.21.15.175:0/3946714594 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f40c46c0 con 0x7f40f41524b0 2024-04-25T09:04:42.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.410+0000 7f40fae00640 1 -- 172.21.15.175:0/3946714594 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f40c41d0 con 0x7f40f41524b0 2024-04-25T09:04:42.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.410+0000 7f40ebe00640 1 -- 172.21.15.175:0/3946714594 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f40ec0159d0 con 0x7f40f41524b0 2024-04-25T09:04:42.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.410+0000 7f40ebe00640 1 --2- 172.21.15.175:0/3946714594 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f40d4066f90 0x7f40d4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.410+0000 7f40ebe00640 1 -- 172.21.15.175:0/3946714594 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40ec0859d0 con 0x7f40f41524b0 2024-04-25T09:04:42.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.410+0000 7f40f3e00640 1 --2- 172.21.15.175:0/3946714594 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f40d4066f90 0x7f40d4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.410+0000 7f40f3e00640 1 --2- 172.21.15.175:0/3946714594 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f40d4066f90 0x7f40d4069450 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f40e4009a60 tx=0x7f40e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.414+0000 7f40ebe00640 1 -- 172.21.15.175:0/3946714594 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f40ec010040 con 0x7f40f41524b0 2024-04-25T09:04:42.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.574+0000 7f40fae00640 1 -- 172.21.15.175:0/3946714594 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40f4074a60 con 0x7f40f41524b0 2024-04-25T09:04:42.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.574+0000 7f40ebe00640 1 -- 172.21.15.175:0/3946714594 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f40ec056940 con 0x7f40f41524b0 2024-04-25T09:04:42.567 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:42.568 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":20,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:11.440551+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:42.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.578+0000 7f40fae00640 1 -- 172.21.15.175:0/3946714594 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f40d4066f90 msgr2=0x7f40d4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.578+0000 7f40fae00640 1 --2- 172.21.15.175:0/3946714594 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f40d4066f90 0x7f40d4069450 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f40e4009a60 tx=0x7f40e4008040 comp rx=0 tx=0).stop 2024-04-25T09:04:42.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.578+0000 7f40fae00640 1 -- 172.21.15.175:0/3946714594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40f41524b0 msgr2=0x7f40f40af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.578+0000 7f40fae00640 1 --2- 172.21.15.175:0/3946714594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40f41524b0 0x7f40f40af030 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f40f40d17c0 tx=0x7f40ec00f580 comp rx=0 tx=0).stop 2024-04-25T09:04:42.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.578+0000 7f40fae00640 1 -- 172.21.15.175:0/3946714594 shutdown_connections 2024-04-25T09:04:42.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.578+0000 7f40fae00640 1 --2- 172.21.15.175:0/3946714594 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f40d4066f90 0x7f40d4069450 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.578+0000 7f40fae00640 1 --2- 172.21.15.175:0/3946714594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f40f41524b0 0x7f40f40af030 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.578+0000 7f40fae00640 1 --2- 172.21.15.175:0/3946714594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40f41f78c0 0x7f40f413f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.578+0000 7f40fae00640 1 --2- 172.21.15.175:0/3946714594 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40d8004810 0x7f40f41e7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.578+0000 7f40fae00640 1 -- 172.21.15.175:0/3946714594 >> 172.21.15.175:0/3946714594 conn(0x7f40f40d06c0 msgr2=0x7f40f40ade70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.578+0000 7f40fae00640 1 -- 172.21.15.175:0/3946714594 shutdown_connections 2024-04-25T09:04:42.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.578+0000 7f40fae00640 1 -- 172.21.15.175:0/3946714594 wait complete. 2024-04-25T09:04:42.589 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:08.047706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:04:08.795449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:42.590 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:42.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.734+0000 7f4702c00640 1 Processor -- start 2024-04-25T09:04:42.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.734+0000 7f4702c00640 1 -- start start 2024-04-25T09:04:42.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f4702c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46fc0719e0 0x7f46fc15aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f4702c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46fc15dd10 con 0x7f46fc0b3230 2024-04-25T09:04:42.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f4702c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46fc15dff0 con 0x7f46fc0b2660 2024-04-25T09:04:42.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f4702c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc15e2d0 con 0x7f46fc0719e0 2024-04-25T09:04:42.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fbe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f46fc0b3230 0x7f46fc0b3d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:51322/0 (socket says 172.21.15.175:51322) 2024-04-25T09:04:42.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fbe00640 1 -- 172.21.15.175:0/144278146 learned_addr learned my addr 172.21.15.175:0/144278146 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:42.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f4700c00640 1 --2- 172.21.15.175:0/144278146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46fc0719e0 0x7f46fc15aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fb400640 1 -- 172.21.15.175:0/144278146 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144461614 0 0) 0x7f46fc15dd10 con 0x7f46fc0b3230 2024-04-25T09:04:42.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fb400640 1 -- 172.21.15.175:0/144278146 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46e0003530 con 0x7f46fc0b3230 2024-04-25T09:04:42.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fb400640 1 -- 172.21.15.175:0/144278146 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2316488082 0 0) 0x7f46e0003530 con 0x7f46fc0b3230 2024-04-25T09:04:42.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fb400640 1 -- 172.21.15.175:0/144278146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46fc0719e0 msgr2=0x7f46fc15aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fb400640 1 --2- 172.21.15.175:0/144278146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46fc0719e0 0x7f46fc15aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fb400640 1 -- 172.21.15.175:0/144278146 >> v1:172.21.15.177:6789/0 conn(0x7f46fc0b2660 legacy=0x7f46fc0712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fb400640 1 -- 172.21.15.175:0/144278146 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc15e5b0 con 0x7f46fc0b3230 2024-04-25T09:04:42.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fb400640 1 -- 172.21.15.175:0/144278146 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f46ec001a00 con 0x7f46fc0b3230 2024-04-25T09:04:42.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fb400640 1 -- 172.21.15.175:0/144278146 >> v1:172.21.15.175:6789/0 conn(0x7f46fc0b3230 legacy=0x7f46fc0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fb400640 1 --2- 172.21.15.175:0/144278146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46e00039f0 0x7f46e0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fb400640 1 --2- 172.21.15.175:0/144278146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e0004810 0x7f46e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fb400640 1 --2- 172.21.15.175:0/144278146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46fc0719e0 0x7f46e00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fb400640 1 -- 172.21.15.175:0/144278146 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc15e2d0 con 0x7f46e00039f0 2024-04-25T09:04:42.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fb400640 1 -- 172.21.15.175:0/144278146 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e000bab0 con 0x7f46e0004810 2024-04-25T09:04:42.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fb400640 1 -- 172.21.15.175:0/144278146 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e000bcb0 con 0x7f46fc0719e0 2024-04-25T09:04:42.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fbe00640 1 --2- 172.21.15.175:0/144278146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46e00039f0 0x7f46e0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46f3400640 1 --2- 172.21.15.175:0/144278146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e0004810 0x7f46e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f4700c00640 1 --2- 172.21.15.175:0/144278146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46fc0719e0 0x7f46e00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fbe00640 1 -- 172.21.15.175:0/144278146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46fc0719e0 msgr2=0x7f46e00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fbe00640 1 --2- 172.21.15.175:0/144278146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46fc0719e0 0x7f46e00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fbe00640 1 -- 172.21.15.175:0/144278146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e0004810 msgr2=0x7f46e0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fbe00640 1 --2- 172.21.15.175:0/144278146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46e0004810 0x7f46e0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.738+0000 7f46fbe00640 1 -- 172.21.15.175:0/144278146 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e0003530 con 0x7f46e00039f0 2024-04-25T09:04:42.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.742+0000 7f46fbe00640 1 --2- 172.21.15.175:0/144278146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46e00039f0 0x7f46e0003e10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00a830 tx=0x7f46ec01d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708a32d5bff7ef8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.742+0000 7f46fb400640 1 -- 172.21.15.175:0/144278146 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec00a480 con 0x7f46e00039f0 2024-04-25T09:04:42.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.742+0000 7f46fb400640 1 -- 172.21.15.175:0/144278146 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ec0ad630 con 0x7f46e00039f0 2024-04-25T09:04:42.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.742+0000 7f46fb400640 1 -- 172.21.15.175:0/144278146 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec0a5e60 con 0x7f46e00039f0 2024-04-25T09:04:42.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.742+0000 7f4702c00640 1 -- 172.21.15.175:0/144278146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46e00039f0 msgr2=0x7f46e0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.742+0000 7f4702c00640 1 --2- 172.21.15.175:0/144278146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46e00039f0 0x7f46e0003e10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f46ec00a830 tx=0x7f46ec01d340 comp rx=0 tx=0).stop 2024-04-25T09:04:42.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.742+0000 7f4700c00640 1 -- 172.21.15.175:0/144278146 reap_dead start 2024-04-25T09:04:42.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.742+0000 7f4702c00640 1 -- 172.21.15.175:0/144278146 shutdown_connections 2024-04-25T09:04:42.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.742+0000 7f4702c00640 1 -- 172.21.15.175:0/144278146 >> 172.21.15.175:0/144278146 conn(0x7f46fc06ac50 msgr2=0x7f46fc06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.742+0000 7f4702c00640 1 -- 172.21.15.175:0/144278146 shutdown_connections 2024-04-25T09:04:42.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.742+0000 7f4702c00640 1 -- 172.21.15.175:0/144278146 wait complete. 2024-04-25T09:04:42.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.742+0000 7f4702c00640 1 Processor -- start 2024-04-25T09:04:42.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.742+0000 7f4702c00640 1 -- start start 2024-04-25T09:04:42.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f4702c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46e00039f0 0x7f46fc14c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f4702c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46fc157220 0x7f46fc1576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f4702c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46fc163250 0x7f46fc163700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f4702c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc0b45b0 con 0x7f46fc163250 2024-04-25T09:04:42.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f4702c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc0b4430 con 0x7f46fc157220 2024-04-25T09:04:42.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f4702c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46fc15aa50 con 0x7f46e00039f0 2024-04-25T09:04:42.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f4700c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46fc163250 0x7f46fc163700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f4700c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46fc163250 0x7f46fc163700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53624/0 (socket says 172.21.15.175:53624) 2024-04-25T09:04:42.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f4700c00640 1 -- 172.21.15.175:0/1568956656 learned_addr learned my addr 172.21.15.175:0/1568956656 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:42.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f46f3400640 1 --2- 172.21.15.175:0/1568956656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46fc157220 0x7f46fc1576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f46fbe00640 1 --2- 172.21.15.175:0/1568956656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46e00039f0 0x7f46fc14c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f4700c00640 1 -- 172.21.15.175:0/1568956656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46e00039f0 msgr2=0x7f46fc14c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f4700c00640 1 --2- 172.21.15.175:0/1568956656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46e00039f0 0x7f46fc14c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f4700c00640 1 -- 172.21.15.175:0/1568956656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46fc157220 msgr2=0x7f46fc1576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f4700c00640 1 --2- 172.21.15.175:0/1568956656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46fc157220 0x7f46fc1576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f4700c00640 1 -- 172.21.15.175:0/1568956656 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc1551a0 con 0x7f46fc163250 2024-04-25T09:04:42.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f4700c00640 1 --2- 172.21.15.175:0/1568956656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46fc163250 0x7f46fc163700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f46fc06f1f0 tx=0x7f46f4010ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f46f8c00640 1 -- 172.21.15.175:0/1568956656 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f400b040 con 0x7f46fc163250 2024-04-25T09:04:42.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f46f8c00640 1 -- 172.21.15.175:0/1568956656 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f4003620 con 0x7f46fc163250 2024-04-25T09:04:42.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f46f8c00640 1 -- 172.21.15.175:0/1568956656 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4003a10 con 0x7f46fc163250 2024-04-25T09:04:42.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f4702c00640 1 -- 172.21.15.175:0/1568956656 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46fc155480 con 0x7f46fc163250 2024-04-25T09:04:42.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f4702c00640 1 -- 172.21.15.175:0/1568956656 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46fc155a40 con 0x7f46fc163250 2024-04-25T09:04:42.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f4702c00640 1 -- 172.21.15.175:0/1568956656 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46fc075160 con 0x7f46fc163250 2024-04-25T09:04:42.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.746+0000 7f46f8c00640 1 -- 172.21.15.175:0/1568956656 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f46f4003bb0 con 0x7f46fc163250 2024-04-25T09:04:42.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.750+0000 7f46f8c00640 1 --2- 172.21.15.175:0/1568956656 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f46d8066f90 0x7f46d8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.750+0000 7f46f8c00640 1 -- 172.21.15.175:0/1568956656 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46f4084d00 con 0x7f46fc163250 2024-04-25T09:04:42.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.750+0000 7f46fbe00640 1 --2- 172.21.15.175:0/1568956656 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f46d8066f90 0x7f46d8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.750+0000 7f46fbe00640 1 --2- 172.21.15.175:0/1568956656 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f46d8066f90 0x7f46d8069450 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0ad000 tx=0x7f46ec0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.754+0000 7f46f8c00640 1 -- 172.21.15.175:0/1568956656 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f46f4022070 con 0x7f46fc163250 2024-04-25T09:04:42.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.914+0000 7f4702c00640 1 -- 172.21.15.175:0/1568956656 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46fc072370 con 0x7f46fc163250 2024-04-25T09:04:42.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.914+0000 7f46f8c00640 1 -- 172.21.15.175:0/1568956656 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f46f40556b0 con 0x7f46fc163250 2024-04-25T09:04:42.906 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:04:42.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.914+0000 7f4702c00640 1 -- 172.21.15.175:0/1568956656 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f46d8066f90 msgr2=0x7f46d8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.914+0000 7f4702c00640 1 --2- 172.21.15.175:0/1568956656 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f46d8066f90 0x7f46d8069450 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f46ec0ad000 tx=0x7f46ec0a7000 comp rx=0 tx=0).stop 2024-04-25T09:04:42.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.914+0000 7f4702c00640 1 -- 172.21.15.175:0/1568956656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46fc163250 msgr2=0x7f46fc163700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.914+0000 7f4702c00640 1 --2- 172.21.15.175:0/1568956656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46fc163250 0x7f46fc163700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f46fc06f1f0 tx=0x7f46f4010ae0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.914+0000 7f4702c00640 1 -- 172.21.15.175:0/1568956656 shutdown_connections 2024-04-25T09:04:42.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.914+0000 7f4702c00640 1 --2- 172.21.15.175:0/1568956656 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f46d8066f90 0x7f46d8069450 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.914+0000 7f4702c00640 1 --2- 172.21.15.175:0/1568956656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46fc163250 0x7f46fc163700 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.914+0000 7f4702c00640 1 --2- 172.21.15.175:0/1568956656 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46fc157220 0x7f46fc1576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.914+0000 7f4702c00640 1 --2- 172.21.15.175:0/1568956656 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46e00039f0 0x7f46fc14c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.914+0000 7f4702c00640 1 -- 172.21.15.175:0/1568956656 >> 172.21.15.175:0/1568956656 conn(0x7f46fc06ac50 msgr2=0x7f46fc154250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.914+0000 7f4702c00640 1 -- 172.21.15.175:0/1568956656 shutdown_connections 2024-04-25T09:04:42.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:42.914+0000 7f4702c00640 1 -- 172.21.15.175:0/1568956656 wait complete. 2024-04-25T09:04:42.927 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:43.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.074+0000 7f1b8a800640 1 Processor -- start 2024-04-25T09:04:43.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.074+0000 7f1b8a800640 1 -- start start 2024-04-25T09:04:43.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.074+0000 7f1b8a800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1b84145250 0x7f1b840cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.074+0000 7f1b8a800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b841600a0 0x7f1b840cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.074+0000 7f1b8a800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1b840ce970 0x7f1b840cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.074+0000 7f1b8a800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8415f650 con 0x7f1b84145250 2024-04-25T09:04:43.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.074+0000 7f1b8a800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b840cfd10 con 0x7f1b840ce970 2024-04-25T09:04:43.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.074+0000 7f1b8a800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b840cfff0 con 0x7f1b841600a0 2024-04-25T09:04:43.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.074+0000 7f1b83400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1b84145250 0x7f1b840cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.074+0000 7f1b83400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1b84145250 0x7f1b840cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53634/0 (socket says 172.21.15.175:53634) 2024-04-25T09:04:43.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.074+0000 7f1b83400640 1 -- 172.21.15.175:0/3015540104 learned_addr learned my addr 172.21.15.175:0/3015540104 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:43.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.074+0000 7f1b83e00640 1 --2- 172.21.15.175:0/3015540104 >> v2:172.21.15.177:3300/0 conn(0x7f1b840ce970 0x7f1b840cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.074+0000 7f1b7aa00640 1 --2- 172.21.15.175:0/3015540104 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b841600a0 0x7f1b840cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.074+0000 7f1b83400640 1 -- 172.21.15.175:0/3015540104 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b841600a0 msgr2=0x7f1b840cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:43.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.074+0000 7f1b83400640 1 --2- 172.21.15.175:0/3015540104 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b841600a0 0x7f1b840cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.074+0000 7f1b83400640 1 -- 172.21.15.175:0/3015540104 >> v2:172.21.15.177:3300/0 conn(0x7f1b840ce970 msgr2=0x7f1b840cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:43.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.074+0000 7f1b83400640 1 --2- 172.21.15.175:0/3015540104 >> v2:172.21.15.177:3300/0 conn(0x7f1b840ce970 0x7f1b840cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.074+0000 7f1b83400640 1 -- 172.21.15.175:0/3015540104 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8415f8a0 con 0x7f1b84145250 2024-04-25T09:04:43.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.078+0000 7f1b83400640 1 --2- 172.21.15.175:0/3015540104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b84145250 0x7f1b840cf6b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1b84071260 tx=0x7f1b7401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46270e2a438cf1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.078+0000 7f1b82a00640 1 -- 172.21.15.175:0/3015540104 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b740aa430 con 0x7f1b84145250 2024-04-25T09:04:43.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.078+0000 7f1b82a00640 1 -- 172.21.15.175:0/3015540104 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b740af070 con 0x7f1b84145250 2024-04-25T09:04:43.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.078+0000 7f1b82a00640 1 -- 172.21.15.175:0/3015540104 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b740aa7f0 con 0x7f1b84145250 2024-04-25T09:04:43.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.078+0000 7f1b8a800640 1 -- 172.21.15.175:0/3015540104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b84145250 msgr2=0x7f1b840cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.078+0000 7f1b8a800640 1 --2- 172.21.15.175:0/3015540104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b84145250 0x7f1b840cf6b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1b84071260 tx=0x7f1b7401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.078+0000 7f1b8a800640 1 -- 172.21.15.175:0/3015540104 shutdown_connections 2024-04-25T09:04:43.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.078+0000 7f1b8a800640 1 --2- 172.21.15.175:0/3015540104 >> v2:172.21.15.177:3300/0 conn(0x7f1b840ce970 0x7f1b840cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.078+0000 7f1b8a800640 1 --2- 172.21.15.175:0/3015540104 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b841600a0 0x7f1b840cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.078+0000 7f1b8a800640 1 --2- 172.21.15.175:0/3015540104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b84145250 0x7f1b840cf6b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.078+0000 7f1b8a800640 1 -- 172.21.15.175:0/3015540104 >> 172.21.15.175:0/3015540104 conn(0x7f1b8406ac50 msgr2=0x7f1b8406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.078+0000 7f1b8a800640 1 -- 172.21.15.175:0/3015540104 shutdown_connections 2024-04-25T09:04:43.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.078+0000 7f1b8a800640 1 -- 172.21.15.175:0/3015540104 wait complete. 2024-04-25T09:04:43.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b8a800640 1 Processor -- start 2024-04-25T09:04:43.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b8a800640 1 -- start start 2024-04-25T09:04:43.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b8a800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b840ce970 0x7f1b84143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b8a800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b84145250 0x7f1b84142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b8a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b841600a0 0x7f1b84165c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b8a800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b84160480 con 0x7f1b841600a0 2024-04-25T09:04:43.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b8a800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b84145630 con 0x7f1b840ce970 2024-04-25T09:04:43.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b8a800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b84160600 con 0x7f1b84145250 2024-04-25T09:04:43.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b83e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b841600a0 0x7f1b84165c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b83e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b841600a0 0x7f1b84165c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53642/0 (socket says 172.21.15.175:53642) 2024-04-25T09:04:43.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b83e00640 1 -- 172.21.15.175:0/2687677939 learned_addr learned my addr 172.21.15.175:0/2687677939 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:43.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b7aa00640 1 --2- 172.21.15.175:0/2687677939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b84145250 0x7f1b84142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b83400640 1 --2- 172.21.15.175:0/2687677939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b840ce970 0x7f1b84143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b83e00640 1 -- 172.21.15.175:0/2687677939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b84145250 msgr2=0x7f1b84142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b83e00640 1 --2- 172.21.15.175:0/2687677939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b84145250 0x7f1b84142870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b83e00640 1 -- 172.21.15.175:0/2687677939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b840ce970 msgr2=0x7f1b84143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b83e00640 1 --2- 172.21.15.175:0/2687677939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b840ce970 0x7f1b84143870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b83e00640 1 -- 172.21.15.175:0/2687677939 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b84141480 con 0x7f1b841600a0 2024-04-25T09:04:43.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b83e00640 1 --2- 172.21.15.175:0/2687677939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b841600a0 0x7f1b84165c60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c007e90 tx=0x7f1b7c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b7be00640 1 -- 172.21.15.175:0/2687677939 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c014420 con 0x7f1b841600a0 2024-04-25T09:04:43.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b7be00640 1 -- 172.21.15.175:0/2687677939 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c019070 con 0x7f1b841600a0 2024-04-25T09:04:43.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b7be00640 1 -- 172.21.15.175:0/2687677939 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c014820 con 0x7f1b841600a0 2024-04-25T09:04:43.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b8a800640 1 -- 172.21.15.175:0/2687677939 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b84141760 con 0x7f1b841600a0 2024-04-25T09:04:43.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.082+0000 7f1b8a800640 1 -- 172.21.15.175:0/2687677939 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b84141d20 con 0x7f1b841600a0 2024-04-25T09:04:43.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.086+0000 7f1b8a800640 1 -- 172.21.15.175:0/2687677939 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b84075160 con 0x7f1b841600a0 2024-04-25T09:04:43.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.086+0000 7f1b7be00640 1 -- 172.21.15.175:0/2687677939 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1b7c0149c0 con 0x7f1b841600a0 2024-04-25T09:04:43.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.086+0000 7f1b7be00640 1 --2- 172.21.15.175:0/2687677939 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1b60066f60 0x7f1b60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.086+0000 7f1b7be00640 1 -- 172.21.15.175:0/2687677939 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b7c085760 con 0x7f1b841600a0 2024-04-25T09:04:43.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.086+0000 7f1b83400640 1 --2- 172.21.15.175:0/2687677939 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1b60066f60 0x7f1b60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.086+0000 7f1b83400640 1 --2- 172.21.15.175:0/2687677939 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1b60066f60 0x7f1b60069420 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1b740ae000 tx=0x7f1b740a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.090+0000 7f1b7be00640 1 -- 172.21.15.175:0/2687677939 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1b7c056110 con 0x7f1b841600a0 2024-04-25T09:04:43.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.242+0000 7f1b8a800640 1 -- 172.21.15.175:0/2687677939 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b84141ef0 con 0x7f1b841600a0 2024-04-25T09:04:43.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.242+0000 7f1b7be00640 1 -- 172.21.15.175:0/2687677939 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b7c05a1b0 con 0x7f1b841600a0 2024-04-25T09:04:43.237 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:04:43.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.246+0000 7f1b8a800640 1 -- 172.21.15.175:0/2687677939 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1b60066f60 msgr2=0x7f1b60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.246+0000 7f1b8a800640 1 --2- 172.21.15.175:0/2687677939 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1b60066f60 0x7f1b60069420 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1b740ae000 tx=0x7f1b740a7000 comp rx=0 tx=0).stop 2024-04-25T09:04:43.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.246+0000 7f1b8a800640 1 -- 172.21.15.175:0/2687677939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b841600a0 msgr2=0x7f1b84165c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.246+0000 7f1b8a800640 1 --2- 172.21.15.175:0/2687677939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b841600a0 0x7f1b84165c60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c007e90 tx=0x7f1b7c00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.246+0000 7f1b8a800640 1 -- 172.21.15.175:0/2687677939 shutdown_connections 2024-04-25T09:04:43.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.246+0000 7f1b8a800640 1 --2- 172.21.15.175:0/2687677939 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1b60066f60 0x7f1b60069420 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.246+0000 7f1b8a800640 1 --2- 172.21.15.175:0/2687677939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b841600a0 0x7f1b84165c60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.246+0000 7f1b8a800640 1 --2- 172.21.15.175:0/2687677939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1b84145250 0x7f1b84142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.246+0000 7f1b8a800640 1 --2- 172.21.15.175:0/2687677939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1b840ce970 0x7f1b84143870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.246+0000 7f1b8a800640 1 -- 172.21.15.175:0/2687677939 >> 172.21.15.175:0/2687677939 conn(0x7f1b8406ac50 msgr2=0x7f1b840cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.246+0000 7f1b8a800640 1 -- 172.21.15.175:0/2687677939 shutdown_connections 2024-04-25T09:04:43.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.246+0000 7f1b8a800640 1 -- 172.21.15.175:0/2687677939 wait complete. 2024-04-25T09:04:43.258 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:43.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.402+0000 7f2542600640 1 Processor -- start 2024-04-25T09:04:43.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.402+0000 7f2542600640 1 -- start start 2024-04-25T09:04:43.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.406+0000 7f2542600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f253c0cf080 0x7f253c1600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.406+0000 7f2542600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253c0cfd10 con 0x7f253c0cf6b0 2024-04-25T09:04:43.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.406+0000 7f2542600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253c0cfff0 con 0x7f253c145250 2024-04-25T09:04:43.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.406+0000 7f2542600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253c1605e0 con 0x7f253c0cf080 2024-04-25T09:04:43.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.406+0000 7f2532a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f253c0cf6b0 0x7f253c0ce970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:51330/0 (socket says 172.21.15.175:51330) 2024-04-25T09:04:43.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.406+0000 7f253be00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f253c0cf080 0x7f253c1600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.406+0000 7f2532a00640 1 -- 172.21.15.175:0/2098352458 learned_addr learned my addr 172.21.15.175:0/2098352458 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:43.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.406+0000 7f253be00640 1 -- 172.21.15.175:0/2098352458 >> v1:172.21.15.177:6789/0 conn(0x7f253c145250 legacy=0x7f253c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.406+0000 7f253be00640 1 -- 172.21.15.175:0/2098352458 >> v1:172.21.15.175:6789/0 conn(0x7f253c0cf6b0 legacy=0x7f253c0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.406+0000 7f253be00640 1 -- 172.21.15.175:0/2098352458 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c15f8a0 con 0x7f253c0cf080 2024-04-25T09:04:43.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.410+0000 7f253be00640 1 --2- 172.21.15.175:0/2098352458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253c0cf080 0x7f253c1600a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f25340097f0 tx=0x7f253401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d36c17376f545c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.410+0000 7f253aa00640 1 -- 172.21.15.175:0/2098352458 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25340b0070 con 0x7f253c0cf080 2024-04-25T09:04:43.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.410+0000 7f253aa00640 1 -- 172.21.15.175:0/2098352458 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25340ab600 con 0x7f253c0cf080 2024-04-25T09:04:43.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.410+0000 7f253aa00640 1 -- 172.21.15.175:0/2098352458 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25340ab9d0 con 0x7f253c0cf080 2024-04-25T09:04:43.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.410+0000 7f2542600640 1 -- 172.21.15.175:0/2098352458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253c0cf080 msgr2=0x7f253c1600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.410+0000 7f2542600640 1 --2- 172.21.15.175:0/2098352458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253c0cf080 0x7f253c1600a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f25340097f0 tx=0x7f253401c410 comp rx=0 tx=0).stop 2024-04-25T09:04:43.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.410+0000 7f2542600640 1 -- 172.21.15.175:0/2098352458 shutdown_connections 2024-04-25T09:04:43.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.410+0000 7f2542600640 1 --2- 172.21.15.175:0/2098352458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253c0cf080 0x7f253c1600a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.410+0000 7f2542600640 1 -- 172.21.15.175:0/2098352458 >> 172.21.15.175:0/2098352458 conn(0x7f253c06ac50 msgr2=0x7f253c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.410+0000 7f2542600640 1 -- 172.21.15.175:0/2098352458 shutdown_connections 2024-04-25T09:04:43.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.410+0000 7f2542600640 1 -- 172.21.15.175:0/2098352458 wait complete. 2024-04-25T09:04:43.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.410+0000 7f2542600640 1 Processor -- start 2024-04-25T09:04:43.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.410+0000 7f2542600640 1 -- start start 2024-04-25T09:04:43.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f2542600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253c0cf080 0x7f253c143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f2542600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f253c0cf6b0 0x7f253c0a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f2542600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f253c145250 0x7f253c15e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f2542600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c15cc80 con 0x7f253c0cf080 2024-04-25T09:04:43.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f2542600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c15cb00 con 0x7f253c145250 2024-04-25T09:04:43.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f2542600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253c1697f0 con 0x7f253c0cf6b0 2024-04-25T09:04:43.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f253b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253c0cf080 0x7f253c143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f253b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253c0cf080 0x7f253c143730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53672/0 (socket says 172.21.15.175:53672) 2024-04-25T09:04:43.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f253b400640 1 -- 172.21.15.175:0/3901103073 learned_addr learned my addr 172.21.15.175:0/3901103073 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:43.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f2532a00640 1 --2- 172.21.15.175:0/3901103073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f253c0cf6b0 0x7f253c0a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f253be00640 1 --2- 172.21.15.175:0/3901103073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f253c145250 0x7f253c15e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f253b400640 1 -- 172.21.15.175:0/3901103073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f253c0cf6b0 msgr2=0x7f253c0a9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f253b400640 1 --2- 172.21.15.175:0/3901103073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f253c0cf6b0 0x7f253c0a9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f253b400640 1 -- 172.21.15.175:0/3901103073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f253c145250 msgr2=0x7f253c15e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f253b400640 1 --2- 172.21.15.175:0/3901103073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f253c145250 0x7f253c15e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f253b400640 1 -- 172.21.15.175:0/3901103073 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c0a8a20 con 0x7f253c0cf080 2024-04-25T09:04:43.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f253b400640 1 --2- 172.21.15.175:0/3901103073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253c0cf080 0x7f253c143730 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f252c00c7f0 tx=0x7f252c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f2533e00640 1 -- 172.21.15.175:0/3901103073 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c003b80 con 0x7f253c0cf080 2024-04-25T09:04:43.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f2533e00640 1 -- 172.21.15.175:0/3901103073 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c003d20 con 0x7f253c0cf080 2024-04-25T09:04:43.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f2542600640 1 -- 172.21.15.175:0/3901103073 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253c0a8d00 con 0x7f253c0cf080 2024-04-25T09:04:43.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f2533e00640 1 -- 172.21.15.175:0/3901103073 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c00aa90 con 0x7f253c0cf080 2024-04-25T09:04:43.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f2542600640 1 -- 172.21.15.175:0/3901103073 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253c0a92c0 con 0x7f253c0cf080 2024-04-25T09:04:43.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f2542600640 1 -- 172.21.15.175:0/3901103073 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253c075160 con 0x7f253c0cf080 2024-04-25T09:04:43.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.414+0000 7f2533e00640 1 -- 172.21.15.175:0/3901103073 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f252c00ac30 con 0x7f253c0cf080 2024-04-25T09:04:43.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.418+0000 7f2533e00640 1 --2- 172.21.15.175:0/3901103073 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2518066f90 0x7f2518069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.418+0000 7f2533e00640 1 -- 172.21.15.175:0/3901103073 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f252c084fa0 con 0x7f253c0cf080 2024-04-25T09:04:43.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.418+0000 7f2532a00640 1 --2- 172.21.15.175:0/3901103073 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2518066f90 0x7f2518069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.418+0000 7f2532a00640 1 --2- 172.21.15.175:0/3901103073 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2518066f90 0x7f2518069450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f253c0cbae0 tx=0x7f2524009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.422+0000 7f2533e00640 1 -- 172.21.15.175:0/3901103073 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f252c055830 con 0x7f253c0cf080 2024-04-25T09:04:43.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.574+0000 7f2542600640 1 -- 172.21.15.175:0/3901103073 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f253c15f000 con 0x7f253c0cf080 2024-04-25T09:04:43.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.574+0000 7f2533e00640 1 -- 172.21.15.175:0/3901103073 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f252c0598d0 con 0x7f253c0cf080 2024-04-25T09:04:43.566 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:04:43.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.574+0000 7f2542600640 1 -- 172.21.15.175:0/3901103073 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2518066f90 msgr2=0x7f2518069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.574+0000 7f2542600640 1 --2- 172.21.15.175:0/3901103073 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2518066f90 0x7f2518069450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f253c0cbae0 tx=0x7f2524009040 comp rx=0 tx=0).stop 2024-04-25T09:04:43.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.574+0000 7f2542600640 1 -- 172.21.15.175:0/3901103073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253c0cf080 msgr2=0x7f253c143730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.574+0000 7f2542600640 1 --2- 172.21.15.175:0/3901103073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253c0cf080 0x7f253c143730 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f252c00c7f0 tx=0x7f252c00ccb0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.574+0000 7f2542600640 1 -- 172.21.15.175:0/3901103073 shutdown_connections 2024-04-25T09:04:43.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.574+0000 7f2542600640 1 --2- 172.21.15.175:0/3901103073 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2518066f90 0x7f2518069450 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.574+0000 7f2542600640 1 --2- 172.21.15.175:0/3901103073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f253c145250 0x7f253c15e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.574+0000 7f2542600640 1 --2- 172.21.15.175:0/3901103073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f253c0cf6b0 0x7f253c0a9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.574+0000 7f2542600640 1 --2- 172.21.15.175:0/3901103073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f253c0cf080 0x7f253c143730 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.574+0000 7f2542600640 1 -- 172.21.15.175:0/3901103073 >> 172.21.15.175:0/3901103073 conn(0x7f253c06ac50 msgr2=0x7f253c13ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.574+0000 7f2542600640 1 -- 172.21.15.175:0/3901103073 shutdown_connections 2024-04-25T09:04:43.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.574+0000 7f2542600640 1 -- 172.21.15.175:0/3901103073 wait complete. 2024-04-25T09:04:43.588 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:04:43.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.730+0000 7fb4ea800640 1 Processor -- start 2024-04-25T09:04:43.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.730+0000 7fb4ea800640 1 -- start start 2024-04-25T09:04:43.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.734+0000 7fb4ea800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb4e4145250 0x7fb4e40cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.734+0000 7fb4ea800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb4e41600a0 0x7fb4e40cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.734+0000 7fb4ea800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e40cfd10 con 0x7fb4e40ce970 2024-04-25T09:04:43.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.734+0000 7fb4ea800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e415f650 con 0x7fb4e4145250 2024-04-25T09:04:43.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.734+0000 7fb4ea800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e40cfff0 con 0x7fb4e41600a0 2024-04-25T09:04:43.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.734+0000 7fb4e3e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb4e40ce970 0x7fb4e40cedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:51342/0 (socket says 172.21.15.175:51342) 2024-04-25T09:04:43.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.734+0000 7fb4e3400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb4e4145250 0x7fb4e40cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.734+0000 7fb4e3e00640 1 -- 172.21.15.175:0/1964942299 learned_addr learned my addr 172.21.15.175:0/1964942299 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:43.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.734+0000 7fb4e3400640 1 -- 172.21.15.175:0/1964942299 >> v2:172.21.15.177:3300/0 conn(0x7fb4e41600a0 msgr2=0x7fb4e40cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:43.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.734+0000 7fb4e3400640 1 --2- 172.21.15.175:0/1964942299 >> v2:172.21.15.177:3300/0 conn(0x7fb4e41600a0 0x7fb4e40cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.734+0000 7fb4e3400640 1 -- 172.21.15.175:0/1964942299 >> v1:172.21.15.175:6789/0 conn(0x7fb4e40ce970 legacy=0x7fb4e40cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.734+0000 7fb4e3400640 1 -- 172.21.15.175:0/1964942299 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e415f8a0 con 0x7fb4e4145250 2024-04-25T09:04:43.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.738+0000 7fb4e3400640 1 --2- 172.21.15.175:0/1964942299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e4145250 0x7fb4e40cf6b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40097c0 tx=0x7fb4d401c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d9882eed937bba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.738+0000 7fb4e2a00640 1 -- 172.21.15.175:0/1964942299 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d40b0070 con 0x7fb4e4145250 2024-04-25T09:04:43.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.738+0000 7fb4e2a00640 1 -- 172.21.15.175:0/1964942299 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d40ab600 con 0x7fb4e4145250 2024-04-25T09:04:43.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.738+0000 7fb4e2a00640 1 -- 172.21.15.175:0/1964942299 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d40ab9d0 con 0x7fb4e4145250 2024-04-25T09:04:43.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.738+0000 7fb4ea800640 1 -- 172.21.15.175:0/1964942299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e4145250 msgr2=0x7fb4e40cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.738+0000 7fb4ea800640 1 --2- 172.21.15.175:0/1964942299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e4145250 0x7fb4e40cf6b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40097c0 tx=0x7fb4d401c2f0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.738+0000 7fb4ea800640 1 -- 172.21.15.175:0/1964942299 shutdown_connections 2024-04-25T09:04:43.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.738+0000 7fb4ea800640 1 --2- 172.21.15.175:0/1964942299 >> v2:172.21.15.177:3300/0 conn(0x7fb4e41600a0 0x7fb4e40cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.738+0000 7fb4ea800640 1 --2- 172.21.15.175:0/1964942299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e4145250 0x7fb4e40cf6b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.738+0000 7fb4ea800640 1 -- 172.21.15.175:0/1964942299 >> 172.21.15.175:0/1964942299 conn(0x7fb4e406ac50 msgr2=0x7fb4e406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.738+0000 7fb4ea800640 1 -- 172.21.15.175:0/1964942299 shutdown_connections 2024-04-25T09:04:43.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.738+0000 7fb4ea800640 1 -- 172.21.15.175:0/1964942299 wait complete. 2024-04-25T09:04:43.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.738+0000 7fb4ea800640 1 Processor -- start 2024-04-25T09:04:43.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.738+0000 7fb4ea800640 1 -- start start 2024-04-25T09:04:43.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4ea800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4e40ce970 0x7fb4e415eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4ea800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4e4145250 0x7fb4e40c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4ea800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e41600a0 0x7fb4e40c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4ea800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e40cc950 con 0x7fb4e41600a0 2024-04-25T09:04:43.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4ea800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e4160530 con 0x7fb4e40ce970 2024-04-25T09:04:43.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4ea800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e4145630 con 0x7fb4e4145250 2024-04-25T09:04:43.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4e3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e41600a0 0x7fb4e40c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4e3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e41600a0 0x7fb4e40c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53696/0 (socket says 172.21.15.175:53696) 2024-04-25T09:04:43.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4e3e00640 1 -- 172.21.15.175:0/2999846513 learned_addr learned my addr 172.21.15.175:0/2999846513 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:43.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4e3400640 1 --2- 172.21.15.175:0/2999846513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4e40ce970 0x7fb4e415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4daa00640 1 --2- 172.21.15.175:0/2999846513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4e4145250 0x7fb4e40c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4e3e00640 1 -- 172.21.15.175:0/2999846513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4e4145250 msgr2=0x7fb4e40c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4e3e00640 1 --2- 172.21.15.175:0/2999846513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4e4145250 0x7fb4e40c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4e3e00640 1 -- 172.21.15.175:0/2999846513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4e40ce970 msgr2=0x7fb4e415eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4e3e00640 1 --2- 172.21.15.175:0/2999846513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4e40ce970 0x7fb4e415eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4e3e00640 1 -- 172.21.15.175:0/2999846513 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e40c61b0 con 0x7fb4e41600a0 2024-04-25T09:04:43.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4daa00640 1 --2- 172.21.15.175:0/2999846513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4e4145250 0x7fb4e40c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:43.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4e3e00640 1 --2- 172.21.15.175:0/2999846513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e41600a0 0x7fb4e40c9420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00e780 tx=0x7fb4dc00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4dbe00640 1 -- 172.21.15.175:0/2999846513 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00f930 con 0x7fb4e41600a0 2024-04-25T09:04:43.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4dbe00640 1 -- 172.21.15.175:0/2999846513 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc013070 con 0x7fb4e41600a0 2024-04-25T09:04:43.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4dbe00640 1 -- 172.21.15.175:0/2999846513 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00fcf0 con 0x7fb4e41600a0 2024-04-25T09:04:43.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4ea800640 1 -- 172.21.15.175:0/2999846513 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e41341f0 con 0x7fb4e41600a0 2024-04-25T09:04:43.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4ea800640 1 -- 172.21.15.175:0/2999846513 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e41347b0 con 0x7fb4e41600a0 2024-04-25T09:04:43.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4ea800640 1 -- 172.21.15.175:0/2999846513 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e4075160 con 0x7fb4e41600a0 2024-04-25T09:04:43.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.742+0000 7fb4dbe00640 1 -- 172.21.15.175:0/2999846513 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb4dc018470 con 0x7fb4e41600a0 2024-04-25T09:04:43.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.746+0000 7fb4dbe00640 1 --2- 172.21.15.175:0/2999846513 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb4c0066f60 0x7fb4c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.746+0000 7fb4dbe00640 1 -- 172.21.15.175:0/2999846513 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4dc087c30 con 0x7fb4e41600a0 2024-04-25T09:04:43.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.746+0000 7fb4e3400640 1 --2- 172.21.15.175:0/2999846513 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb4c0066f60 0x7fb4c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.746+0000 7fb4e3400640 1 --2- 172.21.15.175:0/2999846513 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb4c0066f60 0x7fb4c0069420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40ad000 tx=0x7fb4d40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.750+0000 7fb4dbe00640 1 -- 172.21.15.175:0/2999846513 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb4dc058b10 con 0x7fb4e41600a0 2024-04-25T09:04:43.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.914+0000 7fb4ea800640 1 -- 172.21.15.175:0/2999846513 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb4e4067f00 con 0x7fb4e41600a0 2024-04-25T09:04:43.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.914+0000 7fb4dbe00640 1 -- 172.21.15.175:0/2999846513 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb4dc058410 con 0x7fb4e41600a0 2024-04-25T09:04:43.906 INFO:teuthology.orchestra.run.smithi175.stderr:listed 0 entries 2024-04-25T09:04:43.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.914+0000 7fb4ea800640 1 -- 172.21.15.175:0/2999846513 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb4c0066f60 msgr2=0x7fb4c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.914+0000 7fb4ea800640 1 --2- 172.21.15.175:0/2999846513 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb4c0066f60 0x7fb4c0069420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40ad000 tx=0x7fb4d40a6000 comp rx=0 tx=0).stop 2024-04-25T09:04:43.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.914+0000 7fb4ea800640 1 -- 172.21.15.175:0/2999846513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e41600a0 msgr2=0x7fb4e40c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.914+0000 7fb4ea800640 1 --2- 172.21.15.175:0/2999846513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e41600a0 0x7fb4e40c9420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc00e780 tx=0x7fb4dc00ec40 comp rx=0 tx=0).stop 2024-04-25T09:04:43.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.914+0000 7fb4ea800640 1 -- 172.21.15.175:0/2999846513 shutdown_connections 2024-04-25T09:04:43.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.914+0000 7fb4ea800640 1 --2- 172.21.15.175:0/2999846513 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb4c0066f60 0x7fb4c0069420 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.914+0000 7fb4ea800640 1 --2- 172.21.15.175:0/2999846513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4e41600a0 0x7fb4e40c9420 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.914+0000 7fb4ea800640 1 --2- 172.21.15.175:0/2999846513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb4e4145250 0x7fb4e40c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.914+0000 7fb4ea800640 1 --2- 172.21.15.175:0/2999846513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4e40ce970 0x7fb4e415eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.914+0000 7fb4ea800640 1 -- 172.21.15.175:0/2999846513 >> 172.21.15.175:0/2999846513 conn(0x7fb4e406ac50 msgr2=0x7fb4e406d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.914+0000 7fb4ea800640 1 -- 172.21.15.175:0/2999846513 shutdown_connections 2024-04-25T09:04:43.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:43.914+0000 7fb4ea800640 1 -- 172.21.15.175:0/2999846513 wait complete. 2024-04-25T09:04:43.927 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T09:04:43.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:43.927 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-25T09:04:43.964 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-04-25T09:04:43.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:43.964 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T09:04:44.027 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:04:44.027 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:44.036 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:04:44.036 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:44.088 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:04:44.088 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:44.137 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:44.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.322+0000 7f448f400640 1 Processor -- start 2024-04-25T09:04:44.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.322+0000 7f448f400640 1 -- start start 2024-04-25T09:04:44.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.322+0000 7f448f400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f448815a900 0x7f448806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.322+0000 7f448f400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44880cf560 0x7f44880cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.322+0000 7f448f400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44880cda00 con 0x7f44880cd520 2024-04-25T09:04:44.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.322+0000 7f448f400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448815bcf0 con 0x7f44880cf560 2024-04-25T09:04:44.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.322+0000 7f448f400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44880cfef0 con 0x7f448815a900 2024-04-25T09:04:44.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.322+0000 7f448ca00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f448815a900 0x7f448806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.322+0000 7f448ca00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f448815a900 0x7f448806e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:55326/0 (socket says 172.21.15.175:55326) 2024-04-25T09:04:44.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.322+0000 7f448ca00640 1 -- 172.21.15.175:0/235548579 learned_addr learned my addr 172.21.15.175:0/235548579 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:44.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.322+0000 7f448d400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44880cf560 0x7f44880cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.322+0000 7f447fe00640 1 --1- 172.21.15.175:0/235548579 >> v1:172.21.15.177:6789/0 conn(0x7f44880cd520 0x7f44880ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:57724/0 (socket says 172.21.15.175:57724) 2024-04-25T09:04:44.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.322+0000 7f448ca00640 1 -- 172.21.15.175:0/235548579 >> v2:172.21.15.177:3300/0 conn(0x7f44880cf560 msgr2=0x7f44880cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:44.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.322+0000 7f448ca00640 1 --2- 172.21.15.175:0/235548579 >> v2:172.21.15.177:3300/0 conn(0x7f44880cf560 0x7f44880cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.322+0000 7f448ca00640 1 -- 172.21.15.175:0/235548579 >> v1:172.21.15.177:6789/0 conn(0x7f44880cd520 legacy=0x7f44880ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.326+0000 7f448ca00640 1 -- 172.21.15.175:0/235548579 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44880cdce0 con 0x7f448815a900 2024-04-25T09:04:44.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.326+0000 7f448d400640 1 --2- 172.21.15.175:0/235548579 >> v2:172.21.15.177:3300/0 conn(0x7f44880cf560 0x7f44880cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:44.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.322+0000 7f4487e00640 1 -- 172.21.15.175:0/235548579 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849296493 0 0) 0x7f44880cda00 con 0x7f44880cd520 2024-04-25T09:04:44.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.326+0000 7f448ca00640 1 --2- 172.21.15.175:0/235548579 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f448815a900 0x7f448806e150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4478009870 tx=0x7f447801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f1232e46b4e5722 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:44.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.326+0000 7f4487e00640 1 -- 172.21.15.175:0/235548579 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44780ab650 con 0x7f448815a900 2024-04-25T09:04:44.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.326+0000 7f4487e00640 1 -- 172.21.15.175:0/235548579 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44780b0070 con 0x7f448815a900 2024-04-25T09:04:44.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.326+0000 7f4487e00640 1 -- 172.21.15.175:0/235548579 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44780aba10 con 0x7f448815a900 2024-04-25T09:04:44.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.326+0000 7f448f400640 1 -- 172.21.15.175:0/235548579 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f448815a900 msgr2=0x7f448806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.326+0000 7f448f400640 1 --2- 172.21.15.175:0/235548579 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f448815a900 0x7f448806e150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4478009870 tx=0x7f447801c560 comp rx=0 tx=0).stop 2024-04-25T09:04:44.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.326+0000 7f448f400640 1 -- 172.21.15.175:0/235548579 shutdown_connections 2024-04-25T09:04:44.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.326+0000 7f448f400640 1 --2- 172.21.15.175:0/235548579 >> v2:172.21.15.177:3300/0 conn(0x7f44880cf560 0x7f44880cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.326+0000 7f448f400640 1 --2- 172.21.15.175:0/235548579 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f448815a900 0x7f448806e150 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.326+0000 7f448f400640 1 -- 172.21.15.175:0/235548579 >> 172.21.15.175:0/235548579 conn(0x7f4488067150 msgr2=0x7f448806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:44.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.326+0000 7f448f400640 1 -- 172.21.15.175:0/235548579 shutdown_connections 2024-04-25T09:04:44.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448f400640 1 -- 172.21.15.175:0/235548579 wait complete. 2024-04-25T09:04:44.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448f400640 1 Processor -- start 2024-04-25T09:04:44.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448f400640 1 -- start start 2024-04-25T09:04:44.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44880cf560 0x7f44881459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448f400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f448815a900 0x7f4488158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4488158cd0 0x7f44880b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448f400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448806d530 con 0x7f44880cf560 2024-04-25T09:04:44.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448f400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448806d3b0 con 0x7f4488158cd0 2024-04-25T09:04:44.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448f400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448815c790 con 0x7f448815a900 2024-04-25T09:04:44.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448ca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44880cf560 0x7f44881459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448ca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44880cf560 0x7f44881459d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53700/0 (socket says 172.21.15.175:53700) 2024-04-25T09:04:44.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448ca00640 1 -- 172.21.15.175:0/750336651 learned_addr learned my addr 172.21.15.175:0/750336651 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:44.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f447fe00640 1 --2- 172.21.15.175:0/750336651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f448815a900 0x7f4488158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448d400640 1 --2- 172.21.15.175:0/750336651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4488158cd0 0x7f44880b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448ca00640 1 -- 172.21.15.175:0/750336651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f448815a900 msgr2=0x7f4488158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448ca00640 1 --2- 172.21.15.175:0/750336651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f448815a900 0x7f4488158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448ca00640 1 -- 172.21.15.175:0/750336651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4488158cd0 msgr2=0x7f44880b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448ca00640 1 --2- 172.21.15.175:0/750336651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4488158cd0 0x7f44880b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448ca00640 1 -- 172.21.15.175:0/750336651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44880b1910 con 0x7f44880cf560 2024-04-25T09:04:44.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448d400640 1 --2- 172.21.15.175:0/750336651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4488158cd0 0x7f44880b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:44.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f448ca00640 1 --2- 172.21.15.175:0/750336651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44880cf560 0x7f44881459d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f447801ac10 tx=0x7f4478019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:44.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.330+0000 7f4485600640 1 -- 172.21.15.175:0/750336651 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44780bf610 con 0x7f44880cf560 2024-04-25T09:04:44.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.334+0000 7f4485600640 1 -- 172.21.15.175:0/750336651 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44780bf7d0 con 0x7f44880cf560 2024-04-25T09:04:44.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.334+0000 7f4485600640 1 -- 172.21.15.175:0/750336651 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44780bfbc0 con 0x7f44880cf560 2024-04-25T09:04:44.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.334+0000 7f448f400640 1 -- 172.21.15.175:0/750336651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44880b1350 con 0x7f44880cf560 2024-04-25T09:04:44.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.334+0000 7f448f400640 1 -- 172.21.15.175:0/750336651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448814b200 con 0x7f44880cf560 2024-04-25T09:04:44.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.334+0000 7f448f400640 1 -- 172.21.15.175:0/750336651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44881590e0 con 0x7f44880cf560 2024-04-25T09:04:44.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.334+0000 7f4485600640 1 -- 172.21.15.175:0/750336651 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f44780bd020 con 0x7f44880cf560 2024-04-25T09:04:44.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.334+0000 7f4485600640 1 --2- 172.21.15.175:0/750336651 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4464066f60 0x7f4464069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.334+0000 7f4485600640 1 -- 172.21.15.175:0/750336651 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f447811f380 con 0x7f44880cf560 2024-04-25T09:04:44.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.334+0000 7f447fe00640 1 --2- 172.21.15.175:0/750336651 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4464066f60 0x7f4464069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.334+0000 7f447fe00640 1 --2- 172.21.15.175:0/750336651 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4464066f60 0x7f4464069420 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f44881f9bc0 tx=0x7f4470007b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:44.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.338+0000 7f4485600640 1 -- 172.21.15.175:0/750336651 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f44881590e0 con 0x7f44880cf560 2024-04-25T09:04:44.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.494+0000 7f448f400640 1 -- 172.21.15.175:0/750336651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4488074a60 con 0x7f44880cf560 2024-04-25T09:04:44.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.494+0000 7f4485600640 1 -- 172.21.15.175:0/750336651 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f44780c6070 con 0x7f44880cf560 2024-04-25T09:04:44.487 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:44.488 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":20,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:11.440551+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:44.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.498+0000 7f448f400640 1 -- 172.21.15.175:0/750336651 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4464066f60 msgr2=0x7f4464069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.498+0000 7f448f400640 1 --2- 172.21.15.175:0/750336651 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4464066f60 0x7f4464069420 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f44881f9bc0 tx=0x7f4470007b60 comp rx=0 tx=0).stop 2024-04-25T09:04:44.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.498+0000 7f448f400640 1 -- 172.21.15.175:0/750336651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44880cf560 msgr2=0x7f44881459d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.498+0000 7f448f400640 1 --2- 172.21.15.175:0/750336651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44880cf560 0x7f44881459d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f447801ac10 tx=0x7f4478019300 comp rx=0 tx=0).stop 2024-04-25T09:04:44.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.498+0000 7f448f400640 1 -- 172.21.15.175:0/750336651 shutdown_connections 2024-04-25T09:04:44.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.498+0000 7f448f400640 1 --2- 172.21.15.175:0/750336651 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4464066f60 0x7f4464069420 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.498+0000 7f448f400640 1 --2- 172.21.15.175:0/750336651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4488158cd0 0x7f44880b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.498+0000 7f448f400640 1 --2- 172.21.15.175:0/750336651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f448815a900 0x7f4488158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.498+0000 7f448f400640 1 --2- 172.21.15.175:0/750336651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44880cf560 0x7f44881459d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.498+0000 7f448f400640 1 -- 172.21.15.175:0/750336651 >> 172.21.15.175:0/750336651 conn(0x7f44880cd520 msgr2=0x7f44880b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:44.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.498+0000 7f448f400640 1 -- 172.21.15.175:0/750336651 shutdown_connections 2024-04-25T09:04:44.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.498+0000 7f448f400640 1 -- 172.21.15.175:0/750336651 wait complete. 2024-04-25T09:04:44.508 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:08.047706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:04:08.795449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:44.509 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:44.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.654+0000 7fd395600640 1 Processor -- start 2024-04-25T09:04:44.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.654+0000 7fd395600640 1 -- start start 2024-04-25T09:04:44.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.654+0000 7fd395600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd390145250 0x7fd3900cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.654+0000 7fd395600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd3901600a0 0x7fd3900cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.654+0000 7fd395600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3900cfd10 con 0x7fd3900ce970 2024-04-25T09:04:44.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.654+0000 7fd395600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39015f650 con 0x7fd3901600a0 2024-04-25T09:04:44.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.654+0000 7fd395600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3900cfff0 con 0x7fd390145250 2024-04-25T09:04:44.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.654+0000 7fd38e000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd3901600a0 0x7fd3900cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.654+0000 7fd38f400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd3900ce970 0x7fd3900cedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:51354/0 (socket says 172.21.15.175:51354) 2024-04-25T09:04:44.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.654+0000 7fd38f400640 1 -- 172.21.15.175:0/3540381688 learned_addr learned my addr 172.21.15.175:0/3540381688 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:44.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.654+0000 7fd38ea00640 1 --2- 172.21.15.175:0/3540381688 >> v2:172.21.15.177:3300/0 conn(0x7fd390145250 0x7fd3900cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.654+0000 7fd38e000640 1 -- 172.21.15.175:0/3540381688 >> v2:172.21.15.177:3300/0 conn(0x7fd390145250 msgr2=0x7fd3900cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:44.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.654+0000 7fd38e000640 1 --2- 172.21.15.175:0/3540381688 >> v2:172.21.15.177:3300/0 conn(0x7fd390145250 0x7fd3900cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.654+0000 7fd38e000640 1 -- 172.21.15.175:0/3540381688 >> v1:172.21.15.175:6789/0 conn(0x7fd3900ce970 legacy=0x7fd3900cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.658+0000 7fd38e000640 1 -- 172.21.15.175:0/3540381688 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39015f8a0 con 0x7fd3901600a0 2024-04-25T09:04:44.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.654+0000 7fd38d600640 1 -- 172.21.15.175:0/3540381688 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907184340 0 0) 0x7fd3900cfd10 con 0x7fd3900ce970 2024-04-25T09:04:44.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.658+0000 7fd38ea00640 1 --2- 172.21.15.175:0/3540381688 >> v2:172.21.15.177:3300/0 conn(0x7fd390145250 0x7fd3900cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:44.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.658+0000 7fd38e000640 1 --2- 172.21.15.175:0/3540381688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3901600a0 0x7fd3900cc410 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0097c0 tx=0x7fd37c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=961c17c7444c5bb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:44.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.658+0000 7fd38d600640 1 -- 172.21.15.175:0/3540381688 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c0ab610 con 0x7fd3901600a0 2024-04-25T09:04:44.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.658+0000 7fd38d600640 1 -- 172.21.15.175:0/3540381688 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c0b0070 con 0x7fd3901600a0 2024-04-25T09:04:44.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.658+0000 7fd38d600640 1 -- 172.21.15.175:0/3540381688 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c0ab9d0 con 0x7fd3901600a0 2024-04-25T09:04:44.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.658+0000 7fd395600640 1 -- 172.21.15.175:0/3540381688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3901600a0 msgr2=0x7fd3900cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.658+0000 7fd395600640 1 --2- 172.21.15.175:0/3540381688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3901600a0 0x7fd3900cc410 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0097c0 tx=0x7fd37c01c430 comp rx=0 tx=0).stop 2024-04-25T09:04:44.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.658+0000 7fd395600640 1 -- 172.21.15.175:0/3540381688 shutdown_connections 2024-04-25T09:04:44.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.658+0000 7fd395600640 1 --2- 172.21.15.175:0/3540381688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3901600a0 0x7fd3900cc410 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.658+0000 7fd395600640 1 --2- 172.21.15.175:0/3540381688 >> v2:172.21.15.177:3300/0 conn(0x7fd390145250 0x7fd3900cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.658+0000 7fd395600640 1 -- 172.21.15.175:0/3540381688 >> 172.21.15.175:0/3540381688 conn(0x7fd39006ac50 msgr2=0x7fd39006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:44.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.658+0000 7fd395600640 1 -- 172.21.15.175:0/3540381688 shutdown_connections 2024-04-25T09:04:44.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.658+0000 7fd395600640 1 -- 172.21.15.175:0/3540381688 wait complete. 2024-04-25T09:04:44.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd395600640 1 Processor -- start 2024-04-25T09:04:44.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd395600640 1 -- start start 2024-04-25T09:04:44.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd395600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3900ce970 0x7fd3900a9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd395600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd390145250 0x7fd390071530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd395600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3901600a0 0x7fd3900ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd395600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39015c870 con 0x7fd3900ce970 2024-04-25T09:04:44.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd395600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd390145630 con 0x7fd3901600a0 2024-04-25T09:04:44.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd395600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39015c9f0 con 0x7fd390145250 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd38ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3900ce970 0x7fd3900a9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd38ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3900ce970 0x7fd3900a9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53722/0 (socket says 172.21.15.175:53722) 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd38ea00640 1 -- 172.21.15.175:0/1507728321 learned_addr learned my addr 172.21.15.175:0/1507728321 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd38ea00640 1 -- 172.21.15.175:0/1507728321 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd390145250 msgr2=0x7fd390071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd38ea00640 1 --2- 172.21.15.175:0/1507728321 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd390145250 0x7fd390071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd38ea00640 1 -- 172.21.15.175:0/1507728321 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3901600a0 msgr2=0x7fd3900ae3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd38ea00640 1 --2- 172.21.15.175:0/1507728321 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3901600a0 0x7fd3900ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd38ea00640 1 -- 172.21.15.175:0/1507728321 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3900ac7d0 con 0x7fd3900ce970 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd38ea00640 1 --2- 172.21.15.175:0/1507728321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3900ce970 0x7fd3900a9500 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd380009fc0 tx=0x7fd38000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd386a00640 1 -- 172.21.15.175:0/1507728321 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38001a070 con 0x7fd3900ce970 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd386a00640 1 -- 172.21.15.175:0/1507728321 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd380003bc0 con 0x7fd3900ce970 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd395600640 1 -- 172.21.15.175:0/1507728321 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3900acab0 con 0x7fd3900ce970 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd386a00640 1 -- 172.21.15.175:0/1507728321 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380004030 con 0x7fd3900ce970 2024-04-25T09:04:44.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.662+0000 7fd395600640 1 -- 172.21.15.175:0/1507728321 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd390071a70 con 0x7fd3900ce970 2024-04-25T09:04:44.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.666+0000 7fd395600640 1 -- 172.21.15.175:0/1507728321 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd390075160 con 0x7fd3900ce970 2024-04-25T09:04:44.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.666+0000 7fd386a00640 1 -- 172.21.15.175:0/1507728321 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd38001d070 con 0x7fd3900ce970 2024-04-25T09:04:44.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.666+0000 7fd386a00640 1 --2- 172.21.15.175:0/1507728321 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd370066f60 0x7fd370069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.666+0000 7fd386a00640 1 -- 172.21.15.175:0/1507728321 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3800851c0 con 0x7fd3900ce970 2024-04-25T09:04:44.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.666+0000 7fd38e000640 1 --2- 172.21.15.175:0/1507728321 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd370066f60 0x7fd370069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.666+0000 7fd38e000640 1 --2- 172.21.15.175:0/1507728321 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd370066f60 0x7fd370069420 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0af000 tx=0x7fd37c004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:44.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.670+0000 7fd386a00640 1 -- 172.21.15.175:0/1507728321 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd380010070 con 0x7fd3900ce970 2024-04-25T09:04:44.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.830+0000 7fd395600640 1 -- 172.21.15.175:0/1507728321 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd390135110 con 0x7fd3900ce970 2024-04-25T09:04:44.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.830+0000 7fd386a00640 1 -- 172.21.15.175:0/1507728321 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd380055bf0 con 0x7fd3900ce970 2024-04-25T09:04:44.822 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:04:44.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.830+0000 7fd395600640 1 -- 172.21.15.175:0/1507728321 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd370066f60 msgr2=0x7fd370069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.830+0000 7fd395600640 1 --2- 172.21.15.175:0/1507728321 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd370066f60 0x7fd370069420 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0af000 tx=0x7fd37c004740 comp rx=0 tx=0).stop 2024-04-25T09:04:44.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.830+0000 7fd395600640 1 -- 172.21.15.175:0/1507728321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3900ce970 msgr2=0x7fd3900a9500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.830+0000 7fd395600640 1 --2- 172.21.15.175:0/1507728321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3900ce970 0x7fd3900a9500 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd380009fc0 tx=0x7fd38000d560 comp rx=0 tx=0).stop 2024-04-25T09:04:44.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.830+0000 7fd395600640 1 -- 172.21.15.175:0/1507728321 shutdown_connections 2024-04-25T09:04:44.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.830+0000 7fd395600640 1 --2- 172.21.15.175:0/1507728321 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd370066f60 0x7fd370069420 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.830+0000 7fd395600640 1 --2- 172.21.15.175:0/1507728321 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd3901600a0 0x7fd3900ae3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.830+0000 7fd395600640 1 --2- 172.21.15.175:0/1507728321 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd390145250 0x7fd390071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.830+0000 7fd395600640 1 --2- 172.21.15.175:0/1507728321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3900ce970 0x7fd3900a9500 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.830+0000 7fd395600640 1 -- 172.21.15.175:0/1507728321 >> 172.21.15.175:0/1507728321 conn(0x7fd39006ac50 msgr2=0x7fd39006b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:44.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.834+0000 7fd395600640 1 -- 172.21.15.175:0/1507728321 shutdown_connections 2024-04-25T09:04:44.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.834+0000 7fd395600640 1 -- 172.21.15.175:0/1507728321 wait complete. 2024-04-25T09:04:44.844 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:44.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.990+0000 7efd10600640 1 Processor -- start 2024-04-25T09:04:44.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.990+0000 7efd10600640 1 -- start start 2024-04-25T09:04:44.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.990+0000 7efd10600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd080cbe60 0x7efd0815af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.990+0000 7efd10600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd0806d310 0x7efd080b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.990+0000 7efd10600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0806db60 con 0x7efd080b4630 2024-04-25T09:04:44.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.990+0000 7efd10600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd0806de40 con 0x7efd080cbe60 2024-04-25T09:04:44.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.990+0000 7efd10600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0806e120 con 0x7efd0806d310 2024-04-25T09:04:44.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.994+0000 7efd0dc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd080cbe60 0x7efd0815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.994+0000 7efd0dc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd080cbe60 0x7efd0815af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53730/0 (socket says 172.21.15.175:53730) 2024-04-25T09:04:44.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.994+0000 7efd0dc00640 1 -- 172.21.15.175:0/2888308393 learned_addr learned my addr 172.21.15.175:0/2888308393 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:44.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.994+0000 7efd0d200640 1 --2- 172.21.15.175:0/2888308393 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd0806d310 0x7efd080b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.994+0000 7efd0dc00640 1 -- 172.21.15.175:0/2888308393 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd0806d310 msgr2=0x7efd080b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:44.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.994+0000 7efd0dc00640 1 --2- 172.21.15.175:0/2888308393 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd0806d310 0x7efd080b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.994+0000 7efd0dc00640 1 -- 172.21.15.175:0/2888308393 >> v1:172.21.15.177:6789/0 conn(0x7efd080b4630 legacy=0x7efd080b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.994+0000 7efd0dc00640 1 -- 172.21.15.175:0/2888308393 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0815c2f0 con 0x7efd080cbe60 2024-04-25T09:04:44.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.994+0000 7efd0d200640 1 --2- 172.21.15.175:0/2888308393 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd0806d310 0x7efd080b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:44.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.994+0000 7efd0dc00640 1 --2- 172.21.15.175:0/2888308393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd080cbe60 0x7efd0815af20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00bb10 tx=0x7efcfc01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d2be323e4195b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:44.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.994+0000 7efd07e00640 1 -- 172.21.15.175:0/2888308393 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0b4070 con 0x7efd080cbe60 2024-04-25T09:04:44.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.994+0000 7efd07e00640 1 -- 172.21.15.175:0/2888308393 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc0a7b00 con 0x7efd080cbe60 2024-04-25T09:04:44.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.994+0000 7efd07e00640 1 -- 172.21.15.175:0/2888308393 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0af440 con 0x7efd080cbe60 2024-04-25T09:04:44.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd10600640 1 -- 172.21.15.175:0/2888308393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd080cbe60 msgr2=0x7efd0815af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd10600640 1 --2- 172.21.15.175:0/2888308393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd080cbe60 0x7efd0815af20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00bb10 tx=0x7efcfc01ec30 comp rx=0 tx=0).stop 2024-04-25T09:04:44.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd10600640 1 -- 172.21.15.175:0/2888308393 shutdown_connections 2024-04-25T09:04:44.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd10600640 1 --2- 172.21.15.175:0/2888308393 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd0806d310 0x7efd080b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd10600640 1 --2- 172.21.15.175:0/2888308393 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd080cbe60 0x7efd0815af20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd10600640 1 -- 172.21.15.175:0/2888308393 >> 172.21.15.175:0/2888308393 conn(0x7efd0806ac50 msgr2=0x7efd0806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:44.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd10600640 1 -- 172.21.15.175:0/2888308393 shutdown_connections 2024-04-25T09:04:44.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd10600640 1 -- 172.21.15.175:0/2888308393 wait complete. 2024-04-25T09:04:44.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd10600640 1 Processor -- start 2024-04-25T09:04:44.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd10600640 1 -- start start 2024-04-25T09:04:44.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd10600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0806d310 0x7efd08141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd10600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd080b4630 0x7efd08144850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd10600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd080cbe60 0x7efd080cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd10600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd080716e0 con 0x7efd0806d310 2024-04-25T09:04:44.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd10600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd08071560 con 0x7efd080b4630 2024-04-25T09:04:44.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd10600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd08071860 con 0x7efd080cbe60 2024-04-25T09:04:44.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd0dc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0806d310 0x7efd08141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd0dc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0806d310 0x7efd08141db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53746/0 (socket says 172.21.15.175:53746) 2024-04-25T09:04:44.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd0dc00640 1 -- 172.21.15.175:0/3392433853 learned_addr learned my addr 172.21.15.175:0/3392433853 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:44.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd0d200640 1 --2- 172.21.15.175:0/3392433853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd080b4630 0x7efd08144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd0e600640 1 --2- 172.21.15.175:0/3392433853 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd080cbe60 0x7efd080cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd0dc00640 1 -- 172.21.15.175:0/3392433853 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd080cbe60 msgr2=0x7efd080cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd0dc00640 1 --2- 172.21.15.175:0/3392433853 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd080cbe60 0x7efd080cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd0dc00640 1 -- 172.21.15.175:0/3392433853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd080b4630 msgr2=0x7efd08144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd0dc00640 1 --2- 172.21.15.175:0/3392433853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd080b4630 0x7efd08144850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd0dc00640 1 -- 172.21.15.175:0/3392433853 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd08144d90 con 0x7efd0806d310 2024-04-25T09:04:44.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd0d200640 1 --2- 172.21.15.175:0/3392433853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd080b4630 0x7efd08144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:44.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:44.998+0000 7efd0dc00640 1 --2- 172.21.15.175:0/3392433853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0806d310 0x7efd08141db0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00b2c0 tx=0x7efcfc01d470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:44.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.002+0000 7efd05600640 1 -- 172.21.15.175:0/3392433853 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0bf070 con 0x7efd0806d310 2024-04-25T09:04:44.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.002+0000 7efd05600640 1 -- 172.21.15.175:0/3392433853 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc0ba440 con 0x7efd0806d310 2024-04-25T09:04:44.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.002+0000 7efd05600640 1 -- 172.21.15.175:0/3392433853 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0b4070 con 0x7efd0806d310 2024-04-25T09:04:44.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.002+0000 7efd10600640 1 -- 172.21.15.175:0/3392433853 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd08142390 con 0x7efd0806d310 2024-04-25T09:04:44.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.002+0000 7efd10600640 1 -- 172.21.15.175:0/3392433853 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd08142c30 con 0x7efd0806d310 2024-04-25T09:04:44.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.002+0000 7efd10600640 1 -- 172.21.15.175:0/3392433853 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd08075160 con 0x7efd0806d310 2024-04-25T09:04:44.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.002+0000 7efd05600640 1 -- 172.21.15.175:0/3392433853 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efcfc0c2070 con 0x7efd0806d310 2024-04-25T09:04:44.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.002+0000 7efd05600640 1 --2- 172.21.15.175:0/3392433853 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efce8066f60 0x7efce8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.002+0000 7efd05600640 1 -- 172.21.15.175:0/3392433853 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcfc11f6e0 con 0x7efd0806d310 2024-04-25T09:04:44.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.002+0000 7efd0d200640 1 --2- 172.21.15.175:0/3392433853 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efce8066f60 0x7efce8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.006+0000 7efd0d200640 1 --2- 172.21.15.175:0/3392433853 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efce8066f60 0x7efce8069420 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efd081fa180 tx=0x7efcf4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.006+0000 7efd05600640 1 -- 172.21.15.175:0/3392433853 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efd08144d90 con 0x7efd0806d310 2024-04-25T09:04:45.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.162+0000 7efd10600640 1 -- 172.21.15.175:0/3392433853 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efd080af6c0 con 0x7efd0806d310 2024-04-25T09:04:45.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.162+0000 7efd05600640 1 -- 172.21.15.175:0/3392433853 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7efcfc018820 con 0x7efd0806d310 2024-04-25T09:04:45.154 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:04:45.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.162+0000 7efd10600640 1 -- 172.21.15.175:0/3392433853 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efce8066f60 msgr2=0x7efce8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.162+0000 7efd10600640 1 --2- 172.21.15.175:0/3392433853 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efce8066f60 0x7efce8069420 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7efd081fa180 tx=0x7efcf4008040 comp rx=0 tx=0).stop 2024-04-25T09:04:45.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.162+0000 7efd10600640 1 -- 172.21.15.175:0/3392433853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0806d310 msgr2=0x7efd08141db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.162+0000 7efd10600640 1 --2- 172.21.15.175:0/3392433853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0806d310 0x7efd08141db0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00b2c0 tx=0x7efcfc01d470 comp rx=0 tx=0).stop 2024-04-25T09:04:45.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.162+0000 7efd10600640 1 -- 172.21.15.175:0/3392433853 shutdown_connections 2024-04-25T09:04:45.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.162+0000 7efd10600640 1 --2- 172.21.15.175:0/3392433853 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efce8066f60 0x7efce8069420 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.162+0000 7efd10600640 1 --2- 172.21.15.175:0/3392433853 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd080cbe60 0x7efd080cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.162+0000 7efd10600640 1 --2- 172.21.15.175:0/3392433853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd080b4630 0x7efd08144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.162+0000 7efd10600640 1 --2- 172.21.15.175:0/3392433853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0806d310 0x7efd08141db0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.162+0000 7efd10600640 1 -- 172.21.15.175:0/3392433853 >> 172.21.15.175:0/3392433853 conn(0x7efd0806ac50 msgr2=0x7efd08157920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.162+0000 7efd10600640 1 -- 172.21.15.175:0/3392433853 shutdown_connections 2024-04-25T09:04:45.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.162+0000 7efd10600640 1 -- 172.21.15.175:0/3392433853 wait complete. 2024-04-25T09:04:45.174 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:45.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.318+0000 7f965e800640 1 Processor -- start 2024-04-25T09:04:45.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.318+0000 7f965e800640 1 -- start start 2024-04-25T09:04:45.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.322+0000 7f965e800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9658145250 0x7f96580cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.322+0000 7f965e800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f96580ce970 0x7f96580cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.322+0000 7f965e800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96580cfd10 con 0x7f96581600a0 2024-04-25T09:04:45.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.322+0000 7f965e800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965815f650 con 0x7f96580ce970 2024-04-25T09:04:45.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.322+0000 7f965e800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96580cfff0 con 0x7f9658145250 2024-04-25T09:04:45.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.322+0000 7f9657e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f96580ce970 0x7f96580cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.322+0000 7f9657e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f96580ce970 0x7f96580cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53756/0 (socket says 172.21.15.175:53756) 2024-04-25T09:04:45.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.322+0000 7f9657e00640 1 -- 172.21.15.175:0/1252139605 learned_addr learned my addr 172.21.15.175:0/1252139605 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:45.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.322+0000 7f9657400640 1 --2- 172.21.15.175:0/1252139605 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9658145250 0x7f96580cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.322+0000 7f9657e00640 1 -- 172.21.15.175:0/1252139605 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9658145250 msgr2=0x7f96580cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.322+0000 7f9657e00640 1 --2- 172.21.15.175:0/1252139605 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9658145250 0x7f96580cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.322+0000 7f9657e00640 1 -- 172.21.15.175:0/1252139605 >> v1:172.21.15.177:6789/0 conn(0x7f96581600a0 legacy=0x7f96580cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.322+0000 7f9657e00640 1 -- 172.21.15.175:0/1252139605 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965815f8a0 con 0x7f96580ce970 2024-04-25T09:04:45.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.326+0000 7f9657e00640 1 --2- 172.21.15.175:0/1252139605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96580ce970 0x7f96580cee00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9650009e50 tx=0x7f965001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420ce449308ca273 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.326+0000 7f9656a00640 1 -- 172.21.15.175:0/1252139605 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500a5850 con 0x7f96580ce970 2024-04-25T09:04:45.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.326+0000 7f9656a00640 1 -- 172.21.15.175:0/1252139605 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96500a59f0 con 0x7f96580ce970 2024-04-25T09:04:45.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.326+0000 7f9656a00640 1 -- 172.21.15.175:0/1252139605 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500a5dc0 con 0x7f96580ce970 2024-04-25T09:04:45.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.326+0000 7f965e800640 1 -- 172.21.15.175:0/1252139605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96580ce970 msgr2=0x7f96580cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.326+0000 7f965e800640 1 --2- 172.21.15.175:0/1252139605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96580ce970 0x7f96580cee00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9650009e50 tx=0x7f965001c970 comp rx=0 tx=0).stop 2024-04-25T09:04:45.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.326+0000 7f965e800640 1 -- 172.21.15.175:0/1252139605 shutdown_connections 2024-04-25T09:04:45.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.326+0000 7f965e800640 1 --2- 172.21.15.175:0/1252139605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96580ce970 0x7f96580cee00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.326+0000 7f965e800640 1 --2- 172.21.15.175:0/1252139605 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9658145250 0x7f96580cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.326+0000 7f965e800640 1 -- 172.21.15.175:0/1252139605 >> 172.21.15.175:0/1252139605 conn(0x7f965806ac50 msgr2=0x7f965806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.326+0000 7f965e800640 1 -- 172.21.15.175:0/1252139605 shutdown_connections 2024-04-25T09:04:45.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.326+0000 7f965e800640 1 -- 172.21.15.175:0/1252139605 wait complete. 2024-04-25T09:04:45.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.326+0000 7f965e800640 1 Processor -- start 2024-04-25T09:04:45.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.326+0000 7f965e800640 1 -- start start 2024-04-25T09:04:45.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f965e800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96580ce970 0x7f965813e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f965e800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9658145250 0x7f965806d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f965e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96581600a0 0x7f965806def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f965e800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9658160600 con 0x7f96581600a0 2024-04-25T09:04:45.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f965e800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9658160480 con 0x7f96580ce970 2024-04-25T09:04:45.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f965e800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965815c870 con 0x7f9658145250 2024-04-25T09:04:45.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f9657e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96581600a0 0x7f965806def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f9657e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96581600a0 0x7f965806def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53768/0 (socket says 172.21.15.175:53768) 2024-04-25T09:04:45.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f9657e00640 1 -- 172.21.15.175:0/2915269396 learned_addr learned my addr 172.21.15.175:0/2915269396 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:45.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f964ea00640 1 --2- 172.21.15.175:0/2915269396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9658145250 0x7f965806d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f9657400640 1 --2- 172.21.15.175:0/2915269396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96580ce970 0x7f965813e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f9657e00640 1 -- 172.21.15.175:0/2915269396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9658145250 msgr2=0x7f965806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f9657e00640 1 --2- 172.21.15.175:0/2915269396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9658145250 0x7f965806d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f9657e00640 1 -- 172.21.15.175:0/2915269396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96580ce970 msgr2=0x7f965813e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f9657e00640 1 --2- 172.21.15.175:0/2915269396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96580ce970 0x7f965813e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f9657e00640 1 -- 172.21.15.175:0/2915269396 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965815b630 con 0x7f96581600a0 2024-04-25T09:04:45.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f9657400640 1 --2- 172.21.15.175:0/2915269396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96580ce970 0x7f965813e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:45.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f9657e00640 1 --2- 172.21.15.175:0/2915269396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96581600a0 0x7f965806def0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f96500af040 tx=0x7f9650019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f964fe00640 1 -- 172.21.15.175:0/2915269396 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500bc020 con 0x7f96581600a0 2024-04-25T09:04:45.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f964fe00640 1 -- 172.21.15.175:0/2915269396 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96500b8670 con 0x7f96581600a0 2024-04-25T09:04:45.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f964fe00640 1 -- 172.21.15.175:0/2915269396 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500b8a60 con 0x7f96581600a0 2024-04-25T09:04:45.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f965e800640 1 -- 172.21.15.175:0/2915269396 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965815b350 con 0x7f96581600a0 2024-04-25T09:04:45.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f965e800640 1 -- 172.21.15.175:0/2915269396 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965813d880 con 0x7f96581600a0 2024-04-25T09:04:45.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f965e800640 1 -- 172.21.15.175:0/2915269396 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9658075160 con 0x7f96581600a0 2024-04-25T09:04:45.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.330+0000 7f964fe00640 1 -- 172.21.15.175:0/2915269396 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f96500bf020 con 0x7f96581600a0 2024-04-25T09:04:45.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.334+0000 7f964fe00640 1 --2- 172.21.15.175:0/2915269396 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9634066f60 0x7f9634069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.334+0000 7f964fe00640 1 -- 172.21.15.175:0/2915269396 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9650120430 con 0x7f96581600a0 2024-04-25T09:04:45.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.334+0000 7f9657400640 1 --2- 172.21.15.175:0/2915269396 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9634066f60 0x7f9634069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.334+0000 7f9657400640 1 --2- 172.21.15.175:0/2915269396 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9634066f60 0x7f9634069420 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9648007a70 tx=0x7f9648008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.338+0000 7f964fe00640 1 -- 172.21.15.175:0/2915269396 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f96500c6030 con 0x7f96581600a0 2024-04-25T09:04:45.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.490+0000 7f965e800640 1 -- 172.21.15.175:0/2915269396 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9658165fb0 con 0x7f96581600a0 2024-04-25T09:04:45.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.490+0000 7f964fe00640 1 -- 172.21.15.175:0/2915269396 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9650016620 con 0x7f96581600a0 2024-04-25T09:04:45.483 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:04:45.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.490+0000 7f965e800640 1 -- 172.21.15.175:0/2915269396 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9634066f60 msgr2=0x7f9634069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.490+0000 7f965e800640 1 --2- 172.21.15.175:0/2915269396 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9634066f60 0x7f9634069420 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9648007a70 tx=0x7f9648008040 comp rx=0 tx=0).stop 2024-04-25T09:04:45.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.490+0000 7f965e800640 1 -- 172.21.15.175:0/2915269396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96581600a0 msgr2=0x7f965806def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.490+0000 7f965e800640 1 --2- 172.21.15.175:0/2915269396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96581600a0 0x7f965806def0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f96500af040 tx=0x7f9650019710 comp rx=0 tx=0).stop 2024-04-25T09:04:45.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.490+0000 7f965e800640 1 -- 172.21.15.175:0/2915269396 shutdown_connections 2024-04-25T09:04:45.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.490+0000 7f965e800640 1 --2- 172.21.15.175:0/2915269396 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9634066f60 0x7f9634069420 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.490+0000 7f965e800640 1 --2- 172.21.15.175:0/2915269396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96581600a0 0x7f965806def0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.490+0000 7f965e800640 1 --2- 172.21.15.175:0/2915269396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9658145250 0x7f965806d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.490+0000 7f965e800640 1 --2- 172.21.15.175:0/2915269396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96580ce970 0x7f965813e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.490+0000 7f965e800640 1 -- 172.21.15.175:0/2915269396 >> 172.21.15.175:0/2915269396 conn(0x7f965806ac50 msgr2=0x7f96580af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.494+0000 7f965e800640 1 -- 172.21.15.175:0/2915269396 shutdown_connections 2024-04-25T09:04:45.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.494+0000 7f965e800640 1 -- 172.21.15.175:0/2915269396 wait complete. 2024-04-25T09:04:45.505 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:04:45.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.650+0000 7fabf3000640 1 Processor -- start 2024-04-25T09:04:45.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.650+0000 7fabf3000640 1 -- start start 2024-04-25T09:04:45.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.650+0000 7fabf3000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fabec0cf6b0 0x7fabec1600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.650+0000 7fabf3000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabec0ce970 0x7fabec0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.650+0000 7fabf3000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabec0cfd10 con 0x7fabec145250 2024-04-25T09:04:45.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.650+0000 7fabf3000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabec1605e0 con 0x7fabec0cf6b0 2024-04-25T09:04:45.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.650+0000 7fabf3000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec15f650 con 0x7fabec0ce970 2024-04-25T09:04:45.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.650+0000 7fabeb400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fabec0cf6b0 0x7fabec1600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.650+0000 7fabebe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fabec145250 0x7fabec0cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:51360/0 (socket says 172.21.15.175:51360) 2024-04-25T09:04:45.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.650+0000 7fabebe00640 1 -- 172.21.15.175:0/1148853245 learned_addr learned my addr 172.21.15.175:0/1148853245 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:45.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.650+0000 7fabf1000640 1 --2- 172.21.15.175:0/1148853245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabec0ce970 0x7fabec0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.650+0000 7fabeb400640 1 -- 172.21.15.175:0/1148853245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabec0ce970 msgr2=0x7fabec0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.650+0000 7fabeb400640 1 --2- 172.21.15.175:0/1148853245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabec0ce970 0x7fabec0cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.650+0000 7fabeb400640 1 -- 172.21.15.175:0/1148853245 >> v1:172.21.15.175:6789/0 conn(0x7fabec145250 legacy=0x7fabec0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.650+0000 7fabeaa00640 1 -- 172.21.15.175:0/1148853245 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831282012 0 0) 0x7fabec0cfd10 con 0x7fabec145250 2024-04-25T09:04:45.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.650+0000 7fabeb400640 1 -- 172.21.15.175:0/1148853245 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec0cfff0 con 0x7fabec0cf6b0 2024-04-25T09:04:45.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.650+0000 7fabf1000640 1 --2- 172.21.15.175:0/1148853245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabec0ce970 0x7fabec0cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:45.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.654+0000 7fabeb400640 1 --2- 172.21.15.175:0/1148853245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabec0cf6b0 0x7fabec1600a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fabd80097f0 tx=0x7fabd801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7273bee851fd2f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.654+0000 7fabeaa00640 1 -- 172.21.15.175:0/1148853245 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80b0070 con 0x7fabec0cf6b0 2024-04-25T09:04:45.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.654+0000 7fabeaa00640 1 -- 172.21.15.175:0/1148853245 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd80ab600 con 0x7fabec0cf6b0 2024-04-25T09:04:45.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.654+0000 7fabeaa00640 1 -- 172.21.15.175:0/1148853245 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80ab9d0 con 0x7fabec0cf6b0 2024-04-25T09:04:45.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.654+0000 7fabf3000640 1 -- 172.21.15.175:0/1148853245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabec0cf6b0 msgr2=0x7fabec1600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.654+0000 7fabf3000640 1 --2- 172.21.15.175:0/1148853245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabec0cf6b0 0x7fabec1600a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fabd80097f0 tx=0x7fabd801c410 comp rx=0 tx=0).stop 2024-04-25T09:04:45.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.654+0000 7fabf3000640 1 -- 172.21.15.175:0/1148853245 shutdown_connections 2024-04-25T09:04:45.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.654+0000 7fabf3000640 1 --2- 172.21.15.175:0/1148853245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabec0ce970 0x7fabec0cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.654+0000 7fabf3000640 1 --2- 172.21.15.175:0/1148853245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabec0cf6b0 0x7fabec1600a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.654+0000 7fabf3000640 1 -- 172.21.15.175:0/1148853245 >> 172.21.15.175:0/1148853245 conn(0x7fabec06ac50 msgr2=0x7fabec06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.654+0000 7fabf3000640 1 -- 172.21.15.175:0/1148853245 shutdown_connections 2024-04-25T09:04:45.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.654+0000 7fabf3000640 1 -- 172.21.15.175:0/1148853245 wait complete. 2024-04-25T09:04:45.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabf3000640 1 Processor -- start 2024-04-25T09:04:45.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabf3000640 1 -- start start 2024-04-25T09:04:45.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabf3000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabec0ce970 0x7fabec0b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabf3000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabec0cf6b0 0x7fabec13cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabf3000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabec145250 0x7fabec1426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabf3000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec15c870 con 0x7fabec0cf6b0 2024-04-25T09:04:45.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabf3000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec145630 con 0x7fabec0ce970 2024-04-25T09:04:45.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabf3000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec15c9f0 con 0x7fabec145250 2024-04-25T09:04:45.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabeb400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabec0cf6b0 0x7fabec13cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabeb400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabec0cf6b0 0x7fabec13cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53788/0 (socket says 172.21.15.175:53788) 2024-04-25T09:04:45.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabeb400640 1 -- 172.21.15.175:0/3789363617 learned_addr learned my addr 172.21.15.175:0/3789363617 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:45.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabebe00640 1 --2- 172.21.15.175:0/3789363617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabec0ce970 0x7fabec0b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabf1000640 1 --2- 172.21.15.175:0/3789363617 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabec145250 0x7fabec1426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabeb400640 1 -- 172.21.15.175:0/3789363617 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabec145250 msgr2=0x7fabec1426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabeb400640 1 --2- 172.21.15.175:0/3789363617 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabec145250 0x7fabec1426d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabeb400640 1 -- 172.21.15.175:0/3789363617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabec0ce970 msgr2=0x7fabec0b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabeb400640 1 --2- 172.21.15.175:0/3789363617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabec0ce970 0x7fabec0b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabeb400640 1 -- 172.21.15.175:0/3789363617 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec15cff0 con 0x7fabec0cf6b0 2024-04-25T09:04:45.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabebe00640 1 --2- 172.21.15.175:0/3789363617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabec0ce970 0x7fabec0b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:45.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabf1000640 1 --2- 172.21.15.175:0/3789363617 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabec145250 0x7fabec1426d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:45.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabeb400640 1 --2- 172.21.15.175:0/3789363617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabec0cf6b0 0x7fabec13cd40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fabd80ae040 tx=0x7fabd80191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabe3e00640 1 -- 172.21.15.175:0/3789363617 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80b8020 con 0x7fabec0cf6b0 2024-04-25T09:04:45.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabe3e00640 1 -- 172.21.15.175:0/3789363617 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd80b4630 con 0x7fabec0cf6b0 2024-04-25T09:04:45.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabe3e00640 1 -- 172.21.15.175:0/3789363617 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80b0040 con 0x7fabec0cf6b0 2024-04-25T09:04:45.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabf3000640 1 -- 172.21.15.175:0/3789363617 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabec15d2d0 con 0x7fabec0cf6b0 2024-04-25T09:04:45.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabf3000640 1 -- 172.21.15.175:0/3789363617 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabec0b43c0 con 0x7fabec0cf6b0 2024-04-25T09:04:45.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.658+0000 7fabf3000640 1 -- 172.21.15.175:0/3789363617 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabec075160 con 0x7fabec0cf6b0 2024-04-25T09:04:45.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.662+0000 7fabe3e00640 1 -- 172.21.15.175:0/3789363617 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fabd80bb020 con 0x7fabec0cf6b0 2024-04-25T09:04:45.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.662+0000 7fabe3e00640 1 --2- 172.21.15.175:0/3789363617 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fabcc066f60 0x7fabcc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.662+0000 7fabe3e00640 1 -- 172.21.15.175:0/3789363617 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabd811ec20 con 0x7fabec0cf6b0 2024-04-25T09:04:45.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.662+0000 7fabebe00640 1 --2- 172.21.15.175:0/3789363617 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fabcc066f60 0x7fabcc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.662+0000 7fabebe00640 1 --2- 172.21.15.175:0/3789363617 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fabcc066f60 0x7fabcc069420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fabdc000f70 tx=0x7fabdc007cb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.666+0000 7fabe3e00640 1 -- 172.21.15.175:0/3789363617 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fabd80c2030 con 0x7fabec0cf6b0 2024-04-25T09:04:45.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.830+0000 7fabf3000640 1 -- 172.21.15.175:0/3789363617 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fabec0cbbf0 con 0x7fabec0cf6b0 2024-04-25T09:04:45.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.834+0000 7fabe3e00640 1 -- 172.21.15.175:0/3789363617 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fabd8016090 con 0x7fabec0cf6b0 2024-04-25T09:04:45.825 INFO:teuthology.orchestra.run.smithi175.stderr:listed 0 entries 2024-04-25T09:04:45.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.834+0000 7fabf3000640 1 -- 172.21.15.175:0/3789363617 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fabcc066f60 msgr2=0x7fabcc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.834+0000 7fabf3000640 1 --2- 172.21.15.175:0/3789363617 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fabcc066f60 0x7fabcc069420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fabdc000f70 tx=0x7fabdc007cb0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.834+0000 7fabf3000640 1 -- 172.21.15.175:0/3789363617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabec0cf6b0 msgr2=0x7fabec13cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.834+0000 7fabf3000640 1 --2- 172.21.15.175:0/3789363617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabec0cf6b0 0x7fabec13cd40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fabd80ae040 tx=0x7fabd80191b0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.834+0000 7fabf3000640 1 -- 172.21.15.175:0/3789363617 shutdown_connections 2024-04-25T09:04:45.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.834+0000 7fabf3000640 1 --2- 172.21.15.175:0/3789363617 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fabcc066f60 0x7fabcc069420 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.834+0000 7fabf3000640 1 --2- 172.21.15.175:0/3789363617 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabec145250 0x7fabec1426d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.834+0000 7fabf3000640 1 --2- 172.21.15.175:0/3789363617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabec0cf6b0 0x7fabec13cd40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.834+0000 7fabf3000640 1 --2- 172.21.15.175:0/3789363617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabec0ce970 0x7fabec0b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.834+0000 7fabf3000640 1 -- 172.21.15.175:0/3789363617 >> 172.21.15.175:0/3789363617 conn(0x7fabec06ac50 msgr2=0x7fabec144020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.834+0000 7fabf3000640 1 -- 172.21.15.175:0/3789363617 shutdown_connections 2024-04-25T09:04:45.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:45.834+0000 7fabf3000640 1 -- 172.21.15.175:0/3789363617 wait complete. 2024-04-25T09:04:45.845 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-25T09:04:45.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:45.846 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-25T09:04:45.870 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:04:45.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:45.870 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-25T09:04:45.921 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:04:45.921 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:45.931 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:04:45.931 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:45.981 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:04:45.981 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:46.033 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:46.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.174+0000 7f53bd400640 1 Processor -- start 2024-04-25T09:04:46.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.174+0000 7f53bd400640 1 -- start start 2024-04-25T09:04:46.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.174+0000 7f53bd400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53b81453a0 0x7f53b815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.174+0000 7f53bd400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b815cd00 con 0x7f53b8144fc0 2024-04-25T09:04:46.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.174+0000 7f53bd400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b80ce660 con 0x7f53b815c410 2024-04-25T09:04:46.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.174+0000 7f53bd400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b815c840 con 0x7f53b81453a0 2024-04-25T09:04:46.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.174+0000 7f53b6800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f53b8144fc0 0x7f53b80cbe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:51366/0 (socket says 172.21.15.175:51366) 2024-04-25T09:04:46.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.174+0000 7f53b6800640 1 -- 172.21.15.175:0/3126236770 learned_addr learned my addr 172.21.15.175:0/3126236770 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:46.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.174+0000 7f53b5e00640 1 --2- 172.21.15.175:0/3126236770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53b81453a0 0x7f53b815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5400640 1 -- 172.21.15.175:0/3126236770 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 870817251 0 0) 0x7f53b815cd00 con 0x7f53b8144fc0 2024-04-25T09:04:46.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5400640 1 -- 172.21.15.175:0/3126236770 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f539c003530 con 0x7f53b8144fc0 2024-04-25T09:04:46.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5400640 1 -- 172.21.15.175:0/3126236770 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481388902 0 0) 0x7f53b80ce660 con 0x7f53b815c410 2024-04-25T09:04:46.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5400640 1 -- 172.21.15.175:0/3126236770 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53b815cd00 con 0x7f53b815c410 2024-04-25T09:04:46.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5400640 1 -- 172.21.15.175:0/3126236770 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1370956084 0 0) 0x7f539c003530 con 0x7f53b8144fc0 2024-04-25T09:04:46.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5400640 1 -- 172.21.15.175:0/3126236770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53b81453a0 msgr2=0x7f53b815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:46.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5400640 1 --2- 172.21.15.175:0/3126236770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53b81453a0 0x7f53b815bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5400640 1 -- 172.21.15.175:0/3126236770 >> v1:172.21.15.177:6789/0 conn(0x7f53b815c410 legacy=0x7f53b80cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5400640 1 -- 172.21.15.175:0/3126236770 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b80cc930 con 0x7f53b8144fc0 2024-04-25T09:04:46.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5400640 1 -- 172.21.15.175:0/3126236770 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f53a8001a00 con 0x7f53b8144fc0 2024-04-25T09:04:46.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5400640 1 -- 172.21.15.175:0/3126236770 >> v1:172.21.15.175:6789/0 conn(0x7f53b8144fc0 legacy=0x7f53b80cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5400640 1 --2- 172.21.15.175:0/3126236770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f539c003b80 0x7f539c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5400640 1 --2- 172.21.15.175:0/3126236770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f539c004810 0x7f539c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5400640 1 --2- 172.21.15.175:0/3126236770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53b81453a0 0x7f539c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5400640 1 -- 172.21.15.175:0/3126236770 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b815c840 con 0x7f539c004810 2024-04-25T09:04:46.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5400640 1 -- 172.21.15.175:0/3126236770 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c00ba80 con 0x7f539c003b80 2024-04-25T09:04:46.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5400640 1 -- 172.21.15.175:0/3126236770 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539c00bc50 con 0x7f53b81453a0 2024-04-25T09:04:46.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5e00640 1 --2- 172.21.15.175:0/3126236770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f539c004810 0x7f539c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b6800640 1 --2- 172.21.15.175:0/3126236770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f539c003b80 0x7f539c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b7200640 1 --2- 172.21.15.175:0/3126236770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53b81453a0 0x7f539c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5e00640 1 -- 172.21.15.175:0/3126236770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53b81453a0 msgr2=0x7f539c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:46.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5e00640 1 --2- 172.21.15.175:0/3126236770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53b81453a0 0x7f539c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5e00640 1 -- 172.21.15.175:0/3126236770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f539c003b80 msgr2=0x7f539c003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:46.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5e00640 1 --2- 172.21.15.175:0/3126236770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f539c003b80 0x7f539c003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5e00640 1 -- 172.21.15.175:0/3126236770 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c003530 con 0x7f539c004810 2024-04-25T09:04:46.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b6800640 1 --2- 172.21.15.175:0/3126236770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f539c003b80 0x7f539c003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:46.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.178+0000 7f53b5e00640 1 --2- 172.21.15.175:0/3126236770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f539c004810 0x7f539c004c90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009ae0 tx=0x7f53a401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30af174f2b8adf12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:46.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53b5400640 1 -- 172.21.15.175:0/3126236770 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40b2070 con 0x7f539c004810 2024-04-25T09:04:46.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53b5400640 1 -- 172.21.15.175:0/3126236770 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a40a5600 con 0x7f539c004810 2024-04-25T09:04:46.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53b5400640 1 -- 172.21.15.175:0/3126236770 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40096b0 con 0x7f539c004810 2024-04-25T09:04:46.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53bd400640 1 -- 172.21.15.175:0/3126236770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f539c004810 msgr2=0x7f539c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53bd400640 1 --2- 172.21.15.175:0/3126236770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f539c004810 0x7f539c004c90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009ae0 tx=0x7f53a401ca10 comp rx=0 tx=0).stop 2024-04-25T09:04:46.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53b7200640 1 -- 172.21.15.175:0/3126236770 reap_dead start 2024-04-25T09:04:46.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53bd400640 1 -- 172.21.15.175:0/3126236770 shutdown_connections 2024-04-25T09:04:46.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53bd400640 1 -- 172.21.15.175:0/3126236770 >> 172.21.15.175:0/3126236770 conn(0x7f53b8067150 msgr2=0x7f53b806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:46.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53bd400640 1 -- 172.21.15.175:0/3126236770 shutdown_connections 2024-04-25T09:04:46.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53bd400640 1 -- 172.21.15.175:0/3126236770 wait complete. 2024-04-25T09:04:46.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53bd400640 1 Processor -- start 2024-04-25T09:04:46.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53bd400640 1 -- start start 2024-04-25T09:04:46.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53bd400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53b81510e0 0x7f53b8137070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53bd400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53b815b2c0 0x7f53b8138bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53bd400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53b8139130 0x7f53b81f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53bd400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80ce900 con 0x7f53b8139130 2024-04-25T09:04:46.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53bd400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80ccef0 con 0x7f53b815b2c0 2024-04-25T09:04:46.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53bd400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80cc580 con 0x7f53b81510e0 2024-04-25T09:04:46.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53b7200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53b8139130 0x7f53b81f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53b7200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53b8139130 0x7f53b81f4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53814/0 (socket says 172.21.15.175:53814) 2024-04-25T09:04:46.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.182+0000 7f53b7200640 1 -- 172.21.15.175:0/1164261363 learned_addr learned my addr 172.21.15.175:0/1164261363 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:46.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53b5e00640 1 --2- 172.21.15.175:0/1164261363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53b815b2c0 0x7f53b8138bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53b6800640 1 --2- 172.21.15.175:0/1164261363 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53b81510e0 0x7f53b8137070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53b7200640 1 -- 172.21.15.175:0/1164261363 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53b81510e0 msgr2=0x7f53b8137070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53b7200640 1 --2- 172.21.15.175:0/1164261363 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53b81510e0 0x7f53b8137070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53b7200640 1 -- 172.21.15.175:0/1164261363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53b815b2c0 msgr2=0x7f53b8138bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53b7200640 1 --2- 172.21.15.175:0/1164261363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53b815b2c0 0x7f53b8138bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53b7200640 1 -- 172.21.15.175:0/1164261363 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b806f370 con 0x7f53b8139130 2024-04-25T09:04:46.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53b5e00640 1 --2- 172.21.15.175:0/1164261363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53b815b2c0 0x7f53b8138bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:46.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53b6800640 1 --2- 172.21.15.175:0/1164261363 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53b81510e0 0x7f53b8137070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:46.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53b7200640 1 --2- 172.21.15.175:0/1164261363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53b8139130 0x7f53b81f4fd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f53b80726e0 tx=0x7f53b000f170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:46.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53aea00640 1 -- 172.21.15.175:0/1164261363 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b0010040 con 0x7f53b8139130 2024-04-25T09:04:46.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53aea00640 1 -- 172.21.15.175:0/1164261363 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b001a070 con 0x7f53b8139130 2024-04-25T09:04:46.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53bd400640 1 -- 172.21.15.175:0/1164261363 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b815e860 con 0x7f53b8139130 2024-04-25T09:04:46.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53aea00640 1 -- 172.21.15.175:0/1164261363 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b0015410 con 0x7f53b8139130 2024-04-25T09:04:46.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53bd400640 1 -- 172.21.15.175:0/1164261363 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b815ee20 con 0x7f53b8139130 2024-04-25T09:04:46.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53bd400640 1 -- 172.21.15.175:0/1164261363 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b8074a60 con 0x7f53b8139130 2024-04-25T09:04:46.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53aea00640 1 -- 172.21.15.175:0/1164261363 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f53b00155b0 con 0x7f53b8139130 2024-04-25T09:04:46.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53aea00640 1 --2- 172.21.15.175:0/1164261363 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5398066f90 0x7f5398069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53aea00640 1 -- 172.21.15.175:0/1164261363 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53b00884c0 con 0x7f53b8139130 2024-04-25T09:04:46.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.186+0000 7f53b6800640 1 --2- 172.21.15.175:0/1164261363 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5398066f90 0x7f5398069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.190+0000 7f53b6800640 1 --2- 172.21.15.175:0/1164261363 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5398066f90 0x7f5398069450 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f53a8001790 tx=0x7f53a8001700 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:46.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.190+0000 7f53aea00640 1 -- 172.21.15.175:0/1164261363 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f53b0059430 con 0x7f53b8139130 2024-04-25T09:04:46.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.346+0000 7f53bd400640 1 -- 172.21.15.175:0/1164261363 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53b8142130 con 0x7f53b8139130 2024-04-25T09:04:46.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.346+0000 7f53aea00640 1 -- 172.21.15.175:0/1164261363 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f53b0058d30 con 0x7f53b8139130 2024-04-25T09:04:46.339 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:46.339 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":20,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:11.440551+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:46.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.346+0000 7f53bd400640 1 -- 172.21.15.175:0/1164261363 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5398066f90 msgr2=0x7f5398069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.346+0000 7f53bd400640 1 --2- 172.21.15.175:0/1164261363 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5398066f90 0x7f5398069450 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f53a8001790 tx=0x7f53a8001700 comp rx=0 tx=0).stop 2024-04-25T09:04:46.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.346+0000 7f53bd400640 1 -- 172.21.15.175:0/1164261363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53b8139130 msgr2=0x7f53b81f4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.346+0000 7f53bd400640 1 --2- 172.21.15.175:0/1164261363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53b8139130 0x7f53b81f4fd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f53b80726e0 tx=0x7f53b000f170 comp rx=0 tx=0).stop 2024-04-25T09:04:46.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.346+0000 7f53bd400640 1 -- 172.21.15.175:0/1164261363 shutdown_connections 2024-04-25T09:04:46.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.346+0000 7f53bd400640 1 --2- 172.21.15.175:0/1164261363 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5398066f90 0x7f5398069450 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.346+0000 7f53bd400640 1 --2- 172.21.15.175:0/1164261363 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53b8139130 0x7f53b81f4fd0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.346+0000 7f53bd400640 1 --2- 172.21.15.175:0/1164261363 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53b815b2c0 0x7f53b8138bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.346+0000 7f53bd400640 1 --2- 172.21.15.175:0/1164261363 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53b81510e0 0x7f53b8137070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.346+0000 7f53bd400640 1 -- 172.21.15.175:0/1164261363 >> 172.21.15.175:0/1164261363 conn(0x7f539c004810 msgr2=0x7f53b806e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:46.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.350+0000 7f53bd400640 1 -- 172.21.15.175:0/1164261363 shutdown_connections 2024-04-25T09:04:46.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.350+0000 7f53bd400640 1 -- 172.21.15.175:0/1164261363 wait complete. 2024-04-25T09:04:46.360 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:08.047706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:04:08.795449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:46.361 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:46.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.506+0000 7fce96a00640 1 Processor -- start 2024-04-25T09:04:46.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.506+0000 7fce96a00640 1 -- start start 2024-04-25T09:04:46.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.506+0000 7fce96a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fce9015af20 0x7fce900b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.506+0000 7fce96a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9006db60 con 0x7fce900cbe60 2024-04-25T09:04:46.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.506+0000 7fce96a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9006de40 con 0x7fce900b4630 2024-04-25T09:04:46.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.506+0000 7fce96a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce900b4aa0 con 0x7fce9015af20 2024-04-25T09:04:46.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.510+0000 7fce8f400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fce9015af20 0x7fce900b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.510+0000 7fce8f400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fce9015af20 0x7fce900b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53828/0 (socket says 172.21.15.175:53828) 2024-04-25T09:04:46.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.510+0000 7fce8f400640 1 -- 172.21.15.175:0/540075503 learned_addr learned my addr 172.21.15.175:0/540075503 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:46.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.510+0000 7fce8fe00640 1 --1- 172.21.15.175:0/540075503 >> v1:172.21.15.175:6789/0 conn(0x7fce900cbe60 0x7fce9006d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:51376/0 (socket says 172.21.15.175:51376) 2024-04-25T09:04:46.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.510+0000 7fce8f400640 1 -- 172.21.15.175:0/540075503 >> v1:172.21.15.177:6789/0 conn(0x7fce900b4630 legacy=0x7fce9015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.510+0000 7fce8f400640 1 -- 172.21.15.175:0/540075503 >> v1:172.21.15.175:6789/0 conn(0x7fce900cbe60 legacy=0x7fce9006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.510+0000 7fce8f400640 1 -- 172.21.15.175:0/540075503 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9006e120 con 0x7fce9015af20 2024-04-25T09:04:46.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.510+0000 7fce8ea00640 1 -- 172.21.15.175:0/540075503 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884335610 0 0) 0x7fce9006db60 con 0x7fce900cbe60 2024-04-25T09:04:46.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.510+0000 7fce8f400640 1 --2- 172.21.15.175:0/540075503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce9015af20 0x7fce900b40f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009870 tx=0x7fce7c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbc220a29d0565c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:46.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.510+0000 7fce8ea00640 1 -- 172.21.15.175:0/540075503 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c0a7070 con 0x7fce9015af20 2024-04-25T09:04:46.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.510+0000 7fce8ea00640 1 -- 172.21.15.175:0/540075503 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7c0b0070 con 0x7fce9015af20 2024-04-25T09:04:46.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.510+0000 7fce8ea00640 1 -- 172.21.15.175:0/540075503 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7c0ab890 con 0x7fce9015af20 2024-04-25T09:04:46.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce96a00640 1 -- 172.21.15.175:0/540075503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce9015af20 msgr2=0x7fce900b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce96a00640 1 --2- 172.21.15.175:0/540075503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce9015af20 0x7fce900b40f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009870 tx=0x7fce7c01c560 comp rx=0 tx=0).stop 2024-04-25T09:04:46.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce96a00640 1 -- 172.21.15.175:0/540075503 shutdown_connections 2024-04-25T09:04:46.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce96a00640 1 --2- 172.21.15.175:0/540075503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce9015af20 0x7fce900b40f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce96a00640 1 -- 172.21.15.175:0/540075503 >> 172.21.15.175:0/540075503 conn(0x7fce9006ac50 msgr2=0x7fce9006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:46.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce96a00640 1 -- 172.21.15.175:0/540075503 shutdown_connections 2024-04-25T09:04:46.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce96a00640 1 -- 172.21.15.175:0/540075503 wait complete. 2024-04-25T09:04:46.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce96a00640 1 Processor -- start 2024-04-25T09:04:46.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce96a00640 1 -- start start 2024-04-25T09:04:46.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce96a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce900b4630 0x7fce90153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce96a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce900cbe60 0x7fce900ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce96a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce9015af20 0x7fce9013c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce96a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9015db40 con 0x7fce9015af20 2024-04-25T09:04:46.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce96a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9015d9c0 con 0x7fce900cbe60 2024-04-25T09:04:46.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce96a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce900712d0 con 0x7fce900b4630 2024-04-25T09:04:46.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce94a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce9015af20 0x7fce9013c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce94a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce9015af20 0x7fce9013c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53830/0 (socket says 172.21.15.175:53830) 2024-04-25T09:04:46.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce94a00640 1 -- 172.21.15.175:0/2024538041 learned_addr learned my addr 172.21.15.175:0/2024538041 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:46.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce8fe00640 1 --2- 172.21.15.175:0/2024538041 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce900b4630 0x7fce90153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce8f400640 1 --2- 172.21.15.175:0/2024538041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce900cbe60 0x7fce900ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce94a00640 1 -- 172.21.15.175:0/2024538041 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce900b4630 msgr2=0x7fce90153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce94a00640 1 --2- 172.21.15.175:0/2024538041 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce900b4630 0x7fce90153e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce94a00640 1 -- 172.21.15.175:0/2024538041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce900cbe60 msgr2=0x7fce900ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce94a00640 1 --2- 172.21.15.175:0/2024538041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce900cbe60 0x7fce900ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.514+0000 7fce94a00640 1 -- 172.21.15.175:0/2024538041 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce900cf620 con 0x7fce9015af20 2024-04-25T09:04:46.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.518+0000 7fce94a00640 1 --2- 172.21.15.175:0/2024538041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce9015af20 0x7fce9013c710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fce8800c460 tx=0x7fce8800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:46.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.518+0000 7fce87e00640 1 -- 172.21.15.175:0/2024538041 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce88005220 con 0x7fce9015af20 2024-04-25T09:04:46.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.518+0000 7fce87e00640 1 -- 172.21.15.175:0/2024538041 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce880053c0 con 0x7fce9015af20 2024-04-25T09:04:46.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.518+0000 7fce87e00640 1 -- 172.21.15.175:0/2024538041 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce88007270 con 0x7fce9015af20 2024-04-25T09:04:46.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.518+0000 7fce96a00640 1 -- 172.21.15.175:0/2024538041 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce900cf900 con 0x7fce9015af20 2024-04-25T09:04:46.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.518+0000 7fce96a00640 1 -- 172.21.15.175:0/2024538041 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce900cf0d0 con 0x7fce9015af20 2024-04-25T09:04:46.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.518+0000 7fce96a00640 1 -- 172.21.15.175:0/2024538041 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce90075160 con 0x7fce9015af20 2024-04-25T09:04:46.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.518+0000 7fce87e00640 1 -- 172.21.15.175:0/2024538041 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fce88019020 con 0x7fce9015af20 2024-04-25T09:04:46.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.518+0000 7fce87e00640 1 --2- 172.21.15.175:0/2024538041 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fce70066f60 0x7fce70069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.518+0000 7fce87e00640 1 -- 172.21.15.175:0/2024538041 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce88084320 con 0x7fce9015af20 2024-04-25T09:04:46.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.518+0000 7fce8fe00640 1 --2- 172.21.15.175:0/2024538041 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fce70066f60 0x7fce70069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.518+0000 7fce8fe00640 1 --2- 172.21.15.175:0/2024538041 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fce70066f60 0x7fce70069420 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce80001950 tx=0x7fce800018e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:46.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.522+0000 7fce87e00640 1 -- 172.21.15.175:0/2024538041 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fce88055290 con 0x7fce9015af20 2024-04-25T09:04:46.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.674+0000 7fce96a00640 1 -- 172.21.15.175:0/2024538041 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fce90157ec0 con 0x7fce9015af20 2024-04-25T09:04:46.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.678+0000 7fce87e00640 1 -- 172.21.15.175:0/2024538041 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fce88054b90 con 0x7fce9015af20 2024-04-25T09:04:46.669 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:04:46.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.678+0000 7fce96a00640 1 -- 172.21.15.175:0/2024538041 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fce70066f60 msgr2=0x7fce70069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.678+0000 7fce96a00640 1 --2- 172.21.15.175:0/2024538041 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fce70066f60 0x7fce70069420 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce80001950 tx=0x7fce800018e0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.678+0000 7fce96a00640 1 -- 172.21.15.175:0/2024538041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce9015af20 msgr2=0x7fce9013c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.678+0000 7fce96a00640 1 --2- 172.21.15.175:0/2024538041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce9015af20 0x7fce9013c710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fce8800c460 tx=0x7fce8800c860 comp rx=0 tx=0).stop 2024-04-25T09:04:46.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.678+0000 7fce96a00640 1 -- 172.21.15.175:0/2024538041 shutdown_connections 2024-04-25T09:04:46.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.678+0000 7fce96a00640 1 --2- 172.21.15.175:0/2024538041 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fce70066f60 0x7fce70069420 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.678+0000 7fce96a00640 1 --2- 172.21.15.175:0/2024538041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce9015af20 0x7fce9013c710 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.678+0000 7fce96a00640 1 --2- 172.21.15.175:0/2024538041 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce900cbe60 0x7fce900ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.678+0000 7fce96a00640 1 --2- 172.21.15.175:0/2024538041 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce900b4630 0x7fce90153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.678+0000 7fce96a00640 1 -- 172.21.15.175:0/2024538041 >> 172.21.15.175:0/2024538041 conn(0x7fce9006ac50 msgr2=0x7fce9015c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:46.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.678+0000 7fce96a00640 1 -- 172.21.15.175:0/2024538041 shutdown_connections 2024-04-25T09:04:46.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.678+0000 7fce96a00640 1 -- 172.21.15.175:0/2024538041 wait complete. 2024-04-25T09:04:46.690 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:46.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.834+0000 7f4190400640 1 Processor -- start 2024-04-25T09:04:46.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.834+0000 7f4190400640 1 -- start start 2024-04-25T09:04:46.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.838+0000 7f4190400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f418815af20 0x7f41880b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.838+0000 7f4190400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418806db60 con 0x7f41880b4630 2024-04-25T09:04:46.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.838+0000 7f4190400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418806de40 con 0x7f41880cbe60 2024-04-25T09:04:46.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.838+0000 7f4190400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41880b4aa0 con 0x7f418815af20 2024-04-25T09:04:46.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.838+0000 7f418d000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f418815af20 0x7f41880b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.838+0000 7f418e400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f41880b4630 0x7f418815c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:51380/0 (socket says 172.21.15.175:51380) 2024-04-25T09:04:46.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.838+0000 7f418d000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f418815af20 0x7f41880b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53840/0 (socket says 172.21.15.175:53840) 2024-04-25T09:04:46.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.838+0000 7f418e400640 1 -- 172.21.15.175:0/3748095531 learned_addr learned my addr 172.21.15.175:0/3748095531 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:46.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.838+0000 7f418d000640 1 -- 172.21.15.175:0/3748095531 >> v1:172.21.15.177:6789/0 conn(0x7f41880cbe60 legacy=0x7f418806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.838+0000 7f418d000640 1 -- 172.21.15.175:0/3748095531 >> v1:172.21.15.175:6789/0 conn(0x7f41880b4630 legacy=0x7f418815c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.838+0000 7f418d000640 1 -- 172.21.15.175:0/3748095531 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418806e120 con 0x7f418815af20 2024-04-25T09:04:46.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f418d000640 1 --2- 172.21.15.175:0/3748095531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f418815af20 0x7f41880b40f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f41740097c0 tx=0x7f417401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea4014b0812c5e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:46.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f4187e00640 1 -- 172.21.15.175:0/3748095531 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740b1070 con 0x7f418815af20 2024-04-25T09:04:46.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f4187e00640 1 -- 172.21.15.175:0/3748095531 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41740ac410 con 0x7f418815af20 2024-04-25T09:04:46.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f4187e00640 1 -- 172.21.15.175:0/3748095531 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740ac7e0 con 0x7f418815af20 2024-04-25T09:04:46.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f4190400640 1 -- 172.21.15.175:0/3748095531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f418815af20 msgr2=0x7f41880b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f4190400640 1 --2- 172.21.15.175:0/3748095531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f418815af20 0x7f41880b40f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f41740097c0 tx=0x7f417401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f4190400640 1 -- 172.21.15.175:0/3748095531 shutdown_connections 2024-04-25T09:04:46.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f4190400640 1 --2- 172.21.15.175:0/3748095531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f418815af20 0x7f41880b40f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f4190400640 1 -- 172.21.15.175:0/3748095531 >> 172.21.15.175:0/3748095531 conn(0x7f418806ac50 msgr2=0x7f418806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:46.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f4190400640 1 -- 172.21.15.175:0/3748095531 shutdown_connections 2024-04-25T09:04:46.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f4190400640 1 -- 172.21.15.175:0/3748095531 wait complete. 2024-04-25T09:04:46.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f4190400640 1 Processor -- start 2024-04-25T09:04:46.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f4190400640 1 -- start start 2024-04-25T09:04:46.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f4190400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41880b4630 0x7f418813be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f4190400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41880cbe60 0x7f41880cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f4190400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f418815af20 0x7f41880cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f4190400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418815db40 con 0x7f41880cbe60 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f4190400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418815d9c0 con 0x7f41880b4630 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.842+0000 7f4190400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4188168570 con 0x7f418815af20 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f418d000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41880cbe60 0x7f41880cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f418d000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41880cbe60 0x7f41880cd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53852/0 (socket says 172.21.15.175:53852) 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f418d000640 1 -- 172.21.15.175:0/636939064 learned_addr learned my addr 172.21.15.175:0/636939064 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f418da00640 1 --2- 172.21.15.175:0/636939064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41880b4630 0x7f418813be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f418e400640 1 --2- 172.21.15.175:0/636939064 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f418815af20 0x7f41880cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f418d000640 1 -- 172.21.15.175:0/636939064 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f418815af20 msgr2=0x7f41880cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f418d000640 1 --2- 172.21.15.175:0/636939064 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f418815af20 0x7f41880cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f418d000640 1 -- 172.21.15.175:0/636939064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41880b4630 msgr2=0x7f418813be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f418d000640 1 --2- 172.21.15.175:0/636939064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41880b4630 0x7f418813be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f418d000640 1 -- 172.21.15.175:0/636939064 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41880ce3c0 con 0x7f41880cbe60 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f418d000640 1 --2- 172.21.15.175:0/636939064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41880cbe60 0x7f41880cd850 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f41740190b0 tx=0x7f4174019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f4185600640 1 -- 172.21.15.175:0/636939064 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740b1040 con 0x7f41880cbe60 2024-04-25T09:04:46.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f4185600640 1 -- 172.21.15.175:0/636939064 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41740bb070 con 0x7f41880cbe60 2024-04-25T09:04:46.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f4190400640 1 -- 172.21.15.175:0/636939064 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41880ce6a0 con 0x7f41880cbe60 2024-04-25T09:04:46.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f4185600640 1 -- 172.21.15.175:0/636939064 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41740b5650 con 0x7f41880cbe60 2024-04-25T09:04:46.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f4190400640 1 -- 172.21.15.175:0/636939064 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41880af580 con 0x7f41880cbe60 2024-04-25T09:04:46.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f4190400640 1 -- 172.21.15.175:0/636939064 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4188075160 con 0x7f41880cbe60 2024-04-25T09:04:46.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f4185600640 1 -- 172.21.15.175:0/636939064 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f41740b57f0 con 0x7f41880cbe60 2024-04-25T09:04:46.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.846+0000 7f4185600640 1 --2- 172.21.15.175:0/636939064 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4168066f60 0x7f4168069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:46.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.850+0000 7f4185600640 1 -- 172.21.15.175:0/636939064 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f417411ed30 con 0x7f41880cbe60 2024-04-25T09:04:46.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.850+0000 7f418da00640 1 --2- 172.21.15.175:0/636939064 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4168066f60 0x7f4168069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:46.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.850+0000 7f418da00640 1 --2- 172.21.15.175:0/636939064 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4168066f60 0x7f4168069420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f417c000f70 tx=0x7f417c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:46.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:46.854+0000 7f4185600640 1 -- 172.21.15.175:0/636939064 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4174016090 con 0x7f41880cbe60 2024-04-25T09:04:46.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.006+0000 7f4190400640 1 -- 172.21.15.175:0/636939064 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f418806b370 con 0x7f41880cbe60 2024-04-25T09:04:46.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.006+0000 7f4185600640 1 -- 172.21.15.175:0/636939064 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f41740efc10 con 0x7f41880cbe60 2024-04-25T09:04:46.999 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:04:47.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.006+0000 7f4190400640 1 -- 172.21.15.175:0/636939064 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4168066f60 msgr2=0x7f4168069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.006+0000 7f4190400640 1 --2- 172.21.15.175:0/636939064 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4168066f60 0x7f4168069420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f417c000f70 tx=0x7f417c009040 comp rx=0 tx=0).stop 2024-04-25T09:04:47.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.006+0000 7f4190400640 1 -- 172.21.15.175:0/636939064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41880cbe60 msgr2=0x7f41880cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.006+0000 7f4190400640 1 --2- 172.21.15.175:0/636939064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41880cbe60 0x7f41880cd850 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f41740190b0 tx=0x7f4174019240 comp rx=0 tx=0).stop 2024-04-25T09:04:47.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.006+0000 7f4190400640 1 -- 172.21.15.175:0/636939064 shutdown_connections 2024-04-25T09:04:47.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.006+0000 7f4190400640 1 --2- 172.21.15.175:0/636939064 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4168066f60 0x7f4168069420 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.006+0000 7f4190400640 1 --2- 172.21.15.175:0/636939064 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f418815af20 0x7f41880cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.006+0000 7f4190400640 1 --2- 172.21.15.175:0/636939064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41880cbe60 0x7f41880cd850 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.006+0000 7f4190400640 1 --2- 172.21.15.175:0/636939064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41880b4630 0x7f418813be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.006+0000 7f4190400640 1 -- 172.21.15.175:0/636939064 >> 172.21.15.175:0/636939064 conn(0x7f418806ac50 msgr2=0x7f418815b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:47.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.010+0000 7f4190400640 1 -- 172.21.15.175:0/636939064 shutdown_connections 2024-04-25T09:04:47.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.010+0000 7f4190400640 1 -- 172.21.15.175:0/636939064 wait complete. 2024-04-25T09:04:47.021 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:47.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.166+0000 7f2e6a800640 1 Processor -- start 2024-04-25T09:04:47.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.166+0000 7f2e6a800640 1 -- start start 2024-04-25T09:04:47.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.166+0000 7f2e6a800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2e6415af20 0x7f2e640b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.166+0000 7f2e6a800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2e640b4630 0x7f2e6415c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.166+0000 7f2e6a800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6406db60 con 0x7f2e640cbe60 2024-04-25T09:04:47.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.166+0000 7f2e6a800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e640b4aa0 con 0x7f2e6415af20 2024-04-25T09:04:47.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.166+0000 7f2e6a800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6406de40 con 0x7f2e640b4630 2024-04-25T09:04:47.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.166+0000 7f2e63400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f2e640cbe60 0x7f2e6406d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:51392/0 (socket says 172.21.15.175:51392) 2024-04-25T09:04:47.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.166+0000 7f2e63400640 1 -- 172.21.15.175:0/4118075880 learned_addr learned my addr 172.21.15.175:0/4118075880 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:47.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.166+0000 7f2e5be00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2e6415af20 0x7f2e640b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.170+0000 7f2e63e00640 1 --2- 172.21.15.175:0/4118075880 >> v2:172.21.15.177:3300/0 conn(0x7f2e640b4630 0x7f2e6415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.170+0000 7f2e62a00640 1 -- 172.21.15.175:0/4118075880 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635303964 0 0) 0x7f2e6406db60 con 0x7f2e640cbe60 2024-04-25T09:04:47.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.170+0000 7f2e62a00640 1 -- 172.21.15.175:0/4118075880 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e48003530 con 0x7f2e640cbe60 2024-04-25T09:04:47.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.170+0000 7f2e5be00640 1 -- 172.21.15.175:0/4118075880 >> v2:172.21.15.177:3300/0 conn(0x7f2e640b4630 msgr2=0x7f2e6415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:47.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.170+0000 7f2e5be00640 1 --2- 172.21.15.175:0/4118075880 >> v2:172.21.15.177:3300/0 conn(0x7f2e640b4630 0x7f2e6415c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.170+0000 7f2e5be00640 1 -- 172.21.15.175:0/4118075880 >> v1:172.21.15.175:6789/0 conn(0x7f2e640cbe60 legacy=0x7f2e6406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.170+0000 7f2e5be00640 1 -- 172.21.15.175:0/4118075880 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6406e120 con 0x7f2e6415af20 2024-04-25T09:04:47.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.170+0000 7f2e5be00640 1 --2- 172.21.15.175:0/4118075880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e6415af20 0x7f2e640b40f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2e640b3700 tx=0x7f2e4c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a0d881794984db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:47.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.170+0000 7f2e62a00640 1 -- 172.21.15.175:0/4118075880 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0b1070 con 0x7f2e6415af20 2024-04-25T09:04:47.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.170+0000 7f2e62a00640 1 -- 172.21.15.175:0/4118075880 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c0ac5f0 con 0x7f2e6415af20 2024-04-25T09:04:47.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.170+0000 7f2e62a00640 1 -- 172.21.15.175:0/4118075880 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0ac9c0 con 0x7f2e6415af20 2024-04-25T09:04:47.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e6a800640 1 -- 172.21.15.175:0/4118075880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e6415af20 msgr2=0x7f2e640b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e6a800640 1 --2- 172.21.15.175:0/4118075880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e6415af20 0x7f2e640b40f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2e640b3700 tx=0x7f2e4c01c480 comp rx=0 tx=0).stop 2024-04-25T09:04:47.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e6a800640 1 -- 172.21.15.175:0/4118075880 shutdown_connections 2024-04-25T09:04:47.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e6a800640 1 --2- 172.21.15.175:0/4118075880 >> v2:172.21.15.177:3300/0 conn(0x7f2e640b4630 0x7f2e6415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e6a800640 1 --2- 172.21.15.175:0/4118075880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e6415af20 0x7f2e640b40f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e6a800640 1 -- 172.21.15.175:0/4118075880 >> 172.21.15.175:0/4118075880 conn(0x7f2e6406ac50 msgr2=0x7f2e6406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:47.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e6a800640 1 -- 172.21.15.175:0/4118075880 shutdown_connections 2024-04-25T09:04:47.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e6a800640 1 -- 172.21.15.175:0/4118075880 wait complete. 2024-04-25T09:04:47.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e6a800640 1 Processor -- start 2024-04-25T09:04:47.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e6a800640 1 -- start start 2024-04-25T09:04:47.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e6a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e640b4630 0x7f2e64141430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e6a800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e640cbe60 0x7f2e6415e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e6a800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e6415af20 0x7f2e6415e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e6a800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6415d930 con 0x7f2e640b4630 2024-04-25T09:04:47.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e6a800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6415d7b0 con 0x7f2e640cbe60 2024-04-25T09:04:47.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e6a800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6415dab0 con 0x7f2e6415af20 2024-04-25T09:04:47.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e63400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e640b4630 0x7f2e64141430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e63400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e640b4630 0x7f2e64141430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53874/0 (socket says 172.21.15.175:53874) 2024-04-25T09:04:47.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e63400640 1 -- 172.21.15.175:0/1055206849 learned_addr learned my addr 172.21.15.175:0/1055206849 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:47.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e5be00640 1 --2- 172.21.15.175:0/1055206849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e640cbe60 0x7f2e6415e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e63e00640 1 --2- 172.21.15.175:0/1055206849 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e6415af20 0x7f2e6415e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e63400640 1 -- 172.21.15.175:0/1055206849 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e6415af20 msgr2=0x7f2e6415e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e63400640 1 --2- 172.21.15.175:0/1055206849 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e6415af20 0x7f2e6415e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e63400640 1 -- 172.21.15.175:0/1055206849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e640cbe60 msgr2=0x7f2e6415e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e63400640 1 --2- 172.21.15.175:0/1055206849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e640cbe60 0x7f2e6415e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e63400640 1 -- 172.21.15.175:0/1055206849 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e64141ea0 con 0x7f2e640b4630 2024-04-25T09:04:47.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e63e00640 1 --2- 172.21.15.175:0/1055206849 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e6415af20 0x7f2e6415e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:47.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.174+0000 7f2e63400640 1 --2- 172.21.15.175:0/1055206849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e640b4630 0x7f2e64141430 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400c3c0 tx=0x7f2e5400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:47.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.178+0000 7f2e5b400640 1 -- 172.21.15.175:0/1055206849 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e54017070 con 0x7f2e640b4630 2024-04-25T09:04:47.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.178+0000 7f2e5b400640 1 -- 172.21.15.175:0/1055206849 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e54005cf0 con 0x7f2e640b4630 2024-04-25T09:04:47.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.178+0000 7f2e5b400640 1 -- 172.21.15.175:0/1055206849 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e540072f0 con 0x7f2e640b4630 2024-04-25T09:04:47.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.178+0000 7f2e6a800640 1 -- 172.21.15.175:0/1055206849 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e64144a80 con 0x7f2e640b4630 2024-04-25T09:04:47.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.178+0000 7f2e6a800640 1 -- 172.21.15.175:0/1055206849 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e64141970 con 0x7f2e640b4630 2024-04-25T09:04:47.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.178+0000 7f2e6a800640 1 -- 172.21.15.175:0/1055206849 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e64075160 con 0x7f2e640b4630 2024-04-25T09:04:47.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.178+0000 7f2e5b400640 1 -- 172.21.15.175:0/1055206849 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2e5401a070 con 0x7f2e640b4630 2024-04-25T09:04:47.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.178+0000 7f2e5b400640 1 --2- 172.21.15.175:0/1055206849 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e40066f60 0x7f2e40069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.178+0000 7f2e5b400640 1 -- 172.21.15.175:0/1055206849 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e540844d0 con 0x7f2e640b4630 2024-04-25T09:04:47.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.178+0000 7f2e5be00640 1 --2- 172.21.15.175:0/1055206849 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e40066f60 0x7f2e40069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.178+0000 7f2e5be00640 1 --2- 172.21.15.175:0/1055206849 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e40066f60 0x7f2e40069420 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0ae000 tx=0x7f2e4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:47.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.182+0000 7f2e5b400640 1 -- 172.21.15.175:0/1055206849 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2e54055440 con 0x7f2e640b4630 2024-04-25T09:04:47.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.338+0000 7f2e6a800640 1 -- 172.21.15.175:0/1055206849 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2e6415a720 con 0x7f2e640b4630 2024-04-25T09:04:47.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.338+0000 7f2e5b400640 1 -- 172.21.15.175:0/1055206849 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2e54054d40 con 0x7f2e640b4630 2024-04-25T09:04:47.332 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:04:47.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.342+0000 7f2e6a800640 1 -- 172.21.15.175:0/1055206849 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e40066f60 msgr2=0x7f2e40069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.342+0000 7f2e6a800640 1 --2- 172.21.15.175:0/1055206849 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e40066f60 0x7f2e40069420 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0ae000 tx=0x7f2e4c008040 comp rx=0 tx=0).stop 2024-04-25T09:04:47.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.342+0000 7f2e6a800640 1 -- 172.21.15.175:0/1055206849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e640b4630 msgr2=0x7f2e64141430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.342+0000 7f2e6a800640 1 --2- 172.21.15.175:0/1055206849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e640b4630 0x7f2e64141430 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400c3c0 tx=0x7f2e5400c880 comp rx=0 tx=0).stop 2024-04-25T09:04:47.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.342+0000 7f2e6a800640 1 -- 172.21.15.175:0/1055206849 shutdown_connections 2024-04-25T09:04:47.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.342+0000 7f2e6a800640 1 --2- 172.21.15.175:0/1055206849 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e40066f60 0x7f2e40069420 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.342+0000 7f2e6a800640 1 --2- 172.21.15.175:0/1055206849 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e6415af20 0x7f2e6415e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.342+0000 7f2e6a800640 1 --2- 172.21.15.175:0/1055206849 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e640cbe60 0x7f2e6415e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.342+0000 7f2e6a800640 1 --2- 172.21.15.175:0/1055206849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e640b4630 0x7f2e64141430 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.342+0000 7f2e6a800640 1 -- 172.21.15.175:0/1055206849 >> 172.21.15.175:0/1055206849 conn(0x7f2e6406ac50 msgr2=0x7f2e640b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:47.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.342+0000 7f2e6a800640 1 -- 172.21.15.175:0/1055206849 shutdown_connections 2024-04-25T09:04:47.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.342+0000 7f2e6a800640 1 -- 172.21.15.175:0/1055206849 wait complete. 2024-04-25T09:04:47.353 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:04:47.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5bad000640 1 Processor -- start 2024-04-25T09:04:47.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5bad000640 1 -- start start 2024-04-25T09:04:47.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5bad000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5ba8145250 0x7f5ba80cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5bad000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ba80ce970 0x7f5ba80cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5bad000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba80cfd10 con 0x7f5ba81600a0 2024-04-25T09:04:47.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5bad000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba815f650 con 0x7f5ba8145250 2024-04-25T09:04:47.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5bad000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba80cfff0 con 0x7f5ba80ce970 2024-04-25T09:04:47.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5b9d400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5ba81600a0 0x7f5ba80cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:51400/0 (socket says 172.21.15.175:51400) 2024-04-25T09:04:47.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5b9d400640 1 -- 172.21.15.175:0/1631993287 learned_addr learned my addr 172.21.15.175:0/1631993287 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:47.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5e00640 1 --2- 172.21.15.175:0/1631993287 >> v2:172.21.15.177:3300/0 conn(0x7f5ba8145250 0x7f5ba80cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba6800640 1 --2- 172.21.15.175:0/1631993287 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ba80ce970 0x7f5ba80cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5400640 1 -- 172.21.15.175:0/1631993287 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124569506 0 0) 0x7f5ba80cfd10 con 0x7f5ba81600a0 2024-04-25T09:04:47.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5400640 1 -- 172.21.15.175:0/1631993287 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b8c003530 con 0x7f5ba81600a0 2024-04-25T09:04:47.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5400640 1 -- 172.21.15.175:0/1631993287 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2709646863 0 0) 0x7f5b8c003530 con 0x7f5ba81600a0 2024-04-25T09:04:47.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5400640 1 -- 172.21.15.175:0/1631993287 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ba80ce970 msgr2=0x7f5ba80cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:47.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5400640 1 --2- 172.21.15.175:0/1631993287 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ba80ce970 0x7f5ba80cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5400640 1 -- 172.21.15.175:0/1631993287 >> v2:172.21.15.177:3300/0 conn(0x7f5ba8145250 msgr2=0x7f5ba80cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:47.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5400640 1 --2- 172.21.15.175:0/1631993287 >> v2:172.21.15.177:3300/0 conn(0x7f5ba8145250 0x7f5ba80cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5400640 1 -- 172.21.15.175:0/1631993287 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba815f8a0 con 0x7f5ba81600a0 2024-04-25T09:04:47.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5400640 1 -- 172.21.15.175:0/1631993287 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f5b90001680 con 0x7f5ba81600a0 2024-04-25T09:04:47.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5400640 1 -- 172.21.15.175:0/1631993287 >> v1:172.21.15.175:6789/0 conn(0x7f5ba81600a0 legacy=0x7f5ba80cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5400640 1 --2- 172.21.15.175:0/1631993287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b8c0039c0 0x7f5b8c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5400640 1 --2- 172.21.15.175:0/1631993287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b8c004810 0x7f5b8c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5400640 1 --2- 172.21.15.175:0/1631993287 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ba80ce970 0x7f5b8c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5400640 1 -- 172.21.15.175:0/1631993287 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba815f650 con 0x7f5b8c004810 2024-04-25T09:04:47.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5400640 1 -- 172.21.15.175:0/1631993287 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba80cfff0 con 0x7f5b8c0039c0 2024-04-25T09:04:47.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5400640 1 -- 172.21.15.175:0/1631993287 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c00b9d0 con 0x7f5ba80ce970 2024-04-25T09:04:47.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5b9d400640 1 --2- 172.21.15.175:0/1631993287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b8c004810 0x7f5b8c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5e00640 1 --2- 172.21.15.175:0/1631993287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b8c0039c0 0x7f5b8c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba6800640 1 --2- 172.21.15.175:0/1631993287 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ba80ce970 0x7f5b8c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5b9d400640 1 -- 172.21.15.175:0/1631993287 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ba80ce970 msgr2=0x7f5b8c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:47.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5b9d400640 1 --2- 172.21.15.175:0/1631993287 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ba80ce970 0x7f5b8c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5b9d400640 1 -- 172.21.15.175:0/1631993287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b8c0039c0 msgr2=0x7f5b8c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:47.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5b9d400640 1 --2- 172.21.15.175:0/1631993287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b8c0039c0 0x7f5b8c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5b9d400640 1 -- 172.21.15.175:0/1631993287 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c003530 con 0x7f5b8c004810 2024-04-25T09:04:47.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.498+0000 7f5ba5e00640 1 --2- 172.21.15.175:0/1631993287 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b8c0039c0 0x7f5b8c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:47.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.502+0000 7f5b9d400640 1 --2- 172.21.15.175:0/1631993287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b8c004810 0x7f5b8c004c90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000c1f0 tx=0x7f5b9001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4855b9fcca55bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:47.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.502+0000 7f5ba5400640 1 -- 172.21.15.175:0/1631993287 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90007d00 con 0x7f5b8c004810 2024-04-25T09:04:47.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.502+0000 7f5ba5400640 1 -- 172.21.15.175:0/1631993287 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b900a9020 con 0x7f5b8c004810 2024-04-25T09:04:47.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.502+0000 7f5ba5400640 1 -- 172.21.15.175:0/1631993287 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90005ae0 con 0x7f5b8c004810 2024-04-25T09:04:47.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.502+0000 7f5bad000640 1 -- 172.21.15.175:0/1631993287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b8c004810 msgr2=0x7f5b8c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.502+0000 7f5bad000640 1 --2- 172.21.15.175:0/1631993287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b8c004810 0x7f5b8c004c90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000c1f0 tx=0x7f5b9001cc30 comp rx=0 tx=0).stop 2024-04-25T09:04:47.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.502+0000 7f5ba6800640 1 -- 172.21.15.175:0/1631993287 reap_dead start 2024-04-25T09:04:47.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.502+0000 7f5bad000640 1 -- 172.21.15.175:0/1631993287 shutdown_connections 2024-04-25T09:04:47.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.502+0000 7f5bad000640 1 -- 172.21.15.175:0/1631993287 >> 172.21.15.175:0/1631993287 conn(0x7f5ba806ac50 msgr2=0x7f5ba806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:47.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.502+0000 7f5bad000640 1 -- 172.21.15.175:0/1631993287 shutdown_connections 2024-04-25T09:04:47.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.502+0000 7f5bad000640 1 -- 172.21.15.175:0/1631993287 wait complete. 2024-04-25T09:04:47.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5bad000640 1 Processor -- start 2024-04-25T09:04:47.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5bad000640 1 -- start start 2024-04-25T09:04:47.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5bad000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b8c004810 0x7f5ba815b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5bad000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ba8140130 0x7f5ba81405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5bad000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ba815e490 0x7f5ba815e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5bad000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba815c1e0 con 0x7f5ba815e490 2024-04-25T09:04:47.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5bad000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba815c060 con 0x7f5b8c004810 2024-04-25T09:04:47.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5bad000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba815c360 con 0x7f5ba8140130 2024-04-25T09:04:47.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5ba6800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ba815e490 0x7f5ba815e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5ba6800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ba815e490 0x7f5ba815e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53890/0 (socket says 172.21.15.175:53890) 2024-04-25T09:04:47.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5ba6800640 1 -- 172.21.15.175:0/1333366464 learned_addr learned my addr 172.21.15.175:0/1333366464 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:47.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5ba5e00640 1 --2- 172.21.15.175:0/1333366464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b8c004810 0x7f5ba815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5b9d400640 1 --2- 172.21.15.175:0/1333366464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ba8140130 0x7f5ba81405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5ba6800640 1 -- 172.21.15.175:0/1333366464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ba8140130 msgr2=0x7f5ba81405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5ba6800640 1 --2- 172.21.15.175:0/1333366464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ba8140130 0x7f5ba81405b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5ba6800640 1 -- 172.21.15.175:0/1333366464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b8c004810 msgr2=0x7f5ba815b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5ba6800640 1 --2- 172.21.15.175:0/1333366464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b8c004810 0x7f5ba815b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5ba6800640 1 -- 172.21.15.175:0/1333366464 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba815c7a0 con 0x7f5ba815e490 2024-04-25T09:04:47.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5ba5e00640 1 --2- 172.21.15.175:0/1333366464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b8c004810 0x7f5ba815b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:47.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5ba6800640 1 --2- 172.21.15.175:0/1333366464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ba815e490 0x7f5ba815e910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8160480 tx=0x7f5ba000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:47.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5b9ea00640 1 -- 172.21.15.175:0/1333366464 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b980096b0 con 0x7f5ba815e490 2024-04-25T09:04:47.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5b9ea00640 1 -- 172.21.15.175:0/1333366464 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba001d070 con 0x7f5ba815e490 2024-04-25T09:04:47.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5b9ea00640 1 -- 172.21.15.175:0/1333366464 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0015430 con 0x7f5ba815e490 2024-04-25T09:04:47.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5bad000640 1 -- 172.21.15.175:0/1333366464 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba815ca40 con 0x7f5ba815e490 2024-04-25T09:04:47.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.506+0000 7f5bad000640 1 -- 172.21.15.175:0/1333366464 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba815d000 con 0x7f5ba815e490 2024-04-25T09:04:47.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.510+0000 7f5bad000640 1 -- 172.21.15.175:0/1333366464 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba8075160 con 0x7f5ba815e490 2024-04-25T09:04:47.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.510+0000 7f5b9ea00640 1 -- 172.21.15.175:0/1333366464 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5ba00155d0 con 0x7f5ba815e490 2024-04-25T09:04:47.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.510+0000 7f5b9ea00640 1 --2- 172.21.15.175:0/1333366464 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5b84066f90 0x7f5b84069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.510+0000 7f5b9ea00640 1 -- 172.21.15.175:0/1333366464 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ba00857a0 con 0x7f5ba815e490 2024-04-25T09:04:47.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.510+0000 7f5ba5e00640 1 --2- 172.21.15.175:0/1333366464 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5b84066f90 0x7f5b84069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.510+0000 7f5ba5e00640 1 --2- 172.21.15.175:0/1333366464 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5b84066f90 0x7f5b84069450 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5ba813ff80 tx=0x7f5b98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:47.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.514+0000 7f5b9ea00640 1 -- 172.21.15.175:0/1333366464 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5ba0010040 con 0x7f5ba815e490 2024-04-25T09:04:47.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.678+0000 7f5bad000640 1 -- 172.21.15.175:0/1333366464 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5ba80b0970 con 0x7f5ba815e490 2024-04-25T09:04:47.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.678+0000 7f5b9ea00640 1 -- 172.21.15.175:0/1333366464 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5ba0056710 con 0x7f5ba815e490 2024-04-25T09:04:47.671 INFO:teuthology.orchestra.run.smithi175.stderr:listed 0 entries 2024-04-25T09:04:47.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.682+0000 7f5bad000640 1 -- 172.21.15.175:0/1333366464 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5b84066f90 msgr2=0x7f5b84069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.682+0000 7f5bad000640 1 --2- 172.21.15.175:0/1333366464 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5b84066f90 0x7f5b84069450 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5ba813ff80 tx=0x7f5b98008040 comp rx=0 tx=0).stop 2024-04-25T09:04:47.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.682+0000 7f5bad000640 1 -- 172.21.15.175:0/1333366464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ba815e490 msgr2=0x7f5ba815e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.682+0000 7f5bad000640 1 --2- 172.21.15.175:0/1333366464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ba815e490 0x7f5ba815e910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8160480 tx=0x7f5ba000f580 comp rx=0 tx=0).stop 2024-04-25T09:04:47.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.682+0000 7f5bad000640 1 -- 172.21.15.175:0/1333366464 shutdown_connections 2024-04-25T09:04:47.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.682+0000 7f5bad000640 1 --2- 172.21.15.175:0/1333366464 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5b84066f90 0x7f5b84069450 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.682+0000 7f5bad000640 1 --2- 172.21.15.175:0/1333366464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ba815e490 0x7f5ba815e910 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.682+0000 7f5bad000640 1 --2- 172.21.15.175:0/1333366464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ba8140130 0x7f5ba81405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.682+0000 7f5bad000640 1 --2- 172.21.15.175:0/1333366464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b8c004810 0x7f5ba815b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.682+0000 7f5bad000640 1 -- 172.21.15.175:0/1333366464 >> 172.21.15.175:0/1333366464 conn(0x7f5ba806ac50 msgr2=0x7f5ba8144270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:47.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.682+0000 7f5bad000640 1 -- 172.21.15.175:0/1333366464 shutdown_connections 2024-04-25T09:04:47.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.682+0000 7f5bad000640 1 -- 172.21.15.175:0/1333366464 wait complete. 2024-04-25T09:04:47.692 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-25T09:04:47.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:47.693 DEBUG:teuthology.orchestra.run.smithi177:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-25T09:04:47.720 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2024-04-25T09:04:47.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:47.720 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-25T09:04:47.774 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:04:47.775 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:47.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.918+0000 7f3ec9800640 1 Processor -- start 2024-04-25T09:04:47.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.918+0000 7f3ec9800640 1 -- start start 2024-04-25T09:04:47.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.922+0000 7f3ec9800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3ec4144fc0 0x7f3ec40cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.922+0000 7f3ec9800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ec41453a0 0x7f3ec415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.922+0000 7f3ec9800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3ec40cc3b0 0x7f3ec415c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.922+0000 7f3ec9800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec415cd00 con 0x7f3ec40cc3b0 2024-04-25T09:04:47.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.922+0000 7f3ec9800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec40ce660 con 0x7f3ec4144fc0 2024-04-25T09:04:47.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.922+0000 7f3ec9800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec40cc930 con 0x7f3ec41453a0 2024-04-25T09:04:47.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.922+0000 7f3ec3400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3ec40cc3b0 0x7f3ec415c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.922+0000 7f3ec3400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3ec40cc3b0 0x7f3ec415c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53906/0 (socket says 172.21.15.175:53906) 2024-04-25T09:04:47.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.922+0000 7f3ec3400640 1 -- 172.21.15.175:0/3115547924 learned_addr learned my addr 172.21.15.175:0/3115547924 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:47.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.922+0000 7f3ec2a00640 1 --2- 172.21.15.175:0/3115547924 >> v2:172.21.15.177:3300/0 conn(0x7f3ec4144fc0 0x7f3ec40cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.922+0000 7f3eba000640 1 --2- 172.21.15.175:0/3115547924 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ec41453a0 0x7f3ec415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.922+0000 7f3ec3400640 1 -- 172.21.15.175:0/3115547924 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ec41453a0 msgr2=0x7f3ec415bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:47.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.922+0000 7f3ec3400640 1 --2- 172.21.15.175:0/3115547924 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ec41453a0 0x7f3ec415bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.922+0000 7f3ec3400640 1 -- 172.21.15.175:0/3115547924 >> v2:172.21.15.177:3300/0 conn(0x7f3ec4144fc0 msgr2=0x7f3ec40cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:47.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.922+0000 7f3ec3400640 1 --2- 172.21.15.175:0/3115547924 >> v2:172.21.15.177:3300/0 conn(0x7f3ec4144fc0 0x7f3ec40cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.922+0000 7f3ec3400640 1 -- 172.21.15.175:0/3115547924 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec40ccc10 con 0x7f3ec40cc3b0 2024-04-25T09:04:47.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec3400640 1 --2- 172.21.15.175:0/3115547924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ec40cc3b0 0x7f3ec415c410 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40b4c00 tx=0x7f3ebc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4ee600d88472c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:47.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec2000640 1 -- 172.21.15.175:0/3115547924 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc0a5780 con 0x7f3ec40cc3b0 2024-04-25T09:04:47.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec2000640 1 -- 172.21.15.175:0/3115547924 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc0a5920 con 0x7f3ec40cc3b0 2024-04-25T09:04:47.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec2000640 1 -- 172.21.15.175:0/3115547924 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc0a5cf0 con 0x7f3ec40cc3b0 2024-04-25T09:04:47.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec9800640 1 -- 172.21.15.175:0/3115547924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ec40cc3b0 msgr2=0x7f3ec415c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec9800640 1 --2- 172.21.15.175:0/3115547924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ec40cc3b0 0x7f3ec415c410 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3ec40b4c00 tx=0x7f3ebc01c9f0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec9800640 1 -- 172.21.15.175:0/3115547924 shutdown_connections 2024-04-25T09:04:47.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec9800640 1 --2- 172.21.15.175:0/3115547924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ec40cc3b0 0x7f3ec415c410 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec9800640 1 --2- 172.21.15.175:0/3115547924 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ec41453a0 0x7f3ec415bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec9800640 1 --2- 172.21.15.175:0/3115547924 >> v2:172.21.15.177:3300/0 conn(0x7f3ec4144fc0 0x7f3ec40cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec9800640 1 -- 172.21.15.175:0/3115547924 >> 172.21.15.175:0/3115547924 conn(0x7f3ec4067150 msgr2=0x7f3ec406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:47.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec9800640 1 -- 172.21.15.175:0/3115547924 shutdown_connections 2024-04-25T09:04:47.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec9800640 1 -- 172.21.15.175:0/3115547924 wait complete. 2024-04-25T09:04:47.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec9800640 1 Processor -- start 2024-04-25T09:04:47.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec9800640 1 -- start start 2024-04-25T09:04:47.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec9800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ec4144fc0 0x7f3ec413fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec9800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ec41453a0 0x7f3ec4164c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec9800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ec4158af0 0x7f3ec4158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec9800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec4160020 con 0x7f3ec4158af0 2024-04-25T09:04:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec9800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec415fea0 con 0x7f3ec41453a0 2024-04-25T09:04:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.926+0000 7f3ec9800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec41601a0 con 0x7f3ec4144fc0 2024-04-25T09:04:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.930+0000 7f3ec3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ec4158af0 0x7f3ec4158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.930+0000 7f3ec3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ec4158af0 0x7f3ec4158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53916/0 (socket says 172.21.15.175:53916) 2024-04-25T09:04:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.930+0000 7f3ec2a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ec4144fc0 0x7f3ec413fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.930+0000 7f3ec3400640 1 -- 172.21.15.175:0/3947937675 learned_addr learned my addr 172.21.15.175:0/3947937675 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.930+0000 7f3eba000640 1 --2- 172.21.15.175:0/3947937675 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ec41453a0 0x7f3ec4164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.930+0000 7f3ec3400640 1 -- 172.21.15.175:0/3947937675 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ec4144fc0 msgr2=0x7f3ec413fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.930+0000 7f3ec3400640 1 --2- 172.21.15.175:0/3947937675 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ec4144fc0 0x7f3ec413fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.930+0000 7f3ec3400640 1 -- 172.21.15.175:0/3947937675 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ec41453a0 msgr2=0x7f3ec4164c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.930+0000 7f3ec3400640 1 --2- 172.21.15.175:0/3947937675 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ec41453a0 0x7f3ec4164c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.930+0000 7f3ec3400640 1 -- 172.21.15.175:0/3947937675 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec4153bc0 con 0x7f3ec4158af0 2024-04-25T09:04:47.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.930+0000 7f3ec3400640 1 --2- 172.21.15.175:0/3947937675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ec4158af0 0x7f3ec4158f80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0af040 tx=0x7f3ebc019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:47.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.930+0000 7f3ebb400640 1 -- 172.21.15.175:0/3947937675 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc009510 con 0x7f3ec4158af0 2024-04-25T09:04:47.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.930+0000 7f3ebb400640 1 -- 172.21.15.175:0/3947937675 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ebc0be070 con 0x7f3ec4158af0 2024-04-25T09:04:47.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.930+0000 7f3ebb400640 1 -- 172.21.15.175:0/3947937675 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc0b88f0 con 0x7f3ec4158af0 2024-04-25T09:04:47.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.930+0000 7f3ec9800640 1 -- 172.21.15.175:0/3947937675 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec4153ea0 con 0x7f3ec4158af0 2024-04-25T09:04:47.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.930+0000 7f3ec9800640 1 -- 172.21.15.175:0/3947937675 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec4154460 con 0x7f3ec4158af0 2024-04-25T09:04:47.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.930+0000 7f3ec9800640 1 -- 172.21.15.175:0/3947937675 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec4074a60 con 0x7f3ec4158af0 2024-04-25T09:04:47.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.930+0000 7f3ebb400640 1 -- 172.21.15.175:0/3947937675 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3ebc0b8a90 con 0x7f3ec4158af0 2024-04-25T09:04:47.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.934+0000 7f3ebb400640 1 --2- 172.21.15.175:0/3947937675 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ea0066f60 0x7f3ea0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:47.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.934+0000 7f3ebb400640 1 -- 172.21.15.175:0/3947937675 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ebc11fe70 con 0x7f3ec4158af0 2024-04-25T09:04:47.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.934+0000 7f3ec2a00640 1 --2- 172.21.15.175:0/3947937675 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ea0066f60 0x7f3ea0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:47.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.934+0000 7f3ec2a00640 1 --2- 172.21.15.175:0/3947937675 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ea0066f60 0x7f3ea0069420 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009ac0 tx=0x7f3eb4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:47.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:47.938+0000 7f3ebb400640 1 -- 172.21.15.175:0/3947937675 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3ebc0165e0 con 0x7f3ec4158af0 2024-04-25T09:04:48.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.122+0000 7f3ec9800640 1 -- 172.21.15.175:0/3947937675 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ec406c220 con 0x7f3ec4158af0 2024-04-25T09:04:48.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.122+0000 7f3ebb400640 1 -- 172.21.15.175:0/3947937675 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4938 (secure 0 0 0) 0x7f3ebc0f0790 con 0x7f3ec4158af0 2024-04-25T09:04:48.114 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:48.114 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/989886914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":989886914},{"type":"v1","addr":"172.21.15.175:6837","nonce":989886914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/611556493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":611556493},{"type":"v1","addr":"172.21.15.177:6833","nonce":611556493}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1366486960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1366486960},{"type":"v1","addr":"172.21.15.177:6835","nonce":1366486960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:09.810111+0000","modified":"2024-04-25T09:04:12.820376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6836/2613139594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2613139594},{"type":"v1","addr":"172.21.15.175:6836","nonce":2613139594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:04:48.114 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 8 2024-04-25T09:04:48.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.122+0000 7f3ec9800640 1 -- 172.21.15.175:0/3947937675 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ea0066f60 msgr2=0x7f3ea0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.122+0000 7f3ec9800640 1 --2- 172.21.15.175:0/3947937675 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ea0066f60 0x7f3ea0069420 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009ac0 tx=0x7f3eb4009190 comp rx=0 tx=0).stop 2024-04-25T09:04:48.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.122+0000 7f3ec9800640 1 -- 172.21.15.175:0/3947937675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ec4158af0 msgr2=0x7f3ec4158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.122+0000 7f3ec9800640 1 --2- 172.21.15.175:0/3947937675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ec4158af0 0x7f3ec4158f80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0af040 tx=0x7f3ebc019790 comp rx=0 tx=0).stop 2024-04-25T09:04:48.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.122+0000 7f3ec9800640 1 -- 172.21.15.175:0/3947937675 shutdown_connections 2024-04-25T09:04:48.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.122+0000 7f3ec9800640 1 --2- 172.21.15.175:0/3947937675 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ea0066f60 0x7f3ea0069420 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.122+0000 7f3ec9800640 1 --2- 172.21.15.175:0/3947937675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ec4158af0 0x7f3ec4158f80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.122+0000 7f3ec9800640 1 --2- 172.21.15.175:0/3947937675 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ec41453a0 0x7f3ec4164c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.122+0000 7f3ec9800640 1 --2- 172.21.15.175:0/3947937675 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ec4144fc0 0x7f3ec413fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.122+0000 7f3ec9800640 1 -- 172.21.15.175:0/3947937675 >> 172.21.15.175:0/3947937675 conn(0x7f3ec40cc3b0 msgr2=0x7f3ec406ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:48.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.122+0000 7f3ec9800640 1 -- 172.21.15.175:0/3947937675 shutdown_connections 2024-04-25T09:04:48.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.122+0000 7f3ec9800640 1 -- 172.21.15.175:0/3947937675 wait complete. 2024-04-25T09:04:48.135 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:48.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.278+0000 7f7600400640 1 Processor -- start 2024-04-25T09:04:48.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.278+0000 7f7600400640 1 -- start start 2024-04-25T09:04:48.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.278+0000 7f7600400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75f815bc10 0x7f75f80cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.278+0000 7f7600400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f75f809abb0 0x7f75f80cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.278+0000 7f7600400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f80cc4c0 con 0x7f75f8099a50 2024-04-25T09:04:48.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.278+0000 7f7600400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f80d06f0 con 0x7f75f809abb0 2024-04-25T09:04:48.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.278+0000 7f7600400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80cc7a0 con 0x7f75f815bc10 2024-04-25T09:04:48.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.278+0000 7f75fda00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f75f8099a50 0x7f75f8099e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:51416/0 (socket says 172.21.15.175:51416) 2024-04-25T09:04:48.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.278+0000 7f75fda00640 1 -- 172.21.15.175:0/1164929670 learned_addr learned my addr 172.21.15.175:0/1164929670 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:48.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.278+0000 7f75fe400640 1 --2- 172.21.15.175:0/1164929670 >> v2:172.21.15.177:3300/0 conn(0x7f75f809abb0 0x7f75f80cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.278+0000 7f75fd000640 1 --2- 172.21.15.175:0/1164929670 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75f815bc10 0x7f75f80cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.278+0000 7f75f7e00640 1 -- 172.21.15.175:0/1164929670 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453156324 0 0) 0x7f75f80cc4c0 con 0x7f75f8099a50 2024-04-25T09:04:48.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.278+0000 7f75f7e00640 1 -- 172.21.15.175:0/1164929670 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e0003530 con 0x7f75f8099a50 2024-04-25T09:04:48.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.278+0000 7f75fe400640 1 -- 172.21.15.175:0/1164929670 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75f815bc10 msgr2=0x7f75f80cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:48.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.278+0000 7f75fe400640 1 --2- 172.21.15.175:0/1164929670 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75f815bc10 0x7f75f80cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.278+0000 7f75fe400640 1 -- 172.21.15.175:0/1164929670 >> v1:172.21.15.175:6789/0 conn(0x7f75f8099a50 legacy=0x7f75f8099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.278+0000 7f75fe400640 1 -- 172.21.15.175:0/1164929670 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f80cca80 con 0x7f75f809abb0 2024-04-25T09:04:48.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.278+0000 7f75fd000640 1 --2- 172.21.15.175:0/1164929670 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75f815bc10 0x7f75f80cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:48.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.282+0000 7f75fe400640 1 --2- 172.21.15.175:0/1164929670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75f809abb0 0x7f75f80cfdf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f75f00097c0 tx=0x7f75f001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cafb5bf14cc9b78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:48.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.282+0000 7f75f7e00640 1 -- 172.21.15.175:0/1164929670 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f00b0070 con 0x7f75f809abb0 2024-04-25T09:04:48.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.282+0000 7f75f7e00640 1 -- 172.21.15.175:0/1164929670 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f00ab600 con 0x7f75f809abb0 2024-04-25T09:04:48.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.282+0000 7f75f7e00640 1 -- 172.21.15.175:0/1164929670 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f00ab9d0 con 0x7f75f809abb0 2024-04-25T09:04:48.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.282+0000 7f7600400640 1 -- 172.21.15.175:0/1164929670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75f809abb0 msgr2=0x7f75f80cfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.282+0000 7f7600400640 1 --2- 172.21.15.175:0/1164929670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75f809abb0 0x7f75f80cfdf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f75f00097c0 tx=0x7f75f001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.282+0000 7f7600400640 1 -- 172.21.15.175:0/1164929670 shutdown_connections 2024-04-25T09:04:48.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.282+0000 7f7600400640 1 --2- 172.21.15.175:0/1164929670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75f809abb0 0x7f75f80cfdf0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.282+0000 7f7600400640 1 --2- 172.21.15.175:0/1164929670 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75f815bc10 0x7f75f80cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.282+0000 7f7600400640 1 -- 172.21.15.175:0/1164929670 >> 172.21.15.175:0/1164929670 conn(0x7f75f80b3300 msgr2=0x7f75f80b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:48.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.282+0000 7f7600400640 1 -- 172.21.15.175:0/1164929670 shutdown_connections 2024-04-25T09:04:48.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.282+0000 7f7600400640 1 -- 172.21.15.175:0/1164929670 wait complete. 2024-04-25T09:04:48.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f7600400640 1 Processor -- start 2024-04-25T09:04:48.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f7600400640 1 -- start start 2024-04-25T09:04:48.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f7600400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75f8099a50 0x7f75f8152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f7600400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75f809abb0 0x7f75f815c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f7600400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75f815bc10 0x7f75f8152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f7600400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80c5f00 con 0x7f75f8099a50 2024-04-25T09:04:48.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f7600400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80c5d80 con 0x7f75f815bc10 2024-04-25T09:04:48.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f7600400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f8168850 con 0x7f75f809abb0 2024-04-25T09:04:48.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f75fda00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75f8099a50 0x7f75f8152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f75fda00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75f8099a50 0x7f75f8152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53930/0 (socket says 172.21.15.175:53930) 2024-04-25T09:04:48.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f75fda00640 1 -- 172.21.15.175:0/3731677123 learned_addr learned my addr 172.21.15.175:0/3731677123 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:48.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f75fe400640 1 --2- 172.21.15.175:0/3731677123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75f815bc10 0x7f75f8152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f75fd000640 1 --2- 172.21.15.175:0/3731677123 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75f809abb0 0x7f75f815c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f75fda00640 1 -- 172.21.15.175:0/3731677123 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75f809abb0 msgr2=0x7f75f815c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f75fda00640 1 --2- 172.21.15.175:0/3731677123 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75f809abb0 0x7f75f815c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f75fda00640 1 -- 172.21.15.175:0/3731677123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75f815bc10 msgr2=0x7f75f8152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f75fda00640 1 --2- 172.21.15.175:0/3731677123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75f815bc10 0x7f75f8152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f75fda00640 1 -- 172.21.15.175:0/3731677123 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f815c9f0 con 0x7f75f8099a50 2024-04-25T09:04:48.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f75fda00640 1 --2- 172.21.15.175:0/3731677123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75f8099a50 0x7f75f8152610 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00cb40 tx=0x7f75ec00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:48.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f75f5600640 1 -- 172.21.15.175:0/3731677123 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec017070 con 0x7f75f8099a50 2024-04-25T09:04:48.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f75f5600640 1 -- 172.21.15.175:0/3731677123 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec00aca0 con 0x7f75f8099a50 2024-04-25T09:04:48.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f7600400640 1 -- 172.21.15.175:0/3731677123 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f8156000 con 0x7f75f8099a50 2024-04-25T09:04:48.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f75f5600640 1 -- 172.21.15.175:0/3731677123 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec012620 con 0x7f75f8099a50 2024-04-25T09:04:48.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.286+0000 7f7600400640 1 -- 172.21.15.175:0/3731677123 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f81565c0 con 0x7f75f8099a50 2024-04-25T09:04:48.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.290+0000 7f7600400640 1 -- 172.21.15.175:0/3731677123 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f80b76a0 con 0x7f75f8099a50 2024-04-25T09:04:48.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.290+0000 7f75f5600640 1 -- 172.21.15.175:0/3731677123 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f75ec01a070 con 0x7f75f8099a50 2024-04-25T09:04:48.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.290+0000 7f75f5600640 1 --2- 172.21.15.175:0/3731677123 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f75d8066f90 0x7f75d8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.290+0000 7f75f5600640 1 -- 172.21.15.175:0/3731677123 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75ec084e30 con 0x7f75f8099a50 2024-04-25T09:04:48.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.290+0000 7f75fd000640 1 --2- 172.21.15.175:0/3731677123 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f75d8066f90 0x7f75d8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.290+0000 7f75fd000640 1 --2- 172.21.15.175:0/3731677123 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f75d8066f90 0x7f75d8069450 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009580 tx=0x7f75e4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:48.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.294+0000 7f75f5600640 1 -- 172.21.15.175:0/3731677123 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f75ec055750 con 0x7f75f8099a50 2024-04-25T09:04:48.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.450+0000 7f7600400640 1 -- 172.21.15.175:0/3731677123 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75f80cdc40 con 0x7f75f8099a50 2024-04-25T09:04:48.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.450+0000 7f75f5600640 1 -- 172.21.15.175:0/3731677123 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f75ec0597f0 con 0x7f75f8099a50 2024-04-25T09:04:48.445 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:48.445 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":20,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:11.440551+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:48.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.454+0000 7f7600400640 1 -- 172.21.15.175:0/3731677123 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f75d8066f90 msgr2=0x7f75d8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.454+0000 7f7600400640 1 --2- 172.21.15.175:0/3731677123 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f75d8066f90 0x7f75d8069450 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009580 tx=0x7f75e4009190 comp rx=0 tx=0).stop 2024-04-25T09:04:48.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.454+0000 7f7600400640 1 -- 172.21.15.175:0/3731677123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75f8099a50 msgr2=0x7f75f8152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.454+0000 7f7600400640 1 --2- 172.21.15.175:0/3731677123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75f8099a50 0x7f75f8152610 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f75ec00cb40 tx=0x7f75ec00a060 comp rx=0 tx=0).stop 2024-04-25T09:04:48.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.454+0000 7f7600400640 1 -- 172.21.15.175:0/3731677123 shutdown_connections 2024-04-25T09:04:48.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.454+0000 7f7600400640 1 --2- 172.21.15.175:0/3731677123 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f75d8066f90 0x7f75d8069450 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.454+0000 7f7600400640 1 --2- 172.21.15.175:0/3731677123 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75f815bc10 0x7f75f8152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.454+0000 7f7600400640 1 --2- 172.21.15.175:0/3731677123 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75f809abb0 0x7f75f815c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.454+0000 7f7600400640 1 --2- 172.21.15.175:0/3731677123 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75f8099a50 0x7f75f8152610 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.454+0000 7f7600400640 1 -- 172.21.15.175:0/3731677123 >> 172.21.15.175:0/3731677123 conn(0x7f75f80b3300 msgr2=0x7f75f8156a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:48.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.454+0000 7f7600400640 1 -- 172.21.15.175:0/3731677123 shutdown_connections 2024-04-25T09:04:48.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.454+0000 7f7600400640 1 -- 172.21.15.175:0/3731677123 wait complete. 2024-04-25T09:04:48.467 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:08.047706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:04:08.795449+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:48.467 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:48.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.614+0000 7f2e52a00640 1 Processor -- start 2024-04-25T09:04:48.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.614+0000 7f2e52a00640 1 -- start start 2024-04-25T09:04:48.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.614+0000 7f2e52a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e4c0cf6b0 0x7f2e4c1600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.614+0000 7f2e52a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2e4c0ce970 0x7f2e4c0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.614+0000 7f2e52a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4c0cfd10 con 0x7f2e4c145250 2024-04-25T09:04:48.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.614+0000 7f2e52a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4c1605e0 con 0x7f2e4c0ce970 2024-04-25T09:04:48.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.614+0000 7f2e52a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c15f650 con 0x7f2e4c0cf6b0 2024-04-25T09:04:48.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.614+0000 7f2e50a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2e4c0ce970 0x7f2e4c0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.614+0000 7f2e50a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2e4c0ce970 0x7f2e4c0cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53936/0 (socket says 172.21.15.175:53936) 2024-04-25T09:04:48.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.614+0000 7f2e50a00640 1 -- 172.21.15.175:0/3441981581 learned_addr learned my addr 172.21.15.175:0/3441981581 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:48.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.614+0000 7f2e4b400640 1 --2- 172.21.15.175:0/3441981581 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e4c0cf6b0 0x7f2e4c1600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.614+0000 7f2e50a00640 1 -- 172.21.15.175:0/3441981581 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e4c0cf6b0 msgr2=0x7f2e4c1600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:48.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.614+0000 7f2e50a00640 1 --2- 172.21.15.175:0/3441981581 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e4c0cf6b0 0x7f2e4c1600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.614+0000 7f2e50a00640 1 -- 172.21.15.175:0/3441981581 >> v1:172.21.15.177:6789/0 conn(0x7f2e4c145250 legacy=0x7f2e4c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.614+0000 7f2e50a00640 1 -- 172.21.15.175:0/3441981581 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c0cfff0 con 0x7f2e4c0ce970 2024-04-25T09:04:48.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.618+0000 7f2e50a00640 1 --2- 172.21.15.175:0/3441981581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e4c0ce970 0x7f2e4c0cee00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009e50 tx=0x7f2e4401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803ca69f9ace17b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:48.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.618+0000 7f2e4aa00640 1 -- 172.21.15.175:0/3441981581 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e440a5750 con 0x7f2e4c0ce970 2024-04-25T09:04:48.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.618+0000 7f2e4aa00640 1 -- 172.21.15.175:0/3441981581 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e440a58f0 con 0x7f2e4c0ce970 2024-04-25T09:04:48.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.618+0000 7f2e4aa00640 1 -- 172.21.15.175:0/3441981581 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e440a5cc0 con 0x7f2e4c0ce970 2024-04-25T09:04:48.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.618+0000 7f2e52a00640 1 -- 172.21.15.175:0/3441981581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e4c0ce970 msgr2=0x7f2e4c0cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.618+0000 7f2e52a00640 1 --2- 172.21.15.175:0/3441981581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e4c0ce970 0x7f2e4c0cee00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009e50 tx=0x7f2e4401c9a0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.618+0000 7f2e52a00640 1 -- 172.21.15.175:0/3441981581 shutdown_connections 2024-04-25T09:04:48.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.618+0000 7f2e52a00640 1 --2- 172.21.15.175:0/3441981581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e4c0ce970 0x7f2e4c0cee00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.618+0000 7f2e52a00640 1 --2- 172.21.15.175:0/3441981581 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e4c0cf6b0 0x7f2e4c1600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.618+0000 7f2e52a00640 1 -- 172.21.15.175:0/3441981581 >> 172.21.15.175:0/3441981581 conn(0x7f2e4c06ac50 msgr2=0x7f2e4c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:48.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.618+0000 7f2e52a00640 1 -- 172.21.15.175:0/3441981581 shutdown_connections 2024-04-25T09:04:48.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.618+0000 7f2e52a00640 1 -- 172.21.15.175:0/3441981581 wait complete. 2024-04-25T09:04:48.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e52a00640 1 Processor -- start 2024-04-25T09:04:48.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e52a00640 1 -- start start 2024-04-25T09:04:48.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e52a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4c0ce970 0x7f2e4c0b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e52a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e4c0cf6b0 0x7f2e4c1439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e52a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e4c145250 0x7f2e4c0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e52a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c15c870 con 0x7f2e4c0cf6b0 2024-04-25T09:04:48.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e52a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c145630 con 0x7f2e4c0ce970 2024-04-25T09:04:48.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e52a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c15c9f0 con 0x7f2e4c145250 2024-04-25T09:04:48.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e4b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e4c0cf6b0 0x7f2e4c1439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e4b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e4c0cf6b0 0x7f2e4c1439d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53940/0 (socket says 172.21.15.175:53940) 2024-04-25T09:04:48.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e4b400640 1 -- 172.21.15.175:0/454488304 learned_addr learned my addr 172.21.15.175:0/454488304 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:48.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e4be00640 1 --2- 172.21.15.175:0/454488304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4c0ce970 0x7f2e4c0b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e50a00640 1 --2- 172.21.15.175:0/454488304 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e4c145250 0x7f2e4c0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e4b400640 1 -- 172.21.15.175:0/454488304 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e4c145250 msgr2=0x7f2e4c0b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e4b400640 1 --2- 172.21.15.175:0/454488304 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e4c145250 0x7f2e4c0b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e4b400640 1 -- 172.21.15.175:0/454488304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4c0ce970 msgr2=0x7f2e4c0b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e4b400640 1 --2- 172.21.15.175:0/454488304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4c0ce970 0x7f2e4c0b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e4b400640 1 -- 172.21.15.175:0/454488304 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c0b3220 con 0x7f2e4c0cf6b0 2024-04-25T09:04:48.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e4be00640 1 --2- 172.21.15.175:0/454488304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4c0ce970 0x7f2e4c0b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:48.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e4b400640 1 --2- 172.21.15.175:0/454488304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e4c0cf6b0 0x7f2e4c1439d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800d830 tx=0x7f2e3800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:48.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e43e00640 1 -- 172.21.15.175:0/454488304 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3800b6c0 con 0x7f2e4c0cf6b0 2024-04-25T09:04:48.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e43e00640 1 -- 172.21.15.175:0/454488304 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e38019070 con 0x7f2e4c0cf6b0 2024-04-25T09:04:48.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e43e00640 1 -- 172.21.15.175:0/454488304 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3800bae0 con 0x7f2e4c0cf6b0 2024-04-25T09:04:48.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e52a00640 1 -- 172.21.15.175:0/454488304 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4c0b3500 con 0x7f2e4c0cf6b0 2024-04-25T09:04:48.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e52a00640 1 -- 172.21.15.175:0/454488304 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4c0b3b00 con 0x7f2e4c0cf6b0 2024-04-25T09:04:48.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.622+0000 7f2e52a00640 1 -- 172.21.15.175:0/454488304 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4c075160 con 0x7f2e4c0cf6b0 2024-04-25T09:04:48.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.626+0000 7f2e43e00640 1 -- 172.21.15.175:0/454488304 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2e3801e460 con 0x7f2e4c0cf6b0 2024-04-25T09:04:48.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.626+0000 7f2e43e00640 1 --2- 172.21.15.175:0/454488304 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e2c066f60 0x7f2e2c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.626+0000 7f2e43e00640 1 -- 172.21.15.175:0/454488304 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e38085790 con 0x7f2e4c0cf6b0 2024-04-25T09:04:48.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.626+0000 7f2e4be00640 1 --2- 172.21.15.175:0/454488304 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e2c066f60 0x7f2e2c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.626+0000 7f2e4be00640 1 --2- 172.21.15.175:0/454488304 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e2c066f60 0x7f2e2c069420 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c001670 tx=0x7f2e3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:48.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.630+0000 7f2e43e00640 1 -- 172.21.15.175:0/454488304 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2e38056790 con 0x7f2e4c0cf6b0 2024-04-25T09:04:48.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.786+0000 7f2e52a00640 1 -- 172.21.15.175:0/454488304 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2e4c13bc90 con 0x7f2e4c0cf6b0 2024-04-25T09:04:48.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.786+0000 7f2e43e00640 1 -- 172.21.15.175:0/454488304 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2e38056090 con 0x7f2e4c0cf6b0 2024-04-25T09:04:48.780 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:04:48.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.790+0000 7f2e52a00640 1 -- 172.21.15.175:0/454488304 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e2c066f60 msgr2=0x7f2e2c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.790+0000 7f2e52a00640 1 --2- 172.21.15.175:0/454488304 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e2c066f60 0x7f2e2c069420 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c001670 tx=0x7f2e3c009040 comp rx=0 tx=0).stop 2024-04-25T09:04:48.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.790+0000 7f2e52a00640 1 -- 172.21.15.175:0/454488304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e4c0cf6b0 msgr2=0x7f2e4c1439d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.790+0000 7f2e52a00640 1 --2- 172.21.15.175:0/454488304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e4c0cf6b0 0x7f2e4c1439d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2e3800d830 tx=0x7f2e3800dcf0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.790+0000 7f2e52a00640 1 -- 172.21.15.175:0/454488304 shutdown_connections 2024-04-25T09:04:48.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.790+0000 7f2e52a00640 1 --2- 172.21.15.175:0/454488304 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e2c066f60 0x7f2e2c069420 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.790+0000 7f2e52a00640 1 --2- 172.21.15.175:0/454488304 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e4c145250 0x7f2e4c0b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.790+0000 7f2e52a00640 1 --2- 172.21.15.175:0/454488304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e4c0cf6b0 0x7f2e4c1439d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.790+0000 7f2e52a00640 1 --2- 172.21.15.175:0/454488304 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e4c0ce970 0x7f2e4c0b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.790+0000 7f2e52a00640 1 -- 172.21.15.175:0/454488304 >> 172.21.15.175:0/454488304 conn(0x7f2e4c06ac50 msgr2=0x7f2e4c0cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:48.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.790+0000 7f2e52a00640 1 -- 172.21.15.175:0/454488304 shutdown_connections 2024-04-25T09:04:48.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.790+0000 7f2e52a00640 1 -- 172.21.15.175:0/454488304 wait complete. 2024-04-25T09:04:48.802 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:48.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.946+0000 7fc274800640 1 Processor -- start 2024-04-25T09:04:48.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.950+0000 7fc274800640 1 -- start start 2024-04-25T09:04:48.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.950+0000 7fc274800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc26c0af980 0x7fc26c0afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.950+0000 7fc274800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc26c06b510 0x7fc26c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.950+0000 7fc274800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26c0ccc80 con 0x7fc26c0b0c00 2024-04-25T09:04:48.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.950+0000 7fc274800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26c0b2010 con 0x7fc26c06b510 2024-04-25T09:04:48.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.950+0000 7fc274800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c0ce6d0 con 0x7fc26c0af980 2024-04-25T09:04:48.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.950+0000 7fc272800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc26c06b510 0x7fc26c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.950+0000 7fc271e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc26c0b0c00 0x7fc26c06ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:51428/0 (socket says 172.21.15.175:51428) 2024-04-25T09:04:48.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.950+0000 7fc271e00640 1 -- 172.21.15.175:0/2050678179 learned_addr learned my addr 172.21.15.175:0/2050678179 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:48.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.950+0000 7fc271400640 1 --2- 172.21.15.175:0/2050678179 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc26c0af980 0x7fc26c0afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.950+0000 7fc272800640 1 -- 172.21.15.175:0/2050678179 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc26c0af980 msgr2=0x7fc26c0afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:48.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.950+0000 7fc272800640 1 --2- 172.21.15.175:0/2050678179 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc26c0af980 0x7fc26c0afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.950+0000 7fc272800640 1 -- 172.21.15.175:0/2050678179 >> v1:172.21.15.175:6789/0 conn(0x7fc26c0b0c00 legacy=0x7fc26c06ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.950+0000 7fc270a00640 1 -- 172.21.15.175:0/2050678179 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950262690 0 0) 0x7fc26c0ccc80 con 0x7fc26c0b0c00 2024-04-25T09:04:48.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.950+0000 7fc272800640 1 -- 172.21.15.175:0/2050678179 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c0ccf60 con 0x7fc26c06b510 2024-04-25T09:04:48.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.954+0000 7fc272800640 1 --2- 172.21.15.175:0/2050678179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc26c06b510 0x7fc26c15d460 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc268009d90 tx=0x7fc26801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6324f98b946432c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:48.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.954+0000 7fc270a00640 1 -- 172.21.15.175:0/2050678179 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2680b2070 con 0x7fc26c06b510 2024-04-25T09:04:48.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.954+0000 7fc270a00640 1 -- 172.21.15.175:0/2050678179 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2680a5910 con 0x7fc26c06b510 2024-04-25T09:04:48.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.954+0000 7fc270a00640 1 -- 172.21.15.175:0/2050678179 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2680a5ce0 con 0x7fc26c06b510 2024-04-25T09:04:48.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.954+0000 7fc274800640 1 -- 172.21.15.175:0/2050678179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc26c06b510 msgr2=0x7fc26c15d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.954+0000 7fc274800640 1 --2- 172.21.15.175:0/2050678179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc26c06b510 0x7fc26c15d460 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc268009d90 tx=0x7fc26801c940 comp rx=0 tx=0).stop 2024-04-25T09:04:48.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.954+0000 7fc274800640 1 -- 172.21.15.175:0/2050678179 shutdown_connections 2024-04-25T09:04:48.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.954+0000 7fc274800640 1 --2- 172.21.15.175:0/2050678179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc26c06b510 0x7fc26c15d460 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.954+0000 7fc274800640 1 --2- 172.21.15.175:0/2050678179 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc26c0af980 0x7fc26c0afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.954+0000 7fc274800640 1 -- 172.21.15.175:0/2050678179 >> 172.21.15.175:0/2050678179 conn(0x7fc26c0d07e0 msgr2=0x7fc26c0d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:48.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.954+0000 7fc274800640 1 -- 172.21.15.175:0/2050678179 shutdown_connections 2024-04-25T09:04:48.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.954+0000 7fc274800640 1 -- 172.21.15.175:0/2050678179 wait complete. 2024-04-25T09:04:48.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.954+0000 7fc274800640 1 Processor -- start 2024-04-25T09:04:48.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.954+0000 7fc274800640 1 -- start start 2024-04-25T09:04:48.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc274800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc26c06b510 0x7fc26c15fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc274800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc26c0af980 0x7fc26c15e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc274800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc26c0b0c00 0x7fc26c15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc274800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c06bb20 con 0x7fc26c06b510 2024-04-25T09:04:48.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc274800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c06b9a0 con 0x7fc26c0b0c00 2024-04-25T09:04:48.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc274800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c0cd1c0 con 0x7fc26c0af980 2024-04-25T09:04:48.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc271e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc26c06b510 0x7fc26c15fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc271e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc26c06b510 0x7fc26c15fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53954/0 (socket says 172.21.15.175:53954) 2024-04-25T09:04:48.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc271e00640 1 -- 172.21.15.175:0/871907785 learned_addr learned my addr 172.21.15.175:0/871907785 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:48.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc271400640 1 --2- 172.21.15.175:0/871907785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc26c0af980 0x7fc26c15e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc272800640 1 --2- 172.21.15.175:0/871907785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc26c0b0c00 0x7fc26c15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc271e00640 1 -- 172.21.15.175:0/871907785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc26c0af980 msgr2=0x7fc26c15e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc271e00640 1 --2- 172.21.15.175:0/871907785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc26c0af980 0x7fc26c15e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc271e00640 1 -- 172.21.15.175:0/871907785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc26c0b0c00 msgr2=0x7fc26c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:48.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc271e00640 1 --2- 172.21.15.175:0/871907785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc26c0b0c00 0x7fc26c15b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:48.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc271e00640 1 -- 172.21.15.175:0/871907785 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c15ea60 con 0x7fc26c06b510 2024-04-25T09:04:48.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc271e00640 1 --2- 172.21.15.175:0/871907785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc26c06b510 0x7fc26c15fef0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc26000c4b0 tx=0x7fc26000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:48.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc266000640 1 -- 172.21.15.175:0/871907785 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260018070 con 0x7fc26c06b510 2024-04-25T09:04:48.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc266000640 1 -- 172.21.15.175:0/871907785 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc260007500 con 0x7fc26c06b510 2024-04-25T09:04:48.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc266000640 1 -- 172.21.15.175:0/871907785 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260004a30 con 0x7fc26c06b510 2024-04-25T09:04:48.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc274800640 1 -- 172.21.15.175:0/871907785 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26c160680 con 0x7fc26c06b510 2024-04-25T09:04:48.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc274800640 1 -- 172.21.15.175:0/871907785 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26c160c40 con 0x7fc26c06b510 2024-04-25T09:04:48.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc274800640 1 -- 172.21.15.175:0/871907785 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26c06ccf0 con 0x7fc26c06b510 2024-04-25T09:04:48.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.958+0000 7fc266000640 1 -- 172.21.15.175:0/871907785 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc260004bd0 con 0x7fc26c06b510 2024-04-25T09:04:48.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.962+0000 7fc266000640 1 --2- 172.21.15.175:0/871907785 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc250066f60 0x7fc250069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:48.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.962+0000 7fc266000640 1 -- 172.21.15.175:0/871907785 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc260084200 con 0x7fc26c06b510 2024-04-25T09:04:48.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.962+0000 7fc271400640 1 --2- 172.21.15.175:0/871907785 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc250066f60 0x7fc250069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:48.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.962+0000 7fc271400640 1 --2- 172.21.15.175:0/871907785 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc250066f60 0x7fc250069420 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0c9a60 tx=0x7fc25c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:48.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:48.966+0000 7fc266000640 1 -- 172.21.15.175:0/871907785 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc260055200 con 0x7fc26c06b510 2024-04-25T09:04:49.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.118+0000 7fc274800640 1 -- 172.21.15.175:0/871907785 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc26c075160 con 0x7fc26c06b510 2024-04-25T09:04:49.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.118+0000 7fc266000640 1 -- 172.21.15.175:0/871907785 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc260054b00 con 0x7fc26c06b510 2024-04-25T09:04:49.111 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:04:49.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.118+0000 7fc274800640 1 -- 172.21.15.175:0/871907785 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc250066f60 msgr2=0x7fc250069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.118+0000 7fc274800640 1 --2- 172.21.15.175:0/871907785 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc250066f60 0x7fc250069420 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0c9a60 tx=0x7fc25c008040 comp rx=0 tx=0).stop 2024-04-25T09:04:49.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.118+0000 7fc274800640 1 -- 172.21.15.175:0/871907785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc26c06b510 msgr2=0x7fc26c15fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.118+0000 7fc274800640 1 --2- 172.21.15.175:0/871907785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc26c06b510 0x7fc26c15fef0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc26000c4b0 tx=0x7fc26000c970 comp rx=0 tx=0).stop 2024-04-25T09:04:49.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.118+0000 7fc274800640 1 -- 172.21.15.175:0/871907785 shutdown_connections 2024-04-25T09:04:49.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.118+0000 7fc274800640 1 --2- 172.21.15.175:0/871907785 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc250066f60 0x7fc250069420 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.118+0000 7fc274800640 1 --2- 172.21.15.175:0/871907785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc26c0b0c00 0x7fc26c15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.118+0000 7fc274800640 1 --2- 172.21.15.175:0/871907785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc26c0af980 0x7fc26c15e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.118+0000 7fc274800640 1 --2- 172.21.15.175:0/871907785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc26c06b510 0x7fc26c15fef0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.118+0000 7fc274800640 1 -- 172.21.15.175:0/871907785 >> 172.21.15.175:0/871907785 conn(0x7fc26c0d07e0 msgr2=0x7fc26c06ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:49.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.118+0000 7fc274800640 1 -- 172.21.15.175:0/871907785 shutdown_connections 2024-04-25T09:04:49.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.118+0000 7fc274800640 1 -- 172.21.15.175:0/871907785 wait complete. 2024-04-25T09:04:49.131 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:49.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.274+0000 7fea45400640 1 Processor -- start 2024-04-25T09:04:49.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.274+0000 7fea45400640 1 -- start start 2024-04-25T09:04:49.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea45400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea401546e0 0x7fea4015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea45400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea4015e4a0 con 0x7fea40154ac0 2024-04-25T09:04:49.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea45400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea4015e780 con 0x7fea400ad240 2024-04-25T09:04:49.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea45400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4015ea60 con 0x7fea401546e0 2024-04-25T09:04:49.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea37400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fea40154ac0 0x7fea400acb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:51442/0 (socket says 172.21.15.175:51442) 2024-04-25T09:04:49.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea37400640 1 -- 172.21.15.175:0/100961610 learned_addr learned my addr 172.21.15.175:0/100961610 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:49.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea3fe00640 1 --2- 172.21.15.175:0/100961610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea401546e0 0x7fea4015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea3f400640 1 -- 172.21.15.175:0/100961610 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754976549 0 0) 0x7fea4015e4a0 con 0x7fea40154ac0 2024-04-25T09:04:49.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea3f400640 1 -- 172.21.15.175:0/100961610 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea24003530 con 0x7fea40154ac0 2024-04-25T09:04:49.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea3f400640 1 -- 172.21.15.175:0/100961610 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1404695990 0 0) 0x7fea24003530 con 0x7fea40154ac0 2024-04-25T09:04:49.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea3f400640 1 -- 172.21.15.175:0/100961610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea401546e0 msgr2=0x7fea4015de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:49.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea3f400640 1 --2- 172.21.15.175:0/100961610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea401546e0 0x7fea4015de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea3f400640 1 -- 172.21.15.175:0/100961610 >> v1:172.21.15.177:6789/0 conn(0x7fea400ad240 legacy=0x7fea40161a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea3f400640 1 -- 172.21.15.175:0/100961610 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4015ed40 con 0x7fea40154ac0 2024-04-25T09:04:49.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea3f400640 1 -- 172.21.15.175:0/100961610 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fea28001680 con 0x7fea40154ac0 2024-04-25T09:04:49.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea3f400640 1 -- 172.21.15.175:0/100961610 >> v1:172.21.15.175:6789/0 conn(0x7fea40154ac0 legacy=0x7fea400acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea3f400640 1 --2- 172.21.15.175:0/100961610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea240039f0 0x7fea24003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea3f400640 1 --2- 172.21.15.175:0/100961610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea401546e0 0x7fea24004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea3f400640 1 --2- 172.21.15.175:0/100961610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea24004d50 0x7fea240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea3f400640 1 -- 172.21.15.175:0/100961610 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4015ea60 con 0x7fea24004d50 2024-04-25T09:04:49.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea3f400640 1 -- 172.21.15.175:0/100961610 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2400b9d0 con 0x7fea240039f0 2024-04-25T09:04:49.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea3f400640 1 -- 172.21.15.175:0/100961610 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2400bbd0 con 0x7fea401546e0 2024-04-25T09:04:49.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea44a00640 1 --2- 172.21.15.175:0/100961610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea24004d50 0x7fea240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea3fe00640 1 --2- 172.21.15.175:0/100961610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea240039f0 0x7fea24003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea37400640 1 --2- 172.21.15.175:0/100961610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea401546e0 0x7fea24004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea44a00640 1 -- 172.21.15.175:0/100961610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea401546e0 msgr2=0x7fea24004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:49.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea44a00640 1 --2- 172.21.15.175:0/100961610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea401546e0 0x7fea24004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea44a00640 1 -- 172.21.15.175:0/100961610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea240039f0 msgr2=0x7fea24003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:49.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea44a00640 1 --2- 172.21.15.175:0/100961610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea240039f0 0x7fea24003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.278+0000 7fea44a00640 1 -- 172.21.15.175:0/100961610 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea24003530 con 0x7fea24004d50 2024-04-25T09:04:49.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.282+0000 7fea44a00640 1 --2- 172.21.15.175:0/100961610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea24004d50 0x7fea240051d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fea401613a0 tx=0x7fea3801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716b4c17b0f5c1e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.282+0000 7fea3f400640 1 -- 172.21.15.175:0/100961610 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea38001460 con 0x7fea24004d50 2024-04-25T09:04:49.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.282+0000 7fea3f400640 1 -- 172.21.15.175:0/100961610 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea380b0070 con 0x7fea24004d50 2024-04-25T09:04:49.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.282+0000 7fea3f400640 1 -- 172.21.15.175:0/100961610 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea380ab840 con 0x7fea24004d50 2024-04-25T09:04:49.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.282+0000 7fea45400640 1 -- 172.21.15.175:0/100961610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea24004d50 msgr2=0x7fea240051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.282+0000 7fea45400640 1 --2- 172.21.15.175:0/100961610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea24004d50 0x7fea240051d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fea401613a0 tx=0x7fea3801c4c0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.282+0000 7fea44a00640 1 -- 172.21.15.175:0/100961610 reap_dead start 2024-04-25T09:04:49.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.282+0000 7fea45400640 1 -- 172.21.15.175:0/100961610 shutdown_connections 2024-04-25T09:04:49.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.282+0000 7fea45400640 1 -- 172.21.15.175:0/100961610 >> 172.21.15.175:0/100961610 conn(0x7fea40067070 msgr2=0x7fea400b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:49.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.282+0000 7fea45400640 1 -- 172.21.15.175:0/100961610 shutdown_connections 2024-04-25T09:04:49.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.282+0000 7fea45400640 1 -- 172.21.15.175:0/100961610 wait complete. 2024-04-25T09:04:49.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea45400640 1 Processor -- start 2024-04-25T09:04:49.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea45400640 1 -- start start 2024-04-25T09:04:49.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea45400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea24004d50 0x7fea40159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea45400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea401f73c0 0x7fea401f08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea45400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea40157170 0x7fea400cf410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea45400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea40162290 con 0x7fea24004d50 2024-04-25T09:04:49.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea45400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea40162110 con 0x7fea40157170 2024-04-25T09:04:49.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea45400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4015de50 con 0x7fea401f73c0 2024-04-25T09:04:49.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea3fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea24004d50 0x7fea40159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea3fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea24004d50 0x7fea40159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53976/0 (socket says 172.21.15.175:53976) 2024-04-25T09:04:49.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea3fe00640 1 -- 172.21.15.175:0/2683237232 learned_addr learned my addr 172.21.15.175:0/2683237232 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:49.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea44a00640 1 --2- 172.21.15.175:0/2683237232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea40157170 0x7fea400cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea37400640 1 --2- 172.21.15.175:0/2683237232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea401f73c0 0x7fea401f08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea3fe00640 1 -- 172.21.15.175:0/2683237232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea401f73c0 msgr2=0x7fea401f08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea3fe00640 1 --2- 172.21.15.175:0/2683237232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea401f73c0 0x7fea401f08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea3fe00640 1 -- 172.21.15.175:0/2683237232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea40157170 msgr2=0x7fea400cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea3fe00640 1 --2- 172.21.15.175:0/2683237232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea40157170 0x7fea400cf410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea3fe00640 1 -- 172.21.15.175:0/2683237232 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea401579e0 con 0x7fea24004d50 2024-04-25T09:04:49.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea3fe00640 1 --2- 172.21.15.175:0/2683237232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea24004d50 0x7fea40159000 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fea30011e60 tx=0x7fea3000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea3cc00640 1 -- 172.21.15.175:0/2683237232 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30015630 con 0x7fea24004d50 2024-04-25T09:04:49.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea3cc00640 1 -- 172.21.15.175:0/2683237232 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea300157d0 con 0x7fea24004d50 2024-04-25T09:04:49.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea3cc00640 1 -- 172.21.15.175:0/2683237232 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea30015ba0 con 0x7fea24004d50 2024-04-25T09:04:49.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea45400640 1 -- 172.21.15.175:0/2683237232 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea40157cc0 con 0x7fea24004d50 2024-04-25T09:04:49.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea45400640 1 -- 172.21.15.175:0/2683237232 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea401f6ea0 con 0x7fea24004d50 2024-04-25T09:04:49.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.286+0000 7fea45400640 1 -- 172.21.15.175:0/2683237232 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea40074a60 con 0x7fea24004d50 2024-04-25T09:04:49.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.290+0000 7fea3cc00640 1 -- 172.21.15.175:0/2683237232 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fea3001d400 con 0x7fea24004d50 2024-04-25T09:04:49.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.290+0000 7fea3cc00640 1 --2- 172.21.15.175:0/2683237232 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea1c066f60 0x7fea1c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.290+0000 7fea3cc00640 1 -- 172.21.15.175:0/2683237232 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea30086210 con 0x7fea24004d50 2024-04-25T09:04:49.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.290+0000 7fea37400640 1 --2- 172.21.15.175:0/2683237232 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea1c066f60 0x7fea1c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.290+0000 7fea37400640 1 --2- 172.21.15.175:0/2683237232 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea1c066f60 0x7fea1c069420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fea4006dc80 tx=0x7fea28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.294+0000 7fea3cc00640 1 -- 172.21.15.175:0/2683237232 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fea30019030 con 0x7fea24004d50 2024-04-25T09:04:49.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.450+0000 7fea45400640 1 -- 172.21.15.175:0/2683237232 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fea4006d5a0 con 0x7fea24004d50 2024-04-25T09:04:49.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.450+0000 7fea3cc00640 1 -- 172.21.15.175:0/2683237232 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fea30010040 con 0x7fea24004d50 2024-04-25T09:04:49.443 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:04:49.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.454+0000 7fea45400640 1 -- 172.21.15.175:0/2683237232 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea1c066f60 msgr2=0x7fea1c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.454+0000 7fea45400640 1 --2- 172.21.15.175:0/2683237232 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea1c066f60 0x7fea1c069420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fea4006dc80 tx=0x7fea28009040 comp rx=0 tx=0).stop 2024-04-25T09:04:49.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.454+0000 7fea45400640 1 -- 172.21.15.175:0/2683237232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea24004d50 msgr2=0x7fea40159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.454+0000 7fea45400640 1 --2- 172.21.15.175:0/2683237232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea24004d50 0x7fea40159000 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fea30011e60 tx=0x7fea3000f580 comp rx=0 tx=0).stop 2024-04-25T09:04:49.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.454+0000 7fea45400640 1 -- 172.21.15.175:0/2683237232 shutdown_connections 2024-04-25T09:04:49.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.454+0000 7fea45400640 1 --2- 172.21.15.175:0/2683237232 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea1c066f60 0x7fea1c069420 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.454+0000 7fea45400640 1 --2- 172.21.15.175:0/2683237232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea40157170 0x7fea400cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.454+0000 7fea45400640 1 --2- 172.21.15.175:0/2683237232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea401f73c0 0x7fea401f08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.454+0000 7fea45400640 1 --2- 172.21.15.175:0/2683237232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea24004d50 0x7fea40159000 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.454+0000 7fea45400640 1 -- 172.21.15.175:0/2683237232 >> 172.21.15.175:0/2683237232 conn(0x7fea40067070 msgr2=0x7fea4015b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:49.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.454+0000 7fea45400640 1 -- 172.21.15.175:0/2683237232 shutdown_connections 2024-04-25T09:04:49.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.454+0000 7fea45400640 1 -- 172.21.15.175:0/2683237232 wait complete. 2024-04-25T09:04:49.464 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:49.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.606+0000 7efc99800640 1 Processor -- start 2024-04-25T09:04:49.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.606+0000 7efc99800640 1 -- start start 2024-04-25T09:04:49.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.606+0000 7efc99800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efc94071950 0x7efc9406de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.606+0000 7efc99800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9406eba0 con 0x7efc940aeb30 2024-04-25T09:04:49.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.606+0000 7efc99800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9406ee80 con 0x7efc9406e340 2024-04-25T09:04:49.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.606+0000 7efc99800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc940b2a70 con 0x7efc94071950 2024-04-25T09:04:49.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.606+0000 7efc8a000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efc94071950 0x7efc9406de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.606+0000 7efc92a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7efc940aeb30 0x7efc94071240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:37746/0 (socket says 172.21.15.175:37746) 2024-04-25T09:04:49.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.606+0000 7efc92a00640 1 -- 172.21.15.175:0/750456773 learned_addr learned my addr 172.21.15.175:0/750456773 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:49.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.610+0000 7efc8a000640 1 -- 172.21.15.175:0/750456773 >> v1:172.21.15.177:6789/0 conn(0x7efc9406e340 legacy=0x7efc940b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.610+0000 7efc8a000640 1 -- 172.21.15.175:0/750456773 >> v1:172.21.15.175:6789/0 conn(0x7efc940aeb30 legacy=0x7efc94071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.610+0000 7efc8a000640 1 -- 172.21.15.175:0/750456773 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc940b2700 con 0x7efc94071950 2024-04-25T09:04:49.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.610+0000 7efc8a000640 1 --2- 172.21.15.175:0/750456773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc94071950 0x7efc9406de00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efc940b2bf0 tx=0x7efc7c01e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745b699c69795c56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.610+0000 7efc92000640 1 -- 172.21.15.175:0/750456773 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c0a8620 con 0x7efc94071950 2024-04-25T09:04:49.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.610+0000 7efc92000640 1 -- 172.21.15.175:0/750456773 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c0a87c0 con 0x7efc94071950 2024-04-25T09:04:49.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.610+0000 7efc92000640 1 -- 172.21.15.175:0/750456773 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c0a8b90 con 0x7efc94071950 2024-04-25T09:04:49.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc99800640 1 -- 172.21.15.175:0/750456773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc94071950 msgr2=0x7efc9406de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc99800640 1 --2- 172.21.15.175:0/750456773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc94071950 0x7efc9406de00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efc940b2bf0 tx=0x7efc7c01e6b0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc99800640 1 -- 172.21.15.175:0/750456773 shutdown_connections 2024-04-25T09:04:49.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc99800640 1 --2- 172.21.15.175:0/750456773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc94071950 0x7efc9406de00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc99800640 1 -- 172.21.15.175:0/750456773 >> 172.21.15.175:0/750456773 conn(0x7efc94067150 msgr2=0x7efc9406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:49.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc99800640 1 -- 172.21.15.175:0/750456773 shutdown_connections 2024-04-25T09:04:49.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc99800640 1 -- 172.21.15.175:0/750456773 wait complete. 2024-04-25T09:04:49.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc99800640 1 Processor -- start 2024-04-25T09:04:49.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc99800640 1 -- start start 2024-04-25T09:04:49.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc99800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc94071950 0x7efc94159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc99800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc940aeb30 0x7efc940b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc99800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc94138b60 0x7efc94138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc99800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc940b3a20 con 0x7efc94138b60 2024-04-25T09:04:49.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc99800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc940b38a0 con 0x7efc94071950 2024-04-25T09:04:49.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc99800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc940b3ba0 con 0x7efc940aeb30 2024-04-25T09:04:49.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc93400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc94138b60 0x7efc94138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc92a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc94071950 0x7efc94159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc93400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc94138b60 0x7efc94138ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50184/0 (socket says 172.21.15.175:50184) 2024-04-25T09:04:49.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc93400640 1 -- 172.21.15.175:0/3051121168 learned_addr learned my addr 172.21.15.175:0/3051121168 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:49.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc8a000640 1 --2- 172.21.15.175:0/3051121168 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc940aeb30 0x7efc940b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc93400640 1 -- 172.21.15.175:0/3051121168 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc940aeb30 msgr2=0x7efc940b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc93400640 1 --2- 172.21.15.175:0/3051121168 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc940aeb30 0x7efc940b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc93400640 1 -- 172.21.15.175:0/3051121168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc94071950 msgr2=0x7efc94159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc93400640 1 --2- 172.21.15.175:0/3051121168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc94071950 0x7efc94159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc93400640 1 -- 172.21.15.175:0/3051121168 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc94139530 con 0x7efc94138b60 2024-04-25T09:04:49.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc92a00640 1 --2- 172.21.15.175:0/3051121168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc94071950 0x7efc94159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:49.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.614+0000 7efc93400640 1 --2- 172.21.15.175:0/3051121168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc94138b60 0x7efc94138ff0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00c770 tx=0x7efc8c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.618+0000 7efc8b400640 1 -- 172.21.15.175:0/3051121168 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c003b80 con 0x7efc94138b60 2024-04-25T09:04:49.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.618+0000 7efc8b400640 1 -- 172.21.15.175:0/3051121168 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c003d20 con 0x7efc94138b60 2024-04-25T09:04:49.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.618+0000 7efc8b400640 1 -- 172.21.15.175:0/3051121168 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00aa90 con 0x7efc94138b60 2024-04-25T09:04:49.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.618+0000 7efc99800640 1 -- 172.21.15.175:0/3051121168 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc94141850 con 0x7efc94138b60 2024-04-25T09:04:49.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.618+0000 7efc99800640 1 -- 172.21.15.175:0/3051121168 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc940af650 con 0x7efc94138b60 2024-04-25T09:04:49.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.618+0000 7efc99800640 1 -- 172.21.15.175:0/3051121168 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc94074a60 con 0x7efc94138b60 2024-04-25T09:04:49.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.618+0000 7efc8b400640 1 -- 172.21.15.175:0/3051121168 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efc8c00ac30 con 0x7efc94138b60 2024-04-25T09:04:49.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.618+0000 7efc8b400640 1 --2- 172.21.15.175:0/3051121168 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efc70066f60 0x7efc70069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.618+0000 7efc8b400640 1 -- 172.21.15.175:0/3051121168 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc8c084e90 con 0x7efc94138b60 2024-04-25T09:04:49.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.618+0000 7efc92a00640 1 --2- 172.21.15.175:0/3051121168 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efc70066f60 0x7efc70069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.618+0000 7efc92a00640 1 --2- 172.21.15.175:0/3051121168 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efc70066f60 0x7efc70069420 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efc84005890 tx=0x7efc84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.622+0000 7efc8b400640 1 -- 172.21.15.175:0/3051121168 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efc8c0557b0 con 0x7efc94138b60 2024-04-25T09:04:49.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.814+0000 7efc99800640 1 -- 172.21.15.175:0/3051121168 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc940721c0 con 0x7efc94138b60 2024-04-25T09:04:49.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.814+0000 7efc8b400640 1 -- 172.21.15.175:0/3051121168 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4938 (secure 0 0 0) 0x7efc8c086090 con 0x7efc94138b60 2024-04-25T09:04:49.807 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:49.807 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/989886914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":989886914},{"type":"v1","addr":"172.21.15.175:6837","nonce":989886914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/611556493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":611556493},{"type":"v1","addr":"172.21.15.177:6833","nonce":611556493}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1366486960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1366486960},{"type":"v1","addr":"172.21.15.177:6835","nonce":1366486960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:09.810111+0000","modified":"2024-04-25T09:04:12.820376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6836/2613139594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2613139594},{"type":"v1","addr":"172.21.15.175:6836","nonce":2613139594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:04:49.807 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 8 2024-04-25T09:04:49.808 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.814+0000 7efc99800640 1 -- 172.21.15.175:0/3051121168 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efc70066f60 msgr2=0x7efc70069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.814+0000 7efc99800640 1 --2- 172.21.15.175:0/3051121168 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efc70066f60 0x7efc70069420 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efc84005890 tx=0x7efc84009040 comp rx=0 tx=0).stop 2024-04-25T09:04:49.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.814+0000 7efc99800640 1 -- 172.21.15.175:0/3051121168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc94138b60 msgr2=0x7efc94138ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.814+0000 7efc99800640 1 --2- 172.21.15.175:0/3051121168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc94138b60 0x7efc94138ff0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00c770 tx=0x7efc8c00cc30 comp rx=0 tx=0).stop 2024-04-25T09:04:49.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.814+0000 7efc99800640 1 -- 172.21.15.175:0/3051121168 shutdown_connections 2024-04-25T09:04:49.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.814+0000 7efc99800640 1 --2- 172.21.15.175:0/3051121168 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efc70066f60 0x7efc70069420 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.814+0000 7efc99800640 1 --2- 172.21.15.175:0/3051121168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc94138b60 0x7efc94138ff0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.814+0000 7efc99800640 1 --2- 172.21.15.175:0/3051121168 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc940aeb30 0x7efc940b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.814+0000 7efc99800640 1 --2- 172.21.15.175:0/3051121168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc94071950 0x7efc94159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.814+0000 7efc99800640 1 -- 172.21.15.175:0/3051121168 >> 172.21.15.175:0/3051121168 conn(0x7efc9406e340 msgr2=0x7efc94142840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:49.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.814+0000 7efc99800640 1 -- 172.21.15.175:0/3051121168 shutdown_connections 2024-04-25T09:04:49.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.814+0000 7efc99800640 1 -- 172.21.15.175:0/3051121168 wait complete. 2024-04-25T09:04:49.828 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:49.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.970+0000 7f80c5400640 1 Processor -- start 2024-04-25T09:04:49.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.970+0000 7f80c5400640 1 -- start start 2024-04-25T09:04:49.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.970+0000 7f80c5400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f80c00cd520 0x7f80c006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.970+0000 7f80c5400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80c00cf560 0x7f80c00cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.970+0000 7f80c5400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c00cda00 con 0x7f80c015a900 2024-04-25T09:04:49.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.970+0000 7f80c5400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c015bcf0 con 0x7f80c00cd520 2024-04-25T09:04:49.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.970+0000 7f80c5400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c00cfef0 con 0x7f80c00cf560 2024-04-25T09:04:49.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.970+0000 7f80bf200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80c00cf560 0x7f80c00cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.974+0000 7f80b5e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f80c00cd520 0x7f80c006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.974+0000 7f80be800640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f80c015a900 0x7f80c00ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:53868/0 (socket says 172.21.15.175:53868) 2024-04-25T09:04:49.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.974+0000 7f80be800640 1 -- 172.21.15.175:0/3293934782 learned_addr learned my addr 172.21.15.175:0/3293934782 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:49.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.974+0000 7f80b5e00640 1 -- 172.21.15.175:0/3293934782 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80c00cf560 msgr2=0x7f80c00cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:49.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.974+0000 7f80b5e00640 1 --2- 172.21.15.175:0/3293934782 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80c00cf560 0x7f80c00cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.974+0000 7f80b5e00640 1 -- 172.21.15.175:0/3293934782 >> v1:172.21.15.177:6789/0 conn(0x7f80c015a900 legacy=0x7f80c00ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.974+0000 7f80b5e00640 1 -- 172.21.15.175:0/3293934782 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c00cdce0 con 0x7f80c00cd520 2024-04-25T09:04:49.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.974+0000 7f80b5e00640 1 --2- 172.21.15.175:0/3293934782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80c00cd520 0x7f80c006e150 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f80a80097c0 tx=0x7f80a801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=435b43a8ac0213e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.974+0000 7f80bde00640 1 -- 172.21.15.175:0/3293934782 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a80b2070 con 0x7f80c00cd520 2024-04-25T09:04:49.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.974+0000 7f80bde00640 1 -- 172.21.15.175:0/3293934782 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a80ad640 con 0x7f80c00cd520 2024-04-25T09:04:49.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.974+0000 7f80bde00640 1 -- 172.21.15.175:0/3293934782 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a80ada10 con 0x7f80c00cd520 2024-04-25T09:04:49.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80c5400640 1 -- 172.21.15.175:0/3293934782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80c00cd520 msgr2=0x7f80c006e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80c5400640 1 --2- 172.21.15.175:0/3293934782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80c00cd520 0x7f80c006e150 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f80a80097c0 tx=0x7f80a801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80c5400640 1 -- 172.21.15.175:0/3293934782 shutdown_connections 2024-04-25T09:04:49.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80c5400640 1 --2- 172.21.15.175:0/3293934782 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80c00cf560 0x7f80c00cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80c5400640 1 --2- 172.21.15.175:0/3293934782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80c00cd520 0x7f80c006e150 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80c5400640 1 -- 172.21.15.175:0/3293934782 >> 172.21.15.175:0/3293934782 conn(0x7f80c0067150 msgr2=0x7f80c006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:49.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80c5400640 1 -- 172.21.15.175:0/3293934782 shutdown_connections 2024-04-25T09:04:49.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80c5400640 1 -- 172.21.15.175:0/3293934782 wait complete. 2024-04-25T09:04:49.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80c5400640 1 Processor -- start 2024-04-25T09:04:49.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80c5400640 1 -- start start 2024-04-25T09:04:49.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80c5400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80c00cf560 0x7f80c0147340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80c5400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80c015a900 0x7f80c0146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80c5400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80c01571e0 0x7f80c00b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80c5400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c006d530 con 0x7f80c015a900 2024-04-25T09:04:49.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80c5400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c006d3b0 con 0x7f80c01571e0 2024-04-25T09:04:49.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80c5400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c015c790 con 0x7f80c00cf560 2024-04-25T09:04:49.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80b5e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80c015a900 0x7f80c0146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80be800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80c00cf560 0x7f80c0147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80b5e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80c015a900 0x7f80c0146d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50190/0 (socket says 172.21.15.175:50190) 2024-04-25T09:04:49.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80b5e00640 1 -- 172.21.15.175:0/472693892 learned_addr learned my addr 172.21.15.175:0/472693892 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:49.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80bf200640 1 --2- 172.21.15.175:0/472693892 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80c01571e0 0x7f80c00b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80b5e00640 1 -- 172.21.15.175:0/472693892 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80c00cf560 msgr2=0x7f80c0147340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80b5e00640 1 --2- 172.21.15.175:0/472693892 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80c00cf560 0x7f80c0147340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80b5e00640 1 -- 172.21.15.175:0/472693892 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80c01571e0 msgr2=0x7f80c00b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:49.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80b5e00640 1 --2- 172.21.15.175:0/472693892 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80c01571e0 0x7f80c00b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:49.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.978+0000 7f80b5e00640 1 -- 172.21.15.175:0/472693892 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c00b28b0 con 0x7f80c015a900 2024-04-25T09:04:49.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.982+0000 7f80b5e00640 1 --2- 172.21.15.175:0/472693892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80c015a900 0x7f80c0146d30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f80a80b0040 tx=0x7f80a8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.982+0000 7f80b7400640 1 -- 172.21.15.175:0/472693892 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a80b2040 con 0x7f80c015a900 2024-04-25T09:04:49.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.982+0000 7f80b7400640 1 -- 172.21.15.175:0/472693892 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a80bc070 con 0x7f80c015a900 2024-04-25T09:04:49.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.982+0000 7f80c5400640 1 -- 172.21.15.175:0/472693892 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c0157970 con 0x7f80c015a900 2024-04-25T09:04:49.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.982+0000 7f80b7400640 1 -- 172.21.15.175:0/472693892 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a80b6650 con 0x7f80c015a900 2024-04-25T09:04:49.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.982+0000 7f80c5400640 1 -- 172.21.15.175:0/472693892 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c014b450 con 0x7f80c015a900 2024-04-25T09:04:49.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.982+0000 7f80c5400640 1 -- 172.21.15.175:0/472693892 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c0074a60 con 0x7f80c015a900 2024-04-25T09:04:49.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.982+0000 7f80b7400640 1 -- 172.21.15.175:0/472693892 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f80a80b67f0 con 0x7f80c015a900 2024-04-25T09:04:49.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.982+0000 7f80b7400640 1 --2- 172.21.15.175:0/472693892 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f809c066f90 0x7f809c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:49.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.982+0000 7f80b7400640 1 -- 172.21.15.175:0/472693892 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80a811eee0 con 0x7f80c015a900 2024-04-25T09:04:49.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.982+0000 7f80be800640 1 --2- 172.21.15.175:0/472693892 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f809c066f90 0x7f809c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:49.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.986+0000 7f80be800640 1 --2- 172.21.15.175:0/472693892 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f809c066f90 0x7f809c069450 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f80c0152f20 tx=0x7f80b0007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:49.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:49.986+0000 7f80b7400640 1 -- 172.21.15.175:0/472693892 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f80a8016090 con 0x7f80c015a900 2024-04-25T09:04:50.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.146+0000 7f80c5400640 1 -- 172.21.15.175:0/472693892 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80c006acf0 con 0x7f80c015a900 2024-04-25T09:04:50.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.146+0000 7f80b7400640 1 -- 172.21.15.175:0/472693892 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16641 (secure 0 0 0) 0x7f80a80ef800 con 0x7f80c015a900 2024-04-25T09:04:50.140 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:50.140 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":20,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:11.440551+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:50.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.150+0000 7f80c5400640 1 -- 172.21.15.175:0/472693892 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f809c066f90 msgr2=0x7f809c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.150+0000 7f80c5400640 1 --2- 172.21.15.175:0/472693892 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f809c066f90 0x7f809c069450 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f80c0152f20 tx=0x7f80b0007e90 comp rx=0 tx=0).stop 2024-04-25T09:04:50.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.150+0000 7f80c5400640 1 -- 172.21.15.175:0/472693892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80c015a900 msgr2=0x7f80c0146d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.150+0000 7f80c5400640 1 --2- 172.21.15.175:0/472693892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80c015a900 0x7f80c0146d30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f80a80b0040 tx=0x7f80a8019240 comp rx=0 tx=0).stop 2024-04-25T09:04:50.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.150+0000 7f80c5400640 1 -- 172.21.15.175:0/472693892 shutdown_connections 2024-04-25T09:04:50.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.150+0000 7f80c5400640 1 --2- 172.21.15.175:0/472693892 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f809c066f90 0x7f809c069450 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.150+0000 7f80c5400640 1 --2- 172.21.15.175:0/472693892 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80c01571e0 0x7f80c00b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.150+0000 7f80c5400640 1 --2- 172.21.15.175:0/472693892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80c015a900 0x7f80c0146d30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.150+0000 7f80c5400640 1 --2- 172.21.15.175:0/472693892 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80c00cf560 0x7f80c0147340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.150+0000 7f80c5400640 1 -- 172.21.15.175:0/472693892 >> 172.21.15.175:0/472693892 conn(0x7f80c00cd520 msgr2=0x7f80c0071240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:50.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.150+0000 7f80c5400640 1 -- 172.21.15.175:0/472693892 shutdown_connections 2024-04-25T09:04:50.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.150+0000 7f80c5400640 1 -- 172.21.15.175:0/472693892 wait complete. 2024-04-25T09:04:50.163 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:04:50.163 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:50.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.306+0000 7f8110000640 1 Processor -- start 2024-04-25T09:04:50.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.306+0000 7f8110000640 1 -- start start 2024-04-25T09:04:50.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.306+0000 7f8110000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8108099a50 0x7f810806cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:50.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.306+0000 7f8110000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81080d0d50 0x7f81080cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:50.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.306+0000 7f8110000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81080cfcb0 con 0x7f810806bd60 2024-04-25T09:04:50.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.306+0000 7f8110000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81080cff90 con 0x7f8108099a50 2024-04-25T09:04:50.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.306+0000 7f8110000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81080d0270 con 0x7f81080d0d50 2024-04-25T09:04:50.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.306+0000 7f810d600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8108099a50 0x7f810806cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:50.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.306+0000 7f810d600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8108099a50 0x7f810806cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50204/0 (socket says 172.21.15.175:50204) 2024-04-25T09:04:50.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.306+0000 7f810d600640 1 -- 172.21.15.175:0/3004200483 learned_addr learned my addr 172.21.15.175:0/3004200483 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:50.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.306+0000 7f810e000640 1 --2- 172.21.15.175:0/3004200483 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81080d0d50 0x7f81080cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:50.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.306+0000 7f810d600640 1 -- 172.21.15.175:0/3004200483 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81080d0d50 msgr2=0x7f81080cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:50.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.306+0000 7f810d600640 1 --2- 172.21.15.175:0/3004200483 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81080d0d50 0x7f81080cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.306+0000 7f810d600640 1 -- 172.21.15.175:0/3004200483 >> v1:172.21.15.177:6789/0 conn(0x7f810806bd60 legacy=0x7f8108099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:50.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.306+0000 7f810d600640 1 -- 172.21.15.175:0/3004200483 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81080d0550 con 0x7f8108099a50 2024-04-25T09:04:50.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.310+0000 7f810d600640 1 --2- 172.21.15.175:0/3004200483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8108099a50 0x7f810806cc50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009870 tx=0x7f80fc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad62ff7ac75c47f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:50.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.310+0000 7f8107e00640 1 -- 172.21.15.175:0/3004200483 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc0b2070 con 0x7f8108099a50 2024-04-25T09:04:50.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.310+0000 7f8107e00640 1 -- 172.21.15.175:0/3004200483 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc0a9070 con 0x7f8108099a50 2024-04-25T09:04:50.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.310+0000 7f8107e00640 1 -- 172.21.15.175:0/3004200483 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc0ad880 con 0x7f8108099a50 2024-04-25T09:04:50.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.310+0000 7f8110000640 1 -- 172.21.15.175:0/3004200483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8108099a50 msgr2=0x7f810806cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.310+0000 7f8110000640 1 --2- 172.21.15.175:0/3004200483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8108099a50 0x7f810806cc50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009870 tx=0x7f80fc01c560 comp rx=0 tx=0).stop 2024-04-25T09:04:50.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.310+0000 7f8110000640 1 -- 172.21.15.175:0/3004200483 shutdown_connections 2024-04-25T09:04:50.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.310+0000 7f8110000640 1 --2- 172.21.15.175:0/3004200483 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81080d0d50 0x7f81080cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.310+0000 7f8110000640 1 --2- 172.21.15.175:0/3004200483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8108099a50 0x7f810806cc50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.310+0000 7f8110000640 1 -- 172.21.15.175:0/3004200483 >> 172.21.15.175:0/3004200483 conn(0x7f81080b3300 msgr2=0x7f81080b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:50.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.310+0000 7f8110000640 1 -- 172.21.15.175:0/3004200483 shutdown_connections 2024-04-25T09:04:50.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.310+0000 7f8110000640 1 -- 172.21.15.175:0/3004200483 wait complete. 2024-04-25T09:04:50.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f8110000640 1 Processor -- start 2024-04-25T09:04:50.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f8110000640 1 -- start start 2024-04-25T09:04:50.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f8110000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f810806bd60 0x7f8108157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:50.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f8110000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8108099a50 0x7f8108151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:50.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f8110000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81080d0d50 0x7f81080c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:50.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f8110000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810815dfe0 con 0x7f81080d0d50 2024-04-25T09:04:50.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f8110000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810815de60 con 0x7f8108099a50 2024-04-25T09:04:50.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f8110000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810816b260 con 0x7f810806bd60 2024-04-25T09:04:50.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f810e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81080d0d50 0x7f81080c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:50.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f810e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81080d0d50 0x7f81080c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50206/0 (socket says 172.21.15.175:50206) 2024-04-25T09:04:50.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f810e000640 1 -- 172.21.15.175:0/4227763689 learned_addr learned my addr 172.21.15.175:0/4227763689 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:50.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f810cc00640 1 --2- 172.21.15.175:0/4227763689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8108099a50 0x7f8108151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:50.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f810d600640 1 --2- 172.21.15.175:0/4227763689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f810806bd60 0x7f8108157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:50.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f810e000640 1 -- 172.21.15.175:0/4227763689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f810806bd60 msgr2=0x7f8108157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f810e000640 1 --2- 172.21.15.175:0/4227763689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f810806bd60 0x7f8108157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f810e000640 1 -- 172.21.15.175:0/4227763689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8108099a50 msgr2=0x7f8108151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f810e000640 1 --2- 172.21.15.175:0/4227763689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8108099a50 0x7f8108151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f810e000640 1 -- 172.21.15.175:0/4227763689 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81081563d0 con 0x7f81080d0d50 2024-04-25T09:04:50.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f810e000640 1 --2- 172.21.15.175:0/4227763689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81080d0d50 0x7f81080c79c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8100007e40 tx=0x7f810000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:50.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f8105600640 1 -- 172.21.15.175:0/4227763689 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100014620 con 0x7f81080d0d50 2024-04-25T09:04:50.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f8105600640 1 -- 172.21.15.175:0/4227763689 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8100019070 con 0x7f81080d0d50 2024-04-25T09:04:50.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f8105600640 1 -- 172.21.15.175:0/4227763689 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100014a20 con 0x7f81080d0d50 2024-04-25T09:04:50.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f8110000640 1 -- 172.21.15.175:0/4227763689 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81080c5d30 con 0x7f81080d0d50 2024-04-25T09:04:50.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f8110000640 1 -- 172.21.15.175:0/4227763689 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81080c62f0 con 0x7f81080d0d50 2024-04-25T09:04:50.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.314+0000 7f8110000640 1 -- 172.21.15.175:0/4227763689 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8108074a60 con 0x7f81080d0d50 2024-04-25T09:04:50.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.318+0000 7f8105600640 1 -- 172.21.15.175:0/4227763689 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8100014bc0 con 0x7f81080d0d50 2024-04-25T09:04:50.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.318+0000 7f8105600640 1 --2- 172.21.15.175:0/4227763689 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f80e8066f60 0x7f80e8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:50.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.318+0000 7f8105600640 1 -- 172.21.15.175:0/4227763689 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81000857a0 con 0x7f81080d0d50 2024-04-25T09:04:50.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.318+0000 7f810d600640 1 --2- 172.21.15.175:0/4227763689 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f80e8066f60 0x7f80e8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:50.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.318+0000 7f810d600640 1 --2- 172.21.15.175:0/4227763689 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f80e8066f60 0x7f80e8069420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0af000 tx=0x7f80fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:50.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.322+0000 7f8105600640 1 -- 172.21.15.175:0/4227763689 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8100056140 con 0x7f81080d0d50 2024-04-25T09:04:50.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.514+0000 7f8110000640 1 -- 172.21.15.175:0/4227763689 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f810806ce30 con 0x7f81080d0d50 2024-04-25T09:04:50.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.514+0000 7f8105600640 1 -- 172.21.15.175:0/4227763689 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4938 (secure 0 0 0) 0x7f810005a1e0 con 0x7f81080d0d50 2024-04-25T09:04:50.507 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:50.507 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/989886914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":989886914},{"type":"v1","addr":"172.21.15.175:6837","nonce":989886914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/611556493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":611556493},{"type":"v1","addr":"172.21.15.177:6833","nonce":611556493}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1366486960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1366486960},{"type":"v1","addr":"172.21.15.177:6835","nonce":1366486960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:09.810111+0000","modified":"2024-04-25T09:04:12.820376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6836/2613139594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2613139594},{"type":"v1","addr":"172.21.15.175:6836","nonce":2613139594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:04:50.507 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 8 2024-04-25T09:04:50.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.514+0000 7f8110000640 1 -- 172.21.15.175:0/4227763689 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f80e8066f60 msgr2=0x7f80e8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.514+0000 7f8110000640 1 --2- 172.21.15.175:0/4227763689 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f80e8066f60 0x7f80e8069420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0af000 tx=0x7f80fc008040 comp rx=0 tx=0).stop 2024-04-25T09:04:50.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.514+0000 7f8110000640 1 -- 172.21.15.175:0/4227763689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81080d0d50 msgr2=0x7f81080c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.514+0000 7f8110000640 1 --2- 172.21.15.175:0/4227763689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81080d0d50 0x7f81080c79c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8100007e40 tx=0x7f810000e4b0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.518+0000 7f8110000640 1 -- 172.21.15.175:0/4227763689 shutdown_connections 2024-04-25T09:04:50.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.518+0000 7f8110000640 1 --2- 172.21.15.175:0/4227763689 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f80e8066f60 0x7f80e8069420 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.518+0000 7f8110000640 1 --2- 172.21.15.175:0/4227763689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81080d0d50 0x7f81080c79c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.518+0000 7f8110000640 1 --2- 172.21.15.175:0/4227763689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8108099a50 0x7f8108151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.518+0000 7f8110000640 1 --2- 172.21.15.175:0/4227763689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f810806bd60 0x7f8108157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.518+0000 7f8110000640 1 -- 172.21.15.175:0/4227763689 >> 172.21.15.175:0/4227763689 conn(0x7f81080b3300 msgr2=0x7f81080ae4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:50.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.518+0000 7f8110000640 1 -- 172.21.15.175:0/4227763689 shutdown_connections 2024-04-25T09:04:50.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.518+0000 7f8110000640 1 -- 172.21.15.175:0/4227763689 wait complete. 2024-04-25T09:04:50.528 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:50.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.670+0000 7f0332000640 1 Processor -- start 2024-04-25T09:04:50.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.670+0000 7f0332000640 1 -- start start 2024-04-25T09:04:50.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.670+0000 7f0332000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f032c15a900 0x7f032c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:50.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.670+0000 7f0332000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f032c0cd520 0x7f032c0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:50.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.670+0000 7f0332000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f032c0cda00 con 0x7f032c0cf560 2024-04-25T09:04:50.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.670+0000 7f0332000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f032c15bcf0 con 0x7f032c15a900 2024-04-25T09:04:50.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.670+0000 7f0332000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f032c0cdce0 con 0x7f032c0cd520 2024-04-25T09:04:50.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.670+0000 7f032b400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f032c15a900 0x7f032c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:50.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.670+0000 7f032b400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f032c15a900 0x7f032c06e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50222/0 (socket says 172.21.15.175:50222) 2024-04-25T09:04:50.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.670+0000 7f032b400640 1 -- 172.21.15.175:0/3956652684 learned_addr learned my addr 172.21.15.175:0/3956652684 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:50.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.670+0000 7f032aa00640 1 --2- 172.21.15.175:0/3956652684 >> v2:172.21.15.177:3300/0 conn(0x7f032c0cd520 0x7f032c0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:50.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.670+0000 7f032b400640 1 -- 172.21.15.175:0/3956652684 >> v2:172.21.15.177:3300/0 conn(0x7f032c0cd520 msgr2=0x7f032c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:50.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.670+0000 7f032b400640 1 --2- 172.21.15.175:0/3956652684 >> v2:172.21.15.177:3300/0 conn(0x7f032c0cd520 0x7f032c0ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.670+0000 7f032b400640 1 -- 172.21.15.175:0/3956652684 >> v1:172.21.15.177:6789/0 conn(0x7f032c0cf560 legacy=0x7f032c15bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.670+0000 7f032b400640 1 -- 172.21.15.175:0/3956652684 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c0cdfc0 con 0x7f032c15a900 2024-04-25T09:04:50.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.674+0000 7f032b400640 1 --2- 172.21.15.175:0/3956652684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f032c15a900 0x7f032c06e150 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f032c0cf510 tx=0x7f031c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29194727d0b8755f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:50.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.674+0000 7f032a000640 1 -- 172.21.15.175:0/3956652684 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c0a5790 con 0x7f032c15a900 2024-04-25T09:04:50.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.674+0000 7f032a000640 1 -- 172.21.15.175:0/3956652684 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031c0a5930 con 0x7f032c15a900 2024-04-25T09:04:50.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.674+0000 7f032a000640 1 -- 172.21.15.175:0/3956652684 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c0a5d00 con 0x7f032c15a900 2024-04-25T09:04:50.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.674+0000 7f0332000640 1 -- 172.21.15.175:0/3956652684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f032c15a900 msgr2=0x7f032c06e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.674+0000 7f0332000640 1 --2- 172.21.15.175:0/3956652684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f032c15a900 0x7f032c06e150 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f032c0cf510 tx=0x7f031c01c9c0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.674+0000 7f0332000640 1 -- 172.21.15.175:0/3956652684 shutdown_connections 2024-04-25T09:04:50.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.674+0000 7f0332000640 1 --2- 172.21.15.175:0/3956652684 >> v2:172.21.15.177:3300/0 conn(0x7f032c0cd520 0x7f032c0ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.674+0000 7f0332000640 1 --2- 172.21.15.175:0/3956652684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f032c15a900 0x7f032c06e150 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.674+0000 7f0332000640 1 -- 172.21.15.175:0/3956652684 >> 172.21.15.175:0/3956652684 conn(0x7f032c067150 msgr2=0x7f032c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:50.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.674+0000 7f0332000640 1 -- 172.21.15.175:0/3956652684 shutdown_connections 2024-04-25T09:04:50.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.674+0000 7f0332000640 1 -- 172.21.15.175:0/3956652684 wait complete. 2024-04-25T09:04:50.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f0332000640 1 Processor -- start 2024-04-25T09:04:50.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f0332000640 1 -- start start 2024-04-25T09:04:50.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f0332000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f032c0cf560 0x7f032c142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:50.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f0332000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f032c15a900 0x7f032c146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:50.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f0332000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f032c1420c0 0x7f032c142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:50.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f0332000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c0cf160 con 0x7f032c15a900 2024-04-25T09:04:50.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f0332000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c0cefe0 con 0x7f032c0cf560 2024-04-25T09:04:50.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f0332000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032c06d3b0 con 0x7f032c1420c0 2024-04-25T09:04:50.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f032aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f032c15a900 0x7f032c146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:50.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f032aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f032c15a900 0x7f032c146df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50238/0 (socket says 172.21.15.175:50238) 2024-04-25T09:04:50.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f032aa00640 1 -- 172.21.15.175:0/1661257185 learned_addr learned my addr 172.21.15.175:0/1661257185 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:50.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f032b400640 1 --2- 172.21.15.175:0/1661257185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f032c0cf560 0x7f032c142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:50.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f032be00640 1 --2- 172.21.15.175:0/1661257185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f032c1420c0 0x7f032c142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:50.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f032aa00640 1 -- 172.21.15.175:0/1661257185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f032c1420c0 msgr2=0x7f032c142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f032aa00640 1 --2- 172.21.15.175:0/1661257185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f032c1420c0 0x7f032c142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f032aa00640 1 -- 172.21.15.175:0/1661257185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f032c0cf560 msgr2=0x7f032c142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f032aa00640 1 --2- 172.21.15.175:0/1661257185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f032c0cf560 0x7f032c142f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f032aa00640 1 -- 172.21.15.175:0/1661257185 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c147cb0 con 0x7f032c15a900 2024-04-25T09:04:50.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f032be00640 1 --2- 172.21.15.175:0/1661257185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f032c1420c0 0x7f032c142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:50.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f032aa00640 1 --2- 172.21.15.175:0/1661257185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f032c15a900 0x7f032c146df0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f031800d800 tx=0x7f031800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:50.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f0323400640 1 -- 172.21.15.175:0/1661257185 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031800b6c0 con 0x7f032c15a900 2024-04-25T09:04:50.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f0323400640 1 -- 172.21.15.175:0/1661257185 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0318019070 con 0x7f032c15a900 2024-04-25T09:04:50.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f0323400640 1 -- 172.21.15.175:0/1661257185 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031800bac0 con 0x7f032c15a900 2024-04-25T09:04:50.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f0332000640 1 -- 172.21.15.175:0/1661257185 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f032c14eed0 con 0x7f032c15a900 2024-04-25T09:04:50.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.678+0000 7f0332000640 1 -- 172.21.15.175:0/1661257185 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032c1479d0 con 0x7f032c15a900 2024-04-25T09:04:50.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.682+0000 7f0332000640 1 -- 172.21.15.175:0/1661257185 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f032c074a60 con 0x7f032c15a900 2024-04-25T09:04:50.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.682+0000 7f0323400640 1 -- 172.21.15.175:0/1661257185 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f031800bc60 con 0x7f032c15a900 2024-04-25T09:04:50.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.682+0000 7f0323400640 1 --2- 172.21.15.175:0/1661257185 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f030c066f90 0x7f030c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:50.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.682+0000 7f0323400640 1 -- 172.21.15.175:0/1661257185 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0318085430 con 0x7f032c15a900 2024-04-25T09:04:50.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.682+0000 7f032b400640 1 --2- 172.21.15.175:0/1661257185 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f030c066f90 0x7f030c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:50.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.682+0000 7f032b400640 1 --2- 172.21.15.175:0/1661257185 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f030c066f90 0x7f030c069450 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f031c0ae000 tx=0x7f031c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:50.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.686+0000 7f0323400640 1 -- 172.21.15.175:0/1661257185 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f03180564d0 con 0x7f032c15a900 2024-04-25T09:04:50.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.882+0000 7f0332000640 1 -- 172.21.15.175:0/1661257185 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f032c153180 con 0x7f032c15a900 2024-04-25T09:04:50.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.882+0000 7f0323400640 1 -- 172.21.15.175:0/1661257185 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4938 (secure 0 0 0) 0x7f0318055dd0 con 0x7f032c15a900 2024-04-25T09:04:50.874 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:50.874 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/989886914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":989886914},{"type":"v1","addr":"172.21.15.175:6837","nonce":989886914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6833/611556493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":611556493},{"type":"v1","addr":"172.21.15.177:6833","nonce":611556493}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/1366486960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1366486960},{"type":"v1","addr":"172.21.15.177:6835","nonce":1366486960}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:09.810111+0000","modified":"2024-04-25T09:04:12.820376+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6836/2613139594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2613139594},{"type":"v1","addr":"172.21.15.175:6836","nonce":2613139594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:04:50.875 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 8 2024-04-25T09:04:50.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.882+0000 7f0332000640 1 -- 172.21.15.175:0/1661257185 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f030c066f90 msgr2=0x7f030c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.882+0000 7f0332000640 1 --2- 172.21.15.175:0/1661257185 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f030c066f90 0x7f030c069450 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f031c0ae000 tx=0x7f031c0a7070 comp rx=0 tx=0).stop 2024-04-25T09:04:50.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.882+0000 7f0332000640 1 -- 172.21.15.175:0/1661257185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f032c15a900 msgr2=0x7f032c146df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:50.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.882+0000 7f0332000640 1 --2- 172.21.15.175:0/1661257185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f032c15a900 0x7f032c146df0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f031800d800 tx=0x7f031800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.882+0000 7f0332000640 1 -- 172.21.15.175:0/1661257185 shutdown_connections 2024-04-25T09:04:50.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.882+0000 7f0332000640 1 --2- 172.21.15.175:0/1661257185 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f030c066f90 0x7f030c069450 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.882+0000 7f0332000640 1 --2- 172.21.15.175:0/1661257185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f032c1420c0 0x7f032c142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.882+0000 7f0332000640 1 --2- 172.21.15.175:0/1661257185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f032c15a900 0x7f032c146df0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.882+0000 7f0332000640 1 --2- 172.21.15.175:0/1661257185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f032c0cf560 0x7f032c142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:50.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.882+0000 7f0332000640 1 -- 172.21.15.175:0/1661257185 >> 172.21.15.175:0/1661257185 conn(0x7f032c0cd520 msgr2=0x7f032c0b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:50.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.882+0000 7f0332000640 1 -- 172.21.15.175:0/1661257185 shutdown_connections 2024-04-25T09:04:50.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:50.882+0000 7f0332000640 1 -- 172.21.15.175:0/1661257185 wait complete. 2024-04-25T09:04:50.896 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:51.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.038+0000 7f08ee000640 1 Processor -- start 2024-04-25T09:04:51.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.038+0000 7f08ee000640 1 -- start start 2024-04-25T09:04:51.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.038+0000 7f08ee000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f08e815db00 0x7f08e806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.038+0000 7f08ee000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f08e8161e30 0x7f08e806b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.038+0000 7f08ee000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e806f280 con 0x7f08e80acd90 2024-04-25T09:04:51.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.038+0000 7f08ee000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e806acf0 con 0x7f08e8161e30 2024-04-25T09:04:51.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.038+0000 7f08ee000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e806afd0 con 0x7f08e815db00 2024-04-25T09:04:51.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.038+0000 7f08e7e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f08e8161e30 0x7f08e806b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.038+0000 7f08dea00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f08e80acd90 0x7f08e8161720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:37756/0 (socket says 172.21.15.175:37756) 2024-04-25T09:04:51.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.038+0000 7f08dea00640 1 -- 172.21.15.175:0/1320223247 learned_addr learned my addr 172.21.15.175:0/1320223247 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:51.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.042+0000 7f08e7400640 1 --2- 172.21.15.175:0/1320223247 >> v2:172.21.15.177:3300/0 conn(0x7f08e815db00 0x7f08e806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.042+0000 7f08e7e00640 1 -- 172.21.15.175:0/1320223247 >> v2:172.21.15.177:3300/0 conn(0x7f08e815db00 msgr2=0x7f08e806e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:51.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.042+0000 7f08e7e00640 1 --2- 172.21.15.175:0/1320223247 >> v2:172.21.15.177:3300/0 conn(0x7f08e815db00 0x7f08e806e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.042+0000 7f08e7e00640 1 -- 172.21.15.175:0/1320223247 >> v1:172.21.15.175:6789/0 conn(0x7f08e80acd90 legacy=0x7f08e8161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.042+0000 7f08e7e00640 1 -- 172.21.15.175:0/1320223247 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e806b2b0 con 0x7f08e8161e30 2024-04-25T09:04:51.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.042+0000 7f08e7e00640 1 --2- 172.21.15.175:0/1320223247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08e8161e30 0x7f08e806b7d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009d90 tx=0x7f08e001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785ce695d4db2d11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:51.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.042+0000 7f08e6a00640 1 -- 172.21.15.175:0/1320223247 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e00b2070 con 0x7f08e8161e30 2024-04-25T09:04:51.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.042+0000 7f08e6a00640 1 -- 172.21.15.175:0/1320223247 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e00a59b0 con 0x7f08e8161e30 2024-04-25T09:04:51.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.042+0000 7f08e6a00640 1 -- 172.21.15.175:0/1320223247 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e00a5d80 con 0x7f08e8161e30 2024-04-25T09:04:51.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.042+0000 7f08ee000640 1 -- 172.21.15.175:0/1320223247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08e8161e30 msgr2=0x7f08e806b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.042+0000 7f08ee000640 1 --2- 172.21.15.175:0/1320223247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08e8161e30 0x7f08e806b7d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009d90 tx=0x7f08e001c8d0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08ee000640 1 -- 172.21.15.175:0/1320223247 shutdown_connections 2024-04-25T09:04:51.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08ee000640 1 --2- 172.21.15.175:0/1320223247 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08e8161e30 0x7f08e806b7d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08ee000640 1 --2- 172.21.15.175:0/1320223247 >> v2:172.21.15.177:3300/0 conn(0x7f08e815db00 0x7f08e806e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08ee000640 1 -- 172.21.15.175:0/1320223247 >> 172.21.15.175:0/1320223247 conn(0x7f08e80b2200 msgr2=0x7f08e80cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:51.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08ee000640 1 -- 172.21.15.175:0/1320223247 shutdown_connections 2024-04-25T09:04:51.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08ee000640 1 -- 172.21.15.175:0/1320223247 wait complete. 2024-04-25T09:04:51.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08ee000640 1 Processor -- start 2024-04-25T09:04:51.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08ee000640 1 -- start start 2024-04-25T09:04:51.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08ee000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08e80acd90 0x7f08e815fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08ee000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08e815db00 0x7f08e8155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08ee000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08e8161e30 0x7f08e8158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08ee000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e816ac40 con 0x7f08e80acd90 2024-04-25T09:04:51.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08ee000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e816aac0 con 0x7f08e815db00 2024-04-25T09:04:51.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08ee000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e816adc0 con 0x7f08e8161e30 2024-04-25T09:04:51.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08e7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08e80acd90 0x7f08e815fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08e7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08e80acd90 0x7f08e815fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50250/0 (socket says 172.21.15.175:50250) 2024-04-25T09:04:51.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08e7400640 1 -- 172.21.15.175:0/2449809248 learned_addr learned my addr 172.21.15.175:0/2449809248 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:51.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08dea00640 1 --2- 172.21.15.175:0/2449809248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08e815db00 0x7f08e8155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08e7e00640 1 --2- 172.21.15.175:0/2449809248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08e8161e30 0x7f08e8158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08e7400640 1 -- 172.21.15.175:0/2449809248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08e8161e30 msgr2=0x7f08e8158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08e7400640 1 --2- 172.21.15.175:0/2449809248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08e8161e30 0x7f08e8158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08e7400640 1 -- 172.21.15.175:0/2449809248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08e815db00 msgr2=0x7f08e8155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08e7400640 1 --2- 172.21.15.175:0/2449809248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08e815db00 0x7f08e8155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08e7400640 1 -- 172.21.15.175:0/2449809248 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e8154b70 con 0x7f08e80acd90 2024-04-25T09:04:51.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08dea00640 1 --2- 172.21.15.175:0/2449809248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08e815db00 0x7f08e8155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:51.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08e7400640 1 --2- 172.21.15.175:0/2449809248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08e80acd90 0x7f08e815fbf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f08d800d800 tx=0x7f08d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:51.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08dfe00640 1 -- 172.21.15.175:0/2449809248 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d800b6c0 con 0x7f08e80acd90 2024-04-25T09:04:51.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08dfe00640 1 -- 172.21.15.175:0/2449809248 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d8019070 con 0x7f08e80acd90 2024-04-25T09:04:51.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08dfe00640 1 -- 172.21.15.175:0/2449809248 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d800ba60 con 0x7f08e80acd90 2024-04-25T09:04:51.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.046+0000 7f08ee000640 1 -- 172.21.15.175:0/2449809248 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e8155130 con 0x7f08e80acd90 2024-04-25T09:04:51.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.050+0000 7f08ee000640 1 -- 172.21.15.175:0/2449809248 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e81556f0 con 0x7f08e80acd90 2024-04-25T09:04:51.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.050+0000 7f08ee000640 1 -- 172.21.15.175:0/2449809248 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e8074a60 con 0x7f08e80acd90 2024-04-25T09:04:51.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.050+0000 7f08dfe00640 1 -- 172.21.15.175:0/2449809248 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f08d800bc00 con 0x7f08e80acd90 2024-04-25T09:04:51.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.050+0000 7f08dfe00640 1 --2- 172.21.15.175:0/2449809248 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f08c4066f60 0x7f08c4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.050+0000 7f08dfe00640 1 -- 172.21.15.175:0/2449809248 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f08d8085550 con 0x7f08e80acd90 2024-04-25T09:04:51.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.050+0000 7f08dea00640 1 --2- 172.21.15.175:0/2449809248 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f08c4066f60 0x7f08c4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.050+0000 7f08dea00640 1 --2- 172.21.15.175:0/2449809248 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f08c4066f60 0x7f08c4069420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f08e81fa4a0 tx=0x7f08d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:51.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.054+0000 7f08dfe00640 1 -- 172.21.15.175:0/2449809248 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f08d80564e0 con 0x7f08e80acd90 2024-04-25T09:04:51.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.210+0000 7f08ee000640 1 -- 172.21.15.175:0/2449809248 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08e80d0ae0 con 0x7f08e80acd90 2024-04-25T09:04:51.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.214+0000 7f08dfe00640 1 -- 172.21.15.175:0/2449809248 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16835 (secure 0 0 0) 0x7f08d8083e20 con 0x7f08e80acd90 2024-04-25T09:04:51.206 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:51.206 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":21,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:50.745509+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:08.047706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:08.795449+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:51.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.214+0000 7f08ee000640 1 -- 172.21.15.175:0/2449809248 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f08c4066f60 msgr2=0x7f08c4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.214+0000 7f08ee000640 1 --2- 172.21.15.175:0/2449809248 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f08c4066f60 0x7f08c4069420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f08e81fa4a0 tx=0x7f08d0009040 comp rx=0 tx=0).stop 2024-04-25T09:04:51.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.214+0000 7f08ee000640 1 -- 172.21.15.175:0/2449809248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08e80acd90 msgr2=0x7f08e815fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.214+0000 7f08ee000640 1 --2- 172.21.15.175:0/2449809248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08e80acd90 0x7f08e815fbf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f08d800d800 tx=0x7f08d800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.214+0000 7f08ee000640 1 -- 172.21.15.175:0/2449809248 shutdown_connections 2024-04-25T09:04:51.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.214+0000 7f08ee000640 1 --2- 172.21.15.175:0/2449809248 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f08c4066f60 0x7f08c4069420 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.214+0000 7f08ee000640 1 --2- 172.21.15.175:0/2449809248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08e8161e30 0x7f08e8158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.214+0000 7f08ee000640 1 --2- 172.21.15.175:0/2449809248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08e815db00 0x7f08e8155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.214+0000 7f08ee000640 1 --2- 172.21.15.175:0/2449809248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08e80acd90 0x7f08e815fbf0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.214+0000 7f08ee000640 1 -- 172.21.15.175:0/2449809248 >> 172.21.15.175:0/2449809248 conn(0x7f08e80b2200 msgr2=0x7f08e815cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:51.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.214+0000 7f08ee000640 1 -- 172.21.15.175:0/2449809248 shutdown_connections 2024-04-25T09:04:51.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.214+0000 7f08ee000640 1 -- 172.21.15.175:0/2449809248 wait complete. 2024-04-25T09:04:51.228 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:04:51.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.370+0000 7f440ae00640 1 Processor -- start 2024-04-25T09:04:51.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.370+0000 7f440ae00640 1 -- start start 2024-04-25T09:04:51.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.370+0000 7f440ae00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44040cbe60 0x7f440415af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.370+0000 7f440ae00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f440406d310 0x7f44040b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.370+0000 7f440ae00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440406db60 con 0x7f44040b4630 2024-04-25T09:04:51.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.370+0000 7f440ae00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f440406de40 con 0x7f440406d310 2024-04-25T09:04:51.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.370+0000 7f440ae00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440406e120 con 0x7f44040cbe60 2024-04-25T09:04:51.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.370+0000 7f4403400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f440406d310 0x7f44040b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.370+0000 7f4403400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f440406d310 0x7f44040b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50262/0 (socket says 172.21.15.175:50262) 2024-04-25T09:04:51.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.370+0000 7f4403400640 1 -- 172.21.15.175:0/1981689236 learned_addr learned my addr 172.21.15.175:0/1981689236 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:51.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.374+0000 7f4403e00640 1 --2- 172.21.15.175:0/1981689236 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44040cbe60 0x7f440415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.374+0000 7f4403400640 1 -- 172.21.15.175:0/1981689236 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44040cbe60 msgr2=0x7f440415af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:51.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.374+0000 7f4403400640 1 --2- 172.21.15.175:0/1981689236 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44040cbe60 0x7f440415af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.374+0000 7f4403400640 1 -- 172.21.15.175:0/1981689236 >> v1:172.21.15.177:6789/0 conn(0x7f44040b4630 legacy=0x7f44040b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:51.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.374+0000 7f4403400640 1 -- 172.21.15.175:0/1981689236 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440415c2f0 con 0x7f440406d310 2024-04-25T09:04:51.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.374+0000 7f4403e00640 1 --2- 172.21.15.175:0/1981689236 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44040cbe60 0x7f440415af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:51.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.374+0000 7f4403400640 1 --2- 172.21.15.175:0/1981689236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f440406d310 0x7f44040b40f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f43f0009870 tx=0x7f43f001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fb1ebe5d536839 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:51.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.374+0000 7f4402a00640 1 -- 172.21.15.175:0/1981689236 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f00b0070 con 0x7f440406d310 2024-04-25T09:04:51.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.374+0000 7f4402a00640 1 -- 172.21.15.175:0/1981689236 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f00ab600 con 0x7f440406d310 2024-04-25T09:04:51.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.374+0000 7f4402a00640 1 -- 172.21.15.175:0/1981689236 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f00ab9d0 con 0x7f440406d310 2024-04-25T09:04:51.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.374+0000 7f440ae00640 1 -- 172.21.15.175:0/1981689236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f440406d310 msgr2=0x7f44040b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.374+0000 7f440ae00640 1 --2- 172.21.15.175:0/1981689236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f440406d310 0x7f44040b40f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f43f0009870 tx=0x7f43f001c520 comp rx=0 tx=0).stop 2024-04-25T09:04:51.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f440ae00640 1 -- 172.21.15.175:0/1981689236 shutdown_connections 2024-04-25T09:04:51.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f440ae00640 1 --2- 172.21.15.175:0/1981689236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f440406d310 0x7f44040b40f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f440ae00640 1 --2- 172.21.15.175:0/1981689236 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44040cbe60 0x7f440415af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f440ae00640 1 -- 172.21.15.175:0/1981689236 >> 172.21.15.175:0/1981689236 conn(0x7f440406ac50 msgr2=0x7f440406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:51.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f440ae00640 1 -- 172.21.15.175:0/1981689236 shutdown_connections 2024-04-25T09:04:51.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f440ae00640 1 -- 172.21.15.175:0/1981689236 wait complete. 2024-04-25T09:04:51.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f440ae00640 1 Processor -- start 2024-04-25T09:04:51.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f440ae00640 1 -- start start 2024-04-25T09:04:51.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f440ae00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f440406d310 0x7f440414ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f440ae00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44040b4630 0x7f4404155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f440ae00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44040cbe60 0x7f440414fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f440ae00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44040712d0 con 0x7f440406d310 2024-04-25T09:04:51.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f440ae00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44040cc450 con 0x7f44040cbe60 2024-04-25T09:04:51.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f440ae00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4404071450 con 0x7f44040b4630 2024-04-25T09:04:51.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f4403e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f440406d310 0x7f440414ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f4403e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f440406d310 0x7f440414ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50270/0 (socket says 172.21.15.175:50270) 2024-04-25T09:04:51.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f4403e00640 1 -- 172.21.15.175:0/171229039 learned_addr learned my addr 172.21.15.175:0/171229039 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:51.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f4403400640 1 --2- 172.21.15.175:0/171229039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44040b4630 0x7f4404155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f4408e00640 1 --2- 172.21.15.175:0/171229039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44040cbe60 0x7f440414fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f4403e00640 1 -- 172.21.15.175:0/171229039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44040b4630 msgr2=0x7f4404155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f4403e00640 1 --2- 172.21.15.175:0/171229039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44040b4630 0x7f4404155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f4403e00640 1 -- 172.21.15.175:0/171229039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44040cbe60 msgr2=0x7f440414fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f4403e00640 1 --2- 172.21.15.175:0/171229039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44040cbe60 0x7f440414fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f4403e00640 1 -- 172.21.15.175:0/171229039 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4404155ef0 con 0x7f440406d310 2024-04-25T09:04:51.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f4408e00640 1 --2- 172.21.15.175:0/171229039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44040cbe60 0x7f440414fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:51.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f4403e00640 1 --2- 172.21.15.175:0/171229039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f440406d310 0x7f440414ab10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f43f400ce30 tx=0x7f43f400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:51.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.378+0000 7f43fbe00640 1 -- 172.21.15.175:0/171229039 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f400f890 con 0x7f440406d310 2024-04-25T09:04:51.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.382+0000 7f43fbe00640 1 -- 172.21.15.175:0/171229039 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f400fa30 con 0x7f440406d310 2024-04-25T09:04:51.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.382+0000 7f43fbe00640 1 -- 172.21.15.175:0/171229039 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f400fe00 con 0x7f440406d310 2024-04-25T09:04:51.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.382+0000 7f440ae00640 1 -- 172.21.15.175:0/171229039 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44040cd980 con 0x7f440406d310 2024-04-25T09:04:51.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.382+0000 7f440ae00640 1 -- 172.21.15.175:0/171229039 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44040cdc20 con 0x7f440406d310 2024-04-25T09:04:51.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.382+0000 7f440ae00640 1 -- 172.21.15.175:0/171229039 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4404075160 con 0x7f440406d310 2024-04-25T09:04:51.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.382+0000 7f43fbe00640 1 -- 172.21.15.175:0/171229039 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f43f4018400 con 0x7f440406d310 2024-04-25T09:04:51.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.382+0000 7f43fbe00640 1 --2- 172.21.15.175:0/171229039 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f43e4066f60 0x7f43e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.382+0000 7f43fbe00640 1 -- 172.21.15.175:0/171229039 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f43f4085d20 con 0x7f440406d310 2024-04-25T09:04:51.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.382+0000 7f4403400640 1 --2- 172.21.15.175:0/171229039 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f43e4066f60 0x7f43e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.382+0000 7f4403400640 1 --2- 172.21.15.175:0/171229039 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f43e4066f60 0x7f43e4069420 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f43f00ad000 tx=0x7f43f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:51.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.386+0000 7f43fbe00640 1 -- 172.21.15.175:0/171229039 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f43f4014030 con 0x7f440406d310 2024-04-25T09:04:51.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.574+0000 7f440ae00640 1 -- 172.21.15.175:0/171229039 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f440414b050 con 0x7f440406d310 2024-04-25T09:04:51.567 INFO:tasks.ceph.mon.a.smithi175.stderr:2024-04-25T09:04:51.574+0000 7feb0ee00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:04:51.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.574+0000 7f43fbe00640 1 -- 172.21.15.175:0/171229039 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f43f400ae20 con 0x7f440406d310 2024-04-25T09:04:51.569 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:04:51.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.578+0000 7f440ae00640 1 -- 172.21.15.175:0/171229039 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f43e4066f60 msgr2=0x7f43e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.578+0000 7f440ae00640 1 --2- 172.21.15.175:0/171229039 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f43e4066f60 0x7f43e4069420 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f43f00ad000 tx=0x7f43f0008040 comp rx=0 tx=0).stop 2024-04-25T09:04:51.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.578+0000 7f440ae00640 1 -- 172.21.15.175:0/171229039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f440406d310 msgr2=0x7f440414ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.578+0000 7f440ae00640 1 --2- 172.21.15.175:0/171229039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f440406d310 0x7f440414ab10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f43f400ce30 tx=0x7f43f400a650 comp rx=0 tx=0).stop 2024-04-25T09:04:51.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.578+0000 7f440ae00640 1 -- 172.21.15.175:0/171229039 shutdown_connections 2024-04-25T09:04:51.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.578+0000 7f440ae00640 1 --2- 172.21.15.175:0/171229039 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f43e4066f60 0x7f43e4069420 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.578+0000 7f440ae00640 1 --2- 172.21.15.175:0/171229039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44040cbe60 0x7f440414fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.578+0000 7f440ae00640 1 --2- 172.21.15.175:0/171229039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44040b4630 0x7f4404155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.578+0000 7f440ae00640 1 --2- 172.21.15.175:0/171229039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f440406d310 0x7f440414ab10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.578+0000 7f440ae00640 1 -- 172.21.15.175:0/171229039 >> 172.21.15.175:0/171229039 conn(0x7f440406ac50 msgr2=0x7f44040af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:51.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.578+0000 7f440ae00640 1 -- 172.21.15.175:0/171229039 shutdown_connections 2024-04-25T09:04:51.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.578+0000 7f440ae00640 1 -- 172.21.15.175:0/171229039 wait complete. 2024-04-25T09:04:51.587 INFO:tasks.ceph.mds.c.smithi175.stderr: -6930> 2024-04-25T09:04:13.391+0000 7f15e0200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:04:51.599 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:04:51.641 INFO:tasks.ceph.mds.c.smithi175.stdout:starting mds.c at 2024-04-25T09:04:51.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.746+0000 7f2edf200640 1 Processor -- start 2024-04-25T09:04:51.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.750+0000 7f2edf200640 1 -- start start 2024-04-25T09:04:51.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.750+0000 7f2edf200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2ed80cf660 0x7f2ed80d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.750+0000 7f2edf200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed80b4430 con 0x7f2ed81454f0 2024-04-25T09:04:51.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.750+0000 7f2edf200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed8070eb0 con 0x7f2ed80d12a0 2024-04-25T09:04:51.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.750+0000 7f2edf200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed80b4940 con 0x7f2ed80cf660 2024-04-25T09:04:51.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.750+0000 7f2ed7e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f2ed81454f0 0x7f2ed80cef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:37760/0 (socket says 172.21.15.175:37760) 2024-04-25T09:04:51.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.750+0000 7f2ed7e00640 1 -- 172.21.15.175:0/2751523337 learned_addr learned my addr 172.21.15.175:0/2751523337 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:51.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.750+0000 7f2ed7400640 1 --2- 172.21.15.175:0/2751523337 >> v2:172.21.15.177:3300/0 conn(0x7f2ed80cf660 0x7f2ed80d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.750+0000 7f2ed7400640 1 -- 172.21.15.175:0/2751523337 >> v1:172.21.15.177:6789/0 conn(0x7f2ed80d12a0 legacy=0x7f2ed80b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.750+0000 7f2ed7400640 1 -- 172.21.15.175:0/2751523337 >> v1:172.21.15.175:6789/0 conn(0x7f2ed81454f0 legacy=0x7f2ed80cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.750+0000 7f2ed7400640 1 -- 172.21.15.175:0/2751523337 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed8071190 con 0x7f2ed80cf660 2024-04-25T09:04:51.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.754+0000 7f2ed7400640 1 --2- 172.21.15.175:0/2751523337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ed80cf660 0x7f2ed80d0d60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40097f0 tx=0x7f2ec401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7536ad255c69fdd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:51.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.754+0000 7f2ed6a00640 1 -- 172.21.15.175:0/2751523337 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec40a7070 con 0x7f2ed80cf660 2024-04-25T09:04:51.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.754+0000 7f2ed6a00640 1 -- 172.21.15.175:0/2751523337 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec40b0070 con 0x7f2ed80cf660 2024-04-25T09:04:51.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.754+0000 7f2ed6a00640 1 -- 172.21.15.175:0/2751523337 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec40ab890 con 0x7f2ed80cf660 2024-04-25T09:04:51.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.754+0000 7f2edf200640 1 -- 172.21.15.175:0/2751523337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ed80cf660 msgr2=0x7f2ed80d0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.754+0000 7f2edf200640 1 --2- 172.21.15.175:0/2751523337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ed80cf660 0x7f2ed80d0d60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40097f0 tx=0x7f2ec401c470 comp rx=0 tx=0).stop 2024-04-25T09:04:51.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.754+0000 7f2edf200640 1 -- 172.21.15.175:0/2751523337 shutdown_connections 2024-04-25T09:04:51.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.754+0000 7f2edf200640 1 --2- 172.21.15.175:0/2751523337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ed80cf660 0x7f2ed80d0d60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.754+0000 7f2edf200640 1 -- 172.21.15.175:0/2751523337 >> 172.21.15.175:0/2751523337 conn(0x7f2ed80b3510 msgr2=0x7f2ed80b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:51.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.754+0000 7f2edf200640 1 -- 172.21.15.175:0/2751523337 shutdown_connections 2024-04-25T09:04:51.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.754+0000 7f2edf200640 1 -- 172.21.15.175:0/2751523337 wait complete. 2024-04-25T09:04:51.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2edf200640 1 Processor -- start 2024-04-25T09:04:51.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2edf200640 1 -- start start 2024-04-25T09:04:51.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2edf200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ed80cf660 0x7f2ed80cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2edf200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ed80d12a0 0x7f2ed815b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2edf200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ed81454f0 0x7f2ed8165830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2edf200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80b5cf0 con 0x7f2ed80cf660 2024-04-25T09:04:51.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2edf200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80d16d0 con 0x7f2ed80d12a0 2024-04-25T09:04:51.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2edf200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80b5e70 con 0x7f2ed81454f0 2024-04-25T09:04:51.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2ed7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ed80cf660 0x7f2ed80cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2ed7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ed80cf660 0x7f2ed80cb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50282/0 (socket says 172.21.15.175:50282) 2024-04-25T09:04:51.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2ed7e00640 1 -- 172.21.15.175:0/868286270 learned_addr learned my addr 172.21.15.175:0/868286270 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:51.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2edd200640 1 --2- 172.21.15.175:0/868286270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ed81454f0 0x7f2ed8165830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2ed7400640 1 --2- 172.21.15.175:0/868286270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ed80d12a0 0x7f2ed815b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2ed7e00640 1 -- 172.21.15.175:0/868286270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ed81454f0 msgr2=0x7f2ed8165830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2ed7e00640 1 --2- 172.21.15.175:0/868286270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ed81454f0 0x7f2ed8165830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2ed7e00640 1 -- 172.21.15.175:0/868286270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ed80d12a0 msgr2=0x7f2ed815b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:51.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2ed7e00640 1 --2- 172.21.15.175:0/868286270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ed80d12a0 0x7f2ed815b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:51.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2ed7e00640 1 -- 172.21.15.175:0/868286270 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed8066d20 con 0x7f2ed80cf660 2024-04-25T09:04:51.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2ed7400640 1 --2- 172.21.15.175:0/868286270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ed80d12a0 0x7f2ed815b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:51.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2ed7e00640 1 --2- 172.21.15.175:0/868286270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ed80cf660 0x7f2ed80cb730 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800c400 tx=0x7f2ec800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:51.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2ecfe00640 1 -- 172.21.15.175:0/868286270 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8017070 con 0x7f2ed80cf660 2024-04-25T09:04:51.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2ecfe00640 1 -- 172.21.15.175:0/868286270 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec8005cf0 con 0x7f2ed80cf660 2024-04-25T09:04:51.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2ecfe00640 1 -- 172.21.15.175:0/868286270 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec80072d0 con 0x7f2ed80cf660 2024-04-25T09:04:51.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2edf200640 1 -- 172.21.15.175:0/868286270 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed8165d70 con 0x7f2ed80cf660 2024-04-25T09:04:51.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2edf200640 1 -- 172.21.15.175:0/868286270 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed80cc040 con 0x7f2ed80cf660 2024-04-25T09:04:51.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.758+0000 7f2edf200640 1 -- 172.21.15.175:0/868286270 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed8075160 con 0x7f2ed80cf660 2024-04-25T09:04:51.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.762+0000 7f2ecfe00640 1 -- 172.21.15.175:0/868286270 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2ec801a070 con 0x7f2ed80cf660 2024-04-25T09:04:51.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.762+0000 7f2ecfe00640 1 --2- 172.21.15.175:0/868286270 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2eb8066f60 0x7f2eb8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:51.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.762+0000 7f2ecfe00640 1 -- 172.21.15.175:0/868286270 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f2ec8084320 con 0x7f2ed80cf660 2024-04-25T09:04:51.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.762+0000 7f2ed7400640 1 --2- 172.21.15.175:0/868286270 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2eb8066f60 0x7f2eb8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:51.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.762+0000 7f2ed7400640 1 --2- 172.21.15.175:0/868286270 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2eb8066f60 0x7f2eb8069420 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40af000 tx=0x7f2ec40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:51.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.766+0000 7f2ecfe00640 1 -- 172.21.15.175:0/868286270 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2ec8054ca0 con 0x7f2ed80cf660 2024-04-25T09:04:51.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:51.954+0000 7f2edf200640 1 -- 172.21.15.175:0/868286270 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2ed8165fa0 con 0x7f2ed80cf660 2024-04-25T09:04:52.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.578+0000 7f2ecfe00640 1 -- 172.21.15.175:0/868286270 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2ec8058d40 con 0x7f2ed80cf660 2024-04-25T09:04:52.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.582+0000 7f2edf200640 1 -- 172.21.15.175:0/868286270 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2eb8066f60 msgr2=0x7f2eb8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.582+0000 7f2edf200640 1 --2- 172.21.15.175:0/868286270 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2eb8066f60 0x7f2eb8069420 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2ec40af000 tx=0x7f2ec40a7000 comp rx=0 tx=0).stop 2024-04-25T09:04:52.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.582+0000 7f2edf200640 1 -- 172.21.15.175:0/868286270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ed80cf660 msgr2=0x7f2ed80cb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.582+0000 7f2edf200640 1 --2- 172.21.15.175:0/868286270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ed80cf660 0x7f2ed80cb730 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2ec800c400 tx=0x7f2ec800c8c0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.582+0000 7f2edf200640 1 -- 172.21.15.175:0/868286270 shutdown_connections 2024-04-25T09:04:52.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.582+0000 7f2edf200640 1 --2- 172.21.15.175:0/868286270 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2eb8066f60 0x7f2eb8069420 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.582+0000 7f2edf200640 1 --2- 172.21.15.175:0/868286270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ed81454f0 0x7f2ed8165830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.582+0000 7f2edf200640 1 --2- 172.21.15.175:0/868286270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ed80d12a0 0x7f2ed815b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.582+0000 7f2edf200640 1 --2- 172.21.15.175:0/868286270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ed80cf660 0x7f2ed80cb730 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.582+0000 7f2edf200640 1 -- 172.21.15.175:0/868286270 >> 172.21.15.175:0/868286270 conn(0x7f2ed80b3510 msgr2=0x7f2ed806c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:52.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.582+0000 7f2edf200640 1 -- 172.21.15.175:0/868286270 shutdown_connections 2024-04-25T09:04:52.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.582+0000 7f2edf200640 1 -- 172.21.15.175:0/868286270 wait complete. 2024-04-25T09:04:52.595 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:04:52.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.790+0000 7f3717000640 1 Processor -- start 2024-04-25T09:04:52.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.790+0000 7f3717000640 1 -- start start 2024-04-25T09:04:52.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.790+0000 7f3717000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f371015b910 0x7f37100cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.790+0000 7f3717000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f37100b2a20 0x7f37100cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.790+0000 7f3717000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f37100d0030 0x7f3710099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.790+0000 7f3717000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37100cd470 con 0x7f37100d0030 2024-04-25T09:04:52.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.790+0000 7f3717000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37100cc610 con 0x7f37100b2a20 2024-04-25T09:04:52.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.790+0000 7f3717000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371015bcf0 con 0x7f371015b910 2024-04-25T09:04:52.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.790+0000 7f3716600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f37100d0030 0x7f3710099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.790+0000 7f3716600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f37100d0030 0x7f3710099a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50288/0 (socket says 172.21.15.175:50288) 2024-04-25T09:04:52.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.790+0000 7f3716600640 1 -- 172.21.15.175:0/644035358 learned_addr learned my addr 172.21.15.175:0/644035358 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:52.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.790+0000 7f3716600640 1 -- 172.21.15.175:0/644035358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f371015b910 msgr2=0x7f37100cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:52.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.790+0000 7f3716600640 1 --2- 172.21.15.175:0/644035358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f371015b910 0x7f37100cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.790+0000 7f3715200640 1 --2- 172.21.15.175:0/644035358 >> v2:172.21.15.177:3300/0 conn(0x7f37100b2a20 0x7f37100cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.790+0000 7f3716600640 1 -- 172.21.15.175:0/644035358 >> v2:172.21.15.177:3300/0 conn(0x7f37100b2a20 msgr2=0x7f37100cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:52.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.790+0000 7f3716600640 1 --2- 172.21.15.175:0/644035358 >> v2:172.21.15.177:3300/0 conn(0x7f37100b2a20 0x7f37100cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.790+0000 7f3716600640 1 -- 172.21.15.175:0/644035358 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37100cc860 con 0x7f37100d0030 2024-04-25T09:04:52.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.790+0000 7f3715200640 1 --2- 172.21.15.175:0/644035358 >> v2:172.21.15.177:3300/0 conn(0x7f37100b2a20 0x7f37100cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:52.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.794+0000 7f3716600640 1 --2- 172.21.15.175:0/644035358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37100d0030 0x7f3710099a50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f37100b4230 tx=0x7f370801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef64f139daa23076 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:52.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.794+0000 7f370fe00640 1 -- 172.21.15.175:0/644035358 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37080b0070 con 0x7f37100d0030 2024-04-25T09:04:52.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.794+0000 7f370fe00640 1 -- 172.21.15.175:0/644035358 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37080ab600 con 0x7f37100d0030 2024-04-25T09:04:52.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.794+0000 7f370fe00640 1 -- 172.21.15.175:0/644035358 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37080ab9d0 con 0x7f37100d0030 2024-04-25T09:04:52.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.794+0000 7f3717000640 1 -- 172.21.15.175:0/644035358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37100d0030 msgr2=0x7f3710099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.794+0000 7f3717000640 1 --2- 172.21.15.175:0/644035358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37100d0030 0x7f3710099a50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f37100b4230 tx=0x7f370801c260 comp rx=0 tx=0).stop 2024-04-25T09:04:52.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.794+0000 7f3717000640 1 -- 172.21.15.175:0/644035358 shutdown_connections 2024-04-25T09:04:52.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.794+0000 7f3717000640 1 --2- 172.21.15.175:0/644035358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37100d0030 0x7f3710099a50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.794+0000 7f3717000640 1 --2- 172.21.15.175:0/644035358 >> v2:172.21.15.177:3300/0 conn(0x7f37100b2a20 0x7f37100cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.794+0000 7f3717000640 1 --2- 172.21.15.175:0/644035358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f371015b910 0x7f37100cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.794+0000 7f3717000640 1 -- 172.21.15.175:0/644035358 >> 172.21.15.175:0/644035358 conn(0x7f37100d1730 msgr2=0x7f37100d1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:52.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.794+0000 7f3717000640 1 -- 172.21.15.175:0/644035358 shutdown_connections 2024-04-25T09:04:52.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.794+0000 7f3717000640 1 -- 172.21.15.175:0/644035358 wait complete. 2024-04-25T09:04:52.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.794+0000 7f3717000640 1 Processor -- start 2024-04-25T09:04:52.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.794+0000 7f3717000640 1 -- start start 2024-04-25T09:04:52.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3717000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37100b2a20 0x7f3710165a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3717000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37100d0030 0x7f3710070440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3717000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f371015b910 0x7f3710070980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3717000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37100b2f80 con 0x7f371015b910 2024-04-25T09:04:52.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3717000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37100b2e00 con 0x7f37100b2a20 2024-04-25T09:04:52.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3717000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37100cd900 con 0x7f37100d0030 2024-04-25T09:04:52.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3716600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f371015b910 0x7f3710070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3716600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f371015b910 0x7f3710070980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50292/0 (socket says 172.21.15.175:50292) 2024-04-25T09:04:52.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3716600640 1 -- 172.21.15.175:0/1450352329 learned_addr learned my addr 172.21.15.175:0/1450352329 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:52.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3715c00640 1 --2- 172.21.15.175:0/1450352329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37100b2a20 0x7f3710165a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3715200640 1 --2- 172.21.15.175:0/1450352329 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37100d0030 0x7f3710070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3716600640 1 -- 172.21.15.175:0/1450352329 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37100d0030 msgr2=0x7f3710070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3716600640 1 --2- 172.21.15.175:0/1450352329 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37100d0030 0x7f3710070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3716600640 1 -- 172.21.15.175:0/1450352329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37100b2a20 msgr2=0x7f3710165a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:52.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3716600640 1 --2- 172.21.15.175:0/1450352329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37100b2a20 0x7f3710165a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:52.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3716600640 1 -- 172.21.15.175:0/1450352329 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371006c260 con 0x7f371015b910 2024-04-25T09:04:52.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3715c00640 1 --2- 172.21.15.175:0/1450352329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37100b2a20 0x7f3710165a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:52.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3716600640 1 --2- 172.21.15.175:0/1450352329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f371015b910 0x7f3710070980 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f370801a910 tx=0x7f370801aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:52.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f370d600640 1 -- 172.21.15.175:0/1450352329 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37080b0040 con 0x7f371015b910 2024-04-25T09:04:52.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f370d600640 1 -- 172.21.15.175:0/1450352329 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37080bc070 con 0x7f371015b910 2024-04-25T09:04:52.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f370d600640 1 -- 172.21.15.175:0/1450352329 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37080b6860 con 0x7f371015b910 2024-04-25T09:04:52.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3717000640 1 -- 172.21.15.175:0/1450352329 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371006c540 con 0x7f371015b910 2024-04-25T09:04:52.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3717000640 1 -- 172.21.15.175:0/1450352329 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371006cb00 con 0x7f371015b910 2024-04-25T09:04:52.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f3717000640 1 -- 172.21.15.175:0/1450352329 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3710074a60 con 0x7f371015b910 2024-04-25T09:04:52.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.798+0000 7f370d600640 1 -- 172.21.15.175:0/1450352329 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f37080b6a00 con 0x7f371015b910 2024-04-25T09:04:52.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.802+0000 7f370d600640 1 --2- 172.21.15.175:0/1450352329 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f36f0066f60 0x7f36f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:52.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.802+0000 7f370d600640 1 -- 172.21.15.175:0/1450352329 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f370811f5f0 con 0x7f371015b910 2024-04-25T09:04:52.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.802+0000 7f3715c00640 1 --2- 172.21.15.175:0/1450352329 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f36f0066f60 0x7f36f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:52.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.802+0000 7f3715c00640 1 --2- 172.21.15.175:0/1450352329 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f36f0066f60 0x7f36f0069420 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3704009fa0 tx=0x7f3704009570 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:52.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.806+0000 7f370d600640 1 -- 172.21.15.175:0/1450352329 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3708016110 con 0x7f371015b910 2024-04-25T09:04:52.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:52.958+0000 7f3717000640 1 -- 172.21.15.175:0/1450352329 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f37101525a0 con 0x7f371015b910 2024-04-25T09:04:53.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.766+0000 7f370d600640 1 -- 172.21.15.175:0/1450352329 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f37080f0490 con 0x7f371015b910 2024-04-25T09:04:53.758 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:04:53.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.770+0000 7f3717000640 1 -- 172.21.15.175:0/1450352329 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f36f0066f60 msgr2=0x7f36f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.770+0000 7f3717000640 1 --2- 172.21.15.175:0/1450352329 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f36f0066f60 0x7f36f0069420 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3704009fa0 tx=0x7f3704009570 comp rx=0 tx=0).stop 2024-04-25T09:04:53.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.770+0000 7f3717000640 1 -- 172.21.15.175:0/1450352329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f371015b910 msgr2=0x7f3710070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.770+0000 7f3717000640 1 --2- 172.21.15.175:0/1450352329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f371015b910 0x7f3710070980 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f370801a910 tx=0x7f370801aaa0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.770+0000 7f3717000640 1 -- 172.21.15.175:0/1450352329 shutdown_connections 2024-04-25T09:04:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.770+0000 7f3717000640 1 --2- 172.21.15.175:0/1450352329 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f36f0066f60 0x7f36f0069420 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.770+0000 7f3717000640 1 --2- 172.21.15.175:0/1450352329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f371015b910 0x7f3710070980 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.770+0000 7f3717000640 1 --2- 172.21.15.175:0/1450352329 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37100d0030 0x7f3710070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.770+0000 7f3717000640 1 --2- 172.21.15.175:0/1450352329 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37100b2a20 0x7f3710165a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.770+0000 7f3717000640 1 -- 172.21.15.175:0/1450352329 >> 172.21.15.175:0/1450352329 conn(0x7f37100d1730 msgr2=0x7f3710152ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:53.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.770+0000 7f3717000640 1 -- 172.21.15.175:0/1450352329 shutdown_connections 2024-04-25T09:04:53.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.770+0000 7f3717000640 1 -- 172.21.15.175:0/1450352329 wait complete. 2024-04-25T09:04:53.788 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:04:53.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.946+0000 7f376e800640 1 Processor -- start 2024-04-25T09:04:53.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.946+0000 7f376e800640 1 -- start start 2024-04-25T09:04:53.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.950+0000 7f376e800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f37680b2700 0x7f37680b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.950+0000 7f376e800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f37680b47a0 0x7f376815c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.950+0000 7f376e800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376815b880 con 0x7f37680aebd0 2024-04-25T09:04:53.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.950+0000 7f376e800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37680b4c10 con 0x7f37680b2700 2024-04-25T09:04:53.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.950+0000 7f376e800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376815bb60 con 0x7f37680b47a0 2024-04-25T09:04:53.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.950+0000 7f3766a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f37680b2700 0x7f37680b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.950+0000 7f3766a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f37680b2700 0x7f37680b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50306/0 (socket says 172.21.15.175:50306) 2024-04-25T09:04:53.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.950+0000 7f3766a00640 1 -- 172.21.15.175:0/812498616 learned_addr learned my addr 172.21.15.175:0/812498616 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:53.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.950+0000 7f3767e00640 1 --2- 172.21.15.175:0/812498616 >> v2:172.21.15.177:3300/0 conn(0x7f37680b47a0 0x7f376815c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.950+0000 7f3766a00640 1 -- 172.21.15.175:0/812498616 >> v2:172.21.15.177:3300/0 conn(0x7f37680b47a0 msgr2=0x7f376815c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:53.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.950+0000 7f3766a00640 1 --2- 172.21.15.175:0/812498616 >> v2:172.21.15.177:3300/0 conn(0x7f37680b47a0 0x7f376815c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.950+0000 7f3766a00640 1 -- 172.21.15.175:0/812498616 >> v1:172.21.15.177:6789/0 conn(0x7f37680aebd0 legacy=0x7f376815b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.950+0000 7f3766a00640 1 -- 172.21.15.175:0/812498616 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376815be40 con 0x7f37680b2700 2024-04-25T09:04:53.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.954+0000 7f3766a00640 1 --2- 172.21.15.175:0/812498616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37680b2700 0x7f37680b4260 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f37680b2be0 tx=0x7f375401ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171529990067aa8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:53.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.954+0000 7f3766000640 1 -- 172.21.15.175:0/812498616 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540b4070 con 0x7f37680b2700 2024-04-25T09:04:53.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.954+0000 7f3766000640 1 -- 172.21.15.175:0/812498616 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37680af1c0 con 0x7f37680b2700 2024-04-25T09:04:53.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.954+0000 7f3766000640 1 -- 172.21.15.175:0/812498616 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540a7df0 con 0x7f37680b2700 2024-04-25T09:04:53.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.954+0000 7f376e800640 1 -- 172.21.15.175:0/812498616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37680b2700 msgr2=0x7f37680b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.954+0000 7f376e800640 1 --2- 172.21.15.175:0/812498616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37680b2700 0x7f37680b4260 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f37680b2be0 tx=0x7f375401ebf0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.954+0000 7f376e800640 1 -- 172.21.15.175:0/812498616 shutdown_connections 2024-04-25T09:04:53.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.954+0000 7f376e800640 1 --2- 172.21.15.175:0/812498616 >> v2:172.21.15.177:3300/0 conn(0x7f37680b47a0 0x7f376815c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.954+0000 7f376e800640 1 --2- 172.21.15.175:0/812498616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37680b2700 0x7f37680b4260 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.954+0000 7f376e800640 1 -- 172.21.15.175:0/812498616 >> 172.21.15.175:0/812498616 conn(0x7f376806ac50 msgr2=0x7f376806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:53.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.954+0000 7f376e800640 1 -- 172.21.15.175:0/812498616 shutdown_connections 2024-04-25T09:04:53.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.954+0000 7f376e800640 1 -- 172.21.15.175:0/812498616 wait complete. 2024-04-25T09:04:53.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.954+0000 7f376e800640 1 Processor -- start 2024-04-25T09:04:53.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.954+0000 7f376e800640 1 -- start start 2024-04-25T09:04:53.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.954+0000 7f376e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37680aebd0 0x7f37680cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.954+0000 7f376e800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37680b2700 0x7f37681551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f376e800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37680b47a0 0x7f3768143dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f376e800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376815da00 con 0x7f37680aebd0 2024-04-25T09:04:53.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f376e800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376815d880 con 0x7f37680b2700 2024-04-25T09:04:53.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f376e800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376815db80 con 0x7f37680b47a0 2024-04-25T09:04:53.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f3767400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37680aebd0 0x7f37680cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f3767400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37680aebd0 0x7f37680cda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50308/0 (socket says 172.21.15.175:50308) 2024-04-25T09:04:53.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f3767400640 1 -- 172.21.15.175:0/1264416026 learned_addr learned my addr 172.21.15.175:0/1264416026 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:53.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f3766a00640 1 --2- 172.21.15.175:0/1264416026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37680b2700 0x7f37681551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f3767e00640 1 --2- 172.21.15.175:0/1264416026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37680b47a0 0x7f3768143dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f3767400640 1 -- 172.21.15.175:0/1264416026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37680b47a0 msgr2=0x7f3768143dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f3767400640 1 --2- 172.21.15.175:0/1264416026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37680b47a0 0x7f3768143dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f3767400640 1 -- 172.21.15.175:0/1264416026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37680b2700 msgr2=0x7f37681551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:53.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f3767400640 1 --2- 172.21.15.175:0/1264416026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37680b2700 0x7f37681551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:53.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f3767400640 1 -- 172.21.15.175:0/1264416026 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37680b0810 con 0x7f37680aebd0 2024-04-25T09:04:53.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f3767400640 1 --2- 172.21.15.175:0/1264416026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37680aebd0 0x7f37680cda90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f375800c370 tx=0x7f375800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:53.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f375f400640 1 -- 172.21.15.175:0/1264416026 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37580052d0 con 0x7f37680aebd0 2024-04-25T09:04:53.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f375f400640 1 -- 172.21.15.175:0/1264416026 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3758005470 con 0x7f37680aebd0 2024-04-25T09:04:53.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f375f400640 1 -- 172.21.15.175:0/1264416026 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758007260 con 0x7f37680aebd0 2024-04-25T09:04:53.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f376e800640 1 -- 172.21.15.175:0/1264416026 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37680b0af0 con 0x7f37680aebd0 2024-04-25T09:04:53.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f376e800640 1 -- 172.21.15.175:0/1264416026 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37680b10b0 con 0x7f37680aebd0 2024-04-25T09:04:53.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f376e800640 1 -- 172.21.15.175:0/1264416026 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3768075160 con 0x7f37680aebd0 2024-04-25T09:04:53.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.958+0000 7f375f400640 1 -- 172.21.15.175:0/1264416026 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3758007400 con 0x7f37680aebd0 2024-04-25T09:04:53.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.962+0000 7f375f400640 1 --2- 172.21.15.175:0/1264416026 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3748066f60 0x7f3748069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:53.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.962+0000 7f375f400640 1 -- 172.21.15.175:0/1264416026 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f3758084310 con 0x7f37680aebd0 2024-04-25T09:04:53.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.962+0000 7f3766a00640 1 --2- 172.21.15.175:0/1264416026 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3748066f60 0x7f3748069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:53.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.962+0000 7f3766a00640 1 --2- 172.21.15.175:0/1264416026 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3748066f60 0x7f3748069420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f37540b1000 tx=0x7f3754008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:53.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:53.966+0000 7f375f400640 1 -- 172.21.15.175:0/1264416026 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3758054da0 con 0x7f37680aebd0 2024-04-25T09:04:54.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:54.122+0000 7f376e800640 1 -- 172.21.15.175:0/1264416026 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f376815a570 con 0x7f37680aebd0 2024-04-25T09:04:54.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:54.770+0000 7f375f400640 1 -- 172.21.15.175:0/1264416026 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3758058e40 con 0x7f37680aebd0 2024-04-25T09:04:54.764 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_data' removed 2024-04-25T09:04:54.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:54.774+0000 7f376e800640 1 -- 172.21.15.175:0/1264416026 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3748066f60 msgr2=0x7f3748069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:54.774+0000 7f376e800640 1 --2- 172.21.15.175:0/1264416026 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3748066f60 0x7f3748069420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f37540b1000 tx=0x7f3754008040 comp rx=0 tx=0).stop 2024-04-25T09:04:54.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:54.774+0000 7f376e800640 1 -- 172.21.15.175:0/1264416026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37680aebd0 msgr2=0x7f37680cda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:54.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:54.774+0000 7f376e800640 1 --2- 172.21.15.175:0/1264416026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37680aebd0 0x7f37680cda90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f375800c370 tx=0x7f375800c830 comp rx=0 tx=0).stop 2024-04-25T09:04:54.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:54.774+0000 7f376e800640 1 -- 172.21.15.175:0/1264416026 shutdown_connections 2024-04-25T09:04:54.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:54.774+0000 7f376e800640 1 --2- 172.21.15.175:0/1264416026 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3748066f60 0x7f3748069420 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:54.774+0000 7f376e800640 1 --2- 172.21.15.175:0/1264416026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37680b47a0 0x7f3768143dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:54.774+0000 7f376e800640 1 --2- 172.21.15.175:0/1264416026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37680b2700 0x7f37681551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:54.774+0000 7f376e800640 1 --2- 172.21.15.175:0/1264416026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37680aebd0 0x7f37680cda90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:54.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:54.774+0000 7f376e800640 1 -- 172.21.15.175:0/1264416026 >> 172.21.15.175:0/1264416026 conn(0x7f376806ac50 msgr2=0x7f376806db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:54.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:54.774+0000 7f376e800640 1 -- 172.21.15.175:0/1264416026 shutdown_connections 2024-04-25T09:04:54.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:54.774+0000 7f376e800640 1 -- 172.21.15.175:0/1264416026 wait complete. 2024-04-25T09:04:54.793 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:04:54.793 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:04:54.793 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:04:54.794 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:54.794 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:04:54.794 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:04:54.794 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:04:54.794 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:54.794 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:04:54.795 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:04:54.795 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:04:54.795 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:54.795 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:04:54.795 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:04:54.795 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:04:54.795 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:54.810 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:04:54.810 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:04:54.811 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:04:54.811 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:04:54.812 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:04:54.812 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:04:54.813 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:04:54.813 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:04:54.855 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:04:54.855 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:54.856 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:04:54.856 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:54.857 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:04:54.857 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:54.857 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:04:54.857 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:54.858 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:04:54.943 INFO:tasks.ceph.mds.c.smithi175.stdout:starting mds.c at 2024-04-25T09:04:54.944 INFO:tasks.ceph.mds.a.smithi175.stdout:starting mds.a at 2024-04-25T09:04:54.945 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-04-25T09:04:54.945 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-04-25T09:04:55.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.010+0000 7f192b600640 1 Processor -- start 2024-04-25T09:04:55.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.010+0000 7f192b600640 1 -- start start 2024-04-25T09:04:55.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.014+0000 7f192b600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f19241454f0 0x7f19240cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:55.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.014+0000 7f192b600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f19240d1470 0x7f19240b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:55.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.014+0000 7f192b600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19240b4430 con 0x7f19240cf490 2024-04-25T09:04:55.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.014+0000 7f192b600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19240b4940 con 0x7f19240d1470 2024-04-25T09:04:55.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.014+0000 7f192b600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19240cf8f0 con 0x7f19241454f0 2024-04-25T09:04:55.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.014+0000 7f1929600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f19240d1470 0x7f19240b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:55.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.014+0000 7f1929600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f19240d1470 0x7f19240b4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50332/0 (socket says 172.21.15.175:50332) 2024-04-25T09:04:55.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.014+0000 7f1929600640 1 -- 172.21.15.175:0/646023262 learned_addr learned my addr 172.21.15.175:0/646023262 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:55.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.014+0000 7f1928c00640 1 --2- 172.21.15.175:0/646023262 >> v2:172.21.15.177:3300/0 conn(0x7f19241454f0 0x7f19240cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:55.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.014+0000 7f1929600640 1 -- 172.21.15.175:0/646023262 >> v2:172.21.15.177:3300/0 conn(0x7f19241454f0 msgr2=0x7f19240cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:55.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.014+0000 7f1929600640 1 --2- 172.21.15.175:0/646023262 >> v2:172.21.15.177:3300/0 conn(0x7f19241454f0 0x7f19240cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:55.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.014+0000 7f1929600640 1 -- 172.21.15.175:0/646023262 >> v1:172.21.15.177:6789/0 conn(0x7f19240cf490 legacy=0x7f19240d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:55.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.014+0000 7f1929600640 1 -- 172.21.15.175:0/646023262 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924070eb0 con 0x7f19240d1470 2024-04-25T09:04:55.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f1929600640 1 --2- 172.21.15.175:0/646023262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19240d1470 0x7f19240b4dd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1924070b50 tx=0x7f191c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9970429cd093a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:55.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f1923e00640 1 -- 172.21.15.175:0/646023262 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c0a5880 con 0x7f19240d1470 2024-04-25T09:04:55.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f1923e00640 1 -- 172.21.15.175:0/646023262 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c0a5a20 con 0x7f19240d1470 2024-04-25T09:04:55.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f1923e00640 1 -- 172.21.15.175:0/646023262 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c0a5df0 con 0x7f19240d1470 2024-04-25T09:04:55.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f192b600640 1 -- 172.21.15.175:0/646023262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19240d1470 msgr2=0x7f19240b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:55.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f192b600640 1 --2- 172.21.15.175:0/646023262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19240d1470 0x7f19240b4dd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1924070b50 tx=0x7f191c01c9c0 comp rx=0 tx=0).stop 2024-04-25T09:04:55.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f192b600640 1 -- 172.21.15.175:0/646023262 shutdown_connections 2024-04-25T09:04:55.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f192b600640 1 --2- 172.21.15.175:0/646023262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19240d1470 0x7f19240b4dd0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:55.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f192b600640 1 --2- 172.21.15.175:0/646023262 >> v2:172.21.15.177:3300/0 conn(0x7f19241454f0 0x7f19240cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:55.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f192b600640 1 -- 172.21.15.175:0/646023262 >> 172.21.15.175:0/646023262 conn(0x7f19240b3510 msgr2=0x7f19240b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:55.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f192b600640 1 -- 172.21.15.175:0/646023262 shutdown_connections 2024-04-25T09:04:55.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f192b600640 1 -- 172.21.15.175:0/646023262 wait complete. 2024-04-25T09:04:55.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f192b600640 1 Processor -- start 2024-04-25T09:04:55.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f192b600640 1 -- start start 2024-04-25T09:04:55.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f192b600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19240cf490 0x7f1924143490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f192b600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19240d1470 0x7f192415e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f192b600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19241454f0 0x7f192415fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f192b600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19240b5b20 con 0x7f19240d1470 2024-04-25T09:04:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f192b600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19241458d0 con 0x7f19240cf490 2024-04-25T09:04:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.018+0000 7f192b600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19240b5ca0 con 0x7f19241454f0 2024-04-25T09:04:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f191be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19240d1470 0x7f192415e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f1928c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19240cf490 0x7f1924143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f191be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19240d1470 0x7f192415e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50338/0 (socket says 172.21.15.175:50338) 2024-04-25T09:04:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f191be00640 1 -- 172.21.15.175:0/3875849067 learned_addr learned my addr 172.21.15.175:0/3875849067 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f1929600640 1 --2- 172.21.15.175:0/3875849067 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19241454f0 0x7f192415fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f1928c00640 1 -- 172.21.15.175:0/3875849067 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19241454f0 msgr2=0x7f192415fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f1928c00640 1 --2- 172.21.15.175:0/3875849067 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19241454f0 0x7f192415fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:55.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f1928c00640 1 -- 172.21.15.175:0/3875849067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19240d1470 msgr2=0x7f192415e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:55.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f1928c00640 1 --2- 172.21.15.175:0/3875849067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19240d1470 0x7f192415e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:55.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f1928c00640 1 -- 172.21.15.175:0/3875849067 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192415ebf0 con 0x7f19240cf490 2024-04-25T09:04:55.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f191be00640 1 --2- 172.21.15.175:0/3875849067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19240d1470 0x7f192415e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:55.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f1928c00640 1 --2- 172.21.15.175:0/3875849067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19240cf490 0x7f1924143490 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f191400e870 tx=0x7f191400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:55.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f1921600640 1 -- 172.21.15.175:0/3875849067 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1914017070 con 0x7f19240cf490 2024-04-25T09:04:55.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f192b600640 1 -- 172.21.15.175:0/3875849067 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192415eed0 con 0x7f19240cf490 2024-04-25T09:04:55.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f1921600640 1 -- 172.21.15.175:0/3875849067 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191400ee60 con 0x7f19240cf490 2024-04-25T09:04:55.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f1921600640 1 -- 172.21.15.175:0/3875849067 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191400cb60 con 0x7f19240cf490 2024-04-25T09:04:55.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f192b600640 1 -- 172.21.15.175:0/3875849067 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192415f770 con 0x7f19240cf490 2024-04-25T09:04:55.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f192b600640 1 -- 172.21.15.175:0/3875849067 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1924075160 con 0x7f19240cf490 2024-04-25T09:04:55.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.022+0000 7f1921600640 1 -- 172.21.15.175:0/3875849067 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f191401a070 con 0x7f19240cf490 2024-04-25T09:04:55.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.026+0000 7f1921600640 1 --2- 172.21.15.175:0/3875849067 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1900066f60 0x7f1900069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:55.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.026+0000 7f1921600640 1 -- 172.21.15.175:0/3875849067 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1914084f90 con 0x7f19240cf490 2024-04-25T09:04:55.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.026+0000 7f191be00640 1 --2- 172.21.15.175:0/3875849067 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1900066f60 0x7f1900069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:55.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.026+0000 7f191be00640 1 --2- 172.21.15.175:0/3875849067 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1900066f60 0x7f1900069420 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f190c001c20 tx=0x7f190c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:55.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.030+0000 7f1921600640 1 -- 172.21.15.175:0/3875849067 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1914055b30 con 0x7f19240cf490 2024-04-25T09:04:55.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.194+0000 7f192b600640 1 -- 172.21.15.175:0/3875849067 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1924165700 con 0x7f19240cf490 2024-04-25T09:04:55.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.790+0000 7f1921600640 1 -- 172.21.15.175:0/3875849067 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1914059bd0 con 0x7f19240cf490 2024-04-25T09:04:55.782 INFO:teuthology.orchestra.run.smithi175.stderr: removed all blocklist entries 2024-04-25T09:04:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.790+0000 7f192b600640 1 -- 172.21.15.175:0/3875849067 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1900066f60 msgr2=0x7f1900069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.790+0000 7f192b600640 1 --2- 172.21.15.175:0/3875849067 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1900066f60 0x7f1900069420 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f190c001c20 tx=0x7f190c009040 comp rx=0 tx=0).stop 2024-04-25T09:04:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.790+0000 7f192b600640 1 -- 172.21.15.175:0/3875849067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19240cf490 msgr2=0x7f1924143490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.790+0000 7f192b600640 1 --2- 172.21.15.175:0/3875849067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19240cf490 0x7f1924143490 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f191400e870 tx=0x7f191400ed30 comp rx=0 tx=0).stop 2024-04-25T09:04:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.790+0000 7f192b600640 1 -- 172.21.15.175:0/3875849067 shutdown_connections 2024-04-25T09:04:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.790+0000 7f192b600640 1 --2- 172.21.15.175:0/3875849067 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1900066f60 0x7f1900069420 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.790+0000 7f192b600640 1 --2- 172.21.15.175:0/3875849067 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19241454f0 0x7f192415fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.790+0000 7f192b600640 1 --2- 172.21.15.175:0/3875849067 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19240d1470 0x7f192415e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.790+0000 7f192b600640 1 --2- 172.21.15.175:0/3875849067 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19240cf490 0x7f1924143490 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.790+0000 7f192b600640 1 -- 172.21.15.175:0/3875849067 >> 172.21.15.175:0/3875849067 conn(0x7f19240b3510 msgr2=0x7f19240b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.790+0000 7f192b600640 1 -- 172.21.15.175:0/3875849067 shutdown_connections 2024-04-25T09:04:55.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.790+0000 7f192b600640 1 -- 172.21.15.175:0/3875849067 wait complete. 2024-04-25T09:04:55.811 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:04:55.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.958+0000 7f3ae7800640 1 Processor -- start 2024-04-25T09:04:55.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.958+0000 7f3ae7800640 1 -- start start 2024-04-25T09:04:55.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.958+0000 7f3ae7800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3ae015db00 0x7f3ae006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:55.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.958+0000 7f3ae7800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae006f280 con 0x7f3ae0161e30 2024-04-25T09:04:55.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.958+0000 7f3ae7800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae006acf0 con 0x7f3ae00acd90 2024-04-25T09:04:55.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.958+0000 7f3ae7800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae006afd0 con 0x7f3ae015db00 2024-04-25T09:04:55.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.958+0000 7f3ae5800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f3ae0161e30 0x7f3ae006b7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:37788/0 (socket says 172.21.15.175:37788) 2024-04-25T09:04:55.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.958+0000 7f3ae5800640 1 -- 172.21.15.175:0/1815040070 learned_addr learned my addr 172.21.15.175:0/1815040070 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:55.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.958+0000 7f3ae4e00640 1 --2- 172.21.15.175:0/1815040070 >> v2:172.21.15.177:3300/0 conn(0x7f3ae015db00 0x7f3ae006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:55.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.958+0000 7f3adf400640 1 -- 172.21.15.175:0/1815040070 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189239073 0 0) 0x7f3ae006f280 con 0x7f3ae0161e30 2024-04-25T09:04:55.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.958+0000 7f3adf400640 1 -- 172.21.15.175:0/1815040070 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ac8003530 con 0x7f3ae0161e30 2024-04-25T09:04:55.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.958+0000 7f3adf400640 1 -- 172.21.15.175:0/1815040070 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 297433852 0 0) 0x7f3ac8003530 con 0x7f3ae0161e30 2024-04-25T09:04:55.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.958+0000 7f3ae4e00640 1 -- 172.21.15.175:0/1815040070 >> v1:172.21.15.177:6789/0 conn(0x7f3ae00acd90 legacy=0x7f3ae0161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:55.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.958+0000 7f3ae4e00640 1 -- 172.21.15.175:0/1815040070 >> v1:172.21.15.175:6789/0 conn(0x7f3ae0161e30 legacy=0x7f3ae006b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:55.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.958+0000 7f3ae4e00640 1 -- 172.21.15.175:0/1815040070 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae006b2b0 con 0x7f3ae015db00 2024-04-25T09:04:55.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.962+0000 7f3ae4e00640 1 --2- 172.21.15.175:0/1815040070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ae015db00 0x7f3ae006e9a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3ad40097f0 tx=0x7f3ad401c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd6c1210ce7f5f87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:55.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.962+0000 7f3adf400640 1 -- 172.21.15.175:0/1815040070 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad40b0070 con 0x7f3ae015db00 2024-04-25T09:04:55.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.962+0000 7f3adf400640 1 -- 172.21.15.175:0/1815040070 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad40ab400 con 0x7f3ae015db00 2024-04-25T09:04:55.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.962+0000 7f3adf400640 1 -- 172.21.15.175:0/1815040070 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8001a00 con 0x7f3ae015db00 2024-04-25T09:04:55.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.962+0000 7f3ae7800640 1 -- 172.21.15.175:0/1815040070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ae015db00 msgr2=0x7f3ae006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:55.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.962+0000 7f3ae7800640 1 --2- 172.21.15.175:0/1815040070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ae015db00 0x7f3ae006e9a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3ad40097f0 tx=0x7f3ad401c360 comp rx=0 tx=0).stop 2024-04-25T09:04:55.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.962+0000 7f3ae7800640 1 -- 172.21.15.175:0/1815040070 shutdown_connections 2024-04-25T09:04:55.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.962+0000 7f3ae7800640 1 --2- 172.21.15.175:0/1815040070 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ae015db00 0x7f3ae006e9a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:55.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.962+0000 7f3ae7800640 1 -- 172.21.15.175:0/1815040070 >> 172.21.15.175:0/1815040070 conn(0x7f3ae00b2200 msgr2=0x7f3ae00cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:55.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.962+0000 7f3ae7800640 1 -- 172.21.15.175:0/1815040070 shutdown_connections 2024-04-25T09:04:55.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.962+0000 7f3ae7800640 1 -- 172.21.15.175:0/1815040070 wait complete. 2024-04-25T09:04:55.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae7800640 1 Processor -- start 2024-04-25T09:04:55.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae7800640 1 -- start start 2024-04-25T09:04:55.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae7800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ae00acd90 0x7f3ae00ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:55.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae7800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ae015db00 0x7f3ae014c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:55.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae7800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ae0161e30 0x7f3ae00b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:55.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae7800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae016bc50 con 0x7f3ae0161e30 2024-04-25T09:04:55.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae7800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae016bad0 con 0x7f3ae015db00 2024-04-25T09:04:55.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae7800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae016bdd0 con 0x7f3ae00acd90 2024-04-25T09:04:55.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae5800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ae0161e30 0x7f3ae00b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:55.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae5800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ae0161e30 0x7f3ae00b2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50346/0 (socket says 172.21.15.175:50346) 2024-04-25T09:04:55.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae5800640 1 -- 172.21.15.175:0/2959307668 learned_addr learned my addr 172.21.15.175:0/2959307668 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:55.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3adfe00640 1 --2- 172.21.15.175:0/2959307668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ae015db00 0x7f3ae014c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:55.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae4e00640 1 --2- 172.21.15.175:0/2959307668 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ae00acd90 0x7f3ae00ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:55.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae5800640 1 -- 172.21.15.175:0/2959307668 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ae00acd90 msgr2=0x7f3ae00ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:55.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae5800640 1 --2- 172.21.15.175:0/2959307668 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ae00acd90 0x7f3ae00ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:55.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae5800640 1 -- 172.21.15.175:0/2959307668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ae015db00 msgr2=0x7f3ae014c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:55.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae5800640 1 --2- 172.21.15.175:0/2959307668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ae015db00 0x7f3ae014c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:55.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae5800640 1 -- 172.21.15.175:0/2959307668 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae00ad950 con 0x7f3ae0161e30 2024-04-25T09:04:55.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae5800640 1 --2- 172.21.15.175:0/2959307668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ae0161e30 0x7f3ae00b2f60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800cc90 tx=0x7f3ad800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:55.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3adcc00640 1 -- 172.21.15.175:0/2959307668 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad800ce40 con 0x7f3ae0161e30 2024-04-25T09:04:55.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3adcc00640 1 -- 172.21.15.175:0/2959307668 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad8012400 con 0x7f3ae0161e30 2024-04-25T09:04:55.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae7800640 1 -- 172.21.15.175:0/2959307668 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae00cca80 con 0x7f3ae0161e30 2024-04-25T09:04:55.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3adcc00640 1 -- 172.21.15.175:0/2959307668 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad80127f0 con 0x7f3ae0161e30 2024-04-25T09:04:55.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae7800640 1 -- 172.21.15.175:0/2959307668 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae00cd040 con 0x7f3ae0161e30 2024-04-25T09:04:55.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.966+0000 7f3ae7800640 1 -- 172.21.15.175:0/2959307668 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae0074a60 con 0x7f3ae0161e30 2024-04-25T09:04:55.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.970+0000 7f3adcc00640 1 -- 172.21.15.175:0/2959307668 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3ad8012990 con 0x7f3ae0161e30 2024-04-25T09:04:55.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.970+0000 7f3adcc00640 1 --2- 172.21.15.175:0/2959307668 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ac0066f60 0x7f3ac0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:55.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.970+0000 7f3adcc00640 1 -- 172.21.15.175:0/2959307668 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3ad80853e0 con 0x7f3ae0161e30 2024-04-25T09:04:55.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.970+0000 7f3ae4e00640 1 --2- 172.21.15.175:0/2959307668 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ac0066f60 0x7f3ac0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:55.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.970+0000 7f3ae4e00640 1 --2- 172.21.15.175:0/2959307668 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ac0066f60 0x7f3ac0069420 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3ad40ad000 tx=0x7f3ad40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:55.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:55.974+0000 7f3adcc00640 1 -- 172.21.15.175:0/2959307668 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3ad80560e0 con 0x7f3ae0161e30 2024-04-25T09:04:56.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.182+0000 7f3ae7800640 1 -- 172.21.15.175:0/2959307668 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3ae015ee00 con 0x7f3ae0161e30 2024-04-25T09:04:56.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.182+0000 7f3adcc00640 1 -- 172.21.15.175:0/2959307668 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f3ad805a180 con 0x7f3ae0161e30 2024-04-25T09:04:56.177 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:56.177 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:04:56.177 INFO:teuthology.orchestra.run.smithi175.stdout: "auth_dump": [ 2024-04-25T09:04:56.177 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.177 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.a", 2024-04-25T09:04:56.177 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpm3usiKxAAROh+31LaNyuh2SdeW6pKjQ==", 2024-04-25T09:04:56.177 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.177 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:04:56.177 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:04:56.177 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:04:56.178 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:04:56.178 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.178 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.178 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.178 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.b", 2024-04-25T09:04:56.178 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmYJoRNxAAZfRvDn1aoR0wa2mEKBrr+A==", 2024-04-25T09:04:56.178 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.178 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:04:56.178 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:04:56.178 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:04:56.178 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:04:56.178 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.179 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.c", 2024-04-25T09:04:56.179 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmk8M3MhAA6aIN33aWvVcvVEFtHL8SWA==", 2024-04-25T09:04:56.179 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.179 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:04:56.179 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:04:56.179 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:04:56.179 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:04:56.179 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.179 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.179 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.179 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.d", 2024-04-25T09:04:56.179 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmLAHLAhAA+mWUfpb6izHixJa073r9Jw==", 2024-04-25T09:04:56.179 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.180 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:04:56.180 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:04:56.180 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:04:56.180 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:04:56.180 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.180 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.180 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.180 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.0", 2024-04-25T09:04:56.180 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBSHCpm2xftAxAAxs9n8AE2H3HpPHEUZA4Cng==", 2024-04-25T09:04:56.180 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.180 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:56.180 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:04:56.180 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:04:56.180 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.181 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.1", 2024-04-25T09:04:56.181 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBVHCpm/OOlDRAAA7zaD8qsqS2TOCKhDFheJw==", 2024-04-25T09:04:56.181 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.181 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:56.181 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:04:56.181 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:04:56.181 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.181 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.181 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.181 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.2", 2024-04-25T09:04:56.181 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBYHCpmy/kmFxAAwCADFI/jMe27gAmyuAJZHQ==", 2024-04-25T09:04:56.181 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.181 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:56.182 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:04:56.182 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:04:56.182 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.182 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.182 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.182 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.3", 2024-04-25T09:04:56.182 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBbHCpm89a7HhAAVTueOuS0/Ksf8SdWK+Nm1g==", 2024-04-25T09:04:56.182 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.182 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:56.182 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:04:56.182 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:04:56.182 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.183 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.4", 2024-04-25T09:04:56.183 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBhHCpm5EAtFRAAeADhjja0BOIvxY3RB+n6+A==", 2024-04-25T09:04:56.183 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.183 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:56.183 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:04:56.183 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:04:56.183 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.183 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.183 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.183 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.5", 2024-04-25T09:04:56.183 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBkHCpmrLilHRAA+H8Bejnk49YfaUvl3Nrrhw==", 2024-04-25T09:04:56.184 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.184 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:56.184 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:04:56.184 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:04:56.184 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.184 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.184 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.184 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.6", 2024-04-25T09:04:56.184 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBnHCpm6uDxJRAAX5EwEelnZXwEHnNnv+XQ6A==", 2024-04-25T09:04:56.184 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.184 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:56.184 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:04:56.184 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:04:56.184 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.185 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.7", 2024-04-25T09:04:56.185 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBqHCpmwow5MBAA7b/Q9DiPO6Bfldq1+rf+/w==", 2024-04-25T09:04:56.185 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.185 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:56.185 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:04:56.185 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:04:56.185 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.185 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.185 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.185 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.0", 2024-04-25T09:04:56.185 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmhyCUBhAA8k9xLKIw8R04i6HSJykDfw==", 2024-04-25T09:04:56.185 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.185 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:04:56.186 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:04:56.186 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:04:56.186 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:04:56.186 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.186 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.186 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.186 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.1", 2024-04-25T09:04:56.186 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmQigrEBAAoWfP1ZEosbLELev5z+C9/g==", 2024-04-25T09:04:56.186 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.186 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:04:56.186 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:04:56.186 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:04:56.186 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:04:56.187 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.187 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.2", 2024-04-25T09:04:56.187 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpm0xaSDBAAup34GS3pnMwjksVuuUGOkw==", 2024-04-25T09:04:56.187 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.187 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:04:56.187 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:04:56.187 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:04:56.187 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:04:56.187 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.187 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.187 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.187 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.3", 2024-04-25T09:04:56.187 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpm6+doFhAAA18OgwfM8gXgQ6g0KUo7Hw==", 2024-04-25T09:04:56.188 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.188 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:04:56.188 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:04:56.188 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:04:56.188 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:04:56.188 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.188 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.188 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.188 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.admin", 2024-04-25T09:04:56.188 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmRZAYDRAA9sepw/fI2OhoZXER6Rmd+g==", 2024-04-25T09:04:56.188 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.188 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:04:56.188 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:04:56.188 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:04:56.189 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:04:56.189 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.189 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.bootstrap-mds", 2024-04-25T09:04:56.189 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBwHCpmtlZKMhAAB5DBoisxp8vGxvkUrTb4tg==", 2024-04-25T09:04:56.189 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.189 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile bootstrap-mds" 2024-04-25T09:04:56.189 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.189 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.189 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.189 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.bootstrap-mgr", 2024-04-25T09:04:56.189 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBwHCpmXWFKMhAAEEjPlDXJSl5NWTk7F+kT/w==", 2024-04-25T09:04:56.189 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.189 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-25T09:04:56.190 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.190 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.bootstrap-osd", 2024-04-25T09:04:56.190 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBwHCpmPWpKMhAAKWi0VHXAjcLzwwczqMuvJg==", 2024-04-25T09:04:56.190 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.190 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile bootstrap-osd" 2024-04-25T09:04:56.190 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.190 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.190 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.190 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.bootstrap-rbd", 2024-04-25T09:04:56.190 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBwHCpm/nJKMhAAIgvvhYzpEX/II1tS5qfdtg==", 2024-04-25T09:04:56.190 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.191 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-25T09:04:56.191 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.191 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-25T09:04:56.191 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBwHCpmGHxKMhAAT8w0zDbZFdZQEJJR9GqSuQ==", 2024-04-25T09:04:56.191 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.191 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-25T09:04:56.191 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.191 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.191 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.191 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.bootstrap-rgw", 2024-04-25T09:04:56.191 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBwHCpmJYVKMhAAyv+3eNKO15+JExf1WixR0A==", 2024-04-25T09:04:56.191 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.191 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-25T09:04:56.192 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.192 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mgr.x", 2024-04-25T09:04:56.192 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpm5q4gJxAA9zPRlimxM0+Rb5RQkcoxzQ==", 2024-04-25T09:04:56.192 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.192 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:04:56.192 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile mgr", 2024-04-25T09:04:56.192 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:04:56.192 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.192 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:04:56.192 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:56.193 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mgr.y", 2024-04-25T09:04:56.193 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmMLIqIxAAiMo8+3lU0fXNoI6kBrro+Q==", 2024-04-25T09:04:56.193 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:04:56.193 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:04:56.193 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile mgr", 2024-04-25T09:04:56.193 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:04:56.193 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.193 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:56.193 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-25T09:04:56.193 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:04:56.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.186+0000 7f3ae7800640 1 -- 172.21.15.175:0/2959307668 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ac0066f60 msgr2=0x7f3ac0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.186+0000 7f3ae7800640 1 --2- 172.21.15.175:0/2959307668 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ac0066f60 0x7f3ac0069420 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3ad40ad000 tx=0x7f3ad40a6000 comp rx=0 tx=0).stop 2024-04-25T09:04:56.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.186+0000 7f3ae7800640 1 -- 172.21.15.175:0/2959307668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ae0161e30 msgr2=0x7f3ae00b2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.186+0000 7f3ae7800640 1 --2- 172.21.15.175:0/2959307668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ae0161e30 0x7f3ae00b2f60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800cc90 tx=0x7f3ad800a430 comp rx=0 tx=0).stop 2024-04-25T09:04:56.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.186+0000 7f3ae7800640 1 -- 172.21.15.175:0/2959307668 shutdown_connections 2024-04-25T09:04:56.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.186+0000 7f3ae7800640 1 --2- 172.21.15.175:0/2959307668 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ac0066f60 0x7f3ac0069420 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.186+0000 7f3ae7800640 1 --2- 172.21.15.175:0/2959307668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ae0161e30 0x7f3ae00b2f60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.186+0000 7f3ae7800640 1 --2- 172.21.15.175:0/2959307668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ae015db00 0x7f3ae014c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.186+0000 7f3ae7800640 1 --2- 172.21.15.175:0/2959307668 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ae00acd90 0x7f3ae00ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.186+0000 7f3ae7800640 1 -- 172.21.15.175:0/2959307668 >> 172.21.15.175:0/2959307668 conn(0x7f3ae00b2200 msgr2=0x7f3ae0160a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:56.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.186+0000 7f3ae7800640 1 -- 172.21.15.175:0/2959307668 shutdown_connections 2024-04-25T09:04:56.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.186+0000 7f3ae7800640 1 -- 172.21.15.175:0/2959307668 wait complete. 2024-04-25T09:04:56.198 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-25T09:04:56.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.342+0000 7f324f200640 1 Processor -- start 2024-04-25T09:04:56.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.342+0000 7f324f200640 1 -- start start 2024-04-25T09:04:56.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.342+0000 7f324f200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32480cbe60 0x7f324815af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.342+0000 7f324f200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f324806d310 0x7f32480b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.342+0000 7f324f200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f32480b4630 0x7f32480b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.342+0000 7f324f200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324806db60 con 0x7f32480b4630 2024-04-25T09:04:56.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.342+0000 7f324f200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324806de40 con 0x7f324806d310 2024-04-25T09:04:56.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.342+0000 7f324f200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324806e120 con 0x7f32480cbe60 2024-04-25T09:04:56.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.342+0000 7f324d200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f32480b4630 0x7f32480b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.342+0000 7f324d200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f32480b4630 0x7f32480b2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50350/0 (socket says 172.21.15.175:50350) 2024-04-25T09:04:56.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.342+0000 7f324d200640 1 -- 172.21.15.175:0/883260838 learned_addr learned my addr 172.21.15.175:0/883260838 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:56.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.342+0000 7f323f400640 1 --2- 172.21.15.175:0/883260838 >> v2:172.21.15.177:3300/0 conn(0x7f324806d310 0x7f32480b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.342+0000 7f3247e00640 1 --2- 172.21.15.175:0/883260838 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32480cbe60 0x7f324815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.342+0000 7f324d200640 1 -- 172.21.15.175:0/883260838 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32480cbe60 msgr2=0x7f324815af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:56.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.342+0000 7f324d200640 1 --2- 172.21.15.175:0/883260838 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32480cbe60 0x7f324815af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.342+0000 7f324d200640 1 -- 172.21.15.175:0/883260838 >> v2:172.21.15.177:3300/0 conn(0x7f324806d310 msgr2=0x7f32480b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:56.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.342+0000 7f324d200640 1 --2- 172.21.15.175:0/883260838 >> v2:172.21.15.177:3300/0 conn(0x7f324806d310 0x7f32480b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.342+0000 7f324d200640 1 -- 172.21.15.175:0/883260838 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324815c2f0 con 0x7f32480b4630 2024-04-25T09:04:56.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.346+0000 7f324d200640 1 --2- 172.21.15.175:0/883260838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32480b4630 0x7f32480b2660 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f324806f7e0 tx=0x7f324001e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cacc41baa4b0cfeb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:56.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.346+0000 7f3247400640 1 -- 172.21.15.175:0/883260838 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324000b2d0 con 0x7f32480b4630 2024-04-25T09:04:56.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.346+0000 7f3247400640 1 -- 172.21.15.175:0/883260838 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324000b470 con 0x7f32480b4630 2024-04-25T09:04:56.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.346+0000 7f3247400640 1 -- 172.21.15.175:0/883260838 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3240009820 con 0x7f32480b4630 2024-04-25T09:04:56.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.346+0000 7f324f200640 1 -- 172.21.15.175:0/883260838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32480b4630 msgr2=0x7f32480b2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.346+0000 7f324f200640 1 --2- 172.21.15.175:0/883260838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32480b4630 0x7f32480b2660 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f324806f7e0 tx=0x7f324001e930 comp rx=0 tx=0).stop 2024-04-25T09:04:56.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.346+0000 7f324f200640 1 -- 172.21.15.175:0/883260838 shutdown_connections 2024-04-25T09:04:56.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.346+0000 7f324f200640 1 --2- 172.21.15.175:0/883260838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32480b4630 0x7f32480b2660 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.346+0000 7f324f200640 1 --2- 172.21.15.175:0/883260838 >> v2:172.21.15.177:3300/0 conn(0x7f324806d310 0x7f32480b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.346+0000 7f324f200640 1 --2- 172.21.15.175:0/883260838 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32480cbe60 0x7f324815af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.346+0000 7f324f200640 1 -- 172.21.15.175:0/883260838 >> 172.21.15.175:0/883260838 conn(0x7f324806ac50 msgr2=0x7f324806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:56.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.346+0000 7f324f200640 1 -- 172.21.15.175:0/883260838 shutdown_connections 2024-04-25T09:04:56.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.346+0000 7f324f200640 1 -- 172.21.15.175:0/883260838 wait complete. 2024-04-25T09:04:56.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324f200640 1 Processor -- start 2024-04-25T09:04:56.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324f200640 1 -- start start 2024-04-25T09:04:56.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324f200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f324806d310 0x7f32480ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324f200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32480b4630 0x7f32481485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324f200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32480cbe60 0x7f32481438d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324f200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32480716a0 con 0x7f32480cbe60 2024-04-25T09:04:56.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324f200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3248071520 con 0x7f324806d310 2024-04-25T09:04:56.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324f200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3248071820 con 0x7f32480b4630 2024-04-25T09:04:56.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324d200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32480cbe60 0x7f32481438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324d200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32480cbe60 0x7f32481438d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50364/0 (socket says 172.21.15.175:50364) 2024-04-25T09:04:56.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324d200640 1 -- 172.21.15.175:0/3892161825 learned_addr learned my addr 172.21.15.175:0/3892161825 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:56.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f323f400640 1 --2- 172.21.15.175:0/3892161825 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32480b4630 0x7f32481485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f3247e00640 1 --2- 172.21.15.175:0/3892161825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f324806d310 0x7f32480ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324d200640 1 -- 172.21.15.175:0/3892161825 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32480b4630 msgr2=0x7f32481485d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324d200640 1 --2- 172.21.15.175:0/3892161825 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32480b4630 0x7f32481485d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324d200640 1 -- 172.21.15.175:0/3892161825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f324806d310 msgr2=0x7f32480ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324d200640 1 --2- 172.21.15.175:0/3892161825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f324806d310 0x7f32480ce5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324d200640 1 -- 172.21.15.175:0/3892161825 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3248149a10 con 0x7f32480cbe60 2024-04-25T09:04:56.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f3247e00640 1 --2- 172.21.15.175:0/3892161825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f324806d310 0x7f32480ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:56.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324d200640 1 --2- 172.21.15.175:0/3892161825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32480cbe60 0x7f32481438d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f32400b1040 tx=0x7f324001b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:56.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f3244c00640 1 -- 172.21.15.175:0/3892161825 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324000b720 con 0x7f32480cbe60 2024-04-25T09:04:56.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f3244c00640 1 -- 172.21.15.175:0/3892161825 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32400c0070 con 0x7f32480cbe60 2024-04-25T09:04:56.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f3244c00640 1 -- 172.21.15.175:0/3892161825 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32400a7a00 con 0x7f32480cbe60 2024-04-25T09:04:56.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324f200640 1 -- 172.21.15.175:0/3892161825 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3248148e90 con 0x7f32480cbe60 2024-04-25T09:04:56.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.350+0000 7f324f200640 1 -- 172.21.15.175:0/3892161825 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3248149450 con 0x7f32480cbe60 2024-04-25T09:04:56.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.354+0000 7f324f200640 1 -- 172.21.15.175:0/3892161825 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3248075160 con 0x7f32480cbe60 2024-04-25T09:04:56.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.354+0000 7f3244c00640 1 -- 172.21.15.175:0/3892161825 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f324000b2e0 con 0x7f32480cbe60 2024-04-25T09:04:56.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.354+0000 7f3244c00640 1 --2- 172.21.15.175:0/3892161825 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3224066f60 0x7f3224069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.354+0000 7f3244c00640 1 -- 172.21.15.175:0/3892161825 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3240121cf0 con 0x7f32480cbe60 2024-04-25T09:04:56.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.354+0000 7f3247e00640 1 --2- 172.21.15.175:0/3892161825 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3224066f60 0x7f3224069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.354+0000 7f3247e00640 1 --2- 172.21.15.175:0/3892161825 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3224066f60 0x7f3224069420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f32481522f0 tx=0x7f3230008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:56.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.358+0000 7f3244c00640 1 -- 172.21.15.175:0/3892161825 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f32400187e0 con 0x7f32480cbe60 2024-04-25T09:04:56.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.570+0000 7f324f200640 1 -- 172.21.15.175:0/3892161825 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f32480b09d0 con 0x7f32480cbe60 2024-04-25T09:04:56.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.570+0000 7f3244c00640 1 -- 172.21.15.175:0/3892161825 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f32400f3190 con 0x7f32480cbe60 2024-04-25T09:04:56.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.574+0000 7f324f200640 1 -- 172.21.15.175:0/3892161825 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3224066f60 msgr2=0x7f3224069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.574+0000 7f324f200640 1 --2- 172.21.15.175:0/3892161825 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3224066f60 0x7f3224069420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f32481522f0 tx=0x7f3230008040 comp rx=0 tx=0).stop 2024-04-25T09:04:56.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.574+0000 7f324f200640 1 -- 172.21.15.175:0/3892161825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32480cbe60 msgr2=0x7f32481438d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.574+0000 7f324f200640 1 --2- 172.21.15.175:0/3892161825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32480cbe60 0x7f32481438d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f32400b1040 tx=0x7f324001b6d0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.574+0000 7f324f200640 1 -- 172.21.15.175:0/3892161825 shutdown_connections 2024-04-25T09:04:56.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.574+0000 7f324f200640 1 --2- 172.21.15.175:0/3892161825 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3224066f60 0x7f3224069420 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.574+0000 7f324f200640 1 --2- 172.21.15.175:0/3892161825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32480cbe60 0x7f32481438d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.574+0000 7f324f200640 1 --2- 172.21.15.175:0/3892161825 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32480b4630 0x7f32481485d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.574+0000 7f324f200640 1 --2- 172.21.15.175:0/3892161825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f324806d310 0x7f32480ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.574+0000 7f324f200640 1 -- 172.21.15.175:0/3892161825 >> 172.21.15.175:0/3892161825 conn(0x7f324806ac50 msgr2=0x7f32480af360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:56.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.574+0000 7f324f200640 1 -- 172.21.15.175:0/3892161825 shutdown_connections 2024-04-25T09:04:56.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.574+0000 7f324f200640 1 -- 172.21.15.175:0/3892161825 wait complete. 2024-04-25T09:04:56.586 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-25T09:04:56.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.730+0000 7fd2e7200640 1 Processor -- start 2024-04-25T09:04:56.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.730+0000 7fd2e7200640 1 -- start start 2024-04-25T09:04:56.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.730+0000 7fd2e7200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2e0145250 0x7fd2e00cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.730+0000 7fd2e7200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd2e00ce970 0x7fd2e00cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.730+0000 7fd2e7200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e00cfd10 con 0x7fd2e01600a0 2024-04-25T09:04:56.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.730+0000 7fd2e7200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e015f650 con 0x7fd2e00ce970 2024-04-25T09:04:56.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.730+0000 7fd2e7200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e00cfff0 con 0x7fd2e0145250 2024-04-25T09:04:56.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.734+0000 7fd2e5200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd2e00ce970 0x7fd2e00cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.734+0000 7fd2d7400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd2e01600a0 0x7fd2e00cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:37798/0 (socket says 172.21.15.175:37798) 2024-04-25T09:04:56.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.734+0000 7fd2d7400640 1 -- 172.21.15.175:0/2170999005 learned_addr learned my addr 172.21.15.175:0/2170999005 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:56.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.734+0000 7fd2dfe00640 1 --2- 172.21.15.175:0/2170999005 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2e0145250 0x7fd2e00cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.734+0000 7fd2e5200640 1 -- 172.21.15.175:0/2170999005 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2e0145250 msgr2=0x7fd2e00cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:56.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.734+0000 7fd2e5200640 1 --2- 172.21.15.175:0/2170999005 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2e0145250 0x7fd2e00cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.734+0000 7fd2e5200640 1 -- 172.21.15.175:0/2170999005 >> v1:172.21.15.175:6789/0 conn(0x7fd2e01600a0 legacy=0x7fd2e00cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.734+0000 7fd2e5200640 1 -- 172.21.15.175:0/2170999005 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e015f8a0 con 0x7fd2e00ce970 2024-04-25T09:04:56.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.734+0000 7fd2e5200640 1 --2- 172.21.15.175:0/2170999005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e00ce970 0x7fd2e00cee00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80097c0 tx=0x7fd2d801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d69f5c6597d238 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:56.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.734+0000 7fd2df400640 1 -- 172.21.15.175:0/2170999005 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d80ab600 con 0x7fd2e00ce970 2024-04-25T09:04:56.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.734+0000 7fd2df400640 1 -- 172.21.15.175:0/2170999005 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d80b0070 con 0x7fd2e00ce970 2024-04-25T09:04:56.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.734+0000 7fd2df400640 1 -- 172.21.15.175:0/2170999005 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d80ab9c0 con 0x7fd2e00ce970 2024-04-25T09:04:56.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2e7200640 1 -- 172.21.15.175:0/2170999005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e00ce970 msgr2=0x7fd2e00cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2e7200640 1 --2- 172.21.15.175:0/2170999005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e00ce970 0x7fd2e00cee00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80097c0 tx=0x7fd2d801c3e0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2e7200640 1 -- 172.21.15.175:0/2170999005 shutdown_connections 2024-04-25T09:04:56.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2e7200640 1 --2- 172.21.15.175:0/2170999005 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e00ce970 0x7fd2e00cee00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2e7200640 1 --2- 172.21.15.175:0/2170999005 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2e0145250 0x7fd2e00cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2e7200640 1 -- 172.21.15.175:0/2170999005 >> 172.21.15.175:0/2170999005 conn(0x7fd2e006ac50 msgr2=0x7fd2e006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:56.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2e7200640 1 -- 172.21.15.175:0/2170999005 shutdown_connections 2024-04-25T09:04:56.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2e7200640 1 -- 172.21.15.175:0/2170999005 wait complete. 2024-04-25T09:04:56.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2e7200640 1 Processor -- start 2024-04-25T09:04:56.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2e7200640 1 -- start start 2024-04-25T09:04:56.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2e7200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2e00ce970 0x7fd2e013e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2e7200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e0145250 0x7fd2e006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2e7200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e01600a0 0x7fd2e006def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2e7200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e0160600 con 0x7fd2e0145250 2024-04-25T09:04:56.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2e7200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e0160480 con 0x7fd2e01600a0 2024-04-25T09:04:56.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2e7200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e015c870 con 0x7fd2e00ce970 2024-04-25T09:04:56.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2d7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e0145250 0x7fd2e006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2d7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e0145250 0x7fd2e006d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50388/0 (socket says 172.21.15.175:50388) 2024-04-25T09:04:56.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2d7400640 1 -- 172.21.15.175:0/2987806000 learned_addr learned my addr 172.21.15.175:0/2987806000 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:56.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2dfe00640 1 --2- 172.21.15.175:0/2987806000 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2e00ce970 0x7fd2e013e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2e5200640 1 --2- 172.21.15.175:0/2987806000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e01600a0 0x7fd2e006def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2d7400640 1 -- 172.21.15.175:0/2987806000 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2e00ce970 msgr2=0x7fd2e013e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2d7400640 1 --2- 172.21.15.175:0/2987806000 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2e00ce970 0x7fd2e013e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2d7400640 1 -- 172.21.15.175:0/2987806000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e01600a0 msgr2=0x7fd2e006def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2d7400640 1 --2- 172.21.15.175:0/2987806000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e01600a0 0x7fd2e006def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2d7400640 1 -- 172.21.15.175:0/2987806000 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e015b630 con 0x7fd2e0145250 2024-04-25T09:04:56.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.738+0000 7fd2d7400640 1 --2- 172.21.15.175:0/2987806000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e0145250 0x7fd2e006d9b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800ca70 tx=0x7fd2c800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:56.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.742+0000 7fd2dcc00640 1 -- 172.21.15.175:0/2987806000 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8017070 con 0x7fd2e0145250 2024-04-25T09:04:56.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.742+0000 7fd2dcc00640 1 -- 172.21.15.175:0/2987806000 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c800abd0 con 0x7fd2e0145250 2024-04-25T09:04:56.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.742+0000 7fd2dcc00640 1 -- 172.21.15.175:0/2987806000 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8012400 con 0x7fd2e0145250 2024-04-25T09:04:56.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.742+0000 7fd2e7200640 1 -- 172.21.15.175:0/2987806000 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e015b350 con 0x7fd2e0145250 2024-04-25T09:04:56.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.742+0000 7fd2e7200640 1 -- 172.21.15.175:0/2987806000 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e013d880 con 0x7fd2e0145250 2024-04-25T09:04:56.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.742+0000 7fd2e7200640 1 -- 172.21.15.175:0/2987806000 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e0075160 con 0x7fd2e0145250 2024-04-25T09:04:56.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.742+0000 7fd2dcc00640 1 -- 172.21.15.175:0/2987806000 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd2c801a070 con 0x7fd2e0145250 2024-04-25T09:04:56.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.742+0000 7fd2dcc00640 1 --2- 172.21.15.175:0/2987806000 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd2bc066f60 0x7fd2bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:56.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.742+0000 7fd2dcc00640 1 -- 172.21.15.175:0/2987806000 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd2c8084a80 con 0x7fd2e0145250 2024-04-25T09:04:56.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.742+0000 7fd2dfe00640 1 --2- 172.21.15.175:0/2987806000 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd2bc066f60 0x7fd2bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:56.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.742+0000 7fd2dfe00640 1 --2- 172.21.15.175:0/2987806000 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd2bc066f60 0x7fd2bc069420 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000b9d0 tx=0x7fd2d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:56.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.746+0000 7fd2dcc00640 1 -- 172.21.15.175:0/2987806000 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd2c8086e20 con 0x7fd2e0145250 2024-04-25T09:04:56.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.958+0000 7fd2e7200640 1 -- 172.21.15.175:0/2987806000 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd2e0067f00 con 0x7fd2e0145250 2024-04-25T09:04:56.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.958+0000 7fd2dcc00640 1 -- 172.21.15.175:0/2987806000 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd2c8055d40 con 0x7fd2e0145250 2024-04-25T09:04:56.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.962+0000 7fd2e7200640 1 -- 172.21.15.175:0/2987806000 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd2bc066f60 msgr2=0x7fd2bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.962+0000 7fd2e7200640 1 --2- 172.21.15.175:0/2987806000 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd2bc066f60 0x7fd2bc069420 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000b9d0 tx=0x7fd2d0008040 comp rx=0 tx=0).stop 2024-04-25T09:04:56.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.962+0000 7fd2e7200640 1 -- 172.21.15.175:0/2987806000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e0145250 msgr2=0x7fd2e006d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:56.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.962+0000 7fd2e7200640 1 --2- 172.21.15.175:0/2987806000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e0145250 0x7fd2e006d9b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800ca70 tx=0x7fd2c800cf30 comp rx=0 tx=0).stop 2024-04-25T09:04:56.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.962+0000 7fd2e7200640 1 -- 172.21.15.175:0/2987806000 shutdown_connections 2024-04-25T09:04:56.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.962+0000 7fd2e7200640 1 --2- 172.21.15.175:0/2987806000 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd2bc066f60 0x7fd2bc069420 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.962+0000 7fd2e7200640 1 --2- 172.21.15.175:0/2987806000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e01600a0 0x7fd2e006def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.962+0000 7fd2e7200640 1 --2- 172.21.15.175:0/2987806000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e0145250 0x7fd2e006d9b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.962+0000 7fd2e7200640 1 --2- 172.21.15.175:0/2987806000 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2e00ce970 0x7fd2e013e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:56.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.962+0000 7fd2e7200640 1 -- 172.21.15.175:0/2987806000 >> 172.21.15.175:0/2987806000 conn(0x7fd2e006ac50 msgr2=0x7fd2e00af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:56.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.962+0000 7fd2e7200640 1 -- 172.21.15.175:0/2987806000 shutdown_connections 2024-04-25T09:04:56.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:56.962+0000 7fd2e7200640 1 -- 172.21.15.175:0/2987806000 wait complete. 2024-04-25T09:04:56.974 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-25T09:04:57.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.118+0000 7f6b91000640 1 Processor -- start 2024-04-25T09:04:57.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.118+0000 7f6b91000640 1 -- start start 2024-04-25T09:04:57.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.118+0000 7f6b91000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b8c0cf6b0 0x7f6b8c1600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.118+0000 7f6b91000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b8c0cfd10 con 0x7f6b8c0ce970 2024-04-25T09:04:57.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.118+0000 7f6b91000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b8c0cfff0 con 0x7f6b8c145250 2024-04-25T09:04:57.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.118+0000 7f6b91000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c1605e0 con 0x7f6b8c0cf6b0 2024-04-25T09:04:57.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.118+0000 7f6b8a800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f6b8c0ce970 0x7f6b8c0cee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:37806/0 (socket says 172.21.15.175:37806) 2024-04-25T09:04:57.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.118+0000 7f6b8a800640 1 -- 172.21.15.175:0/3944987201 learned_addr learned my addr 172.21.15.175:0/3944987201 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:57.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.118+0000 7f6b89400640 1 --2- 172.21.15.175:0/3944987201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b8c0cf6b0 0x7f6b8c1600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.118+0000 7f6b88a00640 1 -- 172.21.15.175:0/3944987201 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2418168107 0 0) 0x7f6b8c0cfd10 con 0x7f6b8c0ce970 2024-04-25T09:04:57.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.118+0000 7f6b88a00640 1 -- 172.21.15.175:0/3944987201 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b70003530 con 0x7f6b8c0ce970 2024-04-25T09:04:57.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b88a00640 1 -- 172.21.15.175:0/3944987201 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47854443 0 0) 0x7f6b8c0cfff0 con 0x7f6b8c145250 2024-04-25T09:04:57.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b88a00640 1 -- 172.21.15.175:0/3944987201 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b8c0cfd10 con 0x7f6b8c145250 2024-04-25T09:04:57.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b88a00640 1 -- 172.21.15.175:0/3944987201 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3120103721 0 0) 0x7f6b70003530 con 0x7f6b8c0ce970 2024-04-25T09:04:57.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b88a00640 1 -- 172.21.15.175:0/3944987201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b8c0cf6b0 msgr2=0x7f6b8c1600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:57.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b88a00640 1 --2- 172.21.15.175:0/3944987201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b8c0cf6b0 0x7f6b8c1600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b88a00640 1 -- 172.21.15.175:0/3944987201 >> v1:172.21.15.177:6789/0 conn(0x7f6b8c145250 legacy=0x7f6b8c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b88a00640 1 -- 172.21.15.175:0/3944987201 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8c15f8a0 con 0x7f6b8c0ce970 2024-04-25T09:04:57.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b88a00640 1 -- 172.21.15.175:0/3944987201 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f6b84001680 con 0x7f6b8c0ce970 2024-04-25T09:04:57.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b88a00640 1 -- 172.21.15.175:0/3944987201 >> v1:172.21.15.175:6789/0 conn(0x7f6b8c0ce970 legacy=0x7f6b8c0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b88a00640 1 --2- 172.21.15.175:0/3944987201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b8c0cf6b0 0x7f6b70003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b88a00640 1 --2- 172.21.15.175:0/3944987201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b70004130 0x7f6b70004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b88a00640 1 --2- 172.21.15.175:0/3944987201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b70004d50 0x7f6b700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b88a00640 1 -- 172.21.15.175:0/3944987201 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c1605e0 con 0x7f6b70004d50 2024-04-25T09:04:57.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b88a00640 1 -- 172.21.15.175:0/3944987201 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7000bc30 con 0x7f6b70004130 2024-04-25T09:04:57.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b88a00640 1 -- 172.21.15.175:0/3944987201 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7000be30 con 0x7f6b8c0cf6b0 2024-04-25T09:04:57.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b8a800640 1 --2- 172.21.15.175:0/3944987201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b70004d50 0x7f6b700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b89e00640 1 --2- 172.21.15.175:0/3944987201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b8c0cf6b0 0x7f6b70003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b89400640 1 --2- 172.21.15.175:0/3944987201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b70004130 0x7f6b70004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b8a800640 1 -- 172.21.15.175:0/3944987201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b8c0cf6b0 msgr2=0x7f6b70003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:57.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b8a800640 1 --2- 172.21.15.175:0/3944987201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b8c0cf6b0 0x7f6b70003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b8a800640 1 -- 172.21.15.175:0/3944987201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b70004130 msgr2=0x7f6b70004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:57.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b8a800640 1 --2- 172.21.15.175:0/3944987201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b70004130 0x7f6b70004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b8a800640 1 -- 172.21.15.175:0/3944987201 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b70003530 con 0x7f6b70004d50 2024-04-25T09:04:57.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.122+0000 7f6b8a800640 1 --2- 172.21.15.175:0/3944987201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b70004d50 0x7f6b700051d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6b84007fb0 tx=0x7f6b8401cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463ed243f3c2e24f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:57.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b88a00640 1 -- 172.21.15.175:0/3944987201 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b84007bd0 con 0x7f6b70004d50 2024-04-25T09:04:57.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b88a00640 1 -- 172.21.15.175:0/3944987201 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b840a9020 con 0x7f6b70004d50 2024-04-25T09:04:57.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b88a00640 1 -- 172.21.15.175:0/3944987201 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b84005b00 con 0x7f6b70004d50 2024-04-25T09:04:57.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b91000640 1 -- 172.21.15.175:0/3944987201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b70004d50 msgr2=0x7f6b700051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b91000640 1 --2- 172.21.15.175:0/3944987201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b70004d50 0x7f6b700051d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6b84007fb0 tx=0x7f6b8401cb20 comp rx=0 tx=0).stop 2024-04-25T09:04:57.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b8a800640 1 -- 172.21.15.175:0/3944987201 reap_dead start 2024-04-25T09:04:57.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b91000640 1 -- 172.21.15.175:0/3944987201 shutdown_connections 2024-04-25T09:04:57.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b91000640 1 -- 172.21.15.175:0/3944987201 >> 172.21.15.175:0/3944987201 conn(0x7f6b8c06ac50 msgr2=0x7f6b8c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:57.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b91000640 1 -- 172.21.15.175:0/3944987201 shutdown_connections 2024-04-25T09:04:57.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b91000640 1 -- 172.21.15.175:0/3944987201 wait complete. 2024-04-25T09:04:57.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b91000640 1 Processor -- start 2024-04-25T09:04:57.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b91000640 1 -- start start 2024-04-25T09:04:57.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b91000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b70004d50 0x7f6b8c13ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b91000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b8c13f350 0x7f6b8c13e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b91000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b8c0b0750 0x7f6b8c0b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b91000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c15cc00 con 0x7f6b8c0b0750 2024-04-25T09:04:57.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b91000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c15ca80 con 0x7f6b70004d50 2024-04-25T09:04:57.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b91000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c15f650 con 0x7f6b8c13f350 2024-04-25T09:04:57.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b8a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b8c0b0750 0x7f6b8c0b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b8a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b8c0b0750 0x7f6b8c0b14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50406/0 (socket says 172.21.15.175:50406) 2024-04-25T09:04:57.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b8a800640 1 -- 172.21.15.175:0/2146675007 learned_addr learned my addr 172.21.15.175:0/2146675007 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:57.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b89e00640 1 --2- 172.21.15.175:0/2146675007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b70004d50 0x7f6b8c13ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.126+0000 7f6b89400640 1 --2- 172.21.15.175:0/2146675007 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b8c13f350 0x7f6b8c13e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.130+0000 7f6b8a800640 1 -- 172.21.15.175:0/2146675007 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b8c13f350 msgr2=0x7f6b8c13e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.130+0000 7f6b8a800640 1 --2- 172.21.15.175:0/2146675007 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b8c13f350 0x7f6b8c13e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.130+0000 7f6b8a800640 1 -- 172.21.15.175:0/2146675007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b70004d50 msgr2=0x7f6b8c13ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.130+0000 7f6b8a800640 1 --2- 172.21.15.175:0/2146675007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b70004d50 0x7f6b8c13ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.130+0000 7f6b8a800640 1 -- 172.21.15.175:0/2146675007 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8c0af6b0 con 0x7f6b8c0b0750 2024-04-25T09:04:57.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.130+0000 7f6b89e00640 1 --2- 172.21.15.175:0/2146675007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b70004d50 0x7f6b8c13ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:57.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.130+0000 7f6b8a800640 1 --2- 172.21.15.175:0/2146675007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b8c0b0750 0x7f6b8c0b14a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6b840ab040 tx=0x7f6b70005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:57.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.130+0000 7f6b82000640 1 -- 172.21.15.175:0/2146675007 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b84007bd0 con 0x7f6b8c0b0750 2024-04-25T09:04:57.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.130+0000 7f6b82000640 1 -- 172.21.15.175:0/2146675007 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b84001480 con 0x7f6b8c0b0750 2024-04-25T09:04:57.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.130+0000 7f6b91000640 1 -- 172.21.15.175:0/2146675007 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8c0af990 con 0x7f6b8c0b0750 2024-04-25T09:04:57.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.130+0000 7f6b82000640 1 -- 172.21.15.175:0/2146675007 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b84000e50 con 0x7f6b8c0b0750 2024-04-25T09:04:57.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.130+0000 7f6b91000640 1 -- 172.21.15.175:0/2146675007 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b8c0aff50 con 0x7f6b8c0b0750 2024-04-25T09:04:57.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.130+0000 7f6b91000640 1 -- 172.21.15.175:0/2146675007 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8c075160 con 0x7f6b8c0b0750 2024-04-25T09:04:57.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.130+0000 7f6b82000640 1 -- 172.21.15.175:0/2146675007 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6b840072f0 con 0x7f6b8c0b0750 2024-04-25T09:04:57.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.130+0000 7f6b82000640 1 --2- 172.21.15.175:0/2146675007 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6b6c066f60 0x7f6b6c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.130+0000 7f6b82000640 1 -- 172.21.15.175:0/2146675007 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6b8411dfb0 con 0x7f6b8c0b0750 2024-04-25T09:04:57.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.130+0000 7f6b89e00640 1 --2- 172.21.15.175:0/2146675007 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6b6c066f60 0x7f6b6c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.134+0000 7f6b89e00640 1 --2- 172.21.15.175:0/2146675007 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6b6c066f60 0x7f6b6c069420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0b2300 tx=0x7f6b7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:57.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.138+0000 7f6b82000640 1 -- 172.21.15.175:0/2146675007 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6b84016830 con 0x7f6b8c0b0750 2024-04-25T09:04:57.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.342+0000 7f6b91000640 1 -- 172.21.15.175:0/2146675007 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f6b8c06f1a0 con 0x7f6b8c0b0750 2024-04-25T09:04:57.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.346+0000 7f6b82000640 1 -- 172.21.15.175:0/2146675007 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6b840ef270 con 0x7f6b8c0b0750 2024-04-25T09:04:57.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.346+0000 7f6b91000640 1 -- 172.21.15.175:0/2146675007 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6b6c066f60 msgr2=0x7f6b6c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.346+0000 7f6b91000640 1 --2- 172.21.15.175:0/2146675007 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6b6c066f60 0x7f6b6c069420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0b2300 tx=0x7f6b7c009040 comp rx=0 tx=0).stop 2024-04-25T09:04:57.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.346+0000 7f6b91000640 1 -- 172.21.15.175:0/2146675007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b8c0b0750 msgr2=0x7f6b8c0b14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.346+0000 7f6b91000640 1 --2- 172.21.15.175:0/2146675007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b8c0b0750 0x7f6b8c0b14a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6b840ab040 tx=0x7f6b70005840 comp rx=0 tx=0).stop 2024-04-25T09:04:57.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.346+0000 7f6b91000640 1 -- 172.21.15.175:0/2146675007 shutdown_connections 2024-04-25T09:04:57.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.346+0000 7f6b91000640 1 --2- 172.21.15.175:0/2146675007 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6b6c066f60 0x7f6b6c069420 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.346+0000 7f6b91000640 1 --2- 172.21.15.175:0/2146675007 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b8c0b0750 0x7f6b8c0b14a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.346+0000 7f6b91000640 1 --2- 172.21.15.175:0/2146675007 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b8c13f350 0x7f6b8c13e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.346+0000 7f6b91000640 1 --2- 172.21.15.175:0/2146675007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b70004d50 0x7f6b8c13ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.346+0000 7f6b91000640 1 -- 172.21.15.175:0/2146675007 >> 172.21.15.175:0/2146675007 conn(0x7f6b8c06ac50 msgr2=0x7f6b8c161dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:57.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.346+0000 7f6b91000640 1 -- 172.21.15.175:0/2146675007 shutdown_connections 2024-04-25T09:04:57.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.346+0000 7f6b91000640 1 -- 172.21.15.175:0/2146675007 wait complete. 2024-04-25T09:04:57.358 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-25T09:04:57.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.502+0000 7f6ecaa00640 1 Processor -- start 2024-04-25T09:04:57.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.502+0000 7f6ecaa00640 1 -- start start 2024-04-25T09:04:57.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.502+0000 7f6ecaa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ec41454f0 0x7f6ec40cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.502+0000 7f6ecaa00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6ec40d1470 0x7f6ec40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.502+0000 7f6ecaa00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec40b4430 con 0x7f6ec40cf490 2024-04-25T09:04:57.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.502+0000 7f6ecaa00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec40b4940 con 0x7f6ec40d1470 2024-04-25T09:04:57.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.502+0000 7f6ecaa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec40cf8f0 con 0x7f6ec41454f0 2024-04-25T09:04:57.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.502+0000 7f6ec8a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6ec40d1470 0x7f6ec40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.502+0000 7f6ebb400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f6ec40cf490 0x7f6ec40d0d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:37808/0 (socket says 172.21.15.175:37808) 2024-04-25T09:04:57.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.502+0000 7f6ebb400640 1 -- 172.21.15.175:0/3518833418 learned_addr learned my addr 172.21.15.175:0/3518833418 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:57.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.502+0000 7f6ec3e00640 1 --2- 172.21.15.175:0/3518833418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ec41454f0 0x7f6ec40cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.502+0000 7f6ec8a00640 1 -- 172.21.15.175:0/3518833418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ec41454f0 msgr2=0x7f6ec40cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:57.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.502+0000 7f6ec8a00640 1 --2- 172.21.15.175:0/3518833418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ec41454f0 0x7f6ec40cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.502+0000 7f6ec8a00640 1 -- 172.21.15.175:0/3518833418 >> v1:172.21.15.175:6789/0 conn(0x7f6ec40cf490 legacy=0x7f6ec40d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.502+0000 7f6ec8a00640 1 -- 172.21.15.175:0/3518833418 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec4070eb0 con 0x7f6ec40d1470 2024-04-25T09:04:57.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.502+0000 7f6ec3400640 1 -- 172.21.15.175:0/3518833418 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1824328158 0 0) 0x7f6ec40b4430 con 0x7f6ec40cf490 2024-04-25T09:04:57.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.506+0000 7f6ec8a00640 1 --2- 172.21.15.175:0/3518833418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec40d1470 0x7f6ec40b4dd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0097c0 tx=0x7f6ebc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baccb4e23fbefdc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:57.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.506+0000 7f6ec3400640 1 -- 172.21.15.175:0/3518833418 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc0a7070 con 0x7f6ec40d1470 2024-04-25T09:04:57.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.506+0000 7f6ec3400640 1 -- 172.21.15.175:0/3518833418 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc0b0070 con 0x7f6ec40d1470 2024-04-25T09:04:57.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.506+0000 7f6ec3400640 1 -- 172.21.15.175:0/3518833418 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc0ab890 con 0x7f6ec40d1470 2024-04-25T09:04:57.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.506+0000 7f6ecaa00640 1 -- 172.21.15.175:0/3518833418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec40d1470 msgr2=0x7f6ec40b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.506+0000 7f6ecaa00640 1 --2- 172.21.15.175:0/3518833418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec40d1470 0x7f6ec40b4dd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0097c0 tx=0x7f6ebc01c470 comp rx=0 tx=0).stop 2024-04-25T09:04:57.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.506+0000 7f6ecaa00640 1 -- 172.21.15.175:0/3518833418 shutdown_connections 2024-04-25T09:04:57.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.506+0000 7f6ecaa00640 1 --2- 172.21.15.175:0/3518833418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec40d1470 0x7f6ec40b4dd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.506+0000 7f6ecaa00640 1 --2- 172.21.15.175:0/3518833418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ec41454f0 0x7f6ec40cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.506+0000 7f6ecaa00640 1 -- 172.21.15.175:0/3518833418 >> 172.21.15.175:0/3518833418 conn(0x7f6ec40b3510 msgr2=0x7f6ec40b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:57.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.506+0000 7f6ecaa00640 1 -- 172.21.15.175:0/3518833418 shutdown_connections 2024-04-25T09:04:57.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.506+0000 7f6ecaa00640 1 -- 172.21.15.175:0/3518833418 wait complete. 2024-04-25T09:04:57.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ecaa00640 1 Processor -- start 2024-04-25T09:04:57.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ecaa00640 1 -- start start 2024-04-25T09:04:57.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ecaa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec40cf490 0x7f6ec4162160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ecaa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ec40d1470 0x7f6ec40b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ecaa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec41454f0 0x7f6ec415d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ecaa00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec40b5b20 con 0x7f6ec41454f0 2024-04-25T09:04:57.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ecaa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec41458d0 con 0x7f6ec40cf490 2024-04-25T09:04:57.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ecaa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec40b5ca0 con 0x7f6ec40d1470 2024-04-25T09:04:57.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ec8a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec41454f0 0x7f6ec415d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ebb400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ec40d1470 0x7f6ec40b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ec8a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec41454f0 0x7f6ec415d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50418/0 (socket says 172.21.15.175:50418) 2024-04-25T09:04:57.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ec8a00640 1 -- 172.21.15.175:0/2725806970 learned_addr learned my addr 172.21.15.175:0/2725806970 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:57.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ec3e00640 1 --2- 172.21.15.175:0/2725806970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec40cf490 0x7f6ec4162160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ec8a00640 1 -- 172.21.15.175:0/2725806970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ec40d1470 msgr2=0x7f6ec40b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ec8a00640 1 --2- 172.21.15.175:0/2725806970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ec40d1470 0x7f6ec40b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ec8a00640 1 -- 172.21.15.175:0/2725806970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec40cf490 msgr2=0x7f6ec4162160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ec8a00640 1 --2- 172.21.15.175:0/2725806970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec40cf490 0x7f6ec4162160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ec8a00640 1 -- 172.21.15.175:0/2725806970 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec40b6330 con 0x7f6ec41454f0 2024-04-25T09:04:57.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ec8a00640 1 --2- 172.21.15.175:0/2725806970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec41454f0 0x7f6ec415d410 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0097c0 tx=0x7f6ebc01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:57.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ec0c00640 1 -- 172.21.15.175:0/2725806970 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc0abe60 con 0x7f6ec41454f0 2024-04-25T09:04:57.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ec0c00640 1 -- 172.21.15.175:0/2725806970 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc0bf610 con 0x7f6ec41454f0 2024-04-25T09:04:57.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ec0c00640 1 -- 172.21.15.175:0/2725806970 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc0bf9e0 con 0x7f6ec41454f0 2024-04-25T09:04:57.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ecaa00640 1 -- 172.21.15.175:0/2725806970 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec415e890 con 0x7f6ec41454f0 2024-04-25T09:04:57.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.510+0000 7f6ecaa00640 1 -- 172.21.15.175:0/2725806970 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec415e2d0 con 0x7f6ec41454f0 2024-04-25T09:04:57.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.514+0000 7f6ecaa00640 1 -- 172.21.15.175:0/2725806970 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec4075160 con 0x7f6ec41454f0 2024-04-25T09:04:57.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.514+0000 7f6ec0c00640 1 -- 172.21.15.175:0/2725806970 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6ebc0bd020 con 0x7f6ec41454f0 2024-04-25T09:04:57.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.514+0000 7f6ec0c00640 1 --2- 172.21.15.175:0/2725806970 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6ea0066f60 0x7f6ea0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.514+0000 7f6ec0c00640 1 -- 172.21.15.175:0/2725806970 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6ebc11ec70 con 0x7f6ec41454f0 2024-04-25T09:04:57.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.514+0000 7f6ec3e00640 1 --2- 172.21.15.175:0/2725806970 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6ea0066f60 0x7f6ea0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.514+0000 7f6ec3e00640 1 --2- 172.21.15.175:0/2725806970 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6ea0066f60 0x7f6ea0069420 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4011340 tx=0x7f6eb400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:57.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.518+0000 7f6ec0c00640 1 -- 172.21.15.175:0/2725806970 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6ebc0c6070 con 0x7f6ec41454f0 2024-04-25T09:04:57.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.726+0000 7f6ecaa00640 1 -- 172.21.15.175:0/2725806970 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f6ec40b43b0 con 0x7f6ec41454f0 2024-04-25T09:04:57.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.730+0000 7f6ec0c00640 1 -- 172.21.15.175:0/2725806970 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6ebc016090 con 0x7f6ec41454f0 2024-04-25T09:04:57.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.730+0000 7f6ecaa00640 1 -- 172.21.15.175:0/2725806970 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6ea0066f60 msgr2=0x7f6ea0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.730+0000 7f6ecaa00640 1 --2- 172.21.15.175:0/2725806970 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6ea0066f60 0x7f6ea0069420 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4011340 tx=0x7f6eb400b040 comp rx=0 tx=0).stop 2024-04-25T09:04:57.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.730+0000 7f6ecaa00640 1 -- 172.21.15.175:0/2725806970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec41454f0 msgr2=0x7f6ec415d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.730+0000 7f6ecaa00640 1 --2- 172.21.15.175:0/2725806970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec41454f0 0x7f6ec415d410 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0097c0 tx=0x7f6ebc01acb0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.730+0000 7f6ecaa00640 1 -- 172.21.15.175:0/2725806970 shutdown_connections 2024-04-25T09:04:57.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.730+0000 7f6ecaa00640 1 --2- 172.21.15.175:0/2725806970 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6ea0066f60 0x7f6ea0069420 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.730+0000 7f6ecaa00640 1 --2- 172.21.15.175:0/2725806970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ec41454f0 0x7f6ec415d410 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.730+0000 7f6ecaa00640 1 --2- 172.21.15.175:0/2725806970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ec40d1470 0x7f6ec40b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.730+0000 7f6ecaa00640 1 --2- 172.21.15.175:0/2725806970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ec40cf490 0x7f6ec4162160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.730+0000 7f6ecaa00640 1 -- 172.21.15.175:0/2725806970 >> 172.21.15.175:0/2725806970 conn(0x7f6ec40b3510 msgr2=0x7f6ec40741d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:57.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.730+0000 7f6ecaa00640 1 -- 172.21.15.175:0/2725806970 shutdown_connections 2024-04-25T09:04:57.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.730+0000 7f6ecaa00640 1 -- 172.21.15.175:0/2725806970 wait complete. 2024-04-25T09:04:57.743 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-25T09:04:57.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.890+0000 7efe2a200640 1 Processor -- start 2024-04-25T09:04:57.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.890+0000 7efe2a200640 1 -- start start 2024-04-25T09:04:57.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.890+0000 7efe2a200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe2415af20 0x7efe240b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.890+0000 7efe2a200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efe240b4630 0x7efe2415c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.890+0000 7efe2a200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2406db60 con 0x7efe240cbe60 2024-04-25T09:04:57.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.890+0000 7efe2a200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2406de40 con 0x7efe240b4630 2024-04-25T09:04:57.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.890+0000 7efe2a200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2406e120 con 0x7efe2415af20 2024-04-25T09:04:57.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.890+0000 7efe23400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7efe240cbe60 0x7efe2406d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:37824/0 (socket says 172.21.15.175:37824) 2024-04-25T09:04:57.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.890+0000 7efe23400640 1 -- 172.21.15.175:0/262634256 learned_addr learned my addr 172.21.15.175:0/262634256 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:57.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.890+0000 7efe23e00640 1 --2- 172.21.15.175:0/262634256 >> v2:172.21.15.177:3300/0 conn(0x7efe240b4630 0x7efe2415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.890+0000 7efe22a00640 1 --2- 172.21.15.175:0/262634256 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe2415af20 0x7efe240b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.890+0000 7efe22000640 1 -- 172.21.15.175:0/262634256 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657874603 0 0) 0x7efe2406db60 con 0x7efe240cbe60 2024-04-25T09:04:57.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.890+0000 7efe22000640 1 -- 172.21.15.175:0/262634256 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe08003530 con 0x7efe240cbe60 2024-04-25T09:04:57.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.890+0000 7efe23e00640 1 -- 172.21.15.175:0/262634256 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe2415af20 msgr2=0x7efe240b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:57.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.890+0000 7efe23e00640 1 --2- 172.21.15.175:0/262634256 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe2415af20 0x7efe240b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.890+0000 7efe23e00640 1 -- 172.21.15.175:0/262634256 >> v1:172.21.15.175:6789/0 conn(0x7efe240cbe60 legacy=0x7efe2406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.890+0000 7efe23e00640 1 -- 172.21.15.175:0/262634256 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2415c2f0 con 0x7efe240b4630 2024-04-25T09:04:57.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.890+0000 7efe22a00640 1 --2- 172.21.15.175:0/262634256 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe2415af20 0x7efe240b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:57.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.894+0000 7efe23e00640 1 --2- 172.21.15.175:0/262634256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe240b4630 0x7efe2415c810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009d90 tx=0x7efe1c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f503b419b854f72 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:57.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.894+0000 7efe22000640 1 -- 172.21.15.175:0/262634256 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c0b2070 con 0x7efe240b4630 2024-04-25T09:04:57.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.894+0000 7efe22000640 1 -- 172.21.15.175:0/262634256 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c0a5830 con 0x7efe240b4630 2024-04-25T09:04:57.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.894+0000 7efe22000640 1 -- 172.21.15.175:0/262634256 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c0a5c00 con 0x7efe240b4630 2024-04-25T09:04:57.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.894+0000 7efe2a200640 1 -- 172.21.15.175:0/262634256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe240b4630 msgr2=0x7efe2415c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.894+0000 7efe2a200640 1 --2- 172.21.15.175:0/262634256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe240b4630 0x7efe2415c810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009d90 tx=0x7efe1c01c970 comp rx=0 tx=0).stop 2024-04-25T09:04:57.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.894+0000 7efe2a200640 1 -- 172.21.15.175:0/262634256 shutdown_connections 2024-04-25T09:04:57.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.894+0000 7efe2a200640 1 --2- 172.21.15.175:0/262634256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe240b4630 0x7efe2415c810 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.894+0000 7efe2a200640 1 --2- 172.21.15.175:0/262634256 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe2415af20 0x7efe240b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.894+0000 7efe2a200640 1 -- 172.21.15.175:0/262634256 >> 172.21.15.175:0/262634256 conn(0x7efe2406ac50 msgr2=0x7efe2406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:57.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.894+0000 7efe2a200640 1 -- 172.21.15.175:0/262634256 shutdown_connections 2024-04-25T09:04:57.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.894+0000 7efe2a200640 1 -- 172.21.15.175:0/262634256 wait complete. 2024-04-25T09:04:57.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe2a200640 1 Processor -- start 2024-04-25T09:04:57.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe2a200640 1 -- start start 2024-04-25T09:04:57.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe2a200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe240b4630 0x7efe2414abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe2a200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe240cbe60 0x7efe24154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe2a200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe2415af20 0x7efe240adb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe2a200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2415d970 con 0x7efe2415af20 2024-04-25T09:04:57.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe2a200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2415d7f0 con 0x7efe240b4630 2024-04-25T09:04:57.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe2a200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2415daf0 con 0x7efe240cbe60 2024-04-25T09:04:57.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe23e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe2415af20 0x7efe240adb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe23e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe2415af20 0x7efe240adb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50426/0 (socket says 172.21.15.175:50426) 2024-04-25T09:04:57.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe23e00640 1 -- 172.21.15.175:0/2245963659 learned_addr learned my addr 172.21.15.175:0/2245963659 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:57.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe23400640 1 --2- 172.21.15.175:0/2245963659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe240b4630 0x7efe2414abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe23e00640 1 -- 172.21.15.175:0/2245963659 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe240cbe60 msgr2=0x7efe24154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe22a00640 1 --2- 172.21.15.175:0/2245963659 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe240cbe60 0x7efe24154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe23e00640 1 --2- 172.21.15.175:0/2245963659 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe240cbe60 0x7efe24154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe23e00640 1 -- 172.21.15.175:0/2245963659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe240b4630 msgr2=0x7efe2414abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:57.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe23e00640 1 --2- 172.21.15.175:0/2245963659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe240b4630 0x7efe2414abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:57.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe23e00640 1 -- 172.21.15.175:0/2245963659 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2406b030 con 0x7efe2415af20 2024-04-25T09:04:57.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe23400640 1 --2- 172.21.15.175:0/2245963659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe240b4630 0x7efe2414abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:57.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe22a00640 1 --2- 172.21.15.175:0/2245963659 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe240cbe60 0x7efe24154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:57.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe23e00640 1 --2- 172.21.15.175:0/2245963659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe2415af20 0x7efe240adb70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efe1c0b0040 tx=0x7efe1c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:57.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe1b400640 1 -- 172.21.15.175:0/2245963659 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c0b2050 con 0x7efe2415af20 2024-04-25T09:04:57.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe1b400640 1 -- 172.21.15.175:0/2245963659 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c0be070 con 0x7efe2415af20 2024-04-25T09:04:57.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe1b400640 1 -- 172.21.15.175:0/2245963659 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c009450 con 0x7efe2415af20 2024-04-25T09:04:57.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe2a200640 1 -- 172.21.15.175:0/2245963659 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe24152580 con 0x7efe2415af20 2024-04-25T09:04:57.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe2a200640 1 -- 172.21.15.175:0/2245963659 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe240b40a0 con 0x7efe2415af20 2024-04-25T09:04:57.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.898+0000 7efe2a200640 1 -- 172.21.15.175:0/2245963659 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe24075160 con 0x7efe2415af20 2024-04-25T09:04:57.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.902+0000 7efe1b400640 1 -- 172.21.15.175:0/2245963659 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efe1c0adc40 con 0x7efe2415af20 2024-04-25T09:04:57.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.902+0000 7efe1b400640 1 --2- 172.21.15.175:0/2245963659 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efe04066f60 0x7efe04069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:57.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.902+0000 7efe1b400640 1 -- 172.21.15.175:0/2245963659 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efe1c11ffb0 con 0x7efe2415af20 2024-04-25T09:04:57.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.902+0000 7efe23400640 1 --2- 172.21.15.175:0/2245963659 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efe04066f60 0x7efe04069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:57.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.902+0000 7efe23400640 1 --2- 172.21.15.175:0/2245963659 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efe04066f60 0x7efe04069420 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efe14005890 tx=0x7efe14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:57.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:57.906+0000 7efe1b400640 1 -- 172.21.15.175:0/2245963659 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efe1c016560 con 0x7efe2415af20 2024-04-25T09:04:58.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.114+0000 7efe2a200640 1 -- 172.21.15.175:0/2245963659 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7efe240b4270 con 0x7efe2415af20 2024-04-25T09:04:58.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.118+0000 7efe1b400640 1 -- 172.21.15.175:0/2245963659 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7efe1c0ab340 con 0x7efe2415af20 2024-04-25T09:04:58.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.118+0000 7efe2a200640 1 -- 172.21.15.175:0/2245963659 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efe04066f60 msgr2=0x7efe04069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.118+0000 7efe2a200640 1 --2- 172.21.15.175:0/2245963659 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efe04066f60 0x7efe04069420 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efe14005890 tx=0x7efe14009040 comp rx=0 tx=0).stop 2024-04-25T09:04:58.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.118+0000 7efe2a200640 1 -- 172.21.15.175:0/2245963659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe2415af20 msgr2=0x7efe240adb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.118+0000 7efe2a200640 1 --2- 172.21.15.175:0/2245963659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe2415af20 0x7efe240adb70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7efe1c0b0040 tx=0x7efe1c019710 comp rx=0 tx=0).stop 2024-04-25T09:04:58.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.118+0000 7efe2a200640 1 -- 172.21.15.175:0/2245963659 shutdown_connections 2024-04-25T09:04:58.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.118+0000 7efe2a200640 1 --2- 172.21.15.175:0/2245963659 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efe04066f60 0x7efe04069420 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.118+0000 7efe2a200640 1 --2- 172.21.15.175:0/2245963659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe2415af20 0x7efe240adb70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.118+0000 7efe2a200640 1 --2- 172.21.15.175:0/2245963659 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe240cbe60 0x7efe24154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.118+0000 7efe2a200640 1 --2- 172.21.15.175:0/2245963659 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe240b4630 0x7efe2414abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.118+0000 7efe2a200640 1 -- 172.21.15.175:0/2245963659 >> 172.21.15.175:0/2245963659 conn(0x7efe2406ac50 msgr2=0x7efe24158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:58.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.118+0000 7efe2a200640 1 -- 172.21.15.175:0/2245963659 shutdown_connections 2024-04-25T09:04:58.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.118+0000 7efe2a200640 1 -- 172.21.15.175:0/2245963659 wait complete. 2024-04-25T09:04:58.130 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-25T09:04:58.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.270+0000 7ff3f0a00640 1 Processor -- start 2024-04-25T09:04:58.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.274+0000 7ff3f0a00640 1 -- start start 2024-04-25T09:04:58.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.274+0000 7ff3f0a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3ec145250 0x7ff3ec0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.274+0000 7ff3f0a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff3ec1600a0 0x7ff3ec0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.274+0000 7ff3f0a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3ec0cfd10 con 0x7ff3ec0ce970 2024-04-25T09:04:58.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.274+0000 7ff3f0a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3ec15f650 con 0x7ff3ec1600a0 2024-04-25T09:04:58.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.274+0000 7ff3f0a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec0cfff0 con 0x7ff3ec145250 2024-04-25T09:04:58.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.274+0000 7ff3ea800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff3ec0ce970 0x7ff3ec0cee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:37836/0 (socket says 172.21.15.175:37836) 2024-04-25T09:04:58.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.274+0000 7ff3ea800640 1 -- 172.21.15.175:0/311301119 learned_addr learned my addr 172.21.15.175:0/311301119 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:58.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.274+0000 7ff3e1400640 1 --2- 172.21.15.175:0/311301119 >> v2:172.21.15.177:3300/0 conn(0x7ff3ec1600a0 0x7ff3ec0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.274+0000 7ff3e9e00640 1 --2- 172.21.15.175:0/311301119 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3ec145250 0x7ff3ec0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.274+0000 7ff3e9400640 1 -- 172.21.15.175:0/311301119 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325416464 0 0) 0x7ff3ec0cfd10 con 0x7ff3ec0ce970 2024-04-25T09:04:58.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.274+0000 7ff3e9400640 1 -- 172.21.15.175:0/311301119 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3d0003530 con 0x7ff3ec0ce970 2024-04-25T09:04:58.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.274+0000 7ff3e9e00640 1 -- 172.21.15.175:0/311301119 >> v2:172.21.15.177:3300/0 conn(0x7ff3ec1600a0 msgr2=0x7ff3ec0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:58.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.274+0000 7ff3e9e00640 1 --2- 172.21.15.175:0/311301119 >> v2:172.21.15.177:3300/0 conn(0x7ff3ec1600a0 0x7ff3ec0cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.274+0000 7ff3e9e00640 1 -- 172.21.15.175:0/311301119 >> v1:172.21.15.175:6789/0 conn(0x7ff3ec0ce970 legacy=0x7ff3ec0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.274+0000 7ff3e9e00640 1 -- 172.21.15.175:0/311301119 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ec15f8a0 con 0x7ff3ec145250 2024-04-25T09:04:58.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.274+0000 7ff3e1400640 1 --2- 172.21.15.175:0/311301119 >> v2:172.21.15.177:3300/0 conn(0x7ff3ec1600a0 0x7ff3ec0cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:58.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.278+0000 7ff3e9e00640 1 --2- 172.21.15.175:0/311301119 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3ec145250 0x7ff3ec0cf6b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0097c0 tx=0x7ff3dc01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a19df11f0a0d42ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:58.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.278+0000 7ff3e9400640 1 -- 172.21.15.175:0/311301119 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc0ab600 con 0x7ff3ec145250 2024-04-25T09:04:58.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.278+0000 7ff3e9400640 1 -- 172.21.15.175:0/311301119 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc0b0070 con 0x7ff3ec145250 2024-04-25T09:04:58.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.278+0000 7ff3e9400640 1 -- 172.21.15.175:0/311301119 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc0ab9a0 con 0x7ff3ec145250 2024-04-25T09:04:58.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.278+0000 7ff3f0a00640 1 -- 172.21.15.175:0/311301119 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3ec145250 msgr2=0x7ff3ec0cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.278+0000 7ff3f0a00640 1 --2- 172.21.15.175:0/311301119 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3ec145250 0x7ff3ec0cf6b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0097c0 tx=0x7ff3dc01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.278+0000 7ff3f0a00640 1 -- 172.21.15.175:0/311301119 shutdown_connections 2024-04-25T09:04:58.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.278+0000 7ff3f0a00640 1 --2- 172.21.15.175:0/311301119 >> v2:172.21.15.177:3300/0 conn(0x7ff3ec1600a0 0x7ff3ec0cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.278+0000 7ff3f0a00640 1 --2- 172.21.15.175:0/311301119 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3ec145250 0x7ff3ec0cf6b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.278+0000 7ff3f0a00640 1 -- 172.21.15.175:0/311301119 >> 172.21.15.175:0/311301119 conn(0x7ff3ec06ac50 msgr2=0x7ff3ec06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:58.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.278+0000 7ff3f0a00640 1 -- 172.21.15.175:0/311301119 shutdown_connections 2024-04-25T09:04:58.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.278+0000 7ff3f0a00640 1 -- 172.21.15.175:0/311301119 wait complete. 2024-04-25T09:04:58.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.278+0000 7ff3f0a00640 1 Processor -- start 2024-04-25T09:04:58.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3f0a00640 1 -- start start 2024-04-25T09:04:58.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3f0a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3ec0ce970 0x7ff3ec13e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3f0a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3ec145250 0x7ff3ec15b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3f0a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3ec1600a0 0x7ff3ec0b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3f0a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec160600 con 0x7ff3ec0ce970 2024-04-25T09:04:58.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3f0a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec160480 con 0x7ff3ec1600a0 2024-04-25T09:04:58.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3f0a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec15c870 con 0x7ff3ec145250 2024-04-25T09:04:58.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3e9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3ec0ce970 0x7ff3ec13e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3e9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3ec0ce970 0x7ff3ec13e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50440/0 (socket says 172.21.15.175:50440) 2024-04-25T09:04:58.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3e9e00640 1 -- 172.21.15.175:0/1071165268 learned_addr learned my addr 172.21.15.175:0/1071165268 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:58.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3ea800640 1 --2- 172.21.15.175:0/1071165268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3ec1600a0 0x7ff3ec0b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3e9e00640 1 -- 172.21.15.175:0/1071165268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3ec145250 msgr2=0x7ff3ec15b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3e9e00640 1 --2- 172.21.15.175:0/1071165268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3ec145250 0x7ff3ec15b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3e9e00640 1 -- 172.21.15.175:0/1071165268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3ec1600a0 msgr2=0x7ff3ec0b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3e9e00640 1 --2- 172.21.15.175:0/1071165268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3ec1600a0 0x7ff3ec0b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3e9e00640 1 -- 172.21.15.175:0/1071165268 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ec0afce0 con 0x7ff3ec0ce970 2024-04-25T09:04:58.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3ea800640 1 --2- 172.21.15.175:0/1071165268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3ec1600a0 0x7ff3ec0b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:58.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3e9e00640 1 --2- 172.21.15.175:0/1071165268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3ec0ce970 0x7ff3ec13e520 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0ad040 tx=0x7ff3dc01ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:58.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3e2a00640 1 -- 172.21.15.175:0/1071165268 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc0bf410 con 0x7ff3ec0ce970 2024-04-25T09:04:58.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3e2a00640 1 -- 172.21.15.175:0/1071165268 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc0bf5b0 con 0x7ff3ec0ce970 2024-04-25T09:04:58.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3e2a00640 1 -- 172.21.15.175:0/1071165268 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc0bf960 con 0x7ff3ec0ce970 2024-04-25T09:04:58.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3f0a00640 1 -- 172.21.15.175:0/1071165268 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ec0affc0 con 0x7ff3ec0ce970 2024-04-25T09:04:58.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3f0a00640 1 -- 172.21.15.175:0/1071165268 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ec0b0580 con 0x7ff3ec0ce970 2024-04-25T09:04:58.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.282+0000 7ff3f0a00640 1 -- 172.21.15.175:0/1071165268 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3ec075160 con 0x7ff3ec0ce970 2024-04-25T09:04:58.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.286+0000 7ff3e2a00640 1 -- 172.21.15.175:0/1071165268 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff3dc0bd020 con 0x7ff3ec0ce970 2024-04-25T09:04:58.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.286+0000 7ff3e2a00640 1 --2- 172.21.15.175:0/1071165268 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff3c8066f60 0x7ff3c8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.286+0000 7ff3e2a00640 1 -- 172.21.15.175:0/1071165268 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff3dc11f310 con 0x7ff3ec0ce970 2024-04-25T09:04:58.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.286+0000 7ff3e1400640 1 --2- 172.21.15.175:0/1071165268 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff3c8066f60 0x7ff3c8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.286+0000 7ff3e1400640 1 --2- 172.21.15.175:0/1071165268 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff3c8066f60 0x7ff3c8069420 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4006e90 tx=0x7ff3d4006de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:58.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.290+0000 7ff3e2a00640 1 -- 172.21.15.175:0/1071165268 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff3dc016090 con 0x7ff3ec0ce970 2024-04-25T09:04:58.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.498+0000 7ff3f0a00640 1 -- 172.21.15.175:0/1071165268 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7ff3ec15db00 con 0x7ff3ec0ce970 2024-04-25T09:04:58.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.502+0000 7ff3e2a00640 1 -- 172.21.15.175:0/1071165268 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff3dc0f0700 con 0x7ff3ec0ce970 2024-04-25T09:04:58.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.502+0000 7ff3f0a00640 1 -- 172.21.15.175:0/1071165268 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff3c8066f60 msgr2=0x7ff3c8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.502+0000 7ff3f0a00640 1 --2- 172.21.15.175:0/1071165268 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff3c8066f60 0x7ff3c8069420 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4006e90 tx=0x7ff3d4006de0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.502+0000 7ff3f0a00640 1 -- 172.21.15.175:0/1071165268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3ec0ce970 msgr2=0x7ff3ec13e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.502+0000 7ff3f0a00640 1 --2- 172.21.15.175:0/1071165268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3ec0ce970 0x7ff3ec13e520 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0ad040 tx=0x7ff3dc01ac20 comp rx=0 tx=0).stop 2024-04-25T09:04:58.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.506+0000 7ff3f0a00640 1 -- 172.21.15.175:0/1071165268 shutdown_connections 2024-04-25T09:04:58.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.506+0000 7ff3f0a00640 1 --2- 172.21.15.175:0/1071165268 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff3c8066f60 0x7ff3c8069420 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.506+0000 7ff3f0a00640 1 --2- 172.21.15.175:0/1071165268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3ec1600a0 0x7ff3ec0b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.506+0000 7ff3f0a00640 1 --2- 172.21.15.175:0/1071165268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3ec145250 0x7ff3ec15b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.506+0000 7ff3f0a00640 1 --2- 172.21.15.175:0/1071165268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3ec0ce970 0x7ff3ec13e520 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.506+0000 7ff3f0a00640 1 -- 172.21.15.175:0/1071165268 >> 172.21.15.175:0/1071165268 conn(0x7ff3ec06ac50 msgr2=0x7ff3ec06b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:58.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.506+0000 7ff3f0a00640 1 -- 172.21.15.175:0/1071165268 shutdown_connections 2024-04-25T09:04:58.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.506+0000 7ff3f0a00640 1 -- 172.21.15.175:0/1071165268 wait complete. 2024-04-25T09:04:58.516 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:58.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.658+0000 7f54bea00640 1 Processor -- start 2024-04-25T09:04:58.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.658+0000 7f54bea00640 1 -- start start 2024-04-25T09:04:58.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.662+0000 7f54bea00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f54b815a900 0x7f54b806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.662+0000 7f54bea00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f54b80cf560 0x7f54b80cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.662+0000 7f54bea00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b80cda00 con 0x7f54b80cd520 2024-04-25T09:04:58.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.662+0000 7f54bea00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b815bcf0 con 0x7f54b80cf560 2024-04-25T09:04:58.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.662+0000 7f54bea00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b80cfed0 con 0x7f54b815a900 2024-04-25T09:04:58.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.662+0000 7f54bca00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f54b80cf560 0x7f54b80cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.662+0000 7f54bca00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f54b80cf560 0x7f54b80cf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50456/0 (socket says 172.21.15.175:50456) 2024-04-25T09:04:58.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.662+0000 7f54bca00640 1 -- 172.21.15.175:0/2303365336 learned_addr learned my addr 172.21.15.175:0/2303365336 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:58.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.662+0000 7f54bca00640 1 -- 172.21.15.175:0/2303365336 >> v2:172.21.15.177:3300/0 conn(0x7f54b815a900 msgr2=0x7f54b806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:58.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.662+0000 7f54bca00640 1 --2- 172.21.15.175:0/2303365336 >> v2:172.21.15.177:3300/0 conn(0x7f54b815a900 0x7f54b806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.662+0000 7f54bca00640 1 -- 172.21.15.175:0/2303365336 >> v1:172.21.15.177:6789/0 conn(0x7f54b80cd520 legacy=0x7f54b80ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:58.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.662+0000 7f54bca00640 1 -- 172.21.15.175:0/2303365336 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b80cdce0 con 0x7f54b80cf560 2024-04-25T09:04:58.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54bca00640 1 --2- 172.21.15.175:0/2303365336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54b80cf560 0x7f54b80cf990 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f54b80b4c70 tx=0x7f54b001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32632966ceda63c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:58.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54b6a00640 1 -- 172.21.15.175:0/2303365336 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b00b1070 con 0x7f54b80cf560 2024-04-25T09:04:58.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54b6a00640 1 -- 172.21.15.175:0/2303365336 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b00ac630 con 0x7f54b80cf560 2024-04-25T09:04:58.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54b6a00640 1 -- 172.21.15.175:0/2303365336 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b00a8050 con 0x7f54b80cf560 2024-04-25T09:04:58.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54bea00640 1 -- 172.21.15.175:0/2303365336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54b80cf560 msgr2=0x7f54b80cf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54bea00640 1 --2- 172.21.15.175:0/2303365336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54b80cf560 0x7f54b80cf990 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f54b80b4c70 tx=0x7f54b001c4e0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54bea00640 1 -- 172.21.15.175:0/2303365336 shutdown_connections 2024-04-25T09:04:58.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54bea00640 1 --2- 172.21.15.175:0/2303365336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54b80cf560 0x7f54b80cf990 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54bea00640 1 --2- 172.21.15.175:0/2303365336 >> v2:172.21.15.177:3300/0 conn(0x7f54b815a900 0x7f54b806e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54bea00640 1 -- 172.21.15.175:0/2303365336 >> 172.21.15.175:0/2303365336 conn(0x7f54b8067150 msgr2=0x7f54b806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:58.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54bea00640 1 -- 172.21.15.175:0/2303365336 shutdown_connections 2024-04-25T09:04:58.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54bea00640 1 -- 172.21.15.175:0/2303365336 wait complete. 2024-04-25T09:04:58.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54bea00640 1 Processor -- start 2024-04-25T09:04:58.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54bea00640 1 -- start start 2024-04-25T09:04:58.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54bea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54b80cf560 0x7f54b814e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54bea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54b815a900 0x7f54b814dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54bea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54b81530b0 0x7f54b814ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54bea00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b806d530 con 0x7f54b80cf560 2024-04-25T09:04:58.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54bea00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b806d3b0 con 0x7f54b815a900 2024-04-25T09:04:58.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54bea00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b815c790 con 0x7f54b81530b0 2024-04-25T09:04:58.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.666+0000 7f54b7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54b80cf560 0x7f54b814e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54b7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54b80cf560 0x7f54b814e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50458/0 (socket says 172.21.15.175:50458) 2024-04-25T09:04:58.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54b7e00640 1 -- 172.21.15.175:0/2605694844 learned_addr learned my addr 172.21.15.175:0/2605694844 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:58.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54bca00640 1 --2- 172.21.15.175:0/2605694844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54b81530b0 0x7f54b814ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54b7400640 1 --2- 172.21.15.175:0/2605694844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54b815a900 0x7f54b814dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54b7e00640 1 -- 172.21.15.175:0/2605694844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54b81530b0 msgr2=0x7f54b814ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54b7e00640 1 --2- 172.21.15.175:0/2605694844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54b81530b0 0x7f54b814ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54b7e00640 1 -- 172.21.15.175:0/2605694844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54b815a900 msgr2=0x7f54b814dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54b7e00640 1 --2- 172.21.15.175:0/2605694844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54b815a900 0x7f54b814dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54b7e00640 1 -- 172.21.15.175:0/2605694844 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b81538a0 con 0x7f54b80cf560 2024-04-25T09:04:58.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54b7400640 1 --2- 172.21.15.175:0/2605694844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54b815a900 0x7f54b814dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:58.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54b7e00640 1 --2- 172.21.15.175:0/2605694844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54b80cf560 0x7f54b814e320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f54a800ba80 tx=0x7f54a800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:58.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54afe00640 1 -- 172.21.15.175:0/2605694844 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8019070 con 0x7f54b80cf560 2024-04-25T09:04:58.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54afe00640 1 -- 172.21.15.175:0/2605694844 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a800cbc0 con 0x7f54b80cf560 2024-04-25T09:04:58.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54afe00640 1 -- 172.21.15.175:0/2605694844 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8014440 con 0x7f54b80cf560 2024-04-25T09:04:58.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54bea00640 1 -- 172.21.15.175:0/2605694844 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b8153b80 con 0x7f54b80cf560 2024-04-25T09:04:58.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54bea00640 1 -- 172.21.15.175:0/2605694844 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b8154140 con 0x7f54b80cf560 2024-04-25T09:04:58.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54bea00640 1 -- 172.21.15.175:0/2605694844 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b80afed0 con 0x7f54b80cf560 2024-04-25T09:04:58.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54afe00640 1 -- 172.21.15.175:0/2605694844 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f54a801c070 con 0x7f54b80cf560 2024-04-25T09:04:58.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54afe00640 1 --2- 172.21.15.175:0/2605694844 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5498066f60 0x7f5498069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.670+0000 7f54afe00640 1 -- 172.21.15.175:0/2605694844 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f54a8084a30 con 0x7f54b80cf560 2024-04-25T09:04:58.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.674+0000 7f54b7400640 1 --2- 172.21.15.175:0/2605694844 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5498066f60 0x7f5498069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.674+0000 7f54b7400640 1 --2- 172.21.15.175:0/2605694844 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5498066f60 0x7f5498069420 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f54b8071d40 tx=0x7f54a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:58.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.674+0000 7f54afe00640 1 -- 172.21.15.175:0/2605694844 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f54b80afed0 con 0x7f54b80cf560 2024-04-25T09:04:58.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.830+0000 7f54bea00640 1 -- 172.21.15.175:0/2605694844 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54b8074a60 con 0x7f54b80cf560 2024-04-25T09:04:58.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.834+0000 7f54afe00640 1 -- 172.21.15.175:0/2605694844 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12927 (secure 0 0 0) 0x7f54a80556a0 con 0x7f54b80cf560 2024-04-25T09:04:58.826 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:58.826 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":28,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:04:55.801935+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.834+0000 7f54bea00640 1 -- 172.21.15.175:0/2605694844 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5498066f60 msgr2=0x7f5498069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.834+0000 7f54bea00640 1 --2- 172.21.15.175:0/2605694844 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5498066f60 0x7f5498069420 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f54b8071d40 tx=0x7f54a4009040 comp rx=0 tx=0).stop 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.834+0000 7f54bea00640 1 -- 172.21.15.175:0/2605694844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54b80cf560 msgr2=0x7f54b814e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.834+0000 7f54bea00640 1 --2- 172.21.15.175:0/2605694844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54b80cf560 0x7f54b814e320 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f54a800ba80 tx=0x7f54a800bf40 comp rx=0 tx=0).stop 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.834+0000 7f54bea00640 1 -- 172.21.15.175:0/2605694844 shutdown_connections 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.834+0000 7f54bea00640 1 --2- 172.21.15.175:0/2605694844 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5498066f60 0x7f5498069420 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.834+0000 7f54bea00640 1 --2- 172.21.15.175:0/2605694844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54b81530b0 0x7f54b814ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.834+0000 7f54bea00640 1 --2- 172.21.15.175:0/2605694844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54b815a900 0x7f54b814dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.834+0000 7f54bea00640 1 --2- 172.21.15.175:0/2605694844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54b80cf560 0x7f54b814e320 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.834+0000 7f54bea00640 1 -- 172.21.15.175:0/2605694844 >> 172.21.15.175:0/2605694844 conn(0x7f54b80cd520 msgr2=0x7f54b81599b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.834+0000 7f54bea00640 1 -- 172.21.15.175:0/2605694844 shutdown_connections 2024-04-25T09:04:58.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.834+0000 7f54bea00640 1 -- 172.21.15.175:0/2605694844 wait complete. 2024-04-25T09:04:58.847 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:58.848 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:58.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.994+0000 7f157a000640 1 Processor -- start 2024-04-25T09:04:58.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.994+0000 7f157a000640 1 -- start start 2024-04-25T09:04:58.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.994+0000 7f157a000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f157415a5f0 0x7f157415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.994+0000 7f157a000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f157406b360 0x7f15740cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.994+0000 7f157a000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157415b3f0 con 0x7f157415a9d0 2024-04-25T09:04:58.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.994+0000 7f157a000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15740cd570 con 0x7f157415a5f0 2024-04-25T09:04:58.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.994+0000 7f157a000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15740cd280 con 0x7f157406b360 2024-04-25T09:04:58.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.994+0000 7f1573e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f157415a9d0 0x7f157406ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:37852/0 (socket says 172.21.15.175:37852) 2024-04-25T09:04:58.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.998+0000 7f1573e00640 1 -- 172.21.15.175:0/1208103153 learned_addr learned my addr 172.21.15.175:0/1208103153 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:58.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.998+0000 7f1579600640 1 --2- 172.21.15.175:0/1208103153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f157406b360 0x7f15740cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.998+0000 7f1578c00640 1 --2- 172.21.15.175:0/1208103153 >> v2:172.21.15.177:3300/0 conn(0x7f157415a5f0 0x7f157415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.998+0000 7f1573400640 1 -- 172.21.15.175:0/1208103153 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669235755 0 0) 0x7f157415b3f0 con 0x7f157415a9d0 2024-04-25T09:04:58.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.998+0000 7f1573400640 1 -- 172.21.15.175:0/1208103153 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f155c003530 con 0x7f157415a9d0 2024-04-25T09:04:58.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.998+0000 7f1578c00640 1 -- 172.21.15.175:0/1208103153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f157406b360 msgr2=0x7f15740cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:58.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.998+0000 7f1573400640 1 -- 172.21.15.175:0/1208103153 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1152644926 0 0) 0x7f155c003530 con 0x7f157415a9d0 2024-04-25T09:04:58.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.998+0000 7f1578c00640 1 --2- 172.21.15.175:0/1208103153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f157406b360 0x7f15740cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.998+0000 7f1578c00640 1 -- 172.21.15.175:0/1208103153 >> v1:172.21.15.175:6789/0 conn(0x7f157415a9d0 legacy=0x7f157406ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.998+0000 7f1578c00640 1 -- 172.21.15.175:0/1208103153 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157415b6d0 con 0x7f157415a5f0 2024-04-25T09:04:58.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:58.998+0000 7f1578c00640 1 --2- 172.21.15.175:0/1208103153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f157415a5f0 0x7f157415ec80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f15680097c0 tx=0x7f156801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aed82a67284ad8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:58.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f1573400640 1 -- 172.21.15.175:0/1208103153 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15680b0070 con 0x7f157415a5f0 2024-04-25T09:04:58.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f1573400640 1 -- 172.21.15.175:0/1208103153 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15680ab400 con 0x7f157415a5f0 2024-04-25T09:04:58.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f1573400640 1 -- 172.21.15.175:0/1208103153 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1560001680 con 0x7f157415a5f0 2024-04-25T09:04:58.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f157a000640 1 -- 172.21.15.175:0/1208103153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f157415a5f0 msgr2=0x7f157415ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f157a000640 1 --2- 172.21.15.175:0/1208103153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f157415a5f0 0x7f157415ec80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f15680097c0 tx=0x7f156801c3c0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f157a000640 1 -- 172.21.15.175:0/1208103153 shutdown_connections 2024-04-25T09:04:58.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f157a000640 1 --2- 172.21.15.175:0/1208103153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f157406b360 0x7f15740cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f157a000640 1 --2- 172.21.15.175:0/1208103153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f157415a5f0 0x7f157415ec80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f157a000640 1 -- 172.21.15.175:0/1208103153 >> 172.21.15.175:0/1208103153 conn(0x7f1574067070 msgr2=0x7f15740b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:58.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f157a000640 1 -- 172.21.15.175:0/1208103153 shutdown_connections 2024-04-25T09:04:58.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f157a000640 1 -- 172.21.15.175:0/1208103153 wait complete. 2024-04-25T09:04:58.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f157a000640 1 Processor -- start 2024-04-25T09:04:58.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f157a000640 1 -- start start 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f157a000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f157406b360 0x7f157413e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f157a000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f157415a5f0 0x7f1574158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f157a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f157415a9d0 0x7f1574156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f157a000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15740ceae0 con 0x7f157415a9d0 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f157a000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15740ce960 con 0x7f157406b360 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f157a000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15740cec60 con 0x7f157415a5f0 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f1579600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f157415a9d0 0x7f1574156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f1579600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f157415a9d0 0x7f1574156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50462/0 (socket says 172.21.15.175:50462) 2024-04-25T09:04:58.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f1579600640 1 -- 172.21.15.175:0/884323474 learned_addr learned my addr 172.21.15.175:0/884323474 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:58.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f1573e00640 1 --2- 172.21.15.175:0/884323474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f157415a5f0 0x7f1574158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.002+0000 7f1578c00640 1 --2- 172.21.15.175:0/884323474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f157406b360 0x7f157413e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:58.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.006+0000 7f1579600640 1 -- 172.21.15.175:0/884323474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f157415a5f0 msgr2=0x7f1574158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.006+0000 7f1579600640 1 --2- 172.21.15.175:0/884323474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f157415a5f0 0x7f1574158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.006+0000 7f1579600640 1 -- 172.21.15.175:0/884323474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f157406b360 msgr2=0x7f157413e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:58.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.006+0000 7f1579600640 1 --2- 172.21.15.175:0/884323474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f157406b360 0x7f157413e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:58.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.006+0000 7f1579600640 1 -- 172.21.15.175:0/884323474 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15740b04b0 con 0x7f157415a9d0 2024-04-25T09:04:58.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.006+0000 7f1579600640 1 --2- 172.21.15.175:0/884323474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f157415a9d0 0x7f1574156180 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f156c00ef90 tx=0x7f156c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:58.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.006+0000 7f1570c00640 1 -- 172.21.15.175:0/884323474 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c018020 con 0x7f157415a9d0 2024-04-25T09:04:58.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.006+0000 7f1570c00640 1 -- 172.21.15.175:0/884323474 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156c014480 con 0x7f157415a9d0 2024-04-25T09:04:58.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.006+0000 7f1570c00640 1 -- 172.21.15.175:0/884323474 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c014870 con 0x7f157415a9d0 2024-04-25T09:04:59.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.006+0000 7f157a000640 1 -- 172.21.15.175:0/884323474 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1574156cf0 con 0x7f157415a9d0 2024-04-25T09:04:59.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.006+0000 7f157a000640 1 -- 172.21.15.175:0/884323474 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15741572b0 con 0x7f157415a9d0 2024-04-25T09:04:59.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.006+0000 7f157a000640 1 -- 172.21.15.175:0/884323474 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1574074a60 con 0x7f157415a9d0 2024-04-25T09:04:59.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.006+0000 7f1570c00640 1 -- 172.21.15.175:0/884323474 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f156c01b020 con 0x7f157415a9d0 2024-04-25T09:04:59.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.006+0000 7f1570c00640 1 --2- 172.21.15.175:0/884323474 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1554066f60 0x7f1554069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.006+0000 7f1570c00640 1 -- 172.21.15.175:0/884323474 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f156c085a40 con 0x7f157415a9d0 2024-04-25T09:04:59.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.006+0000 7f1578c00640 1 --2- 172.21.15.175:0/884323474 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1554066f60 0x7f1554069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.010+0000 7f1578c00640 1 --2- 172.21.15.175:0/884323474 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1554066f60 0x7f1554069420 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f15680ad000 tx=0x7f15680a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:59.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.010+0000 7f1570c00640 1 -- 172.21.15.175:0/884323474 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f156c022030 con 0x7f157415a9d0 2024-04-25T09:04:59.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.166+0000 7f157a000640 1 -- 172.21.15.175:0/884323474 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f157406e6b0 con 0x7f157415a9d0 2024-04-25T09:04:59.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.166+0000 7f1570c00640 1 -- 172.21.15.175:0/884323474 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f156c010040 con 0x7f157415a9d0 2024-04-25T09:04:59.160 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:04:59.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.170+0000 7f157a000640 1 -- 172.21.15.175:0/884323474 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1554066f60 msgr2=0x7f1554069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.170+0000 7f157a000640 1 --2- 172.21.15.175:0/884323474 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1554066f60 0x7f1554069420 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f15680ad000 tx=0x7f15680a6000 comp rx=0 tx=0).stop 2024-04-25T09:04:59.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.170+0000 7f157a000640 1 -- 172.21.15.175:0/884323474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f157415a9d0 msgr2=0x7f1574156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.170+0000 7f157a000640 1 --2- 172.21.15.175:0/884323474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f157415a9d0 0x7f1574156180 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f156c00ef90 tx=0x7f156c00c490 comp rx=0 tx=0).stop 2024-04-25T09:04:59.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.170+0000 7f157a000640 1 -- 172.21.15.175:0/884323474 shutdown_connections 2024-04-25T09:04:59.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.170+0000 7f157a000640 1 --2- 172.21.15.175:0/884323474 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1554066f60 0x7f1554069420 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.170+0000 7f157a000640 1 --2- 172.21.15.175:0/884323474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f157415a9d0 0x7f1574156180 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.170+0000 7f157a000640 1 --2- 172.21.15.175:0/884323474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f157415a5f0 0x7f1574158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.170+0000 7f157a000640 1 --2- 172.21.15.175:0/884323474 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f157406b360 0x7f157413e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.170+0000 7f157a000640 1 -- 172.21.15.175:0/884323474 >> 172.21.15.175:0/884323474 conn(0x7f1574067070 msgr2=0x7f157415e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:59.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.170+0000 7f157a000640 1 -- 172.21.15.175:0/884323474 shutdown_connections 2024-04-25T09:04:59.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.170+0000 7f157a000640 1 -- 172.21.15.175:0/884323474 wait complete. 2024-04-25T09:04:59.181 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:04:59.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.322+0000 7fa477c00640 1 Processor -- start 2024-04-25T09:04:59.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.322+0000 7fa477c00640 1 -- start start 2024-04-25T09:04:59.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.326+0000 7fa477c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa4700b40a0 0x7fa4700b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.326+0000 7fa477c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4700b2f60 0x7fa4700b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.326+0000 7fa477c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4700b3cc0 con 0x7fa47006d260 2024-04-25T09:04:59.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.326+0000 7fa477c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4700cd630 con 0x7fa4700b40a0 2024-04-25T09:04:59.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.326+0000 7fa477c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700b49c0 con 0x7fa4700b2f60 2024-04-25T09:04:59.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.326+0000 7fa475c00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa47006d260 0x7fa47006d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:57436/0 (socket says 172.21.15.175:57436) 2024-04-25T09:04:59.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.326+0000 7fa475c00640 1 -- 172.21.15.175:0/215528077 learned_addr learned my addr 172.21.15.175:0/215528077 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:59.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.326+0000 7fa475200640 1 --2- 172.21.15.175:0/215528077 >> v2:172.21.15.177:3300/0 conn(0x7fa4700b40a0 0x7fa4700b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.326+0000 7fa46fe00640 1 --2- 172.21.15.175:0/215528077 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4700b2f60 0x7fa4700b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.326+0000 7fa46f400640 1 -- 172.21.15.175:0/215528077 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1367289315 0 0) 0x7fa468001120 con 0x7fa47006d260 2024-04-25T09:04:59.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.326+0000 7fa46f400640 1 -- 172.21.15.175:0/215528077 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa454003530 con 0x7fa47006d260 2024-04-25T09:04:59.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.326+0000 7fa475200640 1 -- 172.21.15.175:0/215528077 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4700b2f60 msgr2=0x7fa4700b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:59.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.326+0000 7fa475200640 1 --2- 172.21.15.175:0/215528077 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4700b2f60 0x7fa4700b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.326+0000 7fa475200640 1 -- 172.21.15.175:0/215528077 >> v1:172.21.15.175:6789/0 conn(0x7fa47006d260 legacy=0x7fa47006d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.326+0000 7fa475200640 1 -- 172.21.15.175:0/215528077 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4700b39e0 con 0x7fa4700b40a0 2024-04-25T09:04:59.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.330+0000 7fa475200640 1 --2- 172.21.15.175:0/215528077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4700b40a0 0x7fa4700b4480 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa460009d90 tx=0x7fa46001c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6197e7cbf187cfac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:59.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.330+0000 7fa46f400640 1 -- 172.21.15.175:0/215528077 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600b2070 con 0x7fa4700b40a0 2024-04-25T09:04:59.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.330+0000 7fa46f400640 1 -- 172.21.15.175:0/215528077 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4600a5a00 con 0x7fa4700b40a0 2024-04-25T09:04:59.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.330+0000 7fa46f400640 1 -- 172.21.15.175:0/215528077 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600a5dd0 con 0x7fa4700b40a0 2024-04-25T09:04:59.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.330+0000 7fa477c00640 1 -- 172.21.15.175:0/215528077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4700b40a0 msgr2=0x7fa4700b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.330+0000 7fa477c00640 1 --2- 172.21.15.175:0/215528077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4700b40a0 0x7fa4700b4480 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa460009d90 tx=0x7fa46001c940 comp rx=0 tx=0).stop 2024-04-25T09:04:59.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.330+0000 7fa477c00640 1 -- 172.21.15.175:0/215528077 shutdown_connections 2024-04-25T09:04:59.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.330+0000 7fa477c00640 1 --2- 172.21.15.175:0/215528077 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4700b2f60 0x7fa4700b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.330+0000 7fa477c00640 1 --2- 172.21.15.175:0/215528077 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4700b40a0 0x7fa4700b4480 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.330+0000 7fa477c00640 1 -- 172.21.15.175:0/215528077 >> 172.21.15.175:0/215528077 conn(0x7fa470067150 msgr2=0x7fa47006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:59.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.330+0000 7fa477c00640 1 -- 172.21.15.175:0/215528077 shutdown_connections 2024-04-25T09:04:59.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.330+0000 7fa477c00640 1 -- 172.21.15.175:0/215528077 wait complete. 2024-04-25T09:04:59.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.330+0000 7fa477c00640 1 Processor -- start 2024-04-25T09:04:59.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.330+0000 7fa477c00640 1 -- start start 2024-04-25T09:04:59.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa477c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4700b2f60 0x7fa47015d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa477c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4700b40a0 0x7fa47013a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa477c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa47014d3c0 0x7fa470071240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa477c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700cc090 con 0x7fa4700b2f60 2024-04-25T09:04:59.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa477c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700cbf10 con 0x7fa4700b40a0 2024-04-25T09:04:59.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa477c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47015ab00 con 0x7fa47014d3c0 2024-04-25T09:04:59.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa475200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4700b2f60 0x7fa47015d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa475200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4700b2f60 0x7fa47015d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60970/0 (socket says 172.21.15.175:60970) 2024-04-25T09:04:59.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa475200640 1 -- 172.21.15.175:0/2809028039 learned_addr learned my addr 172.21.15.175:0/2809028039 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:59.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa46fe00640 1 --2- 172.21.15.175:0/2809028039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4700b40a0 0x7fa47013a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa475c00640 1 --2- 172.21.15.175:0/2809028039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa47014d3c0 0x7fa470071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa475200640 1 -- 172.21.15.175:0/2809028039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa47014d3c0 msgr2=0x7fa470071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa475200640 1 --2- 172.21.15.175:0/2809028039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa47014d3c0 0x7fa470071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa475200640 1 -- 172.21.15.175:0/2809028039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4700b40a0 msgr2=0x7fa47013a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa475200640 1 --2- 172.21.15.175:0/2809028039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4700b40a0 0x7fa47013a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa475200640 1 -- 172.21.15.175:0/2809028039 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47013af30 con 0x7fa4700b2f60 2024-04-25T09:04:59.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa46fe00640 1 --2- 172.21.15.175:0/2809028039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4700b40a0 0x7fa47013a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:59.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa475c00640 1 --2- 172.21.15.175:0/2809028039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa47014d3c0 0x7fa470071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:59.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa475200640 1 --2- 172.21.15.175:0/2809028039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4700b2f60 0x7fa47015d920 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa4600b0040 tx=0x7fa4600196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:59.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa46cc00640 1 -- 172.21.15.175:0/2809028039 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600b2040 con 0x7fa4700b2f60 2024-04-25T09:04:59.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa46cc00640 1 -- 172.21.15.175:0/2809028039 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4600bf070 con 0x7fa4700b2f60 2024-04-25T09:04:59.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa46cc00640 1 -- 172.21.15.175:0/2809028039 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600b8890 con 0x7fa4700b2f60 2024-04-25T09:04:59.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa477c00640 1 -- 172.21.15.175:0/2809028039 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa47013b210 con 0x7fa4700b2f60 2024-04-25T09:04:59.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa477c00640 1 -- 172.21.15.175:0/2809028039 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4701388f0 con 0x7fa4700b2f60 2024-04-25T09:04:59.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa477c00640 1 -- 172.21.15.175:0/2809028039 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa470074a60 con 0x7fa4700b2f60 2024-04-25T09:04:59.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.334+0000 7fa46cc00640 1 -- 172.21.15.175:0/2809028039 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa4600b8a30 con 0x7fa4700b2f60 2024-04-25T09:04:59.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.338+0000 7fa46cc00640 1 --2- 172.21.15.175:0/2809028039 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa450066f60 0x7fa450069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.338+0000 7fa46cc00640 1 -- 172.21.15.175:0/2809028039 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa46011feb0 con 0x7fa4700b2f60 2024-04-25T09:04:59.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.338+0000 7fa46fe00640 1 --2- 172.21.15.175:0/2809028039 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa450066f60 0x7fa450069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.338+0000 7fa46fe00640 1 --2- 172.21.15.175:0/2809028039 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa450066f60 0x7fa450069420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa4700ad990 tx=0x7fa45c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:59.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.342+0000 7fa46cc00640 1 -- 172.21.15.175:0/2809028039 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa460016560 con 0x7fa4700b2f60 2024-04-25T09:04:59.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.498+0000 7fa477c00640 1 -- 172.21.15.175:0/2809028039 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa470152fd0 con 0x7fa4700b2f60 2024-04-25T09:04:59.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.498+0000 7fa46cc00640 1 -- 172.21.15.175:0/2809028039 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa4600f1170 con 0x7fa4700b2f60 2024-04-25T09:04:59.490 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:04:59.490 INFO:teuthology.orchestra.run.smithi175.stdout:[ 2024-04-25T09:04:59.491 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:04:59.491 INFO:teuthology.orchestra.run.smithi175.stdout: "poolnum": 1, 2024-04-25T09:04:59.491 INFO:teuthology.orchestra.run.smithi175.stdout: "poolname": ".mgr" 2024-04-25T09:04:59.491 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:04:59.491 INFO:teuthology.orchestra.run.smithi175.stdout:] 2024-04-25T09:04:59.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.498+0000 7fa477c00640 1 -- 172.21.15.175:0/2809028039 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa450066f60 msgr2=0x7fa450069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.498+0000 7fa477c00640 1 --2- 172.21.15.175:0/2809028039 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa450066f60 0x7fa450069420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa4700ad990 tx=0x7fa45c008040 comp rx=0 tx=0).stop 2024-04-25T09:04:59.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.498+0000 7fa477c00640 1 -- 172.21.15.175:0/2809028039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4700b2f60 msgr2=0x7fa47015d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.498+0000 7fa477c00640 1 --2- 172.21.15.175:0/2809028039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4700b2f60 0x7fa47015d920 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa4600b0040 tx=0x7fa4600196e0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.498+0000 7fa477c00640 1 -- 172.21.15.175:0/2809028039 shutdown_connections 2024-04-25T09:04:59.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.498+0000 7fa477c00640 1 --2- 172.21.15.175:0/2809028039 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa450066f60 0x7fa450069420 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.498+0000 7fa477c00640 1 --2- 172.21.15.175:0/2809028039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa47014d3c0 0x7fa470071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.498+0000 7fa477c00640 1 --2- 172.21.15.175:0/2809028039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4700b40a0 0x7fa47013a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.498+0000 7fa477c00640 1 --2- 172.21.15.175:0/2809028039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4700b2f60 0x7fa47015d920 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.498+0000 7fa477c00640 1 -- 172.21.15.175:0/2809028039 >> 172.21.15.175:0/2809028039 conn(0x7fa47006d260 msgr2=0x7fa47014ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:59.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.498+0000 7fa477c00640 1 -- 172.21.15.175:0/2809028039 shutdown_connections 2024-04-25T09:04:59.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.498+0000 7fa477c00640 1 -- 172.21.15.175:0/2809028039 wait complete. 2024-04-25T09:04:59.512 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:04:59.512 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:04:59.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.658+0000 7ff063200640 1 Processor -- start 2024-04-25T09:04:59.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.658+0000 7ff063200640 1 -- start start 2024-04-25T09:04:59.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.658+0000 7ff063200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff05c0b4970 0x7ff05c165660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.658+0000 7ff063200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c15b880 con 0x7ff05c0b2700 2024-04-25T09:04:59.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.658+0000 7ff063200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c15bb60 con 0x7ff05c0aebd0 2024-04-25T09:04:59.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.658+0000 7ff063200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c15be40 con 0x7ff05c0b4970 2024-04-25T09:04:59.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.658+0000 7ff053400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff05c0b2700 0x7ff05c0b4260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:57442/0 (socket says 172.21.15.175:57442) 2024-04-25T09:04:59.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.658+0000 7ff053400640 1 -- 172.21.15.175:0/2163492884 learned_addr learned my addr 172.21.15.175:0/2163492884 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:04:59.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.658+0000 7ff061200640 1 --2- 172.21.15.175:0/2163492884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff05c0b4970 0x7ff05c165660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff05b400640 1 -- 172.21.15.175:0/2163492884 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686420878 0 0) 0x7ff05c15b880 con 0x7ff05c0b2700 2024-04-25T09:04:59.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff05b400640 1 -- 172.21.15.175:0/2163492884 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff040005740 con 0x7ff05c0b2700 2024-04-25T09:04:59.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff05b400640 1 -- 172.21.15.175:0/2163492884 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650953283 0 0) 0x7ff05c15bb60 con 0x7ff05c0aebd0 2024-04-25T09:04:59.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff05b400640 1 -- 172.21.15.175:0/2163492884 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff05c15b880 con 0x7ff05c0aebd0 2024-04-25T09:04:59.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff05b400640 1 -- 172.21.15.175:0/2163492884 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2508704894 0 0) 0x7ff040005740 con 0x7ff05c0b2700 2024-04-25T09:04:59.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff05b400640 1 -- 172.21.15.175:0/2163492884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff05c0b4970 msgr2=0x7ff05c165660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:59.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff05b400640 1 --2- 172.21.15.175:0/2163492884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff05c0b4970 0x7ff05c165660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff05b400640 1 -- 172.21.15.175:0/2163492884 >> v1:172.21.15.177:6789/0 conn(0x7ff05c0aebd0 legacy=0x7ff05c15b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff05b400640 1 -- 172.21.15.175:0/2163492884 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c15c400 con 0x7ff05c0b2700 2024-04-25T09:04:59.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff05b400640 1 -- 172.21.15.175:0/2163492884 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7ff044001680 con 0x7ff05c0b2700 2024-04-25T09:04:59.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff05b400640 1 -- 172.21.15.175:0/2163492884 >> v1:172.21.15.175:6789/0 conn(0x7ff05c0b2700 legacy=0x7ff05c0b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff05b400640 1 --2- 172.21.15.175:0/2163492884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff05c0b4970 0x7ff040005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff05b400640 1 --2- 172.21.15.175:0/2163492884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0400062f0 0x7ff040006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff05b400640 1 --2- 172.21.15.175:0/2163492884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff040006f60 0x7ff0400073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff05b400640 1 -- 172.21.15.175:0/2163492884 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c15be40 con 0x7ff0400062f0 2024-04-25T09:04:59.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff05b400640 1 -- 172.21.15.175:0/2163492884 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04000dcc0 con 0x7ff040006f60 2024-04-25T09:04:59.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff05b400640 1 -- 172.21.15.175:0/2163492884 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04000dec0 con 0x7ff05c0b4970 2024-04-25T09:04:59.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff053400640 1 --2- 172.21.15.175:0/2163492884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0400062f0 0x7ff040006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff05be00640 1 --2- 172.21.15.175:0/2163492884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff05c0b4970 0x7ff040005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff061200640 1 --2- 172.21.15.175:0/2163492884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff040006f60 0x7ff0400073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff053400640 1 -- 172.21.15.175:0/2163492884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff05c0b4970 msgr2=0x7ff040005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:59.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff053400640 1 --2- 172.21.15.175:0/2163492884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff05c0b4970 0x7ff040005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff053400640 1 -- 172.21.15.175:0/2163492884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff040006f60 msgr2=0x7ff0400073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:59.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff053400640 1 --2- 172.21.15.175:0/2163492884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff040006f60 0x7ff0400073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff053400640 1 -- 172.21.15.175:0/2163492884 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff040005740 con 0x7ff0400062f0 2024-04-25T09:04:59.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.662+0000 7ff053400640 1 --2- 172.21.15.175:0/2163492884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0400062f0 0x7ff040006a20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff04400c190 tx=0x7ff04401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9d34606140e233 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:59.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff05b400640 1 -- 172.21.15.175:0/2163492884 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044007cb0 con 0x7ff0400062f0 2024-04-25T09:04:59.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff05b400640 1 -- 172.21.15.175:0/2163492884 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0440a9020 con 0x7ff0400062f0 2024-04-25T09:04:59.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff05b400640 1 -- 172.21.15.175:0/2163492884 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0440a5b20 con 0x7ff0400062f0 2024-04-25T09:04:59.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff063200640 1 -- 172.21.15.175:0/2163492884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0400062f0 msgr2=0x7ff040006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff063200640 1 --2- 172.21.15.175:0/2163492884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0400062f0 0x7ff040006a20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff04400c190 tx=0x7ff04401cc00 comp rx=0 tx=0).stop 2024-04-25T09:04:59.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff061200640 1 -- 172.21.15.175:0/2163492884 reap_dead start 2024-04-25T09:04:59.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff063200640 1 -- 172.21.15.175:0/2163492884 shutdown_connections 2024-04-25T09:04:59.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff063200640 1 -- 172.21.15.175:0/2163492884 >> 172.21.15.175:0/2163492884 conn(0x7ff05c06ac50 msgr2=0x7ff05c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:59.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff063200640 1 -- 172.21.15.175:0/2163492884 shutdown_connections 2024-04-25T09:04:59.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff063200640 1 -- 172.21.15.175:0/2163492884 wait complete. 2024-04-25T09:04:59.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff063200640 1 Processor -- start 2024-04-25T09:04:59.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff063200640 1 -- start start 2024-04-25T09:04:59.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff063200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0400062f0 0x7ff05c14a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff063200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff05c0cf640 0x7ff05c0cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff063200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff05c0b1140 0x7ff05c0b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff063200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c15d930 con 0x7ff0400062f0 2024-04-25T09:04:59.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff063200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c0af1c0 con 0x7ff05c0b1140 2024-04-25T09:04:59.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff063200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c15dab0 con 0x7ff05c0cf640 2024-04-25T09:04:59.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff05be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0400062f0 0x7ff05c14a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff05be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0400062f0 0x7ff05c14a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60980/0 (socket says 172.21.15.175:60980) 2024-04-25T09:04:59.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff05be00640 1 -- 172.21.15.175:0/2726054198 learned_addr learned my addr 172.21.15.175:0/2726054198 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:04:59.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff053400640 1 --2- 172.21.15.175:0/2726054198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff05c0cf640 0x7ff05c0cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.666+0000 7ff061200640 1 --2- 172.21.15.175:0/2726054198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff05c0b1140 0x7ff05c0b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.670+0000 7ff05be00640 1 -- 172.21.15.175:0/2726054198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff05c0cf640 msgr2=0x7ff05c0cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.670+0000 7ff05be00640 1 --2- 172.21.15.175:0/2726054198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff05c0cf640 0x7ff05c0cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.670+0000 7ff05be00640 1 -- 172.21.15.175:0/2726054198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff05c0b1140 msgr2=0x7ff05c0b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:59.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.670+0000 7ff05be00640 1 --2- 172.21.15.175:0/2726054198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff05c0b1140 0x7ff05c0b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:59.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.670+0000 7ff05be00640 1 -- 172.21.15.175:0/2726054198 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c0d0530 con 0x7ff0400062f0 2024-04-25T09:04:59.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.670+0000 7ff053400640 1 --2- 172.21.15.175:0/2726054198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff05c0cf640 0x7ff05c0cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:59.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.670+0000 7ff061200640 1 --2- 172.21.15.175:0/2726054198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff05c0b1140 0x7ff05c0b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:59.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.670+0000 7ff05be00640 1 --2- 172.21.15.175:0/2726054198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0400062f0 0x7ff05c14a890 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff04c005630 tx=0x7ff04c012d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:59.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.670+0000 7ff058c00640 1 -- 172.21.15.175:0/2726054198 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c010ba0 con 0x7ff0400062f0 2024-04-25T09:04:59.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.670+0000 7ff058c00640 1 -- 172.21.15.175:0/2726054198 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c01b070 con 0x7ff0400062f0 2024-04-25T09:04:59.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.670+0000 7ff063200640 1 -- 172.21.15.175:0/2726054198 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05c0b1b00 con 0x7ff0400062f0 2024-04-25T09:04:59.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.670+0000 7ff058c00640 1 -- 172.21.15.175:0/2726054198 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c016480 con 0x7ff0400062f0 2024-04-25T09:04:59.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.670+0000 7ff063200640 1 -- 172.21.15.175:0/2726054198 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05c1f2cb0 con 0x7ff0400062f0 2024-04-25T09:04:59.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.670+0000 7ff063200640 1 -- 172.21.15.175:0/2726054198 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05c075160 con 0x7ff0400062f0 2024-04-25T09:04:59.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.670+0000 7ff058c00640 1 -- 172.21.15.175:0/2726054198 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff04c016620 con 0x7ff0400062f0 2024-04-25T09:04:59.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.670+0000 7ff058c00640 1 --2- 172.21.15.175:0/2726054198 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff038066f60 0x7ff038069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:59.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.670+0000 7ff058c00640 1 -- 172.21.15.175:0/2726054198 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff04c088580 con 0x7ff0400062f0 2024-04-25T09:04:59.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.670+0000 7ff053400640 1 --2- 172.21.15.175:0/2726054198 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff038066f60 0x7ff038069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:59.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.674+0000 7ff053400640 1 --2- 172.21.15.175:0/2726054198 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff038066f60 0x7ff038069420 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff0440aa000 tx=0x7ff0440019d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:59.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.674+0000 7ff058c00640 1 -- 172.21.15.175:0/2726054198 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff04c059840 con 0x7ff0400062f0 2024-04-25T09:04:59.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:04:59.830+0000 7ff063200640 1 -- 172.21.15.175:0/2726054198 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff05c0cbb70 con 0x7ff0400062f0 2024-04-25T09:05:00.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.814+0000 7ff058c00640 1 -- 172.21.15.175:0/2726054198 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff04c05f030 con 0x7ff0400062f0 2024-04-25T09:05:00.807 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_metadata' created 2024-04-25T09:05:00.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.818+0000 7ff063200640 1 -- 172.21.15.175:0/2726054198 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff038066f60 msgr2=0x7ff038069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:00.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.818+0000 7ff063200640 1 --2- 172.21.15.175:0/2726054198 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff038066f60 0x7ff038069420 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff0440aa000 tx=0x7ff0440019d0 comp rx=0 tx=0).stop 2024-04-25T09:05:00.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.818+0000 7ff063200640 1 -- 172.21.15.175:0/2726054198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0400062f0 msgr2=0x7ff05c14a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:00.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.818+0000 7ff063200640 1 --2- 172.21.15.175:0/2726054198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0400062f0 0x7ff05c14a890 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff04c005630 tx=0x7ff04c012d00 comp rx=0 tx=0).stop 2024-04-25T09:05:00.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.818+0000 7ff063200640 1 -- 172.21.15.175:0/2726054198 shutdown_connections 2024-04-25T09:05:00.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.818+0000 7ff063200640 1 --2- 172.21.15.175:0/2726054198 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff038066f60 0x7ff038069420 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:00.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.818+0000 7ff063200640 1 --2- 172.21.15.175:0/2726054198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff05c0b1140 0x7ff05c0b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:00.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.818+0000 7ff063200640 1 --2- 172.21.15.175:0/2726054198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff05c0cf640 0x7ff05c0cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:00.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.818+0000 7ff063200640 1 --2- 172.21.15.175:0/2726054198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0400062f0 0x7ff05c14a890 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:00.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.818+0000 7ff063200640 1 -- 172.21.15.175:0/2726054198 >> 172.21.15.175:0/2726054198 conn(0x7ff05c06ac50 msgr2=0x7ff05c158b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:00.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.818+0000 7ff063200640 1 -- 172.21.15.175:0/2726054198 shutdown_connections 2024-04-25T09:05:00.811 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.818+0000 7ff063200640 1 -- 172.21.15.175:0/2726054198 wait complete. 2024-04-25T09:05:00.834 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:05:00.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.986+0000 7f87f3200640 1 Processor -- start 2024-04-25T09:05:00.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.986+0000 7f87f3200640 1 -- start start 2024-04-25T09:05:00.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.986+0000 7f87f3200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f87ec15eef0 0x7f87ec06ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:00.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.986+0000 7f87f3200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87ec06b190 0x7f87ec0cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:00.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.986+0000 7f87f3200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ec151c90 con 0x7f87ec1518b0 2024-04-25T09:05:00.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.986+0000 7f87f3200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ec06b600 con 0x7f87ec15eef0 2024-04-25T09:05:00.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.986+0000 7f87f3200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec15ad60 con 0x7f87ec06b190 2024-04-25T09:05:00.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.986+0000 7f87eb400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f87ec15eef0 0x7f87ec06ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:00.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.986+0000 7f87ebe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f87ec1518b0 0x7f87ec06efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:57450/0 (socket says 172.21.15.175:57450) 2024-04-25T09:05:00.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.986+0000 7f87ebe00640 1 -- 172.21.15.175:0/1426267606 learned_addr learned my addr 172.21.15.175:0/1426267606 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:00.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.990+0000 7f87f1200640 1 --2- 172.21.15.175:0/1426267606 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87ec06b190 0x7f87ec0cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:00.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.990+0000 7f87eb400640 1 -- 172.21.15.175:0/1426267606 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87ec06b190 msgr2=0x7f87ec0cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:00.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.990+0000 7f87eb400640 1 --2- 172.21.15.175:0/1426267606 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87ec06b190 0x7f87ec0cdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:00.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.990+0000 7f87eb400640 1 -- 172.21.15.175:0/1426267606 >> v1:172.21.15.175:6789/0 conn(0x7f87ec1518b0 legacy=0x7f87ec06efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:00.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.990+0000 7f87eb400640 1 -- 172.21.15.175:0/1426267606 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec15b020 con 0x7f87ec15eef0 2024-04-25T09:05:00.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.990+0000 7f87eaa00640 1 -- 172.21.15.175:0/1426267606 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254316288 0 0) 0x7f87ec151c90 con 0x7f87ec1518b0 2024-04-25T09:05:00.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.990+0000 7f87eb400640 1 --2- 172.21.15.175:0/1426267606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87ec15eef0 0x7f87ec06ac50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f87d80097c0 tx=0x7f87d801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d340b46b2d1494 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:00.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.990+0000 7f87eaa00640 1 -- 172.21.15.175:0/1426267606 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d80b1070 con 0x7f87ec15eef0 2024-04-25T09:05:00.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.990+0000 7f87eaa00640 1 -- 172.21.15.175:0/1426267606 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d80a8050 con 0x7f87ec15eef0 2024-04-25T09:05:00.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.990+0000 7f87eaa00640 1 -- 172.21.15.175:0/1426267606 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d80ac860 con 0x7f87ec15eef0 2024-04-25T09:05:00.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.990+0000 7f87f3200640 1 -- 172.21.15.175:0/1426267606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87ec15eef0 msgr2=0x7f87ec06ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:00.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.990+0000 7f87f3200640 1 --2- 172.21.15.175:0/1426267606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87ec15eef0 0x7f87ec06ac50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f87d80097c0 tx=0x7f87d801c3e0 comp rx=0 tx=0).stop 2024-04-25T09:05:00.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.990+0000 7f87f3200640 1 -- 172.21.15.175:0/1426267606 shutdown_connections 2024-04-25T09:05:00.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.990+0000 7f87f3200640 1 --2- 172.21.15.175:0/1426267606 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87ec06b190 0x7f87ec0cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:00.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.990+0000 7f87f3200640 1 --2- 172.21.15.175:0/1426267606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87ec15eef0 0x7f87ec06ac50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:00.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.990+0000 7f87f3200640 1 -- 172.21.15.175:0/1426267606 >> 172.21.15.175:0/1426267606 conn(0x7f87ec0b1830 msgr2=0x7f87ec0b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:00.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f3200640 1 -- 172.21.15.175:0/1426267606 shutdown_connections 2024-04-25T09:05:00.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f3200640 1 -- 172.21.15.175:0/1426267606 wait complete. 2024-04-25T09:05:00.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f3200640 1 Processor -- start 2024-04-25T09:05:00.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f3200640 1 -- start start 2024-04-25T09:05:00.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f3200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87ec06b190 0x7f87ec15d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:00.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f3200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87ec1518b0 0x7f87ec1497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:00.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f3200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87ec15eef0 0x7f87ec14b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:00.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f3200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec0ce990 con 0x7f87ec15eef0 2024-04-25T09:05:00.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f3200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec0ce810 con 0x7f87ec06b190 2024-04-25T09:05:00.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f3200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec0ceb10 con 0x7f87ec1518b0 2024-04-25T09:05:00.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f1200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87ec15eef0 0x7f87ec14b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:00.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f1200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87ec15eef0 0x7f87ec14b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32774/0 (socket says 172.21.15.175:32774) 2024-04-25T09:05:00.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f1200640 1 -- 172.21.15.175:0/456046895 learned_addr learned my addr 172.21.15.175:0/456046895 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:00.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87ebe00640 1 --2- 172.21.15.175:0/456046895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87ec06b190 0x7f87ec15d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:00.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87eb400640 1 --2- 172.21.15.175:0/456046895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87ec1518b0 0x7f87ec1497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:00.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f1200640 1 -- 172.21.15.175:0/456046895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87ec1518b0 msgr2=0x7f87ec1497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:00.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f1200640 1 --2- 172.21.15.175:0/456046895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87ec1518b0 0x7f87ec1497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:00.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f1200640 1 -- 172.21.15.175:0/456046895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87ec06b190 msgr2=0x7f87ec15d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:00.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f1200640 1 --2- 172.21.15.175:0/456046895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87ec06b190 0x7f87ec15d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:00.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f1200640 1 -- 172.21.15.175:0/456046895 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec150890 con 0x7f87ec15eef0 2024-04-25T09:05:00.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f1200640 1 --2- 172.21.15.175:0/456046895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87ec15eef0 0x7f87ec14b890 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f87e4007e40 tx=0x7f87e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:00.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87e3e00640 1 -- 172.21.15.175:0/456046895 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4014620 con 0x7f87ec15eef0 2024-04-25T09:05:00.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87e3e00640 1 -- 172.21.15.175:0/456046895 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e4019070 con 0x7f87ec15eef0 2024-04-25T09:05:00.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87e3e00640 1 -- 172.21.15.175:0/456046895 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4014a20 con 0x7f87ec15eef0 2024-04-25T09:05:00.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.994+0000 7f87f3200640 1 -- 172.21.15.175:0/456046895 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ec14fff0 con 0x7f87ec15eef0 2024-04-25T09:05:00.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.998+0000 7f87f3200640 1 -- 172.21.15.175:0/456046895 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ec1505b0 con 0x7f87ec15eef0 2024-04-25T09:05:00.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.998+0000 7f87f3200640 1 -- 172.21.15.175:0/456046895 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ec074a60 con 0x7f87ec15eef0 2024-04-25T09:05:00.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.998+0000 7f87e3e00640 1 -- 172.21.15.175:0/456046895 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f87e4014bc0 con 0x7f87ec15eef0 2024-04-25T09:05:00.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.998+0000 7f87e3e00640 1 --2- 172.21.15.175:0/456046895 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f87cc066f60 0x7f87cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:00.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.998+0000 7f87e3e00640 1 -- 172.21.15.175:0/456046895 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f87e4085660 con 0x7f87ec15eef0 2024-04-25T09:05:00.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.998+0000 7f87ebe00640 1 --2- 172.21.15.175:0/456046895 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f87cc066f60 0x7f87cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:00.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:00.998+0000 7f87ebe00640 1 --2- 172.21.15.175:0/456046895 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f87cc066f60 0x7f87cc069420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f87dc007fd0 tx=0x7f87dc007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:00.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.002+0000 7f87e3e00640 1 -- 172.21.15.175:0/456046895 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f87e4056160 con 0x7f87ec15eef0 2024-04-25T09:05:01.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.158+0000 7f87f3200640 1 -- 172.21.15.175:0/456046895 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f87ec0b4e10 con 0x7f87ec15eef0 2024-04-25T09:05:01.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.822+0000 7f87e3e00640 1 -- 172.21.15.175:0/456046895 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f87e405a200 con 0x7f87ec15eef0 2024-04-25T09:05:01.814 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_data' created 2024-04-25T09:05:01.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.822+0000 7f87f3200640 1 -- 172.21.15.175:0/456046895 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f87cc066f60 msgr2=0x7f87cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:01.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.822+0000 7f87f3200640 1 --2- 172.21.15.175:0/456046895 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f87cc066f60 0x7f87cc069420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f87dc007fd0 tx=0x7f87dc007d60 comp rx=0 tx=0).stop 2024-04-25T09:05:01.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.822+0000 7f87f3200640 1 -- 172.21.15.175:0/456046895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87ec15eef0 msgr2=0x7f87ec14b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:01.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.822+0000 7f87f3200640 1 --2- 172.21.15.175:0/456046895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87ec15eef0 0x7f87ec14b890 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f87e4007e40 tx=0x7f87e400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.822+0000 7f87f3200640 1 -- 172.21.15.175:0/456046895 shutdown_connections 2024-04-25T09:05:01.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.822+0000 7f87f3200640 1 --2- 172.21.15.175:0/456046895 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f87cc066f60 0x7f87cc069420 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.822+0000 7f87f3200640 1 --2- 172.21.15.175:0/456046895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87ec15eef0 0x7f87ec14b890 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.822+0000 7f87f3200640 1 --2- 172.21.15.175:0/456046895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87ec1518b0 0x7f87ec1497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.822+0000 7f87f3200640 1 --2- 172.21.15.175:0/456046895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87ec06b190 0x7f87ec15d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.822+0000 7f87f3200640 1 -- 172.21.15.175:0/456046895 >> 172.21.15.175:0/456046895 conn(0x7f87ec0b1830 msgr2=0x7f87ec164430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:01.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.822+0000 7f87f3200640 1 -- 172.21.15.175:0/456046895 shutdown_connections 2024-04-25T09:05:01.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.822+0000 7f87f3200640 1 -- 172.21.15.175:0/456046895 wait complete. 2024-04-25T09:05:01.852 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:05:01.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.998+0000 7f5df7e00640 1 Processor -- start 2024-04-25T09:05:01.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.998+0000 7f5df7e00640 1 -- start start 2024-04-25T09:05:01.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.998+0000 7f5df7e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5df0145250 0x7f5df00cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:01.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.998+0000 7f5df7e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5df01600a0 0x7f5df00cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:01.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.998+0000 7f5df7e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df00cfd10 con 0x7f5df00ce970 2024-04-25T09:05:01.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.998+0000 7f5df7e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df015f650 con 0x7f5df0145250 2024-04-25T09:05:01.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.998+0000 7f5df7e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df00cfff0 con 0x7f5df01600a0 2024-04-25T09:05:01.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.998+0000 7f5df5400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5df0145250 0x7f5df00cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:01.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.998+0000 7f5df5e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5df00ce970 0x7f5df00cedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:57460/0 (socket says 172.21.15.175:57460) 2024-04-25T09:05:01.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:01.998+0000 7f5df5e00640 1 -- 172.21.15.175:0/119833352 learned_addr learned my addr 172.21.15.175:0/119833352 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:01.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.002+0000 7f5df4a00640 1 --2- 172.21.15.175:0/119833352 >> v2:172.21.15.177:3300/0 conn(0x7f5df01600a0 0x7f5df00cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:01.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.002+0000 7f5df5400640 1 -- 172.21.15.175:0/119833352 >> v2:172.21.15.177:3300/0 conn(0x7f5df01600a0 msgr2=0x7f5df00cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:01.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.002+0000 7f5df5400640 1 --2- 172.21.15.175:0/119833352 >> v2:172.21.15.177:3300/0 conn(0x7f5df01600a0 0x7f5df00cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.002+0000 7f5df5400640 1 -- 172.21.15.175:0/119833352 >> v1:172.21.15.175:6789/0 conn(0x7f5df00ce970 legacy=0x7f5df00cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:01.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.002+0000 7f5df5400640 1 -- 172.21.15.175:0/119833352 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df015f8a0 con 0x7f5df0145250 2024-04-25T09:05:01.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.002+0000 7f5defe00640 1 -- 172.21.15.175:0/119833352 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1687767126 0 0) 0x7f5df00cfd10 con 0x7f5df00ce970 2024-04-25T09:05:01.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.002+0000 7f5df4a00640 1 --2- 172.21.15.175:0/119833352 >> v2:172.21.15.177:3300/0 conn(0x7f5df01600a0 0x7f5df00cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:01.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.002+0000 7f5df5400640 1 --2- 172.21.15.175:0/119833352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df0145250 0x7f5df00cf6b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009d90 tx=0x7f5de401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f1946d44ccb970 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:01.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.002+0000 7f5defe00640 1 -- 172.21.15.175:0/119833352 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40b2070 con 0x7f5df0145250 2024-04-25T09:05:01.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.002+0000 7f5defe00640 1 -- 172.21.15.175:0/119833352 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de40a59e0 con 0x7f5df0145250 2024-04-25T09:05:01.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.002+0000 7f5defe00640 1 -- 172.21.15.175:0/119833352 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40a5db0 con 0x7f5df0145250 2024-04-25T09:05:01.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.002+0000 7f5df7e00640 1 -- 172.21.15.175:0/119833352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df0145250 msgr2=0x7f5df00cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:01.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.002+0000 7f5df7e00640 1 --2- 172.21.15.175:0/119833352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df0145250 0x7f5df00cf6b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5de4009d90 tx=0x7f5de401c900 comp rx=0 tx=0).stop 2024-04-25T09:05:01.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df7e00640 1 -- 172.21.15.175:0/119833352 shutdown_connections 2024-04-25T09:05:01.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df7e00640 1 --2- 172.21.15.175:0/119833352 >> v2:172.21.15.177:3300/0 conn(0x7f5df01600a0 0x7f5df00cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df7e00640 1 --2- 172.21.15.175:0/119833352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df0145250 0x7f5df00cf6b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:01.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df7e00640 1 -- 172.21.15.175:0/119833352 >> 172.21.15.175:0/119833352 conn(0x7f5df006ac50 msgr2=0x7f5df006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:01.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df7e00640 1 -- 172.21.15.175:0/119833352 shutdown_connections 2024-04-25T09:05:01.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df7e00640 1 -- 172.21.15.175:0/119833352 wait complete. 2024-04-25T09:05:01.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df7e00640 1 Processor -- start 2024-04-25T09:05:01.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df7e00640 1 -- start start 2024-04-25T09:05:02.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df00ce970 0x7f5df0165480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:02.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df7e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5df0145250 0x7f5df0141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:02.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df01600a0 0x7f5df0142360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:02.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df7e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df015c870 con 0x7f5df00ce970 2024-04-25T09:05:02.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df7e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df01604b0 con 0x7f5df01600a0 2024-04-25T09:05:02.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df7e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df015c9f0 con 0x7f5df0145250 2024-04-25T09:05:02.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df5400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df00ce970 0x7f5df0165480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:02.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df5400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df00ce970 0x7f5df0165480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32784/0 (socket says 172.21.15.175:32784) 2024-04-25T09:05:02.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df5400640 1 -- 172.21.15.175:0/2997695623 learned_addr learned my addr 172.21.15.175:0/2997695623 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:02.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df4a00640 1 --2- 172.21.15.175:0/2997695623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5df0145250 0x7f5df0141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:02.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df5e00640 1 --2- 172.21.15.175:0/2997695623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df01600a0 0x7f5df0142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:02.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df5400640 1 -- 172.21.15.175:0/2997695623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5df0145250 msgr2=0x7f5df0141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:02.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df5400640 1 --2- 172.21.15.175:0/2997695623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5df0145250 0x7f5df0141e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:02.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df5400640 1 -- 172.21.15.175:0/2997695623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df01600a0 msgr2=0x7f5df0142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:02.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df5400640 1 --2- 172.21.15.175:0/2997695623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df01600a0 0x7f5df0142360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:02.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df5400640 1 -- 172.21.15.175:0/2997695623 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df01607d0 con 0x7f5df00ce970 2024-04-25T09:05:02.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df4a00640 1 --2- 172.21.15.175:0/2997695623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5df0145250 0x7f5df0141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:02.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df5e00640 1 --2- 172.21.15.175:0/2997695623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df01600a0 0x7f5df0142360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:02.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df5400640 1 --2- 172.21.15.175:0/2997695623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df00ce970 0x7f5df0165480 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5de4019510 tx=0x7f5de40196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:02.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5ded600640 1 -- 172.21.15.175:0/2997695623 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40b2040 con 0x7f5df00ce970 2024-04-25T09:05:02.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5ded600640 1 -- 172.21.15.175:0/2997695623 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de40bf070 con 0x7f5df00ce970 2024-04-25T09:05:02.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5ded600640 1 -- 172.21.15.175:0/2997695623 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40ad9a0 con 0x7f5df00ce970 2024-04-25T09:05:02.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.006+0000 7f5df7e00640 1 -- 172.21.15.175:0/2997695623 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df0160ab0 con 0x7f5df00ce970 2024-04-25T09:05:02.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.010+0000 7f5df7e00640 1 -- 172.21.15.175:0/2997695623 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df0161070 con 0x7f5df00ce970 2024-04-25T09:05:02.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.010+0000 7f5df7e00640 1 -- 172.21.15.175:0/2997695623 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df0075160 con 0x7f5df00ce970 2024-04-25T09:05:02.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.010+0000 7f5ded600640 1 -- 172.21.15.175:0/2997695623 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5de40adb40 con 0x7f5df00ce970 2024-04-25T09:05:02.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.010+0000 7f5ded600640 1 --2- 172.21.15.175:0/2997695623 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5dd0066f60 0x7f5dd0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:02.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.010+0000 7f5ded600640 1 -- 172.21.15.175:0/2997695623 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f5de4120330 con 0x7f5df00ce970 2024-04-25T09:05:02.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.010+0000 7f5df4a00640 1 --2- 172.21.15.175:0/2997695623 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5dd0066f60 0x7f5dd0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:02.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.010+0000 7f5df4a00640 1 --2- 172.21.15.175:0/2997695623 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5dd0066f60 0x7f5dd0069420 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5df00cc080 tx=0x7f5ddc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:02.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.014+0000 7f5ded600640 1 -- 172.21.15.175:0/2997695623 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5de4016520 con 0x7f5df00ce970 2024-04-25T09:05:02.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.202+0000 7f5df7e00640 1 -- 172.21.15.175:0/2997695623 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5df01417a0 con 0x7f5df00ce970 2024-04-25T09:05:02.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.822+0000 7f5ded600640 1 -- 172.21.15.175:0/2997695623 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5de40ab340 con 0x7f5df00ce970 2024-04-25T09:05:02.816 INFO:teuthology.orchestra.run.smithi175.stderr:new fs with metadata pool 4 and data pool 5 2024-04-25T09:05:02.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.826+0000 7f5df7e00640 1 -- 172.21.15.175:0/2997695623 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5dd0066f60 msgr2=0x7f5dd0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:02.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.826+0000 7f5df7e00640 1 --2- 172.21.15.175:0/2997695623 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5dd0066f60 0x7f5dd0069420 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5df00cc080 tx=0x7f5ddc008040 comp rx=0 tx=0).stop 2024-04-25T09:05:02.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.826+0000 7f5df7e00640 1 -- 172.21.15.175:0/2997695623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df00ce970 msgr2=0x7f5df0165480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:02.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.826+0000 7f5df7e00640 1 --2- 172.21.15.175:0/2997695623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df00ce970 0x7f5df0165480 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5de4019510 tx=0x7f5de40196a0 comp rx=0 tx=0).stop 2024-04-25T09:05:02.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.830+0000 7f5df7e00640 1 -- 172.21.15.175:0/2997695623 shutdown_connections 2024-04-25T09:05:02.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.830+0000 7f5df7e00640 1 --2- 172.21.15.175:0/2997695623 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5dd0066f60 0x7f5dd0069420 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:02.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.830+0000 7f5df7e00640 1 --2- 172.21.15.175:0/2997695623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df01600a0 0x7f5df0142360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:02.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.830+0000 7f5df7e00640 1 --2- 172.21.15.175:0/2997695623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5df0145250 0x7f5df0141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:02.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.830+0000 7f5df7e00640 1 --2- 172.21.15.175:0/2997695623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5df00ce970 0x7f5df0165480 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:02.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.830+0000 7f5df7e00640 1 -- 172.21.15.175:0/2997695623 >> 172.21.15.175:0/2997695623 conn(0x7f5df006ac50 msgr2=0x7f5df0140c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:02.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.830+0000 7f5df7e00640 1 -- 172.21.15.175:0/2997695623 shutdown_connections 2024-04-25T09:05:02.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:02.830+0000 7f5df7e00640 1 -- 172.21.15.175:0/2997695623 wait complete. 2024-04-25T09:05:02.872 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:03.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.014+0000 7f0715e00640 1 Processor -- start 2024-04-25T09:05:03.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.014+0000 7f0715e00640 1 -- start start 2024-04-25T09:05:03.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.018+0000 7f0715e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f07100add90 0x7f07100ae680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:03.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.018+0000 7f0715e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07100aebc0 0x7f0710167700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:03.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.018+0000 7f0715e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071015dfb0 con 0x7f071015dbd0 2024-04-25T09:05:03.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.018+0000 7f0715e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07100ae1d0 con 0x7f07100add90 2024-04-25T09:05:03.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.018+0000 7f0715e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07100cf670 con 0x7f07100aebc0 2024-04-25T09:05:03.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.018+0000 7f070e000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f07100add90 0x7f07100ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:03.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.018+0000 7f070ea00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f071015dbd0 0x7f0710071c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:57462/0 (socket says 172.21.15.175:57462) 2024-04-25T09:05:03.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.018+0000 7f070ea00640 1 -- 172.21.15.175:0/568251632 learned_addr learned my addr 172.21.15.175:0/568251632 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:03.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.018+0000 7f070f400640 1 --2- 172.21.15.175:0/568251632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07100aebc0 0x7f0710167700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:03.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.018+0000 7f070e000640 1 -- 172.21.15.175:0/568251632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07100aebc0 msgr2=0x7f0710167700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:03.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.018+0000 7f070e000640 1 --2- 172.21.15.175:0/568251632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07100aebc0 0x7f0710167700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.018+0000 7f070e000640 1 -- 172.21.15.175:0/568251632 >> v1:172.21.15.175:6789/0 conn(0x7f071015dbd0 legacy=0x7f0710071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:03.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.018+0000 7f070e000640 1 -- 172.21.15.175:0/568251632 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07100b2980 con 0x7f07100add90 2024-04-25T09:05:03.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.018+0000 7f070d600640 1 -- 172.21.15.175:0/568251632 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158254346 0 0) 0x7f071015dfb0 con 0x7f071015dbd0 2024-04-25T09:05:03.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.022+0000 7f070e000640 1 --2- 172.21.15.175:0/568251632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07100add90 0x7f07100ae680 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0097c0 tx=0x7f06fc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea31a7771b38d5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:03.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.022+0000 7f070d600640 1 -- 172.21.15.175:0/568251632 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc0b0070 con 0x7f07100add90 2024-04-25T09:05:03.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.022+0000 7f070d600640 1 -- 172.21.15.175:0/568251632 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06fc0ab600 con 0x7f07100add90 2024-04-25T09:05:03.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.022+0000 7f070d600640 1 -- 172.21.15.175:0/568251632 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc0ab9d0 con 0x7f07100add90 2024-04-25T09:05:03.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.022+0000 7f0715e00640 1 -- 172.21.15.175:0/568251632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07100add90 msgr2=0x7f07100ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:03.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.022+0000 7f0715e00640 1 --2- 172.21.15.175:0/568251632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07100add90 0x7f07100ae680 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0097c0 tx=0x7f06fc01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.022+0000 7f0715e00640 1 -- 172.21.15.175:0/568251632 shutdown_connections 2024-04-25T09:05:03.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.022+0000 7f0715e00640 1 --2- 172.21.15.175:0/568251632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07100aebc0 0x7f0710167700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.022+0000 7f0715e00640 1 --2- 172.21.15.175:0/568251632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07100add90 0x7f07100ae680 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.022+0000 7f0715e00640 1 -- 172.21.15.175:0/568251632 >> 172.21.15.175:0/568251632 conn(0x7f0710067150 msgr2=0x7f071006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:03.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.022+0000 7f0715e00640 1 -- 172.21.15.175:0/568251632 shutdown_connections 2024-04-25T09:05:03.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.022+0000 7f0715e00640 1 -- 172.21.15.175:0/568251632 wait complete. 2024-04-25T09:05:03.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.022+0000 7f0715e00640 1 Processor -- start 2024-04-25T09:05:03.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.022+0000 7f0715e00640 1 -- start start 2024-04-25T09:05:03.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f0715e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07100aebc0 0x7f07101f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:03.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f0715e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f071015dbd0 0x7f071015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:03.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f0715e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07100afd00 0x7f0710158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:03.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f0715e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07100b2700 con 0x7f071015dbd0 2024-04-25T09:05:03.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f0715e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07100b2580 con 0x7f07100aebc0 2024-04-25T09:05:03.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f0715e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071016a460 con 0x7f07100afd00 2024-04-25T09:05:03.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f070e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f071015dbd0 0x7f071015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:03.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f070e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f071015dbd0 0x7f071015c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32808/0 (socket says 172.21.15.175:32808) 2024-04-25T09:05:03.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f070e000640 1 -- 172.21.15.175:0/3442049896 learned_addr learned my addr 172.21.15.175:0/3442049896 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:03.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f070ea00640 1 --2- 172.21.15.175:0/3442049896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07100aebc0 0x7f07101f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:03.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f070f400640 1 --2- 172.21.15.175:0/3442049896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07100afd00 0x7f0710158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:03.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f070e000640 1 -- 172.21.15.175:0/3442049896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07100afd00 msgr2=0x7f0710158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:03.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f070e000640 1 --2- 172.21.15.175:0/3442049896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07100afd00 0x7f0710158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f070e000640 1 -- 172.21.15.175:0/3442049896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07100aebc0 msgr2=0x7f07101f6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:03.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f070e000640 1 --2- 172.21.15.175:0/3442049896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07100aebc0 0x7f07101f6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f070e000640 1 -- 172.21.15.175:0/3442049896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071015ca10 con 0x7f071015dbd0 2024-04-25T09:05:03.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f070e000640 1 --2- 172.21.15.175:0/3442049896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f071015dbd0 0x7f071015c0c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0097c0 tx=0x7f06fc019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:03.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f0707400640 1 -- 172.21.15.175:0/3442049896 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc0ba070 con 0x7f071015dbd0 2024-04-25T09:05:03.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f0707400640 1 -- 172.21.15.175:0/3442049896 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06fc0b43f0 con 0x7f071015dbd0 2024-04-25T09:05:03.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f0715e00640 1 -- 172.21.15.175:0/3442049896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071015ccf0 con 0x7f071015dbd0 2024-04-25T09:05:03.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f0707400640 1 -- 172.21.15.175:0/3442049896 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc0b0040 con 0x7f071015dbd0 2024-04-25T09:05:03.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f0715e00640 1 -- 172.21.15.175:0/3442049896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071015c600 con 0x7f071015dbd0 2024-04-25T09:05:03.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f0715e00640 1 -- 172.21.15.175:0/3442049896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0710074a60 con 0x7f071015dbd0 2024-04-25T09:05:03.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.026+0000 7f0707400640 1 -- 172.21.15.175:0/3442049896 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f06fc0bd070 con 0x7f071015dbd0 2024-04-25T09:05:03.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.030+0000 7f0707400640 1 --2- 172.21.15.175:0/3442049896 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f06f0066f60 0x7f06f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:03.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.030+0000 7f0707400640 1 -- 172.21.15.175:0/3442049896 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06fc11dfc0 con 0x7f071015dbd0 2024-04-25T09:05:03.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.030+0000 7f070ea00640 1 --2- 172.21.15.175:0/3442049896 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f06f0066f60 0x7f06f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:03.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.030+0000 7f070ea00640 1 --2- 172.21.15.175:0/3442049896 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f06f0066f60 0x7f06f0069420 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0700005fd0 tx=0x7f0700005b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:03.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.034+0000 7f0707400640 1 -- 172.21.15.175:0/3442049896 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f06fc016090 con 0x7f071015dbd0 2024-04-25T09:05:03.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.186+0000 7f0715e00640 1 -- 172.21.15.175:0/3442049896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07101603e0 con 0x7f071015dbd0 2024-04-25T09:05:03.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.190+0000 7f0707400640 1 -- 172.21.15.175:0/3442049896 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16718 (secure 0 0 0) 0x7f06fc0eefc0 con 0x7f071015dbd0 2024-04-25T09:05:03.182 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:03.182 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":31,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:05:02.208064+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:59.880776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:01.208198+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:03.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.190+0000 7f0715e00640 1 -- 172.21.15.175:0/3442049896 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f06f0066f60 msgr2=0x7f06f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:03.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.190+0000 7f0715e00640 1 --2- 172.21.15.175:0/3442049896 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f06f0066f60 0x7f06f0069420 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0700005fd0 tx=0x7f0700005b80 comp rx=0 tx=0).stop 2024-04-25T09:05:03.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.190+0000 7f0715e00640 1 -- 172.21.15.175:0/3442049896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f071015dbd0 msgr2=0x7f071015c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:03.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.190+0000 7f0715e00640 1 --2- 172.21.15.175:0/3442049896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f071015dbd0 0x7f071015c0c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f06fc0097c0 tx=0x7f06fc019240 comp rx=0 tx=0).stop 2024-04-25T09:05:03.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.190+0000 7f0715e00640 1 -- 172.21.15.175:0/3442049896 shutdown_connections 2024-04-25T09:05:03.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.190+0000 7f0715e00640 1 --2- 172.21.15.175:0/3442049896 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f06f0066f60 0x7f06f0069420 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.190+0000 7f0715e00640 1 --2- 172.21.15.175:0/3442049896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07100afd00 0x7f0710158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.190+0000 7f0715e00640 1 --2- 172.21.15.175:0/3442049896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f071015dbd0 0x7f071015c0c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.190+0000 7f0715e00640 1 --2- 172.21.15.175:0/3442049896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07100aebc0 0x7f07101f6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.190+0000 7f0715e00640 1 -- 172.21.15.175:0/3442049896 >> 172.21.15.175:0/3442049896 conn(0x7f07100add90 msgr2=0x7f07100ad490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:03.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.190+0000 7f0715e00640 1 -- 172.21.15.175:0/3442049896 shutdown_connections 2024-04-25T09:05:03.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.190+0000 7f0715e00640 1 -- 172.21.15.175:0/3442049896 wait complete. 2024-04-25T09:05:03.203 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:03.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.346+0000 7fa0dc800640 1 Processor -- start 2024-04-25T09:05:03.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.346+0000 7fa0dc800640 1 -- start start 2024-04-25T09:05:03.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.346+0000 7fa0dc800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa0d406b780 0x7fa0d40cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:03.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.346+0000 7fa0dc800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa0d40cc910 0x7fa0d40b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:03.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.346+0000 7fa0dc800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d40b0000 con 0x7fa0d415bc70 2024-04-25T09:05:03.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.346+0000 7fa0dc800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d40b08f0 con 0x7fa0d406b780 2024-04-25T09:05:03.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.346+0000 7fa0dc800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d40b02a0 con 0x7fa0d40cc910 2024-04-25T09:05:03.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.346+0000 7fa0d9400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa0d406b780 0x7fa0d40cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:03.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.346+0000 7fa0d9e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa0d415bc70 0x7fa0d40b0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:57472/0 (socket says 172.21.15.175:57472) 2024-04-25T09:05:03.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.346+0000 7fa0d9e00640 1 -- 172.21.15.175:0/3379076756 learned_addr learned my addr 172.21.15.175:0/3379076756 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:03.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.346+0000 7fa0da800640 1 --2- 172.21.15.175:0/3379076756 >> v2:172.21.15.177:3300/0 conn(0x7fa0d40cc910 0x7fa0d40b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:03.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.346+0000 7fa0d9400640 1 -- 172.21.15.175:0/3379076756 >> v2:172.21.15.177:3300/0 conn(0x7fa0d40cc910 msgr2=0x7fa0d40b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:03.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.346+0000 7fa0d9400640 1 --2- 172.21.15.175:0/3379076756 >> v2:172.21.15.177:3300/0 conn(0x7fa0d40cc910 0x7fa0d40b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.346+0000 7fa0d9400640 1 -- 172.21.15.175:0/3379076756 >> v1:172.21.15.175:6789/0 conn(0x7fa0d415bc70 legacy=0x7fa0d40b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:03.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.346+0000 7fa0d9400640 1 -- 172.21.15.175:0/3379076756 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d40b0580 con 0x7fa0d406b780 2024-04-25T09:05:03.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.350+0000 7fa0d9400640 1 --2- 172.21.15.175:0/3379076756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d406b780 0x7fa0d40cc3d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40cbb60 tx=0x7fa0c401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f297e767db5f5d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:03.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.350+0000 7fa0d8a00640 1 -- 172.21.15.175:0/3379076756 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c40b5070 con 0x7fa0d406b780 2024-04-25T09:05:03.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.350+0000 7fa0d8a00640 1 -- 172.21.15.175:0/3379076756 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c40a8970 con 0x7fa0d406b780 2024-04-25T09:05:03.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.350+0000 7fa0d8a00640 1 -- 172.21.15.175:0/3379076756 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c40a8d40 con 0x7fa0d406b780 2024-04-25T09:05:03.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.350+0000 7fa0dc800640 1 -- 172.21.15.175:0/3379076756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d406b780 msgr2=0x7fa0d40cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:03.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.350+0000 7fa0dc800640 1 --2- 172.21.15.175:0/3379076756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d406b780 0x7fa0d40cc3d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40cbb60 tx=0x7fa0c401ec70 comp rx=0 tx=0).stop 2024-04-25T09:05:03.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.350+0000 7fa0dc800640 1 -- 172.21.15.175:0/3379076756 shutdown_connections 2024-04-25T09:05:03.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.350+0000 7fa0dc800640 1 --2- 172.21.15.175:0/3379076756 >> v2:172.21.15.177:3300/0 conn(0x7fa0d40cc910 0x7fa0d40b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.350+0000 7fa0dc800640 1 --2- 172.21.15.175:0/3379076756 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d406b780 0x7fa0d40cc3d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.350+0000 7fa0dc800640 1 -- 172.21.15.175:0/3379076756 >> 172.21.15.175:0/3379076756 conn(0x7fa0d40d06c0 msgr2=0x7fa0d40d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:03.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.350+0000 7fa0dc800640 1 -- 172.21.15.175:0/3379076756 shutdown_connections 2024-04-25T09:05:03.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.350+0000 7fa0dc800640 1 -- 172.21.15.175:0/3379076756 wait complete. 2024-04-25T09:05:03.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0dc800640 1 Processor -- start 2024-04-25T09:05:03.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0dc800640 1 -- start start 2024-04-25T09:05:03.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0dc800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d406b780 0x7fa0d4153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:03.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0dc800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0d40cc910 0x7fa0d40c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:03.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0dc800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0d415bc70 0x7fa0d40ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:03.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0dc800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40b1b50 con 0x7fa0d406b780 2024-04-25T09:05:03.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0dc800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40cde30 con 0x7fa0d40cc910 2024-04-25T09:05:03.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0dc800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d40b1cd0 con 0x7fa0d415bc70 2024-04-25T09:05:03.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0d9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d406b780 0x7fa0d4153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:03.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0d9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d406b780 0x7fa0d4153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32814/0 (socket says 172.21.15.175:32814) 2024-04-25T09:05:03.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0d9e00640 1 -- 172.21.15.175:0/1920462636 learned_addr learned my addr 172.21.15.175:0/1920462636 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:03.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0d9400640 1 --2- 172.21.15.175:0/1920462636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0d40cc910 0x7fa0d40c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:03.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0da800640 1 --2- 172.21.15.175:0/1920462636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0d415bc70 0x7fa0d40ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:03.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0d9e00640 1 -- 172.21.15.175:0/1920462636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0d415bc70 msgr2=0x7fa0d40ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:03.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0d9e00640 1 --2- 172.21.15.175:0/1920462636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0d415bc70 0x7fa0d40ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0d9e00640 1 -- 172.21.15.175:0/1920462636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0d40cc910 msgr2=0x7fa0d40c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:03.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0d9e00640 1 --2- 172.21.15.175:0/1920462636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0d40cc910 0x7fa0d40c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0d9e00640 1 -- 172.21.15.175:0/1920462636 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d40c9fd0 con 0x7fa0d406b780 2024-04-25T09:05:03.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0d9e00640 1 --2- 172.21.15.175:0/1920462636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d406b780 0x7fa0d4153fa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800c370 tx=0x7fa0c800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:03.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0ce000640 1 -- 172.21.15.175:0/1920462636 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8017070 con 0x7fa0d406b780 2024-04-25T09:05:03.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0ce000640 1 -- 172.21.15.175:0/1920462636 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c8005cf0 con 0x7fa0d406b780 2024-04-25T09:05:03.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0ce000640 1 -- 172.21.15.175:0/1920462636 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80072f0 con 0x7fa0d406b780 2024-04-25T09:05:03.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0dc800640 1 -- 172.21.15.175:0/1920462636 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d40ca2b0 con 0x7fa0d406b780 2024-04-25T09:05:03.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0dc800640 1 -- 172.21.15.175:0/1920462636 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d40ca590 con 0x7fa0d406b780 2024-04-25T09:05:03.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.354+0000 7fa0dc800640 1 -- 172.21.15.175:0/1920462636 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d4074a60 con 0x7fa0d406b780 2024-04-25T09:05:03.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.358+0000 7fa0ce000640 1 -- 172.21.15.175:0/1920462636 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa0c801a070 con 0x7fa0d406b780 2024-04-25T09:05:03.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.358+0000 7fa0ce000640 1 --2- 172.21.15.175:0/1920462636 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa0b8066f90 0x7fa0b8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:03.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.358+0000 7fa0ce000640 1 -- 172.21.15.175:0/1920462636 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0c80842f0 con 0x7fa0d406b780 2024-04-25T09:05:03.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.358+0000 7fa0d9400640 1 --2- 172.21.15.175:0/1920462636 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa0b8066f90 0x7fa0b8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:03.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.358+0000 7fa0d9400640 1 --2- 172.21.15.175:0/1920462636 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa0b8066f90 0x7fa0b8069450 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40b2000 tx=0x7fa0c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:03.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.362+0000 7fa0ce000640 1 -- 172.21.15.175:0/1920462636 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa0c8055390 con 0x7fa0d406b780 2024-04-25T09:05:03.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.518+0000 7fa0dc800640 1 -- 172.21.15.175:0/1920462636 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0d406e870 con 0x7fa0d406b780 2024-04-25T09:05:03.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.518+0000 7fa0ce000640 1 -- 172.21.15.175:0/1920462636 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16718 (secure 0 0 0) 0x7fa0c8054c90 con 0x7fa0d406b780 2024-04-25T09:05:03.513 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:03.513 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":31,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:05:02.208064+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:59.880776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:01.208198+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:03.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.522+0000 7fa0dc800640 1 -- 172.21.15.175:0/1920462636 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa0b8066f90 msgr2=0x7fa0b8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:03.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.522+0000 7fa0dc800640 1 --2- 172.21.15.175:0/1920462636 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa0b8066f90 0x7fa0b8069450 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa0c40b2000 tx=0x7fa0c4008040 comp rx=0 tx=0).stop 2024-04-25T09:05:03.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.522+0000 7fa0dc800640 1 -- 172.21.15.175:0/1920462636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d406b780 msgr2=0x7fa0d4153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:03.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.522+0000 7fa0dc800640 1 --2- 172.21.15.175:0/1920462636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d406b780 0x7fa0d4153fa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800c370 tx=0x7fa0c800c830 comp rx=0 tx=0).stop 2024-04-25T09:05:03.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.522+0000 7fa0dc800640 1 -- 172.21.15.175:0/1920462636 shutdown_connections 2024-04-25T09:05:03.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.522+0000 7fa0dc800640 1 --2- 172.21.15.175:0/1920462636 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa0b8066f90 0x7fa0b8069450 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.522+0000 7fa0dc800640 1 --2- 172.21.15.175:0/1920462636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0d415bc70 0x7fa0d40ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.522+0000 7fa0dc800640 1 --2- 172.21.15.175:0/1920462636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0d40cc910 0x7fa0d40c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.522+0000 7fa0dc800640 1 --2- 172.21.15.175:0/1920462636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0d406b780 0x7fa0d4153fa0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.522+0000 7fa0dc800640 1 -- 172.21.15.175:0/1920462636 >> 172.21.15.175:0/1920462636 conn(0x7fa0d40d06c0 msgr2=0x7fa0d40b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:03.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.522+0000 7fa0dc800640 1 -- 172.21.15.175:0/1920462636 shutdown_connections 2024-04-25T09:05:03.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.522+0000 7fa0dc800640 1 -- 172.21.15.175:0/1920462636 wait complete. 2024-04-25T09:05:03.535 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:05:03.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.682+0000 7f969ac00640 1 Processor -- start 2024-04-25T09:05:03.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.682+0000 7f969ac00640 1 -- start start 2024-04-25T09:05:03.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.682+0000 7f969ac00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f96940cbe60 0x7f969415af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:03.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.682+0000 7f969ac00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f969406d310 0x7f96940b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:03.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.682+0000 7f969ac00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969406db60 con 0x7f96940b4630 2024-04-25T09:05:03.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.682+0000 7f969ac00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969406de40 con 0x7f96940cbe60 2024-04-25T09:05:03.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.682+0000 7f969ac00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969406e120 con 0x7f969406d310 2024-04-25T09:05:03.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.682+0000 7f9693e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f96940cbe60 0x7f969415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:03.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.682+0000 7f9693e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f96940cbe60 0x7f969415af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32822/0 (socket says 172.21.15.175:32822) 2024-04-25T09:05:03.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.682+0000 7f9693e00640 1 -- 172.21.15.175:0/2263009277 learned_addr learned my addr 172.21.15.175:0/2263009277 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:03.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.682+0000 7f9693e00640 1 -- 172.21.15.175:0/2263009277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f969406d310 msgr2=0x7f96940b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:03.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.682+0000 7f9693e00640 1 --2- 172.21.15.175:0/2263009277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f969406d310 0x7f96940b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.682+0000 7f9693e00640 1 -- 172.21.15.175:0/2263009277 >> v1:172.21.15.177:6789/0 conn(0x7f96940b4630 legacy=0x7f96940b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:03.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.682+0000 7f9693e00640 1 -- 172.21.15.175:0/2263009277 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969415c2f0 con 0x7f96940cbe60 2024-04-25T09:05:03.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.686+0000 7f9693e00640 1 --2- 172.21.15.175:0/2263009277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96940cbe60 0x7f969415af20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9684009870 tx=0x7f968401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b301721ffbd4220e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:03.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.686+0000 7f9693400640 1 -- 172.21.15.175:0/2263009277 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840b0070 con 0x7f96940cbe60 2024-04-25T09:05:03.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.686+0000 7f9693400640 1 -- 172.21.15.175:0/2263009277 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96840ab600 con 0x7f96940cbe60 2024-04-25T09:05:03.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.686+0000 7f9693400640 1 -- 172.21.15.175:0/2263009277 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840ab9d0 con 0x7f96940cbe60 2024-04-25T09:05:03.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.686+0000 7f969ac00640 1 -- 172.21.15.175:0/2263009277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96940cbe60 msgr2=0x7f969415af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:03.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.686+0000 7f969ac00640 1 --2- 172.21.15.175:0/2263009277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96940cbe60 0x7f969415af20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9684009870 tx=0x7f968401c520 comp rx=0 tx=0).stop 2024-04-25T09:05:03.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.686+0000 7f969ac00640 1 -- 172.21.15.175:0/2263009277 shutdown_connections 2024-04-25T09:05:03.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.686+0000 7f969ac00640 1 --2- 172.21.15.175:0/2263009277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f969406d310 0x7f96940b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.686+0000 7f969ac00640 1 --2- 172.21.15.175:0/2263009277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96940cbe60 0x7f969415af20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.686+0000 7f969ac00640 1 -- 172.21.15.175:0/2263009277 >> 172.21.15.175:0/2263009277 conn(0x7f969406ac50 msgr2=0x7f969406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:03.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.686+0000 7f969ac00640 1 -- 172.21.15.175:0/2263009277 shutdown_connections 2024-04-25T09:05:03.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.686+0000 7f969ac00640 1 -- 172.21.15.175:0/2263009277 wait complete. 2024-04-25T09:05:03.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.686+0000 7f969ac00640 1 Processor -- start 2024-04-25T09:05:03.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.686+0000 7f969ac00640 1 -- start start 2024-04-25T09:05:03.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f969ac00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f969406d310 0x7f9694167ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:03.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f969ac00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96940b4630 0x7f96940acef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:03.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f969ac00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96940cbe60 0x7f969415b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:03.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f969ac00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9694165960 con 0x7f969406d310 2024-04-25T09:05:03.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f969ac00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96941657e0 con 0x7f96940cbe60 2024-04-25T09:05:03.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f969ac00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9694165ae0 con 0x7f96940b4630 2024-04-25T09:05:03.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f9693e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f969406d310 0x7f9694167ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:03.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f9693e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f969406d310 0x7f9694167ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32824/0 (socket says 172.21.15.175:32824) 2024-04-25T09:05:03.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f9693e00640 1 -- 172.21.15.175:0/1312366407 learned_addr learned my addr 172.21.15.175:0/1312366407 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:03.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f9693e00640 1 -- 172.21.15.175:0/1312366407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96940b4630 msgr2=0x7f96940acef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:03.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f9693e00640 1 --2- 172.21.15.175:0/1312366407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96940b4630 0x7f96940acef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f9693e00640 1 -- 172.21.15.175:0/1312366407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96940cbe60 msgr2=0x7f969415b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:03.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f9698c00640 1 --2- 172.21.15.175:0/1312366407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96940cbe60 0x7f969415b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:03.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f9693e00640 1 --2- 172.21.15.175:0/1312366407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96940cbe60 0x7f969415b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:03.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f9693e00640 1 -- 172.21.15.175:0/1312366407 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9694166140 con 0x7f969406d310 2024-04-25T09:05:03.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f9698c00640 1 --2- 172.21.15.175:0/1312366407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96940cbe60 0x7f969415b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:03.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f9693e00640 1 --2- 172.21.15.175:0/1312366407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f969406d310 0x7f9694167ef0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f96840ae040 tx=0x7f968401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:03.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f9690c00640 1 -- 172.21.15.175:0/1312366407 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840b0040 con 0x7f969406d310 2024-04-25T09:05:03.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f9690c00640 1 -- 172.21.15.175:0/1312366407 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96840bc070 con 0x7f969406d310 2024-04-25T09:05:03.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f9690c00640 1 -- 172.21.15.175:0/1312366407 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840b6860 con 0x7f969406d310 2024-04-25T09:05:03.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f969ac00640 1 -- 172.21.15.175:0/1312366407 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9694166420 con 0x7f969406d310 2024-04-25T09:05:03.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f969ac00640 1 -- 172.21.15.175:0/1312366407 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96941669e0 con 0x7f969406d310 2024-04-25T09:05:03.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f969ac00640 1 -- 172.21.15.175:0/1312366407 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9694075160 con 0x7f969406d310 2024-04-25T09:05:03.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.690+0000 7f9690c00640 1 -- 172.21.15.175:0/1312366407 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f96840b6a00 con 0x7f969406d310 2024-04-25T09:05:03.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.694+0000 7f9690c00640 1 --2- 172.21.15.175:0/1312366407 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9670066f90 0x7f9670069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:03.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.694+0000 7f9690c00640 1 -- 172.21.15.175:0/1312366407 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f968411f450 con 0x7f969406d310 2024-04-25T09:05:03.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.694+0000 7f968b400640 1 --2- 172.21.15.175:0/1312366407 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9670066f90 0x7f9670069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:03.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.694+0000 7f968b400640 1 --2- 172.21.15.175:0/1312366407 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9670066f90 0x7f9670069450 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f969415a7e0 tx=0x7f967c006ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:03.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.698+0000 7f9690c00640 1 -- 172.21.15.175:0/1312366407 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9684016110 con 0x7f969406d310 2024-04-25T09:05:03.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:03.898+0000 7f969ac00640 1 -- 172.21.15.175:0/1312366407 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f969406b410 con 0x7f969406d310 2024-04-25T09:05:04.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:04.850+0000 7f9690c00640 1 -- 172.21.15.175:0/1312366407 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f96840f03c0 con 0x7f969406d310 2024-04-25T09:05:04.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:04.854+0000 7f969ac00640 1 -- 172.21.15.175:0/1312366407 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9670066f90 msgr2=0x7f9670069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:04.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:04.854+0000 7f969ac00640 1 --2- 172.21.15.175:0/1312366407 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9670066f90 0x7f9670069450 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f969415a7e0 tx=0x7f967c006ca0 comp rx=0 tx=0).stop 2024-04-25T09:05:04.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:04.854+0000 7f969ac00640 1 -- 172.21.15.175:0/1312366407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f969406d310 msgr2=0x7f9694167ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:04.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:04.854+0000 7f969ac00640 1 --2- 172.21.15.175:0/1312366407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f969406d310 0x7f9694167ef0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f96840ae040 tx=0x7f968401ad60 comp rx=0 tx=0).stop 2024-04-25T09:05:04.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:04.854+0000 7f969ac00640 1 -- 172.21.15.175:0/1312366407 shutdown_connections 2024-04-25T09:05:04.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:04.854+0000 7f969ac00640 1 --2- 172.21.15.175:0/1312366407 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9670066f90 0x7f9670069450 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:04.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:04.854+0000 7f969ac00640 1 --2- 172.21.15.175:0/1312366407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96940cbe60 0x7f969415b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:04.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:04.854+0000 7f969ac00640 1 --2- 172.21.15.175:0/1312366407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96940b4630 0x7f96940acef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:04.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:04.854+0000 7f969ac00640 1 --2- 172.21.15.175:0/1312366407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f969406d310 0x7f9694167ef0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:04.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:04.854+0000 7f969ac00640 1 -- 172.21.15.175:0/1312366407 >> 172.21.15.175:0/1312366407 conn(0x7f969406ac50 msgr2=0x7f96940afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:04.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:04.854+0000 7f969ac00640 1 -- 172.21.15.175:0/1312366407 shutdown_connections 2024-04-25T09:05:04.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:04.854+0000 7f969ac00640 1 -- 172.21.15.175:0/1312366407 wait complete. 2024-04-25T09:05:04.870 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:05:04.871 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:05:05.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.022+0000 7fa0ac000640 1 Processor -- start 2024-04-25T09:05:05.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.022+0000 7fa0ac000640 1 -- start start 2024-04-25T09:05:05.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.022+0000 7fa0ac000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0a4145250 0x7fa0a40cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.022+0000 7fa0ac000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa0a41600a0 0x7fa0a40cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.022+0000 7fa0ac000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a40cfd10 con 0x7fa0a40ce970 2024-04-25T09:05:05.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.022+0000 7fa0ac000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a415f650 con 0x7fa0a41600a0 2024-04-25T09:05:05.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.022+0000 7fa0ac000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a40cfff0 con 0x7fa0a4145250 2024-04-25T09:05:05.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.022+0000 7fa0a8c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa0a41600a0 0x7fa0a40cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.022+0000 7fa0a9600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0a4145250 0x7fa0a40cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.022+0000 7fa0aa000640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fa0a40ce970 0x7fa0a40cee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:52148/0 (socket says 172.21.15.175:52148) 2024-04-25T09:05:05.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.022+0000 7fa0aa000640 1 -- 172.21.15.175:0/2905615050 learned_addr learned my addr 172.21.15.175:0/2905615050 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:05.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.022+0000 7fa0a8c00640 1 -- 172.21.15.175:0/2905615050 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0a4145250 msgr2=0x7fa0a40cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:05.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.022+0000 7fa0a8c00640 1 --2- 172.21.15.175:0/2905615050 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0a4145250 0x7fa0a40cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.022+0000 7fa0a8c00640 1 -- 172.21.15.175:0/2905615050 >> v1:172.21.15.177:6789/0 conn(0x7fa0a40ce970 legacy=0x7fa0a40cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.022+0000 7fa0a8c00640 1 -- 172.21.15.175:0/2905615050 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a415f8a0 con 0x7fa0a41600a0 2024-04-25T09:05:05.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.022+0000 7fa0a9600640 1 --2- 172.21.15.175:0/2905615050 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0a4145250 0x7fa0a40cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:05.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.026+0000 7fa0a8c00640 1 --2- 172.21.15.175:0/2905615050 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0a41600a0 0x7fa0a40cc410 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa0900097c0 tx=0x7fa09001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a1863b146126b4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.026+0000 7fa0a3e00640 1 -- 172.21.15.175:0/2905615050 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0900ab600 con 0x7fa0a41600a0 2024-04-25T09:05:05.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.026+0000 7fa0a3e00640 1 -- 172.21.15.175:0/2905615050 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0900b0070 con 0x7fa0a41600a0 2024-04-25T09:05:05.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.026+0000 7fa0a3e00640 1 -- 172.21.15.175:0/2905615050 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0900ab9c0 con 0x7fa0a41600a0 2024-04-25T09:05:05.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.026+0000 7fa0ac000640 1 -- 172.21.15.175:0/2905615050 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0a41600a0 msgr2=0x7fa0a40cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.026+0000 7fa0ac000640 1 --2- 172.21.15.175:0/2905615050 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0a41600a0 0x7fa0a40cc410 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa0900097c0 tx=0x7fa09001c3e0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.026+0000 7fa0ac000640 1 -- 172.21.15.175:0/2905615050 shutdown_connections 2024-04-25T09:05:05.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.026+0000 7fa0ac000640 1 --2- 172.21.15.175:0/2905615050 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0a41600a0 0x7fa0a40cc410 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.026+0000 7fa0ac000640 1 --2- 172.21.15.175:0/2905615050 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0a4145250 0x7fa0a40cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.026+0000 7fa0ac000640 1 -- 172.21.15.175:0/2905615050 >> 172.21.15.175:0/2905615050 conn(0x7fa0a406ac50 msgr2=0x7fa0a406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.026+0000 7fa0ac000640 1 -- 172.21.15.175:0/2905615050 shutdown_connections 2024-04-25T09:05:05.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.026+0000 7fa0ac000640 1 -- 172.21.15.175:0/2905615050 wait complete. 2024-04-25T09:05:05.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0ac000640 1 Processor -- start 2024-04-25T09:05:05.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0ac000640 1 -- start start 2024-04-25T09:05:05.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0ac000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0a40ce970 0x7fa0a4142440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0ac000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a4145250 0x7fa0a40a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0ac000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0a41600a0 0x7fa0a413e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0ac000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a415c870 con 0x7fa0a4145250 2024-04-25T09:05:05.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0ac000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4145630 con 0x7fa0a41600a0 2024-04-25T09:05:05.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0ac000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a415c9f0 con 0x7fa0a40ce970 2024-04-25T09:05:05.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0a8c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a4145250 0x7fa0a40a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0a8c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a4145250 0x7fa0a40a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32826/0 (socket says 172.21.15.175:32826) 2024-04-25T09:05:05.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0a8c00640 1 -- 172.21.15.175:0/1638898563 learned_addr learned my addr 172.21.15.175:0/1638898563 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:05.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0aa000640 1 --2- 172.21.15.175:0/1638898563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0a41600a0 0x7fa0a413e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0a9600640 1 --2- 172.21.15.175:0/1638898563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0a40ce970 0x7fa0a4142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0a8c00640 1 -- 172.21.15.175:0/1638898563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0a40ce970 msgr2=0x7fa0a4142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0a8c00640 1 --2- 172.21.15.175:0/1638898563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0a40ce970 0x7fa0a4142440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0a8c00640 1 -- 172.21.15.175:0/1638898563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0a41600a0 msgr2=0x7fa0a413e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0a8c00640 1 --2- 172.21.15.175:0/1638898563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0a41600a0 0x7fa0a413e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0a8c00640 1 -- 172.21.15.175:0/1638898563 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a41404c0 con 0x7fa0a4145250 2024-04-25T09:05:05.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0a8c00640 1 --2- 172.21.15.175:0/1638898563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a4145250 0x7fa0a40a84b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa09001aa90 tx=0x7fa090019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0a1600640 1 -- 172.21.15.175:0/1638898563 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0900abcb0 con 0x7fa0a4145250 2024-04-25T09:05:05.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0a1600640 1 -- 172.21.15.175:0/1638898563 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0900abe50 con 0x7fa0a4145250 2024-04-25T09:05:05.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0a1600640 1 -- 172.21.15.175:0/1638898563 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0900bf690 con 0x7fa0a4145250 2024-04-25T09:05:05.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0ac000640 1 -- 172.21.15.175:0/1638898563 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a41407a0 con 0x7fa0a4145250 2024-04-25T09:05:05.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0ac000640 1 -- 172.21.15.175:0/1638898563 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a4140d60 con 0x7fa0a4145250 2024-04-25T09:05:05.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.030+0000 7fa0ac000640 1 -- 172.21.15.175:0/1638898563 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a4075160 con 0x7fa0a4145250 2024-04-25T09:05:05.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.034+0000 7fa0a1600640 1 -- 172.21.15.175:0/1638898563 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa0900aa070 con 0x7fa0a4145250 2024-04-25T09:05:05.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.034+0000 7fa0a1600640 1 --2- 172.21.15.175:0/1638898563 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa084066f60 0x7fa084069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:05.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.034+0000 7fa0a1600640 1 -- 172.21.15.175:0/1638898563 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa09011f490 con 0x7fa0a4145250 2024-04-25T09:05:05.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.034+0000 7fa0a9600640 1 --2- 172.21.15.175:0/1638898563 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa084066f60 0x7fa084069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:05.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.034+0000 7fa0a9600640 1 --2- 172.21.15.175:0/1638898563 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa084066f60 0x7fa084069420 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa098009580 tx=0x7fa098008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:05.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.038+0000 7fa0a1600640 1 -- 172.21.15.175:0/1638898563 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa090016090 con 0x7fa0a4145250 2024-04-25T09:05:05.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.226+0000 7fa0ac000640 1 -- 172.21.15.175:0/1638898563 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa0a4165420 con 0x7fa0a4145250 2024-04-25T09:05:05.779 INFO:tasks.ceph.mds.a.smithi175.stderr:2024-04-25T09:05:05.790+0000 7f074a600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:05:05.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.858+0000 7fa0a1600640 1 -- 172.21.15.175:0/1638898563 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa0900f0400 con 0x7fa0a4145250 2024-04-25T09:05:05.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.858+0000 7fa0ac000640 1 -- 172.21.15.175:0/1638898563 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa084066f60 msgr2=0x7fa084069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.858+0000 7fa0ac000640 1 --2- 172.21.15.175:0/1638898563 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa084066f60 0x7fa084069420 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa098009580 tx=0x7fa098008040 comp rx=0 tx=0).stop 2024-04-25T09:05:05.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.858+0000 7fa0ac000640 1 -- 172.21.15.175:0/1638898563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a4145250 msgr2=0x7fa0a40a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:05.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.858+0000 7fa0ac000640 1 --2- 172.21.15.175:0/1638898563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a4145250 0x7fa0a40a84b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa09001aa90 tx=0x7fa090019180 comp rx=0 tx=0).stop 2024-04-25T09:05:05.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.858+0000 7fa0ac000640 1 -- 172.21.15.175:0/1638898563 shutdown_connections 2024-04-25T09:05:05.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.858+0000 7fa0ac000640 1 --2- 172.21.15.175:0/1638898563 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa084066f60 0x7fa084069420 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.858+0000 7fa0ac000640 1 --2- 172.21.15.175:0/1638898563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0a41600a0 0x7fa0a413e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.858+0000 7fa0ac000640 1 --2- 172.21.15.175:0/1638898563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0a4145250 0x7fa0a40a84b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.858+0000 7fa0ac000640 1 --2- 172.21.15.175:0/1638898563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0a40ce970 0x7fa0a4142440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:05.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.858+0000 7fa0ac000640 1 -- 172.21.15.175:0/1638898563 >> 172.21.15.175:0/1638898563 conn(0x7fa0a406ac50 msgr2=0x7fa0a40b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:05.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.858+0000 7fa0ac000640 1 -- 172.21.15.175:0/1638898563 shutdown_connections 2024-04-25T09:05:05.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:05.858+0000 7fa0ac000640 1 -- 172.21.15.175:0/1638898563 wait complete. 2024-04-25T09:05:05.876 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:05:05.876 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:06.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.022+0000 7f0ec5600640 1 Processor -- start 2024-04-25T09:05:06.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.022+0000 7f0ec5600640 1 -- start start 2024-04-25T09:05:06.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.022+0000 7f0ec5600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0ec0144fc0 0x7f0ec00cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:06.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.022+0000 7f0ec5600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0ec01453a0 0x7f0ec015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:06.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.022+0000 7f0ec5600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec015cd00 con 0x7f0ec00cc3b0 2024-04-25T09:05:06.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.026+0000 7f0ec5600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec00ce660 con 0x7f0ec0144fc0 2024-04-25T09:05:06.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.026+0000 7f0ec5600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec00cc930 con 0x7f0ec01453a0 2024-04-25T09:05:06.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.026+0000 7f0ebea00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0ec0144fc0 0x7f0ec00cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:06.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.026+0000 7f0ebf400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f0ec00cc3b0 0x7f0ec015f480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:57486/0 (socket says 172.21.15.175:57486) 2024-04-25T09:05:06.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.026+0000 7f0ebf400640 1 -- 172.21.15.175:0/3686270452 learned_addr learned my addr 172.21.15.175:0/3686270452 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:06.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.026+0000 7f0eb6000640 1 --2- 172.21.15.175:0/3686270452 >> v2:172.21.15.177:3300/0 conn(0x7f0ec01453a0 0x7f0ec015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:06.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.026+0000 7f0ebea00640 1 -- 172.21.15.175:0/3686270452 >> v2:172.21.15.177:3300/0 conn(0x7f0ec01453a0 msgr2=0x7f0ec015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:06.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.026+0000 7f0ebea00640 1 --2- 172.21.15.175:0/3686270452 >> v2:172.21.15.177:3300/0 conn(0x7f0ec01453a0 0x7f0ec015bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.026+0000 7f0ebea00640 1 -- 172.21.15.175:0/3686270452 >> v1:172.21.15.175:6789/0 conn(0x7f0ec00cc3b0 legacy=0x7f0ec015f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:06.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.026+0000 7f0ebea00640 1 -- 172.21.15.175:0/3686270452 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec00ccc10 con 0x7f0ec0144fc0 2024-04-25T09:05:06.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.026+0000 7f0ebe000640 1 -- 172.21.15.175:0/3686270452 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020815429 0 0) 0x7f0ec015cd00 con 0x7f0ec00cc3b0 2024-04-25T09:05:06.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.026+0000 7f0ebea00640 1 --2- 172.21.15.175:0/3686270452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec0144fc0 0x7f0ec00cbe70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00097c0 tx=0x7f0eb001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f6af9ad72c7fea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:06.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.026+0000 7f0ebe000640 1 -- 172.21.15.175:0/3686270452 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb00b0070 con 0x7f0ec0144fc0 2024-04-25T09:05:06.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.026+0000 7f0ebe000640 1 -- 172.21.15.175:0/3686270452 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb0004230 con 0x7f0ec0144fc0 2024-04-25T09:05:06.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.026+0000 7f0ebe000640 1 -- 172.21.15.175:0/3686270452 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0003620 con 0x7f0ec0144fc0 2024-04-25T09:05:06.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ec5600640 1 -- 172.21.15.175:0/3686270452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec0144fc0 msgr2=0x7f0ec00cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:06.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ec5600640 1 --2- 172.21.15.175:0/3686270452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec0144fc0 0x7f0ec00cbe70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00097c0 tx=0x7f0eb001c460 comp rx=0 tx=0).stop 2024-04-25T09:05:06.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ec5600640 1 -- 172.21.15.175:0/3686270452 shutdown_connections 2024-04-25T09:05:06.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ec5600640 1 --2- 172.21.15.175:0/3686270452 >> v2:172.21.15.177:3300/0 conn(0x7f0ec01453a0 0x7f0ec015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ec5600640 1 --2- 172.21.15.175:0/3686270452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec0144fc0 0x7f0ec00cbe70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ec5600640 1 -- 172.21.15.175:0/3686270452 >> 172.21.15.175:0/3686270452 conn(0x7f0ec0067150 msgr2=0x7f0ec006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:06.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ec5600640 1 -- 172.21.15.175:0/3686270452 shutdown_connections 2024-04-25T09:05:06.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ec5600640 1 -- 172.21.15.175:0/3686270452 wait complete. 2024-04-25T09:05:06.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ec5600640 1 Processor -- start 2024-04-25T09:05:06.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ec5600640 1 -- start start 2024-04-25T09:05:06.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ec5600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ec0144fc0 0x7f0ec015ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:06.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ec5600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec01453a0 0x7f0ec0143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:06.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ec5600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ec0142590 0x7f0ec00afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:06.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ec5600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00cffb0 con 0x7f0ec01453a0 2024-04-25T09:05:06.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ec5600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00cfe30 con 0x7f0ec0142590 2024-04-25T09:05:06.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ec5600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec01685f0 con 0x7f0ec0144fc0 2024-04-25T09:05:06.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0eb6000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec01453a0 0x7f0ec0143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:06.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0eb6000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec01453a0 0x7f0ec0143b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32854/0 (socket says 172.21.15.175:32854) 2024-04-25T09:05:06.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0eb6000640 1 -- 172.21.15.175:0/627609649 learned_addr learned my addr 172.21.15.175:0/627609649 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:06.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ebea00640 1 --2- 172.21.15.175:0/627609649 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ec0144fc0 0x7f0ec015ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:06.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ebf400640 1 --2- 172.21.15.175:0/627609649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ec0142590 0x7f0ec00afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:06.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0eb6000640 1 -- 172.21.15.175:0/627609649 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ec0144fc0 msgr2=0x7f0ec015ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:06.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0eb6000640 1 --2- 172.21.15.175:0/627609649 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ec0144fc0 0x7f0ec015ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0eb6000640 1 -- 172.21.15.175:0/627609649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ec0142590 msgr2=0x7f0ec00afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:06.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0eb6000640 1 --2- 172.21.15.175:0/627609649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ec0142590 0x7f0ec00afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0eb6000640 1 -- 172.21.15.175:0/627609649 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec0142a90 con 0x7f0ec01453a0 2024-04-25T09:05:06.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ebf400640 1 --2- 172.21.15.175:0/627609649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ec0142590 0x7f0ec00afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:06.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.030+0000 7f0ebea00640 1 --2- 172.21.15.175:0/627609649 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ec0144fc0 0x7f0ec015ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:06.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.034+0000 7f0eb6000640 1 --2- 172.21.15.175:0/627609649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec01453a0 0x7f0ec0143b30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800e8a0 tx=0x7f0ea800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:06.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.034+0000 7f0eb7400640 1 -- 172.21.15.175:0/627609649 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea8017070 con 0x7f0ec01453a0 2024-04-25T09:05:06.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.034+0000 7f0eb7400640 1 -- 172.21.15.175:0/627609649 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea800ee90 con 0x7f0ec01453a0 2024-04-25T09:05:06.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.034+0000 7f0eb7400640 1 -- 172.21.15.175:0/627609649 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea800cb40 con 0x7f0ec01453a0 2024-04-25T09:05:06.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.034+0000 7f0ec5600640 1 -- 172.21.15.175:0/627609649 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec0142d70 con 0x7f0ec01453a0 2024-04-25T09:05:06.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.034+0000 7f0ec5600640 1 -- 172.21.15.175:0/627609649 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec0143330 con 0x7f0ec01453a0 2024-04-25T09:05:06.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.034+0000 7f0ec5600640 1 -- 172.21.15.175:0/627609649 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec013edd0 con 0x7f0ec01453a0 2024-04-25T09:05:06.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.034+0000 7f0eb7400640 1 -- 172.21.15.175:0/627609649 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0ea801a070 con 0x7f0ec01453a0 2024-04-25T09:05:06.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.034+0000 7f0eb7400640 1 --2- 172.21.15.175:0/627609649 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0e9c066f60 0x7f0e9c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:06.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.034+0000 7f0eb7400640 1 -- 172.21.15.175:0/627609649 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ea80851d0 con 0x7f0ec01453a0 2024-04-25T09:05:06.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.034+0000 7f0ebea00640 1 --2- 172.21.15.175:0/627609649 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0e9c066f60 0x7f0e9c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:06.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.038+0000 7f0ebea00640 1 --2- 172.21.15.175:0/627609649 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0e9c066f60 0x7f0e9c069420 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00ad000 tx=0x7f0eb0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:06.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.038+0000 7f0eb7400640 1 -- 172.21.15.175:0/627609649 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0ea8056270 con 0x7f0ec01453a0 2024-04-25T09:05:06.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.226+0000 7f0ec5600640 1 -- 172.21.15.175:0/627609649 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ec00cbd90 con 0x7f0ec01453a0 2024-04-25T09:05:06.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.226+0000 7f0eb7400640 1 -- 172.21.15.175:0/627609649 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f0ea8055b70 con 0x7f0ec01453a0 2024-04-25T09:05:06.218 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:06.219 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2334769483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2334769483},{"type":"v1","addr":"172.21.15.177:6834","nonce":2334769483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2397222507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2397222507},{"type":"v1","addr":"172.21.15.177:6835","nonce":2397222507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5067,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2738941530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2738941530},{"type":"v1","addr":"172.21.15.175:6836","nonce":2738941530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:02.208383+0000","modified":"2024-04-25T09:05:05.231797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1909482114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1909482114},{"type":"v1","addr":"172.21.15.175:6837","nonce":1909482114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:05:06.219 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 17 2024-04-25T09:05:06.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.226+0000 7f0ec5600640 1 -- 172.21.15.175:0/627609649 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0e9c066f60 msgr2=0x7f0e9c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:06.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.226+0000 7f0ec5600640 1 --2- 172.21.15.175:0/627609649 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0e9c066f60 0x7f0e9c069420 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0eb00ad000 tx=0x7f0eb0008040 comp rx=0 tx=0).stop 2024-04-25T09:05:06.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.226+0000 7f0ec5600640 1 -- 172.21.15.175:0/627609649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec01453a0 msgr2=0x7f0ec0143b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:06.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.226+0000 7f0ec5600640 1 --2- 172.21.15.175:0/627609649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec01453a0 0x7f0ec0143b30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800e8a0 tx=0x7f0ea800ed60 comp rx=0 tx=0).stop 2024-04-25T09:05:06.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.226+0000 7f0ec5600640 1 -- 172.21.15.175:0/627609649 shutdown_connections 2024-04-25T09:05:06.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.226+0000 7f0ec5600640 1 --2- 172.21.15.175:0/627609649 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0e9c066f60 0x7f0e9c069420 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.226+0000 7f0ec5600640 1 --2- 172.21.15.175:0/627609649 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ec0142590 0x7f0ec00afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.226+0000 7f0ec5600640 1 --2- 172.21.15.175:0/627609649 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ec01453a0 0x7f0ec0143b30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.226+0000 7f0ec5600640 1 --2- 172.21.15.175:0/627609649 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ec0144fc0 0x7f0ec015ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.226+0000 7f0ec5600640 1 -- 172.21.15.175:0/627609649 >> 172.21.15.175:0/627609649 conn(0x7f0ec00cc3b0 msgr2=0x7f0ec0164980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:06.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.226+0000 7f0ec5600640 1 -- 172.21.15.175:0/627609649 shutdown_connections 2024-04-25T09:05:06.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.226+0000 7f0ec5600640 1 -- 172.21.15.175:0/627609649 wait complete. 2024-04-25T09:05:06.239 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:06.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.382+0000 7fac1ba00640 1 Processor -- start 2024-04-25T09:05:06.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.382+0000 7fac1ba00640 1 -- start start 2024-04-25T09:05:06.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.382+0000 7fac1ba00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac1415a900 0x7fac1406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:06.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.382+0000 7fac1ba00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fac140cf560 0x7fac140cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:06.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.382+0000 7fac1ba00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac140cda00 con 0x7fac140cd520 2024-04-25T09:05:06.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.382+0000 7fac1ba00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1415bcf0 con 0x7fac140cf560 2024-04-25T09:05:06.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.382+0000 7fac1ba00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac140cfef0 con 0x7fac1415a900 2024-04-25T09:05:06.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.382+0000 7fac19a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fac140cf560 0x7fac140cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:06.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.382+0000 7fac19a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fac140cf560 0x7fac140cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32864/0 (socket says 172.21.15.175:32864) 2024-04-25T09:05:06.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.382+0000 7fac19a00640 1 -- 172.21.15.175:0/352449926 learned_addr learned my addr 172.21.15.175:0/352449926 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:06.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.382+0000 7fac19000640 1 --2- 172.21.15.175:0/352449926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac1415a900 0x7fac1406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:06.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.382+0000 7fac19a00640 1 -- 172.21.15.175:0/352449926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac1415a900 msgr2=0x7fac1406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:06.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.382+0000 7fac19a00640 1 --2- 172.21.15.175:0/352449926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac1415a900 0x7fac1406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.382+0000 7fac19a00640 1 -- 172.21.15.175:0/352449926 >> v1:172.21.15.177:6789/0 conn(0x7fac140cd520 legacy=0x7fac140ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:06.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.382+0000 7fac19a00640 1 -- 172.21.15.175:0/352449926 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac140cdce0 con 0x7fac140cf560 2024-04-25T09:05:06.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.386+0000 7fac19a00640 1 --2- 172.21.15.175:0/352449926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac140cf560 0x7fac140cf9b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009e50 tx=0x7fac0c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54022b0f64aabdc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:06.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.386+0000 7fac13e00640 1 -- 172.21.15.175:0/352449926 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c0a57f0 con 0x7fac140cf560 2024-04-25T09:05:06.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.386+0000 7fac13e00640 1 -- 172.21.15.175:0/352449926 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c0a5990 con 0x7fac140cf560 2024-04-25T09:05:06.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.386+0000 7fac13e00640 1 -- 172.21.15.175:0/352449926 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c0a5d60 con 0x7fac140cf560 2024-04-25T09:05:06.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.386+0000 7fac1ba00640 1 -- 172.21.15.175:0/352449926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac140cf560 msgr2=0x7fac140cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:06.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.386+0000 7fac1ba00640 1 --2- 172.21.15.175:0/352449926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac140cf560 0x7fac140cf9b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fac0c009e50 tx=0x7fac0c01ca30 comp rx=0 tx=0).stop 2024-04-25T09:05:06.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.386+0000 7fac1ba00640 1 -- 172.21.15.175:0/352449926 shutdown_connections 2024-04-25T09:05:06.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.386+0000 7fac1ba00640 1 --2- 172.21.15.175:0/352449926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac140cf560 0x7fac140cf9b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.386+0000 7fac1ba00640 1 --2- 172.21.15.175:0/352449926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac1415a900 0x7fac1406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.386+0000 7fac1ba00640 1 -- 172.21.15.175:0/352449926 >> 172.21.15.175:0/352449926 conn(0x7fac14067150 msgr2=0x7fac1406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:06.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.386+0000 7fac1ba00640 1 -- 172.21.15.175:0/352449926 shutdown_connections 2024-04-25T09:05:06.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.386+0000 7fac1ba00640 1 -- 172.21.15.175:0/352449926 wait complete. 2024-04-25T09:05:06.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac1ba00640 1 Processor -- start 2024-04-25T09:05:06.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac1ba00640 1 -- start start 2024-04-25T09:05:06.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac1ba00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac140cf560 0x7fac141f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:06.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac1ba00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac1415a900 0x7fac141f7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:06.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac1ba00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac140af420 0x7fac140af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:06.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac1ba00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1406d530 con 0x7fac1415a900 2024-04-25T09:05:06.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac1ba00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1406d3b0 con 0x7fac140af420 2024-04-25T09:05:06.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac1ba00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1415c790 con 0x7fac140cf560 2024-04-25T09:05:06.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac0be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac1415a900 0x7fac141f7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:06.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac0be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac1415a900 0x7fac141f7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32874/0 (socket says 172.21.15.175:32874) 2024-04-25T09:05:06.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac0be00640 1 -- 172.21.15.175:0/4012307417 learned_addr learned my addr 172.21.15.175:0/4012307417 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:06.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac19000640 1 --2- 172.21.15.175:0/4012307417 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac140cf560 0x7fac141f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:06.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac19a00640 1 --2- 172.21.15.175:0/4012307417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac140af420 0x7fac140af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:06.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac0be00640 1 -- 172.21.15.175:0/4012307417 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac140cf560 msgr2=0x7fac141f45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:06.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac0be00640 1 --2- 172.21.15.175:0/4012307417 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac140cf560 0x7fac141f45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac0be00640 1 -- 172.21.15.175:0/4012307417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac140af420 msgr2=0x7fac140af8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:06.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac0be00640 1 --2- 172.21.15.175:0/4012307417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac140af420 0x7fac140af8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac0be00640 1 -- 172.21.15.175:0/4012307417 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac141f78d0 con 0x7fac1415a900 2024-04-25T09:05:06.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac19a00640 1 --2- 172.21.15.175:0/4012307417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac140af420 0x7fac140af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:06.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac0be00640 1 --2- 172.21.15.175:0/4012307417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac1415a900 0x7fac141f7390 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fabfc00c420 tx=0x7fabfc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:06.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac11600640 1 -- 172.21.15.175:0/4012307417 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc0052d0 con 0x7fac1415a900 2024-04-25T09:05:06.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac11600640 1 -- 172.21.15.175:0/4012307417 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabfc005470 con 0x7fac1415a900 2024-04-25T09:05:06.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac11600640 1 -- 172.21.15.175:0/4012307417 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc007260 con 0x7fac1415a900 2024-04-25T09:05:06.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac1ba00640 1 -- 172.21.15.175:0/4012307417 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac140b0110 con 0x7fac1415a900 2024-04-25T09:05:06.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.390+0000 7fac1ba00640 1 -- 172.21.15.175:0/4012307417 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac140b06d0 con 0x7fac1415a900 2024-04-25T09:05:06.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.394+0000 7fac1ba00640 1 -- 172.21.15.175:0/4012307417 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac14074a60 con 0x7fac1415a900 2024-04-25T09:05:06.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.394+0000 7fac11600640 1 -- 172.21.15.175:0/4012307417 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fabfc007400 con 0x7fac1415a900 2024-04-25T09:05:06.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.394+0000 7fac11600640 1 --2- 172.21.15.175:0/4012307417 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fabf0066f60 0x7fabf0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:06.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.394+0000 7fac11600640 1 -- 172.21.15.175:0/4012307417 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabfc084550 con 0x7fac1415a900 2024-04-25T09:05:06.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.394+0000 7fac19000640 1 --2- 172.21.15.175:0/4012307417 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fabf0066f60 0x7fabf0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:06.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.394+0000 7fac19000640 1 --2- 172.21.15.175:0/4012307417 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fabf0066f60 0x7fabf0069420 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fac040079c0 tx=0x7fac04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:06.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.398+0000 7fac11600640 1 -- 172.21.15.175:0/4012307417 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fabfc054e70 con 0x7fac1415a900 2024-04-25T09:05:06.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.550+0000 7fac1ba00640 1 -- 172.21.15.175:0/4012307417 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac14071ce0 con 0x7fac1415a900 2024-04-25T09:05:06.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.554+0000 7fac11600640 1 -- 172.21.15.175:0/4012307417 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16705 (secure 0 0 0) 0x7fabfc058f10 con 0x7fac1415a900 2024-04-25T09:05:06.546 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:06.547 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":32,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:05:03.828685+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:59.880776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:01.208198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:06.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.554+0000 7fac1ba00640 1 -- 172.21.15.175:0/4012307417 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fabf0066f60 msgr2=0x7fabf0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:06.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.554+0000 7fac1ba00640 1 --2- 172.21.15.175:0/4012307417 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fabf0066f60 0x7fabf0069420 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fac040079c0 tx=0x7fac04008040 comp rx=0 tx=0).stop 2024-04-25T09:05:06.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.554+0000 7fac1ba00640 1 -- 172.21.15.175:0/4012307417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac1415a900 msgr2=0x7fac141f7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:06.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.554+0000 7fac1ba00640 1 --2- 172.21.15.175:0/4012307417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac1415a900 0x7fac141f7390 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fabfc00c420 tx=0x7fabfc00c8e0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.554+0000 7fac1ba00640 1 -- 172.21.15.175:0/4012307417 shutdown_connections 2024-04-25T09:05:06.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.554+0000 7fac1ba00640 1 --2- 172.21.15.175:0/4012307417 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fabf0066f60 0x7fabf0069420 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.554+0000 7fac1ba00640 1 --2- 172.21.15.175:0/4012307417 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac140af420 0x7fac140af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.554+0000 7fac1ba00640 1 --2- 172.21.15.175:0/4012307417 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac1415a900 0x7fac141f7390 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.554+0000 7fac1ba00640 1 --2- 172.21.15.175:0/4012307417 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac140cf560 0x7fac141f45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.554+0000 7fac1ba00640 1 -- 172.21.15.175:0/4012307417 >> 172.21.15.175:0/4012307417 conn(0x7fac140cd520 msgr2=0x7fac1406d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:06.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.554+0000 7fac1ba00640 1 -- 172.21.15.175:0/4012307417 shutdown_connections 2024-04-25T09:05:06.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.554+0000 7fac1ba00640 1 -- 172.21.15.175:0/4012307417 wait complete. 2024-04-25T09:05:06.567 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:05:06.568 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:05:06.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.710+0000 7ff0e6e00640 1 Processor -- start 2024-04-25T09:05:06.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.710+0000 7ff0e6e00640 1 -- start start 2024-04-25T09:05:06.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.710+0000 7ff0e6e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff0e0144fc0 0x7ff0e00cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:06.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.710+0000 7ff0e6e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff0e01453a0 0x7ff0e015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:06.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.710+0000 7ff0e6e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e015cd00 con 0x7ff0e00cc3b0 2024-04-25T09:05:06.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.710+0000 7ff0e6e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e00ce660 con 0x7ff0e0144fc0 2024-04-25T09:05:06.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.710+0000 7ff0e6e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00cc930 con 0x7ff0e01453a0 2024-04-25T09:05:06.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.710+0000 7ff0dfe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff0e0144fc0 0x7ff0e00cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:06.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.714+0000 7ff0dfe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff0e0144fc0 0x7ff0e00cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32888/0 (socket says 172.21.15.175:32888) 2024-04-25T09:05:06.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.714+0000 7ff0dfe00640 1 -- 172.21.15.175:0/100184451 learned_addr learned my addr 172.21.15.175:0/100184451 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:06.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.714+0000 7ff0d7400640 1 --2- 172.21.15.175:0/100184451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff0e01453a0 0x7ff0e015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:06.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.714+0000 7ff0dfe00640 1 -- 172.21.15.175:0/100184451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff0e01453a0 msgr2=0x7ff0e015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:06.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.714+0000 7ff0dfe00640 1 --2- 172.21.15.175:0/100184451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff0e01453a0 0x7ff0e015bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.714+0000 7ff0dfe00640 1 -- 172.21.15.175:0/100184451 >> v1:172.21.15.177:6789/0 conn(0x7ff0e00cc3b0 legacy=0x7ff0e015f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:06.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.714+0000 7ff0dfe00640 1 -- 172.21.15.175:0/100184451 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e00ccc10 con 0x7ff0e0144fc0 2024-04-25T09:05:06.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.714+0000 7ff0d7400640 1 --2- 172.21.15.175:0/100184451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff0e01453a0 0x7ff0e015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:06.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.714+0000 7ff0dfe00640 1 --2- 172.21.15.175:0/100184451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0e0144fc0 0x7ff0e00cbe70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009870 tx=0x7ff0d001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b42887c4d411c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:06.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.714+0000 7ff0df400640 1 -- 172.21.15.175:0/100184451 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00b1070 con 0x7ff0e0144fc0 2024-04-25T09:05:06.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.714+0000 7ff0df400640 1 -- 172.21.15.175:0/100184451 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d00ac630 con 0x7ff0e0144fc0 2024-04-25T09:05:06.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.714+0000 7ff0df400640 1 -- 172.21.15.175:0/100184451 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00a8050 con 0x7ff0e0144fc0 2024-04-25T09:05:06.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0e6e00640 1 -- 172.21.15.175:0/100184451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0e0144fc0 msgr2=0x7ff0e00cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:06.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0e6e00640 1 --2- 172.21.15.175:0/100184451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0e0144fc0 0x7ff0e00cbe70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009870 tx=0x7ff0d001c520 comp rx=0 tx=0).stop 2024-04-25T09:05:06.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0e6e00640 1 -- 172.21.15.175:0/100184451 shutdown_connections 2024-04-25T09:05:06.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0e6e00640 1 --2- 172.21.15.175:0/100184451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff0e01453a0 0x7ff0e015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0e6e00640 1 --2- 172.21.15.175:0/100184451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0e0144fc0 0x7ff0e00cbe70 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0e6e00640 1 -- 172.21.15.175:0/100184451 >> 172.21.15.175:0/100184451 conn(0x7ff0e0067150 msgr2=0x7ff0e006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:06.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0e6e00640 1 -- 172.21.15.175:0/100184451 shutdown_connections 2024-04-25T09:05:06.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0e6e00640 1 -- 172.21.15.175:0/100184451 wait complete. 2024-04-25T09:05:06.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0e6e00640 1 Processor -- start 2024-04-25T09:05:06.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0e6e00640 1 -- start start 2024-04-25T09:05:06.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0e6e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0e0144fc0 0x7ff0e015b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:06.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0e6e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0e01453a0 0x7ff0e00ab260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:06.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0e6e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff0e00ab7a0 0x7ff0e00ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:06.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0e6e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00cffb0 con 0x7ff0e01453a0 2024-04-25T09:05:06.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0e6e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e00cfe30 con 0x7ff0e0144fc0 2024-04-25T09:05:06.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0e6e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e01685f0 con 0x7ff0e00ab7a0 2024-04-25T09:05:06.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0d7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0e01453a0 0x7ff0e00ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:06.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0d7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0e01453a0 0x7ff0e00ab260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32904/0 (socket says 172.21.15.175:32904) 2024-04-25T09:05:06.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0d7400640 1 -- 172.21.15.175:0/1762513495 learned_addr learned my addr 172.21.15.175:0/1762513495 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:06.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0e4e00640 1 --2- 172.21.15.175:0/1762513495 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff0e00ab7a0 0x7ff0e00ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:06.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0dfe00640 1 --2- 172.21.15.175:0/1762513495 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0e0144fc0 0x7ff0e015b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:06.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0d7400640 1 -- 172.21.15.175:0/1762513495 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff0e00ab7a0 msgr2=0x7ff0e00ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:06.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0d7400640 1 --2- 172.21.15.175:0/1762513495 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff0e00ab7a0 0x7ff0e00ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0d7400640 1 -- 172.21.15.175:0/1762513495 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0e0144fc0 msgr2=0x7ff0e015b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:06.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0d7400640 1 --2- 172.21.15.175:0/1762513495 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0e0144fc0 0x7ff0e015b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0d7400640 1 -- 172.21.15.175:0/1762513495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e015b750 con 0x7ff0e01453a0 2024-04-25T09:05:06.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.718+0000 7ff0d7400640 1 --2- 172.21.15.175:0/1762513495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0e01453a0 0x7ff0e00ab260 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800c7f0 tx=0x7ff0c800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:06.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.722+0000 7ff0dcc00640 1 -- 172.21.15.175:0/1762513495 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8015070 con 0x7ff0e01453a0 2024-04-25T09:05:06.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.722+0000 7ff0dcc00640 1 -- 172.21.15.175:0/1762513495 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c8007820 con 0x7ff0e01453a0 2024-04-25T09:05:06.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.722+0000 7ff0dcc00640 1 -- 172.21.15.175:0/1762513495 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8007c10 con 0x7ff0e01453a0 2024-04-25T09:05:06.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.722+0000 7ff0e6e00640 1 -- 172.21.15.175:0/1762513495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e0135ba0 con 0x7ff0e01453a0 2024-04-25T09:05:06.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.722+0000 7ff0e6e00640 1 -- 172.21.15.175:0/1762513495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e00ae200 con 0x7ff0e01453a0 2024-04-25T09:05:06.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.722+0000 7ff0e6e00640 1 -- 172.21.15.175:0/1762513495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e00abbb0 con 0x7ff0e01453a0 2024-04-25T09:05:06.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.722+0000 7ff0dcc00640 1 -- 172.21.15.175:0/1762513495 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff0c8018070 con 0x7ff0e01453a0 2024-04-25T09:05:06.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.722+0000 7ff0dcc00640 1 --2- 172.21.15.175:0/1762513495 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff0bc066f60 0x7ff0bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:06.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.722+0000 7ff0dcc00640 1 -- 172.21.15.175:0/1762513495 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0c8085110 con 0x7ff0e01453a0 2024-04-25T09:05:06.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.722+0000 7ff0dfe00640 1 --2- 172.21.15.175:0/1762513495 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff0bc066f60 0x7ff0bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:06.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.722+0000 7ff0dfe00640 1 --2- 172.21.15.175:0/1762513495 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff0bc066f60 0x7ff0bc069420 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00ae000 tx=0x7ff0d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:06.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.726+0000 7ff0dcc00640 1 -- 172.21.15.175:0/1762513495 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff0e00abbb0 con 0x7ff0e01453a0 2024-04-25T09:05:06.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.878+0000 7ff0e6e00640 1 -- 172.21.15.175:0/1762513495 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0e00af660 con 0x7ff0bc066f60 2024-04-25T09:05:06.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.886+0000 7ff0dcc00640 1 -- 172.21.15.175:0/1762513495 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246635 (secure 0 0 0) 0x7ff0e00af660 con 0x7ff0bc066f60 2024-04-25T09:05:06.880 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:06.881 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:05:06.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.886+0000 7ff0e6e00640 1 -- 172.21.15.175:0/1762513495 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff0bc066f60 msgr2=0x7ff0bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:06.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.886+0000 7ff0e6e00640 1 --2- 172.21.15.175:0/1762513495 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff0bc066f60 0x7ff0bc069420 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00ae000 tx=0x7ff0d0008040 comp rx=0 tx=0).stop 2024-04-25T09:05:06.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.886+0000 7ff0e6e00640 1 -- 172.21.15.175:0/1762513495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0e01453a0 msgr2=0x7ff0e00ab260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:06.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.886+0000 7ff0e6e00640 1 --2- 172.21.15.175:0/1762513495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0e01453a0 0x7ff0e00ab260 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800c7f0 tx=0x7ff0c800ccb0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.890+0000 7ff0e6e00640 1 -- 172.21.15.175:0/1762513495 shutdown_connections 2024-04-25T09:05:06.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.890+0000 7ff0e6e00640 1 --2- 172.21.15.175:0/1762513495 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff0bc066f60 0x7ff0bc069420 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.890+0000 7ff0e6e00640 1 --2- 172.21.15.175:0/1762513495 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff0e00ab7a0 0x7ff0e00ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.890+0000 7ff0e6e00640 1 --2- 172.21.15.175:0/1762513495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0e01453a0 0x7ff0e00ab260 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.890+0000 7ff0e6e00640 1 --2- 172.21.15.175:0/1762513495 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0e0144fc0 0x7ff0e015b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:06.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.890+0000 7ff0e6e00640 1 -- 172.21.15.175:0/1762513495 >> 172.21.15.175:0/1762513495 conn(0x7ff0e00cc3b0 msgr2=0x7ff0e0143d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:06.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.890+0000 7ff0e6e00640 1 -- 172.21.15.175:0/1762513495 shutdown_connections 2024-04-25T09:05:06.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:06.890+0000 7ff0e6e00640 1 -- 172.21.15.175:0/1762513495 wait complete. 2024-04-25T09:05:06.900 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-04-25T09:05:05.800408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219932,"kb_used_data":3772,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754788,"statfs":{"total":773094113280,"available":772868902912,"internally_reserved":0,"allocated":3862528,"data_stored":2194533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.980347"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833032+0000","last_change":"2024-04-25T09:05:01.833032+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833032+0000","last_undegraded":"2024-04-25T09:05:01.833032+0000","last_fullsized":"2024-04-25T09:05:01.833032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.845672+0000","last_change":"2024-04-25T09:05:01.845672+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.845672+0000","last_undegraded":"2024-04-25T09:05:01.845672+0000","last_fullsized":"2024-04-25T09:05:01.845672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.838784+0000","last_change":"2024-04-25T09:05:01.838784+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.838784+0000","last_undegraded":"2024-04-25T09:05:01.838784+0000","last_fullsized":"2024-04-25T09:05:01.838784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.837977+0000","last_change":"2024-04-25T09:05:01.837977+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.837977+0000","last_undegraded":"2024-04-25T09:05:01.837977+0000","last_fullsized":"2024-04-25T09:05:01.837977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833379+0000","last_change":"2024-04-25T09:05:01.833379+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833379+0000","last_undegraded":"2024-04-25T09:05:01.833379+0000","last_fullsized":"2024-04-25T09:05:01.833379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.842224+0000","last_change":"2024-04-25T09:05:01.842224+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.842224+0000","last_undegraded":"2024-04-25T09:05:01.842224+0000","last_fullsized":"2024-04-25T09:05:01.842224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.840686+0000","last_change":"2024-04-25T09:05:01.840686+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.840686+0000","last_undegraded":"2024-04-25T09:05:01.840686+0000","last_fullsized":"2024-04-25T09:05:01.840686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.851836+0000","last_change":"2024-04-25T09:05:01.851836+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.851836+0000","last_undegraded":"2024-04-25T09:05:01.851836+0000","last_fullsized":"2024-04-25T09:05:01.851836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833603+0000","last_change":"2024-04-25T09:05:01.833603+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833603+0000","last_undegraded":"2024-04-25T09:05:01.833603+0000","last_fullsized":"2024-04-25T09:05:01.833603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.836810+0000","last_change":"2024-04-25T09:05:01.836810+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.836810+0000","last_undegraded":"2024-04-25T09:05:01.836810+0000","last_fullsized":"2024-04-25T09:05:01.836810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839339+0000","last_change":"2024-04-25T09:05:01.839339+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839339+0000","last_undegraded":"2024-04-25T09:05:01.839339+0000","last_fullsized":"2024-04-25T09:05:01.839339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.841743+0000","last_change":"2024-04-25T09:05:01.841743+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.841743+0000","last_undegraded":"2024-04-25T09:05:01.841743+0000","last_fullsized":"2024-04-25T09:05:01.841743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832950+0000","last_change":"2024-04-25T09:05:01.832950+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832950+0000","last_undegraded":"2024-04-25T09:05:01.832950+0000","last_fullsized":"2024-04-25T09:05:01.832950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.841723+0000","last_change":"2024-04-25T09:05:01.841723+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.841723+0000","last_undegraded":"2024-04-25T09:05:01.841723+0000","last_fullsized":"2024-04-25T09:05:01.841723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839516+0000","last_change":"2024-04-25T09:05:01.839516+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839516+0000","last_undegraded":"2024-04-25T09:05:01.839516+0000","last_fullsized":"2024-04-25T09:05:01.839516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839997+0000","last_change":"2024-04-25T09:05:01.839997+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839997+0000","last_undegraded":"2024-04-25T09:05:01.839997+0000","last_fullsized":"2024-04-25T09:05:01.839997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.841319+0000","last_change":"2024-04-25T09:05:01.841319+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.841319+0000","last_undegraded":"2024-04-25T09:05:01.841319+0000","last_fullsized":"2024-04-25T09:05:01.841319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.845160+0000","last_change":"2024-04-25T09:05:01.845160+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.845160+0000","last_undegraded":"2024-04-25T09:05:01.845160+0000","last_fullsized":"2024-04-25T09:05:01.845160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833082+0000","last_change":"2024-04-25T09:05:01.833082+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833082+0000","last_undegraded":"2024-04-25T09:05:01.833082+0000","last_fullsized":"2024-04-25T09:05:01.833082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.834309+0000","last_change":"2024-04-25T09:05:01.834309+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.834309+0000","last_undegraded":"2024-04-25T09:05:01.834309+0000","last_fullsized":"2024-04-25T09:05:01.834309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.835652+0000","last_change":"2024-04-25T09:05:01.835652+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.835652+0000","last_undegraded":"2024-04-25T09:05:01.835652+0000","last_fullsized":"2024-04-25T09:05:01.835652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.834258+0000","last_change":"2024-04-25T09:05:01.834258+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.834258+0000","last_undegraded":"2024-04-25T09:05:01.834258+0000","last_fullsized":"2024-04-25T09:05:01.834258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833902+0000","last_change":"2024-04-25T09:05:01.833902+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833902+0000","last_undegraded":"2024-04-25T09:05:01.833902+0000","last_fullsized":"2024-04-25T09:05:01.833902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.837758+0000","last_change":"2024-04-25T09:05:01.837758+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.837758+0000","last_undegraded":"2024-04-25T09:05:01.837758+0000","last_fullsized":"2024-04-25T09:05:01.837758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839814+0000","last_change":"2024-04-25T09:05:01.839814+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839814+0000","last_undegraded":"2024-04-25T09:05:01.839814+0000","last_fullsized":"2024-04-25T09:05:01.839814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.844759+0000","last_change":"2024-04-25T09:05:01.844759+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.844759+0000","last_undegraded":"2024-04-25T09:05:01.844759+0000","last_fullsized":"2024-04-25T09:05:01.844759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.848547+0000","last_change":"2024-04-25T09:05:01.848547+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.848547+0000","last_undegraded":"2024-04-25T09:05:01.848547+0000","last_fullsized":"2024-04-25T09:05:01.848547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.838376+0000","last_change":"2024-04-25T09:05:01.838376+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.838376+0000","last_undegraded":"2024-04-25T09:05:01.838376+0000","last_fullsized":"2024-04-25T09:05:01.838376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.835174+0000","last_change":"2024-04-25T09:05:01.835174+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.835174+0000","last_undegraded":"2024-04-25T09:05:01.835174+0000","last_fullsized":"2024-04-25T09:05:01.835174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.840595+0000","last_change":"2024-04-25T09:05:01.840595+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.840595+0000","last_undegraded":"2024-04-25T09:05:01.840595+0000","last_fullsized":"2024-04-25T09:05:01.840595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833068+0000","last_change":"2024-04-25T09:05:01.833068+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833068+0000","last_undegraded":"2024-04-25T09:05:01.833068+0000","last_fullsized":"2024-04-25T09:05:01.833068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.851467+0000","last_change":"2024-04-25T09:05:01.851467+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.851467+0000","last_undegraded":"2024-04-25T09:05:01.851467+0000","last_fullsized":"2024-04-25T09:05:01.851467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833477+0000","last_change":"2024-04-25T09:05:01.833477+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833477+0000","last_undegraded":"2024-04-25T09:05:01.833477+0000","last_fullsized":"2024-04-25T09:05:01.833477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.862365+0000","last_change":"2024-04-25T09:05:01.859475+0000","last_active":"2024-04-25T09:05:01.862365+0000","last_peered":"2024-04-25T09:05:01.862365+0000","last_clean":"2024-04-25T09:05:01.862365+0000","last_became_active":"2024-04-25T09:05:01.859205+0000","last_became_peered":"2024-04-25T09:05:01.859205+0000","last_unstale":"2024-04-25T09:05:01.862365+0000","last_undegraded":"2024-04-25T09:05:01.862365+0000","last_fullsized":"2024-04-25T09:05:01.862365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:54.535074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832441+0000","last_change":"2024-04-25T09:05:01.832441+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832441+0000","last_undegraded":"2024-04-25T09:05:01.832441+0000","last_fullsized":"2024-04-25T09:05:01.832441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.852329+0000","last_change":"2024-04-25T09:05:01.851020+0000","last_active":"2024-04-25T09:05:01.852329+0000","last_peered":"2024-04-25T09:05:01.852329+0000","last_clean":"2024-04-25T09:05:01.852329+0000","last_became_active":"2024-04-25T09:05:01.850367+0000","last_became_peered":"2024-04-25T09:05:01.850367+0000","last_unstale":"2024-04-25T09:05:01.852329+0000","last_undegraded":"2024-04-25T09:05:01.852329+0000","last_fullsized":"2024-04-25T09:05:01.852329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:54.535074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833820+0000","last_change":"2024-04-25T09:05:01.833820+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833820+0000","last_undegraded":"2024-04-25T09:05:01.833820+0000","last_fullsized":"2024-04-25T09:05:01.833820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.857147+0000","last_change":"2024-04-25T09:05:01.855321+0000","last_active":"2024-04-25T09:05:01.857147+0000","last_peered":"2024-04-25T09:05:01.857147+0000","last_clean":"2024-04-25T09:05:01.857147+0000","last_became_active":"2024-04-25T09:05:01.854980+0000","last_became_peered":"2024-04-25T09:05:01.854980+0000","last_unstale":"2024-04-25T09:05:01.857147+0000","last_undegraded":"2024-04-25T09:05:01.857147+0000","last_fullsized":"2024-04-25T09:05:01.857147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:01.847172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.848097+0000","last_change":"2024-04-25T09:05:01.848097+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.848097+0000","last_undegraded":"2024-04-25T09:05:01.848097+0000","last_fullsized":"2024-04-25T09:05:01.848097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.857066+0000","last_change":"2024-04-25T09:05:01.855383+0000","last_active":"2024-04-25T09:05:01.857066+0000","last_peered":"2024-04-25T09:05:01.857066+0000","last_clean":"2024-04-25T09:05:01.857066+0000","last_became_active":"2024-04-25T09:05:01.855114+0000","last_became_peered":"2024-04-25T09:05:01.855114+0000","last_unstale":"2024-04-25T09:05:01.857066+0000","last_undegraded":"2024-04-25T09:05:01.857066+0000","last_fullsized":"2024-04-25T09:05:01.857066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:30.365760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839360+0000","last_change":"2024-04-25T09:05:01.839360+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839360+0000","last_undegraded":"2024-04-25T09:05:01.839360+0000","last_fullsized":"2024-04-25T09:05:01.839360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.853680+0000","last_change":"2024-04-25T09:05:01.850620+0000","last_active":"2024-04-25T09:05:01.853680+0000","last_peered":"2024-04-25T09:05:01.853680+0000","last_clean":"2024-04-25T09:05:01.853680+0000","last_became_active":"2024-04-25T09:05:01.850289+0000","last_became_peered":"2024-04-25T09:05:01.850289+0000","last_unstale":"2024-04-25T09:05:01.853680+0000","last_undegraded":"2024-04-25T09:05:01.853680+0000","last_fullsized":"2024-04-25T09:05:01.853680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:07.320232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.847081+0000","last_change":"2024-04-25T09:05:01.847081+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.847081+0000","last_undegraded":"2024-04-25T09:05:01.847081+0000","last_fullsized":"2024-04-25T09:05:01.847081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.856102+0000","last_change":"2024-04-25T09:05:01.853233+0000","last_active":"2024-04-25T09:05:01.856102+0000","last_peered":"2024-04-25T09:05:01.856102+0000","last_clean":"2024-04-25T09:05:01.856102+0000","last_became_active":"2024-04-25T09:05:01.852944+0000","last_became_peered":"2024-04-25T09:05:01.852944+0000","last_unstale":"2024-04-25T09:05:01.856102+0000","last_undegraded":"2024-04-25T09:05:01.856102+0000","last_fullsized":"2024-04-25T09:05:01.856102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:21.522852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833667+0000","last_change":"2024-04-25T09:05:01.833667+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833667+0000","last_undegraded":"2024-04-25T09:05:01.833667+0000","last_fullsized":"2024-04-25T09:05:01.833667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.846208+0000","last_change":"2024-04-25T09:05:01.842765+0000","last_active":"2024-04-25T09:05:01.846208+0000","last_peered":"2024-04-25T09:05:01.846208+0000","last_clean":"2024-04-25T09:05:01.846208+0000","last_became_active":"2024-04-25T09:05:01.842535+0000","last_became_peered":"2024-04-25T09:05:01.842535+0000","last_unstale":"2024-04-25T09:05:01.846208+0000","last_undegraded":"2024-04-25T09:05:01.846208+0000","last_fullsized":"2024-04-25T09:05:01.846208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:07.078383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.836163+0000","last_change":"2024-04-25T09:05:01.836163+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.836163+0000","last_undegraded":"2024-04-25T09:05:01.836163+0000","last_fullsized":"2024-04-25T09:05:01.836163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.848730+0000","last_change":"2024-04-25T09:05:01.844077+0000","last_active":"2024-04-25T09:05:01.848730+0000","last_peered":"2024-04-25T09:05:01.848730+0000","last_clean":"2024-04-25T09:05:01.848730+0000","last_became_active":"2024-04-25T09:05:01.843762+0000","last_became_peered":"2024-04-25T09:05:01.843762+0000","last_unstale":"2024-04-25T09:05:01.848730+0000","last_undegraded":"2024-04-25T09:05:01.848730+0000","last_fullsized":"2024-04-25T09:05:01.848730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:47.729359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.838868+0000","last_change":"2024-04-25T09:05:01.838868+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.838868+0000","last_undegraded":"2024-04-25T09:05:01.838868+0000","last_fullsized":"2024-04-25T09:05:01.838868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.860357+0000","last_change":"2024-04-25T09:05:01.858030+0000","last_active":"2024-04-25T09:05:01.860357+0000","last_peered":"2024-04-25T09:05:01.860357+0000","last_clean":"2024-04-25T09:05:01.860357+0000","last_became_active":"2024-04-25T09:05:01.857784+0000","last_became_peered":"2024-04-25T09:05:01.857784+0000","last_unstale":"2024-04-25T09:05:01.860357+0000","last_undegraded":"2024-04-25T09:05:01.860357+0000","last_fullsized":"2024-04-25T09:05:01.860357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:37.505024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.844325+0000","last_change":"2024-04-25T09:05:01.844325+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.844325+0000","last_undegraded":"2024-04-25T09:05:01.844325+0000","last_fullsized":"2024-04-25T09:05:01.844325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.852437+0000","last_change":"2024-04-25T09:05:01.851249+0000","last_active":"2024-04-25T09:05:01.852437+0000","last_peered":"2024-04-25T09:05:01.852437+0000","last_clean":"2024-04-25T09:05:01.852437+0000","last_became_active":"2024-04-25T09:05:01.850775+0000","last_became_peered":"2024-04-25T09:05:01.850775+0000","last_unstale":"2024-04-25T09:05:01.852437+0000","last_undegraded":"2024-04-25T09:05:01.852437+0000","last_fullsized":"2024-04-25T09:05:01.852437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:55.907137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.835093+0000","last_change":"2024-04-25T09:05:01.835093+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.835093+0000","last_undegraded":"2024-04-25T09:05:01.835093+0000","last_fullsized":"2024-04-25T09:05:01.835093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.862229+0000","last_change":"2024-04-25T09:05:01.860048+0000","last_active":"2024-04-25T09:05:01.862229+0000","last_peered":"2024-04-25T09:05:01.862229+0000","last_clean":"2024-04-25T09:05:01.862229+0000","last_became_active":"2024-04-25T09:05:01.859751+0000","last_became_peered":"2024-04-25T09:05:01.859751+0000","last_unstale":"2024-04-25T09:05:01.862229+0000","last_undegraded":"2024-04-25T09:05:01.862229+0000","last_fullsized":"2024-04-25T09:05:01.862229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:50.944782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.848015+0000","last_change":"2024-04-25T09:05:01.848015+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.848015+0000","last_undegraded":"2024-04-25T09:05:01.848015+0000","last_fullsized":"2024-04-25T09:05:01.848015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.855982+0000","last_change":"2024-04-25T09:05:01.853200+0000","last_active":"2024-04-25T09:05:01.855982+0000","last_peered":"2024-04-25T09:05:01.855982+0000","last_clean":"2024-04-25T09:05:01.855982+0000","last_became_active":"2024-04-25T09:05:01.851932+0000","last_became_peered":"2024-04-25T09:05:01.851932+0000","last_unstale":"2024-04-25T09:05:01.855982+0000","last_undegraded":"2024-04-25T09:05:01.855982+0000","last_fullsized":"2024-04-25T09:05:01.855982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:10.494318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839776+0000","last_change":"2024-04-25T09:05:01.839776+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839776+0000","last_undegraded":"2024-04-25T09:05:01.839776+0000","last_fullsized":"2024-04-25T09:05:01.839776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.848760+0000","last_change":"2024-04-25T09:05:01.844545+0000","last_active":"2024-04-25T09:05:01.848760+0000","last_peered":"2024-04-25T09:05:01.848760+0000","last_clean":"2024-04-25T09:05:01.848760+0000","last_became_active":"2024-04-25T09:05:01.843748+0000","last_became_peered":"2024-04-25T09:05:01.843748+0000","last_unstale":"2024-04-25T09:05:01.848760+0000","last_undegraded":"2024-04-25T09:05:01.848760+0000","last_fullsized":"2024-04-25T09:05:01.848760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:32.762758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832733+0000","last_change":"2024-04-25T09:05:01.832733+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832733+0000","last_undegraded":"2024-04-25T09:05:01.832733+0000","last_fullsized":"2024-04-25T09:05:01.832733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.856328+0000","last_change":"2024-04-25T09:05:01.853811+0000","last_active":"2024-04-25T09:05:01.856328+0000","last_peered":"2024-04-25T09:05:01.856328+0000","last_clean":"2024-04-25T09:05:01.856328+0000","last_became_active":"2024-04-25T09:05:01.853511+0000","last_became_peered":"2024-04-25T09:05:01.853511+0000","last_unstale":"2024-04-25T09:05:01.856328+0000","last_undegraded":"2024-04-25T09:05:01.856328+0000","last_fullsized":"2024-04-25T09:05:01.856328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:52.353215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.851022+0000","last_change":"2024-04-25T09:05:01.851022+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.851022+0000","last_undegraded":"2024-04-25T09:05:01.851022+0000","last_fullsized":"2024-04-25T09:05:01.851022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.853525+0000","last_change":"2024-04-25T09:05:01.849597+0000","last_active":"2024-04-25T09:05:01.853525+0000","last_peered":"2024-04-25T09:05:01.853525+0000","last_clean":"2024-04-25T09:05:01.853525+0000","last_became_active":"2024-04-25T09:05:01.849343+0000","last_became_peered":"2024-04-25T09:05:01.849343+0000","last_unstale":"2024-04-25T09:05:01.853525+0000","last_undegraded":"2024-04-25T09:05:01.853525+0000","last_fullsized":"2024-04-25T09:05:01.853525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:23.553154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832450+0000","last_change":"2024-04-25T09:05:01.832450+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832450+0000","last_undegraded":"2024-04-25T09:05:01.832450+0000","last_fullsized":"2024-04-25T09:05:01.832450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.847526+0000","last_change":"2024-04-25T09:05:01.845805+0000","last_active":"2024-04-25T09:05:01.847526+0000","last_peered":"2024-04-25T09:05:01.847526+0000","last_clean":"2024-04-25T09:05:01.847526+0000","last_became_active":"2024-04-25T09:05:01.845373+0000","last_became_peered":"2024-04-25T09:05:01.845373+0000","last_unstale":"2024-04-25T09:05:01.847526+0000","last_undegraded":"2024-04-25T09:05:01.847526+0000","last_fullsized":"2024-04-25T09:05:01.847526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:15.508830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.835237+0000","last_change":"2024-04-25T09:05:01.835237+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.835237+0000","last_undegraded":"2024-04-25T09:05:01.835237+0000","last_fullsized":"2024-04-25T09:05:01.835237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.855778+0000","last_change":"2024-04-25T09:05:01.853103+0000","last_active":"2024-04-25T09:05:01.855778+0000","last_peered":"2024-04-25T09:05:01.855778+0000","last_clean":"2024-04-25T09:05:01.855778+0000","last_became_active":"2024-04-25T09:05:01.852683+0000","last_became_peered":"2024-04-25T09:05:01.852683+0000","last_unstale":"2024-04-25T09:05:01.855778+0000","last_undegraded":"2024-04-25T09:05:01.855778+0000","last_fullsized":"2024-04-25T09:05:01.855778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:22.640219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.845105+0000","last_change":"2024-04-25T09:05:01.845105+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.845105+0000","last_undegraded":"2024-04-25T09:05:01.845105+0000","last_fullsized":"2024-04-25T09:05:01.845105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.851325+0000","last_change":"2024-04-25T09:05:01.846615+0000","last_active":"2024-04-25T09:05:01.851325+0000","last_peered":"2024-04-25T09:05:01.851325+0000","last_clean":"2024-04-25T09:05:01.851325+0000","last_became_active":"2024-04-25T09:05:01.846321+0000","last_became_peered":"2024-04-25T09:05:01.846321+0000","last_unstale":"2024-04-25T09:05:01.851325+0000","last_undegraded":"2024-04-25T09:05:01.851325+0000","last_fullsized":"2024-04-25T09:05:01.851325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:30.103785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.837557+0000","last_change":"2024-04-25T09:05:01.837557+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.837557+0000","last_undegraded":"2024-04-25T09:05:01.837557+0000","last_fullsized":"2024-04-25T09:05:01.837557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.851132+0000","last_change":"2024-04-25T09:05:01.845678+0000","last_active":"2024-04-25T09:05:01.851132+0000","last_peered":"2024-04-25T09:05:01.851132+0000","last_clean":"2024-04-25T09:05:01.851132+0000","last_became_active":"2024-04-25T09:05:01.845394+0000","last_became_peered":"2024-04-25T09:05:01.845394+0000","last_unstale":"2024-04-25T09:05:01.851132+0000","last_undegraded":"2024-04-25T09:05:01.851132+0000","last_fullsized":"2024-04-25T09:05:01.851132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:30.365760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832917+0000","last_change":"2024-04-25T09:05:01.832917+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832917+0000","last_undegraded":"2024-04-25T09:05:01.832917+0000","last_fullsized":"2024-04-25T09:05:01.832917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.855987+0000","last_change":"2024-04-25T09:05:01.850960+0000","last_active":"2024-04-25T09:05:01.855987+0000","last_peered":"2024-04-25T09:05:01.855987+0000","last_clean":"2024-04-25T09:05:01.855987+0000","last_became_active":"2024-04-25T09:05:01.850670+0000","last_became_peered":"2024-04-25T09:05:01.850670+0000","last_unstale":"2024-04-25T09:05:01.855987+0000","last_undegraded":"2024-04-25T09:05:01.855987+0000","last_fullsized":"2024-04-25T09:05:01.855987+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:59.624866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832469+0000","last_change":"2024-04-25T09:05:01.832469+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832469+0000","last_undegraded":"2024-04-25T09:05:01.832469+0000","last_fullsized":"2024-04-25T09:05:01.832469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.843938+0000","last_change":"2024-04-25T09:05:01.841773+0000","last_active":"2024-04-25T09:05:01.843938+0000","last_peered":"2024-04-25T09:05:01.843938+0000","last_clean":"2024-04-25T09:05:01.843938+0000","last_became_active":"2024-04-25T09:05:01.841485+0000","last_became_peered":"2024-04-25T09:05:01.841485+0000","last_unstale":"2024-04-25T09:05:01.843938+0000","last_undegraded":"2024-04-25T09:05:01.843938+0000","last_fullsized":"2024-04-25T09:05:01.843938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:40.689654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832490+0000","last_change":"2024-04-25T09:05:01.832490+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832490+0000","last_undegraded":"2024-04-25T09:05:01.832490+0000","last_fullsized":"2024-04-25T09:05:01.832490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.861723+0000","last_change":"2024-04-25T09:05:01.856230+0000","last_active":"2024-04-25T09:05:01.861723+0000","last_peered":"2024-04-25T09:05:01.861723+0000","last_clean":"2024-04-25T09:05:01.861723+0000","last_became_active":"2024-04-25T09:05:01.855929+0000","last_became_peered":"2024-04-25T09:05:01.855929+0000","last_unstale":"2024-04-25T09:05:01.861723+0000","last_undegraded":"2024-04-25T09:05:01.861723+0000","last_fullsized":"2024-04-25T09:05:01.861723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:45.459385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832449+0000","last_change":"2024-04-25T09:05:01.832449+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832449+0000","last_undegraded":"2024-04-25T09:05:01.832449+0000","last_fullsized":"2024-04-25T09:05:01.832449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.845948+0000","last_change":"2024-04-25T09:05:01.842494+0000","last_active":"2024-04-25T09:05:01.845948+0000","last_peered":"2024-04-25T09:05:01.845948+0000","last_clean":"2024-04-25T09:05:01.845948+0000","last_became_active":"2024-04-25T09:05:01.842187+0000","last_became_peered":"2024-04-25T09:05:01.842187+0000","last_unstale":"2024-04-25T09:05:01.845948+0000","last_undegraded":"2024-04-25T09:05:01.845948+0000","last_fullsized":"2024-04-25T09:05:01.845948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:29.852470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.840941+0000","last_change":"2024-04-25T09:05:01.840941+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.840941+0000","last_undegraded":"2024-04-25T09:05:01.840941+0000","last_fullsized":"2024-04-25T09:05:01.840941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.859059+0000","last_change":"2024-04-25T09:05:01.853085+0000","last_active":"2024-04-25T09:05:01.859059+0000","last_peered":"2024-04-25T09:05:01.859059+0000","last_clean":"2024-04-25T09:05:01.859059+0000","last_became_active":"2024-04-25T09:05:01.852672+0000","last_became_peered":"2024-04-25T09:05:01.852672+0000","last_unstale":"2024-04-25T09:05:01.859059+0000","last_undegraded":"2024-04-25T09:05:01.859059+0000","last_fullsized":"2024-04-25T09:05:01.859059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:28.059026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833669+0000","last_change":"2024-04-25T09:05:01.833669+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833669+0000","last_undegraded":"2024-04-25T09:05:01.833669+0000","last_fullsized":"2024-04-25T09:05:01.833669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.862078+0000","last_change":"2024-04-25T09:05:01.859966+0000","last_active":"2024-04-25T09:05:01.862078+0000","last_peered":"2024-04-25T09:05:01.862078+0000","last_clean":"2024-04-25T09:05:01.862078+0000","last_became_active":"2024-04-25T09:05:01.859591+0000","last_became_peered":"2024-04-25T09:05:01.859591+0000","last_unstale":"2024-04-25T09:05:01.862078+0000","last_undegraded":"2024-04-25T09:05:01.862078+0000","last_fullsized":"2024-04-25T09:05:01.862078+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:48.677980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.844758+0000","last_change":"2024-04-25T09:05:01.844758+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.844758+0000","last_undegraded":"2024-04-25T09:05:01.844758+0000","last_fullsized":"2024-04-25T09:05:01.844758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.843735+0000","last_change":"2024-04-25T09:05:01.841767+0000","last_active":"2024-04-25T09:05:01.843735+0000","last_peered":"2024-04-25T09:05:01.843735+0000","last_clean":"2024-04-25T09:05:01.843735+0000","last_became_active":"2024-04-25T09:05:01.841486+0000","last_became_peered":"2024-04-25T09:05:01.841486+0000","last_unstale":"2024-04-25T09:05:01.843735+0000","last_undegraded":"2024-04-25T09:05:01.843735+0000","last_fullsized":"2024-04-25T09:05:01.843735+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:45.459385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832615+0000","last_change":"2024-04-25T09:05:01.832615+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832615+0000","last_undegraded":"2024-04-25T09:05:01.832615+0000","last_fullsized":"2024-04-25T09:05:01.832615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.855328+0000","last_change":"2024-04-25T09:05:01.853095+0000","last_active":"2024-04-25T09:05:01.855328+0000","last_peered":"2024-04-25T09:05:01.855328+0000","last_clean":"2024-04-25T09:05:01.855328+0000","last_became_active":"2024-04-25T09:05:01.852739+0000","last_became_peered":"2024-04-25T09:05:01.852739+0000","last_unstale":"2024-04-25T09:05:01.855328+0000","last_undegraded":"2024-04-25T09:05:01.855328+0000","last_fullsized":"2024-04-25T09:05:01.855328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:55.907137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.834556+0000","last_change":"2024-04-25T09:05:01.834556+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.834556+0000","last_undegraded":"2024-04-25T09:05:01.834556+0000","last_fullsized":"2024-04-25T09:05:01.834556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.860191+0000","last_change":"2024-04-25T09:05:01.858937+0000","last_active":"2024-04-25T09:05:01.860191+0000","last_peered":"2024-04-25T09:05:01.860191+0000","last_clean":"2024-04-25T09:05:01.860191+0000","last_became_active":"2024-04-25T09:05:01.858636+0000","last_became_peered":"2024-04-25T09:05:01.858636+0000","last_unstale":"2024-04-25T09:05:01.860191+0000","last_undegraded":"2024-04-25T09:05:01.860191+0000","last_fullsized":"2024-04-25T09:05:01.860191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:22.640219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832222+0000","last_change":"2024-04-25T09:05:01.832222+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832222+0000","last_undegraded":"2024-04-25T09:05:01.832222+0000","last_fullsized":"2024-04-25T09:05:01.832222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.862061+0000","last_change":"2024-04-25T09:05:01.859845+0000","last_active":"2024-04-25T09:05:01.862061+0000","last_peered":"2024-04-25T09:05:01.862061+0000","last_clean":"2024-04-25T09:05:01.862061+0000","last_became_active":"2024-04-25T09:05:01.859553+0000","last_became_peered":"2024-04-25T09:05:01.859553+0000","last_unstale":"2024-04-25T09:05:01.862061+0000","last_undegraded":"2024-04-25T09:05:01.862061+0000","last_fullsized":"2024-04-25T09:05:01.862061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:03.855826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.838757+0000","last_change":"2024-04-25T09:05:01.838757+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.838757+0000","last_undegraded":"2024-04-25T09:05:01.838757+0000","last_fullsized":"2024-04-25T09:05:01.838757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.861795+0000","last_change":"2024-04-25T09:05:01.860397+0000","last_active":"2024-04-25T09:05:01.861795+0000","last_peered":"2024-04-25T09:05:01.861795+0000","last_clean":"2024-04-25T09:05:01.861795+0000","last_became_active":"2024-04-25T09:05:01.859885+0000","last_became_peered":"2024-04-25T09:05:01.859885+0000","last_unstale":"2024-04-25T09:05:01.861795+0000","last_undegraded":"2024-04-25T09:05:01.861795+0000","last_fullsized":"2024-04-25T09:05:01.861795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:51.382457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.834694+0000","last_change":"2024-04-25T09:05:01.834694+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.834694+0000","last_undegraded":"2024-04-25T09:05:01.834694+0000","last_fullsized":"2024-04-25T09:05:01.834694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.857124+0000","last_change":"2024-04-25T09:05:01.854637+0000","last_active":"2024-04-25T09:05:01.857124+0000","last_peered":"2024-04-25T09:05:01.857124+0000","last_clean":"2024-04-25T09:05:01.857124+0000","last_became_active":"2024-04-25T09:05:01.854045+0000","last_became_peered":"2024-04-25T09:05:01.854045+0000","last_unstale":"2024-04-25T09:05:01.857124+0000","last_undegraded":"2024-04-25T09:05:01.857124+0000","last_fullsized":"2024-04-25T09:05:01.857124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:12.759868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.842018+0000","last_change":"2024-04-25T09:05:01.842018+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.842018+0000","last_undegraded":"2024-04-25T09:05:01.842018+0000","last_fullsized":"2024-04-25T09:05:01.842018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.848920+0000","last_change":"2024-04-25T09:05:01.844352+0000","last_active":"2024-04-25T09:05:01.848920+0000","last_peered":"2024-04-25T09:05:01.848920+0000","last_clean":"2024-04-25T09:05:01.848920+0000","last_became_active":"2024-04-25T09:05:01.843530+0000","last_became_peered":"2024-04-25T09:05:01.843530+0000","last_unstale":"2024-04-25T09:05:01.848920+0000","last_undegraded":"2024-04-25T09:05:01.848920+0000","last_fullsized":"2024-04-25T09:05:01.848920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:40.689654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.852056+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:05:01.852056+0000","last_peered":"2024-04-25T09:05:01.852056+0000","last_clean":"2024-04-25T09:05:01.852056+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:05:01.852056+0000","last_undegraded":"2024-04-25T09:05:01.852056+0000","last_fullsized":"2024-04-25T09:05:01.852056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":711609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:05:06.904 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:05:07.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.082+0000 7f435d800640 1 Processor -- start 2024-04-25T09:05:07.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.082+0000 7f435d800640 1 -- start start 2024-04-25T09:05:07.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.086+0000 7f435d800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f435815a900 0x7f435806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.086+0000 7f435d800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f43580cf560 0x7f43580cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.086+0000 7f435d800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43580cda00 con 0x7f43580cd520 2024-04-25T09:05:07.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.086+0000 7f435d800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435815bcf0 con 0x7f43580cf560 2024-04-25T09:05:07.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.086+0000 7f435d800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43580cfef0 con 0x7f435815a900 2024-04-25T09:05:07.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.086+0000 7f434fe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f43580cd520 0x7f43580ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:57488/0 (socket says 172.21.15.175:57488) 2024-04-25T09:05:07.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.086+0000 7f434fe00640 1 -- 172.21.15.175:0/1392471773 learned_addr learned my addr 172.21.15.175:0/1392471773 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:07.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.086+0000 7f4357400640 1 --2- 172.21.15.175:0/1392471773 >> v2:172.21.15.177:3300/0 conn(0x7f43580cf560 0x7f43580cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.086+0000 7f4356a00640 1 --2- 172.21.15.175:0/1392471773 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f435815a900 0x7f435806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.086+0000 7f4356000640 1 -- 172.21.15.175:0/1392471773 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340920887 0 0) 0x7f43580cda00 con 0x7f43580cd520 2024-04-25T09:05:07.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.086+0000 7f4356000640 1 -- 172.21.15.175:0/1392471773 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f433c005740 con 0x7f43580cd520 2024-04-25T09:05:07.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.086+0000 7f4357400640 1 -- 172.21.15.175:0/1392471773 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f435815a900 msgr2=0x7f435806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:07.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.086+0000 7f4357400640 1 --2- 172.21.15.175:0/1392471773 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f435815a900 0x7f435806e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.086+0000 7f4357400640 1 -- 172.21.15.175:0/1392471773 >> v1:172.21.15.175:6789/0 conn(0x7f43580cd520 legacy=0x7f43580ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.086+0000 7f4357400640 1 -- 172.21.15.175:0/1392471773 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43580cdce0 con 0x7f43580cf560 2024-04-25T09:05:07.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f4357400640 1 --2- 172.21.15.175:0/1392471773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43580cf560 0x7f43580cf9b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4350009d90 tx=0x7f435001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fd0410a237d49f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:07.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f4356000640 1 -- 172.21.15.175:0/1392471773 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43500b2070 con 0x7f43580cf560 2024-04-25T09:05:07.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f4356000640 1 -- 172.21.15.175:0/1392471773 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43500a5920 con 0x7f43580cf560 2024-04-25T09:05:07.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f4356000640 1 -- 172.21.15.175:0/1392471773 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43500a5cf0 con 0x7f43580cf560 2024-04-25T09:05:07.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f435d800640 1 -- 172.21.15.175:0/1392471773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43580cf560 msgr2=0x7f43580cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f435d800640 1 --2- 172.21.15.175:0/1392471773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43580cf560 0x7f43580cf9b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4350009d90 tx=0x7f435001c970 comp rx=0 tx=0).stop 2024-04-25T09:05:07.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f435d800640 1 -- 172.21.15.175:0/1392471773 shutdown_connections 2024-04-25T09:05:07.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f435d800640 1 --2- 172.21.15.175:0/1392471773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43580cf560 0x7f43580cf9b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f435d800640 1 --2- 172.21.15.175:0/1392471773 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f435815a900 0x7f435806e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f435d800640 1 -- 172.21.15.175:0/1392471773 >> 172.21.15.175:0/1392471773 conn(0x7f4358067150 msgr2=0x7f435806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:07.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f435d800640 1 -- 172.21.15.175:0/1392471773 shutdown_connections 2024-04-25T09:05:07.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f435d800640 1 -- 172.21.15.175:0/1392471773 wait complete. 2024-04-25T09:05:07.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f435d800640 1 Processor -- start 2024-04-25T09:05:07.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f435d800640 1 -- start start 2024-04-25T09:05:07.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f435d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43580cf560 0x7f43581544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f435d800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f435815a900 0x7f4358155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f435d800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43580b0880 0x7f43581501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f435d800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435806d530 con 0x7f43580cf560 2024-04-25T09:05:07.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f435d800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435806d3b0 con 0x7f43580b0880 2024-04-25T09:05:07.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.090+0000 7f435d800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435815c790 con 0x7f435815a900 2024-04-25T09:05:07.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f4356a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43580cf560 0x7f43581544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f4356a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43580cf560 0x7f43581544e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32906/0 (socket says 172.21.15.175:32906) 2024-04-25T09:05:07.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f4356a00640 1 -- 172.21.15.175:0/2949559411 learned_addr learned my addr 172.21.15.175:0/2949559411 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:07.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f434fe00640 1 --2- 172.21.15.175:0/2949559411 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f435815a900 0x7f4358155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f4357400640 1 --2- 172.21.15.175:0/2949559411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43580b0880 0x7f43581501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f4356a00640 1 -- 172.21.15.175:0/2949559411 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f435815a900 msgr2=0x7f4358155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f4356a00640 1 --2- 172.21.15.175:0/2949559411 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f435815a900 0x7f4358155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f4356a00640 1 -- 172.21.15.175:0/2949559411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43580b0880 msgr2=0x7f43581501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f4356a00640 1 --2- 172.21.15.175:0/2949559411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43580b0880 0x7f43581501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f4356a00640 1 -- 172.21.15.175:0/2949559411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4358155790 con 0x7f43580cf560 2024-04-25T09:05:07.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f4356a00640 1 --2- 172.21.15.175:0/2949559411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43580cf560 0x7f43581544e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f434800e870 tx=0x7f434800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:07.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f434ea00640 1 -- 172.21.15.175:0/2949559411 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348017070 con 0x7f43580cf560 2024-04-25T09:05:07.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f434ea00640 1 -- 172.21.15.175:0/2949559411 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434800c940 con 0x7f43580cf560 2024-04-25T09:05:07.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f434ea00640 1 -- 172.21.15.175:0/2949559411 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434800ccf0 con 0x7f43580cf560 2024-04-25T09:05:07.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f435d800640 1 -- 172.21.15.175:0/2949559411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4358153440 con 0x7f43580cf560 2024-04-25T09:05:07.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f435d800640 1 -- 172.21.15.175:0/2949559411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4358153a00 con 0x7f43580cf560 2024-04-25T09:05:07.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f435d800640 1 -- 172.21.15.175:0/2949559411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4358154110 con 0x7f43580cf560 2024-04-25T09:05:07.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f434ea00640 1 -- 172.21.15.175:0/2949559411 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f434801a070 con 0x7f43580cf560 2024-04-25T09:05:07.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.094+0000 7f434ea00640 1 --2- 172.21.15.175:0/2949559411 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4334066f90 0x7f4334069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.098+0000 7f434ea00640 1 -- 172.21.15.175:0/2949559411 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4348084eb0 con 0x7f43580cf560 2024-04-25T09:05:07.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.098+0000 7f434fe00640 1 --2- 172.21.15.175:0/2949559411 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4334066f90 0x7f4334069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.098+0000 7f434fe00640 1 --2- 172.21.15.175:0/2949559411 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4334066f90 0x7f4334069450 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4340007fd0 tx=0x7f4340009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:07.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.098+0000 7f434ea00640 1 -- 172.21.15.175:0/2949559411 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4358155790 con 0x7f43580cf560 2024-04-25T09:05:07.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.250+0000 7f435d800640 1 -- 172.21.15.175:0/2949559411 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43580cc2a0 con 0x7f4334066f90 2024-04-25T09:05:07.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.258+0000 7f434ea00640 1 -- 172.21.15.175:0/2949559411 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246635 (secure 0 0 0) 0x7f43580cc2a0 con 0x7f4334066f90 2024-04-25T09:05:07.252 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:07.253 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:05:07.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.262+0000 7f435d800640 1 -- 172.21.15.175:0/2949559411 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4334066f90 msgr2=0x7f4334069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.262+0000 7f435d800640 1 --2- 172.21.15.175:0/2949559411 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4334066f90 0x7f4334069450 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4340007fd0 tx=0x7f4340009040 comp rx=0 tx=0).stop 2024-04-25T09:05:07.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.262+0000 7f435d800640 1 -- 172.21.15.175:0/2949559411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43580cf560 msgr2=0x7f43581544e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.262+0000 7f435d800640 1 --2- 172.21.15.175:0/2949559411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43580cf560 0x7f43581544e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f434800e870 tx=0x7f434800ec70 comp rx=0 tx=0).stop 2024-04-25T09:05:07.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.262+0000 7f435d800640 1 -- 172.21.15.175:0/2949559411 shutdown_connections 2024-04-25T09:05:07.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.262+0000 7f435d800640 1 --2- 172.21.15.175:0/2949559411 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4334066f90 0x7f4334069450 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.262+0000 7f435d800640 1 --2- 172.21.15.175:0/2949559411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43580b0880 0x7f43581501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.262+0000 7f435d800640 1 --2- 172.21.15.175:0/2949559411 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f435815a900 0x7f4358155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.262+0000 7f435d800640 1 --2- 172.21.15.175:0/2949559411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43580cf560 0x7f43581544e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.262+0000 7f435d800640 1 -- 172.21.15.175:0/2949559411 >> 172.21.15.175:0/2949559411 conn(0x7f43580cd520 msgr2=0x7f4358158f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:07.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.262+0000 7f435d800640 1 -- 172.21.15.175:0/2949559411 shutdown_connections 2024-04-25T09:05:07.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.262+0000 7f435d800640 1 -- 172.21.15.175:0/2949559411 wait complete. 2024-04-25T09:05:07.272 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-04-25T09:05:05.800408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219932,"kb_used_data":3772,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754788,"statfs":{"total":773094113280,"available":772868902912,"internally_reserved":0,"allocated":3862528,"data_stored":2194533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.980347"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833032+0000","last_change":"2024-04-25T09:05:01.833032+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833032+0000","last_undegraded":"2024-04-25T09:05:01.833032+0000","last_fullsized":"2024-04-25T09:05:01.833032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.845672+0000","last_change":"2024-04-25T09:05:01.845672+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.845672+0000","last_undegraded":"2024-04-25T09:05:01.845672+0000","last_fullsized":"2024-04-25T09:05:01.845672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.838784+0000","last_change":"2024-04-25T09:05:01.838784+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.838784+0000","last_undegraded":"2024-04-25T09:05:01.838784+0000","last_fullsized":"2024-04-25T09:05:01.838784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.837977+0000","last_change":"2024-04-25T09:05:01.837977+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.837977+0000","last_undegraded":"2024-04-25T09:05:01.837977+0000","last_fullsized":"2024-04-25T09:05:01.837977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833379+0000","last_change":"2024-04-25T09:05:01.833379+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833379+0000","last_undegraded":"2024-04-25T09:05:01.833379+0000","last_fullsized":"2024-04-25T09:05:01.833379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.842224+0000","last_change":"2024-04-25T09:05:01.842224+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.842224+0000","last_undegraded":"2024-04-25T09:05:01.842224+0000","last_fullsized":"2024-04-25T09:05:01.842224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.840686+0000","last_change":"2024-04-25T09:05:01.840686+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.840686+0000","last_undegraded":"2024-04-25T09:05:01.840686+0000","last_fullsized":"2024-04-25T09:05:01.840686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.851836+0000","last_change":"2024-04-25T09:05:01.851836+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.851836+0000","last_undegraded":"2024-04-25T09:05:01.851836+0000","last_fullsized":"2024-04-25T09:05:01.851836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833603+0000","last_change":"2024-04-25T09:05:01.833603+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833603+0000","last_undegraded":"2024-04-25T09:05:01.833603+0000","last_fullsized":"2024-04-25T09:05:01.833603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.836810+0000","last_change":"2024-04-25T09:05:01.836810+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.836810+0000","last_undegraded":"2024-04-25T09:05:01.836810+0000","last_fullsized":"2024-04-25T09:05:01.836810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839339+0000","last_change":"2024-04-25T09:05:01.839339+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839339+0000","last_undegraded":"2024-04-25T09:05:01.839339+0000","last_fullsized":"2024-04-25T09:05:01.839339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.841743+0000","last_change":"2024-04-25T09:05:01.841743+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.841743+0000","last_undegraded":"2024-04-25T09:05:01.841743+0000","last_fullsized":"2024-04-25T09:05:01.841743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832950+0000","last_change":"2024-04-25T09:05:01.832950+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832950+0000","last_undegraded":"2024-04-25T09:05:01.832950+0000","last_fullsized":"2024-04-25T09:05:01.832950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.841723+0000","last_change":"2024-04-25T09:05:01.841723+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.841723+0000","last_undegraded":"2024-04-25T09:05:01.841723+0000","last_fullsized":"2024-04-25T09:05:01.841723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839516+0000","last_change":"2024-04-25T09:05:01.839516+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839516+0000","last_undegraded":"2024-04-25T09:05:01.839516+0000","last_fullsized":"2024-04-25T09:05:01.839516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839997+0000","last_change":"2024-04-25T09:05:01.839997+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839997+0000","last_undegraded":"2024-04-25T09:05:01.839997+0000","last_fullsized":"2024-04-25T09:05:01.839997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.841319+0000","last_change":"2024-04-25T09:05:01.841319+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.841319+0000","last_undegraded":"2024-04-25T09:05:01.841319+0000","last_fullsized":"2024-04-25T09:05:01.841319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.845160+0000","last_change":"2024-04-25T09:05:01.845160+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.845160+0000","last_undegraded":"2024-04-25T09:05:01.845160+0000","last_fullsized":"2024-04-25T09:05:01.845160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833082+0000","last_change":"2024-04-25T09:05:01.833082+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833082+0000","last_undegraded":"2024-04-25T09:05:01.833082+0000","last_fullsized":"2024-04-25T09:05:01.833082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.834309+0000","last_change":"2024-04-25T09:05:01.834309+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.834309+0000","last_undegraded":"2024-04-25T09:05:01.834309+0000","last_fullsized":"2024-04-25T09:05:01.834309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.835652+0000","last_change":"2024-04-25T09:05:01.835652+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.835652+0000","last_undegraded":"2024-04-25T09:05:01.835652+0000","last_fullsized":"2024-04-25T09:05:01.835652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.834258+0000","last_change":"2024-04-25T09:05:01.834258+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.834258+0000","last_undegraded":"2024-04-25T09:05:01.834258+0000","last_fullsized":"2024-04-25T09:05:01.834258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833902+0000","last_change":"2024-04-25T09:05:01.833902+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833902+0000","last_undegraded":"2024-04-25T09:05:01.833902+0000","last_fullsized":"2024-04-25T09:05:01.833902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.837758+0000","last_change":"2024-04-25T09:05:01.837758+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.837758+0000","last_undegraded":"2024-04-25T09:05:01.837758+0000","last_fullsized":"2024-04-25T09:05:01.837758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839814+0000","last_change":"2024-04-25T09:05:01.839814+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839814+0000","last_undegraded":"2024-04-25T09:05:01.839814+0000","last_fullsized":"2024-04-25T09:05:01.839814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.844759+0000","last_change":"2024-04-25T09:05:01.844759+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.844759+0000","last_undegraded":"2024-04-25T09:05:01.844759+0000","last_fullsized":"2024-04-25T09:05:01.844759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.848547+0000","last_change":"2024-04-25T09:05:01.848547+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.848547+0000","last_undegraded":"2024-04-25T09:05:01.848547+0000","last_fullsized":"2024-04-25T09:05:01.848547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.838376+0000","last_change":"2024-04-25T09:05:01.838376+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.838376+0000","last_undegraded":"2024-04-25T09:05:01.838376+0000","last_fullsized":"2024-04-25T09:05:01.838376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.835174+0000","last_change":"2024-04-25T09:05:01.835174+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.835174+0000","last_undegraded":"2024-04-25T09:05:01.835174+0000","last_fullsized":"2024-04-25T09:05:01.835174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.840595+0000","last_change":"2024-04-25T09:05:01.840595+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.840595+0000","last_undegraded":"2024-04-25T09:05:01.840595+0000","last_fullsized":"2024-04-25T09:05:01.840595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833068+0000","last_change":"2024-04-25T09:05:01.833068+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833068+0000","last_undegraded":"2024-04-25T09:05:01.833068+0000","last_fullsized":"2024-04-25T09:05:01.833068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.851467+0000","last_change":"2024-04-25T09:05:01.851467+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.851467+0000","last_undegraded":"2024-04-25T09:05:01.851467+0000","last_fullsized":"2024-04-25T09:05:01.851467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833477+0000","last_change":"2024-04-25T09:05:01.833477+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833477+0000","last_undegraded":"2024-04-25T09:05:01.833477+0000","last_fullsized":"2024-04-25T09:05:01.833477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.862365+0000","last_change":"2024-04-25T09:05:01.859475+0000","last_active":"2024-04-25T09:05:01.862365+0000","last_peered":"2024-04-25T09:05:01.862365+0000","last_clean":"2024-04-25T09:05:01.862365+0000","last_became_active":"2024-04-25T09:05:01.859205+0000","last_became_peered":"2024-04-25T09:05:01.859205+0000","last_unstale":"2024-04-25T09:05:01.862365+0000","last_undegraded":"2024-04-25T09:05:01.862365+0000","last_fullsized":"2024-04-25T09:05:01.862365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:54.535074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832441+0000","last_change":"2024-04-25T09:05:01.832441+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832441+0000","last_undegraded":"2024-04-25T09:05:01.832441+0000","last_fullsized":"2024-04-25T09:05:01.832441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.852329+0000","last_change":"2024-04-25T09:05:01.851020+0000","last_active":"2024-04-25T09:05:01.852329+0000","last_peered":"2024-04-25T09:05:01.852329+0000","last_clean":"2024-04-25T09:05:01.852329+0000","last_became_active":"2024-04-25T09:05:01.850367+0000","last_became_peered":"2024-04-25T09:05:01.850367+0000","last_unstale":"2024-04-25T09:05:01.852329+0000","last_undegraded":"2024-04-25T09:05:01.852329+0000","last_fullsized":"2024-04-25T09:05:01.852329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:54.535074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833820+0000","last_change":"2024-04-25T09:05:01.833820+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833820+0000","last_undegraded":"2024-04-25T09:05:01.833820+0000","last_fullsized":"2024-04-25T09:05:01.833820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.857147+0000","last_change":"2024-04-25T09:05:01.855321+0000","last_active":"2024-04-25T09:05:01.857147+0000","last_peered":"2024-04-25T09:05:01.857147+0000","last_clean":"2024-04-25T09:05:01.857147+0000","last_became_active":"2024-04-25T09:05:01.854980+0000","last_became_peered":"2024-04-25T09:05:01.854980+0000","last_unstale":"2024-04-25T09:05:01.857147+0000","last_undegraded":"2024-04-25T09:05:01.857147+0000","last_fullsized":"2024-04-25T09:05:01.857147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:01.847172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.848097+0000","last_change":"2024-04-25T09:05:01.848097+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.848097+0000","last_undegraded":"2024-04-25T09:05:01.848097+0000","last_fullsized":"2024-04-25T09:05:01.848097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.857066+0000","last_change":"2024-04-25T09:05:01.855383+0000","last_active":"2024-04-25T09:05:01.857066+0000","last_peered":"2024-04-25T09:05:01.857066+0000","last_clean":"2024-04-25T09:05:01.857066+0000","last_became_active":"2024-04-25T09:05:01.855114+0000","last_became_peered":"2024-04-25T09:05:01.855114+0000","last_unstale":"2024-04-25T09:05:01.857066+0000","last_undegraded":"2024-04-25T09:05:01.857066+0000","last_fullsized":"2024-04-25T09:05:01.857066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:30.365760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839360+0000","last_change":"2024-04-25T09:05:01.839360+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839360+0000","last_undegraded":"2024-04-25T09:05:01.839360+0000","last_fullsized":"2024-04-25T09:05:01.839360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.853680+0000","last_change":"2024-04-25T09:05:01.850620+0000","last_active":"2024-04-25T09:05:01.853680+0000","last_peered":"2024-04-25T09:05:01.853680+0000","last_clean":"2024-04-25T09:05:01.853680+0000","last_became_active":"2024-04-25T09:05:01.850289+0000","last_became_peered":"2024-04-25T09:05:01.850289+0000","last_unstale":"2024-04-25T09:05:01.853680+0000","last_undegraded":"2024-04-25T09:05:01.853680+0000","last_fullsized":"2024-04-25T09:05:01.853680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:07.320232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.847081+0000","last_change":"2024-04-25T09:05:01.847081+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.847081+0000","last_undegraded":"2024-04-25T09:05:01.847081+0000","last_fullsized":"2024-04-25T09:05:01.847081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.856102+0000","last_change":"2024-04-25T09:05:01.853233+0000","last_active":"2024-04-25T09:05:01.856102+0000","last_peered":"2024-04-25T09:05:01.856102+0000","last_clean":"2024-04-25T09:05:01.856102+0000","last_became_active":"2024-04-25T09:05:01.852944+0000","last_became_peered":"2024-04-25T09:05:01.852944+0000","last_unstale":"2024-04-25T09:05:01.856102+0000","last_undegraded":"2024-04-25T09:05:01.856102+0000","last_fullsized":"2024-04-25T09:05:01.856102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:21.522852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833667+0000","last_change":"2024-04-25T09:05:01.833667+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833667+0000","last_undegraded":"2024-04-25T09:05:01.833667+0000","last_fullsized":"2024-04-25T09:05:01.833667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.846208+0000","last_change":"2024-04-25T09:05:01.842765+0000","last_active":"2024-04-25T09:05:01.846208+0000","last_peered":"2024-04-25T09:05:01.846208+0000","last_clean":"2024-04-25T09:05:01.846208+0000","last_became_active":"2024-04-25T09:05:01.842535+0000","last_became_peered":"2024-04-25T09:05:01.842535+0000","last_unstale":"2024-04-25T09:05:01.846208+0000","last_undegraded":"2024-04-25T09:05:01.846208+0000","last_fullsized":"2024-04-25T09:05:01.846208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:07.078383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.836163+0000","last_change":"2024-04-25T09:05:01.836163+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.836163+0000","last_undegraded":"2024-04-25T09:05:01.836163+0000","last_fullsized":"2024-04-25T09:05:01.836163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.848730+0000","last_change":"2024-04-25T09:05:01.844077+0000","last_active":"2024-04-25T09:05:01.848730+0000","last_peered":"2024-04-25T09:05:01.848730+0000","last_clean":"2024-04-25T09:05:01.848730+0000","last_became_active":"2024-04-25T09:05:01.843762+0000","last_became_peered":"2024-04-25T09:05:01.843762+0000","last_unstale":"2024-04-25T09:05:01.848730+0000","last_undegraded":"2024-04-25T09:05:01.848730+0000","last_fullsized":"2024-04-25T09:05:01.848730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:47.729359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.838868+0000","last_change":"2024-04-25T09:05:01.838868+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.838868+0000","last_undegraded":"2024-04-25T09:05:01.838868+0000","last_fullsized":"2024-04-25T09:05:01.838868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.860357+0000","last_change":"2024-04-25T09:05:01.858030+0000","last_active":"2024-04-25T09:05:01.860357+0000","last_peered":"2024-04-25T09:05:01.860357+0000","last_clean":"2024-04-25T09:05:01.860357+0000","last_became_active":"2024-04-25T09:05:01.857784+0000","last_became_peered":"2024-04-25T09:05:01.857784+0000","last_unstale":"2024-04-25T09:05:01.860357+0000","last_undegraded":"2024-04-25T09:05:01.860357+0000","last_fullsized":"2024-04-25T09:05:01.860357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:37.505024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.844325+0000","last_change":"2024-04-25T09:05:01.844325+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.844325+0000","last_undegraded":"2024-04-25T09:05:01.844325+0000","last_fullsized":"2024-04-25T09:05:01.844325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.852437+0000","last_change":"2024-04-25T09:05:01.851249+0000","last_active":"2024-04-25T09:05:01.852437+0000","last_peered":"2024-04-25T09:05:01.852437+0000","last_clean":"2024-04-25T09:05:01.852437+0000","last_became_active":"2024-04-25T09:05:01.850775+0000","last_became_peered":"2024-04-25T09:05:01.850775+0000","last_unstale":"2024-04-25T09:05:01.852437+0000","last_undegraded":"2024-04-25T09:05:01.852437+0000","last_fullsized":"2024-04-25T09:05:01.852437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:55.907137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.835093+0000","last_change":"2024-04-25T09:05:01.835093+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.835093+0000","last_undegraded":"2024-04-25T09:05:01.835093+0000","last_fullsized":"2024-04-25T09:05:01.835093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.862229+0000","last_change":"2024-04-25T09:05:01.860048+0000","last_active":"2024-04-25T09:05:01.862229+0000","last_peered":"2024-04-25T09:05:01.862229+0000","last_clean":"2024-04-25T09:05:01.862229+0000","last_became_active":"2024-04-25T09:05:01.859751+0000","last_became_peered":"2024-04-25T09:05:01.859751+0000","last_unstale":"2024-04-25T09:05:01.862229+0000","last_undegraded":"2024-04-25T09:05:01.862229+0000","last_fullsized":"2024-04-25T09:05:01.862229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:50.944782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.848015+0000","last_change":"2024-04-25T09:05:01.848015+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.848015+0000","last_undegraded":"2024-04-25T09:05:01.848015+0000","last_fullsized":"2024-04-25T09:05:01.848015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.855982+0000","last_change":"2024-04-25T09:05:01.853200+0000","last_active":"2024-04-25T09:05:01.855982+0000","last_peered":"2024-04-25T09:05:01.855982+0000","last_clean":"2024-04-25T09:05:01.855982+0000","last_became_active":"2024-04-25T09:05:01.851932+0000","last_became_peered":"2024-04-25T09:05:01.851932+0000","last_unstale":"2024-04-25T09:05:01.855982+0000","last_undegraded":"2024-04-25T09:05:01.855982+0000","last_fullsized":"2024-04-25T09:05:01.855982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:10.494318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839776+0000","last_change":"2024-04-25T09:05:01.839776+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839776+0000","last_undegraded":"2024-04-25T09:05:01.839776+0000","last_fullsized":"2024-04-25T09:05:01.839776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.848760+0000","last_change":"2024-04-25T09:05:01.844545+0000","last_active":"2024-04-25T09:05:01.848760+0000","last_peered":"2024-04-25T09:05:01.848760+0000","last_clean":"2024-04-25T09:05:01.848760+0000","last_became_active":"2024-04-25T09:05:01.843748+0000","last_became_peered":"2024-04-25T09:05:01.843748+0000","last_unstale":"2024-04-25T09:05:01.848760+0000","last_undegraded":"2024-04-25T09:05:01.848760+0000","last_fullsized":"2024-04-25T09:05:01.848760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:32.762758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832733+0000","last_change":"2024-04-25T09:05:01.832733+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832733+0000","last_undegraded":"2024-04-25T09:05:01.832733+0000","last_fullsized":"2024-04-25T09:05:01.832733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.856328+0000","last_change":"2024-04-25T09:05:01.853811+0000","last_active":"2024-04-25T09:05:01.856328+0000","last_peered":"2024-04-25T09:05:01.856328+0000","last_clean":"2024-04-25T09:05:01.856328+0000","last_became_active":"2024-04-25T09:05:01.853511+0000","last_became_peered":"2024-04-25T09:05:01.853511+0000","last_unstale":"2024-04-25T09:05:01.856328+0000","last_undegraded":"2024-04-25T09:05:01.856328+0000","last_fullsized":"2024-04-25T09:05:01.856328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:52.353215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.851022+0000","last_change":"2024-04-25T09:05:01.851022+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.851022+0000","last_undegraded":"2024-04-25T09:05:01.851022+0000","last_fullsized":"2024-04-25T09:05:01.851022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.853525+0000","last_change":"2024-04-25T09:05:01.849597+0000","last_active":"2024-04-25T09:05:01.853525+0000","last_peered":"2024-04-25T09:05:01.853525+0000","last_clean":"2024-04-25T09:05:01.853525+0000","last_became_active":"2024-04-25T09:05:01.849343+0000","last_became_peered":"2024-04-25T09:05:01.849343+0000","last_unstale":"2024-04-25T09:05:01.853525+0000","last_undegraded":"2024-04-25T09:05:01.853525+0000","last_fullsized":"2024-04-25T09:05:01.853525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:23.553154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832450+0000","last_change":"2024-04-25T09:05:01.832450+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832450+0000","last_undegraded":"2024-04-25T09:05:01.832450+0000","last_fullsized":"2024-04-25T09:05:01.832450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.847526+0000","last_change":"2024-04-25T09:05:01.845805+0000","last_active":"2024-04-25T09:05:01.847526+0000","last_peered":"2024-04-25T09:05:01.847526+0000","last_clean":"2024-04-25T09:05:01.847526+0000","last_became_active":"2024-04-25T09:05:01.845373+0000","last_became_peered":"2024-04-25T09:05:01.845373+0000","last_unstale":"2024-04-25T09:05:01.847526+0000","last_undegraded":"2024-04-25T09:05:01.847526+0000","last_fullsized":"2024-04-25T09:05:01.847526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:15.508830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.835237+0000","last_change":"2024-04-25T09:05:01.835237+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.835237+0000","last_undegraded":"2024-04-25T09:05:01.835237+0000","last_fullsized":"2024-04-25T09:05:01.835237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.855778+0000","last_change":"2024-04-25T09:05:01.853103+0000","last_active":"2024-04-25T09:05:01.855778+0000","last_peered":"2024-04-25T09:05:01.855778+0000","last_clean":"2024-04-25T09:05:01.855778+0000","last_became_active":"2024-04-25T09:05:01.852683+0000","last_became_peered":"2024-04-25T09:05:01.852683+0000","last_unstale":"2024-04-25T09:05:01.855778+0000","last_undegraded":"2024-04-25T09:05:01.855778+0000","last_fullsized":"2024-04-25T09:05:01.855778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:22.640219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.845105+0000","last_change":"2024-04-25T09:05:01.845105+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.845105+0000","last_undegraded":"2024-04-25T09:05:01.845105+0000","last_fullsized":"2024-04-25T09:05:01.845105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.851325+0000","last_change":"2024-04-25T09:05:01.846615+0000","last_active":"2024-04-25T09:05:01.851325+0000","last_peered":"2024-04-25T09:05:01.851325+0000","last_clean":"2024-04-25T09:05:01.851325+0000","last_became_active":"2024-04-25T09:05:01.846321+0000","last_became_peered":"2024-04-25T09:05:01.846321+0000","last_unstale":"2024-04-25T09:05:01.851325+0000","last_undegraded":"2024-04-25T09:05:01.851325+0000","last_fullsized":"2024-04-25T09:05:01.851325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:30.103785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.837557+0000","last_change":"2024-04-25T09:05:01.837557+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.837557+0000","last_undegraded":"2024-04-25T09:05:01.837557+0000","last_fullsized":"2024-04-25T09:05:01.837557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.851132+0000","last_change":"2024-04-25T09:05:01.845678+0000","last_active":"2024-04-25T09:05:01.851132+0000","last_peered":"2024-04-25T09:05:01.851132+0000","last_clean":"2024-04-25T09:05:01.851132+0000","last_became_active":"2024-04-25T09:05:01.845394+0000","last_became_peered":"2024-04-25T09:05:01.845394+0000","last_unstale":"2024-04-25T09:05:01.851132+0000","last_undegraded":"2024-04-25T09:05:01.851132+0000","last_fullsized":"2024-04-25T09:05:01.851132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:30.365760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832917+0000","last_change":"2024-04-25T09:05:01.832917+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832917+0000","last_undegraded":"2024-04-25T09:05:01.832917+0000","last_fullsized":"2024-04-25T09:05:01.832917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.855987+0000","last_change":"2024-04-25T09:05:01.850960+0000","last_active":"2024-04-25T09:05:01.855987+0000","last_peered":"2024-04-25T09:05:01.855987+0000","last_clean":"2024-04-25T09:05:01.855987+0000","last_became_active":"2024-04-25T09:05:01.850670+0000","last_became_peered":"2024-04-25T09:05:01.850670+0000","last_unstale":"2024-04-25T09:05:01.855987+0000","last_undegraded":"2024-04-25T09:05:01.855987+0000","last_fullsized":"2024-04-25T09:05:01.855987+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:59.624866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832469+0000","last_change":"2024-04-25T09:05:01.832469+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832469+0000","last_undegraded":"2024-04-25T09:05:01.832469+0000","last_fullsized":"2024-04-25T09:05:01.832469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.843938+0000","last_change":"2024-04-25T09:05:01.841773+0000","last_active":"2024-04-25T09:05:01.843938+0000","last_peered":"2024-04-25T09:05:01.843938+0000","last_clean":"2024-04-25T09:05:01.843938+0000","last_became_active":"2024-04-25T09:05:01.841485+0000","last_became_peered":"2024-04-25T09:05:01.841485+0000","last_unstale":"2024-04-25T09:05:01.843938+0000","last_undegraded":"2024-04-25T09:05:01.843938+0000","last_fullsized":"2024-04-25T09:05:01.843938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:40.689654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832490+0000","last_change":"2024-04-25T09:05:01.832490+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832490+0000","last_undegraded":"2024-04-25T09:05:01.832490+0000","last_fullsized":"2024-04-25T09:05:01.832490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.861723+0000","last_change":"2024-04-25T09:05:01.856230+0000","last_active":"2024-04-25T09:05:01.861723+0000","last_peered":"2024-04-25T09:05:01.861723+0000","last_clean":"2024-04-25T09:05:01.861723+0000","last_became_active":"2024-04-25T09:05:01.855929+0000","last_became_peered":"2024-04-25T09:05:01.855929+0000","last_unstale":"2024-04-25T09:05:01.861723+0000","last_undegraded":"2024-04-25T09:05:01.861723+0000","last_fullsized":"2024-04-25T09:05:01.861723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:45.459385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832449+0000","last_change":"2024-04-25T09:05:01.832449+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832449+0000","last_undegraded":"2024-04-25T09:05:01.832449+0000","last_fullsized":"2024-04-25T09:05:01.832449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.845948+0000","last_change":"2024-04-25T09:05:01.842494+0000","last_active":"2024-04-25T09:05:01.845948+0000","last_peered":"2024-04-25T09:05:01.845948+0000","last_clean":"2024-04-25T09:05:01.845948+0000","last_became_active":"2024-04-25T09:05:01.842187+0000","last_became_peered":"2024-04-25T09:05:01.842187+0000","last_unstale":"2024-04-25T09:05:01.845948+0000","last_undegraded":"2024-04-25T09:05:01.845948+0000","last_fullsized":"2024-04-25T09:05:01.845948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:29.852470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.840941+0000","last_change":"2024-04-25T09:05:01.840941+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.840941+0000","last_undegraded":"2024-04-25T09:05:01.840941+0000","last_fullsized":"2024-04-25T09:05:01.840941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.859059+0000","last_change":"2024-04-25T09:05:01.853085+0000","last_active":"2024-04-25T09:05:01.859059+0000","last_peered":"2024-04-25T09:05:01.859059+0000","last_clean":"2024-04-25T09:05:01.859059+0000","last_became_active":"2024-04-25T09:05:01.852672+0000","last_became_peered":"2024-04-25T09:05:01.852672+0000","last_unstale":"2024-04-25T09:05:01.859059+0000","last_undegraded":"2024-04-25T09:05:01.859059+0000","last_fullsized":"2024-04-25T09:05:01.859059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:28.059026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833669+0000","last_change":"2024-04-25T09:05:01.833669+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833669+0000","last_undegraded":"2024-04-25T09:05:01.833669+0000","last_fullsized":"2024-04-25T09:05:01.833669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.862078+0000","last_change":"2024-04-25T09:05:01.859966+0000","last_active":"2024-04-25T09:05:01.862078+0000","last_peered":"2024-04-25T09:05:01.862078+0000","last_clean":"2024-04-25T09:05:01.862078+0000","last_became_active":"2024-04-25T09:05:01.859591+0000","last_became_peered":"2024-04-25T09:05:01.859591+0000","last_unstale":"2024-04-25T09:05:01.862078+0000","last_undegraded":"2024-04-25T09:05:01.862078+0000","last_fullsized":"2024-04-25T09:05:01.862078+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:48.677980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.844758+0000","last_change":"2024-04-25T09:05:01.844758+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.844758+0000","last_undegraded":"2024-04-25T09:05:01.844758+0000","last_fullsized":"2024-04-25T09:05:01.844758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.843735+0000","last_change":"2024-04-25T09:05:01.841767+0000","last_active":"2024-04-25T09:05:01.843735+0000","last_peered":"2024-04-25T09:05:01.843735+0000","last_clean":"2024-04-25T09:05:01.843735+0000","last_became_active":"2024-04-25T09:05:01.841486+0000","last_became_peered":"2024-04-25T09:05:01.841486+0000","last_unstale":"2024-04-25T09:05:01.843735+0000","last_undegraded":"2024-04-25T09:05:01.843735+0000","last_fullsized":"2024-04-25T09:05:01.843735+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:45.459385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832615+0000","last_change":"2024-04-25T09:05:01.832615+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832615+0000","last_undegraded":"2024-04-25T09:05:01.832615+0000","last_fullsized":"2024-04-25T09:05:01.832615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.855328+0000","last_change":"2024-04-25T09:05:01.853095+0000","last_active":"2024-04-25T09:05:01.855328+0000","last_peered":"2024-04-25T09:05:01.855328+0000","last_clean":"2024-04-25T09:05:01.855328+0000","last_became_active":"2024-04-25T09:05:01.852739+0000","last_became_peered":"2024-04-25T09:05:01.852739+0000","last_unstale":"2024-04-25T09:05:01.855328+0000","last_undegraded":"2024-04-25T09:05:01.855328+0000","last_fullsized":"2024-04-25T09:05:01.855328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:55.907137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.834556+0000","last_change":"2024-04-25T09:05:01.834556+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.834556+0000","last_undegraded":"2024-04-25T09:05:01.834556+0000","last_fullsized":"2024-04-25T09:05:01.834556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.860191+0000","last_change":"2024-04-25T09:05:01.858937+0000","last_active":"2024-04-25T09:05:01.860191+0000","last_peered":"2024-04-25T09:05:01.860191+0000","last_clean":"2024-04-25T09:05:01.860191+0000","last_became_active":"2024-04-25T09:05:01.858636+0000","last_became_peered":"2024-04-25T09:05:01.858636+0000","last_unstale":"2024-04-25T09:05:01.860191+0000","last_undegraded":"2024-04-25T09:05:01.860191+0000","last_fullsized":"2024-04-25T09:05:01.860191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:22.640219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832222+0000","last_change":"2024-04-25T09:05:01.832222+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832222+0000","last_undegraded":"2024-04-25T09:05:01.832222+0000","last_fullsized":"2024-04-25T09:05:01.832222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.862061+0000","last_change":"2024-04-25T09:05:01.859845+0000","last_active":"2024-04-25T09:05:01.862061+0000","last_peered":"2024-04-25T09:05:01.862061+0000","last_clean":"2024-04-25T09:05:01.862061+0000","last_became_active":"2024-04-25T09:05:01.859553+0000","last_became_peered":"2024-04-25T09:05:01.859553+0000","last_unstale":"2024-04-25T09:05:01.862061+0000","last_undegraded":"2024-04-25T09:05:01.862061+0000","last_fullsized":"2024-04-25T09:05:01.862061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:03.855826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.838757+0000","last_change":"2024-04-25T09:05:01.838757+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.838757+0000","last_undegraded":"2024-04-25T09:05:01.838757+0000","last_fullsized":"2024-04-25T09:05:01.838757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.861795+0000","last_change":"2024-04-25T09:05:01.860397+0000","last_active":"2024-04-25T09:05:01.861795+0000","last_peered":"2024-04-25T09:05:01.861795+0000","last_clean":"2024-04-25T09:05:01.861795+0000","last_became_active":"2024-04-25T09:05:01.859885+0000","last_became_peered":"2024-04-25T09:05:01.859885+0000","last_unstale":"2024-04-25T09:05:01.861795+0000","last_undegraded":"2024-04-25T09:05:01.861795+0000","last_fullsized":"2024-04-25T09:05:01.861795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:51.382457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.834694+0000","last_change":"2024-04-25T09:05:01.834694+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.834694+0000","last_undegraded":"2024-04-25T09:05:01.834694+0000","last_fullsized":"2024-04-25T09:05:01.834694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.857124+0000","last_change":"2024-04-25T09:05:01.854637+0000","last_active":"2024-04-25T09:05:01.857124+0000","last_peered":"2024-04-25T09:05:01.857124+0000","last_clean":"2024-04-25T09:05:01.857124+0000","last_became_active":"2024-04-25T09:05:01.854045+0000","last_became_peered":"2024-04-25T09:05:01.854045+0000","last_unstale":"2024-04-25T09:05:01.857124+0000","last_undegraded":"2024-04-25T09:05:01.857124+0000","last_fullsized":"2024-04-25T09:05:01.857124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:12.759868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.842018+0000","last_change":"2024-04-25T09:05:01.842018+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.842018+0000","last_undegraded":"2024-04-25T09:05:01.842018+0000","last_fullsized":"2024-04-25T09:05:01.842018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.848920+0000","last_change":"2024-04-25T09:05:01.844352+0000","last_active":"2024-04-25T09:05:01.848920+0000","last_peered":"2024-04-25T09:05:01.848920+0000","last_clean":"2024-04-25T09:05:01.848920+0000","last_became_active":"2024-04-25T09:05:01.843530+0000","last_became_peered":"2024-04-25T09:05:01.843530+0000","last_unstale":"2024-04-25T09:05:01.848920+0000","last_undegraded":"2024-04-25T09:05:01.848920+0000","last_fullsized":"2024-04-25T09:05:01.848920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:40.689654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.852056+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:05:01.852056+0000","last_peered":"2024-04-25T09:05:01.852056+0000","last_clean":"2024-04-25T09:05:01.852056+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:05:01.852056+0000","last_undegraded":"2024-04-25T09:05:01.852056+0000","last_fullsized":"2024-04-25T09:05:01.852056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":711609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:05:07.276 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:05:07.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.458+0000 7f59ad400640 1 Processor -- start 2024-04-25T09:05:07.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.458+0000 7f59ad400640 1 -- start start 2024-04-25T09:05:07.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.458+0000 7f59ad400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f59a815a900 0x7f59a806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.458+0000 7f59ad400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a80cf560 0x7f59a80cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.458+0000 7f59ad400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a80cda00 con 0x7f59a80cd520 2024-04-25T09:05:07.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.458+0000 7f59ad400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a815bcf0 con 0x7f59a815a900 2024-04-25T09:05:07.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.458+0000 7f59ad400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a80cfef0 con 0x7f59a80cf560 2024-04-25T09:05:07.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.462+0000 7f59a6800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f59a815a900 0x7f59a806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.462+0000 7f59a6800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f59a815a900 0x7f59a806e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32918/0 (socket says 172.21.15.175:32918) 2024-04-25T09:05:07.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.462+0000 7f59a6800640 1 -- 172.21.15.175:0/2990242514 learned_addr learned my addr 172.21.15.175:0/2990242514 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:07.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.462+0000 7f59a7200640 1 --2- 172.21.15.175:0/2990242514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a80cf560 0x7f59a80cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.462+0000 7f59a6800640 1 -- 172.21.15.175:0/2990242514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a80cf560 msgr2=0x7f59a80cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:07.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.462+0000 7f59a6800640 1 --2- 172.21.15.175:0/2990242514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a80cf560 0x7f59a80cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.462+0000 7f59a6800640 1 -- 172.21.15.175:0/2990242514 >> v1:172.21.15.175:6789/0 conn(0x7f59a80cd520 legacy=0x7f59a80ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:07.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.462+0000 7f59a6800640 1 -- 172.21.15.175:0/2990242514 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a80cdce0 con 0x7f59a815a900 2024-04-25T09:05:07.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.462+0000 7f59a7200640 1 --2- 172.21.15.175:0/2990242514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a80cf560 0x7f59a80cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:07.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.462+0000 7f59a6800640 1 --2- 172.21.15.175:0/2990242514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a815a900 0x7f59a806e150 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5998009e50 tx=0x7f599801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79091feaa82cc42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:07.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.462+0000 7f59a5400640 1 -- 172.21.15.175:0/2990242514 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59980a5760 con 0x7f59a815a900 2024-04-25T09:05:07.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.462+0000 7f59a5400640 1 -- 172.21.15.175:0/2990242514 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59980a5900 con 0x7f59a815a900 2024-04-25T09:05:07.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.462+0000 7f59a5400640 1 -- 172.21.15.175:0/2990242514 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59980a5cd0 con 0x7f59a815a900 2024-04-25T09:05:07.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59ad400640 1 -- 172.21.15.175:0/2990242514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a815a900 msgr2=0x7f59a806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59ad400640 1 --2- 172.21.15.175:0/2990242514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a815a900 0x7f59a806e150 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5998009e50 tx=0x7f599801c9f0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59ad400640 1 -- 172.21.15.175:0/2990242514 shutdown_connections 2024-04-25T09:05:07.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59ad400640 1 --2- 172.21.15.175:0/2990242514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a80cf560 0x7f59a80cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59ad400640 1 --2- 172.21.15.175:0/2990242514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a815a900 0x7f59a806e150 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59ad400640 1 -- 172.21.15.175:0/2990242514 >> 172.21.15.175:0/2990242514 conn(0x7f59a8067150 msgr2=0x7f59a806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:07.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59ad400640 1 -- 172.21.15.175:0/2990242514 shutdown_connections 2024-04-25T09:05:07.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59ad400640 1 -- 172.21.15.175:0/2990242514 wait complete. 2024-04-25T09:05:07.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59ad400640 1 Processor -- start 2024-04-25T09:05:07.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59ad400640 1 -- start start 2024-04-25T09:05:07.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59ad400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a80cf560 0x7f59a80afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59ad400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a815a900 0x7f59a8158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59ad400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a80b12e0 0x7f59a81fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59ad400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a806d530 con 0x7f59a80b12e0 2024-04-25T09:05:07.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59ad400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a806d3b0 con 0x7f59a815a900 2024-04-25T09:05:07.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59ad400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a815c790 con 0x7f59a80cf560 2024-04-25T09:05:07.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59a7200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a80b12e0 0x7f59a81fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59a7200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a80b12e0 0x7f59a81fe9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32934/0 (socket says 172.21.15.175:32934) 2024-04-25T09:05:07.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59a7200640 1 -- 172.21.15.175:0/3551469045 learned_addr learned my addr 172.21.15.175:0/3551469045 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:07.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59a5e00640 1 --2- 172.21.15.175:0/3551469045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a815a900 0x7f59a8158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59a6800640 1 --2- 172.21.15.175:0/3551469045 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a80cf560 0x7f59a80afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59a7200640 1 -- 172.21.15.175:0/3551469045 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a80cf560 msgr2=0x7f59a80afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59a7200640 1 --2- 172.21.15.175:0/3551469045 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a80cf560 0x7f59a80afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59a7200640 1 -- 172.21.15.175:0/3551469045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a815a900 msgr2=0x7f59a8158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59a7200640 1 --2- 172.21.15.175:0/3551469045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a815a900 0x7f59a8158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59a7200640 1 -- 172.21.15.175:0/3551469045 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a80b20f0 con 0x7f59a80b12e0 2024-04-25T09:05:07.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.466+0000 7f59a5e00640 1 --2- 172.21.15.175:0/3551469045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a815a900 0x7f59a8158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:07.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.470+0000 7f59a7200640 1 --2- 172.21.15.175:0/3551469045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a80b12e0 0x7f59a81fe9d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f59a000e840 tx=0x7f59a000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:07.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.470+0000 7f599ea00640 1 -- 172.21.15.175:0/3551469045 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a0017070 con 0x7f59a80b12e0 2024-04-25T09:05:07.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.470+0000 7f599ea00640 1 -- 172.21.15.175:0/3551469045 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a000c670 con 0x7f59a80b12e0 2024-04-25T09:05:07.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.470+0000 7f59ad400640 1 -- 172.21.15.175:0/3551469045 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a80b1850 con 0x7f59a80b12e0 2024-04-25T09:05:07.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.470+0000 7f599ea00640 1 -- 172.21.15.175:0/3551469045 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a000f040 con 0x7f59a80b12e0 2024-04-25T09:05:07.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.470+0000 7f59ad400640 1 -- 172.21.15.175:0/3551469045 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a80b1e10 con 0x7f59a80b12e0 2024-04-25T09:05:07.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.470+0000 7f59ad400640 1 -- 172.21.15.175:0/3551469045 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a8074a60 con 0x7f59a80b12e0 2024-04-25T09:05:07.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.470+0000 7f599ea00640 1 -- 172.21.15.175:0/3551469045 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f59a001a070 con 0x7f59a80b12e0 2024-04-25T09:05:07.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.470+0000 7f599ea00640 1 --2- 172.21.15.175:0/3551469045 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5988066f90 0x7f5988069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.470+0000 7f599ea00640 1 -- 172.21.15.175:0/3551469045 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59a0084b00 con 0x7f59a80b12e0 2024-04-25T09:05:07.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.470+0000 7f59a6800640 1 --2- 172.21.15.175:0/3551469045 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5988066f90 0x7f5988069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.470+0000 7f59a6800640 1 --2- 172.21.15.175:0/3551469045 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5988066f90 0x7f5988069450 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f59980ae000 tx=0x7f59980a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:07.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.474+0000 7f599ea00640 1 -- 172.21.15.175:0/3551469045 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f59a0055b00 con 0x7f59a80b12e0 2024-04-25T09:05:07.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.626+0000 7f59ad400640 1 -- 172.21.15.175:0/3551469045 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f59a81683f0 con 0x7f5988066f90 2024-04-25T09:05:07.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.630+0000 7f599ea00640 1 -- 172.21.15.175:0/3551469045 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246635 (secure 0 0 0) 0x7f59a81683f0 con 0x7f5988066f90 2024-04-25T09:05:07.626 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:07.627 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:05:07.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.634+0000 7f59ad400640 1 -- 172.21.15.175:0/3551469045 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5988066f90 msgr2=0x7f5988069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.634+0000 7f59ad400640 1 --2- 172.21.15.175:0/3551469045 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5988066f90 0x7f5988069450 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f59980ae000 tx=0x7f59980a7070 comp rx=0 tx=0).stop 2024-04-25T09:05:07.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.634+0000 7f59ad400640 1 -- 172.21.15.175:0/3551469045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a80b12e0 msgr2=0x7f59a81fe9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.634+0000 7f59ad400640 1 --2- 172.21.15.175:0/3551469045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a80b12e0 0x7f59a81fe9d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f59a000e840 tx=0x7f59a000ed00 comp rx=0 tx=0).stop 2024-04-25T09:05:07.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.634+0000 7f59ad400640 1 -- 172.21.15.175:0/3551469045 shutdown_connections 2024-04-25T09:05:07.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.634+0000 7f59ad400640 1 --2- 172.21.15.175:0/3551469045 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5988066f90 0x7f5988069450 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.634+0000 7f59ad400640 1 --2- 172.21.15.175:0/3551469045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a80b12e0 0x7f59a81fe9d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.634+0000 7f59ad400640 1 --2- 172.21.15.175:0/3551469045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59a815a900 0x7f59a8158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.634+0000 7f59ad400640 1 --2- 172.21.15.175:0/3551469045 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59a80cf560 0x7f59a80afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.634+0000 7f59ad400640 1 -- 172.21.15.175:0/3551469045 >> 172.21.15.175:0/3551469045 conn(0x7f59a80cd520 msgr2=0x7f59a8152a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:07.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.634+0000 7f59ad400640 1 -- 172.21.15.175:0/3551469045 shutdown_connections 2024-04-25T09:05:07.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.634+0000 7f59ad400640 1 -- 172.21.15.175:0/3551469045 wait complete. 2024-04-25T09:05:07.646 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-04-25T09:05:05.800408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219932,"kb_used_data":3772,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754788,"statfs":{"total":773094113280,"available":772868902912,"internally_reserved":0,"allocated":3862528,"data_stored":2194533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.980347"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833032+0000","last_change":"2024-04-25T09:05:01.833032+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833032+0000","last_undegraded":"2024-04-25T09:05:01.833032+0000","last_fullsized":"2024-04-25T09:05:01.833032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.845672+0000","last_change":"2024-04-25T09:05:01.845672+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.845672+0000","last_undegraded":"2024-04-25T09:05:01.845672+0000","last_fullsized":"2024-04-25T09:05:01.845672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.838784+0000","last_change":"2024-04-25T09:05:01.838784+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.838784+0000","last_undegraded":"2024-04-25T09:05:01.838784+0000","last_fullsized":"2024-04-25T09:05:01.838784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.837977+0000","last_change":"2024-04-25T09:05:01.837977+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.837977+0000","last_undegraded":"2024-04-25T09:05:01.837977+0000","last_fullsized":"2024-04-25T09:05:01.837977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833379+0000","last_change":"2024-04-25T09:05:01.833379+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833379+0000","last_undegraded":"2024-04-25T09:05:01.833379+0000","last_fullsized":"2024-04-25T09:05:01.833379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.842224+0000","last_change":"2024-04-25T09:05:01.842224+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.842224+0000","last_undegraded":"2024-04-25T09:05:01.842224+0000","last_fullsized":"2024-04-25T09:05:01.842224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.840686+0000","last_change":"2024-04-25T09:05:01.840686+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.840686+0000","last_undegraded":"2024-04-25T09:05:01.840686+0000","last_fullsized":"2024-04-25T09:05:01.840686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.851836+0000","last_change":"2024-04-25T09:05:01.851836+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.851836+0000","last_undegraded":"2024-04-25T09:05:01.851836+0000","last_fullsized":"2024-04-25T09:05:01.851836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833603+0000","last_change":"2024-04-25T09:05:01.833603+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833603+0000","last_undegraded":"2024-04-25T09:05:01.833603+0000","last_fullsized":"2024-04-25T09:05:01.833603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.836810+0000","last_change":"2024-04-25T09:05:01.836810+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.836810+0000","last_undegraded":"2024-04-25T09:05:01.836810+0000","last_fullsized":"2024-04-25T09:05:01.836810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839339+0000","last_change":"2024-04-25T09:05:01.839339+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839339+0000","last_undegraded":"2024-04-25T09:05:01.839339+0000","last_fullsized":"2024-04-25T09:05:01.839339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.841743+0000","last_change":"2024-04-25T09:05:01.841743+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.841743+0000","last_undegraded":"2024-04-25T09:05:01.841743+0000","last_fullsized":"2024-04-25T09:05:01.841743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832950+0000","last_change":"2024-04-25T09:05:01.832950+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832950+0000","last_undegraded":"2024-04-25T09:05:01.832950+0000","last_fullsized":"2024-04-25T09:05:01.832950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.841723+0000","last_change":"2024-04-25T09:05:01.841723+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.841723+0000","last_undegraded":"2024-04-25T09:05:01.841723+0000","last_fullsized":"2024-04-25T09:05:01.841723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839516+0000","last_change":"2024-04-25T09:05:01.839516+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839516+0000","last_undegraded":"2024-04-25T09:05:01.839516+0000","last_fullsized":"2024-04-25T09:05:01.839516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839997+0000","last_change":"2024-04-25T09:05:01.839997+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839997+0000","last_undegraded":"2024-04-25T09:05:01.839997+0000","last_fullsized":"2024-04-25T09:05:01.839997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.841319+0000","last_change":"2024-04-25T09:05:01.841319+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.841319+0000","last_undegraded":"2024-04-25T09:05:01.841319+0000","last_fullsized":"2024-04-25T09:05:01.841319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.845160+0000","last_change":"2024-04-25T09:05:01.845160+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.845160+0000","last_undegraded":"2024-04-25T09:05:01.845160+0000","last_fullsized":"2024-04-25T09:05:01.845160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833082+0000","last_change":"2024-04-25T09:05:01.833082+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833082+0000","last_undegraded":"2024-04-25T09:05:01.833082+0000","last_fullsized":"2024-04-25T09:05:01.833082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.834309+0000","last_change":"2024-04-25T09:05:01.834309+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.834309+0000","last_undegraded":"2024-04-25T09:05:01.834309+0000","last_fullsized":"2024-04-25T09:05:01.834309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.835652+0000","last_change":"2024-04-25T09:05:01.835652+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.835652+0000","last_undegraded":"2024-04-25T09:05:01.835652+0000","last_fullsized":"2024-04-25T09:05:01.835652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.834258+0000","last_change":"2024-04-25T09:05:01.834258+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.834258+0000","last_undegraded":"2024-04-25T09:05:01.834258+0000","last_fullsized":"2024-04-25T09:05:01.834258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833902+0000","last_change":"2024-04-25T09:05:01.833902+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833902+0000","last_undegraded":"2024-04-25T09:05:01.833902+0000","last_fullsized":"2024-04-25T09:05:01.833902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.837758+0000","last_change":"2024-04-25T09:05:01.837758+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.837758+0000","last_undegraded":"2024-04-25T09:05:01.837758+0000","last_fullsized":"2024-04-25T09:05:01.837758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839814+0000","last_change":"2024-04-25T09:05:01.839814+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839814+0000","last_undegraded":"2024-04-25T09:05:01.839814+0000","last_fullsized":"2024-04-25T09:05:01.839814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.844759+0000","last_change":"2024-04-25T09:05:01.844759+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.844759+0000","last_undegraded":"2024-04-25T09:05:01.844759+0000","last_fullsized":"2024-04-25T09:05:01.844759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.848547+0000","last_change":"2024-04-25T09:05:01.848547+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.848547+0000","last_undegraded":"2024-04-25T09:05:01.848547+0000","last_fullsized":"2024-04-25T09:05:01.848547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.838376+0000","last_change":"2024-04-25T09:05:01.838376+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.838376+0000","last_undegraded":"2024-04-25T09:05:01.838376+0000","last_fullsized":"2024-04-25T09:05:01.838376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.835174+0000","last_change":"2024-04-25T09:05:01.835174+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.835174+0000","last_undegraded":"2024-04-25T09:05:01.835174+0000","last_fullsized":"2024-04-25T09:05:01.835174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.840595+0000","last_change":"2024-04-25T09:05:01.840595+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.840595+0000","last_undegraded":"2024-04-25T09:05:01.840595+0000","last_fullsized":"2024-04-25T09:05:01.840595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833068+0000","last_change":"2024-04-25T09:05:01.833068+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833068+0000","last_undegraded":"2024-04-25T09:05:01.833068+0000","last_fullsized":"2024-04-25T09:05:01.833068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.851467+0000","last_change":"2024-04-25T09:05:01.851467+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.851467+0000","last_undegraded":"2024-04-25T09:05:01.851467+0000","last_fullsized":"2024-04-25T09:05:01.851467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833477+0000","last_change":"2024-04-25T09:05:01.833477+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833477+0000","last_undegraded":"2024-04-25T09:05:01.833477+0000","last_fullsized":"2024-04-25T09:05:01.833477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.862365+0000","last_change":"2024-04-25T09:05:01.859475+0000","last_active":"2024-04-25T09:05:01.862365+0000","last_peered":"2024-04-25T09:05:01.862365+0000","last_clean":"2024-04-25T09:05:01.862365+0000","last_became_active":"2024-04-25T09:05:01.859205+0000","last_became_peered":"2024-04-25T09:05:01.859205+0000","last_unstale":"2024-04-25T09:05:01.862365+0000","last_undegraded":"2024-04-25T09:05:01.862365+0000","last_fullsized":"2024-04-25T09:05:01.862365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:54.535074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832441+0000","last_change":"2024-04-25T09:05:01.832441+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832441+0000","last_undegraded":"2024-04-25T09:05:01.832441+0000","last_fullsized":"2024-04-25T09:05:01.832441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.852329+0000","last_change":"2024-04-25T09:05:01.851020+0000","last_active":"2024-04-25T09:05:01.852329+0000","last_peered":"2024-04-25T09:05:01.852329+0000","last_clean":"2024-04-25T09:05:01.852329+0000","last_became_active":"2024-04-25T09:05:01.850367+0000","last_became_peered":"2024-04-25T09:05:01.850367+0000","last_unstale":"2024-04-25T09:05:01.852329+0000","last_undegraded":"2024-04-25T09:05:01.852329+0000","last_fullsized":"2024-04-25T09:05:01.852329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:54.535074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833820+0000","last_change":"2024-04-25T09:05:01.833820+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833820+0000","last_undegraded":"2024-04-25T09:05:01.833820+0000","last_fullsized":"2024-04-25T09:05:01.833820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.857147+0000","last_change":"2024-04-25T09:05:01.855321+0000","last_active":"2024-04-25T09:05:01.857147+0000","last_peered":"2024-04-25T09:05:01.857147+0000","last_clean":"2024-04-25T09:05:01.857147+0000","last_became_active":"2024-04-25T09:05:01.854980+0000","last_became_peered":"2024-04-25T09:05:01.854980+0000","last_unstale":"2024-04-25T09:05:01.857147+0000","last_undegraded":"2024-04-25T09:05:01.857147+0000","last_fullsized":"2024-04-25T09:05:01.857147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:01.847172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.848097+0000","last_change":"2024-04-25T09:05:01.848097+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.848097+0000","last_undegraded":"2024-04-25T09:05:01.848097+0000","last_fullsized":"2024-04-25T09:05:01.848097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.857066+0000","last_change":"2024-04-25T09:05:01.855383+0000","last_active":"2024-04-25T09:05:01.857066+0000","last_peered":"2024-04-25T09:05:01.857066+0000","last_clean":"2024-04-25T09:05:01.857066+0000","last_became_active":"2024-04-25T09:05:01.855114+0000","last_became_peered":"2024-04-25T09:05:01.855114+0000","last_unstale":"2024-04-25T09:05:01.857066+0000","last_undegraded":"2024-04-25T09:05:01.857066+0000","last_fullsized":"2024-04-25T09:05:01.857066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:30.365760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839360+0000","last_change":"2024-04-25T09:05:01.839360+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839360+0000","last_undegraded":"2024-04-25T09:05:01.839360+0000","last_fullsized":"2024-04-25T09:05:01.839360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.853680+0000","last_change":"2024-04-25T09:05:01.850620+0000","last_active":"2024-04-25T09:05:01.853680+0000","last_peered":"2024-04-25T09:05:01.853680+0000","last_clean":"2024-04-25T09:05:01.853680+0000","last_became_active":"2024-04-25T09:05:01.850289+0000","last_became_peered":"2024-04-25T09:05:01.850289+0000","last_unstale":"2024-04-25T09:05:01.853680+0000","last_undegraded":"2024-04-25T09:05:01.853680+0000","last_fullsized":"2024-04-25T09:05:01.853680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:07.320232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.847081+0000","last_change":"2024-04-25T09:05:01.847081+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.847081+0000","last_undegraded":"2024-04-25T09:05:01.847081+0000","last_fullsized":"2024-04-25T09:05:01.847081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.856102+0000","last_change":"2024-04-25T09:05:01.853233+0000","last_active":"2024-04-25T09:05:01.856102+0000","last_peered":"2024-04-25T09:05:01.856102+0000","last_clean":"2024-04-25T09:05:01.856102+0000","last_became_active":"2024-04-25T09:05:01.852944+0000","last_became_peered":"2024-04-25T09:05:01.852944+0000","last_unstale":"2024-04-25T09:05:01.856102+0000","last_undegraded":"2024-04-25T09:05:01.856102+0000","last_fullsized":"2024-04-25T09:05:01.856102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:21.522852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833667+0000","last_change":"2024-04-25T09:05:01.833667+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833667+0000","last_undegraded":"2024-04-25T09:05:01.833667+0000","last_fullsized":"2024-04-25T09:05:01.833667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.846208+0000","last_change":"2024-04-25T09:05:01.842765+0000","last_active":"2024-04-25T09:05:01.846208+0000","last_peered":"2024-04-25T09:05:01.846208+0000","last_clean":"2024-04-25T09:05:01.846208+0000","last_became_active":"2024-04-25T09:05:01.842535+0000","last_became_peered":"2024-04-25T09:05:01.842535+0000","last_unstale":"2024-04-25T09:05:01.846208+0000","last_undegraded":"2024-04-25T09:05:01.846208+0000","last_fullsized":"2024-04-25T09:05:01.846208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:07.078383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.836163+0000","last_change":"2024-04-25T09:05:01.836163+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.836163+0000","last_undegraded":"2024-04-25T09:05:01.836163+0000","last_fullsized":"2024-04-25T09:05:01.836163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.848730+0000","last_change":"2024-04-25T09:05:01.844077+0000","last_active":"2024-04-25T09:05:01.848730+0000","last_peered":"2024-04-25T09:05:01.848730+0000","last_clean":"2024-04-25T09:05:01.848730+0000","last_became_active":"2024-04-25T09:05:01.843762+0000","last_became_peered":"2024-04-25T09:05:01.843762+0000","last_unstale":"2024-04-25T09:05:01.848730+0000","last_undegraded":"2024-04-25T09:05:01.848730+0000","last_fullsized":"2024-04-25T09:05:01.848730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:47.729359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.838868+0000","last_change":"2024-04-25T09:05:01.838868+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.838868+0000","last_undegraded":"2024-04-25T09:05:01.838868+0000","last_fullsized":"2024-04-25T09:05:01.838868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.860357+0000","last_change":"2024-04-25T09:05:01.858030+0000","last_active":"2024-04-25T09:05:01.860357+0000","last_peered":"2024-04-25T09:05:01.860357+0000","last_clean":"2024-04-25T09:05:01.860357+0000","last_became_active":"2024-04-25T09:05:01.857784+0000","last_became_peered":"2024-04-25T09:05:01.857784+0000","last_unstale":"2024-04-25T09:05:01.860357+0000","last_undegraded":"2024-04-25T09:05:01.860357+0000","last_fullsized":"2024-04-25T09:05:01.860357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:37.505024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.844325+0000","last_change":"2024-04-25T09:05:01.844325+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.844325+0000","last_undegraded":"2024-04-25T09:05:01.844325+0000","last_fullsized":"2024-04-25T09:05:01.844325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.852437+0000","last_change":"2024-04-25T09:05:01.851249+0000","last_active":"2024-04-25T09:05:01.852437+0000","last_peered":"2024-04-25T09:05:01.852437+0000","last_clean":"2024-04-25T09:05:01.852437+0000","last_became_active":"2024-04-25T09:05:01.850775+0000","last_became_peered":"2024-04-25T09:05:01.850775+0000","last_unstale":"2024-04-25T09:05:01.852437+0000","last_undegraded":"2024-04-25T09:05:01.852437+0000","last_fullsized":"2024-04-25T09:05:01.852437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:55.907137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.835093+0000","last_change":"2024-04-25T09:05:01.835093+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.835093+0000","last_undegraded":"2024-04-25T09:05:01.835093+0000","last_fullsized":"2024-04-25T09:05:01.835093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.862229+0000","last_change":"2024-04-25T09:05:01.860048+0000","last_active":"2024-04-25T09:05:01.862229+0000","last_peered":"2024-04-25T09:05:01.862229+0000","last_clean":"2024-04-25T09:05:01.862229+0000","last_became_active":"2024-04-25T09:05:01.859751+0000","last_became_peered":"2024-04-25T09:05:01.859751+0000","last_unstale":"2024-04-25T09:05:01.862229+0000","last_undegraded":"2024-04-25T09:05:01.862229+0000","last_fullsized":"2024-04-25T09:05:01.862229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:50.944782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.848015+0000","last_change":"2024-04-25T09:05:01.848015+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.848015+0000","last_undegraded":"2024-04-25T09:05:01.848015+0000","last_fullsized":"2024-04-25T09:05:01.848015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.855982+0000","last_change":"2024-04-25T09:05:01.853200+0000","last_active":"2024-04-25T09:05:01.855982+0000","last_peered":"2024-04-25T09:05:01.855982+0000","last_clean":"2024-04-25T09:05:01.855982+0000","last_became_active":"2024-04-25T09:05:01.851932+0000","last_became_peered":"2024-04-25T09:05:01.851932+0000","last_unstale":"2024-04-25T09:05:01.855982+0000","last_undegraded":"2024-04-25T09:05:01.855982+0000","last_fullsized":"2024-04-25T09:05:01.855982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:10.494318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839776+0000","last_change":"2024-04-25T09:05:01.839776+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839776+0000","last_undegraded":"2024-04-25T09:05:01.839776+0000","last_fullsized":"2024-04-25T09:05:01.839776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.848760+0000","last_change":"2024-04-25T09:05:01.844545+0000","last_active":"2024-04-25T09:05:01.848760+0000","last_peered":"2024-04-25T09:05:01.848760+0000","last_clean":"2024-04-25T09:05:01.848760+0000","last_became_active":"2024-04-25T09:05:01.843748+0000","last_became_peered":"2024-04-25T09:05:01.843748+0000","last_unstale":"2024-04-25T09:05:01.848760+0000","last_undegraded":"2024-04-25T09:05:01.848760+0000","last_fullsized":"2024-04-25T09:05:01.848760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:32.762758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832733+0000","last_change":"2024-04-25T09:05:01.832733+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832733+0000","last_undegraded":"2024-04-25T09:05:01.832733+0000","last_fullsized":"2024-04-25T09:05:01.832733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.856328+0000","last_change":"2024-04-25T09:05:01.853811+0000","last_active":"2024-04-25T09:05:01.856328+0000","last_peered":"2024-04-25T09:05:01.856328+0000","last_clean":"2024-04-25T09:05:01.856328+0000","last_became_active":"2024-04-25T09:05:01.853511+0000","last_became_peered":"2024-04-25T09:05:01.853511+0000","last_unstale":"2024-04-25T09:05:01.856328+0000","last_undegraded":"2024-04-25T09:05:01.856328+0000","last_fullsized":"2024-04-25T09:05:01.856328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:52.353215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.851022+0000","last_change":"2024-04-25T09:05:01.851022+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.851022+0000","last_undegraded":"2024-04-25T09:05:01.851022+0000","last_fullsized":"2024-04-25T09:05:01.851022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.853525+0000","last_change":"2024-04-25T09:05:01.849597+0000","last_active":"2024-04-25T09:05:01.853525+0000","last_peered":"2024-04-25T09:05:01.853525+0000","last_clean":"2024-04-25T09:05:01.853525+0000","last_became_active":"2024-04-25T09:05:01.849343+0000","last_became_peered":"2024-04-25T09:05:01.849343+0000","last_unstale":"2024-04-25T09:05:01.853525+0000","last_undegraded":"2024-04-25T09:05:01.853525+0000","last_fullsized":"2024-04-25T09:05:01.853525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:23.553154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832450+0000","last_change":"2024-04-25T09:05:01.832450+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832450+0000","last_undegraded":"2024-04-25T09:05:01.832450+0000","last_fullsized":"2024-04-25T09:05:01.832450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.847526+0000","last_change":"2024-04-25T09:05:01.845805+0000","last_active":"2024-04-25T09:05:01.847526+0000","last_peered":"2024-04-25T09:05:01.847526+0000","last_clean":"2024-04-25T09:05:01.847526+0000","last_became_active":"2024-04-25T09:05:01.845373+0000","last_became_peered":"2024-04-25T09:05:01.845373+0000","last_unstale":"2024-04-25T09:05:01.847526+0000","last_undegraded":"2024-04-25T09:05:01.847526+0000","last_fullsized":"2024-04-25T09:05:01.847526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:15.508830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.835237+0000","last_change":"2024-04-25T09:05:01.835237+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.835237+0000","last_undegraded":"2024-04-25T09:05:01.835237+0000","last_fullsized":"2024-04-25T09:05:01.835237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.855778+0000","last_change":"2024-04-25T09:05:01.853103+0000","last_active":"2024-04-25T09:05:01.855778+0000","last_peered":"2024-04-25T09:05:01.855778+0000","last_clean":"2024-04-25T09:05:01.855778+0000","last_became_active":"2024-04-25T09:05:01.852683+0000","last_became_peered":"2024-04-25T09:05:01.852683+0000","last_unstale":"2024-04-25T09:05:01.855778+0000","last_undegraded":"2024-04-25T09:05:01.855778+0000","last_fullsized":"2024-04-25T09:05:01.855778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:22.640219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.845105+0000","last_change":"2024-04-25T09:05:01.845105+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.845105+0000","last_undegraded":"2024-04-25T09:05:01.845105+0000","last_fullsized":"2024-04-25T09:05:01.845105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.851325+0000","last_change":"2024-04-25T09:05:01.846615+0000","last_active":"2024-04-25T09:05:01.851325+0000","last_peered":"2024-04-25T09:05:01.851325+0000","last_clean":"2024-04-25T09:05:01.851325+0000","last_became_active":"2024-04-25T09:05:01.846321+0000","last_became_peered":"2024-04-25T09:05:01.846321+0000","last_unstale":"2024-04-25T09:05:01.851325+0000","last_undegraded":"2024-04-25T09:05:01.851325+0000","last_fullsized":"2024-04-25T09:05:01.851325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:30.103785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.837557+0000","last_change":"2024-04-25T09:05:01.837557+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.837557+0000","last_undegraded":"2024-04-25T09:05:01.837557+0000","last_fullsized":"2024-04-25T09:05:01.837557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.851132+0000","last_change":"2024-04-25T09:05:01.845678+0000","last_active":"2024-04-25T09:05:01.851132+0000","last_peered":"2024-04-25T09:05:01.851132+0000","last_clean":"2024-04-25T09:05:01.851132+0000","last_became_active":"2024-04-25T09:05:01.845394+0000","last_became_peered":"2024-04-25T09:05:01.845394+0000","last_unstale":"2024-04-25T09:05:01.851132+0000","last_undegraded":"2024-04-25T09:05:01.851132+0000","last_fullsized":"2024-04-25T09:05:01.851132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:30.365760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832917+0000","last_change":"2024-04-25T09:05:01.832917+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832917+0000","last_undegraded":"2024-04-25T09:05:01.832917+0000","last_fullsized":"2024-04-25T09:05:01.832917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.855987+0000","last_change":"2024-04-25T09:05:01.850960+0000","last_active":"2024-04-25T09:05:01.855987+0000","last_peered":"2024-04-25T09:05:01.855987+0000","last_clean":"2024-04-25T09:05:01.855987+0000","last_became_active":"2024-04-25T09:05:01.850670+0000","last_became_peered":"2024-04-25T09:05:01.850670+0000","last_unstale":"2024-04-25T09:05:01.855987+0000","last_undegraded":"2024-04-25T09:05:01.855987+0000","last_fullsized":"2024-04-25T09:05:01.855987+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:59.624866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832469+0000","last_change":"2024-04-25T09:05:01.832469+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832469+0000","last_undegraded":"2024-04-25T09:05:01.832469+0000","last_fullsized":"2024-04-25T09:05:01.832469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.843938+0000","last_change":"2024-04-25T09:05:01.841773+0000","last_active":"2024-04-25T09:05:01.843938+0000","last_peered":"2024-04-25T09:05:01.843938+0000","last_clean":"2024-04-25T09:05:01.843938+0000","last_became_active":"2024-04-25T09:05:01.841485+0000","last_became_peered":"2024-04-25T09:05:01.841485+0000","last_unstale":"2024-04-25T09:05:01.843938+0000","last_undegraded":"2024-04-25T09:05:01.843938+0000","last_fullsized":"2024-04-25T09:05:01.843938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:40.689654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832490+0000","last_change":"2024-04-25T09:05:01.832490+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832490+0000","last_undegraded":"2024-04-25T09:05:01.832490+0000","last_fullsized":"2024-04-25T09:05:01.832490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.861723+0000","last_change":"2024-04-25T09:05:01.856230+0000","last_active":"2024-04-25T09:05:01.861723+0000","last_peered":"2024-04-25T09:05:01.861723+0000","last_clean":"2024-04-25T09:05:01.861723+0000","last_became_active":"2024-04-25T09:05:01.855929+0000","last_became_peered":"2024-04-25T09:05:01.855929+0000","last_unstale":"2024-04-25T09:05:01.861723+0000","last_undegraded":"2024-04-25T09:05:01.861723+0000","last_fullsized":"2024-04-25T09:05:01.861723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:45.459385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832449+0000","last_change":"2024-04-25T09:05:01.832449+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832449+0000","last_undegraded":"2024-04-25T09:05:01.832449+0000","last_fullsized":"2024-04-25T09:05:01.832449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.845948+0000","last_change":"2024-04-25T09:05:01.842494+0000","last_active":"2024-04-25T09:05:01.845948+0000","last_peered":"2024-04-25T09:05:01.845948+0000","last_clean":"2024-04-25T09:05:01.845948+0000","last_became_active":"2024-04-25T09:05:01.842187+0000","last_became_peered":"2024-04-25T09:05:01.842187+0000","last_unstale":"2024-04-25T09:05:01.845948+0000","last_undegraded":"2024-04-25T09:05:01.845948+0000","last_fullsized":"2024-04-25T09:05:01.845948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:29.852470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.840941+0000","last_change":"2024-04-25T09:05:01.840941+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.840941+0000","last_undegraded":"2024-04-25T09:05:01.840941+0000","last_fullsized":"2024-04-25T09:05:01.840941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.859059+0000","last_change":"2024-04-25T09:05:01.853085+0000","last_active":"2024-04-25T09:05:01.859059+0000","last_peered":"2024-04-25T09:05:01.859059+0000","last_clean":"2024-04-25T09:05:01.859059+0000","last_became_active":"2024-04-25T09:05:01.852672+0000","last_became_peered":"2024-04-25T09:05:01.852672+0000","last_unstale":"2024-04-25T09:05:01.859059+0000","last_undegraded":"2024-04-25T09:05:01.859059+0000","last_fullsized":"2024-04-25T09:05:01.859059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:28.059026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833669+0000","last_change":"2024-04-25T09:05:01.833669+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833669+0000","last_undegraded":"2024-04-25T09:05:01.833669+0000","last_fullsized":"2024-04-25T09:05:01.833669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.862078+0000","last_change":"2024-04-25T09:05:01.859966+0000","last_active":"2024-04-25T09:05:01.862078+0000","last_peered":"2024-04-25T09:05:01.862078+0000","last_clean":"2024-04-25T09:05:01.862078+0000","last_became_active":"2024-04-25T09:05:01.859591+0000","last_became_peered":"2024-04-25T09:05:01.859591+0000","last_unstale":"2024-04-25T09:05:01.862078+0000","last_undegraded":"2024-04-25T09:05:01.862078+0000","last_fullsized":"2024-04-25T09:05:01.862078+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:48.677980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.844758+0000","last_change":"2024-04-25T09:05:01.844758+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.844758+0000","last_undegraded":"2024-04-25T09:05:01.844758+0000","last_fullsized":"2024-04-25T09:05:01.844758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.843735+0000","last_change":"2024-04-25T09:05:01.841767+0000","last_active":"2024-04-25T09:05:01.843735+0000","last_peered":"2024-04-25T09:05:01.843735+0000","last_clean":"2024-04-25T09:05:01.843735+0000","last_became_active":"2024-04-25T09:05:01.841486+0000","last_became_peered":"2024-04-25T09:05:01.841486+0000","last_unstale":"2024-04-25T09:05:01.843735+0000","last_undegraded":"2024-04-25T09:05:01.843735+0000","last_fullsized":"2024-04-25T09:05:01.843735+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:45.459385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832615+0000","last_change":"2024-04-25T09:05:01.832615+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832615+0000","last_undegraded":"2024-04-25T09:05:01.832615+0000","last_fullsized":"2024-04-25T09:05:01.832615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.855328+0000","last_change":"2024-04-25T09:05:01.853095+0000","last_active":"2024-04-25T09:05:01.855328+0000","last_peered":"2024-04-25T09:05:01.855328+0000","last_clean":"2024-04-25T09:05:01.855328+0000","last_became_active":"2024-04-25T09:05:01.852739+0000","last_became_peered":"2024-04-25T09:05:01.852739+0000","last_unstale":"2024-04-25T09:05:01.855328+0000","last_undegraded":"2024-04-25T09:05:01.855328+0000","last_fullsized":"2024-04-25T09:05:01.855328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:55.907137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.834556+0000","last_change":"2024-04-25T09:05:01.834556+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.834556+0000","last_undegraded":"2024-04-25T09:05:01.834556+0000","last_fullsized":"2024-04-25T09:05:01.834556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.860191+0000","last_change":"2024-04-25T09:05:01.858937+0000","last_active":"2024-04-25T09:05:01.860191+0000","last_peered":"2024-04-25T09:05:01.860191+0000","last_clean":"2024-04-25T09:05:01.860191+0000","last_became_active":"2024-04-25T09:05:01.858636+0000","last_became_peered":"2024-04-25T09:05:01.858636+0000","last_unstale":"2024-04-25T09:05:01.860191+0000","last_undegraded":"2024-04-25T09:05:01.860191+0000","last_fullsized":"2024-04-25T09:05:01.860191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:22.640219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832222+0000","last_change":"2024-04-25T09:05:01.832222+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832222+0000","last_undegraded":"2024-04-25T09:05:01.832222+0000","last_fullsized":"2024-04-25T09:05:01.832222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.862061+0000","last_change":"2024-04-25T09:05:01.859845+0000","last_active":"2024-04-25T09:05:01.862061+0000","last_peered":"2024-04-25T09:05:01.862061+0000","last_clean":"2024-04-25T09:05:01.862061+0000","last_became_active":"2024-04-25T09:05:01.859553+0000","last_became_peered":"2024-04-25T09:05:01.859553+0000","last_unstale":"2024-04-25T09:05:01.862061+0000","last_undegraded":"2024-04-25T09:05:01.862061+0000","last_fullsized":"2024-04-25T09:05:01.862061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:03.855826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.838757+0000","last_change":"2024-04-25T09:05:01.838757+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.838757+0000","last_undegraded":"2024-04-25T09:05:01.838757+0000","last_fullsized":"2024-04-25T09:05:01.838757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.861795+0000","last_change":"2024-04-25T09:05:01.860397+0000","last_active":"2024-04-25T09:05:01.861795+0000","last_peered":"2024-04-25T09:05:01.861795+0000","last_clean":"2024-04-25T09:05:01.861795+0000","last_became_active":"2024-04-25T09:05:01.859885+0000","last_became_peered":"2024-04-25T09:05:01.859885+0000","last_unstale":"2024-04-25T09:05:01.861795+0000","last_undegraded":"2024-04-25T09:05:01.861795+0000","last_fullsized":"2024-04-25T09:05:01.861795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:51.382457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.834694+0000","last_change":"2024-04-25T09:05:01.834694+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.834694+0000","last_undegraded":"2024-04-25T09:05:01.834694+0000","last_fullsized":"2024-04-25T09:05:01.834694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.857124+0000","last_change":"2024-04-25T09:05:01.854637+0000","last_active":"2024-04-25T09:05:01.857124+0000","last_peered":"2024-04-25T09:05:01.857124+0000","last_clean":"2024-04-25T09:05:01.857124+0000","last_became_active":"2024-04-25T09:05:01.854045+0000","last_became_peered":"2024-04-25T09:05:01.854045+0000","last_unstale":"2024-04-25T09:05:01.857124+0000","last_undegraded":"2024-04-25T09:05:01.857124+0000","last_fullsized":"2024-04-25T09:05:01.857124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:12.759868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.842018+0000","last_change":"2024-04-25T09:05:01.842018+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.842018+0000","last_undegraded":"2024-04-25T09:05:01.842018+0000","last_fullsized":"2024-04-25T09:05:01.842018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.848920+0000","last_change":"2024-04-25T09:05:01.844352+0000","last_active":"2024-04-25T09:05:01.848920+0000","last_peered":"2024-04-25T09:05:01.848920+0000","last_clean":"2024-04-25T09:05:01.848920+0000","last_became_active":"2024-04-25T09:05:01.843530+0000","last_became_peered":"2024-04-25T09:05:01.843530+0000","last_unstale":"2024-04-25T09:05:01.848920+0000","last_undegraded":"2024-04-25T09:05:01.848920+0000","last_fullsized":"2024-04-25T09:05:01.848920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:40.689654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.852056+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:05:01.852056+0000","last_peered":"2024-04-25T09:05:01.852056+0000","last_clean":"2024-04-25T09:05:01.852056+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:05:01.852056+0000","last_undegraded":"2024-04-25T09:05:01.852056+0000","last_fullsized":"2024-04-25T09:05:01.852056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":711609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:05:07.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-04-25T09:05:07.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.833032+0000', 'last_change': '2024-04-25T09:05:01.833032+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.833032+0000', 'last_undegraded': '2024-04-25T09:05:01.833032+0000', 'last_fullsized': '2024-04-25T09:05:01.833032+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:05:07.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2024-04-25T09:05:07.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.845672+0000', 'last_change': '2024-04-25T09:05:01.845672+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.845672+0000', 'last_undegraded': '2024-04-25T09:05:01.845672+0000', 'last_fullsized': '2024-04-25T09:05:01.845672+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:05:07.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-04-25T09:05:07.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.838784+0000', 'last_change': '2024-04-25T09:05:01.838784+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.838784+0000', 'last_undegraded': '2024-04-25T09:05:01.838784+0000', 'last_fullsized': '2024-04-25T09:05:01.838784+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:05:07.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2024-04-25T09:05:07.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.837977+0000', 'last_change': '2024-04-25T09:05:01.837977+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.837977+0000', 'last_undegraded': '2024-04-25T09:05:01.837977+0000', 'last_fullsized': '2024-04-25T09:05:01.837977+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:05:07.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2024-04-25T09:05:07.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.833379+0000', 'last_change': '2024-04-25T09:05:01.833379+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.833379+0000', 'last_undegraded': '2024-04-25T09:05:01.833379+0000', 'last_fullsized': '2024-04-25T09:05:01.833379+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:05:07.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2024-04-25T09:05:07.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.842224+0000', 'last_change': '2024-04-25T09:05:01.842224+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.842224+0000', 'last_undegraded': '2024-04-25T09:05:01.842224+0000', 'last_fullsized': '2024-04-25T09:05:01.842224+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:05:07.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-04-25T09:05:07.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.840686+0000', 'last_change': '2024-04-25T09:05:01.840686+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.840686+0000', 'last_undegraded': '2024-04-25T09:05:01.840686+0000', 'last_fullsized': '2024-04-25T09:05:01.840686+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:05:07.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-04-25T09:05:07.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.851836+0000', 'last_change': '2024-04-25T09:05:01.851836+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.851836+0000', 'last_undegraded': '2024-04-25T09:05:01.851836+0000', 'last_fullsized': '2024-04-25T09:05:01.851836+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:05:07.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-04-25T09:05:07.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.833603+0000', 'last_change': '2024-04-25T09:05:01.833603+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.833603+0000', 'last_undegraded': '2024-04-25T09:05:01.833603+0000', 'last_fullsized': '2024-04-25T09:05:01.833603+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:05:07.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2024-04-25T09:05:07.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.836810+0000', 'last_change': '2024-04-25T09:05:01.836810+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.836810+0000', 'last_undegraded': '2024-04-25T09:05:01.836810+0000', 'last_fullsized': '2024-04-25T09:05:01.836810+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:05:07.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-04-25T09:05:07.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.839339+0000', 'last_change': '2024-04-25T09:05:01.839339+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.839339+0000', 'last_undegraded': '2024-04-25T09:05:01.839339+0000', 'last_fullsized': '2024-04-25T09:05:01.839339+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:05:07.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-04-25T09:05:07.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.841743+0000', 'last_change': '2024-04-25T09:05:01.841743+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.841743+0000', 'last_undegraded': '2024-04-25T09:05:01.841743+0000', 'last_fullsized': '2024-04-25T09:05:01.841743+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:05:07.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2024-04-25T09:05:07.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.832950+0000', 'last_change': '2024-04-25T09:05:01.832950+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.832950+0000', 'last_undegraded': '2024-04-25T09:05:01.832950+0000', 'last_fullsized': '2024-04-25T09:05:01.832950+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:05:07.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2024-04-25T09:05:07.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.841723+0000', 'last_change': '2024-04-25T09:05:01.841723+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.841723+0000', 'last_undegraded': '2024-04-25T09:05:01.841723+0000', 'last_fullsized': '2024-04-25T09:05:01.841723+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:05:07.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-04-25T09:05:07.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.839516+0000', 'last_change': '2024-04-25T09:05:01.839516+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.839516+0000', 'last_undegraded': '2024-04-25T09:05:01.839516+0000', 'last_fullsized': '2024-04-25T09:05:01.839516+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:05:07.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-04-25T09:05:07.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.839997+0000', 'last_change': '2024-04-25T09:05:01.839997+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.839997+0000', 'last_undegraded': '2024-04-25T09:05:01.839997+0000', 'last_fullsized': '2024-04-25T09:05:01.839997+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:05:07.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-04-25T09:05:07.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.841319+0000', 'last_change': '2024-04-25T09:05:01.841319+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.841319+0000', 'last_undegraded': '2024-04-25T09:05:01.841319+0000', 'last_fullsized': '2024-04-25T09:05:01.841319+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:05:07.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2024-04-25T09:05:07.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.845160+0000', 'last_change': '2024-04-25T09:05:01.845160+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.845160+0000', 'last_undegraded': '2024-04-25T09:05:01.845160+0000', 'last_fullsized': '2024-04-25T09:05:01.845160+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:05:07.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2024-04-25T09:05:07.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.833082+0000', 'last_change': '2024-04-25T09:05:01.833082+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.833082+0000', 'last_undegraded': '2024-04-25T09:05:01.833082+0000', 'last_fullsized': '2024-04-25T09:05:01.833082+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:05:07.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2024-04-25T09:05:07.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.834309+0000', 'last_change': '2024-04-25T09:05:01.834309+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.834309+0000', 'last_undegraded': '2024-04-25T09:05:01.834309+0000', 'last_fullsized': '2024-04-25T09:05:01.834309+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:05:07.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-04-25T09:05:07.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.835652+0000', 'last_change': '2024-04-25T09:05:01.835652+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.835652+0000', 'last_undegraded': '2024-04-25T09:05:01.835652+0000', 'last_fullsized': '2024-04-25T09:05:01.835652+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:05:07.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-04-25T09:05:07.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.834258+0000', 'last_change': '2024-04-25T09:05:01.834258+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.834258+0000', 'last_undegraded': '2024-04-25T09:05:01.834258+0000', 'last_fullsized': '2024-04-25T09:05:01.834258+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:05:07.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-04-25T09:05:07.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.833902+0000', 'last_change': '2024-04-25T09:05:01.833902+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.833902+0000', 'last_undegraded': '2024-04-25T09:05:01.833902+0000', 'last_fullsized': '2024-04-25T09:05:01.833902+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:05:07.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-04-25T09:05:07.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.837758+0000', 'last_change': '2024-04-25T09:05:01.837758+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.837758+0000', 'last_undegraded': '2024-04-25T09:05:01.837758+0000', 'last_fullsized': '2024-04-25T09:05:01.837758+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:05:07.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2024-04-25T09:05:07.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.839814+0000', 'last_change': '2024-04-25T09:05:01.839814+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.839814+0000', 'last_undegraded': '2024-04-25T09:05:01.839814+0000', 'last_fullsized': '2024-04-25T09:05:01.839814+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:05:07.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2024-04-25T09:05:07.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.844759+0000', 'last_change': '2024-04-25T09:05:01.844759+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.844759+0000', 'last_undegraded': '2024-04-25T09:05:01.844759+0000', 'last_fullsized': '2024-04-25T09:05:01.844759+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:05:07.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2024-04-25T09:05:07.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.848547+0000', 'last_change': '2024-04-25T09:05:01.848547+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.848547+0000', 'last_undegraded': '2024-04-25T09:05:01.848547+0000', 'last_fullsized': '2024-04-25T09:05:01.848547+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:05:07.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-04-25T09:05:07.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.838376+0000', 'last_change': '2024-04-25T09:05:01.838376+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.838376+0000', 'last_undegraded': '2024-04-25T09:05:01.838376+0000', 'last_fullsized': '2024-04-25T09:05:01.838376+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:05:07.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-04-25T09:05:07.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.835174+0000', 'last_change': '2024-04-25T09:05:01.835174+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.835174+0000', 'last_undegraded': '2024-04-25T09:05:01.835174+0000', 'last_fullsized': '2024-04-25T09:05:01.835174+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:05:07.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-04-25T09:05:07.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.840595+0000', 'last_change': '2024-04-25T09:05:01.840595+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.840595+0000', 'last_undegraded': '2024-04-25T09:05:01.840595+0000', 'last_fullsized': '2024-04-25T09:05:01.840595+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:05:07.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-04-25T09:05:07.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.833068+0000', 'last_change': '2024-04-25T09:05:01.833068+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.833068+0000', 'last_undegraded': '2024-04-25T09:05:01.833068+0000', 'last_fullsized': '2024-04-25T09:05:01.833068+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:05:07.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-04-25T09:05:07.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.851467+0000', 'last_change': '2024-04-25T09:05:01.851467+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.851467+0000', 'last_undegraded': '2024-04-25T09:05:01.851467+0000', 'last_fullsized': '2024-04-25T09:05:01.851467+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:05:07.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-04-25T09:05:07.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.833477+0000', 'last_change': '2024-04-25T09:05:01.833477+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.833477+0000', 'last_undegraded': '2024-04-25T09:05:01.833477+0000', 'last_fullsized': '2024-04-25T09:05:01.833477+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:05:07.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-04-25T09:05:07.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.832441+0000', 'last_change': '2024-04-25T09:05:01.832441+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.832441+0000', 'last_undegraded': '2024-04-25T09:05:01.832441+0000', 'last_fullsized': '2024-04-25T09:05:01.832441+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:05:07.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-04-25T09:05:07.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.833820+0000', 'last_change': '2024-04-25T09:05:01.833820+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.833820+0000', 'last_undegraded': '2024-04-25T09:05:01.833820+0000', 'last_fullsized': '2024-04-25T09:05:01.833820+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:05:07.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2024-04-25T09:05:07.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.848097+0000', 'last_change': '2024-04-25T09:05:01.848097+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.848097+0000', 'last_undegraded': '2024-04-25T09:05:01.848097+0000', 'last_fullsized': '2024-04-25T09:05:01.848097+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:05:07.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-04-25T09:05:07.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.839360+0000', 'last_change': '2024-04-25T09:05:01.839360+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.839360+0000', 'last_undegraded': '2024-04-25T09:05:01.839360+0000', 'last_fullsized': '2024-04-25T09:05:01.839360+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:05:07.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-04-25T09:05:07.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.847081+0000', 'last_change': '2024-04-25T09:05:01.847081+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.847081+0000', 'last_undegraded': '2024-04-25T09:05:01.847081+0000', 'last_fullsized': '2024-04-25T09:05:01.847081+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:05:07.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-04-25T09:05:07.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.833667+0000', 'last_change': '2024-04-25T09:05:01.833667+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.833667+0000', 'last_undegraded': '2024-04-25T09:05:01.833667+0000', 'last_fullsized': '2024-04-25T09:05:01.833667+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:05:07.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2024-04-25T09:05:07.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.836163+0000', 'last_change': '2024-04-25T09:05:01.836163+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.836163+0000', 'last_undegraded': '2024-04-25T09:05:01.836163+0000', 'last_fullsized': '2024-04-25T09:05:01.836163+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:05:07.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-04-25T09:05:07.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.838868+0000', 'last_change': '2024-04-25T09:05:01.838868+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.838868+0000', 'last_undegraded': '2024-04-25T09:05:01.838868+0000', 'last_fullsized': '2024-04-25T09:05:01.838868+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:05:07.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2024-04-25T09:05:07.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.844325+0000', 'last_change': '2024-04-25T09:05:01.844325+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.844325+0000', 'last_undegraded': '2024-04-25T09:05:01.844325+0000', 'last_fullsized': '2024-04-25T09:05:01.844325+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:05:07.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2024-04-25T09:05:07.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.835093+0000', 'last_change': '2024-04-25T09:05:01.835093+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.835093+0000', 'last_undegraded': '2024-04-25T09:05:01.835093+0000', 'last_fullsized': '2024-04-25T09:05:01.835093+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:05:07.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-04-25T09:05:07.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.848015+0000', 'last_change': '2024-04-25T09:05:01.848015+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.848015+0000', 'last_undegraded': '2024-04-25T09:05:01.848015+0000', 'last_fullsized': '2024-04-25T09:05:01.848015+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:05:07.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2024-04-25T09:05:07.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.839776+0000', 'last_change': '2024-04-25T09:05:01.839776+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.839776+0000', 'last_undegraded': '2024-04-25T09:05:01.839776+0000', 'last_fullsized': '2024-04-25T09:05:01.839776+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:05:07.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2024-04-25T09:05:07.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.832733+0000', 'last_change': '2024-04-25T09:05:01.832733+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.832733+0000', 'last_undegraded': '2024-04-25T09:05:01.832733+0000', 'last_fullsized': '2024-04-25T09:05:01.832733+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:05:07.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-04-25T09:05:07.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.851022+0000', 'last_change': '2024-04-25T09:05:01.851022+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.851022+0000', 'last_undegraded': '2024-04-25T09:05:01.851022+0000', 'last_fullsized': '2024-04-25T09:05:01.851022+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:05:07.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-04-25T09:05:07.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.832450+0000', 'last_change': '2024-04-25T09:05:01.832450+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.832450+0000', 'last_undegraded': '2024-04-25T09:05:01.832450+0000', 'last_fullsized': '2024-04-25T09:05:01.832450+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:05:07.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-04-25T09:05:07.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.835237+0000', 'last_change': '2024-04-25T09:05:01.835237+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.835237+0000', 'last_undegraded': '2024-04-25T09:05:01.835237+0000', 'last_fullsized': '2024-04-25T09:05:01.835237+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:05:07.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-04-25T09:05:07.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.845105+0000', 'last_change': '2024-04-25T09:05:01.845105+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.845105+0000', 'last_undegraded': '2024-04-25T09:05:01.845105+0000', 'last_fullsized': '2024-04-25T09:05:01.845105+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:05:07.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2024-04-25T09:05:07.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.837557+0000', 'last_change': '2024-04-25T09:05:01.837557+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.837557+0000', 'last_undegraded': '2024-04-25T09:05:01.837557+0000', 'last_fullsized': '2024-04-25T09:05:01.837557+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:05:07.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2024-04-25T09:05:07.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.832917+0000', 'last_change': '2024-04-25T09:05:01.832917+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.832917+0000', 'last_undegraded': '2024-04-25T09:05:01.832917+0000', 'last_fullsized': '2024-04-25T09:05:01.832917+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:05:07.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2024-04-25T09:05:07.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.832469+0000', 'last_change': '2024-04-25T09:05:01.832469+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.832469+0000', 'last_undegraded': '2024-04-25T09:05:01.832469+0000', 'last_fullsized': '2024-04-25T09:05:01.832469+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:05:07.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2024-04-25T09:05:07.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.832490+0000', 'last_change': '2024-04-25T09:05:01.832490+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.832490+0000', 'last_undegraded': '2024-04-25T09:05:01.832490+0000', 'last_fullsized': '2024-04-25T09:05:01.832490+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:05:07.660 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2024-04-25T09:05:07.660 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.832449+0000', 'last_change': '2024-04-25T09:05:01.832449+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.832449+0000', 'last_undegraded': '2024-04-25T09:05:01.832449+0000', 'last_fullsized': '2024-04-25T09:05:01.832449+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:05:07.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-04-25T09:05:07.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.840941+0000', 'last_change': '2024-04-25T09:05:01.840941+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.840941+0000', 'last_undegraded': '2024-04-25T09:05:01.840941+0000', 'last_fullsized': '2024-04-25T09:05:01.840941+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:05:07.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2024-04-25T09:05:07.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.833669+0000', 'last_change': '2024-04-25T09:05:01.833669+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.833669+0000', 'last_undegraded': '2024-04-25T09:05:01.833669+0000', 'last_fullsized': '2024-04-25T09:05:01.833669+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:05:07.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-04-25T09:05:07.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.844758+0000', 'last_change': '2024-04-25T09:05:01.844758+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.844758+0000', 'last_undegraded': '2024-04-25T09:05:01.844758+0000', 'last_fullsized': '2024-04-25T09:05:01.844758+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:05:07.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-04-25T09:05:07.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.832615+0000', 'last_change': '2024-04-25T09:05:01.832615+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.832615+0000', 'last_undegraded': '2024-04-25T09:05:01.832615+0000', 'last_fullsized': '2024-04-25T09:05:01.832615+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:05:07.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-04-25T09:05:07.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.834556+0000', 'last_change': '2024-04-25T09:05:01.834556+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.834556+0000', 'last_undegraded': '2024-04-25T09:05:01.834556+0000', 'last_fullsized': '2024-04-25T09:05:01.834556+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:05:07.661 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-04-25T09:05:07.661 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.832222+0000', 'last_change': '2024-04-25T09:05:01.832222+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.832222+0000', 'last_undegraded': '2024-04-25T09:05:01.832222+0000', 'last_fullsized': '2024-04-25T09:05:01.832222+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:05:07.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2024-04-25T09:05:07.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.838757+0000', 'last_change': '2024-04-25T09:05:01.838757+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.838757+0000', 'last_undegraded': '2024-04-25T09:05:01.838757+0000', 'last_fullsized': '2024-04-25T09:05:01.838757+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:05:07.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-04-25T09:05:07.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.834694+0000', 'last_change': '2024-04-25T09:05:01.834694+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.834694+0000', 'last_undegraded': '2024-04-25T09:05:01.834694+0000', 'last_fullsized': '2024-04-25T09:05:01.834694+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:05:07.662 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-04-25T09:05:07.662 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:05:01.842018+0000', 'last_change': '2024-04-25T09:05:01.842018+0000', 'last_active': '2024-04-25T09:05:01.819932+0000', 'last_peered': '2024-04-25T09:05:01.819932+0000', 'last_clean': '2024-04-25T09:05:01.819932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:05:01.842018+0000', 'last_undegraded': '2024-04-25T09:05:01.842018+0000', 'last_fullsized': '2024-04-25T09:05:01.842018+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'last_clean_scrub_stamp': '2024-04-25T09:05:01.819932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:05:07.663 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:05:07.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.830+0000 7f551fe00640 1 Processor -- start 2024-04-25T09:05:07.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.830+0000 7f551fe00640 1 -- start start 2024-04-25T09:05:07.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.834+0000 7f551fe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55200d03b0 0x7f55200b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.834+0000 7f551fe00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55200cf9a0 con 0x7f552015b930 2024-04-25T09:05:07.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.834+0000 7f551fe00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55200b2030 con 0x7f552009a5f0 2024-04-25T09:05:07.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.834+0000 7f551fe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55200cc1d0 con 0x7f55200d03b0 2024-04-25T09:05:07.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.834+0000 7f551ea00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f552015b930 0x7f55200cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:57502/0 (socket says 172.21.15.175:57502) 2024-04-25T09:05:07.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.834+0000 7f551ea00640 1 -- 172.21.15.175:0/1618611561 learned_addr learned my addr 172.21.15.175:0/1618611561 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:07.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.834+0000 7f551f400640 1 --2- 172.21.15.175:0/1618611561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55200d03b0 0x7f55200b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.834+0000 7f551e000640 1 -- 172.21.15.175:0/1618611561 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1440850208 0 0) 0x7f55200cf9a0 con 0x7f552015b930 2024-04-25T09:05:07.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.834+0000 7f551e000640 1 -- 172.21.15.175:0/1618611561 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5504003530 con 0x7f552015b930 2024-04-25T09:05:07.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.834+0000 7f551e000640 1 -- 172.21.15.175:0/1618611561 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434920175 0 0) 0x7f55200b2030 con 0x7f552009a5f0 2024-04-25T09:05:07.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.834+0000 7f551f400640 1 -- 172.21.15.175:0/1618611561 >> v1:172.21.15.177:6789/0 conn(0x7f552009a5f0 legacy=0x7f55200cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.834+0000 7f551f400640 1 -- 172.21.15.175:0/1618611561 >> v1:172.21.15.175:6789/0 conn(0x7f552015b930 legacy=0x7f55200cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.834+0000 7f551f400640 1 -- 172.21.15.175:0/1618611561 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55200cc400 con 0x7f55200d03b0 2024-04-25T09:05:07.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.834+0000 7f551f400640 1 --2- 172.21.15.175:0/1618611561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55200d03b0 0x7f55200b2480 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5518009dc0 tx=0x7f551801c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d852738438f5a02f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551e000640 1 -- 172.21.15.175:0/1618611561 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55180b2070 con 0x7f55200d03b0 2024-04-25T09:05:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551e000640 1 -- 172.21.15.175:0/1618611561 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55180a5940 con 0x7f55200d03b0 2024-04-25T09:05:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551e000640 1 -- 172.21.15.175:0/1618611561 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55180a5d10 con 0x7f55200d03b0 2024-04-25T09:05:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551fe00640 1 -- 172.21.15.175:0/1618611561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55200d03b0 msgr2=0x7f55200b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551fe00640 1 --2- 172.21.15.175:0/1618611561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55200d03b0 0x7f55200b2480 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5518009dc0 tx=0x7f551801c990 comp rx=0 tx=0).stop 2024-04-25T09:05:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551fe00640 1 -- 172.21.15.175:0/1618611561 shutdown_connections 2024-04-25T09:05:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551fe00640 1 --2- 172.21.15.175:0/1618611561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55200d03b0 0x7f55200b2480 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551fe00640 1 -- 172.21.15.175:0/1618611561 >> 172.21.15.175:0/1618611561 conn(0x7f55200b31b0 msgr2=0x7f55200b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551fe00640 1 -- 172.21.15.175:0/1618611561 shutdown_connections 2024-04-25T09:05:07.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551fe00640 1 -- 172.21.15.175:0/1618611561 wait complete. 2024-04-25T09:05:07.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551fe00640 1 Processor -- start 2024-04-25T09:05:07.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551fe00640 1 -- start start 2024-04-25T09:05:07.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55200d03b0 0x7f55200cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551fe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552015b930 0x7f552015e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5520152230 0x7f55200c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551fe00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55200cd4a0 con 0x7f5520152230 2024-04-25T09:05:07.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551fe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55200ccf80 con 0x7f55200d03b0 2024-04-25T09:05:07.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551fe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55200cd620 con 0x7f552015b930 2024-04-25T09:05:07.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5520152230 0x7f55200c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5520152230 0x7f55200c9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32944/0 (socket says 172.21.15.175:32944) 2024-04-25T09:05:07.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551f400640 1 -- 172.21.15.175:0/3273578431 learned_addr learned my addr 172.21.15.175:0/3273578431 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:07.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f551ea00640 1 --2- 172.21.15.175:0/3273578431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55200d03b0 0x7f55200cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.838+0000 7f5516000640 1 --2- 172.21.15.175:0/3273578431 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552015b930 0x7f552015e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.842+0000 7f551f400640 1 -- 172.21.15.175:0/3273578431 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552015b930 msgr2=0x7f552015e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.842+0000 7f551f400640 1 --2- 172.21.15.175:0/3273578431 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552015b930 0x7f552015e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.842+0000 7f551f400640 1 -- 172.21.15.175:0/3273578431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55200d03b0 msgr2=0x7f55200cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:07.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.842+0000 7f551f400640 1 --2- 172.21.15.175:0/3273578431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55200d03b0 0x7f55200cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:07.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.842+0000 7f551f400640 1 -- 172.21.15.175:0/3273578431 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55200ca800 con 0x7f5520152230 2024-04-25T09:05:07.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.842+0000 7f551f400640 1 --2- 172.21.15.175:0/3273578431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5520152230 0x7f55200c9980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f551801ce70 tx=0x7f5518019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:07.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.842+0000 7f5517400640 1 -- 172.21.15.175:0/3273578431 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55180b2050 con 0x7f5520152230 2024-04-25T09:05:07.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.842+0000 7f5517400640 1 -- 172.21.15.175:0/3273578431 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55180be070 con 0x7f5520152230 2024-04-25T09:05:07.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.842+0000 7f5517400640 1 -- 172.21.15.175:0/3273578431 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55180ada50 con 0x7f5520152230 2024-04-25T09:05:07.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.842+0000 7f551fe00640 1 -- 172.21.15.175:0/3273578431 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55200caae0 con 0x7f5520152230 2024-04-25T09:05:07.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.842+0000 7f551fe00640 1 -- 172.21.15.175:0/3273578431 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55200b4670 con 0x7f5520152230 2024-04-25T09:05:07.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.842+0000 7f551fe00640 1 -- 172.21.15.175:0/3273578431 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5520074a60 con 0x7f5520152230 2024-04-25T09:05:07.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.842+0000 7f5517400640 1 -- 172.21.15.175:0/3273578431 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f55180adbf0 con 0x7f5520152230 2024-04-25T09:05:07.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.842+0000 7f5517400640 1 --2- 172.21.15.175:0/3273578431 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f54fc066f90 0x7f54fc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:07.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.842+0000 7f5517400640 1 -- 172.21.15.175:0/3273578431 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f551811ff80 con 0x7f5520152230 2024-04-25T09:05:07.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.842+0000 7f551ea00640 1 --2- 172.21.15.175:0/3273578431 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f54fc066f90 0x7f54fc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:07.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.846+0000 7f551ea00640 1 --2- 172.21.15.175:0/3273578431 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f54fc066f90 0x7f54fc069450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5510007fd0 tx=0x7f5510009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:07.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:07.846+0000 7f5517400640 1 -- 172.21.15.175:0/3273578431 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5518016580 con 0x7f5520152230 2024-04-25T09:05:08.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.062+0000 7f551fe00640 1 -- 172.21.15.175:0/3273578431 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f55200b2f90 con 0x7f5520152230 2024-04-25T09:05:08.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.062+0000 7f5517400640 1 -- 172.21.15.175:0/3273578431 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1581 (secure 0 0 0) 0x7f55180f0af0 con 0x7f5520152230 2024-04-25T09:05:08.054 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:08.054 INFO:teuthology.orchestra.run.smithi175.stdout:{"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":83,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035836,"num_in_osds":8,"osd_in_since":1714035827,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225210368,"bytes_avail":772868902912,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5070}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-04-25T09:04:59.799604+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:05:08.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.062+0000 7f551fe00640 1 -- 172.21.15.175:0/3273578431 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f54fc066f90 msgr2=0x7f54fc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:08.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.062+0000 7f551fe00640 1 --2- 172.21.15.175:0/3273578431 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f54fc066f90 0x7f54fc069450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5510007fd0 tx=0x7f5510009040 comp rx=0 tx=0).stop 2024-04-25T09:05:08.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.062+0000 7f551fe00640 1 -- 172.21.15.175:0/3273578431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5520152230 msgr2=0x7f55200c9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:08.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.062+0000 7f551fe00640 1 --2- 172.21.15.175:0/3273578431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5520152230 0x7f55200c9980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f551801ce70 tx=0x7f5518019730 comp rx=0 tx=0).stop 2024-04-25T09:05:08.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.062+0000 7f551fe00640 1 -- 172.21.15.175:0/3273578431 shutdown_connections 2024-04-25T09:05:08.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.062+0000 7f551fe00640 1 --2- 172.21.15.175:0/3273578431 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f54fc066f90 0x7f54fc069450 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:08.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.062+0000 7f551fe00640 1 --2- 172.21.15.175:0/3273578431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5520152230 0x7f55200c9980 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:08.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.062+0000 7f551fe00640 1 --2- 172.21.15.175:0/3273578431 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f552015b930 0x7f552015e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:08.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.062+0000 7f551fe00640 1 --2- 172.21.15.175:0/3273578431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f55200d03b0 0x7f55200cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:08.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.062+0000 7f551fe00640 1 -- 172.21.15.175:0/3273578431 >> 172.21.15.175:0/3273578431 conn(0x7f55200b31b0 msgr2=0x7f5520153400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:08.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.062+0000 7f551fe00640 1 -- 172.21.15.175:0/3273578431 shutdown_connections 2024-04-25T09:05:08.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.062+0000 7f551fe00640 1 -- 172.21.15.175:0/3273578431 wait complete. 2024-04-25T09:05:08.075 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:05:08.075 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:05:08.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.218+0000 7fa00a400640 1 Processor -- start 2024-04-25T09:05:08.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.218+0000 7fa00a400640 1 -- start start 2024-04-25T09:05:08.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.218+0000 7fa00a400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa00415a900 0x7fa00406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:08.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.218+0000 7fa00a400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0040cda00 con 0x7fa0040cd520 2024-04-25T09:05:08.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.218+0000 7fa00a400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0040cdce0 con 0x7fa0040cf560 2024-04-25T09:05:08.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.218+0000 7fa00a400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00415bcf0 con 0x7fa00415a900 2024-04-25T09:05:08.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.218+0000 7fa002a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa0040cd520 0x7fa0040ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:57504/0 (socket says 172.21.15.175:57504) 2024-04-25T09:05:08.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.218+0000 7fa002a00640 1 -- 172.21.15.175:0/1922586508 learned_addr learned my addr 172.21.15.175:0/1922586508 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:08.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.218+0000 7fa002000640 1 -- 172.21.15.175:0/1922586508 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027681069 0 0) 0x7fa0040cda00 con 0x7fa0040cd520 2024-04-25T09:05:08.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.218+0000 7fa002000640 1 -- 172.21.15.175:0/1922586508 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fe8005740 con 0x7fa0040cd520 2024-04-25T09:05:08.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.218+0000 7fa003400640 1 --2- 172.21.15.175:0/1922586508 >> v2:172.21.15.177:3300/0 conn(0x7fa00415a900 0x7fa00406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:08.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.218+0000 7fa002000640 1 -- 172.21.15.175:0/1922586508 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3647292728 0 0) 0x7f9fe8005740 con 0x7fa0040cd520 2024-04-25T09:05:08.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa002000640 1 -- 172.21.15.175:0/1922586508 >> v2:172.21.15.177:3300/0 conn(0x7fa00415a900 msgr2=0x7fa00406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:08.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa002000640 1 --2- 172.21.15.175:0/1922586508 >> v2:172.21.15.177:3300/0 conn(0x7fa00415a900 0x7fa00406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:08.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa002000640 1 -- 172.21.15.175:0/1922586508 >> v1:172.21.15.177:6789/0 conn(0x7fa0040cf560 legacy=0x7fa00415bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:08.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa002000640 1 -- 172.21.15.175:0/1922586508 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0040cdfc0 con 0x7fa0040cd520 2024-04-25T09:05:08.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa002000640 1 -- 172.21.15.175:0/1922586508 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f9ff0001680 con 0x7fa0040cd520 2024-04-25T09:05:08.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa002000640 1 -- 172.21.15.175:0/1922586508 >> v1:172.21.15.175:6789/0 conn(0x7fa0040cd520 legacy=0x7fa0040ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:08.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa002000640 1 --2- 172.21.15.175:0/1922586508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fe8005c20 0x7f9fe8006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:08.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa002000640 1 --2- 172.21.15.175:0/1922586508 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9fe8006a20 0x7f9fe8006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:08.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa002000640 1 --2- 172.21.15.175:0/1922586508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fe8007430 0x7f9fe800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:08.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa002000640 1 -- 172.21.15.175:0/1922586508 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe800e350 con 0x7f9fe8007430 2024-04-25T09:05:08.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa002000640 1 -- 172.21.15.175:0/1922586508 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe800e500 con 0x7f9fe8005c20 2024-04-25T09:05:08.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa002000640 1 -- 172.21.15.175:0/1922586508 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe800e700 con 0x7f9fe8006a20 2024-04-25T09:05:08.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa003400640 1 --2- 172.21.15.175:0/1922586508 >> v2:172.21.15.177:3300/0 conn(0x7fa00415a900 0x7fa00406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:08.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa003e00640 1 --2- 172.21.15.175:0/1922586508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fe8007430 0x7f9fe800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:08.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa002a00640 1 --2- 172.21.15.175:0/1922586508 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9fe8006a20 0x7f9fe8006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:08.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa003400640 1 --2- 172.21.15.175:0/1922586508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fe8005c20 0x7f9fe8006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:08.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa003e00640 1 -- 172.21.15.175:0/1922586508 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9fe8006a20 msgr2=0x7f9fe8006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:08.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa003e00640 1 --2- 172.21.15.175:0/1922586508 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9fe8006a20 0x7f9fe8006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:08.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa003e00640 1 -- 172.21.15.175:0/1922586508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fe8005c20 msgr2=0x7f9fe8006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:08.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa003e00640 1 --2- 172.21.15.175:0/1922586508 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9fe8005c20 0x7f9fe8006040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:08.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa003e00640 1 -- 172.21.15.175:0/1922586508 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe8005740 con 0x7f9fe8007430 2024-04-25T09:05:08.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa003e00640 1 -- 172.21.15.175:0/1922586508 reap_dead start 2024-04-25T09:05:08.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa003e00640 1 --2- 172.21.15.175:0/1922586508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fe8007430 0x7f9fe800dbe0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc001e70 tx=0x7f9ffc01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ddd7dc15961b4e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:08.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa002000640 1 -- 172.21.15.175:0/1922586508 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc001a90 con 0x7f9fe8007430 2024-04-25T09:05:08.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa002000640 1 -- 172.21.15.175:0/1922586508 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ffc003980 con 0x7f9fe8007430 2024-04-25T09:05:08.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.222+0000 7fa002000640 1 -- 172.21.15.175:0/1922586508 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc003d70 con 0x7f9fe8007430 2024-04-25T09:05:08.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa00a400640 1 -- 172.21.15.175:0/1922586508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fe8007430 msgr2=0x7f9fe800dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:08.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa00a400640 1 --2- 172.21.15.175:0/1922586508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fe8007430 0x7f9fe800dbe0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc001e70 tx=0x7f9ffc01c780 comp rx=0 tx=0).stop 2024-04-25T09:05:08.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa00a400640 1 -- 172.21.15.175:0/1922586508 shutdown_connections 2024-04-25T09:05:08.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa00a400640 1 --2- 172.21.15.175:0/1922586508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9fe8007430 0x7f9fe800dbe0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:08.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa00a400640 1 -- 172.21.15.175:0/1922586508 >> 172.21.15.175:0/1922586508 conn(0x7fa004067150 msgr2=0x7fa00406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:08.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa00a400640 1 -- 172.21.15.175:0/1922586508 shutdown_connections 2024-04-25T09:05:08.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa00a400640 1 -- 172.21.15.175:0/1922586508 wait complete. 2024-04-25T09:05:08.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa00a400640 1 Processor -- start 2024-04-25T09:05:08.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa00a400640 1 -- start start 2024-04-25T09:05:08.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa00a400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0040aade0 0x7fa0040b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:08.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa00a400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0040b0cf0 0x7fa0040a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:08.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa00a400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0040ab1c0 0x7fa0040ab650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:08.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa00a400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00406d3b0 con 0x7fa0040b0cf0 2024-04-25T09:05:08.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa00a400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0040ce580 con 0x7fa0040aade0 2024-04-25T09:05:08.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa00a400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00406d530 con 0x7fa0040ab1c0 2024-04-25T09:05:08.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa002a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0040b0cf0 0x7fa0040a9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:08.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa002a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0040b0cf0 0x7fa0040a9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32962/0 (socket says 172.21.15.175:32962) 2024-04-25T09:05:08.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa002a00640 1 -- 172.21.15.175:0/626059984 learned_addr learned my addr 172.21.15.175:0/626059984 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:08.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa003400640 1 --2- 172.21.15.175:0/626059984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0040aade0 0x7fa0040b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:08.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa003e00640 1 --2- 172.21.15.175:0/626059984 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0040ab1c0 0x7fa0040ab650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:08.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa002a00640 1 -- 172.21.15.175:0/626059984 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0040ab1c0 msgr2=0x7fa0040ab650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:08.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa002a00640 1 --2- 172.21.15.175:0/626059984 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0040ab1c0 0x7fa0040ab650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:08.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa002a00640 1 -- 172.21.15.175:0/626059984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0040aade0 msgr2=0x7fa0040b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:08.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa002a00640 1 --2- 172.21.15.175:0/626059984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0040aade0 0x7fa0040b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:08.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa002a00640 1 -- 172.21.15.175:0/626059984 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0040b11f0 con 0x7fa0040b0cf0 2024-04-25T09:05:08.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.226+0000 7fa003400640 1 --2- 172.21.15.175:0/626059984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0040aade0 0x7fa0040b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:08.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.230+0000 7fa002a00640 1 --2- 172.21.15.175:0/626059984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0040b0cf0 0x7fa0040a9d40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000e5b0 tx=0x7f9ff000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:08.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.230+0000 7f9ffb400640 1 -- 172.21.15.175:0/626059984 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0012590 con 0x7fa0040b0cf0 2024-04-25T09:05:08.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.230+0000 7f9ffb400640 1 -- 172.21.15.175:0/626059984 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff0018070 con 0x7fa0040b0cf0 2024-04-25T09:05:08.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.230+0000 7fa00a400640 1 -- 172.21.15.175:0/626059984 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0040b14d0 con 0x7fa0040b0cf0 2024-04-25T09:05:08.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.230+0000 7f9ffb400640 1 -- 172.21.15.175:0/626059984 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0012970 con 0x7fa0040b0cf0 2024-04-25T09:05:08.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.230+0000 7fa00a400640 1 -- 172.21.15.175:0/626059984 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0040b1a90 con 0x7fa0040b0cf0 2024-04-25T09:05:08.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.230+0000 7fa00a400640 1 -- 172.21.15.175:0/626059984 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa004074a60 con 0x7fa0040b0cf0 2024-04-25T09:05:08.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.230+0000 7f9ffb400640 1 -- 172.21.15.175:0/626059984 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9ff0012b10 con 0x7fa0040b0cf0 2024-04-25T09:05:08.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.230+0000 7f9ffb400640 1 --2- 172.21.15.175:0/626059984 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9fe4066f90 0x7f9fe4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:08.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.230+0000 7f9ffb400640 1 -- 172.21.15.175:0/626059984 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ff0084980 con 0x7fa0040b0cf0 2024-04-25T09:05:08.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.230+0000 7fa003400640 1 --2- 172.21.15.175:0/626059984 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9fe4066f90 0x7f9fe4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:08.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.230+0000 7fa003400640 1 --2- 172.21.15.175:0/626059984 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9fe4066f90 0x7f9fe4069450 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa0040a8ea0 tx=0x7f9ff4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:08.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.234+0000 7f9ffb400640 1 -- 172.21.15.175:0/626059984 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9ff0022250 con 0x7fa0040b0cf0 2024-04-25T09:05:08.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.386+0000 7fa00a400640 1 -- 172.21.15.175:0/626059984 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa00415dcc0 con 0x7f9fe4066f90 2024-04-25T09:05:08.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.390+0000 7f9ffb400640 1 -- 172.21.15.175:0/626059984 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246635 (secure 0 0 0) 0x7fa00415dcc0 con 0x7f9fe4066f90 2024-04-25T09:05:08.387 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:08.389 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:05:08.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.394+0000 7fa00a400640 1 -- 172.21.15.175:0/626059984 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9fe4066f90 msgr2=0x7f9fe4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:08.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.394+0000 7fa00a400640 1 --2- 172.21.15.175:0/626059984 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9fe4066f90 0x7f9fe4069450 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa0040a8ea0 tx=0x7f9ff4008040 comp rx=0 tx=0).stop 2024-04-25T09:05:08.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.394+0000 7fa00a400640 1 -- 172.21.15.175:0/626059984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0040b0cf0 msgr2=0x7fa0040a9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:08.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.394+0000 7fa00a400640 1 --2- 172.21.15.175:0/626059984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0040b0cf0 0x7fa0040a9d40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000e5b0 tx=0x7f9ff000ea70 comp rx=0 tx=0).stop 2024-04-25T09:05:08.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.394+0000 7fa00a400640 1 -- 172.21.15.175:0/626059984 shutdown_connections 2024-04-25T09:05:08.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.394+0000 7fa00a400640 1 --2- 172.21.15.175:0/626059984 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9fe4066f90 0x7f9fe4069450 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:08.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.394+0000 7fa00a400640 1 --2- 172.21.15.175:0/626059984 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0040ab1c0 0x7fa0040ab650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:08.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.394+0000 7fa00a400640 1 --2- 172.21.15.175:0/626059984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa0040b0cf0 0x7fa0040a9d40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:08.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.394+0000 7fa00a400640 1 --2- 172.21.15.175:0/626059984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0040aade0 0x7fa0040b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:08.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.394+0000 7fa00a400640 1 -- 172.21.15.175:0/626059984 >> 172.21.15.175:0/626059984 conn(0x7f9fe8007430 msgr2=0x7fa00406dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:08.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.394+0000 7fa00a400640 1 -- 172.21.15.175:0/626059984 shutdown_connections 2024-04-25T09:05:08.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:08.394+0000 7fa00a400640 1 -- 172.21.15.175:0/626059984 wait complete. 2024-04-25T09:05:08.399 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:05:08.402 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:05:08.408 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-04-25T09:05:07.800754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219932,"kb_used_data":3772,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754788,"statfs":{"total":773094113280,"available":772868902912,"internally_reserved":0,"allocated":3862528,"data_stored":2194533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000941"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833032+0000","last_change":"2024-04-25T09:05:01.833032+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833032+0000","last_undegraded":"2024-04-25T09:05:01.833032+0000","last_fullsized":"2024-04-25T09:05:01.833032+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.845672+0000","last_change":"2024-04-25T09:05:01.845672+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.845672+0000","last_undegraded":"2024-04-25T09:05:01.845672+0000","last_fullsized":"2024-04-25T09:05:01.845672+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.838784+0000","last_change":"2024-04-25T09:05:01.838784+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.838784+0000","last_undegraded":"2024-04-25T09:05:01.838784+0000","last_fullsized":"2024-04-25T09:05:01.838784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.837977+0000","last_change":"2024-04-25T09:05:01.837977+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.837977+0000","last_undegraded":"2024-04-25T09:05:01.837977+0000","last_fullsized":"2024-04-25T09:05:01.837977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833379+0000","last_change":"2024-04-25T09:05:01.833379+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833379+0000","last_undegraded":"2024-04-25T09:05:01.833379+0000","last_fullsized":"2024-04-25T09:05:01.833379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.842224+0000","last_change":"2024-04-25T09:05:01.842224+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.842224+0000","last_undegraded":"2024-04-25T09:05:01.842224+0000","last_fullsized":"2024-04-25T09:05:01.842224+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.840686+0000","last_change":"2024-04-25T09:05:01.840686+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.840686+0000","last_undegraded":"2024-04-25T09:05:01.840686+0000","last_fullsized":"2024-04-25T09:05:01.840686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.851836+0000","last_change":"2024-04-25T09:05:01.851836+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.851836+0000","last_undegraded":"2024-04-25T09:05:01.851836+0000","last_fullsized":"2024-04-25T09:05:01.851836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833603+0000","last_change":"2024-04-25T09:05:01.833603+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833603+0000","last_undegraded":"2024-04-25T09:05:01.833603+0000","last_fullsized":"2024-04-25T09:05:01.833603+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.836810+0000","last_change":"2024-04-25T09:05:01.836810+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.836810+0000","last_undegraded":"2024-04-25T09:05:01.836810+0000","last_fullsized":"2024-04-25T09:05:01.836810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839339+0000","last_change":"2024-04-25T09:05:01.839339+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839339+0000","last_undegraded":"2024-04-25T09:05:01.839339+0000","last_fullsized":"2024-04-25T09:05:01.839339+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.841743+0000","last_change":"2024-04-25T09:05:01.841743+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.841743+0000","last_undegraded":"2024-04-25T09:05:01.841743+0000","last_fullsized":"2024-04-25T09:05:01.841743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832950+0000","last_change":"2024-04-25T09:05:01.832950+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832950+0000","last_undegraded":"2024-04-25T09:05:01.832950+0000","last_fullsized":"2024-04-25T09:05:01.832950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.841723+0000","last_change":"2024-04-25T09:05:01.841723+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.841723+0000","last_undegraded":"2024-04-25T09:05:01.841723+0000","last_fullsized":"2024-04-25T09:05:01.841723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839516+0000","last_change":"2024-04-25T09:05:01.839516+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839516+0000","last_undegraded":"2024-04-25T09:05:01.839516+0000","last_fullsized":"2024-04-25T09:05:01.839516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839997+0000","last_change":"2024-04-25T09:05:01.839997+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839997+0000","last_undegraded":"2024-04-25T09:05:01.839997+0000","last_fullsized":"2024-04-25T09:05:01.839997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.841319+0000","last_change":"2024-04-25T09:05:01.841319+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.841319+0000","last_undegraded":"2024-04-25T09:05:01.841319+0000","last_fullsized":"2024-04-25T09:05:01.841319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.845160+0000","last_change":"2024-04-25T09:05:01.845160+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.845160+0000","last_undegraded":"2024-04-25T09:05:01.845160+0000","last_fullsized":"2024-04-25T09:05:01.845160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833082+0000","last_change":"2024-04-25T09:05:01.833082+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833082+0000","last_undegraded":"2024-04-25T09:05:01.833082+0000","last_fullsized":"2024-04-25T09:05:01.833082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.834309+0000","last_change":"2024-04-25T09:05:01.834309+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.834309+0000","last_undegraded":"2024-04-25T09:05:01.834309+0000","last_fullsized":"2024-04-25T09:05:01.834309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.835652+0000","last_change":"2024-04-25T09:05:01.835652+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.835652+0000","last_undegraded":"2024-04-25T09:05:01.835652+0000","last_fullsized":"2024-04-25T09:05:01.835652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.834258+0000","last_change":"2024-04-25T09:05:01.834258+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.834258+0000","last_undegraded":"2024-04-25T09:05:01.834258+0000","last_fullsized":"2024-04-25T09:05:01.834258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833902+0000","last_change":"2024-04-25T09:05:01.833902+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833902+0000","last_undegraded":"2024-04-25T09:05:01.833902+0000","last_fullsized":"2024-04-25T09:05:01.833902+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.837758+0000","last_change":"2024-04-25T09:05:01.837758+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.837758+0000","last_undegraded":"2024-04-25T09:05:01.837758+0000","last_fullsized":"2024-04-25T09:05:01.837758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839814+0000","last_change":"2024-04-25T09:05:01.839814+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839814+0000","last_undegraded":"2024-04-25T09:05:01.839814+0000","last_fullsized":"2024-04-25T09:05:01.839814+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.844759+0000","last_change":"2024-04-25T09:05:01.844759+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.844759+0000","last_undegraded":"2024-04-25T09:05:01.844759+0000","last_fullsized":"2024-04-25T09:05:01.844759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.848547+0000","last_change":"2024-04-25T09:05:01.848547+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.848547+0000","last_undegraded":"2024-04-25T09:05:01.848547+0000","last_fullsized":"2024-04-25T09:05:01.848547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.838376+0000","last_change":"2024-04-25T09:05:01.838376+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.838376+0000","last_undegraded":"2024-04-25T09:05:01.838376+0000","last_fullsized":"2024-04-25T09:05:01.838376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.835174+0000","last_change":"2024-04-25T09:05:01.835174+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.835174+0000","last_undegraded":"2024-04-25T09:05:01.835174+0000","last_fullsized":"2024-04-25T09:05:01.835174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.840595+0000","last_change":"2024-04-25T09:05:01.840595+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.840595+0000","last_undegraded":"2024-04-25T09:05:01.840595+0000","last_fullsized":"2024-04-25T09:05:01.840595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833068+0000","last_change":"2024-04-25T09:05:01.833068+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833068+0000","last_undegraded":"2024-04-25T09:05:01.833068+0000","last_fullsized":"2024-04-25T09:05:01.833068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.851467+0000","last_change":"2024-04-25T09:05:01.851467+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.851467+0000","last_undegraded":"2024-04-25T09:05:01.851467+0000","last_fullsized":"2024-04-25T09:05:01.851467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833477+0000","last_change":"2024-04-25T09:05:01.833477+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833477+0000","last_undegraded":"2024-04-25T09:05:01.833477+0000","last_fullsized":"2024-04-25T09:05:01.833477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.862365+0000","last_change":"2024-04-25T09:05:01.859475+0000","last_active":"2024-04-25T09:05:01.862365+0000","last_peered":"2024-04-25T09:05:01.862365+0000","last_clean":"2024-04-25T09:05:01.862365+0000","last_became_active":"2024-04-25T09:05:01.859205+0000","last_became_peered":"2024-04-25T09:05:01.859205+0000","last_unstale":"2024-04-25T09:05:01.862365+0000","last_undegraded":"2024-04-25T09:05:01.862365+0000","last_fullsized":"2024-04-25T09:05:01.862365+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:54.535074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832441+0000","last_change":"2024-04-25T09:05:01.832441+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832441+0000","last_undegraded":"2024-04-25T09:05:01.832441+0000","last_fullsized":"2024-04-25T09:05:01.832441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.852329+0000","last_change":"2024-04-25T09:05:01.851020+0000","last_active":"2024-04-25T09:05:01.852329+0000","last_peered":"2024-04-25T09:05:01.852329+0000","last_clean":"2024-04-25T09:05:01.852329+0000","last_became_active":"2024-04-25T09:05:01.850367+0000","last_became_peered":"2024-04-25T09:05:01.850367+0000","last_unstale":"2024-04-25T09:05:01.852329+0000","last_undegraded":"2024-04-25T09:05:01.852329+0000","last_fullsized":"2024-04-25T09:05:01.852329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:54.535074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833820+0000","last_change":"2024-04-25T09:05:01.833820+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833820+0000","last_undegraded":"2024-04-25T09:05:01.833820+0000","last_fullsized":"2024-04-25T09:05:01.833820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.857147+0000","last_change":"2024-04-25T09:05:01.855321+0000","last_active":"2024-04-25T09:05:01.857147+0000","last_peered":"2024-04-25T09:05:01.857147+0000","last_clean":"2024-04-25T09:05:01.857147+0000","last_became_active":"2024-04-25T09:05:01.854980+0000","last_became_peered":"2024-04-25T09:05:01.854980+0000","last_unstale":"2024-04-25T09:05:01.857147+0000","last_undegraded":"2024-04-25T09:05:01.857147+0000","last_fullsized":"2024-04-25T09:05:01.857147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:01.847172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.848097+0000","last_change":"2024-04-25T09:05:01.848097+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.848097+0000","last_undegraded":"2024-04-25T09:05:01.848097+0000","last_fullsized":"2024-04-25T09:05:01.848097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.857066+0000","last_change":"2024-04-25T09:05:01.855383+0000","last_active":"2024-04-25T09:05:01.857066+0000","last_peered":"2024-04-25T09:05:01.857066+0000","last_clean":"2024-04-25T09:05:01.857066+0000","last_became_active":"2024-04-25T09:05:01.855114+0000","last_became_peered":"2024-04-25T09:05:01.855114+0000","last_unstale":"2024-04-25T09:05:01.857066+0000","last_undegraded":"2024-04-25T09:05:01.857066+0000","last_fullsized":"2024-04-25T09:05:01.857066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:30.365760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839360+0000","last_change":"2024-04-25T09:05:01.839360+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839360+0000","last_undegraded":"2024-04-25T09:05:01.839360+0000","last_fullsized":"2024-04-25T09:05:01.839360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.853680+0000","last_change":"2024-04-25T09:05:01.850620+0000","last_active":"2024-04-25T09:05:01.853680+0000","last_peered":"2024-04-25T09:05:01.853680+0000","last_clean":"2024-04-25T09:05:01.853680+0000","last_became_active":"2024-04-25T09:05:01.850289+0000","last_became_peered":"2024-04-25T09:05:01.850289+0000","last_unstale":"2024-04-25T09:05:01.853680+0000","last_undegraded":"2024-04-25T09:05:01.853680+0000","last_fullsized":"2024-04-25T09:05:01.853680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:07.320232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.847081+0000","last_change":"2024-04-25T09:05:01.847081+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.847081+0000","last_undegraded":"2024-04-25T09:05:01.847081+0000","last_fullsized":"2024-04-25T09:05:01.847081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.856102+0000","last_change":"2024-04-25T09:05:01.853233+0000","last_active":"2024-04-25T09:05:01.856102+0000","last_peered":"2024-04-25T09:05:01.856102+0000","last_clean":"2024-04-25T09:05:01.856102+0000","last_became_active":"2024-04-25T09:05:01.852944+0000","last_became_peered":"2024-04-25T09:05:01.852944+0000","last_unstale":"2024-04-25T09:05:01.856102+0000","last_undegraded":"2024-04-25T09:05:01.856102+0000","last_fullsized":"2024-04-25T09:05:01.856102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:21.522852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833667+0000","last_change":"2024-04-25T09:05:01.833667+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833667+0000","last_undegraded":"2024-04-25T09:05:01.833667+0000","last_fullsized":"2024-04-25T09:05:01.833667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.846208+0000","last_change":"2024-04-25T09:05:01.842765+0000","last_active":"2024-04-25T09:05:01.846208+0000","last_peered":"2024-04-25T09:05:01.846208+0000","last_clean":"2024-04-25T09:05:01.846208+0000","last_became_active":"2024-04-25T09:05:01.842535+0000","last_became_peered":"2024-04-25T09:05:01.842535+0000","last_unstale":"2024-04-25T09:05:01.846208+0000","last_undegraded":"2024-04-25T09:05:01.846208+0000","last_fullsized":"2024-04-25T09:05:01.846208+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:07.078383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.836163+0000","last_change":"2024-04-25T09:05:01.836163+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.836163+0000","last_undegraded":"2024-04-25T09:05:01.836163+0000","last_fullsized":"2024-04-25T09:05:01.836163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.848730+0000","last_change":"2024-04-25T09:05:01.844077+0000","last_active":"2024-04-25T09:05:01.848730+0000","last_peered":"2024-04-25T09:05:01.848730+0000","last_clean":"2024-04-25T09:05:01.848730+0000","last_became_active":"2024-04-25T09:05:01.843762+0000","last_became_peered":"2024-04-25T09:05:01.843762+0000","last_unstale":"2024-04-25T09:05:01.848730+0000","last_undegraded":"2024-04-25T09:05:01.848730+0000","last_fullsized":"2024-04-25T09:05:01.848730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:47.729359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.838868+0000","last_change":"2024-04-25T09:05:01.838868+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.838868+0000","last_undegraded":"2024-04-25T09:05:01.838868+0000","last_fullsized":"2024-04-25T09:05:01.838868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.860357+0000","last_change":"2024-04-25T09:05:01.858030+0000","last_active":"2024-04-25T09:05:01.860357+0000","last_peered":"2024-04-25T09:05:01.860357+0000","last_clean":"2024-04-25T09:05:01.860357+0000","last_became_active":"2024-04-25T09:05:01.857784+0000","last_became_peered":"2024-04-25T09:05:01.857784+0000","last_unstale":"2024-04-25T09:05:01.860357+0000","last_undegraded":"2024-04-25T09:05:01.860357+0000","last_fullsized":"2024-04-25T09:05:01.860357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:37.505024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.844325+0000","last_change":"2024-04-25T09:05:01.844325+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.844325+0000","last_undegraded":"2024-04-25T09:05:01.844325+0000","last_fullsized":"2024-04-25T09:05:01.844325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.852437+0000","last_change":"2024-04-25T09:05:01.851249+0000","last_active":"2024-04-25T09:05:01.852437+0000","last_peered":"2024-04-25T09:05:01.852437+0000","last_clean":"2024-04-25T09:05:01.852437+0000","last_became_active":"2024-04-25T09:05:01.850775+0000","last_became_peered":"2024-04-25T09:05:01.850775+0000","last_unstale":"2024-04-25T09:05:01.852437+0000","last_undegraded":"2024-04-25T09:05:01.852437+0000","last_fullsized":"2024-04-25T09:05:01.852437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:55.907137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.835093+0000","last_change":"2024-04-25T09:05:01.835093+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.835093+0000","last_undegraded":"2024-04-25T09:05:01.835093+0000","last_fullsized":"2024-04-25T09:05:01.835093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.862229+0000","last_change":"2024-04-25T09:05:01.860048+0000","last_active":"2024-04-25T09:05:01.862229+0000","last_peered":"2024-04-25T09:05:01.862229+0000","last_clean":"2024-04-25T09:05:01.862229+0000","last_became_active":"2024-04-25T09:05:01.859751+0000","last_became_peered":"2024-04-25T09:05:01.859751+0000","last_unstale":"2024-04-25T09:05:01.862229+0000","last_undegraded":"2024-04-25T09:05:01.862229+0000","last_fullsized":"2024-04-25T09:05:01.862229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:50.944782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.848015+0000","last_change":"2024-04-25T09:05:01.848015+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.848015+0000","last_undegraded":"2024-04-25T09:05:01.848015+0000","last_fullsized":"2024-04-25T09:05:01.848015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.855982+0000","last_change":"2024-04-25T09:05:01.853200+0000","last_active":"2024-04-25T09:05:01.855982+0000","last_peered":"2024-04-25T09:05:01.855982+0000","last_clean":"2024-04-25T09:05:01.855982+0000","last_became_active":"2024-04-25T09:05:01.851932+0000","last_became_peered":"2024-04-25T09:05:01.851932+0000","last_unstale":"2024-04-25T09:05:01.855982+0000","last_undegraded":"2024-04-25T09:05:01.855982+0000","last_fullsized":"2024-04-25T09:05:01.855982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:10.494318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.839776+0000","last_change":"2024-04-25T09:05:01.839776+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.839776+0000","last_undegraded":"2024-04-25T09:05:01.839776+0000","last_fullsized":"2024-04-25T09:05:01.839776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.848760+0000","last_change":"2024-04-25T09:05:01.844545+0000","last_active":"2024-04-25T09:05:01.848760+0000","last_peered":"2024-04-25T09:05:01.848760+0000","last_clean":"2024-04-25T09:05:01.848760+0000","last_became_active":"2024-04-25T09:05:01.843748+0000","last_became_peered":"2024-04-25T09:05:01.843748+0000","last_unstale":"2024-04-25T09:05:01.848760+0000","last_undegraded":"2024-04-25T09:05:01.848760+0000","last_fullsized":"2024-04-25T09:05:01.848760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:32.762758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832733+0000","last_change":"2024-04-25T09:05:01.832733+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832733+0000","last_undegraded":"2024-04-25T09:05:01.832733+0000","last_fullsized":"2024-04-25T09:05:01.832733+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.856328+0000","last_change":"2024-04-25T09:05:01.853811+0000","last_active":"2024-04-25T09:05:01.856328+0000","last_peered":"2024-04-25T09:05:01.856328+0000","last_clean":"2024-04-25T09:05:01.856328+0000","last_became_active":"2024-04-25T09:05:01.853511+0000","last_became_peered":"2024-04-25T09:05:01.853511+0000","last_unstale":"2024-04-25T09:05:01.856328+0000","last_undegraded":"2024-04-25T09:05:01.856328+0000","last_fullsized":"2024-04-25T09:05:01.856328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:52.353215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.851022+0000","last_change":"2024-04-25T09:05:01.851022+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.851022+0000","last_undegraded":"2024-04-25T09:05:01.851022+0000","last_fullsized":"2024-04-25T09:05:01.851022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.853525+0000","last_change":"2024-04-25T09:05:01.849597+0000","last_active":"2024-04-25T09:05:01.853525+0000","last_peered":"2024-04-25T09:05:01.853525+0000","last_clean":"2024-04-25T09:05:01.853525+0000","last_became_active":"2024-04-25T09:05:01.849343+0000","last_became_peered":"2024-04-25T09:05:01.849343+0000","last_unstale":"2024-04-25T09:05:01.853525+0000","last_undegraded":"2024-04-25T09:05:01.853525+0000","last_fullsized":"2024-04-25T09:05:01.853525+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:23.553154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832450+0000","last_change":"2024-04-25T09:05:01.832450+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832450+0000","last_undegraded":"2024-04-25T09:05:01.832450+0000","last_fullsized":"2024-04-25T09:05:01.832450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.847526+0000","last_change":"2024-04-25T09:05:01.845805+0000","last_active":"2024-04-25T09:05:01.847526+0000","last_peered":"2024-04-25T09:05:01.847526+0000","last_clean":"2024-04-25T09:05:01.847526+0000","last_became_active":"2024-04-25T09:05:01.845373+0000","last_became_peered":"2024-04-25T09:05:01.845373+0000","last_unstale":"2024-04-25T09:05:01.847526+0000","last_undegraded":"2024-04-25T09:05:01.847526+0000","last_fullsized":"2024-04-25T09:05:01.847526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:15.508830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.835237+0000","last_change":"2024-04-25T09:05:01.835237+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.835237+0000","last_undegraded":"2024-04-25T09:05:01.835237+0000","last_fullsized":"2024-04-25T09:05:01.835237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.855778+0000","last_change":"2024-04-25T09:05:01.853103+0000","last_active":"2024-04-25T09:05:01.855778+0000","last_peered":"2024-04-25T09:05:01.855778+0000","last_clean":"2024-04-25T09:05:01.855778+0000","last_became_active":"2024-04-25T09:05:01.852683+0000","last_became_peered":"2024-04-25T09:05:01.852683+0000","last_unstale":"2024-04-25T09:05:01.855778+0000","last_undegraded":"2024-04-25T09:05:01.855778+0000","last_fullsized":"2024-04-25T09:05:01.855778+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:22.640219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.845105+0000","last_change":"2024-04-25T09:05:01.845105+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.845105+0000","last_undegraded":"2024-04-25T09:05:01.845105+0000","last_fullsized":"2024-04-25T09:05:01.845105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.851325+0000","last_change":"2024-04-25T09:05:01.846615+0000","last_active":"2024-04-25T09:05:01.851325+0000","last_peered":"2024-04-25T09:05:01.851325+0000","last_clean":"2024-04-25T09:05:01.851325+0000","last_became_active":"2024-04-25T09:05:01.846321+0000","last_became_peered":"2024-04-25T09:05:01.846321+0000","last_unstale":"2024-04-25T09:05:01.851325+0000","last_undegraded":"2024-04-25T09:05:01.851325+0000","last_fullsized":"2024-04-25T09:05:01.851325+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:30.103785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.837557+0000","last_change":"2024-04-25T09:05:01.837557+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.837557+0000","last_undegraded":"2024-04-25T09:05:01.837557+0000","last_fullsized":"2024-04-25T09:05:01.837557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.851132+0000","last_change":"2024-04-25T09:05:01.845678+0000","last_active":"2024-04-25T09:05:01.851132+0000","last_peered":"2024-04-25T09:05:01.851132+0000","last_clean":"2024-04-25T09:05:01.851132+0000","last_became_active":"2024-04-25T09:05:01.845394+0000","last_became_peered":"2024-04-25T09:05:01.845394+0000","last_unstale":"2024-04-25T09:05:01.851132+0000","last_undegraded":"2024-04-25T09:05:01.851132+0000","last_fullsized":"2024-04-25T09:05:01.851132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:30.365760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832917+0000","last_change":"2024-04-25T09:05:01.832917+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832917+0000","last_undegraded":"2024-04-25T09:05:01.832917+0000","last_fullsized":"2024-04-25T09:05:01.832917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.855987+0000","last_change":"2024-04-25T09:05:01.850960+0000","last_active":"2024-04-25T09:05:01.855987+0000","last_peered":"2024-04-25T09:05:01.855987+0000","last_clean":"2024-04-25T09:05:01.855987+0000","last_became_active":"2024-04-25T09:05:01.850670+0000","last_became_peered":"2024-04-25T09:05:01.850670+0000","last_unstale":"2024-04-25T09:05:01.855987+0000","last_undegraded":"2024-04-25T09:05:01.855987+0000","last_fullsized":"2024-04-25T09:05:01.855987+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:59.624866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832469+0000","last_change":"2024-04-25T09:05:01.832469+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832469+0000","last_undegraded":"2024-04-25T09:05:01.832469+0000","last_fullsized":"2024-04-25T09:05:01.832469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.843938+0000","last_change":"2024-04-25T09:05:01.841773+0000","last_active":"2024-04-25T09:05:01.843938+0000","last_peered":"2024-04-25T09:05:01.843938+0000","last_clean":"2024-04-25T09:05:01.843938+0000","last_became_active":"2024-04-25T09:05:01.841485+0000","last_became_peered":"2024-04-25T09:05:01.841485+0000","last_unstale":"2024-04-25T09:05:01.843938+0000","last_undegraded":"2024-04-25T09:05:01.843938+0000","last_fullsized":"2024-04-25T09:05:01.843938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:40.689654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832490+0000","last_change":"2024-04-25T09:05:01.832490+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832490+0000","last_undegraded":"2024-04-25T09:05:01.832490+0000","last_fullsized":"2024-04-25T09:05:01.832490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.861723+0000","last_change":"2024-04-25T09:05:01.856230+0000","last_active":"2024-04-25T09:05:01.861723+0000","last_peered":"2024-04-25T09:05:01.861723+0000","last_clean":"2024-04-25T09:05:01.861723+0000","last_became_active":"2024-04-25T09:05:01.855929+0000","last_became_peered":"2024-04-25T09:05:01.855929+0000","last_unstale":"2024-04-25T09:05:01.861723+0000","last_undegraded":"2024-04-25T09:05:01.861723+0000","last_fullsized":"2024-04-25T09:05:01.861723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:45.459385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832449+0000","last_change":"2024-04-25T09:05:01.832449+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832449+0000","last_undegraded":"2024-04-25T09:05:01.832449+0000","last_fullsized":"2024-04-25T09:05:01.832449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.845948+0000","last_change":"2024-04-25T09:05:01.842494+0000","last_active":"2024-04-25T09:05:01.845948+0000","last_peered":"2024-04-25T09:05:01.845948+0000","last_clean":"2024-04-25T09:05:01.845948+0000","last_became_active":"2024-04-25T09:05:01.842187+0000","last_became_peered":"2024-04-25T09:05:01.842187+0000","last_unstale":"2024-04-25T09:05:01.845948+0000","last_undegraded":"2024-04-25T09:05:01.845948+0000","last_fullsized":"2024-04-25T09:05:01.845948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:29.852470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.840941+0000","last_change":"2024-04-25T09:05:01.840941+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.840941+0000","last_undegraded":"2024-04-25T09:05:01.840941+0000","last_fullsized":"2024-04-25T09:05:01.840941+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.859059+0000","last_change":"2024-04-25T09:05:01.853085+0000","last_active":"2024-04-25T09:05:01.859059+0000","last_peered":"2024-04-25T09:05:01.859059+0000","last_clean":"2024-04-25T09:05:01.859059+0000","last_became_active":"2024-04-25T09:05:01.852672+0000","last_became_peered":"2024-04-25T09:05:01.852672+0000","last_unstale":"2024-04-25T09:05:01.859059+0000","last_undegraded":"2024-04-25T09:05:01.859059+0000","last_fullsized":"2024-04-25T09:05:01.859059+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:28.059026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.833669+0000","last_change":"2024-04-25T09:05:01.833669+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.833669+0000","last_undegraded":"2024-04-25T09:05:01.833669+0000","last_fullsized":"2024-04-25T09:05:01.833669+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.862078+0000","last_change":"2024-04-25T09:05:01.859966+0000","last_active":"2024-04-25T09:05:01.862078+0000","last_peered":"2024-04-25T09:05:01.862078+0000","last_clean":"2024-04-25T09:05:01.862078+0000","last_became_active":"2024-04-25T09:05:01.859591+0000","last_became_peered":"2024-04-25T09:05:01.859591+0000","last_unstale":"2024-04-25T09:05:01.862078+0000","last_undegraded":"2024-04-25T09:05:01.862078+0000","last_fullsized":"2024-04-25T09:05:01.862078+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:48.677980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.844758+0000","last_change":"2024-04-25T09:05:01.844758+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.844758+0000","last_undegraded":"2024-04-25T09:05:01.844758+0000","last_fullsized":"2024-04-25T09:05:01.844758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.843735+0000","last_change":"2024-04-25T09:05:01.841767+0000","last_active":"2024-04-25T09:05:01.843735+0000","last_peered":"2024-04-25T09:05:01.843735+0000","last_clean":"2024-04-25T09:05:01.843735+0000","last_became_active":"2024-04-25T09:05:01.841486+0000","last_became_peered":"2024-04-25T09:05:01.841486+0000","last_unstale":"2024-04-25T09:05:01.843735+0000","last_undegraded":"2024-04-25T09:05:01.843735+0000","last_fullsized":"2024-04-25T09:05:01.843735+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:45.459385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832615+0000","last_change":"2024-04-25T09:05:01.832615+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832615+0000","last_undegraded":"2024-04-25T09:05:01.832615+0000","last_fullsized":"2024-04-25T09:05:01.832615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.855328+0000","last_change":"2024-04-25T09:05:01.853095+0000","last_active":"2024-04-25T09:05:01.855328+0000","last_peered":"2024-04-25T09:05:01.855328+0000","last_clean":"2024-04-25T09:05:01.855328+0000","last_became_active":"2024-04-25T09:05:01.852739+0000","last_became_peered":"2024-04-25T09:05:01.852739+0000","last_unstale":"2024-04-25T09:05:01.855328+0000","last_undegraded":"2024-04-25T09:05:01.855328+0000","last_fullsized":"2024-04-25T09:05:01.855328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:55.907137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.834556+0000","last_change":"2024-04-25T09:05:01.834556+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.834556+0000","last_undegraded":"2024-04-25T09:05:01.834556+0000","last_fullsized":"2024-04-25T09:05:01.834556+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.860191+0000","last_change":"2024-04-25T09:05:01.858937+0000","last_active":"2024-04-25T09:05:01.860191+0000","last_peered":"2024-04-25T09:05:01.860191+0000","last_clean":"2024-04-25T09:05:01.860191+0000","last_became_active":"2024-04-25T09:05:01.858636+0000","last_became_peered":"2024-04-25T09:05:01.858636+0000","last_unstale":"2024-04-25T09:05:01.860191+0000","last_undegraded":"2024-04-25T09:05:01.860191+0000","last_fullsized":"2024-04-25T09:05:01.860191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:22.640219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.832222+0000","last_change":"2024-04-25T09:05:01.832222+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.832222+0000","last_undegraded":"2024-04-25T09:05:01.832222+0000","last_fullsized":"2024-04-25T09:05:01.832222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.862061+0000","last_change":"2024-04-25T09:05:01.859845+0000","last_active":"2024-04-25T09:05:01.862061+0000","last_peered":"2024-04-25T09:05:01.862061+0000","last_clean":"2024-04-25T09:05:01.862061+0000","last_became_active":"2024-04-25T09:05:01.859553+0000","last_became_peered":"2024-04-25T09:05:01.859553+0000","last_unstale":"2024-04-25T09:05:01.862061+0000","last_undegraded":"2024-04-25T09:05:01.862061+0000","last_fullsized":"2024-04-25T09:05:01.862061+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:03.855826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.838757+0000","last_change":"2024-04-25T09:05:01.838757+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.838757+0000","last_undegraded":"2024-04-25T09:05:01.838757+0000","last_fullsized":"2024-04-25T09:05:01.838757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.861795+0000","last_change":"2024-04-25T09:05:01.860397+0000","last_active":"2024-04-25T09:05:01.861795+0000","last_peered":"2024-04-25T09:05:01.861795+0000","last_clean":"2024-04-25T09:05:01.861795+0000","last_became_active":"2024-04-25T09:05:01.859885+0000","last_became_peered":"2024-04-25T09:05:01.859885+0000","last_unstale":"2024-04-25T09:05:01.861795+0000","last_undegraded":"2024-04-25T09:05:01.861795+0000","last_fullsized":"2024-04-25T09:05:01.861795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:38:51.382457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.834694+0000","last_change":"2024-04-25T09:05:01.834694+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.834694+0000","last_undegraded":"2024-04-25T09:05:01.834694+0000","last_fullsized":"2024-04-25T09:05:01.834694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.857124+0000","last_change":"2024-04-25T09:05:01.854637+0000","last_active":"2024-04-25T09:05:01.857124+0000","last_peered":"2024-04-25T09:05:01.857124+0000","last_clean":"2024-04-25T09:05:01.857124+0000","last_became_active":"2024-04-25T09:05:01.854045+0000","last_became_peered":"2024-04-25T09:05:01.854045+0000","last_unstale":"2024-04-25T09:05:01.857124+0000","last_undegraded":"2024-04-25T09:05:01.857124+0000","last_fullsized":"2024-04-25T09:05:01.857124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:12.759868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-04-25T09:05:01.842018+0000","last_change":"2024-04-25T09:05:01.842018+0000","last_active":"2024-04-25T09:05:01.819932+0000","last_peered":"2024-04-25T09:05:01.819932+0000","last_clean":"2024-04-25T09:05:01.819932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:05:01.842018+0000","last_undegraded":"2024-04-25T09:05:01.842018+0000","last_fullsized":"2024-04-25T09:05:01.842018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.848920+0000","last_change":"2024-04-25T09:05:01.844352+0000","last_active":"2024-04-25T09:05:01.848920+0000","last_peered":"2024-04-25T09:05:01.848920+0000","last_clean":"2024-04-25T09:05:01.848920+0000","last_became_active":"2024-04-25T09:05:01.843530+0000","last_became_peered":"2024-04-25T09:05:01.843530+0000","last_unstale":"2024-04-25T09:05:01.848920+0000","last_undegraded":"2024-04-25T09:05:01.848920+0000","last_fullsized":"2024-04-25T09:05:01.848920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:40.689654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-25T09:05:01.852056+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:05:01.852056+0000","last_peered":"2024-04-25T09:05:01.852056+0000","last_clean":"2024-04-25T09:05:01.852056+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:05:01.852056+0000","last_undegraded":"2024-04-25T09:05:01.852056+0000","last_fullsized":"2024-04-25T09:05:01.852056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":711609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":929792,"data_stored":717876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:05:11.413 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:05:11.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.566+0000 7f4016000640 1 Processor -- start 2024-04-25T09:05:11.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.566+0000 7f4016000640 1 -- start start 2024-04-25T09:05:11.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f4016000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40100cd520 0x7f401006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f4016000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40100cda00 con 0x7f401015a900 2024-04-25T09:05:11.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f4016000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40100cdce0 con 0x7f40100cf560 2024-04-25T09:05:11.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f4016000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401015bcf0 con 0x7f40100cd520 2024-04-25T09:05:11.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400f400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f401015a900 0x7f40100ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53062/0 (socket says 172.21.15.175:53062) 2024-04-25T09:05:11.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400f400640 1 -- 172.21.15.175:0/3729714941 learned_addr learned my addr 172.21.15.175:0/3729714941 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:11.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400ea00640 1 --2- 172.21.15.175:0/3729714941 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40100cd520 0x7f401006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400e000640 1 -- 172.21.15.175:0/3729714941 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425063535 0 0) 0x7f40100cda00 con 0x7f401015a900 2024-04-25T09:05:11.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400e000640 1 -- 172.21.15.175:0/3729714941 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ff4005740 con 0x7f401015a900 2024-04-25T09:05:11.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400e000640 1 -- 172.21.15.175:0/3729714941 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065475906 0 0) 0x7f40100cdce0 con 0x7f40100cf560 2024-04-25T09:05:11.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400e000640 1 -- 172.21.15.175:0/3729714941 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40100cda00 con 0x7f40100cf560 2024-04-25T09:05:11.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400e000640 1 -- 172.21.15.175:0/3729714941 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2040929533 0 0) 0x7f3ff4005740 con 0x7f401015a900 2024-04-25T09:05:11.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400e000640 1 -- 172.21.15.175:0/3729714941 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40100cd520 msgr2=0x7f401006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:11.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400e000640 1 --2- 172.21.15.175:0/3729714941 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40100cd520 0x7f401006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400e000640 1 -- 172.21.15.175:0/3729714941 >> v1:172.21.15.177:6789/0 conn(0x7f40100cf560 legacy=0x7f401015bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400e000640 1 -- 172.21.15.175:0/3729714941 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40100cdfc0 con 0x7f401015a900 2024-04-25T09:05:11.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400e000640 1 -- 172.21.15.175:0/3729714941 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f4000001680 con 0x7f401015a900 2024-04-25T09:05:11.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400ea00640 1 --2- 172.21.15.175:0/3729714941 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40100cd520 0x7f401006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:11.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400e000640 1 -- 172.21.15.175:0/3729714941 >> v1:172.21.15.175:6789/0 conn(0x7f401015a900 legacy=0x7f40100ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400e000640 1 --2- 172.21.15.175:0/3729714941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ff4005d90 0x7f3ff4006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400e000640 1 --2- 172.21.15.175:0/3729714941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ff4006a20 0x7f3ff4006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400e000640 1 --2- 172.21.15.175:0/3729714941 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40100cd520 0x7f3ff40073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400e000640 1 -- 172.21.15.175:0/3729714941 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff400dc90 con 0x7f3ff4006a20 2024-04-25T09:05:11.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400e000640 1 -- 172.21.15.175:0/3729714941 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff400de10 con 0x7f3ff4005d90 2024-04-25T09:05:11.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400e000640 1 -- 172.21.15.175:0/3729714941 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff400e010 con 0x7f40100cd520 2024-04-25T09:05:11.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400ea00640 1 --2- 172.21.15.175:0/3729714941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ff4006a20 0x7f3ff4006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400f400640 1 --2- 172.21.15.175:0/3729714941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ff4005d90 0x7f3ff4006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400fe00640 1 --2- 172.21.15.175:0/3729714941 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40100cd520 0x7f3ff40073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400ea00640 1 -- 172.21.15.175:0/3729714941 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40100cd520 msgr2=0x7f3ff40073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:11.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400ea00640 1 --2- 172.21.15.175:0/3729714941 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40100cd520 0x7f3ff40073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400ea00640 1 -- 172.21.15.175:0/3729714941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ff4005d90 msgr2=0x7f3ff4006190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:11.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400ea00640 1 --2- 172.21.15.175:0/3729714941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ff4005d90 0x7f3ff4006190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400ea00640 1 -- 172.21.15.175:0/3729714941 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff4005740 con 0x7f3ff4006a20 2024-04-25T09:05:11.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.570+0000 7f400fe00640 1 --2- 172.21.15.175:0/3729714941 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40100cd520 0x7f3ff40073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:11.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.574+0000 7f400ea00640 1 --2- 172.21.15.175:0/3729714941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ff4006a20 0x7f3ff4006ea0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc009c80 tx=0x7f3ffc01cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f4da384c74674c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:11.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.574+0000 7f400e000640 1 -- 172.21.15.175:0/3729714941 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc0b2070 con 0x7f3ff4006a20 2024-04-25T09:05:11.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.574+0000 7f400e000640 1 -- 172.21.15.175:0/3729714941 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ffc0a5760 con 0x7f3ff4006a20 2024-04-25T09:05:11.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.574+0000 7f400e000640 1 -- 172.21.15.175:0/3729714941 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc009880 con 0x7f3ff4006a20 2024-04-25T09:05:11.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.574+0000 7f4016000640 1 -- 172.21.15.175:0/3729714941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ff4006a20 msgr2=0x7f3ff4006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.574+0000 7f4016000640 1 --2- 172.21.15.175:0/3729714941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ff4006a20 0x7f3ff4006ea0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc009c80 tx=0x7f3ffc01cbb0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.574+0000 7f400fe00640 1 -- 172.21.15.175:0/3729714941 reap_dead start 2024-04-25T09:05:11.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.574+0000 7f4016000640 1 -- 172.21.15.175:0/3729714941 shutdown_connections 2024-04-25T09:05:11.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.574+0000 7f4016000640 1 -- 172.21.15.175:0/3729714941 >> 172.21.15.175:0/3729714941 conn(0x7f4010067150 msgr2=0x7f401006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:11.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.574+0000 7f4016000640 1 -- 172.21.15.175:0/3729714941 shutdown_connections 2024-04-25T09:05:11.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.574+0000 7f4016000640 1 -- 172.21.15.175:0/3729714941 wait complete. 2024-04-25T09:05:11.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.574+0000 7f4016000640 1 Processor -- start 2024-04-25T09:05:11.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.574+0000 7f4016000640 1 -- start start 2024-04-25T09:05:11.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f4016000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f401014e360 0x7f401014b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f4016000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f401014e740 0x7f40100af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f4016000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40100cf970 0x7f40100cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f4016000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401006d3b0 con 0x7f401014e740 2024-04-25T09:05:11.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f4016000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40100ce580 con 0x7f401014e360 2024-04-25T09:05:11.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f4016000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401006d530 con 0x7f40100cf970 2024-04-25T09:05:11.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f400ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f401014e740 0x7f40100af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f400ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f401014e740 0x7f40100af100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43534/0 (socket says 172.21.15.175:43534) 2024-04-25T09:05:11.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f400ea00640 1 -- 172.21.15.175:0/3135225535 learned_addr learned my addr 172.21.15.175:0/3135225535 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:11.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f400f400640 1 --2- 172.21.15.175:0/3135225535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f401014e360 0x7f401014b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f400fe00640 1 --2- 172.21.15.175:0/3135225535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40100cf970 0x7f40100cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f400ea00640 1 -- 172.21.15.175:0/3135225535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40100cf970 msgr2=0x7f40100cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f400ea00640 1 --2- 172.21.15.175:0/3135225535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40100cf970 0x7f40100cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f400ea00640 1 -- 172.21.15.175:0/3135225535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f401014e360 msgr2=0x7f401014b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f400ea00640 1 --2- 172.21.15.175:0/3135225535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f401014e360 0x7f401014b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f400ea00640 1 -- 172.21.15.175:0/3135225535 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401014b910 con 0x7f401014e740 2024-04-25T09:05:11.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f400ea00640 1 --2- 172.21.15.175:0/3135225535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f401014e740 0x7f40100af100 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc01c9e0 tx=0x7f3ff4007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:11.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f4007400640 1 -- 172.21.15.175:0/3135225535 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc0b2040 con 0x7f401014e740 2024-04-25T09:05:11.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f4007400640 1 -- 172.21.15.175:0/3135225535 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ffc009400 con 0x7f401014e740 2024-04-25T09:05:11.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f4007400640 1 -- 172.21.15.175:0/3135225535 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ffc009880 con 0x7f401014e740 2024-04-25T09:05:11.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f4016000640 1 -- 172.21.15.175:0/3135225535 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4010148ca0 con 0x7f401014e740 2024-04-25T09:05:11.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f4016000640 1 -- 172.21.15.175:0/3135225535 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4010149260 con 0x7f401014e740 2024-04-25T09:05:11.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.578+0000 7f4016000640 1 -- 172.21.15.175:0/3135225535 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4010074a60 con 0x7f401014e740 2024-04-25T09:05:11.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.582+0000 7f4007400640 1 -- 172.21.15.175:0/3135225535 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3ffc0c0060 con 0x7f401014e740 2024-04-25T09:05:11.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.582+0000 7f4007400640 1 --2- 172.21.15.175:0/3135225535 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ff0066f90 0x7f3ff0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.582+0000 7f4007400640 1 -- 172.21.15.175:0/3135225535 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ffc11ea10 con 0x7f401014e740 2024-04-25T09:05:11.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.582+0000 7f400f400640 1 --2- 172.21.15.175:0/3135225535 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ff0066f90 0x7f3ff0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.582+0000 7f400f400640 1 --2- 172.21.15.175:0/3135225535 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ff0066f90 0x7f3ff0069450 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4000007c90 tx=0x7f4000001d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:11.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.586+0000 7f4007400640 1 -- 172.21.15.175:0/3135225535 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f401014b910 con 0x7f401014e740 2024-04-25T09:05:11.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.738+0000 7f4016000640 1 -- 172.21.15.175:0/3135225535 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4010159400 con 0x7f3ff0066f90 2024-04-25T09:05:11.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.746+0000 7f4007400640 1 -- 172.21.15.175:0/3135225535 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251951 (secure 0 0 0) 0x7f4010159400 con 0x7f3ff0066f90 2024-04-25T09:05:11.741 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:11.742 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:05:11.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.750+0000 7f4016000640 1 -- 172.21.15.175:0/3135225535 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ff0066f90 msgr2=0x7f3ff0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.750+0000 7f4016000640 1 --2- 172.21.15.175:0/3135225535 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ff0066f90 0x7f3ff0069450 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4000007c90 tx=0x7f4000001d80 comp rx=0 tx=0).stop 2024-04-25T09:05:11.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.750+0000 7f4016000640 1 -- 172.21.15.175:0/3135225535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f401014e740 msgr2=0x7f40100af100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.750+0000 7f4016000640 1 --2- 172.21.15.175:0/3135225535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f401014e740 0x7f40100af100 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc01c9e0 tx=0x7f3ff4007a50 comp rx=0 tx=0).stop 2024-04-25T09:05:11.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.750+0000 7f4016000640 1 -- 172.21.15.175:0/3135225535 shutdown_connections 2024-04-25T09:05:11.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.750+0000 7f4016000640 1 --2- 172.21.15.175:0/3135225535 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ff0066f90 0x7f3ff0069450 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.750+0000 7f4016000640 1 --2- 172.21.15.175:0/3135225535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40100cf970 0x7f40100cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.750+0000 7f4016000640 1 --2- 172.21.15.175:0/3135225535 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f401014e740 0x7f40100af100 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.750+0000 7f4016000640 1 --2- 172.21.15.175:0/3135225535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f401014e360 0x7f401014b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.750+0000 7f4016000640 1 -- 172.21.15.175:0/3135225535 >> 172.21.15.175:0/3135225535 conn(0x7f3ff4006a20 msgr2=0x7f401006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:11.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.750+0000 7f4016000640 1 -- 172.21.15.175:0/3135225535 shutdown_connections 2024-04-25T09:05:11.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.750+0000 7f4016000640 1 -- 172.21.15.175:0/3135225535 wait complete. 2024-04-25T09:05:11.760 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-04-25T09:05:09.801076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220264,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754456,"statfs":{"total":773094113280,"available":772868562944,"internally_reserved":0,"allocated":4136960,"data_stored":2310220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.974193"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.837362+0000","last_change":"2024-04-25T09:05:02.858821+0000","last_active":"2024-04-25T09:05:03.837362+0000","last_peered":"2024-04-25T09:05:03.837362+0000","last_clean":"2024-04-25T09:05:03.837362+0000","last_became_active":"2024-04-25T09:05:02.856962+0000","last_became_peered":"2024-04-25T09:05:02.856962+0000","last_unstale":"2024-04-25T09:05:03.837362+0000","last_undegraded":"2024-04-25T09:05:03.837362+0000","last_fullsized":"2024-04-25T09:05:03.837362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:07.521086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.834674+0000","last_change":"2024-04-25T09:05:02.865522+0000","last_active":"2024-04-25T09:05:03.834674+0000","last_peered":"2024-04-25T09:05:03.834674+0000","last_clean":"2024-04-25T09:05:03.834674+0000","last_became_active":"2024-04-25T09:05:02.864866+0000","last_became_peered":"2024-04-25T09:05:02.864866+0000","last_unstale":"2024-04-25T09:05:03.834674+0000","last_undegraded":"2024-04-25T09:05:03.834674+0000","last_fullsized":"2024-04-25T09:05:03.834674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:05:22.021415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.869018+0000","last_change":"2024-04-25T09:05:02.851664+0000","last_active":"2024-04-25T09:05:03.869018+0000","last_peered":"2024-04-25T09:05:03.869018+0000","last_clean":"2024-04-25T09:05:03.869018+0000","last_became_active":"2024-04-25T09:05:02.851386+0000","last_became_peered":"2024-04-25T09:05:02.851386+0000","last_unstale":"2024-04-25T09:05:03.869018+0000","last_undegraded":"2024-04-25T09:05:03.869018+0000","last_fullsized":"2024-04-25T09:05:03.869018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:39.766487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868034+0000","last_change":"2024-04-25T09:05:02.843447+0000","last_active":"2024-04-25T09:05:03.868034+0000","last_peered":"2024-04-25T09:05:03.868034+0000","last_clean":"2024-04-25T09:05:03.868034+0000","last_became_active":"2024-04-25T09:05:02.842825+0000","last_became_peered":"2024-04-25T09:05:02.842825+0000","last_unstale":"2024-04-25T09:05:03.868034+0000","last_undegraded":"2024-04-25T09:05:03.868034+0000","last_fullsized":"2024-04-25T09:05:03.868034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:01.842614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867785+0000","last_change":"2024-04-25T09:05:02.857121+0000","last_active":"2024-04-25T09:05:03.867785+0000","last_peered":"2024-04-25T09:05:03.867785+0000","last_clean":"2024-04-25T09:05:03.867785+0000","last_became_active":"2024-04-25T09:05:02.856850+0000","last_became_peered":"2024-04-25T09:05:02.856850+0000","last_unstale":"2024-04-25T09:05:03.867785+0000","last_undegraded":"2024-04-25T09:05:03.867785+0000","last_fullsized":"2024-04-25T09:05:03.867785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:49.688131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.835029+0000","last_change":"2024-04-25T09:05:02.869101+0000","last_active":"2024-04-25T09:05:03.835029+0000","last_peered":"2024-04-25T09:05:03.835029+0000","last_clean":"2024-04-25T09:05:03.835029+0000","last_became_active":"2024-04-25T09:05:02.868870+0000","last_became_peered":"2024-04-25T09:05:02.868870+0000","last_unstale":"2024-04-25T09:05:03.835029+0000","last_undegraded":"2024-04-25T09:05:03.835029+0000","last_fullsized":"2024-04-25T09:05:03.835029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:03.034575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868101+0000","last_change":"2024-04-25T09:05:02.864189+0000","last_active":"2024-04-25T09:05:03.868101+0000","last_peered":"2024-04-25T09:05:03.868101+0000","last_clean":"2024-04-25T09:05:03.868101+0000","last_became_active":"2024-04-25T09:05:02.863666+0000","last_became_peered":"2024-04-25T09:05:02.863666+0000","last_unstale":"2024-04-25T09:05:03.868101+0000","last_undegraded":"2024-04-25T09:05:03.868101+0000","last_fullsized":"2024-04-25T09:05:03.868101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:26.924039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867968+0000","last_change":"2024-04-25T09:05:02.853295+0000","last_active":"2024-04-25T09:05:03.867968+0000","last_peered":"2024-04-25T09:05:03.867968+0000","last_clean":"2024-04-25T09:05:03.867968+0000","last_became_active":"2024-04-25T09:05:02.853072+0000","last_became_peered":"2024-04-25T09:05:02.853072+0000","last_unstale":"2024-04-25T09:05:03.867968+0000","last_undegraded":"2024-04-25T09:05:03.867968+0000","last_fullsized":"2024-04-25T09:05:03.867968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:47.044187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.836817+0000","last_change":"2024-04-25T09:05:02.847264+0000","last_active":"2024-04-25T09:05:03.836817+0000","last_peered":"2024-04-25T09:05:03.836817+0000","last_clean":"2024-04-25T09:05:03.836817+0000","last_became_active":"2024-04-25T09:05:02.846961+0000","last_became_peered":"2024-04-25T09:05:02.846961+0000","last_unstale":"2024-04-25T09:05:03.836817+0000","last_undegraded":"2024-04-25T09:05:03.836817+0000","last_fullsized":"2024-04-25T09:05:03.836817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:14.414161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868258+0000","last_change":"2024-04-25T09:05:02.864561+0000","last_active":"2024-04-25T09:05:03.868258+0000","last_peered":"2024-04-25T09:05:03.868258+0000","last_clean":"2024-04-25T09:05:03.868258+0000","last_became_active":"2024-04-25T09:05:02.864296+0000","last_became_peered":"2024-04-25T09:05:02.864296+0000","last_unstale":"2024-04-25T09:05:03.868258+0000","last_undegraded":"2024-04-25T09:05:03.868258+0000","last_fullsized":"2024-04-25T09:05:03.868258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:47.044187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868525+0000","last_change":"2024-04-25T09:05:02.861905+0000","last_active":"2024-04-25T09:05:03.868525+0000","last_peered":"2024-04-25T09:05:03.868525+0000","last_clean":"2024-04-25T09:05:03.868525+0000","last_became_active":"2024-04-25T09:05:02.861643+0000","last_became_peered":"2024-04-25T09:05:02.861643+0000","last_unstale":"2024-04-25T09:05:03.868525+0000","last_undegraded":"2024-04-25T09:05:03.868525+0000","last_fullsized":"2024-04-25T09:05:03.868525+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:56.765993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868767+0000","last_change":"2024-04-25T09:05:02.870528+0000","last_active":"2024-04-25T09:05:03.868767+0000","last_peered":"2024-04-25T09:05:03.868767+0000","last_clean":"2024-04-25T09:05:03.868767+0000","last_became_active":"2024-04-25T09:05:02.869841+0000","last_became_peered":"2024-04-25T09:05:02.869841+0000","last_unstale":"2024-04-25T09:05:03.868767+0000","last_undegraded":"2024-04-25T09:05:03.868767+0000","last_fullsized":"2024-04-25T09:05:03.868767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:29.035686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867989+0000","last_change":"2024-04-25T09:05:02.867938+0000","last_active":"2024-04-25T09:05:03.867989+0000","last_peered":"2024-04-25T09:05:03.867989+0000","last_clean":"2024-04-25T09:05:03.867989+0000","last_became_active":"2024-04-25T09:05:02.867208+0000","last_became_peered":"2024-04-25T09:05:02.867208+0000","last_unstale":"2024-04-25T09:05:03.867989+0000","last_undegraded":"2024-04-25T09:05:03.867989+0000","last_fullsized":"2024-04-25T09:05:03.867989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:08.088534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.834706+0000","last_change":"2024-04-25T09:05:02.871421+0000","last_active":"2024-04-25T09:05:03.834706+0000","last_peered":"2024-04-25T09:05:03.834706+0000","last_clean":"2024-04-25T09:05:03.834706+0000","last_became_active":"2024-04-25T09:05:02.871128+0000","last_became_peered":"2024-04-25T09:05:02.871128+0000","last_unstale":"2024-04-25T09:05:03.834706+0000","last_undegraded":"2024-04-25T09:05:03.834706+0000","last_fullsized":"2024-04-25T09:05:03.834706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:29.035686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868782+0000","last_change":"2024-04-25T09:05:02.853705+0000","last_active":"2024-04-25T09:05:03.868782+0000","last_peered":"2024-04-25T09:05:03.868782+0000","last_clean":"2024-04-25T09:05:03.868782+0000","last_became_active":"2024-04-25T09:05:02.851789+0000","last_became_peered":"2024-04-25T09:05:02.851789+0000","last_unstale":"2024-04-25T09:05:03.868782+0000","last_undegraded":"2024-04-25T09:05:03.868782+0000","last_fullsized":"2024-04-25T09:05:03.868782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:25.067439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868405+0000","last_change":"2024-04-25T09:05:02.867713+0000","last_active":"2024-04-25T09:05:03.868405+0000","last_peered":"2024-04-25T09:05:03.868405+0000","last_clean":"2024-04-25T09:05:03.868405+0000","last_became_active":"2024-04-25T09:05:02.867407+0000","last_became_peered":"2024-04-25T09:05:02.867407+0000","last_unstale":"2024-04-25T09:05:03.868405+0000","last_undegraded":"2024-04-25T09:05:03.868405+0000","last_fullsized":"2024-04-25T09:05:03.868405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:48:29.035686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.869208+0000","last_change":"2024-04-25T09:05:02.862693+0000","last_active":"2024-04-25T09:05:03.869208+0000","last_peered":"2024-04-25T09:05:03.869208+0000","last_clean":"2024-04-25T09:05:03.869208+0000","last_became_active":"2024-04-25T09:05:02.862399+0000","last_became_peered":"2024-04-25T09:05:02.862399+0000","last_unstale":"2024-04-25T09:05:03.869208+0000","last_undegraded":"2024-04-25T09:05:03.869208+0000","last_fullsized":"2024-04-25T09:05:03.869208+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:16.903886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.835147+0000","last_change":"2024-04-25T09:05:02.874042+0000","last_active":"2024-04-25T09:05:03.835147+0000","last_peered":"2024-04-25T09:05:03.835147+0000","last_clean":"2024-04-25T09:05:03.835147+0000","last_became_active":"2024-04-25T09:05:02.873788+0000","last_became_peered":"2024-04-25T09:05:02.873788+0000","last_unstale":"2024-04-25T09:05:03.835147+0000","last_undegraded":"2024-04-25T09:05:03.835147+0000","last_fullsized":"2024-04-25T09:05:03.835147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:39.647238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.834894+0000","last_change":"2024-04-25T09:05:02.873484+0000","last_active":"2024-04-25T09:05:03.834894+0000","last_peered":"2024-04-25T09:05:03.834894+0000","last_clean":"2024-04-25T09:05:03.834894+0000","last_became_active":"2024-04-25T09:05:02.873209+0000","last_became_peered":"2024-04-25T09:05:02.873209+0000","last_unstale":"2024-04-25T09:05:03.834894+0000","last_undegraded":"2024-04-25T09:05:03.834894+0000","last_fullsized":"2024-04-25T09:05:03.834894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:16.903886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868514+0000","last_change":"2024-04-25T09:05:02.852037+0000","last_active":"2024-04-25T09:05:03.868514+0000","last_peered":"2024-04-25T09:05:03.868514+0000","last_clean":"2024-04-25T09:05:03.868514+0000","last_became_active":"2024-04-25T09:05:02.851662+0000","last_became_peered":"2024-04-25T09:05:02.851662+0000","last_unstale":"2024-04-25T09:05:03.868514+0000","last_undegraded":"2024-04-25T09:05:03.868514+0000","last_fullsized":"2024-04-25T09:05:03.868514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:13.770019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.836555+0000","last_change":"2024-04-25T09:05:02.853874+0000","last_active":"2024-04-25T09:05:03.836555+0000","last_peered":"2024-04-25T09:05:03.836555+0000","last_clean":"2024-04-25T09:05:03.836555+0000","last_became_active":"2024-04-25T09:05:02.853608+0000","last_became_peered":"2024-04-25T09:05:02.853608+0000","last_unstale":"2024-04-25T09:05:03.836555+0000","last_undegraded":"2024-04-25T09:05:03.836555+0000","last_fullsized":"2024-04-25T09:05:03.836555+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:32.548610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.836335+0000","last_change":"2024-04-25T09:05:02.865674+0000","last_active":"2024-04-25T09:05:03.836335+0000","last_peered":"2024-04-25T09:05:03.836335+0000","last_clean":"2024-04-25T09:05:03.836335+0000","last_became_active":"2024-04-25T09:05:02.864675+0000","last_became_peered":"2024-04-25T09:05:02.864675+0000","last_unstale":"2024-04-25T09:05:03.836335+0000","last_undegraded":"2024-04-25T09:05:03.836335+0000","last_fullsized":"2024-04-25T09:05:03.836335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:42.461184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.866703+0000","last_change":"2024-04-25T09:05:02.852283+0000","last_active":"2024-04-25T09:05:03.866703+0000","last_peered":"2024-04-25T09:05:03.866703+0000","last_clean":"2024-04-25T09:05:03.866703+0000","last_became_active":"2024-04-25T09:05:02.851989+0000","last_became_peered":"2024-04-25T09:05:02.851989+0000","last_unstale":"2024-04-25T09:05:03.866703+0000","last_undegraded":"2024-04-25T09:05:03.866703+0000","last_fullsized":"2024-04-25T09:05:03.866703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:07.521086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868179+0000","last_change":"2024-04-25T09:05:02.849434+0000","last_active":"2024-04-25T09:05:03.868179+0000","last_peered":"2024-04-25T09:05:03.868179+0000","last_clean":"2024-04-25T09:05:03.868179+0000","last_became_active":"2024-04-25T09:05:02.849118+0000","last_became_peered":"2024-04-25T09:05:02.849118+0000","last_unstale":"2024-04-25T09:05:03.868179+0000","last_undegraded":"2024-04-25T09:05:03.868179+0000","last_fullsized":"2024-04-25T09:05:03.868179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:26.924039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867599+0000","last_change":"2024-04-25T09:05:02.861375+0000","last_active":"2024-04-25T09:05:03.867599+0000","last_peered":"2024-04-25T09:05:03.867599+0000","last_clean":"2024-04-25T09:05:03.867599+0000","last_became_active":"2024-04-25T09:05:02.860361+0000","last_became_peered":"2024-04-25T09:05:02.860361+0000","last_unstale":"2024-04-25T09:05:03.867599+0000","last_undegraded":"2024-04-25T09:05:03.867599+0000","last_fullsized":"2024-04-25T09:05:03.867599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:32.548610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.835118+0000","last_change":"2024-04-25T09:05:02.863841+0000","last_active":"2024-04-25T09:05:03.835118+0000","last_peered":"2024-04-25T09:05:03.835118+0000","last_clean":"2024-04-25T09:05:03.835118+0000","last_became_active":"2024-04-25T09:05:02.863513+0000","last_became_peered":"2024-04-25T09:05:02.863513+0000","last_unstale":"2024-04-25T09:05:03.835118+0000","last_undegraded":"2024-04-25T09:05:03.835118+0000","last_fullsized":"2024-04-25T09:05:03.835118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:39.766487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867891+0000","last_change":"2024-04-25T09:05:02.866687+0000","last_active":"2024-04-25T09:05:03.867891+0000","last_peered":"2024-04-25T09:05:03.867891+0000","last_clean":"2024-04-25T09:05:03.867891+0000","last_became_active":"2024-04-25T09:05:02.866281+0000","last_became_peered":"2024-04-25T09:05:02.866281+0000","last_unstale":"2024-04-25T09:05:03.867891+0000","last_undegraded":"2024-04-25T09:05:03.867891+0000","last_fullsized":"2024-04-25T09:05:03.867891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:14.414161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868674+0000","last_change":"2024-04-25T09:05:02.850168+0000","last_active":"2024-04-25T09:05:03.868674+0000","last_peered":"2024-04-25T09:05:03.868674+0000","last_clean":"2024-04-25T09:05:03.868674+0000","last_became_active":"2024-04-25T09:05:02.849815+0000","last_became_peered":"2024-04-25T09:05:02.849815+0000","last_unstale":"2024-04-25T09:05:03.868674+0000","last_undegraded":"2024-04-25T09:05:03.868674+0000","last_fullsized":"2024-04-25T09:05:03.868674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:05:22.021415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.836551+0000","last_change":"2024-04-25T09:05:02.865179+0000","last_active":"2024-04-25T09:05:03.836551+0000","last_peered":"2024-04-25T09:05:03.836551+0000","last_clean":"2024-04-25T09:05:03.836551+0000","last_became_active":"2024-04-25T09:05:02.864734+0000","last_became_peered":"2024-04-25T09:05:02.864734+0000","last_unstale":"2024-04-25T09:05:03.836551+0000","last_undegraded":"2024-04-25T09:05:03.836551+0000","last_fullsized":"2024-04-25T09:05:03.836551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:18.673123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868274+0000","last_change":"2024-04-25T09:05:02.863694+0000","last_active":"2024-04-25T09:05:03.868274+0000","last_peered":"2024-04-25T09:05:03.868274+0000","last_clean":"2024-04-25T09:05:03.868274+0000","last_became_active":"2024-04-25T09:05:02.863444+0000","last_became_peered":"2024-04-25T09:05:02.863444+0000","last_unstale":"2024-04-25T09:05:03.868274+0000","last_undegraded":"2024-04-25T09:05:03.868274+0000","last_fullsized":"2024-04-25T09:05:03.868274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:05:22.021415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.837159+0000","last_change":"2024-04-25T09:05:02.848438+0000","last_active":"2024-04-25T09:05:03.837159+0000","last_peered":"2024-04-25T09:05:03.837159+0000","last_clean":"2024-04-25T09:05:03.837159+0000","last_became_active":"2024-04-25T09:05:02.848145+0000","last_became_peered":"2024-04-25T09:05:02.848145+0000","last_unstale":"2024-04-25T09:05:03.837159+0000","last_undegraded":"2024-04-25T09:05:03.837159+0000","last_fullsized":"2024-04-25T09:05:03.837159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:13.770019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867967+0000","last_change":"2024-04-25T09:05:02.859909+0000","last_active":"2024-04-25T09:05:03.867967+0000","last_peered":"2024-04-25T09:05:03.867967+0000","last_clean":"2024-04-25T09:05:03.867967+0000","last_became_active":"2024-04-25T09:05:02.859536+0000","last_became_peered":"2024-04-25T09:05:02.859536+0000","last_unstale":"2024-04-25T09:05:03.867967+0000","last_undegraded":"2024-04-25T09:05:03.867967+0000","last_fullsized":"2024-04-25T09:05:03.867967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:22.555665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867076+0000","last_change":"2024-04-25T09:05:02.852383+0000","last_active":"2024-04-25T09:05:03.867076+0000","last_peered":"2024-04-25T09:05:03.867076+0000","last_clean":"2024-04-25T09:05:03.867076+0000","last_became_active":"2024-04-25T09:05:02.852110+0000","last_became_peered":"2024-04-25T09:05:02.852110+0000","last_unstale":"2024-04-25T09:05:03.867076+0000","last_undegraded":"2024-04-25T09:05:03.867076+0000","last_fullsized":"2024-04-25T09:05:03.867076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:29.069177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.837579+0000","last_change":"2024-04-25T09:05:01.859475+0000","last_active":"2024-04-25T09:05:03.837579+0000","last_peered":"2024-04-25T09:05:03.837579+0000","last_clean":"2024-04-25T09:05:03.837579+0000","last_became_active":"2024-04-25T09:05:01.859205+0000","last_became_peered":"2024-04-25T09:05:01.859205+0000","last_unstale":"2024-04-25T09:05:03.837579+0000","last_undegraded":"2024-04-25T09:05:03.837579+0000","last_fullsized":"2024-04-25T09:05:03.837579+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:22.640219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.837498+0000","last_change":"2024-04-25T09:05:02.848413+0000","last_active":"2024-04-25T09:05:03.837498+0000","last_peered":"2024-04-25T09:05:03.837498+0000","last_clean":"2024-04-25T09:05:03.837498+0000","last_became_active":"2024-04-25T09:05:02.848114+0000","last_became_peered":"2024-04-25T09:05:02.848114+0000","last_unstale":"2024-04-25T09:05:03.837498+0000","last_undegraded":"2024-04-25T09:05:03.837498+0000","last_fullsized":"2024-04-25T09:05:03.837498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:04.018998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867169+0000","last_change":"2024-04-25T09:05:01.851020+0000","last_active":"2024-04-25T09:05:03.867169+0000","last_peered":"2024-04-25T09:05:03.867169+0000","last_clean":"2024-04-25T09:05:03.867169+0000","last_became_active":"2024-04-25T09:05:01.850367+0000","last_became_peered":"2024-04-25T09:05:01.850367+0000","last_unstale":"2024-04-25T09:05:03.867169+0000","last_undegraded":"2024-04-25T09:05:03.867169+0000","last_fullsized":"2024-04-25T09:05:03.867169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:48.677980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.836149+0000","last_change":"2024-04-25T09:05:02.866156+0000","last_active":"2024-04-25T09:05:03.836149+0000","last_peered":"2024-04-25T09:05:03.836149+0000","last_clean":"2024-04-25T09:05:03.836149+0000","last_became_active":"2024-04-25T09:05:02.864652+0000","last_became_peered":"2024-04-25T09:05:02.864652+0000","last_unstale":"2024-04-25T09:05:03.836149+0000","last_undegraded":"2024-04-25T09:05:03.836149+0000","last_fullsized":"2024-04-25T09:05:03.836149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:49.630434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.834901+0000","last_change":"2024-04-25T09:05:01.855321+0000","last_active":"2024-04-25T09:05:03.834901+0000","last_peered":"2024-04-25T09:05:03.834901+0000","last_clean":"2024-04-25T09:05:03.834901+0000","last_became_active":"2024-04-25T09:05:01.854980+0000","last_became_peered":"2024-04-25T09:05:01.854980+0000","last_unstale":"2024-04-25T09:05:03.834901+0000","last_undegraded":"2024-04-25T09:05:03.834901+0000","last_fullsized":"2024-04-25T09:05:03.834901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:50.944782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868020+0000","last_change":"2024-04-25T09:05:02.866270+0000","last_active":"2024-04-25T09:05:03.868020+0000","last_peered":"2024-04-25T09:05:03.868020+0000","last_clean":"2024-04-25T09:05:03.868020+0000","last_became_active":"2024-04-25T09:05:02.865855+0000","last_became_peered":"2024-04-25T09:05:02.865855+0000","last_unstale":"2024-04-25T09:05:03.868020+0000","last_undegraded":"2024-04-25T09:05:03.868020+0000","last_fullsized":"2024-04-25T09:05:03.868020+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:48.229122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868599+0000","last_change":"2024-04-25T09:05:01.855383+0000","last_active":"2024-04-25T09:05:03.868599+0000","last_peered":"2024-04-25T09:05:03.868599+0000","last_clean":"2024-04-25T09:05:03.868599+0000","last_became_active":"2024-04-25T09:05:01.855114+0000","last_became_peered":"2024-04-25T09:05:01.855114+0000","last_unstale":"2024-04-25T09:05:03.868599+0000","last_undegraded":"2024-04-25T09:05:03.868599+0000","last_fullsized":"2024-04-25T09:05:03.868599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:30.103785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868131+0000","last_change":"2024-04-25T09:05:02.866998+0000","last_active":"2024-04-25T09:05:03.868131+0000","last_peered":"2024-04-25T09:05:03.868131+0000","last_clean":"2024-04-25T09:05:03.868131+0000","last_became_active":"2024-04-25T09:05:02.866321+0000","last_became_peered":"2024-04-25T09:05:02.866321+0000","last_unstale":"2024-04-25T09:05:03.868131+0000","last_undegraded":"2024-04-25T09:05:03.868131+0000","last_fullsized":"2024-04-25T09:05:03.868131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:07.205248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.836695+0000","last_change":"2024-04-25T09:05:01.850620+0000","last_active":"2024-04-25T09:05:03.836695+0000","last_peered":"2024-04-25T09:05:03.836695+0000","last_clean":"2024-04-25T09:05:03.836695+0000","last_became_active":"2024-04-25T09:05:01.850289+0000","last_became_peered":"2024-04-25T09:05:01.850289+0000","last_unstale":"2024-04-25T09:05:03.836695+0000","last_undegraded":"2024-04-25T09:05:03.836695+0000","last_fullsized":"2024-04-25T09:05:03.836695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:52.353215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868428+0000","last_change":"2024-04-25T09:05:02.849645+0000","last_active":"2024-04-25T09:05:03.868428+0000","last_peered":"2024-04-25T09:05:03.868428+0000","last_clean":"2024-04-25T09:05:03.868428+0000","last_became_active":"2024-04-25T09:05:02.849266+0000","last_became_peered":"2024-04-25T09:05:02.849266+0000","last_unstale":"2024-04-25T09:05:03.868428+0000","last_undegraded":"2024-04-25T09:05:03.868428+0000","last_fullsized":"2024-04-25T09:05:03.868428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:07.205248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.836333+0000","last_change":"2024-04-25T09:05:01.853233+0000","last_active":"2024-04-25T09:05:03.836333+0000","last_peered":"2024-04-25T09:05:03.836333+0000","last_clean":"2024-04-25T09:05:03.836333+0000","last_became_active":"2024-04-25T09:05:01.852944+0000","last_became_peered":"2024-04-25T09:05:01.852944+0000","last_unstale":"2024-04-25T09:05:03.836333+0000","last_undegraded":"2024-04-25T09:05:03.836333+0000","last_fullsized":"2024-04-25T09:05:03.836333+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:55.907137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.835850+0000","last_change":"2024-04-25T09:05:02.853559+0000","last_active":"2024-04-25T09:05:03.835850+0000","last_peered":"2024-04-25T09:05:03.835850+0000","last_clean":"2024-04-25T09:05:03.835850+0000","last_became_active":"2024-04-25T09:05:02.848943+0000","last_became_peered":"2024-04-25T09:05:02.848943+0000","last_unstale":"2024-04-25T09:05:03.835850+0000","last_undegraded":"2024-04-25T09:05:03.835850+0000","last_fullsized":"2024-04-25T09:05:03.835850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:51.954932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.834385+0000","last_change":"2024-04-25T09:05:01.842765+0000","last_active":"2024-04-25T09:05:03.834385+0000","last_peered":"2024-04-25T09:05:03.834385+0000","last_clean":"2024-04-25T09:05:03.834385+0000","last_became_active":"2024-04-25T09:05:01.842535+0000","last_became_peered":"2024-04-25T09:05:01.842535+0000","last_unstale":"2024-04-25T09:05:03.834385+0000","last_undegraded":"2024-04-25T09:05:03.834385+0000","last_fullsized":"2024-04-25T09:05:03.834385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:48.620283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867060+0000","last_change":"2024-04-25T09:05:02.845716+0000","last_active":"2024-04-25T09:05:03.867060+0000","last_peered":"2024-04-25T09:05:03.867060+0000","last_clean":"2024-04-25T09:05:03.867060+0000","last_became_active":"2024-04-25T09:05:02.845407+0000","last_became_peered":"2024-04-25T09:05:02.845407+0000","last_unstale":"2024-04-25T09:05:03.867060+0000","last_undegraded":"2024-04-25T09:05:03.867060+0000","last_fullsized":"2024-04-25T09:05:03.867060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:42.461184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.835790+0000","last_change":"2024-04-25T09:05:01.844077+0000","last_active":"2024-04-25T09:05:03.835790+0000","last_peered":"2024-04-25T09:05:03.835790+0000","last_clean":"2024-04-25T09:05:03.835790+0000","last_became_active":"2024-04-25T09:05:01.843762+0000","last_became_peered":"2024-04-25T09:05:01.843762+0000","last_unstale":"2024-04-25T09:05:03.835790+0000","last_undegraded":"2024-04-25T09:05:03.835790+0000","last_fullsized":"2024-04-25T09:05:03.835790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:40.689654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868867+0000","last_change":"2024-04-25T09:05:02.870188+0000","last_active":"2024-04-25T09:05:03.868867+0000","last_peered":"2024-04-25T09:05:03.868867+0000","last_clean":"2024-04-25T09:05:03.868867+0000","last_became_active":"2024-04-25T09:05:02.869854+0000","last_became_peered":"2024-04-25T09:05:02.869854+0000","last_unstale":"2024-04-25T09:05:03.868867+0000","last_undegraded":"2024-04-25T09:05:03.868867+0000","last_fullsized":"2024-04-25T09:05:03.868867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:16.903886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.835166+0000","last_change":"2024-04-25T09:05:01.858030+0000","last_active":"2024-04-25T09:05:03.835166+0000","last_peered":"2024-04-25T09:05:03.835166+0000","last_clean":"2024-04-25T09:05:03.835166+0000","last_became_active":"2024-04-25T09:05:01.857784+0000","last_became_peered":"2024-04-25T09:05:01.857784+0000","last_unstale":"2024-04-25T09:05:03.835166+0000","last_undegraded":"2024-04-25T09:05:03.835166+0000","last_fullsized":"2024-04-25T09:05:03.835166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:03.008848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.835173+0000","last_change":"2024-04-25T09:05:02.868617+0000","last_active":"2024-04-25T09:05:03.835173+0000","last_peered":"2024-04-25T09:05:03.835173+0000","last_clean":"2024-04-25T09:05:03.835173+0000","last_became_active":"2024-04-25T09:05:02.868348+0000","last_became_peered":"2024-04-25T09:05:02.868348+0000","last_unstale":"2024-04-25T09:05:03.835173+0000","last_undegraded":"2024-04-25T09:05:03.835173+0000","last_fullsized":"2024-04-25T09:05:03.835173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:12.719112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867356+0000","last_change":"2024-04-25T09:05:01.851249+0000","last_active":"2024-04-25T09:05:03.867356+0000","last_peered":"2024-04-25T09:05:03.867356+0000","last_clean":"2024-04-25T09:05:03.867356+0000","last_became_active":"2024-04-25T09:05:01.850775+0000","last_became_peered":"2024-04-25T09:05:01.850775+0000","last_unstale":"2024-04-25T09:05:03.867356+0000","last_undegraded":"2024-04-25T09:05:03.867356+0000","last_fullsized":"2024-04-25T09:05:03.867356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:23.553154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.834745+0000","last_change":"2024-04-25T09:05:02.863023+0000","last_active":"2024-04-25T09:05:03.834745+0000","last_peered":"2024-04-25T09:05:03.834745+0000","last_clean":"2024-04-25T09:05:03.834745+0000","last_became_active":"2024-04-25T09:05:02.862731+0000","last_became_peered":"2024-04-25T09:05:02.862731+0000","last_unstale":"2024-04-25T09:05:03.834745+0000","last_undegraded":"2024-04-25T09:05:03.834745+0000","last_fullsized":"2024-04-25T09:05:03.834745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:56.765993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868983+0000","last_change":"2024-04-25T09:05:01.860048+0000","last_active":"2024-04-25T09:05:03.868983+0000","last_peered":"2024-04-25T09:05:03.868983+0000","last_clean":"2024-04-25T09:05:03.868983+0000","last_became_active":"2024-04-25T09:05:01.859751+0000","last_became_peered":"2024-04-25T09:05:01.859751+0000","last_unstale":"2024-04-25T09:05:03.868983+0000","last_undegraded":"2024-04-25T09:05:03.868983+0000","last_fullsized":"2024-04-25T09:05:03.868983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:44.618901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868587+0000","last_change":"2024-04-25T09:05:02.870418+0000","last_active":"2024-04-25T09:05:03.868587+0000","last_peered":"2024-04-25T09:05:03.868587+0000","last_clean":"2024-04-25T09:05:03.868587+0000","last_became_active":"2024-04-25T09:05:02.869933+0000","last_became_peered":"2024-04-25T09:05:02.869933+0000","last_unstale":"2024-04-25T09:05:03.868587+0000","last_undegraded":"2024-04-25T09:05:03.868587+0000","last_fullsized":"2024-04-25T09:05:03.868587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:05.222560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.834712+0000","last_change":"2024-04-25T09:05:01.853200+0000","last_active":"2024-04-25T09:05:03.834712+0000","last_peered":"2024-04-25T09:05:03.834712+0000","last_clean":"2024-04-25T09:05:03.834712+0000","last_became_active":"2024-04-25T09:05:01.851932+0000","last_became_peered":"2024-04-25T09:05:01.851932+0000","last_unstale":"2024-04-25T09:05:03.834712+0000","last_undegraded":"2024-04-25T09:05:03.834712+0000","last_fullsized":"2024-04-25T09:05:03.834712+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:06.510936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867269+0000","last_change":"2024-04-25T09:05:02.866511+0000","last_active":"2024-04-25T09:05:03.867269+0000","last_peered":"2024-04-25T09:05:03.867269+0000","last_clean":"2024-04-25T09:05:03.867269+0000","last_became_active":"2024-04-25T09:05:02.866266+0000","last_became_peered":"2024-04-25T09:05:02.866266+0000","last_unstale":"2024-04-25T09:05:03.867269+0000","last_undegraded":"2024-04-25T09:05:03.867269+0000","last_fullsized":"2024-04-25T09:05:03.867269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:18.673123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.836698+0000","last_change":"2024-04-25T09:05:01.844545+0000","last_active":"2024-04-25T09:05:03.836698+0000","last_peered":"2024-04-25T09:05:03.836698+0000","last_clean":"2024-04-25T09:05:03.836698+0000","last_became_active":"2024-04-25T09:05:01.843748+0000","last_became_peered":"2024-04-25T09:05:01.843748+0000","last_unstale":"2024-04-25T09:05:03.836698+0000","last_undegraded":"2024-04-25T09:05:03.836698+0000","last_fullsized":"2024-04-25T09:05:03.836698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:48.677980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.834707+0000","last_change":"2024-04-25T09:05:02.863176+0000","last_active":"2024-04-25T09:05:03.834707+0000","last_peered":"2024-04-25T09:05:03.834707+0000","last_clean":"2024-04-25T09:05:03.834707+0000","last_became_active":"2024-04-25T09:05:02.862642+0000","last_became_peered":"2024-04-25T09:05:02.862642+0000","last_unstale":"2024-04-25T09:05:03.834707+0000","last_undegraded":"2024-04-25T09:05:03.834707+0000","last_fullsized":"2024-04-25T09:05:03.834707+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:25.067439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867352+0000","last_change":"2024-04-25T09:05:01.853811+0000","last_active":"2024-04-25T09:05:03.867352+0000","last_peered":"2024-04-25T09:05:03.867352+0000","last_clean":"2024-04-25T09:05:03.867352+0000","last_became_active":"2024-04-25T09:05:01.853511+0000","last_became_peered":"2024-04-25T09:05:01.853511+0000","last_unstale":"2024-04-25T09:05:03.867352+0000","last_undegraded":"2024-04-25T09:05:03.867352+0000","last_fullsized":"2024-04-25T09:05:03.867352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:07.078383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868141+0000","last_change":"2024-04-25T09:05:02.856263+0000","last_active":"2024-04-25T09:05:03.868141+0000","last_peered":"2024-04-25T09:05:03.868141+0000","last_clean":"2024-04-25T09:05:03.868141+0000","last_became_active":"2024-04-25T09:05:02.855627+0000","last_became_peered":"2024-04-25T09:05:02.855627+0000","last_unstale":"2024-04-25T09:05:03.868141+0000","last_undegraded":"2024-04-25T09:05:03.868141+0000","last_fullsized":"2024-04-25T09:05:03.868141+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:05.222560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.834305+0000","last_change":"2024-04-25T09:05:01.849597+0000","last_active":"2024-04-25T09:05:03.834305+0000","last_peered":"2024-04-25T09:05:03.834305+0000","last_clean":"2024-04-25T09:05:03.834305+0000","last_became_active":"2024-04-25T09:05:01.849343+0000","last_became_peered":"2024-04-25T09:05:01.849343+0000","last_unstale":"2024-04-25T09:05:03.834305+0000","last_undegraded":"2024-04-25T09:05:03.834305+0000","last_fullsized":"2024-04-25T09:05:03.834305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:28.059026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.837212+0000","last_change":"2024-04-25T09:05:02.844078+0000","last_active":"2024-04-25T09:05:03.837212+0000","last_peered":"2024-04-25T09:05:03.837212+0000","last_clean":"2024-04-25T09:05:03.837212+0000","last_became_active":"2024-04-25T09:05:02.843779+0000","last_became_peered":"2024-04-25T09:05:02.843779+0000","last_unstale":"2024-04-25T09:05:03.837212+0000","last_undegraded":"2024-04-25T09:05:03.837212+0000","last_fullsized":"2024-04-25T09:05:03.837212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:40:02.857323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.834490+0000","last_change":"2024-04-25T09:05:01.845805+0000","last_active":"2024-04-25T09:05:03.834490+0000","last_peered":"2024-04-25T09:05:03.834490+0000","last_clean":"2024-04-25T09:05:03.834490+0000","last_became_active":"2024-04-25T09:05:01.845373+0000","last_became_peered":"2024-04-25T09:05:01.845373+0000","last_unstale":"2024-04-25T09:05:03.834490+0000","last_undegraded":"2024-04-25T09:05:03.834490+0000","last_fullsized":"2024-04-25T09:05:03.834490+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:41.451033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.836163+0000","last_change":"2024-04-25T09:05:02.852376+0000","last_active":"2024-04-25T09:05:03.836163+0000","last_peered":"2024-04-25T09:05:03.836163+0000","last_clean":"2024-04-25T09:05:03.836163+0000","last_became_active":"2024-04-25T09:05:02.851914+0000","last_became_peered":"2024-04-25T09:05:02.851914+0000","last_unstale":"2024-04-25T09:05:03.836163+0000","last_undegraded":"2024-04-25T09:05:03.836163+0000","last_fullsized":"2024-04-25T09:05:03.836163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:45.629052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867742+0000","last_change":"2024-04-25T09:05:01.853103+0000","last_active":"2024-04-25T09:05:03.867742+0000","last_peered":"2024-04-25T09:05:03.867742+0000","last_clean":"2024-04-25T09:05:03.867742+0000","last_became_active":"2024-04-25T09:05:01.852683+0000","last_became_peered":"2024-04-25T09:05:01.852683+0000","last_unstale":"2024-04-25T09:05:03.867742+0000","last_undegraded":"2024-04-25T09:05:03.867742+0000","last_fullsized":"2024-04-25T09:05:03.867742+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:12.759868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868774+0000","last_change":"2024-04-25T09:05:02.855106+0000","last_active":"2024-04-25T09:05:03.868774+0000","last_peered":"2024-04-25T09:05:03.868774+0000","last_clean":"2024-04-25T09:05:03.868774+0000","last_became_active":"2024-04-25T09:05:02.854833+0000","last_became_peered":"2024-04-25T09:05:02.854833+0000","last_unstale":"2024-04-25T09:05:03.868774+0000","last_undegraded":"2024-04-25T09:05:03.868774+0000","last_fullsized":"2024-04-25T09:05:03.868774+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:56.765993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.836555+0000","last_change":"2024-04-25T09:05:01.846615+0000","last_active":"2024-04-25T09:05:03.836555+0000","last_peered":"2024-04-25T09:05:03.836555+0000","last_clean":"2024-04-25T09:05:03.836555+0000","last_became_active":"2024-04-25T09:05:01.846321+0000","last_became_peered":"2024-04-25T09:05:01.846321+0000","last_unstale":"2024-04-25T09:05:03.836555+0000","last_undegraded":"2024-04-25T09:05:03.836555+0000","last_fullsized":"2024-04-25T09:05:03.836555+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:07.078383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868108+0000","last_change":"2024-04-25T09:05:02.843630+0000","last_active":"2024-04-25T09:05:03.868108+0000","last_peered":"2024-04-25T09:05:03.868108+0000","last_clean":"2024-04-25T09:05:03.868108+0000","last_became_active":"2024-04-25T09:05:02.843180+0000","last_became_peered":"2024-04-25T09:05:02.843180+0000","last_unstale":"2024-04-25T09:05:03.868108+0000","last_undegraded":"2024-04-25T09:05:03.868108+0000","last_fullsized":"2024-04-25T09:05:03.868108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:20.924591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.836312+0000","last_change":"2024-04-25T09:05:01.845678+0000","last_active":"2024-04-25T09:05:03.836312+0000","last_peered":"2024-04-25T09:05:03.836312+0000","last_clean":"2024-04-25T09:05:03.836312+0000","last_became_active":"2024-04-25T09:05:01.845394+0000","last_became_peered":"2024-04-25T09:05:01.845394+0000","last_unstale":"2024-04-25T09:05:03.836312+0000","last_undegraded":"2024-04-25T09:05:03.836312+0000","last_fullsized":"2024-04-25T09:05:03.836312+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:38:45.459385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868226+0000","last_change":"2024-04-25T09:05:02.854200+0000","last_active":"2024-04-25T09:05:03.868226+0000","last_peered":"2024-04-25T09:05:03.868226+0000","last_clean":"2024-04-25T09:05:03.868226+0000","last_became_active":"2024-04-25T09:05:02.853951+0000","last_became_peered":"2024-04-25T09:05:02.853951+0000","last_unstale":"2024-04-25T09:05:03.868226+0000","last_undegraded":"2024-04-25T09:05:03.868226+0000","last_fullsized":"2024-04-25T09:05:03.868226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:24.563305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.836292+0000","last_change":"2024-04-25T09:05:01.850960+0000","last_active":"2024-04-25T09:05:03.836292+0000","last_peered":"2024-04-25T09:05:03.836292+0000","last_clean":"2024-04-25T09:05:03.836292+0000","last_became_active":"2024-04-25T09:05:01.850670+0000","last_became_peered":"2024-04-25T09:05:01.850670+0000","last_unstale":"2024-04-25T09:05:03.836292+0000","last_undegraded":"2024-04-25T09:05:03.836292+0000","last_fullsized":"2024-04-25T09:05:03.836292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:03.855826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867767+0000","last_change":"2024-04-25T09:05:02.857926+0000","last_active":"2024-04-25T09:05:03.867767+0000","last_peered":"2024-04-25T09:05:03.867767+0000","last_clean":"2024-04-25T09:05:03.867767+0000","last_became_active":"2024-04-25T09:05:02.857607+0000","last_became_peered":"2024-04-25T09:05:02.857607+0000","last_unstale":"2024-04-25T09:05:03.867767+0000","last_undegraded":"2024-04-25T09:05:03.867767+0000","last_fullsized":"2024-04-25T09:05:03.867767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:04.865976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867194+0000","last_change":"2024-04-25T09:05:01.841773+0000","last_active":"2024-04-25T09:05:03.867194+0000","last_peered":"2024-04-25T09:05:03.867194+0000","last_clean":"2024-04-25T09:05:03.867194+0000","last_became_active":"2024-04-25T09:05:01.841485+0000","last_became_peered":"2024-04-25T09:05:01.841485+0000","last_unstale":"2024-04-25T09:05:03.867194+0000","last_undegraded":"2024-04-25T09:05:03.867194+0000","last_fullsized":"2024-04-25T09:05:03.867194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:03.855826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868066+0000","last_change":"2024-04-25T09:05:02.848304+0000","last_active":"2024-04-25T09:05:03.868066+0000","last_peered":"2024-04-25T09:05:03.868066+0000","last_clean":"2024-04-25T09:05:03.868066+0000","last_became_active":"2024-04-25T09:05:02.848052+0000","last_became_peered":"2024-04-25T09:05:02.848052+0000","last_unstale":"2024-04-25T09:05:03.868066+0000","last_undegraded":"2024-04-25T09:05:03.868066+0000","last_fullsized":"2024-04-25T09:05:03.868066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:16.518980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.837121+0000","last_change":"2024-04-25T09:05:01.856230+0000","last_active":"2024-04-25T09:05:03.837121+0000","last_peered":"2024-04-25T09:05:03.837121+0000","last_clean":"2024-04-25T09:05:03.837121+0000","last_became_active":"2024-04-25T09:05:01.855929+0000","last_became_peered":"2024-04-25T09:05:01.855929+0000","last_unstale":"2024-04-25T09:05:03.837121+0000","last_undegraded":"2024-04-25T09:05:03.837121+0000","last_fullsized":"2024-04-25T09:05:03.837121+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:03.855826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867621+0000","last_change":"2024-04-25T09:05:02.849454+0000","last_active":"2024-04-25T09:05:03.867621+0000","last_peered":"2024-04-25T09:05:03.867621+0000","last_clean":"2024-04-25T09:05:03.867621+0000","last_became_active":"2024-04-25T09:05:02.849142+0000","last_became_peered":"2024-04-25T09:05:02.849142+0000","last_unstale":"2024-04-25T09:05:03.867621+0000","last_undegraded":"2024-04-25T09:05:03.867621+0000","last_fullsized":"2024-04-25T09:05:03.867621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:53.363365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.835931+0000","last_change":"2024-04-25T09:05:01.842494+0000","last_active":"2024-04-25T09:05:03.835931+0000","last_peered":"2024-04-25T09:05:03.835931+0000","last_clean":"2024-04-25T09:05:03.835931+0000","last_became_active":"2024-04-25T09:05:01.842187+0000","last_became_peered":"2024-04-25T09:05:01.842187+0000","last_unstale":"2024-04-25T09:05:03.835931+0000","last_undegraded":"2024-04-25T09:05:03.835931+0000","last_fullsized":"2024-04-25T09:05:03.835931+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:43:54.535074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868016+0000","last_change":"2024-04-25T09:05:02.863975+0000","last_active":"2024-04-25T09:05:03.868016+0000","last_peered":"2024-04-25T09:05:03.868016+0000","last_clean":"2024-04-25T09:05:03.868016+0000","last_became_active":"2024-04-25T09:05:02.863277+0000","last_became_peered":"2024-04-25T09:05:02.863277+0000","last_unstale":"2024-04-25T09:05:03.868016+0000","last_undegraded":"2024-04-25T09:05:03.868016+0000","last_fullsized":"2024-04-25T09:05:03.868016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:11.497247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868185+0000","last_change":"2024-04-25T09:05:01.853085+0000","last_active":"2024-04-25T09:05:03.868185+0000","last_peered":"2024-04-25T09:05:03.868185+0000","last_clean":"2024-04-25T09:05:03.868185+0000","last_became_active":"2024-04-25T09:05:01.852672+0000","last_became_peered":"2024-04-25T09:05:01.852672+0000","last_unstale":"2024-04-25T09:05:03.868185+0000","last_undegraded":"2024-04-25T09:05:03.868185+0000","last_fullsized":"2024-04-25T09:05:03.868185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:48.620283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868227+0000","last_change":"2024-04-25T09:05:02.859757+0000","last_active":"2024-04-25T09:05:03.868227+0000","last_peered":"2024-04-25T09:05:03.868227+0000","last_clean":"2024-04-25T09:05:03.868227+0000","last_became_active":"2024-04-25T09:05:02.859431+0000","last_became_peered":"2024-04-25T09:05:02.859431+0000","last_unstale":"2024-04-25T09:05:03.868227+0000","last_undegraded":"2024-04-25T09:05:03.868227+0000","last_fullsized":"2024-04-25T09:05:03.868227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:11.504469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867831+0000","last_change":"2024-04-25T09:05:01.859966+0000","last_active":"2024-04-25T09:05:03.867831+0000","last_peered":"2024-04-25T09:05:03.867831+0000","last_clean":"2024-04-25T09:05:03.867831+0000","last_became_active":"2024-04-25T09:05:01.859591+0000","last_became_peered":"2024-04-25T09:05:01.859591+0000","last_unstale":"2024-04-25T09:05:03.867831+0000","last_undegraded":"2024-04-25T09:05:03.867831+0000","last_fullsized":"2024-04-25T09:05:03.867831+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:10.494318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868928+0000","last_change":"2024-04-25T09:05:02.870778+0000","last_active":"2024-04-25T09:05:03.868928+0000","last_peered":"2024-04-25T09:05:03.868928+0000","last_clean":"2024-04-25T09:05:03.868928+0000","last_became_active":"2024-04-25T09:05:02.870225+0000","last_became_peered":"2024-04-25T09:05:02.870225+0000","last_unstale":"2024-04-25T09:05:03.868928+0000","last_undegraded":"2024-04-25T09:05:03.868928+0000","last_fullsized":"2024-04-25T09:05:03.868928+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:03.034575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867307+0000","last_change":"2024-04-25T09:05:01.841767+0000","last_active":"2024-04-25T09:05:03.867307+0000","last_peered":"2024-04-25T09:05:03.867307+0000","last_clean":"2024-04-25T09:05:03.867307+0000","last_became_active":"2024-04-25T09:05:01.841486+0000","last_became_peered":"2024-04-25T09:05:01.841486+0000","last_unstale":"2024-04-25T09:05:03.867307+0000","last_undegraded":"2024-04-25T09:05:03.867307+0000","last_fullsized":"2024-04-25T09:05:03.867307+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:15.508830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.866942+0000","last_change":"2024-04-25T09:05:02.847617+0000","last_active":"2024-04-25T09:05:03.866942+0000","last_peered":"2024-04-25T09:05:03.866942+0000","last_clean":"2024-04-25T09:05:03.866942+0000","last_became_active":"2024-04-25T09:05:02.846938+0000","last_became_peered":"2024-04-25T09:05:02.846938+0000","last_unstale":"2024-04-25T09:05:03.866942+0000","last_undegraded":"2024-04-25T09:05:03.866942+0000","last_fullsized":"2024-04-25T09:05:03.866942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:04.018998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868109+0000","last_change":"2024-04-25T09:05:01.853095+0000","last_active":"2024-04-25T09:05:03.868109+0000","last_peered":"2024-04-25T09:05:03.868109+0000","last_clean":"2024-04-25T09:05:03.868109+0000","last_became_active":"2024-04-25T09:05:01.852739+0000","last_became_peered":"2024-04-25T09:05:01.852739+0000","last_unstale":"2024-04-25T09:05:03.868109+0000","last_undegraded":"2024-04-25T09:05:03.868109+0000","last_fullsized":"2024-04-25T09:05:03.868109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:58:15.508830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.837299+0000","last_change":"2024-04-25T09:05:02.849315+0000","last_active":"2024-04-25T09:05:03.837299+0000","last_peered":"2024-04-25T09:05:03.837299+0000","last_clean":"2024-04-25T09:05:03.837299+0000","last_became_active":"2024-04-25T09:05:02.849027+0000","last_became_peered":"2024-04-25T09:05:02.849027+0000","last_unstale":"2024-04-25T09:05:03.837299+0000","last_undegraded":"2024-04-25T09:05:03.837299+0000","last_fullsized":"2024-04-25T09:05:03.837299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:38.515175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867357+0000","last_change":"2024-04-25T09:05:01.858937+0000","last_active":"2024-04-25T09:05:03.867357+0000","last_peered":"2024-04-25T09:05:03.867357+0000","last_clean":"2024-04-25T09:05:03.867357+0000","last_became_active":"2024-04-25T09:05:01.858636+0000","last_became_peered":"2024-04-25T09:05:01.858636+0000","last_unstale":"2024-04-25T09:05:03.867357+0000","last_undegraded":"2024-04-25T09:05:03.867357+0000","last_fullsized":"2024-04-25T09:05:03.867357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:07.078383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867105+0000","last_change":"2024-04-25T09:05:02.848475+0000","last_active":"2024-04-25T09:05:03.867105+0000","last_peered":"2024-04-25T09:05:03.867105+0000","last_clean":"2024-04-25T09:05:03.867105+0000","last_became_active":"2024-04-25T09:05:02.848193+0000","last_became_peered":"2024-04-25T09:05:02.848193+0000","last_unstale":"2024-04-25T09:05:03.867105+0000","last_undegraded":"2024-04-25T09:05:03.867105+0000","last_fullsized":"2024-04-25T09:05:03.867105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:51.954932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.867431+0000","last_change":"2024-04-25T09:05:01.859845+0000","last_active":"2024-04-25T09:05:03.867431+0000","last_peered":"2024-04-25T09:05:03.867431+0000","last_clean":"2024-04-25T09:05:03.867431+0000","last_became_active":"2024-04-25T09:05:01.859553+0000","last_became_peered":"2024-04-25T09:05:01.859553+0000","last_unstale":"2024-04-25T09:05:03.867431+0000","last_undegraded":"2024-04-25T09:05:03.867431+0000","last_fullsized":"2024-04-25T09:05:03.867431+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:23.553154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.834379+0000","last_change":"2024-04-25T09:05:02.869441+0000","last_active":"2024-04-25T09:05:03.834379+0000","last_peered":"2024-04-25T09:05:03.834379+0000","last_clean":"2024-04-25T09:05:03.834379+0000","last_became_active":"2024-04-25T09:05:02.869188+0000","last_became_peered":"2024-04-25T09:05:02.869188+0000","last_unstale":"2024-04-25T09:05:03.834379+0000","last_undegraded":"2024-04-25T09:05:03.834379+0000","last_fullsized":"2024-04-25T09:05:03.834379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:05.222560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.835985+0000","last_change":"2024-04-25T09:05:01.860397+0000","last_active":"2024-04-25T09:05:03.835985+0000","last_peered":"2024-04-25T09:05:03.835985+0000","last_clean":"2024-04-25T09:05:03.835985+0000","last_became_active":"2024-04-25T09:05:01.859885+0000","last_became_peered":"2024-04-25T09:05:01.859885+0000","last_unstale":"2024-04-25T09:05:03.835985+0000","last_undegraded":"2024-04-25T09:05:03.835985+0000","last_fullsized":"2024-04-25T09:05:03.835985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:22.640219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.835857+0000","last_change":"2024-04-25T09:05:02.859991+0000","last_active":"2024-04-25T09:05:03.835857+0000","last_peered":"2024-04-25T09:05:03.835857+0000","last_clean":"2024-04-25T09:05:03.835857+0000","last_became_active":"2024-04-25T09:05:02.859622+0000","last_became_peered":"2024-04-25T09:05:02.859622+0000","last_unstale":"2024-04-25T09:05:03.835857+0000","last_undegraded":"2024-04-25T09:05:03.835857+0000","last_fullsized":"2024-04-25T09:05:03.835857+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:29.069177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.834385+0000","last_change":"2024-04-25T09:05:01.854637+0000","last_active":"2024-04-25T09:05:03.834385+0000","last_peered":"2024-04-25T09:05:03.834385+0000","last_clean":"2024-04-25T09:05:03.834385+0000","last_became_active":"2024-04-25T09:05:01.854045+0000","last_became_peered":"2024-04-25T09:05:01.854045+0000","last_unstale":"2024-04-25T09:05:03.834385+0000","last_undegraded":"2024-04-25T09:05:03.834385+0000","last_fullsized":"2024-04-25T09:05:03.834385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:44.618901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868716+0000","last_change":"2024-04-25T09:05:02.855286+0000","last_active":"2024-04-25T09:05:03.868716+0000","last_peered":"2024-04-25T09:05:03.868716+0000","last_clean":"2024-04-25T09:05:03.868716+0000","last_became_active":"2024-04-25T09:05:02.854987+0000","last_became_peered":"2024-04-25T09:05:02.854987+0000","last_unstale":"2024-04-25T09:05:03.868716+0000","last_undegraded":"2024-04-25T09:05:03.868716+0000","last_fullsized":"2024-04-25T09:05:03.868716+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:01.819932+0000","last_clean_scrub_stamp":"2024-04-25T09:05:01.819932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:25.067439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.837279+0000","last_change":"2024-04-25T09:05:01.844352+0000","last_active":"2024-04-25T09:05:03.837279+0000","last_peered":"2024-04-25T09:05:03.837279+0000","last_clean":"2024-04-25T09:05:03.837279+0000","last_became_active":"2024-04-25T09:05:01.843530+0000","last_became_peered":"2024-04-25T09:05:01.843530+0000","last_unstale":"2024-04-25T09:05:03.837279+0000","last_undegraded":"2024-04-25T09:05:03.837279+0000","last_fullsized":"2024-04-25T09:05:03.837279+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:00.809781+0000","last_clean_scrub_stamp":"2024-04-25T09:05:00.809781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:52.353215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":191,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-25T09:05:03.868459+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:05:03.868459+0000","last_peered":"2024-04-25T09:05:03.868459+0000","last_clean":"2024-04-25T09:05:03.868459+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:05:03.868459+0000","last_undegraded":"2024-04-25T09:05:03.868459+0000","last_fullsized":"2024-04-25T09:05:03.868459+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":731041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":141199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":141255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":140687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":142217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":140653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":142217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":954368,"data_stored":730951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:05:11.768 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:05:11.768 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:05:11.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.950+0000 7f955ec00640 1 Processor -- start 2024-04-25T09:05:11.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.950+0000 7f955ec00640 1 -- start start 2024-04-25T09:05:11.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955ec00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f955815dca0 0x7f95580d06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955ec00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f955809a810 0x7f9558099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955ec00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f955809ad80 con 0x7f95580b05f0 2024-04-25T09:05:11.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955ec00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95580d0260 con 0x7f955809a810 2024-04-25T09:05:11.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955ec00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95580cfc10 con 0x7f955815dca0 2024-04-25T09:05:11.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955e200640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f95580b05f0 0x7f95580cbd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53074/0 (socket says 172.21.15.175:53074) 2024-04-25T09:05:11.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955e200640 1 -- 172.21.15.175:0/997263945 learned_addr learned my addr 172.21.15.175:0/997263945 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:11.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955d800640 1 --2- 172.21.15.175:0/997263945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f955815dca0 0x7f95580d06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955ce00640 1 --2- 172.21.15.175:0/997263945 >> v2:172.21.15.177:3300/0 conn(0x7f955809a810 0x7f9558099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f9557e00640 1 -- 172.21.15.175:0/997263945 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 934805117 0 0) 0x7f955809ad80 con 0x7f95580b05f0 2024-04-25T09:05:11.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f9557e00640 1 -- 172.21.15.175:0/997263945 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9540003530 con 0x7f95580b05f0 2024-04-25T09:05:11.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f9557e00640 1 -- 172.21.15.175:0/997263945 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3757211328 0 0) 0x7f9540003530 con 0x7f95580b05f0 2024-04-25T09:05:11.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f9557e00640 1 -- 172.21.15.175:0/997263945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f955815dca0 msgr2=0x7f95580d06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:11.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f9557e00640 1 --2- 172.21.15.175:0/997263945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f955815dca0 0x7f95580d06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f9557e00640 1 -- 172.21.15.175:0/997263945 >> v2:172.21.15.177:3300/0 conn(0x7f955809a810 msgr2=0x7f9558099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:11.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f9557e00640 1 --2- 172.21.15.175:0/997263945 >> v2:172.21.15.177:3300/0 conn(0x7f955809a810 0x7f9558099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f9557e00640 1 -- 172.21.15.175:0/997263945 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95580cfef0 con 0x7f95580b05f0 2024-04-25T09:05:11.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f9557e00640 1 -- 172.21.15.175:0/997263945 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f9550001a00 con 0x7f95580b05f0 2024-04-25T09:05:11.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f9557e00640 1 -- 172.21.15.175:0/997263945 >> v1:172.21.15.175:6789/0 conn(0x7f95580b05f0 legacy=0x7f95580cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f9557e00640 1 --2- 172.21.15.175:0/997263945 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95400039c0 0x7f9540003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f9557e00640 1 --2- 172.21.15.175:0/997263945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f955815dca0 0x7f9540004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f9557e00640 1 --2- 172.21.15.175:0/997263945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9540004d50 0x7f95400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f9557e00640 1 -- 172.21.15.175:0/997263945 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95580d0260 con 0x7f9540004d50 2024-04-25T09:05:11.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f9557e00640 1 -- 172.21.15.175:0/997263945 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95580cfc10 con 0x7f95400039c0 2024-04-25T09:05:11.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f9557e00640 1 -- 172.21.15.175:0/997263945 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954000b9d0 con 0x7f955815dca0 2024-04-25T09:05:11.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955ce00640 1 --2- 172.21.15.175:0/997263945 >> v2:172.21.15.177:3300/0 conn(0x7f955809a810 0x7f9558099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:11.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955e200640 1 --2- 172.21.15.175:0/997263945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9540004d50 0x7f95400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955d800640 1 --2- 172.21.15.175:0/997263945 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95400039c0 0x7f9540003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955ce00640 1 --2- 172.21.15.175:0/997263945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f955815dca0 0x7f9540004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955e200640 1 -- 172.21.15.175:0/997263945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f955815dca0 msgr2=0x7f9540004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:11.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955e200640 1 --2- 172.21.15.175:0/997263945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f955815dca0 0x7f9540004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955e200640 1 -- 172.21.15.175:0/997263945 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95400039c0 msgr2=0x7f9540003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:11.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955e200640 1 --2- 172.21.15.175:0/997263945 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95400039c0 0x7f9540003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955e200640 1 -- 172.21.15.175:0/997263945 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9540003530 con 0x7f9540004d50 2024-04-25T09:05:11.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.954+0000 7f955ce00640 1 --2- 172.21.15.175:0/997263945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f955815dca0 0x7f9540004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:11.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.958+0000 7f955e200640 1 --2- 172.21.15.175:0/997263945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9540004d50 0x7f95400051d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f955000a7d0 tx=0x7f955001d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9d377b8ed8f96c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:11.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.958+0000 7f9557e00640 1 -- 172.21.15.175:0/997263945 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955000a3f0 con 0x7f9540004d50 2024-04-25T09:05:11.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.958+0000 7f9557e00640 1 -- 172.21.15.175:0/997263945 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95500ad630 con 0x7f9540004d50 2024-04-25T09:05:11.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.958+0000 7f9557e00640 1 -- 172.21.15.175:0/997263945 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95500ada40 con 0x7f9540004d50 2024-04-25T09:05:11.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.958+0000 7f955ec00640 1 -- 172.21.15.175:0/997263945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9540004d50 msgr2=0x7f95400051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.958+0000 7f955ec00640 1 --2- 172.21.15.175:0/997263945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9540004d50 0x7f95400051d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f955000a7d0 tx=0x7f955001d300 comp rx=0 tx=0).stop 2024-04-25T09:05:11.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.958+0000 7f955e200640 1 -- 172.21.15.175:0/997263945 reap_dead start 2024-04-25T09:05:11.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.958+0000 7f955ec00640 1 -- 172.21.15.175:0/997263945 shutdown_connections 2024-04-25T09:05:11.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.958+0000 7f955ec00640 1 -- 172.21.15.175:0/997263945 >> 172.21.15.175:0/997263945 conn(0x7f95580b31b0 msgr2=0x7f95580b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:11.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.958+0000 7f955ec00640 1 -- 172.21.15.175:0/997263945 shutdown_connections 2024-04-25T09:05:11.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.958+0000 7f955ec00640 1 -- 172.21.15.175:0/997263945 wait complete. 2024-04-25T09:05:11.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.958+0000 7f955ec00640 1 Processor -- start 2024-04-25T09:05:11.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.958+0000 7f955ec00640 1 -- start start 2024-04-25T09:05:11.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f955ec00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9540004d50 0x7f9558159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f955ec00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95580c7b40 0x7f955815b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f955ec00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9558150740 0x7f9558150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f955ec00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95580cf9b0 con 0x7f9540004d50 2024-04-25T09:05:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f955ec00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95580cf830 con 0x7f9558150740 2024-04-25T09:05:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f955ec00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95580cc420 con 0x7f95580c7b40 2024-04-25T09:05:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f955d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9540004d50 0x7f9558159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f955d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9540004d50 0x7f9558159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43552/0 (socket says 172.21.15.175:43552) 2024-04-25T09:05:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f955d800640 1 -- 172.21.15.175:0/3548385397 learned_addr learned my addr 172.21.15.175:0/3548385397 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f955d800640 1 -- 172.21.15.175:0/3548385397 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95580c7b40 msgr2=0x7f955815b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f955d800640 1 --2- 172.21.15.175:0/3548385397 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95580c7b40 0x7f955815b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f955d800640 1 -- 172.21.15.175:0/3548385397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9558150740 msgr2=0x7f9558150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f955d800640 1 --2- 172.21.15.175:0/3548385397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9558150740 0x7f9558150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f955d800640 1 -- 172.21.15.175:0/3548385397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95580c80d0 con 0x7f9540004d50 2024-04-25T09:05:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f955d800640 1 --2- 172.21.15.175:0/3548385397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9540004d50 0x7f9558159ea0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f954c011960 tx=0x7f954c011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:11.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f9555600640 1 -- 172.21.15.175:0/3548385397 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c00fa70 con 0x7f9540004d50 2024-04-25T09:05:11.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f9555600640 1 -- 172.21.15.175:0/3548385397 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954c00fc10 con 0x7f9540004d50 2024-04-25T09:05:11.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f9555600640 1 -- 172.21.15.175:0/3548385397 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c014440 con 0x7f9540004d50 2024-04-25T09:05:11.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f955ec00640 1 -- 172.21.15.175:0/3548385397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95581514a0 con 0x7f9540004d50 2024-04-25T09:05:11.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f955ec00640 1 -- 172.21.15.175:0/3548385397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9558151a60 con 0x7f9540004d50 2024-04-25T09:05:11.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f955ec00640 1 -- 172.21.15.175:0/3548385397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9558074a60 con 0x7f9540004d50 2024-04-25T09:05:11.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.962+0000 7f9555600640 1 -- 172.21.15.175:0/3548385397 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f954c012040 con 0x7f9540004d50 2024-04-25T09:05:11.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.966+0000 7f9555600640 1 --2- 172.21.15.175:0/3548385397 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9538066f90 0x7f9538069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:11.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.966+0000 7f9555600640 1 -- 172.21.15.175:0/3548385397 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f954c0855a0 con 0x7f9540004d50 2024-04-25T09:05:11.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.966+0000 7f955ce00640 1 --2- 172.21.15.175:0/3548385397 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9538066f90 0x7f9538069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:11.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.966+0000 7f955ce00640 1 --2- 172.21.15.175:0/3548385397 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9538066f90 0x7f9538069450 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f95581f7d30 tx=0x7f9544008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:11.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:11.970+0000 7f9555600640 1 -- 172.21.15.175:0/3548385397 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f95580c80d0 con 0x7f9540004d50 2024-04-25T09:05:12.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.178+0000 7f955ec00640 1 -- 172.21.15.175:0/3548385397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f95580b01f0 con 0x7f9540004d50 2024-04-25T09:05:12.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.178+0000 7f9555600640 1 -- 172.21.15.175:0/3548385397 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f954c019030 con 0x7f9540004d50 2024-04-25T09:05:12.172 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2024-04-25T09:05:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBPHCpmhyCUBhAA8k9xLKIw8R04i6HSJykDfw== 2024-04-25T09:05:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: caps mds = "allow" 2024-04-25T09:05:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: caps mon = "allow r" 2024-04-25T09:05:12.172 INFO:teuthology.orchestra.run.smithi175.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:05:12.173 INFO:teuthology.orchestra.run.smithi175.stderr:updated caps for client.0 2024-04-25T09:05:12.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.182+0000 7f955ec00640 1 -- 172.21.15.175:0/3548385397 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9538066f90 msgr2=0x7f9538069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:12.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.182+0000 7f955ec00640 1 --2- 172.21.15.175:0/3548385397 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9538066f90 0x7f9538069450 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f95581f7d30 tx=0x7f9544008040 comp rx=0 tx=0).stop 2024-04-25T09:05:12.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.182+0000 7f955ec00640 1 -- 172.21.15.175:0/3548385397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9540004d50 msgr2=0x7f9558159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:12.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.182+0000 7f955ec00640 1 --2- 172.21.15.175:0/3548385397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9540004d50 0x7f9558159ea0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f954c011960 tx=0x7f954c011e20 comp rx=0 tx=0).stop 2024-04-25T09:05:12.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.182+0000 7f955ec00640 1 -- 172.21.15.175:0/3548385397 shutdown_connections 2024-04-25T09:05:12.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.182+0000 7f955ec00640 1 --2- 172.21.15.175:0/3548385397 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9538066f90 0x7f9538069450 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.182+0000 7f955ec00640 1 --2- 172.21.15.175:0/3548385397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9558150740 0x7f9558150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.182+0000 7f955ec00640 1 --2- 172.21.15.175:0/3548385397 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95580c7b40 0x7f955815b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.182+0000 7f955ec00640 1 --2- 172.21.15.175:0/3548385397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9540004d50 0x7f9558159ea0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.182+0000 7f955ec00640 1 -- 172.21.15.175:0/3548385397 >> 172.21.15.175:0/3548385397 conn(0x7f95580b31b0 msgr2=0x7f9558099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:12.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.182+0000 7f955ec00640 1 -- 172.21.15.175:0/3548385397 shutdown_connections 2024-04-25T09:05:12.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.182+0000 7f955ec00640 1 -- 172.21.15.175:0/3548385397 wait complete. 2024-04-25T09:05:12.193 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:12.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.334+0000 7f57a8000640 1 Processor -- start 2024-04-25T09:05:12.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.334+0000 7f57a8000640 1 -- start start 2024-04-25T09:05:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.334+0000 7f57a8000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f57a00cd520 0x7f57a006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.334+0000 7f57a8000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f57a00cf560 0x7f57a00cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.334+0000 7f57a8000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a00cda00 con 0x7f57a015a900 2024-04-25T09:05:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.334+0000 7f57a8000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a015bcf0 con 0x7f57a00cf560 2024-04-25T09:05:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.334+0000 7f57a8000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a00cfed0 con 0x7f57a00cd520 2024-04-25T09:05:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.338+0000 7f57a6000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f57a00cf560 0x7f57a00cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.338+0000 7f57a6000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f57a00cf560 0x7f57a00cf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43558/0 (socket says 172.21.15.175:43558) 2024-04-25T09:05:12.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.338+0000 7f57a6000640 1 -- 172.21.15.175:0/4092520088 learned_addr learned my addr 172.21.15.175:0/4092520088 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:12.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.338+0000 7f57a4c00640 1 --2- 172.21.15.175:0/4092520088 >> v2:172.21.15.177:3300/0 conn(0x7f57a00cd520 0x7f57a006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:12.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.338+0000 7f57a6000640 1 -- 172.21.15.175:0/4092520088 >> v2:172.21.15.177:3300/0 conn(0x7f57a00cd520 msgr2=0x7f57a006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:12.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.338+0000 7f57a6000640 1 --2- 172.21.15.175:0/4092520088 >> v2:172.21.15.177:3300/0 conn(0x7f57a00cd520 0x7f57a006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.338+0000 7f57a6000640 1 -- 172.21.15.175:0/4092520088 >> v1:172.21.15.177:6789/0 conn(0x7f57a015a900 legacy=0x7f57a00ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:12.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.338+0000 7f57a6000640 1 -- 172.21.15.175:0/4092520088 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a00cdce0 con 0x7f57a00cf560 2024-04-25T09:05:12.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.338+0000 7f57a6000640 1 --2- 172.21.15.175:0/4092520088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57a00cf560 0x7f57a00cf990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f57a00cf510 tx=0x7f579801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0e416251960615 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:12.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.338+0000 7f579fe00640 1 -- 172.21.15.175:0/4092520088 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57980a57a0 con 0x7f57a00cf560 2024-04-25T09:05:12.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.338+0000 7f579fe00640 1 -- 172.21.15.175:0/4092520088 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57980a5940 con 0x7f57a00cf560 2024-04-25T09:05:12.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.338+0000 7f579fe00640 1 -- 172.21.15.175:0/4092520088 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57980a5d10 con 0x7f57a00cf560 2024-04-25T09:05:12.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a8000640 1 -- 172.21.15.175:0/4092520088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57a00cf560 msgr2=0x7f57a00cf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:12.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a8000640 1 --2- 172.21.15.175:0/4092520088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57a00cf560 0x7f57a00cf990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f57a00cf510 tx=0x7f579801c9f0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a8000640 1 -- 172.21.15.175:0/4092520088 shutdown_connections 2024-04-25T09:05:12.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a8000640 1 --2- 172.21.15.175:0/4092520088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57a00cf560 0x7f57a00cf990 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a8000640 1 --2- 172.21.15.175:0/4092520088 >> v2:172.21.15.177:3300/0 conn(0x7f57a00cd520 0x7f57a006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a8000640 1 -- 172.21.15.175:0/4092520088 >> 172.21.15.175:0/4092520088 conn(0x7f57a0067150 msgr2=0x7f57a006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:12.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a8000640 1 -- 172.21.15.175:0/4092520088 shutdown_connections 2024-04-25T09:05:12.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a8000640 1 -- 172.21.15.175:0/4092520088 wait complete. 2024-04-25T09:05:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a8000640 1 Processor -- start 2024-04-25T09:05:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a8000640 1 -- start start 2024-04-25T09:05:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a8000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57a00cf560 0x7f57a00b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a8000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57a015a900 0x7f57a0154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a8000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57a01552c0 0x7f57a014e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a8000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a006d530 con 0x7f57a00cf560 2024-04-25T09:05:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a8000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a006d3b0 con 0x7f57a01552c0 2024-04-25T09:05:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a8000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a015c790 con 0x7f57a015a900 2024-04-25T09:05:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a5600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57a00cf560 0x7f57a00b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a5600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57a00cf560 0x7f57a00b2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43570/0 (socket says 172.21.15.175:43570) 2024-04-25T09:05:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a5600640 1 -- 172.21.15.175:0/3421372205 learned_addr learned my addr 172.21.15.175:0/3421372205 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:12.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a6000640 1 --2- 172.21.15.175:0/3421372205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57a01552c0 0x7f57a014e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:12.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a4c00640 1 --2- 172.21.15.175:0/3421372205 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57a015a900 0x7f57a0154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:12.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a5600640 1 -- 172.21.15.175:0/3421372205 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57a015a900 msgr2=0x7f57a0154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:12.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a5600640 1 --2- 172.21.15.175:0/3421372205 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57a015a900 0x7f57a0154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a5600640 1 -- 172.21.15.175:0/3421372205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57a01552c0 msgr2=0x7f57a014e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:12.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a5600640 1 --2- 172.21.15.175:0/3421372205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57a01552c0 0x7f57a014e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.342+0000 7f57a5600640 1 -- 172.21.15.175:0/3421372205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a00b3460 con 0x7f57a00cf560 2024-04-25T09:05:12.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.346+0000 7f57a5600640 1 --2- 172.21.15.175:0/3421372205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57a00cf560 0x7f57a00b2370 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f579400c370 tx=0x7f579400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:12.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.346+0000 7f579d600640 1 -- 172.21.15.175:0/3421372205 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57940052d0 con 0x7f57a00cf560 2024-04-25T09:05:12.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.346+0000 7f579d600640 1 -- 172.21.15.175:0/3421372205 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5794005470 con 0x7f57a00cf560 2024-04-25T09:05:12.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.346+0000 7f57a8000640 1 -- 172.21.15.175:0/3421372205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a00b2bc0 con 0x7f57a00cf560 2024-04-25T09:05:12.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.346+0000 7f579d600640 1 -- 172.21.15.175:0/3421372205 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794007260 con 0x7f57a00cf560 2024-04-25T09:05:12.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.346+0000 7f57a8000640 1 -- 172.21.15.175:0/3421372205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a00b3180 con 0x7f57a00cf560 2024-04-25T09:05:12.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.346+0000 7f57a8000640 1 -- 172.21.15.175:0/3421372205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a0074a60 con 0x7f57a00cf560 2024-04-25T09:05:12.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.346+0000 7f579d600640 1 -- 172.21.15.175:0/3421372205 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5794007400 con 0x7f57a00cf560 2024-04-25T09:05:12.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.346+0000 7f579d600640 1 --2- 172.21.15.175:0/3421372205 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5780066f60 0x7f5780069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:12.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.346+0000 7f579d600640 1 -- 172.21.15.175:0/3421372205 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57940843f0 con 0x7f57a00cf560 2024-04-25T09:05:12.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.346+0000 7f57a4c00640 1 --2- 172.21.15.175:0/3421372205 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5780066f60 0x7f5780069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:12.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.350+0000 7f57a4c00640 1 --2- 172.21.15.175:0/3421372205 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5780066f60 0x7f5780069420 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f57a0154d30 tx=0x7f578c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:12.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.350+0000 7f579d600640 1 -- 172.21.15.175:0/3421372205 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5794054da0 con 0x7f57a00cf560 2024-04-25T09:05:12.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.534+0000 7f57a8000640 1 -- 172.21.15.175:0/3421372205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57a00b28b0 con 0x7f57a00cf560 2024-04-25T09:05:12.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.538+0000 7f579d600640 1 -- 172.21.15.175:0/3421372205 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f5794058e40 con 0x7f57a00cf560 2024-04-25T09:05:12.530 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:12.530 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2334769483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2334769483},{"type":"v1","addr":"172.21.15.177:6834","nonce":2334769483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2397222507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2397222507},{"type":"v1","addr":"172.21.15.177:6835","nonce":2397222507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5067,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2738941530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2738941530},{"type":"v1","addr":"172.21.15.175:6836","nonce":2738941530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:02.208383+0000","modified":"2024-04-25T09:05:05.231797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1909482114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1909482114},{"type":"v1","addr":"172.21.15.175:6837","nonce":1909482114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:05:12.530 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 17 2024-04-25T09:05:12.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.538+0000 7f57a8000640 1 -- 172.21.15.175:0/3421372205 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5780066f60 msgr2=0x7f5780069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:12.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.538+0000 7f57a8000640 1 --2- 172.21.15.175:0/3421372205 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5780066f60 0x7f5780069420 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f57a0154d30 tx=0x7f578c009190 comp rx=0 tx=0).stop 2024-04-25T09:05:12.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.538+0000 7f57a8000640 1 -- 172.21.15.175:0/3421372205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57a00cf560 msgr2=0x7f57a00b2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:12.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.538+0000 7f57a8000640 1 --2- 172.21.15.175:0/3421372205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57a00cf560 0x7f57a00b2370 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f579400c370 tx=0x7f579400c830 comp rx=0 tx=0).stop 2024-04-25T09:05:12.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.538+0000 7f57a8000640 1 -- 172.21.15.175:0/3421372205 shutdown_connections 2024-04-25T09:05:12.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.538+0000 7f57a8000640 1 --2- 172.21.15.175:0/3421372205 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5780066f60 0x7f5780069420 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.538+0000 7f57a8000640 1 --2- 172.21.15.175:0/3421372205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57a01552c0 0x7f57a014e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.538+0000 7f57a8000640 1 --2- 172.21.15.175:0/3421372205 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57a015a900 0x7f57a0154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.538+0000 7f57a8000640 1 --2- 172.21.15.175:0/3421372205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57a00cf560 0x7f57a00b2370 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:12.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.538+0000 7f57a8000640 1 -- 172.21.15.175:0/3421372205 >> 172.21.15.175:0/3421372205 conn(0x7f57a00cd520 msgr2=0x7f57a0155a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:12.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.538+0000 7f57a8000640 1 -- 172.21.15.175:0/3421372205 shutdown_connections 2024-04-25T09:05:12.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:12.538+0000 7f57a8000640 1 -- 172.21.15.175:0/3421372205 wait complete. 2024-04-25T09:05:12.954 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:05:02.208383+0000', 'modified': '2024-04-25T09:05:05.231797+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5070}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5070': {'gid': 5070, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6837/1909482114', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6835', 'nonce': 1909482114}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 1909482114}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:05:12.954 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:05:12.954 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:05:13.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.098+0000 7f6776c00640 1 Processor -- start 2024-04-25T09:05:13.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.098+0000 7f6776c00640 1 -- start start 2024-04-25T09:05:13.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.098+0000 7f6776c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f67700cdb60 0x7f67700cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.098+0000 7f6776c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f677006ad50 0x7f677006bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.098+0000 7f6776c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f677006c080 0x7f67701616d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.098+0000 7f6776c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677006de20 con 0x7f67700cdb60 2024-04-25T09:05:13.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.098+0000 7f6776c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677015dfe0 con 0x7f677006ad50 2024-04-25T09:05:13.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.098+0000 7f6776c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67700ce480 con 0x7f677006c080 2024-04-25T09:05:13.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.102+0000 7f676fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f67700cdb60 0x7f67700cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.102+0000 7f676fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f67700cdb60 0x7f67700cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43582/0 (socket says 172.21.15.175:43582) 2024-04-25T09:05:13.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.102+0000 7f676fe00640 1 -- 172.21.15.175:0/3128581405 learned_addr learned my addr 172.21.15.175:0/3128581405 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:13.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.102+0000 7f6774c00640 1 --2- 172.21.15.175:0/3128581405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f677006c080 0x7f67701616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.102+0000 7f6767400640 1 --2- 172.21.15.175:0/3128581405 >> v2:172.21.15.177:3300/0 conn(0x7f677006ad50 0x7f677006bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.102+0000 7f676fe00640 1 -- 172.21.15.175:0/3128581405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f677006c080 msgr2=0x7f67701616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:13.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.102+0000 7f676fe00640 1 --2- 172.21.15.175:0/3128581405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f677006c080 0x7f67701616d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.102+0000 7f676fe00640 1 -- 172.21.15.175:0/3128581405 >> v2:172.21.15.177:3300/0 conn(0x7f677006ad50 msgr2=0x7f677006bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:13.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.102+0000 7f676fe00640 1 --2- 172.21.15.175:0/3128581405 >> v2:172.21.15.177:3300/0 conn(0x7f677006ad50 0x7f677006bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.102+0000 7f676fe00640 1 -- 172.21.15.175:0/3128581405 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677006e090 con 0x7f67700cdb60 2024-04-25T09:05:13.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.102+0000 7f676fe00640 1 --2- 172.21.15.175:0/3128581405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67700cdb60 0x7f67700cdf40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f67700cc9e0 tx=0x7f676001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4868201636bd3d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:13.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.102+0000 7f676f400640 1 -- 172.21.15.175:0/3128581405 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67600a5840 con 0x7f67700cdb60 2024-04-25T09:05:13.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.102+0000 7f676f400640 1 -- 172.21.15.175:0/3128581405 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67600a59e0 con 0x7f67700cdb60 2024-04-25T09:05:13.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.102+0000 7f676f400640 1 -- 172.21.15.175:0/3128581405 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67600a5db0 con 0x7f67700cdb60 2024-04-25T09:05:13.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f6776c00640 1 -- 172.21.15.175:0/3128581405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67700cdb60 msgr2=0x7f67700cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f6776c00640 1 --2- 172.21.15.175:0/3128581405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67700cdb60 0x7f67700cdf40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f67700cc9e0 tx=0x7f676001c9c0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f6776c00640 1 -- 172.21.15.175:0/3128581405 shutdown_connections 2024-04-25T09:05:13.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f6776c00640 1 --2- 172.21.15.175:0/3128581405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f677006c080 0x7f67701616d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f6776c00640 1 --2- 172.21.15.175:0/3128581405 >> v2:172.21.15.177:3300/0 conn(0x7f677006ad50 0x7f677006bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f6776c00640 1 --2- 172.21.15.175:0/3128581405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67700cdb60 0x7f67700cdf40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f6776c00640 1 -- 172.21.15.175:0/3128581405 >> 172.21.15.175:0/3128581405 conn(0x7f67700cca10 msgr2=0x7f67700cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:13.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f6776c00640 1 -- 172.21.15.175:0/3128581405 shutdown_connections 2024-04-25T09:05:13.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f6776c00640 1 -- 172.21.15.175:0/3128581405 wait complete. 2024-04-25T09:05:13.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f6776c00640 1 Processor -- start 2024-04-25T09:05:13.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f6776c00640 1 -- start start 2024-04-25T09:05:13.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f6776c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f677006ad50 0x7f6770143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f6776c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f677006c080 0x7f67701535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f6776c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67700cdb60 0x7f6770153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f6776c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67700aef40 con 0x7f677006ad50 2024-04-25T09:05:13.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f6776c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67700aedc0 con 0x7f677006c080 2024-04-25T09:05:13.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f6776c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f677006eb70 con 0x7f67700cdb60 2024-04-25T09:05:13.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f676fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f677006ad50 0x7f6770143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f676fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f677006ad50 0x7f6770143230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43592/0 (socket says 172.21.15.175:43592) 2024-04-25T09:05:13.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f676fe00640 1 -- 172.21.15.175:0/2097043568 learned_addr learned my addr 172.21.15.175:0/2097043568 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f676fe00640 1 -- 172.21.15.175:0/2097043568 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67700cdb60 msgr2=0x7f6770153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f676fe00640 1 --2- 172.21.15.175:0/2097043568 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67700cdb60 0x7f6770153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f676fe00640 1 -- 172.21.15.175:0/2097043568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f677006c080 msgr2=0x7f67701535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f676fe00640 1 --2- 172.21.15.175:0/2097043568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f677006c080 0x7f67701535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f676fe00640 1 -- 172.21.15.175:0/2097043568 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6770143770 con 0x7f677006ad50 2024-04-25T09:05:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.106+0000 7f676fe00640 1 --2- 172.21.15.175:0/2097043568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f677006ad50 0x7f6770143230 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f67600af040 tx=0x7f6760019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.110+0000 7f676cc00640 1 -- 172.21.15.175:0/2097043568 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67600bc020 con 0x7f677006ad50 2024-04-25T09:05:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.110+0000 7f676cc00640 1 -- 172.21.15.175:0/2097043568 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67600b8670 con 0x7f677006ad50 2024-04-25T09:05:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.110+0000 7f676cc00640 1 -- 172.21.15.175:0/2097043568 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67600b8a60 con 0x7f677006ad50 2024-04-25T09:05:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.110+0000 7f6776c00640 1 -- 172.21.15.175:0/2097043568 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6770151580 con 0x7f677006ad50 2024-04-25T09:05:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.110+0000 7f6776c00640 1 -- 172.21.15.175:0/2097043568 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6770151b40 con 0x7f677006ad50 2024-04-25T09:05:13.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.110+0000 7f676cc00640 1 -- 172.21.15.175:0/2097043568 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f67600bf020 con 0x7f677006ad50 2024-04-25T09:05:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.110+0000 7f676cc00640 1 --2- 172.21.15.175:0/2097043568 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f674c066f60 0x7f674c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.110+0000 7f676cc00640 1 -- 172.21.15.175:0/2097043568 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67601202b0 con 0x7f677006ad50 2024-04-25T09:05:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.110+0000 7f6767400640 1 --2- 172.21.15.175:0/2097043568 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f674c066f60 0x7f674c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.110+0000 7f677a198000 1 Processor -- start 2024-04-25T09:05:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.110+0000 7f677a198000 1 -- start start 2024-04-25T09:05:13.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.110+0000 7f6767400640 1 --2- 172.21.15.175:0/2097043568 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f674c066f60 0x7f674c069420 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6770153250 tx=0x7f6758009520 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:13.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f677a198000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b88920 0x55a972b88d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f677a198000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 0x55a972b3e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f677a198000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b3ef30 0x55a972b3f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f677a198000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a972a265f0 con 0x55a972b89240 2024-04-25T09:05:13.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f677a198000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a97298dda0 con 0x55a972b88920 2024-04-25T09:05:13.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f677a198000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a972916150 con 0x55a972b3ef30 2024-04-25T09:05:13.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f6767400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 0x55a972b3e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f6767400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 0x55a972b3e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43594/0 (socket says 172.21.15.175:43594) 2024-04-25T09:05:13.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f6767400640 1 -- 172.21.15.175:0/1421905277 learned_addr learned my addr 172.21.15.175:0/1421905277 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:13.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f6774c00640 1 --2- 172.21.15.175:0/1421905277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b3ef30 0x55a972b3f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f676fe00640 1 --2- 172.21.15.175:0/1421905277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b88920 0x55a972b88d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f6767400640 1 -- 172.21.15.175:0/1421905277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b3ef30 msgr2=0x55a972b3f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:13.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f6767400640 1 --2- 172.21.15.175:0/1421905277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b3ef30 0x55a972b3f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f6767400640 1 -- 172.21.15.175:0/1421905277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b88920 msgr2=0x55a972b88d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:13.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f6767400640 1 --2- 172.21.15.175:0/1421905277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b88920 0x55a972b88d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f6767400640 1 -- 172.21.15.175:0/1421905277 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a97292fca0 con 0x55a972b89240 2024-04-25T09:05:13.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f6767400640 1 --2- 172.21.15.175:0/1421905277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 0x55a972b3e9f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f675800eb40 tx=0x7f6758011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a842e9b2e11236e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:13.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f6764c00640 1 -- 172.21.15.175:0/1421905277 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675801b040 con 0x55a972b89240 2024-04-25T09:05:13.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f6764c00640 1 -- 172.21.15.175:0/1421905277 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6758024070 con 0x55a972b89240 2024-04-25T09:05:13.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f6764c00640 1 -- 172.21.15.175:0/1421905277 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758015ce0 con 0x55a972b89240 2024-04-25T09:05:13.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f677a198000 1 -- 172.21.15.175:0/1421905277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 msgr2=0x55a972b3e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f677a198000 1 --2- 172.21.15.175:0/1421905277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 0x55a972b3e9f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f675800eb40 tx=0x7f6758011000 comp rx=0 tx=0).stop 2024-04-25T09:05:13.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f677a198000 1 -- 172.21.15.175:0/1421905277 shutdown_connections 2024-04-25T09:05:13.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f677a198000 1 --2- 172.21.15.175:0/1421905277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b3ef30 0x55a972b3f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f677a198000 1 --2- 172.21.15.175:0/1421905277 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 0x55a972b3e9f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f677a198000 1 --2- 172.21.15.175:0/1421905277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b88920 0x55a972b88d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f677a198000 1 -- 172.21.15.175:0/1421905277 >> 172.21.15.175:0/1421905277 conn(0x55a972b452a0 msgr2=0x55a972b3d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:13.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f677a198000 1 -- 172.21.15.175:0/1421905277 shutdown_connections 2024-04-25T09:05:13.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f677a198000 1 -- 172.21.15.175:0/1421905277 wait complete. 2024-04-25T09:05:13.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f677a198000 1 -- start start 2024-04-25T09:05:13.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.114+0000 7f677a198000 1 Processor -- start 2024-04-25T09:05:13.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b3ef30 0x55a972b8fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b88920 0x55a972b90330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 0x55a972b42aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a972948990 con 0x55a972b89240 2024-04-25T09:05:13.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a972989e40 con 0x55a972b88920 2024-04-25T09:05:13.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a972919900 con 0x55a972b3ef30 2024-04-25T09:05:13.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 10 client.0 _ll_register_callbacks cb 0x55a972a411c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:13.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f6774c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 0x55a972b42aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f6774c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 0x55a972b42aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43606/0 (socket says 172.21.15.175:43606) 2024-04-25T09:05:13.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f6774c00640 1 -- 172.21.15.175:0/3011523163 learned_addr learned my addr 172.21.15.175:0/3011523163 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:13.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f6767400640 1 --2- 172.21.15.175:0/3011523163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b88920 0x55a972b90330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f676fe00640 1 --2- 172.21.15.175:0/3011523163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b3ef30 0x55a972b8fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f6774c00640 1 -- 172.21.15.175:0/3011523163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b3ef30 msgr2=0x55a972b8fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:13.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f6774c00640 1 --2- 172.21.15.175:0/3011523163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b3ef30 0x55a972b8fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f6774c00640 1 -- 172.21.15.175:0/3011523163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b88920 msgr2=0x55a972b90330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:13.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f6774c00640 1 --2- 172.21.15.175:0/3011523163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b88920 0x55a972b90330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f6774c00640 1 -- 172.21.15.175:0/3011523163 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a972946630 con 0x55a972b89240 2024-04-25T09:05:13.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f6767400640 1 --2- 172.21.15.175:0/3011523163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b88920 0x55a972b90330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:13.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f676fe00640 1 --2- 172.21.15.175:0/3011523163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b3ef30 0x55a972b8fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:13.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f6774c00640 1 --2- 172.21.15.175:0/3011523163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 0x55a972b42aa0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f67680115b0 tx=0x7f6768011a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f1cb461ced63ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:13.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f675d600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:05:13.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f675d600640 1 -- 172.21.15.175:0/3011523163 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768013670 con 0x55a972b89240 2024-04-25T09:05:13.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f675d600640 1 -- 172.21.15.175:0/3011523163 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6768013810 con 0x55a972b89240 2024-04-25T09:05:13.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 1 -- 172.21.15.175:0/3011523163 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6758024070 con 0x55a972b89240 2024-04-25T09:05:13.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f675d600640 1 -- 172.21.15.175:0/3011523163 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6768025050 con 0x55a972b89240 2024-04-25T09:05:13.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 10 client.5274 fetch_fsmap learned FSMap version 17 2024-04-25T09:05:13.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 1 -- 172.21.15.175:0/3011523163 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a9729163a0 con 0x55a972b89240 2024-04-25T09:05:13.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f675d600640 1 -- 172.21.15.175:0/3011523163 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6758024070 con 0x55a972b89240 2024-04-25T09:05:13.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f675d600640 1 -- 172.21.15.175:0/3011523163 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6768028020 con 0x55a972b89240 2024-04-25T09:05:13.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 10 client.5274 fetch_fsmap finished waiting for FSMap version 17 2024-04-25T09:05:13.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 10 client.5274 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:05:13.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 20 client.5274 populate_metadata read hostname 'smithi175' 2024-04-25T09:05:13.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 1 --2- 172.21.15.175:0/3011523163 >> [v2:172.21.15.175:6835/1909482114,v1:172.21.15.175:6837/1909482114] conn(0x55a972b44160 0x55a972b99e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 4 client.5274 mds_command: new command op to 5070 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:13.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 1 -- 172.21.15.175:0/3011523163 --> [v2:172.21.15.175:6835/1909482114,v1:172.21.15.175:6837/1909482114] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a972929a50 con 0x55a972b44160 2024-04-25T09:05:13.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f676fe00640 1 --2- 172.21.15.175:0/3011523163 >> [v2:172.21.15.175:6835/1909482114,v1:172.21.15.175:6837/1909482114] conn(0x55a972b44160 0x55a972b99e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f676fe00640 1 --2- 172.21.15.175:0/3011523163 >> [v2:172.21.15.175:6835/1909482114,v1:172.21.15.175:6837/1909482114] conn(0x55a972b44160 0x55a972b99e50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=777b44499d951c8c server_cookie=5fb7895016534b8d in_seq=0 out_seq=0 2024-04-25T09:05:13.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f675d600640 10 client.5274 ms_handle_connect on v2:172.21.15.175:6835/1909482114 2024-04-25T09:05:13.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f675d600640 1 -- 172.21.15.175:0/3011523163 <== mds.0 v2:172.21.15.175:6835/1909482114 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a972929a50 con 0x55a972b44160 2024-04-25T09:05:13.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f675d600640 10 client.5274 handle_command_reply: tid=0 2024-04-25T09:05:13.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 1 client.5274 shutdown 2024-04-25T09:05:13.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 1 -- 172.21.15.175:0/3011523163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 msgr2=0x55a972b42aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.118+0000 7f677a198000 1 --2- 172.21.15.175:0/3011523163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 0x55a972b42aa0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f67680115b0 tx=0x7f6768011a70 comp rx=0 tx=0).stop 2024-04-25T09:05:13.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.122+0000 7f677a198000 1 -- 172.21.15.175:0/3011523163 shutdown_connections 2024-04-25T09:05:13.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.122+0000 7f677a198000 1 --2- 172.21.15.175:0/3011523163 >> [v2:172.21.15.175:6835/1909482114,v1:172.21.15.175:6837/1909482114] conn(0x55a972b44160 0x55a972b99e50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.122+0000 7f677a198000 1 --2- 172.21.15.175:0/3011523163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 0x55a972b42aa0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.122+0000 7f677a198000 1 --2- 172.21.15.175:0/3011523163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b88920 0x55a972b90330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.122+0000 7f677a198000 1 --2- 172.21.15.175:0/3011523163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b3ef30 0x55a972b8fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.122+0000 7f677a198000 1 -- 172.21.15.175:0/3011523163 >> 172.21.15.175:0/3011523163 conn(0x55a972b452a0 msgr2=0x55a972b3d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:13.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.122+0000 7f675d600640 0 client.5274 ms_handle_reset on v2:172.21.15.175:6835/1909482114 2024-04-25T09:05:13.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.122+0000 7f677a198000 1 -- 172.21.15.175:0/3011523163 shutdown_connections 2024-04-25T09:05:13.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.122+0000 7f677a198000 1 -- 172.21.15.175:0/3011523163 wait complete. 2024-04-25T09:05:13.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.122+0000 7f677a198000 20 client.5274 trim_cache size 0 max 16384 2024-04-25T09:05:13.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.134+0000 7f677a198000 1 Processor -- start 2024-04-25T09:05:13.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.134+0000 7f677a198000 1 -- start start 2024-04-25T09:05:13.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f677a198000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b3ef30 0x55a972be3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f677a198000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b88920 0x55a972be4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f677a198000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 0x55a972be4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f677a198000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6770202410 con 0x55a972b89240 2024-04-25T09:05:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f677a198000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6770157870 con 0x55a972b3ef30 2024-04-25T09:05:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f677a198000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6770157e70 con 0x55a972b88920 2024-04-25T09:05:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f6774c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 0x55a972be4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f6774c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 0x55a972be4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43618/0 (socket says 172.21.15.175:43618) 2024-04-25T09:05:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f6774c00640 1 -- 172.21.15.175:0/639834298 learned_addr learned my addr 172.21.15.175:0/639834298 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f6767400640 1 --2- 172.21.15.175:0/639834298 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b88920 0x55a972be4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f676fe00640 1 --2- 172.21.15.175:0/639834298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b3ef30 0x55a972be3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f6774c00640 1 -- 172.21.15.175:0/639834298 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b88920 msgr2=0x55a972be4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f6774c00640 1 --2- 172.21.15.175:0/639834298 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b88920 0x55a972be4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f6774c00640 1 -- 172.21.15.175:0/639834298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b3ef30 msgr2=0x55a972be3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:13.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f6774c00640 1 --2- 172.21.15.175:0/639834298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b3ef30 0x55a972be3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f6774c00640 1 -- 172.21.15.175:0/639834298 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a972b89070 con 0x55a972b89240 2024-04-25T09:05:13.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f676fe00640 1 --2- 172.21.15.175:0/639834298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b3ef30 0x55a972be3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:13.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f6774c00640 1 --2- 172.21.15.175:0/639834298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 0x55a972be4960 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6768011ab0 tx=0x7f6768016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233b30dc791d9cad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:13.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f675fe00640 1 -- 172.21.15.175:0/639834298 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768013670 con 0x55a972b89240 2024-04-25T09:05:13.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f675fe00640 1 -- 172.21.15.175:0/639834298 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6768013830 con 0x55a972b89240 2024-04-25T09:05:13.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f675fe00640 1 -- 172.21.15.175:0/639834298 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6768004270 con 0x55a972b89240 2024-04-25T09:05:13.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f677a198000 1 -- 172.21.15.175:0/639834298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 msgr2=0x55a972be4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f677a198000 1 --2- 172.21.15.175:0/639834298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 0x55a972be4960 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6768011ab0 tx=0x7f6768016000 comp rx=0 tx=0).stop 2024-04-25T09:05:13.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f677a198000 1 -- 172.21.15.175:0/639834298 shutdown_connections 2024-04-25T09:05:13.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f677a198000 1 --2- 172.21.15.175:0/639834298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b89240 0x55a972be4960 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f677a198000 1 --2- 172.21.15.175:0/639834298 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b88920 0x55a972be4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f677a198000 1 --2- 172.21.15.175:0/639834298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b3ef30 0x55a972be3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f677a198000 1 -- 172.21.15.175:0/639834298 >> 172.21.15.175:0/639834298 conn(0x55a972b452a0 msgr2=0x55a972b42220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:13.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f677a198000 1 -- 172.21.15.175:0/639834298 shutdown_connections 2024-04-25T09:05:13.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f677a198000 1 -- 172.21.15.175:0/639834298 wait complete. 2024-04-25T09:05:13.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f677a198000 1 -- start start 2024-04-25T09:05:13.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.138+0000 7f677a198000 1 Processor -- start 2024-04-25T09:05:13.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b3ef30 0x55a972bea350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b88920 0x55a972bec8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b89240 0x55a972beedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9729923d0 con 0x55a972b3ef30 2024-04-25T09:05:13.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a972a49d50 con 0x55a972b88920 2024-04-25T09:05:13.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a972928980 con 0x55a972b89240 2024-04-25T09:05:13.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 10 client.0 _ll_register_callbacks cb 0x7f67580096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:13.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f676fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b3ef30 0x55a972bea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f676fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b3ef30 0x55a972bea350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43622/0 (socket says 172.21.15.175:43622) 2024-04-25T09:05:13.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f676fe00640 1 -- 172.21.15.175:0/672695807 learned_addr learned my addr 172.21.15.175:0/672695807 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:13.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f676fe00640 1 -- 172.21.15.175:0/672695807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b89240 msgr2=0x55a972beedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:13.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f676fe00640 1 --2- 172.21.15.175:0/672695807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b89240 0x55a972beedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f676fe00640 1 -- 172.21.15.175:0/672695807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b88920 msgr2=0x55a972bec8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:13.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f676fe00640 1 --2- 172.21.15.175:0/672695807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b88920 0x55a972bec8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f676fe00640 1 -- 172.21.15.175:0/672695807 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a972a0f600 con 0x55a972b3ef30 2024-04-25T09:05:13.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f676fe00640 1 --2- 172.21.15.175:0/672695807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b3ef30 0x55a972bea350 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6760098560 tx=0x7f6760120040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1467704fd45fbdb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:13.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f675d600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:05:13.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f675d600640 1 -- 172.21.15.175:0/672695807 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67600fe060 con 0x55a972b3ef30 2024-04-25T09:05:13.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f675d600640 1 -- 172.21.15.175:0/672695807 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67600f70b0 con 0x55a972b3ef30 2024-04-25T09:05:13.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 -- 172.21.15.175:0/672695807 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6768013830 con 0x55a972b3ef30 2024-04-25T09:05:13.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f675d600640 1 -- 172.21.15.175:0/672695807 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6760104050 con 0x55a972b3ef30 2024-04-25T09:05:13.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 10 client.5280 fetch_fsmap learned FSMap version 17 2024-04-25T09:05:13.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 -- 172.21.15.175:0/672695807 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a9729229b0 con 0x55a972b3ef30 2024-04-25T09:05:13.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f675d600640 1 -- 172.21.15.175:0/672695807 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6768013830 con 0x55a972b3ef30 2024-04-25T09:05:13.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f675d600640 1 -- 172.21.15.175:0/672695807 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f67600ed340 con 0x55a972b3ef30 2024-04-25T09:05:13.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 10 client.5280 fetch_fsmap finished waiting for FSMap version 17 2024-04-25T09:05:13.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 10 client.5280 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:05:13.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 20 client.5280 populate_metadata read hostname 'smithi175' 2024-04-25T09:05:13.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 --2- 172.21.15.175:0/672695807 >> [v2:172.21.15.175:6835/1909482114,v1:172.21.15.175:6837/1909482114] conn(0x55a972bef330 0x55a972bf1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 4 client.5280 mds_command: new command op to 5070 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:05:13.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 -- 172.21.15.175:0/672695807 --> [v2:172.21.15.175:6835/1909482114,v1:172.21.15.175:6837/1909482114] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a97299b2e0 con 0x55a972bef330 2024-04-25T09:05:13.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f6767400640 1 --2- 172.21.15.175:0/672695807 >> [v2:172.21.15.175:6835/1909482114,v1:172.21.15.175:6837/1909482114] conn(0x55a972bef330 0x55a972bf1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f675d600640 10 client.5280 ms_handle_connect on v2:172.21.15.175:6835/1909482114 2024-04-25T09:05:13.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f6767400640 1 --2- 172.21.15.175:0/672695807 >> [v2:172.21.15.175:6835/1909482114,v1:172.21.15.175:6837/1909482114] conn(0x55a972bef330 0x55a972bf1720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9302b9f5e3f50573 server_cookie=d523558d31018e85 in_seq=0 out_seq=0 2024-04-25T09:05:13.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f675d600640 1 -- 172.21.15.175:0/672695807 <== mds.0 v2:172.21.15.175:6835/1909482114 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55a97299b2e0 con 0x55a972bef330 2024-04-25T09:05:13.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f675d600640 10 client.5280 handle_command_reply: tid=0 2024-04-25T09:05:13.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 client.5280 shutdown 2024-04-25T09:05:13.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 -- 172.21.15.175:0/672695807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b3ef30 msgr2=0x55a972bea350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 --2- 172.21.15.175:0/672695807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b3ef30 0x55a972bea350 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6760098560 tx=0x7f6760120040 comp rx=0 tx=0).stop 2024-04-25T09:05:13.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 -- 172.21.15.175:0/672695807 shutdown_connections 2024-04-25T09:05:13.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 --2- 172.21.15.175:0/672695807 >> [v2:172.21.15.175:6835/1909482114,v1:172.21.15.175:6837/1909482114] conn(0x55a972bef330 0x55a972bf1720 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 --2- 172.21.15.175:0/672695807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a972b89240 0x55a972beedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 --2- 172.21.15.175:0/672695807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a972b88920 0x55a972bec8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f675d600640 0 client.5280 ms_handle_reset on v2:172.21.15.175:6835/1909482114 2024-04-25T09:05:13.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 --2- 172.21.15.175:0/672695807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a972b3ef30 0x55a972bea350 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 -- 172.21.15.175:0/672695807 >> 172.21.15.175:0/672695807 conn(0x55a972b452a0 msgr2=0x55a972b909b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:13.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 -- 172.21.15.175:0/672695807 shutdown_connections 2024-04-25T09:05:13.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 1 -- 172.21.15.175:0/672695807 wait complete. 2024-04-25T09:05:13.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f677a198000 20 client.5280 trim_cache size 0 max 16384 2024-04-25T09:05:13.141 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:05:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: "cluster_fsid": "8caed986-ca08-40e2-b5a5-12e2aade6223", 2024-04-25T09:05:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: "whoami": 0, 2024-04-25T09:05:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 5070, 2024-04-25T09:05:13.141 INFO:teuthology.orchestra.run.smithi175.stdout: "want_state": "up:active", 2024-04-25T09:05:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: "state": "up:active", 2024-04-25T09:05:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs", 2024-04-25T09:05:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: "rank_uptime": 10.318924639, 2024-04-25T09:05:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: "mdsmap_epoch": 17, 2024-04-25T09:05:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch": 32, 2024-04-25T09:05:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch_barrier": 32, 2024-04-25T09:05:13.142 INFO:teuthology.orchestra.run.smithi175.stdout: "uptime": 18.188435105 2024-04-25T09:05:13.142 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:05:13.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f6776c00640 1 -- 172.21.15.175:0/2097043568 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f674c066f60 msgr2=0x7f674c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f6776c00640 1 --2- 172.21.15.175:0/2097043568 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f674c066f60 0x7f674c069420 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6770153250 tx=0x7f6758009520 comp rx=0 tx=0).stop 2024-04-25T09:05:13.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f6776c00640 1 -- 172.21.15.175:0/2097043568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f677006ad50 msgr2=0x7f6770143230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f6776c00640 1 --2- 172.21.15.175:0/2097043568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f677006ad50 0x7f6770143230 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f67600af040 tx=0x7f6760019760 comp rx=0 tx=0).stop 2024-04-25T09:05:13.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f6776c00640 1 -- 172.21.15.175:0/2097043568 shutdown_connections 2024-04-25T09:05:13.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f6776c00640 1 --2- 172.21.15.175:0/2097043568 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f674c066f60 0x7f674c069420 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f6776c00640 1 --2- 172.21.15.175:0/2097043568 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67700cdb60 0x7f6770153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f6776c00640 1 --2- 172.21.15.175:0/2097043568 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f677006c080 0x7f67701535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f6776c00640 1 --2- 172.21.15.175:0/2097043568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f677006ad50 0x7f6770143230 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f6776c00640 1 -- 172.21.15.175:0/2097043568 >> 172.21.15.175:0/2097043568 conn(0x7f67700cca10 msgr2=0x7f67700afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:13.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.142+0000 7f6776c00640 1 -- 172.21.15.175:0/2097043568 shutdown_connections 2024-04-25T09:05:13.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.146+0000 7f6776c00640 1 -- 172.21.15.175:0/2097043568 wait complete. 2024-04-25T09:05:13.157 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:05:13.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.298+0000 7f727ee00640 1 Processor -- start 2024-04-25T09:05:13.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.298+0000 7f727ee00640 1 -- start start 2024-04-25T09:05:13.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.302+0000 7f727ee00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f727815a900 0x7f727806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.302+0000 7f727ee00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f72780cd520 0x7f72780ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.302+0000 7f727ee00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72780cf560 0x7f72780cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.302+0000 7f727ee00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72780cfef0 con 0x7f727815a900 2024-04-25T09:05:13.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.302+0000 7f727ee00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72780cda00 con 0x7f72780cd520 2024-04-25T09:05:13.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.302+0000 7f727ee00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72780cdce0 con 0x7f72780cf560 2024-04-25T09:05:13.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.302+0000 7f7277e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f727815a900 0x7f727806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.302+0000 7f7277e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f727815a900 0x7f727806e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43628/0 (socket says 172.21.15.175:43628) 2024-04-25T09:05:13.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.302+0000 7f7277e00640 1 -- 172.21.15.175:0/800641651 learned_addr learned my addr 172.21.15.175:0/800641651 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:13.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.302+0000 7f727ce00640 1 --2- 172.21.15.175:0/800641651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72780cf560 0x7f72780cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.302+0000 7f726f400640 1 --2- 172.21.15.175:0/800641651 >> v2:172.21.15.177:3300/0 conn(0x7f72780cd520 0x7f72780ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.302+0000 7f7277e00640 1 -- 172.21.15.175:0/800641651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72780cf560 msgr2=0x7f72780cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:13.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.302+0000 7f7277e00640 1 --2- 172.21.15.175:0/800641651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72780cf560 0x7f72780cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.302+0000 7f7277e00640 1 -- 172.21.15.175:0/800641651 >> v2:172.21.15.177:3300/0 conn(0x7f72780cd520 msgr2=0x7f72780ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:13.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.302+0000 7f7277e00640 1 --2- 172.21.15.175:0/800641651 >> v2:172.21.15.177:3300/0 conn(0x7f72780cd520 0x7f72780ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.302+0000 7f7277e00640 1 -- 172.21.15.175:0/800641651 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72780cdfc0 con 0x7f727815a900 2024-04-25T09:05:13.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f7277e00640 1 --2- 172.21.15.175:0/800641651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f727815a900 0x7f727806e150 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f72780cf510 tx=0x7f726801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62010460d98a522a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:13.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f7277400640 1 -- 172.21.15.175:0/800641651 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72680aa610 con 0x7f727815a900 2024-04-25T09:05:13.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f7277400640 1 -- 172.21.15.175:0/800641651 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72680af070 con 0x7f727815a900 2024-04-25T09:05:13.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f7277400640 1 -- 172.21.15.175:0/800641651 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72680aa9d0 con 0x7f727815a900 2024-04-25T09:05:13.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f727ee00640 1 -- 172.21.15.175:0/800641651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f727815a900 msgr2=0x7f727806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f727ee00640 1 --2- 172.21.15.175:0/800641651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f727815a900 0x7f727806e150 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f72780cf510 tx=0x7f726801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f727ee00640 1 -- 172.21.15.175:0/800641651 shutdown_connections 2024-04-25T09:05:13.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f727ee00640 1 --2- 172.21.15.175:0/800641651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72780cf560 0x7f72780cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f727ee00640 1 --2- 172.21.15.175:0/800641651 >> v2:172.21.15.177:3300/0 conn(0x7f72780cd520 0x7f72780ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f727ee00640 1 --2- 172.21.15.175:0/800641651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f727815a900 0x7f727806e150 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f727ee00640 1 -- 172.21.15.175:0/800641651 >> 172.21.15.175:0/800641651 conn(0x7f7278067150 msgr2=0x7f727806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:13.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f727ee00640 1 -- 172.21.15.175:0/800641651 shutdown_connections 2024-04-25T09:05:13.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f727ee00640 1 -- 172.21.15.175:0/800641651 wait complete. 2024-04-25T09:05:13.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f727ee00640 1 Processor -- start 2024-04-25T09:05:13.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f727ee00640 1 -- start start 2024-04-25T09:05:13.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f727ee00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72780cf560 0x7f7278150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f727ee00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f727815a900 0x7f72780af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f727ee00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72781f63f0 0x7f72780b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f727ee00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727806d530 con 0x7f72781f63f0 2024-04-25T09:05:13.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f727ee00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727806d3b0 con 0x7f72780cf560 2024-04-25T09:05:13.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.306+0000 7f727ee00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727815c790 con 0x7f727815a900 2024-04-25T09:05:13.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f727ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72781f63f0 0x7f72780b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f726f400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f727815a900 0x7f72780af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f727ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72781f63f0 0x7f72780b0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43638/0 (socket says 172.21.15.175:43638) 2024-04-25T09:05:13.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f7277e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72780cf560 0x7f7278150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f727ce00640 1 -- 172.21.15.175:0/2433069798 learned_addr learned my addr 172.21.15.175:0/2433069798 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:13.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f727ce00640 1 -- 172.21.15.175:0/2433069798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f727815a900 msgr2=0x7f72780af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f727ce00640 1 --2- 172.21.15.175:0/2433069798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f727815a900 0x7f72780af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f727ce00640 1 -- 172.21.15.175:0/2433069798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72780cf560 msgr2=0x7f7278150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f727ce00640 1 --2- 172.21.15.175:0/2433069798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72780cf560 0x7f7278150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f727ce00640 1 -- 172.21.15.175:0/2433069798 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7278157910 con 0x7f72781f63f0 2024-04-25T09:05:13.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f727ce00640 1 --2- 172.21.15.175:0/2433069798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72781f63f0 0x7f72780b0f10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7270007e70 tx=0x7f727000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:13.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f7274c00640 1 -- 172.21.15.175:0/2433069798 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270014620 con 0x7f72781f63f0 2024-04-25T09:05:13.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f7274c00640 1 -- 172.21.15.175:0/2433069798 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7270019070 con 0x7f72781f63f0 2024-04-25T09:05:13.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f727ee00640 1 -- 172.21.15.175:0/2433069798 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7278157bf0 con 0x7f72781f63f0 2024-04-25T09:05:13.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f7274c00640 1 -- 172.21.15.175:0/2433069798 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270014a20 con 0x7f72781f63f0 2024-04-25T09:05:13.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f727ee00640 1 -- 172.21.15.175:0/2433069798 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72781581b0 con 0x7f72781f63f0 2024-04-25T09:05:13.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f727ee00640 1 -- 172.21.15.175:0/2433069798 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72781583b0 con 0x7f72781f63f0 2024-04-25T09:05:13.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f7274c00640 1 -- 172.21.15.175:0/2433069798 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7270014bc0 con 0x7f72781f63f0 2024-04-25T09:05:13.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f7274c00640 1 --2- 172.21.15.175:0/2433069798 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7254066f90 0x7f7254069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:13.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.310+0000 7f7274c00640 1 -- 172.21.15.175:0/2433069798 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7270085730 con 0x7f72781f63f0 2024-04-25T09:05:13.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.314+0000 7f7277e00640 1 --2- 172.21.15.175:0/2433069798 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7254066f90 0x7f7254069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:13.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.314+0000 7f7277e00640 1 --2- 172.21.15.175:0/2433069798 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7254066f90 0x7f7254069450 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f72680ae000 tx=0x7f72680a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:13.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.318+0000 7f7274c00640 1 -- 172.21.15.175:0/2433069798 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f72781583b0 con 0x7f72781f63f0 2024-04-25T09:05:13.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.506+0000 7f727ee00640 1 -- 172.21.15.175:0/2433069798 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7278074a60 con 0x7f72781f63f0 2024-04-25T09:05:13.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.506+0000 7f7274c00640 1 -- 172.21.15.175:0/2433069798 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f72700560e0 con 0x7f72781f63f0 2024-04-25T09:05:13.501 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:05:13.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.510+0000 7f727ee00640 1 -- 172.21.15.175:0/2433069798 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7254066f90 msgr2=0x7f7254069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.510+0000 7f727ee00640 1 --2- 172.21.15.175:0/2433069798 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7254066f90 0x7f7254069450 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f72680ae000 tx=0x7f72680a7000 comp rx=0 tx=0).stop 2024-04-25T09:05:13.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.510+0000 7f727ee00640 1 -- 172.21.15.175:0/2433069798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72781f63f0 msgr2=0x7f72780b0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:13.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.510+0000 7f727ee00640 1 --2- 172.21.15.175:0/2433069798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72781f63f0 0x7f72780b0f10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7270007e70 tx=0x7f727000e4b0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.510+0000 7f727ee00640 1 -- 172.21.15.175:0/2433069798 shutdown_connections 2024-04-25T09:05:13.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.510+0000 7f727ee00640 1 --2- 172.21.15.175:0/2433069798 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7254066f90 0x7f7254069450 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.510+0000 7f727ee00640 1 --2- 172.21.15.175:0/2433069798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72781f63f0 0x7f72780b0f10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.510+0000 7f727ee00640 1 --2- 172.21.15.175:0/2433069798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f727815a900 0x7f72780af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.510+0000 7f727ee00640 1 --2- 172.21.15.175:0/2433069798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72780cf560 0x7f7278150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:13.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.510+0000 7f727ee00640 1 -- 172.21.15.175:0/2433069798 >> 172.21.15.175:0/2433069798 conn(0x7f72780cd520 msgr2=0x7f72780b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:13.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.510+0000 7f727ee00640 1 -- 172.21.15.175:0/2433069798 shutdown_connections 2024-04-25T09:05:13.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:13.510+0000 7f727ee00640 1 -- 172.21.15.175:0/2433069798 wait complete. 2024-04-25T09:05:13.522 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:05:13.522 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:05:13.522 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-25T09:05:13.522 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:05:13.522 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:05:13.522 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:05:13.522 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:05:13.522 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:05:13.522 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:05:13.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:13.523 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-25T09:05:13.532 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:05:13.532 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:05:13.532 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:05:13.532 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:13.532 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:05:13.532 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:13.532 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:05:13.532 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-25T09:05:13.532 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-25T09:05:13.532 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:05:13.532 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-25T09:05:13.533 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-25T09:05:13.533 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:05:13.533 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:05:13.533 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:05:13.533 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:05:13.533 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:05:13.533 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42405sec preferred_lft 42405sec 2024-04-25T09:05:13.533 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-25T09:05:13.533 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:13.533 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:05:13.533 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:0d:71:4a:a6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:05:13.533 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:05:13.533 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:13.533 INFO:teuthology.orchestra.run.smithi175.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:05:13.534 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:05:13.534 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:05:13.534 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:13.534 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:05:13.534 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:13.534 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:05:13.534 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:05:13.534 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:05:13.534 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:13.534 INFO:teuthology.orchestra.run.smithi175.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:05:13.534 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:05:13.534 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:05:13.534 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:13.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:13.535 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:05:13.594 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:05:13.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:13.596 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-25T09:05:13.652 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-25T09:05:13.652 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:05:13.652 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:05:13.652 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:05:13.652 INFO:teuthology.orchestra.run.smithi175.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:05:13.652 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:05:13.652 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:05:13.652 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:05:13.653 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:05:13.653 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:05:13.653 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:05:13.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:13.653 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:05:13.653 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:05:13.653 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:05:13.653 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:05:13.653 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:05:13.653 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:05:13.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:13.742 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:05:13.750 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:05:13.750 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:05:13.751 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:05:13.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:13.751 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-25T09:05:13.815 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:05:13.815 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:05:13.869 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:05:13.869 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:05:13.869 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:05:13.924 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:05:13.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:13.925 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:05:14.016 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:05:14.016 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:05:14.016 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:05:14.031 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:05:14.031 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:05:14.031 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:05:14.031 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:05:14.031 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:05:14.039 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:05:14.039 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:05:14.039 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:05:14.040 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:05:14.040 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:05:14.040 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:05:14.040 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:05:14.040 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:05:14.043 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:05:14.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:14.044 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:05:14.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:14.063 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:05:14.120 INFO:teuthology.orchestra.run.smithi175.stdout:client5149 2024-04-25T09:05:14.120 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:05:14.120 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:14.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:14.173 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2024-04-25T09:05:14.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:14.231 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2024-04-25T09:05:14.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:14.283 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2024-04-25T09:05:14.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:14.335 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2024-04-25T09:05:14.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:14.390 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2024-04-25T09:05:14.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:14.442 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T09:05:14.498 INFO:teuthology.orchestra.run.smithi175.stdout:./ 2024-04-25T09:05:14.499 INFO:teuthology.orchestra.run.smithi175.stdout:./rfile 2024-04-25T09:05:14.499 INFO:teuthology.orchestra.run.smithi175.stdout:./parentdir 2024-04-25T09:05:14.499 INFO:teuthology.orchestra.run.smithi175.stdout:./parentdir/pfile 2024-04-25T09:05:14.499 INFO:teuthology.orchestra.run.smithi175.stdout:./parentdir/childdir 2024-04-25T09:05:14.499 INFO:teuthology.orchestra.run.smithi175.stdout:./parentdir/childdir/cfile 2024-04-25T09:05:14.501 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:05:14.501 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:05:14.501 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:05:14.501 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:05:14.501 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T09:05:14.501 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:05:14.608 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:05:14.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:05:14.617 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:05:14.617 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:05:14.618 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:05:14.618 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:05:14.618 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2024-04-25T09:05:14.618 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:05:14.724 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627778 2024-04-25T09:05:14.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:05:14.733 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:05:14.733 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:05:14.733 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:05:14.733 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:05:14.733 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2024-04-25T09:05:14.733 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:05:14.846 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627776 2024-04-25T09:05:14.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:05:14.854 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:05:14.854 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:05:14.854 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:05:14.854 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:05:14.854 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2024-04-25T09:05:14.854 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:05:14.965 INFO:teuthology.orchestra.run.smithi175.stdout:1099511628279 2024-04-25T09:05:14.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:05:14.974 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:05:14.974 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:05:14.974 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:05:14.974 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:05:14.974 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2024-04-25T09:05:14.974 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:05:15.084 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627777 2024-04-25T09:05:15.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:05:15.093 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:05:15.093 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:05:15.093 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:05:15.093 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:05:15.093 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2024-04-25T09:05:15.093 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:05:15.199 INFO:teuthology.orchestra.run.smithi175.stdout:1099511628280 2024-04-25T09:05:15.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:05:15.209 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:05:15.209 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:15.261 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:05:15.261 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:15.312 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:15.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.502+0000 7fe2e8400640 1 Processor -- start 2024-04-25T09:05:15.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.502+0000 7fe2e8400640 1 -- start start 2024-04-25T09:05:15.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.502+0000 7fe2e8400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe2e015dac0 0x7fe2e00d3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.502+0000 7fe2e8400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe2e00b9570 0x7fe2e00d1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.502+0000 7fe2e8400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2e00b5460 0x7fe2e00b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.502+0000 7fe2e8400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e00b5e10 con 0x7fe2e00b9570 2024-04-25T09:05:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.502+0000 7fe2e8400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e00b99e0 con 0x7fe2e015dac0 2024-04-25T09:05:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.502+0000 7fe2e8400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00d3000 con 0x7fe2e00b5460 2024-04-25T09:05:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.502+0000 7fe2e5000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe2e00b9570 0x7fe2e00d1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.502+0000 7fe2e5000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe2e00b9570 0x7fe2e00d1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43652/0 (socket says 172.21.15.175:43652) 2024-04-25T09:05:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.502+0000 7fe2e5000640 1 -- 172.21.15.175:0/3252321136 learned_addr learned my addr 172.21.15.175:0/3252321136 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.502+0000 7fe2e5000640 1 -- 172.21.15.175:0/3252321136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2e00b5460 msgr2=0x7fe2e00b58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.502+0000 7fe2e5000640 1 --2- 172.21.15.175:0/3252321136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2e00b5460 0x7fe2e00b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.502+0000 7fe2e5000640 1 -- 172.21.15.175:0/3252321136 >> v2:172.21.15.177:3300/0 conn(0x7fe2e015dac0 msgr2=0x7fe2e00d3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.502+0000 7fe2e5000640 1 --2- 172.21.15.175:0/3252321136 >> v2:172.21.15.177:3300/0 conn(0x7fe2e015dac0 0x7fe2e00d3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.502+0000 7fe2e5000640 1 -- 172.21.15.175:0/3252321136 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e00d23f0 con 0x7fe2e00b9570 2024-04-25T09:05:15.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.506+0000 7fe2e5000640 1 --2- 172.21.15.175:0/3252321136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2e00b9570 0x7fe2e00d1ce0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe2e006d1e0 tx=0x7fe2cc01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd9837e9b2ac067 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:15.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.506+0000 7fe2dfe00640 1 -- 172.21.15.175:0/3252321136 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc0b5070 con 0x7fe2e00b9570 2024-04-25T09:05:15.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.506+0000 7fe2dfe00640 1 -- 172.21.15.175:0/3252321136 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc0a89d0 con 0x7fe2e00b9570 2024-04-25T09:05:15.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.506+0000 7fe2dfe00640 1 -- 172.21.15.175:0/3252321136 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc0a8da0 con 0x7fe2e00b9570 2024-04-25T09:05:15.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.506+0000 7fe2e8400640 1 -- 172.21.15.175:0/3252321136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2e00b9570 msgr2=0x7fe2e00d1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.506+0000 7fe2e8400640 1 --2- 172.21.15.175:0/3252321136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2e00b9570 0x7fe2e00d1ce0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe2e006d1e0 tx=0x7fe2cc01ed10 comp rx=0 tx=0).stop 2024-04-25T09:05:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.506+0000 7fe2e8400640 1 -- 172.21.15.175:0/3252321136 shutdown_connections 2024-04-25T09:05:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.506+0000 7fe2e8400640 1 --2- 172.21.15.175:0/3252321136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2e00b5460 0x7fe2e00b58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.506+0000 7fe2e8400640 1 --2- 172.21.15.175:0/3252321136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2e00b9570 0x7fe2e00d1ce0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.506+0000 7fe2e8400640 1 --2- 172.21.15.175:0/3252321136 >> v2:172.21.15.177:3300/0 conn(0x7fe2e015dac0 0x7fe2e00d3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.506+0000 7fe2e8400640 1 -- 172.21.15.175:0/3252321136 >> 172.21.15.175:0/3252321136 conn(0x7fe2e0072980 msgr2=0x7fe2e00d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.506+0000 7fe2e8400640 1 -- 172.21.15.175:0/3252321136 shutdown_connections 2024-04-25T09:05:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.506+0000 7fe2e8400640 1 -- 172.21.15.175:0/3252321136 wait complete. 2024-04-25T09:05:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e8400640 1 Processor -- start 2024-04-25T09:05:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e8400640 1 -- start start 2024-04-25T09:05:15.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e8400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2e00b5460 0x7fe2e015f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e8400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2e00b9570 0x7fe2e0157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e8400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2e015dac0 0x7fe2e00cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e8400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00d2c90 con 0x7fe2e015dac0 2024-04-25T09:05:15.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e8400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00d29b0 con 0x7fe2e00b9570 2024-04-25T09:05:15.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e8400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e015dea0 con 0x7fe2e00b5460 2024-04-25T09:05:15.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e6400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2e015dac0 0x7fe2e00cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e6400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2e015dac0 0x7fe2e00cd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43666/0 (socket says 172.21.15.175:43666) 2024-04-25T09:05:15.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e6400640 1 -- 172.21.15.175:0/3301408090 learned_addr learned my addr 172.21.15.175:0/3301408090 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:15.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e5000640 1 --2- 172.21.15.175:0/3301408090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2e00b9570 0x7fe2e0157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e5a00640 1 --2- 172.21.15.175:0/3301408090 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2e00b5460 0x7fe2e015f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e6400640 1 -- 172.21.15.175:0/3301408090 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2e00b5460 msgr2=0x7fe2e015f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e6400640 1 --2- 172.21.15.175:0/3301408090 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2e00b5460 0x7fe2e015f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e6400640 1 -- 172.21.15.175:0/3301408090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2e00b9570 msgr2=0x7fe2e0157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e6400640 1 --2- 172.21.15.175:0/3301408090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2e00b9570 0x7fe2e0157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e6400640 1 -- 172.21.15.175:0/3301408090 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e015ba00 con 0x7fe2e015dac0 2024-04-25T09:05:15.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e5000640 1 --2- 172.21.15.175:0/3301408090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2e00b9570 0x7fe2e0157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e5a00640 1 --2- 172.21.15.175:0/3301408090 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2e00b5460 0x7fe2e015f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e6400640 1 --2- 172.21.15.175:0/3301408090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2e015dac0 0x7fe2e00cd210 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800b970 tx=0x7fe2d800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2dd600640 1 -- 172.21.15.175:0/3301408090 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8019070 con 0x7fe2e015dac0 2024-04-25T09:05:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2dd600640 1 -- 172.21.15.175:0/3301408090 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d800cb60 con 0x7fe2e015dac0 2024-04-25T09:05:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2dd600640 1 -- 172.21.15.175:0/3301408090 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8014440 con 0x7fe2e015dac0 2024-04-25T09:05:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e8400640 1 -- 172.21.15.175:0/3301408090 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e015bce0 con 0x7fe2e015dac0 2024-04-25T09:05:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e8400640 1 -- 172.21.15.175:0/3301408090 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e015eea0 con 0x7fe2e015dac0 2024-04-25T09:05:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.510+0000 7fe2e8400640 1 -- 172.21.15.175:0/3301408090 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e0074a60 con 0x7fe2e015dac0 2024-04-25T09:05:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.514+0000 7fe2dd600640 1 -- 172.21.15.175:0/3301408090 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe2d801c070 con 0x7fe2e015dac0 2024-04-25T09:05:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.514+0000 7fe2dd600640 1 --2- 172.21.15.175:0/3301408090 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe2c0066f60 0x7fe2c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.514+0000 7fe2dd600640 1 -- 172.21.15.175:0/3301408090 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2d8084d90 con 0x7fe2e015dac0 2024-04-25T09:05:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.514+0000 7fe2e5a00640 1 --2- 172.21.15.175:0/3301408090 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe2c0066f60 0x7fe2c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.514+0000 7fe2e5a00640 1 --2- 172.21.15.175:0/3301408090 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe2c0066f60 0x7fe2c0069420 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400a870 tx=0x7fe2d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:15.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.518+0000 7fe2dd600640 1 -- 172.21.15.175:0/3301408090 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe2d8055da0 con 0x7fe2e015dac0 2024-04-25T09:05:15.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.674+0000 7fe2e8400640 1 -- 172.21.15.175:0/3301408090 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2e00d4410 con 0x7fe2e015dac0 2024-04-25T09:05:15.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.674+0000 7fe2dd600640 1 -- 172.21.15.175:0/3301408090 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16705 (secure 0 0 0) 0x7fe2d80556a0 con 0x7fe2e015dac0 2024-04-25T09:05:15.668 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:15.669 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":32,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:05:03.828685+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:59.880776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:01.208198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:15.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.678+0000 7fe2e8400640 1 -- 172.21.15.175:0/3301408090 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe2c0066f60 msgr2=0x7fe2c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.678+0000 7fe2e8400640 1 --2- 172.21.15.175:0/3301408090 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe2c0066f60 0x7fe2c0069420 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe2d400a870 tx=0x7fe2d4008040 comp rx=0 tx=0).stop 2024-04-25T09:05:15.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.678+0000 7fe2e8400640 1 -- 172.21.15.175:0/3301408090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2e015dac0 msgr2=0x7fe2e00cd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.678+0000 7fe2e8400640 1 --2- 172.21.15.175:0/3301408090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2e015dac0 0x7fe2e00cd210 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800b970 tx=0x7fe2d800be30 comp rx=0 tx=0).stop 2024-04-25T09:05:15.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.678+0000 7fe2e8400640 1 -- 172.21.15.175:0/3301408090 shutdown_connections 2024-04-25T09:05:15.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.678+0000 7fe2e8400640 1 --2- 172.21.15.175:0/3301408090 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe2c0066f60 0x7fe2c0069420 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.678+0000 7fe2e8400640 1 --2- 172.21.15.175:0/3301408090 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2e015dac0 0x7fe2e00cd210 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.678+0000 7fe2e8400640 1 --2- 172.21.15.175:0/3301408090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2e00b9570 0x7fe2e0157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.678+0000 7fe2e8400640 1 --2- 172.21.15.175:0/3301408090 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2e00b5460 0x7fe2e015f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.678+0000 7fe2e8400640 1 -- 172.21.15.175:0/3301408090 >> 172.21.15.175:0/3301408090 conn(0x7fe2e0072980 msgr2=0x7fe2e00b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:15.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.678+0000 7fe2e8400640 1 -- 172.21.15.175:0/3301408090 shutdown_connections 2024-04-25T09:05:15.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.678+0000 7fe2e8400640 1 -- 172.21.15.175:0/3301408090 wait complete. 2024-04-25T09:05:15.690 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:59.880776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:05:01.208198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:05:15.690 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:05:15.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.834+0000 7f8b21200640 1 Processor -- start 2024-04-25T09:05:15.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.834+0000 7f8b21200640 1 -- start start 2024-04-25T09:05:15.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.838+0000 7f8b21200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8b1c15ba40 0x7f8b1c0b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.838+0000 7f8b21200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b1c0cca80 0x7f8b1c0ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.838+0000 7f8b21200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8b1c0b74c0 0x7f8b1c0ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.838+0000 7f8b21200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1c15f5f0 con 0x7f8b1c15ba40 2024-04-25T09:05:15.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.838+0000 7f8b21200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1c160170 con 0x7f8b1c0b74c0 2024-04-25T09:05:15.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.838+0000 7f8b21200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c0cebb0 con 0x7f8b1c0cca80 2024-04-25T09:05:15.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.838+0000 7f8b19e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8b1c15ba40 0x7f8b1c0b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.838+0000 7f8b19e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8b1c15ba40 0x7f8b1c0b6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43682/0 (socket says 172.21.15.175:43682) 2024-04-25T09:05:15.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.838+0000 7f8b19e00640 1 -- 172.21.15.175:0/494571874 learned_addr learned my addr 172.21.15.175:0/494571874 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:15.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.838+0000 7f8b11400640 1 --2- 172.21.15.175:0/494571874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b1c0cca80 0x7f8b1c0ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.838+0000 7f8b1a800640 1 --2- 172.21.15.175:0/494571874 >> v2:172.21.15.177:3300/0 conn(0x7f8b1c0b74c0 0x7f8b1c0ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.838+0000 7f8b19e00640 1 -- 172.21.15.175:0/494571874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b1c0cca80 msgr2=0x7f8b1c0ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:15.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.838+0000 7f8b19e00640 1 --2- 172.21.15.175:0/494571874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b1c0cca80 0x7f8b1c0ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.838+0000 7f8b19e00640 1 -- 172.21.15.175:0/494571874 >> v2:172.21.15.177:3300/0 conn(0x7f8b1c0b74c0 msgr2=0x7f8b1c0ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:15.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.838+0000 7f8b19e00640 1 --2- 172.21.15.175:0/494571874 >> v2:172.21.15.177:3300/0 conn(0x7f8b1c0b74c0 0x7f8b1c0ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.838+0000 7f8b19e00640 1 -- 172.21.15.175:0/494571874 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c15f840 con 0x7f8b1c15ba40 2024-04-25T09:05:15.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b19e00640 1 --2- 172.21.15.175:0/494571874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1c15ba40 0x7f8b1c0b6f80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0ced30 tx=0x7f8b0c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87726c36b47581bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:15.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b19400640 1 -- 172.21.15.175:0/494571874 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0a5760 con 0x7f8b1c15ba40 2024-04-25T09:05:15.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b19400640 1 -- 172.21.15.175:0/494571874 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c0a5900 con 0x7f8b1c15ba40 2024-04-25T09:05:15.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b19400640 1 -- 172.21.15.175:0/494571874 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0a5cd0 con 0x7f8b1c15ba40 2024-04-25T09:05:15.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b21200640 1 -- 172.21.15.175:0/494571874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1c15ba40 msgr2=0x7f8b1c0b6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b21200640 1 --2- 172.21.15.175:0/494571874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1c15ba40 0x7f8b1c0b6f80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0ced30 tx=0x7f8b0c01c9f0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b21200640 1 -- 172.21.15.175:0/494571874 shutdown_connections 2024-04-25T09:05:15.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b21200640 1 --2- 172.21.15.175:0/494571874 >> v2:172.21.15.177:3300/0 conn(0x7f8b1c0b74c0 0x7f8b1c0ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b21200640 1 --2- 172.21.15.175:0/494571874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b1c0cca80 0x7f8b1c0ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b21200640 1 --2- 172.21.15.175:0/494571874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1c15ba40 0x7f8b1c0b6f80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b21200640 1 -- 172.21.15.175:0/494571874 >> 172.21.15.175:0/494571874 conn(0x7f8b1c06f550 msgr2=0x7f8b1c06f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:15.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b21200640 1 -- 172.21.15.175:0/494571874 shutdown_connections 2024-04-25T09:05:15.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b21200640 1 -- 172.21.15.175:0/494571874 wait complete. 2024-04-25T09:05:15.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b21200640 1 Processor -- start 2024-04-25T09:05:15.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b21200640 1 -- start start 2024-04-25T09:05:15.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b21200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1c0b74c0 0x7f8b1c0c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b21200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b1c0cca80 0x7f8b1c15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b21200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b1c15ba40 0x7f8b1c153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b21200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c0b3d10 con 0x7f8b1c0b74c0 2024-04-25T09:05:15.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b21200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c0b3b90 con 0x7f8b1c0cca80 2024-04-25T09:05:15.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b21200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c0b3e90 con 0x7f8b1c15ba40 2024-04-25T09:05:15.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b19e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1c0b74c0 0x7f8b1c0c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b19e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1c0b74c0 0x7f8b1c0c66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43684/0 (socket says 172.21.15.175:43684) 2024-04-25T09:05:15.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.842+0000 7f8b19e00640 1 -- 172.21.15.175:0/3058757103 learned_addr learned my addr 172.21.15.175:0/3058757103 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:15.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b1a800640 1 --2- 172.21.15.175:0/3058757103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b1c15ba40 0x7f8b1c153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b11400640 1 --2- 172.21.15.175:0/3058757103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b1c0cca80 0x7f8b1c15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b19e00640 1 -- 172.21.15.175:0/3058757103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b1c15ba40 msgr2=0x7f8b1c153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b19e00640 1 --2- 172.21.15.175:0/3058757103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b1c15ba40 0x7f8b1c153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b19e00640 1 -- 172.21.15.175:0/3058757103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b1c0cca80 msgr2=0x7f8b1c15a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b19e00640 1 --2- 172.21.15.175:0/3058757103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b1c0cca80 0x7f8b1c15a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b19e00640 1 -- 172.21.15.175:0/3058757103 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c15d6f0 con 0x7f8b1c0b74c0 2024-04-25T09:05:15.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b1a800640 1 --2- 172.21.15.175:0/3058757103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b1c15ba40 0x7f8b1c153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:15.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b19e00640 1 --2- 172.21.15.175:0/3058757103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1c0b74c0 0x7f8b1c0c66e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c01d290 tx=0x7f8b0c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:15.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b12a00640 1 -- 172.21.15.175:0/3058757103 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0b8670 con 0x7f8b1c0b74c0 2024-04-25T09:05:15.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b12a00640 1 -- 172.21.15.175:0/3058757103 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c0be070 con 0x7f8b1c0b74c0 2024-04-25T09:05:15.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b21200640 1 -- 172.21.15.175:0/3058757103 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1c155ca0 con 0x7f8b1c0b74c0 2024-04-25T09:05:15.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b12a00640 1 -- 172.21.15.175:0/3058757103 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0b8a90 con 0x7f8b1c0b74c0 2024-04-25T09:05:15.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b21200640 1 -- 172.21.15.175:0/3058757103 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1c156260 con 0x7f8b1c0b74c0 2024-04-25T09:05:15.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b21200640 1 -- 172.21.15.175:0/3058757103 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b1c075160 con 0x7f8b1c0b74c0 2024-04-25T09:05:15.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b12a00640 1 -- 172.21.15.175:0/3058757103 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8b0c0b8c30 con 0x7f8b1c0b74c0 2024-04-25T09:05:15.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b12a00640 1 --2- 172.21.15.175:0/3058757103 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8af8066f60 0x7f8af8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b12a00640 1 -- 172.21.15.175:0/3058757103 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b0c120290 con 0x7f8b1c0b74c0 2024-04-25T09:05:15.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.846+0000 7f8b11400640 1 --2- 172.21.15.175:0/3058757103 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8af8066f60 0x7f8af8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.850+0000 7f8b11400640 1 --2- 172.21.15.175:0/3058757103 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8af8066f60 0x7f8af8069420 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c155450 tx=0x7f8b04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:15.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:15.850+0000 7f8b12a00640 1 -- 172.21.15.175:0/3058757103 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8b0c0165e0 con 0x7f8b1c0b74c0 2024-04-25T09:05:16.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.010+0000 7f8b21200640 1 -- 172.21.15.175:0/3058757103 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b1c15f060 con 0x7f8b1c0b74c0 2024-04-25T09:05:16.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.010+0000 7f8b12a00640 1 -- 172.21.15.175:0/3058757103 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b0c0f1200 con 0x7f8b1c0b74c0 2024-04-25T09:05:16.003 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:05:16.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.010+0000 7f8b21200640 1 -- 172.21.15.175:0/3058757103 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8af8066f60 msgr2=0x7f8af8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.010+0000 7f8b21200640 1 --2- 172.21.15.175:0/3058757103 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8af8066f60 0x7f8af8069420 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c155450 tx=0x7f8b04008040 comp rx=0 tx=0).stop 2024-04-25T09:05:16.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.010+0000 7f8b21200640 1 -- 172.21.15.175:0/3058757103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1c0b74c0 msgr2=0x7f8b1c0c66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.010+0000 7f8b21200640 1 --2- 172.21.15.175:0/3058757103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1c0b74c0 0x7f8b1c0c66e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c01d290 tx=0x7f8b0c019790 comp rx=0 tx=0).stop 2024-04-25T09:05:16.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.010+0000 7f8b21200640 1 -- 172.21.15.175:0/3058757103 shutdown_connections 2024-04-25T09:05:16.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.010+0000 7f8b21200640 1 --2- 172.21.15.175:0/3058757103 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8af8066f60 0x7f8af8069420 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.010+0000 7f8b21200640 1 --2- 172.21.15.175:0/3058757103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b1c15ba40 0x7f8b1c153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.010+0000 7f8b21200640 1 --2- 172.21.15.175:0/3058757103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b1c0cca80 0x7f8b1c15a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.010+0000 7f8b21200640 1 --2- 172.21.15.175:0/3058757103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1c0b74c0 0x7f8b1c0c66e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.010+0000 7f8b21200640 1 -- 172.21.15.175:0/3058757103 >> 172.21.15.175:0/3058757103 conn(0x7f8b1c06f550 msgr2=0x7f8b1c1584f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.010+0000 7f8b21200640 1 -- 172.21.15.175:0/3058757103 shutdown_connections 2024-04-25T09:05:16.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.010+0000 7f8b21200640 1 -- 172.21.15.175:0/3058757103 wait complete. 2024-04-25T09:05:16.024 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:05:16.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.170+0000 7f8331600640 1 Processor -- start 2024-04-25T09:05:16.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.170+0000 7f8331600640 1 -- start start 2024-04-25T09:05:16.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.170+0000 7f8331600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f832c145250 0x7f832c0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.170+0000 7f8331600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f832c1600a0 0x7f832c0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.170+0000 7f8331600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c0cfd10 con 0x7f832c0ce970 2024-04-25T09:05:16.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.170+0000 7f8331600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832c15f650 con 0x7f832c145250 2024-04-25T09:05:16.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.170+0000 7f8331600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832c0cfff0 con 0x7f832c1600a0 2024-04-25T09:05:16.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.170+0000 7f832aa00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f832c145250 0x7f832c0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.170+0000 7f832b400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f832c0ce970 0x7f832c0cedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53082/0 (socket says 172.21.15.175:53082) 2024-04-25T09:05:16.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.170+0000 7f832b400640 1 -- 172.21.15.175:0/1935968319 learned_addr learned my addr 172.21.15.175:0/1935968319 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:16.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.170+0000 7f8322000640 1 --2- 172.21.15.175:0/1935968319 >> v2:172.21.15.177:3300/0 conn(0x7f832c1600a0 0x7f832c0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.170+0000 7f832aa00640 1 -- 172.21.15.175:0/1935968319 >> v2:172.21.15.177:3300/0 conn(0x7f832c1600a0 msgr2=0x7f832c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.170+0000 7f832aa00640 1 --2- 172.21.15.175:0/1935968319 >> v2:172.21.15.177:3300/0 conn(0x7f832c1600a0 0x7f832c0cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.170+0000 7f832aa00640 1 -- 172.21.15.175:0/1935968319 >> v1:172.21.15.175:6789/0 conn(0x7f832c0ce970 legacy=0x7f832c0cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.170+0000 7f832a000640 1 -- 172.21.15.175:0/1935968319 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044762331 0 0) 0x7f832c0cfd10 con 0x7f832c0ce970 2024-04-25T09:05:16.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.170+0000 7f832aa00640 1 -- 172.21.15.175:0/1935968319 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c15f8a0 con 0x7f832c145250 2024-04-25T09:05:16.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.174+0000 7f832aa00640 1 --2- 172.21.15.175:0/1935968319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f832c145250 0x7f832c0cf6b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f831c0097c0 tx=0x7f831c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1870baccc065ed5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.174+0000 7f832a000640 1 -- 172.21.15.175:0/1935968319 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c0ab650 con 0x7f832c145250 2024-04-25T09:05:16.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.174+0000 7f832a000640 1 -- 172.21.15.175:0/1935968319 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c0b0070 con 0x7f832c145250 2024-04-25T09:05:16.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.174+0000 7f832a000640 1 -- 172.21.15.175:0/1935968319 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c0aba10 con 0x7f832c145250 2024-04-25T09:05:16.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.174+0000 7f8331600640 1 -- 172.21.15.175:0/1935968319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f832c145250 msgr2=0x7f832c0cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.174+0000 7f8331600640 1 --2- 172.21.15.175:0/1935968319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f832c145250 0x7f832c0cf6b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f831c0097c0 tx=0x7f831c01c430 comp rx=0 tx=0).stop 2024-04-25T09:05:16.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.174+0000 7f8331600640 1 -- 172.21.15.175:0/1935968319 shutdown_connections 2024-04-25T09:05:16.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.174+0000 7f8331600640 1 --2- 172.21.15.175:0/1935968319 >> v2:172.21.15.177:3300/0 conn(0x7f832c1600a0 0x7f832c0cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.174+0000 7f8331600640 1 --2- 172.21.15.175:0/1935968319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f832c145250 0x7f832c0cf6b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.174+0000 7f8331600640 1 -- 172.21.15.175:0/1935968319 >> 172.21.15.175:0/1935968319 conn(0x7f832c06ac50 msgr2=0x7f832c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.174+0000 7f8331600640 1 -- 172.21.15.175:0/1935968319 shutdown_connections 2024-04-25T09:05:16.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.174+0000 7f8331600640 1 -- 172.21.15.175:0/1935968319 wait complete. 2024-04-25T09:05:16.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f8331600640 1 Processor -- start 2024-04-25T09:05:16.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f8331600640 1 -- start start 2024-04-25T09:05:16.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f8331600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f832c0ce970 0x7f832c0b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f8331600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f832c145250 0x7f832c0addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f8331600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f832c1600a0 0x7f832c0ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f8331600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c15c870 con 0x7f832c1600a0 2024-04-25T09:05:16.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f8331600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c1604b0 con 0x7f832c0ce970 2024-04-25T09:05:16.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f8331600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c15c9f0 con 0x7f832c145250 2024-04-25T09:05:16.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f832b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f832c1600a0 0x7f832c0ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f832b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f832c1600a0 0x7f832c0ae2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43710/0 (socket says 172.21.15.175:43710) 2024-04-25T09:05:16.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f832b400640 1 -- 172.21.15.175:0/4088250379 learned_addr learned my addr 172.21.15.175:0/4088250379 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:16.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f8322000640 1 --2- 172.21.15.175:0/4088250379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f832c145250 0x7f832c0addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f832aa00640 1 --2- 172.21.15.175:0/4088250379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f832c0ce970 0x7f832c0b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f832b400640 1 -- 172.21.15.175:0/4088250379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f832c145250 msgr2=0x7f832c0addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f832b400640 1 --2- 172.21.15.175:0/4088250379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f832c145250 0x7f832c0addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f832b400640 1 -- 172.21.15.175:0/4088250379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f832c0ce970 msgr2=0x7f832c0b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f832b400640 1 --2- 172.21.15.175:0/4088250379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f832c0ce970 0x7f832c0b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f832b400640 1 -- 172.21.15.175:0/4088250379 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c0ae990 con 0x7f832c1600a0 2024-04-25T09:05:16.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f8322000640 1 --2- 172.21.15.175:0/4088250379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f832c145250 0x7f832c0addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:16.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f832aa00640 1 --2- 172.21.15.175:0/4088250379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f832c0ce970 0x7f832c0b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:16.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f832b400640 1 --2- 172.21.15.175:0/4088250379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f832c1600a0 0x7f832c0ae2f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f832400c7d0 tx=0x7f832400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f8323400640 1 -- 172.21.15.175:0/4088250379 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324018070 con 0x7f832c1600a0 2024-04-25T09:05:16.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f8323400640 1 -- 172.21.15.175:0/4088250379 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832400a640 con 0x7f832c1600a0 2024-04-25T09:05:16.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f8323400640 1 -- 172.21.15.175:0/4088250379 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832400aa70 con 0x7f832c1600a0 2024-04-25T09:05:16.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f8331600640 1 -- 172.21.15.175:0/4088250379 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832c0a8630 con 0x7f832c1600a0 2024-04-25T09:05:16.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.178+0000 7f8331600640 1 -- 172.21.15.175:0/4088250379 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832c0b3f50 con 0x7f832c1600a0 2024-04-25T09:05:16.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.182+0000 7f8331600640 1 -- 172.21.15.175:0/4088250379 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832c0a8c40 con 0x7f832c1600a0 2024-04-25T09:05:16.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.182+0000 7f8323400640 1 -- 172.21.15.175:0/4088250379 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f832401b070 con 0x7f832c1600a0 2024-04-25T09:05:16.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.182+0000 7f8323400640 1 --2- 172.21.15.175:0/4088250379 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8308066f60 0x7f8308069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.182+0000 7f8323400640 1 -- 172.21.15.175:0/4088250379 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8324084660 con 0x7f832c1600a0 2024-04-25T09:05:16.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.182+0000 7f832aa00640 1 --2- 172.21.15.175:0/4088250379 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8308066f60 0x7f8308069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.182+0000 7f832aa00640 1 --2- 172.21.15.175:0/4088250379 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8308066f60 0x7f8308069420 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f831c0af000 tx=0x7f831c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.186+0000 7f8323400640 1 -- 172.21.15.175:0/4088250379 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8324055660 con 0x7f832c1600a0 2024-04-25T09:05:16.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.338+0000 7f8331600640 1 -- 172.21.15.175:0/4088250379 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f832c075160 con 0x7f832c1600a0 2024-04-25T09:05:16.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.338+0000 7f8323400640 1 -- 172.21.15.175:0/4088250379 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8324054f60 con 0x7f832c1600a0 2024-04-25T09:05:16.331 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:05:16.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.338+0000 7f8331600640 1 -- 172.21.15.175:0/4088250379 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8308066f60 msgr2=0x7f8308069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.338+0000 7f8331600640 1 --2- 172.21.15.175:0/4088250379 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8308066f60 0x7f8308069420 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f831c0af000 tx=0x7f831c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:05:16.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.338+0000 7f8331600640 1 -- 172.21.15.175:0/4088250379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f832c1600a0 msgr2=0x7f832c0ae2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.338+0000 7f8331600640 1 --2- 172.21.15.175:0/4088250379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f832c1600a0 0x7f832c0ae2f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f832400c7d0 tx=0x7f832400cc90 comp rx=0 tx=0).stop 2024-04-25T09:05:16.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.338+0000 7f8331600640 1 -- 172.21.15.175:0/4088250379 shutdown_connections 2024-04-25T09:05:16.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.338+0000 7f8331600640 1 --2- 172.21.15.175:0/4088250379 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8308066f60 0x7f8308069420 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.338+0000 7f8331600640 1 --2- 172.21.15.175:0/4088250379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f832c1600a0 0x7f832c0ae2f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.338+0000 7f8331600640 1 --2- 172.21.15.175:0/4088250379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f832c145250 0x7f832c0addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.338+0000 7f8331600640 1 --2- 172.21.15.175:0/4088250379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f832c0ce970 0x7f832c0b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.338+0000 7f8331600640 1 -- 172.21.15.175:0/4088250379 >> 172.21.15.175:0/4088250379 conn(0x7f832c06ac50 msgr2=0x7f832c0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.338+0000 7f8331600640 1 -- 172.21.15.175:0/4088250379 shutdown_connections 2024-04-25T09:05:16.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.338+0000 7f8331600640 1 -- 172.21.15.175:0/4088250379 wait complete. 2024-04-25T09:05:16.353 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:05:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.610+0000 7fccb1200640 1 Processor -- start 2024-04-25T09:05:16.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.610+0000 7fccb1200640 1 -- start start 2024-04-25T09:05:16.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.610+0000 7fccb1200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccac0cdb60 0x7fccac0cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.610+0000 7fccb1200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fccac0ace00 0x7fccac06eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.610+0000 7fccb1200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccac06de20 con 0x7fccac06ad50 2024-04-25T09:05:16.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.610+0000 7fccb1200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccac15dfe0 con 0x7fccac0ace00 2024-04-25T09:05:16.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.610+0000 7fccb1200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0ce480 con 0x7fccac0cdb60 2024-04-25T09:05:16.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.610+0000 7fccaa800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fccac0ace00 0x7fccac06eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.610+0000 7fccaa800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fccac0ace00 0x7fccac06eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43726/0 (socket says 172.21.15.175:43726) 2024-04-25T09:05:16.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.610+0000 7fccaa800640 1 -- 172.21.15.175:0/166333077 learned_addr learned my addr 172.21.15.175:0/166333077 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:16.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.610+0000 7fcca9e00640 1 --2- 172.21.15.175:0/166333077 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccac0cdb60 0x7fccac0cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.610+0000 7fccaa800640 1 -- 172.21.15.175:0/166333077 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccac0cdb60 msgr2=0x7fccac0cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.610+0000 7fccaa800640 1 --2- 172.21.15.175:0/166333077 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccac0cdb60 0x7fccac0cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.610+0000 7fccaa800640 1 -- 172.21.15.175:0/166333077 >> v1:172.21.15.177:6789/0 conn(0x7fccac06ad50 legacy=0x7fccac06bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.610+0000 7fccaa800640 1 -- 172.21.15.175:0/166333077 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac06e090 con 0x7fccac0ace00 2024-04-25T09:05:16.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.610+0000 7fcca9e00640 1 --2- 172.21.15.175:0/166333077 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccac0cdb60 0x7fccac0cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.614+0000 7fccaa800640 1 --2- 172.21.15.175:0/166333077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccac0ace00 0x7fccac06eb70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009e50 tx=0x7fcca401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c13dc2287640a65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.614+0000 7fcca9400640 1 -- 172.21.15.175:0/166333077 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca40a5840 con 0x7fccac0ace00 2024-04-25T09:05:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.614+0000 7fcca9400640 1 -- 172.21.15.175:0/166333077 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca40a59e0 con 0x7fccac0ace00 2024-04-25T09:05:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.614+0000 7fcca9400640 1 -- 172.21.15.175:0/166333077 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca40a5db0 con 0x7fccac0ace00 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.614+0000 7fccb1200640 1 -- 172.21.15.175:0/166333077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccac0ace00 msgr2=0x7fccac06eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.614+0000 7fccb1200640 1 --2- 172.21.15.175:0/166333077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccac0ace00 0x7fccac06eb70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009e50 tx=0x7fcca401c9c0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.614+0000 7fccb1200640 1 -- 172.21.15.175:0/166333077 shutdown_connections 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.614+0000 7fccb1200640 1 --2- 172.21.15.175:0/166333077 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccac0ace00 0x7fccac06eb70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.614+0000 7fccb1200640 1 --2- 172.21.15.175:0/166333077 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccac0cdb60 0x7fccac0cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.614+0000 7fccb1200640 1 -- 172.21.15.175:0/166333077 >> 172.21.15.175:0/166333077 conn(0x7fccac0cca10 msgr2=0x7fccac0cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.614+0000 7fccb1200640 1 -- 172.21.15.175:0/166333077 shutdown_connections 2024-04-25T09:05:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.614+0000 7fccb1200640 1 -- 172.21.15.175:0/166333077 wait complete. 2024-04-25T09:05:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.614+0000 7fccb1200640 1 Processor -- start 2024-04-25T09:05:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.614+0000 7fccb1200640 1 -- start start 2024-04-25T09:05:16.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fccb1200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccac06ad50 0x7fccac1574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fccb1200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccac0ace00 0x7fccac15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fccb1200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccac0cdb60 0x7fccac15d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fccb1200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0aedc0 con 0x7fccac0cdb60 2024-04-25T09:05:16.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fccb1200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac06c550 con 0x7fccac06ad50 2024-04-25T09:05:16.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fccb1200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0aef40 con 0x7fccac0ace00 2024-04-25T09:05:16.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fccaa800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccac0cdb60 0x7fccac15d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fccaa800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccac0cdb60 0x7fccac15d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43740/0 (socket says 172.21.15.175:43740) 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fccaa800640 1 -- 172.21.15.175:0/1036527983 learned_addr learned my addr 172.21.15.175:0/1036527983 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fcca9e00640 1 --2- 172.21.15.175:0/1036527983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccac06ad50 0x7fccac1574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fcca3e00640 1 --2- 172.21.15.175:0/1036527983 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccac0ace00 0x7fccac15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fccaa800640 1 -- 172.21.15.175:0/1036527983 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccac0ace00 msgr2=0x7fccac15ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fccaa800640 1 --2- 172.21.15.175:0/1036527983 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccac0ace00 0x7fccac15ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fccaa800640 1 -- 172.21.15.175:0/1036527983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccac06ad50 msgr2=0x7fccac1574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fccaa800640 1 --2- 172.21.15.175:0/1036527983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccac06ad50 0x7fccac1574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fccaa800640 1 -- 172.21.15.175:0/1036527983 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac0c66f0 con 0x7fccac0cdb60 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fccaa800640 1 --2- 172.21.15.175:0/1036527983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccac0cdb60 0x7fccac15d350 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009e50 tx=0x7fcca4019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fcca2000640 1 -- 172.21.15.175:0/1036527983 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca40bc020 con 0x7fccac0cdb60 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fcca2000640 1 -- 172.21.15.175:0/1036527983 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca40b8670 con 0x7fccac0cdb60 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fcca2000640 1 -- 172.21.15.175:0/1036527983 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca40b8a60 con 0x7fccac0cdb60 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fccb1200640 1 -- 172.21.15.175:0/1036527983 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccac0c6410 con 0x7fccac0cdb60 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fccb1200640 1 -- 172.21.15.175:0/1036527983 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccac156ce0 con 0x7fccac0cdb60 2024-04-25T09:05:16.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fccb1200640 1 -- 172.21.15.175:0/1036527983 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccac075160 con 0x7fccac0cdb60 2024-04-25T09:05:16.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.618+0000 7fcca2000640 1 -- 172.21.15.175:0/1036527983 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcca40bf020 con 0x7fccac0cdb60 2024-04-25T09:05:16.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.622+0000 7fcca2000640 1 --2- 172.21.15.175:0/1036527983 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcc88066f60 0x7fcc88069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.622+0000 7fcca2000640 1 -- 172.21.15.175:0/1036527983 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcca41201d0 con 0x7fccac0cdb60 2024-04-25T09:05:16.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.622+0000 7fcca9e00640 1 --2- 172.21.15.175:0/1036527983 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcc88066f60 0x7fcc88069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.622+0000 7fcca9e00640 1 --2- 172.21.15.175:0/1036527983 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcc88066f60 0x7fcc88069420 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c006fd0 tx=0x7fcc9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.626+0000 7fcca2000640 1 -- 172.21.15.175:0/1036527983 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcca40c6030 con 0x7fccac0cdb60 2024-04-25T09:05:16.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.778+0000 7fccb1200640 1 -- 172.21.15.175:0/1036527983 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fccac066bc0 con 0x7fccac0cdb60 2024-04-25T09:05:16.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.778+0000 7fcca2000640 1 -- 172.21.15.175:0/1036527983 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcca40165e0 con 0x7fccac0cdb60 2024-04-25T09:05:16.772 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:05:16.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.782+0000 7fccb1200640 1 -- 172.21.15.175:0/1036527983 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcc88066f60 msgr2=0x7fcc88069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.782+0000 7fccb1200640 1 --2- 172.21.15.175:0/1036527983 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcc88066f60 0x7fcc88069420 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c006fd0 tx=0x7fcc9c008040 comp rx=0 tx=0).stop 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.782+0000 7fccb1200640 1 -- 172.21.15.175:0/1036527983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccac0cdb60 msgr2=0x7fccac15d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.782+0000 7fccb1200640 1 --2- 172.21.15.175:0/1036527983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccac0cdb60 0x7fccac15d350 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009e50 tx=0x7fcca4019760 comp rx=0 tx=0).stop 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.782+0000 7fccb1200640 1 -- 172.21.15.175:0/1036527983 shutdown_connections 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.782+0000 7fccb1200640 1 --2- 172.21.15.175:0/1036527983 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcc88066f60 0x7fcc88069420 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.782+0000 7fccb1200640 1 --2- 172.21.15.175:0/1036527983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccac0cdb60 0x7fccac15d350 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.782+0000 7fccb1200640 1 --2- 172.21.15.175:0/1036527983 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fccac0ace00 0x7fccac15ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.782+0000 7fccb1200640 1 --2- 172.21.15.175:0/1036527983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fccac06ad50 0x7fccac1574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.782+0000 7fccb1200640 1 -- 172.21.15.175:0/1036527983 >> 172.21.15.175:0/1036527983 conn(0x7fccac0cca10 msgr2=0x7fccac0b2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.782+0000 7fccb1200640 1 -- 172.21.15.175:0/1036527983 shutdown_connections 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.782+0000 7fccb1200640 1 -- 172.21.15.175:0/1036527983 wait complete. 2024-04-25T09:05:16.793 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:05:16.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.938+0000 7fc118600640 1 Processor -- start 2024-04-25T09:05:16.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.938+0000 7fc118600640 1 -- start start 2024-04-25T09:05:16.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.938+0000 7fc118600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc1100cbf90 0x7fc1100ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.938+0000 7fc118600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1100ce7f0 0x7fc11006c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.938+0000 7fc118600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11006dd70 con 0x7fc11015dc90 2024-04-25T09:05:16.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.938+0000 7fc118600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1100cec60 con 0x7fc1100cbf90 2024-04-25T09:05:16.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.938+0000 7fc118600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc110162570 con 0x7fc1100ce7f0 2024-04-25T09:05:16.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc115c00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc11015dc90 0x7fc11006d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53092/0 (socket says 172.21.15.175:53092) 2024-04-25T09:05:16.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc115c00640 1 -- 172.21.15.175:0/1899587033 learned_addr learned my addr 172.21.15.175:0/1899587033 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:16.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc115200640 1 --2- 172.21.15.175:0/1899587033 >> v2:172.21.15.177:3300/0 conn(0x7fc1100cbf90 0x7fc1100ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc116600640 1 --2- 172.21.15.175:0/1899587033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1100ce7f0 0x7fc11006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc10fe00640 1 -- 172.21.15.175:0/1899587033 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327481931 0 0) 0x7fc104001120 con 0x7fc11015dc90 2024-04-25T09:05:16.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc10fe00640 1 -- 172.21.15.175:0/1899587033 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0f8003530 con 0x7fc11015dc90 2024-04-25T09:05:16.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc10fe00640 1 -- 172.21.15.175:0/1899587033 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 896317484 0 0) 0x7fc0f8003530 con 0x7fc11015dc90 2024-04-25T09:05:16.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc10fe00640 1 -- 172.21.15.175:0/1899587033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1100ce7f0 msgr2=0x7fc11006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc10fe00640 1 --2- 172.21.15.175:0/1899587033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1100ce7f0 0x7fc11006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc10fe00640 1 -- 172.21.15.175:0/1899587033 >> v2:172.21.15.177:3300/0 conn(0x7fc1100cbf90 msgr2=0x7fc1100ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc10fe00640 1 --2- 172.21.15.175:0/1899587033 >> v2:172.21.15.177:3300/0 conn(0x7fc1100cbf90 0x7fc1100ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc10fe00640 1 -- 172.21.15.175:0/1899587033 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1101619a0 con 0x7fc11015dc90 2024-04-25T09:05:16.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc10fe00640 1 -- 172.21.15.175:0/1899587033 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fc104001850 con 0x7fc11015dc90 2024-04-25T09:05:16.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc115200640 1 --2- 172.21.15.175:0/1899587033 >> v2:172.21.15.177:3300/0 conn(0x7fc1100cbf90 0x7fc1100ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:16.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc10fe00640 1 -- 172.21.15.175:0/1899587033 >> v1:172.21.15.175:6789/0 conn(0x7fc11015dc90 legacy=0x7fc11006d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc10fe00640 1 --2- 172.21.15.175:0/1899587033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0f80039c0 0x7fc0f8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc10fe00640 1 --2- 172.21.15.175:0/1899587033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1100ce7f0 0x7fc0f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc10fe00640 1 --2- 172.21.15.175:0/1899587033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0f8004d50 0x7fc0f80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc10fe00640 1 -- 172.21.15.175:0/1899587033 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1100cec60 con 0x7fc0f8004d50 2024-04-25T09:05:16.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc10fe00640 1 -- 172.21.15.175:0/1899587033 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc110162570 con 0x7fc0f80039c0 2024-04-25T09:05:16.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc10fe00640 1 -- 172.21.15.175:0/1899587033 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f800b9d0 con 0x7fc1100ce7f0 2024-04-25T09:05:16.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc116600640 1 --2- 172.21.15.175:0/1899587033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0f8004d50 0x7fc0f80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc115200640 1 --2- 172.21.15.175:0/1899587033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1100ce7f0 0x7fc0f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc115c00640 1 --2- 172.21.15.175:0/1899587033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0f80039c0 0x7fc0f8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc116600640 1 -- 172.21.15.175:0/1899587033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1100ce7f0 msgr2=0x7fc0f8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc116600640 1 --2- 172.21.15.175:0/1899587033 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1100ce7f0 0x7fc0f8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc116600640 1 -- 172.21.15.175:0/1899587033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0f80039c0 msgr2=0x7fc0f8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc116600640 1 --2- 172.21.15.175:0/1899587033 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0f80039c0 0x7fc0f8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.942+0000 7fc116600640 1 -- 172.21.15.175:0/1899587033 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f8003530 con 0x7fc0f8004d50 2024-04-25T09:05:16.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.946+0000 7fc116600640 1 --2- 172.21.15.175:0/1899587033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0f8004d50 0x7fc0f80051d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc108009fc0 tx=0x7fc10801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f956714f4f0e34d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.946+0000 7fc10fe00640 1 -- 172.21.15.175:0/1899587033 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1080b2070 con 0x7fc0f8004d50 2024-04-25T09:05:16.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.946+0000 7fc10fe00640 1 -- 172.21.15.175:0/1899587033 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1080a5c90 con 0x7fc0f8004d50 2024-04-25T09:05:16.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.946+0000 7fc10fe00640 1 -- 172.21.15.175:0/1899587033 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108009c10 con 0x7fc0f8004d50 2024-04-25T09:05:16.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.946+0000 7fc118600640 1 -- 172.21.15.175:0/1899587033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0f8004d50 msgr2=0x7fc0f80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.946+0000 7fc118600640 1 --2- 172.21.15.175:0/1899587033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0f8004d50 0x7fc0f80051d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc108009fc0 tx=0x7fc10801cc80 comp rx=0 tx=0).stop 2024-04-25T09:05:16.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.946+0000 7fc116600640 1 -- 172.21.15.175:0/1899587033 reap_dead start 2024-04-25T09:05:16.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.946+0000 7fc118600640 1 -- 172.21.15.175:0/1899587033 shutdown_connections 2024-04-25T09:05:16.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.946+0000 7fc118600640 1 -- 172.21.15.175:0/1899587033 >> 172.21.15.175:0/1899587033 conn(0x7fc11006f550 msgr2=0x7fc11006f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.946+0000 7fc118600640 1 -- 172.21.15.175:0/1899587033 shutdown_connections 2024-04-25T09:05:16.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.946+0000 7fc118600640 1 -- 172.21.15.175:0/1899587033 wait complete. 2024-04-25T09:05:16.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.946+0000 7fc118600640 1 Processor -- start 2024-04-25T09:05:16.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.946+0000 7fc118600640 1 -- start start 2024-04-25T09:05:16.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc118600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0f8004d50 0x7fc1100b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc118600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1100cb180 0x7fc1100b6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc118600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1100b2fd0 0x7fc1100b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc118600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc110162200 con 0x7fc1100b2fd0 2024-04-25T09:05:16.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc118600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc110161f20 con 0x7fc1100cb180 2024-04-25T09:05:16.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc118600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11015e070 con 0x7fc0f8004d50 2024-04-25T09:05:16.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc116600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1100b2fd0 0x7fc1100b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc116600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1100b2fd0 0x7fc1100b3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43760/0 (socket says 172.21.15.175:43760) 2024-04-25T09:05:16.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc116600640 1 -- 172.21.15.175:0/3283497582 learned_addr learned my addr 172.21.15.175:0/3283497582 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:16.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc115c00640 1 --2- 172.21.15.175:0/3283497582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0f8004d50 0x7fc1100b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc115200640 1 --2- 172.21.15.175:0/3283497582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1100cb180 0x7fc1100b6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc116600640 1 -- 172.21.15.175:0/3283497582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0f8004d50 msgr2=0x7fc1100b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc116600640 1 --2- 172.21.15.175:0/3283497582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0f8004d50 0x7fc1100b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc116600640 1 -- 172.21.15.175:0/3283497582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1100cb180 msgr2=0x7fc1100b6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc116600640 1 --2- 172.21.15.175:0/3283497582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1100cb180 0x7fc1100b6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc116600640 1 -- 172.21.15.175:0/3283497582 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1101f38e0 con 0x7fc1100b2fd0 2024-04-25T09:05:16.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc116600640 1 --2- 172.21.15.175:0/3283497582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1100b2fd0 0x7fc1100b3450 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc108002240 tx=0x7fc108009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc10d600640 1 -- 172.21.15.175:0/3283497582 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1080bd070 con 0x7fc1100b2fd0 2024-04-25T09:05:16.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc10d600640 1 -- 172.21.15.175:0/3283497582 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1080a5a90 con 0x7fc1100b2fd0 2024-04-25T09:05:16.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc118600640 1 -- 172.21.15.175:0/3283497582 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1100cb600 con 0x7fc1100b2fd0 2024-04-25T09:05:16.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc10d600640 1 -- 172.21.15.175:0/3283497582 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1080b2040 con 0x7fc1100b2fd0 2024-04-25T09:05:16.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc118600640 1 -- 172.21.15.175:0/3283497582 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1101f3ba0 con 0x7fc1100b2fd0 2024-04-25T09:05:16.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc118600640 1 -- 172.21.15.175:0/3283497582 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc110075160 con 0x7fc1100b2fd0 2024-04-25T09:05:16.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc10d600640 1 -- 172.21.15.175:0/3283497582 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc1080c0070 con 0x7fc1100b2fd0 2024-04-25T09:05:16.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc10d600640 1 --2- 172.21.15.175:0/3283497582 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc0f0066f90 0x7fc0f0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.950+0000 7fc10d600640 1 -- 172.21.15.175:0/3283497582 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc10811ede0 con 0x7fc1100b2fd0 2024-04-25T09:05:16.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.954+0000 7fc115c00640 1 --2- 172.21.15.175:0/3283497582 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc0f0066f90 0x7fc0f0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.954+0000 7fc115c00640 1 --2- 172.21.15.175:0/3283497582 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc0f0066f90 0x7fc0f0069450 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc104007970 tx=0x7fc104009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:16.954+0000 7fc10d600640 1 -- 172.21.15.175:0/3283497582 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc108016990 con 0x7fc1100b2fd0 2024-04-25T09:05:17.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.118+0000 7fc118600640 1 -- 172.21.15.175:0/3283497582 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc1100b6b70 con 0x7fc1100b2fd0 2024-04-25T09:05:17.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.122+0000 7fc10d600640 1 -- 172.21.15.175:0/3283497582 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc1080ef790 con 0x7fc1100b2fd0 2024-04-25T09:05:17.114 INFO:teuthology.orchestra.run.smithi175.stderr:listed 0 entries 2024-04-25T09:05:17.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.122+0000 7fc118600640 1 -- 172.21.15.175:0/3283497582 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc0f0066f90 msgr2=0x7fc0f0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.122+0000 7fc118600640 1 --2- 172.21.15.175:0/3283497582 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc0f0066f90 0x7fc0f0069450 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc104007970 tx=0x7fc104009040 comp rx=0 tx=0).stop 2024-04-25T09:05:17.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.122+0000 7fc118600640 1 -- 172.21.15.175:0/3283497582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1100b2fd0 msgr2=0x7fc1100b3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.122+0000 7fc118600640 1 --2- 172.21.15.175:0/3283497582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1100b2fd0 0x7fc1100b3450 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc108002240 tx=0x7fc108009750 comp rx=0 tx=0).stop 2024-04-25T09:05:17.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.122+0000 7fc118600640 1 -- 172.21.15.175:0/3283497582 shutdown_connections 2024-04-25T09:05:17.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.122+0000 7fc118600640 1 --2- 172.21.15.175:0/3283497582 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc0f0066f90 0x7fc0f0069450 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.122+0000 7fc118600640 1 --2- 172.21.15.175:0/3283497582 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1100b2fd0 0x7fc1100b3450 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.122+0000 7fc118600640 1 --2- 172.21.15.175:0/3283497582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc1100cb180 0x7fc1100b6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.122+0000 7fc118600640 1 --2- 172.21.15.175:0/3283497582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0f8004d50 0x7fc1100b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.122+0000 7fc118600640 1 -- 172.21.15.175:0/3283497582 >> 172.21.15.175:0/3283497582 conn(0x7fc11006f550 msgr2=0x7fc1100cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.122+0000 7fc118600640 1 -- 172.21.15.175:0/3283497582 shutdown_connections 2024-04-25T09:05:17.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.122+0000 7fc118600640 1 -- 172.21.15.175:0/3283497582 wait complete. 2024-04-25T09:05:17.134 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:05:17.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:17.135 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:05:17.183 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:05:17.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:17.184 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:05:17.211 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:17.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.394+0000 7fb8e9a00640 1 Processor -- start 2024-04-25T09:05:17.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.394+0000 7fb8e9a00640 1 -- start start 2024-04-25T09:05:17.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.398+0000 7fb8e9a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb8e415dab0 0x7fb8e4161490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.398+0000 7fb8e9a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8e40b1ea0 0x7fb8e40cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.398+0000 7fb8e9a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8e40b2330 0x7fb8e40cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.398+0000 7fb8e9a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e40b1a10 con 0x7fb8e40b1ea0 2024-04-25T09:05:17.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.398+0000 7fb8e9a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e4161e30 con 0x7fb8e415dab0 2024-04-25T09:05:17.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.398+0000 7fb8e9a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e4162110 con 0x7fb8e40b2330 2024-04-25T09:05:17.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.398+0000 7fb8e3400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8e40b1ea0 0x7fb8e40cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.398+0000 7fb8e3400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8e40b1ea0 0x7fb8e40cfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43762/0 (socket says 172.21.15.175:43762) 2024-04-25T09:05:17.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.398+0000 7fb8e3400640 1 -- 172.21.15.175:0/1001693127 learned_addr learned my addr 172.21.15.175:0/1001693127 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:17.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.398+0000 7fb8e3e00640 1 --2- 172.21.15.175:0/1001693127 >> v2:172.21.15.177:3300/0 conn(0x7fb8e415dab0 0x7fb8e4161490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.398+0000 7fb8e9000640 1 --2- 172.21.15.175:0/1001693127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8e40b2330 0x7fb8e40cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.398+0000 7fb8e3400640 1 -- 172.21.15.175:0/1001693127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8e40b2330 msgr2=0x7fb8e40cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.398+0000 7fb8e3400640 1 --2- 172.21.15.175:0/1001693127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8e40b2330 0x7fb8e40cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.398+0000 7fb8e3400640 1 -- 172.21.15.175:0/1001693127 >> v2:172.21.15.177:3300/0 conn(0x7fb8e415dab0 msgr2=0x7fb8e4161490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.398+0000 7fb8e3400640 1 --2- 172.21.15.175:0/1001693127 >> v2:172.21.15.177:3300/0 conn(0x7fb8e415dab0 0x7fb8e4161490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.398+0000 7fb8e3400640 1 -- 172.21.15.175:0/1001693127 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e40b16a0 con 0x7fb8e40b1ea0 2024-04-25T09:05:17.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.402+0000 7fb8e3400640 1 --2- 172.21.15.175:0/1001693127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e40b1ea0 0x7fb8e40cfa00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40b4220 tx=0x7fb8d001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ec9e1e77530c3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.402+0000 7fb8e2a00640 1 -- 172.21.15.175:0/1001693127 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d00aa600 con 0x7fb8e40b1ea0 2024-04-25T09:05:17.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.402+0000 7fb8e2a00640 1 -- 172.21.15.175:0/1001693127 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d00af070 con 0x7fb8e40b1ea0 2024-04-25T09:05:17.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.402+0000 7fb8e2a00640 1 -- 172.21.15.175:0/1001693127 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d00aa9c0 con 0x7fb8e40b1ea0 2024-04-25T09:05:17.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.402+0000 7fb8e9a00640 1 -- 172.21.15.175:0/1001693127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e40b1ea0 msgr2=0x7fb8e40cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.402+0000 7fb8e9a00640 1 --2- 172.21.15.175:0/1001693127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e40b1ea0 0x7fb8e40cfa00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40b4220 tx=0x7fb8d001c4c0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.402+0000 7fb8e9a00640 1 -- 172.21.15.175:0/1001693127 shutdown_connections 2024-04-25T09:05:17.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.402+0000 7fb8e9a00640 1 --2- 172.21.15.175:0/1001693127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8e40b2330 0x7fb8e40cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.402+0000 7fb8e9a00640 1 --2- 172.21.15.175:0/1001693127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e40b1ea0 0x7fb8e40cfa00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.402+0000 7fb8e9a00640 1 --2- 172.21.15.175:0/1001693127 >> v2:172.21.15.177:3300/0 conn(0x7fb8e415dab0 0x7fb8e4161490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.402+0000 7fb8e9a00640 1 -- 172.21.15.175:0/1001693127 >> 172.21.15.175:0/1001693127 conn(0x7fb8e408afe0 msgr2=0x7fb8e408b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.402+0000 7fb8e9a00640 1 -- 172.21.15.175:0/1001693127 shutdown_connections 2024-04-25T09:05:17.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.402+0000 7fb8e9a00640 1 -- 172.21.15.175:0/1001693127 wait complete. 2024-04-25T09:05:17.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.402+0000 7fb8e9a00640 1 Processor -- start 2024-04-25T09:05:17.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.402+0000 7fb8e9a00640 1 -- start start 2024-04-25T09:05:17.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e9a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8e40b1ea0 0x7fb8e40b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e9a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e40b2330 0x7fb8e4150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e9a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e415dab0 0x7fb8e4151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e9a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e406cec0 con 0x7fb8e415dab0 2024-04-25T09:05:17.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e9a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e406cd40 con 0x7fb8e40b2330 2024-04-25T09:05:17.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e9a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e406d040 con 0x7fb8e40b1ea0 2024-04-25T09:05:17.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e9000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e415dab0 0x7fb8e4151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e9000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e415dab0 0x7fb8e4151530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43772/0 (socket says 172.21.15.175:43772) 2024-04-25T09:05:17.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e9000640 1 -- 172.21.15.175:0/3078962000 learned_addr learned my addr 172.21.15.175:0/3078962000 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:17.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e3e00640 1 --2- 172.21.15.175:0/3078962000 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8e40b1ea0 0x7fb8e40b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e3400640 1 --2- 172.21.15.175:0/3078962000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e40b2330 0x7fb8e4150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e9000640 1 -- 172.21.15.175:0/3078962000 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8e40b1ea0 msgr2=0x7fb8e40b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e9000640 1 --2- 172.21.15.175:0/3078962000 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8e40b1ea0 0x7fb8e40b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e9000640 1 -- 172.21.15.175:0/3078962000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e40b2330 msgr2=0x7fb8e4150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e9000640 1 --2- 172.21.15.175:0/3078962000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e40b2330 0x7fb8e4150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e9000640 1 -- 172.21.15.175:0/3078962000 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e40af990 con 0x7fb8e415dab0 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e9000640 1 --2- 172.21.15.175:0/3078962000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e415dab0 0x7fb8e4151530 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc00d600 tx=0x7fb8dc00dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8dbe00640 1 -- 172.21.15.175:0/3078962000 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc018020 con 0x7fb8e415dab0 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8dbe00640 1 -- 172.21.15.175:0/3078962000 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8dc014620 con 0x7fb8e415dab0 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e9a00640 1 -- 172.21.15.175:0/3078962000 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e40afc70 con 0x7fb8e415dab0 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8dbe00640 1 -- 172.21.15.175:0/3078962000 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc0149f0 con 0x7fb8e415dab0 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e9a00640 1 -- 172.21.15.175:0/3078962000 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e40b4610 con 0x7fb8e415dab0 2024-04-25T09:05:17.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8e9a00640 1 -- 172.21.15.175:0/3078962000 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e4074a60 con 0x7fb8e415dab0 2024-04-25T09:05:17.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.406+0000 7fb8dbe00640 1 -- 172.21.15.175:0/3078962000 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb8dc01b020 con 0x7fb8e415dab0 2024-04-25T09:05:17.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.410+0000 7fb8dbe00640 1 --2- 172.21.15.175:0/3078962000 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb8c4066f60 0x7fb8c4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.410+0000 7fb8dbe00640 1 -- 172.21.15.175:0/3078962000 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8dc085370 con 0x7fb8e415dab0 2024-04-25T09:05:17.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.410+0000 7fb8e3e00640 1 --2- 172.21.15.175:0/3078962000 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb8c4066f60 0x7fb8c4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.410+0000 7fb8e3e00640 1 --2- 172.21.15.175:0/3078962000 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb8c4066f60 0x7fb8c4069420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb8e415d100 tx=0x7fb8d40098d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.414+0000 7fb8dbe00640 1 -- 172.21.15.175:0/3078962000 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb8dc022020 con 0x7fb8e415dab0 2024-04-25T09:05:17.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.602+0000 7fb8e9a00640 1 -- 172.21.15.175:0/3078962000 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8e40c81f0 con 0x7fb8e415dab0 2024-04-25T09:05:17.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.602+0000 7fb8dbe00640 1 -- 172.21.15.175:0/3078962000 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4950 (secure 0 0 0) 0x7fb8dc055d20 con 0x7fb8e415dab0 2024-04-25T09:05:17.594 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:17.594 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2334769483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2334769483},{"type":"v1","addr":"172.21.15.177:6834","nonce":2334769483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2397222507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2397222507},{"type":"v1","addr":"172.21.15.177:6835","nonce":2397222507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5067,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2738941530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2738941530},{"type":"v1","addr":"172.21.15.175:6836","nonce":2738941530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:02.208383+0000","modified":"2024-04-25T09:05:05.231797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1909482114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1909482114},{"type":"v1","addr":"172.21.15.175:6837","nonce":1909482114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:05:17.594 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 17 2024-04-25T09:05:17.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.602+0000 7fb8e9a00640 1 -- 172.21.15.175:0/3078962000 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb8c4066f60 msgr2=0x7fb8c4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.602+0000 7fb8e9a00640 1 --2- 172.21.15.175:0/3078962000 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb8c4066f60 0x7fb8c4069420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb8e415d100 tx=0x7fb8d40098d0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.602+0000 7fb8e9a00640 1 -- 172.21.15.175:0/3078962000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e415dab0 msgr2=0x7fb8e4151530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.602+0000 7fb8e9a00640 1 --2- 172.21.15.175:0/3078962000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e415dab0 0x7fb8e4151530 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc00d600 tx=0x7fb8dc00dac0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.602+0000 7fb8e9a00640 1 -- 172.21.15.175:0/3078962000 shutdown_connections 2024-04-25T09:05:17.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.602+0000 7fb8e9a00640 1 --2- 172.21.15.175:0/3078962000 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb8c4066f60 0x7fb8c4069420 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.602+0000 7fb8e9a00640 1 --2- 172.21.15.175:0/3078962000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8e415dab0 0x7fb8e4151530 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.602+0000 7fb8e9a00640 1 --2- 172.21.15.175:0/3078962000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e40b2330 0x7fb8e4150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.602+0000 7fb8e9a00640 1 --2- 172.21.15.175:0/3078962000 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8e40b1ea0 0x7fb8e40b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.602+0000 7fb8e9a00640 1 -- 172.21.15.175:0/3078962000 >> 172.21.15.175:0/3078962000 conn(0x7fb8e408afe0 msgr2=0x7fb8e4070940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.602+0000 7fb8e9a00640 1 -- 172.21.15.175:0/3078962000 shutdown_connections 2024-04-25T09:05:17.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.602+0000 7fb8e9a00640 1 -- 172.21.15.175:0/3078962000 wait complete. 2024-04-25T09:05:17.615 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T09:05:17.786 INFO:teuthology.orchestra.run.smithi175.stdout:{"message":"","return_code":0} 2024-04-25T09:05:17.786 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:05:17.786 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:17.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.934+0000 7fa842800640 1 Processor -- start 2024-04-25T09:05:17.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.934+0000 7fa842800640 1 -- start start 2024-04-25T09:05:17.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.938+0000 7fa842800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa83c144fc0 0x7fa83c0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.938+0000 7fa842800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa83c15c5e0 0x7fa83c0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.938+0000 7fa842800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa83c15cd00 con 0x7fa83c1453a0 2024-04-25T09:05:17.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.938+0000 7fa842800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83c0ce660 con 0x7fa83c144fc0 2024-04-25T09:05:17.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.938+0000 7fa842800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa83c0cc930 con 0x7fa83c15c5e0 2024-04-25T09:05:17.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.938+0000 7fa83b400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa83c144fc0 0x7fa83c0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.938+0000 7fa83b400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa83c144fc0 0x7fa83c0cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43776/0 (socket says 172.21.15.175:43776) 2024-04-25T09:05:17.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.938+0000 7fa83b400640 1 -- 172.21.15.175:0/609226416 learned_addr learned my addr 172.21.15.175:0/609226416 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:17.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.938+0000 7fa83be00640 1 --2- 172.21.15.175:0/609226416 >> v2:172.21.15.177:3300/0 conn(0x7fa83c15c5e0 0x7fa83c0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.938+0000 7fa83b400640 1 -- 172.21.15.175:0/609226416 >> v2:172.21.15.177:3300/0 conn(0x7fa83c15c5e0 msgr2=0x7fa83c0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.938+0000 7fa83b400640 1 --2- 172.21.15.175:0/609226416 >> v2:172.21.15.177:3300/0 conn(0x7fa83c15c5e0 0x7fa83c0cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.938+0000 7fa83b400640 1 -- 172.21.15.175:0/609226416 >> v1:172.21.15.177:6789/0 conn(0x7fa83c1453a0 legacy=0x7fa83c15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.938+0000 7fa83b400640 1 -- 172.21.15.175:0/609226416 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c0ccc10 con 0x7fa83c144fc0 2024-04-25T09:05:17.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.938+0000 7fa83b400640 1 --2- 172.21.15.175:0/609226416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83c144fc0 0x7fa83c0cbe70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa82c009870 tx=0x7fa82c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f946814d22aa02e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa83a000640 1 -- 172.21.15.175:0/609226416 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0ab610 con 0x7fa83c144fc0 2024-04-25T09:05:17.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa83a000640 1 -- 172.21.15.175:0/609226416 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c0b0070 con 0x7fa83c144fc0 2024-04-25T09:05:17.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa83a000640 1 -- 172.21.15.175:0/609226416 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0ab9d0 con 0x7fa83c144fc0 2024-04-25T09:05:17.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa842800640 1 -- 172.21.15.175:0/609226416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83c144fc0 msgr2=0x7fa83c0cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa842800640 1 --2- 172.21.15.175:0/609226416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83c144fc0 0x7fa83c0cbe70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa82c009870 tx=0x7fa82c01c520 comp rx=0 tx=0).stop 2024-04-25T09:05:17.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa842800640 1 -- 172.21.15.175:0/609226416 shutdown_connections 2024-04-25T09:05:17.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa842800640 1 --2- 172.21.15.175:0/609226416 >> v2:172.21.15.177:3300/0 conn(0x7fa83c15c5e0 0x7fa83c0cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa842800640 1 --2- 172.21.15.175:0/609226416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83c144fc0 0x7fa83c0cbe70 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa842800640 1 -- 172.21.15.175:0/609226416 >> 172.21.15.175:0/609226416 conn(0x7fa83c067150 msgr2=0x7fa83c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa842800640 1 -- 172.21.15.175:0/609226416 shutdown_connections 2024-04-25T09:05:17.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa842800640 1 -- 172.21.15.175:0/609226416 wait complete. 2024-04-25T09:05:17.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa842800640 1 Processor -- start 2024-04-25T09:05:17.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa842800640 1 -- start start 2024-04-25T09:05:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa842800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa83c1453a0 0x7fa83c15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa842800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa83c15c5e0 0x7fa83c15a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa842800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83c13e290 0x7fa83c1649c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa842800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0cff00 con 0x7fa83c13e290 2024-04-25T09:05:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa842800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c0cfd80 con 0x7fa83c15c5e0 2024-04-25T09:05:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa842800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c13e790 con 0x7fa83c1453a0 2024-04-25T09:05:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa83be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83c13e290 0x7fa83c1649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa83be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83c13e290 0x7fa83c1649c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43792/0 (socket says 172.21.15.175:43792) 2024-04-25T09:05:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa83be00640 1 -- 172.21.15.175:0/1659856332 learned_addr learned my addr 172.21.15.175:0/1659856332 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa83b400640 1 --2- 172.21.15.175:0/1659856332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa83c1453a0 0x7fa83c15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.942+0000 7fa83aa00640 1 --2- 172.21.15.175:0/1659856332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa83c15c5e0 0x7fa83c15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.946+0000 7fa83be00640 1 -- 172.21.15.175:0/1659856332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa83c1453a0 msgr2=0x7fa83c15eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.946+0000 7fa83be00640 1 --2- 172.21.15.175:0/1659856332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa83c1453a0 0x7fa83c15eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.946+0000 7fa83be00640 1 -- 172.21.15.175:0/1659856332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa83c15c5e0 msgr2=0x7fa83c15a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.946+0000 7fa83be00640 1 --2- 172.21.15.175:0/1659856332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa83c15c5e0 0x7fa83c15a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.946+0000 7fa83be00640 1 -- 172.21.15.175:0/1659856332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c0b0df0 con 0x7fa83c13e290 2024-04-25T09:05:17.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.946+0000 7fa83be00640 1 --2- 172.21.15.175:0/1659856332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83c13e290 0x7fa83c1649c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa83400efc0 tx=0x7fa83400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.946+0000 7fa833400640 1 -- 172.21.15.175:0/1659856332 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa834018020 con 0x7fa83c13e290 2024-04-25T09:05:17.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.946+0000 7fa833400640 1 -- 172.21.15.175:0/1659856332 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa834014480 con 0x7fa83c13e290 2024-04-25T09:05:17.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.946+0000 7fa842800640 1 -- 172.21.15.175:0/1659856332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83c0b10d0 con 0x7fa83c13e290 2024-04-25T09:05:17.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.946+0000 7fa833400640 1 -- 172.21.15.175:0/1659856332 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa834014870 con 0x7fa83c13e290 2024-04-25T09:05:17.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.946+0000 7fa842800640 1 -- 172.21.15.175:0/1659856332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83c15b7e0 con 0x7fa83c13e290 2024-04-25T09:05:17.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.946+0000 7fa842800640 1 -- 172.21.15.175:0/1659856332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83c0b1790 con 0x7fa83c13e290 2024-04-25T09:05:17.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.946+0000 7fa833400640 1 -- 172.21.15.175:0/1659856332 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa83401b020 con 0x7fa83c13e290 2024-04-25T09:05:17.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.946+0000 7fa833400640 1 --2- 172.21.15.175:0/1659856332 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa81c066f60 0x7fa81c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.946+0000 7fa833400640 1 -- 172.21.15.175:0/1659856332 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa834085c30 con 0x7fa83c13e290 2024-04-25T09:05:17.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.946+0000 7fa83b400640 1 --2- 172.21.15.175:0/1659856332 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa81c066f60 0x7fa81c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.950+0000 7fa83b400640 1 --2- 172.21.15.175:0/1659856332 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa81c066f60 0x7fa81c069420 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0af000 tx=0x7fa82c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:17.950+0000 7fa833400640 1 -- 172.21.15.175:0/1659856332 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa83c0b1790 con 0x7fa83c13e290 2024-04-25T09:05:18.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:18.138+0000 7fa842800640 1 -- 172.21.15.175:0/1659856332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa83c074a60 con 0x7fa83c13e290 2024-04-25T09:05:18.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:18.138+0000 7fa833400640 1 -- 172.21.15.175:0/1659856332 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4950 (secure 0 0 0) 0x7fa834022030 con 0x7fa83c13e290 2024-04-25T09:05:18.131 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:18.131 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2334769483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2334769483},{"type":"v1","addr":"172.21.15.177:6834","nonce":2334769483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2397222507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2397222507},{"type":"v1","addr":"172.21.15.177:6835","nonce":2397222507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5067,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2738941530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2738941530},{"type":"v1","addr":"172.21.15.175:6836","nonce":2738941530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:02.208383+0000","modified":"2024-04-25T09:05:05.231797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1909482114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1909482114},{"type":"v1","addr":"172.21.15.175:6837","nonce":1909482114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:05:18.131 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 17 2024-04-25T09:05:18.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:18.138+0000 7fa842800640 1 -- 172.21.15.175:0/1659856332 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa81c066f60 msgr2=0x7fa81c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:18.138+0000 7fa842800640 1 --2- 172.21.15.175:0/1659856332 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa81c066f60 0x7fa81c069420 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0af000 tx=0x7fa82c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:05:18.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:18.138+0000 7fa842800640 1 -- 172.21.15.175:0/1659856332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83c13e290 msgr2=0x7fa83c1649c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:18.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:18.138+0000 7fa842800640 1 --2- 172.21.15.175:0/1659856332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83c13e290 0x7fa83c1649c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa83400efc0 tx=0x7fa83400c490 comp rx=0 tx=0).stop 2024-04-25T09:05:18.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:18.138+0000 7fa842800640 1 -- 172.21.15.175:0/1659856332 shutdown_connections 2024-04-25T09:05:18.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:18.138+0000 7fa842800640 1 --2- 172.21.15.175:0/1659856332 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa81c066f60 0x7fa81c069420 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:18.138+0000 7fa842800640 1 --2- 172.21.15.175:0/1659856332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa83c13e290 0x7fa83c1649c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:18.138+0000 7fa842800640 1 --2- 172.21.15.175:0/1659856332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa83c15c5e0 0x7fa83c15a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:18.138+0000 7fa842800640 1 --2- 172.21.15.175:0/1659856332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa83c1453a0 0x7fa83c15eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:18.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:18.138+0000 7fa842800640 1 -- 172.21.15.175:0/1659856332 >> 172.21.15.175:0/1659856332 conn(0x7fa83c144fc0 msgr2=0x7fa83c165e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:18.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:18.138+0000 7fa842800640 1 -- 172.21.15.175:0/1659856332 shutdown_connections 2024-04-25T09:05:18.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:18.138+0000 7fa842800640 1 -- 172.21.15.175:0/1659856332 wait complete. 2024-04-25T09:05:18.152 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parentdir mytag 2024-04-25T09:05:18.310 INFO:teuthology.orchestra.run.smithi175.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2024-04-25T09:05:18.310 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2024-04-25T09:05:28.312 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2024-04-25T09:05:28.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1472269080 1 Processor -- start 2024-04-25T09:05:28.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1472269080 1 -- start start 2024-04-25T09:05:28.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1472269080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df964aec30 0x55df96564ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1472269080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df964af010 0x55df96587fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1472269080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df964fcce0 0x55df96588520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1472269080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df96587a40 con 0x55df964aec30 2024-04-25T09:05:28.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1472269080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df964559f0 con 0x55df964fcce0 2024-04-25T09:05:28.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1472269080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df965933a0 con 0x55df964af010 2024-04-25T09:05:28.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f146f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df964aec30 0x55df96564ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f146f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df964aec30 0x55df96564ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:55108/0 (socket says 172.21.15.175:55108) 2024-04-25T09:05:28.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f146f400640 1 -- 172.21.15.175:0/3771990655 learned_addr learned my addr 172.21.15.175:0/3771990655 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:28.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f146fe00640 1 --2- 172.21.15.175:0/3771990655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df964fcce0 0x55df96588520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1467e00640 1 --2- 172.21.15.175:0/3771990655 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df964af010 0x55df96587fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f146f400640 1 -- 172.21.15.175:0/3771990655 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df964af010 msgr2=0x55df96587fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:28.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f146f400640 1 --2- 172.21.15.175:0/3771990655 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df964af010 0x55df96587fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f146f400640 1 -- 172.21.15.175:0/3771990655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df964fcce0 msgr2=0x55df96588520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:28.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f146f400640 1 --2- 172.21.15.175:0/3771990655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df964fcce0 0x55df96588520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f146f400640 1 -- 172.21.15.175:0/3771990655 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df965688f0 con 0x55df964aec30 2024-04-25T09:05:28.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f146fe00640 1 --2- 172.21.15.175:0/3771990655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df964fcce0 0x55df96588520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:28.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1467e00640 1 --2- 172.21.15.175:0/3771990655 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df964af010 0x55df96587fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:28.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f146f400640 1 --2- 172.21.15.175:0/3771990655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df964aec30 0x55df96564ae0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1460009a10 tx=0x7f1460005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52436d25c85959f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f146e000640 1 -- 172.21.15.175:0/3771990655 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460008e60 con 0x55df964aec30 2024-04-25T09:05:28.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f146e000640 1 -- 172.21.15.175:0/3771990655 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1460018070 con 0x55df964aec30 2024-04-25T09:05:28.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f146e000640 1 -- 172.21.15.175:0/3771990655 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1460013620 con 0x55df964aec30 2024-04-25T09:05:28.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1472269080 1 -- 172.21.15.175:0/3771990655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df964aec30 msgr2=0x55df96564ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1472269080 1 --2- 172.21.15.175:0/3771990655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df964aec30 0x55df96564ae0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1460009a10 tx=0x7f1460005a10 comp rx=0 tx=0).stop 2024-04-25T09:05:28.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1472269080 1 -- 172.21.15.175:0/3771990655 shutdown_connections 2024-04-25T09:05:28.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1472269080 1 --2- 172.21.15.175:0/3771990655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df964fcce0 0x55df96588520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1472269080 1 --2- 172.21.15.175:0/3771990655 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df964af010 0x55df96587fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1472269080 1 --2- 172.21.15.175:0/3771990655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df964aec30 0x55df96564ae0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1472269080 1 -- 172.21.15.175:0/3771990655 >> 172.21.15.175:0/3771990655 conn(0x55df964af880 msgr2=0x55df964e2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:28.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1472269080 1 -- 172.21.15.175:0/3771990655 shutdown_connections 2024-04-25T09:05:28.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1472269080 1 -- 172.21.15.175:0/3771990655 wait complete. 2024-04-25T09:05:28.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.373+0000 7f1472269080 1 Processor -- start 2024-04-25T09:05:28.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f1472269080 1 -- start start 2024-04-25T09:05:28.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f1472269080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df964aec30 0x55df96583c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f1472269080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df964af010 0x55df96584140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f1472269080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df964fcce0 0x55df96622230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f1472269080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df96584e60 con 0x55df964af010 2024-04-25T09:05:28.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f1472269080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df9656f6a0 con 0x55df964fcce0 2024-04-25T09:05:28.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f1472269080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df9656f940 con 0x55df964aec30 2024-04-25T09:05:28.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f1467e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df964af010 0x55df96584140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f1467e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df964af010 0x55df96584140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:55118/0 (socket says 172.21.15.175:55118) 2024-04-25T09:05:28.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f1467e00640 1 -- 172.21.15.175:0/4077410379 learned_addr learned my addr 172.21.15.175:0/4077410379 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:28.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f146fe00640 1 --2- 172.21.15.175:0/4077410379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df964fcce0 0x55df96622230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f146f400640 1 --2- 172.21.15.175:0/4077410379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df964aec30 0x55df96583c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f1467e00640 1 -- 172.21.15.175:0/4077410379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df964aec30 msgr2=0x55df96583c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f1467e00640 1 --2- 172.21.15.175:0/4077410379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df964aec30 0x55df96583c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f1467e00640 1 -- 172.21.15.175:0/4077410379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df964fcce0 msgr2=0x55df96622230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f1467e00640 1 --2- 172.21.15.175:0/4077410379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df964fcce0 0x55df96622230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f1467e00640 1 -- 172.21.15.175:0/4077410379 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df9656fbe0 con 0x55df964af010 2024-04-25T09:05:28.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f146f400640 1 --2- 172.21.15.175:0/4077410379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df964aec30 0x55df96583c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:28.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f146fe00640 1 --2- 172.21.15.175:0/4077410379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df964fcce0 0x55df96622230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:28.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f1467e00640 1 --2- 172.21.15.175:0/4077410379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df964af010 0x55df96584140 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f145800a540 tx=0x7f145800aa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f146cc00640 1 -- 172.21.15.175:0/4077410379 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145800e640 con 0x55df964af010 2024-04-25T09:05:28.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f146cc00640 1 -- 172.21.15.175:0/4077410379 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1458014020 con 0x55df964af010 2024-04-25T09:05:28.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f146cc00640 1 -- 172.21.15.175:0/4077410379 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145800ea20 con 0x55df964af010 2024-04-25T09:05:28.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f1472269080 1 -- 172.21.15.175:0/4077410379 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55df9656fe80 con 0x55df964af010 2024-04-25T09:05:28.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.377+0000 7f1472269080 1 -- 172.21.15.175:0/4077410379 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df964f42d0 con 0x55df964af010 2024-04-25T09:05:28.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f146cc00640 1 -- 172.21.15.175:0/4077410379 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f145800ebc0 con 0x55df964af010 2024-04-25T09:05:28.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f146cc00640 1 --2- 172.21.15.175:0/4077410379 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f144c065970 0x7f144c067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f146cc00640 1 -- 172.21.15.175:0/4077410379 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14580843e0 con 0x55df964af010 2024-04-25T09:05:28.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f146f400640 1 --2- 172.21.15.175:0/4077410379 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f144c065970 0x7f144c067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f1472269080 1 --2- 172.21.15.175:0/4077410379 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55df96620da0 0x55df9662b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f1472269080 1 -- 172.21.15.175:0/4077410379 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v9 -- 0x55df9656f230 con 0x55df96620da0 2024-04-25T09:05:28.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f146fe00640 1 --2- 172.21.15.175:0/4077410379 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55df96620da0 0x55df9662b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f146f400640 1 --2- 172.21.15.175:0/4077410379 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f144c065970 0x7f144c067e30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1460000c10 tx=0x7f146000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f146fe00640 1 --2- 172.21.15.175:0/4077410379 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55df96620da0 0x55df9662b550 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f146fe00640 1 -- 172.21.15.175:0/4077410379 <== osd.3 v2:172.21.15.175:6816/4078277957 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f14680aa490 con 0x55df96620da0 2024-04-25T09:05:28.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f1472269080 1 -- 172.21.15.175:0/4077410379 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55df96620da0 msgr2=0x55df9662b550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f1472269080 1 --2- 172.21.15.175:0/4077410379 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55df96620da0 0x55df9662b550 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f1472269080 1 -- 172.21.15.175:0/4077410379 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f144c065970 msgr2=0x7f144c067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f1472269080 1 --2- 172.21.15.175:0/4077410379 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f144c065970 0x7f144c067e30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1460000c10 tx=0x7f146000b040 comp rx=0 tx=0).stop 2024-04-25T09:05:28.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f1472269080 1 -- 172.21.15.175:0/4077410379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df964af010 msgr2=0x55df96584140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f1472269080 1 --2- 172.21.15.175:0/4077410379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df964af010 0x55df96584140 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f145800a540 tx=0x7f145800aa00 comp rx=0 tx=0).stop 2024-04-25T09:05:28.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f146fe00640 1 -- 172.21.15.175:0/4077410379 reap_dead start 2024-04-25T09:05:28.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f1472269080 1 -- 172.21.15.175:0/4077410379 shutdown_connections 2024-04-25T09:05:28.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f1472269080 1 -- 172.21.15.175:0/4077410379 >> 172.21.15.175:0/4077410379 conn(0x55df964af880 msgr2=0x55df964e2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:28.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f1472269080 1 -- 172.21.15.175:0/4077410379 shutdown_connections 2024-04-25T09:05:28.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.381+0000 7f1472269080 1 -- 172.21.15.175:0/4077410379 wait complete. 2024-04-25T09:05:28.381 INFO:teuthology.orchestra.run.smithi175.stdout:mytag 2024-04-25T09:05:28.381 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2024-04-25T09:05:28.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.433+0000 7fb41609b080 1 Processor -- start 2024-04-25T09:05:28.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.433+0000 7fb41609b080 1 -- start start 2024-04-25T09:05:28.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb41609b080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562250df8740 0x562250e1f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb41609b080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562250df8b20 0x562250d817d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb41609b080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562250df9000 0x562250d80a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb41609b080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562250df9c50 con 0x562250df8740 2024-04-25T09:05:28.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb41609b080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x562250ce69f0 con 0x562250df9000 2024-04-25T09:05:28.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb41609b080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x562250df9ef0 con 0x562250df8b20 2024-04-25T09:05:28.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb413200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562250df8740 0x562250e1f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb413200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562250df8740 0x562250e1f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:55124/0 (socket says 172.21.15.175:55124) 2024-04-25T09:05:28.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb413200640 1 -- 172.21.15.175:0/4122232404 learned_addr learned my addr 172.21.15.175:0/4122232404 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:28.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb412800640 1 --2- 172.21.15.175:0/4122232404 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562250df8b20 0x562250d817d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb413c00640 1 --2- 172.21.15.175:0/4122232404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562250df9000 0x562250d80a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb413200640 1 -- 172.21.15.175:0/4122232404 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562250df8b20 msgr2=0x562250d817d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:28.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb413200640 1 --2- 172.21.15.175:0/4122232404 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562250df8b20 0x562250d817d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb413200640 1 -- 172.21.15.175:0/4122232404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562250df9000 msgr2=0x562250d80a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:28.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb413200640 1 --2- 172.21.15.175:0/4122232404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562250df9000 0x562250d80a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb413200640 1 -- 172.21.15.175:0/4122232404 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562250d81d10 con 0x562250df8740 2024-04-25T09:05:28.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb413c00640 1 --2- 172.21.15.175:0/4122232404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562250df9000 0x562250d80a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:28.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb413200640 1 --2- 172.21.15.175:0/4122232404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562250df8740 0x562250e1f2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb40400b2f0 tx=0x7fb40400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff94a6c072508d71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb411400640 1 -- 172.21.15.175:0/4122232404 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40400d510 con 0x562250df8740 2024-04-25T09:05:28.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb411400640 1 -- 172.21.15.175:0/4122232404 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb404008070 con 0x562250df8740 2024-04-25T09:05:28.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb411400640 1 -- 172.21.15.175:0/4122232404 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40400d8d0 con 0x562250df8740 2024-04-25T09:05:28.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb41609b080 1 -- 172.21.15.175:0/4122232404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562250df8740 msgr2=0x562250e1f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb41609b080 1 --2- 172.21.15.175:0/4122232404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562250df8740 0x562250e1f2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb40400b2f0 tx=0x7fb40400b7b0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb41609b080 1 -- 172.21.15.175:0/4122232404 shutdown_connections 2024-04-25T09:05:28.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb41609b080 1 --2- 172.21.15.175:0/4122232404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562250df9000 0x562250d80a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb41609b080 1 --2- 172.21.15.175:0/4122232404 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562250df8b20 0x562250d817d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb41609b080 1 --2- 172.21.15.175:0/4122232404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562250df8740 0x562250e1f2f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb41609b080 1 -- 172.21.15.175:0/4122232404 >> 172.21.15.175:0/4122232404 conn(0x562250d40420 msgr2=0x562250dfafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:28.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb41609b080 1 -- 172.21.15.175:0/4122232404 shutdown_connections 2024-04-25T09:05:28.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb41609b080 1 -- 172.21.15.175:0/4122232404 wait complete. 2024-04-25T09:05:28.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb41609b080 1 Processor -- start 2024-04-25T09:05:28.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.437+0000 7fb41609b080 1 -- start start 2024-04-25T09:05:28.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb41609b080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562250df8740 0x562250e18360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb41609b080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562250df8b20 0x562250e0aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb41609b080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562250df9000 0x562250d80a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb41609b080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562250e1f050 con 0x562250df8b20 2024-04-25T09:05:28.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb41609b080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x562250e1ee00 con 0x562250df9000 2024-04-25T09:05:28.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb41609b080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x562250d6bee0 con 0x562250df8740 2024-04-25T09:05:28.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb412800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562250df8b20 0x562250e0aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb412800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562250df8b20 0x562250e0aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:55132/0 (socket says 172.21.15.175:55132) 2024-04-25T09:05:28.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb412800640 1 -- 172.21.15.175:0/2385491038 learned_addr learned my addr 172.21.15.175:0/2385491038 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:28.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb413200640 1 --2- 172.21.15.175:0/2385491038 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562250df8740 0x562250e18360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb413c00640 1 --2- 172.21.15.175:0/2385491038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562250df9000 0x562250d80a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb412800640 1 -- 172.21.15.175:0/2385491038 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562250df8740 msgr2=0x562250e18360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb412800640 1 --2- 172.21.15.175:0/2385491038 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562250df8740 0x562250e18360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb412800640 1 -- 172.21.15.175:0/2385491038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562250df9000 msgr2=0x562250d80a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb412800640 1 --2- 172.21.15.175:0/2385491038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562250df9000 0x562250d80a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb412800640 1 -- 172.21.15.175:0/2385491038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562250d84f10 con 0x562250df8b20 2024-04-25T09:05:28.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb413c00640 1 --2- 172.21.15.175:0/2385491038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562250df9000 0x562250d80a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:28.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb412800640 1 --2- 172.21.15.175:0/2385491038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562250df8b20 0x562250e0aae0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb40000a500 tx=0x7fb4000180c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb40be00640 1 -- 172.21.15.175:0/2385491038 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4000be070 con 0x562250df8b20 2024-04-25T09:05:28.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb40be00640 1 -- 172.21.15.175:0/2385491038 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40000a230 con 0x562250df8b20 2024-04-25T09:05:28.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb40be00640 1 -- 172.21.15.175:0/2385491038 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4000af040 con 0x562250df8b20 2024-04-25T09:05:28.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb41609b080 1 -- 172.21.15.175:0/2385491038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562250d851b0 con 0x562250df8b20 2024-04-25T09:05:28.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb41609b080 1 -- 172.21.15.175:0/2385491038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562250d856f0 con 0x562250df8b20 2024-04-25T09:05:28.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.441+0000 7fb40be00640 1 -- 172.21.15.175:0/2385491038 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb4000c1070 con 0x562250df8b20 2024-04-25T09:05:28.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb40be00640 1 --2- 172.21.15.175:0/2385491038 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb3f4065940 0x7fb3f4067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb40be00640 1 -- 172.21.15.175:0/2385491038 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb40011df90 con 0x562250df8b20 2024-04-25T09:05:28.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb413200640 1 --2- 172.21.15.175:0/2385491038 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb3f4065940 0x7fb3f4067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb41609b080 1 --2- 172.21.15.175:0/2385491038 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x562250e08460 0x562250e08840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb41609b080 1 -- 172.21.15.175:0/2385491038 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:1 4.7 4:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v9 -- 0x562250e08d80 con 0x562250e08460 2024-04-25T09:05:28.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb413c00640 1 --2- 172.21.15.175:0/2385491038 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x562250e08460 0x562250e08840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb413200640 1 --2- 172.21.15.175:0/2385491038 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb3f4065940 0x7fb3f4067e00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb40400b7f0 tx=0x7fb404008000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb413c00640 1 --2- 172.21.15.175:0/2385491038 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x562250e08460 0x562250e08840 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb413c00640 1 -- 172.21.15.175:0/2385491038 <== osd.1 v2:172.21.15.175:6802/594808902 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7fb40c011040 con 0x562250e08460 2024-04-25T09:05:28.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb41609b080 1 -- 172.21.15.175:0/2385491038 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x562250e08460 msgr2=0x562250e08840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb41609b080 1 --2- 172.21.15.175:0/2385491038 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x562250e08460 0x562250e08840 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb41609b080 1 -- 172.21.15.175:0/2385491038 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb3f4065940 msgr2=0x7fb3f4067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb41609b080 1 --2- 172.21.15.175:0/2385491038 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb3f4065940 0x7fb3f4067e00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb40400b7f0 tx=0x7fb404008000 comp rx=0 tx=0).stop 2024-04-25T09:05:28.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb41609b080 1 -- 172.21.15.175:0/2385491038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562250df8b20 msgr2=0x562250e0aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb41609b080 1 --2- 172.21.15.175:0/2385491038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562250df8b20 0x562250e0aae0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb40000a500 tx=0x7fb4000180c0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb413c00640 1 -- 172.21.15.175:0/2385491038 reap_dead start 2024-04-25T09:05:28.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb41609b080 1 -- 172.21.15.175:0/2385491038 shutdown_connections 2024-04-25T09:05:28.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb41609b080 1 -- 172.21.15.175:0/2385491038 >> 172.21.15.175:0/2385491038 conn(0x562250d40420 msgr2=0x562250d6fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:28.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb41609b080 1 -- 172.21.15.175:0/2385491038 shutdown_connections 2024-04-25T09:05:28.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.445+0000 7fb41609b080 1 -- 172.21.15.175:0/2385491038 wait complete. 2024-04-25T09:05:28.443 INFO:teuthology.orchestra.run.smithi175.stdout:mytag 2024-04-25T09:05:28.444 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-04-25T09:05:28.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.537+0000 7f24a6c4e080 1 Processor -- start 2024-04-25T09:05:28.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.537+0000 7f24a6c4e080 1 -- start start 2024-04-25T09:05:28.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.537+0000 7f24a6c4e080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b06723510 0x564b067acd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.537+0000 7f24a6c4e080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b067238f0 0x564b0670b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.537+0000 7f24a6c4e080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564b067b0550 0x564b068425a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.537+0000 7f24a6c4e080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b0670d360 con 0x564b067238f0 2024-04-25T09:05:28.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.537+0000 7f24a6c4e080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b0667f9f0 con 0x564b06723510 2024-04-25T09:05:28.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.537+0000 7f24a6c4e080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b06724f40 con 0x564b067b0550 2024-04-25T09:05:28.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.537+0000 7f24a3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b067238f0 0x564b0670b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.537+0000 7f24a3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b067238f0 0x564b0670b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:55150/0 (socket says 172.21.15.175:55150) 2024-04-25T09:05:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.537+0000 7f24a3400640 1 -- 172.21.15.175:0/1856701610 learned_addr learned my addr 172.21.15.175:0/1856701610 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.537+0000 7f24a3e00640 1 --2- 172.21.15.175:0/1856701610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b06723510 0x564b067acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.537+0000 7f24a4800640 1 --2- 172.21.15.175:0/1856701610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564b067b0550 0x564b068425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.537+0000 7f24a3400640 1 -- 172.21.15.175:0/1856701610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564b067b0550 msgr2=0x564b068425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.537+0000 7f24a3400640 1 --2- 172.21.15.175:0/1856701610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564b067b0550 0x564b068425a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.537+0000 7f24a3400640 1 -- 172.21.15.175:0/1856701610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b06723510 msgr2=0x564b067acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.537+0000 7f24a3400640 1 --2- 172.21.15.175:0/1856701610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b06723510 0x564b067acd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.537+0000 7f24a3400640 1 -- 172.21.15.175:0/1856701610 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b067af3a0 con 0x564b067238f0 2024-04-25T09:05:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a3400640 1 --2- 172.21.15.175:0/1856701610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b067238f0 0x564b0670b410 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2490009950 tx=0x7f2490005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7727641b99d1081 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a2000640 1 -- 172.21.15.175:0/1856701610 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490008d40 con 0x564b067238f0 2024-04-25T09:05:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a2000640 1 -- 172.21.15.175:0/1856701610 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2490018070 con 0x564b067238f0 2024-04-25T09:05:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a2000640 1 -- 172.21.15.175:0/1856701610 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490013640 con 0x564b067238f0 2024-04-25T09:05:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a6c4e080 1 -- 172.21.15.175:0/1856701610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b067238f0 msgr2=0x564b0670b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a6c4e080 1 --2- 172.21.15.175:0/1856701610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b067238f0 0x564b0670b410 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2490009950 tx=0x7f2490005a10 comp rx=0 tx=0).stop 2024-04-25T09:05:28.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a6c4e080 1 -- 172.21.15.175:0/1856701610 shutdown_connections 2024-04-25T09:05:28.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a6c4e080 1 --2- 172.21.15.175:0/1856701610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564b067b0550 0x564b068425a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a6c4e080 1 --2- 172.21.15.175:0/1856701610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b067238f0 0x564b0670b410 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a6c4e080 1 --2- 172.21.15.175:0/1856701610 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b06723510 0x564b067acd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a6c4e080 1 -- 172.21.15.175:0/1856701610 >> 172.21.15.175:0/1856701610 conn(0x564b06707430 msgr2=0x564b067ae9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:28.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a6c4e080 1 -- 172.21.15.175:0/1856701610 shutdown_connections 2024-04-25T09:05:28.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a6c4e080 1 -- 172.21.15.175:0/1856701610 wait complete. 2024-04-25T09:05:28.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a6c4e080 1 Processor -- start 2024-04-25T09:05:28.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a6c4e080 1 -- start start 2024-04-25T09:05:28.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a6c4e080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b06723510 0x564b06796150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a6c4e080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b067238f0 0x564b06843da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a6c4e080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564b067b0550 0x564b067985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a6c4e080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b067af640 con 0x564b06723510 2024-04-25T09:05:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a6c4e080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b067b0cc0 con 0x564b067238f0 2024-04-25T09:05:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a6c4e080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b067af8e0 con 0x564b067b0550 2024-04-25T09:05:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b06723510 0x564b06796150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b06723510 0x564b06796150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:55164/0 (socket says 172.21.15.175:55164) 2024-04-25T09:05:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a3e00640 1 -- 172.21.15.175:0/4149858358 learned_addr learned my addr 172.21.15.175:0/4149858358 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a3400640 1 --2- 172.21.15.175:0/4149858358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b067238f0 0x564b06843da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a4800640 1 --2- 172.21.15.175:0/4149858358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564b067b0550 0x564b067985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a3e00640 1 -- 172.21.15.175:0/4149858358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564b067b0550 msgr2=0x564b067985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a3e00640 1 --2- 172.21.15.175:0/4149858358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564b067b0550 0x564b067985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a3e00640 1 -- 172.21.15.175:0/4149858358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b067238f0 msgr2=0x564b06843da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a3e00640 1 --2- 172.21.15.175:0/4149858358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b067238f0 0x564b06843da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a3e00640 1 -- 172.21.15.175:0/4149858358 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b067968d0 con 0x564b06723510 2024-04-25T09:05:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a3400640 1 --2- 172.21.15.175:0/4149858358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564b067238f0 0x564b06843da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.541+0000 7f24a3e00640 1 --2- 172.21.15.175:0/4149858358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b06723510 0x564b06796150 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f24940ab040 tx=0x7f2494019cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.545+0000 7f24a0c00640 1 -- 172.21.15.175:0/4149858358 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940c1070 con 0x564b06723510 2024-04-25T09:05:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.545+0000 7f24a0c00640 1 -- 172.21.15.175:0/4149858358 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24940b2b90 con 0x564b06723510 2024-04-25T09:05:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.545+0000 7f24a0c00640 1 -- 172.21.15.175:0/4149858358 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940bc480 con 0x564b06723510 2024-04-25T09:05:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.545+0000 7f24a6c4e080 1 -- 172.21.15.175:0/4149858358 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564b06796b70 con 0x564b06723510 2024-04-25T09:05:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.545+0000 7f24a6c4e080 1 -- 172.21.15.175:0/4149858358 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b067970b0 con 0x564b06723510 2024-04-25T09:05:28.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.545+0000 7f24a0c00640 1 -- 172.21.15.175:0/4149858358 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f24940c4070 con 0x564b06723510 2024-04-25T09:05:28.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.545+0000 7f24a0c00640 1 --2- 172.21.15.175:0/4149858358 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2484065970 0x7f2484067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.545+0000 7f24a0c00640 1 -- 172.21.15.175:0/4149858358 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f249411ea30 con 0x564b06723510 2024-04-25T09:05:28.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.545+0000 7f24a3400640 1 --2- 172.21.15.175:0/4149858358 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2484065970 0x7f2484067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.545+0000 7f24a6c4e080 1 --2- 172.21.15.175:0/4149858358 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x564b068442e0 0x564b06797d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.545+0000 7f24a6c4e080 1 -- 172.21.15.175:0/4149858358 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:1 5.36 5:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v9 -- 0x564b06798b20 con 0x564b068442e0 2024-04-25T09:05:28.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.545+0000 7f24a4800640 1 --2- 172.21.15.175:0/4149858358 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x564b068442e0 0x564b06797d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.545+0000 7f24a3400640 1 --2- 172.21.15.175:0/4149858358 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2484065970 0x7f2484067e30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2490015040 tx=0x7f2490012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.545+0000 7f24a4800640 1 --2- 172.21.15.175:0/4149858358 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x564b068442e0 0x564b06797d00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.549+0000 7f24a4800640 1 -- 172.21.15.175:0/4149858358 <== osd.1 v2:172.21.15.175:6802/594808902 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f249c0015b0 con 0x564b068442e0 2024-04-25T09:05:28.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.549+0000 7f24a6c4e080 1 -- 172.21.15.175:0/4149858358 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x564b068442e0 msgr2=0x564b06797d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.549+0000 7f24a6c4e080 1 --2- 172.21.15.175:0/4149858358 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x564b068442e0 0x564b06797d00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.549+0000 7f24a6c4e080 1 -- 172.21.15.175:0/4149858358 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2484065970 msgr2=0x7f2484067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.549+0000 7f24a6c4e080 1 --2- 172.21.15.175:0/4149858358 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2484065970 0x7f2484067e30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2490015040 tx=0x7f2490012000 comp rx=0 tx=0).stop 2024-04-25T09:05:28.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.549+0000 7f24a6c4e080 1 -- 172.21.15.175:0/4149858358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b06723510 msgr2=0x564b06796150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.549+0000 7f24a6c4e080 1 --2- 172.21.15.175:0/4149858358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564b06723510 0x564b06796150 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f24940ab040 tx=0x7f2494019cb0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.549+0000 7f24a4800640 1 -- 172.21.15.175:0/4149858358 reap_dead start 2024-04-25T09:05:28.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.549+0000 7f24a6c4e080 1 -- 172.21.15.175:0/4149858358 shutdown_connections 2024-04-25T09:05:28.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.549+0000 7f24a6c4e080 1 -- 172.21.15.175:0/4149858358 >> 172.21.15.175:0/4149858358 conn(0x564b06707430 msgr2=0x564b0670b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:28.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.549+0000 7f24a6c4e080 1 -- 172.21.15.175:0/4149858358 shutdown_connections 2024-04-25T09:05:28.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.549+0000 7f24a6c4e080 1 -- 172.21.15.175:0/4149858358 wait complete. 2024-04-25T09:05:28.548 INFO:teuthology.orchestra.run.smithi175.stdout:mytag 2024-04-25T09:05:28.548 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-04-25T09:05:28.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3df0049080 1 Processor -- start 2024-04-25T09:05:28.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3df0049080 1 -- start start 2024-04-25T09:05:28.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3df0049080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55984013f740 0x55984015a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3df0049080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55984013fb20 0x5598400c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3df0049080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559840140000 0x55984015f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3df0049080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559840140c50 con 0x55984013f740 2024-04-25T09:05:28.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3df0049080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55984002d9f0 con 0x55984013fb20 2024-04-25T09:05:28.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3df0049080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x559840140ef0 con 0x559840140000 2024-04-25T09:05:28.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3dec800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55984013f740 0x55984015a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3dec800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55984013f740 0x55984015a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:55172/0 (socket says 172.21.15.175:55172) 2024-04-25T09:05:28.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3dec800640 1 -- 172.21.15.175:0/1792677027 learned_addr learned my addr 172.21.15.175:0/1792677027 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:28.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3debe00640 1 --2- 172.21.15.175:0/1792677027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55984013fb20 0x5598400c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3ded200640 1 --2- 172.21.15.175:0/1792677027 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559840140000 0x55984015f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3dec800640 1 -- 172.21.15.175:0/1792677027 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559840140000 msgr2=0x55984015f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:28.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3dec800640 1 --2- 172.21.15.175:0/1792677027 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559840140000 0x55984015f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3dec800640 1 -- 172.21.15.175:0/1792677027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55984013fb20 msgr2=0x5598400c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:28.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3dec800640 1 --2- 172.21.15.175:0/1792677027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55984013fb20 0x5598400c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3dec800640 1 -- 172.21.15.175:0/1792677027 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598400b1cc0 con 0x55984013f740 2024-04-25T09:05:28.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3debe00640 1 --2- 172.21.15.175:0/1792677027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55984013fb20 0x5598400c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:28.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3ded200640 1 --2- 172.21.15.175:0/1792677027 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559840140000 0x55984015f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:28.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3dec800640 1 --2- 172.21.15.175:0/1792677027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55984013f740 0x55984015a0b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3de000a500 tx=0x7f3de0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afedf7a9a0881525 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3deaa00640 1 -- 172.21.15.175:0/1792677027 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de00af040 con 0x55984013f740 2024-04-25T09:05:28.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3deaa00640 1 -- 172.21.15.175:0/1792677027 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de00b9070 con 0x55984013f740 2024-04-25T09:05:28.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3deaa00640 1 -- 172.21.15.175:0/1792677027 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de00aadb0 con 0x55984013f740 2024-04-25T09:05:28.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3df0049080 1 -- 172.21.15.175:0/1792677027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55984013f740 msgr2=0x55984015a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3df0049080 1 --2- 172.21.15.175:0/1792677027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55984013f740 0x55984015a0b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3de000a500 tx=0x7f3de0003030 comp rx=0 tx=0).stop 2024-04-25T09:05:28.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3df0049080 1 -- 172.21.15.175:0/1792677027 shutdown_connections 2024-04-25T09:05:28.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3df0049080 1 --2- 172.21.15.175:0/1792677027 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559840140000 0x55984015f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3df0049080 1 --2- 172.21.15.175:0/1792677027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55984013fb20 0x5598400c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3df0049080 1 --2- 172.21.15.175:0/1792677027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55984013f740 0x55984015a0b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3df0049080 1 -- 172.21.15.175:0/1792677027 >> 172.21.15.175:0/1792677027 conn(0x559840087420 msgr2=0x559840141fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:28.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3df0049080 1 -- 172.21.15.175:0/1792677027 shutdown_connections 2024-04-25T09:05:28.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.645+0000 7f3df0049080 1 -- 172.21.15.175:0/1792677027 wait complete. 2024-04-25T09:05:28.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3df0049080 1 Processor -- start 2024-04-25T09:05:28.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3df0049080 1 -- start start 2024-04-25T09:05:28.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3df0049080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55984013f740 0x55984015d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3df0049080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55984013fb20 0x55984013ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3df0049080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559840140000 0x55984013f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3df0049080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55984015eb30 con 0x559840140000 2024-04-25T09:05:28.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3df0049080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55984015e8d0 con 0x55984013fb20 2024-04-25T09:05:28.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3df0049080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55984015edd0 con 0x55984013f740 2024-04-25T09:05:28.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3ded200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559840140000 0x55984013f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3ded200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559840140000 0x55984013f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:55184/0 (socket says 172.21.15.175:55184) 2024-04-25T09:05:28.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3ded200640 1 -- 172.21.15.175:0/2537286757 learned_addr learned my addr 172.21.15.175:0/2537286757 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:28.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3dec800640 1 --2- 172.21.15.175:0/2537286757 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55984013f740 0x55984015d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3debe00640 1 --2- 172.21.15.175:0/2537286757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55984013fb20 0x55984013ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3ded200640 1 -- 172.21.15.175:0/2537286757 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55984013f740 msgr2=0x55984015d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3ded200640 1 --2- 172.21.15.175:0/2537286757 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55984013f740 0x55984015d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3ded200640 1 -- 172.21.15.175:0/2537286757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55984013fb20 msgr2=0x55984013ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3ded200640 1 --2- 172.21.15.175:0/2537286757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55984013fb20 0x55984013ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3ded200640 1 -- 172.21.15.175:0/2537286757 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598401f7880 con 0x559840140000 2024-04-25T09:05:28.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3dec800640 1 --2- 172.21.15.175:0/2537286757 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55984013f740 0x55984015d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:28.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3debe00640 1 --2- 172.21.15.175:0/2537286757 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55984013fb20 0x55984013ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:28.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3ded200640 1 --2- 172.21.15.175:0/2537286757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559840140000 0x55984013f130 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3de400f5b0 tx=0x7f3de400fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3de9600640 1 -- 172.21.15.175:0/2537286757 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4019020 con 0x559840140000 2024-04-25T09:05:28.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3de9600640 1 -- 172.21.15.175:0/2537286757 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de4015690 con 0x559840140000 2024-04-25T09:05:28.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3df0049080 1 -- 172.21.15.175:0/2537286757 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5598401f7b20 con 0x559840140000 2024-04-25T09:05:28.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3de9600640 1 -- 172.21.15.175:0/2537286757 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4015a80 con 0x559840140000 2024-04-25T09:05:28.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.649+0000 7f3df0049080 1 -- 172.21.15.175:0/2537286757 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5598401f8060 con 0x559840140000 2024-04-25T09:05:28.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3de9600640 1 -- 172.21.15.175:0/2537286757 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3de401c020 con 0x559840140000 2024-04-25T09:05:28.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3de9600640 1 --2- 172.21.15.175:0/2537286757 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3dcc065940 0x7f3dcc067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3de9600640 1 -- 172.21.15.175:0/2537286757 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3de4084370 con 0x559840140000 2024-04-25T09:05:28.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3dec800640 1 --2- 172.21.15.175:0/2537286757 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3dcc065940 0x7f3dcc067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3df0049080 1 --2- 172.21.15.175:0/2537286757 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55984015dd40 0x5598400ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3df0049080 1 -- 172.21.15.175:0/2537286757 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:1 5.19 5:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v9 -- 0x5598400cae70 con 0x55984015dd40 2024-04-25T09:05:28.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3debe00640 1 --2- 172.21.15.175:0/2537286757 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55984015dd40 0x5598400ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3dec800640 1 --2- 172.21.15.175:0/2537286757 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3dcc065940 0x7f3dcc067e00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3de0005930 tx=0x7f3de00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3debe00640 1 --2- 172.21.15.175:0/2537286757 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55984015dd40 0x5598400ca930 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3debe00640 1 -- 172.21.15.175:0/2537286757 <== osd.1 v2:172.21.15.175:6802/594808902 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f3dd8008040 con 0x55984015dd40 2024-04-25T09:05:28.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3df0049080 1 -- 172.21.15.175:0/2537286757 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55984015dd40 msgr2=0x5598400ca930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3df0049080 1 --2- 172.21.15.175:0/2537286757 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55984015dd40 0x5598400ca930 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3df0049080 1 -- 172.21.15.175:0/2537286757 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3dcc065940 msgr2=0x7f3dcc067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3df0049080 1 --2- 172.21.15.175:0/2537286757 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3dcc065940 0x7f3dcc067e00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3de0005930 tx=0x7f3de00a7000 comp rx=0 tx=0).stop 2024-04-25T09:05:28.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3df0049080 1 -- 172.21.15.175:0/2537286757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559840140000 msgr2=0x55984013f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3df0049080 1 --2- 172.21.15.175:0/2537286757 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559840140000 0x55984013f130 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3de400f5b0 tx=0x7f3de400fa70 comp rx=0 tx=0).stop 2024-04-25T09:05:28.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3ded200640 1 -- 172.21.15.175:0/2537286757 reap_dead start 2024-04-25T09:05:28.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3df0049080 1 -- 172.21.15.175:0/2537286757 shutdown_connections 2024-04-25T09:05:28.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3df0049080 1 -- 172.21.15.175:0/2537286757 >> 172.21.15.175:0/2537286757 conn(0x559840087420 msgr2=0x559840142210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:28.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3df0049080 1 -- 172.21.15.175:0/2537286757 shutdown_connections 2024-04-25T09:05:28.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.653+0000 7f3df0049080 1 -- 172.21.15.175:0/2537286757 wait complete. 2024-04-25T09:05:28.652 INFO:teuthology.orchestra.run.smithi175.stdout:mytag 2024-04-25T09:05:28.652 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-04-25T09:05:28.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6323d91080 1 Processor -- start 2024-04-25T09:05:28.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6323d91080 1 -- start start 2024-04-25T09:05:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6323d91080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0f091c740 0x55b0f08a5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6323d91080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b0f091cb20 0x55b0f0937aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6323d91080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0f091d000 0x55b0f093b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6323d91080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f091dc50 con 0x55b0f091c740 2024-04-25T09:05:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6323d91080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f080a9f0 con 0x55b0f091d000 2024-04-25T09:05:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6323d91080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0f091def0 con 0x55b0f091cb20 2024-04-25T09:05:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6321000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0f091c740 0x55b0f08a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6321000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0f091c740 0x55b0f08a5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:55196/0 (socket says 172.21.15.175:55196) 2024-04-25T09:05:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6321000640 1 -- 172.21.15.175:0/478782219 learned_addr learned my addr 172.21.15.175:0/478782219 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f631be00640 1 --2- 172.21.15.175:0/478782219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b0f091cb20 0x55b0f0937aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6321000640 1 -- 172.21.15.175:0/478782219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b0f091cb20 msgr2=0x55b0f0937aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6321a00640 1 --2- 172.21.15.175:0/478782219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0f091d000 0x55b0f093b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6321000640 1 --2- 172.21.15.175:0/478782219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b0f091cb20 0x55b0f0937aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6321000640 1 -- 172.21.15.175:0/478782219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0f091d000 msgr2=0x55b0f093b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6321000640 1 --2- 172.21.15.175:0/478782219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0f091d000 0x55b0f093b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6321000640 1 -- 172.21.15.175:0/478782219 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0f08a5d40 con 0x55b0f091c740 2024-04-25T09:05:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f631be00640 1 --2- 172.21.15.175:0/478782219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b0f091cb20 0x55b0f0937aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6321a00640 1 --2- 172.21.15.175:0/478782219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0f091d000 0x55b0f093b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6321000640 1 --2- 172.21.15.175:0/478782219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0f091c740 0x55b0f08a5800 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f631400b320 tx=0x7f631400b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5989a65a51ebc81a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f631aa00640 1 -- 172.21.15.175:0/478782219 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631400d510 con 0x55b0f091c740 2024-04-25T09:05:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f631aa00640 1 -- 172.21.15.175:0/478782219 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6314008070 con 0x55b0f091c740 2024-04-25T09:05:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f631aa00640 1 -- 172.21.15.175:0/478782219 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631400d8b0 con 0x55b0f091c740 2024-04-25T09:05:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6323d91080 1 -- 172.21.15.175:0/478782219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0f091c740 msgr2=0x55b0f08a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6323d91080 1 --2- 172.21.15.175:0/478782219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0f091c740 0x55b0f08a5800 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f631400b320 tx=0x7f631400b7e0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6323d91080 1 -- 172.21.15.175:0/478782219 shutdown_connections 2024-04-25T09:05:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6323d91080 1 --2- 172.21.15.175:0/478782219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0f091d000 0x55b0f093b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6323d91080 1 --2- 172.21.15.175:0/478782219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b0f091cb20 0x55b0f0937aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6323d91080 1 --2- 172.21.15.175:0/478782219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0f091c740 0x55b0f08a5800 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6323d91080 1 -- 172.21.15.175:0/478782219 >> 172.21.15.175:0/478782219 conn(0x55b0f0864420 msgr2=0x55b0f091efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6323d91080 1 -- 172.21.15.175:0/478782219 shutdown_connections 2024-04-25T09:05:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6323d91080 1 -- 172.21.15.175:0/478782219 wait complete. 2024-04-25T09:05:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.745+0000 7f6323d91080 1 Processor -- start 2024-04-25T09:05:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6323d91080 1 -- start start 2024-04-25T09:05:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6323d91080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0f091c740 0x55b0f093bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6323d91080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b0f091cb20 0x55b0f0936780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6323d91080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0f091d000 0x55b0f0936cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6323d91080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f08a4e20 con 0x55b0f091c740 2024-04-25T09:05:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6323d91080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f08a4b80 con 0x55b0f091d000 2024-04-25T09:05:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6323d91080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0f08a50c0 con 0x55b0f091cb20 2024-04-25T09:05:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6321000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0f091c740 0x55b0f093bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6321000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0f091c740 0x55b0f093bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:55200/0 (socket says 172.21.15.175:55200) 2024-04-25T09:05:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6321000640 1 -- 172.21.15.175:0/1019758411 learned_addr learned my addr 172.21.15.175:0/1019758411 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6321000640 1 -- 172.21.15.175:0/1019758411 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b0f091cb20 msgr2=0x55b0f0936780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6321000640 1 --2- 172.21.15.175:0/1019758411 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b0f091cb20 0x55b0f0936780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6321000640 1 -- 172.21.15.175:0/1019758411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0f091d000 msgr2=0x55b0f0936cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6321000640 1 --2- 172.21.15.175:0/1019758411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b0f091d000 0x55b0f0936cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6321000640 1 -- 172.21.15.175:0/1019758411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0f08a90a0 con 0x55b0f091c740 2024-04-25T09:05:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6321000640 1 --2- 172.21.15.175:0/1019758411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0f091c740 0x55b0f093bfc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f631400b820 tx=0x7f6314000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6319600640 1 -- 172.21.15.175:0/1019758411 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314020070 con 0x55b0f091c740 2024-04-25T09:05:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6319600640 1 -- 172.21.15.175:0/1019758411 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631401c870 con 0x55b0f091c740 2024-04-25T09:05:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6323d91080 1 -- 172.21.15.175:0/1019758411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b0f08a9340 con 0x55b0f091c740 2024-04-25T09:05:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6319600640 1 -- 172.21.15.175:0/1019758411 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631401cc60 con 0x55b0f091c740 2024-04-25T09:05:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6323d91080 1 -- 172.21.15.175:0/1019758411 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0f08a9880 con 0x55b0f091c740 2024-04-25T09:05:28.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.749+0000 7f6319600640 1 -- 172.21.15.175:0/1019758411 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6314023070 con 0x55b0f091c740 2024-04-25T09:05:28.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f6319600640 1 --2- 172.21.15.175:0/1019758411 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6300065970 0x7f6300067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f6319600640 1 -- 172.21.15.175:0/1019758411 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6314085ea0 con 0x55b0f091c740 2024-04-25T09:05:28.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f631be00640 1 --2- 172.21.15.175:0/1019758411 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6300065970 0x7f6300067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f6323d91080 1 --2- 172.21.15.175:0/1019758411 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55b0f093c500 0x55b0f09d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:28.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f6323d91080 1 -- 172.21.15.175:0/1019758411 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:1 5.12 5:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v9 -- 0x55b0f09d2f90 con 0x55b0f093c500 2024-04-25T09:05:28.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f6321a00640 1 --2- 172.21.15.175:0/1019758411 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55b0f093c500 0x55b0f09d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:28.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f631be00640 1 --2- 172.21.15.175:0/1019758411 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6300065970 0x7f6300067e30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f630c0ac000 tx=0x7f630c003030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f6321a00640 1 --2- 172.21.15.175:0/1019758411 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55b0f093c500 0x55b0f09d2a50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:28.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f6321a00640 1 -- 172.21.15.175:0/1019758411 <== osd.1 v2:172.21.15.175:6802/594808902 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f631c00c780 con 0x55b0f093c500 2024-04-25T09:05:28.751 INFO:teuthology.orchestra.run.smithi175.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2024-04-25T09:05:28.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f6323d91080 1 -- 172.21.15.175:0/1019758411 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55b0f093c500 msgr2=0x55b0f09d2a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f6323d91080 1 --2- 172.21.15.175:0/1019758411 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55b0f093c500 0x55b0f09d2a50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f6323d91080 1 -- 172.21.15.175:0/1019758411 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6300065970 msgr2=0x7f6300067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f6323d91080 1 --2- 172.21.15.175:0/1019758411 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6300065970 0x7f6300067e30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f630c0ac000 tx=0x7f630c003030 comp rx=0 tx=0).stop 2024-04-25T09:05:28.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f6323d91080 1 -- 172.21.15.175:0/1019758411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0f091c740 msgr2=0x55b0f093bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:28.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f6323d91080 1 --2- 172.21.15.175:0/1019758411 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b0f091c740 0x55b0f093bfc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f631400b820 tx=0x7f6314000ee0 comp rx=0 tx=0).stop 2024-04-25T09:05:28.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f6321a00640 1 -- 172.21.15.175:0/1019758411 reap_dead start 2024-04-25T09:05:28.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f6323d91080 1 -- 172.21.15.175:0/1019758411 shutdown_connections 2024-04-25T09:05:28.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f6323d91080 1 -- 172.21.15.175:0/1019758411 >> 172.21.15.175:0/1019758411 conn(0x55b0f0864420 msgr2=0x55b0f088faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:28.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f6323d91080 1 -- 172.21.15.175:0/1019758411 shutdown_connections 2024-04-25T09:05:28.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:28.753+0000 7f6323d91080 1 -- 172.21.15.175:0/1019758411 wait complete. 2024-04-25T09:05:28.752 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:05:28.753 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:05:28.753 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:05:28.852 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:05:28.935 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:05:28.935 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:05:28.936 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:28.944 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:05:28.944 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:05:28.944 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:28.954 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:05:28.954 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:05:28.954 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:28.992 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:05:28.992 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:05:28.992 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:29.008 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:05:29.009 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:29.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.181+0000 7f5309e00640 1 Processor -- start 2024-04-25T09:05:29.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.181+0000 7f5309e00640 1 -- start start 2024-04-25T09:05:29.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.181+0000 7f5309e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f53040afa90 0x7f530406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:29.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.181+0000 7f5309e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f530406ac50 0x7f530406b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:29.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.181+0000 7f5309e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5304161ad0 con 0x7f530415d250 2024-04-25T09:05:29.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.181+0000 7f5309e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530406b5d0 con 0x7f530406ac50 2024-04-25T09:05:29.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.181+0000 7f5309e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5304161db0 con 0x7f53040afa90 2024-04-25T09:05:29.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.185+0000 7f52fbe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f530406ac50 0x7f530406b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:29.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.185+0000 7f52fbe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f530406ac50 0x7f530406b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:55204/0 (socket says 172.21.15.175:55204) 2024-04-25T09:05:29.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.185+0000 7f52fbe00640 1 -- 172.21.15.175:0/1129041869 learned_addr learned my addr 172.21.15.175:0/1129041869 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:29.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.185+0000 7f5308a00640 1 --2- 172.21.15.175:0/1129041869 >> v2:172.21.15.177:3300/0 conn(0x7f53040afa90 0x7f530406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:29.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.185+0000 7f52fbe00640 1 -- 172.21.15.175:0/1129041869 >> v2:172.21.15.177:3300/0 conn(0x7f53040afa90 msgr2=0x7f530406ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:29.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.185+0000 7f52fbe00640 1 --2- 172.21.15.175:0/1129041869 >> v2:172.21.15.177:3300/0 conn(0x7f53040afa90 0x7f530406ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.185+0000 7f52fbe00640 1 -- 172.21.15.175:0/1129041869 >> v1:172.21.15.177:6789/0 conn(0x7f530415d250 legacy=0x7f530415d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:29.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.185+0000 7f52fbe00640 1 -- 172.21.15.175:0/1129041869 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5304162090 con 0x7f530406ac50 2024-04-25T09:05:29.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.185+0000 7f52fbe00640 1 --2- 172.21.15.175:0/1129041869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f530406ac50 0x7f530406b090 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f53040d1670 tx=0x7f52ec01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b133b4aab1a6d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:29.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.185+0000 7f5303e00640 1 -- 172.21.15.175:0/1129041869 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0b0070 con 0x7f530406ac50 2024-04-25T09:05:29.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.185+0000 7f5303e00640 1 -- 172.21.15.175:0/1129041869 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec0ab600 con 0x7f530406ac50 2024-04-25T09:05:29.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.185+0000 7f5303e00640 1 -- 172.21.15.175:0/1129041869 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0ab9d0 con 0x7f530406ac50 2024-04-25T09:05:29.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f5309e00640 1 -- 172.21.15.175:0/1129041869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f530406ac50 msgr2=0x7f530406b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:29.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f5309e00640 1 --2- 172.21.15.175:0/1129041869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f530406ac50 0x7f530406b090 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f53040d1670 tx=0x7f52ec01c490 comp rx=0 tx=0).stop 2024-04-25T09:05:29.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f5309e00640 1 -- 172.21.15.175:0/1129041869 shutdown_connections 2024-04-25T09:05:29.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f5309e00640 1 --2- 172.21.15.175:0/1129041869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f530406ac50 0x7f530406b090 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f5309e00640 1 --2- 172.21.15.175:0/1129041869 >> v2:172.21.15.177:3300/0 conn(0x7f53040afa90 0x7f530406ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f5309e00640 1 -- 172.21.15.175:0/1129041869 >> 172.21.15.175:0/1129041869 conn(0x7f53040727b0 msgr2=0x7f5304099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:29.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f5309e00640 1 -- 172.21.15.175:0/1129041869 shutdown_connections 2024-04-25T09:05:29.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f5309e00640 1 -- 172.21.15.175:0/1129041869 wait complete. 2024-04-25T09:05:29.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f5309e00640 1 Processor -- start 2024-04-25T09:05:29.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f5309e00640 1 -- start start 2024-04-25T09:05:29.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f5309e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f530406ac50 0x7f530414fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:29.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f5309e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53040afa90 0x7f5304154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:29.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f5309e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f530415d250 0x7f5304155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:29.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f5309e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53040cb8c0 con 0x7f53040afa90 2024-04-25T09:05:29.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f5309e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53040cb740 con 0x7f530415d250 2024-04-25T09:05:29.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f5309e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53040cba40 con 0x7f530406ac50 2024-04-25T09:05:29.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f52fbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53040afa90 0x7f5304154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:29.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f52fbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53040afa90 0x7f5304154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:55218/0 (socket says 172.21.15.175:55218) 2024-04-25T09:05:29.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f52fbe00640 1 -- 172.21.15.175:0/3096289558 learned_addr learned my addr 172.21.15.175:0/3096289558 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:29.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f5308a00640 1 --2- 172.21.15.175:0/3096289558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f530406ac50 0x7f530414fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:29.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f5309400640 1 --2- 172.21.15.175:0/3096289558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f530415d250 0x7f5304155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:29.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f52fbe00640 1 -- 172.21.15.175:0/3096289558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f530406ac50 msgr2=0x7f530414fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:29.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f52fbe00640 1 --2- 172.21.15.175:0/3096289558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f530406ac50 0x7f530414fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f52fbe00640 1 -- 172.21.15.175:0/3096289558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f530415d250 msgr2=0x7f5304155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:29.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f52fbe00640 1 --2- 172.21.15.175:0/3096289558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f530415d250 0x7f5304155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.189+0000 7f52fbe00640 1 -- 172.21.15.175:0/3096289558 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53040c80b0 con 0x7f53040afa90 2024-04-25T09:05:29.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.193+0000 7f52fbe00640 1 --2- 172.21.15.175:0/3096289558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53040afa90 0x7f5304154a90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0ae040 tx=0x7f52ec019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:29.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.193+0000 7f5301600640 1 -- 172.21.15.175:0/3096289558 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0b0040 con 0x7f53040afa90 2024-04-25T09:05:29.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.193+0000 7f5309e00640 1 -- 172.21.15.175:0/3096289558 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53040c8390 con 0x7f53040afa90 2024-04-25T09:05:29.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.193+0000 7f5301600640 1 -- 172.21.15.175:0/3096289558 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec0b4420 con 0x7f53040afa90 2024-04-25T09:05:29.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.193+0000 7f5301600640 1 -- 172.21.15.175:0/3096289558 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0b4810 con 0x7f53040afa90 2024-04-25T09:05:29.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.193+0000 7f5309e00640 1 -- 172.21.15.175:0/3096289558 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53040c8950 con 0x7f53040afa90 2024-04-25T09:05:29.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.193+0000 7f5309e00640 1 -- 172.21.15.175:0/3096289558 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5304074a60 con 0x7f53040afa90 2024-04-25T09:05:29.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.193+0000 7f5301600640 1 -- 172.21.15.175:0/3096289558 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f52ec0b49b0 con 0x7f53040afa90 2024-04-25T09:05:29.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.193+0000 7f5301600640 1 --2- 172.21.15.175:0/3096289558 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f52e0066f60 0x7f52e0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:29.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.193+0000 7f5301600640 1 -- 172.21.15.175:0/3096289558 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52ec11ec00 con 0x7f53040afa90 2024-04-25T09:05:29.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.193+0000 7f5308a00640 1 --2- 172.21.15.175:0/3096289558 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f52e0066f60 0x7f52e0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:29.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.197+0000 7f5308a00640 1 --2- 172.21.15.175:0/3096289558 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f52e0066f60 0x7f52e0069420 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009b60 tx=0x7f52f4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:29.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.197+0000 7f5301600640 1 -- 172.21.15.175:0/3096289558 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f52ec016110 con 0x7f53040afa90 2024-04-25T09:05:29.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.381+0000 7f5309e00640 1 -- 172.21.15.175:0/3096289558 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53040d0da0 con 0x7f53040afa90 2024-04-25T09:05:29.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.381+0000 7f5301600640 1 -- 172.21.15.175:0/3096289558 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f52ec0efb70 con 0x7f53040afa90 2024-04-25T09:05:29.373 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:29.373 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2334769483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2334769483},{"type":"v1","addr":"172.21.15.177:6834","nonce":2334769483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2397222507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2397222507},{"type":"v1","addr":"172.21.15.177:6835","nonce":2397222507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5067,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2738941530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2738941530},{"type":"v1","addr":"172.21.15.175:6836","nonce":2738941530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:02.208383+0000","modified":"2024-04-25T09:05:05.231797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1909482114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1909482114},{"type":"v1","addr":"172.21.15.175:6837","nonce":1909482114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:05:29.373 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 17 2024-04-25T09:05:29.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.385+0000 7f5309e00640 1 -- 172.21.15.175:0/3096289558 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f52e0066f60 msgr2=0x7f52e0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:29.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.385+0000 7f5309e00640 1 --2- 172.21.15.175:0/3096289558 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f52e0066f60 0x7f52e0069420 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009b60 tx=0x7f52f4009190 comp rx=0 tx=0).stop 2024-04-25T09:05:29.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.385+0000 7f5309e00640 1 -- 172.21.15.175:0/3096289558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53040afa90 msgr2=0x7f5304154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:29.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.385+0000 7f5309e00640 1 --2- 172.21.15.175:0/3096289558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53040afa90 0x7f5304154a90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0ae040 tx=0x7f52ec019230 comp rx=0 tx=0).stop 2024-04-25T09:05:29.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.385+0000 7f5309e00640 1 -- 172.21.15.175:0/3096289558 shutdown_connections 2024-04-25T09:05:29.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.385+0000 7f5309e00640 1 --2- 172.21.15.175:0/3096289558 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f52e0066f60 0x7f52e0069420 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.385+0000 7f5309e00640 1 --2- 172.21.15.175:0/3096289558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f530415d250 0x7f5304155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.385+0000 7f5309e00640 1 --2- 172.21.15.175:0/3096289558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53040afa90 0x7f5304154a90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.385+0000 7f5309e00640 1 --2- 172.21.15.175:0/3096289558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f530406ac50 0x7f530414fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.385+0000 7f5309e00640 1 -- 172.21.15.175:0/3096289558 >> 172.21.15.175:0/3096289558 conn(0x7f53040727b0 msgr2=0x7f530406e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:29.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.385+0000 7f5309e00640 1 -- 172.21.15.175:0/3096289558 shutdown_connections 2024-04-25T09:05:29.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.385+0000 7f5309e00640 1 -- 172.21.15.175:0/3096289558 wait complete. 2024-04-25T09:05:29.395 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:29.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.541+0000 7fba47800640 1 Processor -- start 2024-04-25T09:05:29.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.541+0000 7fba47800640 1 -- start start 2024-04-25T09:05:29.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.541+0000 7fba47800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba401453a0 0x7fba4015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:29.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.541+0000 7fba47800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fba4015c410 0x7fba400cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:29.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.541+0000 7fba47800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4015cd00 con 0x7fba40144fc0 2024-04-25T09:05:29.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.541+0000 7fba47800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba400ce660 con 0x7fba4015c410 2024-04-25T09:05:29.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.541+0000 7fba47800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4015c840 con 0x7fba401453a0 2024-04-25T09:05:29.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.541+0000 7fba44e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fba40144fc0 0x7fba400cbe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39418/0 (socket says 172.21.15.175:39418) 2024-04-25T09:05:29.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.541+0000 7fba44e00640 1 -- 172.21.15.175:0/2809999959 learned_addr learned my addr 172.21.15.175:0/2809999959 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:29.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.541+0000 7fba45800640 1 --2- 172.21.15.175:0/2809999959 >> v2:172.21.15.175:3300/0 conn(0x7fba4015c410 0x7fba400cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:29.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.545+0000 7fba3fe00640 1 --2- 172.21.15.175:0/2809999959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba401453a0 0x7fba4015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:29.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.545+0000 7fba3f400640 1 -- 172.21.15.175:0/2809999959 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208769773 0 0) 0x7fba4015cd00 con 0x7fba40144fc0 2024-04-25T09:05:29.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.545+0000 7fba3f400640 1 -- 172.21.15.175:0/2809999959 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba24003530 con 0x7fba40144fc0 2024-04-25T09:05:29.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.545+0000 7fba45800640 1 -- 172.21.15.175:0/2809999959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba401453a0 msgr2=0x7fba4015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:29.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.545+0000 7fba45800640 1 --2- 172.21.15.175:0/2809999959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba401453a0 0x7fba4015bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.545+0000 7fba45800640 1 -- 172.21.15.175:0/2809999959 >> v1:172.21.15.175:6789/0 conn(0x7fba40144fc0 legacy=0x7fba400cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:29.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.545+0000 7fba45800640 1 -- 172.21.15.175:0/2809999959 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba400cc930 con 0x7fba4015c410 2024-04-25T09:05:29.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.545+0000 7fba3fe00640 1 --2- 172.21.15.175:0/2809999959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba401453a0 0x7fba4015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:29.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.545+0000 7fba45800640 1 --2- 172.21.15.175:0/2809999959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba4015c410 0x7fba400cee20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fba380097c0 tx=0x7fba3801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104c192726de8ca4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:29.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.545+0000 7fba3f400640 1 -- 172.21.15.175:0/2809999959 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba380b2070 con 0x7fba4015c410 2024-04-25T09:05:29.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.545+0000 7fba3f400640 1 -- 172.21.15.175:0/2809999959 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba380ad640 con 0x7fba4015c410 2024-04-25T09:05:29.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.545+0000 7fba3f400640 1 -- 172.21.15.175:0/2809999959 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba380ada10 con 0x7fba4015c410 2024-04-25T09:05:29.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba47800640 1 -- 172.21.15.175:0/2809999959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba4015c410 msgr2=0x7fba400cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:29.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba47800640 1 --2- 172.21.15.175:0/2809999959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba4015c410 0x7fba400cee20 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fba380097c0 tx=0x7fba3801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba47800640 1 -- 172.21.15.175:0/2809999959 shutdown_connections 2024-04-25T09:05:29.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba47800640 1 --2- 172.21.15.175:0/2809999959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba4015c410 0x7fba400cee20 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba47800640 1 --2- 172.21.15.175:0/2809999959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba401453a0 0x7fba4015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba47800640 1 -- 172.21.15.175:0/2809999959 >> 172.21.15.175:0/2809999959 conn(0x7fba40067150 msgr2=0x7fba4006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:29.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba47800640 1 -- 172.21.15.175:0/2809999959 shutdown_connections 2024-04-25T09:05:29.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba47800640 1 -- 172.21.15.175:0/2809999959 wait complete. 2024-04-25T09:05:29.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba47800640 1 Processor -- start 2024-04-25T09:05:29.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba47800640 1 -- start start 2024-04-25T09:05:29.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba47800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba401453a0 0x7fba400b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:29.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba47800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba4015c410 0x7fba400afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:29.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba47800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba400b0290 0x7fba4015cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:29.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba47800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba400cc580 con 0x7fba400b0290 2024-04-25T09:05:29.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba47800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba400cfb70 con 0x7fba401453a0 2024-04-25T09:05:29.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba47800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4015daf0 con 0x7fba4015c410 2024-04-25T09:05:29.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba45800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba400b0290 0x7fba4015cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:29.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba45800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba400b0290 0x7fba4015cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43422/0 (socket says 172.21.15.175:43422) 2024-04-25T09:05:29.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba45800640 1 -- 172.21.15.175:0/164425565 learned_addr learned my addr 172.21.15.175:0/164425565 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:29.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba3fe00640 1 --2- 172.21.15.175:0/164425565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba4015c410 0x7fba400afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:29.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba44e00640 1 --2- 172.21.15.175:0/164425565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba401453a0 0x7fba400b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:29.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba45800640 1 -- 172.21.15.175:0/164425565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba4015c410 msgr2=0x7fba400afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:29.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba45800640 1 --2- 172.21.15.175:0/164425565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba4015c410 0x7fba400afd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba45800640 1 -- 172.21.15.175:0/164425565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba401453a0 msgr2=0x7fba400b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:29.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba45800640 1 --2- 172.21.15.175:0/164425565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba401453a0 0x7fba400b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba45800640 1 -- 172.21.15.175:0/164425565 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4015ddd0 con 0x7fba400b0290 2024-04-25T09:05:29.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.549+0000 7fba44e00640 1 --2- 172.21.15.175:0/164425565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba401453a0 0x7fba400b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:29.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.553+0000 7fba45800640 1 --2- 172.21.15.175:0/164425565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba400b0290 0x7fba4015cf80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fba380b0040 tx=0x7fba38019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:29.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.553+0000 7fba3cc00640 1 -- 172.21.15.175:0/164425565 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba380ba020 con 0x7fba400b0290 2024-04-25T09:05:29.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.553+0000 7fba3cc00640 1 -- 172.21.15.175:0/164425565 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba380b6410 con 0x7fba400b0290 2024-04-25T09:05:29.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.553+0000 7fba47800640 1 -- 172.21.15.175:0/164425565 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba400af270 con 0x7fba400b0290 2024-04-25T09:05:29.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.553+0000 7fba3cc00640 1 -- 172.21.15.175:0/164425565 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba380b2040 con 0x7fba400b0290 2024-04-25T09:05:29.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.553+0000 7fba47800640 1 -- 172.21.15.175:0/164425565 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4015b4a0 con 0x7fba400b0290 2024-04-25T09:05:29.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.553+0000 7fba47800640 1 -- 172.21.15.175:0/164425565 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba40074a60 con 0x7fba400b0290 2024-04-25T09:05:29.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.553+0000 7fba3cc00640 1 -- 172.21.15.175:0/164425565 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fba380bd020 con 0x7fba400b0290 2024-04-25T09:05:29.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.553+0000 7fba3cc00640 1 --2- 172.21.15.175:0/164425565 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fba20066f60 0x7fba20069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:29.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.553+0000 7fba3cc00640 1 -- 172.21.15.175:0/164425565 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba3811ed00 con 0x7fba400b0290 2024-04-25T09:05:29.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.553+0000 7fba44e00640 1 --2- 172.21.15.175:0/164425565 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fba20066f60 0x7fba20069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:29.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.553+0000 7fba44e00640 1 --2- 172.21.15.175:0/164425565 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fba20066f60 0x7fba20069420 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fba30005c10 tx=0x7fba30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:29.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.557+0000 7fba3cc00640 1 -- 172.21.15.175:0/164425565 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fba380c4030 con 0x7fba400b0290 2024-04-25T09:05:29.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.717+0000 7fba47800640 1 -- 172.21.15.175:0/164425565 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba400cb560 con 0x7fba400b0290 2024-04-25T09:05:29.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.717+0000 7fba3cc00640 1 -- 172.21.15.175:0/164425565 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16705 (secure 0 0 0) 0x7fba38016090 con 0x7fba400b0290 2024-04-25T09:05:29.707 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:29.707 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":32,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:05:03.828685+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:59.880776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:01.208198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:29.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.717+0000 7fba47800640 1 -- 172.21.15.175:0/164425565 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fba20066f60 msgr2=0x7fba20069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:29.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.717+0000 7fba47800640 1 --2- 172.21.15.175:0/164425565 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fba20066f60 0x7fba20069420 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fba30005c10 tx=0x7fba30009040 comp rx=0 tx=0).stop 2024-04-25T09:05:29.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.717+0000 7fba47800640 1 -- 172.21.15.175:0/164425565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba400b0290 msgr2=0x7fba4015cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:29.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.717+0000 7fba47800640 1 --2- 172.21.15.175:0/164425565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba400b0290 0x7fba4015cf80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fba380b0040 tx=0x7fba38019240 comp rx=0 tx=0).stop 2024-04-25T09:05:29.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.717+0000 7fba47800640 1 -- 172.21.15.175:0/164425565 shutdown_connections 2024-04-25T09:05:29.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.717+0000 7fba47800640 1 --2- 172.21.15.175:0/164425565 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fba20066f60 0x7fba20069420 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.717+0000 7fba47800640 1 --2- 172.21.15.175:0/164425565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba400b0290 0x7fba4015cf80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.717+0000 7fba47800640 1 --2- 172.21.15.175:0/164425565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba4015c410 0x7fba400afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.717+0000 7fba47800640 1 --2- 172.21.15.175:0/164425565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba401453a0 0x7fba400b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.717+0000 7fba47800640 1 -- 172.21.15.175:0/164425565 >> 172.21.15.175:0/164425565 conn(0x7fba40144fc0 msgr2=0x7fba4006d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:29.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.717+0000 7fba47800640 1 -- 172.21.15.175:0/164425565 shutdown_connections 2024-04-25T09:05:29.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.717+0000 7fba47800640 1 -- 172.21.15.175:0/164425565 wait complete. 2024-04-25T09:05:29.727 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:59.880776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:05:01.208198+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:05:29.728 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:05:29.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.877+0000 7fcd27c00640 1 Processor -- start 2024-04-25T09:05:29.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.877+0000 7fcd27c00640 1 -- start start 2024-04-25T09:05:29.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.881+0000 7fcd27c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcd200cf6b0 0x7fcd201600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.881+0000 7fcd27c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd200ce970 0x7fcd200cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.881+0000 7fcd27c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd200cfd10 con 0x7fcd20145250 2024-04-25T09:05:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.881+0000 7fcd27c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd201605e0 con 0x7fcd200cf6b0 2024-04-25T09:05:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.881+0000 7fcd27c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2015f650 con 0x7fcd200ce970 2024-04-25T09:05:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.881+0000 7fcd25c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd200ce970 0x7fcd200cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.881+0000 7fcd1fe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcd200cf6b0 0x7fcd201600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.881+0000 7fcd25c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd200ce970 0x7fcd200cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:55474/0 (socket says 172.21.15.175:55474) 2024-04-25T09:05:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.881+0000 7fcd25c00640 1 -- 172.21.15.175:0/1298313785 learned_addr learned my addr 172.21.15.175:0/1298313785 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:29.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.881+0000 7fcd25c00640 1 -- 172.21.15.175:0/1298313785 >> v2:172.21.15.177:3300/0 conn(0x7fcd200cf6b0 msgr2=0x7fcd201600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:29.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.881+0000 7fcd25c00640 1 --2- 172.21.15.175:0/1298313785 >> v2:172.21.15.177:3300/0 conn(0x7fcd200cf6b0 0x7fcd201600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.881+0000 7fcd25c00640 1 -- 172.21.15.175:0/1298313785 >> v1:172.21.15.177:6789/0 conn(0x7fcd20145250 legacy=0x7fcd200cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:29.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.881+0000 7fcd1f400640 1 -- 172.21.15.175:0/1298313785 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125174745 0 0) 0x7fcd200cfd10 con 0x7fcd20145250 2024-04-25T09:05:29.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.881+0000 7fcd25c00640 1 -- 172.21.15.175:0/1298313785 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd200cfff0 con 0x7fcd200ce970 2024-04-25T09:05:29.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd25c00640 1 --2- 172.21.15.175:0/1298313785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd200ce970 0x7fcd200cee00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcd180098a0 tx=0x7fcd1801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b11e502535c8dc90 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:29.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd1f400640 1 -- 172.21.15.175:0/1298313785 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd180b1070 con 0x7fcd200ce970 2024-04-25T09:05:29.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd1f400640 1 -- 172.21.15.175:0/1298313785 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd180ac600 con 0x7fcd200ce970 2024-04-25T09:05:29.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd1f400640 1 -- 172.21.15.175:0/1298313785 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd180ac9d0 con 0x7fcd200ce970 2024-04-25T09:05:29.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd27c00640 1 -- 172.21.15.175:0/1298313785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd200ce970 msgr2=0x7fcd200cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:29.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd27c00640 1 --2- 172.21.15.175:0/1298313785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd200ce970 0x7fcd200cee00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcd180098a0 tx=0x7fcd1801c4b0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd27c00640 1 -- 172.21.15.175:0/1298313785 shutdown_connections 2024-04-25T09:05:29.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd27c00640 1 --2- 172.21.15.175:0/1298313785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd200ce970 0x7fcd200cee00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd27c00640 1 --2- 172.21.15.175:0/1298313785 >> v2:172.21.15.177:3300/0 conn(0x7fcd200cf6b0 0x7fcd201600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd27c00640 1 -- 172.21.15.175:0/1298313785 >> 172.21.15.175:0/1298313785 conn(0x7fcd2006ac50 msgr2=0x7fcd2006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:29.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd27c00640 1 -- 172.21.15.175:0/1298313785 shutdown_connections 2024-04-25T09:05:29.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd27c00640 1 -- 172.21.15.175:0/1298313785 wait complete. 2024-04-25T09:05:29.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd27c00640 1 Processor -- start 2024-04-25T09:05:29.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd27c00640 1 -- start start 2024-04-25T09:05:29.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd27c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd200ce970 0x7fcd20143dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:29.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd27c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd200cf6b0 0x7fcd2013ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:29.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd27c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd20145250 0x7fcd200ab630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:29.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd27c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2015c870 con 0x7fcd200cf6b0 2024-04-25T09:05:29.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.885+0000 7fcd27c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20145630 con 0x7fcd200ce970 2024-04-25T09:05:29.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd27c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2015c9f0 con 0x7fcd20145250 2024-04-25T09:05:29.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd1fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd200cf6b0 0x7fcd2013ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:29.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd25200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd200ce970 0x7fcd20143dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:29.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd1fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd200cf6b0 0x7fcd2013ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43438/0 (socket says 172.21.15.175:43438) 2024-04-25T09:05:29.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd1fe00640 1 -- 172.21.15.175:0/529791920 learned_addr learned my addr 172.21.15.175:0/529791920 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:29.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd25c00640 1 --2- 172.21.15.175:0/529791920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd20145250 0x7fcd200ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:29.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd1fe00640 1 -- 172.21.15.175:0/529791920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd20145250 msgr2=0x7fcd200ab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:29.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd1fe00640 1 --2- 172.21.15.175:0/529791920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd20145250 0x7fcd200ab630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd1fe00640 1 -- 172.21.15.175:0/529791920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd200ce970 msgr2=0x7fcd20143dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:29.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd1fe00640 1 --2- 172.21.15.175:0/529791920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd200ce970 0x7fcd20143dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:29.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd1fe00640 1 -- 172.21.15.175:0/529791920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd20142e30 con 0x7fcd200cf6b0 2024-04-25T09:05:29.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd1fe00640 1 --2- 172.21.15.175:0/529791920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd200cf6b0 0x7fcd2013ff20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00e930 tx=0x7fcd0c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:29.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd1cc00640 1 -- 172.21.15.175:0/529791920 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c017070 con 0x7fcd200cf6b0 2024-04-25T09:05:29.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd1cc00640 1 -- 172.21.15.175:0/529791920 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c00ca00 con 0x7fcd200cf6b0 2024-04-25T09:05:29.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd1cc00640 1 -- 172.21.15.175:0/529791920 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c00cdb0 con 0x7fcd200cf6b0 2024-04-25T09:05:29.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd27c00640 1 -- 172.21.15.175:0/529791920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd20143110 con 0x7fcd200cf6b0 2024-04-25T09:05:29.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd27c00640 1 -- 172.21.15.175:0/529791920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd200a8f60 con 0x7fcd200cf6b0 2024-04-25T09:05:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd27c00640 1 -- 172.21.15.175:0/529791920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd20075160 con 0x7fcd200cf6b0 2024-04-25T09:05:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd1cc00640 1 -- 172.21.15.175:0/529791920 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcd0c01a070 con 0x7fcd200cf6b0 2024-04-25T09:05:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.889+0000 7fcd1cc00640 1 --2- 172.21.15.175:0/529791920 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd00066f60 0x7fcd00069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.893+0000 7fcd1cc00640 1 -- 172.21.15.175:0/529791920 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd0c085400 con 0x7fcd200cf6b0 2024-04-25T09:05:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.893+0000 7fcd25200640 1 --2- 172.21.15.175:0/529791920 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd00066f60 0x7fcd00069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.893+0000 7fcd25200640 1 --2- 172.21.15.175:0/529791920 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd00066f60 0x7fcd00069420 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcd100012f0 tx=0x7fcd10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:29.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:29.897+0000 7fcd1cc00640 1 -- 172.21.15.175:0/529791920 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcd0c055de0 con 0x7fcd200cf6b0 2024-04-25T09:05:30.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.049+0000 7fcd27c00640 1 -- 172.21.15.175:0/529791920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd2015be40 con 0x7fcd200cf6b0 2024-04-25T09:05:30.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.049+0000 7fcd1cc00640 1 -- 172.21.15.175:0/529791920 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd0c059e80 con 0x7fcd200cf6b0 2024-04-25T09:05:30.040 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:05:30.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.053+0000 7fcd27c00640 1 -- 172.21.15.175:0/529791920 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd00066f60 msgr2=0x7fcd00069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:30.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.053+0000 7fcd27c00640 1 --2- 172.21.15.175:0/529791920 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd00066f60 0x7fcd00069420 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcd100012f0 tx=0x7fcd10009040 comp rx=0 tx=0).stop 2024-04-25T09:05:30.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.053+0000 7fcd27c00640 1 -- 172.21.15.175:0/529791920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd200cf6b0 msgr2=0x7fcd2013ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:30.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.053+0000 7fcd27c00640 1 --2- 172.21.15.175:0/529791920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd200cf6b0 0x7fcd2013ff20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00e930 tx=0x7fcd0c00edf0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.053+0000 7fcd27c00640 1 -- 172.21.15.175:0/529791920 shutdown_connections 2024-04-25T09:05:30.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.053+0000 7fcd27c00640 1 --2- 172.21.15.175:0/529791920 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd00066f60 0x7fcd00069420 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.053+0000 7fcd27c00640 1 --2- 172.21.15.175:0/529791920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd20145250 0x7fcd200ab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.053+0000 7fcd27c00640 1 --2- 172.21.15.175:0/529791920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd200cf6b0 0x7fcd2013ff20 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.053+0000 7fcd27c00640 1 --2- 172.21.15.175:0/529791920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd200ce970 0x7fcd20143dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.053+0000 7fcd27c00640 1 -- 172.21.15.175:0/529791920 >> 172.21.15.175:0/529791920 conn(0x7fcd2006ac50 msgr2=0x7fcd200b0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:30.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.053+0000 7fcd27c00640 1 -- 172.21.15.175:0/529791920 shutdown_connections 2024-04-25T09:05:30.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.053+0000 7fcd27c00640 1 -- 172.21.15.175:0/529791920 wait complete. 2024-04-25T09:05:30.061 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:05:30.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.209+0000 7f72dbc00640 1 Processor -- start 2024-04-25T09:05:30.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.209+0000 7f72dbc00640 1 -- start start 2024-04-25T09:05:30.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.209+0000 7f72dbc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f72d406ad50 0x7f72d406bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:30.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.209+0000 7f72dbc00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d406de20 con 0x7f72d40cdb60 2024-04-25T09:05:30.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.209+0000 7f72dbc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d415dfe0 con 0x7f72d406c080 2024-04-25T09:05:30.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.209+0000 7f72dbc00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d406e090 con 0x7f72d406ad50 2024-04-25T09:05:30.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.209+0000 7f72d3e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f72d406ad50 0x7f72d406bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:30.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.209+0000 7f72d9200640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f72d40cdb60 0x7f72d40cdf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39430/0 (socket says 172.21.15.175:39430) 2024-04-25T09:05:30.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.209+0000 7f72d9200640 1 -- 172.21.15.175:0/1951004407 learned_addr learned my addr 172.21.15.175:0/1951004407 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:30.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.209+0000 7f72d3e00640 1 -- 172.21.15.175:0/1951004407 >> v1:172.21.15.177:6789/0 conn(0x7f72d406c080 legacy=0x7f72d406eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:30.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.209+0000 7f72d3e00640 1 -- 172.21.15.175:0/1951004407 >> v1:172.21.15.175:6789/0 conn(0x7f72d40cdb60 legacy=0x7f72d40cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:30.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.209+0000 7f72d3e00640 1 -- 172.21.15.175:0/1951004407 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d406e370 con 0x7f72d406ad50 2024-04-25T09:05:30.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.213+0000 7f72d3e00640 1 --2- 172.21.15.175:0/1951004407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d406ad50 0x7f72d406bb40 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f72c00097c0 tx=0x7f72c001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309fcca5d3eacf29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:30.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.213+0000 7f72d3400640 1 -- 172.21.15.175:0/1951004407 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c00aa5f0 con 0x7f72d406ad50 2024-04-25T09:05:30.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.213+0000 7f72d3400640 1 -- 172.21.15.175:0/1951004407 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c00af070 con 0x7f72d406ad50 2024-04-25T09:05:30.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.213+0000 7f72d3400640 1 -- 172.21.15.175:0/1951004407 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c00aa9b0 con 0x7f72d406ad50 2024-04-25T09:05:30.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.213+0000 7f72dbc00640 1 -- 172.21.15.175:0/1951004407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d406ad50 msgr2=0x7f72d406bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:30.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.213+0000 7f72dbc00640 1 --2- 172.21.15.175:0/1951004407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d406ad50 0x7f72d406bb40 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f72c00097c0 tx=0x7f72c001c470 comp rx=0 tx=0).stop 2024-04-25T09:05:30.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.213+0000 7f72dbc00640 1 -- 172.21.15.175:0/1951004407 shutdown_connections 2024-04-25T09:05:30.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.213+0000 7f72dbc00640 1 --2- 172.21.15.175:0/1951004407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d406ad50 0x7f72d406bb40 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.213+0000 7f72dbc00640 1 -- 172.21.15.175:0/1951004407 >> 172.21.15.175:0/1951004407 conn(0x7f72d40cca10 msgr2=0x7f72d40cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:30.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.213+0000 7f72dbc00640 1 -- 172.21.15.175:0/1951004407 shutdown_connections 2024-04-25T09:05:30.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.213+0000 7f72dbc00640 1 -- 172.21.15.175:0/1951004407 wait complete. 2024-04-25T09:05:30.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72dbc00640 1 Processor -- start 2024-04-25T09:05:30.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72dbc00640 1 -- start start 2024-04-25T09:05:30.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72dbc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72d406ad50 0x7f72d4157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:30.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72dbc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72d406c080 0x7f72d415a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:30.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72dbc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d40cdb60 0x7f72d414e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:30.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72dbc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d416ba80 con 0x7f72d40cdb60 2024-04-25T09:05:30.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72dbc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d40aefd0 con 0x7f72d406c080 2024-04-25T09:05:30.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72dbc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d416bc00 con 0x7f72d406ad50 2024-04-25T09:05:30.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72d9c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d40cdb60 0x7f72d414e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:30.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72d9c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d40cdb60 0x7f72d414e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43446/0 (socket says 172.21.15.175:43446) 2024-04-25T09:05:30.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72d9c00640 1 -- 172.21.15.175:0/2654113299 learned_addr learned my addr 172.21.15.175:0/2654113299 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:30.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72d9200640 1 --2- 172.21.15.175:0/2654113299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72d406ad50 0x7f72d4157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:30.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72d3e00640 1 --2- 172.21.15.175:0/2654113299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72d406c080 0x7f72d415a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:30.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72d9c00640 1 -- 172.21.15.175:0/2654113299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72d406ad50 msgr2=0x7f72d4157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:30.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72d9c00640 1 --2- 172.21.15.175:0/2654113299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72d406ad50 0x7f72d4157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72d9c00640 1 -- 172.21.15.175:0/2654113299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72d406c080 msgr2=0x7f72d415a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:30.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72d9c00640 1 --2- 172.21.15.175:0/2654113299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72d406c080 0x7f72d415a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72d9c00640 1 -- 172.21.15.175:0/2654113299 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d4153ed0 con 0x7f72d40cdb60 2024-04-25T09:05:30.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72d9c00640 1 --2- 172.21.15.175:0/2654113299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d40cdb60 0x7f72d414e330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00c7a0 tx=0x7f72cc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:30.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72d0c00640 1 -- 172.21.15.175:0/2654113299 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc003b80 con 0x7f72d40cdb60 2024-04-25T09:05:30.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72d0c00640 1 -- 172.21.15.175:0/2654113299 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc003d20 con 0x7f72d40cdb60 2024-04-25T09:05:30.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72d0c00640 1 -- 172.21.15.175:0/2654113299 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc00aa30 con 0x7f72d40cdb60 2024-04-25T09:05:30.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72dbc00640 1 -- 172.21.15.175:0/2654113299 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d41541b0 con 0x7f72d40cdb60 2024-04-25T09:05:30.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.217+0000 7f72dbc00640 1 -- 172.21.15.175:0/2654113299 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d4154770 con 0x7f72d40cdb60 2024-04-25T09:05:30.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.221+0000 7f72dbc00640 1 -- 172.21.15.175:0/2654113299 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d4075160 con 0x7f72d40cdb60 2024-04-25T09:05:30.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.221+0000 7f72d0c00640 1 -- 172.21.15.175:0/2654113299 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f72cc00abd0 con 0x7f72d40cdb60 2024-04-25T09:05:30.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.221+0000 7f72d0c00640 1 --2- 172.21.15.175:0/2654113299 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f72b4066f60 0x7f72b4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:30.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.221+0000 7f72d0c00640 1 -- 172.21.15.175:0/2654113299 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72cc084ff0 con 0x7f72d40cdb60 2024-04-25T09:05:30.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.221+0000 7f72d9200640 1 --2- 172.21.15.175:0/2654113299 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f72b4066f60 0x7f72b4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:30.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.221+0000 7f72d9200640 1 --2- 172.21.15.175:0/2654113299 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f72b4066f60 0x7f72b4069420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f72c4005890 tx=0x7f72c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:30.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.225+0000 7f72d0c00640 1 -- 172.21.15.175:0/2654113299 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f72cc055f80 con 0x7f72d40cdb60 2024-04-25T09:05:30.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.377+0000 7f72dbc00640 1 -- 172.21.15.175:0/2654113299 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f72d4066bc0 con 0x7f72d40cdb60 2024-04-25T09:05:30.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.377+0000 7f72d0c00640 1 -- 172.21.15.175:0/2654113299 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) v1 ==== 104+0+11 (secure 0 0 0) 0x7f72cc055880 con 0x7f72d40cdb60 2024-04-25T09:05:30.368 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:05:30.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.381+0000 7f72dbc00640 1 -- 172.21.15.175:0/2654113299 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f72b4066f60 msgr2=0x7f72b4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:30.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.381+0000 7f72dbc00640 1 --2- 172.21.15.175:0/2654113299 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f72b4066f60 0x7f72b4069420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f72c4005890 tx=0x7f72c4009040 comp rx=0 tx=0).stop 2024-04-25T09:05:30.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.381+0000 7f72dbc00640 1 -- 172.21.15.175:0/2654113299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d40cdb60 msgr2=0x7f72d414e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:30.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.381+0000 7f72dbc00640 1 --2- 172.21.15.175:0/2654113299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d40cdb60 0x7f72d414e330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00c7a0 tx=0x7f72cc00cc60 comp rx=0 tx=0).stop 2024-04-25T09:05:30.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.381+0000 7f72dbc00640 1 -- 172.21.15.175:0/2654113299 shutdown_connections 2024-04-25T09:05:30.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.381+0000 7f72dbc00640 1 --2- 172.21.15.175:0/2654113299 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f72b4066f60 0x7f72b4069420 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.381+0000 7f72dbc00640 1 --2- 172.21.15.175:0/2654113299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72d40cdb60 0x7f72d414e330 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.381+0000 7f72dbc00640 1 --2- 172.21.15.175:0/2654113299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72d406c080 0x7f72d415a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.381+0000 7f72dbc00640 1 --2- 172.21.15.175:0/2654113299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72d406ad50 0x7f72d4157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.381+0000 7f72dbc00640 1 -- 172.21.15.175:0/2654113299 >> 172.21.15.175:0/2654113299 conn(0x7f72d40cca10 msgr2=0x7f72d40b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:30.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.381+0000 7f72dbc00640 1 -- 172.21.15.175:0/2654113299 shutdown_connections 2024-04-25T09:05:30.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.381+0000 7f72dbc00640 1 -- 172.21.15.175:0/2654113299 wait complete. 2024-04-25T09:05:30.389 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:05:30.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.537+0000 7efc2d400640 1 Processor -- start 2024-04-25T09:05:30.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.537+0000 7efc2d400640 1 -- start start 2024-04-25T09:05:30.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.537+0000 7efc2d400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efc2815af20 0x7efc280b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:30.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.537+0000 7efc2d400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc280b4630 0x7efc2815c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:30.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.537+0000 7efc2d400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2806db60 con 0x7efc280cbe60 2024-04-25T09:05:30.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.537+0000 7efc2d400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2806de40 con 0x7efc2815af20 2024-04-25T09:05:30.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.537+0000 7efc2d400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2806e120 con 0x7efc280b4630 2024-04-25T09:05:30.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.541+0000 7efc27200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc280b4630 0x7efc2815c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:30.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.541+0000 7efc27200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc280b4630 0x7efc2815c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:55512/0 (socket says 172.21.15.175:55512) 2024-04-25T09:05:30.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.541+0000 7efc1de00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efc2815af20 0x7efc280b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:30.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.541+0000 7efc26800640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7efc280cbe60 0x7efc2806d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:42778/0 (socket says 172.21.15.175:42778) 2024-04-25T09:05:30.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.541+0000 7efc27200640 1 -- 172.21.15.175:0/2820491991 learned_addr learned my addr 172.21.15.175:0/2820491991 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:30.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.541+0000 7efc27200640 1 -- 172.21.15.175:0/2820491991 >> v2:172.21.15.177:3300/0 conn(0x7efc2815af20 msgr2=0x7efc280b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:30.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.541+0000 7efc27200640 1 --2- 172.21.15.175:0/2820491991 >> v2:172.21.15.177:3300/0 conn(0x7efc2815af20 0x7efc280b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.541+0000 7efc27200640 1 -- 172.21.15.175:0/2820491991 >> v1:172.21.15.177:6789/0 conn(0x7efc280cbe60 legacy=0x7efc2806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:30.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.541+0000 7efc27200640 1 -- 172.21.15.175:0/2820491991 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2815c2f0 con 0x7efc280b4630 2024-04-25T09:05:30.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.541+0000 7efc27200640 1 --2- 172.21.15.175:0/2820491991 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc280b4630 0x7efc2815c810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efc20009870 tx=0x7efc2001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddcc1cfc8fd94c22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:30.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.541+0000 7efc25e00640 1 -- 172.21.15.175:0/2820491991 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc200b2070 con 0x7efc280b4630 2024-04-25T09:05:30.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.541+0000 7efc25e00640 1 -- 172.21.15.175:0/2820491991 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc200a9070 con 0x7efc280b4630 2024-04-25T09:05:30.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.541+0000 7efc25e00640 1 -- 172.21.15.175:0/2820491991 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc200ad880 con 0x7efc280b4630 2024-04-25T09:05:30.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc2d400640 1 -- 172.21.15.175:0/2820491991 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc280b4630 msgr2=0x7efc2815c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:30.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc2d400640 1 --2- 172.21.15.175:0/2820491991 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc280b4630 0x7efc2815c810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efc20009870 tx=0x7efc2001c560 comp rx=0 tx=0).stop 2024-04-25T09:05:30.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc2d400640 1 -- 172.21.15.175:0/2820491991 shutdown_connections 2024-04-25T09:05:30.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc2d400640 1 --2- 172.21.15.175:0/2820491991 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc280b4630 0x7efc2815c810 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc2d400640 1 --2- 172.21.15.175:0/2820491991 >> v2:172.21.15.177:3300/0 conn(0x7efc2815af20 0x7efc280b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc2d400640 1 -- 172.21.15.175:0/2820491991 >> 172.21.15.175:0/2820491991 conn(0x7efc2806ac50 msgr2=0x7efc2806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:30.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc2d400640 1 -- 172.21.15.175:0/2820491991 shutdown_connections 2024-04-25T09:05:30.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc2d400640 1 -- 172.21.15.175:0/2820491991 wait complete. 2024-04-25T09:05:30.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc2d400640 1 Processor -- start 2024-04-25T09:05:30.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc2d400640 1 -- start start 2024-04-25T09:05:30.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc2d400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc280b4630 0x7efc28153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:30.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc2d400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc280cbe60 0x7efc2806d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:30.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc2d400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc2815af20 0x7efc280b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:30.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc2d400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2815d970 con 0x7efc2815af20 2024-04-25T09:05:30.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc2d400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2815d7f0 con 0x7efc280cbe60 2024-04-25T09:05:30.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc2d400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2815daf0 con 0x7efc280b4630 2024-04-25T09:05:30.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc27200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc2815af20 0x7efc280b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:30.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc27200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc2815af20 0x7efc280b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43458/0 (socket says 172.21.15.175:43458) 2024-04-25T09:05:30.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc27200640 1 -- 172.21.15.175:0/1113213877 learned_addr learned my addr 172.21.15.175:0/1113213877 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:30.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc26800640 1 --2- 172.21.15.175:0/1113213877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc280b4630 0x7efc28153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:30.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.545+0000 7efc1de00640 1 --2- 172.21.15.175:0/1113213877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc280cbe60 0x7efc2806d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:30.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.549+0000 7efc27200640 1 -- 172.21.15.175:0/1113213877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc280b4630 msgr2=0x7efc28153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:30.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.549+0000 7efc27200640 1 --2- 172.21.15.175:0/1113213877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc280b4630 0x7efc28153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.549+0000 7efc27200640 1 -- 172.21.15.175:0/1113213877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc280cbe60 msgr2=0x7efc2806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:30.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.549+0000 7efc27200640 1 --2- 172.21.15.175:0/1113213877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc280cbe60 0x7efc2806d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.549+0000 7efc27200640 1 -- 172.21.15.175:0/1113213877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc280cdc90 con 0x7efc2815af20 2024-04-25T09:05:30.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.549+0000 7efc27200640 1 --2- 172.21.15.175:0/1113213877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc2815af20 0x7efc280b05c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7efc2001a190 tx=0x7efc20019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:30.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.549+0000 7efc1f400640 1 -- 172.21.15.175:0/1113213877 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc200bc070 con 0x7efc2815af20 2024-04-25T09:05:30.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.549+0000 7efc1f400640 1 -- 172.21.15.175:0/1113213877 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc200b6630 con 0x7efc2815af20 2024-04-25T09:05:30.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.549+0000 7efc1f400640 1 -- 172.21.15.175:0/1113213877 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc200b2040 con 0x7efc2815af20 2024-04-25T09:05:30.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.549+0000 7efc2d400640 1 -- 172.21.15.175:0/1113213877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc280cdf70 con 0x7efc2815af20 2024-04-25T09:05:30.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.549+0000 7efc2d400640 1 -- 172.21.15.175:0/1113213877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc280ce530 con 0x7efc2815af20 2024-04-25T09:05:30.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.549+0000 7efc2d400640 1 -- 172.21.15.175:0/1113213877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc28075160 con 0x7efc2815af20 2024-04-25T09:05:30.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.549+0000 7efc1f400640 1 -- 172.21.15.175:0/1113213877 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efc200bf070 con 0x7efc2815af20 2024-04-25T09:05:30.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.553+0000 7efc1f400640 1 --2- 172.21.15.175:0/1113213877 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efc04066f60 0x7efc04069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:30.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.553+0000 7efc1f400640 1 -- 172.21.15.175:0/1113213877 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc2011e3e0 con 0x7efc2815af20 2024-04-25T09:05:30.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.553+0000 7efc26800640 1 --2- 172.21.15.175:0/1113213877 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efc04066f60 0x7efc04069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:30.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.553+0000 7efc26800640 1 --2- 172.21.15.175:0/1113213877 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efc04066f60 0x7efc04069420 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efc2806b6b0 tx=0x7efc18001640 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:30.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.557+0000 7efc1f400640 1 -- 172.21.15.175:0/1113213877 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efc20016150 con 0x7efc2815af20 2024-04-25T09:05:30.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.709+0000 7efc2d400640 1 -- 172.21.15.175:0/1113213877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc280721c0 con 0x7efc2815af20 2024-04-25T09:05:30.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.709+0000 7efc1f400640 1 -- 172.21.15.175:0/1113213877 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc200eeda0 con 0x7efc2815af20 2024-04-25T09:05:30.699 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:05:30.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.709+0000 7efc2d400640 1 -- 172.21.15.175:0/1113213877 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efc04066f60 msgr2=0x7efc04069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:30.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.709+0000 7efc2d400640 1 --2- 172.21.15.175:0/1113213877 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efc04066f60 0x7efc04069420 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efc2806b6b0 tx=0x7efc18001640 comp rx=0 tx=0).stop 2024-04-25T09:05:30.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.709+0000 7efc2d400640 1 -- 172.21.15.175:0/1113213877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc2815af20 msgr2=0x7efc280b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:30.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.709+0000 7efc2d400640 1 --2- 172.21.15.175:0/1113213877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc2815af20 0x7efc280b05c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7efc2001a190 tx=0x7efc20019300 comp rx=0 tx=0).stop 2024-04-25T09:05:30.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.709+0000 7efc2d400640 1 -- 172.21.15.175:0/1113213877 shutdown_connections 2024-04-25T09:05:30.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.709+0000 7efc2d400640 1 --2- 172.21.15.175:0/1113213877 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efc04066f60 0x7efc04069420 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.709+0000 7efc2d400640 1 --2- 172.21.15.175:0/1113213877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc2815af20 0x7efc280b05c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.709+0000 7efc2d400640 1 --2- 172.21.15.175:0/1113213877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc280cbe60 0x7efc2806d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.709+0000 7efc2d400640 1 --2- 172.21.15.175:0/1113213877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc280b4630 0x7efc28153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.709+0000 7efc2d400640 1 -- 172.21.15.175:0/1113213877 >> 172.21.15.175:0/1113213877 conn(0x7efc2806ac50 msgr2=0x7efc280b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:30.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.709+0000 7efc2d400640 1 -- 172.21.15.175:0/1113213877 shutdown_connections 2024-04-25T09:05:30.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.709+0000 7efc2d400640 1 -- 172.21.15.175:0/1113213877 wait complete. 2024-04-25T09:05:30.719 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:30.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.865+0000 7f0f0c000640 1 Processor -- start 2024-04-25T09:05:30.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.865+0000 7f0f0c000640 1 -- start start 2024-04-25T09:05:30.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.865+0000 7f0f0c000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0f0415a900 0x7f0f0406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:30.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.865+0000 7f0f0c000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0f040cd520 0x7f0f040ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:30.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.865+0000 7f0f0c000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f040cda00 con 0x7f0f040cf560 2024-04-25T09:05:30.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.865+0000 7f0f0c000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0415bcf0 con 0x7f0f0415a900 2024-04-25T09:05:30.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.865+0000 7f0f0c000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f040cdce0 con 0x7f0f040cd520 2024-04-25T09:05:30.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.869+0000 7f0f09600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0f0415a900 0x7f0f0406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:30.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.869+0000 7f0f09600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0f0415a900 0x7f0f0406e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43472/0 (socket says 172.21.15.175:43472) 2024-04-25T09:05:30.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.869+0000 7f0f09600640 1 -- 172.21.15.175:0/2158090364 learned_addr learned my addr 172.21.15.175:0/2158090364 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:30.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.869+0000 7f0f08c00640 1 --2- 172.21.15.175:0/2158090364 >> v2:172.21.15.177:3300/0 conn(0x7f0f040cd520 0x7f0f040ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:30.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.869+0000 7f0f09600640 1 -- 172.21.15.175:0/2158090364 >> v2:172.21.15.177:3300/0 conn(0x7f0f040cd520 msgr2=0x7f0f040ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:30.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.869+0000 7f0f09600640 1 --2- 172.21.15.175:0/2158090364 >> v2:172.21.15.177:3300/0 conn(0x7f0f040cd520 0x7f0f040ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.869+0000 7f0f09600640 1 -- 172.21.15.175:0/2158090364 >> v1:172.21.15.177:6789/0 conn(0x7f0f040cf560 legacy=0x7f0f0415bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:30.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.869+0000 7f0f09600640 1 -- 172.21.15.175:0/2158090364 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f040cdfc0 con 0x7f0f0415a900 2024-04-25T09:05:30.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.869+0000 7f0f09600640 1 --2- 172.21.15.175:0/2158090364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f0415a900 0x7f0f0406e150 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0f040cf510 tx=0x7f0ef801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943ffa02976fefd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:30.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.873+0000 7f0f03e00640 1 -- 172.21.15.175:0/2158090364 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80a5750 con 0x7f0f0415a900 2024-04-25T09:05:30.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.873+0000 7f0f03e00640 1 -- 172.21.15.175:0/2158090364 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef80a58f0 con 0x7f0f0415a900 2024-04-25T09:05:30.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.873+0000 7f0f03e00640 1 -- 172.21.15.175:0/2158090364 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80a5cc0 con 0x7f0f0415a900 2024-04-25T09:05:30.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.873+0000 7f0f0c000640 1 -- 172.21.15.175:0/2158090364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f0415a900 msgr2=0x7f0f0406e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:30.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.873+0000 7f0f0c000640 1 --2- 172.21.15.175:0/2158090364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f0415a900 0x7f0f0406e150 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0f040cf510 tx=0x7f0ef801c980 comp rx=0 tx=0).stop 2024-04-25T09:05:30.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.873+0000 7f0f0c000640 1 -- 172.21.15.175:0/2158090364 shutdown_connections 2024-04-25T09:05:30.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.873+0000 7f0f0c000640 1 --2- 172.21.15.175:0/2158090364 >> v2:172.21.15.177:3300/0 conn(0x7f0f040cd520 0x7f0f040ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.873+0000 7f0f0c000640 1 --2- 172.21.15.175:0/2158090364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f0415a900 0x7f0f0406e150 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.873+0000 7f0f0c000640 1 -- 172.21.15.175:0/2158090364 >> 172.21.15.175:0/2158090364 conn(0x7f0f04067150 msgr2=0x7f0f0406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:30.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.873+0000 7f0f0c000640 1 -- 172.21.15.175:0/2158090364 shutdown_connections 2024-04-25T09:05:30.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.873+0000 7f0f0c000640 1 -- 172.21.15.175:0/2158090364 wait complete. 2024-04-25T09:05:30.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0c000640 1 Processor -- start 2024-04-25T09:05:30.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0c000640 1 -- start start 2024-04-25T09:05:30.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0c000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f040cf560 0x7f0f040b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:30.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0c000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f0415a900 0x7f0f041566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:30.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0c000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f0414dc90 0x7f0f04157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:30.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0c000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040cf160 con 0x7f0f0414dc90 2024-04-25T09:05:30.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0c000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040cefe0 con 0x7f0f0415a900 2024-04-25T09:05:30.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0c000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0406d3b0 con 0x7f0f040cf560 2024-04-25T09:05:30.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f0414dc90 0x7f0f04157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:30.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f0414dc90 0x7f0f04157990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43482/0 (socket says 172.21.15.175:43482) 2024-04-25T09:05:30.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0a000640 1 -- 172.21.15.175:0/692765626 learned_addr learned my addr 172.21.15.175:0/692765626 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:30.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f09600640 1 --2- 172.21.15.175:0/692765626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f040cf560 0x7f0f040b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:30.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f08c00640 1 --2- 172.21.15.175:0/692765626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f0415a900 0x7f0f041566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:30.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0a000640 1 -- 172.21.15.175:0/692765626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f040cf560 msgr2=0x7f0f040b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:30.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0a000640 1 --2- 172.21.15.175:0/692765626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f040cf560 0x7f0f040b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0a000640 1 -- 172.21.15.175:0/692765626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f0415a900 msgr2=0x7f0f041566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:30.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0a000640 1 --2- 172.21.15.175:0/692765626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f0415a900 0x7f0f041566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:30.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0a000640 1 -- 172.21.15.175:0/692765626 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f040b20b0 con 0x7f0f0414dc90 2024-04-25T09:05:30.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0a000640 1 --2- 172.21.15.175:0/692765626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f0414dc90 0x7f0f04157990 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c3f0 tx=0x7f0efc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:30.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f01600640 1 -- 172.21.15.175:0/692765626 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc011790 con 0x7f0f0414dc90 2024-04-25T09:05:30.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f01600640 1 -- 172.21.15.175:0/692765626 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc017070 con 0x7f0f0414dc90 2024-04-25T09:05:30.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f01600640 1 -- 172.21.15.175:0/692765626 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc011b70 con 0x7f0f0414dc90 2024-04-25T09:05:30.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0c000640 1 -- 172.21.15.175:0/692765626 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0415d410 con 0x7f0f0414dc90 2024-04-25T09:05:30.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0c000640 1 -- 172.21.15.175:0/692765626 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0415d9d0 con 0x7f0f0414dc90 2024-04-25T09:05:30.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.877+0000 7f0f0c000640 1 -- 172.21.15.175:0/692765626 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f04074a60 con 0x7f0f0414dc90 2024-04-25T09:05:30.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.881+0000 7f0f01600640 1 -- 172.21.15.175:0/692765626 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0efc011d10 con 0x7f0f0414dc90 2024-04-25T09:05:30.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.881+0000 7f0f01600640 1 --2- 172.21.15.175:0/692765626 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0ee4066f60 0x7f0ee4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:30.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.881+0000 7f0f01600640 1 -- 172.21.15.175:0/692765626 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0efc084ed0 con 0x7f0f0414dc90 2024-04-25T09:05:30.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.881+0000 7f0f09600640 1 --2- 172.21.15.175:0/692765626 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0ee4066f60 0x7f0ee4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:30.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.881+0000 7f0f09600640 1 --2- 172.21.15.175:0/692765626 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0ee4066f60 0x7f0ee4069420 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80ae000 tx=0x7f0ef80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:30.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:30.885+0000 7f0f01600640 1 -- 172.21.15.175:0/692765626 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0efc055e40 con 0x7f0f0414dc90 2024-04-25T09:05:31.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.069+0000 7f0f0c000640 1 -- 172.21.15.175:0/692765626 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f0415deb0 con 0x7f0f0414dc90 2024-04-25T09:05:31.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.069+0000 7f0f01600640 1 -- 172.21.15.175:0/692765626 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f0efc055740 con 0x7f0f0414dc90 2024-04-25T09:05:31.060 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:31.060 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2334769483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2334769483},{"type":"v1","addr":"172.21.15.177:6834","nonce":2334769483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2397222507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2397222507},{"type":"v1","addr":"172.21.15.177:6835","nonce":2397222507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5067,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2738941530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2738941530},{"type":"v1","addr":"172.21.15.175:6836","nonce":2738941530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:02.208383+0000","modified":"2024-04-25T09:05:05.231797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1909482114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1909482114},{"type":"v1","addr":"172.21.15.175:6837","nonce":1909482114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:05:31.060 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 17 2024-04-25T09:05:31.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.073+0000 7f0f0c000640 1 -- 172.21.15.175:0/692765626 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0ee4066f60 msgr2=0x7f0ee4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.073+0000 7f0f0c000640 1 --2- 172.21.15.175:0/692765626 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0ee4066f60 0x7f0ee4069420 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80ae000 tx=0x7f0ef80a7070 comp rx=0 tx=0).stop 2024-04-25T09:05:31.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.073+0000 7f0f0c000640 1 -- 172.21.15.175:0/692765626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f0414dc90 msgr2=0x7f0f04157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.073+0000 7f0f0c000640 1 --2- 172.21.15.175:0/692765626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f0414dc90 0x7f0f04157990 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0efc00c3f0 tx=0x7f0efc00c8b0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.073+0000 7f0f0c000640 1 -- 172.21.15.175:0/692765626 shutdown_connections 2024-04-25T09:05:31.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.073+0000 7f0f0c000640 1 --2- 172.21.15.175:0/692765626 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0ee4066f60 0x7f0ee4069420 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.073+0000 7f0f0c000640 1 --2- 172.21.15.175:0/692765626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f0414dc90 0x7f0f04157990 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.073+0000 7f0f0c000640 1 --2- 172.21.15.175:0/692765626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f0415a900 0x7f0f041566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.073+0000 7f0f0c000640 1 --2- 172.21.15.175:0/692765626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f040cf560 0x7f0f040b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.073+0000 7f0f0c000640 1 -- 172.21.15.175:0/692765626 >> 172.21.15.175:0/692765626 conn(0x7f0f040cd520 msgr2=0x7f0f0415bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.073+0000 7f0f0c000640 1 -- 172.21.15.175:0/692765626 shutdown_connections 2024-04-25T09:05:31.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.073+0000 7f0f0c000640 1 -- 172.21.15.175:0/692765626 wait complete. 2024-04-25T09:05:31.081 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:31.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.225+0000 7f1287a00640 1 Processor -- start 2024-04-25T09:05:31.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.225+0000 7f1287a00640 1 -- start start 2024-04-25T09:05:31.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.229+0000 7f1287a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f12800acd90 0x7f12800b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.229+0000 7f1287a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12800b3280 0x7f12800b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.229+0000 7f1287a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128006f280 con 0x7f128015db00 2024-04-25T09:05:31.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.229+0000 7f1287a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128006acf0 con 0x7f12800acd90 2024-04-25T09:05:31.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.229+0000 7f1287a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128006afd0 con 0x7f12800b3280 2024-04-25T09:05:31.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.229+0000 7f1285000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f128015db00 0x7f128006e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39434/0 (socket says 172.21.15.175:39434) 2024-04-25T09:05:31.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.229+0000 7f1285000640 1 -- 172.21.15.175:0/303610960 learned_addr learned my addr 172.21.15.175:0/303610960 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:31.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.229+0000 7f127fe00640 1 --2- 172.21.15.175:0/303610960 >> v2:172.21.15.175:3300/0 conn(0x7f12800acd90 0x7f12800b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.229+0000 7f1285a00640 1 --2- 172.21.15.175:0/303610960 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12800b3280 0x7f12800b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.229+0000 7f127f400640 1 -- 172.21.15.175:0/303610960 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1179249701 0 0) 0x7f128006f280 con 0x7f128015db00 2024-04-25T09:05:31.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.229+0000 7f127f400640 1 -- 172.21.15.175:0/303610960 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1268003530 con 0x7f128015db00 2024-04-25T09:05:31.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.229+0000 7f127fe00640 1 -- 172.21.15.175:0/303610960 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12800b3280 msgr2=0x7f12800b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.229+0000 7f127fe00640 1 --2- 172.21.15.175:0/303610960 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12800b3280 0x7f12800b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.229+0000 7f127fe00640 1 -- 172.21.15.175:0/303610960 >> v1:172.21.15.175:6789/0 conn(0x7f128015db00 legacy=0x7f128006e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.229+0000 7f127fe00640 1 -- 172.21.15.175:0/303610960 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128006b2b0 con 0x7f12800acd90 2024-04-25T09:05:31.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f127fe00640 1 --2- 172.21.15.175:0/303610960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12800acd90 0x7f12800b2d40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f126c0097f0 tx=0x7f126c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43af86cae2b7e20f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f127f400640 1 -- 172.21.15.175:0/303610960 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c0b1070 con 0x7f12800acd90 2024-04-25T09:05:31.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f127f400640 1 -- 172.21.15.175:0/303610960 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c0ac410 con 0x7f12800acd90 2024-04-25T09:05:31.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f127f400640 1 -- 172.21.15.175:0/303610960 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c0ac7e0 con 0x7f12800acd90 2024-04-25T09:05:31.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f1287a00640 1 -- 172.21.15.175:0/303610960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12800acd90 msgr2=0x7f12800b2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f1287a00640 1 --2- 172.21.15.175:0/303610960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12800acd90 0x7f12800b2d40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f126c0097f0 tx=0x7f126c01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f1287a00640 1 -- 172.21.15.175:0/303610960 shutdown_connections 2024-04-25T09:05:31.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f1287a00640 1 --2- 172.21.15.175:0/303610960 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12800b3280 0x7f12800b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f1287a00640 1 --2- 172.21.15.175:0/303610960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12800acd90 0x7f12800b2d40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f1287a00640 1 -- 172.21.15.175:0/303610960 >> 172.21.15.175:0/303610960 conn(0x7f12800b2200 msgr2=0x7f12800cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f1287a00640 1 -- 172.21.15.175:0/303610960 shutdown_connections 2024-04-25T09:05:31.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f1287a00640 1 -- 172.21.15.175:0/303610960 wait complete. 2024-04-25T09:05:31.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f1287a00640 1 Processor -- start 2024-04-25T09:05:31.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f1287a00640 1 -- start start 2024-04-25T09:05:31.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f1287a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12800acd90 0x7f12800ce870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f1287a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12800b3280 0x7f12800ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f1287a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f128015db00 0x7f128015c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f1287a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128006c370 con 0x7f12800b3280 2024-04-25T09:05:31.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f1287a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128006c1f0 con 0x7f128015db00 2024-04-25T09:05:31.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f1287a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f128006c4f0 con 0x7f12800acd90 2024-04-25T09:05:31.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f127fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12800b3280 0x7f12800ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f127fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12800b3280 0x7f12800ccc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43498/0 (socket says 172.21.15.175:43498) 2024-04-25T09:05:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.233+0000 7f127fe00640 1 -- 172.21.15.175:0/1019446426 learned_addr learned my addr 172.21.15.175:0/1019446426 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f1285000640 1 --2- 172.21.15.175:0/1019446426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12800acd90 0x7f12800ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f127fe00640 1 -- 172.21.15.175:0/1019446426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12800acd90 msgr2=0x7f12800ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f1285a00640 1 --2- 172.21.15.175:0/1019446426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f128015db00 0x7f128015c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f127fe00640 1 --2- 172.21.15.175:0/1019446426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12800acd90 0x7f12800ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f127fe00640 1 -- 172.21.15.175:0/1019446426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f128015db00 msgr2=0x7f128015c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f127fe00640 1 --2- 172.21.15.175:0/1019446426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f128015db00 0x7f128015c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f127fe00640 1 -- 172.21.15.175:0/1019446426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12801367f0 con 0x7f12800b3280 2024-04-25T09:05:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f1285a00640 1 --2- 172.21.15.175:0/1019446426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f128015db00 0x7f128015c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f1285000640 1 --2- 172.21.15.175:0/1019446426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12800acd90 0x7f12800ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f127fe00640 1 --2- 172.21.15.175:0/1019446426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12800b3280 0x7f12800ccc00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f126c0af040 tx=0x7f126c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f127cc00640 1 -- 172.21.15.175:0/1019446426 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c0b1040 con 0x7f12800b3280 2024-04-25T09:05:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f127cc00640 1 -- 172.21.15.175:0/1019446426 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c0bb070 con 0x7f12800b3280 2024-04-25T09:05:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f127cc00640 1 -- 172.21.15.175:0/1019446426 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c0b5410 con 0x7f12800b3280 2024-04-25T09:05:31.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f1287a00640 1 -- 172.21.15.175:0/1019446426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128014a640 con 0x7f12800b3280 2024-04-25T09:05:31.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f1287a00640 1 -- 172.21.15.175:0/1019446426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12800cf530 con 0x7f12800b3280 2024-04-25T09:05:31.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f1287a00640 1 -- 172.21.15.175:0/1019446426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128014a810 con 0x7f12800b3280 2024-04-25T09:05:31.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f127cc00640 1 -- 172.21.15.175:0/1019446426 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f126c0b55b0 con 0x7f12800b3280 2024-04-25T09:05:31.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f127cc00640 1 --2- 172.21.15.175:0/1019446426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1260066f60 0x7f1260069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f127cc00640 1 -- 172.21.15.175:0/1019446426 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f126c11eb20 con 0x7f12800b3280 2024-04-25T09:05:31.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.237+0000 7f1285000640 1 --2- 172.21.15.175:0/1019446426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1260066f60 0x7f1260069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.241+0000 7f1285000640 1 --2- 172.21.15.175:0/1019446426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1260066f60 0x7f1260069420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1274005890 tx=0x7f1274009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.241+0000 7f127cc00640 1 -- 172.21.15.175:0/1019446426 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f126c016090 con 0x7f12800b3280 2024-04-25T09:05:31.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.401+0000 7f1287a00640 1 -- 172.21.15.175:0/1019446426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12800d0ae0 con 0x7f12800b3280 2024-04-25T09:05:31.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.401+0000 7f127cc00640 1 -- 172.21.15.175:0/1019446426 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16705 (secure 0 0 0) 0x7f126c0efbb0 con 0x7f12800b3280 2024-04-25T09:05:31.391 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:31.391 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":32,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:05:03.828685+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:59.880776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:01.208198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:31.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.401+0000 7f1287a00640 1 -- 172.21.15.175:0/1019446426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1260066f60 msgr2=0x7f1260069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.401+0000 7f1287a00640 1 --2- 172.21.15.175:0/1019446426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1260066f60 0x7f1260069420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1274005890 tx=0x7f1274009040 comp rx=0 tx=0).stop 2024-04-25T09:05:31.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.401+0000 7f1287a00640 1 -- 172.21.15.175:0/1019446426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12800b3280 msgr2=0x7f12800ccc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.401+0000 7f1287a00640 1 --2- 172.21.15.175:0/1019446426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12800b3280 0x7f12800ccc00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f126c0af040 tx=0x7f126c019240 comp rx=0 tx=0).stop 2024-04-25T09:05:31.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.401+0000 7f1287a00640 1 -- 172.21.15.175:0/1019446426 shutdown_connections 2024-04-25T09:05:31.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.401+0000 7f1287a00640 1 --2- 172.21.15.175:0/1019446426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1260066f60 0x7f1260069420 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.401+0000 7f1287a00640 1 --2- 172.21.15.175:0/1019446426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f128015db00 0x7f128015c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.401+0000 7f1287a00640 1 --2- 172.21.15.175:0/1019446426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12800b3280 0x7f12800ccc00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.401+0000 7f1287a00640 1 --2- 172.21.15.175:0/1019446426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12800acd90 0x7f12800ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.401+0000 7f1287a00640 1 -- 172.21.15.175:0/1019446426 >> 172.21.15.175:0/1019446426 conn(0x7f12800b2200 msgr2=0x7f1280157d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.401+0000 7f1287a00640 1 -- 172.21.15.175:0/1019446426 shutdown_connections 2024-04-25T09:05:31.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.401+0000 7f1287a00640 1 -- 172.21.15.175:0/1019446426 wait complete. 2024-04-25T09:05:31.413 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:05:31.413 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:31.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.557+0000 7f928be00640 1 Processor -- start 2024-04-25T09:05:31.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.557+0000 7f928be00640 1 -- start start 2024-04-25T09:05:31.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.557+0000 7f928be00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9284147780 0x7f92840ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.557+0000 7f928be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f928406e960 0x7f928406ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.561+0000 7f928be00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92840cee90 con 0x7f92840716e0 2024-04-25T09:05:31.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.561+0000 7f928be00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92840cd2d0 con 0x7f9284147780 2024-04-25T09:05:31.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.561+0000 7f928be00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9284161860 con 0x7f928406e960 2024-04-25T09:05:31.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.561+0000 7f9288a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f92840716e0 0x7f9284161fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39448/0 (socket says 172.21.15.175:39448) 2024-04-25T09:05:31.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.561+0000 7f9288a00640 1 -- 172.21.15.175:0/3759817265 learned_addr learned my addr 172.21.15.175:0/3759817265 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:31.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.561+0000 7f9289400640 1 --2- 172.21.15.175:0/3759817265 >> v2:172.21.15.177:3300/0 conn(0x7f9284147780 0x7f92840ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.561+0000 7f9289e00640 1 --2- 172.21.15.175:0/3759817265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f928406e960 0x7f928406ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.561+0000 7f9283e00640 1 -- 172.21.15.175:0/3759817265 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 11414153 0 0) 0x7f92840cee90 con 0x7f92840716e0 2024-04-25T09:05:31.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.561+0000 7f9283e00640 1 -- 172.21.15.175:0/3759817265 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f926c003530 con 0x7f92840716e0 2024-04-25T09:05:31.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.561+0000 7f9289400640 1 -- 172.21.15.175:0/3759817265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f928406e960 msgr2=0x7f928406ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.561+0000 7f9289400640 1 --2- 172.21.15.175:0/3759817265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f928406e960 0x7f928406ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.561+0000 7f9289400640 1 -- 172.21.15.175:0/3759817265 >> v1:172.21.15.175:6789/0 conn(0x7f92840716e0 legacy=0x7f9284161fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.561+0000 7f9289400640 1 -- 172.21.15.175:0/3759817265 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92840cf150 con 0x7f9284147780 2024-04-25T09:05:31.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.561+0000 7f9289400640 1 --2- 172.21.15.175:0/3759817265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9284147780 0x7f92840ce950 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9278009d90 tx=0x7f927801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac9262ca4ae0aa98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f9283e00640 1 -- 172.21.15.175:0/3759817265 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92780b2070 con 0x7f9284147780 2024-04-25T09:05:31.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f9283e00640 1 -- 172.21.15.175:0/3759817265 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92780a57a0 con 0x7f9284147780 2024-04-25T09:05:31.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f9283e00640 1 -- 172.21.15.175:0/3759817265 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92780a5b70 con 0x7f9284147780 2024-04-25T09:05:31.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f928be00640 1 -- 172.21.15.175:0/3759817265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9284147780 msgr2=0x7f92840ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f928be00640 1 --2- 172.21.15.175:0/3759817265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9284147780 0x7f92840ce950 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9278009d90 tx=0x7f927801c8e0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f928be00640 1 -- 172.21.15.175:0/3759817265 shutdown_connections 2024-04-25T09:05:31.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f928be00640 1 --2- 172.21.15.175:0/3759817265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f928406e960 0x7f928406ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f928be00640 1 --2- 172.21.15.175:0/3759817265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9284147780 0x7f92840ce950 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f928be00640 1 -- 172.21.15.175:0/3759817265 >> 172.21.15.175:0/3759817265 conn(0x7f92840cc550 msgr2=0x7f92840cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f928be00640 1 -- 172.21.15.175:0/3759817265 shutdown_connections 2024-04-25T09:05:31.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f928be00640 1 -- 172.21.15.175:0/3759817265 wait complete. 2024-04-25T09:05:31.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f928be00640 1 Processor -- start 2024-04-25T09:05:31.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f928be00640 1 -- start start 2024-04-25T09:05:31.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f928be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f928406e960 0x7f9284160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f928be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92840716e0 0x7f928406de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f928be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9284147780 0x7f928413e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f928be00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928416aba0 con 0x7f928406e960 2024-04-25T09:05:31.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f928be00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92841626e0 con 0x7f92840716e0 2024-04-25T09:05:31.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f928be00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928416ad20 con 0x7f9284147780 2024-04-25T09:05:31.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f9289400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f928406e960 0x7f9284160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f9289400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f928406e960 0x7f9284160ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43508/0 (socket says 172.21.15.175:43508) 2024-04-25T09:05:31.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.565+0000 7f9289400640 1 -- 172.21.15.175:0/1771864002 learned_addr learned my addr 172.21.15.175:0/1771864002 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:31.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.569+0000 7f9289e00640 1 --2- 172.21.15.175:0/1771864002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9284147780 0x7f928413e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.569+0000 7f9288a00640 1 --2- 172.21.15.175:0/1771864002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92840716e0 0x7f928406de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.569+0000 7f9289400640 1 -- 172.21.15.175:0/1771864002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9284147780 msgr2=0x7f928413e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.569+0000 7f9289400640 1 --2- 172.21.15.175:0/1771864002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9284147780 0x7f928413e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.569+0000 7f9289400640 1 -- 172.21.15.175:0/1771864002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92840716e0 msgr2=0x7f928406de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.569+0000 7f9289400640 1 --2- 172.21.15.175:0/1771864002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92840716e0 0x7f928406de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.569+0000 7f9289400640 1 -- 172.21.15.175:0/1771864002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9284161600 con 0x7f928406e960 2024-04-25T09:05:31.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.569+0000 7f9289400640 1 --2- 172.21.15.175:0/1771864002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f928406e960 0x7f9284160ad0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f92780b0040 tx=0x7f9278019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.569+0000 7f9281600640 1 -- 172.21.15.175:0/1771864002 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92780bd020 con 0x7f928406e960 2024-04-25T09:05:31.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.569+0000 7f9281600640 1 -- 172.21.15.175:0/1771864002 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92780b8470 con 0x7f928406e960 2024-04-25T09:05:31.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.569+0000 7f928be00640 1 -- 172.21.15.175:0/1771864002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928415c100 con 0x7f928406e960 2024-04-25T09:05:31.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.569+0000 7f9281600640 1 -- 172.21.15.175:0/1771864002 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92780b2040 con 0x7f928406e960 2024-04-25T09:05:31.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.569+0000 7f928be00640 1 -- 172.21.15.175:0/1771864002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928415c6c0 con 0x7f928406e960 2024-04-25T09:05:31.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.569+0000 7f928be00640 1 -- 172.21.15.175:0/1771864002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9284074a60 con 0x7f928406e960 2024-04-25T09:05:31.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.569+0000 7f9281600640 1 -- 172.21.15.175:0/1771864002 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f92780c0020 con 0x7f928406e960 2024-04-25T09:05:31.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.569+0000 7f9281600640 1 --2- 172.21.15.175:0/1771864002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9264066f60 0x7f9264069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.569+0000 7f9281600640 1 -- 172.21.15.175:0/1771864002 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f927811fcc0 con 0x7f928406e960 2024-04-25T09:05:31.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.569+0000 7f9288a00640 1 --2- 172.21.15.175:0/1771864002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9264066f60 0x7f9264069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.573+0000 7f9288a00640 1 --2- 172.21.15.175:0/1771864002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9264066f60 0x7f9264069420 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9284144130 tx=0x7f9270009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.573+0000 7f9281600640 1 -- 172.21.15.175:0/1771864002 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9278126080 con 0x7f928406e960 2024-04-25T09:05:31.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.761+0000 7f928be00640 1 -- 172.21.15.175:0/1771864002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92840cbe30 con 0x7f928406e960 2024-04-25T09:05:31.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.761+0000 7f9281600640 1 -- 172.21.15.175:0/1771864002 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f92780c7030 con 0x7f928406e960 2024-04-25T09:05:31.751 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:31.751 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2334769483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2334769483},{"type":"v1","addr":"172.21.15.177:6834","nonce":2334769483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2397222507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2397222507},{"type":"v1","addr":"172.21.15.177:6835","nonce":2397222507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5067,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2738941530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2738941530},{"type":"v1","addr":"172.21.15.175:6836","nonce":2738941530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:02.208383+0000","modified":"2024-04-25T09:05:05.231797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1909482114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1909482114},{"type":"v1","addr":"172.21.15.175:6837","nonce":1909482114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:05:31.751 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 17 2024-04-25T09:05:31.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.761+0000 7f928be00640 1 -- 172.21.15.175:0/1771864002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9264066f60 msgr2=0x7f9264069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.761+0000 7f928be00640 1 --2- 172.21.15.175:0/1771864002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9264066f60 0x7f9264069420 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9284144130 tx=0x7f9270009040 comp rx=0 tx=0).stop 2024-04-25T09:05:31.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.761+0000 7f928be00640 1 -- 172.21.15.175:0/1771864002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f928406e960 msgr2=0x7f9284160ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.761+0000 7f928be00640 1 --2- 172.21.15.175:0/1771864002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f928406e960 0x7f9284160ad0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f92780b0040 tx=0x7f9278019680 comp rx=0 tx=0).stop 2024-04-25T09:05:31.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.761+0000 7f928be00640 1 -- 172.21.15.175:0/1771864002 shutdown_connections 2024-04-25T09:05:31.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.761+0000 7f928be00640 1 --2- 172.21.15.175:0/1771864002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9264066f60 0x7f9264069420 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.761+0000 7f928be00640 1 --2- 172.21.15.175:0/1771864002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9284147780 0x7f928413e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.761+0000 7f928be00640 1 --2- 172.21.15.175:0/1771864002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92840716e0 0x7f928406de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.761+0000 7f928be00640 1 --2- 172.21.15.175:0/1771864002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f928406e960 0x7f9284160ad0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.761+0000 7f928be00640 1 -- 172.21.15.175:0/1771864002 >> 172.21.15.175:0/1771864002 conn(0x7f92840cc550 msgr2=0x7f92840cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.761+0000 7f928be00640 1 -- 172.21.15.175:0/1771864002 shutdown_connections 2024-04-25T09:05:31.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.761+0000 7f928be00640 1 -- 172.21.15.175:0/1771864002 wait complete. 2024-04-25T09:05:31.771 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:31.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.921+0000 7fde63e00640 1 Processor -- start 2024-04-25T09:05:31.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.921+0000 7fde63e00640 1 -- start start 2024-04-25T09:05:31.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.921+0000 7fde63e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fde6409a090 0x7fde640b2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.921+0000 7fde63e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fde6406c9c0 0x7fde640cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.921+0000 7fde63e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde6406cf60 con 0x7fde64099cb0 2024-04-25T09:05:31.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.921+0000 7fde63e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde640d0220 con 0x7fde6409a090 2024-04-25T09:05:31.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.921+0000 7fde63e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde6406d240 con 0x7fde6406c9c0 2024-04-25T09:05:31.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.921+0000 7fde62000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fde6409a090 0x7fde640b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.921+0000 7fde62000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fde6409a090 0x7fde640b2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43510/0 (socket says 172.21.15.175:43510) 2024-04-25T09:05:31.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.921+0000 7fde62000640 1 -- 172.21.15.175:0/3290386758 learned_addr learned my addr 172.21.15.175:0/3290386758 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:31.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.921+0000 7fde63400640 1 --2- 172.21.15.175:0/3290386758 >> v2:172.21.15.177:3300/0 conn(0x7fde6406c9c0 0x7fde640cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.921+0000 7fde62000640 1 -- 172.21.15.175:0/3290386758 >> v2:172.21.15.177:3300/0 conn(0x7fde6406c9c0 msgr2=0x7fde640cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.921+0000 7fde62000640 1 --2- 172.21.15.175:0/3290386758 >> v2:172.21.15.177:3300/0 conn(0x7fde6406c9c0 0x7fde640cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.921+0000 7fde62000640 1 -- 172.21.15.175:0/3290386758 >> v1:172.21.15.177:6789/0 conn(0x7fde64099cb0 legacy=0x7fde640d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:31.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.921+0000 7fde62000640 1 -- 172.21.15.175:0/3290386758 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde640cfeb0 con 0x7fde6409a090 2024-04-25T09:05:31.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.921+0000 7fde63400640 1 --2- 172.21.15.175:0/3290386758 >> v2:172.21.15.177:3300/0 conn(0x7fde6406c9c0 0x7fde640cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:31.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.925+0000 7fde62000640 1 --2- 172.21.15.175:0/3290386758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde6409a090 0x7fde640b2380 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fde6409a550 tx=0x7fde5001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a392cdad67d720b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.925+0000 7fde61600640 1 -- 172.21.15.175:0/3290386758 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500b1070 con 0x7fde6409a090 2024-04-25T09:05:31.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.925+0000 7fde61600640 1 -- 172.21.15.175:0/3290386758 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde500ac620 con 0x7fde6409a090 2024-04-25T09:05:31.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.925+0000 7fde61600640 1 -- 172.21.15.175:0/3290386758 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500ac9f0 con 0x7fde6409a090 2024-04-25T09:05:31.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.925+0000 7fde63e00640 1 -- 172.21.15.175:0/3290386758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde6409a090 msgr2=0x7fde640b2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.925+0000 7fde63e00640 1 --2- 172.21.15.175:0/3290386758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde6409a090 0x7fde640b2380 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fde6409a550 tx=0x7fde5001c4b0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.925+0000 7fde63e00640 1 -- 172.21.15.175:0/3290386758 shutdown_connections 2024-04-25T09:05:31.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.925+0000 7fde63e00640 1 --2- 172.21.15.175:0/3290386758 >> v2:172.21.15.177:3300/0 conn(0x7fde6406c9c0 0x7fde640cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.925+0000 7fde63e00640 1 --2- 172.21.15.175:0/3290386758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde6409a090 0x7fde640b2380 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.925+0000 7fde63e00640 1 -- 172.21.15.175:0/3290386758 >> 172.21.15.175:0/3290386758 conn(0x7fde640b3170 msgr2=0x7fde640b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:31.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.925+0000 7fde63e00640 1 -- 172.21.15.175:0/3290386758 shutdown_connections 2024-04-25T09:05:31.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.925+0000 7fde63e00640 1 -- 172.21.15.175:0/3290386758 wait complete. 2024-04-25T09:05:31.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.925+0000 7fde63e00640 1 Processor -- start 2024-04-25T09:05:31.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.925+0000 7fde63e00640 1 -- start start 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde63e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde6406c9c0 0x7fde64159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde63e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde64099cb0 0x7fde64157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde63e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde6409a090 0x7fde640b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde63e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6415d7a0 con 0x7fde64099cb0 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde63e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6415d620 con 0x7fde6406c9c0 2024-04-25T09:05:31.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde63e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6415d920 con 0x7fde6409a090 2024-04-25T09:05:31.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde62000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde64099cb0 0x7fde64157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde62000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde64099cb0 0x7fde64157990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43524/0 (socket says 172.21.15.175:43524) 2024-04-25T09:05:31.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde62000640 1 -- 172.21.15.175:0/4038644449 learned_addr learned my addr 172.21.15.175:0/4038644449 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:31.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde63400640 1 --2- 172.21.15.175:0/4038644449 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde6409a090 0x7fde640b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde62a00640 1 --2- 172.21.15.175:0/4038644449 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde6406c9c0 0x7fde64159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde62000640 1 -- 172.21.15.175:0/4038644449 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde6409a090 msgr2=0x7fde640b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde62000640 1 --2- 172.21.15.175:0/4038644449 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde6409a090 0x7fde640b66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde62000640 1 -- 172.21.15.175:0/4038644449 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde6406c9c0 msgr2=0x7fde64159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:31.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde62000640 1 --2- 172.21.15.175:0/4038644449 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde6406c9c0 0x7fde64159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:31.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde62000640 1 -- 172.21.15.175:0/4038644449 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde64157ed0 con 0x7fde64099cb0 2024-04-25T09:05:31.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde63400640 1 --2- 172.21.15.175:0/4038644449 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde6409a090 0x7fde640b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:31.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde62000640 1 --2- 172.21.15.175:0/4038644449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde64099cb0 0x7fde64157990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fde500af040 tx=0x7fde50019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde5aa00640 1 -- 172.21.15.175:0/4038644449 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500bc070 con 0x7fde64099cb0 2024-04-25T09:05:31.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde5aa00640 1 -- 172.21.15.175:0/4038644449 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde500b7430 con 0x7fde64099cb0 2024-04-25T09:05:31.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde63e00640 1 -- 172.21.15.175:0/4038644449 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde6409eda0 con 0x7fde64099cb0 2024-04-25T09:05:31.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde5aa00640 1 -- 172.21.15.175:0/4038644449 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde500b1040 con 0x7fde64099cb0 2024-04-25T09:05:31.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde63e00640 1 -- 172.21.15.175:0/4038644449 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde640ca9c0 con 0x7fde64099cb0 2024-04-25T09:05:31.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.929+0000 7fde63e00640 1 -- 172.21.15.175:0/4038644449 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde64074a60 con 0x7fde64099cb0 2024-04-25T09:05:31.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.933+0000 7fde5aa00640 1 -- 172.21.15.175:0/4038644449 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fde500bf070 con 0x7fde64099cb0 2024-04-25T09:05:31.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.933+0000 7fde5aa00640 1 --2- 172.21.15.175:0/4038644449 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde44066f60 0x7fde44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:31.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.933+0000 7fde5aa00640 1 -- 172.21.15.175:0/4038644449 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde5011e6e0 con 0x7fde64099cb0 2024-04-25T09:05:31.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.933+0000 7fde62a00640 1 --2- 172.21.15.175:0/4038644449 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde44066f60 0x7fde44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:31.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.933+0000 7fde62a00640 1 --2- 172.21.15.175:0/4038644449 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde44066f60 0x7fde44069420 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fde640b5bd0 tx=0x7fde54007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:31.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:31.937+0000 7fde5aa00640 1 -- 172.21.15.175:0/4038644449 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fde500160d0 con 0x7fde64099cb0 2024-04-25T09:05:32.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.121+0000 7fde63e00640 1 -- 172.21.15.175:0/4038644449 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde640b3fa0 con 0x7fde64099cb0 2024-04-25T09:05:32.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.121+0000 7fde5aa00640 1 -- 172.21.15.175:0/4038644449 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4950 (secure 0 0 0) 0x7fde500ef000 con 0x7fde64099cb0 2024-04-25T09:05:32.112 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:32.112 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2334769483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2334769483},{"type":"v1","addr":"172.21.15.177:6834","nonce":2334769483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2397222507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2397222507},{"type":"v1","addr":"172.21.15.177:6835","nonce":2397222507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5067,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2738941530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2738941530},{"type":"v1","addr":"172.21.15.175:6836","nonce":2738941530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:02.208383+0000","modified":"2024-04-25T09:05:05.231797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1909482114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1909482114},{"type":"v1","addr":"172.21.15.175:6837","nonce":1909482114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:05:32.112 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 17 2024-04-25T09:05:32.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.125+0000 7fde63e00640 1 -- 172.21.15.175:0/4038644449 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde44066f60 msgr2=0x7fde44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.125+0000 7fde63e00640 1 --2- 172.21.15.175:0/4038644449 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde44066f60 0x7fde44069420 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fde640b5bd0 tx=0x7fde54007e40 comp rx=0 tx=0).stop 2024-04-25T09:05:32.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.125+0000 7fde63e00640 1 -- 172.21.15.175:0/4038644449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde64099cb0 msgr2=0x7fde64157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.125+0000 7fde63e00640 1 --2- 172.21.15.175:0/4038644449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde64099cb0 0x7fde64157990 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fde500af040 tx=0x7fde50019250 comp rx=0 tx=0).stop 2024-04-25T09:05:32.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.125+0000 7fde63e00640 1 -- 172.21.15.175:0/4038644449 shutdown_connections 2024-04-25T09:05:32.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.125+0000 7fde63e00640 1 --2- 172.21.15.175:0/4038644449 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde44066f60 0x7fde44069420 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.125+0000 7fde63e00640 1 --2- 172.21.15.175:0/4038644449 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde6409a090 0x7fde640b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.125+0000 7fde63e00640 1 --2- 172.21.15.175:0/4038644449 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde64099cb0 0x7fde64157990 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.125+0000 7fde63e00640 1 --2- 172.21.15.175:0/4038644449 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde6406c9c0 0x7fde64159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.125+0000 7fde63e00640 1 -- 172.21.15.175:0/4038644449 >> 172.21.15.175:0/4038644449 conn(0x7fde640b3170 msgr2=0x7fde640b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:32.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.125+0000 7fde63e00640 1 -- 172.21.15.175:0/4038644449 shutdown_connections 2024-04-25T09:05:32.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.125+0000 7fde63e00640 1 -- 172.21.15.175:0/4038644449 wait complete. 2024-04-25T09:05:32.134 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:32.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.281+0000 7facc0c00640 1 Processor -- start 2024-04-25T09:05:32.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.281+0000 7facc0c00640 1 -- start start 2024-04-25T09:05:32.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.281+0000 7facc0c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7facbc099a50 0x7facbc06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.281+0000 7facc0c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7facbc06bd60 0x7facbc099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.281+0000 7facc0c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facbc09a370 con 0x7facbc0d0d50 2024-04-25T09:05:32.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.281+0000 7facc0c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facbc0cfcb0 con 0x7facbc099a50 2024-04-25T09:05:32.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.281+0000 7facc0c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facbc0cff90 con 0x7facbc06bd60 2024-04-25T09:05:32.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.281+0000 7facb9e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7facbc099a50 0x7facbc06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.281+0000 7facb9e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7facbc099a50 0x7facbc06cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43536/0 (socket says 172.21.15.175:43536) 2024-04-25T09:05:32.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.281+0000 7facb9e00640 1 -- 172.21.15.175:0/2330065150 learned_addr learned my addr 172.21.15.175:0/2330065150 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:32.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.281+0000 7facb9400640 1 --2- 172.21.15.175:0/2330065150 >> v2:172.21.15.177:3300/0 conn(0x7facbc06bd60 0x7facbc099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.281+0000 7facb9e00640 1 -- 172.21.15.175:0/2330065150 >> v2:172.21.15.177:3300/0 conn(0x7facbc06bd60 msgr2=0x7facbc099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:32.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.281+0000 7facb9e00640 1 --2- 172.21.15.175:0/2330065150 >> v2:172.21.15.177:3300/0 conn(0x7facbc06bd60 0x7facbc099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.281+0000 7facb9e00640 1 -- 172.21.15.175:0/2330065150 >> v1:172.21.15.177:6789/0 conn(0x7facbc0d0d50 legacy=0x7facbc0cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:32.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.281+0000 7facb9e00640 1 -- 172.21.15.175:0/2330065150 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc0d0270 con 0x7facbc099a50 2024-04-25T09:05:32.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.281+0000 7facb9400640 1 --2- 172.21.15.175:0/2330065150 >> v2:172.21.15.177:3300/0 conn(0x7facbc06bd60 0x7facbc099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:32.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.285+0000 7facb9e00640 1 --2- 172.21.15.175:0/2330065150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facbc099a50 0x7facbc06cc50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7facbc067440 tx=0x7facac01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2525400e4c8c5772 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:32.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.285+0000 7facb8a00640 1 -- 172.21.15.175:0/2330065150 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac0b0070 con 0x7facbc099a50 2024-04-25T09:05:32.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.285+0000 7facb8a00640 1 -- 172.21.15.175:0/2330065150 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac0ab600 con 0x7facbc099a50 2024-04-25T09:05:32.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.285+0000 7facb8a00640 1 -- 172.21.15.175:0/2330065150 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac0ab9d0 con 0x7facbc099a50 2024-04-25T09:05:32.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.285+0000 7facc0c00640 1 -- 172.21.15.175:0/2330065150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facbc099a50 msgr2=0x7facbc06cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.285+0000 7facc0c00640 1 --2- 172.21.15.175:0/2330065150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facbc099a50 0x7facbc06cc50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7facbc067440 tx=0x7facac01c4e0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.285+0000 7facc0c00640 1 -- 172.21.15.175:0/2330065150 shutdown_connections 2024-04-25T09:05:32.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.285+0000 7facc0c00640 1 --2- 172.21.15.175:0/2330065150 >> v2:172.21.15.177:3300/0 conn(0x7facbc06bd60 0x7facbc099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.285+0000 7facc0c00640 1 --2- 172.21.15.175:0/2330065150 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facbc099a50 0x7facbc06cc50 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.285+0000 7facc0c00640 1 -- 172.21.15.175:0/2330065150 >> 172.21.15.175:0/2330065150 conn(0x7facbc0b3300 msgr2=0x7facbc0b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:32.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.285+0000 7facc0c00640 1 -- 172.21.15.175:0/2330065150 shutdown_connections 2024-04-25T09:05:32.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.285+0000 7facc0c00640 1 -- 172.21.15.175:0/2330065150 wait complete. 2024-04-25T09:05:32.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.285+0000 7facc0c00640 1 Processor -- start 2024-04-25T09:05:32.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.285+0000 7facc0c00640 1 -- start start 2024-04-25T09:05:32.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facc0c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facbc06bd60 0x7facbc153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facc0c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facbc099a50 0x7facbc141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facc0c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facbc0d0d50 0x7facbc0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facc0c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc15dfe0 con 0x7facbc0d0d50 2024-04-25T09:05:32.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facc0c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc15de60 con 0x7facbc06bd60 2024-04-25T09:05:32.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facc0c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facbc16b260 con 0x7facbc099a50 2024-04-25T09:05:32.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facba800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facbc0d0d50 0x7facbc0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facba800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facbc0d0d50 0x7facbc0cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43540/0 (socket says 172.21.15.175:43540) 2024-04-25T09:05:32.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facba800640 1 -- 172.21.15.175:0/2291555313 learned_addr learned my addr 172.21.15.175:0/2291555313 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:32.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facb9e00640 1 --2- 172.21.15.175:0/2291555313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facbc06bd60 0x7facbc153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facb9400640 1 --2- 172.21.15.175:0/2291555313 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facbc099a50 0x7facbc141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facba800640 1 -- 172.21.15.175:0/2291555313 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facbc099a50 msgr2=0x7facbc141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facba800640 1 --2- 172.21.15.175:0/2291555313 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facbc099a50 0x7facbc141690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facba800640 1 -- 172.21.15.175:0/2291555313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facbc06bd60 msgr2=0x7facbc153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facba800640 1 --2- 172.21.15.175:0/2291555313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facbc06bd60 0x7facbc153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facba800640 1 -- 172.21.15.175:0/2291555313 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc0cabe0 con 0x7facbc0d0d50 2024-04-25T09:05:32.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facba800640 1 --2- 172.21.15.175:0/2291555313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facbc0d0d50 0x7facbc0cbc80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7facb400c780 tx=0x7facb400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:32.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facb2000640 1 -- 172.21.15.175:0/2291555313 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb4004b70 con 0x7facbc0d0d50 2024-04-25T09:05:32.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facb2000640 1 -- 172.21.15.175:0/2291555313 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb4004d10 con 0x7facbc0d0d50 2024-04-25T09:05:32.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facb2000640 1 -- 172.21.15.175:0/2291555313 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb400aa90 con 0x7facbc0d0d50 2024-04-25T09:05:32.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facc0c00640 1 -- 172.21.15.175:0/2291555313 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facbc0caec0 con 0x7facbc0d0d50 2024-04-25T09:05:32.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facc0c00640 1 -- 172.21.15.175:0/2291555313 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facbc0cb480 con 0x7facbc0d0d50 2024-04-25T09:05:32.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.289+0000 7facc0c00640 1 -- 172.21.15.175:0/2291555313 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facbc074a60 con 0x7facbc0d0d50 2024-04-25T09:05:32.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.293+0000 7facb2000640 1 -- 172.21.15.175:0/2291555313 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7facb400ac30 con 0x7facbc0d0d50 2024-04-25T09:05:32.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.293+0000 7facb2000640 1 --2- 172.21.15.175:0/2291555313 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fac9c066f60 0x7fac9c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.293+0000 7facb2000640 1 -- 172.21.15.175:0/2291555313 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facb4085240 con 0x7facbc0d0d50 2024-04-25T09:05:32.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.293+0000 7facb9e00640 1 --2- 172.21.15.175:0/2291555313 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fac9c066f60 0x7fac9c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.293+0000 7facb9e00640 1 --2- 172.21.15.175:0/2291555313 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fac9c066f60 0x7fac9c069420 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7facac0ad000 tx=0x7facac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:32.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.297+0000 7facb2000640 1 -- 172.21.15.175:0/2291555313 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7facb4020070 con 0x7facbc0d0d50 2024-04-25T09:05:32.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.449+0000 7facc0c00640 1 -- 172.21.15.175:0/2291555313 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facbc141bd0 con 0x7facbc0d0d50 2024-04-25T09:05:32.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.449+0000 7facb2000640 1 -- 172.21.15.175:0/2291555313 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16705 (secure 0 0 0) 0x7facb4056240 con 0x7facbc0d0d50 2024-04-25T09:05:32.441 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:32.441 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":32,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:05:03.828685+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:59.880776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:01.208198+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:32.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.453+0000 7facc0c00640 1 -- 172.21.15.175:0/2291555313 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fac9c066f60 msgr2=0x7fac9c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.453+0000 7facc0c00640 1 --2- 172.21.15.175:0/2291555313 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fac9c066f60 0x7fac9c069420 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7facac0ad000 tx=0x7facac008040 comp rx=0 tx=0).stop 2024-04-25T09:05:32.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.453+0000 7facc0c00640 1 -- 172.21.15.175:0/2291555313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facbc0d0d50 msgr2=0x7facbc0cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.453+0000 7facc0c00640 1 --2- 172.21.15.175:0/2291555313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facbc0d0d50 0x7facbc0cbc80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7facb400c780 tx=0x7facb400cc40 comp rx=0 tx=0).stop 2024-04-25T09:05:32.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.453+0000 7facc0c00640 1 -- 172.21.15.175:0/2291555313 shutdown_connections 2024-04-25T09:05:32.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.453+0000 7facc0c00640 1 --2- 172.21.15.175:0/2291555313 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fac9c066f60 0x7fac9c069420 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.453+0000 7facc0c00640 1 --2- 172.21.15.175:0/2291555313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7facbc0d0d50 0x7facbc0cbc80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.453+0000 7facc0c00640 1 --2- 172.21.15.175:0/2291555313 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7facbc099a50 0x7facbc141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.453+0000 7facc0c00640 1 --2- 172.21.15.175:0/2291555313 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7facbc06bd60 0x7facbc153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.453+0000 7facc0c00640 1 -- 172.21.15.175:0/2291555313 >> 172.21.15.175:0/2291555313 conn(0x7facbc0b3300 msgr2=0x7facbc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:32.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.453+0000 7facc0c00640 1 -- 172.21.15.175:0/2291555313 shutdown_connections 2024-04-25T09:05:32.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.453+0000 7facc0c00640 1 -- 172.21.15.175:0/2291555313 wait complete. 2024-04-25T09:05:32.462 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:05:32.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.605+0000 7fc000400640 1 Processor -- start 2024-04-25T09:05:32.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.609+0000 7fc000400640 1 -- start start 2024-04-25T09:05:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.609+0000 7fc000400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbff80b3880 0x7fbff8169c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.609+0000 7fc000400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbff80b2660 0x7fbff816c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.609+0000 7fc000400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff8162630 con 0x7fbff815c6e0 2024-04-25T09:05:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.609+0000 7fc000400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff815cac0 con 0x7fbff80b3880 2024-04-25T09:05:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.609+0000 7fc000400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff81628f0 con 0x7fbff80b2660 2024-04-25T09:05:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.609+0000 7fbffd000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbff80b3880 0x7fbff8169c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.609+0000 7fbffda00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fbff815c6e0 0x7fbff80b3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:42816/0 (socket says 172.21.15.175:42816) 2024-04-25T09:05:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.609+0000 7fbffd000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbff80b3880 0x7fbff8169c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43554/0 (socket says 172.21.15.175:43554) 2024-04-25T09:05:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.609+0000 7fbffda00640 1 -- 172.21.15.175:0/3575910290 learned_addr learned my addr 172.21.15.175:0/3575910290 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.609+0000 7fbffe400640 1 --2- 172.21.15.175:0/3575910290 >> v2:172.21.15.177:3300/0 conn(0x7fbff80b2660 0x7fbff816c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.609+0000 7fbffd000640 1 -- 172.21.15.175:0/3575910290 >> v2:172.21.15.177:3300/0 conn(0x7fbff80b2660 msgr2=0x7fbff816c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:32.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.609+0000 7fbffd000640 1 --2- 172.21.15.175:0/3575910290 >> v2:172.21.15.177:3300/0 conn(0x7fbff80b2660 0x7fbff816c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.609+0000 7fbffd000640 1 -- 172.21.15.175:0/3575910290 >> v1:172.21.15.177:6789/0 conn(0x7fbff815c6e0 legacy=0x7fbff80b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.609+0000 7fbff7e00640 1 -- 172.21.15.175:0/3575910290 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885057163 0 0) 0x7fbff8162630 con 0x7fbff815c6e0 2024-04-25T09:05:32.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.609+0000 7fbffd000640 1 -- 172.21.15.175:0/3575910290 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff8162bd0 con 0x7fbff80b3880 2024-04-25T09:05:32.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.613+0000 7fbffd000640 1 --2- 172.21.15.175:0/3575910290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbff80b3880 0x7fbff8169c50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbff806f2e0 tx=0x7fbfe401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855bf09d98b67a5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:32.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.613+0000 7fbff7e00640 1 -- 172.21.15.175:0/3575910290 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40b1070 con 0x7fbff80b3880 2024-04-25T09:05:32.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.613+0000 7fbff7e00640 1 -- 172.21.15.175:0/3575910290 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe40ac5f0 con 0x7fbff80b3880 2024-04-25T09:05:32.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.613+0000 7fbff7e00640 1 -- 172.21.15.175:0/3575910290 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40ac9c0 con 0x7fbff80b3880 2024-04-25T09:05:32.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.613+0000 7fc000400640 1 -- 172.21.15.175:0/3575910290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbff80b3880 msgr2=0x7fbff8169c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.613+0000 7fc000400640 1 --2- 172.21.15.175:0/3575910290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbff80b3880 0x7fbff8169c50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fbff806f2e0 tx=0x7fbfe401c480 comp rx=0 tx=0).stop 2024-04-25T09:05:32.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.613+0000 7fc000400640 1 -- 172.21.15.175:0/3575910290 shutdown_connections 2024-04-25T09:05:32.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.613+0000 7fc000400640 1 --2- 172.21.15.175:0/3575910290 >> v2:172.21.15.177:3300/0 conn(0x7fbff80b2660 0x7fbff816c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.613+0000 7fc000400640 1 --2- 172.21.15.175:0/3575910290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbff80b3880 0x7fbff8169c50 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.613+0000 7fc000400640 1 -- 172.21.15.175:0/3575910290 >> 172.21.15.175:0/3575910290 conn(0x7fbff806ac50 msgr2=0x7fbff806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:32.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.613+0000 7fc000400640 1 -- 172.21.15.175:0/3575910290 shutdown_connections 2024-04-25T09:05:32.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.613+0000 7fc000400640 1 -- 172.21.15.175:0/3575910290 wait complete. 2024-04-25T09:05:32.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.613+0000 7fc000400640 1 Processor -- start 2024-04-25T09:05:32.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.613+0000 7fc000400640 1 -- start start 2024-04-25T09:05:32.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fc000400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbff80b2660 0x7fbff81683e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fc000400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff80b3880 0x7fbff80cf830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fc000400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbff815c6e0 0x7fbff8159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fc000400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff8165980 con 0x7fbff80b2660 2024-04-25T09:05:32.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fc000400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff8165800 con 0x7fbff815c6e0 2024-04-25T09:05:32.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fc000400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff816ef00 con 0x7fbff80b3880 2024-04-25T09:05:32.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fbffda00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbff80b2660 0x7fbff81683e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fbffda00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbff80b2660 0x7fbff81683e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43562/0 (socket says 172.21.15.175:43562) 2024-04-25T09:05:32.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fbffda00640 1 -- 172.21.15.175:0/3755349413 learned_addr learned my addr 172.21.15.175:0/3755349413 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:32.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fbffe400640 1 --2- 172.21.15.175:0/3755349413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbff815c6e0 0x7fbff8159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fbffda00640 1 -- 172.21.15.175:0/3755349413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff80b3880 msgr2=0x7fbff80cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fbffda00640 1 --2- 172.21.15.175:0/3755349413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff80b3880 0x7fbff80cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fbffda00640 1 -- 172.21.15.175:0/3755349413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbff815c6e0 msgr2=0x7fbff8159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fbffda00640 1 --2- 172.21.15.175:0/3755349413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbff815c6e0 0x7fbff8159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fbffda00640 1 -- 172.21.15.175:0/3755349413 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff8161960 con 0x7fbff80b2660 2024-04-25T09:05:32.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fbffe400640 1 --2- 172.21.15.175:0/3755349413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbff815c6e0 0x7fbff8159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:32.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fbffda00640 1 --2- 172.21.15.175:0/3755349413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbff80b2660 0x7fbff81683e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00c410 tx=0x7fbfec00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:32.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fbff5600640 1 -- 172.21.15.175:0/3755349413 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0074e0 con 0x7fbff80b2660 2024-04-25T09:05:32.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fbff5600640 1 -- 172.21.15.175:0/3755349413 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec0047f0 con 0x7fbff80b2660 2024-04-25T09:05:32.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fbff5600640 1 -- 172.21.15.175:0/3755349413 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec007680 con 0x7fbff80b2660 2024-04-25T09:05:32.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fc000400640 1 -- 172.21.15.175:0/3755349413 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff80b3e20 con 0x7fbff80b2660 2024-04-25T09:05:32.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fc000400640 1 -- 172.21.15.175:0/3755349413 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff80cfd70 con 0x7fbff80b2660 2024-04-25T09:05:32.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fc000400640 1 -- 172.21.15.175:0/3755349413 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff8075160 con 0x7fbff80b2660 2024-04-25T09:05:32.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.617+0000 7fbff5600640 1 -- 172.21.15.175:0/3755349413 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbfec011070 con 0x7fbff80b2660 2024-04-25T09:05:32.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.621+0000 7fbff5600640 1 --2- 172.21.15.175:0/3755349413 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbfd8066f90 0x7fbfd8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.621+0000 7fbff5600640 1 -- 172.21.15.175:0/3755349413 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfec084b50 con 0x7fbff80b2660 2024-04-25T09:05:32.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.621+0000 7fbffd000640 1 --2- 172.21.15.175:0/3755349413 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbfd8066f90 0x7fbfd8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.621+0000 7fbffd000640 1 --2- 172.21.15.175:0/3755349413 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbfd8066f90 0x7fbfd8069450 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40ae000 tx=0x7fbfe4004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:32.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.625+0000 7fbff5600640 1 -- 172.21.15.175:0/3755349413 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbfec055b50 con 0x7fbff80b2660 2024-04-25T09:05:32.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.809+0000 7fc000400640 1 -- 172.21.15.175:0/3755349413 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbff8166830 con 0x7fbff80b2660 2024-04-25T09:05:32.799 INFO:tasks.ceph.mon.a.smithi175.stderr:2024-04-25T09:05:32.809+0000 7feb0ee00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:05:32.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.813+0000 7fbff5600640 1 -- 172.21.15.175:0/3755349413 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbfec055450 con 0x7fbff80b2660 2024-04-25T09:05:32.802 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:05:32.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.813+0000 7fc000400640 1 -- 172.21.15.175:0/3755349413 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbfd8066f90 msgr2=0x7fbfd8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.813+0000 7fc000400640 1 --2- 172.21.15.175:0/3755349413 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbfd8066f90 0x7fbfd8069450 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40ae000 tx=0x7fbfe4004740 comp rx=0 tx=0).stop 2024-04-25T09:05:32.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.813+0000 7fc000400640 1 -- 172.21.15.175:0/3755349413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbff80b2660 msgr2=0x7fbff81683e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.813+0000 7fc000400640 1 --2- 172.21.15.175:0/3755349413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbff80b2660 0x7fbff81683e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00c410 tx=0x7fbfec00c8d0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.813+0000 7fc000400640 1 -- 172.21.15.175:0/3755349413 shutdown_connections 2024-04-25T09:05:32.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.813+0000 7fc000400640 1 --2- 172.21.15.175:0/3755349413 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbfd8066f90 0x7fbfd8069450 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.813+0000 7fc000400640 1 --2- 172.21.15.175:0/3755349413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbff815c6e0 0x7fbff8159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.813+0000 7fc000400640 1 --2- 172.21.15.175:0/3755349413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbff80b3880 0x7fbff80cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.813+0000 7fc000400640 1 --2- 172.21.15.175:0/3755349413 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbff80b2660 0x7fbff81683e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.813+0000 7fc000400640 1 -- 172.21.15.175:0/3755349413 >> 172.21.15.175:0/3755349413 conn(0x7fbff806ac50 msgr2=0x7fbff80b07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:32.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.813+0000 7fc000400640 1 -- 172.21.15.175:0/3755349413 shutdown_connections 2024-04-25T09:05:32.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.813+0000 7fc000400640 1 -- 172.21.15.175:0/3755349413 wait complete. 2024-04-25T09:05:32.815 INFO:tasks.ceph.mds.a.smithi175.stderr: -6607> 2024-04-25T09:05:05.790+0000 7f074a600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:05:32.827 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:05:32.867 INFO:tasks.ceph.mds.a.smithi175.stdout:starting mds.a at 2024-04-25T09:05:32.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.981+0000 7fb85fe00640 1 Processor -- start 2024-04-25T09:05:32.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.981+0000 7fb85fe00640 1 -- start start 2024-04-25T09:05:32.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.981+0000 7fb85fe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb8601548b0 0x7fb86006ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.981+0000 7fb85fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb860154c90 0x7fb8600ad810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.981+0000 7fb85fe00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8600b3a30 con 0x7fb860070120 2024-04-25T09:05:32.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.981+0000 7fb85fe00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8600b3d10 con 0x7fb860154c90 2024-04-25T09:05:32.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.981+0000 7fb85fe00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8600b3ff0 con 0x7fb8601548b0 2024-04-25T09:05:32.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.981+0000 7fb85e000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb860154c90 0x7fb8600ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.981+0000 7fb85e000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb860154c90 0x7fb8600ad810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43602/0 (socket says 172.21.15.175:43602) 2024-04-25T09:05:32.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.981+0000 7fb85e000640 1 -- 172.21.15.175:0/2869905907 learned_addr learned my addr 172.21.15.175:0/2869905907 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:32.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.981+0000 7fb85ea00640 1 --2- 172.21.15.175:0/2869905907 >> v2:172.21.15.177:3300/0 conn(0x7fb8601548b0 0x7fb86006ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.981+0000 7fb85e000640 1 -- 172.21.15.175:0/2869905907 >> v2:172.21.15.177:3300/0 conn(0x7fb8601548b0 msgr2=0x7fb86006ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:32.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.981+0000 7fb85e000640 1 --2- 172.21.15.175:0/2869905907 >> v2:172.21.15.177:3300/0 conn(0x7fb8601548b0 0x7fb86006ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.981+0000 7fb85e000640 1 -- 172.21.15.175:0/2869905907 >> v1:172.21.15.177:6789/0 conn(0x7fb860070120 legacy=0x7fb8600b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.981+0000 7fb85e000640 1 -- 172.21.15.175:0/2869905907 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8600b42d0 con 0x7fb860154c90 2024-04-25T09:05:32.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.985+0000 7fb85e000640 1 --2- 172.21.15.175:0/2869905907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb860154c90 0x7fb8600ad810 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb860066cb0 tx=0x7fb84c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b81c693dc3f3fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:32.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.985+0000 7fb85d600640 1 -- 172.21.15.175:0/2869905907 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86015ebe0 con 0x7fb860154c90 2024-04-25T09:05:32.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.985+0000 7fb85d600640 1 -- 172.21.15.175:0/2869905907 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84c0a9400 con 0x7fb860154c90 2024-04-25T09:05:32.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.985+0000 7fb85d600640 1 -- 172.21.15.175:0/2869905907 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c0a97d0 con 0x7fb860154c90 2024-04-25T09:05:32.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.985+0000 7fb85fe00640 1 -- 172.21.15.175:0/2869905907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb860154c90 msgr2=0x7fb8600ad810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.985+0000 7fb85fe00640 1 --2- 172.21.15.175:0/2869905907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb860154c90 0x7fb8600ad810 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb860066cb0 tx=0x7fb84c01c520 comp rx=0 tx=0).stop 2024-04-25T09:05:32.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.985+0000 7fb85fe00640 1 -- 172.21.15.175:0/2869905907 shutdown_connections 2024-04-25T09:05:32.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.985+0000 7fb85fe00640 1 --2- 172.21.15.175:0/2869905907 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb860154c90 0x7fb8600ad810 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.985+0000 7fb85fe00640 1 --2- 172.21.15.175:0/2869905907 >> v2:172.21.15.177:3300/0 conn(0x7fb8601548b0 0x7fb86006ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.985+0000 7fb85fe00640 1 -- 172.21.15.175:0/2869905907 >> 172.21.15.175:0/2869905907 conn(0x7fb8600d0360 msgr2=0x7fb8600d0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:32.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.985+0000 7fb85fe00640 1 -- 172.21.15.175:0/2869905907 shutdown_connections 2024-04-25T09:05:32.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.985+0000 7fb85fe00640 1 -- 172.21.15.175:0/2869905907 wait complete. 2024-04-25T09:05:32.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85fe00640 1 Processor -- start 2024-04-25T09:05:32.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85fe00640 1 -- start start 2024-04-25T09:05:32.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85fe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb860070120 0x7fb86014d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8601548b0 0x7fb8601576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb860154c90 0x7fb86006ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85fe00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600add50 con 0x7fb860154c90 2024-04-25T09:05:32.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85fe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86006b3a0 con 0x7fb8601548b0 2024-04-25T09:05:32.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85fe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600aded0 con 0x7fb860070120 2024-04-25T09:05:32.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb860154c90 0x7fb86006ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb860154c90 0x7fb86006ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43608/0 (socket says 172.21.15.175:43608) 2024-04-25T09:05:32.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85f400640 1 -- 172.21.15.175:0/2564276364 learned_addr learned my addr 172.21.15.175:0/2564276364 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:32.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85e000640 1 --2- 172.21.15.175:0/2564276364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8601548b0 0x7fb8601576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85ea00640 1 --2- 172.21.15.175:0/2564276364 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb860070120 0x7fb86014d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85f400640 1 -- 172.21.15.175:0/2564276364 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb860070120 msgr2=0x7fb86014d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85f400640 1 --2- 172.21.15.175:0/2564276364 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb860070120 0x7fb86014d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85f400640 1 -- 172.21.15.175:0/2564276364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8601548b0 msgr2=0x7fb8601576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:32.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85f400640 1 --2- 172.21.15.175:0/2564276364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8601548b0 0x7fb8601576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:32.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85f400640 1 -- 172.21.15.175:0/2564276364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb860155d60 con 0x7fb860154c90 2024-04-25T09:05:32.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85e000640 1 --2- 172.21.15.175:0/2564276364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8601548b0 0x7fb8601576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:32.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85f400640 1 --2- 172.21.15.175:0/2564276364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb860154c90 0x7fb86006ecb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c7a0 tx=0x7fb85800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:32.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb856a00640 1 -- 172.21.15.175:0/2564276364 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858003b80 con 0x7fb860154c90 2024-04-25T09:05:32.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb856a00640 1 -- 172.21.15.175:0/2564276364 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb858003d20 con 0x7fb860154c90 2024-04-25T09:05:32.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb856a00640 1 -- 172.21.15.175:0/2564276364 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85800aa30 con 0x7fb860154c90 2024-04-25T09:05:32.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85fe00640 1 -- 172.21.15.175:0/2564276364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8600cef10 con 0x7fb860154c90 2024-04-25T09:05:32.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85fe00640 1 -- 172.21.15.175:0/2564276364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb860155a50 con 0x7fb860154c90 2024-04-25T09:05:32.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.989+0000 7fb85fe00640 1 -- 172.21.15.175:0/2564276364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8600cf430 con 0x7fb860154c90 2024-04-25T09:05:32.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.993+0000 7fb856a00640 1 -- 172.21.15.175:0/2564276364 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb85800abd0 con 0x7fb860154c90 2024-04-25T09:05:32.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.993+0000 7fb856a00640 1 --2- 172.21.15.175:0/2564276364 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb840066f60 0x7fb840069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:32.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.993+0000 7fb856a00640 1 -- 172.21.15.175:0/2564276364 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb858085060 con 0x7fb860154c90 2024-04-25T09:05:32.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.993+0000 7fb85ea00640 1 --2- 172.21.15.175:0/2564276364 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb840066f60 0x7fb840069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:32.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.993+0000 7fb85ea00640 1 --2- 172.21.15.175:0/2564276364 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb840066f60 0x7fb840069420 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb860160050 tx=0x7fb850008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:32.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:32.997+0000 7fb856a00640 1 -- 172.21.15.175:0/2564276364 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb8600cf430 con 0x7fb860154c90 2024-04-25T09:05:33.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:33.181+0000 7fb85fe00640 1 -- 172.21.15.175:0/2564276364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb860074a60 con 0x7fb860154c90 2024-04-25T09:05:33.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:33.889+0000 7fb856a00640 1 -- 172.21.15.175:0/2564276364 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb858055f70 con 0x7fb860154c90 2024-04-25T09:05:33.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:33.893+0000 7fb85fe00640 1 -- 172.21.15.175:0/2564276364 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb840066f60 msgr2=0x7fb840069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:33.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:33.893+0000 7fb85fe00640 1 --2- 172.21.15.175:0/2564276364 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb840066f60 0x7fb840069420 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb860160050 tx=0x7fb850008040 comp rx=0 tx=0).stop 2024-04-25T09:05:33.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:33.893+0000 7fb85fe00640 1 -- 172.21.15.175:0/2564276364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb860154c90 msgr2=0x7fb86006ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:33.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:33.893+0000 7fb85fe00640 1 --2- 172.21.15.175:0/2564276364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb860154c90 0x7fb86006ecb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c7a0 tx=0x7fb85800cc60 comp rx=0 tx=0).stop 2024-04-25T09:05:33.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:33.893+0000 7fb85fe00640 1 -- 172.21.15.175:0/2564276364 shutdown_connections 2024-04-25T09:05:33.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:33.893+0000 7fb85fe00640 1 --2- 172.21.15.175:0/2564276364 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb840066f60 0x7fb840069420 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:33.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:33.893+0000 7fb85fe00640 1 --2- 172.21.15.175:0/2564276364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb860154c90 0x7fb86006ecb0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:33.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:33.893+0000 7fb85fe00640 1 --2- 172.21.15.175:0/2564276364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8601548b0 0x7fb8601576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:33.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:33.893+0000 7fb85fe00640 1 --2- 172.21.15.175:0/2564276364 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb860070120 0x7fb86014d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:33.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:33.893+0000 7fb85fe00640 1 -- 172.21.15.175:0/2564276364 >> 172.21.15.175:0/2564276364 conn(0x7fb8600d0360 msgr2=0x7fb860160150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:33.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:33.893+0000 7fb85fe00640 1 -- 172.21.15.175:0/2564276364 shutdown_connections 2024-04-25T09:05:33.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:33.893+0000 7fb85fe00640 1 -- 172.21.15.175:0/2564276364 wait complete. 2024-04-25T09:05:33.906 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:05:34.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.105+0000 7fed1a400640 1 Processor -- start 2024-04-25T09:05:34.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.105+0000 7fed1a400640 1 -- start start 2024-04-25T09:05:34.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.105+0000 7fed1a400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fed1408a8e0 0x7fed140b2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:34.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.105+0000 7fed1a400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed140b3920 0x7fed140cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:34.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.105+0000 7fed1a400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed1406df10 con 0x7fed1416f160 2024-04-25T09:05:34.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.105+0000 7fed1a400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1406dcc0 con 0x7fed1408a8e0 2024-04-25T09:05:34.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.105+0000 7fed1a400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1406e1f0 con 0x7fed140b3920 2024-04-25T09:05:34.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.105+0000 7fed13400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fed1408a8e0 0x7fed140b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:34.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.105+0000 7fed13400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fed1408a8e0 0x7fed140b2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43616/0 (socket says 172.21.15.175:43616) 2024-04-25T09:05:34.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.105+0000 7fed13400640 1 -- 172.21.15.175:0/3111890950 learned_addr learned my addr 172.21.15.175:0/3111890950 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:34.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.105+0000 7fed12a00640 1 -- 172.21.15.175:0/3111890950 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758156589 0 0) 0x7fed1406df10 con 0x7fed1416f160 2024-04-25T09:05:34.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.105+0000 7fed13e00640 1 --2- 172.21.15.175:0/3111890950 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed140b3920 0x7fed140cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:34.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.129+0000 7fed12a00640 1 -- 172.21.15.175:0/3111890950 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecf8007940 con 0x7fed1416f160 2024-04-25T09:05:34.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.129+0000 7fed13400640 1 -- 172.21.15.175:0/3111890950 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed140b3920 msgr2=0x7fed140cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:34.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.129+0000 7fed13400640 1 --2- 172.21.15.175:0/3111890950 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed140b3920 0x7fed140cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.129+0000 7fed13400640 1 -- 172.21.15.175:0/3111890950 >> v1:172.21.15.177:6789/0 conn(0x7fed1416f160 legacy=0x7fed140b3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:34.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.129+0000 7fed13400640 1 -- 172.21.15.175:0/3111890950 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1406e4d0 con 0x7fed1408a8e0 2024-04-25T09:05:34.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.133+0000 7fed13400640 1 --2- 172.21.15.175:0/3111890950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed1408a8e0 0x7fed140b2700 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fed040088e0 tx=0x7fed0401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a0688b81e166dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:34.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.133+0000 7fed12a00640 1 -- 172.21.15.175:0/3111890950 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed040b0070 con 0x7fed1408a8e0 2024-04-25T09:05:34.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.133+0000 7fed12a00640 1 -- 172.21.15.175:0/3111890950 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed04008be0 con 0x7fed1408a8e0 2024-04-25T09:05:34.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.133+0000 7fed12a00640 1 -- 172.21.15.175:0/3111890950 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed040a7070 con 0x7fed1408a8e0 2024-04-25T09:05:34.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.133+0000 7fed1a400640 1 -- 172.21.15.175:0/3111890950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed1408a8e0 msgr2=0x7fed140b2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:34.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.133+0000 7fed1a400640 1 --2- 172.21.15.175:0/3111890950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed1408a8e0 0x7fed140b2700 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fed040088e0 tx=0x7fed0401c450 comp rx=0 tx=0).stop 2024-04-25T09:05:34.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.133+0000 7fed1a400640 1 -- 172.21.15.175:0/3111890950 shutdown_connections 2024-04-25T09:05:34.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.133+0000 7fed1a400640 1 --2- 172.21.15.175:0/3111890950 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed140b3920 0x7fed140cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.133+0000 7fed1a400640 1 --2- 172.21.15.175:0/3111890950 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed1408a8e0 0x7fed140b2700 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.133+0000 7fed1a400640 1 -- 172.21.15.175:0/3111890950 >> 172.21.15.175:0/3111890950 conn(0x7fed1406ac50 msgr2=0x7fed1406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:34.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.133+0000 7fed1a400640 1 -- 172.21.15.175:0/3111890950 shutdown_connections 2024-04-25T09:05:34.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.133+0000 7fed1a400640 1 -- 172.21.15.175:0/3111890950 wait complete. 2024-04-25T09:05:34.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed1a400640 1 Processor -- start 2024-04-25T09:05:34.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed1a400640 1 -- start start 2024-04-25T09:05:34.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed1a400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed1408a8e0 0x7fed14166600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:34.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed1a400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed140b3920 0x7fed14166b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:34.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed1a400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed1416f160 0x7fed140b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:34.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed1a400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed140cfee0 con 0x7fed1416f160 2024-04-25T09:05:34.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed1a400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed140cfd60 con 0x7fed140b3920 2024-04-25T09:05:34.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed1a400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed140d0060 con 0x7fed1408a8e0 2024-04-25T09:05:34.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed13e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed1416f160 0x7fed140b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:34.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed13e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed1416f160 0x7fed140b09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43624/0 (socket says 172.21.15.175:43624) 2024-04-25T09:05:34.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed13e00640 1 -- 172.21.15.175:0/3208117978 learned_addr learned my addr 172.21.15.175:0/3208117978 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:34.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed0be00640 1 --2- 172.21.15.175:0/3208117978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed140b3920 0x7fed14166b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:34.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed13400640 1 --2- 172.21.15.175:0/3208117978 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed1408a8e0 0x7fed14166600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:34.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed13e00640 1 -- 172.21.15.175:0/3208117978 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed1408a8e0 msgr2=0x7fed14166600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:34.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed13e00640 1 --2- 172.21.15.175:0/3208117978 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed1408a8e0 0x7fed14166600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed13e00640 1 -- 172.21.15.175:0/3208117978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed140b3920 msgr2=0x7fed14166b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:34.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed13e00640 1 --2- 172.21.15.175:0/3208117978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed140b3920 0x7fed14166b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed13e00640 1 -- 172.21.15.175:0/3208117978 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed141671b0 con 0x7fed1416f160 2024-04-25T09:05:34.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed0be00640 1 --2- 172.21.15.175:0/3208117978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed140b3920 0x7fed14166b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:34.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed13e00640 1 --2- 172.21.15.175:0/3208117978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed1416f160 0x7fed140b09f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fed0c008c90 tx=0x7fed0c00e5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:34.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed0b400640 1 -- 172.21.15.175:0/3208117978 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c00d040 con 0x7fed1416f160 2024-04-25T09:05:34.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed0b400640 1 -- 172.21.15.175:0/3208117978 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c003ba0 con 0x7fed1416f160 2024-04-25T09:05:34.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed0b400640 1 -- 172.21.15.175:0/3208117978 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c008d80 con 0x7fed1416f160 2024-04-25T09:05:34.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed1a400640 1 -- 172.21.15.175:0/3208117978 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed14165260 con 0x7fed1416f160 2024-04-25T09:05:34.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed1a400640 1 -- 172.21.15.175:0/3208117978 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed14165a60 con 0x7fed1416f160 2024-04-25T09:05:34.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.137+0000 7fed1a400640 1 -- 172.21.15.175:0/3208117978 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed14075160 con 0x7fed1416f160 2024-04-25T09:05:34.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.141+0000 7fed0b400640 1 -- 172.21.15.175:0/3208117978 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fed0c004030 con 0x7fed1416f160 2024-04-25T09:05:34.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.141+0000 7fed0b400640 1 --2- 172.21.15.175:0/3208117978 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fecf0066f60 0x7fecf0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:34.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.141+0000 7fed0b400640 1 -- 172.21.15.175:0/3208117978 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fed0c085970 con 0x7fed1416f160 2024-04-25T09:05:34.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.141+0000 7fed13400640 1 --2- 172.21.15.175:0/3208117978 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fecf0066f60 0x7fecf0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:34.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.141+0000 7fed13400640 1 --2- 172.21.15.175:0/3208117978 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fecf0066f60 0x7fecf0069420 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fed040ad000 tx=0x7fed040a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:34.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.145+0000 7fed0b400640 1 -- 172.21.15.175:0/3208117978 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fed0c056910 con 0x7fed1416f160 2024-04-25T09:05:34.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.301+0000 7fed1a400640 1 -- 172.21.15.175:0/3208117978 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fed14167620 con 0x7fed1416f160 2024-04-25T09:05:34.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.893+0000 7fed0b400640 1 -- 172.21.15.175:0/3208117978 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v34) v1 ==== 181+0+0 (secure 0 0 0) 0x7fed0c056210 con 0x7fed1416f160 2024-04-25T09:05:34.885 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:05:34.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.897+0000 7fed1a400640 1 -- 172.21.15.175:0/3208117978 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fecf0066f60 msgr2=0x7fecf0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:34.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.897+0000 7fed1a400640 1 --2- 172.21.15.175:0/3208117978 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fecf0066f60 0x7fecf0069420 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fed040ad000 tx=0x7fed040a7000 comp rx=0 tx=0).stop 2024-04-25T09:05:34.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.897+0000 7fed1a400640 1 -- 172.21.15.175:0/3208117978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed1416f160 msgr2=0x7fed140b09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:34.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.897+0000 7fed1a400640 1 --2- 172.21.15.175:0/3208117978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed1416f160 0x7fed140b09f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fed0c008c90 tx=0x7fed0c00e5c0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.897+0000 7fed1a400640 1 -- 172.21.15.175:0/3208117978 shutdown_connections 2024-04-25T09:05:34.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.897+0000 7fed1a400640 1 --2- 172.21.15.175:0/3208117978 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fecf0066f60 0x7fecf0069420 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.897+0000 7fed1a400640 1 --2- 172.21.15.175:0/3208117978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fed1416f160 0x7fed140b09f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.897+0000 7fed1a400640 1 --2- 172.21.15.175:0/3208117978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed140b3920 0x7fed14166b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.897+0000 7fed1a400640 1 --2- 172.21.15.175:0/3208117978 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed1408a8e0 0x7fed14166600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:34.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.897+0000 7fed1a400640 1 -- 172.21.15.175:0/3208117978 >> 172.21.15.175:0/3208117978 conn(0x7fed1406ac50 msgr2=0x7fed1416d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:34.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.897+0000 7fed1a400640 1 -- 172.21.15.175:0/3208117978 shutdown_connections 2024-04-25T09:05:34.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:34.897+0000 7fed1a400640 1 -- 172.21.15.175:0/3208117978 wait complete. 2024-04-25T09:05:34.911 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:05:35.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.065+0000 7fb084800640 1 Processor -- start 2024-04-25T09:05:35.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.065+0000 7fb084800640 1 -- start start 2024-04-25T09:05:35.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.065+0000 7fb084800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb07c0aebd0 0x7fb07c15b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.065+0000 7fb084800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb07c0b4970 0x7fb07c15c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.065+0000 7fb084800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c15b880 con 0x7fb07c0b2700 2024-04-25T09:05:35.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.065+0000 7fb084800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c15bb60 con 0x7fb07c0b4970 2024-04-25T09:05:35.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.065+0000 7fb084800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c15be40 con 0x7fb07c0aebd0 2024-04-25T09:05:35.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.065+0000 7fb082800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb07c0b4970 0x7fb07c15c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.065+0000 7fb082800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb07c0b4970 0x7fb07c15c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43630/0 (socket says 172.21.15.175:43630) 2024-04-25T09:05:35.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.069+0000 7fb082800640 1 -- 172.21.15.175:0/1947138461 learned_addr learned my addr 172.21.15.175:0/1947138461 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:35.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.069+0000 7fb081e00640 1 --2- 172.21.15.175:0/1947138461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb07c0aebd0 0x7fb07c15b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.069+0000 7fb082800640 1 -- 172.21.15.175:0/1947138461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb07c0aebd0 msgr2=0x7fb07c15b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:35.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.069+0000 7fb082800640 1 --2- 172.21.15.175:0/1947138461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb07c0aebd0 0x7fb07c15b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.069+0000 7fb082800640 1 -- 172.21.15.175:0/1947138461 >> v1:172.21.15.177:6789/0 conn(0x7fb07c0b2700 legacy=0x7fb07c0b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.069+0000 7fb082800640 1 -- 172.21.15.175:0/1947138461 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c15c400 con 0x7fb07c0b4970 2024-04-25T09:05:35.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.069+0000 7fb082800640 1 --2- 172.21.15.175:0/1947138461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb07c0b4970 0x7fb07c15c920 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb07800d150 tx=0x7fb07801eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d30cc2108909631 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:35.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.069+0000 7fb080a00640 1 -- 172.21.15.175:0/1947138461 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07800b2d0 con 0x7fb07c0b4970 2024-04-25T09:05:35.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.069+0000 7fb080a00640 1 -- 172.21.15.175:0/1947138461 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c0af1c0 con 0x7fb07c0b4970 2024-04-25T09:05:35.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.069+0000 7fb080a00640 1 -- 172.21.15.175:0/1947138461 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0780a7ba0 con 0x7fb07c0b4970 2024-04-25T09:05:35.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb084800640 1 -- 172.21.15.175:0/1947138461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb07c0b4970 msgr2=0x7fb07c15c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb084800640 1 --2- 172.21.15.175:0/1947138461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb07c0b4970 0x7fb07c15c920 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb07800d150 tx=0x7fb07801eba0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb084800640 1 -- 172.21.15.175:0/1947138461 shutdown_connections 2024-04-25T09:05:35.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb084800640 1 --2- 172.21.15.175:0/1947138461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb07c0b4970 0x7fb07c15c920 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb084800640 1 --2- 172.21.15.175:0/1947138461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb07c0aebd0 0x7fb07c15b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb084800640 1 -- 172.21.15.175:0/1947138461 >> 172.21.15.175:0/1947138461 conn(0x7fb07c06ac50 msgr2=0x7fb07c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:35.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb084800640 1 -- 172.21.15.175:0/1947138461 shutdown_connections 2024-04-25T09:05:35.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb084800640 1 -- 172.21.15.175:0/1947138461 wait complete. 2024-04-25T09:05:35.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb084800640 1 Processor -- start 2024-04-25T09:05:35.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb084800640 1 -- start start 2024-04-25T09:05:35.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb084800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb07c0aebd0 0x7fb07c1596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb084800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb07c0b2700 0x7fb07c1551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb084800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb07c0b4970 0x7fb07c150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb084800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c15da80 con 0x7fb07c0b4970 2024-04-25T09:05:35.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb084800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c15d900 con 0x7fb07c0aebd0 2024-04-25T09:05:35.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb084800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c15dc00 con 0x7fb07c0b2700 2024-04-25T09:05:35.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb082800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb07c0b4970 0x7fb07c150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb082800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb07c0b4970 0x7fb07c150260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43640/0 (socket says 172.21.15.175:43640) 2024-04-25T09:05:35.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb082800640 1 -- 172.21.15.175:0/1441037767 learned_addr learned my addr 172.21.15.175:0/1441037767 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:35.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb081e00640 1 --2- 172.21.15.175:0/1441037767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb07c0aebd0 0x7fb07c1596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb081400640 1 --2- 172.21.15.175:0/1441037767 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb07c0b2700 0x7fb07c1551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb082800640 1 -- 172.21.15.175:0/1441037767 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb07c0b2700 msgr2=0x7fb07c1551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb082800640 1 --2- 172.21.15.175:0/1441037767 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb07c0b2700 0x7fb07c1551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb082800640 1 -- 172.21.15.175:0/1441037767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb07c0aebd0 msgr2=0x7fb07c1596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb082800640 1 --2- 172.21.15.175:0/1441037767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb07c0aebd0 0x7fb07c1596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb082800640 1 -- 172.21.15.175:0/1441037767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c0b1d60 con 0x7fb07c0b4970 2024-04-25T09:05:35.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb082800640 1 --2- 172.21.15.175:0/1441037767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb07c0b4970 0x7fb07c150260 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb07801c7d0 tx=0x7fb07801b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:35.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.073+0000 7fb076000640 1 -- 172.21.15.175:0/1441037767 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0780a7e10 con 0x7fb07c0b4970 2024-04-25T09:05:35.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.077+0000 7fb076000640 1 -- 172.21.15.175:0/1441037767 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0780be070 con 0x7fb07c0b4970 2024-04-25T09:05:35.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.077+0000 7fb076000640 1 -- 172.21.15.175:0/1441037767 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb078009840 con 0x7fb07c0b4970 2024-04-25T09:05:35.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.077+0000 7fb084800640 1 -- 172.21.15.175:0/1441037767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c0b2040 con 0x7fb07c0b4970 2024-04-25T09:05:35.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.077+0000 7fb084800640 1 -- 172.21.15.175:0/1441037767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c0acd40 con 0x7fb07c0b4970 2024-04-25T09:05:35.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.077+0000 7fb084800640 1 -- 172.21.15.175:0/1441037767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c075160 con 0x7fb07c0b4970 2024-04-25T09:05:35.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.077+0000 7fb076000640 1 -- 172.21.15.175:0/1441037767 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb0780b6070 con 0x7fb07c0b4970 2024-04-25T09:05:35.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.077+0000 7fb076000640 1 --2- 172.21.15.175:0/1441037767 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb060066f60 0x7fb060069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:35.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.077+0000 7fb076000640 1 -- 172.21.15.175:0/1441037767 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fb07811feb0 con 0x7fb07c0b4970 2024-04-25T09:05:35.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.077+0000 7fb081e00640 1 --2- 172.21.15.175:0/1441037767 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb060066f60 0x7fb060069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:35.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.077+0000 7fb081e00640 1 --2- 172.21.15.175:0/1441037767 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb060066f60 0x7fb060069420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb070009a50 tx=0x7fb070008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:35.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.081+0000 7fb076000640 1 -- 172.21.15.175:0/1441037767 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb078018820 con 0x7fb07c0b4970 2024-04-25T09:05:35.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.237+0000 7fb084800640 1 -- 172.21.15.175:0/1441037767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb07c06b280 con 0x7fb07c0b4970 2024-04-25T09:05:35.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.909+0000 7fb076000640 1 -- 172.21.15.175:0/1441037767 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v35) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb0780aee40 con 0x7fb07c0b4970 2024-04-25T09:05:35.900 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_data' removed 2024-04-25T09:05:35.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.913+0000 7fb084800640 1 -- 172.21.15.175:0/1441037767 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb060066f60 msgr2=0x7fb060069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.913+0000 7fb084800640 1 --2- 172.21.15.175:0/1441037767 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb060066f60 0x7fb060069420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb070009a50 tx=0x7fb070008040 comp rx=0 tx=0).stop 2024-04-25T09:05:35.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.913+0000 7fb084800640 1 -- 172.21.15.175:0/1441037767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb07c0b4970 msgr2=0x7fb07c150260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:35.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.913+0000 7fb084800640 1 --2- 172.21.15.175:0/1441037767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb07c0b4970 0x7fb07c150260 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb07801c7d0 tx=0x7fb07801b940 comp rx=0 tx=0).stop 2024-04-25T09:05:35.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.913+0000 7fb084800640 1 -- 172.21.15.175:0/1441037767 shutdown_connections 2024-04-25T09:05:35.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.913+0000 7fb084800640 1 --2- 172.21.15.175:0/1441037767 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb060066f60 0x7fb060069420 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.913+0000 7fb084800640 1 --2- 172.21.15.175:0/1441037767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb07c0b4970 0x7fb07c150260 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.913+0000 7fb084800640 1 --2- 172.21.15.175:0/1441037767 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb07c0b2700 0x7fb07c1551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.913+0000 7fb084800640 1 --2- 172.21.15.175:0/1441037767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb07c0aebd0 0x7fb07c1596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:35.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.913+0000 7fb084800640 1 -- 172.21.15.175:0/1441037767 >> 172.21.15.175:0/1441037767 conn(0x7fb07c06ac50 msgr2=0x7fb07c15a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:35.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.913+0000 7fb084800640 1 -- 172.21.15.175:0/1441037767 shutdown_connections 2024-04-25T09:05:35.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:35.913+0000 7fb084800640 1 -- 172.21.15.175:0/1441037767 wait complete. 2024-04-25T09:05:35.931 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:05:36.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.089+0000 7f58e9c00640 1 Processor -- start 2024-04-25T09:05:36.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.089+0000 7f58e9c00640 1 -- start start 2024-04-25T09:05:36.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.093+0000 7f58e9c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f58e406ac50 0x7f58e40cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.093+0000 7f58e9c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58e415bd40 0x7f58e406b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.093+0000 7f58e9c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e406b570 con 0x7f58e40cd9c0 2024-04-25T09:05:36.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.093+0000 7f58e9c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e40cd530 con 0x7f58e406ac50 2024-04-25T09:05:36.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.093+0000 7f58e9c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40cc920 con 0x7f58e415bd40 2024-04-25T09:05:36.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.093+0000 7f58e2000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58e415bd40 0x7f58e406b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.093+0000 7f58e3400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f58e40cd9c0 0x7f58e415d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:42850/0 (socket says 172.21.15.175:42850) 2024-04-25T09:05:36.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.093+0000 7f58e2a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f58e406ac50 0x7f58e40cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.093+0000 7f58e3400640 1 -- 172.21.15.175:0/3843040216 learned_addr learned my addr 172.21.15.175:0/3843040216 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:36.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.093+0000 7f58e2000640 1 -- 172.21.15.175:0/3843040216 >> v2:172.21.15.177:3300/0 conn(0x7f58e406ac50 msgr2=0x7f58e40cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:36.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.093+0000 7f58e2000640 1 --2- 172.21.15.175:0/3843040216 >> v2:172.21.15.177:3300/0 conn(0x7f58e406ac50 0x7f58e40cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.093+0000 7f58e2000640 1 -- 172.21.15.175:0/3843040216 >> v1:172.21.15.177:6789/0 conn(0x7f58e40cd9c0 legacy=0x7f58e415d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.093+0000 7f58e1600640 1 -- 172.21.15.175:0/3843040216 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636059345 0 0) 0x7f58e406b570 con 0x7f58e40cd9c0 2024-04-25T09:05:36.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.093+0000 7f58e2000640 1 -- 172.21.15.175:0/3843040216 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e40ccc00 con 0x7f58e415bd40 2024-04-25T09:05:36.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.097+0000 7f58e2000640 1 --2- 172.21.15.175:0/3843040216 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58e415bd40 0x7f58e406b030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f58d00097c0 tx=0x7f58d001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d11c56b6f2941ce2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.097+0000 7f58e1600640 1 -- 172.21.15.175:0/3843040216 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d00b0070 con 0x7f58e415bd40 2024-04-25T09:05:36.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.097+0000 7f58e1600640 1 -- 172.21.15.175:0/3843040216 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d00ab600 con 0x7f58e415bd40 2024-04-25T09:05:36.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.097+0000 7f58e1600640 1 -- 172.21.15.175:0/3843040216 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d00ab9d0 con 0x7f58e415bd40 2024-04-25T09:05:36.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.097+0000 7f58e9c00640 1 -- 172.21.15.175:0/3843040216 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58e415bd40 msgr2=0x7f58e406b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.097+0000 7f58e9c00640 1 --2- 172.21.15.175:0/3843040216 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58e415bd40 0x7f58e406b030 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f58d00097c0 tx=0x7f58d001c3e0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.097+0000 7f58e9c00640 1 -- 172.21.15.175:0/3843040216 shutdown_connections 2024-04-25T09:05:36.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.097+0000 7f58e9c00640 1 --2- 172.21.15.175:0/3843040216 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58e415bd40 0x7f58e406b030 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.097+0000 7f58e9c00640 1 --2- 172.21.15.175:0/3843040216 >> v2:172.21.15.177:3300/0 conn(0x7f58e406ac50 0x7f58e40cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.097+0000 7f58e9c00640 1 -- 172.21.15.175:0/3843040216 >> 172.21.15.175:0/3843040216 conn(0x7f58e4099a50 msgr2=0x7f58e40b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:36.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.097+0000 7f58e9c00640 1 -- 172.21.15.175:0/3843040216 shutdown_connections 2024-04-25T09:05:36.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.097+0000 7f58e9c00640 1 -- 172.21.15.175:0/3843040216 wait complete. 2024-04-25T09:05:36.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.097+0000 7f58e9c00640 1 Processor -- start 2024-04-25T09:05:36.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.097+0000 7f58e9c00640 1 -- start start 2024-04-25T09:05:36.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e9c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58e406ac50 0x7f58e406ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e9c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58e40cd9c0 0x7f58e40ce500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e9c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e415bd40 0x7f58e4147880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e9c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40b31b0 con 0x7f58e415bd40 2024-04-25T09:05:36.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e9c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40b3030 con 0x7f58e40cd9c0 2024-04-25T09:05:36.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e9c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40cde10 con 0x7f58e406ac50 2024-04-25T09:05:36.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e415bd40 0x7f58e4147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e2000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58e40cd9c0 0x7f58e40ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e415bd40 0x7f58e4147880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43650/0 (socket says 172.21.15.175:43650) 2024-04-25T09:05:36.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e3400640 1 -- 172.21.15.175:0/2904115421 learned_addr learned my addr 172.21.15.175:0/2904115421 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:36.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e2a00640 1 --2- 172.21.15.175:0/2904115421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58e406ac50 0x7f58e406ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e2000640 1 -- 172.21.15.175:0/2904115421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58e406ac50 msgr2=0x7f58e406ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e2000640 1 --2- 172.21.15.175:0/2904115421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58e406ac50 0x7f58e406ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e2000640 1 -- 172.21.15.175:0/2904115421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e415bd40 msgr2=0x7f58e4147880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e2000640 1 --2- 172.21.15.175:0/2904115421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e415bd40 0x7f58e4147880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e2000640 1 -- 172.21.15.175:0/2904115421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e40ca730 con 0x7f58e40cd9c0 2024-04-25T09:05:36.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e2000640 1 --2- 172.21.15.175:0/2904115421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58e40cd9c0 0x7f58e40ce500 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f58d00ab000 tx=0x7f58d0019180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58daa00640 1 -- 172.21.15.175:0/2904115421 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d00ba070 con 0x7f58e40cd9c0 2024-04-25T09:05:36.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58daa00640 1 -- 172.21.15.175:0/2904115421 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d00b5460 con 0x7f58e40cd9c0 2024-04-25T09:05:36.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58daa00640 1 -- 172.21.15.175:0/2904115421 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d00b0040 con 0x7f58e40cd9c0 2024-04-25T09:05:36.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e9c00640 1 -- 172.21.15.175:0/2904115421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e40704e0 con 0x7f58e40cd9c0 2024-04-25T09:05:36.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e9c00640 1 -- 172.21.15.175:0/2904115421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e40ca170 con 0x7f58e40cd9c0 2024-04-25T09:05:36.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.101+0000 7f58e9c00640 1 -- 172.21.15.175:0/2904115421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e4164ce0 con 0x7f58e40cd9c0 2024-04-25T09:05:36.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.105+0000 7f58daa00640 1 -- 172.21.15.175:0/2904115421 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f58d00bd070 con 0x7f58e40cd9c0 2024-04-25T09:05:36.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.105+0000 7f58daa00640 1 --2- 172.21.15.175:0/2904115421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f58c4066f60 0x7f58c4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.105+0000 7f58daa00640 1 -- 172.21.15.175:0/2904115421 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f58d011f250 con 0x7f58e40cd9c0 2024-04-25T09:05:36.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.105+0000 7f58e2a00640 1 --2- 172.21.15.175:0/2904115421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f58c4066f60 0x7f58c4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.105+0000 7f58e2a00640 1 --2- 172.21.15.175:0/2904115421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f58c4066f60 0x7f58c4069420 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f58d4009ac0 tx=0x7f58d4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.109+0000 7f58daa00640 1 -- 172.21.15.175:0/2904115421 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f58d0016090 con 0x7f58e40cd9c0 2024-04-25T09:05:36.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.265+0000 7f58e9c00640 1 -- 172.21.15.175:0/2904115421 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f58e4075160 con 0x7f58e40cd9c0 2024-04-25T09:05:36.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.269+0000 7f58daa00640 1 -- 172.21.15.175:0/2904115421 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f58d00f00a0 con 0x7f58e40cd9c0 2024-04-25T09:05:36.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.273+0000 7f58e9c00640 1 -- 172.21.15.175:0/2904115421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f58c4066f60 msgr2=0x7f58c4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.273+0000 7f58e9c00640 1 --2- 172.21.15.175:0/2904115421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f58c4066f60 0x7f58c4069420 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f58d4009ac0 tx=0x7f58d4009190 comp rx=0 tx=0).stop 2024-04-25T09:05:36.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.273+0000 7f58e9c00640 1 -- 172.21.15.175:0/2904115421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58e40cd9c0 msgr2=0x7f58e40ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.273+0000 7f58e9c00640 1 --2- 172.21.15.175:0/2904115421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58e40cd9c0 0x7f58e40ce500 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f58d00ab000 tx=0x7f58d0019180 comp rx=0 tx=0).stop 2024-04-25T09:05:36.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.273+0000 7f58e9c00640 1 -- 172.21.15.175:0/2904115421 shutdown_connections 2024-04-25T09:05:36.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.273+0000 7f58e9c00640 1 --2- 172.21.15.175:0/2904115421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f58c4066f60 0x7f58c4069420 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.273+0000 7f58e9c00640 1 --2- 172.21.15.175:0/2904115421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e415bd40 0x7f58e4147880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.273+0000 7f58e9c00640 1 --2- 172.21.15.175:0/2904115421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58e40cd9c0 0x7f58e40ce500 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.273+0000 7f58e9c00640 1 --2- 172.21.15.175:0/2904115421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58e406ac50 0x7f58e406ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.273+0000 7f58e9c00640 1 -- 172.21.15.175:0/2904115421 >> 172.21.15.175:0/2904115421 conn(0x7f58e4099a50 msgr2=0x7f58e40af590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:36.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.273+0000 7f58e9c00640 1 -- 172.21.15.175:0/2904115421 shutdown_connections 2024-04-25T09:05:36.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.273+0000 7f58e9c00640 1 -- 172.21.15.175:0/2904115421 wait complete. 2024-04-25T09:05:36.281 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-04-25T09:05:36.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.425+0000 7f77e6800640 1 Processor -- start 2024-04-25T09:05:36.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.425+0000 7f77e6800640 1 -- start start 2024-04-25T09:05:36.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.429+0000 7f77e6800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f77e015a900 0x7f77e006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.429+0000 7f77e6800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e00cda00 con 0x7f77e00cf560 2024-04-25T09:05:36.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.429+0000 7f77e6800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e00cdce0 con 0x7f77e00cd520 2024-04-25T09:05:36.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.429+0000 7f77e6800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e015bcf0 con 0x7f77e015a900 2024-04-25T09:05:36.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.429+0000 7f77dfe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f77e00cf560 0x7f77e015bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39450/0 (socket says 172.21.15.175:39450) 2024-04-25T09:05:36.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.429+0000 7f77dfe00640 1 -- 172.21.15.175:0/1233240296 learned_addr learned my addr 172.21.15.175:0/1233240296 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:36.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.429+0000 7f77df400640 1 --2- 172.21.15.175:0/1233240296 >> v2:172.21.15.177:3300/0 conn(0x7f77e015a900 0x7f77e006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.429+0000 7f77de000640 1 -- 172.21.15.175:0/1233240296 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809082343 0 0) 0x7f77e00cda00 con 0x7f77e00cf560 2024-04-25T09:05:36.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.429+0000 7f77de000640 1 -- 172.21.15.175:0/1233240296 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77c4003530 con 0x7f77e00cf560 2024-04-25T09:05:36.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.429+0000 7f77df400640 1 -- 172.21.15.175:0/1233240296 >> v1:172.21.15.177:6789/0 conn(0x7f77e00cd520 legacy=0x7f77e00ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.429+0000 7f77df400640 1 -- 172.21.15.175:0/1233240296 >> v1:172.21.15.175:6789/0 conn(0x7f77e00cf560 legacy=0x7f77e015bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.429+0000 7f77df400640 1 -- 172.21.15.175:0/1233240296 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e00cdfc0 con 0x7f77e015a900 2024-04-25T09:05:36.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.433+0000 7f77df400640 1 --2- 172.21.15.175:0/1233240296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77e015a900 0x7f77e006e150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009d90 tx=0x7f77d001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2c79d9f535ef32e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.433+0000 7f77de000640 1 -- 172.21.15.175:0/1233240296 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d00b2070 con 0x7f77e015a900 2024-04-25T09:05:36.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.433+0000 7f77de000640 1 -- 172.21.15.175:0/1233240296 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d00a5830 con 0x7f77e015a900 2024-04-25T09:05:36.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.433+0000 7f77de000640 1 -- 172.21.15.175:0/1233240296 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d00a5c00 con 0x7f77e015a900 2024-04-25T09:05:36.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.433+0000 7f77e6800640 1 -- 172.21.15.175:0/1233240296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77e015a900 msgr2=0x7f77e006e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.433+0000 7f77e6800640 1 --2- 172.21.15.175:0/1233240296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77e015a900 0x7f77e006e150 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009d90 tx=0x7f77d001c970 comp rx=0 tx=0).stop 2024-04-25T09:05:36.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.433+0000 7f77e6800640 1 -- 172.21.15.175:0/1233240296 shutdown_connections 2024-04-25T09:05:36.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.433+0000 7f77e6800640 1 --2- 172.21.15.175:0/1233240296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77e015a900 0x7f77e006e150 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.433+0000 7f77e6800640 1 -- 172.21.15.175:0/1233240296 >> 172.21.15.175:0/1233240296 conn(0x7f77e0067150 msgr2=0x7f77e006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:36.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.433+0000 7f77e6800640 1 -- 172.21.15.175:0/1233240296 shutdown_connections 2024-04-25T09:05:36.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.433+0000 7f77e6800640 1 -- 172.21.15.175:0/1233240296 wait complete. 2024-04-25T09:05:36.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.433+0000 7f77e6800640 1 Processor -- start 2024-04-25T09:05:36.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.433+0000 7f77e6800640 1 -- start start 2024-04-25T09:05:36.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77e6800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77e00cf560 0x7f77e014ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77e6800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77e015a900 0x7f77e00ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77e6800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77e014b110 0x7f77e014d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77e6800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e006d530 con 0x7f77e014b110 2024-04-25T09:05:36.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77e6800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e006d3b0 con 0x7f77e00cf560 2024-04-25T09:05:36.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77e6800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e0168c20 con 0x7f77e015a900 2024-04-25T09:05:36.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77dfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77e014b110 0x7f77e014d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77dfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77e014b110 0x7f77e014d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43656/0 (socket says 172.21.15.175:43656) 2024-04-25T09:05:36.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77dfe00640 1 -- 172.21.15.175:0/1437410054 learned_addr learned my addr 172.21.15.175:0/1437410054 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:36.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77dea00640 1 --2- 172.21.15.175:0/1437410054 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77e015a900 0x7f77e00ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77df400640 1 --2- 172.21.15.175:0/1437410054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77e00cf560 0x7f77e014ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77dfe00640 1 -- 172.21.15.175:0/1437410054 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77e015a900 msgr2=0x7f77e00ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77dfe00640 1 --2- 172.21.15.175:0/1437410054 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77e015a900 0x7f77e00ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77dfe00640 1 -- 172.21.15.175:0/1437410054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77e00cf560 msgr2=0x7f77e014ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77dfe00640 1 --2- 172.21.15.175:0/1437410054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77e00cf560 0x7f77e014ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77dfe00640 1 -- 172.21.15.175:0/1437410054 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e00b2370 con 0x7f77e014b110 2024-04-25T09:05:36.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77dfe00640 1 --2- 172.21.15.175:0/1437410054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77e014b110 0x7f77e014d910 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f77d800c450 tx=0x7f77d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77d7400640 1 -- 172.21.15.175:0/1437410054 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d8017070 con 0x7f77e014b110 2024-04-25T09:05:36.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77d7400640 1 -- 172.21.15.175:0/1437410054 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d8005cf0 con 0x7f77e014b110 2024-04-25T09:05:36.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77d7400640 1 -- 172.21.15.175:0/1437410054 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d80072b0 con 0x7f77e014b110 2024-04-25T09:05:36.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77e6800640 1 -- 172.21.15.175:0/1437410054 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e014c5c0 con 0x7f77e014b110 2024-04-25T09:05:36.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77e6800640 1 -- 172.21.15.175:0/1437410054 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e014cb80 con 0x7f77e014b110 2024-04-25T09:05:36.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77e6800640 1 -- 172.21.15.175:0/1437410054 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e0074a60 con 0x7f77e014b110 2024-04-25T09:05:36.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.437+0000 7f77d7400640 1 -- 172.21.15.175:0/1437410054 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f77d801a070 con 0x7f77e014b110 2024-04-25T09:05:36.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.441+0000 7f77d7400640 1 --2- 172.21.15.175:0/1437410054 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f77c0066f90 0x7f77c0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:36.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.441+0000 7f77d7400640 1 -- 172.21.15.175:0/1437410054 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f77d8083ed0 con 0x7f77e014b110 2024-04-25T09:05:36.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.441+0000 7f77df400640 1 --2- 172.21.15.175:0/1437410054 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f77c0066f90 0x7f77c0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:36.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.441+0000 7f77df400640 1 --2- 172.21.15.175:0/1437410054 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f77c0066f90 0x7f77c0069450 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f77d00af000 tx=0x7f77d00a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:36.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.445+0000 7f77d7400640 1 -- 172.21.15.175:0/1437410054 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f77d8054b90 con 0x7f77e014b110 2024-04-25T09:05:36.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.649+0000 7f77e6800640 1 -- 172.21.15.175:0/1437410054 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f77e0071ea0 con 0x7f77e014b110 2024-04-25T09:05:36.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.913+0000 7f77d7400640 1 -- 172.21.15.175:0/1437410054 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v106) v1 ==== 142+0+0 (secure 0 0 0) 0x7f77d8058c30 con 0x7f77e014b110 2024-04-25T09:05:36.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.913+0000 7f77e6800640 1 -- 172.21.15.175:0/1437410054 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f77c0066f90 msgr2=0x7f77c0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.913+0000 7f77e6800640 1 --2- 172.21.15.175:0/1437410054 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f77c0066f90 0x7f77c0069450 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f77d00af000 tx=0x7f77d00a7070 comp rx=0 tx=0).stop 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.913+0000 7f77e6800640 1 -- 172.21.15.175:0/1437410054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77e014b110 msgr2=0x7f77e014d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.913+0000 7f77e6800640 1 --2- 172.21.15.175:0/1437410054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77e014b110 0x7f77e014d910 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f77d800c450 tx=0x7f77d800c910 comp rx=0 tx=0).stop 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.913+0000 7f77e6800640 1 -- 172.21.15.175:0/1437410054 shutdown_connections 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.913+0000 7f77e6800640 1 --2- 172.21.15.175:0/1437410054 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f77c0066f90 0x7f77c0069450 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.913+0000 7f77e6800640 1 --2- 172.21.15.175:0/1437410054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77e014b110 0x7f77e014d910 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.913+0000 7f77e6800640 1 --2- 172.21.15.175:0/1437410054 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77e015a900 0x7f77e00ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.913+0000 7f77e6800640 1 --2- 172.21.15.175:0/1437410054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77e00cf560 0x7f77e014ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.913+0000 7f77e6800640 1 -- 172.21.15.175:0/1437410054 >> 172.21.15.175:0/1437410054 conn(0x7f77e00cd520 msgr2=0x7f77e006ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.913+0000 7f77e6800640 1 -- 172.21.15.175:0/1437410054 shutdown_connections 2024-04-25T09:05:36.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:36.913+0000 7f77e6800640 1 -- 172.21.15.175:0/1437410054 wait complete. 2024-04-25T09:05:36.924 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-25T09:05:36.925 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2024-04-25T09:05:36.925 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:05:36.925 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:37.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.069+0000 7fe4fa800640 1 Processor -- start 2024-04-25T09:05:37.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.069+0000 7fe4fa800640 1 -- start start 2024-04-25T09:05:37.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.069+0000 7fe4fa800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe4f41452f0 0x7fe4f4071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.069+0000 7fe4fa800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe4f406dd30 0x7fe4f40ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.069+0000 7fe4fa800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f406e270 con 0x7fe4f4071780 2024-04-25T09:05:37.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.073+0000 7fe4fa800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f40cc2c0 con 0x7fe4f406dd30 2024-04-25T09:05:37.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.073+0000 7fe4fa800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f406e550 con 0x7fe4f41452f0 2024-04-25T09:05:37.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.073+0000 7fe4f3e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe4f406dd30 0x7fe4f40ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.073+0000 7fe4f3e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe4f406dd30 0x7fe4f40ce6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43672/0 (socket says 172.21.15.175:43672) 2024-04-25T09:05:37.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.073+0000 7fe4f3e00640 1 -- 172.21.15.175:0/3462869111 learned_addr learned my addr 172.21.15.175:0/3462869111 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:37.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.073+0000 7fe4f3400640 1 --2- 172.21.15.175:0/3462869111 >> v2:172.21.15.177:3300/0 conn(0x7fe4f41452f0 0x7fe4f4071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.073+0000 7fe4f3e00640 1 -- 172.21.15.175:0/3462869111 >> v2:172.21.15.177:3300/0 conn(0x7fe4f41452f0 msgr2=0x7fe4f4071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:37.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.073+0000 7fe4f3e00640 1 --2- 172.21.15.175:0/3462869111 >> v2:172.21.15.177:3300/0 conn(0x7fe4f41452f0 0x7fe4f4071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.073+0000 7fe4f3e00640 1 -- 172.21.15.175:0/3462869111 >> v1:172.21.15.177:6789/0 conn(0x7fe4f4071780 legacy=0x7fe4f406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:37.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.073+0000 7fe4f3e00640 1 -- 172.21.15.175:0/3462869111 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f406e830 con 0x7fe4f406dd30 2024-04-25T09:05:37.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.073+0000 7fe4f3400640 1 --2- 172.21.15.175:0/3462869111 >> v2:172.21.15.177:3300/0 conn(0x7fe4f41452f0 0x7fe4f4071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:37.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.073+0000 7fe4f3e00640 1 --2- 172.21.15.175:0/3462869111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4f406dd30 0x7fe4f40ce6d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40d0670 tx=0x7fe4ec01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35763878f33e0d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:37.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.073+0000 7fe4f2000640 1 -- 172.21.15.175:0/3462869111 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec0b0070 con 0x7fe4f406dd30 2024-04-25T09:05:37.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.073+0000 7fe4f2000640 1 -- 172.21.15.175:0/3462869111 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec0ab600 con 0x7fe4f406dd30 2024-04-25T09:05:37.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.073+0000 7fe4f2000640 1 -- 172.21.15.175:0/3462869111 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec0ab9d0 con 0x7fe4f406dd30 2024-04-25T09:05:37.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4fa800640 1 -- 172.21.15.175:0/3462869111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4f406dd30 msgr2=0x7fe4f40ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4fa800640 1 --2- 172.21.15.175:0/3462869111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4f406dd30 0x7fe4f40ce6d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe4f40d0670 tx=0x7fe4ec01c4c0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4fa800640 1 -- 172.21.15.175:0/3462869111 shutdown_connections 2024-04-25T09:05:37.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4fa800640 1 --2- 172.21.15.175:0/3462869111 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4f406dd30 0x7fe4f40ce6d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4fa800640 1 --2- 172.21.15.175:0/3462869111 >> v2:172.21.15.177:3300/0 conn(0x7fe4f41452f0 0x7fe4f4071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4fa800640 1 -- 172.21.15.175:0/3462869111 >> 172.21.15.175:0/3462869111 conn(0x7fe4f4067150 msgr2=0x7fe4f406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:37.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4fa800640 1 -- 172.21.15.175:0/3462869111 shutdown_connections 2024-04-25T09:05:37.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4fa800640 1 -- 172.21.15.175:0/3462869111 wait complete. 2024-04-25T09:05:37.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4fa800640 1 Processor -- start 2024-04-25T09:05:37.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4fa800640 1 -- start start 2024-04-25T09:05:37.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4fa800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4f4071780 0x7fe4f413a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4fa800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4f41452f0 0x7fe4f415ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4fa800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4f413c110 0x7fe4f413def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4fa800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f40cf830 con 0x7fe4f4071780 2024-04-25T09:05:37.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4fa800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f40cf6b0 con 0x7fe4f413c110 2024-04-25T09:05:37.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4fa800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f40cf9b0 con 0x7fe4f41452f0 2024-04-25T09:05:37.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4f3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4f4071780 0x7fe4f413a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4f3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4f4071780 0x7fe4f413a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43676/0 (socket says 172.21.15.175:43676) 2024-04-25T09:05:37.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4f3400640 1 -- 172.21.15.175:0/4946629 learned_addr learned my addr 172.21.15.175:0/4946629 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:37.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4f3e00640 1 --2- 172.21.15.175:0/4946629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4f413c110 0x7fe4f413def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4f2a00640 1 --2- 172.21.15.175:0/4946629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4f41452f0 0x7fe4f415ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4f3400640 1 -- 172.21.15.175:0/4946629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4f41452f0 msgr2=0x7fe4f415ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4f3400640 1 --2- 172.21.15.175:0/4946629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4f41452f0 0x7fe4f415ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4f3400640 1 -- 172.21.15.175:0/4946629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4f413c110 msgr2=0x7fe4f413def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4f3400640 1 --2- 172.21.15.175:0/4946629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4f413c110 0x7fe4f413def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4f3400640 1 -- 172.21.15.175:0/4946629 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f413b070 con 0x7fe4f4071780 2024-04-25T09:05:37.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.077+0000 7fe4f2a00640 1 --2- 172.21.15.175:0/4946629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4f41452f0 0x7fe4f415ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:37.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.081+0000 7fe4f3400640 1 --2- 172.21.15.175:0/4946629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4f4071780 0x7fe4f413a970 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400cf60 tx=0x7fe4e400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:37.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.081+0000 7fe4eb400640 1 -- 172.21.15.175:0/4946629 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e401a070 con 0x7fe4f4071780 2024-04-25T09:05:37.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.081+0000 7fe4eb400640 1 -- 172.21.15.175:0/4946629 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e400d840 con 0x7fe4f4071780 2024-04-25T09:05:37.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.081+0000 7fe4eb400640 1 -- 172.21.15.175:0/4946629 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e400dc10 con 0x7fe4f4071780 2024-04-25T09:05:37.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.081+0000 7fe4fa800640 1 -- 172.21.15.175:0/4946629 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f413b350 con 0x7fe4f4071780 2024-04-25T09:05:37.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.081+0000 7fe4fa800640 1 -- 172.21.15.175:0/4946629 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f413b910 con 0x7fe4f4071780 2024-04-25T09:05:37.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.081+0000 7fe4fa800640 1 -- 172.21.15.175:0/4946629 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f4074a60 con 0x7fe4f4071780 2024-04-25T09:05:37.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.081+0000 7fe4eb400640 1 -- 172.21.15.175:0/4946629 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe4e401d070 con 0x7fe4f4071780 2024-04-25T09:05:37.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.081+0000 7fe4eb400640 1 --2- 172.21.15.175:0/4946629 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe4d4066f90 0x7fe4d4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.081+0000 7fe4eb400640 1 -- 172.21.15.175:0/4946629 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe4e4085470 con 0x7fe4f4071780 2024-04-25T09:05:37.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.081+0000 7fe4f2a00640 1 --2- 172.21.15.175:0/4946629 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe4d4066f90 0x7fe4d4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.081+0000 7fe4f2a00640 1 --2- 172.21.15.175:0/4946629 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe4d4066f90 0x7fe4d4069450 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4166680 tx=0x7fe4e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:37.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.085+0000 7fe4eb400640 1 -- 172.21.15.175:0/4946629 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe4e4056090 con 0x7fe4f4071780 2024-04-25T09:05:37.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.241+0000 7fe4fa800640 1 -- 172.21.15.175:0/4946629 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4f41600e0 con 0x7fe4f4071780 2024-04-25T09:05:37.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.241+0000 7fe4eb400640 1 -- 172.21.15.175:0/4946629 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13058 (secure 0 0 0) 0x7fe4e405a130 con 0x7fe4f4071780 2024-04-25T09:05:37.231 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:37.231 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":35,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:05:35.907226+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6837/1909482114":"2024-04-26T09:05:32.812274+0000","172.21.15.175:6835/1909482114":"2024-04-26T09:05:32.812274+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:37.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.245+0000 7fe4fa800640 1 -- 172.21.15.175:0/4946629 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe4d4066f90 msgr2=0x7fe4d4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.245+0000 7fe4fa800640 1 --2- 172.21.15.175:0/4946629 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe4d4066f90 0x7fe4d4069450 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4166680 tx=0x7fe4e0008040 comp rx=0 tx=0).stop 2024-04-25T09:05:37.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.245+0000 7fe4fa800640 1 -- 172.21.15.175:0/4946629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4f4071780 msgr2=0x7fe4f413a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.245+0000 7fe4fa800640 1 --2- 172.21.15.175:0/4946629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4f4071780 0x7fe4f413a970 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe4e400cf60 tx=0x7fe4e400cf90 comp rx=0 tx=0).stop 2024-04-25T09:05:37.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.245+0000 7fe4fa800640 1 -- 172.21.15.175:0/4946629 shutdown_connections 2024-04-25T09:05:37.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.245+0000 7fe4fa800640 1 --2- 172.21.15.175:0/4946629 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe4d4066f90 0x7fe4d4069450 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.245+0000 7fe4fa800640 1 --2- 172.21.15.175:0/4946629 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4f413c110 0x7fe4f413def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.245+0000 7fe4fa800640 1 --2- 172.21.15.175:0/4946629 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe4f41452f0 0x7fe4f415ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.245+0000 7fe4fa800640 1 --2- 172.21.15.175:0/4946629 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4f4071780 0x7fe4f413a970 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.245+0000 7fe4fa800640 1 -- 172.21.15.175:0/4946629 >> 172.21.15.175:0/4946629 conn(0x7fe4f406dd30 msgr2=0x7fe4f406ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:37.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.245+0000 7fe4fa800640 1 -- 172.21.15.175:0/4946629 shutdown_connections 2024-04-25T09:05:37.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.245+0000 7fe4fa800640 1 -- 172.21.15.175:0/4946629 wait complete. 2024-04-25T09:05:37.253 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:05:37.253 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:05:37.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.401+0000 7f8d80c00640 1 Processor -- start 2024-04-25T09:05:37.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.401+0000 7f8d80c00640 1 -- start start 2024-04-25T09:05:37.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.401+0000 7f8d80c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8d7c15ddf0 0x7f8d7c099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.401+0000 7f8d80c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8d7c06cd70 0x7f8d7c099f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.401+0000 7f8d80c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7c0d0b40 con 0x7f8d7c0d0630 2024-04-25T09:05:37.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.401+0000 7f8d80c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7c06d1e0 con 0x7f8d7c15ddf0 2024-04-25T09:05:37.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.401+0000 7f8d80c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7c0cbf60 con 0x7f8d7c06cd70 2024-04-25T09:05:37.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.405+0000 7f8d79e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8d7c15ddf0 0x7f8d7c099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.405+0000 7f8d71400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f8d7c0d0630 0x7f8d7c0cc3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39454/0 (socket says 172.21.15.175:39454) 2024-04-25T09:05:37.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.405+0000 7f8d71400640 1 -- 172.21.15.175:0/3130308902 learned_addr learned my addr 172.21.15.175:0/3130308902 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:37.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.405+0000 7f8d7a800640 1 --2- 172.21.15.175:0/3130308902 >> v2:172.21.15.177:3300/0 conn(0x7f8d7c06cd70 0x7f8d7c099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.405+0000 7f8d79e00640 1 -- 172.21.15.175:0/3130308902 >> v2:172.21.15.177:3300/0 conn(0x7f8d7c06cd70 msgr2=0x7f8d7c099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:37.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.405+0000 7f8d79e00640 1 --2- 172.21.15.175:0/3130308902 >> v2:172.21.15.177:3300/0 conn(0x7f8d7c06cd70 0x7f8d7c099f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.405+0000 7f8d79e00640 1 -- 172.21.15.175:0/3130308902 >> v1:172.21.15.175:6789/0 conn(0x7f8d7c0d0630 legacy=0x7f8d7c0cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.405+0000 7f8d79e00640 1 -- 172.21.15.175:0/3130308902 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c0d0e20 con 0x7f8d7c15ddf0 2024-04-25T09:05:37.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.405+0000 7f8d7a800640 1 --2- 172.21.15.175:0/3130308902 >> v2:172.21.15.177:3300/0 conn(0x7f8d7c06cd70 0x7f8d7c099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:37.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.405+0000 7f8d79400640 1 -- 172.21.15.175:0/3130308902 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341625657 0 0) 0x7f8d7c0d0b40 con 0x7f8d7c0d0630 2024-04-25T09:05:37.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.405+0000 7f8d79e00640 1 --2- 172.21.15.175:0/3130308902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d7c15ddf0 0x7f8d7c099a50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c072dd0 tx=0x7f8d6c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199872da68d75e91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:37.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.405+0000 7f8d79400640 1 -- 172.21.15.175:0/3130308902 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c0b0070 con 0x7f8d7c15ddf0 2024-04-25T09:05:37.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.405+0000 7f8d79400640 1 -- 172.21.15.175:0/3130308902 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c0ab600 con 0x7f8d7c15ddf0 2024-04-25T09:05:37.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.405+0000 7f8d79400640 1 -- 172.21.15.175:0/3130308902 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c0ab9d0 con 0x7f8d7c15ddf0 2024-04-25T09:05:37.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d80c00640 1 -- 172.21.15.175:0/3130308902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d7c15ddf0 msgr2=0x7f8d7c099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d80c00640 1 --2- 172.21.15.175:0/3130308902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d7c15ddf0 0x7f8d7c099a50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c072dd0 tx=0x7f8d6c01c480 comp rx=0 tx=0).stop 2024-04-25T09:05:37.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d80c00640 1 -- 172.21.15.175:0/3130308902 shutdown_connections 2024-04-25T09:05:37.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d80c00640 1 --2- 172.21.15.175:0/3130308902 >> v2:172.21.15.177:3300/0 conn(0x7f8d7c06cd70 0x7f8d7c099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d80c00640 1 --2- 172.21.15.175:0/3130308902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d7c15ddf0 0x7f8d7c099a50 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d80c00640 1 -- 172.21.15.175:0/3130308902 >> 172.21.15.175:0/3130308902 conn(0x7f8d7c0b3400 msgr2=0x7f8d7c0b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:37.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d80c00640 1 -- 172.21.15.175:0/3130308902 shutdown_connections 2024-04-25T09:05:37.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d80c00640 1 -- 172.21.15.175:0/3130308902 wait complete. 2024-04-25T09:05:37.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d80c00640 1 Processor -- start 2024-04-25T09:05:37.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d80c00640 1 -- start start 2024-04-25T09:05:37.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d80c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d7c06cd70 0x7f8d7c1559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d80c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c0d0630 0x7f8d7c0c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d80c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d7c15ddf0 0x7f8d7c0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d80c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0cd490 con 0x7f8d7c06cd70 2024-04-25T09:05:37.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d80c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0cd310 con 0x7f8d7c15ddf0 2024-04-25T09:05:37.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d80c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0cd610 con 0x7f8d7c0d0630 2024-04-25T09:05:37.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d79e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d7c06cd70 0x7f8d7c1559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d79e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d7c06cd70 0x7f8d7c1559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43702/0 (socket says 172.21.15.175:43702) 2024-04-25T09:05:37.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d79e00640 1 -- 172.21.15.175:0/2935522192 learned_addr learned my addr 172.21.15.175:0/2935522192 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:37.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d7a800640 1 --2- 172.21.15.175:0/2935522192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d7c15ddf0 0x7f8d7c0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d71400640 1 --2- 172.21.15.175:0/2935522192 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c0d0630 0x7f8d7c0c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d79e00640 1 -- 172.21.15.175:0/2935522192 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c0d0630 msgr2=0x7f8d7c0c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d79e00640 1 --2- 172.21.15.175:0/2935522192 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c0d0630 0x7f8d7c0c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d79e00640 1 -- 172.21.15.175:0/2935522192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d7c15ddf0 msgr2=0x7f8d7c0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d79e00640 1 --2- 172.21.15.175:0/2935522192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d7c15ddf0 0x7f8d7c0b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d79e00640 1 -- 172.21.15.175:0/2935522192 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c0c8f20 con 0x7f8d7c06cd70 2024-04-25T09:05:37.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.409+0000 7f8d79e00640 1 --2- 172.21.15.175:0/2935522192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d7c06cd70 0x7f8d7c1559c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c01a0b0 tx=0x7f8d6c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:37.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.413+0000 7f8d72a00640 1 -- 172.21.15.175:0/2935522192 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c0bd070 con 0x7f8d7c06cd70 2024-04-25T09:05:37.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.413+0000 7f8d72a00640 1 -- 172.21.15.175:0/2935522192 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c004030 con 0x7f8d7c06cd70 2024-04-25T09:05:37.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.413+0000 7f8d80c00640 1 -- 172.21.15.175:0/2935522192 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7c155fa0 con 0x7f8d7c06cd70 2024-04-25T09:05:37.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.413+0000 7f8d72a00640 1 -- 172.21.15.175:0/2935522192 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c0b0040 con 0x7f8d7c06cd70 2024-04-25T09:05:37.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.413+0000 7f8d80c00640 1 -- 172.21.15.175:0/2935522192 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7c156560 con 0x7f8d7c06cd70 2024-04-25T09:05:37.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.413+0000 7f8d80c00640 1 -- 172.21.15.175:0/2935522192 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7c09af30 con 0x7f8d7c06cd70 2024-04-25T09:05:37.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.413+0000 7f8d72a00640 1 -- 172.21.15.175:0/2935522192 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8d6c0c0070 con 0x7f8d7c06cd70 2024-04-25T09:05:37.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.413+0000 7f8d72a00640 1 --2- 172.21.15.175:0/2935522192 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8d58066f60 0x7f8d58069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.413+0000 7f8d72a00640 1 -- 172.21.15.175:0/2935522192 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8d6c11e830 con 0x7f8d7c06cd70 2024-04-25T09:05:37.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.413+0000 7f8d71400640 1 --2- 172.21.15.175:0/2935522192 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8d58066f60 0x7f8d58069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.413+0000 7f8d71400640 1 --2- 172.21.15.175:0/2935522192 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8d58066f60 0x7f8d58069420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c0cbcc0 tx=0x7f8d64007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:37.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.417+0000 7f8d72a00640 1 -- 172.21.15.175:0/2935522192 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8d6c016070 con 0x7f8d7c06cd70 2024-04-25T09:05:37.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.573+0000 7f8d80c00640 1 -- 172.21.15.175:0/2935522192 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8d7c0b1340 con 0x7f8d7c06cd70 2024-04-25T09:05:37.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.573+0000 7f8d72a00640 1 -- 172.21.15.175:0/2935522192 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d6c0efaa0 con 0x7f8d7c06cd70 2024-04-25T09:05:37.563 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:05:37.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.573+0000 7f8d80c00640 1 -- 172.21.15.175:0/2935522192 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8d58066f60 msgr2=0x7f8d58069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.573+0000 7f8d80c00640 1 --2- 172.21.15.175:0/2935522192 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8d58066f60 0x7f8d58069420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c0cbcc0 tx=0x7f8d64007c10 comp rx=0 tx=0).stop 2024-04-25T09:05:37.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.573+0000 7f8d80c00640 1 -- 172.21.15.175:0/2935522192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d7c06cd70 msgr2=0x7f8d7c1559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.573+0000 7f8d80c00640 1 --2- 172.21.15.175:0/2935522192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d7c06cd70 0x7f8d7c1559c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c01a0b0 tx=0x7f8d6c01acc0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.573+0000 7f8d80c00640 1 -- 172.21.15.175:0/2935522192 shutdown_connections 2024-04-25T09:05:37.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.573+0000 7f8d80c00640 1 --2- 172.21.15.175:0/2935522192 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8d58066f60 0x7f8d58069420 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.573+0000 7f8d80c00640 1 --2- 172.21.15.175:0/2935522192 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d7c15ddf0 0x7f8d7c0b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.573+0000 7f8d80c00640 1 --2- 172.21.15.175:0/2935522192 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c0d0630 0x7f8d7c0c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.573+0000 7f8d80c00640 1 --2- 172.21.15.175:0/2935522192 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d7c06cd70 0x7f8d7c1559c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.573+0000 7f8d80c00640 1 -- 172.21.15.175:0/2935522192 >> 172.21.15.175:0/2935522192 conn(0x7f8d7c0b3400 msgr2=0x7f8d7c0b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:37.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.573+0000 7f8d80c00640 1 -- 172.21.15.175:0/2935522192 shutdown_connections 2024-04-25T09:05:37.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.573+0000 7f8d80c00640 1 -- 172.21.15.175:0/2935522192 wait complete. 2024-04-25T09:05:37.584 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-04-25T09:05:37.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.729+0000 7fe82fc00640 1 Processor -- start 2024-04-25T09:05:37.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.729+0000 7fe82fc00640 1 -- start start 2024-04-25T09:05:37.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.729+0000 7fe82fc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe82815dbd0 0x7fe828071c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.729+0000 7fe82fc00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82815dfb0 con 0x7fe8280aeac0 2024-04-25T09:05:37.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.729+0000 7fe82fc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8280b2980 con 0x7fe8280ae680 2024-04-25T09:05:37.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.729+0000 7fe82fc00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8280cf670 con 0x7fe82815dbd0 2024-04-25T09:05:37.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.729+0000 7fe82dc00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe8280aeac0 0x7fe8280ad490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39464/0 (socket says 172.21.15.175:39464) 2024-04-25T09:05:37.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.729+0000 7fe82dc00640 1 -- 172.21.15.175:0/1013240560 learned_addr learned my addr 172.21.15.175:0/1013240560 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:37.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.729+0000 7fe82d200640 1 --2- 172.21.15.175:0/1013240560 >> v2:172.21.15.175:3300/0 conn(0x7fe82815dbd0 0x7fe828071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.729+0000 7fe827e00640 1 -- 172.21.15.175:0/1013240560 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963127995 0 0) 0x7fe82815dfb0 con 0x7fe8280aeac0 2024-04-25T09:05:37.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.729+0000 7fe827e00640 1 -- 172.21.15.175:0/1013240560 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe80c003530 con 0x7fe8280aeac0 2024-04-25T09:05:37.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.729+0000 7fe82d200640 1 -- 172.21.15.175:0/1013240560 >> v1:172.21.15.177:6789/0 conn(0x7fe8280ae680 legacy=0x7fe8280acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.729+0000 7fe82d200640 1 -- 172.21.15.175:0/1013240560 >> v1:172.21.15.175:6789/0 conn(0x7fe8280aeac0 legacy=0x7fe8280ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.729+0000 7fe82d200640 1 -- 172.21.15.175:0/1013240560 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8280b2c60 con 0x7fe82815dbd0 2024-04-25T09:05:37.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.733+0000 7fe82d200640 1 --2- 172.21.15.175:0/1013240560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe82815dbd0 0x7fe828071c50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe8180097c0 tx=0x7fe81801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9038a16cad7266 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:37.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.733+0000 7fe827e00640 1 -- 172.21.15.175:0/1013240560 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180b1070 con 0x7fe82815dbd0 2024-04-25T09:05:37.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.733+0000 7fe827e00640 1 -- 172.21.15.175:0/1013240560 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8180ac5f0 con 0x7fe82815dbd0 2024-04-25T09:05:37.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.733+0000 7fe827e00640 1 -- 172.21.15.175:0/1013240560 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180ac9c0 con 0x7fe82815dbd0 2024-04-25T09:05:37.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.733+0000 7fe82fc00640 1 -- 172.21.15.175:0/1013240560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe82815dbd0 msgr2=0x7fe828071c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.733+0000 7fe82fc00640 1 --2- 172.21.15.175:0/1013240560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe82815dbd0 0x7fe828071c50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe8180097c0 tx=0x7fe81801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.733+0000 7fe82fc00640 1 -- 172.21.15.175:0/1013240560 shutdown_connections 2024-04-25T09:05:37.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.733+0000 7fe82fc00640 1 --2- 172.21.15.175:0/1013240560 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe82815dbd0 0x7fe828071c50 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.733+0000 7fe82fc00640 1 -- 172.21.15.175:0/1013240560 >> 172.21.15.175:0/1013240560 conn(0x7fe828067150 msgr2=0x7fe82806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:37.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.733+0000 7fe82fc00640 1 -- 172.21.15.175:0/1013240560 shutdown_connections 2024-04-25T09:05:37.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.733+0000 7fe82fc00640 1 -- 172.21.15.175:0/1013240560 wait complete. 2024-04-25T09:05:37.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82fc00640 1 Processor -- start 2024-04-25T09:05:37.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82fc00640 1 -- start start 2024-04-25T09:05:37.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82fc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8280aeac0 0x7fe82813e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82fc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe82815dbd0 0x7fe828152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82fc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8280ccda0 0x7fe828153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82fc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8280b2580 con 0x7fe8280aeac0 2024-04-25T09:05:37.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82fc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8280aeed0 con 0x7fe8280ccda0 2024-04-25T09:05:37.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82fc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8280b2700 con 0x7fe82815dbd0 2024-04-25T09:05:37.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82d200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8280aeac0 0x7fe82813e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82d200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8280aeac0 0x7fe82813e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43724/0 (socket says 172.21.15.175:43724) 2024-04-25T09:05:37.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82d200640 1 -- 172.21.15.175:0/2622939517 learned_addr learned my addr 172.21.15.175:0/2622939517 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:37.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82dc00640 1 --2- 172.21.15.175:0/2622939517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8280ccda0 0x7fe828153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe81fe00640 1 --2- 172.21.15.175:0/2622939517 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe82815dbd0 0x7fe828152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82d200640 1 -- 172.21.15.175:0/2622939517 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe82815dbd0 msgr2=0x7fe828152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82d200640 1 --2- 172.21.15.175:0/2622939517 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe82815dbd0 0x7fe828152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82d200640 1 -- 172.21.15.175:0/2622939517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8280ccda0 msgr2=0x7fe828153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:37.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82d200640 1 --2- 172.21.15.175:0/2622939517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8280ccda0 0x7fe828153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:37.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82d200640 1 -- 172.21.15.175:0/2622939517 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8280adfb0 con 0x7fe8280aeac0 2024-04-25T09:05:37.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82dc00640 1 --2- 172.21.15.175:0/2622939517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8280ccda0 0x7fe828153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:37.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe81fe00640 1 --2- 172.21.15.175:0/2622939517 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe82815dbd0 0x7fe828152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:37.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82d200640 1 --2- 172.21.15.175:0/2622939517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8280aeac0 0x7fe82813e280 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe8180af040 tx=0x7fe81801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:37.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe825600640 1 -- 172.21.15.175:0/2622939517 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180b1050 con 0x7fe8280aeac0 2024-04-25T09:05:37.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe825600640 1 -- 172.21.15.175:0/2622939517 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8180bd070 con 0x7fe8280aeac0 2024-04-25T09:05:37.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe825600640 1 -- 172.21.15.175:0/2622939517 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180b6870 con 0x7fe8280aeac0 2024-04-25T09:05:37.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82fc00640 1 -- 172.21.15.175:0/2622939517 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe828160d30 con 0x7fe8280aeac0 2024-04-25T09:05:37.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.737+0000 7fe82fc00640 1 -- 172.21.15.175:0/2622939517 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8280cbfe0 con 0x7fe8280aeac0 2024-04-25T09:05:37.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.741+0000 7fe82fc00640 1 -- 172.21.15.175:0/2622939517 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe828074a60 con 0x7fe8280aeac0 2024-04-25T09:05:37.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.741+0000 7fe825600640 1 -- 172.21.15.175:0/2622939517 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe8180b6a10 con 0x7fe8280aeac0 2024-04-25T09:05:37.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.741+0000 7fe825600640 1 --2- 172.21.15.175:0/2622939517 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe804066f60 0x7fe804069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:37.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.741+0000 7fe825600640 1 -- 172.21.15.175:0/2622939517 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe81811f4b0 con 0x7fe8280aeac0 2024-04-25T09:05:37.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.741+0000 7fe81fe00640 1 --2- 172.21.15.175:0/2622939517 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe804066f60 0x7fe804069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:37.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.741+0000 7fe81fe00640 1 --2- 172.21.15.175:0/2622939517 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe804066f60 0x7fe804069420 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe82806e5d0 tx=0x7fe810009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:37.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.745+0000 7fe825600640 1 -- 172.21.15.175:0/2622939517 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe8180a9070 con 0x7fe8280aeac0 2024-04-25T09:05:37.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:37.957+0000 7fe82fc00640 1 -- 172.21.15.175:0/2622939517 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7fe828160a50 con 0x7fe8280aeac0 2024-04-25T09:05:38.452 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:05:38.456 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:05:38.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:38.921+0000 7fe825600640 1 -- 172.21.15.175:0/2622939517 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v108) v1 ==== 152+0+0 (secure 0 0 0) 0x7fe818016090 con 0x7fe8280aeac0 2024-04-25T09:05:38.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:38.921+0000 7fe82fc00640 1 -- 172.21.15.175:0/2622939517 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe804066f60 msgr2=0x7fe804069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:38.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:38.921+0000 7fe82fc00640 1 --2- 172.21.15.175:0/2622939517 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe804066f60 0x7fe804069420 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe82806e5d0 tx=0x7fe810009040 comp rx=0 tx=0).stop 2024-04-25T09:05:38.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:38.921+0000 7fe82fc00640 1 -- 172.21.15.175:0/2622939517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8280aeac0 msgr2=0x7fe82813e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:38.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:38.921+0000 7fe82fc00640 1 --2- 172.21.15.175:0/2622939517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8280aeac0 0x7fe82813e280 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe8180af040 tx=0x7fe81801ace0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:38.921+0000 7fe82fc00640 1 -- 172.21.15.175:0/2622939517 shutdown_connections 2024-04-25T09:05:38.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:38.921+0000 7fe82fc00640 1 --2- 172.21.15.175:0/2622939517 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe804066f60 0x7fe804069420 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:38.921+0000 7fe82fc00640 1 --2- 172.21.15.175:0/2622939517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8280ccda0 0x7fe828153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:38.921+0000 7fe82fc00640 1 --2- 172.21.15.175:0/2622939517 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe82815dbd0 0x7fe828152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:38.921+0000 7fe82fc00640 1 --2- 172.21.15.175:0/2622939517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe8280aeac0 0x7fe82813e280 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:38.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:38.921+0000 7fe82fc00640 1 -- 172.21.15.175:0/2622939517 >> 172.21.15.175:0/2622939517 conn(0x7fe8280ae680 msgr2=0x7fe82806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:38.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:38.921+0000 7fe82fc00640 1 -- 172.21.15.175:0/2622939517 shutdown_connections 2024-04-25T09:05:38.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:38.921+0000 7fe82fc00640 1 -- 172.21.15.175:0/2622939517 wait complete. 2024-04-25T09:05:38.936 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:05:39.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c3a000640 1 Processor -- start 2024-04-25T09:05:39.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c3a000640 1 -- start start 2024-04-25T09:05:39.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c3a000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3c34145250 0x7f3c340cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c3a000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c341600a0 0x7f3c340cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c3a000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3c340ce970 0x7f3c340cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c3a000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3415f650 con 0x7f3c340ce970 2024-04-25T09:05:39.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c3a000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c340cfd10 con 0x7f3c34145250 2024-04-25T09:05:39.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c3a000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c340cfff0 con 0x7f3c341600a0 2024-04-25T09:05:39.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c33e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3c340ce970 0x7f3c340cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c33e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3c340ce970 0x7f3c340cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43732/0 (socket says 172.21.15.175:43732) 2024-04-25T09:05:39.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c33e00640 1 -- 172.21.15.175:0/2258784355 learned_addr learned my addr 172.21.15.175:0/2258784355 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:39.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c33400640 1 --2- 172.21.15.175:0/2258784355 >> v2:172.21.15.177:3300/0 conn(0x7f3c34145250 0x7f3c340cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c2aa00640 1 --2- 172.21.15.175:0/2258784355 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c341600a0 0x7f3c340cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c33e00640 1 -- 172.21.15.175:0/2258784355 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c341600a0 msgr2=0x7f3c340cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:39.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c33e00640 1 --2- 172.21.15.175:0/2258784355 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c341600a0 0x7f3c340cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c33e00640 1 -- 172.21.15.175:0/2258784355 >> v2:172.21.15.177:3300/0 conn(0x7f3c34145250 msgr2=0x7f3c340cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:39.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c33e00640 1 --2- 172.21.15.175:0/2258784355 >> v2:172.21.15.177:3300/0 conn(0x7f3c34145250 0x7f3c340cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c33e00640 1 -- 172.21.15.175:0/2258784355 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3415f8a0 con 0x7f3c340ce970 2024-04-25T09:05:39.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c33400640 1 --2- 172.21.15.175:0/2258784355 >> v2:172.21.15.177:3300/0 conn(0x7f3c34145250 0x7f3c340cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:39.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.089+0000 7f3c2aa00640 1 --2- 172.21.15.175:0/2258784355 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c341600a0 0x7f3c340cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:39.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.093+0000 7f3c33e00640 1 --2- 172.21.15.175:0/2258784355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c340ce970 0x7f3c340cee00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3c340b4ad0 tx=0x7f3c2c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c894f0ba3257366 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:39.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.093+0000 7f3c32a00640 1 -- 172.21.15.175:0/2258784355 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0a5860 con 0x7f3c340ce970 2024-04-25T09:05:39.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.093+0000 7f3c32a00640 1 -- 172.21.15.175:0/2258784355 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c0a5a00 con 0x7f3c340ce970 2024-04-25T09:05:39.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.093+0000 7f3c32a00640 1 -- 172.21.15.175:0/2258784355 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0a5dd0 con 0x7f3c340ce970 2024-04-25T09:05:39.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.093+0000 7f3c3a000640 1 -- 172.21.15.175:0/2258784355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c340ce970 msgr2=0x7f3c340cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.093+0000 7f3c3a000640 1 --2- 172.21.15.175:0/2258784355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c340ce970 0x7f3c340cee00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3c340b4ad0 tx=0x7f3c2c01c9c0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.093+0000 7f3c3a000640 1 -- 172.21.15.175:0/2258784355 shutdown_connections 2024-04-25T09:05:39.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.093+0000 7f3c3a000640 1 --2- 172.21.15.175:0/2258784355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c340ce970 0x7f3c340cee00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.093+0000 7f3c3a000640 1 --2- 172.21.15.175:0/2258784355 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c341600a0 0x7f3c340cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.093+0000 7f3c3a000640 1 --2- 172.21.15.175:0/2258784355 >> v2:172.21.15.177:3300/0 conn(0x7f3c34145250 0x7f3c340cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.093+0000 7f3c3a000640 1 -- 172.21.15.175:0/2258784355 >> 172.21.15.175:0/2258784355 conn(0x7f3c3406ac50 msgr2=0x7f3c3406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:39.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.093+0000 7f3c3a000640 1 -- 172.21.15.175:0/2258784355 shutdown_connections 2024-04-25T09:05:39.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.093+0000 7f3c3a000640 1 -- 172.21.15.175:0/2258784355 wait complete. 2024-04-25T09:05:39.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c3a000640 1 Processor -- start 2024-04-25T09:05:39.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c3a000640 1 -- start start 2024-04-25T09:05:39.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c3a000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c340ce970 0x7f3c341591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c3a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c34145250 0x7f3c3415dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c3a000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c341600a0 0x7f3c34143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c3a000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c34160480 con 0x7f3c34145250 2024-04-25T09:05:39.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c3a000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c34145630 con 0x7f3c341600a0 2024-04-25T09:05:39.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c3a000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c34160600 con 0x7f3c340ce970 2024-04-25T09:05:39.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c2aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c34145250 0x7f3c3415dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c2aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c34145250 0x7f3c3415dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43744/0 (socket says 172.21.15.175:43744) 2024-04-25T09:05:39.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c2aa00640 1 -- 172.21.15.175:0/1611473464 learned_addr learned my addr 172.21.15.175:0/1611473464 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:39.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c33400640 1 --2- 172.21.15.175:0/1611473464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c340ce970 0x7f3c341591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c33e00640 1 --2- 172.21.15.175:0/1611473464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c341600a0 0x7f3c34143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c2aa00640 1 -- 172.21.15.175:0/1611473464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c340ce970 msgr2=0x7f3c341591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c2aa00640 1 --2- 172.21.15.175:0/1611473464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c340ce970 0x7f3c341591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c2aa00640 1 -- 172.21.15.175:0/1611473464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c341600a0 msgr2=0x7f3c34143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c2aa00640 1 --2- 172.21.15.175:0/1611473464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c341600a0 0x7f3c34143ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c2aa00640 1 -- 172.21.15.175:0/1611473464 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3413e580 con 0x7f3c34145250 2024-04-25T09:05:39.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c33e00640 1 --2- 172.21.15.175:0/1611473464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c341600a0 0x7f3c34143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:39.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c2aa00640 1 --2- 172.21.15.175:0/1611473464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c34145250 0x7f3c3415dbc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c00d800 tx=0x7f3c1c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:39.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c2be00640 1 -- 172.21.15.175:0/1611473464 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c018020 con 0x7f3c34145250 2024-04-25T09:05:39.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c2be00640 1 -- 172.21.15.175:0/1611473464 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1c0096c0 con 0x7f3c34145250 2024-04-25T09:05:39.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c2be00640 1 -- 172.21.15.175:0/1611473464 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c009ab0 con 0x7f3c34145250 2024-04-25T09:05:39.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c3a000640 1 -- 172.21.15.175:0/1611473464 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3413e860 con 0x7f3c34145250 2024-04-25T09:05:39.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.097+0000 7f3c3a000640 1 -- 172.21.15.175:0/1611473464 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3413ee20 con 0x7f3c34145250 2024-04-25T09:05:39.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.101+0000 7f3c3a000640 1 -- 172.21.15.175:0/1611473464 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c34075160 con 0x7f3c34145250 2024-04-25T09:05:39.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.101+0000 7f3c2be00640 1 -- 172.21.15.175:0/1611473464 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3c1c01b020 con 0x7f3c34145250 2024-04-25T09:05:39.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.101+0000 7f3c2be00640 1 --2- 172.21.15.175:0/1611473464 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c10066f90 0x7f3c10069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.101+0000 7f3c2be00640 1 -- 172.21.15.175:0/1611473464 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3c1c085320 con 0x7f3c34145250 2024-04-25T09:05:39.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.101+0000 7f3c33400640 1 --2- 172.21.15.175:0/1611473464 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c10066f90 0x7f3c10069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.101+0000 7f3c33400640 1 --2- 172.21.15.175:0/1611473464 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c10066f90 0x7f3c10069450 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400c880 tx=0x7f3c24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:39.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.105+0000 7f3c2be00640 1 -- 172.21.15.175:0/1611473464 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3c1c022020 con 0x7f3c34145250 2024-04-25T09:05:39.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.257+0000 7f3c3a000640 1 -- 172.21.15.175:0/1611473464 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3c3406c2d0 con 0x7f3c34145250 2024-04-25T09:05:39.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.261+0000 7f3c2be00640 1 -- 172.21.15.175:0/1611473464 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3c1c056500 con 0x7f3c34145250 2024-04-25T09:05:39.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.265+0000 7f3c3a000640 1 -- 172.21.15.175:0/1611473464 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c10066f90 msgr2=0x7f3c10069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.265+0000 7f3c3a000640 1 --2- 172.21.15.175:0/1611473464 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c10066f90 0x7f3c10069450 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400c880 tx=0x7f3c24008040 comp rx=0 tx=0).stop 2024-04-25T09:05:39.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.265+0000 7f3c3a000640 1 -- 172.21.15.175:0/1611473464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c34145250 msgr2=0x7f3c3415dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.265+0000 7f3c3a000640 1 --2- 172.21.15.175:0/1611473464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c34145250 0x7f3c3415dbc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c00d800 tx=0x7f3c1c00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.265+0000 7f3c3a000640 1 -- 172.21.15.175:0/1611473464 shutdown_connections 2024-04-25T09:05:39.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.265+0000 7f3c3a000640 1 --2- 172.21.15.175:0/1611473464 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c10066f90 0x7f3c10069450 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.265+0000 7f3c3a000640 1 --2- 172.21.15.175:0/1611473464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c341600a0 0x7f3c34143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.265+0000 7f3c3a000640 1 --2- 172.21.15.175:0/1611473464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c34145250 0x7f3c3415dbc0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.265+0000 7f3c3a000640 1 --2- 172.21.15.175:0/1611473464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c340ce970 0x7f3c341591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.265+0000 7f3c3a000640 1 -- 172.21.15.175:0/1611473464 >> 172.21.15.175:0/1611473464 conn(0x7f3c3406ac50 msgr2=0x7f3c340af820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:39.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.265+0000 7f3c3a000640 1 -- 172.21.15.175:0/1611473464 shutdown_connections 2024-04-25T09:05:39.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.265+0000 7f3c3a000640 1 -- 172.21.15.175:0/1611473464 wait complete. 2024-04-25T09:05:39.273 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:05:39.273 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:05:39.332 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:05:39.415 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:05:39.415 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:05:39.415 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:39.424 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:05:39.424 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:05:39.424 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:39.433 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:05:39.433 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:05:39.433 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:39.477 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:05:39.477 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:05:39.477 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:39.486 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:05:39.486 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:05:39.486 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:39.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.665+0000 7f3532200640 1 Processor -- start 2024-04-25T09:05:39.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.665+0000 7f3532200640 1 -- start start 2024-04-25T09:05:39.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.665+0000 7f3532200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f352c15a900 0x7f352c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.665+0000 7f3532200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352c0cda00 con 0x7f352c0cd520 2024-04-25T09:05:39.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.665+0000 7f3532200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352c0cdce0 con 0x7f352c0cf560 2024-04-25T09:05:39.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.665+0000 7f3532200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352c15bcf0 con 0x7f352c15a900 2024-04-25T09:05:39.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.665+0000 7f3522a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f352c0cd520 0x7f352c0ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44692/0 (socket says 172.21.15.175:44692) 2024-04-25T09:05:39.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.665+0000 7f3522a00640 1 -- 172.21.15.175:0/2456842369 learned_addr learned my addr 172.21.15.175:0/2456842369 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:39.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.665+0000 7f352b400640 1 --2- 172.21.15.175:0/2456842369 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f352c15a900 0x7f352c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.665+0000 7f352aa00640 1 -- 172.21.15.175:0/2456842369 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119065690 0 0) 0x7f352c0cda00 con 0x7f352c0cd520 2024-04-25T09:05:39.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.665+0000 7f352aa00640 1 -- 172.21.15.175:0/2456842369 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3510003530 con 0x7f352c0cd520 2024-04-25T09:05:39.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.665+0000 7f352aa00640 1 -- 172.21.15.175:0/2456842369 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712214360 0 0) 0x7f352c0cdce0 con 0x7f352c0cf560 2024-04-25T09:05:39.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.665+0000 7f352aa00640 1 -- 172.21.15.175:0/2456842369 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f352c0cda00 con 0x7f352c0cf560 2024-04-25T09:05:39.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.665+0000 7f352b400640 1 -- 172.21.15.175:0/2456842369 >> v1:172.21.15.177:6789/0 conn(0x7f352c0cf560 legacy=0x7f352c15bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.665+0000 7f352b400640 1 -- 172.21.15.175:0/2456842369 >> v1:172.21.15.175:6789/0 conn(0x7f352c0cd520 legacy=0x7f352c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.665+0000 7f352aa00640 1 -- 172.21.15.175:0/2456842369 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1304010037 0 0) 0x7f3510003530 con 0x7f352c0cd520 2024-04-25T09:05:39.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.665+0000 7f352b400640 1 -- 172.21.15.175:0/2456842369 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352c0cdfc0 con 0x7f352c15a900 2024-04-25T09:05:39.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.669+0000 7f352b400640 1 --2- 172.21.15.175:0/2456842369 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f352c15a900 0x7f352c06e150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f351c0097f0 tx=0x7f351c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a95ee420042d0c2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:39.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.669+0000 7f352aa00640 1 -- 172.21.15.175:0/2456842369 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c0b0070 con 0x7f352c15a900 2024-04-25T09:05:39.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.669+0000 7f352aa00640 1 -- 172.21.15.175:0/2456842369 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351c0ab400 con 0x7f352c15a900 2024-04-25T09:05:39.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.669+0000 7f352aa00640 1 -- 172.21.15.175:0/2456842369 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514001680 con 0x7f352c15a900 2024-04-25T09:05:39.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.669+0000 7f3532200640 1 -- 172.21.15.175:0/2456842369 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f352c15a900 msgr2=0x7f352c06e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.669+0000 7f3532200640 1 --2- 172.21.15.175:0/2456842369 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f352c15a900 0x7f352c06e150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f351c0097f0 tx=0x7f351c01c400 comp rx=0 tx=0).stop 2024-04-25T09:05:39.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.669+0000 7f3532200640 1 -- 172.21.15.175:0/2456842369 shutdown_connections 2024-04-25T09:05:39.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.669+0000 7f3532200640 1 --2- 172.21.15.175:0/2456842369 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f352c15a900 0x7f352c06e150 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.669+0000 7f3532200640 1 -- 172.21.15.175:0/2456842369 >> 172.21.15.175:0/2456842369 conn(0x7f352c067150 msgr2=0x7f352c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:39.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.669+0000 7f3532200640 1 -- 172.21.15.175:0/2456842369 shutdown_connections 2024-04-25T09:05:39.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.669+0000 7f3532200640 1 -- 172.21.15.175:0/2456842369 wait complete. 2024-04-25T09:05:39.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f3532200640 1 Processor -- start 2024-04-25T09:05:39.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f3532200640 1 -- start start 2024-04-25T09:05:39.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f3532200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f352c0cf560 0x7f352c14c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f3532200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f352c15a900 0x7f352c1f6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f3532200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f352c146050 0x7f352c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f3532200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c06d530 con 0x7f352c146050 2024-04-25T09:05:39.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f3532200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c06d3b0 con 0x7f352c15a900 2024-04-25T09:05:39.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f3532200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352c071a50 con 0x7f352c0cf560 2024-04-25T09:05:39.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f352be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f352c146050 0x7f352c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f352be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f352c146050 0x7f352c0b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50512/0 (socket says 172.21.15.175:50512) 2024-04-25T09:05:39.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f352be00640 1 -- 172.21.15.175:0/3267216980 learned_addr learned my addr 172.21.15.175:0/3267216980 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:39.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f352b400640 1 --2- 172.21.15.175:0/3267216980 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f352c0cf560 0x7f352c14c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f3522a00640 1 --2- 172.21.15.175:0/3267216980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f352c15a900 0x7f352c1f6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f352be00640 1 -- 172.21.15.175:0/3267216980 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f352c0cf560 msgr2=0x7f352c14c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f352be00640 1 --2- 172.21.15.175:0/3267216980 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f352c0cf560 0x7f352c14c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f352be00640 1 -- 172.21.15.175:0/3267216980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f352c15a900 msgr2=0x7f352c1f6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f352be00640 1 --2- 172.21.15.175:0/3267216980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f352c15a900 0x7f352c1f6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f352be00640 1 -- 172.21.15.175:0/3267216980 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352c153b20 con 0x7f352c146050 2024-04-25T09:05:39.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f352be00640 1 --2- 172.21.15.175:0/3267216980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f352c146050 0x7f352c0b34b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f352400c790 tx=0x7f352400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:39.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f3523e00640 1 -- 172.21.15.175:0/3267216980 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524003b80 con 0x7f352c146050 2024-04-25T09:05:39.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f3523e00640 1 -- 172.21.15.175:0/3267216980 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3524003d20 con 0x7f352c146050 2024-04-25T09:05:39.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f3523e00640 1 -- 172.21.15.175:0/3267216980 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352400aa50 con 0x7f352c146050 2024-04-25T09:05:39.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f3532200640 1 -- 172.21.15.175:0/3267216980 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352c1f7750 con 0x7f352c146050 2024-04-25T09:05:39.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.673+0000 7f3532200640 1 -- 172.21.15.175:0/3267216980 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352c1f7d10 con 0x7f352c146050 2024-04-25T09:05:39.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.677+0000 7f3532200640 1 -- 172.21.15.175:0/3267216980 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352c074a60 con 0x7f352c146050 2024-04-25T09:05:39.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.677+0000 7f3523e00640 1 -- 172.21.15.175:0/3267216980 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f352400abf0 con 0x7f352c146050 2024-04-25T09:05:39.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.677+0000 7f3523e00640 1 --2- 172.21.15.175:0/3267216980 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3508066f90 0x7f3508069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:39.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.677+0000 7f3523e00640 1 -- 172.21.15.175:0/3267216980 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3524084be0 con 0x7f352c146050 2024-04-25T09:05:39.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.677+0000 7f352b400640 1 --2- 172.21.15.175:0/3267216980 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3508066f90 0x7f3508069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:39.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.677+0000 7f352b400640 1 --2- 172.21.15.175:0/3267216980 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3508066f90 0x7f3508069450 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f351c0ad000 tx=0x7f351c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:39.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.681+0000 7f3523e00640 1 -- 172.21.15.175:0/3267216980 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3524055800 con 0x7f352c146050 2024-04-25T09:05:39.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.869+0000 7f3532200640 1 -- 172.21.15.175:0/3267216980 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f352c06aea0 con 0x7f352c146050 2024-04-25T09:05:39.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.869+0000 7f3523e00640 1 -- 172.21.15.175:0/3267216980 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f35240598a0 con 0x7f352c146050 2024-04-25T09:05:39.858 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:39.858 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2334769483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2334769483},{"type":"v1","addr":"172.21.15.177:6834","nonce":2334769483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2397222507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2397222507},{"type":"v1","addr":"172.21.15.177:6835","nonce":2397222507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5067,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2738941530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2738941530},{"type":"v1","addr":"172.21.15.175:6836","nonce":2738941530}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5454,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2030305264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2030305264},{"type":"v1","addr":"172.21.15.175:6837","nonce":2030305264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[]} 2024-04-25T09:05:39.859 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 19 2024-04-25T09:05:39.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.869+0000 7f3532200640 1 -- 172.21.15.175:0/3267216980 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3508066f90 msgr2=0x7f3508069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.869+0000 7f3532200640 1 --2- 172.21.15.175:0/3267216980 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3508066f90 0x7f3508069450 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f351c0ad000 tx=0x7f351c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:05:39.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.869+0000 7f3532200640 1 -- 172.21.15.175:0/3267216980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f352c146050 msgr2=0x7f352c0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:39.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.869+0000 7f3532200640 1 --2- 172.21.15.175:0/3267216980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f352c146050 0x7f352c0b34b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f352400c790 tx=0x7f352400cc50 comp rx=0 tx=0).stop 2024-04-25T09:05:39.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.869+0000 7f3532200640 1 -- 172.21.15.175:0/3267216980 shutdown_connections 2024-04-25T09:05:39.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.869+0000 7f3532200640 1 --2- 172.21.15.175:0/3267216980 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3508066f90 0x7f3508069450 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.869+0000 7f3532200640 1 --2- 172.21.15.175:0/3267216980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f352c146050 0x7f352c0b34b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.869+0000 7f3532200640 1 --2- 172.21.15.175:0/3267216980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f352c15a900 0x7f352c1f6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.869+0000 7f3532200640 1 --2- 172.21.15.175:0/3267216980 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f352c0cf560 0x7f352c14c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:39.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.869+0000 7f3532200640 1 -- 172.21.15.175:0/3267216980 >> 172.21.15.175:0/3267216980 conn(0x7f352c0cd520 msgr2=0x7f352c1583a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:39.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.869+0000 7f3532200640 1 -- 172.21.15.175:0/3267216980 shutdown_connections 2024-04-25T09:05:39.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:39.869+0000 7f3532200640 1 -- 172.21.15.175:0/3267216980 wait complete. 2024-04-25T09:05:39.880 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:05:39.880 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:05:39.880 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:05:39.880 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:05:39.880 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:05:39.880 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:05:39.881 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:05:39.881 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:05:39.881 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:05:39.881 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:05:39.881 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:05:39.882 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:05:39.882 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:05:39.882 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:05:39.882 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:05:39.882 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:05:39.895 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:05:39.895 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:05:39.896 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:05:39.896 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:05:39.897 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:05:39.897 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:05:39.897 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:05:39.898 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:05:39.943 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:05:39.944 DEBUG:teuthology.parallel:result is None 2024-04-25T09:05:39.945 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:05:39.945 DEBUG:teuthology.parallel:result is None 2024-04-25T09:05:39.947 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:05:39.947 DEBUG:teuthology.parallel:result is None 2024-04-25T09:05:39.949 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:05:39.949 DEBUG:teuthology.parallel:result is None 2024-04-25T09:05:39.949 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:05:40.030 INFO:tasks.ceph.mds.c.smithi175.stdout:starting mds.c at 2024-04-25T09:05:40.030 INFO:tasks.ceph.mds.a.smithi175.stdout:starting mds.a at 2024-04-25T09:05:40.040 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-04-25T09:05:40.040 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-04-25T09:05:40.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.105+0000 7f5177c00640 1 Processor -- start 2024-04-25T09:05:40.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.105+0000 7f5177c00640 1 -- start start 2024-04-25T09:05:40.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.105+0000 7f5177c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f517015af20 0x7f51700b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.105+0000 7f5177c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f51700b4630 0x7f517015c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.105+0000 7f5177c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f517006db60 con 0x7f51700cbe60 2024-04-25T09:05:40.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.105+0000 7f5177c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517006de40 con 0x7f51700b4630 2024-04-25T09:05:40.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.105+0000 7f5177c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517006e120 con 0x7f517015af20 2024-04-25T09:05:40.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.105+0000 7f5175c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f51700b4630 0x7f517015c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.105+0000 7f5175c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f51700b4630 0x7f517015c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50564/0 (socket says 172.21.15.175:50564) 2024-04-25T09:05:40.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.105+0000 7f5175c00640 1 -- 172.21.15.175:0/498352484 learned_addr learned my addr 172.21.15.175:0/498352484 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:40.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.105+0000 7f516fe00640 1 --2- 172.21.15.175:0/498352484 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f517015af20 0x7f51700b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.105+0000 7f5175c00640 1 -- 172.21.15.175:0/498352484 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f517015af20 msgr2=0x7f51700b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:40.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.105+0000 7f5175c00640 1 --2- 172.21.15.175:0/498352484 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f517015af20 0x7f51700b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.105+0000 7f5175c00640 1 -- 172.21.15.175:0/498352484 >> v1:172.21.15.175:6789/0 conn(0x7f51700cbe60 legacy=0x7f517006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.105+0000 7f5175c00640 1 -- 172.21.15.175:0/498352484 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517015c2f0 con 0x7f51700b4630 2024-04-25T09:05:40.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.105+0000 7f516f400640 1 -- 172.21.15.175:0/498352484 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735625622 0 0) 0x7f517006db60 con 0x7f51700cbe60 2024-04-25T09:05:40.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.109+0000 7f5175c00640 1 --2- 172.21.15.175:0/498352484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51700b4630 0x7f517015c810 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5168009e50 tx=0x7f516801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e0d12c0a07b9d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:40.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.109+0000 7f516f400640 1 -- 172.21.15.175:0/498352484 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51680a5700 con 0x7f51700b4630 2024-04-25T09:05:40.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.109+0000 7f516f400640 1 -- 172.21.15.175:0/498352484 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51680a58a0 con 0x7f51700b4630 2024-04-25T09:05:40.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.109+0000 7f516f400640 1 -- 172.21.15.175:0/498352484 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51680a5c70 con 0x7f51700b4630 2024-04-25T09:05:40.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.109+0000 7f5177c00640 1 -- 172.21.15.175:0/498352484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51700b4630 msgr2=0x7f517015c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.109+0000 7f5177c00640 1 --2- 172.21.15.175:0/498352484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51700b4630 0x7f517015c810 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5168009e50 tx=0x7f516801ca30 comp rx=0 tx=0).stop 2024-04-25T09:05:40.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.109+0000 7f5177c00640 1 -- 172.21.15.175:0/498352484 shutdown_connections 2024-04-25T09:05:40.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.109+0000 7f5177c00640 1 --2- 172.21.15.175:0/498352484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51700b4630 0x7f517015c810 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.109+0000 7f5177c00640 1 --2- 172.21.15.175:0/498352484 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f517015af20 0x7f51700b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.109+0000 7f5177c00640 1 -- 172.21.15.175:0/498352484 >> 172.21.15.175:0/498352484 conn(0x7f517006ac50 msgr2=0x7f517006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:40.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.109+0000 7f5177c00640 1 -- 172.21.15.175:0/498352484 shutdown_connections 2024-04-25T09:05:40.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.109+0000 7f5177c00640 1 -- 172.21.15.175:0/498352484 wait complete. 2024-04-25T09:05:40.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.109+0000 7f5177c00640 1 Processor -- start 2024-04-25T09:05:40.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.109+0000 7f5177c00640 1 -- start start 2024-04-25T09:05:40.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5177c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51700b4630 0x7f51700b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5177c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51700cbe60 0x7f5170141110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5177c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f517015af20 0x7f5170159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5177c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517015d970 con 0x7f51700b4630 2024-04-25T09:05:40.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5177c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517015d7f0 con 0x7f51700cbe60 2024-04-25T09:05:40.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5177c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517015daf0 con 0x7f517015af20 2024-04-25T09:05:40.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5175200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51700b4630 0x7f51700b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5175200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51700b4630 0x7f51700b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50570/0 (socket says 172.21.15.175:50570) 2024-04-25T09:05:40.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5175200640 1 -- 172.21.15.175:0/3663356300 learned_addr learned my addr 172.21.15.175:0/3663356300 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:40.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f516fe00640 1 --2- 172.21.15.175:0/3663356300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51700cbe60 0x7f5170141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5175200640 1 -- 172.21.15.175:0/3663356300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f517015af20 msgr2=0x7f5170159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5175c00640 1 --2- 172.21.15.175:0/3663356300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f517015af20 0x7f5170159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5175200640 1 --2- 172.21.15.175:0/3663356300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f517015af20 0x7f5170159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5175200640 1 -- 172.21.15.175:0/3663356300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51700cbe60 msgr2=0x7f5170141110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:40.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5175200640 1 --2- 172.21.15.175:0/3663356300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51700cbe60 0x7f5170141110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:40.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5175200640 1 -- 172.21.15.175:0/3663356300 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51700b42d0 con 0x7f51700b4630 2024-04-25T09:05:40.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f516fe00640 1 --2- 172.21.15.175:0/3663356300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51700cbe60 0x7f5170141110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:40.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5175c00640 1 --2- 172.21.15.175:0/3663356300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f517015af20 0x7f5170159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:40.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5175200640 1 --2- 172.21.15.175:0/3663356300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51700b4630 0x7f51700b3bd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5164001ec0 tx=0x7f516400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:40.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f516cc00640 1 -- 172.21.15.175:0/3663356300 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5164017070 con 0x7f51700b4630 2024-04-25T09:05:40.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f516cc00640 1 -- 172.21.15.175:0/3663356300 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5164003600 con 0x7f51700b4630 2024-04-25T09:05:40.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f516cc00640 1 -- 172.21.15.175:0/3663356300 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51640039f0 con 0x7f51700b4630 2024-04-25T09:05:40.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5177c00640 1 -- 172.21.15.175:0/3663356300 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5170157bf0 con 0x7f51700b4630 2024-04-25T09:05:40.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5177c00640 1 -- 172.21.15.175:0/3663356300 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51701581b0 con 0x7f51700b4630 2024-04-25T09:05:40.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.113+0000 7f5177c00640 1 -- 172.21.15.175:0/3663356300 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5170075160 con 0x7f51700b4630 2024-04-25T09:05:40.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.117+0000 7f516cc00640 1 -- 172.21.15.175:0/3663356300 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f516401a070 con 0x7f51700b4630 2024-04-25T09:05:40.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.117+0000 7f516cc00640 1 --2- 172.21.15.175:0/3663356300 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5150066f60 0x7f5150069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:40.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.117+0000 7f516cc00640 1 -- 172.21.15.175:0/3663356300 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5164084190 con 0x7f51700b4630 2024-04-25T09:05:40.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.117+0000 7f516fe00640 1 --2- 172.21.15.175:0/3663356300 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5150066f60 0x7f5150069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:40.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.117+0000 7f516fe00640 1 --2- 172.21.15.175:0/3663356300 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5150066f60 0x7f5150069420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f51700cfd50 tx=0x7f515c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:40.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.121+0000 7f516cc00640 1 -- 172.21.15.175:0/3663356300 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5164055400 con 0x7f51700b4630 2024-04-25T09:05:40.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:40.289+0000 7f5177c00640 1 -- 172.21.15.175:0/3663356300 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f51700cb960 con 0x7f51700b4630 2024-04-25T09:05:41.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.281+0000 7f516cc00640 1 -- 172.21.15.175:0/3663356300 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v40) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5164054d00 con 0x7f51700b4630 2024-04-25T09:05:41.270 INFO:teuthology.orchestra.run.smithi175.stderr: removed all blocklist entries 2024-04-25T09:05:41.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.281+0000 7f5177c00640 1 -- 172.21.15.175:0/3663356300 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5150066f60 msgr2=0x7f5150069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.281+0000 7f5177c00640 1 --2- 172.21.15.175:0/3663356300 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5150066f60 0x7f5150069420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f51700cfd50 tx=0x7f515c008040 comp rx=0 tx=0).stop 2024-04-25T09:05:41.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.281+0000 7f5177c00640 1 -- 172.21.15.175:0/3663356300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51700b4630 msgr2=0x7f51700b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.281+0000 7f5177c00640 1 --2- 172.21.15.175:0/3663356300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51700b4630 0x7f51700b3bd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5164001ec0 tx=0x7f516400c8e0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.285+0000 7f5177c00640 1 -- 172.21.15.175:0/3663356300 shutdown_connections 2024-04-25T09:05:41.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.285+0000 7f5177c00640 1 --2- 172.21.15.175:0/3663356300 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5150066f60 0x7f5150069420 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.285+0000 7f5177c00640 1 --2- 172.21.15.175:0/3663356300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f517015af20 0x7f5170159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.285+0000 7f5177c00640 1 --2- 172.21.15.175:0/3663356300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51700cbe60 0x7f5170141110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.285+0000 7f5177c00640 1 --2- 172.21.15.175:0/3663356300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51700b4630 0x7f51700b3bd0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.285+0000 7f5177c00640 1 -- 172.21.15.175:0/3663356300 >> 172.21.15.175:0/3663356300 conn(0x7f517006ac50 msgr2=0x7f5170154810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:41.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.285+0000 7f5177c00640 1 -- 172.21.15.175:0/3663356300 shutdown_connections 2024-04-25T09:05:41.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.285+0000 7f5177c00640 1 -- 172.21.15.175:0/3663356300 wait complete. 2024-04-25T09:05:41.296 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:05:41.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eba400640 1 Processor -- start 2024-04-25T09:05:41.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eba400640 1 -- start start 2024-04-25T09:05:41.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eba400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8eb4099a50 0x7f8eb40cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eba400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8eb415bc10 0x7f8eb4099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eba400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb409a370 con 0x7f8eb409abb0 2024-04-25T09:05:41.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eba400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb40d06f0 con 0x7f8eb415bc10 2024-04-25T09:05:41.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eba400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40cc4c0 con 0x7f8eb4099a50 2024-04-25T09:05:41.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb3e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f8eb409abb0 0x7f8eb40cfdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44714/0 (socket says 172.21.15.175:44714) 2024-04-25T09:05:41.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb3e00640 1 -- 172.21.15.175:0/1435216997 learned_addr learned my addr 172.21.15.175:0/1435216997 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:41.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb3400640 1 --2- 172.21.15.175:0/1435216997 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8eb4099a50 0x7f8eb40cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eaaa00640 1 --2- 172.21.15.175:0/1435216997 >> v2:172.21.15.177:3300/0 conn(0x7f8eb415bc10 0x7f8eb4099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb2a00640 1 -- 172.21.15.175:0/1435216997 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502316401 0 0) 0x7f8eb409a370 con 0x7f8eb409abb0 2024-04-25T09:05:41.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb2a00640 1 -- 172.21.15.175:0/1435216997 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e98003530 con 0x7f8eb409abb0 2024-04-25T09:05:41.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb2a00640 1 -- 172.21.15.175:0/1435216997 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 822180854 0 0) 0x7f8e98003530 con 0x7f8eb409abb0 2024-04-25T09:05:41.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb2a00640 1 -- 172.21.15.175:0/1435216997 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8eb4099a50 msgr2=0x7f8eb40cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:41.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb2a00640 1 --2- 172.21.15.175:0/1435216997 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8eb4099a50 0x7f8eb40cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb2a00640 1 -- 172.21.15.175:0/1435216997 >> v2:172.21.15.177:3300/0 conn(0x7f8eb415bc10 msgr2=0x7f8eb4099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:41.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb2a00640 1 --2- 172.21.15.175:0/1435216997 >> v2:172.21.15.177:3300/0 conn(0x7f8eb415bc10 0x7f8eb4099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb2a00640 1 -- 172.21.15.175:0/1435216997 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb40cc7a0 con 0x7f8eb409abb0 2024-04-25T09:05:41.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb2a00640 1 -- 172.21.15.175:0/1435216997 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f8eac001680 con 0x7f8eb409abb0 2024-04-25T09:05:41.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb2a00640 1 -- 172.21.15.175:0/1435216997 >> v1:172.21.15.175:6789/0 conn(0x7f8eb409abb0 legacy=0x7f8eb40cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb2a00640 1 --2- 172.21.15.175:0/1435216997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e980039c0 0x7f8e98003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb2a00640 1 --2- 172.21.15.175:0/1435216997 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8eb4099a50 0x7f8e98004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb2a00640 1 --2- 172.21.15.175:0/1435216997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e98004d50 0x7f8e980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb2a00640 1 -- 172.21.15.175:0/1435216997 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40d06f0 con 0x7f8e98004d50 2024-04-25T09:05:41.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb2a00640 1 -- 172.21.15.175:0/1435216997 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40cc4c0 con 0x7f8e980039c0 2024-04-25T09:05:41.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.449+0000 7f8eb2a00640 1 -- 172.21.15.175:0/1435216997 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9800b9d0 con 0x7f8eb4099a50 2024-04-25T09:05:41.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.453+0000 7f8eb3400640 1 --2- 172.21.15.175:0/1435216997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e980039c0 0x7f8e98003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.453+0000 7f8eb3e00640 1 --2- 172.21.15.175:0/1435216997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e98004d50 0x7f8e980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.453+0000 7f8eaaa00640 1 --2- 172.21.15.175:0/1435216997 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8eb4099a50 0x7f8e98004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.453+0000 7f8eb3e00640 1 -- 172.21.15.175:0/1435216997 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8eb4099a50 msgr2=0x7f8e98004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:41.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.453+0000 7f8eb3e00640 1 --2- 172.21.15.175:0/1435216997 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8eb4099a50 0x7f8e98004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.453+0000 7f8eb3e00640 1 -- 172.21.15.175:0/1435216997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e980039c0 msgr2=0x7f8e98003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:41.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.453+0000 7f8eb3e00640 1 --2- 172.21.15.175:0/1435216997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e980039c0 0x7f8e98003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.453+0000 7f8eb3e00640 1 -- 172.21.15.175:0/1435216997 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e98003530 con 0x7f8e98004d50 2024-04-25T09:05:41.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.453+0000 7f8eaaa00640 1 --2- 172.21.15.175:0/1435216997 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8eb4099a50 0x7f8e98004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:41.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.453+0000 7f8eb3e00640 1 --2- 172.21.15.175:0/1435216997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e98004d50 0x7f8e980051d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00c2c0 tx=0x7f8eac01cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b5aa740ac06a93 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:41.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.453+0000 7f8eb2a00640 1 -- 172.21.15.175:0/1435216997 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac007d60 con 0x7f8e98004d50 2024-04-25T09:05:41.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.453+0000 7f8eb2a00640 1 -- 172.21.15.175:0/1435216997 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eac0a9020 con 0x7f8e98004d50 2024-04-25T09:05:41.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.453+0000 7f8eb2a00640 1 -- 172.21.15.175:0/1435216997 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac0a5bb0 con 0x7f8e98004d50 2024-04-25T09:05:41.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eba400640 1 -- 172.21.15.175:0/1435216997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e98004d50 msgr2=0x7f8e980051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eba400640 1 --2- 172.21.15.175:0/1435216997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e98004d50 0x7f8e980051d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00c2c0 tx=0x7f8eac01cd40 comp rx=0 tx=0).stop 2024-04-25T09:05:41.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eb3e00640 1 -- 172.21.15.175:0/1435216997 reap_dead start 2024-04-25T09:05:41.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eba400640 1 -- 172.21.15.175:0/1435216997 shutdown_connections 2024-04-25T09:05:41.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eba400640 1 -- 172.21.15.175:0/1435216997 >> 172.21.15.175:0/1435216997 conn(0x7f8eb40b3300 msgr2=0x7f8eb40b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:41.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eba400640 1 -- 172.21.15.175:0/1435216997 shutdown_connections 2024-04-25T09:05:41.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eba400640 1 -- 172.21.15.175:0/1435216997 wait complete. 2024-04-25T09:05:41.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eba400640 1 Processor -- start 2024-04-25T09:05:41.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eba400640 1 -- start start 2024-04-25T09:05:41.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eba400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e98004d50 0x7f8eb414ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eba400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8eb40c9ed0 0x7f8eb40ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eba400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8eb409be10 0x7f8eb409c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eba400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40cd280 con 0x7f8e98004d50 2024-04-25T09:05:41.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eba400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40ccd60 con 0x7f8eb40c9ed0 2024-04-25T09:05:41.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eba400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40cd400 con 0x7f8eb409be10 2024-04-25T09:05:41.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eb3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e98004d50 0x7f8eb414ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eb3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e98004d50 0x7f8eb414ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50594/0 (socket says 172.21.15.175:50594) 2024-04-25T09:05:41.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eb3400640 1 -- 172.21.15.175:0/4089541390 learned_addr learned my addr 172.21.15.175:0/4089541390 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:41.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eaaa00640 1 --2- 172.21.15.175:0/4089541390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8eb40c9ed0 0x7f8eb40ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eb3e00640 1 --2- 172.21.15.175:0/4089541390 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8eb409be10 0x7f8eb409c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eb3400640 1 -- 172.21.15.175:0/4089541390 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8eb409be10 msgr2=0x7f8eb409c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eb3400640 1 --2- 172.21.15.175:0/4089541390 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8eb409be10 0x7f8eb409c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eb3400640 1 -- 172.21.15.175:0/4089541390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8eb40c9ed0 msgr2=0x7f8eb40ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eb3400640 1 --2- 172.21.15.175:0/4089541390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8eb40c9ed0 0x7f8eb40ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eb3400640 1 -- 172.21.15.175:0/4089541390 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb414f190 con 0x7f8e98004d50 2024-04-25T09:05:41.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.457+0000 7f8eb3400640 1 --2- 172.21.15.175:0/4089541390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e98004d50 0x7f8eb414ec50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4011e30 tx=0x7f8ea400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:41.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.461+0000 7f8eabe00640 1 -- 172.21.15.175:0/4089541390 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4015430 con 0x7f8e98004d50 2024-04-25T09:05:41.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.461+0000 7f8eabe00640 1 -- 172.21.15.175:0/4089541390 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea40155d0 con 0x7f8e98004d50 2024-04-25T09:05:41.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.461+0000 7f8eabe00640 1 -- 172.21.15.175:0/4089541390 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40159a0 con 0x7f8e98004d50 2024-04-25T09:05:41.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.461+0000 7f8eba400640 1 -- 172.21.15.175:0/4089541390 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb41f1720 con 0x7f8e98004d50 2024-04-25T09:05:41.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.461+0000 7f8eba400640 1 -- 172.21.15.175:0/4089541390 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb41f1ce0 con 0x7f8e98004d50 2024-04-25T09:05:41.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.461+0000 7f8eba400640 1 -- 172.21.15.175:0/4089541390 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb4074a60 con 0x7f8e98004d50 2024-04-25T09:05:41.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.461+0000 7f8eabe00640 1 -- 172.21.15.175:0/4089541390 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8ea4015b40 con 0x7f8e98004d50 2024-04-25T09:05:41.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.461+0000 7f8eabe00640 1 --2- 172.21.15.175:0/4089541390 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8e90066f60 0x7f8e90069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.461+0000 7f8eabe00640 1 -- 172.21.15.175:0/4089541390 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8ea4085cd0 con 0x7f8e98004d50 2024-04-25T09:05:41.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.461+0000 7f8eaaa00640 1 --2- 172.21.15.175:0/4089541390 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8e90066f60 0x7f8e90069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.461+0000 7f8eaaa00640 1 --2- 172.21.15.175:0/4089541390 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8e90066f60 0x7f8e90069420 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4070fd0 tx=0x7f8e9c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:41.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.465+0000 7f8eabe00640 1 -- 172.21.15.175:0/4089541390 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8ea4019030 con 0x7f8e98004d50 2024-04-25T09:05:41.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.673+0000 7f8eba400640 1 -- 172.21.15.175:0/4089541390 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8eb40cdc40 con 0x7f8e98004d50 2024-04-25T09:05:41.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.673+0000 7f8eabe00640 1 -- 172.21.15.175:0/4089541390 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8ea4010040 con 0x7f8e98004d50 2024-04-25T09:05:41.665 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:41.666 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:05:41.666 INFO:teuthology.orchestra.run.smithi175.stdout: "auth_dump": [ 2024-04-25T09:05:41.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.666 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.a", 2024-04-25T09:05:41.666 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpm3usiKxAAROh+31LaNyuh2SdeW6pKjQ==", 2024-04-25T09:05:41.666 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.666 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:05:41.666 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:05:41.666 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:05:41.666 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:05:41.666 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.666 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:41.666 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.667 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.b", 2024-04-25T09:05:41.667 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmYJoRNxAAZfRvDn1aoR0wa2mEKBrr+A==", 2024-04-25T09:05:41.667 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.667 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:05:41.667 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:05:41.667 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:05:41.667 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:05:41.667 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.667 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:41.667 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.667 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.c", 2024-04-25T09:05:41.667 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmk8M3MhAA6aIN33aWvVcvVEFtHL8SWA==", 2024-04-25T09:05:41.667 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.667 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:05:41.668 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:05:41.668 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:05:41.668 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:05:41.668 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.668 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:41.668 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.668 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.d", 2024-04-25T09:05:41.668 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmLAHLAhAA+mWUfpb6izHixJa073r9Jw==", 2024-04-25T09:05:41.668 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.668 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:05:41.668 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:05:41.668 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:05:41.668 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:05:41.668 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:41.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.669 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.0", 2024-04-25T09:05:41.669 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBSHCpm2xftAxAAxs9n8AE2H3HpPHEUZA4Cng==", 2024-04-25T09:05:41.669 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.669 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:41.669 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:05:41.669 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:05:41.669 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:41.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.669 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.1", 2024-04-25T09:05:41.669 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBVHCpm/OOlDRAAA7zaD8qsqS2TOCKhDFheJw==", 2024-04-25T09:05:41.670 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.670 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:41.670 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:05:41.670 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:05:41.670 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.670 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:41.670 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.670 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.2", 2024-04-25T09:05:41.670 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBYHCpmy/kmFxAAwCADFI/jMe27gAmyuAJZHQ==", 2024-04-25T09:05:41.670 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.670 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:41.670 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:05:41.670 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:05:41.670 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:41.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.671 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.3", 2024-04-25T09:05:41.671 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBbHCpm89a7HhAAVTueOuS0/Ksf8SdWK+Nm1g==", 2024-04-25T09:05:41.671 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.671 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:41.671 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:05:41.671 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:05:41.671 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.671 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:41.671 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.671 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.4", 2024-04-25T09:05:41.671 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBhHCpm5EAtFRAAeADhjja0BOIvxY3RB+n6+A==", 2024-04-25T09:05:41.671 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.671 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:41.672 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:05:41.672 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:05:41.672 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:41.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.672 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.5", 2024-04-25T09:05:41.672 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBkHCpmrLilHRAA+H8Bejnk49YfaUvl3Nrrhw==", 2024-04-25T09:05:41.672 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.672 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:41.672 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:05:41.672 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:05:41.672 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.672 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:41.672 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.672 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.6", 2024-04-25T09:05:41.673 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBnHCpm6uDxJRAAX5EwEelnZXwEHnNnv+XQ6A==", 2024-04-25T09:05:41.673 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.673 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:41.673 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:05:41.673 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:05:41.673 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:41.673 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.673 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.7", 2024-04-25T09:05:41.673 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBqHCpmwow5MBAA7b/Q9DiPO6Bfldq1+rf+/w==", 2024-04-25T09:05:41.673 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.673 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:05:41.673 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:05:41.673 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:05:41.673 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.673 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:41.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.674 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.0", 2024-04-25T09:05:41.674 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmhyCUBhAA8k9xLKIw8R04i6HSJykDfw==", 2024-04-25T09:05:41.674 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.674 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:05:41.674 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow r", 2024-04-25T09:05:41.674 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:05:41.674 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.674 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:41.674 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.674 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.1", 2024-04-25T09:05:41.674 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmQigrEBAAoWfP1ZEosbLELev5z+C9/g==", 2024-04-25T09:05:41.674 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.674 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:05:41.674 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:05:41.675 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:05:41.675 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:05:41.675 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:41.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.675 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.2", 2024-04-25T09:05:41.675 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpm0xaSDBAAup34GS3pnMwjksVuuUGOkw==", 2024-04-25T09:05:41.675 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.675 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:05:41.675 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:05:41.675 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:05:41.675 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:05:41.675 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.675 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:41.675 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.675 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.3", 2024-04-25T09:05:41.676 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpm6+doFhAAA18OgwfM8gXgQ6g0KUo7Hw==", 2024-04-25T09:05:41.676 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.676 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:05:41.676 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:05:41.676 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:05:41.676 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:05:41.676 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.676 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:41.676 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.676 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.admin", 2024-04-25T09:05:41.676 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmRZAYDRAA9sepw/fI2OhoZXER6Rmd+g==", 2024-04-25T09:05:41.676 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.676 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:05:41.676 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:05:41.676 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:05:41.676 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:05:41.677 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:41.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.677 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mgr.x", 2024-04-25T09:05:41.677 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpm5q4gJxAA9zPRlimxM0+Rb5RQkcoxzQ==", 2024-04-25T09:05:41.677 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.677 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:05:41.677 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile mgr", 2024-04-25T09:05:41.677 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:05:41.677 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.677 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:41.677 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:41.677 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mgr.y", 2024-04-25T09:05:41.677 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmMLIqIxAAiMo8+3lU0fXNoI6kBrro+Q==", 2024-04-25T09:05:41.677 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:05:41.678 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:05:41.678 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile mgr", 2024-04-25T09:05:41.678 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:05:41.678 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.678 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:41.678 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-25T09:05:41.678 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:05:41.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.673+0000 7f8eba400640 1 -- 172.21.15.175:0/4089541390 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8e90066f60 msgr2=0x7f8e90069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.673+0000 7f8eba400640 1 --2- 172.21.15.175:0/4089541390 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8e90066f60 0x7f8e90069420 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4070fd0 tx=0x7f8e9c009190 comp rx=0 tx=0).stop 2024-04-25T09:05:41.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.673+0000 7f8eba400640 1 -- 172.21.15.175:0/4089541390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e98004d50 msgr2=0x7f8eb414ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.673+0000 7f8eba400640 1 --2- 172.21.15.175:0/4089541390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e98004d50 0x7f8eb414ec50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4011e30 tx=0x7f8ea400f580 comp rx=0 tx=0).stop 2024-04-25T09:05:41.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.673+0000 7f8eba400640 1 -- 172.21.15.175:0/4089541390 shutdown_connections 2024-04-25T09:05:41.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.673+0000 7f8eba400640 1 --2- 172.21.15.175:0/4089541390 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8e90066f60 0x7f8e90069420 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.673+0000 7f8eba400640 1 --2- 172.21.15.175:0/4089541390 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8eb409be10 0x7f8eb409c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.673+0000 7f8eba400640 1 --2- 172.21.15.175:0/4089541390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8eb40c9ed0 0x7f8eb40ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.673+0000 7f8eba400640 1 --2- 172.21.15.175:0/4089541390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e98004d50 0x7f8eb414ec50 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.673+0000 7f8eba400640 1 -- 172.21.15.175:0/4089541390 >> 172.21.15.175:0/4089541390 conn(0x7f8eb40b3300 msgr2=0x7f8eb415dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:41.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.677+0000 7f8eba400640 1 -- 172.21.15.175:0/4089541390 shutdown_connections 2024-04-25T09:05:41.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.677+0000 7f8eba400640 1 -- 172.21.15.175:0/4089541390 wait complete. 2024-04-25T09:05:41.685 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:41.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.829+0000 7fc4e6200640 1 Processor -- start 2024-04-25T09:05:41.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.829+0000 7fc4e6200640 1 -- start start 2024-04-25T09:05:41.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.833+0000 7fc4e6200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e01453a0 0x7fc4e015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.833+0000 7fc4e6200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc4e015c410 0x7fc4e00cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.833+0000 7fc4e6200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e015cd00 con 0x7fc4e0144fc0 2024-04-25T09:05:41.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.833+0000 7fc4e6200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e00ce660 con 0x7fc4e015c410 2024-04-25T09:05:41.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.833+0000 7fc4e6200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e015c840 con 0x7fc4e01453a0 2024-04-25T09:05:41.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.833+0000 7fc4d6a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e01453a0 0x7fc4e015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.833+0000 7fc4d6a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e01453a0 0x7fc4e015bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:49352/0 (socket says 172.21.15.175:49352) 2024-04-25T09:05:41.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.833+0000 7fc4d6a00640 1 -- 172.21.15.175:0/441933455 learned_addr learned my addr 172.21.15.175:0/441933455 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:41.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.833+0000 7fc4dfe00640 1 --2- 172.21.15.175:0/441933455 >> v2:172.21.15.177:3300/0 conn(0x7fc4e015c410 0x7fc4e00cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.833+0000 7fc4d6a00640 1 -- 172.21.15.175:0/441933455 >> v2:172.21.15.177:3300/0 conn(0x7fc4e015c410 msgr2=0x7fc4e00cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:41.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.833+0000 7fc4d6a00640 1 --2- 172.21.15.175:0/441933455 >> v2:172.21.15.177:3300/0 conn(0x7fc4e015c410 0x7fc4e00cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.833+0000 7fc4d6a00640 1 -- 172.21.15.175:0/441933455 >> v1:172.21.15.177:6789/0 conn(0x7fc4e0144fc0 legacy=0x7fc4e00cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.833+0000 7fc4d6a00640 1 -- 172.21.15.175:0/441933455 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e00cc930 con 0x7fc4e01453a0 2024-04-25T09:05:41.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.833+0000 7fc4d6a00640 1 --2- 172.21.15.175:0/441933455 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e01453a0 0x7fc4e015bed0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009870 tx=0x7fc4c801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bde8a44c7155739a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:41.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4dea00640 1 -- 172.21.15.175:0/441933455 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80ab650 con 0x7fc4e01453a0 2024-04-25T09:05:41.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4dea00640 1 -- 172.21.15.175:0/441933455 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c80b0070 con 0x7fc4e01453a0 2024-04-25T09:05:41.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4dea00640 1 -- 172.21.15.175:0/441933455 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c80aba10 con 0x7fc4e01453a0 2024-04-25T09:05:41.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4e6200640 1 -- 172.21.15.175:0/441933455 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e01453a0 msgr2=0x7fc4e015bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4e6200640 1 --2- 172.21.15.175:0/441933455 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e01453a0 0x7fc4e015bed0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8009870 tx=0x7fc4c801c560 comp rx=0 tx=0).stop 2024-04-25T09:05:41.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4e6200640 1 -- 172.21.15.175:0/441933455 shutdown_connections 2024-04-25T09:05:41.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4e6200640 1 --2- 172.21.15.175:0/441933455 >> v2:172.21.15.177:3300/0 conn(0x7fc4e015c410 0x7fc4e00cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4e6200640 1 --2- 172.21.15.175:0/441933455 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e01453a0 0x7fc4e015bed0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4e6200640 1 -- 172.21.15.175:0/441933455 >> 172.21.15.175:0/441933455 conn(0x7fc4e0067150 msgr2=0x7fc4e006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:41.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4e6200640 1 -- 172.21.15.175:0/441933455 shutdown_connections 2024-04-25T09:05:41.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4e6200640 1 -- 172.21.15.175:0/441933455 wait complete. 2024-04-25T09:05:41.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4e6200640 1 Processor -- start 2024-04-25T09:05:41.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4e6200640 1 -- start start 2024-04-25T09:05:41.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4e6200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e01453a0 0x7fc4e013fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4e6200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e015c410 0x7fc4e0140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4e6200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4e015ad50 0x7fc4e015b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4e6200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00cc580 con 0x7fc4e015ad50 2024-04-25T09:05:41.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4e6200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00cfb70 con 0x7fc4e015c410 2024-04-25T09:05:41.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4e6200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00b12e0 con 0x7fc4e01453a0 2024-04-25T09:05:41.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4dfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4e015ad50 0x7fc4e015b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4dfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4e015ad50 0x7fc4e015b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50610/0 (socket says 172.21.15.175:50610) 2024-04-25T09:05:41.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4dfe00640 1 -- 172.21.15.175:0/2406056325 learned_addr learned my addr 172.21.15.175:0/2406056325 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:41.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4df400640 1 --2- 172.21.15.175:0/2406056325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e01453a0 0x7fc4e013fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.837+0000 7fc4d6a00640 1 --2- 172.21.15.175:0/2406056325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e015c410 0x7fc4e0140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.841+0000 7fc4dfe00640 1 -- 172.21.15.175:0/2406056325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e01453a0 msgr2=0x7fc4e013fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.841+0000 7fc4dfe00640 1 --2- 172.21.15.175:0/2406056325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e01453a0 0x7fc4e013fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.841+0000 7fc4dfe00640 1 -- 172.21.15.175:0/2406056325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e015c410 msgr2=0x7fc4e0140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.841+0000 7fc4dfe00640 1 --2- 172.21.15.175:0/2406056325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e015c410 0x7fc4e0140da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.841+0000 7fc4dfe00640 1 -- 172.21.15.175:0/2406056325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e0141620 con 0x7fc4e015ad50 2024-04-25T09:05:41.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.841+0000 7fc4dfe00640 1 --2- 172.21.15.175:0/2406056325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4e015ad50 0x7fc4e015b1b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800e7f0 tx=0x7fc4d800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:41.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.841+0000 7fc4d7e00640 1 -- 172.21.15.175:0/2406056325 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8017070 con 0x7fc4e015ad50 2024-04-25T09:05:41.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.841+0000 7fc4d7e00640 1 -- 172.21.15.175:0/2406056325 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d800c940 con 0x7fc4e015ad50 2024-04-25T09:05:41.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.841+0000 7fc4e6200640 1 -- 172.21.15.175:0/2406056325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e00af270 con 0x7fc4e015ad50 2024-04-25T09:05:41.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.841+0000 7fc4d7e00640 1 -- 172.21.15.175:0/2406056325 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d800eea0 con 0x7fc4e015ad50 2024-04-25T09:05:41.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.841+0000 7fc4e6200640 1 -- 172.21.15.175:0/2406056325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e00af830 con 0x7fc4e015ad50 2024-04-25T09:05:41.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.841+0000 7fc4e6200640 1 -- 172.21.15.175:0/2406056325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e0074a60 con 0x7fc4e015ad50 2024-04-25T09:05:41.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.841+0000 7fc4d7e00640 1 -- 172.21.15.175:0/2406056325 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc4d801a070 con 0x7fc4e015ad50 2024-04-25T09:05:41.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.841+0000 7fc4d7e00640 1 --2- 172.21.15.175:0/2406056325 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc4bc066f60 0x7fc4bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:41.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.841+0000 7fc4d7e00640 1 -- 172.21.15.175:0/2406056325 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc4d8084b20 con 0x7fc4e015ad50 2024-04-25T09:05:41.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.845+0000 7fc4df400640 1 --2- 172.21.15.175:0/2406056325 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc4bc066f60 0x7fc4bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:41.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.845+0000 7fc4df400640 1 --2- 172.21.15.175:0/2406056325 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc4bc066f60 0x7fc4bc069420 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0001ea0 tx=0x7fc4d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:41.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:41.845+0000 7fc4d7e00640 1 -- 172.21.15.175:0/2406056325 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc4d8055820 con 0x7fc4e015ad50 2024-04-25T09:05:41.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.005+0000 7fc4e6200640 1 -- 172.21.15.175:0/2406056325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4e013b9c0 con 0x7fc4e015ad50 2024-04-25T09:05:41.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.005+0000 7fc4d7e00640 1 -- 172.21.15.175:0/2406056325 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+12927 (secure 0 0 0) 0x7fc4d80598c0 con 0x7fc4e015ad50 2024-04-25T09:05:41.996 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:41.996 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":40,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:05:41.279273+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:41.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.009+0000 7fc4e6200640 1 -- 172.21.15.175:0/2406056325 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc4bc066f60 msgr2=0x7fc4bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.009+0000 7fc4e6200640 1 --2- 172.21.15.175:0/2406056325 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc4bc066f60 0x7fc4bc069420 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0001ea0 tx=0x7fc4d0009040 comp rx=0 tx=0).stop 2024-04-25T09:05:41.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.009+0000 7fc4e6200640 1 -- 172.21.15.175:0/2406056325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4e015ad50 msgr2=0x7fc4e015b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:41.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.009+0000 7fc4e6200640 1 --2- 172.21.15.175:0/2406056325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4e015ad50 0x7fc4e015b1b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800e7f0 tx=0x7fc4d800ecb0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.009+0000 7fc4e6200640 1 -- 172.21.15.175:0/2406056325 shutdown_connections 2024-04-25T09:05:41.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.009+0000 7fc4e6200640 1 --2- 172.21.15.175:0/2406056325 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc4bc066f60 0x7fc4bc069420 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.009+0000 7fc4e6200640 1 --2- 172.21.15.175:0/2406056325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4e015ad50 0x7fc4e015b1b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.009+0000 7fc4e6200640 1 --2- 172.21.15.175:0/2406056325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e015c410 0x7fc4e0140da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.009+0000 7fc4e6200640 1 --2- 172.21.15.175:0/2406056325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e01453a0 0x7fc4e013fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:41.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.009+0000 7fc4e6200640 1 -- 172.21.15.175:0/2406056325 >> 172.21.15.175:0/2406056325 conn(0x7fc4e0144fc0 msgr2=0x7fc4e013a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:41.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.009+0000 7fc4e6200640 1 -- 172.21.15.175:0/2406056325 shutdown_connections 2024-04-25T09:05:41.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.009+0000 7fc4e6200640 1 -- 172.21.15.175:0/2406056325 wait complete. 2024-04-25T09:05:42.018 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:05:42.018 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:05:42.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.165+0000 7f2784800640 1 Processor -- start 2024-04-25T09:05:42.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.165+0000 7f2784800640 1 -- start start 2024-04-25T09:05:42.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2784800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f277c0cf6b0 0x7f277c1600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2784800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f277c0ce970 0x7f277c0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2784800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277c0cfd10 con 0x7f277c145250 2024-04-25T09:05:42.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2784800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f277c1605e0 con 0x7f277c0ce970 2024-04-25T09:05:42.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2784800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277c15f650 con 0x7f277c0cf6b0 2024-04-25T09:05:42.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2781e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f277c145250 0x7f277c0cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44724/0 (socket says 172.21.15.175:44724) 2024-04-25T09:05:42.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2781e00640 1 -- 172.21.15.175:0/550562504 learned_addr learned my addr 172.21.15.175:0/550562504 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:42.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2780a00640 1 -- 172.21.15.175:0/550562504 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233630858 0 0) 0x7f277c0cfd10 con 0x7f277c145250 2024-04-25T09:05:42.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2780a00640 1 -- 172.21.15.175:0/550562504 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2764003530 con 0x7f277c145250 2024-04-25T09:05:42.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2781400640 1 --2- 172.21.15.175:0/550562504 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f277c0cf6b0 0x7f277c1600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2782800640 1 --2- 172.21.15.175:0/550562504 >> v2:172.21.15.177:3300/0 conn(0x7f277c0ce970 0x7f277c0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2780a00640 1 -- 172.21.15.175:0/550562504 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3633986644 0 0) 0x7f2764003530 con 0x7f277c145250 2024-04-25T09:05:42.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2780a00640 1 -- 172.21.15.175:0/550562504 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f277c0cf6b0 msgr2=0x7f277c1600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:42.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2780a00640 1 --2- 172.21.15.175:0/550562504 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f277c0cf6b0 0x7f277c1600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2780a00640 1 -- 172.21.15.175:0/550562504 >> v2:172.21.15.177:3300/0 conn(0x7f277c0ce970 msgr2=0x7f277c0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:42.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2780a00640 1 --2- 172.21.15.175:0/550562504 >> v2:172.21.15.177:3300/0 conn(0x7f277c0ce970 0x7f277c0cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2780a00640 1 -- 172.21.15.175:0/550562504 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c0cfff0 con 0x7f277c145250 2024-04-25T09:05:42.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2780a00640 1 -- 172.21.15.175:0/550562504 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f2770001680 con 0x7f277c145250 2024-04-25T09:05:42.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2780a00640 1 -- 172.21.15.175:0/550562504 >> v1:172.21.15.175:6789/0 conn(0x7f277c145250 legacy=0x7f277c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2780a00640 1 --2- 172.21.15.175:0/550562504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27640039c0 0x7f2764003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2780a00640 1 --2- 172.21.15.175:0/550562504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2764004810 0x7f2764004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2780a00640 1 --2- 172.21.15.175:0/550562504 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f277c0cf6b0 0x7f27640051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2780a00640 1 -- 172.21.15.175:0/550562504 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c1605e0 con 0x7f27640039c0 2024-04-25T09:05:42.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2780a00640 1 -- 172.21.15.175:0/550562504 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c15f650 con 0x7f2764004810 2024-04-25T09:05:42.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2780a00640 1 -- 172.21.15.175:0/550562504 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276400bb60 con 0x7f277c0cf6b0 2024-04-25T09:05:42.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2781e00640 1 --2- 172.21.15.175:0/550562504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27640039c0 0x7f2764003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2781400640 1 --2- 172.21.15.175:0/550562504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2764004810 0x7f2764004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2782800640 1 --2- 172.21.15.175:0/550562504 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f277c0cf6b0 0x7f27640051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2781e00640 1 -- 172.21.15.175:0/550562504 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f277c0cf6b0 msgr2=0x7f27640051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:42.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2781e00640 1 --2- 172.21.15.175:0/550562504 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f277c0cf6b0 0x7f27640051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2781e00640 1 -- 172.21.15.175:0/550562504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2764004810 msgr2=0x7f2764004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:42.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2781e00640 1 --2- 172.21.15.175:0/550562504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2764004810 0x7f2764004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2781e00640 1 -- 172.21.15.175:0/550562504 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2764003530 con 0x7f27640039c0 2024-04-25T09:05:42.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.169+0000 7f2781400640 1 --2- 172.21.15.175:0/550562504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2764004810 0x7f2764004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:42.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.173+0000 7f2781e00640 1 --2- 172.21.15.175:0/550562504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27640039c0 0x7f2764003de0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f277000c210 tx=0x7f277001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d417b35971c47b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:42.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.173+0000 7f2780a00640 1 -- 172.21.15.175:0/550562504 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770007d40 con 0x7f27640039c0 2024-04-25T09:05:42.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.173+0000 7f2780a00640 1 -- 172.21.15.175:0/550562504 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27700a9020 con 0x7f27640039c0 2024-04-25T09:05:42.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.173+0000 7f2780a00640 1 -- 172.21.15.175:0/550562504 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2770005b00 con 0x7f27640039c0 2024-04-25T09:05:42.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.173+0000 7f2784800640 1 -- 172.21.15.175:0/550562504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27640039c0 msgr2=0x7f2764003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.173+0000 7f2784800640 1 --2- 172.21.15.175:0/550562504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27640039c0 0x7f2764003de0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f277000c210 tx=0x7f277001cc60 comp rx=0 tx=0).stop 2024-04-25T09:05:42.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.173+0000 7f2782800640 1 -- 172.21.15.175:0/550562504 reap_dead start 2024-04-25T09:05:42.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.173+0000 7f2784800640 1 -- 172.21.15.175:0/550562504 shutdown_connections 2024-04-25T09:05:42.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.173+0000 7f2784800640 1 -- 172.21.15.175:0/550562504 >> 172.21.15.175:0/550562504 conn(0x7f277c06ac50 msgr2=0x7f277c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:42.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.173+0000 7f2784800640 1 -- 172.21.15.175:0/550562504 shutdown_connections 2024-04-25T09:05:42.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.173+0000 7f2784800640 1 -- 172.21.15.175:0/550562504 wait complete. 2024-04-25T09:05:42.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2784800640 1 Processor -- start 2024-04-25T09:05:42.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2784800640 1 -- start start 2024-04-25T09:05:42.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2784800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27640039c0 0x7f277c0a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2784800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f277c0b1dc0 0x7f277c15df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2784800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f277c0a9e30 0x7f277c13e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2784800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c15c870 con 0x7f277c0a9e30 2024-04-25T09:05:42.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2784800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277c145630 con 0x7f277c0b1dc0 2024-04-25T09:05:42.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2784800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277c15c9f0 con 0x7f27640039c0 2024-04-25T09:05:42.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2782800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f277c0a9e30 0x7f277c13e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2782800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f277c0a9e30 0x7f277c13e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50634/0 (socket says 172.21.15.175:50634) 2024-04-25T09:05:42.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2782800640 1 -- 172.21.15.175:0/2006151339 learned_addr learned my addr 172.21.15.175:0/2006151339 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:42.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2781e00640 1 --2- 172.21.15.175:0/2006151339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27640039c0 0x7f277c0a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2781400640 1 --2- 172.21.15.175:0/2006151339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f277c0b1dc0 0x7f277c15df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2782800640 1 -- 172.21.15.175:0/2006151339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27640039c0 msgr2=0x7f277c0a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2782800640 1 --2- 172.21.15.175:0/2006151339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27640039c0 0x7f277c0a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2782800640 1 -- 172.21.15.175:0/2006151339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f277c0b1dc0 msgr2=0x7f277c15df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2782800640 1 --2- 172.21.15.175:0/2006151339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f277c0b1dc0 0x7f277c15df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2782800640 1 -- 172.21.15.175:0/2006151339 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c0a8d90 con 0x7f277c0a9e30 2024-04-25T09:05:42.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2781400640 1 --2- 172.21.15.175:0/2006151339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f277c0b1dc0 0x7f277c15df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:42.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2782800640 1 --2- 172.21.15.175:0/2006151339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f277c0a9e30 0x7f277c13e7d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f277c0b26f0 tx=0x7f2778007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:42.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2776000640 1 -- 172.21.15.175:0/2006151339 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778014410 con 0x7f277c0a9e30 2024-04-25T09:05:42.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2776000640 1 -- 172.21.15.175:0/2006151339 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2778019070 con 0x7f277c0a9e30 2024-04-25T09:05:42.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2776000640 1 -- 172.21.15.175:0/2006151339 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778014810 con 0x7f277c0a9e30 2024-04-25T09:05:42.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2784800640 1 -- 172.21.15.175:0/2006151339 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277c0a9070 con 0x7f277c0a9e30 2024-04-25T09:05:42.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2784800640 1 -- 172.21.15.175:0/2006151339 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277c0a9630 con 0x7f277c0a9e30 2024-04-25T09:05:42.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.177+0000 7f2784800640 1 -- 172.21.15.175:0/2006151339 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277c075160 con 0x7f277c0a9e30 2024-04-25T09:05:42.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.181+0000 7f2776000640 1 -- 172.21.15.175:0/2006151339 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f27780149b0 con 0x7f277c0a9e30 2024-04-25T09:05:42.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.181+0000 7f2776000640 1 --2- 172.21.15.175:0/2006151339 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2760066f60 0x7f2760069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.181+0000 7f2776000640 1 -- 172.21.15.175:0/2006151339 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2778085070 con 0x7f277c0a9e30 2024-04-25T09:05:42.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.181+0000 7f2781e00640 1 --2- 172.21.15.175:0/2006151339 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2760066f60 0x7f2760069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.181+0000 7f2781e00640 1 --2- 172.21.15.175:0/2006151339 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2760066f60 0x7f2760069420 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f27700aa000 tx=0x7f277c0ce200 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:42.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.185+0000 7f2776000640 1 -- 172.21.15.175:0/2006151339 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2778056460 con 0x7f277c0a9e30 2024-04-25T09:05:42.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.341+0000 7f2784800640 1 -- 172.21.15.175:0/2006151339 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f277c144750 con 0x7f277c0a9e30 2024-04-25T09:05:42.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.341+0000 7f2776000640 1 -- 172.21.15.175:0/2006151339 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2778055d60 con 0x7f277c0a9e30 2024-04-25T09:05:42.331 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:05:42.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.341+0000 7f2784800640 1 -- 172.21.15.175:0/2006151339 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2760066f60 msgr2=0x7f2760069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.341+0000 7f2784800640 1 --2- 172.21.15.175:0/2006151339 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2760066f60 0x7f2760069420 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f27700aa000 tx=0x7f277c0ce200 comp rx=0 tx=0).stop 2024-04-25T09:05:42.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.341+0000 7f2784800640 1 -- 172.21.15.175:0/2006151339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f277c0a9e30 msgr2=0x7f277c13e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.341+0000 7f2784800640 1 --2- 172.21.15.175:0/2006151339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f277c0a9e30 0x7f277c13e7d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f277c0b26f0 tx=0x7f2778007700 comp rx=0 tx=0).stop 2024-04-25T09:05:42.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.341+0000 7f2784800640 1 -- 172.21.15.175:0/2006151339 shutdown_connections 2024-04-25T09:05:42.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.341+0000 7f2784800640 1 --2- 172.21.15.175:0/2006151339 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2760066f60 0x7f2760069420 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.341+0000 7f2784800640 1 --2- 172.21.15.175:0/2006151339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f277c0a9e30 0x7f277c13e7d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.341+0000 7f2784800640 1 --2- 172.21.15.175:0/2006151339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f277c0b1dc0 0x7f277c15df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.341+0000 7f2784800640 1 --2- 172.21.15.175:0/2006151339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27640039c0 0x7f277c0a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.341+0000 7f2784800640 1 -- 172.21.15.175:0/2006151339 >> 172.21.15.175:0/2006151339 conn(0x7f277c06ac50 msgr2=0x7f277c1617d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:42.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.341+0000 7f2784800640 1 -- 172.21.15.175:0/2006151339 shutdown_connections 2024-04-25T09:05:42.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.341+0000 7f2784800640 1 -- 172.21.15.175:0/2006151339 wait complete. 2024-04-25T09:05:42.352 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:05:42.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.497+0000 7fbb38200640 1 Processor -- start 2024-04-25T09:05:42.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.497+0000 7fbb38200640 1 -- start start 2024-04-25T09:05:42.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.501+0000 7fbb38200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb300aeb30 0x7fbb30071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.501+0000 7fbb38200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbb30071780 0x7fbb3006de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.501+0000 7fbb38200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbb3006e340 0x7fbb3015db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.501+0000 7fbb38200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb30071be0 con 0x7fbb30071780 2024-04-25T09:05:42.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.501+0000 7fbb38200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb300b2a70 con 0x7fbb3006e340 2024-04-25T09:05:42.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.501+0000 7fbb38200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3006eba0 con 0x7fbb300aeb30 2024-04-25T09:05:42.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.501+0000 7fbb34e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbb30071780 0x7fbb3006de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.501+0000 7fbb34e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbb30071780 0x7fbb3006de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50646/0 (socket says 172.21.15.175:50646) 2024-04-25T09:05:42.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.501+0000 7fbb34e00640 1 -- 172.21.15.175:0/151467845 learned_addr learned my addr 172.21.15.175:0/151467845 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:42.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.501+0000 7fbb35800640 1 --2- 172.21.15.175:0/151467845 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb300aeb30 0x7fbb30071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.501+0000 7fbb36200640 1 --2- 172.21.15.175:0/151467845 >> v2:172.21.15.177:3300/0 conn(0x7fbb3006e340 0x7fbb3015db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.501+0000 7fbb34e00640 1 -- 172.21.15.175:0/151467845 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb300aeb30 msgr2=0x7fbb30071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:42.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.501+0000 7fbb34e00640 1 --2- 172.21.15.175:0/151467845 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb300aeb30 0x7fbb30071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.501+0000 7fbb34e00640 1 -- 172.21.15.175:0/151467845 >> v2:172.21.15.177:3300/0 conn(0x7fbb3006e340 msgr2=0x7fbb3015db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:42.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.501+0000 7fbb34e00640 1 --2- 172.21.15.175:0/151467845 >> v2:172.21.15.177:3300/0 conn(0x7fbb3006e340 0x7fbb3015db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.501+0000 7fbb34e00640 1 -- 172.21.15.175:0/151467845 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3006ee80 con 0x7fbb30071780 2024-04-25T09:05:42.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.501+0000 7fbb36200640 1 --2- 172.21.15.175:0/151467845 >> v2:172.21.15.177:3300/0 conn(0x7fbb3006e340 0x7fbb3015db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:42.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.505+0000 7fbb34e00640 1 --2- 172.21.15.175:0/151467845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb30071780 0x7fbb3006de00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbb300d0430 tx=0x7fbb1c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb22e371127bf285 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:42.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.505+0000 7fbb2fe00640 1 -- 172.21.15.175:0/151467845 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c0ab680 con 0x7fbb30071780 2024-04-25T09:05:42.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.505+0000 7fbb2fe00640 1 -- 172.21.15.175:0/151467845 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c0b0070 con 0x7fbb30071780 2024-04-25T09:05:42.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.505+0000 7fbb2fe00640 1 -- 172.21.15.175:0/151467845 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c0aba40 con 0x7fbb30071780 2024-04-25T09:05:42.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.505+0000 7fbb38200640 1 -- 172.21.15.175:0/151467845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb30071780 msgr2=0x7fbb3006de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.505+0000 7fbb38200640 1 --2- 172.21.15.175:0/151467845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb30071780 0x7fbb3006de00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbb300d0430 tx=0x7fbb1c01c520 comp rx=0 tx=0).stop 2024-04-25T09:05:42.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.505+0000 7fbb38200640 1 -- 172.21.15.175:0/151467845 shutdown_connections 2024-04-25T09:05:42.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.505+0000 7fbb38200640 1 --2- 172.21.15.175:0/151467845 >> v2:172.21.15.177:3300/0 conn(0x7fbb3006e340 0x7fbb3015db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.505+0000 7fbb38200640 1 --2- 172.21.15.175:0/151467845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb30071780 0x7fbb3006de00 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.505+0000 7fbb38200640 1 --2- 172.21.15.175:0/151467845 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb300aeb30 0x7fbb30071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.505+0000 7fbb38200640 1 -- 172.21.15.175:0/151467845 >> 172.21.15.175:0/151467845 conn(0x7fbb30067150 msgr2=0x7fbb3006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:42.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.505+0000 7fbb38200640 1 -- 172.21.15.175:0/151467845 shutdown_connections 2024-04-25T09:05:42.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.505+0000 7fbb38200640 1 -- 172.21.15.175:0/151467845 wait complete. 2024-04-25T09:05:42.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.505+0000 7fbb38200640 1 Processor -- start 2024-04-25T09:05:42.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.505+0000 7fbb38200640 1 -- start start 2024-04-25T09:05:42.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb38200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb30071780 0x7fbb300b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb38200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb300aeb30 0x7fbb300af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb38200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb300af730 0x7fbb30139f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb38200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3015e0a0 con 0x7fbb300af730 2024-04-25T09:05:42.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb38200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3006e960 con 0x7fbb300aeb30 2024-04-25T09:05:42.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb38200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3015e220 con 0x7fbb30071780 2024-04-25T09:05:42.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb36200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb300af730 0x7fbb30139f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb35800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb30071780 0x7fbb300b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb36200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb300af730 0x7fbb30139f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50650/0 (socket says 172.21.15.175:50650) 2024-04-25T09:05:42.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb36200640 1 -- 172.21.15.175:0/670448065 learned_addr learned my addr 172.21.15.175:0/670448065 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:42.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb34e00640 1 --2- 172.21.15.175:0/670448065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb300aeb30 0x7fbb300af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb36200640 1 -- 172.21.15.175:0/670448065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb30071780 msgr2=0x7fbb300b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb36200640 1 --2- 172.21.15.175:0/670448065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb30071780 0x7fbb300b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb36200640 1 -- 172.21.15.175:0/670448065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb300aeb30 msgr2=0x7fbb300af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb36200640 1 --2- 172.21.15.175:0/670448065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb300aeb30 0x7fbb300af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb36200640 1 -- 172.21.15.175:0/670448065 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb300afcb0 con 0x7fbb300af730 2024-04-25T09:05:42.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb36200640 1 --2- 172.21.15.175:0/670448065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb300af730 0x7fbb30139f50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009fd0 tx=0x7fbb2800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:42.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb2d600640 1 -- 172.21.15.175:0/670448065 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2801a070 con 0x7fbb300af730 2024-04-25T09:05:42.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb2d600640 1 -- 172.21.15.175:0/670448065 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb28003bc0 con 0x7fbb300af730 2024-04-25T09:05:42.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb2d600640 1 -- 172.21.15.175:0/670448065 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb28004030 con 0x7fbb300af730 2024-04-25T09:05:42.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb38200640 1 -- 172.21.15.175:0/670448065 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb300aff90 con 0x7fbb300af730 2024-04-25T09:05:42.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb38200640 1 -- 172.21.15.175:0/670448065 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb300b0550 con 0x7fbb300af730 2024-04-25T09:05:42.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb38200640 1 -- 172.21.15.175:0/670448065 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb30074a60 con 0x7fbb300af730 2024-04-25T09:05:42.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.509+0000 7fbb2d600640 1 -- 172.21.15.175:0/670448065 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbb2801d070 con 0x7fbb300af730 2024-04-25T09:05:42.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.513+0000 7fbb2d600640 1 --2- 172.21.15.175:0/670448065 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbb10066f60 0x7fbb10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.513+0000 7fbb2d600640 1 -- 172.21.15.175:0/670448065 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbb28084ff0 con 0x7fbb300af730 2024-04-25T09:05:42.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.513+0000 7fbb35800640 1 --2- 172.21.15.175:0/670448065 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbb10066f60 0x7fbb10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.513+0000 7fbb35800640 1 --2- 172.21.15.175:0/670448065 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbb10066f60 0x7fbb10069420 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009a40 tx=0x7fbb24009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:42.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.517+0000 7fbb2d600640 1 -- 172.21.15.175:0/670448065 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbb28010070 con 0x7fbb300af730 2024-04-25T09:05:42.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.669+0000 7fbb38200640 1 -- 172.21.15.175:0/670448065 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbb3006c220 con 0x7fbb300af730 2024-04-25T09:05:42.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.669+0000 7fbb2d600640 1 -- 172.21.15.175:0/670448065 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) v1 ==== 84+0+65 (secure 0 0 0) 0x7fbb28055d10 con 0x7fbb300af730 2024-04-25T09:05:42.661 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:42.661 INFO:teuthology.orchestra.run.smithi175.stdout:[ 2024-04-25T09:05:42.661 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:42.661 INFO:teuthology.orchestra.run.smithi175.stdout: "poolnum": 1, 2024-04-25T09:05:42.661 INFO:teuthology.orchestra.run.smithi175.stdout: "poolname": ".mgr" 2024-04-25T09:05:42.661 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:42.661 INFO:teuthology.orchestra.run.smithi175.stdout:] 2024-04-25T09:05:42.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.673+0000 7fbb38200640 1 -- 172.21.15.175:0/670448065 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbb10066f60 msgr2=0x7fbb10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.673+0000 7fbb38200640 1 --2- 172.21.15.175:0/670448065 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbb10066f60 0x7fbb10069420 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009a40 tx=0x7fbb24009190 comp rx=0 tx=0).stop 2024-04-25T09:05:42.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.673+0000 7fbb38200640 1 -- 172.21.15.175:0/670448065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb300af730 msgr2=0x7fbb30139f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.673+0000 7fbb38200640 1 --2- 172.21.15.175:0/670448065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb300af730 0x7fbb30139f50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009fd0 tx=0x7fbb2800d560 comp rx=0 tx=0).stop 2024-04-25T09:05:42.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.673+0000 7fbb38200640 1 -- 172.21.15.175:0/670448065 shutdown_connections 2024-04-25T09:05:42.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.673+0000 7fbb38200640 1 --2- 172.21.15.175:0/670448065 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbb10066f60 0x7fbb10069420 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.673+0000 7fbb38200640 1 --2- 172.21.15.175:0/670448065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb300af730 0x7fbb30139f50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.673+0000 7fbb38200640 1 --2- 172.21.15.175:0/670448065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb300aeb30 0x7fbb300af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.673+0000 7fbb38200640 1 --2- 172.21.15.175:0/670448065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb30071780 0x7fbb300b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.673+0000 7fbb38200640 1 -- 172.21.15.175:0/670448065 >> 172.21.15.175:0/670448065 conn(0x7fbb3006e340 msgr2=0x7fbb3015a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:42.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.673+0000 7fbb38200640 1 -- 172.21.15.175:0/670448065 shutdown_connections 2024-04-25T09:05:42.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.673+0000 7fbb38200640 1 -- 172.21.15.175:0/670448065 wait complete. 2024-04-25T09:05:42.681 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:05:42.681 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:05:42.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.829+0000 7f8dfac00640 1 Processor -- start 2024-04-25T09:05:42.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.829+0000 7f8dfac00640 1 -- start start 2024-04-25T09:05:42.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.833+0000 7f8dfac00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8df40712b0 0x7f8df4071740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.833+0000 7f8dfac00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df4071e20 con 0x7f8df406d860 2024-04-25T09:05:42.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.833+0000 7f8dfac00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df4072100 con 0x7f8df40cfb60 2024-04-25T09:05:42.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.833+0000 7f8dfac00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df40cbed0 con 0x7f8df40712b0 2024-04-25T09:05:42.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.833+0000 7f8df8c00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f8df406d860 0x7f8df40cc920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44740/0 (socket says 172.21.15.175:44740) 2024-04-25T09:05:42.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.833+0000 7f8df8c00640 1 -- 172.21.15.175:0/3969007805 learned_addr learned my addr 172.21.15.175:0/3969007805 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:42.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.833+0000 7f8deb400640 1 --2- 172.21.15.175:0/3969007805 >> v2:172.21.15.177:3300/0 conn(0x7f8df40712b0 0x7f8df4071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.833+0000 7f8df3400640 1 -- 172.21.15.175:0/3969007805 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72823620 0 0) 0x7f8df4071e20 con 0x7f8df406d860 2024-04-25T09:05:42.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.833+0000 7f8df3400640 1 -- 172.21.15.175:0/3969007805 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dd8003530 con 0x7f8df406d860 2024-04-25T09:05:42.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.833+0000 7f8deb400640 1 -- 172.21.15.175:0/3969007805 >> v1:172.21.15.177:6789/0 conn(0x7f8df40cfb60 legacy=0x7f8df40ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.833+0000 7f8deb400640 1 -- 172.21.15.175:0/3969007805 >> v1:172.21.15.175:6789/0 conn(0x7f8df406d860 legacy=0x7f8df40cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.833+0000 7f8df3400640 1 -- 172.21.15.175:0/3969007805 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2525279872 0 0) 0x7f8dd8003530 con 0x7f8df406d860 2024-04-25T09:05:42.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.833+0000 7f8deb400640 1 -- 172.21.15.175:0/3969007805 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df40cc120 con 0x7f8df40712b0 2024-04-25T09:05:42.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.837+0000 7f8deb400640 1 --2- 172.21.15.175:0/3969007805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8df40712b0 0x7f8df4071740 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0097c0 tx=0x7f8ddc01c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c3599f215480360 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:42.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.837+0000 7f8df3400640 1 -- 172.21.15.175:0/3969007805 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc0b0070 con 0x7f8df40712b0 2024-04-25T09:05:42.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.837+0000 7f8df3400640 1 -- 172.21.15.175:0/3969007805 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ddc0ab400 con 0x7f8df40712b0 2024-04-25T09:05:42.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.837+0000 7f8df3400640 1 -- 172.21.15.175:0/3969007805 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec001a00 con 0x7f8df40712b0 2024-04-25T09:05:42.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.837+0000 7f8dfac00640 1 -- 172.21.15.175:0/3969007805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8df40712b0 msgr2=0x7f8df4071740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.837+0000 7f8dfac00640 1 --2- 172.21.15.175:0/3969007805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8df40712b0 0x7f8df4071740 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0097c0 tx=0x7f8ddc01c300 comp rx=0 tx=0).stop 2024-04-25T09:05:42.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.837+0000 7f8dfac00640 1 -- 172.21.15.175:0/3969007805 shutdown_connections 2024-04-25T09:05:42.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.837+0000 7f8dfac00640 1 --2- 172.21.15.175:0/3969007805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8df40712b0 0x7f8df4071740 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.837+0000 7f8dfac00640 1 -- 172.21.15.175:0/3969007805 >> 172.21.15.175:0/3969007805 conn(0x7f8df406ac50 msgr2=0x7f8df406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:42.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.837+0000 7f8dfac00640 1 -- 172.21.15.175:0/3969007805 shutdown_connections 2024-04-25T09:05:42.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.837+0000 7f8dfac00640 1 -- 172.21.15.175:0/3969007805 wait complete. 2024-04-25T09:05:42.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.837+0000 7f8dfac00640 1 Processor -- start 2024-04-25T09:05:42.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.837+0000 7f8dfac00640 1 -- start start 2024-04-25T09:05:42.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8dfac00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8df406d860 0x7f8df415d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8dfac00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8df40712b0 0x7f8df415b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8dfac00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8df40cfb60 0x7f8df40b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8dfac00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40d00c0 con 0x7f8df406d860 2024-04-25T09:05:42.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8dfac00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40cff40 con 0x7f8df40cfb60 2024-04-25T09:05:42.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8dfac00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40ceee0 con 0x7f8df40712b0 2024-04-25T09:05:42.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8df3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8df406d860 0x7f8df415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8df3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8df406d860 0x7f8df415d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50660/0 (socket says 172.21.15.175:50660) 2024-04-25T09:05:42.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8df3e00640 1 -- 172.21.15.175:0/2629298975 learned_addr learned my addr 172.21.15.175:0/2629298975 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:42.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8deb400640 1 --2- 172.21.15.175:0/2629298975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8df40712b0 0x7f8df415b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8df8c00640 1 --2- 172.21.15.175:0/2629298975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8df40cfb60 0x7f8df40b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8df3e00640 1 -- 172.21.15.175:0/2629298975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8df40712b0 msgr2=0x7f8df415b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8df3e00640 1 --2- 172.21.15.175:0/2629298975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8df40712b0 0x7f8df415b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8df3e00640 1 -- 172.21.15.175:0/2629298975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8df40cfb60 msgr2=0x7f8df40b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:42.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8df3e00640 1 --2- 172.21.15.175:0/2629298975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8df40cfb60 0x7f8df40b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:42.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8df3e00640 1 -- 172.21.15.175:0/2629298975 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df40b3ac0 con 0x7f8df406d860 2024-04-25T09:05:42.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8deb400640 1 --2- 172.21.15.175:0/2629298975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8df40712b0 0x7f8df415b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:42.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8df8c00640 1 --2- 172.21.15.175:0/2629298975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8df40cfb60 0x7f8df40b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:42.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8df3e00640 1 --2- 172.21.15.175:0/2629298975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8df406d860 0x7f8df415d310 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8de400c530 tx=0x7f8de400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:42.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8df0c00640 1 -- 172.21.15.175:0/2629298975 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de4016020 con 0x7f8df406d860 2024-04-25T09:05:42.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8df0c00640 1 -- 172.21.15.175:0/2629298975 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de4005220 con 0x7f8df406d860 2024-04-25T09:05:42.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8dfac00640 1 -- 172.21.15.175:0/2629298975 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df40b3da0 con 0x7f8df406d860 2024-04-25T09:05:42.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8df0c00640 1 -- 172.21.15.175:0/2629298975 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de4007030 con 0x7f8df406d860 2024-04-25T09:05:42.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8dfac00640 1 -- 172.21.15.175:0/2629298975 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df40b4360 con 0x7f8df406d860 2024-04-25T09:05:42.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8dfac00640 1 -- 172.21.15.175:0/2629298975 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df4075160 con 0x7f8df406d860 2024-04-25T09:05:42.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.841+0000 7f8df0c00640 1 -- 172.21.15.175:0/2629298975 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8de40071d0 con 0x7f8df406d860 2024-04-25T09:05:42.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.845+0000 7f8df0c00640 1 --2- 172.21.15.175:0/2629298975 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8dd0066f60 0x7f8dd0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:42.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.845+0000 7f8df0c00640 1 -- 172.21.15.175:0/2629298975 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8de4084710 con 0x7f8df406d860 2024-04-25T09:05:42.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.845+0000 7f8deb400640 1 --2- 172.21.15.175:0/2629298975 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8dd0066f60 0x7f8dd0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:42.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.845+0000 7f8deb400640 1 --2- 172.21.15.175:0/2629298975 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8dd0066f60 0x7f8dd0069420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0ad000 tx=0x7f8ddc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:42.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:42.849+0000 7f8df0c00640 1 -- 172.21.15.175:0/2629298975 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8de4020020 con 0x7f8df406d860 2024-04-25T09:05:42.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:43.005+0000 7f8dfac00640 1 -- 172.21.15.175:0/2629298975 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8df415f320 con 0x7f8df406d860 2024-04-25T09:05:43.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:43.937+0000 7f8df0c00640 1 -- 172.21.15.175:0/2629298975 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8de40074c0 con 0x7f8df406d860 2024-04-25T09:05:43.928 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_metadata' created 2024-04-25T09:05:43.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:43.941+0000 7f8dfac00640 1 -- 172.21.15.175:0/2629298975 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8dd0066f60 msgr2=0x7f8dd0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:43.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:43.941+0000 7f8dfac00640 1 --2- 172.21.15.175:0/2629298975 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8dd0066f60 0x7f8dd0069420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0ad000 tx=0x7f8ddc008040 comp rx=0 tx=0).stop 2024-04-25T09:05:43.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:43.941+0000 7f8dfac00640 1 -- 172.21.15.175:0/2629298975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8df406d860 msgr2=0x7f8df415d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:43.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:43.941+0000 7f8dfac00640 1 --2- 172.21.15.175:0/2629298975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8df406d860 0x7f8df415d310 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8de400c530 tx=0x7f8de400c9f0 comp rx=0 tx=0).stop 2024-04-25T09:05:43.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:43.941+0000 7f8dfac00640 1 -- 172.21.15.175:0/2629298975 shutdown_connections 2024-04-25T09:05:43.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:43.941+0000 7f8dfac00640 1 --2- 172.21.15.175:0/2629298975 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8dd0066f60 0x7f8dd0069420 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:43.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:43.941+0000 7f8dfac00640 1 --2- 172.21.15.175:0/2629298975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8df40cfb60 0x7f8df40b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:43.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:43.941+0000 7f8dfac00640 1 --2- 172.21.15.175:0/2629298975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8df40712b0 0x7f8df415b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:43.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:43.941+0000 7f8dfac00640 1 --2- 172.21.15.175:0/2629298975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8df406d860 0x7f8df415d310 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:43.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:43.941+0000 7f8dfac00640 1 -- 172.21.15.175:0/2629298975 >> 172.21.15.175:0/2629298975 conn(0x7f8df406ac50 msgr2=0x7f8df4143a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:43.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:43.941+0000 7f8dfac00640 1 -- 172.21.15.175:0/2629298975 shutdown_connections 2024-04-25T09:05:43.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:43.941+0000 7f8dfac00640 1 -- 172.21.15.175:0/2629298975 wait complete. 2024-04-25T09:05:43.959 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:05:44.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70dc000640 1 Processor -- start 2024-04-25T09:05:44.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70dc000640 1 -- start start 2024-04-25T09:05:44.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70dc000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f70d40b4710 0x7f70d415ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:44.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70dc000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d40b3660 con 0x7f70d415de90 2024-04-25T09:05:44.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70dc000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d40b28a0 con 0x7f70d40ae9c0 2024-04-25T09:05:44.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70dc000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d40b2b80 con 0x7f70d40b4710 2024-04-25T09:05:44.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d9600640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f70d415de90 0x7f70d40b4000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44756/0 (socket says 172.21.15.175:44756) 2024-04-25T09:05:44.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d9600640 1 -- 172.21.15.175:0/2721699419 learned_addr learned my addr 172.21.15.175:0/2721699419 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:44.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d8c00640 1 --2- 172.21.15.175:0/2721699419 >> v2:172.21.15.177:3300/0 conn(0x7f70d40b4710 0x7f70d415ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:44.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d3e00640 1 -- 172.21.15.175:0/2721699419 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646567530 0 0) 0x7f70d40b3660 con 0x7f70d415de90 2024-04-25T09:05:44.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d3e00640 1 -- 172.21.15.175:0/2721699419 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70bc003530 con 0x7f70d415de90 2024-04-25T09:05:44.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d3e00640 1 -- 172.21.15.175:0/2721699419 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1542990322 0 0) 0x7f70bc003530 con 0x7f70d415de90 2024-04-25T09:05:44.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d3e00640 1 -- 172.21.15.175:0/2721699419 >> v2:172.21.15.177:3300/0 conn(0x7f70d40b4710 msgr2=0x7f70d415ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:44.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d3e00640 1 --2- 172.21.15.175:0/2721699419 >> v2:172.21.15.177:3300/0 conn(0x7f70d40b4710 0x7f70d415ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d3e00640 1 -- 172.21.15.175:0/2721699419 >> v1:172.21.15.177:6789/0 conn(0x7f70d40ae9c0 legacy=0x7f70d40cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:44.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d3e00640 1 -- 172.21.15.175:0/2721699419 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d40b2e60 con 0x7f70d415de90 2024-04-25T09:05:44.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d3e00640 1 -- 172.21.15.175:0/2721699419 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f70c8001680 con 0x7f70d415de90 2024-04-25T09:05:44.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d3e00640 1 -- 172.21.15.175:0/2721699419 >> v1:172.21.15.175:6789/0 conn(0x7f70d415de90 legacy=0x7f70d40b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:44.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d3e00640 1 --2- 172.21.15.175:0/2721699419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70bc0039c0 0x7f70bc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:44.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d3e00640 1 --2- 172.21.15.175:0/2721699419 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70bc0043c0 0x7f70bc004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:44.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d3e00640 1 --2- 172.21.15.175:0/2721699419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70bc005130 0x7f70bc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:44.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d3e00640 1 -- 172.21.15.175:0/2721699419 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d40b2b80 con 0x7f70bc005130 2024-04-25T09:05:44.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d3e00640 1 -- 172.21.15.175:0/2721699419 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc00c070 con 0x7f70bc0039c0 2024-04-25T09:05:44.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d3e00640 1 -- 172.21.15.175:0/2721699419 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc00e480 con 0x7f70bc0043c0 2024-04-25T09:05:44.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70da000640 1 --2- 172.21.15.175:0/2721699419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70bc005130 0x7f70bc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:44.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d9600640 1 --2- 172.21.15.175:0/2721699419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70bc0039c0 0x7f70bc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:44.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70d8c00640 1 --2- 172.21.15.175:0/2721699419 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70bc0043c0 0x7f70bc004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:44.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70da000640 1 -- 172.21.15.175:0/2721699419 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70bc0043c0 msgr2=0x7f70bc004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:44.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70da000640 1 --2- 172.21.15.175:0/2721699419 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70bc0043c0 0x7f70bc004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70da000640 1 -- 172.21.15.175:0/2721699419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70bc0039c0 msgr2=0x7f70bc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:44.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70da000640 1 --2- 172.21.15.175:0/2721699419 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70bc0039c0 0x7f70bc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.117+0000 7f70da000640 1 -- 172.21.15.175:0/2721699419 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70bc003530 con 0x7f70bc005130 2024-04-25T09:05:44.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.121+0000 7f70da000640 1 -- 172.21.15.175:0/2721699419 reap_dead start 2024-04-25T09:05:44.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.121+0000 7f70da000640 1 --2- 172.21.15.175:0/2721699419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70bc005130 0x7f70bc00b9d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f70cc001f60 tx=0x7f70cc01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3384a47dc484be91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:44.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.121+0000 7f70d3e00640 1 -- 172.21.15.175:0/2721699419 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc001b60 con 0x7f70bc005130 2024-04-25T09:05:44.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.121+0000 7f70d3e00640 1 -- 172.21.15.175:0/2721699419 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc003b80 con 0x7f70bc005130 2024-04-25T09:05:44.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.121+0000 7f70d3e00640 1 -- 172.21.15.175:0/2721699419 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc0050d0 con 0x7f70bc005130 2024-04-25T09:05:44.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.121+0000 7f70dc000640 1 -- 172.21.15.175:0/2721699419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70bc005130 msgr2=0x7f70bc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:44.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.121+0000 7f70dc000640 1 --2- 172.21.15.175:0/2721699419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70bc005130 0x7f70bc00b9d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f70cc001f60 tx=0x7f70cc01c880 comp rx=0 tx=0).stop 2024-04-25T09:05:44.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.121+0000 7f70dc000640 1 -- 172.21.15.175:0/2721699419 shutdown_connections 2024-04-25T09:05:44.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.121+0000 7f70dc000640 1 --2- 172.21.15.175:0/2721699419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70bc005130 0x7f70bc00b9d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.121+0000 7f70dc000640 1 -- 172.21.15.175:0/2721699419 >> 172.21.15.175:0/2721699419 conn(0x7f70d406ac50 msgr2=0x7f70d406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:44.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.121+0000 7f70dc000640 1 -- 172.21.15.175:0/2721699419 shutdown_connections 2024-04-25T09:05:44.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.121+0000 7f70dc000640 1 -- 172.21.15.175:0/2721699419 wait complete. 2024-04-25T09:05:44.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70dc000640 1 Processor -- start 2024-04-25T09:05:44.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70dc000640 1 -- start start 2024-04-25T09:05:44.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70dc000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70bc005130 0x7f70d415a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:44.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70dc000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70d40afc80 0x7f70d4138ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:44.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70dc000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70d415afb0 0x7f70d415b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:44.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70dc000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d415ee20 con 0x7f70d40afc80 2024-04-25T09:05:44.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70dc000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d40ce860 con 0x7f70bc005130 2024-04-25T09:05:44.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70dc000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d415efa0 con 0x7f70d415afb0 2024-04-25T09:05:44.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70d8c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70d40afc80 0x7f70d4138ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:44.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70d8c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70d40afc80 0x7f70d4138ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50684/0 (socket says 172.21.15.175:50684) 2024-04-25T09:05:44.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70d8c00640 1 -- 172.21.15.175:0/3984605494 learned_addr learned my addr 172.21.15.175:0/3984605494 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:44.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70d9600640 1 --2- 172.21.15.175:0/3984605494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70bc005130 0x7f70d415a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:44.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70da000640 1 --2- 172.21.15.175:0/3984605494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70d415afb0 0x7f70d415b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:44.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70d8c00640 1 -- 172.21.15.175:0/3984605494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70d415afb0 msgr2=0x7f70d415b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:44.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70d8c00640 1 --2- 172.21.15.175:0/3984605494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70d415afb0 0x7f70d415b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70d8c00640 1 -- 172.21.15.175:0/3984605494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70bc005130 msgr2=0x7f70d415a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:44.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70d8c00640 1 --2- 172.21.15.175:0/3984605494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70bc005130 0x7f70d415a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70d8c00640 1 -- 172.21.15.175:0/3984605494 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d41599b0 con 0x7f70d40afc80 2024-04-25T09:05:44.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70d8c00640 1 --2- 172.21.15.175:0/3984605494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70d40afc80 0x7f70d4138ef0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f70c0011990 tx=0x7f70c0011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:44.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70d1600640 1 -- 172.21.15.175:0/3984605494 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c000fa30 con 0x7f70d40afc80 2024-04-25T09:05:44.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70d1600640 1 -- 172.21.15.175:0/3984605494 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c000fbd0 con 0x7f70d40afc80 2024-04-25T09:05:44.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70d1600640 1 -- 172.21.15.175:0/3984605494 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c0014440 con 0x7f70d40afc80 2024-04-25T09:05:44.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70dc000640 1 -- 172.21.15.175:0/3984605494 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d40b01f0 con 0x7f70d40afc80 2024-04-25T09:05:44.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70dc000640 1 -- 172.21.15.175:0/3984605494 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d40b07b0 con 0x7f70d40afc80 2024-04-25T09:05:44.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.125+0000 7f70dc000640 1 -- 172.21.15.175:0/3984605494 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d4074a60 con 0x7f70d40afc80 2024-04-25T09:05:44.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.129+0000 7f70d1600640 1 -- 172.21.15.175:0/3984605494 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f70c0012040 con 0x7f70d40afc80 2024-04-25T09:05:44.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.129+0000 7f70d1600640 1 --2- 172.21.15.175:0/3984605494 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f70b4066f60 0x7f70b4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:44.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.129+0000 7f70d1600640 1 -- 172.21.15.175:0/3984605494 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f70c0085340 con 0x7f70d40afc80 2024-04-25T09:05:44.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.129+0000 7f70d9600640 1 --2- 172.21.15.175:0/3984605494 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f70b4066f60 0x7f70b4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:44.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.129+0000 7f70d9600640 1 --2- 172.21.15.175:0/3984605494 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f70b4066f60 0x7f70b4069420 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f70c8000c10 tx=0x7f70c8000ee0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:44.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.133+0000 7f70d1600640 1 -- 172.21.15.175:0/3984605494 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f70c0019030 con 0x7f70d40afc80 2024-04-25T09:05:44.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.285+0000 7f70dc000640 1 -- 172.21.15.175:0/3984605494 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f70d406e6a0 con 0x7f70d40afc80 2024-04-25T09:05:44.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.941+0000 7f70d1600640 1 -- 172.21.15.175:0/3984605494 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v42) v1 ==== 170+0+0 (secure 0 0 0) 0x7f70c0056490 con 0x7f70d40afc80 2024-04-25T09:05:44.931 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_data' created 2024-04-25T09:05:44.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.945+0000 7f70dc000640 1 -- 172.21.15.175:0/3984605494 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f70b4066f60 msgr2=0x7f70b4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:44.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.945+0000 7f70dc000640 1 --2- 172.21.15.175:0/3984605494 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f70b4066f60 0x7f70b4069420 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f70c8000c10 tx=0x7f70c8000ee0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.945+0000 7f70dc000640 1 -- 172.21.15.175:0/3984605494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70d40afc80 msgr2=0x7f70d4138ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:44.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.945+0000 7f70dc000640 1 --2- 172.21.15.175:0/3984605494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70d40afc80 0x7f70d4138ef0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f70c0011990 tx=0x7f70c0011d90 comp rx=0 tx=0).stop 2024-04-25T09:05:44.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.945+0000 7f70dc000640 1 -- 172.21.15.175:0/3984605494 shutdown_connections 2024-04-25T09:05:44.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.945+0000 7f70dc000640 1 --2- 172.21.15.175:0/3984605494 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f70b4066f60 0x7f70b4069420 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.945+0000 7f70dc000640 1 --2- 172.21.15.175:0/3984605494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70d415afb0 0x7f70d415b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.945+0000 7f70dc000640 1 --2- 172.21.15.175:0/3984605494 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70d40afc80 0x7f70d4138ef0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.945+0000 7f70dc000640 1 --2- 172.21.15.175:0/3984605494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70bc005130 0x7f70d415a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:44.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.945+0000 7f70dc000640 1 -- 172.21.15.175:0/3984605494 >> 172.21.15.175:0/3984605494 conn(0x7f70d406ac50 msgr2=0x7f70d406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:44.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.945+0000 7f70dc000640 1 -- 172.21.15.175:0/3984605494 shutdown_connections 2024-04-25T09:05:44.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:44.945+0000 7f70dc000640 1 -- 172.21.15.175:0/3984605494 wait complete. 2024-04-25T09:05:44.974 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:05:45.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.125+0000 7f54b1c00640 1 Processor -- start 2024-04-25T09:05:45.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.125+0000 7f54b1c00640 1 -- start start 2024-04-25T09:05:45.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.125+0000 7f54b1c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac145250 0x7f54ac0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:45.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.125+0000 7f54b1c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f54ac1600a0 0x7f54ac0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:45.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.125+0000 7f54b1c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f54ac0ce970 0x7f54ac0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:45.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.125+0000 7f54b1c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ac15f650 con 0x7f54ac0ce970 2024-04-25T09:05:45.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.125+0000 7f54b1c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ac0cfd10 con 0x7f54ac1600a0 2024-04-25T09:05:45.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.125+0000 7f54b1c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac0cfff0 con 0x7f54ac145250 2024-04-25T09:05:45.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.125+0000 7f54ab400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f54ac0ce970 0x7f54ac0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:45.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.125+0000 7f54ab400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f54ac0ce970 0x7f54ac0cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50692/0 (socket says 172.21.15.175:50692) 2024-04-25T09:05:45.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.125+0000 7f54ab400640 1 -- 172.21.15.175:0/3481001904 learned_addr learned my addr 172.21.15.175:0/3481001904 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:45.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.129+0000 7f54aaa00640 1 --2- 172.21.15.175:0/3481001904 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac145250 0x7f54ac0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:45.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.129+0000 7f54a2000640 1 --2- 172.21.15.175:0/3481001904 >> v2:172.21.15.177:3300/0 conn(0x7f54ac1600a0 0x7f54ac0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:45.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.129+0000 7f54ab400640 1 -- 172.21.15.175:0/3481001904 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac145250 msgr2=0x7f54ac0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:45.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.129+0000 7f54ab400640 1 --2- 172.21.15.175:0/3481001904 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac145250 0x7f54ac0cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.129+0000 7f54ab400640 1 -- 172.21.15.175:0/3481001904 >> v2:172.21.15.177:3300/0 conn(0x7f54ac1600a0 msgr2=0x7f54ac0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:45.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.129+0000 7f54ab400640 1 --2- 172.21.15.175:0/3481001904 >> v2:172.21.15.177:3300/0 conn(0x7f54ac1600a0 0x7f54ac0cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.129+0000 7f54ab400640 1 -- 172.21.15.175:0/3481001904 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac15f8a0 con 0x7f54ac0ce970 2024-04-25T09:05:45.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.129+0000 7f54ab400640 1 --2- 172.21.15.175:0/3481001904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac0ce970 0x7f54ac0cee00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f54ac06bbe0 tx=0x7f54a401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4314c39305b3f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:45.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.129+0000 7f54aa000640 1 -- 172.21.15.175:0/3481001904 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a40aa430 con 0x7f54ac0ce970 2024-04-25T09:05:45.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.129+0000 7f54aa000640 1 -- 172.21.15.175:0/3481001904 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a40af070 con 0x7f54ac0ce970 2024-04-25T09:05:45.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.129+0000 7f54aa000640 1 -- 172.21.15.175:0/3481001904 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a40aa7f0 con 0x7f54ac0ce970 2024-04-25T09:05:45.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54b1c00640 1 -- 172.21.15.175:0/3481001904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac0ce970 msgr2=0x7f54ac0cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:45.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54b1c00640 1 --2- 172.21.15.175:0/3481001904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac0ce970 0x7f54ac0cee00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f54ac06bbe0 tx=0x7f54a401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54b1c00640 1 -- 172.21.15.175:0/3481001904 shutdown_connections 2024-04-25T09:05:45.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54b1c00640 1 --2- 172.21.15.175:0/3481001904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac0ce970 0x7f54ac0cee00 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54b1c00640 1 --2- 172.21.15.175:0/3481001904 >> v2:172.21.15.177:3300/0 conn(0x7f54ac1600a0 0x7f54ac0cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54b1c00640 1 --2- 172.21.15.175:0/3481001904 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac145250 0x7f54ac0cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54b1c00640 1 -- 172.21.15.175:0/3481001904 >> 172.21.15.175:0/3481001904 conn(0x7f54ac06ac50 msgr2=0x7f54ac06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:45.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54b1c00640 1 -- 172.21.15.175:0/3481001904 shutdown_connections 2024-04-25T09:05:45.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54b1c00640 1 -- 172.21.15.175:0/3481001904 wait complete. 2024-04-25T09:05:45.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54b1c00640 1 Processor -- start 2024-04-25T09:05:45.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54b1c00640 1 -- start start 2024-04-25T09:05:45.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54b1c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54ac0ce970 0x7f54ac164b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:45.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54b1c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac145250 0x7f54ac1650d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:45.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54b1c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac1600a0 0x7f54ac0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:45.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54b1c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac160480 con 0x7f54ac1600a0 2024-04-25T09:05:45.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54b1c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac145630 con 0x7f54ac0ce970 2024-04-25T09:05:45.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54b1c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac160600 con 0x7f54ac145250 2024-04-25T09:05:45.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54ab400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac1600a0 0x7f54ac0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:45.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54ab400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac1600a0 0x7f54ac0b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50704/0 (socket says 172.21.15.175:50704) 2024-04-25T09:05:45.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54ab400640 1 -- 172.21.15.175:0/2456203694 learned_addr learned my addr 172.21.15.175:0/2456203694 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:45.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54aaa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54ac0ce970 0x7f54ac164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:45.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54a2000640 1 --2- 172.21.15.175:0/2456203694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac145250 0x7f54ac1650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:45.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54ab400640 1 -- 172.21.15.175:0/2456203694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac145250 msgr2=0x7f54ac1650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:45.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54ab400640 1 --2- 172.21.15.175:0/2456203694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac145250 0x7f54ac1650d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54ab400640 1 -- 172.21.15.175:0/2456203694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54ac0ce970 msgr2=0x7f54ac164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:45.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54ab400640 1 --2- 172.21.15.175:0/2456203694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54ac0ce970 0x7f54ac164b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54ab400640 1 -- 172.21.15.175:0/2456203694 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac0b2890 con 0x7f54ac1600a0 2024-04-25T09:05:45.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.133+0000 7f54aaa00640 1 --2- 172.21.15.175:0/2456203694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54ac0ce970 0x7f54ac164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:45.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.137+0000 7f54ab400640 1 --2- 172.21.15.175:0/2456203694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac1600a0 0x7f54ac0b3d20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f54a40ac040 tx=0x7f54a401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:45.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.137+0000 7f54a3400640 1 -- 172.21.15.175:0/2456203694 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a40bd3f0 con 0x7f54ac1600a0 2024-04-25T09:05:45.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.137+0000 7f54a3400640 1 -- 172.21.15.175:0/2456203694 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a40bd590 con 0x7f54ac1600a0 2024-04-25T09:05:45.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.137+0000 7f54b1c00640 1 -- 172.21.15.175:0/2456203694 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ac0b2b70 con 0x7f54ac1600a0 2024-04-25T09:05:45.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.137+0000 7f54a3400640 1 -- 172.21.15.175:0/2456203694 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a40bd940 con 0x7f54ac1600a0 2024-04-25T09:05:45.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.137+0000 7f54b1c00640 1 -- 172.21.15.175:0/2456203694 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ac0b3130 con 0x7f54ac1600a0 2024-04-25T09:05:45.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.137+0000 7f54b1c00640 1 -- 172.21.15.175:0/2456203694 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ac075160 con 0x7f54ac1600a0 2024-04-25T09:05:45.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.137+0000 7f54a3400640 1 -- 172.21.15.175:0/2456203694 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f54a40c7420 con 0x7f54ac1600a0 2024-04-25T09:05:45.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.137+0000 7f54a3400640 1 --2- 172.21.15.175:0/2456203694 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5488066f60 0x7f5488069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:45.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.137+0000 7f54a3400640 1 -- 172.21.15.175:0/2456203694 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f54a411f640 con 0x7f54ac1600a0 2024-04-25T09:05:45.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.141+0000 7f54aaa00640 1 --2- 172.21.15.175:0/2456203694 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5488066f60 0x7f5488069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:45.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.141+0000 7f54aaa00640 1 --2- 172.21.15.175:0/2456203694 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5488066f60 0x7f5488069420 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f549c00e6c0 tx=0x7f549c00d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:45.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.141+0000 7f54a3400640 1 -- 172.21.15.175:0/2456203694 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f54a40c3060 con 0x7f54ac1600a0 2024-04-25T09:05:45.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.329+0000 7f54b1c00640 1 -- 172.21.15.175:0/2456203694 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f54ac0b24d0 con 0x7f54ac1600a0 2024-04-25T09:05:45.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.973+0000 7f54a3400640 1 -- 172.21.15.175:0/2456203694 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7f54a4016110 con 0x7f54ac1600a0 2024-04-25T09:05:45.965 INFO:teuthology.orchestra.run.smithi175.stderr:new fs with metadata pool 6 and data pool 7 2024-04-25T09:05:45.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.985+0000 7f54b1c00640 1 -- 172.21.15.175:0/2456203694 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5488066f60 msgr2=0x7f5488069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:45.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.985+0000 7f54b1c00640 1 --2- 172.21.15.175:0/2456203694 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5488066f60 0x7f5488069420 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f549c00e6c0 tx=0x7f549c00d040 comp rx=0 tx=0).stop 2024-04-25T09:05:45.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.985+0000 7f54b1c00640 1 -- 172.21.15.175:0/2456203694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac1600a0 msgr2=0x7f54ac0b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:45.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.985+0000 7f54b1c00640 1 --2- 172.21.15.175:0/2456203694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac1600a0 0x7f54ac0b3d20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f54a40ac040 tx=0x7f54a401ad30 comp rx=0 tx=0).stop 2024-04-25T09:05:45.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.985+0000 7f54b1c00640 1 -- 172.21.15.175:0/2456203694 shutdown_connections 2024-04-25T09:05:45.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.985+0000 7f54b1c00640 1 --2- 172.21.15.175:0/2456203694 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5488066f60 0x7f5488069420 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.985+0000 7f54b1c00640 1 --2- 172.21.15.175:0/2456203694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac1600a0 0x7f54ac0b3d20 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.985+0000 7f54b1c00640 1 --2- 172.21.15.175:0/2456203694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac145250 0x7f54ac1650d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.985+0000 7f54b1c00640 1 --2- 172.21.15.175:0/2456203694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54ac0ce970 0x7f54ac164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:45.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.985+0000 7f54b1c00640 1 -- 172.21.15.175:0/2456203694 >> 172.21.15.175:0/2456203694 conn(0x7f54ac06ac50 msgr2=0x7f54ac0b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:45.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.993+0000 7f54b1c00640 1 -- 172.21.15.175:0/2456203694 shutdown_connections 2024-04-25T09:05:45.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:45.993+0000 7f54b1c00640 1 -- 172.21.15.175:0/2456203694 wait complete. 2024-04-25T09:05:46.009 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:46.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.153+0000 7f9847800640 1 Processor -- start 2024-04-25T09:05:46.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.153+0000 7f9847800640 1 -- start start 2024-04-25T09:05:46.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.153+0000 7f9847800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98401453a0 0x7f984015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.153+0000 7f9847800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f984015c410 0x7f98400cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.153+0000 7f9847800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f984015cd00 con 0x7f9840144fc0 2024-04-25T09:05:46.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.153+0000 7f9847800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98400ce660 con 0x7f984015c410 2024-04-25T09:05:46.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.153+0000 7f9847800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984015c840 con 0x7f98401453a0 2024-04-25T09:05:46.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.157+0000 7f9845800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f984015c410 0x7f98400cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.157+0000 7f9844e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f9840144fc0 0x7f98400cbe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44758/0 (socket says 172.21.15.175:44758) 2024-04-25T09:05:46.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.157+0000 7f9845800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f984015c410 0x7f98400cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50712/0 (socket says 172.21.15.175:50712) 2024-04-25T09:05:46.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.157+0000 7f9844e00640 1 -- 172.21.15.175:0/481128990 learned_addr learned my addr 172.21.15.175:0/481128990 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:46.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.157+0000 7f9837e00640 1 --2- 172.21.15.175:0/481128990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98401453a0 0x7f984015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.157+0000 7f9845800640 1 -- 172.21.15.175:0/481128990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98401453a0 msgr2=0x7f984015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:46.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.157+0000 7f9845800640 1 --2- 172.21.15.175:0/481128990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98401453a0 0x7f984015bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.157+0000 7f9845800640 1 -- 172.21.15.175:0/481128990 >> v1:172.21.15.175:6789/0 conn(0x7f9840144fc0 legacy=0x7f98400cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.157+0000 7f983fe00640 1 -- 172.21.15.175:0/481128990 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327360125 0 0) 0x7f984015cd00 con 0x7f9840144fc0 2024-04-25T09:05:46.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.157+0000 7f9845800640 1 -- 172.21.15.175:0/481128990 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98400cc930 con 0x7f984015c410 2024-04-25T09:05:46.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.157+0000 7f9837e00640 1 --2- 172.21.15.175:0/481128990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98401453a0 0x7f984015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:46.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.157+0000 7f9845800640 1 --2- 172.21.15.175:0/481128990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f984015c410 0x7f98400cee20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9838009d90 tx=0x7f983801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feedf262f3d4913f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:46.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.157+0000 7f983fe00640 1 -- 172.21.15.175:0/481128990 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98380b2070 con 0x7f984015c410 2024-04-25T09:05:46.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.157+0000 7f983fe00640 1 -- 172.21.15.175:0/481128990 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98380a5920 con 0x7f984015c410 2024-04-25T09:05:46.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.157+0000 7f983fe00640 1 -- 172.21.15.175:0/481128990 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98380a5cf0 con 0x7f984015c410 2024-04-25T09:05:46.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9847800640 1 -- 172.21.15.175:0/481128990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f984015c410 msgr2=0x7f98400cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9847800640 1 --2- 172.21.15.175:0/481128990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f984015c410 0x7f98400cee20 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f9838009d90 tx=0x7f983801c970 comp rx=0 tx=0).stop 2024-04-25T09:05:46.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9847800640 1 -- 172.21.15.175:0/481128990 shutdown_connections 2024-04-25T09:05:46.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9847800640 1 --2- 172.21.15.175:0/481128990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f984015c410 0x7f98400cee20 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9847800640 1 --2- 172.21.15.175:0/481128990 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98401453a0 0x7f984015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9847800640 1 -- 172.21.15.175:0/481128990 >> 172.21.15.175:0/481128990 conn(0x7f9840067150 msgr2=0x7f984006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:46.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9847800640 1 -- 172.21.15.175:0/481128990 shutdown_connections 2024-04-25T09:05:46.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9847800640 1 -- 172.21.15.175:0/481128990 wait complete. 2024-04-25T09:05:46.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9847800640 1 Processor -- start 2024-04-25T09:05:46.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9847800640 1 -- start start 2024-04-25T09:05:46.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9847800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98401453a0 0x7f98400b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9847800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f984015c410 0x7f984013bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9847800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f984015b280 0x7f984015da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9847800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98400cc580 con 0x7f984015b280 2024-04-25T09:05:46.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9847800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98400cfb70 con 0x7f98401453a0 2024-04-25T09:05:46.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9847800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984013c260 con 0x7f984015c410 2024-04-25T09:05:46.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9845800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f984015b280 0x7f984015da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9845800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f984015b280 0x7f984015da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50716/0 (socket says 172.21.15.175:50716) 2024-04-25T09:05:46.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9845800640 1 -- 172.21.15.175:0/1515850778 learned_addr learned my addr 172.21.15.175:0/1515850778 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:46.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9837e00640 1 --2- 172.21.15.175:0/1515850778 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f984015c410 0x7f984013bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9844e00640 1 --2- 172.21.15.175:0/1515850778 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98401453a0 0x7f98400b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9845800640 1 -- 172.21.15.175:0/1515850778 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f984015c410 msgr2=0x7f984013bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9845800640 1 --2- 172.21.15.175:0/1515850778 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f984015c410 0x7f984013bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9845800640 1 -- 172.21.15.175:0/1515850778 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98401453a0 msgr2=0x7f98400b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9845800640 1 --2- 172.21.15.175:0/1515850778 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98401453a0 0x7f98400b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.161+0000 7f9845800640 1 -- 172.21.15.175:0/1515850778 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984015dfd0 con 0x7f984015b280 2024-04-25T09:05:46.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.165+0000 7f9845800640 1 --2- 172.21.15.175:0/1515850778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f984015b280 0x7f984015da90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9838009d90 tx=0x7f9838019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:46.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.165+0000 7f983d600640 1 -- 172.21.15.175:0/1515850778 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98380b2040 con 0x7f984015b280 2024-04-25T09:05:46.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.165+0000 7f983d600640 1 -- 172.21.15.175:0/1515850778 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98380bf070 con 0x7f984015b280 2024-04-25T09:05:46.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.165+0000 7f9847800640 1 -- 172.21.15.175:0/1515850778 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984013c4e0 con 0x7f984015b280 2024-04-25T09:05:46.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.165+0000 7f983d600640 1 -- 172.21.15.175:0/1515850778 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98380b8890 con 0x7f984015b280 2024-04-25T09:05:46.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.165+0000 7f9847800640 1 -- 172.21.15.175:0/1515850778 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984013caa0 con 0x7f984015b280 2024-04-25T09:05:46.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.165+0000 7f9847800640 1 -- 172.21.15.175:0/1515850778 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984013cce0 con 0x7f984015b280 2024-04-25T09:05:46.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.165+0000 7f983d600640 1 -- 172.21.15.175:0/1515850778 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f98380b8a30 con 0x7f984015b280 2024-04-25T09:05:46.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.165+0000 7f983d600640 1 --2- 172.21.15.175:0/1515850778 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f981c066f90 0x7f981c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.165+0000 7f983d600640 1 -- 172.21.15.175:0/1515850778 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98381202c0 con 0x7f984015b280 2024-04-25T09:05:46.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.165+0000 7f9844e00640 1 --2- 172.21.15.175:0/1515850778 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f981c066f90 0x7f981c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.169+0000 7f9844e00640 1 --2- 172.21.15.175:0/1515850778 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f981c066f90 0x7f981c069450 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9830000f70 tx=0x7f9830007b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:46.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.169+0000 7f983d600640 1 -- 172.21.15.175:0/1515850778 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f984013cce0 con 0x7f984015b280 2024-04-25T09:05:46.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.325+0000 7f9847800640 1 -- 172.21.15.175:0/1515850778 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9840074a60 con 0x7f984015b280 2024-04-25T09:05:46.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.325+0000 7f983d600640 1 -- 172.21.15.175:0/1515850778 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16662 (secure 0 0 0) 0x7f9838016560 con 0x7f984015b280 2024-04-25T09:05:46.317 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:46.317 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":43,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:05:45.332295+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:43.050603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:44.332424+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:46.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.329+0000 7f9847800640 1 -- 172.21.15.175:0/1515850778 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f981c066f90 msgr2=0x7f981c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.329+0000 7f9847800640 1 --2- 172.21.15.175:0/1515850778 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f981c066f90 0x7f981c069450 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9830000f70 tx=0x7f9830007b60 comp rx=0 tx=0).stop 2024-04-25T09:05:46.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.329+0000 7f9847800640 1 -- 172.21.15.175:0/1515850778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f984015b280 msgr2=0x7f984015da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.329+0000 7f9847800640 1 --2- 172.21.15.175:0/1515850778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f984015b280 0x7f984015da90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9838009d90 tx=0x7f9838019710 comp rx=0 tx=0).stop 2024-04-25T09:05:46.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.329+0000 7f9847800640 1 -- 172.21.15.175:0/1515850778 shutdown_connections 2024-04-25T09:05:46.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.329+0000 7f9847800640 1 --2- 172.21.15.175:0/1515850778 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f981c066f90 0x7f981c069450 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.329+0000 7f9847800640 1 --2- 172.21.15.175:0/1515850778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f984015b280 0x7f984015da90 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.329+0000 7f9847800640 1 --2- 172.21.15.175:0/1515850778 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f984015c410 0x7f984013bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.329+0000 7f9847800640 1 --2- 172.21.15.175:0/1515850778 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98401453a0 0x7f98400b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.329+0000 7f9847800640 1 -- 172.21.15.175:0/1515850778 >> 172.21.15.175:0/1515850778 conn(0x7f9840144fc0 msgr2=0x7f984006d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:46.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.329+0000 7f9847800640 1 -- 172.21.15.175:0/1515850778 shutdown_connections 2024-04-25T09:05:46.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.329+0000 7f9847800640 1 -- 172.21.15.175:0/1515850778 wait complete. 2024-04-25T09:05:46.338 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:46.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.485+0000 7fd085c00640 1 Processor -- start 2024-04-25T09:05:46.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.485+0000 7fd085c00640 1 -- start start 2024-04-25T09:05:46.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.485+0000 7fd085c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0800cd520 0x7fd08006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.485+0000 7fd085c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0800cda00 con 0x7fd08015a900 2024-04-25T09:05:46.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.485+0000 7fd085c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0800cdce0 con 0x7fd0800cf560 2024-04-25T09:05:46.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.485+0000 7fd085c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08015bcf0 con 0x7fd0800cd520 2024-04-25T09:05:46.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.485+0000 7fd07ea00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd08015a900 0x7fd0800ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44770/0 (socket says 172.21.15.175:44770) 2024-04-25T09:05:46.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.485+0000 7fd07ea00640 1 -- 172.21.15.175:0/1500139181 learned_addr learned my addr 172.21.15.175:0/1500139181 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:46.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.485+0000 7fd076000640 1 --2- 172.21.15.175:0/1500139181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0800cd520 0x7fd08006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.485+0000 7fd07e000640 1 -- 172.21.15.175:0/1500139181 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017838632 0 0) 0x7fd0800cda00 con 0x7fd08015a900 2024-04-25T09:05:46.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07e000640 1 -- 172.21.15.175:0/1500139181 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd064003530 con 0x7fd08015a900 2024-04-25T09:05:46.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07e000640 1 -- 172.21.15.175:0/1500139181 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3942701513 0 0) 0x7fd0800cdce0 con 0x7fd0800cf560 2024-04-25T09:05:46.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07e000640 1 -- 172.21.15.175:0/1500139181 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0800cda00 con 0x7fd0800cf560 2024-04-25T09:05:46.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07e000640 1 -- 172.21.15.175:0/1500139181 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 16670841 0 0) 0x7fd064003530 con 0x7fd08015a900 2024-04-25T09:05:46.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07e000640 1 -- 172.21.15.175:0/1500139181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0800cd520 msgr2=0x7fd08006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:46.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07e000640 1 --2- 172.21.15.175:0/1500139181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0800cd520 0x7fd08006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07e000640 1 -- 172.21.15.175:0/1500139181 >> v1:172.21.15.177:6789/0 conn(0x7fd0800cf560 legacy=0x7fd08015bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07e000640 1 -- 172.21.15.175:0/1500139181 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0800cdfc0 con 0x7fd08015a900 2024-04-25T09:05:46.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07e000640 1 -- 172.21.15.175:0/1500139181 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fd070001680 con 0x7fd08015a900 2024-04-25T09:05:46.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd076000640 1 --2- 172.21.15.175:0/1500139181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0800cd520 0x7fd08006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:46.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07e000640 1 -- 172.21.15.175:0/1500139181 >> v1:172.21.15.175:6789/0 conn(0x7fd08015a900 legacy=0x7fd0800ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07e000640 1 --2- 172.21.15.175:0/1500139181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0800cd520 0x7fd064003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07e000640 1 --2- 172.21.15.175:0/1500139181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd064004110 0x7fd064004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07e000640 1 --2- 172.21.15.175:0/1500139181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd064004d50 0x7fd0640051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07e000640 1 -- 172.21.15.175:0/1500139181 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06400bab0 con 0x7fd064004110 2024-04-25T09:05:46.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07e000640 1 -- 172.21.15.175:0/1500139181 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06400bc60 con 0x7fd064004d50 2024-04-25T09:05:46.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07e000640 1 -- 172.21.15.175:0/1500139181 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06400be60 con 0x7fd0800cd520 2024-04-25T09:05:46.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd076000640 1 --2- 172.21.15.175:0/1500139181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd064004110 0x7fd064004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07f400640 1 --2- 172.21.15.175:0/1500139181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd064004d50 0x7fd0640051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07ea00640 1 --2- 172.21.15.175:0/1500139181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0800cd520 0x7fd064003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd076000640 1 -- 172.21.15.175:0/1500139181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0800cd520 msgr2=0x7fd064003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:46.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd076000640 1 --2- 172.21.15.175:0/1500139181 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0800cd520 0x7fd064003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd076000640 1 -- 172.21.15.175:0/1500139181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd064004d50 msgr2=0x7fd0640051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:46.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd076000640 1 --2- 172.21.15.175:0/1500139181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd064004d50 0x7fd0640051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd076000640 1 -- 172.21.15.175:0/1500139181 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd064003530 con 0x7fd064004110 2024-04-25T09:05:46.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd07f400640 1 --2- 172.21.15.175:0/1500139181 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd064004d50 0x7fd0640051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:46.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.489+0000 7fd076000640 1 --2- 172.21.15.175:0/1500139181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd064004110 0x7fd064004810 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd068009c60 tx=0x7fd06801cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f61286339c0af3ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:46.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd07e000640 1 -- 172.21.15.175:0/1500139181 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd068009860 con 0x7fd064004110 2024-04-25T09:05:46.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd07e000640 1 -- 172.21.15.175:0/1500139181 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd068004030 con 0x7fd064004110 2024-04-25T09:05:46.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd07e000640 1 -- 172.21.15.175:0/1500139181 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd068004460 con 0x7fd064004110 2024-04-25T09:05:46.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd085c00640 1 -- 172.21.15.175:0/1500139181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd064004110 msgr2=0x7fd064004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd085c00640 1 --2- 172.21.15.175:0/1500139181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd064004110 0x7fd064004810 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd068009c60 tx=0x7fd06801cbd0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd07f400640 1 -- 172.21.15.175:0/1500139181 reap_dead start 2024-04-25T09:05:46.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd085c00640 1 -- 172.21.15.175:0/1500139181 shutdown_connections 2024-04-25T09:05:46.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd085c00640 1 -- 172.21.15.175:0/1500139181 >> 172.21.15.175:0/1500139181 conn(0x7fd080067150 msgr2=0x7fd08006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:46.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd085c00640 1 -- 172.21.15.175:0/1500139181 shutdown_connections 2024-04-25T09:05:46.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd085c00640 1 -- 172.21.15.175:0/1500139181 wait complete. 2024-04-25T09:05:46.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd085c00640 1 Processor -- start 2024-04-25T09:05:46.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd085c00640 1 -- start start 2024-04-25T09:05:46.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd085c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd08013e700 0x7fd08013eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd085c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd080142040 0x7fd080154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd085c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd080155520 0x7fd080141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd085c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08006d3b0 con 0x7fd080142040 2024-04-25T09:05:46.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd085c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0800ce580 con 0x7fd080155520 2024-04-25T09:05:46.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd085c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08006d530 con 0x7fd08013e700 2024-04-25T09:05:46.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd076000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd080142040 0x7fd080154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd076000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd080142040 0x7fd080154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50742/0 (socket says 172.21.15.175:50742) 2024-04-25T09:05:46.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd076000640 1 -- 172.21.15.175:0/3619986616 learned_addr learned my addr 172.21.15.175:0/3619986616 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:46.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.493+0000 7fd07ea00640 1 --2- 172.21.15.175:0/3619986616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd08013e700 0x7fd08013eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.497+0000 7fd07f400640 1 --2- 172.21.15.175:0/3619986616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd080155520 0x7fd080141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.497+0000 7fd076000640 1 -- 172.21.15.175:0/3619986616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd08013e700 msgr2=0x7fd08013eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.497+0000 7fd076000640 1 --2- 172.21.15.175:0/3619986616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd08013e700 0x7fd08013eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.497+0000 7fd076000640 1 -- 172.21.15.175:0/3619986616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd080155520 msgr2=0x7fd080141340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.497+0000 7fd076000640 1 --2- 172.21.15.175:0/3619986616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd080155520 0x7fd080141340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.497+0000 7fd076000640 1 -- 172.21.15.175:0/3619986616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08013f020 con 0x7fd080142040 2024-04-25T09:05:46.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.497+0000 7fd076000640 1 --2- 172.21.15.175:0/3619986616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd080142040 0x7fd080154fe0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd0680af040 tx=0x7fd064005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:46.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.497+0000 7fd077400640 1 -- 172.21.15.175:0/3619986616 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd068005db0 con 0x7fd080142040 2024-04-25T09:05:46.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.497+0000 7fd077400640 1 -- 172.21.15.175:0/3619986616 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0680bd070 con 0x7fd080142040 2024-04-25T09:05:46.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.497+0000 7fd085c00640 1 -- 172.21.15.175:0/3619986616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd080156a40 con 0x7fd080142040 2024-04-25T09:05:46.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.497+0000 7fd077400640 1 -- 172.21.15.175:0/3619986616 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0680a5ad0 con 0x7fd080142040 2024-04-25T09:05:46.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.497+0000 7fd085c00640 1 -- 172.21.15.175:0/3619986616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd080155c80 con 0x7fd080142040 2024-04-25T09:05:46.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.497+0000 7fd085c00640 1 -- 172.21.15.175:0/3619986616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd080074a60 con 0x7fd080142040 2024-04-25T09:05:46.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.497+0000 7fd077400640 1 -- 172.21.15.175:0/3619986616 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd0680a5c70 con 0x7fd080142040 2024-04-25T09:05:46.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.501+0000 7fd077400640 1 --2- 172.21.15.175:0/3619986616 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd05c066f60 0x7fd05c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.501+0000 7fd077400640 1 -- 172.21.15.175:0/3619986616 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd06811f8e0 con 0x7fd080142040 2024-04-25T09:05:46.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.501+0000 7fd07ea00640 1 --2- 172.21.15.175:0/3619986616 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd05c066f60 0x7fd05c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.501+0000 7fd07ea00640 1 --2- 172.21.15.175:0/3619986616 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd05c066f60 0x7fd05c069420 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd070000c10 tx=0x7fd070007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:46.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.505+0000 7fd077400640 1 -- 172.21.15.175:0/3619986616 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd0680168e0 con 0x7fd080142040 2024-04-25T09:05:46.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.661+0000 7fd085c00640 1 -- 172.21.15.175:0/3619986616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0800cf0a0 con 0x7fd080142040 2024-04-25T09:05:46.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.661+0000 7fd077400640 1 -- 172.21.15.175:0/3619986616 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16662 (secure 0 0 0) 0x7fd0680f03c0 con 0x7fd080142040 2024-04-25T09:05:46.652 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:46.652 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":43,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:05:45.332295+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:43.050603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:44.332424+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:46.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.665+0000 7fd085c00640 1 -- 172.21.15.175:0/3619986616 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd05c066f60 msgr2=0x7fd05c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.665+0000 7fd085c00640 1 --2- 172.21.15.175:0/3619986616 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd05c066f60 0x7fd05c069420 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd070000c10 tx=0x7fd070007040 comp rx=0 tx=0).stop 2024-04-25T09:05:46.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.665+0000 7fd085c00640 1 -- 172.21.15.175:0/3619986616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd080142040 msgr2=0x7fd080154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.665+0000 7fd085c00640 1 --2- 172.21.15.175:0/3619986616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd080142040 0x7fd080154fe0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd0680af040 tx=0x7fd064005840 comp rx=0 tx=0).stop 2024-04-25T09:05:46.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.665+0000 7fd085c00640 1 -- 172.21.15.175:0/3619986616 shutdown_connections 2024-04-25T09:05:46.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.665+0000 7fd085c00640 1 --2- 172.21.15.175:0/3619986616 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd05c066f60 0x7fd05c069420 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.665+0000 7fd085c00640 1 --2- 172.21.15.175:0/3619986616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd080155520 0x7fd080141340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.665+0000 7fd085c00640 1 --2- 172.21.15.175:0/3619986616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd080142040 0x7fd080154fe0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.665+0000 7fd085c00640 1 --2- 172.21.15.175:0/3619986616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd08013e700 0x7fd08013eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.665+0000 7fd085c00640 1 -- 172.21.15.175:0/3619986616 >> 172.21.15.175:0/3619986616 conn(0x7fd064004110 msgr2=0x7fd080159800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:46.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.665+0000 7fd085c00640 1 -- 172.21.15.175:0/3619986616 shutdown_connections 2024-04-25T09:05:46.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.665+0000 7fd085c00640 1 -- 172.21.15.175:0/3619986616 wait complete. 2024-04-25T09:05:46.675 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:05:46.813 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.825+0000 7fe39c200640 1 Processor -- start 2024-04-25T09:05:46.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.825+0000 7fe39c200640 1 -- start start 2024-04-25T09:05:46.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.825+0000 7fe39c200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe394145250 0x7fe3940cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.825+0000 7fe39c200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3941600a0 0x7fe3940cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.825+0000 7fe39c200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe3940ce970 0x7fe3940cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.825+0000 7fe39c200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39415f650 con 0x7fe394145250 2024-04-25T09:05:46.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.825+0000 7fe39c200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3940cfd10 con 0x7fe3940ce970 2024-04-25T09:05:46.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.825+0000 7fe39c200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3940cfff0 con 0x7fe3941600a0 2024-04-25T09:05:46.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.825+0000 7fe399800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe394145250 0x7fe3940cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.825+0000 7fe399800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe394145250 0x7fe3940cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50748/0 (socket says 172.21.15.175:50748) 2024-04-25T09:05:46.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.825+0000 7fe399800640 1 -- 172.21.15.175:0/1139379167 learned_addr learned my addr 172.21.15.175:0/1139379167 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:46.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.825+0000 7fe39a200640 1 --2- 172.21.15.175:0/1139379167 >> v2:172.21.15.177:3300/0 conn(0x7fe3940ce970 0x7fe3940cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.825+0000 7fe398e00640 1 --2- 172.21.15.175:0/1139379167 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3941600a0 0x7fe3940cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.825+0000 7fe399800640 1 -- 172.21.15.175:0/1139379167 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3941600a0 msgr2=0x7fe3940cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:46.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.825+0000 7fe399800640 1 --2- 172.21.15.175:0/1139379167 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3941600a0 0x7fe3940cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.825+0000 7fe399800640 1 -- 172.21.15.175:0/1139379167 >> v2:172.21.15.177:3300/0 conn(0x7fe3940ce970 msgr2=0x7fe3940cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:46.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.825+0000 7fe399800640 1 --2- 172.21.15.175:0/1139379167 >> v2:172.21.15.177:3300/0 conn(0x7fe3940ce970 0x7fe3940cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.825+0000 7fe399800640 1 -- 172.21.15.175:0/1139379167 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39415f8a0 con 0x7fe394145250 2024-04-25T09:05:46.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.829+0000 7fe399800640 1 --2- 172.21.15.175:0/1139379167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe394145250 0x7fe3940cf6b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe394071260 tx=0x7fe38801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ce3e1faf6a74b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:46.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.829+0000 7fe393e00640 1 -- 172.21.15.175:0/1139379167 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3880aa430 con 0x7fe394145250 2024-04-25T09:05:46.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.829+0000 7fe393e00640 1 -- 172.21.15.175:0/1139379167 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3880af070 con 0x7fe394145250 2024-04-25T09:05:46.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.829+0000 7fe393e00640 1 -- 172.21.15.175:0/1139379167 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3880aa7f0 con 0x7fe394145250 2024-04-25T09:05:46.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.829+0000 7fe39c200640 1 -- 172.21.15.175:0/1139379167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe394145250 msgr2=0x7fe3940cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.829+0000 7fe39c200640 1 --2- 172.21.15.175:0/1139379167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe394145250 0x7fe3940cf6b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe394071260 tx=0x7fe38801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.829+0000 7fe39c200640 1 -- 172.21.15.175:0/1139379167 shutdown_connections 2024-04-25T09:05:46.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.829+0000 7fe39c200640 1 --2- 172.21.15.175:0/1139379167 >> v2:172.21.15.177:3300/0 conn(0x7fe3940ce970 0x7fe3940cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.829+0000 7fe39c200640 1 --2- 172.21.15.175:0/1139379167 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3941600a0 0x7fe3940cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.829+0000 7fe39c200640 1 --2- 172.21.15.175:0/1139379167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe394145250 0x7fe3940cf6b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.829+0000 7fe39c200640 1 -- 172.21.15.175:0/1139379167 >> 172.21.15.175:0/1139379167 conn(0x7fe39406ac50 msgr2=0x7fe39406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:46.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.829+0000 7fe39c200640 1 -- 172.21.15.175:0/1139379167 shutdown_connections 2024-04-25T09:05:46.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.829+0000 7fe39c200640 1 -- 172.21.15.175:0/1139379167 wait complete. 2024-04-25T09:05:46.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.829+0000 7fe39c200640 1 Processor -- start 2024-04-25T09:05:46.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe39c200640 1 -- start start 2024-04-25T09:05:46.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe39c200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3940ce970 0x7fe394165300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe39c200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe394145250 0x7fe39415b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe39c200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3941600a0 0x7fe39413e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe39c200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe394160480 con 0x7fe3940ce970 2024-04-25T09:05:46.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe39c200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe394145630 con 0x7fe394145250 2024-04-25T09:05:46.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe39c200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe394160600 con 0x7fe3941600a0 2024-04-25T09:05:46.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe399800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3940ce970 0x7fe394165300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe399800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3940ce970 0x7fe394165300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50750/0 (socket says 172.21.15.175:50750) 2024-04-25T09:05:46.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe399800640 1 -- 172.21.15.175:0/631588506 learned_addr learned my addr 172.21.15.175:0/631588506 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:46.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe398e00640 1 --2- 172.21.15.175:0/631588506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe394145250 0x7fe39415b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe39a200640 1 --2- 172.21.15.175:0/631588506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3941600a0 0x7fe39413e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe399800640 1 -- 172.21.15.175:0/631588506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3941600a0 msgr2=0x7fe39413e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe399800640 1 --2- 172.21.15.175:0/631588506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3941600a0 0x7fe39413e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe399800640 1 -- 172.21.15.175:0/631588506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe394145250 msgr2=0x7fe39415b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:46.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe399800640 1 --2- 172.21.15.175:0/631588506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe394145250 0x7fe39415b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:46.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe399800640 1 -- 172.21.15.175:0/631588506 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe394142ee0 con 0x7fe3940ce970 2024-04-25T09:05:46.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe398e00640 1 --2- 172.21.15.175:0/631588506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe394145250 0x7fe39415b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:46.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe39a200640 1 --2- 172.21.15.175:0/631588506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3941600a0 0x7fe39413e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:46.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe399800640 1 --2- 172.21.15.175:0/631588506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3940ce970 0x7fe394165300 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe3880ac040 tx=0x7fe38801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:46.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe391600640 1 -- 172.21.15.175:0/631588506 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3880bd3f0 con 0x7fe3940ce970 2024-04-25T09:05:46.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe391600640 1 -- 172.21.15.175:0/631588506 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3880bd590 con 0x7fe3940ce970 2024-04-25T09:05:46.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe391600640 1 -- 172.21.15.175:0/631588506 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3880bd960 con 0x7fe3940ce970 2024-04-25T09:05:46.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe39c200640 1 -- 172.21.15.175:0/631588506 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3941431c0 con 0x7fe3940ce970 2024-04-25T09:05:46.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe39c200640 1 -- 172.21.15.175:0/631588506 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39415b560 con 0x7fe3940ce970 2024-04-25T09:05:46.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.833+0000 7fe39c200640 1 -- 172.21.15.175:0/631588506 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe394075160 con 0x7fe3940ce970 2024-04-25T09:05:46.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.837+0000 7fe391600640 1 -- 172.21.15.175:0/631588506 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe3880b33f0 con 0x7fe3940ce970 2024-04-25T09:05:46.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.837+0000 7fe391600640 1 --2- 172.21.15.175:0/631588506 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe374066f60 0x7fe374069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:46.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.837+0000 7fe391600640 1 -- 172.21.15.175:0/631588506 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe38811f560 con 0x7fe3940ce970 2024-04-25T09:05:46.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.837+0000 7fe398e00640 1 --2- 172.21.15.175:0/631588506 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe374066f60 0x7fe374069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:46.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.837+0000 7fe398e00640 1 --2- 172.21.15.175:0/631588506 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe374066f60 0x7fe374069420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe3941f9dd0 tx=0x7fe380008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:46.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:46.841+0000 7fe391600640 1 -- 172.21.15.175:0/631588506 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe3880c3060 con 0x7fe3940ce970 2024-04-25T09:05:47.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:47.033+0000 7fe39c200640 1 -- 172.21.15.175:0/631588506 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe39406ecc0 con 0x7fe3940ce970 2024-04-25T09:05:47.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:47.985+0000 7fe391600640 1 -- 172.21.15.175:0/631588506 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe388016110 con 0x7fe3940ce970 2024-04-25T09:05:47.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:47.985+0000 7fe39c200640 1 -- 172.21.15.175:0/631588506 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe374066f60 msgr2=0x7fe374069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:47.985+0000 7fe39c200640 1 --2- 172.21.15.175:0/631588506 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe374066f60 0x7fe374069420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe3941f9dd0 tx=0x7fe380008040 comp rx=0 tx=0).stop 2024-04-25T09:05:47.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:47.985+0000 7fe39c200640 1 -- 172.21.15.175:0/631588506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3940ce970 msgr2=0x7fe394165300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:47.985+0000 7fe39c200640 1 --2- 172.21.15.175:0/631588506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3940ce970 0x7fe394165300 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe3880ac040 tx=0x7fe38801ad30 comp rx=0 tx=0).stop 2024-04-25T09:05:47.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:47.985+0000 7fe39c200640 1 -- 172.21.15.175:0/631588506 shutdown_connections 2024-04-25T09:05:47.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:47.985+0000 7fe39c200640 1 --2- 172.21.15.175:0/631588506 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe374066f60 0x7fe374069420 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:47.985+0000 7fe39c200640 1 --2- 172.21.15.175:0/631588506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe3941600a0 0x7fe39413e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:47.985+0000 7fe39c200640 1 --2- 172.21.15.175:0/631588506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe394145250 0x7fe39415b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:47.985+0000 7fe39c200640 1 --2- 172.21.15.175:0/631588506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3940ce970 0x7fe394165300 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:47.985+0000 7fe39c200640 1 -- 172.21.15.175:0/631588506 >> 172.21.15.175:0/631588506 conn(0x7fe39406ac50 msgr2=0x7fe39406e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:47.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:47.985+0000 7fe39c200640 1 -- 172.21.15.175:0/631588506 shutdown_connections 2024-04-25T09:05:47.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:47.985+0000 7fe39c200640 1 -- 172.21.15.175:0/631588506 wait complete. 2024-04-25T09:05:47.999 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:05:47.999 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:05:48.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.153+0000 7f81c8c00640 1 Processor -- start 2024-04-25T09:05:48.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.153+0000 7f81c8c00640 1 -- start start 2024-04-25T09:05:48.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.153+0000 7f81c8c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81c40cf080 0x7f81c41600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.153+0000 7f81c8c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c40cfd10 con 0x7f81c4145250 2024-04-25T09:05:48.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.153+0000 7f81c8c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c40cfff0 con 0x7f81c40cf6b0 2024-04-25T09:05:48.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.153+0000 7f81c8c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c41605e0 con 0x7f81c40cf080 2024-04-25T09:05:48.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.153+0000 7f81c1e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f81c4145250 0x7f81c40cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44782/0 (socket says 172.21.15.175:44782) 2024-04-25T09:05:48.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.153+0000 7f81c1e00640 1 -- 172.21.15.175:0/4000652384 learned_addr learned my addr 172.21.15.175:0/4000652384 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:48.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.153+0000 7f81c2800640 1 --2- 172.21.15.175:0/4000652384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81c40cf080 0x7f81c41600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.153+0000 7f81c0a00640 1 -- 172.21.15.175:0/4000652384 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2713896901 0 0) 0x7f81c40cfd10 con 0x7f81c4145250 2024-04-25T09:05:48.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.153+0000 7f81c0a00640 1 -- 172.21.15.175:0/4000652384 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81a8003530 con 0x7f81c4145250 2024-04-25T09:05:48.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.153+0000 7f81c0a00640 1 -- 172.21.15.175:0/4000652384 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071147800 0 0) 0x7f81c40cfff0 con 0x7f81c40cf6b0 2024-04-25T09:05:48.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.153+0000 7f81c0a00640 1 -- 172.21.15.175:0/4000652384 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c40cfd10 con 0x7f81c40cf6b0 2024-04-25T09:05:48.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.153+0000 7f81c2800640 1 -- 172.21.15.175:0/4000652384 >> v1:172.21.15.177:6789/0 conn(0x7f81c40cf6b0 legacy=0x7f81c40ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.153+0000 7f81c2800640 1 -- 172.21.15.175:0/4000652384 >> v1:172.21.15.175:6789/0 conn(0x7f81c4145250 legacy=0x7f81c40cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.153+0000 7f81c2800640 1 -- 172.21.15.175:0/4000652384 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c415f8a0 con 0x7f81c40cf080 2024-04-25T09:05:48.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.157+0000 7f81c2800640 1 --2- 172.21.15.175:0/4000652384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81c40cf080 0x7f81c41600a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f81bc009820 tx=0x7f81bc01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=610110b695dde400 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.157+0000 7f81c0a00640 1 -- 172.21.15.175:0/4000652384 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc0b0070 con 0x7f81c40cf080 2024-04-25T09:05:48.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.157+0000 7f81c0a00640 1 -- 172.21.15.175:0/4000652384 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81bc0ab600 con 0x7f81c40cf080 2024-04-25T09:05:48.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.157+0000 7f81c0a00640 1 -- 172.21.15.175:0/4000652384 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc0ab9d0 con 0x7f81c40cf080 2024-04-25T09:05:48.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.157+0000 7f81c8c00640 1 -- 172.21.15.175:0/4000652384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81c40cf080 msgr2=0x7f81c41600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.157+0000 7f81c8c00640 1 --2- 172.21.15.175:0/4000652384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81c40cf080 0x7f81c41600a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f81bc009820 tx=0x7f81bc01c3a0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.157+0000 7f81c8c00640 1 -- 172.21.15.175:0/4000652384 shutdown_connections 2024-04-25T09:05:48.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.157+0000 7f81c8c00640 1 --2- 172.21.15.175:0/4000652384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81c40cf080 0x7f81c41600a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.157+0000 7f81c8c00640 1 -- 172.21.15.175:0/4000652384 >> 172.21.15.175:0/4000652384 conn(0x7f81c406ac50 msgr2=0x7f81c406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:48.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.157+0000 7f81c8c00640 1 -- 172.21.15.175:0/4000652384 shutdown_connections 2024-04-25T09:05:48.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.157+0000 7f81c8c00640 1 -- 172.21.15.175:0/4000652384 wait complete. 2024-04-25T09:05:48.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c8c00640 1 Processor -- start 2024-04-25T09:05:48.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c8c00640 1 -- start start 2024-04-25T09:05:48.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c8c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c40cf080 0x7f81c41662b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c8c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81c40cf6b0 0x7f81c41638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c8c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81c4145250 0x7f81c4143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c8c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c415cc80 con 0x7f81c40cf080 2024-04-25T09:05:48.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c8c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c415cb00 con 0x7f81c4145250 2024-04-25T09:05:48.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c8c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c41697f0 con 0x7f81c40cf6b0 2024-04-25T09:05:48.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c1e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c40cf080 0x7f81c41662b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c1e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c40cf080 0x7f81c41662b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50754/0 (socket says 172.21.15.175:50754) 2024-04-25T09:05:48.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c1e00640 1 -- 172.21.15.175:0/673044011 learned_addr learned my addr 172.21.15.175:0/673044011 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:48.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c2800640 1 --2- 172.21.15.175:0/673044011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81c4145250 0x7f81c4143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c1400640 1 --2- 172.21.15.175:0/673044011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81c40cf6b0 0x7f81c41638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c1e00640 1 -- 172.21.15.175:0/673044011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81c40cf6b0 msgr2=0x7f81c41638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c1e00640 1 --2- 172.21.15.175:0/673044011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81c40cf6b0 0x7f81c41638c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c1e00640 1 -- 172.21.15.175:0/673044011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81c4145250 msgr2=0x7f81c4143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c1e00640 1 --2- 172.21.15.175:0/673044011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81c4145250 0x7f81c4143f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c1e00640 1 -- 172.21.15.175:0/673044011 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c4131cd0 con 0x7f81c40cf080 2024-04-25T09:05:48.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c1e00640 1 --2- 172.21.15.175:0/673044011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c40cf080 0x7f81c41662b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f81b400cbc0 tx=0x7f81b400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81ba000640 1 -- 172.21.15.175:0/673044011 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4017070 con 0x7f81c40cf080 2024-04-25T09:05:48.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81ba000640 1 -- 172.21.15.175:0/673044011 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b400ad40 con 0x7f81c40cf080 2024-04-25T09:05:48.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c8c00640 1 -- 172.21.15.175:0/673044011 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c41654f0 con 0x7f81c40cf080 2024-04-25T09:05:48.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81ba000640 1 -- 172.21.15.175:0/673044011 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4012600 con 0x7f81c40cf080 2024-04-25T09:05:48.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c8c00640 1 -- 172.21.15.175:0/673044011 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c4165ab0 con 0x7f81c40cf080 2024-04-25T09:05:48.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.161+0000 7f81c8c00640 1 -- 172.21.15.175:0/673044011 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c4075160 con 0x7f81c40cf080 2024-04-25T09:05:48.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.165+0000 7f81ba000640 1 -- 172.21.15.175:0/673044011 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f81b401a070 con 0x7f81c40cf080 2024-04-25T09:05:48.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.165+0000 7f81ba000640 1 --2- 172.21.15.175:0/673044011 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f81a4066f60 0x7f81a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.165+0000 7f81ba000640 1 -- 172.21.15.175:0/673044011 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81b4084e60 con 0x7f81c40cf080 2024-04-25T09:05:48.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.165+0000 7f81c1400640 1 --2- 172.21.15.175:0/673044011 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f81a4066f60 0x7f81a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.165+0000 7f81c1400640 1 --2- 172.21.15.175:0/673044011 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f81a4066f60 0x7f81a4069420 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f81c40cc640 tx=0x7f81b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.169+0000 7f81ba000640 1 -- 172.21.15.175:0/673044011 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f81b4055780 con 0x7f81c40cf080 2024-04-25T09:05:48.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.353+0000 7f81c8c00640 1 -- 172.21.15.175:0/673044011 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f81c41671f0 con 0x7f81c40cf080 2024-04-25T09:05:48.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.985+0000 7f81ba000640 1 -- 172.21.15.175:0/673044011 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7f81b4059820 con 0x7f81c40cf080 2024-04-25T09:05:48.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.985+0000 7f81c8c00640 1 -- 172.21.15.175:0/673044011 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f81a4066f60 msgr2=0x7f81a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.985+0000 7f81c8c00640 1 --2- 172.21.15.175:0/673044011 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f81a4066f60 0x7f81a4069420 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f81c40cc640 tx=0x7f81b0009040 comp rx=0 tx=0).stop 2024-04-25T09:05:48.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.985+0000 7f81c8c00640 1 -- 172.21.15.175:0/673044011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c40cf080 msgr2=0x7f81c41662b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.985+0000 7f81c8c00640 1 --2- 172.21.15.175:0/673044011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c40cf080 0x7f81c41662b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f81b400cbc0 tx=0x7f81b400a430 comp rx=0 tx=0).stop 2024-04-25T09:05:48.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.985+0000 7f81c8c00640 1 -- 172.21.15.175:0/673044011 shutdown_connections 2024-04-25T09:05:48.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.985+0000 7f81c8c00640 1 --2- 172.21.15.175:0/673044011 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f81a4066f60 0x7f81a4069420 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.985+0000 7f81c8c00640 1 --2- 172.21.15.175:0/673044011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81c4145250 0x7f81c4143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.985+0000 7f81c8c00640 1 --2- 172.21.15.175:0/673044011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81c40cf6b0 0x7f81c41638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.985+0000 7f81c8c00640 1 --2- 172.21.15.175:0/673044011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81c40cf080 0x7f81c41662b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.985+0000 7f81c8c00640 1 -- 172.21.15.175:0/673044011 >> 172.21.15.175:0/673044011 conn(0x7f81c406ac50 msgr2=0x7f81c406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:48.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.985+0000 7f81c8c00640 1 -- 172.21.15.175:0/673044011 shutdown_connections 2024-04-25T09:05:48.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:48.985+0000 7f81c8c00640 1 -- 172.21.15.175:0/673044011 wait complete. 2024-04-25T09:05:48.998 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:05:48.998 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:49.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.145+0000 7f74c4e00640 1 Processor -- start 2024-04-25T09:05:49.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.145+0000 7f74c4e00640 1 -- start start 2024-04-25T09:05:49.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.145+0000 7f74c4e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f74c0144fc0 0x7f74c00cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.145+0000 7f74c4e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c015cd00 con 0x7f74c015c5e0 2024-04-25T09:05:49.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.145+0000 7f74c4e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c00ce660 con 0x7f74c01453a0 2024-04-25T09:05:49.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.145+0000 7f74c4e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c00cc930 con 0x7f74c0144fc0 2024-04-25T09:05:49.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.145+0000 7f74be800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f74c015c5e0 0x7f74c00cee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44788/0 (socket says 172.21.15.175:44788) 2024-04-25T09:05:49.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.145+0000 7f74be800640 1 -- 172.21.15.175:0/1392854989 learned_addr learned my addr 172.21.15.175:0/1392854989 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:49.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bde00640 1 --2- 172.21.15.175:0/1392854989 >> v2:172.21.15.177:3300/0 conn(0x7f74c0144fc0 0x7f74c00cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bca00640 1 -- 172.21.15.175:0/1392854989 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606666523 0 0) 0x7f74c015cd00 con 0x7f74c015c5e0 2024-04-25T09:05:49.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bca00640 1 -- 172.21.15.175:0/1392854989 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74a4003530 con 0x7f74c015c5e0 2024-04-25T09:05:49.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bca00640 1 -- 172.21.15.175:0/1392854989 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3055867663 0 0) 0x7f74a4003530 con 0x7f74c015c5e0 2024-04-25T09:05:49.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bca00640 1 -- 172.21.15.175:0/1392854989 >> v2:172.21.15.177:3300/0 conn(0x7f74c0144fc0 msgr2=0x7f74c00cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:49.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bca00640 1 --2- 172.21.15.175:0/1392854989 >> v2:172.21.15.177:3300/0 conn(0x7f74c0144fc0 0x7f74c00cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bca00640 1 -- 172.21.15.175:0/1392854989 >> v1:172.21.15.177:6789/0 conn(0x7f74c01453a0 legacy=0x7f74c015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bca00640 1 -- 172.21.15.175:0/1392854989 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c00ccc10 con 0x7f74c015c5e0 2024-04-25T09:05:49.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bca00640 1 -- 172.21.15.175:0/1392854989 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f74b8001a00 con 0x7f74c015c5e0 2024-04-25T09:05:49.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bca00640 1 -- 172.21.15.175:0/1392854989 >> v1:172.21.15.175:6789/0 conn(0x7f74c015c5e0 legacy=0x7f74c00cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bca00640 1 --2- 172.21.15.175:0/1392854989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74a40039c0 0x7f74a4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bca00640 1 --2- 172.21.15.175:0/1392854989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74a4004810 0x7f74a4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bca00640 1 --2- 172.21.15.175:0/1392854989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74a40051d0 0x7f74a400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bca00640 1 -- 172.21.15.175:0/1392854989 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c00cc930 con 0x7f74a40039c0 2024-04-25T09:05:49.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bca00640 1 -- 172.21.15.175:0/1392854989 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a400c070 con 0x7f74a4004810 2024-04-25T09:05:49.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bca00640 1 -- 172.21.15.175:0/1392854989 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a400c270 con 0x7f74a40051d0 2024-04-25T09:05:49.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bde00640 1 --2- 172.21.15.175:0/1392854989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74a40039c0 0x7f74a4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bd400640 1 --2- 172.21.15.175:0/1392854989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74a4004810 0x7f74a4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74be800640 1 --2- 172.21.15.175:0/1392854989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74a40051d0 0x7f74a400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bde00640 1 -- 172.21.15.175:0/1392854989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74a40051d0 msgr2=0x7f74a400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:49.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bde00640 1 --2- 172.21.15.175:0/1392854989 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74a40051d0 0x7f74a400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bde00640 1 -- 172.21.15.175:0/1392854989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74a4004810 msgr2=0x7f74a4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:49.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bde00640 1 --2- 172.21.15.175:0/1392854989 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74a4004810 0x7f74a4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74be800640 1 -- 172.21.15.175:0/1392854989 reap_dead start 2024-04-25T09:05:49.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.149+0000 7f74bde00640 1 -- 172.21.15.175:0/1392854989 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a4003530 con 0x7f74a40039c0 2024-04-25T09:05:49.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74bde00640 1 --2- 172.21.15.175:0/1392854989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74a40039c0 0x7f74a4003de0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009ae0 tx=0x7f74b001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e417acda10283d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74bca00640 1 -- 172.21.15.175:0/1392854989 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b00b2070 con 0x7f74a40039c0 2024-04-25T09:05:49.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74bca00640 1 -- 172.21.15.175:0/1392854989 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b00a5530 con 0x7f74a40039c0 2024-04-25T09:05:49.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74bca00640 1 -- 172.21.15.175:0/1392854989 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b00096b0 con 0x7f74a40039c0 2024-04-25T09:05:49.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74c4e00640 1 -- 172.21.15.175:0/1392854989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74a40039c0 msgr2=0x7f74a4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74c4e00640 1 --2- 172.21.15.175:0/1392854989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74a40039c0 0x7f74a4003de0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009ae0 tx=0x7f74b001ca70 comp rx=0 tx=0).stop 2024-04-25T09:05:49.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74c4e00640 1 -- 172.21.15.175:0/1392854989 shutdown_connections 2024-04-25T09:05:49.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74c4e00640 1 --2- 172.21.15.175:0/1392854989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74a40039c0 0x7f74a4003de0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74c4e00640 1 -- 172.21.15.175:0/1392854989 >> 172.21.15.175:0/1392854989 conn(0x7f74c0067150 msgr2=0x7f74c006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:49.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74c4e00640 1 -- 172.21.15.175:0/1392854989 shutdown_connections 2024-04-25T09:05:49.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74c4e00640 1 -- 172.21.15.175:0/1392854989 wait complete. 2024-04-25T09:05:49.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74c4e00640 1 Processor -- start 2024-04-25T09:05:49.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74c4e00640 1 -- start start 2024-04-25T09:05:49.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74c4e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74c015b1a0 0x7f74c00b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74c4e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74c00b4330 0x7f74c013bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74c4e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74c015b580 0x7f74c00b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74c4e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c015f600 con 0x7f74c00b4330 2024-04-25T09:05:49.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74c4e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c015f480 con 0x7f74c015b580 2024-04-25T09:05:49.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.153+0000 7f74c4e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c015f780 con 0x7f74c015b1a0 2024-04-25T09:05:49.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74bd400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74c00b4330 0x7f74c013bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74bd400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74c00b4330 0x7f74c013bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50780/0 (socket says 172.21.15.175:50780) 2024-04-25T09:05:49.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74bd400640 1 -- 172.21.15.175:0/3006959500 learned_addr learned my addr 172.21.15.175:0/3006959500 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:49.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74bde00640 1 --2- 172.21.15.175:0/3006959500 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74c015b1a0 0x7f74c00b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74be800640 1 --2- 172.21.15.175:0/3006959500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74c015b580 0x7f74c00b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74bd400640 1 -- 172.21.15.175:0/3006959500 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74c015b1a0 msgr2=0x7f74c00b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74bd400640 1 --2- 172.21.15.175:0/3006959500 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74c015b1a0 0x7f74c00b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74bd400640 1 -- 172.21.15.175:0/3006959500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74c015b580 msgr2=0x7f74c00b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74bd400640 1 --2- 172.21.15.175:0/3006959500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74c015b580 0x7f74c00b0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74bd400640 1 -- 172.21.15.175:0/3006959500 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c00aca90 con 0x7f74c00b4330 2024-04-25T09:05:49.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74be800640 1 --2- 172.21.15.175:0/3006959500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74c015b580 0x7f74c00b0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:49.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74bd400640 1 --2- 172.21.15.175:0/3006959500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74c00b4330 0x7f74c013bb40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00e410 tx=0x7f74ac00e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74b6000640 1 -- 172.21.15.175:0/3006959500 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac019070 con 0x7f74c00b4330 2024-04-25T09:05:49.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74b6000640 1 -- 172.21.15.175:0/3006959500 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac005320 con 0x7f74c00b4330 2024-04-25T09:05:49.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74c4e00640 1 -- 172.21.15.175:0/3006959500 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c00acd70 con 0x7f74c00b4330 2024-04-25T09:05:49.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74b6000640 1 -- 172.21.15.175:0/3006959500 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac007270 con 0x7f74c00b4330 2024-04-25T09:05:49.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74c4e00640 1 -- 172.21.15.175:0/3006959500 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c00b0900 con 0x7f74c00b4330 2024-04-25T09:05:49.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74c4e00640 1 -- 172.21.15.175:0/3006959500 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c0074a60 con 0x7f74c00b4330 2024-04-25T09:05:49.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74b6000640 1 -- 172.21.15.175:0/3006959500 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f74ac01c070 con 0x7f74c00b4330 2024-04-25T09:05:49.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74b6000640 1 --2- 172.21.15.175:0/3006959500 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f74a0066f60 0x7f74a0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.157+0000 7f74b6000640 1 -- 172.21.15.175:0/3006959500 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74ac084660 con 0x7f74c00b4330 2024-04-25T09:05:49.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.161+0000 7f74bde00640 1 --2- 172.21.15.175:0/3006959500 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f74a0066f60 0x7f74a0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.161+0000 7f74bde00640 1 --2- 172.21.15.175:0/3006959500 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f74a0066f60 0x7f74a0069420 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f74b00af000 tx=0x7f74b00046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.165+0000 7f74b6000640 1 -- 172.21.15.175:0/3006959500 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f74ac054f80 con 0x7f74c00b4330 2024-04-25T09:05:49.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.349+0000 7f74c4e00640 1 -- 172.21.15.175:0/3006959500 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74c00cfb40 con 0x7f74c00b4330 2024-04-25T09:05:49.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.349+0000 7f74b6000640 1 -- 172.21.15.175:0/3006959500 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f74ac059020 con 0x7f74c00b4330 2024-04-25T09:05:49.340 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:49.340 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5102,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2763692769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2763692769},{"type":"v1","addr":"172.21.15.175:6837","nonce":2763692769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3823569323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3823569323},{"type":"v1","addr":"172.21.15.177:6834","nonce":3823569323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2687013607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2687013607},{"type":"v1","addr":"172.21.15.177:6835","nonce":2687013607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:45.332647+0000","modified":"2024-04-25T09:05:48.357816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6836/1389262120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1389262120},{"type":"v1","addr":"172.21.15.175:6836","nonce":1389262120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:05:49.341 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 25 2024-04-25T09:05:49.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.353+0000 7f74c4e00640 1 -- 172.21.15.175:0/3006959500 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f74a0066f60 msgr2=0x7f74a0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.353+0000 7f74c4e00640 1 --2- 172.21.15.175:0/3006959500 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f74a0066f60 0x7f74a0069420 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f74b00af000 tx=0x7f74b00046d0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.353+0000 7f74c4e00640 1 -- 172.21.15.175:0/3006959500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74c00b4330 msgr2=0x7f74c013bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.353+0000 7f74c4e00640 1 --2- 172.21.15.175:0/3006959500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74c00b4330 0x7f74c013bb40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00e410 tx=0x7f74ac00e8d0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.353+0000 7f74c4e00640 1 -- 172.21.15.175:0/3006959500 shutdown_connections 2024-04-25T09:05:49.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.353+0000 7f74c4e00640 1 --2- 172.21.15.175:0/3006959500 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f74a0066f60 0x7f74a0069420 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.353+0000 7f74c4e00640 1 --2- 172.21.15.175:0/3006959500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74c015b580 0x7f74c00b0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.353+0000 7f74c4e00640 1 --2- 172.21.15.175:0/3006959500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74c00b4330 0x7f74c013bb40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.353+0000 7f74c4e00640 1 --2- 172.21.15.175:0/3006959500 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f74c015b1a0 0x7f74c00b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.353+0000 7f74c4e00640 1 -- 172.21.15.175:0/3006959500 >> 172.21.15.175:0/3006959500 conn(0x7f74a40039c0 msgr2=0x7f74c0141e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:49.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.353+0000 7f74c4e00640 1 -- 172.21.15.175:0/3006959500 shutdown_connections 2024-04-25T09:05:49.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.353+0000 7f74c4e00640 1 -- 172.21.15.175:0/3006959500 wait complete. 2024-04-25T09:05:49.361 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:49.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.505+0000 7f415fa00640 1 Processor -- start 2024-04-25T09:05:49.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.509+0000 7f415fa00640 1 -- start start 2024-04-25T09:05:49.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.509+0000 7f415fa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4158144fc0 0x7f41580cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.509+0000 7f415fa00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41581453a0 0x7f415815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.509+0000 7f415fa00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f415815cd00 con 0x7f41580cc3b0 2024-04-25T09:05:49.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.509+0000 7f415fa00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41580ce660 con 0x7f41581453a0 2024-04-25T09:05:49.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.509+0000 7f415fa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41580cc930 con 0x7f4158144fc0 2024-04-25T09:05:49.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.509+0000 7f414fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41581453a0 0x7f415815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.509+0000 7f414fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41581453a0 0x7f415815bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53320/0 (socket says 172.21.15.175:53320) 2024-04-25T09:05:49.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.509+0000 7f414fe00640 1 -- 172.21.15.175:0/4294484477 learned_addr learned my addr 172.21.15.175:0/4294484477 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:49.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.509+0000 7f415d000640 1 --2- 172.21.15.175:0/4294484477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4158144fc0 0x7f41580cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.509+0000 7f414fe00640 1 -- 172.21.15.175:0/4294484477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4158144fc0 msgr2=0x7f41580cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:49.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.509+0000 7f414fe00640 1 --2- 172.21.15.175:0/4294484477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4158144fc0 0x7f41580cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.509+0000 7f414fe00640 1 -- 172.21.15.175:0/4294484477 >> v1:172.21.15.175:6789/0 conn(0x7f41580cc3b0 legacy=0x7f415815f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.509+0000 7f414fe00640 1 -- 172.21.15.175:0/4294484477 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41580ccc10 con 0x7f41581453a0 2024-04-25T09:05:49.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.509+0000 7f4157e00640 1 -- 172.21.15.175:0/4294484477 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001788162 0 0) 0x7f415815cd00 con 0x7f41580cc3b0 2024-04-25T09:05:49.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.513+0000 7f414fe00640 1 --2- 172.21.15.175:0/4294484477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41581453a0 0x7f415815bed0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4140009870 tx=0x7f414001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62cc9a0241f5382a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.513+0000 7f4157e00640 1 -- 172.21.15.175:0/4294484477 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41400ab650 con 0x7f41581453a0 2024-04-25T09:05:49.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.513+0000 7f4157e00640 1 -- 172.21.15.175:0/4294484477 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41400b0070 con 0x7f41581453a0 2024-04-25T09:05:49.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.513+0000 7f4157e00640 1 -- 172.21.15.175:0/4294484477 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41400aba10 con 0x7f41581453a0 2024-04-25T09:05:49.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.513+0000 7f415fa00640 1 -- 172.21.15.175:0/4294484477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41581453a0 msgr2=0x7f415815bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.513+0000 7f415fa00640 1 --2- 172.21.15.175:0/4294484477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41581453a0 0x7f415815bed0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4140009870 tx=0x7f414001c560 comp rx=0 tx=0).stop 2024-04-25T09:05:49.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.513+0000 7f415fa00640 1 -- 172.21.15.175:0/4294484477 shutdown_connections 2024-04-25T09:05:49.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.513+0000 7f415fa00640 1 --2- 172.21.15.175:0/4294484477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41581453a0 0x7f415815bed0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.513+0000 7f415fa00640 1 --2- 172.21.15.175:0/4294484477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4158144fc0 0x7f41580cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.513+0000 7f415fa00640 1 -- 172.21.15.175:0/4294484477 >> 172.21.15.175:0/4294484477 conn(0x7f4158067150 msgr2=0x7f415806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:49.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.513+0000 7f415fa00640 1 -- 172.21.15.175:0/4294484477 shutdown_connections 2024-04-25T09:05:49.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.513+0000 7f415fa00640 1 -- 172.21.15.175:0/4294484477 wait complete. 2024-04-25T09:05:49.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.513+0000 7f415fa00640 1 Processor -- start 2024-04-25T09:05:49.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.513+0000 7f415fa00640 1 -- start start 2024-04-25T09:05:49.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415fa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4158144fc0 0x7f41580af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415fa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41581453a0 0x7f4158158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415fa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4158159090 0x7f41581425c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415fa00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41580cffb0 con 0x7f4158144fc0 2024-04-25T09:05:49.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415fa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41580cfe30 con 0x7f41581453a0 2024-04-25T09:05:49.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415fa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41581685f0 con 0x7f4158159090 2024-04-25T09:05:49.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415d000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4158144fc0 0x7f41580af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415d000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4158144fc0 0x7f41580af760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53324/0 (socket says 172.21.15.175:53324) 2024-04-25T09:05:49.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415d000640 1 -- 172.21.15.175:0/1370819988 learned_addr learned my addr 172.21.15.175:0/1370819988 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:49.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f414fe00640 1 --2- 172.21.15.175:0/1370819988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41581453a0 0x7f4158158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415da00640 1 --2- 172.21.15.175:0/1370819988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4158159090 0x7f41581425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415d000640 1 -- 172.21.15.175:0/1370819988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4158159090 msgr2=0x7f41581425c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415d000640 1 --2- 172.21.15.175:0/1370819988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4158159090 0x7f41581425c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415d000640 1 -- 172.21.15.175:0/1370819988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41581453a0 msgr2=0x7f4158158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415d000640 1 --2- 172.21.15.175:0/1370819988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41581453a0 0x7f4158158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415d000640 1 -- 172.21.15.175:0/1370819988 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415813d4b0 con 0x7f4158144fc0 2024-04-25T09:05:49.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415d000640 1 --2- 172.21.15.175:0/1370819988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4158144fc0 0x7f41580af760 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f414800e960 tx=0x7f414800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f4155600640 1 -- 172.21.15.175:0/1370819988 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4148017070 con 0x7f4158144fc0 2024-04-25T09:05:49.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f4155600640 1 -- 172.21.15.175:0/1370819988 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414800ca00 con 0x7f4158144fc0 2024-04-25T09:05:49.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f4155600640 1 -- 172.21.15.175:0/1370819988 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414800cdb0 con 0x7f4158144fc0 2024-04-25T09:05:49.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415fa00640 1 -- 172.21.15.175:0/1370819988 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415813d790 con 0x7f4158144fc0 2024-04-25T09:05:49.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415fa00640 1 -- 172.21.15.175:0/1370819988 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4158158350 con 0x7f4158144fc0 2024-04-25T09:05:49.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f415fa00640 1 -- 172.21.15.175:0/1370819988 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4158074a60 con 0x7f4158144fc0 2024-04-25T09:05:49.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.517+0000 7f4155600640 1 -- 172.21.15.175:0/1370819988 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f414801a070 con 0x7f4158144fc0 2024-04-25T09:05:49.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.521+0000 7f4155600640 1 --2- 172.21.15.175:0/1370819988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4134066f60 0x7f4134069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.521+0000 7f4155600640 1 -- 172.21.15.175:0/1370819988 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4148085300 con 0x7f4158144fc0 2024-04-25T09:05:49.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.521+0000 7f414fe00640 1 --2- 172.21.15.175:0/1370819988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4134066f60 0x7f4134069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.521+0000 7f414fe00640 1 --2- 172.21.15.175:0/1370819988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4134066f60 0x7f4134069420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f41400af000 tx=0x7f41400a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.525+0000 7f4155600640 1 -- 172.21.15.175:0/1370819988 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4148055d50 con 0x7f4158144fc0 2024-04-25T09:05:49.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.681+0000 7f415fa00640 1 -- 172.21.15.175:0/1370819988 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f415813e890 con 0x7f4158144fc0 2024-04-25T09:05:49.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.681+0000 7f4155600640 1 -- 172.21.15.175:0/1370819988 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16649 (secure 0 0 0) 0x7f4148059df0 con 0x7f4158144fc0 2024-04-25T09:05:49.671 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:49.671 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":44,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:05:46.974078+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:43.050603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:44.332424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:49.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.681+0000 7f415fa00640 1 -- 172.21.15.175:0/1370819988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4134066f60 msgr2=0x7f4134069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.681+0000 7f415fa00640 1 --2- 172.21.15.175:0/1370819988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4134066f60 0x7f4134069420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f41400af000 tx=0x7f41400a7000 comp rx=0 tx=0).stop 2024-04-25T09:05:49.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.681+0000 7f415fa00640 1 -- 172.21.15.175:0/1370819988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4158144fc0 msgr2=0x7f41580af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.681+0000 7f415fa00640 1 --2- 172.21.15.175:0/1370819988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4158144fc0 0x7f41580af760 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f414800e960 tx=0x7f414800ee20 comp rx=0 tx=0).stop 2024-04-25T09:05:49.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.681+0000 7f415fa00640 1 -- 172.21.15.175:0/1370819988 shutdown_connections 2024-04-25T09:05:49.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.681+0000 7f415fa00640 1 --2- 172.21.15.175:0/1370819988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4134066f60 0x7f4134069420 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.681+0000 7f415fa00640 1 --2- 172.21.15.175:0/1370819988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4158159090 0x7f41581425c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.681+0000 7f415fa00640 1 --2- 172.21.15.175:0/1370819988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41581453a0 0x7f4158158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.681+0000 7f415fa00640 1 --2- 172.21.15.175:0/1370819988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4158144fc0 0x7f41580af760 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.681+0000 7f415fa00640 1 -- 172.21.15.175:0/1370819988 >> 172.21.15.175:0/1370819988 conn(0x7f41580cc3b0 msgr2=0x7f415815d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:49.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.685+0000 7f415fa00640 1 -- 172.21.15.175:0/1370819988 shutdown_connections 2024-04-25T09:05:49.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.685+0000 7f415fa00640 1 -- 172.21.15.175:0/1370819988 wait complete. 2024-04-25T09:05:49.693 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:05:49.693 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:05:49.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.837+0000 7faf40c00640 1 Processor -- start 2024-04-25T09:05:49.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.841+0000 7faf40c00640 1 -- start start 2024-04-25T09:05:49.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.841+0000 7faf40c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c06bd60 0x7faf3c06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.841+0000 7faf40c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3c0cfcb0 con 0x7faf3c099a50 2024-04-25T09:05:49.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.841+0000 7faf40c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3c0cff90 con 0x7faf3c0d0d50 2024-04-25T09:05:49.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.841+0000 7faf40c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c0d0270 con 0x7faf3c06bd60 2024-04-25T09:05:49.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.841+0000 7faf39e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7faf3c099a50 0x7faf3c099e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39016/0 (socket says 172.21.15.175:39016) 2024-04-25T09:05:49.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.841+0000 7faf39e00640 1 -- 172.21.15.175:0/88707910 learned_addr learned my addr 172.21.15.175:0/88707910 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:49.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.841+0000 7faf31400640 1 --2- 172.21.15.175:0/88707910 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c06bd60 0x7faf3c06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.841+0000 7faf39400640 1 -- 172.21.15.175:0/88707910 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476175992 0 0) 0x7faf3c0cfcb0 con 0x7faf3c099a50 2024-04-25T09:05:49.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.841+0000 7faf39400640 1 -- 172.21.15.175:0/88707910 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf20003530 con 0x7faf3c099a50 2024-04-25T09:05:49.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.841+0000 7faf39400640 1 -- 172.21.15.175:0/88707910 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660268023 0 0) 0x7faf3c0cff90 con 0x7faf3c0d0d50 2024-04-25T09:05:49.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.841+0000 7faf39400640 1 -- 172.21.15.175:0/88707910 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf3c0cfcb0 con 0x7faf3c0d0d50 2024-04-25T09:05:49.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.841+0000 7faf31400640 1 -- 172.21.15.175:0/88707910 >> v1:172.21.15.177:6789/0 conn(0x7faf3c0d0d50 legacy=0x7faf3c0cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.841+0000 7faf31400640 1 -- 172.21.15.175:0/88707910 >> v1:172.21.15.175:6789/0 conn(0x7faf3c099a50 legacy=0x7faf3c099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.841+0000 7faf31400640 1 -- 172.21.15.175:0/88707910 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c0d0550 con 0x7faf3c06bd60 2024-04-25T09:05:49.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.845+0000 7faf31400640 1 --2- 172.21.15.175:0/88707910 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c06bd60 0x7faf3c06cc50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faf240097f0 tx=0x7faf2401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9705cd5e1fc6dda0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.845+0000 7faf39400640 1 -- 172.21.15.175:0/88707910 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf240b0070 con 0x7faf3c06bd60 2024-04-25T09:05:49.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.845+0000 7faf39400640 1 -- 172.21.15.175:0/88707910 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf240ab600 con 0x7faf3c06bd60 2024-04-25T09:05:49.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.845+0000 7faf39400640 1 -- 172.21.15.175:0/88707910 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf240ab9d0 con 0x7faf3c06bd60 2024-04-25T09:05:49.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.845+0000 7faf40c00640 1 -- 172.21.15.175:0/88707910 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c06bd60 msgr2=0x7faf3c06cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.845+0000 7faf40c00640 1 --2- 172.21.15.175:0/88707910 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c06bd60 0x7faf3c06cc50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faf240097f0 tx=0x7faf2401c4e0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.845+0000 7faf40c00640 1 -- 172.21.15.175:0/88707910 shutdown_connections 2024-04-25T09:05:49.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.845+0000 7faf40c00640 1 --2- 172.21.15.175:0/88707910 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c06bd60 0x7faf3c06cc50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.845+0000 7faf40c00640 1 -- 172.21.15.175:0/88707910 >> 172.21.15.175:0/88707910 conn(0x7faf3c0b3300 msgr2=0x7faf3c0b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:49.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.845+0000 7faf40c00640 1 -- 172.21.15.175:0/88707910 shutdown_connections 2024-04-25T09:05:49.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.845+0000 7faf40c00640 1 -- 172.21.15.175:0/88707910 wait complete. 2024-04-25T09:05:49.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.845+0000 7faf40c00640 1 Processor -- start 2024-04-25T09:05:49.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf40c00640 1 -- start start 2024-04-25T09:05:49.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf40c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf3c06bd60 0x7faf3c15c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf40c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c099a50 0x7faf3c0c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf40c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf3c0d0d50 0x7faf3c0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf40c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c16c270 con 0x7faf3c0d0d50 2024-04-25T09:05:49.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf40c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c15e070 con 0x7faf3c06bd60 2024-04-25T09:05:49.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf40c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c16c3f0 con 0x7faf3c099a50 2024-04-25T09:05:49.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf3a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf3c0d0d50 0x7faf3c0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf3a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf3c0d0d50 0x7faf3c0b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53336/0 (socket says 172.21.15.175:53336) 2024-04-25T09:05:49.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf3a800640 1 -- 172.21.15.175:0/346158675 learned_addr learned my addr 172.21.15.175:0/346158675 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:49.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf39e00640 1 --2- 172.21.15.175:0/346158675 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf3c06bd60 0x7faf3c15c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf31400640 1 --2- 172.21.15.175:0/346158675 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c099a50 0x7faf3c0c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf3a800640 1 -- 172.21.15.175:0/346158675 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c099a50 msgr2=0x7faf3c0c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf3a800640 1 --2- 172.21.15.175:0/346158675 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c099a50 0x7faf3c0c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf3a800640 1 -- 172.21.15.175:0/346158675 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf3c06bd60 msgr2=0x7faf3c15c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf3a800640 1 --2- 172.21.15.175:0/346158675 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf3c06bd60 0x7faf3c15c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf3a800640 1 -- 172.21.15.175:0/346158675 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c0c96d0 con 0x7faf3c0d0d50 2024-04-25T09:05:49.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf3a800640 1 --2- 172.21.15.175:0/346158675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf3c0d0d50 0x7faf3c0b1660 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faf3400c790 tx=0x7faf3400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf32a00640 1 -- 172.21.15.175:0/346158675 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf34003b80 con 0x7faf3c0d0d50 2024-04-25T09:05:49.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf32a00640 1 -- 172.21.15.175:0/346158675 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf34003d20 con 0x7faf3c0d0d50 2024-04-25T09:05:49.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf40c00640 1 -- 172.21.15.175:0/346158675 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3c0c58e0 con 0x7faf3c0d0d50 2024-04-25T09:05:49.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf32a00640 1 -- 172.21.15.175:0/346158675 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3400aa50 con 0x7faf3c0d0d50 2024-04-25T09:05:49.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf40c00640 1 -- 172.21.15.175:0/346158675 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3c0c6110 con 0x7faf3c0d0d50 2024-04-25T09:05:49.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.849+0000 7faf40c00640 1 -- 172.21.15.175:0/346158675 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3c0c98a0 con 0x7faf3c0d0d50 2024-04-25T09:05:49.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.853+0000 7faf32a00640 1 -- 172.21.15.175:0/346158675 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faf3400abf0 con 0x7faf3c0d0d50 2024-04-25T09:05:49.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.853+0000 7faf32a00640 1 --2- 172.21.15.175:0/346158675 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faf18066f60 0x7faf18069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.853+0000 7faf32a00640 1 -- 172.21.15.175:0/346158675 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf34084f60 con 0x7faf3c0d0d50 2024-04-25T09:05:49.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.853+0000 7faf39e00640 1 --2- 172.21.15.175:0/346158675 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faf18066f60 0x7faf18069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.853+0000 7faf39e00640 1 --2- 172.21.15.175:0/346158675 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faf18066f60 0x7faf18069420 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faf2c000f70 tx=0x7faf2c007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:49.857+0000 7faf32a00640 1 -- 172.21.15.175:0/346158675 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faf34055880 con 0x7faf3c0d0d50 2024-04-25T09:05:50.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.013+0000 7faf40c00640 1 -- 172.21.15.175:0/346158675 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf3c0b7440 con 0x7faf18066f60 2024-04-25T09:05:50.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.021+0000 7faf32a00640 1 -- 172.21.15.175:0/346158675 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251940 (secure 0 0 0) 0x7faf3c0b7440 con 0x7faf18066f60 2024-04-25T09:05:50.013 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:50.015 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:05:50.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.025+0000 7faf40c00640 1 -- 172.21.15.175:0/346158675 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faf18066f60 msgr2=0x7faf18069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.025+0000 7faf40c00640 1 --2- 172.21.15.175:0/346158675 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faf18066f60 0x7faf18069420 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faf2c000f70 tx=0x7faf2c007d40 comp rx=0 tx=0).stop 2024-04-25T09:05:50.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.025+0000 7faf40c00640 1 -- 172.21.15.175:0/346158675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf3c0d0d50 msgr2=0x7faf3c0b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.025+0000 7faf40c00640 1 --2- 172.21.15.175:0/346158675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf3c0d0d50 0x7faf3c0b1660 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7faf3400c790 tx=0x7faf3400cc50 comp rx=0 tx=0).stop 2024-04-25T09:05:50.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.025+0000 7faf40c00640 1 -- 172.21.15.175:0/346158675 shutdown_connections 2024-04-25T09:05:50.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.025+0000 7faf40c00640 1 --2- 172.21.15.175:0/346158675 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faf18066f60 0x7faf18069420 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.025+0000 7faf40c00640 1 --2- 172.21.15.175:0/346158675 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf3c0d0d50 0x7faf3c0b1660 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.025+0000 7faf40c00640 1 --2- 172.21.15.175:0/346158675 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3c099a50 0x7faf3c0c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.025+0000 7faf40c00640 1 --2- 172.21.15.175:0/346158675 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf3c06bd60 0x7faf3c15c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.025+0000 7faf40c00640 1 -- 172.21.15.175:0/346158675 >> 172.21.15.175:0/346158675 conn(0x7faf3c0b3300 msgr2=0x7faf3c06f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:50.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.025+0000 7faf40c00640 1 -- 172.21.15.175:0/346158675 shutdown_connections 2024-04-25T09:05:50.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.025+0000 7faf40c00640 1 -- 172.21.15.175:0/346158675 wait complete. 2024-04-25T09:05:50.033 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-04-25T09:05:49.810097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221400,"kb_used_data":5208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753320,"statfs":{"total":773094113280,"available":772867399680,"internally_reserved":0,"allocated":5332992,"data_stored":2833076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.868579"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985150+0000","last_change":"2024-04-25T09:05:45.996876+0000","last_active":"2024-04-25T09:05:46.985150+0000","last_peered":"2024-04-25T09:05:46.985150+0000","last_clean":"2024-04-25T09:05:46.985150+0000","last_became_active":"2024-04-25T09:05:45.996480+0000","last_became_peered":"2024-04-25T09:05:45.996480+0000","last_unstale":"2024-04-25T09:05:46.985150+0000","last_undegraded":"2024-04-25T09:05:46.985150+0000","last_fullsized":"2024-04-25T09:05:46.985150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:50.747903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.294389+0000","last_change":"2024-04-25T09:05:46.005734+0000","last_active":"2024-04-25T09:05:47.294389+0000","last_peered":"2024-04-25T09:05:47.294389+0000","last_clean":"2024-04-25T09:05:47.294389+0000","last_became_active":"2024-04-25T09:05:46.005271+0000","last_became_peered":"2024-04-25T09:05:46.005271+0000","last_unstale":"2024-04-25T09:05:47.294389+0000","last_undegraded":"2024-04-25T09:05:47.294389+0000","last_fullsized":"2024-04-25T09:05:47.294389+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:50.747903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990649+0000","last_change":"2024-04-25T09:05:45.988820+0000","last_active":"2024-04-25T09:05:46.990649+0000","last_peered":"2024-04-25T09:05:46.990649+0000","last_clean":"2024-04-25T09:05:46.990649+0000","last_became_active":"2024-04-25T09:05:45.987543+0000","last_became_peered":"2024-04-25T09:05:45.987543+0000","last_unstale":"2024-04-25T09:05:46.990649+0000","last_undegraded":"2024-04-25T09:05:46.990649+0000","last_fullsized":"2024-04-25T09:05:46.990649+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:02.301616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.000313+0000","last_change":"2024-04-25T09:05:45.984529+0000","last_active":"2024-04-25T09:05:46.000313+0000","last_peered":"2024-04-25T09:05:46.000313+0000","last_clean":"2024-04-25T09:05:46.000313+0000","last_became_active":"2024-04-25T09:05:45.983997+0000","last_became_peered":"2024-04-25T09:05:45.983997+0000","last_unstale":"2024-04-25T09:05:46.000313+0000","last_undegraded":"2024-04-25T09:05:46.000313+0000","last_fullsized":"2024-04-25T09:05:46.000313+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:32.535178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.294187+0000","last_change":"2024-04-25T09:05:45.985407+0000","last_active":"2024-04-25T09:05:47.294187+0000","last_peered":"2024-04-25T09:05:47.294187+0000","last_clean":"2024-04-25T09:05:47.294187+0000","last_became_active":"2024-04-25T09:05:45.985136+0000","last_became_peered":"2024-04-25T09:05:45.985136+0000","last_unstale":"2024-04-25T09:05:47.294187+0000","last_undegraded":"2024-04-25T09:05:47.294187+0000","last_fullsized":"2024-04-25T09:05:47.294187+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:03.153480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986362+0000","last_change":"2024-04-25T09:05:45.983498+0000","last_active":"2024-04-25T09:05:46.986362+0000","last_peered":"2024-04-25T09:05:46.986362+0000","last_clean":"2024-04-25T09:05:46.986362+0000","last_became_active":"2024-04-25T09:05:45.983191+0000","last_became_peered":"2024-04-25T09:05:45.983191+0000","last_unstale":"2024-04-25T09:05:46.986362+0000","last_undegraded":"2024-04-25T09:05:46.986362+0000","last_fullsized":"2024-04-25T09:05:46.986362+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:46.402394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984352+0000","last_change":"2024-04-25T09:05:45.985129+0000","last_active":"2024-04-25T09:05:46.984352+0000","last_peered":"2024-04-25T09:05:46.984352+0000","last_clean":"2024-04-25T09:05:46.984352+0000","last_became_active":"2024-04-25T09:05:45.984636+0000","last_became_peered":"2024-04-25T09:05:45.984636+0000","last_unstale":"2024-04-25T09:05:46.984352+0000","last_undegraded":"2024-04-25T09:05:46.984352+0000","last_fullsized":"2024-04-25T09:05:46.984352+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:03.153480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.003114+0000","last_change":"2024-04-25T09:05:45.992080+0000","last_active":"2024-04-25T09:05:46.003114+0000","last_peered":"2024-04-25T09:05:46.003114+0000","last_clean":"2024-04-25T09:05:46.003114+0000","last_became_active":"2024-04-25T09:05:45.991743+0000","last_became_peered":"2024-04-25T09:05:45.991743+0000","last_unstale":"2024-04-25T09:05:46.003114+0000","last_undegraded":"2024-04-25T09:05:46.003114+0000","last_fullsized":"2024-04-25T09:05:46.003114+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:30.668192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.000580+0000","last_change":"2024-04-25T09:05:45.984714+0000","last_active":"2024-04-25T09:05:46.000580+0000","last_peered":"2024-04-25T09:05:46.000580+0000","last_clean":"2024-04-25T09:05:46.000580+0000","last_became_active":"2024-04-25T09:05:45.984383+0000","last_became_peered":"2024-04-25T09:05:45.984383+0000","last_unstale":"2024-04-25T09:05:46.000580+0000","last_undegraded":"2024-04-25T09:05:46.000580+0000","last_fullsized":"2024-04-25T09:05:46.000580+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:40.538531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.994895+0000","last_change":"2024-04-25T09:05:45.984064+0000","last_active":"2024-04-25T09:05:45.994895+0000","last_peered":"2024-04-25T09:05:45.994895+0000","last_clean":"2024-04-25T09:05:45.994895+0000","last_became_active":"2024-04-25T09:05:45.983590+0000","last_became_peered":"2024-04-25T09:05:45.983590+0000","last_unstale":"2024-04-25T09:05:45.994895+0000","last_undegraded":"2024-04-25T09:05:45.994895+0000","last_fullsized":"2024-04-25T09:05:45.994895+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:34.837377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.982720+0000","last_change":"2024-04-25T09:05:45.980491+0000","last_active":"2024-04-25T09:05:45.982720+0000","last_peered":"2024-04-25T09:05:45.982720+0000","last_clean":"2024-04-25T09:05:45.982720+0000","last_became_active":"2024-04-25T09:05:45.980193+0000","last_became_peered":"2024-04-25T09:05:45.980193+0000","last_unstale":"2024-04-25T09:05:45.982720+0000","last_undegraded":"2024-04-25T09:05:45.982720+0000","last_fullsized":"2024-04-25T09:05:45.982720+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:22.768061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.294191+0000","last_change":"2024-04-25T09:05:46.000071+0000","last_active":"2024-04-25T09:05:47.294191+0000","last_peered":"2024-04-25T09:05:47.294191+0000","last_clean":"2024-04-25T09:05:47.294191+0000","last_became_active":"2024-04-25T09:05:45.999724+0000","last_became_peered":"2024-04-25T09:05:45.999724+0000","last_unstale":"2024-04-25T09:05:47.294191+0000","last_undegraded":"2024-04-25T09:05:47.294191+0000","last_fullsized":"2024-04-25T09:05:47.294191+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:38.697851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.982207+0000","last_change":"2024-04-25T09:05:45.973026+0000","last_active":"2024-04-25T09:05:46.982207+0000","last_peered":"2024-04-25T09:05:46.982207+0000","last_clean":"2024-04-25T09:05:46.982207+0000","last_became_active":"2024-04-25T09:05:45.972654+0000","last_became_peered":"2024-04-25T09:05:45.972654+0000","last_unstale":"2024-04-25T09:05:46.982207+0000","last_undegraded":"2024-04-25T09:05:46.982207+0000","last_fullsized":"2024-04-25T09:05:46.982207+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:00.024708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.000843+0000","last_change":"2024-04-25T09:05:45.989872+0000","last_active":"2024-04-25T09:05:46.000843+0000","last_peered":"2024-04-25T09:05:46.000843+0000","last_clean":"2024-04-25T09:05:46.000843+0000","last_became_active":"2024-04-25T09:05:45.989603+0000","last_became_peered":"2024-04-25T09:05:45.989603+0000","last_unstale":"2024-04-25T09:05:46.000843+0000","last_undegraded":"2024-04-25T09:05:46.000843+0000","last_fullsized":"2024-04-25T09:05:46.000843+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:30.673511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986319+0000","last_change":"2024-04-25T09:05:45.974213+0000","last_active":"2024-04-25T09:05:46.986319+0000","last_peered":"2024-04-25T09:05:46.986319+0000","last_clean":"2024-04-25T09:05:46.986319+0000","last_became_active":"2024-04-25T09:05:45.973969+0000","last_became_peered":"2024-04-25T09:05:45.973969+0000","last_unstale":"2024-04-25T09:05:46.986319+0000","last_undegraded":"2024-04-25T09:05:46.986319+0000","last_fullsized":"2024-04-25T09:05:46.986319+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:04.244359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984803+0000","last_change":"2024-04-25T09:05:45.993618+0000","last_active":"2024-04-25T09:05:46.984803+0000","last_peered":"2024-04-25T09:05:46.984803+0000","last_clean":"2024-04-25T09:05:46.984803+0000","last_became_active":"2024-04-25T09:05:45.993214+0000","last_became_peered":"2024-04-25T09:05:45.993214+0000","last_unstale":"2024-04-25T09:05:46.984803+0000","last_undegraded":"2024-04-25T09:05:46.984803+0000","last_fullsized":"2024-04-25T09:05:46.984803+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:34.837377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990972+0000","last_change":"2024-04-25T09:05:45.983516+0000","last_active":"2024-04-25T09:05:46.990972+0000","last_peered":"2024-04-25T09:05:46.990972+0000","last_clean":"2024-04-25T09:05:46.990972+0000","last_became_active":"2024-04-25T09:05:45.983155+0000","last_became_peered":"2024-04-25T09:05:45.983155+0000","last_unstale":"2024-04-25T09:05:46.990972+0000","last_undegraded":"2024-04-25T09:05:46.990972+0000","last_fullsized":"2024-04-25T09:05:46.990972+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:27.405724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990731+0000","last_change":"2024-04-25T09:05:45.999149+0000","last_active":"2024-04-25T09:05:46.990731+0000","last_peered":"2024-04-25T09:05:46.990731+0000","last_clean":"2024-04-25T09:05:46.990731+0000","last_became_active":"2024-04-25T09:05:45.998584+0000","last_became_peered":"2024-04-25T09:05:45.998584+0000","last_unstale":"2024-04-25T09:05:46.990731+0000","last_undegraded":"2024-04-25T09:05:46.990731+0000","last_fullsized":"2024-04-25T09:05:46.990731+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:35.080595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985884+0000","last_change":"2024-04-25T09:05:45.986285+0000","last_active":"2024-04-25T09:05:46.985884+0000","last_peered":"2024-04-25T09:05:46.985884+0000","last_clean":"2024-04-25T09:05:46.985884+0000","last_became_active":"2024-04-25T09:05:45.985873+0000","last_became_peered":"2024-04-25T09:05:45.985873+0000","last_unstale":"2024-04-25T09:05:46.985884+0000","last_undegraded":"2024-04-25T09:05:46.985884+0000","last_fullsized":"2024-04-25T09:05:46.985884+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:30.673511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.982333+0000","last_change":"2024-04-25T09:05:45.980530+0000","last_active":"2024-04-25T09:05:46.982333+0000","last_peered":"2024-04-25T09:05:46.982333+0000","last_clean":"2024-04-25T09:05:46.982333+0000","last_became_active":"2024-04-25T09:05:45.980287+0000","last_became_peered":"2024-04-25T09:05:45.980287+0000","last_unstale":"2024-04-25T09:05:46.982333+0000","last_undegraded":"2024-04-25T09:05:46.982333+0000","last_fullsized":"2024-04-25T09:05:46.982333+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:46.155398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986456+0000","last_change":"2024-04-25T09:05:45.981042+0000","last_active":"2024-04-25T09:05:46.986456+0000","last_peered":"2024-04-25T09:05:46.986456+0000","last_clean":"2024-04-25T09:05:46.986456+0000","last_became_active":"2024-04-25T09:05:45.980771+0000","last_became_peered":"2024-04-25T09:05:45.980771+0000","last_unstale":"2024-04-25T09:05:46.986456+0000","last_undegraded":"2024-04-25T09:05:46.986456+0000","last_fullsized":"2024-04-25T09:05:46.986456+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:25.370631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.002430+0000","last_change":"2024-04-25T09:05:45.991526+0000","last_active":"2024-04-25T09:05:46.002430+0000","last_peered":"2024-04-25T09:05:46.002430+0000","last_clean":"2024-04-25T09:05:46.002430+0000","last_became_active":"2024-04-25T09:05:45.991079+0000","last_became_peered":"2024-04-25T09:05:45.991079+0000","last_unstale":"2024-04-25T09:05:46.002430+0000","last_undegraded":"2024-04-25T09:05:46.002430+0000","last_fullsized":"2024-04-25T09:05:46.002430+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:43.593543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984717+0000","last_change":"2024-04-25T09:05:45.983145+0000","last_active":"2024-04-25T09:05:46.984717+0000","last_peered":"2024-04-25T09:05:46.984717+0000","last_clean":"2024-04-25T09:05:46.984717+0000","last_became_active":"2024-04-25T09:05:45.982828+0000","last_became_peered":"2024-04-25T09:05:45.982828+0000","last_unstale":"2024-04-25T09:05:46.984717+0000","last_undegraded":"2024-04-25T09:05:46.984717+0000","last_fullsized":"2024-04-25T09:05:46.984717+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:55.839935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984987+0000","last_change":"2024-04-25T09:05:45.984300+0000","last_active":"2024-04-25T09:05:46.984987+0000","last_peered":"2024-04-25T09:05:46.984987+0000","last_clean":"2024-04-25T09:05:46.984987+0000","last_became_active":"2024-04-25T09:05:45.983379+0000","last_became_peered":"2024-04-25T09:05:45.983379+0000","last_unstale":"2024-04-25T09:05:46.984987+0000","last_undegraded":"2024-04-25T09:05:46.984987+0000","last_fullsized":"2024-04-25T09:05:46.984987+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:23.805432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985942+0000","last_change":"2024-04-25T09:05:45.988863+0000","last_active":"2024-04-25T09:05:46.985942+0000","last_peered":"2024-04-25T09:05:46.985942+0000","last_clean":"2024-04-25T09:05:46.985942+0000","last_became_active":"2024-04-25T09:05:45.988574+0000","last_became_peered":"2024-04-25T09:05:45.988574+0000","last_unstale":"2024-04-25T09:05:46.985942+0000","last_undegraded":"2024-04-25T09:05:46.985942+0000","last_fullsized":"2024-04-25T09:05:46.985942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:43.593543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.982495+0000","last_change":"2024-04-25T09:05:45.975463+0000","last_active":"2024-04-25T09:05:46.982495+0000","last_peered":"2024-04-25T09:05:46.982495+0000","last_clean":"2024-04-25T09:05:46.982495+0000","last_became_active":"2024-04-25T09:05:45.975208+0000","last_became_peered":"2024-04-25T09:05:45.975208+0000","last_unstale":"2024-04-25T09:05:46.982495+0000","last_undegraded":"2024-04-25T09:05:46.982495+0000","last_fullsized":"2024-04-25T09:05:46.982495+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:22.887310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990788+0000","last_change":"2024-04-25T09:05:45.987595+0000","last_active":"2024-04-25T09:05:46.990788+0000","last_peered":"2024-04-25T09:05:46.990788+0000","last_clean":"2024-04-25T09:05:46.990788+0000","last_became_active":"2024-04-25T09:05:45.987330+0000","last_became_peered":"2024-04-25T09:05:45.987330+0000","last_unstale":"2024-04-25T09:05:46.990788+0000","last_undegraded":"2024-04-25T09:05:46.990788+0000","last_fullsized":"2024-04-25T09:05:46.990788+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:52.690987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.294193+0000","last_change":"2024-04-25T09:05:45.989573+0000","last_active":"2024-04-25T09:05:47.294193+0000","last_peered":"2024-04-25T09:05:47.294193+0000","last_clean":"2024-04-25T09:05:47.294193+0000","last_became_active":"2024-04-25T09:05:45.989283+0000","last_became_peered":"2024-04-25T09:05:45.989283+0000","last_unstale":"2024-04-25T09:05:47.294193+0000","last_undegraded":"2024-04-25T09:05:47.294193+0000","last_fullsized":"2024-04-25T09:05:47.294193+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:00.592886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985268+0000","last_change":"2024-04-25T09:05:45.981576+0000","last_active":"2024-04-25T09:05:46.985268+0000","last_peered":"2024-04-25T09:05:46.985268+0000","last_clean":"2024-04-25T09:05:46.985268+0000","last_became_active":"2024-04-25T09:05:45.981254+0000","last_became_peered":"2024-04-25T09:05:45.981254+0000","last_unstale":"2024-04-25T09:05:46.985268+0000","last_undegraded":"2024-04-25T09:05:46.985268+0000","last_fullsized":"2024-04-25T09:05:46.985268+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:40.538531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990540+0000","last_change":"2024-04-25T09:05:45.983290+0000","last_active":"2024-04-25T09:05:46.990540+0000","last_peered":"2024-04-25T09:05:46.990540+0000","last_clean":"2024-04-25T09:05:46.990540+0000","last_became_active":"2024-04-25T09:05:45.982970+0000","last_became_peered":"2024-04-25T09:05:45.982970+0000","last_unstale":"2024-04-25T09:05:46.990540+0000","last_undegraded":"2024-04-25T09:05:46.990540+0000","last_fullsized":"2024-04-25T09:05:46.990540+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:14.344862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986427+0000","last_change":"2024-04-25T09:05:45.987881+0000","last_active":"2024-04-25T09:05:46.986427+0000","last_peered":"2024-04-25T09:05:46.986427+0000","last_clean":"2024-04-25T09:05:46.986427+0000","last_became_active":"2024-04-25T09:05:45.987552+0000","last_became_peered":"2024-04-25T09:05:45.987552+0000","last_unstale":"2024-04-25T09:05:46.986427+0000","last_undegraded":"2024-04-25T09:05:46.986427+0000","last_fullsized":"2024-04-25T09:05:46.986427+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:33.625785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.982117+0000","last_change":"2024-04-25T09:05:45.985763+0000","last_active":"2024-04-25T09:05:46.982117+0000","last_peered":"2024-04-25T09:05:46.982117+0000","last_clean":"2024-04-25T09:05:46.982117+0000","last_became_active":"2024-04-25T09:05:45.985478+0000","last_became_peered":"2024-04-25T09:05:45.985478+0000","last_unstale":"2024-04-25T09:05:46.982117+0000","last_undegraded":"2024-04-25T09:05:46.982117+0000","last_fullsized":"2024-04-25T09:05:46.982117+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:08.188262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.980644+0000","last_change":"2024-04-25T09:05:45.976299+0000","last_active":"2024-04-25T09:05:45.980644+0000","last_peered":"2024-04-25T09:05:45.980644+0000","last_clean":"2024-04-25T09:05:45.980644+0000","last_became_active":"2024-04-25T09:05:45.976022+0000","last_became_peered":"2024-04-25T09:05:45.976022+0000","last_unstale":"2024-04-25T09:05:45.980644+0000","last_undegraded":"2024-04-25T09:05:45.980644+0000","last_fullsized":"2024-04-25T09:05:45.980644+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.314784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986872+0000","last_change":"2024-04-25T09:05:44.969727+0000","last_active":"2024-04-25T09:05:46.986872+0000","last_peered":"2024-04-25T09:05:46.986872+0000","last_clean":"2024-04-25T09:05:46.986872+0000","last_became_active":"2024-04-25T09:05:44.969335+0000","last_became_peered":"2024-04-25T09:05:44.969335+0000","last_unstale":"2024-04-25T09:05:46.986872+0000","last_undegraded":"2024-04-25T09:05:46.986872+0000","last_fullsized":"2024-04-25T09:05:46.986872+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:06.675601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985912+0000","last_change":"2024-04-25T09:05:45.982190+0000","last_active":"2024-04-25T09:05:46.985912+0000","last_peered":"2024-04-25T09:05:46.985912+0000","last_clean":"2024-04-25T09:05:46.985912+0000","last_became_active":"2024-04-25T09:05:45.981836+0000","last_became_peered":"2024-04-25T09:05:45.981836+0000","last_unstale":"2024-04-25T09:05:46.985912+0000","last_undegraded":"2024-04-25T09:05:46.985912+0000","last_fullsized":"2024-04-25T09:05:46.985912+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:13.815001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990946+0000","last_change":"2024-04-25T09:05:44.965988+0000","last_active":"2024-04-25T09:05:46.990946+0000","last_peered":"2024-04-25T09:05:46.990946+0000","last_clean":"2024-04-25T09:05:46.990946+0000","last_became_active":"2024-04-25T09:05:44.965633+0000","last_became_peered":"2024-04-25T09:05:44.965633+0000","last_unstale":"2024-04-25T09:05:46.990946+0000","last_undegraded":"2024-04-25T09:05:46.990946+0000","last_fullsized":"2024-04-25T09:05:46.990946+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:39.532486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.294406+0000","last_change":"2024-04-25T09:05:45.991219+0000","last_active":"2024-04-25T09:05:47.294406+0000","last_peered":"2024-04-25T09:05:47.294406+0000","last_clean":"2024-04-25T09:05:47.294406+0000","last_became_active":"2024-04-25T09:05:45.990946+0000","last_became_peered":"2024-04-25T09:05:45.990946+0000","last_unstale":"2024-04-25T09:05:47.294406+0000","last_undegraded":"2024-04-25T09:05:47.294406+0000","last_fullsized":"2024-04-25T09:05:47.294406+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:34.295608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.997224+0000","last_change":"2024-04-25T09:05:44.965804+0000","last_active":"2024-04-25T09:05:45.997224+0000","last_peered":"2024-04-25T09:05:45.997224+0000","last_clean":"2024-04-25T09:05:45.997224+0000","last_became_active":"2024-04-25T09:05:44.965545+0000","last_became_peered":"2024-04-25T09:05:44.965545+0000","last_unstale":"2024-04-25T09:05:45.997224+0000","last_undegraded":"2024-04-25T09:05:45.997224+0000","last_fullsized":"2024-04-25T09:05:45.997224+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:42.587498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.005571+0000","last_change":"2024-04-25T09:05:45.996080+0000","last_active":"2024-04-25T09:05:46.005571+0000","last_peered":"2024-04-25T09:05:46.005571+0000","last_clean":"2024-04-25T09:05:46.005571+0000","last_became_active":"2024-04-25T09:05:45.995637+0000","last_became_peered":"2024-04-25T09:05:45.995637+0000","last_unstale":"2024-04-25T09:05:46.005571+0000","last_undegraded":"2024-04-25T09:05:46.005571+0000","last_fullsized":"2024-04-25T09:05:46.005571+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:14.322200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984519+0000","last_change":"2024-04-25T09:05:44.968925+0000","last_active":"2024-04-25T09:05:46.984519+0000","last_peered":"2024-04-25T09:05:46.984519+0000","last_clean":"2024-04-25T09:05:46.984519+0000","last_became_active":"2024-04-25T09:05:44.968603+0000","last_became_peered":"2024-04-25T09:05:44.968603+0000","last_unstale":"2024-04-25T09:05:46.984519+0000","last_undegraded":"2024-04-25T09:05:46.984519+0000","last_fullsized":"2024-04-25T09:05:46.984519+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:34.074550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990547+0000","last_change":"2024-04-25T09:05:45.986138+0000","last_active":"2024-04-25T09:05:46.990547+0000","last_peered":"2024-04-25T09:05:46.990547+0000","last_clean":"2024-04-25T09:05:46.990547+0000","last_became_active":"2024-04-25T09:05:45.985835+0000","last_became_peered":"2024-04-25T09:05:45.985835+0000","last_unstale":"2024-04-25T09:05:46.990547+0000","last_undegraded":"2024-04-25T09:05:46.990547+0000","last_fullsized":"2024-04-25T09:05:46.990547+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:43.013672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986586+0000","last_change":"2024-04-25T09:05:44.971825+0000","last_active":"2024-04-25T09:05:46.986586+0000","last_peered":"2024-04-25T09:05:46.986586+0000","last_clean":"2024-04-25T09:05:46.986586+0000","last_became_active":"2024-04-25T09:05:44.971277+0000","last_became_peered":"2024-04-25T09:05:44.971277+0000","last_unstale":"2024-04-25T09:05:46.986586+0000","last_undegraded":"2024-04-25T09:05:46.986586+0000","last_fullsized":"2024-04-25T09:05:46.986586+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:50.033611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.000808+0000","last_change":"2024-04-25T09:05:45.990094+0000","last_active":"2024-04-25T09:05:46.000808+0000","last_peered":"2024-04-25T09:05:46.000808+0000","last_clean":"2024-04-25T09:05:46.000808+0000","last_became_active":"2024-04-25T09:05:45.989454+0000","last_became_peered":"2024-04-25T09:05:45.989454+0000","last_unstale":"2024-04-25T09:05:46.000808+0000","last_undegraded":"2024-04-25T09:05:46.000808+0000","last_fullsized":"2024-04-25T09:05:46.000808+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:13.815001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990706+0000","last_change":"2024-04-25T09:05:44.965817+0000","last_active":"2024-04-25T09:05:46.990706+0000","last_peered":"2024-04-25T09:05:46.990706+0000","last_clean":"2024-04-25T09:05:46.990706+0000","last_became_active":"2024-04-25T09:05:44.964811+0000","last_became_peered":"2024-04-25T09:05:44.964811+0000","last_unstale":"2024-04-25T09:05:46.990706+0000","last_undegraded":"2024-04-25T09:05:46.990706+0000","last_fullsized":"2024-04-25T09:05:46.990706+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:33.831332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.003094+0000","last_change":"2024-04-25T09:05:45.992013+0000","last_active":"2024-04-25T09:05:46.003094+0000","last_peered":"2024-04-25T09:05:46.003094+0000","last_clean":"2024-04-25T09:05:46.003094+0000","last_became_active":"2024-04-25T09:05:45.991354+0000","last_became_peered":"2024-04-25T09:05:45.991354+0000","last_unstale":"2024-04-25T09:05:46.003094+0000","last_undegraded":"2024-04-25T09:05:46.003094+0000","last_fullsized":"2024-04-25T09:05:46.003094+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.314784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.293934+0000","last_change":"2024-04-25T09:05:44.967207+0000","last_active":"2024-04-25T09:05:47.293934+0000","last_peered":"2024-04-25T09:05:47.293934+0000","last_clean":"2024-04-25T09:05:47.293934+0000","last_became_active":"2024-04-25T09:05:44.966896+0000","last_became_peered":"2024-04-25T09:05:44.966896+0000","last_unstale":"2024-04-25T09:05:47.293934+0000","last_undegraded":"2024-04-25T09:05:47.293934+0000","last_fullsized":"2024-04-25T09:05:47.293934+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:51.684942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984330+0000","last_change":"2024-04-25T09:05:45.983280+0000","last_active":"2024-04-25T09:05:46.984330+0000","last_peered":"2024-04-25T09:05:46.984330+0000","last_clean":"2024-04-25T09:05:46.984330+0000","last_became_active":"2024-04-25T09:05:45.983005+0000","last_became_peered":"2024-04-25T09:05:45.983005+0000","last_unstale":"2024-04-25T09:05:46.984330+0000","last_undegraded":"2024-04-25T09:05:46.984330+0000","last_fullsized":"2024-04-25T09:05:46.984330+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:22.768061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.970937+0000","last_change":"2024-04-25T09:05:44.964254+0000","last_active":"2024-04-25T09:05:45.970937+0000","last_peered":"2024-04-25T09:05:45.970937+0000","last_clean":"2024-04-25T09:05:45.970937+0000","last_became_active":"2024-04-25T09:05:44.963950+0000","last_became_peered":"2024-04-25T09:05:44.963950+0000","last_unstale":"2024-04-25T09:05:45.970937+0000","last_undegraded":"2024-04-25T09:05:45.970937+0000","last_fullsized":"2024-04-25T09:05:45.970937+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:59.018663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990973+0000","last_change":"2024-04-25T09:05:45.984972+0000","last_active":"2024-04-25T09:05:46.990973+0000","last_peered":"2024-04-25T09:05:46.990973+0000","last_clean":"2024-04-25T09:05:46.990973+0000","last_became_active":"2024-04-25T09:05:45.984714+0000","last_became_peered":"2024-04-25T09:05:45.984714+0000","last_unstale":"2024-04-25T09:05:46.990973+0000","last_undegraded":"2024-04-25T09:05:46.990973+0000","last_fullsized":"2024-04-25T09:05:46.990973+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:40.465912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.991003+0000","last_change":"2024-04-25T09:05:44.962236+0000","last_active":"2024-04-25T09:05:46.991003+0000","last_peered":"2024-04-25T09:05:46.991003+0000","last_clean":"2024-04-25T09:05:46.991003+0000","last_became_active":"2024-04-25T09:05:44.961810+0000","last_became_peered":"2024-04-25T09:05:44.961810+0000","last_unstale":"2024-04-25T09:05:46.991003+0000","last_undegraded":"2024-04-25T09:05:46.991003+0000","last_fullsized":"2024-04-25T09:05:46.991003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:54.833890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985275+0000","last_change":"2024-04-25T09:05:45.989225+0000","last_active":"2024-04-25T09:05:46.985275+0000","last_peered":"2024-04-25T09:05:46.985275+0000","last_clean":"2024-04-25T09:05:46.985275+0000","last_became_active":"2024-04-25T09:05:45.988798+0000","last_became_peered":"2024-04-25T09:05:45.988798+0000","last_unstale":"2024-04-25T09:05:46.985275+0000","last_undegraded":"2024-04-25T09:05:46.985275+0000","last_fullsized":"2024-04-25T09:05:46.985275+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:20.521287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.969759+0000","last_change":"2024-04-25T09:05:44.974996+0000","last_active":"2024-04-25T09:05:45.969759+0000","last_peered":"2024-04-25T09:05:45.969759+0000","last_clean":"2024-04-25T09:05:45.969759+0000","last_became_active":"2024-04-25T09:05:44.974744+0000","last_became_peered":"2024-04-25T09:05:44.974744+0000","last_unstale":"2024-04-25T09:05:45.969759+0000","last_undegraded":"2024-04-25T09:05:45.969759+0000","last_fullsized":"2024-04-25T09:05:45.969759+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:38.880771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986758+0000","last_change":"2024-04-25T09:05:45.978430+0000","last_active":"2024-04-25T09:05:46.986758+0000","last_peered":"2024-04-25T09:05:46.986758+0000","last_clean":"2024-04-25T09:05:46.986758+0000","last_became_active":"2024-04-25T09:05:45.978178+0000","last_became_peered":"2024-04-25T09:05:45.978178+0000","last_unstale":"2024-04-25T09:05:46.986758+0000","last_undegraded":"2024-04-25T09:05:46.986758+0000","last_fullsized":"2024-04-25T09:05:46.986758+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:23.443548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985123+0000","last_change":"2024-04-25T09:05:44.970903+0000","last_active":"2024-04-25T09:05:46.985123+0000","last_peered":"2024-04-25T09:05:46.985123+0000","last_clean":"2024-04-25T09:05:46.985123+0000","last_became_active":"2024-04-25T09:05:44.970369+0000","last_became_peered":"2024-04-25T09:05:44.970369+0000","last_unstale":"2024-04-25T09:05:46.985123+0000","last_undegraded":"2024-04-25T09:05:46.985123+0000","last_fullsized":"2024-04-25T09:05:46.985123+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:55.087570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984843+0000","last_change":"2024-04-25T09:05:45.985464+0000","last_active":"2024-04-25T09:05:46.984843+0000","last_peered":"2024-04-25T09:05:46.984843+0000","last_clean":"2024-04-25T09:05:46.984843+0000","last_became_active":"2024-04-25T09:05:45.984556+0000","last_became_peered":"2024-04-25T09:05:45.984556+0000","last_unstale":"2024-04-25T09:05:46.984843+0000","last_undegraded":"2024-04-25T09:05:46.984843+0000","last_fullsized":"2024-04-25T09:05:46.984843+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:38.697851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.982284+0000","last_change":"2024-04-25T09:05:44.962979+0000","last_active":"2024-04-25T09:05:46.982284+0000","last_peered":"2024-04-25T09:05:46.982284+0000","last_clean":"2024-04-25T09:05:46.982284+0000","last_became_active":"2024-04-25T09:05:44.962051+0000","last_became_peered":"2024-04-25T09:05:44.962051+0000","last_unstale":"2024-04-25T09:05:46.982284+0000","last_undegraded":"2024-04-25T09:05:46.982284+0000","last_fullsized":"2024-04-25T09:05:46.982284+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:04.670442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985313+0000","last_change":"2024-04-25T09:05:45.985437+0000","last_active":"2024-04-25T09:05:46.985313+0000","last_peered":"2024-04-25T09:05:46.985313+0000","last_clean":"2024-04-25T09:05:46.985313+0000","last_became_active":"2024-04-25T09:05:45.985036+0000","last_became_peered":"2024-04-25T09:05:45.985036+0000","last_unstale":"2024-04-25T09:05:46.985313+0000","last_undegraded":"2024-04-25T09:05:46.985313+0000","last_fullsized":"2024-04-25T09:05:46.985313+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:26.004499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986658+0000","last_change":"2024-04-25T09:05:44.974119+0000","last_active":"2024-04-25T09:05:46.986658+0000","last_peered":"2024-04-25T09:05:46.986658+0000","last_clean":"2024-04-25T09:05:46.986658+0000","last_became_active":"2024-04-25T09:05:44.973785+0000","last_became_peered":"2024-04-25T09:05:44.973785+0000","last_unstale":"2024-04-25T09:05:46.986658+0000","last_undegraded":"2024-04-25T09:05:46.986658+0000","last_fullsized":"2024-04-25T09:05:46.986658+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:09.848649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.000611+0000","last_change":"2024-04-25T09:05:45.989003+0000","last_active":"2024-04-25T09:05:46.000611+0000","last_peered":"2024-04-25T09:05:46.000611+0000","last_clean":"2024-04-25T09:05:46.000611+0000","last_became_active":"2024-04-25T09:05:45.981264+0000","last_became_peered":"2024-04-25T09:05:45.981264+0000","last_unstale":"2024-04-25T09:05:46.000611+0000","last_undegraded":"2024-04-25T09:05:46.000611+0000","last_fullsized":"2024-04-25T09:05:46.000611+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:26.004499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984684+0000","last_change":"2024-04-25T09:05:44.966816+0000","last_active":"2024-04-25T09:05:46.984684+0000","last_peered":"2024-04-25T09:05:46.984684+0000","last_clean":"2024-04-25T09:05:46.984684+0000","last_became_active":"2024-04-25T09:05:44.966544+0000","last_became_peered":"2024-04-25T09:05:44.966544+0000","last_unstale":"2024-04-25T09:05:46.984684+0000","last_undegraded":"2024-04-25T09:05:46.984684+0000","last_fullsized":"2024-04-25T09:05:46.984684+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:26.399679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986282+0000","last_change":"2024-04-25T09:05:45.990447+0000","last_active":"2024-04-25T09:05:46.986282+0000","last_peered":"2024-04-25T09:05:46.986282+0000","last_clean":"2024-04-25T09:05:46.986282+0000","last_became_active":"2024-04-25T09:05:45.990178+0000","last_became_peered":"2024-04-25T09:05:45.990178+0000","last_unstale":"2024-04-25T09:05:46.986282+0000","last_undegraded":"2024-04-25T09:05:46.986282+0000","last_fullsized":"2024-04-25T09:05:46.986282+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:49.395534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986421+0000","last_change":"2024-04-25T09:05:44.974194+0000","last_active":"2024-04-25T09:05:46.986421+0000","last_peered":"2024-04-25T09:05:46.986421+0000","last_clean":"2024-04-25T09:05:46.986421+0000","last_became_active":"2024-04-25T09:05:44.973844+0000","last_became_peered":"2024-04-25T09:05:44.973844+0000","last_unstale":"2024-04-25T09:05:46.986421+0000","last_undegraded":"2024-04-25T09:05:46.986421+0000","last_fullsized":"2024-04-25T09:05:46.986421+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:39.459866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985261+0000","last_change":"2024-04-25T09:05:45.984978+0000","last_active":"2024-04-25T09:05:46.985261+0000","last_peered":"2024-04-25T09:05:46.985261+0000","last_clean":"2024-04-25T09:05:46.985261+0000","last_became_active":"2024-04-25T09:05:45.984223+0000","last_became_peered":"2024-04-25T09:05:45.984223+0000","last_unstale":"2024-04-25T09:05:46.985261+0000","last_undegraded":"2024-04-25T09:05:46.985261+0000","last_fullsized":"2024-04-25T09:05:46.985261+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:34.295608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.003829+0000","last_change":"2024-04-25T09:05:44.967008+0000","last_active":"2024-04-25T09:05:46.003829+0000","last_peered":"2024-04-25T09:05:46.003829+0000","last_clean":"2024-04-25T09:05:46.003829+0000","last_became_active":"2024-04-25T09:05:44.966736+0000","last_became_peered":"2024-04-25T09:05:44.966736+0000","last_unstale":"2024-04-25T09:05:46.003829+0000","last_undegraded":"2024-04-25T09:05:46.003829+0000","last_fullsized":"2024-04-25T09:05:46.003829+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:45.149353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.982507+0000","last_change":"2024-04-25T09:05:45.988443+0000","last_active":"2024-04-25T09:05:46.982507+0000","last_peered":"2024-04-25T09:05:46.982507+0000","last_clean":"2024-04-25T09:05:46.982507+0000","last_became_active":"2024-04-25T09:05:45.988157+0000","last_became_peered":"2024-04-25T09:05:45.988157+0000","last_unstale":"2024-04-25T09:05:46.982507+0000","last_undegraded":"2024-04-25T09:05:46.982507+0000","last_fullsized":"2024-04-25T09:05:46.982507+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:22.768061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.982579+0000","last_change":"2024-04-25T09:05:44.965202+0000","last_active":"2024-04-25T09:05:46.982579+0000","last_peered":"2024-04-25T09:05:46.982579+0000","last_clean":"2024-04-25T09:05:46.982579+0000","last_became_active":"2024-04-25T09:05:44.964757+0000","last_became_peered":"2024-04-25T09:05:44.964757+0000","last_unstale":"2024-04-25T09:05:46.982579+0000","last_undegraded":"2024-04-25T09:05:46.982579+0000","last_fullsized":"2024-04-25T09:05:46.982579+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:29.158964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.003056+0000","last_change":"2024-04-25T09:05:45.992363+0000","last_active":"2024-04-25T09:05:46.003056+0000","last_peered":"2024-04-25T09:05:46.003056+0000","last_clean":"2024-04-25T09:05:46.003056+0000","last_became_active":"2024-04-25T09:05:45.992100+0000","last_became_peered":"2024-04-25T09:05:45.992100+0000","last_unstale":"2024-04-25T09:05:46.003056+0000","last_undegraded":"2024-04-25T09:05:46.003056+0000","last_fullsized":"2024-04-25T09:05:46.003056+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:14.322200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990841+0000","last_change":"2024-04-25T09:05:44.963637+0000","last_active":"2024-04-25T09:05:46.990841+0000","last_peered":"2024-04-25T09:05:46.990841+0000","last_clean":"2024-04-25T09:05:46.990841+0000","last_became_active":"2024-04-25T09:05:44.963363+0000","last_became_peered":"2024-04-25T09:05:44.963363+0000","last_unstale":"2024-04-25T09:05:46.990841+0000","last_undegraded":"2024-04-25T09:05:46.990841+0000","last_fullsized":"2024-04-25T09:05:46.990841+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:22.799387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985200+0000","last_change":"2024-04-25T09:05:45.987651+0000","last_active":"2024-04-25T09:05:46.985200+0000","last_peered":"2024-04-25T09:05:46.985200+0000","last_clean":"2024-04-25T09:05:46.985200+0000","last_became_active":"2024-04-25T09:05:45.987367+0000","last_became_peered":"2024-04-25T09:05:45.987367+0000","last_unstale":"2024-04-25T09:05:46.985200+0000","last_undegraded":"2024-04-25T09:05:46.985200+0000","last_fullsized":"2024-04-25T09:05:46.985200+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:32.535178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.294282+0000","last_change":"2024-04-25T09:05:44.971044+0000","last_active":"2024-04-25T09:05:47.294282+0000","last_peered":"2024-04-25T09:05:47.294282+0000","last_clean":"2024-04-25T09:05:47.294282+0000","last_became_active":"2024-04-25T09:05:44.970745+0000","last_became_peered":"2024-04-25T09:05:44.970745+0000","last_unstale":"2024-04-25T09:05:47.294282+0000","last_undegraded":"2024-04-25T09:05:47.294282+0000","last_fullsized":"2024-04-25T09:05:47.294282+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:55.087570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985735+0000","last_change":"2024-04-25T09:05:45.989619+0000","last_active":"2024-04-25T09:05:46.985735+0000","last_peered":"2024-04-25T09:05:46.985735+0000","last_clean":"2024-04-25T09:05:46.985735+0000","last_became_active":"2024-04-25T09:05:45.989318+0000","last_became_peered":"2024-04-25T09:05:45.989318+0000","last_unstale":"2024-04-25T09:05:46.985735+0000","last_undegraded":"2024-04-25T09:05:46.985735+0000","last_fullsized":"2024-04-25T09:05:46.985735+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:59.784443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986857+0000","last_change":"2024-04-25T09:05:44.973011+0000","last_active":"2024-04-25T09:05:46.986857+0000","last_peered":"2024-04-25T09:05:46.986857+0000","last_clean":"2024-04-25T09:05:46.986857+0000","last_became_active":"2024-04-25T09:05:44.972737+0000","last_became_peered":"2024-04-25T09:05:44.972737+0000","last_unstale":"2024-04-25T09:05:46.986857+0000","last_undegraded":"2024-04-25T09:05:46.986857+0000","last_fullsized":"2024-04-25T09:05:46.986857+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:55.087570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986371+0000","last_change":"2024-04-25T09:05:45.990076+0000","last_active":"2024-04-25T09:05:46.986371+0000","last_peered":"2024-04-25T09:05:46.986371+0000","last_clean":"2024-04-25T09:05:46.986371+0000","last_became_active":"2024-04-25T09:05:45.989778+0000","last_became_peered":"2024-04-25T09:05:45.989778+0000","last_unstale":"2024-04-25T09:05:46.986371+0000","last_undegraded":"2024-04-25T09:05:46.986371+0000","last_fullsized":"2024-04-25T09:05:46.986371+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:35.122951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986781+0000","last_change":"2024-04-25T09:05:44.971565+0000","last_active":"2024-04-25T09:05:46.986781+0000","last_peered":"2024-04-25T09:05:46.986781+0000","last_clean":"2024-04-25T09:05:46.986781+0000","last_became_active":"2024-04-25T09:05:44.970909+0000","last_became_peered":"2024-04-25T09:05:44.970909+0000","last_unstale":"2024-04-25T09:05:46.986781+0000","last_undegraded":"2024-04-25T09:05:46.986781+0000","last_fullsized":"2024-04-25T09:05:46.986781+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:21.759535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.992342+0000","last_change":"2024-04-25T09:05:45.986759+0000","last_active":"2024-04-25T09:05:45.992342+0000","last_peered":"2024-04-25T09:05:45.992342+0000","last_clean":"2024-04-25T09:05:45.992342+0000","last_became_active":"2024-04-25T09:05:45.986485+0000","last_became_peered":"2024-04-25T09:05:45.986485+0000","last_unstale":"2024-04-25T09:05:45.992342+0000","last_undegraded":"2024-04-25T09:05:45.992342+0000","last_fullsized":"2024-04-25T09:05:45.992342+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:30.668192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.293972+0000","last_change":"2024-04-25T09:05:44.965022+0000","last_active":"2024-04-25T09:05:47.293972+0000","last_peered":"2024-04-25T09:05:47.293972+0000","last_clean":"2024-04-25T09:05:47.293972+0000","last_became_active":"2024-04-25T09:05:44.964756+0000","last_became_peered":"2024-04-25T09:05:44.964756+0000","last_unstale":"2024-04-25T09:05:47.293972+0000","last_undegraded":"2024-04-25T09:05:47.293972+0000","last_fullsized":"2024-04-25T09:05:47.293972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:26.399679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.982113+0000","last_change":"2024-04-25T09:05:45.981906+0000","last_active":"2024-04-25T09:05:46.982113+0000","last_peered":"2024-04-25T09:05:46.982113+0000","last_clean":"2024-04-25T09:05:46.982113+0000","last_became_active":"2024-04-25T09:05:45.981653+0000","last_became_peered":"2024-04-25T09:05:45.981653+0000","last_unstale":"2024-04-25T09:05:46.982113+0000","last_undegraded":"2024-04-25T09:05:46.982113+0000","last_fullsized":"2024-04-25T09:05:46.982113+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:39.886816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.970009+0000","last_change":"2024-04-25T09:05:44.969200+0000","last_active":"2024-04-25T09:05:45.970009+0000","last_peered":"2024-04-25T09:05:45.970009+0000","last_clean":"2024-04-25T09:05:45.970009+0000","last_became_active":"2024-04-25T09:05:44.968917+0000","last_became_peered":"2024-04-25T09:05:44.968917+0000","last_unstale":"2024-04-25T09:05:45.970009+0000","last_undegraded":"2024-04-25T09:05:45.970009+0000","last_fullsized":"2024-04-25T09:05:45.970009+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:07.182217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.000699+0000","last_change":"2024-04-25T09:05:45.989777+0000","last_active":"2024-04-25T09:05:46.000699+0000","last_peered":"2024-04-25T09:05:46.000699+0000","last_clean":"2024-04-25T09:05:46.000699+0000","last_became_active":"2024-04-25T09:05:45.989441+0000","last_became_peered":"2024-04-25T09:05:45.989441+0000","last_unstale":"2024-04-25T09:05:46.000699+0000","last_undegraded":"2024-04-25T09:05:46.000699+0000","last_fullsized":"2024-04-25T09:05:46.000699+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:59.784443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984128+0000","last_change":"2024-04-25T09:05:44.969151+0000","last_active":"2024-04-25T09:05:46.984128+0000","last_peered":"2024-04-25T09:05:46.984128+0000","last_clean":"2024-04-25T09:05:46.984128+0000","last_became_active":"2024-04-25T09:05:44.967404+0000","last_became_peered":"2024-04-25T09:05:44.967404+0000","last_unstale":"2024-04-25T09:05:46.984128+0000","last_undegraded":"2024-04-25T09:05:46.984128+0000","last_fullsized":"2024-04-25T09:05:46.984128+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:39.459866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986006+0000","last_change":"2024-04-25T09:05:45.993445+0000","last_active":"2024-04-25T09:05:46.986006+0000","last_peered":"2024-04-25T09:05:46.986006+0000","last_clean":"2024-04-25T09:05:46.986006+0000","last_became_active":"2024-04-25T09:05:45.993188+0000","last_became_peered":"2024-04-25T09:05:45.993188+0000","last_unstale":"2024-04-25T09:05:46.986006+0000","last_undegraded":"2024-04-25T09:05:46.986006+0000","last_fullsized":"2024-04-25T09:05:46.986006+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.314784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.988471+0000","last_change":"2024-04-25T09:05:44.963620+0000","last_active":"2024-04-25T09:05:46.988471+0000","last_peered":"2024-04-25T09:05:46.988471+0000","last_clean":"2024-04-25T09:05:46.988471+0000","last_became_active":"2024-04-25T09:05:44.961803+0000","last_became_peered":"2024-04-25T09:05:44.961803+0000","last_unstale":"2024-04-25T09:05:46.988471+0000","last_undegraded":"2024-04-25T09:05:46.988471+0000","last_fullsized":"2024-04-25T09:05:46.988471+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:46.601142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.999852+0000","last_change":"2024-04-25T09:05:45.984412+0000","last_active":"2024-04-25T09:05:45.999852+0000","last_peered":"2024-04-25T09:05:45.999852+0000","last_clean":"2024-04-25T09:05:45.999852+0000","last_became_active":"2024-04-25T09:05:45.983645+0000","last_became_peered":"2024-04-25T09:05:45.983645+0000","last_unstale":"2024-04-25T09:05:45.999852+0000","last_undegraded":"2024-04-25T09:05:45.999852+0000","last_fullsized":"2024-04-25T09:05:45.999852+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:23.805432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985120+0000","last_change":"2024-04-25T09:05:44.970656+0000","last_active":"2024-04-25T09:05:46.985120+0000","last_peered":"2024-04-25T09:05:46.985120+0000","last_clean":"2024-04-25T09:05:46.985120+0000","last_became_active":"2024-04-25T09:05:44.969944+0000","last_became_peered":"2024-04-25T09:05:44.969944+0000","last_unstale":"2024-04-25T09:05:46.985120+0000","last_undegraded":"2024-04-25T09:05:46.985120+0000","last_fullsized":"2024-04-25T09:05:46.985120+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:46.601142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985001+0000","last_change":"2024-04-25T09:05:45.994520+0000","last_active":"2024-04-25T09:05:46.985001+0000","last_peered":"2024-04-25T09:05:46.985001+0000","last_clean":"2024-04-25T09:05:46.985001+0000","last_became_active":"2024-04-25T09:05:45.994237+0000","last_became_peered":"2024-04-25T09:05:45.994237+0000","last_unstale":"2024-04-25T09:05:46.985001+0000","last_undegraded":"2024-04-25T09:05:46.985001+0000","last_fullsized":"2024-04-25T09:05:46.985001+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:39.457564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.972583+0000","last_change":"2024-04-25T09:05:44.966197+0000","last_active":"2024-04-25T09:05:45.972583+0000","last_peered":"2024-04-25T09:05:45.972583+0000","last_clean":"2024-04-25T09:05:45.972583+0000","last_became_active":"2024-04-25T09:05:44.965946+0000","last_became_peered":"2024-04-25T09:05:44.965946+0000","last_unstale":"2024-04-25T09:05:45.972583+0000","last_undegraded":"2024-04-25T09:05:45.972583+0000","last_fullsized":"2024-04-25T09:05:45.972583+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:12.808956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986535+0000","last_change":"2024-04-25T09:05:45.978993+0000","last_active":"2024-04-25T09:05:46.986535+0000","last_peered":"2024-04-25T09:05:46.986535+0000","last_clean":"2024-04-25T09:05:46.986535+0000","last_became_active":"2024-04-25T09:05:45.976239+0000","last_became_peered":"2024-04-25T09:05:45.976239+0000","last_unstale":"2024-04-25T09:05:46.986535+0000","last_undegraded":"2024-04-25T09:05:46.986535+0000","last_fullsized":"2024-04-25T09:05:46.986535+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:07.259558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984453+0000","last_change":"2024-04-25T09:05:44.968742+0000","last_active":"2024-04-25T09:05:46.984453+0000","last_peered":"2024-04-25T09:05:46.984453+0000","last_clean":"2024-04-25T09:05:46.984453+0000","last_became_active":"2024-04-25T09:05:44.968465+0000","last_became_peered":"2024-04-25T09:05:44.968465+0000","last_unstale":"2024-04-25T09:05:46.984453+0000","last_undegraded":"2024-04-25T09:05:46.984453+0000","last_fullsized":"2024-04-25T09:05:46.984453+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:51.684942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986557+0000","last_change":"2024-04-25T09:05:45.990080+0000","last_active":"2024-04-25T09:05:46.986557+0000","last_peered":"2024-04-25T09:05:46.986557+0000","last_clean":"2024-04-25T09:05:46.986557+0000","last_became_active":"2024-04-25T09:05:45.989760+0000","last_became_peered":"2024-04-25T09:05:45.989760+0000","last_unstale":"2024-04-25T09:05:46.986557+0000","last_undegraded":"2024-04-25T09:05:46.986557+0000","last_fullsized":"2024-04-25T09:05:46.986557+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:03.029893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990722+0000","last_change":"2024-04-25T09:05:44.963068+0000","last_active":"2024-04-25T09:05:46.990722+0000","last_peered":"2024-04-25T09:05:46.990722+0000","last_clean":"2024-04-25T09:05:46.990722+0000","last_became_active":"2024-04-25T09:05:44.962739+0000","last_became_peered":"2024-04-25T09:05:44.962739+0000","last_unstale":"2024-04-25T09:05:46.990722+0000","last_undegraded":"2024-04-25T09:05:46.990722+0000","last_fullsized":"2024-04-25T09:05:46.990722+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:31.529133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.294208+0000","last_change":"2024-04-25T09:05:45.995537+0000","last_active":"2024-04-25T09:05:47.294208+0000","last_peered":"2024-04-25T09:05:47.294208+0000","last_clean":"2024-04-25T09:05:47.294208+0000","last_became_active":"2024-04-25T09:05:45.994693+0000","last_became_peered":"2024-04-25T09:05:45.994693+0000","last_unstale":"2024-04-25T09:05:47.294208+0000","last_undegraded":"2024-04-25T09:05:47.294208+0000","last_fullsized":"2024-04-25T09:05:47.294208+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:39.457564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.970745+0000","last_change":"2024-04-25T09:05:44.965506+0000","last_active":"2024-04-25T09:05:45.970745+0000","last_peered":"2024-04-25T09:05:45.970745+0000","last_clean":"2024-04-25T09:05:45.970745+0000","last_became_active":"2024-04-25T09:05:44.965298+0000","last_became_peered":"2024-04-25T09:05:44.965298+0000","last_unstale":"2024-04-25T09:05:45.970745+0000","last_undegraded":"2024-04-25T09:05:45.970745+0000","last_fullsized":"2024-04-25T09:05:45.970745+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:29.667466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990526+0000","last_change":"2024-04-25T09:05:45.978499+0000","last_active":"2024-04-25T09:05:46.990526+0000","last_peered":"2024-04-25T09:05:46.990526+0000","last_clean":"2024-04-25T09:05:46.990526+0000","last_became_active":"2024-04-25T09:05:45.978227+0000","last_became_peered":"2024-04-25T09:05:45.978227+0000","last_unstale":"2024-04-25T09:05:46.990526+0000","last_undegraded":"2024-04-25T09:05:46.990526+0000","last_fullsized":"2024-04-25T09:05:46.990526+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:17.077361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.971222+0000","last_change":"2024-04-25T09:05:44.961851+0000","last_active":"2024-04-25T09:05:45.971222+0000","last_peered":"2024-04-25T09:05:45.971222+0000","last_clean":"2024-04-25T09:05:45.971222+0000","last_became_active":"2024-04-25T09:05:44.961554+0000","last_became_peered":"2024-04-25T09:05:44.961554+0000","last_unstale":"2024-04-25T09:05:45.971222+0000","last_undegraded":"2024-04-25T09:05:45.971222+0000","last_fullsized":"2024-04-25T09:05:45.971222+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:21.881265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.994874+0000","last_change":"2024-04-25T09:05:45.983845+0000","last_active":"2024-04-25T09:05:45.994874+0000","last_peered":"2024-04-25T09:05:45.994874+0000","last_clean":"2024-04-25T09:05:45.994874+0000","last_became_active":"2024-04-25T09:05:45.981204+0000","last_became_peered":"2024-04-25T09:05:45.981204+0000","last_unstale":"2024-04-25T09:05:45.994874+0000","last_undegraded":"2024-04-25T09:05:45.994874+0000","last_fullsized":"2024-04-25T09:05:45.994874+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:55.839935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.294348+0000","last_change":"2024-04-25T09:05:44.967312+0000","last_active":"2024-04-25T09:05:47.294348+0000","last_peered":"2024-04-25T09:05:47.294348+0000","last_clean":"2024-04-25T09:05:47.294348+0000","last_became_active":"2024-04-25T09:05:44.966859+0000","last_became_peered":"2024-04-25T09:05:44.966859+0000","last_unstale":"2024-04-25T09:05:47.294348+0000","last_undegraded":"2024-04-25T09:05:47.294348+0000","last_fullsized":"2024-04-25T09:05:47.294348+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:39.459866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":214,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984185+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:05:46.984185+0000","last_peered":"2024-04-25T09:05:46.984185+0000","last_clean":"2024-04-25T09:05:46.984185+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:05:46.984185+0000","last_undegraded":"2024-04-25T09:05:46.984185+0000","last_fullsized":"2024-04-25T09:05:46.984185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1114112,"data_stored":799548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":203462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":202860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":528384,"data_stored":210702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":528384,"data_stored":209728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":210724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":202860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1101824,"data_stored":793192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:05:50.038 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:05:50.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.221+0000 7fa6e5200640 1 Processor -- start 2024-04-25T09:05:50.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.221+0000 7fa6e5200640 1 -- start start 2024-04-25T09:05:50.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.225+0000 7fa6e5200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa6e00cd520 0x7fa6e006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.225+0000 7fa6e5200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6e00cf560 0x7fa6e00cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.225+0000 7fa6e5200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e00cda00 con 0x7fa6e015a900 2024-04-25T09:05:50.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.225+0000 7fa6e5200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e015bcf0 con 0x7fa6e00cd520 2024-04-25T09:05:50.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.225+0000 7fa6e5200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e00cfef0 con 0x7fa6e00cf560 2024-04-25T09:05:50.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.225+0000 7fa6de800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6e00cf560 0x7fa6e00cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.225+0000 7fa6de800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6e00cf560 0x7fa6e00cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:55854/0 (socket says 172.21.15.175:55854) 2024-04-25T09:05:50.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.225+0000 7fa6de800640 1 -- 172.21.15.175:0/1031253715 learned_addr learned my addr 172.21.15.175:0/1031253715 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:50.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.225+0000 7fa6d5400640 1 --2- 172.21.15.175:0/1031253715 >> v2:172.21.15.177:3300/0 conn(0x7fa6e00cd520 0x7fa6e006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.225+0000 7fa6dde00640 1 --1- 172.21.15.175:0/1031253715 >> v1:172.21.15.177:6789/0 conn(0x7fa6e015a900 0x7fa6e00ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:45648/0 (socket says 172.21.15.175:45648) 2024-04-25T09:05:50.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.225+0000 7fa6d5400640 1 -- 172.21.15.175:0/1031253715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6e00cf560 msgr2=0x7fa6e00cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:50.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.225+0000 7fa6d5400640 1 --2- 172.21.15.175:0/1031253715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6e00cf560 0x7fa6e00cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.225+0000 7fa6d5400640 1 -- 172.21.15.175:0/1031253715 >> v1:172.21.15.177:6789/0 conn(0x7fa6e015a900 legacy=0x7fa6e00ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.225+0000 7fa6d5400640 1 -- 172.21.15.175:0/1031253715 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e00cdce0 con 0x7fa6e00cd520 2024-04-25T09:05:50.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.225+0000 7fa6dd400640 1 -- 172.21.15.175:0/1031253715 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1636333508 0 0) 0x7fa6e00cda00 con 0x7fa6e015a900 2024-04-25T09:05:50.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6d5400640 1 --2- 172.21.15.175:0/1031253715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6e00cd520 0x7fa6e006e150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80097c0 tx=0x7fa6c801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb35b61819b7f9ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6dd400640 1 -- 172.21.15.175:0/1031253715 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80b2070 con 0x7fa6e00cd520 2024-04-25T09:05:50.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6dd400640 1 -- 172.21.15.175:0/1031253715 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c80ad640 con 0x7fa6e00cd520 2024-04-25T09:05:50.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6dd400640 1 -- 172.21.15.175:0/1031253715 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80ada10 con 0x7fa6e00cd520 2024-04-25T09:05:50.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6e5200640 1 -- 172.21.15.175:0/1031253715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6e00cd520 msgr2=0x7fa6e006e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6e5200640 1 --2- 172.21.15.175:0/1031253715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6e00cd520 0x7fa6e006e150 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa6c80097c0 tx=0x7fa6c801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6e5200640 1 -- 172.21.15.175:0/1031253715 shutdown_connections 2024-04-25T09:05:50.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6e5200640 1 --2- 172.21.15.175:0/1031253715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6e00cf560 0x7fa6e00cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6e5200640 1 --2- 172.21.15.175:0/1031253715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6e00cd520 0x7fa6e006e150 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6e5200640 1 -- 172.21.15.175:0/1031253715 >> 172.21.15.175:0/1031253715 conn(0x7fa6e0067150 msgr2=0x7fa6e006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:50.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6e5200640 1 -- 172.21.15.175:0/1031253715 shutdown_connections 2024-04-25T09:05:50.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6e5200640 1 -- 172.21.15.175:0/1031253715 wait complete. 2024-04-25T09:05:50.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6e5200640 1 Processor -- start 2024-04-25T09:05:50.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6e5200640 1 -- start start 2024-04-25T09:05:50.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6e5200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6e00cf560 0x7fa6e0146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6e5200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6e015a900 0x7fa6e014ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6e5200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e014bfd0 0x7fa6e00ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6e5200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e006d530 con 0x7fa6e014bfd0 2024-04-25T09:05:50.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6e5200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e006d3b0 con 0x7fa6e015a900 2024-04-25T09:05:50.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6e5200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e015c790 con 0x7fa6e00cf560 2024-04-25T09:05:50.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6de800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e014bfd0 0x7fa6e00ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6de800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e014bfd0 0x7fa6e00ad910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53346/0 (socket says 172.21.15.175:53346) 2024-04-25T09:05:50.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6de800640 1 -- 172.21.15.175:0/2311098988 learned_addr learned my addr 172.21.15.175:0/2311098988 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:50.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.229+0000 7fa6d5400640 1 --2- 172.21.15.175:0/2311098988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6e015a900 0x7fa6e014ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.233+0000 7fa6dde00640 1 --2- 172.21.15.175:0/2311098988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6e00cf560 0x7fa6e0146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.233+0000 7fa6d5400640 1 -- 172.21.15.175:0/2311098988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6e00cf560 msgr2=0x7fa6e0146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.233+0000 7fa6d5400640 1 --2- 172.21.15.175:0/2311098988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6e00cf560 0x7fa6e0146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.233+0000 7fa6d5400640 1 -- 172.21.15.175:0/2311098988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e014bfd0 msgr2=0x7fa6e00ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.233+0000 7fa6d5400640 1 --2- 172.21.15.175:0/2311098988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e014bfd0 0x7fa6e00ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.233+0000 7fa6d5400640 1 -- 172.21.15.175:0/2311098988 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e0150ae0 con 0x7fa6e015a900 2024-04-25T09:05:50.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.233+0000 7fa6de800640 1 --2- 172.21.15.175:0/2311098988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e014bfd0 0x7fa6e00ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:50.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.233+0000 7fa6d5400640 1 --2- 172.21.15.175:0/2311098988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6e015a900 0x7fa6e014ba90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa6e006ba60 tx=0x7fa6c8019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.233+0000 7fa6d6a00640 1 -- 172.21.15.175:0/2311098988 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80b2040 con 0x7fa6e015a900 2024-04-25T09:05:50.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.233+0000 7fa6d6a00640 1 -- 172.21.15.175:0/2311098988 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c80b6430 con 0x7fa6e015a900 2024-04-25T09:05:50.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.233+0000 7fa6e5200640 1 -- 172.21.15.175:0/2311098988 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e0150dc0 con 0x7fa6e015a900 2024-04-25T09:05:50.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.233+0000 7fa6d6a00640 1 -- 172.21.15.175:0/2311098988 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80b6820 con 0x7fa6e015a900 2024-04-25T09:05:50.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.233+0000 7fa6e5200640 1 -- 172.21.15.175:0/2311098988 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e0151380 con 0x7fa6e015a900 2024-04-25T09:05:50.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.233+0000 7fa6e5200640 1 -- 172.21.15.175:0/2311098988 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e0074a60 con 0x7fa6e015a900 2024-04-25T09:05:50.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.233+0000 7fa6d6a00640 1 -- 172.21.15.175:0/2311098988 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa6c80bd030 con 0x7fa6e015a900 2024-04-25T09:05:50.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.233+0000 7fa6d6a00640 1 --2- 172.21.15.175:0/2311098988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa6bc066f90 0x7fa6bc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.237+0000 7fa6d6a00640 1 -- 172.21.15.175:0/2311098988 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6c811e500 con 0x7fa6e015a900 2024-04-25T09:05:50.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.237+0000 7fa6dde00640 1 --2- 172.21.15.175:0/2311098988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa6bc066f90 0x7fa6bc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.237+0000 7fa6dde00640 1 --2- 172.21.15.175:0/2311098988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa6bc066f90 0x7fa6bc069450 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0000f70 tx=0x7fa6d0007240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.241+0000 7fa6d6a00640 1 -- 172.21.15.175:0/2311098988 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa6c80c4060 con 0x7fa6e015a900 2024-04-25T09:05:50.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.389+0000 7fa6e5200640 1 -- 172.21.15.175:0/2311098988 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa6e014f230 con 0x7fa6bc066f90 2024-04-25T09:05:50.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.397+0000 7fa6d6a00640 1 -- 172.21.15.175:0/2311098988 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251940 (secure 0 0 0) 0x7fa6d0004d40 con 0x7fa6bc066f90 2024-04-25T09:05:50.390 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:50.391 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:05:50.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.401+0000 7fa6e5200640 1 -- 172.21.15.175:0/2311098988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa6bc066f90 msgr2=0x7fa6bc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.401+0000 7fa6e5200640 1 --2- 172.21.15.175:0/2311098988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa6bc066f90 0x7fa6bc069450 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0000f70 tx=0x7fa6d0007240 comp rx=0 tx=0).stop 2024-04-25T09:05:50.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.401+0000 7fa6e5200640 1 -- 172.21.15.175:0/2311098988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6e015a900 msgr2=0x7fa6e014ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.401+0000 7fa6e5200640 1 --2- 172.21.15.175:0/2311098988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6e015a900 0x7fa6e014ba90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa6e006ba60 tx=0x7fa6c8019240 comp rx=0 tx=0).stop 2024-04-25T09:05:50.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.401+0000 7fa6e5200640 1 -- 172.21.15.175:0/2311098988 shutdown_connections 2024-04-25T09:05:50.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.401+0000 7fa6e5200640 1 --2- 172.21.15.175:0/2311098988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa6bc066f90 0x7fa6bc069450 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.401+0000 7fa6e5200640 1 --2- 172.21.15.175:0/2311098988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e014bfd0 0x7fa6e00ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.401+0000 7fa6e5200640 1 --2- 172.21.15.175:0/2311098988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6e015a900 0x7fa6e014ba90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.401+0000 7fa6e5200640 1 --2- 172.21.15.175:0/2311098988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6e00cf560 0x7fa6e0146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.401+0000 7fa6e5200640 1 -- 172.21.15.175:0/2311098988 >> 172.21.15.175:0/2311098988 conn(0x7fa6e00cd520 msgr2=0x7fa6e006e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:50.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.401+0000 7fa6e5200640 1 -- 172.21.15.175:0/2311098988 shutdown_connections 2024-04-25T09:05:50.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.401+0000 7fa6e5200640 1 -- 172.21.15.175:0/2311098988 wait complete. 2024-04-25T09:05:50.409 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-04-25T09:05:49.810097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":135,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221400,"kb_used_data":5208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753320,"statfs":{"total":773094113280,"available":772867399680,"internally_reserved":0,"allocated":5332992,"data_stored":2833076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.868579"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985150+0000","last_change":"2024-04-25T09:05:45.996876+0000","last_active":"2024-04-25T09:05:46.985150+0000","last_peered":"2024-04-25T09:05:46.985150+0000","last_clean":"2024-04-25T09:05:46.985150+0000","last_became_active":"2024-04-25T09:05:45.996480+0000","last_became_peered":"2024-04-25T09:05:45.996480+0000","last_unstale":"2024-04-25T09:05:46.985150+0000","last_undegraded":"2024-04-25T09:05:46.985150+0000","last_fullsized":"2024-04-25T09:05:46.985150+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:50.747903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.294389+0000","last_change":"2024-04-25T09:05:46.005734+0000","last_active":"2024-04-25T09:05:47.294389+0000","last_peered":"2024-04-25T09:05:47.294389+0000","last_clean":"2024-04-25T09:05:47.294389+0000","last_became_active":"2024-04-25T09:05:46.005271+0000","last_became_peered":"2024-04-25T09:05:46.005271+0000","last_unstale":"2024-04-25T09:05:47.294389+0000","last_undegraded":"2024-04-25T09:05:47.294389+0000","last_fullsized":"2024-04-25T09:05:47.294389+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:50.747903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990649+0000","last_change":"2024-04-25T09:05:45.988820+0000","last_active":"2024-04-25T09:05:46.990649+0000","last_peered":"2024-04-25T09:05:46.990649+0000","last_clean":"2024-04-25T09:05:46.990649+0000","last_became_active":"2024-04-25T09:05:45.987543+0000","last_became_peered":"2024-04-25T09:05:45.987543+0000","last_unstale":"2024-04-25T09:05:46.990649+0000","last_undegraded":"2024-04-25T09:05:46.990649+0000","last_fullsized":"2024-04-25T09:05:46.990649+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:02.301616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.000313+0000","last_change":"2024-04-25T09:05:45.984529+0000","last_active":"2024-04-25T09:05:46.000313+0000","last_peered":"2024-04-25T09:05:46.000313+0000","last_clean":"2024-04-25T09:05:46.000313+0000","last_became_active":"2024-04-25T09:05:45.983997+0000","last_became_peered":"2024-04-25T09:05:45.983997+0000","last_unstale":"2024-04-25T09:05:46.000313+0000","last_undegraded":"2024-04-25T09:05:46.000313+0000","last_fullsized":"2024-04-25T09:05:46.000313+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:32.535178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.294187+0000","last_change":"2024-04-25T09:05:45.985407+0000","last_active":"2024-04-25T09:05:47.294187+0000","last_peered":"2024-04-25T09:05:47.294187+0000","last_clean":"2024-04-25T09:05:47.294187+0000","last_became_active":"2024-04-25T09:05:45.985136+0000","last_became_peered":"2024-04-25T09:05:45.985136+0000","last_unstale":"2024-04-25T09:05:47.294187+0000","last_undegraded":"2024-04-25T09:05:47.294187+0000","last_fullsized":"2024-04-25T09:05:47.294187+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:03.153480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986362+0000","last_change":"2024-04-25T09:05:45.983498+0000","last_active":"2024-04-25T09:05:46.986362+0000","last_peered":"2024-04-25T09:05:46.986362+0000","last_clean":"2024-04-25T09:05:46.986362+0000","last_became_active":"2024-04-25T09:05:45.983191+0000","last_became_peered":"2024-04-25T09:05:45.983191+0000","last_unstale":"2024-04-25T09:05:46.986362+0000","last_undegraded":"2024-04-25T09:05:46.986362+0000","last_fullsized":"2024-04-25T09:05:46.986362+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:46.402394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984352+0000","last_change":"2024-04-25T09:05:45.985129+0000","last_active":"2024-04-25T09:05:46.984352+0000","last_peered":"2024-04-25T09:05:46.984352+0000","last_clean":"2024-04-25T09:05:46.984352+0000","last_became_active":"2024-04-25T09:05:45.984636+0000","last_became_peered":"2024-04-25T09:05:45.984636+0000","last_unstale":"2024-04-25T09:05:46.984352+0000","last_undegraded":"2024-04-25T09:05:46.984352+0000","last_fullsized":"2024-04-25T09:05:46.984352+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:03.153480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.003114+0000","last_change":"2024-04-25T09:05:45.992080+0000","last_active":"2024-04-25T09:05:46.003114+0000","last_peered":"2024-04-25T09:05:46.003114+0000","last_clean":"2024-04-25T09:05:46.003114+0000","last_became_active":"2024-04-25T09:05:45.991743+0000","last_became_peered":"2024-04-25T09:05:45.991743+0000","last_unstale":"2024-04-25T09:05:46.003114+0000","last_undegraded":"2024-04-25T09:05:46.003114+0000","last_fullsized":"2024-04-25T09:05:46.003114+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:30.668192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.000580+0000","last_change":"2024-04-25T09:05:45.984714+0000","last_active":"2024-04-25T09:05:46.000580+0000","last_peered":"2024-04-25T09:05:46.000580+0000","last_clean":"2024-04-25T09:05:46.000580+0000","last_became_active":"2024-04-25T09:05:45.984383+0000","last_became_peered":"2024-04-25T09:05:45.984383+0000","last_unstale":"2024-04-25T09:05:46.000580+0000","last_undegraded":"2024-04-25T09:05:46.000580+0000","last_fullsized":"2024-04-25T09:05:46.000580+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:40.538531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.994895+0000","last_change":"2024-04-25T09:05:45.984064+0000","last_active":"2024-04-25T09:05:45.994895+0000","last_peered":"2024-04-25T09:05:45.994895+0000","last_clean":"2024-04-25T09:05:45.994895+0000","last_became_active":"2024-04-25T09:05:45.983590+0000","last_became_peered":"2024-04-25T09:05:45.983590+0000","last_unstale":"2024-04-25T09:05:45.994895+0000","last_undegraded":"2024-04-25T09:05:45.994895+0000","last_fullsized":"2024-04-25T09:05:45.994895+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:34.837377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.982720+0000","last_change":"2024-04-25T09:05:45.980491+0000","last_active":"2024-04-25T09:05:45.982720+0000","last_peered":"2024-04-25T09:05:45.982720+0000","last_clean":"2024-04-25T09:05:45.982720+0000","last_became_active":"2024-04-25T09:05:45.980193+0000","last_became_peered":"2024-04-25T09:05:45.980193+0000","last_unstale":"2024-04-25T09:05:45.982720+0000","last_undegraded":"2024-04-25T09:05:45.982720+0000","last_fullsized":"2024-04-25T09:05:45.982720+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:22.768061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.294191+0000","last_change":"2024-04-25T09:05:46.000071+0000","last_active":"2024-04-25T09:05:47.294191+0000","last_peered":"2024-04-25T09:05:47.294191+0000","last_clean":"2024-04-25T09:05:47.294191+0000","last_became_active":"2024-04-25T09:05:45.999724+0000","last_became_peered":"2024-04-25T09:05:45.999724+0000","last_unstale":"2024-04-25T09:05:47.294191+0000","last_undegraded":"2024-04-25T09:05:47.294191+0000","last_fullsized":"2024-04-25T09:05:47.294191+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:38.697851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.982207+0000","last_change":"2024-04-25T09:05:45.973026+0000","last_active":"2024-04-25T09:05:46.982207+0000","last_peered":"2024-04-25T09:05:46.982207+0000","last_clean":"2024-04-25T09:05:46.982207+0000","last_became_active":"2024-04-25T09:05:45.972654+0000","last_became_peered":"2024-04-25T09:05:45.972654+0000","last_unstale":"2024-04-25T09:05:46.982207+0000","last_undegraded":"2024-04-25T09:05:46.982207+0000","last_fullsized":"2024-04-25T09:05:46.982207+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:00.024708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.000843+0000","last_change":"2024-04-25T09:05:45.989872+0000","last_active":"2024-04-25T09:05:46.000843+0000","last_peered":"2024-04-25T09:05:46.000843+0000","last_clean":"2024-04-25T09:05:46.000843+0000","last_became_active":"2024-04-25T09:05:45.989603+0000","last_became_peered":"2024-04-25T09:05:45.989603+0000","last_unstale":"2024-04-25T09:05:46.000843+0000","last_undegraded":"2024-04-25T09:05:46.000843+0000","last_fullsized":"2024-04-25T09:05:46.000843+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:30.673511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986319+0000","last_change":"2024-04-25T09:05:45.974213+0000","last_active":"2024-04-25T09:05:46.986319+0000","last_peered":"2024-04-25T09:05:46.986319+0000","last_clean":"2024-04-25T09:05:46.986319+0000","last_became_active":"2024-04-25T09:05:45.973969+0000","last_became_peered":"2024-04-25T09:05:45.973969+0000","last_unstale":"2024-04-25T09:05:46.986319+0000","last_undegraded":"2024-04-25T09:05:46.986319+0000","last_fullsized":"2024-04-25T09:05:46.986319+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:04.244359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984803+0000","last_change":"2024-04-25T09:05:45.993618+0000","last_active":"2024-04-25T09:05:46.984803+0000","last_peered":"2024-04-25T09:05:46.984803+0000","last_clean":"2024-04-25T09:05:46.984803+0000","last_became_active":"2024-04-25T09:05:45.993214+0000","last_became_peered":"2024-04-25T09:05:45.993214+0000","last_unstale":"2024-04-25T09:05:46.984803+0000","last_undegraded":"2024-04-25T09:05:46.984803+0000","last_fullsized":"2024-04-25T09:05:46.984803+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:34.837377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990972+0000","last_change":"2024-04-25T09:05:45.983516+0000","last_active":"2024-04-25T09:05:46.990972+0000","last_peered":"2024-04-25T09:05:46.990972+0000","last_clean":"2024-04-25T09:05:46.990972+0000","last_became_active":"2024-04-25T09:05:45.983155+0000","last_became_peered":"2024-04-25T09:05:45.983155+0000","last_unstale":"2024-04-25T09:05:46.990972+0000","last_undegraded":"2024-04-25T09:05:46.990972+0000","last_fullsized":"2024-04-25T09:05:46.990972+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:27.405724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990731+0000","last_change":"2024-04-25T09:05:45.999149+0000","last_active":"2024-04-25T09:05:46.990731+0000","last_peered":"2024-04-25T09:05:46.990731+0000","last_clean":"2024-04-25T09:05:46.990731+0000","last_became_active":"2024-04-25T09:05:45.998584+0000","last_became_peered":"2024-04-25T09:05:45.998584+0000","last_unstale":"2024-04-25T09:05:46.990731+0000","last_undegraded":"2024-04-25T09:05:46.990731+0000","last_fullsized":"2024-04-25T09:05:46.990731+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:35.080595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985884+0000","last_change":"2024-04-25T09:05:45.986285+0000","last_active":"2024-04-25T09:05:46.985884+0000","last_peered":"2024-04-25T09:05:46.985884+0000","last_clean":"2024-04-25T09:05:46.985884+0000","last_became_active":"2024-04-25T09:05:45.985873+0000","last_became_peered":"2024-04-25T09:05:45.985873+0000","last_unstale":"2024-04-25T09:05:46.985884+0000","last_undegraded":"2024-04-25T09:05:46.985884+0000","last_fullsized":"2024-04-25T09:05:46.985884+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:30.673511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.982333+0000","last_change":"2024-04-25T09:05:45.980530+0000","last_active":"2024-04-25T09:05:46.982333+0000","last_peered":"2024-04-25T09:05:46.982333+0000","last_clean":"2024-04-25T09:05:46.982333+0000","last_became_active":"2024-04-25T09:05:45.980287+0000","last_became_peered":"2024-04-25T09:05:45.980287+0000","last_unstale":"2024-04-25T09:05:46.982333+0000","last_undegraded":"2024-04-25T09:05:46.982333+0000","last_fullsized":"2024-04-25T09:05:46.982333+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:46.155398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986456+0000","last_change":"2024-04-25T09:05:45.981042+0000","last_active":"2024-04-25T09:05:46.986456+0000","last_peered":"2024-04-25T09:05:46.986456+0000","last_clean":"2024-04-25T09:05:46.986456+0000","last_became_active":"2024-04-25T09:05:45.980771+0000","last_became_peered":"2024-04-25T09:05:45.980771+0000","last_unstale":"2024-04-25T09:05:46.986456+0000","last_undegraded":"2024-04-25T09:05:46.986456+0000","last_fullsized":"2024-04-25T09:05:46.986456+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:25.370631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.002430+0000","last_change":"2024-04-25T09:05:45.991526+0000","last_active":"2024-04-25T09:05:46.002430+0000","last_peered":"2024-04-25T09:05:46.002430+0000","last_clean":"2024-04-25T09:05:46.002430+0000","last_became_active":"2024-04-25T09:05:45.991079+0000","last_became_peered":"2024-04-25T09:05:45.991079+0000","last_unstale":"2024-04-25T09:05:46.002430+0000","last_undegraded":"2024-04-25T09:05:46.002430+0000","last_fullsized":"2024-04-25T09:05:46.002430+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:43.593543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984717+0000","last_change":"2024-04-25T09:05:45.983145+0000","last_active":"2024-04-25T09:05:46.984717+0000","last_peered":"2024-04-25T09:05:46.984717+0000","last_clean":"2024-04-25T09:05:46.984717+0000","last_became_active":"2024-04-25T09:05:45.982828+0000","last_became_peered":"2024-04-25T09:05:45.982828+0000","last_unstale":"2024-04-25T09:05:46.984717+0000","last_undegraded":"2024-04-25T09:05:46.984717+0000","last_fullsized":"2024-04-25T09:05:46.984717+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:55.839935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984987+0000","last_change":"2024-04-25T09:05:45.984300+0000","last_active":"2024-04-25T09:05:46.984987+0000","last_peered":"2024-04-25T09:05:46.984987+0000","last_clean":"2024-04-25T09:05:46.984987+0000","last_became_active":"2024-04-25T09:05:45.983379+0000","last_became_peered":"2024-04-25T09:05:45.983379+0000","last_unstale":"2024-04-25T09:05:46.984987+0000","last_undegraded":"2024-04-25T09:05:46.984987+0000","last_fullsized":"2024-04-25T09:05:46.984987+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:23.805432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985942+0000","last_change":"2024-04-25T09:05:45.988863+0000","last_active":"2024-04-25T09:05:46.985942+0000","last_peered":"2024-04-25T09:05:46.985942+0000","last_clean":"2024-04-25T09:05:46.985942+0000","last_became_active":"2024-04-25T09:05:45.988574+0000","last_became_peered":"2024-04-25T09:05:45.988574+0000","last_unstale":"2024-04-25T09:05:46.985942+0000","last_undegraded":"2024-04-25T09:05:46.985942+0000","last_fullsized":"2024-04-25T09:05:46.985942+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:43.593543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.982495+0000","last_change":"2024-04-25T09:05:45.975463+0000","last_active":"2024-04-25T09:05:46.982495+0000","last_peered":"2024-04-25T09:05:46.982495+0000","last_clean":"2024-04-25T09:05:46.982495+0000","last_became_active":"2024-04-25T09:05:45.975208+0000","last_became_peered":"2024-04-25T09:05:45.975208+0000","last_unstale":"2024-04-25T09:05:46.982495+0000","last_undegraded":"2024-04-25T09:05:46.982495+0000","last_fullsized":"2024-04-25T09:05:46.982495+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:22.887310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990788+0000","last_change":"2024-04-25T09:05:45.987595+0000","last_active":"2024-04-25T09:05:46.990788+0000","last_peered":"2024-04-25T09:05:46.990788+0000","last_clean":"2024-04-25T09:05:46.990788+0000","last_became_active":"2024-04-25T09:05:45.987330+0000","last_became_peered":"2024-04-25T09:05:45.987330+0000","last_unstale":"2024-04-25T09:05:46.990788+0000","last_undegraded":"2024-04-25T09:05:46.990788+0000","last_fullsized":"2024-04-25T09:05:46.990788+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:52.690987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.294193+0000","last_change":"2024-04-25T09:05:45.989573+0000","last_active":"2024-04-25T09:05:47.294193+0000","last_peered":"2024-04-25T09:05:47.294193+0000","last_clean":"2024-04-25T09:05:47.294193+0000","last_became_active":"2024-04-25T09:05:45.989283+0000","last_became_peered":"2024-04-25T09:05:45.989283+0000","last_unstale":"2024-04-25T09:05:47.294193+0000","last_undegraded":"2024-04-25T09:05:47.294193+0000","last_fullsized":"2024-04-25T09:05:47.294193+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:00.592886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985268+0000","last_change":"2024-04-25T09:05:45.981576+0000","last_active":"2024-04-25T09:05:46.985268+0000","last_peered":"2024-04-25T09:05:46.985268+0000","last_clean":"2024-04-25T09:05:46.985268+0000","last_became_active":"2024-04-25T09:05:45.981254+0000","last_became_peered":"2024-04-25T09:05:45.981254+0000","last_unstale":"2024-04-25T09:05:46.985268+0000","last_undegraded":"2024-04-25T09:05:46.985268+0000","last_fullsized":"2024-04-25T09:05:46.985268+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:40.538531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990540+0000","last_change":"2024-04-25T09:05:45.983290+0000","last_active":"2024-04-25T09:05:46.990540+0000","last_peered":"2024-04-25T09:05:46.990540+0000","last_clean":"2024-04-25T09:05:46.990540+0000","last_became_active":"2024-04-25T09:05:45.982970+0000","last_became_peered":"2024-04-25T09:05:45.982970+0000","last_unstale":"2024-04-25T09:05:46.990540+0000","last_undegraded":"2024-04-25T09:05:46.990540+0000","last_fullsized":"2024-04-25T09:05:46.990540+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:14.344862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986427+0000","last_change":"2024-04-25T09:05:45.987881+0000","last_active":"2024-04-25T09:05:46.986427+0000","last_peered":"2024-04-25T09:05:46.986427+0000","last_clean":"2024-04-25T09:05:46.986427+0000","last_became_active":"2024-04-25T09:05:45.987552+0000","last_became_peered":"2024-04-25T09:05:45.987552+0000","last_unstale":"2024-04-25T09:05:46.986427+0000","last_undegraded":"2024-04-25T09:05:46.986427+0000","last_fullsized":"2024-04-25T09:05:46.986427+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:23:33.625785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.982117+0000","last_change":"2024-04-25T09:05:45.985763+0000","last_active":"2024-04-25T09:05:46.982117+0000","last_peered":"2024-04-25T09:05:46.982117+0000","last_clean":"2024-04-25T09:05:46.982117+0000","last_became_active":"2024-04-25T09:05:45.985478+0000","last_became_peered":"2024-04-25T09:05:45.985478+0000","last_unstale":"2024-04-25T09:05:46.982117+0000","last_undegraded":"2024-04-25T09:05:46.982117+0000","last_fullsized":"2024-04-25T09:05:46.982117+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:08.188262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.980644+0000","last_change":"2024-04-25T09:05:45.976299+0000","last_active":"2024-04-25T09:05:45.980644+0000","last_peered":"2024-04-25T09:05:45.980644+0000","last_clean":"2024-04-25T09:05:45.980644+0000","last_became_active":"2024-04-25T09:05:45.976022+0000","last_became_peered":"2024-04-25T09:05:45.976022+0000","last_unstale":"2024-04-25T09:05:45.980644+0000","last_undegraded":"2024-04-25T09:05:45.980644+0000","last_fullsized":"2024-04-25T09:05:45.980644+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.314784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"43'4","reported_seq":18,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986872+0000","last_change":"2024-04-25T09:05:44.969727+0000","last_active":"2024-04-25T09:05:46.986872+0000","last_peered":"2024-04-25T09:05:46.986872+0000","last_clean":"2024-04-25T09:05:46.986872+0000","last_became_active":"2024-04-25T09:05:44.969335+0000","last_became_peered":"2024-04-25T09:05:44.969335+0000","last_unstale":"2024-04-25T09:05:46.986872+0000","last_undegraded":"2024-04-25T09:05:46.986872+0000","last_fullsized":"2024-04-25T09:05:46.986872+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:06.675601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985912+0000","last_change":"2024-04-25T09:05:45.982190+0000","last_active":"2024-04-25T09:05:46.985912+0000","last_peered":"2024-04-25T09:05:46.985912+0000","last_clean":"2024-04-25T09:05:46.985912+0000","last_became_active":"2024-04-25T09:05:45.981836+0000","last_became_peered":"2024-04-25T09:05:45.981836+0000","last_unstale":"2024-04-25T09:05:46.985912+0000","last_undegraded":"2024-04-25T09:05:46.985912+0000","last_fullsized":"2024-04-25T09:05:46.985912+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:13.815001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990946+0000","last_change":"2024-04-25T09:05:44.965988+0000","last_active":"2024-04-25T09:05:46.990946+0000","last_peered":"2024-04-25T09:05:46.990946+0000","last_clean":"2024-04-25T09:05:46.990946+0000","last_became_active":"2024-04-25T09:05:44.965633+0000","last_became_peered":"2024-04-25T09:05:44.965633+0000","last_unstale":"2024-04-25T09:05:46.990946+0000","last_undegraded":"2024-04-25T09:05:46.990946+0000","last_fullsized":"2024-04-25T09:05:46.990946+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:39.532486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.294406+0000","last_change":"2024-04-25T09:05:45.991219+0000","last_active":"2024-04-25T09:05:47.294406+0000","last_peered":"2024-04-25T09:05:47.294406+0000","last_clean":"2024-04-25T09:05:47.294406+0000","last_became_active":"2024-04-25T09:05:45.990946+0000","last_became_peered":"2024-04-25T09:05:45.990946+0000","last_unstale":"2024-04-25T09:05:47.294406+0000","last_undegraded":"2024-04-25T09:05:47.294406+0000","last_fullsized":"2024-04-25T09:05:47.294406+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:34.295608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"43'2","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.997224+0000","last_change":"2024-04-25T09:05:44.965804+0000","last_active":"2024-04-25T09:05:45.997224+0000","last_peered":"2024-04-25T09:05:45.997224+0000","last_clean":"2024-04-25T09:05:45.997224+0000","last_became_active":"2024-04-25T09:05:44.965545+0000","last_became_peered":"2024-04-25T09:05:44.965545+0000","last_unstale":"2024-04-25T09:05:45.997224+0000","last_undegraded":"2024-04-25T09:05:45.997224+0000","last_fullsized":"2024-04-25T09:05:45.997224+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:42.587498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.005571+0000","last_change":"2024-04-25T09:05:45.996080+0000","last_active":"2024-04-25T09:05:46.005571+0000","last_peered":"2024-04-25T09:05:46.005571+0000","last_clean":"2024-04-25T09:05:46.005571+0000","last_became_active":"2024-04-25T09:05:45.995637+0000","last_became_peered":"2024-04-25T09:05:45.995637+0000","last_unstale":"2024-04-25T09:05:46.005571+0000","last_undegraded":"2024-04-25T09:05:46.005571+0000","last_fullsized":"2024-04-25T09:05:46.005571+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:14.322200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984519+0000","last_change":"2024-04-25T09:05:44.968925+0000","last_active":"2024-04-25T09:05:46.984519+0000","last_peered":"2024-04-25T09:05:46.984519+0000","last_clean":"2024-04-25T09:05:46.984519+0000","last_became_active":"2024-04-25T09:05:44.968603+0000","last_became_peered":"2024-04-25T09:05:44.968603+0000","last_unstale":"2024-04-25T09:05:46.984519+0000","last_undegraded":"2024-04-25T09:05:46.984519+0000","last_fullsized":"2024-04-25T09:05:46.984519+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:34.074550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990547+0000","last_change":"2024-04-25T09:05:45.986138+0000","last_active":"2024-04-25T09:05:46.990547+0000","last_peered":"2024-04-25T09:05:46.990547+0000","last_clean":"2024-04-25T09:05:46.990547+0000","last_became_active":"2024-04-25T09:05:45.985835+0000","last_became_peered":"2024-04-25T09:05:45.985835+0000","last_unstale":"2024-04-25T09:05:46.990547+0000","last_undegraded":"2024-04-25T09:05:46.990547+0000","last_fullsized":"2024-04-25T09:05:46.990547+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:43.013672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986586+0000","last_change":"2024-04-25T09:05:44.971825+0000","last_active":"2024-04-25T09:05:46.986586+0000","last_peered":"2024-04-25T09:05:46.986586+0000","last_clean":"2024-04-25T09:05:46.986586+0000","last_became_active":"2024-04-25T09:05:44.971277+0000","last_became_peered":"2024-04-25T09:05:44.971277+0000","last_unstale":"2024-04-25T09:05:46.986586+0000","last_undegraded":"2024-04-25T09:05:46.986586+0000","last_fullsized":"2024-04-25T09:05:46.986586+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:50.033611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.000808+0000","last_change":"2024-04-25T09:05:45.990094+0000","last_active":"2024-04-25T09:05:46.000808+0000","last_peered":"2024-04-25T09:05:46.000808+0000","last_clean":"2024-04-25T09:05:46.000808+0000","last_became_active":"2024-04-25T09:05:45.989454+0000","last_became_peered":"2024-04-25T09:05:45.989454+0000","last_unstale":"2024-04-25T09:05:46.000808+0000","last_undegraded":"2024-04-25T09:05:46.000808+0000","last_fullsized":"2024-04-25T09:05:46.000808+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:13.815001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990706+0000","last_change":"2024-04-25T09:05:44.965817+0000","last_active":"2024-04-25T09:05:46.990706+0000","last_peered":"2024-04-25T09:05:46.990706+0000","last_clean":"2024-04-25T09:05:46.990706+0000","last_became_active":"2024-04-25T09:05:44.964811+0000","last_became_peered":"2024-04-25T09:05:44.964811+0000","last_unstale":"2024-04-25T09:05:46.990706+0000","last_undegraded":"2024-04-25T09:05:46.990706+0000","last_fullsized":"2024-04-25T09:05:46.990706+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:33.831332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.003094+0000","last_change":"2024-04-25T09:05:45.992013+0000","last_active":"2024-04-25T09:05:46.003094+0000","last_peered":"2024-04-25T09:05:46.003094+0000","last_clean":"2024-04-25T09:05:46.003094+0000","last_became_active":"2024-04-25T09:05:45.991354+0000","last_became_peered":"2024-04-25T09:05:45.991354+0000","last_unstale":"2024-04-25T09:05:46.003094+0000","last_undegraded":"2024-04-25T09:05:46.003094+0000","last_fullsized":"2024-04-25T09:05:46.003094+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.314784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.293934+0000","last_change":"2024-04-25T09:05:44.967207+0000","last_active":"2024-04-25T09:05:47.293934+0000","last_peered":"2024-04-25T09:05:47.293934+0000","last_clean":"2024-04-25T09:05:47.293934+0000","last_became_active":"2024-04-25T09:05:44.966896+0000","last_became_peered":"2024-04-25T09:05:44.966896+0000","last_unstale":"2024-04-25T09:05:47.293934+0000","last_undegraded":"2024-04-25T09:05:47.293934+0000","last_fullsized":"2024-04-25T09:05:47.293934+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:51.684942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984330+0000","last_change":"2024-04-25T09:05:45.983280+0000","last_active":"2024-04-25T09:05:46.984330+0000","last_peered":"2024-04-25T09:05:46.984330+0000","last_clean":"2024-04-25T09:05:46.984330+0000","last_became_active":"2024-04-25T09:05:45.983005+0000","last_became_peered":"2024-04-25T09:05:45.983005+0000","last_unstale":"2024-04-25T09:05:46.984330+0000","last_undegraded":"2024-04-25T09:05:46.984330+0000","last_fullsized":"2024-04-25T09:05:46.984330+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:22.768061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.970937+0000","last_change":"2024-04-25T09:05:44.964254+0000","last_active":"2024-04-25T09:05:45.970937+0000","last_peered":"2024-04-25T09:05:45.970937+0000","last_clean":"2024-04-25T09:05:45.970937+0000","last_became_active":"2024-04-25T09:05:44.963950+0000","last_became_peered":"2024-04-25T09:05:44.963950+0000","last_unstale":"2024-04-25T09:05:45.970937+0000","last_undegraded":"2024-04-25T09:05:45.970937+0000","last_fullsized":"2024-04-25T09:05:45.970937+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:59.018663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990973+0000","last_change":"2024-04-25T09:05:45.984972+0000","last_active":"2024-04-25T09:05:46.990973+0000","last_peered":"2024-04-25T09:05:46.990973+0000","last_clean":"2024-04-25T09:05:46.990973+0000","last_became_active":"2024-04-25T09:05:45.984714+0000","last_became_peered":"2024-04-25T09:05:45.984714+0000","last_unstale":"2024-04-25T09:05:46.990973+0000","last_undegraded":"2024-04-25T09:05:46.990973+0000","last_fullsized":"2024-04-25T09:05:46.990973+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:40.465912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.991003+0000","last_change":"2024-04-25T09:05:44.962236+0000","last_active":"2024-04-25T09:05:46.991003+0000","last_peered":"2024-04-25T09:05:46.991003+0000","last_clean":"2024-04-25T09:05:46.991003+0000","last_became_active":"2024-04-25T09:05:44.961810+0000","last_became_peered":"2024-04-25T09:05:44.961810+0000","last_unstale":"2024-04-25T09:05:46.991003+0000","last_undegraded":"2024-04-25T09:05:46.991003+0000","last_fullsized":"2024-04-25T09:05:46.991003+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:54.833890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985275+0000","last_change":"2024-04-25T09:05:45.989225+0000","last_active":"2024-04-25T09:05:46.985275+0000","last_peered":"2024-04-25T09:05:46.985275+0000","last_clean":"2024-04-25T09:05:46.985275+0000","last_became_active":"2024-04-25T09:05:45.988798+0000","last_became_peered":"2024-04-25T09:05:45.988798+0000","last_unstale":"2024-04-25T09:05:46.985275+0000","last_undegraded":"2024-04-25T09:05:46.985275+0000","last_fullsized":"2024-04-25T09:05:46.985275+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:20.521287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.969759+0000","last_change":"2024-04-25T09:05:44.974996+0000","last_active":"2024-04-25T09:05:45.969759+0000","last_peered":"2024-04-25T09:05:45.969759+0000","last_clean":"2024-04-25T09:05:45.969759+0000","last_became_active":"2024-04-25T09:05:44.974744+0000","last_became_peered":"2024-04-25T09:05:44.974744+0000","last_unstale":"2024-04-25T09:05:45.969759+0000","last_undegraded":"2024-04-25T09:05:45.969759+0000","last_fullsized":"2024-04-25T09:05:45.969759+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:38.880771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986758+0000","last_change":"2024-04-25T09:05:45.978430+0000","last_active":"2024-04-25T09:05:46.986758+0000","last_peered":"2024-04-25T09:05:46.986758+0000","last_clean":"2024-04-25T09:05:46.986758+0000","last_became_active":"2024-04-25T09:05:45.978178+0000","last_became_peered":"2024-04-25T09:05:45.978178+0000","last_unstale":"2024-04-25T09:05:46.986758+0000","last_undegraded":"2024-04-25T09:05:46.986758+0000","last_fullsized":"2024-04-25T09:05:46.986758+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:23.443548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"43'3","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985123+0000","last_change":"2024-04-25T09:05:44.970903+0000","last_active":"2024-04-25T09:05:46.985123+0000","last_peered":"2024-04-25T09:05:46.985123+0000","last_clean":"2024-04-25T09:05:46.985123+0000","last_became_active":"2024-04-25T09:05:44.970369+0000","last_became_peered":"2024-04-25T09:05:44.970369+0000","last_unstale":"2024-04-25T09:05:46.985123+0000","last_undegraded":"2024-04-25T09:05:46.985123+0000","last_fullsized":"2024-04-25T09:05:46.985123+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:55.087570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984843+0000","last_change":"2024-04-25T09:05:45.985464+0000","last_active":"2024-04-25T09:05:46.984843+0000","last_peered":"2024-04-25T09:05:46.984843+0000","last_clean":"2024-04-25T09:05:46.984843+0000","last_became_active":"2024-04-25T09:05:45.984556+0000","last_became_peered":"2024-04-25T09:05:45.984556+0000","last_unstale":"2024-04-25T09:05:46.984843+0000","last_undegraded":"2024-04-25T09:05:46.984843+0000","last_fullsized":"2024-04-25T09:05:46.984843+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:38.697851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"43'6","reported_seq":20,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.982284+0000","last_change":"2024-04-25T09:05:44.962979+0000","last_active":"2024-04-25T09:05:46.982284+0000","last_peered":"2024-04-25T09:05:46.982284+0000","last_clean":"2024-04-25T09:05:46.982284+0000","last_became_active":"2024-04-25T09:05:44.962051+0000","last_became_peered":"2024-04-25T09:05:44.962051+0000","last_unstale":"2024-04-25T09:05:46.982284+0000","last_undegraded":"2024-04-25T09:05:46.982284+0000","last_fullsized":"2024-04-25T09:05:46.982284+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:04.670442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985313+0000","last_change":"2024-04-25T09:05:45.985437+0000","last_active":"2024-04-25T09:05:46.985313+0000","last_peered":"2024-04-25T09:05:46.985313+0000","last_clean":"2024-04-25T09:05:46.985313+0000","last_became_active":"2024-04-25T09:05:45.985036+0000","last_became_peered":"2024-04-25T09:05:45.985036+0000","last_unstale":"2024-04-25T09:05:46.985313+0000","last_undegraded":"2024-04-25T09:05:46.985313+0000","last_fullsized":"2024-04-25T09:05:46.985313+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:26.004499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986658+0000","last_change":"2024-04-25T09:05:44.974119+0000","last_active":"2024-04-25T09:05:46.986658+0000","last_peered":"2024-04-25T09:05:46.986658+0000","last_clean":"2024-04-25T09:05:46.986658+0000","last_became_active":"2024-04-25T09:05:44.973785+0000","last_became_peered":"2024-04-25T09:05:44.973785+0000","last_unstale":"2024-04-25T09:05:46.986658+0000","last_undegraded":"2024-04-25T09:05:46.986658+0000","last_fullsized":"2024-04-25T09:05:46.986658+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:09.848649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.000611+0000","last_change":"2024-04-25T09:05:45.989003+0000","last_active":"2024-04-25T09:05:46.000611+0000","last_peered":"2024-04-25T09:05:46.000611+0000","last_clean":"2024-04-25T09:05:46.000611+0000","last_became_active":"2024-04-25T09:05:45.981264+0000","last_became_peered":"2024-04-25T09:05:45.981264+0000","last_unstale":"2024-04-25T09:05:46.000611+0000","last_undegraded":"2024-04-25T09:05:46.000611+0000","last_fullsized":"2024-04-25T09:05:46.000611+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:26.004499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984684+0000","last_change":"2024-04-25T09:05:44.966816+0000","last_active":"2024-04-25T09:05:46.984684+0000","last_peered":"2024-04-25T09:05:46.984684+0000","last_clean":"2024-04-25T09:05:46.984684+0000","last_became_active":"2024-04-25T09:05:44.966544+0000","last_became_peered":"2024-04-25T09:05:44.966544+0000","last_unstale":"2024-04-25T09:05:46.984684+0000","last_undegraded":"2024-04-25T09:05:46.984684+0000","last_fullsized":"2024-04-25T09:05:46.984684+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:26.399679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986282+0000","last_change":"2024-04-25T09:05:45.990447+0000","last_active":"2024-04-25T09:05:46.986282+0000","last_peered":"2024-04-25T09:05:46.986282+0000","last_clean":"2024-04-25T09:05:46.986282+0000","last_became_active":"2024-04-25T09:05:45.990178+0000","last_became_peered":"2024-04-25T09:05:45.990178+0000","last_unstale":"2024-04-25T09:05:46.986282+0000","last_undegraded":"2024-04-25T09:05:46.986282+0000","last_fullsized":"2024-04-25T09:05:46.986282+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:49.395534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986421+0000","last_change":"2024-04-25T09:05:44.974194+0000","last_active":"2024-04-25T09:05:46.986421+0000","last_peered":"2024-04-25T09:05:46.986421+0000","last_clean":"2024-04-25T09:05:46.986421+0000","last_became_active":"2024-04-25T09:05:44.973844+0000","last_became_peered":"2024-04-25T09:05:44.973844+0000","last_unstale":"2024-04-25T09:05:46.986421+0000","last_undegraded":"2024-04-25T09:05:46.986421+0000","last_fullsized":"2024-04-25T09:05:46.986421+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:39.459866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985261+0000","last_change":"2024-04-25T09:05:45.984978+0000","last_active":"2024-04-25T09:05:46.985261+0000","last_peered":"2024-04-25T09:05:46.985261+0000","last_clean":"2024-04-25T09:05:46.985261+0000","last_became_active":"2024-04-25T09:05:45.984223+0000","last_became_peered":"2024-04-25T09:05:45.984223+0000","last_unstale":"2024-04-25T09:05:46.985261+0000","last_undegraded":"2024-04-25T09:05:46.985261+0000","last_fullsized":"2024-04-25T09:05:46.985261+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:59:34.295608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"43'8","reported_seq":20,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.003829+0000","last_change":"2024-04-25T09:05:44.967008+0000","last_active":"2024-04-25T09:05:46.003829+0000","last_peered":"2024-04-25T09:05:46.003829+0000","last_clean":"2024-04-25T09:05:46.003829+0000","last_became_active":"2024-04-25T09:05:44.966736+0000","last_became_peered":"2024-04-25T09:05:44.966736+0000","last_unstale":"2024-04-25T09:05:46.003829+0000","last_undegraded":"2024-04-25T09:05:46.003829+0000","last_fullsized":"2024-04-25T09:05:46.003829+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:45.149353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.982507+0000","last_change":"2024-04-25T09:05:45.988443+0000","last_active":"2024-04-25T09:05:46.982507+0000","last_peered":"2024-04-25T09:05:46.982507+0000","last_clean":"2024-04-25T09:05:46.982507+0000","last_became_active":"2024-04-25T09:05:45.988157+0000","last_became_peered":"2024-04-25T09:05:45.988157+0000","last_unstale":"2024-04-25T09:05:46.982507+0000","last_undegraded":"2024-04-25T09:05:46.982507+0000","last_fullsized":"2024-04-25T09:05:46.982507+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:22.768061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.982579+0000","last_change":"2024-04-25T09:05:44.965202+0000","last_active":"2024-04-25T09:05:46.982579+0000","last_peered":"2024-04-25T09:05:46.982579+0000","last_clean":"2024-04-25T09:05:46.982579+0000","last_became_active":"2024-04-25T09:05:44.964757+0000","last_became_peered":"2024-04-25T09:05:44.964757+0000","last_unstale":"2024-04-25T09:05:46.982579+0000","last_undegraded":"2024-04-25T09:05:46.982579+0000","last_fullsized":"2024-04-25T09:05:46.982579+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:29.158964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.003056+0000","last_change":"2024-04-25T09:05:45.992363+0000","last_active":"2024-04-25T09:05:46.003056+0000","last_peered":"2024-04-25T09:05:46.003056+0000","last_clean":"2024-04-25T09:05:46.003056+0000","last_became_active":"2024-04-25T09:05:45.992100+0000","last_became_peered":"2024-04-25T09:05:45.992100+0000","last_unstale":"2024-04-25T09:05:46.003056+0000","last_undegraded":"2024-04-25T09:05:46.003056+0000","last_fullsized":"2024-04-25T09:05:46.003056+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:14.322200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990841+0000","last_change":"2024-04-25T09:05:44.963637+0000","last_active":"2024-04-25T09:05:46.990841+0000","last_peered":"2024-04-25T09:05:46.990841+0000","last_clean":"2024-04-25T09:05:46.990841+0000","last_became_active":"2024-04-25T09:05:44.963363+0000","last_became_peered":"2024-04-25T09:05:44.963363+0000","last_unstale":"2024-04-25T09:05:46.990841+0000","last_undegraded":"2024-04-25T09:05:46.990841+0000","last_fullsized":"2024-04-25T09:05:46.990841+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:22.799387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985200+0000","last_change":"2024-04-25T09:05:45.987651+0000","last_active":"2024-04-25T09:05:46.985200+0000","last_peered":"2024-04-25T09:05:46.985200+0000","last_clean":"2024-04-25T09:05:46.985200+0000","last_became_active":"2024-04-25T09:05:45.987367+0000","last_became_peered":"2024-04-25T09:05:45.987367+0000","last_unstale":"2024-04-25T09:05:46.985200+0000","last_undegraded":"2024-04-25T09:05:46.985200+0000","last_fullsized":"2024-04-25T09:05:46.985200+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:32.535178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"43'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.294282+0000","last_change":"2024-04-25T09:05:44.971044+0000","last_active":"2024-04-25T09:05:47.294282+0000","last_peered":"2024-04-25T09:05:47.294282+0000","last_clean":"2024-04-25T09:05:47.294282+0000","last_became_active":"2024-04-25T09:05:44.970745+0000","last_became_peered":"2024-04-25T09:05:44.970745+0000","last_unstale":"2024-04-25T09:05:47.294282+0000","last_undegraded":"2024-04-25T09:05:47.294282+0000","last_fullsized":"2024-04-25T09:05:47.294282+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:55.087570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985735+0000","last_change":"2024-04-25T09:05:45.989619+0000","last_active":"2024-04-25T09:05:46.985735+0000","last_peered":"2024-04-25T09:05:46.985735+0000","last_clean":"2024-04-25T09:05:46.985735+0000","last_became_active":"2024-04-25T09:05:45.989318+0000","last_became_peered":"2024-04-25T09:05:45.989318+0000","last_unstale":"2024-04-25T09:05:46.985735+0000","last_undegraded":"2024-04-25T09:05:46.985735+0000","last_fullsized":"2024-04-25T09:05:46.985735+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:59.784443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986857+0000","last_change":"2024-04-25T09:05:44.973011+0000","last_active":"2024-04-25T09:05:46.986857+0000","last_peered":"2024-04-25T09:05:46.986857+0000","last_clean":"2024-04-25T09:05:46.986857+0000","last_became_active":"2024-04-25T09:05:44.972737+0000","last_became_peered":"2024-04-25T09:05:44.972737+0000","last_unstale":"2024-04-25T09:05:46.986857+0000","last_undegraded":"2024-04-25T09:05:46.986857+0000","last_fullsized":"2024-04-25T09:05:46.986857+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:55.087570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986371+0000","last_change":"2024-04-25T09:05:45.990076+0000","last_active":"2024-04-25T09:05:46.986371+0000","last_peered":"2024-04-25T09:05:46.986371+0000","last_clean":"2024-04-25T09:05:46.986371+0000","last_became_active":"2024-04-25T09:05:45.989778+0000","last_became_peered":"2024-04-25T09:05:45.989778+0000","last_unstale":"2024-04-25T09:05:46.986371+0000","last_undegraded":"2024-04-25T09:05:46.986371+0000","last_fullsized":"2024-04-25T09:05:46.986371+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:35.122951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986781+0000","last_change":"2024-04-25T09:05:44.971565+0000","last_active":"2024-04-25T09:05:46.986781+0000","last_peered":"2024-04-25T09:05:46.986781+0000","last_clean":"2024-04-25T09:05:46.986781+0000","last_became_active":"2024-04-25T09:05:44.970909+0000","last_became_peered":"2024-04-25T09:05:44.970909+0000","last_unstale":"2024-04-25T09:05:46.986781+0000","last_undegraded":"2024-04-25T09:05:46.986781+0000","last_fullsized":"2024-04-25T09:05:46.986781+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:21.759535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.992342+0000","last_change":"2024-04-25T09:05:45.986759+0000","last_active":"2024-04-25T09:05:45.992342+0000","last_peered":"2024-04-25T09:05:45.992342+0000","last_clean":"2024-04-25T09:05:45.992342+0000","last_became_active":"2024-04-25T09:05:45.986485+0000","last_became_peered":"2024-04-25T09:05:45.986485+0000","last_unstale":"2024-04-25T09:05:45.992342+0000","last_undegraded":"2024-04-25T09:05:45.992342+0000","last_fullsized":"2024-04-25T09:05:45.992342+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:30.668192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.293972+0000","last_change":"2024-04-25T09:05:44.965022+0000","last_active":"2024-04-25T09:05:47.293972+0000","last_peered":"2024-04-25T09:05:47.293972+0000","last_clean":"2024-04-25T09:05:47.293972+0000","last_became_active":"2024-04-25T09:05:44.964756+0000","last_became_peered":"2024-04-25T09:05:44.964756+0000","last_unstale":"2024-04-25T09:05:47.293972+0000","last_undegraded":"2024-04-25T09:05:47.293972+0000","last_fullsized":"2024-04-25T09:05:47.293972+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:26.399679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.982113+0000","last_change":"2024-04-25T09:05:45.981906+0000","last_active":"2024-04-25T09:05:46.982113+0000","last_peered":"2024-04-25T09:05:46.982113+0000","last_clean":"2024-04-25T09:05:46.982113+0000","last_became_active":"2024-04-25T09:05:45.981653+0000","last_became_peered":"2024-04-25T09:05:45.981653+0000","last_unstale":"2024-04-25T09:05:46.982113+0000","last_undegraded":"2024-04-25T09:05:46.982113+0000","last_fullsized":"2024-04-25T09:05:46.982113+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:46:39.886816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.970009+0000","last_change":"2024-04-25T09:05:44.969200+0000","last_active":"2024-04-25T09:05:45.970009+0000","last_peered":"2024-04-25T09:05:45.970009+0000","last_clean":"2024-04-25T09:05:45.970009+0000","last_became_active":"2024-04-25T09:05:44.968917+0000","last_became_peered":"2024-04-25T09:05:44.968917+0000","last_unstale":"2024-04-25T09:05:45.970009+0000","last_undegraded":"2024-04-25T09:05:45.970009+0000","last_fullsized":"2024-04-25T09:05:45.970009+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:07.182217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.000699+0000","last_change":"2024-04-25T09:05:45.989777+0000","last_active":"2024-04-25T09:05:46.000699+0000","last_peered":"2024-04-25T09:05:46.000699+0000","last_clean":"2024-04-25T09:05:46.000699+0000","last_became_active":"2024-04-25T09:05:45.989441+0000","last_became_peered":"2024-04-25T09:05:45.989441+0000","last_unstale":"2024-04-25T09:05:46.000699+0000","last_undegraded":"2024-04-25T09:05:46.000699+0000","last_fullsized":"2024-04-25T09:05:46.000699+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:59.784443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984128+0000","last_change":"2024-04-25T09:05:44.969151+0000","last_active":"2024-04-25T09:05:46.984128+0000","last_peered":"2024-04-25T09:05:46.984128+0000","last_clean":"2024-04-25T09:05:46.984128+0000","last_became_active":"2024-04-25T09:05:44.967404+0000","last_became_peered":"2024-04-25T09:05:44.967404+0000","last_unstale":"2024-04-25T09:05:46.984128+0000","last_undegraded":"2024-04-25T09:05:46.984128+0000","last_fullsized":"2024-04-25T09:05:46.984128+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:39.459866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986006+0000","last_change":"2024-04-25T09:05:45.993445+0000","last_active":"2024-04-25T09:05:46.986006+0000","last_peered":"2024-04-25T09:05:46.986006+0000","last_clean":"2024-04-25T09:05:46.986006+0000","last_became_active":"2024-04-25T09:05:45.993188+0000","last_became_peered":"2024-04-25T09:05:45.993188+0000","last_unstale":"2024-04-25T09:05:46.986006+0000","last_undegraded":"2024-04-25T09:05:46.986006+0000","last_fullsized":"2024-04-25T09:05:46.986006+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:11.314784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.988471+0000","last_change":"2024-04-25T09:05:44.963620+0000","last_active":"2024-04-25T09:05:46.988471+0000","last_peered":"2024-04-25T09:05:46.988471+0000","last_clean":"2024-04-25T09:05:46.988471+0000","last_became_active":"2024-04-25T09:05:44.961803+0000","last_became_peered":"2024-04-25T09:05:44.961803+0000","last_unstale":"2024-04-25T09:05:46.988471+0000","last_undegraded":"2024-04-25T09:05:46.988471+0000","last_fullsized":"2024-04-25T09:05:46.988471+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:46.601142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.999852+0000","last_change":"2024-04-25T09:05:45.984412+0000","last_active":"2024-04-25T09:05:45.999852+0000","last_peered":"2024-04-25T09:05:45.999852+0000","last_clean":"2024-04-25T09:05:45.999852+0000","last_became_active":"2024-04-25T09:05:45.983645+0000","last_became_peered":"2024-04-25T09:05:45.983645+0000","last_unstale":"2024-04-25T09:05:45.999852+0000","last_undegraded":"2024-04-25T09:05:45.999852+0000","last_fullsized":"2024-04-25T09:05:45.999852+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:23.805432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985120+0000","last_change":"2024-04-25T09:05:44.970656+0000","last_active":"2024-04-25T09:05:46.985120+0000","last_peered":"2024-04-25T09:05:46.985120+0000","last_clean":"2024-04-25T09:05:46.985120+0000","last_became_active":"2024-04-25T09:05:44.969944+0000","last_became_peered":"2024-04-25T09:05:44.969944+0000","last_unstale":"2024-04-25T09:05:46.985120+0000","last_undegraded":"2024-04-25T09:05:46.985120+0000","last_fullsized":"2024-04-25T09:05:46.985120+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:46.601142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.985001+0000","last_change":"2024-04-25T09:05:45.994520+0000","last_active":"2024-04-25T09:05:46.985001+0000","last_peered":"2024-04-25T09:05:46.985001+0000","last_clean":"2024-04-25T09:05:46.985001+0000","last_became_active":"2024-04-25T09:05:45.994237+0000","last_became_peered":"2024-04-25T09:05:45.994237+0000","last_unstale":"2024-04-25T09:05:46.985001+0000","last_undegraded":"2024-04-25T09:05:46.985001+0000","last_fullsized":"2024-04-25T09:05:46.985001+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:39.457564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.972583+0000","last_change":"2024-04-25T09:05:44.966197+0000","last_active":"2024-04-25T09:05:45.972583+0000","last_peered":"2024-04-25T09:05:45.972583+0000","last_clean":"2024-04-25T09:05:45.972583+0000","last_became_active":"2024-04-25T09:05:44.965946+0000","last_became_peered":"2024-04-25T09:05:44.965946+0000","last_unstale":"2024-04-25T09:05:45.972583+0000","last_undegraded":"2024-04-25T09:05:45.972583+0000","last_fullsized":"2024-04-25T09:05:45.972583+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:12.808956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986535+0000","last_change":"2024-04-25T09:05:45.978993+0000","last_active":"2024-04-25T09:05:46.986535+0000","last_peered":"2024-04-25T09:05:46.986535+0000","last_clean":"2024-04-25T09:05:46.986535+0000","last_became_active":"2024-04-25T09:05:45.976239+0000","last_became_peered":"2024-04-25T09:05:45.976239+0000","last_unstale":"2024-04-25T09:05:46.986535+0000","last_undegraded":"2024-04-25T09:05:46.986535+0000","last_fullsized":"2024-04-25T09:05:46.986535+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:07.259558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984453+0000","last_change":"2024-04-25T09:05:44.968742+0000","last_active":"2024-04-25T09:05:46.984453+0000","last_peered":"2024-04-25T09:05:46.984453+0000","last_clean":"2024-04-25T09:05:46.984453+0000","last_became_active":"2024-04-25T09:05:44.968465+0000","last_became_peered":"2024-04-25T09:05:44.968465+0000","last_unstale":"2024-04-25T09:05:46.984453+0000","last_undegraded":"2024-04-25T09:05:46.984453+0000","last_fullsized":"2024-04-25T09:05:46.984453+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:51.684942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.986557+0000","last_change":"2024-04-25T09:05:45.990080+0000","last_active":"2024-04-25T09:05:46.986557+0000","last_peered":"2024-04-25T09:05:46.986557+0000","last_clean":"2024-04-25T09:05:46.986557+0000","last_became_active":"2024-04-25T09:05:45.989760+0000","last_became_peered":"2024-04-25T09:05:45.989760+0000","last_unstale":"2024-04-25T09:05:46.986557+0000","last_undegraded":"2024-04-25T09:05:46.986557+0000","last_fullsized":"2024-04-25T09:05:46.986557+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:03.029893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990722+0000","last_change":"2024-04-25T09:05:44.963068+0000","last_active":"2024-04-25T09:05:46.990722+0000","last_peered":"2024-04-25T09:05:46.990722+0000","last_clean":"2024-04-25T09:05:46.990722+0000","last_became_active":"2024-04-25T09:05:44.962739+0000","last_became_peered":"2024-04-25T09:05:44.962739+0000","last_unstale":"2024-04-25T09:05:46.990722+0000","last_undegraded":"2024-04-25T09:05:46.990722+0000","last_fullsized":"2024-04-25T09:05:46.990722+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:31.529133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.294208+0000","last_change":"2024-04-25T09:05:45.995537+0000","last_active":"2024-04-25T09:05:47.294208+0000","last_peered":"2024-04-25T09:05:47.294208+0000","last_clean":"2024-04-25T09:05:47.294208+0000","last_became_active":"2024-04-25T09:05:45.994693+0000","last_became_peered":"2024-04-25T09:05:45.994693+0000","last_unstale":"2024-04-25T09:05:47.294208+0000","last_undegraded":"2024-04-25T09:05:47.294208+0000","last_fullsized":"2024-04-25T09:05:47.294208+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:39.457564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.970745+0000","last_change":"2024-04-25T09:05:44.965506+0000","last_active":"2024-04-25T09:05:45.970745+0000","last_peered":"2024-04-25T09:05:45.970745+0000","last_clean":"2024-04-25T09:05:45.970745+0000","last_became_active":"2024-04-25T09:05:44.965298+0000","last_became_peered":"2024-04-25T09:05:44.965298+0000","last_unstale":"2024-04-25T09:05:45.970745+0000","last_undegraded":"2024-04-25T09:05:45.970745+0000","last_fullsized":"2024-04-25T09:05:45.970745+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:29.667466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.990526+0000","last_change":"2024-04-25T09:05:45.978499+0000","last_active":"2024-04-25T09:05:46.990526+0000","last_peered":"2024-04-25T09:05:46.990526+0000","last_clean":"2024-04-25T09:05:46.990526+0000","last_became_active":"2024-04-25T09:05:45.978227+0000","last_became_peered":"2024-04-25T09:05:45.978227+0000","last_unstale":"2024-04-25T09:05:46.990526+0000","last_undegraded":"2024-04-25T09:05:46.990526+0000","last_fullsized":"2024-04-25T09:05:46.990526+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:17.077361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.971222+0000","last_change":"2024-04-25T09:05:44.961851+0000","last_active":"2024-04-25T09:05:45.971222+0000","last_peered":"2024-04-25T09:05:45.971222+0000","last_clean":"2024-04-25T09:05:45.971222+0000","last_became_active":"2024-04-25T09:05:44.961554+0000","last_became_peered":"2024-04-25T09:05:44.961554+0000","last_unstale":"2024-04-25T09:05:45.971222+0000","last_undegraded":"2024-04-25T09:05:45.971222+0000","last_fullsized":"2024-04-25T09:05:45.971222+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:21.881265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T09:05:45.994874+0000","last_change":"2024-04-25T09:05:45.983845+0000","last_active":"2024-04-25T09:05:45.994874+0000","last_peered":"2024-04-25T09:05:45.994874+0000","last_clean":"2024-04-25T09:05:45.994874+0000","last_became_active":"2024-04-25T09:05:45.981204+0000","last_became_peered":"2024-04-25T09:05:45.981204+0000","last_unstale":"2024-04-25T09:05:45.994874+0000","last_undegraded":"2024-04-25T09:05:45.994874+0000","last_fullsized":"2024-04-25T09:05:45.994874+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:44.940754+0000","last_clean_scrub_stamp":"2024-04-25T09:05:44.940754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:55.839935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"43'2","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:47.294348+0000","last_change":"2024-04-25T09:05:44.967312+0000","last_active":"2024-04-25T09:05:47.294348+0000","last_peered":"2024-04-25T09:05:47.294348+0000","last_clean":"2024-04-25T09:05:47.294348+0000","last_became_active":"2024-04-25T09:05:44.966859+0000","last_became_peered":"2024-04-25T09:05:44.966859+0000","last_unstale":"2024-04-25T09:05:47.294348+0000","last_undegraded":"2024-04-25T09:05:47.294348+0000","last_fullsized":"2024-04-25T09:05:47.294348+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:05:43.934709+0000","last_clean_scrub_stamp":"2024-04-25T09:05:43.934709+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:29:39.459866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":214,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-25T09:05:46.984185+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:05:46.984185+0000","last_peered":"2024-04-25T09:05:46.984185+0000","last_clean":"2024-04-25T09:05:46.984185+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:05:46.984185+0000","last_undegraded":"2024-04-25T09:05:46.984185+0000","last_fullsized":"2024-04-25T09:05:46.984185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1114112,"data_stored":799548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":512000,"data_stored":203462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":202860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":528384,"data_stored":210702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":528384,"data_stored":209728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":532480,"data_stored":210724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":202860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28104,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343736,"statfs":{"total":96636764160,"available":96607985664,"internally_reserved":0,"allocated":1101824,"data_stored":793192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:05:50.413 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:05:50.413 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:05:50.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.609+0000 7fefb1800640 1 Processor -- start 2024-04-25T09:05:50.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.609+0000 7fefb1800640 1 -- start start 2024-04-25T09:05:50.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.609+0000 7fefb1800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefac15ebd0 0x7fefac168ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.609+0000 7fefb1800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefac0ad710 con 0x7fefac06c370 2024-04-25T09:05:50.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.609+0000 7fefb1800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefac15f1f0 con 0x7fefac158340 2024-04-25T09:05:50.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.609+0000 7fefb1800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefac0ad9b0 con 0x7fefac15ebd0 2024-04-25T09:05:50.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.609+0000 7fefa2000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fefac06c370 0x7fefac15e4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39030/0 (socket says 172.21.15.175:39030) 2024-04-25T09:05:50.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.609+0000 7fefa2000640 1 -- 172.21.15.175:0/2630703634 learned_addr learned my addr 172.21.15.175:0/2630703634 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:50.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.609+0000 7fefab400640 1 --2- 172.21.15.175:0/2630703634 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefac15ebd0 0x7fefac168ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.609+0000 7fefaa000640 1 -- 172.21.15.175:0/2630703634 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521804161 0 0) 0x7fefac0ad710 con 0x7fefac06c370 2024-04-25T09:05:50.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.609+0000 7fefaa000640 1 -- 172.21.15.175:0/2630703634 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef90003530 con 0x7fefac06c370 2024-04-25T09:05:50.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.609+0000 7fefab400640 1 -- 172.21.15.175:0/2630703634 >> v1:172.21.15.177:6789/0 conn(0x7fefac158340 legacy=0x7fefac06bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.609+0000 7fefab400640 1 -- 172.21.15.175:0/2630703634 >> v1:172.21.15.175:6789/0 conn(0x7fefac06c370 legacy=0x7fefac15e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.609+0000 7fefaa000640 1 -- 172.21.15.175:0/2630703634 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227282321 0 0) 0x7fefac15f1f0 con 0x7fefac158340 2024-04-25T09:05:50.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.609+0000 7fefab400640 1 -- 172.21.15.175:0/2630703634 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac0adc90 con 0x7fefac15ebd0 2024-04-25T09:05:50.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.613+0000 7fefab400640 1 --2- 172.21.15.175:0/2630703634 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefac15ebd0 0x7fefac168ac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009dc0 tx=0x7fefa401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72c27a1330b0c073 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.613+0000 7fefaa000640 1 -- 172.21.15.175:0/2630703634 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa40b2070 con 0x7fefac15ebd0 2024-04-25T09:05:50.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.613+0000 7fefaa000640 1 -- 172.21.15.175:0/2630703634 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa40a5860 con 0x7fefac15ebd0 2024-04-25T09:05:50.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.613+0000 7fefaa000640 1 -- 172.21.15.175:0/2630703634 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa40a5c30 con 0x7fefac15ebd0 2024-04-25T09:05:50.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.613+0000 7fefb1800640 1 -- 172.21.15.175:0/2630703634 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefac15ebd0 msgr2=0x7fefac168ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.613+0000 7fefb1800640 1 --2- 172.21.15.175:0/2630703634 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefac15ebd0 0x7fefac168ac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009dc0 tx=0x7fefa401c990 comp rx=0 tx=0).stop 2024-04-25T09:05:50.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.613+0000 7fefb1800640 1 -- 172.21.15.175:0/2630703634 shutdown_connections 2024-04-25T09:05:50.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.613+0000 7fefb1800640 1 --2- 172.21.15.175:0/2630703634 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefac15ebd0 0x7fefac168ac0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.613+0000 7fefb1800640 1 -- 172.21.15.175:0/2630703634 >> 172.21.15.175:0/2630703634 conn(0x7fefac071b20 msgr2=0x7fefac071f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:50.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.613+0000 7fefb1800640 1 -- 172.21.15.175:0/2630703634 shutdown_connections 2024-04-25T09:05:50.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.613+0000 7fefb1800640 1 -- 172.21.15.175:0/2630703634 wait complete. 2024-04-25T09:05:50.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.613+0000 7fefb1800640 1 Processor -- start 2024-04-25T09:05:50.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefb1800640 1 -- start start 2024-04-25T09:05:50.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefb1800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefac06c370 0x7fefac0b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefb1800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefac158340 0x7fefac14d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefb1800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefac15ebd0 0x7fefac160690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefb1800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac16b9a0 con 0x7fefac158340 2024-04-25T09:05:50.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefb1800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac16b820 con 0x7fefac15ebd0 2024-04-25T09:05:50.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefb1800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefac16bb20 con 0x7fefac06c370 2024-04-25T09:05:50.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefa2000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefac158340 0x7fefac14d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefa2000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefac158340 0x7fefac14d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53362/0 (socket says 172.21.15.175:53362) 2024-04-25T09:05:50.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefa2000640 1 -- 172.21.15.175:0/2984444491 learned_addr learned my addr 172.21.15.175:0/2984444491 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:50.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefaaa00640 1 --2- 172.21.15.175:0/2984444491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefac06c370 0x7fefac0b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefab400640 1 --2- 172.21.15.175:0/2984444491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefac15ebd0 0x7fefac160690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefa2000640 1 -- 172.21.15.175:0/2984444491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefac06c370 msgr2=0x7fefac0b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefa2000640 1 --2- 172.21.15.175:0/2984444491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefac06c370 0x7fefac0b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefa2000640 1 -- 172.21.15.175:0/2984444491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefac15ebd0 msgr2=0x7fefac160690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefa2000640 1 --2- 172.21.15.175:0/2984444491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefac15ebd0 0x7fefac160690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefa2000640 1 -- 172.21.15.175:0/2984444491 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac157460 con 0x7fefac158340 2024-04-25T09:05:50.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefa2000640 1 --2- 172.21.15.175:0/2984444491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefac158340 0x7fefac14d860 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fef9400c460 tx=0x7fef9400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefa3400640 1 -- 172.21.15.175:0/2984444491 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef94017070 con 0x7fefac158340 2024-04-25T09:05:50.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefa3400640 1 -- 172.21.15.175:0/2984444491 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef94005d10 con 0x7fefac158340 2024-04-25T09:05:50.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefa3400640 1 -- 172.21.15.175:0/2984444491 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef940072b0 con 0x7fefac158340 2024-04-25T09:05:50.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefb1800640 1 -- 172.21.15.175:0/2984444491 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefac157740 con 0x7fefac158340 2024-04-25T09:05:50.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefb1800640 1 -- 172.21.15.175:0/2984444491 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefac14cff0 con 0x7fefac158340 2024-04-25T09:05:50.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.617+0000 7fefb1800640 1 -- 172.21.15.175:0/2984444491 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefac074a60 con 0x7fefac158340 2024-04-25T09:05:50.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.621+0000 7fefa3400640 1 -- 172.21.15.175:0/2984444491 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fef9401a070 con 0x7fefac158340 2024-04-25T09:05:50.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.621+0000 7fefa3400640 1 --2- 172.21.15.175:0/2984444491 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fef88066f60 0x7fef88069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.621+0000 7fefa3400640 1 -- 172.21.15.175:0/2984444491 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef94084360 con 0x7fefac158340 2024-04-25T09:05:50.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.621+0000 7fefaaa00640 1 --2- 172.21.15.175:0/2984444491 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fef88066f60 0x7fef88069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.621+0000 7fefaaa00640 1 --2- 172.21.15.175:0/2984444491 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fef88066f60 0x7fef88069420 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fefac0b1870 tx=0x7fef9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.625+0000 7fefa3400640 1 -- 172.21.15.175:0/2984444491 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fef94054d10 con 0x7fefac158340 2024-04-25T09:05:50.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.833+0000 7fefb1800640 1 -- 172.21.15.175:0/2984444491 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fefac06cb20 con 0x7fefac158340 2024-04-25T09:05:50.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.837+0000 7fefa3400640 1 -- 172.21.15.175:0/2984444491 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7fef94058db0 con 0x7fefac158340 2024-04-25T09:05:50.825 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2024-04-25T09:05:50.825 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBPHCpmhyCUBhAA8k9xLKIw8R04i6HSJykDfw== 2024-04-25T09:05:50.825 INFO:teuthology.orchestra.run.smithi175.stdout: caps mds = "allow" 2024-04-25T09:05:50.825 INFO:teuthology.orchestra.run.smithi175.stdout: caps mon = "allow r" 2024-04-25T09:05:50.826 INFO:teuthology.orchestra.run.smithi175.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:05:50.826 INFO:teuthology.orchestra.run.smithi175.stderr:updated caps for client.0 2024-04-25T09:05:50.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.837+0000 7fefb1800640 1 -- 172.21.15.175:0/2984444491 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fef88066f60 msgr2=0x7fef88069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.837+0000 7fefb1800640 1 --2- 172.21.15.175:0/2984444491 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fef88066f60 0x7fef88069420 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fefac0b1870 tx=0x7fef9c009040 comp rx=0 tx=0).stop 2024-04-25T09:05:50.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.837+0000 7fefb1800640 1 -- 172.21.15.175:0/2984444491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefac158340 msgr2=0x7fefac14d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.837+0000 7fefb1800640 1 --2- 172.21.15.175:0/2984444491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefac158340 0x7fefac14d860 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fef9400c460 tx=0x7fef9400c920 comp rx=0 tx=0).stop 2024-04-25T09:05:50.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.837+0000 7fefb1800640 1 -- 172.21.15.175:0/2984444491 shutdown_connections 2024-04-25T09:05:50.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.837+0000 7fefb1800640 1 --2- 172.21.15.175:0/2984444491 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fef88066f60 0x7fef88069420 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.837+0000 7fefb1800640 1 --2- 172.21.15.175:0/2984444491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fefac15ebd0 0x7fefac160690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.837+0000 7fefb1800640 1 --2- 172.21.15.175:0/2984444491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fefac158340 0x7fefac14d860 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.837+0000 7fefb1800640 1 --2- 172.21.15.175:0/2984444491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fefac06c370 0x7fefac0b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.837+0000 7fefb1800640 1 -- 172.21.15.175:0/2984444491 >> 172.21.15.175:0/2984444491 conn(0x7fefac071b20 msgr2=0x7fefac071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:50.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.837+0000 7fefb1800640 1 -- 172.21.15.175:0/2984444491 shutdown_connections 2024-04-25T09:05:50.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.837+0000 7fefb1800640 1 -- 172.21.15.175:0/2984444491 wait complete. 2024-04-25T09:05:50.847 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:50.926 INFO:tasks.ceph.mds.c.smithi175.stderr:2024-04-25T09:05:50.937+0000 7f800ac00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:05:50.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.993+0000 7f0085200640 1 Processor -- start 2024-04-25T09:05:50.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.993+0000 7f0085200640 1 -- start start 2024-04-25T09:05:50.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.993+0000 7f0085200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f008006bd60 0x7f008006cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.993+0000 7f0085200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f00800d0d50 0x7f00800cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.993+0000 7f0085200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00800cfcb0 con 0x7f0080099a50 2024-04-25T09:05:50.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.993+0000 7f0085200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00800cff90 con 0x7f00800d0d50 2024-04-25T09:05:50.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.993+0000 7f0085200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00800d0270 con 0x7f008006bd60 2024-04-25T09:05:50.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.993+0000 7f007e800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f00800d0d50 0x7f00800cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.997+0000 7f007e800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f00800d0d50 0x7f00800cbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53368/0 (socket says 172.21.15.175:53368) 2024-04-25T09:05:50.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.997+0000 7f007e800640 1 -- 172.21.15.175:0/3829461085 learned_addr learned my addr 172.21.15.175:0/3829461085 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:50.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.997+0000 7f007d400640 1 --2- 172.21.15.175:0/3829461085 >> v2:172.21.15.177:3300/0 conn(0x7f008006bd60 0x7f008006cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.997+0000 7f007e800640 1 -- 172.21.15.175:0/3829461085 >> v2:172.21.15.177:3300/0 conn(0x7f008006bd60 msgr2=0x7f008006cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:50.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.997+0000 7f007e800640 1 --2- 172.21.15.175:0/3829461085 >> v2:172.21.15.177:3300/0 conn(0x7f008006bd60 0x7f008006cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.997+0000 7f007e800640 1 -- 172.21.15.175:0/3829461085 >> v1:172.21.15.177:6789/0 conn(0x7f0080099a50 legacy=0x7f0080099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:50.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.997+0000 7f007e800640 1 -- 172.21.15.175:0/3829461085 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00800d0550 con 0x7f00800d0d50 2024-04-25T09:05:50.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.997+0000 7f007e800640 1 --2- 172.21.15.175:0/3829461085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00800d0d50 0x7f00800cbe60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0080072fe0 tx=0x7f007801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4c64e39bb74a91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.997+0000 7f007ca00640 1 -- 172.21.15.175:0/3829461085 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00780a5670 con 0x7f00800d0d50 2024-04-25T09:05:50.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.997+0000 7f007ca00640 1 -- 172.21.15.175:0/3829461085 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00780a5810 con 0x7f00800d0d50 2024-04-25T09:05:50.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:50.997+0000 7f007ca00640 1 -- 172.21.15.175:0/3829461085 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00780a5be0 con 0x7f00800d0d50 2024-04-25T09:05:50.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f0085200640 1 -- 172.21.15.175:0/3829461085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00800d0d50 msgr2=0x7f00800cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f0085200640 1 --2- 172.21.15.175:0/3829461085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00800d0d50 0x7f00800cbe60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0080072fe0 tx=0x7f007801c9b0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f0085200640 1 -- 172.21.15.175:0/3829461085 shutdown_connections 2024-04-25T09:05:50.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f0085200640 1 --2- 172.21.15.175:0/3829461085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00800d0d50 0x7f00800cbe60 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f0085200640 1 --2- 172.21.15.175:0/3829461085 >> v2:172.21.15.177:3300/0 conn(0x7f008006bd60 0x7f008006cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f0085200640 1 -- 172.21.15.175:0/3829461085 >> 172.21.15.175:0/3829461085 conn(0x7f00800b3300 msgr2=0x7f00800b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:50.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f0085200640 1 -- 172.21.15.175:0/3829461085 shutdown_connections 2024-04-25T09:05:50.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f0085200640 1 -- 172.21.15.175:0/3829461085 wait complete. 2024-04-25T09:05:50.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f0085200640 1 Processor -- start 2024-04-25T09:05:50.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f0085200640 1 -- start start 2024-04-25T09:05:50.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f0085200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f008006bd60 0x7f00800b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f0085200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0080099a50 0x7f0080150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f0085200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00800d0d50 0x7f00800b6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f0085200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008015dfe0 con 0x7f00800d0d50 2024-04-25T09:05:50.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f0085200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008015de60 con 0x7f0080099a50 2024-04-25T09:05:50.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f0085200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008016b260 con 0x7f008006bd60 2024-04-25T09:05:50.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f007e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00800d0d50 0x7f00800b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f007e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00800d0d50 0x7f00800b6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53384/0 (socket says 172.21.15.175:53384) 2024-04-25T09:05:50.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.001+0000 7f007e800640 1 -- 172.21.15.175:0/3598171719 learned_addr learned my addr 172.21.15.175:0/3598171719 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:50.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.005+0000 7f007de00640 1 --2- 172.21.15.175:0/3598171719 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f008006bd60 0x7f00800b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.005+0000 7f007d400640 1 --2- 172.21.15.175:0/3598171719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0080099a50 0x7f0080150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.005+0000 7f007e800640 1 -- 172.21.15.175:0/3598171719 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f008006bd60 msgr2=0x7f00800b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.005+0000 7f007e800640 1 --2- 172.21.15.175:0/3598171719 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f008006bd60 0x7f00800b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.005+0000 7f007e800640 1 -- 172.21.15.175:0/3598171719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0080099a50 msgr2=0x7f0080150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.005+0000 7f007e800640 1 --2- 172.21.15.175:0/3598171719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0080099a50 0x7f0080150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.005+0000 7f007e800640 1 -- 172.21.15.175:0/3598171719 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00800b5320 con 0x7f00800d0d50 2024-04-25T09:05:50.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.005+0000 7f007e800640 1 --2- 172.21.15.175:0/3598171719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00800d0d50 0x7f00800b6880 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f007801a5e0 tx=0x7f0078019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.005+0000 7f0076000640 1 -- 172.21.15.175:0/3598171719 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078009510 con 0x7f00800d0d50 2024-04-25T09:05:50.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.005+0000 7f0076000640 1 -- 172.21.15.175:0/3598171719 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00780be070 con 0x7f00800d0d50 2024-04-25T09:05:50.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.005+0000 7f0076000640 1 -- 172.21.15.175:0/3598171719 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00780b88b0 con 0x7f00800d0d50 2024-04-25T09:05:50.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.005+0000 7f0085200640 1 -- 172.21.15.175:0/3598171719 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00800b4760 con 0x7f00800d0d50 2024-04-25T09:05:50.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.005+0000 7f0085200640 1 -- 172.21.15.175:0/3598171719 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0080151b40 con 0x7f00800d0d50 2024-04-25T09:05:50.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.005+0000 7f0085200640 1 -- 172.21.15.175:0/3598171719 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0080074a60 con 0x7f00800d0d50 2024-04-25T09:05:50.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.005+0000 7f0076000640 1 -- 172.21.15.175:0/3598171719 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f00780b8a50 con 0x7f00800d0d50 2024-04-25T09:05:50.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.009+0000 7f0076000640 1 --2- 172.21.15.175:0/3598171719 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0060066f60 0x7f0060069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.009+0000 7f0076000640 1 -- 172.21.15.175:0/3598171719 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f007811ffe0 con 0x7f00800d0d50 2024-04-25T09:05:50.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.009+0000 7f007de00640 1 --2- 172.21.15.175:0/3598171719 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0060066f60 0x7f0060069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.009+0000 7f007de00640 1 --2- 172.21.15.175:0/3598171719 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0060066f60 0x7f0060069420 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f00800c5e10 tx=0x7f0070007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.013+0000 7f0076000640 1 -- 172.21.15.175:0/3598171719 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f00780165a0 con 0x7f00800d0d50 2024-04-25T09:05:51.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.201+0000 7f0085200640 1 -- 172.21.15.175:0/3598171719 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00800b08e0 con 0x7f00800d0d50 2024-04-25T09:05:51.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.201+0000 7f0076000640 1 -- 172.21.15.175:0/3598171719 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f00780f0a40 con 0x7f00800d0d50 2024-04-25T09:05:51.192 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:51.192 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5102,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2763692769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2763692769},{"type":"v1","addr":"172.21.15.175:6837","nonce":2763692769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3823569323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3823569323},{"type":"v1","addr":"172.21.15.177:6834","nonce":3823569323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2687013607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2687013607},{"type":"v1","addr":"172.21.15.177:6835","nonce":2687013607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:45.332647+0000","modified":"2024-04-25T09:05:48.357816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6836/1389262120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1389262120},{"type":"v1","addr":"172.21.15.175:6836","nonce":1389262120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:05:51.193 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 25 2024-04-25T09:05:51.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.205+0000 7f0085200640 1 -- 172.21.15.175:0/3598171719 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0060066f60 msgr2=0x7f0060069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.205+0000 7f0085200640 1 --2- 172.21.15.175:0/3598171719 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0060066f60 0x7f0060069420 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f00800c5e10 tx=0x7f0070007e40 comp rx=0 tx=0).stop 2024-04-25T09:05:51.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.205+0000 7f0085200640 1 -- 172.21.15.175:0/3598171719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00800d0d50 msgr2=0x7f00800b6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.205+0000 7f0085200640 1 --2- 172.21.15.175:0/3598171719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00800d0d50 0x7f00800b6880 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f007801a5e0 tx=0x7f0078019750 comp rx=0 tx=0).stop 2024-04-25T09:05:51.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.205+0000 7f0085200640 1 -- 172.21.15.175:0/3598171719 shutdown_connections 2024-04-25T09:05:51.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.205+0000 7f0085200640 1 --2- 172.21.15.175:0/3598171719 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0060066f60 0x7f0060069420 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.205+0000 7f0085200640 1 --2- 172.21.15.175:0/3598171719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00800d0d50 0x7f00800b6880 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.205+0000 7f0085200640 1 --2- 172.21.15.175:0/3598171719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0080099a50 0x7f0080150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.205+0000 7f0085200640 1 --2- 172.21.15.175:0/3598171719 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f008006bd60 0x7f00800b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.205+0000 7f0085200640 1 -- 172.21.15.175:0/3598171719 >> 172.21.15.175:0/3598171719 conn(0x7f00800b3300 msgr2=0x7f00800ae760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.205+0000 7f0085200640 1 -- 172.21.15.175:0/3598171719 shutdown_connections 2024-04-25T09:05:51.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.205+0000 7f0085200640 1 -- 172.21.15.175:0/3598171719 wait complete. 2024-04-25T09:05:51.615 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:05:45.332647+0000', 'modified': '2024-04-25T09:05:48.357816+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5535}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5535': {'gid': 5535, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6836/1389262120', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 1389262120}, {'type': 'v1', 'addr': '172.21.15.175:6836', 'nonce': 1389262120}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:05:51.615 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:05:51.616 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:05:51.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.765+0000 7f8f03800640 1 Processor -- start 2024-04-25T09:05:51.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.765+0000 7f8f03800640 1 -- start start 2024-04-25T09:05:51.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.765+0000 7f8f03800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8efc15dc90 0x7f8efc0cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.765+0000 7f8f03800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8efc06d660 0x7f8efc0ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.765+0000 7f8f03800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8efc1619a0 con 0x7f8efc06dae0 2024-04-25T09:05:51.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.765+0000 7f8f03800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8efc162570 con 0x7f8efc06d660 2024-04-25T09:05:51.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.765+0000 7f8f03800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc161c40 con 0x7f8efc15dc90 2024-04-25T09:05:51.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.765+0000 7f8efbe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8efc06d660 0x7f8efc0ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.765+0000 7f8efbe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8efc06d660 0x7f8efc0ce2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53386/0 (socket says 172.21.15.175:53386) 2024-04-25T09:05:51.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.765+0000 7f8efbe00640 1 -- 172.21.15.175:0/2351720 learned_addr learned my addr 172.21.15.175:0/2351720 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:51.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.765+0000 7f8f00e00640 1 --2- 172.21.15.175:0/2351720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8efc15dc90 0x7f8efc0cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.765+0000 7f8efbe00640 1 -- 172.21.15.175:0/2351720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8efc15dc90 msgr2=0x7f8efc0cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:51.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.765+0000 7f8efbe00640 1 --2- 172.21.15.175:0/2351720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8efc15dc90 0x7f8efc0cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.765+0000 7f8efbe00640 1 -- 172.21.15.175:0/2351720 >> v1:172.21.15.177:6789/0 conn(0x7f8efc06dae0 legacy=0x7f8efc0b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:51.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.765+0000 7f8efbe00640 1 -- 172.21.15.175:0/2351720 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc161f20 con 0x7f8efc06d660 2024-04-25T09:05:51.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.765+0000 7f8f00e00640 1 --2- 172.21.15.175:0/2351720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8efc15dc90 0x7f8efc0cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:51.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.769+0000 7f8efbe00640 1 --2- 172.21.15.175:0/2351720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8efc06d660 0x7f8efc0ce2b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009870 tx=0x7f8ee801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9be2c7961d59c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.769+0000 7f8efb400640 1 -- 172.21.15.175:0/2351720 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80b0070 con 0x7f8efc06d660 2024-04-25T09:05:51.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.769+0000 7f8efb400640 1 -- 172.21.15.175:0/2351720 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee80ab600 con 0x7f8efc06d660 2024-04-25T09:05:51.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.769+0000 7f8efb400640 1 -- 172.21.15.175:0/2351720 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80ab9d0 con 0x7f8efc06d660 2024-04-25T09:05:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.769+0000 7f8f03800640 1 -- 172.21.15.175:0/2351720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8efc06d660 msgr2=0x7f8efc0ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.769+0000 7f8f03800640 1 --2- 172.21.15.175:0/2351720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8efc06d660 0x7f8efc0ce2b0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8009870 tx=0x7f8ee801c460 comp rx=0 tx=0).stop 2024-04-25T09:05:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.769+0000 7f8f03800640 1 -- 172.21.15.175:0/2351720 shutdown_connections 2024-04-25T09:05:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.769+0000 7f8f03800640 1 --2- 172.21.15.175:0/2351720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8efc06d660 0x7f8efc0ce2b0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.769+0000 7f8f03800640 1 --2- 172.21.15.175:0/2351720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8efc15dc90 0x7f8efc0cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.769+0000 7f8f03800640 1 -- 172.21.15.175:0/2351720 >> 172.21.15.175:0/2351720 conn(0x7f8efc06f550 msgr2=0x7f8efc06f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.769+0000 7f8f03800640 1 -- 172.21.15.175:0/2351720 shutdown_connections 2024-04-25T09:05:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.769+0000 7f8f03800640 1 -- 172.21.15.175:0/2351720 wait complete. 2024-04-25T09:05:51.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f03800640 1 Processor -- start 2024-04-25T09:05:51.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f03800640 1 -- start start 2024-04-25T09:05:51.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f03800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8efc06d660 0x7f8efc0c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f03800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8efc06dae0 0x7f8efc0c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f03800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8efc15dc90 0x7f8efc0c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f03800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc16acc0 con 0x7f8efc06d660 2024-04-25T09:05:51.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f03800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc16ab40 con 0x7f8efc06dae0 2024-04-25T09:05:51.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f03800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc16ae40 con 0x7f8efc15dc90 2024-04-25T09:05:51.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f00e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8efc06d660 0x7f8efc0c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f00e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8efc06d660 0x7f8efc0c9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53392/0 (socket says 172.21.15.175:53392) 2024-04-25T09:05:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f00e00640 1 -- 172.21.15.175:0/747033554 learned_addr learned my addr 172.21.15.175:0/747033554 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8efbe00640 1 --2- 172.21.15.175:0/747033554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8efc06dae0 0x7f8efc0c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f01800640 1 --2- 172.21.15.175:0/747033554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8efc15dc90 0x7f8efc0c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f00e00640 1 -- 172.21.15.175:0/747033554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8efc15dc90 msgr2=0x7f8efc0c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f00e00640 1 --2- 172.21.15.175:0/747033554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8efc15dc90 0x7f8efc0c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f00e00640 1 -- 172.21.15.175:0/747033554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8efc06dae0 msgr2=0x7f8efc0c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f00e00640 1 --2- 172.21.15.175:0/747033554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8efc06dae0 0x7f8efc0c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f00e00640 1 -- 172.21.15.175:0/747033554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc0c5950 con 0x7f8efc06d660 2024-04-25T09:05:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f01800640 1 --2- 172.21.15.175:0/747033554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8efc15dc90 0x7f8efc0c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f00e00640 1 --2- 172.21.15.175:0/747033554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8efc06d660 0x7f8efc0c9e00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00ce00 tx=0x7f8eec00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8ef8c00640 1 -- 172.21.15.175:0/747033554 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec00f890 con 0x7f8efc06d660 2024-04-25T09:05:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8ef8c00640 1 -- 172.21.15.175:0/747033554 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec00fa30 con 0x7f8efc06d660 2024-04-25T09:05:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8ef8c00640 1 -- 172.21.15.175:0/747033554 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec00fe40 con 0x7f8efc06d660 2024-04-25T09:05:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f03800640 1 -- 172.21.15.175:0/747033554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8efc0c5bf0 con 0x7f8efc06d660 2024-04-25T09:05:51.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.773+0000 7f8f03800640 1 -- 172.21.15.175:0/747033554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8efc0c6490 con 0x7f8efc06d660 2024-04-25T09:05:51.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.777+0000 7f8ef8c00640 1 -- 172.21.15.175:0/747033554 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8eec018400 con 0x7f8efc06d660 2024-04-25T09:05:51.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.777+0000 7f8ef8c00640 1 --2- 172.21.15.175:0/747033554 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8edc066f60 0x7f8edc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.777+0000 7f8ef8c00640 1 -- 172.21.15.175:0/747033554 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8eec085d70 con 0x7f8efc06d660 2024-04-25T09:05:51.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.777+0000 7f8efbe00640 1 --2- 172.21.15.175:0/747033554 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8edc066f60 0x7f8edc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.777+0000 7f8f06dac000 1 Processor -- start 2024-04-25T09:05:51.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.777+0000 7f8f06dac000 1 -- start start 2024-04-25T09:05:51.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.777+0000 7f8efbe00640 1 --2- 172.21.15.175:0/747033554 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8edc066f60 0x7f8edc069420 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80ad000 tx=0x7f8ee8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.777+0000 7f8f06dac000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55848301e920 0x55848301ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.777+0000 7f8f06dac000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55848301f240 0x558482fd49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.777+0000 7f8f06dac000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558482fd4f30 0x558482fd5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558482ebc5f0 con 0x558482fd4f30 2024-04-25T09:05:51.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x558482e23da0 con 0x55848301e920 2024-04-25T09:05:51.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x558482dac150 con 0x55848301f240 2024-04-25T09:05:51.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f01800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558482fd4f30 0x558482fd5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f01800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558482fd4f30 0x558482fd5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53404/0 (socket says 172.21.15.175:53404) 2024-04-25T09:05:51.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f01800640 1 -- 172.21.15.175:0/442447751 learned_addr learned my addr 172.21.15.175:0/442447751 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:51.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f00e00640 1 --2- 172.21.15.175:0/442447751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55848301e920 0x55848301ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8efbe00640 1 --2- 172.21.15.175:0/442447751 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55848301f240 0x558482fd49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f01800640 1 -- 172.21.15.175:0/442447751 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55848301f240 msgr2=0x558482fd49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:51.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f01800640 1 --2- 172.21.15.175:0/442447751 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55848301f240 0x558482fd49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f01800640 1 -- 172.21.15.175:0/442447751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55848301e920 msgr2=0x55848301ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:51.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f01800640 1 --2- 172.21.15.175:0/442447751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55848301e920 0x55848301ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f01800640 1 -- 172.21.15.175:0/442447751 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558482dc5ca0 con 0x558482fd4f30 2024-04-25T09:05:51.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8efbe00640 1 --2- 172.21.15.175:0/442447751 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55848301f240 0x558482fd49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f01800640 1 --2- 172.21.15.175:0/442447751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558482fd4f30 0x558482fd5310 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4003da0 tx=0x7f8ef4004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd798550f45cd28d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8ef1600640 1 -- 172.21.15.175:0/442447751 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4019070 con 0x558482fd4f30 2024-04-25T09:05:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8ef1600640 1 -- 172.21.15.175:0/442447751 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef4005070 con 0x558482fd4f30 2024-04-25T09:05:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8ef1600640 1 -- 172.21.15.175:0/442447751 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4005440 con 0x558482fd4f30 2024-04-25T09:05:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 -- 172.21.15.175:0/442447751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558482fd4f30 msgr2=0x558482fd5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 --2- 172.21.15.175:0/442447751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558482fd4f30 0x558482fd5310 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4003da0 tx=0x7f8ef4004260 comp rx=0 tx=0).stop 2024-04-25T09:05:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 -- 172.21.15.175:0/442447751 shutdown_connections 2024-04-25T09:05:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 --2- 172.21.15.175:0/442447751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558482fd4f30 0x558482fd5310 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 --2- 172.21.15.175:0/442447751 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55848301f240 0x558482fd49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 --2- 172.21.15.175:0/442447751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55848301e920 0x55848301ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 -- 172.21.15.175:0/442447751 >> 172.21.15.175:0/442447751 conn(0x558482fdb2a0 msgr2=0x558482fd32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 -- 172.21.15.175:0/442447751 shutdown_connections 2024-04-25T09:05:51.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 -- 172.21.15.175:0/442447751 wait complete. 2024-04-25T09:05:51.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 -- start start 2024-04-25T09:05:51.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 Processor -- start 2024-04-25T09:05:51.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558482fd4f30 0x558483025d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55848301e920 0x5584830262a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55848301f240 0x558482fd8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558482dde990 con 0x55848301f240 2024-04-25T09:05:51.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x558482e1fe40 con 0x558482fd4f30 2024-04-25T09:05:51.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x558482daf900 con 0x55848301e920 2024-04-25T09:05:51.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f06dac000 10 client.0 _ll_register_callbacks cb 0x558482ed71c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:51.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f01800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55848301f240 0x558482fd8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f01800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55848301f240 0x558482fd8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53412/0 (socket says 172.21.15.175:53412) 2024-04-25T09:05:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.781+0000 7f8f01800640 1 -- 172.21.15.175:0/2013506853 learned_addr learned my addr 172.21.15.175:0/2013506853 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8efbe00640 1 --2- 172.21.15.175:0/2013506853 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55848301e920 0x5584830262a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f00e00640 1 --2- 172.21.15.175:0/2013506853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558482fd4f30 0x558483025d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f01800640 1 -- 172.21.15.175:0/2013506853 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55848301e920 msgr2=0x5584830262a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f01800640 1 --2- 172.21.15.175:0/2013506853 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55848301e920 0x5584830262a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f01800640 1 -- 172.21.15.175:0/2013506853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558482fd4f30 msgr2=0x558483025d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f01800640 1 --2- 172.21.15.175:0/2013506853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558482fd4f30 0x558483025d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f01800640 1 -- 172.21.15.175:0/2013506853 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558482ddc630 con 0x55848301f240 2024-04-25T09:05:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f00e00640 1 --2- 172.21.15.175:0/2013506853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558482fd4f30 0x558483025d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f01800640 1 --2- 172.21.15.175:0/2013506853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55848301f240 0x558482fd8aa0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009010 tx=0x7f8ef4003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9002fcac282b6cfb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8ee6000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:05:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8ee6000640 1 -- 172.21.15.175:0/2013506853 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4024020 con 0x55848301f240 2024-04-25T09:05:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8ee6000640 1 -- 172.21.15.175:0/2013506853 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8ef400eb60 con 0x55848301f240 2024-04-25T09:05:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 1 -- 172.21.15.175:0/2013506853 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8ef4005070 con 0x55848301f240 2024-04-25T09:05:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8ee6000640 1 -- 172.21.15.175:0/2013506853 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ef402e050 con 0x55848301f240 2024-04-25T09:05:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 10 client.5667 fetch_fsmap learned FSMap version 25 2024-04-25T09:05:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 1 -- 172.21.15.175:0/2013506853 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x558482dac3a0 con 0x55848301f240 2024-04-25T09:05:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8ee6000640 1 -- 172.21.15.175:0/2013506853 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef4005070 con 0x55848301f240 2024-04-25T09:05:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8ee6000640 1 -- 172.21.15.175:0/2013506853 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8ef4031020 con 0x55848301f240 2024-04-25T09:05:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 10 client.5667 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T09:05:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 10 client.5667 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:05:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 20 client.5667 populate_metadata read hostname 'smithi175' 2024-04-25T09:05:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 1 --2- 172.21.15.175:0/2013506853 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x558482fda160 0x55848302fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 4 client.5667 mds_command: new command op to 5535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 1 -- 172.21.15.175:0/2013506853 --> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558482dbfa50 con 0x558482fda160 2024-04-25T09:05:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f00e00640 1 --2- 172.21.15.175:0/2013506853 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x558482fda160 0x55848302fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f00e00640 1 --2- 172.21.15.175:0/2013506853 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x558482fda160 0x55848302fdc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0c08ee680cbf436 server_cookie=8cc0a1c2c277a5a4 in_seq=0 out_seq=0 2024-04-25T09:05:51.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8ee6000640 10 client.5667 ms_handle_connect on v2:172.21.15.175:6834/1389262120 2024-04-25T09:05:51.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8ee6000640 1 -- 172.21.15.175:0/2013506853 <== mds.0 v2:172.21.15.175:6834/1389262120 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558482dbfa50 con 0x558482fda160 2024-04-25T09:05:51.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8ee6000640 10 client.5667 handle_command_reply: tid=0 2024-04-25T09:05:51.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 1 client.5667 shutdown 2024-04-25T09:05:51.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 1 -- 172.21.15.175:0/2013506853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55848301f240 msgr2=0x558482fd8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 1 --2- 172.21.15.175:0/2013506853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55848301f240 0x558482fd8aa0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4009010 tx=0x7f8ef4003700 comp rx=0 tx=0).stop 2024-04-25T09:05:51.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 1 -- 172.21.15.175:0/2013506853 shutdown_connections 2024-04-25T09:05:51.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 1 --2- 172.21.15.175:0/2013506853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55848301f240 0x558482fd8aa0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 1 --2- 172.21.15.175:0/2013506853 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55848301e920 0x5584830262a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 1 --2- 172.21.15.175:0/2013506853 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x558482fda160 0x55848302fdc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 1 --2- 172.21.15.175:0/2013506853 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558482fd4f30 0x558483025d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 1 -- 172.21.15.175:0/2013506853 >> 172.21.15.175:0/2013506853 conn(0x558482fdb2a0 msgr2=0x558482fd39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8ee6000640 0 client.5667 ms_handle_reset on v2:172.21.15.175:6834/1389262120 2024-04-25T09:05:51.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 1 -- 172.21.15.175:0/2013506853 shutdown_connections 2024-04-25T09:05:51.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 1 -- 172.21.15.175:0/2013506853 wait complete. 2024-04-25T09:05:51.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.785+0000 7f8f06dac000 20 client.5667 trim_cache size 0 max 16384 2024-04-25T09:05:51.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.801+0000 7f8f06dac000 1 Processor -- start 2024-04-25T09:05:51.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.801+0000 7f8f06dac000 1 -- start start 2024-04-25T09:05:51.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.801+0000 7f8f06dac000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558482fd4f30 0x558483082c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.801+0000 7f8f06dac000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55848301e920 0x5584830831d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.801+0000 7f8f06dac000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55848301f240 0x558483083710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.801+0000 7f8f06dac000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc154c70 con 0x558482fd4f30 2024-04-25T09:05:51.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.801+0000 7f8f06dac000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc1fb480 con 0x55848301e920 2024-04-25T09:05:51.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.801+0000 7f8f06dac000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc154670 con 0x55848301f240 2024-04-25T09:05:51.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.801+0000 7f8f00e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558482fd4f30 0x558483082c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.801+0000 7f8f00e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558482fd4f30 0x558483082c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53426/0 (socket says 172.21.15.175:53426) 2024-04-25T09:05:51.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.801+0000 7f8f00e00640 1 -- 172.21.15.175:0/244244376 learned_addr learned my addr 172.21.15.175:0/244244376 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:51.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.801+0000 7f8efbe00640 1 --2- 172.21.15.175:0/244244376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55848301e920 0x5584830831d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.801+0000 7f8f00e00640 1 -- 172.21.15.175:0/244244376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55848301f240 msgr2=0x558483083710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:51.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.801+0000 7f8f00e00640 1 --2- 172.21.15.175:0/244244376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55848301f240 0x558483083710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.801+0000 7f8f00e00640 1 -- 172.21.15.175:0/244244376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55848301e920 msgr2=0x5584830831d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:51.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f00e00640 1 --2- 172.21.15.175:0/244244376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55848301e920 0x5584830831d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f00e00640 1 -- 172.21.15.175:0/244244376 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55848301f070 con 0x558482fd4f30 2024-04-25T09:05:51.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f00e00640 1 --2- 172.21.15.175:0/244244376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558482fd4f30 0x558483082c90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8eec05e810 tx=0x7f8eec00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d5133fba7207f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8ef0c00640 1 -- 172.21.15.175:0/244244376 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec081070 con 0x558482fd4f30 2024-04-25T09:05:51.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8ef0c00640 1 -- 172.21.15.175:0/244244376 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec0546d0 con 0x558482fd4f30 2024-04-25T09:05:51.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8ef0c00640 1 -- 172.21.15.175:0/244244376 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec054930 con 0x558482fd4f30 2024-04-25T09:05:51.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f06dac000 1 -- 172.21.15.175:0/244244376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558482fd4f30 msgr2=0x558483082c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f06dac000 1 --2- 172.21.15.175:0/244244376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558482fd4f30 0x558483082c90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8eec05e810 tx=0x7f8eec00cf90 comp rx=0 tx=0).stop 2024-04-25T09:05:51.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f06dac000 1 -- 172.21.15.175:0/244244376 shutdown_connections 2024-04-25T09:05:51.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f06dac000 1 --2- 172.21.15.175:0/244244376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55848301f240 0x558483083710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f06dac000 1 --2- 172.21.15.175:0/244244376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55848301e920 0x5584830831d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f06dac000 1 --2- 172.21.15.175:0/244244376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558482fd4f30 0x558483082c90 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f06dac000 1 -- 172.21.15.175:0/244244376 >> 172.21.15.175:0/244244376 conn(0x558482fdb2a0 msgr2=0x558482fd8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f06dac000 1 -- 172.21.15.175:0/244244376 shutdown_connections 2024-04-25T09:05:51.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f06dac000 1 -- 172.21.15.175:0/244244376 wait complete. 2024-04-25T09:05:51.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f06dac000 1 -- start start 2024-04-25T09:05:51.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f06dac000 1 Processor -- start 2024-04-25T09:05:51.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f06dac000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558482fd4f30 0x55848302b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f06dac000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55848301e920 0x55848306bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f06dac000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55848301f240 0x55848306c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f06dac000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558482e283d0 con 0x55848301f240 2024-04-25T09:05:51.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f06dac000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x558482edfd50 con 0x55848301e920 2024-04-25T09:05:51.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f06dac000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x558482dbe980 con 0x558482fd4f30 2024-04-25T09:05:51.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f06dac000 10 client.0 _ll_register_callbacks cb 0x558482dc4330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:51.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f01800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55848301f240 0x55848306c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f01800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55848301f240 0x55848306c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53436/0 (socket says 172.21.15.175:53436) 2024-04-25T09:05:51.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f01800640 1 -- 172.21.15.175:0/4127918601 learned_addr learned my addr 172.21.15.175:0/4127918601 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:51.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f00e00640 1 --2- 172.21.15.175:0/4127918601 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558482fd4f30 0x55848302b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8efbe00640 1 --2- 172.21.15.175:0/4127918601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55848301e920 0x55848306bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f01800640 1 -- 172.21.15.175:0/4127918601 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558482fd4f30 msgr2=0x55848302b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:51.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f01800640 1 --2- 172.21.15.175:0/4127918601 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558482fd4f30 0x55848302b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f01800640 1 -- 172.21.15.175:0/4127918601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55848301e920 msgr2=0x55848306bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:51.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f01800640 1 --2- 172.21.15.175:0/4127918601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55848301e920 0x55848306bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f01800640 1 -- 172.21.15.175:0/4127918601 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558482ea5600 con 0x55848301f240 2024-04-25T09:05:51.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8efbe00640 1 --2- 172.21.15.175:0/4127918601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55848301e920 0x55848306bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:51.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8f01800640 1 --2- 172.21.15.175:0/4127918601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55848301f240 0x55848306c0d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4007d10 tx=0x7f8ef4003770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2839ac4f23fcd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.805+0000 7f8ee6000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:05:51.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8ee6000640 1 -- 172.21.15.175:0/4127918601 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4024030 con 0x55848301f240 2024-04-25T09:05:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8ee6000640 1 -- 172.21.15.175:0/4127918601 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8ef4033ae0 con 0x55848301f240 2024-04-25T09:05:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 1 -- 172.21.15.175:0/4127918601 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8eec0546d0 con 0x55848301f240 2024-04-25T09:05:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8ee6000640 1 -- 172.21.15.175:0/4127918601 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ef4019070 con 0x55848301f240 2024-04-25T09:05:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 10 client.5673 fetch_fsmap learned FSMap version 25 2024-04-25T09:05:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 1 -- 172.21.15.175:0/4127918601 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x558482db89b0 con 0x55848301f240 2024-04-25T09:05:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8ee6000640 1 -- 172.21.15.175:0/4127918601 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec0546d0 con 0x55848301f240 2024-04-25T09:05:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8ee6000640 1 -- 172.21.15.175:0/4127918601 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8ef403a050 con 0x55848301f240 2024-04-25T09:05:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 10 client.5673 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T09:05:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 10 client.5673 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:05:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 20 client.5673 populate_metadata read hostname 'smithi175' 2024-04-25T09:05:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 1 --2- 172.21.15.175:0/4127918601 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x55848306c610 0x558483087ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 4 client.5673 mds_command: new command op to 5535 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:05:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 1 -- 172.21.15.175:0/4127918601 --> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558482e312e0 con 0x55848306c610 2024-04-25T09:05:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f00e00640 1 --2- 172.21.15.175:0/4127918601 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x55848306c610 0x558483087ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8ee6000640 10 client.5673 ms_handle_connect on v2:172.21.15.175:6834/1389262120 2024-04-25T09:05:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f00e00640 1 --2- 172.21.15.175:0/4127918601 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x55848306c610 0x558483087ac0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c383b9d76c30162f server_cookie=4ade9ba18dfdf494 in_seq=0 out_seq=0 2024-04-25T09:05:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8ee6000640 1 -- 172.21.15.175:0/4127918601 <== mds.0 v2:172.21.15.175:6834/1389262120 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+316 (crc 0 0 0) 0x558482e312e0 con 0x55848306c610 2024-04-25T09:05:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8ee6000640 10 client.5673 handle_command_reply: tid=0 2024-04-25T09:05:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 1 client.5673 shutdown 2024-04-25T09:05:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 1 -- 172.21.15.175:0/4127918601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55848301f240 msgr2=0x55848306c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 1 --2- 172.21.15.175:0/4127918601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55848301f240 0x55848306c0d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4007d10 tx=0x7f8ef4003770 comp rx=0 tx=0).stop 2024-04-25T09:05:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 1 -- 172.21.15.175:0/4127918601 shutdown_connections 2024-04-25T09:05:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 1 --2- 172.21.15.175:0/4127918601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55848301f240 0x55848306c0d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 1 --2- 172.21.15.175:0/4127918601 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x55848306c610 0x558483087ac0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 1 --2- 172.21.15.175:0/4127918601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55848301e920 0x55848306bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 1 --2- 172.21.15.175:0/4127918601 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558482fd4f30 0x55848302b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8ee6000640 0 client.5673 ms_handle_reset on v2:172.21.15.175:6834/1389262120 2024-04-25T09:05:51.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 1 -- 172.21.15.175:0/4127918601 >> 172.21.15.175:0/4127918601 conn(0x558482fdb2a0 msgr2=0x558483026880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 1 -- 172.21.15.175:0/4127918601 shutdown_connections 2024-04-25T09:05:51.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 1 -- 172.21.15.175:0/4127918601 wait complete. 2024-04-25T09:05:51.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f06dac000 20 client.5673 trim_cache size 0 max 16384 2024-04-25T09:05:51.804 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:05:51.804 INFO:teuthology.orchestra.run.smithi175.stdout: "cluster_fsid": "8caed986-ca08-40e2-b5a5-12e2aade6223", 2024-04-25T09:05:51.804 INFO:teuthology.orchestra.run.smithi175.stdout: "whoami": 0, 2024-04-25T09:05:51.804 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 5535, 2024-04-25T09:05:51.804 INFO:teuthology.orchestra.run.smithi175.stdout: "want_state": "up:active", 2024-04-25T09:05:51.804 INFO:teuthology.orchestra.run.smithi175.stdout: "state": "up:active", 2024-04-25T09:05:51.805 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs", 2024-04-25T09:05:51.805 INFO:teuthology.orchestra.run.smithi175.stdout: "rank_uptime": 5.836327195, 2024-04-25T09:05:51.805 INFO:teuthology.orchestra.run.smithi175.stdout: "mdsmap_epoch": 25, 2024-04-25T09:05:51.805 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch": 45, 2024-04-25T09:05:51.805 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch_barrier": 44, 2024-04-25T09:05:51.805 INFO:teuthology.orchestra.run.smithi175.stdout: "uptime": 11.7651162 2024-04-25T09:05:51.805 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:05:51.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f03800640 1 -- 172.21.15.175:0/747033554 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8edc066f60 msgr2=0x7f8edc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f03800640 1 --2- 172.21.15.175:0/747033554 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8edc066f60 0x7f8edc069420 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80ad000 tx=0x7f8ee8008040 comp rx=0 tx=0).stop 2024-04-25T09:05:51.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f03800640 1 -- 172.21.15.175:0/747033554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8efc06d660 msgr2=0x7f8efc0c9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f03800640 1 --2- 172.21.15.175:0/747033554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8efc06d660 0x7f8efc0c9e00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00ce00 tx=0x7f8eec00a650 comp rx=0 tx=0).stop 2024-04-25T09:05:51.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f03800640 1 -- 172.21.15.175:0/747033554 shutdown_connections 2024-04-25T09:05:51.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f03800640 1 --2- 172.21.15.175:0/747033554 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8edc066f60 0x7f8edc069420 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f03800640 1 --2- 172.21.15.175:0/747033554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8efc15dc90 0x7f8efc0c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f03800640 1 --2- 172.21.15.175:0/747033554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8efc06dae0 0x7f8efc0c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f03800640 1 --2- 172.21.15.175:0/747033554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8efc06d660 0x7f8efc0c9e00 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f03800640 1 -- 172.21.15.175:0/747033554 >> 172.21.15.175:0/747033554 conn(0x7f8efc06f550 msgr2=0x7f8efc15bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f03800640 1 -- 172.21.15.175:0/747033554 shutdown_connections 2024-04-25T09:05:51.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.809+0000 7f8f03800640 1 -- 172.21.15.175:0/747033554 wait complete. 2024-04-25T09:05:51.820 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:05:51.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.965+0000 7fc5a3600640 1 Processor -- start 2024-04-25T09:05:51.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.965+0000 7fc5a3600640 1 -- start start 2024-04-25T09:05:51.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.965+0000 7fc5a3600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc59c06c070 0x7fc59c06f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.965+0000 7fc5a3600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc59c0af0f0 0x7fc59c15ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.965+0000 7fc5a3600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c15cf80 con 0x7fc59c0acfa0 2024-04-25T09:05:51.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.965+0000 7fc5a3600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c0af550 con 0x7fc59c0af0f0 2024-04-25T09:05:51.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.965+0000 7fc5a3600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c06ec50 con 0x7fc59c06c070 2024-04-25T09:05:51.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.969+0000 7fc5a1600640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fc59c0acfa0 0x7fc59c06ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:45692/0 (socket says 172.21.15.175:45692) 2024-04-25T09:05:51.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.969+0000 7fc5a1600640 1 -- 172.21.15.175:0/3751713895 learned_addr learned my addr 172.21.15.175:0/3751713895 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:51.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.969+0000 7fc5a0c00640 1 --2- 172.21.15.175:0/3751713895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc59c06c070 0x7fc59c06f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.969+0000 7fc593e00640 1 --2- 172.21.15.175:0/3751713895 >> v2:172.21.15.177:3300/0 conn(0x7fc59c0af0f0 0x7fc59c15ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.969+0000 7fc59be00640 1 -- 172.21.15.175:0/3751713895 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835509504 0 0) 0x7fc5940014a0 con 0x7fc59c0acfa0 2024-04-25T09:05:51.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.969+0000 7fc59be00640 1 -- 172.21.15.175:0/3751713895 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc580003530 con 0x7fc59c0acfa0 2024-04-25T09:05:51.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.969+0000 7fc5a0c00640 1 -- 172.21.15.175:0/3751713895 >> v2:172.21.15.177:3300/0 conn(0x7fc59c0af0f0 msgr2=0x7fc59c15ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:51.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.969+0000 7fc5a0c00640 1 --2- 172.21.15.175:0/3751713895 >> v2:172.21.15.177:3300/0 conn(0x7fc59c0af0f0 0x7fc59c15ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.969+0000 7fc5a0c00640 1 -- 172.21.15.175:0/3751713895 >> v1:172.21.15.177:6789/0 conn(0x7fc59c0acfa0 legacy=0x7fc59c06ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.969+0000 7fc5a0c00640 1 -- 172.21.15.175:0/3751713895 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c06e080 con 0x7fc59c06c070 2024-04-25T09:05:51.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.969+0000 7fc5a0c00640 1 --2- 172.21.15.175:0/3751713895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc59c06c070 0x7fc59c06f0e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0097f0 tx=0x7fc59c06bb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1100b07a44d393 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.969+0000 7fc59be00640 1 -- 172.21.15.175:0/3751713895 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c0a7070 con 0x7fc59c06c070 2024-04-25T09:05:51.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.969+0000 7fc59be00640 1 -- 172.21.15.175:0/3751713895 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c0b0070 con 0x7fc59c06c070 2024-04-25T09:05:51.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.969+0000 7fc59be00640 1 -- 172.21.15.175:0/3751713895 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c0ab890 con 0x7fc59c06c070 2024-04-25T09:05:51.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc5a3600640 1 -- 172.21.15.175:0/3751713895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc59c06c070 msgr2=0x7fc59c06f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc5a3600640 1 --2- 172.21.15.175:0/3751713895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc59c06c070 0x7fc59c06f0e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0097f0 tx=0x7fc59c06bb70 comp rx=0 tx=0).stop 2024-04-25T09:05:51.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc5a3600640 1 -- 172.21.15.175:0/3751713895 shutdown_connections 2024-04-25T09:05:51.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc5a3600640 1 --2- 172.21.15.175:0/3751713895 >> v2:172.21.15.177:3300/0 conn(0x7fc59c0af0f0 0x7fc59c15ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc5a3600640 1 --2- 172.21.15.175:0/3751713895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc59c06c070 0x7fc59c06f0e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc5a3600640 1 -- 172.21.15.175:0/3751713895 >> 172.21.15.175:0/3751713895 conn(0x7fc59c0b2200 msgr2=0x7fc59c0cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc5a3600640 1 -- 172.21.15.175:0/3751713895 shutdown_connections 2024-04-25T09:05:51.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc5a3600640 1 -- 172.21.15.175:0/3751713895 wait complete. 2024-04-25T09:05:51.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc5a3600640 1 Processor -- start 2024-04-25T09:05:51.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc5a3600640 1 -- start start 2024-04-25T09:05:51.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc5a3600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc59c06c070 0x7fc59c151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc5a3600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc59c0acfa0 0x7fc59c1483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc5a3600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc59c0af0f0 0x7fc59c14cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc5a3600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c0ad7c0 con 0x7fc59c0acfa0 2024-04-25T09:05:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc5a3600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c06c450 con 0x7fc59c06c070 2024-04-25T09:05:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc5a3600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c148bc0 con 0x7fc59c0af0f0 2024-04-25T09:05:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc593e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc59c0acfa0 0x7fc59c1483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc593e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc59c0acfa0 0x7fc59c1483e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53444/0 (socket says 172.21.15.175:53444) 2024-04-25T09:05:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc593e00640 1 -- 172.21.15.175:0/843181051 learned_addr learned my addr 172.21.15.175:0/843181051 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc5a0c00640 1 --2- 172.21.15.175:0/843181051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc59c06c070 0x7fc59c151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc5a1600640 1 --2- 172.21.15.175:0/843181051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc59c0af0f0 0x7fc59c14cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc593e00640 1 -- 172.21.15.175:0/843181051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc59c0af0f0 msgr2=0x7fc59c14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc593e00640 1 --2- 172.21.15.175:0/843181051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc59c0af0f0 0x7fc59c14cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc593e00640 1 -- 172.21.15.175:0/843181051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc59c06c070 msgr2=0x7fc59c151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc593e00640 1 --2- 172.21.15.175:0/843181051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc59c06c070 0x7fc59c151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.973+0000 7fc593e00640 1 -- 172.21.15.175:0/843181051 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c150fe0 con 0x7fc59c0acfa0 2024-04-25T09:05:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.977+0000 7fc593e00640 1 --2- 172.21.15.175:0/843181051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc59c0acfa0 0x7fc59c1483e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc58400e870 tx=0x7fc58400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.977+0000 7fc599600640 1 -- 172.21.15.175:0/843181051 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc584017070 con 0x7fc59c0acfa0 2024-04-25T09:05:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.977+0000 7fc599600640 1 -- 172.21.15.175:0/843181051 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58400c940 con 0x7fc59c0acfa0 2024-04-25T09:05:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.977+0000 7fc5a3600640 1 -- 172.21.15.175:0/843181051 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59c148920 con 0x7fc59c0acfa0 2024-04-25T09:05:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.977+0000 7fc599600640 1 -- 172.21.15.175:0/843181051 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58400ccf0 con 0x7fc59c0acfa0 2024-04-25T09:05:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.977+0000 7fc5a3600640 1 -- 172.21.15.175:0/843181051 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c151560 con 0x7fc59c0acfa0 2024-04-25T09:05:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.977+0000 7fc5a3600640 1 -- 172.21.15.175:0/843181051 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59c074a60 con 0x7fc59c0acfa0 2024-04-25T09:05:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.977+0000 7fc599600640 1 -- 172.21.15.175:0/843181051 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc58401a070 con 0x7fc59c0acfa0 2024-04-25T09:05:51.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.977+0000 7fc599600640 1 --2- 172.21.15.175:0/843181051 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc578066f90 0x7fc578069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.977+0000 7fc599600640 1 -- 172.21.15.175:0/843181051 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc584084de0 con 0x7fc59c0acfa0 2024-04-25T09:05:51.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.977+0000 7fc5a0c00640 1 --2- 172.21.15.175:0/843181051 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc578066f90 0x7fc578069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.977+0000 7fc5a0c00640 1 --2- 172.21.15.175:0/843181051 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc578066f90 0x7fc578069450 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0af000 tx=0x7fc58c004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:51.981+0000 7fc599600640 1 -- 172.21.15.175:0/843181051 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc5840557d0 con 0x7fc59c0acfa0 2024-04-25T09:05:52.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:52.177+0000 7fc5a3600640 1 -- 172.21.15.175:0/843181051 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc59c0d0b50 con 0x7fc59c0acfa0 2024-04-25T09:05:52.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:52.177+0000 7fc599600640 1 -- 172.21.15.175:0/843181051 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc584059870 con 0x7fc59c0acfa0 2024-04-25T09:05:52.166 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:05:52.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:52.177+0000 7fc5a3600640 1 -- 172.21.15.175:0/843181051 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc578066f90 msgr2=0x7fc578069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:52.177+0000 7fc5a3600640 1 --2- 172.21.15.175:0/843181051 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc578066f90 0x7fc578069450 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0af000 tx=0x7fc58c004740 comp rx=0 tx=0).stop 2024-04-25T09:05:52.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:52.177+0000 7fc5a3600640 1 -- 172.21.15.175:0/843181051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc59c0acfa0 msgr2=0x7fc59c1483e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:52.177+0000 7fc5a3600640 1 --2- 172.21.15.175:0/843181051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc59c0acfa0 0x7fc59c1483e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc58400e870 tx=0x7fc58400ec70 comp rx=0 tx=0).stop 2024-04-25T09:05:52.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:52.177+0000 7fc5a3600640 1 -- 172.21.15.175:0/843181051 shutdown_connections 2024-04-25T09:05:52.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:52.177+0000 7fc5a3600640 1 --2- 172.21.15.175:0/843181051 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc578066f90 0x7fc578069450 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:52.177+0000 7fc5a3600640 1 --2- 172.21.15.175:0/843181051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc59c0af0f0 0x7fc59c14cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:52.177+0000 7fc5a3600640 1 --2- 172.21.15.175:0/843181051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc59c0acfa0 0x7fc59c1483e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:52.177+0000 7fc5a3600640 1 --2- 172.21.15.175:0/843181051 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc59c06c070 0x7fc59c151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:52.177+0000 7fc5a3600640 1 -- 172.21.15.175:0/843181051 >> 172.21.15.175:0/843181051 conn(0x7fc59c0b2200 msgr2=0x7fc59c0af790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:52.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:52.177+0000 7fc5a3600640 1 -- 172.21.15.175:0/843181051 shutdown_connections 2024-04-25T09:05:52.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:52.177+0000 7fc5a3600640 1 -- 172.21.15.175:0/843181051 wait complete. 2024-04-25T09:05:52.186 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:05:52.186 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:05:52.187 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-25T09:05:52.187 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:05:52.187 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:05:52.187 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:05:52.187 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:05:52.187 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:05:52.187 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:05:52.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:52.187 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-25T09:05:52.197 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:05:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:05:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:05:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:05:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:52.197 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:05:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-25T09:05:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-25T09:05:52.197 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:05:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-25T09:05:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-25T09:05:52.197 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:05:52.197 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:05:52.198 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:05:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:05:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:05:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42367sec preferred_lft 42367sec 2024-04-25T09:05:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-25T09:05:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:52.198 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:05:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:0d:71:4a:a6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:05:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:05:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:52.198 INFO:teuthology.orchestra.run.smithi175.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:05:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:05:52.198 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:05:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:05:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:52.199 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:05:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:05:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:05:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:52.199 INFO:teuthology.orchestra.run.smithi175.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:05:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:05:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:05:52.199 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:05:52.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:52.200 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:05:52.258 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:05:52.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:52.262 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-25T09:05:52.321 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-25T09:05:52.321 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:05:52.321 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:05:52.321 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:05:52.322 INFO:teuthology.orchestra.run.smithi175.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:05:52.322 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:05:52.322 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:05:52.322 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:05:52.322 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:05:52.322 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:05:52.322 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:05:52.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:52.322 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:05:52.323 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:05:52.323 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:05:52.323 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:05:52.323 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:05:52.323 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:05:52.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:52.417 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:05:52.426 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:05:52.426 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:05:52.427 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:05:52.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:52.427 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-25T09:05:52.492 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:05:52.492 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:05:52.540 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:05:52.541 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:05:52.541 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:05:52.591 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:05:52.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:52.592 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:05:52.683 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:05:52.683 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:05:52.683 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:05:52.698 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:05:52.698 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:05:52.698 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:05:52.698 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:05:52.698 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:05:52.707 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:05:52.707 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:05:52.707 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:05:52.707 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:05:52.708 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:05:52.708 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:05:52.708 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:05:52.708 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:05:52.711 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:05:52.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:52.712 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:05:52.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:52.776 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:05:52.839 INFO:teuthology.orchestra.run.smithi175.stdout:client5679 2024-04-25T09:05:52.839 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:05:52.839 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:52.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:52.888 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2024-04-25T09:05:52.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:52.951 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2024-04-25T09:05:53.008 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:05:53.008 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:05:53.008 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:05:53.008 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:05:53.008 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2024-04-25T09:05:53.008 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:05:53.111 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627777 2024-04-25T09:05:53.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:05:53.120 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:53.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.305+0000 7fb381c00640 1 Processor -- start 2024-04-25T09:05:53.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.305+0000 7fb381c00640 1 -- start start 2024-04-25T09:05:53.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.305+0000 7fb381c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb37c15bc10 0x7fb37c0cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.305+0000 7fb381c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb37c09abb0 0x7fb37c0cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.305+0000 7fb381c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb37c0cc4c0 con 0x7fb37c099a50 2024-04-25T09:05:53.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.305+0000 7fb381c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37c0d06f0 con 0x7fb37c15bc10 2024-04-25T09:05:53.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.305+0000 7fb381c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c0cc7a0 con 0x7fb37c09abb0 2024-04-25T09:05:53.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.305+0000 7fb37aa00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb37c099a50 0x7fb37c099e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39034/0 (socket says 172.21.15.175:39034) 2024-04-25T09:05:53.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.309+0000 7fb37aa00640 1 -- 172.21.15.175:0/3597846703 learned_addr learned my addr 172.21.15.175:0/3597846703 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:53.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.309+0000 7fb372000640 1 --2- 172.21.15.175:0/3597846703 >> v2:172.21.15.177:3300/0 conn(0x7fb37c15bc10 0x7fb37c0cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.309+0000 7fb37b400640 1 --2- 172.21.15.175:0/3597846703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb37c09abb0 0x7fb37c0cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.309+0000 7fb37a000640 1 -- 172.21.15.175:0/3597846703 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210127934 0 0) 0x7fb37c0cc4c0 con 0x7fb37c099a50 2024-04-25T09:05:53.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.309+0000 7fb37a000640 1 -- 172.21.15.175:0/3597846703 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb360003530 con 0x7fb37c099a50 2024-04-25T09:05:53.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.309+0000 7fb372000640 1 -- 172.21.15.175:0/3597846703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb37c09abb0 msgr2=0x7fb37c0cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:53.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.309+0000 7fb372000640 1 --2- 172.21.15.175:0/3597846703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb37c09abb0 0x7fb37c0cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.309+0000 7fb372000640 1 -- 172.21.15.175:0/3597846703 >> v1:172.21.15.175:6789/0 conn(0x7fb37c099a50 legacy=0x7fb37c099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.309+0000 7fb372000640 1 -- 172.21.15.175:0/3597846703 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c0cca80 con 0x7fb37c15bc10 2024-04-25T09:05:53.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.309+0000 7fb372000640 1 --2- 172.21.15.175:0/3597846703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37c15bc10 0x7fb37c0cd280 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb3640097c0 tx=0x7fb36401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=153fef82dc0b9c51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb37a000640 1 -- 172.21.15.175:0/3597846703 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3640b1070 con 0x7fb37c15bc10 2024-04-25T09:05:53.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb37a000640 1 -- 172.21.15.175:0/3597846703 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3640ac410 con 0x7fb37c15bc10 2024-04-25T09:05:53.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb37a000640 1 -- 172.21.15.175:0/3597846703 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3640ac7e0 con 0x7fb37c15bc10 2024-04-25T09:05:53.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb381c00640 1 -- 172.21.15.175:0/3597846703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37c15bc10 msgr2=0x7fb37c0cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb381c00640 1 --2- 172.21.15.175:0/3597846703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37c15bc10 0x7fb37c0cd280 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb3640097c0 tx=0x7fb36401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb381c00640 1 -- 172.21.15.175:0/3597846703 shutdown_connections 2024-04-25T09:05:53.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb381c00640 1 --2- 172.21.15.175:0/3597846703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb37c09abb0 0x7fb37c0cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb381c00640 1 --2- 172.21.15.175:0/3597846703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37c15bc10 0x7fb37c0cd280 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb381c00640 1 -- 172.21.15.175:0/3597846703 >> 172.21.15.175:0/3597846703 conn(0x7fb37c0b3300 msgr2=0x7fb37c0b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:53.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb381c00640 1 -- 172.21.15.175:0/3597846703 shutdown_connections 2024-04-25T09:05:53.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb381c00640 1 -- 172.21.15.175:0/3597846703 wait complete. 2024-04-25T09:05:53.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb381c00640 1 Processor -- start 2024-04-25T09:05:53.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb381c00640 1 -- start start 2024-04-25T09:05:53.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb381c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37c099a50 0x7fb37c1469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb381c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb37c09abb0 0x7fb37c06c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb381c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb37c15bc10 0x7fb37c06cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb381c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c0c5f00 con 0x7fb37c15bc10 2024-04-25T09:05:53.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb381c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c0c5d80 con 0x7fb37c099a50 2024-04-25T09:05:53.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb381c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c168850 con 0x7fb37c09abb0 2024-04-25T09:05:53.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb37b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb37c15bc10 0x7fb37c06cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb37b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb37c15bc10 0x7fb37c06cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53448/0 (socket says 172.21.15.175:53448) 2024-04-25T09:05:53.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.313+0000 7fb37b400640 1 -- 172.21.15.175:0/3591880723 learned_addr learned my addr 172.21.15.175:0/3591880723 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:53.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.317+0000 7fb37aa00640 1 --2- 172.21.15.175:0/3591880723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37c099a50 0x7fb37c1469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.317+0000 7fb372000640 1 --2- 172.21.15.175:0/3591880723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb37c09abb0 0x7fb37c06c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.317+0000 7fb37b400640 1 -- 172.21.15.175:0/3591880723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb37c09abb0 msgr2=0x7fb37c06c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.317+0000 7fb37b400640 1 --2- 172.21.15.175:0/3591880723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb37c09abb0 0x7fb37c06c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.317+0000 7fb37b400640 1 -- 172.21.15.175:0/3591880723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37c099a50 msgr2=0x7fb37c1469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.317+0000 7fb37b400640 1 --2- 172.21.15.175:0/3591880723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37c099a50 0x7fb37c1469c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.317+0000 7fb37b400640 1 -- 172.21.15.175:0/3591880723 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c159c90 con 0x7fb37c15bc10 2024-04-25T09:05:53.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.317+0000 7fb37b400640 1 --2- 172.21.15.175:0/3591880723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb37c15bc10 0x7fb37c06cd80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb37400e930 tx=0x7fb37400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.317+0000 7fb373400640 1 -- 172.21.15.175:0/3591880723 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb374017070 con 0x7fb37c15bc10 2024-04-25T09:05:53.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.317+0000 7fb373400640 1 -- 172.21.15.175:0/3591880723 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37400c9a0 con 0x7fb37c15bc10 2024-04-25T09:05:53.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.317+0000 7fb381c00640 1 -- 172.21.15.175:0/3591880723 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37c159f70 con 0x7fb37c15bc10 2024-04-25T09:05:53.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.317+0000 7fb373400640 1 -- 172.21.15.175:0/3591880723 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37400cd70 con 0x7fb37c15bc10 2024-04-25T09:05:53.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.317+0000 7fb381c00640 1 -- 172.21.15.175:0/3591880723 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37c15a530 con 0x7fb37c15bc10 2024-04-25T09:05:53.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.317+0000 7fb381c00640 1 -- 172.21.15.175:0/3591880723 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37c074a60 con 0x7fb37c15bc10 2024-04-25T09:05:53.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.317+0000 7fb373400640 1 -- 172.21.15.175:0/3591880723 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb37401a070 con 0x7fb37c15bc10 2024-04-25T09:05:53.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.321+0000 7fb373400640 1 --2- 172.21.15.175:0/3591880723 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb358066f90 0x7fb358069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.321+0000 7fb373400640 1 -- 172.21.15.175:0/3591880723 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb374084fe0 con 0x7fb37c15bc10 2024-04-25T09:05:53.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.321+0000 7fb37aa00640 1 --2- 172.21.15.175:0/3591880723 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb358066f90 0x7fb358069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.321+0000 7fb37aa00640 1 --2- 172.21.15.175:0/3591880723 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb358066f90 0x7fb358069450 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb36c005c10 tx=0x7fb36c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.325+0000 7fb373400640 1 -- 172.21.15.175:0/3591880723 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb3740559c0 con 0x7fb37c15bc10 2024-04-25T09:05:53.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.509+0000 7fb381c00640 1 -- 172.21.15.175:0/3591880723 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb37c0cdc40 con 0x7fb37c15bc10 2024-04-25T09:05:53.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.509+0000 7fb373400640 1 -- 172.21.15.175:0/3591880723 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4950 (secure 0 0 0) 0x7fb374059a60 con 0x7fb37c15bc10 2024-04-25T09:05:53.499 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:53.499 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5102,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2763692769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2763692769},{"type":"v1","addr":"172.21.15.175:6837","nonce":2763692769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3823569323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3823569323},{"type":"v1","addr":"172.21.15.177:6834","nonce":3823569323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2687013607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2687013607},{"type":"v1","addr":"172.21.15.177:6835","nonce":2687013607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:45.332647+0000","modified":"2024-04-25T09:05:48.357816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6836/1389262120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1389262120},{"type":"v1","addr":"172.21.15.175:6836","nonce":1389262120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:05:53.499 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 25 2024-04-25T09:05:53.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.509+0000 7fb381c00640 1 -- 172.21.15.175:0/3591880723 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb358066f90 msgr2=0x7fb358069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.509+0000 7fb381c00640 1 --2- 172.21.15.175:0/3591880723 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb358066f90 0x7fb358069450 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb36c005c10 tx=0x7fb36c009040 comp rx=0 tx=0).stop 2024-04-25T09:05:53.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.509+0000 7fb381c00640 1 -- 172.21.15.175:0/3591880723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb37c15bc10 msgr2=0x7fb37c06cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.509+0000 7fb381c00640 1 --2- 172.21.15.175:0/3591880723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb37c15bc10 0x7fb37c06cd80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb37400e930 tx=0x7fb37400edf0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.513+0000 7fb381c00640 1 -- 172.21.15.175:0/3591880723 shutdown_connections 2024-04-25T09:05:53.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.513+0000 7fb381c00640 1 --2- 172.21.15.175:0/3591880723 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb358066f90 0x7fb358069450 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.513+0000 7fb381c00640 1 --2- 172.21.15.175:0/3591880723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb37c15bc10 0x7fb37c06cd80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.513+0000 7fb381c00640 1 --2- 172.21.15.175:0/3591880723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb37c09abb0 0x7fb37c06c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.513+0000 7fb381c00640 1 --2- 172.21.15.175:0/3591880723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb37c099a50 0x7fb37c1469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.513+0000 7fb381c00640 1 -- 172.21.15.175:0/3591880723 >> 172.21.15.175:0/3591880723 conn(0x7fb37c0b3300 msgr2=0x7fb37c0cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:53.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.513+0000 7fb381c00640 1 -- 172.21.15.175:0/3591880723 shutdown_connections 2024-04-25T09:05:53.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.513+0000 7fb381c00640 1 -- 172.21.15.175:0/3591880723 wait complete. 2024-04-25T09:05:53.520 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T09:05:53.682 INFO:teuthology.orchestra.run.smithi175.stdout:{"message":"","return_code":0} 2024-04-25T09:05:53.683 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:05:53.683 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T09:05:53.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.737+0000 7f1608517080 1 Processor -- start 2024-04-25T09:05:53.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1608517080 1 -- start start 2024-04-25T09:05:53.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1608517080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cc70c30510 0x55cc70cbc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1608517080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55cc70c308f0 0x55cc70cb9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1608517080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc70cbd550 0x55cc70c18410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1608517080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc70c1a360 con 0x55cc70cbd550 2024-04-25T09:05:53.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1608517080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc70b8c9f0 con 0x55cc70c30510 2024-04-25T09:05:53.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1608517080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc70c31f40 con 0x55cc70c308f0 2024-04-25T09:05:53.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1606200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc70cbd550 0x55cc70c18410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1606200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc70cbd550 0x55cc70c18410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53460/0 (socket says 172.21.15.175:53460) 2024-04-25T09:05:53.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1606200640 1 -- 172.21.15.175:0/2988423837 learned_addr learned my addr 172.21.15.175:0/2988423837 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:53.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1604e00640 1 --2- 172.21.15.175:0/2988423837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55cc70c308f0 0x55cc70cb9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1605800640 1 --2- 172.21.15.175:0/2988423837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cc70c30510 0x55cc70cbc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1606200640 1 -- 172.21.15.175:0/2988423837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55cc70c308f0 msgr2=0x55cc70cb9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:53.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1606200640 1 --2- 172.21.15.175:0/2988423837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55cc70c308f0 0x55cc70cb9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1606200640 1 -- 172.21.15.175:0/2988423837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cc70c30510 msgr2=0x55cc70cbc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:53.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1606200640 1 --2- 172.21.15.175:0/2988423837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cc70c30510 0x55cc70cbc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1606200640 1 -- 172.21.15.175:0/2988423837 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc70cc0bd0 con 0x55cc70cbd550 2024-04-25T09:05:53.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1606200640 1 --2- 172.21.15.175:0/2988423837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc70cbd550 0x55cc70c18410 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1600001740 tx=0x7f1600001c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6491839188652bf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f15ff400640 1 -- 172.21.15.175:0/2988423837 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600016070 con 0x55cc70cbd550 2024-04-25T09:05:53.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f15ff400640 1 -- 172.21.15.175:0/2988423837 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1600004530 con 0x55cc70cbd550 2024-04-25T09:05:53.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f15ff400640 1 -- 172.21.15.175:0/2988423837 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1600004920 con 0x55cc70cbd550 2024-04-25T09:05:53.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1608517080 1 -- 172.21.15.175:0/2988423837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc70cbd550 msgr2=0x55cc70c18410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1608517080 1 --2- 172.21.15.175:0/2988423837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc70cbd550 0x55cc70c18410 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1600001740 tx=0x7f1600001c00 comp rx=0 tx=0).stop 2024-04-25T09:05:53.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1608517080 1 -- 172.21.15.175:0/2988423837 shutdown_connections 2024-04-25T09:05:53.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1608517080 1 --2- 172.21.15.175:0/2988423837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc70cbd550 0x55cc70c18410 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1608517080 1 --2- 172.21.15.175:0/2988423837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55cc70c308f0 0x55cc70cb9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1608517080 1 --2- 172.21.15.175:0/2988423837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cc70c30510 0x55cc70cbc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1608517080 1 -- 172.21.15.175:0/2988423837 >> 172.21.15.175:0/2988423837 conn(0x55cc70c14430 msgr2=0x55cc70cbb8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:53.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1608517080 1 -- 172.21.15.175:0/2988423837 shutdown_connections 2024-04-25T09:05:53.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1608517080 1 -- 172.21.15.175:0/2988423837 wait complete. 2024-04-25T09:05:53.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1608517080 1 Processor -- start 2024-04-25T09:05:53.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.741+0000 7f1608517080 1 -- start start 2024-04-25T09:05:53.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1608517080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55cc70c30510 0x55cc70cc2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1608517080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc70c308f0 0x55cc70cbf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1608517080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cc70cbd550 0x55cc70cbf670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1608517080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc70cb9250 con 0x55cc70c308f0 2024-04-25T09:05:53.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1608517080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc70cc0e70 con 0x55cc70cbd550 2024-04-25T09:05:53.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1608517080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc70cb94f0 con 0x55cc70c30510 2024-04-25T09:05:53.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1604e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc70c308f0 0x55cc70cbf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1604e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc70c308f0 0x55cc70cbf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53462/0 (socket says 172.21.15.175:53462) 2024-04-25T09:05:53.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1604e00640 1 -- 172.21.15.175:0/4032163901 learned_addr learned my addr 172.21.15.175:0/4032163901 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:53.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1605800640 1 --2- 172.21.15.175:0/4032163901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55cc70c30510 0x55cc70cc2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1606200640 1 --2- 172.21.15.175:0/4032163901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cc70cbd550 0x55cc70cbf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1604e00640 1 -- 172.21.15.175:0/4032163901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55cc70c30510 msgr2=0x55cc70cc2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1604e00640 1 --2- 172.21.15.175:0/4032163901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55cc70c30510 0x55cc70cc2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1604e00640 1 -- 172.21.15.175:0/4032163901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cc70cbd550 msgr2=0x55cc70cbf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1604e00640 1 --2- 172.21.15.175:0/4032163901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55cc70cbd550 0x55cc70cbf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1604e00640 1 -- 172.21.15.175:0/4032163901 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc70cb9080 con 0x55cc70c308f0 2024-04-25T09:05:53.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1604e00640 1 --2- 172.21.15.175:0/4032163901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc70c308f0 0x55cc70cbf130 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f15f4008870 tx=0x7f15f4008d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f15fe000640 1 -- 172.21.15.175:0/4032163901 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4019070 con 0x55cc70c308f0 2024-04-25T09:05:53.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f15fe000640 1 -- 172.21.15.175:0/4032163901 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f4010ba0 con 0x55cc70c308f0 2024-04-25T09:05:53.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1608517080 1 -- 172.21.15.175:0/4032163901 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cc70cb8600 con 0x55cc70c308f0 2024-04-25T09:05:53.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f15fe000640 1 -- 172.21.15.175:0/4032163901 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4015450 con 0x55cc70c308f0 2024-04-25T09:05:53.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.745+0000 7f1608517080 1 -- 172.21.15.175:0/4032163901 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc70cb8b40 con 0x55cc70c308f0 2024-04-25T09:05:53.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f15fe000640 1 -- 172.21.15.175:0/4032163901 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f15f401c070 con 0x55cc70c308f0 2024-04-25T09:05:53.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f15fe000640 1 --2- 172.21.15.175:0/4032163901 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f15e8065940 0x7f15e8067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f15fe000640 1 -- 172.21.15.175:0/4032163901 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f15f40848c0 con 0x55cc70c308f0 2024-04-25T09:05:53.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f1605800640 1 --2- 172.21.15.175:0/4032163901 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f15e8065940 0x7f15e8067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f1608517080 1 --2- 172.21.15.175:0/4032163901 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55cc70d57b30 0x55cc70cb7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f1608517080 1 -- 172.21.15.175:0/4032163901 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:1 7.7 7:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v9 -- 0x55cc70cc2ca0 con 0x55cc70d57b30 2024-04-25T09:05:53.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f1605800640 1 --2- 172.21.15.175:0/4032163901 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f15e8065940 0x7f15e8067e00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f15f80ad000 tx=0x7f15f80a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f1606200640 1 --2- 172.21.15.175:0/4032163901 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55cc70d57b30 0x55cc70cb7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f1606200640 1 --2- 172.21.15.175:0/4032163901 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55cc70d57b30 0x55cc70cb7550 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f1606200640 1 -- 172.21.15.175:0/4032163901 <== osd.6 v2:172.21.15.177:6822/4132808595 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f160000f070 con 0x55cc70d57b30 2024-04-25T09:05:53.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f1608517080 1 -- 172.21.15.175:0/4032163901 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55cc70d57b30 msgr2=0x55cc70cb7550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f1608517080 1 --2- 172.21.15.175:0/4032163901 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55cc70d57b30 0x55cc70cb7550 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f1608517080 1 -- 172.21.15.175:0/4032163901 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f15e8065940 msgr2=0x7f15e8067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f1608517080 1 --2- 172.21.15.175:0/4032163901 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f15e8065940 0x7f15e8067e00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f15f80ad000 tx=0x7f15f80a6000 comp rx=0 tx=0).stop 2024-04-25T09:05:53.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f1608517080 1 -- 172.21.15.175:0/4032163901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc70c308f0 msgr2=0x55cc70cbf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f1608517080 1 --2- 172.21.15.175:0/4032163901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55cc70c308f0 0x55cc70cbf130 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f15f4008870 tx=0x7f15f4008d30 comp rx=0 tx=0).stop 2024-04-25T09:05:53.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f1606200640 1 -- 172.21.15.175:0/4032163901 reap_dead start 2024-04-25T09:05:53.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f1608517080 1 -- 172.21.15.175:0/4032163901 shutdown_connections 2024-04-25T09:05:53.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f1608517080 1 -- 172.21.15.175:0/4032163901 >> 172.21.15.175:0/4032163901 conn(0x55cc70c14430 msgr2=0x55cc70cb4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:53.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f1608517080 1 -- 172.21.15.175:0/4032163901 shutdown_connections 2024-04-25T09:05:53.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.749+0000 7f1608517080 1 -- 172.21.15.175:0/4032163901 wait complete. 2024-04-25T09:05:53.744 INFO:teuthology.orchestra.run.smithi175.stdout:Yalphaparent_a 2024-04-25T09:05:53.744 DEBUG:teuthology.orchestra.run.smithi175:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T09:05:53.789 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:05:53.789 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 1099511627777, 2024-04-25T09:05:53.789 INFO:teuthology.orchestra.run.smithi175.stdout: "ancestors": [ 2024-04-25T09:05:53.789 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: "dirino": 1099511627776, 2024-04-25T09:05:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: "dname": "alpha", 2024-04-25T09:05:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: "version": 2 2024-04-25T09:05:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:05:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:05:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: "dirino": 1, 2024-04-25T09:05:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: "dname": "parent_a", 2024-04-25T09:05:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: "version": 4 2024-04-25T09:05:53.790 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:53.791 INFO:teuthology.orchestra.run.smithi175.stdout: ], 2024-04-25T09:05:53.791 INFO:teuthology.orchestra.run.smithi175.stdout: "pool": 7, 2024-04-25T09:05:53.791 INFO:teuthology.orchestra.run.smithi175.stdout: "old_pools": [] 2024-04-25T09:05:53.791 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:05:53.791 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:53.794 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2024-04-25T09:05:53.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63ada2f080 1 Processor -- start 2024-04-25T09:05:53.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63ada2f080 1 -- start start 2024-04-25T09:05:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63ada2f080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5647b30f5740 0x5647b30f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63ada2f080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b30f5b20 0x5647b31a40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63ada2f080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647b30f6000 0x5647b30f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63ada2f080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647b30f6c50 con 0x5647b30f6000 2024-04-25T09:05:53.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63ada2f080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647b2fe39f0 con 0x5647b30f5b20 2024-04-25T09:05:53.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63ada2f080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5647b30f6ef0 con 0x5647b30f5740 2024-04-25T09:05:53.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63ab600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647b30f6000 0x5647b30f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63ab600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647b30f6000 0x5647b30f7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53478/0 (socket says 172.21.15.175:53478) 2024-04-25T09:05:53.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63ab600640 1 -- 172.21.15.175:0/2858499648 learned_addr learned my addr 172.21.15.175:0/2858499648 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:53.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63aac00640 1 --2- 172.21.15.175:0/2858499648 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5647b30f5740 0x5647b30f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63aa200640 1 --2- 172.21.15.175:0/2858499648 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b30f5b20 0x5647b31a40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63ab600640 1 -- 172.21.15.175:0/2858499648 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5647b30f5740 msgr2=0x5647b30f4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:53.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63ab600640 1 --2- 172.21.15.175:0/2858499648 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5647b30f5740 0x5647b30f4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63ab600640 1 -- 172.21.15.175:0/2858499648 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b30f5b20 msgr2=0x5647b31a40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:53.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63ab600640 1 --2- 172.21.15.175:0/2858499648 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b30f5b20 0x5647b31a40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63ab600640 1 -- 172.21.15.175:0/2858499648 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647b3114d90 con 0x5647b30f6000 2024-04-25T09:05:53.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.897+0000 7f63aa200640 1 --2- 172.21.15.175:0/2858499648 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b30f5b20 0x5647b31a40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:53.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ab600640 1 --2- 172.21.15.175:0/2858499648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647b30f6000 0x5647b30f7fb0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f63a400a560 tx=0x7f63a40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0863d42782a231b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63a8e00640 1 -- 172.21.15.175:0/2858499648 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a40b0040 con 0x5647b30f6000 2024-04-25T09:05:53.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63a8e00640 1 -- 172.21.15.175:0/2858499648 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a40ab590 con 0x5647b30f6000 2024-04-25T09:05:53.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63a8e00640 1 -- 172.21.15.175:0/2858499648 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a40ab980 con 0x5647b30f6000 2024-04-25T09:05:53.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ada2f080 1 -- 172.21.15.175:0/2858499648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647b30f6000 msgr2=0x5647b30f7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ada2f080 1 --2- 172.21.15.175:0/2858499648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647b30f6000 0x5647b30f7fb0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f63a400a560 tx=0x7f63a40033b0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ada2f080 1 -- 172.21.15.175:0/2858499648 shutdown_connections 2024-04-25T09:05:53.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ada2f080 1 --2- 172.21.15.175:0/2858499648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647b30f6000 0x5647b30f7fb0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ada2f080 1 --2- 172.21.15.175:0/2858499648 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b30f5b20 0x5647b31a40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ada2f080 1 --2- 172.21.15.175:0/2858499648 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5647b30f5740 0x5647b30f4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ada2f080 1 -- 172.21.15.175:0/2858499648 >> 172.21.15.175:0/2858499648 conn(0x5647b303d420 msgr2=0x5647b3115260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:53.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ada2f080 1 -- 172.21.15.175:0/2858499648 shutdown_connections 2024-04-25T09:05:53.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ada2f080 1 -- 172.21.15.175:0/2858499648 wait complete. 2024-04-25T09:05:53.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ada2f080 1 Processor -- start 2024-04-25T09:05:53.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ada2f080 1 -- start start 2024-04-25T09:05:53.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ada2f080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b30f5740 0x5647b31a6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ada2f080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647b30f5b20 0x5647b31a7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ada2f080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5647b30f6000 0x5647b3112010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ada2f080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647b3111940 con 0x5647b30f5b20 2024-04-25T09:05:53.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ada2f080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647b31116a0 con 0x5647b30f5740 2024-04-25T09:05:53.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ada2f080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5647b3111be0 con 0x5647b30f6000 2024-04-25T09:05:53.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63aa200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647b30f5b20 0x5647b31a7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63aac00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b30f5740 0x5647b31a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63aa200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647b30f5b20 0x5647b31a7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53484/0 (socket says 172.21.15.175:53484) 2024-04-25T09:05:53.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63aa200640 1 -- 172.21.15.175:0/2169427554 learned_addr learned my addr 172.21.15.175:0/2169427554 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:53.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63ab600640 1 --2- 172.21.15.175:0/2169427554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5647b30f6000 0x5647b3112010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63aa200640 1 -- 172.21.15.175:0/2169427554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5647b30f6000 msgr2=0x5647b3112010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63aa200640 1 --2- 172.21.15.175:0/2169427554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5647b30f6000 0x5647b3112010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63aa200640 1 -- 172.21.15.175:0/2169427554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b30f5740 msgr2=0x5647b31a6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63aa200640 1 --2- 172.21.15.175:0/2169427554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5647b30f5740 0x5647b31a6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63aa200640 1 -- 172.21.15.175:0/2169427554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647b31a6bb0 con 0x5647b30f5b20 2024-04-25T09:05:53.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.901+0000 7f63aa200640 1 --2- 172.21.15.175:0/2169427554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647b30f5b20 0x5647b31a7ad0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f639800b250 tx=0x7f639800b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.905+0000 7f63a3400640 1 -- 172.21.15.175:0/2169427554 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398014020 con 0x5647b30f5b20 2024-04-25T09:05:53.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.905+0000 7f63a3400640 1 -- 172.21.15.175:0/2169427554 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6398008030 con 0x5647b30f5b20 2024-04-25T09:05:53.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.905+0000 7f63a3400640 1 -- 172.21.15.175:0/2169427554 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398010840 con 0x5647b30f5b20 2024-04-25T09:05:53.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.905+0000 7f63ada2f080 1 -- 172.21.15.175:0/2169427554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5647b31a6e50 con 0x5647b30f5b20 2024-04-25T09:05:53.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.905+0000 7f63ada2f080 1 -- 172.21.15.175:0/2169427554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647b31a7390 con 0x5647b30f5b20 2024-04-25T09:05:53.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.905+0000 7f63a3400640 1 -- 172.21.15.175:0/2169427554 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6398017020 con 0x5647b30f5b20 2024-04-25T09:05:53.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.905+0000 7f63a3400640 1 --2- 172.21.15.175:0/2169427554 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f638c065940 0x7f638c067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.905+0000 7f63a3400640 1 -- 172.21.15.175:0/2169427554 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6398083960 con 0x5647b30f5b20 2024-04-25T09:05:53.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.905+0000 7f63aac00640 1 --2- 172.21.15.175:0/2169427554 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f638c065940 0x7f638c067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.905+0000 7f63ada2f080 1 --2- 172.21.15.175:0/2169427554 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x5647b310a8f0 0x5647b310acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.905+0000 7f63ada2f080 1 -- 172.21.15.175:0/2169427554 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:1 7.7 7:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v9 -- 0x5647b3110470 con 0x5647b310a8f0 2024-04-25T09:05:53.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.905+0000 7f63ab600640 1 --2- 172.21.15.175:0/2169427554 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x5647b310a8f0 0x5647b310acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.905+0000 7f63aac00640 1 --2- 172.21.15.175:0/2169427554 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f638c065940 0x7f638c067e00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f639c005410 tx=0x7f639c00c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.909+0000 7f63ab600640 1 --2- 172.21.15.175:0/2169427554 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x5647b310a8f0 0x5647b310acd0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.909+0000 7f63ab600640 1 -- 172.21.15.175:0/2169427554 <== osd.6 v2:172.21.15.177:6822/4132808595 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v46'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f63a40ab880 con 0x5647b310a8f0 2024-04-25T09:05:53.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.909+0000 7f63ada2f080 1 -- 172.21.15.175:0/2169427554 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x5647b310a8f0 msgr2=0x5647b310acd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.909+0000 7f63ada2f080 1 --2- 172.21.15.175:0/2169427554 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x5647b310a8f0 0x5647b310acd0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.909+0000 7f63ada2f080 1 -- 172.21.15.175:0/2169427554 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f638c065940 msgr2=0x7f638c067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.909+0000 7f63ada2f080 1 --2- 172.21.15.175:0/2169427554 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f638c065940 0x7f638c067e00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f639c005410 tx=0x7f639c00c040 comp rx=0 tx=0).stop 2024-04-25T09:05:53.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.909+0000 7f63ada2f080 1 -- 172.21.15.175:0/2169427554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647b30f5b20 msgr2=0x5647b31a7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.909+0000 7f63ada2f080 1 --2- 172.21.15.175:0/2169427554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5647b30f5b20 0x5647b31a7ad0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f639800b250 tx=0x7f639800b710 comp rx=0 tx=0).stop 2024-04-25T09:05:53.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.909+0000 7f63ab600640 1 -- 172.21.15.175:0/2169427554 reap_dead start 2024-04-25T09:05:53.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.909+0000 7f63ada2f080 1 -- 172.21.15.175:0/2169427554 shutdown_connections 2024-04-25T09:05:53.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.909+0000 7f63ada2f080 1 -- 172.21.15.175:0/2169427554 >> 172.21.15.175:0/2169427554 conn(0x5647b303d420 msgr2=0x5647b3067850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:53.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.909+0000 7f63ada2f080 1 -- 172.21.15.175:0/2169427554 shutdown_connections 2024-04-25T09:05:53.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:53.909+0000 7f63ada2f080 1 -- 172.21.15.175:0/2169427554 wait complete. 2024-04-25T09:05:53.911 DEBUG:teuthology.orchestra.run.smithi175:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-25T09:05:53.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:53.956 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2024-04-25T09:05:54.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.113+0000 7f979de00640 1 Processor -- start 2024-04-25T09:05:54.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.113+0000 7f979de00640 1 -- start start 2024-04-25T09:05:54.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.113+0000 7f979de00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f979815b700 0x7f97980b7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.113+0000 7f979de00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f979815c1f0 0x7f9798160020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.113+0000 7f979de00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979815c670 con 0x7f979815fb90 2024-04-25T09:05:54.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.113+0000 7f979de00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97980b7850 con 0x7f979815b700 2024-04-25T09:05:54.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.113+0000 7f979de00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979815f700 con 0x7f979815c1f0 2024-04-25T09:05:54.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.113+0000 7f978e000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f979815fb90 0x7f979815bae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39036/0 (socket says 172.21.15.175:39036) 2024-04-25T09:05:54.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.113+0000 7f978e000640 1 -- 172.21.15.175:0/1157147042 learned_addr learned my addr 172.21.15.175:0/1157147042 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:54.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.113+0000 7f9797400640 1 --2- 172.21.15.175:0/1157147042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f979815c1f0 0x7f9798160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.113+0000 7f9796a00640 1 --2- 172.21.15.175:0/1157147042 >> v2:172.21.15.177:3300/0 conn(0x7f979815b700 0x7f97980b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.113+0000 7f9796000640 1 -- 172.21.15.175:0/1157147042 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720595664 0 0) 0x7f979815c670 con 0x7f979815fb90 2024-04-25T09:05:54.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.113+0000 7f9796000640 1 -- 172.21.15.175:0/1157147042 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f977c003530 con 0x7f979815fb90 2024-04-25T09:05:54.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.113+0000 7f9797400640 1 -- 172.21.15.175:0/1157147042 >> v2:172.21.15.177:3300/0 conn(0x7f979815b700 msgr2=0x7f97980b7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.113+0000 7f9797400640 1 --2- 172.21.15.175:0/1157147042 >> v2:172.21.15.177:3300/0 conn(0x7f979815b700 0x7f97980b7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.113+0000 7f9797400640 1 -- 172.21.15.175:0/1157147042 >> v1:172.21.15.175:6789/0 conn(0x7f979815fb90 legacy=0x7f979815bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.113+0000 7f9797400640 1 -- 172.21.15.175:0/1157147042 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979815c950 con 0x7f979815c1f0 2024-04-25T09:05:54.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.117+0000 7f9797400640 1 --2- 172.21.15.175:0/1157147042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f979815c1f0 0x7f9798160020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9790009d90 tx=0x7f979001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41f1ba71c24b927 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.117+0000 7f9796000640 1 -- 172.21.15.175:0/1157147042 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97900b2070 con 0x7f979815c1f0 2024-04-25T09:05:54.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.117+0000 7f9796000640 1 -- 172.21.15.175:0/1157147042 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97900a5a50 con 0x7f979815c1f0 2024-04-25T09:05:54.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.117+0000 7f9796000640 1 -- 172.21.15.175:0/1157147042 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97900a5e20 con 0x7f979815c1f0 2024-04-25T09:05:54.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.117+0000 7f979de00640 1 -- 172.21.15.175:0/1157147042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f979815c1f0 msgr2=0x7f9798160020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.117+0000 7f979de00640 1 --2- 172.21.15.175:0/1157147042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f979815c1f0 0x7f9798160020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9790009d90 tx=0x7f979001c970 comp rx=0 tx=0).stop 2024-04-25T09:05:54.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.117+0000 7f979de00640 1 -- 172.21.15.175:0/1157147042 shutdown_connections 2024-04-25T09:05:54.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.117+0000 7f979de00640 1 --2- 172.21.15.175:0/1157147042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f979815c1f0 0x7f9798160020 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.117+0000 7f979de00640 1 --2- 172.21.15.175:0/1157147042 >> v2:172.21.15.177:3300/0 conn(0x7f979815b700 0x7f97980b7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.117+0000 7f979de00640 1 -- 172.21.15.175:0/1157147042 >> 172.21.15.175:0/1157147042 conn(0x7f97980d1880 msgr2=0x7f97980d1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.117+0000 7f979de00640 1 -- 172.21.15.175:0/1157147042 shutdown_connections 2024-04-25T09:05:54.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.117+0000 7f979de00640 1 -- 172.21.15.175:0/1157147042 wait complete. 2024-04-25T09:05:54.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f979de00640 1 Processor -- start 2024-04-25T09:05:54.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f979de00640 1 -- start start 2024-04-25T09:05:54.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f979de00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f979815b700 0x7f9798150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f979de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f979815c1f0 0x7f979815afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f979de00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f979815fb90 0x7f9798153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f979de00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97981687e0 con 0x7f979815c1f0 2024-04-25T09:05:54.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f979de00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9798168660 con 0x7f979815fb90 2024-04-25T09:05:54.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f979de00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9798168960 con 0x7f979815b700 2024-04-25T09:05:54.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f978e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f979815c1f0 0x7f979815afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f978e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f979815c1f0 0x7f979815afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53496/0 (socket says 172.21.15.175:53496) 2024-04-25T09:05:54.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f978e000640 1 -- 172.21.15.175:0/2021611961 learned_addr learned my addr 172.21.15.175:0/2021611961 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:54.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f9797400640 1 --2- 172.21.15.175:0/2021611961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f979815fb90 0x7f9798153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f9796a00640 1 --2- 172.21.15.175:0/2021611961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f979815b700 0x7f9798150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f978e000640 1 -- 172.21.15.175:0/2021611961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f979815b700 msgr2=0x7f9798150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f978e000640 1 --2- 172.21.15.175:0/2021611961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f979815b700 0x7f9798150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f978e000640 1 -- 172.21.15.175:0/2021611961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f979815fb90 msgr2=0x7f9798153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f978e000640 1 --2- 172.21.15.175:0/2021611961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f979815fb90 0x7f9798153b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f978e000640 1 -- 172.21.15.175:0/2021611961 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9798150780 con 0x7f979815c1f0 2024-04-25T09:05:54.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f9796a00640 1 --2- 172.21.15.175:0/2021611961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f979815b700 0x7f9798150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:54.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f978e000640 1 --2- 172.21.15.175:0/2021611961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f979815c1f0 0x7f979815afa0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f978000c480 tx=0x7f978000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f978fe00640 1 -- 172.21.15.175:0/2021611961 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780017070 con 0x7f979815c1f0 2024-04-25T09:05:54.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f978fe00640 1 -- 172.21.15.175:0/2021611961 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9780005cf0 con 0x7f979815c1f0 2024-04-25T09:05:54.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f978fe00640 1 -- 172.21.15.175:0/2021611961 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780007290 con 0x7f979815c1f0 2024-04-25T09:05:54.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.121+0000 7f979de00640 1 -- 172.21.15.175:0/2021611961 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979815b4e0 con 0x7f979815c1f0 2024-04-25T09:05:54.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.125+0000 7f979de00640 1 -- 172.21.15.175:0/2021611961 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97980c8ca0 con 0x7f979815c1f0 2024-04-25T09:05:54.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.125+0000 7f978fe00640 1 -- 172.21.15.175:0/2021611961 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f978001a070 con 0x7f979815c1f0 2024-04-25T09:05:54.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.125+0000 7f978fe00640 1 --2- 172.21.15.175:0/2021611961 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9774066f60 0x7f9774069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.125+0000 7f978fe00640 1 -- 172.21.15.175:0/2021611961 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9780084410 con 0x7f979815c1f0 2024-04-25T09:05:54.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.125+0000 7f9796a00640 1 --2- 172.21.15.175:0/2021611961 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9774066f60 0x7f9774069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.125+0000 7f9796a00640 1 --2- 172.21.15.175:0/2021611961 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9774066f60 0x7f9774069420 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9788009a40 tx=0x7f9788008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f97a13b1000 1 Processor -- start 2024-04-25T09:05:54.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f97a13b1000 1 -- start start 2024-04-25T09:05:54.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f97a13b1000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedaac90 0x55e5cedab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f97a13b1000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedab5b0 0x55e5ced60d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f97a13b1000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5ced61290 0x55e5ced61670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f97a13b1000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cec47f40 con 0x55e5cedaac90 2024-04-25T09:05:54.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f97a13b1000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cebaf070 con 0x55e5cedab5b0 2024-04-25T09:05:54.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f97a13b1000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5ceb371a0 con 0x55e5ced61290 2024-04-25T09:05:54.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f9796a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedaac90 0x55e5cedab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f9796a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedaac90 0x55e5cedab070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53512/0 (socket says 172.21.15.175:53512) 2024-04-25T09:05:54.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f9796a00640 1 -- 172.21.15.175:0/2849733653 learned_addr learned my addr 172.21.15.175:0/2849733653 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:54.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f9797400640 1 --2- 172.21.15.175:0/2849733653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5ced61290 0x55e5ced61670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f978e000640 1 --2- 172.21.15.175:0/2849733653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedab5b0 0x55e5ced60d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f9796a00640 1 -- 172.21.15.175:0/2849733653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5ced61290 msgr2=0x55e5ced61670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f9796a00640 1 --2- 172.21.15.175:0/2849733653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5ced61290 0x55e5ced61670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f9796a00640 1 -- 172.21.15.175:0/2849733653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedab5b0 msgr2=0x55e5ced60d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f9796a00640 1 --2- 172.21.15.175:0/2849733653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedab5b0 0x55e5ced60d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f9796a00640 1 -- 172.21.15.175:0/2849733653 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5ceb35510 con 0x55e5cedaac90 2024-04-25T09:05:54.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f978e000640 1 --2- 172.21.15.175:0/2849733653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedab5b0 0x55e5ced60d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:54.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f9796a00640 1 --2- 172.21.15.175:0/2849733653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedaac90 0x55e5cedab070 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9788006e70 tx=0x7f9788013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcecde07d219154b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f9787e00640 1 -- 172.21.15.175:0/2849733653 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978801c050 con 0x55e5cedaac90 2024-04-25T09:05:54.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f9787e00640 1 -- 172.21.15.175:0/2849733653 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9788026070 con 0x55e5cedaac90 2024-04-25T09:05:54.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.129+0000 7f9787e00640 1 -- 172.21.15.175:0/2849733653 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978800f040 con 0x55e5cedaac90 2024-04-25T09:05:54.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 1 -- 172.21.15.175:0/2849733653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedaac90 msgr2=0x55e5cedab070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 1 --2- 172.21.15.175:0/2849733653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedaac90 0x55e5cedab070 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9788006e70 tx=0x7f9788013000 comp rx=0 tx=0).stop 2024-04-25T09:05:54.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 1 -- 172.21.15.175:0/2849733653 shutdown_connections 2024-04-25T09:05:54.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 1 --2- 172.21.15.175:0/2849733653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5ced61290 0x55e5ced61670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 1 --2- 172.21.15.175:0/2849733653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedab5b0 0x55e5ced60d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 1 --2- 172.21.15.175:0/2849733653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedaac90 0x55e5cedab070 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 1 -- 172.21.15.175:0/2849733653 >> 172.21.15.175:0/2849733653 conn(0x55e5ced5d240 msgr2=0x55e5ced5f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 1 -- 172.21.15.175:0/2849733653 shutdown_connections 2024-04-25T09:05:54.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 1 -- 172.21.15.175:0/2849733653 wait complete. 2024-04-25T09:05:54.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 1 -- start start 2024-04-25T09:05:54.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 1 Processor -- start 2024-04-25T09:05:54.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5ced61290 0x55e5ced6be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedaac90 0x55e5ced6c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedab5b0 0x55e5ced6c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ceb696c0 con 0x55e5cedab5b0 2024-04-25T09:05:54.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5cebab110 con 0x55e5cedaac90 2024-04-25T09:05:54.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5cec65f20 con 0x55e5ced61290 2024-04-25T09:05:54.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 10 client.0 _ll_register_callbacks cb 0x55e5ced4c570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:54.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f9797400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedab5b0 0x55e5ced6c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f9797400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedab5b0 0x55e5ced6c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53526/0 (socket says 172.21.15.175:53526) 2024-04-25T09:05:54.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f9797400640 1 -- 172.21.15.175:0/3770673686 learned_addr learned my addr 172.21.15.175:0/3770673686 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:54.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f978e000640 1 --2- 172.21.15.175:0/3770673686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedaac90 0x55e5ced6c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f9796a00640 1 --2- 172.21.15.175:0/3770673686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5ced61290 0x55e5ced6be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f9797400640 1 -- 172.21.15.175:0/3770673686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5ced61290 msgr2=0x55e5ced6be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f9797400640 1 --2- 172.21.15.175:0/3770673686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5ced61290 0x55e5ced6be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f9797400640 1 -- 172.21.15.175:0/3770673686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedaac90 msgr2=0x55e5ced6c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f9797400640 1 --2- 172.21.15.175:0/3770673686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedaac90 0x55e5ced6c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f9797400640 1 -- 172.21.15.175:0/3770673686 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5ceb373b0 con 0x55e5cedab5b0 2024-04-25T09:05:54.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f9796a00640 1 --2- 172.21.15.175:0/3770673686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5ced61290 0x55e5ced6be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:54.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f9797400640 1 --2- 172.21.15.175:0/3770673686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedab5b0 0x55e5ced6c8b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f97900b0040 tx=0x7f979001b1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5d824a0cb4ecbb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f9784c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:05:54.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f9784c00640 1 -- 172.21.15.175:0/3770673686 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97900bf070 con 0x55e5cedab5b0 2024-04-25T09:05:54.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f9784c00640 1 -- 172.21.15.175:0/3770673686 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f97900b9460 con 0x55e5cedab5b0 2024-04-25T09:05:54.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.133+0000 7f97a13b1000 1 -- 172.21.15.175:0/3770673686 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9788026070 con 0x55e5cedab5b0 2024-04-25T09:05:54.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f9784c00640 1 -- 172.21.15.175:0/3770673686 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97900c9050 con 0x55e5cedab5b0 2024-04-25T09:05:54.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 10 client.5709 fetch_fsmap learned FSMap version 25 2024-04-25T09:05:54.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 1 -- 172.21.15.175:0/3770673686 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55e5cec30e00 con 0x55e5cedab5b0 2024-04-25T09:05:54.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f9784c00640 1 -- 172.21.15.175:0/3770673686 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9788026070 con 0x55e5cedab5b0 2024-04-25T09:05:54.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f9784c00640 1 -- 172.21.15.175:0/3770673686 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f97900cc020 con 0x55e5cedab5b0 2024-04-25T09:05:54.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 10 client.5709 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T09:05:54.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 10 client.5709 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-25T09:05:54.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 20 client.5709 populate_metadata read hostname 'smithi175' 2024-04-25T09:05:54.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 1 --2- 172.21.15.175:0/3770673686 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x55e5ced6d150 0x55e5cedbc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 4 client.5709 mds_command: new command op to 5535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:54.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 1 -- 172.21.15.175:0/3770673686 --> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e5ceb4ad60 con 0x55e5ced6d150 2024-04-25T09:05:54.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f9796a00640 1 --2- 172.21.15.175:0/3770673686 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x55e5ced6d150 0x55e5cedbc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f9796a00640 1 --2- 172.21.15.175:0/3770673686 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x55e5ced6d150 0x55e5cedbc410 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7f68d9017b909a3 server_cookie=d07d35425675d312 in_seq=0 out_seq=0 2024-04-25T09:05:54.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f9784c00640 10 client.5709 ms_handle_connect on v2:172.21.15.175:6834/1389262120 2024-04-25T09:05:54.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f9784c00640 1 -- 172.21.15.175:0/3770673686 <== mds.0 v2:172.21.15.175:6834/1389262120 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e5ceb4ad60 con 0x55e5ced6d150 2024-04-25T09:05:54.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f9784c00640 10 client.5709 handle_command_reply: tid=0 2024-04-25T09:05:54.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 1 client.5709 shutdown 2024-04-25T09:05:54.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 1 -- 172.21.15.175:0/3770673686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedab5b0 msgr2=0x55e5ced6c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 1 --2- 172.21.15.175:0/3770673686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedab5b0 0x55e5ced6c8b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f97900b0040 tx=0x7f979001b1b0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 1 -- 172.21.15.175:0/3770673686 shutdown_connections 2024-04-25T09:05:54.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 1 --2- 172.21.15.175:0/3770673686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedab5b0 0x55e5ced6c8b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 1 --2- 172.21.15.175:0/3770673686 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x55e5ced6d150 0x55e5cedbc410 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 1 --2- 172.21.15.175:0/3770673686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedaac90 0x55e5ced6c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 1 --2- 172.21.15.175:0/3770673686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5ced61290 0x55e5ced6be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f9784c00640 0 client.5709 ms_handle_reset on v2:172.21.15.175:6834/1389262120 2024-04-25T09:05:54.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 1 -- 172.21.15.175:0/3770673686 >> 172.21.15.175:0/3770673686 conn(0x55e5ced5d240 msgr2=0x55e5ced5fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 1 -- 172.21.15.175:0/3770673686 shutdown_connections 2024-04-25T09:05:54.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 1 -- 172.21.15.175:0/3770673686 wait complete. 2024-04-25T09:05:54.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.137+0000 7f97a13b1000 20 client.5709 trim_cache size 0 max 16384 2024-04-25T09:05:54.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.141+0000 7fb224000640 1 Processor -- start 2024-04-25T09:05:54.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.141+0000 7fb224000640 1 -- start start 2024-04-25T09:05:54.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.141+0000 7fb224000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb21c142930 0x7fb21c142de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.141+0000 7fb224000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb21c0732b0 con 0x7fb21c1454e0 2024-04-25T09:05:54.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.141+0000 7fb224000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb21c143320 con 0x7fb21c142290 2024-04-25T09:05:54.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.141+0000 7fb224000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c1605d0 con 0x7fb21c142930 2024-04-25T09:05:54.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.141+0000 7fb220c00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb21c1454e0 0x7fb21c072ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:39044/0 (socket says 172.21.15.175:39044) 2024-04-25T09:05:54.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.141+0000 7fb220c00640 1 -- 172.21.15.175:0/2123527104 learned_addr learned my addr 172.21.15.175:0/2123527104 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:05:54.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.141+0000 7fb222000640 1 --2- 172.21.15.175:0/2123527104 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb21c142930 0x7fb21c142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.141+0000 7fb21be00640 1 -- 172.21.15.175:0/2123527104 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867252039 0 0) 0x7fb21c0732b0 con 0x7fb21c1454e0 2024-04-25T09:05:54.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.141+0000 7fb21be00640 1 -- 172.21.15.175:0/2123527104 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb204003530 con 0x7fb21c1454e0 2024-04-25T09:05:54.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.141+0000 7fb222000640 1 -- 172.21.15.175:0/2123527104 >> v1:172.21.15.177:6789/0 conn(0x7fb21c142290 legacy=0x7fb21c15f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.141+0000 7fb21be00640 1 -- 172.21.15.175:0/2123527104 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1141647864 0 0) 0x7fb21c143320 con 0x7fb21c142290 2024-04-25T09:05:54.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.141+0000 7fb222000640 1 -- 172.21.15.175:0/2123527104 >> v1:172.21.15.175:6789/0 conn(0x7fb21c1454e0 legacy=0x7fb21c072ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.141+0000 7fb222000640 1 -- 172.21.15.175:0/2123527104 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c160010 con 0x7fb21c142930 2024-04-25T09:05:54.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.145+0000 7fb222000640 1 --2- 172.21.15.175:0/2123527104 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb21c142930 0x7fb21c142de0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb214009dc0 tx=0x7fb21401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eff47ab6777aa486 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.145+0000 7fb21be00640 1 -- 172.21.15.175:0/2123527104 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2140b2070 con 0x7fb21c142930 2024-04-25T09:05:54.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.145+0000 7fb21be00640 1 -- 172.21.15.175:0/2123527104 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2140a5850 con 0x7fb21c142930 2024-04-25T09:05:54.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.145+0000 7fb21be00640 1 -- 172.21.15.175:0/2123527104 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2140a5c20 con 0x7fb21c142930 2024-04-25T09:05:54.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.145+0000 7fb224000640 1 -- 172.21.15.175:0/2123527104 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb21c142930 msgr2=0x7fb21c142de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.145+0000 7fb224000640 1 --2- 172.21.15.175:0/2123527104 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb21c142930 0x7fb21c142de0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb214009dc0 tx=0x7fb21401c990 comp rx=0 tx=0).stop 2024-04-25T09:05:54.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.145+0000 7fb224000640 1 -- 172.21.15.175:0/2123527104 shutdown_connections 2024-04-25T09:05:54.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.145+0000 7fb224000640 1 --2- 172.21.15.175:0/2123527104 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb21c142930 0x7fb21c142de0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.145+0000 7fb224000640 1 -- 172.21.15.175:0/2123527104 >> 172.21.15.175:0/2123527104 conn(0x7fb21c06e300 msgr2=0x7fb21c06e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.145+0000 7fb224000640 1 -- 172.21.15.175:0/2123527104 shutdown_connections 2024-04-25T09:05:54.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.145+0000 7fb224000640 1 -- 172.21.15.175:0/2123527104 wait complete. 2024-04-25T09:05:54.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb224000640 1 Processor -- start 2024-04-25T09:05:54.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb224000640 1 -- start start 2024-04-25T09:05:54.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb224000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb21c142290 0x7fb21c13e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb224000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb21c142930 0x7fb21c0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb224000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb21c1454e0 0x7fb21c0b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb224000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c0d0280 con 0x7fb21c1454e0 2024-04-25T09:05:54.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb224000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c072680 con 0x7fb21c142930 2024-04-25T09:05:54.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb224000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c0d0400 con 0x7fb21c142290 2024-04-25T09:05:54.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb222000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb21c1454e0 0x7fb21c0b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb222000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb21c1454e0 0x7fb21c0b1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53536/0 (socket says 172.21.15.175:53536) 2024-04-25T09:05:54.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb222000640 1 -- 172.21.15.175:0/2306770888 learned_addr learned my addr 172.21.15.175:0/2306770888 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:54.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb220c00640 1 --2- 172.21.15.175:0/2306770888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb21c142930 0x7fb21c0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb221600640 1 --2- 172.21.15.175:0/2306770888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb21c142290 0x7fb21c13e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb222000640 1 -- 172.21.15.175:0/2306770888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb21c142290 msgr2=0x7fb21c13e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb222000640 1 --2- 172.21.15.175:0/2306770888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb21c142290 0x7fb21c13e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb222000640 1 -- 172.21.15.175:0/2306770888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb21c142930 msgr2=0x7fb21c0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb222000640 1 --2- 172.21.15.175:0/2306770888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb21c142930 0x7fb21c0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb222000640 1 -- 172.21.15.175:0/2306770888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c0ce990 con 0x7fb21c1454e0 2024-04-25T09:05:54.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.149+0000 7fb222000640 1 --2- 172.21.15.175:0/2306770888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb21c1454e0 0x7fb21c0b1c50 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb2140b0040 tx=0x7fb214019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.153+0000 7fb219600640 1 -- 172.21.15.175:0/2306770888 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2140b2040 con 0x7fb21c1454e0 2024-04-25T09:05:54.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.153+0000 7fb219600640 1 -- 172.21.15.175:0/2306770888 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2140039a0 con 0x7fb21c1454e0 2024-04-25T09:05:54.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.153+0000 7fb219600640 1 -- 172.21.15.175:0/2306770888 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214003db0 con 0x7fb21c1454e0 2024-04-25T09:05:54.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.153+0000 7fb224000640 1 -- 172.21.15.175:0/2306770888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21c166be0 con 0x7fb21c1454e0 2024-04-25T09:05:54.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.153+0000 7fb224000640 1 -- 172.21.15.175:0/2306770888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21c158e40 con 0x7fb21c1454e0 2024-04-25T09:05:54.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.153+0000 7fb224000640 1 -- 172.21.15.175:0/2306770888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fb21c074a60 con 0x7fb21c1454e0 2024-04-25T09:05:54.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.153+0000 7fb219600640 1 -- 172.21.15.175:0/2306770888 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb2140c2060 con 0x7fb21c1454e0 2024-04-25T09:05:54.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.153+0000 7fb219600640 1 --2- 172.21.15.175:0/2306770888 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb1fc066f60 0x7fb1fc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.153+0000 7fb219600640 1 -- 172.21.15.175:0/2306770888 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb21411ef60 con 0x7fb21c1454e0 2024-04-25T09:05:54.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.153+0000 7fb221600640 1 --2- 172.21.15.175:0/2306770888 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb1fc066f60 0x7fb1fc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.153+0000 7fb219600640 1 -- 172.21.15.175:0/2306770888 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+503 (secure 0 0 0) 0x7fb21c166be0 con 0x7fb21c1454e0 2024-04-25T09:05:54.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.153+0000 7fb224000640 1 -- 172.21.15.175:0/2306770888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fb21c142f80 con 0x7fb21c1454e0 2024-04-25T09:05:54.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.153+0000 7f97a13b1000 1 Processor -- start 2024-04-25T09:05:54.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.153+0000 7f97a13b1000 1 -- start start 2024-04-25T09:05:54.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.153+0000 7fb221600640 1 --2- 172.21.15.175:0/2306770888 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb1fc066f60 0x7fb1fc069420 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb210000f70 tx=0x7fb210009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f97a13b1000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5ced61290 0x55e5ced60640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f97a13b1000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedaac90 0x55e5ced60b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f97a13b1000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedab5b0 0x55e5cedbc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f97a13b1000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97982010f0 con 0x55e5cedaac90 2024-04-25T09:05:54.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f97a13b1000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97982002c0 con 0x55e5cedab5b0 2024-04-25T09:05:54.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f97a13b1000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97980b5050 con 0x55e5ced61290 2024-04-25T09:05:54.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f978e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedaac90 0x55e5ced60b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f978e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedaac90 0x55e5ced60b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53550/0 (socket says 172.21.15.175:53550) 2024-04-25T09:05:54.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f978e000640 1 -- 172.21.15.175:0/815919805 learned_addr learned my addr 172.21.15.175:0/815919805 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:54.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f9796a00640 1 --2- 172.21.15.175:0/815919805 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5ced61290 0x55e5ced60640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f9797400640 1 --2- 172.21.15.175:0/815919805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedab5b0 0x55e5cedbc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f978e000640 1 -- 172.21.15.175:0/815919805 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5ced61290 msgr2=0x55e5ced60640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f978e000640 1 --2- 172.21.15.175:0/815919805 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5ced61290 0x55e5ced60640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f978e000640 1 -- 172.21.15.175:0/815919805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedab5b0 msgr2=0x55e5cedbc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f978e000640 1 --2- 172.21.15.175:0/815919805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedab5b0 0x55e5cedbc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f978e000640 1 -- 172.21.15.175:0/815919805 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5cec06c50 con 0x55e5cedaac90 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f978e000640 1 --2- 172.21.15.175:0/815919805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedaac90 0x55e5ced60b80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9780082990 tx=0x7f9780084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3cff8c6c66f38b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f9787400640 1 -- 172.21.15.175:0/815919805 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978005b0b0 con 0x55e5cedaac90 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f9787400640 1 -- 172.21.15.175:0/815919805 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97800513e0 con 0x55e5cedaac90 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f9787400640 1 -- 172.21.15.175:0/815919805 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978005cff0 con 0x55e5cedaac90 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f97a13b1000 1 -- 172.21.15.175:0/815919805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedaac90 msgr2=0x55e5ced60b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f97a13b1000 1 --2- 172.21.15.175:0/815919805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedaac90 0x55e5ced60b80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9780082990 tx=0x7f9780084040 comp rx=0 tx=0).stop 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f97a13b1000 1 -- 172.21.15.175:0/815919805 shutdown_connections 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f97a13b1000 1 --2- 172.21.15.175:0/815919805 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedab5b0 0x55e5cedbc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f97a13b1000 1 --2- 172.21.15.175:0/815919805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5cedaac90 0x55e5ced60b80 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f97a13b1000 1 --2- 172.21.15.175:0/815919805 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5ced61290 0x55e5ced60640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f97a13b1000 1 -- 172.21.15.175:0/815919805 >> 172.21.15.175:0/815919805 conn(0x55e5ced5d240 msgr2=0x55e5ced663b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f97a13b1000 1 -- 172.21.15.175:0/815919805 shutdown_connections 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f97a13b1000 1 -- 172.21.15.175:0/815919805 wait complete. 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f97a13b1000 1 -- start start 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.157+0000 7f97a13b1000 1 Processor -- start 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5ced61290 0x55e5cee0b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5cedaac90 0x55e5cee0b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedab5b0 0x55e5cedc6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ced6a200 con 0x55e5ced61290 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9798151890 con 0x55e5cedab5b0 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5cec65f20 con 0x55e5cedaac90 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 10 client.0 _ll_register_callbacks cb 0x7f97880096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9796a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5ced61290 0x55e5cee0b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9796a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5ced61290 0x55e5cee0b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53564/0 (socket says 172.21.15.175:53564) 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9796a00640 1 -- 172.21.15.175:0/2833528431 learned_addr learned my addr 172.21.15.175:0/2833528431 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:54.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f978e000640 1 --2- 172.21.15.175:0/2833528431 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5cedaac90 0x55e5cee0b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9797400640 1 --2- 172.21.15.175:0/2833528431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedab5b0 0x55e5cedc6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9796a00640 1 -- 172.21.15.175:0/2833528431 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5cedaac90 msgr2=0x55e5cee0b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9796a00640 1 --2- 172.21.15.175:0/2833528431 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5cedaac90 0x55e5cee0b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9796a00640 1 -- 172.21.15.175:0/2833528431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedab5b0 msgr2=0x55e5cedc6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9796a00640 1 --2- 172.21.15.175:0/2833528431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedab5b0 0x55e5cedc6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9796a00640 1 -- 172.21.15.175:0/2833528431 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5ceb77120 con 0x55e5ced61290 2024-04-25T09:05:54.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9797400640 1 --2- 172.21.15.175:0/2833528431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedab5b0 0x55e5cedc6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:54.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9796a00640 1 --2- 172.21.15.175:0/2833528431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5ced61290 0x55e5cee0b440 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9788008010 tx=0x7f9788004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61150a7e54752e3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9784c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:05:54.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9784c00640 1 -- 172.21.15.175:0/2833528431 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788038030 con 0x55e5ced61290 2024-04-25T09:05:54.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9784c00640 1 -- 172.21.15.175:0/2833528431 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9788033050 con 0x55e5ced61290 2024-04-25T09:05:54.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 -- 172.21.15.175:0/2833528431 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f97800513e0 con 0x55e5ced61290 2024-04-25T09:05:54.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9784c00640 1 -- 172.21.15.175:0/2833528431 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9788044050 con 0x55e5ced61290 2024-04-25T09:05:54.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 10 client.5721 fetch_fsmap learned FSMap version 25 2024-04-25T09:05:54.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 -- 172.21.15.175:0/2833528431 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55e5ceb56170 con 0x55e5ced61290 2024-04-25T09:05:54.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9784c00640 1 -- 172.21.15.175:0/2833528431 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97800513e0 con 0x55e5ced61290 2024-04-25T09:05:54.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9784c00640 1 -- 172.21.15.175:0/2833528431 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9788047020 con 0x55e5ced61290 2024-04-25T09:05:54.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 10 client.5721 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T09:05:54.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 10 client.5721 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-25T09:05:54.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 20 client.5721 populate_metadata read hostname 'smithi175' 2024-04-25T09:05:54.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 --2- 172.21.15.175:0/2833528431 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x55e5cedc7ad0 0x55e5cedc7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 4 client.5721 mds_command: new command op to 5535 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-25T09:05:54.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 -- 172.21.15.175:0/2833528431 --> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x55e5cebbc5b0 con 0x55e5cedc7ad0 2024-04-25T09:05:54.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f978e000640 1 --2- 172.21.15.175:0/2833528431 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x55e5cedc7ad0 0x55e5cedc7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f978e000640 1 --2- 172.21.15.175:0/2833528431 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x55e5cedc7ad0 0x55e5cedc7ee0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc69d676df5a55fa server_cookie=1d93c81d2c1f5105 in_seq=0 out_seq=0 2024-04-25T09:05:54.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9784c00640 10 client.5721 ms_handle_connect on v2:172.21.15.175:6834/1389262120 2024-04-25T09:05:54.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9784c00640 1 -- 172.21.15.175:0/2833528431 <== mds.0 v2:172.21.15.175:6834/1389262120 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e5cebbc5b0 con 0x55e5cedc7ad0 2024-04-25T09:05:54.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9784c00640 10 client.5721 handle_command_reply: tid=0 2024-04-25T09:05:54.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 client.5721 shutdown 2024-04-25T09:05:54.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 -- 172.21.15.175:0/2833528431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5ced61290 msgr2=0x55e5cee0b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 --2- 172.21.15.175:0/2833528431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5ced61290 0x55e5cee0b440 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9788008010 tx=0x7f9788004740 comp rx=0 tx=0).stop 2024-04-25T09:05:54.168 INFO:tasks.ceph.mds.c.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f8005c00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5679=0-4194304@1} caps={5679=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5679 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x558fd4436100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:05:54.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 -- 172.21.15.175:0/2833528431 shutdown_connections 2024-04-25T09:05:54.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 --2- 172.21.15.175:0/2833528431 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x55e5cedc7ad0 0x55e5cedc7ee0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 --2- 172.21.15.175:0/2833528431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e5cedab5b0 0x55e5cedc6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 --2- 172.21.15.175:0/2833528431 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e5cedaac90 0x55e5cee0b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 --2- 172.21.15.175:0/2833528431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e5ced61290 0x55e5cee0b440 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f97a13b1000 1 -- 172.21.15.175:0/2833528431 >> 172.21.15.175:0/2833528431 conn(0x55e5ced5d240 msgr2=0x55e5ced5f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.161+0000 7f9784c00640 0 client.5721 ms_handle_reset on v2:172.21.15.175:6834/1389262120 2024-04-25T09:05:54.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.165+0000 7f97a13b1000 1 -- 172.21.15.175:0/2833528431 shutdown_connections 2024-04-25T09:05:54.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.165+0000 7f97a13b1000 1 -- 172.21.15.175:0/2833528431 wait complete. 2024-04-25T09:05:54.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.165+0000 7f97a13b1000 20 client.5721 trim_cache size 0 max 16384 2024-04-25T09:05:54.170 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:05:54.170 INFO:teuthology.orchestra.run.smithi175.stdout: "return_code": 0, 2024-04-25T09:05:54.170 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_tag": "69a9c21e-88e9-47e4-99c6-2b06504a7395", 2024-04-25T09:05:54.170 INFO:teuthology.orchestra.run.smithi175.stdout: "mode": "asynchronous" 2024-04-25T09:05:54.170 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:05:54.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.165+0000 7f979de00640 1 -- 172.21.15.175:0/2021611961 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9774066f60 msgr2=0x7f9774069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.165+0000 7f979de00640 1 --2- 172.21.15.175:0/2021611961 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9774066f60 0x7f9774069420 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9788009a40 tx=0x7f9788008040 comp rx=0 tx=0).stop 2024-04-25T09:05:54.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.165+0000 7f979de00640 1 -- 172.21.15.175:0/2021611961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f979815c1f0 msgr2=0x7f979815afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.165+0000 7f979de00640 1 --2- 172.21.15.175:0/2021611961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f979815c1f0 0x7f979815afa0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f978000c480 tx=0x7f978000c940 comp rx=0 tx=0).stop 2024-04-25T09:05:54.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.165+0000 7f979de00640 1 -- 172.21.15.175:0/2021611961 shutdown_connections 2024-04-25T09:05:54.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.165+0000 7f979de00640 1 --2- 172.21.15.175:0/2021611961 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9774066f60 0x7f9774069420 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.165+0000 7f979de00640 1 --2- 172.21.15.175:0/2021611961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f979815fb90 0x7f9798153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.165+0000 7f979de00640 1 --2- 172.21.15.175:0/2021611961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f979815c1f0 0x7f979815afa0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.165+0000 7f979de00640 1 --2- 172.21.15.175:0/2021611961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f979815b700 0x7f9798150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.165+0000 7f979de00640 1 -- 172.21.15.175:0/2021611961 >> 172.21.15.175:0/2021611961 conn(0x7f97980d1880 msgr2=0x7f9798157d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.165+0000 7f979de00640 1 -- 172.21.15.175:0/2021611961 shutdown_connections 2024-04-25T09:05:54.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.165+0000 7f979de00640 1 -- 172.21.15.175:0/2021611961 wait complete. 2024-04-25T09:05:54.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:54.173 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T09:05:54.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.321+0000 7f24b3000640 1 Processor -- start 2024-04-25T09:05:54.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.321+0000 7f24b3000640 1 -- start start 2024-04-25T09:05:54.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.321+0000 7f24b3000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24ac145250 0x7f24ac0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.321+0000 7f24b3000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f24ac1600a0 0x7f24ac0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.321+0000 7f24b3000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f24ac0ce970 0x7f24ac0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.321+0000 7f24b3000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ac15f650 con 0x7f24ac1600a0 2024-04-25T09:05:54.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.321+0000 7f24b3000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ac0cfd10 con 0x7f24ac0ce970 2024-04-25T09:05:54.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.321+0000 7f24b3000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac0cfff0 con 0x7f24ac145250 2024-04-25T09:05:54.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.321+0000 7f24a3400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f24ac1600a0 0x7f24ac0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.321+0000 7f24a3400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f24ac1600a0 0x7f24ac0cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53576/0 (socket says 172.21.15.175:53576) 2024-04-25T09:05:54.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.321+0000 7f24a3400640 1 -- 172.21.15.175:0/3829767868 learned_addr learned my addr 172.21.15.175:0/3829767868 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:54.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.321+0000 7f24abe00640 1 --2- 172.21.15.175:0/3829767868 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24ac145250 0x7f24ac0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.321+0000 7f24b1000640 1 --2- 172.21.15.175:0/3829767868 >> v2:172.21.15.177:3300/0 conn(0x7f24ac0ce970 0x7f24ac0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.321+0000 7f24a3400640 1 -- 172.21.15.175:0/3829767868 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24ac145250 msgr2=0x7f24ac0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.321+0000 7f24a3400640 1 --2- 172.21.15.175:0/3829767868 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24ac145250 0x7f24ac0cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.321+0000 7f24a3400640 1 -- 172.21.15.175:0/3829767868 >> v2:172.21.15.177:3300/0 conn(0x7f24ac0ce970 msgr2=0x7f24ac0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.321+0000 7f24a3400640 1 --2- 172.21.15.175:0/3829767868 >> v2:172.21.15.177:3300/0 conn(0x7f24ac0ce970 0x7f24ac0cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.321+0000 7f24a3400640 1 -- 172.21.15.175:0/3829767868 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac15f8a0 con 0x7f24ac1600a0 2024-04-25T09:05:54.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.325+0000 7f24a3400640 1 --2- 172.21.15.175:0/3829767868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24ac1600a0 0x7f24ac0cc410 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f24ac071260 tx=0x7f249401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9897f713df95af0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.325+0000 7f24ab400640 1 -- 172.21.15.175:0/3829767868 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940aa430 con 0x7f24ac1600a0 2024-04-25T09:05:54.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.325+0000 7f24ab400640 1 -- 172.21.15.175:0/3829767868 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24940af070 con 0x7f24ac1600a0 2024-04-25T09:05:54.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.325+0000 7f24ab400640 1 -- 172.21.15.175:0/3829767868 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940aa7f0 con 0x7f24ac1600a0 2024-04-25T09:05:54.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.325+0000 7f24b3000640 1 -- 172.21.15.175:0/3829767868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24ac1600a0 msgr2=0x7f24ac0cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.325+0000 7f24b3000640 1 --2- 172.21.15.175:0/3829767868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24ac1600a0 0x7f24ac0cc410 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f24ac071260 tx=0x7f249401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.325+0000 7f24b3000640 1 -- 172.21.15.175:0/3829767868 shutdown_connections 2024-04-25T09:05:54.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.325+0000 7f24b3000640 1 --2- 172.21.15.175:0/3829767868 >> v2:172.21.15.177:3300/0 conn(0x7f24ac0ce970 0x7f24ac0cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.325+0000 7f24b3000640 1 --2- 172.21.15.175:0/3829767868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24ac1600a0 0x7f24ac0cc410 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.325+0000 7f24b3000640 1 --2- 172.21.15.175:0/3829767868 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24ac145250 0x7f24ac0cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.325+0000 7f24b3000640 1 -- 172.21.15.175:0/3829767868 >> 172.21.15.175:0/3829767868 conn(0x7f24ac06ac50 msgr2=0x7f24ac06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.325+0000 7f24b3000640 1 -- 172.21.15.175:0/3829767868 shutdown_connections 2024-04-25T09:05:54.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.325+0000 7f24b3000640 1 -- 172.21.15.175:0/3829767868 wait complete. 2024-04-25T09:05:54.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24b3000640 1 Processor -- start 2024-04-25T09:05:54.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24b3000640 1 -- start start 2024-04-25T09:05:54.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24b3000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24ac0ce970 0x7f24ac0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24b3000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24ac145250 0x7f24ac1f5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24b3000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24ac1600a0 0x7f24ac12b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24b3000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac145630 con 0x7f24ac145250 2024-04-25T09:05:54.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24b3000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac160500 con 0x7f24ac0ce970 2024-04-25T09:05:54.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24b3000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac15c870 con 0x7f24ac1600a0 2024-04-25T09:05:54.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24a3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24ac145250 0x7f24ac1f5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24a3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24ac145250 0x7f24ac1f5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53584/0 (socket says 172.21.15.175:53584) 2024-04-25T09:05:54.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24a3400640 1 -- 172.21.15.175:0/3265607385 learned_addr learned my addr 172.21.15.175:0/3265607385 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:54.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24b1000640 1 --2- 172.21.15.175:0/3265607385 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24ac1600a0 0x7f24ac12b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24abe00640 1 --2- 172.21.15.175:0/3265607385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24ac0ce970 0x7f24ac0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24a3400640 1 -- 172.21.15.175:0/3265607385 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24ac1600a0 msgr2=0x7f24ac12b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24a3400640 1 --2- 172.21.15.175:0/3265607385 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24ac1600a0 0x7f24ac12b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24a3400640 1 -- 172.21.15.175:0/3265607385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24ac0ce970 msgr2=0x7f24ac0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24a3400640 1 --2- 172.21.15.175:0/3265607385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24ac0ce970 0x7f24ac0b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24a3400640 1 -- 172.21.15.175:0/3265607385 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac0b3310 con 0x7f24ac145250 2024-04-25T09:05:54.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24b1000640 1 --2- 172.21.15.175:0/3265607385 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24ac1600a0 0x7f24ac12b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:54.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24a3400640 1 --2- 172.21.15.175:0/3265607385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24ac145250 0x7f24ac1f5b00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f24940ac040 tx=0x7f2494019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24a8c00640 1 -- 172.21.15.175:0/3265607385 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940be610 con 0x7f24ac145250 2024-04-25T09:05:54.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24a8c00640 1 -- 172.21.15.175:0/3265607385 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24940be7d0 con 0x7f24ac145250 2024-04-25T09:05:54.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24a8c00640 1 -- 172.21.15.175:0/3265607385 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940bebc0 con 0x7f24ac145250 2024-04-25T09:05:54.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24b3000640 1 -- 172.21.15.175:0/3265607385 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ac143d80 con 0x7f24ac145250 2024-04-25T09:05:54.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.329+0000 7f24b3000640 1 -- 172.21.15.175:0/3265607385 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ac131b10 con 0x7f24ac145250 2024-04-25T09:05:54.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.333+0000 7f24a8c00640 1 -- 172.21.15.175:0/3265607385 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f24940bc020 con 0x7f24ac145250 2024-04-25T09:05:54.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.333+0000 7f24a8c00640 1 --2- 172.21.15.175:0/3265607385 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2488066f60 0x7f2488069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.333+0000 7f24a8c00640 1 -- 172.21.15.175:0/3265607385 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f249411f2a0 con 0x7f24ac145250 2024-04-25T09:05:54.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.333+0000 7f24abe00640 1 --2- 172.21.15.175:0/3265607385 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2488066f60 0x7f2488069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.333+0000 7f24b649e000 1 Processor -- start 2024-04-25T09:05:54.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.333+0000 7f24b649e000 1 -- start start 2024-04-25T09:05:54.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.333+0000 7f24abe00640 1 --2- 172.21.15.175:0/3265607385 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2488066f60 0x7f2488069420 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f249c00b9d0 tx=0x7f249c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.333+0000 7f24b649e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4ce9d0 0x563a7c4cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.333+0000 7f24b649e000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4cf2f0 0x563a7c484b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.333+0000 7f24b649e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4850a0 0x563a7c485480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.333+0000 7f24b649e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a7c2d1ff0 con 0x563a7c4850a0 2024-04-25T09:05:54.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.333+0000 7f24b649e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a7c25a150 con 0x563a7c4ce9d0 2024-04-25T09:05:54.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.333+0000 7f24b649e000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a7c2ce090 con 0x563a7c4cf2f0 2024-04-25T09:05:54.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.333+0000 7f24b1000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4850a0 0x563a7c485480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.333+0000 7f24b1000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4850a0 0x563a7c485480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53598/0 (socket says 172.21.15.175:53598) 2024-04-25T09:05:54.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.333+0000 7f24b1000640 1 -- 172.21.15.175:0/925414545 learned_addr learned my addr 172.21.15.175:0/925414545 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:54.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.333+0000 7f24abe00640 1 --2- 172.21.15.175:0/925414545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4ce9d0 0x563a7c4cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.333+0000 7f24a3400640 1 --2- 172.21.15.175:0/925414545 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4cf2f0 0x563a7c484b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b1000640 1 -- 172.21.15.175:0/925414545 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4cf2f0 msgr2=0x563a7c484b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b1000640 1 --2- 172.21.15.175:0/925414545 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4cf2f0 0x563a7c484b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b1000640 1 -- 172.21.15.175:0/925414545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4ce9d0 msgr2=0x563a7c4cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b1000640 1 --2- 172.21.15.175:0/925414545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4ce9d0 0x563a7c4cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b1000640 1 -- 172.21.15.175:0/925414545 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a7c4680d0 con 0x563a7c4850a0 2024-04-25T09:05:54.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24a3400640 1 --2- 172.21.15.175:0/925414545 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4cf2f0 0x563a7c484b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:54.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b1000640 1 --2- 172.21.15.175:0/925414545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4850a0 0x563a7c485480 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f24a4007430 tx=0x7f24a40078f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d73473c80c6ecd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24a0c00640 1 -- 172.21.15.175:0/925414545 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a40147e0 con 0x563a7c4850a0 2024-04-25T09:05:54.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24a0c00640 1 -- 172.21.15.175:0/925414545 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a401a070 con 0x563a7c4850a0 2024-04-25T09:05:54.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24a0c00640 1 -- 172.21.15.175:0/925414545 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4014b80 con 0x563a7c4850a0 2024-04-25T09:05:54.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b649e000 1 -- 172.21.15.175:0/925414545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4850a0 msgr2=0x563a7c485480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b649e000 1 --2- 172.21.15.175:0/925414545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4850a0 0x563a7c485480 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f24a4007430 tx=0x7f24a40078f0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b649e000 1 -- 172.21.15.175:0/925414545 shutdown_connections 2024-04-25T09:05:54.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b649e000 1 --2- 172.21.15.175:0/925414545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4850a0 0x563a7c485480 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b649e000 1 --2- 172.21.15.175:0/925414545 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4cf2f0 0x563a7c484b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b649e000 1 --2- 172.21.15.175:0/925414545 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4ce9d0 0x563a7c4cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b649e000 1 -- 172.21.15.175:0/925414545 >> 172.21.15.175:0/925414545 conn(0x563a7c481020 msgr2=0x563a7c483440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b649e000 1 -- 172.21.15.175:0/925414545 shutdown_connections 2024-04-25T09:05:54.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b649e000 1 -- 172.21.15.175:0/925414545 wait complete. 2024-04-25T09:05:54.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b649e000 1 -- start start 2024-04-25T09:05:54.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b649e000 1 Processor -- start 2024-04-25T09:05:54.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b649e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4850a0 0x563a7c4b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b649e000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4ce9d0 0x563a7c4b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b649e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4cf2f0 0x563a7c4b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b649e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a7c296250 con 0x563a7c4cf2f0 2024-04-25T09:05:54.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b649e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a7c28c690 con 0x563a7c4850a0 2024-04-25T09:05:54.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b649e000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a7c25aa40 con 0x563a7c4ce9d0 2024-04-25T09:05:54.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b649e000 10 client.0 _ll_register_callbacks cb 0x563a7c46fe90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:54.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b1000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4cf2f0 0x563a7c4b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b1000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4cf2f0 0x563a7c4b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53602/0 (socket says 172.21.15.175:53602) 2024-04-25T09:05:54.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b1000640 1 -- 172.21.15.175:0/1466924076 learned_addr learned my addr 172.21.15.175:0/1466924076 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:54.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24abe00640 1 --2- 172.21.15.175:0/1466924076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4850a0 0x563a7c4b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24a3400640 1 --2- 172.21.15.175:0/1466924076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4ce9d0 0x563a7c4b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b1000640 1 -- 172.21.15.175:0/1466924076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4ce9d0 msgr2=0x563a7c4b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b1000640 1 --2- 172.21.15.175:0/1466924076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4ce9d0 0x563a7c4b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b1000640 1 -- 172.21.15.175:0/1466924076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4850a0 msgr2=0x563a7c4b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.337+0000 7f24b1000640 1 --2- 172.21.15.175:0/1466924076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4850a0 0x563a7c4b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b1000640 1 -- 172.21.15.175:0/1466924076 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a7c37f1c0 con 0x563a7c4cf2f0 2024-04-25T09:05:54.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b1000640 1 --2- 172.21.15.175:0/1466924076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4cf2f0 0x563a7c4b4270 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f24a4017040 tx=0x7f24a4004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42644a4202fe87c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f2499600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:05:54.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f2499600640 1 -- 172.21.15.175:0/1466924076 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4009b50 con 0x563a7c4cf2f0 2024-04-25T09:05:54.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f2499600640 1 -- 172.21.15.175:0/1466924076 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f24a4015880 con 0x563a7c4cf2f0 2024-04-25T09:05:54.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 1 -- 172.21.15.175:0/1466924076 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f24a401a070 con 0x563a7c4cf2f0 2024-04-25T09:05:54.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f2499600640 1 -- 172.21.15.175:0/1466924076 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24a4032050 con 0x563a7c4cf2f0 2024-04-25T09:05:54.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 10 client.5733 fetch_fsmap learned FSMap version 25 2024-04-25T09:05:54.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 1 -- 172.21.15.175:0/1466924076 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x563a7c37b170 con 0x563a7c4cf2f0 2024-04-25T09:05:54.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f2499600640 1 -- 172.21.15.175:0/1466924076 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a401a070 con 0x563a7c4cf2f0 2024-04-25T09:05:54.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f2499600640 1 -- 172.21.15.175:0/1466924076 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f24a4035020 con 0x563a7c4cf2f0 2024-04-25T09:05:54.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 10 client.5733 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T09:05:54.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 10 client.5733 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-25T09:05:54.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 20 client.5733 populate_metadata read hostname 'smithi175' 2024-04-25T09:05:54.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 1 --2- 172.21.15.175:0/1466924076 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x563a7c4dec80 0x563a7c4e1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 4 client.5733 mds_command: new command op to 5535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:54.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 1 -- 172.21.15.175:0/1466924076 --> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563a7c26dc60 con 0x563a7c4dec80 2024-04-25T09:05:54.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24abe00640 1 --2- 172.21.15.175:0/1466924076 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x563a7c4dec80 0x563a7c4e1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24abe00640 1 --2- 172.21.15.175:0/1466924076 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x563a7c4dec80 0x563a7c4e1070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf7424b9e661310d server_cookie=8410bd3abdcfd0 in_seq=0 out_seq=0 2024-04-25T09:05:54.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f2499600640 10 client.5733 ms_handle_connect on v2:172.21.15.175:6834/1389262120 2024-04-25T09:05:54.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f2499600640 1 -- 172.21.15.175:0/1466924076 <== mds.0 v2:172.21.15.175:6834/1389262120 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563a7c26dc60 con 0x563a7c4dec80 2024-04-25T09:05:54.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f2499600640 10 client.5733 handle_command_reply: tid=0 2024-04-25T09:05:54.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 1 client.5733 shutdown 2024-04-25T09:05:54.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 1 -- 172.21.15.175:0/1466924076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4cf2f0 msgr2=0x563a7c4b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 1 --2- 172.21.15.175:0/1466924076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4cf2f0 0x563a7c4b4270 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f24a4017040 tx=0x7f24a4004ac0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 1 -- 172.21.15.175:0/1466924076 shutdown_connections 2024-04-25T09:05:54.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 1 --2- 172.21.15.175:0/1466924076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4cf2f0 0x563a7c4b4270 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 1 --2- 172.21.15.175:0/1466924076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4ce9d0 0x563a7c4b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 1 --2- 172.21.15.175:0/1466924076 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x563a7c4dec80 0x563a7c4e1070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 1 --2- 172.21.15.175:0/1466924076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4850a0 0x563a7c4b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 1 -- 172.21.15.175:0/1466924076 >> 172.21.15.175:0/1466924076 conn(0x563a7c481020 msgr2=0x563a7c483ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f2499600640 0 client.5733 ms_handle_reset on v2:172.21.15.175:6834/1389262120 2024-04-25T09:05:54.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 1 -- 172.21.15.175:0/1466924076 shutdown_connections 2024-04-25T09:05:54.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 1 -- 172.21.15.175:0/1466924076 wait complete. 2024-04-25T09:05:54.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.341+0000 7f24b649e000 20 client.5733 trim_cache size 0 max 16384 2024-04-25T09:05:54.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24b649e000 1 Processor -- start 2024-04-25T09:05:54.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24b649e000 1 -- start start 2024-04-25T09:05:54.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24b649e000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4850a0 0x563a7c4cde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24b649e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4ce9d0 0x563a7c484420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24b649e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4cf2f0 0x563a7c484960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24b649e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac12e710 con 0x563a7c4cf2f0 2024-04-25T09:05:54.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24b649e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac12d8f0 con 0x563a7c4ce9d0 2024-04-25T09:05:54.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24b649e000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac1f9d70 con 0x563a7c4850a0 2024-04-25T09:05:54.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24b1000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4cf2f0 0x563a7c484960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24b1000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4cf2f0 0x563a7c484960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53614/0 (socket says 172.21.15.175:53614) 2024-04-25T09:05:54.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24b1000640 1 -- 172.21.15.175:0/3372452912 learned_addr learned my addr 172.21.15.175:0/3372452912 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:54.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24a3400640 1 --2- 172.21.15.175:0/3372452912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4ce9d0 0x563a7c484420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24abe00640 1 --2- 172.21.15.175:0/3372452912 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4850a0 0x563a7c4cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24b1000640 1 -- 172.21.15.175:0/3372452912 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4850a0 msgr2=0x563a7c4cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24b1000640 1 --2- 172.21.15.175:0/3372452912 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4850a0 0x563a7c4cde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24b1000640 1 -- 172.21.15.175:0/3372452912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4ce9d0 msgr2=0x563a7c484420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24b1000640 1 --2- 172.21.15.175:0/3372452912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4ce9d0 0x563a7c484420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24b1000640 1 -- 172.21.15.175:0/3372452912 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a7c318de0 con 0x563a7c4cf2f0 2024-04-25T09:05:54.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f24b1000640 1 --2- 172.21.15.175:0/3372452912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4cf2f0 0x563a7c484960 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f24a4000f90 tx=0x7f24a4021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b96b8ae1a23f8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f249be00640 1 -- 172.21.15.175:0/3372452912 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4009b50 con 0x563a7c4cf2f0 2024-04-25T09:05:54.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f249be00640 1 -- 172.21.15.175:0/3372452912 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a401a070 con 0x563a7c4cf2f0 2024-04-25T09:05:54.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.357+0000 7f249be00640 1 -- 172.21.15.175:0/3372452912 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4015b50 con 0x563a7c4cf2f0 2024-04-25T09:05:54.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 -- 172.21.15.175:0/3372452912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4cf2f0 msgr2=0x563a7c484960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 --2- 172.21.15.175:0/3372452912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4cf2f0 0x563a7c484960 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f24a4000f90 tx=0x7f24a4021070 comp rx=0 tx=0).stop 2024-04-25T09:05:54.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 -- 172.21.15.175:0/3372452912 shutdown_connections 2024-04-25T09:05:54.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 --2- 172.21.15.175:0/3372452912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4cf2f0 0x563a7c484960 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 --2- 172.21.15.175:0/3372452912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4ce9d0 0x563a7c484420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 --2- 172.21.15.175:0/3372452912 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4850a0 0x563a7c4cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 -- 172.21.15.175:0/3372452912 >> 172.21.15.175:0/3372452912 conn(0x563a7c481020 msgr2=0x563a7c4cd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 -- 172.21.15.175:0/3372452912 shutdown_connections 2024-04-25T09:05:54.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 -- 172.21.15.175:0/3372452912 wait complete. 2024-04-25T09:05:54.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 -- start start 2024-04-25T09:05:54.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 Processor -- start 2024-04-25T09:05:54.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4850a0 0x563a7c52f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4ce9d0 0x563a7c52f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4cf2f0 0x563a7c4e1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a7c26ce00 con 0x563a7c4ce9d0 2024-04-25T09:05:54.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac1fa370 con 0x563a7c4850a0 2024-04-25T09:05:54.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a7c2d1300 con 0x563a7c4cf2f0 2024-04-25T09:05:54.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 10 client.0 _ll_register_callbacks cb 0x563a7c450040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:54.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24a3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4ce9d0 0x563a7c52f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24a3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4ce9d0 0x563a7c52f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:53622/0 (socket says 172.21.15.175:53622) 2024-04-25T09:05:54.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24a3400640 1 -- 172.21.15.175:0/350750566 learned_addr learned my addr 172.21.15.175:0/350750566 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:05:54.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24abe00640 1 --2- 172.21.15.175:0/350750566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4850a0 0x563a7c52f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b1000640 1 --2- 172.21.15.175:0/350750566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4cf2f0 0x563a7c4e1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24a3400640 1 -- 172.21.15.175:0/350750566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4cf2f0 msgr2=0x563a7c4e1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24a3400640 1 --2- 172.21.15.175:0/350750566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4cf2f0 0x563a7c4e1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24a3400640 1 -- 172.21.15.175:0/350750566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4850a0 msgr2=0x563a7c52f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24a3400640 1 --2- 172.21.15.175:0/350750566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4850a0 0x563a7c52f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24a3400640 1 -- 172.21.15.175:0/350750566 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a7c2738e0 con 0x563a7c4ce9d0 2024-04-25T09:05:54.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24abe00640 1 --2- 172.21.15.175:0/350750566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4850a0 0x563a7c52f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:54.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24a3400640 1 --2- 172.21.15.175:0/350750566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4ce9d0 0x563a7c52f850 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f249401ca60 tx=0x7f24940ef430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d9024270e40f6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f2499600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:05:54.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f2499600640 1 -- 172.21.15.175:0/350750566 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940f3c20 con 0x563a7c4ce9d0 2024-04-25T09:05:54.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f2499600640 1 -- 172.21.15.175:0/350750566 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f24940f4b40 con 0x563a7c4ce9d0 2024-04-25T09:05:54.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 -- 172.21.15.175:0/350750566 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f24a401a070 con 0x563a7c4ce9d0 2024-04-25T09:05:54.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f2499600640 1 -- 172.21.15.175:0/350750566 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24940f81e0 con 0x563a7c4ce9d0 2024-04-25T09:05:54.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 10 client.5739 fetch_fsmap learned FSMap version 25 2024-04-25T09:05:54.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 -- 172.21.15.175:0/350750566 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x563a7c32b8f0 con 0x563a7c4ce9d0 2024-04-25T09:05:54.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f2499600640 1 -- 172.21.15.175:0/350750566 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a401a070 con 0x563a7c4ce9d0 2024-04-25T09:05:54.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f2499600640 1 -- 172.21.15.175:0/350750566 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f24940a9070 con 0x563a7c4ce9d0 2024-04-25T09:05:54.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 10 client.5739 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T09:05:54.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 10 client.5739 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-25T09:05:54.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 20 client.5739 populate_metadata read hostname 'smithi175' 2024-04-25T09:05:54.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 --2- 172.21.15.175:0/350750566 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x563a7c4e1d40 0x563a7c4e2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 4 client.5739 mds_command: new command op to 5535 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:05:54.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.361+0000 7f24b649e000 1 -- 172.21.15.175:0/350750566 --> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563a7c2df530 con 0x563a7c4e1d40 2024-04-25T09:05:54.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24abe00640 1 --2- 172.21.15.175:0/350750566 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x563a7c4e1d40 0x563a7c4e2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24abe00640 1 --2- 172.21.15.175:0/350750566 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x563a7c4e1d40 0x563a7c4e2150 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67eddf46c40550ba server_cookie=3593d2ea21a96fe5 in_seq=0 out_seq=0 2024-04-25T09:05:54.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f2499600640 10 client.5739 ms_handle_connect on v2:172.21.15.175:6834/1389262120 2024-04-25T09:05:54.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f2499600640 1 -- 172.21.15.175:0/350750566 <== mds.0 v2:172.21.15.175:6834/1389262120 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x563a7c2df530 con 0x563a7c4e1d40 2024-04-25T09:05:54.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f2499600640 10 client.5739 handle_command_reply: tid=0 2024-04-25T09:05:54.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b649e000 1 client.5739 shutdown 2024-04-25T09:05:54.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b649e000 1 -- 172.21.15.175:0/350750566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4ce9d0 msgr2=0x563a7c52f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b649e000 1 --2- 172.21.15.175:0/350750566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4ce9d0 0x563a7c52f850 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f249401ca60 tx=0x7f24940ef430 comp rx=0 tx=0).stop 2024-04-25T09:05:54.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b649e000 1 -- 172.21.15.175:0/350750566 shutdown_connections 2024-04-25T09:05:54.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b649e000 1 --2- 172.21.15.175:0/350750566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563a7c4cf2f0 0x563a7c4e1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b649e000 1 --2- 172.21.15.175:0/350750566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563a7c4ce9d0 0x563a7c52f850 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b649e000 1 --2- 172.21.15.175:0/350750566 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x563a7c4e1d40 0x563a7c4e2150 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b649e000 1 --2- 172.21.15.175:0/350750566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563a7c4850a0 0x563a7c52f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f2499600640 0 client.5739 ms_handle_reset on v2:172.21.15.175:6834/1389262120 2024-04-25T09:05:54.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b649e000 1 -- 172.21.15.175:0/350750566 >> 172.21.15.175:0/350750566 conn(0x563a7c481020 msgr2=0x563a7c4cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b649e000 1 -- 172.21.15.175:0/350750566 shutdown_connections 2024-04-25T09:05:54.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b649e000 1 -- 172.21.15.175:0/350750566 wait complete. 2024-04-25T09:05:54.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b649e000 20 client.5739 trim_cache size 0 max 16384 2024-04-25T09:05:54.359 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:05:54.359 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:05:54.359 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": { 2024-04-25T09:05:54.359 INFO:teuthology.orchestra.run.smithi175.stdout: "69a9c21e-88e9-47e4-99c6-2b06504a7395": { 2024-04-25T09:05:54.359 INFO:teuthology.orchestra.run.smithi175.stdout: "path": "/", 2024-04-25T09:05:54.360 INFO:teuthology.orchestra.run.smithi175.stdout: "tag": "69a9c21e-88e9-47e4-99c6-2b06504a7395", 2024-04-25T09:05:54.360 INFO:teuthology.orchestra.run.smithi175.stdout: "options": "recursive,repair" 2024-04-25T09:05:54.360 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:54.360 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:05:54.360 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:05:54.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b3000640 1 -- 172.21.15.175:0/3265607385 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2488066f60 msgr2=0x7f2488069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b3000640 1 --2- 172.21.15.175:0/3265607385 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2488066f60 0x7f2488069420 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f249c00b9d0 tx=0x7f249c008040 comp rx=0 tx=0).stop 2024-04-25T09:05:54.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b3000640 1 -- 172.21.15.175:0/3265607385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24ac145250 msgr2=0x7f24ac1f5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b3000640 1 --2- 172.21.15.175:0/3265607385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24ac145250 0x7f24ac1f5b00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f24940ac040 tx=0x7f2494019290 comp rx=0 tx=0).stop 2024-04-25T09:05:54.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b3000640 1 -- 172.21.15.175:0/3265607385 shutdown_connections 2024-04-25T09:05:54.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b3000640 1 --2- 172.21.15.175:0/3265607385 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2488066f60 0x7f2488069420 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b3000640 1 --2- 172.21.15.175:0/3265607385 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24ac1600a0 0x7f24ac12b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b3000640 1 --2- 172.21.15.175:0/3265607385 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24ac145250 0x7f24ac1f5b00 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b3000640 1 --2- 172.21.15.175:0/3265607385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24ac0ce970 0x7f24ac0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b3000640 1 -- 172.21.15.175:0/3265607385 >> 172.21.15.175:0/3265607385 conn(0x7f24ac06ac50 msgr2=0x7f24ac0cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b3000640 1 -- 172.21.15.175:0/3265607385 shutdown_connections 2024-04-25T09:05:54.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:54.365+0000 7f24b3000640 1 -- 172.21.15.175:0/3265607385 wait complete. 2024-04-25T09:05:54.373 INFO:tasks.cephfs.filesystem:scrub status for tag:69a9c21e-88e9-47e4-99c6-2b06504a7395 - {'path': '/', 'tag': '69a9c21e-88e9-47e4-99c6-2b06504a7395', 'options': 'recursive,repair'} 2024-04-25T09:05:56.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:56.029+0000 7fb219600640 1 -- 172.21.15.175:0/2306770888 <== mon.0 v2:172.21.15.175:3300/0 7 ==== log(6 entries from seq 1 at 2024-04-25T09:05:54.164900+0000) v1 ==== 1078+0+0 (secure 0 0 0) 0x7fb2140ed8e0 con 0x7fb21c1454e0 2024-04-25T09:05:56.018 INFO:teuthology.orchestra.run.smithi175.stdout: cluster: 2024-04-25T09:05:56.018 INFO:teuthology.orchestra.run.smithi175.stdout: id: 8caed986-ca08-40e2-b5a5-12e2aade6223 2024-04-25T09:05:56.018 INFO:teuthology.orchestra.run.smithi175.stdout: health: HEALTH_OK 2024-04-25T09:05:56.018 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:56.018 INFO:teuthology.orchestra.run.smithi175.stdout: services: 2024-04-25T09:05:56.018 INFO:teuthology.orchestra.run.smithi175.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2024-04-25T09:05:56.018 INFO:teuthology.orchestra.run.smithi175.stdout: mgr: y(active, since 2m), standbys: x 2024-04-25T09:05:56.018 INFO:teuthology.orchestra.run.smithi175.stdout: mds: 1/1 daemons up, 3 standby 2024-04-25T09:05:56.018 INFO:teuthology.orchestra.run.smithi175.stdout: osd: 8 osds: 8 up (since 117s), 8 in (since 2m) 2024-04-25T09:05:56.018 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:56.019 INFO:teuthology.orchestra.run.smithi175.stdout: data: 2024-04-25T09:05:56.019 INFO:teuthology.orchestra.run.smithi175.stdout: volumes: 1/1 healthy 2024-04-25T09:05:56.019 INFO:teuthology.orchestra.run.smithi175.stdout: pools: 3 pools, 97 pgs 2024-04-25T09:05:56.019 INFO:teuthology.orchestra.run.smithi175.stdout: objects: 24 objects, 579 KiB 2024-04-25T09:05:56.019 INFO:teuthology.orchestra.run.smithi175.stdout: usage: 216 MiB used, 720 GiB / 720 GiB avail 2024-04-25T09:05:56.019 INFO:teuthology.orchestra.run.smithi175.stdout: pgs: 97 active+clean 2024-04-25T09:05:56.019 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:56.019 INFO:teuthology.orchestra.run.smithi175.stdout: io: 2024-04-25T09:05:56.019 INFO:teuthology.orchestra.run.smithi175.stdout: client: 2.2 KiB/s wr, 0 op/s rd, 6 op/s wr 2024-04-25T09:05:56.019 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:56.019 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:05:56.019 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:05:54.164900+0000 mds.c [INF] scrub queued for path: / 2024-04-25T09:05:56.019 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:05:54.164903+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-25T09:05:56.019 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:05:54.164907+0000 mds.c [INF] scrub summary: active paths [/] 2024-04-25T09:05:56.019 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:05:54.165822+0000 mds.c [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2024-04-25T09:05:56.020 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:05:54.165836+0000 mds.c [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2024-04-25T09:05:56.020 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:05:54.166394+0000 mds.c [INF] scrub summary: idle+waiting paths [/] 2024-04-25T09:05:57.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:05:57.029+0000 7fb219600640 1 -- 172.21.15.175:0/2306770888 <== mon.0 v2:172.21.15.175:3300/0 8 ==== log(1 entries from seq 7 at 2024-04-25T09:05:55.050108+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7fb2140edb40 con 0x7fb21c1454e0 2024-04-25T09:05:57.019 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:05:55.050108+0000 mds.c [INF] scrub summary: idle 2024-04-25T09:06:08.516 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:06:08.520 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:06:24.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:24.374 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T09:06:24.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.533+0000 7fc2b7000640 1 Processor -- start 2024-04-25T09:06:24.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.533+0000 7fc2b7000640 1 -- start start 2024-04-25T09:06:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.533+0000 7fc2b7000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc2b0161360 0x7fc2b00ad990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.533+0000 7fc2b7000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc2b00ae660 0x7fc2b006e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.533+0000 7fc2b7000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b00ae250 con 0x7fc2b006ef10 2024-04-25T09:06:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.533+0000 7fc2b7000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b00adf70 con 0x7fc2b0161360 2024-04-25T09:06:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.533+0000 7fc2b7000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b006def0 con 0x7fc2b00ae660 2024-04-25T09:06:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.537+0000 7fc2afe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc2b0161360 0x7fc2b00ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.537+0000 7fc2afe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc2b0161360 0x7fc2b00ad990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52208/0 (socket says 172.21.15.175:52208) 2024-04-25T09:06:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.537+0000 7fc2afe00640 1 -- 172.21.15.175:0/2001178454 learned_addr learned my addr 172.21.15.175:0/2001178454 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.537+0000 7fc2af400640 1 --2- 172.21.15.175:0/2001178454 >> v2:172.21.15.177:3300/0 conn(0x7fc2b00ae660 0x7fc2b006e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.537+0000 7fc2afe00640 1 -- 172.21.15.175:0/2001178454 >> v2:172.21.15.177:3300/0 conn(0x7fc2b00ae660 msgr2=0x7fc2b006e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.537+0000 7fc2afe00640 1 --2- 172.21.15.175:0/2001178454 >> v2:172.21.15.177:3300/0 conn(0x7fc2b00ae660 0x7fc2b006e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.537+0000 7fc2afe00640 1 -- 172.21.15.175:0/2001178454 >> v1:172.21.15.177:6789/0 conn(0x7fc2b006ef10 legacy=0x7fc2b00712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.537+0000 7fc2afe00640 1 -- 172.21.15.175:0/2001178454 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b006e1d0 con 0x7fc2b0161360 2024-04-25T09:06:24.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.537+0000 7fc2afe00640 1 --2- 172.21.15.175:0/2001178454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b0161360 0x7fc2b00ad990 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00b4d30 tx=0x7fc2a001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce39c35e2baef732 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.537+0000 7fc2aea00640 1 -- 172.21.15.175:0/2001178454 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a00a5810 con 0x7fc2b0161360 2024-04-25T09:06:24.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.537+0000 7fc2aea00640 1 -- 172.21.15.175:0/2001178454 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a00a59b0 con 0x7fc2b0161360 2024-04-25T09:06:24.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.537+0000 7fc2aea00640 1 -- 172.21.15.175:0/2001178454 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a00a5d80 con 0x7fc2b0161360 2024-04-25T09:06:24.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b7000640 1 -- 172.21.15.175:0/2001178454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b0161360 msgr2=0x7fc2b00ad990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b7000640 1 --2- 172.21.15.175:0/2001178454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b0161360 0x7fc2b00ad990 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00b4d30 tx=0x7fc2a001c930 comp rx=0 tx=0).stop 2024-04-25T09:06:24.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b7000640 1 -- 172.21.15.175:0/2001178454 shutdown_connections 2024-04-25T09:06:24.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b7000640 1 --2- 172.21.15.175:0/2001178454 >> v2:172.21.15.177:3300/0 conn(0x7fc2b00ae660 0x7fc2b006e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b7000640 1 --2- 172.21.15.175:0/2001178454 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b0161360 0x7fc2b00ad990 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b7000640 1 -- 172.21.15.175:0/2001178454 >> 172.21.15.175:0/2001178454 conn(0x7fc2b006ac50 msgr2=0x7fc2b006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b7000640 1 -- 172.21.15.175:0/2001178454 shutdown_connections 2024-04-25T09:06:24.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b7000640 1 -- 172.21.15.175:0/2001178454 wait complete. 2024-04-25T09:06:24.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b7000640 1 Processor -- start 2024-04-25T09:06:24.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b7000640 1 -- start start 2024-04-25T09:06:24.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b7000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2b006ef10 0x7fc2b0148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b7000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2b00ae660 0x7fc2b0154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b7000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b0161360 0x7fc2b014bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b7000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b00719e0 con 0x7fc2b0161360 2024-04-25T09:06:24.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b7000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b00b3080 con 0x7fc2b00ae660 2024-04-25T09:06:24.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b7000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b0071b60 con 0x7fc2b006ef10 2024-04-25T09:06:24.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b5000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b0161360 0x7fc2b014bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b5000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b0161360 0x7fc2b014bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52216/0 (socket says 172.21.15.175:52216) 2024-04-25T09:06:24.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b5000640 1 -- 172.21.15.175:0/2609603299 learned_addr learned my addr 172.21.15.175:0/2609603299 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:24.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2af400640 1 --2- 172.21.15.175:0/2609603299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2b00ae660 0x7fc2b0154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2afe00640 1 --2- 172.21.15.175:0/2609603299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2b006ef10 0x7fc2b0148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b5000640 1 -- 172.21.15.175:0/2609603299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2b006ef10 msgr2=0x7fc2b0148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b5000640 1 --2- 172.21.15.175:0/2609603299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2b006ef10 0x7fc2b0148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b5000640 1 -- 172.21.15.175:0/2609603299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2b00ae660 msgr2=0x7fc2b0154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b5000640 1 --2- 172.21.15.175:0/2609603299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2b00ae660 0x7fc2b0154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.541+0000 7fc2b5000640 1 -- 172.21.15.175:0/2609603299 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b0153b20 con 0x7fc2b0161360 2024-04-25T09:06:24.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.545+0000 7fc2b5000640 1 --2- 172.21.15.175:0/2609603299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b0161360 0x7fc2b014bbf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc2a800c430 tx=0x7fc2a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.545+0000 7fc2a7e00640 1 -- 172.21.15.175:0/2609603299 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8005220 con 0x7fc2b0161360 2024-04-25T09:06:24.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.545+0000 7fc2a7e00640 1 -- 172.21.15.175:0/2609603299 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a80053c0 con 0x7fc2b0161360 2024-04-25T09:06:24.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.545+0000 7fc2b7000640 1 -- 172.21.15.175:0/2609603299 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b0153e00 con 0x7fc2b0161360 2024-04-25T09:06:24.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.545+0000 7fc2a7e00640 1 -- 172.21.15.175:0/2609603299 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8007270 con 0x7fc2b0161360 2024-04-25T09:06:24.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.545+0000 7fc2b7000640 1 -- 172.21.15.175:0/2609603299 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b0147d80 con 0x7fc2b0161360 2024-04-25T09:06:24.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.545+0000 7fc2a7e00640 1 -- 172.21.15.175:0/2609603299 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc2a8019020 con 0x7fc2b0161360 2024-04-25T09:06:24.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.545+0000 7fc2a7e00640 1 --2- 172.21.15.175:0/2609603299 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc290066f90 0x7fc290069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.545+0000 7fc2a7e00640 1 -- 172.21.15.175:0/2609603299 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc2a80841f0 con 0x7fc2b0161360 2024-04-25T09:06:24.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.545+0000 7fc2afe00640 1 --2- 172.21.15.175:0/2609603299 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc290066f90 0x7fc290069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 Processor -- start 2024-04-25T09:06:24.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 -- start start 2024-04-25T09:06:24.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2afe00640 1 --2- 172.21.15.175:0/2609603299 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc290066f90 0x7fc290069450 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00ae000 tx=0x7fc2a00a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd47779d0 0x556dd4777db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 0x556dd472db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd472e0a0 0x556dd472e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dd457aff0 con 0x556dd47782f0 2024-04-25T09:06:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dd4503150 con 0x556dd472e0a0 2024-04-25T09:06:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x556dd4577090 con 0x556dd47779d0 2024-04-25T09:06:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2af400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 0x556dd472db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2af400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 0x556dd472db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52222/0 (socket says 172.21.15.175:52222) 2024-04-25T09:06:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2af400640 1 -- 172.21.15.175:0/3270239176 learned_addr learned my addr 172.21.15.175:0/3270239176 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2afe00640 1 --2- 172.21.15.175:0/3270239176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd47779d0 0x556dd4777db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2b5000640 1 --2- 172.21.15.175:0/3270239176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd472e0a0 0x556dd472e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2af400640 1 -- 172.21.15.175:0/3270239176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd47779d0 msgr2=0x556dd4777db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2af400640 1 --2- 172.21.15.175:0/3270239176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd47779d0 0x556dd4777db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2af400640 1 -- 172.21.15.175:0/3270239176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd472e0a0 msgr2=0x556dd472e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2af400640 1 --2- 172.21.15.175:0/3270239176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd472e0a0 0x556dd472e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2af400640 1 -- 172.21.15.175:0/3270239176 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dd47110d0 con 0x556dd47782f0 2024-04-25T09:06:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2afe00640 1 --2- 172.21.15.175:0/3270239176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd47779d0 0x556dd4777db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2af400640 1 --2- 172.21.15.175:0/3270239176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 0x556dd472db60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009bb0 tx=0x7fc29c011690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9ef8e175531982 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2a4c00640 1 -- 172.21.15.175:0/3270239176 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c019070 con 0x556dd47782f0 2024-04-25T09:06:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2a4c00640 1 -- 172.21.15.175:0/3270239176 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c004030 con 0x556dd47782f0 2024-04-25T09:06:24.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2a4c00640 1 -- 172.21.15.175:0/3270239176 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c004420 con 0x556dd47782f0 2024-04-25T09:06:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 -- 172.21.15.175:0/3270239176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 msgr2=0x556dd472db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/3270239176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 0x556dd472db60 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009bb0 tx=0x7fc29c011690 comp rx=0 tx=0).stop 2024-04-25T09:06:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 -- 172.21.15.175:0/3270239176 shutdown_connections 2024-04-25T09:06:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/3270239176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd472e0a0 0x556dd472e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/3270239176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 0x556dd472db60 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/3270239176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd47779d0 0x556dd4777db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 -- 172.21.15.175:0/3270239176 >> 172.21.15.175:0/3270239176 conn(0x556dd472a020 msgr2=0x556dd472c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 -- 172.21.15.175:0/3270239176 shutdown_connections 2024-04-25T09:06:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 -- 172.21.15.175:0/3270239176 wait complete. 2024-04-25T09:06:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 -- start start 2024-04-25T09:06:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.549+0000 7fc2ba54b000 1 Processor -- start 2024-04-25T09:06:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2ba54b000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd472e0a0 0x556dd475c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2ba54b000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd47779d0 0x556dd475cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2ba54b000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 0x556dd475d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2ba54b000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dd453f250 con 0x556dd47782f0 2024-04-25T09:06:24.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2ba54b000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dd4535690 con 0x556dd47779d0 2024-04-25T09:06:24.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2ba54b000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x556dd4503a40 con 0x556dd472e0a0 2024-04-25T09:06:24.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2ba54b000 10 client.0 _ll_register_callbacks cb 0x556dd4718e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:24.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2b5000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 0x556dd475d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2b5000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 0x556dd475d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52224/0 (socket says 172.21.15.175:52224) 2024-04-25T09:06:24.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2b5000640 1 -- 172.21.15.175:0/4229434702 learned_addr learned my addr 172.21.15.175:0/4229434702 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:24.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2af400640 1 --2- 172.21.15.175:0/4229434702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd47779d0 0x556dd475cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2afe00640 1 --2- 172.21.15.175:0/4229434702 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd472e0a0 0x556dd475c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2b5000640 1 -- 172.21.15.175:0/4229434702 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd472e0a0 msgr2=0x556dd475c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2b5000640 1 --2- 172.21.15.175:0/4229434702 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd472e0a0 0x556dd475c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2b5000640 1 -- 172.21.15.175:0/4229434702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd47779d0 msgr2=0x556dd475cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2b5000640 1 --2- 172.21.15.175:0/4229434702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd47779d0 0x556dd475cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2b5000640 1 -- 172.21.15.175:0/4229434702 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556dd46281c0 con 0x556dd47782f0 2024-04-25T09:06:24.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2b5000640 1 --2- 172.21.15.175:0/4229434702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 0x556dd475d270 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8082640 tx=0x7fc2a8058b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae85019c824e32e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc299600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:06:24.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc299600640 1 -- 172.21.15.175:0/4229434702 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8080060 con 0x556dd47782f0 2024-04-25T09:06:24.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc299600640 1 -- 172.21.15.175:0/4229434702 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc2a805cea0 con 0x556dd47782f0 2024-04-25T09:06:24.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2ba54b000 1 -- 172.21.15.175:0/4229434702 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc29c004030 con 0x556dd47782f0 2024-04-25T09:06:24.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc299600640 1 -- 172.21.15.175:0/4229434702 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2a8071050 con 0x556dd47782f0 2024-04-25T09:06:24.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2ba54b000 10 client.5751 fetch_fsmap learned FSMap version 25 2024-04-25T09:06:24.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2ba54b000 1 -- 172.21.15.175:0/4229434702 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x556dd4624170 con 0x556dd47782f0 2024-04-25T09:06:24.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc299600640 1 -- 172.21.15.175:0/4229434702 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c004030 con 0x556dd47782f0 2024-04-25T09:06:24.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc299600640 1 -- 172.21.15.175:0/4229434702 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc2a8007410 con 0x556dd47782f0 2024-04-25T09:06:24.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2ba54b000 10 client.5751 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T09:06:24.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2ba54b000 10 client.5751 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-25T09:06:24.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2ba54b000 20 client.5751 populate_metadata read hostname 'smithi175' 2024-04-25T09:06:24.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/4229434702 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x556dd4787c80 0x556dd478a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2ba54b000 4 client.5751 mds_command: new command op to 5535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:24.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2ba54b000 1 -- 172.21.15.175:0/4229434702 --> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556dd4516c60 con 0x556dd4787c80 2024-04-25T09:06:24.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2afe00640 1 --2- 172.21.15.175:0/4229434702 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x556dd4787c80 0x556dd478a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2afe00640 1 --2- 172.21.15.175:0/4229434702 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x556dd4787c80 0x556dd478a070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ae74f570478ce2c server_cookie=c85d6fc33b367561 in_seq=0 out_seq=0 2024-04-25T09:06:24.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc299600640 10 client.5751 ms_handle_connect on v2:172.21.15.175:6834/1389262120 2024-04-25T09:06:24.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc299600640 1 -- 172.21.15.175:0/4229434702 <== mds.0 v2:172.21.15.175:6834/1389262120 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556dd4516c60 con 0x556dd4787c80 2024-04-25T09:06:24.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc299600640 10 client.5751 handle_command_reply: tid=0 2024-04-25T09:06:24.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.553+0000 7fc2ba54b000 1 client.5751 shutdown 2024-04-25T09:06:24.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.557+0000 7fc2ba54b000 1 -- 172.21.15.175:0/4229434702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 msgr2=0x556dd475d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.557+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/4229434702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 0x556dd475d270 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8082640 tx=0x7fc2a8058b70 comp rx=0 tx=0).stop 2024-04-25T09:06:24.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.557+0000 7fc2ba54b000 1 -- 172.21.15.175:0/4229434702 shutdown_connections 2024-04-25T09:06:24.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.557+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/4229434702 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 0x556dd475d270 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.557+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/4229434702 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x556dd4787c80 0x556dd478a070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.557+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/4229434702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd47779d0 0x556dd475cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.557+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/4229434702 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd472e0a0 0x556dd475c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.557+0000 7fc2ba54b000 1 -- 172.21.15.175:0/4229434702 >> 172.21.15.175:0/4229434702 conn(0x556dd472a020 msgr2=0x556dd472cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.557+0000 7fc299600640 0 client.5751 ms_handle_reset on v2:172.21.15.175:6834/1389262120 2024-04-25T09:06:24.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.557+0000 7fc2ba54b000 1 -- 172.21.15.175:0/4229434702 shutdown_connections 2024-04-25T09:06:24.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.557+0000 7fc2ba54b000 1 -- 172.21.15.175:0/4229434702 wait complete. 2024-04-25T09:06:24.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.557+0000 7fc2ba54b000 20 client.5751 trim_cache size 0 max 16384 2024-04-25T09:06:24.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.569+0000 7fc2ba54b000 1 Processor -- start 2024-04-25T09:06:24.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.569+0000 7fc2ba54b000 1 -- start start 2024-04-25T09:06:24.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.569+0000 7fc2ba54b000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd472e0a0 0x556dd47d40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.569+0000 7fc2ba54b000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47779d0 0x556dd47d4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.569+0000 7fc2ba54b000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd47782f0 0x556dd47d4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.569+0000 7fc2ba54b000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b0202c80 con 0x556dd47779d0 2024-04-25T09:06:24.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.569+0000 7fc2ba54b000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b0202010 con 0x556dd472e0a0 2024-04-25T09:06:24.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.569+0000 7fc2ba54b000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b0150af0 con 0x556dd47782f0 2024-04-25T09:06:24.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2af400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47779d0 0x556dd47d4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2af400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47779d0 0x556dd47d4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52238/0 (socket says 172.21.15.175:52238) 2024-04-25T09:06:24.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2af400640 1 -- 172.21.15.175:0/580530378 learned_addr learned my addr 172.21.15.175:0/580530378 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:24.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2b5000640 1 --2- 172.21.15.175:0/580530378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd47782f0 0x556dd47d4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2afe00640 1 --2- 172.21.15.175:0/580530378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd472e0a0 0x556dd47d40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2af400640 1 -- 172.21.15.175:0/580530378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd47782f0 msgr2=0x556dd47d4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2af400640 1 --2- 172.21.15.175:0/580530378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd47782f0 0x556dd47d4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2af400640 1 -- 172.21.15.175:0/580530378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd472e0a0 msgr2=0x556dd47d40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2af400640 1 --2- 172.21.15.175:0/580530378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd472e0a0 0x556dd47d40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2af400640 1 -- 172.21.15.175:0/580530378 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dd45c1de0 con 0x556dd47779d0 2024-04-25T09:06:24.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2af400640 1 --2- 172.21.15.175:0/580530378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47779d0 0x556dd47d4630 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc29c018000 tx=0x7fc29c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6364a6af3d5198 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc29be00640 1 -- 172.21.15.175:0/580530378 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c019040 con 0x556dd47779d0 2024-04-25T09:06:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc29be00640 1 -- 172.21.15.175:0/580530378 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c004040 con 0x556dd47779d0 2024-04-25T09:06:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc29be00640 1 -- 172.21.15.175:0/580530378 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c004470 con 0x556dd47779d0 2024-04-25T09:06:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2ba54b000 1 -- 172.21.15.175:0/580530378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47779d0 msgr2=0x556dd47d4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/580530378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47779d0 0x556dd47d4630 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc29c018000 tx=0x7fc29c016000 comp rx=0 tx=0).stop 2024-04-25T09:06:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2ba54b000 1 -- 172.21.15.175:0/580530378 shutdown_connections 2024-04-25T09:06:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/580530378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd47782f0 0x556dd47d4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/580530378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47779d0 0x556dd47d4630 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/580530378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd472e0a0 0x556dd47d40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2ba54b000 1 -- 172.21.15.175:0/580530378 >> 172.21.15.175:0/580530378 conn(0x556dd472a020 msgr2=0x556dd4784fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2ba54b000 1 -- 172.21.15.175:0/580530378 shutdown_connections 2024-04-25T09:06:24.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2ba54b000 1 -- 172.21.15.175:0/580530378 wait complete. 2024-04-25T09:06:24.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2ba54b000 1 -- start start 2024-04-25T09:06:24.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2ba54b000 1 Processor -- start 2024-04-25T09:06:24.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2ba54b000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd472e0a0 0x556dd478a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2ba54b000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd47779d0 0x556dd478a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2ba54b000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 0x556dd478ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2ba54b000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dd4515e00 con 0x556dd47782f0 2024-04-25T09:06:24.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2ba54b000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b01510f0 con 0x556dd47779d0 2024-04-25T09:06:24.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2ba54b000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x556dd457a300 con 0x556dd472e0a0 2024-04-25T09:06:24.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2ba54b000 10 client.0 _ll_register_callbacks cb 0x556dd46f9040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:24.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2b5000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 0x556dd478ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2afe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd472e0a0 0x556dd478a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2b5000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 0x556dd478ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52250/0 (socket says 172.21.15.175:52250) 2024-04-25T09:06:24.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2afe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd472e0a0 0x556dd478a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:52940/0 (socket says 172.21.15.175:52940) 2024-04-25T09:06:24.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2b5000640 1 -- 172.21.15.175:0/3724208930 learned_addr learned my addr 172.21.15.175:0/3724208930 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:24.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.573+0000 7fc2af400640 1 --2- 172.21.15.175:0/3724208930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd47779d0 0x556dd478a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2b5000640 1 -- 172.21.15.175:0/3724208930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd472e0a0 msgr2=0x556dd478a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2b5000640 1 --2- 172.21.15.175:0/3724208930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd472e0a0 0x556dd478a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2b5000640 1 -- 172.21.15.175:0/3724208930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd47779d0 msgr2=0x556dd478a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2b5000640 1 --2- 172.21.15.175:0/3724208930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd47779d0 0x556dd478a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2b5000640 1 -- 172.21.15.175:0/3724208930 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556dd451c8e0 con 0x556dd47782f0 2024-04-25T09:06:24.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2b5000640 1 --2- 172.21.15.175:0/3724208930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 0x556dd478ae00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80547d0 tx=0x7fc2a8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b94370dd12065b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc299600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:06:24.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc299600640 1 -- 172.21.15.175:0/3724208930 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8072e60 con 0x556dd47782f0 2024-04-25T09:06:24.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc299600640 1 -- 172.21.15.175:0/3724208930 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc2a8053f20 con 0x556dd47782f0 2024-04-25T09:06:24.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 1 -- 172.21.15.175:0/3724208930 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc29c004040 con 0x556dd47782f0 2024-04-25T09:06:24.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc299600640 1 -- 172.21.15.175:0/3724208930 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2a8080030 con 0x556dd47782f0 2024-04-25T09:06:24.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 10 client.5757 fetch_fsmap learned FSMap version 25 2024-04-25T09:06:24.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 1 -- 172.21.15.175:0/3724208930 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x556dd45d48f0 con 0x556dd47782f0 2024-04-25T09:06:24.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc299600640 1 -- 172.21.15.175:0/3724208930 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c004040 con 0x556dd47782f0 2024-04-25T09:06:24.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc299600640 1 -- 172.21.15.175:0/3724208930 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 25) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc2a8050820 con 0x556dd47782f0 2024-04-25T09:06:24.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 10 client.5757 fetch_fsmap finished waiting for FSMap version 25 2024-04-25T09:06:24.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 10 client.5757 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2024-04-25T09:06:24.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 20 client.5757 populate_metadata read hostname 'smithi175' 2024-04-25T09:06:24.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/3724208930 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x556dd478b910 0x556dd47dff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 4 client.5757 mds_command: new command op to 5535 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:06:24.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 1 -- 172.21.15.175:0/3724208930 --> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556dd4588530 con 0x556dd478b910 2024-04-25T09:06:24.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2afe00640 1 --2- 172.21.15.175:0/3724208930 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x556dd478b910 0x556dd47dff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2afe00640 1 --2- 172.21.15.175:0/3724208930 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x556dd478b910 0x556dd47dff60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce1f51019b8492da server_cookie=5dabb88373100731 in_seq=0 out_seq=0 2024-04-25T09:06:24.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc299600640 10 client.5757 ms_handle_connect on v2:172.21.15.175:6834/1389262120 2024-04-25T09:06:24.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc299600640 1 -- 172.21.15.175:0/3724208930 <== mds.0 v2:172.21.15.175:6834/1389262120 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x556dd4588530 con 0x556dd478b910 2024-04-25T09:06:24.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc299600640 10 client.5757 handle_command_reply: tid=0 2024-04-25T09:06:24.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 1 client.5757 shutdown 2024-04-25T09:06:24.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 1 -- 172.21.15.175:0/3724208930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 msgr2=0x556dd478ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/3724208930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 0x556dd478ae00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80547d0 tx=0x7fc2a8000ee0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 1 -- 172.21.15.175:0/3724208930 shutdown_connections 2024-04-25T09:06:24.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/3724208930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556dd47782f0 0x556dd478ae00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/3724208930 >> [v2:172.21.15.175:6834/1389262120,v1:172.21.15.175:6836/1389262120] conn(0x556dd478b910 0x556dd47dff60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/3724208930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556dd47779d0 0x556dd478a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 1 --2- 172.21.15.175:0/3724208930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556dd472e0a0 0x556dd478a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc299600640 0 client.5757 ms_handle_reset on v2:172.21.15.175:6834/1389262120 2024-04-25T09:06:24.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 1 -- 172.21.15.175:0/3724208930 >> 172.21.15.175:0/3724208930 conn(0x556dd472a020 msgr2=0x556dd47760d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 1 -- 172.21.15.175:0/3724208930 shutdown_connections 2024-04-25T09:06:24.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 1 -- 172.21.15.175:0/3724208930 wait complete. 2024-04-25T09:06:24.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2ba54b000 20 client.5757 trim_cache size 0 max 16384 2024-04-25T09:06:24.572 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:06:24.573 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "no active scrubs running", 2024-04-25T09:06:24.573 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": {} 2024-04-25T09:06:24.573 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:06:24.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2b7000640 1 -- 172.21.15.175:0/2609603299 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc290066f90 msgr2=0x7fc290069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2b7000640 1 --2- 172.21.15.175:0/2609603299 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc290066f90 0x7fc290069450 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00ae000 tx=0x7fc2a00a7070 comp rx=0 tx=0).stop 2024-04-25T09:06:24.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2b7000640 1 -- 172.21.15.175:0/2609603299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b0161360 msgr2=0x7fc2b014bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2b7000640 1 --2- 172.21.15.175:0/2609603299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b0161360 0x7fc2b014bbf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc2a800c430 tx=0x7fc2a800c8f0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2b7000640 1 -- 172.21.15.175:0/2609603299 shutdown_connections 2024-04-25T09:06:24.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2b7000640 1 --2- 172.21.15.175:0/2609603299 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc290066f90 0x7fc290069450 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2b7000640 1 --2- 172.21.15.175:0/2609603299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b0161360 0x7fc2b014bbf0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2b7000640 1 --2- 172.21.15.175:0/2609603299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2b00ae660 0x7fc2b0154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2b7000640 1 --2- 172.21.15.175:0/2609603299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2b006ef10 0x7fc2b0148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2b7000640 1 -- 172.21.15.175:0/2609603299 >> 172.21.15.175:0/2609603299 conn(0x7fc2b006ac50 msgr2=0x7fc2b015e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2b7000640 1 -- 172.21.15.175:0/2609603299 shutdown_connections 2024-04-25T09:06:24.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.577+0000 7fc2b7000640 1 -- 172.21.15.175:0/2609603299 wait complete. 2024-04-25T09:06:24.586 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:06:24.688 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:24.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.833+0000 7f8129000640 1 Processor -- start 2024-04-25T09:06:24.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.833+0000 7f8129000640 1 -- start start 2024-04-25T09:06:24.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.837+0000 7f8129000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8124071950 0x7f812406de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.837+0000 7f8129000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f812406e340 0x7f81240b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.837+0000 7f8129000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812406eba0 con 0x7f81240aeb30 2024-04-25T09:06:24.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.837+0000 7f8129000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81240b2a70 con 0x7f812406e340 2024-04-25T09:06:24.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.837+0000 7f8129000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812406ee80 con 0x7f8124071950 2024-04-25T09:06:24.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.837+0000 7f8122800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f812406e340 0x7f81240b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.837+0000 7f8122800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f812406e340 0x7f81240b2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52254/0 (socket says 172.21.15.175:52254) 2024-04-25T09:06:24.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.837+0000 7f8122800640 1 -- 172.21.15.175:0/36908547 learned_addr learned my addr 172.21.15.175:0/36908547 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:24.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.837+0000 7f8119400640 1 --2- 172.21.15.175:0/36908547 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8124071950 0x7f812406de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.837+0000 7f8122800640 1 -- 172.21.15.175:0/36908547 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8124071950 msgr2=0x7f812406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:24.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.837+0000 7f8122800640 1 --2- 172.21.15.175:0/36908547 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8124071950 0x7f812406de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.837+0000 7f8122800640 1 -- 172.21.15.175:0/36908547 >> v1:172.21.15.177:6789/0 conn(0x7f81240aeb30 legacy=0x7f8124071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.837+0000 7f8122800640 1 -- 172.21.15.175:0/36908547 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81240b2700 con 0x7f812406e340 2024-04-25T09:06:24.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.841+0000 7f8122800640 1 --2- 172.21.15.175:0/36908547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f812406e340 0x7f81240b2f00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f81240b2bf0 tx=0x7f811c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847fab6ba1a1e307 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.841+0000 7f8121400640 1 -- 172.21.15.175:0/36908547 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c0a5830 con 0x7f812406e340 2024-04-25T09:06:24.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.841+0000 7f8121400640 1 -- 172.21.15.175:0/36908547 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c0a59d0 con 0x7f812406e340 2024-04-25T09:06:24.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.841+0000 7f8121400640 1 -- 172.21.15.175:0/36908547 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c0a5da0 con 0x7f812406e340 2024-04-25T09:06:24.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.841+0000 7f8129000640 1 -- 172.21.15.175:0/36908547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f812406e340 msgr2=0x7f81240b2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.841+0000 7f8129000640 1 --2- 172.21.15.175:0/36908547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f812406e340 0x7f81240b2f00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f81240b2bf0 tx=0x7f811c01c950 comp rx=0 tx=0).stop 2024-04-25T09:06:24.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.841+0000 7f8129000640 1 -- 172.21.15.175:0/36908547 shutdown_connections 2024-04-25T09:06:24.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.841+0000 7f8129000640 1 --2- 172.21.15.175:0/36908547 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f812406e340 0x7f81240b2f00 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.841+0000 7f8129000640 1 --2- 172.21.15.175:0/36908547 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8124071950 0x7f812406de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.841+0000 7f8129000640 1 -- 172.21.15.175:0/36908547 >> 172.21.15.175:0/36908547 conn(0x7f8124067150 msgr2=0x7f812406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:24.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.841+0000 7f8129000640 1 -- 172.21.15.175:0/36908547 shutdown_connections 2024-04-25T09:06:24.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.841+0000 7f8129000640 1 -- 172.21.15.175:0/36908547 wait complete. 2024-04-25T09:06:24.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.841+0000 7f8129000640 1 Processor -- start 2024-04-25T09:06:24.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.841+0000 7f8129000640 1 -- start start 2024-04-25T09:06:24.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.841+0000 7f8129000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8124071950 0x7f81240ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.841+0000 7f8129000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81240aeb30 0x7f81241f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.841+0000 7f8129000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81241f9850 0x7f81240cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f8129000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81240b37d0 con 0x7f8124071950 2024-04-25T09:06:24.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f8129000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81240b3650 con 0x7f81241f9850 2024-04-25T09:06:24.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f8129000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81240b3950 con 0x7f81240aeb30 2024-04-25T09:06:24.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f8121e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8124071950 0x7f81240ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f8121e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8124071950 0x7f81240ae200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52268/0 (socket says 172.21.15.175:52268) 2024-04-25T09:06:24.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f8121e00640 1 -- 172.21.15.175:0/1604680588 learned_addr learned my addr 172.21.15.175:0/1604680588 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:24.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f8119400640 1 --2- 172.21.15.175:0/1604680588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81240aeb30 0x7f81241f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f8122800640 1 --2- 172.21.15.175:0/1604680588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81241f9850 0x7f81240cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f8121e00640 1 -- 172.21.15.175:0/1604680588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81240aeb30 msgr2=0x7f81241f6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f8121e00640 1 --2- 172.21.15.175:0/1604680588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81240aeb30 0x7f81241f6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f8121e00640 1 -- 172.21.15.175:0/1604680588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81241f9850 msgr2=0x7f81240cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:24.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f8121e00640 1 --2- 172.21.15.175:0/1604680588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81241f9850 0x7f81240cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:24.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f8121e00640 1 -- 172.21.15.175:0/1604680588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81240ccf10 con 0x7f8124071950 2024-04-25T09:06:24.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f8121e00640 1 --2- 172.21.15.175:0/1604680588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8124071950 0x7f81240ae200 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f811400c370 tx=0x7f811400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f811aa00640 1 -- 172.21.15.175:0/1604680588 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140052d0 con 0x7f8124071950 2024-04-25T09:06:24.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f811aa00640 1 -- 172.21.15.175:0/1604680588 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8114005470 con 0x7f8124071950 2024-04-25T09:06:24.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f811aa00640 1 -- 172.21.15.175:0/1604680588 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114007260 con 0x7f8124071950 2024-04-25T09:06:24.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f8129000640 1 -- 172.21.15.175:0/1604680588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81240cd1f0 con 0x7f8124071950 2024-04-25T09:06:24.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f8129000640 1 -- 172.21.15.175:0/1604680588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81241f9d00 con 0x7f8124071950 2024-04-25T09:06:24.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f8129000640 1 -- 172.21.15.175:0/1604680588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8124074a60 con 0x7f8124071950 2024-04-25T09:06:24.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f811aa00640 1 -- 172.21.15.175:0/1604680588 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8114007400 con 0x7f8124071950 2024-04-25T09:06:24.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.845+0000 7f811aa00640 1 --2- 172.21.15.175:0/1604680588 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8100066f90 0x7f8100069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:24.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.849+0000 7f811aa00640 1 -- 172.21.15.175:0/1604680588 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f81140844a0 con 0x7f8124071950 2024-04-25T09:06:24.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.849+0000 7f8119400640 1 --2- 172.21.15.175:0/1604680588 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8100066f90 0x7f8100069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:24.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.849+0000 7f8119400640 1 --2- 172.21.15.175:0/1604680588 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8100066f90 0x7f8100069450 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f81240ad700 tx=0x7f810c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:24.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:24.853+0000 7f811aa00640 1 -- 172.21.15.175:0/1604680588 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8114054d80 con 0x7f8124071950 2024-04-25T09:06:25.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.041+0000 7f8129000640 1 -- 172.21.15.175:0/1604680588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81240721c0 con 0x7f8124071950 2024-04-25T09:06:25.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.041+0000 7f811aa00640 1 -- 172.21.15.175:0/1604680588 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f8114058e20 con 0x7f8124071950 2024-04-25T09:06:25.032 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:25.032 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5102,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2763692769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2763692769},{"type":"v1","addr":"172.21.15.175:6837","nonce":2763692769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3823569323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3823569323},{"type":"v1","addr":"172.21.15.177:6834","nonce":3823569323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2687013607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2687013607},{"type":"v1","addr":"172.21.15.177:6835","nonce":2687013607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:45.332647+0000","modified":"2024-04-25T09:05:48.357816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6836/1389262120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1389262120},{"type":"v1","addr":"172.21.15.175:6836","nonce":1389262120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:25.032 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 25 2024-04-25T09:06:25.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.045+0000 7f8129000640 1 -- 172.21.15.175:0/1604680588 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8100066f90 msgr2=0x7f8100069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.045+0000 7f8129000640 1 --2- 172.21.15.175:0/1604680588 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8100066f90 0x7f8100069450 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f81240ad700 tx=0x7f810c009190 comp rx=0 tx=0).stop 2024-04-25T09:06:25.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.045+0000 7f8129000640 1 -- 172.21.15.175:0/1604680588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8124071950 msgr2=0x7f81240ae200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.045+0000 7f8129000640 1 --2- 172.21.15.175:0/1604680588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8124071950 0x7f81240ae200 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f811400c370 tx=0x7f811400c830 comp rx=0 tx=0).stop 2024-04-25T09:06:25.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.045+0000 7f8129000640 1 -- 172.21.15.175:0/1604680588 shutdown_connections 2024-04-25T09:06:25.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.045+0000 7f8129000640 1 --2- 172.21.15.175:0/1604680588 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8100066f90 0x7f8100069450 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.045+0000 7f8129000640 1 --2- 172.21.15.175:0/1604680588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f81241f9850 0x7f81240cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.045+0000 7f8129000640 1 --2- 172.21.15.175:0/1604680588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f81240aeb30 0x7f81241f6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.045+0000 7f8129000640 1 --2- 172.21.15.175:0/1604680588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8124071950 0x7f81240ae200 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.045+0000 7f8129000640 1 -- 172.21.15.175:0/1604680588 >> 172.21.15.175:0/1604680588 conn(0x7f812406e340 msgr2=0x7f81240af180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.045+0000 7f8129000640 1 -- 172.21.15.175:0/1604680588 shutdown_connections 2024-04-25T09:06:25.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.045+0000 7f8129000640 1 -- 172.21.15.175:0/1604680588 wait complete. 2024-04-25T09:06:25.053 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T09:06:25.217 INFO:teuthology.orchestra.run.smithi175.stdout:{"message":"","return_code":0} 2024-04-25T09:06:25.217 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:06:25.217 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T09:06:25.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0748308080 1 Processor -- start 2024-04-25T09:06:25.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0748308080 1 -- start start 2024-04-25T09:06:25.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0748308080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557bcd963740 0x557bcd8ec640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0748308080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557bcd963b20 0x557bcd983320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0748308080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bcd964000 0x557bcd8f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0748308080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bcd964c50 con 0x557bcd964000 2024-04-25T09:06:25.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0748308080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bcd8519f0 con 0x557bcd963b20 2024-04-25T09:06:25.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0748308080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x557bcd964ef0 con 0x557bcd963740 2024-04-25T09:06:25.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0746000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bcd964000 0x557bcd8f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0746000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bcd964000 0x557bcd8f1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52296/0 (socket says 172.21.15.175:52296) 2024-04-25T09:06:25.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0746000640 1 -- 172.21.15.175:0/2188345309 learned_addr learned my addr 172.21.15.175:0/2188345309 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:25.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0745600640 1 --2- 172.21.15.175:0/2188345309 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557bcd963740 0x557bcd8ec640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0744c00640 1 --2- 172.21.15.175:0/2188345309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557bcd963b20 0x557bcd983320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0746000640 1 -- 172.21.15.175:0/2188345309 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557bcd963740 msgr2=0x557bcd8ec640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:25.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0746000640 1 --2- 172.21.15.175:0/2188345309 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557bcd963740 0x557bcd8ec640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0746000640 1 -- 172.21.15.175:0/2188345309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557bcd963b20 msgr2=0x557bcd983320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:25.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0746000640 1 --2- 172.21.15.175:0/2188345309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557bcd963b20 0x557bcd983320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0746000640 1 -- 172.21.15.175:0/2188345309 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bcd8d7120 con 0x557bcd964000 2024-04-25T09:06:25.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0745600640 1 --2- 172.21.15.175:0/2188345309 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557bcd963740 0x557bcd8ec640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:25.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f0746000640 1 --2- 172.21.15.175:0/2188345309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bcd964000 0x557bcd8f1eb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f074000a560 tx=0x7f07400033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85424c20f22138c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f073f400640 1 -- 172.21.15.175:0/2188345309 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07400b0040 con 0x557bcd964000 2024-04-25T09:06:25.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f073f400640 1 -- 172.21.15.175:0/2188345309 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07400ab640 con 0x557bcd964000 2024-04-25T09:06:25.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.273+0000 7f073f400640 1 -- 172.21.15.175:0/2188345309 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07400aba30 con 0x557bcd964000 2024-04-25T09:06:25.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 -- 172.21.15.175:0/2188345309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bcd964000 msgr2=0x557bcd8f1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 --2- 172.21.15.175:0/2188345309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bcd964000 0x557bcd8f1eb0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f074000a560 tx=0x7f07400033b0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 -- 172.21.15.175:0/2188345309 shutdown_connections 2024-04-25T09:06:25.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 --2- 172.21.15.175:0/2188345309 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bcd964000 0x557bcd8f1eb0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 --2- 172.21.15.175:0/2188345309 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557bcd963b20 0x557bcd983320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 --2- 172.21.15.175:0/2188345309 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557bcd963740 0x557bcd8ec640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 -- 172.21.15.175:0/2188345309 >> 172.21.15.175:0/2188345309 conn(0x557bcd8ab420 msgr2=0x557bcd8eb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 -- 172.21.15.175:0/2188345309 shutdown_connections 2024-04-25T09:06:25.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 -- 172.21.15.175:0/2188345309 wait complete. 2024-04-25T09:06:25.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 Processor -- start 2024-04-25T09:06:25.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 -- start start 2024-04-25T09:06:25.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557bcd963740 0x557bcd8f0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bcd963b20 0x557bcd8d4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557bcd964000 0x557bcd8f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bcd982940 con 0x557bcd963b20 2024-04-25T09:06:25.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bcd8d73c0 con 0x557bcd964000 2024-04-25T09:06:25.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x557bcd982be0 con 0x557bcd963740 2024-04-25T09:06:25.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0744c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bcd963b20 0x557bcd8d4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0744c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bcd963b20 0x557bcd8d4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52300/0 (socket says 172.21.15.175:52300) 2024-04-25T09:06:25.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0744c00640 1 -- 172.21.15.175:0/2177803072 learned_addr learned my addr 172.21.15.175:0/2177803072 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:25.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0745600640 1 --2- 172.21.15.175:0/2177803072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557bcd963740 0x557bcd8f0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0746000640 1 --2- 172.21.15.175:0/2177803072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557bcd964000 0x557bcd8f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0744c00640 1 -- 172.21.15.175:0/2177803072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557bcd963740 msgr2=0x557bcd8f0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0744c00640 1 --2- 172.21.15.175:0/2177803072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557bcd963740 0x557bcd8f0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0744c00640 1 -- 172.21.15.175:0/2177803072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557bcd964000 msgr2=0x557bcd8f2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0744c00640 1 --2- 172.21.15.175:0/2177803072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557bcd964000 0x557bcd8f2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0744c00640 1 -- 172.21.15.175:0/2177803072 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bcd8ef990 con 0x557bcd963b20 2024-04-25T09:06:25.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0744c00640 1 --2- 172.21.15.175:0/2177803072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bcd963b20 0x557bcd8d4d30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0734008780 tx=0x7f0734008c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f073e000640 1 -- 172.21.15.175:0/2177803072 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734006b80 con 0x557bcd963b20 2024-04-25T09:06:25.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f073e000640 1 -- 172.21.15.175:0/2177803072 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0734006d20 con 0x557bcd963b20 2024-04-25T09:06:25.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 -- 172.21.15.175:0/2177803072 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557bcd8efc30 con 0x557bcd963b20 2024-04-25T09:06:25.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f073e000640 1 -- 172.21.15.175:0/2177803072 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07340156a0 con 0x557bcd963b20 2024-04-25T09:06:25.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.277+0000 7f0748308080 1 -- 172.21.15.175:0/2177803072 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557bcd8f0170 con 0x557bcd963b20 2024-04-25T09:06:25.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.281+0000 7f073e000640 1 -- 172.21.15.175:0/2177803072 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f073401c020 con 0x557bcd963b20 2024-04-25T09:06:25.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.281+0000 7f073e000640 1 --2- 172.21.15.175:0/2177803072 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0728065970 0x7f0728067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.281+0000 7f073e000640 1 -- 172.21.15.175:0/2177803072 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0734084150 con 0x557bcd963b20 2024-04-25T09:06:25.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.281+0000 7f0745600640 1 --2- 172.21.15.175:0/2177803072 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0728065970 0x7f0728067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.281+0000 7f0748308080 1 --2- 172.21.15.175:0/2177803072 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x557bcda1d0a0 0x557bcd8ee7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.281+0000 7f0748308080 1 -- 172.21.15.175:0/2177803072 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:1 7.7 7:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v9 -- 0x557bcd8eed30 con 0x557bcda1d0a0 2024-04-25T09:06:25.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.281+0000 7f0745600640 1 --2- 172.21.15.175:0/2177803072 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0728065970 0x7f0728067e30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0738000f70 tx=0x7f0738001840 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.281+0000 7f0746000640 1 --2- 172.21.15.175:0/2177803072 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x557bcda1d0a0 0x557bcd8ee7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.281+0000 7f0746000640 1 --2- 172.21.15.175:0/2177803072 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x557bcda1d0a0 0x557bcd8ee7f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.281+0000 7f0746000640 1 -- 172.21.15.175:0/2177803072 <== osd.6 v2:172.21.15.177:6822/4132808595 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f07400ab9f0 con 0x557bcda1d0a0 2024-04-25T09:06:25.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.281+0000 7f0748308080 1 -- 172.21.15.175:0/2177803072 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x557bcda1d0a0 msgr2=0x557bcd8ee7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.281+0000 7f0748308080 1 --2- 172.21.15.175:0/2177803072 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x557bcda1d0a0 0x557bcd8ee7f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.285+0000 7f0748308080 1 -- 172.21.15.175:0/2177803072 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0728065970 msgr2=0x7f0728067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.285+0000 7f0748308080 1 --2- 172.21.15.175:0/2177803072 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0728065970 0x7f0728067e30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0738000f70 tx=0x7f0738001840 comp rx=0 tx=0).stop 2024-04-25T09:06:25.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.285+0000 7f0748308080 1 -- 172.21.15.175:0/2177803072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bcd963b20 msgr2=0x557bcd8d4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.285+0000 7f0748308080 1 --2- 172.21.15.175:0/2177803072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557bcd963b20 0x557bcd8d4d30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0734008780 tx=0x7f0734008c40 comp rx=0 tx=0).stop 2024-04-25T09:06:25.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.285+0000 7f0746000640 1 -- 172.21.15.175:0/2177803072 reap_dead start 2024-04-25T09:06:25.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.285+0000 7f0748308080 1 -- 172.21.15.175:0/2177803072 shutdown_connections 2024-04-25T09:06:25.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.285+0000 7f0748308080 1 -- 172.21.15.175:0/2177803072 >> 172.21.15.175:0/2177803072 conn(0x557bcd8ab420 msgr2=0x557bcd8a9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.285+0000 7f0748308080 1 -- 172.21.15.175:0/2177803072 shutdown_connections 2024-04-25T09:06:25.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.285+0000 7f0748308080 1 -- 172.21.15.175:0/2177803072 wait complete. 2024-04-25T09:06:25.277 INFO:teuthology.orchestra.run.smithi175.stdout:Yalphaparent_a 2024-04-25T09:06:25.277 DEBUG:teuthology.orchestra.run.smithi175:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T09:06:25.373 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:06:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 1099511627777, 2024-04-25T09:06:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "ancestors": [ 2024-04-25T09:06:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "dirino": 1099511627776, 2024-04-25T09:06:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "dname": "alpha", 2024-04-25T09:06:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: "version": 2 2024-04-25T09:06:25.373 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "dirino": 1, 2024-04-25T09:06:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "dname": "parent_a", 2024-04-25T09:06:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "version": 4 2024-04-25T09:06:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: ], 2024-04-25T09:06:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "pool": 7, 2024-04-25T09:06:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: "old_pools": [] 2024-04-25T09:06:25.374 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:06:25.374 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:25.379 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:06:25.379 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:06:25.467 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:06:25.516 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:06:25.516 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:06:25.516 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:25.524 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:06:25.524 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:25.576 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:25.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.761+0000 7fb0cce00640 1 Processor -- start 2024-04-25T09:06:25.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.761+0000 7fb0cce00640 1 -- start start 2024-04-25T09:06:25.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.761+0000 7fb0cce00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0c815dbd0 0x7fb0c8071c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.761+0000 7fb0cce00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb0c80ae680 0x7fb0c80aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.761+0000 7fb0cce00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c815dfb0 con 0x7fb0c80acd80 2024-04-25T09:06:25.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.761+0000 7fb0cce00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c80cf670 con 0x7fb0c80ae680 2024-04-25T09:06:25.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.761+0000 7fb0cce00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c80b3590 con 0x7fb0c815dbd0 2024-04-25T09:06:25.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.761+0000 7fb0c5e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0c815dbd0 0x7fb0c8071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.761+0000 7fb0bd400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb0c80ae680 0x7fb0c80aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.761+0000 7fb0c6800640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fb0c80acd80 0x7fb0c80ad210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:50338/0 (socket says 172.21.15.175:50338) 2024-04-25T09:06:25.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.765+0000 7fb0c6800640 1 -- 172.21.15.175:0/955799407 learned_addr learned my addr 172.21.15.175:0/955799407 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:25.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.765+0000 7fb0c5e00640 1 -- 172.21.15.175:0/955799407 >> v2:172.21.15.177:3300/0 conn(0x7fb0c80ae680 msgr2=0x7fb0c80aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:25.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.765+0000 7fb0c5e00640 1 --2- 172.21.15.175:0/955799407 >> v2:172.21.15.177:3300/0 conn(0x7fb0c80ae680 0x7fb0c80aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.765+0000 7fb0c5e00640 1 -- 172.21.15.175:0/955799407 >> v1:172.21.15.177:6789/0 conn(0x7fb0c80acd80 legacy=0x7fb0c80ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.765+0000 7fb0c5e00640 1 -- 172.21.15.175:0/955799407 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c80b2980 con 0x7fb0c815dbd0 2024-04-25T09:06:25.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.765+0000 7fb0c5400640 1 -- 172.21.15.175:0/955799407 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4134291259 0 0) 0x7fb0c815dfb0 con 0x7fb0c80acd80 2024-04-25T09:06:25.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.765+0000 7fb0c5e00640 1 --2- 172.21.15.175:0/955799407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0c815dbd0 0x7fb0c8071c50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80097c0 tx=0x7fb0b801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f89fb607989670 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.765+0000 7fb0c5400640 1 -- 172.21.15.175:0/955799407 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b80b2070 con 0x7fb0c815dbd0 2024-04-25T09:06:25.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.765+0000 7fb0c5400640 1 -- 172.21.15.175:0/955799407 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b80ad640 con 0x7fb0c815dbd0 2024-04-25T09:06:25.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.765+0000 7fb0c5400640 1 -- 172.21.15.175:0/955799407 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b80ada10 con 0x7fb0c815dbd0 2024-04-25T09:06:25.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0cce00640 1 -- 172.21.15.175:0/955799407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0c815dbd0 msgr2=0x7fb0c8071c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0cce00640 1 --2- 172.21.15.175:0/955799407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0c815dbd0 0x7fb0c8071c50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80097c0 tx=0x7fb0b801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0cce00640 1 -- 172.21.15.175:0/955799407 shutdown_connections 2024-04-25T09:06:25.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0cce00640 1 --2- 172.21.15.175:0/955799407 >> v2:172.21.15.177:3300/0 conn(0x7fb0c80ae680 0x7fb0c80aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0cce00640 1 --2- 172.21.15.175:0/955799407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0c815dbd0 0x7fb0c8071c50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0cce00640 1 -- 172.21.15.175:0/955799407 >> 172.21.15.175:0/955799407 conn(0x7fb0c8067150 msgr2=0x7fb0c806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0cce00640 1 -- 172.21.15.175:0/955799407 shutdown_connections 2024-04-25T09:06:25.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0cce00640 1 -- 172.21.15.175:0/955799407 wait complete. 2024-04-25T09:06:25.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0cce00640 1 Processor -- start 2024-04-25T09:06:25.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0cce00640 1 -- start start 2024-04-25T09:06:25.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0cce00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0c80ae680 0x7fb0c814c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0cce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0c815dbd0 0x7fb0c80ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0cce00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0c8154e40 0x7fb0c81557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0cce00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c80b2580 con 0x7fb0c815dbd0 2024-04-25T09:06:25.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0cce00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c8072190 con 0x7fb0c80ae680 2024-04-25T09:06:25.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0cce00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c80b2700 con 0x7fb0c8154e40 2024-04-25T09:06:25.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0bd400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0c815dbd0 0x7fb0c80ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0bd400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0c815dbd0 0x7fb0c80ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52310/0 (socket says 172.21.15.175:52310) 2024-04-25T09:06:25.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0bd400640 1 -- 172.21.15.175:0/2939574524 learned_addr learned my addr 172.21.15.175:0/2939574524 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:25.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0c5e00640 1 --2- 172.21.15.175:0/2939574524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0c80ae680 0x7fb0c814c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0c6800640 1 --2- 172.21.15.175:0/2939574524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0c8154e40 0x7fb0c81557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0bd400640 1 -- 172.21.15.175:0/2939574524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0c8154e40 msgr2=0x7fb0c81557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0bd400640 1 --2- 172.21.15.175:0/2939574524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0c8154e40 0x7fb0c81557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0bd400640 1 -- 172.21.15.175:0/2939574524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0c80ae680 msgr2=0x7fb0c814c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0bd400640 1 --2- 172.21.15.175:0/2939574524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0c80ae680 0x7fb0c814c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.769+0000 7fb0bd400640 1 -- 172.21.15.175:0/2939574524 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c80cc9b0 con 0x7fb0c815dbd0 2024-04-25T09:06:25.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.773+0000 7fb0bd400640 1 --2- 172.21.15.175:0/2939574524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0c815dbd0 0x7fb0c80ceaa0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009d10 tx=0x7fb0b000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.773+0000 7fb0bea00640 1 -- 172.21.15.175:0/2939574524 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0018020 con 0x7fb0c815dbd0 2024-04-25T09:06:25.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.773+0000 7fb0bea00640 1 -- 172.21.15.175:0/2939574524 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b0014480 con 0x7fb0c815dbd0 2024-04-25T09:06:25.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.773+0000 7fb0bea00640 1 -- 172.21.15.175:0/2939574524 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0014830 con 0x7fb0c815dbd0 2024-04-25T09:06:25.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.773+0000 7fb0cce00640 1 -- 172.21.15.175:0/2939574524 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c81552f0 con 0x7fb0c815dbd0 2024-04-25T09:06:25.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.773+0000 7fb0cce00640 1 -- 172.21.15.175:0/2939574524 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c80cc6d0 con 0x7fb0c815dbd0 2024-04-25T09:06:25.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.773+0000 7fb0cce00640 1 -- 172.21.15.175:0/2939574524 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c8074a60 con 0x7fb0c815dbd0 2024-04-25T09:06:25.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.773+0000 7fb0bea00640 1 -- 172.21.15.175:0/2939574524 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb0b001b020 con 0x7fb0c815dbd0 2024-04-25T09:06:25.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.773+0000 7fb0bea00640 1 --2- 172.21.15.175:0/2939574524 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb0a4066f90 0x7fb0a4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.773+0000 7fb0bea00640 1 -- 172.21.15.175:0/2939574524 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb0b0085c70 con 0x7fb0c815dbd0 2024-04-25T09:06:25.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.773+0000 7fb0c5e00640 1 --2- 172.21.15.175:0/2939574524 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb0a4066f90 0x7fb0a4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.777+0000 7fb0c5e00640 1 --2- 172.21.15.175:0/2939574524 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb0a4066f90 0x7fb0a4069450 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80af000 tx=0x7fb0b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.777+0000 7fb0bea00640 1 -- 172.21.15.175:0/2939574524 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb0b0022030 con 0x7fb0c815dbd0 2024-04-25T09:06:25.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.933+0000 7fb0cce00640 1 -- 172.21.15.175:0/2939574524 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0c806afd0 con 0x7fb0c815dbd0 2024-04-25T09:06:25.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.937+0000 7fb0bea00640 1 -- 172.21.15.175:0/2939574524 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16741 (secure 0 0 0) 0x7fb0b0010040 con 0x7fb0c815dbd0 2024-04-25T09:06:25.925 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:25.925 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":46,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:05:52.004266+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:43.050603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:44.332424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.1b","mappings":[{"from":0,"to":4}]},{"pgid":"7.37","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:25.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.937+0000 7fb0cce00640 1 -- 172.21.15.175:0/2939574524 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb0a4066f90 msgr2=0x7fb0a4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.937+0000 7fb0cce00640 1 --2- 172.21.15.175:0/2939574524 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb0a4066f90 0x7fb0a4069450 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80af000 tx=0x7fb0b8008040 comp rx=0 tx=0).stop 2024-04-25T09:06:25.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.937+0000 7fb0cce00640 1 -- 172.21.15.175:0/2939574524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0c815dbd0 msgr2=0x7fb0c80ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.937+0000 7fb0cce00640 1 --2- 172.21.15.175:0/2939574524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0c815dbd0 0x7fb0c80ceaa0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009d10 tx=0x7fb0b000c490 comp rx=0 tx=0).stop 2024-04-25T09:06:25.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.937+0000 7fb0cce00640 1 -- 172.21.15.175:0/2939574524 shutdown_connections 2024-04-25T09:06:25.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.937+0000 7fb0cce00640 1 --2- 172.21.15.175:0/2939574524 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb0a4066f90 0x7fb0a4069450 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.937+0000 7fb0cce00640 1 --2- 172.21.15.175:0/2939574524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0c8154e40 0x7fb0c81557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.937+0000 7fb0cce00640 1 --2- 172.21.15.175:0/2939574524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0c815dbd0 0x7fb0c80ceaa0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.937+0000 7fb0cce00640 1 --2- 172.21.15.175:0/2939574524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0c80ae680 0x7fb0c814c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.937+0000 7fb0cce00640 1 -- 172.21.15.175:0/2939574524 >> 172.21.15.175:0/2939574524 conn(0x7fb0c80acd80 msgr2=0x7fb0c80b09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.937+0000 7fb0cce00640 1 -- 172.21.15.175:0/2939574524 shutdown_connections 2024-04-25T09:06:25.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:25.937+0000 7fb0cce00640 1 -- 172.21.15.175:0/2939574524 wait complete. 2024-04-25T09:06:25.947 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:05:43.050603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:05:44.332424+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:06:25.948 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:06:26.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.101+0000 7efea3200640 1 Processor -- start 2024-04-25T09:06:26.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.101+0000 7efea3200640 1 -- start start 2024-04-25T09:06:26.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.101+0000 7efea3200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efe9c145250 0x7efe9c0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.101+0000 7efea3200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe9c0ce970 0x7efe9c0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.101+0000 7efea3200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe9c0cfd10 con 0x7efe9c1600a0 2024-04-25T09:06:26.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.101+0000 7efea3200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe9c15f650 con 0x7efe9c145250 2024-04-25T09:06:26.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.101+0000 7efea3200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c0cfff0 con 0x7efe9c0ce970 2024-04-25T09:06:26.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.101+0000 7efea1200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe9c0ce970 0x7efe9c0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.101+0000 7efe9be00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efe9c145250 0x7efe9c0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.101+0000 7efea1200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe9c0ce970 0x7efe9c0cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:53022/0 (socket says 172.21.15.175:53022) 2024-04-25T09:06:26.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.101+0000 7efe93400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7efe9c1600a0 0x7efe9c0cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:50346/0 (socket says 172.21.15.175:50346) 2024-04-25T09:06:26.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.101+0000 7efea1200640 1 -- 172.21.15.175:0/3751585413 learned_addr learned my addr 172.21.15.175:0/3751585413 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:26.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.105+0000 7efea1200640 1 -- 172.21.15.175:0/3751585413 >> v2:172.21.15.177:3300/0 conn(0x7efe9c145250 msgr2=0x7efe9c0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:26.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.105+0000 7efea1200640 1 --2- 172.21.15.175:0/3751585413 >> v2:172.21.15.177:3300/0 conn(0x7efe9c145250 0x7efe9c0cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.105+0000 7efea1200640 1 -- 172.21.15.175:0/3751585413 >> v1:172.21.15.177:6789/0 conn(0x7efe9c1600a0 legacy=0x7efe9c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.105+0000 7efea1200640 1 -- 172.21.15.175:0/3751585413 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c15f8a0 con 0x7efe9c0ce970 2024-04-25T09:06:26.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.105+0000 7efea1200640 1 --2- 172.21.15.175:0/3751585413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe9c0ce970 0x7efe9c0cee00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efe940098a0 tx=0x7efe9401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ac173cd1a2fba21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:26.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.105+0000 7efe9b400640 1 -- 172.21.15.175:0/3751585413 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe940aa600 con 0x7efe9c0ce970 2024-04-25T09:06:26.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.105+0000 7efe9b400640 1 -- 172.21.15.175:0/3751585413 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe940af070 con 0x7efe9c0ce970 2024-04-25T09:06:26.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.105+0000 7efe9b400640 1 -- 172.21.15.175:0/3751585413 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe940aa9c0 con 0x7efe9c0ce970 2024-04-25T09:06:26.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efea3200640 1 -- 172.21.15.175:0/3751585413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe9c0ce970 msgr2=0x7efe9c0cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efea3200640 1 --2- 172.21.15.175:0/3751585413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe9c0ce970 0x7efe9c0cee00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efe940098a0 tx=0x7efe9401c480 comp rx=0 tx=0).stop 2024-04-25T09:06:26.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efea3200640 1 -- 172.21.15.175:0/3751585413 shutdown_connections 2024-04-25T09:06:26.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efea3200640 1 --2- 172.21.15.175:0/3751585413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe9c0ce970 0x7efe9c0cee00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efea3200640 1 --2- 172.21.15.175:0/3751585413 >> v2:172.21.15.177:3300/0 conn(0x7efe9c145250 0x7efe9c0cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efea3200640 1 -- 172.21.15.175:0/3751585413 >> 172.21.15.175:0/3751585413 conn(0x7efe9c06ac50 msgr2=0x7efe9c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:26.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efea3200640 1 -- 172.21.15.175:0/3751585413 shutdown_connections 2024-04-25T09:06:26.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efea3200640 1 -- 172.21.15.175:0/3751585413 wait complete. 2024-04-25T09:06:26.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efea3200640 1 Processor -- start 2024-04-25T09:06:26.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efea3200640 1 -- start start 2024-04-25T09:06:26.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efea3200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe9c0ce970 0x7efe9c0a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efea3200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe9c145250 0x7efe9c13d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efea3200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe9c1600a0 0x7efe9c158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efea3200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c15c870 con 0x7efe9c145250 2024-04-25T09:06:26.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efea3200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c1604b0 con 0x7efe9c0ce970 2024-04-25T09:06:26.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efea3200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c15c9f0 con 0x7efe9c1600a0 2024-04-25T09:06:26.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efe9be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe9c0ce970 0x7efe9c0a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efe93400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe9c145250 0x7efe9c13d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efe9be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe9c0ce970 0x7efe9c0a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:41388/0 (socket says 172.21.15.175:41388) 2024-04-25T09:06:26.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efe9be00640 1 -- 172.21.15.175:0/1523919920 learned_addr learned my addr 172.21.15.175:0/1523919920 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:26.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efea1200640 1 --2- 172.21.15.175:0/1523919920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe9c1600a0 0x7efe9c158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efe9be00640 1 -- 172.21.15.175:0/1523919920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe9c1600a0 msgr2=0x7efe9c158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efe9be00640 1 --2- 172.21.15.175:0/1523919920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe9c1600a0 0x7efe9c158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efe9be00640 1 -- 172.21.15.175:0/1523919920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe9c145250 msgr2=0x7efe9c13d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efe9be00640 1 --2- 172.21.15.175:0/1523919920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe9c145250 0x7efe9c13d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.109+0000 7efe9be00640 1 -- 172.21.15.175:0/1523919920 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c15dfe0 con 0x7efe9c0ce970 2024-04-25T09:06:26.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.113+0000 7efe9be00640 1 --2- 172.21.15.175:0/1523919920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe9c0ce970 0x7efe9c0a84b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efe8c00efc0 tx=0x7efe8c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:26.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.113+0000 7efe98c00640 1 -- 172.21.15.175:0/1523919920 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c018020 con 0x7efe9c0ce970 2024-04-25T09:06:26.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.113+0000 7efe98c00640 1 -- 172.21.15.175:0/1523919920 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8c014480 con 0x7efe9c0ce970 2024-04-25T09:06:26.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.113+0000 7efea3200640 1 -- 172.21.15.175:0/1523919920 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe9c1459c0 con 0x7efe9c0ce970 2024-04-25T09:06:26.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.113+0000 7efe98c00640 1 -- 172.21.15.175:0/1523919920 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c014850 con 0x7efe9c0ce970 2024-04-25T09:06:26.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.113+0000 7efea3200640 1 -- 172.21.15.175:0/1523919920 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9c145c80 con 0x7efe9c0ce970 2024-04-25T09:06:26.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.113+0000 7efea3200640 1 -- 172.21.15.175:0/1523919920 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe9c075160 con 0x7efe9c0ce970 2024-04-25T09:06:26.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.113+0000 7efe98c00640 1 -- 172.21.15.175:0/1523919920 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efe8c01b020 con 0x7efe9c0ce970 2024-04-25T09:06:26.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.113+0000 7efe98c00640 1 --2- 172.21.15.175:0/1523919920 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efe78066f60 0x7efe78069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.113+0000 7efe98c00640 1 -- 172.21.15.175:0/1523919920 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7efe8c086220 con 0x7efe9c0ce970 2024-04-25T09:06:26.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.113+0000 7efe93400640 1 --2- 172.21.15.175:0/1523919920 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efe78066f60 0x7efe78069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.117+0000 7efe93400640 1 --2- 172.21.15.175:0/1523919920 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efe78066f60 0x7efe78069420 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efe9c144c50 tx=0x7efe84007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:26.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.117+0000 7efe98c00640 1 -- 172.21.15.175:0/1523919920 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efe8c022070 con 0x7efe9c0ce970 2024-04-25T09:06:26.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.273+0000 7efea3200640 1 -- 172.21.15.175:0/1523919920 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe9c140b20 con 0x7efe9c0ce970 2024-04-25T09:06:26.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.273+0000 7efe98c00640 1 -- 172.21.15.175:0/1523919920 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe8c010040 con 0x7efe9c0ce970 2024-04-25T09:06:26.264 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:06:26.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.277+0000 7efea3200640 1 -- 172.21.15.175:0/1523919920 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efe78066f60 msgr2=0x7efe78069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.277+0000 7efea3200640 1 --2- 172.21.15.175:0/1523919920 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efe78066f60 0x7efe78069420 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efe9c144c50 tx=0x7efe84007e90 comp rx=0 tx=0).stop 2024-04-25T09:06:26.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.277+0000 7efea3200640 1 -- 172.21.15.175:0/1523919920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe9c0ce970 msgr2=0x7efe9c0a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.277+0000 7efea3200640 1 --2- 172.21.15.175:0/1523919920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe9c0ce970 0x7efe9c0a84b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efe8c00efc0 tx=0x7efe8c00c490 comp rx=0 tx=0).stop 2024-04-25T09:06:26.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.277+0000 7efea3200640 1 -- 172.21.15.175:0/1523919920 shutdown_connections 2024-04-25T09:06:26.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.277+0000 7efea3200640 1 --2- 172.21.15.175:0/1523919920 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efe78066f60 0x7efe78069420 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.277+0000 7efea3200640 1 --2- 172.21.15.175:0/1523919920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe9c1600a0 0x7efe9c158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.277+0000 7efea3200640 1 --2- 172.21.15.175:0/1523919920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe9c145250 0x7efe9c13d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.277+0000 7efea3200640 1 --2- 172.21.15.175:0/1523919920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe9c0ce970 0x7efe9c0a84b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.277+0000 7efea3200640 1 -- 172.21.15.175:0/1523919920 >> 172.21.15.175:0/1523919920 conn(0x7efe9c06ac50 msgr2=0x7efe9c0b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:26.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.277+0000 7efea3200640 1 -- 172.21.15.175:0/1523919920 shutdown_connections 2024-04-25T09:06:26.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.277+0000 7efea3200640 1 -- 172.21.15.175:0/1523919920 wait complete. 2024-04-25T09:06:26.285 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:06:26.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.433+0000 7f6430200640 1 Processor -- start 2024-04-25T09:06:26.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.433+0000 7f6430200640 1 -- start start 2024-04-25T09:06:26.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.437+0000 7f6430200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f64280af980 0x7f64280afed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.437+0000 7f6430200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f642806b510 0x7f642815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.437+0000 7f6430200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64280ccc80 con 0x7f64280b0c00 2024-04-25T09:06:26.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.437+0000 7f6430200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64280b2010 con 0x7f64280af980 2024-04-25T09:06:26.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.437+0000 7f6430200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64280ce6d0 con 0x7f642806b510 2024-04-25T09:06:26.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.437+0000 7f642ce00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f64280af980 0x7f64280afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.437+0000 7f642ce00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f64280af980 0x7f64280afed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52336/0 (socket says 172.21.15.175:52336) 2024-04-25T09:06:26.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.437+0000 7f642ce00640 1 -- 172.21.15.175:0/4576105 learned_addr learned my addr 172.21.15.175:0/4576105 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:26.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.437+0000 7f642e200640 1 --2- 172.21.15.175:0/4576105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f642806b510 0x7f642815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.437+0000 7f642ce00640 1 -- 172.21.15.175:0/4576105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f642806b510 msgr2=0x7f642815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:26.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.437+0000 7f642ce00640 1 --2- 172.21.15.175:0/4576105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f642806b510 0x7f642815d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.437+0000 7f642ce00640 1 -- 172.21.15.175:0/4576105 >> v1:172.21.15.177:6789/0 conn(0x7f64280b0c00 legacy=0x7f642806ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.437+0000 7f642ce00640 1 -- 172.21.15.175:0/4576105 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64280ccf60 con 0x7f64280af980 2024-04-25T09:06:26.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.437+0000 7f642ce00640 1 --2- 172.21.15.175:0/4576105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64280af980 0x7f64280afed0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6414009870 tx=0x7f641401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f769720c79db2d08 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:26.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6427e00640 1 -- 172.21.15.175:0/4576105 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64140a95f0 con 0x7f64280af980 2024-04-25T09:06:26.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6427e00640 1 -- 172.21.15.175:0/4576105 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64140a9790 con 0x7f64280af980 2024-04-25T09:06:26.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6427e00640 1 -- 172.21.15.175:0/4576105 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64140a9b60 con 0x7f64280af980 2024-04-25T09:06:26.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6430200640 1 -- 172.21.15.175:0/4576105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64280af980 msgr2=0x7f64280afed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6430200640 1 --2- 172.21.15.175:0/4576105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64280af980 0x7f64280afed0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6414009870 tx=0x7f641401c530 comp rx=0 tx=0).stop 2024-04-25T09:06:26.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6430200640 1 -- 172.21.15.175:0/4576105 shutdown_connections 2024-04-25T09:06:26.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6430200640 1 --2- 172.21.15.175:0/4576105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f642806b510 0x7f642815d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6430200640 1 --2- 172.21.15.175:0/4576105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64280af980 0x7f64280afed0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6430200640 1 -- 172.21.15.175:0/4576105 >> 172.21.15.175:0/4576105 conn(0x7f64280d07e0 msgr2=0x7f64280d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:26.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6430200640 1 -- 172.21.15.175:0/4576105 shutdown_connections 2024-04-25T09:06:26.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6430200640 1 -- 172.21.15.175:0/4576105 wait complete. 2024-04-25T09:06:26.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6430200640 1 Processor -- start 2024-04-25T09:06:26.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6430200640 1 -- start start 2024-04-25T09:06:26.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6430200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f642806b510 0x7f6428156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6430200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64280af980 0x7f642815cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6430200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64280b0c00 0x7f642815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6430200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64280cd340 con 0x7f64280af980 2024-04-25T09:06:26.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6430200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64280cd1c0 con 0x7f642806b510 2024-04-25T09:06:26.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f6430200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64280cd4c0 con 0x7f64280b0c00 2024-04-25T09:06:26.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f642ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64280af980 0x7f642815cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f642ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64280af980 0x7f642815cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52344/0 (socket says 172.21.15.175:52344) 2024-04-25T09:06:26.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f642ce00640 1 -- 172.21.15.175:0/1105732231 learned_addr learned my addr 172.21.15.175:0/1105732231 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:26.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.441+0000 7f642d800640 1 --2- 172.21.15.175:0/1105732231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f642806b510 0x7f6428156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.445+0000 7f642e200640 1 --2- 172.21.15.175:0/1105732231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64280b0c00 0x7f642815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.445+0000 7f642ce00640 1 -- 172.21.15.175:0/1105732231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64280b0c00 msgr2=0x7f642815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.445+0000 7f642ce00640 1 --2- 172.21.15.175:0/1105732231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64280b0c00 0x7f642815bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.445+0000 7f642ce00640 1 -- 172.21.15.175:0/1105732231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f642806b510 msgr2=0x7f6428156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.445+0000 7f642ce00640 1 --2- 172.21.15.175:0/1105732231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f642806b510 0x7f6428156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.445+0000 7f642ce00640 1 -- 172.21.15.175:0/1105732231 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642815d480 con 0x7f64280af980 2024-04-25T09:06:26.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.445+0000 7f642ce00640 1 --2- 172.21.15.175:0/1105732231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64280af980 0x7f642815cf40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f64140ab040 tx=0x7f641401ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:26.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.445+0000 7f6425600640 1 -- 172.21.15.175:0/1105732231 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64140b1800 con 0x7f64280af980 2024-04-25T09:06:26.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.445+0000 7f6425600640 1 -- 172.21.15.175:0/1105732231 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64140b19c0 con 0x7f64280af980 2024-04-25T09:06:26.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.445+0000 7f6425600640 1 -- 172.21.15.175:0/1105732231 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64140b1db0 con 0x7f64280af980 2024-04-25T09:06:26.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.445+0000 7f6430200640 1 -- 172.21.15.175:0/1105732231 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64280c9c90 con 0x7f64280af980 2024-04-25T09:06:26.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.445+0000 7f6430200640 1 -- 172.21.15.175:0/1105732231 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64280ca210 con 0x7f64280af980 2024-04-25T09:06:26.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.445+0000 7f6430200640 1 -- 172.21.15.175:0/1105732231 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642806ccf0 con 0x7f64280af980 2024-04-25T09:06:26.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.445+0000 7f6425600640 1 -- 172.21.15.175:0/1105732231 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f64140bc450 con 0x7f64280af980 2024-04-25T09:06:26.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.445+0000 7f6425600640 1 --2- 172.21.15.175:0/1105732231 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6408066f90 0x7f6408069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.445+0000 7f6425600640 1 -- 172.21.15.175:0/1105732231 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f641411f9e0 con 0x7f64280af980 2024-04-25T09:06:26.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.449+0000 7f642d800640 1 --2- 172.21.15.175:0/1105732231 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6408066f90 0x7f6408069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.449+0000 7f642d800640 1 --2- 172.21.15.175:0/1105732231 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6408066f90 0x7f6408069450 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f641c001770 tx=0x7f641c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:26.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.449+0000 7f6425600640 1 -- 172.21.15.175:0/1105732231 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f64140ad020 con 0x7f64280af980 2024-04-25T09:06:26.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.605+0000 7f6430200640 1 -- 172.21.15.175:0/1105732231 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6428075160 con 0x7f64280af980 2024-04-25T09:06:26.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.605+0000 7f6425600640 1 -- 172.21.15.175:0/1105732231 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6414016150 con 0x7f64280af980 2024-04-25T09:06:26.595 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:06:26.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.605+0000 7f6430200640 1 -- 172.21.15.175:0/1105732231 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6408066f90 msgr2=0x7f6408069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.605+0000 7f6430200640 1 --2- 172.21.15.175:0/1105732231 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6408066f90 0x7f6408069450 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f641c001770 tx=0x7f641c009040 comp rx=0 tx=0).stop 2024-04-25T09:06:26.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.605+0000 7f6430200640 1 -- 172.21.15.175:0/1105732231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64280af980 msgr2=0x7f642815cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.605+0000 7f6430200640 1 --2- 172.21.15.175:0/1105732231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64280af980 0x7f642815cf40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f64140ab040 tx=0x7f641401ad70 comp rx=0 tx=0).stop 2024-04-25T09:06:26.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.609+0000 7f6430200640 1 -- 172.21.15.175:0/1105732231 shutdown_connections 2024-04-25T09:06:26.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.609+0000 7f6430200640 1 --2- 172.21.15.175:0/1105732231 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6408066f90 0x7f6408069450 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.609+0000 7f6430200640 1 --2- 172.21.15.175:0/1105732231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64280b0c00 0x7f642815bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.609+0000 7f6430200640 1 --2- 172.21.15.175:0/1105732231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64280af980 0x7f642815cf40 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.609+0000 7f6430200640 1 --2- 172.21.15.175:0/1105732231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f642806b510 0x7f6428156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.609+0000 7f6430200640 1 -- 172.21.15.175:0/1105732231 >> 172.21.15.175:0/1105732231 conn(0x7f64280d07e0 msgr2=0x7f64280c6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:26.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.609+0000 7f6430200640 1 -- 172.21.15.175:0/1105732231 shutdown_connections 2024-04-25T09:06:26.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.609+0000 7f6430200640 1 -- 172.21.15.175:0/1105732231 wait complete. 2024-04-25T09:06:26.615 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:06:26.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.765+0000 7ff6bd000640 1 Processor -- start 2024-04-25T09:06:26.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.765+0000 7ff6bd000640 1 -- start start 2024-04-25T09:06:26.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.765+0000 7ff6bd000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6b8145250 0x7ff6b80cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.765+0000 7ff6bd000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b80cfd10 con 0x7ff6b80ce970 2024-04-25T09:06:26.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.765+0000 7ff6bd000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b80cfff0 con 0x7ff6b81600a0 2024-04-25T09:06:26.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.765+0000 7ff6bd000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b815f650 con 0x7ff6b8145250 2024-04-25T09:06:26.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.765+0000 7ff6b6800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff6b80ce970 0x7ff6b80cee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59102/0 (socket says 172.21.15.175:59102) 2024-04-25T09:06:26.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.765+0000 7ff6b6800640 1 -- 172.21.15.175:0/2403409143 learned_addr learned my addr 172.21.15.175:0/2403409143 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:26.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.765+0000 7ff6b5e00640 1 --2- 172.21.15.175:0/2403409143 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6b8145250 0x7ff6b80cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.765+0000 7ff6b5400640 1 -- 172.21.15.175:0/2403409143 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542320879 0 0) 0x7ff6b80cfd10 con 0x7ff6b80ce970 2024-04-25T09:06:26.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.765+0000 7ff6b5400640 1 -- 172.21.15.175:0/2403409143 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff69c003530 con 0x7ff6b80ce970 2024-04-25T09:06:26.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.765+0000 7ff6b5e00640 1 -- 172.21.15.175:0/2403409143 >> v1:172.21.15.177:6789/0 conn(0x7ff6b81600a0 legacy=0x7ff6b80cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.765+0000 7ff6b5400640 1 -- 172.21.15.175:0/2403409143 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061619717 0 0) 0x7ff6b80cfff0 con 0x7ff6b81600a0 2024-04-25T09:06:26.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.765+0000 7ff6b5e00640 1 -- 172.21.15.175:0/2403409143 >> v1:172.21.15.175:6789/0 conn(0x7ff6b80ce970 legacy=0x7ff6b80cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.765+0000 7ff6b5e00640 1 -- 172.21.15.175:0/2403409143 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b815f8a0 con 0x7ff6b8145250 2024-04-25T09:06:26.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.769+0000 7ff6b5e00640 1 --2- 172.21.15.175:0/2403409143 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6b8145250 0x7ff6b80cf6b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80097f0 tx=0x7ff6a801c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee3164a120c94000 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:26.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.769+0000 7ff6b5400640 1 -- 172.21.15.175:0/2403409143 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80b1070 con 0x7ff6b8145250 2024-04-25T09:06:26.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.769+0000 7ff6b5400640 1 -- 172.21.15.175:0/2403409143 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a80ac410 con 0x7ff6b8145250 2024-04-25T09:06:26.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.769+0000 7ff6b5400640 1 -- 172.21.15.175:0/2403409143 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80ac7c0 con 0x7ff6b8145250 2024-04-25T09:06:26.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.769+0000 7ff6bd000640 1 -- 172.21.15.175:0/2403409143 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6b8145250 msgr2=0x7ff6b80cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.769+0000 7ff6bd000640 1 --2- 172.21.15.175:0/2403409143 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6b8145250 0x7ff6b80cf6b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80097f0 tx=0x7ff6a801c390 comp rx=0 tx=0).stop 2024-04-25T09:06:26.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.769+0000 7ff6bd000640 1 -- 172.21.15.175:0/2403409143 shutdown_connections 2024-04-25T09:06:26.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.769+0000 7ff6bd000640 1 --2- 172.21.15.175:0/2403409143 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6b8145250 0x7ff6b80cf6b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.769+0000 7ff6bd000640 1 -- 172.21.15.175:0/2403409143 >> 172.21.15.175:0/2403409143 conn(0x7ff6b806ac50 msgr2=0x7ff6b806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:26.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.769+0000 7ff6bd000640 1 -- 172.21.15.175:0/2403409143 shutdown_connections 2024-04-25T09:06:26.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.769+0000 7ff6bd000640 1 -- 172.21.15.175:0/2403409143 wait complete. 2024-04-25T09:06:26.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6bd000640 1 Processor -- start 2024-04-25T09:06:26.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6bd000640 1 -- start start 2024-04-25T09:06:26.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6bd000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6b80ce970 0x7ff6b80b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6bd000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6b8145250 0x7ff6b8140200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6bd000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6b81600a0 0x7ff6b813b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6bd000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b815c9f0 con 0x7ff6b8145250 2024-04-25T09:06:26.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6bd000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b815c870 con 0x7ff6b81600a0 2024-04-25T09:06:26.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6bd000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b815cb70 con 0x7ff6b80ce970 2024-04-25T09:06:26.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6ad400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6b8145250 0x7ff6b8140200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6ad400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6b8145250 0x7ff6b8140200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52356/0 (socket says 172.21.15.175:52356) 2024-04-25T09:06:26.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6ad400640 1 -- 172.21.15.175:0/2854804110 learned_addr learned my addr 172.21.15.175:0/2854804110 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:26.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6b5e00640 1 --2- 172.21.15.175:0/2854804110 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6b80ce970 0x7ff6b80b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6b6800640 1 --2- 172.21.15.175:0/2854804110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6b81600a0 0x7ff6b813b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6ad400640 1 -- 172.21.15.175:0/2854804110 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6b80ce970 msgr2=0x7ff6b80b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6ad400640 1 --2- 172.21.15.175:0/2854804110 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6b80ce970 0x7ff6b80b4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6ad400640 1 -- 172.21.15.175:0/2854804110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6b81600a0 msgr2=0x7ff6b813b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6ad400640 1 --2- 172.21.15.175:0/2854804110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6b81600a0 0x7ff6b813b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6ad400640 1 -- 172.21.15.175:0/2854804110 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b80b4740 con 0x7ff6b8145250 2024-04-25T09:06:26.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6b5e00640 1 --2- 172.21.15.175:0/2854804110 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6b80ce970 0x7ff6b80b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:26.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6ad400640 1 --2- 172.21.15.175:0/2854804110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6b8145250 0x7ff6b8140200 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0001ec0 tx=0x7ff6a000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:26.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6aea00640 1 -- 172.21.15.175:0/2854804110 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0017070 con 0x7ff6b8145250 2024-04-25T09:06:26.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6aea00640 1 -- 172.21.15.175:0/2854804110 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a0003600 con 0x7ff6b8145250 2024-04-25T09:06:26.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6aea00640 1 -- 172.21.15.175:0/2854804110 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a00039f0 con 0x7ff6b8145250 2024-04-25T09:06:26.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6bd000640 1 -- 172.21.15.175:0/2854804110 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b80adb70 con 0x7ff6b8145250 2024-04-25T09:06:26.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.773+0000 7ff6bd000640 1 -- 172.21.15.175:0/2854804110 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b80ae130 con 0x7ff6b8145250 2024-04-25T09:06:26.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.777+0000 7ff6bd000640 1 -- 172.21.15.175:0/2854804110 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b8075160 con 0x7ff6b8145250 2024-04-25T09:06:26.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.777+0000 7ff6aea00640 1 -- 172.21.15.175:0/2854804110 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff6a001a070 con 0x7ff6b8145250 2024-04-25T09:06:26.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.777+0000 7ff6aea00640 1 --2- 172.21.15.175:0/2854804110 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff694066f60 0x7ff694069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.777+0000 7ff6aea00640 1 -- 172.21.15.175:0/2854804110 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff6a0084470 con 0x7ff6b8145250 2024-04-25T09:06:26.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.777+0000 7ff6b5e00640 1 --2- 172.21.15.175:0/2854804110 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff694066f60 0x7ff694069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.777+0000 7ff6b5e00640 1 --2- 172.21.15.175:0/2854804110 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff694066f60 0x7ff694069420 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80ae000 tx=0x7ff6a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:26.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.781+0000 7ff6aea00640 1 -- 172.21.15.175:0/2854804110 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff6a0055430 con 0x7ff6b8145250 2024-04-25T09:06:26.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.937+0000 7ff6bd000640 1 -- 172.21.15.175:0/2854804110 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6b806e1c0 con 0x7ff6b8145250 2024-04-25T09:06:26.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.937+0000 7ff6aea00640 1 -- 172.21.15.175:0/2854804110 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff6a0054d30 con 0x7ff6b8145250 2024-04-25T09:06:26.926 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:06:26.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.937+0000 7ff6bd000640 1 -- 172.21.15.175:0/2854804110 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff694066f60 msgr2=0x7ff694069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.937+0000 7ff6bd000640 1 --2- 172.21.15.175:0/2854804110 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff694066f60 0x7ff694069420 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80ae000 tx=0x7ff6a8008040 comp rx=0 tx=0).stop 2024-04-25T09:06:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.937+0000 7ff6bd000640 1 -- 172.21.15.175:0/2854804110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6b8145250 msgr2=0x7ff6b8140200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.937+0000 7ff6bd000640 1 --2- 172.21.15.175:0/2854804110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6b8145250 0x7ff6b8140200 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0001ec0 tx=0x7ff6a000c8e0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.937+0000 7ff6bd000640 1 -- 172.21.15.175:0/2854804110 shutdown_connections 2024-04-25T09:06:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.937+0000 7ff6bd000640 1 --2- 172.21.15.175:0/2854804110 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff694066f60 0x7ff694069420 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.937+0000 7ff6bd000640 1 --2- 172.21.15.175:0/2854804110 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6b81600a0 0x7ff6b813b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.937+0000 7ff6bd000640 1 --2- 172.21.15.175:0/2854804110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6b8145250 0x7ff6b8140200 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.937+0000 7ff6bd000640 1 --2- 172.21.15.175:0/2854804110 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6b80ce970 0x7ff6b80b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.937+0000 7ff6bd000640 1 -- 172.21.15.175:0/2854804110 >> 172.21.15.175:0/2854804110 conn(0x7ff6b806ac50 msgr2=0x7ff6b80cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.937+0000 7ff6bd000640 1 -- 172.21.15.175:0/2854804110 shutdown_connections 2024-04-25T09:06:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:26.937+0000 7ff6bd000640 1 -- 172.21.15.175:0/2854804110 wait complete. 2024-04-25T09:06:26.947 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:06:27.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.093+0000 7f6e06200640 1 Processor -- start 2024-04-25T09:06:27.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.093+0000 7f6e06200640 1 -- start start 2024-04-25T09:06:27.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.093+0000 7f6e06200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e000cf6b0 0x7f6e001600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.093+0000 7f6e06200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6e000ce970 0x7f6e000cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.093+0000 7f6e06200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e000cfd10 con 0x7f6e00145250 2024-04-25T09:06:27.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.093+0000 7f6e06200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e001605e0 con 0x7f6e000ce970 2024-04-25T09:06:27.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.093+0000 7f6e06200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0015f650 con 0x7f6e000cf6b0 2024-04-25T09:06:27.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.093+0000 7f6dffe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6e000ce970 0x7f6e000cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.093+0000 7f6dff400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f6e00145250 0x7f6e000cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59106/0 (socket says 172.21.15.175:59106) 2024-04-25T09:06:27.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.093+0000 7f6dff400640 1 -- 172.21.15.175:0/3935199467 learned_addr learned my addr 172.21.15.175:0/3935199467 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.093+0000 7f6dfea00640 1 --2- 172.21.15.175:0/3935199467 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e000cf6b0 0x7f6e001600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.097+0000 7f6dffe00640 1 -- 172.21.15.175:0/3935199467 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e000cf6b0 msgr2=0x7f6e001600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.097+0000 7f6dffe00640 1 --2- 172.21.15.175:0/3935199467 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e000cf6b0 0x7f6e001600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.097+0000 7f6dfe000640 1 -- 172.21.15.175:0/3935199467 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085655845 0 0) 0x7f6e000cfd10 con 0x7f6e00145250 2024-04-25T09:06:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.097+0000 7f6dffe00640 1 -- 172.21.15.175:0/3935199467 >> v1:172.21.15.175:6789/0 conn(0x7f6e00145250 legacy=0x7f6e000cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.097+0000 7f6dffe00640 1 -- 172.21.15.175:0/3935199467 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e000cfff0 con 0x7f6e000ce970 2024-04-25T09:06:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.097+0000 7f6dffe00640 1 --2- 172.21.15.175:0/3935199467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e000ce970 0x7f6e000cee00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009d90 tx=0x7f6df801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ce0399f9659301 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.097+0000 7f6dfe000640 1 -- 172.21.15.175:0/3935199467 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df80b2070 con 0x7f6e000ce970 2024-04-25T09:06:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.097+0000 7f6dfe000640 1 -- 172.21.15.175:0/3935199467 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df80a5890 con 0x7f6e000ce970 2024-04-25T09:06:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.097+0000 7f6dfe000640 1 -- 172.21.15.175:0/3935199467 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df80a5c60 con 0x7f6e000ce970 2024-04-25T09:06:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.097+0000 7f6e06200640 1 -- 172.21.15.175:0/3935199467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e000ce970 msgr2=0x7f6e000cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.097+0000 7f6e06200640 1 --2- 172.21.15.175:0/3935199467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e000ce970 0x7f6e000cee00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6df8009d90 tx=0x7f6df801c8e0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.097+0000 7f6e06200640 1 -- 172.21.15.175:0/3935199467 shutdown_connections 2024-04-25T09:06:27.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.097+0000 7f6e06200640 1 --2- 172.21.15.175:0/3935199467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e000ce970 0x7f6e000cee00 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.097+0000 7f6e06200640 1 --2- 172.21.15.175:0/3935199467 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e000cf6b0 0x7f6e001600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.097+0000 7f6e06200640 1 -- 172.21.15.175:0/3935199467 >> 172.21.15.175:0/3935199467 conn(0x7f6e0006ac50 msgr2=0x7f6e0006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:27.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.097+0000 7f6e06200640 1 -- 172.21.15.175:0/3935199467 shutdown_connections 2024-04-25T09:06:27.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.097+0000 7f6e06200640 1 -- 172.21.15.175:0/3935199467 wait complete. 2024-04-25T09:06:27.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6e06200640 1 Processor -- start 2024-04-25T09:06:27.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6e06200640 1 -- start start 2024-04-25T09:06:27.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6e06200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e000ce970 0x7f6e00166150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6e06200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e000cf6b0 0x7f6e000b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6e06200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e00145250 0x7f6e0015b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6e06200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0015c870 con 0x7f6e000ce970 2024-04-25T09:06:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6e06200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e00145630 con 0x7f6e000cf6b0 2024-04-25T09:06:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6e06200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0015c9f0 con 0x7f6e00145250 2024-04-25T09:06:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6dff400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e000ce970 0x7f6e00166150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6dff400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e000ce970 0x7f6e00166150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52366/0 (socket says 172.21.15.175:52366) 2024-04-25T09:06:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6dff400640 1 -- 172.21.15.175:0/1361281954 learned_addr learned my addr 172.21.15.175:0/1361281954 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6dfea00640 1 --2- 172.21.15.175:0/1361281954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e000cf6b0 0x7f6e000b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6dffe00640 1 --2- 172.21.15.175:0/1361281954 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e00145250 0x7f6e0015b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6dff400640 1 -- 172.21.15.175:0/1361281954 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e00145250 msgr2=0x7f6e0015b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6dff400640 1 --2- 172.21.15.175:0/1361281954 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e00145250 0x7f6e0015b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6dff400640 1 -- 172.21.15.175:0/1361281954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e000cf6b0 msgr2=0x7f6e000b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6dff400640 1 --2- 172.21.15.175:0/1361281954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e000cf6b0 0x7f6e000b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6dff400640 1 -- 172.21.15.175:0/1361281954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e000b2e60 con 0x7f6e000ce970 2024-04-25T09:06:27.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6dfea00640 1 --2- 172.21.15.175:0/1361281954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e000cf6b0 0x7f6e000b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:27.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6dff400640 1 --2- 172.21.15.175:0/1361281954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e000ce970 0x7f6e00166150 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6df000c4b0 tx=0x7f6df000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6df7400640 1 -- 172.21.15.175:0/1361281954 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df0018070 con 0x7f6e000ce970 2024-04-25T09:06:27.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6df7400640 1 -- 172.21.15.175:0/1361281954 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df0007500 con 0x7f6e000ce970 2024-04-25T09:06:27.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6e06200640 1 -- 172.21.15.175:0/1361281954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e000b3140 con 0x7f6e000ce970 2024-04-25T09:06:27.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.101+0000 7f6df7400640 1 -- 172.21.15.175:0/1361281954 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df0004a30 con 0x7f6e000ce970 2024-04-25T09:06:27.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.105+0000 7f6e06200640 1 -- 172.21.15.175:0/1361281954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e000b3700 con 0x7f6e000ce970 2024-04-25T09:06:27.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.105+0000 7f6e06200640 1 -- 172.21.15.175:0/1361281954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e00075160 con 0x7f6e000ce970 2024-04-25T09:06:27.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.105+0000 7f6df7400640 1 -- 172.21.15.175:0/1361281954 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6df001b070 con 0x7f6e000ce970 2024-04-25T09:06:27.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.105+0000 7f6df7400640 1 --2- 172.21.15.175:0/1361281954 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6de0066f60 0x7f6de0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.105+0000 7f6df7400640 1 -- 172.21.15.175:0/1361281954 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6df00842b0 con 0x7f6e000ce970 2024-04-25T09:06:27.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.105+0000 7f6dfea00640 1 --2- 172.21.15.175:0/1361281954 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6de0066f60 0x7f6de0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.105+0000 7f6dfea00640 1 --2- 172.21.15.175:0/1361281954 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6de0066f60 0x7f6de0069420 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6e001667a0 tx=0x7f6dec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.109+0000 7f6df7400640 1 -- 172.21.15.175:0/1361281954 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6df0054c30 con 0x7f6e000ce970 2024-04-25T09:06:27.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.273+0000 7f6e06200640 1 -- 172.21.15.175:0/1361281954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6e000afac0 con 0x7f6e000ce970 2024-04-25T09:06:27.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.273+0000 7f6df7400640 1 -- 172.21.15.175:0/1361281954 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6df0058cd0 con 0x7f6e000ce970 2024-04-25T09:06:27.263 INFO:teuthology.orchestra.run.smithi175.stderr:listed 0 entries 2024-04-25T09:06:27.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.277+0000 7f6e06200640 1 -- 172.21.15.175:0/1361281954 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6de0066f60 msgr2=0x7f6de0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.277+0000 7f6e06200640 1 --2- 172.21.15.175:0/1361281954 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6de0066f60 0x7f6de0069420 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6e001667a0 tx=0x7f6dec008040 comp rx=0 tx=0).stop 2024-04-25T09:06:27.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.277+0000 7f6e06200640 1 -- 172.21.15.175:0/1361281954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e000ce970 msgr2=0x7f6e00166150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.277+0000 7f6e06200640 1 --2- 172.21.15.175:0/1361281954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e000ce970 0x7f6e00166150 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f6df000c4b0 tx=0x7f6df000c970 comp rx=0 tx=0).stop 2024-04-25T09:06:27.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.277+0000 7f6e06200640 1 -- 172.21.15.175:0/1361281954 shutdown_connections 2024-04-25T09:06:27.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.277+0000 7f6e06200640 1 --2- 172.21.15.175:0/1361281954 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6de0066f60 0x7f6de0069420 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.277+0000 7f6e06200640 1 --2- 172.21.15.175:0/1361281954 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e00145250 0x7f6e0015b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.277+0000 7f6e06200640 1 --2- 172.21.15.175:0/1361281954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e000cf6b0 0x7f6e000b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.277+0000 7f6e06200640 1 --2- 172.21.15.175:0/1361281954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e000ce970 0x7f6e00166150 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.277+0000 7f6e06200640 1 -- 172.21.15.175:0/1361281954 >> 172.21.15.175:0/1361281954 conn(0x7f6e0006ac50 msgr2=0x7f6e000b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:27.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.277+0000 7f6e06200640 1 -- 172.21.15.175:0/1361281954 shutdown_connections 2024-04-25T09:06:27.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.277+0000 7f6e06200640 1 -- 172.21.15.175:0/1361281954 wait complete. 2024-04-25T09:06:27.285 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:06:27.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:27.285 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:27.336 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:06:27.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:27.337 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:06:27.389 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:06:27.389 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:27.398 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:06:27.398 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:06:27.398 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:27.440 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:06:27.440 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:06:27.441 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:27.449 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:06:27.449 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:27.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.633+0000 7f9f95200640 1 Processor -- start 2024-04-25T09:06:27.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.633+0000 7f9f95200640 1 -- start start 2024-04-25T09:06:27.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.633+0000 7f9f95200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9f9015a900 0x7f9f9006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.633+0000 7f9f95200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f900cf560 0x7f9f900cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.633+0000 7f9f95200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f900cda00 con 0x7f9f900cd520 2024-04-25T09:06:27.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.633+0000 7f9f95200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9015bcf0 con 0x7f9f9015a900 2024-04-25T09:06:27.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.633+0000 7f9f95200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900cfef0 con 0x7f9f900cf560 2024-04-25T09:06:27.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.633+0000 7f9f8de00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9f9015a900 0x7f9f9006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.633+0000 7f9f8de00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9f9015a900 0x7f9f9006e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52376/0 (socket says 172.21.15.175:52376) 2024-04-25T09:06:27.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.633+0000 7f9f8de00640 1 -- 172.21.15.175:0/3231383592 learned_addr learned my addr 172.21.15.175:0/3231383592 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:27.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.633+0000 7f9f8e800640 1 --2- 172.21.15.175:0/3231383592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f900cf560 0x7f9f900cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.633+0000 7f9f8de00640 1 -- 172.21.15.175:0/3231383592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f900cf560 msgr2=0x7f9f900cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.633+0000 7f9f8de00640 1 --2- 172.21.15.175:0/3231383592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f900cf560 0x7f9f900cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.637+0000 7f9f8de00640 1 -- 172.21.15.175:0/3231383592 >> v1:172.21.15.177:6789/0 conn(0x7f9f900cd520 legacy=0x7f9f900ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.637+0000 7f9f8de00640 1 -- 172.21.15.175:0/3231383592 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f900cdce0 con 0x7f9f9015a900 2024-04-25T09:06:27.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.637+0000 7f9f8de00640 1 --2- 172.21.15.175:0/3231383592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9015a900 0x7f9f9006e150 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009e50 tx=0x7f9f8001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b785e0848eb4eda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.637+0000 7f9f8ca00640 1 -- 172.21.15.175:0/3231383592 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f800a57f0 con 0x7f9f9015a900 2024-04-25T09:06:27.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.637+0000 7f9f8ca00640 1 -- 172.21.15.175:0/3231383592 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f800a5990 con 0x7f9f9015a900 2024-04-25T09:06:27.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.637+0000 7f9f8ca00640 1 -- 172.21.15.175:0/3231383592 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f800a5d60 con 0x7f9f9015a900 2024-04-25T09:06:27.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.637+0000 7f9f95200640 1 -- 172.21.15.175:0/3231383592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9015a900 msgr2=0x7f9f9006e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.637+0000 7f9f95200640 1 --2- 172.21.15.175:0/3231383592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9015a900 0x7f9f9006e150 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009e50 tx=0x7f9f8001ca30 comp rx=0 tx=0).stop 2024-04-25T09:06:27.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.637+0000 7f9f95200640 1 -- 172.21.15.175:0/3231383592 shutdown_connections 2024-04-25T09:06:27.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.637+0000 7f9f95200640 1 --2- 172.21.15.175:0/3231383592 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f900cf560 0x7f9f900cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.637+0000 7f9f95200640 1 --2- 172.21.15.175:0/3231383592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f9015a900 0x7f9f9006e150 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.637+0000 7f9f95200640 1 -- 172.21.15.175:0/3231383592 >> 172.21.15.175:0/3231383592 conn(0x7f9f90067150 msgr2=0x7f9f9006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:27.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.637+0000 7f9f95200640 1 -- 172.21.15.175:0/3231383592 shutdown_connections 2024-04-25T09:06:27.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.637+0000 7f9f95200640 1 -- 172.21.15.175:0/3231383592 wait complete. 2024-04-25T09:06:27.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f95200640 1 Processor -- start 2024-04-25T09:06:27.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f95200640 1 -- start start 2024-04-25T09:06:27.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f95200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f900cf560 0x7f9f900af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f95200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f9015a900 0x7f9f9014e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f95200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f900b1db0 0x7f9f90071240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f95200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9006d530 con 0x7f9f900b1db0 2024-04-25T09:06:27.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f95200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9006d3b0 con 0x7f9f9015a900 2024-04-25T09:06:27.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f95200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9015c790 con 0x7f9f900cf560 2024-04-25T09:06:27.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f8e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f900b1db0 0x7f9f90071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f8de00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f900cf560 0x7f9f900af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f8de00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f900cf560 0x7f9f900af0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:53106/0 (socket says 172.21.15.175:53106) 2024-04-25T09:06:27.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f8de00640 1 -- 172.21.15.175:0/1364235939 learned_addr learned my addr 172.21.15.175:0/1364235939 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:27.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f8d400640 1 --2- 172.21.15.175:0/1364235939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f9015a900 0x7f9f9014e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f8e800640 1 -- 172.21.15.175:0/1364235939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f900cf560 msgr2=0x7f9f900af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f8e800640 1 --2- 172.21.15.175:0/1364235939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f900cf560 0x7f9f900af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f8e800640 1 -- 172.21.15.175:0/1364235939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f9015a900 msgr2=0x7f9f9014e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f8e800640 1 --2- 172.21.15.175:0/1364235939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f9015a900 0x7f9f9014e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f8e800640 1 -- 172.21.15.175:0/1364235939 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f90067680 con 0x7f9f900b1db0 2024-04-25T09:06:27.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f8e800640 1 --2- 172.21.15.175:0/1364235939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f900b1db0 0x7f9f90071240 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800d530 tx=0x7f9f8800d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f86000640 1 -- 172.21.15.175:0/1364235939 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f880125f0 con 0x7f9f900b1db0 2024-04-25T09:06:27.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f86000640 1 -- 172.21.15.175:0/1364235939 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f88019070 con 0x7f9f900b1db0 2024-04-25T09:06:27.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f95200640 1 -- 172.21.15.175:0/1364235939 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f900af600 con 0x7f9f900b1db0 2024-04-25T09:06:27.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f86000640 1 -- 172.21.15.175:0/1364235939 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f880129d0 con 0x7f9f900b1db0 2024-04-25T09:06:27.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.641+0000 7f9f95200640 1 -- 172.21.15.175:0/1364235939 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f900afb80 con 0x7f9f900b1db0 2024-04-25T09:06:27.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.645+0000 7f9f95200640 1 -- 172.21.15.175:0/1364235939 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f90074a60 con 0x7f9f900b1db0 2024-04-25T09:06:27.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.645+0000 7f9f86000640 1 -- 172.21.15.175:0/1364235939 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9f88012b70 con 0x7f9f900b1db0 2024-04-25T09:06:27.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.645+0000 7f9f86000640 1 --2- 172.21.15.175:0/1364235939 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9f70066f60 0x7f9f70069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.645+0000 7f9f86000640 1 -- 172.21.15.175:0/1364235939 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9f880852f0 con 0x7f9f900b1db0 2024-04-25T09:06:27.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.645+0000 7f9f8de00640 1 --2- 172.21.15.175:0/1364235939 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9f70066f60 0x7f9f70069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.645+0000 7f9f8de00640 1 --2- 172.21.15.175:0/1364235939 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9f70066f60 0x7f9f70069420 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009e50 tx=0x7f9f800a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.649+0000 7f9f86000640 1 -- 172.21.15.175:0/1364235939 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9f88055c60 con 0x7f9f900b1db0 2024-04-25T09:06:27.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.837+0000 7f9f95200640 1 -- 172.21.15.175:0/1364235939 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f9006c220 con 0x7f9f900b1db0 2024-04-25T09:06:27.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.837+0000 7f9f86000640 1 -- 172.21.15.175:0/1364235939 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f9f88059d00 con 0x7f9f900b1db0 2024-04-25T09:06:27.826 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:27.826 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5102,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2763692769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2763692769},{"type":"v1","addr":"172.21.15.175:6837","nonce":2763692769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3823569323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3823569323},{"type":"v1","addr":"172.21.15.177:6834","nonce":3823569323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2687013607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2687013607},{"type":"v1","addr":"172.21.15.177:6835","nonce":2687013607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:45.332647+0000","modified":"2024-04-25T09:05:48.357816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6836/1389262120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1389262120},{"type":"v1","addr":"172.21.15.175:6836","nonce":1389262120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:27.826 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 25 2024-04-25T09:06:27.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.837+0000 7f9f95200640 1 -- 172.21.15.175:0/1364235939 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9f70066f60 msgr2=0x7f9f70069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.837+0000 7f9f95200640 1 --2- 172.21.15.175:0/1364235939 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9f70066f60 0x7f9f70069420 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009e50 tx=0x7f9f800a7070 comp rx=0 tx=0).stop 2024-04-25T09:06:27.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.837+0000 7f9f95200640 1 -- 172.21.15.175:0/1364235939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f900b1db0 msgr2=0x7f9f90071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.837+0000 7f9f95200640 1 --2- 172.21.15.175:0/1364235939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f900b1db0 0x7f9f90071240 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800d530 tx=0x7f9f8800d9f0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.837+0000 7f9f95200640 1 -- 172.21.15.175:0/1364235939 shutdown_connections 2024-04-25T09:06:27.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.837+0000 7f9f95200640 1 --2- 172.21.15.175:0/1364235939 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9f70066f60 0x7f9f70069420 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.837+0000 7f9f95200640 1 --2- 172.21.15.175:0/1364235939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f900b1db0 0x7f9f90071240 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.837+0000 7f9f95200640 1 --2- 172.21.15.175:0/1364235939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9f9015a900 0x7f9f9014e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.837+0000 7f9f95200640 1 --2- 172.21.15.175:0/1364235939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9f900cf560 0x7f9f900af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.837+0000 7f9f95200640 1 -- 172.21.15.175:0/1364235939 >> 172.21.15.175:0/1364235939 conn(0x7f9f900cd520 msgr2=0x7f9f9006ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:27.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.837+0000 7f9f95200640 1 -- 172.21.15.175:0/1364235939 shutdown_connections 2024-04-25T09:06:27.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.837+0000 7f9f95200640 1 -- 172.21.15.175:0/1364235939 wait complete. 2024-04-25T09:06:27.848 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:27.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.997+0000 7f9356000640 1 Processor -- start 2024-04-25T09:06:27.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.997+0000 7f9356000640 1 -- start start 2024-04-25T09:06:27.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.997+0000 7f9356000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f935006ff00 0x7f935015df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.997+0000 7f9356000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f93500ace40 0x7f93500ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.997+0000 7f9356000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93500adc70 0x7f9350154050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.997+0000 7f9356000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93500ae0e0 con 0x7f93500ace40 2024-04-25T09:06:27.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.997+0000 7f9356000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93500b4050 con 0x7f935006ff00 2024-04-25T09:06:27.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.997+0000 7f9356000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93500b4330 con 0x7f93500adc70 2024-04-25T09:06:27.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.997+0000 7f934fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f93500ace40 0x7f93500ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.997+0000 7f934fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f93500ace40 0x7f93500ad730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52388/0 (socket says 172.21.15.175:52388) 2024-04-25T09:06:27.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.997+0000 7f934fe00640 1 -- 172.21.15.175:0/3543169814 learned_addr learned my addr 172.21.15.175:0/3543169814 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:27.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.997+0000 7f9355600640 1 --2- 172.21.15.175:0/3543169814 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93500adc70 0x7f9350154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.997+0000 7f9354c00640 1 --2- 172.21.15.175:0/3543169814 >> v2:172.21.15.177:3300/0 conn(0x7f935006ff00 0x7f935015df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.997+0000 7f934fe00640 1 -- 172.21.15.175:0/3543169814 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93500adc70 msgr2=0x7f9350154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.997+0000 7f934fe00640 1 --2- 172.21.15.175:0/3543169814 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93500adc70 0x7f9350154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.997+0000 7f934fe00640 1 -- 172.21.15.175:0/3543169814 >> v2:172.21.15.177:3300/0 conn(0x7f935006ff00 msgr2=0x7f935015df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.997+0000 7f934fe00640 1 --2- 172.21.15.175:0/3543169814 >> v2:172.21.15.177:3300/0 conn(0x7f935006ff00 0x7f935015df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:27.997+0000 7f934fe00640 1 -- 172.21.15.175:0/3543169814 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93500b4610 con 0x7f93500ace40 2024-04-25T09:06:27.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.001+0000 7f934fe00640 1 --2- 172.21.15.175:0/3543169814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93500ace40 0x7f93500ad730 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9350066bc0 tx=0x7f933c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d20fe704dc530 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.001+0000 7f934f400640 1 -- 172.21.15.175:0/3543169814 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c0ab620 con 0x7f93500ace40 2024-04-25T09:06:27.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.001+0000 7f934f400640 1 -- 172.21.15.175:0/3543169814 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933c0b0070 con 0x7f93500ace40 2024-04-25T09:06:27.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.001+0000 7f934f400640 1 -- 172.21.15.175:0/3543169814 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c0ab9e0 con 0x7f93500ace40 2024-04-25T09:06:27.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.001+0000 7f9356000640 1 -- 172.21.15.175:0/3543169814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93500ace40 msgr2=0x7f93500ad730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.001+0000 7f9356000640 1 --2- 172.21.15.175:0/3543169814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93500ace40 0x7f93500ad730 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9350066bc0 tx=0x7f933c01c460 comp rx=0 tx=0).stop 2024-04-25T09:06:27.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.001+0000 7f9356000640 1 -- 172.21.15.175:0/3543169814 shutdown_connections 2024-04-25T09:06:27.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.001+0000 7f9356000640 1 --2- 172.21.15.175:0/3543169814 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93500adc70 0x7f9350154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.001+0000 7f9356000640 1 --2- 172.21.15.175:0/3543169814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93500ace40 0x7f93500ad730 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.001+0000 7f9356000640 1 --2- 172.21.15.175:0/3543169814 >> v2:172.21.15.177:3300/0 conn(0x7f935006ff00 0x7f935015df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.001+0000 7f9356000640 1 -- 172.21.15.175:0/3543169814 >> 172.21.15.175:0/3543169814 conn(0x7f93500d03e0 msgr2=0x7f93500d07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:27.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.001+0000 7f9356000640 1 -- 172.21.15.175:0/3543169814 shutdown_connections 2024-04-25T09:06:27.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.001+0000 7f9356000640 1 -- 172.21.15.175:0/3543169814 wait complete. 2024-04-25T09:06:27.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f9356000640 1 Processor -- start 2024-04-25T09:06:27.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f9356000640 1 -- start start 2024-04-25T09:06:27.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f9356000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f935006ff00 0x7f9350141f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f9356000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93500ace40 0x7f93500af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f9356000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93500adc70 0x7f935006b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f9356000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93500b5270 con 0x7f93500ace40 2024-04-25T09:06:27.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f9356000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93500b50f0 con 0x7f93500adc70 2024-04-25T09:06:27.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f9356000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93500b3be0 con 0x7f935006ff00 2024-04-25T09:06:27.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f934fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93500ace40 0x7f93500af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f934fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93500ace40 0x7f93500af8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52394/0 (socket says 172.21.15.175:52394) 2024-04-25T09:06:27.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f934fe00640 1 -- 172.21.15.175:0/1309854852 learned_addr learned my addr 172.21.15.175:0/1309854852 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:27.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f9355600640 1 --2- 172.21.15.175:0/1309854852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93500adc70 0x7f935006b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f9354c00640 1 --2- 172.21.15.175:0/1309854852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f935006ff00 0x7f9350141f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f934fe00640 1 -- 172.21.15.175:0/1309854852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f935006ff00 msgr2=0x7f9350141f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f934fe00640 1 --2- 172.21.15.175:0/1309854852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f935006ff00 0x7f9350141f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f934fe00640 1 -- 172.21.15.175:0/1309854852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93500adc70 msgr2=0x7f935006b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f934fe00640 1 --2- 172.21.15.175:0/1309854852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93500adc70 0x7f935006b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f934fe00640 1 -- 172.21.15.175:0/1309854852 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93501fa480 con 0x7f93500ace40 2024-04-25T09:06:27.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f9355600640 1 --2- 172.21.15.175:0/1309854852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93500adc70 0x7f935006b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:27.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f934fe00640 1 --2- 172.21.15.175:0/1309854852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93500ace40 0x7f93500af8e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f933c01ab10 tx=0x7f933c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f934cc00640 1 -- 172.21.15.175:0/1309854852 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c0abc70 con 0x7f93500ace40 2024-04-25T09:06:27.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f934cc00640 1 -- 172.21.15.175:0/1309854852 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933c0abe10 con 0x7f93500ace40 2024-04-25T09:06:27.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f934cc00640 1 -- 172.21.15.175:0/1309854852 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933c0be630 con 0x7f93500ace40 2024-04-25T09:06:27.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f9356000640 1 -- 172.21.15.175:0/1309854852 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9350150390 con 0x7f93500ace40 2024-04-25T09:06:27.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f9356000640 1 -- 172.21.15.175:0/1309854852 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93501500b0 con 0x7f93500ace40 2024-04-25T09:06:27.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.005+0000 7f9356000640 1 -- 172.21.15.175:0/1309854852 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9350074a60 con 0x7f93500ace40 2024-04-25T09:06:27.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.009+0000 7f934cc00640 1 -- 172.21.15.175:0/1309854852 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f933c0b43f0 con 0x7f93500ace40 2024-04-25T09:06:27.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.009+0000 7f934cc00640 1 --2- 172.21.15.175:0/1309854852 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9330066f60 0x7f9330069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.009+0000 7f934cc00640 1 -- 172.21.15.175:0/1309854852 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f933c11efc0 con 0x7f93500ace40 2024-04-25T09:06:27.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.009+0000 7f9354c00640 1 --2- 172.21.15.175:0/1309854852 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9330066f60 0x7f9330069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.009+0000 7f9354c00640 1 --2- 172.21.15.175:0/1309854852 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9330066f60 0x7f9330069420 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9344009a40 tx=0x7f9344009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:28.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.013+0000 7f934cc00640 1 -- 172.21.15.175:0/1309854852 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f93501fa480 con 0x7f93500ace40 2024-04-25T09:06:28.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.169+0000 7f9356000640 1 -- 172.21.15.175:0/1309854852 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93500b3790 con 0x7f93500ace40 2024-04-25T09:06:28.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.169+0000 7f934cc00640 1 -- 172.21.15.175:0/1309854852 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16741 (secure 0 0 0) 0x7f933c016110 con 0x7f93500ace40 2024-04-25T09:06:28.159 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:28.159 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":46,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:05:52.004266+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:43.050603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:44.332424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.1b","mappings":[{"from":0,"to":4}]},{"pgid":"7.37","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:28.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.173+0000 7f9356000640 1 -- 172.21.15.175:0/1309854852 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9330066f60 msgr2=0x7f9330069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.173+0000 7f9356000640 1 --2- 172.21.15.175:0/1309854852 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9330066f60 0x7f9330069420 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9344009a40 tx=0x7f9344009190 comp rx=0 tx=0).stop 2024-04-25T09:06:28.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.173+0000 7f9356000640 1 -- 172.21.15.175:0/1309854852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93500ace40 msgr2=0x7f93500af8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.173+0000 7f9356000640 1 --2- 172.21.15.175:0/1309854852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93500ace40 0x7f93500af8e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f933c01ab10 tx=0x7f933c01aca0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.173+0000 7f9356000640 1 -- 172.21.15.175:0/1309854852 shutdown_connections 2024-04-25T09:06:28.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.173+0000 7f9356000640 1 --2- 172.21.15.175:0/1309854852 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9330066f60 0x7f9330069420 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.173+0000 7f9356000640 1 --2- 172.21.15.175:0/1309854852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93500adc70 0x7f935006b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.173+0000 7f9356000640 1 --2- 172.21.15.175:0/1309854852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93500ace40 0x7f93500af8e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.173+0000 7f9356000640 1 --2- 172.21.15.175:0/1309854852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f935006ff00 0x7f9350141f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.173+0000 7f9356000640 1 -- 172.21.15.175:0/1309854852 >> 172.21.15.175:0/1309854852 conn(0x7f93500d03e0 msgr2=0x7f935015de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:28.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.173+0000 7f9356000640 1 -- 172.21.15.175:0/1309854852 shutdown_connections 2024-04-25T09:06:28.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.173+0000 7f9356000640 1 -- 172.21.15.175:0/1309854852 wait complete. 2024-04-25T09:06:28.182 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:05:43.050603+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:05:44.332424+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:06:28.182 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:06:28.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.333+0000 7fbb20c00640 1 Processor -- start 2024-04-25T09:06:28.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.333+0000 7fbb20c00640 1 -- start start 2024-04-25T09:06:28.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.333+0000 7fbb20c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbb1c0cbe60 0x7fbb1c15af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:28.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.333+0000 7fbb20c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbb1c06d310 0x7fbb1c0b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:28.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.333+0000 7fbb20c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1c06db60 con 0x7fbb1c0b4630 2024-04-25T09:06:28.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.333+0000 7fbb20c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1c0b4aa0 con 0x7fbb1c06d310 2024-04-25T09:06:28.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.333+0000 7fbb20c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1c06de40 con 0x7fbb1c0cbe60 2024-04-25T09:06:28.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.333+0000 7fbb19400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbb1c06d310 0x7fbb1c0b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:28.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.333+0000 7fbb1a800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fbb1c0b4630 0x7fbb1c0b2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59122/0 (socket says 172.21.15.175:59122) 2024-04-25T09:06:28.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.333+0000 7fbb1a800640 1 -- 172.21.15.175:0/538193398 learned_addr learned my addr 172.21.15.175:0/538193398 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:28.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.333+0000 7fbb19e00640 1 --2- 172.21.15.175:0/538193398 >> v2:172.21.15.177:3300/0 conn(0x7fbb1c0cbe60 0x7fbb1c15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:28.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.333+0000 7fbb18a00640 1 -- 172.21.15.175:0/538193398 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816253636 0 0) 0x7fbb1c06db60 con 0x7fbb1c0b4630 2024-04-25T09:06:28.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.333+0000 7fbb18a00640 1 -- 172.21.15.175:0/538193398 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb00003530 con 0x7fbb1c0b4630 2024-04-25T09:06:28.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.333+0000 7fbb19400640 1 -- 172.21.15.175:0/538193398 >> v2:172.21.15.177:3300/0 conn(0x7fbb1c0cbe60 msgr2=0x7fbb1c15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:28.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.333+0000 7fbb19400640 1 --2- 172.21.15.175:0/538193398 >> v2:172.21.15.177:3300/0 conn(0x7fbb1c0cbe60 0x7fbb1c15af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.333+0000 7fbb19400640 1 -- 172.21.15.175:0/538193398 >> v1:172.21.15.175:6789/0 conn(0x7fbb1c0b4630 legacy=0x7fbb1c0b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.333+0000 7fbb19400640 1 -- 172.21.15.175:0/538193398 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c06e120 con 0x7fbb1c06d310 2024-04-25T09:06:28.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.337+0000 7fbb19400640 1 --2- 172.21.15.175:0/538193398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb1c06d310 0x7fbb1c0b40f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0b4d50 tx=0x7fbb0801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f65220fd3aa6a7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:28.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.337+0000 7fbb18a00640 1 -- 172.21.15.175:0/538193398 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb080b1070 con 0x7fbb1c06d310 2024-04-25T09:06:28.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.337+0000 7fbb18a00640 1 -- 172.21.15.175:0/538193398 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb080ac5f0 con 0x7fbb1c06d310 2024-04-25T09:06:28.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.337+0000 7fbb18a00640 1 -- 172.21.15.175:0/538193398 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb080ac9a0 con 0x7fbb1c06d310 2024-04-25T09:06:28.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.337+0000 7fbb20c00640 1 -- 172.21.15.175:0/538193398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb1c06d310 msgr2=0x7fbb1c0b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.337+0000 7fbb20c00640 1 --2- 172.21.15.175:0/538193398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb1c06d310 0x7fbb1c0b40f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0b4d50 tx=0x7fbb0801c480 comp rx=0 tx=0).stop 2024-04-25T09:06:28.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.337+0000 7fbb20c00640 1 -- 172.21.15.175:0/538193398 shutdown_connections 2024-04-25T09:06:28.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.337+0000 7fbb20c00640 1 --2- 172.21.15.175:0/538193398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb1c06d310 0x7fbb1c0b40f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.337+0000 7fbb20c00640 1 --2- 172.21.15.175:0/538193398 >> v2:172.21.15.177:3300/0 conn(0x7fbb1c0cbe60 0x7fbb1c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.337+0000 7fbb20c00640 1 -- 172.21.15.175:0/538193398 >> 172.21.15.175:0/538193398 conn(0x7fbb1c06ac50 msgr2=0x7fbb1c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:28.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.337+0000 7fbb20c00640 1 -- 172.21.15.175:0/538193398 shutdown_connections 2024-04-25T09:06:28.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.337+0000 7fbb20c00640 1 -- 172.21.15.175:0/538193398 wait complete. 2024-04-25T09:06:28.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb20c00640 1 Processor -- start 2024-04-25T09:06:28.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb20c00640 1 -- start start 2024-04-25T09:06:28.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb20c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb1c06d310 0x7fbb1c0cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:28.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb20c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb1c0b4630 0x7fbb1c13ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:28.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb20c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb1c0cbe60 0x7fbb1c0adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:28.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb20c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c167560 con 0x7fbb1c0cbe60 2024-04-25T09:06:28.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb20c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c0cc490 con 0x7fbb1c06d310 2024-04-25T09:06:28.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb20c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c1676e0 con 0x7fbb1c0b4630 2024-04-25T09:06:28.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb1a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb1c0cbe60 0x7fbb1c0adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:28.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb1a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb1c0cbe60 0x7fbb1c0adc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52408/0 (socket says 172.21.15.175:52408) 2024-04-25T09:06:28.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb1a800640 1 -- 172.21.15.175:0/2978960884 learned_addr learned my addr 172.21.15.175:0/2978960884 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:28.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb19e00640 1 --2- 172.21.15.175:0/2978960884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb1c06d310 0x7fbb1c0cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:28.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb19400640 1 --2- 172.21.15.175:0/2978960884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb1c0b4630 0x7fbb1c13ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:28.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb1a800640 1 -- 172.21.15.175:0/2978960884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb1c0b4630 msgr2=0x7fbb1c13ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb1a800640 1 --2- 172.21.15.175:0/2978960884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb1c0b4630 0x7fbb1c13ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb1a800640 1 -- 172.21.15.175:0/2978960884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb1c06d310 msgr2=0x7fbb1c0cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb1a800640 1 --2- 172.21.15.175:0/2978960884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb1c06d310 0x7fbb1c0cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb1a800640 1 -- 172.21.15.175:0/2978960884 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c0cdd90 con 0x7fbb1c0cbe60 2024-04-25T09:06:28.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb1a800640 1 --2- 172.21.15.175:0/2978960884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb1c0cbe60 0x7fbb1c0adc00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400cb70 tx=0x7fbb1400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:28.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb12000640 1 -- 172.21.15.175:0/2978960884 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14017070 con 0x7fbb1c0cbe60 2024-04-25T09:06:28.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb12000640 1 -- 172.21.15.175:0/2978960884 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1400ad40 con 0x7fbb1c0cbe60 2024-04-25T09:06:28.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb12000640 1 -- 172.21.15.175:0/2978960884 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14012620 con 0x7fbb1c0cbe60 2024-04-25T09:06:28.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb20c00640 1 -- 172.21.15.175:0/2978960884 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1c154570 con 0x7fbb1c0cbe60 2024-04-25T09:06:28.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb20c00640 1 -- 172.21.15.175:0/2978960884 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1c0ad400 con 0x7fbb1c0cbe60 2024-04-25T09:06:28.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.341+0000 7fbb20c00640 1 -- 172.21.15.175:0/2978960884 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1c075160 con 0x7fbb1c0cbe60 2024-04-25T09:06:28.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.345+0000 7fbb12000640 1 -- 172.21.15.175:0/2978960884 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbb1401a070 con 0x7fbb1c0cbe60 2024-04-25T09:06:28.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.345+0000 7fbb12000640 1 --2- 172.21.15.175:0/2978960884 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbafc066f60 0x7fbafc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:28.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.345+0000 7fbb12000640 1 -- 172.21.15.175:0/2978960884 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbb14084de0 con 0x7fbb1c0cbe60 2024-04-25T09:06:28.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.345+0000 7fbb19e00640 1 --2- 172.21.15.175:0/2978960884 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbafc066f60 0x7fbafc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:28.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.345+0000 7fbb19e00640 1 --2- 172.21.15.175:0/2978960884 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbafc066f60 0x7fbafc069420 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c1528a0 tx=0x7fbb0c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:28.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.349+0000 7fbb12000640 1 -- 172.21.15.175:0/2978960884 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbb14055750 con 0x7fbb1c0cbe60 2024-04-25T09:06:28.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.501+0000 7fbb20c00640 1 -- 172.21.15.175:0/2978960884 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb1c1553e0 con 0x7fbb1c0cbe60 2024-04-25T09:06:28.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.501+0000 7fbb12000640 1 -- 172.21.15.175:0/2978960884 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb140597f0 con 0x7fbb1c0cbe60 2024-04-25T09:06:28.493 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:06:28.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.505+0000 7fbb20c00640 1 -- 172.21.15.175:0/2978960884 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbafc066f60 msgr2=0x7fbafc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.505+0000 7fbb20c00640 1 --2- 172.21.15.175:0/2978960884 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbafc066f60 0x7fbafc069420 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c1528a0 tx=0x7fbb0c009190 comp rx=0 tx=0).stop 2024-04-25T09:06:28.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.505+0000 7fbb20c00640 1 -- 172.21.15.175:0/2978960884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb1c0cbe60 msgr2=0x7fbb1c0adc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.505+0000 7fbb20c00640 1 --2- 172.21.15.175:0/2978960884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb1c0cbe60 0x7fbb1c0adc00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400cb70 tx=0x7fbb1400a430 comp rx=0 tx=0).stop 2024-04-25T09:06:28.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.505+0000 7fbb20c00640 1 -- 172.21.15.175:0/2978960884 shutdown_connections 2024-04-25T09:06:28.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.505+0000 7fbb20c00640 1 --2- 172.21.15.175:0/2978960884 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbafc066f60 0x7fbafc069420 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.505+0000 7fbb20c00640 1 --2- 172.21.15.175:0/2978960884 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb1c0cbe60 0x7fbb1c0adc00 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.505+0000 7fbb20c00640 1 --2- 172.21.15.175:0/2978960884 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb1c0b4630 0x7fbb1c13ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.505+0000 7fbb20c00640 1 --2- 172.21.15.175:0/2978960884 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb1c06d310 0x7fbb1c0cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.505+0000 7fbb20c00640 1 -- 172.21.15.175:0/2978960884 >> 172.21.15.175:0/2978960884 conn(0x7fbb1c06ac50 msgr2=0x7fbb1c0b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:28.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.505+0000 7fbb20c00640 1 -- 172.21.15.175:0/2978960884 shutdown_connections 2024-04-25T09:06:28.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.505+0000 7fbb20c00640 1 -- 172.21.15.175:0/2978960884 wait complete. 2024-04-25T09:06:28.513 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:06:28.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.661+0000 7faa80400640 1 Processor -- start 2024-04-25T09:06:28.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.661+0000 7faa80400640 1 -- start start 2024-04-25T09:06:28.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.665+0000 7faa80400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faa780b4800 0x7faa78165550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:28.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.665+0000 7faa80400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7806db60 con 0x7faa780cbe60 2024-04-25T09:06:28.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.665+0000 7faa80400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7806de40 con 0x7faa7815af20 2024-04-25T09:06:28.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.665+0000 7faa80400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa7806e120 con 0x7faa780b4800 2024-04-25T09:06:28.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.665+0000 7faa7da00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7faa780cbe60 0x7faa7806d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59134/0 (socket says 172.21.15.175:59134) 2024-04-25T09:06:28.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.665+0000 7faa7da00640 1 -- 172.21.15.175:0/3937707233 learned_addr learned my addr 172.21.15.175:0/3937707233 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:28.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.665+0000 7faa7e400640 1 --2- 172.21.15.175:0/3937707233 >> v2:172.21.15.175:3300/0 conn(0x7faa780b4800 0x7faa78165550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:28.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.665+0000 7faa7e400640 1 -- 172.21.15.175:0/3937707233 >> v1:172.21.15.177:6789/0 conn(0x7faa7815af20 legacy=0x7faa780b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.665+0000 7faa77e00640 1 -- 172.21.15.175:0/3937707233 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366707261 0 0) 0x7faa7806db60 con 0x7faa780cbe60 2024-04-25T09:06:28.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.665+0000 7faa7e400640 1 -- 172.21.15.175:0/3937707233 >> v1:172.21.15.175:6789/0 conn(0x7faa780cbe60 legacy=0x7faa7806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.665+0000 7faa7e400640 1 -- 172.21.15.175:0/3937707233 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7815c2f0 con 0x7faa780b4800 2024-04-25T09:06:28.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.665+0000 7faa7e400640 1 --2- 172.21.15.175:0/3937707233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa780b4800 0x7faa78165550 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7faa700097c0 tx=0x7faa7001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4d990bcdc32705 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:28.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.665+0000 7faa77e00640 1 -- 172.21.15.175:0/3937707233 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa700b0070 con 0x7faa780b4800 2024-04-25T09:06:28.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.665+0000 7faa77e00640 1 -- 172.21.15.175:0/3937707233 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa700ab600 con 0x7faa780b4800 2024-04-25T09:06:28.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.665+0000 7faa77e00640 1 -- 172.21.15.175:0/3937707233 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa700ab9d0 con 0x7faa780b4800 2024-04-25T09:06:28.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa80400640 1 -- 172.21.15.175:0/3937707233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa780b4800 msgr2=0x7faa78165550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa80400640 1 --2- 172.21.15.175:0/3937707233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa780b4800 0x7faa78165550 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7faa700097c0 tx=0x7faa7001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa80400640 1 -- 172.21.15.175:0/3937707233 shutdown_connections 2024-04-25T09:06:28.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa80400640 1 --2- 172.21.15.175:0/3937707233 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa780b4800 0x7faa78165550 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa80400640 1 -- 172.21.15.175:0/3937707233 >> 172.21.15.175:0/3937707233 conn(0x7faa7806ac50 msgr2=0x7faa7806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:28.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa80400640 1 -- 172.21.15.175:0/3937707233 shutdown_connections 2024-04-25T09:06:28.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa80400640 1 -- 172.21.15.175:0/3937707233 wait complete. 2024-04-25T09:06:28.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa80400640 1 Processor -- start 2024-04-25T09:06:28.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa80400640 1 -- start start 2024-04-25T09:06:28.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa80400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa780b4800 0x7faa7813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:28.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa80400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa780cbe60 0x7faa780cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:28.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa80400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa7815af20 0x7faa780ce740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:28.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa80400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa781688d0 con 0x7faa780cbe60 2024-04-25T09:06:28.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa80400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa780cc450 con 0x7faa780b4800 2024-04-25T09:06:28.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa80400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa78168a50 con 0x7faa7815af20 2024-04-25T09:06:28.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa7d000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa780cbe60 0x7faa780cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:28.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa7da00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa780b4800 0x7faa7813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:28.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa7d000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa780cbe60 0x7faa780cd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52420/0 (socket says 172.21.15.175:52420) 2024-04-25T09:06:28.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa7d000640 1 -- 172.21.15.175:0/1868568686 learned_addr learned my addr 172.21.15.175:0/1868568686 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:28.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa7e400640 1 --2- 172.21.15.175:0/1868568686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa7815af20 0x7faa780ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:28.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa7d000640 1 -- 172.21.15.175:0/1868568686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa7815af20 msgr2=0x7faa780ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa7d000640 1 --2- 172.21.15.175:0/1868568686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa7815af20 0x7faa780ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa7d000640 1 -- 172.21.15.175:0/1868568686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa780b4800 msgr2=0x7faa7813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa7d000640 1 --2- 172.21.15.175:0/1868568686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa780b4800 0x7faa7813ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.669+0000 7faa7d000640 1 -- 172.21.15.175:0/1868568686 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa78153f30 con 0x7faa780cbe60 2024-04-25T09:06:28.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.673+0000 7faa7d000640 1 --2- 172.21.15.175:0/1868568686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa780cbe60 0x7faa780cd850 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7faa6400c3c0 tx=0x7faa6400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:28.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.673+0000 7faa75600640 1 -- 172.21.15.175:0/1868568686 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa64017070 con 0x7faa780cbe60 2024-04-25T09:06:28.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.673+0000 7faa75600640 1 -- 172.21.15.175:0/1868568686 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa640052d0 con 0x7faa780cbe60 2024-04-25T09:06:28.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.673+0000 7faa75600640 1 -- 172.21.15.175:0/1868568686 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa64003840 con 0x7faa780cbe60 2024-04-25T09:06:28.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.673+0000 7faa80400640 1 -- 172.21.15.175:0/1868568686 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa781541d0 con 0x7faa780cbe60 2024-04-25T09:06:28.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.673+0000 7faa80400640 1 -- 172.21.15.175:0/1868568686 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa78154790 con 0x7faa780cbe60 2024-04-25T09:06:28.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.673+0000 7faa80400640 1 -- 172.21.15.175:0/1868568686 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa78075160 con 0x7faa780cbe60 2024-04-25T09:06:28.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.673+0000 7faa75600640 1 -- 172.21.15.175:0/1868568686 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faa6401a070 con 0x7faa780cbe60 2024-04-25T09:06:28.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.673+0000 7faa75600640 1 --2- 172.21.15.175:0/1868568686 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faa58066f60 0x7faa58069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:28.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.673+0000 7faa75600640 1 -- 172.21.15.175:0/1868568686 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7faa640842f0 con 0x7faa780cbe60 2024-04-25T09:06:28.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.673+0000 7faa7da00640 1 --2- 172.21.15.175:0/1868568686 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faa58066f60 0x7faa58069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:28.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.677+0000 7faa7da00640 1 --2- 172.21.15.175:0/1868568686 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faa58066f60 0x7faa58069420 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faa6c001950 tx=0x7faa6c0018e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:28.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.677+0000 7faa75600640 1 -- 172.21.15.175:0/1868568686 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faa64005480 con 0x7faa780cbe60 2024-04-25T09:06:28.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.829+0000 7faa80400640 1 -- 172.21.15.175:0/1868568686 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa781651a0 con 0x7faa780cbe60 2024-04-25T09:06:28.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.829+0000 7faa75600640 1 -- 172.21.15.175:0/1868568686 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7faa64054d00 con 0x7faa780cbe60 2024-04-25T09:06:28.820 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:06:28.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.833+0000 7faa80400640 1 -- 172.21.15.175:0/1868568686 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faa58066f60 msgr2=0x7faa58069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.833+0000 7faa80400640 1 --2- 172.21.15.175:0/1868568686 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faa58066f60 0x7faa58069420 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7faa6c001950 tx=0x7faa6c0018e0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.833+0000 7faa80400640 1 -- 172.21.15.175:0/1868568686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa780cbe60 msgr2=0x7faa780cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.833+0000 7faa80400640 1 --2- 172.21.15.175:0/1868568686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa780cbe60 0x7faa780cd850 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7faa6400c3c0 tx=0x7faa6400c7c0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.833+0000 7faa80400640 1 -- 172.21.15.175:0/1868568686 shutdown_connections 2024-04-25T09:06:28.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.833+0000 7faa80400640 1 --2- 172.21.15.175:0/1868568686 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faa58066f60 0x7faa58069420 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.833+0000 7faa80400640 1 --2- 172.21.15.175:0/1868568686 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa7815af20 0x7faa780ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.833+0000 7faa80400640 1 --2- 172.21.15.175:0/1868568686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa780cbe60 0x7faa780cd850 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.833+0000 7faa80400640 1 --2- 172.21.15.175:0/1868568686 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa780b4800 0x7faa7813ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.833+0000 7faa80400640 1 -- 172.21.15.175:0/1868568686 >> 172.21.15.175:0/1868568686 conn(0x7faa7806ac50 msgr2=0x7faa780adf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:28.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.833+0000 7faa80400640 1 -- 172.21.15.175:0/1868568686 shutdown_connections 2024-04-25T09:06:28.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.833+0000 7faa80400640 1 -- 172.21.15.175:0/1868568686 wait complete. 2024-04-25T09:06:28.841 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:06:28.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.993+0000 7fca63600640 1 Processor -- start 2024-04-25T09:06:28.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.993+0000 7fca63600640 1 -- start start 2024-04-25T09:06:28.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.993+0000 7fca63600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fca5c15ba40 0x7fca5c0b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:28.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.993+0000 7fca63600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca5c0cca80 0x7fca5c0ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:28.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.993+0000 7fca63600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca5c15f840 con 0x7fca5c0b74c0 2024-04-25T09:06:28.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.993+0000 7fca63600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5c15f5f0 con 0x7fca5c15ba40 2024-04-25T09:06:28.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.993+0000 7fca63600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c160170 con 0x7fca5c0cca80 2024-04-25T09:06:28.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.993+0000 7fca61600640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fca5c0b74c0 0x7fca5c0b3380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59150/0 (socket says 172.21.15.175:59150) 2024-04-25T09:06:28.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.993+0000 7fca61600640 1 -- 172.21.15.175:0/610104868 learned_addr learned my addr 172.21.15.175:0/610104868 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:28.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.993+0000 7fca60c00640 1 --2- 172.21.15.175:0/610104868 >> v2:172.21.15.177:3300/0 conn(0x7fca5c15ba40 0x7fca5c0b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:28.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.993+0000 7fca5be00640 1 --2- 172.21.15.175:0/610104868 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca5c0cca80 0x7fca5c0ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:28.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.993+0000 7fca5b400640 1 -- 172.21.15.175:0/610104868 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168346305 0 0) 0x7fca5c15f840 con 0x7fca5c0b74c0 2024-04-25T09:06:28.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.993+0000 7fca5b400640 1 -- 172.21.15.175:0/610104868 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca44003530 con 0x7fca5c0b74c0 2024-04-25T09:06:28.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.993+0000 7fca60c00640 1 -- 172.21.15.175:0/610104868 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca5c0cca80 msgr2=0x7fca5c0ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:28.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.993+0000 7fca60c00640 1 --2- 172.21.15.175:0/610104868 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca5c0cca80 0x7fca5c0ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.993+0000 7fca60c00640 1 -- 172.21.15.175:0/610104868 >> v1:172.21.15.175:6789/0 conn(0x7fca5c0b74c0 legacy=0x7fca5c0b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.993+0000 7fca60c00640 1 -- 172.21.15.175:0/610104868 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c15fb20 con 0x7fca5c15ba40 2024-04-25T09:06:28.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.997+0000 7fca60c00640 1 --2- 172.21.15.175:0/610104868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca5c15ba40 0x7fca5c0b6f80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fca500097c0 tx=0x7fca5001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fc2015ed4ca6177 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:28.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.997+0000 7fca5b400640 1 -- 172.21.15.175:0/610104868 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca500b1070 con 0x7fca5c15ba40 2024-04-25T09:06:28.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.997+0000 7fca5b400640 1 -- 172.21.15.175:0/610104868 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca500ac410 con 0x7fca5c15ba40 2024-04-25T09:06:28.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:28.997+0000 7fca5b400640 1 -- 172.21.15.175:0/610104868 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca500ac7e0 con 0x7fca5c15ba40 2024-04-25T09:06:28.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca63600640 1 -- 172.21.15.175:0/610104868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca5c15ba40 msgr2=0x7fca5c0b6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca63600640 1 --2- 172.21.15.175:0/610104868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca5c15ba40 0x7fca5c0b6f80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fca500097c0 tx=0x7fca5001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca63600640 1 -- 172.21.15.175:0/610104868 shutdown_connections 2024-04-25T09:06:28.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca63600640 1 --2- 172.21.15.175:0/610104868 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca5c0cca80 0x7fca5c0ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca63600640 1 --2- 172.21.15.175:0/610104868 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca5c15ba40 0x7fca5c0b6f80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca63600640 1 -- 172.21.15.175:0/610104868 >> 172.21.15.175:0/610104868 conn(0x7fca5c06f550 msgr2=0x7fca5c06f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:28.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca63600640 1 -- 172.21.15.175:0/610104868 shutdown_connections 2024-04-25T09:06:28.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca63600640 1 -- 172.21.15.175:0/610104868 wait complete. 2024-04-25T09:06:28.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca63600640 1 Processor -- start 2024-04-25T09:06:28.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca63600640 1 -- start start 2024-04-25T09:06:28.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca63600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca5c0b74c0 0x7fca5c0c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:28.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca63600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca5c0cca80 0x7fca5c147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:28.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca63600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca5c15ba40 0x7fca5c0caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:28.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca63600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c0d0b70 con 0x7fca5c0cca80 2024-04-25T09:06:28.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca63600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c0d09f0 con 0x7fca5c0b74c0 2024-04-25T09:06:28.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca63600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5c168990 con 0x7fca5c15ba40 2024-04-25T09:06:28.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca5be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca5c0cca80 0x7fca5c147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:28.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca5be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca5c0cca80 0x7fca5c147670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:52432/0 (socket says 172.21.15.175:52432) 2024-04-25T09:06:28.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca5be00640 1 -- 172.21.15.175:0/1282766807 learned_addr learned my addr 172.21.15.175:0/1282766807 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:28.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca61600640 1 --2- 172.21.15.175:0/1282766807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca5c15ba40 0x7fca5c0caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:28.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca60c00640 1 --2- 172.21.15.175:0/1282766807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca5c0b74c0 0x7fca5c0c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:28.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca5be00640 1 -- 172.21.15.175:0/1282766807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca5c15ba40 msgr2=0x7fca5c0caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca5be00640 1 --2- 172.21.15.175:0/1282766807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca5c15ba40 0x7fca5c0caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca5be00640 1 -- 172.21.15.175:0/1282766807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca5c0b74c0 msgr2=0x7fca5c0c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:28.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca5be00640 1 --2- 172.21.15.175:0/1282766807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca5c0b74c0 0x7fca5c0c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:28.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca5be00640 1 -- 172.21.15.175:0/1282766807 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c0cb2c0 con 0x7fca5c0cca80 2024-04-25T09:06:28.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.001+0000 7fca5be00640 1 --2- 172.21.15.175:0/1282766807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca5c0cca80 0x7fca5c147670 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fca4800e840 tx=0x7fca4800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:28.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.005+0000 7fca58c00640 1 -- 172.21.15.175:0/1282766807 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca48017070 con 0x7fca5c0cca80 2024-04-25T09:06:28.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.005+0000 7fca58c00640 1 -- 172.21.15.175:0/1282766807 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4800ee90 con 0x7fca5c0cca80 2024-04-25T09:06:28.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.005+0000 7fca63600640 1 -- 172.21.15.175:0/1282766807 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca5c0cb5a0 con 0x7fca5c0cca80 2024-04-25T09:06:28.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.005+0000 7fca58c00640 1 -- 172.21.15.175:0/1282766807 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4800cb80 con 0x7fca5c0cca80 2024-04-25T09:06:28.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.005+0000 7fca63600640 1 -- 172.21.15.175:0/1282766807 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca5c0cbb60 con 0x7fca5c0cca80 2024-04-25T09:06:28.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.005+0000 7fca63600640 1 -- 172.21.15.175:0/1282766807 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5c075160 con 0x7fca5c0cca80 2024-04-25T09:06:28.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.005+0000 7fca58c00640 1 -- 172.21.15.175:0/1282766807 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fca4801a070 con 0x7fca5c0cca80 2024-04-25T09:06:28.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.005+0000 7fca58c00640 1 --2- 172.21.15.175:0/1282766807 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fca3c066f60 0x7fca3c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:28.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.005+0000 7fca58c00640 1 -- 172.21.15.175:0/1282766807 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fca48085060 con 0x7fca5c0cca80 2024-04-25T09:06:28.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.005+0000 7fca60c00640 1 --2- 172.21.15.175:0/1282766807 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fca3c066f60 0x7fca3c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:28.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.009+0000 7fca60c00640 1 --2- 172.21.15.175:0/1282766807 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fca3c066f60 0x7fca3c069420 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fca500ae000 tx=0x7fca50008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:29.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.009+0000 7fca58c00640 1 -- 172.21.15.175:0/1282766807 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fca48055830 con 0x7fca5c0cca80 2024-04-25T09:06:29.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.165+0000 7fca63600640 1 -- 172.21.15.175:0/1282766807 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fca5c0b3840 con 0x7fca5c0cca80 2024-04-25T09:06:29.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.165+0000 7fca58c00640 1 -- 172.21.15.175:0/1282766807 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7fca480598d0 con 0x7fca5c0cca80 2024-04-25T09:06:29.153 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:06:29.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.165+0000 7fca63600640 1 -- 172.21.15.175:0/1282766807 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fca3c066f60 msgr2=0x7fca3c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:29.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.165+0000 7fca63600640 1 --2- 172.21.15.175:0/1282766807 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fca3c066f60 0x7fca3c069420 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fca500ae000 tx=0x7fca50008040 comp rx=0 tx=0).stop 2024-04-25T09:06:29.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.165+0000 7fca63600640 1 -- 172.21.15.175:0/1282766807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca5c0cca80 msgr2=0x7fca5c147670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:29.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.165+0000 7fca63600640 1 --2- 172.21.15.175:0/1282766807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca5c0cca80 0x7fca5c147670 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fca4800e840 tx=0x7fca4800ec40 comp rx=0 tx=0).stop 2024-04-25T09:06:29.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.165+0000 7fca63600640 1 -- 172.21.15.175:0/1282766807 shutdown_connections 2024-04-25T09:06:29.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.165+0000 7fca63600640 1 --2- 172.21.15.175:0/1282766807 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fca3c066f60 0x7fca3c069420 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.165+0000 7fca63600640 1 --2- 172.21.15.175:0/1282766807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fca5c15ba40 0x7fca5c0caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.165+0000 7fca63600640 1 --2- 172.21.15.175:0/1282766807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca5c0cca80 0x7fca5c147670 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.165+0000 7fca63600640 1 --2- 172.21.15.175:0/1282766807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fca5c0b74c0 0x7fca5c0c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.165+0000 7fca63600640 1 -- 172.21.15.175:0/1282766807 >> 172.21.15.175:0/1282766807 conn(0x7fca5c06f550 msgr2=0x7fca5c06d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:29.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.165+0000 7fca63600640 1 -- 172.21.15.175:0/1282766807 shutdown_connections 2024-04-25T09:06:29.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.165+0000 7fca63600640 1 -- 172.21.15.175:0/1282766807 wait complete. 2024-04-25T09:06:29.175 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:29.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b7ea00640 1 Processor -- start 2024-04-25T09:06:29.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b7ea00640 1 -- start start 2024-04-25T09:06:29.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b7ea00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7b7806bd60 0x7f7b7806cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:29.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b7ea00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b780cfcb0 con 0x7f7b780d0d50 2024-04-25T09:06:29.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b7ea00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b780cff90 con 0x7f7b78099a50 2024-04-25T09:06:29.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b7ea00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b780d0270 con 0x7f7b7806bd60 2024-04-25T09:06:29.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b7ca00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7b780d0d50 0x7f7b780cbe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:54100/0 (socket says 172.21.15.175:54100) 2024-04-25T09:06:29.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b7ca00640 1 -- 172.21.15.175:0/3483527064 learned_addr learned my addr 172.21.15.175:0/3483527064 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:29.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b6f400640 1 --2- 172.21.15.175:0/3483527064 >> v2:172.21.15.177:3300/0 conn(0x7f7b7806bd60 0x7f7b7806cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:29.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b77400640 1 -- 172.21.15.175:0/3483527064 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911245249 0 0) 0x7f7b780cfcb0 con 0x7f7b780d0d50 2024-04-25T09:06:29.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b77400640 1 -- 172.21.15.175:0/3483527064 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b5c003530 con 0x7f7b780d0d50 2024-04-25T09:06:29.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b77400640 1 -- 172.21.15.175:0/3483527064 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788493410 0 0) 0x7f7b780cff90 con 0x7f7b78099a50 2024-04-25T09:06:29.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b77400640 1 -- 172.21.15.175:0/3483527064 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b780cfcb0 con 0x7f7b78099a50 2024-04-25T09:06:29.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b77400640 1 -- 172.21.15.175:0/3483527064 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3786668024 0 0) 0x7f7b5c003530 con 0x7f7b780d0d50 2024-04-25T09:06:29.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b77400640 1 -- 172.21.15.175:0/3483527064 >> v2:172.21.15.177:3300/0 conn(0x7f7b7806bd60 msgr2=0x7f7b7806cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:29.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b77400640 1 --2- 172.21.15.175:0/3483527064 >> v2:172.21.15.177:3300/0 conn(0x7f7b7806bd60 0x7f7b7806cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b77400640 1 -- 172.21.15.175:0/3483527064 >> v1:172.21.15.177:6789/0 conn(0x7f7b78099a50 legacy=0x7f7b78099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:29.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b77400640 1 -- 172.21.15.175:0/3483527064 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b780d0550 con 0x7f7b780d0d50 2024-04-25T09:06:29.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b77400640 1 -- 172.21.15.175:0/3483527064 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f7b70001a00 con 0x7f7b780d0d50 2024-04-25T09:06:29.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b77400640 1 -- 172.21.15.175:0/3483527064 >> v1:172.21.15.175:6789/0 conn(0x7f7b780d0d50 legacy=0x7f7b780cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:29.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b77400640 1 --2- 172.21.15.175:0/3483527064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b5c003b50 0x7f7b5c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:29.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b77400640 1 --2- 172.21.15.175:0/3483527064 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b5c004810 0x7f7b5c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:29.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b77400640 1 --2- 172.21.15.175:0/3483527064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b5c0051d0 0x7f7b5c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:29.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b77400640 1 -- 172.21.15.175:0/3483527064 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b780d0270 con 0x7f7b5c0051d0 2024-04-25T09:06:29.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b77400640 1 -- 172.21.15.175:0/3483527064 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c00c050 con 0x7f7b5c003b50 2024-04-25T09:06:29.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b77400640 1 -- 172.21.15.175:0/3483527064 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c00c250 con 0x7f7b5c004810 2024-04-25T09:06:29.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b7ca00640 1 --2- 172.21.15.175:0/3483527064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b5c0051d0 0x7f7b5c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:29.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.325+0000 7f7b6f400640 1 --2- 172.21.15.175:0/3483527064 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b5c004810 0x7f7b5c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:29.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.321+0000 7f7b77e00640 1 --2- 172.21.15.175:0/3483527064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b5c003b50 0x7f7b5c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:29.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.325+0000 7f7b7ca00640 1 -- 172.21.15.175:0/3483527064 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b5c004810 msgr2=0x7f7b5c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:29.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.325+0000 7f7b7ca00640 1 --2- 172.21.15.175:0/3483527064 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b5c004810 0x7f7b5c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.325+0000 7f7b7ca00640 1 -- 172.21.15.175:0/3483527064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b5c003b50 msgr2=0x7f7b5c003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:29.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.325+0000 7f7b7ca00640 1 --2- 172.21.15.175:0/3483527064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b5c003b50 0x7f7b5c003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.325+0000 7f7b7ca00640 1 -- 172.21.15.175:0/3483527064 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5c003530 con 0x7f7b5c0051d0 2024-04-25T09:06:29.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.325+0000 7f7b77e00640 1 --2- 172.21.15.175:0/3483527064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b5c003b50 0x7f7b5c003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:29.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.325+0000 7f7b7ca00640 1 -- 172.21.15.175:0/3483527064 reap_dead start 2024-04-25T09:06:29.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.325+0000 7f7b7ca00640 1 --2- 172.21.15.175:0/3483527064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b5c0051d0 0x7f7b5c00b9d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000a820 tx=0x7f7b7001fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a636b6b20b57cb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:29.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.325+0000 7f7b77400640 1 -- 172.21.15.175:0/3483527064 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7000a450 con 0x7f7b5c0051d0 2024-04-25T09:06:29.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.325+0000 7f7b77400640 1 -- 172.21.15.175:0/3483527064 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b700aa6d0 con 0x7f7b5c0051d0 2024-04-25T09:06:29.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.325+0000 7f7b77400640 1 -- 172.21.15.175:0/3483527064 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b700aaac0 con 0x7f7b5c0051d0 2024-04-25T09:06:29.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.325+0000 7f7b7ea00640 1 -- 172.21.15.175:0/3483527064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b5c0051d0 msgr2=0x7f7b5c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:29.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.325+0000 7f7b7ea00640 1 --2- 172.21.15.175:0/3483527064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b5c0051d0 0x7f7b5c00b9d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000a820 tx=0x7f7b7001fa60 comp rx=0 tx=0).stop 2024-04-25T09:06:29.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.325+0000 7f7b7ea00640 1 -- 172.21.15.175:0/3483527064 shutdown_connections 2024-04-25T09:06:29.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.325+0000 7f7b7ea00640 1 --2- 172.21.15.175:0/3483527064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b5c0051d0 0x7f7b5c00b9d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.325+0000 7f7b7ea00640 1 -- 172.21.15.175:0/3483527064 >> 172.21.15.175:0/3483527064 conn(0x7f7b780b3300 msgr2=0x7f7b780b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:29.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ea00640 1 -- 172.21.15.175:0/3483527064 shutdown_connections 2024-04-25T09:06:29.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ea00640 1 -- 172.21.15.175:0/3483527064 wait complete. 2024-04-25T09:06:29.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ea00640 1 Processor -- start 2024-04-25T09:06:29.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ea00640 1 -- start start 2024-04-25T09:06:29.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b5c0051d0 0x7f7b781ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:29.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b7815ba80 0x7f7b7815bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:29.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b780b52a0 0x7f7b780b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:29.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ea00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b780cf9a0 con 0x7f7b780b52a0 2024-04-25T09:06:29.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ea00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7815de60 con 0x7f7b7815ba80 2024-04-25T09:06:29.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ea00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b78155590 con 0x7f7b5c0051d0 2024-04-25T09:06:29.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b780b52a0 0x7f7b780b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:29.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b780b52a0 0x7f7b780b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44488/0 (socket says 172.21.15.175:44488) 2024-04-25T09:06:29.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ca00640 1 -- 172.21.15.175:0/3894523891 learned_addr learned my addr 172.21.15.175:0/3894523891 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:29.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b6f400640 1 --2- 172.21.15.175:0/3894523891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b7815ba80 0x7f7b7815bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:29.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b77e00640 1 --2- 172.21.15.175:0/3894523891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b5c0051d0 0x7f7b781ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:29.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ca00640 1 -- 172.21.15.175:0/3894523891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b5c0051d0 msgr2=0x7f7b781ed9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:29.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ca00640 1 --2- 172.21.15.175:0/3894523891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b5c0051d0 0x7f7b781ed9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ca00640 1 -- 172.21.15.175:0/3894523891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b7815ba80 msgr2=0x7f7b7815bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:29.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ca00640 1 --2- 172.21.15.175:0/3894523891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b7815ba80 0x7f7b7815bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ca00640 1 -- 172.21.15.175:0/3894523891 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b781f3a60 con 0x7f7b780b52a0 2024-04-25T09:06:29.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b77e00640 1 --2- 172.21.15.175:0/3894523891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b5c0051d0 0x7f7b781ed9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:29.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ca00640 1 --2- 172.21.15.175:0/3894523891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b780b52a0 0x7f7b780b5750 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7b70007040 tx=0x7f7b5c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:29.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b74c00640 1 -- 172.21.15.175:0/3894523891 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b700af070 con 0x7f7b780b52a0 2024-04-25T09:06:29.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b74c00640 1 -- 172.21.15.175:0/3894523891 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b700ba070 con 0x7f7b780b52a0 2024-04-25T09:06:29.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b74c00640 1 -- 172.21.15.175:0/3894523891 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7000a450 con 0x7f7b780b52a0 2024-04-25T09:06:29.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.329+0000 7f7b7ea00640 1 -- 172.21.15.175:0/3894523891 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b781f3d40 con 0x7f7b780b52a0 2024-04-25T09:06:29.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.333+0000 7f7b7ea00640 1 -- 172.21.15.175:0/3894523891 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b781f4300 con 0x7f7b780b52a0 2024-04-25T09:06:29.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.333+0000 7f7b7ea00640 1 -- 172.21.15.175:0/3894523891 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b78074a60 con 0x7f7b780b52a0 2024-04-25T09:06:29.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.333+0000 7f7b74c00640 1 -- 172.21.15.175:0/3894523891 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7b70001800 con 0x7f7b780b52a0 2024-04-25T09:06:29.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.333+0000 7f7b74c00640 1 --2- 172.21.15.175:0/3894523891 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7b54066f60 0x7f7b54069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:29.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.333+0000 7f7b74c00640 1 -- 172.21.15.175:0/3894523891 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7b70122900 con 0x7f7b780b52a0 2024-04-25T09:06:29.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.333+0000 7f7b77e00640 1 --2- 172.21.15.175:0/3894523891 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7b54066f60 0x7f7b54069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:29.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.333+0000 7f7b77e00640 1 --2- 172.21.15.175:0/3894523891 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7b54066f60 0x7f7b54069420 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7b780b74c0 tx=0x7f7b68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:29.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.337+0000 7f7b74c00640 1 -- 172.21.15.175:0/3894523891 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7b70019770 con 0x7f7b780b52a0 2024-04-25T09:06:29.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.521+0000 7f7b7ea00640 1 -- 172.21.15.175:0/3894523891 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b7809aee0 con 0x7f7b780b52a0 2024-04-25T09:06:29.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.525+0000 7f7b74c00640 1 -- 172.21.15.175:0/3894523891 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f7b700f38c0 con 0x7f7b780b52a0 2024-04-25T09:06:29.513 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:29.513 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5102,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2763692769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2763692769},{"type":"v1","addr":"172.21.15.175:6837","nonce":2763692769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3823569323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3823569323},{"type":"v1","addr":"172.21.15.177:6834","nonce":3823569323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2687013607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2687013607},{"type":"v1","addr":"172.21.15.177:6835","nonce":2687013607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:45.332647+0000","modified":"2024-04-25T09:05:48.357816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6836/1389262120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1389262120},{"type":"v1","addr":"172.21.15.175:6836","nonce":1389262120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:29.513 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 25 2024-04-25T09:06:29.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.525+0000 7f7b7ea00640 1 -- 172.21.15.175:0/3894523891 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7b54066f60 msgr2=0x7f7b54069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:29.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.525+0000 7f7b7ea00640 1 --2- 172.21.15.175:0/3894523891 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7b54066f60 0x7f7b54069420 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7b780b74c0 tx=0x7f7b68009040 comp rx=0 tx=0).stop 2024-04-25T09:06:29.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.525+0000 7f7b7ea00640 1 -- 172.21.15.175:0/3894523891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b780b52a0 msgr2=0x7f7b780b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:29.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.525+0000 7f7b7ea00640 1 --2- 172.21.15.175:0/3894523891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b780b52a0 0x7f7b780b5750 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7b70007040 tx=0x7f7b5c005840 comp rx=0 tx=0).stop 2024-04-25T09:06:29.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.525+0000 7f7b7ea00640 1 -- 172.21.15.175:0/3894523891 shutdown_connections 2024-04-25T09:06:29.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.525+0000 7f7b7ea00640 1 --2- 172.21.15.175:0/3894523891 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7b54066f60 0x7f7b54069420 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.525+0000 7f7b7ea00640 1 --2- 172.21.15.175:0/3894523891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b780b52a0 0x7f7b780b5750 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.525+0000 7f7b7ea00640 1 --2- 172.21.15.175:0/3894523891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b7815ba80 0x7f7b7815bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.525+0000 7f7b7ea00640 1 --2- 172.21.15.175:0/3894523891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b5c0051d0 0x7f7b781ed9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.525+0000 7f7b7ea00640 1 -- 172.21.15.175:0/3894523891 >> 172.21.15.175:0/3894523891 conn(0x7f7b780b3300 msgr2=0x7f7b780ae4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:29.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.525+0000 7f7b7ea00640 1 -- 172.21.15.175:0/3894523891 shutdown_connections 2024-04-25T09:06:29.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.525+0000 7f7b7ea00640 1 -- 172.21.15.175:0/3894523891 wait complete. 2024-04-25T09:06:29.535 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:29.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.681+0000 7f60c0e00640 1 Processor -- start 2024-04-25T09:06:29.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.681+0000 7f60c0e00640 1 -- start start 2024-04-25T09:06:29.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60c0e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f60bc0b3450 0x7f60bc168ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:29.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60c0e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60bc06f280 con 0x7f60bc0acd90 2024-04-25T09:06:29.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60c0e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60bc06acf0 con 0x7f60bc15db00 2024-04-25T09:06:29.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60c0e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60bc06afd0 con 0x7f60bc0b3450 2024-04-25T09:06:29.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b1400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f60bc0acd90 0x7f60bc0b2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:54108/0 (socket says 172.21.15.175:54108) 2024-04-25T09:06:29.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b1400640 1 -- 172.21.15.175:0/2408427976 learned_addr learned my addr 172.21.15.175:0/2408427976 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:29.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b9400640 1 -- 172.21.15.175:0/2408427976 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623446860 0 0) 0x7f60bc06f280 con 0x7f60bc0acd90 2024-04-25T09:06:29.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b9400640 1 -- 172.21.15.175:0/2408427976 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60a0003530 con 0x7f60bc0acd90 2024-04-25T09:06:29.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60ba800640 1 --2- 172.21.15.175:0/2408427976 >> v2:172.21.15.177:3300/0 conn(0x7f60bc0b3450 0x7f60bc168ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:29.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b9400640 1 -- 172.21.15.175:0/2408427976 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 42043214 0 0) 0x7f60a0003530 con 0x7f60bc0acd90 2024-04-25T09:06:29.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b9400640 1 -- 172.21.15.175:0/2408427976 >> v2:172.21.15.177:3300/0 conn(0x7f60bc0b3450 msgr2=0x7f60bc168ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:29.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b9400640 1 --2- 172.21.15.175:0/2408427976 >> v2:172.21.15.177:3300/0 conn(0x7f60bc0b3450 0x7f60bc168ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b9400640 1 -- 172.21.15.175:0/2408427976 >> v1:172.21.15.177:6789/0 conn(0x7f60bc15db00 legacy=0x7f60bc06e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:29.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b9400640 1 -- 172.21.15.175:0/2408427976 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc06b2b0 con 0x7f60bc0acd90 2024-04-25T09:06:29.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b9400640 1 -- 172.21.15.175:0/2408427976 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f60a4001680 con 0x7f60bc0acd90 2024-04-25T09:06:29.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b9400640 1 -- 172.21.15.175:0/2408427976 >> v1:172.21.15.175:6789/0 conn(0x7f60bc0acd90 legacy=0x7f60bc0b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:29.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b9400640 1 --2- 172.21.15.175:0/2408427976 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60a0003a10 0x7f60a0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:29.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b9400640 1 --2- 172.21.15.175:0/2408427976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60a0004810 0x7f60a0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:29.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b9400640 1 --2- 172.21.15.175:0/2408427976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60a0005220 0x7f60a000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:29.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b9400640 1 -- 172.21.15.175:0/2408427976 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc06afd0 con 0x7f60a0005220 2024-04-25T09:06:29.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b9400640 1 -- 172.21.15.175:0/2408427976 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a000c170 con 0x7f60a0004810 2024-04-25T09:06:29.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b9400640 1 -- 172.21.15.175:0/2408427976 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a000c370 con 0x7f60a0003a10 2024-04-25T09:06:29.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60ba800640 1 --2- 172.21.15.175:0/2408427976 >> v2:172.21.15.177:3300/0 conn(0x7f60bc0b3450 0x7f60bc168ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:29.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60ba800640 1 --2- 172.21.15.175:0/2408427976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60a0005220 0x7f60a000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:29.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b9e00640 1 --2- 172.21.15.175:0/2408427976 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60a0003a10 0x7f60a0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:29.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b1400640 1 --2- 172.21.15.175:0/2408427976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60a0004810 0x7f60a0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:29.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60ba800640 1 -- 172.21.15.175:0/2408427976 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60a0003a10 msgr2=0x7f60a0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:29.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60ba800640 1 --2- 172.21.15.175:0/2408427976 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60a0003a10 0x7f60a0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60ba800640 1 -- 172.21.15.175:0/2408427976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60a0004810 msgr2=0x7f60a0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:29.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60ba800640 1 --2- 172.21.15.175:0/2408427976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60a0004810 0x7f60a0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60ba800640 1 -- 172.21.15.175:0/2408427976 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a0003530 con 0x7f60a0005220 2024-04-25T09:06:29.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.685+0000 7f60b1400640 1 --2- 172.21.15.175:0/2408427976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60a0004810 0x7f60a0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:29.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.689+0000 7f60ba800640 1 -- 172.21.15.175:0/2408427976 reap_dead start 2024-04-25T09:06:29.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.689+0000 7f60ba800640 1 --2- 172.21.15.175:0/2408427976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60a0005220 0x7f60a000b9d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f60b40073e0 tx=0x7f60b401cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53659dd21b2370d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:29.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.689+0000 7f60b9400640 1 -- 172.21.15.175:0/2408427976 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b4009c70 con 0x7f60a0005220 2024-04-25T09:06:29.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.689+0000 7f60b9400640 1 -- 172.21.15.175:0/2408427976 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b40ad440 con 0x7f60a0005220 2024-04-25T09:06:29.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.689+0000 7f60b9400640 1 -- 172.21.15.175:0/2408427976 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b40a5e60 con 0x7f60a0005220 2024-04-25T09:06:29.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.689+0000 7f60c0e00640 1 -- 172.21.15.175:0/2408427976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60a0005220 msgr2=0x7f60a000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:29.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.689+0000 7f60c0e00640 1 --2- 172.21.15.175:0/2408427976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60a0005220 0x7f60a000b9d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f60b40073e0 tx=0x7f60b401cf40 comp rx=0 tx=0).stop 2024-04-25T09:06:29.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.689+0000 7f60c0e00640 1 -- 172.21.15.175:0/2408427976 shutdown_connections 2024-04-25T09:06:29.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.689+0000 7f60c0e00640 1 --2- 172.21.15.175:0/2408427976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60a0005220 0x7f60a000b9d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.689+0000 7f60c0e00640 1 -- 172.21.15.175:0/2408427976 >> 172.21.15.175:0/2408427976 conn(0x7f60bc0b2200 msgr2=0x7f60bc0cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:29.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.689+0000 7f60c0e00640 1 -- 172.21.15.175:0/2408427976 shutdown_connections 2024-04-25T09:06:29.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.689+0000 7f60c0e00640 1 -- 172.21.15.175:0/2408427976 wait complete. 2024-04-25T09:06:29.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.689+0000 7f60c0e00640 1 Processor -- start 2024-04-25T09:06:29.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.689+0000 7f60c0e00640 1 -- start start 2024-04-25T09:06:29.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60c0e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60a0005220 0x7f60bc0ced50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:29.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60c0e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60bc0cd7b0 0x7f60bc15b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:29.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60c0e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60bc15a0d0 0x7f60bc15a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:29.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60c0e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc0b3880 con 0x7f60a0005220 2024-04-25T09:06:29.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60c0e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc15dee0 con 0x7f60bc15a0d0 2024-04-25T09:06:29.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60c0e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc0b3a00 con 0x7f60bc0cd7b0 2024-04-25T09:06:29.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60b9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60a0005220 0x7f60bc0ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:29.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60b9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60a0005220 0x7f60bc0ced50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44498/0 (socket says 172.21.15.175:44498) 2024-04-25T09:06:29.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60b9e00640 1 -- 172.21.15.175:0/2766374775 learned_addr learned my addr 172.21.15.175:0/2766374775 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:29.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60b1400640 1 --2- 172.21.15.175:0/2766374775 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60bc0cd7b0 0x7f60bc15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:29.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60ba800640 1 --2- 172.21.15.175:0/2766374775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60bc15a0d0 0x7f60bc15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:29.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60b9e00640 1 -- 172.21.15.175:0/2766374775 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60bc0cd7b0 msgr2=0x7f60bc15b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:29.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60b9e00640 1 --2- 172.21.15.175:0/2766374775 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60bc0cd7b0 0x7f60bc15b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60b9e00640 1 -- 172.21.15.175:0/2766374775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60bc15a0d0 msgr2=0x7f60bc15a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:29.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60b9e00640 1 --2- 172.21.15.175:0/2766374775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60bc15a0d0 0x7f60bc15a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60b9e00640 1 -- 172.21.15.175:0/2766374775 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc0cdcb0 con 0x7f60a0005220 2024-04-25T09:06:29.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60b1400640 1 --2- 172.21.15.175:0/2766374775 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60bc0cd7b0 0x7f60bc15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:29.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60b9e00640 1 --2- 172.21.15.175:0/2766374775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60a0005220 0x7f60bc0ced50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00f820 tx=0x7f60ac00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:29.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60b2a00640 1 -- 172.21.15.175:0/2766374775 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac001cf0 con 0x7f60a0005220 2024-04-25T09:06:29.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60b2a00640 1 -- 172.21.15.175:0/2766374775 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac018070 con 0x7f60a0005220 2024-04-25T09:06:29.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60c0e00640 1 -- 172.21.15.175:0/2766374775 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60bc0cdf90 con 0x7f60a0005220 2024-04-25T09:06:29.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60b2a00640 1 -- 172.21.15.175:0/2766374775 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac00d730 con 0x7f60a0005220 2024-04-25T09:06:29.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60c0e00640 1 -- 172.21.15.175:0/2766374775 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60bc0ce550 con 0x7f60a0005220 2024-04-25T09:06:29.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60c0e00640 1 -- 172.21.15.175:0/2766374775 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60bc074a60 con 0x7f60a0005220 2024-04-25T09:06:29.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.693+0000 7f60b2a00640 1 -- 172.21.15.175:0/2766374775 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f60ac00d8d0 con 0x7f60a0005220 2024-04-25T09:06:29.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.697+0000 7f60b2a00640 1 --2- 172.21.15.175:0/2766374775 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6098066f60 0x7f6098069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:29.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.697+0000 7f60b2a00640 1 -- 172.21.15.175:0/2766374775 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f60ac084f30 con 0x7f60a0005220 2024-04-25T09:06:29.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.697+0000 7f60b1400640 1 --2- 172.21.15.175:0/2766374775 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6098066f60 0x7f6098069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:29.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.697+0000 7f60b1400640 1 --2- 172.21.15.175:0/2766374775 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6098066f60 0x7f6098069420 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f60bc159c40 tx=0x7f60a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:29.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.701+0000 7f60b2a00640 1 -- 172.21.15.175:0/2766374775 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f60ac055e60 con 0x7f60a0005220 2024-04-25T09:06:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.857+0000 7f60c0e00640 1 -- 172.21.15.175:0/2766374775 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60bc1541e0 con 0x7f60a0005220 2024-04-25T09:06:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.861+0000 7f60b2a00640 1 -- 172.21.15.175:0/2766374775 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16741 (secure 0 0 0) 0x7f60ac055760 con 0x7f60a0005220 2024-04-25T09:06:29.849 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:29.849 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":46,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:05:52.004266+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:43.050603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:44.332424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.1b","mappings":[{"from":0,"to":4}]},{"pgid":"7.37","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:29.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.861+0000 7f60c0e00640 1 -- 172.21.15.175:0/2766374775 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6098066f60 msgr2=0x7f6098069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:29.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.861+0000 7f60c0e00640 1 --2- 172.21.15.175:0/2766374775 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6098066f60 0x7f6098069420 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f60bc159c40 tx=0x7f60a4009040 comp rx=0 tx=0).stop 2024-04-25T09:06:29.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.861+0000 7f60c0e00640 1 -- 172.21.15.175:0/2766374775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60a0005220 msgr2=0x7f60bc0ced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:29.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.861+0000 7f60c0e00640 1 --2- 172.21.15.175:0/2766374775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60a0005220 0x7f60bc0ced50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00f820 tx=0x7f60ac00fce0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.861+0000 7f60c0e00640 1 -- 172.21.15.175:0/2766374775 shutdown_connections 2024-04-25T09:06:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.861+0000 7f60c0e00640 1 --2- 172.21.15.175:0/2766374775 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6098066f60 0x7f6098069420 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.861+0000 7f60c0e00640 1 --2- 172.21.15.175:0/2766374775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60bc15a0d0 0x7f60bc15a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.861+0000 7f60c0e00640 1 --2- 172.21.15.175:0/2766374775 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f60bc0cd7b0 0x7f60bc15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.861+0000 7f60c0e00640 1 --2- 172.21.15.175:0/2766374775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60a0005220 0x7f60bc0ced50 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.861+0000 7f60c0e00640 1 -- 172.21.15.175:0/2766374775 >> 172.21.15.175:0/2766374775 conn(0x7f60bc0b2200 msgr2=0x7f60bc1523a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.861+0000 7f60c0e00640 1 -- 172.21.15.175:0/2766374775 shutdown_connections 2024-04-25T09:06:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:29.861+0000 7f60c0e00640 1 -- 172.21.15.175:0/2766374775 wait complete. 2024-04-25T09:06:29.870 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:06:29.870 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:30.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.017+0000 7f85fe200640 1 Processor -- start 2024-04-25T09:06:30.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.017+0000 7f85fe200640 1 -- start start 2024-04-25T09:06:30.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.021+0000 7f85fe200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f85f80cfc70 0x7f85f806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.021+0000 7f85fe200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f80cda00 con 0x7f85f80cd520 2024-04-25T09:06:30.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.021+0000 7f85fe200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f80cdce0 con 0x7f85f815a900 2024-04-25T09:06:30.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.021+0000 7f85fe200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f815bcf0 con 0x7f85f80cfc70 2024-04-25T09:06:30.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.021+0000 7f85f7e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f85f80cfc70 0x7f85f806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.021+0000 7f85eea00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f85f80cd520 0x7f85f80cf560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:54120/0 (socket says 172.21.15.175:54120) 2024-04-25T09:06:30.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.021+0000 7f85eea00640 1 -- 172.21.15.175:0/4257046778 learned_addr learned my addr 172.21.15.175:0/4257046778 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:30.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.021+0000 7f85f6a00640 1 -- 172.21.15.175:0/4257046778 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232861361 0 0) 0x7f85f80cda00 con 0x7f85f80cd520 2024-04-25T09:06:30.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.021+0000 7f85f7e00640 1 -- 172.21.15.175:0/4257046778 >> v1:172.21.15.177:6789/0 conn(0x7f85f815a900 legacy=0x7f85f80ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.021+0000 7f85f7e00640 1 -- 172.21.15.175:0/4257046778 >> v1:172.21.15.175:6789/0 conn(0x7f85f80cd520 legacy=0x7f85f80cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.021+0000 7f85f7e00640 1 -- 172.21.15.175:0/4257046778 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f80cdfc0 con 0x7f85f80cfc70 2024-04-25T09:06:30.012 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.021+0000 7f85f7e00640 1 --2- 172.21.15.175:0/4257046778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f80cfc70 0x7f85f806e150 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f85f0009d90 tx=0x7f85f001c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16a57a5339987de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.012 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.021+0000 7f85f6a00640 1 -- 172.21.15.175:0/4257046778 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f00b2070 con 0x7f85f80cfc70 2024-04-25T09:06:30.012 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.021+0000 7f85f6a00640 1 -- 172.21.15.175:0/4257046778 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f00a5750 con 0x7f85f80cfc70 2024-04-25T09:06:30.012 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.021+0000 7f85f6a00640 1 -- 172.21.15.175:0/4257046778 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f00a5b20 con 0x7f85f80cfc70 2024-04-25T09:06:30.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85fe200640 1 -- 172.21.15.175:0/4257046778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f80cfc70 msgr2=0x7f85f806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85fe200640 1 --2- 172.21.15.175:0/4257046778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f80cfc70 0x7f85f806e150 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f85f0009d90 tx=0x7f85f001c820 comp rx=0 tx=0).stop 2024-04-25T09:06:30.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85fe200640 1 -- 172.21.15.175:0/4257046778 shutdown_connections 2024-04-25T09:06:30.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85fe200640 1 --2- 172.21.15.175:0/4257046778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f80cfc70 0x7f85f806e150 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85fe200640 1 -- 172.21.15.175:0/4257046778 >> 172.21.15.175:0/4257046778 conn(0x7f85f8067150 msgr2=0x7f85f806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85fe200640 1 -- 172.21.15.175:0/4257046778 shutdown_connections 2024-04-25T09:06:30.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85fe200640 1 -- 172.21.15.175:0/4257046778 wait complete. 2024-04-25T09:06:30.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85fe200640 1 Processor -- start 2024-04-25T09:06:30.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85fe200640 1 -- start start 2024-04-25T09:06:30.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85fe200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85f80cfc70 0x7f85f8149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85fe200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f815a900 0x7f85f8153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85fe200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85f8154420 0x7f85f8155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85fe200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f815c910 con 0x7f85f815a900 2024-04-25T09:06:30.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85fe200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f815c790 con 0x7f85f80cfc70 2024-04-25T09:06:30.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85fe200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f8168410 con 0x7f85f8154420 2024-04-25T09:06:30.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85eea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f815a900 0x7f85f8153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85eea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f815a900 0x7f85f8153ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44514/0 (socket says 172.21.15.175:44514) 2024-04-25T09:06:30.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85eea00640 1 -- 172.21.15.175:0/4200345424 learned_addr learned my addr 172.21.15.175:0/4200345424 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:30.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85f7400640 1 --2- 172.21.15.175:0/4200345424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85f80cfc70 0x7f85f8149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85f7e00640 1 --2- 172.21.15.175:0/4200345424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85f8154420 0x7f85f8155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85eea00640 1 -- 172.21.15.175:0/4200345424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85f8154420 msgr2=0x7f85f8155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85eea00640 1 --2- 172.21.15.175:0/4200345424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85f8154420 0x7f85f8155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85eea00640 1 -- 172.21.15.175:0/4200345424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85f80cfc70 msgr2=0x7f85f8149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85eea00640 1 --2- 172.21.15.175:0/4200345424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85f80cfc70 0x7f85f8149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.025+0000 7f85eea00640 1 -- 172.21.15.175:0/4200345424 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f814cf10 con 0x7f85f815a900 2024-04-25T09:06:30.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.029+0000 7f85eea00640 1 --2- 172.21.15.175:0/4200345424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f815a900 0x7f85f8153ee0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f85e000c4b0 tx=0x7f85e000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.029+0000 7f85efe00640 1 -- 172.21.15.175:0/4200345424 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0018070 con 0x7f85f815a900 2024-04-25T09:06:30.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.029+0000 7f85efe00640 1 -- 172.21.15.175:0/4200345424 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e00074e0 con 0x7f85f815a900 2024-04-25T09:06:30.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.029+0000 7f85efe00640 1 -- 172.21.15.175:0/4200345424 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0004a30 con 0x7f85f815a900 2024-04-25T09:06:30.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.029+0000 7f85fe200640 1 -- 172.21.15.175:0/4200345424 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f8156570 con 0x7f85f815a900 2024-04-25T09:06:30.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.029+0000 7f85fe200640 1 -- 172.21.15.175:0/4200345424 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f814d380 con 0x7f85f815a900 2024-04-25T09:06:30.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.029+0000 7f85fe200640 1 -- 172.21.15.175:0/4200345424 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f8074a60 con 0x7f85f815a900 2024-04-25T09:06:30.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.029+0000 7f85efe00640 1 -- 172.21.15.175:0/4200345424 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f85e0004bd0 con 0x7f85f815a900 2024-04-25T09:06:30.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.029+0000 7f85efe00640 1 --2- 172.21.15.175:0/4200345424 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f85d4066f90 0x7f85d4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.029+0000 7f85efe00640 1 -- 172.21.15.175:0/4200345424 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f85e00842c0 con 0x7f85f815a900 2024-04-25T09:06:30.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.029+0000 7f85f7400640 1 --2- 172.21.15.175:0/4200345424 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f85d4066f90 0x7f85d4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.033+0000 7f85f7400640 1 --2- 172.21.15.175:0/4200345424 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f85d4066f90 0x7f85d4069450 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f85e8007fd0 tx=0x7f85e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.033+0000 7f85efe00640 1 -- 172.21.15.175:0/4200345424 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f85f814cf10 con 0x7f85f815a900 2024-04-25T09:06:30.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.217+0000 7f85fe200640 1 -- 172.21.15.175:0/4200345424 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85f8072130 con 0x7f85f815a900 2024-04-25T09:06:30.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.221+0000 7f85efe00640 1 -- 172.21.15.175:0/4200345424 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f85e0054c40 con 0x7f85f815a900 2024-04-25T09:06:30.209 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:30.209 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5102,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2763692769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2763692769},{"type":"v1","addr":"172.21.15.175:6837","nonce":2763692769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3823569323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3823569323},{"type":"v1","addr":"172.21.15.177:6834","nonce":3823569323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2687013607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2687013607},{"type":"v1","addr":"172.21.15.177:6835","nonce":2687013607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:45.332647+0000","modified":"2024-04-25T09:05:48.357816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6836/1389262120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1389262120},{"type":"v1","addr":"172.21.15.175:6836","nonce":1389262120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:30.209 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 25 2024-04-25T09:06:30.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.221+0000 7f85fe200640 1 -- 172.21.15.175:0/4200345424 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f85d4066f90 msgr2=0x7f85d4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.221+0000 7f85fe200640 1 --2- 172.21.15.175:0/4200345424 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f85d4066f90 0x7f85d4069450 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f85e8007fd0 tx=0x7f85e8009040 comp rx=0 tx=0).stop 2024-04-25T09:06:30.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.221+0000 7f85fe200640 1 -- 172.21.15.175:0/4200345424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f815a900 msgr2=0x7f85f8153ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.221+0000 7f85fe200640 1 --2- 172.21.15.175:0/4200345424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f815a900 0x7f85f8153ee0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f85e000c4b0 tx=0x7f85e000c970 comp rx=0 tx=0).stop 2024-04-25T09:06:30.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.221+0000 7f85fe200640 1 -- 172.21.15.175:0/4200345424 shutdown_connections 2024-04-25T09:06:30.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.221+0000 7f85fe200640 1 --2- 172.21.15.175:0/4200345424 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f85d4066f90 0x7f85d4069450 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.221+0000 7f85fe200640 1 --2- 172.21.15.175:0/4200345424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85f8154420 0x7f85f8155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.221+0000 7f85fe200640 1 --2- 172.21.15.175:0/4200345424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f815a900 0x7f85f8153ee0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.221+0000 7f85fe200640 1 --2- 172.21.15.175:0/4200345424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85f80cfc70 0x7f85f8149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.221+0000 7f85fe200640 1 -- 172.21.15.175:0/4200345424 >> 172.21.15.175:0/4200345424 conn(0x7f85f80cd520 msgr2=0x7f85f806ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.221+0000 7f85fe200640 1 -- 172.21.15.175:0/4200345424 shutdown_connections 2024-04-25T09:06:30.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.221+0000 7f85fe200640 1 -- 172.21.15.175:0/4200345424 wait complete. 2024-04-25T09:06:30.229 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:30.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.373+0000 7f28d9a00640 1 Processor -- start 2024-04-25T09:06:30.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.373+0000 7f28d9a00640 1 -- start start 2024-04-25T09:06:30.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.377+0000 7f28d9a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f28d415de10 0x7f28d40af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.377+0000 7f28d9a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f28d40ada50 0x7f28d40ade80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.377+0000 7f28d9a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d40afb60 con 0x7f28d40d11d0 2024-04-25T09:06:30.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.377+0000 7f28d9a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d40af930 con 0x7f28d40ada50 2024-04-25T09:06:30.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.377+0000 7f28d9a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d40ae4f0 con 0x7f28d415de10 2024-04-25T09:06:30.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.377+0000 7f28d9000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f28d40ada50 0x7f28d40ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.377+0000 7f28d9000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f28d40ada50 0x7f28d40ade80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44530/0 (socket says 172.21.15.175:44530) 2024-04-25T09:06:30.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.377+0000 7f28d9000640 1 -- 172.21.15.175:0/2779682476 learned_addr learned my addr 172.21.15.175:0/2779682476 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:30.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.377+0000 7f28d3e00640 1 --2- 172.21.15.175:0/2779682476 >> v2:172.21.15.177:3300/0 conn(0x7f28d415de10 0x7f28d40af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.377+0000 7f28d9000640 1 -- 172.21.15.175:0/2779682476 >> v2:172.21.15.177:3300/0 conn(0x7f28d415de10 msgr2=0x7f28d40af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.377+0000 7f28d9000640 1 --2- 172.21.15.175:0/2779682476 >> v2:172.21.15.177:3300/0 conn(0x7f28d415de10 0x7f28d40af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.377+0000 7f28d9000640 1 -- 172.21.15.175:0/2779682476 >> v1:172.21.15.177:6789/0 conn(0x7f28d40d11d0 legacy=0x7f28d40ad340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.377+0000 7f28d9000640 1 -- 172.21.15.175:0/2779682476 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d40ae7d0 con 0x7f28d40ada50 2024-04-25T09:06:30.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.381+0000 7f28d9000640 1 --2- 172.21.15.175:0/2779682476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28d40ada50 0x7f28d40ade80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f28d4072400 tx=0x7f28cc01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09d8d99ad033d39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.381+0000 7f28d2a00640 1 -- 172.21.15.175:0/2779682476 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0a56a0 con 0x7f28d40ada50 2024-04-25T09:06:30.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.381+0000 7f28d2a00640 1 -- 172.21.15.175:0/2779682476 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc0a5840 con 0x7f28d40ada50 2024-04-25T09:06:30.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.381+0000 7f28d2a00640 1 -- 172.21.15.175:0/2779682476 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0a5c10 con 0x7f28d40ada50 2024-04-25T09:06:30.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.381+0000 7f28d9a00640 1 -- 172.21.15.175:0/2779682476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28d40ada50 msgr2=0x7f28d40ade80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.381+0000 7f28d9a00640 1 --2- 172.21.15.175:0/2779682476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28d40ada50 0x7f28d40ade80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f28d4072400 tx=0x7f28cc01c8d0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.381+0000 7f28d9a00640 1 -- 172.21.15.175:0/2779682476 shutdown_connections 2024-04-25T09:06:30.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.381+0000 7f28d9a00640 1 --2- 172.21.15.175:0/2779682476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28d40ada50 0x7f28d40ade80 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.381+0000 7f28d9a00640 1 --2- 172.21.15.175:0/2779682476 >> v2:172.21.15.177:3300/0 conn(0x7f28d415de10 0x7f28d40af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.381+0000 7f28d9a00640 1 -- 172.21.15.175:0/2779682476 >> 172.21.15.175:0/2779682476 conn(0x7f28d4099a50 msgr2=0x7f28d40d0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.381+0000 7f28d9a00640 1 -- 172.21.15.175:0/2779682476 shutdown_connections 2024-04-25T09:06:30.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.381+0000 7f28d9a00640 1 -- 172.21.15.175:0/2779682476 wait complete. 2024-04-25T09:06:30.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.381+0000 7f28d9a00640 1 Processor -- start 2024-04-25T09:06:30.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.381+0000 7f28d9a00640 1 -- start start 2024-04-25T09:06:30.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d9a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28d40ada50 0x7f28d414ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d9a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28d40d11d0 0x7f28d4151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d9a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28d415de10 0x7f28d40c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d9a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40b16b0 con 0x7f28d415de10 2024-04-25T09:06:30.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d9a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d415e440 con 0x7f28d40d11d0 2024-04-25T09:06:30.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d9a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40b1830 con 0x7f28d40ada50 2024-04-25T09:06:30.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d9000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28d415de10 0x7f28d40c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d9000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28d415de10 0x7f28d40c7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44538/0 (socket says 172.21.15.175:44538) 2024-04-25T09:06:30.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d9000640 1 -- 172.21.15.175:0/2934873723 learned_addr learned my addr 172.21.15.175:0/2934873723 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:30.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d3400640 1 --2- 172.21.15.175:0/2934873723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28d40d11d0 0x7f28d4151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d3e00640 1 --2- 172.21.15.175:0/2934873723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28d40ada50 0x7f28d414ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d9000640 1 -- 172.21.15.175:0/2934873723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28d40ada50 msgr2=0x7f28d414ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d9000640 1 --2- 172.21.15.175:0/2934873723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28d40ada50 0x7f28d414ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d9000640 1 -- 172.21.15.175:0/2934873723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28d40d11d0 msgr2=0x7f28d4151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d9000640 1 --2- 172.21.15.175:0/2934873723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28d40d11d0 0x7f28d4151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d9000640 1 -- 172.21.15.175:0/2934873723 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d40c9ee0 con 0x7f28d415de10 2024-04-25T09:06:30.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d3400640 1 --2- 172.21.15.175:0/2934873723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28d40d11d0 0x7f28d4151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:30.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d3e00640 1 --2- 172.21.15.175:0/2934873723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28d40ada50 0x7f28d414ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:30.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d9000640 1 --2- 172.21.15.175:0/2934873723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28d415de10 0x7f28d40c7900 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0194e0 tx=0x7f28cc019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28cbe00640 1 -- 172.21.15.175:0/2934873723 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc0bc020 con 0x7f28d415de10 2024-04-25T09:06:30.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28cbe00640 1 -- 172.21.15.175:0/2934873723 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc0b8690 con 0x7f28d415de10 2024-04-25T09:06:30.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d9a00640 1 -- 172.21.15.175:0/2934873723 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d40ca180 con 0x7f28d415de10 2024-04-25T09:06:30.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28cbe00640 1 -- 172.21.15.175:0/2934873723 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc009510 con 0x7f28d415de10 2024-04-25T09:06:30.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d9a00640 1 -- 172.21.15.175:0/2934873723 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d41517b0 con 0x7f28d415de10 2024-04-25T09:06:30.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28d9a00640 1 -- 172.21.15.175:0/2934873723 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d4074a60 con 0x7f28d415de10 2024-04-25T09:06:30.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.385+0000 7f28cbe00640 1 -- 172.21.15.175:0/2934873723 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f28cc0bf020 con 0x7f28d415de10 2024-04-25T09:06:30.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.389+0000 7f28cbe00640 1 --2- 172.21.15.175:0/2934873723 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f28b4066f60 0x7f28b4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.389+0000 7f28cbe00640 1 -- 172.21.15.175:0/2934873723 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f28cc11fed0 con 0x7f28d415de10 2024-04-25T09:06:30.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.389+0000 7f28d3e00640 1 --2- 172.21.15.175:0/2934873723 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f28b4066f60 0x7f28b4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.389+0000 7f28d3e00640 1 --2- 172.21.15.175:0/2934873723 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f28b4066f60 0x7f28b4069420 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f28c400b9f0 tx=0x7f28c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.393+0000 7f28cbe00640 1 -- 172.21.15.175:0/2934873723 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f28cc0c6030 con 0x7f28d415de10 2024-04-25T09:06:30.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.577+0000 7f28d9a00640 1 -- 172.21.15.175:0/2934873723 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28d40ce2d0 con 0x7f28d415de10 2024-04-25T09:06:30.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.577+0000 7f28cbe00640 1 -- 172.21.15.175:0/2934873723 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f28cc0165e0 con 0x7f28d415de10 2024-04-25T09:06:30.566 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:30.566 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5102,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2763692769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2763692769},{"type":"v1","addr":"172.21.15.175:6837","nonce":2763692769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3823569323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3823569323},{"type":"v1","addr":"172.21.15.177:6834","nonce":3823569323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2687013607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2687013607},{"type":"v1","addr":"172.21.15.177:6835","nonce":2687013607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:05:45.332647+0000","modified":"2024-04-25T09:05:48.357816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5535},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5535":{"gid":5535,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6836/1389262120","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1389262120},{"type":"v1","addr":"172.21.15.175:6836","nonce":1389262120}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:06:30.566 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 25 2024-04-25T09:06:30.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.577+0000 7f28d9a00640 1 -- 172.21.15.175:0/2934873723 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f28b4066f60 msgr2=0x7f28b4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.577+0000 7f28d9a00640 1 --2- 172.21.15.175:0/2934873723 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f28b4066f60 0x7f28b4069420 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f28c400b9f0 tx=0x7f28c4008040 comp rx=0 tx=0).stop 2024-04-25T09:06:30.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.577+0000 7f28d9a00640 1 -- 172.21.15.175:0/2934873723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28d415de10 msgr2=0x7f28d40c7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.577+0000 7f28d9a00640 1 --2- 172.21.15.175:0/2934873723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28d415de10 0x7f28d40c7900 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f28cc0194e0 tx=0x7f28cc019670 comp rx=0 tx=0).stop 2024-04-25T09:06:30.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.577+0000 7f28d9a00640 1 -- 172.21.15.175:0/2934873723 shutdown_connections 2024-04-25T09:06:30.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.577+0000 7f28d9a00640 1 --2- 172.21.15.175:0/2934873723 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f28b4066f60 0x7f28b4069420 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.577+0000 7f28d9a00640 1 --2- 172.21.15.175:0/2934873723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28d415de10 0x7f28d40c7900 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.577+0000 7f28d9a00640 1 --2- 172.21.15.175:0/2934873723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28d40d11d0 0x7f28d4151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.577+0000 7f28d9a00640 1 --2- 172.21.15.175:0/2934873723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28d40ada50 0x7f28d414ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.577+0000 7f28d9a00640 1 -- 172.21.15.175:0/2934873723 >> 172.21.15.175:0/2934873723 conn(0x7f28d4099a50 msgr2=0x7f28d406b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.577+0000 7f28d9a00640 1 -- 172.21.15.175:0/2934873723 shutdown_connections 2024-04-25T09:06:30.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.577+0000 7f28d9a00640 1 -- 172.21.15.175:0/2934873723 wait complete. 2024-04-25T09:06:30.586 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:30.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa70b800640 1 Processor -- start 2024-04-25T09:06:30.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa70b800640 1 -- start start 2024-04-25T09:06:30.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa70b800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa704144fc0 0x7fa7040cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa70b800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa70415c5e0 0x7fa7040cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa70b800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70415cd00 con 0x7fa7041453a0 2024-04-25T09:06:30.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa70b800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7040ce660 con 0x7fa704144fc0 2024-04-25T09:06:30.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa70b800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040cc930 con 0x7fa70415c5e0 2024-04-25T09:06:30.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa7041453a0 0x7fa70415bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:54128/0 (socket says 172.21.15.175:54128) 2024-04-25T09:06:30.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703e00640 1 -- 172.21.15.175:0/3198743626 learned_addr learned my addr 172.21.15.175:0/3198743626 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:30.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa708e00640 1 --2- 172.21.15.175:0/3198743626 >> v2:172.21.15.177:3300/0 conn(0x7fa704144fc0 0x7fa7040cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa709800640 1 --2- 172.21.15.175:0/3198743626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa70415c5e0 0x7fa7040cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703400640 1 -- 172.21.15.175:0/3198743626 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686496627 0 0) 0x7fa70415cd00 con 0x7fa7041453a0 2024-04-25T09:06:30.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703400640 1 -- 172.21.15.175:0/3198743626 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6e8003530 con 0x7fa7041453a0 2024-04-25T09:06:30.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703400640 1 -- 172.21.15.175:0/3198743626 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4246281184 0 0) 0x7fa6e8003530 con 0x7fa7041453a0 2024-04-25T09:06:30.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703400640 1 -- 172.21.15.175:0/3198743626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa70415c5e0 msgr2=0x7fa7040cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703400640 1 --2- 172.21.15.175:0/3198743626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa70415c5e0 0x7fa7040cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703400640 1 -- 172.21.15.175:0/3198743626 >> v2:172.21.15.177:3300/0 conn(0x7fa704144fc0 msgr2=0x7fa7040cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703400640 1 --2- 172.21.15.175:0/3198743626 >> v2:172.21.15.177:3300/0 conn(0x7fa704144fc0 0x7fa7040cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703400640 1 -- 172.21.15.175:0/3198743626 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7040ccc10 con 0x7fa7041453a0 2024-04-25T09:06:30.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703400640 1 -- 172.21.15.175:0/3198743626 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fa6f0001680 con 0x7fa7041453a0 2024-04-25T09:06:30.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa708e00640 1 --2- 172.21.15.175:0/3198743626 >> v2:172.21.15.177:3300/0 conn(0x7fa704144fc0 0x7fa7040cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:30.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703400640 1 -- 172.21.15.175:0/3198743626 >> v1:172.21.15.175:6789/0 conn(0x7fa7041453a0 legacy=0x7fa70415bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703400640 1 --2- 172.21.15.175:0/3198743626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6e80039c0 0x7fa6e8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703400640 1 --2- 172.21.15.175:0/3198743626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6e80043b0 0x7fa6e8004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703400640 1 --2- 172.21.15.175:0/3198743626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e8004f00 0x7fa6e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703400640 1 -- 172.21.15.175:0/3198743626 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040ce660 con 0x7fa6e8004f00 2024-04-25T09:06:30.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703400640 1 -- 172.21.15.175:0/3198743626 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040cc930 con 0x7fa6e80043b0 2024-04-25T09:06:30.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703400640 1 -- 172.21.15.175:0/3198743626 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e800bf10 con 0x7fa6e80039c0 2024-04-25T09:06:30.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa709800640 1 --2- 172.21.15.175:0/3198743626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa70415c5e0 0x7fa7040cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:30.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.733+0000 7fa703e00640 1 --2- 172.21.15.175:0/3198743626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6e80043b0 0x7fa6e8004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.737+0000 7fa708e00640 1 --2- 172.21.15.175:0/3198743626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6e80039c0 0x7fa6e8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.737+0000 7fa709800640 1 --2- 172.21.15.175:0/3198743626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e8004f00 0x7fa6e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.737+0000 7fa708e00640 1 -- 172.21.15.175:0/3198743626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6e80043b0 msgr2=0x7fa6e8004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.737+0000 7fa708e00640 1 --2- 172.21.15.175:0/3198743626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6e80043b0 0x7fa6e8004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.737+0000 7fa708e00640 1 -- 172.21.15.175:0/3198743626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e8004f00 msgr2=0x7fa6e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:30.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.737+0000 7fa708e00640 1 --2- 172.21.15.175:0/3198743626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e8004f00 0x7fa6e800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.737+0000 7fa708e00640 1 -- 172.21.15.175:0/3198743626 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e8003530 con 0x7fa6e80039c0 2024-04-25T09:06:30.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.737+0000 7fa709800640 1 --2- 172.21.15.175:0/3198743626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6e8004f00 0x7fa6e800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:30.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.737+0000 7fa708e00640 1 --2- 172.21.15.175:0/3198743626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6e80039c0 0x7fa6e8003de0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009cb0 tx=0x7fa6f401cc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=960c13268d4ca215 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.737+0000 7fa703400640 1 -- 172.21.15.175:0/3198743626 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f40b2070 con 0x7fa6e80039c0 2024-04-25T09:06:30.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.737+0000 7fa703400640 1 -- 172.21.15.175:0/3198743626 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f40a5950 con 0x7fa6e80039c0 2024-04-25T09:06:30.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.737+0000 7fa703400640 1 -- 172.21.15.175:0/3198743626 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4009880 con 0x7fa6e80039c0 2024-04-25T09:06:30.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa70b800640 1 -- 172.21.15.175:0/3198743626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6e80039c0 msgr2=0x7fa6e8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa70b800640 1 --2- 172.21.15.175:0/3198743626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6e80039c0 0x7fa6e8003de0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009cb0 tx=0x7fa6f401cc90 comp rx=0 tx=0).stop 2024-04-25T09:06:30.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa709800640 1 -- 172.21.15.175:0/3198743626 reap_dead start 2024-04-25T09:06:30.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa70b800640 1 -- 172.21.15.175:0/3198743626 shutdown_connections 2024-04-25T09:06:30.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa70b800640 1 -- 172.21.15.175:0/3198743626 >> 172.21.15.175:0/3198743626 conn(0x7fa704067150 msgr2=0x7fa70406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa70b800640 1 -- 172.21.15.175:0/3198743626 shutdown_connections 2024-04-25T09:06:30.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa70b800640 1 -- 172.21.15.175:0/3198743626 wait complete. 2024-04-25T09:06:30.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa70b800640 1 Processor -- start 2024-04-25T09:06:30.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa70b800640 1 -- start start 2024-04-25T09:06:30.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa70b800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7040b0df0 0x7fa7040b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa70b800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7040ad850 0x7fa7040adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa70b800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7040b11d0 0x7fa7040b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa70b800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040cc3b0 con 0x7fa7040ad850 2024-04-25T09:06:30.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa70b800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040ce900 con 0x7fa7040b0df0 2024-04-25T09:06:30.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa70b800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040cc530 con 0x7fa7040b11d0 2024-04-25T09:06:30.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa703e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7040ad850 0x7fa7040adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa703e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7040ad850 0x7fa7040adcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44554/0 (socket says 172.21.15.175:44554) 2024-04-25T09:06:30.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa703e00640 1 -- 172.21.15.175:0/2310209219 learned_addr learned my addr 172.21.15.175:0/2310209219 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:30.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa709800640 1 --2- 172.21.15.175:0/2310209219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7040b11d0 0x7fa7040b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa708e00640 1 --2- 172.21.15.175:0/2310209219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7040b0df0 0x7fa7040b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa703e00640 1 -- 172.21.15.175:0/2310209219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7040b11d0 msgr2=0x7fa7040b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa703e00640 1 --2- 172.21.15.175:0/2310209219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7040b11d0 0x7fa7040b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa703e00640 1 -- 172.21.15.175:0/2310209219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7040b0df0 msgr2=0x7fa7040b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa703e00640 1 --2- 172.21.15.175:0/2310209219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7040b0df0 0x7fa7040b2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa703e00640 1 -- 172.21.15.175:0/2310209219 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7040ae210 con 0x7fa7040ad850 2024-04-25T09:06:30.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa703e00640 1 --2- 172.21.15.175:0/2310209219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7040ad850 0x7fa7040adcd0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00072c0 tx=0x7fa6f0007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa700c00640 1 -- 172.21.15.175:0/2310209219 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f000f940 con 0x7fa7040ad850 2024-04-25T09:06:30.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa700c00640 1 -- 172.21.15.175:0/2310209219 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f0018070 con 0x7fa7040ad850 2024-04-25T09:06:30.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.741+0000 7fa700c00640 1 -- 172.21.15.175:0/2310209219 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f000fd20 con 0x7fa7040ad850 2024-04-25T09:06:30.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.745+0000 7fa70b800640 1 -- 172.21.15.175:0/2310209219 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70413af90 con 0x7fa7040ad850 2024-04-25T09:06:30.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.745+0000 7fa70b800640 1 -- 172.21.15.175:0/2310209219 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70413b230 con 0x7fa7040ad850 2024-04-25T09:06:30.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.745+0000 7fa70b800640 1 -- 172.21.15.175:0/2310209219 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa704074a60 con 0x7fa7040ad850 2024-04-25T09:06:30.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.745+0000 7fa700c00640 1 -- 172.21.15.175:0/2310209219 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa6f001d460 con 0x7fa7040ad850 2024-04-25T09:06:30.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.745+0000 7fa700c00640 1 --2- 172.21.15.175:0/2310209219 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa6e4066f60 0x7fa6e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:30.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.745+0000 7fa700c00640 1 -- 172.21.15.175:0/2310209219 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa6f0084ed0 con 0x7fa7040ad850 2024-04-25T09:06:30.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.745+0000 7fa708e00640 1 --2- 172.21.15.175:0/2310209219 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa6e4066f60 0x7fa6e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:30.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.745+0000 7fa708e00640 1 --2- 172.21.15.175:0/2310209219 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa6e4066f60 0x7fa6e4069420 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40af000 tx=0x7fa6f40046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:30.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.749+0000 7fa700c00640 1 -- 172.21.15.175:0/2310209219 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa6f00558e0 con 0x7fa7040ad850 2024-04-25T09:06:30.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.905+0000 7fa70b800640 1 -- 172.21.15.175:0/2310209219 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7040cfa30 con 0x7fa7040ad850 2024-04-25T09:06:30.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.909+0000 7fa700c00640 1 -- 172.21.15.175:0/2310209219 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16741 (secure 0 0 0) 0x7fa6f0059980 con 0x7fa7040ad850 2024-04-25T09:06:30.897 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:30.897 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":46,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:05:52.004266+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:05:43.050603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-25T09:05:44.332424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.1b","mappings":[{"from":0,"to":4}]},{"pgid":"7.37","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:30.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.909+0000 7fa70b800640 1 -- 172.21.15.175:0/2310209219 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa6e4066f60 msgr2=0x7fa6e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.909+0000 7fa70b800640 1 --2- 172.21.15.175:0/2310209219 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa6e4066f60 0x7fa6e4069420 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40af000 tx=0x7fa6f40046d0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.909+0000 7fa70b800640 1 -- 172.21.15.175:0/2310209219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7040ad850 msgr2=0x7fa7040adcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:30.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.909+0000 7fa70b800640 1 --2- 172.21.15.175:0/2310209219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7040ad850 0x7fa7040adcd0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00072c0 tx=0x7fa6f0007780 comp rx=0 tx=0).stop 2024-04-25T09:06:30.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.909+0000 7fa70b800640 1 -- 172.21.15.175:0/2310209219 shutdown_connections 2024-04-25T09:06:30.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.909+0000 7fa70b800640 1 --2- 172.21.15.175:0/2310209219 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa6e4066f60 0x7fa6e4069420 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.909+0000 7fa70b800640 1 --2- 172.21.15.175:0/2310209219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7040b11d0 0x7fa7040b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.909+0000 7fa70b800640 1 --2- 172.21.15.175:0/2310209219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7040ad850 0x7fa7040adcd0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.909+0000 7fa70b800640 1 --2- 172.21.15.175:0/2310209219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7040b0df0 0x7fa7040b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:30.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.909+0000 7fa70b800640 1 -- 172.21.15.175:0/2310209219 >> 172.21.15.175:0/2310209219 conn(0x7fa6e80039c0 msgr2=0x7fa70413f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:30.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.909+0000 7fa70b800640 1 -- 172.21.15.175:0/2310209219 shutdown_connections 2024-04-25T09:06:30.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:30.909+0000 7fa70b800640 1 -- 172.21.15.175:0/2310209219 wait complete. 2024-04-25T09:06:30.920 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:06:31.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.069+0000 7f46c9800640 1 Processor -- start 2024-04-25T09:06:31.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.069+0000 7f46c9800640 1 -- start start 2024-04-25T09:06:31.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.069+0000 7f46c9800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c40cbe60 0x7f46c415af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.069+0000 7f46c9800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f46c406d310 0x7f46c40b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.069+0000 7f46c9800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c406db60 con 0x7f46c40b4630 2024-04-25T09:06:31.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.069+0000 7f46c9800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c406de40 con 0x7f46c406d310 2024-04-25T09:06:31.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.069+0000 7f46c9800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c406e120 con 0x7f46c40cbe60 2024-04-25T09:06:31.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.069+0000 7f46ba000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f46c406d310 0x7f46c40b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.069+0000 7f46ba000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f46c406d310 0x7f46c40b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44556/0 (socket says 172.21.15.175:44556) 2024-04-25T09:06:31.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.069+0000 7f46ba000640 1 -- 172.21.15.175:0/4092879864 learned_addr learned my addr 172.21.15.175:0/4092879864 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:31.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.069+0000 7f46c3400640 1 --1- 172.21.15.175:0/4092879864 >> v1:172.21.15.175:6789/0 conn(0x7f46c40b4630 0x7f46c40b2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:54132/0 (socket says 172.21.15.175:54132) 2024-04-25T09:06:31.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.069+0000 7f46c2a00640 1 --2- 172.21.15.175:0/4092879864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c40cbe60 0x7f46c415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.069+0000 7f46ba000640 1 -- 172.21.15.175:0/4092879864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c40cbe60 msgr2=0x7f46c415af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:31.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.069+0000 7f46ba000640 1 --2- 172.21.15.175:0/4092879864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c40cbe60 0x7f46c415af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.069+0000 7f46ba000640 1 -- 172.21.15.175:0/4092879864 >> v1:172.21.15.175:6789/0 conn(0x7f46c40b4630 legacy=0x7f46c40b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.069+0000 7f46ba000640 1 -- 172.21.15.175:0/4092879864 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c415c2f0 con 0x7f46c406d310 2024-04-25T09:06:31.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.073+0000 7f46ba000640 1 --2- 172.21.15.175:0/4092879864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46c406d310 0x7f46c40b40f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00bb10 tx=0x7f46ac01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d142aa0d9a56714 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:31.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.073+0000 7f46c2000640 1 -- 172.21.15.175:0/4092879864 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac0b4070 con 0x7f46c406d310 2024-04-25T09:06:31.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.073+0000 7f46c2000640 1 -- 172.21.15.175:0/4092879864 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac0a7b00 con 0x7f46c406d310 2024-04-25T09:06:31.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.073+0000 7f46c2000640 1 -- 172.21.15.175:0/4092879864 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac0af440 con 0x7f46c406d310 2024-04-25T09:06:31.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.073+0000 7f46c9800640 1 -- 172.21.15.175:0/4092879864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46c406d310 msgr2=0x7f46c40b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.073+0000 7f46c9800640 1 --2- 172.21.15.175:0/4092879864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46c406d310 0x7f46c40b40f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00bb10 tx=0x7f46ac01ec30 comp rx=0 tx=0).stop 2024-04-25T09:06:31.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.073+0000 7f46c9800640 1 -- 172.21.15.175:0/4092879864 shutdown_connections 2024-04-25T09:06:31.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.073+0000 7f46c9800640 1 --2- 172.21.15.175:0/4092879864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46c406d310 0x7f46c40b40f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.073+0000 7f46c9800640 1 --2- 172.21.15.175:0/4092879864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c40cbe60 0x7f46c415af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.073+0000 7f46c9800640 1 -- 172.21.15.175:0/4092879864 >> 172.21.15.175:0/4092879864 conn(0x7f46c406ac50 msgr2=0x7f46c406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:31.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.073+0000 7f46c9800640 1 -- 172.21.15.175:0/4092879864 shutdown_connections 2024-04-25T09:06:31.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.073+0000 7f46c9800640 1 -- 172.21.15.175:0/4092879864 wait complete. 2024-04-25T09:06:31.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.073+0000 7f46c9800640 1 Processor -- start 2024-04-25T09:06:31.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.073+0000 7f46c9800640 1 -- start start 2024-04-25T09:06:31.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c9800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c406d310 0x7f46c4155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c9800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c40b4630 0x7f46c4149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c9800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46c40cbe60 0x7f46c41f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c9800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c40716e0 con 0x7f46c40cbe60 2024-04-25T09:06:31.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c9800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c4071560 con 0x7f46c406d310 2024-04-25T09:06:31.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c9800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c4071860 con 0x7f46c40b4630 2024-04-25T09:06:31.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46c40cbe60 0x7f46c41f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46c40cbe60 0x7f46c41f2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44570/0 (socket says 172.21.15.175:44570) 2024-04-25T09:06:31.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c3400640 1 -- 172.21.15.175:0/116064022 learned_addr learned my addr 172.21.15.175:0/116064022 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:31.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c2a00640 1 --2- 172.21.15.175:0/116064022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c406d310 0x7f46c4155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46ba000640 1 --2- 172.21.15.175:0/116064022 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c40b4630 0x7f46c4149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c3400640 1 -- 172.21.15.175:0/116064022 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c40b4630 msgr2=0x7f46c4149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c3400640 1 --2- 172.21.15.175:0/116064022 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c40b4630 0x7f46c4149730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c3400640 1 -- 172.21.15.175:0/116064022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c406d310 msgr2=0x7f46c4155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c3400640 1 --2- 172.21.15.175:0/116064022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c406d310 0x7f46c4155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c3400640 1 -- 172.21.15.175:0/116064022 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c41578b0 con 0x7f46c40cbe60 2024-04-25T09:06:31.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c3400640 1 --2- 172.21.15.175:0/116064022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46c40cbe60 0x7f46c41f2b50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00c7a0 tx=0x7f46bc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:31.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46bb400640 1 -- 172.21.15.175:0/116064022 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc017070 con 0x7f46c40cbe60 2024-04-25T09:06:31.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46bb400640 1 -- 172.21.15.175:0/116064022 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46bc00a640 con 0x7f46c40cbe60 2024-04-25T09:06:31.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46bb400640 1 -- 172.21.15.175:0/116064022 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc00a9f0 con 0x7f46c40cbe60 2024-04-25T09:06:31.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c9800640 1 -- 172.21.15.175:0/116064022 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c4157b90 con 0x7f46c40cbe60 2024-04-25T09:06:31.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c9800640 1 -- 172.21.15.175:0/116064022 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c4158150 con 0x7f46c40cbe60 2024-04-25T09:06:31.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46c9800640 1 -- 172.21.15.175:0/116064022 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c4075160 con 0x7f46c40cbe60 2024-04-25T09:06:31.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.077+0000 7f46bb400640 1 -- 172.21.15.175:0/116064022 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f46bc01a070 con 0x7f46c40cbe60 2024-04-25T09:06:31.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.081+0000 7f46bb400640 1 --2- 172.21.15.175:0/116064022 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f46a0066f60 0x7f46a0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.081+0000 7f46bb400640 1 -- 172.21.15.175:0/116064022 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f46bc0846d0 con 0x7f46c40cbe60 2024-04-25T09:06:31.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.081+0000 7f46c2a00640 1 --2- 172.21.15.175:0/116064022 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f46a0066f60 0x7f46a0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.081+0000 7f46c2a00640 1 --2- 172.21.15.175:0/116064022 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f46a0066f60 0x7f46a0069420 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f46b40079c0 tx=0x7f46b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:31.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.085+0000 7f46bb400640 1 -- 172.21.15.175:0/116064022 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f46bc054fb0 con 0x7f46c40cbe60 2024-04-25T09:06:31.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.269+0000 7f46c9800640 1 -- 172.21.15.175:0/116064022 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f46c4156720 con 0x7f46c40cbe60 2024-04-25T09:06:31.258 INFO:tasks.ceph.mon.a.smithi175.stderr:2024-04-25T09:06:31.269+0000 7feb0ee00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:06:31.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.273+0000 7f46bb400640 1 -- 172.21.15.175:0/116064022 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7f46bc059050 con 0x7f46c40cbe60 2024-04-25T09:06:31.262 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:06:31.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.277+0000 7f46c9800640 1 -- 172.21.15.175:0/116064022 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f46a0066f60 msgr2=0x7f46a0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.277+0000 7f46c9800640 1 --2- 172.21.15.175:0/116064022 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f46a0066f60 0x7f46a0069420 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f46b40079c0 tx=0x7f46b4008040 comp rx=0 tx=0).stop 2024-04-25T09:06:31.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.277+0000 7f46c9800640 1 -- 172.21.15.175:0/116064022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46c40cbe60 msgr2=0x7f46c41f2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.277+0000 7f46c9800640 1 --2- 172.21.15.175:0/116064022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46c40cbe60 0x7f46c41f2b50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00c7a0 tx=0x7f46bc00cc60 comp rx=0 tx=0).stop 2024-04-25T09:06:31.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.277+0000 7f46c9800640 1 -- 172.21.15.175:0/116064022 shutdown_connections 2024-04-25T09:06:31.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.277+0000 7f46c9800640 1 --2- 172.21.15.175:0/116064022 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f46a0066f60 0x7f46a0069420 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.277+0000 7f46c9800640 1 --2- 172.21.15.175:0/116064022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46c40cbe60 0x7f46c41f2b50 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.277+0000 7f46c9800640 1 --2- 172.21.15.175:0/116064022 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46c40b4630 0x7f46c4149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.277+0000 7f46c9800640 1 --2- 172.21.15.175:0/116064022 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46c406d310 0x7f46c4155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.277+0000 7f46c9800640 1 -- 172.21.15.175:0/116064022 >> 172.21.15.175:0/116064022 conn(0x7f46c406ac50 msgr2=0x7f46c40d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:31.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.277+0000 7f46c9800640 1 -- 172.21.15.175:0/116064022 shutdown_connections 2024-04-25T09:06:31.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.277+0000 7f46c9800640 1 -- 172.21.15.175:0/116064022 wait complete. 2024-04-25T09:06:31.276 INFO:tasks.ceph.mds.c.smithi175.stderr: -5778> 2024-04-25T09:05:50.937+0000 7f800ac00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:06:31.281 INFO:tasks.ceph.mds.c.smithi175.stderr: -3163> 2024-04-25T09:05:54.161+0000 7f8005c00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5679=0-4194304@1} caps={5679=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5679 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x558fd4436100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:06:31.288 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:06:31.326 INFO:tasks.ceph.mds.c.smithi175.stdout:starting mds.c at 2024-04-25T09:06:31.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.441+0000 7f1aac400640 1 Processor -- start 2024-04-25T09:06:31.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.441+0000 7f1aac400640 1 -- start start 2024-04-25T09:06:31.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.441+0000 7f1aac400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1aa415af20 0x7f1aa40b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.441+0000 7f1aac400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1aa40b4630 0x7f1aa415c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.441+0000 7f1aac400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa406db60 con 0x7f1aa40cbe60 2024-04-25T09:06:31.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.441+0000 7f1aac400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa406de40 con 0x7f1aa40b4630 2024-04-25T09:06:31.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.441+0000 7f1aac400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa406e120 con 0x7f1aa415af20 2024-04-25T09:06:31.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.441+0000 7f1aa9000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1aa415af20 0x7f1aa40b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.441+0000 7f1aa9a00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f1aa40cbe60 0x7f1aa406d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:49792/0 (socket says 172.21.15.175:49792) 2024-04-25T09:06:31.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.441+0000 7f1aa9a00640 1 -- 172.21.15.175:0/4229374050 learned_addr learned my addr 172.21.15.175:0/4229374050 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:31.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.441+0000 7f1aaa400640 1 --2- 172.21.15.175:0/4229374050 >> v2:172.21.15.177:3300/0 conn(0x7f1aa40b4630 0x7f1aa415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.441+0000 7f1aa9000640 1 -- 172.21.15.175:0/4229374050 >> v2:172.21.15.177:3300/0 conn(0x7f1aa40b4630 msgr2=0x7f1aa415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:31.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.441+0000 7f1aa9000640 1 --2- 172.21.15.175:0/4229374050 >> v2:172.21.15.177:3300/0 conn(0x7f1aa40b4630 0x7f1aa415c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.441+0000 7f1aa9000640 1 -- 172.21.15.175:0/4229374050 >> v1:172.21.15.177:6789/0 conn(0x7f1aa40cbe60 legacy=0x7f1aa406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.441+0000 7f1aa9000640 1 -- 172.21.15.175:0/4229374050 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa415c2f0 con 0x7f1aa415af20 2024-04-25T09:06:31.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.445+0000 7f1aa9000640 1 --2- 172.21.15.175:0/4229374050 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1aa415af20 0x7f1aa40b40f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a900097c0 tx=0x7f1a9001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86c1f363b39e9b08 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:31.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.445+0000 7f1aa3e00640 1 -- 172.21.15.175:0/4229374050 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a900b0070 con 0x7f1aa415af20 2024-04-25T09:06:31.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.445+0000 7f1aa3e00640 1 -- 172.21.15.175:0/4229374050 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a900ab600 con 0x7f1aa415af20 2024-04-25T09:06:31.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.445+0000 7f1aa3e00640 1 -- 172.21.15.175:0/4229374050 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a900ab9d0 con 0x7f1aa415af20 2024-04-25T09:06:31.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.445+0000 7f1aac400640 1 -- 172.21.15.175:0/4229374050 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1aa415af20 msgr2=0x7f1aa40b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.445+0000 7f1aac400640 1 --2- 172.21.15.175:0/4229374050 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1aa415af20 0x7f1aa40b40f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a900097c0 tx=0x7f1a9001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.445+0000 7f1aac400640 1 -- 172.21.15.175:0/4229374050 shutdown_connections 2024-04-25T09:06:31.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.445+0000 7f1aac400640 1 --2- 172.21.15.175:0/4229374050 >> v2:172.21.15.177:3300/0 conn(0x7f1aa40b4630 0x7f1aa415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.445+0000 7f1aac400640 1 --2- 172.21.15.175:0/4229374050 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1aa415af20 0x7f1aa40b40f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.445+0000 7f1aac400640 1 -- 172.21.15.175:0/4229374050 >> 172.21.15.175:0/4229374050 conn(0x7f1aa406ac50 msgr2=0x7f1aa406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:31.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.445+0000 7f1aac400640 1 -- 172.21.15.175:0/4229374050 shutdown_connections 2024-04-25T09:06:31.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.445+0000 7f1aac400640 1 -- 172.21.15.175:0/4229374050 wait complete. 2024-04-25T09:06:31.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aac400640 1 Processor -- start 2024-04-25T09:06:31.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aac400640 1 -- start start 2024-04-25T09:06:31.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aac400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa40b4630 0x7f1aa4149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aac400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1aa40cbe60 0x7f1aa41f4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aac400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1aa415af20 0x7f1aa414e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aac400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa415d970 con 0x7f1aa40b4630 2024-04-25T09:06:31.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aac400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa415d7f0 con 0x7f1aa40cbe60 2024-04-25T09:06:31.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aac400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa415daf0 con 0x7f1aa415af20 2024-04-25T09:06:31.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aa9a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa40b4630 0x7f1aa4149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aa9a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa40b4630 0x7f1aa4149b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44592/0 (socket says 172.21.15.175:44592) 2024-04-25T09:06:31.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aa9a00640 1 -- 172.21.15.175:0/3053515646 learned_addr learned my addr 172.21.15.175:0/3053515646 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:31.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aa9000640 1 --2- 172.21.15.175:0/3053515646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1aa40cbe60 0x7f1aa41f4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aaa400640 1 --2- 172.21.15.175:0/3053515646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1aa415af20 0x7f1aa414e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aa9a00640 1 -- 172.21.15.175:0/3053515646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1aa415af20 msgr2=0x7f1aa414e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aa9a00640 1 --2- 172.21.15.175:0/3053515646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1aa415af20 0x7f1aa414e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aa9a00640 1 -- 172.21.15.175:0/3053515646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1aa40cbe60 msgr2=0x7f1aa41f4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:31.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aa9a00640 1 --2- 172.21.15.175:0/3053515646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1aa40cbe60 0x7f1aa41f4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:31.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aa9a00640 1 -- 172.21.15.175:0/3053515646 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa4152c80 con 0x7f1aa40b4630 2024-04-25T09:06:31.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aa9a00640 1 --2- 172.21.15.175:0/3053515646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa40b4630 0x7f1aa4149b50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1a9800c370 tx=0x7f1a9800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:31.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aa1600640 1 -- 172.21.15.175:0/3053515646 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a98017070 con 0x7f1aa40b4630 2024-04-25T09:06:31.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aa1600640 1 -- 172.21.15.175:0/3053515646 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a98005cf0 con 0x7f1aa40b4630 2024-04-25T09:06:31.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aac400640 1 -- 172.21.15.175:0/3053515646 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa4152f60 con 0x7f1aa40b4630 2024-04-25T09:06:31.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aa1600640 1 -- 172.21.15.175:0/3053515646 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a980072f0 con 0x7f1aa40b4630 2024-04-25T09:06:31.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.449+0000 7f1aac400640 1 -- 172.21.15.175:0/3053515646 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa4153520 con 0x7f1aa40b4630 2024-04-25T09:06:31.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.453+0000 7f1aac400640 1 -- 172.21.15.175:0/3053515646 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa4075160 con 0x7f1aa40b4630 2024-04-25T09:06:31.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.453+0000 7f1aa1600640 1 -- 172.21.15.175:0/3053515646 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1a9801a070 con 0x7f1aa40b4630 2024-04-25T09:06:31.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.453+0000 7f1aa1600640 1 --2- 172.21.15.175:0/3053515646 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1a84066f60 0x7f1a84069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:31.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.453+0000 7f1aa1600640 1 -- 172.21.15.175:0/3053515646 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f1a980843c0 con 0x7f1aa40b4630 2024-04-25T09:06:31.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.453+0000 7f1aa9000640 1 --2- 172.21.15.175:0/3053515646 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1a84066f60 0x7f1a84069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:31.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.453+0000 7f1aa9000640 1 --2- 172.21.15.175:0/3053515646 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1a84066f60 0x7f1a84069420 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1a900ad000 tx=0x7f1a90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:31.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.457+0000 7f1aa1600640 1 -- 172.21.15.175:0/3053515646 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1a98054ce0 con 0x7f1aa40b4630 2024-04-25T09:06:31.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:31.645+0000 7f1aac400640 1 -- 172.21.15.175:0/3053515646 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1aa40cc710 con 0x7f1aa40b4630 2024-04-25T09:06:32.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.281+0000 7f1aa1600640 1 -- 172.21.15.175:0/3053515646 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1a98058d80 con 0x7f1aa40b4630 2024-04-25T09:06:32.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.285+0000 7f1aac400640 1 -- 172.21.15.175:0/3053515646 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1a84066f60 msgr2=0x7f1a84069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.285+0000 7f1aac400640 1 --2- 172.21.15.175:0/3053515646 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1a84066f60 0x7f1a84069420 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1a900ad000 tx=0x7f1a90008040 comp rx=0 tx=0).stop 2024-04-25T09:06:32.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.285+0000 7f1aac400640 1 -- 172.21.15.175:0/3053515646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa40b4630 msgr2=0x7f1aa4149b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.285+0000 7f1aac400640 1 --2- 172.21.15.175:0/3053515646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa40b4630 0x7f1aa4149b50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1a9800c370 tx=0x7f1a9800c830 comp rx=0 tx=0).stop 2024-04-25T09:06:32.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.285+0000 7f1aac400640 1 -- 172.21.15.175:0/3053515646 shutdown_connections 2024-04-25T09:06:32.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.285+0000 7f1aac400640 1 --2- 172.21.15.175:0/3053515646 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1a84066f60 0x7f1a84069420 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.285+0000 7f1aac400640 1 --2- 172.21.15.175:0/3053515646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1aa415af20 0x7f1aa414e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.285+0000 7f1aac400640 1 --2- 172.21.15.175:0/3053515646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1aa40cbe60 0x7f1aa41f4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.285+0000 7f1aac400640 1 --2- 172.21.15.175:0/3053515646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1aa40b4630 0x7f1aa4149b50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.285+0000 7f1aac400640 1 -- 172.21.15.175:0/3053515646 >> 172.21.15.175:0/3053515646 conn(0x7f1aa406ac50 msgr2=0x7f1aa40b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:32.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.285+0000 7f1aac400640 1 -- 172.21.15.175:0/3053515646 shutdown_connections 2024-04-25T09:06:32.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.285+0000 7f1aac400640 1 -- 172.21.15.175:0/3053515646 wait complete. 2024-04-25T09:06:32.295 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:06:32.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.485+0000 7fce37800640 1 Processor -- start 2024-04-25T09:06:32.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.485+0000 7fce37800640 1 -- start start 2024-04-25T09:06:32.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.489+0000 7fce37800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fce300712b0 0x7fce30071740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.489+0000 7fce37800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce3006d860 0x7fce3006dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.489+0000 7fce37800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3006e1a0 con 0x7fce300cfb60 2024-04-25T09:06:32.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.489+0000 7fce37800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce300cbed0 con 0x7fce300712b0 2024-04-25T09:06:32.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.489+0000 7fce37800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce30071e20 con 0x7fce3006d860 2024-04-25T09:06:32.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.489+0000 7fce27e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fce300712b0 0x7fce30071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.489+0000 7fce27e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fce300712b0 0x7fce30071740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44598/0 (socket says 172.21.15.175:44598) 2024-04-25T09:06:32.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.489+0000 7fce27e00640 1 -- 172.21.15.175:0/3366460488 learned_addr learned my addr 172.21.15.175:0/3366460488 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:32.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.489+0000 7fce35800640 1 --2- 172.21.15.175:0/3366460488 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce3006d860 0x7fce3006dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.489+0000 7fce27e00640 1 -- 172.21.15.175:0/3366460488 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce3006d860 msgr2=0x7fce3006dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:32.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.489+0000 7fce27e00640 1 --2- 172.21.15.175:0/3366460488 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce3006d860 0x7fce3006dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.489+0000 7fce27e00640 1 -- 172.21.15.175:0/3366460488 >> v1:172.21.15.177:6789/0 conn(0x7fce300cfb60 legacy=0x7fce300ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:32.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.489+0000 7fce27e00640 1 -- 172.21.15.175:0/3366460488 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce30072100 con 0x7fce300712b0 2024-04-25T09:06:32.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.493+0000 7fce27e00640 1 --2- 172.21.15.175:0/3366460488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce300712b0 0x7fce30071740 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fce18009870 tx=0x7fce1801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79dbd922b9e41eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:32.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.493+0000 7fce2fe00640 1 -- 172.21.15.175:0/3366460488 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce180aa600 con 0x7fce300712b0 2024-04-25T09:06:32.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.493+0000 7fce2fe00640 1 -- 172.21.15.175:0/3366460488 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce180af070 con 0x7fce300712b0 2024-04-25T09:06:32.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.493+0000 7fce2fe00640 1 -- 172.21.15.175:0/3366460488 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce180aa9c0 con 0x7fce300712b0 2024-04-25T09:06:32.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.493+0000 7fce37800640 1 -- 172.21.15.175:0/3366460488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce300712b0 msgr2=0x7fce30071740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.493+0000 7fce37800640 1 --2- 172.21.15.175:0/3366460488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce300712b0 0x7fce30071740 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fce18009870 tx=0x7fce1801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.493+0000 7fce37800640 1 -- 172.21.15.175:0/3366460488 shutdown_connections 2024-04-25T09:06:32.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.493+0000 7fce37800640 1 --2- 172.21.15.175:0/3366460488 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce3006d860 0x7fce3006dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.493+0000 7fce37800640 1 --2- 172.21.15.175:0/3366460488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce300712b0 0x7fce30071740 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.493+0000 7fce37800640 1 -- 172.21.15.175:0/3366460488 >> 172.21.15.175:0/3366460488 conn(0x7fce3006ac50 msgr2=0x7fce3006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:32.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.493+0000 7fce37800640 1 -- 172.21.15.175:0/3366460488 shutdown_connections 2024-04-25T09:06:32.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.493+0000 7fce37800640 1 -- 172.21.15.175:0/3366460488 wait complete. 2024-04-25T09:06:32.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.493+0000 7fce37800640 1 Processor -- start 2024-04-25T09:06:32.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.493+0000 7fce37800640 1 -- start start 2024-04-25T09:06:32.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce37800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce3006d860 0x7fce3013f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce37800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce300712b0 0x7fce3015dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce37800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce300cfb60 0x7fce301f6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce37800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce300d00c0 con 0x7fce3006d860 2024-04-25T09:06:32.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce37800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce300cff40 con 0x7fce300cfb60 2024-04-25T09:06:32.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce37800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce300ceee0 con 0x7fce300712b0 2024-04-25T09:06:32.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce34e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce3006d860 0x7fce3013f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce34e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce3006d860 0x7fce3013f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44604/0 (socket says 172.21.15.175:44604) 2024-04-25T09:06:32.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce34e00640 1 -- 172.21.15.175:0/865117086 learned_addr learned my addr 172.21.15.175:0/865117086 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:32.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce34e00640 1 -- 172.21.15.175:0/865117086 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce300712b0 msgr2=0x7fce3015dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce34e00640 1 --2- 172.21.15.175:0/865117086 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce300712b0 0x7fce3015dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce34e00640 1 -- 172.21.15.175:0/865117086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce300cfb60 msgr2=0x7fce301f6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:32.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce34e00640 1 --2- 172.21.15.175:0/865117086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce300cfb60 0x7fce301f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:32.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce34e00640 1 -- 172.21.15.175:0/865117086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3013e780 con 0x7fce3006d860 2024-04-25T09:06:32.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce34e00640 1 --2- 172.21.15.175:0/865117086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce3006d860 0x7fce3013f7e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fce2000c3a0 tx=0x7fce2000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:32.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce2d600640 1 -- 172.21.15.175:0/865117086 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce200052d0 con 0x7fce3006d860 2024-04-25T09:06:32.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce2d600640 1 -- 172.21.15.175:0/865117086 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce20005470 con 0x7fce3006d860 2024-04-25T09:06:32.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce2d600640 1 -- 172.21.15.175:0/865117086 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce20007260 con 0x7fce3006d860 2024-04-25T09:06:32.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce37800640 1 -- 172.21.15.175:0/865117086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3013ea20 con 0x7fce3006d860 2024-04-25T09:06:32.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce37800640 1 -- 172.21.15.175:0/865117086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3013efe0 con 0x7fce3006d860 2024-04-25T09:06:32.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce37800640 1 -- 172.21.15.175:0/865117086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce30075160 con 0x7fce3006d860 2024-04-25T09:06:32.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.497+0000 7fce2d600640 1 -- 172.21.15.175:0/865117086 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fce20007400 con 0x7fce3006d860 2024-04-25T09:06:32.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.501+0000 7fce2d600640 1 --2- 172.21.15.175:0/865117086 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fce0c066f90 0x7fce0c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:32.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.501+0000 7fce2d600640 1 -- 172.21.15.175:0/865117086 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fce20084550 con 0x7fce3006d860 2024-04-25T09:06:32.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.501+0000 7fce27e00640 1 --2- 172.21.15.175:0/865117086 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fce0c066f90 0x7fce0c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:32.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.501+0000 7fce27e00640 1 --2- 172.21.15.175:0/865117086 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fce0c066f90 0x7fce0c069450 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fce180ae000 tx=0x7fce18004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:32.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.505+0000 7fce2d600640 1 -- 172.21.15.175:0/865117086 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fce200554d0 con 0x7fce3006d860 2024-04-25T09:06:32.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:32.657+0000 7fce37800640 1 -- 172.21.15.175:0/865117086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fce30141fe0 con 0x7fce3006d860 2024-04-25T09:06:33.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.285+0000 7fce2d600640 1 -- 172.21.15.175:0/865117086 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v48) v1 ==== 181+0+0 (secure 0 0 0) 0x7fce20054dd0 con 0x7fce3006d860 2024-04-25T09:06:33.275 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:06:33.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.289+0000 7fce37800640 1 -- 172.21.15.175:0/865117086 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fce0c066f90 msgr2=0x7fce0c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.289+0000 7fce37800640 1 --2- 172.21.15.175:0/865117086 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fce0c066f90 0x7fce0c069450 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fce180ae000 tx=0x7fce18004740 comp rx=0 tx=0).stop 2024-04-25T09:06:33.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.289+0000 7fce37800640 1 -- 172.21.15.175:0/865117086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce3006d860 msgr2=0x7fce3013f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.289+0000 7fce37800640 1 --2- 172.21.15.175:0/865117086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce3006d860 0x7fce3013f7e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fce2000c3a0 tx=0x7fce2000c860 comp rx=0 tx=0).stop 2024-04-25T09:06:33.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.289+0000 7fce37800640 1 -- 172.21.15.175:0/865117086 shutdown_connections 2024-04-25T09:06:33.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.289+0000 7fce37800640 1 --2- 172.21.15.175:0/865117086 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fce0c066f90 0x7fce0c069450 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.289+0000 7fce37800640 1 --2- 172.21.15.175:0/865117086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce300cfb60 0x7fce301f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.289+0000 7fce37800640 1 --2- 172.21.15.175:0/865117086 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce300712b0 0x7fce3015dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.289+0000 7fce37800640 1 --2- 172.21.15.175:0/865117086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce3006d860 0x7fce3013f7e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.289+0000 7fce37800640 1 -- 172.21.15.175:0/865117086 >> 172.21.15.175:0/865117086 conn(0x7fce3006ac50 msgr2=0x7fce300b0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:33.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.289+0000 7fce37800640 1 -- 172.21.15.175:0/865117086 shutdown_connections 2024-04-25T09:06:33.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.289+0000 7fce37800640 1 -- 172.21.15.175:0/865117086 wait complete. 2024-04-25T09:06:33.300 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:06:33.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.457+0000 7fd06ca00640 1 Processor -- start 2024-04-25T09:06:33.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.457+0000 7fd06ca00640 1 -- start start 2024-04-25T09:06:33.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.457+0000 7fd06ca00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0680aebd0 0x7fd06815b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.457+0000 7fd06ca00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06815b880 con 0x7fd0680b2700 2024-04-25T09:06:33.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.457+0000 7fd06ca00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06815bb60 con 0x7fd0680b4970 2024-04-25T09:06:33.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.457+0000 7fd06ca00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06815be40 con 0x7fd0680aebd0 2024-04-25T09:06:33.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd065400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd0680b2700 0x7fd0680b4260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:54140/0 (socket says 172.21.15.175:54140) 2024-04-25T09:06:33.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd065400640 1 -- 172.21.15.175:0/1733308052 learned_addr learned my addr 172.21.15.175:0/1733308052 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:33.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd065e00640 1 --2- 172.21.15.175:0/1733308052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0680aebd0 0x7fd06815b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd064a00640 1 -- 172.21.15.175:0/1733308052 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208894588 0 0) 0x7fd06815b880 con 0x7fd0680b2700 2024-04-25T09:06:33.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd064a00640 1 -- 172.21.15.175:0/1733308052 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd04c005740 con 0x7fd0680b2700 2024-04-25T09:06:33.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd064a00640 1 -- 172.21.15.175:0/1733308052 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197939961 0 0) 0x7fd06815bb60 con 0x7fd0680b4970 2024-04-25T09:06:33.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd064a00640 1 -- 172.21.15.175:0/1733308052 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd06815b880 con 0x7fd0680b4970 2024-04-25T09:06:33.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd064a00640 1 -- 172.21.15.175:0/1733308052 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2830924874 0 0) 0x7fd04c005740 con 0x7fd0680b2700 2024-04-25T09:06:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd064a00640 1 -- 172.21.15.175:0/1733308052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0680aebd0 msgr2=0x7fd06815b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd064a00640 1 --2- 172.21.15.175:0/1733308052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0680aebd0 0x7fd06815b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd064a00640 1 -- 172.21.15.175:0/1733308052 >> v1:172.21.15.177:6789/0 conn(0x7fd0680b4970 legacy=0x7fd06815c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd064a00640 1 -- 172.21.15.175:0/1733308052 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06815c400 con 0x7fd0680b2700 2024-04-25T09:06:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd064a00640 1 -- 172.21.15.175:0/1733308052 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fd058001680 con 0x7fd0680b2700 2024-04-25T09:06:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd064a00640 1 -- 172.21.15.175:0/1733308052 >> v1:172.21.15.175:6789/0 conn(0x7fd0680b2700 legacy=0x7fd0680b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd064a00640 1 --2- 172.21.15.175:0/1733308052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0680aebd0 0x7fd04c005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd064a00640 1 --2- 172.21.15.175:0/1733308052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd04c0062f0 0x7fd04c006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd064a00640 1 --2- 172.21.15.175:0/1733308052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c006f60 0x7fd04c0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd064a00640 1 -- 172.21.15.175:0/1733308052 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06815be40 con 0x7fd04c006f60 2024-04-25T09:06:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd064a00640 1 -- 172.21.15.175:0/1733308052 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c00dd70 con 0x7fd04c0062f0 2024-04-25T09:06:33.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd064a00640 1 -- 172.21.15.175:0/1733308052 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c00df40 con 0x7fd0680aebd0 2024-04-25T09:06:33.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd066800640 1 --2- 172.21.15.175:0/1733308052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c006f60 0x7fd04c0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd065e00640 1 --2- 172.21.15.175:0/1733308052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0680aebd0 0x7fd04c005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd065400640 1 --2- 172.21.15.175:0/1733308052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd04c0062f0 0x7fd04c006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd065e00640 1 -- 172.21.15.175:0/1733308052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd04c0062f0 msgr2=0x7fd04c006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:33.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd065e00640 1 --2- 172.21.15.175:0/1733308052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd04c0062f0 0x7fd04c006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd065e00640 1 -- 172.21.15.175:0/1733308052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c006f60 msgr2=0x7fd04c0073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:33.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd065e00640 1 --2- 172.21.15.175:0/1733308052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd04c006f60 0x7fd04c0073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.461+0000 7fd065e00640 1 -- 172.21.15.175:0/1733308052 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c005740 con 0x7fd0680aebd0 2024-04-25T09:06:33.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.465+0000 7fd065e00640 1 --2- 172.21.15.175:0/1733308052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0680aebd0 0x7fd04c005d90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd050009ae0 tx=0x7fd05001cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92829f77315e5f39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:33.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.465+0000 7fd064a00640 1 -- 172.21.15.175:0/1733308052 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0500b2070 con 0x7fd0680aebd0 2024-04-25T09:06:33.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.465+0000 7fd064a00640 1 -- 172.21.15.175:0/1733308052 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0500a56a0 con 0x7fd0680aebd0 2024-04-25T09:06:33.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.465+0000 7fd064a00640 1 -- 172.21.15.175:0/1733308052 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0500096b0 con 0x7fd0680aebd0 2024-04-25T09:06:33.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.465+0000 7fd06ca00640 1 -- 172.21.15.175:0/1733308052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0680aebd0 msgr2=0x7fd04c005d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.465+0000 7fd06ca00640 1 --2- 172.21.15.175:0/1733308052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0680aebd0 0x7fd04c005d90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd050009ae0 tx=0x7fd05001cab0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.465+0000 7fd066800640 1 -- 172.21.15.175:0/1733308052 reap_dead start 2024-04-25T09:06:33.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.465+0000 7fd06ca00640 1 -- 172.21.15.175:0/1733308052 shutdown_connections 2024-04-25T09:06:33.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.465+0000 7fd06ca00640 1 -- 172.21.15.175:0/1733308052 >> 172.21.15.175:0/1733308052 conn(0x7fd06806ac50 msgr2=0x7fd06806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:33.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.465+0000 7fd06ca00640 1 -- 172.21.15.175:0/1733308052 shutdown_connections 2024-04-25T09:06:33.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.465+0000 7fd06ca00640 1 -- 172.21.15.175:0/1733308052 wait complete. 2024-04-25T09:06:33.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.465+0000 7fd06ca00640 1 Processor -- start 2024-04-25T09:06:33.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.465+0000 7fd06ca00640 1 -- start start 2024-04-25T09:06:33.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd06ca00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0680aebd0 0x7fd0681e15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd06ca00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0681e3350 0x7fd0681e3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd06ca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0680cde30 0x7fd0680ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd06ca00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06815b030 con 0x7fd0680cde30 2024-04-25T09:06:33.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd06ca00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0680af1c0 con 0x7fd0680aebd0 2024-04-25T09:06:33.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd06ca00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06815b1b0 con 0x7fd0681e3350 2024-04-25T09:06:33.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd066800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0680cde30 0x7fd0680ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd066800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0680cde30 0x7fd0680ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44630/0 (socket says 172.21.15.175:44630) 2024-04-25T09:06:33.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd066800640 1 -- 172.21.15.175:0/3304230421 learned_addr learned my addr 172.21.15.175:0/3304230421 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:33.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd065400640 1 --2- 172.21.15.175:0/3304230421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0681e3350 0x7fd0681e3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd065e00640 1 --2- 172.21.15.175:0/3304230421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0680aebd0 0x7fd0681e15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd066800640 1 -- 172.21.15.175:0/3304230421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0681e3350 msgr2=0x7fd0681e3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd066800640 1 --2- 172.21.15.175:0/3304230421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0681e3350 0x7fd0681e3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd066800640 1 -- 172.21.15.175:0/3304230421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0680aebd0 msgr2=0x7fd0681e15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:33.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd066800640 1 --2- 172.21.15.175:0/3304230421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0680aebd0 0x7fd0681e15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:33.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd066800640 1 -- 172.21.15.175:0/3304230421 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0681e1ea0 con 0x7fd0680cde30 2024-04-25T09:06:33.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd065e00640 1 --2- 172.21.15.175:0/3304230421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0680aebd0 0x7fd0681e15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:33.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd066800640 1 --2- 172.21.15.175:0/3304230421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0680cde30 0x7fd0680ce290 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd0600059b0 tx=0x7fd060012c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:33.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd05e000640 1 -- 172.21.15.175:0/3304230421 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060010b20 con 0x7fd0680cde30 2024-04-25T09:06:33.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd05e000640 1 -- 172.21.15.175:0/3304230421 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06001b070 con 0x7fd0680cde30 2024-04-25T09:06:33.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd06ca00640 1 -- 172.21.15.175:0/3304230421 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0681e2180 con 0x7fd0680cde30 2024-04-25T09:06:33.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd05e000640 1 -- 172.21.15.175:0/3304230421 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060016480 con 0x7fd0680cde30 2024-04-25T09:06:33.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd06ca00640 1 -- 172.21.15.175:0/3304230421 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0681e2740 con 0x7fd0680cde30 2024-04-25T09:06:33.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd06ca00640 1 -- 172.21.15.175:0/3304230421 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd068075160 con 0x7fd0680cde30 2024-04-25T09:06:33.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.469+0000 7fd05e000640 1 -- 172.21.15.175:0/3304230421 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd060016620 con 0x7fd0680cde30 2024-04-25T09:06:33.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.473+0000 7fd05e000640 1 --2- 172.21.15.175:0/3304230421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd044066f90 0x7fd044069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:33.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.473+0000 7fd05e000640 1 -- 172.21.15.175:0/3304230421 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5415+0+0 (secure 0 0 0) 0x7fd060088500 con 0x7fd0680cde30 2024-04-25T09:06:33.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.473+0000 7fd065e00640 1 --2- 172.21.15.175:0/3304230421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd044066f90 0x7fd044069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:33.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.473+0000 7fd065e00640 1 --2- 172.21.15.175:0/3304230421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd044066f90 0x7fd044069450 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd0500af000 tx=0x7fd0500046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:33.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.477+0000 7fd05e000640 1 -- 172.21.15.175:0/3304230421 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd060059620 con 0x7fd0680cde30 2024-04-25T09:06:33.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:33.633+0000 7fd06ca00640 1 -- 172.21.15.175:0/3304230421 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd06806c2d0 con 0x7fd0680cde30 2024-04-25T09:06:34.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.293+0000 7fd05e000640 1 -- 172.21.15.175:0/3304230421 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v49) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd060058f20 con 0x7fd0680cde30 2024-04-25T09:06:34.281 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_data' removed 2024-04-25T09:06:34.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.293+0000 7fd06ca00640 1 -- 172.21.15.175:0/3304230421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd044066f90 msgr2=0x7fd044069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.293+0000 7fd06ca00640 1 --2- 172.21.15.175:0/3304230421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd044066f90 0x7fd044069450 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd0500af000 tx=0x7fd0500046d0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.293+0000 7fd06ca00640 1 -- 172.21.15.175:0/3304230421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0680cde30 msgr2=0x7fd0680ce290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.293+0000 7fd06ca00640 1 --2- 172.21.15.175:0/3304230421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0680cde30 0x7fd0680ce290 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd0600059b0 tx=0x7fd060012c90 comp rx=0 tx=0).stop 2024-04-25T09:06:34.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.297+0000 7fd06ca00640 1 -- 172.21.15.175:0/3304230421 shutdown_connections 2024-04-25T09:06:34.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.297+0000 7fd06ca00640 1 --2- 172.21.15.175:0/3304230421 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd044066f90 0x7fd044069450 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.297+0000 7fd06ca00640 1 --2- 172.21.15.175:0/3304230421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0680cde30 0x7fd0680ce290 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.297+0000 7fd06ca00640 1 --2- 172.21.15.175:0/3304230421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0681e3350 0x7fd0681e3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.297+0000 7fd06ca00640 1 --2- 172.21.15.175:0/3304230421 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0680aebd0 0x7fd0681e15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.297+0000 7fd06ca00640 1 -- 172.21.15.175:0/3304230421 >> 172.21.15.175:0/3304230421 conn(0x7fd06806ac50 msgr2=0x7fd06806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:34.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.297+0000 7fd06ca00640 1 -- 172.21.15.175:0/3304230421 shutdown_connections 2024-04-25T09:06:34.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.297+0000 7fd06ca00640 1 -- 172.21.15.175:0/3304230421 wait complete. 2024-04-25T09:06:34.310 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:06:34.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.461+0000 7fb2b5600640 1 Processor -- start 2024-04-25T09:06:34.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.461+0000 7fb2b5600640 1 -- start start 2024-04-25T09:06:34.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.461+0000 7fb2b5600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb2b0145250 0x7fb2b00cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.461+0000 7fb2b5600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2b00ce970 0x7fb2b00cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.461+0000 7fb2b5600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b00cfd10 con 0x7fb2b01600a0 2024-04-25T09:06:34.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.461+0000 7fb2b5600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b015f650 con 0x7fb2b0145250 2024-04-25T09:06:34.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.461+0000 7fb2b5600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b00cfff0 con 0x7fb2b00ce970 2024-04-25T09:06:34.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.461+0000 7fb2aea00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb2b0145250 0x7fb2b00cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.461+0000 7fb2aea00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb2b0145250 0x7fb2b00cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44646/0 (socket says 172.21.15.175:44646) 2024-04-25T09:06:34.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.461+0000 7fb2aea00640 1 -- 172.21.15.175:0/3941912140 learned_addr learned my addr 172.21.15.175:0/3941912140 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:34.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.461+0000 7fb2af400640 1 --2- 172.21.15.175:0/3941912140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2b00ce970 0x7fb2b00cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.461+0000 7fb2aea00640 1 -- 172.21.15.175:0/3941912140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2b00ce970 msgr2=0x7fb2b00cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:34.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.461+0000 7fb2aea00640 1 --2- 172.21.15.175:0/3941912140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2b00ce970 0x7fb2b00cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.461+0000 7fb2aea00640 1 -- 172.21.15.175:0/3941912140 >> v1:172.21.15.177:6789/0 conn(0x7fb2b01600a0 legacy=0x7fb2b00cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:34.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.461+0000 7fb2aea00640 1 -- 172.21.15.175:0/3941912140 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b015f8a0 con 0x7fb2b0145250 2024-04-25T09:06:34.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.465+0000 7fb2aea00640 1 --2- 172.21.15.175:0/3941912140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2b0145250 0x7fb2b00cf6b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb2a00098a0 tx=0x7fb2a001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a9bae0b1b38f27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:34.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.465+0000 7fb2ae000640 1 -- 172.21.15.175:0/3941912140 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a00b1070 con 0x7fb2b0145250 2024-04-25T09:06:34.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.465+0000 7fb2ae000640 1 -- 172.21.15.175:0/3941912140 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a00a8050 con 0x7fb2b0145250 2024-04-25T09:06:34.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.465+0000 7fb2ae000640 1 -- 172.21.15.175:0/3941912140 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a00ac860 con 0x7fb2b0145250 2024-04-25T09:06:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.465+0000 7fb2b5600640 1 -- 172.21.15.175:0/3941912140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2b0145250 msgr2=0x7fb2b00cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.465+0000 7fb2b5600640 1 --2- 172.21.15.175:0/3941912140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2b0145250 0x7fb2b00cf6b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb2a00098a0 tx=0x7fb2a001c440 comp rx=0 tx=0).stop 2024-04-25T09:06:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.465+0000 7fb2b5600640 1 -- 172.21.15.175:0/3941912140 shutdown_connections 2024-04-25T09:06:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.465+0000 7fb2b5600640 1 --2- 172.21.15.175:0/3941912140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2b00ce970 0x7fb2b00cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.465+0000 7fb2b5600640 1 --2- 172.21.15.175:0/3941912140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2b0145250 0x7fb2b00cf6b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.465+0000 7fb2b5600640 1 -- 172.21.15.175:0/3941912140 >> 172.21.15.175:0/3941912140 conn(0x7fb2b006ac50 msgr2=0x7fb2b006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:34.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.465+0000 7fb2b5600640 1 -- 172.21.15.175:0/3941912140 shutdown_connections 2024-04-25T09:06:34.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.465+0000 7fb2b5600640 1 -- 172.21.15.175:0/3941912140 wait complete. 2024-04-25T09:06:34.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.465+0000 7fb2b5600640 1 Processor -- start 2024-04-25T09:06:34.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2b5600640 1 -- start start 2024-04-25T09:06:34.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2b5600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2b00ce970 0x7fb2b013e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2b5600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2b0145250 0x7fb2b0141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2b5600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2b01600a0 0x7fb2b0159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2b5600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b015c870 con 0x7fb2b00ce970 2024-04-25T09:06:34.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2b5600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b0145630 con 0x7fb2b0145250 2024-04-25T09:06:34.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2b5600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b015c9f0 con 0x7fb2b01600a0 2024-04-25T09:06:34.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2aea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2b00ce970 0x7fb2b013e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2aea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2b00ce970 0x7fb2b013e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44662/0 (socket says 172.21.15.175:44662) 2024-04-25T09:06:34.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2aea00640 1 -- 172.21.15.175:0/3514120456 learned_addr learned my addr 172.21.15.175:0/3514120456 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:34.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2a7e00640 1 --2- 172.21.15.175:0/3514120456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2b0145250 0x7fb2b0141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2af400640 1 --2- 172.21.15.175:0/3514120456 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2b01600a0 0x7fb2b0159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2aea00640 1 -- 172.21.15.175:0/3514120456 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2b01600a0 msgr2=0x7fb2b0159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2aea00640 1 --2- 172.21.15.175:0/3514120456 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2b01600a0 0x7fb2b0159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2aea00640 1 -- 172.21.15.175:0/3514120456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2b0145250 msgr2=0x7fb2b0141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2aea00640 1 --2- 172.21.15.175:0/3514120456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2b0145250 0x7fb2b0141ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2aea00640 1 -- 172.21.15.175:0/3514120456 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b013c260 con 0x7fb2b00ce970 2024-04-25T09:06:34.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2aea00640 1 --2- 172.21.15.175:0/3514120456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2b00ce970 0x7fb2b013e260 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb2a001aaf0 tx=0x7fb2a001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:34.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2a6a00640 1 -- 172.21.15.175:0/3514120456 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a00b1040 con 0x7fb2b00ce970 2024-04-25T09:06:34.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2a6a00640 1 -- 172.21.15.175:0/3514120456 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a00bd070 con 0x7fb2b00ce970 2024-04-25T09:06:34.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2b5600640 1 -- 172.21.15.175:0/3514120456 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b013e8b0 con 0x7fb2b00ce970 2024-04-25T09:06:34.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2a6a00640 1 -- 172.21.15.175:0/3514120456 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a00b7660 con 0x7fb2b00ce970 2024-04-25T09:06:34.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2b5600640 1 -- 172.21.15.175:0/3514120456 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b01f7c70 con 0x7fb2b00ce970 2024-04-25T09:06:34.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.469+0000 7fb2b5600640 1 -- 172.21.15.175:0/3514120456 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b013edd0 con 0x7fb2b00ce970 2024-04-25T09:06:34.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.473+0000 7fb2a6a00640 1 -- 172.21.15.175:0/3514120456 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb2a00b7800 con 0x7fb2b00ce970 2024-04-25T09:06:34.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.473+0000 7fb2a6a00640 1 --2- 172.21.15.175:0/3514120456 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb28c066f90 0x7fb28c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.473+0000 7fb2a6a00640 1 -- 172.21.15.175:0/3514120456 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb2a011f150 con 0x7fb2b00ce970 2024-04-25T09:06:34.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.473+0000 7fb2a7e00640 1 --2- 172.21.15.175:0/3514120456 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb28c066f90 0x7fb28c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.473+0000 7fb2a7e00640 1 --2- 172.21.15.175:0/3514120456 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb28c066f90 0x7fb28c069450 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00aec60 tx=0x7fb298008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:34.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.477+0000 7fb2a6a00640 1 -- 172.21.15.175:0/3514120456 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb2b013edd0 con 0x7fb2b00ce970 2024-04-25T09:06:34.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.629+0000 7fb2b5600640 1 -- 172.21.15.175:0/3514120456 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb2b0075160 con 0x7fb2b00ce970 2024-04-25T09:06:34.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.633+0000 7fb2a6a00640 1 -- 172.21.15.175:0/3514120456 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb2a00160f0 con 0x7fb2b00ce970 2024-04-25T09:06:34.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.637+0000 7fb2b5600640 1 -- 172.21.15.175:0/3514120456 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb28c066f90 msgr2=0x7fb28c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.637+0000 7fb2b5600640 1 --2- 172.21.15.175:0/3514120456 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb28c066f90 0x7fb28c069450 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00aec60 tx=0x7fb298008040 comp rx=0 tx=0).stop 2024-04-25T09:06:34.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.637+0000 7fb2b5600640 1 -- 172.21.15.175:0/3514120456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2b00ce970 msgr2=0x7fb2b013e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.637+0000 7fb2b5600640 1 --2- 172.21.15.175:0/3514120456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2b00ce970 0x7fb2b013e260 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb2a001aaf0 tx=0x7fb2a001ac80 comp rx=0 tx=0).stop 2024-04-25T09:06:34.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.637+0000 7fb2b5600640 1 -- 172.21.15.175:0/3514120456 shutdown_connections 2024-04-25T09:06:34.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.637+0000 7fb2b5600640 1 --2- 172.21.15.175:0/3514120456 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb28c066f90 0x7fb28c069450 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.637+0000 7fb2b5600640 1 --2- 172.21.15.175:0/3514120456 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2b01600a0 0x7fb2b0159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.637+0000 7fb2b5600640 1 --2- 172.21.15.175:0/3514120456 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2b0145250 0x7fb2b0141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.637+0000 7fb2b5600640 1 --2- 172.21.15.175:0/3514120456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2b00ce970 0x7fb2b013e260 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.637+0000 7fb2b5600640 1 -- 172.21.15.175:0/3514120456 >> 172.21.15.175:0/3514120456 conn(0x7fb2b006ac50 msgr2=0x7fb2b00af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:34.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.637+0000 7fb2b5600640 1 -- 172.21.15.175:0/3514120456 shutdown_connections 2024-04-25T09:06:34.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.637+0000 7fb2b5600640 1 -- 172.21.15.175:0/3514120456 wait complete. 2024-04-25T09:06:34.645 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-04-25T09:06:34.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.789+0000 7fadcf800640 1 Processor -- start 2024-04-25T09:06:34.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.793+0000 7fadcf800640 1 -- start start 2024-04-25T09:06:34.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.793+0000 7fadcf800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fadc815a900 0x7fadc806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.793+0000 7fadcf800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc80cda00 con 0x7fadc80cd520 2024-04-25T09:06:34.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.793+0000 7fadcf800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc80cdce0 con 0x7fadc80cf560 2024-04-25T09:06:34.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.793+0000 7fadcf800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc815bcf0 con 0x7fadc815a900 2024-04-25T09:06:34.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.793+0000 7fadc7e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fadc80cd520 0x7fadc80ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:54156/0 (socket says 172.21.15.175:54156) 2024-04-25T09:06:34.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.793+0000 7fadc7e00640 1 -- 172.21.15.175:0/1109379639 learned_addr learned my addr 172.21.15.175:0/1109379639 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:34.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.793+0000 7fadcce00640 1 --2- 172.21.15.175:0/1109379639 >> v2:172.21.15.177:3300/0 conn(0x7fadc815a900 0x7fadc806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.793+0000 7fadc7400640 1 -- 172.21.15.175:0/1109379639 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676372134 0 0) 0x7fadc80cda00 con 0x7fadc80cd520 2024-04-25T09:06:34.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.793+0000 7fadc7400640 1 -- 172.21.15.175:0/1109379639 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadac005740 con 0x7fadc80cd520 2024-04-25T09:06:34.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.793+0000 7fadcce00640 1 -- 172.21.15.175:0/1109379639 >> v1:172.21.15.177:6789/0 conn(0x7fadc80cf560 legacy=0x7fadc815bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.793+0000 7fadcce00640 1 -- 172.21.15.175:0/1109379639 >> v1:172.21.15.175:6789/0 conn(0x7fadc80cd520 legacy=0x7fadc80ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.793+0000 7fadcce00640 1 -- 172.21.15.175:0/1109379639 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc80cdfc0 con 0x7fadc815a900 2024-04-25T09:06:34.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.797+0000 7fadcce00640 1 --2- 172.21.15.175:0/1109379639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc815a900 0x7fadc806e150 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fadb80097c0 tx=0x7fadb801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c8fc9d1b5d8e6c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:34.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.797+0000 7fadc7400640 1 -- 172.21.15.175:0/1109379639 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb80b0070 con 0x7fadc815a900 2024-04-25T09:06:34.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.797+0000 7fadc7400640 1 -- 172.21.15.175:0/1109379639 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb80ab600 con 0x7fadc815a900 2024-04-25T09:06:34.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.797+0000 7fadc7400640 1 -- 172.21.15.175:0/1109379639 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb80ab9d0 con 0x7fadc815a900 2024-04-25T09:06:34.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.797+0000 7fadcf800640 1 -- 172.21.15.175:0/1109379639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc815a900 msgr2=0x7fadc806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.797+0000 7fadcf800640 1 --2- 172.21.15.175:0/1109379639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc815a900 0x7fadc806e150 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fadb80097c0 tx=0x7fadb801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.797+0000 7fadcf800640 1 -- 172.21.15.175:0/1109379639 shutdown_connections 2024-04-25T09:06:34.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.797+0000 7fadcf800640 1 --2- 172.21.15.175:0/1109379639 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc815a900 0x7fadc806e150 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.797+0000 7fadcf800640 1 -- 172.21.15.175:0/1109379639 >> 172.21.15.175:0/1109379639 conn(0x7fadc8067150 msgr2=0x7fadc806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:34.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.797+0000 7fadcf800640 1 -- 172.21.15.175:0/1109379639 shutdown_connections 2024-04-25T09:06:34.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.797+0000 7fadcf800640 1 -- 172.21.15.175:0/1109379639 wait complete. 2024-04-25T09:06:34.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadcf800640 1 Processor -- start 2024-04-25T09:06:34.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadcf800640 1 -- start start 2024-04-25T09:06:34.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadcf800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc80cf560 0x7fadc80b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadcf800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc815a900 0x7fadc80b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadcf800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadc8157c80 0x7fadc80af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadcf800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc806d530 con 0x7fadc815a900 2024-04-25T09:06:34.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadcf800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc806d3b0 con 0x7fadc80cf560 2024-04-25T09:06:34.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadcf800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc8071a50 con 0x7fadc8157c80 2024-04-25T09:06:34.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadc7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc815a900 0x7fadc80b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadc7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc815a900 0x7fadc80b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44670/0 (socket says 172.21.15.175:44670) 2024-04-25T09:06:34.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadc7e00640 1 -- 172.21.15.175:0/4262175519 learned_addr learned my addr 172.21.15.175:0/4262175519 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:34.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadcce00640 1 --2- 172.21.15.175:0/4262175519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc80cf560 0x7fadc80b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadcd800640 1 --2- 172.21.15.175:0/4262175519 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadc8157c80 0x7fadc80af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadc7e00640 1 -- 172.21.15.175:0/4262175519 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadc8157c80 msgr2=0x7fadc80af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadc7e00640 1 --2- 172.21.15.175:0/4262175519 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadc8157c80 0x7fadc80af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadc7e00640 1 -- 172.21.15.175:0/4262175519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc80cf560 msgr2=0x7fadc80b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:34.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadc7e00640 1 --2- 172.21.15.175:0/4262175519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc80cf560 0x7fadc80b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:34.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadc7e00640 1 -- 172.21.15.175:0/4262175519 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc81f83c0 con 0x7fadc815a900 2024-04-25T09:06:34.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadc7e00640 1 --2- 172.21.15.175:0/4262175519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc815a900 0x7fadc80b28b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fadb4001ec0 tx=0x7fadb400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:34.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadc4c00640 1 -- 172.21.15.175:0/4262175519 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb4017070 con 0x7fadc815a900 2024-04-25T09:06:34.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadc4c00640 1 -- 172.21.15.175:0/4262175519 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb4005d50 con 0x7fadc815a900 2024-04-25T09:06:34.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadc4c00640 1 -- 172.21.15.175:0/4262175519 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb4007270 con 0x7fadc815a900 2024-04-25T09:06:34.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadcf800640 1 -- 172.21.15.175:0/4262175519 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc81f86a0 con 0x7fadc815a900 2024-04-25T09:06:34.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadcf800640 1 -- 172.21.15.175:0/4262175519 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc81f8c60 con 0x7fadc815a900 2024-04-25T09:06:34.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.801+0000 7fadcf800640 1 -- 172.21.15.175:0/4262175519 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc8074a60 con 0x7fadc815a900 2024-04-25T09:06:34.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.805+0000 7fadc4c00640 1 -- 172.21.15.175:0/4262175519 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fadb401a070 con 0x7fadc815a900 2024-04-25T09:06:34.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.805+0000 7fadc4c00640 1 --2- 172.21.15.175:0/4262175519 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fada8066f60 0x7fada8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:34.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.805+0000 7fadc4c00640 1 -- 172.21.15.175:0/4262175519 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fadb4083ff0 con 0x7fadc815a900 2024-04-25T09:06:34.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.805+0000 7fadcce00640 1 --2- 172.21.15.175:0/4262175519 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fada8066f60 0x7fada8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:34.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.805+0000 7fadcce00640 1 --2- 172.21.15.175:0/4262175519 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fada8066f60 0x7fada8069420 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fadb80ad000 tx=0x7fadb8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:34.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:34.809+0000 7fadc4c00640 1 -- 172.21.15.175:0/4262175519 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fadb4054d60 con 0x7fadc815a900 2024-04-25T09:06:35.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.025+0000 7fadcf800640 1 -- 172.21.15.175:0/4262175519 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7fadc80adc20 con 0x7fadc815a900 2024-04-25T09:06:35.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.293+0000 7fadc4c00640 1 -- 172.21.15.175:0/4262175519 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v150) v1 ==== 149+0+0 (secure 0 0 0) 0x7fadb4058e00 con 0x7fadc815a900 2024-04-25T09:06:35.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.297+0000 7fadcf800640 1 -- 172.21.15.175:0/4262175519 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fada8066f60 msgr2=0x7fada8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.297+0000 7fadcf800640 1 --2- 172.21.15.175:0/4262175519 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fada8066f60 0x7fada8069420 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fadb80ad000 tx=0x7fadb8008040 comp rx=0 tx=0).stop 2024-04-25T09:06:35.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.297+0000 7fadcf800640 1 -- 172.21.15.175:0/4262175519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc815a900 msgr2=0x7fadc80b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.297+0000 7fadcf800640 1 --2- 172.21.15.175:0/4262175519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc815a900 0x7fadc80b28b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fadb4001ec0 tx=0x7fadb400c960 comp rx=0 tx=0).stop 2024-04-25T09:06:35.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.297+0000 7fadcf800640 1 -- 172.21.15.175:0/4262175519 shutdown_connections 2024-04-25T09:06:35.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.297+0000 7fadcf800640 1 --2- 172.21.15.175:0/4262175519 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fada8066f60 0x7fada8069420 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.297+0000 7fadcf800640 1 --2- 172.21.15.175:0/4262175519 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadc8157c80 0x7fadc80af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.297+0000 7fadcf800640 1 --2- 172.21.15.175:0/4262175519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadc815a900 0x7fadc80b28b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.297+0000 7fadcf800640 1 --2- 172.21.15.175:0/4262175519 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadc80cf560 0x7fadc80b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.297+0000 7fadcf800640 1 -- 172.21.15.175:0/4262175519 >> 172.21.15.175:0/4262175519 conn(0x7fadc80cd520 msgr2=0x7fadc8153350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:35.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.297+0000 7fadcf800640 1 -- 172.21.15.175:0/4262175519 shutdown_connections 2024-04-25T09:06:35.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.297+0000 7fadcf800640 1 -- 172.21.15.175:0/4262175519 wait complete. 2024-04-25T09:06:35.305 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2024-04-25T09:06:35.306 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-25T09:06:35.306 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:06:35.306 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:35.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8ece00640 1 Processor -- start 2024-04-25T09:06:35.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8ece00640 1 -- start start 2024-04-25T09:06:35.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8ece00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8e80cd520 0x7fc8e806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8ece00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e80cda00 con 0x7fc8e815a900 2024-04-25T09:06:35.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8ece00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e80cdce0 con 0x7fc8e80cf560 2024-04-25T09:06:35.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8ece00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e815bcf0 con 0x7fc8e80cd520 2024-04-25T09:06:35.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc8e815a900 0x7fc8e80ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:54166/0 (socket says 172.21.15.175:54166) 2024-04-25T09:06:35.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5e00640 1 -- 172.21.15.175:0/3307777660 learned_addr learned my addr 172.21.15.175:0/3307777660 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:35.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8dfe00640 1 --2- 172.21.15.175:0/3307777660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8e80cd520 0x7fc8e806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5400640 1 -- 172.21.15.175:0/3307777660 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650152461 0 0) 0x7fc8e80cda00 con 0x7fc8e815a900 2024-04-25T09:06:35.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5400640 1 -- 172.21.15.175:0/3307777660 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8cc005740 con 0x7fc8e815a900 2024-04-25T09:06:35.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5400640 1 -- 172.21.15.175:0/3307777660 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129462954 0 0) 0x7fc8e80cdce0 con 0x7fc8e80cf560 2024-04-25T09:06:35.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5400640 1 -- 172.21.15.175:0/3307777660 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8e80cda00 con 0x7fc8e80cf560 2024-04-25T09:06:35.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5400640 1 -- 172.21.15.175:0/3307777660 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2755303090 0 0) 0x7fc8cc005740 con 0x7fc8e815a900 2024-04-25T09:06:35.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5400640 1 -- 172.21.15.175:0/3307777660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8e80cd520 msgr2=0x7fc8e806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:35.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5400640 1 --2- 172.21.15.175:0/3307777660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8e80cd520 0x7fc8e806e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5400640 1 -- 172.21.15.175:0/3307777660 >> v1:172.21.15.177:6789/0 conn(0x7fc8e80cf560 legacy=0x7fc8e815bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5400640 1 -- 172.21.15.175:0/3307777660 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e80cdfc0 con 0x7fc8e815a900 2024-04-25T09:06:35.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5400640 1 -- 172.21.15.175:0/3307777660 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fc8d8001680 con 0x7fc8e815a900 2024-04-25T09:06:35.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5400640 1 -- 172.21.15.175:0/3307777660 >> v1:172.21.15.175:6789/0 conn(0x7fc8e815a900 legacy=0x7fc8e80ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5400640 1 --2- 172.21.15.175:0/3307777660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8cc005d90 0x7fc8cc006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5400640 1 --2- 172.21.15.175:0/3307777660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8e80cd520 0x7fc8cc006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5400640 1 --2- 172.21.15.175:0/3307777660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8cc006f60 0x7fc8cc0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5400640 1 -- 172.21.15.175:0/3307777660 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc00dc90 con 0x7fc8cc006f60 2024-04-25T09:06:35.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5400640 1 -- 172.21.15.175:0/3307777660 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc00de40 con 0x7fc8cc005d90 2024-04-25T09:06:35.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5400640 1 -- 172.21.15.175:0/3307777660 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc00e040 con 0x7fc8e80cd520 2024-04-25T09:06:35.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e6800640 1 --2- 172.21.15.175:0/3307777660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8cc006f60 0x7fc8cc0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8e5e00640 1 --2- 172.21.15.175:0/3307777660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8cc005d90 0x7fc8cc006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.453+0000 7fc8dfe00640 1 --2- 172.21.15.175:0/3307777660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8e80cd520 0x7fc8cc006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.457+0000 7fc8e6800640 1 -- 172.21.15.175:0/3307777660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8e80cd520 msgr2=0x7fc8cc006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:35.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.457+0000 7fc8e6800640 1 --2- 172.21.15.175:0/3307777660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8e80cd520 0x7fc8cc006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.457+0000 7fc8e6800640 1 -- 172.21.15.175:0/3307777660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8cc005d90 msgr2=0x7fc8cc006190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:35.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.457+0000 7fc8e6800640 1 --2- 172.21.15.175:0/3307777660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8cc005d90 0x7fc8cc006190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.457+0000 7fc8e6800640 1 -- 172.21.15.175:0/3307777660 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8cc005740 con 0x7fc8cc006f60 2024-04-25T09:06:35.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.457+0000 7fc8e6800640 1 --2- 172.21.15.175:0/3307777660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8cc006f60 0x7fc8cc0073e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0001fd0 tx=0x7fc8e001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651cd8d1fd4bd2aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.457+0000 7fc8e5400640 1 -- 172.21.15.175:0/3307777660 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0001c20 con 0x7fc8cc006f60 2024-04-25T09:06:35.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.457+0000 7fc8e5400640 1 -- 172.21.15.175:0/3307777660 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e0003ba0 con 0x7fc8cc006f60 2024-04-25T09:06:35.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.457+0000 7fc8e5400640 1 -- 172.21.15.175:0/3307777660 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e00050d0 con 0x7fc8cc006f60 2024-04-25T09:06:35.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.457+0000 7fc8ece00640 1 -- 172.21.15.175:0/3307777660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8cc006f60 msgr2=0x7fc8cc0073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.457+0000 7fc8ece00640 1 --2- 172.21.15.175:0/3307777660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8cc006f60 0x7fc8cc0073e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0001fd0 tx=0x7fc8e001c900 comp rx=0 tx=0).stop 2024-04-25T09:06:35.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.457+0000 7fc8e6800640 1 -- 172.21.15.175:0/3307777660 reap_dead start 2024-04-25T09:06:35.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.457+0000 7fc8ece00640 1 -- 172.21.15.175:0/3307777660 shutdown_connections 2024-04-25T09:06:35.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.457+0000 7fc8ece00640 1 -- 172.21.15.175:0/3307777660 >> 172.21.15.175:0/3307777660 conn(0x7fc8e8067150 msgr2=0x7fc8e806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:35.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.457+0000 7fc8ece00640 1 -- 172.21.15.175:0/3307777660 shutdown_connections 2024-04-25T09:06:35.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.457+0000 7fc8ece00640 1 -- 172.21.15.175:0/3307777660 wait complete. 2024-04-25T09:06:35.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8ece00640 1 Processor -- start 2024-04-25T09:06:35.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8ece00640 1 -- start start 2024-04-25T09:06:35.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8ece00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8e814a090 0x7fc8e80ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8ece00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8e80b27c0 0x7fc8e80b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8ece00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8e815caa0 0x7fc8e815cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8ece00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e806d3b0 con 0x7fc8e80b27c0 2024-04-25T09:06:35.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8ece00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80ce580 con 0x7fc8e814a090 2024-04-25T09:06:35.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8ece00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e806d530 con 0x7fc8e815caa0 2024-04-25T09:06:35.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8dfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8e80b27c0 0x7fc8e80b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8dfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8e80b27c0 0x7fc8e80b2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44690/0 (socket says 172.21.15.175:44690) 2024-04-25T09:06:35.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8dfe00640 1 -- 172.21.15.175:0/2672749173 learned_addr learned my addr 172.21.15.175:0/2672749173 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:35.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8e5e00640 1 --2- 172.21.15.175:0/2672749173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8e814a090 0x7fc8e80ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8e6800640 1 --2- 172.21.15.175:0/2672749173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8e815caa0 0x7fc8e815cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8dfe00640 1 -- 172.21.15.175:0/2672749173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8e815caa0 msgr2=0x7fc8e815cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8dfe00640 1 --2- 172.21.15.175:0/2672749173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8e815caa0 0x7fc8e815cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8dfe00640 1 -- 172.21.15.175:0/2672749173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8e814a090 msgr2=0x7fc8e80ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8dfe00640 1 --2- 172.21.15.175:0/2672749173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8e814a090 0x7fc8e80ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8dfe00640 1 -- 172.21.15.175:0/2672749173 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e80a8700 con 0x7fc8e80b27c0 2024-04-25T09:06:35.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8dfe00640 1 --2- 172.21.15.175:0/2672749173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8e80b27c0 0x7fc8e80b2c40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0011a30 tx=0x7fc8d0011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8de000640 1 -- 172.21.15.175:0/2672749173 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d000fbb0 con 0x7fc8e80b27c0 2024-04-25T09:06:35.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8de000640 1 -- 172.21.15.175:0/2672749173 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d000fd50 con 0x7fc8e80b27c0 2024-04-25T09:06:35.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8ece00640 1 -- 172.21.15.175:0/2672749173 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e80a89e0 con 0x7fc8e80b27c0 2024-04-25T09:06:35.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8de000640 1 -- 172.21.15.175:0/2672749173 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0014680 con 0x7fc8e80b27c0 2024-04-25T09:06:35.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.461+0000 7fc8ece00640 1 -- 172.21.15.175:0/2672749173 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e80a8fa0 con 0x7fc8e80b27c0 2024-04-25T09:06:35.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.465+0000 7fc8ece00640 1 -- 172.21.15.175:0/2672749173 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e8074a60 con 0x7fc8e80b27c0 2024-04-25T09:06:35.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.465+0000 7fc8de000640 1 -- 172.21.15.175:0/2672749173 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc8d0012040 con 0x7fc8e80b27c0 2024-04-25T09:06:35.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.465+0000 7fc8de000640 1 --2- 172.21.15.175:0/2672749173 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc8c4066f60 0x7fc8c4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.465+0000 7fc8de000640 1 -- 172.21.15.175:0/2672749173 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc8d0085290 con 0x7fc8e80b27c0 2024-04-25T09:06:35.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.465+0000 7fc8e5e00640 1 --2- 172.21.15.175:0/2672749173 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc8c4066f60 0x7fc8c4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.465+0000 7fc8e5e00640 1 --2- 172.21.15.175:0/2672749173 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc8c4066f60 0x7fc8c4069420 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8001060 tx=0x7fc8d8001d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.469+0000 7fc8de000640 1 -- 172.21.15.175:0/2672749173 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc8d0019030 con 0x7fc8e80b27c0 2024-04-25T09:06:35.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.625+0000 7fc8ece00640 1 -- 172.21.15.175:0/2672749173 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8e80cbae0 con 0x7fc8e80b27c0 2024-04-25T09:06:35.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.625+0000 7fc8de000640 1 -- 172.21.15.175:0/2672749173 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+13058 (secure 0 0 0) 0x7fc8d00560a0 con 0x7fc8e80b27c0 2024-04-25T09:06:35.615 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:35.615 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":49,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:06:34.288197+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6836/1389262120":"2024-04-26T09:06:31.271638+0000","172.21.15.175:6834/1389262120":"2024-04-26T09:06:31.271638+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:35.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.629+0000 7fc8ece00640 1 -- 172.21.15.175:0/2672749173 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc8c4066f60 msgr2=0x7fc8c4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.629+0000 7fc8ece00640 1 --2- 172.21.15.175:0/2672749173 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc8c4066f60 0x7fc8c4069420 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8001060 tx=0x7fc8d8001d60 comp rx=0 tx=0).stop 2024-04-25T09:06:35.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.629+0000 7fc8ece00640 1 -- 172.21.15.175:0/2672749173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8e80b27c0 msgr2=0x7fc8e80b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.629+0000 7fc8ece00640 1 --2- 172.21.15.175:0/2672749173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8e80b27c0 0x7fc8e80b2c40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0011a30 tx=0x7fc8d0011ef0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.629+0000 7fc8ece00640 1 -- 172.21.15.175:0/2672749173 shutdown_connections 2024-04-25T09:06:35.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.629+0000 7fc8ece00640 1 --2- 172.21.15.175:0/2672749173 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc8c4066f60 0x7fc8c4069420 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.629+0000 7fc8ece00640 1 --2- 172.21.15.175:0/2672749173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8e815caa0 0x7fc8e815cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.629+0000 7fc8ece00640 1 --2- 172.21.15.175:0/2672749173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8e80b27c0 0x7fc8e80b2c40 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.629+0000 7fc8ece00640 1 --2- 172.21.15.175:0/2672749173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8e814a090 0x7fc8e80ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.629+0000 7fc8ece00640 1 -- 172.21.15.175:0/2672749173 >> 172.21.15.175:0/2672749173 conn(0x7fc8cc006f60 msgr2=0x7fc8e80b3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:35.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.629+0000 7fc8ece00640 1 -- 172.21.15.175:0/2672749173 shutdown_connections 2024-04-25T09:06:35.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.629+0000 7fc8ece00640 1 -- 172.21.15.175:0/2672749173 wait complete. 2024-04-25T09:06:35.636 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:06:35.636 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:06:35.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.785+0000 7f9079c00640 1 Processor -- start 2024-04-25T09:06:35.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.789+0000 7f9079c00640 1 -- start start 2024-04-25T09:06:35.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.789+0000 7f9079c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90740b0ac0 0x7f907409aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.789+0000 7f9079c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90740cd7f0 con 0x7f907409a160 2024-04-25T09:06:35.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.789+0000 7f9079c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90740cff90 con 0x7f907415bca0 2024-04-25T09:06:35.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.789+0000 7f9079c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90740d0230 con 0x7f90740b0ac0 2024-04-25T09:06:35.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.789+0000 7f9072000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f907409a160 0x7f90740b1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:54180/0 (socket says 172.21.15.175:54180) 2024-04-25T09:06:35.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.789+0000 7f9072000640 1 -- 172.21.15.175:0/1175965493 learned_addr learned my addr 172.21.15.175:0/1175965493 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:35.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.789+0000 7f9073400640 1 --2- 172.21.15.175:0/1175965493 >> v2:172.21.15.177:3300/0 conn(0x7f90740b0ac0 0x7f907409aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.789+0000 7f9071600640 1 -- 172.21.15.175:0/1175965493 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809040458 0 0) 0x7f90740cd7f0 con 0x7f907409a160 2024-04-25T09:06:35.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.789+0000 7f9071600640 1 -- 172.21.15.175:0/1175965493 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9058003530 con 0x7f907409a160 2024-04-25T09:06:35.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.789+0000 7f9071600640 1 -- 172.21.15.175:0/1175965493 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2486818910 0 0) 0x7f90740cff90 con 0x7f907415bca0 2024-04-25T09:06:35.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.789+0000 7f9071600640 1 -- 172.21.15.175:0/1175965493 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90740cd7f0 con 0x7f907415bca0 2024-04-25T09:06:35.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.789+0000 7f9073400640 1 -- 172.21.15.175:0/1175965493 >> v1:172.21.15.177:6789/0 conn(0x7f907415bca0 legacy=0x7f9074099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.789+0000 7f9073400640 1 -- 172.21.15.175:0/1175965493 >> v1:172.21.15.175:6789/0 conn(0x7f907409a160 legacy=0x7f90740b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.789+0000 7f9073400640 1 -- 172.21.15.175:0/1175965493 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90740d0510 con 0x7f90740b0ac0 2024-04-25T09:06:35.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.793+0000 7f9073400640 1 --2- 172.21.15.175:0/1175965493 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90740b0ac0 0x7f907409aa90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f906c009d90 tx=0x7f906c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=374330525b26eb55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.793+0000 7f9071600640 1 -- 172.21.15.175:0/1175965493 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c0b2070 con 0x7f90740b0ac0 2024-04-25T09:06:35.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.793+0000 7f9071600640 1 -- 172.21.15.175:0/1175965493 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c0a5940 con 0x7f90740b0ac0 2024-04-25T09:06:35.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.793+0000 7f9071600640 1 -- 172.21.15.175:0/1175965493 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c0a5d10 con 0x7f90740b0ac0 2024-04-25T09:06:35.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.793+0000 7f9079c00640 1 -- 172.21.15.175:0/1175965493 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90740b0ac0 msgr2=0x7f907409aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.793+0000 7f9079c00640 1 --2- 172.21.15.175:0/1175965493 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90740b0ac0 0x7f907409aa90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f906c009d90 tx=0x7f906c01c970 comp rx=0 tx=0).stop 2024-04-25T09:06:35.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.793+0000 7f9079c00640 1 -- 172.21.15.175:0/1175965493 shutdown_connections 2024-04-25T09:06:35.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.793+0000 7f9079c00640 1 --2- 172.21.15.175:0/1175965493 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90740b0ac0 0x7f907409aa90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.793+0000 7f9079c00640 1 -- 172.21.15.175:0/1175965493 >> 172.21.15.175:0/1175965493 conn(0x7f90740b3400 msgr2=0x7f90740b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:35.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.793+0000 7f9079c00640 1 -- 172.21.15.175:0/1175965493 shutdown_connections 2024-04-25T09:06:35.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.793+0000 7f9079c00640 1 -- 172.21.15.175:0/1175965493 wait complete. 2024-04-25T09:06:35.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9079c00640 1 Processor -- start 2024-04-25T09:06:35.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9079c00640 1 -- start start 2024-04-25T09:06:35.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9079c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f907409a160 0x7f907406f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9079c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90740b0ac0 0x7f9074152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9079c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f907415bca0 0x7f9074152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9079c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90740b2ae0 con 0x7f90740b0ac0 2024-04-25T09:06:35.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9079c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90740b2960 con 0x7f907409a160 2024-04-25T09:06:35.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9079c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90741696e0 con 0x7f907415bca0 2024-04-25T09:06:35.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9072000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90740b0ac0 0x7f9074152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9072000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90740b0ac0 0x7f9074152a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44692/0 (socket says 172.21.15.175:44692) 2024-04-25T09:06:35.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9072000640 1 -- 172.21.15.175:0/2001702038 learned_addr learned my addr 172.21.15.175:0/2001702038 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:35.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9072a00640 1 --2- 172.21.15.175:0/2001702038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f907409a160 0x7f907406f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9073400640 1 --2- 172.21.15.175:0/2001702038 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f907415bca0 0x7f9074152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9072000640 1 -- 172.21.15.175:0/2001702038 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f907415bca0 msgr2=0x7f9074152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9072000640 1 --2- 172.21.15.175:0/2001702038 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f907415bca0 0x7f9074152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9072000640 1 -- 172.21.15.175:0/2001702038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f907409a160 msgr2=0x7f907406f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9072000640 1 --2- 172.21.15.175:0/2001702038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f907409a160 0x7f907406f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9072000640 1 -- 172.21.15.175:0/2001702038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9074158530 con 0x7f90740b0ac0 2024-04-25T09:06:35.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9072000640 1 --2- 172.21.15.175:0/2001702038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90740b0ac0 0x7f9074152a00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f906000c4d0 tx=0x7f906000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f906aa00640 1 -- 172.21.15.175:0/2001702038 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060017070 con 0x7f90740b0ac0 2024-04-25T09:06:35.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f906aa00640 1 -- 172.21.15.175:0/2001702038 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9060005cf0 con 0x7f90740b0ac0 2024-04-25T09:06:35.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9079c00640 1 -- 172.21.15.175:0/2001702038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90740ca810 con 0x7f90740b0ac0 2024-04-25T09:06:35.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f906aa00640 1 -- 172.21.15.175:0/2001702038 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90600072b0 con 0x7f90740b0ac0 2024-04-25T09:06:35.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.797+0000 7f9079c00640 1 -- 172.21.15.175:0/2001702038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90740cadd0 con 0x7f90740b0ac0 2024-04-25T09:06:35.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.801+0000 7f9079c00640 1 -- 172.21.15.175:0/2001702038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9074075160 con 0x7f90740b0ac0 2024-04-25T09:06:35.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.801+0000 7f906aa00640 1 -- 172.21.15.175:0/2001702038 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f906001a070 con 0x7f90740b0ac0 2024-04-25T09:06:35.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.801+0000 7f906aa00640 1 --2- 172.21.15.175:0/2001702038 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9054066f60 0x7f9054069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:35.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.801+0000 7f906aa00640 1 -- 172.21.15.175:0/2001702038 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f90600840f0 con 0x7f90740b0ac0 2024-04-25T09:06:35.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.801+0000 7f9072a00640 1 --2- 172.21.15.175:0/2001702038 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9054066f60 0x7f9054069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:35.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.801+0000 7f9072a00640 1 --2- 172.21.15.175:0/2001702038 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9054066f60 0x7f9054069420 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9064001720 tx=0x7f9064009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:35.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.805+0000 7f906aa00640 1 -- 172.21.15.175:0/2001702038 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9074158530 con 0x7f90740b0ac0 2024-04-25T09:06:35.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.961+0000 7f9079c00640 1 -- 172.21.15.175:0/2001702038 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90740b3d20 con 0x7f90740b0ac0 2024-04-25T09:06:35.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.961+0000 7f906aa00640 1 -- 172.21.15.175:0/2001702038 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9060054d10 con 0x7f90740b0ac0 2024-04-25T09:06:35.952 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:06:35.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.965+0000 7f9079c00640 1 -- 172.21.15.175:0/2001702038 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9054066f60 msgr2=0x7f9054069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.965+0000 7f9079c00640 1 --2- 172.21.15.175:0/2001702038 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9054066f60 0x7f9054069420 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9064001720 tx=0x7f9064009040 comp rx=0 tx=0).stop 2024-04-25T09:06:35.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.965+0000 7f9079c00640 1 -- 172.21.15.175:0/2001702038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90740b0ac0 msgr2=0x7f9074152a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:35.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.965+0000 7f9079c00640 1 --2- 172.21.15.175:0/2001702038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90740b0ac0 0x7f9074152a00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f906000c4d0 tx=0x7f906000c990 comp rx=0 tx=0).stop 2024-04-25T09:06:35.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.965+0000 7f9079c00640 1 -- 172.21.15.175:0/2001702038 shutdown_connections 2024-04-25T09:06:35.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.965+0000 7f9079c00640 1 --2- 172.21.15.175:0/2001702038 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9054066f60 0x7f9054069420 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.965+0000 7f9079c00640 1 --2- 172.21.15.175:0/2001702038 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f907415bca0 0x7f9074152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.965+0000 7f9079c00640 1 --2- 172.21.15.175:0/2001702038 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90740b0ac0 0x7f9074152a00 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.965+0000 7f9079c00640 1 --2- 172.21.15.175:0/2001702038 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f907409a160 0x7f907406f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:35.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.965+0000 7f9079c00640 1 -- 172.21.15.175:0/2001702038 >> 172.21.15.175:0/2001702038 conn(0x7f90740b3400 msgr2=0x7f9074099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:35.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.965+0000 7f9079c00640 1 -- 172.21.15.175:0/2001702038 shutdown_connections 2024-04-25T09:06:35.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:35.965+0000 7f9079c00640 1 -- 172.21.15.175:0/2001702038 wait complete. 2024-04-25T09:06:35.972 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-04-25T09:06:36.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.117+0000 7fa39ca00640 1 Processor -- start 2024-04-25T09:06:36.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.117+0000 7fa39ca00640 1 -- start start 2024-04-25T09:06:36.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa39ca00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa3980cd520 0x7fa39806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa39ca00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3980cda00 con 0x7fa39815a900 2024-04-25T09:06:36.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa39ca00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3980cdce0 con 0x7fa3980cf560 2024-04-25T09:06:36.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa39ca00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39815bcf0 con 0x7fa3980cd520 2024-04-25T09:06:36.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa395e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa39815a900 0x7fa3980ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:54190/0 (socket says 172.21.15.175:54190) 2024-04-25T09:06:36.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa395e00640 1 -- 172.21.15.175:0/388124288 learned_addr learned my addr 172.21.15.175:0/388124288 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:36.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa394a00640 1 -- 172.21.15.175:0/388124288 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816593151 0 0) 0x7fa3980cda00 con 0x7fa39815a900 2024-04-25T09:06:36.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa395400640 1 --2- 172.21.15.175:0/388124288 >> v2:172.21.15.177:3300/0 conn(0x7fa3980cd520 0x7fa39806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa394a00640 1 -- 172.21.15.175:0/388124288 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa37c005740 con 0x7fa39815a900 2024-04-25T09:06:36.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa394a00640 1 -- 172.21.15.175:0/388124288 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4176223447 0 0) 0x7fa37c005740 con 0x7fa39815a900 2024-04-25T09:06:36.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa394a00640 1 -- 172.21.15.175:0/388124288 >> v2:172.21.15.177:3300/0 conn(0x7fa3980cd520 msgr2=0x7fa39806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:36.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa394a00640 1 --2- 172.21.15.175:0/388124288 >> v2:172.21.15.177:3300/0 conn(0x7fa3980cd520 0x7fa39806e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa394a00640 1 -- 172.21.15.175:0/388124288 >> v1:172.21.15.177:6789/0 conn(0x7fa3980cf560 legacy=0x7fa39815bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa394a00640 1 -- 172.21.15.175:0/388124288 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3980cdfc0 con 0x7fa39815a900 2024-04-25T09:06:36.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa394a00640 1 -- 172.21.15.175:0/388124288 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fa388001a00 con 0x7fa39815a900 2024-04-25T09:06:36.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa394a00640 1 -- 172.21.15.175:0/388124288 >> v1:172.21.15.175:6789/0 conn(0x7fa39815a900 legacy=0x7fa3980ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa394a00640 1 --2- 172.21.15.175:0/388124288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa37c005bd0 0x7fa37c005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa394a00640 1 --2- 172.21.15.175:0/388124288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa37c0065d0 0x7fa37c006aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa394a00640 1 --2- 172.21.15.175:0/388124288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa37c0072a0 0x7fa37c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa394a00640 1 -- 172.21.15.175:0/388124288 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c00e1d0 con 0x7fa37c005bd0 2024-04-25T09:06:36.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa394a00640 1 -- 172.21.15.175:0/388124288 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c00e380 con 0x7fa37c0072a0 2024-04-25T09:06:36.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa394a00640 1 -- 172.21.15.175:0/388124288 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c00e580 con 0x7fa37c0065d0 2024-04-25T09:06:36.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa395e00640 1 --2- 172.21.15.175:0/388124288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa37c005bd0 0x7fa37c005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa395400640 1 --2- 172.21.15.175:0/388124288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa37c0065d0 0x7fa37c006aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa396800640 1 --2- 172.21.15.175:0/388124288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa37c0072a0 0x7fa37c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa395e00640 1 -- 172.21.15.175:0/388124288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa37c0065d0 msgr2=0x7fa37c006aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:36.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa395e00640 1 --2- 172.21.15.175:0/388124288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa37c0065d0 0x7fa37c006aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa395e00640 1 -- 172.21.15.175:0/388124288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa37c0072a0 msgr2=0x7fa37c00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:36.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa395e00640 1 --2- 172.21.15.175:0/388124288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa37c0072a0 0x7fa37c00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa395e00640 1 -- 172.21.15.175:0/388124288 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c005740 con 0x7fa37c005bd0 2024-04-25T09:06:36.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.121+0000 7fa396800640 1 -- 172.21.15.175:0/388124288 reap_dead start 2024-04-25T09:06:36.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.125+0000 7fa395e00640 1 --2- 172.21.15.175:0/388124288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa37c005bd0 0x7fa37c005fb0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa38800a860 tx=0x7fa38801d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f008fbf7fb8c860a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.125+0000 7fa394a00640 1 -- 172.21.15.175:0/388124288 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38800a480 con 0x7fa37c005bd0 2024-04-25T09:06:36.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.125+0000 7fa394a00640 1 -- 172.21.15.175:0/388124288 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3880ad630 con 0x7fa37c005bd0 2024-04-25T09:06:36.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.125+0000 7fa394a00640 1 -- 172.21.15.175:0/388124288 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3880ada80 con 0x7fa37c005bd0 2024-04-25T09:06:36.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.125+0000 7fa39ca00640 1 -- 172.21.15.175:0/388124288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa37c005bd0 msgr2=0x7fa37c005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.125+0000 7fa39ca00640 1 --2- 172.21.15.175:0/388124288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa37c005bd0 0x7fa37c005fb0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa38800a860 tx=0x7fa38801d350 comp rx=0 tx=0).stop 2024-04-25T09:06:36.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.125+0000 7fa39ca00640 1 -- 172.21.15.175:0/388124288 shutdown_connections 2024-04-25T09:06:36.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.125+0000 7fa39ca00640 1 --2- 172.21.15.175:0/388124288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa37c005bd0 0x7fa37c005fb0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.125+0000 7fa39ca00640 1 -- 172.21.15.175:0/388124288 >> 172.21.15.175:0/388124288 conn(0x7fa398067150 msgr2=0x7fa39806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:36.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.125+0000 7fa39ca00640 1 -- 172.21.15.175:0/388124288 shutdown_connections 2024-04-25T09:06:36.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.125+0000 7fa39ca00640 1 -- 172.21.15.175:0/388124288 wait complete. 2024-04-25T09:06:36.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.125+0000 7fa39ca00640 1 Processor -- start 2024-04-25T09:06:36.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa39ca00640 1 -- start start 2024-04-25T09:06:36.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa39ca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa39814d490 0x7fa3981553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa39ca00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa398156ae0 0x7fa39814ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa39ca00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa39814d870 0x7fa39814dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa39ca00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3980cfed0 con 0x7fa39814d490 2024-04-25T09:06:36.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa39ca00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3980cfd50 con 0x7fa39814d870 2024-04-25T09:06:36.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa39ca00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39806d3b0 con 0x7fa398156ae0 2024-04-25T09:06:36.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa395e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa39814d490 0x7fa3981553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa395e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa39814d490 0x7fa3981553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44712/0 (socket says 172.21.15.175:44712) 2024-04-25T09:06:36.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa395e00640 1 -- 172.21.15.175:0/1853468832 learned_addr learned my addr 172.21.15.175:0/1853468832 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:36.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa396800640 1 --2- 172.21.15.175:0/1853468832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa39814d870 0x7fa39814dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa395400640 1 --2- 172.21.15.175:0/1853468832 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa398156ae0 0x7fa39814ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa395e00640 1 -- 172.21.15.175:0/1853468832 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa398156ae0 msgr2=0x7fa39814ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa395e00640 1 --2- 172.21.15.175:0/1853468832 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa398156ae0 0x7fa39814ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa395e00640 1 -- 172.21.15.175:0/1853468832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa39814d870 msgr2=0x7fa39814dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:36.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa395e00640 1 --2- 172.21.15.175:0/1853468832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa39814d870 0x7fa39814dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:36.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa395e00640 1 -- 172.21.15.175:0/1853468832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa398155a40 con 0x7fa39814d490 2024-04-25T09:06:36.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa395e00640 1 --2- 172.21.15.175:0/1853468832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa39814d490 0x7fa3981553d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa38800a860 tx=0x7fa37c007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa38e000640 1 -- 172.21.15.175:0/1853468832 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3880bb070 con 0x7fa39814d490 2024-04-25T09:06:36.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa38e000640 1 -- 172.21.15.175:0/1853468832 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3880ad430 con 0x7fa39814d490 2024-04-25T09:06:36.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa38e000640 1 -- 172.21.15.175:0/1853468832 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3880019c0 con 0x7fa39814d490 2024-04-25T09:06:36.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa39ca00640 1 -- 172.21.15.175:0/1853468832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa398155d20 con 0x7fa39814d490 2024-04-25T09:06:36.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa39ca00640 1 -- 172.21.15.175:0/1853468832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3981562e0 con 0x7fa39814d490 2024-04-25T09:06:36.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.129+0000 7fa39ca00640 1 -- 172.21.15.175:0/1853468832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa398074a60 con 0x7fa39814d490 2024-04-25T09:06:36.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.133+0000 7fa38e000640 1 -- 172.21.15.175:0/1853468832 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa3880b5070 con 0x7fa39814d490 2024-04-25T09:06:36.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.133+0000 7fa38e000640 1 --2- 172.21.15.175:0/1853468832 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa378066f90 0x7fa378069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:36.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.133+0000 7fa38e000640 1 -- 172.21.15.175:0/1853468832 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa38811e8a0 con 0x7fa39814d490 2024-04-25T09:06:36.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.133+0000 7fa395400640 1 --2- 172.21.15.175:0/1853468832 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa378066f90 0x7fa378069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:36.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.133+0000 7fa395400640 1 --2- 172.21.15.175:0/1853468832 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa378066f90 0x7fa378069450 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa3980b32d0 tx=0x7fa384008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:36.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.137+0000 7fa38e000640 1 -- 172.21.15.175:0/1853468832 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa388017090 con 0x7fa39814d490 2024-04-25T09:06:36.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:36.349+0000 7fa39ca00640 1 -- 172.21.15.175:0/1853468832 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7fa39806af90 con 0x7fa39814d490 2024-04-25T09:06:37.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.301+0000 7fa38e000640 1 -- 172.21.15.175:0/1853468832 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v152) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa3880efc40 con 0x7fa39814d490 2024-04-25T09:06:37.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.301+0000 7fa39ca00640 1 -- 172.21.15.175:0/1853468832 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa378066f90 msgr2=0x7fa378069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.301+0000 7fa39ca00640 1 --2- 172.21.15.175:0/1853468832 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa378066f90 0x7fa378069450 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa3980b32d0 tx=0x7fa384008040 comp rx=0 tx=0).stop 2024-04-25T09:06:37.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.301+0000 7fa39ca00640 1 -- 172.21.15.175:0/1853468832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa39814d490 msgr2=0x7fa3981553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.301+0000 7fa39ca00640 1 --2- 172.21.15.175:0/1853468832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa39814d490 0x7fa3981553d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa38800a860 tx=0x7fa37c007a50 comp rx=0 tx=0).stop 2024-04-25T09:06:37.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.301+0000 7fa39ca00640 1 -- 172.21.15.175:0/1853468832 shutdown_connections 2024-04-25T09:06:37.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.301+0000 7fa39ca00640 1 --2- 172.21.15.175:0/1853468832 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa378066f90 0x7fa378069450 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.301+0000 7fa39ca00640 1 --2- 172.21.15.175:0/1853468832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa39814d870 0x7fa39814dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.301+0000 7fa39ca00640 1 --2- 172.21.15.175:0/1853468832 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa398156ae0 0x7fa39814ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.301+0000 7fa39ca00640 1 --2- 172.21.15.175:0/1853468832 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa39814d490 0x7fa3981553d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.301+0000 7fa39ca00640 1 -- 172.21.15.175:0/1853468832 >> 172.21.15.175:0/1853468832 conn(0x7fa37c005bd0 msgr2=0x7fa3980b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:37.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.305+0000 7fa39ca00640 1 -- 172.21.15.175:0/1853468832 shutdown_connections 2024-04-25T09:06:37.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.305+0000 7fa39ca00640 1 -- 172.21.15.175:0/1853468832 wait complete. 2024-04-25T09:06:37.314 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:06:37.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.465+0000 7f4e2e800640 1 Processor -- start 2024-04-25T09:06:37.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.465+0000 7f4e2e800640 1 -- start start 2024-04-25T09:06:37.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.465+0000 7f4e2e800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4e28145250 0x7f4e280cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.465+0000 7f4e2e800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e281600a0 0x7f4e280cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.465+0000 7f4e2e800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e280cfd10 con 0x7f4e280ce970 2024-04-25T09:06:37.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.465+0000 7f4e2e800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e2815f650 con 0x7f4e28145250 2024-04-25T09:06:37.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.465+0000 7f4e2e800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e280cfff0 con 0x7f4e281600a0 2024-04-25T09:06:37.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.465+0000 7f4e26a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e281600a0 0x7f4e280cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.465+0000 7f4e26a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e281600a0 0x7f4e280cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:57990/0 (socket says 172.21.15.175:57990) 2024-04-25T09:06:37.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.465+0000 7f4e26a00640 1 -- 172.21.15.175:0/4231803920 learned_addr learned my addr 172.21.15.175:0/4231803920 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:37.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.465+0000 7f4e27400640 1 --2- 172.21.15.175:0/4231803920 >> v2:172.21.15.177:3300/0 conn(0x7f4e28145250 0x7f4e280cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.465+0000 7f4e26a00640 1 -- 172.21.15.175:0/4231803920 >> v2:172.21.15.177:3300/0 conn(0x7f4e28145250 msgr2=0x7f4e280cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:37.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.465+0000 7f4e26a00640 1 --2- 172.21.15.175:0/4231803920 >> v2:172.21.15.177:3300/0 conn(0x7f4e28145250 0x7f4e280cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.465+0000 7f4e26a00640 1 -- 172.21.15.175:0/4231803920 >> v1:172.21.15.177:6789/0 conn(0x7f4e280ce970 legacy=0x7f4e280cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.465+0000 7f4e26a00640 1 -- 172.21.15.175:0/4231803920 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2815f8a0 con 0x7f4e281600a0 2024-04-25T09:06:37.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.465+0000 7f4e26000640 1 -- 172.21.15.175:0/4231803920 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109261583 0 0) 0x7f4e280cfd10 con 0x7f4e280ce970 2024-04-25T09:06:37.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.469+0000 7f4e26a00640 1 --2- 172.21.15.175:0/4231803920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e281600a0 0x7f4e280cc410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009870 tx=0x7f4e1401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=962eebfb6c544ecb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:37.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.469+0000 7f4e26000640 1 -- 172.21.15.175:0/4231803920 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140aa620 con 0x7f4e281600a0 2024-04-25T09:06:37.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.469+0000 7f4e26000640 1 -- 172.21.15.175:0/4231803920 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e140af070 con 0x7f4e281600a0 2024-04-25T09:06:37.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.469+0000 7f4e26000640 1 -- 172.21.15.175:0/4231803920 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140aa9e0 con 0x7f4e281600a0 2024-04-25T09:06:37.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.469+0000 7f4e2e800640 1 -- 172.21.15.175:0/4231803920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e281600a0 msgr2=0x7f4e280cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.469+0000 7f4e2e800640 1 --2- 172.21.15.175:0/4231803920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e281600a0 0x7f4e280cc410 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009870 tx=0x7f4e1401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.469+0000 7f4e2e800640 1 -- 172.21.15.175:0/4231803920 shutdown_connections 2024-04-25T09:06:37.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.469+0000 7f4e2e800640 1 --2- 172.21.15.175:0/4231803920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e281600a0 0x7f4e280cc410 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.469+0000 7f4e2e800640 1 --2- 172.21.15.175:0/4231803920 >> v2:172.21.15.177:3300/0 conn(0x7f4e28145250 0x7f4e280cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.469+0000 7f4e2e800640 1 -- 172.21.15.175:0/4231803920 >> 172.21.15.175:0/4231803920 conn(0x7f4e2806ac50 msgr2=0x7f4e2806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:37.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.469+0000 7f4e2e800640 1 -- 172.21.15.175:0/4231803920 shutdown_connections 2024-04-25T09:06:37.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.469+0000 7f4e2e800640 1 -- 172.21.15.175:0/4231803920 wait complete. 2024-04-25T09:06:37.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e2e800640 1 Processor -- start 2024-04-25T09:06:37.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e2e800640 1 -- start start 2024-04-25T09:06:37.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e2e800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e280ce970 0x7f4e2813c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e2e800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e28145250 0x7f4e2813f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e2e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e281600a0 0x7f4e280af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e2e800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2815c870 con 0x7f4e281600a0 2024-04-25T09:06:37.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e2e800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e28145630 con 0x7f4e280ce970 2024-04-25T09:06:37.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e2e800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2815c9f0 con 0x7f4e28145250 2024-04-25T09:06:37.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e27e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e281600a0 0x7f4e280af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e27e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e281600a0 0x7f4e280af2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44716/0 (socket says 172.21.15.175:44716) 2024-04-25T09:06:37.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e27e00640 1 -- 172.21.15.175:0/2991363205 learned_addr learned my addr 172.21.15.175:0/2991363205 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:37.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e26a00640 1 --2- 172.21.15.175:0/2991363205 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e28145250 0x7f4e2813f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e27400640 1 --2- 172.21.15.175:0/2991363205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e280ce970 0x7f4e2813c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e27e00640 1 -- 172.21.15.175:0/2991363205 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e28145250 msgr2=0x7f4e2813f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e27e00640 1 --2- 172.21.15.175:0/2991363205 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e28145250 0x7f4e2813f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e27e00640 1 -- 172.21.15.175:0/2991363205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e280ce970 msgr2=0x7f4e2813c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e27e00640 1 --2- 172.21.15.175:0/2991363205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e280ce970 0x7f4e2813c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e27e00640 1 -- 172.21.15.175:0/2991363205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2813bbc0 con 0x7f4e281600a0 2024-04-25T09:06:37.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e27e00640 1 --2- 172.21.15.175:0/2991363205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e281600a0 0x7f4e280af2d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000c780 tx=0x7f4e2000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:37.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e1f400640 1 -- 172.21.15.175:0/2991363205 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e20003db0 con 0x7f4e281600a0 2024-04-25T09:06:37.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e1f400640 1 -- 172.21.15.175:0/2991363205 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e20005070 con 0x7f4e281600a0 2024-04-25T09:06:37.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e2e800640 1 -- 172.21.15.175:0/2991363205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2813be40 con 0x7f4e281600a0 2024-04-25T09:06:37.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e1f400640 1 -- 172.21.15.175:0/2991363205 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e20005460 con 0x7f4e281600a0 2024-04-25T09:06:37.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e2e800640 1 -- 172.21.15.175:0/2991363205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2813fdd0 con 0x7f4e281600a0 2024-04-25T09:06:37.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.473+0000 7f4e2e800640 1 -- 172.21.15.175:0/2991363205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e28075160 con 0x7f4e281600a0 2024-04-25T09:06:37.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.477+0000 7f4e1f400640 1 -- 172.21.15.175:0/2991363205 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4e20005600 con 0x7f4e281600a0 2024-04-25T09:06:37.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.477+0000 7f4e1f400640 1 --2- 172.21.15.175:0/2991363205 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4e08066f90 0x7f4e08069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:37.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.477+0000 7f4e1f400640 1 -- 172.21.15.175:0/2991363205 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4e20084b80 con 0x7f4e281600a0 2024-04-25T09:06:37.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.477+0000 7f4e27400640 1 --2- 172.21.15.175:0/2991363205 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4e08066f90 0x7f4e08069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:37.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.477+0000 7f4e27400640 1 --2- 172.21.15.175:0/2991363205 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4e08066f90 0x7f4e08069450 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4e18009b60 tx=0x7f4e18009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:37.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.481+0000 7f4e1f400640 1 -- 172.21.15.175:0/2991363205 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4e2813bbc0 con 0x7f4e281600a0 2024-04-25T09:06:37.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.633+0000 7f4e2e800640 1 -- 172.21.15.175:0/2991363205 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4e280d0480 con 0x7f4e281600a0 2024-04-25T09:06:37.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.637+0000 7f4e1f400640 1 -- 172.21.15.175:0/2991363205 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4e200557a0 con 0x7f4e281600a0 2024-04-25T09:06:37.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.641+0000 7f4e2e800640 1 -- 172.21.15.175:0/2991363205 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4e08066f90 msgr2=0x7f4e08069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.641+0000 7f4e2e800640 1 --2- 172.21.15.175:0/2991363205 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4e08066f90 0x7f4e08069450 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4e18009b60 tx=0x7f4e18009190 comp rx=0 tx=0).stop 2024-04-25T09:06:37.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.641+0000 7f4e2e800640 1 -- 172.21.15.175:0/2991363205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e281600a0 msgr2=0x7f4e280af2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:37.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.641+0000 7f4e2e800640 1 --2- 172.21.15.175:0/2991363205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e281600a0 0x7f4e280af2d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000c780 tx=0x7f4e2000cc40 comp rx=0 tx=0).stop 2024-04-25T09:06:37.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.641+0000 7f4e2e800640 1 -- 172.21.15.175:0/2991363205 shutdown_connections 2024-04-25T09:06:37.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.641+0000 7f4e2e800640 1 --2- 172.21.15.175:0/2991363205 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4e08066f90 0x7f4e08069450 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.641+0000 7f4e2e800640 1 --2- 172.21.15.175:0/2991363205 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e281600a0 0x7f4e280af2d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.641+0000 7f4e2e800640 1 --2- 172.21.15.175:0/2991363205 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e28145250 0x7f4e2813f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.641+0000 7f4e2e800640 1 --2- 172.21.15.175:0/2991363205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e280ce970 0x7f4e2813c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:37.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.641+0000 7f4e2e800640 1 -- 172.21.15.175:0/2991363205 >> 172.21.15.175:0/2991363205 conn(0x7f4e2806ac50 msgr2=0x7f4e2806b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:37.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.641+0000 7f4e2e800640 1 -- 172.21.15.175:0/2991363205 shutdown_connections 2024-04-25T09:06:37.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:37.641+0000 7f4e2e800640 1 -- 172.21.15.175:0/2991363205 wait complete. 2024-04-25T09:06:37.648 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:06:37.648 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:06:37.755 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:06:37.819 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:06:37.820 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:06:37.820 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:37.828 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:06:37.828 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:06:37.828 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:37.837 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:06:37.837 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:06:37.837 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:37.879 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:06:37.880 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:06:37.880 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:37.887 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:06:37.888 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:06:37.888 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:38.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.069+0000 7f6cccc00640 1 Processor -- start 2024-04-25T09:06:38.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.069+0000 7f6cccc00640 1 -- start start 2024-04-25T09:06:38.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.069+0000 7f6cccc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6cc80d0480 0x7f6cc80cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.069+0000 7f6cccc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cc80cc2e0 0x7f6cc8161a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.069+0000 7f6cccc00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc80cc750 con 0x7f6cc8161650 2024-04-25T09:06:38.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.069+0000 7f6cccc00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc806d1b0 con 0x7f6cc80d0480 2024-04-25T09:06:38.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.069+0000 7f6cccc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc809a220 con 0x7f6cc80cc2e0 2024-04-25T09:06:38.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.069+0000 7f6cc6a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6cc80d0480 0x7f6cc80cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.069+0000 7f6cc7400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f6cc8161650 0x7f6cc809a6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:54198/0 (socket says 172.21.15.175:54198) 2024-04-25T09:06:38.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.069+0000 7f6cc7400640 1 -- 172.21.15.175:0/1485532493 learned_addr learned my addr 172.21.15.175:0/1485532493 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:38.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.069+0000 7f6cc7e00640 1 --2- 172.21.15.175:0/1485532493 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cc80cc2e0 0x7f6cc8161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.069+0000 7f6cc6a00640 1 -- 172.21.15.175:0/1485532493 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cc80cc2e0 msgr2=0x7f6cc8161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:38.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.069+0000 7f6cc6a00640 1 --2- 172.21.15.175:0/1485532493 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cc80cc2e0 0x7f6cc8161a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.069+0000 7f6cc6a00640 1 -- 172.21.15.175:0/1485532493 >> v1:172.21.15.175:6789/0 conn(0x7f6cc8161650 legacy=0x7f6cc809a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.069+0000 7f6cc6a00640 1 -- 172.21.15.175:0/1485532493 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc80d08f0 con 0x7f6cc80d0480 2024-04-25T09:06:38.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.069+0000 7f6cc6000640 1 -- 172.21.15.175:0/1485532493 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362083640 0 0) 0x7f6cc80cc750 con 0x7f6cc8161650 2024-04-25T09:06:38.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.073+0000 7f6cc6a00640 1 --2- 172.21.15.175:0/1485532493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc80d0480 0x7f6cc80cbda0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40097f0 tx=0x7f6cb401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44ab81459cf8025 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.073+0000 7f6cc6000640 1 -- 172.21.15.175:0/1485532493 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb40b0070 con 0x7f6cc80d0480 2024-04-25T09:06:38.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.073+0000 7f6cc6000640 1 -- 172.21.15.175:0/1485532493 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb40ab600 con 0x7f6cc80d0480 2024-04-25T09:06:38.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.073+0000 7f6cc6000640 1 -- 172.21.15.175:0/1485532493 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb40ab9d0 con 0x7f6cc80d0480 2024-04-25T09:06:38.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.073+0000 7f6cccc00640 1 -- 172.21.15.175:0/1485532493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc80d0480 msgr2=0x7f6cc80cbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.073+0000 7f6cccc00640 1 --2- 172.21.15.175:0/1485532493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc80d0480 0x7f6cc80cbda0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40097f0 tx=0x7f6cb401c410 comp rx=0 tx=0).stop 2024-04-25T09:06:38.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.073+0000 7f6cccc00640 1 -- 172.21.15.175:0/1485532493 shutdown_connections 2024-04-25T09:06:38.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.073+0000 7f6cccc00640 1 --2- 172.21.15.175:0/1485532493 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cc80cc2e0 0x7f6cc8161a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.073+0000 7f6cccc00640 1 --2- 172.21.15.175:0/1485532493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc80d0480 0x7f6cc80cbda0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.073+0000 7f6cccc00640 1 -- 172.21.15.175:0/1485532493 >> 172.21.15.175:0/1485532493 conn(0x7f6cc80b3240 msgr2=0x7f6cc80b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:38.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.073+0000 7f6cccc00640 1 -- 172.21.15.175:0/1485532493 shutdown_connections 2024-04-25T09:06:38.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.073+0000 7f6cccc00640 1 -- 172.21.15.175:0/1485532493 wait complete. 2024-04-25T09:06:38.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cccc00640 1 Processor -- start 2024-04-25T09:06:38.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cccc00640 1 -- start start 2024-04-25T09:06:38.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cccc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc80cc2e0 0x7f6cc8158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cccc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cc80d0480 0x7f6cc81563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cccc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cc8161650 0x7f6cc806c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cccc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc8161220 con 0x7f6cc80cc2e0 2024-04-25T09:06:38.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cccc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc809adc0 con 0x7f6cc8161650 2024-04-25T09:06:38.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cccc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc81613a0 con 0x7f6cc80d0480 2024-04-25T09:06:38.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cc7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc80cc2e0 0x7f6cc8158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cc7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc80cc2e0 0x7f6cc8158f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44730/0 (socket says 172.21.15.175:44730) 2024-04-25T09:06:38.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cc7400640 1 -- 172.21.15.175:0/2681886286 learned_addr learned my addr 172.21.15.175:0/2681886286 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:38.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cc6a00640 1 --2- 172.21.15.175:0/2681886286 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cc80d0480 0x7f6cc81563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cc7e00640 1 --2- 172.21.15.175:0/2681886286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cc8161650 0x7f6cc806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cc7400640 1 -- 172.21.15.175:0/2681886286 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cc80d0480 msgr2=0x7f6cc81563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cc7400640 1 --2- 172.21.15.175:0/2681886286 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cc80d0480 0x7f6cc81563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cc7400640 1 -- 172.21.15.175:0/2681886286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cc8161650 msgr2=0x7f6cc806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cc7400640 1 --2- 172.21.15.175:0/2681886286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cc8161650 0x7f6cc806c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cc7400640 1 -- 172.21.15.175:0/2681886286 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc8156ed0 con 0x7f6cc80cc2e0 2024-04-25T09:06:38.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cc6a00640 1 --2- 172.21.15.175:0/2681886286 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cc80d0480 0x7f6cc81563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:38.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cc7400640 1 --2- 172.21.15.175:0/2681886286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc80cc2e0 0x7f6cc8158f50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800c890 tx=0x7f6cb800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cbf400640 1 -- 172.21.15.175:0/2681886286 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8018070 con 0x7f6cc80cc2e0 2024-04-25T09:06:38.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cbf400640 1 -- 172.21.15.175:0/2681886286 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb800a640 con 0x7f6cc80cc2e0 2024-04-25T09:06:38.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cbf400640 1 -- 172.21.15.175:0/2681886286 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb800aa30 con 0x7f6cc80cc2e0 2024-04-25T09:06:38.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cccc00640 1 -- 172.21.15.175:0/2681886286 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc8159490 con 0x7f6cc80cc2e0 2024-04-25T09:06:38.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.077+0000 7f6cccc00640 1 -- 172.21.15.175:0/2681886286 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc80c7030 con 0x7f6cc80cc2e0 2024-04-25T09:06:38.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.081+0000 7f6cccc00640 1 -- 172.21.15.175:0/2681886286 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc8074a60 con 0x7f6cc80cc2e0 2024-04-25T09:06:38.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.081+0000 7f6cbf400640 1 -- 172.21.15.175:0/2681886286 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6cb800abd0 con 0x7f6cc80cc2e0 2024-04-25T09:06:38.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.081+0000 7f6cbf400640 1 --2- 172.21.15.175:0/2681886286 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6ca8066f90 0x7f6ca8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.081+0000 7f6cbf400640 1 -- 172.21.15.175:0/2681886286 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6cb8084370 con 0x7f6cc80cc2e0 2024-04-25T09:06:38.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.081+0000 7f6cc6a00640 1 --2- 172.21.15.175:0/2681886286 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6ca8066f90 0x7f6ca8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.081+0000 7f6cc6a00640 1 --2- 172.21.15.175:0/2681886286 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6ca8066f90 0x7f6ca8069450 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40ad000 tx=0x7f6cb40a4f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.085+0000 7f6cbf400640 1 -- 172.21.15.175:0/2681886286 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6cc8156ed0 con 0x7f6cc80cc2e0 2024-04-25T09:06:38.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.269+0000 7f6cccc00640 1 -- 172.21.15.175:0/2681886286 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cc80d1320 con 0x7f6cc80cc2e0 2024-04-25T09:06:38.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.269+0000 7f6cbf400640 1 -- 172.21.15.175:0/2681886286 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f6cb8055670 con 0x7f6cc80cc2e0 2024-04-25T09:06:38.259 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:38.260 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5102,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2763692769","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2763692769},{"type":"v1","addr":"172.21.15.175:6837","nonce":2763692769}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5105,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3823569323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3823569323},{"type":"v1","addr":"172.21.15.177:6834","nonce":3823569323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2687013607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2687013607},{"type":"v1","addr":"172.21.15.177:6835","nonce":2687013607}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5883,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2343997391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2343997391},{"type":"v1","addr":"172.21.15.175:6836","nonce":2343997391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[]} 2024-04-25T09:06:38.260 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 27 2024-04-25T09:06:38.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.273+0000 7f6cccc00640 1 -- 172.21.15.175:0/2681886286 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6ca8066f90 msgr2=0x7f6ca8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.273+0000 7f6cccc00640 1 --2- 172.21.15.175:0/2681886286 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6ca8066f90 0x7f6ca8069450 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40ad000 tx=0x7f6cb40a4f90 comp rx=0 tx=0).stop 2024-04-25T09:06:38.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.273+0000 7f6cccc00640 1 -- 172.21.15.175:0/2681886286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc80cc2e0 msgr2=0x7f6cc8158f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.273+0000 7f6cccc00640 1 --2- 172.21.15.175:0/2681886286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc80cc2e0 0x7f6cc8158f50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800c890 tx=0x7f6cb800cd50 comp rx=0 tx=0).stop 2024-04-25T09:06:38.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.273+0000 7f6cccc00640 1 -- 172.21.15.175:0/2681886286 shutdown_connections 2024-04-25T09:06:38.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.273+0000 7f6cccc00640 1 --2- 172.21.15.175:0/2681886286 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6ca8066f90 0x7f6ca8069450 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.273+0000 7f6cccc00640 1 --2- 172.21.15.175:0/2681886286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6cc8161650 0x7f6cc806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.273+0000 7f6cccc00640 1 --2- 172.21.15.175:0/2681886286 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6cc80d0480 0x7f6cc81563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.273+0000 7f6cccc00640 1 --2- 172.21.15.175:0/2681886286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6cc80cc2e0 0x7f6cc8158f50 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.273+0000 7f6cccc00640 1 -- 172.21.15.175:0/2681886286 >> 172.21.15.175:0/2681886286 conn(0x7f6cc80b3240 msgr2=0x7f6cc8070460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:38.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.273+0000 7f6cccc00640 1 -- 172.21.15.175:0/2681886286 shutdown_connections 2024-04-25T09:06:38.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.273+0000 7f6cccc00640 1 -- 172.21.15.175:0/2681886286 wait complete. 2024-04-25T09:06:38.281 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:06:38.281 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:06:38.282 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:06:38.282 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:06:38.282 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:06:38.282 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:06:38.282 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:06:38.282 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:06:38.282 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:06:38.282 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:06:38.283 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:06:38.283 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:06:38.283 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:06:38.283 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:06:38.283 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:06:38.283 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:06:38.294 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:06:38.294 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:06:38.295 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:06:38.295 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:06:38.302 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:06:38.302 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:06:38.303 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:06:38.303 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:06:38.339 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:06:38.339 DEBUG:teuthology.parallel:result is None 2024-04-25T09:06:38.340 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:06:38.341 DEBUG:teuthology.parallel:result is None 2024-04-25T09:06:38.347 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:06:38.347 DEBUG:teuthology.parallel:result is None 2024-04-25T09:06:38.348 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:06:38.349 DEBUG:teuthology.parallel:result is None 2024-04-25T09:06:38.349 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:06:38.427 INFO:tasks.ceph.mds.c.smithi175.stdout:starting mds.c at 2024-04-25T09:06:38.428 INFO:tasks.ceph.mds.a.smithi175.stdout:starting mds.a at 2024-04-25T09:06:38.438 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-04-25T09:06:38.438 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-04-25T09:06:38.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.505+0000 7fbbeee00640 1 Processor -- start 2024-04-25T09:06:38.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.505+0000 7fbbeee00640 1 -- start start 2024-04-25T09:06:38.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.505+0000 7fbbeee00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbbe809a090 0x7fbbe806c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.505+0000 7fbbeee00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbbe80b27c0 0x7fbbe815d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.505+0000 7fbbeee00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe806cef0 con 0x7fbbe8099cb0 2024-04-25T09:06:38.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.505+0000 7fbbeee00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe80cf8b0 con 0x7fbbe809a090 2024-04-25T09:06:38.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.505+0000 7fbbeee00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe806ccb0 con 0x7fbbe80b27c0 2024-04-25T09:06:38.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.505+0000 7fbbed000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbbe809a090 0x7fbbe806c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.505+0000 7fbbed000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbbe809a090 0x7fbbe806c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44768/0 (socket says 172.21.15.175:44768) 2024-04-25T09:06:38.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.505+0000 7fbbed000640 1 -- 172.21.15.175:0/2370905610 learned_addr learned my addr 172.21.15.175:0/2370905610 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:38.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.505+0000 7fbbee400640 1 --2- 172.21.15.175:0/2370905610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbbe80b27c0 0x7fbbe815d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.505+0000 7fbbed000640 1 -- 172.21.15.175:0/2370905610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbbe80b27c0 msgr2=0x7fbbe815d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:38.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.505+0000 7fbbed000640 1 --2- 172.21.15.175:0/2370905610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbbe80b27c0 0x7fbbe815d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.505+0000 7fbbed000640 1 -- 172.21.15.175:0/2370905610 >> v1:172.21.15.175:6789/0 conn(0x7fbbe8099cb0 legacy=0x7fbbe80cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.505+0000 7fbbed000640 1 -- 172.21.15.175:0/2370905610 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe80cfae0 con 0x7fbbe809a090 2024-04-25T09:06:38.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.505+0000 7fbbe7e00640 1 -- 172.21.15.175:0/2370905610 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30816544 0 0) 0x7fbbe806cef0 con 0x7fbbe8099cb0 2024-04-25T09:06:38.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.509+0000 7fbbed000640 1 --2- 172.21.15.175:0/2370905610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbe809a090 0x7fbbe806c770 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009870 tx=0x7fbbd401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f88b1f41095fd5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.509+0000 7fbbe7e00640 1 -- 172.21.15.175:0/2370905610 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40b0070 con 0x7fbbe809a090 2024-04-25T09:06:38.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.509+0000 7fbbe7e00640 1 -- 172.21.15.175:0/2370905610 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd40ab600 con 0x7fbbe809a090 2024-04-25T09:06:38.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.509+0000 7fbbe7e00640 1 -- 172.21.15.175:0/2370905610 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40ab9d0 con 0x7fbbe809a090 2024-04-25T09:06:38.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.509+0000 7fbbeee00640 1 -- 172.21.15.175:0/2370905610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbe809a090 msgr2=0x7fbbe806c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.509+0000 7fbbeee00640 1 --2- 172.21.15.175:0/2370905610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbe809a090 0x7fbbe806c770 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4009870 tx=0x7fbbd401c4d0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.509+0000 7fbbeee00640 1 -- 172.21.15.175:0/2370905610 shutdown_connections 2024-04-25T09:06:38.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.509+0000 7fbbeee00640 1 --2- 172.21.15.175:0/2370905610 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbbe80b27c0 0x7fbbe815d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.509+0000 7fbbeee00640 1 --2- 172.21.15.175:0/2370905610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbe809a090 0x7fbbe806c770 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.509+0000 7fbbeee00640 1 -- 172.21.15.175:0/2370905610 >> 172.21.15.175:0/2370905610 conn(0x7fbbe80b3160 msgr2=0x7fbbe80b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:38.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.509+0000 7fbbeee00640 1 -- 172.21.15.175:0/2370905610 shutdown_connections 2024-04-25T09:06:38.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.509+0000 7fbbeee00640 1 -- 172.21.15.175:0/2370905610 wait complete. 2024-04-25T09:06:38.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbeee00640 1 Processor -- start 2024-04-25T09:06:38.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbeee00640 1 -- start start 2024-04-25T09:06:38.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbeee00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbe8099cb0 0x7fbbe814c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbeee00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbbe809a090 0x7fbbe81538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbeee00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbe80b27c0 0x7fbbe814d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbeee00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80d0f50 con 0x7fbbe80b27c0 2024-04-25T09:06:38.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbeee00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80d0dd0 con 0x7fbbe8099cb0 2024-04-25T09:06:38.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbeee00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe80d10d0 con 0x7fbbe809a090 2024-04-25T09:06:38.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbee400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbe80b27c0 0x7fbbe814d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbee400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbe80b27c0 0x7fbbe814d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44774/0 (socket says 172.21.15.175:44774) 2024-04-25T09:06:38.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbee400640 1 -- 172.21.15.175:0/1727499979 learned_addr learned my addr 172.21.15.175:0/1727499979 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:38.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbeda00640 1 --2- 172.21.15.175:0/1727499979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbe8099cb0 0x7fbbe814c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbed000640 1 --2- 172.21.15.175:0/1727499979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbbe809a090 0x7fbbe81538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbee400640 1 -- 172.21.15.175:0/1727499979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbbe809a090 msgr2=0x7fbbe81538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbee400640 1 --2- 172.21.15.175:0/1727499979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbbe809a090 0x7fbbe81538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbee400640 1 -- 172.21.15.175:0/1727499979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbe8099cb0 msgr2=0x7fbbe814c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:38.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbee400640 1 --2- 172.21.15.175:0/1727499979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbe8099cb0 0x7fbbe814c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:38.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbee400640 1 -- 172.21.15.175:0/1727499979 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe815b1a0 con 0x7fbbe80b27c0 2024-04-25T09:06:38.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbee400640 1 --2- 172.21.15.175:0/1727499979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbe80b27c0 0x7fbbe814d3b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000efc0 tx=0x7fbbe000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbe5600640 1 -- 172.21.15.175:0/1727499979 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0018020 con 0x7fbbe80b27c0 2024-04-25T09:06:38.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbe5600640 1 -- 172.21.15.175:0/1727499979 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe0014480 con 0x7fbbe80b27c0 2024-04-25T09:06:38.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbe5600640 1 -- 172.21.15.175:0/1727499979 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0014870 con 0x7fbbe80b27c0 2024-04-25T09:06:38.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbeee00640 1 -- 172.21.15.175:0/1727499979 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe815cb60 con 0x7fbbe80b27c0 2024-04-25T09:06:38.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbeee00640 1 -- 172.21.15.175:0/1727499979 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe814c5a0 con 0x7fbbe80b27c0 2024-04-25T09:06:38.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.513+0000 7fbbeee00640 1 -- 172.21.15.175:0/1727499979 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe8074a60 con 0x7fbbe80b27c0 2024-04-25T09:06:38.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.517+0000 7fbbe5600640 1 -- 172.21.15.175:0/1727499979 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbbe001b020 con 0x7fbbe80b27c0 2024-04-25T09:06:38.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.517+0000 7fbbe5600640 1 --2- 172.21.15.175:0/1727499979 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbbc8066f90 0x7fbbc8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:38.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.517+0000 7fbbe5600640 1 -- 172.21.15.175:0/1727499979 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbbe0085850 con 0x7fbbe80b27c0 2024-04-25T09:06:38.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.517+0000 7fbbeda00640 1 --2- 172.21.15.175:0/1727499979 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbbc8066f90 0x7fbbc8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:38.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.517+0000 7fbbeda00640 1 --2- 172.21.15.175:0/1727499979 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbbc8066f90 0x7fbbc8069450 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc000f70 tx=0x7fbbdc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:38.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.521+0000 7fbbe5600640 1 -- 172.21.15.175:0/1727499979 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbbe0022030 con 0x7fbbe80b27c0 2024-04-25T09:06:38.590 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:06:38.593 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:06:38.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:38.693+0000 7fbbeee00640 1 -- 172.21.15.175:0/1727499979 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbbe80b3f70 con 0x7fbbe80b27c0 2024-04-25T09:06:39.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.653+0000 7fbbe5600640 1 -- 172.21.15.175:0/1727499979 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v54) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbbe0010040 con 0x7fbbe80b27c0 2024-04-25T09:06:39.643 INFO:teuthology.orchestra.run.smithi175.stderr: removed all blocklist entries 2024-04-25T09:06:39.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.657+0000 7fbbeee00640 1 -- 172.21.15.175:0/1727499979 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbbc8066f90 msgr2=0x7fbbc8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.657+0000 7fbbeee00640 1 --2- 172.21.15.175:0/1727499979 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbbc8066f90 0x7fbbc8069450 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc000f70 tx=0x7fbbdc009040 comp rx=0 tx=0).stop 2024-04-25T09:06:39.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.657+0000 7fbbeee00640 1 -- 172.21.15.175:0/1727499979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbe80b27c0 msgr2=0x7fbbe814d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.657+0000 7fbbeee00640 1 --2- 172.21.15.175:0/1727499979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbe80b27c0 0x7fbbe814d3b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000efc0 tx=0x7fbbe000c490 comp rx=0 tx=0).stop 2024-04-25T09:06:39.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.657+0000 7fbbeee00640 1 -- 172.21.15.175:0/1727499979 shutdown_connections 2024-04-25T09:06:39.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.657+0000 7fbbeee00640 1 --2- 172.21.15.175:0/1727499979 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbbc8066f90 0x7fbbc8069450 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.657+0000 7fbbeee00640 1 --2- 172.21.15.175:0/1727499979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbe80b27c0 0x7fbbe814d3b0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.657+0000 7fbbeee00640 1 --2- 172.21.15.175:0/1727499979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbbe809a090 0x7fbbe81538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.657+0000 7fbbeee00640 1 --2- 172.21.15.175:0/1727499979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbbe8099cb0 0x7fbbe814c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.657+0000 7fbbeee00640 1 -- 172.21.15.175:0/1727499979 >> 172.21.15.175:0/1727499979 conn(0x7fbbe80b3160 msgr2=0x7fbbe80b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:39.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.657+0000 7fbbeee00640 1 -- 172.21.15.175:0/1727499979 shutdown_connections 2024-04-25T09:06:39.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.657+0000 7fbbeee00640 1 -- 172.21.15.175:0/1727499979 wait complete. 2024-04-25T09:06:39.670 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:06:39.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.861+0000 7f6698000640 1 Processor -- start 2024-04-25T09:06:39.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.861+0000 7f6698000640 1 -- start start 2024-04-25T09:06:39.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.865+0000 7f6698000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f669015dbd0 0x7f6690071c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.865+0000 7f6698000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66900ae680 0x7f66900aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.865+0000 7f6698000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669015dfb0 con 0x7f66900acd80 2024-04-25T09:06:39.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.865+0000 7f6698000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66900cf670 con 0x7f669015dbd0 2024-04-25T09:06:39.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.865+0000 7f6698000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66900b3590 con 0x7f66900ae680 2024-04-25T09:06:39.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.865+0000 7f6694c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66900ae680 0x7f66900aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.865+0000 7f6696000640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f66900acd80 0x7f66900ad210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:48580/0 (socket says 172.21.15.175:48580) 2024-04-25T09:06:39.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.865+0000 7f6696000640 1 -- 172.21.15.175:0/4211764335 learned_addr learned my addr 172.21.15.175:0/4211764335 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:39.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.865+0000 7f6695600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f669015dbd0 0x7f6690071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.865+0000 7f668fe00640 1 -- 172.21.15.175:0/4211764335 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2748497840 0 0) 0x7f669015dfb0 con 0x7f66900acd80 2024-04-25T09:06:39.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.865+0000 7f668fe00640 1 -- 172.21.15.175:0/4211764335 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6678003530 con 0x7f66900acd80 2024-04-25T09:06:39.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.865+0000 7f6695600640 1 -- 172.21.15.175:0/4211764335 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66900ae680 msgr2=0x7f66900aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:39.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.865+0000 7f6695600640 1 --2- 172.21.15.175:0/4211764335 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66900ae680 0x7f66900aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.865+0000 7f6695600640 1 -- 172.21.15.175:0/4211764335 >> v1:172.21.15.177:6789/0 conn(0x7f66900acd80 legacy=0x7f66900ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.865+0000 7f6695600640 1 -- 172.21.15.175:0/4211764335 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66900b2980 con 0x7f669015dbd0 2024-04-25T09:06:39.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.865+0000 7f6694c00640 1 --2- 172.21.15.175:0/4211764335 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66900ae680 0x7f66900aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:39.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.869+0000 7f6695600640 1 --2- 172.21.15.175:0/4211764335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f669015dbd0 0x7f6690071c50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6684009d90 tx=0x7f668401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=560382aa28e2639d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:39.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.869+0000 7f668fe00640 1 -- 172.21.15.175:0/4211764335 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66840b2070 con 0x7f669015dbd0 2024-04-25T09:06:39.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.869+0000 7f668fe00640 1 -- 172.21.15.175:0/4211764335 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66840a5920 con 0x7f669015dbd0 2024-04-25T09:06:39.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.869+0000 7f668fe00640 1 -- 172.21.15.175:0/4211764335 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66840a5cd0 con 0x7f669015dbd0 2024-04-25T09:06:39.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.869+0000 7f6698000640 1 -- 172.21.15.175:0/4211764335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f669015dbd0 msgr2=0x7f6690071c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.869+0000 7f6698000640 1 --2- 172.21.15.175:0/4211764335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f669015dbd0 0x7f6690071c50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6684009d90 tx=0x7f668401c970 comp rx=0 tx=0).stop 2024-04-25T09:06:39.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.869+0000 7f6698000640 1 -- 172.21.15.175:0/4211764335 shutdown_connections 2024-04-25T09:06:39.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.869+0000 7f6698000640 1 --2- 172.21.15.175:0/4211764335 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66900ae680 0x7f66900aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.869+0000 7f6698000640 1 --2- 172.21.15.175:0/4211764335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f669015dbd0 0x7f6690071c50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.869+0000 7f6698000640 1 -- 172.21.15.175:0/4211764335 >> 172.21.15.175:0/4211764335 conn(0x7f6690067150 msgr2=0x7f669006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:39.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.869+0000 7f6698000640 1 -- 172.21.15.175:0/4211764335 shutdown_connections 2024-04-25T09:06:39.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.869+0000 7f6698000640 1 -- 172.21.15.175:0/4211764335 wait complete. 2024-04-25T09:06:39.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.869+0000 7f6698000640 1 Processor -- start 2024-04-25T09:06:39.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.869+0000 7f6698000640 1 -- start start 2024-04-25T09:06:39.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6698000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66900ae680 0x7f669015fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6698000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f669015dbd0 0x7f6690140080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6698000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66900cbbd0 0x7f66900cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6698000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66900b2580 con 0x7f66900cbbd0 2024-04-25T09:06:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6698000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6690072190 con 0x7f669015dbd0 2024-04-25T09:06:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6698000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66900b2700 con 0x7f66900ae680 2024-04-25T09:06:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6696000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66900cbbd0 0x7f66900cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6696000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66900cbbd0 0x7f66900cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59064/0 (socket says 172.21.15.175:59064) 2024-04-25T09:06:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6696000640 1 -- 172.21.15.175:0/146002283 learned_addr learned my addr 172.21.15.175:0/146002283 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6695600640 1 --2- 172.21.15.175:0/146002283 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66900ae680 0x7f669015fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6694c00640 1 --2- 172.21.15.175:0/146002283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f669015dbd0 0x7f6690140080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6696000640 1 -- 172.21.15.175:0/146002283 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66900ae680 msgr2=0x7f669015fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6696000640 1 --2- 172.21.15.175:0/146002283 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66900ae680 0x7f669015fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6696000640 1 -- 172.21.15.175:0/146002283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f669015dbd0 msgr2=0x7f6690140080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6696000640 1 --2- 172.21.15.175:0/146002283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f669015dbd0 0x7f6690140080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:39.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6696000640 1 -- 172.21.15.175:0/146002283 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6690160140 con 0x7f66900cbbd0 2024-04-25T09:06:39.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6696000640 1 --2- 172.21.15.175:0/146002283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66900cbbd0 0x7f66900cc8c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f668800c3c0 tx=0x7f668800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:39.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f668d600640 1 -- 172.21.15.175:0/146002283 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6688017070 con 0x7f66900cbbd0 2024-04-25T09:06:39.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f668d600640 1 -- 172.21.15.175:0/146002283 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6688005cf0 con 0x7f66900cbbd0 2024-04-25T09:06:39.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f668d600640 1 -- 172.21.15.175:0/146002283 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6688007310 con 0x7f66900cbbd0 2024-04-25T09:06:39.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6698000640 1 -- 172.21.15.175:0/146002283 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6690160420 con 0x7f66900cbbd0 2024-04-25T09:06:39.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6698000640 1 -- 172.21.15.175:0/146002283 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6690150c70 con 0x7f66900cbbd0 2024-04-25T09:06:39.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f6698000640 1 -- 172.21.15.175:0/146002283 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6690160940 con 0x7f66900cbbd0 2024-04-25T09:06:39.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.873+0000 7f668d600640 1 -- 172.21.15.175:0/146002283 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f66880074b0 con 0x7f66900cbbd0 2024-04-25T09:06:39.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.877+0000 7f668d600640 1 --2- 172.21.15.175:0/146002283 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6670066f60 0x7f6670069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:39.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.877+0000 7f668d600640 1 -- 172.21.15.175:0/146002283 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6688083e60 con 0x7f66900cbbd0 2024-04-25T09:06:39.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.877+0000 7f6695600640 1 --2- 172.21.15.175:0/146002283 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6670066f60 0x7f6670069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:39.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.877+0000 7f6695600640 1 --2- 172.21.15.175:0/146002283 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6670066f60 0x7f6670069420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f66840af000 tx=0x7f66840a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:39.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:39.881+0000 7f668d600640 1 -- 172.21.15.175:0/146002283 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6690160940 con 0x7f66900cbbd0 2024-04-25T09:06:40.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.089+0000 7f6698000640 1 -- 172.21.15.175:0/146002283 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6690074a60 con 0x7f66900cbbd0 2024-04-25T09:06:40.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.089+0000 7f668d600640 1 -- 172.21.15.175:0/146002283 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6688054c00 con 0x7f66900cbbd0 2024-04-25T09:06:40.079 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:40.079 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:06:40.080 INFO:teuthology.orchestra.run.smithi175.stdout: "auth_dump": [ 2024-04-25T09:06:40.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.080 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.a", 2024-04-25T09:06:40.080 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpm3usiKxAAROh+31LaNyuh2SdeW6pKjQ==", 2024-04-25T09:06:40.080 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.080 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:06:40.080 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:06:40.080 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:06:40.080 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:06:40.080 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.080 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:40.080 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.080 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.b", 2024-04-25T09:06:40.080 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmYJoRNxAAZfRvDn1aoR0wa2mEKBrr+A==", 2024-04-25T09:06:40.080 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.081 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:06:40.081 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:06:40.081 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:06:40.081 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:06:40.081 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.081 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:40.081 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.081 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.c", 2024-04-25T09:06:40.081 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmk8M3MhAA6aIN33aWvVcvVEFtHL8SWA==", 2024-04-25T09:06:40.081 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.081 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:06:40.081 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:06:40.081 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:06:40.081 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:06:40.081 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:40.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.082 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.d", 2024-04-25T09:06:40.082 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmLAHLAhAA+mWUfpb6izHixJa073r9Jw==", 2024-04-25T09:06:40.082 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.082 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:06:40.082 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:06:40.082 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:06:40.082 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:06:40.082 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.082 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:40.082 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.082 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.0", 2024-04-25T09:06:40.082 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBSHCpm2xftAxAAxs9n8AE2H3HpPHEUZA4Cng==", 2024-04-25T09:06:40.082 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.083 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:40.083 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:06:40.083 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:06:40.083 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:40.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.083 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.1", 2024-04-25T09:06:40.083 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBVHCpm/OOlDRAAA7zaD8qsqS2TOCKhDFheJw==", 2024-04-25T09:06:40.083 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.083 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:40.083 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:06:40.083 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:06:40.083 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.083 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:40.083 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.083 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.2", 2024-04-25T09:06:40.084 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBYHCpmy/kmFxAAwCADFI/jMe27gAmyuAJZHQ==", 2024-04-25T09:06:40.084 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.084 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:40.084 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:06:40.084 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:06:40.084 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.084 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:40.084 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.084 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.3", 2024-04-25T09:06:40.084 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBbHCpm89a7HhAAVTueOuS0/Ksf8SdWK+Nm1g==", 2024-04-25T09:06:40.084 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.084 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:40.084 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:06:40.084 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:06:40.084 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:40.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.085 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.4", 2024-04-25T09:06:40.085 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBhHCpm5EAtFRAAeADhjja0BOIvxY3RB+n6+A==", 2024-04-25T09:06:40.085 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.085 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:40.085 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:06:40.085 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:06:40.085 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.085 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:40.085 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.085 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.5", 2024-04-25T09:06:40.085 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBkHCpmrLilHRAA+H8Bejnk49YfaUvl3Nrrhw==", 2024-04-25T09:06:40.085 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.085 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:40.085 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:06:40.086 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:06:40.086 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:40.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.086 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.6", 2024-04-25T09:06:40.086 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBnHCpm6uDxJRAAX5EwEelnZXwEHnNnv+XQ6A==", 2024-04-25T09:06:40.086 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.086 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:40.086 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:06:40.086 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:06:40.086 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.086 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:40.086 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.086 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.7", 2024-04-25T09:06:40.087 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBqHCpmwow5MBAA7b/Q9DiPO6Bfldq1+rf+/w==", 2024-04-25T09:06:40.087 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.087 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:40.087 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:06:40.087 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:06:40.087 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.087 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:40.087 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.087 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.0", 2024-04-25T09:06:40.087 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmhyCUBhAA8k9xLKIw8R04i6HSJykDfw==", 2024-04-25T09:06:40.087 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.087 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:06:40.087 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow r", 2024-04-25T09:06:40.087 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:06:40.087 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:40.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.088 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.1", 2024-04-25T09:06:40.088 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmQigrEBAAoWfP1ZEosbLELev5z+C9/g==", 2024-04-25T09:06:40.088 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.088 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:06:40.088 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:06:40.088 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:06:40.088 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:06:40.088 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.088 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:40.088 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.088 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.2", 2024-04-25T09:06:40.088 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpm0xaSDBAAup34GS3pnMwjksVuuUGOkw==", 2024-04-25T09:06:40.089 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.089 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:06:40.089 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:06:40.089 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:06:40.089 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:06:40.089 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.089 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:40.089 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.089 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.3", 2024-04-25T09:06:40.089 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpm6+doFhAAA18OgwfM8gXgQ6g0KUo7Hw==", 2024-04-25T09:06:40.089 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.089 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:06:40.089 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:06:40.089 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:06:40.089 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:06:40.090 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:40.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.090 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.admin", 2024-04-25T09:06:40.090 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmRZAYDRAA9sepw/fI2OhoZXER6Rmd+g==", 2024-04-25T09:06:40.090 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.090 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:06:40.090 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:06:40.090 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:06:40.090 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:06:40.090 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.090 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:40.090 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.090 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mgr.x", 2024-04-25T09:06:40.090 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpm5q4gJxAA9zPRlimxM0+Rb5RQkcoxzQ==", 2024-04-25T09:06:40.090 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.091 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:06:40.091 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile mgr", 2024-04-25T09:06:40.091 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:06:40.091 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.091 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:40.091 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:40.091 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mgr.y", 2024-04-25T09:06:40.091 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmMLIqIxAAiMo8+3lU0fXNoI6kBrro+Q==", 2024-04-25T09:06:40.091 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:06:40.091 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:06:40.091 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile mgr", 2024-04-25T09:06:40.091 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:06:40.091 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.091 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:40.091 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-25T09:06:40.092 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:06:40.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.093+0000 7f6698000640 1 -- 172.21.15.175:0/146002283 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6670066f60 msgr2=0x7f6670069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.093+0000 7f6698000640 1 --2- 172.21.15.175:0/146002283 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6670066f60 0x7f6670069420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f66840af000 tx=0x7f66840a7070 comp rx=0 tx=0).stop 2024-04-25T09:06:40.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.093+0000 7f6698000640 1 -- 172.21.15.175:0/146002283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66900cbbd0 msgr2=0x7f66900cc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.093+0000 7f6698000640 1 --2- 172.21.15.175:0/146002283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66900cbbd0 0x7f66900cc8c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f668800c3c0 tx=0x7f668800c880 comp rx=0 tx=0).stop 2024-04-25T09:06:40.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.093+0000 7f6698000640 1 -- 172.21.15.175:0/146002283 shutdown_connections 2024-04-25T09:06:40.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.093+0000 7f6698000640 1 --2- 172.21.15.175:0/146002283 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6670066f60 0x7f6670069420 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.093+0000 7f6698000640 1 --2- 172.21.15.175:0/146002283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66900cbbd0 0x7f66900cc8c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.093+0000 7f6698000640 1 --2- 172.21.15.175:0/146002283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f669015dbd0 0x7f6690140080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.093+0000 7f6698000640 1 --2- 172.21.15.175:0/146002283 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f66900ae680 0x7f669015fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.093+0000 7f6698000640 1 -- 172.21.15.175:0/146002283 >> 172.21.15.175:0/146002283 conn(0x7f66900acd80 msgr2=0x7f669014fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:40.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.093+0000 7f6698000640 1 -- 172.21.15.175:0/146002283 shutdown_connections 2024-04-25T09:06:40.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.093+0000 7f6698000640 1 -- 172.21.15.175:0/146002283 wait complete. 2024-04-25T09:06:40.100 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:40.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.245+0000 7f04f9e00640 1 Processor -- start 2024-04-25T09:06:40.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.245+0000 7f04f9e00640 1 -- start start 2024-04-25T09:06:40.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.249+0000 7f04f9e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f04f415a900 0x7f04f406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.249+0000 7f04f9e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04f40cf560 0x7f04f40cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.249+0000 7f04f9e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f40cda00 con 0x7f04f40cd520 2024-04-25T09:06:40.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.249+0000 7f04f9e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f415bcf0 con 0x7f04f415a900 2024-04-25T09:06:40.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.249+0000 7f04f9e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f40cfef0 con 0x7f04f40cf560 2024-04-25T09:06:40.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.249+0000 7f04f2a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f04f415a900 0x7f04f406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.249+0000 7f04f2a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f04f415a900 0x7f04f406e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59074/0 (socket says 172.21.15.175:59074) 2024-04-25T09:06:40.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.249+0000 7f04f2a00640 1 -- 172.21.15.175:0/4025273812 learned_addr learned my addr 172.21.15.175:0/4025273812 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:40.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.249+0000 7f04f3400640 1 --2- 172.21.15.175:0/4025273812 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04f40cf560 0x7f04f40cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.249+0000 7f04f2a00640 1 -- 172.21.15.175:0/4025273812 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04f40cf560 msgr2=0x7f04f40cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:40.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.249+0000 7f04f2a00640 1 --2- 172.21.15.175:0/4025273812 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04f40cf560 0x7f04f40cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.249+0000 7f04f2a00640 1 -- 172.21.15.175:0/4025273812 >> v1:172.21.15.177:6789/0 conn(0x7f04f40cd520 legacy=0x7f04f40ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.249+0000 7f04f2a00640 1 -- 172.21.15.175:0/4025273812 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f40cdce0 con 0x7f04f415a900 2024-04-25T09:06:40.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.249+0000 7f04f3400640 1 --2- 172.21.15.175:0/4025273812 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04f40cf560 0x7f04f40cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:40.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f2a00640 1 --2- 172.21.15.175:0/4025273812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f415a900 0x7f04f406e150 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f04e4009e50 tx=0x7f04e401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f8c7451de4afc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f2000640 1 -- 172.21.15.175:0/4025273812 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40a57f0 con 0x7f04f415a900 2024-04-25T09:06:40.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f2000640 1 -- 172.21.15.175:0/4025273812 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e40a5990 con 0x7f04f415a900 2024-04-25T09:06:40.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f2000640 1 -- 172.21.15.175:0/4025273812 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40a5d60 con 0x7f04f415a900 2024-04-25T09:06:40.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f9e00640 1 -- 172.21.15.175:0/4025273812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f415a900 msgr2=0x7f04f406e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f9e00640 1 --2- 172.21.15.175:0/4025273812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f415a900 0x7f04f406e150 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f04e4009e50 tx=0x7f04e401ca30 comp rx=0 tx=0).stop 2024-04-25T09:06:40.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f9e00640 1 -- 172.21.15.175:0/4025273812 shutdown_connections 2024-04-25T09:06:40.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f9e00640 1 --2- 172.21.15.175:0/4025273812 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04f40cf560 0x7f04f40cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f9e00640 1 --2- 172.21.15.175:0/4025273812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f415a900 0x7f04f406e150 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f9e00640 1 -- 172.21.15.175:0/4025273812 >> 172.21.15.175:0/4025273812 conn(0x7f04f4067150 msgr2=0x7f04f406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:40.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f9e00640 1 -- 172.21.15.175:0/4025273812 shutdown_connections 2024-04-25T09:06:40.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f9e00640 1 -- 172.21.15.175:0/4025273812 wait complete. 2024-04-25T09:06:40.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f9e00640 1 Processor -- start 2024-04-25T09:06:40.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f9e00640 1 -- start start 2024-04-25T09:06:40.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f40cf560 0x7f04f4158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f9e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04f415a900 0x7f04f414e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f9e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04f414ed20 0x7f04f40b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f9e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f406d530 con 0x7f04f40cf560 2024-04-25T09:06:40.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f9e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f406d3b0 con 0x7f04f414ed20 2024-04-25T09:06:40.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f9e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f415c790 con 0x7f04f415a900 2024-04-25T09:06:40.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f40cf560 0x7f04f4158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f40cf560 0x7f04f4158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59082/0 (socket says 172.21.15.175:59082) 2024-04-25T09:06:40.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04f2a00640 1 -- 172.21.15.175:0/3554692872 learned_addr learned my addr 172.21.15.175:0/3554692872 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:40.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.253+0000 7f04ea000640 1 --2- 172.21.15.175:0/3554692872 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04f415a900 0x7f04f414e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.257+0000 7f04f3400640 1 --2- 172.21.15.175:0/3554692872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04f414ed20 0x7f04f40b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.257+0000 7f04f2a00640 1 -- 172.21.15.175:0/3554692872 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04f415a900 msgr2=0x7f04f414e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.257+0000 7f04f2a00640 1 --2- 172.21.15.175:0/3554692872 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04f415a900 0x7f04f414e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.257+0000 7f04f2a00640 1 -- 172.21.15.175:0/3554692872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04f414ed20 msgr2=0x7f04f40b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.257+0000 7f04f2a00640 1 --2- 172.21.15.175:0/3554692872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04f414ed20 0x7f04f40b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.257+0000 7f04f2a00640 1 -- 172.21.15.175:0/3554692872 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f40b3310 con 0x7f04f40cf560 2024-04-25T09:06:40.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.257+0000 7f04f2a00640 1 --2- 172.21.15.175:0/3554692872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f40cf560 0x7f04f4158880 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f04e401a660 tx=0x7f04e40197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.257+0000 7f04ebe00640 1 -- 172.21.15.175:0/3554692872 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40b8470 con 0x7f04f40cf560 2024-04-25T09:06:40.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.257+0000 7f04ebe00640 1 -- 172.21.15.175:0/3554692872 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e40b8610 con 0x7f04f40cf560 2024-04-25T09:06:40.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.257+0000 7f04ebe00640 1 -- 172.21.15.175:0/3554692872 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40b8a00 con 0x7f04f40cf560 2024-04-25T09:06:40.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.257+0000 7f04f9e00640 1 -- 172.21.15.175:0/3554692872 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f40b35f0 con 0x7f04f40cf560 2024-04-25T09:06:40.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.257+0000 7f04f9e00640 1 -- 172.21.15.175:0/3554692872 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f40b3bb0 con 0x7f04f40cf560 2024-04-25T09:06:40.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.257+0000 7f04f9e00640 1 -- 172.21.15.175:0/3554692872 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f4074a60 con 0x7f04f40cf560 2024-04-25T09:06:40.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.257+0000 7f04ebe00640 1 -- 172.21.15.175:0/3554692872 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f04e40c0020 con 0x7f04f40cf560 2024-04-25T09:06:40.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.257+0000 7f04ebe00640 1 --2- 172.21.15.175:0/3554692872 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f04d0066f60 0x7f04d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.257+0000 7f04ebe00640 1 -- 172.21.15.175:0/3554692872 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f04e411f640 con 0x7f04f40cf560 2024-04-25T09:06:40.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.261+0000 7f04ea000640 1 --2- 172.21.15.175:0/3554692872 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f04d0066f60 0x7f04d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.261+0000 7f04ea000640 1 --2- 172.21.15.175:0/3554692872 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f04d0066f60 0x7f04d0069420 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f04f40b4550 tx=0x7f04dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.265+0000 7f04ebe00640 1 -- 172.21.15.175:0/3554692872 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f04e40c7020 con 0x7f04f40cf560 2024-04-25T09:06:40.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.421+0000 7f04f9e00640 1 -- 172.21.15.175:0/3554692872 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04f406c220 con 0x7f04f40cf560 2024-04-25T09:06:40.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.425+0000 7f04ebe00640 1 -- 172.21.15.175:0/3554692872 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+12927 (secure 0 0 0) 0x7f04e4016620 con 0x7f04f40cf560 2024-04-25T09:06:40.413 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:40.413 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":54,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:06:39.653862+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:40.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.425+0000 7f04f9e00640 1 -- 172.21.15.175:0/3554692872 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f04d0066f60 msgr2=0x7f04d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.425+0000 7f04f9e00640 1 --2- 172.21.15.175:0/3554692872 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f04d0066f60 0x7f04d0069420 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f04f40b4550 tx=0x7f04dc009040 comp rx=0 tx=0).stop 2024-04-25T09:06:40.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.425+0000 7f04f9e00640 1 -- 172.21.15.175:0/3554692872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f40cf560 msgr2=0x7f04f4158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.425+0000 7f04f9e00640 1 --2- 172.21.15.175:0/3554692872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f40cf560 0x7f04f4158880 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f04e401a660 tx=0x7f04e40197d0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.425+0000 7f04f9e00640 1 -- 172.21.15.175:0/3554692872 shutdown_connections 2024-04-25T09:06:40.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.425+0000 7f04f9e00640 1 --2- 172.21.15.175:0/3554692872 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f04d0066f60 0x7f04d0069420 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.425+0000 7f04f9e00640 1 --2- 172.21.15.175:0/3554692872 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04f414ed20 0x7f04f40b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.425+0000 7f04f9e00640 1 --2- 172.21.15.175:0/3554692872 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04f415a900 0x7f04f414e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.425+0000 7f04f9e00640 1 --2- 172.21.15.175:0/3554692872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04f40cf560 0x7f04f4158880 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.425+0000 7f04f9e00640 1 -- 172.21.15.175:0/3554692872 >> 172.21.15.175:0/3554692872 conn(0x7f04f40cd520 msgr2=0x7f04f415b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:40.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.425+0000 7f04f9e00640 1 -- 172.21.15.175:0/3554692872 shutdown_connections 2024-04-25T09:06:40.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.425+0000 7f04f9e00640 1 -- 172.21.15.175:0/3554692872 wait complete. 2024-04-25T09:06:40.435 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:06:40.435 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:06:40.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.585+0000 7f4edea00640 1 Processor -- start 2024-04-25T09:06:40.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.585+0000 7f4edea00640 1 -- start start 2024-04-25T09:06:40.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.585+0000 7f4edea00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4ed8145250 0x7f4ed80cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.585+0000 7f4edea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ed81600a0 0x7f4ed80cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.585+0000 7f4edea00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed80cfd10 con 0x7f4ed80ce970 2024-04-25T09:06:40.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.585+0000 7f4edea00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed815f650 con 0x7f4ed8145250 2024-04-25T09:06:40.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.585+0000 7f4edea00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed80cfff0 con 0x7f4ed81600a0 2024-04-25T09:06:40.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.585+0000 7f4ecf400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ed81600a0 0x7f4ed80cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.585+0000 7f4ecf400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ed81600a0 0x7f4ed80cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:36894/0 (socket says 172.21.15.175:36894) 2024-04-25T09:06:40.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.585+0000 7f4ecf400640 1 -- 172.21.15.175:0/3565583231 learned_addr learned my addr 172.21.15.175:0/3565583231 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:40.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.585+0000 7f4ed7e00640 1 --2- 172.21.15.175:0/3565583231 >> v2:172.21.15.177:3300/0 conn(0x7f4ed8145250 0x7f4ed80cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.585+0000 7f4ecf400640 1 -- 172.21.15.175:0/3565583231 >> v2:172.21.15.177:3300/0 conn(0x7f4ed8145250 msgr2=0x7f4ed80cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:40.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.585+0000 7f4ecf400640 1 --2- 172.21.15.175:0/3565583231 >> v2:172.21.15.177:3300/0 conn(0x7f4ed8145250 0x7f4ed80cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.585+0000 7f4ecf400640 1 -- 172.21.15.175:0/3565583231 >> v1:172.21.15.177:6789/0 conn(0x7f4ed80ce970 legacy=0x7f4ed80cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.585+0000 7f4ecf400640 1 -- 172.21.15.175:0/3565583231 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed815f8a0 con 0x7f4ed81600a0 2024-04-25T09:06:40.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.589+0000 7f4ecf400640 1 --2- 172.21.15.175:0/3565583231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ed81600a0 0x7f4ed80cc410 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0009e50 tx=0x7f4ec001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=875a8b77f58d0f12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.589+0000 7f4ed7400640 1 -- 172.21.15.175:0/3565583231 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec00a5850 con 0x7f4ed81600a0 2024-04-25T09:06:40.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.589+0000 7f4ed7400640 1 -- 172.21.15.175:0/3565583231 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec00a59f0 con 0x7f4ed81600a0 2024-04-25T09:06:40.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.589+0000 7f4ed7400640 1 -- 172.21.15.175:0/3565583231 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec00a5dc0 con 0x7f4ed81600a0 2024-04-25T09:06:40.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.589+0000 7f4edea00640 1 -- 172.21.15.175:0/3565583231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ed81600a0 msgr2=0x7f4ed80cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.589+0000 7f4edea00640 1 --2- 172.21.15.175:0/3565583231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ed81600a0 0x7f4ed80cc410 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0009e50 tx=0x7f4ec001c970 comp rx=0 tx=0).stop 2024-04-25T09:06:40.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.589+0000 7f4edea00640 1 -- 172.21.15.175:0/3565583231 shutdown_connections 2024-04-25T09:06:40.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.589+0000 7f4edea00640 1 --2- 172.21.15.175:0/3565583231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ed81600a0 0x7f4ed80cc410 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.589+0000 7f4edea00640 1 --2- 172.21.15.175:0/3565583231 >> v2:172.21.15.177:3300/0 conn(0x7f4ed8145250 0x7f4ed80cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.589+0000 7f4edea00640 1 -- 172.21.15.175:0/3565583231 >> 172.21.15.175:0/3565583231 conn(0x7f4ed806ac50 msgr2=0x7f4ed806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:40.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.589+0000 7f4edea00640 1 -- 172.21.15.175:0/3565583231 shutdown_connections 2024-04-25T09:06:40.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.589+0000 7f4edea00640 1 -- 172.21.15.175:0/3565583231 wait complete. 2024-04-25T09:06:40.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4edea00640 1 Processor -- start 2024-04-25T09:06:40.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4edea00640 1 -- start start 2024-04-25T09:06:40.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4edea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ed80ce970 0x7f4ed812e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4edea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ed8145250 0x7f4ed80ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4edea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ed81600a0 0x7f4ed813fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4edea00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed815c870 con 0x7f4ed80ce970 2024-04-25T09:06:40.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4edea00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed8145630 con 0x7f4ed81600a0 2024-04-25T09:06:40.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4edea00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed815c9f0 con 0x7f4ed8145250 2024-04-25T09:06:40.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4ed7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ed80ce970 0x7f4ed812e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4ed7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ed80ce970 0x7f4ed812e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59094/0 (socket says 172.21.15.175:59094) 2024-04-25T09:06:40.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4ed7e00640 1 -- 172.21.15.175:0/1731186693 learned_addr learned my addr 172.21.15.175:0/1731186693 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:40.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4ecf400640 1 --2- 172.21.15.175:0/1731186693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ed8145250 0x7f4ed80ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4edca00640 1 --2- 172.21.15.175:0/1731186693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ed81600a0 0x7f4ed813fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4ed7e00640 1 -- 172.21.15.175:0/1731186693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ed8145250 msgr2=0x7f4ed80ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4ed7e00640 1 --2- 172.21.15.175:0/1731186693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ed8145250 0x7f4ed80ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4ed7e00640 1 -- 172.21.15.175:0/1731186693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ed81600a0 msgr2=0x7f4ed813fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4ed7e00640 1 --2- 172.21.15.175:0/1731186693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ed81600a0 0x7f4ed813fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4ed7e00640 1 -- 172.21.15.175:0/1731186693 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed8143800 con 0x7f4ed80ce970 2024-04-25T09:06:40.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4ecf400640 1 --2- 172.21.15.175:0/1731186693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ed8145250 0x7f4ed80ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:40.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4ed7e00640 1 --2- 172.21.15.175:0/1731186693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ed80ce970 0x7f4ed812e640 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f4ec800e960 tx=0x7f4ec800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4ed4c00640 1 -- 172.21.15.175:0/1731186693 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8017070 con 0x7f4ed80ce970 2024-04-25T09:06:40.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4ed4c00640 1 -- 172.21.15.175:0/1731186693 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec800ca00 con 0x7f4ed80ce970 2024-04-25T09:06:40.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4ed4c00640 1 -- 172.21.15.175:0/1731186693 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec800cdb0 con 0x7f4ed80ce970 2024-04-25T09:06:40.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4edea00640 1 -- 172.21.15.175:0/1731186693 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed812eb80 con 0x7f4ed80ce970 2024-04-25T09:06:40.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4edea00640 1 -- 172.21.15.175:0/1731186693 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed8143a70 con 0x7f4ed80ce970 2024-04-25T09:06:40.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.593+0000 7f4edea00640 1 -- 172.21.15.175:0/1731186693 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed8075160 con 0x7f4ed80ce970 2024-04-25T09:06:40.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.597+0000 7f4ed4c00640 1 -- 172.21.15.175:0/1731186693 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4ec801a070 con 0x7f4ed80ce970 2024-04-25T09:06:40.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.597+0000 7f4ed4c00640 1 --2- 172.21.15.175:0/1731186693 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4eb4066f60 0x7f4eb4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.597+0000 7f4ed4c00640 1 -- 172.21.15.175:0/1731186693 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4ec8084c80 con 0x7f4ed80ce970 2024-04-25T09:06:40.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.597+0000 7f4ecf400640 1 --2- 172.21.15.175:0/1731186693 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4eb4066f60 0x7f4eb4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.597+0000 7f4ecf400640 1 --2- 172.21.15.175:0/1731186693 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4eb4066f60 0x7f4eb4069420 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4ec00ae000 tx=0x7f4ec00a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.601+0000 7f4ed4c00640 1 -- 172.21.15.175:0/1731186693 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4ed812eb80 con 0x7f4ed80ce970 2024-04-25T09:06:40.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.757+0000 7f4edea00640 1 -- 172.21.15.175:0/1731186693 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ed80cc5a0 con 0x7f4ed80ce970 2024-04-25T09:06:40.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.757+0000 7f4ed4c00640 1 -- 172.21.15.175:0/1731186693 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ec8055980 con 0x7f4ed80ce970 2024-04-25T09:06:40.747 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:06:40.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.757+0000 7f4edea00640 1 -- 172.21.15.175:0/1731186693 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4eb4066f60 msgr2=0x7f4eb4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.757+0000 7f4edea00640 1 --2- 172.21.15.175:0/1731186693 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4eb4066f60 0x7f4eb4069420 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4ec00ae000 tx=0x7f4ec00a7070 comp rx=0 tx=0).stop 2024-04-25T09:06:40.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.757+0000 7f4edea00640 1 -- 172.21.15.175:0/1731186693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ed80ce970 msgr2=0x7f4ed812e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.757+0000 7f4edea00640 1 --2- 172.21.15.175:0/1731186693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ed80ce970 0x7f4ed812e640 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f4ec800e960 tx=0x7f4ec800ee20 comp rx=0 tx=0).stop 2024-04-25T09:06:40.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.757+0000 7f4edea00640 1 -- 172.21.15.175:0/1731186693 shutdown_connections 2024-04-25T09:06:40.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.757+0000 7f4edea00640 1 --2- 172.21.15.175:0/1731186693 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4eb4066f60 0x7f4eb4069420 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.757+0000 7f4edea00640 1 --2- 172.21.15.175:0/1731186693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4ed81600a0 0x7f4ed813fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.757+0000 7f4edea00640 1 --2- 172.21.15.175:0/1731186693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4ed8145250 0x7f4ed80ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.757+0000 7f4edea00640 1 --2- 172.21.15.175:0/1731186693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ed80ce970 0x7f4ed812e640 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.757+0000 7f4edea00640 1 -- 172.21.15.175:0/1731186693 >> 172.21.15.175:0/1731186693 conn(0x7f4ed806ac50 msgr2=0x7f4ed81440d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:40.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.761+0000 7f4edea00640 1 -- 172.21.15.175:0/1731186693 shutdown_connections 2024-04-25T09:06:40.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.761+0000 7f4edea00640 1 -- 172.21.15.175:0/1731186693 wait complete. 2024-04-25T09:06:40.767 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:06:40.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.913+0000 7ff3a9a00640 1 Processor -- start 2024-04-25T09:06:40.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.913+0000 7ff3a9a00640 1 -- start start 2024-04-25T09:06:40.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.913+0000 7ff3a9a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff3a4144fc0 0x7ff3a40cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.913+0000 7ff3a9a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3a41453a0 0x7ff3a415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.913+0000 7ff3a9a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a415cd00 con 0x7ff3a40cc3b0 2024-04-25T09:06:40.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.913+0000 7ff3a9a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a40ce660 con 0x7ff3a4144fc0 2024-04-25T09:06:40.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.913+0000 7ff3a9a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a40cc930 con 0x7ff3a41453a0 2024-04-25T09:06:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.913+0000 7ff3a2a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff3a4144fc0 0x7ff3a40cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.913+0000 7ff39a000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3a41453a0 0x7ff3a415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.913+0000 7ff3a3400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ff3a40cc3b0 0x7ff3a415f480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:48606/0 (socket says 172.21.15.175:48606) 2024-04-25T09:06:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.913+0000 7ff3a3400640 1 -- 172.21.15.175:0/425257240 learned_addr learned my addr 172.21.15.175:0/425257240 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.917+0000 7ff3a2a00640 1 -- 172.21.15.175:0/425257240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3a41453a0 msgr2=0x7ff3a415bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.917+0000 7ff3a2a00640 1 --2- 172.21.15.175:0/425257240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3a41453a0 0x7ff3a415bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.917+0000 7ff3a2a00640 1 -- 172.21.15.175:0/425257240 >> v1:172.21.15.177:6789/0 conn(0x7ff3a40cc3b0 legacy=0x7ff3a415f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.917+0000 7ff3a2a00640 1 -- 172.21.15.175:0/425257240 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a40ccc10 con 0x7ff3a4144fc0 2024-04-25T09:06:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.917+0000 7ff39a000640 1 --2- 172.21.15.175:0/425257240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3a41453a0 0x7ff3a415bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:40.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.917+0000 7ff3a2a00640 1 --2- 172.21.15.175:0/425257240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3a4144fc0 0x7ff3a40cbe70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff394009d90 tx=0x7ff39401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e29287fdf9f603f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.917+0000 7ff3a2000640 1 -- 172.21.15.175:0/425257240 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3940b2070 con 0x7ff3a4144fc0 2024-04-25T09:06:40.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.917+0000 7ff3a2000640 1 -- 172.21.15.175:0/425257240 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3940a5920 con 0x7ff3a4144fc0 2024-04-25T09:06:40.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.917+0000 7ff3a2000640 1 -- 172.21.15.175:0/425257240 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3940a5cf0 con 0x7ff3a4144fc0 2024-04-25T09:06:40.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.917+0000 7ff3a9a00640 1 -- 172.21.15.175:0/425257240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3a4144fc0 msgr2=0x7ff3a40cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.917+0000 7ff3a9a00640 1 --2- 172.21.15.175:0/425257240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3a4144fc0 0x7ff3a40cbe70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff394009d90 tx=0x7ff39401c970 comp rx=0 tx=0).stop 2024-04-25T09:06:40.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff3a9a00640 1 -- 172.21.15.175:0/425257240 shutdown_connections 2024-04-25T09:06:40.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff3a9a00640 1 --2- 172.21.15.175:0/425257240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3a41453a0 0x7ff3a415bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff3a9a00640 1 --2- 172.21.15.175:0/425257240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3a4144fc0 0x7ff3a40cbe70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff3a9a00640 1 -- 172.21.15.175:0/425257240 >> 172.21.15.175:0/425257240 conn(0x7ff3a4067150 msgr2=0x7ff3a406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:40.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff3a9a00640 1 -- 172.21.15.175:0/425257240 shutdown_connections 2024-04-25T09:06:40.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff3a9a00640 1 -- 172.21.15.175:0/425257240 wait complete. 2024-04-25T09:06:40.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff3a9a00640 1 Processor -- start 2024-04-25T09:06:40.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff3a9a00640 1 -- start start 2024-04-25T09:06:40.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff3a9a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3a4144fc0 0x7ff3a4159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff3a9a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3a41453a0 0x7ff3a4159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff3a9a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3a413d440 0x7ff3a415a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff3a9a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a40cffb0 con 0x7ff3a41453a0 2024-04-25T09:06:40.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff3a9a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a40cfe30 con 0x7ff3a4144fc0 2024-04-25T09:06:40.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff3a9a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a41685f0 con 0x7ff3a413d440 2024-04-25T09:06:40.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff39a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3a41453a0 0x7ff3a4159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff39a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3a41453a0 0x7ff3a4159f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59106/0 (socket says 172.21.15.175:59106) 2024-04-25T09:06:40.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff39a000640 1 -- 172.21.15.175:0/602342630 learned_addr learned my addr 172.21.15.175:0/602342630 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:40.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff3a3400640 1 --2- 172.21.15.175:0/602342630 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3a413d440 0x7ff3a415a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff3a2a00640 1 --2- 172.21.15.175:0/602342630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3a4144fc0 0x7ff3a4159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff39a000640 1 -- 172.21.15.175:0/602342630 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3a413d440 msgr2=0x7ff3a415a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff39a000640 1 --2- 172.21.15.175:0/602342630 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3a413d440 0x7ff3a415a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff39a000640 1 -- 172.21.15.175:0/602342630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3a4144fc0 msgr2=0x7ff3a4159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:40.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff39a000640 1 --2- 172.21.15.175:0/602342630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3a4144fc0 0x7ff3a4159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:40.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff39a000640 1 -- 172.21.15.175:0/602342630 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a413d8d0 con 0x7ff3a41453a0 2024-04-25T09:06:40.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff39a000640 1 --2- 172.21.15.175:0/602342630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3a41453a0 0x7ff3a4159f60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00e980 tx=0x7ff38c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff39b400640 1 -- 172.21.15.175:0/602342630 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c017070 con 0x7ff3a41453a0 2024-04-25T09:06:40.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff39b400640 1 -- 172.21.15.175:0/602342630 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c00ca00 con 0x7ff3a41453a0 2024-04-25T09:06:40.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.921+0000 7ff39b400640 1 -- 172.21.15.175:0/602342630 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c00cdd0 con 0x7ff3a41453a0 2024-04-25T09:06:40.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.925+0000 7ff3a9a00640 1 -- 172.21.15.175:0/602342630 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a41398c0 con 0x7ff3a41453a0 2024-04-25T09:06:40.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.925+0000 7ff3a9a00640 1 -- 172.21.15.175:0/602342630 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a4139e80 con 0x7ff3a41453a0 2024-04-25T09:06:40.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.925+0000 7ff3a9a00640 1 -- 172.21.15.175:0/602342630 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a4074a60 con 0x7ff3a41453a0 2024-04-25T09:06:40.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.925+0000 7ff39b400640 1 -- 172.21.15.175:0/602342630 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff38c01a070 con 0x7ff3a41453a0 2024-04-25T09:06:40.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.925+0000 7ff39b400640 1 --2- 172.21.15.175:0/602342630 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff380066f60 0x7ff380069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:40.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.925+0000 7ff39b400640 1 -- 172.21.15.175:0/602342630 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff38c084e70 con 0x7ff3a41453a0 2024-04-25T09:06:40.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.925+0000 7ff3a2a00640 1 --2- 172.21.15.175:0/602342630 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff380066f60 0x7ff380069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:40.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.925+0000 7ff3a2a00640 1 --2- 172.21.15.175:0/602342630 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff380066f60 0x7ff380069420 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff3940af000 tx=0x7ff3940a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:40.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:40.929+0000 7ff39b400640 1 -- 172.21.15.175:0/602342630 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff38c055c10 con 0x7ff3a41453a0 2024-04-25T09:06:41.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.085+0000 7ff3a9a00640 1 -- 172.21.15.175:0/602342630 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff3a413dbb0 con 0x7ff3a41453a0 2024-04-25T09:06:41.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.085+0000 7ff39b400640 1 -- 172.21.15.175:0/602342630 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v54) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff38c059cb0 con 0x7ff3a41453a0 2024-04-25T09:06:41.076 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:41.076 INFO:teuthology.orchestra.run.smithi175.stdout:[ 2024-04-25T09:06:41.076 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:41.076 INFO:teuthology.orchestra.run.smithi175.stdout: "poolnum": 1, 2024-04-25T09:06:41.076 INFO:teuthology.orchestra.run.smithi175.stdout: "poolname": ".mgr" 2024-04-25T09:06:41.076 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:41.076 INFO:teuthology.orchestra.run.smithi175.stdout:] 2024-04-25T09:06:41.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.089+0000 7ff3a9a00640 1 -- 172.21.15.175:0/602342630 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff380066f60 msgr2=0x7ff380069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.089+0000 7ff3a9a00640 1 --2- 172.21.15.175:0/602342630 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff380066f60 0x7ff380069420 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff3940af000 tx=0x7ff3940a7070 comp rx=0 tx=0).stop 2024-04-25T09:06:41.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.089+0000 7ff3a9a00640 1 -- 172.21.15.175:0/602342630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3a41453a0 msgr2=0x7ff3a4159f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.089+0000 7ff3a9a00640 1 --2- 172.21.15.175:0/602342630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3a41453a0 0x7ff3a4159f60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff38c00e980 tx=0x7ff38c00ee40 comp rx=0 tx=0).stop 2024-04-25T09:06:41.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.089+0000 7ff3a9a00640 1 -- 172.21.15.175:0/602342630 shutdown_connections 2024-04-25T09:06:41.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.089+0000 7ff3a9a00640 1 --2- 172.21.15.175:0/602342630 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff380066f60 0x7ff380069420 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.089+0000 7ff3a9a00640 1 --2- 172.21.15.175:0/602342630 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3a413d440 0x7ff3a415a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.089+0000 7ff3a9a00640 1 --2- 172.21.15.175:0/602342630 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3a41453a0 0x7ff3a4159f60 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.089+0000 7ff3a9a00640 1 --2- 172.21.15.175:0/602342630 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3a4144fc0 0x7ff3a4159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.089+0000 7ff3a9a00640 1 -- 172.21.15.175:0/602342630 >> 172.21.15.175:0/602342630 conn(0x7ff3a40cc3b0 msgr2=0x7ff3a40cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:41.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.089+0000 7ff3a9a00640 1 -- 172.21.15.175:0/602342630 shutdown_connections 2024-04-25T09:06:41.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.089+0000 7ff3a9a00640 1 -- 172.21.15.175:0/602342630 wait complete. 2024-04-25T09:06:41.097 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:06:41.097 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:06:41.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.245+0000 7fbd34400640 1 Processor -- start 2024-04-25T09:06:41.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.245+0000 7fbd34400640 1 -- start start 2024-04-25T09:06:41.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.249+0000 7fbd34400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbd2c0cdb40 0x7fbd2c0cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.249+0000 7fbd34400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2c15dfa0 con 0x7fbd2c06bb20 2024-04-25T09:06:41.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.249+0000 7fbd34400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2c0ce460 con 0x7fbd2c1656f0 2024-04-25T09:06:41.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.249+0000 7fbd34400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2c06dc60 con 0x7fbd2c0cdb40 2024-04-25T09:06:41.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.249+0000 7fbd31000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fbd2c06bb20 0x7fbd2c06bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45536/0 (socket says 172.21.15.175:45536) 2024-04-25T09:06:41.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.249+0000 7fbd31000640 1 -- 172.21.15.175:0/2136382431 learned_addr learned my addr 172.21.15.175:0/2136382431 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:41.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.249+0000 7fbd31a00640 1 --2- 172.21.15.175:0/2136382431 >> v2:172.21.15.177:3300/0 conn(0x7fbd2c0cdb40 0x7fbd2c0cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.249+0000 7fbd2be00640 1 -- 172.21.15.175:0/2136382431 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933839430 0 0) 0x7fbd2c15dfa0 con 0x7fbd2c06bb20 2024-04-25T09:06:41.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.249+0000 7fbd2be00640 1 -- 172.21.15.175:0/2136382431 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd14003530 con 0x7fbd2c06bb20 2024-04-25T09:06:41.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.249+0000 7fbd31a00640 1 -- 172.21.15.175:0/2136382431 >> v1:172.21.15.177:6789/0 conn(0x7fbd2c1656f0 legacy=0x7fbd2c167ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.249+0000 7fbd31a00640 1 -- 172.21.15.175:0/2136382431 >> v1:172.21.15.175:6789/0 conn(0x7fbd2c06bb20 legacy=0x7fbd2c06bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.249+0000 7fbd31a00640 1 -- 172.21.15.175:0/2136382431 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c06df40 con 0x7fbd2c0cdb40 2024-04-25T09:06:41.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.253+0000 7fbd31a00640 1 --2- 172.21.15.175:0/2136382431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd2c0cdb40 0x7fbd2c0cdf20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbd200097c0 tx=0x7fbd2001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=520530b05d6e917 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:41.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.253+0000 7fbd2be00640 1 -- 172.21.15.175:0/2136382431 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd200b0070 con 0x7fbd2c0cdb40 2024-04-25T09:06:41.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.253+0000 7fbd2be00640 1 -- 172.21.15.175:0/2136382431 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd200ab600 con 0x7fbd2c0cdb40 2024-04-25T09:06:41.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.253+0000 7fbd2be00640 1 -- 172.21.15.175:0/2136382431 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd200ab9b0 con 0x7fbd2c0cdb40 2024-04-25T09:06:41.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.253+0000 7fbd34400640 1 -- 172.21.15.175:0/2136382431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd2c0cdb40 msgr2=0x7fbd2c0cdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.253+0000 7fbd34400640 1 --2- 172.21.15.175:0/2136382431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd2c0cdb40 0x7fbd2c0cdf20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbd200097c0 tx=0x7fbd2001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.253+0000 7fbd34400640 1 -- 172.21.15.175:0/2136382431 shutdown_connections 2024-04-25T09:06:41.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.253+0000 7fbd34400640 1 --2- 172.21.15.175:0/2136382431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd2c0cdb40 0x7fbd2c0cdf20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.253+0000 7fbd34400640 1 -- 172.21.15.175:0/2136382431 >> 172.21.15.175:0/2136382431 conn(0x7fbd2c0cc9f0 msgr2=0x7fbd2c0cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:41.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.253+0000 7fbd34400640 1 -- 172.21.15.175:0/2136382431 shutdown_connections 2024-04-25T09:06:41.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.253+0000 7fbd34400640 1 -- 172.21.15.175:0/2136382431 wait complete. 2024-04-25T09:06:41.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.253+0000 7fbd34400640 1 Processor -- start 2024-04-25T09:06:41.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.253+0000 7fbd34400640 1 -- start start 2024-04-25T09:06:41.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd34400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd2c06bb20 0x7fbd2c15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd34400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd2c0cdb40 0x7fbd2c154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd34400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd2c1656f0 0x7fbd2c0c3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd34400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c147570 con 0x7fbd2c0cdb40 2024-04-25T09:06:41.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd34400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c0ace00 con 0x7fbd2c06bb20 2024-04-25T09:06:41.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd34400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c1476f0 con 0x7fbd2c1656f0 2024-04-25T09:06:41.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd31000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd2c0cdb40 0x7fbd2c154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd31000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd2c0cdb40 0x7fbd2c154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59114/0 (socket says 172.21.15.175:59114) 2024-04-25T09:06:41.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd31000640 1 -- 172.21.15.175:0/3379991974 learned_addr learned my addr 172.21.15.175:0/3379991974 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:41.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd31a00640 1 --2- 172.21.15.175:0/3379991974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd2c06bb20 0x7fbd2c15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd32400640 1 --2- 172.21.15.175:0/3379991974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd2c1656f0 0x7fbd2c0c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd31000640 1 -- 172.21.15.175:0/3379991974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd2c1656f0 msgr2=0x7fbd2c0c3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd31000640 1 --2- 172.21.15.175:0/3379991974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd2c1656f0 0x7fbd2c0c3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd31000640 1 -- 172.21.15.175:0/3379991974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd2c06bb20 msgr2=0x7fbd2c15a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:41.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd31000640 1 --2- 172.21.15.175:0/3379991974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd2c06bb20 0x7fbd2c15a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:41.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd31000640 1 -- 172.21.15.175:0/3379991974 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c14df50 con 0x7fbd2c0cdb40 2024-04-25T09:06:41.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd31000640 1 --2- 172.21.15.175:0/3379991974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd2c0cdb40 0x7fbd2c154960 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800c420 tx=0x7fbd1800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:41.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd29600640 1 -- 172.21.15.175:0/3379991974 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18017070 con 0x7fbd2c0cdb40 2024-04-25T09:06:41.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd29600640 1 -- 172.21.15.175:0/3379991974 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd18005cf0 con 0x7fbd2c0cdb40 2024-04-25T09:06:41.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd34400640 1 -- 172.21.15.175:0/3379991974 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2c14e230 con 0x7fbd2c0cdb40 2024-04-25T09:06:41.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd29600640 1 -- 172.21.15.175:0/3379991974 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd180072d0 con 0x7fbd2c0cdb40 2024-04-25T09:06:41.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd34400640 1 -- 172.21.15.175:0/3379991974 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2c14e7f0 con 0x7fbd2c0cdb40 2024-04-25T09:06:41.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd34400640 1 -- 172.21.15.175:0/3379991974 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2c075160 con 0x7fbd2c0cdb40 2024-04-25T09:06:41.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.257+0000 7fbd29600640 1 -- 172.21.15.175:0/3379991974 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbd1801a070 con 0x7fbd2c0cdb40 2024-04-25T09:06:41.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.261+0000 7fbd29600640 1 --2- 172.21.15.175:0/3379991974 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbd0c066f90 0x7fbd0c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:41.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.261+0000 7fbd29600640 1 -- 172.21.15.175:0/3379991974 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbd18084090 con 0x7fbd2c0cdb40 2024-04-25T09:06:41.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.261+0000 7fbd31a00640 1 --2- 172.21.15.175:0/3379991974 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbd0c066f90 0x7fbd0c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:41.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.261+0000 7fbd31a00640 1 --2- 172.21.15.175:0/3379991974 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbd0c066f90 0x7fbd0c069450 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbd200ad000 tx=0x7fbd200a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:41.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.265+0000 7fbd29600640 1 -- 172.21.15.175:0/3379991974 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbd18054d00 con 0x7fbd2c0cdb40 2024-04-25T09:06:41.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:41.417+0000 7fbd34400640 1 -- 172.21.15.175:0/3379991974 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbd2c071fe0 con 0x7fbd2c0cdb40 2024-04-25T09:06:42.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.317+0000 7fbd29600640 1 -- 172.21.15.175:0/3379991974 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v55) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbd18058da0 con 0x7fbd2c0cdb40 2024-04-25T09:06:42.308 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_metadata' created 2024-04-25T09:06:42.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.321+0000 7fbd34400640 1 -- 172.21.15.175:0/3379991974 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbd0c066f90 msgr2=0x7fbd0c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.321+0000 7fbd34400640 1 --2- 172.21.15.175:0/3379991974 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbd0c066f90 0x7fbd0c069450 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbd200ad000 tx=0x7fbd200a6000 comp rx=0 tx=0).stop 2024-04-25T09:06:42.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.321+0000 7fbd34400640 1 -- 172.21.15.175:0/3379991974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd2c0cdb40 msgr2=0x7fbd2c154960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.321+0000 7fbd34400640 1 --2- 172.21.15.175:0/3379991974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd2c0cdb40 0x7fbd2c154960 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800c420 tx=0x7fbd1800c8e0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.321+0000 7fbd34400640 1 -- 172.21.15.175:0/3379991974 shutdown_connections 2024-04-25T09:06:42.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.321+0000 7fbd34400640 1 --2- 172.21.15.175:0/3379991974 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbd0c066f90 0x7fbd0c069450 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.321+0000 7fbd34400640 1 --2- 172.21.15.175:0/3379991974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbd2c1656f0 0x7fbd2c0c3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.321+0000 7fbd34400640 1 --2- 172.21.15.175:0/3379991974 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd2c0cdb40 0x7fbd2c154960 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.321+0000 7fbd34400640 1 --2- 172.21.15.175:0/3379991974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbd2c06bb20 0x7fbd2c15a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.321+0000 7fbd34400640 1 -- 172.21.15.175:0/3379991974 >> 172.21.15.175:0/3379991974 conn(0x7fbd2c0cc9f0 msgr2=0x7fbd2c0727e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:42.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.321+0000 7fbd34400640 1 -- 172.21.15.175:0/3379991974 shutdown_connections 2024-04-25T09:06:42.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.321+0000 7fbd34400640 1 -- 172.21.15.175:0/3379991974 wait complete. 2024-04-25T09:06:42.341 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:06:42.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.497+0000 7fc0a7e00640 1 Processor -- start 2024-04-25T09:06:42.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.497+0000 7fc0a7e00640 1 -- start start 2024-04-25T09:06:42.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.497+0000 7fc0a7e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0a015de90 0x7fc0a015ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.497+0000 7fc0a7e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc0a00ae9c0 0x7fc0a00b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.497+0000 7fc0a7e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc0a00b4540 0x7fc0a006d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.497+0000 7fc0a7e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a00b3660 con 0x7fc0a00b4540 2024-04-25T09:06:42.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.497+0000 7fc0a7e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a00b28a0 con 0x7fc0a00ae9c0 2024-04-25T09:06:42.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.497+0000 7fc0a7e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00b2b80 con 0x7fc0a015de90 2024-04-25T09:06:42.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.497+0000 7fc0a5e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc0a00b4540 0x7fc0a006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.497+0000 7fc0a5e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc0a00b4540 0x7fc0a006d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59120/0 (socket says 172.21.15.175:59120) 2024-04-25T09:06:42.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.497+0000 7fc0a5e00640 1 -- 172.21.15.175:0/3123280798 learned_addr learned my addr 172.21.15.175:0/3123280798 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:42.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.497+0000 7fc0a4a00640 1 --2- 172.21.15.175:0/3123280798 >> v2:172.21.15.177:3300/0 conn(0x7fc0a00ae9c0 0x7fc0a00b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.497+0000 7fc0a5400640 1 --2- 172.21.15.175:0/3123280798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0a015de90 0x7fc0a015ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.497+0000 7fc0a5e00640 1 -- 172.21.15.175:0/3123280798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0a015de90 msgr2=0x7fc0a015ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:42.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.497+0000 7fc0a5e00640 1 --2- 172.21.15.175:0/3123280798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0a015de90 0x7fc0a015ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.497+0000 7fc0a5e00640 1 -- 172.21.15.175:0/3123280798 >> v2:172.21.15.177:3300/0 conn(0x7fc0a00ae9c0 msgr2=0x7fc0a00b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:42.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.497+0000 7fc0a5e00640 1 --2- 172.21.15.175:0/3123280798 >> v2:172.21.15.177:3300/0 conn(0x7fc0a00ae9c0 0x7fc0a00b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.497+0000 7fc0a5e00640 1 -- 172.21.15.175:0/3123280798 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a00b2e60 con 0x7fc0a00b4540 2024-04-25T09:06:42.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.501+0000 7fc0a5e00640 1 --2- 172.21.15.175:0/3123280798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a00b4540 0x7fc0a006d310 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc0a006ba80 tx=0x7fc09801c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17897503249cf74f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:42.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.501+0000 7fc09fe00640 1 -- 172.21.15.175:0/3123280798 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0980b0070 con 0x7fc0a00b4540 2024-04-25T09:06:42.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.501+0000 7fc09fe00640 1 -- 172.21.15.175:0/3123280798 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0980ab600 con 0x7fc0a00b4540 2024-04-25T09:06:42.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.501+0000 7fc09fe00640 1 -- 172.21.15.175:0/3123280798 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0980ab9d0 con 0x7fc0a00b4540 2024-04-25T09:06:42.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.501+0000 7fc0a7e00640 1 -- 172.21.15.175:0/3123280798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a00b4540 msgr2=0x7fc0a006d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.501+0000 7fc0a7e00640 1 --2- 172.21.15.175:0/3123280798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a00b4540 0x7fc0a006d310 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc0a006ba80 tx=0x7fc09801c1d0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.501+0000 7fc0a7e00640 1 -- 172.21.15.175:0/3123280798 shutdown_connections 2024-04-25T09:06:42.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.501+0000 7fc0a7e00640 1 --2- 172.21.15.175:0/3123280798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a00b4540 0x7fc0a006d310 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.501+0000 7fc0a7e00640 1 --2- 172.21.15.175:0/3123280798 >> v2:172.21.15.177:3300/0 conn(0x7fc0a00ae9c0 0x7fc0a00b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.501+0000 7fc0a7e00640 1 --2- 172.21.15.175:0/3123280798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0a015de90 0x7fc0a015ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.501+0000 7fc0a7e00640 1 -- 172.21.15.175:0/3123280798 >> 172.21.15.175:0/3123280798 conn(0x7fc0a006ac50 msgr2=0x7fc0a006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:42.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.501+0000 7fc0a7e00640 1 -- 172.21.15.175:0/3123280798 shutdown_connections 2024-04-25T09:06:42.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.501+0000 7fc0a7e00640 1 -- 172.21.15.175:0/3123280798 wait complete. 2024-04-25T09:06:42.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a7e00640 1 Processor -- start 2024-04-25T09:06:42.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a7e00640 1 -- start start 2024-04-25T09:06:42.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0a00ae9c0 0x7fc0a014acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a7e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0a00b4540 0x7fc0a00cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a015de90 0x7fc0a00cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a7e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a0071640 con 0x7fc0a015de90 2024-04-25T09:06:42.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a7e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00714c0 con 0x7fc0a00ae9c0 2024-04-25T09:06:42.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a7e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00717c0 con 0x7fc0a00b4540 2024-04-25T09:06:42.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a5e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a015de90 0x7fc0a00cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a5e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a015de90 0x7fc0a00cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59134/0 (socket says 172.21.15.175:59134) 2024-04-25T09:06:42.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a5e00640 1 -- 172.21.15.175:0/1264149185 learned_addr learned my addr 172.21.15.175:0/1264149185 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:42.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a5400640 1 --2- 172.21.15.175:0/1264149185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0a00ae9c0 0x7fc0a014acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a4a00640 1 --2- 172.21.15.175:0/1264149185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0a00b4540 0x7fc0a00cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a5e00640 1 -- 172.21.15.175:0/1264149185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0a00b4540 msgr2=0x7fc0a00cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a5e00640 1 --2- 172.21.15.175:0/1264149185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0a00b4540 0x7fc0a00cd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a5e00640 1 -- 172.21.15.175:0/1264149185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0a00ae9c0 msgr2=0x7fc0a014acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:42.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a5e00640 1 --2- 172.21.15.175:0/1264149185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0a00ae9c0 0x7fc0a014acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:42.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a5e00640 1 -- 172.21.15.175:0/1264149185 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a014b200 con 0x7fc0a015de90 2024-04-25T09:06:42.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a5e00640 1 --2- 172.21.15.175:0/1264149185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a015de90 0x7fc0a00cefe0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc0980ae040 tx=0x7fc098018f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:42.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc09d600640 1 -- 172.21.15.175:0/1264149185 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0980b0040 con 0x7fc0a015de90 2024-04-25T09:06:42.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc09d600640 1 -- 172.21.15.175:0/1264149185 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0980b9070 con 0x7fc0a015de90 2024-04-25T09:06:42.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc09d600640 1 -- 172.21.15.175:0/1264149185 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0980b4670 con 0x7fc0a015de90 2024-04-25T09:06:42.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.505+0000 7fc0a7e00640 1 -- 172.21.15.175:0/1264149185 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a00cdf40 con 0x7fc0a015de90 2024-04-25T09:06:42.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.509+0000 7fc0a7e00640 1 -- 172.21.15.175:0/1264149185 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a00ce500 con 0x7fc0a015de90 2024-04-25T09:06:42.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.509+0000 7fc0a7e00640 1 -- 172.21.15.175:0/1264149185 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a0074a60 con 0x7fc0a015de90 2024-04-25T09:06:42.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.509+0000 7fc09d600640 1 -- 172.21.15.175:0/1264149185 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc0980b4810 con 0x7fc0a015de90 2024-04-25T09:06:42.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.509+0000 7fc09d600640 1 --2- 172.21.15.175:0/1264149185 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc080066f90 0x7fc080069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:42.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.509+0000 7fc09d600640 1 -- 172.21.15.175:0/1264149185 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fc09811eaa0 con 0x7fc0a015de90 2024-04-25T09:06:42.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.509+0000 7fc0a5400640 1 --2- 172.21.15.175:0/1264149185 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc080066f90 0x7fc080069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:42.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.509+0000 7fc0a5400640 1 --2- 172.21.15.175:0/1264149185 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc080066f90 0x7fc080069450 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc094003ab0 tx=0x7fc094009830 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:42.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.513+0000 7fc09d600640 1 -- 172.21.15.175:0/1264149185 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc098016110 con 0x7fc0a015de90 2024-04-25T09:06:42.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:42.669+0000 7fc0a7e00640 1 -- 172.21.15.175:0/1264149185 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc0a0154750 con 0x7fc0a015de90 2024-04-25T09:06:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.321+0000 7fc09d600640 1 -- 172.21.15.175:0/1264149185 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v56) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc0980ef5a0 con 0x7fc0a015de90 2024-04-25T09:06:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_data' created 2024-04-25T09:06:43.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.325+0000 7fc0a7e00640 1 -- 172.21.15.175:0/1264149185 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc080066f90 msgr2=0x7fc080069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.325+0000 7fc0a7e00640 1 --2- 172.21.15.175:0/1264149185 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc080066f90 0x7fc080069450 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc094003ab0 tx=0x7fc094009830 comp rx=0 tx=0).stop 2024-04-25T09:06:43.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.325+0000 7fc0a7e00640 1 -- 172.21.15.175:0/1264149185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a015de90 msgr2=0x7fc0a00cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.325+0000 7fc0a7e00640 1 --2- 172.21.15.175:0/1264149185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a015de90 0x7fc0a00cefe0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc0980ae040 tx=0x7fc098018f70 comp rx=0 tx=0).stop 2024-04-25T09:06:43.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.325+0000 7fc0a7e00640 1 -- 172.21.15.175:0/1264149185 shutdown_connections 2024-04-25T09:06:43.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.325+0000 7fc0a7e00640 1 --2- 172.21.15.175:0/1264149185 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc080066f90 0x7fc080069450 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.325+0000 7fc0a7e00640 1 --2- 172.21.15.175:0/1264149185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a015de90 0x7fc0a00cefe0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.325+0000 7fc0a7e00640 1 --2- 172.21.15.175:0/1264149185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0a00b4540 0x7fc0a00cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.325+0000 7fc0a7e00640 1 --2- 172.21.15.175:0/1264149185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0a00ae9c0 0x7fc0a014acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.325+0000 7fc0a7e00640 1 -- 172.21.15.175:0/1264149185 >> 172.21.15.175:0/1264149185 conn(0x7fc0a006ac50 msgr2=0x7fc0a00afd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:43.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.325+0000 7fc0a7e00640 1 -- 172.21.15.175:0/1264149185 shutdown_connections 2024-04-25T09:06:43.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.325+0000 7fc0a7e00640 1 -- 172.21.15.175:0/1264149185 wait complete. 2024-04-25T09:06:43.350 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:06:43.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.497+0000 7fe6a3400640 1 Processor -- start 2024-04-25T09:06:43.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.501+0000 7fe6a3400640 1 -- start start 2024-04-25T09:06:43.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.501+0000 7fe6a3400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe69c145250 0x7fe69c0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.501+0000 7fe6a3400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe69c0ce970 0x7fe69c0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.501+0000 7fe6a3400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe69c0cfd10 con 0x7fe69c1600a0 2024-04-25T09:06:43.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.501+0000 7fe6a3400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69c15f650 con 0x7fe69c145250 2024-04-25T09:06:43.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.501+0000 7fe6a3400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c0cfff0 con 0x7fe69c0ce970 2024-04-25T09:06:43.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.501+0000 7fe6a0a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe69c145250 0x7fe69c0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.501+0000 7fe6a0a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe69c145250 0x7fe69c0cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59142/0 (socket says 172.21.15.175:59142) 2024-04-25T09:06:43.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.501+0000 7fe6a0a00640 1 -- 172.21.15.175:0/2124769565 learned_addr learned my addr 172.21.15.175:0/2124769565 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:43.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.501+0000 7fe6a1400640 1 --2- 172.21.15.175:0/2124769565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe69c0ce970 0x7fe69c0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.501+0000 7fe6a0a00640 1 -- 172.21.15.175:0/2124769565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe69c0ce970 msgr2=0x7fe69c0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:43.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.501+0000 7fe6a0a00640 1 --2- 172.21.15.175:0/2124769565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe69c0ce970 0x7fe69c0cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.501+0000 7fe6a0a00640 1 -- 172.21.15.175:0/2124769565 >> v1:172.21.15.177:6789/0 conn(0x7fe69c1600a0 legacy=0x7fe69c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.501+0000 7fe6a0a00640 1 -- 172.21.15.175:0/2124769565 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c15f8a0 con 0x7fe69c145250 2024-04-25T09:06:43.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.505+0000 7fe6a0a00640 1 --2- 172.21.15.175:0/2124769565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c145250 0x7fe69c0cf6b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe68c0098a0 tx=0x7fe68c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499c9534e79e926d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:43.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.505+0000 7fe69be00640 1 -- 172.21.15.175:0/2124769565 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c0aa600 con 0x7fe69c145250 2024-04-25T09:06:43.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.505+0000 7fe69be00640 1 -- 172.21.15.175:0/2124769565 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68c0af070 con 0x7fe69c145250 2024-04-25T09:06:43.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.505+0000 7fe69be00640 1 -- 172.21.15.175:0/2124769565 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68c0aa9c0 con 0x7fe69c145250 2024-04-25T09:06:43.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.505+0000 7fe6a3400640 1 -- 172.21.15.175:0/2124769565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c145250 msgr2=0x7fe69c0cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.505+0000 7fe6a3400640 1 --2- 172.21.15.175:0/2124769565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c145250 0x7fe69c0cf6b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe68c0098a0 tx=0x7fe68c01c480 comp rx=0 tx=0).stop 2024-04-25T09:06:43.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.505+0000 7fe6a3400640 1 -- 172.21.15.175:0/2124769565 shutdown_connections 2024-04-25T09:06:43.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.505+0000 7fe6a3400640 1 --2- 172.21.15.175:0/2124769565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe69c0ce970 0x7fe69c0cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.505+0000 7fe6a3400640 1 --2- 172.21.15.175:0/2124769565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c145250 0x7fe69c0cf6b0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.505+0000 7fe6a3400640 1 -- 172.21.15.175:0/2124769565 >> 172.21.15.175:0/2124769565 conn(0x7fe69c06ac50 msgr2=0x7fe69c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:43.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.505+0000 7fe6a3400640 1 -- 172.21.15.175:0/2124769565 shutdown_connections 2024-04-25T09:06:43.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.505+0000 7fe6a3400640 1 -- 172.21.15.175:0/2124769565 wait complete. 2024-04-25T09:06:43.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.505+0000 7fe6a3400640 1 Processor -- start 2024-04-25T09:06:43.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.505+0000 7fe6a3400640 1 -- start start 2024-04-25T09:06:43.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe6a3400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe69c0ce970 0x7fe69c13e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe6a3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c145250 0x7fe69c0b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe6a3400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe69c1600a0 0x7fe69c1f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe6a3400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c15c870 con 0x7fe69c145250 2024-04-25T09:06:43.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe6a3400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c1604b0 con 0x7fe69c1600a0 2024-04-25T09:06:43.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe6a3400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe69c15c9f0 con 0x7fe69c0ce970 2024-04-25T09:06:43.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe693e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c145250 0x7fe69c0b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe693e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c145250 0x7fe69c0b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59150/0 (socket says 172.21.15.175:59150) 2024-04-25T09:06:43.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe693e00640 1 -- 172.21.15.175:0/420847482 learned_addr learned my addr 172.21.15.175:0/420847482 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:43.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe6a1400640 1 --2- 172.21.15.175:0/420847482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe69c1600a0 0x7fe69c1f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe6a0a00640 1 --2- 172.21.15.175:0/420847482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe69c0ce970 0x7fe69c13e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe693e00640 1 -- 172.21.15.175:0/420847482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe69c0ce970 msgr2=0x7fe69c13e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe693e00640 1 --2- 172.21.15.175:0/420847482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe69c0ce970 0x7fe69c13e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe693e00640 1 -- 172.21.15.175:0/420847482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe69c1600a0 msgr2=0x7fe69c1f6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:43.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe693e00640 1 --2- 172.21.15.175:0/420847482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe69c1600a0 0x7fe69c1f6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:43.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe693e00640 1 -- 172.21.15.175:0/420847482 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe69c0b2e80 con 0x7fe69c145250 2024-04-25T09:06:43.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe693e00640 1 --2- 172.21.15.175:0/420847482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c145250 0x7fe69c0b3f20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe68400c370 tx=0x7fe68400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:43.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe699600640 1 -- 172.21.15.175:0/420847482 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6840052d0 con 0x7fe69c145250 2024-04-25T09:06:43.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe699600640 1 -- 172.21.15.175:0/420847482 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe684005470 con 0x7fe69c145250 2024-04-25T09:06:43.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe699600640 1 -- 172.21.15.175:0/420847482 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe684007260 con 0x7fe69c145250 2024-04-25T09:06:43.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe6a3400640 1 -- 172.21.15.175:0/420847482 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe69c0b3160 con 0x7fe69c145250 2024-04-25T09:06:43.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe6a3400640 1 -- 172.21.15.175:0/420847482 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe69c0b3720 con 0x7fe69c145250 2024-04-25T09:06:43.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.509+0000 7fe6a3400640 1 -- 172.21.15.175:0/420847482 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe69c075160 con 0x7fe69c145250 2024-04-25T09:06:43.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.513+0000 7fe699600640 1 -- 172.21.15.175:0/420847482 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe684007400 con 0x7fe69c145250 2024-04-25T09:06:43.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.513+0000 7fe699600640 1 --2- 172.21.15.175:0/420847482 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe678066f60 0x7fe678069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:43.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.513+0000 7fe699600640 1 -- 172.21.15.175:0/420847482 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fe684084910 con 0x7fe69c145250 2024-04-25T09:06:43.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.513+0000 7fe6a0a00640 1 --2- 172.21.15.175:0/420847482 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe678066f60 0x7fe678069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:43.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.513+0000 7fe6a0a00640 1 --2- 172.21.15.175:0/420847482 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe678066f60 0x7fe678069420 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe68c0ae000 tx=0x7fe68c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:43.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.517+0000 7fe699600640 1 -- 172.21.15.175:0/420847482 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe684055310 con 0x7fe69c145250 2024-04-25T09:06:43.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:43.701+0000 7fe6a3400640 1 -- 172.21.15.175:0/420847482 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe69c0b10a0 con 0x7fe69c145250 2024-04-25T09:06:44.348 INFO:teuthology.orchestra.run.smithi175.stderr:new fs with metadata pool 8 and data pool 9 2024-04-25T09:06:44.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.353+0000 7fe699600640 1 -- 172.21.15.175:0/420847482 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v29) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe6840593b0 con 0x7fe69c145250 2024-04-25T09:06:44.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.361+0000 7fe6a3400640 1 -- 172.21.15.175:0/420847482 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe678066f60 msgr2=0x7fe678069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.361+0000 7fe6a3400640 1 --2- 172.21.15.175:0/420847482 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe678066f60 0x7fe678069420 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe68c0ae000 tx=0x7fe68c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:44.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.361+0000 7fe6a3400640 1 -- 172.21.15.175:0/420847482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c145250 msgr2=0x7fe69c0b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.361+0000 7fe6a3400640 1 --2- 172.21.15.175:0/420847482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c145250 0x7fe69c0b3f20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe68400c370 tx=0x7fe68400c830 comp rx=0 tx=0).stop 2024-04-25T09:06:44.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.361+0000 7fe6a3400640 1 -- 172.21.15.175:0/420847482 shutdown_connections 2024-04-25T09:06:44.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.361+0000 7fe6a3400640 1 --2- 172.21.15.175:0/420847482 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe678066f60 0x7fe678069420 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.361+0000 7fe6a3400640 1 --2- 172.21.15.175:0/420847482 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe69c1600a0 0x7fe69c1f6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.361+0000 7fe6a3400640 1 --2- 172.21.15.175:0/420847482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe69c145250 0x7fe69c0b3f20 secure :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe68400c370 tx=0x7fe68400c830 comp rx=0 tx=0).stop 2024-04-25T09:06:44.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.361+0000 7fe6a3400640 1 --2- 172.21.15.175:0/420847482 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe69c0ce970 0x7fe69c13e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.361+0000 7fe6a3400640 1 -- 172.21.15.175:0/420847482 >> 172.21.15.175:0/420847482 conn(0x7fe69c06ac50 msgr2=0x7fe69c0af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:44.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.369+0000 7fe6a3400640 1 -- 172.21.15.175:0/420847482 shutdown_connections 2024-04-25T09:06:44.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.369+0000 7fe6a3400640 1 -- 172.21.15.175:0/420847482 wait complete. 2024-04-25T09:06:44.392 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:44.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.537+0000 7f5ad0400640 1 Processor -- start 2024-04-25T09:06:44.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.537+0000 7f5ad0400640 1 -- start start 2024-04-25T09:06:44.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.541+0000 7f5ad0400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5ac8144fc0 0x7f5ac80cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.541+0000 7f5ad0400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ac81453a0 0x7f5ac815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.541+0000 7f5ad0400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5ac80cc3b0 0x7f5ac815c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.541+0000 7f5ad0400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac815cd00 con 0x7f5ac8144fc0 2024-04-25T09:06:44.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.541+0000 7f5ad0400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac80ce660 con 0x7f5ac80cc3b0 2024-04-25T09:06:44.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.541+0000 7f5ad0400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac80cc930 con 0x7f5ac81453a0 2024-04-25T09:06:44.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.541+0000 7f5acda00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5ac8144fc0 0x7f5ac80cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.541+0000 7f5acda00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5ac8144fc0 0x7f5ac80cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59162/0 (socket says 172.21.15.175:59162) 2024-04-25T09:06:44.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.541+0000 7f5acda00640 1 -- 172.21.15.175:0/3550540009 learned_addr learned my addr 172.21.15.175:0/3550540009 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:44.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.541+0000 7f5ace400640 1 --2- 172.21.15.175:0/3550540009 >> v2:172.21.15.177:3300/0 conn(0x7f5ac80cc3b0 0x7f5ac815c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.541+0000 7f5acd000640 1 --2- 172.21.15.175:0/3550540009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ac81453a0 0x7f5ac815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.541+0000 7f5acda00640 1 -- 172.21.15.175:0/3550540009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ac81453a0 msgr2=0x7f5ac815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:44.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.541+0000 7f5acda00640 1 --2- 172.21.15.175:0/3550540009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ac81453a0 0x7f5ac815bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.541+0000 7f5acda00640 1 -- 172.21.15.175:0/3550540009 >> v2:172.21.15.177:3300/0 conn(0x7f5ac80cc3b0 msgr2=0x7f5ac815c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:44.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.541+0000 7f5acda00640 1 --2- 172.21.15.175:0/3550540009 >> v2:172.21.15.177:3300/0 conn(0x7f5ac80cc3b0 0x7f5ac815c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.541+0000 7f5acda00640 1 -- 172.21.15.175:0/3550540009 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac80ccc10 con 0x7f5ac8144fc0 2024-04-25T09:06:44.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.545+0000 7f5acda00640 1 --2- 172.21.15.175:0/3550540009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac8144fc0 0x7f5ac80cbe70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5ac806f610 tx=0x7f5abc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf963d7462e3c699 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:44.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.545+0000 7f5ac7e00640 1 -- 172.21.15.175:0/3550540009 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0a5780 con 0x7f5ac8144fc0 2024-04-25T09:06:44.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.545+0000 7f5ac7e00640 1 -- 172.21.15.175:0/3550540009 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc0a5920 con 0x7f5ac8144fc0 2024-04-25T09:06:44.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.545+0000 7f5ac7e00640 1 -- 172.21.15.175:0/3550540009 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc0a5cf0 con 0x7f5ac8144fc0 2024-04-25T09:06:44.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.545+0000 7f5ad0400640 1 -- 172.21.15.175:0/3550540009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac8144fc0 msgr2=0x7f5ac80cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.545+0000 7f5ad0400640 1 --2- 172.21.15.175:0/3550540009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac8144fc0 0x7f5ac80cbe70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5ac806f610 tx=0x7f5abc01c9f0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.545+0000 7f5ad0400640 1 -- 172.21.15.175:0/3550540009 shutdown_connections 2024-04-25T09:06:44.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.545+0000 7f5ad0400640 1 --2- 172.21.15.175:0/3550540009 >> v2:172.21.15.177:3300/0 conn(0x7f5ac80cc3b0 0x7f5ac815c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.545+0000 7f5ad0400640 1 --2- 172.21.15.175:0/3550540009 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ac81453a0 0x7f5ac815bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.545+0000 7f5ad0400640 1 --2- 172.21.15.175:0/3550540009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac8144fc0 0x7f5ac80cbe70 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.545+0000 7f5ad0400640 1 -- 172.21.15.175:0/3550540009 >> 172.21.15.175:0/3550540009 conn(0x7f5ac8067150 msgr2=0x7f5ac806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:44.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.545+0000 7f5ad0400640 1 -- 172.21.15.175:0/3550540009 shutdown_connections 2024-04-25T09:06:44.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.545+0000 7f5ad0400640 1 -- 172.21.15.175:0/3550540009 wait complete. 2024-04-25T09:06:44.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.545+0000 7f5ad0400640 1 Processor -- start 2024-04-25T09:06:44.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.545+0000 7f5ad0400640 1 -- start start 2024-04-25T09:06:44.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5ad0400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac8144fc0 0x7f5ac813b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5ad0400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac81453a0 0x7f5ac813ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5ad0400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ac80b1e30 0x7f5ac815cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5ad0400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac8160020 con 0x7f5ac81453a0 2024-04-25T09:06:44.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5ad0400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac815fea0 con 0x7f5ac8144fc0 2024-04-25T09:06:44.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5ad0400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac81601a0 con 0x7f5ac80b1e30 2024-04-25T09:06:44.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5acd000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac81453a0 0x7f5ac813ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5acd000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac81453a0 0x7f5ac813ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59170/0 (socket says 172.21.15.175:59170) 2024-04-25T09:06:44.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5acd000640 1 -- 172.21.15.175:0/2003965691 learned_addr learned my addr 172.21.15.175:0/2003965691 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:44.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5acda00640 1 --2- 172.21.15.175:0/2003965691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac8144fc0 0x7f5ac813b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5ace400640 1 --2- 172.21.15.175:0/2003965691 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ac80b1e30 0x7f5ac815cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5acd000640 1 -- 172.21.15.175:0/2003965691 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ac80b1e30 msgr2=0x7f5ac815cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5acd000640 1 --2- 172.21.15.175:0/2003965691 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ac80b1e30 0x7f5ac815cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5acd000640 1 -- 172.21.15.175:0/2003965691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac8144fc0 msgr2=0x7f5ac813b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5acd000640 1 --2- 172.21.15.175:0/2003965691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac8144fc0 0x7f5ac813b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5acd000640 1 -- 172.21.15.175:0/2003965691 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac8143be0 con 0x7f5ac81453a0 2024-04-25T09:06:44.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5acd000640 1 --2- 172.21.15.175:0/2003965691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac81453a0 0x7f5ac813ba80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400d5f0 tx=0x7f5ab400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:44.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5ac5600640 1 -- 172.21.15.175:0/2003965691 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40125f0 con 0x7f5ac81453a0 2024-04-25T09:06:44.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5ac5600640 1 -- 172.21.15.175:0/2003965691 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab4019070 con 0x7f5ac81453a0 2024-04-25T09:06:44.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5ac5600640 1 -- 172.21.15.175:0/2003965691 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40129b0 con 0x7f5ac81453a0 2024-04-25T09:06:44.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5ad0400640 1 -- 172.21.15.175:0/2003965691 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac80af3b0 con 0x7f5ac81453a0 2024-04-25T09:06:44.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5ad0400640 1 -- 172.21.15.175:0/2003965691 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac815d4c0 con 0x7f5ac81453a0 2024-04-25T09:06:44.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5ad0400640 1 -- 172.21.15.175:0/2003965691 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac8074a60 con 0x7f5ac81453a0 2024-04-25T09:06:44.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.549+0000 7f5ac5600640 1 -- 172.21.15.175:0/2003965691 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5ab4012b50 con 0x7f5ac81453a0 2024-04-25T09:06:44.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.553+0000 7f5ac5600640 1 --2- 172.21.15.175:0/2003965691 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5aa8066f90 0x7f5aa8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.553+0000 7f5ac5600640 1 -- 172.21.15.175:0/2003965691 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ab40852d0 con 0x7f5ac81453a0 2024-04-25T09:06:44.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.553+0000 7f5acda00640 1 --2- 172.21.15.175:0/2003965691 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5aa8066f90 0x7f5aa8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.553+0000 7f5acda00640 1 --2- 172.21.15.175:0/2003965691 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5aa8066f90 0x7f5aa8069450 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0ae000 tx=0x7f5abc0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:44.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.557+0000 7f5ac5600640 1 -- 172.21.15.175:0/2003965691 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5ab4056370 con 0x7f5ac81453a0 2024-04-25T09:06:44.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.713+0000 7f5ad0400640 1 -- 172.21.15.175:0/2003965691 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ac8140840 con 0x7f5ac81453a0 2024-04-25T09:06:44.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.717+0000 7f5ac5600640 1 -- 172.21.15.175:0/2003965691 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16714 (secure 0 0 0) 0x7f5ab4055c70 con 0x7f5ac81453a0 2024-04-25T09:06:44.705 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:44.705 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":57,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:06:43.704453+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:41.465085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:42.715758+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:44.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.717+0000 7f5ad0400640 1 -- 172.21.15.175:0/2003965691 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5aa8066f90 msgr2=0x7f5aa8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.717+0000 7f5ad0400640 1 --2- 172.21.15.175:0/2003965691 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5aa8066f90 0x7f5aa8069450 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0ae000 tx=0x7f5abc0a7070 comp rx=0 tx=0).stop 2024-04-25T09:06:44.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.717+0000 7f5ad0400640 1 -- 172.21.15.175:0/2003965691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac81453a0 msgr2=0x7f5ac813ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.717+0000 7f5ad0400640 1 --2- 172.21.15.175:0/2003965691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac81453a0 0x7f5ac813ba80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400d5f0 tx=0x7f5ab400dab0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.717+0000 7f5ad0400640 1 -- 172.21.15.175:0/2003965691 shutdown_connections 2024-04-25T09:06:44.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.717+0000 7f5ad0400640 1 --2- 172.21.15.175:0/2003965691 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5aa8066f90 0x7f5aa8069450 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.717+0000 7f5ad0400640 1 --2- 172.21.15.175:0/2003965691 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ac80b1e30 0x7f5ac815cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.717+0000 7f5ad0400640 1 --2- 172.21.15.175:0/2003965691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ac81453a0 0x7f5ac813ba80 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.717+0000 7f5ad0400640 1 --2- 172.21.15.175:0/2003965691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ac8144fc0 0x7f5ac813b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.717+0000 7f5ad0400640 1 -- 172.21.15.175:0/2003965691 >> 172.21.15.175:0/2003965691 conn(0x7f5ac80cc3b0 msgr2=0x7f5ac813c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:44.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.717+0000 7f5ad0400640 1 -- 172.21.15.175:0/2003965691 shutdown_connections 2024-04-25T09:06:44.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.717+0000 7f5ad0400640 1 -- 172.21.15.175:0/2003965691 wait complete. 2024-04-25T09:06:44.727 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:44.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.873+0000 7f4553200640 1 Processor -- start 2024-04-25T09:06:44.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.873+0000 7f4553200640 1 -- start start 2024-04-25T09:06:44.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.873+0000 7f4553200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f454c099a50 0x7f454c0cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.873+0000 7f4553200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f454c15bc10 0x7f454c099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.873+0000 7f4553200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454c09a370 con 0x7f454c09abb0 2024-04-25T09:06:44.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.873+0000 7f4553200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f454c0d06f0 con 0x7f454c099a50 2024-04-25T09:06:44.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.873+0000 7f4553200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0cc4c0 con 0x7f454c15bc10 2024-04-25T09:06:44.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.873+0000 7f454be00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f454c099a50 0x7f454c0cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.873+0000 7f454be00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f454c099a50 0x7f454c0cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59176/0 (socket says 172.21.15.175:59176) 2024-04-25T09:06:44.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.873+0000 7f454be00640 1 -- 172.21.15.175:0/396545191 learned_addr learned my addr 172.21.15.175:0/396545191 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:44.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.873+0000 7f454b400640 1 --2- 172.21.15.175:0/396545191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f454c15bc10 0x7f454c099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.873+0000 7f454be00640 1 -- 172.21.15.175:0/396545191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f454c15bc10 msgr2=0x7f454c099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:44.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.873+0000 7f454be00640 1 --2- 172.21.15.175:0/396545191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f454c15bc10 0x7f454c099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.873+0000 7f454be00640 1 -- 172.21.15.175:0/396545191 >> v1:172.21.15.175:6789/0 conn(0x7f454c09abb0 legacy=0x7f454c0cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.873+0000 7f454be00640 1 -- 172.21.15.175:0/396545191 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c0cc7a0 con 0x7f454c099a50 2024-04-25T09:06:44.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.877+0000 7f454be00640 1 --2- 172.21.15.175:0/396545191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f454c099a50 0x7f454c0cd280 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f453c009870 tx=0x7f453c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f66525b4fbaff96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:44.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.877+0000 7f454aa00640 1 -- 172.21.15.175:0/396545191 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c0a7070 con 0x7f454c099a50 2024-04-25T09:06:44.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.877+0000 7f454aa00640 1 -- 172.21.15.175:0/396545191 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453c0b0070 con 0x7f454c099a50 2024-04-25T09:06:44.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.877+0000 7f454aa00640 1 -- 172.21.15.175:0/396545191 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c0ab890 con 0x7f454c099a50 2024-04-25T09:06:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.877+0000 7f4553200640 1 -- 172.21.15.175:0/396545191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f454c099a50 msgr2=0x7f454c0cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.877+0000 7f4553200640 1 --2- 172.21.15.175:0/396545191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f454c099a50 0x7f454c0cd280 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f453c009870 tx=0x7f453c01c560 comp rx=0 tx=0).stop 2024-04-25T09:06:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.877+0000 7f4553200640 1 -- 172.21.15.175:0/396545191 shutdown_connections 2024-04-25T09:06:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.877+0000 7f4553200640 1 --2- 172.21.15.175:0/396545191 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f454c15bc10 0x7f454c099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.877+0000 7f4553200640 1 --2- 172.21.15.175:0/396545191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f454c099a50 0x7f454c0cd280 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.877+0000 7f4553200640 1 -- 172.21.15.175:0/396545191 >> 172.21.15.175:0/396545191 conn(0x7f454c0b3300 msgr2=0x7f454c0b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.877+0000 7f4553200640 1 -- 172.21.15.175:0/396545191 shutdown_connections 2024-04-25T09:06:44.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.877+0000 7f4553200640 1 -- 172.21.15.175:0/396545191 wait complete. 2024-04-25T09:06:44.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4553200640 1 Processor -- start 2024-04-25T09:06:44.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4553200640 1 -- start start 2024-04-25T09:06:44.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4553200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f454c099a50 0x7f454c150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4553200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f454c09abb0 0x7f454c0c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4553200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f454c15bc10 0x7f454c154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4553200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0c5f00 con 0x7f454c15bc10 2024-04-25T09:06:44.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4553200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0c5d80 con 0x7f454c09abb0 2024-04-25T09:06:44.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4553200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c168850 con 0x7f454c099a50 2024-04-25T09:06:44.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4551200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f454c15bc10 0x7f454c154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4551200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f454c15bc10 0x7f454c154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59184/0 (socket says 172.21.15.175:59184) 2024-04-25T09:06:44.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4551200640 1 -- 172.21.15.175:0/2693787971 learned_addr learned my addr 172.21.15.175:0/2693787971 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:44.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f454be00640 1 --2- 172.21.15.175:0/2693787971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f454c099a50 0x7f454c150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f454b400640 1 --2- 172.21.15.175:0/2693787971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f454c09abb0 0x7f454c0c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4551200640 1 -- 172.21.15.175:0/2693787971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f454c099a50 msgr2=0x7f454c150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4551200640 1 --2- 172.21.15.175:0/2693787971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f454c099a50 0x7f454c150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4551200640 1 -- 172.21.15.175:0/2693787971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f454c09abb0 msgr2=0x7f454c0c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:44.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4551200640 1 --2- 172.21.15.175:0/2693787971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f454c09abb0 0x7f454c0c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:44.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4551200640 1 -- 172.21.15.175:0/2693787971 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c151460 con 0x7f454c15bc10 2024-04-25T09:06:44.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4551200640 1 --2- 172.21.15.175:0/2693787971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f454c15bc10 0x7f454c154f80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f454400c770 tx=0x7f454400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:44.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4543e00640 1 -- 172.21.15.175:0/2693787971 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544003b80 con 0x7f454c15bc10 2024-04-25T09:06:44.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4543e00640 1 -- 172.21.15.175:0/2693787971 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4544003d20 con 0x7f454c15bc10 2024-04-25T09:06:44.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4553200640 1 -- 172.21.15.175:0/2693787971 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454c155c00 con 0x7f454c15bc10 2024-04-25T09:06:44.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4543e00640 1 -- 172.21.15.175:0/2693787971 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454400aa90 con 0x7f454c15bc10 2024-04-25T09:06:44.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.881+0000 7f4553200640 1 -- 172.21.15.175:0/2693787971 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454c156180 con 0x7f454c15bc10 2024-04-25T09:06:44.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.885+0000 7f4553200640 1 -- 172.21.15.175:0/2693787971 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454c074a60 con 0x7f454c15bc10 2024-04-25T09:06:44.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.885+0000 7f4543e00640 1 -- 172.21.15.175:0/2693787971 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f454400ac30 con 0x7f454c15bc10 2024-04-25T09:06:44.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.885+0000 7f4543e00640 1 --2- 172.21.15.175:0/2693787971 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f452c066f60 0x7f452c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:44.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.885+0000 7f4543e00640 1 -- 172.21.15.175:0/2693787971 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4544084e30 con 0x7f454c15bc10 2024-04-25T09:06:44.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.885+0000 7f454be00640 1 --2- 172.21.15.175:0/2693787971 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f452c066f60 0x7f452c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:44.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.885+0000 7f454be00640 1 --2- 172.21.15.175:0/2693787971 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f452c066f60 0x7f452c069420 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f453c0af000 tx=0x7f453c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:44.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:44.889+0000 7f4543e00640 1 -- 172.21.15.175:0/2693787971 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f45440557f0 con 0x7f454c15bc10 2024-04-25T09:06:45.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.045+0000 7f4553200640 1 -- 172.21.15.175:0/2693787971 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f454c0cdc40 con 0x7f454c15bc10 2024-04-25T09:06:45.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.045+0000 7f4543e00640 1 -- 172.21.15.175:0/2693787971 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16714 (secure 0 0 0) 0x7f4544059890 con 0x7f454c15bc10 2024-04-25T09:06:45.035 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:45.035 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":57,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:06:43.704453+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:41.465085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:42.715758+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:45.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.049+0000 7f4553200640 1 -- 172.21.15.175:0/2693787971 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f452c066f60 msgr2=0x7f452c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.049+0000 7f4553200640 1 --2- 172.21.15.175:0/2693787971 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f452c066f60 0x7f452c069420 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f453c0af000 tx=0x7f453c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:45.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.049+0000 7f4553200640 1 -- 172.21.15.175:0/2693787971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f454c15bc10 msgr2=0x7f454c154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.049+0000 7f4553200640 1 --2- 172.21.15.175:0/2693787971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f454c15bc10 0x7f454c154f80 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f454400c770 tx=0x7f454400cc30 comp rx=0 tx=0).stop 2024-04-25T09:06:45.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.049+0000 7f4553200640 1 -- 172.21.15.175:0/2693787971 shutdown_connections 2024-04-25T09:06:45.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.049+0000 7f4553200640 1 --2- 172.21.15.175:0/2693787971 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f452c066f60 0x7f452c069420 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.049+0000 7f4553200640 1 --2- 172.21.15.175:0/2693787971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f454c15bc10 0x7f454c154f80 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.049+0000 7f4553200640 1 --2- 172.21.15.175:0/2693787971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f454c09abb0 0x7f454c0c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.049+0000 7f4553200640 1 --2- 172.21.15.175:0/2693787971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f454c099a50 0x7f454c150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.049+0000 7f4553200640 1 -- 172.21.15.175:0/2693787971 >> 172.21.15.175:0/2693787971 conn(0x7f454c0b3300 msgr2=0x7f454c15a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:45.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.049+0000 7f4553200640 1 -- 172.21.15.175:0/2693787971 shutdown_connections 2024-04-25T09:06:45.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.049+0000 7f4553200640 1 -- 172.21.15.175:0/2693787971 wait complete. 2024-04-25T09:06:45.056 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:06:45.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.205+0000 7fb858a00640 1 Processor -- start 2024-04-25T09:06:45.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.205+0000 7fb858a00640 1 -- start start 2024-04-25T09:06:45.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.205+0000 7fb858a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb8540cbe60 0x7fb85415af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.205+0000 7fb858a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb85406d310 0x7fb8540b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.205+0000 7fb858a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85406db60 con 0x7fb8540b4630 2024-04-25T09:06:45.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.205+0000 7fb858a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8540b4aa0 con 0x7fb85406d310 2024-04-25T09:06:45.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.205+0000 7fb858a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85406de40 con 0x7fb8540cbe60 2024-04-25T09:06:45.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.205+0000 7fb851400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb85406d310 0x7fb8540b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:45.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.205+0000 7fb851400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb85406d310 0x7fb8540b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59194/0 (socket says 172.21.15.175:59194) 2024-04-25T09:06:45.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.205+0000 7fb851400640 1 -- 172.21.15.175:0/2798006815 learned_addr learned my addr 172.21.15.175:0/2798006815 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:45.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.205+0000 7fb852800640 1 --1- 172.21.15.175:0/2798006815 >> v1:172.21.15.175:6789/0 conn(0x7fb8540b4630 0x7fb8540b2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45566/0 (socket says 172.21.15.175:45566) 2024-04-25T09:06:45.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.205+0000 7fb851e00640 1 --2- 172.21.15.175:0/2798006815 >> v2:172.21.15.177:3300/0 conn(0x7fb8540cbe60 0x7fb85415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:45.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.205+0000 7fb851400640 1 -- 172.21.15.175:0/2798006815 >> v2:172.21.15.177:3300/0 conn(0x7fb8540cbe60 msgr2=0x7fb85415af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:45.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.205+0000 7fb851400640 1 --2- 172.21.15.175:0/2798006815 >> v2:172.21.15.177:3300/0 conn(0x7fb8540cbe60 0x7fb85415af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.205+0000 7fb851400640 1 -- 172.21.15.175:0/2798006815 >> v1:172.21.15.175:6789/0 conn(0x7fb8540b4630 legacy=0x7fb8540b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.205+0000 7fb851400640 1 -- 172.21.15.175:0/2798006815 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85406e120 con 0x7fb85406d310 2024-04-25T09:06:45.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.205+0000 7fb850a00640 1 -- 172.21.15.175:0/2798006815 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772711273 0 0) 0x7fb85406db60 con 0x7fb8540b4630 2024-04-25T09:06:45.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.209+0000 7fb851400640 1 --2- 172.21.15.175:0/2798006815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85406d310 0x7fb8540b40f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb8540b4d50 tx=0x7fb84001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1878a314ce533dd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:45.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.209+0000 7fb850a00640 1 -- 172.21.15.175:0/2798006815 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400ab430 con 0x7fb85406d310 2024-04-25T09:06:45.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.209+0000 7fb850a00640 1 -- 172.21.15.175:0/2798006815 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8400b0070 con 0x7fb85406d310 2024-04-25T09:06:45.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.209+0000 7fb850a00640 1 -- 172.21.15.175:0/2798006815 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400ab7f0 con 0x7fb85406d310 2024-04-25T09:06:45.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.209+0000 7fb858a00640 1 -- 172.21.15.175:0/2798006815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85406d310 msgr2=0x7fb8540b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.209+0000 7fb858a00640 1 --2- 172.21.15.175:0/2798006815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85406d310 0x7fb8540b40f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb8540b4d50 tx=0x7fb84001c520 comp rx=0 tx=0).stop 2024-04-25T09:06:45.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.209+0000 7fb858a00640 1 -- 172.21.15.175:0/2798006815 shutdown_connections 2024-04-25T09:06:45.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.209+0000 7fb858a00640 1 --2- 172.21.15.175:0/2798006815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85406d310 0x7fb8540b40f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.209+0000 7fb858a00640 1 --2- 172.21.15.175:0/2798006815 >> v2:172.21.15.177:3300/0 conn(0x7fb8540cbe60 0x7fb85415af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.209+0000 7fb858a00640 1 -- 172.21.15.175:0/2798006815 >> 172.21.15.175:0/2798006815 conn(0x7fb85406ac50 msgr2=0x7fb85406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:45.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.209+0000 7fb858a00640 1 -- 172.21.15.175:0/2798006815 shutdown_connections 2024-04-25T09:06:45.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.209+0000 7fb858a00640 1 -- 172.21.15.175:0/2798006815 wait complete. 2024-04-25T09:06:45.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb858a00640 1 Processor -- start 2024-04-25T09:06:45.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb858a00640 1 -- start start 2024-04-25T09:06:45.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb858a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85406d310 0x7fb8540cf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb858a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8540b4630 0x7fb854154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb858a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8540cbe60 0x7fb854159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb858a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb854167560 con 0x7fb85406d310 2024-04-25T09:06:45.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb858a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8540cc450 con 0x7fb8540cbe60 2024-04-25T09:06:45.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb858a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8541676e0 con 0x7fb8540b4630 2024-04-25T09:06:45.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb851e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85406d310 0x7fb8540cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:45.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb851e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85406d310 0x7fb8540cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59204/0 (socket says 172.21.15.175:59204) 2024-04-25T09:06:45.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb851e00640 1 -- 172.21.15.175:0/306838027 learned_addr learned my addr 172.21.15.175:0/306838027 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:45.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb852800640 1 --2- 172.21.15.175:0/306838027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8540cbe60 0x7fb854159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:45.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb851400640 1 --2- 172.21.15.175:0/306838027 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8540b4630 0x7fb854154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:45.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb851e00640 1 -- 172.21.15.175:0/306838027 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8540b4630 msgr2=0x7fb854154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb851e00640 1 --2- 172.21.15.175:0/306838027 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8540b4630 0x7fb854154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb851e00640 1 -- 172.21.15.175:0/306838027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8540cbe60 msgr2=0x7fb854159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:45.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb851e00640 1 --2- 172.21.15.175:0/306838027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8540cbe60 0x7fb854159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:45.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb851e00640 1 -- 172.21.15.175:0/306838027 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8540ad370 con 0x7fb85406d310 2024-04-25T09:06:45.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb851400640 1 --2- 172.21.15.175:0/306838027 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8540b4630 0x7fb854154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:45.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb851e00640 1 --2- 172.21.15.175:0/306838027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85406d310 0x7fb8540cf420 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb84400e870 tx=0x7fb84400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:45.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb84a000640 1 -- 172.21.15.175:0/306838027 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844017070 con 0x7fb85406d310 2024-04-25T09:06:45.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb84a000640 1 -- 172.21.15.175:0/306838027 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84400c940 con 0x7fb85406d310 2024-04-25T09:06:45.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb84a000640 1 -- 172.21.15.175:0/306838027 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84400ccf0 con 0x7fb85406d310 2024-04-25T09:06:45.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb858a00640 1 -- 172.21.15.175:0/306838027 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb854155330 con 0x7fb85406d310 2024-04-25T09:06:45.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.213+0000 7fb858a00640 1 -- 172.21.15.175:0/306838027 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8540ad8c0 con 0x7fb85406d310 2024-04-25T09:06:45.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.217+0000 7fb858a00640 1 -- 172.21.15.175:0/306838027 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb854075160 con 0x7fb85406d310 2024-04-25T09:06:45.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.217+0000 7fb84a000640 1 -- 172.21.15.175:0/306838027 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb84401a070 con 0x7fb85406d310 2024-04-25T09:06:45.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.217+0000 7fb84a000640 1 --2- 172.21.15.175:0/306838027 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb834066f60 0x7fb834069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:45.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.217+0000 7fb84a000640 1 -- 172.21.15.175:0/306838027 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb844084eb0 con 0x7fb85406d310 2024-04-25T09:06:45.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.217+0000 7fb851400640 1 --2- 172.21.15.175:0/306838027 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb834066f60 0x7fb834069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:45.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.217+0000 7fb851400640 1 --2- 172.21.15.175:0/306838027 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb834066f60 0x7fb834069420 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb8400af000 tx=0x7fb8400a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:45.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.221+0000 7fb84a000640 1 -- 172.21.15.175:0/306838027 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb8440557d0 con 0x7fb85406d310 2024-04-25T09:06:45.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:45.413+0000 7fb858a00640 1 -- 172.21.15.175:0/306838027 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb8540cd850 con 0x7fb85406d310 2024-04-25T09:06:46.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.369+0000 7fb84a000640 1 -- 172.21.15.175:0/306838027 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb844059870 con 0x7fb85406d310 2024-04-25T09:06:46.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.373+0000 7fb858a00640 1 -- 172.21.15.175:0/306838027 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb834066f60 msgr2=0x7fb834069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:46.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.373+0000 7fb858a00640 1 --2- 172.21.15.175:0/306838027 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb834066f60 0x7fb834069420 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb8400af000 tx=0x7fb8400a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:46.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.373+0000 7fb858a00640 1 -- 172.21.15.175:0/306838027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85406d310 msgr2=0x7fb8540cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:46.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.373+0000 7fb858a00640 1 --2- 172.21.15.175:0/306838027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85406d310 0x7fb8540cf420 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb84400e870 tx=0x7fb84400ec70 comp rx=0 tx=0).stop 2024-04-25T09:06:46.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.373+0000 7fb858a00640 1 -- 172.21.15.175:0/306838027 shutdown_connections 2024-04-25T09:06:46.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.373+0000 7fb858a00640 1 --2- 172.21.15.175:0/306838027 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb834066f60 0x7fb834069420 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.373+0000 7fb858a00640 1 --2- 172.21.15.175:0/306838027 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8540cbe60 0x7fb854159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.373+0000 7fb858a00640 1 --2- 172.21.15.175:0/306838027 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8540b4630 0x7fb854154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.373+0000 7fb858a00640 1 --2- 172.21.15.175:0/306838027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb85406d310 0x7fb8540cf420 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.373+0000 7fb858a00640 1 -- 172.21.15.175:0/306838027 >> 172.21.15.175:0/306838027 conn(0x7fb85406ac50 msgr2=0x7fb854071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:46.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.373+0000 7fb858a00640 1 -- 172.21.15.175:0/306838027 shutdown_connections 2024-04-25T09:06:46.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.373+0000 7fb858a00640 1 -- 172.21.15.175:0/306838027 wait complete. 2024-04-25T09:06:46.382 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:06:46.382 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:06:46.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.533+0000 7f6f1da00640 1 Processor -- start 2024-04-25T09:06:46.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.533+0000 7f6f1da00640 1 -- start start 2024-04-25T09:06:46.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.533+0000 7f6f1da00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f180cbe60 0x7f6f1815af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.533+0000 7f6f1da00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f1806db60 con 0x7f6f180b4800 2024-04-25T09:06:46.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.533+0000 7f6f1da00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f1806de40 con 0x7f6f1806d310 2024-04-25T09:06:46.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.533+0000 7f6f1da00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1806e120 con 0x7f6f180cbe60 2024-04-25T09:06:46.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.533+0000 7f6f17400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f6f180b4800 0x7f6f1815c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45578/0 (socket says 172.21.15.175:45578) 2024-04-25T09:06:46.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.533+0000 7f6f17400640 1 -- 172.21.15.175:0/2966084 learned_addr learned my addr 172.21.15.175:0/2966084 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:46.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.533+0000 7f6f16a00640 1 --2- 172.21.15.175:0/2966084 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f180cbe60 0x7f6f1815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.533+0000 7f6f16000640 1 -- 172.21.15.175:0/2966084 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952781089 0 0) 0x7f6f1806db60 con 0x7f6f180b4800 2024-04-25T09:06:46.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.533+0000 7f6f16000640 1 -- 172.21.15.175:0/2966084 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6efc003530 con 0x7f6f180b4800 2024-04-25T09:06:46.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.533+0000 7f6f16000640 1 -- 172.21.15.175:0/2966084 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476208033 0 0) 0x7f6f1806de40 con 0x7f6f1806d310 2024-04-25T09:06:46.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.533+0000 7f6f16000640 1 -- 172.21.15.175:0/2966084 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f1806db60 con 0x7f6f1806d310 2024-04-25T09:06:46.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.533+0000 7f6f16a00640 1 -- 172.21.15.175:0/2966084 >> v1:172.21.15.177:6789/0 conn(0x7f6f1806d310 legacy=0x7f6f180b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:46.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.533+0000 7f6f16a00640 1 -- 172.21.15.175:0/2966084 >> v1:172.21.15.175:6789/0 conn(0x7f6f180b4800 legacy=0x7f6f1815c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:46.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.533+0000 7f6f16a00640 1 -- 172.21.15.175:0/2966084 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1815c2f0 con 0x7f6f180cbe60 2024-04-25T09:06:46.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.537+0000 7f6f16a00640 1 --2- 172.21.15.175:0/2966084 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f180cbe60 0x7f6f1815af20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6f080097f0 tx=0x7f6f0801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5853ace259e3786 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:46.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.537+0000 7f6f16000640 1 -- 172.21.15.175:0/2966084 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f080b0070 con 0x7f6f180cbe60 2024-04-25T09:06:46.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.537+0000 7f6f16000640 1 -- 172.21.15.175:0/2966084 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f080ab600 con 0x7f6f180cbe60 2024-04-25T09:06:46.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.537+0000 7f6f16000640 1 -- 172.21.15.175:0/2966084 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f080ab9d0 con 0x7f6f180cbe60 2024-04-25T09:06:46.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.537+0000 7f6f1da00640 1 -- 172.21.15.175:0/2966084 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f180cbe60 msgr2=0x7f6f1815af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:46.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.537+0000 7f6f1da00640 1 --2- 172.21.15.175:0/2966084 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f180cbe60 0x7f6f1815af20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6f080097f0 tx=0x7f6f0801c4e0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.537+0000 7f6f1da00640 1 -- 172.21.15.175:0/2966084 shutdown_connections 2024-04-25T09:06:46.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.537+0000 7f6f1da00640 1 --2- 172.21.15.175:0/2966084 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f180cbe60 0x7f6f1815af20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.537+0000 7f6f1da00640 1 -- 172.21.15.175:0/2966084 >> 172.21.15.175:0/2966084 conn(0x7f6f1806ac50 msgr2=0x7f6f1806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:46.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.537+0000 7f6f1da00640 1 -- 172.21.15.175:0/2966084 shutdown_connections 2024-04-25T09:06:46.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.537+0000 7f6f1da00640 1 -- 172.21.15.175:0/2966084 wait complete. 2024-04-25T09:06:46.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f1da00640 1 Processor -- start 2024-04-25T09:06:46.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f1da00640 1 -- start start 2024-04-25T09:06:46.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f1da00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f1806d310 0x7f6f18158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f1da00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f180b4800 0x7f6f18148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f1da00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f180cbe60 0x7f6f18155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f1da00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1815db00 con 0x7f6f1806d310 2024-04-25T09:06:46.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f1da00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1815d980 con 0x7f6f180cbe60 2024-04-25T09:06:46.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f1da00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180cc450 con 0x7f6f180b4800 2024-04-25T09:06:46.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f16a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f1806d310 0x7f6f18158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f16a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f1806d310 0x7f6f18158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59210/0 (socket says 172.21.15.175:59210) 2024-04-25T09:06:46.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f16a00640 1 -- 172.21.15.175:0/120322727 learned_addr learned my addr 172.21.15.175:0/120322727 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:46.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f17400640 1 --2- 172.21.15.175:0/120322727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f180cbe60 0x7f6f18155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f0e000640 1 --2- 172.21.15.175:0/120322727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f180b4800 0x7f6f18148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f16a00640 1 -- 172.21.15.175:0/120322727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f180b4800 msgr2=0x7f6f18148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:46.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f16a00640 1 --2- 172.21.15.175:0/120322727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f180b4800 0x7f6f18148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f16a00640 1 -- 172.21.15.175:0/120322727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f180cbe60 msgr2=0x7f6f18155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:46.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f16a00640 1 --2- 172.21.15.175:0/120322727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f180cbe60 0x7f6f18155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:46.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f16a00640 1 -- 172.21.15.175:0/120322727 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f181589e0 con 0x7f6f1806d310 2024-04-25T09:06:46.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f0e000640 1 --2- 172.21.15.175:0/120322727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f180b4800 0x7f6f18148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:46.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f16a00640 1 --2- 172.21.15.175:0/120322727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f1806d310 0x7f6f18158190 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6f080190f0 tx=0x7f6f0801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:46.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f0f400640 1 -- 172.21.15.175:0/120322727 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f080b0050 con 0x7f6f1806d310 2024-04-25T09:06:46.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f0f400640 1 -- 172.21.15.175:0/120322727 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f080bc070 con 0x7f6f1806d310 2024-04-25T09:06:46.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f0f400640 1 -- 172.21.15.175:0/120322727 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f08006e20 con 0x7f6f1806d310 2024-04-25T09:06:46.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f1da00640 1 -- 172.21.15.175:0/120322727 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f18158cc0 con 0x7f6f1806d310 2024-04-25T09:06:46.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f1da00640 1 -- 172.21.15.175:0/120322727 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f18159280 con 0x7f6f1806d310 2024-04-25T09:06:46.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.541+0000 7f6f1da00640 1 -- 172.21.15.175:0/120322727 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f18075160 con 0x7f6f1806d310 2024-04-25T09:06:46.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.545+0000 7f6f0f400640 1 -- 172.21.15.175:0/120322727 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6f080b5870 con 0x7f6f1806d310 2024-04-25T09:06:46.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.545+0000 7f6f0f400640 1 --2- 172.21.15.175:0/120322727 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6ef4066f60 0x7f6ef4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:46.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.545+0000 7f6f0f400640 1 -- 172.21.15.175:0/120322727 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f0811f730 con 0x7f6f1806d310 2024-04-25T09:06:46.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.545+0000 7f6f0e000640 1 --2- 172.21.15.175:0/120322727 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6ef4066f60 0x7f6ef4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:46.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.545+0000 7f6f0e000640 1 --2- 172.21.15.175:0/120322727 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6ef4066f60 0x7f6ef4069420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6f18156ec0 tx=0x7f6f00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:46.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.549+0000 7f6f0f400640 1 -- 172.21.15.175:0/120322727 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6f080160d0 con 0x7f6f1806d310 2024-04-25T09:06:46.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:46.733+0000 7f6f1da00640 1 -- 172.21.15.175:0/120322727 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6f180d03c0 con 0x7f6f1806d310 2024-04-25T09:06:47.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.381+0000 7f6f0f400640 1 -- 172.21.15.175:0/120322727 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6f080f0610 con 0x7f6f1806d310 2024-04-25T09:06:47.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.381+0000 7f6f1da00640 1 -- 172.21.15.175:0/120322727 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6ef4066f60 msgr2=0x7f6ef4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.385+0000 7f6f1da00640 1 --2- 172.21.15.175:0/120322727 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6ef4066f60 0x7f6ef4069420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6f18156ec0 tx=0x7f6f00009040 comp rx=0 tx=0).stop 2024-04-25T09:06:47.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.385+0000 7f6f1da00640 1 -- 172.21.15.175:0/120322727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f1806d310 msgr2=0x7f6f18158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.385+0000 7f6f1da00640 1 --2- 172.21.15.175:0/120322727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f1806d310 0x7f6f18158190 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6f080190f0 tx=0x7f6f0801ad20 comp rx=0 tx=0).stop 2024-04-25T09:06:47.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.385+0000 7f6f1da00640 1 -- 172.21.15.175:0/120322727 shutdown_connections 2024-04-25T09:06:47.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.385+0000 7f6f1da00640 1 --2- 172.21.15.175:0/120322727 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6ef4066f60 0x7f6ef4069420 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.385+0000 7f6f1da00640 1 --2- 172.21.15.175:0/120322727 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f180cbe60 0x7f6f18155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.385+0000 7f6f1da00640 1 --2- 172.21.15.175:0/120322727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f180b4800 0x7f6f18148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.385+0000 7f6f1da00640 1 --2- 172.21.15.175:0/120322727 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f1806d310 0x7f6f18158190 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.385+0000 7f6f1da00640 1 -- 172.21.15.175:0/120322727 >> 172.21.15.175:0/120322727 conn(0x7f6f1806ac50 msgr2=0x7f6f180b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:47.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.385+0000 7f6f1da00640 1 -- 172.21.15.175:0/120322727 shutdown_connections 2024-04-25T09:06:47.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.385+0000 7f6f1da00640 1 -- 172.21.15.175:0/120322727 wait complete. 2024-04-25T09:06:47.397 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:06:47.397 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:47.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.557+0000 7fdd86a00640 1 Processor -- start 2024-04-25T09:06:47.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.557+0000 7fdd86a00640 1 -- start start 2024-04-25T09:06:47.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.557+0000 7fdd86a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd8015db00 0x7fdd8006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.557+0000 7fdd86a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdd800acd90 0x7fdd80161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.557+0000 7fdd86a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8006f280 con 0x7fdd80161c60 2024-04-25T09:06:47.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.557+0000 7fdd86a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd8006acf0 con 0x7fdd800acd90 2024-04-25T09:06:47.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.557+0000 7fdd86a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8006afd0 con 0x7fdd8015db00 2024-04-25T09:06:47.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.557+0000 7fdd7f400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdd800acd90 0x7fdd80161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.557+0000 7fdd84a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fdd80161c60 0x7fdd800b2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45580/0 (socket says 172.21.15.175:45580) 2024-04-25T09:06:47.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.557+0000 7fdd84a00640 1 -- 172.21.15.175:0/1977479464 learned_addr learned my addr 172.21.15.175:0/1977479464 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:47.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.557+0000 7fdd7f400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdd800acd90 0x7fdd80161720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59216/0 (socket says 172.21.15.175:59216) 2024-04-25T09:06:47.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.557+0000 7fdd7fe00640 1 --2- 172.21.15.175:0/1977479464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd8015db00 0x7fdd8006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.557+0000 7fdd7f400640 1 -- 172.21.15.175:0/1977479464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd8015db00 msgr2=0x7fdd8006e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:47.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.557+0000 7fdd7f400640 1 --2- 172.21.15.175:0/1977479464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd8015db00 0x7fdd8006e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.557+0000 7fdd7f400640 1 -- 172.21.15.175:0/1977479464 >> v1:172.21.15.175:6789/0 conn(0x7fdd80161c60 legacy=0x7fdd800b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.557+0000 7fdd7f400640 1 -- 172.21.15.175:0/1977479464 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8006b2b0 con 0x7fdd800acd90 2024-04-25T09:06:47.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.557+0000 7fdd7fe00640 1 --2- 172.21.15.175:0/1977479464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd8015db00 0x7fdd8006e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:47.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.561+0000 7fdd7f400640 1 --2- 172.21.15.175:0/1977479464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd800acd90 0x7fdd80161720 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c0097c0 tx=0x7fdd6c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635f0433d89f3f8f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.561+0000 7fdd7ea00640 1 -- 172.21.15.175:0/1977479464 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c0ab660 con 0x7fdd800acd90 2024-04-25T09:06:47.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.561+0000 7fdd7ea00640 1 -- 172.21.15.175:0/1977479464 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6c0b0070 con 0x7fdd800acd90 2024-04-25T09:06:47.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.561+0000 7fdd7ea00640 1 -- 172.21.15.175:0/1977479464 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c0aba20 con 0x7fdd800acd90 2024-04-25T09:06:47.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd86a00640 1 -- 172.21.15.175:0/1977479464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd800acd90 msgr2=0x7fdd80161720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd86a00640 1 --2- 172.21.15.175:0/1977479464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd800acd90 0x7fdd80161720 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c0097c0 tx=0x7fdd6c01c440 comp rx=0 tx=0).stop 2024-04-25T09:06:47.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd86a00640 1 -- 172.21.15.175:0/1977479464 shutdown_connections 2024-04-25T09:06:47.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd86a00640 1 --2- 172.21.15.175:0/1977479464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd800acd90 0x7fdd80161720 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd86a00640 1 --2- 172.21.15.175:0/1977479464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd8015db00 0x7fdd8006e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd86a00640 1 -- 172.21.15.175:0/1977479464 >> 172.21.15.175:0/1977479464 conn(0x7fdd800b2200 msgr2=0x7fdd800cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:47.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd86a00640 1 -- 172.21.15.175:0/1977479464 shutdown_connections 2024-04-25T09:06:47.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd86a00640 1 -- 172.21.15.175:0/1977479464 wait complete. 2024-04-25T09:06:47.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd86a00640 1 Processor -- start 2024-04-25T09:06:47.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd86a00640 1 -- start start 2024-04-25T09:06:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd86a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd800acd90 0x7fdd8013b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd86a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd8015db00 0x7fdd80150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd86a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd80161c60 0x7fdd80159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd86a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8006f060 con 0x7fdd80161c60 2024-04-25T09:06:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd86a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8006eee0 con 0x7fdd800acd90 2024-04-25T09:06:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd86a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8016aac0 con 0x7fdd8015db00 2024-04-25T09:06:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd84a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd80161c60 0x7fdd80159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd84a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd80161c60 0x7fdd80159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59232/0 (socket says 172.21.15.175:59232) 2024-04-25T09:06:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd84a00640 1 -- 172.21.15.175:0/4286698802 learned_addr learned my addr 172.21.15.175:0/4286698802 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:47.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd7f400640 1 --2- 172.21.15.175:0/4286698802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd8015db00 0x7fdd80150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd7fe00640 1 --2- 172.21.15.175:0/4286698802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd800acd90 0x7fdd8013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd84a00640 1 -- 172.21.15.175:0/4286698802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd8015db00 msgr2=0x7fdd80150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd84a00640 1 --2- 172.21.15.175:0/4286698802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd8015db00 0x7fdd80150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd84a00640 1 -- 172.21.15.175:0/4286698802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd800acd90 msgr2=0x7fdd8013b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd84a00640 1 --2- 172.21.15.175:0/4286698802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd800acd90 0x7fdd8013b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.565+0000 7fdd84a00640 1 -- 172.21.15.175:0/4286698802 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8014fad0 con 0x7fdd80161c60 2024-04-25T09:06:47.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.569+0000 7fdd84a00640 1 --2- 172.21.15.175:0/4286698802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd80161c60 0x7fdd80159f70 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800ca80 tx=0x7fdd7800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.569+0000 7fdd77e00640 1 -- 172.21.15.175:0/4286698802 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78017070 con 0x7fdd80161c60 2024-04-25T09:06:47.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.569+0000 7fdd77e00640 1 -- 172.21.15.175:0/4286698802 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7800ac30 con 0x7fdd80161c60 2024-04-25T09:06:47.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.569+0000 7fdd86a00640 1 -- 172.21.15.175:0/4286698802 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd801548a0 con 0x7fdd80161c60 2024-04-25T09:06:47.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.569+0000 7fdd77e00640 1 -- 172.21.15.175:0/4286698802 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78012600 con 0x7fdd80161c60 2024-04-25T09:06:47.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.569+0000 7fdd86a00640 1 -- 172.21.15.175:0/4286698802 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8014ed10 con 0x7fdd80161c60 2024-04-25T09:06:47.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.569+0000 7fdd86a00640 1 -- 172.21.15.175:0/4286698802 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd80074a60 con 0x7fdd80161c60 2024-04-25T09:06:47.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.569+0000 7fdd77e00640 1 -- 172.21.15.175:0/4286698802 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdd7801a070 con 0x7fdd80161c60 2024-04-25T09:06:47.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.569+0000 7fdd77e00640 1 --2- 172.21.15.175:0/4286698802 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdd60066f90 0x7fdd60069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.573+0000 7fdd77e00640 1 -- 172.21.15.175:0/4286698802 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd78084c20 con 0x7fdd80161c60 2024-04-25T09:06:47.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.573+0000 7fdd7fe00640 1 --2- 172.21.15.175:0/4286698802 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdd60066f90 0x7fdd60069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.573+0000 7fdd7fe00640 1 --2- 172.21.15.175:0/4286698802 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdd60066f90 0x7fdd60069450 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdd70009950 tx=0x7fdd70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.577+0000 7fdd77e00640 1 -- 172.21.15.175:0/4286698802 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdd7800ae20 con 0x7fdd80161c60 2024-04-25T09:06:47.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.761+0000 7fdd86a00640 1 -- 172.21.15.175:0/4286698802 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd800d0770 con 0x7fdd80161c60 2024-04-25T09:06:47.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.765+0000 7fdd77e00640 1 -- 172.21.15.175:0/4286698802 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fdd78055550 con 0x7fdd80161c60 2024-04-25T09:06:47.753 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:47.753 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2064272902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2064272902},{"type":"v1","addr":"172.21.15.177:6834","nonce":2064272902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5462,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3896280225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3896280225},{"type":"v1","addr":"172.21.15.177:6835","nonce":3896280225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/149812612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":149812612},{"type":"v1","addr":"172.21.15.175:6835","nonce":149812612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:43.704808+0000","modified":"2024-04-25T09:06:46.737698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1478147147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1478147147},{"type":"v1","addr":"172.21.15.175:6837","nonce":1478147147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:06:47.753 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 32 2024-04-25T09:06:47.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.765+0000 7fdd86a00640 1 -- 172.21.15.175:0/4286698802 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdd60066f90 msgr2=0x7fdd60069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.765+0000 7fdd86a00640 1 --2- 172.21.15.175:0/4286698802 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdd60066f90 0x7fdd60069450 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdd70009950 tx=0x7fdd70008040 comp rx=0 tx=0).stop 2024-04-25T09:06:47.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.765+0000 7fdd86a00640 1 -- 172.21.15.175:0/4286698802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd80161c60 msgr2=0x7fdd80159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.765+0000 7fdd86a00640 1 --2- 172.21.15.175:0/4286698802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd80161c60 0x7fdd80159f70 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800ca80 tx=0x7fdd7800cf40 comp rx=0 tx=0).stop 2024-04-25T09:06:47.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.765+0000 7fdd86a00640 1 -- 172.21.15.175:0/4286698802 shutdown_connections 2024-04-25T09:06:47.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.765+0000 7fdd86a00640 1 --2- 172.21.15.175:0/4286698802 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdd60066f90 0x7fdd60069450 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.765+0000 7fdd86a00640 1 --2- 172.21.15.175:0/4286698802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd80161c60 0x7fdd80159f70 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.765+0000 7fdd86a00640 1 --2- 172.21.15.175:0/4286698802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd8015db00 0x7fdd80150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.765+0000 7fdd86a00640 1 --2- 172.21.15.175:0/4286698802 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd800acd90 0x7fdd8013b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.765+0000 7fdd86a00640 1 -- 172.21.15.175:0/4286698802 >> 172.21.15.175:0/4286698802 conn(0x7fdd800b2200 msgr2=0x7fdd80071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:47.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.765+0000 7fdd86a00640 1 -- 172.21.15.175:0/4286698802 shutdown_connections 2024-04-25T09:06:47.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.765+0000 7fdd86a00640 1 -- 172.21.15.175:0/4286698802 wait complete. 2024-04-25T09:06:47.774 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:47.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.921+0000 7fadda400640 1 Processor -- start 2024-04-25T09:06:47.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.921+0000 7fadda400640 1 -- start start 2024-04-25T09:06:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.921+0000 7fadda400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fadd4099a50 0x7fadd406cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.921+0000 7fadda400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadd40d0d50 0x7fadd40cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.921+0000 7fadda400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd40cfcb0 con 0x7fadd406bd60 2024-04-25T09:06:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.921+0000 7fadda400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd40cff90 con 0x7fadd4099a50 2024-04-25T09:06:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.921+0000 7fadda400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd40d0270 con 0x7fadd40d0d50 2024-04-25T09:06:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.921+0000 7fadd3400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fadd4099a50 0x7fadd406cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.921+0000 7fadd3400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fadd4099a50 0x7fadd406cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59244/0 (socket says 172.21.15.175:59244) 2024-04-25T09:06:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.921+0000 7fadd3400640 1 -- 172.21.15.175:0/4284081574 learned_addr learned my addr 172.21.15.175:0/4284081574 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.921+0000 7fadd3e00640 1 --2- 172.21.15.175:0/4284081574 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadd40d0d50 0x7fadd40cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.925+0000 7fadd3400640 1 -- 172.21.15.175:0/4284081574 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadd40d0d50 msgr2=0x7fadd40cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:47.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.925+0000 7fadd3400640 1 --2- 172.21.15.175:0/4284081574 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadd40d0d50 0x7fadd40cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.925+0000 7fadd3400640 1 -- 172.21.15.175:0/4284081574 >> v1:172.21.15.177:6789/0 conn(0x7fadd406bd60 legacy=0x7fadd4099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:47.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.925+0000 7fadd3400640 1 -- 172.21.15.175:0/4284081574 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd40d0550 con 0x7fadd4099a50 2024-04-25T09:06:47.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.925+0000 7fadd3400640 1 --2- 172.21.15.175:0/4284081574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadd4099a50 0x7fadd406cc50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fadc4009e50 tx=0x7fadc401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc85eced46f777d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.925+0000 7fadd2000640 1 -- 172.21.15.175:0/4284081574 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc40a5700 con 0x7fadd4099a50 2024-04-25T09:06:47.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.925+0000 7fadd2000640 1 -- 172.21.15.175:0/4284081574 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc40a58a0 con 0x7fadd4099a50 2024-04-25T09:06:47.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.925+0000 7fadd2000640 1 -- 172.21.15.175:0/4284081574 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc40a5c70 con 0x7fadd4099a50 2024-04-25T09:06:47.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.925+0000 7fadda400640 1 -- 172.21.15.175:0/4284081574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadd4099a50 msgr2=0x7fadd406cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.925+0000 7fadda400640 1 --2- 172.21.15.175:0/4284081574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadd4099a50 0x7fadd406cc50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fadc4009e50 tx=0x7fadc401ca30 comp rx=0 tx=0).stop 2024-04-25T09:06:47.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.925+0000 7fadda400640 1 -- 172.21.15.175:0/4284081574 shutdown_connections 2024-04-25T09:06:47.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.925+0000 7fadda400640 1 --2- 172.21.15.175:0/4284081574 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadd40d0d50 0x7fadd40cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.925+0000 7fadda400640 1 --2- 172.21.15.175:0/4284081574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadd4099a50 0x7fadd406cc50 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.925+0000 7fadda400640 1 -- 172.21.15.175:0/4284081574 >> 172.21.15.175:0/4284081574 conn(0x7fadd40b3300 msgr2=0x7fadd40b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:47.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadda400640 1 -- 172.21.15.175:0/4284081574 shutdown_connections 2024-04-25T09:06:47.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadda400640 1 -- 172.21.15.175:0/4284081574 wait complete. 2024-04-25T09:06:47.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadda400640 1 Processor -- start 2024-04-25T09:06:47.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadda400640 1 -- start start 2024-04-25T09:06:47.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadda400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadd406bd60 0x7fadd414bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadda400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadd4099a50 0x7fadd406fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadda400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadd40d0d50 0x7fadd415c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadda400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd415dfe0 con 0x7fadd4099a50 2024-04-25T09:06:47.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadda400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd415de60 con 0x7fadd40d0d50 2024-04-25T09:06:47.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadda400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd416b260 con 0x7fadd406bd60 2024-04-25T09:06:47.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadd2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadd4099a50 0x7fadd406fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadd3400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadd406bd60 0x7fadd414bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadd2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadd4099a50 0x7fadd406fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59256/0 (socket says 172.21.15.175:59256) 2024-04-25T09:06:47.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadd2a00640 1 -- 172.21.15.175:0/1595232089 learned_addr learned my addr 172.21.15.175:0/1595232089 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:47.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadd3e00640 1 --2- 172.21.15.175:0/1595232089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadd40d0d50 0x7fadd415c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadd2a00640 1 -- 172.21.15.175:0/1595232089 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadd406bd60 msgr2=0x7fadd414bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadd2a00640 1 --2- 172.21.15.175:0/1595232089 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadd406bd60 0x7fadd414bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadd2a00640 1 -- 172.21.15.175:0/1595232089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadd40d0d50 msgr2=0x7fadd415c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:47.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadd2a00640 1 --2- 172.21.15.175:0/1595232089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadd40d0d50 0x7fadd415c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:47.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadd2a00640 1 -- 172.21.15.175:0/1595232089 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd40caba0 con 0x7fadd4099a50 2024-04-25T09:06:47.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadd2a00640 1 --2- 172.21.15.175:0/1595232089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadd4099a50 0x7fadd406fc70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c370 tx=0x7fadc000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadcb400640 1 -- 172.21.15.175:0/1595232089 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc00052d0 con 0x7fadd4099a50 2024-04-25T09:06:47.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadcb400640 1 -- 172.21.15.175:0/1595232089 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc0005470 con 0x7fadd4099a50 2024-04-25T09:06:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadcb400640 1 -- 172.21.15.175:0/1595232089 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0007260 con 0x7fadd4099a50 2024-04-25T09:06:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadda400640 1 -- 172.21.15.175:0/1595232089 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd40cae80 con 0x7fadd4099a50 2024-04-25T09:06:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.929+0000 7fadda400640 1 -- 172.21.15.175:0/1595232089 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd40cb440 con 0x7fadd4099a50 2024-04-25T09:06:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.933+0000 7fadda400640 1 -- 172.21.15.175:0/1595232089 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd4074a60 con 0x7fadd4099a50 2024-04-25T09:06:47.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.933+0000 7fadcb400640 1 -- 172.21.15.175:0/1595232089 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fadc0007400 con 0x7fadd4099a50 2024-04-25T09:06:47.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.933+0000 7fadcb400640 1 --2- 172.21.15.175:0/1595232089 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fadb4066f60 0x7fadb4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:47.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.933+0000 7fadcb400640 1 -- 172.21.15.175:0/1595232089 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadc0084540 con 0x7fadd4099a50 2024-04-25T09:06:47.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.933+0000 7fadd3400640 1 --2- 172.21.15.175:0/1595232089 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fadb4066f60 0x7fadb4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:47.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.933+0000 7fadd3400640 1 --2- 172.21.15.175:0/1595232089 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fadb4066f60 0x7fadb4069420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fadc40ae000 tx=0x7fadc40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:47.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:47.937+0000 7fadcb400640 1 -- 172.21.15.175:0/1595232089 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fadc0054dd0 con 0x7fadd4099a50 2024-04-25T09:06:48.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.089+0000 7fadda400640 1 -- 172.21.15.175:0/1595232089 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadd406ccc0 con 0x7fadd4099a50 2024-04-25T09:06:48.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.093+0000 7fadcb400640 1 -- 172.21.15.175:0/1595232089 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16701 (secure 0 0 0) 0x7fadc0058e70 con 0x7fadd4099a50 2024-04-25T09:06:48.082 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:48.082 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":58,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:06:45.356791+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:41.465085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:42.715758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:48.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.093+0000 7fadda400640 1 -- 172.21.15.175:0/1595232089 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fadb4066f60 msgr2=0x7fadb4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.093+0000 7fadda400640 1 --2- 172.21.15.175:0/1595232089 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fadb4066f60 0x7fadb4069420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fadc40ae000 tx=0x7fadc40a7070 comp rx=0 tx=0).stop 2024-04-25T09:06:48.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.093+0000 7fadda400640 1 -- 172.21.15.175:0/1595232089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadd4099a50 msgr2=0x7fadd406fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.093+0000 7fadda400640 1 --2- 172.21.15.175:0/1595232089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadd4099a50 0x7fadd406fc70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fadc000c370 tx=0x7fadc000c830 comp rx=0 tx=0).stop 2024-04-25T09:06:48.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.093+0000 7fadda400640 1 -- 172.21.15.175:0/1595232089 shutdown_connections 2024-04-25T09:06:48.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.093+0000 7fadda400640 1 --2- 172.21.15.175:0/1595232089 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fadb4066f60 0x7fadb4069420 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.093+0000 7fadda400640 1 --2- 172.21.15.175:0/1595232089 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadd40d0d50 0x7fadd415c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.093+0000 7fadda400640 1 --2- 172.21.15.175:0/1595232089 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fadd4099a50 0x7fadd406fc70 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.093+0000 7fadda400640 1 --2- 172.21.15.175:0/1595232089 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadd406bd60 0x7fadd414bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.093+0000 7fadda400640 1 -- 172.21.15.175:0/1595232089 >> 172.21.15.175:0/1595232089 conn(0x7fadd40b3300 msgr2=0x7fadd40b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:48.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.093+0000 7fadda400640 1 -- 172.21.15.175:0/1595232089 shutdown_connections 2024-04-25T09:06:48.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.093+0000 7fadda400640 1 -- 172.21.15.175:0/1595232089 wait complete. 2024-04-25T09:06:48.103 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:06:48.103 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:06:48.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.249+0000 7f8b3c000640 1 Processor -- start 2024-04-25T09:06:48.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.249+0000 7f8b3c000640 1 -- start start 2024-04-25T09:06:48.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.249+0000 7f8b3c000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b341453a0 0x7f8b3415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.249+0000 7f8b3c000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b3415cd00 con 0x7f8b34144fc0 2024-04-25T09:06:48.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.249+0000 7f8b3c000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b340ce660 con 0x7f8b3415c410 2024-04-25T09:06:48.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.249+0000 7f8b3c000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3415c840 con 0x7f8b341453a0 2024-04-25T09:06:48.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.249+0000 7f8b39600640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f8b34144fc0 0x7f8b340cbe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45586/0 (socket says 172.21.15.175:45586) 2024-04-25T09:06:48.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.249+0000 7f8b39600640 1 -- 172.21.15.175:0/2398411376 learned_addr learned my addr 172.21.15.175:0/2398411376 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:48.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.249+0000 7f8b38c00640 1 --2- 172.21.15.175:0/2398411376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b341453a0 0x7f8b3415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.249+0000 7f8b33e00640 1 -- 172.21.15.175:0/2398411376 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833456831 0 0) 0x7f8b3415cd00 con 0x7f8b34144fc0 2024-04-25T09:06:48.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b33e00640 1 -- 172.21.15.175:0/2398411376 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b1c003530 con 0x7f8b34144fc0 2024-04-25T09:06:48.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b33e00640 1 -- 172.21.15.175:0/2398411376 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873078807 0 0) 0x7f8b340ce660 con 0x7f8b3415c410 2024-04-25T09:06:48.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b33e00640 1 -- 172.21.15.175:0/2398411376 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b3415cd00 con 0x7f8b3415c410 2024-04-25T09:06:48.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b33e00640 1 -- 172.21.15.175:0/2398411376 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2324874172 0 0) 0x7f8b1c003530 con 0x7f8b34144fc0 2024-04-25T09:06:48.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b33e00640 1 -- 172.21.15.175:0/2398411376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b341453a0 msgr2=0x7f8b3415bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:48.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b33e00640 1 --2- 172.21.15.175:0/2398411376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b341453a0 0x7f8b3415bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b33e00640 1 -- 172.21.15.175:0/2398411376 >> v1:172.21.15.177:6789/0 conn(0x7f8b3415c410 legacy=0x7f8b340cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b33e00640 1 -- 172.21.15.175:0/2398411376 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b340cc930 con 0x7f8b34144fc0 2024-04-25T09:06:48.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b33e00640 1 -- 172.21.15.175:0/2398411376 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f8b28001680 con 0x7f8b34144fc0 2024-04-25T09:06:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b38c00640 1 --2- 172.21.15.175:0/2398411376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b341453a0 0x7f8b3415bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b33e00640 1 -- 172.21.15.175:0/2398411376 >> v1:172.21.15.175:6789/0 conn(0x7f8b34144fc0 legacy=0x7f8b340cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b33e00640 1 --2- 172.21.15.175:0/2398411376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b1c003b80 0x7f8b1c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b33e00640 1 --2- 172.21.15.175:0/2398411376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b1c004810 0x7f8b1c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b33e00640 1 --2- 172.21.15.175:0/2398411376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1c0051d0 0x7f8b1c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b33e00640 1 -- 172.21.15.175:0/2398411376 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3415c840 con 0x7f8b1c0051d0 2024-04-25T09:06:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b33e00640 1 -- 172.21.15.175:0/2398411376 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c00bfc0 con 0x7f8b1c004810 2024-04-25T09:06:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b33e00640 1 -- 172.21.15.175:0/2398411376 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c00c1c0 con 0x7f8b1c003b80 2024-04-25T09:06:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b3a000640 1 --2- 172.21.15.175:0/2398411376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1c0051d0 0x7f8b1c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b38c00640 1 --2- 172.21.15.175:0/2398411376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b1c004810 0x7f8b1c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b39600640 1 --2- 172.21.15.175:0/2398411376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b1c003b80 0x7f8b1c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b3a000640 1 -- 172.21.15.175:0/2398411376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b1c003b80 msgr2=0x7f8b1c003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b3a000640 1 --2- 172.21.15.175:0/2398411376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b1c003b80 0x7f8b1c003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b3a000640 1 -- 172.21.15.175:0/2398411376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b1c004810 msgr2=0x7f8b1c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b3a000640 1 --2- 172.21.15.175:0/2398411376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b1c004810 0x7f8b1c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b3a000640 1 -- 172.21.15.175:0/2398411376 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c003530 con 0x7f8b1c0051d0 2024-04-25T09:06:48.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.253+0000 7f8b3a000640 1 --2- 172.21.15.175:0/2398411376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1c0051d0 0x7f8b1c00b9d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8b340ce830 tx=0x7f8b2c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719b47c94ca09986 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:48.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b33e00640 1 -- 172.21.15.175:0/2398411376 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c001c30 con 0x7f8b1c0051d0 2024-04-25T09:06:48.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b33e00640 1 -- 172.21.15.175:0/2398411376 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2c003b80 con 0x7f8b1c0051d0 2024-04-25T09:06:48.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b33e00640 1 -- 172.21.15.175:0/2398411376 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c0050d0 con 0x7f8b1c0051d0 2024-04-25T09:06:48.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b3c000640 1 -- 172.21.15.175:0/2398411376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1c0051d0 msgr2=0x7f8b1c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b3c000640 1 --2- 172.21.15.175:0/2398411376 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1c0051d0 0x7f8b1c00b9d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8b340ce830 tx=0x7f8b2c01c8e0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b3a000640 1 -- 172.21.15.175:0/2398411376 reap_dead start 2024-04-25T09:06:48.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b3c000640 1 -- 172.21.15.175:0/2398411376 shutdown_connections 2024-04-25T09:06:48.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b3c000640 1 -- 172.21.15.175:0/2398411376 >> 172.21.15.175:0/2398411376 conn(0x7f8b34067150 msgr2=0x7f8b3406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:48.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b3c000640 1 -- 172.21.15.175:0/2398411376 shutdown_connections 2024-04-25T09:06:48.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b3c000640 1 -- 172.21.15.175:0/2398411376 wait complete. 2024-04-25T09:06:48.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b3c000640 1 Processor -- start 2024-04-25T09:06:48.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b3c000640 1 -- start start 2024-04-25T09:06:48.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b3c000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b34144580 0x7f8b3415d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b3c000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b3415e690 0x7f8b3415b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b3c000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b340b30d0 0x7f8b340b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b3c000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b340ce900 con 0x7f8b3415e690 2024-04-25T09:06:48.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b3c000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b340ccef0 con 0x7f8b340b30d0 2024-04-25T09:06:48.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b3c000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b340cc580 con 0x7f8b34144580 2024-04-25T09:06:48.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b38c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b3415e690 0x7f8b3415b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b38c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b3415e690 0x7f8b3415b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59278/0 (socket says 172.21.15.175:59278) 2024-04-25T09:06:48.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b38c00640 1 -- 172.21.15.175:0/4166630405 learned_addr learned my addr 172.21.15.175:0/4166630405 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:48.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b39600640 1 --2- 172.21.15.175:0/4166630405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b34144580 0x7f8b3415d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.257+0000 7f8b3a000640 1 --2- 172.21.15.175:0/4166630405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b340b30d0 0x7f8b340b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.261+0000 7f8b38c00640 1 -- 172.21.15.175:0/4166630405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b34144580 msgr2=0x7f8b3415d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.261+0000 7f8b38c00640 1 --2- 172.21.15.175:0/4166630405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b34144580 0x7f8b3415d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.261+0000 7f8b38c00640 1 -- 172.21.15.175:0/4166630405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b340b30d0 msgr2=0x7f8b340b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.261+0000 7f8b38c00640 1 --2- 172.21.15.175:0/4166630405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b340b30d0 0x7f8b340b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.261+0000 7f8b38c00640 1 -- 172.21.15.175:0/4166630405 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3415a6d0 con 0x7f8b3415e690 2024-04-25T09:06:48.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.261+0000 7f8b3a000640 1 --2- 172.21.15.175:0/4166630405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b340b30d0 0x7f8b340b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:48.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.261+0000 7f8b38c00640 1 --2- 172.21.15.175:0/4166630405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b3415e690 0x7f8b3415b320 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f8b20011a00 tx=0x7f8b20011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:48.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.261+0000 7f8b31600640 1 -- 172.21.15.175:0/4166630405 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2000fc10 con 0x7f8b3415e690 2024-04-25T09:06:48.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.261+0000 7f8b31600640 1 -- 172.21.15.175:0/4166630405 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2000fdb0 con 0x7f8b3415e690 2024-04-25T09:06:48.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.261+0000 7f8b31600640 1 -- 172.21.15.175:0/4166630405 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b20014640 con 0x7f8b3415e690 2024-04-25T09:06:48.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.261+0000 7f8b3c000640 1 -- 172.21.15.175:0/4166630405 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3415d5f0 con 0x7f8b3415e690 2024-04-25T09:06:48.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.261+0000 7f8b3c000640 1 -- 172.21.15.175:0/4166630405 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3415dbb0 con 0x7f8b3415e690 2024-04-25T09:06:48.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.261+0000 7f8b3c000640 1 -- 172.21.15.175:0/4166630405 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b34074a60 con 0x7f8b3415e690 2024-04-25T09:06:48.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.261+0000 7f8b31600640 1 -- 172.21.15.175:0/4166630405 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8b20012040 con 0x7f8b3415e690 2024-04-25T09:06:48.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.261+0000 7f8b31600640 1 --2- 172.21.15.175:0/4166630405 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8b14066f60 0x7f8b14069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.261+0000 7f8b31600640 1 -- 172.21.15.175:0/4166630405 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b200856a0 con 0x7f8b3415e690 2024-04-25T09:06:48.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.261+0000 7f8b39600640 1 --2- 172.21.15.175:0/4166630405 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8b14066f60 0x7f8b14069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.265+0000 7f8b39600640 1 --2- 172.21.15.175:0/4166630405 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8b14066f60 0x7f8b14069420 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8b28001060 tx=0x7f8b28001e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:48.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.265+0000 7f8b31600640 1 -- 172.21.15.175:0/4166630405 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8b20019030 con 0x7f8b3415e690 2024-04-25T09:06:48.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.421+0000 7f8b3c000640 1 -- 172.21.15.175:0/4166630405 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b34142090 con 0x7f8b14066f60 2024-04-25T09:06:48.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.425+0000 7f8b31600640 1 -- 172.21.15.175:0/4166630405 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+239859 (secure 0 0 0) 0x7f8b34142090 con 0x7f8b14066f60 2024-04-25T09:06:48.419 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:48.420 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:06:48.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.429+0000 7f8b3c000640 1 -- 172.21.15.175:0/4166630405 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8b14066f60 msgr2=0x7f8b14069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.429+0000 7f8b3c000640 1 --2- 172.21.15.175:0/4166630405 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8b14066f60 0x7f8b14069420 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8b28001060 tx=0x7f8b28001e40 comp rx=0 tx=0).stop 2024-04-25T09:06:48.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.429+0000 7f8b3c000640 1 -- 172.21.15.175:0/4166630405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b3415e690 msgr2=0x7f8b3415b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.429+0000 7f8b3c000640 1 --2- 172.21.15.175:0/4166630405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b3415e690 0x7f8b3415b320 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f8b20011a00 tx=0x7f8b20011ec0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.429+0000 7f8b3c000640 1 -- 172.21.15.175:0/4166630405 shutdown_connections 2024-04-25T09:06:48.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.429+0000 7f8b3c000640 1 --2- 172.21.15.175:0/4166630405 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8b14066f60 0x7f8b14069420 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.429+0000 7f8b3c000640 1 --2- 172.21.15.175:0/4166630405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b340b30d0 0x7f8b340b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.429+0000 7f8b3c000640 1 --2- 172.21.15.175:0/4166630405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b3415e690 0x7f8b3415b320 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.429+0000 7f8b3c000640 1 --2- 172.21.15.175:0/4166630405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b34144580 0x7f8b3415d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.429+0000 7f8b3c000640 1 -- 172.21.15.175:0/4166630405 >> 172.21.15.175:0/4166630405 conn(0x7f8b1c0051d0 msgr2=0x7f8b341411a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:48.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.429+0000 7f8b3c000640 1 -- 172.21.15.175:0/4166630405 shutdown_connections 2024-04-25T09:06:48.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.429+0000 7f8b3c000640 1 -- 172.21.15.175:0/4166630405 wait complete. 2024-04-25T09:06:48.439 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-04-25T09:06:47.824537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":226616,"kb_used_data":6240,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748104,"statfs":{"total":773094113280,"available":772862058496,"internally_reserved":0,"allocated":6389760,"data_stored":3309138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.500297"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.333966+0000","last_change":"2024-04-25T09:06:42.333966+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.333966+0000","last_undegraded":"2024-04-25T09:06:42.333966+0000","last_fullsized":"2024-04-25T09:06:42.333966+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.334223+0000","last_change":"2024-04-25T09:06:42.334223+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.334223+0000","last_undegraded":"2024-04-25T09:06:42.334223+0000","last_fullsized":"2024-04-25T09:06:42.334223+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.334728+0000","last_change":"2024-04-25T09:06:42.334728+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.334728+0000","last_undegraded":"2024-04-25T09:06:42.334728+0000","last_fullsized":"2024-04-25T09:06:42.334728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.328890+0000","last_change":"2024-04-25T09:06:42.328890+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.328890+0000","last_undegraded":"2024-04-25T09:06:42.328890+0000","last_fullsized":"2024-04-25T09:06:42.328890+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.330663+0000","last_change":"2024-04-25T09:06:42.330663+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.330663+0000","last_undegraded":"2024-04-25T09:06:42.330663+0000","last_fullsized":"2024-04-25T09:06:42.330663+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.333853+0000","last_change":"2024-04-25T09:06:42.333853+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.333853+0000","last_undegraded":"2024-04-25T09:06:42.333853+0000","last_fullsized":"2024-04-25T09:06:42.333853+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.328893+0000","last_change":"2024-04-25T09:06:42.328893+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.328893+0000","last_undegraded":"2024-04-25T09:06:42.328893+0000","last_fullsized":"2024-04-25T09:06:42.328893+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.329284+0000","last_change":"2024-04-25T09:06:42.329284+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.329284+0000","last_undegraded":"2024-04-25T09:06:42.329284+0000","last_fullsized":"2024-04-25T09:06:42.329284+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.325708+0000","last_change":"2024-04-25T09:06:42.325708+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.325708+0000","last_undegraded":"2024-04-25T09:06:42.325708+0000","last_fullsized":"2024-04-25T09:06:42.325708+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.331613+0000","last_change":"2024-04-25T09:06:42.331613+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.331613+0000","last_undegraded":"2024-04-25T09:06:42.331613+0000","last_fullsized":"2024-04-25T09:06:42.331613+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.325583+0000","last_change":"2024-04-25T09:06:42.325583+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.325583+0000","last_undegraded":"2024-04-25T09:06:42.325583+0000","last_fullsized":"2024-04-25T09:06:42.325583+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.329276+0000","last_change":"2024-04-25T09:06:42.329276+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.329276+0000","last_undegraded":"2024-04-25T09:06:42.329276+0000","last_fullsized":"2024-04-25T09:06:42.329276+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.332744+0000","last_change":"2024-04-25T09:06:42.332744+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.332744+0000","last_undegraded":"2024-04-25T09:06:42.332744+0000","last_fullsized":"2024-04-25T09:06:42.332744+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.325931+0000","last_change":"2024-04-25T09:06:42.325931+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.325931+0000","last_undegraded":"2024-04-25T09:06:42.325931+0000","last_fullsized":"2024-04-25T09:06:42.325931+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.328334+0000","last_change":"2024-04-25T09:06:42.328334+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.328334+0000","last_undegraded":"2024-04-25T09:06:42.328334+0000","last_fullsized":"2024-04-25T09:06:42.328334+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.325530+0000","last_change":"2024-04-25T09:06:42.325530+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.325530+0000","last_undegraded":"2024-04-25T09:06:42.325530+0000","last_fullsized":"2024-04-25T09:06:42.325530+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.331904+0000","last_change":"2024-04-25T09:06:42.331904+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.331904+0000","last_undegraded":"2024-04-25T09:06:42.331904+0000","last_fullsized":"2024-04-25T09:06:42.331904+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.331403+0000","last_change":"2024-04-25T09:06:42.331403+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.331403+0000","last_undegraded":"2024-04-25T09:06:42.331403+0000","last_fullsized":"2024-04-25T09:06:42.331403+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.328369+0000","last_change":"2024-04-25T09:06:42.328369+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.328369+0000","last_undegraded":"2024-04-25T09:06:42.328369+0000","last_fullsized":"2024-04-25T09:06:42.328369+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.331537+0000","last_change":"2024-04-25T09:06:42.331537+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.331537+0000","last_undegraded":"2024-04-25T09:06:42.331537+0000","last_fullsized":"2024-04-25T09:06:42.331537+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.332218+0000","last_change":"2024-04-25T09:06:42.332218+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.332218+0000","last_undegraded":"2024-04-25T09:06:42.332218+0000","last_fullsized":"2024-04-25T09:06:42.332218+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.331412+0000","last_change":"2024-04-25T09:06:42.331412+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.331412+0000","last_undegraded":"2024-04-25T09:06:42.331412+0000","last_fullsized":"2024-04-25T09:06:42.331412+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.328263+0000","last_change":"2024-04-25T09:06:42.328263+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.328263+0000","last_undegraded":"2024-04-25T09:06:42.328263+0000","last_fullsized":"2024-04-25T09:06:42.328263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.330859+0000","last_change":"2024-04-25T09:06:42.330859+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.330859+0000","last_undegraded":"2024-04-25T09:06:42.330859+0000","last_fullsized":"2024-04-25T09:06:42.330859+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.330908+0000","last_change":"2024-04-25T09:06:42.330908+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.330908+0000","last_undegraded":"2024-04-25T09:06:42.330908+0000","last_fullsized":"2024-04-25T09:06:42.330908+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.326445+0000","last_change":"2024-04-25T09:06:42.326445+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.326445+0000","last_undegraded":"2024-04-25T09:06:42.326445+0000","last_fullsized":"2024-04-25T09:06:42.326445+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.328285+0000","last_change":"2024-04-25T09:06:42.328285+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.328285+0000","last_undegraded":"2024-04-25T09:06:42.328285+0000","last_fullsized":"2024-04-25T09:06:42.328285+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.331258+0000","last_change":"2024-04-25T09:06:42.331258+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.331258+0000","last_undegraded":"2024-04-25T09:06:42.331258+0000","last_fullsized":"2024-04-25T09:06:42.331258+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.329391+0000","last_change":"2024-04-25T09:06:42.329391+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.329391+0000","last_undegraded":"2024-04-25T09:06:42.329391+0000","last_fullsized":"2024-04-25T09:06:42.329391+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.330834+0000","last_change":"2024-04-25T09:06:42.330834+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.330834+0000","last_undegraded":"2024-04-25T09:06:42.330834+0000","last_fullsized":"2024-04-25T09:06:42.330834+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.330982+0000","last_change":"2024-04-25T09:06:42.330982+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.330982+0000","last_undegraded":"2024-04-25T09:06:42.330982+0000","last_fullsized":"2024-04-25T09:06:42.330982+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.325887+0000","last_change":"2024-04-25T09:06:42.325887+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.325887+0000","last_undegraded":"2024-04-25T09:06:42.325887+0000","last_fullsized":"2024-04-25T09:06:42.325887+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":234,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:06:42.327097+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:06:42.327097+0000","last_peered":"2024-04-25T09:06:42.327097+0000","last_clean":"2024-04-25T09:06:42.327097+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:06:42.327097+0000","last_undegraded":"2024-04-25T09:06:42.327097+0000","last_fullsized":"2024-04-25T09:06:42.327097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1253376,"data_stored":860781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":647168,"data_stored":264596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":659456,"data_stored":270413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":647168,"data_stored":264596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":264596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":264596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":264596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1241088,"data_stored":854964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:06:48.444 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:06:48.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.629+0000 7ff814200640 1 Processor -- start 2024-04-25T09:06:48.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.629+0000 7ff814200640 1 -- start start 2024-04-25T09:06:48.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.629+0000 7ff814200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff80c15a900 0x7ff80c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.629+0000 7ff814200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff80c0cf560 0x7ff80c0cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.629+0000 7ff814200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80c0cda00 con 0x7ff80c0cd520 2024-04-25T09:06:48.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.629+0000 7ff814200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80c15bcf0 con 0x7ff80c15a900 2024-04-25T09:06:48.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.629+0000 7ff814200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c0cfef0 con 0x7ff80c0cf560 2024-04-25T09:06:48.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.629+0000 7ff812200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff80c0cf560 0x7ff80c0cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.629+0000 7ff811800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff80c15a900 0x7ff80c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.629+0000 7ff810e00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7ff80c0cd520 0x7ff80c0ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:48654/0 (socket says 172.21.15.175:48654) 2024-04-25T09:06:48.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.629+0000 7ff810e00640 1 -- 172.21.15.175:0/2351322103 learned_addr learned my addr 172.21.15.175:0/2351322103 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:48.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.633+0000 7ff811800640 1 -- 172.21.15.175:0/2351322103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff80c0cf560 msgr2=0x7ff80c0cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:48.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.633+0000 7ff80be00640 1 -- 172.21.15.175:0/2351322103 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578150228 0 0) 0x7ff80c0cda00 con 0x7ff80c0cd520 2024-04-25T09:06:48.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.633+0000 7ff811800640 1 --2- 172.21.15.175:0/2351322103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff80c0cf560 0x7ff80c0cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.633+0000 7ff811800640 1 -- 172.21.15.175:0/2351322103 >> v1:172.21.15.177:6789/0 conn(0x7ff80c0cd520 legacy=0x7ff80c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.633+0000 7ff811800640 1 -- 172.21.15.175:0/2351322103 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c0cdce0 con 0x7ff80c15a900 2024-04-25T09:06:48.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.633+0000 7ff812200640 1 --2- 172.21.15.175:0/2351322103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff80c0cf560 0x7ff80c0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:48.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.633+0000 7ff811800640 1 --2- 172.21.15.175:0/2351322103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff80c15a900 0x7ff80c06e150 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff8000097c0 tx=0x7ff80001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5155c682679ab2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:48.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.633+0000 7ff80be00640 1 -- 172.21.15.175:0/2351322103 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8000b2070 con 0x7ff80c15a900 2024-04-25T09:06:48.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.633+0000 7ff80be00640 1 -- 172.21.15.175:0/2351322103 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8000ad640 con 0x7ff80c15a900 2024-04-25T09:06:48.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.633+0000 7ff80be00640 1 -- 172.21.15.175:0/2351322103 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8000ada10 con 0x7ff80c15a900 2024-04-25T09:06:48.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff814200640 1 -- 172.21.15.175:0/2351322103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff80c15a900 msgr2=0x7ff80c06e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff814200640 1 --2- 172.21.15.175:0/2351322103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff80c15a900 0x7ff80c06e150 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff8000097c0 tx=0x7ff80001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff814200640 1 -- 172.21.15.175:0/2351322103 shutdown_connections 2024-04-25T09:06:48.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff814200640 1 --2- 172.21.15.175:0/2351322103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff80c0cf560 0x7ff80c0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff814200640 1 --2- 172.21.15.175:0/2351322103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff80c15a900 0x7ff80c06e150 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff814200640 1 -- 172.21.15.175:0/2351322103 >> 172.21.15.175:0/2351322103 conn(0x7ff80c067150 msgr2=0x7ff80c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:48.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff814200640 1 -- 172.21.15.175:0/2351322103 shutdown_connections 2024-04-25T09:06:48.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff814200640 1 -- 172.21.15.175:0/2351322103 wait complete. 2024-04-25T09:06:48.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff814200640 1 Processor -- start 2024-04-25T09:06:48.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff814200640 1 -- start start 2024-04-25T09:06:48.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff814200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff80c0cf560 0x7ff80c1f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff814200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff80c15a900 0x7ff80c15d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff814200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff80c15dc00 0x7ff80c155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff814200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c06d530 con 0x7ff80c0cf560 2024-04-25T09:06:48.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff814200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c06d3b0 con 0x7ff80c15a900 2024-04-25T09:06:48.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff814200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c15c790 con 0x7ff80c15dc00 2024-04-25T09:06:48.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff811800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff80c0cf560 0x7ff80c1f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff811800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff80c0cf560 0x7ff80c1f5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59280/0 (socket says 172.21.15.175:59280) 2024-04-25T09:06:48.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff811800640 1 -- 172.21.15.175:0/2002272631 learned_addr learned my addr 172.21.15.175:0/2002272631 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:48.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff810e00640 1 --2- 172.21.15.175:0/2002272631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff80c15a900 0x7ff80c15d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff812200640 1 --2- 172.21.15.175:0/2002272631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff80c15dc00 0x7ff80c155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff811800640 1 -- 172.21.15.175:0/2002272631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff80c15dc00 msgr2=0x7ff80c155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff811800640 1 --2- 172.21.15.175:0/2002272631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff80c15dc00 0x7ff80c155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff811800640 1 -- 172.21.15.175:0/2002272631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff80c15a900 msgr2=0x7ff80c15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff811800640 1 --2- 172.21.15.175:0/2002272631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff80c15a900 0x7ff80c15d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff811800640 1 -- 172.21.15.175:0/2002272631 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c14b260 con 0x7ff80c0cf560 2024-04-25T09:06:48.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.637+0000 7ff812200640 1 --2- 172.21.15.175:0/2002272631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff80c15dc00 0x7ff80c155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:48.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.641+0000 7ff811800640 1 --2- 172.21.15.175:0/2002272631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff80c0cf560 0x7ff80c1f5630 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff8000b0040 tx=0x7ff800019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:48.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.641+0000 7ff809600640 1 -- 172.21.15.175:0/2002272631 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8000b2040 con 0x7ff80c0cf560 2024-04-25T09:06:48.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.641+0000 7ff809600640 1 -- 172.21.15.175:0/2002272631 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff800004020 con 0x7ff80c0cf560 2024-04-25T09:06:48.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.641+0000 7ff809600640 1 -- 172.21.15.175:0/2002272631 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff800006e20 con 0x7ff80c0cf560 2024-04-25T09:06:48.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.641+0000 7ff814200640 1 -- 172.21.15.175:0/2002272631 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff80c14b540 con 0x7ff80c0cf560 2024-04-25T09:06:48.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.641+0000 7ff814200640 1 -- 172.21.15.175:0/2002272631 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80c14bb00 con 0x7ff80c0cf560 2024-04-25T09:06:48.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.641+0000 7ff814200640 1 -- 172.21.15.175:0/2002272631 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80c074a60 con 0x7ff80c0cf560 2024-04-25T09:06:48.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.641+0000 7ff809600640 1 -- 172.21.15.175:0/2002272631 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff800003620 con 0x7ff80c0cf560 2024-04-25T09:06:48.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.641+0000 7ff809600640 1 --2- 172.21.15.175:0/2002272631 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7ec066f60 0x7ff7ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:48.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.641+0000 7ff809600640 1 -- 172.21.15.175:0/2002272631 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff80011efe0 con 0x7ff80c0cf560 2024-04-25T09:06:48.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.641+0000 7ff810e00640 1 --2- 172.21.15.175:0/2002272631 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7ec066f60 0x7ff7ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:48.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.641+0000 7ff810e00640 1 --2- 172.21.15.175:0/2002272631 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7ec066f60 0x7ff7ec069420 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff80c14ad40 tx=0x7ff7f8007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:48.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.645+0000 7ff809600640 1 -- 172.21.15.175:0/2002272631 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff8000c3030 con 0x7ff80c0cf560 2024-04-25T09:06:48.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.801+0000 7ff814200640 1 -- 172.21.15.175:0/2002272631 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff80c14bd40 con 0x7ff7ec066f60 2024-04-25T09:06:48.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.805+0000 7ff809600640 1 -- 172.21.15.175:0/2002272631 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+239859 (secure 0 0 0) 0x7ff80c14bd40 con 0x7ff7ec066f60 2024-04-25T09:06:48.798 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:48.800 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:06:48.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.809+0000 7ff814200640 1 -- 172.21.15.175:0/2002272631 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7ec066f60 msgr2=0x7ff7ec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.809+0000 7ff814200640 1 --2- 172.21.15.175:0/2002272631 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7ec066f60 0x7ff7ec069420 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff80c14ad40 tx=0x7ff7f8007d60 comp rx=0 tx=0).stop 2024-04-25T09:06:48.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.809+0000 7ff814200640 1 -- 172.21.15.175:0/2002272631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff80c0cf560 msgr2=0x7ff80c1f5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:48.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.809+0000 7ff814200640 1 --2- 172.21.15.175:0/2002272631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff80c0cf560 0x7ff80c1f5630 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff8000b0040 tx=0x7ff800019240 comp rx=0 tx=0).stop 2024-04-25T09:06:48.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.809+0000 7ff814200640 1 -- 172.21.15.175:0/2002272631 shutdown_connections 2024-04-25T09:06:48.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.809+0000 7ff814200640 1 --2- 172.21.15.175:0/2002272631 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7ec066f60 0x7ff7ec069420 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.809+0000 7ff814200640 1 --2- 172.21.15.175:0/2002272631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff80c15dc00 0x7ff80c155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.809+0000 7ff814200640 1 --2- 172.21.15.175:0/2002272631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff80c15a900 0x7ff80c15d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.809+0000 7ff814200640 1 --2- 172.21.15.175:0/2002272631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff80c0cf560 0x7ff80c1f5630 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:48.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.809+0000 7ff814200640 1 -- 172.21.15.175:0/2002272631 >> 172.21.15.175:0/2002272631 conn(0x7ff80c0cd520 msgr2=0x7ff80c06ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:48.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.809+0000 7ff814200640 1 -- 172.21.15.175:0/2002272631 shutdown_connections 2024-04-25T09:06:48.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:48.809+0000 7ff814200640 1 -- 172.21.15.175:0/2002272631 wait complete. 2024-04-25T09:06:48.819 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-04-25T09:06:47.824537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":226616,"kb_used_data":6240,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748104,"statfs":{"total":773094113280,"available":772862058496,"internally_reserved":0,"allocated":6389760,"data_stored":3309138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.500297"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.333966+0000","last_change":"2024-04-25T09:06:42.333966+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.333966+0000","last_undegraded":"2024-04-25T09:06:42.333966+0000","last_fullsized":"2024-04-25T09:06:42.333966+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.334223+0000","last_change":"2024-04-25T09:06:42.334223+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.334223+0000","last_undegraded":"2024-04-25T09:06:42.334223+0000","last_fullsized":"2024-04-25T09:06:42.334223+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.334728+0000","last_change":"2024-04-25T09:06:42.334728+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.334728+0000","last_undegraded":"2024-04-25T09:06:42.334728+0000","last_fullsized":"2024-04-25T09:06:42.334728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.328890+0000","last_change":"2024-04-25T09:06:42.328890+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.328890+0000","last_undegraded":"2024-04-25T09:06:42.328890+0000","last_fullsized":"2024-04-25T09:06:42.328890+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.330663+0000","last_change":"2024-04-25T09:06:42.330663+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.330663+0000","last_undegraded":"2024-04-25T09:06:42.330663+0000","last_fullsized":"2024-04-25T09:06:42.330663+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.333853+0000","last_change":"2024-04-25T09:06:42.333853+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.333853+0000","last_undegraded":"2024-04-25T09:06:42.333853+0000","last_fullsized":"2024-04-25T09:06:42.333853+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.328893+0000","last_change":"2024-04-25T09:06:42.328893+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.328893+0000","last_undegraded":"2024-04-25T09:06:42.328893+0000","last_fullsized":"2024-04-25T09:06:42.328893+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.329284+0000","last_change":"2024-04-25T09:06:42.329284+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.329284+0000","last_undegraded":"2024-04-25T09:06:42.329284+0000","last_fullsized":"2024-04-25T09:06:42.329284+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.325708+0000","last_change":"2024-04-25T09:06:42.325708+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.325708+0000","last_undegraded":"2024-04-25T09:06:42.325708+0000","last_fullsized":"2024-04-25T09:06:42.325708+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.331613+0000","last_change":"2024-04-25T09:06:42.331613+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.331613+0000","last_undegraded":"2024-04-25T09:06:42.331613+0000","last_fullsized":"2024-04-25T09:06:42.331613+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.325583+0000","last_change":"2024-04-25T09:06:42.325583+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.325583+0000","last_undegraded":"2024-04-25T09:06:42.325583+0000","last_fullsized":"2024-04-25T09:06:42.325583+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.329276+0000","last_change":"2024-04-25T09:06:42.329276+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.329276+0000","last_undegraded":"2024-04-25T09:06:42.329276+0000","last_fullsized":"2024-04-25T09:06:42.329276+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.332744+0000","last_change":"2024-04-25T09:06:42.332744+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.332744+0000","last_undegraded":"2024-04-25T09:06:42.332744+0000","last_fullsized":"2024-04-25T09:06:42.332744+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.325931+0000","last_change":"2024-04-25T09:06:42.325931+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.325931+0000","last_undegraded":"2024-04-25T09:06:42.325931+0000","last_fullsized":"2024-04-25T09:06:42.325931+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.328334+0000","last_change":"2024-04-25T09:06:42.328334+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.328334+0000","last_undegraded":"2024-04-25T09:06:42.328334+0000","last_fullsized":"2024-04-25T09:06:42.328334+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.325530+0000","last_change":"2024-04-25T09:06:42.325530+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.325530+0000","last_undegraded":"2024-04-25T09:06:42.325530+0000","last_fullsized":"2024-04-25T09:06:42.325530+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.331904+0000","last_change":"2024-04-25T09:06:42.331904+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.331904+0000","last_undegraded":"2024-04-25T09:06:42.331904+0000","last_fullsized":"2024-04-25T09:06:42.331904+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.331403+0000","last_change":"2024-04-25T09:06:42.331403+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.331403+0000","last_undegraded":"2024-04-25T09:06:42.331403+0000","last_fullsized":"2024-04-25T09:06:42.331403+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.328369+0000","last_change":"2024-04-25T09:06:42.328369+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.328369+0000","last_undegraded":"2024-04-25T09:06:42.328369+0000","last_fullsized":"2024-04-25T09:06:42.328369+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.331537+0000","last_change":"2024-04-25T09:06:42.331537+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.331537+0000","last_undegraded":"2024-04-25T09:06:42.331537+0000","last_fullsized":"2024-04-25T09:06:42.331537+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.332218+0000","last_change":"2024-04-25T09:06:42.332218+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.332218+0000","last_undegraded":"2024-04-25T09:06:42.332218+0000","last_fullsized":"2024-04-25T09:06:42.332218+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.331412+0000","last_change":"2024-04-25T09:06:42.331412+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.331412+0000","last_undegraded":"2024-04-25T09:06:42.331412+0000","last_fullsized":"2024-04-25T09:06:42.331412+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.328263+0000","last_change":"2024-04-25T09:06:42.328263+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.328263+0000","last_undegraded":"2024-04-25T09:06:42.328263+0000","last_fullsized":"2024-04-25T09:06:42.328263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.330859+0000","last_change":"2024-04-25T09:06:42.330859+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.330859+0000","last_undegraded":"2024-04-25T09:06:42.330859+0000","last_fullsized":"2024-04-25T09:06:42.330859+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.330908+0000","last_change":"2024-04-25T09:06:42.330908+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.330908+0000","last_undegraded":"2024-04-25T09:06:42.330908+0000","last_fullsized":"2024-04-25T09:06:42.330908+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.326445+0000","last_change":"2024-04-25T09:06:42.326445+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.326445+0000","last_undegraded":"2024-04-25T09:06:42.326445+0000","last_fullsized":"2024-04-25T09:06:42.326445+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.328285+0000","last_change":"2024-04-25T09:06:42.328285+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.328285+0000","last_undegraded":"2024-04-25T09:06:42.328285+0000","last_fullsized":"2024-04-25T09:06:42.328285+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.331258+0000","last_change":"2024-04-25T09:06:42.331258+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.331258+0000","last_undegraded":"2024-04-25T09:06:42.331258+0000","last_fullsized":"2024-04-25T09:06:42.331258+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.329391+0000","last_change":"2024-04-25T09:06:42.329391+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.329391+0000","last_undegraded":"2024-04-25T09:06:42.329391+0000","last_fullsized":"2024-04-25T09:06:42.329391+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.330834+0000","last_change":"2024-04-25T09:06:42.330834+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.330834+0000","last_undegraded":"2024-04-25T09:06:42.330834+0000","last_fullsized":"2024-04-25T09:06:42.330834+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.330982+0000","last_change":"2024-04-25T09:06:42.330982+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.330982+0000","last_undegraded":"2024-04-25T09:06:42.330982+0000","last_fullsized":"2024-04-25T09:06:42.330982+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.325887+0000","last_change":"2024-04-25T09:06:42.325887+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.325887+0000","last_undegraded":"2024-04-25T09:06:42.325887+0000","last_fullsized":"2024-04-25T09:06:42.325887+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":234,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:06:42.327097+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:06:42.327097+0000","last_peered":"2024-04-25T09:06:42.327097+0000","last_clean":"2024-04-25T09:06:42.327097+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:06:42.327097+0000","last_undegraded":"2024-04-25T09:06:42.327097+0000","last_fullsized":"2024-04-25T09:06:42.327097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1253376,"data_stored":860781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":647168,"data_stored":264596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":659456,"data_stored":270413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":647168,"data_stored":264596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":264596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":264596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":264596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1241088,"data_stored":854964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:06:48.823 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:06:48.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.009+0000 7f3f9ce00640 1 Processor -- start 2024-04-25T09:06:48.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.009+0000 7f3f9ce00640 1 -- start start 2024-04-25T09:06:49.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.013+0000 7f3f9ce00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3f980cd520 0x7f3f9806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.013+0000 7f3f9ce00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3f980cf560 0x7f3f980cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.013+0000 7f3f9ce00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f980cda00 con 0x7f3f9815a900 2024-04-25T09:06:49.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.013+0000 7f3f9ce00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9815bcf0 con 0x7f3f980cd520 2024-04-25T09:06:49.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.013+0000 7f3f9ce00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f980cfef0 con 0x7f3f980cf560 2024-04-25T09:06:49.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.013+0000 7f3f8d400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3f980cd520 0x7f3f9806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.013+0000 7f3f8d400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3f980cd520 0x7f3f9806e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59290/0 (socket says 172.21.15.175:59290) 2024-04-25T09:06:49.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.013+0000 7f3f8d400640 1 -- 172.21.15.175:0/3230243908 learned_addr learned my addr 172.21.15.175:0/3230243908 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:49.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.013+0000 7f3f96800640 1 --2- 172.21.15.175:0/3230243908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3f980cf560 0x7f3f980cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.013+0000 7f3f8d400640 1 -- 172.21.15.175:0/3230243908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3f980cf560 msgr2=0x7f3f980cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:49.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.013+0000 7f3f8d400640 1 --2- 172.21.15.175:0/3230243908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3f980cf560 0x7f3f980cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.013+0000 7f3f8d400640 1 -- 172.21.15.175:0/3230243908 >> v1:172.21.15.177:6789/0 conn(0x7f3f9815a900 legacy=0x7f3f980ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.013+0000 7f3f8d400640 1 -- 172.21.15.175:0/3230243908 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f980cdce0 con 0x7f3f980cd520 2024-04-25T09:06:49.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.013+0000 7f3f8d400640 1 --2- 172.21.15.175:0/3230243908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f980cd520 0x7f3f9806e150 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3f80009870 tx=0x7f3f8001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73bc10e8b1059baa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.013+0000 7f3f95400640 1 -- 172.21.15.175:0/3230243908 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f800ab650 con 0x7f3f980cd520 2024-04-25T09:06:49.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f95400640 1 -- 172.21.15.175:0/3230243908 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f800b0070 con 0x7f3f980cd520 2024-04-25T09:06:49.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f95400640 1 -- 172.21.15.175:0/3230243908 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f800aba10 con 0x7f3f980cd520 2024-04-25T09:06:49.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f9ce00640 1 -- 172.21.15.175:0/3230243908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f980cd520 msgr2=0x7f3f9806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f9ce00640 1 --2- 172.21.15.175:0/3230243908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f980cd520 0x7f3f9806e150 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3f80009870 tx=0x7f3f8001c560 comp rx=0 tx=0).stop 2024-04-25T09:06:49.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f9ce00640 1 -- 172.21.15.175:0/3230243908 shutdown_connections 2024-04-25T09:06:49.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f9ce00640 1 --2- 172.21.15.175:0/3230243908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3f980cf560 0x7f3f980cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f9ce00640 1 --2- 172.21.15.175:0/3230243908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f980cd520 0x7f3f9806e150 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f9ce00640 1 -- 172.21.15.175:0/3230243908 >> 172.21.15.175:0/3230243908 conn(0x7f3f98067150 msgr2=0x7f3f9806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:49.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f9ce00640 1 -- 172.21.15.175:0/3230243908 shutdown_connections 2024-04-25T09:06:49.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f9ce00640 1 -- 172.21.15.175:0/3230243908 wait complete. 2024-04-25T09:06:49.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f9ce00640 1 Processor -- start 2024-04-25T09:06:49.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f9ce00640 1 -- start start 2024-04-25T09:06:49.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f9ce00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3f980cf560 0x7f3f981499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f9ce00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f9815a900 0x7f3f9814d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f9ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f9814a020 0x7f3f98154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f9ce00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9806d530 con 0x7f3f9814a020 2024-04-25T09:06:49.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f9ce00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9806d3b0 con 0x7f3f9815a900 2024-04-25T09:06:49.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f9ce00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9815c790 con 0x7f3f980cf560 2024-04-25T09:06:49.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f96800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f9814a020 0x7f3f98154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f96800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f9814a020 0x7f3f98154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:59292/0 (socket says 172.21.15.175:59292) 2024-04-25T09:06:49.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f96800640 1 -- 172.21.15.175:0/3829388798 learned_addr learned my addr 172.21.15.175:0/3829388798 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:49.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f95e00640 1 --2- 172.21.15.175:0/3829388798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3f980cf560 0x7f3f981499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.017+0000 7f3f8d400640 1 --2- 172.21.15.175:0/3829388798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f9815a900 0x7f3f9814d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.021+0000 7f3f96800640 1 -- 172.21.15.175:0/3829388798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3f980cf560 msgr2=0x7f3f981499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.021+0000 7f3f96800640 1 --2- 172.21.15.175:0/3829388798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3f980cf560 0x7f3f981499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.021+0000 7f3f96800640 1 -- 172.21.15.175:0/3829388798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f9815a900 msgr2=0x7f3f9814d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.021+0000 7f3f96800640 1 --2- 172.21.15.175:0/3829388798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f9815a900 0x7f3f9814d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.021+0000 7f3f96800640 1 -- 172.21.15.175:0/3829388798 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9814dff0 con 0x7f3f9814a020 2024-04-25T09:06:49.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.021+0000 7f3f8d400640 1 --2- 172.21.15.175:0/3829388798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f9815a900 0x7f3f9814d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:49.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.021+0000 7f3f96800640 1 --2- 172.21.15.175:0/3829388798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f9814a020 0x7f3f98154370 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000d800 tx=0x7f3f9000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.021+0000 7f3f8ea00640 1 -- 172.21.15.175:0/3829388798 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000b6c0 con 0x7f3f9814a020 2024-04-25T09:06:49.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.021+0000 7f3f8ea00640 1 -- 172.21.15.175:0/3829388798 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f90019070 con 0x7f3f9814a020 2024-04-25T09:06:49.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.021+0000 7f3f8ea00640 1 -- 172.21.15.175:0/3829388798 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9000baa0 con 0x7f3f9814a020 2024-04-25T09:06:49.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.021+0000 7f3f9ce00640 1 -- 172.21.15.175:0/3829388798 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9814e330 con 0x7f3f9814a020 2024-04-25T09:06:49.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.021+0000 7f3f9ce00640 1 -- 172.21.15.175:0/3829388798 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9814e5d0 con 0x7f3f9814a020 2024-04-25T09:06:49.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.021+0000 7f3f9ce00640 1 -- 172.21.15.175:0/3829388798 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f98074a60 con 0x7f3f9814a020 2024-04-25T09:06:49.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.021+0000 7f3f8ea00640 1 -- 172.21.15.175:0/3829388798 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3f9000bc40 con 0x7f3f9814a020 2024-04-25T09:06:49.012 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.021+0000 7f3f8ea00640 1 --2- 172.21.15.175:0/3829388798 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3f74066f90 0x7f3f74069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.012 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.021+0000 7f3f8ea00640 1 -- 172.21.15.175:0/3829388798 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f900852c0 con 0x7f3f9814a020 2024-04-25T09:06:49.012 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.021+0000 7f3f95e00640 1 --2- 172.21.15.175:0/3829388798 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3f74066f90 0x7f3f74069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.012 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.025+0000 7f3f95e00640 1 --2- 172.21.15.175:0/3829388798 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3f74066f90 0x7f3f74069450 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3f88001e00 tx=0x7f3f88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.025+0000 7f3f8ea00640 1 -- 172.21.15.175:0/3829388798 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3f90055c80 con 0x7f3f9814a020 2024-04-25T09:06:49.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.177+0000 7f3f9ce00640 1 -- 172.21.15.175:0/3829388798 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f9806adf0 con 0x7f3f74066f90 2024-04-25T09:06:49.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.185+0000 7f3f8ea00640 1 -- 172.21.15.175:0/3829388798 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+239859 (secure 0 0 0) 0x7f3f9806adf0 con 0x7f3f74066f90 2024-04-25T09:06:49.175 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:49.177 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:06:49.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.189+0000 7f3f9ce00640 1 -- 172.21.15.175:0/3829388798 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3f74066f90 msgr2=0x7f3f74069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.189+0000 7f3f9ce00640 1 --2- 172.21.15.175:0/3829388798 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3f74066f90 0x7f3f74069450 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3f88001e00 tx=0x7f3f88009040 comp rx=0 tx=0).stop 2024-04-25T09:06:49.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.189+0000 7f3f9ce00640 1 -- 172.21.15.175:0/3829388798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f9814a020 msgr2=0x7f3f98154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.189+0000 7f3f9ce00640 1 --2- 172.21.15.175:0/3829388798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f9814a020 0x7f3f98154370 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3f9000d800 tx=0x7f3f9000dcc0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.189+0000 7f3f9ce00640 1 -- 172.21.15.175:0/3829388798 shutdown_connections 2024-04-25T09:06:49.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.189+0000 7f3f9ce00640 1 --2- 172.21.15.175:0/3829388798 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3f74066f90 0x7f3f74069450 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.189+0000 7f3f9ce00640 1 --2- 172.21.15.175:0/3829388798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3f9814a020 0x7f3f98154370 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.189+0000 7f3f9ce00640 1 --2- 172.21.15.175:0/3829388798 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3f9815a900 0x7f3f9814d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.189+0000 7f3f9ce00640 1 --2- 172.21.15.175:0/3829388798 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3f980cf560 0x7f3f981499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.189+0000 7f3f9ce00640 1 -- 172.21.15.175:0/3829388798 >> 172.21.15.175:0/3829388798 conn(0x7f3f980cd520 msgr2=0x7f3f9806d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:49.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.189+0000 7f3f9ce00640 1 -- 172.21.15.175:0/3829388798 shutdown_connections 2024-04-25T09:06:49.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.189+0000 7f3f9ce00640 1 -- 172.21.15.175:0/3829388798 wait complete. 2024-04-25T09:06:49.195 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2024-04-25T09:06:47.824537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":226616,"kb_used_data":6240,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748104,"statfs":{"total":773094113280,"available":772862058496,"internally_reserved":0,"allocated":6389760,"data_stored":3309138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.500297"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.333966+0000","last_change":"2024-04-25T09:06:42.333966+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.333966+0000","last_undegraded":"2024-04-25T09:06:42.333966+0000","last_fullsized":"2024-04-25T09:06:42.333966+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.334223+0000","last_change":"2024-04-25T09:06:42.334223+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.334223+0000","last_undegraded":"2024-04-25T09:06:42.334223+0000","last_fullsized":"2024-04-25T09:06:42.334223+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.334728+0000","last_change":"2024-04-25T09:06:42.334728+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.334728+0000","last_undegraded":"2024-04-25T09:06:42.334728+0000","last_fullsized":"2024-04-25T09:06:42.334728+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.328890+0000","last_change":"2024-04-25T09:06:42.328890+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.328890+0000","last_undegraded":"2024-04-25T09:06:42.328890+0000","last_fullsized":"2024-04-25T09:06:42.328890+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.330663+0000","last_change":"2024-04-25T09:06:42.330663+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.330663+0000","last_undegraded":"2024-04-25T09:06:42.330663+0000","last_fullsized":"2024-04-25T09:06:42.330663+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.333853+0000","last_change":"2024-04-25T09:06:42.333853+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.333853+0000","last_undegraded":"2024-04-25T09:06:42.333853+0000","last_fullsized":"2024-04-25T09:06:42.333853+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.328893+0000","last_change":"2024-04-25T09:06:42.328893+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.328893+0000","last_undegraded":"2024-04-25T09:06:42.328893+0000","last_fullsized":"2024-04-25T09:06:42.328893+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.329284+0000","last_change":"2024-04-25T09:06:42.329284+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.329284+0000","last_undegraded":"2024-04-25T09:06:42.329284+0000","last_fullsized":"2024-04-25T09:06:42.329284+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.325708+0000","last_change":"2024-04-25T09:06:42.325708+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.325708+0000","last_undegraded":"2024-04-25T09:06:42.325708+0000","last_fullsized":"2024-04-25T09:06:42.325708+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.331613+0000","last_change":"2024-04-25T09:06:42.331613+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.331613+0000","last_undegraded":"2024-04-25T09:06:42.331613+0000","last_fullsized":"2024-04-25T09:06:42.331613+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.325583+0000","last_change":"2024-04-25T09:06:42.325583+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.325583+0000","last_undegraded":"2024-04-25T09:06:42.325583+0000","last_fullsized":"2024-04-25T09:06:42.325583+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.329276+0000","last_change":"2024-04-25T09:06:42.329276+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.329276+0000","last_undegraded":"2024-04-25T09:06:42.329276+0000","last_fullsized":"2024-04-25T09:06:42.329276+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.332744+0000","last_change":"2024-04-25T09:06:42.332744+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.332744+0000","last_undegraded":"2024-04-25T09:06:42.332744+0000","last_fullsized":"2024-04-25T09:06:42.332744+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.325931+0000","last_change":"2024-04-25T09:06:42.325931+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.325931+0000","last_undegraded":"2024-04-25T09:06:42.325931+0000","last_fullsized":"2024-04-25T09:06:42.325931+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.328334+0000","last_change":"2024-04-25T09:06:42.328334+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.328334+0000","last_undegraded":"2024-04-25T09:06:42.328334+0000","last_fullsized":"2024-04-25T09:06:42.328334+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.325530+0000","last_change":"2024-04-25T09:06:42.325530+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.325530+0000","last_undegraded":"2024-04-25T09:06:42.325530+0000","last_fullsized":"2024-04-25T09:06:42.325530+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.331904+0000","last_change":"2024-04-25T09:06:42.331904+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.331904+0000","last_undegraded":"2024-04-25T09:06:42.331904+0000","last_fullsized":"2024-04-25T09:06:42.331904+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.331403+0000","last_change":"2024-04-25T09:06:42.331403+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.331403+0000","last_undegraded":"2024-04-25T09:06:42.331403+0000","last_fullsized":"2024-04-25T09:06:42.331403+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.328369+0000","last_change":"2024-04-25T09:06:42.328369+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.328369+0000","last_undegraded":"2024-04-25T09:06:42.328369+0000","last_fullsized":"2024-04-25T09:06:42.328369+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.331537+0000","last_change":"2024-04-25T09:06:42.331537+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.331537+0000","last_undegraded":"2024-04-25T09:06:42.331537+0000","last_fullsized":"2024-04-25T09:06:42.331537+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.332218+0000","last_change":"2024-04-25T09:06:42.332218+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.332218+0000","last_undegraded":"2024-04-25T09:06:42.332218+0000","last_fullsized":"2024-04-25T09:06:42.332218+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.331412+0000","last_change":"2024-04-25T09:06:42.331412+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.331412+0000","last_undegraded":"2024-04-25T09:06:42.331412+0000","last_fullsized":"2024-04-25T09:06:42.331412+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.328263+0000","last_change":"2024-04-25T09:06:42.328263+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.328263+0000","last_undegraded":"2024-04-25T09:06:42.328263+0000","last_fullsized":"2024-04-25T09:06:42.328263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.330859+0000","last_change":"2024-04-25T09:06:42.330859+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.330859+0000","last_undegraded":"2024-04-25T09:06:42.330859+0000","last_fullsized":"2024-04-25T09:06:42.330859+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.330908+0000","last_change":"2024-04-25T09:06:42.330908+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.330908+0000","last_undegraded":"2024-04-25T09:06:42.330908+0000","last_fullsized":"2024-04-25T09:06:42.330908+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.326445+0000","last_change":"2024-04-25T09:06:42.326445+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.326445+0000","last_undegraded":"2024-04-25T09:06:42.326445+0000","last_fullsized":"2024-04-25T09:06:42.326445+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.328285+0000","last_change":"2024-04-25T09:06:42.328285+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.328285+0000","last_undegraded":"2024-04-25T09:06:42.328285+0000","last_fullsized":"2024-04-25T09:06:42.328285+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.331258+0000","last_change":"2024-04-25T09:06:42.331258+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.331258+0000","last_undegraded":"2024-04-25T09:06:42.331258+0000","last_fullsized":"2024-04-25T09:06:42.331258+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.329391+0000","last_change":"2024-04-25T09:06:42.329391+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.329391+0000","last_undegraded":"2024-04-25T09:06:42.329391+0000","last_fullsized":"2024-04-25T09:06:42.329391+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.330834+0000","last_change":"2024-04-25T09:06:42.330834+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.330834+0000","last_undegraded":"2024-04-25T09:06:42.330834+0000","last_fullsized":"2024-04-25T09:06:42.330834+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.330982+0000","last_change":"2024-04-25T09:06:42.330982+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.330982+0000","last_undegraded":"2024-04-25T09:06:42.330982+0000","last_fullsized":"2024-04-25T09:06:42.330982+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:06:43.321231+0000","last_change":"2024-04-25T09:06:43.321231+0000","last_active":"2024-04-25T09:06:43.321231+0000","last_peered":"2024-04-25T09:06:43.321231+0000","last_clean":"2024-04-25T09:06:43.321231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:43.321231+0000","last_undegraded":"2024-04-25T09:06:43.321231+0000","last_fullsized":"2024-04-25T09:06:43.321231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-04-25T09:06:42.325887+0000","last_change":"2024-04-25T09:06:42.325887+0000","last_active":"2024-04-25T09:06:42.313990+0000","last_peered":"2024-04-25T09:06:42.313990+0000","last_clean":"2024-04-25T09:06:42.313990+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:06:42.325887+0000","last_undegraded":"2024-04-25T09:06:42.325887+0000","last_fullsized":"2024-04-25T09:06:42.325887+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":234,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-25T09:06:42.327097+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:06:42.327097+0000","last_peered":"2024-04-25T09:06:42.327097+0000","last_clean":"2024-04-25T09:06:42.327097+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:06:42.327097+0000","last_undegraded":"2024-04-25T09:06:42.327097+0000","last_fullsized":"2024-04-25T09:06:42.327097+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1253376,"data_stored":860781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":647168,"data_stored":264596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":659456,"data_stored":270413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":647168,"data_stored":264596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":264596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":264596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":647168,"data_stored":264596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1241088,"data_stored":854964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:06:49.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2024-04-25T09:06:49.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2024-04-25T09:06:49.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2024-04-25T09:06:49.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2024-04-25T09:06:49.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2024-04-25T09:06:49.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2024-04-25T09:06:49.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2024-04-25T09:06:49.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2024-04-25T09:06:49.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2024-04-25T09:06:49.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2024-04-25T09:06:49.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2024-04-25T09:06:49.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2024-04-25T09:06:49.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2024-04-25T09:06:49.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2024-04-25T09:06:49.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2024-04-25T09:06:49.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2024-04-25T09:06:49.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2024-04-25T09:06:49.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2024-04-25T09:06:49.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2024-04-25T09:06:49.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2024-04-25T09:06:49.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2024-04-25T09:06:49.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2024-04-25T09:06:49.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2024-04-25T09:06:49.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2024-04-25T09:06:49.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2024-04-25T09:06:49.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2024-04-25T09:06:49.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2024-04-25T09:06:49.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2024-04-25T09:06:49.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2024-04-25T09:06:49.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2024-04-25T09:06:49.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2024-04-25T09:06:49.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2024-04-25T09:06:49.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2024-04-25T09:06:49.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2024-04-25T09:06:49.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.333966+0000', 'last_change': '2024-04-25T09:06:42.333966+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.333966+0000', 'last_undegraded': '2024-04-25T09:06:42.333966+0000', 'last_fullsized': '2024-04-25T09:06:42.333966+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:06:49.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2024-04-25T09:06:49.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2024-04-25T09:06:49.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.334223+0000', 'last_change': '2024-04-25T09:06:42.334223+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.334223+0000', 'last_undegraded': '2024-04-25T09:06:42.334223+0000', 'last_fullsized': '2024-04-25T09:06:42.334223+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:06:49.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2024-04-25T09:06:49.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2024-04-25T09:06:49.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.334728+0000', 'last_change': '2024-04-25T09:06:42.334728+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.334728+0000', 'last_undegraded': '2024-04-25T09:06:42.334728+0000', 'last_fullsized': '2024-04-25T09:06:42.334728+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:06:49.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2024-04-25T09:06:49.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2024-04-25T09:06:49.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.328890+0000', 'last_change': '2024-04-25T09:06:42.328890+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.328890+0000', 'last_undegraded': '2024-04-25T09:06:42.328890+0000', 'last_fullsized': '2024-04-25T09:06:42.328890+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:06:49.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2024-04-25T09:06:49.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2024-04-25T09:06:49.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.330663+0000', 'last_change': '2024-04-25T09:06:42.330663+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.330663+0000', 'last_undegraded': '2024-04-25T09:06:42.330663+0000', 'last_fullsized': '2024-04-25T09:06:42.330663+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:06:49.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2024-04-25T09:06:49.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2024-04-25T09:06:49.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.333853+0000', 'last_change': '2024-04-25T09:06:42.333853+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.333853+0000', 'last_undegraded': '2024-04-25T09:06:42.333853+0000', 'last_fullsized': '2024-04-25T09:06:42.333853+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:06:49.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2024-04-25T09:06:49.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2024-04-25T09:06:49.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.328893+0000', 'last_change': '2024-04-25T09:06:42.328893+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.328893+0000', 'last_undegraded': '2024-04-25T09:06:42.328893+0000', 'last_fullsized': '2024-04-25T09:06:42.328893+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:06:49.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2024-04-25T09:06:49.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2024-04-25T09:06:49.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.329284+0000', 'last_change': '2024-04-25T09:06:42.329284+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.329284+0000', 'last_undegraded': '2024-04-25T09:06:42.329284+0000', 'last_fullsized': '2024-04-25T09:06:42.329284+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:06:49.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2024-04-25T09:06:49.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2024-04-25T09:06:49.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.325708+0000', 'last_change': '2024-04-25T09:06:42.325708+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.325708+0000', 'last_undegraded': '2024-04-25T09:06:42.325708+0000', 'last_fullsized': '2024-04-25T09:06:42.325708+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:06:49.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2024-04-25T09:06:49.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2024-04-25T09:06:49.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.331613+0000', 'last_change': '2024-04-25T09:06:42.331613+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.331613+0000', 'last_undegraded': '2024-04-25T09:06:42.331613+0000', 'last_fullsized': '2024-04-25T09:06:42.331613+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:06:49.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2024-04-25T09:06:49.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2024-04-25T09:06:49.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.325583+0000', 'last_change': '2024-04-25T09:06:42.325583+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.325583+0000', 'last_undegraded': '2024-04-25T09:06:42.325583+0000', 'last_fullsized': '2024-04-25T09:06:42.325583+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:06:49.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2024-04-25T09:06:49.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2024-04-25T09:06:49.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.329276+0000', 'last_change': '2024-04-25T09:06:42.329276+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.329276+0000', 'last_undegraded': '2024-04-25T09:06:42.329276+0000', 'last_fullsized': '2024-04-25T09:06:42.329276+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:06:49.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2024-04-25T09:06:49.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2024-04-25T09:06:49.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.332744+0000', 'last_change': '2024-04-25T09:06:42.332744+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.332744+0000', 'last_undegraded': '2024-04-25T09:06:42.332744+0000', 'last_fullsized': '2024-04-25T09:06:42.332744+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:06:49.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2024-04-25T09:06:49.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2024-04-25T09:06:49.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.325931+0000', 'last_change': '2024-04-25T09:06:42.325931+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.325931+0000', 'last_undegraded': '2024-04-25T09:06:42.325931+0000', 'last_fullsized': '2024-04-25T09:06:42.325931+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:06:49.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2024-04-25T09:06:49.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2024-04-25T09:06:49.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.328334+0000', 'last_change': '2024-04-25T09:06:42.328334+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.328334+0000', 'last_undegraded': '2024-04-25T09:06:42.328334+0000', 'last_fullsized': '2024-04-25T09:06:42.328334+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:06:49.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2024-04-25T09:06:49.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2024-04-25T09:06:49.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.325530+0000', 'last_change': '2024-04-25T09:06:42.325530+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.325530+0000', 'last_undegraded': '2024-04-25T09:06:42.325530+0000', 'last_fullsized': '2024-04-25T09:06:42.325530+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:06:49.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2024-04-25T09:06:49.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2024-04-25T09:06:49.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.331904+0000', 'last_change': '2024-04-25T09:06:42.331904+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.331904+0000', 'last_undegraded': '2024-04-25T09:06:42.331904+0000', 'last_fullsized': '2024-04-25T09:06:42.331904+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:06:49.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2024-04-25T09:06:49.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2024-04-25T09:06:49.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.331403+0000', 'last_change': '2024-04-25T09:06:42.331403+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.331403+0000', 'last_undegraded': '2024-04-25T09:06:42.331403+0000', 'last_fullsized': '2024-04-25T09:06:42.331403+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:06:49.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2024-04-25T09:06:49.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2024-04-25T09:06:49.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.328369+0000', 'last_change': '2024-04-25T09:06:42.328369+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.328369+0000', 'last_undegraded': '2024-04-25T09:06:42.328369+0000', 'last_fullsized': '2024-04-25T09:06:42.328369+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:06:49.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2024-04-25T09:06:49.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2024-04-25T09:06:49.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.331537+0000', 'last_change': '2024-04-25T09:06:42.331537+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.331537+0000', 'last_undegraded': '2024-04-25T09:06:42.331537+0000', 'last_fullsized': '2024-04-25T09:06:42.331537+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:06:49.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2024-04-25T09:06:49.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2024-04-25T09:06:49.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.332218+0000', 'last_change': '2024-04-25T09:06:42.332218+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.332218+0000', 'last_undegraded': '2024-04-25T09:06:42.332218+0000', 'last_fullsized': '2024-04-25T09:06:42.332218+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:06:49.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2024-04-25T09:06:49.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2024-04-25T09:06:49.212 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.331412+0000', 'last_change': '2024-04-25T09:06:42.331412+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.331412+0000', 'last_undegraded': '2024-04-25T09:06:42.331412+0000', 'last_fullsized': '2024-04-25T09:06:42.331412+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:06:49.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2024-04-25T09:06:49.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2024-04-25T09:06:49.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.328263+0000', 'last_change': '2024-04-25T09:06:42.328263+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.328263+0000', 'last_undegraded': '2024-04-25T09:06:42.328263+0000', 'last_fullsized': '2024-04-25T09:06:42.328263+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:06:49.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2024-04-25T09:06:49.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2024-04-25T09:06:49.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.330859+0000', 'last_change': '2024-04-25T09:06:42.330859+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.330859+0000', 'last_undegraded': '2024-04-25T09:06:42.330859+0000', 'last_fullsized': '2024-04-25T09:06:42.330859+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:06:49.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2024-04-25T09:06:49.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2024-04-25T09:06:49.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.330908+0000', 'last_change': '2024-04-25T09:06:42.330908+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.330908+0000', 'last_undegraded': '2024-04-25T09:06:42.330908+0000', 'last_fullsized': '2024-04-25T09:06:42.330908+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:06:49.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2024-04-25T09:06:49.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2024-04-25T09:06:49.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.326445+0000', 'last_change': '2024-04-25T09:06:42.326445+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.326445+0000', 'last_undegraded': '2024-04-25T09:06:42.326445+0000', 'last_fullsized': '2024-04-25T09:06:42.326445+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:06:49.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2024-04-25T09:06:49.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2024-04-25T09:06:49.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.328285+0000', 'last_change': '2024-04-25T09:06:42.328285+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.328285+0000', 'last_undegraded': '2024-04-25T09:06:42.328285+0000', 'last_fullsized': '2024-04-25T09:06:42.328285+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:06:49.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2024-04-25T09:06:49.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2024-04-25T09:06:49.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.331258+0000', 'last_change': '2024-04-25T09:06:42.331258+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.331258+0000', 'last_undegraded': '2024-04-25T09:06:42.331258+0000', 'last_fullsized': '2024-04-25T09:06:42.331258+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:06:49.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2024-04-25T09:06:49.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2024-04-25T09:06:49.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.329391+0000', 'last_change': '2024-04-25T09:06:42.329391+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.329391+0000', 'last_undegraded': '2024-04-25T09:06:42.329391+0000', 'last_fullsized': '2024-04-25T09:06:42.329391+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:06:49.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2024-04-25T09:06:49.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2024-04-25T09:06:49.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.330834+0000', 'last_change': '2024-04-25T09:06:42.330834+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.330834+0000', 'last_undegraded': '2024-04-25T09:06:42.330834+0000', 'last_fullsized': '2024-04-25T09:06:42.330834+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:06:49.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2024-04-25T09:06:49.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2024-04-25T09:06:49.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.330982+0000', 'last_change': '2024-04-25T09:06:42.330982+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.330982+0000', 'last_undegraded': '2024-04-25T09:06:42.330982+0000', 'last_fullsized': '2024-04-25T09:06:42.330982+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:06:49.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2024-04-25T09:06:49.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T09:06:43.321231+0000', 'last_change': '2024-04-25T09:06:43.321231+0000', 'last_active': '2024-04-25T09:06:43.321231+0000', 'last_peered': '2024-04-25T09:06:43.321231+0000', 'last_clean': '2024-04-25T09:06:43.321231+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:43.321231+0000', 'last_undegraded': '2024-04-25T09:06:43.321231+0000', 'last_fullsized': '2024-04-25T09:06:43.321231+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:43.321231+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T09:06:49.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2024-04-25T09:06:49.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:06:42.325887+0000', 'last_change': '2024-04-25T09:06:42.325887+0000', 'last_active': '2024-04-25T09:06:42.313990+0000', 'last_peered': '2024-04-25T09:06:42.313990+0000', 'last_clean': '2024-04-25T09:06:42.313990+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:06:42.325887+0000', 'last_undegraded': '2024-04-25T09:06:42.325887+0000', 'last_fullsized': '2024-04-25T09:06:42.325887+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'last_clean_scrub_stamp': '2024-04-25T09:06:42.313990+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:06:49.217 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:06:49.305 INFO:tasks.ceph.mds.a.smithi175.stderr:2024-04-25T09:06:49.317+0000 7f3265800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:06:49.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.385+0000 7fe702800640 1 Processor -- start 2024-04-25T09:06:49.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.385+0000 7fe702800640 1 -- start start 2024-04-25T09:06:49.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.385+0000 7fe702800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe6fc15a900 0x7fe6fc06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.385+0000 7fe702800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe6fc0cd520 0x7fe6fc0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.385+0000 7fe702800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6fc0cda00 con 0x7fe6fc0cf560 2024-04-25T09:06:49.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.385+0000 7fe702800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6fc15bcf0 con 0x7fe6fc15a900 2024-04-25T09:06:49.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.385+0000 7fe702800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6fc0cdce0 con 0x7fe6fc0cd520 2024-04-25T09:06:49.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.385+0000 7fe6fb400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe6fc15a900 0x7fe6fc06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.385+0000 7fe6fb400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe6fc15a900 0x7fe6fc06e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34752/0 (socket says 172.21.15.175:34752) 2024-04-25T09:06:49.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.389+0000 7fe6fb400640 1 -- 172.21.15.175:0/3397978578 learned_addr learned my addr 172.21.15.175:0/3397978578 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:49.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.389+0000 7fe6f2a00640 1 --2- 172.21.15.175:0/3397978578 >> v2:172.21.15.177:3300/0 conn(0x7fe6fc0cd520 0x7fe6fc0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.389+0000 7fe6fb400640 1 -- 172.21.15.175:0/3397978578 >> v2:172.21.15.177:3300/0 conn(0x7fe6fc0cd520 msgr2=0x7fe6fc0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:49.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.389+0000 7fe6fb400640 1 --2- 172.21.15.175:0/3397978578 >> v2:172.21.15.177:3300/0 conn(0x7fe6fc0cd520 0x7fe6fc0ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.389+0000 7fe6fb400640 1 -- 172.21.15.175:0/3397978578 >> v1:172.21.15.177:6789/0 conn(0x7fe6fc0cf560 legacy=0x7fe6fc15bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:49.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.389+0000 7fe6fb400640 1 -- 172.21.15.175:0/3397978578 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc0cdfc0 con 0x7fe6fc15a900 2024-04-25T09:06:49.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.389+0000 7fe6f2a00640 1 --2- 172.21.15.175:0/3397978578 >> v2:172.21.15.177:3300/0 conn(0x7fe6fc0cd520 0x7fe6fc0ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:49.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.389+0000 7fe6fb400640 1 --2- 172.21.15.175:0/3397978578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6fc15a900 0x7fe6fc06e150 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0cf510 tx=0x7fe6ec01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ccc7b5756709d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.393+0000 7fe6faa00640 1 -- 172.21.15.175:0/3397978578 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0b1070 con 0x7fe6fc15a900 2024-04-25T09:06:49.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.393+0000 7fe6faa00640 1 -- 172.21.15.175:0/3397978578 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0ac620 con 0x7fe6fc15a900 2024-04-25T09:06:49.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.393+0000 7fe6faa00640 1 -- 172.21.15.175:0/3397978578 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0ac9f0 con 0x7fe6fc15a900 2024-04-25T09:06:49.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.393+0000 7fe702800640 1 -- 172.21.15.175:0/3397978578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6fc15a900 msgr2=0x7fe6fc06e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.393+0000 7fe702800640 1 --2- 172.21.15.175:0/3397978578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6fc15a900 0x7fe6fc06e150 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc0cf510 tx=0x7fe6ec01c4b0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.393+0000 7fe702800640 1 -- 172.21.15.175:0/3397978578 shutdown_connections 2024-04-25T09:06:49.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.393+0000 7fe702800640 1 --2- 172.21.15.175:0/3397978578 >> v2:172.21.15.177:3300/0 conn(0x7fe6fc0cd520 0x7fe6fc0ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.393+0000 7fe702800640 1 --2- 172.21.15.175:0/3397978578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6fc15a900 0x7fe6fc06e150 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.393+0000 7fe702800640 1 -- 172.21.15.175:0/3397978578 >> 172.21.15.175:0/3397978578 conn(0x7fe6fc067150 msgr2=0x7fe6fc06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:49.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.393+0000 7fe702800640 1 -- 172.21.15.175:0/3397978578 shutdown_connections 2024-04-25T09:06:49.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.393+0000 7fe702800640 1 -- 172.21.15.175:0/3397978578 wait complete. 2024-04-25T09:06:49.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe702800640 1 Processor -- start 2024-04-25T09:06:49.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe702800640 1 -- start start 2024-04-25T09:06:49.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe702800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6fc0cf560 0x7fe6fc144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe702800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6fc15a900 0x7fe6fc14dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe702800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6fc14e520 0x7fe6fc0b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe702800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc0cf160 con 0x7fe6fc15a900 2024-04-25T09:06:49.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe702800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc0cefe0 con 0x7fe6fc0cf560 2024-04-25T09:06:49.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe702800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc06d3b0 con 0x7fe6fc14e520 2024-04-25T09:06:49.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe6f2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6fc15a900 0x7fe6fc14dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe6f2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6fc15a900 0x7fe6fc14dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34754/0 (socket says 172.21.15.175:34754) 2024-04-25T09:06:49.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe6f2a00640 1 -- 172.21.15.175:0/4240624964 learned_addr learned my addr 172.21.15.175:0/4240624964 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:49.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe6fb400640 1 --2- 172.21.15.175:0/4240624964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6fc0cf560 0x7fe6fc144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe6fbe00640 1 --2- 172.21.15.175:0/4240624964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6fc14e520 0x7fe6fc0b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe6f2a00640 1 -- 172.21.15.175:0/4240624964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6fc14e520 msgr2=0x7fe6fc0b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe6f2a00640 1 --2- 172.21.15.175:0/4240624964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6fc14e520 0x7fe6fc0b07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe6f2a00640 1 -- 172.21.15.175:0/4240624964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6fc0cf560 msgr2=0x7fe6fc144c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe6f2a00640 1 --2- 172.21.15.175:0/4240624964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6fc0cf560 0x7fe6fc144c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe6f2a00640 1 -- 172.21.15.175:0/4240624964 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc0b13e0 con 0x7fe6fc15a900 2024-04-25T09:06:49.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe6fbe00640 1 --2- 172.21.15.175:0/4240624964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6fc14e520 0x7fe6fc0b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:49.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe6f2a00640 1 --2- 172.21.15.175:0/4240624964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6fc15a900 0x7fe6fc14dfe0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400c820 tx=0x7fe6e400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe6f3e00640 1 -- 172.21.15.175:0/4240624964 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4015070 con 0x7fe6fc15a900 2024-04-25T09:06:49.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe6f3e00640 1 -- 172.21.15.175:0/4240624964 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e4007a30 con 0x7fe6fc15a900 2024-04-25T09:06:49.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe6f3e00640 1 -- 172.21.15.175:0/4240624964 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4007e00 con 0x7fe6fc15a900 2024-04-25T09:06:49.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe702800640 1 -- 172.21.15.175:0/4240624964 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6fc0b16c0 con 0x7fe6fc15a900 2024-04-25T09:06:49.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe702800640 1 -- 172.21.15.175:0/4240624964 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6fc1451c0 con 0x7fe6fc15a900 2024-04-25T09:06:49.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.397+0000 7fe702800640 1 -- 172.21.15.175:0/4240624964 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6fc06ea80 con 0x7fe6fc15a900 2024-04-25T09:06:49.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.401+0000 7fe6f3e00640 1 -- 172.21.15.175:0/4240624964 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe6e4018070 con 0x7fe6fc15a900 2024-04-25T09:06:49.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.401+0000 7fe6f3e00640 1 --2- 172.21.15.175:0/4240624964 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe6d8066f60 0x7fe6d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.401+0000 7fe6f3e00640 1 -- 172.21.15.175:0/4240624964 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6e4084ff0 con 0x7fe6fc15a900 2024-04-25T09:06:49.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.401+0000 7fe6fb400640 1 --2- 172.21.15.175:0/4240624964 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe6d8066f60 0x7fe6d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.401+0000 7fe6fb400640 1 --2- 172.21.15.175:0/4240624964 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe6d8066f60 0x7fe6d8069420 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0ae000 tx=0x7fe6ec0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.405+0000 7fe6f3e00640 1 -- 172.21.15.175:0/4240624964 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe6e4055910 con 0x7fe6fc15a900 2024-04-25T09:06:49.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.613+0000 7fe702800640 1 -- 172.21.15.175:0/4240624964 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe6fc074a60 con 0x7fe6fc15a900 2024-04-25T09:06:49.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.613+0000 7fe6f3e00640 1 -- 172.21.15.175:0/4240624964 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1528 (secure 0 0 0) 0x7fe6e40599b0 con 0x7fe6fc15a900 2024-04-25T09:06:49.605 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:49.605 INFO:teuthology.orchestra.run.smithi175.stdout:{"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":184,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":58,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035836,"num_in_osds":8,"osd_in_since":1714035827,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":232054784,"bytes_avail":772862058496,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":32,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5958}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-04-25T09:06:31.821465+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T09:06:49.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.617+0000 7fe702800640 1 -- 172.21.15.175:0/4240624964 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe6d8066f60 msgr2=0x7fe6d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.617+0000 7fe702800640 1 --2- 172.21.15.175:0/4240624964 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe6d8066f60 0x7fe6d8069420 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0ae000 tx=0x7fe6ec0a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:49.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.617+0000 7fe702800640 1 -- 172.21.15.175:0/4240624964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6fc15a900 msgr2=0x7fe6fc14dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.617+0000 7fe702800640 1 --2- 172.21.15.175:0/4240624964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6fc15a900 0x7fe6fc14dfe0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400c820 tx=0x7fe6e400cce0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.617+0000 7fe702800640 1 -- 172.21.15.175:0/4240624964 shutdown_connections 2024-04-25T09:06:49.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.617+0000 7fe702800640 1 --2- 172.21.15.175:0/4240624964 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe6d8066f60 0x7fe6d8069420 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.617+0000 7fe702800640 1 --2- 172.21.15.175:0/4240624964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6fc14e520 0x7fe6fc0b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.617+0000 7fe702800640 1 --2- 172.21.15.175:0/4240624964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6fc15a900 0x7fe6fc14dfe0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.617+0000 7fe702800640 1 --2- 172.21.15.175:0/4240624964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6fc0cf560 0x7fe6fc144c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.617+0000 7fe702800640 1 -- 172.21.15.175:0/4240624964 >> 172.21.15.175:0/4240624964 conn(0x7fe6fc0cd520 msgr2=0x7fe6fc158ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:49.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.617+0000 7fe702800640 1 -- 172.21.15.175:0/4240624964 shutdown_connections 2024-04-25T09:06:49.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.617+0000 7fe702800640 1 -- 172.21.15.175:0/4240624964 wait complete. 2024-04-25T09:06:49.626 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:06:49.626 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:06:49.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.773+0000 7fd4a6200640 1 Processor -- start 2024-04-25T09:06:49.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.773+0000 7fd4a6200640 1 -- start start 2024-04-25T09:06:49.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.773+0000 7fd4a6200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4a0099a50 0x7fd4a006cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.773+0000 7fd4a6200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd4a00d0d50 0x7fd4a00cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.773+0000 7fd4a6200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a00cfcb0 con 0x7fd4a006bd60 2024-04-25T09:06:49.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.773+0000 7fd4a6200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a00cff90 con 0x7fd4a00d0d50 2024-04-25T09:06:49.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.773+0000 7fd4a6200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00d0270 con 0x7fd4a0099a50 2024-04-25T09:06:49.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.773+0000 7fd49fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd4a00d0d50 0x7fd4a00cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.773+0000 7fd49fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd4a00d0d50 0x7fd4a00cbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34768/0 (socket says 172.21.15.175:34768) 2024-04-25T09:06:49.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.773+0000 7fd49fe00640 1 -- 172.21.15.175:0/1059769923 learned_addr learned my addr 172.21.15.175:0/1059769923 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:49.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.773+0000 7fd49ea00640 1 --1- 172.21.15.175:0/1059769923 >> v1:172.21.15.175:6789/0 conn(0x7fd4a006bd60 0x7fd4a0099e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:41952/0 (socket says 172.21.15.175:41952) 2024-04-25T09:06:49.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.773+0000 7fd49f400640 1 --2- 172.21.15.175:0/1059769923 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4a0099a50 0x7fd4a006cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.773+0000 7fd49fe00640 1 -- 172.21.15.175:0/1059769923 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4a0099a50 msgr2=0x7fd4a006cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:49.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.773+0000 7fd49fe00640 1 --2- 172.21.15.175:0/1059769923 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4a0099a50 0x7fd4a006cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.773+0000 7fd49fe00640 1 -- 172.21.15.175:0/1059769923 >> v1:172.21.15.175:6789/0 conn(0x7fd4a006bd60 legacy=0x7fd4a0099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.773+0000 7fd49fe00640 1 -- 172.21.15.175:0/1059769923 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a00d0550 con 0x7fd4a00d0d50 2024-04-25T09:06:49.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.773+0000 7fd49e000640 1 -- 172.21.15.175:0/1059769923 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533389629 0 0) 0x7fd4a00cfcb0 con 0x7fd4a006bd60 2024-04-25T09:06:49.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.777+0000 7fd49fe00640 1 --2- 172.21.15.175:0/1059769923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4a00d0d50 0x7fd4a00cbe60 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd498009e50 tx=0x7fd49801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c133e7316d4d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.777+0000 7fd49e000640 1 -- 172.21.15.175:0/1059769923 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4980a5700 con 0x7fd4a00d0d50 2024-04-25T09:06:49.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.777+0000 7fd49e000640 1 -- 172.21.15.175:0/1059769923 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4980a58a0 con 0x7fd4a00d0d50 2024-04-25T09:06:49.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.777+0000 7fd49e000640 1 -- 172.21.15.175:0/1059769923 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4980a5c70 con 0x7fd4a00d0d50 2024-04-25T09:06:49.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.777+0000 7fd4a6200640 1 -- 172.21.15.175:0/1059769923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4a00d0d50 msgr2=0x7fd4a00cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.777+0000 7fd4a6200640 1 --2- 172.21.15.175:0/1059769923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4a00d0d50 0x7fd4a00cbe60 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd498009e50 tx=0x7fd49801ca30 comp rx=0 tx=0).stop 2024-04-25T09:06:49.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.777+0000 7fd4a6200640 1 -- 172.21.15.175:0/1059769923 shutdown_connections 2024-04-25T09:06:49.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.777+0000 7fd4a6200640 1 --2- 172.21.15.175:0/1059769923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4a00d0d50 0x7fd4a00cbe60 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.777+0000 7fd4a6200640 1 --2- 172.21.15.175:0/1059769923 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4a0099a50 0x7fd4a006cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.777+0000 7fd4a6200640 1 -- 172.21.15.175:0/1059769923 >> 172.21.15.175:0/1059769923 conn(0x7fd4a00b3300 msgr2=0x7fd4a00b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:49.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.777+0000 7fd4a6200640 1 -- 172.21.15.175:0/1059769923 shutdown_connections 2024-04-25T09:06:49.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.777+0000 7fd4a6200640 1 -- 172.21.15.175:0/1059769923 wait complete. 2024-04-25T09:06:49.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.777+0000 7fd4a6200640 1 Processor -- start 2024-04-25T09:06:49.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd4a6200640 1 -- start start 2024-04-25T09:06:49.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd4a6200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4a006bd60 0x7fd4a0158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd4a6200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4a0099a50 0x7fd4a0158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd4a6200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4a00d0d50 0x7fd4a0159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd4a6200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a015dfe0 con 0x7fd4a006bd60 2024-04-25T09:06:49.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd4a6200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a015de60 con 0x7fd4a0099a50 2024-04-25T09:06:49.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd4a6200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a016b260 con 0x7fd4a00d0d50 2024-04-25T09:06:49.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd49f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4a006bd60 0x7fd4a0158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd49f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4a006bd60 0x7fd4a0158470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34784/0 (socket says 172.21.15.175:34784) 2024-04-25T09:06:49.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd49f400640 1 -- 172.21.15.175:0/2088672382 learned_addr learned my addr 172.21.15.175:0/2088672382 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:49.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd49fe00640 1 --2- 172.21.15.175:0/2088672382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4a00d0d50 0x7fd4a0159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd49ea00640 1 --2- 172.21.15.175:0/2088672382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4a0099a50 0x7fd4a0158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd49f400640 1 -- 172.21.15.175:0/2088672382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4a00d0d50 msgr2=0x7fd4a0159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd49f400640 1 --2- 172.21.15.175:0/2088672382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4a00d0d50 0x7fd4a0159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd49f400640 1 -- 172.21.15.175:0/2088672382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4a0099a50 msgr2=0x7fd4a0158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd49f400640 1 --2- 172.21.15.175:0/2088672382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4a0099a50 0x7fd4a0158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd49f400640 1 -- 172.21.15.175:0/2088672382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a0154ff0 con 0x7fd4a006bd60 2024-04-25T09:06:49.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd49f400640 1 --2- 172.21.15.175:0/2088672382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4a006bd60 0x7fd4a0158470 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd49000d800 tx=0x7fd49000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd497400640 1 -- 172.21.15.175:0/2088672382 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000b6c0 con 0x7fd4a006bd60 2024-04-25T09:06:49.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd497400640 1 -- 172.21.15.175:0/2088672382 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd490019070 con 0x7fd4a006bd60 2024-04-25T09:06:49.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd497400640 1 -- 172.21.15.175:0/2088672382 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49000ba60 con 0x7fd4a006bd60 2024-04-25T09:06:49.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd4a6200640 1 -- 172.21.15.175:0/2088672382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a0155270 con 0x7fd4a006bd60 2024-04-25T09:06:49.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd4a6200640 1 -- 172.21.15.175:0/2088672382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a0155830 con 0x7fd4a006bd60 2024-04-25T09:06:49.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.781+0000 7fd4a6200640 1 -- 172.21.15.175:0/2088672382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a0074a60 con 0x7fd4a006bd60 2024-04-25T09:06:49.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.785+0000 7fd497400640 1 -- 172.21.15.175:0/2088672382 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd49000bc00 con 0x7fd4a006bd60 2024-04-25T09:06:49.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.785+0000 7fd497400640 1 --2- 172.21.15.175:0/2088672382 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd480066f60 0x7fd480069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:49.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.785+0000 7fd497400640 1 -- 172.21.15.175:0/2088672382 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4900854e0 con 0x7fd4a006bd60 2024-04-25T09:06:49.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.785+0000 7fd49ea00640 1 --2- 172.21.15.175:0/2088672382 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd480066f60 0x7fd480069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:49.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.785+0000 7fd49ea00640 1 --2- 172.21.15.175:0/2088672382 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd480066f60 0x7fd480069420 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd4a01561d0 tx=0x7fd48c007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:49.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.789+0000 7fd497400640 1 -- 172.21.15.175:0/2088672382 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd4a0154ff0 con 0x7fd4a006bd60 2024-04-25T09:06:49.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.945+0000 7fd4a6200640 1 -- 172.21.15.175:0/2088672382 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4a0158be0 con 0x7fd480066f60 2024-04-25T09:06:49.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.949+0000 7fd497400640 1 -- 172.21.15.175:0/2088672382 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251955 (secure 0 0 0) 0x7fd4a0158be0 con 0x7fd480066f60 2024-04-25T09:06:49.942 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:49.945 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:06:49.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.953+0000 7fd4a6200640 1 -- 172.21.15.175:0/2088672382 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd480066f60 msgr2=0x7fd480069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.953+0000 7fd4a6200640 1 --2- 172.21.15.175:0/2088672382 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd480066f60 0x7fd480069420 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd4a01561d0 tx=0x7fd48c007c10 comp rx=0 tx=0).stop 2024-04-25T09:06:49.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.953+0000 7fd4a6200640 1 -- 172.21.15.175:0/2088672382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4a006bd60 msgr2=0x7fd4a0158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:49.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.953+0000 7fd4a6200640 1 --2- 172.21.15.175:0/2088672382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4a006bd60 0x7fd4a0158470 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd49000d800 tx=0x7fd49000dcc0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.953+0000 7fd4a6200640 1 -- 172.21.15.175:0/2088672382 shutdown_connections 2024-04-25T09:06:49.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.953+0000 7fd4a6200640 1 --2- 172.21.15.175:0/2088672382 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd480066f60 0x7fd480069420 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.953+0000 7fd4a6200640 1 --2- 172.21.15.175:0/2088672382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4a00d0d50 0x7fd4a0159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.953+0000 7fd4a6200640 1 --2- 172.21.15.175:0/2088672382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4a0099a50 0x7fd4a0158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.953+0000 7fd4a6200640 1 --2- 172.21.15.175:0/2088672382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4a006bd60 0x7fd4a0158470 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:49.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.953+0000 7fd4a6200640 1 -- 172.21.15.175:0/2088672382 >> 172.21.15.175:0/2088672382 conn(0x7fd4a00b3300 msgr2=0x7fd4a015a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:49.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.953+0000 7fd4a6200640 1 -- 172.21.15.175:0/2088672382 shutdown_connections 2024-04-25T09:06:49.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:49.953+0000 7fd4a6200640 1 -- 172.21.15.175:0/2088672382 wait complete. 2024-04-25T09:06:49.962 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-04-25T09:06:49.824861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231176,"kb_used_data":6664,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743544,"statfs":{"total":773094113280,"available":772857389056,"internally_reserved":0,"allocated":6823936,"data_stored":3503596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.497453"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370313+0000","last_change":"2024-04-25T09:06:44.378253+0000","last_active":"2024-04-25T09:06:45.370313+0000","last_peered":"2024-04-25T09:06:45.370313+0000","last_clean":"2024-04-25T09:06:45.370313+0000","last_became_active":"2024-04-25T09:06:44.377939+0000","last_became_peered":"2024-04-25T09:06:44.377939+0000","last_unstale":"2024-04-25T09:06:45.370313+0000","last_undegraded":"2024-04-25T09:06:45.370313+0000","last_fullsized":"2024-04-25T09:06:45.370313+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:50.634776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118626+0000","last_change":"2024-04-25T09:06:44.375426+0000","last_active":"2024-04-25T09:06:46.118626+0000","last_peered":"2024-04-25T09:06:46.118626+0000","last_clean":"2024-04-25T09:06:46.118626+0000","last_became_active":"2024-04-25T09:06:44.373078+0000","last_became_peered":"2024-04-25T09:06:44.373078+0000","last_unstale":"2024-04-25T09:06:46.118626+0000","last_undegraded":"2024-04-25T09:06:46.118626+0000","last_fullsized":"2024-04-25T09:06:46.118626+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:28.633399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369345+0000","last_change":"2024-04-25T09:06:44.376491+0000","last_active":"2024-04-25T09:06:45.369345+0000","last_peered":"2024-04-25T09:06:45.369345+0000","last_clean":"2024-04-25T09:06:45.369345+0000","last_became_active":"2024-04-25T09:06:44.375504+0000","last_became_peered":"2024-04-25T09:06:44.375504+0000","last_unstale":"2024-04-25T09:06:45.369345+0000","last_undegraded":"2024-04-25T09:06:45.369345+0000","last_fullsized":"2024-04-25T09:06:45.369345+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:46.798871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118830+0000","last_change":"2024-04-25T09:06:44.370383+0000","last_active":"2024-04-25T09:06:46.118830+0000","last_peered":"2024-04-25T09:06:46.118830+0000","last_clean":"2024-04-25T09:06:46.118830+0000","last_became_active":"2024-04-25T09:06:44.369901+0000","last_became_peered":"2024-04-25T09:06:44.369901+0000","last_unstale":"2024-04-25T09:06:46.118830+0000","last_undegraded":"2024-04-25T09:06:46.118830+0000","last_fullsized":"2024-04-25T09:06:46.118830+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:37.997829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370077+0000","last_change":"2024-04-25T09:06:44.368235+0000","last_active":"2024-04-25T09:06:45.370077+0000","last_peered":"2024-04-25T09:06:45.370077+0000","last_clean":"2024-04-25T09:06:45.370077+0000","last_became_active":"2024-04-25T09:06:44.367910+0000","last_became_peered":"2024-04-25T09:06:44.367910+0000","last_unstale":"2024-04-25T09:06:45.370077+0000","last_undegraded":"2024-04-25T09:06:45.370077+0000","last_fullsized":"2024-04-25T09:06:45.370077+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:49.420133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118223+0000","last_change":"2024-04-25T09:06:44.376130+0000","last_active":"2024-04-25T09:06:46.118223+0000","last_peered":"2024-04-25T09:06:46.118223+0000","last_clean":"2024-04-25T09:06:46.118223+0000","last_became_active":"2024-04-25T09:06:44.375875+0000","last_became_peered":"2024-04-25T09:06:44.375875+0000","last_unstale":"2024-04-25T09:06:46.118223+0000","last_undegraded":"2024-04-25T09:06:46.118223+0000","last_fullsized":"2024-04-25T09:06:46.118223+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:37.845256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.803122+0000","last_change":"2024-04-25T09:06:44.366312+0000","last_active":"2024-04-25T09:06:45.803122+0000","last_peered":"2024-04-25T09:06:45.803122+0000","last_clean":"2024-04-25T09:06:45.803122+0000","last_became_active":"2024-04-25T09:06:44.366041+0000","last_became_peered":"2024-04-25T09:06:44.366041+0000","last_unstale":"2024-04-25T09:06:45.803122+0000","last_undegraded":"2024-04-25T09:06:45.803122+0000","last_fullsized":"2024-04-25T09:06:45.803122+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:08.132318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117389+0000","last_change":"2024-04-25T09:06:44.383257+0000","last_active":"2024-04-25T09:06:46.117389+0000","last_peered":"2024-04-25T09:06:46.117389+0000","last_clean":"2024-04-25T09:06:46.117389+0000","last_became_active":"2024-04-25T09:06:44.383000+0000","last_became_peered":"2024-04-25T09:06:44.383000+0000","last_unstale":"2024-04-25T09:06:46.117389+0000","last_undegraded":"2024-04-25T09:06:46.117389+0000","last_fullsized":"2024-04-25T09:06:46.117389+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:22.146522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.803399+0000","last_change":"2024-04-25T09:06:44.377437+0000","last_active":"2024-04-25T09:06:45.803399+0000","last_peered":"2024-04-25T09:06:45.803399+0000","last_clean":"2024-04-25T09:06:45.803399+0000","last_became_active":"2024-04-25T09:06:44.377130+0000","last_became_peered":"2024-04-25T09:06:44.377130+0000","last_unstale":"2024-04-25T09:06:45.803399+0000","last_undegraded":"2024-04-25T09:06:45.803399+0000","last_fullsized":"2024-04-25T09:06:45.803399+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:46.826020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117891+0000","last_change":"2024-04-25T09:06:44.367067+0000","last_active":"2024-04-25T09:06:46.117891+0000","last_peered":"2024-04-25T09:06:46.117891+0000","last_clean":"2024-04-25T09:06:46.117891+0000","last_became_active":"2024-04-25T09:06:44.362233+0000","last_became_peered":"2024-04-25T09:06:44.362233+0000","last_unstale":"2024-04-25T09:06:46.117891+0000","last_undegraded":"2024-04-25T09:06:46.117891+0000","last_fullsized":"2024-04-25T09:06:46.117891+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:29.574277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118004+0000","last_change":"2024-04-25T09:06:44.377725+0000","last_active":"2024-04-25T09:06:46.118004+0000","last_peered":"2024-04-25T09:06:46.118004+0000","last_clean":"2024-04-25T09:06:46.118004+0000","last_became_active":"2024-04-25T09:06:44.377361+0000","last_became_peered":"2024-04-25T09:06:44.377361+0000","last_unstale":"2024-04-25T09:06:46.118004+0000","last_undegraded":"2024-04-25T09:06:46.118004+0000","last_fullsized":"2024-04-25T09:06:46.118004+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:07:05.465866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118780+0000","last_change":"2024-04-25T09:06:44.375595+0000","last_active":"2024-04-25T09:06:46.118780+0000","last_peered":"2024-04-25T09:06:46.118780+0000","last_clean":"2024-04-25T09:06:46.118780+0000","last_became_active":"2024-04-25T09:06:44.371154+0000","last_became_peered":"2024-04-25T09:06:44.371154+0000","last_unstale":"2024-04-25T09:06:46.118780+0000","last_undegraded":"2024-04-25T09:06:46.118780+0000","last_fullsized":"2024-04-25T09:06:46.118780+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:46.798871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370864+0000","last_change":"2024-04-25T09:06:44.373884+0000","last_active":"2024-04-25T09:06:45.370864+0000","last_peered":"2024-04-25T09:06:45.370864+0000","last_clean":"2024-04-25T09:06:45.370864+0000","last_became_active":"2024-04-25T09:06:44.373608+0000","last_became_peered":"2024-04-25T09:06:44.373608+0000","last_unstale":"2024-04-25T09:06:45.370864+0000","last_undegraded":"2024-04-25T09:06:45.370864+0000","last_fullsized":"2024-04-25T09:06:45.370864+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:18.408861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.803095+0000","last_change":"2024-04-25T09:06:44.378147+0000","last_active":"2024-04-25T09:06:45.803095+0000","last_peered":"2024-04-25T09:06:45.803095+0000","last_clean":"2024-04-25T09:06:45.803095+0000","last_became_active":"2024-04-25T09:06:44.377728+0000","last_became_peered":"2024-04-25T09:06:44.377728+0000","last_unstale":"2024-04-25T09:06:45.803095+0000","last_undegraded":"2024-04-25T09:06:45.803095+0000","last_fullsized":"2024-04-25T09:06:45.803095+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:40.727118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.803174+0000","last_change":"2024-04-25T09:06:44.361919+0000","last_active":"2024-04-25T09:06:45.803174+0000","last_peered":"2024-04-25T09:06:45.803174+0000","last_clean":"2024-04-25T09:06:45.803174+0000","last_became_active":"2024-04-25T09:06:44.361554+0000","last_became_peered":"2024-04-25T09:06:44.361554+0000","last_unstale":"2024-04-25T09:06:45.803174+0000","last_undegraded":"2024-04-25T09:06:45.803174+0000","last_fullsized":"2024-04-25T09:06:45.803174+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:09.816218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117358+0000","last_change":"2024-04-25T09:06:44.370488+0000","last_active":"2024-04-25T09:06:46.117358+0000","last_peered":"2024-04-25T09:06:46.117358+0000","last_clean":"2024-04-25T09:06:46.117358+0000","last_became_active":"2024-04-25T09:06:44.370219+0000","last_became_peered":"2024-04-25T09:06:44.370219+0000","last_unstale":"2024-04-25T09:06:46.117358+0000","last_undegraded":"2024-04-25T09:06:46.117358+0000","last_fullsized":"2024-04-25T09:06:46.117358+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:37:33.390477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118240+0000","last_change":"2024-04-25T09:06:44.384654+0000","last_active":"2024-04-25T09:06:46.118240+0000","last_peered":"2024-04-25T09:06:46.118240+0000","last_clean":"2024-04-25T09:06:46.118240+0000","last_became_active":"2024-04-25T09:06:44.384396+0000","last_became_peered":"2024-04-25T09:06:44.384396+0000","last_unstale":"2024-04-25T09:06:46.118240+0000","last_undegraded":"2024-04-25T09:06:46.118240+0000","last_fullsized":"2024-04-25T09:06:46.118240+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:12.215787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369738+0000","last_change":"2024-04-25T09:06:44.377476+0000","last_active":"2024-04-25T09:06:45.369738+0000","last_peered":"2024-04-25T09:06:45.369738+0000","last_clean":"2024-04-25T09:06:45.369738+0000","last_became_active":"2024-04-25T09:06:44.377182+0000","last_became_peered":"2024-04-25T09:06:44.377182+0000","last_unstale":"2024-04-25T09:06:45.369738+0000","last_undegraded":"2024-04-25T09:06:45.369738+0000","last_fullsized":"2024-04-25T09:06:45.369738+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:30.025920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370165+0000","last_change":"2024-04-25T09:06:44.383085+0000","last_active":"2024-04-25T09:06:45.370165+0000","last_peered":"2024-04-25T09:06:45.370165+0000","last_clean":"2024-04-25T09:06:45.370165+0000","last_became_active":"2024-04-25T09:06:44.382811+0000","last_became_peered":"2024-04-25T09:06:44.382811+0000","last_unstale":"2024-04-25T09:06:45.370165+0000","last_undegraded":"2024-04-25T09:06:45.370165+0000","last_fullsized":"2024-04-25T09:06:45.370165+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:09.235171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118077+0000","last_change":"2024-04-25T09:06:44.385093+0000","last_active":"2024-04-25T09:06:46.118077+0000","last_peered":"2024-04-25T09:06:46.118077+0000","last_clean":"2024-04-25T09:06:46.118077+0000","last_became_active":"2024-04-25T09:06:44.384846+0000","last_became_peered":"2024-04-25T09:06:44.384846+0000","last_unstale":"2024-04-25T09:06:46.118077+0000","last_undegraded":"2024-04-25T09:06:46.118077+0000","last_fullsized":"2024-04-25T09:06:46.118077+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:28.332138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369437+0000","last_change":"2024-04-25T09:06:44.372404+0000","last_active":"2024-04-25T09:06:45.369437+0000","last_peered":"2024-04-25T09:06:45.369437+0000","last_clean":"2024-04-25T09:06:45.369437+0000","last_became_active":"2024-04-25T09:06:44.372139+0000","last_became_peered":"2024-04-25T09:06:44.372139+0000","last_unstale":"2024-04-25T09:06:45.369437+0000","last_undegraded":"2024-04-25T09:06:45.369437+0000","last_fullsized":"2024-04-25T09:06:45.369437+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:37.997829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118862+0000","last_change":"2024-04-25T09:06:44.387853+0000","last_active":"2024-04-25T09:06:46.118862+0000","last_peered":"2024-04-25T09:06:46.118862+0000","last_clean":"2024-04-25T09:06:46.118862+0000","last_became_active":"2024-04-25T09:06:44.387580+0000","last_became_peered":"2024-04-25T09:06:44.387580+0000","last_unstale":"2024-04-25T09:06:46.118862+0000","last_undegraded":"2024-04-25T09:06:46.118862+0000","last_fullsized":"2024-04-25T09:06:46.118862+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:55.363901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369513+0000","last_change":"2024-04-25T09:06:44.381096+0000","last_active":"2024-04-25T09:06:45.369513+0000","last_peered":"2024-04-25T09:06:45.369513+0000","last_clean":"2024-04-25T09:06:45.369513+0000","last_became_active":"2024-04-25T09:06:44.380551+0000","last_became_peered":"2024-04-25T09:06:44.380551+0000","last_unstale":"2024-04-25T09:06:45.369513+0000","last_undegraded":"2024-04-25T09:06:45.369513+0000","last_fullsized":"2024-04-25T09:06:45.369513+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:04.888010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370681+0000","last_change":"2024-04-25T09:06:44.375386+0000","last_active":"2024-04-25T09:06:45.370681+0000","last_peered":"2024-04-25T09:06:45.370681+0000","last_clean":"2024-04-25T09:06:45.370681+0000","last_became_active":"2024-04-25T09:06:44.375068+0000","last_became_peered":"2024-04-25T09:06:44.375068+0000","last_unstale":"2024-04-25T09:06:45.370681+0000","last_undegraded":"2024-04-25T09:06:45.370681+0000","last_fullsized":"2024-04-25T09:06:45.370681+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:03.972048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370462+0000","last_change":"2024-04-25T09:06:44.363902+0000","last_active":"2024-04-25T09:06:45.370462+0000","last_peered":"2024-04-25T09:06:45.370462+0000","last_clean":"2024-04-25T09:06:45.370462+0000","last_became_active":"2024-04-25T09:06:44.363627+0000","last_became_peered":"2024-04-25T09:06:44.363627+0000","last_unstale":"2024-04-25T09:06:45.370462+0000","last_undegraded":"2024-04-25T09:06:45.370462+0000","last_fullsized":"2024-04-25T09:06:45.370462+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:47.181706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118997+0000","last_change":"2024-04-25T09:06:44.372969+0000","last_active":"2024-04-25T09:06:46.118997+0000","last_peered":"2024-04-25T09:06:46.118997+0000","last_clean":"2024-04-25T09:06:46.118997+0000","last_became_active":"2024-04-25T09:06:44.372653+0000","last_became_peered":"2024-04-25T09:06:44.372653+0000","last_unstale":"2024-04-25T09:06:46.118997+0000","last_undegraded":"2024-04-25T09:06:46.118997+0000","last_fullsized":"2024-04-25T09:06:46.118997+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:50.346255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118727+0000","last_change":"2024-04-25T09:06:44.371885+0000","last_active":"2024-04-25T09:06:46.118727+0000","last_peered":"2024-04-25T09:06:46.118727+0000","last_clean":"2024-04-25T09:06:46.118727+0000","last_became_active":"2024-04-25T09:06:44.371602+0000","last_became_peered":"2024-04-25T09:06:44.371602+0000","last_unstale":"2024-04-25T09:06:46.118727+0000","last_undegraded":"2024-04-25T09:06:46.118727+0000","last_fullsized":"2024-04-25T09:06:46.118727+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:57.567952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370233+0000","last_change":"2024-04-25T09:06:44.366883+0000","last_active":"2024-04-25T09:06:45.370233+0000","last_peered":"2024-04-25T09:06:45.370233+0000","last_clean":"2024-04-25T09:06:45.370233+0000","last_became_active":"2024-04-25T09:06:44.366619+0000","last_became_peered":"2024-04-25T09:06:44.366619+0000","last_unstale":"2024-04-25T09:06:45.370233+0000","last_undegraded":"2024-04-25T09:06:45.370233+0000","last_fullsized":"2024-04-25T09:06:45.370233+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:21.146056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119127+0000","last_change":"2024-04-25T09:06:44.383855+0000","last_active":"2024-04-25T09:06:46.119127+0000","last_peered":"2024-04-25T09:06:46.119127+0000","last_clean":"2024-04-25T09:06:46.119127+0000","last_became_active":"2024-04-25T09:06:44.383691+0000","last_became_peered":"2024-04-25T09:06:44.383691+0000","last_unstale":"2024-04-25T09:06:46.119127+0000","last_undegraded":"2024-04-25T09:06:46.119127+0000","last_fullsized":"2024-04-25T09:06:46.119127+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:58.471037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369259+0000","last_change":"2024-04-25T09:06:44.375322+0000","last_active":"2024-04-25T09:06:45.369259+0000","last_peered":"2024-04-25T09:06:45.369259+0000","last_clean":"2024-04-25T09:06:45.369259+0000","last_became_active":"2024-04-25T09:06:44.375001+0000","last_became_peered":"2024-04-25T09:06:44.375001+0000","last_unstale":"2024-04-25T09:06:45.369259+0000","last_undegraded":"2024-04-25T09:06:45.369259+0000","last_fullsized":"2024-04-25T09:06:45.369259+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:28.027452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370011+0000","last_change":"2024-04-25T09:06:44.363727+0000","last_active":"2024-04-25T09:06:45.370011+0000","last_peered":"2024-04-25T09:06:45.370011+0000","last_clean":"2024-04-25T09:06:45.370011+0000","last_became_active":"2024-04-25T09:06:44.363410+0000","last_became_peered":"2024-04-25T09:06:44.363410+0000","last_unstale":"2024-04-25T09:06:45.370011+0000","last_undegraded":"2024-04-25T09:06:45.370011+0000","last_fullsized":"2024-04-25T09:06:45.370011+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:06.062123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117677+0000","last_change":"2024-04-25T09:06:44.386739+0000","last_active":"2024-04-25T09:06:46.117677+0000","last_peered":"2024-04-25T09:06:46.117677+0000","last_clean":"2024-04-25T09:06:46.117677+0000","last_became_active":"2024-04-25T09:06:44.386416+0000","last_became_peered":"2024-04-25T09:06:44.386416+0000","last_unstale":"2024-04-25T09:06:46.117677+0000","last_undegraded":"2024-04-25T09:06:46.117677+0000","last_fullsized":"2024-04-25T09:06:46.117677+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:38.810236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119484+0000","last_change":"2024-04-25T09:06:44.372241+0000","last_active":"2024-04-25T09:06:46.119484+0000","last_peered":"2024-04-25T09:06:46.119484+0000","last_clean":"2024-04-25T09:06:46.119484+0000","last_became_active":"2024-04-25T09:06:44.371968+0000","last_became_peered":"2024-04-25T09:06:44.371968+0000","last_unstale":"2024-04-25T09:06:46.119484+0000","last_undegraded":"2024-04-25T09:06:46.119484+0000","last_fullsized":"2024-04-25T09:06:46.119484+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:50.346255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119482+0000","last_change":"2024-04-25T09:06:43.342616+0000","last_active":"2024-04-25T09:06:46.119482+0000","last_peered":"2024-04-25T09:06:46.119482+0000","last_clean":"2024-04-25T09:06:46.119482+0000","last_became_active":"2024-04-25T09:06:43.342326+0000","last_became_peered":"2024-04-25T09:06:43.342326+0000","last_unstale":"2024-04-25T09:06:46.119482+0000","last_undegraded":"2024-04-25T09:06:46.119482+0000","last_fullsized":"2024-04-25T09:06:46.119482+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:07:04.458624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118086+0000","last_change":"2024-04-25T09:06:44.370389+0000","last_active":"2024-04-25T09:06:46.118086+0000","last_peered":"2024-04-25T09:06:46.118086+0000","last_clean":"2024-04-25T09:06:46.118086+0000","last_became_active":"2024-04-25T09:06:44.370127+0000","last_became_peered":"2024-04-25T09:06:44.370127+0000","last_unstale":"2024-04-25T09:06:46.118086+0000","last_undegraded":"2024-04-25T09:06:46.118086+0000","last_fullsized":"2024-04-25T09:06:46.118086+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:47.075347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"57'1","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118677+0000","last_change":"2024-04-25T09:06:43.352544+0000","last_active":"2024-04-25T09:06:46.118677+0000","last_peered":"2024-04-25T09:06:46.118677+0000","last_clean":"2024-04-25T09:06:46.118677+0000","last_became_active":"2024-04-25T09:06:43.351876+0000","last_became_peered":"2024-04-25T09:06:43.351876+0000","last_unstale":"2024-04-25T09:06:46.118677+0000","last_undegraded":"2024-04-25T09:06:46.118677+0000","last_fullsized":"2024-04-25T09:06:46.118677+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:01.746407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118784+0000","last_change":"2024-04-25T09:06:44.369341+0000","last_active":"2024-04-25T09:06:46.118784+0000","last_peered":"2024-04-25T09:06:46.118784+0000","last_clean":"2024-04-25T09:06:46.118784+0000","last_became_active":"2024-04-25T09:06:44.369055+0000","last_became_peered":"2024-04-25T09:06:44.369055+0000","last_unstale":"2024-04-25T09:06:46.118784+0000","last_undegraded":"2024-04-25T09:06:46.118784+0000","last_fullsized":"2024-04-25T09:06:46.118784+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:28.027452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119438+0000","last_change":"2024-04-25T09:06:43.343819+0000","last_active":"2024-04-25T09:06:46.119438+0000","last_peered":"2024-04-25T09:06:46.119438+0000","last_clean":"2024-04-25T09:06:46.119438+0000","last_became_active":"2024-04-25T09:06:43.343554+0000","last_became_peered":"2024-04-25T09:06:43.343554+0000","last_unstale":"2024-04-25T09:06:46.119438+0000","last_undegraded":"2024-04-25T09:06:46.119438+0000","last_fullsized":"2024-04-25T09:06:46.119438+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:07.125077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119365+0000","last_change":"2024-04-25T09:06:44.374376+0000","last_active":"2024-04-25T09:06:46.119365+0000","last_peered":"2024-04-25T09:06:46.119365+0000","last_clean":"2024-04-25T09:06:46.119365+0000","last_became_active":"2024-04-25T09:06:44.372139+0000","last_became_peered":"2024-04-25T09:06:44.372139+0000","last_unstale":"2024-04-25T09:06:46.119365+0000","last_undegraded":"2024-04-25T09:06:46.119365+0000","last_fullsized":"2024-04-25T09:06:46.119365+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:46.798871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"57'2","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118847+0000","last_change":"2024-04-25T09:06:43.349507+0000","last_active":"2024-04-25T09:06:46.118847+0000","last_peered":"2024-04-25T09:06:46.118847+0000","last_clean":"2024-04-25T09:06:46.118847+0000","last_became_active":"2024-04-25T09:06:43.349216+0000","last_became_peered":"2024-04-25T09:06:43.349216+0000","last_unstale":"2024-04-25T09:06:46.118847+0000","last_undegraded":"2024-04-25T09:06:46.118847+0000","last_fullsized":"2024-04-25T09:06:46.118847+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:11.345029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118947+0000","last_change":"2024-04-25T09:06:44.376381+0000","last_active":"2024-04-25T09:06:46.118947+0000","last_peered":"2024-04-25T09:06:46.118947+0000","last_clean":"2024-04-25T09:06:46.118947+0000","last_became_active":"2024-04-25T09:06:44.376123+0000","last_became_peered":"2024-04-25T09:06:44.376123+0000","last_unstale":"2024-04-25T09:06:46.118947+0000","last_undegraded":"2024-04-25T09:06:46.118947+0000","last_fullsized":"2024-04-25T09:06:46.118947+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:32.111039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"57'1","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.803123+0000","last_change":"2024-04-25T09:06:43.346999+0000","last_active":"2024-04-25T09:06:45.803123+0000","last_peered":"2024-04-25T09:06:45.803123+0000","last_clean":"2024-04-25T09:06:45.803123+0000","last_became_active":"2024-04-25T09:06:43.346693+0000","last_became_peered":"2024-04-25T09:06:43.346693+0000","last_unstale":"2024-04-25T09:06:45.803123+0000","last_undegraded":"2024-04-25T09:06:45.803123+0000","last_fullsized":"2024-04-25T09:06:45.803123+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:30.999021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119122+0000","last_change":"2024-04-25T09:06:44.385699+0000","last_active":"2024-04-25T09:06:46.119122+0000","last_peered":"2024-04-25T09:06:46.119122+0000","last_clean":"2024-04-25T09:06:46.119122+0000","last_became_active":"2024-04-25T09:06:44.385462+0000","last_became_peered":"2024-04-25T09:06:44.385462+0000","last_unstale":"2024-04-25T09:06:46.119122+0000","last_undegraded":"2024-04-25T09:06:46.119122+0000","last_fullsized":"2024-04-25T09:06:46.119122+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:50.040518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118556+0000","last_change":"2024-04-25T09:06:43.339187+0000","last_active":"2024-04-25T09:06:46.118556+0000","last_peered":"2024-04-25T09:06:46.118556+0000","last_clean":"2024-04-25T09:06:46.118556+0000","last_became_active":"2024-04-25T09:06:43.338905+0000","last_became_peered":"2024-04-25T09:06:43.338905+0000","last_unstale":"2024-04-25T09:06:46.118556+0000","last_undegraded":"2024-04-25T09:06:46.118556+0000","last_fullsized":"2024-04-25T09:06:46.118556+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:28.567036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370672+0000","last_change":"2024-04-25T09:06:44.366602+0000","last_active":"2024-04-25T09:06:45.370672+0000","last_peered":"2024-04-25T09:06:45.370672+0000","last_clean":"2024-04-25T09:06:45.370672+0000","last_became_active":"2024-04-25T09:06:44.366343+0000","last_became_peered":"2024-04-25T09:06:44.366343+0000","last_unstale":"2024-04-25T09:06:45.370672+0000","last_undegraded":"2024-04-25T09:06:45.370672+0000","last_fullsized":"2024-04-25T09:06:45.370672+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:18.901764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118484+0000","last_change":"2024-04-25T09:06:43.346449+0000","last_active":"2024-04-25T09:06:46.118484+0000","last_peered":"2024-04-25T09:06:46.118484+0000","last_clean":"2024-04-25T09:06:46.118484+0000","last_became_active":"2024-04-25T09:06:43.343544+0000","last_became_peered":"2024-04-25T09:06:43.343544+0000","last_unstale":"2024-04-25T09:06:46.118484+0000","last_undegraded":"2024-04-25T09:06:46.118484+0000","last_fullsized":"2024-04-25T09:06:46.118484+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:46.633802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118302+0000","last_change":"2024-04-25T09:06:44.382904+0000","last_active":"2024-04-25T09:06:46.118302+0000","last_peered":"2024-04-25T09:06:46.118302+0000","last_clean":"2024-04-25T09:06:46.118302+0000","last_became_active":"2024-04-25T09:06:44.382636+0000","last_became_peered":"2024-04-25T09:06:44.382636+0000","last_unstale":"2024-04-25T09:06:46.118302+0000","last_undegraded":"2024-04-25T09:06:46.118302+0000","last_fullsized":"2024-04-25T09:06:46.118302+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:41.117200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.802841+0000","last_change":"2024-04-25T09:06:43.343297+0000","last_active":"2024-04-25T09:06:45.802841+0000","last_peered":"2024-04-25T09:06:45.802841+0000","last_clean":"2024-04-25T09:06:45.802841+0000","last_became_active":"2024-04-25T09:06:43.342963+0000","last_became_peered":"2024-04-25T09:06:43.342963+0000","last_unstale":"2024-04-25T09:06:45.802841+0000","last_undegraded":"2024-04-25T09:06:45.802841+0000","last_fullsized":"2024-04-25T09:06:45.802841+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:43.775629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.803426+0000","last_change":"2024-04-25T09:06:44.361868+0000","last_active":"2024-04-25T09:06:45.803426+0000","last_peered":"2024-04-25T09:06:45.803426+0000","last_clean":"2024-04-25T09:06:45.803426+0000","last_became_active":"2024-04-25T09:06:44.361498+0000","last_became_peered":"2024-04-25T09:06:44.361498+0000","last_unstale":"2024-04-25T09:06:45.803426+0000","last_undegraded":"2024-04-25T09:06:45.803426+0000","last_fullsized":"2024-04-25T09:06:45.803426+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:34.046237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369851+0000","last_change":"2024-04-25T09:06:43.353192+0000","last_active":"2024-04-25T09:06:45.369851+0000","last_peered":"2024-04-25T09:06:45.369851+0000","last_clean":"2024-04-25T09:06:45.369851+0000","last_became_active":"2024-04-25T09:06:43.353001+0000","last_became_peered":"2024-04-25T09:06:43.353001+0000","last_unstale":"2024-04-25T09:06:45.369851+0000","last_undegraded":"2024-04-25T09:06:45.369851+0000","last_fullsized":"2024-04-25T09:06:45.369851+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:53.132304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370073+0000","last_change":"2024-04-25T09:06:44.371411+0000","last_active":"2024-04-25T09:06:45.370073+0000","last_peered":"2024-04-25T09:06:45.370073+0000","last_clean":"2024-04-25T09:06:45.370073+0000","last_became_active":"2024-04-25T09:06:44.370951+0000","last_became_peered":"2024-04-25T09:06:44.370951+0000","last_unstale":"2024-04-25T09:06:45.370073+0000","last_undegraded":"2024-04-25T09:06:45.370073+0000","last_fullsized":"2024-04-25T09:06:45.370073+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:00.159535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118752+0000","last_change":"2024-04-25T09:06:43.354286+0000","last_active":"2024-04-25T09:06:46.118752+0000","last_peered":"2024-04-25T09:06:46.118752+0000","last_clean":"2024-04-25T09:06:46.118752+0000","last_became_active":"2024-04-25T09:06:43.354023+0000","last_became_peered":"2024-04-25T09:06:43.354023+0000","last_unstale":"2024-04-25T09:06:46.118752+0000","last_undegraded":"2024-04-25T09:06:46.118752+0000","last_fullsized":"2024-04-25T09:06:46.118752+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:51.163293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117518+0000","last_change":"2024-04-25T09:06:44.362982+0000","last_active":"2024-04-25T09:06:46.117518+0000","last_peered":"2024-04-25T09:06:46.117518+0000","last_clean":"2024-04-25T09:06:46.117518+0000","last_became_active":"2024-04-25T09:06:44.362554+0000","last_became_peered":"2024-04-25T09:06:44.362554+0000","last_unstale":"2024-04-25T09:06:46.117518+0000","last_undegraded":"2024-04-25T09:06:46.117518+0000","last_fullsized":"2024-04-25T09:06:46.117518+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:23.000896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"57'3","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369649+0000","last_change":"2024-04-25T09:06:43.359172+0000","last_active":"2024-04-25T09:06:45.369649+0000","last_peered":"2024-04-25T09:06:45.369649+0000","last_clean":"2024-04-25T09:06:45.369649+0000","last_became_active":"2024-04-25T09:06:43.358886+0000","last_became_peered":"2024-04-25T09:06:43.358886+0000","last_unstale":"2024-04-25T09:06:45.369649+0000","last_undegraded":"2024-04-25T09:06:45.369649+0000","last_fullsized":"2024-04-25T09:06:45.369649+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:36.899491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369491+0000","last_change":"2024-04-25T09:06:44.379421+0000","last_active":"2024-04-25T09:06:45.369491+0000","last_peered":"2024-04-25T09:06:45.369491+0000","last_clean":"2024-04-25T09:06:45.369491+0000","last_became_active":"2024-04-25T09:06:44.379175+0000","last_became_peered":"2024-04-25T09:06:44.379175+0000","last_unstale":"2024-04-25T09:06:45.369491+0000","last_undegraded":"2024-04-25T09:06:45.369491+0000","last_fullsized":"2024-04-25T09:06:45.369491+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:50.346255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"57'6","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.803208+0000","last_change":"2024-04-25T09:06:43.341015+0000","last_active":"2024-04-25T09:06:45.803208+0000","last_peered":"2024-04-25T09:06:45.803208+0000","last_clean":"2024-04-25T09:06:45.803208+0000","last_became_active":"2024-04-25T09:06:43.340724+0000","last_became_peered":"2024-04-25T09:06:43.340724+0000","last_unstale":"2024-04-25T09:06:45.803208+0000","last_undegraded":"2024-04-25T09:06:45.803208+0000","last_fullsized":"2024-04-25T09:06:45.803208+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:22.743866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118742+0000","last_change":"2024-04-25T09:06:44.372154+0000","last_active":"2024-04-25T09:06:46.118742+0000","last_peered":"2024-04-25T09:06:46.118742+0000","last_clean":"2024-04-25T09:06:46.118742+0000","last_became_active":"2024-04-25T09:06:44.371885+0000","last_became_peered":"2024-04-25T09:06:44.371885+0000","last_unstale":"2024-04-25T09:06:46.118742+0000","last_undegraded":"2024-04-25T09:06:46.118742+0000","last_fullsized":"2024-04-25T09:06:46.118742+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:28.027452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"57'2","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119023+0000","last_change":"2024-04-25T09:06:43.350060+0000","last_active":"2024-04-25T09:06:46.119023+0000","last_peered":"2024-04-25T09:06:46.119023+0000","last_clean":"2024-04-25T09:06:46.119023+0000","last_became_active":"2024-04-25T09:06:43.349768+0000","last_became_peered":"2024-04-25T09:06:43.349768+0000","last_unstale":"2024-04-25T09:06:46.119023+0000","last_undegraded":"2024-04-25T09:06:46.119023+0000","last_fullsized":"2024-04-25T09:06:46.119023+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:59.152294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369645+0000","last_change":"2024-04-25T09:06:44.373300+0000","last_active":"2024-04-25T09:06:45.369645+0000","last_peered":"2024-04-25T09:06:45.369645+0000","last_clean":"2024-04-25T09:06:45.369645+0000","last_became_active":"2024-04-25T09:06:44.372969+0000","last_became_peered":"2024-04-25T09:06:44.372969+0000","last_unstale":"2024-04-25T09:06:45.369645+0000","last_undegraded":"2024-04-25T09:06:45.369645+0000","last_fullsized":"2024-04-25T09:06:45.369645+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:16.500622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370447+0000","last_change":"2024-04-25T09:06:43.349963+0000","last_active":"2024-04-25T09:06:45.370447+0000","last_peered":"2024-04-25T09:06:45.370447+0000","last_clean":"2024-04-25T09:06:45.370447+0000","last_became_active":"2024-04-25T09:06:43.349649+0000","last_became_peered":"2024-04-25T09:06:43.349649+0000","last_unstale":"2024-04-25T09:06:45.370447+0000","last_undegraded":"2024-04-25T09:06:45.370447+0000","last_fullsized":"2024-04-25T09:06:45.370447+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:36.071087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.802904+0000","last_change":"2024-04-25T09:06:44.369864+0000","last_active":"2024-04-25T09:06:45.802904+0000","last_peered":"2024-04-25T09:06:45.802904+0000","last_clean":"2024-04-25T09:06:45.802904+0000","last_became_active":"2024-04-25T09:06:44.369471+0000","last_became_peered":"2024-04-25T09:06:44.369471+0000","last_unstale":"2024-04-25T09:06:45.802904+0000","last_undegraded":"2024-04-25T09:06:45.802904+0000","last_fullsized":"2024-04-25T09:06:45.802904+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:47.075347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118615+0000","last_change":"2024-04-25T09:06:43.349641+0000","last_active":"2024-04-25T09:06:46.118615+0000","last_peered":"2024-04-25T09:06:46.118615+0000","last_clean":"2024-04-25T09:06:46.118615+0000","last_became_active":"2024-04-25T09:06:43.349261+0000","last_became_peered":"2024-04-25T09:06:43.349261+0000","last_unstale":"2024-04-25T09:06:46.118615+0000","last_undegraded":"2024-04-25T09:06:46.118615+0000","last_fullsized":"2024-04-25T09:06:46.118615+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:53.132304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369951+0000","last_change":"2024-04-25T09:06:44.378954+0000","last_active":"2024-04-25T09:06:45.369951+0000","last_peered":"2024-04-25T09:06:45.369951+0000","last_clean":"2024-04-25T09:06:45.369951+0000","last_became_active":"2024-04-25T09:06:44.378570+0000","last_became_peered":"2024-04-25T09:06:44.378570+0000","last_unstale":"2024-04-25T09:06:45.369951+0000","last_undegraded":"2024-04-25T09:06:45.369951+0000","last_fullsized":"2024-04-25T09:06:45.369951+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:52.170535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"57'8","reported_seq":22,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369386+0000","last_change":"2024-04-25T09:06:43.351852+0000","last_active":"2024-04-25T09:06:45.369386+0000","last_peered":"2024-04-25T09:06:45.369386+0000","last_clean":"2024-04-25T09:06:45.369386+0000","last_became_active":"2024-04-25T09:06:43.351538+0000","last_became_peered":"2024-04-25T09:06:43.351538+0000","last_unstale":"2024-04-25T09:06:45.369386+0000","last_undegraded":"2024-04-25T09:06:45.369386+0000","last_fullsized":"2024-04-25T09:06:45.369386+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:46.633802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369871+0000","last_change":"2024-04-25T09:06:44.376683+0000","last_active":"2024-04-25T09:06:45.369871+0000","last_peered":"2024-04-25T09:06:45.369871+0000","last_clean":"2024-04-25T09:06:45.369871+0000","last_became_active":"2024-04-25T09:06:44.376291+0000","last_became_peered":"2024-04-25T09:06:44.376291+0000","last_unstale":"2024-04-25T09:06:45.369871+0000","last_undegraded":"2024-04-25T09:06:45.369871+0000","last_fullsized":"2024-04-25T09:06:45.369871+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:13.116989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"57'1","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118392+0000","last_change":"2024-04-25T09:06:43.355096+0000","last_active":"2024-04-25T09:06:46.118392+0000","last_peered":"2024-04-25T09:06:46.118392+0000","last_clean":"2024-04-25T09:06:46.118392+0000","last_became_active":"2024-04-25T09:06:43.354807+0000","last_became_peered":"2024-04-25T09:06:43.354807+0000","last_unstale":"2024-04-25T09:06:46.118392+0000","last_undegraded":"2024-04-25T09:06:46.118392+0000","last_fullsized":"2024-04-25T09:06:46.118392+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:15.863844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119104+0000","last_change":"2024-04-25T09:06:44.367798+0000","last_active":"2024-04-25T09:06:46.119104+0000","last_peered":"2024-04-25T09:06:46.119104+0000","last_clean":"2024-04-25T09:06:46.119104+0000","last_became_active":"2024-04-25T09:06:44.367460+0000","last_became_peered":"2024-04-25T09:06:44.367460+0000","last_unstale":"2024-04-25T09:06:46.119104+0000","last_undegraded":"2024-04-25T09:06:46.119104+0000","last_fullsized":"2024-04-25T09:06:46.119104+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:16.500622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119457+0000","last_change":"2024-04-25T09:06:43.346869+0000","last_active":"2024-04-25T09:06:46.119457+0000","last_peered":"2024-04-25T09:06:46.119457+0000","last_clean":"2024-04-25T09:06:46.119457+0000","last_became_active":"2024-04-25T09:06:43.346525+0000","last_became_peered":"2024-04-25T09:06:43.346525+0000","last_unstale":"2024-04-25T09:06:46.119457+0000","last_undegraded":"2024-04-25T09:06:46.119457+0000","last_fullsized":"2024-04-25T09:06:46.119457+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:46.068106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118244+0000","last_change":"2024-04-25T09:06:44.382678+0000","last_active":"2024-04-25T09:06:46.118244+0000","last_peered":"2024-04-25T09:06:46.118244+0000","last_clean":"2024-04-25T09:06:46.118244+0000","last_became_active":"2024-04-25T09:06:44.382387+0000","last_became_peered":"2024-04-25T09:06:44.382387+0000","last_unstale":"2024-04-25T09:06:46.118244+0000","last_undegraded":"2024-04-25T09:06:46.118244+0000","last_fullsized":"2024-04-25T09:06:46.118244+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:13.840830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"57'1","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118950+0000","last_change":"2024-04-25T09:06:43.351831+0000","last_active":"2024-04-25T09:06:46.118950+0000","last_peered":"2024-04-25T09:06:46.118950+0000","last_clean":"2024-04-25T09:06:46.118950+0000","last_became_active":"2024-04-25T09:06:43.351536+0000","last_became_peered":"2024-04-25T09:06:43.351536+0000","last_unstale":"2024-04-25T09:06:46.118950+0000","last_undegraded":"2024-04-25T09:06:46.118950+0000","last_fullsized":"2024-04-25T09:06:46.118950+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:33.038996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369877+0000","last_change":"2024-04-25T09:06:44.379324+0000","last_active":"2024-04-25T09:06:45.369877+0000","last_peered":"2024-04-25T09:06:45.369877+0000","last_clean":"2024-04-25T09:06:45.369877+0000","last_became_active":"2024-04-25T09:06:44.378973+0000","last_became_peered":"2024-04-25T09:06:44.378973+0000","last_unstale":"2024-04-25T09:06:45.369877+0000","last_undegraded":"2024-04-25T09:06:45.369877+0000","last_fullsized":"2024-04-25T09:06:45.369877+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:02.753649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118845+0000","last_change":"2024-04-25T09:06:43.341776+0000","last_active":"2024-04-25T09:06:46.118845+0000","last_peered":"2024-04-25T09:06:46.118845+0000","last_clean":"2024-04-25T09:06:46.118845+0000","last_became_active":"2024-04-25T09:06:43.341531+0000","last_became_peered":"2024-04-25T09:06:43.341531+0000","last_unstale":"2024-04-25T09:06:46.118845+0000","last_undegraded":"2024-04-25T09:06:46.118845+0000","last_fullsized":"2024-04-25T09:06:46.118845+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:30:50.542949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118733+0000","last_change":"2024-04-25T09:06:44.371643+0000","last_active":"2024-04-25T09:06:46.118733+0000","last_peered":"2024-04-25T09:06:46.118733+0000","last_clean":"2024-04-25T09:06:46.118733+0000","last_became_active":"2024-04-25T09:06:44.371379+0000","last_became_peered":"2024-04-25T09:06:44.371379+0000","last_unstale":"2024-04-25T09:06:46.118733+0000","last_undegraded":"2024-04-25T09:06:46.118733+0000","last_fullsized":"2024-04-25T09:06:46.118733+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:57.567952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"57'2","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119156+0000","last_change":"2024-04-25T09:06:43.349390+0000","last_active":"2024-04-25T09:06:46.119156+0000","last_peered":"2024-04-25T09:06:46.119156+0000","last_clean":"2024-04-25T09:06:46.119156+0000","last_became_active":"2024-04-25T09:06:43.348273+0000","last_became_peered":"2024-04-25T09:06:43.348273+0000","last_unstale":"2024-04-25T09:06:46.119156+0000","last_undegraded":"2024-04-25T09:06:46.119156+0000","last_fullsized":"2024-04-25T09:06:46.119156+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:15.974360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118674+0000","last_change":"2024-04-25T09:06:44.374084+0000","last_active":"2024-04-25T09:06:46.118674+0000","last_peered":"2024-04-25T09:06:46.118674+0000","last_clean":"2024-04-25T09:06:46.118674+0000","last_became_active":"2024-04-25T09:06:44.373472+0000","last_became_peered":"2024-04-25T09:06:44.373472+0000","last_unstale":"2024-04-25T09:06:46.118674+0000","last_undegraded":"2024-04-25T09:06:46.118674+0000","last_fullsized":"2024-04-25T09:06:46.118674+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:58.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117524+0000","last_change":"2024-04-25T09:06:43.358082+0000","last_active":"2024-04-25T09:06:46.117524+0000","last_peered":"2024-04-25T09:06:46.117524+0000","last_clean":"2024-04-25T09:06:46.117524+0000","last_became_active":"2024-04-25T09:06:43.357770+0000","last_became_peered":"2024-04-25T09:06:43.357770+0000","last_unstale":"2024-04-25T09:06:46.117524+0000","last_undegraded":"2024-04-25T09:06:46.117524+0000","last_fullsized":"2024-04-25T09:06:46.117524+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:02.964807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118019+0000","last_change":"2024-04-25T09:06:44.371595+0000","last_active":"2024-04-25T09:06:46.118019+0000","last_peered":"2024-04-25T09:06:46.118019+0000","last_clean":"2024-04-25T09:06:46.118019+0000","last_became_active":"2024-04-25T09:06:44.371350+0000","last_became_peered":"2024-04-25T09:06:44.371350+0000","last_unstale":"2024-04-25T09:06:46.118019+0000","last_undegraded":"2024-04-25T09:06:46.118019+0000","last_fullsized":"2024-04-25T09:06:46.118019+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:56.106313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118494+0000","last_change":"2024-04-25T09:06:43.344024+0000","last_active":"2024-04-25T09:06:46.118494+0000","last_peered":"2024-04-25T09:06:46.118494+0000","last_clean":"2024-04-25T09:06:46.118494+0000","last_became_active":"2024-04-25T09:06:43.343210+0000","last_became_peered":"2024-04-25T09:06:43.343210+0000","last_unstale":"2024-04-25T09:06:46.118494+0000","last_undegraded":"2024-04-25T09:06:46.118494+0000","last_fullsized":"2024-04-25T09:06:46.118494+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:36.899491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119046+0000","last_change":"2024-04-25T09:06:44.368233+0000","last_active":"2024-04-25T09:06:46.119046+0000","last_peered":"2024-04-25T09:06:46.119046+0000","last_clean":"2024-04-25T09:06:46.119046+0000","last_became_active":"2024-04-25T09:06:44.367948+0000","last_became_peered":"2024-04-25T09:06:44.367948+0000","last_unstale":"2024-04-25T09:06:46.119046+0000","last_undegraded":"2024-04-25T09:06:46.119046+0000","last_fullsized":"2024-04-25T09:06:46.119046+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:04.888010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"57'2","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118015+0000","last_change":"2024-04-25T09:06:43.354248+0000","last_active":"2024-04-25T09:06:46.118015+0000","last_peered":"2024-04-25T09:06:46.118015+0000","last_clean":"2024-04-25T09:06:46.118015+0000","last_became_active":"2024-04-25T09:06:43.353952+0000","last_became_peered":"2024-04-25T09:06:43.353952+0000","last_unstale":"2024-04-25T09:06:46.118015+0000","last_undegraded":"2024-04-25T09:06:46.118015+0000","last_fullsized":"2024-04-25T09:06:46.118015+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:17.401620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119155+0000","last_change":"2024-04-25T09:06:44.368822+0000","last_active":"2024-04-25T09:06:46.119155+0000","last_peered":"2024-04-25T09:06:46.119155+0000","last_clean":"2024-04-25T09:06:46.119155+0000","last_became_active":"2024-04-25T09:06:44.368536+0000","last_became_peered":"2024-04-25T09:06:44.368536+0000","last_unstale":"2024-04-25T09:06:46.119155+0000","last_undegraded":"2024-04-25T09:06:46.119155+0000","last_fullsized":"2024-04-25T09:06:46.119155+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:30.025920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119544+0000","last_change":"2024-04-25T09:06:43.338943+0000","last_active":"2024-04-25T09:06:46.119544+0000","last_peered":"2024-04-25T09:06:46.119544+0000","last_clean":"2024-04-25T09:06:46.119544+0000","last_became_active":"2024-04-25T09:06:43.338653+0000","last_became_peered":"2024-04-25T09:06:43.338653+0000","last_unstale":"2024-04-25T09:06:46.119544+0000","last_undegraded":"2024-04-25T09:06:46.119544+0000","last_fullsized":"2024-04-25T09:06:46.119544+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:39.719877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117680+0000","last_change":"2024-04-25T09:06:44.362793+0000","last_active":"2024-04-25T09:06:46.117680+0000","last_peered":"2024-04-25T09:06:46.117680+0000","last_clean":"2024-04-25T09:06:46.117680+0000","last_became_active":"2024-04-25T09:06:44.362090+0000","last_became_peered":"2024-04-25T09:06:44.362090+0000","last_unstale":"2024-04-25T09:06:46.117680+0000","last_undegraded":"2024-04-25T09:06:46.117680+0000","last_fullsized":"2024-04-25T09:06:46.117680+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:30:51.550190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370765+0000","last_change":"2024-04-25T09:06:43.335474+0000","last_active":"2024-04-25T09:06:45.370765+0000","last_peered":"2024-04-25T09:06:45.370765+0000","last_clean":"2024-04-25T09:06:45.370765+0000","last_became_active":"2024-04-25T09:06:43.335163+0000","last_became_peered":"2024-04-25T09:06:43.335163+0000","last_unstale":"2024-04-25T09:06:45.370765+0000","last_undegraded":"2024-04-25T09:06:45.370765+0000","last_fullsized":"2024-04-25T09:06:45.370765+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:00.526715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119399+0000","last_change":"2024-04-25T09:06:44.373655+0000","last_active":"2024-04-25T09:06:46.119399+0000","last_peered":"2024-04-25T09:06:46.119399+0000","last_clean":"2024-04-25T09:06:46.119399+0000","last_became_active":"2024-04-25T09:06:44.370781+0000","last_became_peered":"2024-04-25T09:06:44.370781+0000","last_unstale":"2024-04-25T09:06:46.119399+0000","last_undegraded":"2024-04-25T09:06:46.119399+0000","last_fullsized":"2024-04-25T09:06:46.119399+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:37.997829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118953+0000","last_change":"2024-04-25T09:06:43.348066+0000","last_active":"2024-04-25T09:06:46.118953+0000","last_peered":"2024-04-25T09:06:46.118953+0000","last_clean":"2024-04-25T09:06:46.118953+0000","last_became_active":"2024-04-25T09:06:43.347705+0000","last_became_peered":"2024-04-25T09:06:43.347705+0000","last_unstale":"2024-04-25T09:06:46.118953+0000","last_undegraded":"2024-04-25T09:06:46.118953+0000","last_fullsized":"2024-04-25T09:06:46.118953+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:02.285914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118941+0000","last_change":"2024-04-25T09:06:44.377982+0000","last_active":"2024-04-25T09:06:46.118941+0000","last_peered":"2024-04-25T09:06:46.118941+0000","last_clean":"2024-04-25T09:06:46.118941+0000","last_became_active":"2024-04-25T09:06:44.377247+0000","last_became_peered":"2024-04-25T09:06:44.377247+0000","last_unstale":"2024-04-25T09:06:46.118941+0000","last_undegraded":"2024-04-25T09:06:46.118941+0000","last_fullsized":"2024-04-25T09:06:46.118941+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:51.446033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117409+0000","last_change":"2024-04-25T09:06:43.351949+0000","last_active":"2024-04-25T09:06:46.117409+0000","last_peered":"2024-04-25T09:06:46.117409+0000","last_clean":"2024-04-25T09:06:46.117409+0000","last_became_active":"2024-04-25T09:06:43.351642+0000","last_became_peered":"2024-04-25T09:06:43.351642+0000","last_unstale":"2024-04-25T09:06:46.117409+0000","last_undegraded":"2024-04-25T09:06:46.117409+0000","last_fullsized":"2024-04-25T09:06:46.117409+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:46.768769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369991+0000","last_change":"2024-04-25T09:06:44.381696+0000","last_active":"2024-04-25T09:06:45.369991+0000","last_peered":"2024-04-25T09:06:45.369991+0000","last_clean":"2024-04-25T09:06:45.369991+0000","last_became_active":"2024-04-25T09:06:44.381432+0000","last_became_peered":"2024-04-25T09:06:44.381432+0000","last_unstale":"2024-04-25T09:06:45.369991+0000","last_undegraded":"2024-04-25T09:06:45.369991+0000","last_fullsized":"2024-04-25T09:06:45.369991+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:16.871085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.803189+0000","last_change":"2024-04-25T09:06:43.335030+0000","last_active":"2024-04-25T09:06:45.803189+0000","last_peered":"2024-04-25T09:06:45.803189+0000","last_clean":"2024-04-25T09:06:45.803189+0000","last_became_active":"2024-04-25T09:06:43.334703+0000","last_became_peered":"2024-04-25T09:06:43.334703+0000","last_unstale":"2024-04-25T09:06:45.803189+0000","last_undegraded":"2024-04-25T09:06:45.803189+0000","last_fullsized":"2024-04-25T09:06:45.803189+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:32.496186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117332+0000","last_change":"2024-04-25T09:06:44.361864+0000","last_active":"2024-04-25T09:06:46.117332+0000","last_peered":"2024-04-25T09:06:46.117332+0000","last_clean":"2024-04-25T09:06:46.117332+0000","last_became_active":"2024-04-25T09:06:44.361519+0000","last_became_peered":"2024-04-25T09:06:44.361519+0000","last_unstale":"2024-04-25T09:06:46.117332+0000","last_undegraded":"2024-04-25T09:06:46.117332+0000","last_fullsized":"2024-04-25T09:06:46.117332+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:21.824025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117252+0000","last_change":"2024-04-25T09:06:43.344057+0000","last_active":"2024-04-25T09:06:46.117252+0000","last_peered":"2024-04-25T09:06:46.117252+0000","last_clean":"2024-04-25T09:06:46.117252+0000","last_became_active":"2024-04-25T09:06:43.343823+0000","last_became_peered":"2024-04-25T09:06:43.343823+0000","last_unstale":"2024-04-25T09:06:46.117252+0000","last_undegraded":"2024-04-25T09:06:46.117252+0000","last_fullsized":"2024-04-25T09:06:46.117252+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:17.894523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118445+0000","last_change":"2024-04-25T09:06:44.376838+0000","last_active":"2024-04-25T09:06:46.118445+0000","last_peered":"2024-04-25T09:06:46.118445+0000","last_clean":"2024-04-25T09:06:46.118445+0000","last_became_active":"2024-04-25T09:06:44.376071+0000","last_became_peered":"2024-04-25T09:06:44.376071+0000","last_unstale":"2024-04-25T09:06:46.118445+0000","last_undegraded":"2024-04-25T09:06:46.118445+0000","last_fullsized":"2024-04-25T09:06:46.118445+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:06.739812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117943+0000","last_change":"2024-04-25T09:06:43.343216+0000","last_active":"2024-04-25T09:06:46.117943+0000","last_peered":"2024-04-25T09:06:46.117943+0000","last_clean":"2024-04-25T09:06:46.117943+0000","last_became_active":"2024-04-25T09:06:43.342919+0000","last_became_peered":"2024-04-25T09:06:43.342919+0000","last_unstale":"2024-04-25T09:06:46.117943+0000","last_undegraded":"2024-04-25T09:06:46.117943+0000","last_fullsized":"2024-04-25T09:06:46.117943+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:29.018679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117497+0000","last_change":"2024-04-25T09:06:44.385406+0000","last_active":"2024-04-25T09:06:46.117497+0000","last_peered":"2024-04-25T09:06:46.117497+0000","last_clean":"2024-04-25T09:06:46.117497+0000","last_became_active":"2024-04-25T09:06:44.385120+0000","last_became_peered":"2024-04-25T09:06:44.385120+0000","last_unstale":"2024-04-25T09:06:46.117497+0000","last_undegraded":"2024-04-25T09:06:46.117497+0000","last_fullsized":"2024-04-25T09:06:46.117497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:18.351825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370491+0000","last_change":"2024-04-25T09:06:43.342236+0000","last_active":"2024-04-25T09:06:45.370491+0000","last_peered":"2024-04-25T09:06:45.370491+0000","last_clean":"2024-04-25T09:06:45.370491+0000","last_became_active":"2024-04-25T09:06:43.341950+0000","last_became_peered":"2024-04-25T09:06:43.341950+0000","last_unstale":"2024-04-25T09:06:45.370491+0000","last_undegraded":"2024-04-25T09:06:45.370491+0000","last_fullsized":"2024-04-25T09:06:45.370491+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:57.966121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":240,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369637+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:06:45.369637+0000","last_peered":"2024-04-25T09:06:45.369637+0000","last_clean":"2024-04-25T09:06:45.369637+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:06:45.369637+0000","last_undegraded":"2024-04-25T09:06:45.369637+0000","last_fullsized":"2024-04-25T09:06:45.369637+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1298432,"data_stored":880283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":696320,"data_stored":289755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":704512,"data_stored":290407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":708608,"data_stored":291367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":704512,"data_stored":289811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":704512,"data_stored":289811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":700416,"data_stored":289845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1306624,"data_stored":882317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:06:52.967 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:06:53.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.124+0000 7fb8a3000640 1 Processor -- start 2024-04-25T09:06:53.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.124+0000 7fb8a3000640 1 -- start start 2024-04-25T09:06:53.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.124+0000 7fb8a3000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb89c15da20 0x7fb89c0cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.124+0000 7fb8a3000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb89c1622f0 0x7fb89c0cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.124+0000 7fb8a3000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb89c0cdd90 con 0x7fb89c15de00 2024-04-25T09:06:53.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.124+0000 7fb8a3000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89c0ce070 con 0x7fb89c1622f0 2024-04-25T09:06:53.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.124+0000 7fb8a3000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c161810 con 0x7fb89c15da20 2024-04-25T09:06:53.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.124+0000 7fb8a1c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb89c15da20 0x7fb89c0cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.124+0000 7fb8a1c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb89c15da20 0x7fb89c0cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:58576/0 (socket says 172.21.15.175:58576) 2024-04-25T09:06:53.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.124+0000 7fb8a1c00640 1 -- 172.21.15.175:0/1579209567 learned_addr learned my addr 172.21.15.175:0/1579209567 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:53.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.124+0000 7fb8a2600640 1 --2- 172.21.15.175:0/1579209567 >> v2:172.21.15.177:3300/0 conn(0x7fb89c1622f0 0x7fb89c0cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.124+0000 7fb8a1c00640 1 -- 172.21.15.175:0/1579209567 >> v2:172.21.15.177:3300/0 conn(0x7fb89c1622f0 msgr2=0x7fb89c0cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.124+0000 7fb8a1c00640 1 --2- 172.21.15.175:0/1579209567 >> v2:172.21.15.177:3300/0 conn(0x7fb89c1622f0 0x7fb89c0cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.124+0000 7fb8a1c00640 1 -- 172.21.15.175:0/1579209567 >> v1:172.21.15.177:6789/0 conn(0x7fb89c15de00 legacy=0x7fb89c0cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.124+0000 7fb89be00640 1 -- 172.21.15.175:0/1579209567 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303555821 0 0) 0x7fb89c0cdd90 con 0x7fb89c15de00 2024-04-25T09:06:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.124+0000 7fb8a1c00640 1 -- 172.21.15.175:0/1579209567 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c161af0 con 0x7fb89c15da20 2024-04-25T09:06:53.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.128+0000 7fb8a1c00640 1 --2- 172.21.15.175:0/1579209567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb89c15da20 0x7fb89c0cd540 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb890009870 tx=0x7fb89001c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=326ea1edb0d80e2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:53.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.128+0000 7fb89be00640 1 -- 172.21.15.175:0/1579209567 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8900b0070 con 0x7fb89c15da20 2024-04-25T09:06:53.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.128+0000 7fb89be00640 1 -- 172.21.15.175:0/1579209567 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb890004230 con 0x7fb89c15da20 2024-04-25T09:06:53.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.128+0000 7fb89be00640 1 -- 172.21.15.175:0/1579209567 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb890003620 con 0x7fb89c15da20 2024-04-25T09:06:53.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.128+0000 7fb8a3000640 1 -- 172.21.15.175:0/1579209567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb89c15da20 msgr2=0x7fb89c0cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.128+0000 7fb8a3000640 1 --2- 172.21.15.175:0/1579209567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb89c15da20 0x7fb89c0cd540 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb890009870 tx=0x7fb89001c440 comp rx=0 tx=0).stop 2024-04-25T09:06:53.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.128+0000 7fb8a3000640 1 -- 172.21.15.175:0/1579209567 shutdown_connections 2024-04-25T09:06:53.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.128+0000 7fb8a3000640 1 --2- 172.21.15.175:0/1579209567 >> v2:172.21.15.177:3300/0 conn(0x7fb89c1622f0 0x7fb89c0cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.128+0000 7fb8a3000640 1 --2- 172.21.15.175:0/1579209567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb89c15da20 0x7fb89c0cd540 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.128+0000 7fb8a3000640 1 -- 172.21.15.175:0/1579209567 >> 172.21.15.175:0/1579209567 conn(0x7fb89c072760 msgr2=0x7fb89c099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:53.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.128+0000 7fb8a3000640 1 -- 172.21.15.175:0/1579209567 shutdown_connections 2024-04-25T09:06:53.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.128+0000 7fb8a3000640 1 -- 172.21.15.175:0/1579209567 wait complete. 2024-04-25T09:06:53.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a3000640 1 Processor -- start 2024-04-25T09:06:53.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a3000640 1 -- start start 2024-04-25T09:06:53.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a3000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb89c15da20 0x7fb89c1f82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a3000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb89c15de00 0x7fb89c1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a3000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb89c1622f0 0x7fb89c15c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a3000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c16aba0 con 0x7fb89c15da20 2024-04-25T09:06:53.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a3000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c16aa20 con 0x7fb89c15de00 2024-04-25T09:06:53.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a3000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c16ad20 con 0x7fb89c1622f0 2024-04-25T09:06:53.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a1c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb89c15da20 0x7fb89c1f82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a1c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb89c15da20 0x7fb89c1f82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34792/0 (socket says 172.21.15.175:34792) 2024-04-25T09:06:53.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a1c00640 1 -- 172.21.15.175:0/328311553 learned_addr learned my addr 172.21.15.175:0/328311553 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:53.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a2600640 1 --2- 172.21.15.175:0/328311553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb89c1622f0 0x7fb89c15c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a1200640 1 --2- 172.21.15.175:0/328311553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb89c15de00 0x7fb89c1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a1c00640 1 -- 172.21.15.175:0/328311553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb89c1622f0 msgr2=0x7fb89c15c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a1c00640 1 --2- 172.21.15.175:0/328311553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb89c1622f0 0x7fb89c15c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a1c00640 1 -- 172.21.15.175:0/328311553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb89c15de00 msgr2=0x7fb89c1555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a1c00640 1 --2- 172.21.15.175:0/328311553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb89c15de00 0x7fb89c1555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a1c00640 1 -- 172.21.15.175:0/328311553 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c155b30 con 0x7fb89c15da20 2024-04-25T09:06:53.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a1c00640 1 --2- 172.21.15.175:0/328311553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb89c15da20 0x7fb89c1f82c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb89001a070 tx=0x7fb8900191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:53.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb899600640 1 -- 172.21.15.175:0/328311553 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8900b9020 con 0x7fb89c15da20 2024-04-25T09:06:53.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb899600640 1 -- 172.21.15.175:0/328311553 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8900b1040 con 0x7fb89c15da20 2024-04-25T09:06:53.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a3000640 1 -- 172.21.15.175:0/328311553 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb89c15ba70 con 0x7fb89c15da20 2024-04-25T09:06:53.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb899600640 1 -- 172.21.15.175:0/328311553 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8900b0050 con 0x7fb89c15da20 2024-04-25T09:06:53.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.132+0000 7fb8a3000640 1 -- 172.21.15.175:0/328311553 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89c1f7ac0 con 0x7fb89c15da20 2024-04-25T09:06:53.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.136+0000 7fb8a3000640 1 -- 172.21.15.175:0/328311553 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb89c074a60 con 0x7fb89c15da20 2024-04-25T09:06:53.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.136+0000 7fb899600640 1 -- 172.21.15.175:0/328311553 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb8900bc020 con 0x7fb89c15da20 2024-04-25T09:06:53.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.136+0000 7fb899600640 1 --2- 172.21.15.175:0/328311553 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb87c066f60 0x7fb87c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.136+0000 7fb899600640 1 -- 172.21.15.175:0/328311553 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb89011ec10 con 0x7fb89c15da20 2024-04-25T09:06:53.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.136+0000 7fb8a1200640 1 --2- 172.21.15.175:0/328311553 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb87c066f60 0x7fb87c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.136+0000 7fb8a1200640 1 --2- 172.21.15.175:0/328311553 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb87c066f60 0x7fb87c069420 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb89c09a0d0 tx=0x7fb888009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:53.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.140+0000 7fb899600640 1 -- 172.21.15.175:0/328311553 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb8900c3030 con 0x7fb89c15da20 2024-04-25T09:06:53.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.288+0000 7fb8a3000640 1 -- 172.21.15.175:0/328311553 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb89c072450 con 0x7fb87c066f60 2024-04-25T09:06:53.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.296+0000 7fb899600640 1 -- 172.21.15.175:0/328311553 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251955 (secure 0 0 0) 0x7fb89c072450 con 0x7fb87c066f60 2024-04-25T09:06:53.289 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:53.290 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:06:53.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.300+0000 7fb8a3000640 1 -- 172.21.15.175:0/328311553 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb87c066f60 msgr2=0x7fb87c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.300+0000 7fb8a3000640 1 --2- 172.21.15.175:0/328311553 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb87c066f60 0x7fb87c069420 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb89c09a0d0 tx=0x7fb888009040 comp rx=0 tx=0).stop 2024-04-25T09:06:53.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.300+0000 7fb8a3000640 1 -- 172.21.15.175:0/328311553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb89c15da20 msgr2=0x7fb89c1f82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.300+0000 7fb8a3000640 1 --2- 172.21.15.175:0/328311553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb89c15da20 0x7fb89c1f82c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb89001a070 tx=0x7fb8900191e0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.300+0000 7fb8a3000640 1 -- 172.21.15.175:0/328311553 shutdown_connections 2024-04-25T09:06:53.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.300+0000 7fb8a3000640 1 --2- 172.21.15.175:0/328311553 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb87c066f60 0x7fb87c069420 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.300+0000 7fb8a3000640 1 --2- 172.21.15.175:0/328311553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb89c1622f0 0x7fb89c15c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.300+0000 7fb8a3000640 1 --2- 172.21.15.175:0/328311553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb89c15de00 0x7fb89c1555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.300+0000 7fb8a3000640 1 --2- 172.21.15.175:0/328311553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb89c15da20 0x7fb89c1f82c0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.300+0000 7fb8a3000640 1 -- 172.21.15.175:0/328311553 >> 172.21.15.175:0/328311553 conn(0x7fb89c072760 msgr2=0x7fb89c0cbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:53.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.300+0000 7fb8a3000640 1 -- 172.21.15.175:0/328311553 shutdown_connections 2024-04-25T09:06:53.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.300+0000 7fb8a3000640 1 -- 172.21.15.175:0/328311553 wait complete. 2024-04-25T09:06:53.308 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-04-25T09:06:51.825312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231176,"kb_used_data":6664,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743544,"statfs":{"total":773094113280,"available":772857389056,"internally_reserved":0,"allocated":6823936,"data_stored":3503596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001480"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370313+0000","last_change":"2024-04-25T09:06:44.378253+0000","last_active":"2024-04-25T09:06:45.370313+0000","last_peered":"2024-04-25T09:06:45.370313+0000","last_clean":"2024-04-25T09:06:45.370313+0000","last_became_active":"2024-04-25T09:06:44.377939+0000","last_became_peered":"2024-04-25T09:06:44.377939+0000","last_unstale":"2024-04-25T09:06:45.370313+0000","last_undegraded":"2024-04-25T09:06:45.370313+0000","last_fullsized":"2024-04-25T09:06:45.370313+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:50.634776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118626+0000","last_change":"2024-04-25T09:06:44.375426+0000","last_active":"2024-04-25T09:06:46.118626+0000","last_peered":"2024-04-25T09:06:46.118626+0000","last_clean":"2024-04-25T09:06:46.118626+0000","last_became_active":"2024-04-25T09:06:44.373078+0000","last_became_peered":"2024-04-25T09:06:44.373078+0000","last_unstale":"2024-04-25T09:06:46.118626+0000","last_undegraded":"2024-04-25T09:06:46.118626+0000","last_fullsized":"2024-04-25T09:06:46.118626+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:28.633399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369345+0000","last_change":"2024-04-25T09:06:44.376491+0000","last_active":"2024-04-25T09:06:45.369345+0000","last_peered":"2024-04-25T09:06:45.369345+0000","last_clean":"2024-04-25T09:06:45.369345+0000","last_became_active":"2024-04-25T09:06:44.375504+0000","last_became_peered":"2024-04-25T09:06:44.375504+0000","last_unstale":"2024-04-25T09:06:45.369345+0000","last_undegraded":"2024-04-25T09:06:45.369345+0000","last_fullsized":"2024-04-25T09:06:45.369345+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:46.798871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118830+0000","last_change":"2024-04-25T09:06:44.370383+0000","last_active":"2024-04-25T09:06:46.118830+0000","last_peered":"2024-04-25T09:06:46.118830+0000","last_clean":"2024-04-25T09:06:46.118830+0000","last_became_active":"2024-04-25T09:06:44.369901+0000","last_became_peered":"2024-04-25T09:06:44.369901+0000","last_unstale":"2024-04-25T09:06:46.118830+0000","last_undegraded":"2024-04-25T09:06:46.118830+0000","last_fullsized":"2024-04-25T09:06:46.118830+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:37.997829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370077+0000","last_change":"2024-04-25T09:06:44.368235+0000","last_active":"2024-04-25T09:06:45.370077+0000","last_peered":"2024-04-25T09:06:45.370077+0000","last_clean":"2024-04-25T09:06:45.370077+0000","last_became_active":"2024-04-25T09:06:44.367910+0000","last_became_peered":"2024-04-25T09:06:44.367910+0000","last_unstale":"2024-04-25T09:06:45.370077+0000","last_undegraded":"2024-04-25T09:06:45.370077+0000","last_fullsized":"2024-04-25T09:06:45.370077+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:49.420133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118223+0000","last_change":"2024-04-25T09:06:44.376130+0000","last_active":"2024-04-25T09:06:46.118223+0000","last_peered":"2024-04-25T09:06:46.118223+0000","last_clean":"2024-04-25T09:06:46.118223+0000","last_became_active":"2024-04-25T09:06:44.375875+0000","last_became_peered":"2024-04-25T09:06:44.375875+0000","last_unstale":"2024-04-25T09:06:46.118223+0000","last_undegraded":"2024-04-25T09:06:46.118223+0000","last_fullsized":"2024-04-25T09:06:46.118223+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:37.845256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.803122+0000","last_change":"2024-04-25T09:06:44.366312+0000","last_active":"2024-04-25T09:06:45.803122+0000","last_peered":"2024-04-25T09:06:45.803122+0000","last_clean":"2024-04-25T09:06:45.803122+0000","last_became_active":"2024-04-25T09:06:44.366041+0000","last_became_peered":"2024-04-25T09:06:44.366041+0000","last_unstale":"2024-04-25T09:06:45.803122+0000","last_undegraded":"2024-04-25T09:06:45.803122+0000","last_fullsized":"2024-04-25T09:06:45.803122+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:08.132318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117389+0000","last_change":"2024-04-25T09:06:44.383257+0000","last_active":"2024-04-25T09:06:46.117389+0000","last_peered":"2024-04-25T09:06:46.117389+0000","last_clean":"2024-04-25T09:06:46.117389+0000","last_became_active":"2024-04-25T09:06:44.383000+0000","last_became_peered":"2024-04-25T09:06:44.383000+0000","last_unstale":"2024-04-25T09:06:46.117389+0000","last_undegraded":"2024-04-25T09:06:46.117389+0000","last_fullsized":"2024-04-25T09:06:46.117389+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:22.146522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.803399+0000","last_change":"2024-04-25T09:06:44.377437+0000","last_active":"2024-04-25T09:06:45.803399+0000","last_peered":"2024-04-25T09:06:45.803399+0000","last_clean":"2024-04-25T09:06:45.803399+0000","last_became_active":"2024-04-25T09:06:44.377130+0000","last_became_peered":"2024-04-25T09:06:44.377130+0000","last_unstale":"2024-04-25T09:06:45.803399+0000","last_undegraded":"2024-04-25T09:06:45.803399+0000","last_fullsized":"2024-04-25T09:06:45.803399+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:46.826020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117891+0000","last_change":"2024-04-25T09:06:44.367067+0000","last_active":"2024-04-25T09:06:46.117891+0000","last_peered":"2024-04-25T09:06:46.117891+0000","last_clean":"2024-04-25T09:06:46.117891+0000","last_became_active":"2024-04-25T09:06:44.362233+0000","last_became_peered":"2024-04-25T09:06:44.362233+0000","last_unstale":"2024-04-25T09:06:46.117891+0000","last_undegraded":"2024-04-25T09:06:46.117891+0000","last_fullsized":"2024-04-25T09:06:46.117891+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:29.574277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118004+0000","last_change":"2024-04-25T09:06:44.377725+0000","last_active":"2024-04-25T09:06:46.118004+0000","last_peered":"2024-04-25T09:06:46.118004+0000","last_clean":"2024-04-25T09:06:46.118004+0000","last_became_active":"2024-04-25T09:06:44.377361+0000","last_became_peered":"2024-04-25T09:06:44.377361+0000","last_unstale":"2024-04-25T09:06:46.118004+0000","last_undegraded":"2024-04-25T09:06:46.118004+0000","last_fullsized":"2024-04-25T09:06:46.118004+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:07:05.465866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118780+0000","last_change":"2024-04-25T09:06:44.375595+0000","last_active":"2024-04-25T09:06:46.118780+0000","last_peered":"2024-04-25T09:06:46.118780+0000","last_clean":"2024-04-25T09:06:46.118780+0000","last_became_active":"2024-04-25T09:06:44.371154+0000","last_became_peered":"2024-04-25T09:06:44.371154+0000","last_unstale":"2024-04-25T09:06:46.118780+0000","last_undegraded":"2024-04-25T09:06:46.118780+0000","last_fullsized":"2024-04-25T09:06:46.118780+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:46.798871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370864+0000","last_change":"2024-04-25T09:06:44.373884+0000","last_active":"2024-04-25T09:06:45.370864+0000","last_peered":"2024-04-25T09:06:45.370864+0000","last_clean":"2024-04-25T09:06:45.370864+0000","last_became_active":"2024-04-25T09:06:44.373608+0000","last_became_peered":"2024-04-25T09:06:44.373608+0000","last_unstale":"2024-04-25T09:06:45.370864+0000","last_undegraded":"2024-04-25T09:06:45.370864+0000","last_fullsized":"2024-04-25T09:06:45.370864+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:18.408861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.803095+0000","last_change":"2024-04-25T09:06:44.378147+0000","last_active":"2024-04-25T09:06:45.803095+0000","last_peered":"2024-04-25T09:06:45.803095+0000","last_clean":"2024-04-25T09:06:45.803095+0000","last_became_active":"2024-04-25T09:06:44.377728+0000","last_became_peered":"2024-04-25T09:06:44.377728+0000","last_unstale":"2024-04-25T09:06:45.803095+0000","last_undegraded":"2024-04-25T09:06:45.803095+0000","last_fullsized":"2024-04-25T09:06:45.803095+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:40.727118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.803174+0000","last_change":"2024-04-25T09:06:44.361919+0000","last_active":"2024-04-25T09:06:45.803174+0000","last_peered":"2024-04-25T09:06:45.803174+0000","last_clean":"2024-04-25T09:06:45.803174+0000","last_became_active":"2024-04-25T09:06:44.361554+0000","last_became_peered":"2024-04-25T09:06:44.361554+0000","last_unstale":"2024-04-25T09:06:45.803174+0000","last_undegraded":"2024-04-25T09:06:45.803174+0000","last_fullsized":"2024-04-25T09:06:45.803174+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:09.816218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117358+0000","last_change":"2024-04-25T09:06:44.370488+0000","last_active":"2024-04-25T09:06:46.117358+0000","last_peered":"2024-04-25T09:06:46.117358+0000","last_clean":"2024-04-25T09:06:46.117358+0000","last_became_active":"2024-04-25T09:06:44.370219+0000","last_became_peered":"2024-04-25T09:06:44.370219+0000","last_unstale":"2024-04-25T09:06:46.117358+0000","last_undegraded":"2024-04-25T09:06:46.117358+0000","last_fullsized":"2024-04-25T09:06:46.117358+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:37:33.390477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118240+0000","last_change":"2024-04-25T09:06:44.384654+0000","last_active":"2024-04-25T09:06:46.118240+0000","last_peered":"2024-04-25T09:06:46.118240+0000","last_clean":"2024-04-25T09:06:46.118240+0000","last_became_active":"2024-04-25T09:06:44.384396+0000","last_became_peered":"2024-04-25T09:06:44.384396+0000","last_unstale":"2024-04-25T09:06:46.118240+0000","last_undegraded":"2024-04-25T09:06:46.118240+0000","last_fullsized":"2024-04-25T09:06:46.118240+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:12.215787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369738+0000","last_change":"2024-04-25T09:06:44.377476+0000","last_active":"2024-04-25T09:06:45.369738+0000","last_peered":"2024-04-25T09:06:45.369738+0000","last_clean":"2024-04-25T09:06:45.369738+0000","last_became_active":"2024-04-25T09:06:44.377182+0000","last_became_peered":"2024-04-25T09:06:44.377182+0000","last_unstale":"2024-04-25T09:06:45.369738+0000","last_undegraded":"2024-04-25T09:06:45.369738+0000","last_fullsized":"2024-04-25T09:06:45.369738+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:30.025920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370165+0000","last_change":"2024-04-25T09:06:44.383085+0000","last_active":"2024-04-25T09:06:45.370165+0000","last_peered":"2024-04-25T09:06:45.370165+0000","last_clean":"2024-04-25T09:06:45.370165+0000","last_became_active":"2024-04-25T09:06:44.382811+0000","last_became_peered":"2024-04-25T09:06:44.382811+0000","last_unstale":"2024-04-25T09:06:45.370165+0000","last_undegraded":"2024-04-25T09:06:45.370165+0000","last_fullsized":"2024-04-25T09:06:45.370165+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:24:09.235171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118077+0000","last_change":"2024-04-25T09:06:44.385093+0000","last_active":"2024-04-25T09:06:46.118077+0000","last_peered":"2024-04-25T09:06:46.118077+0000","last_clean":"2024-04-25T09:06:46.118077+0000","last_became_active":"2024-04-25T09:06:44.384846+0000","last_became_peered":"2024-04-25T09:06:44.384846+0000","last_unstale":"2024-04-25T09:06:46.118077+0000","last_undegraded":"2024-04-25T09:06:46.118077+0000","last_fullsized":"2024-04-25T09:06:46.118077+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:28.332138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369437+0000","last_change":"2024-04-25T09:06:44.372404+0000","last_active":"2024-04-25T09:06:45.369437+0000","last_peered":"2024-04-25T09:06:45.369437+0000","last_clean":"2024-04-25T09:06:45.369437+0000","last_became_active":"2024-04-25T09:06:44.372139+0000","last_became_peered":"2024-04-25T09:06:44.372139+0000","last_unstale":"2024-04-25T09:06:45.369437+0000","last_undegraded":"2024-04-25T09:06:45.369437+0000","last_fullsized":"2024-04-25T09:06:45.369437+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:37.997829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118862+0000","last_change":"2024-04-25T09:06:44.387853+0000","last_active":"2024-04-25T09:06:46.118862+0000","last_peered":"2024-04-25T09:06:46.118862+0000","last_clean":"2024-04-25T09:06:46.118862+0000","last_became_active":"2024-04-25T09:06:44.387580+0000","last_became_peered":"2024-04-25T09:06:44.387580+0000","last_unstale":"2024-04-25T09:06:46.118862+0000","last_undegraded":"2024-04-25T09:06:46.118862+0000","last_fullsized":"2024-04-25T09:06:46.118862+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:55.363901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369513+0000","last_change":"2024-04-25T09:06:44.381096+0000","last_active":"2024-04-25T09:06:45.369513+0000","last_peered":"2024-04-25T09:06:45.369513+0000","last_clean":"2024-04-25T09:06:45.369513+0000","last_became_active":"2024-04-25T09:06:44.380551+0000","last_became_peered":"2024-04-25T09:06:44.380551+0000","last_unstale":"2024-04-25T09:06:45.369513+0000","last_undegraded":"2024-04-25T09:06:45.369513+0000","last_fullsized":"2024-04-25T09:06:45.369513+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:04.888010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370681+0000","last_change":"2024-04-25T09:06:44.375386+0000","last_active":"2024-04-25T09:06:45.370681+0000","last_peered":"2024-04-25T09:06:45.370681+0000","last_clean":"2024-04-25T09:06:45.370681+0000","last_became_active":"2024-04-25T09:06:44.375068+0000","last_became_peered":"2024-04-25T09:06:44.375068+0000","last_unstale":"2024-04-25T09:06:45.370681+0000","last_undegraded":"2024-04-25T09:06:45.370681+0000","last_fullsized":"2024-04-25T09:06:45.370681+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:03.972048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370462+0000","last_change":"2024-04-25T09:06:44.363902+0000","last_active":"2024-04-25T09:06:45.370462+0000","last_peered":"2024-04-25T09:06:45.370462+0000","last_clean":"2024-04-25T09:06:45.370462+0000","last_became_active":"2024-04-25T09:06:44.363627+0000","last_became_peered":"2024-04-25T09:06:44.363627+0000","last_unstale":"2024-04-25T09:06:45.370462+0000","last_undegraded":"2024-04-25T09:06:45.370462+0000","last_fullsized":"2024-04-25T09:06:45.370462+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:47.181706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118997+0000","last_change":"2024-04-25T09:06:44.372969+0000","last_active":"2024-04-25T09:06:46.118997+0000","last_peered":"2024-04-25T09:06:46.118997+0000","last_clean":"2024-04-25T09:06:46.118997+0000","last_became_active":"2024-04-25T09:06:44.372653+0000","last_became_peered":"2024-04-25T09:06:44.372653+0000","last_unstale":"2024-04-25T09:06:46.118997+0000","last_undegraded":"2024-04-25T09:06:46.118997+0000","last_fullsized":"2024-04-25T09:06:46.118997+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:50.346255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118727+0000","last_change":"2024-04-25T09:06:44.371885+0000","last_active":"2024-04-25T09:06:46.118727+0000","last_peered":"2024-04-25T09:06:46.118727+0000","last_clean":"2024-04-25T09:06:46.118727+0000","last_became_active":"2024-04-25T09:06:44.371602+0000","last_became_peered":"2024-04-25T09:06:44.371602+0000","last_unstale":"2024-04-25T09:06:46.118727+0000","last_undegraded":"2024-04-25T09:06:46.118727+0000","last_fullsized":"2024-04-25T09:06:46.118727+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:57.567952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370233+0000","last_change":"2024-04-25T09:06:44.366883+0000","last_active":"2024-04-25T09:06:45.370233+0000","last_peered":"2024-04-25T09:06:45.370233+0000","last_clean":"2024-04-25T09:06:45.370233+0000","last_became_active":"2024-04-25T09:06:44.366619+0000","last_became_peered":"2024-04-25T09:06:44.366619+0000","last_unstale":"2024-04-25T09:06:45.370233+0000","last_undegraded":"2024-04-25T09:06:45.370233+0000","last_fullsized":"2024-04-25T09:06:45.370233+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:21.146056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119127+0000","last_change":"2024-04-25T09:06:44.383855+0000","last_active":"2024-04-25T09:06:46.119127+0000","last_peered":"2024-04-25T09:06:46.119127+0000","last_clean":"2024-04-25T09:06:46.119127+0000","last_became_active":"2024-04-25T09:06:44.383691+0000","last_became_peered":"2024-04-25T09:06:44.383691+0000","last_unstale":"2024-04-25T09:06:46.119127+0000","last_undegraded":"2024-04-25T09:06:46.119127+0000","last_fullsized":"2024-04-25T09:06:46.119127+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:58.471037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369259+0000","last_change":"2024-04-25T09:06:44.375322+0000","last_active":"2024-04-25T09:06:45.369259+0000","last_peered":"2024-04-25T09:06:45.369259+0000","last_clean":"2024-04-25T09:06:45.369259+0000","last_became_active":"2024-04-25T09:06:44.375001+0000","last_became_peered":"2024-04-25T09:06:44.375001+0000","last_unstale":"2024-04-25T09:06:45.369259+0000","last_undegraded":"2024-04-25T09:06:45.369259+0000","last_fullsized":"2024-04-25T09:06:45.369259+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:28.027452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370011+0000","last_change":"2024-04-25T09:06:44.363727+0000","last_active":"2024-04-25T09:06:45.370011+0000","last_peered":"2024-04-25T09:06:45.370011+0000","last_clean":"2024-04-25T09:06:45.370011+0000","last_became_active":"2024-04-25T09:06:44.363410+0000","last_became_peered":"2024-04-25T09:06:44.363410+0000","last_unstale":"2024-04-25T09:06:45.370011+0000","last_undegraded":"2024-04-25T09:06:45.370011+0000","last_fullsized":"2024-04-25T09:06:45.370011+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:06.062123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117677+0000","last_change":"2024-04-25T09:06:44.386739+0000","last_active":"2024-04-25T09:06:46.117677+0000","last_peered":"2024-04-25T09:06:46.117677+0000","last_clean":"2024-04-25T09:06:46.117677+0000","last_became_active":"2024-04-25T09:06:44.386416+0000","last_became_peered":"2024-04-25T09:06:44.386416+0000","last_unstale":"2024-04-25T09:06:46.117677+0000","last_undegraded":"2024-04-25T09:06:46.117677+0000","last_fullsized":"2024-04-25T09:06:46.117677+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:38.810236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119484+0000","last_change":"2024-04-25T09:06:44.372241+0000","last_active":"2024-04-25T09:06:46.119484+0000","last_peered":"2024-04-25T09:06:46.119484+0000","last_clean":"2024-04-25T09:06:46.119484+0000","last_became_active":"2024-04-25T09:06:44.371968+0000","last_became_peered":"2024-04-25T09:06:44.371968+0000","last_unstale":"2024-04-25T09:06:46.119484+0000","last_undegraded":"2024-04-25T09:06:46.119484+0000","last_fullsized":"2024-04-25T09:06:46.119484+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:50.346255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119482+0000","last_change":"2024-04-25T09:06:43.342616+0000","last_active":"2024-04-25T09:06:46.119482+0000","last_peered":"2024-04-25T09:06:46.119482+0000","last_clean":"2024-04-25T09:06:46.119482+0000","last_became_active":"2024-04-25T09:06:43.342326+0000","last_became_peered":"2024-04-25T09:06:43.342326+0000","last_unstale":"2024-04-25T09:06:46.119482+0000","last_undegraded":"2024-04-25T09:06:46.119482+0000","last_fullsized":"2024-04-25T09:06:46.119482+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:07:04.458624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118086+0000","last_change":"2024-04-25T09:06:44.370389+0000","last_active":"2024-04-25T09:06:46.118086+0000","last_peered":"2024-04-25T09:06:46.118086+0000","last_clean":"2024-04-25T09:06:46.118086+0000","last_became_active":"2024-04-25T09:06:44.370127+0000","last_became_peered":"2024-04-25T09:06:44.370127+0000","last_unstale":"2024-04-25T09:06:46.118086+0000","last_undegraded":"2024-04-25T09:06:46.118086+0000","last_fullsized":"2024-04-25T09:06:46.118086+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:47.075347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"57'1","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118677+0000","last_change":"2024-04-25T09:06:43.352544+0000","last_active":"2024-04-25T09:06:46.118677+0000","last_peered":"2024-04-25T09:06:46.118677+0000","last_clean":"2024-04-25T09:06:46.118677+0000","last_became_active":"2024-04-25T09:06:43.351876+0000","last_became_peered":"2024-04-25T09:06:43.351876+0000","last_unstale":"2024-04-25T09:06:46.118677+0000","last_undegraded":"2024-04-25T09:06:46.118677+0000","last_fullsized":"2024-04-25T09:06:46.118677+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:01.746407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118784+0000","last_change":"2024-04-25T09:06:44.369341+0000","last_active":"2024-04-25T09:06:46.118784+0000","last_peered":"2024-04-25T09:06:46.118784+0000","last_clean":"2024-04-25T09:06:46.118784+0000","last_became_active":"2024-04-25T09:06:44.369055+0000","last_became_peered":"2024-04-25T09:06:44.369055+0000","last_unstale":"2024-04-25T09:06:46.118784+0000","last_undegraded":"2024-04-25T09:06:46.118784+0000","last_fullsized":"2024-04-25T09:06:46.118784+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:28.027452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119438+0000","last_change":"2024-04-25T09:06:43.343819+0000","last_active":"2024-04-25T09:06:46.119438+0000","last_peered":"2024-04-25T09:06:46.119438+0000","last_clean":"2024-04-25T09:06:46.119438+0000","last_became_active":"2024-04-25T09:06:43.343554+0000","last_became_peered":"2024-04-25T09:06:43.343554+0000","last_unstale":"2024-04-25T09:06:46.119438+0000","last_undegraded":"2024-04-25T09:06:46.119438+0000","last_fullsized":"2024-04-25T09:06:46.119438+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:07.125077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119365+0000","last_change":"2024-04-25T09:06:44.374376+0000","last_active":"2024-04-25T09:06:46.119365+0000","last_peered":"2024-04-25T09:06:46.119365+0000","last_clean":"2024-04-25T09:06:46.119365+0000","last_became_active":"2024-04-25T09:06:44.372139+0000","last_became_peered":"2024-04-25T09:06:44.372139+0000","last_unstale":"2024-04-25T09:06:46.119365+0000","last_undegraded":"2024-04-25T09:06:46.119365+0000","last_fullsized":"2024-04-25T09:06:46.119365+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:46.798871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"57'2","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118847+0000","last_change":"2024-04-25T09:06:43.349507+0000","last_active":"2024-04-25T09:06:46.118847+0000","last_peered":"2024-04-25T09:06:46.118847+0000","last_clean":"2024-04-25T09:06:46.118847+0000","last_became_active":"2024-04-25T09:06:43.349216+0000","last_became_peered":"2024-04-25T09:06:43.349216+0000","last_unstale":"2024-04-25T09:06:46.118847+0000","last_undegraded":"2024-04-25T09:06:46.118847+0000","last_fullsized":"2024-04-25T09:06:46.118847+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:11.345029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118947+0000","last_change":"2024-04-25T09:06:44.376381+0000","last_active":"2024-04-25T09:06:46.118947+0000","last_peered":"2024-04-25T09:06:46.118947+0000","last_clean":"2024-04-25T09:06:46.118947+0000","last_became_active":"2024-04-25T09:06:44.376123+0000","last_became_peered":"2024-04-25T09:06:44.376123+0000","last_unstale":"2024-04-25T09:06:46.118947+0000","last_undegraded":"2024-04-25T09:06:46.118947+0000","last_fullsized":"2024-04-25T09:06:46.118947+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:32.111039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"57'1","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.803123+0000","last_change":"2024-04-25T09:06:43.346999+0000","last_active":"2024-04-25T09:06:45.803123+0000","last_peered":"2024-04-25T09:06:45.803123+0000","last_clean":"2024-04-25T09:06:45.803123+0000","last_became_active":"2024-04-25T09:06:43.346693+0000","last_became_peered":"2024-04-25T09:06:43.346693+0000","last_unstale":"2024-04-25T09:06:45.803123+0000","last_undegraded":"2024-04-25T09:06:45.803123+0000","last_fullsized":"2024-04-25T09:06:45.803123+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:24:30.999021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119122+0000","last_change":"2024-04-25T09:06:44.385699+0000","last_active":"2024-04-25T09:06:46.119122+0000","last_peered":"2024-04-25T09:06:46.119122+0000","last_clean":"2024-04-25T09:06:46.119122+0000","last_became_active":"2024-04-25T09:06:44.385462+0000","last_became_peered":"2024-04-25T09:06:44.385462+0000","last_unstale":"2024-04-25T09:06:46.119122+0000","last_undegraded":"2024-04-25T09:06:46.119122+0000","last_fullsized":"2024-04-25T09:06:46.119122+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:49:50.040518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118556+0000","last_change":"2024-04-25T09:06:43.339187+0000","last_active":"2024-04-25T09:06:46.118556+0000","last_peered":"2024-04-25T09:06:46.118556+0000","last_clean":"2024-04-25T09:06:46.118556+0000","last_became_active":"2024-04-25T09:06:43.338905+0000","last_became_peered":"2024-04-25T09:06:43.338905+0000","last_unstale":"2024-04-25T09:06:46.118556+0000","last_undegraded":"2024-04-25T09:06:46.118556+0000","last_fullsized":"2024-04-25T09:06:46.118556+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:43:28.567036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370672+0000","last_change":"2024-04-25T09:06:44.366602+0000","last_active":"2024-04-25T09:06:45.370672+0000","last_peered":"2024-04-25T09:06:45.370672+0000","last_clean":"2024-04-25T09:06:45.370672+0000","last_became_active":"2024-04-25T09:06:44.366343+0000","last_became_peered":"2024-04-25T09:06:44.366343+0000","last_unstale":"2024-04-25T09:06:45.370672+0000","last_undegraded":"2024-04-25T09:06:45.370672+0000","last_fullsized":"2024-04-25T09:06:45.370672+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:18.901764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118484+0000","last_change":"2024-04-25T09:06:43.346449+0000","last_active":"2024-04-25T09:06:46.118484+0000","last_peered":"2024-04-25T09:06:46.118484+0000","last_clean":"2024-04-25T09:06:46.118484+0000","last_became_active":"2024-04-25T09:06:43.343544+0000","last_became_peered":"2024-04-25T09:06:43.343544+0000","last_unstale":"2024-04-25T09:06:46.118484+0000","last_undegraded":"2024-04-25T09:06:46.118484+0000","last_fullsized":"2024-04-25T09:06:46.118484+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:46.633802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118302+0000","last_change":"2024-04-25T09:06:44.382904+0000","last_active":"2024-04-25T09:06:46.118302+0000","last_peered":"2024-04-25T09:06:46.118302+0000","last_clean":"2024-04-25T09:06:46.118302+0000","last_became_active":"2024-04-25T09:06:44.382636+0000","last_became_peered":"2024-04-25T09:06:44.382636+0000","last_unstale":"2024-04-25T09:06:46.118302+0000","last_undegraded":"2024-04-25T09:06:46.118302+0000","last_fullsized":"2024-04-25T09:06:46.118302+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:41.117200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.802841+0000","last_change":"2024-04-25T09:06:43.343297+0000","last_active":"2024-04-25T09:06:45.802841+0000","last_peered":"2024-04-25T09:06:45.802841+0000","last_clean":"2024-04-25T09:06:45.802841+0000","last_became_active":"2024-04-25T09:06:43.342963+0000","last_became_peered":"2024-04-25T09:06:43.342963+0000","last_unstale":"2024-04-25T09:06:45.802841+0000","last_undegraded":"2024-04-25T09:06:45.802841+0000","last_fullsized":"2024-04-25T09:06:45.802841+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:43.775629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.803426+0000","last_change":"2024-04-25T09:06:44.361868+0000","last_active":"2024-04-25T09:06:45.803426+0000","last_peered":"2024-04-25T09:06:45.803426+0000","last_clean":"2024-04-25T09:06:45.803426+0000","last_became_active":"2024-04-25T09:06:44.361498+0000","last_became_peered":"2024-04-25T09:06:44.361498+0000","last_unstale":"2024-04-25T09:06:45.803426+0000","last_undegraded":"2024-04-25T09:06:45.803426+0000","last_fullsized":"2024-04-25T09:06:45.803426+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:34.046237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369851+0000","last_change":"2024-04-25T09:06:43.353192+0000","last_active":"2024-04-25T09:06:45.369851+0000","last_peered":"2024-04-25T09:06:45.369851+0000","last_clean":"2024-04-25T09:06:45.369851+0000","last_became_active":"2024-04-25T09:06:43.353001+0000","last_became_peered":"2024-04-25T09:06:43.353001+0000","last_unstale":"2024-04-25T09:06:45.369851+0000","last_undegraded":"2024-04-25T09:06:45.369851+0000","last_fullsized":"2024-04-25T09:06:45.369851+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:53.132304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370073+0000","last_change":"2024-04-25T09:06:44.371411+0000","last_active":"2024-04-25T09:06:45.370073+0000","last_peered":"2024-04-25T09:06:45.370073+0000","last_clean":"2024-04-25T09:06:45.370073+0000","last_became_active":"2024-04-25T09:06:44.370951+0000","last_became_peered":"2024-04-25T09:06:44.370951+0000","last_unstale":"2024-04-25T09:06:45.370073+0000","last_undegraded":"2024-04-25T09:06:45.370073+0000","last_fullsized":"2024-04-25T09:06:45.370073+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:00.159535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118752+0000","last_change":"2024-04-25T09:06:43.354286+0000","last_active":"2024-04-25T09:06:46.118752+0000","last_peered":"2024-04-25T09:06:46.118752+0000","last_clean":"2024-04-25T09:06:46.118752+0000","last_became_active":"2024-04-25T09:06:43.354023+0000","last_became_peered":"2024-04-25T09:06:43.354023+0000","last_unstale":"2024-04-25T09:06:46.118752+0000","last_undegraded":"2024-04-25T09:06:46.118752+0000","last_fullsized":"2024-04-25T09:06:46.118752+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:51.163293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117518+0000","last_change":"2024-04-25T09:06:44.362982+0000","last_active":"2024-04-25T09:06:46.117518+0000","last_peered":"2024-04-25T09:06:46.117518+0000","last_clean":"2024-04-25T09:06:46.117518+0000","last_became_active":"2024-04-25T09:06:44.362554+0000","last_became_peered":"2024-04-25T09:06:44.362554+0000","last_unstale":"2024-04-25T09:06:46.117518+0000","last_undegraded":"2024-04-25T09:06:46.117518+0000","last_fullsized":"2024-04-25T09:06:46.117518+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:23.000896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"57'3","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369649+0000","last_change":"2024-04-25T09:06:43.359172+0000","last_active":"2024-04-25T09:06:45.369649+0000","last_peered":"2024-04-25T09:06:45.369649+0000","last_clean":"2024-04-25T09:06:45.369649+0000","last_became_active":"2024-04-25T09:06:43.358886+0000","last_became_peered":"2024-04-25T09:06:43.358886+0000","last_unstale":"2024-04-25T09:06:45.369649+0000","last_undegraded":"2024-04-25T09:06:45.369649+0000","last_fullsized":"2024-04-25T09:06:45.369649+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:36.899491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369491+0000","last_change":"2024-04-25T09:06:44.379421+0000","last_active":"2024-04-25T09:06:45.369491+0000","last_peered":"2024-04-25T09:06:45.369491+0000","last_clean":"2024-04-25T09:06:45.369491+0000","last_became_active":"2024-04-25T09:06:44.379175+0000","last_became_peered":"2024-04-25T09:06:44.379175+0000","last_unstale":"2024-04-25T09:06:45.369491+0000","last_undegraded":"2024-04-25T09:06:45.369491+0000","last_fullsized":"2024-04-25T09:06:45.369491+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:50.346255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"57'6","reported_seq":20,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.803208+0000","last_change":"2024-04-25T09:06:43.341015+0000","last_active":"2024-04-25T09:06:45.803208+0000","last_peered":"2024-04-25T09:06:45.803208+0000","last_clean":"2024-04-25T09:06:45.803208+0000","last_became_active":"2024-04-25T09:06:43.340724+0000","last_became_peered":"2024-04-25T09:06:43.340724+0000","last_unstale":"2024-04-25T09:06:45.803208+0000","last_undegraded":"2024-04-25T09:06:45.803208+0000","last_fullsized":"2024-04-25T09:06:45.803208+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:22.743866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118742+0000","last_change":"2024-04-25T09:06:44.372154+0000","last_active":"2024-04-25T09:06:46.118742+0000","last_peered":"2024-04-25T09:06:46.118742+0000","last_clean":"2024-04-25T09:06:46.118742+0000","last_became_active":"2024-04-25T09:06:44.371885+0000","last_became_peered":"2024-04-25T09:06:44.371885+0000","last_unstale":"2024-04-25T09:06:46.118742+0000","last_undegraded":"2024-04-25T09:06:46.118742+0000","last_fullsized":"2024-04-25T09:06:46.118742+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:28.027452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"57'2","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119023+0000","last_change":"2024-04-25T09:06:43.350060+0000","last_active":"2024-04-25T09:06:46.119023+0000","last_peered":"2024-04-25T09:06:46.119023+0000","last_clean":"2024-04-25T09:06:46.119023+0000","last_became_active":"2024-04-25T09:06:43.349768+0000","last_became_peered":"2024-04-25T09:06:43.349768+0000","last_unstale":"2024-04-25T09:06:46.119023+0000","last_undegraded":"2024-04-25T09:06:46.119023+0000","last_fullsized":"2024-04-25T09:06:46.119023+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:59.152294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369645+0000","last_change":"2024-04-25T09:06:44.373300+0000","last_active":"2024-04-25T09:06:45.369645+0000","last_peered":"2024-04-25T09:06:45.369645+0000","last_clean":"2024-04-25T09:06:45.369645+0000","last_became_active":"2024-04-25T09:06:44.372969+0000","last_became_peered":"2024-04-25T09:06:44.372969+0000","last_unstale":"2024-04-25T09:06:45.369645+0000","last_undegraded":"2024-04-25T09:06:45.369645+0000","last_fullsized":"2024-04-25T09:06:45.369645+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:16.500622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370447+0000","last_change":"2024-04-25T09:06:43.349963+0000","last_active":"2024-04-25T09:06:45.370447+0000","last_peered":"2024-04-25T09:06:45.370447+0000","last_clean":"2024-04-25T09:06:45.370447+0000","last_became_active":"2024-04-25T09:06:43.349649+0000","last_became_peered":"2024-04-25T09:06:43.349649+0000","last_unstale":"2024-04-25T09:06:45.370447+0000","last_undegraded":"2024-04-25T09:06:45.370447+0000","last_fullsized":"2024-04-25T09:06:45.370447+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:36.071087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.802904+0000","last_change":"2024-04-25T09:06:44.369864+0000","last_active":"2024-04-25T09:06:45.802904+0000","last_peered":"2024-04-25T09:06:45.802904+0000","last_clean":"2024-04-25T09:06:45.802904+0000","last_became_active":"2024-04-25T09:06:44.369471+0000","last_became_peered":"2024-04-25T09:06:44.369471+0000","last_unstale":"2024-04-25T09:06:45.802904+0000","last_undegraded":"2024-04-25T09:06:45.802904+0000","last_fullsized":"2024-04-25T09:06:45.802904+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:47.075347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118615+0000","last_change":"2024-04-25T09:06:43.349641+0000","last_active":"2024-04-25T09:06:46.118615+0000","last_peered":"2024-04-25T09:06:46.118615+0000","last_clean":"2024-04-25T09:06:46.118615+0000","last_became_active":"2024-04-25T09:06:43.349261+0000","last_became_peered":"2024-04-25T09:06:43.349261+0000","last_unstale":"2024-04-25T09:06:46.118615+0000","last_undegraded":"2024-04-25T09:06:46.118615+0000","last_fullsized":"2024-04-25T09:06:46.118615+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:53.132304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369951+0000","last_change":"2024-04-25T09:06:44.378954+0000","last_active":"2024-04-25T09:06:45.369951+0000","last_peered":"2024-04-25T09:06:45.369951+0000","last_clean":"2024-04-25T09:06:45.369951+0000","last_became_active":"2024-04-25T09:06:44.378570+0000","last_became_peered":"2024-04-25T09:06:44.378570+0000","last_unstale":"2024-04-25T09:06:45.369951+0000","last_undegraded":"2024-04-25T09:06:45.369951+0000","last_fullsized":"2024-04-25T09:06:45.369951+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:52.170535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"57'8","reported_seq":22,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369386+0000","last_change":"2024-04-25T09:06:43.351852+0000","last_active":"2024-04-25T09:06:45.369386+0000","last_peered":"2024-04-25T09:06:45.369386+0000","last_clean":"2024-04-25T09:06:45.369386+0000","last_became_active":"2024-04-25T09:06:43.351538+0000","last_became_peered":"2024-04-25T09:06:43.351538+0000","last_unstale":"2024-04-25T09:06:45.369386+0000","last_undegraded":"2024-04-25T09:06:45.369386+0000","last_fullsized":"2024-04-25T09:06:45.369386+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:46.633802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369871+0000","last_change":"2024-04-25T09:06:44.376683+0000","last_active":"2024-04-25T09:06:45.369871+0000","last_peered":"2024-04-25T09:06:45.369871+0000","last_clean":"2024-04-25T09:06:45.369871+0000","last_became_active":"2024-04-25T09:06:44.376291+0000","last_became_peered":"2024-04-25T09:06:44.376291+0000","last_unstale":"2024-04-25T09:06:45.369871+0000","last_undegraded":"2024-04-25T09:06:45.369871+0000","last_fullsized":"2024-04-25T09:06:45.369871+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:13.116989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"57'1","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118392+0000","last_change":"2024-04-25T09:06:43.355096+0000","last_active":"2024-04-25T09:06:46.118392+0000","last_peered":"2024-04-25T09:06:46.118392+0000","last_clean":"2024-04-25T09:06:46.118392+0000","last_became_active":"2024-04-25T09:06:43.354807+0000","last_became_peered":"2024-04-25T09:06:43.354807+0000","last_unstale":"2024-04-25T09:06:46.118392+0000","last_undegraded":"2024-04-25T09:06:46.118392+0000","last_fullsized":"2024-04-25T09:06:46.118392+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:15.863844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119104+0000","last_change":"2024-04-25T09:06:44.367798+0000","last_active":"2024-04-25T09:06:46.119104+0000","last_peered":"2024-04-25T09:06:46.119104+0000","last_clean":"2024-04-25T09:06:46.119104+0000","last_became_active":"2024-04-25T09:06:44.367460+0000","last_became_peered":"2024-04-25T09:06:44.367460+0000","last_unstale":"2024-04-25T09:06:46.119104+0000","last_undegraded":"2024-04-25T09:06:46.119104+0000","last_fullsized":"2024-04-25T09:06:46.119104+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:16.500622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119457+0000","last_change":"2024-04-25T09:06:43.346869+0000","last_active":"2024-04-25T09:06:46.119457+0000","last_peered":"2024-04-25T09:06:46.119457+0000","last_clean":"2024-04-25T09:06:46.119457+0000","last_became_active":"2024-04-25T09:06:43.346525+0000","last_became_peered":"2024-04-25T09:06:43.346525+0000","last_unstale":"2024-04-25T09:06:46.119457+0000","last_undegraded":"2024-04-25T09:06:46.119457+0000","last_fullsized":"2024-04-25T09:06:46.119457+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:46.068106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118244+0000","last_change":"2024-04-25T09:06:44.382678+0000","last_active":"2024-04-25T09:06:46.118244+0000","last_peered":"2024-04-25T09:06:46.118244+0000","last_clean":"2024-04-25T09:06:46.118244+0000","last_became_active":"2024-04-25T09:06:44.382387+0000","last_became_peered":"2024-04-25T09:06:44.382387+0000","last_unstale":"2024-04-25T09:06:46.118244+0000","last_undegraded":"2024-04-25T09:06:46.118244+0000","last_fullsized":"2024-04-25T09:06:46.118244+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:13.840830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"57'1","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118950+0000","last_change":"2024-04-25T09:06:43.351831+0000","last_active":"2024-04-25T09:06:46.118950+0000","last_peered":"2024-04-25T09:06:46.118950+0000","last_clean":"2024-04-25T09:06:46.118950+0000","last_became_active":"2024-04-25T09:06:43.351536+0000","last_became_peered":"2024-04-25T09:06:43.351536+0000","last_unstale":"2024-04-25T09:06:46.118950+0000","last_undegraded":"2024-04-25T09:06:46.118950+0000","last_fullsized":"2024-04-25T09:06:46.118950+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:33.038996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369877+0000","last_change":"2024-04-25T09:06:44.379324+0000","last_active":"2024-04-25T09:06:45.369877+0000","last_peered":"2024-04-25T09:06:45.369877+0000","last_clean":"2024-04-25T09:06:45.369877+0000","last_became_active":"2024-04-25T09:06:44.378973+0000","last_became_peered":"2024-04-25T09:06:44.378973+0000","last_unstale":"2024-04-25T09:06:45.369877+0000","last_undegraded":"2024-04-25T09:06:45.369877+0000","last_fullsized":"2024-04-25T09:06:45.369877+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:02.753649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118845+0000","last_change":"2024-04-25T09:06:43.341776+0000","last_active":"2024-04-25T09:06:46.118845+0000","last_peered":"2024-04-25T09:06:46.118845+0000","last_clean":"2024-04-25T09:06:46.118845+0000","last_became_active":"2024-04-25T09:06:43.341531+0000","last_became_peered":"2024-04-25T09:06:43.341531+0000","last_unstale":"2024-04-25T09:06:46.118845+0000","last_undegraded":"2024-04-25T09:06:46.118845+0000","last_fullsized":"2024-04-25T09:06:46.118845+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:30:50.542949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118733+0000","last_change":"2024-04-25T09:06:44.371643+0000","last_active":"2024-04-25T09:06:46.118733+0000","last_peered":"2024-04-25T09:06:46.118733+0000","last_clean":"2024-04-25T09:06:46.118733+0000","last_became_active":"2024-04-25T09:06:44.371379+0000","last_became_peered":"2024-04-25T09:06:44.371379+0000","last_unstale":"2024-04-25T09:06:46.118733+0000","last_undegraded":"2024-04-25T09:06:46.118733+0000","last_fullsized":"2024-04-25T09:06:46.118733+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:57.567952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"57'2","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119156+0000","last_change":"2024-04-25T09:06:43.349390+0000","last_active":"2024-04-25T09:06:46.119156+0000","last_peered":"2024-04-25T09:06:46.119156+0000","last_clean":"2024-04-25T09:06:46.119156+0000","last_became_active":"2024-04-25T09:06:43.348273+0000","last_became_peered":"2024-04-25T09:06:43.348273+0000","last_unstale":"2024-04-25T09:06:46.119156+0000","last_undegraded":"2024-04-25T09:06:46.119156+0000","last_fullsized":"2024-04-25T09:06:46.119156+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:15.974360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118674+0000","last_change":"2024-04-25T09:06:44.374084+0000","last_active":"2024-04-25T09:06:46.118674+0000","last_peered":"2024-04-25T09:06:46.118674+0000","last_clean":"2024-04-25T09:06:46.118674+0000","last_became_active":"2024-04-25T09:06:44.373472+0000","last_became_peered":"2024-04-25T09:06:44.373472+0000","last_unstale":"2024-04-25T09:06:46.118674+0000","last_undegraded":"2024-04-25T09:06:46.118674+0000","last_fullsized":"2024-04-25T09:06:46.118674+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:58.113821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117524+0000","last_change":"2024-04-25T09:06:43.358082+0000","last_active":"2024-04-25T09:06:46.117524+0000","last_peered":"2024-04-25T09:06:46.117524+0000","last_clean":"2024-04-25T09:06:46.117524+0000","last_became_active":"2024-04-25T09:06:43.357770+0000","last_became_peered":"2024-04-25T09:06:43.357770+0000","last_unstale":"2024-04-25T09:06:46.117524+0000","last_undegraded":"2024-04-25T09:06:46.117524+0000","last_fullsized":"2024-04-25T09:06:46.117524+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:07:02.964807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118019+0000","last_change":"2024-04-25T09:06:44.371595+0000","last_active":"2024-04-25T09:06:46.118019+0000","last_peered":"2024-04-25T09:06:46.118019+0000","last_clean":"2024-04-25T09:06:46.118019+0000","last_became_active":"2024-04-25T09:06:44.371350+0000","last_became_peered":"2024-04-25T09:06:44.371350+0000","last_unstale":"2024-04-25T09:06:46.118019+0000","last_undegraded":"2024-04-25T09:06:46.118019+0000","last_fullsized":"2024-04-25T09:06:46.118019+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:56.106313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118494+0000","last_change":"2024-04-25T09:06:43.344024+0000","last_active":"2024-04-25T09:06:46.118494+0000","last_peered":"2024-04-25T09:06:46.118494+0000","last_clean":"2024-04-25T09:06:46.118494+0000","last_became_active":"2024-04-25T09:06:43.343210+0000","last_became_peered":"2024-04-25T09:06:43.343210+0000","last_unstale":"2024-04-25T09:06:46.118494+0000","last_undegraded":"2024-04-25T09:06:46.118494+0000","last_fullsized":"2024-04-25T09:06:46.118494+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:36.899491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119046+0000","last_change":"2024-04-25T09:06:44.368233+0000","last_active":"2024-04-25T09:06:46.119046+0000","last_peered":"2024-04-25T09:06:46.119046+0000","last_clean":"2024-04-25T09:06:46.119046+0000","last_became_active":"2024-04-25T09:06:44.367948+0000","last_became_peered":"2024-04-25T09:06:44.367948+0000","last_unstale":"2024-04-25T09:06:46.119046+0000","last_undegraded":"2024-04-25T09:06:46.119046+0000","last_fullsized":"2024-04-25T09:06:46.119046+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:04.888010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"57'2","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118015+0000","last_change":"2024-04-25T09:06:43.354248+0000","last_active":"2024-04-25T09:06:46.118015+0000","last_peered":"2024-04-25T09:06:46.118015+0000","last_clean":"2024-04-25T09:06:46.118015+0000","last_became_active":"2024-04-25T09:06:43.353952+0000","last_became_peered":"2024-04-25T09:06:43.353952+0000","last_unstale":"2024-04-25T09:06:46.118015+0000","last_undegraded":"2024-04-25T09:06:46.118015+0000","last_fullsized":"2024-04-25T09:06:46.118015+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:17.401620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119155+0000","last_change":"2024-04-25T09:06:44.368822+0000","last_active":"2024-04-25T09:06:46.119155+0000","last_peered":"2024-04-25T09:06:46.119155+0000","last_clean":"2024-04-25T09:06:46.119155+0000","last_became_active":"2024-04-25T09:06:44.368536+0000","last_became_peered":"2024-04-25T09:06:44.368536+0000","last_unstale":"2024-04-25T09:06:46.119155+0000","last_undegraded":"2024-04-25T09:06:46.119155+0000","last_fullsized":"2024-04-25T09:06:46.119155+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:30.025920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119544+0000","last_change":"2024-04-25T09:06:43.338943+0000","last_active":"2024-04-25T09:06:46.119544+0000","last_peered":"2024-04-25T09:06:46.119544+0000","last_clean":"2024-04-25T09:06:46.119544+0000","last_became_active":"2024-04-25T09:06:43.338653+0000","last_became_peered":"2024-04-25T09:06:43.338653+0000","last_unstale":"2024-04-25T09:06:46.119544+0000","last_undegraded":"2024-04-25T09:06:46.119544+0000","last_fullsized":"2024-04-25T09:06:46.119544+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:39.719877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117680+0000","last_change":"2024-04-25T09:06:44.362793+0000","last_active":"2024-04-25T09:06:46.117680+0000","last_peered":"2024-04-25T09:06:46.117680+0000","last_clean":"2024-04-25T09:06:46.117680+0000","last_became_active":"2024-04-25T09:06:44.362090+0000","last_became_peered":"2024-04-25T09:06:44.362090+0000","last_unstale":"2024-04-25T09:06:46.117680+0000","last_undegraded":"2024-04-25T09:06:46.117680+0000","last_fullsized":"2024-04-25T09:06:46.117680+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:30:51.550190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370765+0000","last_change":"2024-04-25T09:06:43.335474+0000","last_active":"2024-04-25T09:06:45.370765+0000","last_peered":"2024-04-25T09:06:45.370765+0000","last_clean":"2024-04-25T09:06:45.370765+0000","last_became_active":"2024-04-25T09:06:43.335163+0000","last_became_peered":"2024-04-25T09:06:43.335163+0000","last_unstale":"2024-04-25T09:06:45.370765+0000","last_undegraded":"2024-04-25T09:06:45.370765+0000","last_fullsized":"2024-04-25T09:06:45.370765+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:00.526715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.119399+0000","last_change":"2024-04-25T09:06:44.373655+0000","last_active":"2024-04-25T09:06:46.119399+0000","last_peered":"2024-04-25T09:06:46.119399+0000","last_clean":"2024-04-25T09:06:46.119399+0000","last_became_active":"2024-04-25T09:06:44.370781+0000","last_became_peered":"2024-04-25T09:06:44.370781+0000","last_unstale":"2024-04-25T09:06:46.119399+0000","last_undegraded":"2024-04-25T09:06:46.119399+0000","last_fullsized":"2024-04-25T09:06:46.119399+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:37.997829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118953+0000","last_change":"2024-04-25T09:06:43.348066+0000","last_active":"2024-04-25T09:06:46.118953+0000","last_peered":"2024-04-25T09:06:46.118953+0000","last_clean":"2024-04-25T09:06:46.118953+0000","last_became_active":"2024-04-25T09:06:43.347705+0000","last_became_peered":"2024-04-25T09:06:43.347705+0000","last_unstale":"2024-04-25T09:06:46.118953+0000","last_undegraded":"2024-04-25T09:06:46.118953+0000","last_fullsized":"2024-04-25T09:06:46.118953+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:01:02.285914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118941+0000","last_change":"2024-04-25T09:06:44.377982+0000","last_active":"2024-04-25T09:06:46.118941+0000","last_peered":"2024-04-25T09:06:46.118941+0000","last_clean":"2024-04-25T09:06:46.118941+0000","last_became_active":"2024-04-25T09:06:44.377247+0000","last_became_peered":"2024-04-25T09:06:44.377247+0000","last_unstale":"2024-04-25T09:06:46.118941+0000","last_undegraded":"2024-04-25T09:06:46.118941+0000","last_fullsized":"2024-04-25T09:06:46.118941+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:51.446033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117409+0000","last_change":"2024-04-25T09:06:43.351949+0000","last_active":"2024-04-25T09:06:46.117409+0000","last_peered":"2024-04-25T09:06:46.117409+0000","last_clean":"2024-04-25T09:06:46.117409+0000","last_became_active":"2024-04-25T09:06:43.351642+0000","last_became_peered":"2024-04-25T09:06:43.351642+0000","last_unstale":"2024-04-25T09:06:46.117409+0000","last_undegraded":"2024-04-25T09:06:46.117409+0000","last_fullsized":"2024-04-25T09:06:46.117409+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:46.768769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369991+0000","last_change":"2024-04-25T09:06:44.381696+0000","last_active":"2024-04-25T09:06:45.369991+0000","last_peered":"2024-04-25T09:06:45.369991+0000","last_clean":"2024-04-25T09:06:45.369991+0000","last_became_active":"2024-04-25T09:06:44.381432+0000","last_became_peered":"2024-04-25T09:06:44.381432+0000","last_unstale":"2024-04-25T09:06:45.369991+0000","last_undegraded":"2024-04-25T09:06:45.369991+0000","last_fullsized":"2024-04-25T09:06:45.369991+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:16.871085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.803189+0000","last_change":"2024-04-25T09:06:43.335030+0000","last_active":"2024-04-25T09:06:45.803189+0000","last_peered":"2024-04-25T09:06:45.803189+0000","last_clean":"2024-04-25T09:06:45.803189+0000","last_became_active":"2024-04-25T09:06:43.334703+0000","last_became_peered":"2024-04-25T09:06:43.334703+0000","last_unstale":"2024-04-25T09:06:45.803189+0000","last_undegraded":"2024-04-25T09:06:45.803189+0000","last_fullsized":"2024-04-25T09:06:45.803189+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:32.496186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117332+0000","last_change":"2024-04-25T09:06:44.361864+0000","last_active":"2024-04-25T09:06:46.117332+0000","last_peered":"2024-04-25T09:06:46.117332+0000","last_clean":"2024-04-25T09:06:46.117332+0000","last_became_active":"2024-04-25T09:06:44.361519+0000","last_became_peered":"2024-04-25T09:06:44.361519+0000","last_unstale":"2024-04-25T09:06:46.117332+0000","last_undegraded":"2024-04-25T09:06:46.117332+0000","last_fullsized":"2024-04-25T09:06:46.117332+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:21.824025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117252+0000","last_change":"2024-04-25T09:06:43.344057+0000","last_active":"2024-04-25T09:06:46.117252+0000","last_peered":"2024-04-25T09:06:46.117252+0000","last_clean":"2024-04-25T09:06:46.117252+0000","last_became_active":"2024-04-25T09:06:43.343823+0000","last_became_peered":"2024-04-25T09:06:43.343823+0000","last_unstale":"2024-04-25T09:06:46.117252+0000","last_undegraded":"2024-04-25T09:06:46.117252+0000","last_fullsized":"2024-04-25T09:06:46.117252+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:17.894523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.118445+0000","last_change":"2024-04-25T09:06:44.376838+0000","last_active":"2024-04-25T09:06:46.118445+0000","last_peered":"2024-04-25T09:06:46.118445+0000","last_clean":"2024-04-25T09:06:46.118445+0000","last_became_active":"2024-04-25T09:06:44.376071+0000","last_became_peered":"2024-04-25T09:06:44.376071+0000","last_unstale":"2024-04-25T09:06:46.118445+0000","last_undegraded":"2024-04-25T09:06:46.118445+0000","last_fullsized":"2024-04-25T09:06:46.118445+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:06.739812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117943+0000","last_change":"2024-04-25T09:06:43.343216+0000","last_active":"2024-04-25T09:06:46.117943+0000","last_peered":"2024-04-25T09:06:46.117943+0000","last_clean":"2024-04-25T09:06:46.117943+0000","last_became_active":"2024-04-25T09:06:43.342919+0000","last_became_peered":"2024-04-25T09:06:43.342919+0000","last_unstale":"2024-04-25T09:06:46.117943+0000","last_undegraded":"2024-04-25T09:06:46.117943+0000","last_fullsized":"2024-04-25T09:06:46.117943+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:29.018679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:46.117497+0000","last_change":"2024-04-25T09:06:44.385406+0000","last_active":"2024-04-25T09:06:46.117497+0000","last_peered":"2024-04-25T09:06:46.117497+0000","last_clean":"2024-04-25T09:06:46.117497+0000","last_became_active":"2024-04-25T09:06:44.385120+0000","last_became_peered":"2024-04-25T09:06:44.385120+0000","last_unstale":"2024-04-25T09:06:46.117497+0000","last_undegraded":"2024-04-25T09:06:46.117497+0000","last_fullsized":"2024-04-25T09:06:46.117497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:43.321231+0000","last_clean_scrub_stamp":"2024-04-25T09:06:43.321231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:18.351825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.370491+0000","last_change":"2024-04-25T09:06:43.342236+0000","last_active":"2024-04-25T09:06:45.370491+0000","last_peered":"2024-04-25T09:06:45.370491+0000","last_clean":"2024-04-25T09:06:45.370491+0000","last_became_active":"2024-04-25T09:06:43.341950+0000","last_became_peered":"2024-04-25T09:06:43.341950+0000","last_unstale":"2024-04-25T09:06:45.370491+0000","last_undegraded":"2024-04-25T09:06:45.370491+0000","last_fullsized":"2024-04-25T09:06:45.370491+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:42.313990+0000","last_clean_scrub_stamp":"2024-04-25T09:06:42.313990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:57.966121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":240,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-04-25T09:06:45.369637+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:06:45.369637+0000","last_peered":"2024-04-25T09:06:45.369637+0000","last_clean":"2024-04-25T09:06:45.369637+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:06:45.369637+0000","last_undegraded":"2024-04-25T09:06:45.369637+0000","last_fullsized":"2024-04-25T09:06:45.369637+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1298432,"data_stored":880283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":696320,"data_stored":289755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":704512,"data_stored":290407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":708608,"data_stored":291367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574886,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":704512,"data_stored":289811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":704512,"data_stored":289811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":700416,"data_stored":289845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1306624,"data_stored":882317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:06:53.312 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:06:53.312 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:06:53.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.508+0000 7fe90da00640 1 Processor -- start 2024-04-25T09:06:53.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.508+0000 7fe90da00640 1 -- start start 2024-04-25T09:06:53.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.508+0000 7fe90da00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe908071510 0x7fe9080cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.508+0000 7fe90da00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe908163490 0x7fe908165880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.508+0000 7fe90da00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9080cf7e0 con 0x7fe90806dd90 2024-04-25T09:06:53.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.508+0000 7fe90da00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9080ccc40 con 0x7fe908071510 2024-04-25T09:06:53.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.508+0000 7fe90da00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9080cc310 con 0x7fe908163490 2024-04-25T09:06:53.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.508+0000 7fe906a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe908071510 0x7fe9080cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.508+0000 7fe906a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe908071510 0x7fe9080cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34802/0 (socket says 172.21.15.175:34802) 2024-04-25T09:06:53.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.508+0000 7fe906a00640 1 -- 172.21.15.175:0/4161662600 learned_addr learned my addr 172.21.15.175:0/4161662600 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:53.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.508+0000 7fe906000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe90806dd90 0x7fe9080718f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:41958/0 (socket says 172.21.15.175:41958) 2024-04-25T09:06:53.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.508+0000 7fe907400640 1 --2- 172.21.15.175:0/4161662600 >> v2:172.21.15.177:3300/0 conn(0x7fe908163490 0x7fe908165880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.508+0000 7fe906a00640 1 -- 172.21.15.175:0/4161662600 >> v2:172.21.15.177:3300/0 conn(0x7fe908163490 msgr2=0x7fe908165880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:53.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.508+0000 7fe906a00640 1 --2- 172.21.15.175:0/4161662600 >> v2:172.21.15.177:3300/0 conn(0x7fe908163490 0x7fe908165880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.508+0000 7fe906a00640 1 -- 172.21.15.175:0/4161662600 >> v1:172.21.15.175:6789/0 conn(0x7fe90806dd90 legacy=0x7fe9080718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.508+0000 7fe906a00640 1 -- 172.21.15.175:0/4161662600 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9080cc5f0 con 0x7fe908071510 2024-04-25T09:06:53.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.508+0000 7fe907400640 1 --2- 172.21.15.175:0/4161662600 >> v2:172.21.15.177:3300/0 conn(0x7fe908163490 0x7fe908165880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:53.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.508+0000 7fe905600640 1 -- 172.21.15.175:0/4161662600 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109457481 0 0) 0x7fe9080cf7e0 con 0x7fe90806dd90 2024-04-25T09:06:53.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.512+0000 7fe906a00640 1 --2- 172.21.15.175:0/4161662600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe908071510 0x7fe9080cbae0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe90806f130 tx=0x7fe8f801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7bfe8a5918c305 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:53.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.512+0000 7fe905600640 1 -- 172.21.15.175:0/4161662600 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80a58a0 con 0x7fe908071510 2024-04-25T09:06:53.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.512+0000 7fe905600640 1 -- 172.21.15.175:0/4161662600 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f80a5a40 con 0x7fe908071510 2024-04-25T09:06:53.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.512+0000 7fe905600640 1 -- 172.21.15.175:0/4161662600 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80a5e10 con 0x7fe908071510 2024-04-25T09:06:53.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.512+0000 7fe90da00640 1 -- 172.21.15.175:0/4161662600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe908071510 msgr2=0x7fe9080cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.512+0000 7fe90da00640 1 --2- 172.21.15.175:0/4161662600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe908071510 0x7fe9080cbae0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe90806f130 tx=0x7fe8f801c9f0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.512+0000 7fe90da00640 1 -- 172.21.15.175:0/4161662600 shutdown_connections 2024-04-25T09:06:53.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.512+0000 7fe90da00640 1 --2- 172.21.15.175:0/4161662600 >> v2:172.21.15.177:3300/0 conn(0x7fe908163490 0x7fe908165880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.512+0000 7fe90da00640 1 --2- 172.21.15.175:0/4161662600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe908071510 0x7fe9080cbae0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.512+0000 7fe90da00640 1 -- 172.21.15.175:0/4161662600 >> 172.21.15.175:0/4161662600 conn(0x7fe90806ac50 msgr2=0x7fe90806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:53.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.512+0000 7fe90da00640 1 -- 172.21.15.175:0/4161662600 shutdown_connections 2024-04-25T09:06:53.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.512+0000 7fe90da00640 1 -- 172.21.15.175:0/4161662600 wait complete. 2024-04-25T09:06:53.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe90da00640 1 Processor -- start 2024-04-25T09:06:53.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe90da00640 1 -- start start 2024-04-25T09:06:53.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe90da00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe90806dd90 0x7fe908156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe90da00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe908071510 0x7fe9080b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe90da00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe908163490 0x7fe908139e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe90da00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90806e350 con 0x7fe90806dd90 2024-04-25T09:06:53.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe90da00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90806e1d0 con 0x7fe908163490 2024-04-25T09:06:53.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe90da00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080cd0d0 con 0x7fe908071510 2024-04-25T09:06:53.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe906a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe90806dd90 0x7fe908156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe906a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe90806dd90 0x7fe908156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34804/0 (socket says 172.21.15.175:34804) 2024-04-25T09:06:53.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe906a00640 1 -- 172.21.15.175:0/871749201 learned_addr learned my addr 172.21.15.175:0/871749201 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:53.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe906a00640 1 -- 172.21.15.175:0/871749201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe908071510 msgr2=0x7fe9080b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe906a00640 1 --2- 172.21.15.175:0/871749201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe908071510 0x7fe9080b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe906a00640 1 -- 172.21.15.175:0/871749201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe908163490 msgr2=0x7fe908139e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe906a00640 1 --2- 172.21.15.175:0/871749201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe908163490 0x7fe908139e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe906a00640 1 -- 172.21.15.175:0/871749201 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9081641b0 con 0x7fe90806dd90 2024-04-25T09:06:53.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe906a00640 1 --2- 172.21.15.175:0/871749201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe90806dd90 0x7fe908156570 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe8f801a620 tx=0x7fe8f8019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:53.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe8fea00640 1 -- 172.21.15.175:0/871749201 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80a58a0 con 0x7fe90806dd90 2024-04-25T09:06:53.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe8fea00640 1 -- 172.21.15.175:0/871749201 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f80be070 con 0x7fe90806dd90 2024-04-25T09:06:53.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe8fea00640 1 -- 172.21.15.175:0/871749201 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f8009510 con 0x7fe90806dd90 2024-04-25T09:06:53.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe90da00640 1 -- 172.21.15.175:0/871749201 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9080b31e0 con 0x7fe90806dd90 2024-04-25T09:06:53.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.516+0000 7fe90da00640 1 -- 172.21.15.175:0/871749201 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9080b34c0 con 0x7fe90806dd90 2024-04-25T09:06:53.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.520+0000 7fe90da00640 1 -- 172.21.15.175:0/871749201 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe908074a60 con 0x7fe90806dd90 2024-04-25T09:06:53.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.520+0000 7fe8fea00640 1 -- 172.21.15.175:0/871749201 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe8f80b86b0 con 0x7fe90806dd90 2024-04-25T09:06:53.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.520+0000 7fe8fea00640 1 --2- 172.21.15.175:0/871749201 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe8e8066f90 0x7fe8e8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.520+0000 7fe8fea00640 1 -- 172.21.15.175:0/871749201 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8f8120160 con 0x7fe90806dd90 2024-04-25T09:06:53.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.520+0000 7fe906000640 1 --2- 172.21.15.175:0/871749201 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe8e8066f90 0x7fe8e8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.520+0000 7fe906000640 1 --2- 172.21.15.175:0/871749201 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe8e8066f90 0x7fe8e8069450 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40011f0 tx=0x7fe8f4007930 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:53.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.524+0000 7fe8fea00640 1 -- 172.21.15.175:0/871749201 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe8f80c7020 con 0x7fe90806dd90 2024-04-25T09:06:53.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.732+0000 7fe90da00640 1 -- 172.21.15.175:0/871749201 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe9080b0270 con 0x7fe90806dd90 2024-04-25T09:06:53.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.732+0000 7fe8fea00640 1 -- 172.21.15.175:0/871749201 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fe8f80165e0 con 0x7fe90806dd90 2024-04-25T09:06:53.724 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2024-04-25T09:06:53.724 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBPHCpmhyCUBhAA8k9xLKIw8R04i6HSJykDfw== 2024-04-25T09:06:53.724 INFO:teuthology.orchestra.run.smithi175.stdout: caps mds = "allow" 2024-04-25T09:06:53.724 INFO:teuthology.orchestra.run.smithi175.stdout: caps mon = "allow r" 2024-04-25T09:06:53.724 INFO:teuthology.orchestra.run.smithi175.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:06:53.725 INFO:teuthology.orchestra.run.smithi175.stderr:updated caps for client.0 2024-04-25T09:06:53.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.736+0000 7fe90da00640 1 -- 172.21.15.175:0/871749201 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe8e8066f90 msgr2=0x7fe8e8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.736+0000 7fe90da00640 1 --2- 172.21.15.175:0/871749201 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe8e8066f90 0x7fe8e8069450 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe8f40011f0 tx=0x7fe8f4007930 comp rx=0 tx=0).stop 2024-04-25T09:06:53.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.736+0000 7fe90da00640 1 -- 172.21.15.175:0/871749201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe90806dd90 msgr2=0x7fe908156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.736+0000 7fe90da00640 1 --2- 172.21.15.175:0/871749201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe90806dd90 0x7fe908156570 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe8f801a620 tx=0x7fe8f8019790 comp rx=0 tx=0).stop 2024-04-25T09:06:53.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.736+0000 7fe90da00640 1 -- 172.21.15.175:0/871749201 shutdown_connections 2024-04-25T09:06:53.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.736+0000 7fe90da00640 1 --2- 172.21.15.175:0/871749201 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe8e8066f90 0x7fe8e8069450 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.736+0000 7fe90da00640 1 --2- 172.21.15.175:0/871749201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe908163490 0x7fe908139e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.736+0000 7fe90da00640 1 --2- 172.21.15.175:0/871749201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe908071510 0x7fe9080b2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.736+0000 7fe90da00640 1 --2- 172.21.15.175:0/871749201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe90806dd90 0x7fe908156570 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.736+0000 7fe90da00640 1 -- 172.21.15.175:0/871749201 >> 172.21.15.175:0/871749201 conn(0x7fe90806ac50 msgr2=0x7fe9080b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:53.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.736+0000 7fe90da00640 1 -- 172.21.15.175:0/871749201 shutdown_connections 2024-04-25T09:06:53.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.736+0000 7fe90da00640 1 -- 172.21.15.175:0/871749201 wait complete. 2024-04-25T09:06:53.746 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:53.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3af6800640 1 Processor -- start 2024-04-25T09:06:53.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3af6800640 1 -- start start 2024-04-25T09:06:53.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3af6800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3af0144fc0 0x7f3af00cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3af6800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3af01453a0 0x7f3af015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3af6800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3af00cc3b0 0x7f3af015c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3af6800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af015cd00 con 0x7f3af00cc3b0 2024-04-25T09:06:53.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3af6800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af00ce660 con 0x7f3af01453a0 2024-04-25T09:06:53.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3af6800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00cc930 con 0x7f3af0144fc0 2024-04-25T09:06:53.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3aefe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3af00cc3b0 0x7f3af015c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3aefe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3af00cc3b0 0x7f3af015c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34818/0 (socket says 172.21.15.175:34818) 2024-04-25T09:06:53.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3aefe00640 1 -- 172.21.15.175:0/1639141306 learned_addr learned my addr 172.21.15.175:0/1639141306 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:53.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3aef400640 1 --2- 172.21.15.175:0/1639141306 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3af0144fc0 0x7f3af00cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3aeea00640 1 --2- 172.21.15.175:0/1639141306 >> v2:172.21.15.177:3300/0 conn(0x7f3af01453a0 0x7f3af015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3aefe00640 1 -- 172.21.15.175:0/1639141306 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3af0144fc0 msgr2=0x7f3af00cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:53.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3aefe00640 1 --2- 172.21.15.175:0/1639141306 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3af0144fc0 0x7f3af00cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3aefe00640 1 -- 172.21.15.175:0/1639141306 >> v2:172.21.15.177:3300/0 conn(0x7f3af01453a0 msgr2=0x7f3af015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:53.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3aefe00640 1 --2- 172.21.15.175:0/1639141306 >> v2:172.21.15.177:3300/0 conn(0x7f3af01453a0 0x7f3af015bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3aefe00640 1 -- 172.21.15.175:0/1639141306 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af00ccc10 con 0x7f3af00cc3b0 2024-04-25T09:06:53.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.892+0000 7f3aef400640 1 --2- 172.21.15.175:0/1639141306 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3af0144fc0 0x7f3af00cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:53.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.896+0000 7f3aefe00640 1 --2- 172.21.15.175:0/1639141306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3af00cc3b0 0x7f3af015c410 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3af00b4b10 tx=0x7f3ae801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d59477e2b64c5d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:53.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.896+0000 7f3aee000640 1 -- 172.21.15.175:0/1639141306 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae80ab5f0 con 0x7f3af00cc3b0 2024-04-25T09:06:53.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.896+0000 7f3aee000640 1 -- 172.21.15.175:0/1639141306 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae80b0070 con 0x7f3af00cc3b0 2024-04-25T09:06:53.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.896+0000 7f3aee000640 1 -- 172.21.15.175:0/1639141306 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae80ab9b0 con 0x7f3af00cc3b0 2024-04-25T09:06:53.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.896+0000 7f3af6800640 1 -- 172.21.15.175:0/1639141306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3af00cc3b0 msgr2=0x7f3af015c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.896+0000 7f3af6800640 1 --2- 172.21.15.175:0/1639141306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3af00cc3b0 0x7f3af015c410 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3af00b4b10 tx=0x7f3ae801c520 comp rx=0 tx=0).stop 2024-04-25T09:06:53.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.896+0000 7f3af6800640 1 -- 172.21.15.175:0/1639141306 shutdown_connections 2024-04-25T09:06:53.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.896+0000 7f3af6800640 1 --2- 172.21.15.175:0/1639141306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3af00cc3b0 0x7f3af015c410 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.896+0000 7f3af6800640 1 --2- 172.21.15.175:0/1639141306 >> v2:172.21.15.177:3300/0 conn(0x7f3af01453a0 0x7f3af015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.896+0000 7f3af6800640 1 --2- 172.21.15.175:0/1639141306 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3af0144fc0 0x7f3af00cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.896+0000 7f3af6800640 1 -- 172.21.15.175:0/1639141306 >> 172.21.15.175:0/1639141306 conn(0x7f3af0067150 msgr2=0x7f3af006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:53.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.896+0000 7f3af6800640 1 -- 172.21.15.175:0/1639141306 shutdown_connections 2024-04-25T09:06:53.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.896+0000 7f3af6800640 1 -- 172.21.15.175:0/1639141306 wait complete. 2024-04-25T09:06:53.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3af6800640 1 Processor -- start 2024-04-25T09:06:53.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3af6800640 1 -- start start 2024-04-25T09:06:53.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3af6800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3af0144fc0 0x7f3af015b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3af6800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3af01453a0 0x7f3af013f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3af6800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3af014df90 0x7f3af0143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3af6800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af0160020 con 0x7f3af014df90 2024-04-25T09:06:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3af6800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af015fea0 con 0x7f3af01453a0 2024-04-25T09:06:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3af6800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af01601a0 con 0x7f3af0144fc0 2024-04-25T09:06:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3aefe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3af014df90 0x7f3af0143610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3aefe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3af014df90 0x7f3af0143610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34834/0 (socket says 172.21.15.175:34834) 2024-04-25T09:06:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3aefe00640 1 -- 172.21.15.175:0/4053831148 learned_addr learned my addr 172.21.15.175:0/4053831148 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3aef400640 1 --2- 172.21.15.175:0/4053831148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3af0144fc0 0x7f3af015b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3aeea00640 1 --2- 172.21.15.175:0/4053831148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3af01453a0 0x7f3af013f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3aefe00640 1 -- 172.21.15.175:0/4053831148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3af0144fc0 msgr2=0x7f3af015b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3aefe00640 1 --2- 172.21.15.175:0/4053831148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3af0144fc0 0x7f3af015b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3aefe00640 1 -- 172.21.15.175:0/4053831148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3af01453a0 msgr2=0x7f3af013f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:53.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3aefe00640 1 --2- 172.21.15.175:0/4053831148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3af01453a0 0x7f3af013f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:53.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3aefe00640 1 -- 172.21.15.175:0/4053831148 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af013fcf0 con 0x7f3af014df90 2024-04-25T09:06:53.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3aefe00640 1 --2- 172.21.15.175:0/4053831148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3af014df90 0x7f3af0143610 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80ad040 tx=0x7f3ae801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:53.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3ae7400640 1 -- 172.21.15.175:0/4053831148 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae80be3f0 con 0x7f3af014df90 2024-04-25T09:06:53.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3ae7400640 1 -- 172.21.15.175:0/4053831148 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae80be590 con 0x7f3af014df90 2024-04-25T09:06:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3af6800640 1 -- 172.21.15.175:0/4053831148 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af013ffd0 con 0x7f3af014df90 2024-04-25T09:06:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3ae7400640 1 -- 172.21.15.175:0/4053831148 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae80be980 con 0x7f3af014df90 2024-04-25T09:06:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.900+0000 7f3af6800640 1 -- 172.21.15.175:0/4053831148 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af0140590 con 0x7f3af014df90 2024-04-25T09:06:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.904+0000 7f3af6800640 1 -- 172.21.15.175:0/4053831148 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af0074a60 con 0x7f3af014df90 2024-04-25T09:06:53.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.904+0000 7f3ae7400640 1 -- 172.21.15.175:0/4053831148 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3ae80b43f0 con 0x7f3af014df90 2024-04-25T09:06:53.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.904+0000 7f3ae7400640 1 --2- 172.21.15.175:0/4053831148 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ad0066f60 0x7f3ad0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:53.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.904+0000 7f3ae7400640 1 -- 172.21.15.175:0/4053831148 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ae811f2d0 con 0x7f3af014df90 2024-04-25T09:06:53.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.904+0000 7f3aef400640 1 --2- 172.21.15.175:0/4053831148 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ad0066f60 0x7f3ad0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:53.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.904+0000 7f3aef400640 1 --2- 172.21.15.175:0/4053831148 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ad0066f60 0x7f3ad0069420 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0009fd0 tx=0x7f3ae00097f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:53.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:53.908+0000 7f3ae7400640 1 -- 172.21.15.175:0/4053831148 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3ae80c4060 con 0x7f3af014df90 2024-04-25T09:06:54.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.096+0000 7f3af6800640 1 -- 172.21.15.175:0/4053831148 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3af006ee30 con 0x7f3af014df90 2024-04-25T09:06:54.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.096+0000 7f3ae7400640 1 -- 172.21.15.175:0/4053831148 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f3ae8016110 con 0x7f3af014df90 2024-04-25T09:06:54.085 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:54.085 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2064272902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2064272902},{"type":"v1","addr":"172.21.15.177:6834","nonce":2064272902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5462,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3896280225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3896280225},{"type":"v1","addr":"172.21.15.177:6835","nonce":3896280225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/149812612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":149812612},{"type":"v1","addr":"172.21.15.175:6835","nonce":149812612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:43.704808+0000","modified":"2024-04-25T09:06:46.737698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1478147147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1478147147},{"type":"v1","addr":"172.21.15.175:6837","nonce":1478147147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:06:54.086 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 32 2024-04-25T09:06:54.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.096+0000 7f3af6800640 1 -- 172.21.15.175:0/4053831148 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ad0066f60 msgr2=0x7f3ad0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.096+0000 7f3af6800640 1 --2- 172.21.15.175:0/4053831148 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ad0066f60 0x7f3ad0069420 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0009fd0 tx=0x7f3ae00097f0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.096+0000 7f3af6800640 1 -- 172.21.15.175:0/4053831148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3af014df90 msgr2=0x7f3af0143610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.096+0000 7f3af6800640 1 --2- 172.21.15.175:0/4053831148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3af014df90 0x7f3af0143610 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80ad040 tx=0x7f3ae801ad60 comp rx=0 tx=0).stop 2024-04-25T09:06:54.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.096+0000 7f3af6800640 1 -- 172.21.15.175:0/4053831148 shutdown_connections 2024-04-25T09:06:54.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.096+0000 7f3af6800640 1 --2- 172.21.15.175:0/4053831148 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3ad0066f60 0x7f3ad0069420 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.096+0000 7f3af6800640 1 --2- 172.21.15.175:0/4053831148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3af014df90 0x7f3af0143610 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.096+0000 7f3af6800640 1 --2- 172.21.15.175:0/4053831148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3af01453a0 0x7f3af013f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.096+0000 7f3af6800640 1 --2- 172.21.15.175:0/4053831148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3af0144fc0 0x7f3af015b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.096+0000 7f3af6800640 1 -- 172.21.15.175:0/4053831148 >> 172.21.15.175:0/4053831148 conn(0x7f3af00cc3b0 msgr2=0x7f3af006ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:54.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.096+0000 7f3af6800640 1 -- 172.21.15.175:0/4053831148 shutdown_connections 2024-04-25T09:06:54.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.096+0000 7f3af6800640 1 -- 172.21.15.175:0/4053831148 wait complete. 2024-04-25T09:06:54.509 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:06:43.704808+0000', 'modified': '2024-04-25T09:06:46.737698+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5958}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5958': {'gid': 5958, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6837/1478147147', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 1478147147}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 1478147147}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:06:54.509 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:06:54.510 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:06:54.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.656+0000 7f2aa9600640 1 Processor -- start 2024-04-25T09:06:54.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.656+0000 7f2aa9600640 1 -- start start 2024-04-25T09:06:54.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.656+0000 7f2aa9600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2aa4070e10 0x7f2aa40b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.656+0000 7f2aa9600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2aa40ceb50 0x7f2aa40cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.656+0000 7f2aa9600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa406dd80 con 0x7f2aa40b4810 2024-04-25T09:06:54.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.656+0000 7f2aa9600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa406d8f0 con 0x7f2aa4070e10 2024-04-25T09:06:54.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.656+0000 7f2aa9600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa406cd70 con 0x7f2aa40ceb50 2024-04-25T09:06:54.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.656+0000 7f2aa2a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2aa4070e10 0x7f2aa40b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.656+0000 7f2aa2a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2aa4070e10 0x7f2aa40b0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34838/0 (socket says 172.21.15.175:34838) 2024-04-25T09:06:54.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.656+0000 7f2aa2a00640 1 -- 172.21.15.175:0/1460796550 learned_addr learned my addr 172.21.15.175:0/1460796550 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:54.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.656+0000 7f2aa3400640 1 --2- 172.21.15.175:0/1460796550 >> v2:172.21.15.177:3300/0 conn(0x7f2aa40ceb50 0x7f2aa40cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.656+0000 7f2aa2a00640 1 -- 172.21.15.175:0/1460796550 >> v2:172.21.15.177:3300/0 conn(0x7f2aa40ceb50 msgr2=0x7f2aa40cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:54.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.656+0000 7f2aa2a00640 1 --2- 172.21.15.175:0/1460796550 >> v2:172.21.15.177:3300/0 conn(0x7f2aa40ceb50 0x7f2aa40cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.656+0000 7f2aa2a00640 1 -- 172.21.15.175:0/1460796550 >> v1:172.21.15.177:6789/0 conn(0x7f2aa40b4810 legacy=0x7f2aa40711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:54.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.656+0000 7f2aa2a00640 1 -- 172.21.15.175:0/1460796550 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa406cfc0 con 0x7f2aa4070e10 2024-04-25T09:06:54.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.660+0000 7f2aa2a00640 1 --2- 172.21.15.175:0/1460796550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2aa4070e10 0x7f2aa40b0e20 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40b5010 tx=0x7f2a9401c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4efd3cbe6b8184a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:54.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.660+0000 7f2aa2000640 1 -- 172.21.15.175:0/1460796550 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a940b0070 con 0x7f2aa4070e10 2024-04-25T09:06:54.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.660+0000 7f2aa2000640 1 -- 172.21.15.175:0/1460796550 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a940ab600 con 0x7f2aa4070e10 2024-04-25T09:06:54.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.660+0000 7f2aa2000640 1 -- 172.21.15.175:0/1460796550 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a940ab9d0 con 0x7f2aa4070e10 2024-04-25T09:06:54.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.660+0000 7f2aa9600640 1 -- 172.21.15.175:0/1460796550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2aa4070e10 msgr2=0x7f2aa40b0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.660+0000 7f2aa9600640 1 --2- 172.21.15.175:0/1460796550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2aa4070e10 0x7f2aa40b0e20 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40b5010 tx=0x7f2a9401c2d0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.660+0000 7f2aa9600640 1 -- 172.21.15.175:0/1460796550 shutdown_connections 2024-04-25T09:06:54.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.660+0000 7f2aa9600640 1 --2- 172.21.15.175:0/1460796550 >> v2:172.21.15.177:3300/0 conn(0x7f2aa40ceb50 0x7f2aa40cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.660+0000 7f2aa9600640 1 --2- 172.21.15.175:0/1460796550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2aa4070e10 0x7f2aa40b0e20 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.660+0000 7f2aa9600640 1 -- 172.21.15.175:0/1460796550 >> 172.21.15.175:0/1460796550 conn(0x7f2aa40b3510 msgr2=0x7f2aa40b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:54.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.660+0000 7f2aa9600640 1 -- 172.21.15.175:0/1460796550 shutdown_connections 2024-04-25T09:06:54.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.660+0000 7f2aa9600640 1 -- 172.21.15.175:0/1460796550 wait complete. 2024-04-25T09:06:54.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2aa9600640 1 Processor -- start 2024-04-25T09:06:54.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2aa9600640 1 -- start start 2024-04-25T09:06:54.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2aa9600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2aa4070e10 0x7f2aa4139000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2aa9600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2aa40b4810 0x7f2aa41fa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2aa9600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2aa40ceb50 0x7f2aa40cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2aa9600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa416a440 con 0x7f2aa40b4810 2024-04-25T09:06:54.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2aa9600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa415e110 con 0x7f2aa40ceb50 2024-04-25T09:06:54.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2aa9600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa416a5c0 con 0x7f2aa4070e10 2024-04-25T09:06:54.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2a9a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2aa40b4810 0x7f2aa41fa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2a9a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2aa40b4810 0x7f2aa41fa5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34850/0 (socket says 172.21.15.175:34850) 2024-04-25T09:06:54.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2a9a000640 1 -- 172.21.15.175:0/1082950492 learned_addr learned my addr 172.21.15.175:0/1082950492 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:54.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2aa2a00640 1 --2- 172.21.15.175:0/1082950492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2aa4070e10 0x7f2aa4139000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2aa3400640 1 --2- 172.21.15.175:0/1082950492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2aa40ceb50 0x7f2aa40cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2a9a000640 1 -- 172.21.15.175:0/1082950492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2aa4070e10 msgr2=0x7f2aa4139000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2a9a000640 1 --2- 172.21.15.175:0/1082950492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2aa4070e10 0x7f2aa4139000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2a9a000640 1 -- 172.21.15.175:0/1082950492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2aa40ceb50 msgr2=0x7f2aa40cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2a9a000640 1 --2- 172.21.15.175:0/1082950492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2aa40ceb50 0x7f2aa40cabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2a9a000640 1 -- 172.21.15.175:0/1082950492 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa414d9e0 con 0x7f2aa40b4810 2024-04-25T09:06:54.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2aa3400640 1 --2- 172.21.15.175:0/1082950492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2aa40ceb50 0x7f2aa40cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:54.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2a9a000640 1 --2- 172.21.15.175:0/1082950492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2aa40b4810 0x7f2aa41fa5e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00c480 tx=0x7f2a8c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:54.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2a9b400640 1 -- 172.21.15.175:0/1082950492 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c012830 con 0x7f2aa40b4810 2024-04-25T09:06:54.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2a9b400640 1 -- 172.21.15.175:0/1082950492 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c017070 con 0x7f2aa40b4810 2024-04-25T09:06:54.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2aa9600640 1 -- 172.21.15.175:0/1082950492 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa414dca0 con 0x7f2aa40b4810 2024-04-25T09:06:54.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2a9b400640 1 -- 172.21.15.175:0/1082950492 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c012c30 con 0x7f2aa40b4810 2024-04-25T09:06:54.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.664+0000 7f2aa9600640 1 -- 172.21.15.175:0/1082950492 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa414e260 con 0x7f2aa40b4810 2024-04-25T09:06:54.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.668+0000 7f2a9b400640 1 -- 172.21.15.175:0/1082950492 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2a8c01c460 con 0x7f2aa40b4810 2024-04-25T09:06:54.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.668+0000 7f2a9b400640 1 --2- 172.21.15.175:0/1082950492 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2a80066f60 0x7f2a80069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.668+0000 7f2a9b400640 1 -- 172.21.15.175:0/1082950492 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a8c084e80 con 0x7f2aa40b4810 2024-04-25T09:06:54.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.668+0000 7f2aa2a00640 1 --2- 172.21.15.175:0/1082950492 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2a80066f60 0x7f2a80069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.668+0000 7f2aaca23000 1 Processor -- start 2024-04-25T09:06:54.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.668+0000 7f2aaca23000 1 -- start start 2024-04-25T09:06:54.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.668+0000 7f2aa2a00640 1 --2- 172.21.15.175:0/1082950492 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2a80066f60 0x7f2a80069420 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2a940ad000 tx=0x7f2a94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:54.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aaca23000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40ba3a920 0x55c40ba3ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aaca23000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 0x55c40b9f09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aaca23000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40b9f0f30 0x55c40b9f1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aaca23000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c40b8d85f0 con 0x55c40ba3b240 2024-04-25T09:06:54.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aaca23000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c40b83fda0 con 0x55c40ba3a920 2024-04-25T09:06:54.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aaca23000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c40b7c8150 con 0x55c40b9f0f30 2024-04-25T09:06:54.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2a9a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 0x55c40b9f09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2a9a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 0x55c40b9f09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34864/0 (socket says 172.21.15.175:34864) 2024-04-25T09:06:54.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2a9a000640 1 -- 172.21.15.175:0/1988214684 learned_addr learned my addr 172.21.15.175:0/1988214684 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:54.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aa2a00640 1 --2- 172.21.15.175:0/1988214684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40ba3a920 0x55c40ba3ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aa3400640 1 --2- 172.21.15.175:0/1988214684 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40b9f0f30 0x55c40b9f1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2a9a000640 1 -- 172.21.15.175:0/1988214684 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40b9f0f30 msgr2=0x55c40b9f1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:54.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2a9a000640 1 --2- 172.21.15.175:0/1988214684 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40b9f0f30 0x55c40b9f1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2a9a000640 1 -- 172.21.15.175:0/1988214684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40ba3a920 msgr2=0x55c40ba3ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:54.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2a9a000640 1 --2- 172.21.15.175:0/1988214684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40ba3a920 0x55c40ba3ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2a9a000640 1 -- 172.21.15.175:0/1988214684 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c40b7e1ca0 con 0x55c40ba3b240 2024-04-25T09:06:54.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aa2a00640 1 --2- 172.21.15.175:0/1988214684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40ba3a920 0x55c40ba3ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:54.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2a9a000640 1 --2- 172.21.15.175:0/1988214684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 0x55c40b9f09f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00ce40 tx=0x7f2a8c055fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38da164b0873904b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:54.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2a93400640 1 -- 172.21.15.175:0/1988214684 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c06d020 con 0x55c40ba3b240 2024-04-25T09:06:54.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2a93400640 1 -- 172.21.15.175:0/1988214684 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c05de90 con 0x55c40ba3b240 2024-04-25T09:06:54.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2a93400640 1 -- 172.21.15.175:0/1988214684 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c06d1c0 con 0x55c40ba3b240 2024-04-25T09:06:54.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aaca23000 1 -- 172.21.15.175:0/1988214684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 msgr2=0x55c40b9f09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aaca23000 1 --2- 172.21.15.175:0/1988214684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 0x55c40b9f09f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00ce40 tx=0x7f2a8c055fc0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aaca23000 1 -- 172.21.15.175:0/1988214684 shutdown_connections 2024-04-25T09:06:54.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aaca23000 1 --2- 172.21.15.175:0/1988214684 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40b9f0f30 0x55c40b9f1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aaca23000 1 --2- 172.21.15.175:0/1988214684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 0x55c40b9f09f0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aaca23000 1 --2- 172.21.15.175:0/1988214684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40ba3a920 0x55c40ba3ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aaca23000 1 -- 172.21.15.175:0/1988214684 >> 172.21.15.175:0/1988214684 conn(0x55c40b9f72a0 msgr2=0x55c40b9ef2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:54.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aaca23000 1 -- 172.21.15.175:0/1988214684 shutdown_connections 2024-04-25T09:06:54.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aaca23000 1 -- 172.21.15.175:0/1988214684 wait complete. 2024-04-25T09:06:54.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aaca23000 1 -- start start 2024-04-25T09:06:54.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.672+0000 7f2aaca23000 1 Processor -- start 2024-04-25T09:06:54.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aaca23000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40b9f0f30 0x55c40ba41c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aaca23000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40ba3a920 0x55c40ba421c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aaca23000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 0x55c40b9f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aaca23000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c40b7fa990 con 0x55c40ba3b240 2024-04-25T09:06:54.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aaca23000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c40b83be40 con 0x55c40b9f0f30 2024-04-25T09:06:54.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aaca23000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c40b7cb900 con 0x55c40ba3a920 2024-04-25T09:06:54.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aaca23000 10 client.0 _ll_register_callbacks cb 0x55c40b8f31c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:54.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aa3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 0x55c40b9f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aa2a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40b9f0f30 0x55c40ba41c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aa2a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40b9f0f30 0x55c40ba41c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:48934/0 (socket says 172.21.15.175:48934) 2024-04-25T09:06:54.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aa3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 0x55c40b9f4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34876/0 (socket says 172.21.15.175:34876) 2024-04-25T09:06:54.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aa2a00640 1 -- 172.21.15.175:0/827866827 learned_addr learned my addr 172.21.15.175:0/827866827 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:54.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2a9a000640 1 --2- 172.21.15.175:0/827866827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40ba3a920 0x55c40ba421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aa3400640 1 -- 172.21.15.175:0/827866827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40ba3a920 msgr2=0x55c40ba421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:54.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aa3400640 1 --2- 172.21.15.175:0/827866827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40ba3a920 0x55c40ba421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aa3400640 1 -- 172.21.15.175:0/827866827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40b9f0f30 msgr2=0x55c40ba41c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:54.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aa3400640 1 --2- 172.21.15.175:0/827866827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40b9f0f30 0x55c40ba41c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aa3400640 1 -- 172.21.15.175:0/827866827 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c40b7f8630 con 0x55c40ba3b240 2024-04-25T09:06:54.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aa3400640 1 --2- 172.21.15.175:0/827866827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 0x55c40b9f4aa0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2aa413ca60 tx=0x7f2a9c007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc6bfe625a6dbb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:54.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2a87e00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:06:54.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2a87e00640 1 -- 172.21.15.175:0/827866827 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c019020 con 0x55c40ba3b240 2024-04-25T09:06:54.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2a87e00640 1 -- 172.21.15.175:0/827866827 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a9c003bb0 con 0x55c40ba3b240 2024-04-25T09:06:54.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aaca23000 1 -- 172.21.15.175:0/827866827 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2a8c05de90 con 0x55c40ba3b240 2024-04-25T09:06:54.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2a87e00640 1 -- 172.21.15.175:0/827866827 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a9c023050 con 0x55c40ba3b240 2024-04-25T09:06:54.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aaca23000 10 client.6111 fetch_fsmap learned FSMap version 32 2024-04-25T09:06:54.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aaca23000 1 -- 172.21.15.175:0/827866827 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55c40b7c83a0 con 0x55c40ba3b240 2024-04-25T09:06:54.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2a87e00640 1 -- 172.21.15.175:0/827866827 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c05de90 con 0x55c40ba3b240 2024-04-25T09:06:54.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2a87e00640 1 -- 172.21.15.175:0/827866827 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2a9c026020 con 0x55c40ba3b240 2024-04-25T09:06:54.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aaca23000 10 client.6111 fetch_fsmap finished waiting for FSMap version 32 2024-04-25T09:06:54.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aaca23000 10 client.6111 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:06:54.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aaca23000 20 client.6111 populate_metadata read hostname 'smithi175' 2024-04-25T09:06:54.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aaca23000 1 --2- 172.21.15.175:0/827866827 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x55c40b9f6160 0x55c40ba4bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aaca23000 4 client.6111 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:54.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aaca23000 1 -- 172.21.15.175:0/827866827 --> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c40b7dba50 con 0x55c40b9f6160 2024-04-25T09:06:54.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aa2a00640 1 --2- 172.21.15.175:0/827866827 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x55c40b9f6160 0x55c40ba4bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aa2a00640 1 --2- 172.21.15.175:0/827866827 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x55c40b9f6160 0x55c40ba4bce0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fc64b9ea8049b35 server_cookie=2241d50a970c9af9 in_seq=0 out_seq=0 2024-04-25T09:06:54.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2a87e00640 10 client.6111 ms_handle_connect on v2:172.21.15.175:6836/1478147147 2024-04-25T09:06:54.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2a87e00640 1 -- 172.21.15.175:0/827866827 <== mds.0 v2:172.21.15.175:6836/1478147147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c40b7dba50 con 0x55c40b9f6160 2024-04-25T09:06:54.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2a87e00640 10 client.6111 handle_command_reply: tid=0 2024-04-25T09:06:54.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.676+0000 7f2aaca23000 1 client.6111 shutdown 2024-04-25T09:06:54.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.680+0000 7f2aaca23000 1 -- 172.21.15.175:0/827866827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 msgr2=0x55c40b9f4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.680+0000 7f2aaca23000 1 --2- 172.21.15.175:0/827866827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 0x55c40b9f4aa0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2aa413ca60 tx=0x7f2a9c007e30 comp rx=0 tx=0).stop 2024-04-25T09:06:54.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.680+0000 7f2aaca23000 1 -- 172.21.15.175:0/827866827 shutdown_connections 2024-04-25T09:06:54.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.680+0000 7f2aaca23000 1 --2- 172.21.15.175:0/827866827 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x55c40b9f6160 0x55c40ba4bce0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.680+0000 7f2aaca23000 1 --2- 172.21.15.175:0/827866827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 0x55c40b9f4aa0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.680+0000 7f2aaca23000 1 --2- 172.21.15.175:0/827866827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40ba3a920 0x55c40ba421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.680+0000 7f2a87e00640 0 client.6111 ms_handle_reset on v2:172.21.15.175:6836/1478147147 2024-04-25T09:06:54.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.680+0000 7f2aaca23000 1 --2- 172.21.15.175:0/827866827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40b9f0f30 0x55c40ba41c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.680+0000 7f2aaca23000 1 -- 172.21.15.175:0/827866827 >> 172.21.15.175:0/827866827 conn(0x55c40b9f72a0 msgr2=0x55c40b9ef9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:54.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.680+0000 7f2aaca23000 1 -- 172.21.15.175:0/827866827 shutdown_connections 2024-04-25T09:06:54.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.680+0000 7f2aaca23000 1 -- 172.21.15.175:0/827866827 wait complete. 2024-04-25T09:06:54.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.680+0000 7f2aaca23000 20 client.6111 trim_cache size 0 max 16384 2024-04-25T09:06:54.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.692+0000 7f2aaca23000 1 Processor -- start 2024-04-25T09:06:54.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.692+0000 7f2aaca23000 1 -- start start 2024-04-25T09:06:54.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aaca23000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40b9f0f30 0x55c40ba963a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aaca23000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40ba3a920 0x55c40ba968e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aaca23000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 0x55c40ba96e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aaca23000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa40cda40 con 0x55c40ba3b240 2024-04-25T09:06:54.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aaca23000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa40cce40 con 0x55c40b9f0f30 2024-04-25T09:06:54.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aaca23000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa40cd440 con 0x55c40ba3a920 2024-04-25T09:06:54.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aa3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 0x55c40ba96e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aa3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 0x55c40ba96e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34892/0 (socket says 172.21.15.175:34892) 2024-04-25T09:06:54.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aa3400640 1 -- 172.21.15.175:0/34967271 learned_addr learned my addr 172.21.15.175:0/34967271 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:54.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2a9a000640 1 --2- 172.21.15.175:0/34967271 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40ba3a920 0x55c40ba968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aa2a00640 1 --2- 172.21.15.175:0/34967271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40b9f0f30 0x55c40ba963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aa3400640 1 -- 172.21.15.175:0/34967271 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40ba3a920 msgr2=0x55c40ba968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:54.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aa3400640 1 --2- 172.21.15.175:0/34967271 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40ba3a920 0x55c40ba968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aa3400640 1 -- 172.21.15.175:0/34967271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40b9f0f30 msgr2=0x55c40ba963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:54.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aa3400640 1 --2- 172.21.15.175:0/34967271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40b9f0f30 0x55c40ba963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aa3400640 1 -- 172.21.15.175:0/34967271 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c40ba3b070 con 0x55c40ba3b240 2024-04-25T09:06:54.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aa3400640 1 --2- 172.21.15.175:0/34967271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 0x55c40ba96e20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c009ec0 tx=0x7f2a9c00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfa2e2cfbf5c1ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:54.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2a92a00640 1 -- 172.21.15.175:0/34967271 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c019040 con 0x55c40ba3b240 2024-04-25T09:06:54.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2a92a00640 1 -- 172.21.15.175:0/34967271 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c02c070 con 0x55c40ba3b240 2024-04-25T09:06:54.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2a92a00640 1 -- 172.21.15.175:0/34967271 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c011bb0 con 0x55c40ba3b240 2024-04-25T09:06:54.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aaca23000 1 -- 172.21.15.175:0/34967271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 msgr2=0x55c40ba96e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aaca23000 1 --2- 172.21.15.175:0/34967271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 0x55c40ba96e20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c009ec0 tx=0x7f2a9c00f000 comp rx=0 tx=0).stop 2024-04-25T09:06:54.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aaca23000 1 -- 172.21.15.175:0/34967271 shutdown_connections 2024-04-25T09:06:54.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aaca23000 1 --2- 172.21.15.175:0/34967271 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40ba3b240 0x55c40ba96e20 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aaca23000 1 --2- 172.21.15.175:0/34967271 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40ba3a920 0x55c40ba968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aaca23000 1 --2- 172.21.15.175:0/34967271 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40b9f0f30 0x55c40ba963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aaca23000 1 -- 172.21.15.175:0/34967271 >> 172.21.15.175:0/34967271 conn(0x55c40b9f72a0 msgr2=0x55c40b9f4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:54.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aaca23000 1 -- 172.21.15.175:0/34967271 shutdown_connections 2024-04-25T09:06:54.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aaca23000 1 -- 172.21.15.175:0/34967271 wait complete. 2024-04-25T09:06:54.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aaca23000 1 -- start start 2024-04-25T09:06:54.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.696+0000 7f2aaca23000 1 Processor -- start 2024-04-25T09:06:54.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40b9f0f30 0x55c40ba471c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40ba3a920 0x55c40ba9c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40ba3b240 0x55c40ba9c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c40b8443d0 con 0x55c40b9f0f30 2024-04-25T09:06:54.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c40b8fbd50 con 0x55c40ba3a920 2024-04-25T09:06:54.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c40b7da980 con 0x55c40ba3b240 2024-04-25T09:06:54.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 10 client.0 _ll_register_callbacks cb 0x7f2a8c055550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:54.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aa2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40b9f0f30 0x55c40ba471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aa2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40b9f0f30 0x55c40ba471c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34896/0 (socket says 172.21.15.175:34896) 2024-04-25T09:06:54.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aa2a00640 1 -- 172.21.15.175:0/2239482470 learned_addr learned my addr 172.21.15.175:0/2239482470 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:54.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aa3400640 1 --2- 172.21.15.175:0/2239482470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40ba3b240 0x55c40ba9c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2a9a000640 1 --2- 172.21.15.175:0/2239482470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40ba3a920 0x55c40ba9c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aa2a00640 1 -- 172.21.15.175:0/2239482470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40ba3b240 msgr2=0x55c40ba9c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:54.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aa2a00640 1 --2- 172.21.15.175:0/2239482470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40ba3b240 0x55c40ba9c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aa2a00640 1 -- 172.21.15.175:0/2239482470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40ba3a920 msgr2=0x55c40ba9c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:54.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aa2a00640 1 --2- 172.21.15.175:0/2239482470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40ba3a920 0x55c40ba9c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aa2a00640 1 -- 172.21.15.175:0/2239482470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c40b8c1600 con 0x55c40b9f0f30 2024-04-25T09:06:54.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aa2a00640 1 --2- 172.21.15.175:0/2239482470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40b9f0f30 0x55c40ba471c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2a94006b20 tx=0x7f2a9401ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc42c398957ebe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:54.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2a87e00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:06:54.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2a87e00640 1 -- 172.21.15.175:0/2239482470 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a940b0040 con 0x55c40b9f0f30 2024-04-25T09:06:54.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2a87e00640 1 -- 172.21.15.175:0/2239482470 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a940c62b0 con 0x55c40b9f0f30 2024-04-25T09:06:54.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 -- 172.21.15.175:0/2239482470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2a9c02c070 con 0x55c40b9f0f30 2024-04-25T09:06:54.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2a87e00640 1 -- 172.21.15.175:0/2239482470 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a940d6050 con 0x55c40b9f0f30 2024-04-25T09:06:54.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 10 client.6117 fetch_fsmap learned FSMap version 32 2024-04-25T09:06:54.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 -- 172.21.15.175:0/2239482470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55c40b7d49b0 con 0x55c40b9f0f30 2024-04-25T09:06:54.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2a87e00640 1 -- 172.21.15.175:0/2239482470 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c02c070 con 0x55c40b9f0f30 2024-04-25T09:06:54.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2a87e00640 1 -- 172.21.15.175:0/2239482470 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2a940d9020 con 0x55c40b9f0f30 2024-04-25T09:06:54.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 10 client.6117 fetch_fsmap finished waiting for FSMap version 32 2024-04-25T09:06:54.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 10 client.6117 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:06:54.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 20 client.6117 populate_metadata read hostname 'smithi175' 2024-04-25T09:06:54.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 --2- 172.21.15.175:0/2239482470 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x55c40ba7ff20 0x55c40ba80300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 4 client.6117 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:06:54.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 -- 172.21.15.175:0/2239482470 --> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c40b84d2e0 con 0x55c40ba7ff20 2024-04-25T09:06:54.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2a9a000640 1 --2- 172.21.15.175:0/2239482470 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x55c40ba7ff20 0x55c40ba80300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2a9a000640 1 --2- 172.21.15.175:0/2239482470 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x55c40ba7ff20 0x55c40ba80300 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b0fe2e953b625f1 server_cookie=1c2d2fd4c48a3120 in_seq=0 out_seq=0 2024-04-25T09:06:54.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2a87e00640 10 client.6117 ms_handle_connect on v2:172.21.15.175:6836/1478147147 2024-04-25T09:06:54.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2a87e00640 1 -- 172.21.15.175:0/2239482470 <== mds.0 v2:172.21.15.175:6836/1478147147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55c40b84d2e0 con 0x55c40ba7ff20 2024-04-25T09:06:54.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2a87e00640 10 client.6117 handle_command_reply: tid=0 2024-04-25T09:06:54.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 client.6117 shutdown 2024-04-25T09:06:54.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 -- 172.21.15.175:0/2239482470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40b9f0f30 msgr2=0x55c40ba471c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 --2- 172.21.15.175:0/2239482470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40b9f0f30 0x55c40ba471c0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f2a94006b20 tx=0x7f2a9401ab10 comp rx=0 tx=0).stop 2024-04-25T09:06:54.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 -- 172.21.15.175:0/2239482470 shutdown_connections 2024-04-25T09:06:54.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 --2- 172.21.15.175:0/2239482470 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x55c40ba7ff20 0x55c40ba80300 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 --2- 172.21.15.175:0/2239482470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c40ba3b240 0x55c40ba9c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 --2- 172.21.15.175:0/2239482470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c40ba3a920 0x55c40ba9c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2a87e00640 0 client.6117 ms_handle_reset on v2:172.21.15.175:6836/1478147147 2024-04-25T09:06:54.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 --2- 172.21.15.175:0/2239482470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c40b9f0f30 0x55c40ba471c0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 -- 172.21.15.175:0/2239482470 >> 172.21.15.175:0/2239482470 conn(0x55c40b9f72a0 msgr2=0x55c40ba42870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:54.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 -- 172.21.15.175:0/2239482470 shutdown_connections 2024-04-25T09:06:54.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 1 -- 172.21.15.175:0/2239482470 wait complete. 2024-04-25T09:06:54.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.700+0000 7f2aaca23000 20 client.6117 trim_cache size 0 max 16384 2024-04-25T09:06:54.697 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:06:54.697 INFO:teuthology.orchestra.run.smithi175.stdout: "cluster_fsid": "8caed986-ca08-40e2-b5a5-12e2aade6223", 2024-04-25T09:06:54.697 INFO:teuthology.orchestra.run.smithi175.stdout: "whoami": 0, 2024-04-25T09:06:54.697 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 5958, 2024-04-25T09:06:54.697 INFO:teuthology.orchestra.run.smithi175.stdout: "want_state": "up:active", 2024-04-25T09:06:54.697 INFO:teuthology.orchestra.run.smithi175.stdout: "state": "up:active", 2024-04-25T09:06:54.697 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs", 2024-04-25T09:06:54.697 INFO:teuthology.orchestra.run.smithi175.stdout: "rank_uptime": 10.347079300000001, 2024-04-25T09:06:54.697 INFO:teuthology.orchestra.run.smithi175.stdout: "mdsmap_epoch": 32, 2024-04-25T09:06:54.698 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch": 58, 2024-04-25T09:06:54.698 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch_barrier": 58, 2024-04-25T09:06:54.698 INFO:teuthology.orchestra.run.smithi175.stdout: "uptime": 16.258076065000001 2024-04-25T09:06:54.698 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:06:54.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.704+0000 7f2aa9600640 1 -- 172.21.15.175:0/1082950492 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2a80066f60 msgr2=0x7f2a80069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.704+0000 7f2aa9600640 1 --2- 172.21.15.175:0/1082950492 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2a80066f60 0x7f2a80069420 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2a940ad000 tx=0x7f2a94008040 comp rx=0 tx=0).stop 2024-04-25T09:06:54.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.704+0000 7f2aa9600640 1 -- 172.21.15.175:0/1082950492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2aa40b4810 msgr2=0x7f2aa41fa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.704+0000 7f2aa9600640 1 --2- 172.21.15.175:0/1082950492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2aa40b4810 0x7f2aa41fa5e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c00c480 tx=0x7f2a8c00c940 comp rx=0 tx=0).stop 2024-04-25T09:06:54.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.704+0000 7f2aa9600640 1 -- 172.21.15.175:0/1082950492 shutdown_connections 2024-04-25T09:06:54.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.704+0000 7f2aa9600640 1 --2- 172.21.15.175:0/1082950492 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2a80066f60 0x7f2a80069420 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.704+0000 7f2aa9600640 1 --2- 172.21.15.175:0/1082950492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2aa40ceb50 0x7f2aa40cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.704+0000 7f2aa9600640 1 --2- 172.21.15.175:0/1082950492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2aa40b4810 0x7f2aa41fa5e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.704+0000 7f2aa9600640 1 --2- 172.21.15.175:0/1082950492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2aa4070e10 0x7f2aa4139000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.704+0000 7f2aa9600640 1 -- 172.21.15.175:0/1082950492 >> 172.21.15.175:0/1082950492 conn(0x7f2aa40b3510 msgr2=0x7f2aa40b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:54.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.704+0000 7f2aa9600640 1 -- 172.21.15.175:0/1082950492 shutdown_connections 2024-04-25T09:06:54.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.704+0000 7f2aa9600640 1 -- 172.21.15.175:0/1082950492 wait complete. 2024-04-25T09:06:54.711 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:06:54.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.856+0000 7f5487000640 1 Processor -- start 2024-04-25T09:06:54.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.860+0000 7f5487000640 1 -- start start 2024-04-25T09:06:54.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.860+0000 7f5487000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5480099a50 0x7f548006cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.860+0000 7f5487000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f548006bd60 0x7f5480099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.860+0000 7f5487000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548009a370 con 0x7f54800d0d50 2024-04-25T09:06:54.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.860+0000 7f5487000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54800cfcb0 con 0x7f548006bd60 2024-04-25T09:06:54.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.860+0000 7f5487000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54800cff90 con 0x7f5480099a50 2024-04-25T09:06:54.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.860+0000 7f5477e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f548006bd60 0x7f5480099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.860+0000 7f5477e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f548006bd60 0x7f5480099e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34898/0 (socket says 172.21.15.175:34898) 2024-04-25T09:06:54.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.860+0000 7f5477e00640 1 -- 172.21.15.175:0/215810613 learned_addr learned my addr 172.21.15.175:0/215810613 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:54.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.860+0000 7f5485000640 1 --1- 172.21.15.175:0/215810613 >> v1:172.21.15.175:6789/0 conn(0x7f54800d0d50 0x7f54800cbe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:41972/0 (socket says 172.21.15.175:41972) 2024-04-25T09:06:54.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.860+0000 7f547fe00640 1 --2- 172.21.15.175:0/215810613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5480099a50 0x7f548006cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.860+0000 7f5477e00640 1 -- 172.21.15.175:0/215810613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5480099a50 msgr2=0x7f548006cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:54.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.860+0000 7f5477e00640 1 --2- 172.21.15.175:0/215810613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5480099a50 0x7f548006cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.860+0000 7f5477e00640 1 -- 172.21.15.175:0/215810613 >> v1:172.21.15.175:6789/0 conn(0x7f54800d0d50 legacy=0x7f54800cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.860+0000 7f5477e00640 1 -- 172.21.15.175:0/215810613 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54800d0270 con 0x7f548006bd60 2024-04-25T09:06:54.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.860+0000 7f547f400640 1 -- 172.21.15.175:0/215810613 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231970491 0 0) 0x7f548009a370 con 0x7f54800d0d50 2024-04-25T09:06:54.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.864+0000 7f5477e00640 1 --2- 172.21.15.175:0/215810613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f548006bd60 0x7f5480099e30 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5468009870 tx=0x7f546801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb388082e81bf248 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:54.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.864+0000 7f547f400640 1 -- 172.21.15.175:0/215810613 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54680b2070 con 0x7f548006bd60 2024-04-25T09:06:54.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.864+0000 7f547f400640 1 -- 172.21.15.175:0/215810613 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54680a9070 con 0x7f548006bd60 2024-04-25T09:06:54.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.864+0000 7f547f400640 1 -- 172.21.15.175:0/215810613 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54680ad880 con 0x7f548006bd60 2024-04-25T09:06:54.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.864+0000 7f5487000640 1 -- 172.21.15.175:0/215810613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f548006bd60 msgr2=0x7f5480099e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.864+0000 7f5487000640 1 --2- 172.21.15.175:0/215810613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f548006bd60 0x7f5480099e30 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5468009870 tx=0x7f546801c560 comp rx=0 tx=0).stop 2024-04-25T09:06:54.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.864+0000 7f5487000640 1 -- 172.21.15.175:0/215810613 shutdown_connections 2024-04-25T09:06:54.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.864+0000 7f5487000640 1 --2- 172.21.15.175:0/215810613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f548006bd60 0x7f5480099e30 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.864+0000 7f5487000640 1 --2- 172.21.15.175:0/215810613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5480099a50 0x7f548006cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.864+0000 7f5487000640 1 -- 172.21.15.175:0/215810613 >> 172.21.15.175:0/215810613 conn(0x7f54800b3300 msgr2=0x7f54800b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:54.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.864+0000 7f5487000640 1 -- 172.21.15.175:0/215810613 shutdown_connections 2024-04-25T09:06:54.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.864+0000 7f5487000640 1 -- 172.21.15.175:0/215810613 wait complete. 2024-04-25T09:06:54.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.864+0000 7f5487000640 1 Processor -- start 2024-04-25T09:06:54.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.864+0000 7f5487000640 1 -- start start 2024-04-25T09:06:54.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f5487000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f548006bd60 0x7f5480150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f5487000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5480099a50 0x7f54800c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f5487000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54800d0d50 0x7f548015c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f5487000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548015dfe0 con 0x7f548006bd60 2024-04-25T09:06:54.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f5487000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548015de60 con 0x7f54800d0d50 2024-04-25T09:06:54.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f5487000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548016b260 con 0x7f5480099a50 2024-04-25T09:06:54.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f547fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f548006bd60 0x7f5480150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f547fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f548006bd60 0x7f5480150840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34910/0 (socket says 172.21.15.175:34910) 2024-04-25T09:06:54.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f547fe00640 1 -- 172.21.15.175:0/409091601 learned_addr learned my addr 172.21.15.175:0/409091601 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:54.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f5477e00640 1 --2- 172.21.15.175:0/409091601 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5480099a50 0x7f54800c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f547fe00640 1 -- 172.21.15.175:0/409091601 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5480099a50 msgr2=0x7f54800c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f5485000640 1 --2- 172.21.15.175:0/409091601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54800d0d50 0x7f548015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f547fe00640 1 --2- 172.21.15.175:0/409091601 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5480099a50 0x7f54800c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f547fe00640 1 -- 172.21.15.175:0/409091601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54800d0d50 msgr2=0x7f548015c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:54.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f547fe00640 1 --2- 172.21.15.175:0/409091601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54800d0d50 0x7f548015c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:54.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f547fe00640 1 -- 172.21.15.175:0/409091601 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54800c54e0 con 0x7f548006bd60 2024-04-25T09:06:54.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f5477e00640 1 --2- 172.21.15.175:0/409091601 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5480099a50 0x7f54800c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:54.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f5485000640 1 --2- 172.21.15.175:0/409091601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54800d0d50 0x7f548015c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:54.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f547fe00640 1 --2- 172.21.15.175:0/409091601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f548006bd60 0x7f5480150840 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f547000d830 tx=0x7f547000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:54.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f547cc00640 1 -- 172.21.15.175:0/409091601 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547000b6c0 con 0x7f548006bd60 2024-04-25T09:06:54.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f547cc00640 1 -- 172.21.15.175:0/409091601 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5470019070 con 0x7f548006bd60 2024-04-25T09:06:54.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f5487000640 1 -- 172.21.15.175:0/409091601 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54800c57c0 con 0x7f548006bd60 2024-04-25T09:06:54.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f547cc00640 1 -- 172.21.15.175:0/409091601 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547000ba60 con 0x7f548006bd60 2024-04-25T09:06:54.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f5487000640 1 -- 172.21.15.175:0/409091601 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5480151990 con 0x7f548006bd60 2024-04-25T09:06:54.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f5487000640 1 -- 172.21.15.175:0/409091601 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5480074a60 con 0x7f548006bd60 2024-04-25T09:06:54.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.868+0000 7f547cc00640 1 -- 172.21.15.175:0/409091601 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f547001e460 con 0x7f548006bd60 2024-04-25T09:06:54.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.872+0000 7f547cc00640 1 --2- 172.21.15.175:0/409091601 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f545c066f90 0x7f545c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:54.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.872+0000 7f547cc00640 1 -- 172.21.15.175:0/409091601 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54700856c0 con 0x7f548006bd60 2024-04-25T09:06:54.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.872+0000 7f5477e00640 1 --2- 172.21.15.175:0/409091601 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f545c066f90 0x7f545c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:54.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.872+0000 7f5477e00640 1 --2- 172.21.15.175:0/409091601 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f545c066f90 0x7f545c069450 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f54680af000 tx=0x7f5468008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:54.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:54.876+0000 7f547cc00640 1 -- 172.21.15.175:0/409091601 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f54700566d0 con 0x7f548006bd60 2024-04-25T09:06:55.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:55.068+0000 7f5487000640 1 -- 172.21.15.175:0/409091601 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f548009aee0 con 0x7f548006bd60 2024-04-25T09:06:55.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:55.068+0000 7f547cc00640 1 -- 172.21.15.175:0/409091601 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5470055fd0 con 0x7f548006bd60 2024-04-25T09:06:55.057 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:06:55.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:55.068+0000 7f5487000640 1 -- 172.21.15.175:0/409091601 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f545c066f90 msgr2=0x7f545c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:55.068+0000 7f5487000640 1 --2- 172.21.15.175:0/409091601 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f545c066f90 0x7f545c069450 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f54680af000 tx=0x7f5468008040 comp rx=0 tx=0).stop 2024-04-25T09:06:55.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:55.068+0000 7f5487000640 1 -- 172.21.15.175:0/409091601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f548006bd60 msgr2=0x7f5480150840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:55.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:55.068+0000 7f5487000640 1 --2- 172.21.15.175:0/409091601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f548006bd60 0x7f5480150840 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f547000d830 tx=0x7f547000dcf0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:55.068+0000 7f5487000640 1 -- 172.21.15.175:0/409091601 shutdown_connections 2024-04-25T09:06:55.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:55.068+0000 7f5487000640 1 --2- 172.21.15.175:0/409091601 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f545c066f90 0x7f545c069450 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:55.068+0000 7f5487000640 1 --2- 172.21.15.175:0/409091601 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54800d0d50 0x7f548015c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:55.068+0000 7f5487000640 1 --2- 172.21.15.175:0/409091601 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5480099a50 0x7f54800c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:55.068+0000 7f5487000640 1 --2- 172.21.15.175:0/409091601 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f548006bd60 0x7f5480150840 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:55.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:55.068+0000 7f5487000640 1 -- 172.21.15.175:0/409091601 >> 172.21.15.175:0/409091601 conn(0x7f54800b3300 msgr2=0x7f548015b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:55.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:55.068+0000 7f5487000640 1 -- 172.21.15.175:0/409091601 shutdown_connections 2024-04-25T09:06:55.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:55.068+0000 7f5487000640 1 -- 172.21.15.175:0/409091601 wait complete. 2024-04-25T09:06:55.077 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:06:55.077 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:06:55.077 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-25T09:06:55.078 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:06:55.078 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:55.078 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:06:55.078 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:06:55.078 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:06:55.078 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:06:55.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:55.078 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-25T09:06:55.088 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:06:55.088 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:06:55.088 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:06:55.088 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:55.088 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:06:55.088 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:55.088 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:06:55.088 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:55.088 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-25T09:06:55.088 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:06:55.089 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:55.089 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-25T09:06:55.089 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:06:55.089 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:55.089 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:06:55.089 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:55.089 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:06:55.089 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42304sec preferred_lft 42304sec 2024-04-25T09:06:55.089 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-25T09:06:55.089 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:55.089 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:06:55.089 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:0d:71:4a:a6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:55.089 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:06:55.089 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:55.089 INFO:teuthology.orchestra.run.smithi175.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:06:55.089 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:55.090 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:06:55.090 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:55.090 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:06:55.090 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:55.090 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:06:55.090 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:06:55.090 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:06:55.090 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:55.090 INFO:teuthology.orchestra.run.smithi175.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:06:55.090 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:06:55.090 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:06:55.090 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:55.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:55.093 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:06:55.149 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:06:55.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:55.151 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-25T09:06:55.203 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-25T09:06:55.203 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:06:55.203 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:06:55.203 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:06:55.203 INFO:teuthology.orchestra.run.smithi175.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:06:55.203 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:06:55.203 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:06:55.203 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:06:55.203 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:06:55.203 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:06:55.204 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:06:55.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:55.204 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:06:55.204 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:06:55.204 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:06:55.204 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:06:55.204 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:06:55.204 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:06:55.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:55.295 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:06:55.348 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:06:55.348 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:06:55.348 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:06:55.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:55.349 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-25T09:06:55.411 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:06:55.411 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:55.460 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:06:55.460 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:06:55.460 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:55.511 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:06:55.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:55.511 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:55.599 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:55.600 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:06:55.600 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:06:55.615 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:55.615 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:06:55.615 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:06:55.615 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:06:55.615 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:06:55.624 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:55.624 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:06:55.624 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:06:55.624 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:06:55.624 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:06:55.624 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:06:55.624 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:06:55.624 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:06:55.628 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:06:55.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:55.628 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:55.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:55.647 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:06:55.703 INFO:teuthology.orchestra.run.smithi175.stdout:client6129 2024-04-25T09:06:55.703 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:06:55.703 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:55.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:55.756 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2024-04-25T09:06:55.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:55.810 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2024-04-25T09:06:55.862 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:06:55.862 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:06:55.862 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:06:55.862 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:06:55.862 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2024-04-25T09:06:55.862 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:06:55.967 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627777 2024-04-25T09:06:55.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:06:55.976 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:56.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.168+0000 7f8a82a00640 1 Processor -- start 2024-04-25T09:06:56.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.168+0000 7f8a82a00640 1 -- start start 2024-04-25T09:06:56.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.168+0000 7f8a82a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8a7c144fc0 0x7f8a7c0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.168+0000 7f8a82a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c1453a0 0x7f8a7c15bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.168+0000 7f8a82a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7c15cd00 con 0x7f8a7c0cc3b0 2024-04-25T09:06:56.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.168+0000 7f8a82a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7c0ce660 con 0x7f8a7c144fc0 2024-04-25T09:06:56.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.168+0000 7f8a82a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c0cc930 con 0x7f8a7c1453a0 2024-04-25T09:06:56.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.172+0000 7f8a80a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f8a7c0cc3b0 0x7f8a7c15f480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:41982/0 (socket says 172.21.15.175:41982) 2024-04-25T09:06:56.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.172+0000 7f8a80a00640 1 -- 172.21.15.175:0/1819424843 learned_addr learned my addr 172.21.15.175:0/1819424843 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:56.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.172+0000 7f8a7b400640 1 --2- 172.21.15.175:0/1819424843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c1453a0 0x7f8a7c15bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.172+0000 7f8a7be00640 1 --2- 172.21.15.175:0/1819424843 >> v2:172.21.15.177:3300/0 conn(0x7f8a7c144fc0 0x7f8a7c0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.172+0000 7f8a7aa00640 1 -- 172.21.15.175:0/1819424843 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802034669 0 0) 0x7f8a7c15cd00 con 0x7f8a7c0cc3b0 2024-04-25T09:06:56.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.172+0000 7f8a7aa00640 1 -- 172.21.15.175:0/1819424843 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a60003530 con 0x7f8a7c0cc3b0 2024-04-25T09:06:56.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.172+0000 7f8a7b400640 1 -- 172.21.15.175:0/1819424843 >> v2:172.21.15.177:3300/0 conn(0x7f8a7c144fc0 msgr2=0x7f8a7c0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.172+0000 7f8a7b400640 1 --2- 172.21.15.175:0/1819424843 >> v2:172.21.15.177:3300/0 conn(0x7f8a7c144fc0 0x7f8a7c0cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.172+0000 7f8a7b400640 1 -- 172.21.15.175:0/1819424843 >> v1:172.21.15.175:6789/0 conn(0x7f8a7c0cc3b0 legacy=0x7f8a7c15f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.172+0000 7f8a7aa00640 1 -- 172.21.15.175:0/1819424843 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4063103913 0 0) 0x7f8a60003530 con 0x7f8a7c0cc3b0 2024-04-25T09:06:56.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.172+0000 7f8a7b400640 1 -- 172.21.15.175:0/1819424843 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7c0ccc10 con 0x7f8a7c1453a0 2024-04-25T09:06:56.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.172+0000 7f8a7b400640 1 --2- 172.21.15.175:0/1819424843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c1453a0 0x7f8a7c15bed0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8a680097c0 tx=0x7f8a6801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c3c4e6d4591753d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a7aa00640 1 -- 172.21.15.175:0/1819424843 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a680b0070 con 0x7f8a7c1453a0 2024-04-25T09:06:56.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a7aa00640 1 -- 172.21.15.175:0/1819424843 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a680ab400 con 0x7f8a7c1453a0 2024-04-25T09:06:56.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a7aa00640 1 -- 172.21.15.175:0/1819424843 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a74001680 con 0x7f8a7c1453a0 2024-04-25T09:06:56.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a82a00640 1 -- 172.21.15.175:0/1819424843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c1453a0 msgr2=0x7f8a7c15bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a82a00640 1 --2- 172.21.15.175:0/1819424843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c1453a0 0x7f8a7c15bed0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8a680097c0 tx=0x7f8a6801c3c0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a82a00640 1 -- 172.21.15.175:0/1819424843 shutdown_connections 2024-04-25T09:06:56.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a82a00640 1 --2- 172.21.15.175:0/1819424843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c1453a0 0x7f8a7c15bed0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a82a00640 1 --2- 172.21.15.175:0/1819424843 >> v2:172.21.15.177:3300/0 conn(0x7f8a7c144fc0 0x7f8a7c0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a82a00640 1 -- 172.21.15.175:0/1819424843 >> 172.21.15.175:0/1819424843 conn(0x7f8a7c067150 msgr2=0x7f8a7c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:56.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a82a00640 1 -- 172.21.15.175:0/1819424843 shutdown_connections 2024-04-25T09:06:56.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a82a00640 1 -- 172.21.15.175:0/1819424843 wait complete. 2024-04-25T09:06:56.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a82a00640 1 Processor -- start 2024-04-25T09:06:56.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a82a00640 1 -- start start 2024-04-25T09:06:56.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a82a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c144fc0 0x7f8a7c0b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a82a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a7c1453a0 0x7f8a7c1f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a82a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a7c15af70 0x7f8a7c13f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a82a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c0cffb0 con 0x7f8a7c1453a0 2024-04-25T09:06:56.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a82a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c0cfe30 con 0x7f8a7c15af70 2024-04-25T09:06:56.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.176+0000 7f8a82a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c1685f0 con 0x7f8a7c144fc0 2024-04-25T09:06:56.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a7b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a7c1453a0 0x7f8a7c1f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a7be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c144fc0 0x7f8a7c0b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a7b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a7c1453a0 0x7f8a7c1f79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34918/0 (socket says 172.21.15.175:34918) 2024-04-25T09:06:56.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a7b400640 1 -- 172.21.15.175:0/367285881 learned_addr learned my addr 172.21.15.175:0/367285881 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:56.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a80a00640 1 --2- 172.21.15.175:0/367285881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a7c15af70 0x7f8a7c13f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a7b400640 1 -- 172.21.15.175:0/367285881 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c144fc0 msgr2=0x7f8a7c0b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a7b400640 1 --2- 172.21.15.175:0/367285881 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c144fc0 0x7f8a7c0b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a7b400640 1 -- 172.21.15.175:0/367285881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a7c15af70 msgr2=0x7f8a7c13f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a7b400640 1 --2- 172.21.15.175:0/367285881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a7c15af70 0x7f8a7c13f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a7b400640 1 -- 172.21.15.175:0/367285881 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7c13c580 con 0x7f8a7c1453a0 2024-04-25T09:06:56.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a7be00640 1 --2- 172.21.15.175:0/367285881 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c144fc0 0x7f8a7c0b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:56.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a7b400640 1 --2- 172.21.15.175:0/367285881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a7c1453a0 0x7f8a7c1f79f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8a6801aa70 tx=0x7f8a68019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a73e00640 1 -- 172.21.15.175:0/367285881 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a680b0040 con 0x7f8a7c1453a0 2024-04-25T09:06:56.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a73e00640 1 -- 172.21.15.175:0/367285881 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a680bc070 con 0x7f8a7c1453a0 2024-04-25T09:06:56.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a73e00640 1 -- 172.21.15.175:0/367285881 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a680b58c0 con 0x7f8a7c1453a0 2024-04-25T09:06:56.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a82a00640 1 -- 172.21.15.175:0/367285881 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a7c15d140 con 0x7f8a7c1453a0 2024-04-25T09:06:56.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a82a00640 1 -- 172.21.15.175:0/367285881 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7c15d700 con 0x7f8a7c1453a0 2024-04-25T09:06:56.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a82a00640 1 -- 172.21.15.175:0/367285881 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a7c074a60 con 0x7f8a7c1453a0 2024-04-25T09:06:56.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.180+0000 7f8a73e00640 1 -- 172.21.15.175:0/367285881 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8a680b3070 con 0x7f8a7c1453a0 2024-04-25T09:06:56.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.184+0000 7f8a73e00640 1 --2- 172.21.15.175:0/367285881 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8a5c066f60 0x7f8a5c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.184+0000 7f8a73e00640 1 -- 172.21.15.175:0/367285881 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a6811f2e0 con 0x7f8a7c1453a0 2024-04-25T09:06:56.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.184+0000 7f8a7be00640 1 --2- 172.21.15.175:0/367285881 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8a5c066f60 0x7f8a5c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.184+0000 7f8a7be00640 1 --2- 172.21.15.175:0/367285881 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8a5c066f60 0x7f8a5c069420 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c06f5e0 tx=0x7f8a6c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.188+0000 7f8a73e00640 1 -- 172.21.15.175:0/367285881 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8a68015fb0 con 0x7f8a7c1453a0 2024-04-25T09:06:56.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.376+0000 7f8a82a00640 1 -- 172.21.15.175:0/367285881 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a7c06d260 con 0x7f8a7c1453a0 2024-04-25T09:06:56.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.376+0000 7f8a73e00640 1 -- 172.21.15.175:0/367285881 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f8a6811f0e0 con 0x7f8a7c1453a0 2024-04-25T09:06:56.367 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:56.367 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2064272902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2064272902},{"type":"v1","addr":"172.21.15.177:6834","nonce":2064272902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5462,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3896280225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3896280225},{"type":"v1","addr":"172.21.15.177:6835","nonce":3896280225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/149812612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":149812612},{"type":"v1","addr":"172.21.15.175:6835","nonce":149812612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:43.704808+0000","modified":"2024-04-25T09:06:46.737698+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1478147147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1478147147},{"type":"v1","addr":"172.21.15.175:6837","nonce":1478147147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:06:56.367 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 32 2024-04-25T09:06:56.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.380+0000 7f8a82a00640 1 -- 172.21.15.175:0/367285881 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8a5c066f60 msgr2=0x7f8a5c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.380+0000 7f8a82a00640 1 --2- 172.21.15.175:0/367285881 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8a5c066f60 0x7f8a5c069420 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c06f5e0 tx=0x7f8a6c00b040 comp rx=0 tx=0).stop 2024-04-25T09:06:56.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.380+0000 7f8a82a00640 1 -- 172.21.15.175:0/367285881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a7c1453a0 msgr2=0x7f8a7c1f79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.380+0000 7f8a82a00640 1 --2- 172.21.15.175:0/367285881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a7c1453a0 0x7f8a7c1f79f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8a6801aa70 tx=0x7f8a68019160 comp rx=0 tx=0).stop 2024-04-25T09:06:56.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.380+0000 7f8a82a00640 1 -- 172.21.15.175:0/367285881 shutdown_connections 2024-04-25T09:06:56.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.380+0000 7f8a82a00640 1 --2- 172.21.15.175:0/367285881 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8a5c066f60 0x7f8a5c069420 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.380+0000 7f8a82a00640 1 --2- 172.21.15.175:0/367285881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a7c15af70 0x7f8a7c13f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.380+0000 7f8a82a00640 1 --2- 172.21.15.175:0/367285881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a7c1453a0 0x7f8a7c1f79f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.380+0000 7f8a82a00640 1 --2- 172.21.15.175:0/367285881 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a7c144fc0 0x7f8a7c0b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.380+0000 7f8a82a00640 1 -- 172.21.15.175:0/367285881 >> 172.21.15.175:0/367285881 conn(0x7f8a7c0cc3b0 msgr2=0x7f8a7c06d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:56.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.380+0000 7f8a82a00640 1 -- 172.21.15.175:0/367285881 shutdown_connections 2024-04-25T09:06:56.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.380+0000 7f8a82a00640 1 -- 172.21.15.175:0/367285881 wait complete. 2024-04-25T09:06:56.389 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T09:06:56.558 INFO:teuthology.orchestra.run.smithi175.stdout:{"message":"","return_code":0} 2024-04-25T09:06:56.558 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:06:56.558 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T09:06:56.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff692c4d080 1 Processor -- start 2024-04-25T09:06:56.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff692c4d080 1 -- start start 2024-04-25T09:06:56.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff692c4d080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b44e1f1740 0x55b44e20dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff692c4d080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b44e1f1b20 0x55b44e17de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff692c4d080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b44e1f2000 0x55b44e20f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff692c4d080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b44e1f2c50 con 0x55b44e1f1b20 2024-04-25T09:06:56.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff692c4d080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b44e0df9f0 con 0x55b44e1f2000 2024-04-25T09:06:56.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff692c4d080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b44e1f2ef0 con 0x55b44e1f1740 2024-04-25T09:06:56.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff68e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b44e1f1b20 0x55b44e17de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff68f200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b44e1f1740 0x55b44e20dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff68e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b44e1f1b20 0x55b44e17de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34932/0 (socket says 172.21.15.175:34932) 2024-04-25T09:06:56.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff68e800640 1 -- 172.21.15.175:0/579364801 learned_addr learned my addr 172.21.15.175:0/579364801 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:56.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff68fc00640 1 --2- 172.21.15.175:0/579364801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b44e1f2000 0x55b44e20f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff68e800640 1 -- 172.21.15.175:0/579364801 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b44e1f1740 msgr2=0x55b44e20dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff68e800640 1 --2- 172.21.15.175:0/579364801 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b44e1f1740 0x55b44e20dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff68e800640 1 -- 172.21.15.175:0/579364801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b44e1f2000 msgr2=0x55b44e20f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff68e800640 1 --2- 172.21.15.175:0/579364801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b44e1f2000 0x55b44e20f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff68e800640 1 -- 172.21.15.175:0/579364801 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b44e211150 con 0x55b44e1f1b20 2024-04-25T09:06:56.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff68e800640 1 --2- 172.21.15.175:0/579364801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b44e1f1b20 0x55b44e17de10 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00b2a0 tx=0x7ff67c00b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e61b820c9b752 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff68d400640 1 -- 172.21.15.175:0/579364801 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c00a040 con 0x55b44e1f1b20 2024-04-25T09:06:56.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff68d400640 1 -- 172.21.15.175:0/579364801 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67c00f620 con 0x55b44e1f1b20 2024-04-25T09:06:56.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff68d400640 1 -- 172.21.15.175:0/579364801 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c00fa10 con 0x55b44e1f1b20 2024-04-25T09:06:56.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff692c4d080 1 -- 172.21.15.175:0/579364801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b44e1f1b20 msgr2=0x55b44e17de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff692c4d080 1 --2- 172.21.15.175:0/579364801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b44e1f1b20 0x55b44e17de10 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff67c00b2a0 tx=0x7ff67c00b760 comp rx=0 tx=0).stop 2024-04-25T09:06:56.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff692c4d080 1 -- 172.21.15.175:0/579364801 shutdown_connections 2024-04-25T09:06:56.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff692c4d080 1 --2- 172.21.15.175:0/579364801 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b44e1f2000 0x55b44e20f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff692c4d080 1 --2- 172.21.15.175:0/579364801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b44e1f1b20 0x55b44e17de10 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff692c4d080 1 --2- 172.21.15.175:0/579364801 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b44e1f1740 0x55b44e20dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff692c4d080 1 -- 172.21.15.175:0/579364801 >> 172.21.15.175:0/579364801 conn(0x55b44e139420 msgr2=0x55b44e1f3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:56.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff692c4d080 1 -- 172.21.15.175:0/579364801 shutdown_connections 2024-04-25T09:06:56.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.616+0000 7ff692c4d080 1 -- 172.21.15.175:0/579364801 wait complete. 2024-04-25T09:06:56.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff692c4d080 1 Processor -- start 2024-04-25T09:06:56.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff692c4d080 1 -- start start 2024-04-25T09:06:56.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff692c4d080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b44e1f1740 0x55b44e20ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff692c4d080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b44e1f1b20 0x55b44e20dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff692c4d080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b44e1f2000 0x55b44e1814c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff692c4d080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b44e2113f0 con 0x55b44e1f1740 2024-04-25T09:06:56.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff692c4d080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b44e1822b0 con 0x55b44e1f1b20 2024-04-25T09:06:56.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff692c4d080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b44e211690 con 0x55b44e1f2000 2024-04-25T09:06:56.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff68f200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b44e1f1740 0x55b44e20ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff68f200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b44e1f1740 0x55b44e20ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34938/0 (socket says 172.21.15.175:34938) 2024-04-25T09:06:56.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff68f200640 1 -- 172.21.15.175:0/1324687462 learned_addr learned my addr 172.21.15.175:0/1324687462 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:56.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff68fc00640 1 --2- 172.21.15.175:0/1324687462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b44e1f2000 0x55b44e1814c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff68e800640 1 --2- 172.21.15.175:0/1324687462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b44e1f1b20 0x55b44e20dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff68f200640 1 -- 172.21.15.175:0/1324687462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b44e1f2000 msgr2=0x55b44e1814c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff68f200640 1 --2- 172.21.15.175:0/1324687462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b44e1f2000 0x55b44e1814c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff68f200640 1 -- 172.21.15.175:0/1324687462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b44e1f1b20 msgr2=0x55b44e20dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff68f200640 1 --2- 172.21.15.175:0/1324687462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b44e1f1b20 0x55b44e20dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff68f200640 1 -- 172.21.15.175:0/1324687462 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b44e213140 con 0x55b44e1f1740 2024-04-25T09:06:56.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff68f200640 1 --2- 172.21.15.175:0/1324687462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b44e1f1740 0x55b44e20ff10 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff6800087f0 tx=0x7ff680008cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff687e00640 1 -- 172.21.15.175:0/1324687462 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff680019070 con 0x55b44e1f1740 2024-04-25T09:06:56.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff687e00640 1 -- 172.21.15.175:0/1324687462 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff680010ba0 con 0x55b44e1f1740 2024-04-25T09:06:56.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff687e00640 1 -- 172.21.15.175:0/1324687462 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff680015450 con 0x55b44e1f1740 2024-04-25T09:06:56.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff692c4d080 1 -- 172.21.15.175:0/1324687462 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b44e2133e0 con 0x55b44e1f1740 2024-04-25T09:06:56.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.620+0000 7ff692c4d080 1 -- 172.21.15.175:0/1324687462 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b44e212e40 con 0x55b44e1f1740 2024-04-25T09:06:56.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff687e00640 1 -- 172.21.15.175:0/1324687462 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff68001c070 con 0x55b44e1f1740 2024-04-25T09:06:56.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff687e00640 1 --2- 172.21.15.175:0/1324687462 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff670065970 0x7ff670067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff687e00640 1 -- 172.21.15.175:0/1324687462 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff680084850 con 0x55b44e1f1740 2024-04-25T09:06:56.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff68e800640 1 --2- 172.21.15.175:0/1324687462 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff670065970 0x7ff670067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff692c4d080 1 --2- 172.21.15.175:0/1324687462 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55b44e20e320 0x55b44e215220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff692c4d080 1 -- 172.21.15.175:0/1324687462 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e58) v9 -- 0x55b44e2ad3d0 con 0x55b44e20e320 2024-04-25T09:06:56.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff68fc00640 1 --2- 172.21.15.175:0/1324687462 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55b44e20e320 0x55b44e215220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff68e800640 1 --2- 172.21.15.175:0/1324687462 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff670065970 0x7ff670067e30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff67c003040 tx=0x7ff67c009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff68fc00640 1 --2- 172.21.15.175:0/1324687462 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55b44e20e320 0x55b44e215220 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff68fc00640 1 -- 172.21.15.175:0/1324687462 <== osd.5 v2:172.21.15.177:6816/3311807078 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+94 (crc 0 0 0) 0x7ff6880b3040 con 0x55b44e20e320 2024-04-25T09:06:56.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff692c4d080 1 -- 172.21.15.175:0/1324687462 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55b44e20e320 msgr2=0x55b44e215220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff692c4d080 1 --2- 172.21.15.175:0/1324687462 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55b44e20e320 0x55b44e215220 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff692c4d080 1 -- 172.21.15.175:0/1324687462 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff670065970 msgr2=0x7ff670067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff692c4d080 1 --2- 172.21.15.175:0/1324687462 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff670065970 0x7ff670067e30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff67c003040 tx=0x7ff67c009000 comp rx=0 tx=0).stop 2024-04-25T09:06:56.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff692c4d080 1 -- 172.21.15.175:0/1324687462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b44e1f1740 msgr2=0x55b44e20ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff692c4d080 1 --2- 172.21.15.175:0/1324687462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b44e1f1740 0x55b44e20ff10 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff6800087f0 tx=0x7ff680008cb0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff68fc00640 1 -- 172.21.15.175:0/1324687462 reap_dead start 2024-04-25T09:06:56.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff692c4d080 1 -- 172.21.15.175:0/1324687462 shutdown_connections 2024-04-25T09:06:56.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff692c4d080 1 -- 172.21.15.175:0/1324687462 >> 172.21.15.175:0/1324687462 conn(0x55b44e139420 msgr2=0x55b44e20ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:56.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff692c4d080 1 -- 172.21.15.175:0/1324687462 shutdown_connections 2024-04-25T09:06:56.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.624+0000 7ff692c4d080 1 -- 172.21.15.175:0/1324687462 wait complete. 2024-04-25T09:06:56.620 INFO:teuthology.orchestra.run.smithi175.stdout:Xfiledir_test 2024-04-25T09:06:56.620 DEBUG:teuthology.orchestra.run.smithi175:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T09:06:56.668 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:06:56.668 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 1099511627777, 2024-04-25T09:06:56.668 INFO:teuthology.orchestra.run.smithi175.stdout: "ancestors": [ 2024-04-25T09:06:56.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:56.669 INFO:teuthology.orchestra.run.smithi175.stdout: "dirino": 1099511627776, 2024-04-25T09:06:56.669 INFO:teuthology.orchestra.run.smithi175.stdout: "dname": "file", 2024-04-25T09:06:56.669 INFO:teuthology.orchestra.run.smithi175.stdout: "version": 2 2024-04-25T09:06:56.669 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:06:56.669 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:06:56.669 INFO:teuthology.orchestra.run.smithi175.stdout: "dirino": 1, 2024-04-25T09:06:56.669 INFO:teuthology.orchestra.run.smithi175.stdout: "dname": "dir_test", 2024-04-25T09:06:56.669 INFO:teuthology.orchestra.run.smithi175.stdout: "version": 4 2024-04-25T09:06:56.669 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:56.669 INFO:teuthology.orchestra.run.smithi175.stdout: ], 2024-04-25T09:06:56.669 INFO:teuthology.orchestra.run.smithi175.stdout: "pool": 9, 2024-04-25T09:06:56.669 INFO:teuthology.orchestra.run.smithi175.stdout: "old_pools": [] 2024-04-25T09:06:56.669 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:06:56.669 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:06:56.673 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2024-04-25T09:06:56.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.772+0000 7f698e0ce080 1 Processor -- start 2024-04-25T09:06:56.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.772+0000 7f698e0ce080 1 -- start start 2024-04-25T09:06:56.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.772+0000 7f698e0ce080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6970002c90 0x559c24828800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559c247a7310 0x559c24796730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559c247a76f0 0x559c24796c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c2470a9f0 con 0x7f6970002c90 2024-04-25T09:06:56.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c2470e950 con 0x559c247a7310 2024-04-25T09:06:56.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c24763430 con 0x559c247a76f0 2024-04-25T09:06:56.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6970002c90 0x559c24828800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6970002c90 0x559c24828800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34960/0 (socket says 172.21.15.175:34960) 2024-04-25T09:06:56.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698b200640 1 -- 172.21.15.175:0/1298549653 learned_addr learned my addr 172.21.15.175:0/1298549653 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:56.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f6983e00640 1 --2- 172.21.15.175:0/1298549653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559c247a7310 0x559c24796730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698bc00640 1 --2- 172.21.15.175:0/1298549653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559c247a76f0 0x559c24796c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698b200640 1 -- 172.21.15.175:0/1298549653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559c247a76f0 msgr2=0x559c24796c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698b200640 1 --2- 172.21.15.175:0/1298549653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559c247a76f0 0x559c24796c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698b200640 1 -- 172.21.15.175:0/1298549653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559c247a7310 msgr2=0x559c24796730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698b200640 1 --2- 172.21.15.175:0/1298549653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559c247a7310 0x559c24796730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698b200640 1 -- 172.21.15.175:0/1298549653 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c247a7c90 con 0x7f6970002c90 2024-04-25T09:06:56.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698b200640 1 --2- 172.21.15.175:0/1298549653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6970002c90 0x559c24828800 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f697c0097f0 tx=0x7f697c005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428fa4d0bedda0a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f6989e00640 1 -- 172.21.15.175:0/1298549653 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c019020 con 0x7f6970002c90 2024-04-25T09:06:56.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f6989e00640 1 -- 172.21.15.175:0/1298549653 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c008da0 con 0x7f6970002c90 2024-04-25T09:06:56.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f6989e00640 1 -- 172.21.15.175:0/1298549653 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c015690 con 0x7f6970002c90 2024-04-25T09:06:56.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 -- 172.21.15.175:0/1298549653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6970002c90 msgr2=0x559c24828800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 --2- 172.21.15.175:0/1298549653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6970002c90 0x559c24828800 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f697c0097f0 tx=0x7f697c005a10 comp rx=0 tx=0).stop 2024-04-25T09:06:56.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 -- 172.21.15.175:0/1298549653 shutdown_connections 2024-04-25T09:06:56.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 --2- 172.21.15.175:0/1298549653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559c247a76f0 0x559c24796c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 --2- 172.21.15.175:0/1298549653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559c247a7310 0x559c24796730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 --2- 172.21.15.175:0/1298549653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6970002c90 0x559c24828800 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 -- 172.21.15.175:0/1298549653 >> 172.21.15.175:0/1298549653 conn(0x559c24792430 msgr2=0x559c24764940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:56.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 -- 172.21.15.175:0/1298549653 shutdown_connections 2024-04-25T09:06:56.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 -- 172.21.15.175:0/1298549653 wait complete. 2024-04-25T09:06:56.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 Processor -- start 2024-04-25T09:06:56.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 -- start start 2024-04-25T09:06:56.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c247a7310 0x559c248d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559c247a76f0 0x559c24827cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6970002c90 0x559c24820d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c247a81d0 con 0x559c247a7310 2024-04-25T09:06:56.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c247a7f30 con 0x7f6970002c90 2024-04-25T09:06:56.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698e0ce080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c247aae80 con 0x559c247a76f0 2024-04-25T09:06:56.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c247a7310 0x559c248d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c247a7310 0x559c248d1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34962/0 (socket says 172.21.15.175:34962) 2024-04-25T09:06:56.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698b200640 1 -- 172.21.15.175:0/1772996984 learned_addr learned my addr 172.21.15.175:0/1772996984 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:56.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f6983e00640 1 --2- 172.21.15.175:0/1772996984 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559c247a76f0 0x559c24827cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.776+0000 7f698bc00640 1 --2- 172.21.15.175:0/1772996984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6970002c90 0x559c24820d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.780+0000 7f698b200640 1 -- 172.21.15.175:0/1772996984 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559c247a76f0 msgr2=0x559c24827cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.780+0000 7f698b200640 1 --2- 172.21.15.175:0/1772996984 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559c247a76f0 0x559c24827cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.780+0000 7f698b200640 1 -- 172.21.15.175:0/1772996984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6970002c90 msgr2=0x559c24820d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.780+0000 7f698b200640 1 --2- 172.21.15.175:0/1772996984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6970002c90 0x559c24820d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.780+0000 7f698b200640 1 -- 172.21.15.175:0/1772996984 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c24821740 con 0x559c247a7310 2024-04-25T09:06:56.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.780+0000 7f698b200640 1 --2- 172.21.15.175:0/1772996984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c247a7310 0x559c248d1b40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f697c015f90 tx=0x7f697c002fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.780+0000 7f6988a00640 1 -- 172.21.15.175:0/1772996984 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c01f640 con 0x559c247a7310 2024-04-25T09:06:56.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.780+0000 7f6988a00640 1 -- 172.21.15.175:0/1772996984 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697c01f800 con 0x559c247a7310 2024-04-25T09:06:56.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.780+0000 7f6988a00640 1 -- 172.21.15.175:0/1772996984 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697c01fbf0 con 0x559c247a7310 2024-04-25T09:06:56.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.780+0000 7f698e0ce080 1 -- 172.21.15.175:0/1772996984 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559c248219e0 con 0x559c247a7310 2024-04-25T09:06:56.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.780+0000 7f698e0ce080 1 -- 172.21.15.175:0/1772996984 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c24821f20 con 0x559c247a7310 2024-04-25T09:06:56.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.780+0000 7f6988a00640 1 -- 172.21.15.175:0/1772996984 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f697c01c020 con 0x559c247a7310 2024-04-25T09:06:56.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.780+0000 7f6988a00640 1 --2- 172.21.15.175:0/1772996984 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6968065970 0x7f6968067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.780+0000 7f6988a00640 1 -- 172.21.15.175:0/1772996984 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f697c086940 con 0x559c247a7310 2024-04-25T09:06:56.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.780+0000 7f6983e00640 1 --2- 172.21.15.175:0/1772996984 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6968065970 0x7f6968067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.780+0000 7f698e0ce080 1 --2- 172.21.15.175:0/1772996984 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x559c24821290 0x559c24822660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.780+0000 7f698e0ce080 1 -- 172.21.15.175:0/1772996984 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58) v9 -- 0x559c248281f0 con 0x559c24821290 2024-04-25T09:06:56.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.784+0000 7f698bc00640 1 --2- 172.21.15.175:0/1772996984 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x559c24821290 0x559c24822660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.784+0000 7f6983e00640 1 --2- 172.21.15.175:0/1772996984 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6968065970 0x7f6968067e30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6974009b30 tx=0x7f69740a6070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.784+0000 7f698bc00640 1 --2- 172.21.15.175:0/1772996984 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x559c24821290 0x559c24822660 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.784+0000 7f698bc00640 1 -- 172.21.15.175:0/1772996984 <== osd.5 v2:172.21.15.177:6816/3311807078 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v58'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6984012040 con 0x559c24821290 2024-04-25T09:06:56.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.784+0000 7f698e0ce080 1 -- 172.21.15.175:0/1772996984 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x559c24821290 msgr2=0x559c24822660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.784+0000 7f698e0ce080 1 --2- 172.21.15.175:0/1772996984 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x559c24821290 0x559c24822660 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.784+0000 7f698e0ce080 1 -- 172.21.15.175:0/1772996984 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6968065970 msgr2=0x7f6968067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.784+0000 7f698e0ce080 1 --2- 172.21.15.175:0/1772996984 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6968065970 0x7f6968067e30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6974009b30 tx=0x7f69740a6070 comp rx=0 tx=0).stop 2024-04-25T09:06:56.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.784+0000 7f698e0ce080 1 -- 172.21.15.175:0/1772996984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c247a7310 msgr2=0x559c248d1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.784+0000 7f698e0ce080 1 --2- 172.21.15.175:0/1772996984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559c247a7310 0x559c248d1b40 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f697c015f90 tx=0x7f697c002fc0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.784+0000 7f698bc00640 1 -- 172.21.15.175:0/1772996984 reap_dead start 2024-04-25T09:06:56.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.784+0000 7f698e0ce080 1 -- 172.21.15.175:0/1772996984 shutdown_connections 2024-04-25T09:06:56.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.784+0000 7f698e0ce080 1 -- 172.21.15.175:0/1772996984 >> 172.21.15.175:0/1772996984 conn(0x559c24792430 msgr2=0x559c24828800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:56.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.784+0000 7f698e0ce080 1 -- 172.21.15.175:0/1772996984 shutdown_connections 2024-04-25T09:06:56.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.784+0000 7f698e0ce080 1 -- 172.21.15.175:0/1772996984 wait complete. 2024-04-25T09:06:56.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:56.779 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2024-04-25T09:06:56.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.968+0000 7f2a2a200640 1 Processor -- start 2024-04-25T09:06:56.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.968+0000 7f2a2a200640 1 -- start start 2024-04-25T09:06:56.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a2a200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a240ca5c0 0x7f2a240caa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a2a200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2406c5f0 con 0x7f2a2415ba00 2024-04-25T09:06:56.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a2a200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a240cdc70 con 0x7f2a240cea30 2024-04-25T09:06:56.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a2a200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240caf60 con 0x7f2a240ca5c0 2024-04-25T09:06:56.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a23400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f2a2415ba00 0x7f2a2406bb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:42010/0 (socket says 172.21.15.175:42010) 2024-04-25T09:06:56.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a23400640 1 -- 172.21.15.175:0/2401950596 learned_addr learned my addr 172.21.15.175:0/2401950596 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:06:56.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a1aa00640 1 --2- 172.21.15.175:0/2401950596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a240ca5c0 0x7f2a240caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a22a00640 1 -- 172.21.15.175:0/2401950596 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516971976 0 0) 0x7f2a2406c5f0 con 0x7f2a2415ba00 2024-04-25T09:06:56.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a22a00640 1 -- 172.21.15.175:0/2401950596 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a08003530 con 0x7f2a2415ba00 2024-04-25T09:06:56.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a22a00640 1 -- 172.21.15.175:0/2401950596 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3376276822 0 0) 0x7f2a08003530 con 0x7f2a2415ba00 2024-04-25T09:06:56.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a22a00640 1 -- 172.21.15.175:0/2401950596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a240ca5c0 msgr2=0x7f2a240caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a22a00640 1 --2- 172.21.15.175:0/2401950596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a240ca5c0 0x7f2a240caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a22a00640 1 -- 172.21.15.175:0/2401950596 >> v1:172.21.15.177:6789/0 conn(0x7f2a240cea30 legacy=0x7f2a240ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a22a00640 1 -- 172.21.15.175:0/2401950596 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a240cdf50 con 0x7f2a2415ba00 2024-04-25T09:06:56.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a22a00640 1 -- 172.21.15.175:0/2401950596 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f2a14001a00 con 0x7f2a2415ba00 2024-04-25T09:06:56.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a22a00640 1 -- 172.21.15.175:0/2401950596 >> v1:172.21.15.175:6789/0 conn(0x7f2a2415ba00 legacy=0x7f2a2406bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a22a00640 1 --2- 172.21.15.175:0/2401950596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a080039f0 0x7f2a08003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a22a00640 1 --2- 172.21.15.175:0/2401950596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a08004810 0x7f2a08004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a22a00640 1 --2- 172.21.15.175:0/2401950596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a240ca5c0 0x7f2a08005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a22a00640 1 -- 172.21.15.175:0/2401950596 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0800bb60 con 0x7f2a080039f0 2024-04-25T09:06:56.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a22a00640 1 -- 172.21.15.175:0/2401950596 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0800bce0 con 0x7f2a08004810 2024-04-25T09:06:56.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a22a00640 1 -- 172.21.15.175:0/2401950596 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0800bee0 con 0x7f2a240ca5c0 2024-04-25T09:06:56.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a23400640 1 --2- 172.21.15.175:0/2401950596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a080039f0 0x7f2a08003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a23e00640 1 --2- 172.21.15.175:0/2401950596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a240ca5c0 0x7f2a08005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a1aa00640 1 --2- 172.21.15.175:0/2401950596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a08004810 0x7f2a08004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a23400640 1 -- 172.21.15.175:0/2401950596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a240ca5c0 msgr2=0x7f2a08005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a23400640 1 --2- 172.21.15.175:0/2401950596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a240ca5c0 0x7f2a08005280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a23400640 1 -- 172.21.15.175:0/2401950596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a08004810 msgr2=0x7f2a08004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a23400640 1 --2- 172.21.15.175:0/2401950596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a08004810 0x7f2a08004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.972+0000 7f2a23400640 1 -- 172.21.15.175:0/2401950596 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a08003530 con 0x7f2a080039f0 2024-04-25T09:06:56.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.976+0000 7f2a23400640 1 --2- 172.21.15.175:0/2401950596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a080039f0 0x7f2a08003e10 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400a770 tx=0x7f2a1401d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e81d6c1e26e0d15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.976+0000 7f2a22a00640 1 -- 172.21.15.175:0/2401950596 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1400a390 con 0x7f2a080039f0 2024-04-25T09:06:56.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.976+0000 7f2a22a00640 1 -- 172.21.15.175:0/2401950596 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a140ad650 con 0x7f2a080039f0 2024-04-25T09:06:56.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.976+0000 7f2a22a00640 1 -- 172.21.15.175:0/2401950596 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a140ada40 con 0x7f2a080039f0 2024-04-25T09:06:56.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.976+0000 7f2a2a200640 1 -- 172.21.15.175:0/2401950596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a080039f0 msgr2=0x7f2a08003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.976+0000 7f2a2a200640 1 --2- 172.21.15.175:0/2401950596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a080039f0 0x7f2a08003e10 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400a770 tx=0x7f2a1401d2a0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.976+0000 7f2a23e00640 1 -- 172.21.15.175:0/2401950596 reap_dead start 2024-04-25T09:06:56.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.976+0000 7f2a2a200640 1 -- 172.21.15.175:0/2401950596 shutdown_connections 2024-04-25T09:06:56.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.976+0000 7f2a2a200640 1 -- 172.21.15.175:0/2401950596 >> 172.21.15.175:0/2401950596 conn(0x7f2a240cc9f0 msgr2=0x7f2a240cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:56.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.976+0000 7f2a2a200640 1 -- 172.21.15.175:0/2401950596 shutdown_connections 2024-04-25T09:06:56.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.976+0000 7f2a2a200640 1 -- 172.21.15.175:0/2401950596 wait complete. 2024-04-25T09:06:56.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.976+0000 7f2a2a200640 1 Processor -- start 2024-04-25T09:06:56.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.976+0000 7f2a2a200640 1 -- start start 2024-04-25T09:06:56.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a2a200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a080039f0 0x7f2a24150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a2a200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a24150d50 0x7f2a240c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a2a200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a2415e270 0x7f2a2415e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a2a200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2406ae70 con 0x7f2a2415e270 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a2a200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240cadb0 con 0x7f2a080039f0 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a2a200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240ace00 con 0x7f2a24150d50 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a23e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a2415e270 0x7f2a2415e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a23e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a2415e270 0x7f2a2415e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34978/0 (socket says 172.21.15.175:34978) 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a23e00640 1 -- 172.21.15.175:0/1022033527 learned_addr learned my addr 172.21.15.175:0/1022033527 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a23e00640 1 -- 172.21.15.175:0/1022033527 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a24150d50 msgr2=0x7f2a240c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a23e00640 1 --2- 172.21.15.175:0/1022033527 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a24150d50 0x7f2a240c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a23e00640 1 -- 172.21.15.175:0/1022033527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a080039f0 msgr2=0x7f2a24150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a23e00640 1 --2- 172.21.15.175:0/1022033527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a080039f0 0x7f2a24150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a23e00640 1 -- 172.21.15.175:0/1022033527 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a241515a0 con 0x7f2a2415e270 2024-04-25T09:06:56.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a23e00640 1 --2- 172.21.15.175:0/1022033527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a2415e270 0x7f2a2415e6f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2a2409e020 tx=0x7f2a1c00e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a1be00640 1 -- 172.21.15.175:0/1022033527 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c019070 con 0x7f2a2415e270 2024-04-25T09:06:56.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a1be00640 1 -- 172.21.15.175:0/1022033527 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c007e30 con 0x7f2a2415e270 2024-04-25T09:06:56.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a2a200640 1 -- 172.21.15.175:0/1022033527 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a240c5820 con 0x7f2a2415e270 2024-04-25T09:06:56.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a1be00640 1 -- 172.21.15.175:0/1022033527 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c003600 con 0x7f2a2415e270 2024-04-25T09:06:56.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a2a200640 1 -- 172.21.15.175:0/1022033527 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a240c5de0 con 0x7f2a2415e270 2024-04-25T09:06:56.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.980+0000 7f2a1be00640 1 -- 172.21.15.175:0/1022033527 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2a1c01c070 con 0x7f2a2415e270 2024-04-25T09:06:56.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a1be00640 1 --2- 172.21.15.175:0/1022033527 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2a00066f90 0x7f2a00069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a1be00640 1 -- 172.21.15.175:0/1022033527 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a1c0842e0 con 0x7f2a2415e270 2024-04-25T09:06:56.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a23400640 1 --2- 172.21.15.175:0/1022033527 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2a00066f90 0x7f2a00069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a2d719000 1 Processor -- start 2024-04-25T09:06:56.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a2d719000 1 -- start start 2024-04-25T09:06:56.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a23400640 1 --2- 172.21.15.175:0/1022033527 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2a00066f90 0x7f2a00069450 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400a770 tx=0x7f2a240ce120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a2d719000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 0x555eea89f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a2d719000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea89fad0 0x555eea8839d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a2d719000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea883f10 0x555eea8842f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a2d719000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eea6a2fd0 con 0x555eea89f1b0 2024-04-25T09:06:56.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a2d719000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eea62b170 con 0x555eea883f10 2024-04-25T09:06:56.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a2d719000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x555eea69f070 con 0x555eea89fad0 2024-04-25T09:06:56.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a23400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 0x555eea89f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a23400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 0x555eea89f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34982/0 (socket says 172.21.15.175:34982) 2024-04-25T09:06:56.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a23400640 1 -- 172.21.15.175:0/1326632531 learned_addr learned my addr 172.21.15.175:0/1326632531 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:56.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a1aa00640 1 --2- 172.21.15.175:0/1326632531 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea89fad0 0x555eea8839d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a23e00640 1 --2- 172.21.15.175:0/1326632531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea883f10 0x555eea8842f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a23400640 1 -- 172.21.15.175:0/1326632531 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea89fad0 msgr2=0x555eea8839d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a23400640 1 --2- 172.21.15.175:0/1326632531 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea89fad0 0x555eea8839d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a23400640 1 -- 172.21.15.175:0/1326632531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea883f10 msgr2=0x555eea8842f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a23400640 1 --2- 172.21.15.175:0/1326632531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea883f10 0x555eea8842f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a23400640 1 -- 172.21.15.175:0/1326632531 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555eea6e9d20 con 0x555eea89f1b0 2024-04-25T09:06:56.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a1aa00640 1 --2- 172.21.15.175:0/1326632531 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea89fad0 0x555eea8839d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:56.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a23400640 1 --2- 172.21.15.175:0/1326632531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 0x555eea89f590 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2a1401d2e0 tx=0x7f2a140a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd12badfdd0e0798 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a13e00640 1 -- 172.21.15.175:0/1326632531 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a140b2040 con 0x555eea89f1b0 2024-04-25T09:06:56.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a13e00640 1 -- 172.21.15.175:0/1326632531 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a140ad800 con 0x555eea89f1b0 2024-04-25T09:06:56.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.984+0000 7f2a13e00640 1 -- 172.21.15.175:0/1326632531 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a140b8470 con 0x555eea89f1b0 2024-04-25T09:06:56.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 -- 172.21.15.175:0/1326632531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 msgr2=0x555eea89f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 --2- 172.21.15.175:0/1326632531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 0x555eea89f590 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2a1401d2e0 tx=0x7f2a140a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:56.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 -- 172.21.15.175:0/1326632531 shutdown_connections 2024-04-25T09:06:56.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 --2- 172.21.15.175:0/1326632531 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea883f10 0x555eea8842f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 --2- 172.21.15.175:0/1326632531 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea89fad0 0x555eea8839d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 --2- 172.21.15.175:0/1326632531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 0x555eea89f590 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 -- 172.21.15.175:0/1326632531 >> 172.21.15.175:0/1326632531 conn(0x555eea85b710 msgr2=0x555eea85baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:56.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 -- 172.21.15.175:0/1326632531 shutdown_connections 2024-04-25T09:06:56.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 -- 172.21.15.175:0/1326632531 wait complete. 2024-04-25T09:06:56.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 -- start start 2024-04-25T09:06:56.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 Processor -- start 2024-04-25T09:06:56.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea883f10 0x555eea8a6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea89f1b0 0x555eea8a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89fad0 0x555eea8842f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eea760c10 con 0x555eea89fad0 2024-04-25T09:06:56.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eea65d680 con 0x555eea883f10 2024-04-25T09:06:56.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x555eea6a7600 con 0x555eea89f1b0 2024-04-25T09:06:56.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 10 client.0 _ll_register_callbacks cb 0x555eea758080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:56.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a23e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89fad0 0x555eea8842f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a23e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89fad0 0x555eea8842f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34986/0 (socket says 172.21.15.175:34986) 2024-04-25T09:06:56.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a23e00640 1 -- 172.21.15.175:0/3766367292 learned_addr learned my addr 172.21.15.175:0/3766367292 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:56.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a23400640 1 --2- 172.21.15.175:0/3766367292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea883f10 0x555eea8a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a1aa00640 1 --2- 172.21.15.175:0/3766367292 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea89f1b0 0x555eea8a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a23e00640 1 -- 172.21.15.175:0/3766367292 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea89f1b0 msgr2=0x555eea8a6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a23e00640 1 --2- 172.21.15.175:0/3766367292 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea89f1b0 0x555eea8a6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a23e00640 1 -- 172.21.15.175:0/3766367292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea883f10 msgr2=0x555eea8a6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:56.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a23e00640 1 --2- 172.21.15.175:0/3766367292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea883f10 0x555eea8a6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a23e00640 1 -- 172.21.15.175:0/3766367292 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555eea67ad30 con 0x555eea89fad0 2024-04-25T09:06:56.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a23e00640 1 --2- 172.21.15.175:0/3766367292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89fad0 0x555eea8842f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c0050a0 tx=0x7f2a1c054c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be32f4ed0e17818 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:56.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a10c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:06:56.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a10c00640 1 -- 172.21.15.175:0/3766367292 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c051250 con 0x555eea89fad0 2024-04-25T09:06:56.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a10c00640 1 -- 172.21.15.175:0/3766367292 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a1c05ce60 con 0x555eea89fad0 2024-04-25T09:06:56.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 -- 172.21.15.175:0/3766367292 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2a140ad800 con 0x555eea89fad0 2024-04-25T09:06:56.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a10c00640 1 -- 172.21.15.175:0/3766367292 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a1c0513f0 con 0x555eea89fad0 2024-04-25T09:06:56.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 10 client.6162 fetch_fsmap learned FSMap version 32 2024-04-25T09:06:56.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 -- 172.21.15.175:0/3766367292 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x555eea62b3c0 con 0x555eea89fad0 2024-04-25T09:06:56.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a10c00640 1 -- 172.21.15.175:0/3766367292 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a140ad800 con 0x555eea89fad0 2024-04-25T09:06:56.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a10c00640 1 -- 172.21.15.175:0/3766367292 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2a1c068ba0 con 0x555eea89fad0 2024-04-25T09:06:56.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 10 client.6162 fetch_fsmap finished waiting for FSMap version 32 2024-04-25T09:06:56.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 10 client.6162 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:06:56.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 20 client.6162 populate_metadata read hostname 'smithi175' 2024-04-25T09:06:56.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 --2- 172.21.15.175:0/3766367292 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x555eea885090 0x555eea885470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:56.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 4 client.6162 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:56.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.988+0000 7f2a2d719000 1 -- 172.21.15.175:0/3766367292 --> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555eea63ee00 con 0x555eea885090 2024-04-25T09:06:56.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.992+0000 7f2a23400640 1 --2- 172.21.15.175:0/3766367292 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x555eea885090 0x555eea885470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:56.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.992+0000 7f2a23400640 1 --2- 172.21.15.175:0/3766367292 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x555eea885090 0x555eea885470 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76766d32581e29db server_cookie=d8bdac4635ff4eb1 in_seq=0 out_seq=0 2024-04-25T09:06:56.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.992+0000 7f2a10c00640 10 client.6162 ms_handle_connect on v2:172.21.15.175:6836/1478147147 2024-04-25T09:06:56.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.992+0000 7f2a10c00640 1 -- 172.21.15.175:0/3766367292 <== mds.0 v2:172.21.15.175:6836/1478147147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555eea63ee00 con 0x555eea885090 2024-04-25T09:06:56.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.992+0000 7f2a10c00640 10 client.6162 handle_command_reply: tid=0 2024-04-25T09:06:56.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.992+0000 7f2a2d719000 1 client.6162 shutdown 2024-04-25T09:06:56.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.992+0000 7f2a2d719000 1 -- 172.21.15.175:0/3766367292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89fad0 msgr2=0x555eea8842f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:56.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.992+0000 7f2a2d719000 1 --2- 172.21.15.175:0/3766367292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89fad0 0x555eea8842f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c0050a0 tx=0x7f2a1c054c60 comp rx=0 tx=0).stop 2024-04-25T09:06:56.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.992+0000 7f2a2d719000 1 -- 172.21.15.175:0/3766367292 shutdown_connections 2024-04-25T09:06:56.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.992+0000 7f2a2d719000 1 --2- 172.21.15.175:0/3766367292 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x555eea885090 0x555eea885470 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.992+0000 7f2a2d719000 1 --2- 172.21.15.175:0/3766367292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89fad0 0x555eea8842f0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.992+0000 7f2a2d719000 1 --2- 172.21.15.175:0/3766367292 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea89f1b0 0x555eea8a6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.992+0000 7f2a2d719000 1 --2- 172.21.15.175:0/3766367292 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea883f10 0x555eea8a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:56.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.992+0000 7f2a10c00640 0 client.6162 ms_handle_reset on v2:172.21.15.175:6836/1478147147 2024-04-25T09:06:56.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.992+0000 7f2a2d719000 1 -- 172.21.15.175:0/3766367292 >> 172.21.15.175:0/3766367292 conn(0x555eea85b710 msgr2=0x555eea853950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:56.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.992+0000 7f2a2d719000 1 -- 172.21.15.175:0/3766367292 shutdown_connections 2024-04-25T09:06:56.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.992+0000 7f2a2d719000 1 -- 172.21.15.175:0/3766367292 wait complete. 2024-04-25T09:06:56.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:56.992+0000 7f2a2d719000 20 client.6162 trim_cache size 0 max 16384 2024-04-25T09:06:56.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a2d719000 1 Processor -- start 2024-04-25T09:06:56.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a2d719000 1 -- start start 2024-04-25T09:06:57.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a2d719000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea85b710 0x555eea89d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a2d719000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea883f10 0x555eea89da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a2d719000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 0x555eea89dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a2d719000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a24203ac0 con 0x555eea89f1b0 2024-04-25T09:06:57.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a2d719000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2406f260 con 0x555eea883f10 2024-04-25T09:06:57.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a2d719000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240c4bd0 con 0x555eea85b710 2024-04-25T09:06:57.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a23e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 0x555eea89dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a23e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 0x555eea89dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34990/0 (socket says 172.21.15.175:34990) 2024-04-25T09:06:57.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a23e00640 1 -- 172.21.15.175:0/4052854704 learned_addr learned my addr 172.21.15.175:0/4052854704 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:57.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a23e00640 1 -- 172.21.15.175:0/4052854704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea85b710 msgr2=0x555eea89d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a23e00640 1 --2- 172.21.15.175:0/4052854704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea85b710 0x555eea89d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a23e00640 1 -- 172.21.15.175:0/4052854704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea883f10 msgr2=0x555eea89da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a23e00640 1 --2- 172.21.15.175:0/4052854704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea883f10 0x555eea89da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a23e00640 1 -- 172.21.15.175:0/4052854704 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555eea7250f0 con 0x555eea89f1b0 2024-04-25T09:06:57.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a23e00640 1 --2- 172.21.15.175:0/4052854704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 0x555eea89dfb0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009010 tx=0x7f2a1c056000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13bed9c55e9b597f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a13400640 1 -- 172.21.15.175:0/4052854704 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c051250 con 0x555eea89f1b0 2024-04-25T09:06:57.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a13400640 1 -- 172.21.15.175:0/4052854704 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c058d30 con 0x555eea89f1b0 2024-04-25T09:06:57.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a13400640 1 -- 172.21.15.175:0/4052854704 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c050e80 con 0x555eea89f1b0 2024-04-25T09:06:57.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a2d719000 1 -- 172.21.15.175:0/4052854704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 msgr2=0x555eea89dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a2d719000 1 --2- 172.21.15.175:0/4052854704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 0x555eea89dfb0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009010 tx=0x7f2a1c056000 comp rx=0 tx=0).stop 2024-04-25T09:06:57.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a2d719000 1 -- 172.21.15.175:0/4052854704 shutdown_connections 2024-04-25T09:06:57.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a2d719000 1 --2- 172.21.15.175:0/4052854704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 0x555eea89dfb0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a2d719000 1 --2- 172.21.15.175:0/4052854704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea883f10 0x555eea89da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a2d719000 1 --2- 172.21.15.175:0/4052854704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea85b710 0x555eea89d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a2d719000 1 -- 172.21.15.175:0/4052854704 >> 172.21.15.175:0/4052854704 conn(0x555eea8acd20 msgr2=0x555eea8835a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:57.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a2d719000 1 -- 172.21.15.175:0/4052854704 shutdown_connections 2024-04-25T09:06:57.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.008+0000 7f2a2d719000 1 -- 172.21.15.175:0/4052854704 wait complete. 2024-04-25T09:06:57.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a2d719000 1 -- start start 2024-04-25T09:06:57.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a2d719000 1 Processor -- start 2024-04-25T09:06:57.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a2d719000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea85b710 0x555eea856360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a2d719000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea883f10 0x555eea855020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a2d719000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 0x555eea855560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a2d719000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eea666860 con 0x555eea89f1b0 2024-04-25T09:06:57.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a2d719000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2406ec60 con 0x555eea85b710 2024-04-25T09:06:57.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a2d719000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x555eea85ed50 con 0x555eea883f10 2024-04-25T09:06:57.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a2d719000 10 client.0 _ll_register_callbacks cb 0x555eea640b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:57.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a23e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 0x555eea855560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a23e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 0x555eea855560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35000/0 (socket says 172.21.15.175:35000) 2024-04-25T09:06:57.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a23e00640 1 -- 172.21.15.175:0/292785282 learned_addr learned my addr 172.21.15.175:0/292785282 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:57.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a1aa00640 1 --2- 172.21.15.175:0/292785282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea883f10 0x555eea855020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a23400640 1 --2- 172.21.15.175:0/292785282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea85b710 0x555eea856360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a23e00640 1 -- 172.21.15.175:0/292785282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea883f10 msgr2=0x555eea855020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a23e00640 1 --2- 172.21.15.175:0/292785282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea883f10 0x555eea855020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a23e00640 1 -- 172.21.15.175:0/292785282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea85b710 msgr2=0x555eea856360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a23e00640 1 --2- 172.21.15.175:0/292785282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea85b710 0x555eea856360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a23e00640 1 -- 172.21.15.175:0/292785282 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555eea637d20 con 0x555eea89f1b0 2024-04-25T09:06:57.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a23400640 1 --2- 172.21.15.175:0/292785282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea85b710 0x555eea856360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:57.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a23e00640 1 --2- 172.21.15.175:0/292785282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 0x555eea855560 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c068fd0 tx=0x7f2a1c0826d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39838d03f1308d73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a10c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:06:57.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a10c00640 1 -- 172.21.15.175:0/292785282 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c051250 con 0x555eea89f1b0 2024-04-25T09:06:57.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a10c00640 1 -- 172.21.15.175:0/292785282 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a1c05ce60 con 0x555eea89f1b0 2024-04-25T09:06:57.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a2d719000 1 -- 172.21.15.175:0/292785282 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2a1c058d30 con 0x555eea89f1b0 2024-04-25T09:06:57.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a10c00640 1 -- 172.21.15.175:0/292785282 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a1c062050 con 0x555eea89f1b0 2024-04-25T09:06:57.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a2d719000 10 client.6168 fetch_fsmap learned FSMap version 32 2024-04-25T09:06:57.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a2d719000 1 -- 172.21.15.175:0/292785282 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x555eea64a0c0 con 0x555eea89f1b0 2024-04-25T09:06:57.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a10c00640 1 -- 172.21.15.175:0/292785282 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c058d30 con 0x555eea89f1b0 2024-04-25T09:06:57.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a10c00640 1 -- 172.21.15.175:0/292785282 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2a1c065020 con 0x555eea89f1b0 2024-04-25T09:06:57.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a2d719000 10 client.6168 fetch_fsmap finished waiting for FSMap version 32 2024-04-25T09:06:57.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a2d719000 10 client.6168 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:06:57.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a2d719000 20 client.6168 populate_metadata read hostname 'smithi175' 2024-04-25T09:06:57.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a2d719000 1 --2- 172.21.15.175:0/292785282 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x555eea89fad0 0x555eea8bd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a2d719000 4 client.6168 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-04-25T09:06:57.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a2d719000 1 -- 172.21.15.175:0/292785282 --> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) v1 -- 0x555eea6b0510 con 0x555eea89fad0 2024-04-25T09:06:57.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a23400640 1 --2- 172.21.15.175:0/292785282 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x555eea89fad0 0x555eea8bd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a23400640 1 --2- 172.21.15.175:0/292785282 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x555eea89fad0 0x555eea8bd470 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=627fd1d3e154959 server_cookie=86478b0f6cd97643 in_seq=0 out_seq=0 2024-04-25T09:06:57.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.012+0000 7f2a10c00640 10 client.6168 ms_handle_connect on v2:172.21.15.175:6836/1478147147 2024-04-25T09:06:57.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a10c00640 1 -- 172.21.15.175:0/292785282 <== mds.0 v2:172.21.15.175:6836/1478147147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555eea6b0510 con 0x555eea89fad0 2024-04-25T09:06:57.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a10c00640 10 client.6168 handle_command_reply: tid=0 2024-04-25T09:06:57.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2d719000 1 client.6168 shutdown 2024-04-25T09:06:57.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2d719000 1 -- 172.21.15.175:0/292785282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 msgr2=0x555eea855560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2d719000 1 --2- 172.21.15.175:0/292785282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 0x555eea855560 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c068fd0 tx=0x7f2a1c0826d0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2d719000 1 -- 172.21.15.175:0/292785282 shutdown_connections 2024-04-25T09:06:57.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2d719000 1 --2- 172.21.15.175:0/292785282 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x555eea89fad0 0x555eea8bd470 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2d719000 1 --2- 172.21.15.175:0/292785282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555eea89f1b0 0x555eea855560 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2d719000 1 --2- 172.21.15.175:0/292785282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555eea883f10 0x555eea855020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2d719000 1 --2- 172.21.15.175:0/292785282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555eea85b710 0x555eea856360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a10c00640 0 client.6168 ms_handle_reset on v2:172.21.15.175:6836/1478147147 2024-04-25T09:06:57.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2d719000 1 -- 172.21.15.175:0/292785282 >> 172.21.15.175:0/292785282 conn(0x555eea8acd20 msgr2=0x555eea859ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:57.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2d719000 1 -- 172.21.15.175:0/292785282 shutdown_connections 2024-04-25T09:06:57.011 INFO:tasks.ceph.mds.a.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f3260800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6129=0-4194304@1} caps={6129=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6129 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x560f56c87b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:06:57.012 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2d719000 1 -- 172.21.15.175:0/292785282 wait complete. 2024-04-25T09:06:57.012 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2d719000 20 client.6168 trim_cache size 0 max 16384 2024-04-25T09:06:57.012 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:06:57.012 INFO:teuthology.orchestra.run.smithi175.stdout: "return_code": 0, 2024-04-25T09:06:57.012 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_tag": "3a2e11dc-3973-4ad9-b8b0-3280169fbc8f", 2024-04-25T09:06:57.012 INFO:teuthology.orchestra.run.smithi175.stdout: "mode": "asynchronous" 2024-04-25T09:06:57.012 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:06:57.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2a200640 1 -- 172.21.15.175:0/1022033527 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2a00066f90 msgr2=0x7f2a00069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2a200640 1 --2- 172.21.15.175:0/1022033527 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2a00066f90 0x7f2a00069450 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400a770 tx=0x7f2a240ce120 comp rx=0 tx=0).stop 2024-04-25T09:06:57.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2a200640 1 -- 172.21.15.175:0/1022033527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a2415e270 msgr2=0x7f2a2415e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2a200640 1 --2- 172.21.15.175:0/1022033527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a2415e270 0x7f2a2415e6f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f2a2409e020 tx=0x7f2a1c00e8a0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2a200640 1 -- 172.21.15.175:0/1022033527 shutdown_connections 2024-04-25T09:06:57.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2a200640 1 --2- 172.21.15.175:0/1022033527 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2a00066f90 0x7f2a00069450 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2a200640 1 --2- 172.21.15.175:0/1022033527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a2415e270 0x7f2a2415e6f0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2a200640 1 --2- 172.21.15.175:0/1022033527 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a24150d50 0x7f2a240c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2a200640 1 --2- 172.21.15.175:0/1022033527 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a080039f0 0x7f2a24150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2a200640 1 -- 172.21.15.175:0/1022033527 >> 172.21.15.175:0/1022033527 conn(0x7f2a240cc9f0 msgr2=0x7f2a241607c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:57.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2a200640 1 -- 172.21.15.175:0/1022033527 shutdown_connections 2024-04-25T09:06:57.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.016+0000 7f2a2a200640 1 -- 172.21.15.175:0/1022033527 wait complete. 2024-04-25T09:06:57.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:57.025 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T09:06:57.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.172+0000 7f124d600640 1 Processor -- start 2024-04-25T09:06:57.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.172+0000 7f124d600640 1 -- start start 2024-04-25T09:06:57.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.172+0000 7f124d600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1248161360 0x7f12480ad990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.172+0000 7f124d600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f12480712d0 0x7f12480716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.172+0000 7f124d600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1248071c20 con 0x7f12480ae660 2024-04-25T09:06:57.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.172+0000 7f124d600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12480ae250 con 0x7f1248161360 2024-04-25T09:06:57.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.172+0000 7f124d600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f124806f0e0 con 0x7f12480712d0 2024-04-25T09:06:57.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.172+0000 7f1246a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1248161360 0x7f12480ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.172+0000 7f1246a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1248161360 0x7f12480ad990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35006/0 (socket says 172.21.15.175:35006) 2024-04-25T09:06:57.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.172+0000 7f1246000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f12480ae660 0x7f124806e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:42014/0 (socket says 172.21.15.175:42014) 2024-04-25T09:06:57.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.172+0000 7f1246a00640 1 -- 172.21.15.175:0/3309247437 learned_addr learned my addr 172.21.15.175:0/3309247437 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:57.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.172+0000 7f1247400640 1 --2- 172.21.15.175:0/3309247437 >> v2:172.21.15.177:3300/0 conn(0x7f12480712d0 0x7f12480716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.172+0000 7f1246a00640 1 -- 172.21.15.175:0/3309247437 >> v2:172.21.15.177:3300/0 conn(0x7f12480712d0 msgr2=0x7f12480716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.172+0000 7f1246a00640 1 --2- 172.21.15.175:0/3309247437 >> v2:172.21.15.177:3300/0 conn(0x7f12480712d0 0x7f12480716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.172+0000 7f1246a00640 1 -- 172.21.15.175:0/3309247437 >> v1:172.21.15.175:6789/0 conn(0x7f12480ae660 legacy=0x7f124806e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.172+0000 7f1246a00640 1 -- 172.21.15.175:0/3309247437 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12480adf70 con 0x7f1248161360 2024-04-25T09:06:57.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.172+0000 7f1247400640 1 --2- 172.21.15.175:0/3309247437 >> v2:172.21.15.177:3300/0 conn(0x7f12480712d0 0x7f12480716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:57.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.176+0000 7f1246a00640 1 --2- 172.21.15.175:0/3309247437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1248161360 0x7f12480ad990 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f12480af000 tx=0x7f123801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b55a48739f79f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.176+0000 7f1245600640 1 -- 172.21.15.175:0/3309247437 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12380a57f0 con 0x7f1248161360 2024-04-25T09:06:57.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.176+0000 7f1245600640 1 -- 172.21.15.175:0/3309247437 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12380a5990 con 0x7f1248161360 2024-04-25T09:06:57.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.176+0000 7f1245600640 1 -- 172.21.15.175:0/3309247437 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12380a5d60 con 0x7f1248161360 2024-04-25T09:06:57.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.176+0000 7f124d600640 1 -- 172.21.15.175:0/3309247437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1248161360 msgr2=0x7f12480ad990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.176+0000 7f124d600640 1 --2- 172.21.15.175:0/3309247437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1248161360 0x7f12480ad990 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f12480af000 tx=0x7f123801c930 comp rx=0 tx=0).stop 2024-04-25T09:06:57.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.176+0000 7f124d600640 1 -- 172.21.15.175:0/3309247437 shutdown_connections 2024-04-25T09:06:57.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.176+0000 7f124d600640 1 --2- 172.21.15.175:0/3309247437 >> v2:172.21.15.177:3300/0 conn(0x7f12480712d0 0x7f12480716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.176+0000 7f124d600640 1 --2- 172.21.15.175:0/3309247437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1248161360 0x7f12480ad990 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.176+0000 7f124d600640 1 -- 172.21.15.175:0/3309247437 >> 172.21.15.175:0/3309247437 conn(0x7f124806ac50 msgr2=0x7f124806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:57.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.176+0000 7f124d600640 1 -- 172.21.15.175:0/3309247437 shutdown_connections 2024-04-25T09:06:57.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.176+0000 7f124d600640 1 -- 172.21.15.175:0/3309247437 wait complete. 2024-04-25T09:06:57.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f124d600640 1 Processor -- start 2024-04-25T09:06:57.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f124d600640 1 -- start start 2024-04-25T09:06:57.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f124d600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12480712d0 0x7f1248157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f124d600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12480ae660 0x7f1248158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f124d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1248161360 0x7f1248147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f124d600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1248072110 con 0x7f1248161360 2024-04-25T09:06:57.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f124d600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1248071f90 con 0x7f12480ae660 2024-04-25T09:06:57.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f124d600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124816a900 con 0x7f12480712d0 2024-04-25T09:06:57.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f1247400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1248161360 0x7f1248147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f1247400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1248161360 0x7f1248147fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35018/0 (socket says 172.21.15.175:35018) 2024-04-25T09:06:57.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f1247400640 1 -- 172.21.15.175:0/2891076231 learned_addr learned my addr 172.21.15.175:0/2891076231 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:57.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f1246000640 1 --2- 172.21.15.175:0/2891076231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12480ae660 0x7f1248158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f1246a00640 1 --2- 172.21.15.175:0/2891076231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12480712d0 0x7f1248157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f1247400640 1 -- 172.21.15.175:0/2891076231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12480712d0 msgr2=0x7f1248157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f1247400640 1 --2- 172.21.15.175:0/2891076231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12480712d0 0x7f1248157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f1247400640 1 -- 172.21.15.175:0/2891076231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12480ae660 msgr2=0x7f1248158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f1247400640 1 --2- 172.21.15.175:0/2891076231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12480ae660 0x7f1248158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f1247400640 1 -- 172.21.15.175:0/2891076231 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1248158c60 con 0x7f1248161360 2024-04-25T09:06:57.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f1247400640 1 --2- 172.21.15.175:0/2891076231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1248161360 0x7f1248147fa0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f124000e810 tx=0x7f124000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f123ea00640 1 -- 172.21.15.175:0/2891076231 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1240017070 con 0x7f1248161360 2024-04-25T09:06:57.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f123ea00640 1 -- 172.21.15.175:0/2891076231 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124000c6d0 con 0x7f1248161360 2024-04-25T09:06:57.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f123ea00640 1 -- 172.21.15.175:0/2891076231 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124000f040 con 0x7f1248161360 2024-04-25T09:06:57.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f124d600640 1 -- 172.21.15.175:0/2891076231 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1248149d80 con 0x7f1248161360 2024-04-25T09:06:57.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.180+0000 7f124d600640 1 -- 172.21.15.175:0/2891076231 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1248157a30 con 0x7f1248161360 2024-04-25T09:06:57.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.184+0000 7f123ea00640 1 -- 172.21.15.175:0/2891076231 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f124001a070 con 0x7f1248161360 2024-04-25T09:06:57.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.184+0000 7f123ea00640 1 --2- 172.21.15.175:0/2891076231 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1228066f60 0x7f1228069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.184+0000 7f123ea00640 1 -- 172.21.15.175:0/2891076231 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1240084c10 con 0x7f1248161360 2024-04-25T09:06:57.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.184+0000 7f1246a00640 1 --2- 172.21.15.175:0/2891076231 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1228066f60 0x7f1228069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.184+0000 7f12509ea000 1 Processor -- start 2024-04-25T09:06:57.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.184+0000 7f12509ea000 1 -- start start 2024-04-25T09:06:57.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.184+0000 7f1246a00640 1 --2- 172.21.15.175:0/2891076231 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1228066f60 0x7f1228069420 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f12380ae000 tx=0x7f12380a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.184+0000 7f12509ea000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82069d0 0x5630f8206db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.184+0000 7f12509ea000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f82072f0 0x5630f81bcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.184+0000 7f12509ea000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f81bd0a0 0x5630f81bd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.184+0000 7f12509ea000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630f8009ff0 con 0x5630f82069d0 2024-04-25T09:06:57.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.184+0000 7f12509ea000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630f7f92150 con 0x5630f82072f0 2024-04-25T09:06:57.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.184+0000 7f12509ea000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630f8006090 con 0x5630f81bd0a0 2024-04-25T09:06:57.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f1246a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82069d0 0x5630f8206db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f1246a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82069d0 0x5630f8206db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35020/0 (socket says 172.21.15.175:35020) 2024-04-25T09:06:57.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f1246a00640 1 -- 172.21.15.175:0/1639432177 learned_addr learned my addr 172.21.15.175:0/1639432177 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:57.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f1247400640 1 --2- 172.21.15.175:0/1639432177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f81bd0a0 0x5630f81bd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f1246000640 1 --2- 172.21.15.175:0/1639432177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f82072f0 0x5630f81bcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f1246a00640 1 -- 172.21.15.175:0/1639432177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f81bd0a0 msgr2=0x5630f81bd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f1246a00640 1 --2- 172.21.15.175:0/1639432177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f81bd0a0 0x5630f81bd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f1246a00640 1 -- 172.21.15.175:0/1639432177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f82072f0 msgr2=0x5630f81bcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f1246a00640 1 --2- 172.21.15.175:0/1639432177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f82072f0 0x5630f81bcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f1246a00640 1 -- 172.21.15.175:0/1639432177 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630f81a00d0 con 0x5630f82069d0 2024-04-25T09:06:57.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f1246000640 1 --2- 172.21.15.175:0/1639432177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f82072f0 0x5630f81bcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:57.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f1246a00640 1 --2- 172.21.15.175:0/1639432177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82069d0 0x5630f8206db0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1238009c90 tx=0x7f1238004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebf61df3268bed5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f1233400640 1 -- 172.21.15.175:0/1639432177 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12380c6070 con 0x5630f82069d0 2024-04-25T09:06:57.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f1233400640 1 -- 172.21.15.175:0/1639432177 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12380c2620 con 0x5630f82069d0 2024-04-25T09:06:57.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f1233400640 1 -- 172.21.15.175:0/1639432177 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12380c29f0 con 0x5630f82069d0 2024-04-25T09:06:57.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f12509ea000 1 -- 172.21.15.175:0/1639432177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82069d0 msgr2=0x5630f8206db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f12509ea000 1 --2- 172.21.15.175:0/1639432177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82069d0 0x5630f8206db0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1238009c90 tx=0x7f1238004ac0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f12509ea000 1 -- 172.21.15.175:0/1639432177 shutdown_connections 2024-04-25T09:06:57.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f12509ea000 1 --2- 172.21.15.175:0/1639432177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f81bd0a0 0x5630f81bd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f12509ea000 1 --2- 172.21.15.175:0/1639432177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f82072f0 0x5630f81bcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f12509ea000 1 --2- 172.21.15.175:0/1639432177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82069d0 0x5630f8206db0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f12509ea000 1 -- 172.21.15.175:0/1639432177 >> 172.21.15.175:0/1639432177 conn(0x5630f81b9020 msgr2=0x5630f81bb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:57.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f12509ea000 1 -- 172.21.15.175:0/1639432177 shutdown_connections 2024-04-25T09:06:57.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f12509ea000 1 -- 172.21.15.175:0/1639432177 wait complete. 2024-04-25T09:06:57.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f12509ea000 1 -- start start 2024-04-25T09:06:57.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f12509ea000 1 Processor -- start 2024-04-25T09:06:57.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f12509ea000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f81bd0a0 0x5630f81eb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f12509ea000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82069d0 0x5630f81ebd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f12509ea000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f82072f0 0x5630f81ec270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f12509ea000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630f7fce250 con 0x5630f82069d0 2024-04-25T09:06:57.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f12509ea000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630f7fc4690 con 0x5630f81bd0a0 2024-04-25T09:06:57.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f12509ea000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630f7f92a40 con 0x5630f82072f0 2024-04-25T09:06:57.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f12509ea000 10 client.0 _ll_register_callbacks cb 0x5630f81a7e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:57.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f1246000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82069d0 0x5630f81ebd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f1246000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82069d0 0x5630f81ebd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35026/0 (socket says 172.21.15.175:35026) 2024-04-25T09:06:57.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.188+0000 7f1246000640 1 -- 172.21.15.175:0/3834026703 learned_addr learned my addr 172.21.15.175:0/3834026703 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:57.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1247400640 1 --2- 172.21.15.175:0/3834026703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f82072f0 0x5630f81ec270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1246a00640 1 --2- 172.21.15.175:0/3834026703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f81bd0a0 0x5630f81eb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1246000640 1 -- 172.21.15.175:0/3834026703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f82072f0 msgr2=0x5630f81ec270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1246000640 1 --2- 172.21.15.175:0/3834026703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f82072f0 0x5630f81ec270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1246000640 1 -- 172.21.15.175:0/3834026703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f81bd0a0 msgr2=0x5630f81eb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1246000640 1 --2- 172.21.15.175:0/3834026703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f81bd0a0 0x5630f81eb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1246000640 1 -- 172.21.15.175:0/3834026703 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630f80b71c0 con 0x5630f82069d0 2024-04-25T09:06:57.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1247400640 1 --2- 172.21.15.175:0/3834026703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f82072f0 0x5630f81ec270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:57.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1246000640 1 --2- 172.21.15.175:0/3834026703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82069d0 0x5630f81ebd30 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1234007500 tx=0x7f1234001500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34082d3939b74d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1227e00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:06:57.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1227e00640 1 -- 172.21.15.175:0/3834026703 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12340076b0 con 0x5630f82069d0 2024-04-25T09:06:57.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1227e00640 1 -- 172.21.15.175:0/3834026703 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1234014400 con 0x5630f82069d0 2024-04-25T09:06:57.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 1 -- 172.21.15.175:0/3834026703 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12380c2620 con 0x5630f82069d0 2024-04-25T09:06:57.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1227e00640 1 -- 172.21.15.175:0/3834026703 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1234021050 con 0x5630f82069d0 2024-04-25T09:06:57.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 10 client.6183 fetch_fsmap learned FSMap version 32 2024-04-25T09:06:57.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 1 -- 172.21.15.175:0/3834026703 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5630f80b3170 con 0x5630f82069d0 2024-04-25T09:06:57.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1227e00640 1 -- 172.21.15.175:0/3834026703 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12380c2620 con 0x5630f82069d0 2024-04-25T09:06:57.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1227e00640 1 -- 172.21.15.175:0/3834026703 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1234024020 con 0x5630f82069d0 2024-04-25T09:06:57.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 10 client.6183 fetch_fsmap finished waiting for FSMap version 32 2024-04-25T09:06:57.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 10 client.6183 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:06:57.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 20 client.6183 populate_metadata read hostname 'smithi175' 2024-04-25T09:06:57.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 1 --2- 172.21.15.175:0/3834026703 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5630f8216c80 0x5630f8219070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 4 client.6183 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:57.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 1 -- 172.21.15.175:0/3834026703 --> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5630f7fa5c60 con 0x5630f8216c80 2024-04-25T09:06:57.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1246a00640 1 --2- 172.21.15.175:0/3834026703 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5630f8216c80 0x5630f8219070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1246a00640 1 --2- 172.21.15.175:0/3834026703 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5630f8216c80 0x5630f8219070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=760e84890e062bf1 server_cookie=9420ff01b40a2011 in_seq=0 out_seq=0 2024-04-25T09:06:57.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1227e00640 10 client.6183 ms_handle_connect on v2:172.21.15.175:6836/1478147147 2024-04-25T09:06:57.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1227e00640 1 -- 172.21.15.175:0/3834026703 <== mds.0 v2:172.21.15.175:6836/1478147147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5630f7fa5c60 con 0x5630f8216c80 2024-04-25T09:06:57.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1227e00640 10 client.6183 handle_command_reply: tid=0 2024-04-25T09:06:57.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 1 client.6183 shutdown 2024-04-25T09:06:57.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 1 -- 172.21.15.175:0/3834026703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82069d0 msgr2=0x5630f81ebd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 1 --2- 172.21.15.175:0/3834026703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82069d0 0x5630f81ebd30 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1234007500 tx=0x7f1234001500 comp rx=0 tx=0).stop 2024-04-25T09:06:57.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 1 -- 172.21.15.175:0/3834026703 shutdown_connections 2024-04-25T09:06:57.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 1 --2- 172.21.15.175:0/3834026703 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5630f8216c80 0x5630f8219070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 1 --2- 172.21.15.175:0/3834026703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f82072f0 0x5630f81ec270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 1 --2- 172.21.15.175:0/3834026703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82069d0 0x5630f81ebd30 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 1 --2- 172.21.15.175:0/3834026703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f81bd0a0 0x5630f81eb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f1227e00640 0 client.6183 ms_handle_reset on v2:172.21.15.175:6836/1478147147 2024-04-25T09:06:57.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 1 -- 172.21.15.175:0/3834026703 >> 172.21.15.175:0/3834026703 conn(0x5630f81b9020 msgr2=0x5630f81bbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:57.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 1 -- 172.21.15.175:0/3834026703 shutdown_connections 2024-04-25T09:06:57.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 1 -- 172.21.15.175:0/3834026703 wait complete. 2024-04-25T09:06:57.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.192+0000 7f12509ea000 20 client.6183 trim_cache size 0 max 16384 2024-04-25T09:06:57.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.208+0000 7f12509ea000 1 Processor -- start 2024-04-25T09:06:57.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.208+0000 7f12509ea000 1 -- start start 2024-04-25T09:06:57.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.208+0000 7f12509ea000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f81bd0a0 0x5630f821b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.208+0000 7f12509ea000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f82069d0 0x5630f82050a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.208+0000 7f12509ea000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f82072f0 0x5630f82055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.208+0000 7f12509ea000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1248202ed0 con 0x5630f81bd0a0 2024-04-25T09:06:57.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.208+0000 7f12509ea000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1248202040 con 0x5630f82072f0 2024-04-25T09:06:57.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.208+0000 7f12509ea000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1248201590 con 0x5630f82069d0 2024-04-25T09:06:57.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.208+0000 7f1246a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f81bd0a0 0x5630f821b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.208+0000 7f1246a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f81bd0a0 0x5630f821b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35030/0 (socket says 172.21.15.175:35030) 2024-04-25T09:06:57.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.208+0000 7f1246a00640 1 -- 172.21.15.175:0/2581822272 learned_addr learned my addr 172.21.15.175:0/2581822272 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:57.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.208+0000 7f1246a00640 1 -- 172.21.15.175:0/2581822272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f82069d0 msgr2=0x5630f82050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.208+0000 7f1246a00640 1 --2- 172.21.15.175:0/2581822272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f82069d0 0x5630f82050a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.208+0000 7f1246a00640 1 -- 172.21.15.175:0/2581822272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f82072f0 msgr2=0x5630f82055e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.208+0000 7f1246a00640 1 --2- 172.21.15.175:0/2581822272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f82072f0 0x5630f82055e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.208+0000 7f1246a00640 1 -- 172.21.15.175:0/2581822272 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630f8050de0 con 0x5630f81bd0a0 2024-04-25T09:06:57.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.208+0000 7f1246a00640 1 --2- 172.21.15.175:0/2581822272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f81bd0a0 0x5630f821b4b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f123801ce10 tx=0x7f12380b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22feea268f8209d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f1232a00640 1 -- 172.21.15.175:0/2581822272 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12380d9070 con 0x5630f81bd0a0 2024-04-25T09:06:57.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f1232a00640 1 -- 172.21.15.175:0/2581822272 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12380d4410 con 0x5630f81bd0a0 2024-04-25T09:06:57.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f1232a00640 1 -- 172.21.15.175:0/2581822272 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12380c6040 con 0x5630f81bd0a0 2024-04-25T09:06:57.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 -- 172.21.15.175:0/2581822272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f81bd0a0 msgr2=0x5630f821b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 --2- 172.21.15.175:0/2581822272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f81bd0a0 0x5630f821b4b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f123801ce10 tx=0x7f12380b7000 comp rx=0 tx=0).stop 2024-04-25T09:06:57.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 -- 172.21.15.175:0/2581822272 shutdown_connections 2024-04-25T09:06:57.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 --2- 172.21.15.175:0/2581822272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f82072f0 0x5630f82055e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 --2- 172.21.15.175:0/2581822272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f82069d0 0x5630f82050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 --2- 172.21.15.175:0/2581822272 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f81bd0a0 0x5630f821b4b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 -- 172.21.15.175:0/2581822272 >> 172.21.15.175:0/2581822272 conn(0x5630f81b9020 msgr2=0x5630f8213730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:57.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 -- 172.21.15.175:0/2581822272 shutdown_connections 2024-04-25T09:06:57.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 -- 172.21.15.175:0/2581822272 wait complete. 2024-04-25T09:06:57.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 -- start start 2024-04-25T09:06:57.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 Processor -- start 2024-04-25T09:06:57.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f81bd0a0 0x5630f8219070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f82069d0 0x5630f82195b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82072f0 0x5630f8219af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630f7fa4e00 con 0x5630f82072f0 2024-04-25T09:06:57.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1248201a40 con 0x5630f82069d0 2024-04-25T09:06:57.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630f8009300 con 0x5630f81bd0a0 2024-04-25T09:06:57.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 10 client.0 _ll_register_callbacks cb 0x5630f8188040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:57.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f1247400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82072f0 0x5630f8219af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f1247400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82072f0 0x5630f8219af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35032/0 (socket says 172.21.15.175:35032) 2024-04-25T09:06:57.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f1247400640 1 -- 172.21.15.175:0/801471341 learned_addr learned my addr 172.21.15.175:0/801471341 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:06:57.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f1246a00640 1 --2- 172.21.15.175:0/801471341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f81bd0a0 0x5630f8219070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f1246000640 1 --2- 172.21.15.175:0/801471341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f82069d0 0x5630f82195b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f1247400640 1 -- 172.21.15.175:0/801471341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f81bd0a0 msgr2=0x5630f8219070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f1247400640 1 --2- 172.21.15.175:0/801471341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f81bd0a0 0x5630f8219070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f1247400640 1 -- 172.21.15.175:0/801471341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f82069d0 msgr2=0x5630f82195b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f1247400640 1 --2- 172.21.15.175:0/801471341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f82069d0 0x5630f82195b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f1247400640 1 -- 172.21.15.175:0/801471341 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630f7fab8e0 con 0x5630f82072f0 2024-04-25T09:06:57.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f1247400640 1 --2- 172.21.15.175:0/801471341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82072f0 0x5630f8219af0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f124000c4c0 tx=0x7f1240055690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a98527e423f0169 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f1227e00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:06:57.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f1227e00640 1 -- 172.21.15.175:0/801471341 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1240021040 con 0x5630f82072f0 2024-04-25T09:06:57.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f1227e00640 1 -- 172.21.15.175:0/801471341 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1240054980 con 0x5630f82072f0 2024-04-25T09:06:57.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 -- 172.21.15.175:0/801471341 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12380d4410 con 0x5630f82072f0 2024-04-25T09:06:57.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f1227e00640 1 -- 172.21.15.175:0/801471341 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1240054b80 con 0x5630f82072f0 2024-04-25T09:06:57.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 10 client.6189 fetch_fsmap learned FSMap version 32 2024-04-25T09:06:57.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.212+0000 7f12509ea000 1 -- 172.21.15.175:0/801471341 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5630f80638f0 con 0x5630f82072f0 2024-04-25T09:06:57.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f1227e00640 1 -- 172.21.15.175:0/801471341 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12380d4410 con 0x5630f82072f0 2024-04-25T09:06:57.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f1227e00640 1 -- 172.21.15.175:0/801471341 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1240012050 con 0x5630f82072f0 2024-04-25T09:06:57.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f12509ea000 10 client.6189 fetch_fsmap finished waiting for FSMap version 32 2024-04-25T09:06:57.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f12509ea000 10 client.6189 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:06:57.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f12509ea000 20 client.6189 populate_metadata read hostname 'smithi175' 2024-04-25T09:06:57.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f12509ea000 1 --2- 172.21.15.175:0/801471341 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5630f821a030 0x5630f821a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f12509ea000 4 client.6189 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:06:57.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f12509ea000 1 -- 172.21.15.175:0/801471341 --> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5630f8017530 con 0x5630f821a030 2024-04-25T09:06:57.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f1246a00640 1 --2- 172.21.15.175:0/801471341 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5630f821a030 0x5630f821a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f1227e00640 10 client.6189 ms_handle_connect on v2:172.21.15.175:6836/1478147147 2024-04-25T09:06:57.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f1246a00640 1 --2- 172.21.15.175:0/801471341 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5630f821a030 0x5630f821a440 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=812334d458381149 server_cookie=82bac2235b571dc in_seq=0 out_seq=0 2024-04-25T09:06:57.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f1227e00640 1 -- 172.21.15.175:0/801471341 <== mds.0 v2:172.21.15.175:6836/1478147147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+253 (crc 0 0 0) 0x5630f8017530 con 0x5630f821a030 2024-04-25T09:06:57.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f1227e00640 10 client.6189 handle_command_reply: tid=0 2024-04-25T09:06:57.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f12509ea000 1 client.6189 shutdown 2024-04-25T09:06:57.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f12509ea000 1 -- 172.21.15.175:0/801471341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82072f0 msgr2=0x5630f8219af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f12509ea000 1 --2- 172.21.15.175:0/801471341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82072f0 0x5630f8219af0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f124000c4c0 tx=0x7f1240055690 comp rx=0 tx=0).stop 2024-04-25T09:06:57.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f12509ea000 1 -- 172.21.15.175:0/801471341 shutdown_connections 2024-04-25T09:06:57.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f12509ea000 1 --2- 172.21.15.175:0/801471341 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5630f821a030 0x5630f821a440 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f12509ea000 1 --2- 172.21.15.175:0/801471341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5630f82072f0 0x5630f8219af0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f12509ea000 1 --2- 172.21.15.175:0/801471341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5630f82069d0 0x5630f82195b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f12509ea000 1 --2- 172.21.15.175:0/801471341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5630f81bd0a0 0x5630f8219070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f12509ea000 1 -- 172.21.15.175:0/801471341 >> 172.21.15.175:0/801471341 conn(0x5630f81b9020 msgr2=0x5630f8213fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:57.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f1227e00640 0 client.6189 ms_handle_reset on v2:172.21.15.175:6836/1478147147 2024-04-25T09:06:57.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f12509ea000 1 -- 172.21.15.175:0/801471341 shutdown_connections 2024-04-25T09:06:57.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f12509ea000 1 -- 172.21.15.175:0/801471341 wait complete. 2024-04-25T09:06:57.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f12509ea000 20 client.6189 trim_cache size 0 max 16384 2024-04-25T09:06:57.211 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:06:57.211 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:06:57.211 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": { 2024-04-25T09:06:57.211 INFO:teuthology.orchestra.run.smithi175.stdout: "3a2e11dc-3973-4ad9-b8b0-3280169fbc8f": { 2024-04-25T09:06:57.211 INFO:teuthology.orchestra.run.smithi175.stdout: "path": "/", 2024-04-25T09:06:57.211 INFO:teuthology.orchestra.run.smithi175.stdout: "tag": "3a2e11dc-3973-4ad9-b8b0-3280169fbc8f", 2024-04-25T09:06:57.211 INFO:teuthology.orchestra.run.smithi175.stdout: "options": "recursive" 2024-04-25T09:06:57.211 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:57.211 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:06:57.211 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:06:57.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f124d600640 1 -- 172.21.15.175:0/2891076231 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1228066f60 msgr2=0x7f1228069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f124d600640 1 --2- 172.21.15.175:0/2891076231 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1228066f60 0x7f1228069420 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f12380ae000 tx=0x7f12380a7070 comp rx=0 tx=0).stop 2024-04-25T09:06:57.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f124d600640 1 -- 172.21.15.175:0/2891076231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1248161360 msgr2=0x7f1248147fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f124d600640 1 --2- 172.21.15.175:0/2891076231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1248161360 0x7f1248147fa0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f124000e810 tx=0x7f124000ecd0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f124d600640 1 -- 172.21.15.175:0/2891076231 shutdown_connections 2024-04-25T09:06:57.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f124d600640 1 --2- 172.21.15.175:0/2891076231 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1228066f60 0x7f1228069420 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f124d600640 1 --2- 172.21.15.175:0/2891076231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1248161360 0x7f1248147fa0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f124d600640 1 --2- 172.21.15.175:0/2891076231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f12480ae660 0x7f1248158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f124d600640 1 --2- 172.21.15.175:0/2891076231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f12480712d0 0x7f1248157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f124d600640 1 -- 172.21.15.175:0/2891076231 >> 172.21.15.175:0/2891076231 conn(0x7f124806ac50 msgr2=0x7f12480b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:57.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f124d600640 1 -- 172.21.15.175:0/2891076231 shutdown_connections 2024-04-25T09:06:57.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:06:57.216+0000 7f124d600640 1 -- 172.21.15.175:0/2891076231 wait complete. 2024-04-25T09:06:57.225 INFO:tasks.cephfs.filesystem:scrub status for tag:3a2e11dc-3973-4ad9-b8b0-3280169fbc8f - {'path': '/', 'tag': '3a2e11dc-3973-4ad9-b8b0-3280169fbc8f', 'options': 'recursive'} 2024-04-25T09:07:00.800 INFO:tasks.ceph.mon.a.smithi175.stderr:2024-04-25T09:07:00.808+0000 7feb12000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T09:07:08.649 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:07:08.654 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:07:27.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:27.226 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T09:07:27.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.384+0000 7f6ebf200640 1 Processor -- start 2024-04-25T09:07:27.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.384+0000 7f6ebf200640 1 -- start start 2024-04-25T09:07:27.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.384+0000 7f6ebf200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6eb815b8f0 0x7f6eb80cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.384+0000 7f6ebf200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6eb80cfff0 0x7f6eb80b1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.384+0000 7f6ebf200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb80b23b0 con 0x7f6eb80b1b70 2024-04-25T09:07:27.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.384+0000 7f6ebf200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb80d0450 con 0x7f6eb815b8f0 2024-04-25T09:07:27.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.384+0000 7f6ebf200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb815d070 con 0x7f6eb80cfff0 2024-04-25T09:07:27.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.384+0000 7f6ebde00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6eb815b8f0 0x7f6eb80cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.384+0000 7f6ebde00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6eb815b8f0 0x7f6eb80cfab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37582/0 (socket says 172.21.15.175:37582) 2024-04-25T09:07:27.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.384+0000 7f6ebde00640 1 -- 172.21.15.175:0/1962019011 learned_addr learned my addr 172.21.15.175:0/1962019011 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:27.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.388+0000 7f6ebd400640 1 --2- 172.21.15.175:0/1962019011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6eb80cfff0 0x7f6eb80b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.388+0000 7f6ebde00640 1 -- 172.21.15.175:0/1962019011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6eb80cfff0 msgr2=0x7f6eb80b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.388+0000 7f6ebde00640 1 --2- 172.21.15.175:0/1962019011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6eb80cfff0 0x7f6eb80b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.388+0000 7f6ebde00640 1 -- 172.21.15.175:0/1962019011 >> v1:172.21.15.177:6789/0 conn(0x7f6eb80b1b70 legacy=0x7f6eb815bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.388+0000 7f6ebde00640 1 -- 172.21.15.175:0/1962019011 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb80b2690 con 0x7f6eb815b8f0 2024-04-25T09:07:27.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.388+0000 7f6ebd400640 1 --2- 172.21.15.175:0/1962019011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6eb80cfff0 0x7f6eb80b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:27.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.388+0000 7f6ebde00640 1 --2- 172.21.15.175:0/1962019011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb815b8f0 0x7f6eb80cfab0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6eac009870 tx=0x7f6eac01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6ff66843778230 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.388+0000 7f6ebca00640 1 -- 172.21.15.175:0/1962019011 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0a7070 con 0x7f6eb815b8f0 2024-04-25T09:07:27.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.388+0000 7f6ebca00640 1 -- 172.21.15.175:0/1962019011 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac0b0070 con 0x7f6eb815b8f0 2024-04-25T09:07:27.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.388+0000 7f6ebca00640 1 -- 172.21.15.175:0/1962019011 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0ab890 con 0x7f6eb815b8f0 2024-04-25T09:07:27.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebf200640 1 -- 172.21.15.175:0/1962019011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb815b8f0 msgr2=0x7f6eb80cfab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebf200640 1 --2- 172.21.15.175:0/1962019011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb815b8f0 0x7f6eb80cfab0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6eac009870 tx=0x7f6eac01c560 comp rx=0 tx=0).stop 2024-04-25T09:07:27.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebf200640 1 -- 172.21.15.175:0/1962019011 shutdown_connections 2024-04-25T09:07:27.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebf200640 1 --2- 172.21.15.175:0/1962019011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6eb80cfff0 0x7f6eb80b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebf200640 1 --2- 172.21.15.175:0/1962019011 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb815b8f0 0x7f6eb80cfab0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebf200640 1 -- 172.21.15.175:0/1962019011 >> 172.21.15.175:0/1962019011 conn(0x7f6eb80d16f0 msgr2=0x7f6eb80d1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:27.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebf200640 1 -- 172.21.15.175:0/1962019011 shutdown_connections 2024-04-25T09:07:27.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebf200640 1 -- 172.21.15.175:0/1962019011 wait complete. 2024-04-25T09:07:27.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebf200640 1 Processor -- start 2024-04-25T09:07:27.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebf200640 1 -- start start 2024-04-25T09:07:27.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebf200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb80b1b70 0x7f6eb80b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebf200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6eb80cfff0 0x7f6eb806d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebf200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6eb815b8f0 0x7f6eb806d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebf200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8168880 con 0x7f6eb80b1b70 2024-04-25T09:07:27.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebf200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8168700 con 0x7f6eb80cfff0 2024-04-25T09:07:27.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebf200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8168a00 con 0x7f6eb815b8f0 2024-04-25T09:07:27.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb80b1b70 0x7f6eb80b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb80b1b70 0x7f6eb80b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37596/0 (socket says 172.21.15.175:37596) 2024-04-25T09:07:27.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebde00640 1 -- 172.21.15.175:0/3013740378 learned_addr learned my addr 172.21.15.175:0/3013740378 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:27.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebd400640 1 --2- 172.21.15.175:0/3013740378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6eb80cfff0 0x7f6eb806d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebe800640 1 --2- 172.21.15.175:0/3013740378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6eb815b8f0 0x7f6eb806d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebde00640 1 -- 172.21.15.175:0/3013740378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6eb815b8f0 msgr2=0x7f6eb806d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebde00640 1 --2- 172.21.15.175:0/3013740378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6eb815b8f0 0x7f6eb806d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebde00640 1 -- 172.21.15.175:0/3013740378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6eb80cfff0 msgr2=0x7f6eb806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebde00640 1 --2- 172.21.15.175:0/3013740378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6eb80cfff0 0x7f6eb806d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebde00640 1 -- 172.21.15.175:0/3013740378 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb8163310 con 0x7f6eb80b1b70 2024-04-25T09:07:27.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.392+0000 7f6ebde00640 1 --2- 172.21.15.175:0/3013740378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb80b1b70 0x7f6eb80b3790 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0ad040 tx=0x7f6eac01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.396+0000 7f6eb2000640 1 -- 172.21.15.175:0/3013740378 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0b4800 con 0x7f6eb80b1b70 2024-04-25T09:07:27.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.396+0000 7f6eb2000640 1 -- 172.21.15.175:0/3013740378 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac0b49a0 con 0x7f6eb80b1b70 2024-04-25T09:07:27.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.396+0000 7f6eb2000640 1 -- 172.21.15.175:0/3013740378 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0b4d90 con 0x7f6eb80b1b70 2024-04-25T09:07:27.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.396+0000 7f6ebf200640 1 -- 172.21.15.175:0/3013740378 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb81635f0 con 0x7f6eb80b1b70 2024-04-25T09:07:27.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.396+0000 7f6ebf200640 1 -- 172.21.15.175:0/3013740378 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb806bd60 con 0x7f6eb80b1b70 2024-04-25T09:07:27.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.396+0000 7f6eb2000640 1 -- 172.21.15.175:0/3013740378 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6eac0b3380 con 0x7f6eb80b1b70 2024-04-25T09:07:27.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.396+0000 7f6eb2000640 1 --2- 172.21.15.175:0/3013740378 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6e9c066f90 0x7f6e9c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.396+0000 7f6eb2000640 1 -- 172.21.15.175:0/3013740378 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6eac11f510 con 0x7f6eb80b1b70 2024-04-25T09:07:27.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.396+0000 7f6ebd400640 1 --2- 172.21.15.175:0/3013740378 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6e9c066f90 0x7f6e9c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.396+0000 7f6ec3d48000 1 Processor -- start 2024-04-25T09:07:27.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.396+0000 7f6ec3d48000 1 -- start start 2024-04-25T09:07:27.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.396+0000 7f6ebd400640 1 --2- 172.21.15.175:0/3013740378 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6e9c066f90 0x7f6e9c069450 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8154310 tx=0x7f6ea8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ec3d48000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23af9d0 0x562bc23afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ec3d48000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23b02f0 0x562bc2365b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ec3d48000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 0x562bc2366480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ec3d48000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc21b2ff0 con 0x562bc23660a0 2024-04-25T09:07:27.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ec3d48000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc213b150 con 0x562bc23af9d0 2024-04-25T09:07:27.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ec3d48000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x562bc21af090 con 0x562bc23b02f0 2024-04-25T09:07:27.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ebe800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 0x562bc2366480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ebe800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 0x562bc2366480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37606/0 (socket says 172.21.15.175:37606) 2024-04-25T09:07:27.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ebe800640 1 -- 172.21.15.175:0/2975886965 learned_addr learned my addr 172.21.15.175:0/2975886965 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:27.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ebde00640 1 --2- 172.21.15.175:0/2975886965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23af9d0 0x562bc23afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ebd400640 1 --2- 172.21.15.175:0/2975886965 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23b02f0 0x562bc2365b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ebe800640 1 -- 172.21.15.175:0/2975886965 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23b02f0 msgr2=0x562bc2365b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ebe800640 1 --2- 172.21.15.175:0/2975886965 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23b02f0 0x562bc2365b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ebe800640 1 -- 172.21.15.175:0/2975886965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23af9d0 msgr2=0x562bc23afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ebe800640 1 --2- 172.21.15.175:0/2975886965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23af9d0 0x562bc23afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ebe800640 1 -- 172.21.15.175:0/2975886965 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bc23490d0 con 0x562bc23660a0 2024-04-25T09:07:27.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ebde00640 1 --2- 172.21.15.175:0/2975886965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23af9d0 0x562bc23afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:27.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ebe800640 1 --2- 172.21.15.175:0/2975886965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 0x562bc2366480 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4001c60 tx=0x7f6eb4002120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2af10d1bc3a1dc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ea6a00640 1 -- 172.21.15.175:0/2975886965 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4019070 con 0x562bc23660a0 2024-04-25T09:07:27.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ea6a00640 1 -- 172.21.15.175:0/2975886965 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb4003b90 con 0x562bc23660a0 2024-04-25T09:07:27.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ea6a00640 1 -- 172.21.15.175:0/2975886965 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb400e860 con 0x562bc23660a0 2024-04-25T09:07:27.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ec3d48000 1 -- 172.21.15.175:0/2975886965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 msgr2=0x562bc2366480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/2975886965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 0x562bc2366480 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4001c60 tx=0x7f6eb4002120 comp rx=0 tx=0).stop 2024-04-25T09:07:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ec3d48000 1 -- 172.21.15.175:0/2975886965 shutdown_connections 2024-04-25T09:07:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/2975886965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 0x562bc2366480 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/2975886965 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23b02f0 0x562bc2365b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/2975886965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23af9d0 0x562bc23afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ec3d48000 1 -- 172.21.15.175:0/2975886965 >> 172.21.15.175:0/2975886965 conn(0x562bc2362020 msgr2=0x562bc2364440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ec3d48000 1 -- 172.21.15.175:0/2975886965 shutdown_connections 2024-04-25T09:07:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ec3d48000 1 -- 172.21.15.175:0/2975886965 wait complete. 2024-04-25T09:07:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ec3d48000 1 -- start start 2024-04-25T09:07:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.400+0000 7f6ec3d48000 1 Processor -- start 2024-04-25T09:07:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ec3d48000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23660a0 0x562bc23947f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ec3d48000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23af9d0 0x562bc2394d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ec3d48000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23b02f0 0x562bc2395270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ec3d48000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc2177250 con 0x562bc23af9d0 2024-04-25T09:07:27.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ec3d48000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc216d690 con 0x562bc23b02f0 2024-04-25T09:07:27.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ec3d48000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x562bc213ba40 con 0x562bc23660a0 2024-04-25T09:07:27.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ec3d48000 10 client.0 _ll_register_callbacks cb 0x562bc2350e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:27.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ebd400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23af9d0 0x562bc2394d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ebd400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23af9d0 0x562bc2394d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37616/0 (socket says 172.21.15.175:37616) 2024-04-25T09:07:27.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ebd400640 1 -- 172.21.15.175:0/3111212782 learned_addr learned my addr 172.21.15.175:0/3111212782 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:27.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ebde00640 1 --2- 172.21.15.175:0/3111212782 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23660a0 0x562bc23947f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ebe800640 1 --2- 172.21.15.175:0/3111212782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23b02f0 0x562bc2395270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ebd400640 1 -- 172.21.15.175:0/3111212782 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23660a0 msgr2=0x562bc23947f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ebd400640 1 --2- 172.21.15.175:0/3111212782 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23660a0 0x562bc23947f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ebd400640 1 -- 172.21.15.175:0/3111212782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23b02f0 msgr2=0x562bc2395270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ebd400640 1 --2- 172.21.15.175:0/3111212782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23b02f0 0x562bc2395270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ebd400640 1 -- 172.21.15.175:0/3111212782 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562bc22601c0 con 0x562bc23af9d0 2024-04-25T09:07:27.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ebd400640 1 --2- 172.21.15.175:0/3111212782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23af9d0 0x562bc2394d30 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8014460 tx=0x7f6ea80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597ba43fa2cb9ce3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6e9b400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:07:27.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6e9b400640 1 -- 172.21.15.175:0/3111212782 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8025070 con 0x562bc23af9d0 2024-04-25T09:07:27.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6e9b400640 1 -- 172.21.15.175:0/3111212782 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ea80158e0 con 0x562bc23af9d0 2024-04-25T09:07:27.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ec3d48000 1 -- 172.21.15.175:0/3111212782 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6eb4003b90 con 0x562bc23af9d0 2024-04-25T09:07:27.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6e9b400640 1 -- 172.21.15.175:0/3111212782 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ea8030050 con 0x562bc23af9d0 2024-04-25T09:07:27.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ec3d48000 10 client.6201 fetch_fsmap learned FSMap version 33 2024-04-25T09:07:27.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ec3d48000 1 -- 172.21.15.175:0/3111212782 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x562bc225c170 con 0x562bc23af9d0 2024-04-25T09:07:27.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6e9b400640 1 -- 172.21.15.175:0/3111212782 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb4003b90 con 0x562bc23af9d0 2024-04-25T09:07:27.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6e9b400640 1 -- 172.21.15.175:0/3111212782 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 33) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6ea8033020 con 0x562bc23af9d0 2024-04-25T09:07:27.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ec3d48000 10 client.6201 fetch_fsmap finished waiting for FSMap version 33 2024-04-25T09:07:27.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ec3d48000 10 client.6201 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:07:27.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ec3d48000 20 client.6201 populate_metadata read hostname 'smithi175' 2024-04-25T09:07:27.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/3111212782 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x562bc23bfc80 0x562bc23c2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ec3d48000 4 client.6201 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:07:27.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ec3d48000 1 -- 172.21.15.175:0/3111212782 --> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562bc214ec60 con 0x562bc23bfc80 2024-04-25T09:07:27.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ebde00640 1 --2- 172.21.15.175:0/3111212782 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x562bc23bfc80 0x562bc23c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6e9b400640 10 client.6201 ms_handle_connect on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ebde00640 1 --2- 172.21.15.175:0/3111212782 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x562bc23bfc80 0x562bc23c2070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=465ce05d5da9c0a7 server_cookie=878211ccbab72127 in_seq=0 out_seq=0 2024-04-25T09:07:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6e9b400640 1 -- 172.21.15.175:0/3111212782 <== mds.0 v2:172.21.15.175:6836/1478147147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562bc214ec60 con 0x562bc23bfc80 2024-04-25T09:07:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6e9b400640 10 client.6201 handle_command_reply: tid=0 2024-04-25T09:07:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.404+0000 7f6ec3d48000 1 client.6201 shutdown 2024-04-25T09:07:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.408+0000 7f6ec3d48000 1 -- 172.21.15.175:0/3111212782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23af9d0 msgr2=0x562bc2394d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.408+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/3111212782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23af9d0 0x562bc2394d30 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8014460 tx=0x7f6ea80046d0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.408+0000 7f6ec3d48000 1 -- 172.21.15.175:0/3111212782 shutdown_connections 2024-04-25T09:07:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.408+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/3111212782 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x562bc23bfc80 0x562bc23c2070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.408+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/3111212782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23b02f0 0x562bc2395270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.408+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/3111212782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23af9d0 0x562bc2394d30 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.408+0000 7f6e9b400640 0 client.6201 ms_handle_reset on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.408+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/3111212782 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23660a0 0x562bc23947f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.408+0000 7f6ec3d48000 1 -- 172.21.15.175:0/3111212782 >> 172.21.15.175:0/3111212782 conn(0x562bc2362020 msgr2=0x562bc2364ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:27.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.408+0000 7f6ec3d48000 1 -- 172.21.15.175:0/3111212782 shutdown_connections 2024-04-25T09:07:27.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.408+0000 7f6ec3d48000 1 -- 172.21.15.175:0/3111212782 wait complete. 2024-04-25T09:07:27.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.408+0000 7f6ec3d48000 20 client.6201 trim_cache size 0 max 16384 2024-04-25T09:07:27.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.420+0000 7f6ec3d48000 1 Processor -- start 2024-04-25T09:07:27.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.420+0000 7f6ec3d48000 1 -- start start 2024-04-25T09:07:27.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 0x562bc23aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23af9d0 0x562bc2365420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23b02f0 0x562bc2365960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb82030f0 con 0x562bc23660a0 2024-04-25T09:07:27.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb81650e0 con 0x562bc23b02f0 2024-04-25T09:07:27.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8142480 con 0x562bc23af9d0 2024-04-25T09:07:27.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ebde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 0x562bc23aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ebde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 0x562bc23aede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37620/0 (socket says 172.21.15.175:37620) 2024-04-25T09:07:27.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ebde00640 1 -- 172.21.15.175:0/582351221 learned_addr learned my addr 172.21.15.175:0/582351221 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:27.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ebde00640 1 -- 172.21.15.175:0/582351221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23af9d0 msgr2=0x562bc2365420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ebde00640 1 --2- 172.21.15.175:0/582351221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23af9d0 0x562bc2365420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ebde00640 1 -- 172.21.15.175:0/582351221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23b02f0 msgr2=0x562bc2365960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ebe800640 1 --2- 172.21.15.175:0/582351221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23b02f0 0x562bc2365960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ebde00640 1 --2- 172.21.15.175:0/582351221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23b02f0 0x562bc2365960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ebde00640 1 -- 172.21.15.175:0/582351221 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bc21f9de0 con 0x562bc23660a0 2024-04-25T09:07:27.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ebe800640 1 --2- 172.21.15.175:0/582351221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23b02f0 0x562bc2365960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:27.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ebde00640 1 --2- 172.21.15.175:0/582351221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 0x562bc23aede0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6eac097f40 tx=0x7f6eac11f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c943a88bcd6f30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ea6000640 1 -- 172.21.15.175:0/582351221 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0c4040 con 0x562bc23660a0 2024-04-25T09:07:27.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ea6000640 1 -- 172.21.15.175:0/582351221 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac0b0040 con 0x562bc23660a0 2024-04-25T09:07:27.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ea6000640 1 -- 172.21.15.175:0/582351221 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac11de60 con 0x562bc23660a0 2024-04-25T09:07:27.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 -- 172.21.15.175:0/582351221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 msgr2=0x562bc23aede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/582351221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 0x562bc23aede0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6eac097f40 tx=0x7f6eac11f040 comp rx=0 tx=0).stop 2024-04-25T09:07:27.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 -- 172.21.15.175:0/582351221 shutdown_connections 2024-04-25T09:07:27.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/582351221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23b02f0 0x562bc2365960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/582351221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23af9d0 0x562bc2365420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/582351221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 0x562bc23aede0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 -- 172.21.15.175:0/582351221 >> 172.21.15.175:0/582351221 conn(0x562bc2362020 msgr2=0x562bc23ae0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:27.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 -- 172.21.15.175:0/582351221 shutdown_connections 2024-04-25T09:07:27.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 -- 172.21.15.175:0/582351221 wait complete. 2024-04-25T09:07:27.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 -- start start 2024-04-25T09:07:27.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 Processor -- start 2024-04-25T09:07:27.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 0x562bc2418d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23af9d0 0x562bc2419270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23b02f0 0x562bc23c2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bc214de00 con 0x562bc23660a0 2024-04-25T09:07:27.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8164ae0 con 0x562bc23af9d0 2024-04-25T09:07:27.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x562bc21b2300 con 0x562bc23b02f0 2024-04-25T09:07:27.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ec3d48000 10 client.0 _ll_register_callbacks cb 0x562bc2331040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:27.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ebde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 0x562bc2418d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ebde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 0x562bc2418d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37630/0 (socket says 172.21.15.175:37630) 2024-04-25T09:07:27.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ebde00640 1 -- 172.21.15.175:0/3666957251 learned_addr learned my addr 172.21.15.175:0/3666957251 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:27.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ebd400640 1 --2- 172.21.15.175:0/3666957251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23af9d0 0x562bc2419270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.424+0000 7f6ebe800640 1 --2- 172.21.15.175:0/3666957251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23b02f0 0x562bc23c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebde00640 1 -- 172.21.15.175:0/3666957251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23b02f0 msgr2=0x562bc23c2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebde00640 1 --2- 172.21.15.175:0/3666957251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23b02f0 0x562bc23c2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebde00640 1 -- 172.21.15.175:0/3666957251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23af9d0 msgr2=0x562bc2419270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebde00640 1 --2- 172.21.15.175:0/3666957251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23af9d0 0x562bc2419270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebde00640 1 -- 172.21.15.175:0/3666957251 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562bc21548e0 con 0x562bc23660a0 2024-04-25T09:07:27.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebe800640 1 --2- 172.21.15.175:0/3666957251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23b02f0 0x562bc23c2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:27.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebde00640 1 --2- 172.21.15.175:0/3666957251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 0x562bc2418d30 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6eac01a190 tx=0x7f6eac11d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78721719b2cebf4f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6e9b400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:07:27.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6e9b400640 1 -- 172.21.15.175:0/3666957251 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0c4070 con 0x562bc23660a0 2024-04-25T09:07:27.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6e9b400640 1 -- 172.21.15.175:0/3666957251 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6eac11daa0 con 0x562bc23660a0 2024-04-25T09:07:27.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 1 -- 172.21.15.175:0/3666957251 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6eac0b0040 con 0x562bc23660a0 2024-04-25T09:07:27.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6e9b400640 1 -- 172.21.15.175:0/3666957251 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6eac0ec5d0 con 0x562bc23660a0 2024-04-25T09:07:27.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 10 client.6207 fetch_fsmap learned FSMap version 33 2024-04-25T09:07:27.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 1 -- 172.21.15.175:0/3666957251 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x562bc220c8f0 con 0x562bc23660a0 2024-04-25T09:07:27.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6e9b400640 1 -- 172.21.15.175:0/3666957251 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac0b0040 con 0x562bc23660a0 2024-04-25T09:07:27.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6e9b400640 1 -- 172.21.15.175:0/3666957251 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 33) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6eac10f020 con 0x562bc23660a0 2024-04-25T09:07:27.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 10 client.6207 fetch_fsmap finished waiting for FSMap version 33 2024-04-25T09:07:27.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 10 client.6207 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:07:27.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 20 client.6207 populate_metadata read hostname 'smithi175' 2024-04-25T09:07:27.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/3666957251 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x562bc23c2d10 0x562bc23c3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 4 client.6207 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:07:27.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 1 -- 172.21.15.175:0/3666957251 --> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562bc21c0530 con 0x562bc23c2d10 2024-04-25T09:07:27.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebd400640 1 --2- 172.21.15.175:0/3666957251 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x562bc23c2d10 0x562bc23c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6e9b400640 10 client.6207 ms_handle_connect on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:27.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebd400640 1 --2- 172.21.15.175:0/3666957251 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x562bc23c2d10 0x562bc23c3120 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4ad0bf58727801b server_cookie=3bca7725e37fa39d in_seq=0 out_seq=0 2024-04-25T09:07:27.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6e9b400640 1 -- 172.21.15.175:0/3666957251 <== mds.0 v2:172.21.15.175:6836/1478147147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x562bc21c0530 con 0x562bc23c2d10 2024-04-25T09:07:27.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6e9b400640 10 client.6207 handle_command_reply: tid=0 2024-04-25T09:07:27.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 1 client.6207 shutdown 2024-04-25T09:07:27.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 1 -- 172.21.15.175:0/3666957251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 msgr2=0x562bc2418d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/3666957251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 0x562bc2418d30 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6eac01a190 tx=0x7f6eac11d9a0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 1 -- 172.21.15.175:0/3666957251 shutdown_connections 2024-04-25T09:07:27.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/3666957251 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x562bc23c2d10 0x562bc23c3120 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/3666957251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562bc23b02f0 0x562bc23c2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/3666957251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562bc23af9d0 0x562bc2419270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 1 --2- 172.21.15.175:0/3666957251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562bc23660a0 0x562bc2418d30 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 1 -- 172.21.15.175:0/3666957251 >> 172.21.15.175:0/3666957251 conn(0x562bc2362020 msgr2=0x562bc23ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:27.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6e9b400640 0 client.6207 ms_handle_reset on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:27.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 1 -- 172.21.15.175:0/3666957251 shutdown_connections 2024-04-25T09:07:27.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 1 -- 172.21.15.175:0/3666957251 wait complete. 2024-04-25T09:07:27.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ec3d48000 20 client.6207 trim_cache size 0 max 16384 2024-04-25T09:07:27.423 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:07:27.423 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "no active scrubs running", 2024-04-25T09:07:27.423 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": {} 2024-04-25T09:07:27.423 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:07:27.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebf200640 1 -- 172.21.15.175:0/3013740378 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6e9c066f90 msgr2=0x7f6e9c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebf200640 1 --2- 172.21.15.175:0/3013740378 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6e9c066f90 0x7f6e9c069450 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8154310 tx=0x7f6ea8008040 comp rx=0 tx=0).stop 2024-04-25T09:07:27.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebf200640 1 -- 172.21.15.175:0/3013740378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb80b1b70 msgr2=0x7f6eb80b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebf200640 1 --2- 172.21.15.175:0/3013740378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb80b1b70 0x7f6eb80b3790 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0ad040 tx=0x7f6eac01ada0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebf200640 1 -- 172.21.15.175:0/3013740378 shutdown_connections 2024-04-25T09:07:27.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebf200640 1 --2- 172.21.15.175:0/3013740378 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6e9c066f90 0x7f6e9c069450 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebf200640 1 --2- 172.21.15.175:0/3013740378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6eb815b8f0 0x7f6eb806d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebf200640 1 --2- 172.21.15.175:0/3013740378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6eb80cfff0 0x7f6eb806d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebf200640 1 --2- 172.21.15.175:0/3013740378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb80b1b70 0x7f6eb80b3790 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebf200640 1 -- 172.21.15.175:0/3013740378 >> 172.21.15.175:0/3013740378 conn(0x7f6eb80d16f0 msgr2=0x7f6eb815ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:27.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebf200640 1 -- 172.21.15.175:0/3013740378 shutdown_connections 2024-04-25T09:07:27.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.428+0000 7f6ebf200640 1 -- 172.21.15.175:0/3013740378 wait complete. 2024-04-25T09:07:27.438 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:07:27.438 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:27.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.584+0000 7f9a29400640 1 Processor -- start 2024-04-25T09:07:27.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.584+0000 7f9a29400640 1 -- start start 2024-04-25T09:07:27.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.588+0000 7f9a29400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9a240aeb30 0x7f9a24071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.588+0000 7f9a29400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9a24071780 0x7f9a2406de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.588+0000 7f9a29400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2406eba0 con 0x7f9a2406e340 2024-04-25T09:07:27.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.588+0000 7f9a29400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a24071be0 con 0x7f9a240aeb30 2024-04-25T09:07:27.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.588+0000 7f9a29400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a240b2a70 con 0x7f9a24071780 2024-04-25T09:07:27.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.588+0000 7f9a22800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9a240aeb30 0x7f9a24071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.588+0000 7f9a23200640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f9a2406e340 0x7f9a2415db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:46454/0 (socket says 172.21.15.175:46454) 2024-04-25T09:07:27.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.588+0000 7f9a22800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9a240aeb30 0x7f9a24071240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37640/0 (socket says 172.21.15.175:37640) 2024-04-25T09:07:27.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.588+0000 7f9a23200640 1 -- 172.21.15.175:0/2103926694 learned_addr learned my addr 172.21.15.175:0/2103926694 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:07:27.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.588+0000 7f9a19e00640 1 --2- 172.21.15.175:0/2103926694 >> v2:172.21.15.177:3300/0 conn(0x7f9a24071780 0x7f9a2406de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.588+0000 7f9a22800640 1 -- 172.21.15.175:0/2103926694 >> v2:172.21.15.177:3300/0 conn(0x7f9a24071780 msgr2=0x7f9a2406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.588+0000 7f9a22800640 1 --2- 172.21.15.175:0/2103926694 >> v2:172.21.15.177:3300/0 conn(0x7f9a24071780 0x7f9a2406de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.588+0000 7f9a22800640 1 -- 172.21.15.175:0/2103926694 >> v1:172.21.15.175:6789/0 conn(0x7f9a2406e340 legacy=0x7f9a2415db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.588+0000 7f9a22800640 1 -- 172.21.15.175:0/2103926694 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2406ee80 con 0x7f9a240aeb30 2024-04-25T09:07:27.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.588+0000 7f9a21e00640 1 -- 172.21.15.175:0/2103926694 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416321630 0 0) 0x7f9a2406eba0 con 0x7f9a2406e340 2024-04-25T09:07:27.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.592+0000 7f9a22800640 1 --2- 172.21.15.175:0/2103926694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a240aeb30 0x7f9a24071240 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9a240b2340 tx=0x7f9a1401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380ec8c54503d664 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.592+0000 7f9a21e00640 1 -- 172.21.15.175:0/2103926694 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a140ab620 con 0x7f9a240aeb30 2024-04-25T09:07:27.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.592+0000 7f9a21e00640 1 -- 172.21.15.175:0/2103926694 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a140b0070 con 0x7f9a240aeb30 2024-04-25T09:07:27.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.592+0000 7f9a21e00640 1 -- 172.21.15.175:0/2103926694 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a140ab9e0 con 0x7f9a240aeb30 2024-04-25T09:07:27.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.592+0000 7f9a29400640 1 -- 172.21.15.175:0/2103926694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a240aeb30 msgr2=0x7f9a24071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.592+0000 7f9a29400640 1 --2- 172.21.15.175:0/2103926694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a240aeb30 0x7f9a24071240 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9a240b2340 tx=0x7f9a1401c480 comp rx=0 tx=0).stop 2024-04-25T09:07:27.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.592+0000 7f9a29400640 1 -- 172.21.15.175:0/2103926694 shutdown_connections 2024-04-25T09:07:27.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.592+0000 7f9a29400640 1 --2- 172.21.15.175:0/2103926694 >> v2:172.21.15.177:3300/0 conn(0x7f9a24071780 0x7f9a2406de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.592+0000 7f9a29400640 1 --2- 172.21.15.175:0/2103926694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a240aeb30 0x7f9a24071240 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.592+0000 7f9a29400640 1 -- 172.21.15.175:0/2103926694 >> 172.21.15.175:0/2103926694 conn(0x7f9a24067150 msgr2=0x7f9a2406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:27.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.592+0000 7f9a29400640 1 -- 172.21.15.175:0/2103926694 shutdown_connections 2024-04-25T09:07:27.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.592+0000 7f9a29400640 1 -- 172.21.15.175:0/2103926694 wait complete. 2024-04-25T09:07:27.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.592+0000 7f9a29400640 1 Processor -- start 2024-04-25T09:07:27.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.592+0000 7f9a29400640 1 -- start start 2024-04-25T09:07:27.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a29400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a24071780 0x7f9a240a91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a29400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a240aeb30 0x7f9a241598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a29400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a24159de0 0x7f9a241f83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a29400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2415e3f0 con 0x7f9a240aeb30 2024-04-25T09:07:27.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a29400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2415e270 con 0x7f9a24071780 2024-04-25T09:07:27.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a29400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2415e570 con 0x7f9a24159de0 2024-04-25T09:07:27.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a19e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a240aeb30 0x7f9a241598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a19e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a240aeb30 0x7f9a241598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37654/0 (socket says 172.21.15.175:37654) 2024-04-25T09:07:27.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a19e00640 1 -- 172.21.15.175:0/2063665541 learned_addr learned my addr 172.21.15.175:0/2063665541 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:27.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a23200640 1 --2- 172.21.15.175:0/2063665541 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a24159de0 0x7f9a241f83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a22800640 1 --2- 172.21.15.175:0/2063665541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a24071780 0x7f9a240a91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a19e00640 1 -- 172.21.15.175:0/2063665541 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a24159de0 msgr2=0x7f9a241f83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a19e00640 1 --2- 172.21.15.175:0/2063665541 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a24159de0 0x7f9a241f83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a19e00640 1 -- 172.21.15.175:0/2063665541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a24071780 msgr2=0x7f9a240a91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a19e00640 1 --2- 172.21.15.175:0/2063665541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a24071780 0x7f9a240a91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a19e00640 1 -- 172.21.15.175:0/2063665541 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a240afe10 con 0x7f9a240aeb30 2024-04-25T09:07:27.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a19e00640 1 --2- 172.21.15.175:0/2063665541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a240aeb30 0x7f9a241598a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00e930 tx=0x7f9a0c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a1b400640 1 -- 172.21.15.175:0/2063665541 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c017070 con 0x7f9a240aeb30 2024-04-25T09:07:27.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a1b400640 1 -- 172.21.15.175:0/2063665541 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0c00c9a0 con 0x7f9a240aeb30 2024-04-25T09:07:27.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a29400640 1 -- 172.21.15.175:0/2063665541 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a240b00f0 con 0x7f9a240aeb30 2024-04-25T09:07:27.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a1b400640 1 -- 172.21.15.175:0/2063665541 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c00cd50 con 0x7f9a240aeb30 2024-04-25T09:07:27.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a29400640 1 -- 172.21.15.175:0/2063665541 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a240b06b0 con 0x7f9a240aeb30 2024-04-25T09:07:27.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a29400640 1 -- 172.21.15.175:0/2063665541 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a24074a60 con 0x7f9a240aeb30 2024-04-25T09:07:27.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.596+0000 7f9a1b400640 1 -- 172.21.15.175:0/2063665541 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9a0c01a070 con 0x7f9a240aeb30 2024-04-25T09:07:27.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.600+0000 7f9a1b400640 1 --2- 172.21.15.175:0/2063665541 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9a00066f60 0x7f9a00069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.600+0000 7f9a1b400640 1 -- 172.21.15.175:0/2063665541 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a0c0854e0 con 0x7f9a240aeb30 2024-04-25T09:07:27.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.600+0000 7f9a22800640 1 --2- 172.21.15.175:0/2063665541 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9a00066f60 0x7f9a00069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.600+0000 7f9a22800640 1 --2- 172.21.15.175:0/2063665541 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9a00066f60 0x7f9a00069420 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9a140af000 tx=0x7f9a140a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.604+0000 7f9a1b400640 1 -- 172.21.15.175:0/2063665541 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9a0c056480 con 0x7f9a240aeb30 2024-04-25T09:07:27.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.788+0000 7f9a29400640 1 -- 172.21.15.175:0/2063665541 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a2415e950 con 0x7f9a240aeb30 2024-04-25T09:07:27.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.788+0000 7f9a1b400640 1 -- 172.21.15.175:0/2063665541 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f9a0c055d80 con 0x7f9a240aeb30 2024-04-25T09:07:27.778 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:07:27.778 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2064272902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2064272902},{"type":"v1","addr":"172.21.15.177:6834","nonce":2064272902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5462,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3896280225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3896280225},{"type":"v1","addr":"172.21.15.177:6835","nonce":3896280225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/149812612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":149812612},{"type":"v1","addr":"172.21.15.175:6835","nonce":149812612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:43.704808+0000","modified":"2024-04-25T09:07:00.395284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":7,"addr":"172.21.15.175:6837/1478147147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1478147147},{"type":"v1","addr":"172.21.15.175:6837","nonce":1478147147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:07:27.779 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 33 2024-04-25T09:07:27.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.788+0000 7f9a29400640 1 -- 172.21.15.175:0/2063665541 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9a00066f60 msgr2=0x7f9a00069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.788+0000 7f9a29400640 1 --2- 172.21.15.175:0/2063665541 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9a00066f60 0x7f9a00069420 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9a140af000 tx=0x7f9a140a7000 comp rx=0 tx=0).stop 2024-04-25T09:07:27.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.788+0000 7f9a29400640 1 -- 172.21.15.175:0/2063665541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a240aeb30 msgr2=0x7f9a241598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.788+0000 7f9a29400640 1 --2- 172.21.15.175:0/2063665541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a240aeb30 0x7f9a241598a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00e930 tx=0x7f9a0c00edf0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.788+0000 7f9a29400640 1 -- 172.21.15.175:0/2063665541 shutdown_connections 2024-04-25T09:07:27.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.788+0000 7f9a29400640 1 --2- 172.21.15.175:0/2063665541 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9a00066f60 0x7f9a00069420 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.788+0000 7f9a29400640 1 --2- 172.21.15.175:0/2063665541 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a24159de0 0x7f9a241f83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.788+0000 7f9a29400640 1 --2- 172.21.15.175:0/2063665541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a240aeb30 0x7f9a241598a0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.788+0000 7f9a29400640 1 --2- 172.21.15.175:0/2063665541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a24071780 0x7f9a240a91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.788+0000 7f9a29400640 1 -- 172.21.15.175:0/2063665541 >> 172.21.15.175:0/2063665541 conn(0x7f9a2406e340 msgr2=0x7f9a2415b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:27.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.792+0000 7f9a29400640 1 -- 172.21.15.175:0/2063665541 shutdown_connections 2024-04-25T09:07:27.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.792+0000 7f9a29400640 1 -- 172.21.15.175:0/2063665541 wait complete. 2024-04-25T09:07:27.799 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T09:07:27.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.948+0000 7f1e88c00640 1 Processor -- start 2024-04-25T09:07:27.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.948+0000 7f1e88c00640 1 -- start start 2024-04-25T09:07:27.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.948+0000 7f1e88c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1e84145250 0x7f1e840cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.948+0000 7f1e88c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e840ce970 0x7f1e840cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.948+0000 7f1e88c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e840cfd10 con 0x7f1e841600a0 2024-04-25T09:07:27.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.948+0000 7f1e88c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8415f650 con 0x7f1e84145250 2024-04-25T09:07:27.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.948+0000 7f1e88c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840cfff0 con 0x7f1e840ce970 2024-04-25T09:07:27.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.948+0000 7f1e81e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1e84145250 0x7f1e840cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.948+0000 7f1e81400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f1e841600a0 0x7f1e840cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:46470/0 (socket says 172.21.15.175:46470) 2024-04-25T09:07:27.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.948+0000 7f1e81400640 1 -- 172.21.15.175:0/841310328 learned_addr learned my addr 172.21.15.175:0/841310328 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:07:27.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.948+0000 7f1e82800640 1 --2- 172.21.15.175:0/841310328 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e840ce970 0x7f1e840cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.948+0000 7f1e81e00640 1 -- 172.21.15.175:0/841310328 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e840ce970 msgr2=0x7f1e840cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.948+0000 7f1e81e00640 1 --2- 172.21.15.175:0/841310328 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e840ce970 0x7f1e840cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.948+0000 7f1e81e00640 1 -- 172.21.15.175:0/841310328 >> v1:172.21.15.175:6789/0 conn(0x7f1e841600a0 legacy=0x7f1e840cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.948+0000 7f1e81e00640 1 -- 172.21.15.175:0/841310328 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8415f8a0 con 0x7f1e84145250 2024-04-25T09:07:27.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.948+0000 7f1e80a00640 1 -- 172.21.15.175:0/841310328 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041087206 0 0) 0x7f1e840cfd10 con 0x7f1e841600a0 2024-04-25T09:07:27.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.952+0000 7f1e81e00640 1 --2- 172.21.15.175:0/841310328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e84145250 0x7f1e840cf6b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009dc0 tx=0x7f1e7401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6730f999e3e3a69c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.952+0000 7f1e80a00640 1 -- 172.21.15.175:0/841310328 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e740b2070 con 0x7f1e84145250 2024-04-25T09:07:27.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.952+0000 7f1e80a00640 1 -- 172.21.15.175:0/841310328 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e740a5970 con 0x7f1e84145250 2024-04-25T09:07:27.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.952+0000 7f1e80a00640 1 -- 172.21.15.175:0/841310328 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e740a5d40 con 0x7f1e84145250 2024-04-25T09:07:27.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.952+0000 7f1e88c00640 1 -- 172.21.15.175:0/841310328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e84145250 msgr2=0x7f1e840cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.952+0000 7f1e88c00640 1 --2- 172.21.15.175:0/841310328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e84145250 0x7f1e840cf6b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1e74009dc0 tx=0x7f1e7401c890 comp rx=0 tx=0).stop 2024-04-25T09:07:27.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.952+0000 7f1e88c00640 1 -- 172.21.15.175:0/841310328 shutdown_connections 2024-04-25T09:07:27.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.952+0000 7f1e88c00640 1 --2- 172.21.15.175:0/841310328 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e840ce970 0x7f1e840cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.952+0000 7f1e88c00640 1 --2- 172.21.15.175:0/841310328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e84145250 0x7f1e840cf6b0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.952+0000 7f1e88c00640 1 -- 172.21.15.175:0/841310328 >> 172.21.15.175:0/841310328 conn(0x7f1e8406ac50 msgr2=0x7f1e8406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:27.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.952+0000 7f1e88c00640 1 -- 172.21.15.175:0/841310328 shutdown_connections 2024-04-25T09:07:27.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.952+0000 7f1e88c00640 1 -- 172.21.15.175:0/841310328 wait complete. 2024-04-25T09:07:27.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e88c00640 1 Processor -- start 2024-04-25T09:07:27.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e88c00640 1 -- start start 2024-04-25T09:07:27.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e88c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e840ce970 0x7f1e841f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e88c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e84145250 0x7f1e840b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e88c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e841600a0 0x7f1e8415b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e88c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8415c870 con 0x7f1e841600a0 2024-04-25T09:07:27.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e88c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e84145630 con 0x7f1e84145250 2024-04-25T09:07:27.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e88c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8415c9f0 con 0x7f1e840ce970 2024-04-25T09:07:27.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e82800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e841600a0 0x7f1e8415b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e82800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e841600a0 0x7f1e8415b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37666/0 (socket says 172.21.15.175:37666) 2024-04-25T09:07:27.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e82800640 1 -- 172.21.15.175:0/1977439775 learned_addr learned my addr 172.21.15.175:0/1977439775 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:27.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e81e00640 1 --2- 172.21.15.175:0/1977439775 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e840ce970 0x7f1e841f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e81400640 1 --2- 172.21.15.175:0/1977439775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e84145250 0x7f1e840b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e82800640 1 -- 172.21.15.175:0/1977439775 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e840ce970 msgr2=0x7f1e841f6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e82800640 1 --2- 172.21.15.175:0/1977439775 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e840ce970 0x7f1e841f6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e82800640 1 -- 172.21.15.175:0/1977439775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e84145250 msgr2=0x7f1e840b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e82800640 1 --2- 172.21.15.175:0/1977439775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e84145250 0x7f1e840b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e82800640 1 -- 172.21.15.175:0/1977439775 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e840aca60 con 0x7f1e841600a0 2024-04-25T09:07:27.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e81e00640 1 --2- 172.21.15.175:0/1977439775 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e840ce970 0x7f1e841f6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:27.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e81400640 1 --2- 172.21.15.175:0/1977439775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e84145250 0x7f1e840b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:27.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e82800640 1 --2- 172.21.15.175:0/1977439775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e841600a0 0x7f1e8415b170 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c00d800 tx=0x7f1e7c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e7a000640 1 -- 172.21.15.175:0/1977439775 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c00b6c0 con 0x7f1e841600a0 2024-04-25T09:07:27.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e7a000640 1 -- 172.21.15.175:0/1977439775 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c019070 con 0x7f1e841600a0 2024-04-25T09:07:27.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e7a000640 1 -- 172.21.15.175:0/1977439775 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c00baa0 con 0x7f1e841600a0 2024-04-25T09:07:27.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e88c00640 1 -- 172.21.15.175:0/1977439775 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e840b4510 con 0x7f1e841600a0 2024-04-25T09:07:27.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.956+0000 7f1e88c00640 1 -- 172.21.15.175:0/1977439775 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e840acfe0 con 0x7f1e841600a0 2024-04-25T09:07:27.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.960+0000 7f1e7a000640 1 -- 172.21.15.175:0/1977439775 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1e7c00bc40 con 0x7f1e841600a0 2024-04-25T09:07:27.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.960+0000 7f1e7a000640 1 --2- 172.21.15.175:0/1977439775 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1e64066f60 0x7f1e64069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.960+0000 7f1e7a000640 1 -- 172.21.15.175:0/1977439775 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e7c085480 con 0x7f1e841600a0 2024-04-25T09:07:27.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.960+0000 7f1e81e00640 1 --2- 172.21.15.175:0/1977439775 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1e64066f60 0x7f1e64069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.960+0000 7f1e8bfb6000 1 Processor -- start 2024-04-25T09:07:27.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.960+0000 7f1e8bfb6000 1 -- start start 2024-04-25T09:07:27.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.960+0000 7f1e81e00640 1 --2- 172.21.15.175:0/1977439775 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1e64066f60 0x7f1e64069420 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1e740af000 tx=0x7f1e740a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5557927672e0 0x5557927676c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555792767c00 0x55579271d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 0x55579271dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555792604ba0 con 0x55579271d8e0 2024-04-25T09:07:27.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55579256a090 con 0x555792767c00 2024-04-25T09:07:27.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557924f2160 con 0x5557927672e0 2024-04-25T09:07:27.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e82800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 0x55579271dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e82800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 0x55579271dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37680/0 (socket says 172.21.15.175:37680) 2024-04-25T09:07:27.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e82800640 1 -- 172.21.15.175:0/3049331300 learned_addr learned my addr 172.21.15.175:0/3049331300 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:27.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e81e00640 1 --2- 172.21.15.175:0/3049331300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5557927672e0 0x5557927676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e81400640 1 --2- 172.21.15.175:0/3049331300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555792767c00 0x55579271d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e82800640 1 -- 172.21.15.175:0/3049331300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5557927672e0 msgr2=0x5557927676c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e82800640 1 --2- 172.21.15.175:0/3049331300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5557927672e0 0x5557927676c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e82800640 1 -- 172.21.15.175:0/3049331300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555792767c00 msgr2=0x55579271d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e82800640 1 --2- 172.21.15.175:0/3049331300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555792767c00 0x55579271d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e82800640 1 -- 172.21.15.175:0/3049331300 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555792613c20 con 0x55579271d8e0 2024-04-25T09:07:27.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e81400640 1 --2- 172.21.15.175:0/3049331300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555792767c00 0x55579271d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:27.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e82800640 1 --2- 172.21.15.175:0/3049331300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 0x55579271dcc0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c007190 tx=0x7f1e7c056480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75bd9bb40fb5018 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e6ea00640 1 -- 172.21.15.175:0/3049331300 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c05e490 con 0x55579271d8e0 2024-04-25T09:07:27.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e6ea00640 1 -- 172.21.15.175:0/3049331300 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c053e20 con 0x55579271d8e0 2024-04-25T09:07:27.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e6ea00640 1 -- 172.21.15.175:0/3049331300 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7c05c0c0 con 0x55579271d8e0 2024-04-25T09:07:27.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/3049331300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 msgr2=0x55579271dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/3049331300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 0x55579271dcc0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c007190 tx=0x7f1e7c056480 comp rx=0 tx=0).stop 2024-04-25T09:07:27.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/3049331300 shutdown_connections 2024-04-25T09:07:27.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/3049331300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 0x55579271dcc0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/3049331300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555792767c00 0x55579271d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/3049331300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5557927672e0 0x5557927676c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/3049331300 >> 172.21.15.175:0/3049331300 conn(0x555792719890 msgr2=0x55579271bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:27.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/3049331300 shutdown_connections 2024-04-25T09:07:27.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/3049331300 wait complete. 2024-04-25T09:07:27.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 -- start start 2024-04-25T09:07:27.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 Processor -- start 2024-04-25T09:07:27.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 0x55579276e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5557927672e0 0x55579276eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555792767c00 0x555792755090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555792566130 con 0x55579271d8e0 2024-04-25T09:07:27.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55579252e130 con 0x5557927672e0 2024-04-25T09:07:27.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x555792628300 con 0x555792767c00 2024-04-25T09:07:27.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e8bfb6000 10 client.0 _ll_register_callbacks cb 0x555792708bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:27.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.964+0000 7f1e81e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 0x55579276e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e81e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 0x55579276e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37684/0 (socket says 172.21.15.175:37684) 2024-04-25T09:07:27.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e81e00640 1 -- 172.21.15.175:0/223855806 learned_addr learned my addr 172.21.15.175:0/223855806 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:27.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e81400640 1 --2- 172.21.15.175:0/223855806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5557927672e0 0x55579276eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e82800640 1 --2- 172.21.15.175:0/223855806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555792767c00 0x555792755090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e81e00640 1 -- 172.21.15.175:0/223855806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555792767c00 msgr2=0x555792755090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e81e00640 1 --2- 172.21.15.175:0/223855806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555792767c00 0x555792755090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e81e00640 1 -- 172.21.15.175:0/223855806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5557927672e0 msgr2=0x55579276eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e81e00640 1 --2- 172.21.15.175:0/223855806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5557927672e0 0x55579276eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e81e00640 1 -- 172.21.15.175:0/223855806 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555792547060 con 0x55579271d8e0 2024-04-25T09:07:27.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e81e00640 1 --2- 172.21.15.175:0/223855806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 0x55579276e640 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f1e7401a4c0 tx=0x7f1e7401b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cf17e6c5198fe1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e63400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:07:27.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e63400640 1 -- 172.21.15.175:0/223855806 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e740ca020 con 0x55579271d8e0 2024-04-25T09:07:27.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e63400640 1 -- 172.21.15.175:0/223855806 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e740c5440 con 0x55579271d8e0 2024-04-25T09:07:27.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/223855806 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1e7c053e20 con 0x55579271d8e0 2024-04-25T09:07:27.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e63400640 1 -- 172.21.15.175:0/223855806 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e740b2040 con 0x55579271d8e0 2024-04-25T09:07:27.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 10 client.6231 fetch_fsmap learned FSMap version 33 2024-04-25T09:07:27.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/223855806 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x55579250b7c0 con 0x55579271d8e0 2024-04-25T09:07:27.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e63400640 1 -- 172.21.15.175:0/223855806 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7c053e20 con 0x55579271d8e0 2024-04-25T09:07:27.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e63400640 1 -- 172.21.15.175:0/223855806 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 33) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1e740c5640 con 0x55579271d8e0 2024-04-25T09:07:27.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 10 client.6231 fetch_fsmap finished waiting for FSMap version 33 2024-04-25T09:07:27.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 10 client.6231 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:07:27.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 20 client.6231 populate_metadata read hostname 'smithi175' 2024-04-25T09:07:27.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/223855806 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x555792755e30 0x555792756210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 4 client.6231 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:07:27.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/223855806 --> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555792505cd0 con 0x555792755e30 2024-04-25T09:07:27.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e81400640 1 --2- 172.21.15.175:0/223855806 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x555792755e30 0x555792756210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e81400640 1 --2- 172.21.15.175:0/223855806 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x555792755e30 0x555792756210 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b734f3d30e2e59 server_cookie=2e7ff8b3ed42b307 in_seq=0 out_seq=0 2024-04-25T09:07:27.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e63400640 10 client.6231 ms_handle_connect on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:27.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e63400640 1 -- 172.21.15.175:0/223855806 <== mds.0 v2:172.21.15.175:6836/1478147147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555792505cd0 con 0x555792755e30 2024-04-25T09:07:27.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e63400640 10 client.6231 handle_command_reply: tid=0 2024-04-25T09:07:27.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 1 client.6231 shutdown 2024-04-25T09:07:27.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/223855806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 msgr2=0x55579276e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/223855806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 0x55579276e640 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f1e7401a4c0 tx=0x7f1e7401b0d0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/223855806 shutdown_connections 2024-04-25T09:07:27.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/223855806 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x555792755e30 0x555792756210 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/223855806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555792767c00 0x555792755090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/223855806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5557927672e0 0x55579276eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e63400640 0 client.6231 ms_handle_reset on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:27.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/223855806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 0x55579276e640 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/223855806 >> 172.21.15.175:0/223855806 conn(0x555792719890 msgr2=0x55579271c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:27.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/223855806 shutdown_connections 2024-04-25T09:07:27.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/223855806 wait complete. 2024-04-25T09:07:27.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.968+0000 7f1e8bfb6000 20 client.6231 trim_cache size 0 max 16384 2024-04-25T09:07:27.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.980+0000 7f1e8bfb6000 1 Processor -- start 2024-04-25T09:07:27.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.980+0000 7f1e8bfb6000 1 -- start start 2024-04-25T09:07:27.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 0x5557927cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5557927672e0 0x5557927cc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555792767c00 0x5557927cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e84201b00 con 0x55579271d8e0 2024-04-25T09:07:27.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e841432f0 con 0x5557927672e0 2024-04-25T09:07:27.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840adf70 con 0x555792767c00 2024-04-25T09:07:27.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e81e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 0x5557927cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e81e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 0x5557927cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37700/0 (socket says 172.21.15.175:37700) 2024-04-25T09:07:27.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e81e00640 1 -- 172.21.15.175:0/4046346500 learned_addr learned my addr 172.21.15.175:0/4046346500 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:27.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e82800640 1 --2- 172.21.15.175:0/4046346500 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555792767c00 0x5557927cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e81400640 1 --2- 172.21.15.175:0/4046346500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5557927672e0 0x5557927cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e81e00640 1 -- 172.21.15.175:0/4046346500 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555792767c00 msgr2=0x5557927cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e81e00640 1 --2- 172.21.15.175:0/4046346500 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555792767c00 0x5557927cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e81e00640 1 -- 172.21.15.175:0/4046346500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5557927672e0 msgr2=0x5557927cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e81e00640 1 --2- 172.21.15.175:0/4046346500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5557927672e0 0x5557927cc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e81e00640 1 -- 172.21.15.175:0/4046346500 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555792525fc0 con 0x55579271d8e0 2024-04-25T09:07:27.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e81e00640 1 --2- 172.21.15.175:0/4046346500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 0x5557927cbd10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1e7401c6c0 tx=0x7f1e740c3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de90021586b55125 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e6e000640 1 -- 172.21.15.175:0/4046346500 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e740dd070 con 0x55579271d8e0 2024-04-25T09:07:27.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e6e000640 1 -- 172.21.15.175:0/4046346500 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e740a5970 con 0x55579271d8e0 2024-04-25T09:07:27.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e6e000640 1 -- 172.21.15.175:0/4046346500 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e740ca040 con 0x55579271d8e0 2024-04-25T09:07:27.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/4046346500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 msgr2=0x5557927cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/4046346500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 0x5557927cbd10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1e7401c6c0 tx=0x7f1e740c3000 comp rx=0 tx=0).stop 2024-04-25T09:07:27.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/4046346500 shutdown_connections 2024-04-25T09:07:27.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/4046346500 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555792767c00 0x5557927cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/4046346500 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5557927672e0 0x5557927cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/4046346500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55579271d8e0 0x5557927cbd10 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/4046346500 >> 172.21.15.175:0/4046346500 conn(0x555792719890 msgr2=0x555792766290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:27.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/4046346500 shutdown_connections 2024-04-25T09:07:27.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/4046346500 wait complete. 2024-04-25T09:07:27.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 -- start start 2024-04-25T09:07:27.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 Processor -- start 2024-04-25T09:07:27.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55579271d8e0 0x5557927d0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557927672e0 0x5557927d0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555792767c00 0x55579276b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555792504e70 con 0x5557927672e0 2024-04-25T09:07:27.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557924f2a50 con 0x55579271d8e0 2024-04-25T09:07:27.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557925693a0 con 0x555792767c00 2024-04-25T09:07:27.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.984+0000 7f1e8bfb6000 10 client.0 _ll_register_callbacks cb 0x555792516240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:27.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e81400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557927672e0 0x5557927d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e81e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55579271d8e0 0x5557927d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e81400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557927672e0 0x5557927d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37704/0 (socket says 172.21.15.175:37704) 2024-04-25T09:07:27.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e81400640 1 -- 172.21.15.175:0/614891221 learned_addr learned my addr 172.21.15.175:0/614891221 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:27.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e82800640 1 --2- 172.21.15.175:0/614891221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555792767c00 0x55579276b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e81400640 1 -- 172.21.15.175:0/614891221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555792767c00 msgr2=0x55579276b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e81400640 1 --2- 172.21.15.175:0/614891221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555792767c00 0x55579276b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e81400640 1 -- 172.21.15.175:0/614891221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55579271d8e0 msgr2=0x5557927d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:27.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e81400640 1 --2- 172.21.15.175:0/614891221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55579271d8e0 0x5557927d0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e81400640 1 -- 172.21.15.175:0/614891221 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557925c39e0 con 0x5557927672e0 2024-04-25T09:07:27.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e81400640 1 --2- 172.21.15.175:0/614891221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557927672e0 0x5557927d0680 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1e70007fd0 tx=0x7f1e70005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c16d22a2c3d6c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:27.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e63400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:07:27.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e63400640 1 -- 172.21.15.175:0/614891221 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e70016be0 con 0x5557927672e0 2024-04-25T09:07:27.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e63400640 1 -- 172.21.15.175:0/614891221 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e70010040 con 0x5557927672e0 2024-04-25T09:07:27.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/614891221 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1e740a5970 con 0x5557927672e0 2024-04-25T09:07:27.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e63400640 1 -- 172.21.15.175:0/614891221 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e70016d80 con 0x5557927672e0 2024-04-25T09:07:27.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 10 client.6237 fetch_fsmap learned FSMap version 33 2024-04-25T09:07:27.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/614891221 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x555792509630 con 0x5557927672e0 2024-04-25T09:07:27.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e63400640 1 -- 172.21.15.175:0/614891221 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e740a5970 con 0x5557927672e0 2024-04-25T09:07:27.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e63400640 1 -- 172.21.15.175:0/614891221 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 33) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1e7002d050 con 0x5557927672e0 2024-04-25T09:07:27.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 10 client.6237 fetch_fsmap finished waiting for FSMap version 33 2024-04-25T09:07:27.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 10 client.6237 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:07:27.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 20 client.6237 populate_metadata read hostname 'smithi175' 2024-04-25T09:07:27.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/614891221 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5557927d6fa0 0x5557927d9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:27.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 4 client.6237 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:07:27.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/614891221 --> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x5557925775d0 con 0x5557927d6fa0 2024-04-25T09:07:27.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e81e00640 1 --2- 172.21.15.175:0/614891221 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5557927d6fa0 0x5557927d9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:27.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e81e00640 1 --2- 172.21.15.175:0/614891221 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5557927d6fa0 0x5557927d9390 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae330a3378fc0d43 server_cookie=321921b3d78390b8 in_seq=0 out_seq=0 2024-04-25T09:07:27.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e63400640 10 client.6237 ms_handle_connect on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:27.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e63400640 1 -- 172.21.15.175:0/614891221 <== mds.0 v2:172.21.15.175:6836/1478147147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+141 (crc 0 0 0) 0x5557925775d0 con 0x5557927d6fa0 2024-04-25T09:07:27.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e63400640 10 client.6237 handle_command_reply: tid=0 2024-04-25T09:07:27.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 1 client.6237 shutdown 2024-04-25T09:07:27.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/614891221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557927672e0 msgr2=0x5557927d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/614891221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557927672e0 0x5557927d0680 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1e70007fd0 tx=0x7f1e70005f10 comp rx=0 tx=0).stop 2024-04-25T09:07:27.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/614891221 shutdown_connections 2024-04-25T09:07:27.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/614891221 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5557927d6fa0 0x5557927d9390 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/614891221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555792767c00 0x55579276b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/614891221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5557927672e0 0x5557927d0680 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 1 --2- 172.21.15.175:0/614891221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55579271d8e0 0x5557927d0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e63400640 0 client.6237 ms_handle_reset on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:27.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/614891221 >> 172.21.15.175:0/614891221 conn(0x555792719890 msgr2=0x555792766b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:27.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/614891221 shutdown_connections 2024-04-25T09:07:27.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 1 -- 172.21.15.175:0/614891221 wait complete. 2024-04-25T09:07:27.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e8bfb6000 20 client.6237 trim_cache size 0 max 16384 2024-04-25T09:07:27.983 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:07:27.983 INFO:teuthology.orchestra.run.smithi175.stdout:[ 2024-04-25T09:07:27.983 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:07:27.983 INFO:teuthology.orchestra.run.smithi175.stdout: "damage_type": "backtrace", 2024-04-25T09:07:27.984 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 1428676108, 2024-04-25T09:07:27.984 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 1099511627777, 2024-04-25T09:07:27.984 INFO:teuthology.orchestra.run.smithi175.stdout: "path": "/dir_test/file" 2024-04-25T09:07:27.984 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:07:27.984 INFO:teuthology.orchestra.run.smithi175.stdout:] 2024-04-25T09:07:27.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e88c00640 1 -- 172.21.15.175:0/1977439775 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1e64066f60 msgr2=0x7f1e64069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e88c00640 1 --2- 172.21.15.175:0/1977439775 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1e64066f60 0x7f1e64069420 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1e740af000 tx=0x7f1e740a7070 comp rx=0 tx=0).stop 2024-04-25T09:07:27.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e88c00640 1 -- 172.21.15.175:0/1977439775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e841600a0 msgr2=0x7f1e8415b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:27.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e88c00640 1 --2- 172.21.15.175:0/1977439775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e841600a0 0x7f1e8415b170 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c00d800 tx=0x7f1e7c00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e88c00640 1 -- 172.21.15.175:0/1977439775 shutdown_connections 2024-04-25T09:07:27.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e88c00640 1 --2- 172.21.15.175:0/1977439775 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1e64066f60 0x7f1e64069420 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e88c00640 1 --2- 172.21.15.175:0/1977439775 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e841600a0 0x7f1e8415b170 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e88c00640 1 --2- 172.21.15.175:0/1977439775 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e84145250 0x7f1e840b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e88c00640 1 --2- 172.21.15.175:0/1977439775 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e840ce970 0x7f1e841f6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:27.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e88c00640 1 -- 172.21.15.175:0/1977439775 >> 172.21.15.175:0/1977439775 conn(0x7f1e8406ac50 msgr2=0x7f1e840cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:27.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.988+0000 7f1e88c00640 1 -- 172.21.15.175:0/1977439775 shutdown_connections 2024-04-25T09:07:27.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:27.992+0000 7f1e88c00640 1 -- 172.21.15.175:0/1977439775 wait complete. 2024-04-25T09:07:27.999 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:07:28.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.144+0000 7f7870a00640 1 Processor -- start 2024-04-25T09:07:28.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.144+0000 7f7870a00640 1 -- start start 2024-04-25T09:07:28.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.144+0000 7f7870a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f786c099a50 0x7f786c0cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.144+0000 7f7870a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f786c15bc10 0x7f786c099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.144+0000 7f7870a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786c09a370 con 0x7f786c09abb0 2024-04-25T09:07:28.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.144+0000 7f7870a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786c0d06f0 con 0x7f786c099a50 2024-04-25T09:07:28.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.144+0000 7f7870a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786c0cc4c0 con 0x7f786c15bc10 2024-04-25T09:07:28.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.144+0000 7f7869e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f786c099a50 0x7f786c0cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.144+0000 7f7869e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f786c099a50 0x7f786c0cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37706/0 (socket says 172.21.15.175:37706) 2024-04-25T09:07:28.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.144+0000 7f7869e00640 1 -- 172.21.15.175:0/3511670485 learned_addr learned my addr 172.21.15.175:0/3511670485 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:28.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.144+0000 7f7861400640 1 --2- 172.21.15.175:0/3511670485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f786c15bc10 0x7f786c099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.144+0000 7f7869e00640 1 -- 172.21.15.175:0/3511670485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f786c15bc10 msgr2=0x7f786c099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:28.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.144+0000 7f7869e00640 1 --2- 172.21.15.175:0/3511670485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f786c15bc10 0x7f786c099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.144+0000 7f7869e00640 1 -- 172.21.15.175:0/3511670485 >> v1:172.21.15.177:6789/0 conn(0x7f786c09abb0 legacy=0x7f786c0cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.144+0000 7f7869e00640 1 -- 172.21.15.175:0/3511670485 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c0cc7a0 con 0x7f786c099a50 2024-04-25T09:07:28.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.148+0000 7f7869e00640 1 --2- 172.21.15.175:0/3511670485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f786c099a50 0x7f786c0cd280 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f785c009e50 tx=0x7f785c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693fd861182fe33e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.148+0000 7f7869400640 1 -- 172.21.15.175:0/3511670485 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c0a5810 con 0x7f786c099a50 2024-04-25T09:07:28.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.148+0000 7f7869400640 1 -- 172.21.15.175:0/3511670485 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785c0a59b0 con 0x7f786c099a50 2024-04-25T09:07:28.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.148+0000 7f7869400640 1 -- 172.21.15.175:0/3511670485 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c0a5d80 con 0x7f786c099a50 2024-04-25T09:07:28.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.148+0000 7f7870a00640 1 -- 172.21.15.175:0/3511670485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f786c099a50 msgr2=0x7f786c0cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.148+0000 7f7870a00640 1 --2- 172.21.15.175:0/3511670485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f786c099a50 0x7f786c0cd280 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f785c009e50 tx=0x7f785c01ca30 comp rx=0 tx=0).stop 2024-04-25T09:07:28.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.148+0000 7f7870a00640 1 -- 172.21.15.175:0/3511670485 shutdown_connections 2024-04-25T09:07:28.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.148+0000 7f7870a00640 1 --2- 172.21.15.175:0/3511670485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f786c15bc10 0x7f786c099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.148+0000 7f7870a00640 1 --2- 172.21.15.175:0/3511670485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f786c099a50 0x7f786c0cd280 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.148+0000 7f7870a00640 1 -- 172.21.15.175:0/3511670485 >> 172.21.15.175:0/3511670485 conn(0x7f786c0b3300 msgr2=0x7f786c0b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:28.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.148+0000 7f7870a00640 1 -- 172.21.15.175:0/3511670485 shutdown_connections 2024-04-25T09:07:28.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.148+0000 7f7870a00640 1 -- 172.21.15.175:0/3511670485 wait complete. 2024-04-25T09:07:28.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7870a00640 1 Processor -- start 2024-04-25T09:07:28.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7870a00640 1 -- start start 2024-04-25T09:07:28.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7870a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f786c099a50 0x7f786c1f9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7870a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f786c09abb0 0x7f786c0b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7870a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f786c15bc10 0x7f786c164dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7870a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c0c5f00 con 0x7f786c099a50 2024-04-25T09:07:28.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7870a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c0c5d80 con 0x7f786c09abb0 2024-04-25T09:07:28.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7870a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786c168850 con 0x7f786c15bc10 2024-04-25T09:07:28.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7869e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f786c099a50 0x7f786c1f9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7869e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f786c099a50 0x7f786c1f9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37716/0 (socket says 172.21.15.175:37716) 2024-04-25T09:07:28.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7869e00640 1 -- 172.21.15.175:0/4186637603 learned_addr learned my addr 172.21.15.175:0/4186637603 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:28.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f786a800640 1 --2- 172.21.15.175:0/4186637603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f786c15bc10 0x7f786c164dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7861400640 1 --2- 172.21.15.175:0/4186637603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f786c09abb0 0x7f786c0b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7869e00640 1 -- 172.21.15.175:0/4186637603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f786c15bc10 msgr2=0x7f786c164dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7869e00640 1 --2- 172.21.15.175:0/4186637603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f786c15bc10 0x7f786c164dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7869e00640 1 -- 172.21.15.175:0/4186637603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f786c09abb0 msgr2=0x7f786c0b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7869e00640 1 --2- 172.21.15.175:0/4186637603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f786c09abb0 0x7f786c0b5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7869e00640 1 -- 172.21.15.175:0/4186637603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c0b5fc0 con 0x7f786c099a50 2024-04-25T09:07:28.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7869e00640 1 --2- 172.21.15.175:0/4186637603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f786c099a50 0x7f786c1f9ff0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f785c01a660 tx=0x7f785c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7862a00640 1 -- 172.21.15.175:0/4186637603 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c0b8470 con 0x7f786c099a50 2024-04-25T09:07:28.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7862a00640 1 -- 172.21.15.175:0/4186637603 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785c0b8630 con 0x7f786c099a50 2024-04-25T09:07:28.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7862a00640 1 -- 172.21.15.175:0/4186637603 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c0b8a20 con 0x7f786c099a50 2024-04-25T09:07:28.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7870a00640 1 -- 172.21.15.175:0/4186637603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f786c0b62a0 con 0x7f786c099a50 2024-04-25T09:07:28.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.152+0000 7f7870a00640 1 -- 172.21.15.175:0/4186637603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786c0b6860 con 0x7f786c099a50 2024-04-25T09:07:28.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.156+0000 7f7870a00640 1 -- 172.21.15.175:0/4186637603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f786c074a60 con 0x7f786c099a50 2024-04-25T09:07:28.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.156+0000 7f7862a00640 1 -- 172.21.15.175:0/4186637603 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f785c0c0030 con 0x7f786c099a50 2024-04-25T09:07:28.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.156+0000 7f7862a00640 1 --2- 172.21.15.175:0/4186637603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7848066f90 0x7f7848069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.156+0000 7f7862a00640 1 -- 172.21.15.175:0/4186637603 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f785c11f6a0 con 0x7f786c099a50 2024-04-25T09:07:28.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.156+0000 7f7861400640 1 --2- 172.21.15.175:0/4186637603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7848066f90 0x7f7848069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.156+0000 7f7861400640 1 --2- 172.21.15.175:0/4186637603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7848066f90 0x7f7848069450 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f786c166470 tx=0x7f7854008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.160+0000 7f7862a00640 1 -- 172.21.15.175:0/4186637603 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f785c0c7060 con 0x7f786c099a50 2024-04-25T09:07:28.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.344+0000 7f7870a00640 1 -- 172.21.15.175:0/4186637603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f786c0b4060 con 0x7f786c099a50 2024-04-25T09:07:28.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.344+0000 7f7862a00640 1 -- 172.21.15.175:0/4186637603 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f785c016620 con 0x7f786c099a50 2024-04-25T09:07:28.335 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:07:28.335 INFO:teuthology.orchestra.run.smithi175.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-25T09:07:28.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.348+0000 7f7870a00640 1 -- 172.21.15.175:0/4186637603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7848066f90 msgr2=0x7f7848069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.348+0000 7f7870a00640 1 --2- 172.21.15.175:0/4186637603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7848066f90 0x7f7848069450 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f786c166470 tx=0x7f7854008040 comp rx=0 tx=0).stop 2024-04-25T09:07:28.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.348+0000 7f7870a00640 1 -- 172.21.15.175:0/4186637603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f786c099a50 msgr2=0x7f786c1f9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.348+0000 7f7870a00640 1 --2- 172.21.15.175:0/4186637603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f786c099a50 0x7f786c1f9ff0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f785c01a660 tx=0x7f785c0197d0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.348+0000 7f7870a00640 1 -- 172.21.15.175:0/4186637603 shutdown_connections 2024-04-25T09:07:28.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.348+0000 7f7870a00640 1 --2- 172.21.15.175:0/4186637603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7848066f90 0x7f7848069450 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.348+0000 7f7870a00640 1 --2- 172.21.15.175:0/4186637603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f786c15bc10 0x7f786c164dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.348+0000 7f7870a00640 1 --2- 172.21.15.175:0/4186637603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f786c09abb0 0x7f786c0b5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.348+0000 7f7870a00640 1 --2- 172.21.15.175:0/4186637603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f786c099a50 0x7f786c1f9ff0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.348+0000 7f7870a00640 1 -- 172.21.15.175:0/4186637603 >> 172.21.15.175:0/4186637603 conn(0x7f786c0b3300 msgr2=0x7f786c06bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:28.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.348+0000 7f7870a00640 1 -- 172.21.15.175:0/4186637603 shutdown_connections 2024-04-25T09:07:28.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.348+0000 7f7870a00640 1 -- 172.21.15.175:0/4186637603 wait complete. 2024-04-25T09:07:28.356 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T09:07:28.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:28.356 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive,force 2024-04-25T09:07:28.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.504+0000 7fa329400640 1 Processor -- start 2024-04-25T09:07:28.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.504+0000 7fa329400640 1 -- start start 2024-04-25T09:07:28.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.508+0000 7fa329400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3240cfb60 0x7fa3240ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.508+0000 7fa329400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa32406d860 0x7fa32406dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.508+0000 7fa329400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa324071e20 con 0x7fa3240ced10 2024-04-25T09:07:28.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.508+0000 7fa329400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3240cbed0 con 0x7fa32406d860 2024-04-25T09:07:28.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.508+0000 7fa329400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32406e1d0 con 0x7fa3240cfb60 2024-04-25T09:07:28.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.508+0000 7fa322800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3240cfb60 0x7fa3240ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.508+0000 7fa322800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3240cfb60 0x7fa3240ce7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:60052/0 (socket says 172.21.15.175:60052) 2024-04-25T09:07:28.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.508+0000 7fa323200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa32406d860 0x7fa32406dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.508+0000 7fa322800640 1 -- 172.21.15.175:0/2842253027 learned_addr learned my addr 172.21.15.175:0/2842253027 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:28.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.508+0000 7fa321e00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fa3240ced10 0x7fa3240712b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:37836/0 (socket says 172.21.15.175:37836) 2024-04-25T09:07:28.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.508+0000 7fa322800640 1 -- 172.21.15.175:0/2842253027 >> v2:172.21.15.177:3300/0 conn(0x7fa32406d860 msgr2=0x7fa32406dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:28.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.508+0000 7fa322800640 1 --2- 172.21.15.175:0/2842253027 >> v2:172.21.15.177:3300/0 conn(0x7fa32406d860 0x7fa32406dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.508+0000 7fa322800640 1 -- 172.21.15.175:0/2842253027 >> v1:172.21.15.177:6789/0 conn(0x7fa3240ced10 legacy=0x7fa3240712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.508+0000 7fa322800640 1 -- 172.21.15.175:0/2842253027 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa324072100 con 0x7fa3240cfb60 2024-04-25T09:07:28.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.512+0000 7fa322800640 1 --2- 172.21.15.175:0/2842253027 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3240cfb60 0x7fa3240ce7d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa314009870 tx=0x7fa31401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=778d1462c038507e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.512+0000 7fa321400640 1 -- 172.21.15.175:0/2842253027 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3140b1070 con 0x7fa3240cfb60 2024-04-25T09:07:28.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.512+0000 7fa321400640 1 -- 172.21.15.175:0/2842253027 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3140ac410 con 0x7fa3240cfb60 2024-04-25T09:07:28.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.512+0000 7fa321400640 1 -- 172.21.15.175:0/2842253027 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3140ac7e0 con 0x7fa3240cfb60 2024-04-25T09:07:28.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.512+0000 7fa329400640 1 -- 172.21.15.175:0/2842253027 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3240cfb60 msgr2=0x7fa3240ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.512+0000 7fa329400640 1 --2- 172.21.15.175:0/2842253027 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3240cfb60 0x7fa3240ce7d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa314009870 tx=0x7fa31401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.512+0000 7fa329400640 1 -- 172.21.15.175:0/2842253027 shutdown_connections 2024-04-25T09:07:28.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.512+0000 7fa329400640 1 --2- 172.21.15.175:0/2842253027 >> v2:172.21.15.177:3300/0 conn(0x7fa32406d860 0x7fa32406dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.512+0000 7fa329400640 1 --2- 172.21.15.175:0/2842253027 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3240cfb60 0x7fa3240ce7d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.512+0000 7fa329400640 1 -- 172.21.15.175:0/2842253027 >> 172.21.15.175:0/2842253027 conn(0x7fa32406ac50 msgr2=0x7fa32406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:28.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.512+0000 7fa329400640 1 -- 172.21.15.175:0/2842253027 shutdown_connections 2024-04-25T09:07:28.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.512+0000 7fa329400640 1 -- 172.21.15.175:0/2842253027 wait complete. 2024-04-25T09:07:28.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.512+0000 7fa329400640 1 Processor -- start 2024-04-25T09:07:28.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.512+0000 7fa329400640 1 -- start start 2024-04-25T09:07:28.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa329400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa32406d860 0x7fa32415d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa329400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3240ced10 0x7fa3240b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa329400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3240cfb60 0x7fa32415f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa329400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240d00c0 con 0x7fa3240ced10 2024-04-25T09:07:28.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa329400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240cff40 con 0x7fa3240cfb60 2024-04-25T09:07:28.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa329400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240719c0 con 0x7fa32406d860 2024-04-25T09:07:28.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa321e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3240ced10 0x7fa3240b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa321e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3240ced10 0x7fa3240b0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37720/0 (socket says 172.21.15.175:37720) 2024-04-25T09:07:28.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa321e00640 1 -- 172.21.15.175:0/3925511566 learned_addr learned my addr 172.21.15.175:0/3925511566 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:28.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa322800640 1 --2- 172.21.15.175:0/3925511566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa32406d860 0x7fa32415d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa323200640 1 --2- 172.21.15.175:0/3925511566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3240cfb60 0x7fa32415f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa321e00640 1 -- 172.21.15.175:0/3925511566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa32406d860 msgr2=0x7fa32415d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa321e00640 1 --2- 172.21.15.175:0/3925511566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa32406d860 0x7fa32415d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa321e00640 1 -- 172.21.15.175:0/3925511566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3240cfb60 msgr2=0x7fa32415f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa321e00640 1 --2- 172.21.15.175:0/3925511566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3240cfb60 0x7fa32415f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa321e00640 1 -- 172.21.15.175:0/3925511566 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3240b0a50 con 0x7fa3240ced10 2024-04-25T09:07:28.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa321e00640 1 --2- 172.21.15.175:0/3925511566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3240ced10 0x7fa3240b0370 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa31000c420 tx=0x7fa31000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa31aa00640 1 -- 172.21.15.175:0/3925511566 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3100074e0 con 0x7fa3240ced10 2024-04-25T09:07:28.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa31aa00640 1 -- 172.21.15.175:0/3925511566 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa310007680 con 0x7fa3240ced10 2024-04-25T09:07:28.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa31aa00640 1 -- 172.21.15.175:0/3925511566 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310004a30 con 0x7fa3240ced10 2024-04-25T09:07:28.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa329400640 1 -- 172.21.15.175:0/3925511566 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3240b0d30 con 0x7fa3240ced10 2024-04-25T09:07:28.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.516+0000 7fa329400640 1 -- 172.21.15.175:0/3925511566 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa324141470 con 0x7fa3240ced10 2024-04-25T09:07:28.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa31aa00640 1 -- 172.21.15.175:0/3925511566 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa31001a020 con 0x7fa3240ced10 2024-04-25T09:07:28.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa31aa00640 1 --2- 172.21.15.175:0/3925511566 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa304066f60 0x7fa304069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa31aa00640 1 -- 172.21.15.175:0/3925511566 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3100847c0 con 0x7fa3240ced10 2024-04-25T09:07:28.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa32c94f000 1 Processor -- start 2024-04-25T09:07:28.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa322800640 1 --2- 172.21.15.175:0/3925511566 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa304066f60 0x7fa304069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa32c94f000 1 -- start start 2024-04-25T09:07:28.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa322800640 1 --2- 172.21.15.175:0/3925511566 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa304066f60 0x7fa304069420 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa3140ae000 tx=0x7fa3140a6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa32c94f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 0x557ac80e3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa32c94f000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac80e3e40 0x557ac809a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa32c94f000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac809a970 0x557ac809ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa32c94f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ac7ee7d00 con 0x557ac80e3520 2024-04-25T09:07:28.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa32c94f000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ac7e6fdf0 con 0x557ac809a970 2024-04-25T09:07:28.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa32c94f000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ac7ee3da0 con 0x557ac80e3e40 2024-04-25T09:07:28.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa322800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 0x557ac80e3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa322800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 0x557ac80e3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37732/0 (socket says 172.21.15.175:37732) 2024-04-25T09:07:28.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa322800640 1 -- 172.21.15.175:0/1704480533 learned_addr learned my addr 172.21.15.175:0/1704480533 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:28.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa323200640 1 --2- 172.21.15.175:0/1704480533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac809a970 0x557ac809ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa321e00640 1 --2- 172.21.15.175:0/1704480533 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac80e3e40 0x557ac809a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa322800640 1 -- 172.21.15.175:0/1704480533 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac80e3e40 msgr2=0x557ac809a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:28.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa322800640 1 --2- 172.21.15.175:0/1704480533 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac80e3e40 0x557ac809a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa322800640 1 -- 172.21.15.175:0/1704480533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac809a970 msgr2=0x557ac809ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:28.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa322800640 1 --2- 172.21.15.175:0/1704480533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac809a970 0x557ac809ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa322800640 1 -- 172.21.15.175:0/1704480533 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ac7ea2580 con 0x557ac80e3520 2024-04-25T09:07:28.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa322800640 1 --2- 172.21.15.175:0/1704480533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 0x557ac80e3900 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa3140af040 tx=0x7fa314004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf27cd529fabb21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa30f400640 1 -- 172.21.15.175:0/1704480533 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3140c8070 con 0x557ac80e3520 2024-04-25T09:07:28.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa30f400640 1 -- 172.21.15.175:0/1704480533 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3140b7530 con 0x557ac80e3520 2024-04-25T09:07:28.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.520+0000 7fa30f400640 1 -- 172.21.15.175:0/1704480533 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3140b1040 con 0x557ac80e3520 2024-04-25T09:07:28.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 -- 172.21.15.175:0/1704480533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 msgr2=0x557ac80e3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 --2- 172.21.15.175:0/1704480533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 0x557ac80e3900 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa3140af040 tx=0x7fa314004740 comp rx=0 tx=0).stop 2024-04-25T09:07:28.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 -- 172.21.15.175:0/1704480533 shutdown_connections 2024-04-25T09:07:28.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 --2- 172.21.15.175:0/1704480533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac809a970 0x557ac809ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 --2- 172.21.15.175:0/1704480533 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac80e3e40 0x557ac809a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 --2- 172.21.15.175:0/1704480533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 0x557ac80e3900 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 -- 172.21.15.175:0/1704480533 >> 172.21.15.175:0/1704480533 conn(0x557ac7f81c10 msgr2=0x557ac8098d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:28.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 -- 172.21.15.175:0/1704480533 shutdown_connections 2024-04-25T09:07:28.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 -- 172.21.15.175:0/1704480533 wait complete. 2024-04-25T09:07:28.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 -- start start 2024-04-25T09:07:28.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 Processor -- start 2024-04-25T09:07:28.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac809a970 0x557ac80e9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 0x557ac80ea0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac80e3e40 0x557ac809ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ac7e806d0 con 0x557ac80e3520 2024-04-25T09:07:28.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ac7ea2950 con 0x557ac80e3e40 2024-04-25T09:07:28.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ac7ee7010 con 0x557ac809a970 2024-04-25T09:07:28.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 10 client.0 _ll_register_callbacks cb 0x557ac8086030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:28.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa321e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 0x557ac80ea0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa321e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 0x557ac80ea0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37748/0 (socket says 172.21.15.175:37748) 2024-04-25T09:07:28.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa321e00640 1 -- 172.21.15.175:0/3868512105 learned_addr learned my addr 172.21.15.175:0/3868512105 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:28.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa323200640 1 --2- 172.21.15.175:0/3868512105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac80e3e40 0x557ac809ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa322800640 1 --2- 172.21.15.175:0/3868512105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac809a970 0x557ac80e9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa321e00640 1 -- 172.21.15.175:0/3868512105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac809a970 msgr2=0x557ac80e9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:28.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa321e00640 1 --2- 172.21.15.175:0/3868512105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac809a970 0x557ac80e9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa321e00640 1 -- 172.21.15.175:0/3868512105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac80e3e40 msgr2=0x557ac809ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:28.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa321e00640 1 --2- 172.21.15.175:0/3868512105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac80e3e40 0x557ac809ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa321e00640 1 -- 172.21.15.175:0/3868512105 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ac7e84d40 con 0x557ac80e3520 2024-04-25T09:07:28.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa323200640 1 --2- 172.21.15.175:0/3868512105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac80e3e40 0x557ac809ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:28.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa321e00640 1 --2- 172.21.15.175:0/3868512105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 0x557ac80ea0a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa31000cde0 tx=0x7fa31005d740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e9d1e78a02839b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa303e00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:07:28.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa303e00640 1 -- 172.21.15.175:0/3868512105 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310080020 con 0x557ac80e3520 2024-04-25T09:07:28.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa303e00640 1 -- 172.21.15.175:0/3868512105 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa310004bd0 con 0x557ac80e3520 2024-04-25T09:07:28.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 -- 172.21.15.175:0/3868512105 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa3140b7530 con 0x557ac80e3520 2024-04-25T09:07:28.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa303e00640 1 -- 172.21.15.175:0/3868512105 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa310073170 con 0x557ac80e3520 2024-04-25T09:07:28.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 10 client.6252 fetch_fsmap learned FSMap version 33 2024-04-25T09:07:28.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 -- 172.21.15.175:0/3868512105 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x557ac7ee2cf0 con 0x557ac80e3520 2024-04-25T09:07:28.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa303e00640 1 -- 172.21.15.175:0/3868512105 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3140b7530 con 0x557ac80e3520 2024-04-25T09:07:28.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa303e00640 1 -- 172.21.15.175:0/3868512105 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 33) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa31005d2b0 con 0x557ac80e3520 2024-04-25T09:07:28.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 10 client.6252 fetch_fsmap finished waiting for FSMap version 33 2024-04-25T09:07:28.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 10 client.6252 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:07:28.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 20 client.6252 populate_metadata read hostname 'smithi175' 2024-04-25T09:07:28.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 --2- 172.21.15.175:0/3868512105 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x557ac809fba0 0x557ac809ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 4 client.6252 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:07:28.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.524+0000 7fa32c94f000 1 -- 172.21.15.175:0/3868512105 --> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557ac7e839d0 con 0x557ac809fba0 2024-04-25T09:07:28.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.528+0000 7fa322800640 1 --2- 172.21.15.175:0/3868512105 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x557ac809fba0 0x557ac809ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.528+0000 7fa322800640 1 --2- 172.21.15.175:0/3868512105 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x557ac809fba0 0x557ac809ff80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6f0032c930368ca server_cookie=b830eb44468ad96d in_seq=0 out_seq=0 2024-04-25T09:07:28.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.528+0000 7fa303e00640 10 client.6252 ms_handle_connect on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:28.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.528+0000 7fa303e00640 1 -- 172.21.15.175:0/3868512105 <== mds.0 v2:172.21.15.175:6836/1478147147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557ac7e839d0 con 0x557ac809fba0 2024-04-25T09:07:28.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.528+0000 7fa303e00640 10 client.6252 handle_command_reply: tid=0 2024-04-25T09:07:28.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.528+0000 7fa32c94f000 1 client.6252 shutdown 2024-04-25T09:07:28.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.528+0000 7fa32c94f000 1 -- 172.21.15.175:0/3868512105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 msgr2=0x557ac80ea0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.528+0000 7fa32c94f000 1 --2- 172.21.15.175:0/3868512105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 0x557ac80ea0a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa31000cde0 tx=0x7fa31005d740 comp rx=0 tx=0).stop 2024-04-25T09:07:28.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.528+0000 7fa32c94f000 1 -- 172.21.15.175:0/3868512105 shutdown_connections 2024-04-25T09:07:28.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.528+0000 7fa32c94f000 1 --2- 172.21.15.175:0/3868512105 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x557ac809fba0 0x557ac809ff80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.528+0000 7fa32c94f000 1 --2- 172.21.15.175:0/3868512105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac80e3e40 0x557ac809ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.528+0000 7fa32c94f000 1 --2- 172.21.15.175:0/3868512105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 0x557ac80ea0a0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.528+0000 7fa32c94f000 1 --2- 172.21.15.175:0/3868512105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac809a970 0x557ac80e9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.528+0000 7fa32c94f000 1 -- 172.21.15.175:0/3868512105 >> 172.21.15.175:0/3868512105 conn(0x557ac7f81c10 msgr2=0x557ac8099420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:28.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.528+0000 7fa303e00640 0 client.6252 ms_handle_reset on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:28.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.528+0000 7fa32c94f000 1 -- 172.21.15.175:0/3868512105 shutdown_connections 2024-04-25T09:07:28.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.528+0000 7fa32c94f000 1 -- 172.21.15.175:0/3868512105 wait complete. 2024-04-25T09:07:28.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.528+0000 7fa32c94f000 20 client.6252 trim_cache size 0 max 16384 2024-04-25T09:07:28.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 Processor -- start 2024-04-25T09:07:28.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 -- start start 2024-04-25T09:07:28.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac809a970 0x557ac813ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 0x557ac813f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac80e3e40 0x557ac813f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa324202ee0 con 0x557ac80e3520 2024-04-25T09:07:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3242020e0 con 0x557ac809a970 2024-04-25T09:07:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa324142840 con 0x557ac80e3e40 2024-04-25T09:07:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa321e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 0x557ac813f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa321e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 0x557ac813f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37756/0 (socket says 172.21.15.175:37756) 2024-04-25T09:07:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa321e00640 1 -- 172.21.15.175:0/1278074068 learned_addr learned my addr 172.21.15.175:0/1278074068 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa322800640 1 --2- 172.21.15.175:0/1278074068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac809a970 0x557ac813ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa323200640 1 --2- 172.21.15.175:0/1278074068 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac80e3e40 0x557ac813f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa321e00640 1 -- 172.21.15.175:0/1278074068 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac80e3e40 msgr2=0x557ac813f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:28.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa321e00640 1 --2- 172.21.15.175:0/1278074068 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac80e3e40 0x557ac813f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa321e00640 1 -- 172.21.15.175:0/1278074068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac809a970 msgr2=0x557ac813ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:28.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa321e00640 1 --2- 172.21.15.175:0/1278074068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac809a970 0x557ac813ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa321e00640 1 -- 172.21.15.175:0/1278074068 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ac80e3c70 con 0x557ac80e3520 2024-04-25T09:07:28.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa321e00640 1 --2- 172.21.15.175:0/1278074068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 0x557ac813f1f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa310054d90 tx=0x7fa310015070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ab062569975954 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa30ea00640 1 -- 172.21.15.175:0/1278074068 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310080070 con 0x557ac80e3520 2024-04-25T09:07:28.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa30ea00640 1 -- 172.21.15.175:0/1278074068 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31007b070 con 0x557ac80e3520 2024-04-25T09:07:28.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa30ea00640 1 -- 172.21.15.175:0/1278074068 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310054530 con 0x557ac80e3520 2024-04-25T09:07:28.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 -- 172.21.15.175:0/1278074068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 msgr2=0x557ac813f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 --2- 172.21.15.175:0/1278074068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 0x557ac813f1f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa310054d90 tx=0x7fa310015070 comp rx=0 tx=0).stop 2024-04-25T09:07:28.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 -- 172.21.15.175:0/1278074068 shutdown_connections 2024-04-25T09:07:28.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 --2- 172.21.15.175:0/1278074068 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac80e3e40 0x557ac813f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 --2- 172.21.15.175:0/1278074068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac80e3520 0x557ac813f1f0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 --2- 172.21.15.175:0/1278074068 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac809a970 0x557ac813ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 -- 172.21.15.175:0/1278074068 >> 172.21.15.175:0/1278074068 conn(0x557ac7f81c10 msgr2=0x557ac80e25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:28.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 -- 172.21.15.175:0/1278074068 shutdown_connections 2024-04-25T09:07:28.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 -- 172.21.15.175:0/1278074068 wait complete. 2024-04-25T09:07:28.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 -- start start 2024-04-25T09:07:28.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.544+0000 7fa32c94f000 1 Processor -- start 2024-04-25T09:07:28.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa32c94f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac809a970 0x557ac8140c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa32c94f000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac80e3520 0x557ac8141170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa32c94f000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac80e3e40 0x557ac81416b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa32c94f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ac7e9ed70 con 0x557ac809a970 2024-04-25T09:07:28.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa32c94f000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa324201b10 con 0x557ac80e3520 2024-04-25T09:07:28.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa32c94f000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ac7e8e8c0 con 0x557ac80e3e40 2024-04-25T09:07:28.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa32c94f000 10 client.0 _ll_register_callbacks cb 0x7fa31c0095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:28.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa322800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac809a970 0x557ac8140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa322800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac809a970 0x557ac8140c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37758/0 (socket says 172.21.15.175:37758) 2024-04-25T09:07:28.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa322800640 1 -- 172.21.15.175:0/825070919 learned_addr learned my addr 172.21.15.175:0/825070919 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:28.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa323200640 1 --2- 172.21.15.175:0/825070919 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac80e3e40 0x557ac81416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa321e00640 1 --2- 172.21.15.175:0/825070919 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac80e3520 0x557ac8141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa322800640 1 -- 172.21.15.175:0/825070919 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac80e3e40 msgr2=0x557ac81416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa322800640 1 --2- 172.21.15.175:0/825070919 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac80e3e40 0x557ac81416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa322800640 1 -- 172.21.15.175:0/825070919 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac80e3520 msgr2=0x557ac8141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa322800640 1 --2- 172.21.15.175:0/825070919 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac80e3520 0x557ac8141170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa322800640 1 -- 172.21.15.175:0/825070919 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ac7f6ad30 con 0x557ac809a970 2024-04-25T09:07:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa322800640 1 --2- 172.21.15.175:0/825070919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac809a970 0x557ac8140c30 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa3140af040 tx=0x7fa3140b5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d6a89a3e56e4e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa303e00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:07:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa303e00640 1 -- 172.21.15.175:0/825070919 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3140c8040 con 0x557ac809a970 2024-04-25T09:07:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa303e00640 1 -- 172.21.15.175:0/825070919 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3140cd520 con 0x557ac809a970 2024-04-25T09:07:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa32c94f000 1 -- 172.21.15.175:0/825070919 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa31007b070 con 0x557ac809a970 2024-04-25T09:07:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa303e00640 1 -- 172.21.15.175:0/825070919 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3140dd050 con 0x557ac809a970 2024-04-25T09:07:28.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa32c94f000 10 client.6258 fetch_fsmap learned FSMap version 33 2024-04-25T09:07:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa32c94f000 1 -- 172.21.15.175:0/825070919 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x557ac7eb45a0 con 0x557ac809a970 2024-04-25T09:07:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa303e00640 1 -- 172.21.15.175:0/825070919 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31007b070 con 0x557ac809a970 2024-04-25T09:07:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa303e00640 1 -- 172.21.15.175:0/825070919 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 33) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa3140e0020 con 0x557ac809a970 2024-04-25T09:07:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa32c94f000 10 client.6258 fetch_fsmap finished waiting for FSMap version 33 2024-04-25T09:07:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa32c94f000 10 client.6258 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:07:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa32c94f000 20 client.6258 populate_metadata read hostname 'smithi175' 2024-04-25T09:07:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa32c94f000 1 --2- 172.21.15.175:0/825070919 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x557ac8142040 0x557ac814c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa32c94f000 4 client.6258 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}] 2024-04-25T09:07:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa32c94f000 1 -- 172.21.15.175:0/825070919 --> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}) v1 -- 0x557ac7ec4610 con 0x557ac8142040 2024-04-25T09:07:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa321e00640 1 --2- 172.21.15.175:0/825070919 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x557ac8142040 0x557ac814c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa321e00640 1 --2- 172.21.15.175:0/825070919 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x557ac8142040 0x557ac814c5f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9eefe108b1aae2e server_cookie=2b8ca5950f63cc0a in_seq=0 out_seq=0 2024-04-25T09:07:28.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.548+0000 7fa303e00640 10 client.6258 ms_handle_connect on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:28.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa303e00640 1 -- 172.21.15.175:0/825070919 <== mds.0 v2:172.21.15.175:6836/1478147147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x557ac7ec4610 con 0x557ac8142040 2024-04-25T09:07:28.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa303e00640 10 client.6258 handle_command_reply: tid=0 2024-04-25T09:07:28.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa32c94f000 1 client.6258 shutdown 2024-04-25T09:07:28.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa32c94f000 1 -- 172.21.15.175:0/825070919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac809a970 msgr2=0x557ac8140c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa32c94f000 1 --2- 172.21.15.175:0/825070919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac809a970 0x557ac8140c30 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fa3140af040 tx=0x7fa3140b5000 comp rx=0 tx=0).stop 2024-04-25T09:07:28.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa32c94f000 1 -- 172.21.15.175:0/825070919 shutdown_connections 2024-04-25T09:07:28.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa32c94f000 1 --2- 172.21.15.175:0/825070919 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x557ac8142040 0x557ac814c5f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa32c94f000 1 --2- 172.21.15.175:0/825070919 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557ac80e3e40 0x557ac81416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa32c94f000 1 --2- 172.21.15.175:0/825070919 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557ac80e3520 0x557ac8141170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa32c94f000 1 --2- 172.21.15.175:0/825070919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557ac809a970 0x557ac8140c30 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa32c94f000 1 -- 172.21.15.175:0/825070919 >> 172.21.15.175:0/825070919 conn(0x557ac7f81c10 msgr2=0x557ac80e4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:28.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa303e00640 0 client.6258 ms_handle_reset on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:28.545 INFO:tasks.ceph.mds.a.smithi175.stderr:2024-04-25T09:07:28.552+0000 7f3260800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v4 ap=1 DIRTYPARENT s=0 n(v0 rc2024-04-25T09:06:55.872956+0000 1=1+0) (iversion lock) caps={6129=pAsLsXsFs/-@2},l=6129(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 scrubqueue=0 0x560f56c87b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v4>,<0x1/dir_test v7>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:07:28.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa32c94f000 1 -- 172.21.15.175:0/825070919 shutdown_connections 2024-04-25T09:07:28.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa32c94f000 1 -- 172.21.15.175:0/825070919 wait complete. 2024-04-25T09:07:28.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa32c94f000 20 client.6258 trim_cache size 0 max 16384 2024-04-25T09:07:28.546 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:07:28.547 INFO:teuthology.orchestra.run.smithi175.stdout: "return_code": 0, 2024-04-25T09:07:28.547 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_tag": "729f3d80-852d-484d-a3b6-e90ae636b304", 2024-04-25T09:07:28.547 INFO:teuthology.orchestra.run.smithi175.stdout: "mode": "asynchronous" 2024-04-25T09:07:28.547 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:07:28.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa329400640 1 -- 172.21.15.175:0/3925511566 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa304066f60 msgr2=0x7fa304069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa329400640 1 --2- 172.21.15.175:0/3925511566 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa304066f60 0x7fa304069420 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa3140ae000 tx=0x7fa3140a6040 comp rx=0 tx=0).stop 2024-04-25T09:07:28.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa329400640 1 -- 172.21.15.175:0/3925511566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3240ced10 msgr2=0x7fa3240b0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa329400640 1 --2- 172.21.15.175:0/3925511566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3240ced10 0x7fa3240b0370 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa31000c420 tx=0x7fa31000c8e0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa329400640 1 -- 172.21.15.175:0/3925511566 shutdown_connections 2024-04-25T09:07:28.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa329400640 1 --2- 172.21.15.175:0/3925511566 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa304066f60 0x7fa304069420 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa329400640 1 --2- 172.21.15.175:0/3925511566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3240cfb60 0x7fa32415f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa329400640 1 --2- 172.21.15.175:0/3925511566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa3240ced10 0x7fa3240b0370 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa329400640 1 --2- 172.21.15.175:0/3925511566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa32406d860 0x7fa32415d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa329400640 1 -- 172.21.15.175:0/3925511566 >> 172.21.15.175:0/3925511566 conn(0x7fa32406ac50 msgr2=0x7fa324165b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:28.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa329400640 1 -- 172.21.15.175:0/3925511566 shutdown_connections 2024-04-25T09:07:28.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.552+0000 7fa329400640 1 -- 172.21.15.175:0/3925511566 wait complete. 2024-04-25T09:07:28.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:28.561 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T09:07:28.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.708+0000 7f5977000640 1 Processor -- start 2024-04-25T09:07:28.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.708+0000 7f5977000640 1 -- start start 2024-04-25T09:07:28.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.708+0000 7f5977000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f59700cf080 0x7f59701600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.708+0000 7f5977000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59700cfd10 con 0x7f59700cf6b0 2024-04-25T09:07:28.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.708+0000 7f5977000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59700cfff0 con 0x7f5970145250 2024-04-25T09:07:28.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.708+0000 7f5977000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59701605e0 con 0x7f59700cf080 2024-04-25T09:07:28.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.712+0000 7f5975000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f59700cf080 0x7f59701600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.712+0000 7f596f400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f59700cf6b0 0x7f59700ce970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:46484/0 (socket says 172.21.15.175:46484) 2024-04-25T09:07:28.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.712+0000 7f596f400640 1 -- 172.21.15.175:0/2781452840 learned_addr learned my addr 172.21.15.175:0/2781452840 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:07:28.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.712+0000 7f5975000640 1 -- 172.21.15.175:0/2781452840 >> v1:172.21.15.177:6789/0 conn(0x7f5970145250 legacy=0x7f59700cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.712+0000 7f5975000640 1 -- 172.21.15.175:0/2781452840 >> v1:172.21.15.175:6789/0 conn(0x7f59700cf6b0 legacy=0x7f59700ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.712+0000 7f5975000640 1 -- 172.21.15.175:0/2781452840 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597015f8a0 con 0x7f59700cf080 2024-04-25T09:07:28.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.712+0000 7f596ea00640 1 -- 172.21.15.175:0/2781452840 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170419042 0 0) 0x7f59700cfd10 con 0x7f59700cf6b0 2024-04-25T09:07:28.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.712+0000 7f5975000640 1 --2- 172.21.15.175:0/2781452840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59700cf080 0x7f59701600a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5968009dc0 tx=0x7f596801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b158357a66dfe803 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.712+0000 7f596ea00640 1 -- 172.21.15.175:0/2781452840 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59680b2070 con 0x7f59700cf080 2024-04-25T09:07:28.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.712+0000 7f596ea00640 1 -- 172.21.15.175:0/2781452840 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59680a5780 con 0x7f59700cf080 2024-04-25T09:07:28.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.712+0000 7f596ea00640 1 -- 172.21.15.175:0/2781452840 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59680a5b50 con 0x7f59700cf080 2024-04-25T09:07:28.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5977000640 1 -- 172.21.15.175:0/2781452840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59700cf080 msgr2=0x7f59701600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5977000640 1 --2- 172.21.15.175:0/2781452840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59700cf080 0x7f59701600a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5968009dc0 tx=0x7f596801c8c0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5977000640 1 -- 172.21.15.175:0/2781452840 shutdown_connections 2024-04-25T09:07:28.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5977000640 1 --2- 172.21.15.175:0/2781452840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59700cf080 0x7f59701600a0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5977000640 1 -- 172.21.15.175:0/2781452840 >> 172.21.15.175:0/2781452840 conn(0x7f597006ac50 msgr2=0x7f597006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:28.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5977000640 1 -- 172.21.15.175:0/2781452840 shutdown_connections 2024-04-25T09:07:28.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5977000640 1 -- 172.21.15.175:0/2781452840 wait complete. 2024-04-25T09:07:28.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5977000640 1 Processor -- start 2024-04-25T09:07:28.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5977000640 1 -- start start 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5977000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59700cf080 0x7f597012ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5977000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59700cf6b0 0x7f597012bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5977000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5970145250 0x7f59701f9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5977000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597015cc00 con 0x7f5970145250 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5977000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597015ca80 con 0x7f59700cf080 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5977000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59701697f0 con 0x7f59700cf6b0 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5975000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5970145250 0x7f59701f9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5975000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5970145250 0x7f59701f9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37782/0 (socket says 172.21.15.175:37782) 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5975000640 1 -- 172.21.15.175:0/105769903 learned_addr learned my addr 172.21.15.175:0/105769903 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f596fe00640 1 --2- 172.21.15.175:0/105769903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59700cf080 0x7f597012ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f596f400640 1 --2- 172.21.15.175:0/105769903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59700cf6b0 0x7f597012bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5975000640 1 -- 172.21.15.175:0/105769903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59700cf6b0 msgr2=0x7f597012bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5975000640 1 --2- 172.21.15.175:0/105769903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59700cf6b0 0x7f597012bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5975000640 1 -- 172.21.15.175:0/105769903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59700cf080 msgr2=0x7f597012ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5975000640 1 --2- 172.21.15.175:0/105769903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59700cf080 0x7f597012ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.716+0000 7f5975000640 1 -- 172.21.15.175:0/105769903 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59700aebd0 con 0x7f5970145250 2024-04-25T09:07:28.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.720+0000 7f5975000640 1 --2- 172.21.15.175:0/105769903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5970145250 0x7f59701f9b20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f59680b0040 tx=0x7f5968019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.720+0000 7f5967e00640 1 -- 172.21.15.175:0/105769903 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59680bd020 con 0x7f5970145250 2024-04-25T09:07:28.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.720+0000 7f5967e00640 1 -- 172.21.15.175:0/105769903 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59680b3040 con 0x7f5970145250 2024-04-25T09:07:28.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.720+0000 7f5967e00640 1 -- 172.21.15.175:0/105769903 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59680b2050 con 0x7f5970145250 2024-04-25T09:07:28.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.720+0000 7f5977000640 1 -- 172.21.15.175:0/105769903 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59700ae650 con 0x7f5970145250 2024-04-25T09:07:28.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.720+0000 7f5977000640 1 -- 172.21.15.175:0/105769903 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59700b3880 con 0x7f5970145250 2024-04-25T09:07:28.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.720+0000 7f5967e00640 1 -- 172.21.15.175:0/105769903 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f59680ad650 con 0x7f5970145250 2024-04-25T09:07:28.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.720+0000 7f5967e00640 1 --2- 172.21.15.175:0/105769903 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f594c066f60 0x7f594c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.720+0000 7f5967e00640 1 -- 172.21.15.175:0/105769903 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f596811f8a0 con 0x7f5970145250 2024-04-25T09:07:28.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.720+0000 7f596fe00640 1 --2- 172.21.15.175:0/105769903 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f594c066f60 0x7f594c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.720+0000 7f597a459000 1 Processor -- start 2024-04-25T09:07:28.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f597a459000 1 -- start start 2024-04-25T09:07:28.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f596fe00640 1 --2- 172.21.15.175:0/105769903 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f594c066f60 0x7f594c069420 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5958007fd0 tx=0x7f5958009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f597a459000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049b009d0 0x564049b00db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f597a459000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b012f0 0x564049ab6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f597a459000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 0x564049ab7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f597a459000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564049903ff0 con 0x564049ab70a0 2024-04-25T09:07:28.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f597a459000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x56404988c150 con 0x564049b012f0 2024-04-25T09:07:28.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f597a459000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x564049900090 con 0x564049b009d0 2024-04-25T09:07:28.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f5975000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 0x564049ab7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f5975000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 0x564049ab7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37798/0 (socket says 172.21.15.175:37798) 2024-04-25T09:07:28.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f5975000640 1 -- 172.21.15.175:0/3875171297 learned_addr learned my addr 172.21.15.175:0/3875171297 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:28.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f596fe00640 1 --2- 172.21.15.175:0/3875171297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049b009d0 0x564049b00db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f596f400640 1 --2- 172.21.15.175:0/3875171297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b012f0 0x564049ab6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f5975000640 1 -- 172.21.15.175:0/3875171297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049b009d0 msgr2=0x564049b00db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:28.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f5975000640 1 --2- 172.21.15.175:0/3875171297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049b009d0 0x564049b00db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f5975000640 1 -- 172.21.15.175:0/3875171297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b012f0 msgr2=0x564049ab6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:28.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f5975000640 1 --2- 172.21.15.175:0/3875171297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b012f0 0x564049ab6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f5975000640 1 -- 172.21.15.175:0/3875171297 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564049a9a0d0 con 0x564049ab70a0 2024-04-25T09:07:28.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f5975000640 1 --2- 172.21.15.175:0/3875171297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 0x564049ab7480 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f59680f8540 tx=0x7f5968009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a73ec797786f198 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f5964c00640 1 -- 172.21.15.175:0/3875171297 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596811b030 con 0x564049ab70a0 2024-04-25T09:07:28.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f5964c00640 1 -- 172.21.15.175:0/3875171297 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59680f44b0 con 0x564049ab70a0 2024-04-25T09:07:28.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f5964c00640 1 -- 172.21.15.175:0/3875171297 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59680f8a70 con 0x564049ab70a0 2024-04-25T09:07:28.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f597a459000 1 -- 172.21.15.175:0/3875171297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 msgr2=0x564049ab7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f597a459000 1 --2- 172.21.15.175:0/3875171297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 0x564049ab7480 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f59680f8540 tx=0x7f5968009750 comp rx=0 tx=0).stop 2024-04-25T09:07:28.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f597a459000 1 -- 172.21.15.175:0/3875171297 shutdown_connections 2024-04-25T09:07:28.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f597a459000 1 --2- 172.21.15.175:0/3875171297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 0x564049ab7480 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f597a459000 1 --2- 172.21.15.175:0/3875171297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b012f0 0x564049ab6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f597a459000 1 --2- 172.21.15.175:0/3875171297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049b009d0 0x564049b00db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f597a459000 1 -- 172.21.15.175:0/3875171297 >> 172.21.15.175:0/3875171297 conn(0x564049ab3020 msgr2=0x564049ab5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:28.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f597a459000 1 -- 172.21.15.175:0/3875171297 shutdown_connections 2024-04-25T09:07:28.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f597a459000 1 -- 172.21.15.175:0/3875171297 wait complete. 2024-04-25T09:07:28.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f597a459000 1 -- start start 2024-04-25T09:07:28.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.724+0000 7f597a459000 1 Processor -- start 2024-04-25T09:07:28.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f597a459000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049ab70a0 0x564049ae57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f597a459000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b009d0 0x564049ae5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f597a459000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049b012f0 0x564049ae6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f597a459000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640498c8250 con 0x564049b012f0 2024-04-25T09:07:28.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f597a459000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640498be690 con 0x564049b009d0 2024-04-25T09:07:28.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f597a459000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x56404988ca40 con 0x564049ab70a0 2024-04-25T09:07:28.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f597a459000 10 client.0 _ll_register_callbacks cb 0x564049aa1e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:28.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f5975000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049b012f0 0x564049ae6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f5975000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049b012f0 0x564049ae6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37800/0 (socket says 172.21.15.175:37800) 2024-04-25T09:07:28.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f5975000640 1 -- 172.21.15.175:0/2499271185 learned_addr learned my addr 172.21.15.175:0/2499271185 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:28.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f596fe00640 1 --2- 172.21.15.175:0/2499271185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049ab70a0 0x564049ae57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f596f400640 1 --2- 172.21.15.175:0/2499271185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b009d0 0x564049ae5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f5975000640 1 -- 172.21.15.175:0/2499271185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049ab70a0 msgr2=0x564049ae57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:28.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f5975000640 1 --2- 172.21.15.175:0/2499271185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049ab70a0 0x564049ae57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f5975000640 1 -- 172.21.15.175:0/2499271185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b009d0 msgr2=0x564049ae5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:28.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f5975000640 1 --2- 172.21.15.175:0/2499271185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b009d0 0x564049ae5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f5975000640 1 -- 172.21.15.175:0/2499271185 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5640499b11c0 con 0x564049b012f0 2024-04-25T09:07:28.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f5975000640 1 --2- 172.21.15.175:0/2499271185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049b012f0 0x564049ae6270 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f59680adfd0 tx=0x7f596801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5004b5818a72a00 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f595d600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:07:28.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f595d600640 1 -- 172.21.15.175:0/2499271185 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596811b040 con 0x564049b012f0 2024-04-25T09:07:28.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f595d600640 1 -- 172.21.15.175:0/2499271185 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59680f4150 con 0x564049b012f0 2024-04-25T09:07:28.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f597a459000 1 -- 172.21.15.175:0/2499271185 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f59680f44b0 con 0x564049b012f0 2024-04-25T09:07:28.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f595d600640 1 -- 172.21.15.175:0/2499271185 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59680f0670 con 0x564049b012f0 2024-04-25T09:07:28.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f597a459000 10 client.6273 fetch_fsmap learned FSMap version 33 2024-04-25T09:07:28.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f597a459000 1 -- 172.21.15.175:0/2499271185 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x5640499ad170 con 0x564049b012f0 2024-04-25T09:07:28.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f595d600640 1 -- 172.21.15.175:0/2499271185 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59680f44b0 con 0x564049b012f0 2024-04-25T09:07:28.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f595d600640 1 -- 172.21.15.175:0/2499271185 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 33) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f59680f85e0 con 0x564049b012f0 2024-04-25T09:07:28.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f597a459000 10 client.6273 fetch_fsmap finished waiting for FSMap version 33 2024-04-25T09:07:28.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f597a459000 10 client.6273 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:07:28.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f597a459000 20 client.6273 populate_metadata read hostname 'smithi175' 2024-04-25T09:07:28.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f597a459000 1 --2- 172.21.15.175:0/2499271185 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x564049b10c80 0x564049b13070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f597a459000 4 client.6273 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:07:28.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f597a459000 1 -- 172.21.15.175:0/2499271185 --> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56404989fc60 con 0x564049b10c80 2024-04-25T09:07:28.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f596fe00640 1 --2- 172.21.15.175:0/2499271185 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x564049b10c80 0x564049b13070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f596fe00640 1 --2- 172.21.15.175:0/2499271185 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x564049b10c80 0x564049b13070 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2cefcbebb2de2e1 server_cookie=e89b1e331d4e9479 in_seq=0 out_seq=0 2024-04-25T09:07:28.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f595d600640 10 client.6273 ms_handle_connect on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:28.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f595d600640 1 -- 172.21.15.175:0/2499271185 <== mds.0 v2:172.21.15.175:6836/1478147147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56404989fc60 con 0x564049b10c80 2024-04-25T09:07:28.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f595d600640 10 client.6273 handle_command_reply: tid=0 2024-04-25T09:07:28.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.728+0000 7f597a459000 1 client.6273 shutdown 2024-04-25T09:07:28.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.732+0000 7f597a459000 1 -- 172.21.15.175:0/2499271185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049b012f0 msgr2=0x564049ae6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.732+0000 7f597a459000 1 --2- 172.21.15.175:0/2499271185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049b012f0 0x564049ae6270 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f59680adfd0 tx=0x7f596801c8c0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.732+0000 7f597a459000 1 -- 172.21.15.175:0/2499271185 shutdown_connections 2024-04-25T09:07:28.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.732+0000 7f597a459000 1 --2- 172.21.15.175:0/2499271185 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x564049b10c80 0x564049b13070 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.732+0000 7f597a459000 1 --2- 172.21.15.175:0/2499271185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049b012f0 0x564049ae6270 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.732+0000 7f597a459000 1 --2- 172.21.15.175:0/2499271185 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b009d0 0x564049ae5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.732+0000 7f597a459000 1 --2- 172.21.15.175:0/2499271185 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049ab70a0 0x564049ae57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.732+0000 7f597a459000 1 -- 172.21.15.175:0/2499271185 >> 172.21.15.175:0/2499271185 conn(0x564049ab3020 msgr2=0x564049ab5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:28.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.732+0000 7f595d600640 0 client.6273 ms_handle_reset on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:28.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.732+0000 7f597a459000 1 -- 172.21.15.175:0/2499271185 shutdown_connections 2024-04-25T09:07:28.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.732+0000 7f597a459000 1 -- 172.21.15.175:0/2499271185 wait complete. 2024-04-25T09:07:28.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.732+0000 7f597a459000 20 client.6273 trim_cache size 0 max 16384 2024-04-25T09:07:28.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.744+0000 7f597a459000 1 Processor -- start 2024-04-25T09:07:28.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.744+0000 7f597a459000 1 -- start start 2024-04-25T09:07:28.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.744+0000 7f597a459000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 0x564049b5cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.744+0000 7f597a459000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b009d0 0x564049b5d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049b012f0 0x564049b5d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5970202b40 con 0x564049ab70a0 2024-04-25T09:07:28.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59700b35a0 con 0x564049b009d0 2024-04-25T09:07:28.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59700b29a0 con 0x564049b012f0 2024-04-25T09:07:28.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f596fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 0x564049b5cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f596fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 0x564049b5cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37804/0 (socket says 172.21.15.175:37804) 2024-04-25T09:07:28.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f596fe00640 1 -- 172.21.15.175:0/3041294231 learned_addr learned my addr 172.21.15.175:0/3041294231 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f5975000640 1 --2- 172.21.15.175:0/3041294231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049b012f0 0x564049b5d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f596f400640 1 --2- 172.21.15.175:0/3041294231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b009d0 0x564049b5d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f596fe00640 1 -- 172.21.15.175:0/3041294231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049b012f0 msgr2=0x564049b5d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f596fe00640 1 --2- 172.21.15.175:0/3041294231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049b012f0 0x564049b5d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f596fe00640 1 -- 172.21.15.175:0/3041294231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b009d0 msgr2=0x564049b5d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f596fe00640 1 --2- 172.21.15.175:0/3041294231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b009d0 0x564049b5d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f596fe00640 1 -- 172.21.15.175:0/3041294231 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56404994ade0 con 0x564049ab70a0 2024-04-25T09:07:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f5975000640 1 --2- 172.21.15.175:0/3041294231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049b012f0 0x564049b5d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f596fe00640 1 --2- 172.21.15.175:0/3041294231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 0x564049b5cee0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f595800fce0 tx=0x7f5958012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae30a9aec0e817ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f595fe00640 1 -- 172.21.15.175:0/3041294231 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595800fdd0 con 0x564049ab70a0 2024-04-25T09:07:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f595fe00640 1 -- 172.21.15.175:0/3041294231 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595802c030 con 0x564049ab70a0 2024-04-25T09:07:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f595fe00640 1 -- 172.21.15.175:0/3041294231 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958014650 con 0x564049ab70a0 2024-04-25T09:07:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 -- 172.21.15.175:0/3041294231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 msgr2=0x564049b5cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 --2- 172.21.15.175:0/3041294231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 0x564049b5cee0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f595800fce0 tx=0x7f5958012000 comp rx=0 tx=0).stop 2024-04-25T09:07:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 -- 172.21.15.175:0/3041294231 shutdown_connections 2024-04-25T09:07:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 --2- 172.21.15.175:0/3041294231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049b012f0 0x564049b5d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 --2- 172.21.15.175:0/3041294231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b009d0 0x564049b5d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 --2- 172.21.15.175:0/3041294231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 0x564049b5cee0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 -- 172.21.15.175:0/3041294231 >> 172.21.15.175:0/3041294231 conn(0x564049ab3020 msgr2=0x564049b0dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 -- 172.21.15.175:0/3041294231 shutdown_connections 2024-04-25T09:07:28.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 -- 172.21.15.175:0/3041294231 wait complete. 2024-04-25T09:07:28.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 -- start start 2024-04-25T09:07:28.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 Processor -- start 2024-04-25T09:07:28.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 0x564049b13380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049b009d0 0x564049b138c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b012f0 0x564049b13e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56404989ee00 con 0x564049ab70a0 2024-04-25T09:07:28.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59700b2fa0 con 0x564049b012f0 2024-04-25T09:07:28.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x564049903300 con 0x564049b009d0 2024-04-25T09:07:28.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f597a459000 10 client.0 _ll_register_callbacks cb 0x564049a82040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:28.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f596fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 0x564049b13380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f596fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 0x564049b13380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37806/0 (socket says 172.21.15.175:37806) 2024-04-25T09:07:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.748+0000 7f596fe00640 1 -- 172.21.15.175:0/1885634440 learned_addr learned my addr 172.21.15.175:0/1885634440 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f5975000640 1 --2- 172.21.15.175:0/1885634440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b012f0 0x564049b13e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f596f400640 1 --2- 172.21.15.175:0/1885634440 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049b009d0 0x564049b138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f596fe00640 1 -- 172.21.15.175:0/1885634440 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049b009d0 msgr2=0x564049b138c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f596fe00640 1 --2- 172.21.15.175:0/1885634440 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049b009d0 0x564049b138c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f596fe00640 1 -- 172.21.15.175:0/1885634440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b012f0 msgr2=0x564049b13e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f596fe00640 1 --2- 172.21.15.175:0/1885634440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b012f0 0x564049b13e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f596fe00640 1 -- 172.21.15.175:0/1885634440 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5640498a58e0 con 0x564049ab70a0 2024-04-25T09:07:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f5975000640 1 --2- 172.21.15.175:0/1885634440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b012f0 0x564049b13e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f596fe00640 1 --2- 172.21.15.175:0/1885634440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 0x564049b13380 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f595800f970 tx=0x7f5958001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f446a7c0c5234f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f595d600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:07:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f595d600640 1 -- 172.21.15.175:0/1885634440 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958014920 con 0x564049ab70a0 2024-04-25T09:07:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f595d600640 1 -- 172.21.15.175:0/1885634440 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5958014ac0 con 0x564049ab70a0 2024-04-25T09:07:28.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 1 -- 172.21.15.175:0/1885634440 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f595802c030 con 0x564049ab70a0 2024-04-25T09:07:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f595d600640 1 -- 172.21.15.175:0/1885634440 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f595803a470 con 0x564049ab70a0 2024-04-25T09:07:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 10 client.6279 fetch_fsmap learned FSMap version 33 2024-04-25T09:07:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 1 -- 172.21.15.175:0/1885634440 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x56404995d8f0 con 0x564049ab70a0 2024-04-25T09:07:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f595d600640 1 -- 172.21.15.175:0/1885634440 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595802c030 con 0x564049ab70a0 2024-04-25T09:07:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f595d600640 1 -- 172.21.15.175:0/1885634440 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 33) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5958020040 con 0x564049ab70a0 2024-04-25T09:07:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 10 client.6279 fetch_fsmap finished waiting for FSMap version 33 2024-04-25T09:07:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 10 client.6279 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:07:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 20 client.6279 populate_metadata read hostname 'smithi175' 2024-04-25T09:07:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 1 --2- 172.21.15.175:0/1885634440 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x564049b14730 0x564049b68f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 4 client.6279 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:07:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 1 -- 172.21.15.175:0/1885634440 --> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564049911530 con 0x564049b14730 2024-04-25T09:07:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f596f400640 1 --2- 172.21.15.175:0/1885634440 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x564049b14730 0x564049b68f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f596f400640 1 --2- 172.21.15.175:0/1885634440 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x564049b14730 0x564049b68f60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f059076608891e28 server_cookie=1df0326f113e0318 in_seq=0 out_seq=0 2024-04-25T09:07:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f595d600640 10 client.6279 ms_handle_connect on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f595d600640 1 -- 172.21.15.175:0/1885634440 <== mds.0 v2:172.21.15.175:6836/1478147147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x564049911530 con 0x564049b14730 2024-04-25T09:07:28.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f595d600640 10 client.6279 handle_command_reply: tid=0 2024-04-25T09:07:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 1 client.6279 shutdown 2024-04-25T09:07:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 1 -- 172.21.15.175:0/1885634440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 msgr2=0x564049b13380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 1 --2- 172.21.15.175:0/1885634440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 0x564049b13380 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f595800f970 tx=0x7f5958001090 comp rx=0 tx=0).stop 2024-04-25T09:07:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 1 -- 172.21.15.175:0/1885634440 shutdown_connections 2024-04-25T09:07:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 1 --2- 172.21.15.175:0/1885634440 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x564049b14730 0x564049b68f60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 1 --2- 172.21.15.175:0/1885634440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564049b012f0 0x564049b13e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 1 --2- 172.21.15.175:0/1885634440 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564049b009d0 0x564049b138c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f595d600640 0 client.6279 ms_handle_reset on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 1 --2- 172.21.15.175:0/1885634440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564049ab70a0 0x564049b13380 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 1 -- 172.21.15.175:0/1885634440 >> 172.21.15.175:0/1885634440 conn(0x564049ab3020 msgr2=0x564049aff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 1 -- 172.21.15.175:0/1885634440 shutdown_connections 2024-04-25T09:07:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 1 -- 172.21.15.175:0/1885634440 wait complete. 2024-04-25T09:07:28.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f597a459000 20 client.6279 trim_cache size 0 max 16384 2024-04-25T09:07:28.748 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:07:28.748 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:07:28.748 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": { 2024-04-25T09:07:28.748 INFO:teuthology.orchestra.run.smithi175.stdout: "729f3d80-852d-484d-a3b6-e90ae636b304": { 2024-04-25T09:07:28.748 INFO:teuthology.orchestra.run.smithi175.stdout: "path": "/", 2024-04-25T09:07:28.748 INFO:teuthology.orchestra.run.smithi175.stdout: "tag": "729f3d80-852d-484d-a3b6-e90ae636b304", 2024-04-25T09:07:28.748 INFO:teuthology.orchestra.run.smithi175.stdout: "options": "recursive,repair,force" 2024-04-25T09:07:28.748 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:07:28.748 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:07:28.748 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:07:28.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f5977000640 1 -- 172.21.15.175:0/105769903 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f594c066f60 msgr2=0x7f594c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f5977000640 1 --2- 172.21.15.175:0/105769903 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f594c066f60 0x7f594c069420 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5958007fd0 tx=0x7f5958009040 comp rx=0 tx=0).stop 2024-04-25T09:07:28.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f5977000640 1 -- 172.21.15.175:0/105769903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5970145250 msgr2=0x7f59701f9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:28.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f5977000640 1 --2- 172.21.15.175:0/105769903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5970145250 0x7f59701f9b20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f59680b0040 tx=0x7f5968019660 comp rx=0 tx=0).stop 2024-04-25T09:07:28.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f5977000640 1 -- 172.21.15.175:0/105769903 shutdown_connections 2024-04-25T09:07:28.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f5977000640 1 --2- 172.21.15.175:0/105769903 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f594c066f60 0x7f594c069420 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f5977000640 1 --2- 172.21.15.175:0/105769903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5970145250 0x7f59701f9b20 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f5977000640 1 --2- 172.21.15.175:0/105769903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f59700cf6b0 0x7f597012bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f5977000640 1 --2- 172.21.15.175:0/105769903 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f59700cf080 0x7f597012ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:28.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f5977000640 1 -- 172.21.15.175:0/105769903 >> 172.21.15.175:0/105769903 conn(0x7f597006ac50 msgr2=0x7f597006b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:28.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f5977000640 1 -- 172.21.15.175:0/105769903 shutdown_connections 2024-04-25T09:07:28.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:28.752+0000 7f5977000640 1 -- 172.21.15.175:0/105769903 wait complete. 2024-04-25T09:07:28.762 INFO:tasks.cephfs.filesystem:scrub status for tag:729f3d80-852d-484d-a3b6-e90ae636b304 - {'path': '/', 'tag': '729f3d80-852d-484d-a3b6-e90ae636b304', 'options': 'recursive,repair,force'} 2024-04-25T09:07:38.709 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:07:38.713 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:07:58.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:58.763 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T09:07:58.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.924+0000 7fa48de00640 1 Processor -- start 2024-04-25T09:07:58.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.924+0000 7fa48de00640 1 -- start start 2024-04-25T09:07:58.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.924+0000 7fa48de00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa488145250 0x7fa4880cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.924+0000 7fa48de00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa4880ce970 0x7fa4880cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.924+0000 7fa48de00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4880cfd10 con 0x7fa4881600a0 2024-04-25T09:07:58.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.924+0000 7fa48de00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48815f650 con 0x7fa4880ce970 2024-04-25T09:07:58.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.924+0000 7fa48de00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880cfff0 con 0x7fa488145250 2024-04-25T09:07:58.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.924+0000 7fa487400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa4880ce970 0x7fa4880cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.924+0000 7fa487400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa4880ce970 0x7fa4880cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37692/0 (socket says 172.21.15.175:37692) 2024-04-25T09:07:58.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.924+0000 7fa487400640 1 -- 172.21.15.175:0/1711904614 learned_addr learned my addr 172.21.15.175:0/1711904614 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:58.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.924+0000 7fa486a00640 1 --2- 172.21.15.175:0/1711904614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa488145250 0x7fa4880cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.924+0000 7fa487400640 1 -- 172.21.15.175:0/1711904614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa488145250 msgr2=0x7fa4880cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:58.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.924+0000 7fa487400640 1 --2- 172.21.15.175:0/1711904614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa488145250 0x7fa4880cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.924+0000 7fa487400640 1 -- 172.21.15.175:0/1711904614 >> v1:172.21.15.177:6789/0 conn(0x7fa4881600a0 legacy=0x7fa4880cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.924+0000 7fa487400640 1 -- 172.21.15.175:0/1711904614 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48815f8a0 con 0x7fa4880ce970 2024-04-25T09:07:58.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.928+0000 7fa487400640 1 --2- 172.21.15.175:0/1711904614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4880ce970 0x7fa4880cee00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa480009e50 tx=0x7fa48001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e216bced011c16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:58.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.928+0000 7fa486000640 1 -- 172.21.15.175:0/1711904614 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4800a5850 con 0x7fa4880ce970 2024-04-25T09:07:58.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.928+0000 7fa486000640 1 -- 172.21.15.175:0/1711904614 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4800a59f0 con 0x7fa4880ce970 2024-04-25T09:07:58.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.928+0000 7fa486000640 1 -- 172.21.15.175:0/1711904614 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4800a5dc0 con 0x7fa4880ce970 2024-04-25T09:07:58.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.928+0000 7fa48de00640 1 -- 172.21.15.175:0/1711904614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4880ce970 msgr2=0x7fa4880cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.928+0000 7fa48de00640 1 --2- 172.21.15.175:0/1711904614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4880ce970 0x7fa4880cee00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa480009e50 tx=0x7fa48001c970 comp rx=0 tx=0).stop 2024-04-25T09:07:58.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.928+0000 7fa48de00640 1 -- 172.21.15.175:0/1711904614 shutdown_connections 2024-04-25T09:07:58.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.928+0000 7fa48de00640 1 --2- 172.21.15.175:0/1711904614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4880ce970 0x7fa4880cee00 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.928+0000 7fa48de00640 1 --2- 172.21.15.175:0/1711904614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa488145250 0x7fa4880cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.928+0000 7fa48de00640 1 -- 172.21.15.175:0/1711904614 >> 172.21.15.175:0/1711904614 conn(0x7fa48806ac50 msgr2=0x7fa48806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:58.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.928+0000 7fa48de00640 1 -- 172.21.15.175:0/1711904614 shutdown_connections 2024-04-25T09:07:58.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.928+0000 7fa48de00640 1 -- 172.21.15.175:0/1711904614 wait complete. 2024-04-25T09:07:58.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa48de00640 1 Processor -- start 2024-04-25T09:07:58.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa48de00640 1 -- start start 2024-04-25T09:07:58.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa48de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4880ce970 0x7fa48813c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa48de00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa488145250 0x7fa488164b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa48de00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4881600a0 0x7fa4881650d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa48de00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa488160600 con 0x7fa4880ce970 2024-04-25T09:07:58.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa48de00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa488160480 con 0x7fa488145250 2024-04-25T09:07:58.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa48de00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48815c870 con 0x7fa4881600a0 2024-04-25T09:07:58.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa486a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4880ce970 0x7fa48813c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa486a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4880ce970 0x7fa48813c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37702/0 (socket says 172.21.15.175:37702) 2024-04-25T09:07:58.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa486a00640 1 -- 172.21.15.175:0/299352212 learned_addr learned my addr 172.21.15.175:0/299352212 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:58.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa47fe00640 1 --2- 172.21.15.175:0/299352212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa488145250 0x7fa488164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa487400640 1 --2- 172.21.15.175:0/299352212 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4881600a0 0x7fa4881650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa486a00640 1 -- 172.21.15.175:0/299352212 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4881600a0 msgr2=0x7fa4881650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa486a00640 1 --2- 172.21.15.175:0/299352212 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4881600a0 0x7fa4881650d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa486a00640 1 -- 172.21.15.175:0/299352212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa488145250 msgr2=0x7fa488164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa486a00640 1 --2- 172.21.15.175:0/299352212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa488145250 0x7fa488164b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa486a00640 1 -- 172.21.15.175:0/299352212 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48813e9d0 con 0x7fa4880ce970 2024-04-25T09:07:58.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa486a00640 1 --2- 172.21.15.175:0/299352212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4880ce970 0x7fa48813c2a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa47800d830 tx=0x7fa47800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:58.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa47f400640 1 -- 172.21.15.175:0/299352212 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47800b6c0 con 0x7fa4880ce970 2024-04-25T09:07:58.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa47f400640 1 -- 172.21.15.175:0/299352212 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa478019070 con 0x7fa4880ce970 2024-04-25T09:07:58.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa47f400640 1 -- 172.21.15.175:0/299352212 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47800bae0 con 0x7fa4880ce970 2024-04-25T09:07:58.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa48de00640 1 -- 172.21.15.175:0/299352212 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4880b2800 con 0x7fa4880ce970 2024-04-25T09:07:58.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.932+0000 7fa48de00640 1 -- 172.21.15.175:0/299352212 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48813ecb0 con 0x7fa4880ce970 2024-04-25T09:07:58.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa47f400640 1 -- 172.21.15.175:0/299352212 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa47801e460 con 0x7fa4880ce970 2024-04-25T09:07:58.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa47f400640 1 --2- 172.21.15.175:0/299352212 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa464066f60 0x7fa464069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa47f400640 1 -- 172.21.15.175:0/299352212 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4780856e0 con 0x7fa4880ce970 2024-04-25T09:07:58.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa47fe00640 1 --2- 172.21.15.175:0/299352212 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa464066f60 0x7fa464069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa4913b0000 1 Processor -- start 2024-04-25T09:07:58.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa4913b0000 1 -- start start 2024-04-25T09:07:58.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa47fe00640 1 --2- 172.21.15.175:0/299352212 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa464066f60 0x7fa464069420 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa488067f60 tx=0x7fa470009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:58.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa4913b0000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b28d89d0 0x5631b28d8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa4913b0000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d92f0 0x5631b288eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa4913b0000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b288f0a0 0x5631b288f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa4913b0000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631b26dbff0 con 0x5631b28d89d0 2024-04-25T09:07:58.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa4913b0000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631b2664150 con 0x5631b28d92f0 2024-04-25T09:07:58.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa4913b0000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631b26d8090 con 0x5631b288f0a0 2024-04-25T09:07:58.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa486a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b28d89d0 0x5631b28d8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa486a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b28d89d0 0x5631b28d8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37710/0 (socket says 172.21.15.175:37710) 2024-04-25T09:07:58.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa486a00640 1 -- 172.21.15.175:0/4002375401 learned_addr learned my addr 172.21.15.175:0/4002375401 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:58.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa47fe00640 1 --2- 172.21.15.175:0/4002375401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d92f0 0x5631b288eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa486a00640 1 -- 172.21.15.175:0/4002375401 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b288f0a0 msgr2=0x5631b288f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:58.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa487400640 1 --2- 172.21.15.175:0/4002375401 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b288f0a0 0x5631b288f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa486a00640 1 --2- 172.21.15.175:0/4002375401 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b288f0a0 0x5631b288f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa486a00640 1 -- 172.21.15.175:0/4002375401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d92f0 msgr2=0x5631b288eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:58.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa486a00640 1 --2- 172.21.15.175:0/4002375401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d92f0 0x5631b288eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa486a00640 1 -- 172.21.15.175:0/4002375401 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631b28720d0 con 0x5631b28d89d0 2024-04-25T09:07:58.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa47fe00640 1 --2- 172.21.15.175:0/4002375401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d92f0 0x5631b288eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:58.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.936+0000 7fa487400640 1 --2- 172.21.15.175:0/4002375401 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b288f0a0 0x5631b288f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:58.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa486a00640 1 --2- 172.21.15.175:0/4002375401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b28d89d0 0x5631b28d8db0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fa478007190 tx=0x7fa478056820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ebb5ee623eb72c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:58.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa477e00640 1 -- 172.21.15.175:0/4002375401 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47805e6f0 con 0x5631b28d89d0 2024-04-25T09:07:58.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa477e00640 1 -- 172.21.15.175:0/4002375401 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa478083c80 con 0x5631b28d89d0 2024-04-25T09:07:58.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa477e00640 1 -- 172.21.15.175:0/4002375401 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa478055430 con 0x5631b28d89d0 2024-04-25T09:07:58.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 1 -- 172.21.15.175:0/4002375401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b28d89d0 msgr2=0x5631b28d8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 1 --2- 172.21.15.175:0/4002375401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b28d89d0 0x5631b28d8db0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fa478007190 tx=0x7fa478056820 comp rx=0 tx=0).stop 2024-04-25T09:07:58.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 1 -- 172.21.15.175:0/4002375401 shutdown_connections 2024-04-25T09:07:58.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 1 --2- 172.21.15.175:0/4002375401 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b288f0a0 0x5631b288f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 1 --2- 172.21.15.175:0/4002375401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d92f0 0x5631b288eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 1 --2- 172.21.15.175:0/4002375401 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b28d89d0 0x5631b28d8db0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 1 -- 172.21.15.175:0/4002375401 >> 172.21.15.175:0/4002375401 conn(0x5631b288b020 msgr2=0x5631b288d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:58.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 1 -- 172.21.15.175:0/4002375401 shutdown_connections 2024-04-25T09:07:58.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 1 -- 172.21.15.175:0/4002375401 wait complete. 2024-04-25T09:07:58.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 1 -- start start 2024-04-25T09:07:58.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 1 Processor -- start 2024-04-25T09:07:58.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b288f0a0 0x5631b28bd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b28d89d0 0x5631b28bdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d92f0 0x5631b28be270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631b26a0250 con 0x5631b288f0a0 2024-04-25T09:07:58.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631b2696690 con 0x5631b28d92f0 2024-04-25T09:07:58.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631b2664a40 con 0x5631b28d89d0 2024-04-25T09:07:58.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 10 client.0 _ll_register_callbacks cb 0x5631b2879e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:58.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa486a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b288f0a0 0x5631b28bd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa486a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b288f0a0 0x5631b28bd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37712/0 (socket says 172.21.15.175:37712) 2024-04-25T09:07:58.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa486a00640 1 -- 172.21.15.175:0/2852706893 learned_addr learned my addr 172.21.15.175:0/2852706893 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:58.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa47fe00640 1 --2- 172.21.15.175:0/2852706893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b28d89d0 0x5631b28bdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa487400640 1 --2- 172.21.15.175:0/2852706893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d92f0 0x5631b28be270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa486a00640 1 -- 172.21.15.175:0/2852706893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b28d89d0 msgr2=0x5631b28bdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:58.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa486a00640 1 --2- 172.21.15.175:0/2852706893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b28d89d0 0x5631b28bdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa486a00640 1 -- 172.21.15.175:0/2852706893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d92f0 msgr2=0x5631b28be270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:58.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa486a00640 1 --2- 172.21.15.175:0/2852706893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d92f0 0x5631b28be270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa486a00640 1 -- 172.21.15.175:0/2852706893 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5631b27891c0 con 0x5631b288f0a0 2024-04-25T09:07:58.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa47fe00640 1 --2- 172.21.15.175:0/2852706893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b28d89d0 0x5631b28bdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:58.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa487400640 1 --2- 172.21.15.175:0/2852706893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d92f0 0x5631b28be270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:58.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa486a00640 1 --2- 172.21.15.175:0/2852706893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b288f0a0 0x5631b28bd7f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fa47800b4b0 tx=0x7fa478007120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9aa51a5331acb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:58.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa474c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:07:58.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa474c00640 1 -- 172.21.15.175:0/2852706893 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa478055430 con 0x5631b288f0a0 2024-04-25T09:07:58.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa474c00640 1 -- 172.21.15.175:0/2852706893 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4780555d0 con 0x5631b288f0a0 2024-04-25T09:07:58.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.940+0000 7fa4913b0000 1 -- 172.21.15.175:0/2852706893 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa478083c80 con 0x5631b288f0a0 2024-04-25T09:07:58.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa474c00640 1 -- 172.21.15.175:0/2852706893 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa47805c0c0 con 0x5631b288f0a0 2024-04-25T09:07:58.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 10 client.6291 fetch_fsmap learned FSMap version 34 2024-04-25T09:07:58.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 1 -- 172.21.15.175:0/2852706893 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x5631b2785170 con 0x5631b288f0a0 2024-04-25T09:07:58.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa474c00640 1 -- 172.21.15.175:0/2852706893 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa478083c80 con 0x5631b288f0a0 2024-04-25T09:07:58.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa474c00640 1 -- 172.21.15.175:0/2852706893 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 34) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa478013070 con 0x5631b288f0a0 2024-04-25T09:07:58.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 10 client.6291 fetch_fsmap finished waiting for FSMap version 34 2024-04-25T09:07:58.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 10 client.6291 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:07:58.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 20 client.6291 populate_metadata read hostname 'smithi175' 2024-04-25T09:07:58.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 1 --2- 172.21.15.175:0/2852706893 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5631b28e8c80 0x5631b28eb070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 4 client.6291 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:07:58.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 1 -- 172.21.15.175:0/2852706893 --> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5631b2677c60 con 0x5631b28e8c80 2024-04-25T09:07:58.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa47fe00640 1 --2- 172.21.15.175:0/2852706893 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5631b28e8c80 0x5631b28eb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa47fe00640 1 --2- 172.21.15.175:0/2852706893 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5631b28e8c80 0x5631b28eb070 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ad4036adf0a73c1 server_cookie=272d1c9868acf911 in_seq=0 out_seq=0 2024-04-25T09:07:58.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa474c00640 10 client.6291 ms_handle_connect on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:58.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa474c00640 1 -- 172.21.15.175:0/2852706893 <== mds.0 v2:172.21.15.175:6836/1478147147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5631b2677c60 con 0x5631b28e8c80 2024-04-25T09:07:58.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa474c00640 10 client.6291 handle_command_reply: tid=0 2024-04-25T09:07:58.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 1 client.6291 shutdown 2024-04-25T09:07:58.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 1 -- 172.21.15.175:0/2852706893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b288f0a0 msgr2=0x5631b28bd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 1 --2- 172.21.15.175:0/2852706893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b288f0a0 0x5631b28bd7f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fa47800b4b0 tx=0x7fa478007120 comp rx=0 tx=0).stop 2024-04-25T09:07:58.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 1 -- 172.21.15.175:0/2852706893 shutdown_connections 2024-04-25T09:07:58.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 1 --2- 172.21.15.175:0/2852706893 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5631b28e8c80 0x5631b28eb070 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 1 --2- 172.21.15.175:0/2852706893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d92f0 0x5631b28be270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 1 --2- 172.21.15.175:0/2852706893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b28d89d0 0x5631b28bdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 1 --2- 172.21.15.175:0/2852706893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b288f0a0 0x5631b28bd7f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa474c00640 0 client.6291 ms_handle_reset on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:58.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 1 -- 172.21.15.175:0/2852706893 >> 172.21.15.175:0/2852706893 conn(0x5631b288b020 msgr2=0x5631b288dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:58.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 1 -- 172.21.15.175:0/2852706893 shutdown_connections 2024-04-25T09:07:58.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 1 -- 172.21.15.175:0/2852706893 wait complete. 2024-04-25T09:07:58.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.944+0000 7fa4913b0000 20 client.6291 trim_cache size 0 max 16384 2024-04-25T09:07:58.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa4913b0000 1 Processor -- start 2024-04-25T09:07:58.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa4913b0000 1 -- start start 2024-04-25T09:07:58.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa4913b0000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b288f0a0 0x5631b28d7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa4913b0000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d89d0 0x5631b28d8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa4913b0000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b28d92f0 0x5631b288e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa4913b0000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa488202960 con 0x5631b288f0a0 2024-04-25T09:07:58.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa4913b0000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880b44a0 con 0x5631b28d89d0 2024-04-25T09:07:58.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa4913b0000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48806e9c0 con 0x5631b28d92f0 2024-04-25T09:07:58.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa486a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b288f0a0 0x5631b28d7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa486a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b288f0a0 0x5631b28d7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37728/0 (socket says 172.21.15.175:37728) 2024-04-25T09:07:58.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa486a00640 1 -- 172.21.15.175:0/1156965529 learned_addr learned my addr 172.21.15.175:0/1156965529 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:58.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa47fe00640 1 --2- 172.21.15.175:0/1156965529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d89d0 0x5631b28d8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa486a00640 1 -- 172.21.15.175:0/1156965529 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b28d92f0 msgr2=0x5631b288e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:58.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa487400640 1 --2- 172.21.15.175:0/1156965529 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b28d92f0 0x5631b288e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa486a00640 1 --2- 172.21.15.175:0/1156965529 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b28d92f0 0x5631b288e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa486a00640 1 -- 172.21.15.175:0/1156965529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d89d0 msgr2=0x5631b28d8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:58.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa486a00640 1 --2- 172.21.15.175:0/1156965529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d89d0 0x5631b28d8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa486a00640 1 -- 172.21.15.175:0/1156965529 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631b2722de0 con 0x5631b288f0a0 2024-04-25T09:07:58.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa487400640 1 --2- 172.21.15.175:0/1156965529 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b28d92f0 0x5631b288e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:58.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa486a00640 1 --2- 172.21.15.175:0/1156965529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b288f0a0 0x5631b28d7c00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fa47805c300 tx=0x7fa47807e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ecf1789e11d5f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:58.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa477400640 1 -- 172.21.15.175:0/1156965529 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa478055b20 con 0x5631b288f0a0 2024-04-25T09:07:58.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa477400640 1 -- 172.21.15.175:0/1156965529 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47805c400 con 0x5631b288f0a0 2024-04-25T09:07:58.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa477400640 1 -- 172.21.15.175:0/1156965529 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa478055430 con 0x5631b288f0a0 2024-04-25T09:07:58.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa4913b0000 1 -- 172.21.15.175:0/1156965529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b288f0a0 msgr2=0x5631b28d7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa4913b0000 1 --2- 172.21.15.175:0/1156965529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b288f0a0 0x5631b28d7c00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fa47805c300 tx=0x7fa47807e000 comp rx=0 tx=0).stop 2024-04-25T09:07:58.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa4913b0000 1 -- 172.21.15.175:0/1156965529 shutdown_connections 2024-04-25T09:07:58.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa4913b0000 1 --2- 172.21.15.175:0/1156965529 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b28d92f0 0x5631b288e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa4913b0000 1 --2- 172.21.15.175:0/1156965529 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d89d0 0x5631b28d8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa4913b0000 1 --2- 172.21.15.175:0/1156965529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b288f0a0 0x5631b28d7c00 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.960+0000 7fa4913b0000 1 -- 172.21.15.175:0/1156965529 >> 172.21.15.175:0/1156965529 conn(0x5631b288b020 msgr2=0x5631b28d70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:58.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 1 -- 172.21.15.175:0/1156965529 shutdown_connections 2024-04-25T09:07:58.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 1 -- 172.21.15.175:0/1156965529 wait complete. 2024-04-25T09:07:58.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 1 -- start start 2024-04-25T09:07:58.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 1 Processor -- start 2024-04-25T09:07:58.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b288f0a0 0x5631b2939310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d89d0 0x5631b2939850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b28d92f0 0x5631b28eb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631b2676e00 con 0x5631b28d92f0 2024-04-25T09:07:58.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880b3ea0 con 0x5631b28d89d0 2024-04-25T09:07:58.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631b26db300 con 0x5631b288f0a0 2024-04-25T09:07:58.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 10 client.0 _ll_register_callbacks cb 0x5631b285a040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:58.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa487400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b28d92f0 0x5631b28eb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa47fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d89d0 0x5631b2939850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa486a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b288f0a0 0x5631b2939310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa487400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b28d92f0 0x5631b28eb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37744/0 (socket says 172.21.15.175:37744) 2024-04-25T09:07:58.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa487400640 1 -- 172.21.15.175:0/2237197137 learned_addr learned my addr 172.21.15.175:0/2237197137 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:58.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa487400640 1 -- 172.21.15.175:0/2237197137 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b288f0a0 msgr2=0x5631b2939310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:58.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa487400640 1 --2- 172.21.15.175:0/2237197137 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b288f0a0 0x5631b2939310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa487400640 1 -- 172.21.15.175:0/2237197137 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d89d0 msgr2=0x5631b2939850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:58.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa487400640 1 --2- 172.21.15.175:0/2237197137 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d89d0 0x5631b2939850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa487400640 1 -- 172.21.15.175:0/2237197137 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5631b267d8e0 con 0x5631b28d92f0 2024-04-25T09:07:58.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa487400640 1 --2- 172.21.15.175:0/2237197137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b28d92f0 0x5631b28eb380 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa4800af040 tx=0x7fa480004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45493fa102bd1535 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:58.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa474c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:07:58.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa474c00640 1 -- 172.21.15.175:0/2237197137 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4800a5950 con 0x5631b28d92f0 2024-04-25T09:07:58.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa474c00640 1 -- 172.21.15.175:0/2237197137 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4800a5af0 con 0x5631b28d92f0 2024-04-25T09:07:58.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 1 -- 172.21.15.175:0/2237197137 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5631b26e9530 con 0x5631b28d92f0 2024-04-25T09:07:58.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa474c00640 1 -- 172.21.15.175:0/2237197137 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4800a5d10 con 0x5631b28d92f0 2024-04-25T09:07:58.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 10 client.6297 fetch_fsmap learned FSMap version 34 2024-04-25T09:07:58.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 1 -- 172.21.15.175:0/2237197137 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x5631b27358f0 con 0x5631b28d92f0 2024-04-25T09:07:58.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa474c00640 1 -- 172.21.15.175:0/2237197137 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5631b26e9530 con 0x5631b28d92f0 2024-04-25T09:07:58.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa474c00640 1 -- 172.21.15.175:0/2237197137 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 34) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa4800c9050 con 0x5631b28d92f0 2024-04-25T09:07:58.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 10 client.6297 fetch_fsmap finished waiting for FSMap version 34 2024-04-25T09:07:58.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 10 client.6297 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:07:58.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 20 client.6297 populate_metadata read hostname 'smithi175' 2024-04-25T09:07:58.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 1 --2- 172.21.15.175:0/2237197137 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5631b28ebf00 0x5631b28ec310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 4 client.6297 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:07:58.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa4913b0000 1 -- 172.21.15.175:0/2237197137 --> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5631b26e3880 con 0x5631b28ebf00 2024-04-25T09:07:58.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.964+0000 7fa486a00640 1 --2- 172.21.15.175:0/2237197137 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5631b28ebf00 0x5631b28ec310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa486a00640 1 --2- 172.21.15.175:0/2237197137 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5631b28ebf00 0x5631b28ec310 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95e92e19a800c52f server_cookie=a3c8ecf1a956c780 in_seq=0 out_seq=0 2024-04-25T09:07:58.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa474c00640 10 client.6297 ms_handle_connect on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:58.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa474c00640 1 -- 172.21.15.175:0/2237197137 <== mds.0 v2:172.21.15.175:6836/1478147147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5631b26e3880 con 0x5631b28ebf00 2024-04-25T09:07:58.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa474c00640 10 client.6297 handle_command_reply: tid=0 2024-04-25T09:07:58.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa4913b0000 1 client.6297 shutdown 2024-04-25T09:07:58.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa4913b0000 1 -- 172.21.15.175:0/2237197137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b28d92f0 msgr2=0x5631b28eb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa4913b0000 1 --2- 172.21.15.175:0/2237197137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b28d92f0 0x5631b28eb380 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa4800af040 tx=0x7fa480004a50 comp rx=0 tx=0).stop 2024-04-25T09:07:58.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa4913b0000 1 -- 172.21.15.175:0/2237197137 shutdown_connections 2024-04-25T09:07:58.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa4913b0000 1 --2- 172.21.15.175:0/2237197137 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x5631b28ebf00 0x5631b28ec310 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa4913b0000 1 --2- 172.21.15.175:0/2237197137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5631b28d92f0 0x5631b28eb380 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa4913b0000 1 --2- 172.21.15.175:0/2237197137 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5631b28d89d0 0x5631b2939850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa4913b0000 1 --2- 172.21.15.175:0/2237197137 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5631b288f0a0 0x5631b2939310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa4913b0000 1 -- 172.21.15.175:0/2237197137 >> 172.21.15.175:0/2237197137 conn(0x5631b288b020 msgr2=0x5631b28d7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:58.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa474c00640 0 client.6297 ms_handle_reset on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:58.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa4913b0000 1 -- 172.21.15.175:0/2237197137 shutdown_connections 2024-04-25T09:07:58.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa4913b0000 1 -- 172.21.15.175:0/2237197137 wait complete. 2024-04-25T09:07:58.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa4913b0000 20 client.6297 trim_cache size 0 max 16384 2024-04-25T09:07:58.961 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:07:58.961 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "no active scrubs running", 2024-04-25T09:07:58.961 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": {} 2024-04-25T09:07:58.961 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:07:58.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa48de00640 1 -- 172.21.15.175:0/299352212 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa464066f60 msgr2=0x7fa464069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa48de00640 1 --2- 172.21.15.175:0/299352212 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa464066f60 0x7fa464069420 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa488067f60 tx=0x7fa470009040 comp rx=0 tx=0).stop 2024-04-25T09:07:58.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa48de00640 1 -- 172.21.15.175:0/299352212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4880ce970 msgr2=0x7fa48813c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa48de00640 1 --2- 172.21.15.175:0/299352212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4880ce970 0x7fa48813c2a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa47800d830 tx=0x7fa47800dcf0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa48de00640 1 -- 172.21.15.175:0/299352212 shutdown_connections 2024-04-25T09:07:58.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa48de00640 1 --2- 172.21.15.175:0/299352212 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa464066f60 0x7fa464069420 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa48de00640 1 --2- 172.21.15.175:0/299352212 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4881600a0 0x7fa4881650d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa48de00640 1 --2- 172.21.15.175:0/299352212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa488145250 0x7fa488164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa48de00640 1 --2- 172.21.15.175:0/299352212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4880ce970 0x7fa48813c2a0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa48de00640 1 -- 172.21.15.175:0/299352212 >> 172.21.15.175:0/299352212 conn(0x7fa48806ac50 msgr2=0x7fa4880cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:58.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa48de00640 1 -- 172.21.15.175:0/299352212 shutdown_connections 2024-04-25T09:07:58.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:58.968+0000 7fa48de00640 1 -- 172.21.15.175:0/299352212 wait complete. 2024-04-25T09:07:58.976 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:07:58.977 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:59.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.124+0000 7f10bbc00640 1 Processor -- start 2024-04-25T09:07:59.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.124+0000 7f10bbc00640 1 -- start start 2024-04-25T09:07:59.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.124+0000 7f10bbc00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f10b406b0e0 0x7f10b406b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.124+0000 7f10bbc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f10b40b0c50 0x7f10b40cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.124+0000 7f10bbc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b40d0450 con 0x7f10b40b1090 2024-04-25T09:07:59.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.124+0000 7f10bbc00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b40b07c0 con 0x7f10b40b0c50 2024-04-25T09:07:59.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.124+0000 7f10bbc00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b40afe90 con 0x7f10b406b0e0 2024-04-25T09:07:59.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.124+0000 7f10abe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f10b40b0c50 0x7f10b40cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.124+0000 7f10abe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f10b40b0c50 0x7f10b40cfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37750/0 (socket says 172.21.15.175:37750) 2024-04-25T09:07:59.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.124+0000 7f10abe00640 1 -- 172.21.15.175:0/1436323068 learned_addr learned my addr 172.21.15.175:0/1436323068 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:59.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.124+0000 7f10b9200640 1 --2- 172.21.15.175:0/1436323068 >> v2:172.21.15.177:3300/0 conn(0x7f10b406b0e0 0x7f10b406b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.124+0000 7f10abe00640 1 -- 172.21.15.175:0/1436323068 >> v2:172.21.15.177:3300/0 conn(0x7f10b406b0e0 msgr2=0x7f10b406b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.124+0000 7f10abe00640 1 --2- 172.21.15.175:0/1436323068 >> v2:172.21.15.177:3300/0 conn(0x7f10b406b0e0 0x7f10b406b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.124+0000 7f10abe00640 1 -- 172.21.15.175:0/1436323068 >> v1:172.21.15.177:6789/0 conn(0x7f10b40b1090 legacy=0x7f10b40b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.124+0000 7f10abe00640 1 -- 172.21.15.175:0/1436323068 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b40b0170 con 0x7f10b40b0c50 2024-04-25T09:07:59.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.128+0000 7f10abe00640 1 --2- 172.21.15.175:0/1436323068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b40b0c50 0x7f10b40cfac0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f109c009870 tx=0x7f109c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec2ffa6ed332c23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.128+0000 7f10b3e00640 1 -- 172.21.15.175:0/1436323068 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c0b5070 con 0x7f10b40b0c50 2024-04-25T09:07:59.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.128+0000 7f10b3e00640 1 -- 172.21.15.175:0/1436323068 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c0a8a10 con 0x7f10b40b0c50 2024-04-25T09:07:59.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.128+0000 7f10b3e00640 1 -- 172.21.15.175:0/1436323068 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c0a8de0 con 0x7f10b40b0c50 2024-04-25T09:07:59.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.128+0000 7f10bbc00640 1 -- 172.21.15.175:0/1436323068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b40b0c50 msgr2=0x7f10b40cfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.128+0000 7f10bbc00640 1 --2- 172.21.15.175:0/1436323068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b40b0c50 0x7f10b40cfac0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f109c009870 tx=0x7f109c01ed10 comp rx=0 tx=0).stop 2024-04-25T09:07:59.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.128+0000 7f10bbc00640 1 -- 172.21.15.175:0/1436323068 shutdown_connections 2024-04-25T09:07:59.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.128+0000 7f10bbc00640 1 --2- 172.21.15.175:0/1436323068 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b40b0c50 0x7f10b40cfac0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.128+0000 7f10bbc00640 1 --2- 172.21.15.175:0/1436323068 >> v2:172.21.15.177:3300/0 conn(0x7f10b406b0e0 0x7f10b406b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.128+0000 7f10bbc00640 1 -- 172.21.15.175:0/1436323068 >> 172.21.15.175:0/1436323068 conn(0x7f10b40d06c0 msgr2=0x7f10b40d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.128+0000 7f10bbc00640 1 -- 172.21.15.175:0/1436323068 shutdown_connections 2024-04-25T09:07:59.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.128+0000 7f10bbc00640 1 -- 172.21.15.175:0/1436323068 wait complete. 2024-04-25T09:07:59.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10bbc00640 1 Processor -- start 2024-04-25T09:07:59.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10bbc00640 1 -- start start 2024-04-25T09:07:59.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10bbc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b406b0e0 0x7f10b40b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10bbc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b40b0c50 0x7f10b41f7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10bbc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10b40b1090 0x7f10b41f7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10bbc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b406bb80 con 0x7f10b40b0c50 2024-04-25T09:07:59.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10bbc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b406ba00 con 0x7f10b406b0e0 2024-04-25T09:07:59.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10bbc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40d0000 con 0x7f10b40b1090 2024-04-25T09:07:59.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10abe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b40b0c50 0x7f10b41f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10abe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b40b0c50 0x7f10b41f7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37760/0 (socket says 172.21.15.175:37760) 2024-04-25T09:07:59.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10b9200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b406b0e0 0x7f10b40b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10abe00640 1 -- 172.21.15.175:0/34886731 learned_addr learned my addr 172.21.15.175:0/34886731 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:59.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10b9c00640 1 --2- 172.21.15.175:0/34886731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10b40b1090 0x7f10b41f7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10abe00640 1 -- 172.21.15.175:0/34886731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10b40b1090 msgr2=0x7f10b41f7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10abe00640 1 --2- 172.21.15.175:0/34886731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10b40b1090 0x7f10b41f7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10abe00640 1 -- 172.21.15.175:0/34886731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b406b0e0 msgr2=0x7f10b40b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10abe00640 1 --2- 172.21.15.175:0/34886731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b406b0e0 0x7f10b40b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10abe00640 1 -- 172.21.15.175:0/34886731 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b40c54f0 con 0x7f10b40b0c50 2024-04-25T09:07:59.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10abe00640 1 --2- 172.21.15.175:0/34886731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b40b0c50 0x7f10b41f7580 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f109c0b3040 tx=0x7f109c01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10b1600640 1 -- 172.21.15.175:0/34886731 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c0b5070 con 0x7f10b40b0c50 2024-04-25T09:07:59.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10b1600640 1 -- 172.21.15.175:0/34886731 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c0b0ab0 con 0x7f10b40b0c50 2024-04-25T09:07:59.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10bbc00640 1 -- 172.21.15.175:0/34886731 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b40c57d0 con 0x7f10b40b0c50 2024-04-25T09:07:59.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10b1600640 1 -- 172.21.15.175:0/34886731 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c0bb410 con 0x7f10b40b0c50 2024-04-25T09:07:59.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10bbc00640 1 -- 172.21.15.175:0/34886731 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b40b3430 con 0x7f10b40b0c50 2024-04-25T09:07:59.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.132+0000 7f10bbc00640 1 -- 172.21.15.175:0/34886731 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b40b60f0 con 0x7f10b40b0c50 2024-04-25T09:07:59.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.136+0000 7f10b1600640 1 -- 172.21.15.175:0/34886731 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f109c0c2060 con 0x7f10b40b0c50 2024-04-25T09:07:59.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.136+0000 7f10b1600640 1 --2- 172.21.15.175:0/34886731 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1090066f60 0x7f1090069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.136+0000 7f10b1600640 1 -- 172.21.15.175:0/34886731 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f109c122270 con 0x7f10b40b0c50 2024-04-25T09:07:59.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.136+0000 7f10b9200640 1 --2- 172.21.15.175:0/34886731 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1090066f60 0x7f1090069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.136+0000 7f10b9200640 1 --2- 172.21.15.175:0/34886731 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1090066f60 0x7f1090069420 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f10a4007a60 tx=0x7f10a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.140+0000 7f10b1600640 1 -- 172.21.15.175:0/34886731 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f109c018870 con 0x7f10b40b0c50 2024-04-25T09:07:59.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.328+0000 7f10bbc00640 1 -- 172.21.15.175:0/34886731 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10b4074a60 con 0x7f10b40b0c50 2024-04-25T09:07:59.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.328+0000 7f10b1600640 1 -- 172.21.15.175:0/34886731 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f109c0f3150 con 0x7f10b40b0c50 2024-04-25T09:07:59.319 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:07:59.320 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2064272902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2064272902},{"type":"v1","addr":"172.21.15.177:6834","nonce":2064272902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5462,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3896280225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3896280225},{"type":"v1","addr":"172.21.15.177:6835","nonce":3896280225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/149812612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":149812612},{"type":"v1","addr":"172.21.15.175:6835","nonce":149812612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:43.704808+0000","modified":"2024-04-25T09:07:36.402066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.175:6837/1478147147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1478147147},{"type":"v1","addr":"172.21.15.175:6837","nonce":1478147147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:07:59.320 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 34 2024-04-25T09:07:59.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.332+0000 7f10bbc00640 1 -- 172.21.15.175:0/34886731 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1090066f60 msgr2=0x7f1090069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.332+0000 7f10bbc00640 1 --2- 172.21.15.175:0/34886731 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1090066f60 0x7f1090069420 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f10a4007a60 tx=0x7f10a4008040 comp rx=0 tx=0).stop 2024-04-25T09:07:59.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.332+0000 7f10bbc00640 1 -- 172.21.15.175:0/34886731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b40b0c50 msgr2=0x7f10b41f7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.332+0000 7f10bbc00640 1 --2- 172.21.15.175:0/34886731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b40b0c50 0x7f10b41f7580 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f109c0b3040 tx=0x7f109c01bab0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.332+0000 7f10bbc00640 1 -- 172.21.15.175:0/34886731 shutdown_connections 2024-04-25T09:07:59.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.332+0000 7f10bbc00640 1 --2- 172.21.15.175:0/34886731 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1090066f60 0x7f1090069420 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.332+0000 7f10bbc00640 1 --2- 172.21.15.175:0/34886731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10b40b1090 0x7f10b41f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.332+0000 7f10bbc00640 1 --2- 172.21.15.175:0/34886731 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10b40b0c50 0x7f10b41f7580 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.332+0000 7f10bbc00640 1 --2- 172.21.15.175:0/34886731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10b406b0e0 0x7f10b40b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.332+0000 7f10bbc00640 1 -- 172.21.15.175:0/34886731 >> 172.21.15.175:0/34886731 conn(0x7f10b40d06c0 msgr2=0x7f10b406f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.332+0000 7f10bbc00640 1 -- 172.21.15.175:0/34886731 shutdown_connections 2024-04-25T09:07:59.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.332+0000 7f10bbc00640 1 -- 172.21.15.175:0/34886731 wait complete. 2024-04-25T09:07:59.341 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T09:07:59.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.488+0000 7f964ec00640 1 Processor -- start 2024-04-25T09:07:59.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.488+0000 7f964ec00640 1 -- start start 2024-04-25T09:07:59.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.492+0000 7f964ec00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f964815af20 0x7f96480b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.492+0000 7f964ec00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f96480b4630 0x7f964815c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.492+0000 7f964ec00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964806db60 con 0x7f96480cbe60 2024-04-25T09:07:59.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.492+0000 7f964ec00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f964806de40 con 0x7f96480b4630 2024-04-25T09:07:59.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.492+0000 7f964ec00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964806e120 con 0x7f964815af20 2024-04-25T09:07:59.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.492+0000 7f9647e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f96480cbe60 0x7f964806d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45282/0 (socket says 172.21.15.175:45282) 2024-04-25T09:07:59.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.492+0000 7f9647e00640 1 -- 172.21.15.175:0/3222209313 learned_addr learned my addr 172.21.15.175:0/3222209313 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:07:59.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.492+0000 7f964cc00640 1 --2- 172.21.15.175:0/3222209313 >> v2:172.21.15.175:3300/0 conn(0x7f96480b4630 0x7f964815c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.492+0000 7f963f400640 1 --2- 172.21.15.175:0/3222209313 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f964815af20 0x7f96480b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.492+0000 7f964cc00640 1 -- 172.21.15.175:0/3222209313 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f964815af20 msgr2=0x7f96480b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.492+0000 7f964cc00640 1 --2- 172.21.15.175:0/3222209313 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f964815af20 0x7f96480b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.492+0000 7f964cc00640 1 -- 172.21.15.175:0/3222209313 >> v1:172.21.15.175:6789/0 conn(0x7f96480cbe60 legacy=0x7f964806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.492+0000 7f964cc00640 1 -- 172.21.15.175:0/3222209313 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964815c2f0 con 0x7f96480b4630 2024-04-25T09:07:59.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.492+0000 7f9647400640 1 -- 172.21.15.175:0/3222209313 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1041910505 0 0) 0x7f964806db60 con 0x7f96480cbe60 2024-04-25T09:07:59.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.492+0000 7f963f400640 1 --2- 172.21.15.175:0/3222209313 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f964815af20 0x7f96480b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:59.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.496+0000 7f964cc00640 1 --2- 172.21.15.175:0/3222209313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96480b4630 0x7f964815c810 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f96400097c0 tx=0x7f964001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a11917ee68d371 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.496+0000 7f9647400640 1 -- 172.21.15.175:0/3222209313 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96400b0070 con 0x7f96480b4630 2024-04-25T09:07:59.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.496+0000 7f9647400640 1 -- 172.21.15.175:0/3222209313 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96400ab600 con 0x7f96480b4630 2024-04-25T09:07:59.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.496+0000 7f9647400640 1 -- 172.21.15.175:0/3222209313 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96400ab9d0 con 0x7f96480b4630 2024-04-25T09:07:59.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.496+0000 7f964ec00640 1 -- 172.21.15.175:0/3222209313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96480b4630 msgr2=0x7f964815c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.496+0000 7f964ec00640 1 --2- 172.21.15.175:0/3222209313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96480b4630 0x7f964815c810 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f96400097c0 tx=0x7f964001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.496+0000 7f964ec00640 1 -- 172.21.15.175:0/3222209313 shutdown_connections 2024-04-25T09:07:59.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.496+0000 7f964ec00640 1 --2- 172.21.15.175:0/3222209313 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96480b4630 0x7f964815c810 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.496+0000 7f964ec00640 1 --2- 172.21.15.175:0/3222209313 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f964815af20 0x7f96480b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.496+0000 7f964ec00640 1 -- 172.21.15.175:0/3222209313 >> 172.21.15.175:0/3222209313 conn(0x7f964806ac50 msgr2=0x7f964806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.496+0000 7f964ec00640 1 -- 172.21.15.175:0/3222209313 shutdown_connections 2024-04-25T09:07:59.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.496+0000 7f964ec00640 1 -- 172.21.15.175:0/3222209313 wait complete. 2024-04-25T09:07:59.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.496+0000 7f964ec00640 1 Processor -- start 2024-04-25T09:07:59.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.496+0000 7f964ec00640 1 -- start start 2024-04-25T09:07:59.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.496+0000 7f964ec00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96480b4630 0x7f9648150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.496+0000 7f964ec00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96480cbe60 0x7f9648159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f964ec00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f964815af20 0x7f964815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f964ec00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964815d970 con 0x7f96480cbe60 2024-04-25T09:07:59.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f964ec00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964815d7f0 con 0x7f96480b4630 2024-04-25T09:07:59.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f964ec00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964815daf0 con 0x7f964815af20 2024-04-25T09:07:59.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f963f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96480cbe60 0x7f9648159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f963f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96480cbe60 0x7f9648159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37110/0 (socket says 172.21.15.175:37110) 2024-04-25T09:07:59.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f963f400640 1 -- 172.21.15.175:0/1851959195 learned_addr learned my addr 172.21.15.175:0/1851959195 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:59.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f9647e00640 1 --2- 172.21.15.175:0/1851959195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96480b4630 0x7f9648150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f964cc00640 1 --2- 172.21.15.175:0/1851959195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f964815af20 0x7f964815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f963f400640 1 -- 172.21.15.175:0/1851959195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f964815af20 msgr2=0x7f964815a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f963f400640 1 --2- 172.21.15.175:0/1851959195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f964815af20 0x7f964815a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f963f400640 1 -- 172.21.15.175:0/1851959195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96480b4630 msgr2=0x7f9648150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f963f400640 1 --2- 172.21.15.175:0/1851959195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96480b4630 0x7f9648150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f963f400640 1 -- 172.21.15.175:0/1851959195 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9648158c60 con 0x7f96480cbe60 2024-04-25T09:07:59.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f963f400640 1 --2- 172.21.15.175:0/1851959195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96480cbe60 0x7f9648159ea0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f963000e840 tx=0x7f963000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f9644c00640 1 -- 172.21.15.175:0/1851959195 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9630017070 con 0x7f96480cbe60 2024-04-25T09:07:59.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f9644c00640 1 -- 172.21.15.175:0/1851959195 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963000c8d0 con 0x7f96480cbe60 2024-04-25T09:07:59.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f964ec00640 1 -- 172.21.15.175:0/1851959195 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96480ae640 con 0x7f96480cbe60 2024-04-25T09:07:59.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f9644c00640 1 -- 172.21.15.175:0/1851959195 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963000f040 con 0x7f96480cbe60 2024-04-25T09:07:59.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f964ec00640 1 -- 172.21.15.175:0/1851959195 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964814fcd0 con 0x7f96480cbe60 2024-04-25T09:07:59.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.500+0000 7f9644c00640 1 -- 172.21.15.175:0/1851959195 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f963001a070 con 0x7f96480cbe60 2024-04-25T09:07:59.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f9644c00640 1 --2- 172.21.15.175:0/1851959195 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9624066f60 0x7f9624069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f9644c00640 1 -- 172.21.15.175:0/1851959195 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9630084be0 con 0x7f96480cbe60 2024-04-25T09:07:59.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f9647e00640 1 --2- 172.21.15.175:0/1851959195 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9624066f60 0x7f9624069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f965218e000 1 Processor -- start 2024-04-25T09:07:59.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f965218e000 1 -- start start 2024-04-25T09:07:59.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f9647e00640 1 --2- 172.21.15.175:0/1851959195 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9624066f60 0x7f9624069420 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f96380012f0 tx=0x7f9638001690 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f965218e000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128ef92e0 0x556128ef96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f965218e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128ef9c00 0x556128eaf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f965218e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128eaf8e0 0x556128eafcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f965218e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556128d96ba0 con 0x556128eaf8e0 2024-04-25T09:07:59.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f965218e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x556128cfc090 con 0x556128ef9c00 2024-04-25T09:07:59.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f965218e000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x556128c84160 con 0x556128ef92e0 2024-04-25T09:07:59.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f964cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128eaf8e0 0x556128eafcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f964cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128eaf8e0 0x556128eafcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37124/0 (socket says 172.21.15.175:37124) 2024-04-25T09:07:59.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f964cc00640 1 -- 172.21.15.175:0/1745020372 learned_addr learned my addr 172.21.15.175:0/1745020372 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:59.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f963f400640 1 --2- 172.21.15.175:0/1745020372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128ef9c00 0x556128eaf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f9647e00640 1 --2- 172.21.15.175:0/1745020372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128ef92e0 0x556128ef96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f964cc00640 1 -- 172.21.15.175:0/1745020372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128ef92e0 msgr2=0x556128ef96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f964cc00640 1 --2- 172.21.15.175:0/1745020372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128ef92e0 0x556128ef96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f964cc00640 1 -- 172.21.15.175:0/1745020372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128ef9c00 msgr2=0x556128eaf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f964cc00640 1 --2- 172.21.15.175:0/1745020372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128ef9c00 0x556128eaf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f964cc00640 1 -- 172.21.15.175:0/1745020372 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556128da5c20 con 0x556128eaf8e0 2024-04-25T09:07:59.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f964cc00640 1 --2- 172.21.15.175:0/1745020372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128eaf8e0 0x556128eafcc0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f96400097c0 tx=0x7f9640004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e332c414aab9ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f963cc00640 1 -- 172.21.15.175:0/1745020372 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96400bc070 con 0x556128eaf8e0 2024-04-25T09:07:59.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f963cc00640 1 -- 172.21.15.175:0/1745020372 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96400b1040 con 0x556128eaf8e0 2024-04-25T09:07:59.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f963cc00640 1 -- 172.21.15.175:0/1745020372 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96400b0040 con 0x556128eaf8e0 2024-04-25T09:07:59.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f965218e000 1 -- 172.21.15.175:0/1745020372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128eaf8e0 msgr2=0x556128eafcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f965218e000 1 --2- 172.21.15.175:0/1745020372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128eaf8e0 0x556128eafcc0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f96400097c0 tx=0x7f9640004740 comp rx=0 tx=0).stop 2024-04-25T09:07:59.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f965218e000 1 -- 172.21.15.175:0/1745020372 shutdown_connections 2024-04-25T09:07:59.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f965218e000 1 --2- 172.21.15.175:0/1745020372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128eaf8e0 0x556128eafcc0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f965218e000 1 --2- 172.21.15.175:0/1745020372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128ef9c00 0x556128eaf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f965218e000 1 --2- 172.21.15.175:0/1745020372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128ef92e0 0x556128ef96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f965218e000 1 -- 172.21.15.175:0/1745020372 >> 172.21.15.175:0/1745020372 conn(0x556128eab890 msgr2=0x556128eadc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.504+0000 7f965218e000 1 -- 172.21.15.175:0/1745020372 shutdown_connections 2024-04-25T09:07:59.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 1 -- 172.21.15.175:0/1745020372 wait complete. 2024-04-25T09:07:59.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 1 -- start start 2024-04-25T09:07:59.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 1 Processor -- start 2024-04-25T09:07:59.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128eaf8e0 0x556128f00640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128ef92e0 0x556128f00b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef9c00 0x556128ee7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556128cf8130 con 0x556128ef9c00 2024-04-25T09:07:59.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x556128cc0130 con 0x556128ef92e0 2024-04-25T09:07:59.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x556128dba300 con 0x556128eaf8e0 2024-04-25T09:07:59.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 10 client.0 _ll_register_callbacks cb 0x556128e9abc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:59.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f964cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef9c00 0x556128ee7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f964cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef9c00 0x556128ee7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37130/0 (socket says 172.21.15.175:37130) 2024-04-25T09:07:59.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f964cc00640 1 -- 172.21.15.175:0/285012933 learned_addr learned my addr 172.21.15.175:0/285012933 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:59.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f963f400640 1 --2- 172.21.15.175:0/285012933 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128ef92e0 0x556128f00b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f9647e00640 1 --2- 172.21.15.175:0/285012933 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128eaf8e0 0x556128f00640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f964cc00640 1 -- 172.21.15.175:0/285012933 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128eaf8e0 msgr2=0x556128f00640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f964cc00640 1 --2- 172.21.15.175:0/285012933 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128eaf8e0 0x556128f00640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f964cc00640 1 -- 172.21.15.175:0/285012933 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128ef92e0 msgr2=0x556128f00b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f964cc00640 1 --2- 172.21.15.175:0/285012933 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128ef92e0 0x556128f00b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f964cc00640 1 -- 172.21.15.175:0/285012933 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556128cd9060 con 0x556128ef9c00 2024-04-25T09:07:59.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f964cc00640 1 --2- 172.21.15.175:0/285012933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef9c00 0x556128ee7090 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f964001a0d0 tx=0x7f964001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8767036adac036d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f9635600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:07:59.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f9635600640 1 -- 172.21.15.175:0/285012933 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96400bc040 con 0x556128ef9c00 2024-04-25T09:07:59.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f9635600640 1 -- 172.21.15.175:0/285012933 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96400ab9d0 con 0x556128ef9c00 2024-04-25T09:07:59.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 1 -- 172.21.15.175:0/285012933 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f96400b1040 con 0x556128ef9c00 2024-04-25T09:07:59.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f9635600640 1 -- 172.21.15.175:0/285012933 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96400d1050 con 0x556128ef9c00 2024-04-25T09:07:59.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 10 client.6318 fetch_fsmap learned FSMap version 34 2024-04-25T09:07:59.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 1 -- 172.21.15.175:0/285012933 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x556128c9d7c0 con 0x556128ef9c00 2024-04-25T09:07:59.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f9635600640 1 -- 172.21.15.175:0/285012933 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96400b1040 con 0x556128ef9c00 2024-04-25T09:07:59.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f9635600640 1 -- 172.21.15.175:0/285012933 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 34) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f96400d4020 con 0x556128ef9c00 2024-04-25T09:07:59.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 10 client.6318 fetch_fsmap finished waiting for FSMap version 34 2024-04-25T09:07:59.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 10 client.6318 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:07:59.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 20 client.6318 populate_metadata read hostname 'smithi175' 2024-04-25T09:07:59.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 1 --2- 172.21.15.175:0/285012933 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x556128ee7e00 0x556128ee81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 4 client.6318 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:07:59.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.508+0000 7f965218e000 1 -- 172.21.15.175:0/285012933 --> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556128c97cd0 con 0x556128ee7e00 2024-04-25T09:07:59.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.512+0000 7f9647e00640 1 --2- 172.21.15.175:0/285012933 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x556128ee7e00 0x556128ee81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.512+0000 7f9647e00640 1 --2- 172.21.15.175:0/285012933 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x556128ee7e00 0x556128ee81e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4314e8b5175e371 server_cookie=8e7823dba9160da1 in_seq=0 out_seq=0 2024-04-25T09:07:59.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.512+0000 7f9635600640 10 client.6318 ms_handle_connect on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:59.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.512+0000 7f9635600640 1 -- 172.21.15.175:0/285012933 <== mds.0 v2:172.21.15.175:6836/1478147147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556128c97cd0 con 0x556128ee7e00 2024-04-25T09:07:59.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.512+0000 7f9635600640 10 client.6318 handle_command_reply: tid=0 2024-04-25T09:07:59.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.512+0000 7f965218e000 1 client.6318 shutdown 2024-04-25T09:07:59.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.512+0000 7f965218e000 1 -- 172.21.15.175:0/285012933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef9c00 msgr2=0x556128ee7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.512+0000 7f965218e000 1 --2- 172.21.15.175:0/285012933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef9c00 0x556128ee7090 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f964001a0d0 tx=0x7f964001ace0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.512+0000 7f965218e000 1 -- 172.21.15.175:0/285012933 shutdown_connections 2024-04-25T09:07:59.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.512+0000 7f965218e000 1 --2- 172.21.15.175:0/285012933 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x556128ee7e00 0x556128ee81e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.512+0000 7f965218e000 1 --2- 172.21.15.175:0/285012933 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef9c00 0x556128ee7090 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.512+0000 7f965218e000 1 --2- 172.21.15.175:0/285012933 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128ef92e0 0x556128f00b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.512+0000 7f965218e000 1 --2- 172.21.15.175:0/285012933 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128eaf8e0 0x556128f00640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.512+0000 7f9635600640 0 client.6318 ms_handle_reset on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:59.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.512+0000 7f965218e000 1 -- 172.21.15.175:0/285012933 >> 172.21.15.175:0/285012933 conn(0x556128eab890 msgr2=0x556128eae510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.512+0000 7f965218e000 1 -- 172.21.15.175:0/285012933 shutdown_connections 2024-04-25T09:07:59.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.512+0000 7f965218e000 1 -- 172.21.15.175:0/285012933 wait complete. 2024-04-25T09:07:59.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.512+0000 7f965218e000 20 client.6318 trim_cache size 0 max 16384 2024-04-25T09:07:59.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f965218e000 1 Processor -- start 2024-04-25T09:07:59.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f965218e000 1 -- start start 2024-04-25T09:07:59.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f965218e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128eaf8e0 0x556128eaeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f965218e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef92e0 0x556128eadc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f965218e000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128ef9c00 0x556128eae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f965218e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96481ff8f0 con 0x556128ef92e0 2024-04-25T09:07:59.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f965218e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9648152cb0 con 0x556128eaf8e0 2024-04-25T09:07:59.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f965218e000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9648153280 con 0x556128ef9c00 2024-04-25T09:07:59.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f963f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef92e0 0x556128eadc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f963f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef92e0 0x556128eadc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37138/0 (socket says 172.21.15.175:37138) 2024-04-25T09:07:59.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f963f400640 1 -- 172.21.15.175:0/2676510297 learned_addr learned my addr 172.21.15.175:0/2676510297 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:59.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f963f400640 1 -- 172.21.15.175:0/2676510297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128ef9c00 msgr2=0x556128eae1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f963f400640 1 --2- 172.21.15.175:0/2676510297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128ef9c00 0x556128eae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f963f400640 1 -- 172.21.15.175:0/2676510297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128eaf8e0 msgr2=0x556128eaeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f963f400640 1 --2- 172.21.15.175:0/2676510297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128eaf8e0 0x556128eaeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f963f400640 1 -- 172.21.15.175:0/2676510297 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556128cb7fc0 con 0x556128ef92e0 2024-04-25T09:07:59.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f963f400640 1 --2- 172.21.15.175:0/2676510297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef92e0 0x556128eadc80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9630083100 tx=0x7f9630059630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff0f0a846ce9c48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f9637e00640 1 -- 172.21.15.175:0/2676510297 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9630081070 con 0x556128ef92e0 2024-04-25T09:07:59.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f9637e00640 1 -- 172.21.15.175:0/2676510297 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9630051c00 con 0x556128ef92e0 2024-04-25T09:07:59.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f9637e00640 1 -- 172.21.15.175:0/2676510297 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963006d070 con 0x556128ef92e0 2024-04-25T09:07:59.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f965218e000 1 -- 172.21.15.175:0/2676510297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef92e0 msgr2=0x556128eadc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f965218e000 1 --2- 172.21.15.175:0/2676510297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef92e0 0x556128eadc80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9630083100 tx=0x7f9630059630 comp rx=0 tx=0).stop 2024-04-25T09:07:59.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f965218e000 1 -- 172.21.15.175:0/2676510297 shutdown_connections 2024-04-25T09:07:59.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f965218e000 1 --2- 172.21.15.175:0/2676510297 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128ef9c00 0x556128eae1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f965218e000 1 --2- 172.21.15.175:0/2676510297 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef92e0 0x556128eadc80 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f965218e000 1 --2- 172.21.15.175:0/2676510297 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128eaf8e0 0x556128eaeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.524+0000 7f965218e000 1 -- 172.21.15.175:0/2676510297 >> 172.21.15.175:0/2676510297 conn(0x556128eab890 msgr2=0x556128ef8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 1 -- 172.21.15.175:0/2676510297 shutdown_connections 2024-04-25T09:07:59.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 1 -- 172.21.15.175:0/2676510297 wait complete. 2024-04-25T09:07:59.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 1 -- start start 2024-04-25T09:07:59.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 1 Processor -- start 2024-04-25T09:07:59.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128eaf8e0 0x556128f5db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef92e0 0x556128f5e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128ef9c00 0x556128efd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556128c96e70 con 0x556128ef92e0 2024-04-25T09:07:59.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x556128c84a50 con 0x556128eaf8e0 2024-04-25T09:07:59.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x556128cfb3a0 con 0x556128ef9c00 2024-04-25T09:07:59.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 10 client.0 _ll_register_callbacks cb 0x556128ca8240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:59.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f963f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef92e0 0x556128f5e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f963f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef92e0 0x556128f5e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37148/0 (socket says 172.21.15.175:37148) 2024-04-25T09:07:59.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f963f400640 1 -- 172.21.15.175:0/120673787 learned_addr learned my addr 172.21.15.175:0/120673787 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:59.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f9647e00640 1 --2- 172.21.15.175:0/120673787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128eaf8e0 0x556128f5db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f964cc00640 1 --2- 172.21.15.175:0/120673787 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128ef9c00 0x556128efd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f963f400640 1 -- 172.21.15.175:0/120673787 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128ef9c00 msgr2=0x556128efd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f963f400640 1 --2- 172.21.15.175:0/120673787 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128ef9c00 0x556128efd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f963f400640 1 -- 172.21.15.175:0/120673787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128eaf8e0 msgr2=0x556128f5db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f963f400640 1 --2- 172.21.15.175:0/120673787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128eaf8e0 0x556128f5db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f963f400640 1 -- 172.21.15.175:0/120673787 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556128d559e0 con 0x556128ef92e0 2024-04-25T09:07:59.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f9647e00640 1 --2- 172.21.15.175:0/120673787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128eaf8e0 0x556128f5db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:59.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f963f400640 1 --2- 172.21.15.175:0/120673787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef92e0 0x556128f5e070 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f9630055520 tx=0x7f9630000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a920b1611e3aa3b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f9635600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:07:59.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f9635600640 1 -- 172.21.15.175:0/120673787 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9630081050 con 0x556128ef92e0 2024-04-25T09:07:59.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f9635600640 1 -- 172.21.15.175:0/120673787 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96300590b0 con 0x556128ef92e0 2024-04-25T09:07:59.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 1 -- 172.21.15.175:0/120673787 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9630051c00 con 0x556128ef92e0 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f9635600640 1 -- 172.21.15.175:0/120673787 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f963007a050 con 0x556128ef92e0 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 10 client.6324 fetch_fsmap learned FSMap version 34 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 1 -- 172.21.15.175:0/120673787 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x556128c9b630 con 0x556128ef92e0 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f9635600640 1 -- 172.21.15.175:0/120673787 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9630051c00 con 0x556128ef92e0 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f9635600640 1 -- 172.21.15.175:0/120673787 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 34) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9630012050 con 0x556128ef92e0 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 10 client.6324 fetch_fsmap finished waiting for FSMap version 34 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 10 client.6324 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 20 client.6324 populate_metadata read hostname 'smithi175' 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 1 --2- 172.21.15.175:0/120673787 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x556128efe370 0x556128efe750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 4 client.6324 mds_command: new command op to 5958 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f965218e000 1 -- 172.21.15.175:0/120673787 --> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x556128d095d0 con 0x556128efe370 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f9647e00640 1 --2- 172.21.15.175:0/120673787 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x556128efe370 0x556128efe750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f9647e00640 1 --2- 172.21.15.175:0/120673787 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x556128efe370 0x556128efe750 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0bf680ee997385c server_cookie=6bffc7121acf783a in_seq=0 out_seq=0 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.528+0000 7f9635600640 10 client.6324 ms_handle_connect on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:59.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f9635600640 1 -- 172.21.15.175:0/120673787 <== mds.0 v2:172.21.15.175:6836/1478147147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556128d095d0 con 0x556128efe370 2024-04-25T09:07:59.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f9635600640 10 client.6324 handle_command_reply: tid=0 2024-04-25T09:07:59.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f965218e000 1 client.6324 shutdown 2024-04-25T09:07:59.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f965218e000 1 -- 172.21.15.175:0/120673787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef92e0 msgr2=0x556128f5e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f965218e000 1 --2- 172.21.15.175:0/120673787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef92e0 0x556128f5e070 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f9630055520 tx=0x7f9630000bd0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f965218e000 1 -- 172.21.15.175:0/120673787 shutdown_connections 2024-04-25T09:07:59.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f965218e000 1 --2- 172.21.15.175:0/120673787 >> [v2:172.21.15.175:6836/1478147147,v1:172.21.15.175:6837/1478147147] conn(0x556128efe370 0x556128efe750 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f965218e000 1 --2- 172.21.15.175:0/120673787 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556128ef9c00 0x556128efd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f965218e000 1 --2- 172.21.15.175:0/120673787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556128ef92e0 0x556128f5e070 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f965218e000 1 --2- 172.21.15.175:0/120673787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556128eaf8e0 0x556128f5db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f9635600640 0 client.6324 ms_handle_reset on v2:172.21.15.175:6836/1478147147 2024-04-25T09:07:59.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f965218e000 1 -- 172.21.15.175:0/120673787 >> 172.21.15.175:0/120673787 conn(0x556128eab890 msgr2=0x556128ef8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f965218e000 1 -- 172.21.15.175:0/120673787 shutdown_connections 2024-04-25T09:07:59.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f965218e000 1 -- 172.21.15.175:0/120673787 wait complete. 2024-04-25T09:07:59.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f965218e000 20 client.6324 trim_cache size 0 max 16384 2024-04-25T09:07:59.525 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:07:59.525 INFO:teuthology.orchestra.run.smithi175.stdout:[] 2024-04-25T09:07:59.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f964ec00640 1 -- 172.21.15.175:0/1851959195 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9624066f60 msgr2=0x7f9624069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f964ec00640 1 --2- 172.21.15.175:0/1851959195 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9624066f60 0x7f9624069420 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f96380012f0 tx=0x7f9638001690 comp rx=0 tx=0).stop 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f964ec00640 1 -- 172.21.15.175:0/1851959195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96480cbe60 msgr2=0x7f9648159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f964ec00640 1 --2- 172.21.15.175:0/1851959195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96480cbe60 0x7f9648159ea0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f963000e840 tx=0x7f963000ed00 comp rx=0 tx=0).stop 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f964ec00640 1 -- 172.21.15.175:0/1851959195 shutdown_connections 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f964ec00640 1 --2- 172.21.15.175:0/1851959195 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9624066f60 0x7f9624069420 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f964ec00640 1 --2- 172.21.15.175:0/1851959195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f964815af20 0x7f964815a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f964ec00640 1 --2- 172.21.15.175:0/1851959195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96480cbe60 0x7f9648159ea0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f964ec00640 1 --2- 172.21.15.175:0/1851959195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96480b4630 0x7f9648150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f964ec00640 1 -- 172.21.15.175:0/1851959195 >> 172.21.15.175:0/1851959195 conn(0x7f964806ac50 msgr2=0x7f9648157b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f964ec00640 1 -- 172.21.15.175:0/1851959195 shutdown_connections 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.532+0000 7f964ec00640 1 -- 172.21.15.175:0/1851959195 wait complete. 2024-04-25T09:07:59.539 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:07:59.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.684+0000 7f8382400640 1 Processor -- start 2024-04-25T09:07:59.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.684+0000 7f8382400640 1 -- start start 2024-04-25T09:07:59.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.684+0000 7f8382400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f837c099a50 0x7f837c06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.684+0000 7f8382400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f837c06bd60 0x7f837c099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.684+0000 7f8382400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837c09a370 con 0x7f837c0d0d50 2024-04-25T09:07:59.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.684+0000 7f8382400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837c0cfcb0 con 0x7f837c06bd60 2024-04-25T09:07:59.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.684+0000 7f8382400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837c0cff90 con 0x7f837c099a50 2024-04-25T09:07:59.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.684+0000 7f8372a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f837c06bd60 0x7f837c099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.684+0000 7f8372a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f837c06bd60 0x7f837c099e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37152/0 (socket says 172.21.15.175:37152) 2024-04-25T09:07:59.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.684+0000 7f8372a00640 1 -- 172.21.15.175:0/4268605761 learned_addr learned my addr 172.21.15.175:0/4268605761 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:59.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.684+0000 7f837b400640 1 --2- 172.21.15.175:0/4268605761 >> v2:172.21.15.177:3300/0 conn(0x7f837c099a50 0x7f837c06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.684+0000 7f8372a00640 1 -- 172.21.15.175:0/4268605761 >> v2:172.21.15.177:3300/0 conn(0x7f837c099a50 msgr2=0x7f837c06cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.684+0000 7f8372a00640 1 --2- 172.21.15.175:0/4268605761 >> v2:172.21.15.177:3300/0 conn(0x7f837c099a50 0x7f837c06cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.684+0000 7f8372a00640 1 -- 172.21.15.175:0/4268605761 >> v1:172.21.15.177:6789/0 conn(0x7f837c0d0d50 legacy=0x7f837c0cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.684+0000 7f8372a00640 1 -- 172.21.15.175:0/4268605761 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c0d0270 con 0x7f837c06bd60 2024-04-25T09:07:59.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.684+0000 7f837b400640 1 --2- 172.21.15.175:0/4268605761 >> v2:172.21.15.177:3300/0 conn(0x7f837c099a50 0x7f837c06cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:59.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.688+0000 7f8372a00640 1 --2- 172.21.15.175:0/4268605761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f837c06bd60 0x7f837c099e30 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f837c071ee0 tx=0x7f836401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14b371abcf381db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.688+0000 7f837aa00640 1 -- 172.21.15.175:0/4268605761 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83640b0070 con 0x7f837c06bd60 2024-04-25T09:07:59.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.688+0000 7f837aa00640 1 -- 172.21.15.175:0/4268605761 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83640ab600 con 0x7f837c06bd60 2024-04-25T09:07:59.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.688+0000 7f837aa00640 1 -- 172.21.15.175:0/4268605761 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83640ab9d0 con 0x7f837c06bd60 2024-04-25T09:07:59.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.688+0000 7f8382400640 1 -- 172.21.15.175:0/4268605761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f837c06bd60 msgr2=0x7f837c099e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.688+0000 7f8382400640 1 --2- 172.21.15.175:0/4268605761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f837c06bd60 0x7f837c099e30 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f837c071ee0 tx=0x7f836401c520 comp rx=0 tx=0).stop 2024-04-25T09:07:59.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.688+0000 7f8382400640 1 -- 172.21.15.175:0/4268605761 shutdown_connections 2024-04-25T09:07:59.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.688+0000 7f8382400640 1 --2- 172.21.15.175:0/4268605761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f837c06bd60 0x7f837c099e30 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.688+0000 7f8382400640 1 --2- 172.21.15.175:0/4268605761 >> v2:172.21.15.177:3300/0 conn(0x7f837c099a50 0x7f837c06cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.688+0000 7f8382400640 1 -- 172.21.15.175:0/4268605761 >> 172.21.15.175:0/4268605761 conn(0x7f837c0b3300 msgr2=0x7f837c0b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.688+0000 7f8382400640 1 -- 172.21.15.175:0/4268605761 shutdown_connections 2024-04-25T09:07:59.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.688+0000 7f8382400640 1 -- 172.21.15.175:0/4268605761 wait complete. 2024-04-25T09:07:59.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f8382400640 1 Processor -- start 2024-04-25T09:07:59.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f8382400640 1 -- start start 2024-04-25T09:07:59.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f8382400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f837c06bd60 0x7f837c155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f8382400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f837c099a50 0x7f837c15c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f8382400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f837c0d0d50 0x7f837c158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f8382400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c15dfe0 con 0x7f837c06bd60 2024-04-25T09:07:59.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f8382400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c15de60 con 0x7f837c099a50 2024-04-25T09:07:59.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f8382400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837c16b260 con 0x7f837c0d0d50 2024-04-25T09:07:59.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f837b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f837c06bd60 0x7f837c155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f837b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f837c06bd60 0x7f837c155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37154/0 (socket says 172.21.15.175:37154) 2024-04-25T09:07:59.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f837b400640 1 -- 172.21.15.175:0/1629019501 learned_addr learned my addr 172.21.15.175:0/1629019501 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:07:59.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f8372a00640 1 --2- 172.21.15.175:0/1629019501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f837c099a50 0x7f837c15c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f837be00640 1 --2- 172.21.15.175:0/1629019501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f837c0d0d50 0x7f837c158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f837b400640 1 -- 172.21.15.175:0/1629019501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f837c0d0d50 msgr2=0x7f837c158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f837b400640 1 --2- 172.21.15.175:0/1629019501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f837c0d0d50 0x7f837c158530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f837b400640 1 -- 172.21.15.175:0/1629019501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f837c099a50 msgr2=0x7f837c15c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f837b400640 1 --2- 172.21.15.175:0/1629019501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f837c099a50 0x7f837c15c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f837b400640 1 -- 172.21.15.175:0/1629019501 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c0c5ce0 con 0x7f837c06bd60 2024-04-25T09:07:59.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f837be00640 1 --2- 172.21.15.175:0/1629019501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f837c0d0d50 0x7f837c158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:59.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f837b400640 1 --2- 172.21.15.175:0/1629019501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f837c06bd60 0x7f837c155b20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f836c00e840 tx=0x7f836c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f8373e00640 1 -- 172.21.15.175:0/1629019501 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c017070 con 0x7f837c06bd60 2024-04-25T09:07:59.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f8373e00640 1 -- 172.21.15.175:0/1629019501 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c00c8d0 con 0x7f837c06bd60 2024-04-25T09:07:59.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f8382400640 1 -- 172.21.15.175:0/1629019501 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c156290 con 0x7f837c06bd60 2024-04-25T09:07:59.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f8373e00640 1 -- 172.21.15.175:0/1629019501 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c00f040 con 0x7f837c06bd60 2024-04-25T09:07:59.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.692+0000 7f8382400640 1 -- 172.21.15.175:0/1629019501 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c156850 con 0x7f837c06bd60 2024-04-25T09:07:59.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.696+0000 7f8382400640 1 -- 172.21.15.175:0/1629019501 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837c074a60 con 0x7f837c06bd60 2024-04-25T09:07:59.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.696+0000 7f8373e00640 1 -- 172.21.15.175:0/1629019501 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f836c01a070 con 0x7f837c06bd60 2024-04-25T09:07:59.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.696+0000 7f8373e00640 1 --2- 172.21.15.175:0/1629019501 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8358066f60 0x7f8358069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.696+0000 7f8373e00640 1 -- 172.21.15.175:0/1629019501 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f836c084cf0 con 0x7f837c06bd60 2024-04-25T09:07:59.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.696+0000 7f8372a00640 1 --2- 172.21.15.175:0/1629019501 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8358066f60 0x7f8358069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.696+0000 7f8372a00640 1 --2- 172.21.15.175:0/1629019501 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8358066f60 0x7f8358069420 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f83640ad000 tx=0x7f8364008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.700+0000 7f8373e00640 1 -- 172.21.15.175:0/1629019501 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f837c0c5ce0 con 0x7f837c06bd60 2024-04-25T09:07:59.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.884+0000 7f8382400640 1 -- 172.21.15.175:0/1629019501 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f837c09aee0 con 0x7f837c06bd60 2024-04-25T09:07:59.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.888+0000 7f8373e00640 1 -- 172.21.15.175:0/1629019501 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f836c055bd0 con 0x7f837c06bd60 2024-04-25T09:07:59.876 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:07:59.876 INFO:teuthology.orchestra.run.smithi175.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T09:07:59.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.888+0000 7f8382400640 1 -- 172.21.15.175:0/1629019501 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8358066f60 msgr2=0x7f8358069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.888+0000 7f8382400640 1 --2- 172.21.15.175:0/1629019501 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8358066f60 0x7f8358069420 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f83640ad000 tx=0x7f8364008040 comp rx=0 tx=0).stop 2024-04-25T09:07:59.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.888+0000 7f8382400640 1 -- 172.21.15.175:0/1629019501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f837c06bd60 msgr2=0x7f837c155b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.888+0000 7f8382400640 1 --2- 172.21.15.175:0/1629019501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f837c06bd60 0x7f837c155b20 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f836c00e840 tx=0x7f836c00ed00 comp rx=0 tx=0).stop 2024-04-25T09:07:59.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.888+0000 7f8382400640 1 -- 172.21.15.175:0/1629019501 shutdown_connections 2024-04-25T09:07:59.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.888+0000 7f8382400640 1 --2- 172.21.15.175:0/1629019501 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8358066f60 0x7f8358069420 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.888+0000 7f8382400640 1 --2- 172.21.15.175:0/1629019501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f837c0d0d50 0x7f837c158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.888+0000 7f8382400640 1 --2- 172.21.15.175:0/1629019501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f837c099a50 0x7f837c15c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.888+0000 7f8382400640 1 --2- 172.21.15.175:0/1629019501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f837c06bd60 0x7f837c155b20 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.888+0000 7f8382400640 1 -- 172.21.15.175:0/1629019501 >> 172.21.15.175:0/1629019501 conn(0x7f837c0b3300 msgr2=0x7f837c0b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.888+0000 7f8382400640 1 -- 172.21.15.175:0/1629019501 shutdown_connections 2024-04-25T09:07:59.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:07:59.888+0000 7f8382400640 1 -- 172.21.15.175:0/1629019501 wait complete. 2024-04-25T09:07:59.899 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T09:07:59.899 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:07:59.900 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:07:59.990 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:08:00.031 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:08:00.031 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:08:00.032 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:08:00.040 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:08:00.041 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:08:00.091 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:08:00.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578f200640 1 Processor -- start 2024-04-25T09:08:00.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578f200640 1 -- start start 2024-04-25T09:08:00.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578f200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f579015dc80 0x7f57900cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578f200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57900ce580 con 0x7f57900c4170 2024-04-25T09:08:00.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578f200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57900d0220 con 0x7f579006b360 2024-04-25T09:08:00.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578f200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57900cadf0 con 0x7f579015dc80 2024-04-25T09:08:00.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578d400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f57900c4170 0x7f579006ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45288/0 (socket says 172.21.15.175:45288) 2024-04-25T09:08:00.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578d400640 1 -- 172.21.15.175:0/3705625138 learned_addr learned my addr 172.21.15.175:0/3705625138 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:00.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578de00640 1 --2- 172.21.15.175:0/3705625138 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f579015dc80 0x7f57900cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578ca00640 1 -- 172.21.15.175:0/3705625138 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611176607 0 0) 0x7f57900ce580 con 0x7f57900c4170 2024-04-25T09:08:00.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578ca00640 1 -- 172.21.15.175:0/3705625138 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5774003530 con 0x7f57900c4170 2024-04-25T09:08:00.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578ca00640 1 -- 172.21.15.175:0/3705625138 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 422901093 0 0) 0x7f57900d0220 con 0x7f579006b360 2024-04-25T09:08:00.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578ca00640 1 -- 172.21.15.175:0/3705625138 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57900ce580 con 0x7f579006b360 2024-04-25T09:08:00.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578ca00640 1 -- 172.21.15.175:0/3705625138 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 345095888 0 0) 0x7f5774003530 con 0x7f57900c4170 2024-04-25T09:08:00.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578ca00640 1 -- 172.21.15.175:0/3705625138 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f579015dc80 msgr2=0x7f57900cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:00.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578ca00640 1 --2- 172.21.15.175:0/3705625138 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f579015dc80 0x7f57900cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578ca00640 1 -- 172.21.15.175:0/3705625138 >> v1:172.21.15.177:6789/0 conn(0x7f579006b360 legacy=0x7f57900cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578ca00640 1 -- 172.21.15.175:0/3705625138 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57900cb0d0 con 0x7f57900c4170 2024-04-25T09:08:00.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578ca00640 1 -- 172.21.15.175:0/3705625138 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f577c001600 con 0x7f57900c4170 2024-04-25T09:08:00.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578ca00640 1 -- 172.21.15.175:0/3705625138 >> v1:172.21.15.175:6789/0 conn(0x7f57900c4170 legacy=0x7f579006ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578ca00640 1 --2- 172.21.15.175:0/3705625138 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f579015dc80 0x7f5774003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578ca00640 1 --2- 172.21.15.175:0/3705625138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57740041a0 0x7f5774004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578ca00640 1 --2- 172.21.15.175:0/3705625138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5774004d50 0x7f57740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578ca00640 1 -- 172.21.15.175:0/3705625138 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57900cadf0 con 0x7f5774004d50 2024-04-25T09:08:00.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578ca00640 1 -- 172.21.15.175:0/3705625138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577400bb60 con 0x7f57740041a0 2024-04-25T09:08:00.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578ca00640 1 -- 172.21.15.175:0/3705625138 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577400bd60 con 0x7f579015dc80 2024-04-25T09:08:00.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578d400640 1 --2- 172.21.15.175:0/3705625138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57740041a0 0x7f5774004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578de00640 1 --2- 172.21.15.175:0/3705625138 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f579015dc80 0x7f5774003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578e800640 1 --2- 172.21.15.175:0/3705625138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5774004d50 0x7f57740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578d400640 1 -- 172.21.15.175:0/3705625138 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f579015dc80 msgr2=0x7f5774003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:00.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578d400640 1 --2- 172.21.15.175:0/3705625138 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f579015dc80 0x7f5774003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578d400640 1 -- 172.21.15.175:0/3705625138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5774004d50 msgr2=0x7f57740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:00.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578d400640 1 --2- 172.21.15.175:0/3705625138 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5774004d50 0x7f57740051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.284+0000 7f578d400640 1 -- 172.21.15.175:0/3705625138 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5774003530 con 0x7f57740041a0 2024-04-25T09:08:00.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.288+0000 7f578d400640 1 --2- 172.21.15.175:0/3705625138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57740041a0 0x7f5774004810 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f577c007fc0 tx=0x7f577c01f230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5144ea90c1f55ae0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:00.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.288+0000 7f578ca00640 1 -- 172.21.15.175:0/3705625138 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c007bb0 con 0x7f57740041a0 2024-04-25T09:08:00.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.288+0000 7f578ca00640 1 -- 172.21.15.175:0/3705625138 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c0ac070 con 0x7f57740041a0 2024-04-25T09:08:00.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.288+0000 7f578ca00640 1 -- 172.21.15.175:0/3705625138 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577c005b20 con 0x7f57740041a0 2024-04-25T09:08:00.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.288+0000 7f578f200640 1 -- 172.21.15.175:0/3705625138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57740041a0 msgr2=0x7f5774004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.288+0000 7f578f200640 1 --2- 172.21.15.175:0/3705625138 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57740041a0 0x7f5774004810 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f577c007fc0 tx=0x7f577c01f230 comp rx=0 tx=0).stop 2024-04-25T09:08:00.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.288+0000 7f578e800640 1 -- 172.21.15.175:0/3705625138 reap_dead start 2024-04-25T09:08:00.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.288+0000 7f578f200640 1 -- 172.21.15.175:0/3705625138 shutdown_connections 2024-04-25T09:08:00.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.288+0000 7f578f200640 1 -- 172.21.15.175:0/3705625138 >> 172.21.15.175:0/3705625138 conn(0x7f5790099a50 msgr2=0x7f57900d0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:00.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.288+0000 7f578f200640 1 -- 172.21.15.175:0/3705625138 shutdown_connections 2024-04-25T09:08:00.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.288+0000 7f578f200640 1 -- 172.21.15.175:0/3705625138 wait complete. 2024-04-25T09:08:00.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578f200640 1 Processor -- start 2024-04-25T09:08:00.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578f200640 1 -- start start 2024-04-25T09:08:00.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578f200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57740041a0 0x7f5790157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578f200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57901f6b10 0x7f57900c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578f200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57901f6f90 0x7f57900c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578f200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579015e1e0 con 0x7f57740041a0 2024-04-25T09:08:00.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578f200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579015e060 con 0x7f57901f6f90 2024-04-25T09:08:00.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578f200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57900d0fd0 con 0x7f57901f6b10 2024-04-25T09:08:00.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57740041a0 0x7f5790157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57740041a0 0x7f5790157f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37176/0 (socket says 172.21.15.175:37176) 2024-04-25T09:08:00.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578de00640 1 -- 172.21.15.175:0/569599850 learned_addr learned my addr 172.21.15.175:0/569599850 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:00.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578d400640 1 --2- 172.21.15.175:0/569599850 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57901f6b10 0x7f57900c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578e800640 1 --2- 172.21.15.175:0/569599850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57901f6f90 0x7f57900c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578de00640 1 -- 172.21.15.175:0/569599850 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57901f6b10 msgr2=0x7f57900c5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578de00640 1 --2- 172.21.15.175:0/569599850 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57901f6b10 0x7f57900c5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578de00640 1 -- 172.21.15.175:0/569599850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57901f6f90 msgr2=0x7f57900c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578de00640 1 --2- 172.21.15.175:0/569599850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57901f6f90 0x7f57900c5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578de00640 1 -- 172.21.15.175:0/569599850 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5790158480 con 0x7f57740041a0 2024-04-25T09:08:00.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578de00640 1 --2- 172.21.15.175:0/569599850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57740041a0 0x7f5790157f40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f57800119d0 tx=0x7f5780011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:00.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f5786000640 1 -- 172.21.15.175:0/569599850 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578000faf0 con 0x7f57740041a0 2024-04-25T09:08:00.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f5786000640 1 -- 172.21.15.175:0/569599850 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578000fc90 con 0x7f57740041a0 2024-04-25T09:08:00.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578f200640 1 -- 172.21.15.175:0/569599850 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57901f7560 con 0x7f57740041a0 2024-04-25T09:08:00.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f5786000640 1 -- 172.21.15.175:0/569599850 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5780014440 con 0x7f57740041a0 2024-04-25T09:08:00.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.292+0000 7f578f200640 1 -- 172.21.15.175:0/569599850 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57901f4860 con 0x7f57740041a0 2024-04-25T09:08:00.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.296+0000 7f578f200640 1 -- 172.21.15.175:0/569599850 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5790074a60 con 0x7f57740041a0 2024-04-25T09:08:00.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.296+0000 7f5786000640 1 -- 172.21.15.175:0/569599850 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5780012040 con 0x7f57740041a0 2024-04-25T09:08:00.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.296+0000 7f5786000640 1 --2- 172.21.15.175:0/569599850 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5770066f90 0x7f5770069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.296+0000 7f5786000640 1 -- 172.21.15.175:0/569599850 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5780085350 con 0x7f57740041a0 2024-04-25T09:08:00.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.296+0000 7f578d400640 1 --2- 172.21.15.175:0/569599850 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5770066f90 0x7f5770069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.296+0000 7f578d400640 1 --2- 172.21.15.175:0/569599850 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5770066f90 0x7f5770069450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f577c007f90 tx=0x7f577c0b4040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:00.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.300+0000 7f5786000640 1 -- 172.21.15.175:0/569599850 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5790158480 con 0x7f57740041a0 2024-04-25T09:08:00.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.460+0000 7f578f200640 1 -- 172.21.15.175:0/569599850 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57900cca50 con 0x7f57740041a0 2024-04-25T09:08:00.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.464+0000 7f5786000640 1 -- 172.21.15.175:0/569599850 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16701 (secure 0 0 0) 0x7f578005ae20 con 0x7f57740041a0 2024-04-25T09:08:00.452 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:00.452 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":58,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:06:45.356791+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:41.465085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:42.715758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:08:00.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.464+0000 7f578f200640 1 -- 172.21.15.175:0/569599850 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5770066f90 msgr2=0x7f5770069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.464+0000 7f578f200640 1 --2- 172.21.15.175:0/569599850 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5770066f90 0x7f5770069450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f577c007f90 tx=0x7f577c0b4040 comp rx=0 tx=0).stop 2024-04-25T09:08:00.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.464+0000 7f578f200640 1 -- 172.21.15.175:0/569599850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57740041a0 msgr2=0x7f5790157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.464+0000 7f578f200640 1 --2- 172.21.15.175:0/569599850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57740041a0 0x7f5790157f40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f57800119d0 tx=0x7f5780011e90 comp rx=0 tx=0).stop 2024-04-25T09:08:00.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.464+0000 7f578f200640 1 -- 172.21.15.175:0/569599850 shutdown_connections 2024-04-25T09:08:00.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.464+0000 7f578f200640 1 --2- 172.21.15.175:0/569599850 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5770066f90 0x7f5770069450 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.464+0000 7f578f200640 1 --2- 172.21.15.175:0/569599850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57901f6f90 0x7f57900c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.464+0000 7f578f200640 1 --2- 172.21.15.175:0/569599850 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57901f6b10 0x7f57900c5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.464+0000 7f578f200640 1 --2- 172.21.15.175:0/569599850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57740041a0 0x7f5790157f40 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.464+0000 7f578f200640 1 -- 172.21.15.175:0/569599850 >> 172.21.15.175:0/569599850 conn(0x7f5790099a50 msgr2=0x7f57900b1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:00.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.464+0000 7f578f200640 1 -- 172.21.15.175:0/569599850 shutdown_connections 2024-04-25T09:08:00.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.464+0000 7f578f200640 1 -- 172.21.15.175:0/569599850 wait complete. 2024-04-25T09:08:00.473 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:06:41.465085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:06:42.715758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:08:00.474 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:08:00.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.624+0000 7f1862a00640 1 Processor -- start 2024-04-25T09:08:00.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.624+0000 7f1862a00640 1 -- start start 2024-04-25T09:08:00.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.624+0000 7f1862a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185c145250 0x7f185c0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.624+0000 7f1862a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f185c0ce970 0x7f185c0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.624+0000 7f1862a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185c0cfd10 con 0x7f185c1600a0 2024-04-25T09:08:00.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.624+0000 7f1862a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185c15f650 con 0x7f185c0ce970 2024-04-25T09:08:00.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.624+0000 7f1862a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c0cfff0 con 0x7f185c145250 2024-04-25T09:08:00.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.624+0000 7f185be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185c145250 0x7f185c0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.624+0000 7f1860a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f185c0ce970 0x7f185c0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.624+0000 7f185be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185c145250 0x7f185c0cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:43522/0 (socket says 172.21.15.175:43522) 2024-04-25T09:08:00.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.624+0000 7f185be00640 1 -- 172.21.15.175:0/1861394749 learned_addr learned my addr 172.21.15.175:0/1861394749 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:00.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.624+0000 7f185be00640 1 -- 172.21.15.175:0/1861394749 >> v2:172.21.15.177:3300/0 conn(0x7f185c0ce970 msgr2=0x7f185c0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:00.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.624+0000 7f185be00640 1 --2- 172.21.15.175:0/1861394749 >> v2:172.21.15.177:3300/0 conn(0x7f185c0ce970 0x7f185c0cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.624+0000 7f185be00640 1 -- 172.21.15.175:0/1861394749 >> v1:172.21.15.177:6789/0 conn(0x7f185c1600a0 legacy=0x7f185c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.624+0000 7f185be00640 1 -- 172.21.15.175:0/1861394749 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c15f8a0 con 0x7f185c145250 2024-04-25T09:08:00.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.628+0000 7f185be00640 1 --2- 172.21.15.175:0/1861394749 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185c145250 0x7f185c0cf6b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f184c009870 tx=0x7f184c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e9e7c1a335232b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:00.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.628+0000 7f185aa00640 1 -- 172.21.15.175:0/1861394749 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c0aa620 con 0x7f185c145250 2024-04-25T09:08:00.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.628+0000 7f185aa00640 1 -- 172.21.15.175:0/1861394749 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184c0af070 con 0x7f185c145250 2024-04-25T09:08:00.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.628+0000 7f185aa00640 1 -- 172.21.15.175:0/1861394749 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c0aa9e0 con 0x7f185c145250 2024-04-25T09:08:00.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.628+0000 7f1862a00640 1 -- 172.21.15.175:0/1861394749 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185c145250 msgr2=0x7f185c0cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.628+0000 7f1862a00640 1 --2- 172.21.15.175:0/1861394749 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185c145250 0x7f185c0cf6b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f184c009870 tx=0x7f184c01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.628+0000 7f1862a00640 1 -- 172.21.15.175:0/1861394749 shutdown_connections 2024-04-25T09:08:00.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.628+0000 7f1862a00640 1 --2- 172.21.15.175:0/1861394749 >> v2:172.21.15.177:3300/0 conn(0x7f185c0ce970 0x7f185c0cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.628+0000 7f1862a00640 1 --2- 172.21.15.175:0/1861394749 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185c145250 0x7f185c0cf6b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.628+0000 7f1862a00640 1 -- 172.21.15.175:0/1861394749 >> 172.21.15.175:0/1861394749 conn(0x7f185c06ac50 msgr2=0x7f185c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:00.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.628+0000 7f1862a00640 1 -- 172.21.15.175:0/1861394749 shutdown_connections 2024-04-25T09:08:00.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.628+0000 7f1862a00640 1 -- 172.21.15.175:0/1861394749 wait complete. 2024-04-25T09:08:00.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.628+0000 7f1862a00640 1 Processor -- start 2024-04-25T09:08:00.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.628+0000 7f1862a00640 1 -- start start 2024-04-25T09:08:00.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f1862a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185c0ce970 0x7f185c15d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f1862a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185c145250 0x7f185c15e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f1862a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f185c1600a0 0x7f185c06ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f1862a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c160600 con 0x7f185c0ce970 2024-04-25T09:08:00.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f1862a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c160480 con 0x7f185c1600a0 2024-04-25T09:08:00.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f1862a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c15c870 con 0x7f185c145250 2024-04-25T09:08:00.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f185be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185c0ce970 0x7f185c15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f185be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185c0ce970 0x7f185c15d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37180/0 (socket says 172.21.15.175:37180) 2024-04-25T09:08:00.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f1860a00640 1 --2- 172.21.15.175:0/3256994116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f185c1600a0 0x7f185c06ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f185b400640 1 --2- 172.21.15.175:0/3256994116 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185c145250 0x7f185c15e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f185be00640 1 -- 172.21.15.175:0/3256994116 learned_addr learned my addr 172.21.15.175:0/3256994116 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:00.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f185be00640 1 -- 172.21.15.175:0/3256994116 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185c145250 msgr2=0x7f185c15e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f185be00640 1 --2- 172.21.15.175:0/3256994116 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185c145250 0x7f185c15e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f185be00640 1 -- 172.21.15.175:0/3256994116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f185c1600a0 msgr2=0x7f185c06ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f185be00640 1 --2- 172.21.15.175:0/3256994116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f185c1600a0 0x7f185c06ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f185be00640 1 -- 172.21.15.175:0/3256994116 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c140bf0 con 0x7f185c0ce970 2024-04-25T09:08:00.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f185b400640 1 --2- 172.21.15.175:0/3256994116 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185c145250 0x7f185c15e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:08:00.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f1860a00640 1 --2- 172.21.15.175:0/3256994116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f185c1600a0 0x7f185c06ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:08:00.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f185be00640 1 --2- 172.21.15.175:0/3256994116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185c0ce970 0x7f185c15d430 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f184c0ac040 tx=0x7f184c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:00.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f1853e00640 1 -- 172.21.15.175:0/3256994116 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c0aad00 con 0x7f185c0ce970 2024-04-25T09:08:00.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f1853e00640 1 -- 172.21.15.175:0/3256994116 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184c0bd3f0 con 0x7f185c0ce970 2024-04-25T09:08:00.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f1853e00640 1 -- 172.21.15.175:0/3256994116 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c0bd7e0 con 0x7f185c0ce970 2024-04-25T09:08:00.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f1862a00640 1 -- 172.21.15.175:0/3256994116 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185c140e90 con 0x7f185c0ce970 2024-04-25T09:08:00.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f1862a00640 1 -- 172.21.15.175:0/3256994116 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185c15d970 con 0x7f185c0ce970 2024-04-25T09:08:00.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.632+0000 7f1862a00640 1 -- 172.21.15.175:0/3256994116 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185c075160 con 0x7f185c0ce970 2024-04-25T09:08:00.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.636+0000 7f1853e00640 1 -- 172.21.15.175:0/3256994116 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f184c0c6440 con 0x7f185c0ce970 2024-04-25T09:08:00.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.636+0000 7f1853e00640 1 --2- 172.21.15.175:0/3256994116 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f183c066f90 0x7f183c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.636+0000 7f1853e00640 1 -- 172.21.15.175:0/3256994116 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f184c11f490 con 0x7f185c0ce970 2024-04-25T09:08:00.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.636+0000 7f185b400640 1 --2- 172.21.15.175:0/3256994116 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f183c066f90 0x7f183c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.636+0000 7f185b400640 1 --2- 172.21.15.175:0/3256994116 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f183c066f90 0x7f183c069450 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f185c13d010 tx=0x7f1848009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:00.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.640+0000 7f1853e00640 1 -- 172.21.15.175:0/3256994116 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f184c016150 con 0x7f185c0ce970 2024-04-25T09:08:00.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.792+0000 7f1862a00640 1 -- 172.21.15.175:0/3256994116 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f185c0d03d0 con 0x7f185c0ce970 2024-04-25T09:08:00.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.792+0000 7f1853e00640 1 -- 172.21.15.175:0/3256994116 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f184c0efe40 con 0x7f185c0ce970 2024-04-25T09:08:00.783 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:08:00.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.796+0000 7f1862a00640 1 -- 172.21.15.175:0/3256994116 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f183c066f90 msgr2=0x7f183c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.796+0000 7f1862a00640 1 --2- 172.21.15.175:0/3256994116 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f183c066f90 0x7f183c069450 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f185c13d010 tx=0x7f1848009040 comp rx=0 tx=0).stop 2024-04-25T09:08:00.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.796+0000 7f1862a00640 1 -- 172.21.15.175:0/3256994116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185c0ce970 msgr2=0x7f185c15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.796+0000 7f1862a00640 1 --2- 172.21.15.175:0/3256994116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185c0ce970 0x7f185c15d430 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f184c0ac040 tx=0x7f184c01ace0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.796+0000 7f1862a00640 1 -- 172.21.15.175:0/3256994116 shutdown_connections 2024-04-25T09:08:00.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.796+0000 7f1862a00640 1 --2- 172.21.15.175:0/3256994116 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f183c066f90 0x7f183c069450 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.796+0000 7f1862a00640 1 --2- 172.21.15.175:0/3256994116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f185c1600a0 0x7f185c06ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.796+0000 7f1862a00640 1 --2- 172.21.15.175:0/3256994116 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f185c145250 0x7f185c15e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.796+0000 7f1862a00640 1 --2- 172.21.15.175:0/3256994116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185c0ce970 0x7f185c15d430 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.796+0000 7f1862a00640 1 -- 172.21.15.175:0/3256994116 >> 172.21.15.175:0/3256994116 conn(0x7f185c06ac50 msgr2=0x7f185c144040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:00.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.796+0000 7f1862a00640 1 -- 172.21.15.175:0/3256994116 shutdown_connections 2024-04-25T09:08:00.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.796+0000 7f1862a00640 1 -- 172.21.15.175:0/3256994116 wait complete. 2024-04-25T09:08:00.805 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:08:00.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.956+0000 7f8ce0600640 1 Processor -- start 2024-04-25T09:08:00.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.956+0000 7f8ce0600640 1 -- start start 2024-04-25T09:08:00.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.956+0000 7f8ce0600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8cd80cbf90 0x7f8cd80ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.956+0000 7f8ce0600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8cd80ce7f0 0x7f8cd806c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.956+0000 7f8ce0600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd806dd70 con 0x7f8cd815dc90 2024-04-25T09:08:00.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.956+0000 7f8ce0600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd8162570 con 0x7f8cd80ce7f0 2024-04-25T09:08:00.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.956+0000 7f8ce0600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd80cec20 con 0x7f8cd80cbf90 2024-04-25T09:08:00.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.956+0000 7f8cde600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8cd80ce7f0 0x7f8cd806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.956+0000 7f8cde600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8cd80ce7f0 0x7f8cd806c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37192/0 (socket says 172.21.15.175:37192) 2024-04-25T09:08:00.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.956+0000 7f8cddc00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f8cd815dc90 0x7f8cd806d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45290/0 (socket says 172.21.15.175:45290) 2024-04-25T09:08:00.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.956+0000 7f8cde600640 1 -- 172.21.15.175:0/2136668991 learned_addr learned my addr 172.21.15.175:0/2136668991 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:00.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.956+0000 7f8cdd200640 1 --2- 172.21.15.175:0/2136668991 >> v2:172.21.15.177:3300/0 conn(0x7f8cd80cbf90 0x7f8cd80ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.956+0000 7f8cde600640 1 -- 172.21.15.175:0/2136668991 >> v2:172.21.15.177:3300/0 conn(0x7f8cd80cbf90 msgr2=0x7f8cd80ce2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:00.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.956+0000 7f8cde600640 1 --2- 172.21.15.175:0/2136668991 >> v2:172.21.15.177:3300/0 conn(0x7f8cd80cbf90 0x7f8cd80ce2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.956+0000 7f8cde600640 1 -- 172.21.15.175:0/2136668991 >> v1:172.21.15.175:6789/0 conn(0x7f8cd815dc90 legacy=0x7f8cd806d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.956+0000 7f8cde600640 1 -- 172.21.15.175:0/2136668991 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd81619a0 con 0x7f8cd80ce7f0 2024-04-25T09:08:00.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.960+0000 7f8cde600640 1 --2- 172.21.15.175:0/2136668991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd80ce7f0 0x7f8cd806c330 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80d2a00 tx=0x7f8cd001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b2398580f75078 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:00.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.960+0000 7f8cd7e00640 1 -- 172.21.15.175:0/2136668991 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd00b0070 con 0x7f8cd80ce7f0 2024-04-25T09:08:00.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.960+0000 7f8cd7e00640 1 -- 172.21.15.175:0/2136668991 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd00ab600 con 0x7f8cd80ce7f0 2024-04-25T09:08:00.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.960+0000 7f8cd7e00640 1 -- 172.21.15.175:0/2136668991 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd00ab9d0 con 0x7f8cd80ce7f0 2024-04-25T09:08:00.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.960+0000 7f8ce0600640 1 -- 172.21.15.175:0/2136668991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd80ce7f0 msgr2=0x7f8cd806c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.960+0000 7f8ce0600640 1 --2- 172.21.15.175:0/2136668991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd80ce7f0 0x7f8cd806c330 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80d2a00 tx=0x7f8cd001c460 comp rx=0 tx=0).stop 2024-04-25T09:08:00.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.960+0000 7f8ce0600640 1 -- 172.21.15.175:0/2136668991 shutdown_connections 2024-04-25T09:08:00.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.960+0000 7f8ce0600640 1 --2- 172.21.15.175:0/2136668991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd80ce7f0 0x7f8cd806c330 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.960+0000 7f8ce0600640 1 --2- 172.21.15.175:0/2136668991 >> v2:172.21.15.177:3300/0 conn(0x7f8cd80cbf90 0x7f8cd80ce2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.960+0000 7f8ce0600640 1 -- 172.21.15.175:0/2136668991 >> 172.21.15.175:0/2136668991 conn(0x7f8cd806f550 msgr2=0x7f8cd806f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:00.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.960+0000 7f8ce0600640 1 -- 172.21.15.175:0/2136668991 shutdown_connections 2024-04-25T09:08:00.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.960+0000 7f8ce0600640 1 -- 172.21.15.175:0/2136668991 wait complete. 2024-04-25T09:08:00.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8ce0600640 1 Processor -- start 2024-04-25T09:08:00.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8ce0600640 1 -- start start 2024-04-25T09:08:00.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8ce0600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd80cbf90 0x7f8cd815f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8ce0600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd80ce7f0 0x7f8cd8158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8ce0600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd815dc90 0x7f8cd8153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8ce0600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80cdf20 con 0x7f8cd80cbf90 2024-04-25T09:08:00.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8ce0600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd815e070 con 0x7f8cd80ce7f0 2024-04-25T09:08:00.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8ce0600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80ce0a0 con 0x7f8cd815dc90 2024-04-25T09:08:00.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8cddc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd80cbf90 0x7f8cd815f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8cddc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd80cbf90 0x7f8cd815f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37208/0 (socket says 172.21.15.175:37208) 2024-04-25T09:08:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8cddc00640 1 -- 172.21.15.175:0/2180443 learned_addr learned my addr 172.21.15.175:0/2180443 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8cde600640 1 --2- 172.21.15.175:0/2180443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd815dc90 0x7f8cd8153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8cdd200640 1 --2- 172.21.15.175:0/2180443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd80ce7f0 0x7f8cd8158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8cddc00640 1 -- 172.21.15.175:0/2180443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd815dc90 msgr2=0x7f8cd8153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8cddc00640 1 --2- 172.21.15.175:0/2180443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd815dc90 0x7f8cd8153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8cddc00640 1 -- 172.21.15.175:0/2180443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd80ce7f0 msgr2=0x7f8cd8158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8cddc00640 1 --2- 172.21.15.175:0/2180443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd80ce7f0 0x7f8cd8158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8cddc00640 1 -- 172.21.15.175:0/2180443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd81596f0 con 0x7f8cd80cbf90 2024-04-25T09:08:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8cdd200640 1 --2- 172.21.15.175:0/2180443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd80ce7f0 0x7f8cd8158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8cddc00640 1 --2- 172.21.15.175:0/2180443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd80cbf90 0x7f8cd815f350 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00c760 tx=0x7f8ccc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8cd5600640 1 -- 172.21.15.175:0/2180443 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc017070 con 0x7f8cd80cbf90 2024-04-25T09:08:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8cd5600640 1 -- 172.21.15.175:0/2180443 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc00a640 con 0x7f8cd80cbf90 2024-04-25T09:08:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8ce0600640 1 -- 172.21.15.175:0/2180443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd81599d0 con 0x7f8cd80cbf90 2024-04-25T09:08:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8cd5600640 1 -- 172.21.15.175:0/2180443 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc00aa10 con 0x7f8cd80cbf90 2024-04-25T09:08:00.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.964+0000 7f8ce0600640 1 -- 172.21.15.175:0/2180443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd8159f90 con 0x7f8cd80cbf90 2024-04-25T09:08:00.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.968+0000 7f8ce0600640 1 -- 172.21.15.175:0/2180443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd815a370 con 0x7f8cd80cbf90 2024-04-25T09:08:00.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.968+0000 7f8cd5600640 1 -- 172.21.15.175:0/2180443 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8ccc01a070 con 0x7f8cd80cbf90 2024-04-25T09:08:00.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.968+0000 7f8cd5600640 1 --2- 172.21.15.175:0/2180443 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8cb8066f60 0x7f8cb8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.968+0000 7f8cd5600640 1 -- 172.21.15.175:0/2180443 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ccc0845f0 con 0x7f8cd80cbf90 2024-04-25T09:08:00.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.968+0000 7f8cdd200640 1 --2- 172.21.15.175:0/2180443 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8cb8066f60 0x7f8cb8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.968+0000 7f8cdd200640 1 --2- 172.21.15.175:0/2180443 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8cb8066f60 0x7f8cb8069420 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8cd81fa180 tx=0x7f8cc4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:00.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:00.972+0000 7f8cd5600640 1 -- 172.21.15.175:0/2180443 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8cd815a370 con 0x7f8cd80cbf90 2024-04-25T09:08:01.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.132+0000 7f8ce0600640 1 -- 172.21.15.175:0/2180443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8cd8075160 con 0x7f8cd80cbf90 2024-04-25T09:08:01.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.132+0000 7f8cd5600640 1 -- 172.21.15.175:0/2180443 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8cd806dd70 con 0x7f8cd80cbf90 2024-04-25T09:08:01.121 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:08:01.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.132+0000 7f8ce0600640 1 -- 172.21.15.175:0/2180443 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8cb8066f60 msgr2=0x7f8cb8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:01.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.132+0000 7f8ce0600640 1 --2- 172.21.15.175:0/2180443 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8cb8066f60 0x7f8cb8069420 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8cd81fa180 tx=0x7f8cc4008040 comp rx=0 tx=0).stop 2024-04-25T09:08:01.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.132+0000 7f8ce0600640 1 -- 172.21.15.175:0/2180443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd80cbf90 msgr2=0x7f8cd815f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:01.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.132+0000 7f8ce0600640 1 --2- 172.21.15.175:0/2180443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd80cbf90 0x7f8cd815f350 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00c760 tx=0x7f8ccc00cc20 comp rx=0 tx=0).stop 2024-04-25T09:08:01.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.132+0000 7f8ce0600640 1 -- 172.21.15.175:0/2180443 shutdown_connections 2024-04-25T09:08:01.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.132+0000 7f8ce0600640 1 --2- 172.21.15.175:0/2180443 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8cb8066f60 0x7f8cb8069420 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.132+0000 7f8ce0600640 1 --2- 172.21.15.175:0/2180443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cd815dc90 0x7f8cd8153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.132+0000 7f8ce0600640 1 --2- 172.21.15.175:0/2180443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cd80ce7f0 0x7f8cd8158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.132+0000 7f8ce0600640 1 --2- 172.21.15.175:0/2180443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cd80cbf90 0x7f8cd815f350 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.132+0000 7f8ce0600640 1 -- 172.21.15.175:0/2180443 >> 172.21.15.175:0/2180443 conn(0x7f8cd806f550 msgr2=0x7f8cd815c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:01.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.132+0000 7f8ce0600640 1 -- 172.21.15.175:0/2180443 shutdown_connections 2024-04-25T09:08:01.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.132+0000 7f8ce0600640 1 -- 172.21.15.175:0/2180443 wait complete. 2024-04-25T09:08:01.142 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:08:01.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.288+0000 7f5d15c00640 1 Processor -- start 2024-04-25T09:08:01.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.288+0000 7f5d15c00640 1 -- start start 2024-04-25T09:08:01.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d15c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d100cf6b0 0x7f5d101600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:01.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d15c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5d100ce970 0x7f5d100cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:01.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d15c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d100cfd10 con 0x7f5d10145250 2024-04-25T09:08:01.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d15c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d101605e0 con 0x7f5d100ce970 2024-04-25T09:08:01.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d15c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1015f650 con 0x7f5d100cf6b0 2024-04-25T09:08:01.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0ea00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5d10145250 0x7f5d100cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45298/0 (socket says 172.21.15.175:45298) 2024-04-25T09:08:01.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0ea00640 1 -- 172.21.15.175:0/1213994095 learned_addr learned my addr 172.21.15.175:0/1213994095 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:01.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0f400640 1 --2- 172.21.15.175:0/1213994095 >> v2:172.21.15.177:3300/0 conn(0x7f5d100ce970 0x7f5d100cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:01.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0e000640 1 --2- 172.21.15.175:0/1213994095 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d100cf6b0 0x7f5d101600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:01.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0d600640 1 -- 172.21.15.175:0/1213994095 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951404532 0 0) 0x7f5d100cfd10 con 0x7f5d10145250 2024-04-25T09:08:01.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0d600640 1 -- 172.21.15.175:0/1213994095 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cf4003530 con 0x7f5d10145250 2024-04-25T09:08:01.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0d600640 1 -- 172.21.15.175:0/1213994095 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 838434080 0 0) 0x7f5cf4003530 con 0x7f5d10145250 2024-04-25T09:08:01.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0d600640 1 -- 172.21.15.175:0/1213994095 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d100cf6b0 msgr2=0x7f5d101600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:01.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0d600640 1 --2- 172.21.15.175:0/1213994095 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d100cf6b0 0x7f5d101600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0d600640 1 -- 172.21.15.175:0/1213994095 >> v2:172.21.15.177:3300/0 conn(0x7f5d100ce970 msgr2=0x7f5d100cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:01.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0d600640 1 --2- 172.21.15.175:0/1213994095 >> v2:172.21.15.177:3300/0 conn(0x7f5d100ce970 0x7f5d100cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0d600640 1 -- 172.21.15.175:0/1213994095 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d100cfff0 con 0x7f5d10145250 2024-04-25T09:08:01.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0d600640 1 -- 172.21.15.175:0/1213994095 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f5d00001680 con 0x7f5d10145250 2024-04-25T09:08:01.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0d600640 1 -- 172.21.15.175:0/1213994095 >> v1:172.21.15.175:6789/0 conn(0x7f5d10145250 legacy=0x7f5d100cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:01.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0d600640 1 --2- 172.21.15.175:0/1213994095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cf40039c0 0x7f5cf4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:01.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0d600640 1 --2- 172.21.15.175:0/1213994095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cf4004810 0x7f5cf4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:01.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0d600640 1 --2- 172.21.15.175:0/1213994095 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d100cf6b0 0x7f5cf40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:01.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0d600640 1 -- 172.21.15.175:0/1213994095 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d101605e0 con 0x7f5cf4004810 2024-04-25T09:08:01.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0d600640 1 -- 172.21.15.175:0/1213994095 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1015f650 con 0x7f5cf40039c0 2024-04-25T09:08:01.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0d600640 1 -- 172.21.15.175:0/1213994095 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf400ba00 con 0x7f5d100cf6b0 2024-04-25T09:08:01.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0e000640 1 --2- 172.21.15.175:0/1213994095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cf4004810 0x7f5cf4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:01.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0ea00640 1 --2- 172.21.15.175:0/1213994095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cf40039c0 0x7f5cf4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:01.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0f400640 1 --2- 172.21.15.175:0/1213994095 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d100cf6b0 0x7f5cf40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:01.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0e000640 1 -- 172.21.15.175:0/1213994095 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d100cf6b0 msgr2=0x7f5cf40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:01.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0e000640 1 --2- 172.21.15.175:0/1213994095 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5d100cf6b0 0x7f5cf40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0e000640 1 -- 172.21.15.175:0/1213994095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cf40039c0 msgr2=0x7f5cf4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:01.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0e000640 1 --2- 172.21.15.175:0/1213994095 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cf40039c0 0x7f5cf4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.292+0000 7f5d0e000640 1 -- 172.21.15.175:0/1213994095 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf4003530 con 0x7f5cf4004810 2024-04-25T09:08:01.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.296+0000 7f5d0e000640 1 --2- 172.21.15.175:0/1213994095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cf4004810 0x7f5cf4004c90 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009ae0 tx=0x7f5cfc01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d518fce162c580c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:01.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.296+0000 7f5d0d600640 1 -- 172.21.15.175:0/1213994095 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc0096b0 con 0x7f5cf4004810 2024-04-25T09:08:01.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.296+0000 7f5d0d600640 1 -- 172.21.15.175:0/1213994095 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc0a9470 con 0x7f5cf4004810 2024-04-25T09:08:01.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.296+0000 7f5d0d600640 1 -- 172.21.15.175:0/1213994095 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc0a9860 con 0x7f5cf4004810 2024-04-25T09:08:01.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.296+0000 7f5d15c00640 1 -- 172.21.15.175:0/1213994095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cf4004810 msgr2=0x7f5cf4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:01.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.296+0000 7f5d15c00640 1 --2- 172.21.15.175:0/1213994095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cf4004810 0x7f5cf4004c90 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009ae0 tx=0x7f5cfc01ca10 comp rx=0 tx=0).stop 2024-04-25T09:08:01.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.296+0000 7f5d0f400640 1 -- 172.21.15.175:0/1213994095 reap_dead start 2024-04-25T09:08:01.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.296+0000 7f5d15c00640 1 -- 172.21.15.175:0/1213994095 shutdown_connections 2024-04-25T09:08:01.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.296+0000 7f5d15c00640 1 -- 172.21.15.175:0/1213994095 >> 172.21.15.175:0/1213994095 conn(0x7f5d1006ac50 msgr2=0x7f5d1006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:01.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.296+0000 7f5d15c00640 1 -- 172.21.15.175:0/1213994095 shutdown_connections 2024-04-25T09:08:01.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.296+0000 7f5d15c00640 1 -- 172.21.15.175:0/1213994095 wait complete. 2024-04-25T09:08:01.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.296+0000 7f5d15c00640 1 Processor -- start 2024-04-25T09:08:01.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d15c00640 1 -- start start 2024-04-25T09:08:01.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d15c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cf4004810 0x7f5d10137070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:01.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d15c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d10136c00 0x7f5d101fa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:01.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d15c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5d10161a10 0x7f5d1015ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:01.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d15c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1015c870 con 0x7f5d10136c00 2024-04-25T09:08:01.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d15c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d10145630 con 0x7f5d10161a10 2024-04-25T09:08:01.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d15c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1015c9f0 con 0x7f5cf4004810 2024-04-25T09:08:01.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d0e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d10136c00 0x7f5d101fa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:01.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d0ea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cf4004810 0x7f5d10137070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:01.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d0e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d10136c00 0x7f5d101fa870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37222/0 (socket says 172.21.15.175:37222) 2024-04-25T09:08:01.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d0e000640 1 -- 172.21.15.175:0/1635761581 learned_addr learned my addr 172.21.15.175:0/1635761581 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:01.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d0f400640 1 --2- 172.21.15.175:0/1635761581 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5d10161a10 0x7f5d1015ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:01.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d0e000640 1 -- 172.21.15.175:0/1635761581 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cf4004810 msgr2=0x7f5d10137070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:01.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d0e000640 1 --2- 172.21.15.175:0/1635761581 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cf4004810 0x7f5d10137070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d0e000640 1 -- 172.21.15.175:0/1635761581 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5d10161a10 msgr2=0x7f5d1015ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:01.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d0e000640 1 --2- 172.21.15.175:0/1635761581 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5d10161a10 0x7f5d1015ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d0e000640 1 -- 172.21.15.175:0/1635761581 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d100ae510 con 0x7f5d10136c00 2024-04-25T09:08:01.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d0e000640 1 --2- 172.21.15.175:0/1635761581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d10136c00 0x7f5d101fa870 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc01d2b0 tx=0x7f5cf4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:01.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d06a00640 1 -- 172.21.15.175:0/1635761581 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc0c1070 con 0x7f5d10136c00 2024-04-25T09:08:01.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d06a00640 1 -- 172.21.15.175:0/1635761581 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc0a9620 con 0x7f5d10136c00 2024-04-25T09:08:01.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d15c00640 1 -- 172.21.15.175:0/1635761581 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d100ae230 con 0x7f5d10136c00 2024-04-25T09:08:01.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d06a00640 1 -- 172.21.15.175:0/1635761581 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc0a9dc0 con 0x7f5d10136c00 2024-04-25T09:08:01.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d15c00640 1 -- 172.21.15.175:0/1635761581 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d101fa070 con 0x7f5d10136c00 2024-04-25T09:08:01.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.300+0000 7f5d15c00640 1 -- 172.21.15.175:0/1635761581 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d10075160 con 0x7f5d10136c00 2024-04-25T09:08:01.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.304+0000 7f5d06a00640 1 -- 172.21.15.175:0/1635761581 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5cfc0c4070 con 0x7f5d10136c00 2024-04-25T09:08:01.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.304+0000 7f5d06a00640 1 --2- 172.21.15.175:0/1635761581 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5cf0066f90 0x7f5cf0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:01.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.304+0000 7f5d06a00640 1 -- 172.21.15.175:0/1635761581 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5cfc11f0d0 con 0x7f5d10136c00 2024-04-25T09:08:01.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.304+0000 7f5d0ea00640 1 --2- 172.21.15.175:0/1635761581 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5cf0066f90 0x7f5cf0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:01.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.304+0000 7f5d0ea00640 1 --2- 172.21.15.175:0/1635761581 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5cf0066f90 0x7f5cf0069450 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5d00001560 tx=0x7f5d00007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:01.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.308+0000 7f5d06a00640 1 -- 172.21.15.175:0/1635761581 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5cfc0ad020 con 0x7f5d10136c00 2024-04-25T09:08:01.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.464+0000 7f5d15c00640 1 -- 172.21.15.175:0/1635761581 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d1006b2e0 con 0x7f5d10136c00 2024-04-25T09:08:01.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.464+0000 7f5d06a00640 1 -- 172.21.15.175:0/1635761581 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5cfc016780 con 0x7f5d10136c00 2024-04-25T09:08:01.454 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:08:01.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.464+0000 7f5d15c00640 1 -- 172.21.15.175:0/1635761581 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5cf0066f90 msgr2=0x7f5cf0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:01.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.464+0000 7f5d15c00640 1 --2- 172.21.15.175:0/1635761581 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5cf0066f90 0x7f5cf0069450 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5d00001560 tx=0x7f5d00007900 comp rx=0 tx=0).stop 2024-04-25T09:08:01.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.464+0000 7f5d15c00640 1 -- 172.21.15.175:0/1635761581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d10136c00 msgr2=0x7f5d101fa870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:01.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.464+0000 7f5d15c00640 1 --2- 172.21.15.175:0/1635761581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d10136c00 0x7f5d101fa870 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc01d2b0 tx=0x7f5cf4005840 comp rx=0 tx=0).stop 2024-04-25T09:08:01.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.464+0000 7f5d15c00640 1 -- 172.21.15.175:0/1635761581 shutdown_connections 2024-04-25T09:08:01.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.464+0000 7f5d15c00640 1 --2- 172.21.15.175:0/1635761581 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5cf0066f90 0x7f5cf0069450 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.464+0000 7f5d15c00640 1 --2- 172.21.15.175:0/1635761581 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5d10161a10 0x7f5d1015ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.464+0000 7f5d15c00640 1 --2- 172.21.15.175:0/1635761581 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d10136c00 0x7f5d101fa870 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.464+0000 7f5d15c00640 1 --2- 172.21.15.175:0/1635761581 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cf4004810 0x7f5d10137070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.464+0000 7f5d15c00640 1 -- 172.21.15.175:0/1635761581 >> 172.21.15.175:0/1635761581 conn(0x7f5d1006ac50 msgr2=0x7f5d100cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:01.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.464+0000 7f5d15c00640 1 -- 172.21.15.175:0/1635761581 shutdown_connections 2024-04-25T09:08:01.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.468+0000 7f5d15c00640 1 -- 172.21.15.175:0/1635761581 wait complete. 2024-04-25T09:08:01.475 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:08:01.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc085800640 1 Processor -- start 2024-04-25T09:08:01.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc085800640 1 -- start start 2024-04-25T09:08:01.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc085800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc08006b360 0x7fc080162340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:01.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc085800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0800cc3a0 con 0x7fc08015dd90 2024-04-25T09:08:01.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc085800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0800cc0c0 con 0x7fc08006b9a0 2024-04-25T09:08:01.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc085800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc080161eb0 con 0x7fc08006b360 2024-04-25T09:08:01.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07ea00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc08015dd90 0x7fc08006ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45308/0 (socket says 172.21.15.175:45308) 2024-04-25T09:08:01.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07ea00640 1 -- 172.21.15.175:0/3590533713 learned_addr learned my addr 172.21.15.175:0/3590533713 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:01.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07d600640 1 -- 172.21.15.175:0/3590533713 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005940187 0 0) 0x7fc0800cc3a0 con 0x7fc08015dd90 2024-04-25T09:08:01.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07d600640 1 -- 172.21.15.175:0/3590533713 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc064003530 con 0x7fc08015dd90 2024-04-25T09:08:01.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07e000640 1 --2- 172.21.15.175:0/3590533713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc08006b360 0x7fc080162340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:01.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07d600640 1 -- 172.21.15.175:0/3590533713 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3653030013 0 0) 0x7fc064003530 con 0x7fc08015dd90 2024-04-25T09:08:01.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07d600640 1 -- 172.21.15.175:0/3590533713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc08006b360 msgr2=0x7fc080162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:01.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07d600640 1 --2- 172.21.15.175:0/3590533713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc08006b360 0x7fc080162340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07d600640 1 -- 172.21.15.175:0/3590533713 >> v1:172.21.15.177:6789/0 conn(0x7fc08006b9a0 legacy=0x7fc08015e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:01.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07d600640 1 -- 172.21.15.175:0/3590533713 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc080161860 con 0x7fc08015dd90 2024-04-25T09:08:01.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07d600640 1 -- 172.21.15.175:0/3590533713 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fc070001a00 con 0x7fc08015dd90 2024-04-25T09:08:01.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07d600640 1 -- 172.21.15.175:0/3590533713 >> v1:172.21.15.175:6789/0 conn(0x7fc08015dd90 legacy=0x7fc08006ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:01.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07d600640 1 --2- 172.21.15.175:0/3590533713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0640039f0 0x7fc064003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:01.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07d600640 1 --2- 172.21.15.175:0/3590533713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc064004810 0x7fc064004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:01.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07d600640 1 --2- 172.21.15.175:0/3590533713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc08006b360 0x7fc064005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:01.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07d600640 1 -- 172.21.15.175:0/3590533713 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc080161eb0 con 0x7fc0640039f0 2024-04-25T09:08:01.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07d600640 1 -- 172.21.15.175:0/3590533713 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06400bb00 con 0x7fc064004810 2024-04-25T09:08:01.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07d600640 1 -- 172.21.15.175:0/3590533713 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06400bd00 con 0x7fc08006b360 2024-04-25T09:08:01.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07ea00640 1 --2- 172.21.15.175:0/3590533713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0640039f0 0x7fc064003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:01.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07e000640 1 --2- 172.21.15.175:0/3590533713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc064004810 0x7fc064004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:01.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07f400640 1 --2- 172.21.15.175:0/3590533713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc08006b360 0x7fc064005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:01.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07ea00640 1 -- 172.21.15.175:0/3590533713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc08006b360 msgr2=0x7fc064005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:01.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07ea00640 1 --2- 172.21.15.175:0/3590533713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc08006b360 0x7fc064005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07ea00640 1 -- 172.21.15.175:0/3590533713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc064004810 msgr2=0x7fc064004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:01.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07ea00640 1 --2- 172.21.15.175:0/3590533713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc064004810 0x7fc064004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07ea00640 1 -- 172.21.15.175:0/3590533713 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc064003530 con 0x7fc0640039f0 2024-04-25T09:08:01.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.624+0000 7fc07e000640 1 --2- 172.21.15.175:0/3590533713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc064004810 0x7fc064004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:08:01.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.628+0000 7fc07ea00640 1 --2- 172.21.15.175:0/3590533713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0640039f0 0x7fc064003e10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fc07000a850 tx=0x7fc07001d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08afa42863f1097 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:01.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.628+0000 7fc07d600640 1 -- 172.21.15.175:0/3590533713 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07000a4a0 con 0x7fc0640039f0 2024-04-25T09:08:01.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.628+0000 7fc07d600640 1 -- 172.21.15.175:0/3590533713 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0700ad650 con 0x7fc0640039f0 2024-04-25T09:08:01.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.628+0000 7fc07d600640 1 -- 172.21.15.175:0/3590533713 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0700ada40 con 0x7fc0640039f0 2024-04-25T09:08:01.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.628+0000 7fc085800640 1 -- 172.21.15.175:0/3590533713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0640039f0 msgr2=0x7fc064003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:01.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.628+0000 7fc085800640 1 --2- 172.21.15.175:0/3590533713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0640039f0 0x7fc064003e10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fc07000a850 tx=0x7fc07001d370 comp rx=0 tx=0).stop 2024-04-25T09:08:01.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.628+0000 7fc07f400640 1 -- 172.21.15.175:0/3590533713 reap_dead start 2024-04-25T09:08:01.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.628+0000 7fc085800640 1 -- 172.21.15.175:0/3590533713 shutdown_connections 2024-04-25T09:08:01.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.628+0000 7fc085800640 1 -- 172.21.15.175:0/3590533713 >> 172.21.15.175:0/3590533713 conn(0x7fc0800cc5f0 msgr2=0x7fc0800cca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:01.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.628+0000 7fc085800640 1 -- 172.21.15.175:0/3590533713 shutdown_connections 2024-04-25T09:08:01.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.628+0000 7fc085800640 1 -- 172.21.15.175:0/3590533713 wait complete. 2024-04-25T09:08:01.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc085800640 1 Processor -- start 2024-04-25T09:08:01.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc085800640 1 -- start start 2024-04-25T09:08:01.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc085800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0640039f0 0x7fc08015be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:01.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc085800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc08015a940 0x7fc080166b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:01.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc085800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc080167a50 0x7fc08014b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:01.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc085800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc080169d70 con 0x7fc08015a940 2024-04-25T09:08:01.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc085800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc080162730 con 0x7fc080167a50 2024-04-25T09:08:01.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc085800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc080169ef0 con 0x7fc0640039f0 2024-04-25T09:08:01.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc07e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc08015a940 0x7fc080166b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:01.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc07e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc08015a940 0x7fc080166b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37240/0 (socket says 172.21.15.175:37240) 2024-04-25T09:08:01.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc07e000640 1 -- 172.21.15.175:0/3810187278 learned_addr learned my addr 172.21.15.175:0/3810187278 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:01.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc07f400640 1 --2- 172.21.15.175:0/3810187278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc080167a50 0x7fc08014b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:01.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc07ea00640 1 --2- 172.21.15.175:0/3810187278 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0640039f0 0x7fc08015be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:01.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc07e000640 1 -- 172.21.15.175:0/3810187278 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0640039f0 msgr2=0x7fc08015be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:01.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc07e000640 1 --2- 172.21.15.175:0/3810187278 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0640039f0 0x7fc08015be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc07e000640 1 -- 172.21.15.175:0/3810187278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc080167a50 msgr2=0x7fc08014b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:01.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc07e000640 1 --2- 172.21.15.175:0/3810187278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc080167a50 0x7fc08014b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc07e000640 1 -- 172.21.15.175:0/3810187278 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc080159ab0 con 0x7fc08015a940 2024-04-25T09:08:01.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc07e000640 1 --2- 172.21.15.175:0/3810187278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc08015a940 0x7fc080166b40 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fc06c003920 tx=0x7fc06c003de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:01.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc076a00640 1 -- 172.21.15.175:0/3810187278 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c018070 con 0x7fc08015a940 2024-04-25T09:08:01.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc076a00640 1 -- 172.21.15.175:0/3810187278 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c010a40 con 0x7fc08015a940 2024-04-25T09:08:01.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc085800640 1 -- 172.21.15.175:0/3810187278 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08015add0 con 0x7fc08015a940 2024-04-25T09:08:01.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc076a00640 1 -- 172.21.15.175:0/3810187278 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c010e10 con 0x7fc08015a940 2024-04-25T09:08:01.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.632+0000 7fc085800640 1 -- 172.21.15.175:0/3810187278 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08015b390 con 0x7fc08015a940 2024-04-25T09:08:01.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.636+0000 7fc085800640 1 -- 172.21.15.175:0/3810187278 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc080075160 con 0x7fc08015a940 2024-04-25T09:08:01.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.636+0000 7fc076a00640 1 -- 172.21.15.175:0/3810187278 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc06c01b070 con 0x7fc08015a940 2024-04-25T09:08:01.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.636+0000 7fc076a00640 1 --2- 172.21.15.175:0/3810187278 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc060066f60 0x7fc060069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:01.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.636+0000 7fc076a00640 1 -- 172.21.15.175:0/3810187278 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc06c085520 con 0x7fc08015a940 2024-04-25T09:08:01.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.636+0000 7fc07ea00640 1 --2- 172.21.15.175:0/3810187278 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc060066f60 0x7fc060069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:01.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.636+0000 7fc07ea00640 1 --2- 172.21.15.175:0/3810187278 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc060066f60 0x7fc060069420 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc0700ad000 tx=0x7fc0700a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:01.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.640+0000 7fc076a00640 1 -- 172.21.15.175:0/3810187278 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc06c056530 con 0x7fc08015a940 2024-04-25T09:08:01.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.804+0000 7fc085800640 1 -- 172.21.15.175:0/3810187278 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc08006b780 con 0x7fc08015a940 2024-04-25T09:08:01.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.804+0000 7fc076a00640 1 -- 172.21.15.175:0/3810187278 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v58) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc06c055e30 con 0x7fc08015a940 2024-04-25T09:08:01.792 INFO:teuthology.orchestra.run.smithi175.stderr:listed 0 entries 2024-04-25T09:08:01.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.804+0000 7fc085800640 1 -- 172.21.15.175:0/3810187278 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc060066f60 msgr2=0x7fc060069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:01.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.804+0000 7fc085800640 1 --2- 172.21.15.175:0/3810187278 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc060066f60 0x7fc060069420 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc0700ad000 tx=0x7fc0700a7000 comp rx=0 tx=0).stop 2024-04-25T09:08:01.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.804+0000 7fc085800640 1 -- 172.21.15.175:0/3810187278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc08015a940 msgr2=0x7fc080166b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:01.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.804+0000 7fc085800640 1 --2- 172.21.15.175:0/3810187278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc08015a940 0x7fc080166b40 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fc06c003920 tx=0x7fc06c003de0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.804+0000 7fc085800640 1 -- 172.21.15.175:0/3810187278 shutdown_connections 2024-04-25T09:08:01.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.804+0000 7fc085800640 1 --2- 172.21.15.175:0/3810187278 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc060066f60 0x7fc060069420 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.804+0000 7fc085800640 1 --2- 172.21.15.175:0/3810187278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc080167a50 0x7fc08014b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.804+0000 7fc085800640 1 --2- 172.21.15.175:0/3810187278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc08015a940 0x7fc080166b40 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.804+0000 7fc085800640 1 --2- 172.21.15.175:0/3810187278 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0640039f0 0x7fc08015be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.804+0000 7fc085800640 1 -- 172.21.15.175:0/3810187278 >> 172.21.15.175:0/3810187278 conn(0x7fc0800cc5f0 msgr2=0x7fc0800acde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:01.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.804+0000 7fc085800640 1 -- 172.21.15.175:0/3810187278 shutdown_connections 2024-04-25T09:08:01.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:01.804+0000 7fc085800640 1 -- 172.21.15.175:0/3810187278 wait complete. 2024-04-25T09:08:01.813 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:08:01.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:01.814 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:08:01.860 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:08:01.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:01.860 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:08:01.916 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:08:01.916 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:08:01.925 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:08:01.925 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:08:01.925 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:08:01.971 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:08:01.972 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:08:01.972 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:08:01.980 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:08:01.980 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:08:02.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.160+0000 7f0a8c800640 1 Processor -- start 2024-04-25T09:08:02.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.160+0000 7f0a8c800640 1 -- start start 2024-04-25T09:08:02.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.160+0000 7f0a8c800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0a8415a900 0x7f0a8406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.160+0000 7f0a8c800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a840cd520 0x7f0a840ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.160+0000 7f0a8c800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0a840cf560 0x7f0a840cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.160+0000 7f0a8c800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a840cfef0 con 0x7f0a840cf560 2024-04-25T09:08:02.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.160+0000 7f0a8c800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a840cda00 con 0x7f0a8415a900 2024-04-25T09:08:02.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.160+0000 7f0a8c800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a840cdce0 con 0x7f0a840cd520 2024-04-25T09:08:02.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.160+0000 7f0a8a800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0a840cf560 0x7f0a840cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.160+0000 7f0a8a800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0a840cf560 0x7f0a840cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37252/0 (socket says 172.21.15.175:37252) 2024-04-25T09:08:02.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.160+0000 7f0a8a800640 1 -- 172.21.15.175:0/2218246844 learned_addr learned my addr 172.21.15.175:0/2218246844 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:02.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.160+0000 7f0a89e00640 1 --2- 172.21.15.175:0/2218246844 >> v2:172.21.15.177:3300/0 conn(0x7f0a8415a900 0x7f0a8406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.160+0000 7f0a89400640 1 --2- 172.21.15.175:0/2218246844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a840cd520 0x7f0a840ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.160+0000 7f0a8a800640 1 -- 172.21.15.175:0/2218246844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a840cd520 msgr2=0x7f0a840ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:02.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.160+0000 7f0a8a800640 1 --2- 172.21.15.175:0/2218246844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a840cd520 0x7f0a840ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.160+0000 7f0a8a800640 1 -- 172.21.15.175:0/2218246844 >> v2:172.21.15.177:3300/0 conn(0x7f0a8415a900 msgr2=0x7f0a8406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:02.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.160+0000 7f0a8a800640 1 --2- 172.21.15.175:0/2218246844 >> v2:172.21.15.177:3300/0 conn(0x7f0a8415a900 0x7f0a8406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.160+0000 7f0a8a800640 1 -- 172.21.15.175:0/2218246844 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a840cdfc0 con 0x7f0a840cf560 2024-04-25T09:08:02.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.164+0000 7f0a8a800640 1 --2- 172.21.15.175:0/2218246844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a840cf560 0x7f0a840cf9b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0a840b4c70 tx=0x7f0a8001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b2a990886ba4ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:02.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.164+0000 7f0a88a00640 1 -- 172.21.15.175:0/2218246844 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a800a5840 con 0x7f0a840cf560 2024-04-25T09:08:02.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.164+0000 7f0a88a00640 1 -- 172.21.15.175:0/2218246844 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a800a59e0 con 0x7f0a840cf560 2024-04-25T09:08:02.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.164+0000 7f0a88a00640 1 -- 172.21.15.175:0/2218246844 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a800a5db0 con 0x7f0a840cf560 2024-04-25T09:08:02.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.164+0000 7f0a8c800640 1 -- 172.21.15.175:0/2218246844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a840cf560 msgr2=0x7f0a840cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.164+0000 7f0a8c800640 1 --2- 172.21.15.175:0/2218246844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a840cf560 0x7f0a840cf9b0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0a840b4c70 tx=0x7f0a8001c9c0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.164+0000 7f0a8c800640 1 -- 172.21.15.175:0/2218246844 shutdown_connections 2024-04-25T09:08:02.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.164+0000 7f0a8c800640 1 --2- 172.21.15.175:0/2218246844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a840cf560 0x7f0a840cf9b0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.164+0000 7f0a8c800640 1 --2- 172.21.15.175:0/2218246844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a840cd520 0x7f0a840ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.164+0000 7f0a8c800640 1 --2- 172.21.15.175:0/2218246844 >> v2:172.21.15.177:3300/0 conn(0x7f0a8415a900 0x7f0a8406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.164+0000 7f0a8c800640 1 -- 172.21.15.175:0/2218246844 >> 172.21.15.175:0/2218246844 conn(0x7f0a84067150 msgr2=0x7f0a8406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:02.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.164+0000 7f0a8c800640 1 -- 172.21.15.175:0/2218246844 shutdown_connections 2024-04-25T09:08:02.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.164+0000 7f0a8c800640 1 -- 172.21.15.175:0/2218246844 wait complete. 2024-04-25T09:08:02.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a8c800640 1 Processor -- start 2024-04-25T09:08:02.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a8c800640 1 -- start start 2024-04-25T09:08:02.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a8c800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a840cf560 0x7f0a841563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a8c800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a8415a900 0x7f0a84145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a8c800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a84154ca0 0x7f0a840af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a8c800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8406d530 con 0x7f0a840cf560 2024-04-25T09:08:02.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a8c800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8406d3b0 con 0x7f0a84154ca0 2024-04-25T09:08:02.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a8c800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8415c790 con 0x7f0a8415a900 2024-04-25T09:08:02.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a89e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a840cf560 0x7f0a841563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a89e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a840cf560 0x7f0a841563a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37266/0 (socket says 172.21.15.175:37266) 2024-04-25T09:08:02.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a89e00640 1 -- 172.21.15.175:0/3677957426 learned_addr learned my addr 172.21.15.175:0/3677957426 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:02.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a8a800640 1 --2- 172.21.15.175:0/3677957426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a84154ca0 0x7f0a840af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a89400640 1 --2- 172.21.15.175:0/3677957426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a8415a900 0x7f0a84145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a89e00640 1 -- 172.21.15.175:0/3677957426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a8415a900 msgr2=0x7f0a84145be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a89e00640 1 --2- 172.21.15.175:0/3677957426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a8415a900 0x7f0a84145be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a89e00640 1 -- 172.21.15.175:0/3677957426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a84154ca0 msgr2=0x7f0a840af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a89e00640 1 --2- 172.21.15.175:0/3677957426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a84154ca0 0x7f0a840af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a89e00640 1 -- 172.21.15.175:0/3677957426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8414d640 con 0x7f0a840cf560 2024-04-25T09:08:02.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a89e00640 1 --2- 172.21.15.175:0/3677957426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a840cf560 0x7f0a841563a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800e870 tx=0x7f0a7800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:02.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a7e000640 1 -- 172.21.15.175:0/3677957426 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78017070 con 0x7f0a840cf560 2024-04-25T09:08:02.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a7e000640 1 -- 172.21.15.175:0/3677957426 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7800c940 con 0x7f0a840cf560 2024-04-25T09:08:02.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a8c800640 1 -- 172.21.15.175:0/3677957426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a84156980 con 0x7f0a840cf560 2024-04-25T09:08:02.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a7e000640 1 -- 172.21.15.175:0/3677957426 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7800ccf0 con 0x7f0a840cf560 2024-04-25T09:08:02.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.168+0000 7f0a8c800640 1 -- 172.21.15.175:0/3677957426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a84156f40 con 0x7f0a840cf560 2024-04-25T09:08:02.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.172+0000 7f0a8c800640 1 -- 172.21.15.175:0/3677957426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a84074a60 con 0x7f0a840cf560 2024-04-25T09:08:02.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.172+0000 7f0a7e000640 1 -- 172.21.15.175:0/3677957426 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0a7801a070 con 0x7f0a840cf560 2024-04-25T09:08:02.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.172+0000 7f0a7e000640 1 --2- 172.21.15.175:0/3677957426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0a68066f90 0x7f0a68069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.172+0000 7f0a7e000640 1 -- 172.21.15.175:0/3677957426 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a78084e20 con 0x7f0a840cf560 2024-04-25T09:08:02.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.172+0000 7f0a89400640 1 --2- 172.21.15.175:0/3677957426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0a68066f90 0x7f0a68069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.172+0000 7f0a89400640 1 --2- 172.21.15.175:0/3677957426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0a68066f90 0x7f0a68069450 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0a840b22f0 tx=0x7f0a74009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:02.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.176+0000 7f0a7e000640 1 -- 172.21.15.175:0/3677957426 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0a780557d0 con 0x7f0a840cf560 2024-04-25T09:08:02.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.360+0000 7f0a8c800640 1 -- 172.21.15.175:0/3677957426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a84150620 con 0x7f0a840cf560 2024-04-25T09:08:02.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.360+0000 7f0a7e000640 1 -- 172.21.15.175:0/3677957426 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f0a78059870 con 0x7f0a840cf560 2024-04-25T09:08:02.351 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:02.352 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2064272902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2064272902},{"type":"v1","addr":"172.21.15.177:6834","nonce":2064272902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5462,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3896280225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3896280225},{"type":"v1","addr":"172.21.15.177:6835","nonce":3896280225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/149812612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":149812612},{"type":"v1","addr":"172.21.15.175:6835","nonce":149812612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:43.704808+0000","modified":"2024-04-25T09:07:36.402066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.175:6837/1478147147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1478147147},{"type":"v1","addr":"172.21.15.175:6837","nonce":1478147147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:08:02.352 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 34 2024-04-25T09:08:02.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.364+0000 7f0a8c800640 1 -- 172.21.15.175:0/3677957426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0a68066f90 msgr2=0x7f0a68069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.364+0000 7f0a8c800640 1 --2- 172.21.15.175:0/3677957426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0a68066f90 0x7f0a68069450 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0a840b22f0 tx=0x7f0a74009190 comp rx=0 tx=0).stop 2024-04-25T09:08:02.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.364+0000 7f0a8c800640 1 -- 172.21.15.175:0/3677957426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a840cf560 msgr2=0x7f0a841563a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.364+0000 7f0a8c800640 1 --2- 172.21.15.175:0/3677957426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a840cf560 0x7f0a841563a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800e870 tx=0x7f0a7800ec70 comp rx=0 tx=0).stop 2024-04-25T09:08:02.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.364+0000 7f0a8c800640 1 -- 172.21.15.175:0/3677957426 shutdown_connections 2024-04-25T09:08:02.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.364+0000 7f0a8c800640 1 --2- 172.21.15.175:0/3677957426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0a68066f90 0x7f0a68069450 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.364+0000 7f0a8c800640 1 --2- 172.21.15.175:0/3677957426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a84154ca0 0x7f0a840af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.364+0000 7f0a8c800640 1 --2- 172.21.15.175:0/3677957426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a8415a900 0x7f0a84145be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.364+0000 7f0a8c800640 1 --2- 172.21.15.175:0/3677957426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a840cf560 0x7f0a841563a0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.364+0000 7f0a8c800640 1 -- 172.21.15.175:0/3677957426 >> 172.21.15.175:0/3677957426 conn(0x7f0a840cd520 msgr2=0x7f0a8406dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:02.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.364+0000 7f0a8c800640 1 -- 172.21.15.175:0/3677957426 shutdown_connections 2024-04-25T09:08:02.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.364+0000 7f0a8c800640 1 -- 172.21.15.175:0/3677957426 wait complete. 2024-04-25T09:08:02.373 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:08:02.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.520+0000 7fd44b200640 1 Processor -- start 2024-04-25T09:08:02.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.520+0000 7fd44b200640 1 -- start start 2024-04-25T09:08:02.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.520+0000 7fd44b200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44c15ee40 0x7fd44c0cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.520+0000 7fd44b200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd44c0c59b0 0x7fd44c0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.520+0000 7fd44b200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44c09ac40 con 0x7fd44c09a430 2024-04-25T09:08:02.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.520+0000 7fd44b200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44c15f220 con 0x7fd44c0c59b0 2024-04-25T09:08:02.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.520+0000 7fd44b200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0ccd30 con 0x7fd44c15ee40 2024-04-25T09:08:02.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.520+0000 7fd449400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd44c09a430 0x7fd44c0c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45320/0 (socket says 172.21.15.175:45320) 2024-04-25T09:08:02.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.520+0000 7fd449400640 1 -- 172.21.15.175:0/1532850079 learned_addr learned my addr 172.21.15.175:0/1532850079 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:02.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.520+0000 7fd44a800640 1 --2- 172.21.15.175:0/1532850079 >> v2:172.21.15.177:3300/0 conn(0x7fd44c0c59b0 0x7fd44c0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.520+0000 7fd449e00640 1 --2- 172.21.15.175:0/1532850079 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44c15ee40 0x7fd44c0cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.520+0000 7fd448a00640 1 -- 172.21.15.175:0/1532850079 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026402005 0 0) 0x7fd44c09ac40 con 0x7fd44c09a430 2024-04-25T09:08:02.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.520+0000 7fd448a00640 1 -- 172.21.15.175:0/1532850079 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd430003530 con 0x7fd44c09a430 2024-04-25T09:08:02.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.520+0000 7fd44a800640 1 -- 172.21.15.175:0/1532850079 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44c15ee40 msgr2=0x7fd44c0cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:02.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.520+0000 7fd44a800640 1 --2- 172.21.15.175:0/1532850079 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44c15ee40 0x7fd44c0cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.520+0000 7fd448a00640 1 -- 172.21.15.175:0/1532850079 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2012178292 0 0) 0x7fd430003530 con 0x7fd44c09a430 2024-04-25T09:08:02.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.520+0000 7fd44a800640 1 -- 172.21.15.175:0/1532850079 >> v1:172.21.15.175:6789/0 conn(0x7fd44c09a430 legacy=0x7fd44c0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.520+0000 7fd44a800640 1 -- 172.21.15.175:0/1532850079 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c0cc400 con 0x7fd44c0c59b0 2024-04-25T09:08:02.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.524+0000 7fd44a800640 1 --2- 172.21.15.175:0/1532850079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd44c0c59b0 0x7fd44c0cf7d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd444009d90 tx=0x7fd44401c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ce5726ae3e18be0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:02.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.524+0000 7fd448a00640 1 -- 172.21.15.175:0/1532850079 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd438001680 con 0x7fd44c0c59b0 2024-04-25T09:08:02.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.524+0000 7fd448a00640 1 -- 172.21.15.175:0/1532850079 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4440a6500 con 0x7fd44c0c59b0 2024-04-25T09:08:02.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.524+0000 7fd448a00640 1 -- 172.21.15.175:0/1532850079 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4440a68b0 con 0x7fd44c0c59b0 2024-04-25T09:08:02.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.524+0000 7fd44b200640 1 -- 172.21.15.175:0/1532850079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd44c0c59b0 msgr2=0x7fd44c0cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.524+0000 7fd44b200640 1 --2- 172.21.15.175:0/1532850079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd44c0c59b0 0x7fd44c0cf7d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd444009d90 tx=0x7fd44401c800 comp rx=0 tx=0).stop 2024-04-25T09:08:02.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.524+0000 7fd44b200640 1 -- 172.21.15.175:0/1532850079 shutdown_connections 2024-04-25T09:08:02.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.524+0000 7fd44b200640 1 --2- 172.21.15.175:0/1532850079 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd44c0c59b0 0x7fd44c0cf7d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.524+0000 7fd44b200640 1 --2- 172.21.15.175:0/1532850079 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44c15ee40 0x7fd44c0cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.524+0000 7fd44b200640 1 -- 172.21.15.175:0/1532850079 >> 172.21.15.175:0/1532850079 conn(0x7fd44c0b3240 msgr2=0x7fd44c0b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:02.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.524+0000 7fd44b200640 1 -- 172.21.15.175:0/1532850079 shutdown_connections 2024-04-25T09:08:02.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.524+0000 7fd44b200640 1 -- 172.21.15.175:0/1532850079 wait complete. 2024-04-25T09:08:02.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44b200640 1 Processor -- start 2024-04-25T09:08:02.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44b200640 1 -- start start 2024-04-25T09:08:02.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44b200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd44c09a430 0x7fd44c15c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44b200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44c0c59b0 0x7fd44c06cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd44c15ee40 0x7fd44c09d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44b200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0c5e40 con 0x7fd44c15ee40 2024-04-25T09:08:02.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44b200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c168780 con 0x7fd44c09a430 2024-04-25T09:08:02.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44b200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c06be00 con 0x7fd44c0c59b0 2024-04-25T09:08:02.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd44c15ee40 0x7fd44c09d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd44c15ee40 0x7fd44c09d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37276/0 (socket says 172.21.15.175:37276) 2024-04-25T09:08:02.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44a800640 1 -- 172.21.15.175:0/89014333 learned_addr learned my addr 172.21.15.175:0/89014333 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:02.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd449e00640 1 --2- 172.21.15.175:0/89014333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd44c09a430 0x7fd44c15c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd449400640 1 --2- 172.21.15.175:0/89014333 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44c0c59b0 0x7fd44c06cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44a800640 1 -- 172.21.15.175:0/89014333 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44c0c59b0 msgr2=0x7fd44c06cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44a800640 1 --2- 172.21.15.175:0/89014333 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44c0c59b0 0x7fd44c06cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44a800640 1 -- 172.21.15.175:0/89014333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd44c09a430 msgr2=0x7fd44c15c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44a800640 1 --2- 172.21.15.175:0/89014333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd44c09a430 0x7fd44c15c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44a800640 1 -- 172.21.15.175:0/89014333 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c06c0a0 con 0x7fd44c15ee40 2024-04-25T09:08:02.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44a800640 1 --2- 172.21.15.175:0/89014333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd44c15ee40 0x7fd44c09d910 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd4440b0040 tx=0x7fd4440195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:02.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd442000640 1 -- 172.21.15.175:0/89014333 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4440a68c0 con 0x7fd44c15ee40 2024-04-25T09:08:02.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd442000640 1 -- 172.21.15.175:0/89014333 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4440c0070 con 0x7fd44c15ee40 2024-04-25T09:08:02.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd442000640 1 -- 172.21.15.175:0/89014333 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4440a6c80 con 0x7fd44c15ee40 2024-04-25T09:08:02.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44b200640 1 -- 172.21.15.175:0/89014333 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44c06c380 con 0x7fd44c15ee40 2024-04-25T09:08:02.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.528+0000 7fd44b200640 1 -- 172.21.15.175:0/89014333 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c0c7120 con 0x7fd44c15ee40 2024-04-25T09:08:02.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.532+0000 7fd44b200640 1 -- 172.21.15.175:0/89014333 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44c074a60 con 0x7fd44c15ee40 2024-04-25T09:08:02.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.532+0000 7fd442000640 1 -- 172.21.15.175:0/89014333 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd4440b7040 con 0x7fd44c15ee40 2024-04-25T09:08:02.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.532+0000 7fd442000640 1 --2- 172.21.15.175:0/89014333 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd42c066f90 0x7fd42c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.532+0000 7fd442000640 1 -- 172.21.15.175:0/89014333 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd44411ff00 con 0x7fd44c15ee40 2024-04-25T09:08:02.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.532+0000 7fd449e00640 1 --2- 172.21.15.175:0/89014333 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd42c066f90 0x7fd42c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.532+0000 7fd449e00640 1 --2- 172.21.15.175:0/89014333 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd42c066f90 0x7fd42c069450 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd44c070e40 tx=0x7fd43c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:02.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.536+0000 7fd442000640 1 -- 172.21.15.175:0/89014333 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd444016480 con 0x7fd44c15ee40 2024-04-25T09:08:02.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.692+0000 7fd44b200640 1 -- 172.21.15.175:0/89014333 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd44c06dd50 con 0x7fd44c15ee40 2024-04-25T09:08:02.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.692+0000 7fd442000640 1 -- 172.21.15.175:0/89014333 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16701 (secure 0 0 0) 0x7fd4440ad3d0 con 0x7fd44c15ee40 2024-04-25T09:08:02.683 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:02.683 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":58,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:06:45.356791+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:41.465085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:42.715758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:08:02.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.696+0000 7fd44b200640 1 -- 172.21.15.175:0/89014333 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd42c066f90 msgr2=0x7fd42c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.696+0000 7fd44b200640 1 --2- 172.21.15.175:0/89014333 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd42c066f90 0x7fd42c069450 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd44c070e40 tx=0x7fd43c008040 comp rx=0 tx=0).stop 2024-04-25T09:08:02.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.696+0000 7fd44b200640 1 -- 172.21.15.175:0/89014333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd44c15ee40 msgr2=0x7fd44c09d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.696+0000 7fd44b200640 1 --2- 172.21.15.175:0/89014333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd44c15ee40 0x7fd44c09d910 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd4440b0040 tx=0x7fd4440195a0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.696+0000 7fd44b200640 1 -- 172.21.15.175:0/89014333 shutdown_connections 2024-04-25T09:08:02.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.696+0000 7fd44b200640 1 --2- 172.21.15.175:0/89014333 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd42c066f90 0x7fd42c069450 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.696+0000 7fd44b200640 1 --2- 172.21.15.175:0/89014333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd44c15ee40 0x7fd44c09d910 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.696+0000 7fd44b200640 1 --2- 172.21.15.175:0/89014333 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd44c0c59b0 0x7fd44c06cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.696+0000 7fd44b200640 1 --2- 172.21.15.175:0/89014333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd44c09a430 0x7fd44c15c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.696+0000 7fd44b200640 1 -- 172.21.15.175:0/89014333 >> 172.21.15.175:0/89014333 conn(0x7fd44c0b3240 msgr2=0x7fd44c0c8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:02.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.696+0000 7fd44b200640 1 -- 172.21.15.175:0/89014333 shutdown_connections 2024-04-25T09:08:02.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.696+0000 7fd44b200640 1 -- 172.21.15.175:0/89014333 wait complete. 2024-04-25T09:08:02.704 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:06:41.465085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:06:42.715758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:08:02.704 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:08:02.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.852+0000 7f98b9800640 1 Processor -- start 2024-04-25T09:08:02.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.852+0000 7f98b9800640 1 -- start start 2024-04-25T09:08:02.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.856+0000 7f98b9800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f98b415af20 0x7f98b40b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.856+0000 7f98b9800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98b40b4630 0x7f98b415c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.856+0000 7f98b9800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b406db60 con 0x7f98b40cbe60 2024-04-25T09:08:02.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.856+0000 7f98b9800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b406de40 con 0x7f98b415af20 2024-04-25T09:08:02.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.856+0000 7f98b9800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b406e120 con 0x7f98b40b4630 2024-04-25T09:08:02.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.856+0000 7f98aa000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f98b415af20 0x7f98b40b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.856+0000 7f98aa000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f98b415af20 0x7f98b40b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37280/0 (socket says 172.21.15.175:37280) 2024-04-25T09:08:02.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.856+0000 7f98aa000640 1 -- 172.21.15.175:0/2399609748 learned_addr learned my addr 172.21.15.175:0/2399609748 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:02.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.856+0000 7f98aa000640 1 -- 172.21.15.175:0/2399609748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98b40b4630 msgr2=0x7f98b415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:02.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.856+0000 7f98aa000640 1 --2- 172.21.15.175:0/2399609748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98b40b4630 0x7f98b415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.856+0000 7f98aa000640 1 -- 172.21.15.175:0/2399609748 >> v1:172.21.15.177:6789/0 conn(0x7f98b40cbe60 legacy=0x7f98b406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:02.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.856+0000 7f98aa000640 1 -- 172.21.15.175:0/2399609748 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b415c2f0 con 0x7f98b415af20 2024-04-25T09:08:02.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.860+0000 7f98aa000640 1 --2- 172.21.15.175:0/2399609748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98b415af20 0x7f98b40b40f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f989c009870 tx=0x7f989c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a6306682d42aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:02.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.860+0000 7f98b2000640 1 -- 172.21.15.175:0/2399609748 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c0b0070 con 0x7f98b415af20 2024-04-25T09:08:02.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.860+0000 7f98b2000640 1 -- 172.21.15.175:0/2399609748 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c0ab600 con 0x7f98b415af20 2024-04-25T09:08:02.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.860+0000 7f98b2000640 1 -- 172.21.15.175:0/2399609748 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c0ab9d0 con 0x7f98b415af20 2024-04-25T09:08:02.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.860+0000 7f98b9800640 1 -- 172.21.15.175:0/2399609748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98b415af20 msgr2=0x7f98b40b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.860+0000 7f98b9800640 1 --2- 172.21.15.175:0/2399609748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98b415af20 0x7f98b40b40f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f989c009870 tx=0x7f989c01c520 comp rx=0 tx=0).stop 2024-04-25T09:08:02.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.860+0000 7f98b9800640 1 -- 172.21.15.175:0/2399609748 shutdown_connections 2024-04-25T09:08:02.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.860+0000 7f98b9800640 1 --2- 172.21.15.175:0/2399609748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98b40b4630 0x7f98b415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.860+0000 7f98b9800640 1 --2- 172.21.15.175:0/2399609748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98b415af20 0x7f98b40b40f0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.860+0000 7f98b9800640 1 -- 172.21.15.175:0/2399609748 >> 172.21.15.175:0/2399609748 conn(0x7f98b406ac50 msgr2=0x7f98b406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:02.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.860+0000 7f98b9800640 1 -- 172.21.15.175:0/2399609748 shutdown_connections 2024-04-25T09:08:02.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.860+0000 7f98b9800640 1 -- 172.21.15.175:0/2399609748 wait complete. 2024-04-25T09:08:02.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.860+0000 7f98b9800640 1 Processor -- start 2024-04-25T09:08:02.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.860+0000 7f98b9800640 1 -- start start 2024-04-25T09:08:02.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98b9800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98b40b4630 0x7f98b4156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98b9800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98b40cbe60 0x7f98b40af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98b9800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98b415af20 0x7f98b4146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98b9800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b415d970 con 0x7f98b40cbe60 2024-04-25T09:08:02.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98b9800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b415d7f0 con 0x7f98b415af20 2024-04-25T09:08:02.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98b9800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b415daf0 con 0x7f98b40b4630 2024-04-25T09:08:02.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98aa000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98b40cbe60 0x7f98b40af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98aa000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98b40cbe60 0x7f98b40af8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37292/0 (socket says 172.21.15.175:37292) 2024-04-25T09:08:02.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98aa000640 1 -- 172.21.15.175:0/3201136267 learned_addr learned my addr 172.21.15.175:0/3201136267 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:02.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98b2a00640 1 --2- 172.21.15.175:0/3201136267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98b40b4630 0x7f98b4156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98b3400640 1 --2- 172.21.15.175:0/3201136267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98b415af20 0x7f98b4146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98aa000640 1 -- 172.21.15.175:0/3201136267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98b40b4630 msgr2=0x7f98b4156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98aa000640 1 --2- 172.21.15.175:0/3201136267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98b40b4630 0x7f98b4156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98aa000640 1 -- 172.21.15.175:0/3201136267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98b415af20 msgr2=0x7f98b4146dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98aa000640 1 --2- 172.21.15.175:0/3201136267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98b415af20 0x7f98b4146dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98aa000640 1 -- 172.21.15.175:0/3201136267 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b41558a0 con 0x7f98b40cbe60 2024-04-25T09:08:02.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98aa000640 1 --2- 172.21.15.175:0/3201136267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98b40cbe60 0x7f98b40af8a0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f989c0ae040 tx=0x7f989c01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:02.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98ab400640 1 -- 172.21.15.175:0/3201136267 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c0ba020 con 0x7f98b40cbe60 2024-04-25T09:08:02.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98ab400640 1 -- 172.21.15.175:0/3201136267 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c0aa720 con 0x7f98b40cbe60 2024-04-25T09:08:02.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98b9800640 1 -- 172.21.15.175:0/3201136267 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b4155b80 con 0x7f98b40cbe60 2024-04-25T09:08:02.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98ab400640 1 -- 172.21.15.175:0/3201136267 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c0b0040 con 0x7f98b40cbe60 2024-04-25T09:08:02.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98b9800640 1 -- 172.21.15.175:0/3201136267 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b4156140 con 0x7f98b40cbe60 2024-04-25T09:08:02.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98b9800640 1 -- 172.21.15.175:0/3201136267 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b4075160 con 0x7f98b40cbe60 2024-04-25T09:08:02.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.864+0000 7f98ab400640 1 -- 172.21.15.175:0/3201136267 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f989c0bd020 con 0x7f98b40cbe60 2024-04-25T09:08:02.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.868+0000 7f98ab400640 1 --2- 172.21.15.175:0/3201136267 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9890066f60 0x7f9890069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.868+0000 7f98ab400640 1 -- 172.21.15.175:0/3201136267 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f989c11f4a0 con 0x7f98b40cbe60 2024-04-25T09:08:02.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.868+0000 7f98b2a00640 1 --2- 172.21.15.175:0/3201136267 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9890066f60 0x7f9890069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.868+0000 7f98b2a00640 1 --2- 172.21.15.175:0/3201136267 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9890066f60 0x7f9890069420 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f98b40ae190 tx=0x7f98a400d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:02.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:02.872+0000 7f98ab400640 1 -- 172.21.15.175:0/3201136267 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f989c0c4030 con 0x7f98b40cbe60 2024-04-25T09:08:03.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.028+0000 7f98b9800640 1 -- 172.21.15.175:0/3201136267 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f98b406c2d0 con 0x7f98b40cbe60 2024-04-25T09:08:03.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.028+0000 7f98ab400640 1 -- 172.21.15.175:0/3201136267 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f989c016110 con 0x7f98b40cbe60 2024-04-25T09:08:03.018 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:08:03.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.028+0000 7f98b9800640 1 -- 172.21.15.175:0/3201136267 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9890066f60 msgr2=0x7f9890069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:03.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.028+0000 7f98b9800640 1 --2- 172.21.15.175:0/3201136267 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9890066f60 0x7f9890069420 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f98b40ae190 tx=0x7f98a400d040 comp rx=0 tx=0).stop 2024-04-25T09:08:03.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.028+0000 7f98b9800640 1 -- 172.21.15.175:0/3201136267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98b40cbe60 msgr2=0x7f98b40af8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:03.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.028+0000 7f98b9800640 1 --2- 172.21.15.175:0/3201136267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98b40cbe60 0x7f98b40af8a0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f989c0ae040 tx=0x7f989c01ad60 comp rx=0 tx=0).stop 2024-04-25T09:08:03.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.028+0000 7f98b9800640 1 -- 172.21.15.175:0/3201136267 shutdown_connections 2024-04-25T09:08:03.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.028+0000 7f98b9800640 1 --2- 172.21.15.175:0/3201136267 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9890066f60 0x7f9890069420 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.028+0000 7f98b9800640 1 --2- 172.21.15.175:0/3201136267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98b415af20 0x7f98b4146dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.028+0000 7f98b9800640 1 --2- 172.21.15.175:0/3201136267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98b40cbe60 0x7f98b40af8a0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.028+0000 7f98b9800640 1 --2- 172.21.15.175:0/3201136267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98b40b4630 0x7f98b4156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.028+0000 7f98b9800640 1 -- 172.21.15.175:0/3201136267 >> 172.21.15.175:0/3201136267 conn(0x7f98b406ac50 msgr2=0x7f98b406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:03.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.032+0000 7f98b9800640 1 -- 172.21.15.175:0/3201136267 shutdown_connections 2024-04-25T09:08:03.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.032+0000 7f98b9800640 1 -- 172.21.15.175:0/3201136267 wait complete. 2024-04-25T09:08:03.039 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:08:03.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.188+0000 7f8513800640 1 Processor -- start 2024-04-25T09:08:03.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.188+0000 7f8513800640 1 -- start start 2024-04-25T09:08:03.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.188+0000 7f8513800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f850c145250 0x7f850c0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.188+0000 7f8513800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f850c1600a0 0x7f850c0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.188+0000 7f8513800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f850c0ce970 0x7f850c0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.188+0000 7f8513800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850c15f650 con 0x7f850c1600a0 2024-04-25T09:08:03.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.188+0000 7f8513800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850c0cfd10 con 0x7f850c0ce970 2024-04-25T09:08:03.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.188+0000 7f8513800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850c0cfff0 con 0x7f850c145250 2024-04-25T09:08:03.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.188+0000 7f850be00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f850c1600a0 0x7f850c0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.188+0000 7f850be00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f850c1600a0 0x7f850c0cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37302/0 (socket says 172.21.15.175:37302) 2024-04-25T09:08:03.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.188+0000 7f850be00640 1 -- 172.21.15.175:0/4274120996 learned_addr learned my addr 172.21.15.175:0/4274120996 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:03.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.192+0000 7f8511800640 1 --2- 172.21.15.175:0/4274120996 >> v2:172.21.15.177:3300/0 conn(0x7f850c0ce970 0x7f850c0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.192+0000 7f8510e00640 1 --2- 172.21.15.175:0/4274120996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f850c145250 0x7f850c0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.192+0000 7f850be00640 1 -- 172.21.15.175:0/4274120996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f850c145250 msgr2=0x7f850c0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:03.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.192+0000 7f850be00640 1 --2- 172.21.15.175:0/4274120996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f850c145250 0x7f850c0cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.192+0000 7f850be00640 1 -- 172.21.15.175:0/4274120996 >> v2:172.21.15.177:3300/0 conn(0x7f850c0ce970 msgr2=0x7f850c0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:03.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.192+0000 7f850be00640 1 --2- 172.21.15.175:0/4274120996 >> v2:172.21.15.177:3300/0 conn(0x7f850c0ce970 0x7f850c0cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.192+0000 7f850be00640 1 -- 172.21.15.175:0/4274120996 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c15f8a0 con 0x7f850c1600a0 2024-04-25T09:08:03.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.192+0000 7f8510e00640 1 --2- 172.21.15.175:0/4274120996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f850c145250 0x7f850c0cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:03.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.192+0000 7f850be00640 1 --2- 172.21.15.175:0/4274120996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f850c1600a0 0x7f850c0cc410 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f850c071260 tx=0x7f84f801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4940d4d5d9a817f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:03.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.192+0000 7f850b400640 1 -- 172.21.15.175:0/4274120996 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f80aa430 con 0x7f850c1600a0 2024-04-25T09:08:03.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.192+0000 7f850b400640 1 -- 172.21.15.175:0/4274120996 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f80af070 con 0x7f850c1600a0 2024-04-25T09:08:03.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.192+0000 7f850b400640 1 -- 172.21.15.175:0/4274120996 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f80aa7f0 con 0x7f850c1600a0 2024-04-25T09:08:03.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.192+0000 7f8513800640 1 -- 172.21.15.175:0/4274120996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f850c1600a0 msgr2=0x7f850c0cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:03.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.192+0000 7f8513800640 1 --2- 172.21.15.175:0/4274120996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f850c1600a0 0x7f850c0cc410 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f850c071260 tx=0x7f84f801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.192+0000 7f8513800640 1 -- 172.21.15.175:0/4274120996 shutdown_connections 2024-04-25T09:08:03.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.192+0000 7f8513800640 1 --2- 172.21.15.175:0/4274120996 >> v2:172.21.15.177:3300/0 conn(0x7f850c0ce970 0x7f850c0cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f8513800640 1 --2- 172.21.15.175:0/4274120996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f850c1600a0 0x7f850c0cc410 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f8513800640 1 --2- 172.21.15.175:0/4274120996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f850c145250 0x7f850c0cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f8513800640 1 -- 172.21.15.175:0/4274120996 >> 172.21.15.175:0/4274120996 conn(0x7f850c06ac50 msgr2=0x7f850c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:03.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f8513800640 1 -- 172.21.15.175:0/4274120996 shutdown_connections 2024-04-25T09:08:03.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f8513800640 1 -- 172.21.15.175:0/4274120996 wait complete. 2024-04-25T09:08:03.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f8513800640 1 Processor -- start 2024-04-25T09:08:03.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f8513800640 1 -- start start 2024-04-25T09:08:03.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f8513800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f850c0ce970 0x7f850c161090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f8513800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f850c145250 0x7f850c15d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f8513800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850c1600a0 0x7f850c15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f8513800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c145630 con 0x7f850c145250 2024-04-25T09:08:03.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f8513800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850c160500 con 0x7f850c1600a0 2024-04-25T09:08:03.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f8513800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850c15c870 con 0x7f850c0ce970 2024-04-25T09:08:03.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f850be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f850c145250 0x7f850c15d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f850be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f850c145250 0x7f850c15d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37318/0 (socket says 172.21.15.175:37318) 2024-04-25T09:08:03.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f850be00640 1 -- 172.21.15.175:0/511731923 learned_addr learned my addr 172.21.15.175:0/511731923 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:03.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f8511800640 1 --2- 172.21.15.175:0/511731923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850c1600a0 0x7f850c15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f8510e00640 1 --2- 172.21.15.175:0/511731923 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f850c0ce970 0x7f850c161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f850be00640 1 -- 172.21.15.175:0/511731923 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f850c0ce970 msgr2=0x7f850c161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:03.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f850be00640 1 --2- 172.21.15.175:0/511731923 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f850c0ce970 0x7f850c161090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f850be00640 1 -- 172.21.15.175:0/511731923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850c1600a0 msgr2=0x7f850c15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:03.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f850be00640 1 --2- 172.21.15.175:0/511731923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850c1600a0 0x7f850c15b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f850be00640 1 -- 172.21.15.175:0/511731923 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c15de00 con 0x7f850c145250 2024-04-25T09:08:03.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f8511800640 1 --2- 172.21.15.175:0/511731923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850c1600a0 0x7f850c15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:03.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.196+0000 7f850be00640 1 --2- 172.21.15.175:0/511731923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f850c145250 0x7f850c15d8c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f84f80ac040 tx=0x7f84f8019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:03.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.200+0000 7f8508c00640 1 -- 172.21.15.175:0/511731923 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f80be610 con 0x7f850c145250 2024-04-25T09:08:03.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.200+0000 7f8508c00640 1 -- 172.21.15.175:0/511731923 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f80be7d0 con 0x7f850c145250 2024-04-25T09:08:03.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.200+0000 7f8513800640 1 -- 172.21.15.175:0/511731923 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850c161720 con 0x7f850c145250 2024-04-25T09:08:03.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.200+0000 7f8508c00640 1 -- 172.21.15.175:0/511731923 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f80bebc0 con 0x7f850c145250 2024-04-25T09:08:03.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.200+0000 7f8513800640 1 -- 172.21.15.175:0/511731923 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850c161ce0 con 0x7f850c145250 2024-04-25T09:08:03.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.200+0000 7f8513800640 1 -- 172.21.15.175:0/511731923 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850c075160 con 0x7f850c145250 2024-04-25T09:08:03.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.200+0000 7f8508c00640 1 -- 172.21.15.175:0/511731923 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f84f80bc020 con 0x7f850c145250 2024-04-25T09:08:03.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.200+0000 7f8508c00640 1 --2- 172.21.15.175:0/511731923 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f84ec066f90 0x7f84ec069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.200+0000 7f8508c00640 1 -- 172.21.15.175:0/511731923 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84f811fd90 con 0x7f850c145250 2024-04-25T09:08:03.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.200+0000 7f8510e00640 1 --2- 172.21.15.175:0/511731923 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f84ec066f90 0x7f84ec069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.200+0000 7f8510e00640 1 --2- 172.21.15.175:0/511731923 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f84ec066f90 0x7f84ec069450 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0075b0 tx=0x7f84fc007540 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:03.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.204+0000 7f8508c00640 1 -- 172.21.15.175:0/511731923 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f850c15de00 con 0x7f850c145250 2024-04-25T09:08:03.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.360+0000 7f8513800640 1 -- 172.21.15.175:0/511731923 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f850c0b1020 con 0x7f850c145250 2024-04-25T09:08:03.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.360+0000 7f8508c00640 1 -- 172.21.15.175:0/511731923 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v58) v1 ==== 104+0+11 (secure 0 0 0) 0x7f850c0b1020 con 0x7f850c145250 2024-04-25T09:08:03.350 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:08:03.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.364+0000 7f8513800640 1 -- 172.21.15.175:0/511731923 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f84ec066f90 msgr2=0x7f84ec069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:03.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.364+0000 7f8513800640 1 --2- 172.21.15.175:0/511731923 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f84ec066f90 0x7f84ec069450 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0075b0 tx=0x7f84fc007540 comp rx=0 tx=0).stop 2024-04-25T09:08:03.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.364+0000 7f8513800640 1 -- 172.21.15.175:0/511731923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f850c145250 msgr2=0x7f850c15d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:03.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.364+0000 7f8513800640 1 --2- 172.21.15.175:0/511731923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f850c145250 0x7f850c15d8c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f84f80ac040 tx=0x7f84f8019290 comp rx=0 tx=0).stop 2024-04-25T09:08:03.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.364+0000 7f8513800640 1 -- 172.21.15.175:0/511731923 shutdown_connections 2024-04-25T09:08:03.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.364+0000 7f8513800640 1 --2- 172.21.15.175:0/511731923 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f84ec066f90 0x7f84ec069450 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.364+0000 7f8513800640 1 --2- 172.21.15.175:0/511731923 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f850c1600a0 0x7f850c15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.364+0000 7f8513800640 1 --2- 172.21.15.175:0/511731923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f850c145250 0x7f850c15d8c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.364+0000 7f8513800640 1 --2- 172.21.15.175:0/511731923 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f850c0ce970 0x7f850c161090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.364+0000 7f8513800640 1 -- 172.21.15.175:0/511731923 >> 172.21.15.175:0/511731923 conn(0x7f850c06ac50 msgr2=0x7f850c06b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:03.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.364+0000 7f8513800640 1 -- 172.21.15.175:0/511731923 shutdown_connections 2024-04-25T09:08:03.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.364+0000 7f8513800640 1 -- 172.21.15.175:0/511731923 wait complete. 2024-04-25T09:08:03.372 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:08:03.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.520+0000 7f2d70600640 1 Processor -- start 2024-04-25T09:08:03.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.520+0000 7f2d70600640 1 -- start start 2024-04-25T09:08:03.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.524+0000 7f2d70600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d680cdb60 0x7f2d680cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.524+0000 7f2d70600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2d680ace00 0x7f2d6806eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.524+0000 7f2d70600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6806de20 con 0x7f2d6806ad50 2024-04-25T09:08:03.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.524+0000 7f2d70600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6815dfe0 con 0x7f2d680ace00 2024-04-25T09:08:03.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.524+0000 7f2d70600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d680ce480 con 0x7f2d680cdb60 2024-04-25T09:08:03.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.524+0000 7f2d6dc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d680cdb60 0x7f2d680cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.524+0000 7f2d6d200640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f2d6806ad50 0x7f2d6806bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:51316/0 (socket says 172.21.15.175:51316) 2024-04-25T09:08:03.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.524+0000 7f2d6d200640 1 -- 172.21.15.175:0/2988275553 learned_addr learned my addr 172.21.15.175:0/2988275553 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:03.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.524+0000 7f2d6e600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2d680ace00 0x7f2d6806eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.524+0000 7f2d6dc00640 1 -- 172.21.15.175:0/2988275553 >> v2:172.21.15.177:3300/0 conn(0x7f2d680ace00 msgr2=0x7f2d6806eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:03.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.524+0000 7f2d6dc00640 1 --2- 172.21.15.175:0/2988275553 >> v2:172.21.15.177:3300/0 conn(0x7f2d680ace00 0x7f2d6806eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.524+0000 7f2d6dc00640 1 -- 172.21.15.175:0/2988275553 >> v1:172.21.15.177:6789/0 conn(0x7f2d6806ad50 legacy=0x7f2d6806bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:03.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.524+0000 7f2d6dc00640 1 -- 172.21.15.175:0/2988275553 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6806e090 con 0x7f2d680cdb60 2024-04-25T09:08:03.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.524+0000 7f2d67e00640 1 -- 172.21.15.175:0/2988275553 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092737684 0 0) 0x7f2d6806de20 con 0x7f2d6806ad50 2024-04-25T09:08:03.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.524+0000 7f2d6e600640 1 --2- 172.21.15.175:0/2988275553 >> v2:172.21.15.177:3300/0 conn(0x7f2d680ace00 0x7f2d6806eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:08:03.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.528+0000 7f2d6dc00640 1 --2- 172.21.15.175:0/2988275553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d680cdb60 0x7f2d680cdf40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c0097c0 tx=0x7f2d5c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0a4c76c21b14fb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:03.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.528+0000 7f2d67e00640 1 -- 172.21.15.175:0/2988275553 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c0a7070 con 0x7f2d680cdb60 2024-04-25T09:08:03.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.528+0000 7f2d67e00640 1 -- 172.21.15.175:0/2988275553 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c0b0070 con 0x7f2d680cdb60 2024-04-25T09:08:03.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.528+0000 7f2d67e00640 1 -- 172.21.15.175:0/2988275553 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c0ab890 con 0x7f2d680cdb60 2024-04-25T09:08:03.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.528+0000 7f2d70600640 1 -- 172.21.15.175:0/2988275553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d680cdb60 msgr2=0x7f2d680cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:03.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.528+0000 7f2d70600640 1 --2- 172.21.15.175:0/2988275553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d680cdb60 0x7f2d680cdf40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c0097c0 tx=0x7f2d5c01c470 comp rx=0 tx=0).stop 2024-04-25T09:08:03.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.528+0000 7f2d70600640 1 -- 172.21.15.175:0/2988275553 shutdown_connections 2024-04-25T09:08:03.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.528+0000 7f2d70600640 1 --2- 172.21.15.175:0/2988275553 >> v2:172.21.15.177:3300/0 conn(0x7f2d680ace00 0x7f2d6806eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.528+0000 7f2d70600640 1 --2- 172.21.15.175:0/2988275553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d680cdb60 0x7f2d680cdf40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.528+0000 7f2d70600640 1 -- 172.21.15.175:0/2988275553 >> 172.21.15.175:0/2988275553 conn(0x7f2d680cca10 msgr2=0x7f2d680cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:03.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.528+0000 7f2d70600640 1 -- 172.21.15.175:0/2988275553 shutdown_connections 2024-04-25T09:08:03.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.528+0000 7f2d70600640 1 -- 172.21.15.175:0/2988275553 wait complete. 2024-04-25T09:08:03.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.528+0000 7f2d70600640 1 Processor -- start 2024-04-25T09:08:03.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.528+0000 7f2d70600640 1 -- start start 2024-04-25T09:08:03.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d70600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d6806ad50 0x7f2d68156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d70600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d680ace00 0x7f2d681543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d70600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d680cdb60 0x7f2d680c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d70600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d680aedc0 con 0x7f2d680ace00 2024-04-25T09:08:03.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d70600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6806c550 con 0x7f2d680cdb60 2024-04-25T09:08:03.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d70600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d680aef40 con 0x7f2d6806ad50 2024-04-25T09:08:03.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d6d200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d680ace00 0x7f2d681543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d6d200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d680ace00 0x7f2d681543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37324/0 (socket says 172.21.15.175:37324) 2024-04-25T09:08:03.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d6d200640 1 -- 172.21.15.175:0/3646483632 learned_addr learned my addr 172.21.15.175:0/3646483632 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:03.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d6dc00640 1 --2- 172.21.15.175:0/3646483632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d6806ad50 0x7f2d68156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d6e600640 1 --2- 172.21.15.175:0/3646483632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d680cdb60 0x7f2d680c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d6d200640 1 -- 172.21.15.175:0/3646483632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d6806ad50 msgr2=0x7f2d68156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:03.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d6d200640 1 --2- 172.21.15.175:0/3646483632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d6806ad50 0x7f2d68156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d6d200640 1 -- 172.21.15.175:0/3646483632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d680cdb60 msgr2=0x7f2d680c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:03.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d6d200640 1 --2- 172.21.15.175:0/3646483632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d680cdb60 0x7f2d680c5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d6d200640 1 -- 172.21.15.175:0/3646483632 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d681559f0 con 0x7f2d680ace00 2024-04-25T09:08:03.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d6d200640 1 --2- 172.21.15.175:0/3646483632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d680ace00 0x7f2d681543d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2d540011f0 tx=0x7f2d5400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:03.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d65600640 1 -- 172.21.15.175:0/3646483632 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d540074e0 con 0x7f2d680ace00 2024-04-25T09:08:03.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d65600640 1 -- 172.21.15.175:0/3646483632 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d540047f0 con 0x7f2d680ace00 2024-04-25T09:08:03.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d65600640 1 -- 172.21.15.175:0/3646483632 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54007680 con 0x7f2d680ace00 2024-04-25T09:08:03.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d70600640 1 -- 172.21.15.175:0/3646483632 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d68155cd0 con 0x7f2d680ace00 2024-04-25T09:08:03.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d70600640 1 -- 172.21.15.175:0/3646483632 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d68154910 con 0x7f2d680ace00 2024-04-25T09:08:03.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.532+0000 7f2d70600640 1 -- 172.21.15.175:0/3646483632 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d68075160 con 0x7f2d680ace00 2024-04-25T09:08:03.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.536+0000 7f2d65600640 1 -- 172.21.15.175:0/3646483632 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2d54011070 con 0x7f2d680ace00 2024-04-25T09:08:03.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.536+0000 7f2d65600640 1 --2- 172.21.15.175:0/3646483632 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2d48066f60 0x7f2d48069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.536+0000 7f2d65600640 1 -- 172.21.15.175:0/3646483632 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d54084c40 con 0x7f2d680ace00 2024-04-25T09:08:03.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.536+0000 7f2d6dc00640 1 --2- 172.21.15.175:0/3646483632 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2d48066f60 0x7f2d48069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.536+0000 7f2d6dc00640 1 --2- 172.21.15.175:0/3646483632 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2d48066f60 0x7f2d48069420 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c0af000 tx=0x7f2d5c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:03.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.540+0000 7f2d65600640 1 -- 172.21.15.175:0/3646483632 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2d54055bb0 con 0x7f2d680ace00 2024-04-25T09:08:03.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.696+0000 7f2d70600640 1 -- 172.21.15.175:0/3646483632 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2d68066bc0 con 0x7f2d680ace00 2024-04-25T09:08:03.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.696+0000 7f2d65600640 1 -- 172.21.15.175:0/3646483632 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v58) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2d540554b0 con 0x7f2d680ace00 2024-04-25T09:08:03.687 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:08:03.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.700+0000 7f2d70600640 1 -- 172.21.15.175:0/3646483632 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2d48066f60 msgr2=0x7f2d48069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:03.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.700+0000 7f2d70600640 1 --2- 172.21.15.175:0/3646483632 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2d48066f60 0x7f2d48069420 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c0af000 tx=0x7f2d5c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:08:03.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.700+0000 7f2d70600640 1 -- 172.21.15.175:0/3646483632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d680ace00 msgr2=0x7f2d681543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:03.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.700+0000 7f2d70600640 1 --2- 172.21.15.175:0/3646483632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d680ace00 0x7f2d681543d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2d540011f0 tx=0x7f2d5400c8f0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.700+0000 7f2d70600640 1 -- 172.21.15.175:0/3646483632 shutdown_connections 2024-04-25T09:08:03.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.700+0000 7f2d70600640 1 --2- 172.21.15.175:0/3646483632 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2d48066f60 0x7f2d48069420 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.700+0000 7f2d70600640 1 --2- 172.21.15.175:0/3646483632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2d680cdb60 0x7f2d680c5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.700+0000 7f2d70600640 1 --2- 172.21.15.175:0/3646483632 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d680ace00 0x7f2d681543d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.700+0000 7f2d70600640 1 --2- 172.21.15.175:0/3646483632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2d6806ad50 0x7f2d68156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.700+0000 7f2d70600640 1 -- 172.21.15.175:0/3646483632 >> 172.21.15.175:0/3646483632 conn(0x7f2d680cca10 msgr2=0x7f2d6815d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:03.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.700+0000 7f2d70600640 1 -- 172.21.15.175:0/3646483632 shutdown_connections 2024-04-25T09:08:03.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.700+0000 7f2d70600640 1 -- 172.21.15.175:0/3646483632 wait complete. 2024-04-25T09:08:03.707 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:08:03.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54b1c00640 1 Processor -- start 2024-04-25T09:08:03.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54b1c00640 1 -- start start 2024-04-25T09:08:03.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54b1c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac15a900 0x7f54ac06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54b1c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ac0cda00 con 0x7f54ac0cd520 2024-04-25T09:08:03.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54b1c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ac0cdce0 con 0x7f54ac0cf560 2024-04-25T09:08:03.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54b1c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac15bcf0 con 0x7f54ac15a900 2024-04-25T09:08:03.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54aa000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f54ac0cd520 0x7f54ac0ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45334/0 (socket says 172.21.15.175:45334) 2024-04-25T09:08:03.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54aa000640 1 -- 172.21.15.175:0/945462827 learned_addr learned my addr 172.21.15.175:0/945462827 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:03.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54aaa00640 1 --2- 172.21.15.175:0/945462827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac15a900 0x7f54ac06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54a9600640 1 -- 172.21.15.175:0/945462827 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499808075 0 0) 0x7f54ac0cda00 con 0x7f54ac0cd520 2024-04-25T09:08:03.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54a9600640 1 -- 172.21.15.175:0/945462827 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5490003530 con 0x7f54ac0cd520 2024-04-25T09:08:03.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54a9600640 1 -- 172.21.15.175:0/945462827 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1111279284 0 0) 0x7f5490003530 con 0x7f54ac0cd520 2024-04-25T09:08:03.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54a9600640 1 -- 172.21.15.175:0/945462827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac15a900 msgr2=0x7f54ac06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:03.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54a9600640 1 --2- 172.21.15.175:0/945462827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac15a900 0x7f54ac06e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54a9600640 1 -- 172.21.15.175:0/945462827 >> v1:172.21.15.177:6789/0 conn(0x7f54ac0cf560 legacy=0x7f54ac15bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:03.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54a9600640 1 -- 172.21.15.175:0/945462827 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac0cdfc0 con 0x7f54ac0cd520 2024-04-25T09:08:03.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54a9600640 1 -- 172.21.15.175:0/945462827 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f5498001680 con 0x7f54ac0cd520 2024-04-25T09:08:03.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54a9600640 1 -- 172.21.15.175:0/945462827 >> v1:172.21.15.175:6789/0 conn(0x7f54ac0cd520 legacy=0x7f54ac0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:03.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54a9600640 1 --2- 172.21.15.175:0/945462827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac15a900 0x7f54900039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54a9600640 1 --2- 172.21.15.175:0/945462827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5490003f70 0x7f5490004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54a9600640 1 --2- 172.21.15.175:0/945462827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5490004d50 0x7f54900051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54a9600640 1 -- 172.21.15.175:0/945462827 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549000ba80 con 0x7f5490004d50 2024-04-25T09:08:03.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54a9600640 1 -- 172.21.15.175:0/945462827 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549000bc30 con 0x7f5490003f70 2024-04-25T09:08:03.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54a9600640 1 -- 172.21.15.175:0/945462827 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549000e040 con 0x7f54ac15a900 2024-04-25T09:08:03.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54ab400640 1 --2- 172.21.15.175:0/945462827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5490004d50 0x7f54900051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54aa000640 1 --2- 172.21.15.175:0/945462827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5490003f70 0x7f5490004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54aaa00640 1 --2- 172.21.15.175:0/945462827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac15a900 0x7f54900039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54ab400640 1 -- 172.21.15.175:0/945462827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac15a900 msgr2=0x7f54900039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:03.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54ab400640 1 --2- 172.21.15.175:0/945462827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac15a900 0x7f54900039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54ab400640 1 -- 172.21.15.175:0/945462827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5490003f70 msgr2=0x7f5490004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:03.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54ab400640 1 --2- 172.21.15.175:0/945462827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5490003f70 0x7f5490004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54ab400640 1 -- 172.21.15.175:0/945462827 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5490003530 con 0x7f5490004d50 2024-04-25T09:08:03.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.856+0000 7f54aa000640 1 --2- 172.21.15.175:0/945462827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5490003f70 0x7f5490004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:03.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.860+0000 7f54ab400640 1 --2- 172.21.15.175:0/945462827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5490004d50 0x7f54900051d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f54a4001e70 tx=0x7f54a401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e24854466c1fa77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:03.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.860+0000 7f54a9600640 1 -- 172.21.15.175:0/945462827 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4001a90 con 0x7f5490004d50 2024-04-25T09:08:03.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.860+0000 7f54a9600640 1 -- 172.21.15.175:0/945462827 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a4003b80 con 0x7f5490004d50 2024-04-25T09:08:03.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.860+0000 7f54a9600640 1 -- 172.21.15.175:0/945462827 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4005080 con 0x7f5490004d50 2024-04-25T09:08:03.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.860+0000 7f54b1c00640 1 -- 172.21.15.175:0/945462827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5490004d50 msgr2=0x7f54900051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:03.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.860+0000 7f54b1c00640 1 --2- 172.21.15.175:0/945462827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5490004d50 0x7f54900051d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f54a4001e70 tx=0x7f54a401c780 comp rx=0 tx=0).stop 2024-04-25T09:08:03.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.860+0000 7f54ab400640 1 -- 172.21.15.175:0/945462827 reap_dead start 2024-04-25T09:08:03.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.860+0000 7f54b1c00640 1 -- 172.21.15.175:0/945462827 shutdown_connections 2024-04-25T09:08:03.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.860+0000 7f54b1c00640 1 -- 172.21.15.175:0/945462827 >> 172.21.15.175:0/945462827 conn(0x7f54ac067150 msgr2=0x7f54ac06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:03.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.860+0000 7f54b1c00640 1 -- 172.21.15.175:0/945462827 shutdown_connections 2024-04-25T09:08:03.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.860+0000 7f54b1c00640 1 -- 172.21.15.175:0/945462827 wait complete. 2024-04-25T09:08:03.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54b1c00640 1 Processor -- start 2024-04-25T09:08:03.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54b1c00640 1 -- start start 2024-04-25T09:08:03.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54b1c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac1ed810 0x7f54ac0ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54b1c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54ac0b1470 0x7f54ac151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54b1c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac152200 0x7f54ac14f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54b1c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac06d3b0 con 0x7f54ac152200 2024-04-25T09:08:03.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54b1c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac0ce580 con 0x7f54ac0b1470 2024-04-25T09:08:03.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54b1c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac06d530 con 0x7f54ac1ed810 2024-04-25T09:08:03.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54ab400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac152200 0x7f54ac14f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54ab400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac152200 0x7f54ac14f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37328/0 (socket says 172.21.15.175:37328) 2024-04-25T09:08:03.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54ab400640 1 -- 172.21.15.175:0/993659464 learned_addr learned my addr 172.21.15.175:0/993659464 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:03.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54aa000640 1 --2- 172.21.15.175:0/993659464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54ac0b1470 0x7f54ac151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54aaa00640 1 --2- 172.21.15.175:0/993659464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac1ed810 0x7f54ac0ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54ab400640 1 -- 172.21.15.175:0/993659464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac1ed810 msgr2=0x7f54ac0ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:03.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54ab400640 1 --2- 172.21.15.175:0/993659464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac1ed810 0x7f54ac0ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54ab400640 1 -- 172.21.15.175:0/993659464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54ac0b1470 msgr2=0x7f54ac151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:03.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54ab400640 1 --2- 172.21.15.175:0/993659464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54ac0b1470 0x7f54ac151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:03.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54ab400640 1 -- 172.21.15.175:0/993659464 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac0ad9d0 con 0x7f54ac152200 2024-04-25T09:08:03.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54ab400640 1 --2- 172.21.15.175:0/993659464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac152200 0x7f54ac14f490 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f54a4098190 tx=0x7f5490005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:03.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54a2a00640 1 -- 172.21.15.175:0/993659464 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a40b9070 con 0x7f54ac152200 2024-04-25T09:08:03.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54a2a00640 1 -- 172.21.15.175:0/993659464 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a4005820 con 0x7f54ac152200 2024-04-25T09:08:03.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54a2a00640 1 -- 172.21.15.175:0/993659464 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4007dc0 con 0x7f54ac152200 2024-04-25T09:08:03.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54b1c00640 1 -- 172.21.15.175:0/993659464 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ac0adcb0 con 0x7f54ac152200 2024-04-25T09:08:03.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.864+0000 7f54b1c00640 1 -- 172.21.15.175:0/993659464 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ac1f4a50 con 0x7f54ac152200 2024-04-25T09:08:03.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.868+0000 7f54b1c00640 1 -- 172.21.15.175:0/993659464 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ac074a60 con 0x7f54ac152200 2024-04-25T09:08:03.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.868+0000 7f54a2a00640 1 -- 172.21.15.175:0/993659464 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f54a40bc070 con 0x7f54ac152200 2024-04-25T09:08:03.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.868+0000 7f54a2a00640 1 --2- 172.21.15.175:0/993659464 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f548c066f60 0x7f548c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:03.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.868+0000 7f54a2a00640 1 -- 172.21.15.175:0/993659464 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54a411e9e0 con 0x7f54ac152200 2024-04-25T09:08:03.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.868+0000 7f54aaa00640 1 --2- 172.21.15.175:0/993659464 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f548c066f60 0x7f548c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:03.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.868+0000 7f54aaa00640 1 --2- 172.21.15.175:0/993659464 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f548c066f60 0x7f548c069420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f549c009be0 tx=0x7f549c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:03.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:03.872+0000 7f54a2a00640 1 -- 172.21.15.175:0/993659464 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f54a40ac020 con 0x7f54ac152200 2024-04-25T09:08:04.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.060+0000 7f54b1c00640 1 -- 172.21.15.175:0/993659464 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54ac0d0230 con 0x7f54ac152200 2024-04-25T09:08:04.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.060+0000 7f54a2a00640 1 -- 172.21.15.175:0/993659464 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f54a4016490 con 0x7f54ac152200 2024-04-25T09:08:04.051 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:04.051 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2064272902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2064272902},{"type":"v1","addr":"172.21.15.177:6834","nonce":2064272902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5462,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3896280225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3896280225},{"type":"v1","addr":"172.21.15.177:6835","nonce":3896280225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/149812612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":149812612},{"type":"v1","addr":"172.21.15.175:6835","nonce":149812612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:43.704808+0000","modified":"2024-04-25T09:07:36.402066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.175:6837/1478147147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1478147147},{"type":"v1","addr":"172.21.15.175:6837","nonce":1478147147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:08:04.053 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 34 2024-04-25T09:08:04.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.060+0000 7f54b1c00640 1 -- 172.21.15.175:0/993659464 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f548c066f60 msgr2=0x7f548c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.060+0000 7f54b1c00640 1 --2- 172.21.15.175:0/993659464 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f548c066f60 0x7f548c069420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f549c009be0 tx=0x7f549c009190 comp rx=0 tx=0).stop 2024-04-25T09:08:04.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.060+0000 7f54b1c00640 1 -- 172.21.15.175:0/993659464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac152200 msgr2=0x7f54ac14f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.060+0000 7f54b1c00640 1 --2- 172.21.15.175:0/993659464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac152200 0x7f54ac14f490 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f54a4098190 tx=0x7f5490005840 comp rx=0 tx=0).stop 2024-04-25T09:08:04.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.060+0000 7f54b1c00640 1 -- 172.21.15.175:0/993659464 shutdown_connections 2024-04-25T09:08:04.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.060+0000 7f54b1c00640 1 --2- 172.21.15.175:0/993659464 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f548c066f60 0x7f548c069420 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.060+0000 7f54b1c00640 1 --2- 172.21.15.175:0/993659464 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54ac152200 0x7f54ac14f490 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.060+0000 7f54b1c00640 1 --2- 172.21.15.175:0/993659464 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54ac0b1470 0x7f54ac151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.060+0000 7f54b1c00640 1 --2- 172.21.15.175:0/993659464 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54ac1ed810 0x7f54ac0ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.060+0000 7f54b1c00640 1 -- 172.21.15.175:0/993659464 >> 172.21.15.175:0/993659464 conn(0x7f5490004d50 msgr2=0x7f54ac06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:04.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.060+0000 7f54b1c00640 1 -- 172.21.15.175:0/993659464 shutdown_connections 2024-04-25T09:08:04.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.060+0000 7f54b1c00640 1 -- 172.21.15.175:0/993659464 wait complete. 2024-04-25T09:08:04.071 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:08:04.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.216+0000 7fd974000640 1 Processor -- start 2024-04-25T09:08:04.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.216+0000 7fd974000640 1 -- start start 2024-04-25T09:08:04.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.216+0000 7fd974000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd96c15a900 0x7fd96c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.216+0000 7fd974000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd96c0cd520 0x7fd96c0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.220+0000 7fd974000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd96c0cda00 con 0x7fd96c0cf560 2024-04-25T09:08:04.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.220+0000 7fd974000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96c15bcf0 con 0x7fd96c0cd520 2024-04-25T09:08:04.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.220+0000 7fd974000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c0cdce0 con 0x7fd96c15a900 2024-04-25T09:08:04.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.220+0000 7fd970c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd96c0cd520 0x7fd96c0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.220+0000 7fd970c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd96c0cd520 0x7fd96c0ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37338/0 (socket says 172.21.15.175:37338) 2024-04-25T09:08:04.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.220+0000 7fd970c00640 1 -- 172.21.15.175:0/200076295 learned_addr learned my addr 172.21.15.175:0/200076295 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:04.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.220+0000 7fd971600640 1 --2- 172.21.15.175:0/200076295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd96c15a900 0x7fd96c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.220+0000 7fd970c00640 1 -- 172.21.15.175:0/200076295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd96c15a900 msgr2=0x7fd96c06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:04.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.220+0000 7fd970c00640 1 --2- 172.21.15.175:0/200076295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd96c15a900 0x7fd96c06e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.220+0000 7fd970c00640 1 -- 172.21.15.175:0/200076295 >> v1:172.21.15.177:6789/0 conn(0x7fd96c0cf560 legacy=0x7fd96c15bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:04.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.220+0000 7fd970c00640 1 -- 172.21.15.175:0/200076295 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c0cdfc0 con 0x7fd96c0cd520 2024-04-25T09:08:04.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.220+0000 7fd970c00640 1 --2- 172.21.15.175:0/200076295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd96c0cd520 0x7fd96c0ceaa0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd958009870 tx=0x7fd95801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4acb7acfbeab01cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:04.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.220+0000 7fd96be00640 1 -- 172.21.15.175:0/200076295 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9580ab640 con 0x7fd96c0cd520 2024-04-25T09:08:04.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.220+0000 7fd96be00640 1 -- 172.21.15.175:0/200076295 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9580b0070 con 0x7fd96c0cd520 2024-04-25T09:08:04.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.220+0000 7fd96be00640 1 -- 172.21.15.175:0/200076295 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9580aba00 con 0x7fd96c0cd520 2024-04-25T09:08:04.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd974000640 1 -- 172.21.15.175:0/200076295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd96c0cd520 msgr2=0x7fd96c0ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd974000640 1 --2- 172.21.15.175:0/200076295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd96c0cd520 0x7fd96c0ceaa0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd958009870 tx=0x7fd95801c530 comp rx=0 tx=0).stop 2024-04-25T09:08:04.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd974000640 1 -- 172.21.15.175:0/200076295 shutdown_connections 2024-04-25T09:08:04.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd974000640 1 --2- 172.21.15.175:0/200076295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd96c0cd520 0x7fd96c0ceaa0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd974000640 1 --2- 172.21.15.175:0/200076295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd96c15a900 0x7fd96c06e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd974000640 1 -- 172.21.15.175:0/200076295 >> 172.21.15.175:0/200076295 conn(0x7fd96c067150 msgr2=0x7fd96c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:04.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd974000640 1 -- 172.21.15.175:0/200076295 shutdown_connections 2024-04-25T09:08:04.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd974000640 1 -- 172.21.15.175:0/200076295 wait complete. 2024-04-25T09:08:04.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd974000640 1 Processor -- start 2024-04-25T09:08:04.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd974000640 1 -- start start 2024-04-25T09:08:04.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd974000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd96c0cf560 0x7fd96c157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd974000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd96c15a900 0x7fd96c0b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd974000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd96c0b3900 0x7fd96c152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd974000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c0cf160 con 0x7fd96c0cf560 2024-04-25T09:08:04.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd974000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c0cefe0 con 0x7fd96c15a900 2024-04-25T09:08:04.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd974000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c06d3b0 con 0x7fd96c0b3900 2024-04-25T09:08:04.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd971600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd96c0cf560 0x7fd96c157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd971600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd96c0cf560 0x7fd96c157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37342/0 (socket says 172.21.15.175:37342) 2024-04-25T09:08:04.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd971600640 1 -- 172.21.15.175:0/1698681684 learned_addr learned my addr 172.21.15.175:0/1698681684 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:04.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd972000640 1 --2- 172.21.15.175:0/1698681684 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd96c0b3900 0x7fd96c152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd970c00640 1 --2- 172.21.15.175:0/1698681684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd96c15a900 0x7fd96c0b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd971600640 1 -- 172.21.15.175:0/1698681684 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd96c0b3900 msgr2=0x7fd96c152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd971600640 1 --2- 172.21.15.175:0/1698681684 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd96c0b3900 0x7fd96c152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd971600640 1 -- 172.21.15.175:0/1698681684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd96c15a900 msgr2=0x7fd96c0b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd971600640 1 --2- 172.21.15.175:0/1698681684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd96c15a900 0x7fd96c0b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.224+0000 7fd971600640 1 -- 172.21.15.175:0/1698681684 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c1518c0 con 0x7fd96c0cf560 2024-04-25T09:08:04.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.228+0000 7fd970c00640 1 --2- 172.21.15.175:0/1698681684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd96c15a900 0x7fd96c0b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:04.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.228+0000 7fd971600640 1 --2- 172.21.15.175:0/1698681684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd96c0cf560 0x7fd96c157680 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd96000d5f0 tx=0x7fd96000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:04.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.228+0000 7fd969600640 1 -- 172.21.15.175:0/1698681684 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9600125f0 con 0x7fd96c0cf560 2024-04-25T09:08:04.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.228+0000 7fd969600640 1 -- 172.21.15.175:0/1698681684 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd960019070 con 0x7fd96c0cf560 2024-04-25T09:08:04.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.228+0000 7fd969600640 1 -- 172.21.15.175:0/1698681684 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9600129b0 con 0x7fd96c0cf560 2024-04-25T09:08:04.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.228+0000 7fd974000640 1 -- 172.21.15.175:0/1698681684 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96c151ba0 con 0x7fd96c0cf560 2024-04-25T09:08:04.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.228+0000 7fd974000640 1 -- 172.21.15.175:0/1698681684 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96c152160 con 0x7fd96c0cf560 2024-04-25T09:08:04.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.228+0000 7fd974000640 1 -- 172.21.15.175:0/1698681684 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96c074a60 con 0x7fd96c0cf560 2024-04-25T09:08:04.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.228+0000 7fd969600640 1 -- 172.21.15.175:0/1698681684 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd960012b50 con 0x7fd96c0cf560 2024-04-25T09:08:04.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.228+0000 7fd969600640 1 --2- 172.21.15.175:0/1698681684 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd94c066f60 0x7fd94c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.228+0000 7fd969600640 1 -- 172.21.15.175:0/1698681684 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9600854c0 con 0x7fd96c0cf560 2024-04-25T09:08:04.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.228+0000 7fd970c00640 1 --2- 172.21.15.175:0/1698681684 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd94c066f60 0x7fd94c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.232+0000 7fd970c00640 1 --2- 172.21.15.175:0/1698681684 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd94c066f60 0x7fd94c069420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd9580af000 tx=0x7fd958008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:04.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.232+0000 7fd969600640 1 -- 172.21.15.175:0/1698681684 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd960011340 con 0x7fd96c0cf560 2024-04-25T09:08:04.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.392+0000 7fd974000640 1 -- 172.21.15.175:0/1698681684 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd96c06ad60 con 0x7fd96c0cf560 2024-04-25T09:08:04.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.396+0000 7fd969600640 1 -- 172.21.15.175:0/1698681684 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16701 (secure 0 0 0) 0x7fd960056430 con 0x7fd96c0cf560 2024-04-25T09:08:04.385 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:04.385 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":58,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:06:45.356791+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:41.465085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:42.715758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:08:04.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.396+0000 7fd974000640 1 -- 172.21.15.175:0/1698681684 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd94c066f60 msgr2=0x7fd94c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.396+0000 7fd974000640 1 --2- 172.21.15.175:0/1698681684 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd94c066f60 0x7fd94c069420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd9580af000 tx=0x7fd958008040 comp rx=0 tx=0).stop 2024-04-25T09:08:04.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.396+0000 7fd974000640 1 -- 172.21.15.175:0/1698681684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd96c0cf560 msgr2=0x7fd96c157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.396+0000 7fd974000640 1 --2- 172.21.15.175:0/1698681684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd96c0cf560 0x7fd96c157680 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd96000d5f0 tx=0x7fd96000dab0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.396+0000 7fd974000640 1 -- 172.21.15.175:0/1698681684 shutdown_connections 2024-04-25T09:08:04.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.396+0000 7fd974000640 1 --2- 172.21.15.175:0/1698681684 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd94c066f60 0x7fd94c069420 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.396+0000 7fd974000640 1 --2- 172.21.15.175:0/1698681684 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd96c0b3900 0x7fd96c152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.396+0000 7fd974000640 1 --2- 172.21.15.175:0/1698681684 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd96c15a900 0x7fd96c0b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.396+0000 7fd974000640 1 --2- 172.21.15.175:0/1698681684 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd96c0cf560 0x7fd96c157680 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.396+0000 7fd974000640 1 -- 172.21.15.175:0/1698681684 >> 172.21.15.175:0/1698681684 conn(0x7fd96c0cd520 msgr2=0x7fd96c1593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:04.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.396+0000 7fd974000640 1 -- 172.21.15.175:0/1698681684 shutdown_connections 2024-04-25T09:08:04.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.396+0000 7fd974000640 1 -- 172.21.15.175:0/1698681684 wait complete. 2024-04-25T09:08:04.407 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:08:04.407 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:08:04.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.552+0000 7fa434000640 1 Processor -- start 2024-04-25T09:08:04.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.552+0000 7fa434000640 1 -- start start 2024-04-25T09:08:04.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.552+0000 7fa434000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa42c1453a0 0x7fa42c15bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.552+0000 7fa434000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa42c15c410 0x7fa42c0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.552+0000 7fa434000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c15c8a0 con 0x7fa42c144fc0 2024-04-25T09:08:04.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.552+0000 7fa434000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c15cd00 con 0x7fa42c1453a0 2024-04-25T09:08:04.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.552+0000 7fa434000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0ce660 con 0x7fa42c15c410 2024-04-25T09:08:04.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.556+0000 7fa430c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa42c1453a0 0x7fa42c15bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.556+0000 7fa430c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa42c1453a0 0x7fa42c15bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37348/0 (socket says 172.21.15.175:37348) 2024-04-25T09:08:04.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.556+0000 7fa430c00640 1 -- 172.21.15.175:0/2627573802 learned_addr learned my addr 172.21.15.175:0/2627573802 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:04.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.556+0000 7fa432000640 1 --2- 172.21.15.175:0/2627573802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa42c15c410 0x7fa42c0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.556+0000 7fa430c00640 1 -- 172.21.15.175:0/2627573802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa42c15c410 msgr2=0x7fa42c0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:04.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.556+0000 7fa430c00640 1 --2- 172.21.15.175:0/2627573802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa42c15c410 0x7fa42c0cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.556+0000 7fa430c00640 1 -- 172.21.15.175:0/2627573802 >> v1:172.21.15.177:6789/0 conn(0x7fa42c144fc0 legacy=0x7fa42c0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:04.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.556+0000 7fa430c00640 1 -- 172.21.15.175:0/2627573802 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c0cc930 con 0x7fa42c1453a0 2024-04-25T09:08:04.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.556+0000 7fa430c00640 1 --2- 172.21.15.175:0/2627573802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42c1453a0 0x7fa42c15bed0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa4180098a0 tx=0x7fa41801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262035ea00e6fe0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:04.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.556+0000 7fa42be00640 1 -- 172.21.15.175:0/2627573802 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4180ab430 con 0x7fa42c1453a0 2024-04-25T09:08:04.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.556+0000 7fa42be00640 1 -- 172.21.15.175:0/2627573802 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4180b0070 con 0x7fa42c1453a0 2024-04-25T09:08:04.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.556+0000 7fa42be00640 1 -- 172.21.15.175:0/2627573802 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4180ab7f0 con 0x7fa42c1453a0 2024-04-25T09:08:04.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa434000640 1 -- 172.21.15.175:0/2627573802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42c1453a0 msgr2=0x7fa42c15bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa434000640 1 --2- 172.21.15.175:0/2627573802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42c1453a0 0x7fa42c15bed0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa4180098a0 tx=0x7fa41801c540 comp rx=0 tx=0).stop 2024-04-25T09:08:04.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa434000640 1 -- 172.21.15.175:0/2627573802 shutdown_connections 2024-04-25T09:08:04.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa434000640 1 --2- 172.21.15.175:0/2627573802 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa42c15c410 0x7fa42c0cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa434000640 1 --2- 172.21.15.175:0/2627573802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42c1453a0 0x7fa42c15bed0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa434000640 1 -- 172.21.15.175:0/2627573802 >> 172.21.15.175:0/2627573802 conn(0x7fa42c067150 msgr2=0x7fa42c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:04.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa434000640 1 -- 172.21.15.175:0/2627573802 shutdown_connections 2024-04-25T09:08:04.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa434000640 1 -- 172.21.15.175:0/2627573802 wait complete. 2024-04-25T09:08:04.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa434000640 1 Processor -- start 2024-04-25T09:08:04.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa434000640 1 -- start start 2024-04-25T09:08:04.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa434000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa42c1453a0 0x7fa42c13dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa434000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42c15c410 0x7fa42c141130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa434000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa42c13e570 0x7fa42c15e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa434000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0cc580 con 0x7fa42c15c410 2024-04-25T09:08:04.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa434000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0cfb70 con 0x7fa42c13e570 2024-04-25T09:08:04.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa434000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c157500 con 0x7fa42c1453a0 2024-04-25T09:08:04.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa430c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42c15c410 0x7fa42c141130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa430c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42c15c410 0x7fa42c141130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37362/0 (socket says 172.21.15.175:37362) 2024-04-25T09:08:04.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa430c00640 1 -- 172.21.15.175:0/2139406803 learned_addr learned my addr 172.21.15.175:0/2139406803 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:04.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa431600640 1 --2- 172.21.15.175:0/2139406803 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa42c1453a0 0x7fa42c13dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa432000640 1 --2- 172.21.15.175:0/2139406803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa42c13e570 0x7fa42c15e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa430c00640 1 -- 172.21.15.175:0/2139406803 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa42c1453a0 msgr2=0x7fa42c13dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa430c00640 1 --2- 172.21.15.175:0/2139406803 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa42c1453a0 0x7fa42c13dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa430c00640 1 -- 172.21.15.175:0/2139406803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa42c13e570 msgr2=0x7fa42c15e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa430c00640 1 --2- 172.21.15.175:0/2139406803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa42c13e570 0x7fa42c15e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.560+0000 7fa430c00640 1 -- 172.21.15.175:0/2139406803 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c141c10 con 0x7fa42c15c410 2024-04-25T09:08:04.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.564+0000 7fa430c00640 1 --2- 172.21.15.175:0/2139406803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42c15c410 0x7fa42c141130 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa41801a170 tx=0x7fa4180192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:04.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.564+0000 7fa429600640 1 -- 172.21.15.175:0/2139406803 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4180b4420 con 0x7fa42c15c410 2024-04-25T09:08:04.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.564+0000 7fa429600640 1 -- 172.21.15.175:0/2139406803 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4180bb070 con 0x7fa42c15c410 2024-04-25T09:08:04.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.564+0000 7fa429600640 1 -- 172.21.15.175:0/2139406803 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4180b47c0 con 0x7fa42c15c410 2024-04-25T09:08:04.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.564+0000 7fa434000640 1 -- 172.21.15.175:0/2139406803 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c141ef0 con 0x7fa42c15c410 2024-04-25T09:08:04.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.564+0000 7fa434000640 1 -- 172.21.15.175:0/2139406803 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c157750 con 0x7fa42c15c410 2024-04-25T09:08:04.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.564+0000 7fa434000640 1 -- 172.21.15.175:0/2139406803 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c074a60 con 0x7fa42c15c410 2024-04-25T09:08:04.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.564+0000 7fa429600640 1 -- 172.21.15.175:0/2139406803 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa4180b4960 con 0x7fa42c15c410 2024-04-25T09:08:04.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.564+0000 7fa429600640 1 --2- 172.21.15.175:0/2139406803 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa40c066f60 0x7fa40c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.564+0000 7fa429600640 1 -- 172.21.15.175:0/2139406803 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa41811ed30 con 0x7fa42c15c410 2024-04-25T09:08:04.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.564+0000 7fa431600640 1 --2- 172.21.15.175:0/2139406803 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa40c066f60 0x7fa40c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.568+0000 7fa431600640 1 --2- 172.21.15.175:0/2139406803 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa40c066f60 0x7fa40c069420 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa42c15c0b0 tx=0x7fa420009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:04.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.568+0000 7fa429600640 1 -- 172.21.15.175:0/2139406803 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa418016130 con 0x7fa42c15c410 2024-04-25T09:08:04.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.752+0000 7fa434000640 1 -- 172.21.15.175:0/2139406803 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa42c143c50 con 0x7fa42c15c410 2024-04-25T09:08:04.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.752+0000 7fa429600640 1 -- 172.21.15.175:0/2139406803 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4948 (secure 0 0 0) 0x7fa4180ef780 con 0x7fa42c15c410 2024-04-25T09:08:04.744 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:04.744 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2064272902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2064272902},{"type":"v1","addr":"172.21.15.177:6834","nonce":2064272902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5462,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3896280225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3896280225},{"type":"v1","addr":"172.21.15.177:6835","nonce":3896280225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/149812612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":149812612},{"type":"v1","addr":"172.21.15.175:6835","nonce":149812612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:43.704808+0000","modified":"2024-04-25T09:07:36.402066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.175:6837/1478147147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1478147147},{"type":"v1","addr":"172.21.15.175:6837","nonce":1478147147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:08:04.744 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 34 2024-04-25T09:08:04.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.756+0000 7fa434000640 1 -- 172.21.15.175:0/2139406803 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa40c066f60 msgr2=0x7fa40c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.756+0000 7fa434000640 1 --2- 172.21.15.175:0/2139406803 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa40c066f60 0x7fa40c069420 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa42c15c0b0 tx=0x7fa420009040 comp rx=0 tx=0).stop 2024-04-25T09:08:04.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.756+0000 7fa434000640 1 -- 172.21.15.175:0/2139406803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42c15c410 msgr2=0x7fa42c141130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.756+0000 7fa434000640 1 --2- 172.21.15.175:0/2139406803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42c15c410 0x7fa42c141130 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fa41801a170 tx=0x7fa4180192e0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.756+0000 7fa434000640 1 -- 172.21.15.175:0/2139406803 shutdown_connections 2024-04-25T09:08:04.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.756+0000 7fa434000640 1 --2- 172.21.15.175:0/2139406803 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa40c066f60 0x7fa40c069420 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.756+0000 7fa434000640 1 --2- 172.21.15.175:0/2139406803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa42c13e570 0x7fa42c15e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.756+0000 7fa434000640 1 --2- 172.21.15.175:0/2139406803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42c15c410 0x7fa42c141130 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.756+0000 7fa434000640 1 --2- 172.21.15.175:0/2139406803 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa42c1453a0 0x7fa42c13dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.756+0000 7fa434000640 1 -- 172.21.15.175:0/2139406803 >> 172.21.15.175:0/2139406803 conn(0x7fa42c144fc0 msgr2=0x7fa42c1425c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:04.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.756+0000 7fa434000640 1 -- 172.21.15.175:0/2139406803 shutdown_connections 2024-04-25T09:08:04.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.756+0000 7fa434000640 1 -- 172.21.15.175:0/2139406803 wait complete. 2024-04-25T09:08:04.765 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:08:04.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.912+0000 7f7d7c400640 1 Processor -- start 2024-04-25T09:08:04.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.912+0000 7f7d7c400640 1 -- start start 2024-04-25T09:08:04.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.912+0000 7f7d7c400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7d74099a50 0x7f7d7406cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.912+0000 7f7d7c400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7d7406bd60 0x7f7d74099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.912+0000 7f7d7c400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7409a370 con 0x7f7d740d0d50 2024-04-25T09:08:04.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.912+0000 7f7d7c400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d740cfcb0 con 0x7f7d74099a50 2024-04-25T09:08:04.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.912+0000 7f7d7c400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d740cff90 con 0x7f7d7406bd60 2024-04-25T09:08:04.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.912+0000 7f7d79a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7d74099a50 0x7f7d7406cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.912+0000 7f7d79a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7d74099a50 0x7f7d7406cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37372/0 (socket says 172.21.15.175:37372) 2024-04-25T09:08:04.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.912+0000 7f7d79a00640 1 -- 172.21.15.175:0/3905992182 learned_addr learned my addr 172.21.15.175:0/3905992182 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:04.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.912+0000 7f7d79000640 1 --2- 172.21.15.175:0/3905992182 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7d7406bd60 0x7f7d74099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.912+0000 7f7d79a00640 1 -- 172.21.15.175:0/3905992182 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7d7406bd60 msgr2=0x7f7d74099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:04.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.912+0000 7f7d79a00640 1 --2- 172.21.15.175:0/3905992182 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7d7406bd60 0x7f7d74099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.912+0000 7f7d79a00640 1 -- 172.21.15.175:0/3905992182 >> v1:172.21.15.177:6789/0 conn(0x7f7d740d0d50 legacy=0x7f7d740cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.912+0000 7f7d79a00640 1 -- 172.21.15.175:0/3905992182 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d740d0270 con 0x7f7d74099a50 2024-04-25T09:08:04.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.916+0000 7f7d79a00640 1 --2- 172.21.15.175:0/3905992182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d74099a50 0x7f7d7406cc50 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009870 tx=0x7f7d6801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438126bd1a293579 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:04.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.916+0000 7f7d73e00640 1 -- 172.21.15.175:0/3905992182 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d680b2070 con 0x7f7d74099a50 2024-04-25T09:08:04.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.916+0000 7f7d73e00640 1 -- 172.21.15.175:0/3905992182 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d680a9070 con 0x7f7d74099a50 2024-04-25T09:08:04.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.916+0000 7f7d73e00640 1 -- 172.21.15.175:0/3905992182 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d680ad880 con 0x7f7d74099a50 2024-04-25T09:08:04.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.916+0000 7f7d7c400640 1 -- 172.21.15.175:0/3905992182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d74099a50 msgr2=0x7f7d7406cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.916+0000 7f7d7c400640 1 --2- 172.21.15.175:0/3905992182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d74099a50 0x7f7d7406cc50 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f7d68009870 tx=0x7f7d6801c560 comp rx=0 tx=0).stop 2024-04-25T09:08:04.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.916+0000 7f7d7c400640 1 -- 172.21.15.175:0/3905992182 shutdown_connections 2024-04-25T09:08:04.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.916+0000 7f7d7c400640 1 --2- 172.21.15.175:0/3905992182 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7d7406bd60 0x7f7d74099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.916+0000 7f7d7c400640 1 --2- 172.21.15.175:0/3905992182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d74099a50 0x7f7d7406cc50 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.916+0000 7f7d7c400640 1 -- 172.21.15.175:0/3905992182 >> 172.21.15.175:0/3905992182 conn(0x7f7d740b3300 msgr2=0x7f7d740b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:04.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.916+0000 7f7d7c400640 1 -- 172.21.15.175:0/3905992182 shutdown_connections 2024-04-25T09:08:04.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.916+0000 7f7d7c400640 1 -- 172.21.15.175:0/3905992182 wait complete. 2024-04-25T09:08:04.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.916+0000 7f7d7c400640 1 Processor -- start 2024-04-25T09:08:04.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d7c400640 1 -- start start 2024-04-25T09:08:04.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d7c400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7d7406bd60 0x7f7d74150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d7c400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d74099a50 0x7f7d740c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d7c400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d740d0d50 0x7f7d740c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d7c400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7415dfe0 con 0x7f7d74099a50 2024-04-25T09:08:04.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d7c400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7415de60 con 0x7f7d740d0d50 2024-04-25T09:08:04.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d7c400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7416b260 con 0x7f7d7406bd60 2024-04-25T09:08:04.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d79000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d74099a50 0x7f7d740c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d79000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d74099a50 0x7f7d740c7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37382/0 (socket says 172.21.15.175:37382) 2024-04-25T09:08:04.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d79000640 1 -- 172.21.15.175:0/3993744762 learned_addr learned my addr 172.21.15.175:0/3993744762 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:04.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d79a00640 1 --2- 172.21.15.175:0/3993744762 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7d7406bd60 0x7f7d74150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d7a400640 1 --2- 172.21.15.175:0/3993744762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d740d0d50 0x7f7d740c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d79000640 1 -- 172.21.15.175:0/3993744762 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7d7406bd60 msgr2=0x7f7d74150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d79000640 1 --2- 172.21.15.175:0/3993744762 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7d7406bd60 0x7f7d74150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d79000640 1 -- 172.21.15.175:0/3993744762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d740d0d50 msgr2=0x7f7d740c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d79000640 1 --2- 172.21.15.175:0/3993744762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d740d0d50 0x7f7d740c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d79000640 1 -- 172.21.15.175:0/3993744762 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d74151c00 con 0x7f7d74099a50 2024-04-25T09:08:04.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d79a00640 1 --2- 172.21.15.175:0/3993744762 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7d7406bd60 0x7f7d74150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:04.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d79000640 1 --2- 172.21.15.175:0/3993744762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d74099a50 0x7f7d740c7b50 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000e8a0 tx=0x7f7d6000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:04.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d71600640 1 -- 172.21.15.175:0/3993744762 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60017070 con 0x7f7d74099a50 2024-04-25T09:08:04.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d71600640 1 -- 172.21.15.175:0/3993744762 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6000c940 con 0x7f7d74099a50 2024-04-25T09:08:04.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d7c400640 1 -- 172.21.15.175:0/3993744762 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d74151ea0 con 0x7f7d74099a50 2024-04-25T09:08:04.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d71600640 1 -- 172.21.15.175:0/3993744762 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000ccf0 con 0x7f7d74099a50 2024-04-25T09:08:04.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d7c400640 1 -- 172.21.15.175:0/3993744762 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d740c5880 con 0x7f7d74099a50 2024-04-25T09:08:04.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.920+0000 7f7d7c400640 1 -- 172.21.15.175:0/3993744762 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d74074a60 con 0x7f7d74099a50 2024-04-25T09:08:04.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.924+0000 7f7d71600640 1 -- 172.21.15.175:0/3993744762 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7d6001a070 con 0x7f7d74099a50 2024-04-25T09:08:04.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.924+0000 7f7d71600640 1 --2- 172.21.15.175:0/3993744762 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7d54066f90 0x7f7d54069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.924+0000 7f7d71600640 1 -- 172.21.15.175:0/3993744762 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d60085270 con 0x7f7d74099a50 2024-04-25T09:08:04.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.924+0000 7f7d79a00640 1 --2- 172.21.15.175:0/3993744762 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7d54066f90 0x7f7d54069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.924+0000 7f7d79a00640 1 --2- 172.21.15.175:0/3993744762 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7d54066f90 0x7f7d54069450 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7d680af000 tx=0x7f7d68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:04.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:04.928+0000 7f7d71600640 1 -- 172.21.15.175:0/3993744762 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7d60056270 con 0x7f7d74099a50 2024-04-25T09:08:05.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.116+0000 7f7d7c400640 1 -- 172.21.15.175:0/3993744762 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d7409aee0 con 0x7f7d74099a50 2024-04-25T09:08:05.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.116+0000 7f7d71600640 1 -- 172.21.15.175:0/3993744762 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f7d60055b70 con 0x7f7d74099a50 2024-04-25T09:08:05.107 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:05.107 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2064272902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2064272902},{"type":"v1","addr":"172.21.15.177:6834","nonce":2064272902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5462,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3896280225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3896280225},{"type":"v1","addr":"172.21.15.177:6835","nonce":3896280225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/149812612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":149812612},{"type":"v1","addr":"172.21.15.175:6835","nonce":149812612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:43.704808+0000","modified":"2024-04-25T09:07:36.402066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5958},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5958":{"gid":5958,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.175:6837/1478147147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1478147147},{"type":"v1","addr":"172.21.15.175:6837","nonce":1478147147}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:08:05.107 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 34 2024-04-25T09:08:05.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.120+0000 7f7d7c400640 1 -- 172.21.15.175:0/3993744762 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7d54066f90 msgr2=0x7f7d54069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.120+0000 7f7d7c400640 1 --2- 172.21.15.175:0/3993744762 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7d54066f90 0x7f7d54069450 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7d680af000 tx=0x7f7d68008040 comp rx=0 tx=0).stop 2024-04-25T09:08:05.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.120+0000 7f7d7c400640 1 -- 172.21.15.175:0/3993744762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d74099a50 msgr2=0x7f7d740c7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.120+0000 7f7d7c400640 1 --2- 172.21.15.175:0/3993744762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d74099a50 0x7f7d740c7b50 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000e8a0 tx=0x7f7d6000eca0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.120+0000 7f7d7c400640 1 -- 172.21.15.175:0/3993744762 shutdown_connections 2024-04-25T09:08:05.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.120+0000 7f7d7c400640 1 --2- 172.21.15.175:0/3993744762 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7d54066f90 0x7f7d54069450 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.120+0000 7f7d7c400640 1 --2- 172.21.15.175:0/3993744762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7d740d0d50 0x7f7d740c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.120+0000 7f7d7c400640 1 --2- 172.21.15.175:0/3993744762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7d74099a50 0x7f7d740c7b50 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.120+0000 7f7d7c400640 1 --2- 172.21.15.175:0/3993744762 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7d7406bd60 0x7f7d74150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.120+0000 7f7d7c400640 1 -- 172.21.15.175:0/3993744762 >> 172.21.15.175:0/3993744762 conn(0x7f7d740b3300 msgr2=0x7f7d740ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:05.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.120+0000 7f7d7c400640 1 -- 172.21.15.175:0/3993744762 shutdown_connections 2024-04-25T09:08:05.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.120+0000 7f7d7c400640 1 -- 172.21.15.175:0/3993744762 wait complete. 2024-04-25T09:08:05.127 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:08:05.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.272+0000 7fdca7600640 1 Processor -- start 2024-04-25T09:08:05.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.272+0000 7fdca7600640 1 -- start start 2024-04-25T09:08:05.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.272+0000 7fdca7600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdca015a900 0x7fdca006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.272+0000 7fdca7600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca00cda00 con 0x7fdca00cf560 2024-04-25T09:08:05.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.272+0000 7fdca7600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca00cdce0 con 0x7fdca00cd520 2024-04-25T09:08:05.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.272+0000 7fdca7600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca015bcf0 con 0x7fdca015a900 2024-04-25T09:08:05.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.272+0000 7fdca4c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdca015a900 0x7fdca006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.272+0000 7fdca4c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdca015a900 0x7fdca006e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37386/0 (socket says 172.21.15.175:37386) 2024-04-25T09:08:05.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.272+0000 7fdca4c00640 1 -- 172.21.15.175:0/3282670177 learned_addr learned my addr 172.21.15.175:0/3282670177 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:05.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.272+0000 7fdca5600640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fdca00cf560 0x7fdca015bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45336/0 (socket says 172.21.15.175:45336) 2024-04-25T09:08:05.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.272+0000 7fdca4c00640 1 -- 172.21.15.175:0/3282670177 >> v1:172.21.15.177:6789/0 conn(0x7fdca00cd520 legacy=0x7fdca00ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.272+0000 7fdca4c00640 1 -- 172.21.15.175:0/3282670177 >> v1:172.21.15.175:6789/0 conn(0x7fdca00cf560 legacy=0x7fdca015bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.276+0000 7fdca4c00640 1 -- 172.21.15.175:0/3282670177 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca00cdfc0 con 0x7fdca015a900 2024-04-25T09:08:05.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.276+0000 7fdc9f400640 1 -- 172.21.15.175:0/3282670177 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714139453 0 0) 0x7fdca00cda00 con 0x7fdca00cf560 2024-04-25T09:08:05.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.276+0000 7fdca4c00640 1 --2- 172.21.15.175:0/3282670177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdca015a900 0x7fdca006e150 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400bb10 tx=0x7fdc9401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ed1fd845d7b498 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.276+0000 7fdc9f400640 1 -- 172.21.15.175:0/3282670177 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc940b4070 con 0x7fdca015a900 2024-04-25T09:08:05.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.276+0000 7fdc9f400640 1 -- 172.21.15.175:0/3282670177 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc940a7a00 con 0x7fdca015a900 2024-04-25T09:08:05.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.276+0000 7fdc9f400640 1 -- 172.21.15.175:0/3282670177 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc940a7dd0 con 0x7fdca015a900 2024-04-25T09:08:05.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.276+0000 7fdca7600640 1 -- 172.21.15.175:0/3282670177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdca015a900 msgr2=0x7fdca006e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.276+0000 7fdca7600640 1 --2- 172.21.15.175:0/3282670177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdca015a900 0x7fdca006e150 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400bb10 tx=0x7fdc9401ec30 comp rx=0 tx=0).stop 2024-04-25T09:08:05.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.276+0000 7fdca7600640 1 -- 172.21.15.175:0/3282670177 shutdown_connections 2024-04-25T09:08:05.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.276+0000 7fdca7600640 1 --2- 172.21.15.175:0/3282670177 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdca015a900 0x7fdca006e150 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.276+0000 7fdca7600640 1 -- 172.21.15.175:0/3282670177 >> 172.21.15.175:0/3282670177 conn(0x7fdca0067150 msgr2=0x7fdca006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:05.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.276+0000 7fdca7600640 1 -- 172.21.15.175:0/3282670177 shutdown_connections 2024-04-25T09:08:05.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.276+0000 7fdca7600640 1 -- 172.21.15.175:0/3282670177 wait complete. 2024-04-25T09:08:05.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdca7600640 1 Processor -- start 2024-04-25T09:08:05.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdca7600640 1 -- start start 2024-04-25T09:08:05.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdca7600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdca00cf560 0x7fdca01487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdca7600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdca015a900 0x7fdca0152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdca7600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdca0153080 0x7fdca0150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdca7600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca006d530 con 0x7fdca015a900 2024-04-25T09:08:05.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdca7600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca006d3b0 con 0x7fdca0153080 2024-04-25T09:08:05.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdca7600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca0071a50 con 0x7fdca00cf560 2024-04-25T09:08:05.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdc9fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdca015a900 0x7fdca0152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdc9fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdca015a900 0x7fdca0152b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37400/0 (socket says 172.21.15.175:37400) 2024-04-25T09:08:05.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdc9fe00640 1 -- 172.21.15.175:0/3189648426 learned_addr learned my addr 172.21.15.175:0/3189648426 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:05.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdca5600640 1 --2- 172.21.15.175:0/3189648426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdca0153080 0x7fdca0150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdc9fe00640 1 -- 172.21.15.175:0/3189648426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdca00cf560 msgr2=0x7fdca01487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdca4c00640 1 --2- 172.21.15.175:0/3189648426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdca00cf560 0x7fdca01487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdc9fe00640 1 --2- 172.21.15.175:0/3189648426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdca00cf560 0x7fdca01487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdc9fe00640 1 -- 172.21.15.175:0/3189648426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdca0153080 msgr2=0x7fdca0150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdc9fe00640 1 --2- 172.21.15.175:0/3189648426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdca0153080 0x7fdca0150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdc9fe00640 1 -- 172.21.15.175:0/3189648426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0148ce0 con 0x7fdca015a900 2024-04-25T09:08:05.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdca5600640 1 --2- 172.21.15.175:0/3189648426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdca0153080 0x7fdca0150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:05.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdca4c00640 1 --2- 172.21.15.175:0/3189648426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdca00cf560 0x7fdca01487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:05.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdc9fe00640 1 --2- 172.21.15.175:0/3189648426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdca015a900 0x7fdca0152b40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00c500 tx=0x7fdc8c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdc9cc00640 1 -- 172.21.15.175:0/3189648426 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c0052d0 con 0x7fdca015a900 2024-04-25T09:08:05.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdc9cc00640 1 -- 172.21.15.175:0/3189648426 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c005470 con 0x7fdca015a900 2024-04-25T09:08:05.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdca7600640 1 -- 172.21.15.175:0/3189648426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca01510a0 con 0x7fdca015a900 2024-04-25T09:08:05.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdc9cc00640 1 -- 172.21.15.175:0/3189648426 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c012830 con 0x7fdca015a900 2024-04-25T09:08:05.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.280+0000 7fdca7600640 1 -- 172.21.15.175:0/3189648426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca014d120 con 0x7fdca015a900 2024-04-25T09:08:05.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.284+0000 7fdca7600640 1 -- 172.21.15.175:0/3189648426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca0074a60 con 0x7fdca015a900 2024-04-25T09:08:05.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.284+0000 7fdc9cc00640 1 -- 172.21.15.175:0/3189648426 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdc8c0129d0 con 0x7fdca015a900 2024-04-25T09:08:05.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.284+0000 7fdc9cc00640 1 --2- 172.21.15.175:0/3189648426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdc80066f90 0x7fdc80069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.284+0000 7fdc9cc00640 1 -- 172.21.15.175:0/3189648426 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc8c084c20 con 0x7fdca015a900 2024-04-25T09:08:05.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.284+0000 7fdca4c00640 1 --2- 172.21.15.175:0/3189648426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdc80066f90 0x7fdc80069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.284+0000 7fdca4c00640 1 --2- 172.21.15.175:0/3189648426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdc80066f90 0x7fdc80069450 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdc940b1000 tx=0x7fdc94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.288+0000 7fdc9cc00640 1 -- 172.21.15.175:0/3189648426 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdc8c0182b0 con 0x7fdca015a900 2024-04-25T09:08:05.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.444+0000 7fdca7600640 1 -- 172.21.15.175:0/3189648426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdca006c220 con 0x7fdca015a900 2024-04-25T09:08:05.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.444+0000 7fdc9cc00640 1 -- 172.21.15.175:0/3189648426 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16701 (secure 0 0 0) 0x7fdc8c055c40 con 0x7fdca015a900 2024-04-25T09:08:05.435 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:05.435 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":58,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:06:45.356791+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:41.465085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:42.715758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:08:05.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.448+0000 7fdca7600640 1 -- 172.21.15.175:0/3189648426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdc80066f90 msgr2=0x7fdc80069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.448+0000 7fdca7600640 1 --2- 172.21.15.175:0/3189648426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdc80066f90 0x7fdc80069450 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdc940b1000 tx=0x7fdc94008040 comp rx=0 tx=0).stop 2024-04-25T09:08:05.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.448+0000 7fdca7600640 1 -- 172.21.15.175:0/3189648426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdca015a900 msgr2=0x7fdca0152b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.448+0000 7fdca7600640 1 --2- 172.21.15.175:0/3189648426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdca015a900 0x7fdca0152b40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00c500 tx=0x7fdc8c00c9c0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.448+0000 7fdca7600640 1 -- 172.21.15.175:0/3189648426 shutdown_connections 2024-04-25T09:08:05.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.448+0000 7fdca7600640 1 --2- 172.21.15.175:0/3189648426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdc80066f90 0x7fdc80069450 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.448+0000 7fdca7600640 1 --2- 172.21.15.175:0/3189648426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdca0153080 0x7fdca0150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.448+0000 7fdca7600640 1 --2- 172.21.15.175:0/3189648426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdca015a900 0x7fdca0152b40 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.448+0000 7fdca7600640 1 --2- 172.21.15.175:0/3189648426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdca00cf560 0x7fdca01487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.448+0000 7fdca7600640 1 -- 172.21.15.175:0/3189648426 >> 172.21.15.175:0/3189648426 conn(0x7fdca00cd520 msgr2=0x7fdca0158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:05.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.448+0000 7fdca7600640 1 -- 172.21.15.175:0/3189648426 shutdown_connections 2024-04-25T09:08:05.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.448+0000 7fdca7600640 1 -- 172.21.15.175:0/3189648426 wait complete. 2024-04-25T09:08:05.457 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:08:05.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.604+0000 7f64d1c00640 1 Processor -- start 2024-04-25T09:08:05.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.604+0000 7f64d1c00640 1 -- start start 2024-04-25T09:08:05.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.604+0000 7f64d1c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f64cc06c2c0 0x7f64cc161630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.604+0000 7f64d1c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64cc09ae40 con 0x7f64cc0b2b40 2024-04-25T09:08:05.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.604+0000 7f64d1c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64cc0b2f20 con 0x7f64cc161b70 2024-04-25T09:08:05.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.604+0000 7f64d1c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64cc161fa0 con 0x7f64cc06c2c0 2024-04-25T09:08:05.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.604+0000 7f64cbe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f64cc0b2b40 0x7f64cc0cf7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45352/0 (socket says 172.21.15.175:45352) 2024-04-25T09:08:05.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.604+0000 7f64cbe00640 1 -- 172.21.15.175:0/3915110375 learned_addr learned my addr 172.21.15.175:0/3915110375 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:05.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.604+0000 7f64c3400640 1 --2- 172.21.15.175:0/3915110375 >> v2:172.21.15.175:3300/0 conn(0x7f64cc06c2c0 0x7f64cc161630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.604+0000 7f64c3400640 1 -- 172.21.15.175:0/3915110375 >> v1:172.21.15.177:6789/0 conn(0x7f64cc161b70 legacy=0x7f64cc15d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.604+0000 7f64c3400640 1 -- 172.21.15.175:0/3915110375 >> v1:172.21.15.175:6789/0 conn(0x7f64cc0b2b40 legacy=0x7f64cc0cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.604+0000 7f64c3400640 1 -- 172.21.15.175:0/3915110375 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc0d0250 con 0x7f64cc06c2c0 2024-04-25T09:08:05.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.608+0000 7f64c3400640 1 --2- 172.21.15.175:0/3915110375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64cc06c2c0 0x7f64cc161630 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f64b40097c0 tx=0x7f64b401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5ef978a11ed1d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.608+0000 7f64cb400640 1 -- 172.21.15.175:0/3915110375 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b40b1070 con 0x7f64cc06c2c0 2024-04-25T09:08:05.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.608+0000 7f64cb400640 1 -- 172.21.15.175:0/3915110375 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b40a8050 con 0x7f64cc06c2c0 2024-04-25T09:08:05.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.608+0000 7f64cb400640 1 -- 172.21.15.175:0/3915110375 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b40ac860 con 0x7f64cc06c2c0 2024-04-25T09:08:05.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.608+0000 7f64d1c00640 1 -- 172.21.15.175:0/3915110375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64cc06c2c0 msgr2=0x7f64cc161630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.608+0000 7f64d1c00640 1 --2- 172.21.15.175:0/3915110375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64cc06c2c0 0x7f64cc161630 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f64b40097c0 tx=0x7f64b401c3e0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.608+0000 7f64d1c00640 1 -- 172.21.15.175:0/3915110375 shutdown_connections 2024-04-25T09:08:05.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.608+0000 7f64d1c00640 1 --2- 172.21.15.175:0/3915110375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64cc06c2c0 0x7f64cc161630 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.608+0000 7f64d1c00640 1 -- 172.21.15.175:0/3915110375 >> 172.21.15.175:0/3915110375 conn(0x7f64cc0b3140 msgr2=0x7f64cc0b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:05.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.608+0000 7f64d1c00640 1 -- 172.21.15.175:0/3915110375 shutdown_connections 2024-04-25T09:08:05.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.608+0000 7f64d1c00640 1 -- 172.21.15.175:0/3915110375 wait complete. 2024-04-25T09:08:05.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64d1c00640 1 Processor -- start 2024-04-25T09:08:05.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64d1c00640 1 -- start start 2024-04-25T09:08:05.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64d1c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64cc06c2c0 0x7f64cc1562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64d1c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64cc0b2b40 0x7f64cc14f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64d1c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64cc161b70 0x7f64cc15f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64d1c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc0cfef0 con 0x7f64cc06c2c0 2024-04-25T09:08:05.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64d1c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc0b0fb0 con 0x7f64cc0b2b40 2024-04-25T09:08:05.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64d1c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc15edf0 con 0x7f64cc161b70 2024-04-25T09:08:05.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64cbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64cc06c2c0 0x7f64cc1562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64cbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64cc06c2c0 0x7f64cc1562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37418/0 (socket says 172.21.15.175:37418) 2024-04-25T09:08:05.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64cbe00640 1 -- 172.21.15.175:0/2189002706 learned_addr learned my addr 172.21.15.175:0/2189002706 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:05.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64cbe00640 1 -- 172.21.15.175:0/2189002706 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64cc161b70 msgr2=0x7f64cc15f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64cbe00640 1 --2- 172.21.15.175:0/2189002706 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64cc161b70 0x7f64cc15f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64cbe00640 1 -- 172.21.15.175:0/2189002706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64cc0b2b40 msgr2=0x7f64cc14f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64cbe00640 1 --2- 172.21.15.175:0/2189002706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64cc0b2b40 0x7f64cc14f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64cbe00640 1 -- 172.21.15.175:0/2189002706 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc156d00 con 0x7f64cc06c2c0 2024-04-25T09:08:05.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64cbe00640 1 --2- 172.21.15.175:0/2189002706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64cc06c2c0 0x7f64cc1562d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00c400 tx=0x7f64bc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64c8c00640 1 -- 172.21.15.175:0/2189002706 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc017070 con 0x7f64cc06c2c0 2024-04-25T09:08:05.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64c8c00640 1 -- 172.21.15.175:0/2189002706 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64bc005cf0 con 0x7f64cc06c2c0 2024-04-25T09:08:05.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64d1c00640 1 -- 172.21.15.175:0/2189002706 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64cc156fa0 con 0x7f64cc06c2c0 2024-04-25T09:08:05.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64c8c00640 1 -- 172.21.15.175:0/2189002706 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc0072d0 con 0x7f64cc06c2c0 2024-04-25T09:08:05.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64d1c00640 1 -- 172.21.15.175:0/2189002706 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64cc157560 con 0x7f64cc06c2c0 2024-04-25T09:08:05.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.612+0000 7f64d1c00640 1 -- 172.21.15.175:0/2189002706 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64cc074a60 con 0x7f64cc06c2c0 2024-04-25T09:08:05.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.616+0000 7f64c8c00640 1 -- 172.21.15.175:0/2189002706 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f64bc01a070 con 0x7f64cc06c2c0 2024-04-25T09:08:05.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.616+0000 7f64c8c00640 1 --2- 172.21.15.175:0/2189002706 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f64a8066f60 0x7f64a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.616+0000 7f64c8c00640 1 -- 172.21.15.175:0/2189002706 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64bc0842a0 con 0x7f64cc06c2c0 2024-04-25T09:08:05.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.616+0000 7f64c3400640 1 --2- 172.21.15.175:0/2189002706 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f64a8066f60 0x7f64a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.616+0000 7f64c3400640 1 --2- 172.21.15.175:0/2189002706 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f64a8066f60 0x7f64a8069420 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f64b40ae000 tx=0x7f64b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.620+0000 7f64c8c00640 1 -- 172.21.15.175:0/2189002706 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f64bc054c50 con 0x7f64cc06c2c0 2024-04-25T09:08:05.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.804+0000 7f64d1c00640 1 -- 172.21.15.175:0/2189002706 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f64cc0b4050 con 0x7f64cc06c2c0 2024-04-25T09:08:05.793 INFO:tasks.ceph.mon.a.smithi175.stderr:2024-04-25T09:08:05.804+0000 7feb0ee00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:08:05.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.804+0000 7f64c8c00640 1 -- 172.21.15.175:0/2189002706 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) v1 ==== 161+0+0 (secure 0 0 0) 0x7f64bc058cf0 con 0x7f64cc06c2c0 2024-04-25T09:08:05.795 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:08:05.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.808+0000 7f64d1c00640 1 -- 172.21.15.175:0/2189002706 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f64a8066f60 msgr2=0x7f64a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.808+0000 7f64d1c00640 1 --2- 172.21.15.175:0/2189002706 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f64a8066f60 0x7f64a8069420 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f64b40ae000 tx=0x7f64b4008040 comp rx=0 tx=0).stop 2024-04-25T09:08:05.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.808+0000 7f64d1c00640 1 -- 172.21.15.175:0/2189002706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64cc06c2c0 msgr2=0x7f64cc1562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.808+0000 7f64d1c00640 1 --2- 172.21.15.175:0/2189002706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64cc06c2c0 0x7f64cc1562d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00c400 tx=0x7f64bc00c8c0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.808+0000 7f64d1c00640 1 -- 172.21.15.175:0/2189002706 shutdown_connections 2024-04-25T09:08:05.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.808+0000 7f64d1c00640 1 --2- 172.21.15.175:0/2189002706 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f64a8066f60 0x7f64a8069420 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.808+0000 7f64d1c00640 1 --2- 172.21.15.175:0/2189002706 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64cc161b70 0x7f64cc15f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.808+0000 7f64d1c00640 1 --2- 172.21.15.175:0/2189002706 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64cc0b2b40 0x7f64cc14f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.808+0000 7f64d1c00640 1 --2- 172.21.15.175:0/2189002706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64cc06c2c0 0x7f64cc1562d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.808+0000 7f64d1c00640 1 -- 172.21.15.175:0/2189002706 >> 172.21.15.175:0/2189002706 conn(0x7f64cc0b3140 msgr2=0x7f64cc0ae420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:05.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.808+0000 7f64d1c00640 1 -- 172.21.15.175:0/2189002706 shutdown_connections 2024-04-25T09:08:05.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.808+0000 7f64d1c00640 1 -- 172.21.15.175:0/2189002706 wait complete. 2024-04-25T09:08:05.817 INFO:tasks.ceph.mds.a.smithi175.stderr: -7591> 2024-04-25T09:06:49.317+0000 7f3265800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:08:05.823 INFO:tasks.ceph.mds.a.smithi175.stderr: -4871> 2024-04-25T09:06:57.016+0000 7f3260800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6129=0-4194304@1} caps={6129=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6129 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x560f56c87b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:08:05.827 INFO:tasks.ceph.mds.a.smithi175.stderr: -2907> 2024-04-25T09:07:28.552+0000 7f3260800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v4 ap=1 DIRTYPARENT s=0 n(v0 rc2024-04-25T09:06:55.872956+0000 1=1+0) (iversion lock) caps={6129=pAsLsXsFs/-@2},l=6129(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 scrubqueue=0 0x560f56c87b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v4>,<0x1/dir_test v7>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:08:05.828 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:08:05.871 INFO:tasks.ceph.mds.a.smithi175.stdout:starting mds.a at 2024-04-25T09:08:05.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.980+0000 7f04d3400640 1 Processor -- start 2024-04-25T09:08:05.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.980+0000 7f04d3400640 1 -- start start 2024-04-25T09:08:05.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.980+0000 7f04d3400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04cc145250 0x7f04cc0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.980+0000 7f04d3400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f04cc1600a0 0x7f04cc0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.980+0000 7f04d3400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04cc0cfd10 con 0x7f04cc0ce970 2024-04-25T09:08:05.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.980+0000 7f04d3400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04cc15f650 con 0x7f04cc1600a0 2024-04-25T09:08:05.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.980+0000 7f04d3400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0cfff0 con 0x7f04cc145250 2024-04-25T09:08:05.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.980+0000 7f04cbe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f04cc1600a0 0x7f04cc0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.980+0000 7f04cbe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f04cc1600a0 0x7f04cc0cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37426/0 (socket says 172.21.15.175:37426) 2024-04-25T09:08:05.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.980+0000 7f04cbe00640 1 -- 172.21.15.175:0/3694940334 learned_addr learned my addr 172.21.15.175:0/3694940334 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:05.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.980+0000 7f04d0a00640 1 --2- 172.21.15.175:0/3694940334 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04cc145250 0x7f04cc0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.984+0000 7f04cbe00640 1 -- 172.21.15.175:0/3694940334 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04cc145250 msgr2=0x7f04cc0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:05.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.984+0000 7f04cbe00640 1 --2- 172.21.15.175:0/3694940334 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04cc145250 0x7f04cc0cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.984+0000 7f04cbe00640 1 -- 172.21.15.175:0/3694940334 >> v1:172.21.15.177:6789/0 conn(0x7f04cc0ce970 legacy=0x7f04cc0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.984+0000 7f04cbe00640 1 -- 172.21.15.175:0/3694940334 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc15f8a0 con 0x7f04cc1600a0 2024-04-25T09:08:05.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.984+0000 7f04cbe00640 1 --2- 172.21.15.175:0/3694940334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc1600a0 0x7f04cc0cc410 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009870 tx=0x7f04b801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c29cf054938ac4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.984+0000 7f04cb400640 1 -- 172.21.15.175:0/3694940334 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b80aa620 con 0x7f04cc1600a0 2024-04-25T09:08:05.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.984+0000 7f04cb400640 1 -- 172.21.15.175:0/3694940334 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b80af070 con 0x7f04cc1600a0 2024-04-25T09:08:05.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.984+0000 7f04cb400640 1 -- 172.21.15.175:0/3694940334 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b80aa9e0 con 0x7f04cc1600a0 2024-04-25T09:08:05.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.984+0000 7f04d3400640 1 -- 172.21.15.175:0/3694940334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc1600a0 msgr2=0x7f04cc0cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.984+0000 7f04d3400640 1 --2- 172.21.15.175:0/3694940334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc1600a0 0x7f04cc0cc410 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009870 tx=0x7f04b801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.984+0000 7f04d3400640 1 -- 172.21.15.175:0/3694940334 shutdown_connections 2024-04-25T09:08:05.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.984+0000 7f04d3400640 1 --2- 172.21.15.175:0/3694940334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc1600a0 0x7f04cc0cc410 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.984+0000 7f04d3400640 1 --2- 172.21.15.175:0/3694940334 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04cc145250 0x7f04cc0cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.984+0000 7f04d3400640 1 -- 172.21.15.175:0/3694940334 >> 172.21.15.175:0/3694940334 conn(0x7f04cc06ac50 msgr2=0x7f04cc06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:05.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.984+0000 7f04d3400640 1 -- 172.21.15.175:0/3694940334 shutdown_connections 2024-04-25T09:08:05.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.984+0000 7f04d3400640 1 -- 172.21.15.175:0/3694940334 wait complete. 2024-04-25T09:08:05.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04d3400640 1 Processor -- start 2024-04-25T09:08:05.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04d3400640 1 -- start start 2024-04-25T09:08:05.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04d3400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04cc0ce970 0x7f04cc160da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04d3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc145250 0x7f04cc15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04d3400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04cc1600a0 0x7f04cc13e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04d3400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc15c870 con 0x7f04cc145250 2024-04-25T09:08:05.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04d3400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc145630 con 0x7f04cc0ce970 2024-04-25T09:08:05.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04d3400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc15c9f0 con 0x7f04cc1600a0 2024-04-25T09:08:05.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04cbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc145250 0x7f04cc15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04cbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc145250 0x7f04cc15b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37430/0 (socket says 172.21.15.175:37430) 2024-04-25T09:08:05.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04cbe00640 1 -- 172.21.15.175:0/588961204 learned_addr learned my addr 172.21.15.175:0/588961204 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:05.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04d0a00640 1 --2- 172.21.15.175:0/588961204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04cc0ce970 0x7f04cc160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04d1400640 1 --2- 172.21.15.175:0/588961204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04cc1600a0 0x7f04cc13e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04cbe00640 1 -- 172.21.15.175:0/588961204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04cc1600a0 msgr2=0x7f04cc13e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04cbe00640 1 --2- 172.21.15.175:0/588961204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04cc1600a0 0x7f04cc13e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04cbe00640 1 -- 172.21.15.175:0/588961204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04cc0ce970 msgr2=0x7f04cc160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04cbe00640 1 --2- 172.21.15.175:0/588961204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04cc0ce970 0x7f04cc160da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04cbe00640 1 -- 172.21.15.175:0/588961204 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc15bad0 con 0x7f04cc145250 2024-04-25T09:08:05.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04cbe00640 1 --2- 172.21.15.175:0/588961204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc145250 0x7f04cc15b590 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f04b801ab50 tx=0x7f04b8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04c8c00640 1 -- 172.21.15.175:0/588961204 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b80aad30 con 0x7f04cc145250 2024-04-25T09:08:05.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04c8c00640 1 -- 172.21.15.175:0/588961204 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b80be410 con 0x7f04cc145250 2024-04-25T09:08:05.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04d3400640 1 -- 172.21.15.175:0/588961204 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04cc13e790 con 0x7f04cc145250 2024-04-25T09:08:05.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04c8c00640 1 -- 172.21.15.175:0/588961204 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b80be800 con 0x7f04cc145250 2024-04-25T09:08:05.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.988+0000 7f04d3400640 1 -- 172.21.15.175:0/588961204 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04cc1622b0 con 0x7f04cc145250 2024-04-25T09:08:05.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.992+0000 7f04d3400640 1 -- 172.21.15.175:0/588961204 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04cc075160 con 0x7f04cc145250 2024-04-25T09:08:05.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.992+0000 7f04c8c00640 1 -- 172.21.15.175:0/588961204 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f04b80bc020 con 0x7f04cc145250 2024-04-25T09:08:05.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.992+0000 7f04c8c00640 1 --2- 172.21.15.175:0/588961204 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f04ac066f60 0x7f04ac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.992+0000 7f04c8c00640 1 -- 172.21.15.175:0/588961204 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f04b811f3c0 con 0x7f04cc145250 2024-04-25T09:08:05.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.992+0000 7f04d0a00640 1 --2- 172.21.15.175:0/588961204 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f04ac066f60 0x7f04ac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.992+0000 7f04d0a00640 1 --2- 172.21.15.175:0/588961204 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f04ac066f60 0x7f04ac069420 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0113e0 tx=0x7f04bc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:05.996+0000 7f04c8c00640 1 -- 172.21.15.175:0/588961204 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f04cc15bad0 con 0x7f04cc145250 2024-04-25T09:08:06.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:06.184+0000 7f04d3400640 1 -- 172.21.15.175:0/588961204 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f04cc13f9f0 con 0x7f04cc145250 2024-04-25T09:08:06.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:06.812+0000 7f04c8c00640 1 -- 172.21.15.175:0/588961204 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7f04b8016150 con 0x7f04cc145250 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:06.816+0000 7f04d3400640 1 -- 172.21.15.175:0/588961204 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f04ac066f60 msgr2=0x7f04ac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:06.816+0000 7f04d3400640 1 --2- 172.21.15.175:0/588961204 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f04ac066f60 0x7f04ac069420 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0113e0 tx=0x7f04bc00b040 comp rx=0 tx=0).stop 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:06.816+0000 7f04d3400640 1 -- 172.21.15.175:0/588961204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc145250 msgr2=0x7f04cc15b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:06.816+0000 7f04d3400640 1 --2- 172.21.15.175:0/588961204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc145250 0x7f04cc15b590 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f04b801ab50 tx=0x7f04b8019240 comp rx=0 tx=0).stop 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:06.816+0000 7f04d3400640 1 -- 172.21.15.175:0/588961204 shutdown_connections 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:06.816+0000 7f04d3400640 1 --2- 172.21.15.175:0/588961204 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f04ac066f60 0x7f04ac069420 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:06.816+0000 7f04d3400640 1 --2- 172.21.15.175:0/588961204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04cc1600a0 0x7f04cc13e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:06.816+0000 7f04d3400640 1 --2- 172.21.15.175:0/588961204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04cc145250 0x7f04cc15b590 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:06.816+0000 7f04d3400640 1 --2- 172.21.15.175:0/588961204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04cc0ce970 0x7f04cc160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:06.816+0000 7f04d3400640 1 -- 172.21.15.175:0/588961204 >> 172.21.15.175:0/588961204 conn(0x7f04cc06ac50 msgr2=0x7f04cc15d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:06.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:06.816+0000 7f04d3400640 1 -- 172.21.15.175:0/588961204 shutdown_connections 2024-04-25T09:08:06.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:06.816+0000 7f04d3400640 1 -- 172.21.15.175:0/588961204 wait complete. 2024-04-25T09:08:06.829 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:08:07.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.028+0000 7faa4e400640 1 Processor -- start 2024-04-25T09:08:07.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.028+0000 7faa4e400640 1 -- start start 2024-04-25T09:08:07.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.032+0000 7faa4e400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa480712b0 0x7faa48071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:07.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.032+0000 7faa4e400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faa4806d860 0x7faa4806dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:07.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.032+0000 7faa4e400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa48071e20 con 0x7faa480cfb60 2024-04-25T09:08:07.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.032+0000 7faa4e400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa480cbed0 con 0x7faa4806d860 2024-04-25T09:08:07.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.032+0000 7faa4e400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4806e1d0 con 0x7faa480712b0 2024-04-25T09:08:07.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.032+0000 7faa47400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7faa480cfb60 0x7faa480ce7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45366/0 (socket says 172.21.15.175:45366) 2024-04-25T09:08:07.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.032+0000 7faa47400640 1 -- 172.21.15.175:0/1027626128 learned_addr learned my addr 172.21.15.175:0/1027626128 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:07.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.032+0000 7faa47e00640 1 --2- 172.21.15.175:0/1027626128 >> v2:172.21.15.175:3300/0 conn(0x7faa4806d860 0x7faa4806dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:07.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.032+0000 7faa46a00640 1 --2- 172.21.15.175:0/1027626128 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa480712b0 0x7faa48071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:07.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.032+0000 7faa46000640 1 -- 172.21.15.175:0/1027626128 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2640178494 0 0) 0x7faa48071e20 con 0x7faa480cfb60 2024-04-25T09:08:07.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.032+0000 7faa46000640 1 -- 172.21.15.175:0/1027626128 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa2c003530 con 0x7faa480cfb60 2024-04-25T09:08:07.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.032+0000 7faa47e00640 1 -- 172.21.15.175:0/1027626128 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa480712b0 msgr2=0x7faa48071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:07.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.032+0000 7faa47e00640 1 --2- 172.21.15.175:0/1027626128 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa480712b0 0x7faa48071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:07.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.032+0000 7faa47e00640 1 -- 172.21.15.175:0/1027626128 >> v1:172.21.15.175:6789/0 conn(0x7faa480cfb60 legacy=0x7faa480ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:07.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.032+0000 7faa47e00640 1 -- 172.21.15.175:0/1027626128 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa48072100 con 0x7faa4806d860 2024-04-25T09:08:07.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.036+0000 7faa47e00640 1 --2- 172.21.15.175:0/1027626128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4806d860 0x7faa4806dc90 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7faa40009d90 tx=0x7faa4001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79da2088d7b547d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:07.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.036+0000 7faa46000640 1 -- 172.21.15.175:0/1027626128 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa400b2070 con 0x7faa4806d860 2024-04-25T09:08:07.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.036+0000 7faa46000640 1 -- 172.21.15.175:0/1027626128 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa400a5890 con 0x7faa4806d860 2024-04-25T09:08:07.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.036+0000 7faa46000640 1 -- 172.21.15.175:0/1027626128 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa400a5c60 con 0x7faa4806d860 2024-04-25T09:08:07.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.036+0000 7faa4e400640 1 -- 172.21.15.175:0/1027626128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4806d860 msgr2=0x7faa4806dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:07.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.036+0000 7faa4e400640 1 --2- 172.21.15.175:0/1027626128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4806d860 0x7faa4806dc90 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7faa40009d90 tx=0x7faa4001c8e0 comp rx=0 tx=0).stop 2024-04-25T09:08:07.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.036+0000 7faa4e400640 1 -- 172.21.15.175:0/1027626128 shutdown_connections 2024-04-25T09:08:07.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.036+0000 7faa4e400640 1 --2- 172.21.15.175:0/1027626128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4806d860 0x7faa4806dc90 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:07.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.036+0000 7faa4e400640 1 --2- 172.21.15.175:0/1027626128 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa480712b0 0x7faa48071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:07.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.036+0000 7faa4e400640 1 -- 172.21.15.175:0/1027626128 >> 172.21.15.175:0/1027626128 conn(0x7faa4806ac50 msgr2=0x7faa4806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:07.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.036+0000 7faa4e400640 1 -- 172.21.15.175:0/1027626128 shutdown_connections 2024-04-25T09:08:07.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.036+0000 7faa4e400640 1 -- 172.21.15.175:0/1027626128 wait complete. 2024-04-25T09:08:07.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.036+0000 7faa4e400640 1 Processor -- start 2024-04-25T09:08:07.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.036+0000 7faa4e400640 1 -- start start 2024-04-25T09:08:07.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa4e400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4806d860 0x7faa4813d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:07.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa4e400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa480712b0 0x7faa48140320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:07.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa4e400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa480cfb60 0x7faa48140860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:07.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa4e400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa480d00c0 con 0x7faa4806d860 2024-04-25T09:08:07.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa4e400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa480cff40 con 0x7faa480712b0 2024-04-25T09:08:07.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa4e400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa480ceee0 con 0x7faa480cfb60 2024-04-25T09:08:07.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa47400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4806d860 0x7faa4813d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:07.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa47400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4806d860 0x7faa4813d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37462/0 (socket says 172.21.15.175:37462) 2024-04-25T09:08:07.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa47400640 1 -- 172.21.15.175:0/2645304530 learned_addr learned my addr 172.21.15.175:0/2645304530 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:07.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa47e00640 1 --2- 172.21.15.175:0/2645304530 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa480cfb60 0x7faa48140860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:07.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa46a00640 1 --2- 172.21.15.175:0/2645304530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa480712b0 0x7faa48140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:07.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa47400640 1 -- 172.21.15.175:0/2645304530 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa480cfb60 msgr2=0x7faa48140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:07.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa47400640 1 --2- 172.21.15.175:0/2645304530 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa480cfb60 0x7faa48140860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:07.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa47400640 1 -- 172.21.15.175:0/2645304530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa480712b0 msgr2=0x7faa48140320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:07.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa47400640 1 --2- 172.21.15.175:0/2645304530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa480712b0 0x7faa48140320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:07.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa47400640 1 -- 172.21.15.175:0/2645304530 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa481f7850 con 0x7faa4806d860 2024-04-25T09:08:07.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa47e00640 1 --2- 172.21.15.175:0/2645304530 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa480cfb60 0x7faa48140860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:07.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa47400640 1 --2- 172.21.15.175:0/2645304530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4806d860 0x7faa4813d150 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7faa3800c3c0 tx=0x7faa3800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:07.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa3f400640 1 -- 172.21.15.175:0/2645304530 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38017070 con 0x7faa4806d860 2024-04-25T09:08:07.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa3f400640 1 -- 172.21.15.175:0/2645304530 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa38005cf0 con 0x7faa4806d860 2024-04-25T09:08:07.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa3f400640 1 -- 172.21.15.175:0/2645304530 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa380072f0 con 0x7faa4806d860 2024-04-25T09:08:07.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa4e400640 1 -- 172.21.15.175:0/2645304530 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa481f7b30 con 0x7faa4806d860 2024-04-25T09:08:07.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa4e400640 1 -- 172.21.15.175:0/2645304530 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa481413c0 con 0x7faa4806d860 2024-04-25T09:08:07.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa4e400640 1 -- 172.21.15.175:0/2645304530 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa48075160 con 0x7faa4806d860 2024-04-25T09:08:07.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.040+0000 7faa3f400640 1 -- 172.21.15.175:0/2645304530 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faa3801a070 con 0x7faa4806d860 2024-04-25T09:08:07.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.044+0000 7faa3f400640 1 --2- 172.21.15.175:0/2645304530 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faa28066f60 0x7faa28069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:07.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.044+0000 7faa3f400640 1 -- 172.21.15.175:0/2645304530 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5795+0+0 (secure 0 0 0) 0x7faa38084530 con 0x7faa4806d860 2024-04-25T09:08:07.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.044+0000 7faa46a00640 1 --2- 172.21.15.175:0/2645304530 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faa28066f60 0x7faa28069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:07.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.044+0000 7faa46a00640 1 --2- 172.21.15.175:0/2645304530 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faa28066f60 0x7faa28069420 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faa3400b930 tx=0x7faa34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:07.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.048+0000 7faa3f400640 1 -- 172.21.15.175:0/2645304530 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faa38055440 con 0x7faa4806d860 2024-04-25T09:08:07.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.200+0000 7faa4e400640 1 -- 172.21.15.175:0/2645304530 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faa4815f320 con 0x7faa4806d860 2024-04-25T09:08:07.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.940+0000 7faa3f400640 1 -- 172.21.15.175:0/2645304530 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v60) v1 ==== 181+0+0 (secure 0 0 0) 0x7faa38054d40 con 0x7faa4806d860 2024-04-25T09:08:07.932 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:08:07.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.944+0000 7faa4e400640 1 -- 172.21.15.175:0/2645304530 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faa28066f60 msgr2=0x7faa28069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:07.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.944+0000 7faa4e400640 1 --2- 172.21.15.175:0/2645304530 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faa28066f60 0x7faa28069420 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faa3400b930 tx=0x7faa34008040 comp rx=0 tx=0).stop 2024-04-25T09:08:07.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.944+0000 7faa4e400640 1 -- 172.21.15.175:0/2645304530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4806d860 msgr2=0x7faa4813d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:07.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.944+0000 7faa4e400640 1 --2- 172.21.15.175:0/2645304530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4806d860 0x7faa4813d150 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7faa3800c3c0 tx=0x7faa3800c880 comp rx=0 tx=0).stop 2024-04-25T09:08:07.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.944+0000 7faa4e400640 1 -- 172.21.15.175:0/2645304530 shutdown_connections 2024-04-25T09:08:07.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.944+0000 7faa4e400640 1 --2- 172.21.15.175:0/2645304530 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faa28066f60 0x7faa28069420 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:07.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.944+0000 7faa4e400640 1 --2- 172.21.15.175:0/2645304530 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa480cfb60 0x7faa48140860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:07.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.944+0000 7faa4e400640 1 --2- 172.21.15.175:0/2645304530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa480712b0 0x7faa48140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:07.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.944+0000 7faa4e400640 1 --2- 172.21.15.175:0/2645304530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa4806d860 0x7faa4813d150 secure :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7faa3800c3c0 tx=0x7faa3800c880 comp rx=0 tx=0).stop 2024-04-25T09:08:07.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.944+0000 7faa4e400640 1 -- 172.21.15.175:0/2645304530 >> 172.21.15.175:0/2645304530 conn(0x7faa4806ac50 msgr2=0x7faa480741d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:07.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.944+0000 7faa4e400640 1 -- 172.21.15.175:0/2645304530 shutdown_connections 2024-04-25T09:08:07.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:07.944+0000 7faa4e400640 1 -- 172.21.15.175:0/2645304530 wait complete. 2024-04-25T09:08:07.957 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:08:08.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.108+0000 7f479aa00640 1 Processor -- start 2024-04-25T09:08:08.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.108+0000 7f479aa00640 1 -- start start 2024-04-25T09:08:08.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.108+0000 7f479aa00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f47940c59b0 0x7f47940c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:08.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.108+0000 7f479aa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f479406d240 0x7f479406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:08.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.108+0000 7f479aa00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479415f400 con 0x7f47940ce340 2024-04-25T09:08:08.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.108+0000 7f479aa00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4794160010 con 0x7f47940c59b0 2024-04-25T09:08:08.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.108+0000 7f479aa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479415f6e0 con 0x7f479406d240 2024-04-25T09:08:08.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.108+0000 7f4798c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f47940c59b0 0x7f47940c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:08.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.108+0000 7f4799600640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f47940ce340 0x7f47940ce720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:51414/0 (socket says 172.21.15.175:51414) 2024-04-25T09:08:08.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.108+0000 7f4799600640 1 -- 172.21.15.175:0/3728443796 learned_addr learned my addr 172.21.15.175:0/3728443796 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:08.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.108+0000 7f479a000640 1 --2- 172.21.15.175:0/3728443796 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f479406d240 0x7f479406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:08.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.108+0000 7f4798c00640 1 -- 172.21.15.175:0/3728443796 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f479406d240 msgr2=0x7f479406d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:08.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.108+0000 7f4798c00640 1 --2- 172.21.15.175:0/3728443796 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f479406d240 0x7f479406d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:08.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.108+0000 7f4798c00640 1 -- 172.21.15.175:0/3728443796 >> v1:172.21.15.177:6789/0 conn(0x7f47940ce340 legacy=0x7f47940ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:08.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.108+0000 7f4798c00640 1 -- 172.21.15.175:0/3728443796 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479415f9c0 con 0x7f47940c59b0 2024-04-25T09:08:08.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.108+0000 7f4793e00640 1 -- 172.21.15.175:0/3728443796 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703918313 0 0) 0x7f479415f400 con 0x7f47940ce340 2024-04-25T09:08:08.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.112+0000 7f4798c00640 1 --2- 172.21.15.175:0/3728443796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47940c59b0 0x7f47940c5e10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f47800097c0 tx=0x7f478001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e89e1e3429c504 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:08.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.112+0000 7f4793e00640 1 -- 172.21.15.175:0/3728443796 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47800aa5f0 con 0x7f47940c59b0 2024-04-25T09:08:08.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.112+0000 7f4793e00640 1 -- 172.21.15.175:0/3728443796 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47800af070 con 0x7f47940c59b0 2024-04-25T09:08:08.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.112+0000 7f4793e00640 1 -- 172.21.15.175:0/3728443796 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47800aa9b0 con 0x7f47940c59b0 2024-04-25T09:08:08.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.112+0000 7f479aa00640 1 -- 172.21.15.175:0/3728443796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47940c59b0 msgr2=0x7f47940c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:08.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.112+0000 7f479aa00640 1 --2- 172.21.15.175:0/3728443796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47940c59b0 0x7f47940c5e10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f47800097c0 tx=0x7f478001c470 comp rx=0 tx=0).stop 2024-04-25T09:08:08.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.112+0000 7f479aa00640 1 -- 172.21.15.175:0/3728443796 shutdown_connections 2024-04-25T09:08:08.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.112+0000 7f479aa00640 1 --2- 172.21.15.175:0/3728443796 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f479406d240 0x7f479406d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:08.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.112+0000 7f479aa00640 1 --2- 172.21.15.175:0/3728443796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47940c59b0 0x7f47940c5e10 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:08.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.112+0000 7f479aa00640 1 -- 172.21.15.175:0/3728443796 >> 172.21.15.175:0/3728443796 conn(0x7f479406ac50 msgr2=0x7f479406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:08.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.112+0000 7f479aa00640 1 -- 172.21.15.175:0/3728443796 shutdown_connections 2024-04-25T09:08:08.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.112+0000 7f479aa00640 1 -- 172.21.15.175:0/3728443796 wait complete. 2024-04-25T09:08:08.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.112+0000 7f479aa00640 1 Processor -- start 2024-04-25T09:08:08.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.112+0000 7f479aa00640 1 -- start start 2024-04-25T09:08:08.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f479aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f479406d240 0x7f479415ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:08.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f479aa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47940c59b0 0x7f47940b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:08.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f479aa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f47940ce340 0x7f47940b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:08.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f479aa00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47941687a0 con 0x7f479406d240 2024-04-25T09:08:08.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f479aa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4794168920 con 0x7f47940c59b0 2024-04-25T09:08:08.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f479aa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4794168aa0 con 0x7f47940ce340 2024-04-25T09:08:08.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f4799600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f479406d240 0x7f479415ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:08.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f4799600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f479406d240 0x7f479415ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37480/0 (socket says 172.21.15.175:37480) 2024-04-25T09:08:08.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f4799600640 1 -- 172.21.15.175:0/3737118585 learned_addr learned my addr 172.21.15.175:0/3737118585 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:08.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f479a000640 1 --2- 172.21.15.175:0/3737118585 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f47940ce340 0x7f47940b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:08.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f4798c00640 1 --2- 172.21.15.175:0/3737118585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47940c59b0 0x7f47940b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:08.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f4799600640 1 -- 172.21.15.175:0/3737118585 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f47940ce340 msgr2=0x7f47940b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:08.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f4799600640 1 --2- 172.21.15.175:0/3737118585 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f47940ce340 0x7f47940b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:08.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f4799600640 1 -- 172.21.15.175:0/3737118585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47940c59b0 msgr2=0x7f47940b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:08.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f4799600640 1 --2- 172.21.15.175:0/3737118585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47940c59b0 0x7f47940b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:08.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f4799600640 1 -- 172.21.15.175:0/3737118585 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4794164eb0 con 0x7f479406d240 2024-04-25T09:08:08.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f4799600640 1 --2- 172.21.15.175:0/3737118585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f479406d240 0x7f479415ad70 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f478800c480 tx=0x7f478800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:08.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f4791600640 1 -- 172.21.15.175:0/3737118585 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788018070 con 0x7f479406d240 2024-04-25T09:08:08.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f4791600640 1 -- 172.21.15.175:0/3737118585 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4788007500 con 0x7f479406d240 2024-04-25T09:08:08.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f4791600640 1 -- 172.21.15.175:0/3737118585 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788004a30 con 0x7f479406d240 2024-04-25T09:08:08.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f479aa00640 1 -- 172.21.15.175:0/3737118585 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4794165190 con 0x7f479406d240 2024-04-25T09:08:08.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f479aa00640 1 -- 172.21.15.175:0/3737118585 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4794165750 con 0x7f479406d240 2024-04-25T09:08:08.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f479aa00640 1 -- 172.21.15.175:0/3737118585 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479406bbe0 con 0x7f479406d240 2024-04-25T09:08:08.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.116+0000 7f4791600640 1 -- 172.21.15.175:0/3737118585 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f478801b070 con 0x7f479406d240 2024-04-25T09:08:08.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.120+0000 7f4791600640 1 --2- 172.21.15.175:0/3737118585 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4774066f60 0x7f4774069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:08.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.120+0000 7f4791600640 1 -- 172.21.15.175:0/3737118585 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f4788084200 con 0x7f479406d240 2024-04-25T09:08:08.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.120+0000 7f4798c00640 1 --2- 172.21.15.175:0/3737118585 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4774066f60 0x7f4774069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:08.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.120+0000 7f4798c00640 1 --2- 172.21.15.175:0/3737118585 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4774066f60 0x7f4774069420 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f47800ae000 tx=0x7f47800a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:08.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.124+0000 7f4791600640 1 -- 172.21.15.175:0/3737118585 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4788054d10 con 0x7f479406d240 2024-04-25T09:08:08.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.284+0000 7f479aa00640 1 -- 172.21.15.175:0/3737118585 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4794074a60 con 0x7f479406d240 2024-04-25T09:08:08.818 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:08:08.822 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:08:08.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.944+0000 7f4791600640 1 -- 172.21.15.175:0/3737118585 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v61) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4788058db0 con 0x7f479406d240 2024-04-25T09:08:08.934 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_data' removed 2024-04-25T09:08:08.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.948+0000 7f479aa00640 1 -- 172.21.15.175:0/3737118585 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4774066f60 msgr2=0x7f4774069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:08.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.948+0000 7f479aa00640 1 --2- 172.21.15.175:0/3737118585 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4774066f60 0x7f4774069420 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f47800ae000 tx=0x7f47800a7000 comp rx=0 tx=0).stop 2024-04-25T09:08:08.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.948+0000 7f479aa00640 1 -- 172.21.15.175:0/3737118585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f479406d240 msgr2=0x7f479415ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:08.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.948+0000 7f479aa00640 1 --2- 172.21.15.175:0/3737118585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f479406d240 0x7f479415ad70 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f478800c480 tx=0x7f478800c940 comp rx=0 tx=0).stop 2024-04-25T09:08:08.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.948+0000 7f479aa00640 1 -- 172.21.15.175:0/3737118585 shutdown_connections 2024-04-25T09:08:08.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.948+0000 7f479aa00640 1 --2- 172.21.15.175:0/3737118585 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4774066f60 0x7f4774069420 secure :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f47800ae000 tx=0x7f47800a7000 comp rx=0 tx=0).stop 2024-04-25T09:08:08.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.948+0000 7f479aa00640 1 --2- 172.21.15.175:0/3737118585 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f47940ce340 0x7f47940b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:08.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.948+0000 7f479aa00640 1 --2- 172.21.15.175:0/3737118585 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47940c59b0 0x7f47940b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:08.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.948+0000 7f479aa00640 1 --2- 172.21.15.175:0/3737118585 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f479406d240 0x7f479415ad70 secure :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f478800c480 tx=0x7f478800c940 comp rx=0 tx=0).stop 2024-04-25T09:08:08.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.948+0000 7f479aa00640 1 -- 172.21.15.175:0/3737118585 >> 172.21.15.175:0/3737118585 conn(0x7f479406ac50 msgr2=0x7f4794143750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:08.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.948+0000 7f479aa00640 1 -- 172.21.15.175:0/3737118585 shutdown_connections 2024-04-25T09:08:08.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:08.948+0000 7f479aa00640 1 -- 172.21.15.175:0/3737118585 wait complete. 2024-04-25T09:08:08.963 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:08:09.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a62c00640 1 Processor -- start 2024-04-25T09:08:09.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a62c00640 1 -- start start 2024-04-25T09:08:09.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a62c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5c145250 0x7f5a5c0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:09.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a62c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5a5c1600a0 0x7f5a5c0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:09.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a62c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5a5c0ce970 0x7f5a5c0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:09.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a62c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a5c15f650 con 0x7f5a5c0ce970 2024-04-25T09:08:09.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a62c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a5c0cfd10 con 0x7f5a5c1600a0 2024-04-25T09:08:09.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a62c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c0cfff0 con 0x7f5a5c145250 2024-04-25T09:08:09.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a60c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5a5c0ce970 0x7f5a5c0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:09.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a60c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5a5c0ce970 0x7f5a5c0cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37494/0 (socket says 172.21.15.175:37494) 2024-04-25T09:08:09.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a60c00640 1 -- 172.21.15.175:0/2785136659 learned_addr learned my addr 172.21.15.175:0/2785136659 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:09.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a5be00640 1 --2- 172.21.15.175:0/2785136659 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5c145250 0x7f5a5c0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:09.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a53400640 1 --2- 172.21.15.175:0/2785136659 >> v2:172.21.15.177:3300/0 conn(0x7f5a5c1600a0 0x7f5a5c0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:09.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a60c00640 1 -- 172.21.15.175:0/2785136659 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5c145250 msgr2=0x7f5a5c0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:09.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a60c00640 1 --2- 172.21.15.175:0/2785136659 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5c145250 0x7f5a5c0cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a60c00640 1 -- 172.21.15.175:0/2785136659 >> v2:172.21.15.177:3300/0 conn(0x7f5a5c1600a0 msgr2=0x7f5a5c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:09.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a60c00640 1 --2- 172.21.15.175:0/2785136659 >> v2:172.21.15.177:3300/0 conn(0x7f5a5c1600a0 0x7f5a5c0cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a60c00640 1 -- 172.21.15.175:0/2785136659 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c15f8a0 con 0x7f5a5c0ce970 2024-04-25T09:08:09.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.116+0000 7f5a53400640 1 --2- 172.21.15.175:0/2785136659 >> v2:172.21.15.177:3300/0 conn(0x7f5a5c1600a0 0x7f5a5c0cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:09.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.120+0000 7f5a60c00640 1 --2- 172.21.15.175:0/2785136659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a5c0ce970 0x7f5a5c0cee00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c06bbe0 tx=0x7f5a5401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd1b3be0198d2dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:09.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.120+0000 7f5a5b400640 1 -- 172.21.15.175:0/2785136659 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a540aa430 con 0x7f5a5c0ce970 2024-04-25T09:08:09.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.120+0000 7f5a5b400640 1 -- 172.21.15.175:0/2785136659 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a540af070 con 0x7f5a5c0ce970 2024-04-25T09:08:09.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.120+0000 7f5a5b400640 1 -- 172.21.15.175:0/2785136659 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a540aa7f0 con 0x7f5a5c0ce970 2024-04-25T09:08:09.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.120+0000 7f5a62c00640 1 -- 172.21.15.175:0/2785136659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a5c0ce970 msgr2=0x7f5a5c0cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:09.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.120+0000 7f5a62c00640 1 --2- 172.21.15.175:0/2785136659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a5c0ce970 0x7f5a5c0cee00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c06bbe0 tx=0x7f5a5401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.120+0000 7f5a62c00640 1 -- 172.21.15.175:0/2785136659 shutdown_connections 2024-04-25T09:08:09.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.120+0000 7f5a62c00640 1 --2- 172.21.15.175:0/2785136659 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a5c0ce970 0x7f5a5c0cee00 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.120+0000 7f5a62c00640 1 --2- 172.21.15.175:0/2785136659 >> v2:172.21.15.177:3300/0 conn(0x7f5a5c1600a0 0x7f5a5c0cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.120+0000 7f5a62c00640 1 --2- 172.21.15.175:0/2785136659 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5c145250 0x7f5a5c0cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.120+0000 7f5a62c00640 1 -- 172.21.15.175:0/2785136659 >> 172.21.15.175:0/2785136659 conn(0x7f5a5c06ac50 msgr2=0x7f5a5c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:09.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.120+0000 7f5a62c00640 1 -- 172.21.15.175:0/2785136659 shutdown_connections 2024-04-25T09:08:09.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.120+0000 7f5a62c00640 1 -- 172.21.15.175:0/2785136659 wait complete. 2024-04-25T09:08:09.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a62c00640 1 Processor -- start 2024-04-25T09:08:09.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a62c00640 1 -- start start 2024-04-25T09:08:09.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a62c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a5c0ce970 0x7f5a5c164b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:09.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a62c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5c145250 0x7f5a5c1650d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:09.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a62c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a5c1600a0 0x7f5a5c0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:09.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a62c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c160480 con 0x7f5a5c0ce970 2024-04-25T09:08:09.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a62c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c145630 con 0x7f5a5c1600a0 2024-04-25T09:08:09.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a62c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c160600 con 0x7f5a5c145250 2024-04-25T09:08:09.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a5be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a5c0ce970 0x7f5a5c164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:09.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a5be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a5c0ce970 0x7f5a5c164b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37508/0 (socket says 172.21.15.175:37508) 2024-04-25T09:08:09.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a5be00640 1 -- 172.21.15.175:0/2773810431 learned_addr learned my addr 172.21.15.175:0/2773810431 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:09.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a60c00640 1 --2- 172.21.15.175:0/2773810431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a5c1600a0 0x7f5a5c0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:09.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a53400640 1 --2- 172.21.15.175:0/2773810431 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5c145250 0x7f5a5c1650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:09.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a5be00640 1 -- 172.21.15.175:0/2773810431 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5c145250 msgr2=0x7f5a5c1650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:09.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a5be00640 1 --2- 172.21.15.175:0/2773810431 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5c145250 0x7f5a5c1650d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a5be00640 1 -- 172.21.15.175:0/2773810431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a5c1600a0 msgr2=0x7f5a5c0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:09.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a5be00640 1 --2- 172.21.15.175:0/2773810431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a5c1600a0 0x7f5a5c0b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a5be00640 1 -- 172.21.15.175:0/2773810431 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c0b2890 con 0x7f5a5c0ce970 2024-04-25T09:08:09.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a5be00640 1 --2- 172.21.15.175:0/2773810431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a5c0ce970 0x7f5a5c164b90 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00eed0 tx=0x7f5a4c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:09.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a58c00640 1 -- 172.21.15.175:0/2773810431 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c018020 con 0x7f5a5c0ce970 2024-04-25T09:08:09.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a58c00640 1 -- 172.21.15.175:0/2773810431 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4c014400 con 0x7f5a5c0ce970 2024-04-25T09:08:09.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a58c00640 1 -- 172.21.15.175:0/2773810431 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c0147d0 con 0x7f5a5c0ce970 2024-04-25T09:08:09.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a62c00640 1 -- 172.21.15.175:0/2773810431 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a5c0b2b70 con 0x7f5a5c0ce970 2024-04-25T09:08:09.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a62c00640 1 -- 172.21.15.175:0/2773810431 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5c0b3130 con 0x7f5a5c0ce970 2024-04-25T09:08:09.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.124+0000 7f5a62c00640 1 -- 172.21.15.175:0/2773810431 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a5c075160 con 0x7f5a5c0ce970 2024-04-25T09:08:09.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.128+0000 7f5a58c00640 1 -- 172.21.15.175:0/2773810431 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5a4c01b020 con 0x7f5a5c0ce970 2024-04-25T09:08:09.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.128+0000 7f5a58c00640 1 --2- 172.21.15.175:0/2773810431 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5a38066f60 0x7f5a38069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:09.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.128+0000 7f5a58c00640 1 -- 172.21.15.175:0/2773810431 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5a4c085260 con 0x7f5a5c0ce970 2024-04-25T09:08:09.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.128+0000 7f5a53400640 1 --2- 172.21.15.175:0/2773810431 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5a38066f60 0x7f5a38069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:09.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.128+0000 7f5a53400640 1 --2- 172.21.15.175:0/2773810431 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5a38066f60 0x7f5a38069420 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c144c50 tx=0x7f5a44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:09.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.132+0000 7f5a58c00640 1 -- 172.21.15.175:0/2773810431 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5a4c022070 con 0x7f5a5c0ce970 2024-04-25T09:08:09.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.292+0000 7f5a62c00640 1 -- 172.21.15.175:0/2773810431 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5a5c0b24d0 con 0x7f5a5c0ce970 2024-04-25T09:08:09.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.296+0000 7f5a58c00640 1 -- 172.21.15.175:0/2773810431 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5a4c055f10 con 0x7f5a5c0ce970 2024-04-25T09:08:09.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.296+0000 7f5a62c00640 1 -- 172.21.15.175:0/2773810431 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5a38066f60 msgr2=0x7f5a38069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:09.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.296+0000 7f5a62c00640 1 --2- 172.21.15.175:0/2773810431 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5a38066f60 0x7f5a38069420 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c144c50 tx=0x7f5a44008040 comp rx=0 tx=0).stop 2024-04-25T09:08:09.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.296+0000 7f5a62c00640 1 -- 172.21.15.175:0/2773810431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a5c0ce970 msgr2=0x7f5a5c164b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:09.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.296+0000 7f5a62c00640 1 --2- 172.21.15.175:0/2773810431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a5c0ce970 0x7f5a5c164b90 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00eed0 tx=0x7f5a4c00b480 comp rx=0 tx=0).stop 2024-04-25T09:08:09.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.296+0000 7f5a62c00640 1 -- 172.21.15.175:0/2773810431 shutdown_connections 2024-04-25T09:08:09.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.296+0000 7f5a62c00640 1 --2- 172.21.15.175:0/2773810431 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5a38066f60 0x7f5a38069420 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.296+0000 7f5a62c00640 1 --2- 172.21.15.175:0/2773810431 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a5c1600a0 0x7f5a5c0b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.296+0000 7f5a62c00640 1 --2- 172.21.15.175:0/2773810431 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a5c145250 0x7f5a5c1650d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.296+0000 7f5a62c00640 1 --2- 172.21.15.175:0/2773810431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a5c0ce970 0x7f5a5c164b90 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.296+0000 7f5a62c00640 1 -- 172.21.15.175:0/2773810431 >> 172.21.15.175:0/2773810431 conn(0x7f5a5c06ac50 msgr2=0x7f5a5c0b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:09.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.296+0000 7f5a62c00640 1 -- 172.21.15.175:0/2773810431 shutdown_connections 2024-04-25T09:08:09.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.296+0000 7f5a62c00640 1 -- 172.21.15.175:0/2773810431 wait complete. 2024-04-25T09:08:09.305 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-04-25T09:08:09.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.452+0000 7f6746c00640 1 Processor -- start 2024-04-25T09:08:09.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.452+0000 7f6746c00640 1 -- start start 2024-04-25T09:08:09.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.452+0000 7f6746c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6740099a50 0x7f67400cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:09.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.452+0000 7f6746c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f674015bc10 0x7f6740099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:09.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.452+0000 7f6746c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f674009a370 con 0x7f674009abb0 2024-04-25T09:08:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.452+0000 7f6746c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67400d06f0 con 0x7f6740099a50 2024-04-25T09:08:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.452+0000 7f6746c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67400cc4c0 con 0x7f674015bc10 2024-04-25T09:08:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.452+0000 7f6744c00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f674009abb0 0x7f67400cfdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:52468/0 (socket says 172.21.15.175:52468) 2024-04-25T09:08:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.452+0000 7f673fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6740099a50 0x7f67400cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.452+0000 7f6744c00640 1 -- 172.21.15.175:0/2259284647 learned_addr learned my addr 172.21.15.175:0/2259284647 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.452+0000 7f673f400640 1 --2- 172.21.15.175:0/2259284647 >> v2:172.21.15.177:3300/0 conn(0x7f674015bc10 0x7f6740099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.452+0000 7f673fe00640 1 -- 172.21.15.175:0/2259284647 >> v2:172.21.15.177:3300/0 conn(0x7f674015bc10 msgr2=0x7f6740099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.452+0000 7f673fe00640 1 --2- 172.21.15.175:0/2259284647 >> v2:172.21.15.177:3300/0 conn(0x7f674015bc10 0x7f6740099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.452+0000 7f673fe00640 1 -- 172.21.15.175:0/2259284647 >> v1:172.21.15.175:6789/0 conn(0x7f674009abb0 legacy=0x7f67400cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:09.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.452+0000 7f673fe00640 1 -- 172.21.15.175:0/2259284647 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67400cc7a0 con 0x7f6740099a50 2024-04-25T09:08:09.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.456+0000 7f673fe00640 1 --2- 172.21.15.175:0/2259284647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6740099a50 0x7f67400cd280 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f674009a6a0 tx=0x7f673001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa928303e768be51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:09.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.456+0000 7f673ea00640 1 -- 172.21.15.175:0/2259284647 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67300b1070 con 0x7f6740099a50 2024-04-25T09:08:09.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.456+0000 7f673ea00640 1 -- 172.21.15.175:0/2259284647 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67300ac5f0 con 0x7f6740099a50 2024-04-25T09:08:09.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.456+0000 7f673ea00640 1 -- 172.21.15.175:0/2259284647 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67300ac9c0 con 0x7f6740099a50 2024-04-25T09:08:09.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.456+0000 7f6746c00640 1 -- 172.21.15.175:0/2259284647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6740099a50 msgr2=0x7f67400cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:09.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.456+0000 7f6746c00640 1 --2- 172.21.15.175:0/2259284647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6740099a50 0x7f67400cd280 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f674009a6a0 tx=0x7f673001c480 comp rx=0 tx=0).stop 2024-04-25T09:08:09.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.456+0000 7f6746c00640 1 -- 172.21.15.175:0/2259284647 shutdown_connections 2024-04-25T09:08:09.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.456+0000 7f6746c00640 1 --2- 172.21.15.175:0/2259284647 >> v2:172.21.15.177:3300/0 conn(0x7f674015bc10 0x7f6740099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.456+0000 7f6746c00640 1 --2- 172.21.15.175:0/2259284647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6740099a50 0x7f67400cd280 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.456+0000 7f6746c00640 1 -- 172.21.15.175:0/2259284647 >> 172.21.15.175:0/2259284647 conn(0x7f67400b3300 msgr2=0x7f67400b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:09.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.456+0000 7f6746c00640 1 -- 172.21.15.175:0/2259284647 shutdown_connections 2024-04-25T09:08:09.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.456+0000 7f6746c00640 1 -- 172.21.15.175:0/2259284647 wait complete. 2024-04-25T09:08:09.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f6746c00640 1 Processor -- start 2024-04-25T09:08:09.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f6746c00640 1 -- start start 2024-04-25T09:08:09.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f6746c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6740099a50 0x7f67400b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:09.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f6746c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f674009abb0 0x7f674014a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:09.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f6746c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f674015bc10 0x7f67400b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:09.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f6746c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67400c5f00 con 0x7f674009abb0 2024-04-25T09:08:09.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f6746c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67400c5d80 con 0x7f6740099a50 2024-04-25T09:08:09.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f6746c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6740168850 con 0x7f674015bc10 2024-04-25T09:08:09.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f673f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f674009abb0 0x7f674014a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:09.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f673f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f674009abb0 0x7f674014a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41358/0 (socket says 172.21.15.175:41358) 2024-04-25T09:08:09.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f673f400640 1 -- 172.21.15.175:0/151770603 learned_addr learned my addr 172.21.15.175:0/151770603 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:09.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f6744c00640 1 --2- 172.21.15.175:0/151770603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f674015bc10 0x7f67400b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:09.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f673fe00640 1 --2- 172.21.15.175:0/151770603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6740099a50 0x7f67400b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:09.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f673f400640 1 -- 172.21.15.175:0/151770603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f674015bc10 msgr2=0x7f67400b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:09.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f673f400640 1 --2- 172.21.15.175:0/151770603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f674015bc10 0x7f67400b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f673f400640 1 -- 172.21.15.175:0/151770603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6740099a50 msgr2=0x7f67400b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:09.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f673f400640 1 --2- 172.21.15.175:0/151770603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6740099a50 0x7f67400b6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f673f400640 1 -- 172.21.15.175:0/151770603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67400cb5a0 con 0x7f674009abb0 2024-04-25T09:08:09.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f673fe00640 1 --2- 172.21.15.175:0/151770603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6740099a50 0x7f67400b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:09.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f6744c00640 1 --2- 172.21.15.175:0/151770603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f674015bc10 0x7f67400b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:09.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f673f400640 1 --2- 172.21.15.175:0/151770603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f674009abb0 0x7f674014a4e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f672c00d5f0 tx=0x7f672c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:09.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f6737e00640 1 -- 172.21.15.175:0/151770603 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0125f0 con 0x7f674009abb0 2024-04-25T09:08:09.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f6737e00640 1 -- 172.21.15.175:0/151770603 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c019070 con 0x7f674009abb0 2024-04-25T09:08:09.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f6737e00640 1 -- 172.21.15.175:0/151770603 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0129b0 con 0x7f674009abb0 2024-04-25T09:08:09.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f6746c00640 1 -- 172.21.15.175:0/151770603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6740149a00 con 0x7f674009abb0 2024-04-25T09:08:09.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.460+0000 7f6746c00640 1 -- 172.21.15.175:0/151770603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6740149fc0 con 0x7f674009abb0 2024-04-25T09:08:09.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.464+0000 7f6746c00640 1 -- 172.21.15.175:0/151770603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6740074a60 con 0x7f674009abb0 2024-04-25T09:08:09.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.464+0000 7f6737e00640 1 -- 172.21.15.175:0/151770603 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f672c012b50 con 0x7f674009abb0 2024-04-25T09:08:09.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.464+0000 7f6737e00640 1 --2- 172.21.15.175:0/151770603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6720066f90 0x7f6720069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:09.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.464+0000 7f6737e00640 1 -- 172.21.15.175:0/151770603 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f672c085090 con 0x7f674009abb0 2024-04-25T09:08:09.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.464+0000 7f673fe00640 1 --2- 172.21.15.175:0/151770603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6720066f90 0x7f6720069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:09.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.464+0000 7f673fe00640 1 --2- 172.21.15.175:0/151770603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6720066f90 0x7f6720069450 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f67300ae000 tx=0x7f67300a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:09.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.468+0000 7f6737e00640 1 -- 172.21.15.175:0/151770603 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f672c056410 con 0x7f674009abb0 2024-04-25T09:08:09.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.676+0000 7f6746c00640 1 -- 172.21.15.175:0/151770603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7f67400cdc40 con 0x7f674009abb0 2024-04-25T09:08:09.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.952+0000 7f6737e00640 1 -- 172.21.15.175:0/151770603 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v219) v1 ==== 169+0+0 (secure 0 0 0) 0x7f672c055d10 con 0x7f674009abb0 2024-04-25T09:08:09.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.956+0000 7f6746c00640 1 -- 172.21.15.175:0/151770603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6720066f90 msgr2=0x7f6720069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:09.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.956+0000 7f6746c00640 1 --2- 172.21.15.175:0/151770603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6720066f90 0x7f6720069450 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f67300ae000 tx=0x7f67300a7000 comp rx=0 tx=0).stop 2024-04-25T09:08:09.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.956+0000 7f6746c00640 1 -- 172.21.15.175:0/151770603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f674009abb0 msgr2=0x7f674014a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:09.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.956+0000 7f6746c00640 1 --2- 172.21.15.175:0/151770603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f674009abb0 0x7f674014a4e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f672c00d5f0 tx=0x7f672c00dab0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.956+0000 7f6746c00640 1 -- 172.21.15.175:0/151770603 shutdown_connections 2024-04-25T09:08:09.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.956+0000 7f6746c00640 1 --2- 172.21.15.175:0/151770603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6720066f90 0x7f6720069450 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.956+0000 7f6746c00640 1 --2- 172.21.15.175:0/151770603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f674015bc10 0x7f67400b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.956+0000 7f6746c00640 1 --2- 172.21.15.175:0/151770603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f674009abb0 0x7f674014a4e0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.956+0000 7f6746c00640 1 --2- 172.21.15.175:0/151770603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6740099a50 0x7f67400b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:09.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.956+0000 7f6746c00640 1 -- 172.21.15.175:0/151770603 >> 172.21.15.175:0/151770603 conn(0x7f67400b3300 msgr2=0x7f67400c6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:09.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.956+0000 7f6746c00640 1 -- 172.21.15.175:0/151770603 shutdown_connections 2024-04-25T09:08:09.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:09.956+0000 7f6746c00640 1 -- 172.21.15.175:0/151770603 wait complete. 2024-04-25T09:08:09.965 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-25T09:08:09.965 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-25T09:08:09.965 INFO:tasks.cephfs_test_runner:test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:08:09.965 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:08:10.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f770bc00640 1 Processor -- start 2024-04-25T09:08:10.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f770bc00640 1 -- start start 2024-04-25T09:08:10.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f770bc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7704144fc0 0x7f77040cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f770bc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77041453a0 0x7f770415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f770bc00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f77040cc3b0 0x7f770415c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f770bc00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770415cd00 con 0x7f7704144fc0 2024-04-25T09:08:10.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f770bc00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77040ce660 con 0x7f77040cc3b0 2024-04-25T09:08:10.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f770bc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77040cc930 con 0x7f77041453a0 2024-04-25T09:08:10.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f7709200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7704144fc0 0x7f77040cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f7709200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7704144fc0 0x7f77040cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41368/0 (socket says 172.21.15.175:41368) 2024-04-25T09:08:10.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f7709200640 1 -- 172.21.15.175:0/1370511326 learned_addr learned my addr 172.21.15.175:0/1370511326 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:10.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f76fbe00640 1 --2- 172.21.15.175:0/1370511326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77041453a0 0x7f770415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f7709c00640 1 --2- 172.21.15.175:0/1370511326 >> v2:172.21.15.177:3300/0 conn(0x7f77040cc3b0 0x7f770415c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f7709200640 1 -- 172.21.15.175:0/1370511326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77041453a0 msgr2=0x7f770415bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:10.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f7709200640 1 --2- 172.21.15.175:0/1370511326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77041453a0 0x7f770415bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f7709200640 1 -- 172.21.15.175:0/1370511326 >> v2:172.21.15.177:3300/0 conn(0x7f77040cc3b0 msgr2=0x7f770415c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:10.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f7709200640 1 --2- 172.21.15.175:0/1370511326 >> v2:172.21.15.177:3300/0 conn(0x7f77040cc3b0 0x7f770415c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f7709200640 1 -- 172.21.15.175:0/1370511326 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77040ccc10 con 0x7f7704144fc0 2024-04-25T09:08:10.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.112+0000 7f76fbe00640 1 --2- 172.21.15.175:0/1370511326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77041453a0 0x7f770415bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:10.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.116+0000 7f7709200640 1 --2- 172.21.15.175:0/1370511326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7704144fc0 0x7f77040cbe70 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f770406f610 tx=0x7f76f401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5234feb7e1ab241c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:10.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.116+0000 7f7703e00640 1 -- 172.21.15.175:0/1370511326 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f40ab5f0 con 0x7f7704144fc0 2024-04-25T09:08:10.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.116+0000 7f7703e00640 1 -- 172.21.15.175:0/1370511326 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f40b0070 con 0x7f7704144fc0 2024-04-25T09:08:10.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.116+0000 7f7703e00640 1 -- 172.21.15.175:0/1370511326 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f40ab9b0 con 0x7f7704144fc0 2024-04-25T09:08:10.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.116+0000 7f770bc00640 1 -- 172.21.15.175:0/1370511326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7704144fc0 msgr2=0x7f77040cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:10.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.116+0000 7f770bc00640 1 --2- 172.21.15.175:0/1370511326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7704144fc0 0x7f77040cbe70 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f770406f610 tx=0x7f76f401c520 comp rx=0 tx=0).stop 2024-04-25T09:08:10.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.116+0000 7f770bc00640 1 -- 172.21.15.175:0/1370511326 shutdown_connections 2024-04-25T09:08:10.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.116+0000 7f770bc00640 1 --2- 172.21.15.175:0/1370511326 >> v2:172.21.15.177:3300/0 conn(0x7f77040cc3b0 0x7f770415c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.116+0000 7f770bc00640 1 --2- 172.21.15.175:0/1370511326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77041453a0 0x7f770415bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.116+0000 7f770bc00640 1 --2- 172.21.15.175:0/1370511326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7704144fc0 0x7f77040cbe70 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.116+0000 7f770bc00640 1 -- 172.21.15.175:0/1370511326 >> 172.21.15.175:0/1370511326 conn(0x7f7704067150 msgr2=0x7f770406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:10.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.116+0000 7f770bc00640 1 -- 172.21.15.175:0/1370511326 shutdown_connections 2024-04-25T09:08:10.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.116+0000 7f770bc00640 1 -- 172.21.15.175:0/1370511326 wait complete. 2024-04-25T09:08:10.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f770bc00640 1 Processor -- start 2024-04-25T09:08:10.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f770bc00640 1 -- start start 2024-04-25T09:08:10.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f770bc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7704144fc0 0x7f77040b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f770bc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77041453a0 0x7f77040b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f770bc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7704164c20 0x7f770413cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f770bc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7704160020 con 0x7f77041453a0 2024-04-25T09:08:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f770bc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770415fea0 con 0x7f7704164c20 2024-04-25T09:08:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f770bc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77041601a0 con 0x7f7704144fc0 2024-04-25T09:08:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f76fbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77041453a0 0x7f77040b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f76fbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77041453a0 0x7f77040b2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41372/0 (socket says 172.21.15.175:41372) 2024-04-25T09:08:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f76fbe00640 1 -- 172.21.15.175:0/3790168976 learned_addr learned my addr 172.21.15.175:0/3790168976 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f7709200640 1 --2- 172.21.15.175:0/3790168976 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7704144fc0 0x7f77040b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f7709c00640 1 --2- 172.21.15.175:0/3790168976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7704164c20 0x7f770413cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f76fbe00640 1 -- 172.21.15.175:0/3790168976 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7704144fc0 msgr2=0x7f77040b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f76fbe00640 1 --2- 172.21.15.175:0/3790168976 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7704144fc0 0x7f77040b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f76fbe00640 1 -- 172.21.15.175:0/3790168976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7704164c20 msgr2=0x7f770413cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f76fbe00640 1 --2- 172.21.15.175:0/3790168976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7704164c20 0x7f770413cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f76fbe00640 1 -- 172.21.15.175:0/3790168976 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77040b2d20 con 0x7f77041453a0 2024-04-25T09:08:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f76fbe00640 1 --2- 172.21.15.175:0/3790168976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77041453a0 0x7f77040b2680 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00d800 tx=0x7f76ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f7701600640 1 -- 172.21.15.175:0/3790168976 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec00b6c0 con 0x7f77041453a0 2024-04-25T09:08:10.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f7701600640 1 -- 172.21.15.175:0/3790168976 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ec019070 con 0x7f77041453a0 2024-04-25T09:08:10.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f770bc00640 1 -- 172.21.15.175:0/3790168976 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77040b3000 con 0x7f77041453a0 2024-04-25T09:08:10.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f7701600640 1 -- 172.21.15.175:0/3790168976 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec00ba60 con 0x7f77041453a0 2024-04-25T09:08:10.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.120+0000 7f770bc00640 1 -- 172.21.15.175:0/3790168976 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77040b35c0 con 0x7f77041453a0 2024-04-25T09:08:10.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.124+0000 7f770bc00640 1 -- 172.21.15.175:0/3790168976 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7704074a60 con 0x7f77041453a0 2024-04-25T09:08:10.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.124+0000 7f7701600640 1 -- 172.21.15.175:0/3790168976 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f76ec00bc00 con 0x7f77041453a0 2024-04-25T09:08:10.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.124+0000 7f7701600640 1 --2- 172.21.15.175:0/3790168976 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f76e0066f60 0x7f76e0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.124+0000 7f7701600640 1 -- 172.21.15.175:0/3790168976 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f76ec085100 con 0x7f77041453a0 2024-04-25T09:08:10.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.124+0000 7f7709200640 1 --2- 172.21.15.175:0/3790168976 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f76e0066f60 0x7f76e0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.124+0000 7f7709200640 1 --2- 172.21.15.175:0/3790168976 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f76e0066f60 0x7f76e0069420 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f76f40af000 tx=0x7f76f40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:10.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.128+0000 7f7701600640 1 -- 172.21.15.175:0/3790168976 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f76ec055c90 con 0x7f77041453a0 2024-04-25T09:08:10.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.284+0000 7f770bc00640 1 -- 172.21.15.175:0/3790168976 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f770406d930 con 0x7f77041453a0 2024-04-25T09:08:10.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.284+0000 7f7701600640 1 -- 172.21.15.175:0/3790168976 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+13058 (secure 0 0 0) 0x7f76ec059d30 con 0x7f77041453a0 2024-04-25T09:08:10.275 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:10.275 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":61,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:08:08.945535+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6837/1478147147":"2024-04-26T09:08:05.807085+0000","172.21.15.175:6836/1478147147":"2024-04-26T09:08:05.807085+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:08:10.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.288+0000 7f770bc00640 1 -- 172.21.15.175:0/3790168976 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f76e0066f60 msgr2=0x7f76e0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:10.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.288+0000 7f770bc00640 1 --2- 172.21.15.175:0/3790168976 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f76e0066f60 0x7f76e0069420 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f76f40af000 tx=0x7f76f40a7000 comp rx=0 tx=0).stop 2024-04-25T09:08:10.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.288+0000 7f770bc00640 1 -- 172.21.15.175:0/3790168976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77041453a0 msgr2=0x7f77040b2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:10.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.288+0000 7f770bc00640 1 --2- 172.21.15.175:0/3790168976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77041453a0 0x7f77040b2680 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00d800 tx=0x7f76ec00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.288+0000 7f770bc00640 1 -- 172.21.15.175:0/3790168976 shutdown_connections 2024-04-25T09:08:10.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.288+0000 7f770bc00640 1 --2- 172.21.15.175:0/3790168976 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f76e0066f60 0x7f76e0069420 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.288+0000 7f770bc00640 1 --2- 172.21.15.175:0/3790168976 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7704164c20 0x7f770413cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.288+0000 7f770bc00640 1 --2- 172.21.15.175:0/3790168976 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77041453a0 0x7f77040b2680 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.288+0000 7f770bc00640 1 --2- 172.21.15.175:0/3790168976 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7704144fc0 0x7f77040b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.288+0000 7f770bc00640 1 -- 172.21.15.175:0/3790168976 >> 172.21.15.175:0/3790168976 conn(0x7f77040cc3b0 msgr2=0x7f77040cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:10.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.288+0000 7f770bc00640 1 -- 172.21.15.175:0/3790168976 shutdown_connections 2024-04-25T09:08:10.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.288+0000 7f770bc00640 1 -- 172.21.15.175:0/3790168976 wait complete. 2024-04-25T09:08:10.297 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:08:10.298 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:08:10.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.444+0000 7f85fba00640 1 Processor -- start 2024-04-25T09:08:10.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.444+0000 7f85fba00640 1 -- start start 2024-04-25T09:08:10.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.448+0000 7f85fba00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85f4145250 0x7f85f40cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.448+0000 7f85fba00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f85f41600a0 0x7f85f40cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.448+0000 7f85fba00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f40cfd10 con 0x7f85f40ce970 2024-04-25T09:08:10.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.448+0000 7f85fba00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f415f650 con 0x7f85f41600a0 2024-04-25T09:08:10.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.448+0000 7f85fba00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f40cfff0 con 0x7f85f4145250 2024-04-25T09:08:10.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.448+0000 7f85ebe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f85f41600a0 0x7f85f40cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.448+0000 7f85f9000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85f4145250 0x7f85f40cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.448+0000 7f85f9a00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f85f40ce970 0x7f85f40cee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:58950/0 (socket says 172.21.15.175:58950) 2024-04-25T09:08:10.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.448+0000 7f85f9a00640 1 -- 172.21.15.175:0/2551821345 learned_addr learned my addr 172.21.15.175:0/2551821345 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:10.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.448+0000 7f85ebe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f85f41600a0 0x7f85f40cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:44454/0 (socket says 172.21.15.175:44454) 2024-04-25T09:08:10.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.448+0000 7f85ebe00640 1 -- 172.21.15.175:0/2551821345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85f4145250 msgr2=0x7f85f40cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:10.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.448+0000 7f85ebe00640 1 --2- 172.21.15.175:0/2551821345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85f4145250 0x7f85f40cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.448+0000 7f85ebe00640 1 -- 172.21.15.175:0/2551821345 >> v1:172.21.15.177:6789/0 conn(0x7f85f40ce970 legacy=0x7f85f40cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:10.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.448+0000 7f85ebe00640 1 -- 172.21.15.175:0/2551821345 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f415f8a0 con 0x7f85f41600a0 2024-04-25T09:08:10.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.448+0000 7f85f9000640 1 --2- 172.21.15.175:0/2551821345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85f4145250 0x7f85f40cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:08:10.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.452+0000 7f85ebe00640 1 --2- 172.21.15.175:0/2551821345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85f41600a0 0x7f85f40cc410 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0097c0 tx=0x7f85dc01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=563c52694b9d2e0d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:10.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.452+0000 7f85f3e00640 1 -- 172.21.15.175:0/2551821345 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0ab600 con 0x7f85f41600a0 2024-04-25T09:08:10.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.452+0000 7f85f3e00640 1 -- 172.21.15.175:0/2551821345 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc0b0070 con 0x7f85f41600a0 2024-04-25T09:08:10.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.452+0000 7f85f3e00640 1 -- 172.21.15.175:0/2551821345 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0ab9c0 con 0x7f85f41600a0 2024-04-25T09:08:10.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.452+0000 7f85fba00640 1 -- 172.21.15.175:0/2551821345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85f41600a0 msgr2=0x7f85f40cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:10.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.452+0000 7f85fba00640 1 --2- 172.21.15.175:0/2551821345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85f41600a0 0x7f85f40cc410 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0097c0 tx=0x7f85dc01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.452+0000 7f85fba00640 1 -- 172.21.15.175:0/2551821345 shutdown_connections 2024-04-25T09:08:10.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.452+0000 7f85fba00640 1 --2- 172.21.15.175:0/2551821345 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85f41600a0 0x7f85f40cc410 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.452+0000 7f85fba00640 1 --2- 172.21.15.175:0/2551821345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85f4145250 0x7f85f40cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.452+0000 7f85fba00640 1 -- 172.21.15.175:0/2551821345 >> 172.21.15.175:0/2551821345 conn(0x7f85f406ac50 msgr2=0x7f85f406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:10.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.452+0000 7f85fba00640 1 -- 172.21.15.175:0/2551821345 shutdown_connections 2024-04-25T09:08:10.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.452+0000 7f85fba00640 1 -- 172.21.15.175:0/2551821345 wait complete. 2024-04-25T09:08:10.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.452+0000 7f85fba00640 1 Processor -- start 2024-04-25T09:08:10.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85fba00640 1 -- start start 2024-04-25T09:08:10.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85fba00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85f40ce970 0x7f85f40b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85fba00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f4145250 0x7f85f40af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85fba00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85f41600a0 0x7f85f40af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85fba00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f415c870 con 0x7f85f4145250 2024-04-25T09:08:10.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85fba00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f4145630 con 0x7f85f41600a0 2024-04-25T09:08:10.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85fba00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f415c9f0 con 0x7f85f40ce970 2024-04-25T09:08:10.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85ebe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f4145250 0x7f85f40af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85ebe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f4145250 0x7f85f40af2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41374/0 (socket says 172.21.15.175:41374) 2024-04-25T09:08:10.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85ebe00640 1 -- 172.21.15.175:0/4282970451 learned_addr learned my addr 172.21.15.175:0/4282970451 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:10.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85f9000640 1 --2- 172.21.15.175:0/4282970451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85f40ce970 0x7f85f40b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85f9a00640 1 --2- 172.21.15.175:0/4282970451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85f41600a0 0x7f85f40af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85ebe00640 1 -- 172.21.15.175:0/4282970451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85f40ce970 msgr2=0x7f85f40b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:10.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85ebe00640 1 --2- 172.21.15.175:0/4282970451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85f40ce970 0x7f85f40b4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85ebe00640 1 -- 172.21.15.175:0/4282970451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85f41600a0 msgr2=0x7f85f40af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:10.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85ebe00640 1 --2- 172.21.15.175:0/4282970451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85f41600a0 0x7f85f40af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85ebe00640 1 -- 172.21.15.175:0/4282970451 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f40b4740 con 0x7f85f4145250 2024-04-25T09:08:10.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85ebe00640 1 --2- 172.21.15.175:0/4282970451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f4145250 0x7f85f40af2d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f85dc01aa90 tx=0x7f85dc019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:10.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85f1600640 1 -- 172.21.15.175:0/4282970451 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0abcb0 con 0x7f85f4145250 2024-04-25T09:08:10.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85f1600640 1 -- 172.21.15.175:0/4282970451 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc0abe50 con 0x7f85f4145250 2024-04-25T09:08:10.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85f1600640 1 -- 172.21.15.175:0/4282970451 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0bf690 con 0x7f85f4145250 2024-04-25T09:08:10.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85fba00640 1 -- 172.21.15.175:0/4282970451 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f4141b20 con 0x7f85f4145250 2024-04-25T09:08:10.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85fba00640 1 -- 172.21.15.175:0/4282970451 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f41420e0 con 0x7f85f4145250 2024-04-25T09:08:10.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.456+0000 7f85fba00640 1 -- 172.21.15.175:0/4282970451 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f4075160 con 0x7f85f4145250 2024-04-25T09:08:10.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.460+0000 7f85f1600640 1 -- 172.21.15.175:0/4282970451 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f85dc0aa070 con 0x7f85f4145250 2024-04-25T09:08:10.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.460+0000 7f85f1600640 1 --2- 172.21.15.175:0/4282970451 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f85d0066f60 0x7f85d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.460+0000 7f85f1600640 1 -- 172.21.15.175:0/4282970451 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f85dc11f3d0 con 0x7f85f4145250 2024-04-25T09:08:10.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.460+0000 7f85f9000640 1 --2- 172.21.15.175:0/4282970451 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f85d0066f60 0x7f85d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.460+0000 7f85f9000640 1 --2- 172.21.15.175:0/4282970451 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f85d0066f60 0x7f85d0069420 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f85e4009580 tx=0x7f85e4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:10.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.464+0000 7f85f1600640 1 -- 172.21.15.175:0/4282970451 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f85dc0c4060 con 0x7f85f4145250 2024-04-25T09:08:10.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.616+0000 7f85fba00640 1 -- 172.21.15.175:0/4282970451 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85f40cc200 con 0x7f85f4145250 2024-04-25T09:08:10.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.616+0000 7f85f1600640 1 -- 172.21.15.175:0/4282970451 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f85dc016090 con 0x7f85f4145250 2024-04-25T09:08:10.688 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:08:10.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.620+0000 7f85fba00640 1 -- 172.21.15.175:0/4282970451 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f85d0066f60 msgr2=0x7f85d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:10.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.620+0000 7f85fba00640 1 --2- 172.21.15.175:0/4282970451 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f85d0066f60 0x7f85d0069420 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f85e4009580 tx=0x7f85e4009190 comp rx=0 tx=0).stop 2024-04-25T09:08:10.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.620+0000 7f85fba00640 1 -- 172.21.15.175:0/4282970451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f4145250 msgr2=0x7f85f40af2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:10.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.620+0000 7f85fba00640 1 --2- 172.21.15.175:0/4282970451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f4145250 0x7f85f40af2d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f85dc01aa90 tx=0x7f85dc019180 comp rx=0 tx=0).stop 2024-04-25T09:08:10.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.620+0000 7f85fba00640 1 -- 172.21.15.175:0/4282970451 shutdown_connections 2024-04-25T09:08:10.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.620+0000 7f85fba00640 1 --2- 172.21.15.175:0/4282970451 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f85d0066f60 0x7f85d0069420 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.620+0000 7f85fba00640 1 --2- 172.21.15.175:0/4282970451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85f41600a0 0x7f85f40af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.620+0000 7f85fba00640 1 --2- 172.21.15.175:0/4282970451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85f4145250 0x7f85f40af2d0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.620+0000 7f85fba00640 1 --2- 172.21.15.175:0/4282970451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85f40ce970 0x7f85f40b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.620+0000 7f85fba00640 1 -- 172.21.15.175:0/4282970451 >> 172.21.15.175:0/4282970451 conn(0x7f85f406ac50 msgr2=0x7f85f413fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:10.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.620+0000 7f85fba00640 1 -- 172.21.15.175:0/4282970451 shutdown_connections 2024-04-25T09:08:10.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.620+0000 7f85fba00640 1 -- 172.21.15.175:0/4282970451 wait complete. 2024-04-25T09:08:10.691 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-04-25T09:08:10.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.836+0000 7f9a9dc00640 1 Processor -- start 2024-04-25T09:08:10.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.836+0000 7f9a9dc00640 1 -- start start 2024-04-25T09:08:10.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.836+0000 7f9a9dc00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9a980cd520 0x7f9a9806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.836+0000 7f9a9dc00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a980cda00 con 0x7f9a9815a900 2024-04-25T09:08:10.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.836+0000 7f9a9dc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a980cdce0 con 0x7f9a980cf560 2024-04-25T09:08:10.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.836+0000 7f9a9dc00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a9815bcf0 con 0x7f9a980cd520 2024-04-25T09:08:10.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.836+0000 7f9a96a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f9a9815a900 0x7f9a980ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:52484/0 (socket says 172.21.15.175:52484) 2024-04-25T09:08:10.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.836+0000 7f9a96a00640 1 -- 172.21.15.175:0/3537129472 learned_addr learned my addr 172.21.15.175:0/3537129472 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:10.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.836+0000 7f9a96000640 1 --2- 172.21.15.175:0/3537129472 >> v2:172.21.15.177:3300/0 conn(0x7f9a980cd520 0x7f9a9806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.836+0000 7f9a95600640 1 -- 172.21.15.175:0/3537129472 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314596815 0 0) 0x7f9a980cda00 con 0x7f9a9815a900 2024-04-25T09:08:10.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.836+0000 7f9a95600640 1 -- 172.21.15.175:0/3537129472 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a7c003530 con 0x7f9a9815a900 2024-04-25T09:08:10.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.836+0000 7f9a95600640 1 -- 172.21.15.175:0/3537129472 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1479301345 0 0) 0x7f9a7c003530 con 0x7f9a9815a900 2024-04-25T09:08:10.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.836+0000 7f9a95600640 1 -- 172.21.15.175:0/3537129472 >> v2:172.21.15.177:3300/0 conn(0x7f9a980cd520 msgr2=0x7f9a9806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:10.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.836+0000 7f9a95600640 1 --2- 172.21.15.175:0/3537129472 >> v2:172.21.15.177:3300/0 conn(0x7f9a980cd520 0x7f9a9806e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.836+0000 7f9a95600640 1 -- 172.21.15.175:0/3537129472 >> v1:172.21.15.177:6789/0 conn(0x7f9a980cf560 legacy=0x7f9a9815bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:10.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.836+0000 7f9a95600640 1 -- 172.21.15.175:0/3537129472 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a980cdfc0 con 0x7f9a9815a900 2024-04-25T09:08:10.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a95600640 1 -- 172.21.15.175:0/3537129472 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f9a88001680 con 0x7f9a9815a900 2024-04-25T09:08:10.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a95600640 1 -- 172.21.15.175:0/3537129472 >> v1:172.21.15.175:6789/0 conn(0x7f9a9815a900 legacy=0x7f9a980ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:10.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a95600640 1 --2- 172.21.15.175:0/3537129472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a7c0039c0 0x7f9a7c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a95600640 1 --2- 172.21.15.175:0/3537129472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a7c0043c0 0x7f9a7c004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a95600640 1 --2- 172.21.15.175:0/3537129472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a7c005090 0x7f9a7c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a95600640 1 -- 172.21.15.175:0/3537129472 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c00e1d0 con 0x7f9a7c005090 2024-04-25T09:08:10.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a95600640 1 -- 172.21.15.175:0/3537129472 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c00bf10 con 0x7f9a7c0043c0 2024-04-25T09:08:10.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a95600640 1 -- 172.21.15.175:0/3537129472 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c00c110 con 0x7f9a7c0039c0 2024-04-25T09:08:10.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a97400640 1 --2- 172.21.15.175:0/3537129472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a7c005090 0x7f9a7c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a96000640 1 --2- 172.21.15.175:0/3537129472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a7c0043c0 0x7f9a7c004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a96a00640 1 --2- 172.21.15.175:0/3537129472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a7c0039c0 0x7f9a7c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a97400640 1 -- 172.21.15.175:0/3537129472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a7c0039c0 msgr2=0x7f9a7c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:10.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a97400640 1 --2- 172.21.15.175:0/3537129472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a7c0039c0 0x7f9a7c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a97400640 1 -- 172.21.15.175:0/3537129472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a7c0043c0 msgr2=0x7f9a7c004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:10.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a97400640 1 --2- 172.21.15.175:0/3537129472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a7c0043c0 0x7f9a7c004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a97400640 1 -- 172.21.15.175:0/3537129472 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c003530 con 0x7f9a7c005090 2024-04-25T09:08:10.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a96a00640 1 --2- 172.21.15.175:0/3537129472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a7c0039c0 0x7f9a7c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:10.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a97400640 1 -- 172.21.15.175:0/3537129472 reap_dead start 2024-04-25T09:08:10.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a97400640 1 --2- 172.21.15.175:0/3537129472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a7c005090 0x7f9a7c00b9d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9a90001f60 tx=0x7f9a9001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4f2423a260fa47 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:10.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a95600640 1 -- 172.21.15.175:0/3537129472 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a90001b60 con 0x7f9a7c005090 2024-04-25T09:08:10.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a95600640 1 -- 172.21.15.175:0/3537129472 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a90003b80 con 0x7f9a7c005090 2024-04-25T09:08:10.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.840+0000 7f9a95600640 1 -- 172.21.15.175:0/3537129472 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a900050d0 con 0x7f9a7c005090 2024-04-25T09:08:10.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a9dc00640 1 -- 172.21.15.175:0/3537129472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a7c005090 msgr2=0x7f9a7c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:10.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a9dc00640 1 --2- 172.21.15.175:0/3537129472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a7c005090 0x7f9a7c00b9d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9a90001f60 tx=0x7f9a9001c880 comp rx=0 tx=0).stop 2024-04-25T09:08:10.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a9dc00640 1 -- 172.21.15.175:0/3537129472 shutdown_connections 2024-04-25T09:08:10.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a9dc00640 1 --2- 172.21.15.175:0/3537129472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a7c005090 0x7f9a7c00b9d0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a9dc00640 1 -- 172.21.15.175:0/3537129472 >> 172.21.15.175:0/3537129472 conn(0x7f9a98067150 msgr2=0x7f9a9806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:10.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a9dc00640 1 -- 172.21.15.175:0/3537129472 shutdown_connections 2024-04-25T09:08:10.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a9dc00640 1 -- 172.21.15.175:0/3537129472 wait complete. 2024-04-25T09:08:10.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a9dc00640 1 Processor -- start 2024-04-25T09:08:10.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a9dc00640 1 -- start start 2024-04-25T09:08:10.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a9dc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a981ee7b0 0x7f9a980b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a9dc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a980af0c0 0x7f9a980af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a9dc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a980afa80 0x7f9a981f2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a9dc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9806d3b0 con 0x7f9a981ee7b0 2024-04-25T09:08:10.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a9dc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a980ce580 con 0x7f9a980afa80 2024-04-25T09:08:10.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a9dc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9806d530 con 0x7f9a980af0c0 2024-04-25T09:08:10.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a96a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a981ee7b0 0x7f9a980b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a96a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a981ee7b0 0x7f9a980b1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41404/0 (socket says 172.21.15.175:41404) 2024-04-25T09:08:10.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a96a00640 1 -- 172.21.15.175:0/148802996 learned_addr learned my addr 172.21.15.175:0/148802996 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:10.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a96000640 1 --2- 172.21.15.175:0/148802996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a980af0c0 0x7f9a980af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a97400640 1 --2- 172.21.15.175:0/148802996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a980afa80 0x7f9a981f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a96a00640 1 -- 172.21.15.175:0/148802996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a980af0c0 msgr2=0x7f9a980af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:10.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a96a00640 1 --2- 172.21.15.175:0/148802996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a980af0c0 0x7f9a980af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a96a00640 1 -- 172.21.15.175:0/148802996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a980afa80 msgr2=0x7f9a981f2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:10.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a96a00640 1 --2- 172.21.15.175:0/148802996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a980afa80 0x7f9a981f2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:10.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.844+0000 7f9a96a00640 1 -- 172.21.15.175:0/148802996 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a980b2140 con 0x7f9a981ee7b0 2024-04-25T09:08:10.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.848+0000 7f9a96a00640 1 --2- 172.21.15.175:0/148802996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a981ee7b0 0x7f9a980b1400 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9a88011810 tx=0x7f9a88011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:10.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.848+0000 7f9a8ea00640 1 -- 172.21.15.175:0/148802996 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a88010040 con 0x7f9a981ee7b0 2024-04-25T09:08:10.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.848+0000 7f9a8ea00640 1 -- 172.21.15.175:0/148802996 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8801a070 con 0x7f9a981ee7b0 2024-04-25T09:08:10.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.848+0000 7f9a8ea00640 1 -- 172.21.15.175:0/148802996 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8800faf0 con 0x7f9a981ee7b0 2024-04-25T09:08:10.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.848+0000 7f9a9dc00640 1 -- 172.21.15.175:0/148802996 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a980aff00 con 0x7f9a981ee7b0 2024-04-25T09:08:10.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.848+0000 7f9a9dc00640 1 -- 172.21.15.175:0/148802996 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a980b1e60 con 0x7f9a981ee7b0 2024-04-25T09:08:10.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.848+0000 7f9a9dc00640 1 -- 172.21.15.175:0/148802996 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a98074a60 con 0x7f9a981ee7b0 2024-04-25T09:08:10.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.848+0000 7f9a8ea00640 1 -- 172.21.15.175:0/148802996 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9a8800fc90 con 0x7f9a981ee7b0 2024-04-25T09:08:10.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.848+0000 7f9a8ea00640 1 --2- 172.21.15.175:0/148802996 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9a78066f60 0x7f9a78069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:10.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.848+0000 7f9a8ea00640 1 -- 172.21.15.175:0/148802996 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9a88087bd0 con 0x7f9a981ee7b0 2024-04-25T09:08:10.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.848+0000 7f9a96000640 1 --2- 172.21.15.175:0/148802996 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9a78066f60 0x7f9a78069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:10.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.852+0000 7f9a96000640 1 --2- 172.21.15.175:0/148802996 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9a78066f60 0x7f9a78069420 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9a980cb9d0 tx=0x7f9a84009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:10.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:10.852+0000 7f9a8ea00640 1 -- 172.21.15.175:0/148802996 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9a88058ed0 con 0x7f9a981ee7b0 2024-04-25T09:08:11.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:11.060+0000 7f9a9dc00640 1 -- 172.21.15.175:0/148802996 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) v1 -- 0x7f9a9806aea0 con 0x7f9a981ee7b0 2024-04-25T09:08:11.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:11.960+0000 7f9a8ea00640 1 -- 172.21.15.175:0/148802996 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v221) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9a880587d0 con 0x7f9a981ee7b0 2024-04-25T09:08:11.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:11.964+0000 7f9a9dc00640 1 -- 172.21.15.175:0/148802996 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9a78066f60 msgr2=0x7f9a78069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:11.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:11.964+0000 7f9a9dc00640 1 --2- 172.21.15.175:0/148802996 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9a78066f60 0x7f9a78069420 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9a980cb9d0 tx=0x7f9a84009190 comp rx=0 tx=0).stop 2024-04-25T09:08:11.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:11.964+0000 7f9a9dc00640 1 -- 172.21.15.175:0/148802996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a981ee7b0 msgr2=0x7f9a980b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:11.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:11.964+0000 7f9a9dc00640 1 --2- 172.21.15.175:0/148802996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a981ee7b0 0x7f9a980b1400 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9a88011810 tx=0x7f9a88011c10 comp rx=0 tx=0).stop 2024-04-25T09:08:11.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:11.964+0000 7f9a9dc00640 1 -- 172.21.15.175:0/148802996 shutdown_connections 2024-04-25T09:08:11.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:11.964+0000 7f9a9dc00640 1 --2- 172.21.15.175:0/148802996 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9a78066f60 0x7f9a78069420 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:11.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:11.964+0000 7f9a9dc00640 1 --2- 172.21.15.175:0/148802996 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9a980afa80 0x7f9a981f2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:11.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:11.964+0000 7f9a9dc00640 1 --2- 172.21.15.175:0/148802996 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9a980af0c0 0x7f9a980af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:11.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:11.964+0000 7f9a9dc00640 1 --2- 172.21.15.175:0/148802996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a981ee7b0 0x7f9a980b1400 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:11.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:11.964+0000 7f9a9dc00640 1 -- 172.21.15.175:0/148802996 >> 172.21.15.175:0/148802996 conn(0x7f9a7c005090 msgr2=0x7f9a981570d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:11.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:11.964+0000 7f9a9dc00640 1 -- 172.21.15.175:0/148802996 shutdown_connections 2024-04-25T09:08:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:11.964+0000 7f9a9dc00640 1 -- 172.21.15.175:0/148802996 wait complete. 2024-04-25T09:08:11.976 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:08:12.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.128+0000 7f8474800640 1 Processor -- start 2024-04-25T09:08:12.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.128+0000 7f8474800640 1 -- start start 2024-04-25T09:08:12.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.128+0000 7f8474800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f846c0cbe60 0x7f846c15af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:12.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.128+0000 7f8474800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f846c06d310 0x7f846c0b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:12.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.128+0000 7f8474800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f846c06db60 con 0x7f846c0b4630 2024-04-25T09:08:12.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.128+0000 7f8474800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846c0b4aa0 con 0x7f846c06d310 2024-04-25T09:08:12.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.128+0000 7f8474800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f846c06de40 con 0x7f846c0cbe60 2024-04-25T09:08:12.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.128+0000 7f8471400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f846c06d310 0x7f846c0b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:12.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.128+0000 7f8471400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f846c06d310 0x7f846c0b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41412/0 (socket says 172.21.15.175:41412) 2024-04-25T09:08:12.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.128+0000 7f8471400640 1 -- 172.21.15.175:0/702199889 learned_addr learned my addr 172.21.15.175:0/702199889 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:12.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.132+0000 7f8471400640 1 -- 172.21.15.175:0/702199889 >> v2:172.21.15.177:3300/0 conn(0x7f846c0cbe60 msgr2=0x7f846c15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:12.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.132+0000 7f8471e00640 1 --2- 172.21.15.175:0/702199889 >> v2:172.21.15.177:3300/0 conn(0x7f846c0cbe60 0x7f846c15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:12.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.132+0000 7f8471400640 1 --2- 172.21.15.175:0/702199889 >> v2:172.21.15.177:3300/0 conn(0x7f846c0cbe60 0x7f846c15af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.132+0000 7f8471400640 1 -- 172.21.15.175:0/702199889 >> v1:172.21.15.177:6789/0 conn(0x7f846c0b4630 legacy=0x7f846c0b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:12.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.132+0000 7f8471400640 1 -- 172.21.15.175:0/702199889 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c06e120 con 0x7f846c06d310 2024-04-25T09:08:12.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.132+0000 7f8471e00640 1 --2- 172.21.15.175:0/702199889 >> v2:172.21.15.177:3300/0 conn(0x7f846c0cbe60 0x7f846c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:12.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.132+0000 7f8471400640 1 --2- 172.21.15.175:0/702199889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f846c06d310 0x7f846c0b40f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f846c0b4d50 tx=0x7f845c01ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c1f98ef4c81579 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:12.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.132+0000 7f8470a00640 1 -- 172.21.15.175:0/702199889 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c0b4070 con 0x7f846c06d310 2024-04-25T09:08:12.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.132+0000 7f8470a00640 1 -- 172.21.15.175:0/702199889 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c0a7b90 con 0x7f846c06d310 2024-04-25T09:08:12.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.132+0000 7f8470a00640 1 -- 172.21.15.175:0/702199889 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c0af440 con 0x7f846c06d310 2024-04-25T09:08:12.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8474800640 1 -- 172.21.15.175:0/702199889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f846c06d310 msgr2=0x7f846c0b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:12.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8474800640 1 --2- 172.21.15.175:0/702199889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f846c06d310 0x7f846c0b40f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f846c0b4d50 tx=0x7f845c01ebb0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8474800640 1 -- 172.21.15.175:0/702199889 shutdown_connections 2024-04-25T09:08:12.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8474800640 1 --2- 172.21.15.175:0/702199889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f846c06d310 0x7f846c0b40f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8474800640 1 --2- 172.21.15.175:0/702199889 >> v2:172.21.15.177:3300/0 conn(0x7f846c0cbe60 0x7f846c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8474800640 1 -- 172.21.15.175:0/702199889 >> 172.21.15.175:0/702199889 conn(0x7f846c06ac50 msgr2=0x7f846c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:12.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8474800640 1 -- 172.21.15.175:0/702199889 shutdown_connections 2024-04-25T09:08:12.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8474800640 1 -- 172.21.15.175:0/702199889 wait complete. 2024-04-25T09:08:12.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8474800640 1 Processor -- start 2024-04-25T09:08:12.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8474800640 1 -- start start 2024-04-25T09:08:12.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8474800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f846c06d310 0x7f846c1f9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:12.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8474800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f846c0b4630 0x7f846c14d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:12.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8474800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f846c0cbe60 0x7f846c152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:12.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8474800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0712d0 con 0x7f846c06d310 2024-04-25T09:08:12.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8474800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846c0cc490 con 0x7f846c0b4630 2024-04-25T09:08:12.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8474800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f846c071450 con 0x7f846c0cbe60 2024-04-25T09:08:12.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8471e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f846c06d310 0x7f846c1f9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:12.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8471e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f846c06d310 0x7f846c1f9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41418/0 (socket says 172.21.15.175:41418) 2024-04-25T09:08:12.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8471e00640 1 -- 172.21.15.175:0/1851025528 learned_addr learned my addr 172.21.15.175:0/1851025528 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:12.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8471400640 1 --2- 172.21.15.175:0/1851025528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f846c0b4630 0x7f846c14d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:12.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8472800640 1 --2- 172.21.15.175:0/1851025528 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f846c0cbe60 0x7f846c152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:12.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8471e00640 1 -- 172.21.15.175:0/1851025528 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f846c0cbe60 msgr2=0x7f846c152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:12.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8471e00640 1 --2- 172.21.15.175:0/1851025528 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f846c0cbe60 0x7f846c152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8471e00640 1 -- 172.21.15.175:0/1851025528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f846c0b4630 msgr2=0x7f846c14d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:12.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8471e00640 1 --2- 172.21.15.175:0/1851025528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f846c0b4630 0x7f846c14d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.136+0000 7f8471e00640 1 -- 172.21.15.175:0/1851025528 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f846c14da80 con 0x7f846c06d310 2024-04-25T09:08:12.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.140+0000 7f8471e00640 1 --2- 172.21.15.175:0/1851025528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f846c06d310 0x7f846c1f9ae0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f846000c820 tx=0x7f846000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:12.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.140+0000 7f8466000640 1 -- 172.21.15.175:0/1851025528 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460015070 con 0x7f846c06d310 2024-04-25T09:08:12.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.140+0000 7f8466000640 1 -- 172.21.15.175:0/1851025528 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8460007a30 con 0x7f846c06d310 2024-04-25T09:08:12.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.140+0000 7f8466000640 1 -- 172.21.15.175:0/1851025528 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460007e40 con 0x7f846c06d310 2024-04-25T09:08:12.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.140+0000 7f8474800640 1 -- 172.21.15.175:0/1851025528 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f846c0aca60 con 0x7f846c06d310 2024-04-25T09:08:12.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.140+0000 7f8474800640 1 -- 172.21.15.175:0/1851025528 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f846c14d5c0 con 0x7f846c06d310 2024-04-25T09:08:12.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.140+0000 7f8474800640 1 -- 172.21.15.175:0/1851025528 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f846c075160 con 0x7f846c06d310 2024-04-25T09:08:12.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.140+0000 7f8466000640 1 -- 172.21.15.175:0/1851025528 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8460018070 con 0x7f846c06d310 2024-04-25T09:08:12.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.140+0000 7f8466000640 1 --2- 172.21.15.175:0/1851025528 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8450066f60 0x7f8450069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:12.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.140+0000 7f8466000640 1 -- 172.21.15.175:0/1851025528 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8460084b60 con 0x7f846c06d310 2024-04-25T09:08:12.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.140+0000 7f8471400640 1 --2- 172.21.15.175:0/1851025528 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8450066f60 0x7f8450069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:12.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.144+0000 7f8471400640 1 --2- 172.21.15.175:0/1851025528 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8450066f60 0x7f8450069420 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f845c0b1000 tx=0x7f845c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:12.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.144+0000 7f8466000640 1 -- 172.21.15.175:0/1851025528 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8460055820 con 0x7f846c06d310 2024-04-25T09:08:12.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.300+0000 7f8474800640 1 -- 172.21.15.175:0/1851025528 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f846c0af720 con 0x7f846c06d310 2024-04-25T09:08:12.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.304+0000 7f8466000640 1 -- 172.21.15.175:0/1851025528 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f84600598c0 con 0x7f846c06d310 2024-04-25T09:08:12.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.304+0000 7f8474800640 1 -- 172.21.15.175:0/1851025528 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8450066f60 msgr2=0x7f8450069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:12.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.304+0000 7f8474800640 1 --2- 172.21.15.175:0/1851025528 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8450066f60 0x7f8450069420 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f845c0b1000 tx=0x7f845c008040 comp rx=0 tx=0).stop 2024-04-25T09:08:12.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.304+0000 7f8474800640 1 -- 172.21.15.175:0/1851025528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f846c06d310 msgr2=0x7f846c1f9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:12.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.304+0000 7f8474800640 1 --2- 172.21.15.175:0/1851025528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f846c06d310 0x7f846c1f9ae0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f846000c820 tx=0x7f846000cce0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.304+0000 7f8474800640 1 -- 172.21.15.175:0/1851025528 shutdown_connections 2024-04-25T09:08:12.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.304+0000 7f8474800640 1 --2- 172.21.15.175:0/1851025528 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8450066f60 0x7f8450069420 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.304+0000 7f8474800640 1 --2- 172.21.15.175:0/1851025528 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f846c0cbe60 0x7f846c152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.304+0000 7f8474800640 1 --2- 172.21.15.175:0/1851025528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f846c0b4630 0x7f846c14d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.304+0000 7f8474800640 1 --2- 172.21.15.175:0/1851025528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f846c06d310 0x7f846c1f9ae0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.304+0000 7f8474800640 1 -- 172.21.15.175:0/1851025528 >> 172.21.15.175:0/1851025528 conn(0x7f846c06ac50 msgr2=0x7f846c0afe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:12.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.304+0000 7f8474800640 1 -- 172.21.15.175:0/1851025528 shutdown_connections 2024-04-25T09:08:12.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.304+0000 7f8474800640 1 -- 172.21.15.175:0/1851025528 wait complete. 2024-04-25T09:08:12.313 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:08:12.314 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:08:12.406 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:08:12.507 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:08:12.507 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:08:12.507 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:08:12.516 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:08:12.516 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:08:12.516 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:08:12.525 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:08:12.525 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:08:12.525 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:08:12.567 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:08:12.568 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:08:12.568 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:08:12.577 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:08:12.577 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:08:12.577 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:08:12.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.756+0000 7f4f91000640 1 Processor -- start 2024-04-25T09:08:12.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.756+0000 7f4f91000640 1 -- start start 2024-04-25T09:08:12.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.756+0000 7f4f91000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4f8c15a900 0x7f4f8c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:12.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.756+0000 7f4f91000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4f8c0cd520 0x7f4f8c0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:12.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.756+0000 7f4f91000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f8c0cf560 0x7f4f8c0cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:12.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.756+0000 7f4f91000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8c0cfef0 con 0x7f4f8c0cd520 2024-04-25T09:08:12.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.756+0000 7f4f91000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8c0cda00 con 0x7f4f8c15a900 2024-04-25T09:08:12.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.756+0000 7f4f91000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c0cdce0 con 0x7f4f8c0cf560 2024-04-25T09:08:12.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.756+0000 7f4f81400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4f8c0cd520 0x7f4f8c0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:12.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.756+0000 7f4f81400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4f8c0cd520 0x7f4f8c0ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41432/0 (socket says 172.21.15.175:41432) 2024-04-25T09:08:12.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.756+0000 7f4f81400640 1 -- 172.21.15.175:0/331026709 learned_addr learned my addr 172.21.15.175:0/331026709 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:12.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.760+0000 7f4f8a800640 1 --2- 172.21.15.175:0/331026709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f8c0cf560 0x7f4f8c0cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:12.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.760+0000 7f4f89e00640 1 --2- 172.21.15.175:0/331026709 >> v2:172.21.15.177:3300/0 conn(0x7f4f8c15a900 0x7f4f8c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:12.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.760+0000 7f4f81400640 1 -- 172.21.15.175:0/331026709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f8c0cf560 msgr2=0x7f4f8c0cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:12.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.760+0000 7f4f81400640 1 --2- 172.21.15.175:0/331026709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f8c0cf560 0x7f4f8c0cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.760+0000 7f4f81400640 1 -- 172.21.15.175:0/331026709 >> v2:172.21.15.177:3300/0 conn(0x7f4f8c15a900 msgr2=0x7f4f8c06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:12.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.760+0000 7f4f81400640 1 --2- 172.21.15.175:0/331026709 >> v2:172.21.15.177:3300/0 conn(0x7f4f8c15a900 0x7f4f8c06e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.760+0000 7f4f81400640 1 -- 172.21.15.175:0/331026709 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c0cdfc0 con 0x7f4f8c0cd520 2024-04-25T09:08:12.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.760+0000 7f4f89e00640 1 --2- 172.21.15.175:0/331026709 >> v2:172.21.15.177:3300/0 conn(0x7f4f8c15a900 0x7f4f8c06e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:12.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.760+0000 7f4f8a800640 1 --2- 172.21.15.175:0/331026709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f8c0cf560 0x7f4f8c0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:12.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.760+0000 7f4f81400640 1 --2- 172.21.15.175:0/331026709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f8c0cd520 0x7f4f8c0ceaa0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0b4c70 tx=0x7f4f7401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7c49eaf5c463a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:12.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.760+0000 7f4f89400640 1 -- 172.21.15.175:0/331026709 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f740aa610 con 0x7f4f8c0cd520 2024-04-25T09:08:12.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.760+0000 7f4f89400640 1 -- 172.21.15.175:0/331026709 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f740af070 con 0x7f4f8c0cd520 2024-04-25T09:08:12.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.760+0000 7f4f89400640 1 -- 172.21.15.175:0/331026709 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f740aa9d0 con 0x7f4f8c0cd520 2024-04-25T09:08:12.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.760+0000 7f4f91000640 1 -- 172.21.15.175:0/331026709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f8c0cd520 msgr2=0x7f4f8c0ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:12.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.760+0000 7f4f91000640 1 --2- 172.21.15.175:0/331026709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f8c0cd520 0x7f4f8c0ceaa0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0b4c70 tx=0x7f4f7401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f91000640 1 -- 172.21.15.175:0/331026709 shutdown_connections 2024-04-25T09:08:12.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f91000640 1 --2- 172.21.15.175:0/331026709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f8c0cf560 0x7f4f8c0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f91000640 1 --2- 172.21.15.175:0/331026709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f8c0cd520 0x7f4f8c0ceaa0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f91000640 1 --2- 172.21.15.175:0/331026709 >> v2:172.21.15.177:3300/0 conn(0x7f4f8c15a900 0x7f4f8c06e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f91000640 1 -- 172.21.15.175:0/331026709 >> 172.21.15.175:0/331026709 conn(0x7f4f8c067150 msgr2=0x7f4f8c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:12.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f91000640 1 -- 172.21.15.175:0/331026709 shutdown_connections 2024-04-25T09:08:12.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f91000640 1 -- 172.21.15.175:0/331026709 wait complete. 2024-04-25T09:08:12.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f91000640 1 Processor -- start 2024-04-25T09:08:12.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f91000640 1 -- start start 2024-04-25T09:08:12.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f91000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f8c0cf560 0x7f4f8c155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:12.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f91000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f8c15a900 0x7f4f8c145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:12.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f91000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f8c14d960 0x7f4f8c14de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:12.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f91000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c06d530 con 0x7f4f8c15a900 2024-04-25T09:08:12.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f91000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c06d3b0 con 0x7f4f8c14d960 2024-04-25T09:08:12.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f91000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c15c790 con 0x7f4f8c0cf560 2024-04-25T09:08:12.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f81400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f8c15a900 0x7f4f8c145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:12.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f81400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f8c15a900 0x7f4f8c145c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41440/0 (socket says 172.21.15.175:41440) 2024-04-25T09:08:12.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f81400640 1 -- 172.21.15.175:0/2762173614 learned_addr learned my addr 172.21.15.175:0/2762173614 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:12.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f89e00640 1 --2- 172.21.15.175:0/2762173614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f8c0cf560 0x7f4f8c155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:12.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f8a800640 1 --2- 172.21.15.175:0/2762173614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f8c14d960 0x7f4f8c14de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:12.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f81400640 1 -- 172.21.15.175:0/2762173614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f8c0cf560 msgr2=0x7f4f8c155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:12.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f81400640 1 --2- 172.21.15.175:0/2762173614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f8c0cf560 0x7f4f8c155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f81400640 1 -- 172.21.15.175:0/2762173614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f8c14d960 msgr2=0x7f4f8c14de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:12.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f81400640 1 --2- 172.21.15.175:0/2762173614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f8c14d960 0x7f4f8c14de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f81400640 1 -- 172.21.15.175:0/2762173614 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c0adf20 con 0x7f4f8c15a900 2024-04-25T09:08:12.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f89e00640 1 --2- 172.21.15.175:0/2762173614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f8c0cf560 0x7f4f8c155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:12.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f81400640 1 --2- 172.21.15.175:0/2762173614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f8c15a900 0x7f4f8c145c00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f4f7401aba0 tx=0x7f4f7401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:12.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f82a00640 1 -- 172.21.15.175:0/2762173614 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f740b3800 con 0x7f4f8c15a900 2024-04-25T09:08:12.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f82a00640 1 -- 172.21.15.175:0/2762173614 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f740b39a0 con 0x7f4f8c15a900 2024-04-25T09:08:12.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f91000640 1 -- 172.21.15.175:0/2762173614 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8c0b24a0 con 0x7f4f8c15a900 2024-04-25T09:08:12.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.764+0000 7f4f82a00640 1 -- 172.21.15.175:0/2762173614 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f740b3d90 con 0x7f4f8c15a900 2024-04-25T09:08:12.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.768+0000 7f4f91000640 1 -- 172.21.15.175:0/2762173614 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c0ad2d0 con 0x7f4f8c15a900 2024-04-25T09:08:12.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.768+0000 7f4f91000640 1 -- 172.21.15.175:0/2762173614 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8c074a60 con 0x7f4f8c15a900 2024-04-25T09:08:12.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.768+0000 7f4f82a00640 1 -- 172.21.15.175:0/2762173614 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4f740c6390 con 0x7f4f8c15a900 2024-04-25T09:08:12.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.768+0000 7f4f82a00640 1 --2- 172.21.15.175:0/2762173614 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4f68066f60 0x7f4f68069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:12.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.768+0000 7f4f82a00640 1 -- 172.21.15.175:0/2762173614 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4f7411f620 con 0x7f4f8c15a900 2024-04-25T09:08:12.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.768+0000 7f4f89e00640 1 --2- 172.21.15.175:0/2762173614 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4f68066f60 0x7f4f68069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:12.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.768+0000 7f4f89e00640 1 --2- 172.21.15.175:0/2762173614 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4f68066f60 0x7f4f68069420 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c150370 tx=0x7f4f7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:12.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.772+0000 7f4f82a00640 1 -- 172.21.15.175:0/2762173614 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4f740c3060 con 0x7f4f8c15a900 2024-04-25T09:08:12.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.960+0000 7f4f91000640 1 -- 172.21.15.175:0/2762173614 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f8c0cf290 con 0x7f4f8c15a900 2024-04-25T09:08:12.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.960+0000 7f4f82a00640 1 -- 172.21.15.175:0/2762173614 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3708 (secure 0 0 0) 0x7f4f740a7070 con 0x7f4f8c15a900 2024-04-25T09:08:12.951 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:12.951 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":36,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5459,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2064272902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2064272902},{"type":"v1","addr":"172.21.15.177:6834","nonce":2064272902}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5462,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3896280225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3896280225},{"type":"v1","addr":"172.21.15.177:6835","nonce":3896280225}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/149812612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":149812612},{"type":"v1","addr":"172.21.15.175:6835","nonce":149812612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":6435,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2786993945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2786993945},{"type":"v1","addr":"172.21.15.175:6837","nonce":2786993945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":36}],"filesystems":[]} 2024-04-25T09:08:12.951 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 36 2024-04-25T09:08:12.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.964+0000 7f4f91000640 1 -- 172.21.15.175:0/2762173614 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4f68066f60 msgr2=0x7f4f68069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:12.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.964+0000 7f4f91000640 1 --2- 172.21.15.175:0/2762173614 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4f68066f60 0x7f4f68069420 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c150370 tx=0x7f4f7c008040 comp rx=0 tx=0).stop 2024-04-25T09:08:12.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.964+0000 7f4f91000640 1 -- 172.21.15.175:0/2762173614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f8c15a900 msgr2=0x7f4f8c145c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:12.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.964+0000 7f4f91000640 1 --2- 172.21.15.175:0/2762173614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f8c15a900 0x7f4f8c145c00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f4f7401aba0 tx=0x7f4f7401ad30 comp rx=0 tx=0).stop 2024-04-25T09:08:12.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.964+0000 7f4f91000640 1 -- 172.21.15.175:0/2762173614 shutdown_connections 2024-04-25T09:08:12.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.964+0000 7f4f91000640 1 --2- 172.21.15.175:0/2762173614 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4f68066f60 0x7f4f68069420 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.964+0000 7f4f91000640 1 --2- 172.21.15.175:0/2762173614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f8c14d960 0x7f4f8c14de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.964+0000 7f4f91000640 1 --2- 172.21.15.175:0/2762173614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4f8c15a900 0x7f4f8c145c00 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.964+0000 7f4f91000640 1 --2- 172.21.15.175:0/2762173614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f8c0cf560 0x7f4f8c155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:12.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.964+0000 7f4f91000640 1 -- 172.21.15.175:0/2762173614 >> 172.21.15.175:0/2762173614 conn(0x7f4f8c0cd520 msgr2=0x7f4f8c15ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:12.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.964+0000 7f4f91000640 1 -- 172.21.15.175:0/2762173614 shutdown_connections 2024-04-25T09:08:12.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:12.964+0000 7f4f91000640 1 -- 172.21.15.175:0/2762173614 wait complete. 2024-04-25T09:08:12.972 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:08:12.972 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:08:12.972 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:08:12.972 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:08:12.973 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:08:12.973 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:08:12.973 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:08:12.973 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:08:12.973 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:08:12.973 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:08:12.973 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:08:12.974 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:08:12.974 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:08:12.974 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:08:12.974 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:08:12.974 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:08:12.986 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:08:12.986 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:08:12.987 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:08:12.987 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:08:12.988 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:08:12.988 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:08:12.989 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:08:12.989 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:08:13.034 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:08:13.034 DEBUG:teuthology.parallel:result is None 2024-04-25T09:08:13.035 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:08:13.036 DEBUG:teuthology.parallel:result is None 2024-04-25T09:08:13.038 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:08:13.039 DEBUG:teuthology.parallel:result is None 2024-04-25T09:08:13.040 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:08:13.040 DEBUG:teuthology.parallel:result is None 2024-04-25T09:08:13.041 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:08:13.120 INFO:tasks.ceph.mds.c.smithi175.stdout:starting mds.c at 2024-04-25T09:08:13.120 INFO:tasks.ceph.mds.a.smithi175.stdout:starting mds.a at 2024-04-25T09:08:13.129 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-04-25T09:08:13.130 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-04-25T09:08:13.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.196+0000 7efd2be00640 1 Processor -- start 2024-04-25T09:08:13.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.196+0000 7efd2be00640 1 -- start start 2024-04-25T09:08:13.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.196+0000 7efd2be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd2c099cb0 0x7efd2c06c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:13.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.196+0000 7efd2be00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efd2c09a090 0x7efd2c0cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:13.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.196+0000 7efd2be00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd2c0b27c0 0x7efd2c15d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:13.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.196+0000 7efd2be00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd2c0cf8b0 con 0x7efd2c0b27c0 2024-04-25T09:08:13.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.196+0000 7efd2be00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd2c06ccb0 con 0x7efd2c09a090 2024-04-25T09:08:13.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.196+0000 7efd2be00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c06d1d0 con 0x7efd2c099cb0 2024-04-25T09:08:13.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.196+0000 7efd2b400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd2c0b27c0 0x7efd2c15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:13.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.196+0000 7efd2b400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd2c0b27c0 0x7efd2c15d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41486/0 (socket says 172.21.15.175:41486) 2024-04-25T09:08:13.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.196+0000 7efd2b400640 1 -- 172.21.15.175:0/3121572357 learned_addr learned my addr 172.21.15.175:0/3121572357 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:13.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.196+0000 7efd22000640 1 --2- 172.21.15.175:0/3121572357 >> v2:172.21.15.177:3300/0 conn(0x7efd2c09a090 0x7efd2c0cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:13.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.196+0000 7efd2aa00640 1 --2- 172.21.15.175:0/3121572357 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd2c099cb0 0x7efd2c06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:13.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.196+0000 7efd2b400640 1 -- 172.21.15.175:0/3121572357 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd2c099cb0 msgr2=0x7efd2c06c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:13.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.196+0000 7efd2b400640 1 --2- 172.21.15.175:0/3121572357 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd2c099cb0 0x7efd2c06c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:13.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.196+0000 7efd2b400640 1 -- 172.21.15.175:0/3121572357 >> v2:172.21.15.177:3300/0 conn(0x7efd2c09a090 msgr2=0x7efd2c0cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:13.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.196+0000 7efd2b400640 1 --2- 172.21.15.175:0/3121572357 >> v2:172.21.15.177:3300/0 conn(0x7efd2c09a090 0x7efd2c0cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:13.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.196+0000 7efd2b400640 1 -- 172.21.15.175:0/3121572357 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2c06cef0 con 0x7efd2c0b27c0 2024-04-25T09:08:13.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.200+0000 7efd2b400640 1 --2- 172.21.15.175:0/3121572357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd2c0b27c0 0x7efd2c15d830 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7efd2c072a40 tx=0x7efd2401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ec8d0c8e91f774 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:13.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.200+0000 7efd2a000640 1 -- 172.21.15.175:0/3121572357 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd240b0070 con 0x7efd2c0b27c0 2024-04-25T09:08:13.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.200+0000 7efd2a000640 1 -- 172.21.15.175:0/3121572357 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd240ab600 con 0x7efd2c0b27c0 2024-04-25T09:08:13.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.200+0000 7efd2a000640 1 -- 172.21.15.175:0/3121572357 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd240ab9d0 con 0x7efd2c0b27c0 2024-04-25T09:08:13.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.200+0000 7efd2be00640 1 -- 172.21.15.175:0/3121572357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd2c0b27c0 msgr2=0x7efd2c15d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:13.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.200+0000 7efd2be00640 1 --2- 172.21.15.175:0/3121572357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd2c0b27c0 0x7efd2c15d830 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7efd2c072a40 tx=0x7efd2401c490 comp rx=0 tx=0).stop 2024-04-25T09:08:13.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.200+0000 7efd2be00640 1 -- 172.21.15.175:0/3121572357 shutdown_connections 2024-04-25T09:08:13.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.200+0000 7efd2be00640 1 --2- 172.21.15.175:0/3121572357 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd2c0b27c0 0x7efd2c15d830 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:13.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.200+0000 7efd2be00640 1 --2- 172.21.15.175:0/3121572357 >> v2:172.21.15.177:3300/0 conn(0x7efd2c09a090 0x7efd2c0cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:13.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.200+0000 7efd2be00640 1 --2- 172.21.15.175:0/3121572357 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd2c099cb0 0x7efd2c06c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:13.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.200+0000 7efd2be00640 1 -- 172.21.15.175:0/3121572357 >> 172.21.15.175:0/3121572357 conn(0x7efd2c0b3160 msgr2=0x7efd2c0b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:13.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.200+0000 7efd2be00640 1 -- 172.21.15.175:0/3121572357 shutdown_connections 2024-04-25T09:08:13.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.200+0000 7efd2be00640 1 -- 172.21.15.175:0/3121572357 wait complete. 2024-04-25T09:08:13.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2be00640 1 Processor -- start 2024-04-25T09:08:13.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2be00640 1 -- start start 2024-04-25T09:08:13.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd2c099cb0 0x7efd2c153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:13.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd2c09a090 0x7efd2c158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:13.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd2c0b27c0 0x7efd2c15bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:13.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2be00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c15e180 con 0x7efd2c099cb0 2024-04-25T09:08:13.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2be00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c0cc200 con 0x7efd2c0b27c0 2024-04-25T09:08:13.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2be00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2c0d0dd0 con 0x7efd2c09a090 2024-04-25T09:08:13.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd2c099cb0 0x7efd2c153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:13.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd2c099cb0 0x7efd2c153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41494/0 (socket says 172.21.15.175:41494) 2024-04-25T09:08:13.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2aa00640 1 -- 172.21.15.175:0/498247255 learned_addr learned my addr 172.21.15.175:0/498247255 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:13.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd22000640 1 --2- 172.21.15.175:0/498247255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd2c09a090 0x7efd2c158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:13.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2b400640 1 --2- 172.21.15.175:0/498247255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd2c0b27c0 0x7efd2c15bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:13.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2aa00640 1 -- 172.21.15.175:0/498247255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd2c09a090 msgr2=0x7efd2c158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:13.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2aa00640 1 --2- 172.21.15.175:0/498247255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd2c09a090 0x7efd2c158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:13.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2aa00640 1 -- 172.21.15.175:0/498247255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd2c0b27c0 msgr2=0x7efd2c15bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:13.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2aa00640 1 --2- 172.21.15.175:0/498247255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd2c0b27c0 0x7efd2c15bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:13.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2aa00640 1 -- 172.21.15.175:0/498247255 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2c153c70 con 0x7efd2c099cb0 2024-04-25T09:08:13.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2aa00640 1 --2- 172.21.15.175:0/498247255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd2c099cb0 0x7efd2c153730 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7efd1c00eed0 tx=0x7efd1c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:13.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd23e00640 1 -- 172.21.15.175:0/498247255 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c018020 con 0x7efd2c099cb0 2024-04-25T09:08:13.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd23e00640 1 -- 172.21.15.175:0/498247255 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c014400 con 0x7efd2c099cb0 2024-04-25T09:08:13.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd23e00640 1 -- 172.21.15.175:0/498247255 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0147d0 con 0x7efd2c099cb0 2024-04-25T09:08:13.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2be00640 1 -- 172.21.15.175:0/498247255 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd2c0ca2b0 con 0x7efd2c099cb0 2024-04-25T09:08:13.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.204+0000 7efd2be00640 1 -- 172.21.15.175:0/498247255 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd2c0ca870 con 0x7efd2c099cb0 2024-04-25T09:08:13.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.208+0000 7efd2be00640 1 -- 172.21.15.175:0/498247255 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd2c074a60 con 0x7efd2c099cb0 2024-04-25T09:08:13.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.208+0000 7efd23e00640 1 -- 172.21.15.175:0/498247255 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efd1c01b020 con 0x7efd2c099cb0 2024-04-25T09:08:13.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.208+0000 7efd23e00640 1 --2- 172.21.15.175:0/498247255 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efd08066f60 0x7efd08069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:13.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.208+0000 7efd23e00640 1 -- 172.21.15.175:0/498247255 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efd1c085630 con 0x7efd2c099cb0 2024-04-25T09:08:13.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.208+0000 7efd22000640 1 --2- 172.21.15.175:0/498247255 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efd08066f60 0x7efd08069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:13.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.208+0000 7efd22000640 1 --2- 172.21.15.175:0/498247255 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efd08066f60 0x7efd08069420 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efd2c09a810 tx=0x7efd14009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:13.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.212+0000 7efd23e00640 1 -- 172.21.15.175:0/498247255 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efd1c022030 con 0x7efd2c099cb0 2024-04-25T09:08:13.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.376+0000 7efd2be00640 1 -- 172.21.15.175:0/498247255 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7efd2c0b36e0 con 0x7efd2c099cb0 2024-04-25T09:08:13.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.980+0000 7efd23e00640 1 -- 172.21.15.175:0/498247255 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v63) v1 ==== 97+0+0 (secure 0 0 0) 0x7efd1c056250 con 0x7efd2c099cb0 2024-04-25T09:08:13.969 INFO:teuthology.orchestra.run.smithi175.stderr: removed all blocklist entries 2024-04-25T09:08:13.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.980+0000 7efd2be00640 1 -- 172.21.15.175:0/498247255 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efd08066f60 msgr2=0x7efd08069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:13.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.980+0000 7efd2be00640 1 --2- 172.21.15.175:0/498247255 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efd08066f60 0x7efd08069420 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efd2c09a810 tx=0x7efd14009190 comp rx=0 tx=0).stop 2024-04-25T09:08:13.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.980+0000 7efd2be00640 1 -- 172.21.15.175:0/498247255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd2c099cb0 msgr2=0x7efd2c153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:13.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.980+0000 7efd2be00640 1 --2- 172.21.15.175:0/498247255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd2c099cb0 0x7efd2c153730 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7efd1c00eed0 tx=0x7efd1c00b480 comp rx=0 tx=0).stop 2024-04-25T09:08:13.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.980+0000 7efd2be00640 1 -- 172.21.15.175:0/498247255 shutdown_connections 2024-04-25T09:08:13.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.980+0000 7efd2be00640 1 --2- 172.21.15.175:0/498247255 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efd08066f60 0x7efd08069420 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:13.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.980+0000 7efd2be00640 1 --2- 172.21.15.175:0/498247255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd2c0b27c0 0x7efd2c15bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:13.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.980+0000 7efd2be00640 1 --2- 172.21.15.175:0/498247255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd2c09a090 0x7efd2c158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:13.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.984+0000 7efd2be00640 1 --2- 172.21.15.175:0/498247255 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd2c099cb0 0x7efd2c153730 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:13.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.984+0000 7efd2be00640 1 -- 172.21.15.175:0/498247255 >> 172.21.15.175:0/498247255 conn(0x7efd2c0b3160 msgr2=0x7efd2c159990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:13.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.984+0000 7efd2be00640 1 -- 172.21.15.175:0/498247255 shutdown_connections 2024-04-25T09:08:13.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:13.984+0000 7efd2be00640 1 -- 172.21.15.175:0/498247255 wait complete. 2024-04-25T09:08:13.996 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:08:14.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.140+0000 7f8cb4800640 1 Processor -- start 2024-04-25T09:08:14.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.144+0000 7f8cb4800640 1 -- start start 2024-04-25T09:08:14.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.144+0000 7f8cb4800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8cac06cc50 0x7f8cac0cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:14.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.144+0000 7f8cb4800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cac0cfcb0 con 0x7f8cac06bd60 2024-04-25T09:08:14.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.144+0000 7f8cb4800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cac0cff90 con 0x7f8cac099a50 2024-04-25T09:08:14.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.144+0000 7f8cb4800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cac0d1460 con 0x7f8cac06cc50 2024-04-25T09:08:14.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.144+0000 7f8cb1400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f8cac06bd60 0x7f8cac0d0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:52494/0 (socket says 172.21.15.175:52494) 2024-04-25T09:08:14.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.144+0000 7f8cb1400640 1 -- 172.21.15.175:0/824513611 learned_addr learned my addr 172.21.15.175:0/824513611 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:14.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.144+0000 7f8cb2800640 1 --2- 172.21.15.175:0/824513611 >> v2:172.21.15.175:3300/0 conn(0x7f8cac06cc50 0x7f8cac0cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:14.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.144+0000 7f8cb0a00640 1 -- 172.21.15.175:0/824513611 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2044316593 0 0) 0x7f8cac0cfcb0 con 0x7f8cac06bd60 2024-04-25T09:08:14.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.144+0000 7f8cb0a00640 1 -- 172.21.15.175:0/824513611 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c94003530 con 0x7f8cac06bd60 2024-04-25T09:08:14.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.144+0000 7f8cb2800640 1 -- 172.21.15.175:0/824513611 >> v1:172.21.15.177:6789/0 conn(0x7f8cac099a50 legacy=0x7f8cac099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:14.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.144+0000 7f8cb2800640 1 -- 172.21.15.175:0/824513611 >> v1:172.21.15.175:6789/0 conn(0x7f8cac06bd60 legacy=0x7f8cac0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:14.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.144+0000 7f8cb2800640 1 -- 172.21.15.175:0/824513611 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac0d0270 con 0x7f8cac06cc50 2024-04-25T09:08:14.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.148+0000 7f8cb2800640 1 --2- 172.21.15.175:0/824513611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cac06cc50 0x7f8cac0cbe60 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009d90 tx=0x7f8ca801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0da08481145eeff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:14.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.148+0000 7f8cb0a00640 1 -- 172.21.15.175:0/824513611 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80b2070 con 0x7f8cac06cc50 2024-04-25T09:08:14.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.148+0000 7f8cb0a00640 1 -- 172.21.15.175:0/824513611 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca80a5920 con 0x7f8cac06cc50 2024-04-25T09:08:14.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.148+0000 7f8cb0a00640 1 -- 172.21.15.175:0/824513611 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80a5cf0 con 0x7f8cac06cc50 2024-04-25T09:08:14.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.148+0000 7f8cb4800640 1 -- 172.21.15.175:0/824513611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cac06cc50 msgr2=0x7f8cac0cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:14.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.148+0000 7f8cb4800640 1 --2- 172.21.15.175:0/824513611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cac06cc50 0x7f8cac0cbe60 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009d90 tx=0x7f8ca801c970 comp rx=0 tx=0).stop 2024-04-25T09:08:14.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.148+0000 7f8cb4800640 1 -- 172.21.15.175:0/824513611 shutdown_connections 2024-04-25T09:08:14.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.148+0000 7f8cb4800640 1 --2- 172.21.15.175:0/824513611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cac06cc50 0x7f8cac0cbe60 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.148+0000 7f8cb4800640 1 -- 172.21.15.175:0/824513611 >> 172.21.15.175:0/824513611 conn(0x7f8cac0b3300 msgr2=0x7f8cac0b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:14.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.148+0000 7f8cb4800640 1 -- 172.21.15.175:0/824513611 shutdown_connections 2024-04-25T09:08:14.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.148+0000 7f8cb4800640 1 -- 172.21.15.175:0/824513611 wait complete. 2024-04-25T09:08:14.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.148+0000 7f8cb4800640 1 Processor -- start 2024-04-25T09:08:14.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.148+0000 7f8cb4800640 1 -- start start 2024-04-25T09:08:14.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb4800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cac06bd60 0x7f8cac0b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:14.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb4800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cac06cc50 0x7f8cac14bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:14.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb4800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cac099a50 0x7f8cac153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:14.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb4800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac0cc7b0 con 0x7f8cac06bd60 2024-04-25T09:08:14.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb4800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac06d060 con 0x7f8cac06cc50 2024-04-25T09:08:14.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb4800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac0cc930 con 0x7f8cac099a50 2024-04-25T09:08:14.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb1e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cac06bd60 0x7f8cac0b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:14.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb1e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cac06bd60 0x7f8cac0b5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41502/0 (socket says 172.21.15.175:41502) 2024-04-25T09:08:14.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb1e00640 1 -- 172.21.15.175:0/4066039954 learned_addr learned my addr 172.21.15.175:0/4066039954 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:14.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb2800640 1 --2- 172.21.15.175:0/4066039954 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cac099a50 0x7f8cac153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:14.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb1400640 1 --2- 172.21.15.175:0/4066039954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cac06cc50 0x7f8cac14bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:14.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb1e00640 1 -- 172.21.15.175:0/4066039954 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cac099a50 msgr2=0x7f8cac153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:14.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb1e00640 1 --2- 172.21.15.175:0/4066039954 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cac099a50 0x7f8cac153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb1e00640 1 -- 172.21.15.175:0/4066039954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cac06cc50 msgr2=0x7f8cac14bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:14.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb1e00640 1 --2- 172.21.15.175:0/4066039954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cac06cc50 0x7f8cac14bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb1e00640 1 -- 172.21.15.175:0/4066039954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac0b5090 con 0x7f8cac06bd60 2024-04-25T09:08:14.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb1400640 1 --2- 172.21.15.175:0/4066039954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cac06cc50 0x7f8cac14bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:14.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb1e00640 1 --2- 172.21.15.175:0/4066039954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cac06bd60 0x7f8cac0b5e50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000c3a0 tx=0x7f8ca000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:14.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8ca6000640 1 -- 172.21.15.175:0/4066039954 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00052d0 con 0x7f8cac06bd60 2024-04-25T09:08:14.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8ca6000640 1 -- 172.21.15.175:0/4066039954 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca0005470 con 0x7f8cac06bd60 2024-04-25T09:08:14.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb4800640 1 -- 172.21.15.175:0/4066039954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cac0b5370 con 0x7f8cac06bd60 2024-04-25T09:08:14.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8ca6000640 1 -- 172.21.15.175:0/4066039954 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0007260 con 0x7f8cac06bd60 2024-04-25T09:08:14.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb4800640 1 -- 172.21.15.175:0/4066039954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cac1543e0 con 0x7f8cac06bd60 2024-04-25T09:08:14.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8cb4800640 1 -- 172.21.15.175:0/4066039954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cac074a60 con 0x7f8cac06bd60 2024-04-25T09:08:14.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.152+0000 7f8ca6000640 1 -- 172.21.15.175:0/4066039954 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8ca0007400 con 0x7f8cac06bd60 2024-04-25T09:08:14.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.156+0000 7f8ca6000640 1 --2- 172.21.15.175:0/4066039954 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8c90066f60 0x7f8c90069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:14.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.156+0000 7f8ca6000640 1 -- 172.21.15.175:0/4066039954 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8ca00840d0 con 0x7f8cac06bd60 2024-04-25T09:08:14.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.156+0000 7f8cb1400640 1 --2- 172.21.15.175:0/4066039954 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8c90066f60 0x7f8c90069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:14.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.156+0000 7f8cb1400640 1 --2- 172.21.15.175:0/4066039954 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8c90066f60 0x7f8c90069420 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8cac1fadb0 tx=0x7f8c9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:14.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.160+0000 7f8ca6000640 1 -- 172.21.15.175:0/4066039954 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8ca0054dd0 con 0x7f8cac06bd60 2024-04-25T09:08:14.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.364+0000 7f8cb4800640 1 -- 172.21.15.175:0/4066039954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8cac0cc180 con 0x7f8cac06bd60 2024-04-25T09:08:14.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.364+0000 7f8ca6000640 1 -- 172.21.15.175:0/4066039954 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8ca0058e70 con 0x7f8cac06bd60 2024-04-25T09:08:14.355 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:14.356 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:08:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: "auth_dump": [ 2024-04-25T09:08:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.a", 2024-04-25T09:08:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpm3usiKxAAROh+31LaNyuh2SdeW6pKjQ==", 2024-04-25T09:08:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:08:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:08:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:08:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:08:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:08:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.356 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.b", 2024-04-25T09:08:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmYJoRNxAAZfRvDn1aoR0wa2mEKBrr+A==", 2024-04-25T09:08:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:08:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:08:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:08:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:08:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:08:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.c", 2024-04-25T09:08:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmk8M3MhAA6aIN33aWvVcvVEFtHL8SWA==", 2024-04-25T09:08:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.357 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:08:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:08:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:08:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:08:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:08:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.d", 2024-04-25T09:08:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmLAHLAhAA+mWUfpb6izHixJa073r9Jw==", 2024-04-25T09:08:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:08:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:08:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:08:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:08:14.358 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:08:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.0", 2024-04-25T09:08:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBSHCpm2xftAxAAxs9n8AE2H3HpPHEUZA4Cng==", 2024-04-25T09:08:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:08:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:08:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:08:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:08:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.1", 2024-04-25T09:08:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBVHCpm/OOlDRAAA7zaD8qsqS2TOCKhDFheJw==", 2024-04-25T09:08:14.359 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:08:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:08:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:08:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:08:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.2", 2024-04-25T09:08:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBYHCpmy/kmFxAAwCADFI/jMe27gAmyuAJZHQ==", 2024-04-25T09:08:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:08:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:08:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:08:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:08:14.360 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.3", 2024-04-25T09:08:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBbHCpm89a7HhAAVTueOuS0/Ksf8SdWK+Nm1g==", 2024-04-25T09:08:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:08:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:08:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:08:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:08:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.4", 2024-04-25T09:08:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBhHCpm5EAtFRAAeADhjja0BOIvxY3RB+n6+A==", 2024-04-25T09:08:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:08:14.361 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:08:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:08:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:08:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.5", 2024-04-25T09:08:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBkHCpmrLilHRAA+H8Bejnk49YfaUvl3Nrrhw==", 2024-04-25T09:08:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:08:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:08:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:08:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:08:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.362 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.6", 2024-04-25T09:08:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBnHCpm6uDxJRAAX5EwEelnZXwEHnNnv+XQ6A==", 2024-04-25T09:08:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:08:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:08:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:08:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:08:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.7", 2024-04-25T09:08:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBqHCpmwow5MBAA7b/Q9DiPO6Bfldq1+rf+/w==", 2024-04-25T09:08:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:08:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:08:14.363 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:08:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:08:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.0", 2024-04-25T09:08:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmhyCUBhAA8k9xLKIw8R04i6HSJykDfw==", 2024-04-25T09:08:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:08:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow r", 2024-04-25T09:08:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:08:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:08:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.1", 2024-04-25T09:08:14.364 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmQigrEBAAoWfP1ZEosbLELev5z+C9/g==", 2024-04-25T09:08:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:08:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:08:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:08:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:08:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:08:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.2", 2024-04-25T09:08:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpm0xaSDBAAup34GS3pnMwjksVuuUGOkw==", 2024-04-25T09:08:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:08:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:08:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:08:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:08:14.365 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:08:14.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.366 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.3", 2024-04-25T09:08:14.366 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpm6+doFhAAA18OgwfM8gXgQ6g0KUo7Hw==", 2024-04-25T09:08:14.366 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.366 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:08:14.366 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:08:14.366 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:08:14.366 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:08:14.366 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:08:14.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.366 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.admin", 2024-04-25T09:08:14.366 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmRZAYDRAA9sepw/fI2OhoZXER6Rmd+g==", 2024-04-25T09:08:14.366 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:08:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:08:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:08:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:08:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:08:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mgr.x", 2024-04-25T09:08:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpm5q4gJxAA9zPRlimxM0+Rb5RQkcoxzQ==", 2024-04-25T09:08:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:08:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile mgr", 2024-04-25T09:08:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:08:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:08:14.367 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mgr.y", 2024-04-25T09:08:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmMLIqIxAAiMo8+3lU0fXNoI6kBrro+Q==", 2024-04-25T09:08:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:08:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:08:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile mgr", 2024-04-25T09:08:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:08:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:14.368 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-25T09:08:14.368 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:08:14.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.368+0000 7f8cb4800640 1 -- 172.21.15.175:0/4066039954 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8c90066f60 msgr2=0x7f8c90069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:14.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.368+0000 7f8cb4800640 1 --2- 172.21.15.175:0/4066039954 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8c90066f60 0x7f8c90069420 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8cac1fadb0 tx=0x7f8c9c009040 comp rx=0 tx=0).stop 2024-04-25T09:08:14.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.368+0000 7f8cb4800640 1 -- 172.21.15.175:0/4066039954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cac06bd60 msgr2=0x7f8cac0b5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:14.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.368+0000 7f8cb4800640 1 --2- 172.21.15.175:0/4066039954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cac06bd60 0x7f8cac0b5e50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000c3a0 tx=0x7f8ca000c860 comp rx=0 tx=0).stop 2024-04-25T09:08:14.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.368+0000 7f8cb4800640 1 -- 172.21.15.175:0/4066039954 shutdown_connections 2024-04-25T09:08:14.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.368+0000 7f8cb4800640 1 --2- 172.21.15.175:0/4066039954 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8c90066f60 0x7f8c90069420 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.368+0000 7f8cb4800640 1 --2- 172.21.15.175:0/4066039954 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8cac099a50 0x7f8cac153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.368+0000 7f8cb4800640 1 --2- 172.21.15.175:0/4066039954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8cac06cc50 0x7f8cac14bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.368+0000 7f8cb4800640 1 --2- 172.21.15.175:0/4066039954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8cac06bd60 0x7f8cac0b5e50 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.368+0000 7f8cb4800640 1 -- 172.21.15.175:0/4066039954 >> 172.21.15.175:0/4066039954 conn(0x7f8cac0b3300 msgr2=0x7f8cac0ae530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:14.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.368+0000 7f8cb4800640 1 -- 172.21.15.175:0/4066039954 shutdown_connections 2024-04-25T09:08:14.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.368+0000 7f8cb4800640 1 -- 172.21.15.175:0/4066039954 wait complete. 2024-04-25T09:08:14.377 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:08:14.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.524+0000 7f9ffc800640 1 Processor -- start 2024-04-25T09:08:14.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.524+0000 7f9ffc800640 1 -- start start 2024-04-25T09:08:14.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.524+0000 7f9ffc800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9ff4144fc0 0x7f9ff40cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:14.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.524+0000 7f9ffc800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff415cd00 con 0x7f9ff415c5e0 2024-04-25T09:08:14.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.524+0000 7f9ffc800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff40ce660 con 0x7f9ff41453a0 2024-04-25T09:08:14.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.524+0000 7f9ffc800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff40cc930 con 0x7f9ff4144fc0 2024-04-25T09:08:14.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.524+0000 7f9ffa800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f9ff415c5e0 0x7f9ff40cee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:52496/0 (socket says 172.21.15.175:52496) 2024-04-25T09:08:14.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.524+0000 7f9ffa800640 1 -- 172.21.15.175:0/3277148832 learned_addr learned my addr 172.21.15.175:0/3277148832 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:14.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.524+0000 7f9ff9e00640 1 --2- 172.21.15.175:0/3277148832 >> v2:172.21.15.177:3300/0 conn(0x7f9ff4144fc0 0x7f9ff40cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:14.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.524+0000 7f9ff8a00640 1 -- 172.21.15.175:0/3277148832 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568684535 0 0) 0x7f9ff415cd00 con 0x7f9ff415c5e0 2024-04-25T09:08:14.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.524+0000 7f9ff8a00640 1 -- 172.21.15.175:0/3277148832 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fdc003530 con 0x7f9ff415c5e0 2024-04-25T09:08:14.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.528+0000 7f9ff9e00640 1 -- 172.21.15.175:0/3277148832 >> v1:172.21.15.177:6789/0 conn(0x7f9ff41453a0 legacy=0x7f9ff415bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:14.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.528+0000 7f9ff8a00640 1 -- 172.21.15.175:0/3277148832 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392401018 0 0) 0x7f9ff40ce660 con 0x7f9ff41453a0 2024-04-25T09:08:14.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.528+0000 7f9ff9e00640 1 -- 172.21.15.175:0/3277148832 >> v1:172.21.15.175:6789/0 conn(0x7f9ff415c5e0 legacy=0x7f9ff40cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:14.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.528+0000 7f9ff9e00640 1 -- 172.21.15.175:0/3277148832 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff40ccc10 con 0x7f9ff4144fc0 2024-04-25T09:08:14.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.528+0000 7f9ff9e00640 1 --2- 172.21.15.175:0/3277148832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ff4144fc0 0x7f9ff40cbe70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80097f0 tx=0x7f9fe801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=856accb737a3264b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:14.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.528+0000 7f9ff8a00640 1 -- 172.21.15.175:0/3277148832 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe80b1070 con 0x7f9ff4144fc0 2024-04-25T09:08:14.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.528+0000 7f9ff8a00640 1 -- 172.21.15.175:0/3277148832 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe80ac5f0 con 0x7f9ff4144fc0 2024-04-25T09:08:14.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.528+0000 7f9ff8a00640 1 -- 172.21.15.175:0/3277148832 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe80ac9a0 con 0x7f9ff4144fc0 2024-04-25T09:08:14.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.528+0000 7f9ffc800640 1 -- 172.21.15.175:0/3277148832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ff4144fc0 msgr2=0x7f9ff40cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:14.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.528+0000 7f9ffc800640 1 --2- 172.21.15.175:0/3277148832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ff4144fc0 0x7f9ff40cbe70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80097f0 tx=0x7f9fe801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ffc800640 1 -- 172.21.15.175:0/3277148832 shutdown_connections 2024-04-25T09:08:14.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ffc800640 1 --2- 172.21.15.175:0/3277148832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ff4144fc0 0x7f9ff40cbe70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ffc800640 1 -- 172.21.15.175:0/3277148832 >> 172.21.15.175:0/3277148832 conn(0x7f9ff4067150 msgr2=0x7f9ff406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:14.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ffc800640 1 -- 172.21.15.175:0/3277148832 shutdown_connections 2024-04-25T09:08:14.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ffc800640 1 -- 172.21.15.175:0/3277148832 wait complete. 2024-04-25T09:08:14.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ffc800640 1 Processor -- start 2024-04-25T09:08:14.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ffc800640 1 -- start start 2024-04-25T09:08:14.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ffc800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ff41453a0 0x7f9ff415fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:14.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ffc800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ff415c5e0 0x7f9ff415a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:14.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ffc800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ff415abe0 0x7f9ff40acf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:14.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ffc800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff4169600 con 0x7f9ff415c5e0 2024-04-25T09:08:14.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ffc800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff40cff50 con 0x7f9ff41453a0 2024-04-25T09:08:14.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ffc800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff4169780 con 0x7f9ff415abe0 2024-04-25T09:08:14.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ff9400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ff415c5e0 0x7f9ff415a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:14.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ff9400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ff415c5e0 0x7f9ff415a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41504/0 (socket says 172.21.15.175:41504) 2024-04-25T09:08:14.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ff9400640 1 -- 172.21.15.175:0/3807012361 learned_addr learned my addr 172.21.15.175:0/3807012361 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:14.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ff9400640 1 -- 172.21.15.175:0/3807012361 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ff415abe0 msgr2=0x7f9ff40acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:14.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ffa800640 1 --2- 172.21.15.175:0/3807012361 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ff415abe0 0x7f9ff40acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:14.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ff9e00640 1 --2- 172.21.15.175:0/3807012361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ff41453a0 0x7f9ff415fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:14.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ff9400640 1 --2- 172.21.15.175:0/3807012361 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ff415abe0 0x7f9ff40acf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ff9400640 1 -- 172.21.15.175:0/3807012361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ff41453a0 msgr2=0x7f9ff415fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:14.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ff9400640 1 --2- 172.21.15.175:0/3807012361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ff41453a0 0x7f9ff415fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ff9400640 1 -- 172.21.15.175:0/3807012361 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff4139cd0 con 0x7f9ff415c5e0 2024-04-25T09:08:14.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ffa800640 1 --2- 172.21.15.175:0/3807012361 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ff415abe0 0x7f9ff40acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:14.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ff9e00640 1 --2- 172.21.15.175:0/3807012361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ff41453a0 0x7f9ff415fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:14.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ff9400640 1 --2- 172.21.15.175:0/3807012361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ff415c5e0 0x7f9ff415a390 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400c480 tx=0x7f9fe400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:14.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9fee000640 1 -- 172.21.15.175:0/3807012361 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe40052d0 con 0x7f9ff415c5e0 2024-04-25T09:08:14.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9fee000640 1 -- 172.21.15.175:0/3807012361 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe4005490 con 0x7f9ff415c5e0 2024-04-25T09:08:14.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9fee000640 1 -- 172.21.15.175:0/3807012361 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4012850 con 0x7f9ff415c5e0 2024-04-25T09:08:14.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.532+0000 7f9ffc800640 1 -- 172.21.15.175:0/3807012361 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff415ed20 con 0x7f9ff415c5e0 2024-04-25T09:08:14.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.536+0000 7f9ffc800640 1 -- 172.21.15.175:0/3807012361 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff4139fb0 con 0x7f9ff415c5e0 2024-04-25T09:08:14.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.536+0000 7f9ffc800640 1 -- 172.21.15.175:0/3807012361 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff4074a60 con 0x7f9ff415c5e0 2024-04-25T09:08:14.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.536+0000 7f9fee000640 1 -- 172.21.15.175:0/3807012361 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9fe40129f0 con 0x7f9ff415c5e0 2024-04-25T09:08:14.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.536+0000 7f9fee000640 1 --2- 172.21.15.175:0/3807012361 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9fd8066f90 0x7f9fd8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:14.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.536+0000 7f9fee000640 1 -- 172.21.15.175:0/3807012361 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9fe4084920 con 0x7f9ff415c5e0 2024-04-25T09:08:14.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.536+0000 7f9ff9e00640 1 --2- 172.21.15.175:0/3807012361 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9fd8066f90 0x7f9fd8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:14.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.536+0000 7f9ff9e00640 1 --2- 172.21.15.175:0/3807012361 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9fd8066f90 0x7f9fd8069450 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80ae000 tx=0x7f9fe8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:14.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.540+0000 7f9fee000640 1 -- 172.21.15.175:0/3807012361 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9fe4055c70 con 0x7f9ff415c5e0 2024-04-25T09:08:14.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.696+0000 7f9ffc800640 1 -- 172.21.15.175:0/3807012361 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ff406adf0 con 0x7f9ff415c5e0 2024-04-25T09:08:14.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.696+0000 7f9fee000640 1 -- 172.21.15.175:0/3807012361 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+12927 (secure 0 0 0) 0x7f9fe4055570 con 0x7f9ff415c5e0 2024-04-25T09:08:14.685 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:14.685 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":65,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:08:13.997188+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:08:14.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.696+0000 7f9ffc800640 1 -- 172.21.15.175:0/3807012361 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9fd8066f90 msgr2=0x7f9fd8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:14.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.696+0000 7f9ffc800640 1 --2- 172.21.15.175:0/3807012361 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9fd8066f90 0x7f9fd8069450 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80ae000 tx=0x7f9fe8008040 comp rx=0 tx=0).stop 2024-04-25T09:08:14.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.696+0000 7f9ffc800640 1 -- 172.21.15.175:0/3807012361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ff415c5e0 msgr2=0x7f9ff415a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:14.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.696+0000 7f9ffc800640 1 --2- 172.21.15.175:0/3807012361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ff415c5e0 0x7f9ff415a390 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f9fe400c480 tx=0x7f9fe400c940 comp rx=0 tx=0).stop 2024-04-25T09:08:14.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.696+0000 7f9ffc800640 1 -- 172.21.15.175:0/3807012361 shutdown_connections 2024-04-25T09:08:14.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.696+0000 7f9ffc800640 1 --2- 172.21.15.175:0/3807012361 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9fd8066f90 0x7f9fd8069450 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.696+0000 7f9ffc800640 1 --2- 172.21.15.175:0/3807012361 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ff415abe0 0x7f9ff40acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.696+0000 7f9ffc800640 1 --2- 172.21.15.175:0/3807012361 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ff415c5e0 0x7f9ff415a390 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.696+0000 7f9ffc800640 1 --2- 172.21.15.175:0/3807012361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ff41453a0 0x7f9ff415fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.696+0000 7f9ffc800640 1 -- 172.21.15.175:0/3807012361 >> 172.21.15.175:0/3807012361 conn(0x7f9ff4144fc0 msgr2=0x7f9ff40b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:14.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.696+0000 7f9ffc800640 1 -- 172.21.15.175:0/3807012361 shutdown_connections 2024-04-25T09:08:14.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.696+0000 7f9ffc800640 1 -- 172.21.15.175:0/3807012361 wait complete. 2024-04-25T09:08:14.706 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:08:14.706 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:08:14.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.856+0000 7f940d800640 1 Processor -- start 2024-04-25T09:08:14.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.856+0000 7f940d800640 1 -- start start 2024-04-25T09:08:14.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.856+0000 7f940d800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f94080cbe60 0x7f940815af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:14.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.856+0000 7f940d800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94080b4800 0x7f940815c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:14.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.856+0000 7f940d800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940806db60 con 0x7f940806d310 2024-04-25T09:08:14.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.856+0000 7f940d800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f940806de40 con 0x7f94080cbe60 2024-04-25T09:08:14.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.856+0000 7f940d800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940806e120 con 0x7f94080b4800 2024-04-25T09:08:14.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.856+0000 7f9406a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f94080cbe60 0x7f940815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:14.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.856+0000 7f9406a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f94080cbe60 0x7f940815af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41520/0 (socket says 172.21.15.175:41520) 2024-04-25T09:08:14.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.856+0000 7f9406a00640 1 -- 172.21.15.175:0/2484283078 learned_addr learned my addr 172.21.15.175:0/2484283078 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:14.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.856+0000 7f9407400640 1 --2- 172.21.15.175:0/2484283078 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94080b4800 0x7f940815c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:14.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.856+0000 7f9406a00640 1 -- 172.21.15.175:0/2484283078 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94080b4800 msgr2=0x7f940815c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:14.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.856+0000 7f9406a00640 1 --2- 172.21.15.175:0/2484283078 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94080b4800 0x7f940815c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.856+0000 7f9406a00640 1 -- 172.21.15.175:0/2484283078 >> v1:172.21.15.177:6789/0 conn(0x7f940806d310 legacy=0x7f94080b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:14.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.856+0000 7f9406a00640 1 -- 172.21.15.175:0/2484283078 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940815c2f0 con 0x7f94080cbe60 2024-04-25T09:08:14.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.856+0000 7f9407400640 1 --2- 172.21.15.175:0/2484283078 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94080b4800 0x7f940815c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:14.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.860+0000 7f9406a00640 1 --2- 172.21.15.175:0/2484283078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94080cbe60 0x7f940815af20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f93f8009870 tx=0x7f93f801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5521d4eeebead04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:14.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.860+0000 7f9405600640 1 -- 172.21.15.175:0/2484283078 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f80b2070 con 0x7f94080cbe60 2024-04-25T09:08:14.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.860+0000 7f9405600640 1 -- 172.21.15.175:0/2484283078 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f80a9070 con 0x7f94080cbe60 2024-04-25T09:08:14.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.860+0000 7f9405600640 1 -- 172.21.15.175:0/2484283078 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f80ad880 con 0x7f94080cbe60 2024-04-25T09:08:14.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.860+0000 7f940d800640 1 -- 172.21.15.175:0/2484283078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94080cbe60 msgr2=0x7f940815af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:14.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.860+0000 7f940d800640 1 --2- 172.21.15.175:0/2484283078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94080cbe60 0x7f940815af20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f93f8009870 tx=0x7f93f801c560 comp rx=0 tx=0).stop 2024-04-25T09:08:14.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.860+0000 7f940d800640 1 -- 172.21.15.175:0/2484283078 shutdown_connections 2024-04-25T09:08:14.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.860+0000 7f940d800640 1 --2- 172.21.15.175:0/2484283078 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94080b4800 0x7f940815c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.860+0000 7f940d800640 1 --2- 172.21.15.175:0/2484283078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94080cbe60 0x7f940815af20 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.860+0000 7f940d800640 1 -- 172.21.15.175:0/2484283078 >> 172.21.15.175:0/2484283078 conn(0x7f940806ac50 msgr2=0x7f940806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:14.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.860+0000 7f940d800640 1 -- 172.21.15.175:0/2484283078 shutdown_connections 2024-04-25T09:08:14.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.860+0000 7f940d800640 1 -- 172.21.15.175:0/2484283078 wait complete. 2024-04-25T09:08:14.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.860+0000 7f940d800640 1 Processor -- start 2024-04-25T09:08:14.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f940d800640 1 -- start start 2024-04-25T09:08:14.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f940d800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f940806d310 0x7f940814d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:14.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f940d800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94080b4800 0x7f94080d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:14.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f940d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94080cbe60 0x7f9408154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:14.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f940d800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940815d770 con 0x7f94080cbe60 2024-04-25T09:08:14.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f940d800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94080cc450 con 0x7f94080b4800 2024-04-25T09:08:14.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f940d800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940815d8f0 con 0x7f940806d310 2024-04-25T09:08:14.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f9407400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94080cbe60 0x7f9408154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:14.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f9407400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94080cbe60 0x7f9408154f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41524/0 (socket says 172.21.15.175:41524) 2024-04-25T09:08:14.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f9407400640 1 -- 172.21.15.175:0/1192757303 learned_addr learned my addr 172.21.15.175:0/1192757303 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:14.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f9406a00640 1 --2- 172.21.15.175:0/1192757303 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f940806d310 0x7f940814d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:14.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f9406000640 1 --2- 172.21.15.175:0/1192757303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94080b4800 0x7f94080d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:14.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f9407400640 1 -- 172.21.15.175:0/1192757303 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f940806d310 msgr2=0x7f940814d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:14.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f9407400640 1 --2- 172.21.15.175:0/1192757303 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f940806d310 0x7f940814d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f9407400640 1 -- 172.21.15.175:0/1192757303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94080b4800 msgr2=0x7f94080d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:14.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f9407400640 1 --2- 172.21.15.175:0/1192757303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94080b4800 0x7f94080d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:14.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f9407400640 1 -- 172.21.15.175:0/1192757303 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94080cb850 con 0x7f94080cbe60 2024-04-25T09:08:14.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f9407400640 1 --2- 172.21.15.175:0/1192757303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94080cbe60 0x7f9408154f50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9400007e70 tx=0x7f940000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:14.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f93fea00640 1 -- 172.21.15.175:0/1192757303 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940001a070 con 0x7f94080cbe60 2024-04-25T09:08:14.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f93fea00640 1 -- 172.21.15.175:0/1192757303 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9400003bc0 con 0x7f94080cbe60 2024-04-25T09:08:14.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f940d800640 1 -- 172.21.15.175:0/1192757303 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94080cf040 con 0x7f94080cbe60 2024-04-25T09:08:14.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f93fea00640 1 -- 172.21.15.175:0/1192757303 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940000de80 con 0x7f94080cbe60 2024-04-25T09:08:14.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f940d800640 1 -- 172.21.15.175:0/1192757303 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94080cf600 con 0x7f94080cbe60 2024-04-25T09:08:14.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.864+0000 7f940d800640 1 -- 172.21.15.175:0/1192757303 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9408075160 con 0x7f94080cbe60 2024-04-25T09:08:14.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.868+0000 7f93fea00640 1 -- 172.21.15.175:0/1192757303 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f940001d070 con 0x7f94080cbe60 2024-04-25T09:08:14.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.868+0000 7f93fea00640 1 --2- 172.21.15.175:0/1192757303 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f93e8066f60 0x7f93e8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:14.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.868+0000 7f93fea00640 1 -- 172.21.15.175:0/1192757303 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9400084ff0 con 0x7f94080cbe60 2024-04-25T09:08:14.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.868+0000 7f9406a00640 1 --2- 172.21.15.175:0/1192757303 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f93e8066f60 0x7f93e8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:14.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.868+0000 7f9406a00640 1 --2- 172.21.15.175:0/1192757303 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f93e8066f60 0x7f93e8069420 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f93f80af000 tx=0x7f93f80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:14.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:14.872+0000 7f93fea00640 1 -- 172.21.15.175:0/1192757303 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9400010070 con 0x7f94080cbe60 2024-04-25T09:08:15.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.032+0000 7f940d800640 1 -- 172.21.15.175:0/1192757303 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f940806b550 con 0x7f94080cbe60 2024-04-25T09:08:15.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.032+0000 7f93fea00640 1 -- 172.21.15.175:0/1192757303 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94000562b0 con 0x7f94080cbe60 2024-04-25T09:08:15.023 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:08:15.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.036+0000 7f940d800640 1 -- 172.21.15.175:0/1192757303 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f93e8066f60 msgr2=0x7f93e8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.036+0000 7f940d800640 1 --2- 172.21.15.175:0/1192757303 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f93e8066f60 0x7f93e8069420 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f93f80af000 tx=0x7f93f80a7000 comp rx=0 tx=0).stop 2024-04-25T09:08:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.036+0000 7f940d800640 1 -- 172.21.15.175:0/1192757303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94080cbe60 msgr2=0x7f9408154f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.036+0000 7f940d800640 1 --2- 172.21.15.175:0/1192757303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94080cbe60 0x7f9408154f50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f9400007e70 tx=0x7f940000d4a0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.036+0000 7f940d800640 1 -- 172.21.15.175:0/1192757303 shutdown_connections 2024-04-25T09:08:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.036+0000 7f940d800640 1 --2- 172.21.15.175:0/1192757303 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f93e8066f60 0x7f93e8069420 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.036+0000 7f940d800640 1 --2- 172.21.15.175:0/1192757303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94080cbe60 0x7f9408154f50 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.036+0000 7f940d800640 1 --2- 172.21.15.175:0/1192757303 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94080b4800 0x7f94080d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.036+0000 7f940d800640 1 --2- 172.21.15.175:0/1192757303 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f940806d310 0x7f940814d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.036+0000 7f940d800640 1 -- 172.21.15.175:0/1192757303 >> 172.21.15.175:0/1192757303 conn(0x7f940806ac50 msgr2=0x7f94080af480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.036+0000 7f940d800640 1 -- 172.21.15.175:0/1192757303 shutdown_connections 2024-04-25T09:08:15.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.036+0000 7f940d800640 1 -- 172.21.15.175:0/1192757303 wait complete. 2024-04-25T09:08:15.043 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:08:15.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.188+0000 7fa7d3e00640 1 Processor -- start 2024-04-25T09:08:15.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.188+0000 7fa7d3e00640 1 -- start start 2024-04-25T09:08:15.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.192+0000 7fa7d3e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa7cc0cd520 0x7fa7cc06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:15.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.192+0000 7fa7d3e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7cc0cda00 con 0x7fa7cc0cf560 2024-04-25T09:08:15.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.192+0000 7fa7d3e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7cc0cdce0 con 0x7fa7cc15a900 2024-04-25T09:08:15.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.192+0000 7fa7d3e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7cc15bcf0 con 0x7fa7cc0cd520 2024-04-25T09:08:15.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.192+0000 7fa7d0a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa7cc0cd520 0x7fa7cc06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:15.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.192+0000 7fa7d0a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa7cc0cd520 0x7fa7cc06e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41540/0 (socket says 172.21.15.175:41540) 2024-04-25T09:08:15.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.192+0000 7fa7d0a00640 1 -- 172.21.15.175:0/1960378863 learned_addr learned my addr 172.21.15.175:0/1960378863 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:15.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.192+0000 7fa7d0a00640 1 -- 172.21.15.175:0/1960378863 >> v1:172.21.15.177:6789/0 conn(0x7fa7cc15a900 legacy=0x7fa7cc0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:15.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.192+0000 7fa7d0a00640 1 -- 172.21.15.175:0/1960378863 >> v1:172.21.15.175:6789/0 conn(0x7fa7cc0cf560 legacy=0x7fa7cc15bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:15.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.192+0000 7fa7d0a00640 1 -- 172.21.15.175:0/1960378863 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc0cdfc0 con 0x7fa7cc0cd520 2024-04-25T09:08:15.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.196+0000 7fa7d0a00640 1 --2- 172.21.15.175:0/1960378863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7cc0cd520 0x7fa7cc06e150 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8009870 tx=0x7fa7b801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e333b5cb258c5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:15.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.196+0000 7fa7cbe00640 1 -- 172.21.15.175:0/1960378863 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b80b2070 con 0x7fa7cc0cd520 2024-04-25T09:08:15.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.196+0000 7fa7cbe00640 1 -- 172.21.15.175:0/1960378863 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b80a9070 con 0x7fa7cc0cd520 2024-04-25T09:08:15.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.196+0000 7fa7cbe00640 1 -- 172.21.15.175:0/1960378863 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b80ad880 con 0x7fa7cc0cd520 2024-04-25T09:08:15.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.196+0000 7fa7d3e00640 1 -- 172.21.15.175:0/1960378863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7cc0cd520 msgr2=0x7fa7cc06e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:15.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.196+0000 7fa7d3e00640 1 --2- 172.21.15.175:0/1960378863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7cc0cd520 0x7fa7cc06e150 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8009870 tx=0x7fa7b801c560 comp rx=0 tx=0).stop 2024-04-25T09:08:15.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.196+0000 7fa7d3e00640 1 -- 172.21.15.175:0/1960378863 shutdown_connections 2024-04-25T09:08:15.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.196+0000 7fa7d3e00640 1 --2- 172.21.15.175:0/1960378863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7cc0cd520 0x7fa7cc06e150 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.196+0000 7fa7d3e00640 1 -- 172.21.15.175:0/1960378863 >> 172.21.15.175:0/1960378863 conn(0x7fa7cc067150 msgr2=0x7fa7cc06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:15.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.196+0000 7fa7d3e00640 1 -- 172.21.15.175:0/1960378863 shutdown_connections 2024-04-25T09:08:15.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.196+0000 7fa7d3e00640 1 -- 172.21.15.175:0/1960378863 wait complete. 2024-04-25T09:08:15.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.196+0000 7fa7d3e00640 1 Processor -- start 2024-04-25T09:08:15.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.196+0000 7fa7d3e00640 1 -- start start 2024-04-25T09:08:15.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7cc0cf560 0x7fa7cc14aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:15.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7cc15a900 0x7fa7cc152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:15.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d3e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7cc14b030 0x7fa7cc159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:15.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d3e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc06d530 con 0x7fa7cc0cf560 2024-04-25T09:08:15.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d3e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc06d3b0 con 0x7fa7cc15a900 2024-04-25T09:08:15.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d3e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc168c20 con 0x7fa7cc14b030 2024-04-25T09:08:15.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d1400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7cc0cf560 0x7fa7cc14aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:15.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d1400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7cc0cf560 0x7fa7cc14aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41542/0 (socket says 172.21.15.175:41542) 2024-04-25T09:08:15.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d1400640 1 -- 172.21.15.175:0/144671837 learned_addr learned my addr 172.21.15.175:0/144671837 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:15.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d0a00640 1 --2- 172.21.15.175:0/144671837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7cc15a900 0x7fa7cc152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:15.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d1e00640 1 --2- 172.21.15.175:0/144671837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7cc14b030 0x7fa7cc159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:15.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d1400640 1 -- 172.21.15.175:0/144671837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7cc14b030 msgr2=0x7fa7cc159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:15.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d1400640 1 --2- 172.21.15.175:0/144671837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7cc14b030 0x7fa7cc159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d1400640 1 -- 172.21.15.175:0/144671837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7cc15a900 msgr2=0x7fa7cc152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:15.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d1400640 1 --2- 172.21.15.175:0/144671837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7cc15a900 0x7fa7cc152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d1400640 1 -- 172.21.15.175:0/144671837 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc0b2e20 con 0x7fa7cc0cf560 2024-04-25T09:08:15.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d1400640 1 --2- 172.21.15.175:0/144671837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7cc0cf560 0x7fa7cc14aa00 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000c370 tx=0x7fa7c000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:15.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7c9600640 1 -- 172.21.15.175:0/144671837 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c00052d0 con 0x7fa7cc0cf560 2024-04-25T09:08:15.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7c9600640 1 -- 172.21.15.175:0/144671837 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c0005470 con 0x7fa7cc0cf560 2024-04-25T09:08:15.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7c9600640 1 -- 172.21.15.175:0/144671837 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0007260 con 0x7fa7cc0cf560 2024-04-25T09:08:15.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d3e00640 1 -- 172.21.15.175:0/144671837 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7cc0b30c0 con 0x7fa7cc0cf560 2024-04-25T09:08:15.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d3e00640 1 -- 172.21.15.175:0/144671837 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7cc0b3680 con 0x7fa7cc0cf560 2024-04-25T09:08:15.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7d3e00640 1 -- 172.21.15.175:0/144671837 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7cc074a60 con 0x7fa7cc0cf560 2024-04-25T09:08:15.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.200+0000 7fa7c9600640 1 -- 172.21.15.175:0/144671837 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa7c0007400 con 0x7fa7cc0cf560 2024-04-25T09:08:15.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.204+0000 7fa7c9600640 1 --2- 172.21.15.175:0/144671837 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa7ac066f60 0x7fa7ac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:15.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.204+0000 7fa7c9600640 1 -- 172.21.15.175:0/144671837 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa7c00841e0 con 0x7fa7cc0cf560 2024-04-25T09:08:15.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.204+0000 7fa7d0a00640 1 --2- 172.21.15.175:0/144671837 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa7ac066f60 0x7fa7ac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:15.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.204+0000 7fa7d0a00640 1 --2- 172.21.15.175:0/144671837 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa7ac066f60 0x7fa7ac069420 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa7b80af000 tx=0x7fa7b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:15.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.208+0000 7fa7c9600640 1 -- 172.21.15.175:0/144671837 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa7c00554a0 con 0x7fa7cc0cf560 2024-04-25T09:08:15.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.360+0000 7fa7d3e00640 1 -- 172.21.15.175:0/144671837 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa7cc1590b0 con 0x7fa7cc0cf560 2024-04-25T09:08:15.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.360+0000 7fa7c9600640 1 -- 172.21.15.175:0/144671837 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v65) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa7c0054da0 con 0x7fa7cc0cf560 2024-04-25T09:08:15.350 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:15.350 INFO:teuthology.orchestra.run.smithi175.stdout:[ 2024-04-25T09:08:15.350 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:08:15.350 INFO:teuthology.orchestra.run.smithi175.stdout: "poolnum": 1, 2024-04-25T09:08:15.350 INFO:teuthology.orchestra.run.smithi175.stdout: "poolname": ".mgr" 2024-04-25T09:08:15.350 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:15.351 INFO:teuthology.orchestra.run.smithi175.stdout:] 2024-04-25T09:08:15.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.360+0000 7fa7d3e00640 1 -- 172.21.15.175:0/144671837 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa7ac066f60 msgr2=0x7fa7ac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:15.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.360+0000 7fa7d3e00640 1 --2- 172.21.15.175:0/144671837 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa7ac066f60 0x7fa7ac069420 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa7b80af000 tx=0x7fa7b8008040 comp rx=0 tx=0).stop 2024-04-25T09:08:15.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.360+0000 7fa7d3e00640 1 -- 172.21.15.175:0/144671837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7cc0cf560 msgr2=0x7fa7cc14aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:15.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.360+0000 7fa7d3e00640 1 --2- 172.21.15.175:0/144671837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7cc0cf560 0x7fa7cc14aa00 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000c370 tx=0x7fa7c000c830 comp rx=0 tx=0).stop 2024-04-25T09:08:15.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.364+0000 7fa7d3e00640 1 -- 172.21.15.175:0/144671837 shutdown_connections 2024-04-25T09:08:15.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.364+0000 7fa7d3e00640 1 --2- 172.21.15.175:0/144671837 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa7ac066f60 0x7fa7ac069420 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.364+0000 7fa7d3e00640 1 --2- 172.21.15.175:0/144671837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa7cc14b030 0x7fa7cc159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.364+0000 7fa7d3e00640 1 --2- 172.21.15.175:0/144671837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa7cc15a900 0x7fa7cc152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.364+0000 7fa7d3e00640 1 --2- 172.21.15.175:0/144671837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7cc0cf560 0x7fa7cc14aa00 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.364+0000 7fa7d3e00640 1 -- 172.21.15.175:0/144671837 >> 172.21.15.175:0/144671837 conn(0x7fa7cc0cd520 msgr2=0x7fa7cc15bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:15.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.364+0000 7fa7d3e00640 1 -- 172.21.15.175:0/144671837 shutdown_connections 2024-04-25T09:08:15.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.364+0000 7fa7d3e00640 1 -- 172.21.15.175:0/144671837 wait complete. 2024-04-25T09:08:15.371 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:08:15.372 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:08:15.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.520+0000 7fa63be00640 1 Processor -- start 2024-04-25T09:08:15.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.520+0000 7fa63be00640 1 -- start start 2024-04-25T09:08:15.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.524+0000 7fa63be00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa6340aebd0 0x7fa63415b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:15.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.524+0000 7fa63be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6340b2700 0x7fa6340b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:15.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.524+0000 7fa63be00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6340b4be0 con 0x7fa6340b47a0 2024-04-25T09:08:15.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.524+0000 7fa63be00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63415b880 con 0x7fa6340aebd0 2024-04-25T09:08:15.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.524+0000 7fa63be00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63415bb60 con 0x7fa6340b2700 2024-04-25T09:08:15.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.524+0000 7fa639400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa6340aebd0 0x7fa63415b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:15.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.524+0000 7fa639e00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fa6340b47a0 0x7fa63406d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:59020/0 (socket says 172.21.15.175:59020) 2024-04-25T09:08:15.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.524+0000 7fa638a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6340b2700 0x7fa6340b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:15.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.524+0000 7fa639e00640 1 -- 172.21.15.175:0/383091640 learned_addr learned my addr 172.21.15.175:0/383091640 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:15.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.524+0000 7fa639400640 1 -- 172.21.15.175:0/383091640 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6340b2700 msgr2=0x7fa6340b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:15.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.524+0000 7fa639400640 1 --2- 172.21.15.175:0/383091640 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6340b2700 0x7fa6340b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.524+0000 7fa639400640 1 -- 172.21.15.175:0/383091640 >> v1:172.21.15.177:6789/0 conn(0x7fa6340b47a0 legacy=0x7fa63406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:15.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.524+0000 7fa639400640 1 -- 172.21.15.175:0/383091640 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63415be40 con 0x7fa6340aebd0 2024-04-25T09:08:15.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.524+0000 7fa638a00640 1 --2- 172.21.15.175:0/383091640 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6340b2700 0x7fa6340b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:08:15.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.528+0000 7fa639400640 1 --2- 172.21.15.175:0/383091640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6340aebd0 0x7fa63415b030 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa628009d90 tx=0x7fa62801c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=957739d937136a3b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:15.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.528+0000 7fa633e00640 1 -- 172.21.15.175:0/383091640 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6280b2070 con 0x7fa6340aebd0 2024-04-25T09:08:15.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.528+0000 7fa633e00640 1 -- 172.21.15.175:0/383091640 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6280a5790 con 0x7fa6340aebd0 2024-04-25T09:08:15.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.528+0000 7fa633e00640 1 -- 172.21.15.175:0/383091640 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6280a5b60 con 0x7fa6340aebd0 2024-04-25T09:08:15.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.528+0000 7fa63be00640 1 -- 172.21.15.175:0/383091640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6340aebd0 msgr2=0x7fa63415b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:15.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.528+0000 7fa63be00640 1 --2- 172.21.15.175:0/383091640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6340aebd0 0x7fa63415b030 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa628009d90 tx=0x7fa62801c770 comp rx=0 tx=0).stop 2024-04-25T09:08:15.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.528+0000 7fa63be00640 1 -- 172.21.15.175:0/383091640 shutdown_connections 2024-04-25T09:08:15.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.528+0000 7fa63be00640 1 --2- 172.21.15.175:0/383091640 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6340b2700 0x7fa6340b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.528+0000 7fa63be00640 1 --2- 172.21.15.175:0/383091640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6340aebd0 0x7fa63415b030 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.528+0000 7fa63be00640 1 -- 172.21.15.175:0/383091640 >> 172.21.15.175:0/383091640 conn(0x7fa63406ac50 msgr2=0x7fa63406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:15.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.528+0000 7fa63be00640 1 -- 172.21.15.175:0/383091640 shutdown_connections 2024-04-25T09:08:15.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.528+0000 7fa63be00640 1 -- 172.21.15.175:0/383091640 wait complete. 2024-04-25T09:08:15.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.528+0000 7fa63be00640 1 Processor -- start 2024-04-25T09:08:15.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.528+0000 7fa63be00640 1 -- start start 2024-04-25T09:08:15.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa63be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6340aebd0 0x7fa6341e6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:15.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa63be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6340b2700 0x7fa63414f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:15.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa63be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6340b47a0 0x7fa6341e8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa63be00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340aefb0 con 0x7fa6340b2700 2024-04-25T09:08:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa63be00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63415b570 con 0x7fa6340aebd0 2024-04-25T09:08:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa63be00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340af130 con 0x7fa6340b47a0 2024-04-25T09:08:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa638a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6340b2700 0x7fa63414f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa638a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6340b2700 0x7fa63414f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41548/0 (socket says 172.21.15.175:41548) 2024-04-25T09:08:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa638a00640 1 -- 172.21.15.175:0/2731547196 learned_addr learned my addr 172.21.15.175:0/2731547196 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa639400640 1 --2- 172.21.15.175:0/2731547196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6340aebd0 0x7fa6341e6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa639e00640 1 --2- 172.21.15.175:0/2731547196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6340b47a0 0x7fa6341e8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa638a00640 1 -- 172.21.15.175:0/2731547196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6340b47a0 msgr2=0x7fa6341e8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa638a00640 1 --2- 172.21.15.175:0/2731547196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6340b47a0 0x7fa6341e8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa638a00640 1 -- 172.21.15.175:0/2731547196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6340aebd0 msgr2=0x7fa6341e6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa638a00640 1 --2- 172.21.15.175:0/2731547196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6340aebd0 0x7fa6341e6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa638a00640 1 -- 172.21.15.175:0/2731547196 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6340b0b10 con 0x7fa6340b2700 2024-04-25T09:08:15.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa638a00640 1 --2- 172.21.15.175:0/2731547196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6340b2700 0x7fa63414f420 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa62000ebe0 tx=0x7fa62000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:15.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa631600640 1 -- 172.21.15.175:0/2731547196 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa620017070 con 0x7fa6340b2700 2024-04-25T09:08:15.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa631600640 1 -- 172.21.15.175:0/2731547196 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62000cc30 con 0x7fa6340b2700 2024-04-25T09:08:15.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa63be00640 1 -- 172.21.15.175:0/2731547196 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6341e6850 con 0x7fa6340b2700 2024-04-25T09:08:15.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa631600640 1 -- 172.21.15.175:0/2731547196 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa620013470 con 0x7fa6340b2700 2024-04-25T09:08:15.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa63be00640 1 -- 172.21.15.175:0/2731547196 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6341e6e10 con 0x7fa6340b2700 2024-04-25T09:08:15.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa63be00640 1 -- 172.21.15.175:0/2731547196 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa634075160 con 0x7fa6340b2700 2024-04-25T09:08:15.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.532+0000 7fa631600640 1 -- 172.21.15.175:0/2731547196 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa62001a070 con 0x7fa6340b2700 2024-04-25T09:08:15.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.536+0000 7fa631600640 1 --2- 172.21.15.175:0/2731547196 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa614066f60 0x7fa614069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:15.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.536+0000 7fa631600640 1 -- 172.21.15.175:0/2731547196 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa620084af0 con 0x7fa6340b2700 2024-04-25T09:08:15.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.536+0000 7fa639400640 1 --2- 172.21.15.175:0/2731547196 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa614066f60 0x7fa614069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:15.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.536+0000 7fa639400640 1 --2- 172.21.15.175:0/2731547196 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa614066f60 0x7fa614069420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa6280af000 tx=0x7fa6280a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:15.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.540+0000 7fa631600640 1 -- 172.21.15.175:0/2731547196 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa620055890 con 0x7fa6340b2700 2024-04-25T09:08:15.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.696+0000 7fa63be00640 1 -- 172.21.15.175:0/2731547196 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa6340ad9b0 con 0x7fa6340b2700 2024-04-25T09:08:15.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.988+0000 7fa631600640 1 -- 172.21.15.175:0/2731547196 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v66) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa620059930 con 0x7fa6340b2700 2024-04-25T09:08:15.977 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_metadata' created 2024-04-25T09:08:15.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.988+0000 7fa63be00640 1 -- 172.21.15.175:0/2731547196 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa614066f60 msgr2=0x7fa614069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:15.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.988+0000 7fa63be00640 1 --2- 172.21.15.175:0/2731547196 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa614066f60 0x7fa614069420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa6280af000 tx=0x7fa6280a7070 comp rx=0 tx=0).stop 2024-04-25T09:08:15.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.988+0000 7fa63be00640 1 -- 172.21.15.175:0/2731547196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6340b2700 msgr2=0x7fa63414f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:15.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.988+0000 7fa63be00640 1 --2- 172.21.15.175:0/2731547196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6340b2700 0x7fa63414f420 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa62000ebe0 tx=0x7fa62000c520 comp rx=0 tx=0).stop 2024-04-25T09:08:15.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.988+0000 7fa63be00640 1 -- 172.21.15.175:0/2731547196 shutdown_connections 2024-04-25T09:08:15.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.988+0000 7fa63be00640 1 --2- 172.21.15.175:0/2731547196 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa614066f60 0x7fa614069420 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.988+0000 7fa63be00640 1 --2- 172.21.15.175:0/2731547196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6340b47a0 0x7fa6341e8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.988+0000 7fa63be00640 1 --2- 172.21.15.175:0/2731547196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6340b2700 0x7fa63414f420 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.988+0000 7fa63be00640 1 --2- 172.21.15.175:0/2731547196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6340aebd0 0x7fa6341e6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:15.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.988+0000 7fa63be00640 1 -- 172.21.15.175:0/2731547196 >> 172.21.15.175:0/2731547196 conn(0x7fa63406ac50 msgr2=0x7fa63406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:15.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.988+0000 7fa63be00640 1 -- 172.21.15.175:0/2731547196 shutdown_connections 2024-04-25T09:08:15.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:15.988+0000 7fa63be00640 1 -- 172.21.15.175:0/2731547196 wait complete. 2024-04-25T09:08:16.003 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:08:16.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.156+0000 7ff7da000640 1 Processor -- start 2024-04-25T09:08:16.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.156+0000 7ff7da000640 1 -- start start 2024-04-25T09:08:16.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.156+0000 7ff7da000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff7d415b830 0x7ff7d40ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:16.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.156+0000 7ff7da000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff7d409a780 0x7ff7d40c5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:16.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.156+0000 7ff7da000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d40cf4c0 con 0x7ff7d40c56c0 2024-04-25T09:08:16.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.156+0000 7ff7da000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d4099a50 con 0x7ff7d409a780 2024-04-25T09:08:16.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.156+0000 7ff7da000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d409a2f0 con 0x7ff7d415b830 2024-04-25T09:08:16.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.156+0000 7ff7cbe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff7d409a780 0x7ff7d40c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:16.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.156+0000 7ff7cbe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff7d409a780 0x7ff7d40c5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41560/0 (socket says 172.21.15.175:41560) 2024-04-25T09:08:16.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.156+0000 7ff7cbe00640 1 -- 172.21.15.175:0/4078771287 learned_addr learned my addr 172.21.15.175:0/4078771287 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:16.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.156+0000 7ff7d8c00640 1 --2- 172.21.15.175:0/4078771287 >> v2:172.21.15.177:3300/0 conn(0x7ff7d415b830 0x7ff7d40ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:16.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.156+0000 7ff7cbe00640 1 -- 172.21.15.175:0/4078771287 >> v2:172.21.15.177:3300/0 conn(0x7ff7d415b830 msgr2=0x7ff7d40ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:16.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.156+0000 7ff7cbe00640 1 --2- 172.21.15.175:0/4078771287 >> v2:172.21.15.177:3300/0 conn(0x7ff7d415b830 0x7ff7d40ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:16.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.156+0000 7ff7cbe00640 1 -- 172.21.15.175:0/4078771287 >> v1:172.21.15.175:6789/0 conn(0x7ff7d40c56c0 legacy=0x7ff7d415f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:16.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.156+0000 7ff7cbe00640 1 -- 172.21.15.175:0/4078771287 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d40cd350 con 0x7ff7d409a780 2024-04-25T09:08:16.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.160+0000 7ff7cbe00640 1 --2- 172.21.15.175:0/4078771287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7d409a780 0x7ff7d40c5180 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4072890 tx=0x7ff7bc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b5b743ab4f8427 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:16.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.160+0000 7ff7d3e00640 1 -- 172.21.15.175:0/4078771287 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc0b0070 con 0x7ff7d409a780 2024-04-25T09:08:16.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.160+0000 7ff7d3e00640 1 -- 172.21.15.175:0/4078771287 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7bc0ab600 con 0x7ff7d409a780 2024-04-25T09:08:16.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.160+0000 7ff7d3e00640 1 -- 172.21.15.175:0/4078771287 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc0ab9d0 con 0x7ff7d409a780 2024-04-25T09:08:16.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.160+0000 7ff7da000640 1 -- 172.21.15.175:0/4078771287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7d409a780 msgr2=0x7ff7d40c5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:16.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.160+0000 7ff7da000640 1 --2- 172.21.15.175:0/4078771287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7d409a780 0x7ff7d40c5180 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff7d4072890 tx=0x7ff7bc01c520 comp rx=0 tx=0).stop 2024-04-25T09:08:16.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.160+0000 7ff7da000640 1 -- 172.21.15.175:0/4078771287 shutdown_connections 2024-04-25T09:08:16.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.160+0000 7ff7da000640 1 --2- 172.21.15.175:0/4078771287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7d409a780 0x7ff7d40c5180 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:16.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.160+0000 7ff7da000640 1 --2- 172.21.15.175:0/4078771287 >> v2:172.21.15.177:3300/0 conn(0x7ff7d415b830 0x7ff7d40ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:16.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.160+0000 7ff7da000640 1 -- 172.21.15.175:0/4078771287 >> 172.21.15.175:0/4078771287 conn(0x7ff7d40b3120 msgr2=0x7ff7d40b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:16.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.160+0000 7ff7da000640 1 -- 172.21.15.175:0/4078771287 shutdown_connections 2024-04-25T09:08:16.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.160+0000 7ff7da000640 1 -- 172.21.15.175:0/4078771287 wait complete. 2024-04-25T09:08:16.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7da000640 1 Processor -- start 2024-04-25T09:08:16.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7da000640 1 -- start start 2024-04-25T09:08:16.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7da000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7d409a780 0x7ff7d41540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:16.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7da000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7d40c56c0 0x7ff7d4159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:16.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7da000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7d415b830 0x7ff7d4159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:16.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7da000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d40c5ad0 con 0x7ff7d415b830 2024-04-25T09:08:16.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7da000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d409ac00 con 0x7ff7d40c56c0 2024-04-25T09:08:16.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7da000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d40c87a0 con 0x7ff7d409a780 2024-04-25T09:08:16.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7d9600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7d415b830 0x7ff7d4159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:16.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7d9600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7d415b830 0x7ff7d4159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41570/0 (socket says 172.21.15.175:41570) 2024-04-25T09:08:16.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7d9600640 1 -- 172.21.15.175:0/3067986978 learned_addr learned my addr 172.21.15.175:0/3067986978 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:16.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7cbe00640 1 --2- 172.21.15.175:0/3067986978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7d40c56c0 0x7ff7d4159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:16.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7d8c00640 1 --2- 172.21.15.175:0/3067986978 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7d409a780 0x7ff7d41540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:16.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7d9600640 1 -- 172.21.15.175:0/3067986978 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7d409a780 msgr2=0x7ff7d41540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:16.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7d9600640 1 --2- 172.21.15.175:0/3067986978 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7d409a780 0x7ff7d41540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:16.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7d9600640 1 -- 172.21.15.175:0/3067986978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7d40c56c0 msgr2=0x7ff7d4159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:16.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7d9600640 1 --2- 172.21.15.175:0/3067986978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7d40c56c0 0x7ff7d4159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:16.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7d9600640 1 -- 172.21.15.175:0/3067986978 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d40c8a80 con 0x7ff7d415b830 2024-04-25T09:08:16.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7d9600640 1 --2- 172.21.15.175:0/3067986978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7d415b830 0x7ff7d4159e50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc00c770 tx=0x7ff7cc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:16.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7d1600640 1 -- 172.21.15.175:0/3067986978 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc003b80 con 0x7ff7d415b830 2024-04-25T09:08:16.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7d1600640 1 -- 172.21.15.175:0/3067986978 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc003d20 con 0x7ff7d415b830 2024-04-25T09:08:16.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7da000640 1 -- 172.21.15.175:0/3067986978 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d40c4e50 con 0x7ff7d415b830 2024-04-25T09:08:16.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7d1600640 1 -- 172.21.15.175:0/3067986978 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc00aa90 con 0x7ff7d415b830 2024-04-25T09:08:16.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7da000640 1 -- 172.21.15.175:0/3067986978 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d40cb470 con 0x7ff7d415b830 2024-04-25T09:08:16.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.164+0000 7ff7da000640 1 -- 172.21.15.175:0/3067986978 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d4074a60 con 0x7ff7d415b830 2024-04-25T09:08:16.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.168+0000 7ff7d1600640 1 -- 172.21.15.175:0/3067986978 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff7cc00ac30 con 0x7ff7d415b830 2024-04-25T09:08:16.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.168+0000 7ff7d1600640 1 --2- 172.21.15.175:0/3067986978 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7b0066f60 0x7ff7b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:16.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.168+0000 7ff7d1600640 1 -- 172.21.15.175:0/3067986978 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5227+0+0 (secure 0 0 0) 0x7ff7cc084ce0 con 0x7ff7d415b830 2024-04-25T09:08:16.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.168+0000 7ff7d8c00640 1 --2- 172.21.15.175:0/3067986978 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7b0066f60 0x7ff7b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:16.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.168+0000 7ff7d8c00640 1 --2- 172.21.15.175:0/3067986978 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7b0066f60 0x7ff7b0069420 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40079c0 tx=0x7ff7c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:16.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.172+0000 7ff7d1600640 1 -- 172.21.15.175:0/3067986978 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff7cc0557e0 con 0x7ff7d415b830 2024-04-25T09:08:16.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.328+0000 7ff7da000640 1 -- 172.21.15.175:0/3067986978 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff7d40b3e20 con 0x7ff7d415b830 2024-04-25T09:08:16.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:16.996+0000 7ff7d1600640 1 -- 172.21.15.175:0/3067986978 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v67) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff7cc059880 con 0x7ff7d415b830 2024-04-25T09:08:16.986 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_data' created 2024-04-25T09:08:16.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.000+0000 7ff7da000640 1 -- 172.21.15.175:0/3067986978 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7b0066f60 msgr2=0x7ff7b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:16.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.000+0000 7ff7da000640 1 --2- 172.21.15.175:0/3067986978 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7b0066f60 0x7ff7b0069420 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40079c0 tx=0x7ff7c4008040 comp rx=0 tx=0).stop 2024-04-25T09:08:16.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.000+0000 7ff7da000640 1 -- 172.21.15.175:0/3067986978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7d415b830 msgr2=0x7ff7d4159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:16.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.000+0000 7ff7da000640 1 --2- 172.21.15.175:0/3067986978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7d415b830 0x7ff7d4159e50 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc00c770 tx=0x7ff7cc00cc30 comp rx=0 tx=0).stop 2024-04-25T09:08:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.000+0000 7ff7da000640 1 -- 172.21.15.175:0/3067986978 shutdown_connections 2024-04-25T09:08:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.000+0000 7ff7da000640 1 --2- 172.21.15.175:0/3067986978 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7b0066f60 0x7ff7b0069420 secure :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40079c0 tx=0x7ff7c4008040 comp rx=0 tx=0).stop 2024-04-25T09:08:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.000+0000 7ff7da000640 1 --2- 172.21.15.175:0/3067986978 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7d415b830 0x7ff7d4159e50 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.000+0000 7ff7da000640 1 --2- 172.21.15.175:0/3067986978 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7d40c56c0 0x7ff7d4159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.000+0000 7ff7da000640 1 --2- 172.21.15.175:0/3067986978 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7d409a780 0x7ff7d41540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.000+0000 7ff7da000640 1 -- 172.21.15.175:0/3067986978 >> 172.21.15.175:0/3067986978 conn(0x7ff7d40b3120 msgr2=0x7ff7d40cf690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.000+0000 7ff7da000640 1 -- 172.21.15.175:0/3067986978 shutdown_connections 2024-04-25T09:08:16.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.000+0000 7ff7da000640 1 -- 172.21.15.175:0/3067986978 wait complete. 2024-04-25T09:08:17.024 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:08:17.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.172+0000 7fbe49a00640 1 Processor -- start 2024-04-25T09:08:17.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.172+0000 7fbe49a00640 1 -- start start 2024-04-25T09:08:17.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.176+0000 7fbe49a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbe4415a5f0 0x7fbe4415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:17.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.176+0000 7fbe49a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4415b3f0 con 0x7fbe4415a9d0 2024-04-25T09:08:17.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.176+0000 7fbe49a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4415b6d0 con 0x7fbe4406b360 2024-04-25T09:08:17.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.176+0000 7fbe49a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe440cd570 con 0x7fbe4415a5f0 2024-04-25T09:08:17.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.176+0000 7fbe43400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fbe4415a9d0 0x7fbe4406ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:52526/0 (socket says 172.21.15.175:52526) 2024-04-25T09:08:17.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.176+0000 7fbe43400640 1 -- 172.21.15.175:0/3440969933 learned_addr learned my addr 172.21.15.175:0/3440969933 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:17.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.176+0000 7fbe43e00640 1 --2- 172.21.15.175:0/3440969933 >> v2:172.21.15.177:3300/0 conn(0x7fbe4415a5f0 0x7fbe4415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:17.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.176+0000 7fbe42a00640 1 -- 172.21.15.175:0/3440969933 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063428258 0 0) 0x7fbe4415b3f0 con 0x7fbe4415a9d0 2024-04-25T09:08:17.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.176+0000 7fbe42a00640 1 -- 172.21.15.175:0/3440969933 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe28003530 con 0x7fbe4415a9d0 2024-04-25T09:08:17.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.176+0000 7fbe43e00640 1 -- 172.21.15.175:0/3440969933 >> v1:172.21.15.177:6789/0 conn(0x7fbe4406b360 legacy=0x7fbe440cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:17.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.176+0000 7fbe43e00640 1 -- 172.21.15.175:0/3440969933 >> v1:172.21.15.175:6789/0 conn(0x7fbe4415a9d0 legacy=0x7fbe4406ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:17.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.176+0000 7fbe42a00640 1 -- 172.21.15.175:0/3440969933 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513308353 0 0) 0x7fbe4415b6d0 con 0x7fbe4406b360 2024-04-25T09:08:17.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.176+0000 7fbe43e00640 1 -- 172.21.15.175:0/3440969933 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4415b9b0 con 0x7fbe4415a5f0 2024-04-25T09:08:17.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe43e00640 1 --2- 172.21.15.175:0/3440969933 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe4415a5f0 0x7fbe4415ec80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbe34009d90 tx=0x7fbe3401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=395f71e6ece0dfec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:17.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe42a00640 1 -- 172.21.15.175:0/3440969933 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe340b2070 con 0x7fbe4415a5f0 2024-04-25T09:08:17.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe42a00640 1 -- 172.21.15.175:0/3440969933 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe340a5860 con 0x7fbe4415a5f0 2024-04-25T09:08:17.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe42a00640 1 -- 172.21.15.175:0/3440969933 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe340a5c30 con 0x7fbe4415a5f0 2024-04-25T09:08:17.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe49a00640 1 -- 172.21.15.175:0/3440969933 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe4415a5f0 msgr2=0x7fbe4415ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:17.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe49a00640 1 --2- 172.21.15.175:0/3440969933 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe4415a5f0 0x7fbe4415ec80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbe34009d90 tx=0x7fbe3401c970 comp rx=0 tx=0).stop 2024-04-25T09:08:17.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe49a00640 1 -- 172.21.15.175:0/3440969933 shutdown_connections 2024-04-25T09:08:17.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe49a00640 1 --2- 172.21.15.175:0/3440969933 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe4415a5f0 0x7fbe4415ec80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:17.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe49a00640 1 -- 172.21.15.175:0/3440969933 >> 172.21.15.175:0/3440969933 conn(0x7fbe44067070 msgr2=0x7fbe440b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:17.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe49a00640 1 -- 172.21.15.175:0/3440969933 shutdown_connections 2024-04-25T09:08:17.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe49a00640 1 -- 172.21.15.175:0/3440969933 wait complete. 2024-04-25T09:08:17.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe49a00640 1 Processor -- start 2024-04-25T09:08:17.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe49a00640 1 -- start start 2024-04-25T09:08:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe49a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbe4406b360 0x7fbe441541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe49a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe4415a5f0 0x7fbe44156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe49a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe4415a9d0 0x7fbe441531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe49a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe440ced30 con 0x7fbe4415a5f0 2024-04-25T09:08:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe49a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe440cebb0 con 0x7fbe4415a9d0 2024-04-25T09:08:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.180+0000 7fbe49a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe440cd280 con 0x7fbe4406b360 2024-04-25T09:08:17.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.184+0000 7fbe43400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe4415a5f0 0x7fbe44156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:17.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.184+0000 7fbe43e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbe4406b360 0x7fbe441541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:17.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.184+0000 7fbe43400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe4415a5f0 0x7fbe44156300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41578/0 (socket says 172.21.15.175:41578) 2024-04-25T09:08:17.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.184+0000 7fbe43400640 1 -- 172.21.15.175:0/2908240403 learned_addr learned my addr 172.21.15.175:0/2908240403 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:17.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.184+0000 7fbe49000640 1 --2- 172.21.15.175:0/2908240403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe4415a9d0 0x7fbe441531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:17.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.184+0000 7fbe43400640 1 -- 172.21.15.175:0/2908240403 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbe4406b360 msgr2=0x7fbe441541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:17.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.184+0000 7fbe43400640 1 --2- 172.21.15.175:0/2908240403 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbe4406b360 0x7fbe441541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:17.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.184+0000 7fbe43400640 1 -- 172.21.15.175:0/2908240403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe4415a9d0 msgr2=0x7fbe441531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:17.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.184+0000 7fbe43400640 1 --2- 172.21.15.175:0/2908240403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe4415a9d0 0x7fbe441531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:17.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.184+0000 7fbe43400640 1 -- 172.21.15.175:0/2908240403 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe44154b60 con 0x7fbe4415a5f0 2024-04-25T09:08:17.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.184+0000 7fbe43400640 1 --2- 172.21.15.175:0/2908240403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe4415a5f0 0x7fbe44156300 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000c450 tx=0x7fbe3000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:17.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.184+0000 7fbe3be00640 1 -- 172.21.15.175:0/2908240403 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30017070 con 0x7fbe4415a5f0 2024-04-25T09:08:17.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.184+0000 7fbe3be00640 1 -- 172.21.15.175:0/2908240403 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe30005cf0 con 0x7fbe4415a5f0 2024-04-25T09:08:17.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.184+0000 7fbe49a00640 1 -- 172.21.15.175:0/2908240403 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe441526c0 con 0x7fbe4415a5f0 2024-04-25T09:08:17.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.184+0000 7fbe3be00640 1 -- 172.21.15.175:0/2908240403 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30007290 con 0x7fbe4415a5f0 2024-04-25T09:08:17.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.184+0000 7fbe49a00640 1 -- 172.21.15.175:0/2908240403 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe44154730 con 0x7fbe4415a5f0 2024-04-25T09:08:17.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.184+0000 7fbe49a00640 1 -- 172.21.15.175:0/2908240403 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe44074a60 con 0x7fbe4415a5f0 2024-04-25T09:08:17.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.184+0000 7fbe3be00640 1 -- 172.21.15.175:0/2908240403 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbe3001a070 con 0x7fbe4415a5f0 2024-04-25T09:08:17.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.188+0000 7fbe3be00640 1 --2- 172.21.15.175:0/2908240403 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbe24066f90 0x7fbe24069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:17.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.188+0000 7fbe3be00640 1 -- 172.21.15.175:0/2908240403 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fbe300844d0 con 0x7fbe4415a5f0 2024-04-25T09:08:17.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.188+0000 7fbe43e00640 1 --2- 172.21.15.175:0/2908240403 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbe24066f90 0x7fbe24069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:17.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.188+0000 7fbe43e00640 1 --2- 172.21.15.175:0/2908240403 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbe24066f90 0x7fbe24069450 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbe340af000 tx=0x7fbe340a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:17.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.192+0000 7fbe3be00640 1 -- 172.21.15.175:0/2908240403 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbe30021080 con 0x7fbe4415a5f0 2024-04-25T09:08:17.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:17.376+0000 7fbe49a00640 1 -- 172.21.15.175:0/2908240403 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbe44072110 con 0x7fbe4415a5f0 2024-04-25T09:08:17.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.008+0000 7fbe3be00640 1 -- 172.21.15.175:0/2908240403 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v39) v1 ==== 174+0+0 (secure 0 0 0) 0x7fbe30054fe0 con 0x7fbe4415a5f0 2024-04-25T09:08:17.999 INFO:teuthology.orchestra.run.smithi175.stderr:new fs with metadata pool 10 and data pool 11 2024-04-25T09:08:18.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.016+0000 7fbe49a00640 1 -- 172.21.15.175:0/2908240403 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbe24066f90 msgr2=0x7fbe24069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:18.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.016+0000 7fbe49a00640 1 --2- 172.21.15.175:0/2908240403 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbe24066f90 0x7fbe24069450 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbe340af000 tx=0x7fbe340a7070 comp rx=0 tx=0).stop 2024-04-25T09:08:18.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.016+0000 7fbe49a00640 1 -- 172.21.15.175:0/2908240403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe4415a5f0 msgr2=0x7fbe44156300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:18.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.016+0000 7fbe49a00640 1 --2- 172.21.15.175:0/2908240403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe4415a5f0 0x7fbe44156300 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000c450 tx=0x7fbe3000c910 comp rx=0 tx=0).stop 2024-04-25T09:08:18.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.016+0000 7fbe49a00640 1 -- 172.21.15.175:0/2908240403 shutdown_connections 2024-04-25T09:08:18.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.016+0000 7fbe49a00640 1 --2- 172.21.15.175:0/2908240403 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbe24066f90 0x7fbe24069450 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.016+0000 7fbe49a00640 1 --2- 172.21.15.175:0/2908240403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe4415a9d0 0x7fbe441531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.016+0000 7fbe49a00640 1 --2- 172.21.15.175:0/2908240403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe4415a5f0 0x7fbe44156300 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.016+0000 7fbe49a00640 1 --2- 172.21.15.175:0/2908240403 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbe4406b360 0x7fbe441541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.016+0000 7fbe49a00640 1 -- 172.21.15.175:0/2908240403 >> 172.21.15.175:0/2908240403 conn(0x7fbe44067070 msgr2=0x7fbe4406ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:18.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.020+0000 7fbe49a00640 1 -- 172.21.15.175:0/2908240403 shutdown_connections 2024-04-25T09:08:18.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.020+0000 7fbe49a00640 1 -- 172.21.15.175:0/2908240403 wait complete. 2024-04-25T09:08:18.041 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:08:18.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.188+0000 7fe320e00640 1 Processor -- start 2024-04-25T09:08:18.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.188+0000 7fe320e00640 1 -- start start 2024-04-25T09:08:18.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.188+0000 7fe320e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe31c144fc0 0x7fe31c0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:18.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.188+0000 7fe320e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe31c1453a0 0x7fe31c15bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:18.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.188+0000 7fe320e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe31c15cd00 con 0x7fe31c0cc3b0 2024-04-25T09:08:18.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.188+0000 7fe320e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe31c0ce660 con 0x7fe31c1453a0 2024-04-25T09:08:18.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.188+0000 7fe320e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c0cc930 con 0x7fe31c144fc0 2024-04-25T09:08:18.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.188+0000 7fe311400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe31c1453a0 0x7fe31c15bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:18.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.188+0000 7fe319e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe31c144fc0 0x7fe31c0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:18.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.188+0000 7fe31a800640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe31c0cc3b0 0x7fe31c15f480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:59032/0 (socket says 172.21.15.175:59032) 2024-04-25T09:08:18.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.188+0000 7fe31a800640 1 -- 172.21.15.175:0/2807154522 learned_addr learned my addr 172.21.15.175:0/2807154522 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:18.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.192+0000 7fe311400640 1 -- 172.21.15.175:0/2807154522 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe31c144fc0 msgr2=0x7fe31c0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:18.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.192+0000 7fe311400640 1 --2- 172.21.15.175:0/2807154522 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe31c144fc0 0x7fe31c0cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.192+0000 7fe311400640 1 -- 172.21.15.175:0/2807154522 >> v1:172.21.15.177:6789/0 conn(0x7fe31c0cc3b0 legacy=0x7fe31c15f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:18.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.192+0000 7fe319400640 1 -- 172.21.15.175:0/2807154522 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650529891 0 0) 0x7fe31c15cd00 con 0x7fe31c0cc3b0 2024-04-25T09:08:18.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.192+0000 7fe311400640 1 -- 172.21.15.175:0/2807154522 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c0ccc10 con 0x7fe31c1453a0 2024-04-25T09:08:18.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.192+0000 7fe319e00640 1 --2- 172.21.15.175:0/2807154522 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe31c144fc0 0x7fe31c0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:08:18.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.192+0000 7fe311400640 1 --2- 172.21.15.175:0/2807154522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe31c1453a0 0x7fe31c15bed0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe3040097c0 tx=0x7fe30401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e34a04f894162e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:18.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.192+0000 7fe319400640 1 -- 172.21.15.175:0/2807154522 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3040b2070 con 0x7fe31c1453a0 2024-04-25T09:08:18.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.192+0000 7fe319400640 1 -- 172.21.15.175:0/2807154522 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3040ad640 con 0x7fe31c1453a0 2024-04-25T09:08:18.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.192+0000 7fe319400640 1 -- 172.21.15.175:0/2807154522 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3040ada10 con 0x7fe31c1453a0 2024-04-25T09:08:18.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe320e00640 1 -- 172.21.15.175:0/2807154522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe31c1453a0 msgr2=0x7fe31c15bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:18.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe320e00640 1 --2- 172.21.15.175:0/2807154522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe31c1453a0 0x7fe31c15bed0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe3040097c0 tx=0x7fe30401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe320e00640 1 -- 172.21.15.175:0/2807154522 shutdown_connections 2024-04-25T09:08:18.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe320e00640 1 --2- 172.21.15.175:0/2807154522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe31c1453a0 0x7fe31c15bed0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe320e00640 1 --2- 172.21.15.175:0/2807154522 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe31c144fc0 0x7fe31c0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe320e00640 1 -- 172.21.15.175:0/2807154522 >> 172.21.15.175:0/2807154522 conn(0x7fe31c067150 msgr2=0x7fe31c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:18.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe320e00640 1 -- 172.21.15.175:0/2807154522 shutdown_connections 2024-04-25T09:08:18.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe320e00640 1 -- 172.21.15.175:0/2807154522 wait complete. 2024-04-25T09:08:18.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe320e00640 1 Processor -- start 2024-04-25T09:08:18.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe320e00640 1 -- start start 2024-04-25T09:08:18.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe320e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe31c144fc0 0x7fe31c0b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:18.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe320e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe31c1453a0 0x7fe31c1558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:18.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe320e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe31c13ec30 0x7fe31c13e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:18.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe320e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c0cffb0 con 0x7fe31c144fc0 2024-04-25T09:08:18.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe320e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c0cfe30 con 0x7fe31c13ec30 2024-04-25T09:08:18.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe320e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c1685f0 con 0x7fe31c1453a0 2024-04-25T09:08:18.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe319e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe31c144fc0 0x7fe31c0b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:18.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe319e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe31c144fc0 0x7fe31c0b4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41582/0 (socket says 172.21.15.175:41582) 2024-04-25T09:08:18.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe319e00640 1 -- 172.21.15.175:0/3201900856 learned_addr learned my addr 172.21.15.175:0/3201900856 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:18.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe311400640 1 --2- 172.21.15.175:0/3201900856 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe31c1453a0 0x7fe31c1558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:18.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe31a800640 1 --2- 172.21.15.175:0/3201900856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe31c13ec30 0x7fe31c13e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:18.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe319e00640 1 -- 172.21.15.175:0/3201900856 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe31c1453a0 msgr2=0x7fe31c1558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:18.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe319e00640 1 --2- 172.21.15.175:0/3201900856 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe31c1453a0 0x7fe31c1558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe319e00640 1 -- 172.21.15.175:0/3201900856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe31c13ec30 msgr2=0x7fe31c13e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:18.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe319e00640 1 --2- 172.21.15.175:0/3201900856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe31c13ec30 0x7fe31c13e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe319e00640 1 -- 172.21.15.175:0/3201900856 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c1426f0 con 0x7fe31c144fc0 2024-04-25T09:08:18.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.196+0000 7fe31a800640 1 --2- 172.21.15.175:0/3201900856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe31c13ec30 0x7fe31c13e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:18.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.200+0000 7fe319e00640 1 --2- 172.21.15.175:0/3201900856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe31c144fc0 0x7fe31c0b4320 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00efc0 tx=0x7fe30c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:18.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.200+0000 7fe312a00640 1 -- 172.21.15.175:0/3201900856 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c018020 con 0x7fe31c144fc0 2024-04-25T09:08:18.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.200+0000 7fe312a00640 1 -- 172.21.15.175:0/3201900856 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c014680 con 0x7fe31c144fc0 2024-04-25T09:08:18.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.200+0000 7fe312a00640 1 -- 172.21.15.175:0/3201900856 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c014a50 con 0x7fe31c144fc0 2024-04-25T09:08:18.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.200+0000 7fe320e00640 1 -- 172.21.15.175:0/3201900856 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe31c1429d0 con 0x7fe31c144fc0 2024-04-25T09:08:18.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.200+0000 7fe320e00640 1 -- 172.21.15.175:0/3201900856 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31c155e20 con 0x7fe31c144fc0 2024-04-25T09:08:18.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.200+0000 7fe320e00640 1 -- 172.21.15.175:0/3201900856 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31c074a60 con 0x7fe31c144fc0 2024-04-25T09:08:18.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.200+0000 7fe312a00640 1 -- 172.21.15.175:0/3201900856 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe30c01b020 con 0x7fe31c144fc0 2024-04-25T09:08:18.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.200+0000 7fe312a00640 1 --2- 172.21.15.175:0/3201900856 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe2f8066f90 0x7fe2f8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:18.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.204+0000 7fe312a00640 1 -- 172.21.15.175:0/3201900856 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe30c085e60 con 0x7fe31c144fc0 2024-04-25T09:08:18.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.204+0000 7fe311400640 1 --2- 172.21.15.175:0/3201900856 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe2f8066f90 0x7fe2f8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:18.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.204+0000 7fe311400640 1 --2- 172.21.15.175:0/3201900856 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe2f8066f90 0x7fe2f8069450 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe3040af000 tx=0x7fe304008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:18.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.208+0000 7fe312a00640 1 -- 172.21.15.175:0/3201900856 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe30c022030 con 0x7fe31c144fc0 2024-04-25T09:08:18.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.360+0000 7fe320e00640 1 -- 172.21.15.175:0/3201900856 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe31c075180 con 0x7fe31c144fc0 2024-04-25T09:08:18.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.364+0000 7fe312a00640 1 -- 172.21.15.175:0/3201900856 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16717 (secure 0 0 0) 0x7fe30c010040 con 0x7fe31c144fc0 2024-04-25T09:08:18.353 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:18.353 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":68,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:08:17.378573+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:08:15.743582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T09:08:16.375168+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:08:18.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.364+0000 7fe320e00640 1 -- 172.21.15.175:0/3201900856 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe2f8066f90 msgr2=0x7fe2f8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:18.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.364+0000 7fe320e00640 1 --2- 172.21.15.175:0/3201900856 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe2f8066f90 0x7fe2f8069450 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe3040af000 tx=0x7fe304008040 comp rx=0 tx=0).stop 2024-04-25T09:08:18.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.364+0000 7fe320e00640 1 -- 172.21.15.175:0/3201900856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe31c144fc0 msgr2=0x7fe31c0b4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:18.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.364+0000 7fe320e00640 1 --2- 172.21.15.175:0/3201900856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe31c144fc0 0x7fe31c0b4320 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00efc0 tx=0x7fe30c00c490 comp rx=0 tx=0).stop 2024-04-25T09:08:18.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.364+0000 7fe320e00640 1 -- 172.21.15.175:0/3201900856 shutdown_connections 2024-04-25T09:08:18.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.364+0000 7fe320e00640 1 --2- 172.21.15.175:0/3201900856 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe2f8066f90 0x7fe2f8069450 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.364+0000 7fe320e00640 1 --2- 172.21.15.175:0/3201900856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe31c13ec30 0x7fe31c13e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.364+0000 7fe320e00640 1 --2- 172.21.15.175:0/3201900856 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe31c1453a0 0x7fe31c1558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.364+0000 7fe320e00640 1 --2- 172.21.15.175:0/3201900856 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe31c144fc0 0x7fe31c0b4320 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.364+0000 7fe320e00640 1 -- 172.21.15.175:0/3201900856 >> 172.21.15.175:0/3201900856 conn(0x7fe31c0cc3b0 msgr2=0x7fe31c06e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:18.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.364+0000 7fe320e00640 1 -- 172.21.15.175:0/3201900856 shutdown_connections 2024-04-25T09:08:18.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.364+0000 7fe320e00640 1 -- 172.21.15.175:0/3201900856 wait complete. 2024-04-25T09:08:18.375 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:08:18.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.520+0000 7ffac1000640 1 Processor -- start 2024-04-25T09:08:18.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.520+0000 7ffac1000640 1 -- start start 2024-04-25T09:08:18.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.520+0000 7ffac1000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ffabc144fc0 0x7ffabc0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:18.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.520+0000 7ffac1000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffabc15c5e0 0x7ffabc0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:18.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.520+0000 7ffac1000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffabc15cd00 con 0x7ffabc1453a0 2024-04-25T09:08:18.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.520+0000 7ffac1000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffabc0ce660 con 0x7ffabc15c5e0 2024-04-25T09:08:18.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.520+0000 7ffac1000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffabc0cc930 con 0x7ffabc144fc0 2024-04-25T09:08:18.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.524+0000 7ffaba800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffabc15c5e0 0x7ffabc0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:18.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.524+0000 7ffaba800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffabc15c5e0 0x7ffabc0cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41590/0 (socket says 172.21.15.175:41590) 2024-04-25T09:08:18.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.524+0000 7ffaba800640 1 -- 172.21.15.175:0/4176991908 learned_addr learned my addr 172.21.15.175:0/4176991908 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:18.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.524+0000 7ffab9e00640 1 --2- 172.21.15.175:0/4176991908 >> v2:172.21.15.177:3300/0 conn(0x7ffabc144fc0 0x7ffabc0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:18.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.524+0000 7ffaba800640 1 -- 172.21.15.175:0/4176991908 >> v2:172.21.15.177:3300/0 conn(0x7ffabc144fc0 msgr2=0x7ffabc0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:18.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.524+0000 7ffaba800640 1 --2- 172.21.15.175:0/4176991908 >> v2:172.21.15.177:3300/0 conn(0x7ffabc144fc0 0x7ffabc0cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.524+0000 7ffaba800640 1 -- 172.21.15.175:0/4176991908 >> v1:172.21.15.177:6789/0 conn(0x7ffabc1453a0 legacy=0x7ffabc15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:18.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.524+0000 7ffaba800640 1 -- 172.21.15.175:0/4176991908 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc0ccc10 con 0x7ffabc15c5e0 2024-04-25T09:08:18.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.524+0000 7ffab9e00640 1 --2- 172.21.15.175:0/4176991908 >> v2:172.21.15.177:3300/0 conn(0x7ffabc144fc0 0x7ffabc0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:18.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.524+0000 7ffaba800640 1 --2- 172.21.15.175:0/4176991908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffabc15c5e0 0x7ffabc0cee20 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009e50 tx=0x7ffab401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03e82facf1bc410 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:18.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.524+0000 7ffab9400640 1 -- 172.21.15.175:0/4176991908 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab40a5760 con 0x7ffabc15c5e0 2024-04-25T09:08:18.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.524+0000 7ffab9400640 1 -- 172.21.15.175:0/4176991908 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab40a5900 con 0x7ffabc15c5e0 2024-04-25T09:08:18.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.524+0000 7ffab9400640 1 -- 172.21.15.175:0/4176991908 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab40a5cd0 con 0x7ffabc15c5e0 2024-04-25T09:08:18.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffac1000640 1 -- 172.21.15.175:0/4176991908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffabc15c5e0 msgr2=0x7ffabc0cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:18.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffac1000640 1 --2- 172.21.15.175:0/4176991908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffabc15c5e0 0x7ffabc0cee20 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009e50 tx=0x7ffab401c9b0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffac1000640 1 -- 172.21.15.175:0/4176991908 shutdown_connections 2024-04-25T09:08:18.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffac1000640 1 --2- 172.21.15.175:0/4176991908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffabc15c5e0 0x7ffabc0cee20 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffac1000640 1 --2- 172.21.15.175:0/4176991908 >> v2:172.21.15.177:3300/0 conn(0x7ffabc144fc0 0x7ffabc0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffac1000640 1 -- 172.21.15.175:0/4176991908 >> 172.21.15.175:0/4176991908 conn(0x7ffabc067150 msgr2=0x7ffabc06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:18.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffac1000640 1 -- 172.21.15.175:0/4176991908 shutdown_connections 2024-04-25T09:08:18.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffac1000640 1 -- 172.21.15.175:0/4176991908 wait complete. 2024-04-25T09:08:18.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffac1000640 1 Processor -- start 2024-04-25T09:08:18.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffac1000640 1 -- start start 2024-04-25T09:08:18.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffac1000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffabc1453a0 0x7ffabc0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:18.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffac1000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffabc15c5e0 0x7ffabc1438a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:18.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffac1000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffabc0b02a0 0x7ffabc143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:18.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffac1000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc0cff40 con 0x7ffabc15c5e0 2024-04-25T09:08:18.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffac1000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc0cfdc0 con 0x7ffabc0b02a0 2024-04-25T09:08:18.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffac1000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc1685f0 con 0x7ffabc1453a0 2024-04-25T09:08:18.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffab1400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffabc15c5e0 0x7ffabc1438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:18.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffab1400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffabc15c5e0 0x7ffabc1438a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41602/0 (socket says 172.21.15.175:41602) 2024-04-25T09:08:18.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffab1400640 1 -- 172.21.15.175:0/2970233436 learned_addr learned my addr 172.21.15.175:0/2970233436 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:18.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffab9e00640 1 --2- 172.21.15.175:0/2970233436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffabc1453a0 0x7ffabc0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:18.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffaba800640 1 --2- 172.21.15.175:0/2970233436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffabc0b02a0 0x7ffabc143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:18.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffab1400640 1 -- 172.21.15.175:0/2970233436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffabc1453a0 msgr2=0x7ffabc0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:18.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffab1400640 1 --2- 172.21.15.175:0/2970233436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffabc1453a0 0x7ffabc0b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffab1400640 1 -- 172.21.15.175:0/2970233436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffabc0b02a0 msgr2=0x7ffabc143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:18.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffab1400640 1 --2- 172.21.15.175:0/2970233436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffabc0b02a0 0x7ffabc143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffab1400640 1 -- 172.21.15.175:0/2970233436 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc138950 con 0x7ffabc15c5e0 2024-04-25T09:08:18.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffab9e00640 1 --2- 172.21.15.175:0/2970233436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffabc1453a0 0x7ffabc0b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:18.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.528+0000 7ffab1400640 1 --2- 172.21.15.175:0/2970233436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffabc15c5e0 0x7ffabc1438a0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400c400 tx=0x7ffaa400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:18.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.532+0000 7ffab2a00640 1 -- 172.21.15.175:0/2970233436 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4007020 con 0x7ffabc15c5e0 2024-04-25T09:08:18.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.532+0000 7ffab2a00640 1 -- 172.21.15.175:0/2970233436 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa40071c0 con 0x7ffabc15c5e0 2024-04-25T09:08:18.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.532+0000 7ffab2a00640 1 -- 172.21.15.175:0/2970233436 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa40075f0 con 0x7ffabc15c5e0 2024-04-25T09:08:18.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.532+0000 7ffac1000640 1 -- 172.21.15.175:0/2970233436 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffabc138c30 con 0x7ffabc15c5e0 2024-04-25T09:08:18.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.532+0000 7ffac1000640 1 -- 172.21.15.175:0/2970233436 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc159430 con 0x7ffabc15c5e0 2024-04-25T09:08:18.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.532+0000 7ffac1000640 1 -- 172.21.15.175:0/2970233436 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc074a60 con 0x7ffabc15c5e0 2024-04-25T09:08:18.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.532+0000 7ffab2a00640 1 -- 172.21.15.175:0/2970233436 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffaa4019020 con 0x7ffabc15c5e0 2024-04-25T09:08:18.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.532+0000 7ffab2a00640 1 --2- 172.21.15.175:0/2970233436 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffa98066f90 0x7ffa98069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:18.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.532+0000 7ffab2a00640 1 -- 172.21.15.175:0/2970233436 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffaa4084770 con 0x7ffabc15c5e0 2024-04-25T09:08:18.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.532+0000 7ffab9e00640 1 --2- 172.21.15.175:0/2970233436 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffa98066f90 0x7ffa98069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:18.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.532+0000 7ffab9e00640 1 --2- 172.21.15.175:0/2970233436 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffa98066f90 0x7ffa98069450 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ffaac006fd0 tx=0x7ffaac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:18.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.536+0000 7ffab2a00640 1 -- 172.21.15.175:0/2970233436 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffaa4055810 con 0x7ffabc15c5e0 2024-04-25T09:08:18.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.692+0000 7ffac1000640 1 -- 172.21.15.175:0/2970233436 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffabc15e640 con 0x7ffabc15c5e0 2024-04-25T09:08:18.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.692+0000 7ffab2a00640 1 -- 172.21.15.175:0/2970233436 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16717 (secure 0 0 0) 0x7ffaa4055110 con 0x7ffabc15c5e0 2024-04-25T09:08:18.683 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:18.683 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":68,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:08:17.378573+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:08:15.743582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T09:08:16.375168+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:08:18.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.696+0000 7ffac1000640 1 -- 172.21.15.175:0/2970233436 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffa98066f90 msgr2=0x7ffa98069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:18.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.696+0000 7ffac1000640 1 --2- 172.21.15.175:0/2970233436 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffa98066f90 0x7ffa98069450 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ffaac006fd0 tx=0x7ffaac008040 comp rx=0 tx=0).stop 2024-04-25T09:08:18.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.696+0000 7ffac1000640 1 -- 172.21.15.175:0/2970233436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffabc15c5e0 msgr2=0x7ffabc1438a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:18.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.696+0000 7ffac1000640 1 --2- 172.21.15.175:0/2970233436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffabc15c5e0 0x7ffabc1438a0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400c400 tx=0x7ffaa400c8c0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.696+0000 7ffac1000640 1 -- 172.21.15.175:0/2970233436 shutdown_connections 2024-04-25T09:08:18.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.696+0000 7ffac1000640 1 --2- 172.21.15.175:0/2970233436 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffa98066f90 0x7ffa98069450 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.696+0000 7ffac1000640 1 --2- 172.21.15.175:0/2970233436 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffabc0b02a0 0x7ffabc143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.696+0000 7ffac1000640 1 --2- 172.21.15.175:0/2970233436 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffabc15c5e0 0x7ffabc1438a0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.696+0000 7ffac1000640 1 --2- 172.21.15.175:0/2970233436 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffabc1453a0 0x7ffabc0b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.696+0000 7ffac1000640 1 -- 172.21.15.175:0/2970233436 >> 172.21.15.175:0/2970233436 conn(0x7ffabc144fc0 msgr2=0x7ffabc15d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:18.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.696+0000 7ffac1000640 1 -- 172.21.15.175:0/2970233436 shutdown_connections 2024-04-25T09:08:18.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.696+0000 7ffac1000640 1 -- 172.21.15.175:0/2970233436 wait complete. 2024-04-25T09:08:18.705 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:08:18.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.852+0000 7f2f6c000640 1 Processor -- start 2024-04-25T09:08:18.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.852+0000 7f2f6c000640 1 -- start start 2024-04-25T09:08:18.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.856+0000 7f2f6c000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2f640b4800 0x7f2f64165550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:18.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.856+0000 7f2f6c000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6406db60 con 0x7f2f640cbe60 2024-04-25T09:08:18.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.856+0000 7f2f6c000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6406de40 con 0x7f2f6415af20 2024-04-25T09:08:18.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.856+0000 7f2f6c000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6406e120 con 0x7f2f640b4800 2024-04-25T09:08:18.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.856+0000 7f2f69600640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f2f640cbe60 0x7f2f6406d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:52530/0 (socket says 172.21.15.175:52530) 2024-04-25T09:08:18.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.856+0000 7f2f69600640 1 -- 172.21.15.175:0/303775723 learned_addr learned my addr 172.21.15.175:0/303775723 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:18.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.856+0000 7f2f6a000640 1 --2- 172.21.15.175:0/303775723 >> v2:172.21.15.175:3300/0 conn(0x7f2f640b4800 0x7f2f64165550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:18.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.856+0000 7f2f6a000640 1 -- 172.21.15.175:0/303775723 >> v1:172.21.15.177:6789/0 conn(0x7f2f6415af20 legacy=0x7f2f640b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:18.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.856+0000 7f2f6a000640 1 -- 172.21.15.175:0/303775723 >> v1:172.21.15.175:6789/0 conn(0x7f2f640cbe60 legacy=0x7f2f6406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:18.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.856+0000 7f2f6a000640 1 -- 172.21.15.175:0/303775723 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6415c2f0 con 0x7f2f640b4800 2024-04-25T09:08:18.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.856+0000 7f2f6a000640 1 --2- 172.21.15.175:0/303775723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f640b4800 0x7f2f64165550 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c009d90 tx=0x7f2f5c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dfb2ae8b19002c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:18.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.856+0000 7f2f63e00640 1 -- 172.21.15.175:0/303775723 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c0b2070 con 0x7f2f640b4800 2024-04-25T09:08:18.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f63e00640 1 -- 172.21.15.175:0/303775723 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c0a57f0 con 0x7f2f640b4800 2024-04-25T09:08:18.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f63e00640 1 -- 172.21.15.175:0/303775723 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c0a5bc0 con 0x7f2f640b4800 2024-04-25T09:08:18.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6c000640 1 -- 172.21.15.175:0/303775723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f640b4800 msgr2=0x7f2f64165550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:18.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6c000640 1 --2- 172.21.15.175:0/303775723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f640b4800 0x7f2f64165550 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c009d90 tx=0x7f2f5c01c930 comp rx=0 tx=0).stop 2024-04-25T09:08:18.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6c000640 1 -- 172.21.15.175:0/303775723 shutdown_connections 2024-04-25T09:08:18.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6c000640 1 --2- 172.21.15.175:0/303775723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f640b4800 0x7f2f64165550 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6c000640 1 -- 172.21.15.175:0/303775723 >> 172.21.15.175:0/303775723 conn(0x7f2f6406ac50 msgr2=0x7f2f6406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:18.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6c000640 1 -- 172.21.15.175:0/303775723 shutdown_connections 2024-04-25T09:08:18.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6c000640 1 -- 172.21.15.175:0/303775723 wait complete. 2024-04-25T09:08:18.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6c000640 1 Processor -- start 2024-04-25T09:08:18.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6c000640 1 -- start start 2024-04-25T09:08:18.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6c000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f640b4800 0x7f2f64154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:18.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6c000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f640cbe60 0x7f2f64150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:18.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6c000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f6415af20 0x7f2f6415a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:18.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6c000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f64168a50 con 0x7f2f6415af20 2024-04-25T09:08:18.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6c000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f641688d0 con 0x7f2f640cbe60 2024-04-25T09:08:18.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6c000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f64168bd0 con 0x7f2f640b4800 2024-04-25T09:08:18.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f6415af20 0x7f2f6415a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:18.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f6415af20 0x7f2f6415a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41624/0 (socket says 172.21.15.175:41624) 2024-04-25T09:08:18.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6a000640 1 -- 172.21.15.175:0/1017842092 learned_addr learned my addr 172.21.15.175:0/1017842092 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:18.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f69600640 1 --2- 172.21.15.175:0/1017842092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f640b4800 0x7f2f64154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:18.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f68c00640 1 --2- 172.21.15.175:0/1017842092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f640cbe60 0x7f2f64150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:18.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6a000640 1 -- 172.21.15.175:0/1017842092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f640b4800 msgr2=0x7f2f64154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:18.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6a000640 1 --2- 172.21.15.175:0/1017842092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f640b4800 0x7f2f64154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6a000640 1 -- 172.21.15.175:0/1017842092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f640cbe60 msgr2=0x7f2f64150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:18.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6a000640 1 --2- 172.21.15.175:0/1017842092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f640cbe60 0x7f2f64150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:18.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f6a000640 1 -- 172.21.15.175:0/1017842092 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f641555a0 con 0x7f2f6415af20 2024-04-25T09:08:18.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.860+0000 7f2f68c00640 1 --2- 172.21.15.175:0/1017842092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f640cbe60 0x7f2f64150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:18.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.864+0000 7f2f6a000640 1 --2- 172.21.15.175:0/1017842092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f6415af20 0x7f2f6415a000 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c01a560 tx=0x7f2f5c0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:18.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.864+0000 7f2f61600640 1 -- 172.21.15.175:0/1017842092 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c0b2050 con 0x7f2f6415af20 2024-04-25T09:08:18.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.864+0000 7f2f61600640 1 -- 172.21.15.175:0/1017842092 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c0be070 con 0x7f2f6415af20 2024-04-25T09:08:18.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.864+0000 7f2f61600640 1 -- 172.21.15.175:0/1017842092 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c0adc20 con 0x7f2f6415af20 2024-04-25T09:08:18.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.864+0000 7f2f6c000640 1 -- 172.21.15.175:0/1017842092 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f64155880 con 0x7f2f6415af20 2024-04-25T09:08:18.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.864+0000 7f2f6c000640 1 -- 172.21.15.175:0/1017842092 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f64155e40 con 0x7f2f6415af20 2024-04-25T09:08:18.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.864+0000 7f2f6c000640 1 -- 172.21.15.175:0/1017842092 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f64075160 con 0x7f2f6415af20 2024-04-25T09:08:18.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.864+0000 7f2f61600640 1 -- 172.21.15.175:0/1017842092 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2f5c0c3460 con 0x7f2f6415af20 2024-04-25T09:08:18.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.864+0000 7f2f61600640 1 --2- 172.21.15.175:0/1017842092 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2f44066f60 0x7f2f44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:18.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.864+0000 7f2f61600640 1 -- 172.21.15.175:0/1017842092 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f5c120530 con 0x7f2f6415af20 2024-04-25T09:08:18.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.864+0000 7f2f69600640 1 --2- 172.21.15.175:0/1017842092 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2f44066f60 0x7f2f44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:18.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.868+0000 7f2f69600640 1 --2- 172.21.15.175:0/1017842092 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2f44066f60 0x7f2f44069420 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2f58000f70 tx=0x7f2f58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:18.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:18.868+0000 7f2f61600640 1 -- 172.21.15.175:0/1017842092 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2f5c016520 con 0x7f2f6415af20 2024-04-25T09:08:19.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:19.060+0000 7f2f6c000640 1 -- 172.21.15.175:0/1017842092 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2f640b27a0 con 0x7f2f6415af20 2024-04-25T09:08:19.977 INFO:tasks.ceph.mds.d.smithi177.stderr:2024-04-25T09:08:19.989+0000 7f1ee4a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:08:20.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.028+0000 7f2f61600640 1 -- 172.21.15.175:0/1017842092 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v42) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2f5c0f1560 con 0x7f2f6415af20 2024-04-25T09:08:20.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.032+0000 7f2f6c000640 1 -- 172.21.15.175:0/1017842092 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2f44066f60 msgr2=0x7f2f44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:20.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.032+0000 7f2f6c000640 1 --2- 172.21.15.175:0/1017842092 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2f44066f60 0x7f2f44069420 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2f58000f70 tx=0x7f2f58009040 comp rx=0 tx=0).stop 2024-04-25T09:08:20.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.032+0000 7f2f6c000640 1 -- 172.21.15.175:0/1017842092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f6415af20 msgr2=0x7f2f6415a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.032+0000 7f2f6c000640 1 --2- 172.21.15.175:0/1017842092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f6415af20 0x7f2f6415a000 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c01a560 tx=0x7f2f5c0196d0 comp rx=0 tx=0).stop 2024-04-25T09:08:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.032+0000 7f2f6c000640 1 -- 172.21.15.175:0/1017842092 shutdown_connections 2024-04-25T09:08:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.032+0000 7f2f6c000640 1 --2- 172.21.15.175:0/1017842092 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2f44066f60 0x7f2f44069420 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.032+0000 7f2f6c000640 1 --2- 172.21.15.175:0/1017842092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f6415af20 0x7f2f6415a000 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.032+0000 7f2f6c000640 1 --2- 172.21.15.175:0/1017842092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f640cbe60 0x7f2f64150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.032+0000 7f2f6c000640 1 --2- 172.21.15.175:0/1017842092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f640b4800 0x7f2f64154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.032+0000 7f2f6c000640 1 -- 172.21.15.175:0/1017842092 >> 172.21.15.175:0/1017842092 conn(0x7f2f6406ac50 msgr2=0x7f2f64154200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.032+0000 7f2f6c000640 1 -- 172.21.15.175:0/1017842092 shutdown_connections 2024-04-25T09:08:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.032+0000 7f2f6c000640 1 -- 172.21.15.175:0/1017842092 wait complete. 2024-04-25T09:08:20.043 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:08:20.043 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:08:20.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.196+0000 7fac45000640 1 Processor -- start 2024-04-25T09:08:20.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.196+0000 7fac45000640 1 -- start start 2024-04-25T09:08:20.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.196+0000 7fac45000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fac40145250 0x7fac400cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:20.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.196+0000 7fac45000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac401600a0 0x7fac400cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:20.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.196+0000 7fac45000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac400cfd10 con 0x7fac400ce970 2024-04-25T09:08:20.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.196+0000 7fac45000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac4015f650 con 0x7fac40145250 2024-04-25T09:08:20.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.196+0000 7fac45000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac400cfff0 con 0x7fac401600a0 2024-04-25T09:08:20.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.196+0000 7fac3de00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fac40145250 0x7fac400cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:20.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.196+0000 7fac3de00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fac40145250 0x7fac400cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60672/0 (socket says 172.21.15.175:60672) 2024-04-25T09:08:20.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.196+0000 7fac3de00640 1 -- 172.21.15.175:0/1710115512 learned_addr learned my addr 172.21.15.175:0/1710115512 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:20.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.196+0000 7fac35400640 1 --2- 172.21.15.175:0/1710115512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac401600a0 0x7fac400cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:20.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.196+0000 7fac3de00640 1 -- 172.21.15.175:0/1710115512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac401600a0 msgr2=0x7fac400cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:20.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.196+0000 7fac3de00640 1 --2- 172.21.15.175:0/1710115512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac401600a0 0x7fac400cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:20.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.196+0000 7fac3de00640 1 -- 172.21.15.175:0/1710115512 >> v1:172.21.15.175:6789/0 conn(0x7fac400ce970 legacy=0x7fac400cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:20.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.196+0000 7fac3de00640 1 -- 172.21.15.175:0/1710115512 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4015f8a0 con 0x7fac40145250 2024-04-25T09:08:20.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.200+0000 7fac3de00640 1 --2- 172.21.15.175:0/1710115512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac40145250 0x7fac400cf6b0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fac30009e50 tx=0x7fac3001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ee863b23a44f76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:20.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.200+0000 7fac3d400640 1 -- 172.21.15.175:0/1710115512 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac300a5850 con 0x7fac40145250 2024-04-25T09:08:20.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.200+0000 7fac3d400640 1 -- 172.21.15.175:0/1710115512 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac300a59f0 con 0x7fac40145250 2024-04-25T09:08:20.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.200+0000 7fac3d400640 1 -- 172.21.15.175:0/1710115512 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac300a5dc0 con 0x7fac40145250 2024-04-25T09:08:20.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.200+0000 7fac45000640 1 -- 172.21.15.175:0/1710115512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac40145250 msgr2=0x7fac400cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:20.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.200+0000 7fac45000640 1 --2- 172.21.15.175:0/1710115512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac40145250 0x7fac400cf6b0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fac30009e50 tx=0x7fac3001c970 comp rx=0 tx=0).stop 2024-04-25T09:08:20.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.200+0000 7fac45000640 1 -- 172.21.15.175:0/1710115512 shutdown_connections 2024-04-25T09:08:20.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.200+0000 7fac45000640 1 --2- 172.21.15.175:0/1710115512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac401600a0 0x7fac400cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:20.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.200+0000 7fac45000640 1 --2- 172.21.15.175:0/1710115512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac40145250 0x7fac400cf6b0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:20.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.200+0000 7fac45000640 1 -- 172.21.15.175:0/1710115512 >> 172.21.15.175:0/1710115512 conn(0x7fac4006ac50 msgr2=0x7fac4006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:20.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.200+0000 7fac45000640 1 -- 172.21.15.175:0/1710115512 shutdown_connections 2024-04-25T09:08:20.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.200+0000 7fac45000640 1 -- 172.21.15.175:0/1710115512 wait complete. 2024-04-25T09:08:20.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac45000640 1 Processor -- start 2024-04-25T09:08:20.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac45000640 1 -- start start 2024-04-25T09:08:20.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac45000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac400ce970 0x7fac4015b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:20.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac45000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac40145250 0x7fac400b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:20.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac45000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac401600a0 0x7fac40141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:20.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac45000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac40160600 con 0x7fac400ce970 2024-04-25T09:08:20.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac45000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac40160480 con 0x7fac40145250 2024-04-25T09:08:20.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac45000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4015c870 con 0x7fac401600a0 2024-04-25T09:08:20.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac3de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac400ce970 0x7fac4015b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:20.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac3de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac400ce970 0x7fac4015b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60676/0 (socket says 172.21.15.175:60676) 2024-04-25T09:08:20.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac3de00640 1 -- 172.21.15.175:0/2413397245 learned_addr learned my addr 172.21.15.175:0/2413397245 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:20.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac3de00640 1 -- 172.21.15.175:0/2413397245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac401600a0 msgr2=0x7fac40141e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:20.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac3de00640 1 --2- 172.21.15.175:0/2413397245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac401600a0 0x7fac40141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:20.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac3de00640 1 -- 172.21.15.175:0/2413397245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac40145250 msgr2=0x7fac400b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:20.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac3de00640 1 --2- 172.21.15.175:0/2413397245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac40145250 0x7fac400b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:20.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac3de00640 1 -- 172.21.15.175:0/2413397245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac40140db0 con 0x7fac400ce970 2024-04-25T09:08:20.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac3de00640 1 --2- 172.21.15.175:0/2413397245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac400ce970 0x7fac4015b300 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fac3001a5a0 tx=0x7fac30019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:20.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac36a00640 1 -- 172.21.15.175:0/2413397245 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac300bc030 con 0x7fac400ce970 2024-04-25T09:08:20.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac36a00640 1 -- 172.21.15.175:0/2413397245 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac300b8680 con 0x7fac400ce970 2024-04-25T09:08:20.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac45000640 1 -- 172.21.15.175:0/2413397245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac40141090 con 0x7fac400ce970 2024-04-25T09:08:20.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac36a00640 1 -- 172.21.15.175:0/2413397245 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac300b8a70 con 0x7fac400ce970 2024-04-25T09:08:20.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac45000640 1 -- 172.21.15.175:0/2413397245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac40141650 con 0x7fac400ce970 2024-04-25T09:08:20.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.204+0000 7fac45000640 1 -- 172.21.15.175:0/2413397245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac40075160 con 0x7fac400ce970 2024-04-25T09:08:20.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.208+0000 7fac36a00640 1 -- 172.21.15.175:0/2413397245 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fac300bf070 con 0x7fac400ce970 2024-04-25T09:08:20.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.208+0000 7fac36a00640 1 --2- 172.21.15.175:0/2413397245 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fac1c066f60 0x7fac1c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:20.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.208+0000 7fac36a00640 1 -- 172.21.15.175:0/2413397245 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac3011fcf0 con 0x7fac400ce970 2024-04-25T09:08:20.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.208+0000 7fac35400640 1 --2- 172.21.15.175:0/2413397245 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fac1c066f60 0x7fac1c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:20.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.208+0000 7fac35400640 1 --2- 172.21.15.175:0/2413397245 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fac1c066f60 0x7fac1c069420 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fac40131b40 tx=0x7fac28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:20.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.212+0000 7fac36a00640 1 -- 172.21.15.175:0/2413397245 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fac30016620 con 0x7fac400ce970 2024-04-25T09:08:20.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:20.400+0000 7fac45000640 1 -- 172.21.15.175:0/2413397245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fac40143e70 con 0x7fac400ce970 2024-04-25T09:08:21.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.032+0000 7fac36a00640 1 -- 172.21.15.175:0/2413397245 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v43) v1 ==== 122+0+0 (secure 0 0 0) 0x7fac300f0d80 con 0x7fac400ce970 2024-04-25T09:08:21.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.032+0000 7fac45000640 1 -- 172.21.15.175:0/2413397245 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fac1c066f60 msgr2=0x7fac1c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:21.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.032+0000 7fac45000640 1 --2- 172.21.15.175:0/2413397245 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fac1c066f60 0x7fac1c069420 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fac40131b40 tx=0x7fac28008040 comp rx=0 tx=0).stop 2024-04-25T09:08:21.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.032+0000 7fac45000640 1 -- 172.21.15.175:0/2413397245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac400ce970 msgr2=0x7fac4015b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:21.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.032+0000 7fac45000640 1 --2- 172.21.15.175:0/2413397245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac400ce970 0x7fac4015b300 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fac3001a5a0 tx=0x7fac30019710 comp rx=0 tx=0).stop 2024-04-25T09:08:21.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.032+0000 7fac45000640 1 -- 172.21.15.175:0/2413397245 shutdown_connections 2024-04-25T09:08:21.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.032+0000 7fac45000640 1 --2- 172.21.15.175:0/2413397245 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fac1c066f60 0x7fac1c069420 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.032+0000 7fac45000640 1 --2- 172.21.15.175:0/2413397245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fac401600a0 0x7fac40141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.032+0000 7fac45000640 1 --2- 172.21.15.175:0/2413397245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fac40145250 0x7fac400b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.032+0000 7fac45000640 1 --2- 172.21.15.175:0/2413397245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac400ce970 0x7fac4015b300 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.032+0000 7fac45000640 1 -- 172.21.15.175:0/2413397245 >> 172.21.15.175:0/2413397245 conn(0x7fac4006ac50 msgr2=0x7fac40164b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:21.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.036+0000 7fac45000640 1 -- 172.21.15.175:0/2413397245 shutdown_connections 2024-04-25T09:08:21.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.036+0000 7fac45000640 1 -- 172.21.15.175:0/2413397245 wait complete. 2024-04-25T09:08:21.043 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:08:21.044 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:08:21.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f9001200640 1 Processor -- start 2024-04-25T09:08:21.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f9001200640 1 -- start start 2024-04-25T09:08:21.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f9001200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8ffc099a50 0x7f8ffc099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f9001200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ffc0cbd10 0x7f8ffc0cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f9001200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ffc0cf740 con 0x7f8ffc0cd890 2024-04-25T09:08:21.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f9001200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ffc09a3f0 con 0x7f8ffc099a50 2024-04-25T09:08:21.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f9001200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc06c6e0 con 0x7f8ffc0cbd10 2024-04-25T09:08:21.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffb400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f8ffc0cd890 0x7f8ffc09a610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:54582/0 (socket says 172.21.15.175:54582) 2024-04-25T09:08:21.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffb400640 1 -- 172.21.15.175:0/2687815266 learned_addr learned my addr 172.21.15.175:0/2687815266 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:21.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffaa00640 1 --2- 172.21.15.175:0/2687815266 >> v2:172.21.15.177:3300/0 conn(0x7f8ffc099a50 0x7f8ffc099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffbe00640 1 --2- 172.21.15.175:0/2687815266 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ffc0cbd10 0x7f8ffc0cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffa000640 1 -- 172.21.15.175:0/2687815266 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 66749343 0 0) 0x7f8ffc0cf740 con 0x7f8ffc0cd890 2024-04-25T09:08:21.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffa000640 1 -- 172.21.15.175:0/2687815266 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fe0003530 con 0x7f8ffc0cd890 2024-04-25T09:08:21.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffa000640 1 -- 172.21.15.175:0/2687815266 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 905028131 0 0) 0x7f8fe0003530 con 0x7f8ffc0cd890 2024-04-25T09:08:21.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffa000640 1 -- 172.21.15.175:0/2687815266 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ffc0cbd10 msgr2=0x7f8ffc0cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:21.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffa000640 1 --2- 172.21.15.175:0/2687815266 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ffc0cbd10 0x7f8ffc0cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffa000640 1 -- 172.21.15.175:0/2687815266 >> v2:172.21.15.177:3300/0 conn(0x7f8ffc099a50 msgr2=0x7f8ffc099eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:21.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffa000640 1 --2- 172.21.15.175:0/2687815266 >> v2:172.21.15.177:3300/0 conn(0x7f8ffc099a50 0x7f8ffc099eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffa000640 1 -- 172.21.15.175:0/2687815266 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc06c9c0 con 0x7f8ffc0cd890 2024-04-25T09:08:21.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffa000640 1 -- 172.21.15.175:0/2687815266 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f8fec001680 con 0x7f8ffc0cd890 2024-04-25T09:08:21.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffaa00640 1 --2- 172.21.15.175:0/2687815266 >> v2:172.21.15.177:3300/0 conn(0x7f8ffc099a50 0x7f8ffc099eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:08:21.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffa000640 1 -- 172.21.15.175:0/2687815266 >> v1:172.21.15.175:6789/0 conn(0x7f8ffc0cd890 legacy=0x7f8ffc09a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:21.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffa000640 1 --2- 172.21.15.175:0/2687815266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fe0003a30 0x7f8fe0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffa000640 1 --2- 172.21.15.175:0/2687815266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fe0004810 0x7f8fe0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffa000640 1 --2- 172.21.15.175:0/2687815266 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ffc0cbd10 0x7f8fe00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffa000640 1 -- 172.21.15.175:0/2687815266 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc06c6e0 con 0x7f8fe0003a30 2024-04-25T09:08:21.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffa000640 1 -- 172.21.15.175:0/2687815266 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe000b9d0 con 0x7f8fe0004810 2024-04-25T09:08:21.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffa000640 1 -- 172.21.15.175:0/2687815266 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe000bb50 con 0x7f8ffc0cbd10 2024-04-25T09:08:21.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffb400640 1 --2- 172.21.15.175:0/2687815266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fe0003a30 0x7f8fe0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffaa00640 1 --2- 172.21.15.175:0/2687815266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fe0004810 0x7f8fe0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffbe00640 1 --2- 172.21.15.175:0/2687815266 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ffc0cbd10 0x7f8fe00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffb400640 1 -- 172.21.15.175:0/2687815266 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ffc0cbd10 msgr2=0x7f8fe00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:21.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffb400640 1 --2- 172.21.15.175:0/2687815266 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ffc0cbd10 0x7f8fe00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffb400640 1 -- 172.21.15.175:0/2687815266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fe0004810 msgr2=0x7f8fe0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:21.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffb400640 1 --2- 172.21.15.175:0/2687815266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fe0004810 0x7f8fe0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffb400640 1 -- 172.21.15.175:0/2687815266 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe0003530 con 0x7f8fe0003a30 2024-04-25T09:08:21.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffbe00640 1 --2- 172.21.15.175:0/2687815266 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ffc0cbd10 0x7f8fe00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:21.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.192+0000 7f8ffaa00640 1 --2- 172.21.15.175:0/2687815266 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8fe0004810 0x7f8fe0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:21.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.196+0000 7f8ffb400640 1 --2- 172.21.15.175:0/2687815266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fe0003a30 0x7f8fe0003e50 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c210 tx=0x7f8fec01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23025892522b891 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:21.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.196+0000 7f8ffa000640 1 -- 172.21.15.175:0/2687815266 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec007d80 con 0x7f8fe0003a30 2024-04-25T09:08:21.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.196+0000 7f8ffa000640 1 -- 172.21.15.175:0/2687815266 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec0a9020 con 0x7f8fe0003a30 2024-04-25T09:08:21.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.196+0000 7f8ffa000640 1 -- 172.21.15.175:0/2687815266 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec005b00 con 0x7f8fe0003a30 2024-04-25T09:08:21.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.196+0000 7f9001200640 1 -- 172.21.15.175:0/2687815266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fe0003a30 msgr2=0x7f8fe0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:21.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.196+0000 7f9001200640 1 --2- 172.21.15.175:0/2687815266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fe0003a30 0x7f8fe0003e50 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c210 tx=0x7f8fec01cca0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.196+0000 7f8ffbe00640 1 -- 172.21.15.175:0/2687815266 reap_dead start 2024-04-25T09:08:21.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.196+0000 7f9001200640 1 -- 172.21.15.175:0/2687815266 shutdown_connections 2024-04-25T09:08:21.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.196+0000 7f9001200640 1 -- 172.21.15.175:0/2687815266 >> 172.21.15.175:0/2687815266 conn(0x7f8ffc0b31b0 msgr2=0x7f8ffc0b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:21.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.196+0000 7f9001200640 1 -- 172.21.15.175:0/2687815266 shutdown_connections 2024-04-25T09:08:21.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.196+0000 7f9001200640 1 -- 172.21.15.175:0/2687815266 wait complete. 2024-04-25T09:08:21.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f9001200640 1 Processor -- start 2024-04-25T09:08:21.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f9001200640 1 -- start start 2024-04-25T09:08:21.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f9001200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fe0003a30 0x7f8ffc0b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f9001200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ffc0b6200 0x7f8ffc155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f9001200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ffc15ad20 0x7f8ffc15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f9001200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc06c3d0 con 0x7f8ffc0b6200 2024-04-25T09:08:21.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f9001200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc09ad20 con 0x7f8ffc15ad20 2024-04-25T09:08:21.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f9001200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc06d780 con 0x7f8fe0003a30 2024-04-25T09:08:21.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f8ffaa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ffc0b6200 0x7f8ffc155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f8ffaa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ffc0b6200 0x7f8ffc155c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60688/0 (socket says 172.21.15.175:60688) 2024-04-25T09:08:21.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f8ffaa00640 1 -- 172.21.15.175:0/2146184575 learned_addr learned my addr 172.21.15.175:0/2146184575 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:21.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f8ffbe00640 1 --2- 172.21.15.175:0/2146184575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ffc15ad20 0x7f8ffc15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f8ffb400640 1 --2- 172.21.15.175:0/2146184575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fe0003a30 0x7f8ffc0b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f8ffaa00640 1 -- 172.21.15.175:0/2146184575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fe0003a30 msgr2=0x7f8ffc0b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:21.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f8ffaa00640 1 --2- 172.21.15.175:0/2146184575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fe0003a30 0x7f8ffc0b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f8ffaa00640 1 -- 172.21.15.175:0/2146184575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ffc15ad20 msgr2=0x7f8ffc15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:21.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f8ffaa00640 1 --2- 172.21.15.175:0/2146184575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ffc15ad20 0x7f8ffc15beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f8ffaa00640 1 -- 172.21.15.175:0/2146184575 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc0b5160 con 0x7f8ffc0b6200 2024-04-25T09:08:21.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f8ffb400640 1 --2- 172.21.15.175:0/2146184575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fe0003a30 0x7f8ffc0b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:21.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f8ffbe00640 1 --2- 172.21.15.175:0/2146184575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ffc15ad20 0x7f8ffc15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:21.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f8ffaa00640 1 --2- 172.21.15.175:0/2146184575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ffc0b6200 0x7f8ffc155c90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8011900 tx=0x7f8fe8011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:21.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f8ff3400640 1 -- 172.21.15.175:0/2146184575 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe800fbd0 con 0x7f8ffc0b6200 2024-04-25T09:08:21.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f8ff3400640 1 -- 172.21.15.175:0/2146184575 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe800fd70 con 0x7f8ffc0b6200 2024-04-25T09:08:21.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f9001200640 1 -- 172.21.15.175:0/2146184575 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ffc0b5440 con 0x7f8ffc0b6200 2024-04-25T09:08:21.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f8ff3400640 1 -- 172.21.15.175:0/2146184575 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8015660 con 0x7f8ffc0b6200 2024-04-25T09:08:21.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f9001200640 1 -- 172.21.15.175:0/2146184575 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ffc0b5a00 con 0x7f8ffc0b6200 2024-04-25T09:08:21.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.200+0000 7f9001200640 1 -- 172.21.15.175:0/2146184575 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ffc074a60 con 0x7f8ffc0b6200 2024-04-25T09:08:21.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.204+0000 7f8ff3400640 1 -- 172.21.15.175:0/2146184575 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8fe8015800 con 0x7f8ffc0b6200 2024-04-25T09:08:21.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.204+0000 7f8ff3400640 1 --2- 172.21.15.175:0/2146184575 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8fdc066f90 0x7f8fdc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.204+0000 7f8ff3400640 1 -- 172.21.15.175:0/2146184575 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fe8085900 con 0x7f8ffc0b6200 2024-04-25T09:08:21.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.204+0000 7f8ffb400640 1 --2- 172.21.15.175:0/2146184575 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8fdc066f90 0x7f8fdc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.204+0000 7f8ffb400640 1 --2- 172.21.15.175:0/2146184575 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8fdc066f90 0x7f8fdc069450 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0aa000 tx=0x7f8fec001a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:21.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.208+0000 7f8ff3400640 1 -- 172.21.15.175:0/2146184575 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8fe8019030 con 0x7f8ffc0b6200 2024-04-25T09:08:21.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.392+0000 7f9001200640 1 -- 172.21.15.175:0/2146184575 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ffc15f4d0 con 0x7f8ffc0b6200 2024-04-25T09:08:21.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.396+0000 7f8ff3400640 1 -- 172.21.15.175:0/2146184575 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f8fe80569a0 con 0x7f8ffc0b6200 2024-04-25T09:08:21.384 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:21.384 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2493316948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2493316948},{"type":"v1","addr":"172.21.15.175:6837","nonce":2493316948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3408529232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3408529232},{"type":"v1","addr":"172.21.15.177:6834","nonce":3408529232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6513,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2714482688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2714482688},{"type":"v1","addr":"172.21.15.175:6836","nonce":2714482688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:08:17.378890+0000","modified":"2024-04-25T09:08:20.403261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"d","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1709110121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":1709110121},{"type":"v1","addr":"172.21.15.177:6835","nonce":1709110121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:08:21.384 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 43 2024-04-25T09:08:21.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.396+0000 7f9001200640 1 -- 172.21.15.175:0/2146184575 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8fdc066f90 msgr2=0x7f8fdc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:21.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.396+0000 7f9001200640 1 --2- 172.21.15.175:0/2146184575 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8fdc066f90 0x7f8fdc069450 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0aa000 tx=0x7f8fec001a50 comp rx=0 tx=0).stop 2024-04-25T09:08:21.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.396+0000 7f9001200640 1 -- 172.21.15.175:0/2146184575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ffc0b6200 msgr2=0x7f8ffc155c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:21.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.396+0000 7f9001200640 1 --2- 172.21.15.175:0/2146184575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ffc0b6200 0x7f8ffc155c90 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8011900 tx=0x7f8fe8011dc0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.396+0000 7f9001200640 1 -- 172.21.15.175:0/2146184575 shutdown_connections 2024-04-25T09:08:21.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.396+0000 7f9001200640 1 --2- 172.21.15.175:0/2146184575 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8fdc066f90 0x7f8fdc069450 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.396+0000 7f9001200640 1 --2- 172.21.15.175:0/2146184575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ffc15ad20 0x7f8ffc15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.396+0000 7f9001200640 1 --2- 172.21.15.175:0/2146184575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ffc0b6200 0x7f8ffc155c90 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.396+0000 7f9001200640 1 --2- 172.21.15.175:0/2146184575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8fe0003a30 0x7f8ffc0b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.396+0000 7f9001200640 1 -- 172.21.15.175:0/2146184575 >> 172.21.15.175:0/2146184575 conn(0x7f8ffc0b31b0 msgr2=0x7f8ffc0d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:21.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.396+0000 7f9001200640 1 -- 172.21.15.175:0/2146184575 shutdown_connections 2024-04-25T09:08:21.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.396+0000 7f9001200640 1 -- 172.21.15.175:0/2146184575 wait complete. 2024-04-25T09:08:21.404 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:08:21.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.548+0000 7f913b000640 1 Processor -- start 2024-04-25T09:08:21.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.548+0000 7f913b000640 1 -- start start 2024-04-25T09:08:21.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.552+0000 7f913b000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f91341453a0 0x7f913415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.552+0000 7f913b000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f913415c410 0x7f91340cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.552+0000 7f913b000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913415c8a0 con 0x7f9134144fc0 2024-04-25T09:08:21.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.552+0000 7f913b000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913415cd00 con 0x7f91341453a0 2024-04-25T09:08:21.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.552+0000 7f913b000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91340ce660 con 0x7f913415c410 2024-04-25T09:08:21.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.552+0000 7f912b400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f91341453a0 0x7f913415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.552+0000 7f912b400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f91341453a0 0x7f913415bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60696/0 (socket says 172.21.15.175:60696) 2024-04-25T09:08:21.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.552+0000 7f912b400640 1 -- 172.21.15.175:0/972303141 learned_addr learned my addr 172.21.15.175:0/972303141 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:21.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.552+0000 7f9139000640 1 --2- 172.21.15.175:0/972303141 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f913415c410 0x7f91340cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.552+0000 7f912b400640 1 -- 172.21.15.175:0/972303141 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f913415c410 msgr2=0x7f91340cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:21.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.552+0000 7f912b400640 1 --2- 172.21.15.175:0/972303141 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f913415c410 0x7f91340cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.552+0000 7f912b400640 1 -- 172.21.15.175:0/972303141 >> v1:172.21.15.177:6789/0 conn(0x7f9134144fc0 legacy=0x7f91340cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:21.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.552+0000 7f912b400640 1 -- 172.21.15.175:0/972303141 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91340cc930 con 0x7f91341453a0 2024-04-25T09:08:21.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.556+0000 7f912b400640 1 --2- 172.21.15.175:0/972303141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91341453a0 0x7f913415bed0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f911c0098a0 tx=0x7f911c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee375f6b31f9add server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:21.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.556+0000 7f9133400640 1 -- 172.21.15.175:0/972303141 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c0b1070 con 0x7f91341453a0 2024-04-25T09:08:21.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.556+0000 7f9133400640 1 -- 172.21.15.175:0/972303141 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c0ac410 con 0x7f91341453a0 2024-04-25T09:08:21.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.556+0000 7f9133400640 1 -- 172.21.15.175:0/972303141 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c0ac7e0 con 0x7f91341453a0 2024-04-25T09:08:21.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.556+0000 7f913b000640 1 -- 172.21.15.175:0/972303141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91341453a0 msgr2=0x7f913415bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:21.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.556+0000 7f913b000640 1 --2- 172.21.15.175:0/972303141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91341453a0 0x7f913415bed0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f911c0098a0 tx=0x7f911c01c500 comp rx=0 tx=0).stop 2024-04-25T09:08:21.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.556+0000 7f913b000640 1 -- 172.21.15.175:0/972303141 shutdown_connections 2024-04-25T09:08:21.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.556+0000 7f913b000640 1 --2- 172.21.15.175:0/972303141 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f913415c410 0x7f91340cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.556+0000 7f913b000640 1 --2- 172.21.15.175:0/972303141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f91341453a0 0x7f913415bed0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.556+0000 7f913b000640 1 -- 172.21.15.175:0/972303141 >> 172.21.15.175:0/972303141 conn(0x7f9134067150 msgr2=0x7f913406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:21.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.556+0000 7f913b000640 1 -- 172.21.15.175:0/972303141 shutdown_connections 2024-04-25T09:08:21.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.556+0000 7f913b000640 1 -- 172.21.15.175:0/972303141 wait complete. 2024-04-25T09:08:21.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.556+0000 7f913b000640 1 Processor -- start 2024-04-25T09:08:21.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.556+0000 7f913b000640 1 -- start start 2024-04-25T09:08:21.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f913b000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91341453a0 0x7f9134139590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f913b000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f913415c410 0x7f9134139ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f913b000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9134159a80 0x7f91340b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f913b000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91340cc580 con 0x7f9134159a80 2024-04-25T09:08:21.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f913b000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91340cfb70 con 0x7f91341453a0 2024-04-25T09:08:21.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f913b000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9134159f20 con 0x7f913415c410 2024-04-25T09:08:21.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f9139000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9134159a80 0x7f91340b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f9139000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9134159a80 0x7f91340b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60698/0 (socket says 172.21.15.175:60698) 2024-04-25T09:08:21.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f9139000640 1 -- 172.21.15.175:0/3425222713 learned_addr learned my addr 172.21.15.175:0/3425222713 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:21.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f912b400640 1 --2- 172.21.15.175:0/3425222713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f913415c410 0x7f9134139ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f9133e00640 1 --2- 172.21.15.175:0/3425222713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91341453a0 0x7f9134139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f9139000640 1 -- 172.21.15.175:0/3425222713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f913415c410 msgr2=0x7f9134139ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:21.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f9139000640 1 --2- 172.21.15.175:0/3425222713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f913415c410 0x7f9134139ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f9139000640 1 -- 172.21.15.175:0/3425222713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91341453a0 msgr2=0x7f9134139590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:21.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f9139000640 1 --2- 172.21.15.175:0/3425222713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91341453a0 0x7f9134139590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f9139000640 1 -- 172.21.15.175:0/3425222713 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913415a170 con 0x7f9134159a80 2024-04-25T09:08:21.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f9133e00640 1 --2- 172.21.15.175:0/3425222713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91341453a0 0x7f9134139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:21.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f9139000640 1 --2- 172.21.15.175:0/3425222713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9134159a80 0x7f91340b10b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f912c007e60 tx=0x7f912c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:21.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f9130c00640 1 -- 172.21.15.175:0/3425222713 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c014420 con 0x7f9134159a80 2024-04-25T09:08:21.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f9130c00640 1 -- 172.21.15.175:0/3425222713 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912c019070 con 0x7f9134159a80 2024-04-25T09:08:21.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f9130c00640 1 -- 172.21.15.175:0/3425222713 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c014820 con 0x7f9134159a80 2024-04-25T09:08:21.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f913b000640 1 -- 172.21.15.175:0/3425222713 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913415a450 con 0x7f9134159a80 2024-04-25T09:08:21.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f913b000640 1 -- 172.21.15.175:0/3425222713 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913415aa10 con 0x7f9134159a80 2024-04-25T09:08:21.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f913b000640 1 -- 172.21.15.175:0/3425222713 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9134074a60 con 0x7f9134159a80 2024-04-25T09:08:21.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.560+0000 7f9130c00640 1 -- 172.21.15.175:0/3425222713 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f912c0149c0 con 0x7f9134159a80 2024-04-25T09:08:21.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.564+0000 7f9130c00640 1 --2- 172.21.15.175:0/3425222713 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9110066f60 0x7f9110069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.564+0000 7f9130c00640 1 -- 172.21.15.175:0/3425222713 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f912c085850 con 0x7f9134159a80 2024-04-25T09:08:21.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.564+0000 7f9133e00640 1 --2- 172.21.15.175:0/3425222713 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9110066f60 0x7f9110069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.564+0000 7f9133e00640 1 --2- 172.21.15.175:0/3425222713 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9110066f60 0x7f9110069420 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9124003e40 tx=0x7f9124009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:21.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.568+0000 7f9130c00640 1 -- 172.21.15.175:0/3425222713 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f912c011260 con 0x7f9134159a80 2024-04-25T09:08:21.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.720+0000 7f913b000640 1 -- 172.21.15.175:0/3425222713 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f913415e5f0 con 0x7f9134159a80 2024-04-25T09:08:21.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.724+0000 7f9130c00640 1 -- 172.21.15.175:0/3425222713 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16704 (secure 0 0 0) 0x7f912c056850 con 0x7f9134159a80 2024-04-25T09:08:21.712 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:21.712 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":69,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:08:19.012954+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:08:15.743582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T09:08:16.375168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:08:21.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.724+0000 7f913b000640 1 -- 172.21.15.175:0/3425222713 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9110066f60 msgr2=0x7f9110069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:21.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.724+0000 7f913b000640 1 --2- 172.21.15.175:0/3425222713 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9110066f60 0x7f9110069420 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9124003e40 tx=0x7f9124009040 comp rx=0 tx=0).stop 2024-04-25T09:08:21.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.724+0000 7f913b000640 1 -- 172.21.15.175:0/3425222713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9134159a80 msgr2=0x7f91340b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:21.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.724+0000 7f913b000640 1 --2- 172.21.15.175:0/3425222713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9134159a80 0x7f91340b10b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f912c007e60 tx=0x7f912c00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.724+0000 7f913b000640 1 -- 172.21.15.175:0/3425222713 shutdown_connections 2024-04-25T09:08:21.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.724+0000 7f913b000640 1 --2- 172.21.15.175:0/3425222713 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9110066f60 0x7f9110069420 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.724+0000 7f913b000640 1 --2- 172.21.15.175:0/3425222713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9134159a80 0x7f91340b10b0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.724+0000 7f913b000640 1 --2- 172.21.15.175:0/3425222713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f913415c410 0x7f9134139ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.724+0000 7f913b000640 1 --2- 172.21.15.175:0/3425222713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f91341453a0 0x7f9134139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.724+0000 7f913b000640 1 -- 172.21.15.175:0/3425222713 >> 172.21.15.175:0/3425222713 conn(0x7f9134144fc0 msgr2=0x7f913406d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:21.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.724+0000 7f913b000640 1 -- 172.21.15.175:0/3425222713 shutdown_connections 2024-04-25T09:08:21.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.724+0000 7f913b000640 1 -- 172.21.15.175:0/3425222713 wait complete. 2024-04-25T09:08:21.732 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:08:21.733 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:08:21.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.880+0000 7f17f1800640 1 Processor -- start 2024-04-25T09:08:21.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.880+0000 7f17f1800640 1 -- start start 2024-04-25T09:08:21.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.880+0000 7f17f1800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f17ec09abb0 0x7f17ec0cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.880+0000 7f17f1800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ec0cc4c0 con 0x7f17ec15bc10 2024-04-25T09:08:21.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.880+0000 7f17f1800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ec0cc7a0 con 0x7f17ec099a50 2024-04-25T09:08:21.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.880+0000 7f17f1800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ec0d06f0 con 0x7f17ec09abb0 2024-04-25T09:08:21.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.880+0000 7f17ea000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f17ec15bc10 0x7f17ec0cfdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:54586/0 (socket says 172.21.15.175:54586) 2024-04-25T09:08:21.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.880+0000 7f17ea000640 1 -- 172.21.15.175:0/1782929000 learned_addr learned my addr 172.21.15.175:0/1782929000 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:21.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.880+0000 7f17eb400640 1 --2- 172.21.15.175:0/1782929000 >> v2:172.21.15.177:3300/0 conn(0x7f17ec09abb0 0x7f17ec0cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.880+0000 7f17e9600640 1 -- 172.21.15.175:0/1782929000 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363241039 0 0) 0x7f17ec0cc4c0 con 0x7f17ec15bc10 2024-04-25T09:08:21.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.880+0000 7f17e9600640 1 -- 172.21.15.175:0/1782929000 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17d0003530 con 0x7f17ec15bc10 2024-04-25T09:08:21.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.880+0000 7f17eb400640 1 -- 172.21.15.175:0/1782929000 >> v1:172.21.15.177:6789/0 conn(0x7f17ec099a50 legacy=0x7f17ec099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:21.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.880+0000 7f17eb400640 1 -- 172.21.15.175:0/1782929000 >> v1:172.21.15.175:6789/0 conn(0x7f17ec15bc10 legacy=0x7f17ec0cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:21.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.880+0000 7f17eb400640 1 -- 172.21.15.175:0/1782929000 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec0cca80 con 0x7f17ec09abb0 2024-04-25T09:08:21.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.884+0000 7f17eb400640 1 --2- 172.21.15.175:0/1782929000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17ec09abb0 0x7f17ec0cd280 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f17e40097c0 tx=0x7f17e401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c895931c858779fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:21.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.884+0000 7f17e9600640 1 -- 172.21.15.175:0/1782929000 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e40b0070 con 0x7f17ec09abb0 2024-04-25T09:08:21.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.884+0000 7f17e9600640 1 -- 172.21.15.175:0/1782929000 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e40ab600 con 0x7f17ec09abb0 2024-04-25T09:08:21.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.884+0000 7f17e9600640 1 -- 172.21.15.175:0/1782929000 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e40ab9d0 con 0x7f17ec09abb0 2024-04-25T09:08:21.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.884+0000 7f17f1800640 1 -- 172.21.15.175:0/1782929000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17ec09abb0 msgr2=0x7f17ec0cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:21.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.884+0000 7f17f1800640 1 --2- 172.21.15.175:0/1782929000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17ec09abb0 0x7f17ec0cd280 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f17e40097c0 tx=0x7f17e401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.884+0000 7f17f1800640 1 -- 172.21.15.175:0/1782929000 shutdown_connections 2024-04-25T09:08:21.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.884+0000 7f17f1800640 1 --2- 172.21.15.175:0/1782929000 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17ec09abb0 0x7f17ec0cd280 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.884+0000 7f17f1800640 1 -- 172.21.15.175:0/1782929000 >> 172.21.15.175:0/1782929000 conn(0x7f17ec0b3300 msgr2=0x7f17ec0b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:21.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.884+0000 7f17f1800640 1 -- 172.21.15.175:0/1782929000 shutdown_connections 2024-04-25T09:08:21.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.884+0000 7f17f1800640 1 -- 172.21.15.175:0/1782929000 wait complete. 2024-04-25T09:08:21.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17f1800640 1 Processor -- start 2024-04-25T09:08:21.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17f1800640 1 -- start start 2024-04-25T09:08:21.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17f1800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17ec099a50 0x7f17ec15cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17f1800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17ec09abb0 0x7f17ec157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17f1800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17ec15bc10 0x7f17ec166c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17f1800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec0c5f00 con 0x7f17ec09abb0 2024-04-25T09:08:21.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17f1800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec0c5d80 con 0x7f17ec15bc10 2024-04-25T09:08:21.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17f1800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ec169860 con 0x7f17ec099a50 2024-04-25T09:08:21.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17ea000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17ec09abb0 0x7f17ec157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17ea000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17ec09abb0 0x7f17ec157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60706/0 (socket says 172.21.15.175:60706) 2024-04-25T09:08:21.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17ea000640 1 -- 172.21.15.175:0/491886358 learned_addr learned my addr 172.21.15.175:0/491886358 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:21.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17eb400640 1 --2- 172.21.15.175:0/491886358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17ec15bc10 0x7f17ec166c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17eaa00640 1 --2- 172.21.15.175:0/491886358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17ec099a50 0x7f17ec15cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17ea000640 1 -- 172.21.15.175:0/491886358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17ec099a50 msgr2=0x7f17ec15cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:21.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17ea000640 1 --2- 172.21.15.175:0/491886358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17ec099a50 0x7f17ec15cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17ea000640 1 -- 172.21.15.175:0/491886358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17ec15bc10 msgr2=0x7f17ec166c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:21.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17ea000640 1 --2- 172.21.15.175:0/491886358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17ec15bc10 0x7f17ec166c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:21.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17ea000640 1 -- 172.21.15.175:0/491886358 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec1671d0 con 0x7f17ec09abb0 2024-04-25T09:08:21.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17eb400640 1 --2- 172.21.15.175:0/491886358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17ec15bc10 0x7f17ec166c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:21.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17ea000640 1 --2- 172.21.15.175:0/491886358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17ec09abb0 0x7f17ec157520 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f17d800c420 tx=0x7f17d800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:21.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17e2a00640 1 -- 172.21.15.175:0/491886358 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8017070 con 0x7f17ec09abb0 2024-04-25T09:08:21.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17e2a00640 1 -- 172.21.15.175:0/491886358 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d8005cf0 con 0x7f17ec09abb0 2024-04-25T09:08:21.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17f1800640 1 -- 172.21.15.175:0/491886358 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ec15d210 con 0x7f17ec09abb0 2024-04-25T09:08:21.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17e2a00640 1 -- 172.21.15.175:0/491886358 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d80072d0 con 0x7f17ec09abb0 2024-04-25T09:08:21.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17f1800640 1 -- 172.21.15.175:0/491886358 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ec15d7d0 con 0x7f17ec09abb0 2024-04-25T09:08:21.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.888+0000 7f17f1800640 1 -- 172.21.15.175:0/491886358 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ec074a60 con 0x7f17ec09abb0 2024-04-25T09:08:21.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.892+0000 7f17e2a00640 1 -- 172.21.15.175:0/491886358 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f17d801a070 con 0x7f17ec09abb0 2024-04-25T09:08:21.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.892+0000 7f17e2a00640 1 --2- 172.21.15.175:0/491886358 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f17cc066f60 0x7f17cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:21.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.892+0000 7f17e2a00640 1 -- 172.21.15.175:0/491886358 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17d80843c0 con 0x7f17ec09abb0 2024-04-25T09:08:21.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.892+0000 7f17eaa00640 1 --2- 172.21.15.175:0/491886358 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f17cc066f60 0x7f17cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:21.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.892+0000 7f17eaa00640 1 --2- 172.21.15.175:0/491886358 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f17cc066f60 0x7f17cc069420 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f17dc001d50 tx=0x7f17dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:21.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:21.896+0000 7f17e2a00640 1 -- 172.21.15.175:0/491886358 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f17d8054ce0 con 0x7f17ec09abb0 2024-04-25T09:08:22.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.048+0000 7f17f1800640 1 -- 172.21.15.175:0/491886358 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17ec0c8130 con 0x7f17cc066f60 2024-04-25T09:08:22.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.056+0000 7f17e2a00640 1 -- 172.21.15.175:0/491886358 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246753 (secure 0 0 0) 0x7f17ec0c8130 con 0x7f17cc066f60 2024-04-25T09:08:22.049 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:22.050 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:08:22.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.060+0000 7f17f1800640 1 -- 172.21.15.175:0/491886358 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f17cc066f60 msgr2=0x7f17cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:22.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.060+0000 7f17f1800640 1 --2- 172.21.15.175:0/491886358 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f17cc066f60 0x7f17cc069420 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f17dc001d50 tx=0x7f17dc009040 comp rx=0 tx=0).stop 2024-04-25T09:08:22.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.060+0000 7f17f1800640 1 -- 172.21.15.175:0/491886358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17ec09abb0 msgr2=0x7f17ec157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:22.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.060+0000 7f17f1800640 1 --2- 172.21.15.175:0/491886358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17ec09abb0 0x7f17ec157520 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f17d800c420 tx=0x7f17d800c8e0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.060+0000 7f17f1800640 1 -- 172.21.15.175:0/491886358 shutdown_connections 2024-04-25T09:08:22.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.060+0000 7f17f1800640 1 --2- 172.21.15.175:0/491886358 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f17cc066f60 0x7f17cc069420 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.060+0000 7f17f1800640 1 --2- 172.21.15.175:0/491886358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17ec15bc10 0x7f17ec166c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.060+0000 7f17f1800640 1 --2- 172.21.15.175:0/491886358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17ec09abb0 0x7f17ec157520 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.060+0000 7f17f1800640 1 --2- 172.21.15.175:0/491886358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17ec099a50 0x7f17ec15cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.060+0000 7f17f1800640 1 -- 172.21.15.175:0/491886358 >> 172.21.15.175:0/491886358 conn(0x7f17ec0b3300 msgr2=0x7f17ec0cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:22.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.060+0000 7f17f1800640 1 -- 172.21.15.175:0/491886358 shutdown_connections 2024-04-25T09:08:22.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.060+0000 7f17f1800640 1 -- 172.21.15.175:0/491886358 wait complete. 2024-04-25T09:08:22.068 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-04-25T09:08:21.846556+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236164,"kb_used_data":7516,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738556,"statfs":{"total":773094113280,"available":772852281344,"internally_reserved":0,"allocated":7696384,"data_stored":3893501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.853098"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018680+0000","last_change":"2024-04-25T09:08:17.018680+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018680+0000","last_undegraded":"2024-04-25T09:08:17.018680+0000","last_fullsized":"2024-04-25T09:08:17.018680+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005292+0000","last_change":"2024-04-25T09:08:17.005292+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005292+0000","last_undegraded":"2024-04-25T09:08:17.005292+0000","last_fullsized":"2024-04-25T09:08:17.005292+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.010066+0000","last_change":"2024-04-25T09:08:17.010066+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.010066+0000","last_undegraded":"2024-04-25T09:08:17.010066+0000","last_fullsized":"2024-04-25T09:08:17.010066+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005491+0000","last_change":"2024-04-25T09:08:17.005491+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005491+0000","last_undegraded":"2024-04-25T09:08:17.005491+0000","last_fullsized":"2024-04-25T09:08:17.005491+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007894+0000","last_change":"2024-04-25T09:08:17.007894+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007894+0000","last_undegraded":"2024-04-25T09:08:17.007894+0000","last_fullsized":"2024-04-25T09:08:17.007894+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007349+0000","last_change":"2024-04-25T09:08:17.007349+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007349+0000","last_undegraded":"2024-04-25T09:08:17.007349+0000","last_fullsized":"2024-04-25T09:08:17.007349+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.011503+0000","last_change":"2024-04-25T09:08:17.011503+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.011503+0000","last_undegraded":"2024-04-25T09:08:17.011503+0000","last_fullsized":"2024-04-25T09:08:17.011503+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005586+0000","last_change":"2024-04-25T09:08:17.005586+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005586+0000","last_undegraded":"2024-04-25T09:08:17.005586+0000","last_fullsized":"2024-04-25T09:08:17.005586+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013666+0000","last_change":"2024-04-25T09:08:17.013666+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013666+0000","last_undegraded":"2024-04-25T09:08:17.013666+0000","last_fullsized":"2024-04-25T09:08:17.013666+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.012277+0000","last_change":"2024-04-25T09:08:17.012277+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.012277+0000","last_undegraded":"2024-04-25T09:08:17.012277+0000","last_fullsized":"2024-04-25T09:08:17.012277+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018926+0000","last_change":"2024-04-25T09:08:17.018926+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018926+0000","last_undegraded":"2024-04-25T09:08:17.018926+0000","last_fullsized":"2024-04-25T09:08:17.018926+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005086+0000","last_change":"2024-04-25T09:08:17.005086+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005086+0000","last_undegraded":"2024-04-25T09:08:17.005086+0000","last_fullsized":"2024-04-25T09:08:17.005086+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007114+0000","last_change":"2024-04-25T09:08:17.007114+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007114+0000","last_undegraded":"2024-04-25T09:08:17.007114+0000","last_fullsized":"2024-04-25T09:08:17.007114+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008999+0000","last_change":"2024-04-25T09:08:17.008999+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008999+0000","last_undegraded":"2024-04-25T09:08:17.008999+0000","last_fullsized":"2024-04-25T09:08:17.008999+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006655+0000","last_change":"2024-04-25T09:08:17.006655+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006655+0000","last_undegraded":"2024-04-25T09:08:17.006655+0000","last_fullsized":"2024-04-25T09:08:17.006655+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009324+0000","last_change":"2024-04-25T09:08:17.009324+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009324+0000","last_undegraded":"2024-04-25T09:08:17.009324+0000","last_fullsized":"2024-04-25T09:08:17.009324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013231+0000","last_change":"2024-04-25T09:08:17.013231+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013231+0000","last_undegraded":"2024-04-25T09:08:17.013231+0000","last_fullsized":"2024-04-25T09:08:17.013231+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004597+0000","last_change":"2024-04-25T09:08:17.004597+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004597+0000","last_undegraded":"2024-04-25T09:08:17.004597+0000","last_fullsized":"2024-04-25T09:08:17.004597+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005206+0000","last_change":"2024-04-25T09:08:17.005206+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005206+0000","last_undegraded":"2024-04-25T09:08:17.005206+0000","last_fullsized":"2024-04-25T09:08:17.005206+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008633+0000","last_change":"2024-04-25T09:08:17.008633+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008633+0000","last_undegraded":"2024-04-25T09:08:17.008633+0000","last_fullsized":"2024-04-25T09:08:17.008633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009408+0000","last_change":"2024-04-25T09:08:17.009408+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009408+0000","last_undegraded":"2024-04-25T09:08:17.009408+0000","last_fullsized":"2024-04-25T09:08:17.009408+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009875+0000","last_change":"2024-04-25T09:08:17.009875+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009875+0000","last_undegraded":"2024-04-25T09:08:17.009875+0000","last_fullsized":"2024-04-25T09:08:17.009875+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018577+0000","last_change":"2024-04-25T09:08:17.018577+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018577+0000","last_undegraded":"2024-04-25T09:08:17.018577+0000","last_fullsized":"2024-04-25T09:08:17.018577+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.017830+0000","last_change":"2024-04-25T09:08:17.017830+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.017830+0000","last_undegraded":"2024-04-25T09:08:17.017830+0000","last_fullsized":"2024-04-25T09:08:17.017830+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.010472+0000","last_change":"2024-04-25T09:08:17.010472+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.010472+0000","last_undegraded":"2024-04-25T09:08:17.010472+0000","last_fullsized":"2024-04-25T09:08:17.010472+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007670+0000","last_change":"2024-04-25T09:08:17.007670+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007670+0000","last_undegraded":"2024-04-25T09:08:17.007670+0000","last_fullsized":"2024-04-25T09:08:17.007670+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009644+0000","last_change":"2024-04-25T09:08:17.009644+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009644+0000","last_undegraded":"2024-04-25T09:08:17.009644+0000","last_fullsized":"2024-04-25T09:08:17.009644+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.012738+0000","last_change":"2024-04-25T09:08:17.012738+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.012738+0000","last_undegraded":"2024-04-25T09:08:17.012738+0000","last_fullsized":"2024-04-25T09:08:17.012738+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008977+0000","last_change":"2024-04-25T09:08:17.008977+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008977+0000","last_undegraded":"2024-04-25T09:08:17.008977+0000","last_fullsized":"2024-04-25T09:08:17.008977+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.011552+0000","last_change":"2024-04-25T09:08:17.011552+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.011552+0000","last_undegraded":"2024-04-25T09:08:17.011552+0000","last_fullsized":"2024-04-25T09:08:17.011552+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007586+0000","last_change":"2024-04-25T09:08:17.007586+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007586+0000","last_undegraded":"2024-04-25T09:08:17.007586+0000","last_fullsized":"2024-04-25T09:08:17.007586+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004876+0000","last_change":"2024-04-25T09:08:17.004876+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004876+0000","last_undegraded":"2024-04-25T09:08:17.004876+0000","last_fullsized":"2024-04-25T09:08:17.004876+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.017842+0000","last_change":"2024-04-25T09:08:17.017842+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.017842+0000","last_undegraded":"2024-04-25T09:08:17.017842+0000","last_fullsized":"2024-04-25T09:08:17.017842+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033662+0000","last_change":"2024-04-25T09:08:17.029200+0000","last_active":"2024-04-25T09:08:17.033662+0000","last_peered":"2024-04-25T09:08:17.033662+0000","last_clean":"2024-04-25T09:08:17.033662+0000","last_became_active":"2024-04-25T09:08:17.028890+0000","last_became_peered":"2024-04-25T09:08:17.028890+0000","last_unstale":"2024-04-25T09:08:17.033662+0000","last_undegraded":"2024-04-25T09:08:17.033662+0000","last_fullsized":"2024-04-25T09:08:17.033662+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:55.882355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.012445+0000","last_change":"2024-04-25T09:08:17.012445+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.012445+0000","last_undegraded":"2024-04-25T09:08:17.012445+0000","last_fullsized":"2024-04-25T09:08:17.012445+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.027624+0000","last_change":"2024-04-25T09:08:17.022928+0000","last_active":"2024-04-25T09:08:17.027624+0000","last_peered":"2024-04-25T09:08:17.027624+0000","last_clean":"2024-04-25T09:08:17.027624+0000","last_became_active":"2024-04-25T09:08:17.022408+0000","last_became_peered":"2024-04-25T09:08:17.022408+0000","last_unstale":"2024-04-25T09:08:17.027624+0000","last_undegraded":"2024-04-25T09:08:17.027624+0000","last_fullsized":"2024-04-25T09:08:17.027624+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:04.773505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005576+0000","last_change":"2024-04-25T09:08:17.005576+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005576+0000","last_undegraded":"2024-04-25T09:08:17.005576+0000","last_fullsized":"2024-04-25T09:08:17.005576+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033373+0000","last_change":"2024-04-25T09:08:17.026541+0000","last_active":"2024-04-25T09:08:17.033373+0000","last_peered":"2024-04-25T09:08:17.033373+0000","last_clean":"2024-04-25T09:08:17.033373+0000","last_became_active":"2024-04-25T09:08:17.026241+0000","last_became_peered":"2024-04-25T09:08:17.026241+0000","last_unstale":"2024-04-25T09:08:17.033373+0000","last_undegraded":"2024-04-25T09:08:17.033373+0000","last_fullsized":"2024-04-25T09:08:17.033373+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:16.176102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018031+0000","last_change":"2024-04-25T09:08:17.018031+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018031+0000","last_undegraded":"2024-04-25T09:08:17.018031+0000","last_fullsized":"2024-04-25T09:08:17.018031+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023898+0000","last_change":"2024-04-25T09:08:17.017059+0000","last_active":"2024-04-25T09:08:17.023898+0000","last_peered":"2024-04-25T09:08:17.023898+0000","last_clean":"2024-04-25T09:08:17.023898+0000","last_became_active":"2024-04-25T09:08:17.016731+0000","last_became_peered":"2024-04-25T09:08:17.016731+0000","last_unstale":"2024-04-25T09:08:17.023898+0000","last_undegraded":"2024-04-25T09:08:17.023898+0000","last_fullsized":"2024-04-25T09:08:17.023898+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:30.230418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006510+0000","last_change":"2024-04-25T09:08:17.006510+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006510+0000","last_undegraded":"2024-04-25T09:08:17.006510+0000","last_fullsized":"2024-04-25T09:08:17.006510+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.027739+0000","last_change":"2024-04-25T09:08:17.026572+0000","last_active":"2024-04-25T09:08:17.027739+0000","last_peered":"2024-04-25T09:08:17.027739+0000","last_clean":"2024-04-25T09:08:17.027739+0000","last_became_active":"2024-04-25T09:08:17.026303+0000","last_became_peered":"2024-04-25T09:08:17.026303+0000","last_unstale":"2024-04-25T09:08:17.027739+0000","last_undegraded":"2024-04-25T09:08:17.027739+0000","last_fullsized":"2024-04-25T09:08:17.027739+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:03.502069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008840+0000","last_change":"2024-04-25T09:08:17.008840+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008840+0000","last_undegraded":"2024-04-25T09:08:17.008840+0000","last_fullsized":"2024-04-25T09:08:17.008840+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023801+0000","last_change":"2024-04-25T09:08:17.015944+0000","last_active":"2024-04-25T09:08:17.023801+0000","last_peered":"2024-04-25T09:08:17.023801+0000","last_clean":"2024-04-25T09:08:17.023801+0000","last_became_active":"2024-04-25T09:08:17.015622+0000","last_became_peered":"2024-04-25T09:08:17.015622+0000","last_unstale":"2024-04-25T09:08:17.023801+0000","last_undegraded":"2024-04-25T09:08:17.023801+0000","last_fullsized":"2024-04-25T09:08:17.023801+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:10.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.015882+0000","last_change":"2024-04-25T09:08:17.015882+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.015882+0000","last_undegraded":"2024-04-25T09:08:17.015882+0000","last_fullsized":"2024-04-25T09:08:17.015882+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023081+0000","last_change":"2024-04-25T09:08:17.020849+0000","last_active":"2024-04-25T09:08:17.023081+0000","last_peered":"2024-04-25T09:08:17.023081+0000","last_clean":"2024-04-25T09:08:17.023081+0000","last_became_active":"2024-04-25T09:08:17.020389+0000","last_became_peered":"2024-04-25T09:08:17.020389+0000","last_unstale":"2024-04-25T09:08:17.023081+0000","last_undegraded":"2024-04-25T09:08:17.023081+0000","last_fullsized":"2024-04-25T09:08:17.023081+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:36.326769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006232+0000","last_change":"2024-04-25T09:08:17.006232+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006232+0000","last_undegraded":"2024-04-25T09:08:17.006232+0000","last_fullsized":"2024-04-25T09:08:17.006232+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026789+0000","last_change":"2024-04-25T09:08:17.021273+0000","last_active":"2024-04-25T09:08:17.026789+0000","last_peered":"2024-04-25T09:08:17.026789+0000","last_clean":"2024-04-25T09:08:17.026789+0000","last_became_active":"2024-04-25T09:08:17.020604+0000","last_became_peered":"2024-04-25T09:08:17.020604+0000","last_unstale":"2024-04-25T09:08:17.026789+0000","last_undegraded":"2024-04-25T09:08:17.026789+0000","last_fullsized":"2024-04-25T09:08:17.026789+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:06.708703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007226+0000","last_change":"2024-04-25T09:08:17.007226+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007226+0000","last_undegraded":"2024-04-25T09:08:17.007226+0000","last_fullsized":"2024-04-25T09:08:17.007226+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.030475+0000","last_change":"2024-04-25T09:08:17.020881+0000","last_active":"2024-04-25T09:08:17.030475+0000","last_peered":"2024-04-25T09:08:17.030475+0000","last_clean":"2024-04-25T09:08:17.030475+0000","last_became_active":"2024-04-25T09:08:17.020648+0000","last_became_peered":"2024-04-25T09:08:17.020648+0000","last_unstale":"2024-04-25T09:08:17.030475+0000","last_undegraded":"2024-04-25T09:08:17.030475+0000","last_fullsized":"2024-04-25T09:08:17.030475+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:34.954575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018250+0000","last_change":"2024-04-25T09:08:17.018250+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018250+0000","last_undegraded":"2024-04-25T09:08:17.018250+0000","last_fullsized":"2024-04-25T09:08:17.018250+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023940+0000","last_change":"2024-04-25T09:08:17.017234+0000","last_active":"2024-04-25T09:08:17.023940+0000","last_peered":"2024-04-25T09:08:17.023940+0000","last_clean":"2024-04-25T09:08:17.023940+0000","last_became_active":"2024-04-25T09:08:17.016932+0000","last_became_peered":"2024-04-25T09:08:17.016932+0000","last_unstale":"2024-04-25T09:08:17.023940+0000","last_undegraded":"2024-04-25T09:08:17.023940+0000","last_fullsized":"2024-04-25T09:08:17.023940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:00.689918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004833+0000","last_change":"2024-04-25T09:08:17.004833+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004833+0000","last_undegraded":"2024-04-25T09:08:17.004833+0000","last_fullsized":"2024-04-25T09:08:17.004833+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.028198+0000","last_change":"2024-04-25T09:08:17.027002+0000","last_active":"2024-04-25T09:08:17.028198+0000","last_peered":"2024-04-25T09:08:17.028198+0000","last_clean":"2024-04-25T09:08:17.028198+0000","last_became_active":"2024-04-25T09:08:17.026421+0000","last_became_peered":"2024-04-25T09:08:17.026421+0000","last_unstale":"2024-04-25T09:08:17.028198+0000","last_undegraded":"2024-04-25T09:08:17.028198+0000","last_fullsized":"2024-04-25T09:08:17.028198+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:52.586369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.012716+0000","last_change":"2024-04-25T09:08:17.012716+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.012716+0000","last_undegraded":"2024-04-25T09:08:17.012716+0000","last_fullsized":"2024-04-25T09:08:17.012716+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.018395+0000","last_change":"2024-04-25T09:08:17.011530+0000","last_active":"2024-04-25T09:08:17.018395+0000","last_peered":"2024-04-25T09:08:17.018395+0000","last_clean":"2024-04-25T09:08:17.018395+0000","last_became_active":"2024-04-25T09:08:17.011275+0000","last_became_peered":"2024-04-25T09:08:17.011275+0000","last_unstale":"2024-04-25T09:08:17.018395+0000","last_undegraded":"2024-04-25T09:08:17.018395+0000","last_fullsized":"2024-04-25T09:08:17.018395+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:16.028538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018337+0000","last_change":"2024-04-25T09:08:17.018337+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018337+0000","last_undegraded":"2024-04-25T09:08:17.018337+0000","last_fullsized":"2024-04-25T09:08:17.018337+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026530+0000","last_change":"2024-04-25T09:08:17.024819+0000","last_active":"2024-04-25T09:08:17.026530+0000","last_peered":"2024-04-25T09:08:17.026530+0000","last_clean":"2024-04-25T09:08:17.026530+0000","last_became_active":"2024-04-25T09:08:17.024388+0000","last_became_peered":"2024-04-25T09:08:17.024388+0000","last_unstale":"2024-04-25T09:08:17.026530+0000","last_undegraded":"2024-04-25T09:08:17.026530+0000","last_fullsized":"2024-04-25T09:08:17.026530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:20.348350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006894+0000","last_change":"2024-04-25T09:08:17.006894+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006894+0000","last_undegraded":"2024-04-25T09:08:17.006894+0000","last_fullsized":"2024-04-25T09:08:17.006894+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.029123+0000","last_change":"2024-04-25T09:08:17.023485+0000","last_active":"2024-04-25T09:08:17.029123+0000","last_peered":"2024-04-25T09:08:17.029123+0000","last_clean":"2024-04-25T09:08:17.029123+0000","last_became_active":"2024-04-25T09:08:17.022356+0000","last_became_peered":"2024-04-25T09:08:17.022356+0000","last_unstale":"2024-04-25T09:08:17.029123+0000","last_undegraded":"2024-04-25T09:08:17.029123+0000","last_fullsized":"2024-04-25T09:08:17.029123+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:49.163088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006039+0000","last_change":"2024-04-25T09:08:17.006039+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006039+0000","last_undegraded":"2024-04-25T09:08:17.006039+0000","last_fullsized":"2024-04-25T09:08:17.006039+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026949+0000","last_change":"2024-04-25T09:08:17.019898+0000","last_active":"2024-04-25T09:08:17.026949+0000","last_peered":"2024-04-25T09:08:17.026949+0000","last_clean":"2024-04-25T09:08:17.026949+0000","last_became_active":"2024-04-25T09:08:17.019593+0000","last_became_peered":"2024-04-25T09:08:17.019593+0000","last_unstale":"2024-04-25T09:08:17.026949+0000","last_undegraded":"2024-04-25T09:08:17.026949+0000","last_fullsized":"2024-04-25T09:08:17.026949+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:31.133503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006931+0000","last_change":"2024-04-25T09:08:17.006931+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006931+0000","last_undegraded":"2024-04-25T09:08:17.006931+0000","last_fullsized":"2024-04-25T09:08:17.006931+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033565+0000","last_change":"2024-04-25T09:08:17.028980+0000","last_active":"2024-04-25T09:08:17.033565+0000","last_peered":"2024-04-25T09:08:17.033565+0000","last_clean":"2024-04-25T09:08:17.033565+0000","last_became_active":"2024-04-25T09:08:17.026719+0000","last_became_peered":"2024-04-25T09:08:17.026719+0000","last_unstale":"2024-04-25T09:08:17.033565+0000","last_undegraded":"2024-04-25T09:08:17.033565+0000","last_fullsized":"2024-04-25T09:08:17.033565+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:54.808987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.011883+0000","last_change":"2024-04-25T09:08:17.011883+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.011883+0000","last_undegraded":"2024-04-25T09:08:17.011883+0000","last_fullsized":"2024-04-25T09:08:17.011883+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.024050+0000","last_change":"2024-04-25T09:08:17.021008+0000","last_active":"2024-04-25T09:08:17.024050+0000","last_peered":"2024-04-25T09:08:17.024050+0000","last_clean":"2024-04-25T09:08:17.024050+0000","last_became_active":"2024-04-25T09:08:17.020699+0000","last_became_peered":"2024-04-25T09:08:17.020699+0000","last_unstale":"2024-04-25T09:08:17.024050+0000","last_undegraded":"2024-04-25T09:08:17.024050+0000","last_fullsized":"2024-04-25T09:08:17.024050+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:10.660294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013082+0000","last_change":"2024-04-25T09:08:17.013082+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013082+0000","last_undegraded":"2024-04-25T09:08:17.013082+0000","last_fullsized":"2024-04-25T09:08:17.013082+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033530+0000","last_change":"2024-04-25T09:08:17.028655+0000","last_active":"2024-04-25T09:08:17.033530+0000","last_peered":"2024-04-25T09:08:17.033530+0000","last_clean":"2024-04-25T09:08:17.033530+0000","last_became_active":"2024-04-25T09:08:17.028383+0000","last_became_peered":"2024-04-25T09:08:17.028383+0000","last_unstale":"2024-04-25T09:08:17.033530+0000","last_undegraded":"2024-04-25T09:08:17.033530+0000","last_fullsized":"2024-04-25T09:08:17.033530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:23.297153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004492+0000","last_change":"2024-04-25T09:08:17.004492+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004492+0000","last_undegraded":"2024-04-25T09:08:17.004492+0000","last_fullsized":"2024-04-25T09:08:17.004492+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.031027+0000","last_change":"2024-04-25T09:08:17.027470+0000","last_active":"2024-04-25T09:08:17.031027+0000","last_peered":"2024-04-25T09:08:17.031027+0000","last_clean":"2024-04-25T09:08:17.031027+0000","last_became_active":"2024-04-25T09:08:17.027198+0000","last_became_peered":"2024-04-25T09:08:17.027198+0000","last_unstale":"2024-04-25T09:08:17.031027+0000","last_undegraded":"2024-04-25T09:08:17.031027+0000","last_fullsized":"2024-04-25T09:08:17.031027+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:02.688386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007577+0000","last_change":"2024-04-25T09:08:17.007577+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007577+0000","last_undegraded":"2024-04-25T09:08:17.007577+0000","last_fullsized":"2024-04-25T09:08:17.007577+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.036250+0000","last_change":"2024-04-25T09:08:17.031403+0000","last_active":"2024-04-25T09:08:17.036250+0000","last_peered":"2024-04-25T09:08:17.036250+0000","last_clean":"2024-04-25T09:08:17.036250+0000","last_became_active":"2024-04-25T09:08:17.031145+0000","last_became_peered":"2024-04-25T09:08:17.031145+0000","last_unstale":"2024-04-25T09:08:17.036250+0000","last_undegraded":"2024-04-25T09:08:17.036250+0000","last_fullsized":"2024-04-25T09:08:17.036250+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:17.838172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008528+0000","last_change":"2024-04-25T09:08:17.008528+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008528+0000","last_undegraded":"2024-04-25T09:08:17.008528+0000","last_fullsized":"2024-04-25T09:08:17.008528+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023992+0000","last_change":"2024-04-25T09:08:17.015969+0000","last_active":"2024-04-25T09:08:17.023992+0000","last_peered":"2024-04-25T09:08:17.023992+0000","last_clean":"2024-04-25T09:08:17.023992+0000","last_became_active":"2024-04-25T09:08:17.015633+0000","last_became_peered":"2024-04-25T09:08:17.015633+0000","last_unstale":"2024-04-25T09:08:17.023992+0000","last_undegraded":"2024-04-25T09:08:17.023992+0000","last_fullsized":"2024-04-25T09:08:17.023992+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:30.776286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008759+0000","last_change":"2024-04-25T09:08:17.008759+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008759+0000","last_undegraded":"2024-04-25T09:08:17.008759+0000","last_fullsized":"2024-04-25T09:08:17.008759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.028086+0000","last_change":"2024-04-25T09:08:17.021971+0000","last_active":"2024-04-25T09:08:17.028086+0000","last_peered":"2024-04-25T09:08:17.028086+0000","last_clean":"2024-04-25T09:08:17.028086+0000","last_became_active":"2024-04-25T09:08:17.021372+0000","last_became_peered":"2024-04-25T09:08:17.021372+0000","last_unstale":"2024-04-25T09:08:17.028086+0000","last_undegraded":"2024-04-25T09:08:17.028086+0000","last_fullsized":"2024-04-25T09:08:17.028086+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:26.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008064+0000","last_change":"2024-04-25T09:08:17.008064+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008064+0000","last_undegraded":"2024-04-25T09:08:17.008064+0000","last_fullsized":"2024-04-25T09:08:17.008064+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.027593+0000","last_change":"2024-04-25T09:08:17.023926+0000","last_active":"2024-04-25T09:08:17.027593+0000","last_peered":"2024-04-25T09:08:17.027593+0000","last_clean":"2024-04-25T09:08:17.027593+0000","last_became_active":"2024-04-25T09:08:17.023662+0000","last_became_peered":"2024-04-25T09:08:17.023662+0000","last_unstale":"2024-04-25T09:08:17.027593+0000","last_undegraded":"2024-04-25T09:08:17.027593+0000","last_fullsized":"2024-04-25T09:08:17.027593+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:22.702984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009567+0000","last_change":"2024-04-25T09:08:17.009567+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009567+0000","last_undegraded":"2024-04-25T09:08:17.009567+0000","last_fullsized":"2024-04-25T09:08:17.009567+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.024033+0000","last_change":"2024-04-25T09:08:17.020129+0000","last_active":"2024-04-25T09:08:17.024033+0000","last_peered":"2024-04-25T09:08:17.024033+0000","last_clean":"2024-04-25T09:08:17.024033+0000","last_became_active":"2024-04-25T09:08:17.019765+0000","last_became_peered":"2024-04-25T09:08:17.019765+0000","last_unstale":"2024-04-25T09:08:17.024033+0000","last_undegraded":"2024-04-25T09:08:17.024033+0000","last_fullsized":"2024-04-25T09:08:17.024033+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:19.461337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006618+0000","last_change":"2024-04-25T09:08:17.006618+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006618+0000","last_undegraded":"2024-04-25T09:08:17.006618+0000","last_fullsized":"2024-04-25T09:08:17.006618+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026521+0000","last_change":"2024-04-25T09:08:17.018323+0000","last_active":"2024-04-25T09:08:17.026521+0000","last_peered":"2024-04-25T09:08:17.026521+0000","last_clean":"2024-04-25T09:08:17.026521+0000","last_became_active":"2024-04-25T09:08:17.018021+0000","last_became_peered":"2024-04-25T09:08:17.018021+0000","last_unstale":"2024-04-25T09:08:17.026521+0000","last_undegraded":"2024-04-25T09:08:17.026521+0000","last_fullsized":"2024-04-25T09:08:17.026521+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:22.702984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013067+0000","last_change":"2024-04-25T09:08:17.013067+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013067+0000","last_undegraded":"2024-04-25T09:08:17.013067+0000","last_fullsized":"2024-04-25T09:08:17.013067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.025141+0000","last_change":"2024-04-25T09:08:17.017852+0000","last_active":"2024-04-25T09:08:17.025141+0000","last_peered":"2024-04-25T09:08:17.025141+0000","last_clean":"2024-04-25T09:08:17.025141+0000","last_became_active":"2024-04-25T09:08:17.017430+0000","last_became_peered":"2024-04-25T09:08:17.017430+0000","last_unstale":"2024-04-25T09:08:17.025141+0000","last_undegraded":"2024-04-25T09:08:17.025141+0000","last_fullsized":"2024-04-25T09:08:17.025141+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:19.488485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013585+0000","last_change":"2024-04-25T09:08:17.013585+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013585+0000","last_undegraded":"2024-04-25T09:08:17.013585+0000","last_fullsized":"2024-04-25T09:08:17.013585+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.028222+0000","last_change":"2024-04-25T09:08:17.026372+0000","last_active":"2024-04-25T09:08:17.028222+0000","last_peered":"2024-04-25T09:08:17.028222+0000","last_clean":"2024-04-25T09:08:17.028222+0000","last_became_active":"2024-04-25T09:08:17.026102+0000","last_became_peered":"2024-04-25T09:08:17.026102+0000","last_unstale":"2024-04-25T09:08:17.028222+0000","last_undegraded":"2024-04-25T09:08:17.028222+0000","last_fullsized":"2024-04-25T09:08:17.028222+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:31.133503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007283+0000","last_change":"2024-04-25T09:08:17.007283+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007283+0000","last_undegraded":"2024-04-25T09:08:17.007283+0000","last_fullsized":"2024-04-25T09:08:17.007283+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.027476+0000","last_change":"2024-04-25T09:08:17.024952+0000","last_active":"2024-04-25T09:08:17.027476+0000","last_peered":"2024-04-25T09:08:17.027476+0000","last_clean":"2024-04-25T09:08:17.027476+0000","last_became_active":"2024-04-25T09:08:17.024696+0000","last_became_peered":"2024-04-25T09:08:17.024696+0000","last_unstale":"2024-04-25T09:08:17.027476+0000","last_undegraded":"2024-04-25T09:08:17.027476+0000","last_fullsized":"2024-04-25T09:08:17.027476+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:20.303509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007882+0000","last_change":"2024-04-25T09:08:17.007882+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007882+0000","last_undegraded":"2024-04-25T09:08:17.007882+0000","last_fullsized":"2024-04-25T09:08:17.007882+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.024423+0000","last_change":"2024-04-25T09:08:17.021898+0000","last_active":"2024-04-25T09:08:17.024423+0000","last_peered":"2024-04-25T09:08:17.024423+0000","last_clean":"2024-04-25T09:08:17.024423+0000","last_became_active":"2024-04-25T09:08:17.021584+0000","last_became_peered":"2024-04-25T09:08:17.021584+0000","last_unstale":"2024-04-25T09:08:17.024423+0000","last_undegraded":"2024-04-25T09:08:17.024423+0000","last_fullsized":"2024-04-25T09:08:17.024423+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:40.369073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004497+0000","last_change":"2024-04-25T09:08:17.004497+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004497+0000","last_undegraded":"2024-04-25T09:08:17.004497+0000","last_fullsized":"2024-04-25T09:08:17.004497+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033347+0000","last_change":"2024-04-25T09:08:17.025380+0000","last_active":"2024-04-25T09:08:17.033347+0000","last_peered":"2024-04-25T09:08:17.033347+0000","last_clean":"2024-04-25T09:08:17.033347+0000","last_became_active":"2024-04-25T09:08:17.024963+0000","last_became_peered":"2024-04-25T09:08:17.024963+0000","last_unstale":"2024-04-25T09:08:17.033347+0000","last_undegraded":"2024-04-25T09:08:17.033347+0000","last_fullsized":"2024-04-25T09:08:17.033347+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:40.320274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005040+0000","last_change":"2024-04-25T09:08:17.005040+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005040+0000","last_undegraded":"2024-04-25T09:08:17.005040+0000","last_fullsized":"2024-04-25T09:08:17.005040+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026554+0000","last_change":"2024-04-25T09:08:17.022999+0000","last_active":"2024-04-25T09:08:17.026554+0000","last_peered":"2024-04-25T09:08:17.026554+0000","last_clean":"2024-04-25T09:08:17.026554+0000","last_became_active":"2024-04-25T09:08:17.022670+0000","last_became_peered":"2024-04-25T09:08:17.022670+0000","last_unstale":"2024-04-25T09:08:17.026554+0000","last_undegraded":"2024-04-25T09:08:17.026554+0000","last_fullsized":"2024-04-25T09:08:17.026554+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:23.008721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009981+0000","last_change":"2024-04-25T09:08:17.009981+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009981+0000","last_undegraded":"2024-04-25T09:08:17.009981+0000","last_fullsized":"2024-04-25T09:08:17.009981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026379+0000","last_change":"2024-04-25T09:08:17.023005+0000","last_active":"2024-04-25T09:08:17.026379+0000","last_peered":"2024-04-25T09:08:17.026379+0000","last_clean":"2024-04-25T09:08:17.026379+0000","last_became_active":"2024-04-25T09:08:17.022690+0000","last_became_peered":"2024-04-25T09:08:17.022690+0000","last_unstale":"2024-04-25T09:08:17.026379+0000","last_undegraded":"2024-04-25T09:08:17.026379+0000","last_fullsized":"2024-04-25T09:08:17.026379+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:37.550476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":257,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.020337+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:08:17.020337+0000","last_peered":"2024-04-25T09:08:17.020337+0000","last_clean":"2024-04-25T09:08:17.020337+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:08:17.020337+0000","last_undegraded":"2024-04-25T09:08:17.020337+0000","last_fullsized":"2024-04-25T09:08:17.020337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1396736,"data_stored":923973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1409024,"data_stored":930248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:08:22.073 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:08:22.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.256+0000 7f76fbe00640 1 Processor -- start 2024-04-25T09:08:22.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.256+0000 7f76fbe00640 1 -- start start 2024-04-25T09:08:22.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.256+0000 7f76fbe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f76f415a900 0x7f76f406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:22.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.256+0000 7f76fbe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76f40cd520 0x7f76f40ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:22.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.256+0000 7f76fbe00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f40cda00 con 0x7f76f40cf560 2024-04-25T09:08:22.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.256+0000 7f76fbe00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f415bcf0 con 0x7f76f415a900 2024-04-25T09:08:22.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.256+0000 7f76fbe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f40cdce0 con 0x7f76f40cd520 2024-04-25T09:08:22.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.260+0000 7f76f8a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76f40cd520 0x7f76f40ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:22.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.260+0000 7f76f9400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f76f415a900 0x7f76f406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:22.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.260+0000 7f76f8a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76f40cd520 0x7f76f40ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:37666/0 (socket says 172.21.15.175:37666) 2024-04-25T09:08:22.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.260+0000 7f76f8a00640 1 -- 172.21.15.175:0/39627876 learned_addr learned my addr 172.21.15.175:0/39627876 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:22.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.260+0000 7f76f9e00640 1 --1- 172.21.15.175:0/39627876 >> v1:172.21.15.177:6789/0 conn(0x7f76f40cf560 0x7f76f415bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:54746/0 (socket says 172.21.15.175:54746) 2024-04-25T09:08:22.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.260+0000 7f76f8a00640 1 -- 172.21.15.175:0/39627876 >> v2:172.21.15.177:3300/0 conn(0x7f76f415a900 msgr2=0x7f76f406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:22.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.260+0000 7f76f8a00640 1 --2- 172.21.15.175:0/39627876 >> v2:172.21.15.177:3300/0 conn(0x7f76f415a900 0x7f76f406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.260+0000 7f76f8a00640 1 -- 172.21.15.175:0/39627876 >> v1:172.21.15.177:6789/0 conn(0x7f76f40cf560 legacy=0x7f76f415bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:22.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.260+0000 7f76f8a00640 1 -- 172.21.15.175:0/39627876 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f40cdfc0 con 0x7f76f40cd520 2024-04-25T09:08:22.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.260+0000 7f76f8a00640 1 --2- 172.21.15.175:0/39627876 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76f40cd520 0x7f76f40ceaa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009870 tx=0x7f76e001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=908bbb89c95e33b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:22.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.260+0000 7f76f3e00640 1 -- 172.21.15.175:0/39627876 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e00ab640 con 0x7f76f40cd520 2024-04-25T09:08:22.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76f3e00640 1 -- 172.21.15.175:0/39627876 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e00b0070 con 0x7f76f40cd520 2024-04-25T09:08:22.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76f3e00640 1 -- 172.21.15.175:0/39627876 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e00aba00 con 0x7f76f40cd520 2024-04-25T09:08:22.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76fbe00640 1 -- 172.21.15.175:0/39627876 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76f40cd520 msgr2=0x7f76f40ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:22.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76fbe00640 1 --2- 172.21.15.175:0/39627876 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76f40cd520 0x7f76f40ceaa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009870 tx=0x7f76e001c530 comp rx=0 tx=0).stop 2024-04-25T09:08:22.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76fbe00640 1 -- 172.21.15.175:0/39627876 shutdown_connections 2024-04-25T09:08:22.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76fbe00640 1 --2- 172.21.15.175:0/39627876 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76f40cd520 0x7f76f40ceaa0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76fbe00640 1 --2- 172.21.15.175:0/39627876 >> v2:172.21.15.177:3300/0 conn(0x7f76f415a900 0x7f76f406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76fbe00640 1 -- 172.21.15.175:0/39627876 >> 172.21.15.175:0/39627876 conn(0x7f76f4067150 msgr2=0x7f76f406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:22.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76fbe00640 1 -- 172.21.15.175:0/39627876 shutdown_connections 2024-04-25T09:08:22.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76fbe00640 1 -- 172.21.15.175:0/39627876 wait complete. 2024-04-25T09:08:22.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76fbe00640 1 Processor -- start 2024-04-25T09:08:22.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76fbe00640 1 -- start start 2024-04-25T09:08:22.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76fbe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76f40cf560 0x7f76f41458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:22.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76fbe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76f415a900 0x7f76f40b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:22.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76fbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f40b1160 0x7f76f40b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:22.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76fbe00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f40cf160 con 0x7f76f40b1160 2024-04-25T09:08:22.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76fbe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f40cefe0 con 0x7f76f415a900 2024-04-25T09:08:22.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76fbe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f406d3b0 con 0x7f76f40cf560 2024-04-25T09:08:22.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76f9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f40b1160 0x7f76f40b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:22.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76f9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f40b1160 0x7f76f40b15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60716/0 (socket says 172.21.15.175:60716) 2024-04-25T09:08:22.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76f9e00640 1 -- 172.21.15.175:0/2699987173 learned_addr learned my addr 172.21.15.175:0/2699987173 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:22.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76f9400640 1 --2- 172.21.15.175:0/2699987173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76f40cf560 0x7f76f41458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:22.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.264+0000 7f76f8a00640 1 --2- 172.21.15.175:0/2699987173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76f415a900 0x7f76f40b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:22.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.268+0000 7f76f9e00640 1 -- 172.21.15.175:0/2699987173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76f40cf560 msgr2=0x7f76f41458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:22.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.268+0000 7f76f9e00640 1 --2- 172.21.15.175:0/2699987173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76f40cf560 0x7f76f41458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.268+0000 7f76f9e00640 1 -- 172.21.15.175:0/2699987173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76f415a900 msgr2=0x7f76f40b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:22.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.268+0000 7f76f9e00640 1 --2- 172.21.15.175:0/2699987173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76f415a900 0x7f76f40b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.268+0000 7f76f9e00640 1 -- 172.21.15.175:0/2699987173 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f4145df0 con 0x7f76f40b1160 2024-04-25T09:08:22.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.268+0000 7f76f9e00640 1 --2- 172.21.15.175:0/2699987173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f40b1160 0x7f76f40b15f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00c7d0 tx=0x7f76ec00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:22.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.268+0000 7f76f1600640 1 -- 172.21.15.175:0/2699987173 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec017070 con 0x7f76f40b1160 2024-04-25T09:08:22.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.268+0000 7f76f1600640 1 -- 172.21.15.175:0/2699987173 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ec00a640 con 0x7f76f40b1160 2024-04-25T09:08:22.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.268+0000 7f76fbe00640 1 -- 172.21.15.175:0/2699987173 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f41575f0 con 0x7f76f40b1160 2024-04-25T09:08:22.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.268+0000 7f76f1600640 1 -- 172.21.15.175:0/2699987173 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec00a9f0 con 0x7f76f40b1160 2024-04-25T09:08:22.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.268+0000 7f76fbe00640 1 -- 172.21.15.175:0/2699987173 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f40af430 con 0x7f76f40b1160 2024-04-25T09:08:22.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.268+0000 7f76fbe00640 1 -- 172.21.15.175:0/2699987173 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f4074a60 con 0x7f76f40b1160 2024-04-25T09:08:22.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.268+0000 7f76f1600640 1 -- 172.21.15.175:0/2699987173 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f76ec01a070 con 0x7f76f40b1160 2024-04-25T09:08:22.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.268+0000 7f76f1600640 1 --2- 172.21.15.175:0/2699987173 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f76d4066f60 0x7f76d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:22.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.268+0000 7f76f1600640 1 -- 172.21.15.175:0/2699987173 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76ec084620 con 0x7f76f40b1160 2024-04-25T09:08:22.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.268+0000 7f76f9400640 1 --2- 172.21.15.175:0/2699987173 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f76d4066f60 0x7f76d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:22.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.272+0000 7f76f9400640 1 --2- 172.21.15.175:0/2699987173 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f76d4066f60 0x7f76d4069420 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f76f41467c0 tx=0x7f76e8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:22.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.272+0000 7f76f1600640 1 -- 172.21.15.175:0/2699987173 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f76ec054f50 con 0x7f76f40b1160 2024-04-25T09:08:22.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.424+0000 7f76fbe00640 1 -- 172.21.15.175:0/2699987173 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76f40008e0 con 0x7f76d4066f60 2024-04-25T09:08:22.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.428+0000 7f76f1600640 1 -- 172.21.15.175:0/2699987173 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246753 (secure 0 0 0) 0x7f76f40008e0 con 0x7f76d4066f60 2024-04-25T09:08:22.422 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:22.423 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:08:22.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.432+0000 7f76fbe00640 1 -- 172.21.15.175:0/2699987173 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f76d4066f60 msgr2=0x7f76d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:22.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.432+0000 7f76fbe00640 1 --2- 172.21.15.175:0/2699987173 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f76d4066f60 0x7f76d4069420 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f76f41467c0 tx=0x7f76e8009190 comp rx=0 tx=0).stop 2024-04-25T09:08:22.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.432+0000 7f76fbe00640 1 -- 172.21.15.175:0/2699987173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f40b1160 msgr2=0x7f76f40b15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:22.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.432+0000 7f76fbe00640 1 --2- 172.21.15.175:0/2699987173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f40b1160 0x7f76f40b15f0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00c7d0 tx=0x7f76ec00cc90 comp rx=0 tx=0).stop 2024-04-25T09:08:22.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.436+0000 7f76fbe00640 1 -- 172.21.15.175:0/2699987173 shutdown_connections 2024-04-25T09:08:22.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.436+0000 7f76fbe00640 1 --2- 172.21.15.175:0/2699987173 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f76d4066f60 0x7f76d4069420 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.436+0000 7f76fbe00640 1 --2- 172.21.15.175:0/2699987173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76f40b1160 0x7f76f40b15f0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.436+0000 7f76fbe00640 1 --2- 172.21.15.175:0/2699987173 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f76f415a900 0x7f76f40b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.436+0000 7f76fbe00640 1 --2- 172.21.15.175:0/2699987173 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f76f40cf560 0x7f76f41458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.436+0000 7f76fbe00640 1 -- 172.21.15.175:0/2699987173 >> 172.21.15.175:0/2699987173 conn(0x7f76f40cd520 msgr2=0x7f76f406d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:22.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.436+0000 7f76fbe00640 1 -- 172.21.15.175:0/2699987173 shutdown_connections 2024-04-25T09:08:22.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.436+0000 7f76fbe00640 1 -- 172.21.15.175:0/2699987173 wait complete. 2024-04-25T09:08:22.443 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-04-25T09:08:21.846556+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236164,"kb_used_data":7516,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738556,"statfs":{"total":773094113280,"available":772852281344,"internally_reserved":0,"allocated":7696384,"data_stored":3893501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.853098"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018680+0000","last_change":"2024-04-25T09:08:17.018680+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018680+0000","last_undegraded":"2024-04-25T09:08:17.018680+0000","last_fullsized":"2024-04-25T09:08:17.018680+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005292+0000","last_change":"2024-04-25T09:08:17.005292+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005292+0000","last_undegraded":"2024-04-25T09:08:17.005292+0000","last_fullsized":"2024-04-25T09:08:17.005292+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.010066+0000","last_change":"2024-04-25T09:08:17.010066+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.010066+0000","last_undegraded":"2024-04-25T09:08:17.010066+0000","last_fullsized":"2024-04-25T09:08:17.010066+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005491+0000","last_change":"2024-04-25T09:08:17.005491+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005491+0000","last_undegraded":"2024-04-25T09:08:17.005491+0000","last_fullsized":"2024-04-25T09:08:17.005491+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007894+0000","last_change":"2024-04-25T09:08:17.007894+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007894+0000","last_undegraded":"2024-04-25T09:08:17.007894+0000","last_fullsized":"2024-04-25T09:08:17.007894+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007349+0000","last_change":"2024-04-25T09:08:17.007349+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007349+0000","last_undegraded":"2024-04-25T09:08:17.007349+0000","last_fullsized":"2024-04-25T09:08:17.007349+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.011503+0000","last_change":"2024-04-25T09:08:17.011503+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.011503+0000","last_undegraded":"2024-04-25T09:08:17.011503+0000","last_fullsized":"2024-04-25T09:08:17.011503+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005586+0000","last_change":"2024-04-25T09:08:17.005586+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005586+0000","last_undegraded":"2024-04-25T09:08:17.005586+0000","last_fullsized":"2024-04-25T09:08:17.005586+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013666+0000","last_change":"2024-04-25T09:08:17.013666+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013666+0000","last_undegraded":"2024-04-25T09:08:17.013666+0000","last_fullsized":"2024-04-25T09:08:17.013666+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.012277+0000","last_change":"2024-04-25T09:08:17.012277+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.012277+0000","last_undegraded":"2024-04-25T09:08:17.012277+0000","last_fullsized":"2024-04-25T09:08:17.012277+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018926+0000","last_change":"2024-04-25T09:08:17.018926+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018926+0000","last_undegraded":"2024-04-25T09:08:17.018926+0000","last_fullsized":"2024-04-25T09:08:17.018926+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005086+0000","last_change":"2024-04-25T09:08:17.005086+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005086+0000","last_undegraded":"2024-04-25T09:08:17.005086+0000","last_fullsized":"2024-04-25T09:08:17.005086+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007114+0000","last_change":"2024-04-25T09:08:17.007114+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007114+0000","last_undegraded":"2024-04-25T09:08:17.007114+0000","last_fullsized":"2024-04-25T09:08:17.007114+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008999+0000","last_change":"2024-04-25T09:08:17.008999+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008999+0000","last_undegraded":"2024-04-25T09:08:17.008999+0000","last_fullsized":"2024-04-25T09:08:17.008999+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006655+0000","last_change":"2024-04-25T09:08:17.006655+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006655+0000","last_undegraded":"2024-04-25T09:08:17.006655+0000","last_fullsized":"2024-04-25T09:08:17.006655+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009324+0000","last_change":"2024-04-25T09:08:17.009324+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009324+0000","last_undegraded":"2024-04-25T09:08:17.009324+0000","last_fullsized":"2024-04-25T09:08:17.009324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013231+0000","last_change":"2024-04-25T09:08:17.013231+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013231+0000","last_undegraded":"2024-04-25T09:08:17.013231+0000","last_fullsized":"2024-04-25T09:08:17.013231+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004597+0000","last_change":"2024-04-25T09:08:17.004597+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004597+0000","last_undegraded":"2024-04-25T09:08:17.004597+0000","last_fullsized":"2024-04-25T09:08:17.004597+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005206+0000","last_change":"2024-04-25T09:08:17.005206+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005206+0000","last_undegraded":"2024-04-25T09:08:17.005206+0000","last_fullsized":"2024-04-25T09:08:17.005206+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008633+0000","last_change":"2024-04-25T09:08:17.008633+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008633+0000","last_undegraded":"2024-04-25T09:08:17.008633+0000","last_fullsized":"2024-04-25T09:08:17.008633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009408+0000","last_change":"2024-04-25T09:08:17.009408+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009408+0000","last_undegraded":"2024-04-25T09:08:17.009408+0000","last_fullsized":"2024-04-25T09:08:17.009408+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009875+0000","last_change":"2024-04-25T09:08:17.009875+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009875+0000","last_undegraded":"2024-04-25T09:08:17.009875+0000","last_fullsized":"2024-04-25T09:08:17.009875+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018577+0000","last_change":"2024-04-25T09:08:17.018577+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018577+0000","last_undegraded":"2024-04-25T09:08:17.018577+0000","last_fullsized":"2024-04-25T09:08:17.018577+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.017830+0000","last_change":"2024-04-25T09:08:17.017830+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.017830+0000","last_undegraded":"2024-04-25T09:08:17.017830+0000","last_fullsized":"2024-04-25T09:08:17.017830+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.010472+0000","last_change":"2024-04-25T09:08:17.010472+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.010472+0000","last_undegraded":"2024-04-25T09:08:17.010472+0000","last_fullsized":"2024-04-25T09:08:17.010472+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007670+0000","last_change":"2024-04-25T09:08:17.007670+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007670+0000","last_undegraded":"2024-04-25T09:08:17.007670+0000","last_fullsized":"2024-04-25T09:08:17.007670+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009644+0000","last_change":"2024-04-25T09:08:17.009644+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009644+0000","last_undegraded":"2024-04-25T09:08:17.009644+0000","last_fullsized":"2024-04-25T09:08:17.009644+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.012738+0000","last_change":"2024-04-25T09:08:17.012738+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.012738+0000","last_undegraded":"2024-04-25T09:08:17.012738+0000","last_fullsized":"2024-04-25T09:08:17.012738+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008977+0000","last_change":"2024-04-25T09:08:17.008977+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008977+0000","last_undegraded":"2024-04-25T09:08:17.008977+0000","last_fullsized":"2024-04-25T09:08:17.008977+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.011552+0000","last_change":"2024-04-25T09:08:17.011552+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.011552+0000","last_undegraded":"2024-04-25T09:08:17.011552+0000","last_fullsized":"2024-04-25T09:08:17.011552+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007586+0000","last_change":"2024-04-25T09:08:17.007586+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007586+0000","last_undegraded":"2024-04-25T09:08:17.007586+0000","last_fullsized":"2024-04-25T09:08:17.007586+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004876+0000","last_change":"2024-04-25T09:08:17.004876+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004876+0000","last_undegraded":"2024-04-25T09:08:17.004876+0000","last_fullsized":"2024-04-25T09:08:17.004876+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.017842+0000","last_change":"2024-04-25T09:08:17.017842+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.017842+0000","last_undegraded":"2024-04-25T09:08:17.017842+0000","last_fullsized":"2024-04-25T09:08:17.017842+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033662+0000","last_change":"2024-04-25T09:08:17.029200+0000","last_active":"2024-04-25T09:08:17.033662+0000","last_peered":"2024-04-25T09:08:17.033662+0000","last_clean":"2024-04-25T09:08:17.033662+0000","last_became_active":"2024-04-25T09:08:17.028890+0000","last_became_peered":"2024-04-25T09:08:17.028890+0000","last_unstale":"2024-04-25T09:08:17.033662+0000","last_undegraded":"2024-04-25T09:08:17.033662+0000","last_fullsized":"2024-04-25T09:08:17.033662+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:55.882355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.012445+0000","last_change":"2024-04-25T09:08:17.012445+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.012445+0000","last_undegraded":"2024-04-25T09:08:17.012445+0000","last_fullsized":"2024-04-25T09:08:17.012445+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.027624+0000","last_change":"2024-04-25T09:08:17.022928+0000","last_active":"2024-04-25T09:08:17.027624+0000","last_peered":"2024-04-25T09:08:17.027624+0000","last_clean":"2024-04-25T09:08:17.027624+0000","last_became_active":"2024-04-25T09:08:17.022408+0000","last_became_peered":"2024-04-25T09:08:17.022408+0000","last_unstale":"2024-04-25T09:08:17.027624+0000","last_undegraded":"2024-04-25T09:08:17.027624+0000","last_fullsized":"2024-04-25T09:08:17.027624+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:04.773505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005576+0000","last_change":"2024-04-25T09:08:17.005576+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005576+0000","last_undegraded":"2024-04-25T09:08:17.005576+0000","last_fullsized":"2024-04-25T09:08:17.005576+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033373+0000","last_change":"2024-04-25T09:08:17.026541+0000","last_active":"2024-04-25T09:08:17.033373+0000","last_peered":"2024-04-25T09:08:17.033373+0000","last_clean":"2024-04-25T09:08:17.033373+0000","last_became_active":"2024-04-25T09:08:17.026241+0000","last_became_peered":"2024-04-25T09:08:17.026241+0000","last_unstale":"2024-04-25T09:08:17.033373+0000","last_undegraded":"2024-04-25T09:08:17.033373+0000","last_fullsized":"2024-04-25T09:08:17.033373+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:16.176102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018031+0000","last_change":"2024-04-25T09:08:17.018031+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018031+0000","last_undegraded":"2024-04-25T09:08:17.018031+0000","last_fullsized":"2024-04-25T09:08:17.018031+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023898+0000","last_change":"2024-04-25T09:08:17.017059+0000","last_active":"2024-04-25T09:08:17.023898+0000","last_peered":"2024-04-25T09:08:17.023898+0000","last_clean":"2024-04-25T09:08:17.023898+0000","last_became_active":"2024-04-25T09:08:17.016731+0000","last_became_peered":"2024-04-25T09:08:17.016731+0000","last_unstale":"2024-04-25T09:08:17.023898+0000","last_undegraded":"2024-04-25T09:08:17.023898+0000","last_fullsized":"2024-04-25T09:08:17.023898+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:30.230418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006510+0000","last_change":"2024-04-25T09:08:17.006510+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006510+0000","last_undegraded":"2024-04-25T09:08:17.006510+0000","last_fullsized":"2024-04-25T09:08:17.006510+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.027739+0000","last_change":"2024-04-25T09:08:17.026572+0000","last_active":"2024-04-25T09:08:17.027739+0000","last_peered":"2024-04-25T09:08:17.027739+0000","last_clean":"2024-04-25T09:08:17.027739+0000","last_became_active":"2024-04-25T09:08:17.026303+0000","last_became_peered":"2024-04-25T09:08:17.026303+0000","last_unstale":"2024-04-25T09:08:17.027739+0000","last_undegraded":"2024-04-25T09:08:17.027739+0000","last_fullsized":"2024-04-25T09:08:17.027739+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:03.502069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008840+0000","last_change":"2024-04-25T09:08:17.008840+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008840+0000","last_undegraded":"2024-04-25T09:08:17.008840+0000","last_fullsized":"2024-04-25T09:08:17.008840+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023801+0000","last_change":"2024-04-25T09:08:17.015944+0000","last_active":"2024-04-25T09:08:17.023801+0000","last_peered":"2024-04-25T09:08:17.023801+0000","last_clean":"2024-04-25T09:08:17.023801+0000","last_became_active":"2024-04-25T09:08:17.015622+0000","last_became_peered":"2024-04-25T09:08:17.015622+0000","last_unstale":"2024-04-25T09:08:17.023801+0000","last_undegraded":"2024-04-25T09:08:17.023801+0000","last_fullsized":"2024-04-25T09:08:17.023801+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:10.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.015882+0000","last_change":"2024-04-25T09:08:17.015882+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.015882+0000","last_undegraded":"2024-04-25T09:08:17.015882+0000","last_fullsized":"2024-04-25T09:08:17.015882+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023081+0000","last_change":"2024-04-25T09:08:17.020849+0000","last_active":"2024-04-25T09:08:17.023081+0000","last_peered":"2024-04-25T09:08:17.023081+0000","last_clean":"2024-04-25T09:08:17.023081+0000","last_became_active":"2024-04-25T09:08:17.020389+0000","last_became_peered":"2024-04-25T09:08:17.020389+0000","last_unstale":"2024-04-25T09:08:17.023081+0000","last_undegraded":"2024-04-25T09:08:17.023081+0000","last_fullsized":"2024-04-25T09:08:17.023081+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:36.326769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006232+0000","last_change":"2024-04-25T09:08:17.006232+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006232+0000","last_undegraded":"2024-04-25T09:08:17.006232+0000","last_fullsized":"2024-04-25T09:08:17.006232+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026789+0000","last_change":"2024-04-25T09:08:17.021273+0000","last_active":"2024-04-25T09:08:17.026789+0000","last_peered":"2024-04-25T09:08:17.026789+0000","last_clean":"2024-04-25T09:08:17.026789+0000","last_became_active":"2024-04-25T09:08:17.020604+0000","last_became_peered":"2024-04-25T09:08:17.020604+0000","last_unstale":"2024-04-25T09:08:17.026789+0000","last_undegraded":"2024-04-25T09:08:17.026789+0000","last_fullsized":"2024-04-25T09:08:17.026789+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:06.708703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007226+0000","last_change":"2024-04-25T09:08:17.007226+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007226+0000","last_undegraded":"2024-04-25T09:08:17.007226+0000","last_fullsized":"2024-04-25T09:08:17.007226+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.030475+0000","last_change":"2024-04-25T09:08:17.020881+0000","last_active":"2024-04-25T09:08:17.030475+0000","last_peered":"2024-04-25T09:08:17.030475+0000","last_clean":"2024-04-25T09:08:17.030475+0000","last_became_active":"2024-04-25T09:08:17.020648+0000","last_became_peered":"2024-04-25T09:08:17.020648+0000","last_unstale":"2024-04-25T09:08:17.030475+0000","last_undegraded":"2024-04-25T09:08:17.030475+0000","last_fullsized":"2024-04-25T09:08:17.030475+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:34.954575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018250+0000","last_change":"2024-04-25T09:08:17.018250+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018250+0000","last_undegraded":"2024-04-25T09:08:17.018250+0000","last_fullsized":"2024-04-25T09:08:17.018250+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023940+0000","last_change":"2024-04-25T09:08:17.017234+0000","last_active":"2024-04-25T09:08:17.023940+0000","last_peered":"2024-04-25T09:08:17.023940+0000","last_clean":"2024-04-25T09:08:17.023940+0000","last_became_active":"2024-04-25T09:08:17.016932+0000","last_became_peered":"2024-04-25T09:08:17.016932+0000","last_unstale":"2024-04-25T09:08:17.023940+0000","last_undegraded":"2024-04-25T09:08:17.023940+0000","last_fullsized":"2024-04-25T09:08:17.023940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:00.689918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004833+0000","last_change":"2024-04-25T09:08:17.004833+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004833+0000","last_undegraded":"2024-04-25T09:08:17.004833+0000","last_fullsized":"2024-04-25T09:08:17.004833+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.028198+0000","last_change":"2024-04-25T09:08:17.027002+0000","last_active":"2024-04-25T09:08:17.028198+0000","last_peered":"2024-04-25T09:08:17.028198+0000","last_clean":"2024-04-25T09:08:17.028198+0000","last_became_active":"2024-04-25T09:08:17.026421+0000","last_became_peered":"2024-04-25T09:08:17.026421+0000","last_unstale":"2024-04-25T09:08:17.028198+0000","last_undegraded":"2024-04-25T09:08:17.028198+0000","last_fullsized":"2024-04-25T09:08:17.028198+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:52.586369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.012716+0000","last_change":"2024-04-25T09:08:17.012716+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.012716+0000","last_undegraded":"2024-04-25T09:08:17.012716+0000","last_fullsized":"2024-04-25T09:08:17.012716+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.018395+0000","last_change":"2024-04-25T09:08:17.011530+0000","last_active":"2024-04-25T09:08:17.018395+0000","last_peered":"2024-04-25T09:08:17.018395+0000","last_clean":"2024-04-25T09:08:17.018395+0000","last_became_active":"2024-04-25T09:08:17.011275+0000","last_became_peered":"2024-04-25T09:08:17.011275+0000","last_unstale":"2024-04-25T09:08:17.018395+0000","last_undegraded":"2024-04-25T09:08:17.018395+0000","last_fullsized":"2024-04-25T09:08:17.018395+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:16.028538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018337+0000","last_change":"2024-04-25T09:08:17.018337+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018337+0000","last_undegraded":"2024-04-25T09:08:17.018337+0000","last_fullsized":"2024-04-25T09:08:17.018337+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026530+0000","last_change":"2024-04-25T09:08:17.024819+0000","last_active":"2024-04-25T09:08:17.026530+0000","last_peered":"2024-04-25T09:08:17.026530+0000","last_clean":"2024-04-25T09:08:17.026530+0000","last_became_active":"2024-04-25T09:08:17.024388+0000","last_became_peered":"2024-04-25T09:08:17.024388+0000","last_unstale":"2024-04-25T09:08:17.026530+0000","last_undegraded":"2024-04-25T09:08:17.026530+0000","last_fullsized":"2024-04-25T09:08:17.026530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:20.348350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006894+0000","last_change":"2024-04-25T09:08:17.006894+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006894+0000","last_undegraded":"2024-04-25T09:08:17.006894+0000","last_fullsized":"2024-04-25T09:08:17.006894+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.029123+0000","last_change":"2024-04-25T09:08:17.023485+0000","last_active":"2024-04-25T09:08:17.029123+0000","last_peered":"2024-04-25T09:08:17.029123+0000","last_clean":"2024-04-25T09:08:17.029123+0000","last_became_active":"2024-04-25T09:08:17.022356+0000","last_became_peered":"2024-04-25T09:08:17.022356+0000","last_unstale":"2024-04-25T09:08:17.029123+0000","last_undegraded":"2024-04-25T09:08:17.029123+0000","last_fullsized":"2024-04-25T09:08:17.029123+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:49.163088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006039+0000","last_change":"2024-04-25T09:08:17.006039+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006039+0000","last_undegraded":"2024-04-25T09:08:17.006039+0000","last_fullsized":"2024-04-25T09:08:17.006039+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026949+0000","last_change":"2024-04-25T09:08:17.019898+0000","last_active":"2024-04-25T09:08:17.026949+0000","last_peered":"2024-04-25T09:08:17.026949+0000","last_clean":"2024-04-25T09:08:17.026949+0000","last_became_active":"2024-04-25T09:08:17.019593+0000","last_became_peered":"2024-04-25T09:08:17.019593+0000","last_unstale":"2024-04-25T09:08:17.026949+0000","last_undegraded":"2024-04-25T09:08:17.026949+0000","last_fullsized":"2024-04-25T09:08:17.026949+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:31.133503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006931+0000","last_change":"2024-04-25T09:08:17.006931+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006931+0000","last_undegraded":"2024-04-25T09:08:17.006931+0000","last_fullsized":"2024-04-25T09:08:17.006931+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033565+0000","last_change":"2024-04-25T09:08:17.028980+0000","last_active":"2024-04-25T09:08:17.033565+0000","last_peered":"2024-04-25T09:08:17.033565+0000","last_clean":"2024-04-25T09:08:17.033565+0000","last_became_active":"2024-04-25T09:08:17.026719+0000","last_became_peered":"2024-04-25T09:08:17.026719+0000","last_unstale":"2024-04-25T09:08:17.033565+0000","last_undegraded":"2024-04-25T09:08:17.033565+0000","last_fullsized":"2024-04-25T09:08:17.033565+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:54.808987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.011883+0000","last_change":"2024-04-25T09:08:17.011883+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.011883+0000","last_undegraded":"2024-04-25T09:08:17.011883+0000","last_fullsized":"2024-04-25T09:08:17.011883+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.024050+0000","last_change":"2024-04-25T09:08:17.021008+0000","last_active":"2024-04-25T09:08:17.024050+0000","last_peered":"2024-04-25T09:08:17.024050+0000","last_clean":"2024-04-25T09:08:17.024050+0000","last_became_active":"2024-04-25T09:08:17.020699+0000","last_became_peered":"2024-04-25T09:08:17.020699+0000","last_unstale":"2024-04-25T09:08:17.024050+0000","last_undegraded":"2024-04-25T09:08:17.024050+0000","last_fullsized":"2024-04-25T09:08:17.024050+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:10.660294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013082+0000","last_change":"2024-04-25T09:08:17.013082+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013082+0000","last_undegraded":"2024-04-25T09:08:17.013082+0000","last_fullsized":"2024-04-25T09:08:17.013082+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033530+0000","last_change":"2024-04-25T09:08:17.028655+0000","last_active":"2024-04-25T09:08:17.033530+0000","last_peered":"2024-04-25T09:08:17.033530+0000","last_clean":"2024-04-25T09:08:17.033530+0000","last_became_active":"2024-04-25T09:08:17.028383+0000","last_became_peered":"2024-04-25T09:08:17.028383+0000","last_unstale":"2024-04-25T09:08:17.033530+0000","last_undegraded":"2024-04-25T09:08:17.033530+0000","last_fullsized":"2024-04-25T09:08:17.033530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:23.297153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004492+0000","last_change":"2024-04-25T09:08:17.004492+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004492+0000","last_undegraded":"2024-04-25T09:08:17.004492+0000","last_fullsized":"2024-04-25T09:08:17.004492+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.031027+0000","last_change":"2024-04-25T09:08:17.027470+0000","last_active":"2024-04-25T09:08:17.031027+0000","last_peered":"2024-04-25T09:08:17.031027+0000","last_clean":"2024-04-25T09:08:17.031027+0000","last_became_active":"2024-04-25T09:08:17.027198+0000","last_became_peered":"2024-04-25T09:08:17.027198+0000","last_unstale":"2024-04-25T09:08:17.031027+0000","last_undegraded":"2024-04-25T09:08:17.031027+0000","last_fullsized":"2024-04-25T09:08:17.031027+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:02.688386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007577+0000","last_change":"2024-04-25T09:08:17.007577+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007577+0000","last_undegraded":"2024-04-25T09:08:17.007577+0000","last_fullsized":"2024-04-25T09:08:17.007577+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.036250+0000","last_change":"2024-04-25T09:08:17.031403+0000","last_active":"2024-04-25T09:08:17.036250+0000","last_peered":"2024-04-25T09:08:17.036250+0000","last_clean":"2024-04-25T09:08:17.036250+0000","last_became_active":"2024-04-25T09:08:17.031145+0000","last_became_peered":"2024-04-25T09:08:17.031145+0000","last_unstale":"2024-04-25T09:08:17.036250+0000","last_undegraded":"2024-04-25T09:08:17.036250+0000","last_fullsized":"2024-04-25T09:08:17.036250+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:17.838172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008528+0000","last_change":"2024-04-25T09:08:17.008528+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008528+0000","last_undegraded":"2024-04-25T09:08:17.008528+0000","last_fullsized":"2024-04-25T09:08:17.008528+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023992+0000","last_change":"2024-04-25T09:08:17.015969+0000","last_active":"2024-04-25T09:08:17.023992+0000","last_peered":"2024-04-25T09:08:17.023992+0000","last_clean":"2024-04-25T09:08:17.023992+0000","last_became_active":"2024-04-25T09:08:17.015633+0000","last_became_peered":"2024-04-25T09:08:17.015633+0000","last_unstale":"2024-04-25T09:08:17.023992+0000","last_undegraded":"2024-04-25T09:08:17.023992+0000","last_fullsized":"2024-04-25T09:08:17.023992+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:30.776286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008759+0000","last_change":"2024-04-25T09:08:17.008759+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008759+0000","last_undegraded":"2024-04-25T09:08:17.008759+0000","last_fullsized":"2024-04-25T09:08:17.008759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.028086+0000","last_change":"2024-04-25T09:08:17.021971+0000","last_active":"2024-04-25T09:08:17.028086+0000","last_peered":"2024-04-25T09:08:17.028086+0000","last_clean":"2024-04-25T09:08:17.028086+0000","last_became_active":"2024-04-25T09:08:17.021372+0000","last_became_peered":"2024-04-25T09:08:17.021372+0000","last_unstale":"2024-04-25T09:08:17.028086+0000","last_undegraded":"2024-04-25T09:08:17.028086+0000","last_fullsized":"2024-04-25T09:08:17.028086+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:26.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008064+0000","last_change":"2024-04-25T09:08:17.008064+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008064+0000","last_undegraded":"2024-04-25T09:08:17.008064+0000","last_fullsized":"2024-04-25T09:08:17.008064+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.027593+0000","last_change":"2024-04-25T09:08:17.023926+0000","last_active":"2024-04-25T09:08:17.027593+0000","last_peered":"2024-04-25T09:08:17.027593+0000","last_clean":"2024-04-25T09:08:17.027593+0000","last_became_active":"2024-04-25T09:08:17.023662+0000","last_became_peered":"2024-04-25T09:08:17.023662+0000","last_unstale":"2024-04-25T09:08:17.027593+0000","last_undegraded":"2024-04-25T09:08:17.027593+0000","last_fullsized":"2024-04-25T09:08:17.027593+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:22.702984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009567+0000","last_change":"2024-04-25T09:08:17.009567+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009567+0000","last_undegraded":"2024-04-25T09:08:17.009567+0000","last_fullsized":"2024-04-25T09:08:17.009567+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.024033+0000","last_change":"2024-04-25T09:08:17.020129+0000","last_active":"2024-04-25T09:08:17.024033+0000","last_peered":"2024-04-25T09:08:17.024033+0000","last_clean":"2024-04-25T09:08:17.024033+0000","last_became_active":"2024-04-25T09:08:17.019765+0000","last_became_peered":"2024-04-25T09:08:17.019765+0000","last_unstale":"2024-04-25T09:08:17.024033+0000","last_undegraded":"2024-04-25T09:08:17.024033+0000","last_fullsized":"2024-04-25T09:08:17.024033+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:19.461337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006618+0000","last_change":"2024-04-25T09:08:17.006618+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006618+0000","last_undegraded":"2024-04-25T09:08:17.006618+0000","last_fullsized":"2024-04-25T09:08:17.006618+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026521+0000","last_change":"2024-04-25T09:08:17.018323+0000","last_active":"2024-04-25T09:08:17.026521+0000","last_peered":"2024-04-25T09:08:17.026521+0000","last_clean":"2024-04-25T09:08:17.026521+0000","last_became_active":"2024-04-25T09:08:17.018021+0000","last_became_peered":"2024-04-25T09:08:17.018021+0000","last_unstale":"2024-04-25T09:08:17.026521+0000","last_undegraded":"2024-04-25T09:08:17.026521+0000","last_fullsized":"2024-04-25T09:08:17.026521+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:22.702984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013067+0000","last_change":"2024-04-25T09:08:17.013067+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013067+0000","last_undegraded":"2024-04-25T09:08:17.013067+0000","last_fullsized":"2024-04-25T09:08:17.013067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.025141+0000","last_change":"2024-04-25T09:08:17.017852+0000","last_active":"2024-04-25T09:08:17.025141+0000","last_peered":"2024-04-25T09:08:17.025141+0000","last_clean":"2024-04-25T09:08:17.025141+0000","last_became_active":"2024-04-25T09:08:17.017430+0000","last_became_peered":"2024-04-25T09:08:17.017430+0000","last_unstale":"2024-04-25T09:08:17.025141+0000","last_undegraded":"2024-04-25T09:08:17.025141+0000","last_fullsized":"2024-04-25T09:08:17.025141+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:19.488485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013585+0000","last_change":"2024-04-25T09:08:17.013585+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013585+0000","last_undegraded":"2024-04-25T09:08:17.013585+0000","last_fullsized":"2024-04-25T09:08:17.013585+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.028222+0000","last_change":"2024-04-25T09:08:17.026372+0000","last_active":"2024-04-25T09:08:17.028222+0000","last_peered":"2024-04-25T09:08:17.028222+0000","last_clean":"2024-04-25T09:08:17.028222+0000","last_became_active":"2024-04-25T09:08:17.026102+0000","last_became_peered":"2024-04-25T09:08:17.026102+0000","last_unstale":"2024-04-25T09:08:17.028222+0000","last_undegraded":"2024-04-25T09:08:17.028222+0000","last_fullsized":"2024-04-25T09:08:17.028222+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:31.133503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007283+0000","last_change":"2024-04-25T09:08:17.007283+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007283+0000","last_undegraded":"2024-04-25T09:08:17.007283+0000","last_fullsized":"2024-04-25T09:08:17.007283+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.027476+0000","last_change":"2024-04-25T09:08:17.024952+0000","last_active":"2024-04-25T09:08:17.027476+0000","last_peered":"2024-04-25T09:08:17.027476+0000","last_clean":"2024-04-25T09:08:17.027476+0000","last_became_active":"2024-04-25T09:08:17.024696+0000","last_became_peered":"2024-04-25T09:08:17.024696+0000","last_unstale":"2024-04-25T09:08:17.027476+0000","last_undegraded":"2024-04-25T09:08:17.027476+0000","last_fullsized":"2024-04-25T09:08:17.027476+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:20.303509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007882+0000","last_change":"2024-04-25T09:08:17.007882+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007882+0000","last_undegraded":"2024-04-25T09:08:17.007882+0000","last_fullsized":"2024-04-25T09:08:17.007882+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.024423+0000","last_change":"2024-04-25T09:08:17.021898+0000","last_active":"2024-04-25T09:08:17.024423+0000","last_peered":"2024-04-25T09:08:17.024423+0000","last_clean":"2024-04-25T09:08:17.024423+0000","last_became_active":"2024-04-25T09:08:17.021584+0000","last_became_peered":"2024-04-25T09:08:17.021584+0000","last_unstale":"2024-04-25T09:08:17.024423+0000","last_undegraded":"2024-04-25T09:08:17.024423+0000","last_fullsized":"2024-04-25T09:08:17.024423+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:40.369073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004497+0000","last_change":"2024-04-25T09:08:17.004497+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004497+0000","last_undegraded":"2024-04-25T09:08:17.004497+0000","last_fullsized":"2024-04-25T09:08:17.004497+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033347+0000","last_change":"2024-04-25T09:08:17.025380+0000","last_active":"2024-04-25T09:08:17.033347+0000","last_peered":"2024-04-25T09:08:17.033347+0000","last_clean":"2024-04-25T09:08:17.033347+0000","last_became_active":"2024-04-25T09:08:17.024963+0000","last_became_peered":"2024-04-25T09:08:17.024963+0000","last_unstale":"2024-04-25T09:08:17.033347+0000","last_undegraded":"2024-04-25T09:08:17.033347+0000","last_fullsized":"2024-04-25T09:08:17.033347+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:40.320274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005040+0000","last_change":"2024-04-25T09:08:17.005040+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005040+0000","last_undegraded":"2024-04-25T09:08:17.005040+0000","last_fullsized":"2024-04-25T09:08:17.005040+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026554+0000","last_change":"2024-04-25T09:08:17.022999+0000","last_active":"2024-04-25T09:08:17.026554+0000","last_peered":"2024-04-25T09:08:17.026554+0000","last_clean":"2024-04-25T09:08:17.026554+0000","last_became_active":"2024-04-25T09:08:17.022670+0000","last_became_peered":"2024-04-25T09:08:17.022670+0000","last_unstale":"2024-04-25T09:08:17.026554+0000","last_undegraded":"2024-04-25T09:08:17.026554+0000","last_fullsized":"2024-04-25T09:08:17.026554+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:23.008721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009981+0000","last_change":"2024-04-25T09:08:17.009981+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009981+0000","last_undegraded":"2024-04-25T09:08:17.009981+0000","last_fullsized":"2024-04-25T09:08:17.009981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026379+0000","last_change":"2024-04-25T09:08:17.023005+0000","last_active":"2024-04-25T09:08:17.026379+0000","last_peered":"2024-04-25T09:08:17.026379+0000","last_clean":"2024-04-25T09:08:17.026379+0000","last_became_active":"2024-04-25T09:08:17.022690+0000","last_became_peered":"2024-04-25T09:08:17.022690+0000","last_unstale":"2024-04-25T09:08:17.026379+0000","last_undegraded":"2024-04-25T09:08:17.026379+0000","last_fullsized":"2024-04-25T09:08:17.026379+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:37.550476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":257,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.020337+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:08:17.020337+0000","last_peered":"2024-04-25T09:08:17.020337+0000","last_clean":"2024-04-25T09:08:17.020337+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:08:17.020337+0000","last_undegraded":"2024-04-25T09:08:17.020337+0000","last_fullsized":"2024-04-25T09:08:17.020337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1396736,"data_stored":923973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1409024,"data_stored":930248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:08:22.446 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:08:22.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.632+0000 7fc668600640 1 Processor -- start 2024-04-25T09:08:22.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.632+0000 7fc668600640 1 -- start start 2024-04-25T09:08:22.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.636+0000 7fc668600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc66015a900 0x7fc66006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:22.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.636+0000 7fc668600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6600cd520 0x7fc6600ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:22.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.636+0000 7fc668600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6600cda00 con 0x7fc6600cf560 2024-04-25T09:08:22.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.636+0000 7fc668600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66015bcf0 con 0x7fc66015a900 2024-04-25T09:08:22.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.636+0000 7fc668600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6600cdce0 con 0x7fc6600cd520 2024-04-25T09:08:22.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.636+0000 7fc665200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6600cd520 0x7fc6600ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:22.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.636+0000 7fc665200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6600cd520 0x7fc6600ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:37680/0 (socket says 172.21.15.175:37680) 2024-04-25T09:08:22.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.636+0000 7fc665200640 1 -- 172.21.15.175:0/2189882596 learned_addr learned my addr 172.21.15.175:0/2189882596 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:22.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.636+0000 7fc665c00640 1 --2- 172.21.15.175:0/2189882596 >> v2:172.21.15.177:3300/0 conn(0x7fc66015a900 0x7fc66006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:22.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.636+0000 7fc665200640 1 -- 172.21.15.175:0/2189882596 >> v2:172.21.15.177:3300/0 conn(0x7fc66015a900 msgr2=0x7fc66006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:22.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.636+0000 7fc665200640 1 --2- 172.21.15.175:0/2189882596 >> v2:172.21.15.177:3300/0 conn(0x7fc66015a900 0x7fc66006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.636+0000 7fc665200640 1 -- 172.21.15.175:0/2189882596 >> v1:172.21.15.177:6789/0 conn(0x7fc6600cf560 legacy=0x7fc66015bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:22.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.636+0000 7fc665200640 1 -- 172.21.15.175:0/2189882596 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6600cdfc0 con 0x7fc6600cd520 2024-04-25T09:08:22.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.640+0000 7fc665200640 1 --2- 172.21.15.175:0/2189882596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6600cd520 0x7fc6600ceaa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc64c00bb10 tx=0x7fc64c01ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c8b121fea7b02c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:22.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.640+0000 7fc65fe00640 1 -- 172.21.15.175:0/2189882596 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c0b4070 con 0x7fc6600cd520 2024-04-25T09:08:22.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.640+0000 7fc65fe00640 1 -- 172.21.15.175:0/2189882596 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c0a7ae0 con 0x7fc6600cd520 2024-04-25T09:08:22.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.640+0000 7fc65fe00640 1 -- 172.21.15.175:0/2189882596 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c0af440 con 0x7fc6600cd520 2024-04-25T09:08:22.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.640+0000 7fc668600640 1 -- 172.21.15.175:0/2189882596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6600cd520 msgr2=0x7fc6600ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:22.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.640+0000 7fc668600640 1 --2- 172.21.15.175:0/2189882596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6600cd520 0x7fc6600ceaa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc64c00bb10 tx=0x7fc64c01ec00 comp rx=0 tx=0).stop 2024-04-25T09:08:22.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.640+0000 7fc668600640 1 -- 172.21.15.175:0/2189882596 shutdown_connections 2024-04-25T09:08:22.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.640+0000 7fc668600640 1 --2- 172.21.15.175:0/2189882596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6600cd520 0x7fc6600ceaa0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.640+0000 7fc668600640 1 --2- 172.21.15.175:0/2189882596 >> v2:172.21.15.177:3300/0 conn(0x7fc66015a900 0x7fc66006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.640+0000 7fc668600640 1 -- 172.21.15.175:0/2189882596 >> 172.21.15.175:0/2189882596 conn(0x7fc660067150 msgr2=0x7fc66006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:22.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.640+0000 7fc668600640 1 -- 172.21.15.175:0/2189882596 shutdown_connections 2024-04-25T09:08:22.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.640+0000 7fc668600640 1 -- 172.21.15.175:0/2189882596 wait complete. 2024-04-25T09:08:22.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.640+0000 7fc668600640 1 Processor -- start 2024-04-25T09:08:22.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.640+0000 7fc668600640 1 -- start start 2024-04-25T09:08:22.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc668600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6600cf560 0x7fc660156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:22.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc668600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc66015a900 0x7fc6601f6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:22.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc668600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6601542d0 0x7fc6601f7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:22.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc668600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6600cf160 con 0x7fc6601542d0 2024-04-25T09:08:22.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc668600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6600cefe0 con 0x7fc66015a900 2024-04-25T09:08:22.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc668600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66006d3b0 con 0x7fc6600cf560 2024-04-25T09:08:22.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc666600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6601542d0 0x7fc6601f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:22.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc665c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6600cf560 0x7fc660156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:22.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc665200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc66015a900 0x7fc6601f6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:22.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc665c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6600cf560 0x7fc660156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:37682/0 (socket says 172.21.15.175:37682) 2024-04-25T09:08:22.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc665c00640 1 -- 172.21.15.175:0/447143115 learned_addr learned my addr 172.21.15.175:0/447143115 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:22.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc666600640 1 -- 172.21.15.175:0/447143115 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6600cf560 msgr2=0x7fc660156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:22.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc666600640 1 --2- 172.21.15.175:0/447143115 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6600cf560 0x7fc660156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc666600640 1 -- 172.21.15.175:0/447143115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc66015a900 msgr2=0x7fc6601f6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:22.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc666600640 1 --2- 172.21.15.175:0/447143115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc66015a900 0x7fc6601f6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc666600640 1 -- 172.21.15.175:0/447143115 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc660148490 con 0x7fc6601542d0 2024-04-25T09:08:22.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc666600640 1 --2- 172.21.15.175:0/447143115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6601542d0 0x7fc6601f7270 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc65800c390 tx=0x7fc65800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:22.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc65d600640 1 -- 172.21.15.175:0/447143115 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc658017070 con 0x7fc6601542d0 2024-04-25T09:08:22.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc65d600640 1 -- 172.21.15.175:0/447143115 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6580052d0 con 0x7fc6601542d0 2024-04-25T09:08:22.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc668600640 1 -- 172.21.15.175:0/447143115 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc660156ac0 con 0x7fc6601542d0 2024-04-25T09:08:22.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc65d600640 1 -- 172.21.15.175:0/447143115 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc658003840 con 0x7fc6601542d0 2024-04-25T09:08:22.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc668600640 1 -- 172.21.15.175:0/447143115 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc660157080 con 0x7fc6601542d0 2024-04-25T09:08:22.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc668600640 1 -- 172.21.15.175:0/447143115 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc660074a60 con 0x7fc6601542d0 2024-04-25T09:08:22.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.644+0000 7fc65d600640 1 -- 172.21.15.175:0/447143115 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc65801a070 con 0x7fc6601542d0 2024-04-25T09:08:22.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.648+0000 7fc65d600640 1 --2- 172.21.15.175:0/447143115 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc640066f90 0x7fc640069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:22.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.648+0000 7fc65d600640 1 -- 172.21.15.175:0/447143115 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc658084270 con 0x7fc6601542d0 2024-04-25T09:08:22.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.648+0000 7fc665c00640 1 --2- 172.21.15.175:0/447143115 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc640066f90 0x7fc640069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:22.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.648+0000 7fc665c00640 1 --2- 172.21.15.175:0/447143115 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc640066f90 0x7fc640069450 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc654009a40 tx=0x7fc65400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:22.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.648+0000 7fc65d600640 1 -- 172.21.15.175:0/447143115 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc658005480 con 0x7fc6601542d0 2024-04-25T09:08:22.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.800+0000 7fc668600640 1 -- 172.21.15.175:0/447143115 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc66006adf0 con 0x7fc640066f90 2024-04-25T09:08:22.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.808+0000 7fc65d600640 1 -- 172.21.15.175:0/447143115 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246753 (secure 0 0 0) 0x7fc66006adf0 con 0x7fc640066f90 2024-04-25T09:08:22.799 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:22.801 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:08:22.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.812+0000 7fc668600640 1 -- 172.21.15.175:0/447143115 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc640066f90 msgr2=0x7fc640069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:22.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.812+0000 7fc668600640 1 --2- 172.21.15.175:0/447143115 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc640066f90 0x7fc640069450 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc654009a40 tx=0x7fc65400b040 comp rx=0 tx=0).stop 2024-04-25T09:08:22.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.812+0000 7fc668600640 1 -- 172.21.15.175:0/447143115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6601542d0 msgr2=0x7fc6601f7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:22.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.812+0000 7fc668600640 1 --2- 172.21.15.175:0/447143115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6601542d0 0x7fc6601f7270 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc65800c390 tx=0x7fc65800c850 comp rx=0 tx=0).stop 2024-04-25T09:08:22.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.812+0000 7fc668600640 1 -- 172.21.15.175:0/447143115 shutdown_connections 2024-04-25T09:08:22.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.812+0000 7fc668600640 1 --2- 172.21.15.175:0/447143115 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc640066f90 0x7fc640069450 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.812+0000 7fc668600640 1 --2- 172.21.15.175:0/447143115 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6601542d0 0x7fc6601f7270 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.812+0000 7fc668600640 1 --2- 172.21.15.175:0/447143115 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc66015a900 0x7fc6601f6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.812+0000 7fc668600640 1 --2- 172.21.15.175:0/447143115 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc6600cf560 0x7fc660156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:22.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.812+0000 7fc668600640 1 -- 172.21.15.175:0/447143115 >> 172.21.15.175:0/447143115 conn(0x7fc6600cd520 msgr2=0x7fc66015cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:22.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.812+0000 7fc668600640 1 -- 172.21.15.175:0/447143115 shutdown_connections 2024-04-25T09:08:22.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:22.812+0000 7fc668600640 1 -- 172.21.15.175:0/447143115 wait complete. 2024-04-25T09:08:22.819 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-04-25T09:08:21.846556+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236164,"kb_used_data":7516,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738556,"statfs":{"total":773094113280,"available":772852281344,"internally_reserved":0,"allocated":7696384,"data_stored":3893501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.853098"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018680+0000","last_change":"2024-04-25T09:08:17.018680+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018680+0000","last_undegraded":"2024-04-25T09:08:17.018680+0000","last_fullsized":"2024-04-25T09:08:17.018680+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005292+0000","last_change":"2024-04-25T09:08:17.005292+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005292+0000","last_undegraded":"2024-04-25T09:08:17.005292+0000","last_fullsized":"2024-04-25T09:08:17.005292+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.010066+0000","last_change":"2024-04-25T09:08:17.010066+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.010066+0000","last_undegraded":"2024-04-25T09:08:17.010066+0000","last_fullsized":"2024-04-25T09:08:17.010066+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005491+0000","last_change":"2024-04-25T09:08:17.005491+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005491+0000","last_undegraded":"2024-04-25T09:08:17.005491+0000","last_fullsized":"2024-04-25T09:08:17.005491+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007894+0000","last_change":"2024-04-25T09:08:17.007894+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007894+0000","last_undegraded":"2024-04-25T09:08:17.007894+0000","last_fullsized":"2024-04-25T09:08:17.007894+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007349+0000","last_change":"2024-04-25T09:08:17.007349+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007349+0000","last_undegraded":"2024-04-25T09:08:17.007349+0000","last_fullsized":"2024-04-25T09:08:17.007349+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.011503+0000","last_change":"2024-04-25T09:08:17.011503+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.011503+0000","last_undegraded":"2024-04-25T09:08:17.011503+0000","last_fullsized":"2024-04-25T09:08:17.011503+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005586+0000","last_change":"2024-04-25T09:08:17.005586+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005586+0000","last_undegraded":"2024-04-25T09:08:17.005586+0000","last_fullsized":"2024-04-25T09:08:17.005586+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013666+0000","last_change":"2024-04-25T09:08:17.013666+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013666+0000","last_undegraded":"2024-04-25T09:08:17.013666+0000","last_fullsized":"2024-04-25T09:08:17.013666+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.012277+0000","last_change":"2024-04-25T09:08:17.012277+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.012277+0000","last_undegraded":"2024-04-25T09:08:17.012277+0000","last_fullsized":"2024-04-25T09:08:17.012277+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018926+0000","last_change":"2024-04-25T09:08:17.018926+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018926+0000","last_undegraded":"2024-04-25T09:08:17.018926+0000","last_fullsized":"2024-04-25T09:08:17.018926+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005086+0000","last_change":"2024-04-25T09:08:17.005086+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005086+0000","last_undegraded":"2024-04-25T09:08:17.005086+0000","last_fullsized":"2024-04-25T09:08:17.005086+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007114+0000","last_change":"2024-04-25T09:08:17.007114+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007114+0000","last_undegraded":"2024-04-25T09:08:17.007114+0000","last_fullsized":"2024-04-25T09:08:17.007114+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008999+0000","last_change":"2024-04-25T09:08:17.008999+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008999+0000","last_undegraded":"2024-04-25T09:08:17.008999+0000","last_fullsized":"2024-04-25T09:08:17.008999+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006655+0000","last_change":"2024-04-25T09:08:17.006655+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006655+0000","last_undegraded":"2024-04-25T09:08:17.006655+0000","last_fullsized":"2024-04-25T09:08:17.006655+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009324+0000","last_change":"2024-04-25T09:08:17.009324+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009324+0000","last_undegraded":"2024-04-25T09:08:17.009324+0000","last_fullsized":"2024-04-25T09:08:17.009324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013231+0000","last_change":"2024-04-25T09:08:17.013231+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013231+0000","last_undegraded":"2024-04-25T09:08:17.013231+0000","last_fullsized":"2024-04-25T09:08:17.013231+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004597+0000","last_change":"2024-04-25T09:08:17.004597+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004597+0000","last_undegraded":"2024-04-25T09:08:17.004597+0000","last_fullsized":"2024-04-25T09:08:17.004597+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005206+0000","last_change":"2024-04-25T09:08:17.005206+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005206+0000","last_undegraded":"2024-04-25T09:08:17.005206+0000","last_fullsized":"2024-04-25T09:08:17.005206+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008633+0000","last_change":"2024-04-25T09:08:17.008633+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008633+0000","last_undegraded":"2024-04-25T09:08:17.008633+0000","last_fullsized":"2024-04-25T09:08:17.008633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009408+0000","last_change":"2024-04-25T09:08:17.009408+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009408+0000","last_undegraded":"2024-04-25T09:08:17.009408+0000","last_fullsized":"2024-04-25T09:08:17.009408+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009875+0000","last_change":"2024-04-25T09:08:17.009875+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009875+0000","last_undegraded":"2024-04-25T09:08:17.009875+0000","last_fullsized":"2024-04-25T09:08:17.009875+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018577+0000","last_change":"2024-04-25T09:08:17.018577+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018577+0000","last_undegraded":"2024-04-25T09:08:17.018577+0000","last_fullsized":"2024-04-25T09:08:17.018577+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.017830+0000","last_change":"2024-04-25T09:08:17.017830+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.017830+0000","last_undegraded":"2024-04-25T09:08:17.017830+0000","last_fullsized":"2024-04-25T09:08:17.017830+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.010472+0000","last_change":"2024-04-25T09:08:17.010472+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.010472+0000","last_undegraded":"2024-04-25T09:08:17.010472+0000","last_fullsized":"2024-04-25T09:08:17.010472+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007670+0000","last_change":"2024-04-25T09:08:17.007670+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007670+0000","last_undegraded":"2024-04-25T09:08:17.007670+0000","last_fullsized":"2024-04-25T09:08:17.007670+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009644+0000","last_change":"2024-04-25T09:08:17.009644+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009644+0000","last_undegraded":"2024-04-25T09:08:17.009644+0000","last_fullsized":"2024-04-25T09:08:17.009644+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.012738+0000","last_change":"2024-04-25T09:08:17.012738+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.012738+0000","last_undegraded":"2024-04-25T09:08:17.012738+0000","last_fullsized":"2024-04-25T09:08:17.012738+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008977+0000","last_change":"2024-04-25T09:08:17.008977+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008977+0000","last_undegraded":"2024-04-25T09:08:17.008977+0000","last_fullsized":"2024-04-25T09:08:17.008977+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.011552+0000","last_change":"2024-04-25T09:08:17.011552+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.011552+0000","last_undegraded":"2024-04-25T09:08:17.011552+0000","last_fullsized":"2024-04-25T09:08:17.011552+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007586+0000","last_change":"2024-04-25T09:08:17.007586+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007586+0000","last_undegraded":"2024-04-25T09:08:17.007586+0000","last_fullsized":"2024-04-25T09:08:17.007586+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004876+0000","last_change":"2024-04-25T09:08:17.004876+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004876+0000","last_undegraded":"2024-04-25T09:08:17.004876+0000","last_fullsized":"2024-04-25T09:08:17.004876+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.017842+0000","last_change":"2024-04-25T09:08:17.017842+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.017842+0000","last_undegraded":"2024-04-25T09:08:17.017842+0000","last_fullsized":"2024-04-25T09:08:17.017842+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033662+0000","last_change":"2024-04-25T09:08:17.029200+0000","last_active":"2024-04-25T09:08:17.033662+0000","last_peered":"2024-04-25T09:08:17.033662+0000","last_clean":"2024-04-25T09:08:17.033662+0000","last_became_active":"2024-04-25T09:08:17.028890+0000","last_became_peered":"2024-04-25T09:08:17.028890+0000","last_unstale":"2024-04-25T09:08:17.033662+0000","last_undegraded":"2024-04-25T09:08:17.033662+0000","last_fullsized":"2024-04-25T09:08:17.033662+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:55.882355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.012445+0000","last_change":"2024-04-25T09:08:17.012445+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.012445+0000","last_undegraded":"2024-04-25T09:08:17.012445+0000","last_fullsized":"2024-04-25T09:08:17.012445+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.027624+0000","last_change":"2024-04-25T09:08:17.022928+0000","last_active":"2024-04-25T09:08:17.027624+0000","last_peered":"2024-04-25T09:08:17.027624+0000","last_clean":"2024-04-25T09:08:17.027624+0000","last_became_active":"2024-04-25T09:08:17.022408+0000","last_became_peered":"2024-04-25T09:08:17.022408+0000","last_unstale":"2024-04-25T09:08:17.027624+0000","last_undegraded":"2024-04-25T09:08:17.027624+0000","last_fullsized":"2024-04-25T09:08:17.027624+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:04.773505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005576+0000","last_change":"2024-04-25T09:08:17.005576+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005576+0000","last_undegraded":"2024-04-25T09:08:17.005576+0000","last_fullsized":"2024-04-25T09:08:17.005576+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033373+0000","last_change":"2024-04-25T09:08:17.026541+0000","last_active":"2024-04-25T09:08:17.033373+0000","last_peered":"2024-04-25T09:08:17.033373+0000","last_clean":"2024-04-25T09:08:17.033373+0000","last_became_active":"2024-04-25T09:08:17.026241+0000","last_became_peered":"2024-04-25T09:08:17.026241+0000","last_unstale":"2024-04-25T09:08:17.033373+0000","last_undegraded":"2024-04-25T09:08:17.033373+0000","last_fullsized":"2024-04-25T09:08:17.033373+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:16.176102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018031+0000","last_change":"2024-04-25T09:08:17.018031+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018031+0000","last_undegraded":"2024-04-25T09:08:17.018031+0000","last_fullsized":"2024-04-25T09:08:17.018031+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023898+0000","last_change":"2024-04-25T09:08:17.017059+0000","last_active":"2024-04-25T09:08:17.023898+0000","last_peered":"2024-04-25T09:08:17.023898+0000","last_clean":"2024-04-25T09:08:17.023898+0000","last_became_active":"2024-04-25T09:08:17.016731+0000","last_became_peered":"2024-04-25T09:08:17.016731+0000","last_unstale":"2024-04-25T09:08:17.023898+0000","last_undegraded":"2024-04-25T09:08:17.023898+0000","last_fullsized":"2024-04-25T09:08:17.023898+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:30.230418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006510+0000","last_change":"2024-04-25T09:08:17.006510+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006510+0000","last_undegraded":"2024-04-25T09:08:17.006510+0000","last_fullsized":"2024-04-25T09:08:17.006510+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.027739+0000","last_change":"2024-04-25T09:08:17.026572+0000","last_active":"2024-04-25T09:08:17.027739+0000","last_peered":"2024-04-25T09:08:17.027739+0000","last_clean":"2024-04-25T09:08:17.027739+0000","last_became_active":"2024-04-25T09:08:17.026303+0000","last_became_peered":"2024-04-25T09:08:17.026303+0000","last_unstale":"2024-04-25T09:08:17.027739+0000","last_undegraded":"2024-04-25T09:08:17.027739+0000","last_fullsized":"2024-04-25T09:08:17.027739+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:03.502069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008840+0000","last_change":"2024-04-25T09:08:17.008840+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008840+0000","last_undegraded":"2024-04-25T09:08:17.008840+0000","last_fullsized":"2024-04-25T09:08:17.008840+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023801+0000","last_change":"2024-04-25T09:08:17.015944+0000","last_active":"2024-04-25T09:08:17.023801+0000","last_peered":"2024-04-25T09:08:17.023801+0000","last_clean":"2024-04-25T09:08:17.023801+0000","last_became_active":"2024-04-25T09:08:17.015622+0000","last_became_peered":"2024-04-25T09:08:17.015622+0000","last_unstale":"2024-04-25T09:08:17.023801+0000","last_undegraded":"2024-04-25T09:08:17.023801+0000","last_fullsized":"2024-04-25T09:08:17.023801+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:10.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.015882+0000","last_change":"2024-04-25T09:08:17.015882+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.015882+0000","last_undegraded":"2024-04-25T09:08:17.015882+0000","last_fullsized":"2024-04-25T09:08:17.015882+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023081+0000","last_change":"2024-04-25T09:08:17.020849+0000","last_active":"2024-04-25T09:08:17.023081+0000","last_peered":"2024-04-25T09:08:17.023081+0000","last_clean":"2024-04-25T09:08:17.023081+0000","last_became_active":"2024-04-25T09:08:17.020389+0000","last_became_peered":"2024-04-25T09:08:17.020389+0000","last_unstale":"2024-04-25T09:08:17.023081+0000","last_undegraded":"2024-04-25T09:08:17.023081+0000","last_fullsized":"2024-04-25T09:08:17.023081+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:36.326769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006232+0000","last_change":"2024-04-25T09:08:17.006232+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006232+0000","last_undegraded":"2024-04-25T09:08:17.006232+0000","last_fullsized":"2024-04-25T09:08:17.006232+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026789+0000","last_change":"2024-04-25T09:08:17.021273+0000","last_active":"2024-04-25T09:08:17.026789+0000","last_peered":"2024-04-25T09:08:17.026789+0000","last_clean":"2024-04-25T09:08:17.026789+0000","last_became_active":"2024-04-25T09:08:17.020604+0000","last_became_peered":"2024-04-25T09:08:17.020604+0000","last_unstale":"2024-04-25T09:08:17.026789+0000","last_undegraded":"2024-04-25T09:08:17.026789+0000","last_fullsized":"2024-04-25T09:08:17.026789+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:06.708703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007226+0000","last_change":"2024-04-25T09:08:17.007226+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007226+0000","last_undegraded":"2024-04-25T09:08:17.007226+0000","last_fullsized":"2024-04-25T09:08:17.007226+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.030475+0000","last_change":"2024-04-25T09:08:17.020881+0000","last_active":"2024-04-25T09:08:17.030475+0000","last_peered":"2024-04-25T09:08:17.030475+0000","last_clean":"2024-04-25T09:08:17.030475+0000","last_became_active":"2024-04-25T09:08:17.020648+0000","last_became_peered":"2024-04-25T09:08:17.020648+0000","last_unstale":"2024-04-25T09:08:17.030475+0000","last_undegraded":"2024-04-25T09:08:17.030475+0000","last_fullsized":"2024-04-25T09:08:17.030475+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:34.954575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018250+0000","last_change":"2024-04-25T09:08:17.018250+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018250+0000","last_undegraded":"2024-04-25T09:08:17.018250+0000","last_fullsized":"2024-04-25T09:08:17.018250+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023940+0000","last_change":"2024-04-25T09:08:17.017234+0000","last_active":"2024-04-25T09:08:17.023940+0000","last_peered":"2024-04-25T09:08:17.023940+0000","last_clean":"2024-04-25T09:08:17.023940+0000","last_became_active":"2024-04-25T09:08:17.016932+0000","last_became_peered":"2024-04-25T09:08:17.016932+0000","last_unstale":"2024-04-25T09:08:17.023940+0000","last_undegraded":"2024-04-25T09:08:17.023940+0000","last_fullsized":"2024-04-25T09:08:17.023940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:00.689918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004833+0000","last_change":"2024-04-25T09:08:17.004833+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004833+0000","last_undegraded":"2024-04-25T09:08:17.004833+0000","last_fullsized":"2024-04-25T09:08:17.004833+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.028198+0000","last_change":"2024-04-25T09:08:17.027002+0000","last_active":"2024-04-25T09:08:17.028198+0000","last_peered":"2024-04-25T09:08:17.028198+0000","last_clean":"2024-04-25T09:08:17.028198+0000","last_became_active":"2024-04-25T09:08:17.026421+0000","last_became_peered":"2024-04-25T09:08:17.026421+0000","last_unstale":"2024-04-25T09:08:17.028198+0000","last_undegraded":"2024-04-25T09:08:17.028198+0000","last_fullsized":"2024-04-25T09:08:17.028198+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:52.586369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.012716+0000","last_change":"2024-04-25T09:08:17.012716+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.012716+0000","last_undegraded":"2024-04-25T09:08:17.012716+0000","last_fullsized":"2024-04-25T09:08:17.012716+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.018395+0000","last_change":"2024-04-25T09:08:17.011530+0000","last_active":"2024-04-25T09:08:17.018395+0000","last_peered":"2024-04-25T09:08:17.018395+0000","last_clean":"2024-04-25T09:08:17.018395+0000","last_became_active":"2024-04-25T09:08:17.011275+0000","last_became_peered":"2024-04-25T09:08:17.011275+0000","last_unstale":"2024-04-25T09:08:17.018395+0000","last_undegraded":"2024-04-25T09:08:17.018395+0000","last_fullsized":"2024-04-25T09:08:17.018395+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:16.028538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018337+0000","last_change":"2024-04-25T09:08:17.018337+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018337+0000","last_undegraded":"2024-04-25T09:08:17.018337+0000","last_fullsized":"2024-04-25T09:08:17.018337+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026530+0000","last_change":"2024-04-25T09:08:17.024819+0000","last_active":"2024-04-25T09:08:17.026530+0000","last_peered":"2024-04-25T09:08:17.026530+0000","last_clean":"2024-04-25T09:08:17.026530+0000","last_became_active":"2024-04-25T09:08:17.024388+0000","last_became_peered":"2024-04-25T09:08:17.024388+0000","last_unstale":"2024-04-25T09:08:17.026530+0000","last_undegraded":"2024-04-25T09:08:17.026530+0000","last_fullsized":"2024-04-25T09:08:17.026530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:20.348350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006894+0000","last_change":"2024-04-25T09:08:17.006894+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006894+0000","last_undegraded":"2024-04-25T09:08:17.006894+0000","last_fullsized":"2024-04-25T09:08:17.006894+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.029123+0000","last_change":"2024-04-25T09:08:17.023485+0000","last_active":"2024-04-25T09:08:17.029123+0000","last_peered":"2024-04-25T09:08:17.029123+0000","last_clean":"2024-04-25T09:08:17.029123+0000","last_became_active":"2024-04-25T09:08:17.022356+0000","last_became_peered":"2024-04-25T09:08:17.022356+0000","last_unstale":"2024-04-25T09:08:17.029123+0000","last_undegraded":"2024-04-25T09:08:17.029123+0000","last_fullsized":"2024-04-25T09:08:17.029123+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:49.163088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006039+0000","last_change":"2024-04-25T09:08:17.006039+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006039+0000","last_undegraded":"2024-04-25T09:08:17.006039+0000","last_fullsized":"2024-04-25T09:08:17.006039+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026949+0000","last_change":"2024-04-25T09:08:17.019898+0000","last_active":"2024-04-25T09:08:17.026949+0000","last_peered":"2024-04-25T09:08:17.026949+0000","last_clean":"2024-04-25T09:08:17.026949+0000","last_became_active":"2024-04-25T09:08:17.019593+0000","last_became_peered":"2024-04-25T09:08:17.019593+0000","last_unstale":"2024-04-25T09:08:17.026949+0000","last_undegraded":"2024-04-25T09:08:17.026949+0000","last_fullsized":"2024-04-25T09:08:17.026949+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:31.133503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006931+0000","last_change":"2024-04-25T09:08:17.006931+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006931+0000","last_undegraded":"2024-04-25T09:08:17.006931+0000","last_fullsized":"2024-04-25T09:08:17.006931+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033565+0000","last_change":"2024-04-25T09:08:17.028980+0000","last_active":"2024-04-25T09:08:17.033565+0000","last_peered":"2024-04-25T09:08:17.033565+0000","last_clean":"2024-04-25T09:08:17.033565+0000","last_became_active":"2024-04-25T09:08:17.026719+0000","last_became_peered":"2024-04-25T09:08:17.026719+0000","last_unstale":"2024-04-25T09:08:17.033565+0000","last_undegraded":"2024-04-25T09:08:17.033565+0000","last_fullsized":"2024-04-25T09:08:17.033565+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:54.808987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.011883+0000","last_change":"2024-04-25T09:08:17.011883+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.011883+0000","last_undegraded":"2024-04-25T09:08:17.011883+0000","last_fullsized":"2024-04-25T09:08:17.011883+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.024050+0000","last_change":"2024-04-25T09:08:17.021008+0000","last_active":"2024-04-25T09:08:17.024050+0000","last_peered":"2024-04-25T09:08:17.024050+0000","last_clean":"2024-04-25T09:08:17.024050+0000","last_became_active":"2024-04-25T09:08:17.020699+0000","last_became_peered":"2024-04-25T09:08:17.020699+0000","last_unstale":"2024-04-25T09:08:17.024050+0000","last_undegraded":"2024-04-25T09:08:17.024050+0000","last_fullsized":"2024-04-25T09:08:17.024050+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:10.660294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013082+0000","last_change":"2024-04-25T09:08:17.013082+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013082+0000","last_undegraded":"2024-04-25T09:08:17.013082+0000","last_fullsized":"2024-04-25T09:08:17.013082+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033530+0000","last_change":"2024-04-25T09:08:17.028655+0000","last_active":"2024-04-25T09:08:17.033530+0000","last_peered":"2024-04-25T09:08:17.033530+0000","last_clean":"2024-04-25T09:08:17.033530+0000","last_became_active":"2024-04-25T09:08:17.028383+0000","last_became_peered":"2024-04-25T09:08:17.028383+0000","last_unstale":"2024-04-25T09:08:17.033530+0000","last_undegraded":"2024-04-25T09:08:17.033530+0000","last_fullsized":"2024-04-25T09:08:17.033530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:23.297153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004492+0000","last_change":"2024-04-25T09:08:17.004492+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004492+0000","last_undegraded":"2024-04-25T09:08:17.004492+0000","last_fullsized":"2024-04-25T09:08:17.004492+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.031027+0000","last_change":"2024-04-25T09:08:17.027470+0000","last_active":"2024-04-25T09:08:17.031027+0000","last_peered":"2024-04-25T09:08:17.031027+0000","last_clean":"2024-04-25T09:08:17.031027+0000","last_became_active":"2024-04-25T09:08:17.027198+0000","last_became_peered":"2024-04-25T09:08:17.027198+0000","last_unstale":"2024-04-25T09:08:17.031027+0000","last_undegraded":"2024-04-25T09:08:17.031027+0000","last_fullsized":"2024-04-25T09:08:17.031027+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:02.688386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007577+0000","last_change":"2024-04-25T09:08:17.007577+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007577+0000","last_undegraded":"2024-04-25T09:08:17.007577+0000","last_fullsized":"2024-04-25T09:08:17.007577+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.036250+0000","last_change":"2024-04-25T09:08:17.031403+0000","last_active":"2024-04-25T09:08:17.036250+0000","last_peered":"2024-04-25T09:08:17.036250+0000","last_clean":"2024-04-25T09:08:17.036250+0000","last_became_active":"2024-04-25T09:08:17.031145+0000","last_became_peered":"2024-04-25T09:08:17.031145+0000","last_unstale":"2024-04-25T09:08:17.036250+0000","last_undegraded":"2024-04-25T09:08:17.036250+0000","last_fullsized":"2024-04-25T09:08:17.036250+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:17.838172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008528+0000","last_change":"2024-04-25T09:08:17.008528+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008528+0000","last_undegraded":"2024-04-25T09:08:17.008528+0000","last_fullsized":"2024-04-25T09:08:17.008528+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023992+0000","last_change":"2024-04-25T09:08:17.015969+0000","last_active":"2024-04-25T09:08:17.023992+0000","last_peered":"2024-04-25T09:08:17.023992+0000","last_clean":"2024-04-25T09:08:17.023992+0000","last_became_active":"2024-04-25T09:08:17.015633+0000","last_became_peered":"2024-04-25T09:08:17.015633+0000","last_unstale":"2024-04-25T09:08:17.023992+0000","last_undegraded":"2024-04-25T09:08:17.023992+0000","last_fullsized":"2024-04-25T09:08:17.023992+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:30.776286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008759+0000","last_change":"2024-04-25T09:08:17.008759+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008759+0000","last_undegraded":"2024-04-25T09:08:17.008759+0000","last_fullsized":"2024-04-25T09:08:17.008759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.028086+0000","last_change":"2024-04-25T09:08:17.021971+0000","last_active":"2024-04-25T09:08:17.028086+0000","last_peered":"2024-04-25T09:08:17.028086+0000","last_clean":"2024-04-25T09:08:17.028086+0000","last_became_active":"2024-04-25T09:08:17.021372+0000","last_became_peered":"2024-04-25T09:08:17.021372+0000","last_unstale":"2024-04-25T09:08:17.028086+0000","last_undegraded":"2024-04-25T09:08:17.028086+0000","last_fullsized":"2024-04-25T09:08:17.028086+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:26.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008064+0000","last_change":"2024-04-25T09:08:17.008064+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008064+0000","last_undegraded":"2024-04-25T09:08:17.008064+0000","last_fullsized":"2024-04-25T09:08:17.008064+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.027593+0000","last_change":"2024-04-25T09:08:17.023926+0000","last_active":"2024-04-25T09:08:17.027593+0000","last_peered":"2024-04-25T09:08:17.027593+0000","last_clean":"2024-04-25T09:08:17.027593+0000","last_became_active":"2024-04-25T09:08:17.023662+0000","last_became_peered":"2024-04-25T09:08:17.023662+0000","last_unstale":"2024-04-25T09:08:17.027593+0000","last_undegraded":"2024-04-25T09:08:17.027593+0000","last_fullsized":"2024-04-25T09:08:17.027593+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:22.702984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009567+0000","last_change":"2024-04-25T09:08:17.009567+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009567+0000","last_undegraded":"2024-04-25T09:08:17.009567+0000","last_fullsized":"2024-04-25T09:08:17.009567+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.024033+0000","last_change":"2024-04-25T09:08:17.020129+0000","last_active":"2024-04-25T09:08:17.024033+0000","last_peered":"2024-04-25T09:08:17.024033+0000","last_clean":"2024-04-25T09:08:17.024033+0000","last_became_active":"2024-04-25T09:08:17.019765+0000","last_became_peered":"2024-04-25T09:08:17.019765+0000","last_unstale":"2024-04-25T09:08:17.024033+0000","last_undegraded":"2024-04-25T09:08:17.024033+0000","last_fullsized":"2024-04-25T09:08:17.024033+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:19.461337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006618+0000","last_change":"2024-04-25T09:08:17.006618+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006618+0000","last_undegraded":"2024-04-25T09:08:17.006618+0000","last_fullsized":"2024-04-25T09:08:17.006618+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026521+0000","last_change":"2024-04-25T09:08:17.018323+0000","last_active":"2024-04-25T09:08:17.026521+0000","last_peered":"2024-04-25T09:08:17.026521+0000","last_clean":"2024-04-25T09:08:17.026521+0000","last_became_active":"2024-04-25T09:08:17.018021+0000","last_became_peered":"2024-04-25T09:08:17.018021+0000","last_unstale":"2024-04-25T09:08:17.026521+0000","last_undegraded":"2024-04-25T09:08:17.026521+0000","last_fullsized":"2024-04-25T09:08:17.026521+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:22.702984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013067+0000","last_change":"2024-04-25T09:08:17.013067+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013067+0000","last_undegraded":"2024-04-25T09:08:17.013067+0000","last_fullsized":"2024-04-25T09:08:17.013067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.025141+0000","last_change":"2024-04-25T09:08:17.017852+0000","last_active":"2024-04-25T09:08:17.025141+0000","last_peered":"2024-04-25T09:08:17.025141+0000","last_clean":"2024-04-25T09:08:17.025141+0000","last_became_active":"2024-04-25T09:08:17.017430+0000","last_became_peered":"2024-04-25T09:08:17.017430+0000","last_unstale":"2024-04-25T09:08:17.025141+0000","last_undegraded":"2024-04-25T09:08:17.025141+0000","last_fullsized":"2024-04-25T09:08:17.025141+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:19.488485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013585+0000","last_change":"2024-04-25T09:08:17.013585+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013585+0000","last_undegraded":"2024-04-25T09:08:17.013585+0000","last_fullsized":"2024-04-25T09:08:17.013585+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.028222+0000","last_change":"2024-04-25T09:08:17.026372+0000","last_active":"2024-04-25T09:08:17.028222+0000","last_peered":"2024-04-25T09:08:17.028222+0000","last_clean":"2024-04-25T09:08:17.028222+0000","last_became_active":"2024-04-25T09:08:17.026102+0000","last_became_peered":"2024-04-25T09:08:17.026102+0000","last_unstale":"2024-04-25T09:08:17.028222+0000","last_undegraded":"2024-04-25T09:08:17.028222+0000","last_fullsized":"2024-04-25T09:08:17.028222+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:31.133503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007283+0000","last_change":"2024-04-25T09:08:17.007283+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007283+0000","last_undegraded":"2024-04-25T09:08:17.007283+0000","last_fullsized":"2024-04-25T09:08:17.007283+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.027476+0000","last_change":"2024-04-25T09:08:17.024952+0000","last_active":"2024-04-25T09:08:17.027476+0000","last_peered":"2024-04-25T09:08:17.027476+0000","last_clean":"2024-04-25T09:08:17.027476+0000","last_became_active":"2024-04-25T09:08:17.024696+0000","last_became_peered":"2024-04-25T09:08:17.024696+0000","last_unstale":"2024-04-25T09:08:17.027476+0000","last_undegraded":"2024-04-25T09:08:17.027476+0000","last_fullsized":"2024-04-25T09:08:17.027476+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:20.303509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007882+0000","last_change":"2024-04-25T09:08:17.007882+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007882+0000","last_undegraded":"2024-04-25T09:08:17.007882+0000","last_fullsized":"2024-04-25T09:08:17.007882+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.024423+0000","last_change":"2024-04-25T09:08:17.021898+0000","last_active":"2024-04-25T09:08:17.024423+0000","last_peered":"2024-04-25T09:08:17.024423+0000","last_clean":"2024-04-25T09:08:17.024423+0000","last_became_active":"2024-04-25T09:08:17.021584+0000","last_became_peered":"2024-04-25T09:08:17.021584+0000","last_unstale":"2024-04-25T09:08:17.024423+0000","last_undegraded":"2024-04-25T09:08:17.024423+0000","last_fullsized":"2024-04-25T09:08:17.024423+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:40.369073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004497+0000","last_change":"2024-04-25T09:08:17.004497+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004497+0000","last_undegraded":"2024-04-25T09:08:17.004497+0000","last_fullsized":"2024-04-25T09:08:17.004497+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033347+0000","last_change":"2024-04-25T09:08:17.025380+0000","last_active":"2024-04-25T09:08:17.033347+0000","last_peered":"2024-04-25T09:08:17.033347+0000","last_clean":"2024-04-25T09:08:17.033347+0000","last_became_active":"2024-04-25T09:08:17.024963+0000","last_became_peered":"2024-04-25T09:08:17.024963+0000","last_unstale":"2024-04-25T09:08:17.033347+0000","last_undegraded":"2024-04-25T09:08:17.033347+0000","last_fullsized":"2024-04-25T09:08:17.033347+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:40.320274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005040+0000","last_change":"2024-04-25T09:08:17.005040+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005040+0000","last_undegraded":"2024-04-25T09:08:17.005040+0000","last_fullsized":"2024-04-25T09:08:17.005040+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026554+0000","last_change":"2024-04-25T09:08:17.022999+0000","last_active":"2024-04-25T09:08:17.026554+0000","last_peered":"2024-04-25T09:08:17.026554+0000","last_clean":"2024-04-25T09:08:17.026554+0000","last_became_active":"2024-04-25T09:08:17.022670+0000","last_became_peered":"2024-04-25T09:08:17.022670+0000","last_unstale":"2024-04-25T09:08:17.026554+0000","last_undegraded":"2024-04-25T09:08:17.026554+0000","last_fullsized":"2024-04-25T09:08:17.026554+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:23.008721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009981+0000","last_change":"2024-04-25T09:08:17.009981+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009981+0000","last_undegraded":"2024-04-25T09:08:17.009981+0000","last_fullsized":"2024-04-25T09:08:17.009981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026379+0000","last_change":"2024-04-25T09:08:17.023005+0000","last_active":"2024-04-25T09:08:17.026379+0000","last_peered":"2024-04-25T09:08:17.026379+0000","last_clean":"2024-04-25T09:08:17.026379+0000","last_became_active":"2024-04-25T09:08:17.022690+0000","last_became_peered":"2024-04-25T09:08:17.022690+0000","last_unstale":"2024-04-25T09:08:17.026379+0000","last_undegraded":"2024-04-25T09:08:17.026379+0000","last_fullsized":"2024-04-25T09:08:17.026379+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:37.550476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":257,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.020337+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:08:17.020337+0000","last_peered":"2024-04-25T09:08:17.020337+0000","last_clean":"2024-04-25T09:08:17.020337+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:08:17.020337+0000","last_undegraded":"2024-04-25T09:08:17.020337+0000","last_fullsized":"2024-04-25T09:08:17.020337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1396736,"data_stored":923973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1409024,"data_stored":930248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:08:22.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2024-04-25T09:08:22.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.018680+0000', 'last_change': '2024-04-25T09:08:17.018680+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.018680+0000', 'last_undegraded': '2024-04-25T09:08:17.018680+0000', 'last_fullsized': '2024-04-25T09:08:17.018680+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:08:22.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2024-04-25T09:08:22.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.005292+0000', 'last_change': '2024-04-25T09:08:17.005292+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.005292+0000', 'last_undegraded': '2024-04-25T09:08:17.005292+0000', 'last_fullsized': '2024-04-25T09:08:17.005292+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:08:22.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2024-04-25T09:08:22.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.010066+0000', 'last_change': '2024-04-25T09:08:17.010066+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.010066+0000', 'last_undegraded': '2024-04-25T09:08:17.010066+0000', 'last_fullsized': '2024-04-25T09:08:17.010066+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:08:22.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2024-04-25T09:08:22.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.005491+0000', 'last_change': '2024-04-25T09:08:17.005491+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.005491+0000', 'last_undegraded': '2024-04-25T09:08:17.005491+0000', 'last_fullsized': '2024-04-25T09:08:17.005491+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:08:22.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2024-04-25T09:08:22.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.007894+0000', 'last_change': '2024-04-25T09:08:17.007894+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.007894+0000', 'last_undegraded': '2024-04-25T09:08:17.007894+0000', 'last_fullsized': '2024-04-25T09:08:17.007894+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:08:22.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2024-04-25T09:08:22.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.007349+0000', 'last_change': '2024-04-25T09:08:17.007349+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.007349+0000', 'last_undegraded': '2024-04-25T09:08:17.007349+0000', 'last_fullsized': '2024-04-25T09:08:17.007349+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:08:22.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2024-04-25T09:08:22.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.011503+0000', 'last_change': '2024-04-25T09:08:17.011503+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.011503+0000', 'last_undegraded': '2024-04-25T09:08:17.011503+0000', 'last_fullsized': '2024-04-25T09:08:17.011503+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:08:22.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2024-04-25T09:08:22.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.005586+0000', 'last_change': '2024-04-25T09:08:17.005586+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.005586+0000', 'last_undegraded': '2024-04-25T09:08:17.005586+0000', 'last_fullsized': '2024-04-25T09:08:17.005586+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:08:22.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2024-04-25T09:08:22.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.013666+0000', 'last_change': '2024-04-25T09:08:17.013666+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.013666+0000', 'last_undegraded': '2024-04-25T09:08:17.013666+0000', 'last_fullsized': '2024-04-25T09:08:17.013666+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:08:22.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2024-04-25T09:08:22.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.012277+0000', 'last_change': '2024-04-25T09:08:17.012277+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.012277+0000', 'last_undegraded': '2024-04-25T09:08:17.012277+0000', 'last_fullsized': '2024-04-25T09:08:17.012277+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:08:22.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2024-04-25T09:08:22.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.018926+0000', 'last_change': '2024-04-25T09:08:17.018926+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.018926+0000', 'last_undegraded': '2024-04-25T09:08:17.018926+0000', 'last_fullsized': '2024-04-25T09:08:17.018926+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:08:22.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2024-04-25T09:08:22.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.005086+0000', 'last_change': '2024-04-25T09:08:17.005086+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.005086+0000', 'last_undegraded': '2024-04-25T09:08:17.005086+0000', 'last_fullsized': '2024-04-25T09:08:17.005086+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:08:22.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2024-04-25T09:08:22.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.007114+0000', 'last_change': '2024-04-25T09:08:17.007114+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.007114+0000', 'last_undegraded': '2024-04-25T09:08:17.007114+0000', 'last_fullsized': '2024-04-25T09:08:17.007114+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:08:22.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2024-04-25T09:08:22.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.008999+0000', 'last_change': '2024-04-25T09:08:17.008999+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.008999+0000', 'last_undegraded': '2024-04-25T09:08:17.008999+0000', 'last_fullsized': '2024-04-25T09:08:17.008999+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:08:22.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2024-04-25T09:08:22.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.006655+0000', 'last_change': '2024-04-25T09:08:17.006655+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.006655+0000', 'last_undegraded': '2024-04-25T09:08:17.006655+0000', 'last_fullsized': '2024-04-25T09:08:17.006655+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:08:22.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2024-04-25T09:08:22.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.009324+0000', 'last_change': '2024-04-25T09:08:17.009324+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.009324+0000', 'last_undegraded': '2024-04-25T09:08:17.009324+0000', 'last_fullsized': '2024-04-25T09:08:17.009324+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:08:22.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2024-04-25T09:08:22.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.013231+0000', 'last_change': '2024-04-25T09:08:17.013231+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.013231+0000', 'last_undegraded': '2024-04-25T09:08:17.013231+0000', 'last_fullsized': '2024-04-25T09:08:17.013231+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:08:22.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2024-04-25T09:08:22.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.004597+0000', 'last_change': '2024-04-25T09:08:17.004597+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.004597+0000', 'last_undegraded': '2024-04-25T09:08:17.004597+0000', 'last_fullsized': '2024-04-25T09:08:17.004597+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:08:22.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2024-04-25T09:08:22.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.005206+0000', 'last_change': '2024-04-25T09:08:17.005206+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.005206+0000', 'last_undegraded': '2024-04-25T09:08:17.005206+0000', 'last_fullsized': '2024-04-25T09:08:17.005206+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:08:22.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2024-04-25T09:08:22.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.008633+0000', 'last_change': '2024-04-25T09:08:17.008633+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.008633+0000', 'last_undegraded': '2024-04-25T09:08:17.008633+0000', 'last_fullsized': '2024-04-25T09:08:17.008633+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:08:22.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2024-04-25T09:08:22.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.009408+0000', 'last_change': '2024-04-25T09:08:17.009408+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.009408+0000', 'last_undegraded': '2024-04-25T09:08:17.009408+0000', 'last_fullsized': '2024-04-25T09:08:17.009408+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:08:22.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2024-04-25T09:08:22.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.009875+0000', 'last_change': '2024-04-25T09:08:17.009875+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.009875+0000', 'last_undegraded': '2024-04-25T09:08:17.009875+0000', 'last_fullsized': '2024-04-25T09:08:17.009875+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:08:22.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2024-04-25T09:08:22.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.018577+0000', 'last_change': '2024-04-25T09:08:17.018577+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.018577+0000', 'last_undegraded': '2024-04-25T09:08:17.018577+0000', 'last_fullsized': '2024-04-25T09:08:17.018577+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:08:22.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2024-04-25T09:08:22.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.017830+0000', 'last_change': '2024-04-25T09:08:17.017830+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.017830+0000', 'last_undegraded': '2024-04-25T09:08:17.017830+0000', 'last_fullsized': '2024-04-25T09:08:17.017830+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:08:22.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2024-04-25T09:08:22.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.010472+0000', 'last_change': '2024-04-25T09:08:17.010472+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.010472+0000', 'last_undegraded': '2024-04-25T09:08:17.010472+0000', 'last_fullsized': '2024-04-25T09:08:17.010472+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:08:22.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2024-04-25T09:08:22.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.007670+0000', 'last_change': '2024-04-25T09:08:17.007670+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.007670+0000', 'last_undegraded': '2024-04-25T09:08:17.007670+0000', 'last_fullsized': '2024-04-25T09:08:17.007670+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:08:22.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2024-04-25T09:08:22.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.009644+0000', 'last_change': '2024-04-25T09:08:17.009644+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.009644+0000', 'last_undegraded': '2024-04-25T09:08:17.009644+0000', 'last_fullsized': '2024-04-25T09:08:17.009644+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:08:22.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2024-04-25T09:08:22.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.012738+0000', 'last_change': '2024-04-25T09:08:17.012738+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.012738+0000', 'last_undegraded': '2024-04-25T09:08:17.012738+0000', 'last_fullsized': '2024-04-25T09:08:17.012738+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:08:22.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2024-04-25T09:08:22.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.008977+0000', 'last_change': '2024-04-25T09:08:17.008977+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.008977+0000', 'last_undegraded': '2024-04-25T09:08:17.008977+0000', 'last_fullsized': '2024-04-25T09:08:17.008977+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:08:22.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2024-04-25T09:08:22.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.011552+0000', 'last_change': '2024-04-25T09:08:17.011552+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.011552+0000', 'last_undegraded': '2024-04-25T09:08:17.011552+0000', 'last_fullsized': '2024-04-25T09:08:17.011552+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:08:22.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2024-04-25T09:08:22.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.007586+0000', 'last_change': '2024-04-25T09:08:17.007586+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.007586+0000', 'last_undegraded': '2024-04-25T09:08:17.007586+0000', 'last_fullsized': '2024-04-25T09:08:17.007586+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:08:22.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2024-04-25T09:08:22.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.004876+0000', 'last_change': '2024-04-25T09:08:17.004876+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.004876+0000', 'last_undegraded': '2024-04-25T09:08:17.004876+0000', 'last_fullsized': '2024-04-25T09:08:17.004876+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:08:22.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2024-04-25T09:08:22.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.017842+0000', 'last_change': '2024-04-25T09:08:17.017842+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.017842+0000', 'last_undegraded': '2024-04-25T09:08:17.017842+0000', 'last_fullsized': '2024-04-25T09:08:17.017842+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:08:22.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2024-04-25T09:08:22.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.012445+0000', 'last_change': '2024-04-25T09:08:17.012445+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.012445+0000', 'last_undegraded': '2024-04-25T09:08:17.012445+0000', 'last_fullsized': '2024-04-25T09:08:17.012445+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:08:22.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2024-04-25T09:08:22.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.005576+0000', 'last_change': '2024-04-25T09:08:17.005576+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.005576+0000', 'last_undegraded': '2024-04-25T09:08:17.005576+0000', 'last_fullsized': '2024-04-25T09:08:17.005576+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:08:22.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2024-04-25T09:08:22.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.018031+0000', 'last_change': '2024-04-25T09:08:17.018031+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.018031+0000', 'last_undegraded': '2024-04-25T09:08:17.018031+0000', 'last_fullsized': '2024-04-25T09:08:17.018031+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:08:22.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2024-04-25T09:08:22.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.006510+0000', 'last_change': '2024-04-25T09:08:17.006510+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.006510+0000', 'last_undegraded': '2024-04-25T09:08:17.006510+0000', 'last_fullsized': '2024-04-25T09:08:17.006510+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:08:22.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2024-04-25T09:08:22.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.008840+0000', 'last_change': '2024-04-25T09:08:17.008840+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.008840+0000', 'last_undegraded': '2024-04-25T09:08:17.008840+0000', 'last_fullsized': '2024-04-25T09:08:17.008840+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:08:22.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2024-04-25T09:08:22.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.015882+0000', 'last_change': '2024-04-25T09:08:17.015882+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.015882+0000', 'last_undegraded': '2024-04-25T09:08:17.015882+0000', 'last_fullsized': '2024-04-25T09:08:17.015882+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:08:22.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2024-04-25T09:08:22.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.006232+0000', 'last_change': '2024-04-25T09:08:17.006232+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.006232+0000', 'last_undegraded': '2024-04-25T09:08:17.006232+0000', 'last_fullsized': '2024-04-25T09:08:17.006232+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:08:22.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2024-04-25T09:08:22.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.007226+0000', 'last_change': '2024-04-25T09:08:17.007226+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.007226+0000', 'last_undegraded': '2024-04-25T09:08:17.007226+0000', 'last_fullsized': '2024-04-25T09:08:17.007226+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:08:22.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2024-04-25T09:08:22.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.018250+0000', 'last_change': '2024-04-25T09:08:17.018250+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.018250+0000', 'last_undegraded': '2024-04-25T09:08:17.018250+0000', 'last_fullsized': '2024-04-25T09:08:17.018250+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:08:22.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2024-04-25T09:08:22.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.004833+0000', 'last_change': '2024-04-25T09:08:17.004833+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.004833+0000', 'last_undegraded': '2024-04-25T09:08:17.004833+0000', 'last_fullsized': '2024-04-25T09:08:17.004833+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:08:22.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2024-04-25T09:08:22.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.012716+0000', 'last_change': '2024-04-25T09:08:17.012716+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.012716+0000', 'last_undegraded': '2024-04-25T09:08:17.012716+0000', 'last_fullsized': '2024-04-25T09:08:17.012716+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:08:22.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2024-04-25T09:08:22.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.018337+0000', 'last_change': '2024-04-25T09:08:17.018337+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.018337+0000', 'last_undegraded': '2024-04-25T09:08:17.018337+0000', 'last_fullsized': '2024-04-25T09:08:17.018337+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:08:22.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2024-04-25T09:08:22.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.006894+0000', 'last_change': '2024-04-25T09:08:17.006894+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.006894+0000', 'last_undegraded': '2024-04-25T09:08:17.006894+0000', 'last_fullsized': '2024-04-25T09:08:17.006894+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:08:22.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2024-04-25T09:08:22.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.006039+0000', 'last_change': '2024-04-25T09:08:17.006039+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.006039+0000', 'last_undegraded': '2024-04-25T09:08:17.006039+0000', 'last_fullsized': '2024-04-25T09:08:17.006039+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:08:22.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2024-04-25T09:08:22.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.006931+0000', 'last_change': '2024-04-25T09:08:17.006931+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.006931+0000', 'last_undegraded': '2024-04-25T09:08:17.006931+0000', 'last_fullsized': '2024-04-25T09:08:17.006931+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:08:22.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2024-04-25T09:08:22.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.011883+0000', 'last_change': '2024-04-25T09:08:17.011883+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.011883+0000', 'last_undegraded': '2024-04-25T09:08:17.011883+0000', 'last_fullsized': '2024-04-25T09:08:17.011883+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:08:22.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2024-04-25T09:08:22.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.013082+0000', 'last_change': '2024-04-25T09:08:17.013082+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.013082+0000', 'last_undegraded': '2024-04-25T09:08:17.013082+0000', 'last_fullsized': '2024-04-25T09:08:17.013082+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:08:22.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2024-04-25T09:08:22.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.004492+0000', 'last_change': '2024-04-25T09:08:17.004492+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.004492+0000', 'last_undegraded': '2024-04-25T09:08:17.004492+0000', 'last_fullsized': '2024-04-25T09:08:17.004492+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:08:22.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2024-04-25T09:08:22.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.007577+0000', 'last_change': '2024-04-25T09:08:17.007577+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.007577+0000', 'last_undegraded': '2024-04-25T09:08:17.007577+0000', 'last_fullsized': '2024-04-25T09:08:17.007577+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:08:22.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2024-04-25T09:08:22.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.008528+0000', 'last_change': '2024-04-25T09:08:17.008528+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.008528+0000', 'last_undegraded': '2024-04-25T09:08:17.008528+0000', 'last_fullsized': '2024-04-25T09:08:17.008528+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:08:22.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2024-04-25T09:08:22.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.008759+0000', 'last_change': '2024-04-25T09:08:17.008759+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.008759+0000', 'last_undegraded': '2024-04-25T09:08:17.008759+0000', 'last_fullsized': '2024-04-25T09:08:17.008759+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:08:22.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2024-04-25T09:08:22.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.008064+0000', 'last_change': '2024-04-25T09:08:17.008064+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.008064+0000', 'last_undegraded': '2024-04-25T09:08:17.008064+0000', 'last_fullsized': '2024-04-25T09:08:17.008064+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:08:22.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2024-04-25T09:08:22.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.009567+0000', 'last_change': '2024-04-25T09:08:17.009567+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.009567+0000', 'last_undegraded': '2024-04-25T09:08:17.009567+0000', 'last_fullsized': '2024-04-25T09:08:17.009567+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:08:22.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2024-04-25T09:08:22.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.006618+0000', 'last_change': '2024-04-25T09:08:17.006618+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.006618+0000', 'last_undegraded': '2024-04-25T09:08:17.006618+0000', 'last_fullsized': '2024-04-25T09:08:17.006618+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:08:22.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2024-04-25T09:08:22.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.013067+0000', 'last_change': '2024-04-25T09:08:17.013067+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.013067+0000', 'last_undegraded': '2024-04-25T09:08:17.013067+0000', 'last_fullsized': '2024-04-25T09:08:17.013067+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:08:22.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2024-04-25T09:08:22.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.013585+0000', 'last_change': '2024-04-25T09:08:17.013585+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.013585+0000', 'last_undegraded': '2024-04-25T09:08:17.013585+0000', 'last_fullsized': '2024-04-25T09:08:17.013585+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:08:22.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2024-04-25T09:08:22.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.007283+0000', 'last_change': '2024-04-25T09:08:17.007283+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.007283+0000', 'last_undegraded': '2024-04-25T09:08:17.007283+0000', 'last_fullsized': '2024-04-25T09:08:17.007283+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:08:22.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2024-04-25T09:08:22.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.007882+0000', 'last_change': '2024-04-25T09:08:17.007882+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.007882+0000', 'last_undegraded': '2024-04-25T09:08:17.007882+0000', 'last_fullsized': '2024-04-25T09:08:17.007882+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:08:22.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2024-04-25T09:08:22.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.004497+0000', 'last_change': '2024-04-25T09:08:17.004497+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.004497+0000', 'last_undegraded': '2024-04-25T09:08:17.004497+0000', 'last_fullsized': '2024-04-25T09:08:17.004497+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:08:22.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2024-04-25T09:08:22.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.005040+0000', 'last_change': '2024-04-25T09:08:17.005040+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.005040+0000', 'last_undegraded': '2024-04-25T09:08:17.005040+0000', 'last_fullsized': '2024-04-25T09:08:17.005040+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:08:22.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2024-04-25T09:08:22.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:08:17.009981+0000', 'last_change': '2024-04-25T09:08:17.009981+0000', 'last_active': '2024-04-25T09:08:16.991085+0000', 'last_peered': '2024-04-25T09:08:16.991085+0000', 'last_clean': '2024-04-25T09:08:16.991085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:08:17.009981+0000', 'last_undegraded': '2024-04-25T09:08:17.009981+0000', 'last_fullsized': '2024-04-25T09:08:17.009981+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'last_clean_scrub_stamp': '2024-04-25T09:08:16.991085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:08:22.835 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:08:22.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.008+0000 7f78b5200640 1 Processor -- start 2024-04-25T09:08:22.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.008+0000 7f78b5200640 1 -- start start 2024-04-25T09:08:22.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.008+0000 7f78b5200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b006bd60 0x7f78b006cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:22.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.008+0000 7f78b5200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f78b00d0d50 0x7f78b00cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:22.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.008+0000 7f78b5200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b00cfcb0 con 0x7f78b0099a50 2024-04-25T09:08:22.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.008+0000 7f78b5200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b00cff90 con 0x7f78b00d0d50 2024-04-25T09:08:22.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.008+0000 7f78b5200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b00d0270 con 0x7f78b006bd60 2024-04-25T09:08:22.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.008+0000 7f78ae800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f78b00d0d50 0x7f78b00cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:22.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.008+0000 7f78ae800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f78b00d0d50 0x7f78b00cbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60740/0 (socket says 172.21.15.175:60740) 2024-04-25T09:08:22.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.008+0000 7f78ae800640 1 -- 172.21.15.175:0/3533648113 learned_addr learned my addr 172.21.15.175:0/3533648113 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:23.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.008+0000 7f78ae800640 1 -- 172.21.15.175:0/3533648113 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b006bd60 msgr2=0x7f78b006cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:23.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.008+0000 7f78a5400640 1 --2- 172.21.15.175:0/3533648113 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b006bd60 0x7f78b006cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:23.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.008+0000 7f78ae800640 1 --2- 172.21.15.175:0/3533648113 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b006bd60 0x7f78b006cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:23.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.008+0000 7f78ae800640 1 -- 172.21.15.175:0/3533648113 >> v1:172.21.15.177:6789/0 conn(0x7f78b0099a50 legacy=0x7f78b0099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:23.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.008+0000 7f78ae800640 1 -- 172.21.15.175:0/3533648113 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b00d0550 con 0x7f78b00d0d50 2024-04-25T09:08:23.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.008+0000 7f78a5400640 1 --2- 172.21.15.175:0/3533648113 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b006bd60 0x7f78b006cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:23.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.012+0000 7f78ae800640 1 --2- 172.21.15.175:0/3533648113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78b00d0d50 0x7f78b00cbe60 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009e50 tx=0x7f78a801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f230c204f8bcb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:23.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.012+0000 7f78ad400640 1 -- 172.21.15.175:0/3533648113 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a80a5670 con 0x7f78b00d0d50 2024-04-25T09:08:23.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.012+0000 7f78ad400640 1 -- 172.21.15.175:0/3533648113 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a80a5810 con 0x7f78b00d0d50 2024-04-25T09:08:23.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.012+0000 7f78ad400640 1 -- 172.21.15.175:0/3533648113 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a80a5be0 con 0x7f78b00d0d50 2024-04-25T09:08:23.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.012+0000 7f78b5200640 1 -- 172.21.15.175:0/3533648113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78b00d0d50 msgr2=0x7f78b00cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:23.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.012+0000 7f78b5200640 1 --2- 172.21.15.175:0/3533648113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78b00d0d50 0x7f78b00cbe60 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009e50 tx=0x7f78a801c9f0 comp rx=0 tx=0).stop 2024-04-25T09:08:23.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.012+0000 7f78b5200640 1 -- 172.21.15.175:0/3533648113 shutdown_connections 2024-04-25T09:08:23.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.012+0000 7f78b5200640 1 --2- 172.21.15.175:0/3533648113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78b00d0d50 0x7f78b00cbe60 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:23.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.012+0000 7f78b5200640 1 --2- 172.21.15.175:0/3533648113 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b006bd60 0x7f78b006cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:23.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.012+0000 7f78b5200640 1 -- 172.21.15.175:0/3533648113 >> 172.21.15.175:0/3533648113 conn(0x7f78b00b3300 msgr2=0x7f78b00b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:23.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.012+0000 7f78b5200640 1 -- 172.21.15.175:0/3533648113 shutdown_connections 2024-04-25T09:08:23.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.012+0000 7f78b5200640 1 -- 172.21.15.175:0/3533648113 wait complete. 2024-04-25T09:08:23.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78b5200640 1 Processor -- start 2024-04-25T09:08:23.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78b5200640 1 -- start start 2024-04-25T09:08:23.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78b5200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78b006bd60 0x7f78b0159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:23.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78b5200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b0099a50 0x7f78b00b6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:23.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78b5200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78b00d0d50 0x7f78b01488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:23.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78b5200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b015dfe0 con 0x7f78b006bd60 2024-04-25T09:08:23.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78b5200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b015de60 con 0x7f78b00d0d50 2024-04-25T09:08:23.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78b5200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b016b260 con 0x7f78b0099a50 2024-04-25T09:08:23.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78ade00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78b006bd60 0x7f78b0159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:23.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78ade00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78b006bd60 0x7f78b0159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60744/0 (socket says 172.21.15.175:60744) 2024-04-25T09:08:23.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78ade00640 1 -- 172.21.15.175:0/1316743245 learned_addr learned my addr 172.21.15.175:0/1316743245 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:23.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78ae800640 1 --2- 172.21.15.175:0/1316743245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78b00d0d50 0x7f78b01488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:23.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78a5400640 1 --2- 172.21.15.175:0/1316743245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b0099a50 0x7f78b00b6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:23.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78ade00640 1 -- 172.21.15.175:0/1316743245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b0099a50 msgr2=0x7f78b00b6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:23.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78ade00640 1 --2- 172.21.15.175:0/1316743245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b0099a50 0x7f78b00b6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:23.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78ade00640 1 -- 172.21.15.175:0/1316743245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78b00d0d50 msgr2=0x7f78b01488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:23.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78ade00640 1 --2- 172.21.15.175:0/1316743245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78b00d0d50 0x7f78b01488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:23.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78ade00640 1 -- 172.21.15.175:0/1316743245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b0148e00 con 0x7f78b006bd60 2024-04-25T09:08:23.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78a5400640 1 --2- 172.21.15.175:0/1316743245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b0099a50 0x7f78b00b6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:23.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78ade00640 1 --2- 172.21.15.175:0/1316743245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78b006bd60 0x7f78b0159f80 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f78a000c450 tx=0x7f78a000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:23.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78a6a00640 1 -- 172.21.15.175:0/1316743245 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0011790 con 0x7f78b006bd60 2024-04-25T09:08:23.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78a6a00640 1 -- 172.21.15.175:0/1316743245 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a0017070 con 0x7f78b006bd60 2024-04-25T09:08:23.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78b5200640 1 -- 172.21.15.175:0/1316743245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b015a560 con 0x7f78b006bd60 2024-04-25T09:08:23.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78a6a00640 1 -- 172.21.15.175:0/1316743245 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a0011b90 con 0x7f78b006bd60 2024-04-25T09:08:23.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.016+0000 7f78b5200640 1 -- 172.21.15.175:0/1316743245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b015ab20 con 0x7f78b006bd60 2024-04-25T09:08:23.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.020+0000 7f78b5200640 1 -- 172.21.15.175:0/1316743245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b0074a60 con 0x7f78b006bd60 2024-04-25T09:08:23.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.020+0000 7f78a6a00640 1 -- 172.21.15.175:0/1316743245 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f78a0011d30 con 0x7f78b006bd60 2024-04-25T09:08:23.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.020+0000 7f78a6a00640 1 --2- 172.21.15.175:0/1316743245 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f788c066f60 0x7f788c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:23.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.020+0000 7f78a6a00640 1 -- 172.21.15.175:0/1316743245 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78a0084ce0 con 0x7f78b006bd60 2024-04-25T09:08:23.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.020+0000 7f78a5400640 1 --2- 172.21.15.175:0/1316743245 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f788c066f60 0x7f788c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:23.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.020+0000 7f78a5400640 1 --2- 172.21.15.175:0/1316743245 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f788c066f60 0x7f788c069420 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f78b014c580 tx=0x7f7898008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:23.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.024+0000 7f78a6a00640 1 -- 172.21.15.175:0/1316743245 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f78a0055d60 con 0x7f78b006bd60 2024-04-25T09:08:23.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.232+0000 7f78b5200640 1 -- 172.21.15.175:0/1316743245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f78b009aee0 con 0x7f78b006bd60 2024-04-25T09:08:23.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.232+0000 7f78a6a00640 1 -- 172.21.15.175:0/1316743245 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1035 (secure 0 0 0) 0x7f78a0055660 con 0x7f78b006bd60 2024-04-25T09:08:23.222 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:23.222 INFO:teuthology.orchestra.run.smithi175.stdout:{"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":278,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":69,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035836,"num_in_osds":8,"osd_in_since":1714035827,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":241831936,"bytes_avail":772852281344,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":43,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"d","status":"up:active","gid":6528}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-04-25T09:08:05.843444+0000","services":{}},"progress_events":{}} 2024-04-25T09:08:23.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.236+0000 7f78b5200640 1 -- 172.21.15.175:0/1316743245 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f788c066f60 msgr2=0x7f788c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:23.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.236+0000 7f78b5200640 1 --2- 172.21.15.175:0/1316743245 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f788c066f60 0x7f788c069420 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f78b014c580 tx=0x7f7898008040 comp rx=0 tx=0).stop 2024-04-25T09:08:23.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.236+0000 7f78b5200640 1 -- 172.21.15.175:0/1316743245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78b006bd60 msgr2=0x7f78b0159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:23.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.236+0000 7f78b5200640 1 --2- 172.21.15.175:0/1316743245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78b006bd60 0x7f78b0159f80 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f78a000c450 tx=0x7f78a000c910 comp rx=0 tx=0).stop 2024-04-25T09:08:23.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.236+0000 7f78b5200640 1 -- 172.21.15.175:0/1316743245 shutdown_connections 2024-04-25T09:08:23.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.236+0000 7f78b5200640 1 --2- 172.21.15.175:0/1316743245 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f788c066f60 0x7f788c069420 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:23.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.236+0000 7f78b5200640 1 --2- 172.21.15.175:0/1316743245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78b00d0d50 0x7f78b01488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:23.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.236+0000 7f78b5200640 1 --2- 172.21.15.175:0/1316743245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78b0099a50 0x7f78b00b6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:23.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.236+0000 7f78b5200640 1 --2- 172.21.15.175:0/1316743245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78b006bd60 0x7f78b0159f80 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:23.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.236+0000 7f78b5200640 1 -- 172.21.15.175:0/1316743245 >> 172.21.15.175:0/1316743245 conn(0x7f78b00b3300 msgr2=0x7f78b00b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:23.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.236+0000 7f78b5200640 1 -- 172.21.15.175:0/1316743245 shutdown_connections 2024-04-25T09:08:23.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.236+0000 7f78b5200640 1 -- 172.21.15.175:0/1316743245 wait complete. 2024-04-25T09:08:23.243 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:08:23.244 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:08:23.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.388+0000 7f878cc00640 1 Processor -- start 2024-04-25T09:08:23.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.388+0000 7f878cc00640 1 -- start start 2024-04-25T09:08:23.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.392+0000 7f878cc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8788144fc0 0x7f87880cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:23.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.392+0000 7f878cc00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878815cd00 con 0x7f87881453a0 2024-04-25T09:08:23.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.392+0000 7f878cc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87880ce660 con 0x7f878815c5e0 2024-04-25T09:08:23.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.392+0000 7f878cc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87880cc930 con 0x7f8788144fc0 2024-04-25T09:08:23.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.392+0000 7f877d400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f87881453a0 0x7f878815bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:54600/0 (socket says 172.21.15.175:54600) 2024-04-25T09:08:23.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.392+0000 7f877d400640 1 -- 172.21.15.175:0/1215982975 learned_addr learned my addr 172.21.15.175:0/1215982975 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:23.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.392+0000 7f8785e00640 1 --2- 172.21.15.175:0/1215982975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8788144fc0 0x7f87880cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:23.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.392+0000 7f8785400640 1 -- 172.21.15.175:0/1215982975 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034184260 0 0) 0x7f878815cd00 con 0x7f87881453a0 2024-04-25T09:08:23.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.392+0000 7f8785400640 1 -- 172.21.15.175:0/1215982975 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f876c003530 con 0x7f87881453a0 2024-04-25T09:08:23.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.392+0000 7f8785400640 1 -- 172.21.15.175:0/1215982975 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952875129 0 0) 0x7f87880ce660 con 0x7f878815c5e0 2024-04-25T09:08:23.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.392+0000 7f8785400640 1 -- 172.21.15.175:0/1215982975 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f878815cd00 con 0x7f878815c5e0 2024-04-25T09:08:23.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.392+0000 7f8785400640 1 -- 172.21.15.175:0/1215982975 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2180361567 0 0) 0x7f876c003530 con 0x7f87881453a0 2024-04-25T09:08:23.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.392+0000 7f8785e00640 1 -- 172.21.15.175:0/1215982975 >> v1:172.21.15.177:6789/0 conn(0x7f878815c5e0 legacy=0x7f87880cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:23.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.392+0000 7f8785e00640 1 -- 172.21.15.175:0/1215982975 >> v1:172.21.15.175:6789/0 conn(0x7f87881453a0 legacy=0x7f878815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:23.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.392+0000 7f8785e00640 1 -- 172.21.15.175:0/1215982975 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87880ccc10 con 0x7f8788144fc0 2024-04-25T09:08:23.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.396+0000 7f8785e00640 1 --2- 172.21.15.175:0/1215982975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8788144fc0 0x7f87880cbe70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f87780097f0 tx=0x7f877801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15b32aa0f49b0d73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:23.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.396+0000 7f8785400640 1 -- 172.21.15.175:0/1215982975 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87780b0070 con 0x7f8788144fc0 2024-04-25T09:08:23.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.396+0000 7f8785400640 1 -- 172.21.15.175:0/1215982975 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87780ab400 con 0x7f8788144fc0 2024-04-25T09:08:23.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.396+0000 7f8785400640 1 -- 172.21.15.175:0/1215982975 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8770001680 con 0x7f8788144fc0 2024-04-25T09:08:23.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.396+0000 7f878cc00640 1 -- 172.21.15.175:0/1215982975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8788144fc0 msgr2=0x7f87880cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:23.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.396+0000 7f878cc00640 1 --2- 172.21.15.175:0/1215982975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8788144fc0 0x7f87880cbe70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f87780097f0 tx=0x7f877801c400 comp rx=0 tx=0).stop 2024-04-25T09:08:23.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.396+0000 7f878cc00640 1 -- 172.21.15.175:0/1215982975 shutdown_connections 2024-04-25T09:08:23.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.396+0000 7f878cc00640 1 --2- 172.21.15.175:0/1215982975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8788144fc0 0x7f87880cbe70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:23.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.396+0000 7f878cc00640 1 -- 172.21.15.175:0/1215982975 >> 172.21.15.175:0/1215982975 conn(0x7f8788067150 msgr2=0x7f878806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:23.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.396+0000 7f878cc00640 1 -- 172.21.15.175:0/1215982975 shutdown_connections 2024-04-25T09:08:23.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.396+0000 7f878cc00640 1 -- 172.21.15.175:0/1215982975 wait complete. 2024-04-25T09:08:23.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.396+0000 7f878cc00640 1 Processor -- start 2024-04-25T09:08:23.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.396+0000 7f878cc00640 1 -- start start 2024-04-25T09:08:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f878cc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87881453a0 0x7f8788155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f878cc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f878815c5e0 0x7f8788155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f878cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f878813abc0 0x7f8788155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f878cc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8788169600 con 0x7f878813abc0 2024-04-25T09:08:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f878cc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87880cffd0 con 0x7f87881453a0 2024-04-25T09:08:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f878cc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8788169780 con 0x7f878815c5e0 2024-04-25T09:08:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f8786800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f878813abc0 0x7f8788155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f8786800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f878813abc0 0x7f8788155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60752/0 (socket says 172.21.15.175:60752) 2024-04-25T09:08:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f8786800640 1 -- 172.21.15.175:0/2785053282 learned_addr learned my addr 172.21.15.175:0/2785053282 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f877d400640 1 --2- 172.21.15.175:0/2785053282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f878815c5e0 0x7f8788155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f8785e00640 1 --2- 172.21.15.175:0/2785053282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87881453a0 0x7f8788155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f8786800640 1 -- 172.21.15.175:0/2785053282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f878815c5e0 msgr2=0x7f8788155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:23.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f8786800640 1 --2- 172.21.15.175:0/2785053282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f878815c5e0 0x7f8788155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:23.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f8786800640 1 -- 172.21.15.175:0/2785053282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87881453a0 msgr2=0x7f8788155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:23.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f8786800640 1 --2- 172.21.15.175:0/2785053282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87881453a0 0x7f8788155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:23.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f8786800640 1 -- 172.21.15.175:0/2785053282 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87880af370 con 0x7f878813abc0 2024-04-25T09:08:23.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f8786800640 1 --2- 172.21.15.175:0/2785053282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f878813abc0 0x7f8788155aa0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f878000c760 tx=0x7f878000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:23.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f877ea00640 1 -- 172.21.15.175:0/2785053282 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780003b80 con 0x7f878813abc0 2024-04-25T09:08:23.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f877ea00640 1 -- 172.21.15.175:0/2785053282 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8780003d40 con 0x7f878813abc0 2024-04-25T09:08:23.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f878cc00640 1 -- 172.21.15.175:0/2785053282 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87880af650 con 0x7f878813abc0 2024-04-25T09:08:23.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f877ea00640 1 -- 172.21.15.175:0/2785053282 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878000aa90 con 0x7f878813abc0 2024-04-25T09:08:23.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f878cc00640 1 -- 172.21.15.175:0/2785053282 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878813b210 con 0x7f878813abc0 2024-04-25T09:08:23.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f878cc00640 1 -- 172.21.15.175:0/2785053282 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8788074a60 con 0x7f878813abc0 2024-04-25T09:08:23.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.400+0000 7f877ea00640 1 -- 172.21.15.175:0/2785053282 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f878000ac30 con 0x7f878813abc0 2024-04-25T09:08:23.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.404+0000 7f877ea00640 1 --2- 172.21.15.175:0/2785053282 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8764066f60 0x7f8764069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:23.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.404+0000 7f877ea00640 1 -- 172.21.15.175:0/2785053282 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8780084e00 con 0x7f878813abc0 2024-04-25T09:08:23.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.404+0000 7f8785e00640 1 --2- 172.21.15.175:0/2785053282 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8764066f60 0x7f8764069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:23.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.404+0000 7f8785e00640 1 --2- 172.21.15.175:0/2785053282 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8764066f60 0x7f8764069420 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f87780ad000 tx=0x7f8778008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:23.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.408+0000 7f877ea00640 1 -- 172.21.15.175:0/2785053282 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f87800557c0 con 0x7f878813abc0 2024-04-25T09:08:23.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.556+0000 7f878cc00640 1 -- 172.21.15.175:0/2785053282 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f87880b2340 con 0x7f8764066f60 2024-04-25T09:08:23.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.564+0000 7f877ea00640 1 -- 172.21.15.175:0/2785053282 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246753 (secure 0 0 0) 0x7f87880b2340 con 0x7f8764066f60 2024-04-25T09:08:23.555 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:23.556 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:08:23.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.568+0000 7f878cc00640 1 -- 172.21.15.175:0/2785053282 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8764066f60 msgr2=0x7f8764069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:23.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.568+0000 7f878cc00640 1 --2- 172.21.15.175:0/2785053282 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8764066f60 0x7f8764069420 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f87780ad000 tx=0x7f8778008040 comp rx=0 tx=0).stop 2024-04-25T09:08:23.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.568+0000 7f878cc00640 1 -- 172.21.15.175:0/2785053282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f878813abc0 msgr2=0x7f8788155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:23.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.568+0000 7f878cc00640 1 --2- 172.21.15.175:0/2785053282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f878813abc0 0x7f8788155aa0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f878000c760 tx=0x7f878000cc20 comp rx=0 tx=0).stop 2024-04-25T09:08:23.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.568+0000 7f878cc00640 1 -- 172.21.15.175:0/2785053282 shutdown_connections 2024-04-25T09:08:23.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.568+0000 7f878cc00640 1 --2- 172.21.15.175:0/2785053282 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8764066f60 0x7f8764069420 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:23.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.568+0000 7f878cc00640 1 --2- 172.21.15.175:0/2785053282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f878813abc0 0x7f8788155aa0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:23.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.568+0000 7f878cc00640 1 --2- 172.21.15.175:0/2785053282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f878815c5e0 0x7f8788155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:23.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.568+0000 7f878cc00640 1 --2- 172.21.15.175:0/2785053282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87881453a0 0x7f8788155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:23.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.568+0000 7f878cc00640 1 -- 172.21.15.175:0/2785053282 >> 172.21.15.175:0/2785053282 conn(0x7f8788144fc0 msgr2=0x7f87880b2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:23.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.568+0000 7f878cc00640 1 -- 172.21.15.175:0/2785053282 shutdown_connections 2024-04-25T09:08:23.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:23.568+0000 7f878cc00640 1 -- 172.21.15.175:0/2785053282 wait complete. 2024-04-25T09:08:23.575 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-04-25T09:08:21.846556+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236164,"kb_used_data":7516,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738556,"statfs":{"total":773094113280,"available":772852281344,"internally_reserved":0,"allocated":7696384,"data_stored":3893501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.853098"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018680+0000","last_change":"2024-04-25T09:08:17.018680+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018680+0000","last_undegraded":"2024-04-25T09:08:17.018680+0000","last_fullsized":"2024-04-25T09:08:17.018680+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005292+0000","last_change":"2024-04-25T09:08:17.005292+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005292+0000","last_undegraded":"2024-04-25T09:08:17.005292+0000","last_fullsized":"2024-04-25T09:08:17.005292+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.010066+0000","last_change":"2024-04-25T09:08:17.010066+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.010066+0000","last_undegraded":"2024-04-25T09:08:17.010066+0000","last_fullsized":"2024-04-25T09:08:17.010066+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005491+0000","last_change":"2024-04-25T09:08:17.005491+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005491+0000","last_undegraded":"2024-04-25T09:08:17.005491+0000","last_fullsized":"2024-04-25T09:08:17.005491+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007894+0000","last_change":"2024-04-25T09:08:17.007894+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007894+0000","last_undegraded":"2024-04-25T09:08:17.007894+0000","last_fullsized":"2024-04-25T09:08:17.007894+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007349+0000","last_change":"2024-04-25T09:08:17.007349+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007349+0000","last_undegraded":"2024-04-25T09:08:17.007349+0000","last_fullsized":"2024-04-25T09:08:17.007349+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.011503+0000","last_change":"2024-04-25T09:08:17.011503+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.011503+0000","last_undegraded":"2024-04-25T09:08:17.011503+0000","last_fullsized":"2024-04-25T09:08:17.011503+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005586+0000","last_change":"2024-04-25T09:08:17.005586+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005586+0000","last_undegraded":"2024-04-25T09:08:17.005586+0000","last_fullsized":"2024-04-25T09:08:17.005586+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013666+0000","last_change":"2024-04-25T09:08:17.013666+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013666+0000","last_undegraded":"2024-04-25T09:08:17.013666+0000","last_fullsized":"2024-04-25T09:08:17.013666+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.012277+0000","last_change":"2024-04-25T09:08:17.012277+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.012277+0000","last_undegraded":"2024-04-25T09:08:17.012277+0000","last_fullsized":"2024-04-25T09:08:17.012277+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018926+0000","last_change":"2024-04-25T09:08:17.018926+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018926+0000","last_undegraded":"2024-04-25T09:08:17.018926+0000","last_fullsized":"2024-04-25T09:08:17.018926+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005086+0000","last_change":"2024-04-25T09:08:17.005086+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005086+0000","last_undegraded":"2024-04-25T09:08:17.005086+0000","last_fullsized":"2024-04-25T09:08:17.005086+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007114+0000","last_change":"2024-04-25T09:08:17.007114+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007114+0000","last_undegraded":"2024-04-25T09:08:17.007114+0000","last_fullsized":"2024-04-25T09:08:17.007114+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008999+0000","last_change":"2024-04-25T09:08:17.008999+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008999+0000","last_undegraded":"2024-04-25T09:08:17.008999+0000","last_fullsized":"2024-04-25T09:08:17.008999+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006655+0000","last_change":"2024-04-25T09:08:17.006655+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006655+0000","last_undegraded":"2024-04-25T09:08:17.006655+0000","last_fullsized":"2024-04-25T09:08:17.006655+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009324+0000","last_change":"2024-04-25T09:08:17.009324+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009324+0000","last_undegraded":"2024-04-25T09:08:17.009324+0000","last_fullsized":"2024-04-25T09:08:17.009324+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013231+0000","last_change":"2024-04-25T09:08:17.013231+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013231+0000","last_undegraded":"2024-04-25T09:08:17.013231+0000","last_fullsized":"2024-04-25T09:08:17.013231+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004597+0000","last_change":"2024-04-25T09:08:17.004597+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004597+0000","last_undegraded":"2024-04-25T09:08:17.004597+0000","last_fullsized":"2024-04-25T09:08:17.004597+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005206+0000","last_change":"2024-04-25T09:08:17.005206+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005206+0000","last_undegraded":"2024-04-25T09:08:17.005206+0000","last_fullsized":"2024-04-25T09:08:17.005206+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008633+0000","last_change":"2024-04-25T09:08:17.008633+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008633+0000","last_undegraded":"2024-04-25T09:08:17.008633+0000","last_fullsized":"2024-04-25T09:08:17.008633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009408+0000","last_change":"2024-04-25T09:08:17.009408+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009408+0000","last_undegraded":"2024-04-25T09:08:17.009408+0000","last_fullsized":"2024-04-25T09:08:17.009408+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009875+0000","last_change":"2024-04-25T09:08:17.009875+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009875+0000","last_undegraded":"2024-04-25T09:08:17.009875+0000","last_fullsized":"2024-04-25T09:08:17.009875+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018577+0000","last_change":"2024-04-25T09:08:17.018577+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018577+0000","last_undegraded":"2024-04-25T09:08:17.018577+0000","last_fullsized":"2024-04-25T09:08:17.018577+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.017830+0000","last_change":"2024-04-25T09:08:17.017830+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.017830+0000","last_undegraded":"2024-04-25T09:08:17.017830+0000","last_fullsized":"2024-04-25T09:08:17.017830+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.010472+0000","last_change":"2024-04-25T09:08:17.010472+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.010472+0000","last_undegraded":"2024-04-25T09:08:17.010472+0000","last_fullsized":"2024-04-25T09:08:17.010472+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007670+0000","last_change":"2024-04-25T09:08:17.007670+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007670+0000","last_undegraded":"2024-04-25T09:08:17.007670+0000","last_fullsized":"2024-04-25T09:08:17.007670+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009644+0000","last_change":"2024-04-25T09:08:17.009644+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009644+0000","last_undegraded":"2024-04-25T09:08:17.009644+0000","last_fullsized":"2024-04-25T09:08:17.009644+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.012738+0000","last_change":"2024-04-25T09:08:17.012738+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.012738+0000","last_undegraded":"2024-04-25T09:08:17.012738+0000","last_fullsized":"2024-04-25T09:08:17.012738+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008977+0000","last_change":"2024-04-25T09:08:17.008977+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008977+0000","last_undegraded":"2024-04-25T09:08:17.008977+0000","last_fullsized":"2024-04-25T09:08:17.008977+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.011552+0000","last_change":"2024-04-25T09:08:17.011552+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.011552+0000","last_undegraded":"2024-04-25T09:08:17.011552+0000","last_fullsized":"2024-04-25T09:08:17.011552+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007586+0000","last_change":"2024-04-25T09:08:17.007586+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007586+0000","last_undegraded":"2024-04-25T09:08:17.007586+0000","last_fullsized":"2024-04-25T09:08:17.007586+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004876+0000","last_change":"2024-04-25T09:08:17.004876+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004876+0000","last_undegraded":"2024-04-25T09:08:17.004876+0000","last_fullsized":"2024-04-25T09:08:17.004876+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.017842+0000","last_change":"2024-04-25T09:08:17.017842+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.017842+0000","last_undegraded":"2024-04-25T09:08:17.017842+0000","last_fullsized":"2024-04-25T09:08:17.017842+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033662+0000","last_change":"2024-04-25T09:08:17.029200+0000","last_active":"2024-04-25T09:08:17.033662+0000","last_peered":"2024-04-25T09:08:17.033662+0000","last_clean":"2024-04-25T09:08:17.033662+0000","last_became_active":"2024-04-25T09:08:17.028890+0000","last_became_peered":"2024-04-25T09:08:17.028890+0000","last_unstale":"2024-04-25T09:08:17.033662+0000","last_undegraded":"2024-04-25T09:08:17.033662+0000","last_fullsized":"2024-04-25T09:08:17.033662+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:55.882355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.012445+0000","last_change":"2024-04-25T09:08:17.012445+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.012445+0000","last_undegraded":"2024-04-25T09:08:17.012445+0000","last_fullsized":"2024-04-25T09:08:17.012445+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.027624+0000","last_change":"2024-04-25T09:08:17.022928+0000","last_active":"2024-04-25T09:08:17.027624+0000","last_peered":"2024-04-25T09:08:17.027624+0000","last_clean":"2024-04-25T09:08:17.027624+0000","last_became_active":"2024-04-25T09:08:17.022408+0000","last_became_peered":"2024-04-25T09:08:17.022408+0000","last_unstale":"2024-04-25T09:08:17.027624+0000","last_undegraded":"2024-04-25T09:08:17.027624+0000","last_fullsized":"2024-04-25T09:08:17.027624+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:04.773505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005576+0000","last_change":"2024-04-25T09:08:17.005576+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005576+0000","last_undegraded":"2024-04-25T09:08:17.005576+0000","last_fullsized":"2024-04-25T09:08:17.005576+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033373+0000","last_change":"2024-04-25T09:08:17.026541+0000","last_active":"2024-04-25T09:08:17.033373+0000","last_peered":"2024-04-25T09:08:17.033373+0000","last_clean":"2024-04-25T09:08:17.033373+0000","last_became_active":"2024-04-25T09:08:17.026241+0000","last_became_peered":"2024-04-25T09:08:17.026241+0000","last_unstale":"2024-04-25T09:08:17.033373+0000","last_undegraded":"2024-04-25T09:08:17.033373+0000","last_fullsized":"2024-04-25T09:08:17.033373+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:16.176102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018031+0000","last_change":"2024-04-25T09:08:17.018031+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018031+0000","last_undegraded":"2024-04-25T09:08:17.018031+0000","last_fullsized":"2024-04-25T09:08:17.018031+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023898+0000","last_change":"2024-04-25T09:08:17.017059+0000","last_active":"2024-04-25T09:08:17.023898+0000","last_peered":"2024-04-25T09:08:17.023898+0000","last_clean":"2024-04-25T09:08:17.023898+0000","last_became_active":"2024-04-25T09:08:17.016731+0000","last_became_peered":"2024-04-25T09:08:17.016731+0000","last_unstale":"2024-04-25T09:08:17.023898+0000","last_undegraded":"2024-04-25T09:08:17.023898+0000","last_fullsized":"2024-04-25T09:08:17.023898+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:30.230418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006510+0000","last_change":"2024-04-25T09:08:17.006510+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006510+0000","last_undegraded":"2024-04-25T09:08:17.006510+0000","last_fullsized":"2024-04-25T09:08:17.006510+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.027739+0000","last_change":"2024-04-25T09:08:17.026572+0000","last_active":"2024-04-25T09:08:17.027739+0000","last_peered":"2024-04-25T09:08:17.027739+0000","last_clean":"2024-04-25T09:08:17.027739+0000","last_became_active":"2024-04-25T09:08:17.026303+0000","last_became_peered":"2024-04-25T09:08:17.026303+0000","last_unstale":"2024-04-25T09:08:17.027739+0000","last_undegraded":"2024-04-25T09:08:17.027739+0000","last_fullsized":"2024-04-25T09:08:17.027739+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:03.502069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008840+0000","last_change":"2024-04-25T09:08:17.008840+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008840+0000","last_undegraded":"2024-04-25T09:08:17.008840+0000","last_fullsized":"2024-04-25T09:08:17.008840+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023801+0000","last_change":"2024-04-25T09:08:17.015944+0000","last_active":"2024-04-25T09:08:17.023801+0000","last_peered":"2024-04-25T09:08:17.023801+0000","last_clean":"2024-04-25T09:08:17.023801+0000","last_became_active":"2024-04-25T09:08:17.015622+0000","last_became_peered":"2024-04-25T09:08:17.015622+0000","last_unstale":"2024-04-25T09:08:17.023801+0000","last_undegraded":"2024-04-25T09:08:17.023801+0000","last_fullsized":"2024-04-25T09:08:17.023801+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:10.507722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.015882+0000","last_change":"2024-04-25T09:08:17.015882+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.015882+0000","last_undegraded":"2024-04-25T09:08:17.015882+0000","last_fullsized":"2024-04-25T09:08:17.015882+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023081+0000","last_change":"2024-04-25T09:08:17.020849+0000","last_active":"2024-04-25T09:08:17.023081+0000","last_peered":"2024-04-25T09:08:17.023081+0000","last_clean":"2024-04-25T09:08:17.023081+0000","last_became_active":"2024-04-25T09:08:17.020389+0000","last_became_peered":"2024-04-25T09:08:17.020389+0000","last_unstale":"2024-04-25T09:08:17.023081+0000","last_undegraded":"2024-04-25T09:08:17.023081+0000","last_fullsized":"2024-04-25T09:08:17.023081+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:36.326769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006232+0000","last_change":"2024-04-25T09:08:17.006232+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006232+0000","last_undegraded":"2024-04-25T09:08:17.006232+0000","last_fullsized":"2024-04-25T09:08:17.006232+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026789+0000","last_change":"2024-04-25T09:08:17.021273+0000","last_active":"2024-04-25T09:08:17.026789+0000","last_peered":"2024-04-25T09:08:17.026789+0000","last_clean":"2024-04-25T09:08:17.026789+0000","last_became_active":"2024-04-25T09:08:17.020604+0000","last_became_peered":"2024-04-25T09:08:17.020604+0000","last_unstale":"2024-04-25T09:08:17.026789+0000","last_undegraded":"2024-04-25T09:08:17.026789+0000","last_fullsized":"2024-04-25T09:08:17.026789+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:06.708703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007226+0000","last_change":"2024-04-25T09:08:17.007226+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007226+0000","last_undegraded":"2024-04-25T09:08:17.007226+0000","last_fullsized":"2024-04-25T09:08:17.007226+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.030475+0000","last_change":"2024-04-25T09:08:17.020881+0000","last_active":"2024-04-25T09:08:17.030475+0000","last_peered":"2024-04-25T09:08:17.030475+0000","last_clean":"2024-04-25T09:08:17.030475+0000","last_became_active":"2024-04-25T09:08:17.020648+0000","last_became_peered":"2024-04-25T09:08:17.020648+0000","last_unstale":"2024-04-25T09:08:17.030475+0000","last_undegraded":"2024-04-25T09:08:17.030475+0000","last_fullsized":"2024-04-25T09:08:17.030475+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:34.954575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018250+0000","last_change":"2024-04-25T09:08:17.018250+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018250+0000","last_undegraded":"2024-04-25T09:08:17.018250+0000","last_fullsized":"2024-04-25T09:08:17.018250+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023940+0000","last_change":"2024-04-25T09:08:17.017234+0000","last_active":"2024-04-25T09:08:17.023940+0000","last_peered":"2024-04-25T09:08:17.023940+0000","last_clean":"2024-04-25T09:08:17.023940+0000","last_became_active":"2024-04-25T09:08:17.016932+0000","last_became_peered":"2024-04-25T09:08:17.016932+0000","last_unstale":"2024-04-25T09:08:17.023940+0000","last_undegraded":"2024-04-25T09:08:17.023940+0000","last_fullsized":"2024-04-25T09:08:17.023940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:21:00.689918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004833+0000","last_change":"2024-04-25T09:08:17.004833+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004833+0000","last_undegraded":"2024-04-25T09:08:17.004833+0000","last_fullsized":"2024-04-25T09:08:17.004833+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.028198+0000","last_change":"2024-04-25T09:08:17.027002+0000","last_active":"2024-04-25T09:08:17.028198+0000","last_peered":"2024-04-25T09:08:17.028198+0000","last_clean":"2024-04-25T09:08:17.028198+0000","last_became_active":"2024-04-25T09:08:17.026421+0000","last_became_peered":"2024-04-25T09:08:17.026421+0000","last_unstale":"2024-04-25T09:08:17.028198+0000","last_undegraded":"2024-04-25T09:08:17.028198+0000","last_fullsized":"2024-04-25T09:08:17.028198+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:52.586369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.012716+0000","last_change":"2024-04-25T09:08:17.012716+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.012716+0000","last_undegraded":"2024-04-25T09:08:17.012716+0000","last_fullsized":"2024-04-25T09:08:17.012716+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.018395+0000","last_change":"2024-04-25T09:08:17.011530+0000","last_active":"2024-04-25T09:08:17.018395+0000","last_peered":"2024-04-25T09:08:17.018395+0000","last_clean":"2024-04-25T09:08:17.018395+0000","last_became_active":"2024-04-25T09:08:17.011275+0000","last_became_peered":"2024-04-25T09:08:17.011275+0000","last_unstale":"2024-04-25T09:08:17.018395+0000","last_undegraded":"2024-04-25T09:08:17.018395+0000","last_fullsized":"2024-04-25T09:08:17.018395+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:16.028538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.018337+0000","last_change":"2024-04-25T09:08:17.018337+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.018337+0000","last_undegraded":"2024-04-25T09:08:17.018337+0000","last_fullsized":"2024-04-25T09:08:17.018337+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026530+0000","last_change":"2024-04-25T09:08:17.024819+0000","last_active":"2024-04-25T09:08:17.026530+0000","last_peered":"2024-04-25T09:08:17.026530+0000","last_clean":"2024-04-25T09:08:17.026530+0000","last_became_active":"2024-04-25T09:08:17.024388+0000","last_became_peered":"2024-04-25T09:08:17.024388+0000","last_unstale":"2024-04-25T09:08:17.026530+0000","last_undegraded":"2024-04-25T09:08:17.026530+0000","last_fullsized":"2024-04-25T09:08:17.026530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:20.348350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006894+0000","last_change":"2024-04-25T09:08:17.006894+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006894+0000","last_undegraded":"2024-04-25T09:08:17.006894+0000","last_fullsized":"2024-04-25T09:08:17.006894+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.029123+0000","last_change":"2024-04-25T09:08:17.023485+0000","last_active":"2024-04-25T09:08:17.029123+0000","last_peered":"2024-04-25T09:08:17.029123+0000","last_clean":"2024-04-25T09:08:17.029123+0000","last_became_active":"2024-04-25T09:08:17.022356+0000","last_became_peered":"2024-04-25T09:08:17.022356+0000","last_unstale":"2024-04-25T09:08:17.029123+0000","last_undegraded":"2024-04-25T09:08:17.029123+0000","last_fullsized":"2024-04-25T09:08:17.029123+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:49.163088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006039+0000","last_change":"2024-04-25T09:08:17.006039+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006039+0000","last_undegraded":"2024-04-25T09:08:17.006039+0000","last_fullsized":"2024-04-25T09:08:17.006039+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026949+0000","last_change":"2024-04-25T09:08:17.019898+0000","last_active":"2024-04-25T09:08:17.026949+0000","last_peered":"2024-04-25T09:08:17.026949+0000","last_clean":"2024-04-25T09:08:17.026949+0000","last_became_active":"2024-04-25T09:08:17.019593+0000","last_became_peered":"2024-04-25T09:08:17.019593+0000","last_unstale":"2024-04-25T09:08:17.026949+0000","last_undegraded":"2024-04-25T09:08:17.026949+0000","last_fullsized":"2024-04-25T09:08:17.026949+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:31.133503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006931+0000","last_change":"2024-04-25T09:08:17.006931+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006931+0000","last_undegraded":"2024-04-25T09:08:17.006931+0000","last_fullsized":"2024-04-25T09:08:17.006931+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033565+0000","last_change":"2024-04-25T09:08:17.028980+0000","last_active":"2024-04-25T09:08:17.033565+0000","last_peered":"2024-04-25T09:08:17.033565+0000","last_clean":"2024-04-25T09:08:17.033565+0000","last_became_active":"2024-04-25T09:08:17.026719+0000","last_became_peered":"2024-04-25T09:08:17.026719+0000","last_unstale":"2024-04-25T09:08:17.033565+0000","last_undegraded":"2024-04-25T09:08:17.033565+0000","last_fullsized":"2024-04-25T09:08:17.033565+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:54.808987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.011883+0000","last_change":"2024-04-25T09:08:17.011883+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.011883+0000","last_undegraded":"2024-04-25T09:08:17.011883+0000","last_fullsized":"2024-04-25T09:08:17.011883+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.024050+0000","last_change":"2024-04-25T09:08:17.021008+0000","last_active":"2024-04-25T09:08:17.024050+0000","last_peered":"2024-04-25T09:08:17.024050+0000","last_clean":"2024-04-25T09:08:17.024050+0000","last_became_active":"2024-04-25T09:08:17.020699+0000","last_became_peered":"2024-04-25T09:08:17.020699+0000","last_unstale":"2024-04-25T09:08:17.024050+0000","last_undegraded":"2024-04-25T09:08:17.024050+0000","last_fullsized":"2024-04-25T09:08:17.024050+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:10.660294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013082+0000","last_change":"2024-04-25T09:08:17.013082+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013082+0000","last_undegraded":"2024-04-25T09:08:17.013082+0000","last_fullsized":"2024-04-25T09:08:17.013082+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033530+0000","last_change":"2024-04-25T09:08:17.028655+0000","last_active":"2024-04-25T09:08:17.033530+0000","last_peered":"2024-04-25T09:08:17.033530+0000","last_clean":"2024-04-25T09:08:17.033530+0000","last_became_active":"2024-04-25T09:08:17.028383+0000","last_became_peered":"2024-04-25T09:08:17.028383+0000","last_unstale":"2024-04-25T09:08:17.033530+0000","last_undegraded":"2024-04-25T09:08:17.033530+0000","last_fullsized":"2024-04-25T09:08:17.033530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:23.297153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004492+0000","last_change":"2024-04-25T09:08:17.004492+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004492+0000","last_undegraded":"2024-04-25T09:08:17.004492+0000","last_fullsized":"2024-04-25T09:08:17.004492+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.031027+0000","last_change":"2024-04-25T09:08:17.027470+0000","last_active":"2024-04-25T09:08:17.031027+0000","last_peered":"2024-04-25T09:08:17.031027+0000","last_clean":"2024-04-25T09:08:17.031027+0000","last_became_active":"2024-04-25T09:08:17.027198+0000","last_became_peered":"2024-04-25T09:08:17.027198+0000","last_unstale":"2024-04-25T09:08:17.031027+0000","last_undegraded":"2024-04-25T09:08:17.031027+0000","last_fullsized":"2024-04-25T09:08:17.031027+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:02.688386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007577+0000","last_change":"2024-04-25T09:08:17.007577+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007577+0000","last_undegraded":"2024-04-25T09:08:17.007577+0000","last_fullsized":"2024-04-25T09:08:17.007577+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.036250+0000","last_change":"2024-04-25T09:08:17.031403+0000","last_active":"2024-04-25T09:08:17.036250+0000","last_peered":"2024-04-25T09:08:17.036250+0000","last_clean":"2024-04-25T09:08:17.036250+0000","last_became_active":"2024-04-25T09:08:17.031145+0000","last_became_peered":"2024-04-25T09:08:17.031145+0000","last_unstale":"2024-04-25T09:08:17.036250+0000","last_undegraded":"2024-04-25T09:08:17.036250+0000","last_fullsized":"2024-04-25T09:08:17.036250+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:17.838172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008528+0000","last_change":"2024-04-25T09:08:17.008528+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008528+0000","last_undegraded":"2024-04-25T09:08:17.008528+0000","last_fullsized":"2024-04-25T09:08:17.008528+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.023992+0000","last_change":"2024-04-25T09:08:17.015969+0000","last_active":"2024-04-25T09:08:17.023992+0000","last_peered":"2024-04-25T09:08:17.023992+0000","last_clean":"2024-04-25T09:08:17.023992+0000","last_became_active":"2024-04-25T09:08:17.015633+0000","last_became_peered":"2024-04-25T09:08:17.015633+0000","last_unstale":"2024-04-25T09:08:17.023992+0000","last_undegraded":"2024-04-25T09:08:17.023992+0000","last_fullsized":"2024-04-25T09:08:17.023992+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:30.776286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008759+0000","last_change":"2024-04-25T09:08:17.008759+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008759+0000","last_undegraded":"2024-04-25T09:08:17.008759+0000","last_fullsized":"2024-04-25T09:08:17.008759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.028086+0000","last_change":"2024-04-25T09:08:17.021971+0000","last_active":"2024-04-25T09:08:17.028086+0000","last_peered":"2024-04-25T09:08:17.028086+0000","last_clean":"2024-04-25T09:08:17.028086+0000","last_became_active":"2024-04-25T09:08:17.021372+0000","last_became_peered":"2024-04-25T09:08:17.021372+0000","last_unstale":"2024-04-25T09:08:17.028086+0000","last_undegraded":"2024-04-25T09:08:17.028086+0000","last_fullsized":"2024-04-25T09:08:17.028086+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:26.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.008064+0000","last_change":"2024-04-25T09:08:17.008064+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.008064+0000","last_undegraded":"2024-04-25T09:08:17.008064+0000","last_fullsized":"2024-04-25T09:08:17.008064+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.027593+0000","last_change":"2024-04-25T09:08:17.023926+0000","last_active":"2024-04-25T09:08:17.027593+0000","last_peered":"2024-04-25T09:08:17.027593+0000","last_clean":"2024-04-25T09:08:17.027593+0000","last_became_active":"2024-04-25T09:08:17.023662+0000","last_became_peered":"2024-04-25T09:08:17.023662+0000","last_unstale":"2024-04-25T09:08:17.027593+0000","last_undegraded":"2024-04-25T09:08:17.027593+0000","last_fullsized":"2024-04-25T09:08:17.027593+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:22.702984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009567+0000","last_change":"2024-04-25T09:08:17.009567+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009567+0000","last_undegraded":"2024-04-25T09:08:17.009567+0000","last_fullsized":"2024-04-25T09:08:17.009567+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.024033+0000","last_change":"2024-04-25T09:08:17.020129+0000","last_active":"2024-04-25T09:08:17.024033+0000","last_peered":"2024-04-25T09:08:17.024033+0000","last_clean":"2024-04-25T09:08:17.024033+0000","last_became_active":"2024-04-25T09:08:17.019765+0000","last_became_peered":"2024-04-25T09:08:17.019765+0000","last_unstale":"2024-04-25T09:08:17.024033+0000","last_undegraded":"2024-04-25T09:08:17.024033+0000","last_fullsized":"2024-04-25T09:08:17.024033+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:19.461337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.006618+0000","last_change":"2024-04-25T09:08:17.006618+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.006618+0000","last_undegraded":"2024-04-25T09:08:17.006618+0000","last_fullsized":"2024-04-25T09:08:17.006618+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026521+0000","last_change":"2024-04-25T09:08:17.018323+0000","last_active":"2024-04-25T09:08:17.026521+0000","last_peered":"2024-04-25T09:08:17.026521+0000","last_clean":"2024-04-25T09:08:17.026521+0000","last_became_active":"2024-04-25T09:08:17.018021+0000","last_became_peered":"2024-04-25T09:08:17.018021+0000","last_unstale":"2024-04-25T09:08:17.026521+0000","last_undegraded":"2024-04-25T09:08:17.026521+0000","last_fullsized":"2024-04-25T09:08:17.026521+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:22.702984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013067+0000","last_change":"2024-04-25T09:08:17.013067+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013067+0000","last_undegraded":"2024-04-25T09:08:17.013067+0000","last_fullsized":"2024-04-25T09:08:17.013067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.025141+0000","last_change":"2024-04-25T09:08:17.017852+0000","last_active":"2024-04-25T09:08:17.025141+0000","last_peered":"2024-04-25T09:08:17.025141+0000","last_clean":"2024-04-25T09:08:17.025141+0000","last_became_active":"2024-04-25T09:08:17.017430+0000","last_became_peered":"2024-04-25T09:08:17.017430+0000","last_unstale":"2024-04-25T09:08:17.025141+0000","last_undegraded":"2024-04-25T09:08:17.025141+0000","last_fullsized":"2024-04-25T09:08:17.025141+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:19.488485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.013585+0000","last_change":"2024-04-25T09:08:17.013585+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.013585+0000","last_undegraded":"2024-04-25T09:08:17.013585+0000","last_fullsized":"2024-04-25T09:08:17.013585+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.028222+0000","last_change":"2024-04-25T09:08:17.026372+0000","last_active":"2024-04-25T09:08:17.028222+0000","last_peered":"2024-04-25T09:08:17.028222+0000","last_clean":"2024-04-25T09:08:17.028222+0000","last_became_active":"2024-04-25T09:08:17.026102+0000","last_became_peered":"2024-04-25T09:08:17.026102+0000","last_unstale":"2024-04-25T09:08:17.028222+0000","last_undegraded":"2024-04-25T09:08:17.028222+0000","last_fullsized":"2024-04-25T09:08:17.028222+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:31.133503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007283+0000","last_change":"2024-04-25T09:08:17.007283+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007283+0000","last_undegraded":"2024-04-25T09:08:17.007283+0000","last_fullsized":"2024-04-25T09:08:17.007283+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.027476+0000","last_change":"2024-04-25T09:08:17.024952+0000","last_active":"2024-04-25T09:08:17.027476+0000","last_peered":"2024-04-25T09:08:17.027476+0000","last_clean":"2024-04-25T09:08:17.027476+0000","last_became_active":"2024-04-25T09:08:17.024696+0000","last_became_peered":"2024-04-25T09:08:17.024696+0000","last_unstale":"2024-04-25T09:08:17.027476+0000","last_undegraded":"2024-04-25T09:08:17.027476+0000","last_fullsized":"2024-04-25T09:08:17.027476+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:20.303509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.007882+0000","last_change":"2024-04-25T09:08:17.007882+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.007882+0000","last_undegraded":"2024-04-25T09:08:17.007882+0000","last_fullsized":"2024-04-25T09:08:17.007882+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.024423+0000","last_change":"2024-04-25T09:08:17.021898+0000","last_active":"2024-04-25T09:08:17.024423+0000","last_peered":"2024-04-25T09:08:17.024423+0000","last_clean":"2024-04-25T09:08:17.024423+0000","last_became_active":"2024-04-25T09:08:17.021584+0000","last_became_peered":"2024-04-25T09:08:17.021584+0000","last_unstale":"2024-04-25T09:08:17.024423+0000","last_undegraded":"2024-04-25T09:08:17.024423+0000","last_fullsized":"2024-04-25T09:08:17.024423+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:40.369073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.004497+0000","last_change":"2024-04-25T09:08:17.004497+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.004497+0000","last_undegraded":"2024-04-25T09:08:17.004497+0000","last_fullsized":"2024-04-25T09:08:17.004497+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.033347+0000","last_change":"2024-04-25T09:08:17.025380+0000","last_active":"2024-04-25T09:08:17.033347+0000","last_peered":"2024-04-25T09:08:17.033347+0000","last_clean":"2024-04-25T09:08:17.033347+0000","last_became_active":"2024-04-25T09:08:17.024963+0000","last_became_peered":"2024-04-25T09:08:17.024963+0000","last_unstale":"2024-04-25T09:08:17.033347+0000","last_undegraded":"2024-04-25T09:08:17.033347+0000","last_fullsized":"2024-04-25T09:08:17.033347+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:40.320274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.005040+0000","last_change":"2024-04-25T09:08:17.005040+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.005040+0000","last_undegraded":"2024-04-25T09:08:17.005040+0000","last_fullsized":"2024-04-25T09:08:17.005040+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026554+0000","last_change":"2024-04-25T09:08:17.022999+0000","last_active":"2024-04-25T09:08:17.026554+0000","last_peered":"2024-04-25T09:08:17.026554+0000","last_clean":"2024-04-25T09:08:17.026554+0000","last_became_active":"2024-04-25T09:08:17.022670+0000","last_became_peered":"2024-04-25T09:08:17.022670+0000","last_unstale":"2024-04-25T09:08:17.026554+0000","last_undegraded":"2024-04-25T09:08:17.026554+0000","last_fullsized":"2024-04-25T09:08:17.026554+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:23.008721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-04-25T09:08:17.009981+0000","last_change":"2024-04-25T09:08:17.009981+0000","last_active":"2024-04-25T09:08:16.991085+0000","last_peered":"2024-04-25T09:08:16.991085+0000","last_clean":"2024-04-25T09:08:16.991085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:08:17.009981+0000","last_undegraded":"2024-04-25T09:08:17.009981+0000","last_fullsized":"2024-04-25T09:08:17.009981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.026379+0000","last_change":"2024-04-25T09:08:17.023005+0000","last_active":"2024-04-25T09:08:17.026379+0000","last_peered":"2024-04-25T09:08:17.026379+0000","last_clean":"2024-04-25T09:08:17.026379+0000","last_became_active":"2024-04-25T09:08:17.022690+0000","last_became_peered":"2024-04-25T09:08:17.022690+0000","last_unstale":"2024-04-25T09:08:17.026379+0000","last_undegraded":"2024-04-25T09:08:17.026379+0000","last_fullsized":"2024-04-25T09:08:17.026379+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:37.550476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":257,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T09:08:17.020337+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:08:17.020337+0000","last_peered":"2024-04-25T09:08:17.020337+0000","last_clean":"2024-04-25T09:08:17.020337+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:08:17.020337+0000","last_undegraded":"2024-04-25T09:08:17.020337+0000","last_fullsized":"2024-04-25T09:08:17.020337+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1396736,"data_stored":923973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":339880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32556,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339284,"statfs":{"total":96636764160,"available":96603426816,"internally_reserved":0,"allocated":1409024,"data_stored":930248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:08:26.579 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:08:26.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.736+0000 7f904b600640 1 Processor -- start 2024-04-25T09:08:26.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.736+0000 7f904b600640 1 -- start start 2024-04-25T09:08:26.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.740+0000 7f904b600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f904415a900 0x7f904406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:26.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.740+0000 7f904b600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90440cd520 0x7f90440ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:26.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.740+0000 7f904b600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90440cda00 con 0x7f90440cf560 2024-04-25T09:08:26.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.740+0000 7f904b600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f904415bcf0 con 0x7f904415a900 2024-04-25T09:08:26.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.740+0000 7f904b600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90440cdce0 con 0x7f90440cd520 2024-04-25T09:08:26.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.740+0000 7f9048c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f904415a900 0x7f904406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:26.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.740+0000 7f9048c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f904415a900 0x7f904406e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:58686/0 (socket says 172.21.15.175:58686) 2024-04-25T09:08:26.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.740+0000 7f9048c00640 1 -- 172.21.15.175:0/4150927785 learned_addr learned my addr 172.21.15.175:0/4150927785 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:26.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.740+0000 7f903be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90440cd520 0x7f90440ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:26.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.740+0000 7f9048c00640 1 -- 172.21.15.175:0/4150927785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90440cd520 msgr2=0x7f90440ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:26.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.740+0000 7f9048c00640 1 --2- 172.21.15.175:0/4150927785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90440cd520 0x7f90440ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:26.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.740+0000 7f9048c00640 1 -- 172.21.15.175:0/4150927785 >> v1:172.21.15.177:6789/0 conn(0x7f90440cf560 legacy=0x7f904415bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:26.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.740+0000 7f9048c00640 1 -- 172.21.15.175:0/4150927785 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90440cdfc0 con 0x7f904415a900 2024-04-25T09:08:26.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.740+0000 7f903be00640 1 --2- 172.21.15.175:0/4150927785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90440cd520 0x7f90440ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:08:26.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.740+0000 7f9043e00640 1 -- 172.21.15.175:0/4150927785 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907971604 0 0) 0x7f90440cda00 con 0x7f90440cf560 2024-04-25T09:08:26.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.744+0000 7f9048c00640 1 --2- 172.21.15.175:0/4150927785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904415a900 0x7f904406e150 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9034009870 tx=0x7f903401c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea0499d2000eaee2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:26.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.744+0000 7f9043e00640 1 -- 172.21.15.175:0/4150927785 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90340ab640 con 0x7f904415a900 2024-04-25T09:08:26.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.744+0000 7f9043e00640 1 -- 172.21.15.175:0/4150927785 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90340b0070 con 0x7f904415a900 2024-04-25T09:08:26.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.744+0000 7f9043e00640 1 -- 172.21.15.175:0/4150927785 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90340aba00 con 0x7f904415a900 2024-04-25T09:08:26.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.744+0000 7f904b600640 1 -- 172.21.15.175:0/4150927785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904415a900 msgr2=0x7f904406e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:26.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.744+0000 7f904b600640 1 --2- 172.21.15.175:0/4150927785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904415a900 0x7f904406e150 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9034009870 tx=0x7f903401c530 comp rx=0 tx=0).stop 2024-04-25T09:08:26.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.744+0000 7f904b600640 1 -- 172.21.15.175:0/4150927785 shutdown_connections 2024-04-25T09:08:26.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.744+0000 7f904b600640 1 --2- 172.21.15.175:0/4150927785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90440cd520 0x7f90440ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:26.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.744+0000 7f904b600640 1 --2- 172.21.15.175:0/4150927785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f904415a900 0x7f904406e150 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:26.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.744+0000 7f904b600640 1 -- 172.21.15.175:0/4150927785 >> 172.21.15.175:0/4150927785 conn(0x7f9044067150 msgr2=0x7f904406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:26.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.744+0000 7f904b600640 1 -- 172.21.15.175:0/4150927785 shutdown_connections 2024-04-25T09:08:26.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.744+0000 7f904b600640 1 -- 172.21.15.175:0/4150927785 wait complete. 2024-04-25T09:08:26.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.744+0000 7f904b600640 1 Processor -- start 2024-04-25T09:08:26.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.744+0000 7f904b600640 1 -- start start 2024-04-25T09:08:26.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f904b600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90440cf560 0x7f90440adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:26.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f904b600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f904415a900 0x7f90440ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:26.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f904b600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9044153430 0x7f90441402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:26.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f904b600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90440cf160 con 0x7f90440cf560 2024-04-25T09:08:26.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f904b600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90440cefe0 con 0x7f9044153430 2024-04-25T09:08:26.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f904b600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904406d3b0 con 0x7f904415a900 2024-04-25T09:08:26.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f9048c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90440cf560 0x7f90440adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:26.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f9048c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90440cf560 0x7f90440adff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60754/0 (socket says 172.21.15.175:60754) 2024-04-25T09:08:26.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f9048c00640 1 -- 172.21.15.175:0/223345509 learned_addr learned my addr 172.21.15.175:0/223345509 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:26.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f903be00640 1 --2- 172.21.15.175:0/223345509 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f904415a900 0x7f90440ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:26.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f9049600640 1 --2- 172.21.15.175:0/223345509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9044153430 0x7f90441402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:26.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f9048c00640 1 -- 172.21.15.175:0/223345509 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f904415a900 msgr2=0x7f90440ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:26.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f9048c00640 1 --2- 172.21.15.175:0/223345509 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f904415a900 0x7f90440ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:26.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f9048c00640 1 -- 172.21.15.175:0/223345509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9044153430 msgr2=0x7f90441402a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:26.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f9048c00640 1 --2- 172.21.15.175:0/223345509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9044153430 0x7f90441402a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:26.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f9048c00640 1 -- 172.21.15.175:0/223345509 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90440cb770 con 0x7f90440cf560 2024-04-25T09:08:26.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f9048c00640 1 --2- 172.21.15.175:0/223345509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90440cf560 0x7f90440adff0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f903401a160 tx=0x7f903401ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:26.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f9041600640 1 -- 172.21.15.175:0/223345509 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90340be3f0 con 0x7f90440cf560 2024-04-25T09:08:26.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f9041600640 1 -- 172.21.15.175:0/223345509 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90340be5b0 con 0x7f90440cf560 2024-04-25T09:08:26.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f9041600640 1 -- 172.21.15.175:0/223345509 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90340be9a0 con 0x7f90440cf560 2024-04-25T09:08:26.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f904b600640 1 -- 172.21.15.175:0/223345509 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90441538b0 con 0x7f90440cf560 2024-04-25T09:08:26.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f904b600640 1 -- 172.21.15.175:0/223345509 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90440ad230 con 0x7f90440cf560 2024-04-25T09:08:26.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.748+0000 7f904b600640 1 -- 172.21.15.175:0/223345509 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9044074a60 con 0x7f90440cf560 2024-04-25T09:08:26.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.752+0000 7f9041600640 1 -- 172.21.15.175:0/223345509 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f90340b43f0 con 0x7f90440cf560 2024-04-25T09:08:26.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.752+0000 7f9041600640 1 --2- 172.21.15.175:0/223345509 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9020066f90 0x7f9020069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:26.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.752+0000 7f9041600640 1 -- 172.21.15.175:0/223345509 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f903411ee90 con 0x7f90440cf560 2024-04-25T09:08:26.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.752+0000 7f903be00640 1 --2- 172.21.15.175:0/223345509 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9020066f90 0x7f9020069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:26.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.752+0000 7f903be00640 1 --2- 172.21.15.175:0/223345509 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9020066f90 0x7f9020069450 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9044157030 tx=0x7f902c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:26.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.756+0000 7f9041600640 1 -- 172.21.15.175:0/223345509 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9034016150 con 0x7f90440cf560 2024-04-25T09:08:26.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.908+0000 7f904b600640 1 -- 172.21.15.175:0/223345509 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f90440cec70 con 0x7f9020066f90 2024-04-25T09:08:26.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.916+0000 7f9041600640 1 -- 172.21.15.175:0/223345509 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252069 (secure 0 0 0) 0x7f90440cec70 con 0x7f9020066f90 2024-04-25T09:08:26.907 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:26.908 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:08:26.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.920+0000 7f904b600640 1 -- 172.21.15.175:0/223345509 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9020066f90 msgr2=0x7f9020069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:26.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.920+0000 7f904b600640 1 --2- 172.21.15.175:0/223345509 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9020066f90 0x7f9020069450 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9044157030 tx=0x7f902c009190 comp rx=0 tx=0).stop 2024-04-25T09:08:26.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.920+0000 7f904b600640 1 -- 172.21.15.175:0/223345509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90440cf560 msgr2=0x7f90440adff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:26.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.920+0000 7f904b600640 1 --2- 172.21.15.175:0/223345509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90440cf560 0x7f90440adff0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f903401a160 tx=0x7f903401ad70 comp rx=0 tx=0).stop 2024-04-25T09:08:26.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.920+0000 7f904b600640 1 -- 172.21.15.175:0/223345509 shutdown_connections 2024-04-25T09:08:26.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.920+0000 7f904b600640 1 --2- 172.21.15.175:0/223345509 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9020066f90 0x7f9020069450 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:26.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.920+0000 7f904b600640 1 --2- 172.21.15.175:0/223345509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9044153430 0x7f90441402a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:26.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.920+0000 7f904b600640 1 --2- 172.21.15.175:0/223345509 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f904415a900 0x7f90440ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:26.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.920+0000 7f904b600640 1 --2- 172.21.15.175:0/223345509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90440cf560 0x7f90440adff0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:26.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.920+0000 7f904b600640 1 -- 172.21.15.175:0/223345509 >> 172.21.15.175:0/223345509 conn(0x7f90440cd520 msgr2=0x7f904406d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:26.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.920+0000 7f904b600640 1 -- 172.21.15.175:0/223345509 shutdown_connections 2024-04-25T09:08:26.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:26.920+0000 7f904b600640 1 -- 172.21.15.175:0/223345509 wait complete. 2024-04-25T09:08:26.928 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-04-25T09:08:25.847448+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240648,"kb_used_data":7784,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734072,"statfs":{"total":773094113280,"available":772847689728,"internally_reserved":0,"allocated":7970816,"data_stored":4009196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001724"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.115407+0000","last_change":"2024-04-25T09:08:18.024344+0000","last_active":"2024-04-25T09:08:19.115407+0000","last_peered":"2024-04-25T09:08:19.115407+0000","last_clean":"2024-04-25T09:08:19.115407+0000","last_became_active":"2024-04-25T09:08:18.024051+0000","last_became_peered":"2024-04-25T09:08:18.024051+0000","last_unstale":"2024-04-25T09:08:19.115407+0000","last_undegraded":"2024-04-25T09:08:19.115407+0000","last_fullsized":"2024-04-25T09:08:19.115407+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:34.831821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028267+0000","last_change":"2024-04-25T09:08:18.032270+0000","last_active":"2024-04-25T09:08:19.028267+0000","last_peered":"2024-04-25T09:08:19.028267+0000","last_clean":"2024-04-25T09:08:19.028267+0000","last_became_active":"2024-04-25T09:08:18.032005+0000","last_became_peered":"2024-04-25T09:08:18.032005+0000","last_unstale":"2024-04-25T09:08:19.028267+0000","last_undegraded":"2024-04-25T09:08:19.028267+0000","last_fullsized":"2024-04-25T09:08:19.028267+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:40:29.033755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.115286+0000","last_change":"2024-04-25T09:08:18.024814+0000","last_active":"2024-04-25T09:08:19.115286+0000","last_peered":"2024-04-25T09:08:19.115286+0000","last_clean":"2024-04-25T09:08:19.115286+0000","last_became_active":"2024-04-25T09:08:18.024452+0000","last_became_peered":"2024-04-25T09:08:18.024452+0000","last_unstale":"2024-04-25T09:08:19.115286+0000","last_undegraded":"2024-04-25T09:08:19.115286+0000","last_fullsized":"2024-04-25T09:08:19.115286+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:31:33.179104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.114543+0000","last_change":"2024-04-25T09:08:18.021493+0000","last_active":"2024-04-25T09:08:19.114543+0000","last_peered":"2024-04-25T09:08:19.114543+0000","last_clean":"2024-04-25T09:08:19.114543+0000","last_became_active":"2024-04-25T09:08:18.021224+0000","last_became_peered":"2024-04-25T09:08:18.021224+0000","last_unstale":"2024-04-25T09:08:19.114543+0000","last_undegraded":"2024-04-25T09:08:19.114543+0000","last_fullsized":"2024-04-25T09:08:19.114543+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:14.787054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.023705+0000","last_change":"2024-04-25T09:08:18.016979+0000","last_active":"2024-04-25T09:08:19.023705+0000","last_peered":"2024-04-25T09:08:19.023705+0000","last_clean":"2024-04-25T09:08:19.023705+0000","last_became_active":"2024-04-25T09:08:18.012964+0000","last_became_peered":"2024-04-25T09:08:18.012964+0000","last_unstale":"2024-04-25T09:08:19.023705+0000","last_undegraded":"2024-04-25T09:08:19.023705+0000","last_fullsized":"2024-04-25T09:08:19.023705+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:11.667683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028349+0000","last_change":"2024-04-25T09:08:18.031598+0000","last_active":"2024-04-25T09:08:19.028349+0000","last_peered":"2024-04-25T09:08:19.028349+0000","last_clean":"2024-04-25T09:08:19.028349+0000","last_became_active":"2024-04-25T09:08:18.030592+0000","last_became_peered":"2024-04-25T09:08:18.030592+0000","last_unstale":"2024-04-25T09:08:19.028349+0000","last_undegraded":"2024-04-25T09:08:19.028349+0000","last_fullsized":"2024-04-25T09:08:19.028349+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:05.780894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.034005+0000","last_change":"2024-04-25T09:08:18.026437+0000","last_active":"2024-04-25T09:08:19.034005+0000","last_peered":"2024-04-25T09:08:19.034005+0000","last_clean":"2024-04-25T09:08:19.034005+0000","last_became_active":"2024-04-25T09:08:18.026134+0000","last_became_peered":"2024-04-25T09:08:18.026134+0000","last_unstale":"2024-04-25T09:08:19.034005+0000","last_undegraded":"2024-04-25T09:08:19.034005+0000","last_fullsized":"2024-04-25T09:08:19.034005+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:10:35.102758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.027823+0000","last_change":"2024-04-25T09:08:18.016229+0000","last_active":"2024-04-25T09:08:19.027823+0000","last_peered":"2024-04-25T09:08:19.027823+0000","last_clean":"2024-04-25T09:08:19.027823+0000","last_became_active":"2024-04-25T09:08:18.015953+0000","last_became_peered":"2024-04-25T09:08:18.015953+0000","last_unstale":"2024-04-25T09:08:19.027823+0000","last_undegraded":"2024-04-25T09:08:19.027823+0000","last_fullsized":"2024-04-25T09:08:19.027823+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:14.787054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.024118+0000","last_change":"2024-04-25T09:08:18.025579+0000","last_active":"2024-04-25T09:08:19.024118+0000","last_peered":"2024-04-25T09:08:19.024118+0000","last_clean":"2024-04-25T09:08:19.024118+0000","last_became_active":"2024-04-25T09:08:18.025272+0000","last_became_peered":"2024-04-25T09:08:18.025272+0000","last_unstale":"2024-04-25T09:08:19.024118+0000","last_undegraded":"2024-04-25T09:08:19.024118+0000","last_fullsized":"2024-04-25T09:08:19.024118+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:12:36.423503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.029098+0000","last_change":"2024-04-25T09:08:18.029273+0000","last_active":"2024-04-25T09:08:19.029098+0000","last_peered":"2024-04-25T09:08:19.029098+0000","last_clean":"2024-04-25T09:08:19.029098+0000","last_became_active":"2024-04-25T09:08:18.028928+0000","last_became_peered":"2024-04-25T09:08:18.028928+0000","last_unstale":"2024-04-25T09:08:19.029098+0000","last_undegraded":"2024-04-25T09:08:19.029098+0000","last_fullsized":"2024-04-25T09:08:19.029098+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:33.160445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.115230+0000","last_change":"2024-04-25T09:08:18.029099+0000","last_active":"2024-04-25T09:08:19.115230+0000","last_peered":"2024-04-25T09:08:19.115230+0000","last_clean":"2024-04-25T09:08:19.115230+0000","last_became_active":"2024-04-25T09:08:18.025046+0000","last_became_peered":"2024-04-25T09:08:18.025046+0000","last_unstale":"2024-04-25T09:08:19.115230+0000","last_undegraded":"2024-04-25T09:08:19.115230+0000","last_fullsized":"2024-04-25T09:08:19.115230+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:37.035832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.114681+0000","last_change":"2024-04-25T09:08:18.019203+0000","last_active":"2024-04-25T09:08:19.114681+0000","last_peered":"2024-04-25T09:08:19.114681+0000","last_clean":"2024-04-25T09:08:19.114681+0000","last_became_active":"2024-04-25T09:08:18.018956+0000","last_became_peered":"2024-04-25T09:08:18.018956+0000","last_unstale":"2024-04-25T09:08:19.114681+0000","last_undegraded":"2024-04-25T09:08:19.114681+0000","last_fullsized":"2024-04-25T09:08:19.114681+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:40.409667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.038681+0000","last_change":"2024-04-25T09:08:18.020888+0000","last_active":"2024-04-25T09:08:19.038681+0000","last_peered":"2024-04-25T09:08:19.038681+0000","last_clean":"2024-04-25T09:08:19.038681+0000","last_became_active":"2024-04-25T09:08:18.020639+0000","last_became_peered":"2024-04-25T09:08:18.020639+0000","last_unstale":"2024-04-25T09:08:19.038681+0000","last_undegraded":"2024-04-25T09:08:19.038681+0000","last_fullsized":"2024-04-25T09:08:19.038681+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:24.664905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.023828+0000","last_change":"2024-04-25T09:08:18.028088+0000","last_active":"2024-04-25T09:08:19.023828+0000","last_peered":"2024-04-25T09:08:19.023828+0000","last_clean":"2024-04-25T09:08:19.023828+0000","last_became_active":"2024-04-25T09:08:18.027595+0000","last_became_peered":"2024-04-25T09:08:18.027595+0000","last_unstale":"2024-04-25T09:08:19.023828+0000","last_undegraded":"2024-04-25T09:08:19.023828+0000","last_fullsized":"2024-04-25T09:08:19.023828+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:50.540939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.038630+0000","last_change":"2024-04-25T09:08:18.016483+0000","last_active":"2024-04-25T09:08:19.038630+0000","last_peered":"2024-04-25T09:08:19.038630+0000","last_clean":"2024-04-25T09:08:19.038630+0000","last_became_active":"2024-04-25T09:08:18.016215+0000","last_became_peered":"2024-04-25T09:08:18.016215+0000","last_unstale":"2024-04-25T09:08:19.038630+0000","last_undegraded":"2024-04-25T09:08:19.038630+0000","last_fullsized":"2024-04-25T09:08:19.038630+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:25.740611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.027118+0000","last_change":"2024-04-25T09:08:18.033473+0000","last_active":"2024-04-25T09:08:19.027118+0000","last_peered":"2024-04-25T09:08:19.027118+0000","last_clean":"2024-04-25T09:08:19.027118+0000","last_became_active":"2024-04-25T09:08:18.028133+0000","last_became_peered":"2024-04-25T09:08:18.028133+0000","last_unstale":"2024-04-25T09:08:19.027118+0000","last_undegraded":"2024-04-25T09:08:19.027118+0000","last_fullsized":"2024-04-25T09:08:19.027118+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:18.845561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.024091+0000","last_change":"2024-04-25T09:08:18.022151+0000","last_active":"2024-04-25T09:08:19.024091+0000","last_peered":"2024-04-25T09:08:19.024091+0000","last_clean":"2024-04-25T09:08:19.024091+0000","last_became_active":"2024-04-25T09:08:18.021847+0000","last_became_peered":"2024-04-25T09:08:18.021847+0000","last_unstale":"2024-04-25T09:08:19.024091+0000","last_undegraded":"2024-04-25T09:08:19.024091+0000","last_fullsized":"2024-04-25T09:08:19.024091+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:46.786843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.115050+0000","last_change":"2024-04-25T09:08:18.022439+0000","last_active":"2024-04-25T09:08:19.115050+0000","last_peered":"2024-04-25T09:08:19.115050+0000","last_clean":"2024-04-25T09:08:19.115050+0000","last_became_active":"2024-04-25T09:08:18.022149+0000","last_became_peered":"2024-04-25T09:08:18.022149+0000","last_unstale":"2024-04-25T09:08:19.115050+0000","last_undegraded":"2024-04-25T09:08:19.115050+0000","last_fullsized":"2024-04-25T09:08:19.115050+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:40:29.033755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028327+0000","last_change":"2024-04-25T09:08:18.018982+0000","last_active":"2024-04-25T09:08:19.028327+0000","last_peered":"2024-04-25T09:08:19.028327+0000","last_clean":"2024-04-25T09:08:19.028327+0000","last_became_active":"2024-04-25T09:08:18.018678+0000","last_became_peered":"2024-04-25T09:08:18.018678+0000","last_unstale":"2024-04-25T09:08:19.028327+0000","last_undegraded":"2024-04-25T09:08:19.028327+0000","last_fullsized":"2024-04-25T09:08:19.028327+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:25.115888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.038683+0000","last_change":"2024-04-25T09:08:18.032722+0000","last_active":"2024-04-25T09:08:19.038683+0000","last_peered":"2024-04-25T09:08:19.038683+0000","last_clean":"2024-04-25T09:08:19.038683+0000","last_became_active":"2024-04-25T09:08:18.032413+0000","last_became_peered":"2024-04-25T09:08:18.032413+0000","last_unstale":"2024-04-25T09:08:19.038683+0000","last_undegraded":"2024-04-25T09:08:19.038683+0000","last_fullsized":"2024-04-25T09:08:19.038683+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:10:35.102758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028661+0000","last_change":"2024-04-25T09:08:18.032628+0000","last_active":"2024-04-25T09:08:19.028661+0000","last_peered":"2024-04-25T09:08:19.028661+0000","last_clean":"2024-04-25T09:08:19.028661+0000","last_became_active":"2024-04-25T09:08:18.030109+0000","last_became_peered":"2024-04-25T09:08:18.030109+0000","last_unstale":"2024-04-25T09:08:19.028661+0000","last_undegraded":"2024-04-25T09:08:19.028661+0000","last_fullsized":"2024-04-25T09:08:19.028661+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:16.322161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.027529+0000","last_change":"2024-04-25T09:08:18.032944+0000","last_active":"2024-04-25T09:08:19.027529+0000","last_peered":"2024-04-25T09:08:19.027529+0000","last_clean":"2024-04-25T09:08:19.027529+0000","last_became_active":"2024-04-25T09:08:18.031238+0000","last_became_peered":"2024-04-25T09:08:18.031238+0000","last_unstale":"2024-04-25T09:08:19.027529+0000","last_undegraded":"2024-04-25T09:08:19.027529+0000","last_fullsized":"2024-04-25T09:08:19.027529+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:37:57.143410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.115008+0000","last_change":"2024-04-25T09:08:18.029240+0000","last_active":"2024-04-25T09:08:19.115008+0000","last_peered":"2024-04-25T09:08:19.115008+0000","last_clean":"2024-04-25T09:08:19.115008+0000","last_became_active":"2024-04-25T09:08:18.028978+0000","last_became_peered":"2024-04-25T09:08:18.028978+0000","last_unstale":"2024-04-25T09:08:19.115008+0000","last_undegraded":"2024-04-25T09:08:19.115008+0000","last_fullsized":"2024-04-25T09:08:19.115008+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:38.264626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.114976+0000","last_change":"2024-04-25T09:08:18.024876+0000","last_active":"2024-04-25T09:08:19.114976+0000","last_peered":"2024-04-25T09:08:19.114976+0000","last_clean":"2024-04-25T09:08:19.114976+0000","last_became_active":"2024-04-25T09:08:18.024589+0000","last_became_peered":"2024-04-25T09:08:18.024589+0000","last_unstale":"2024-04-25T09:08:19.114976+0000","last_undegraded":"2024-04-25T09:08:19.114976+0000","last_fullsized":"2024-04-25T09:08:19.114976+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:52.024945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028874+0000","last_change":"2024-04-25T09:08:18.035892+0000","last_active":"2024-04-25T09:08:19.028874+0000","last_peered":"2024-04-25T09:08:19.028874+0000","last_clean":"2024-04-25T09:08:19.028874+0000","last_became_active":"2024-04-25T09:08:18.035610+0000","last_became_peered":"2024-04-25T09:08:18.035610+0000","last_unstale":"2024-04-25T09:08:19.028874+0000","last_undegraded":"2024-04-25T09:08:19.028874+0000","last_fullsized":"2024-04-25T09:08:19.028874+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:10:30.693264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.034261+0000","last_change":"2024-04-25T09:08:18.035440+0000","last_active":"2024-04-25T09:08:19.034261+0000","last_peered":"2024-04-25T09:08:19.034261+0000","last_clean":"2024-04-25T09:08:19.034261+0000","last_became_active":"2024-04-25T09:08:18.035191+0000","last_became_peered":"2024-04-25T09:08:18.035191+0000","last_unstale":"2024-04-25T09:08:19.034261+0000","last_undegraded":"2024-04-25T09:08:19.034261+0000","last_fullsized":"2024-04-25T09:08:19.034261+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:52.024945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.115364+0000","last_change":"2024-04-25T09:08:18.018319+0000","last_active":"2024-04-25T09:08:19.115364+0000","last_peered":"2024-04-25T09:08:19.115364+0000","last_clean":"2024-04-25T09:08:19.115364+0000","last_became_active":"2024-04-25T09:08:18.018065+0000","last_became_peered":"2024-04-25T09:08:18.018065+0000","last_unstale":"2024-04-25T09:08:19.115364+0000","last_undegraded":"2024-04-25T09:08:19.115364+0000","last_fullsized":"2024-04-25T09:08:19.115364+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:27.244746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028745+0000","last_change":"2024-04-25T09:08:18.029522+0000","last_active":"2024-04-25T09:08:19.028745+0000","last_peered":"2024-04-25T09:08:19.028745+0000","last_clean":"2024-04-25T09:08:19.028745+0000","last_became_active":"2024-04-25T09:08:18.029220+0000","last_became_peered":"2024-04-25T09:08:18.029220+0000","last_unstale":"2024-04-25T09:08:19.028745+0000","last_undegraded":"2024-04-25T09:08:19.028745+0000","last_fullsized":"2024-04-25T09:08:19.028745+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:27.694885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.114631+0000","last_change":"2024-04-25T09:08:18.035855+0000","last_active":"2024-04-25T09:08:19.114631+0000","last_peered":"2024-04-25T09:08:19.114631+0000","last_clean":"2024-04-25T09:08:19.114631+0000","last_became_active":"2024-04-25T09:08:18.035468+0000","last_became_peered":"2024-04-25T09:08:18.035468+0000","last_unstale":"2024-04-25T09:08:19.114631+0000","last_undegraded":"2024-04-25T09:08:19.114631+0000","last_fullsized":"2024-04-25T09:08:19.114631+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:35:22.467568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.034182+0000","last_change":"2024-04-25T09:08:18.033702+0000","last_active":"2024-04-25T09:08:19.034182+0000","last_peered":"2024-04-25T09:08:19.034182+0000","last_clean":"2024-04-25T09:08:19.034182+0000","last_became_active":"2024-04-25T09:08:18.033391+0000","last_became_peered":"2024-04-25T09:08:18.033391+0000","last_unstale":"2024-04-25T09:08:19.034182+0000","last_undegraded":"2024-04-25T09:08:19.034182+0000","last_fullsized":"2024-04-25T09:08:19.034182+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:24.664905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.034389+0000","last_change":"2024-04-25T09:08:18.030851+0000","last_active":"2024-04-25T09:08:19.034389+0000","last_peered":"2024-04-25T09:08:19.034389+0000","last_clean":"2024-04-25T09:08:19.034389+0000","last_became_active":"2024-04-25T09:08:18.030577+0000","last_became_peered":"2024-04-25T09:08:18.030577+0000","last_unstale":"2024-04-25T09:08:19.034389+0000","last_undegraded":"2024-04-25T09:08:19.034389+0000","last_fullsized":"2024-04-25T09:08:19.034389+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:38.264626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028590+0000","last_change":"2024-04-25T09:08:18.022609+0000","last_active":"2024-04-25T09:08:19.028590+0000","last_peered":"2024-04-25T09:08:19.028590+0000","last_clean":"2024-04-25T09:08:19.028590+0000","last_became_active":"2024-04-25T09:08:18.021173+0000","last_became_peered":"2024-04-25T09:08:18.021173+0000","last_unstale":"2024-04-25T09:08:19.028590+0000","last_undegraded":"2024-04-25T09:08:19.028590+0000","last_fullsized":"2024-04-25T09:08:19.028590+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:23.710373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.115449+0000","last_change":"2024-04-25T09:08:18.020744+0000","last_active":"2024-04-25T09:08:19.115449+0000","last_peered":"2024-04-25T09:08:19.115449+0000","last_clean":"2024-04-25T09:08:19.115449+0000","last_became_active":"2024-04-25T09:08:18.020462+0000","last_became_peered":"2024-04-25T09:08:18.020462+0000","last_unstale":"2024-04-25T09:08:19.115449+0000","last_undegraded":"2024-04-25T09:08:19.115449+0000","last_fullsized":"2024-04-25T09:08:19.115449+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:30.577764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"68'4","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.115585+0000","last_change":"2024-04-25T09:08:17.029200+0000","last_active":"2024-04-25T09:08:19.115585+0000","last_peered":"2024-04-25T09:08:19.115585+0000","last_clean":"2024-04-25T09:08:19.115585+0000","last_became_active":"2024-04-25T09:08:17.028890+0000","last_became_peered":"2024-04-25T09:08:17.028890+0000","last_unstale":"2024-04-25T09:08:19.115585+0000","last_undegraded":"2024-04-25T09:08:19.115585+0000","last_fullsized":"2024-04-25T09:08:19.115585+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:26.687496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.024171+0000","last_change":"2024-04-25T09:08:18.015308+0000","last_active":"2024-04-25T09:08:19.024171+0000","last_peered":"2024-04-25T09:08:19.024171+0000","last_clean":"2024-04-25T09:08:19.024171+0000","last_became_active":"2024-04-25T09:08:18.015050+0000","last_became_peered":"2024-04-25T09:08:18.015050+0000","last_unstale":"2024-04-25T09:08:19.024171+0000","last_undegraded":"2024-04-25T09:08:19.024171+0000","last_fullsized":"2024-04-25T09:08:19.024171+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:25.840389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.038804+0000","last_change":"2024-04-25T09:08:17.022928+0000","last_active":"2024-04-25T09:08:19.038804+0000","last_peered":"2024-04-25T09:08:19.038804+0000","last_clean":"2024-04-25T09:08:19.038804+0000","last_became_active":"2024-04-25T09:08:17.022408+0000","last_became_peered":"2024-04-25T09:08:17.022408+0000","last_unstale":"2024-04-25T09:08:19.038804+0000","last_undegraded":"2024-04-25T09:08:19.038804+0000","last_fullsized":"2024-04-25T09:08:19.038804+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:55.882355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.027946+0000","last_change":"2024-04-25T09:08:18.019745+0000","last_active":"2024-04-25T09:08:19.027946+0000","last_peered":"2024-04-25T09:08:19.027946+0000","last_clean":"2024-04-25T09:08:19.027946+0000","last_became_active":"2024-04-25T09:08:18.019471+0000","last_became_peered":"2024-04-25T09:08:18.019471+0000","last_unstale":"2024-04-25T09:08:19.027946+0000","last_undegraded":"2024-04-25T09:08:19.027946+0000","last_fullsized":"2024-04-25T09:08:19.027946+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:40.409667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028896+0000","last_change":"2024-04-25T09:08:17.026541+0000","last_active":"2024-04-25T09:08:19.028896+0000","last_peered":"2024-04-25T09:08:19.028896+0000","last_clean":"2024-04-25T09:08:19.028896+0000","last_became_active":"2024-04-25T09:08:17.026241+0000","last_became_peered":"2024-04-25T09:08:17.026241+0000","last_unstale":"2024-04-25T09:08:19.028896+0000","last_undegraded":"2024-04-25T09:08:19.028896+0000","last_fullsized":"2024-04-25T09:08:19.028896+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:00.994604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.115366+0000","last_change":"2024-04-25T09:08:18.017594+0000","last_active":"2024-04-25T09:08:19.115366+0000","last_peered":"2024-04-25T09:08:19.115366+0000","last_clean":"2024-04-25T09:08:19.115366+0000","last_became_active":"2024-04-25T09:08:18.017233+0000","last_became_peered":"2024-04-25T09:08:18.017233+0000","last_unstale":"2024-04-25T09:08:19.115366+0000","last_undegraded":"2024-04-25T09:08:19.115366+0000","last_fullsized":"2024-04-25T09:08:19.115366+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:30.407502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028337+0000","last_change":"2024-04-25T09:08:17.017059+0000","last_active":"2024-04-25T09:08:19.028337+0000","last_peered":"2024-04-25T09:08:19.028337+0000","last_clean":"2024-04-25T09:08:19.028337+0000","last_became_active":"2024-04-25T09:08:17.016731+0000","last_became_peered":"2024-04-25T09:08:17.016731+0000","last_unstale":"2024-04-25T09:08:19.028337+0000","last_undegraded":"2024-04-25T09:08:19.028337+0000","last_fullsized":"2024-04-25T09:08:19.028337+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:16.028538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.034199+0000","last_change":"2024-04-25T09:08:18.027967+0000","last_active":"2024-04-25T09:08:19.034199+0000","last_peered":"2024-04-25T09:08:19.034199+0000","last_clean":"2024-04-25T09:08:19.034199+0000","last_became_active":"2024-04-25T09:08:18.027705+0000","last_became_peered":"2024-04-25T09:08:18.027705+0000","last_unstale":"2024-04-25T09:08:19.034199+0000","last_undegraded":"2024-04-25T09:08:19.034199+0000","last_fullsized":"2024-04-25T09:08:19.034199+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:44.711489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.114872+0000","last_change":"2024-04-25T09:08:17.026572+0000","last_active":"2024-04-25T09:08:19.114872+0000","last_peered":"2024-04-25T09:08:19.114872+0000","last_clean":"2024-04-25T09:08:19.114872+0000","last_became_active":"2024-04-25T09:08:17.026303+0000","last_became_peered":"2024-04-25T09:08:17.026303+0000","last_unstale":"2024-04-25T09:08:19.114872+0000","last_undegraded":"2024-04-25T09:08:19.114872+0000","last_fullsized":"2024-04-25T09:08:19.114872+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:52.844984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.029441+0000","last_change":"2024-04-25T09:08:18.028758+0000","last_active":"2024-04-25T09:08:19.029441+0000","last_peered":"2024-04-25T09:08:19.029441+0000","last_clean":"2024-04-25T09:08:19.029441+0000","last_became_active":"2024-04-25T09:08:18.025924+0000","last_became_peered":"2024-04-25T09:08:18.025924+0000","last_unstale":"2024-04-25T09:08:19.029441+0000","last_undegraded":"2024-04-25T09:08:19.029441+0000","last_fullsized":"2024-04-25T09:08:19.029441+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:30.738105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028454+0000","last_change":"2024-04-25T09:08:17.015944+0000","last_active":"2024-04-25T09:08:19.028454+0000","last_peered":"2024-04-25T09:08:19.028454+0000","last_clean":"2024-04-25T09:08:19.028454+0000","last_became_active":"2024-04-25T09:08:17.015622+0000","last_became_peered":"2024-04-25T09:08:17.015622+0000","last_unstale":"2024-04-25T09:08:19.028454+0000","last_undegraded":"2024-04-25T09:08:19.028454+0000","last_fullsized":"2024-04-25T09:08:19.028454+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:12:35.416114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.023515+0000","last_change":"2024-04-25T09:08:18.028365+0000","last_active":"2024-04-25T09:08:19.023515+0000","last_peered":"2024-04-25T09:08:19.023515+0000","last_clean":"2024-04-25T09:08:19.023515+0000","last_became_active":"2024-04-25T09:08:18.028111+0000","last_became_peered":"2024-04-25T09:08:18.028111+0000","last_unstale":"2024-04-25T09:08:19.023515+0000","last_undegraded":"2024-04-25T09:08:19.023515+0000","last_fullsized":"2024-04-25T09:08:19.023515+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:20.468726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.114469+0000","last_change":"2024-04-25T09:08:17.020849+0000","last_active":"2024-04-25T09:08:19.114469+0000","last_peered":"2024-04-25T09:08:19.114469+0000","last_clean":"2024-04-25T09:08:19.114469+0000","last_became_active":"2024-04-25T09:08:17.020389+0000","last_became_peered":"2024-04-25T09:08:17.020389+0000","last_unstale":"2024-04-25T09:08:19.114469+0000","last_undegraded":"2024-04-25T09:08:19.114469+0000","last_fullsized":"2024-04-25T09:08:19.114469+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:16.176102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.038611+0000","last_change":"2024-04-25T09:08:18.019395+0000","last_active":"2024-04-25T09:08:19.038611+0000","last_peered":"2024-04-25T09:08:19.038611+0000","last_clean":"2024-04-25T09:08:19.038611+0000","last_became_active":"2024-04-25T09:08:18.019144+0000","last_became_peered":"2024-04-25T09:08:18.019144+0000","last_unstale":"2024-04-25T09:08:19.038611+0000","last_undegraded":"2024-04-25T09:08:19.038611+0000","last_fullsized":"2024-04-25T09:08:19.038611+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:53.503538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.023523+0000","last_change":"2024-04-25T09:08:17.021273+0000","last_active":"2024-04-25T09:08:19.023523+0000","last_peered":"2024-04-25T09:08:19.023523+0000","last_clean":"2024-04-25T09:08:19.023523+0000","last_became_active":"2024-04-25T09:08:17.020604+0000","last_became_peered":"2024-04-25T09:08:17.020604+0000","last_unstale":"2024-04-25T09:08:19.023523+0000","last_undegraded":"2024-04-25T09:08:19.023523+0000","last_fullsized":"2024-04-25T09:08:19.023523+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:10.569198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.034397+0000","last_change":"2024-04-25T09:08:18.034289+0000","last_active":"2024-04-25T09:08:19.034397+0000","last_peered":"2024-04-25T09:08:19.034397+0000","last_clean":"2024-04-25T09:08:19.034397+0000","last_became_active":"2024-04-25T09:08:18.034048+0000","last_became_peered":"2024-04-25T09:08:18.034048+0000","last_unstale":"2024-04-25T09:08:19.034397+0000","last_undegraded":"2024-04-25T09:08:19.034397+0000","last_fullsized":"2024-04-25T09:08:19.034397+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:59.887924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028902+0000","last_change":"2024-04-25T09:08:17.020881+0000","last_active":"2024-04-25T09:08:19.028902+0000","last_peered":"2024-04-25T09:08:19.028902+0000","last_clean":"2024-04-25T09:08:19.028902+0000","last_became_active":"2024-04-25T09:08:17.020648+0000","last_became_peered":"2024-04-25T09:08:17.020648+0000","last_unstale":"2024-04-25T09:08:19.028902+0000","last_undegraded":"2024-04-25T09:08:19.028902+0000","last_fullsized":"2024-04-25T09:08:19.028902+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:46.503295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.115507+0000","last_change":"2024-04-25T09:08:18.023725+0000","last_active":"2024-04-25T09:08:19.115507+0000","last_peered":"2024-04-25T09:08:19.115507+0000","last_clean":"2024-04-25T09:08:19.115507+0000","last_became_active":"2024-04-25T09:08:18.023352+0000","last_became_peered":"2024-04-25T09:08:18.023352+0000","last_unstale":"2024-04-25T09:08:19.115507+0000","last_undegraded":"2024-04-25T09:08:19.115507+0000","last_fullsized":"2024-04-25T09:08:19.115507+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:15.719650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028380+0000","last_change":"2024-04-25T09:08:17.017234+0000","last_active":"2024-04-25T09:08:19.028380+0000","last_peered":"2024-04-25T09:08:19.028380+0000","last_clean":"2024-04-25T09:08:19.028380+0000","last_became_active":"2024-04-25T09:08:17.016932+0000","last_became_peered":"2024-04-25T09:08:17.016932+0000","last_unstale":"2024-04-25T09:08:19.028380+0000","last_undegraded":"2024-04-25T09:08:19.028380+0000","last_fullsized":"2024-04-25T09:08:19.028380+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:20.348350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028233+0000","last_change":"2024-04-25T09:08:18.032538+0000","last_active":"2024-04-25T09:08:19.028233+0000","last_peered":"2024-04-25T09:08:19.028233+0000","last_clean":"2024-04-25T09:08:19.028233+0000","last_became_active":"2024-04-25T09:08:18.032266+0000","last_became_peered":"2024-04-25T09:08:18.032266+0000","last_unstale":"2024-04-25T09:08:19.028233+0000","last_undegraded":"2024-04-25T09:08:19.028233+0000","last_fullsized":"2024-04-25T09:08:19.028233+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:02.303253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.115353+0000","last_change":"2024-04-25T09:08:17.027002+0000","last_active":"2024-04-25T09:08:19.115353+0000","last_peered":"2024-04-25T09:08:19.115353+0000","last_clean":"2024-04-25T09:08:19.115353+0000","last_became_active":"2024-04-25T09:08:17.026421+0000","last_became_peered":"2024-04-25T09:08:17.026421+0000","last_unstale":"2024-04-25T09:08:19.115353+0000","last_undegraded":"2024-04-25T09:08:19.115353+0000","last_fullsized":"2024-04-25T09:08:19.115353+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:13.858656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.023875+0000","last_change":"2024-04-25T09:08:18.018636+0000","last_active":"2024-04-25T09:08:19.023875+0000","last_peered":"2024-04-25T09:08:19.023875+0000","last_clean":"2024-04-25T09:08:19.023875+0000","last_became_active":"2024-04-25T09:08:18.018359+0000","last_became_peered":"2024-04-25T09:08:18.018359+0000","last_unstale":"2024-04-25T09:08:19.023875+0000","last_undegraded":"2024-04-25T09:08:19.023875+0000","last_fullsized":"2024-04-25T09:08:19.023875+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:38.557864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"68'6","reported_seq":20,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.114922+0000","last_change":"2024-04-25T09:08:17.011530+0000","last_active":"2024-04-25T09:08:19.114922+0000","last_peered":"2024-04-25T09:08:19.114922+0000","last_clean":"2024-04-25T09:08:19.114922+0000","last_became_active":"2024-04-25T09:08:17.011275+0000","last_became_peered":"2024-04-25T09:08:17.011275+0000","last_unstale":"2024-04-25T09:08:19.114922+0000","last_undegraded":"2024-04-25T09:08:19.114922+0000","last_fullsized":"2024-04-25T09:08:19.114922+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:47.145083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.115190+0000","last_change":"2024-04-25T09:08:18.024578+0000","last_active":"2024-04-25T09:08:19.115190+0000","last_peered":"2024-04-25T09:08:19.115190+0000","last_clean":"2024-04-25T09:08:19.115190+0000","last_became_active":"2024-04-25T09:08:18.024295+0000","last_became_peered":"2024-04-25T09:08:18.024295+0000","last_unstale":"2024-04-25T09:08:19.115190+0000","last_undegraded":"2024-04-25T09:08:19.115190+0000","last_fullsized":"2024-04-25T09:08:19.115190+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:00:59.887924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.114548+0000","last_change":"2024-04-25T09:08:17.024819+0000","last_active":"2024-04-25T09:08:19.114548+0000","last_peered":"2024-04-25T09:08:19.114548+0000","last_clean":"2024-04-25T09:08:19.114548+0000","last_became_active":"2024-04-25T09:08:17.024388+0000","last_became_peered":"2024-04-25T09:08:17.024388+0000","last_unstale":"2024-04-25T09:08:19.114548+0000","last_undegraded":"2024-04-25T09:08:19.114548+0000","last_fullsized":"2024-04-25T09:08:19.114548+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:34.954575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.034213+0000","last_change":"2024-04-25T09:08:18.037019+0000","last_active":"2024-04-25T09:08:19.034213+0000","last_peered":"2024-04-25T09:08:19.034213+0000","last_clean":"2024-04-25T09:08:19.034213+0000","last_became_active":"2024-04-25T09:08:18.036781+0000","last_became_peered":"2024-04-25T09:08:18.036781+0000","last_unstale":"2024-04-25T09:08:19.034213+0000","last_undegraded":"2024-04-25T09:08:19.034213+0000","last_fullsized":"2024-04-25T09:08:19.034213+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:59.439336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028571+0000","last_change":"2024-04-25T09:08:17.023485+0000","last_active":"2024-04-25T09:08:19.028571+0000","last_peered":"2024-04-25T09:08:19.028571+0000","last_clean":"2024-04-25T09:08:19.028571+0000","last_became_active":"2024-04-25T09:08:17.022356+0000","last_became_peered":"2024-04-25T09:08:17.022356+0000","last_unstale":"2024-04-25T09:08:19.028571+0000","last_undegraded":"2024-04-25T09:08:19.028571+0000","last_fullsized":"2024-04-25T09:08:19.028571+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:24.833000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.038526+0000","last_change":"2024-04-25T09:08:18.023086+0000","last_active":"2024-04-25T09:08:19.038526+0000","last_peered":"2024-04-25T09:08:19.038526+0000","last_clean":"2024-04-25T09:08:19.038526+0000","last_became_active":"2024-04-25T09:08:18.022834+0000","last_became_peered":"2024-04-25T09:08:18.022834+0000","last_unstale":"2024-04-25T09:08:19.038526+0000","last_undegraded":"2024-04-25T09:08:19.038526+0000","last_fullsized":"2024-04-25T09:08:19.038526+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:30.738105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.034343+0000","last_change":"2024-04-25T09:08:17.019898+0000","last_active":"2024-04-25T09:08:19.034343+0000","last_peered":"2024-04-25T09:08:19.034343+0000","last_clean":"2024-04-25T09:08:19.034343+0000","last_became_active":"2024-04-25T09:08:17.019593+0000","last_became_peered":"2024-04-25T09:08:17.019593+0000","last_unstale":"2024-04-25T09:08:19.034343+0000","last_undegraded":"2024-04-25T09:08:19.034343+0000","last_fullsized":"2024-04-25T09:08:19.034343+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:55.882355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.023727+0000","last_change":"2024-04-25T09:08:18.017272+0000","last_active":"2024-04-25T09:08:19.023727+0000","last_peered":"2024-04-25T09:08:19.023727+0000","last_clean":"2024-04-25T09:08:19.023727+0000","last_became_active":"2024-04-25T09:08:18.016986+0000","last_became_peered":"2024-04-25T09:08:18.016986+0000","last_unstale":"2024-04-25T09:08:19.023727+0000","last_undegraded":"2024-04-25T09:08:19.023727+0000","last_fullsized":"2024-04-25T09:08:19.023727+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:24.016110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"68'8","reported_seq":22,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.027117+0000","last_change":"2024-04-25T09:08:17.028980+0000","last_active":"2024-04-25T09:08:19.027117+0000","last_peered":"2024-04-25T09:08:19.027117+0000","last_clean":"2024-04-25T09:08:19.027117+0000","last_became_active":"2024-04-25T09:08:17.026719+0000","last_became_peered":"2024-04-25T09:08:17.026719+0000","last_unstale":"2024-04-25T09:08:19.027117+0000","last_undegraded":"2024-04-25T09:08:19.027117+0000","last_fullsized":"2024-04-25T09:08:19.027117+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:33:51.014290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.029199+0000","last_change":"2024-04-25T09:08:18.029966+0000","last_active":"2024-04-25T09:08:19.029199+0000","last_peered":"2024-04-25T09:08:19.029199+0000","last_clean":"2024-04-25T09:08:19.029199+0000","last_became_active":"2024-04-25T09:08:18.029575+0000","last_became_peered":"2024-04-25T09:08:18.029575+0000","last_unstale":"2024-04-25T09:08:19.029199+0000","last_undegraded":"2024-04-25T09:08:19.029199+0000","last_fullsized":"2024-04-25T09:08:19.029199+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:01.355235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028078+0000","last_change":"2024-04-25T09:08:17.021008+0000","last_active":"2024-04-25T09:08:19.028078+0000","last_peered":"2024-04-25T09:08:19.028078+0000","last_clean":"2024-04-25T09:08:19.028078+0000","last_became_active":"2024-04-25T09:08:17.020699+0000","last_became_peered":"2024-04-25T09:08:17.020699+0000","last_unstale":"2024-04-25T09:08:19.028078+0000","last_undegraded":"2024-04-25T09:08:19.028078+0000","last_fullsized":"2024-04-25T09:08:19.028078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:36.326769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.115563+0000","last_change":"2024-04-25T09:08:18.018734+0000","last_active":"2024-04-25T09:08:19.115563+0000","last_peered":"2024-04-25T09:08:19.115563+0000","last_clean":"2024-04-25T09:08:19.115563+0000","last_became_active":"2024-04-25T09:08:18.017839+0000","last_became_peered":"2024-04-25T09:08:18.017839+0000","last_unstale":"2024-04-25T09:08:19.115563+0000","last_undegraded":"2024-04-25T09:08:19.115563+0000","last_fullsized":"2024-04-25T09:08:19.115563+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:46.874491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.029236+0000","last_change":"2024-04-25T09:08:17.028655+0000","last_active":"2024-04-25T09:08:19.029236+0000","last_peered":"2024-04-25T09:08:19.029236+0000","last_clean":"2024-04-25T09:08:19.029236+0000","last_became_active":"2024-04-25T09:08:17.028383+0000","last_became_peered":"2024-04-25T09:08:17.028383+0000","last_unstale":"2024-04-25T09:08:19.029236+0000","last_undegraded":"2024-04-25T09:08:19.029236+0000","last_fullsized":"2024-04-25T09:08:19.029236+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:44.878253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.114803+0000","last_change":"2024-04-25T09:08:18.017999+0000","last_active":"2024-04-25T09:08:19.114803+0000","last_peered":"2024-04-25T09:08:19.114803+0000","last_clean":"2024-04-25T09:08:19.114803+0000","last_became_active":"2024-04-25T09:08:18.017671+0000","last_became_peered":"2024-04-25T09:08:18.017671+0000","last_unstale":"2024-04-25T09:08:19.114803+0000","last_undegraded":"2024-04-25T09:08:19.114803+0000","last_fullsized":"2024-04-25T09:08:19.114803+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:02.303253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"68'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028227+0000","last_change":"2024-04-25T09:08:17.027470+0000","last_active":"2024-04-25T09:08:19.028227+0000","last_peered":"2024-04-25T09:08:19.028227+0000","last_clean":"2024-04-25T09:08:19.028227+0000","last_became_active":"2024-04-25T09:08:17.027198+0000","last_became_peered":"2024-04-25T09:08:17.027198+0000","last_unstale":"2024-04-25T09:08:19.028227+0000","last_undegraded":"2024-04-25T09:08:19.028227+0000","last_fullsized":"2024-04-25T09:08:19.028227+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:42:49.644067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.023957+0000","last_change":"2024-04-25T09:08:18.031548+0000","last_active":"2024-04-25T09:08:19.023957+0000","last_peered":"2024-04-25T09:08:19.023957+0000","last_clean":"2024-04-25T09:08:19.023957+0000","last_became_active":"2024-04-25T09:08:18.031234+0000","last_became_peered":"2024-04-25T09:08:18.031234+0000","last_unstale":"2024-04-25T09:08:19.023957+0000","last_undegraded":"2024-04-25T09:08:19.023957+0000","last_fullsized":"2024-04-25T09:08:19.023957+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:03.695775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.115413+0000","last_change":"2024-04-25T09:08:17.031403+0000","last_active":"2024-04-25T09:08:19.115413+0000","last_peered":"2024-04-25T09:08:19.115413+0000","last_clean":"2024-04-25T09:08:19.115413+0000","last_became_active":"2024-04-25T09:08:17.031145+0000","last_became_peered":"2024-04-25T09:08:17.031145+0000","last_unstale":"2024-04-25T09:08:19.115413+0000","last_undegraded":"2024-04-25T09:08:19.115413+0000","last_fullsized":"2024-04-25T09:08:19.115413+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:15.314773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.114780+0000","last_change":"2024-04-25T09:08:18.018767+0000","last_active":"2024-04-25T09:08:19.114780+0000","last_peered":"2024-04-25T09:08:19.114780+0000","last_clean":"2024-04-25T09:08:19.114780+0000","last_became_active":"2024-04-25T09:08:18.018496+0000","last_became_peered":"2024-04-25T09:08:18.018496+0000","last_unstale":"2024-04-25T09:08:19.114780+0000","last_undegraded":"2024-04-25T09:08:19.114780+0000","last_fullsized":"2024-04-25T09:08:19.114780+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:59.524322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028665+0000","last_change":"2024-04-25T09:08:17.015969+0000","last_active":"2024-04-25T09:08:19.028665+0000","last_peered":"2024-04-25T09:08:19.028665+0000","last_clean":"2024-04-25T09:08:19.028665+0000","last_became_active":"2024-04-25T09:08:17.015633+0000","last_became_peered":"2024-04-25T09:08:17.015633+0000","last_unstale":"2024-04-25T09:08:19.028665+0000","last_undegraded":"2024-04-25T09:08:19.028665+0000","last_fullsized":"2024-04-25T09:08:19.028665+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:49.533550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.114539+0000","last_change":"2024-04-25T09:08:18.023408+0000","last_active":"2024-04-25T09:08:19.114539+0000","last_peered":"2024-04-25T09:08:19.114539+0000","last_clean":"2024-04-25T09:08:19.114539+0000","last_became_active":"2024-04-25T09:08:18.023050+0000","last_became_peered":"2024-04-25T09:08:18.023050+0000","last_unstale":"2024-04-25T09:08:19.114539+0000","last_undegraded":"2024-04-25T09:08:19.114539+0000","last_fullsized":"2024-04-25T09:08:19.114539+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:50.774796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.034447+0000","last_change":"2024-04-25T09:08:17.021971+0000","last_active":"2024-04-25T09:08:19.034447+0000","last_peered":"2024-04-25T09:08:19.034447+0000","last_clean":"2024-04-25T09:08:19.034447+0000","last_became_active":"2024-04-25T09:08:17.021372+0000","last_became_peered":"2024-04-25T09:08:17.021372+0000","last_unstale":"2024-04-25T09:08:19.034447+0000","last_undegraded":"2024-04-25T09:08:19.034447+0000","last_fullsized":"2024-04-25T09:08:19.034447+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:17.838172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.115136+0000","last_change":"2024-04-25T09:08:18.025138+0000","last_active":"2024-04-25T09:08:19.115136+0000","last_peered":"2024-04-25T09:08:19.115136+0000","last_clean":"2024-04-25T09:08:19.115136+0000","last_became_active":"2024-04-25T09:08:18.023320+0000","last_became_peered":"2024-04-25T09:08:18.023320+0000","last_unstale":"2024-04-25T09:08:19.115136+0000","last_undegraded":"2024-04-25T09:08:19.115136+0000","last_fullsized":"2024-04-25T09:08:19.115136+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:40.579221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.038412+0000","last_change":"2024-04-25T09:08:17.023926+0000","last_active":"2024-04-25T09:08:19.038412+0000","last_peered":"2024-04-25T09:08:19.038412+0000","last_clean":"2024-04-25T09:08:19.038412+0000","last_became_active":"2024-04-25T09:08:17.023662+0000","last_became_peered":"2024-04-25T09:08:17.023662+0000","last_unstale":"2024-04-25T09:08:19.038412+0000","last_undegraded":"2024-04-25T09:08:19.038412+0000","last_fullsized":"2024-04-25T09:08:19.038412+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:26.340284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.038855+0000","last_change":"2024-04-25T09:08:18.015886+0000","last_active":"2024-04-25T09:08:19.038855+0000","last_peered":"2024-04-25T09:08:19.038855+0000","last_clean":"2024-04-25T09:08:19.038855+0000","last_became_active":"2024-04-25T09:08:18.015258+0000","last_became_peered":"2024-04-25T09:08:18.015258+0000","last_unstale":"2024-04-25T09:08:19.038855+0000","last_undegraded":"2024-04-25T09:08:19.038855+0000","last_fullsized":"2024-04-25T09:08:19.038855+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:44.711489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028357+0000","last_change":"2024-04-25T09:08:17.020129+0000","last_active":"2024-04-25T09:08:19.028357+0000","last_peered":"2024-04-25T09:08:19.028357+0000","last_clean":"2024-04-25T09:08:19.028357+0000","last_became_active":"2024-04-25T09:08:17.019765+0000","last_became_peered":"2024-04-25T09:08:17.019765+0000","last_unstale":"2024-04-25T09:08:19.028357+0000","last_undegraded":"2024-04-25T09:08:19.028357+0000","last_fullsized":"2024-04-25T09:08:19.028357+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:40.369073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.034233+0000","last_change":"2024-04-25T09:08:18.032215+0000","last_active":"2024-04-25T09:08:19.034233+0000","last_peered":"2024-04-25T09:08:19.034233+0000","last_clean":"2024-04-25T09:08:19.034233+0000","last_became_active":"2024-04-25T09:08:18.028306+0000","last_became_peered":"2024-04-25T09:08:18.028306+0000","last_unstale":"2024-04-25T09:08:19.034233+0000","last_undegraded":"2024-04-25T09:08:19.034233+0000","last_fullsized":"2024-04-25T09:08:19.034233+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:24.857330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"69'1","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.034505+0000","last_change":"2024-04-25T09:08:17.018323+0000","last_active":"2024-04-25T09:08:19.034505+0000","last_peered":"2024-04-25T09:08:19.034505+0000","last_clean":"2024-04-25T09:08:19.034505+0000","last_became_active":"2024-04-25T09:08:17.018021+0000","last_became_peered":"2024-04-25T09:08:17.018021+0000","last_unstale":"2024-04-25T09:08:19.034505+0000","last_undegraded":"2024-04-25T09:08:19.034505+0000","last_fullsized":"2024-04-25T09:08:19.034505+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:37:56.136021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.115183+0000","last_change":"2024-04-25T09:08:18.021097+0000","last_active":"2024-04-25T09:08:19.115183+0000","last_peered":"2024-04-25T09:08:19.115183+0000","last_clean":"2024-04-25T09:08:19.115183+0000","last_became_active":"2024-04-25T09:08:18.020782+0000","last_became_peered":"2024-04-25T09:08:18.020782+0000","last_unstale":"2024-04-25T09:08:19.115183+0000","last_undegraded":"2024-04-25T09:08:19.115183+0000","last_fullsized":"2024-04-25T09:08:19.115183+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:07.159183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.023977+0000","last_change":"2024-04-25T09:08:17.017852+0000","last_active":"2024-04-25T09:08:19.023977+0000","last_peered":"2024-04-25T09:08:19.023977+0000","last_clean":"2024-04-25T09:08:19.023977+0000","last_became_active":"2024-04-25T09:08:17.017430+0000","last_became_peered":"2024-04-25T09:08:17.017430+0000","last_unstale":"2024-04-25T09:08:19.023977+0000","last_undegraded":"2024-04-25T09:08:19.023977+0000","last_fullsized":"2024-04-25T09:08:19.023977+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:45.014736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.115592+0000","last_change":"2024-04-25T09:08:18.033528+0000","last_active":"2024-04-25T09:08:19.115592+0000","last_peered":"2024-04-25T09:08:19.115592+0000","last_clean":"2024-04-25T09:08:19.115592+0000","last_became_active":"2024-04-25T09:08:18.033177+0000","last_became_peered":"2024-04-25T09:08:18.033177+0000","last_unstale":"2024-04-25T09:08:19.115592+0000","last_undegraded":"2024-04-25T09:08:19.115592+0000","last_fullsized":"2024-04-25T09:08:19.115592+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:38.702546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.038781+0000","last_change":"2024-04-25T09:08:17.026372+0000","last_active":"2024-04-25T09:08:19.038781+0000","last_peered":"2024-04-25T09:08:19.038781+0000","last_clean":"2024-04-25T09:08:19.038781+0000","last_became_active":"2024-04-25T09:08:17.026102+0000","last_became_peered":"2024-04-25T09:08:17.026102+0000","last_unstale":"2024-04-25T09:08:19.038781+0000","last_undegraded":"2024-04-25T09:08:19.038781+0000","last_fullsized":"2024-04-25T09:08:19.038781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:17.838172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.023887+0000","last_change":"2024-04-25T09:08:18.027792+0000","last_active":"2024-04-25T09:08:19.023887+0000","last_peered":"2024-04-25T09:08:19.023887+0000","last_clean":"2024-04-25T09:08:19.023887+0000","last_became_active":"2024-04-25T09:08:18.025079+0000","last_became_peered":"2024-04-25T09:08:18.025079+0000","last_unstale":"2024-04-25T09:08:19.023887+0000","last_undegraded":"2024-04-25T09:08:19.023887+0000","last_fullsized":"2024-04-25T09:08:19.023887+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:50.170477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.023755+0000","last_change":"2024-04-25T09:08:17.024952+0000","last_active":"2024-04-25T09:08:19.023755+0000","last_peered":"2024-04-25T09:08:19.023755+0000","last_clean":"2024-04-25T09:08:19.023755+0000","last_became_active":"2024-04-25T09:08:17.024696+0000","last_became_peered":"2024-04-25T09:08:17.024696+0000","last_unstale":"2024-04-25T09:08:19.023755+0000","last_undegraded":"2024-04-25T09:08:19.023755+0000","last_fullsized":"2024-04-25T09:08:19.023755+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:35.955621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028095+0000","last_change":"2024-04-25T09:08:18.019758+0000","last_active":"2024-04-25T09:08:19.028095+0000","last_peered":"2024-04-25T09:08:19.028095+0000","last_clean":"2024-04-25T09:08:19.028095+0000","last_became_active":"2024-04-25T09:08:18.019461+0000","last_became_peered":"2024-04-25T09:08:18.019461+0000","last_unstale":"2024-04-25T09:08:19.028095+0000","last_undegraded":"2024-04-25T09:08:19.028095+0000","last_fullsized":"2024-04-25T09:08:19.028095+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:47:32.140892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.115265+0000","last_change":"2024-04-25T09:08:17.021898+0000","last_active":"2024-04-25T09:08:19.115265+0000","last_peered":"2024-04-25T09:08:19.115265+0000","last_clean":"2024-04-25T09:08:19.115265+0000","last_became_active":"2024-04-25T09:08:17.021584+0000","last_became_peered":"2024-04-25T09:08:17.021584+0000","last_unstale":"2024-04-25T09:08:19.115265+0000","last_undegraded":"2024-04-25T09:08:19.115265+0000","last_fullsized":"2024-04-25T09:08:19.115265+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:40.320274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.114432+0000","last_change":"2024-04-25T09:08:18.021649+0000","last_active":"2024-04-25T09:08:19.114432+0000","last_peered":"2024-04-25T09:08:19.114432+0000","last_clean":"2024-04-25T09:08:19.114432+0000","last_became_active":"2024-04-25T09:08:18.021254+0000","last_became_peered":"2024-04-25T09:08:18.021254+0000","last_unstale":"2024-04-25T09:08:19.114432+0000","last_undegraded":"2024-04-25T09:08:19.114432+0000","last_fullsized":"2024-04-25T09:08:19.114432+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:47.510684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.027279+0000","last_change":"2024-04-25T09:08:17.025380+0000","last_active":"2024-04-25T09:08:19.027279+0000","last_peered":"2024-04-25T09:08:19.027279+0000","last_clean":"2024-04-25T09:08:19.027279+0000","last_became_active":"2024-04-25T09:08:17.024963+0000","last_became_peered":"2024-04-25T09:08:17.024963+0000","last_unstale":"2024-04-25T09:08:19.027279+0000","last_undegraded":"2024-04-25T09:08:19.027279+0000","last_fullsized":"2024-04-25T09:08:19.027279+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:13.779666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.027724+0000","last_change":"2024-04-25T09:08:18.022840+0000","last_active":"2024-04-25T09:08:19.027724+0000","last_peered":"2024-04-25T09:08:19.027724+0000","last_clean":"2024-04-25T09:08:19.027724+0000","last_became_active":"2024-04-25T09:08:18.022248+0000","last_became_peered":"2024-04-25T09:08:18.022248+0000","last_unstale":"2024-04-25T09:08:19.027724+0000","last_undegraded":"2024-04-25T09:08:19.027724+0000","last_fullsized":"2024-04-25T09:08:19.027724+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:47.510684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.027979+0000","last_change":"2024-04-25T09:08:17.022999+0000","last_active":"2024-04-25T09:08:19.027979+0000","last_peered":"2024-04-25T09:08:19.027979+0000","last_clean":"2024-04-25T09:08:19.027979+0000","last_became_active":"2024-04-25T09:08:17.022670+0000","last_became_peered":"2024-04-25T09:08:17.022670+0000","last_unstale":"2024-04-25T09:08:19.027979+0000","last_undegraded":"2024-04-25T09:08:19.027979+0000","last_fullsized":"2024-04-25T09:08:19.027979+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:32.822001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.114771+0000","last_change":"2024-04-25T09:08:18.023413+0000","last_active":"2024-04-25T09:08:19.114771+0000","last_peered":"2024-04-25T09:08:19.114771+0000","last_clean":"2024-04-25T09:08:19.114771+0000","last_became_active":"2024-04-25T09:08:18.023124+0000","last_became_peered":"2024-04-25T09:08:18.023124+0000","last_unstale":"2024-04-25T09:08:19.114771+0000","last_undegraded":"2024-04-25T09:08:19.114771+0000","last_fullsized":"2024-04-25T09:08:19.114771+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:16.991085+0000","last_clean_scrub_stamp":"2024-04-25T09:08:16.991085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:25.505305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"68'2","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.028774+0000","last_change":"2024-04-25T09:08:17.023005+0000","last_active":"2024-04-25T09:08:19.028774+0000","last_peered":"2024-04-25T09:08:19.028774+0000","last_clean":"2024-04-25T09:08:19.028774+0000","last_became_active":"2024-04-25T09:08:17.022690+0000","last_became_peered":"2024-04-25T09:08:17.022690+0000","last_unstale":"2024-04-25T09:08:19.028774+0000","last_undegraded":"2024-04-25T09:08:19.028774+0000","last_fullsized":"2024-04-25T09:08:19.028774+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:08:15.983697+0000","last_clean_scrub_stamp":"2024-04-25T09:08:15.983697+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:45.779455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":261,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-04-25T09:08:19.114982+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:08:19.114982+0000","last_peered":"2024-04-25T09:08:19.114982+0000","last_clean":"2024-04-25T09:08:19.114982+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:08:19.114982+0000","last_undegraded":"2024-04-25T09:08:19.114982+0000","last_fullsized":"2024-04-25T09:08:19.114982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":1441792,"data_stored":943939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":847872,"data_stored":353047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":843776,"data_stored":353045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":843776,"data_stored":353025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":847872,"data_stored":353067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":354567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":355183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1433600,"data_stored":943323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:08:26.932 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:08:26.932 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:08:27.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.124+0000 7f0207e00640 1 Processor -- start 2024-04-25T09:08:27.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.124+0000 7f0207e00640 1 -- start start 2024-04-25T09:08:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.124+0000 7f0207e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f020015bb80 0x7f02000cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.124+0000 7f0207e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f02000b7250 0x7f02000d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.124+0000 7f0207e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020015bf60 con 0x7f02000d12a0 2024-04-25T09:08:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.124+0000 7f0207e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02000cfcc0 con 0x7f02000b7250 2024-04-25T09:08:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.124+0000 7f0207e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02000cffa0 con 0x7f020015bb80 2024-04-25T09:08:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.124+0000 7f0204a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f02000b7250 0x7f02000d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.124+0000 7f0204a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f02000b7250 0x7f02000d0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60758/0 (socket says 172.21.15.175:60758) 2024-04-25T09:08:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.124+0000 7f0204a00640 1 -- 172.21.15.175:0/1530775861 learned_addr learned my addr 172.21.15.175:0/1530775861 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.124+0000 7f0205400640 1 --2- 172.21.15.175:0/1530775861 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f020015bb80 0x7f02000cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.124+0000 7f0204a00640 1 -- 172.21.15.175:0/1530775861 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f020015bb80 msgr2=0x7f02000cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.124+0000 7f0204a00640 1 --2- 172.21.15.175:0/1530775861 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f020015bb80 0x7f02000cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.124+0000 7f0204a00640 1 -- 172.21.15.175:0/1530775861 >> v1:172.21.15.177:6789/0 conn(0x7f02000d12a0 legacy=0x7f02000d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.124+0000 7f0204a00640 1 -- 172.21.15.175:0/1530775861 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02000d0280 con 0x7f02000b7250 2024-04-25T09:08:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.124+0000 7f0205400640 1 --2- 172.21.15.175:0/1530775861 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f020015bb80 0x7f02000cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:27.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.128+0000 7f0204a00640 1 --2- 172.21.15.175:0/1530775861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02000b7250 0x7f02000d0d60 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009870 tx=0x7f01ec01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcf576f4bafc433 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:27.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.128+0000 7f01ffe00640 1 -- 172.21.15.175:0/1530775861 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0a95f0 con 0x7f02000b7250 2024-04-25T09:08:27.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.128+0000 7f01ffe00640 1 -- 172.21.15.175:0/1530775861 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ec0a9790 con 0x7f02000b7250 2024-04-25T09:08:27.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.128+0000 7f01ffe00640 1 -- 172.21.15.175:0/1530775861 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0a9b60 con 0x7f02000b7250 2024-04-25T09:08:27.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.128+0000 7f0207e00640 1 -- 172.21.15.175:0/1530775861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02000b7250 msgr2=0x7f02000d0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:27.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.128+0000 7f0207e00640 1 --2- 172.21.15.175:0/1530775861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02000b7250 0x7f02000d0d60 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009870 tx=0x7f01ec01c530 comp rx=0 tx=0).stop 2024-04-25T09:08:27.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.128+0000 7f0207e00640 1 -- 172.21.15.175:0/1530775861 shutdown_connections 2024-04-25T09:08:27.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.128+0000 7f0207e00640 1 --2- 172.21.15.175:0/1530775861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02000b7250 0x7f02000d0d60 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.128+0000 7f0207e00640 1 --2- 172.21.15.175:0/1530775861 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f020015bb80 0x7f02000cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.128+0000 7f0207e00640 1 -- 172.21.15.175:0/1530775861 >> 172.21.15.175:0/1530775861 conn(0x7f0200070f40 msgr2=0x7f0200071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:27.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.128+0000 7f0207e00640 1 -- 172.21.15.175:0/1530775861 shutdown_connections 2024-04-25T09:08:27.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.128+0000 7f0207e00640 1 -- 172.21.15.175:0/1530775861 wait complete. 2024-04-25T09:08:27.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0207e00640 1 Processor -- start 2024-04-25T09:08:27.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0207e00640 1 -- start start 2024-04-25T09:08:27.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0207e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02000b7250 0x7f0200154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:27.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0207e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f020015bb80 0x7f02001655d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:27.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0207e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02001639d0 0x7f020006c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:27.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0207e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02000b5010 con 0x7f02000b7250 2024-04-25T09:08:27.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0207e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02000b4e90 con 0x7f02001639d0 2024-04-25T09:08:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0207e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02000d1e90 con 0x7f020015bb80 2024-04-25T09:08:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0205400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02000b7250 0x7f0200154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0205400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02000b7250 0x7f0200154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60764/0 (socket says 172.21.15.175:60764) 2024-04-25T09:08:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0205400640 1 -- 172.21.15.175:0/2845855140 learned_addr learned my addr 172.21.15.175:0/2845855140 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0204a00640 1 --2- 172.21.15.175:0/2845855140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f020015bb80 0x7f02001655d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0205e00640 1 --2- 172.21.15.175:0/2845855140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02001639d0 0x7f020006c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0205400640 1 -- 172.21.15.175:0/2845855140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f020015bb80 msgr2=0x7f02001655d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0205400640 1 --2- 172.21.15.175:0/2845855140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f020015bb80 0x7f02001655d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0205400640 1 -- 172.21.15.175:0/2845855140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02001639d0 msgr2=0x7f020006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0205400640 1 --2- 172.21.15.175:0/2845855140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02001639d0 0x7f020006c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0205400640 1 -- 172.21.15.175:0/2845855140 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0200165f20 con 0x7f02000b7250 2024-04-25T09:08:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0205e00640 1 --2- 172.21.15.175:0/2845855140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02001639d0 0x7f020006c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0205400640 1 --2- 172.21.15.175:0/2845855140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02000b7250 0x7f0200154cb0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f01f400d860 tx=0x7f01f400dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f01fd600640 1 -- 172.21.15.175:0/2845855140 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f4018020 con 0x7f02000b7250 2024-04-25T09:08:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f01fd600640 1 -- 172.21.15.175:0/2845855140 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f400de50 con 0x7f02000b7250 2024-04-25T09:08:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0207e00640 1 -- 172.21.15.175:0/2845855140 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0200166200 con 0x7f02000b7250 2024-04-25T09:08:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f01fd600640 1 -- 172.21.15.175:0/2845855140 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f4009b10 con 0x7f02000b7250 2024-04-25T09:08:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.132+0000 7f0207e00640 1 -- 172.21.15.175:0/2845855140 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020006c170 con 0x7f02000b7250 2024-04-25T09:08:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.136+0000 7f0207e00640 1 -- 172.21.15.175:0/2845855140 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0200074a60 con 0x7f02000b7250 2024-04-25T09:08:27.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.136+0000 7f01fd600640 1 -- 172.21.15.175:0/2845855140 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f01f401b020 con 0x7f02000b7250 2024-04-25T09:08:27.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.136+0000 7f01fd600640 1 --2- 172.21.15.175:0/2845855140 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f01e0066f90 0x7f01e0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:27.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.136+0000 7f01fd600640 1 -- 172.21.15.175:0/2845855140 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01f4085270 con 0x7f02000b7250 2024-04-25T09:08:27.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.136+0000 7f0204a00640 1 --2- 172.21.15.175:0/2845855140 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f01e0066f90 0x7f01e0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:27.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.136+0000 7f0204a00640 1 --2- 172.21.15.175:0/2845855140 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f01e0066f90 0x7f01e0069450 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0ae000 tx=0x7f01ec0b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:27.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.140+0000 7f01fd600640 1 -- 172.21.15.175:0/2845855140 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f01f4022030 con 0x7f02000b7250 2024-04-25T09:08:27.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.348+0000 7f0207e00640 1 -- 172.21.15.175:0/2845855140 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f02000b25e0 con 0x7f02000b7250 2024-04-25T09:08:27.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.352+0000 7f01fd600640 1 -- 172.21.15.175:0/2845855140 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7f01f40561e0 con 0x7f02000b7250 2024-04-25T09:08:27.340 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2024-04-25T09:08:27.340 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBPHCpmhyCUBhAA8k9xLKIw8R04i6HSJykDfw== 2024-04-25T09:08:27.340 INFO:teuthology.orchestra.run.smithi175.stdout: caps mds = "allow" 2024-04-25T09:08:27.341 INFO:teuthology.orchestra.run.smithi175.stdout: caps mon = "allow r" 2024-04-25T09:08:27.341 INFO:teuthology.orchestra.run.smithi175.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:08:27.341 INFO:teuthology.orchestra.run.smithi175.stderr:updated caps for client.0 2024-04-25T09:08:27.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.352+0000 7f0207e00640 1 -- 172.21.15.175:0/2845855140 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f01e0066f90 msgr2=0x7f01e0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:27.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.352+0000 7f0207e00640 1 --2- 172.21.15.175:0/2845855140 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f01e0066f90 0x7f01e0069450 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0ae000 tx=0x7f01ec0b3040 comp rx=0 tx=0).stop 2024-04-25T09:08:27.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.352+0000 7f0207e00640 1 -- 172.21.15.175:0/2845855140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02000b7250 msgr2=0x7f0200154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:27.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.352+0000 7f0207e00640 1 --2- 172.21.15.175:0/2845855140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02000b7250 0x7f0200154cb0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f01f400d860 tx=0x7f01f400dd20 comp rx=0 tx=0).stop 2024-04-25T09:08:27.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.352+0000 7f0207e00640 1 -- 172.21.15.175:0/2845855140 shutdown_connections 2024-04-25T09:08:27.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.352+0000 7f0207e00640 1 --2- 172.21.15.175:0/2845855140 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f01e0066f90 0x7f01e0069450 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.352+0000 7f0207e00640 1 --2- 172.21.15.175:0/2845855140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02001639d0 0x7f020006c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.352+0000 7f0207e00640 1 --2- 172.21.15.175:0/2845855140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f020015bb80 0x7f02001655d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.352+0000 7f0207e00640 1 --2- 172.21.15.175:0/2845855140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02000b7250 0x7f0200154cb0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.352+0000 7f0207e00640 1 -- 172.21.15.175:0/2845855140 >> 172.21.15.175:0/2845855140 conn(0x7f0200070f40 msgr2=0x7f02000b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:27.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.352+0000 7f0207e00640 1 -- 172.21.15.175:0/2845855140 shutdown_connections 2024-04-25T09:08:27.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.352+0000 7f0207e00640 1 -- 172.21.15.175:0/2845855140 wait complete. 2024-04-25T09:08:27.362 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:08:27.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.508+0000 7f68aa000640 1 Processor -- start 2024-04-25T09:08:27.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.508+0000 7f68aa000640 1 -- start start 2024-04-25T09:08:27.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.508+0000 7f68aa000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f68a4099a50 0x7f68a406cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:27.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.508+0000 7f68aa000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68a406bd60 0x7f68a4099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:27.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.508+0000 7f68aa000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a409a370 con 0x7f68a40d0d50 2024-04-25T09:08:27.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.508+0000 7f68aa000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a40cfcb0 con 0x7f68a4099a50 2024-04-25T09:08:27.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.508+0000 7f68aa000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a40cff90 con 0x7f68a406bd60 2024-04-25T09:08:27.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.508+0000 7f68a3400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f68a4099a50 0x7f68a406cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:27.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.508+0000 7f68a3400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f68a4099a50 0x7f68a406cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60772/0 (socket says 172.21.15.175:60772) 2024-04-25T09:08:27.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.508+0000 7f68a3400640 1 -- 172.21.15.175:0/3264413034 learned_addr learned my addr 172.21.15.175:0/3264413034 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:27.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.508+0000 7f68a2a00640 1 --2- 172.21.15.175:0/3264413034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68a406bd60 0x7f68a4099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:27.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.508+0000 7f68a3400640 1 -- 172.21.15.175:0/3264413034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68a406bd60 msgr2=0x7f68a4099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:27.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.508+0000 7f68a3400640 1 --2- 172.21.15.175:0/3264413034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68a406bd60 0x7f68a4099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.508+0000 7f68a3400640 1 -- 172.21.15.175:0/3264413034 >> v1:172.21.15.175:6789/0 conn(0x7f68a40d0d50 legacy=0x7f68a40cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:27.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.508+0000 7f68a3400640 1 -- 172.21.15.175:0/3264413034 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a40d0270 con 0x7f68a4099a50 2024-04-25T09:08:27.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.512+0000 7f68a3400640 1 --2- 172.21.15.175:0/3264413034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a4099a50 0x7f68a406cc50 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6894009e50 tx=0x7f689401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cab4f9153721a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:27.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.512+0000 7f68a2000640 1 -- 172.21.15.175:0/3264413034 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68940a5700 con 0x7f68a4099a50 2024-04-25T09:08:27.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.512+0000 7f68a2000640 1 -- 172.21.15.175:0/3264413034 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68940a58a0 con 0x7f68a4099a50 2024-04-25T09:08:27.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.512+0000 7f68a2000640 1 -- 172.21.15.175:0/3264413034 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68940a5c70 con 0x7f68a4099a50 2024-04-25T09:08:27.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.512+0000 7f68aa000640 1 -- 172.21.15.175:0/3264413034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a4099a50 msgr2=0x7f68a406cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:27.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.512+0000 7f68aa000640 1 --2- 172.21.15.175:0/3264413034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a4099a50 0x7f68a406cc50 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6894009e50 tx=0x7f689401ca30 comp rx=0 tx=0).stop 2024-04-25T09:08:27.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.512+0000 7f68aa000640 1 -- 172.21.15.175:0/3264413034 shutdown_connections 2024-04-25T09:08:27.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.512+0000 7f68aa000640 1 --2- 172.21.15.175:0/3264413034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68a406bd60 0x7f68a4099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.512+0000 7f68aa000640 1 --2- 172.21.15.175:0/3264413034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a4099a50 0x7f68a406cc50 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.512+0000 7f68aa000640 1 -- 172.21.15.175:0/3264413034 >> 172.21.15.175:0/3264413034 conn(0x7f68a40b3300 msgr2=0x7f68a40b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:27.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.512+0000 7f68aa000640 1 -- 172.21.15.175:0/3264413034 shutdown_connections 2024-04-25T09:08:27.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.512+0000 7f68aa000640 1 -- 172.21.15.175:0/3264413034 wait complete. 2024-04-25T09:08:27.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68aa000640 1 Processor -- start 2024-04-25T09:08:27.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68aa000640 1 -- start start 2024-04-25T09:08:27.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68aa000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a406bd60 0x7f68a415c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:27.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68aa000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68a4099a50 0x7f68a4157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:27.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68aa000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68a40d0d50 0x7f68a4158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:27.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68aa000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a415dfe0 con 0x7f68a406bd60 2024-04-25T09:08:27.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68aa000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a415de60 con 0x7f68a40d0d50 2024-04-25T09:08:27.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68aa000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a416b260 con 0x7f68a4099a50 2024-04-25T09:08:27.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68a3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a406bd60 0x7f68a415c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:27.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68a3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a406bd60 0x7f68a415c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60788/0 (socket says 172.21.15.175:60788) 2024-04-25T09:08:27.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68a3400640 1 -- 172.21.15.175:0/2697150578 learned_addr learned my addr 172.21.15.175:0/2697150578 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:27.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68a3400640 1 -- 172.21.15.175:0/2697150578 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68a4099a50 msgr2=0x7f68a4157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:27.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68a3400640 1 --2- 172.21.15.175:0/2697150578 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68a4099a50 0x7f68a4157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68a3400640 1 -- 172.21.15.175:0/2697150578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68a40d0d50 msgr2=0x7f68a4158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:27.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68a3400640 1 --2- 172.21.15.175:0/2697150578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68a40d0d50 0x7f68a4158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68a3400640 1 -- 172.21.15.175:0/2697150578 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a415b3d0 con 0x7f68a406bd60 2024-04-25T09:08:27.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68a3400640 1 --2- 172.21.15.175:0/2697150578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a406bd60 0x7f68a415c470 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f68940af040 tx=0x7f68940197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:27.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f689b400640 1 -- 172.21.15.175:0/2697150578 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68940b8670 con 0x7f68a406bd60 2024-04-25T09:08:27.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f689b400640 1 -- 172.21.15.175:0/2697150578 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68940be070 con 0x7f68a406bd60 2024-04-25T09:08:27.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68aa000640 1 -- 172.21.15.175:0/2697150578 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a415b6b0 con 0x7f68a406bd60 2024-04-25T09:08:27.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f689b400640 1 -- 172.21.15.175:0/2697150578 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68940b8a70 con 0x7f68a406bd60 2024-04-25T09:08:27.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68aa000640 1 -- 172.21.15.175:0/2697150578 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a415bc70 con 0x7f68a406bd60 2024-04-25T09:08:27.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.516+0000 7f68aa000640 1 -- 172.21.15.175:0/2697150578 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a4074a60 con 0x7f68a406bd60 2024-04-25T09:08:27.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.520+0000 7f689b400640 1 -- 172.21.15.175:0/2697150578 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f68940b8c10 con 0x7f68a406bd60 2024-04-25T09:08:27.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.520+0000 7f689b400640 1 --2- 172.21.15.175:0/2697150578 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6884066f60 0x7f6884069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:27.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.520+0000 7f689b400640 1 -- 172.21.15.175:0/2697150578 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6894120230 con 0x7f68a406bd60 2024-04-25T09:08:27.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.520+0000 7f68a2a00640 1 --2- 172.21.15.175:0/2697150578 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6884066f60 0x7f6884069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:27.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.520+0000 7f68a2a00640 1 --2- 172.21.15.175:0/2697150578 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6884066f60 0x7f6884069420 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f68a415d880 tx=0x7f6890008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:27.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.524+0000 7f689b400640 1 -- 172.21.15.175:0/2697150578 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6894016620 con 0x7f68a406bd60 2024-04-25T09:08:27.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.704+0000 7f68aa000640 1 -- 172.21.15.175:0/2697150578 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68a40cc350 con 0x7f68a406bd60 2024-04-25T09:08:27.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.708+0000 7f689b400640 1 -- 172.21.15.175:0/2697150578 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f68940f11b0 con 0x7f68a406bd60 2024-04-25T09:08:27.696 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:27.696 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2493316948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2493316948},{"type":"v1","addr":"172.21.15.175:6837","nonce":2493316948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3408529232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3408529232},{"type":"v1","addr":"172.21.15.177:6834","nonce":3408529232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6513,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2714482688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2714482688},{"type":"v1","addr":"172.21.15.175:6836","nonce":2714482688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:08:17.378890+0000","modified":"2024-04-25T09:08:20.403261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"d","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1709110121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":1709110121},{"type":"v1","addr":"172.21.15.177:6835","nonce":1709110121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:08:27.697 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 43 2024-04-25T09:08:27.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.708+0000 7f68aa000640 1 -- 172.21.15.175:0/2697150578 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6884066f60 msgr2=0x7f6884069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:27.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.708+0000 7f68aa000640 1 --2- 172.21.15.175:0/2697150578 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6884066f60 0x7f6884069420 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f68a415d880 tx=0x7f6890008040 comp rx=0 tx=0).stop 2024-04-25T09:08:27.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.708+0000 7f68aa000640 1 -- 172.21.15.175:0/2697150578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a406bd60 msgr2=0x7f68a415c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:27.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.708+0000 7f68aa000640 1 --2- 172.21.15.175:0/2697150578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a406bd60 0x7f68a415c470 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f68940af040 tx=0x7f68940197d0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.708+0000 7f68aa000640 1 -- 172.21.15.175:0/2697150578 shutdown_connections 2024-04-25T09:08:27.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.708+0000 7f68aa000640 1 --2- 172.21.15.175:0/2697150578 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6884066f60 0x7f6884069420 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.708+0000 7f68aa000640 1 --2- 172.21.15.175:0/2697150578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68a40d0d50 0x7f68a4158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.708+0000 7f68aa000640 1 --2- 172.21.15.175:0/2697150578 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68a4099a50 0x7f68a4157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.708+0000 7f68aa000640 1 --2- 172.21.15.175:0/2697150578 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68a406bd60 0x7f68a415c470 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:27.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.708+0000 7f68aa000640 1 -- 172.21.15.175:0/2697150578 >> 172.21.15.175:0/2697150578 conn(0x7f68a40b3300 msgr2=0x7f68a40ae4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:27.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.708+0000 7f68aa000640 1 -- 172.21.15.175:0/2697150578 shutdown_connections 2024-04-25T09:08:27.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:27.708+0000 7f68aa000640 1 -- 172.21.15.175:0/2697150578 wait complete. 2024-04-25T09:08:28.121 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 43, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:08:17.378890+0000', 'modified': '2024-04-25T09:08:20.403261+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6528}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6528': {'gid': 6528, 'name': 'd', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.177:6835/1709110121', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6833', 'nonce': 1709110121}, {'type': 'v1', 'addr': '172.21.15.177:6835', 'nonce': 1709110121}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:08:28.121 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:08:28.121 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T09:08:28.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.268+0000 7fd254800640 1 Processor -- start 2024-04-25T09:08:28.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.268+0000 7fd254800640 1 -- start start 2024-04-25T09:08:28.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.272+0000 7fd254800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd24c15dd90 0x7fd24c162340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.272+0000 7fd254800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd24c06b9a0 0x7fd24c06ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.272+0000 7fd254800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd24c06ee70 0x7fd24c06b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.272+0000 7fd254800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24c161eb0 con 0x7fd24c15dd90 2024-04-25T09:08:28.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.272+0000 7fd254800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24c0cc3a0 con 0x7fd24c06ee70 2024-04-25T09:08:28.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.272+0000 7fd254800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0cc0c0 con 0x7fd24c06b9a0 2024-04-25T09:08:28.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.272+0000 7fd251e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd24c15dd90 0x7fd24c162340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.272+0000 7fd251e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd24c15dd90 0x7fd24c162340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60794/0 (socket says 172.21.15.175:60794) 2024-04-25T09:08:28.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.272+0000 7fd251e00640 1 -- 172.21.15.175:0/718137575 learned_addr learned my addr 172.21.15.175:0/718137575 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:28.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.272+0000 7fd251e00640 1 -- 172.21.15.175:0/718137575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd24c06b9a0 msgr2=0x7fd24c06ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:28.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.272+0000 7fd251e00640 1 --2- 172.21.15.175:0/718137575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd24c06b9a0 0x7fd24c06ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.272+0000 7fd251e00640 1 -- 172.21.15.175:0/718137575 >> v2:172.21.15.177:3300/0 conn(0x7fd24c06ee70 msgr2=0x7fd24c06b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:28.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.272+0000 7fd251e00640 1 --2- 172.21.15.175:0/718137575 >> v2:172.21.15.177:3300/0 conn(0x7fd24c06ee70 0x7fd24c06b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.272+0000 7fd251e00640 1 -- 172.21.15.175:0/718137575 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c161860 con 0x7fd24c15dd90 2024-04-25T09:08:28.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.272+0000 7fd251e00640 1 --2- 172.21.15.175:0/718137575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c15dd90 0x7fd24c162340 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd24c161700 tx=0x7fd24001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88687a8ae5282ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:28.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd250a00640 1 -- 172.21.15.175:0/718137575 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2400ab650 con 0x7fd24c15dd90 2024-04-25T09:08:28.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd250a00640 1 -- 172.21.15.175:0/718137575 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2400b0070 con 0x7fd24c15dd90 2024-04-25T09:08:28.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd250a00640 1 -- 172.21.15.175:0/718137575 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2400aba10 con 0x7fd24c15dd90 2024-04-25T09:08:28.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd254800640 1 -- 172.21.15.175:0/718137575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c15dd90 msgr2=0x7fd24c162340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:28.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd254800640 1 --2- 172.21.15.175:0/718137575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c15dd90 0x7fd24c162340 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fd24c161700 tx=0x7fd24001c4f0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd254800640 1 -- 172.21.15.175:0/718137575 shutdown_connections 2024-04-25T09:08:28.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd254800640 1 --2- 172.21.15.175:0/718137575 >> v2:172.21.15.177:3300/0 conn(0x7fd24c06ee70 0x7fd24c06b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd254800640 1 --2- 172.21.15.175:0/718137575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd24c06b9a0 0x7fd24c06ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd254800640 1 --2- 172.21.15.175:0/718137575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c15dd90 0x7fd24c162340 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd254800640 1 -- 172.21.15.175:0/718137575 >> 172.21.15.175:0/718137575 conn(0x7fd24c0cc5f0 msgr2=0x7fd24c0cca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:28.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd254800640 1 -- 172.21.15.175:0/718137575 shutdown_connections 2024-04-25T09:08:28.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd254800640 1 -- 172.21.15.175:0/718137575 wait complete. 2024-04-25T09:08:28.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd254800640 1 Processor -- start 2024-04-25T09:08:28.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd254800640 1 -- start start 2024-04-25T09:08:28.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd254800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c06b9a0 0x7fd24c14b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd254800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd24c06ee70 0x7fd24c1519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd254800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd24c15dd90 0x7fd24c0ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd254800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c15ed10 con 0x7fd24c06b9a0 2024-04-25T09:08:28.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd254800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c15eb90 con 0x7fd24c06ee70 2024-04-25T09:08:28.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd254800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c15ee90 con 0x7fd24c15dd90 2024-04-25T09:08:28.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd251e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c06b9a0 0x7fd24c14b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd251e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c06b9a0 0x7fd24c14b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60800/0 (socket says 172.21.15.175:60800) 2024-04-25T09:08:28.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.276+0000 7fd251e00640 1 -- 172.21.15.175:0/2586865056 learned_addr learned my addr 172.21.15.175:0/2586865056 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:28.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.280+0000 7fd252800640 1 --2- 172.21.15.175:0/2586865056 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd24c15dd90 0x7fd24c0ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.280+0000 7fd251400640 1 --2- 172.21.15.175:0/2586865056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd24c06ee70 0x7fd24c1519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.280+0000 7fd251e00640 1 -- 172.21.15.175:0/2586865056 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd24c15dd90 msgr2=0x7fd24c0ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:28.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.280+0000 7fd251e00640 1 --2- 172.21.15.175:0/2586865056 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd24c15dd90 0x7fd24c0ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.280+0000 7fd251e00640 1 -- 172.21.15.175:0/2586865056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd24c06ee70 msgr2=0x7fd24c1519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:28.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.280+0000 7fd251e00640 1 --2- 172.21.15.175:0/2586865056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd24c06ee70 0x7fd24c1519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.280+0000 7fd251e00640 1 -- 172.21.15.175:0/2586865056 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c1521e0 con 0x7fd24c06b9a0 2024-04-25T09:08:28.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.280+0000 7fd251e00640 1 --2- 172.21.15.175:0/2586865056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c06b9a0 0x7fd24c14b830 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd2400ad040 tx=0x7fd24001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:28.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.280+0000 7fd246000640 1 -- 172.21.15.175:0/2586865056 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2400b4600 con 0x7fd24c06b9a0 2024-04-25T09:08:28.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.280+0000 7fd246000640 1 -- 172.21.15.175:0/2586865056 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2400b47c0 con 0x7fd24c06b9a0 2024-04-25T09:08:28.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.280+0000 7fd254800640 1 -- 172.21.15.175:0/2586865056 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24c1524c0 con 0x7fd24c06b9a0 2024-04-25T09:08:28.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.280+0000 7fd246000640 1 -- 172.21.15.175:0/2586865056 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2400b4bb0 con 0x7fd24c06b9a0 2024-04-25T09:08:28.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.280+0000 7fd254800640 1 -- 172.21.15.175:0/2586865056 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c15f8e0 con 0x7fd24c06b9a0 2024-04-25T09:08:28.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.280+0000 7fd246000640 1 -- 172.21.15.175:0/2586865056 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd2400b3380 con 0x7fd24c06b9a0 2024-04-25T09:08:28.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.280+0000 7fd246000640 1 --2- 172.21.15.175:0/2586865056 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd230066f60 0x7fd230069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.280+0000 7fd246000640 1 -- 172.21.15.175:0/2586865056 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd24011f670 con 0x7fd24c06b9a0 2024-04-25T09:08:28.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.280+0000 7fd251400640 1 --2- 172.21.15.175:0/2586865056 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd230066f60 0x7fd230069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd257cbf000 1 Processor -- start 2024-04-25T09:08:28.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd257cbf000 1 -- start start 2024-04-25T09:08:28.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd251400640 1 --2- 172.21.15.175:0/2586865056 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd230066f60 0x7fd230069420 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd23c006fd0 tx=0x7fd23c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:28.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd257cbf000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb7d920 0x55715eb7dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd257cbf000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 0x55715eb339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd257cbf000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb33f30 0x55715eb34310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd257cbf000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715ea1b5f0 con 0x55715eb7e240 2024-04-25T09:08:28.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd257cbf000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715e982da0 con 0x55715eb33f30 2024-04-25T09:08:28.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd257cbf000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55715e90b150 con 0x55715eb7d920 2024-04-25T09:08:28.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd251400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 0x55715eb339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd251400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 0x55715eb339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60804/0 (socket says 172.21.15.175:60804) 2024-04-25T09:08:28.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd251400640 1 -- 172.21.15.175:0/948760340 learned_addr learned my addr 172.21.15.175:0/948760340 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:28.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd252800640 1 --2- 172.21.15.175:0/948760340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb33f30 0x55715eb34310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd251e00640 1 --2- 172.21.15.175:0/948760340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb7d920 0x55715eb7dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd251400640 1 -- 172.21.15.175:0/948760340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb7d920 msgr2=0x55715eb7dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:28.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd251400640 1 --2- 172.21.15.175:0/948760340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb7d920 0x55715eb7dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd251400640 1 -- 172.21.15.175:0/948760340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb33f30 msgr2=0x55715eb34310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:28.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd251400640 1 --2- 172.21.15.175:0/948760340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb33f30 0x55715eb34310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd251400640 1 -- 172.21.15.175:0/948760340 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55715e924ca0 con 0x55715eb7e240 2024-04-25T09:08:28.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd251400640 1 --2- 172.21.15.175:0/948760340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 0x55715eb339f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00d7e0 tx=0x7fd23c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35abe266f88ae120 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:28.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd23aa00640 1 -- 172.21.15.175:0/948760340 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c024070 con 0x55715eb7e240 2024-04-25T09:08:28.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd23aa00640 1 -- 172.21.15.175:0/948760340 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c0149b0 con 0x55715eb7e240 2024-04-25T09:08:28.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd23aa00640 1 -- 172.21.15.175:0/948760340 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c014d60 con 0x55715eb7e240 2024-04-25T09:08:28.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd257cbf000 1 -- 172.21.15.175:0/948760340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 msgr2=0x55715eb339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:28.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd257cbf000 1 --2- 172.21.15.175:0/948760340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 0x55715eb339f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00d7e0 tx=0x7fd23c010000 comp rx=0 tx=0).stop 2024-04-25T09:08:28.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd257cbf000 1 -- 172.21.15.175:0/948760340 shutdown_connections 2024-04-25T09:08:28.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd257cbf000 1 --2- 172.21.15.175:0/948760340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb33f30 0x55715eb34310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd257cbf000 1 --2- 172.21.15.175:0/948760340 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 0x55715eb339f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd257cbf000 1 --2- 172.21.15.175:0/948760340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb7d920 0x55715eb7dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd257cbf000 1 -- 172.21.15.175:0/948760340 >> 172.21.15.175:0/948760340 conn(0x55715eb3a2a0 msgr2=0x55715eb322d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:28.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd257cbf000 1 -- 172.21.15.175:0/948760340 shutdown_connections 2024-04-25T09:08:28.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.284+0000 7fd257cbf000 1 -- 172.21.15.175:0/948760340 wait complete. 2024-04-25T09:08:28.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd257cbf000 1 -- start start 2024-04-25T09:08:28.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd257cbf000 1 Processor -- start 2024-04-25T09:08:28.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd257cbf000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb33f30 0x55715eb84e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd257cbf000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb7d920 0x55715eb853a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd257cbf000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 0x55715eb37aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd257cbf000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715e93d990 con 0x55715eb7e240 2024-04-25T09:08:28.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd257cbf000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715e97ee40 con 0x55715eb33f30 2024-04-25T09:08:28.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd257cbf000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55715e90e900 con 0x55715eb7d920 2024-04-25T09:08:28.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd257cbf000 10 client.0 _ll_register_callbacks cb 0x55715ea361c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:28.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd252800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 0x55715eb37aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd252800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 0x55715eb37aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60808/0 (socket says 172.21.15.175:60808) 2024-04-25T09:08:28.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd252800640 1 -- 172.21.15.175:0/3941740715 learned_addr learned my addr 172.21.15.175:0/3941740715 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:28.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd251400640 1 --2- 172.21.15.175:0/3941740715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb7d920 0x55715eb853a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd251e00640 1 --2- 172.21.15.175:0/3941740715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb33f30 0x55715eb84e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd252800640 1 -- 172.21.15.175:0/3941740715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb7d920 msgr2=0x55715eb853a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:28.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd252800640 1 --2- 172.21.15.175:0/3941740715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb7d920 0x55715eb853a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd252800640 1 -- 172.21.15.175:0/3941740715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb33f30 msgr2=0x55715eb84e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:28.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd252800640 1 --2- 172.21.15.175:0/3941740715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb33f30 0x55715eb84e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd252800640 1 -- 172.21.15.175:0/3941740715 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55715e93b630 con 0x55715eb7e240 2024-04-25T09:08:28.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd251e00640 1 --2- 172.21.15.175:0/3941740715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb33f30 0x55715eb84e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:28.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd252800640 1 --2- 172.21.15.175:0/3941740715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 0x55715eb37aa0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fd24800be50 tx=0x7fd248007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1822d9a2d303f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:28.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd22f400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:08:28.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd22f400640 1 -- 172.21.15.175:0/3941740715 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248007bd0 con 0x55715eb7e240 2024-04-25T09:08:28.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd22f400640 1 -- 172.21.15.175:0/3941740715 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd248007d70 con 0x55715eb7e240 2024-04-25T09:08:28.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd257cbf000 1 -- 172.21.15.175:0/3941740715 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd23c0149b0 con 0x55715eb7e240 2024-04-25T09:08:28.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd22f400640 1 -- 172.21.15.175:0/3941740715 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd248019410 con 0x55715eb7e240 2024-04-25T09:08:28.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd257cbf000 10 client.6672 fetch_fsmap learned FSMap version 43 2024-04-25T09:08:28.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd257cbf000 1 -- 172.21.15.175:0/3941740715 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55715e90b3a0 con 0x55715eb7e240 2024-04-25T09:08:28.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd22f400640 1 -- 172.21.15.175:0/3941740715 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c0149b0 con 0x55715eb7e240 2024-04-25T09:08:28.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd22f400640 1 -- 172.21.15.175:0/3941740715 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd248026080 con 0x55715eb7e240 2024-04-25T09:08:28.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd257cbf000 10 client.6672 fetch_fsmap finished waiting for FSMap version 43 2024-04-25T09:08:28.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd257cbf000 10 client.6672 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T09:08:28.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd257cbf000 20 client.6672 populate_metadata read hostname 'smithi175' 2024-04-25T09:08:28.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd257cbf000 1 --2- 172.21.15.175:0/3941740715 >> [v2:172.21.15.177:6833/1709110121,v1:172.21.15.177:6835/1709110121] conn(0x55715eb39160 0x55715eb8eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd257cbf000 4 client.6672 mds_command: new command op to 6528 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:08:28.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd257cbf000 1 -- 172.21.15.175:0/3941740715 --> [v2:172.21.15.177:6833/1709110121,v1:172.21.15.177:6835/1709110121] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55715e91ea50 con 0x55715eb39160 2024-04-25T09:08:28.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd251e00640 1 --2- 172.21.15.175:0/3941740715 >> [v2:172.21.15.177:6833/1709110121,v1:172.21.15.177:6835/1709110121] conn(0x55715eb39160 0x55715eb8eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd251e00640 1 --2- 172.21.15.175:0/3941740715 >> [v2:172.21.15.177:6833/1709110121,v1:172.21.15.177:6835/1709110121] conn(0x55715eb39160 0x55715eb8eec0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f3e8af2892ee4f2 server_cookie=d588d22cbd1d3388 in_seq=0 out_seq=0 2024-04-25T09:08:28.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.288+0000 7fd22f400640 10 client.6672 ms_handle_connect on v2:172.21.15.177:6833/1709110121 2024-04-25T09:08:28.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.292+0000 7fd22f400640 1 -- 172.21.15.175:0/3941740715 <== mds.0 v2:172.21.15.177:6833/1709110121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55715e91ea50 con 0x55715eb39160 2024-04-25T09:08:28.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.292+0000 7fd22f400640 10 client.6672 handle_command_reply: tid=0 2024-04-25T09:08:28.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.292+0000 7fd257cbf000 1 client.6672 shutdown 2024-04-25T09:08:28.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.292+0000 7fd257cbf000 1 -- 172.21.15.175:0/3941740715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 msgr2=0x55715eb37aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:28.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.292+0000 7fd257cbf000 1 --2- 172.21.15.175:0/3941740715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 0x55715eb37aa0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fd24800be50 tx=0x7fd248007680 comp rx=0 tx=0).stop 2024-04-25T09:08:28.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.292+0000 7fd257cbf000 1 -- 172.21.15.175:0/3941740715 shutdown_connections 2024-04-25T09:08:28.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.292+0000 7fd257cbf000 1 --2- 172.21.15.175:0/3941740715 >> [v2:172.21.15.177:6833/1709110121,v1:172.21.15.177:6835/1709110121] conn(0x55715eb39160 0x55715eb8eec0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.292+0000 7fd257cbf000 1 --2- 172.21.15.175:0/3941740715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 0x55715eb37aa0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.292+0000 7fd257cbf000 1 --2- 172.21.15.175:0/3941740715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb7d920 0x55715eb853a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.292+0000 7fd257cbf000 1 --2- 172.21.15.175:0/3941740715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb33f30 0x55715eb84e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.292+0000 7fd22f400640 0 client.6672 ms_handle_reset on v2:172.21.15.177:6833/1709110121 2024-04-25T09:08:28.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.292+0000 7fd257cbf000 1 -- 172.21.15.175:0/3941740715 >> 172.21.15.175:0/3941740715 conn(0x55715eb3a2a0 msgr2=0x55715eb329e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:28.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.292+0000 7fd257cbf000 1 -- 172.21.15.175:0/3941740715 shutdown_connections 2024-04-25T09:08:28.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.292+0000 7fd257cbf000 1 -- 172.21.15.175:0/3941740715 wait complete. 2024-04-25T09:08:28.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.292+0000 7fd257cbf000 20 client.6672 trim_cache size 0 max 16384 2024-04-25T09:08:28.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 Processor -- start 2024-04-25T09:08:28.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 -- start start 2024-04-25T09:08:28.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb33f30 0x55715ebd9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7d920 0x55715ebd98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb7e240 0x55715ebd9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c201c40 con 0x55715eb7d920 2024-04-25T09:08:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c1501a0 con 0x55715eb7e240 2024-04-25T09:08:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c201640 con 0x55715eb33f30 2024-04-25T09:08:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd251400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7d920 0x55715ebd98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd251400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7d920 0x55715ebd98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60820/0 (socket says 172.21.15.175:60820) 2024-04-25T09:08:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd251400640 1 -- 172.21.15.175:0/4031192932 learned_addr learned my addr 172.21.15.175:0/4031192932 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd251e00640 1 --2- 172.21.15.175:0/4031192932 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb33f30 0x55715ebd9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd252800640 1 --2- 172.21.15.175:0/4031192932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb7e240 0x55715ebd9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd251400640 1 -- 172.21.15.175:0/4031192932 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb33f30 msgr2=0x55715ebd9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd251400640 1 --2- 172.21.15.175:0/4031192932 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb33f30 0x55715ebd9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd251400640 1 -- 172.21.15.175:0/4031192932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb7e240 msgr2=0x55715ebd9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd251400640 1 --2- 172.21.15.175:0/4031192932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb7e240 0x55715ebd9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd251400640 1 -- 172.21.15.175:0/4031192932 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55715eb7e070 con 0x55715eb7d920 2024-04-25T09:08:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd251400640 1 --2- 172.21.15.175:0/4031192932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7d920 0x55715ebd98b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd23c008010 tx=0x7fd23c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7bacd70732361cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd23a000640 1 -- 172.21.15.175:0/4031192932 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c024040 con 0x55715eb7d920 2024-04-25T09:08:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd23a000640 1 -- 172.21.15.175:0/4031192932 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c025040 con 0x55715eb7d920 2024-04-25T09:08:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd23a000640 1 -- 172.21.15.175:0/4031192932 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c014d40 con 0x55715eb7d920 2024-04-25T09:08:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 -- 172.21.15.175:0/4031192932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7d920 msgr2=0x55715ebd98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 --2- 172.21.15.175:0/4031192932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7d920 0x55715ebd98b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fd23c008010 tx=0x7fd23c012000 comp rx=0 tx=0).stop 2024-04-25T09:08:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 -- 172.21.15.175:0/4031192932 shutdown_connections 2024-04-25T09:08:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 --2- 172.21.15.175:0/4031192932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb7e240 0x55715ebd9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 --2- 172.21.15.175:0/4031192932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7d920 0x55715ebd98b0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 --2- 172.21.15.175:0/4031192932 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb33f30 0x55715ebd9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 -- 172.21.15.175:0/4031192932 >> 172.21.15.175:0/4031192932 conn(0x55715eb3a2a0 msgr2=0x55715eb37220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 -- 172.21.15.175:0/4031192932 shutdown_connections 2024-04-25T09:08:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 -- 172.21.15.175:0/4031192932 wait complete. 2024-04-25T09:08:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 -- start start 2024-04-25T09:08:28.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.308+0000 7fd257cbf000 1 Processor -- start 2024-04-25T09:08:28.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb33f30 0x55715ebdea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb7d920 0x55715ebdef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 0x55715ebdafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715e9873d0 con 0x55715eb7e240 2024-04-25T09:08:28.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55715ea3ed50 con 0x55715eb33f30 2024-04-25T09:08:28.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55715e91d980 con 0x55715eb7d920 2024-04-25T09:08:28.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 10 client.0 _ll_register_callbacks cb 0x7fd23c0095a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:28.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd252800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 0x55715ebdafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd252800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 0x55715ebdafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60828/0 (socket says 172.21.15.175:60828) 2024-04-25T09:08:28.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd252800640 1 -- 172.21.15.175:0/1277676823 learned_addr learned my addr 172.21.15.175:0/1277676823 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:28.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd251e00640 1 --2- 172.21.15.175:0/1277676823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb33f30 0x55715ebdea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd251400640 1 --2- 172.21.15.175:0/1277676823 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb7d920 0x55715ebdef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd252800640 1 -- 172.21.15.175:0/1277676823 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb7d920 msgr2=0x55715ebdef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd252800640 1 --2- 172.21.15.175:0/1277676823 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb7d920 0x55715ebdef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd252800640 1 -- 172.21.15.175:0/1277676823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb33f30 msgr2=0x55715ebdea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd252800640 1 --2- 172.21.15.175:0/1277676823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb33f30 0x55715ebdea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd252800640 1 -- 172.21.15.175:0/1277676823 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55715ea04600 con 0x55715eb7e240 2024-04-25T09:08:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd252800640 1 --2- 172.21.15.175:0/1277676823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 0x55715ebdafb0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd24800be50 tx=0x7fd248004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fde2a4945de34dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd22f400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:08:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd22f400640 1 -- 172.21.15.175:0/1277676823 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2480097b0 con 0x55715eb7e240 2024-04-25T09:08:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd22f400640 1 -- 172.21.15.175:0/1277676823 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd248002040 con 0x55715eb7e240 2024-04-25T09:08:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 1 -- 172.21.15.175:0/1277676823 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd23c025040 con 0x55715eb7e240 2024-04-25T09:08:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd22f400640 1 -- 172.21.15.175:0/1277676823 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd248019c20 con 0x55715eb7e240 2024-04-25T09:08:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 10 client.6678 fetch_fsmap learned FSMap version 43 2024-04-25T09:08:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 1 -- 172.21.15.175:0/1277676823 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=2+}) v3 -- 0x55715e9179b0 con 0x55715eb7e240 2024-04-25T09:08:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd22f400640 1 -- 172.21.15.175:0/1277676823 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c025040 con 0x55715eb7e240 2024-04-25T09:08:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd22f400640 1 -- 172.21.15.175:0/1277676823 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 43) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd248035050 con 0x55715eb7e240 2024-04-25T09:08:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 10 client.6678 fetch_fsmap finished waiting for FSMap version 43 2024-04-25T09:08:28.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 10 client.6678 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T09:08:28.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 20 client.6678 populate_metadata read hostname 'smithi175' 2024-04-25T09:08:28.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 1 --2- 172.21.15.175:0/1277676823 >> [v2:172.21.15.177:6833/1709110121,v1:172.21.15.177:6835/1709110121] conn(0x55715ebdb4f0 0x55715ebdb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 4 client.6678 mds_command: new command op to 6528 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:08:28.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 1 -- 172.21.15.175:0/1277676823 --> [v2:172.21.15.177:6833/1709110121,v1:172.21.15.177:6835/1709110121] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55715e9902e0 con 0x55715ebdb4f0 2024-04-25T09:08:28.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd251e00640 1 --2- 172.21.15.175:0/1277676823 >> [v2:172.21.15.177:6833/1709110121,v1:172.21.15.177:6835/1709110121] conn(0x55715ebdb4f0 0x55715ebdb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd251e00640 1 --2- 172.21.15.175:0/1277676823 >> [v2:172.21.15.177:6833/1709110121,v1:172.21.15.177:6835/1709110121] conn(0x55715ebdb4f0 0x55715ebdb8d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1adc793495ff52d server_cookie=33121b910757e299 in_seq=0 out_seq=0 2024-04-25T09:08:28.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd22f400640 10 client.6678 ms_handle_connect on v2:172.21.15.177:6833/1709110121 2024-04-25T09:08:28.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd22f400640 1 -- 172.21.15.175:0/1277676823 <== mds.0 v2:172.21.15.177:6833/1709110121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55715e9902e0 con 0x55715ebdb4f0 2024-04-25T09:08:28.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd22f400640 10 client.6678 handle_command_reply: tid=0 2024-04-25T09:08:28.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 1 client.6678 shutdown 2024-04-25T09:08:28.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 1 -- 172.21.15.175:0/1277676823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 msgr2=0x55715ebdafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:28.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 1 --2- 172.21.15.175:0/1277676823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 0x55715ebdafb0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd24800be50 tx=0x7fd248004b60 comp rx=0 tx=0).stop 2024-04-25T09:08:28.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 1 -- 172.21.15.175:0/1277676823 shutdown_connections 2024-04-25T09:08:28.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.312+0000 7fd257cbf000 1 --2- 172.21.15.175:0/1277676823 >> [v2:172.21.15.177:6833/1709110121,v1:172.21.15.177:6835/1709110121] conn(0x55715ebdb4f0 0x55715ebdb8d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd257cbf000 1 --2- 172.21.15.175:0/1277676823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55715eb7e240 0x55715ebdafb0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd257cbf000 1 --2- 172.21.15.175:0/1277676823 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55715eb7d920 0x55715ebdef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd257cbf000 1 --2- 172.21.15.175:0/1277676823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55715eb33f30 0x55715ebdea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd22f400640 0 client.6678 ms_handle_reset on v2:172.21.15.177:6833/1709110121 2024-04-25T09:08:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd257cbf000 1 -- 172.21.15.175:0/1277676823 >> 172.21.15.175:0/1277676823 conn(0x55715eb3a2a0 msgr2=0x55715eb85a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd257cbf000 1 -- 172.21.15.175:0/1277676823 shutdown_connections 2024-04-25T09:08:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd257cbf000 1 -- 172.21.15.175:0/1277676823 wait complete. 2024-04-25T09:08:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd257cbf000 20 client.6678 trim_cache size 0 max 16384 2024-04-25T09:08:28.307 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:08:28.307 INFO:teuthology.orchestra.run.smithi175.stdout: "cluster_fsid": "8caed986-ca08-40e2-b5a5-12e2aade6223", 2024-04-25T09:08:28.307 INFO:teuthology.orchestra.run.smithi175.stdout: "whoami": 0, 2024-04-25T09:08:28.307 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 6528, 2024-04-25T09:08:28.308 INFO:teuthology.orchestra.run.smithi175.stdout: "want_state": "up:active", 2024-04-25T09:08:28.308 INFO:teuthology.orchestra.run.smithi175.stdout: "state": "up:active", 2024-04-25T09:08:28.308 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs", 2024-04-25T09:08:28.308 INFO:teuthology.orchestra.run.smithi175.stdout: "rank_uptime": 10.302657440000001, 2024-04-25T09:08:28.308 INFO:teuthology.orchestra.run.smithi175.stdout: "mdsmap_epoch": 43, 2024-04-25T09:08:28.308 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch": 69, 2024-04-25T09:08:28.308 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch_barrier": 69, 2024-04-25T09:08:28.308 INFO:teuthology.orchestra.run.smithi175.stdout: "uptime": 15.170007059 2024-04-25T09:08:28.308 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:08:28.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd254800640 1 -- 172.21.15.175:0/2586865056 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd230066f60 msgr2=0x7fd230069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:28.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd254800640 1 --2- 172.21.15.175:0/2586865056 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd230066f60 0x7fd230069420 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd23c006fd0 tx=0x7fd23c008040 comp rx=0 tx=0).stop 2024-04-25T09:08:28.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd254800640 1 -- 172.21.15.175:0/2586865056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c06b9a0 msgr2=0x7fd24c14b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:28.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd254800640 1 --2- 172.21.15.175:0/2586865056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c06b9a0 0x7fd24c14b830 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd2400ad040 tx=0x7fd24001ad30 comp rx=0 tx=0).stop 2024-04-25T09:08:28.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd254800640 1 -- 172.21.15.175:0/2586865056 shutdown_connections 2024-04-25T09:08:28.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd254800640 1 --2- 172.21.15.175:0/2586865056 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd230066f60 0x7fd230069420 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd254800640 1 --2- 172.21.15.175:0/2586865056 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd24c15dd90 0x7fd24c0ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd254800640 1 --2- 172.21.15.175:0/2586865056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd24c06ee70 0x7fd24c1519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd254800640 1 --2- 172.21.15.175:0/2586865056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c06b9a0 0x7fd24c14b830 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd254800640 1 -- 172.21.15.175:0/2586865056 >> 172.21.15.175:0/2586865056 conn(0x7fd24c0cc5f0 msgr2=0x7fd24c0cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:28.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd254800640 1 -- 172.21.15.175:0/2586865056 shutdown_connections 2024-04-25T09:08:28.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.316+0000 7fd254800640 1 -- 172.21.15.175:0/2586865056 wait complete. 2024-04-25T09:08:28.323 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:08:28.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.468+0000 7f4c9e200640 1 Processor -- start 2024-04-25T09:08:28.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.468+0000 7f4c9e200640 1 -- start start 2024-04-25T09:08:28.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.472+0000 7f4c9e200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4c98144fc0 0x7f4c980cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.472+0000 7f4c9e200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c9815cd00 con 0x7f4c981453a0 2024-04-25T09:08:28.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.472+0000 7f4c9e200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c980ce660 con 0x7f4c9815c5e0 2024-04-25T09:08:28.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.472+0000 7f4c9e200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c980cc930 con 0x7f4c98144fc0 2024-04-25T09:08:28.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.472+0000 7f4c97400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4c98144fc0 0x7f4c980cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.472+0000 7f4c97400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4c98144fc0 0x7f4c980cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60832/0 (socket says 172.21.15.175:60832) 2024-04-25T09:08:28.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.472+0000 7f4c97400640 1 -- 172.21.15.175:0/175452415 learned_addr learned my addr 172.21.15.175:0/175452415 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:28.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.472+0000 7f4c97400640 1 -- 172.21.15.175:0/175452415 >> v1:172.21.15.177:6789/0 conn(0x7f4c9815c5e0 legacy=0x7f4c980cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:28.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.472+0000 7f4c97400640 1 -- 172.21.15.175:0/175452415 >> v1:172.21.15.175:6789/0 conn(0x7f4c981453a0 legacy=0x7f4c9815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:28.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.472+0000 7f4c97400640 1 -- 172.21.15.175:0/175452415 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c980ccc10 con 0x7f4c98144fc0 2024-04-25T09:08:28.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.472+0000 7f4c97400640 1 --2- 172.21.15.175:0/175452415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c98144fc0 0x7f4c980cbe70 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4c880098a0 tx=0x7f4c8801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c79c0480898d8dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:28.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c96a00640 1 -- 172.21.15.175:0/175452415 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c880ab430 con 0x7f4c98144fc0 2024-04-25T09:08:28.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c96a00640 1 -- 172.21.15.175:0/175452415 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c880b0070 con 0x7f4c98144fc0 2024-04-25T09:08:28.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c96a00640 1 -- 172.21.15.175:0/175452415 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c880ab7f0 con 0x7f4c98144fc0 2024-04-25T09:08:28.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c9e200640 1 -- 172.21.15.175:0/175452415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c98144fc0 msgr2=0x7f4c980cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:28.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c9e200640 1 --2- 172.21.15.175:0/175452415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c98144fc0 0x7f4c980cbe70 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f4c880098a0 tx=0x7f4c8801c540 comp rx=0 tx=0).stop 2024-04-25T09:08:28.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c9e200640 1 -- 172.21.15.175:0/175452415 shutdown_connections 2024-04-25T09:08:28.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c9e200640 1 --2- 172.21.15.175:0/175452415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c98144fc0 0x7f4c980cbe70 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c9e200640 1 -- 172.21.15.175:0/175452415 >> 172.21.15.175:0/175452415 conn(0x7f4c98067150 msgr2=0x7f4c9806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:28.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c9e200640 1 -- 172.21.15.175:0/175452415 shutdown_connections 2024-04-25T09:08:28.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c9e200640 1 -- 172.21.15.175:0/175452415 wait complete. 2024-04-25T09:08:28.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c9e200640 1 Processor -- start 2024-04-25T09:08:28.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c9e200640 1 -- start start 2024-04-25T09:08:28.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c9e200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c981453a0 0x7f4c981573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c9e200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4c9815c5e0 0x7f4c98159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c9e200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c98138ef0 0x7f4c9815ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c9e200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c98169600 con 0x7f4c98138ef0 2024-04-25T09:08:28.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c9e200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c980cff50 con 0x7f4c981453a0 2024-04-25T09:08:28.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c9e200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c98169780 con 0x7f4c9815c5e0 2024-04-25T09:08:28.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c97e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c98138ef0 0x7f4c9815ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c97e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c98138ef0 0x7f4c9815ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60848/0 (socket says 172.21.15.175:60848) 2024-04-25T09:08:28.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c97e00640 1 -- 172.21.15.175:0/21299730 learned_addr learned my addr 172.21.15.175:0/21299730 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:28.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c97e00640 1 -- 172.21.15.175:0/21299730 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4c9815c5e0 msgr2=0x7f4c98159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:28.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c97e00640 1 --2- 172.21.15.175:0/21299730 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4c9815c5e0 0x7f4c98159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c97e00640 1 -- 172.21.15.175:0/21299730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c981453a0 msgr2=0x7f4c981573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:28.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c97e00640 1 --2- 172.21.15.175:0/21299730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c981453a0 0x7f4c981573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.476+0000 7f4c97e00640 1 -- 172.21.15.175:0/21299730 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9815a1c0 con 0x7f4c98138ef0 2024-04-25T09:08:28.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.480+0000 7f4c97e00640 1 --2- 172.21.15.175:0/21299730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c98138ef0 0x7f4c9815ab90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000c730 tx=0x7f4c9000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:28.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.480+0000 7f4c8fe00640 1 -- 172.21.15.175:0/21299730 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c90003ba0 con 0x7f4c98138ef0 2024-04-25T09:08:28.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.480+0000 7f4c8fe00640 1 -- 172.21.15.175:0/21299730 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c90003d40 con 0x7f4c98138ef0 2024-04-25T09:08:28.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.480+0000 7f4c8fe00640 1 -- 172.21.15.175:0/21299730 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c90005310 con 0x7f4c98138ef0 2024-04-25T09:08:28.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.480+0000 7f4c9e200640 1 -- 172.21.15.175:0/21299730 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c9815a4a0 con 0x7f4c98138ef0 2024-04-25T09:08:28.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.480+0000 7f4c9e200640 1 -- 172.21.15.175:0/21299730 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c980acb10 con 0x7f4c98138ef0 2024-04-25T09:08:28.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.480+0000 7f4c9e200640 1 -- 172.21.15.175:0/21299730 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c980acd10 con 0x7f4c98138ef0 2024-04-25T09:08:28.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.480+0000 7f4c8fe00640 1 -- 172.21.15.175:0/21299730 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4c900056c0 con 0x7f4c98138ef0 2024-04-25T09:08:28.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.480+0000 7f4c8fe00640 1 --2- 172.21.15.175:0/21299730 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4c74066f60 0x7f4c74069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:28.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.480+0000 7f4c8fe00640 1 -- 172.21.15.175:0/21299730 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c90085100 con 0x7f4c98138ef0 2024-04-25T09:08:28.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.480+0000 7f4c97400640 1 --2- 172.21.15.175:0/21299730 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4c74066f60 0x7f4c74069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:28.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.484+0000 7f4c97400640 1 --2- 172.21.15.175:0/21299730 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4c74066f60 0x7f4c74069420 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4c880af000 tx=0x7f4c88004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:28.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.484+0000 7f4c8fe00640 1 -- 172.21.15.175:0/21299730 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4c980acd10 con 0x7f4c98138ef0 2024-04-25T09:08:28.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.672+0000 7f4c9e200640 1 -- 172.21.15.175:0/21299730 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4c98074a60 con 0x7f4c98138ef0 2024-04-25T09:08:28.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.676+0000 7f4c8fe00640 1 -- 172.21.15.175:0/21299730 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v43) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4c90056100 con 0x7f4c98138ef0 2024-04-25T09:08:28.664 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:08:28.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.676+0000 7f4c9e200640 1 -- 172.21.15.175:0/21299730 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4c74066f60 msgr2=0x7f4c74069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:28.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.676+0000 7f4c9e200640 1 --2- 172.21.15.175:0/21299730 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4c74066f60 0x7f4c74069420 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4c880af000 tx=0x7f4c88004740 comp rx=0 tx=0).stop 2024-04-25T09:08:28.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.676+0000 7f4c9e200640 1 -- 172.21.15.175:0/21299730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c98138ef0 msgr2=0x7f4c9815ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:28.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.676+0000 7f4c9e200640 1 --2- 172.21.15.175:0/21299730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c98138ef0 0x7f4c9815ab90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f4c9000c730 tx=0x7f4c9000cbf0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.676+0000 7f4c9e200640 1 -- 172.21.15.175:0/21299730 shutdown_connections 2024-04-25T09:08:28.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.676+0000 7f4c9e200640 1 --2- 172.21.15.175:0/21299730 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4c74066f60 0x7f4c74069420 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.676+0000 7f4c9e200640 1 --2- 172.21.15.175:0/21299730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c98138ef0 0x7f4c9815ab90 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.676+0000 7f4c9e200640 1 --2- 172.21.15.175:0/21299730 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4c9815c5e0 0x7f4c98159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.676+0000 7f4c9e200640 1 --2- 172.21.15.175:0/21299730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c981453a0 0x7f4c981573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:28.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.676+0000 7f4c9e200640 1 -- 172.21.15.175:0/21299730 >> 172.21.15.175:0/21299730 conn(0x7f4c98144fc0 msgr2=0x7f4c9806ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:28.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.676+0000 7f4c9e200640 1 -- 172.21.15.175:0/21299730 shutdown_connections 2024-04-25T09:08:28.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:28.676+0000 7f4c9e200640 1 -- 172.21.15.175:0/21299730 wait complete. 2024-04-25T09:08:28.685 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:08:28.685 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:08:28.685 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-25T09:08:28.685 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:08:28.685 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:08:28.685 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:08:28.685 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:08:28.686 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:08:28.686 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:08:28.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:28.686 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-25T09:08:28.695 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:08:28.695 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:08:28.695 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:08:28.695 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:28.695 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:08:28.695 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:28.695 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:08:28.695 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-25T09:08:28.696 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-25T09:08:28.696 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:08:28.696 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-25T09:08:28.696 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-25T09:08:28.696 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:08:28.696 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:08:28.696 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:08:28.696 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:08:28.696 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:08:28.696 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42210sec preferred_lft 42210sec 2024-04-25T09:08:28.696 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-25T09:08:28.696 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:28.696 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:08:28.696 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:0d:71:4a:a6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:08:28.696 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:08:28.696 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:28.697 INFO:teuthology.orchestra.run.smithi175.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:08:28.697 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:08:28.697 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:08:28.697 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:28.697 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:08:28.697 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:28.697 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:08:28.697 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:08:28.697 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:08:28.697 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:28.697 INFO:teuthology.orchestra.run.smithi175.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:08:28.697 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:08:28.697 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:08:28.697 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:28.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:28.698 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:08:28.756 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:08:28.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:28.759 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-25T09:08:28.810 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-25T09:08:28.810 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:08:28.810 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:08:28.810 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:08:28.810 INFO:teuthology.orchestra.run.smithi175.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:08:28.810 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:08:28.810 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:08:28.810 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:08:28.810 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:08:28.810 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:08:28.810 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:08:28.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:28.811 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:08:28.811 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:08:28.811 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:08:28.811 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:08:28.811 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:08:28.811 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:08:28.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:28.901 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:08:28.910 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:08:28.910 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:08:28.910 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:08:28.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:28.911 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-25T09:08:28.974 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:08:28.975 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:08:29.023 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:08:29.023 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:08:29.024 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:08:29.074 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:08:29.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:29.075 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:08:29.163 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:08:29.163 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:08:29.163 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:08:29.178 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:08:29.178 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:08:29.178 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:08:29.178 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:08:29.178 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:08:29.188 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:08:29.188 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:08:29.188 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:08:29.188 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:08:29.188 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:08:29.188 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:08:29.188 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:08:29.188 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:08:29.191 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:08:29.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:29.192 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:08:29.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:29.211 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:08:29.279 INFO:teuthology.orchestra.run.smithi175.stdout:client6690 2024-04-25T09:08:29.279 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:08:29.279 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:08:29.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:29.327 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/) 2024-04-25T09:08:29.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:29.387 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_undamaged) 2024-04-25T09:08:29.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:29.438 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_to_be_damaged) 2024-04-25T09:08:29.487 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:08:29.487 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:08:29.487 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:08:29.488 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:08:29.488 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-04-25T09:08:29.488 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:08:29.594 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627776 2024-04-25T09:08:29.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:08:29.603 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:08:29.603 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:08:29.659 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:08:29.659 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:08:29.711 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:08:29.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.896+0000 7fd78f800640 1 Processor -- start 2024-04-25T09:08:29.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.896+0000 7fd78f800640 1 -- start start 2024-04-25T09:08:29.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.900+0000 7fd78f800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd788144fc0 0x7fd7880cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:29.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.900+0000 7fd78f800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7881453a0 0x7fd78815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:29.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.900+0000 7fd78f800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd7880cc3b0 0x7fd78815c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:29.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.900+0000 7fd78f800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78815cd00 con 0x7fd7880cc3b0 2024-04-25T09:08:29.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.900+0000 7fd78f800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7880ce660 con 0x7fd788144fc0 2024-04-25T09:08:29.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.900+0000 7fd78f800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7880cc930 con 0x7fd7881453a0 2024-04-25T09:08:29.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.900+0000 7fd78d800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd7880cc3b0 0x7fd78815c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:29.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.900+0000 7fd78d800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd7880cc3b0 0x7fd78815c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41096/0 (socket says 172.21.15.175:41096) 2024-04-25T09:08:29.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.900+0000 7fd78d800640 1 -- 172.21.15.175:0/4084942817 learned_addr learned my addr 172.21.15.175:0/4084942817 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.900+0000 7fd78ce00640 1 --2- 172.21.15.175:0/4084942817 >> v2:172.21.15.177:3300/0 conn(0x7fd788144fc0 0x7fd7880cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.900+0000 7fd78d800640 1 -- 172.21.15.175:0/4084942817 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7881453a0 msgr2=0x7fd78815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.900+0000 7fd77fe00640 1 --2- 172.21.15.175:0/4084942817 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7881453a0 0x7fd78815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.900+0000 7fd78d800640 1 --2- 172.21.15.175:0/4084942817 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7881453a0 0x7fd78815bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.900+0000 7fd78d800640 1 -- 172.21.15.175:0/4084942817 >> v2:172.21.15.177:3300/0 conn(0x7fd788144fc0 msgr2=0x7fd7880cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.900+0000 7fd78d800640 1 --2- 172.21.15.175:0/4084942817 >> v2:172.21.15.177:3300/0 conn(0x7fd788144fc0 0x7fd7880cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.900+0000 7fd78d800640 1 -- 172.21.15.175:0/4084942817 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7880ccc10 con 0x7fd7880cc3b0 2024-04-25T09:08:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.900+0000 7fd78ce00640 1 --2- 172.21.15.175:0/4084942817 >> v2:172.21.15.177:3300/0 conn(0x7fd788144fc0 0x7fd7880cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.900+0000 7fd77fe00640 1 --2- 172.21.15.175:0/4084942817 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7881453a0 0x7fd78815bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:29.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.904+0000 7fd78d800640 1 --2- 172.21.15.175:0/4084942817 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7880cc3b0 0x7fd78815c410 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd7880b4c00 tx=0x7fd78001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978aec7d652efbc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:29.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.904+0000 7fd787e00640 1 -- 172.21.15.175:0/4084942817 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7800ab5f0 con 0x7fd7880cc3b0 2024-04-25T09:08:29.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.904+0000 7fd787e00640 1 -- 172.21.15.175:0/4084942817 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7800b0070 con 0x7fd7880cc3b0 2024-04-25T09:08:29.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.904+0000 7fd787e00640 1 -- 172.21.15.175:0/4084942817 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7800ab9b0 con 0x7fd7880cc3b0 2024-04-25T09:08:29.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.904+0000 7fd78f800640 1 -- 172.21.15.175:0/4084942817 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7880cc3b0 msgr2=0x7fd78815c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:29.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.904+0000 7fd78f800640 1 --2- 172.21.15.175:0/4084942817 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7880cc3b0 0x7fd78815c410 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fd7880b4c00 tx=0x7fd78001c520 comp rx=0 tx=0).stop 2024-04-25T09:08:29.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.904+0000 7fd78f800640 1 -- 172.21.15.175:0/4084942817 shutdown_connections 2024-04-25T09:08:29.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.904+0000 7fd78f800640 1 --2- 172.21.15.175:0/4084942817 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7880cc3b0 0x7fd78815c410 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:29.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.904+0000 7fd78f800640 1 --2- 172.21.15.175:0/4084942817 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7881453a0 0x7fd78815bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:29.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.904+0000 7fd78f800640 1 --2- 172.21.15.175:0/4084942817 >> v2:172.21.15.177:3300/0 conn(0x7fd788144fc0 0x7fd7880cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:29.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.904+0000 7fd78f800640 1 -- 172.21.15.175:0/4084942817 >> 172.21.15.175:0/4084942817 conn(0x7fd788067150 msgr2=0x7fd78806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:29.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.904+0000 7fd78f800640 1 -- 172.21.15.175:0/4084942817 shutdown_connections 2024-04-25T09:08:29.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.904+0000 7fd78f800640 1 -- 172.21.15.175:0/4084942817 wait complete. 2024-04-25T09:08:29.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd78f800640 1 Processor -- start 2024-04-25T09:08:29.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd78f800640 1 -- start start 2024-04-25T09:08:29.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd78f800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd788144fc0 0x7fd788141aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:29.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd78f800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7881453a0 0x7fd78813f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:29.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd78f800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7881425c0 0x7fd78813c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:29.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd78f800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd788160020 con 0x7fd7881453a0 2024-04-25T09:08:29.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd78f800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78815fea0 con 0x7fd788144fc0 2024-04-25T09:08:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd78f800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7881601a0 con 0x7fd7881425c0 2024-04-25T09:08:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd77fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7881453a0 0x7fd78813f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd77fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7881453a0 0x7fd78813f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41100/0 (socket says 172.21.15.175:41100) 2024-04-25T09:08:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd77fe00640 1 -- 172.21.15.175:0/2310505820 learned_addr learned my addr 172.21.15.175:0/2310505820 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd78ce00640 1 --2- 172.21.15.175:0/2310505820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd788144fc0 0x7fd788141aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd78d800640 1 --2- 172.21.15.175:0/2310505820 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7881425c0 0x7fd78813c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd77fe00640 1 -- 172.21.15.175:0/2310505820 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7881425c0 msgr2=0x7fd78813c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd77fe00640 1 --2- 172.21.15.175:0/2310505820 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7881425c0 0x7fd78813c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd77fe00640 1 -- 172.21.15.175:0/2310505820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd788144fc0 msgr2=0x7fd788141aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd77fe00640 1 --2- 172.21.15.175:0/2310505820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd788144fc0 0x7fd788141aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd77fe00640 1 -- 172.21.15.175:0/2310505820 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78813ffb0 con 0x7fd7881453a0 2024-04-25T09:08:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd77fe00640 1 --2- 172.21.15.175:0/2310505820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7881453a0 0x7fd78813f880 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fd77000c7f0 tx=0x7fd77000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd785600640 1 -- 172.21.15.175:0/2310505820 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd770015070 con 0x7fd7881453a0 2024-04-25T09:08:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd785600640 1 -- 172.21.15.175:0/2310505820 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd770007820 con 0x7fd7881453a0 2024-04-25T09:08:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd78f800640 1 -- 172.21.15.175:0/2310505820 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78813b950 con 0x7fd7881453a0 2024-04-25T09:08:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd785600640 1 -- 172.21.15.175:0/2310505820 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd770007c10 con 0x7fd7881453a0 2024-04-25T09:08:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.908+0000 7fd78f800640 1 -- 172.21.15.175:0/2310505820 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78813bf10 con 0x7fd7881453a0 2024-04-25T09:08:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.912+0000 7fd78f800640 1 -- 172.21.15.175:0/2310505820 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd788074a60 con 0x7fd7881453a0 2024-04-25T09:08:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.912+0000 7fd785600640 1 -- 172.21.15.175:0/2310505820 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd770018070 con 0x7fd7881453a0 2024-04-25T09:08:29.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.912+0000 7fd785600640 1 --2- 172.21.15.175:0/2310505820 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd764066f60 0x7fd764069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:29.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.912+0000 7fd785600640 1 -- 172.21.15.175:0/2310505820 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7700850e0 con 0x7fd7881453a0 2024-04-25T09:08:29.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.912+0000 7fd78ce00640 1 --2- 172.21.15.175:0/2310505820 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd764066f60 0x7fd764069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:29.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.912+0000 7fd78ce00640 1 --2- 172.21.15.175:0/2310505820 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd764066f60 0x7fd764069420 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd77800f500 tx=0x7fd778007770 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:29.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:29.916+0000 7fd785600640 1 -- 172.21.15.175:0/2310505820 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd770055a00 con 0x7fd7881453a0 2024-04-25T09:08:30.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.076+0000 7fd78f800640 1 -- 172.21.15.175:0/2310505820 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd78813ec30 con 0x7fd7881453a0 2024-04-25T09:08:30.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.076+0000 7fd785600640 1 -- 172.21.15.175:0/2310505820 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16704 (secure 0 0 0) 0x7fd770059aa0 con 0x7fd7881453a0 2024-04-25T09:08:30.066 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:30.066 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":69,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:08:19.012954+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:08:15.743582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T09:08:16.375168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:08:30.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.080+0000 7fd78f800640 1 -- 172.21.15.175:0/2310505820 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd764066f60 msgr2=0x7fd764069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:30.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.080+0000 7fd78f800640 1 --2- 172.21.15.175:0/2310505820 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd764066f60 0x7fd764069420 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd77800f500 tx=0x7fd778007770 comp rx=0 tx=0).stop 2024-04-25T09:08:30.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.080+0000 7fd78f800640 1 -- 172.21.15.175:0/2310505820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7881453a0 msgr2=0x7fd78813f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:30.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.080+0000 7fd78f800640 1 --2- 172.21.15.175:0/2310505820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7881453a0 0x7fd78813f880 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fd77000c7f0 tx=0x7fd77000ccb0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.080+0000 7fd78f800640 1 -- 172.21.15.175:0/2310505820 shutdown_connections 2024-04-25T09:08:30.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.080+0000 7fd78f800640 1 --2- 172.21.15.175:0/2310505820 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd764066f60 0x7fd764069420 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.080+0000 7fd78f800640 1 --2- 172.21.15.175:0/2310505820 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7881425c0 0x7fd78813c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.080+0000 7fd78f800640 1 --2- 172.21.15.175:0/2310505820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7881453a0 0x7fd78813f880 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.080+0000 7fd78f800640 1 --2- 172.21.15.175:0/2310505820 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd788144fc0 0x7fd788141aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.080+0000 7fd78f800640 1 -- 172.21.15.175:0/2310505820 >> 172.21.15.175:0/2310505820 conn(0x7fd7880cc3b0 msgr2=0x7fd78815ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:30.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.080+0000 7fd78f800640 1 -- 172.21.15.175:0/2310505820 shutdown_connections 2024-04-25T09:08:30.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.080+0000 7fd78f800640 1 -- 172.21.15.175:0/2310505820 wait complete. 2024-04-25T09:08:30.088 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:08:15.743582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:08:16.375168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:08:30.088 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:08:30.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.236+0000 7f1d80a00640 1 Processor -- start 2024-04-25T09:08:30.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.236+0000 7f1d80a00640 1 -- start start 2024-04-25T09:08:30.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.240+0000 7f1d80a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d7c0cd9b0 0x7f1d7c0cde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:30.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.240+0000 7f1d80a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c06c5c0 con 0x7f1d7c0af570 2024-04-25T09:08:30.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.240+0000 7f1d80a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c06ba40 con 0x7f1d7c06dd90 2024-04-25T09:08:30.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.240+0000 7f1d80a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c0ce350 con 0x7f1d7c0cd9b0 2024-04-25T09:08:30.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.240+0000 7f1d7a800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f1d7c0af570 0x7f1d7c146d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:49708/0 (socket says 172.21.15.175:49708) 2024-04-25T09:08:30.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.240+0000 7f1d7a800640 1 -- 172.21.15.175:0/2671107716 learned_addr learned my addr 172.21.15.175:0/2671107716 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:30.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.240+0000 7f1d79e00640 1 --2- 172.21.15.175:0/2671107716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d7c0cd9b0 0x7f1d7c0cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:30.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.240+0000 7f1d79400640 1 -- 172.21.15.175:0/2671107716 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031813225 0 0) 0x7f1d7c06c5c0 con 0x7f1d7c0af570 2024-04-25T09:08:30.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.240+0000 7f1d79400640 1 -- 172.21.15.175:0/2671107716 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d60003530 con 0x7f1d7c0af570 2024-04-25T09:08:30.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.240+0000 7f1d79400640 1 -- 172.21.15.175:0/2671107716 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651614951 0 0) 0x7f1d7c06ba40 con 0x7f1d7c06dd90 2024-04-25T09:08:30.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.240+0000 7f1d79400640 1 -- 172.21.15.175:0/2671107716 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d7c06c5c0 con 0x7f1d7c06dd90 2024-04-25T09:08:30.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.240+0000 7f1d79e00640 1 -- 172.21.15.175:0/2671107716 >> v1:172.21.15.177:6789/0 conn(0x7f1d7c06dd90 legacy=0x7f1d7c06e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:30.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.240+0000 7f1d79e00640 1 -- 172.21.15.175:0/2671107716 >> v1:172.21.15.175:6789/0 conn(0x7f1d7c0af570 legacy=0x7f1d7c146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:30.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.240+0000 7f1d79e00640 1 -- 172.21.15.175:0/2671107716 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c06bd20 con 0x7f1d7c0cd9b0 2024-04-25T09:08:30.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.244+0000 7f1d79e00640 1 --2- 172.21.15.175:0/2671107716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d7c0cd9b0 0x7f1d7c0cde10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1d680097f0 tx=0x7f1d6801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cc49d020d2f2064 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:30.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.244+0000 7f1d79400640 1 -- 172.21.15.175:0/2671107716 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d680aa610 con 0x7f1d7c0cd9b0 2024-04-25T09:08:30.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.244+0000 7f1d79400640 1 -- 172.21.15.175:0/2671107716 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d680af070 con 0x7f1d7c0cd9b0 2024-04-25T09:08:30.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.244+0000 7f1d79400640 1 -- 172.21.15.175:0/2671107716 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d680aa9d0 con 0x7f1d7c0cd9b0 2024-04-25T09:08:30.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.244+0000 7f1d80a00640 1 -- 172.21.15.175:0/2671107716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d7c0cd9b0 msgr2=0x7f1d7c0cde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:30.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.244+0000 7f1d80a00640 1 --2- 172.21.15.175:0/2671107716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d7c0cd9b0 0x7f1d7c0cde10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1d680097f0 tx=0x7f1d6801c4b0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.244+0000 7f1d80a00640 1 -- 172.21.15.175:0/2671107716 shutdown_connections 2024-04-25T09:08:30.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.244+0000 7f1d80a00640 1 --2- 172.21.15.175:0/2671107716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d7c0cd9b0 0x7f1d7c0cde10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.244+0000 7f1d80a00640 1 -- 172.21.15.175:0/2671107716 >> 172.21.15.175:0/2671107716 conn(0x7f1d7c0cc860 msgr2=0x7f1d7c0ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:30.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.244+0000 7f1d80a00640 1 -- 172.21.15.175:0/2671107716 shutdown_connections 2024-04-25T09:08:30.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.244+0000 7f1d80a00640 1 -- 172.21.15.175:0/2671107716 wait complete. 2024-04-25T09:08:30.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.244+0000 7f1d80a00640 1 Processor -- start 2024-04-25T09:08:30.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.244+0000 7f1d80a00640 1 -- start start 2024-04-25T09:08:30.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d80a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d7c06dd90 0x7f1d7c161ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:30.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d80a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c0af570 0x7f1d7c0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:30.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d80a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d7c0cd9b0 0x7f1d7c0b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:30.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d80a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c06b7e0 con 0x7f1d7c0af570 2024-04-25T09:08:30.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d80a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c06b660 con 0x7f1d7c0cd9b0 2024-04-25T09:08:30.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d80a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c16b740 con 0x7f1d7c06dd90 2024-04-25T09:08:30.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d79e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c0af570 0x7f1d7c0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:30.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d79e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c0af570 0x7f1d7c0b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41116/0 (socket says 172.21.15.175:41116) 2024-04-25T09:08:30.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d79e00640 1 -- 172.21.15.175:0/116309364 learned_addr learned my addr 172.21.15.175:0/116309364 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:30.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d7a800640 1 --2- 172.21.15.175:0/116309364 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d7c06dd90 0x7f1d7c161ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:30.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d7b200640 1 --2- 172.21.15.175:0/116309364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d7c0cd9b0 0x7f1d7c0b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:30.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d79e00640 1 -- 172.21.15.175:0/116309364 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d7c06dd90 msgr2=0x7f1d7c161ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:30.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d79e00640 1 --2- 172.21.15.175:0/116309364 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d7c06dd90 0x7f1d7c161ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d79e00640 1 -- 172.21.15.175:0/116309364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d7c0cd9b0 msgr2=0x7f1d7c0b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:30.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d79e00640 1 --2- 172.21.15.175:0/116309364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d7c0cd9b0 0x7f1d7c0b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d79e00640 1 -- 172.21.15.175:0/116309364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c0aea90 con 0x7f1d7c0af570 2024-04-25T09:08:30.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d7b200640 1 --2- 172.21.15.175:0/116309364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d7c0cd9b0 0x7f1d7c0b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:30.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d79e00640 1 --2- 172.21.15.175:0/116309364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c0af570 0x7f1d7c0b4d70 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1d680190c0 tx=0x7f1d6801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:30.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d72a00640 1 -- 172.21.15.175:0/116309364 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d680be610 con 0x7f1d7c0af570 2024-04-25T09:08:30.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d72a00640 1 -- 172.21.15.175:0/116309364 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d680be7d0 con 0x7f1d7c0af570 2024-04-25T09:08:30.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d72a00640 1 -- 172.21.15.175:0/116309364 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d680bebc0 con 0x7f1d7c0af570 2024-04-25T09:08:30.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d80a00640 1 -- 172.21.15.175:0/116309364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c0aed70 con 0x7f1d7c0af570 2024-04-25T09:08:30.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d80a00640 1 -- 172.21.15.175:0/116309364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c13e7c0 con 0x7f1d7c0af570 2024-04-25T09:08:30.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d80a00640 1 -- 172.21.15.175:0/116309364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7c074a60 con 0x7f1d7c0af570 2024-04-25T09:08:30.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.248+0000 7f1d72a00640 1 -- 172.21.15.175:0/116309364 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1d680bc020 con 0x7f1d7c0af570 2024-04-25T09:08:30.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.252+0000 7f1d72a00640 1 --2- 172.21.15.175:0/116309364 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1d5c066f60 0x7f1d5c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:30.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.252+0000 7f1d72a00640 1 -- 172.21.15.175:0/116309364 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d6811f6f0 con 0x7f1d7c0af570 2024-04-25T09:08:30.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.252+0000 7f1d7a800640 1 --2- 172.21.15.175:0/116309364 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1d5c066f60 0x7f1d5c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:30.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.252+0000 7f1d7a800640 1 --2- 172.21.15.175:0/116309364 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1d5c066f60 0x7f1d5c069420 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c000f70 tx=0x7f1d6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:30.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.256+0000 7f1d72a00640 1 -- 172.21.15.175:0/116309364 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1d680a7070 con 0x7f1d7c0af570 2024-04-25T09:08:30.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.412+0000 7f1d80a00640 1 -- 172.21.15.175:0/116309364 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d7c067080 con 0x7f1d7c0af570 2024-04-25T09:08:30.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.412+0000 7f1d72a00640 1 -- 172.21.15.175:0/116309364 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d680160d0 con 0x7f1d7c0af570 2024-04-25T09:08:30.400 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:08:30.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.412+0000 7f1d80a00640 1 -- 172.21.15.175:0/116309364 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1d5c066f60 msgr2=0x7f1d5c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:30.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.412+0000 7f1d80a00640 1 --2- 172.21.15.175:0/116309364 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1d5c066f60 0x7f1d5c069420 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c000f70 tx=0x7f1d6c009040 comp rx=0 tx=0).stop 2024-04-25T09:08:30.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.412+0000 7f1d80a00640 1 -- 172.21.15.175:0/116309364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c0af570 msgr2=0x7f1d7c0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:30.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.412+0000 7f1d80a00640 1 --2- 172.21.15.175:0/116309364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c0af570 0x7f1d7c0b4d70 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1d680190c0 tx=0x7f1d6801acf0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.412+0000 7f1d80a00640 1 -- 172.21.15.175:0/116309364 shutdown_connections 2024-04-25T09:08:30.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.412+0000 7f1d80a00640 1 --2- 172.21.15.175:0/116309364 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1d5c066f60 0x7f1d5c069420 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.412+0000 7f1d80a00640 1 --2- 172.21.15.175:0/116309364 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d7c0cd9b0 0x7f1d7c0b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.412+0000 7f1d80a00640 1 --2- 172.21.15.175:0/116309364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d7c0af570 0x7f1d7c0b4d70 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.412+0000 7f1d80a00640 1 --2- 172.21.15.175:0/116309364 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d7c06dd90 0x7f1d7c161ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.412+0000 7f1d80a00640 1 -- 172.21.15.175:0/116309364 >> 172.21.15.175:0/116309364 conn(0x7f1d7c0cc860 msgr2=0x7f1d7c0cb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:30.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.412+0000 7f1d80a00640 1 -- 172.21.15.175:0/116309364 shutdown_connections 2024-04-25T09:08:30.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.412+0000 7f1d80a00640 1 -- 172.21.15.175:0/116309364 wait complete. 2024-04-25T09:08:30.421 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:08:30.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.568+0000 7f21f8200640 1 Processor -- start 2024-04-25T09:08:30.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.568+0000 7f21f8200640 1 -- start start 2024-04-25T09:08:30.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.572+0000 7f21f8200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f015af20 0x7f21f00b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:30.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.572+0000 7f21f8200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f21f00b4630 0x7f21f015c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:30.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.572+0000 7f21f8200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f006db60 con 0x7f21f00cbe60 2024-04-25T09:08:30.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.572+0000 7f21f8200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f006de40 con 0x7f21f00b4630 2024-04-25T09:08:30.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.572+0000 7f21f8200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f006e120 con 0x7f21f015af20 2024-04-25T09:08:30.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.572+0000 7f21f6200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f21f00b4630 0x7f21f015c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:30.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.572+0000 7f21f4e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f015af20 0x7f21f00b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:30.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.572+0000 7f21f6200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f21f00b4630 0x7f21f015c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:33280/0 (socket says 172.21.15.175:33280) 2024-04-25T09:08:30.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.572+0000 7f21f6200640 1 -- 172.21.15.175:0/2121084160 learned_addr learned my addr 172.21.15.175:0/2121084160 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:30.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.572+0000 7f21f5800640 1 --1- 172.21.15.175:0/2121084160 >> v1:172.21.15.177:6789/0 conn(0x7f21f00cbe60 0x7f21f006d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:55728/0 (socket says 172.21.15.175:55728) 2024-04-25T09:08:30.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.572+0000 7f21f4e00640 1 -- 172.21.15.175:0/2121084160 >> v2:172.21.15.177:3300/0 conn(0x7f21f00b4630 msgr2=0x7f21f015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:30.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.572+0000 7f21f4e00640 1 --2- 172.21.15.175:0/2121084160 >> v2:172.21.15.177:3300/0 conn(0x7f21f00b4630 0x7f21f015c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.572+0000 7f21f4e00640 1 -- 172.21.15.175:0/2121084160 >> v1:172.21.15.177:6789/0 conn(0x7f21f00cbe60 legacy=0x7f21f006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:30.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.572+0000 7f21f4e00640 1 -- 172.21.15.175:0/2121084160 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f015c2f0 con 0x7f21f015af20 2024-04-25T09:08:30.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.572+0000 7f21f6200640 1 --2- 172.21.15.175:0/2121084160 >> v2:172.21.15.177:3300/0 conn(0x7f21f00b4630 0x7f21f015c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:08:30.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.576+0000 7f21f4e00640 1 --2- 172.21.15.175:0/2121084160 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f015af20 0x7f21f00b40f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0097c0 tx=0x7f21dc01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81b7082628161d95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:30.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.576+0000 7f21efe00640 1 -- 172.21.15.175:0/2121084160 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc0b0070 con 0x7f21f015af20 2024-04-25T09:08:30.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.576+0000 7f21efe00640 1 -- 172.21.15.175:0/2121084160 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc0ab600 con 0x7f21f015af20 2024-04-25T09:08:30.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.576+0000 7f21efe00640 1 -- 172.21.15.175:0/2121084160 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc0ab9d0 con 0x7f21f015af20 2024-04-25T09:08:30.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.576+0000 7f21f8200640 1 -- 172.21.15.175:0/2121084160 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f015af20 msgr2=0x7f21f00b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:30.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.576+0000 7f21f8200640 1 --2- 172.21.15.175:0/2121084160 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f015af20 0x7f21f00b40f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0097c0 tx=0x7f21dc01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.576+0000 7f21f8200640 1 -- 172.21.15.175:0/2121084160 shutdown_connections 2024-04-25T09:08:30.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.576+0000 7f21f8200640 1 --2- 172.21.15.175:0/2121084160 >> v2:172.21.15.177:3300/0 conn(0x7f21f00b4630 0x7f21f015c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.576+0000 7f21f8200640 1 --2- 172.21.15.175:0/2121084160 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f015af20 0x7f21f00b40f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.576+0000 7f21f8200640 1 -- 172.21.15.175:0/2121084160 >> 172.21.15.175:0/2121084160 conn(0x7f21f006ac50 msgr2=0x7f21f006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:30.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.576+0000 7f21f8200640 1 -- 172.21.15.175:0/2121084160 shutdown_connections 2024-04-25T09:08:30.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.576+0000 7f21f8200640 1 -- 172.21.15.175:0/2121084160 wait complete. 2024-04-25T09:08:30.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.576+0000 7f21f8200640 1 Processor -- start 2024-04-25T09:08:30.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.576+0000 7f21f8200640 1 -- start start 2024-04-25T09:08:30.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.576+0000 7f21f8200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21f00b4630 0x7f21f0150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:30.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.576+0000 7f21f8200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21f00cbe60 0x7f21f0153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:30.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.576+0000 7f21f8200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f015af20 0x7f21f00aca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:30.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21f8200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f015d970 con 0x7f21f00b4630 2024-04-25T09:08:30.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21f8200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f015d7f0 con 0x7f21f00cbe60 2024-04-25T09:08:30.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21f8200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f015daf0 con 0x7f21f015af20 2024-04-25T09:08:30.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21f5800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21f00b4630 0x7f21f0150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:30.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21f5800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21f00b4630 0x7f21f0150e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41122/0 (socket says 172.21.15.175:41122) 2024-04-25T09:08:30.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21f5800640 1 -- 172.21.15.175:0/3834335448 learned_addr learned my addr 172.21.15.175:0/3834335448 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:30.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21f4e00640 1 --2- 172.21.15.175:0/3834335448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21f00cbe60 0x7f21f0153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:30.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21f6200640 1 --2- 172.21.15.175:0/3834335448 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f015af20 0x7f21f00aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:30.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21f5800640 1 -- 172.21.15.175:0/3834335448 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f015af20 msgr2=0x7f21f00aca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:30.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21f5800640 1 --2- 172.21.15.175:0/3834335448 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f015af20 0x7f21f00aca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21f5800640 1 -- 172.21.15.175:0/3834335448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21f00cbe60 msgr2=0x7f21f0153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:30.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21f5800640 1 --2- 172.21.15.175:0/3834335448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21f00cbe60 0x7f21f0153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21f5800640 1 -- 172.21.15.175:0/3834335448 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f0151360 con 0x7f21f00b4630 2024-04-25T09:08:30.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21f5800640 1 --2- 172.21.15.175:0/3834335448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21f00b4630 0x7f21f0150e20 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f21e400c3a0 tx=0x7f21e400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:30.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21ed600640 1 -- 172.21.15.175:0/3834335448 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e40074e0 con 0x7f21f00b4630 2024-04-25T09:08:30.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21ed600640 1 -- 172.21.15.175:0/3834335448 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e4007680 con 0x7f21f00b4630 2024-04-25T09:08:30.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21ed600640 1 -- 172.21.15.175:0/3834335448 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e4004a30 con 0x7f21f00b4630 2024-04-25T09:08:30.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21f8200640 1 -- 172.21.15.175:0/3834335448 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f00cd850 con 0x7f21f00b4630 2024-04-25T09:08:30.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21f8200640 1 -- 172.21.15.175:0/3834335448 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f0168380 con 0x7f21f00b4630 2024-04-25T09:08:30.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21f8200640 1 -- 172.21.15.175:0/3834335448 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f0075160 con 0x7f21f00b4630 2024-04-25T09:08:30.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.580+0000 7f21ed600640 1 -- 172.21.15.175:0/3834335448 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f21e401a020 con 0x7f21f00b4630 2024-04-25T09:08:30.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.584+0000 7f21ed600640 1 --2- 172.21.15.175:0/3834335448 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f21d0066f60 0x7f21d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:30.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.584+0000 7f21ed600640 1 -- 172.21.15.175:0/3834335448 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21e4084690 con 0x7f21f00b4630 2024-04-25T09:08:30.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.584+0000 7f21f4e00640 1 --2- 172.21.15.175:0/3834335448 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f21d0066f60 0x7f21d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:30.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.584+0000 7f21f4e00640 1 --2- 172.21.15.175:0/3834335448 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f21d0066f60 0x7f21d0069420 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0ad000 tx=0x7f21dc0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:30.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.588+0000 7f21ed600640 1 -- 172.21.15.175:0/3834335448 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f21f0151360 con 0x7f21f00b4630 2024-04-25T09:08:30.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.740+0000 7f21f8200640 1 -- 172.21.15.175:0/3834335448 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21f00b3510 con 0x7f21f00b4630 2024-04-25T09:08:30.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.740+0000 7f21ed600640 1 -- 172.21.15.175:0/3834335448 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21e4055040 con 0x7f21f00b4630 2024-04-25T09:08:30.729 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:08:30.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.740+0000 7f21f8200640 1 -- 172.21.15.175:0/3834335448 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f21d0066f60 msgr2=0x7f21d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:30.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.740+0000 7f21f8200640 1 --2- 172.21.15.175:0/3834335448 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f21d0066f60 0x7f21d0069420 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f21dc0ad000 tx=0x7f21dc0a6000 comp rx=0 tx=0).stop 2024-04-25T09:08:30.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.740+0000 7f21f8200640 1 -- 172.21.15.175:0/3834335448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21f00b4630 msgr2=0x7f21f0150e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:30.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.740+0000 7f21f8200640 1 --2- 172.21.15.175:0/3834335448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21f00b4630 0x7f21f0150e20 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f21e400c3a0 tx=0x7f21e400c860 comp rx=0 tx=0).stop 2024-04-25T09:08:30.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.740+0000 7f21f8200640 1 -- 172.21.15.175:0/3834335448 shutdown_connections 2024-04-25T09:08:30.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.740+0000 7f21f8200640 1 --2- 172.21.15.175:0/3834335448 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f21d0066f60 0x7f21d0069420 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.740+0000 7f21f8200640 1 --2- 172.21.15.175:0/3834335448 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f21f015af20 0x7f21f00aca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.740+0000 7f21f8200640 1 --2- 172.21.15.175:0/3834335448 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f21f00cbe60 0x7f21f0153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.740+0000 7f21f8200640 1 --2- 172.21.15.175:0/3834335448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f21f00b4630 0x7f21f0150e20 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.740+0000 7f21f8200640 1 -- 172.21.15.175:0/3834335448 >> 172.21.15.175:0/3834335448 conn(0x7f21f006ac50 msgr2=0x7f21f00afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:30.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.740+0000 7f21f8200640 1 -- 172.21.15.175:0/3834335448 shutdown_connections 2024-04-25T09:08:30.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.740+0000 7f21f8200640 1 -- 172.21.15.175:0/3834335448 wait complete. 2024-04-25T09:08:30.750 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:08:30.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.900+0000 7faf66e00640 1 Processor -- start 2024-04-25T09:08:30.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.900+0000 7faf66e00640 1 -- start start 2024-04-25T09:08:30.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.900+0000 7faf66e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf600cbe60 0x7faf6015af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:30.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.900+0000 7faf66e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faf6006d310 0x7faf600b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:30.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.900+0000 7faf66e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6006db60 con 0x7faf600b4630 2024-04-25T09:08:30.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.900+0000 7faf66e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6006de40 con 0x7faf6006d310 2024-04-25T09:08:30.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.900+0000 7faf66e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6006e120 con 0x7faf600cbe60 2024-04-25T09:08:30.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.900+0000 7faf57400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faf6006d310 0x7faf600b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:30.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.900+0000 7faf57400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faf6006d310 0x7faf600b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41126/0 (socket says 172.21.15.175:41126) 2024-04-25T09:08:30.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.900+0000 7faf57400640 1 -- 172.21.15.175:0/1788829461 learned_addr learned my addr 172.21.15.175:0/1788829461 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:30.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.900+0000 7faf5fe00640 1 --2- 172.21.15.175:0/1788829461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf600cbe60 0x7faf6015af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:30.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.900+0000 7faf57400640 1 -- 172.21.15.175:0/1788829461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf600cbe60 msgr2=0x7faf6015af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:30.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.900+0000 7faf57400640 1 --2- 172.21.15.175:0/1788829461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf600cbe60 0x7faf6015af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.900+0000 7faf57400640 1 -- 172.21.15.175:0/1788829461 >> v1:172.21.15.177:6789/0 conn(0x7faf600b4630 legacy=0x7faf600b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:30.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.900+0000 7faf57400640 1 -- 172.21.15.175:0/1788829461 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6015c2f0 con 0x7faf6006d310 2024-04-25T09:08:30.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.900+0000 7faf5fe00640 1 --2- 172.21.15.175:0/1788829461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf600cbe60 0x7faf6015af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:30.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.904+0000 7faf57400640 1 --2- 172.21.15.175:0/1788829461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf6006d310 0x7faf600b40f0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7faf4800bb10 tx=0x7faf4801ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a795dd0a21822c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:30.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.908+0000 7faf5f400640 1 -- 172.21.15.175:0/1788829461 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf480b4070 con 0x7faf6006d310 2024-04-25T09:08:30.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.908+0000 7faf5f400640 1 -- 172.21.15.175:0/1788829461 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf480a7a80 con 0x7faf6006d310 2024-04-25T09:08:30.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.908+0000 7faf5f400640 1 -- 172.21.15.175:0/1788829461 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf480a7e50 con 0x7faf6006d310 2024-04-25T09:08:30.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.908+0000 7faf66e00640 1 -- 172.21.15.175:0/1788829461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf6006d310 msgr2=0x7faf600b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:30.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.908+0000 7faf66e00640 1 --2- 172.21.15.175:0/1788829461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf6006d310 0x7faf600b40f0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7faf4800bb10 tx=0x7faf4801ebf0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.908+0000 7faf66e00640 1 -- 172.21.15.175:0/1788829461 shutdown_connections 2024-04-25T09:08:30.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.908+0000 7faf66e00640 1 --2- 172.21.15.175:0/1788829461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf6006d310 0x7faf600b40f0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.908+0000 7faf66e00640 1 --2- 172.21.15.175:0/1788829461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf600cbe60 0x7faf6015af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.908+0000 7faf66e00640 1 -- 172.21.15.175:0/1788829461 >> 172.21.15.175:0/1788829461 conn(0x7faf6006ac50 msgr2=0x7faf6006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:30.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.908+0000 7faf66e00640 1 -- 172.21.15.175:0/1788829461 shutdown_connections 2024-04-25T09:08:30.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.908+0000 7faf66e00640 1 -- 172.21.15.175:0/1788829461 wait complete. 2024-04-25T09:08:30.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.908+0000 7faf66e00640 1 Processor -- start 2024-04-25T09:08:30.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.908+0000 7faf66e00640 1 -- start start 2024-04-25T09:08:30.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf66e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf6006d310 0x7faf6015a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:30.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf66e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf600b4630 0x7faf60156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:30.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf66e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf600cbe60 0x7faf6014dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:30.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf66e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf600716e0 con 0x7faf600cbe60 2024-04-25T09:08:30.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf66e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf60071560 con 0x7faf600b4630 2024-04-25T09:08:30.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf66e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf60071860 con 0x7faf6006d310 2024-04-25T09:08:30.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf64e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf600cbe60 0x7faf6014dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:30.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf64e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf600cbe60 0x7faf6014dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41134/0 (socket says 172.21.15.175:41134) 2024-04-25T09:08:30.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf64e00640 1 -- 172.21.15.175:0/3448219796 learned_addr learned my addr 172.21.15.175:0/3448219796 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:30.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf57400640 1 --2- 172.21.15.175:0/3448219796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf600b4630 0x7faf60156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:30.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf5fe00640 1 --2- 172.21.15.175:0/3448219796 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf6006d310 0x7faf6015a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:30.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf64e00640 1 -- 172.21.15.175:0/3448219796 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf6006d310 msgr2=0x7faf6015a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:30.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf64e00640 1 --2- 172.21.15.175:0/3448219796 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf6006d310 0x7faf6015a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf64e00640 1 -- 172.21.15.175:0/3448219796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf600b4630 msgr2=0x7faf60156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:30.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf64e00640 1 --2- 172.21.15.175:0/3448219796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf600b4630 0x7faf60156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:30.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf64e00640 1 -- 172.21.15.175:0/3448219796 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6014e290 con 0x7faf600cbe60 2024-04-25T09:08:30.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf64e00640 1 --2- 172.21.15.175:0/3448219796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf600cbe60 0x7faf6014dd50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7faf5800c780 tx=0x7faf5800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:30.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf5cc00640 1 -- 172.21.15.175:0/3448219796 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58004b70 con 0x7faf600cbe60 2024-04-25T09:08:30.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf5cc00640 1 -- 172.21.15.175:0/3448219796 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf58004d10 con 0x7faf600cbe60 2024-04-25T09:08:30.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf66e00640 1 -- 172.21.15.175:0/3448219796 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf60153b40 con 0x7faf600cbe60 2024-04-25T09:08:30.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf5cc00640 1 -- 172.21.15.175:0/3448219796 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5800aa90 con 0x7faf600cbe60 2024-04-25T09:08:30.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf66e00640 1 -- 172.21.15.175:0/3448219796 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf601566a0 con 0x7faf600cbe60 2024-04-25T09:08:30.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf66e00640 1 -- 172.21.15.175:0/3448219796 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf60075160 con 0x7faf600cbe60 2024-04-25T09:08:30.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.912+0000 7faf5cc00640 1 -- 172.21.15.175:0/3448219796 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faf5800ac30 con 0x7faf600cbe60 2024-04-25T09:08:30.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.916+0000 7faf5cc00640 1 --2- 172.21.15.175:0/3448219796 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faf3c066f60 0x7faf3c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:30.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.916+0000 7faf5cc00640 1 -- 172.21.15.175:0/3448219796 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf58085070 con 0x7faf600cbe60 2024-04-25T09:08:30.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.916+0000 7faf5fe00640 1 --2- 172.21.15.175:0/3448219796 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faf3c066f60 0x7faf3c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:30.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.916+0000 7faf5fe00640 1 --2- 172.21.15.175:0/3448219796 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faf3c066f60 0x7faf3c069420 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7faf50006fd0 tx=0x7faf50008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:30.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:30.920+0000 7faf5cc00640 1 -- 172.21.15.175:0/3448219796 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faf58020070 con 0x7faf600cbe60 2024-04-25T09:08:31.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.072+0000 7faf66e00640 1 -- 172.21.15.175:0/3448219796 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf60156160 con 0x7faf600cbe60 2024-04-25T09:08:31.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.072+0000 7faf5cc00640 1 -- 172.21.15.175:0/3448219796 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf58055ac0 con 0x7faf600cbe60 2024-04-25T09:08:31.061 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:08:31.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.072+0000 7faf66e00640 1 -- 172.21.15.175:0/3448219796 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faf3c066f60 msgr2=0x7faf3c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:31.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.072+0000 7faf66e00640 1 --2- 172.21.15.175:0/3448219796 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faf3c066f60 0x7faf3c069420 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7faf50006fd0 tx=0x7faf50008040 comp rx=0 tx=0).stop 2024-04-25T09:08:31.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.072+0000 7faf66e00640 1 -- 172.21.15.175:0/3448219796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf600cbe60 msgr2=0x7faf6014dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:31.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.072+0000 7faf66e00640 1 --2- 172.21.15.175:0/3448219796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf600cbe60 0x7faf6014dd50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7faf5800c780 tx=0x7faf5800cc40 comp rx=0 tx=0).stop 2024-04-25T09:08:31.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.072+0000 7faf66e00640 1 -- 172.21.15.175:0/3448219796 shutdown_connections 2024-04-25T09:08:31.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.072+0000 7faf66e00640 1 --2- 172.21.15.175:0/3448219796 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faf3c066f60 0x7faf3c069420 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.072+0000 7faf66e00640 1 --2- 172.21.15.175:0/3448219796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf600cbe60 0x7faf6014dd50 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.072+0000 7faf66e00640 1 --2- 172.21.15.175:0/3448219796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf600b4630 0x7faf60156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.072+0000 7faf66e00640 1 --2- 172.21.15.175:0/3448219796 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf6006d310 0x7faf6015a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.072+0000 7faf66e00640 1 -- 172.21.15.175:0/3448219796 >> 172.21.15.175:0/3448219796 conn(0x7faf6006ac50 msgr2=0x7faf600ac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:31.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.076+0000 7faf66e00640 1 -- 172.21.15.175:0/3448219796 shutdown_connections 2024-04-25T09:08:31.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.076+0000 7faf66e00640 1 -- 172.21.15.175:0/3448219796 wait complete. 2024-04-25T09:08:31.083 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:08:31.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.228+0000 7f795b600640 1 Processor -- start 2024-04-25T09:08:31.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.228+0000 7f795b600640 1 -- start start 2024-04-25T09:08:31.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.232+0000 7f795b600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7954145250 0x7f79540cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:31.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.232+0000 7f795b600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79540ce970 0x7f79540cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:31.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.232+0000 7f795b600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79540cfd10 con 0x7f79541600a0 2024-04-25T09:08:31.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.232+0000 7f795b600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795415f650 con 0x7f7954145250 2024-04-25T09:08:31.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.232+0000 7f795b600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79540cfff0 con 0x7f79540ce970 2024-04-25T09:08:31.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.232+0000 7f7958c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7954145250 0x7f79540cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:31.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.232+0000 7f7958c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7954145250 0x7f79540cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41150/0 (socket says 172.21.15.175:41150) 2024-04-25T09:08:31.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.232+0000 7f7958c00640 1 -- 172.21.15.175:0/1966427265 learned_addr learned my addr 172.21.15.175:0/1966427265 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:31.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.232+0000 7f7959600640 1 --2- 172.21.15.175:0/1966427265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79540ce970 0x7f79540cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:31.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.232+0000 7f7958c00640 1 -- 172.21.15.175:0/1966427265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79540ce970 msgr2=0x7f79540cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:31.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.232+0000 7f7958c00640 1 --2- 172.21.15.175:0/1966427265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79540ce970 0x7f79540cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.232+0000 7f7958c00640 1 -- 172.21.15.175:0/1966427265 >> v1:172.21.15.177:6789/0 conn(0x7f79541600a0 legacy=0x7f79540cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:31.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.232+0000 7f7958c00640 1 -- 172.21.15.175:0/1966427265 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795415f8a0 con 0x7f7954145250 2024-04-25T09:08:31.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.236+0000 7f7958c00640 1 --2- 172.21.15.175:0/1966427265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7954145250 0x7f79540cf6b0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f79440098a0 tx=0x7f794401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8668d10e7d4c42f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:31.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.236+0000 7f7953e00640 1 -- 172.21.15.175:0/1966427265 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79440aa600 con 0x7f7954145250 2024-04-25T09:08:31.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.236+0000 7f7953e00640 1 -- 172.21.15.175:0/1966427265 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79440af070 con 0x7f7954145250 2024-04-25T09:08:31.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.236+0000 7f7953e00640 1 -- 172.21.15.175:0/1966427265 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79440aa9c0 con 0x7f7954145250 2024-04-25T09:08:31.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.236+0000 7f795b600640 1 -- 172.21.15.175:0/1966427265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7954145250 msgr2=0x7f79540cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:31.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.236+0000 7f795b600640 1 --2- 172.21.15.175:0/1966427265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7954145250 0x7f79540cf6b0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f79440098a0 tx=0x7f794401c480 comp rx=0 tx=0).stop 2024-04-25T09:08:31.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.236+0000 7f795b600640 1 -- 172.21.15.175:0/1966427265 shutdown_connections 2024-04-25T09:08:31.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.236+0000 7f795b600640 1 --2- 172.21.15.175:0/1966427265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79540ce970 0x7f79540cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.236+0000 7f795b600640 1 --2- 172.21.15.175:0/1966427265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7954145250 0x7f79540cf6b0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.236+0000 7f795b600640 1 -- 172.21.15.175:0/1966427265 >> 172.21.15.175:0/1966427265 conn(0x7f795406ac50 msgr2=0x7f795406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:31.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.236+0000 7f795b600640 1 -- 172.21.15.175:0/1966427265 shutdown_connections 2024-04-25T09:08:31.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.236+0000 7f795b600640 1 -- 172.21.15.175:0/1966427265 wait complete. 2024-04-25T09:08:31.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.236+0000 7f795b600640 1 Processor -- start 2024-04-25T09:08:31.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.236+0000 7f795b600640 1 -- start start 2024-04-25T09:08:31.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f795b600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79540ce970 0x7f795413e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:31.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f795b600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7954145250 0x7f79540b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:31.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f795b600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79541600a0 0x7f79541f6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:31.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f795b600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795415c870 con 0x7f7954145250 2024-04-25T09:08:31.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f795b600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79541604b0 con 0x7f79540ce970 2024-04-25T09:08:31.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f795b600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795415c9f0 con 0x7f79541600a0 2024-04-25T09:08:31.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f794be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7954145250 0x7f79540b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:31.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f794be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7954145250 0x7f79540b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41156/0 (socket says 172.21.15.175:41156) 2024-04-25T09:08:31.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f794be00640 1 -- 172.21.15.175:0/3408850613 learned_addr learned my addr 172.21.15.175:0/3408850613 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:31.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f7958c00640 1 --2- 172.21.15.175:0/3408850613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79540ce970 0x7f795413e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:31.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f7959600640 1 --2- 172.21.15.175:0/3408850613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79541600a0 0x7f79541f6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:31.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f794be00640 1 -- 172.21.15.175:0/3408850613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79541600a0 msgr2=0x7f79541f6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:31.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f794be00640 1 --2- 172.21.15.175:0/3408850613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79541600a0 0x7f79541f6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f794be00640 1 -- 172.21.15.175:0/3408850613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79540ce970 msgr2=0x7f795413e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:31.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f794be00640 1 --2- 172.21.15.175:0/3408850613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79540ce970 0x7f795413e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f794be00640 1 -- 172.21.15.175:0/3408850613 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79540b2e80 con 0x7f7954145250 2024-04-25T09:08:31.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f794be00640 1 --2- 172.21.15.175:0/3408850613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7954145250 0x7f79540b3f20 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f793c00c370 tx=0x7f793c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:31.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f7951600640 1 -- 172.21.15.175:0/3408850613 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c0052d0 con 0x7f7954145250 2024-04-25T09:08:31.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f7951600640 1 -- 172.21.15.175:0/3408850613 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c005470 con 0x7f7954145250 2024-04-25T09:08:31.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f7951600640 1 -- 172.21.15.175:0/3408850613 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c007260 con 0x7f7954145250 2024-04-25T09:08:31.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f795b600640 1 -- 172.21.15.175:0/3408850613 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79540b3160 con 0x7f7954145250 2024-04-25T09:08:31.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f795b600640 1 -- 172.21.15.175:0/3408850613 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79540b3720 con 0x7f7954145250 2024-04-25T09:08:31.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f795b600640 1 -- 172.21.15.175:0/3408850613 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7954075160 con 0x7f7954145250 2024-04-25T09:08:31.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.240+0000 7f7951600640 1 -- 172.21.15.175:0/3408850613 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f793c007400 con 0x7f7954145250 2024-04-25T09:08:31.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.244+0000 7f7951600640 1 --2- 172.21.15.175:0/3408850613 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7930066f60 0x7f7930069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:31.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.244+0000 7f7951600640 1 -- 172.21.15.175:0/3408850613 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f793c084480 con 0x7f7954145250 2024-04-25T09:08:31.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.244+0000 7f7958c00640 1 --2- 172.21.15.175:0/3408850613 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7930066f60 0x7f7930069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:31.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.244+0000 7f7958c00640 1 --2- 172.21.15.175:0/3408850613 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7930066f60 0x7f7930069420 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f79440ae000 tx=0x7f79440a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:31.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.248+0000 7f7951600640 1 -- 172.21.15.175:0/3408850613 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f793c054da0 con 0x7f7954145250 2024-04-25T09:08:31.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.412+0000 7f795b600640 1 -- 172.21.15.175:0/3408850613 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f79540b10a0 con 0x7f7954145250 2024-04-25T09:08:31.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.412+0000 7f7951600640 1 -- 172.21.15.175:0/3408850613 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) v1 ==== 80+0+0 (secure 0 0 0) 0x7f793c058e40 con 0x7f7954145250 2024-04-25T09:08:31.403 INFO:teuthology.orchestra.run.smithi175.stderr:listed 0 entries 2024-04-25T09:08:31.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.416+0000 7f795b600640 1 -- 172.21.15.175:0/3408850613 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7930066f60 msgr2=0x7f7930069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:31.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.416+0000 7f795b600640 1 --2- 172.21.15.175:0/3408850613 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7930066f60 0x7f7930069420 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f79440ae000 tx=0x7f79440a7000 comp rx=0 tx=0).stop 2024-04-25T09:08:31.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.416+0000 7f795b600640 1 -- 172.21.15.175:0/3408850613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7954145250 msgr2=0x7f79540b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:31.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.416+0000 7f795b600640 1 --2- 172.21.15.175:0/3408850613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7954145250 0x7f79540b3f20 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f793c00c370 tx=0x7f793c00c830 comp rx=0 tx=0).stop 2024-04-25T09:08:31.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.416+0000 7f795b600640 1 -- 172.21.15.175:0/3408850613 shutdown_connections 2024-04-25T09:08:31.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.416+0000 7f795b600640 1 --2- 172.21.15.175:0/3408850613 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7930066f60 0x7f7930069420 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.416+0000 7f795b600640 1 --2- 172.21.15.175:0/3408850613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79541600a0 0x7f79541f6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.416+0000 7f795b600640 1 --2- 172.21.15.175:0/3408850613 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7954145250 0x7f79540b3f20 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.416+0000 7f795b600640 1 --2- 172.21.15.175:0/3408850613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79540ce970 0x7f795413e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.416+0000 7f795b600640 1 -- 172.21.15.175:0/3408850613 >> 172.21.15.175:0/3408850613 conn(0x7f795406ac50 msgr2=0x7f79540af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:31.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.416+0000 7f795b600640 1 -- 172.21.15.175:0/3408850613 shutdown_connections 2024-04-25T09:08:31.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.416+0000 7f795b600640 1 -- 172.21.15.175:0/3408850613 wait complete. 2024-04-25T09:08:31.423 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:08:31.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:31.424 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:08:31.483 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:08:31.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:31.484 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:08:31.494 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:08:31.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.680+0000 7f53d2400640 1 Processor -- start 2024-04-25T09:08:31.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.680+0000 7f53d2400640 1 -- start start 2024-04-25T09:08:31.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.684+0000 7f53d2400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc15bc70 0x7f53cc0b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:31.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.684+0000 7f53d2400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f53cc06b780 0x7f53cc0cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:31.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.684+0000 7f53d2400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53cc0b0000 con 0x7f53cc0cc910 2024-04-25T09:08:31.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.684+0000 7f53d2400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53cc0b08f0 con 0x7f53cc06b780 2024-04-25T09:08:31.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.684+0000 7f53d2400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc0b02a0 con 0x7f53cc15bc70 2024-04-25T09:08:31.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.684+0000 7f53c2a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f53cc06b780 0x7f53cc0cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:31.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.684+0000 7f53c2a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f53cc06b780 0x7f53cc0cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41170/0 (socket says 172.21.15.175:41170) 2024-04-25T09:08:31.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.684+0000 7f53c2a00640 1 -- 172.21.15.175:0/1672985522 learned_addr learned my addr 172.21.15.175:0/1672985522 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:31.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.684+0000 7f53cb400640 1 --2- 172.21.15.175:0/1672985522 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc15bc70 0x7f53cc0b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:31.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.684+0000 7f53c2a00640 1 -- 172.21.15.175:0/1672985522 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc15bc70 msgr2=0x7f53cc0b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:31.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.684+0000 7f53c2a00640 1 --2- 172.21.15.175:0/1672985522 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc15bc70 0x7f53cc0b0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.684+0000 7f53c2a00640 1 -- 172.21.15.175:0/1672985522 >> v1:172.21.15.177:6789/0 conn(0x7f53cc0cc910 legacy=0x7f53cc0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:31.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.684+0000 7f53c2a00640 1 -- 172.21.15.175:0/1672985522 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc0b0580 con 0x7f53cc06b780 2024-04-25T09:08:31.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53c2a00640 1 --2- 172.21.15.175:0/1672985522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53cc06b780 0x7f53cc0cc3d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f53b4009870 tx=0x7f53b401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c819e0b918bbdc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:31.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53caa00640 1 -- 172.21.15.175:0/1672985522 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40b5070 con 0x7f53cc06b780 2024-04-25T09:08:31.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53caa00640 1 -- 172.21.15.175:0/1672985522 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b40a8a50 con 0x7f53cc06b780 2024-04-25T09:08:31.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53caa00640 1 -- 172.21.15.175:0/1672985522 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40a8e20 con 0x7f53cc06b780 2024-04-25T09:08:31.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53d2400640 1 -- 172.21.15.175:0/1672985522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53cc06b780 msgr2=0x7f53cc0cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:31.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53d2400640 1 --2- 172.21.15.175:0/1672985522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53cc06b780 0x7f53cc0cc3d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f53b4009870 tx=0x7f53b401ed50 comp rx=0 tx=0).stop 2024-04-25T09:08:31.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53d2400640 1 -- 172.21.15.175:0/1672985522 shutdown_connections 2024-04-25T09:08:31.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53d2400640 1 --2- 172.21.15.175:0/1672985522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53cc06b780 0x7f53cc0cc3d0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53d2400640 1 --2- 172.21.15.175:0/1672985522 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc15bc70 0x7f53cc0b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53d2400640 1 -- 172.21.15.175:0/1672985522 >> 172.21.15.175:0/1672985522 conn(0x7f53cc0d06c0 msgr2=0x7f53cc0d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:31.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53d2400640 1 -- 172.21.15.175:0/1672985522 shutdown_connections 2024-04-25T09:08:31.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53d2400640 1 -- 172.21.15.175:0/1672985522 wait complete. 2024-04-25T09:08:31.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53d2400640 1 Processor -- start 2024-04-25T09:08:31.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53d2400640 1 -- start start 2024-04-25T09:08:31.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53d2400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53cc06b780 0x7f53cc0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:31.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53d2400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53cc0cc910 0x7f53cc0b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:31.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53d2400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc15bc70 0x7f53cc0b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:31.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53d2400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc0b12c0 con 0x7f53cc06b780 2024-04-25T09:08:31.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53d2400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc0cde30 con 0x7f53cc0cc910 2024-04-25T09:08:31.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53d2400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc0b1d20 con 0x7f53cc15bc70 2024-04-25T09:08:31.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53cb400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53cc06b780 0x7f53cc0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:31.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53cb400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53cc06b780 0x7f53cc0c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41186/0 (socket says 172.21.15.175:41186) 2024-04-25T09:08:31.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.688+0000 7f53cb400640 1 -- 172.21.15.175:0/1193070324 learned_addr learned my addr 172.21.15.175:0/1193070324 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:31.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.692+0000 7f53c2a00640 1 --2- 172.21.15.175:0/1193070324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53cc0cc910 0x7f53cc0b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:31.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.692+0000 7f53cbe00640 1 --2- 172.21.15.175:0/1193070324 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc15bc70 0x7f53cc0b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:31.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.692+0000 7f53cb400640 1 -- 172.21.15.175:0/1193070324 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc15bc70 msgr2=0x7f53cc0b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:31.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.692+0000 7f53cb400640 1 --2- 172.21.15.175:0/1193070324 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc15bc70 0x7f53cc0b5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.692+0000 7f53cb400640 1 -- 172.21.15.175:0/1193070324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53cc0cc910 msgr2=0x7f53cc0b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:31.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.692+0000 7f53cb400640 1 --2- 172.21.15.175:0/1193070324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53cc0cc910 0x7f53cc0b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.692+0000 7f53cb400640 1 -- 172.21.15.175:0/1193070324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc0c6ff0 con 0x7f53cc06b780 2024-04-25T09:08:31.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.692+0000 7f53cb400640 1 --2- 172.21.15.175:0/1193070324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53cc06b780 0x7f53cc0c65a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f53bc007e40 tx=0x7f53bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:31.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.692+0000 7f53c3e00640 1 -- 172.21.15.175:0/1193070324 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc014620 con 0x7f53cc06b780 2024-04-25T09:08:31.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.692+0000 7f53c3e00640 1 -- 172.21.15.175:0/1193070324 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc019070 con 0x7f53cc06b780 2024-04-25T09:08:31.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.692+0000 7f53c3e00640 1 -- 172.21.15.175:0/1193070324 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc014a00 con 0x7f53cc06b780 2024-04-25T09:08:31.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.692+0000 7f53d2400640 1 -- 172.21.15.175:0/1193070324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53cc0ce430 con 0x7f53cc06b780 2024-04-25T09:08:31.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.692+0000 7f53d2400640 1 -- 172.21.15.175:0/1193070324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53cc0c6ae0 con 0x7f53cc06b780 2024-04-25T09:08:31.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.692+0000 7f53d2400640 1 -- 172.21.15.175:0/1193070324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53cc0ceb40 con 0x7f53cc06b780 2024-04-25T09:08:31.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.692+0000 7f53c3e00640 1 -- 172.21.15.175:0/1193070324 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f53bc014ba0 con 0x7f53cc06b780 2024-04-25T09:08:31.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.692+0000 7f53c3e00640 1 --2- 172.21.15.175:0/1193070324 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f53a8066f60 0x7f53a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:31.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.692+0000 7f53c3e00640 1 -- 172.21.15.175:0/1193070324 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53bc0858e0 con 0x7f53cc06b780 2024-04-25T09:08:31.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.692+0000 7f53c2a00640 1 --2- 172.21.15.175:0/1193070324 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f53a8066f60 0x7f53a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:31.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.696+0000 7f53c2a00640 1 --2- 172.21.15.175:0/1193070324 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f53a8066f60 0x7f53a8069420 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f53b40b2000 tx=0x7f53b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:31.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.696+0000 7f53c3e00640 1 -- 172.21.15.175:0/1193070324 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f53bc056850 con 0x7f53cc06b780 2024-04-25T09:08:31.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.888+0000 7f53d2400640 1 -- 172.21.15.175:0/1193070324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53cc074a60 con 0x7f53cc06b780 2024-04-25T09:08:31.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.888+0000 7f53c3e00640 1 -- 172.21.15.175:0/1193070324 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f53bc056150 con 0x7f53cc06b780 2024-04-25T09:08:31.877 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:31.877 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":43,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2493316948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2493316948},{"type":"v1","addr":"172.21.15.175:6837","nonce":2493316948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3408529232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3408529232},{"type":"v1","addr":"172.21.15.177:6834","nonce":3408529232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6513,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2714482688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2714482688},{"type":"v1","addr":"172.21.15.175:6836","nonce":2714482688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:08:17.378890+0000","modified":"2024-04-25T09:08:20.403261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6528},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6528":{"gid":6528,"name":"d","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6835/1709110121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":1709110121},{"type":"v1","addr":"172.21.15.177:6835","nonce":1709110121}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:08:31.877 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 43 2024-04-25T09:08:31.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.888+0000 7f53d2400640 1 -- 172.21.15.175:0/1193070324 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f53a8066f60 msgr2=0x7f53a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:31.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.888+0000 7f53d2400640 1 --2- 172.21.15.175:0/1193070324 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f53a8066f60 0x7f53a8069420 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f53b40b2000 tx=0x7f53b4009040 comp rx=0 tx=0).stop 2024-04-25T09:08:31.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.888+0000 7f53d2400640 1 -- 172.21.15.175:0/1193070324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53cc06b780 msgr2=0x7f53cc0c65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:31.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.888+0000 7f53d2400640 1 --2- 172.21.15.175:0/1193070324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53cc06b780 0x7f53cc0c65a0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f53bc007e40 tx=0x7f53bc00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.888+0000 7f53d2400640 1 -- 172.21.15.175:0/1193070324 shutdown_connections 2024-04-25T09:08:31.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.888+0000 7f53d2400640 1 --2- 172.21.15.175:0/1193070324 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f53a8066f60 0x7f53a8069420 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.888+0000 7f53d2400640 1 --2- 172.21.15.175:0/1193070324 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53cc15bc70 0x7f53cc0b5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.888+0000 7f53d2400640 1 --2- 172.21.15.175:0/1193070324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53cc0cc910 0x7f53cc0b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.888+0000 7f53d2400640 1 --2- 172.21.15.175:0/1193070324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53cc06b780 0x7f53cc0c65a0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:31.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.888+0000 7f53d2400640 1 -- 172.21.15.175:0/1193070324 >> 172.21.15.175:0/1193070324 conn(0x7f53cc0d06c0 msgr2=0x7f53cc0ae950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:31.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.888+0000 7f53d2400640 1 -- 172.21.15.175:0/1193070324 shutdown_connections 2024-04-25T09:08:31.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:31.888+0000 7f53d2400640 1 -- 172.21.15.175:0/1193070324 wait complete. 2024-04-25T09:08:31.899 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-04-25T09:08:32.079 INFO:teuthology.orchestra.run.smithi177.stdout:{"message":"","return_code":0} 2024-04-25T09:08:32.079 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:08:32.079 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:08:32.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.228+0000 7f9026800640 1 Processor -- start 2024-04-25T09:08:32.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.228+0000 7f9026800640 1 -- start start 2024-04-25T09:08:32.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.228+0000 7f9026800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f90200af570 0x7f9020146d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.228+0000 7f9026800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90200ce0c0 0x7f902006dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.228+0000 7f9026800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f902006c5c0 con 0x7f9020147240 2024-04-25T09:08:32.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.228+0000 7f9026800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902006ba40 con 0x7f90200af570 2024-04-25T09:08:32.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.228+0000 7f9026800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902006bd20 con 0x7f90200ce0c0 2024-04-25T09:08:32.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.228+0000 7f9025400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f90200af570 0x7f9020146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.228+0000 7f9025400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f90200af570 0x7f9020146d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41198/0 (socket says 172.21.15.175:41198) 2024-04-25T09:08:32.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.228+0000 7f9025400640 1 -- 172.21.15.175:0/3701391903 learned_addr learned my addr 172.21.15.175:0/3701391903 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:32.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.228+0000 7f9024a00640 1 --1- 172.21.15.175:0/3701391903 >> v1:172.21.15.175:6789/0 conn(0x7f9020147240 0x7f90200cd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:49712/0 (socket says 172.21.15.175:49712) 2024-04-25T09:08:32.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.228+0000 7f9025e00640 1 --2- 172.21.15.175:0/3701391903 >> v2:172.21.15.177:3300/0 conn(0x7f90200ce0c0 0x7f902006dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.228+0000 7f9025400640 1 -- 172.21.15.175:0/3701391903 >> v2:172.21.15.177:3300/0 conn(0x7f90200ce0c0 msgr2=0x7f902006dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:32.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.228+0000 7f9025400640 1 --2- 172.21.15.175:0/3701391903 >> v2:172.21.15.177:3300/0 conn(0x7f90200ce0c0 0x7f902006dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.228+0000 7f9025400640 1 -- 172.21.15.175:0/3701391903 >> v1:172.21.15.175:6789/0 conn(0x7f9020147240 legacy=0x7f90200cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:32.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.228+0000 7f9025400640 1 -- 172.21.15.175:0/3701391903 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902006c000 con 0x7f90200af570 2024-04-25T09:08:32.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.232+0000 7f9025400640 1 --2- 172.21.15.175:0/3701391903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90200af570 0x7f9020146d00 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9020162660 tx=0x7f901401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16760474e2658183 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:32.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.232+0000 7f901fe00640 1 -- 172.21.15.175:0/3701391903 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90140aa670 con 0x7f90200af570 2024-04-25T09:08:32.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.232+0000 7f901fe00640 1 -- 172.21.15.175:0/3701391903 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90140af070 con 0x7f90200af570 2024-04-25T09:08:32.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.232+0000 7f901fe00640 1 -- 172.21.15.175:0/3701391903 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90140aaa30 con 0x7f90200af570 2024-04-25T09:08:32.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.232+0000 7f9026800640 1 -- 172.21.15.175:0/3701391903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90200af570 msgr2=0x7f9020146d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:32.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.232+0000 7f9026800640 1 --2- 172.21.15.175:0/3701391903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90200af570 0x7f9020146d00 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9020162660 tx=0x7f901401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.232+0000 7f9026800640 1 -- 172.21.15.175:0/3701391903 shutdown_connections 2024-04-25T09:08:32.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.232+0000 7f9026800640 1 --2- 172.21.15.175:0/3701391903 >> v2:172.21.15.177:3300/0 conn(0x7f90200ce0c0 0x7f902006dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.232+0000 7f9026800640 1 --2- 172.21.15.175:0/3701391903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90200af570 0x7f9020146d00 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.232+0000 7f9026800640 1 -- 172.21.15.175:0/3701391903 >> 172.21.15.175:0/3701391903 conn(0x7f90200cc860 msgr2=0x7f90200ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:32.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.232+0000 7f9026800640 1 -- 172.21.15.175:0/3701391903 shutdown_connections 2024-04-25T09:08:32.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.232+0000 7f9026800640 1 -- 172.21.15.175:0/3701391903 wait complete. 2024-04-25T09:08:32.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9026800640 1 Processor -- start 2024-04-25T09:08:32.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9026800640 1 -- start start 2024-04-25T09:08:32.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9026800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90200af570 0x7f90201422d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9026800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90200ce0c0 0x7f90200b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9026800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9020147240 0x7f90200b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9026800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902006ee70 con 0x7f9020147240 2024-04-25T09:08:32.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9026800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902006ecf0 con 0x7f90200af570 2024-04-25T09:08:32.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9026800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902006eff0 con 0x7f90200ce0c0 2024-04-25T09:08:32.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9025e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9020147240 0x7f90200b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9025e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9020147240 0x7f90200b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41202/0 (socket says 172.21.15.175:41202) 2024-04-25T09:08:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9025e00640 1 -- 172.21.15.175:0/2463517913 learned_addr learned my addr 172.21.15.175:0/2463517913 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9024a00640 1 --2- 172.21.15.175:0/2463517913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90200ce0c0 0x7f90200b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9025400640 1 --2- 172.21.15.175:0/2463517913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90200af570 0x7f90201422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9025e00640 1 -- 172.21.15.175:0/2463517913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90200ce0c0 msgr2=0x7f90200b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9025e00640 1 --2- 172.21.15.175:0/2463517913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90200ce0c0 0x7f90200b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9025e00640 1 -- 172.21.15.175:0/2463517913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90200af570 msgr2=0x7f90201422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9025e00640 1 --2- 172.21.15.175:0/2463517913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90200af570 0x7f90201422d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9025e00640 1 -- 172.21.15.175:0/2463517913 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90200b5b50 con 0x7f9020147240 2024-04-25T09:08:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9025e00640 1 --2- 172.21.15.175:0/2463517913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9020147240 0x7f90200b0c90 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f901800efc0 tx=0x7f901800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f901d600640 1 -- 172.21.15.175:0/2463517913 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018018020 con 0x7f9020147240 2024-04-25T09:08:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f901d600640 1 -- 172.21.15.175:0/2463517913 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9018014480 con 0x7f9020147240 2024-04-25T09:08:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f901d600640 1 -- 172.21.15.175:0/2463517913 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018009e60 con 0x7f9020147240 2024-04-25T09:08:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9026800640 1 -- 172.21.15.175:0/2463517913 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90201428b0 con 0x7f9020147240 2024-04-25T09:08:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9026800640 1 -- 172.21.15.175:0/2463517913 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9020142e70 con 0x7f9020147240 2024-04-25T09:08:32.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.236+0000 7f9026800640 1 -- 172.21.15.175:0/2463517913 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9020074a60 con 0x7f9020147240 2024-04-25T09:08:32.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.240+0000 7f901d600640 1 -- 172.21.15.175:0/2463517913 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f901801b020 con 0x7f9020147240 2024-04-25T09:08:32.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.240+0000 7f901d600640 1 --2- 172.21.15.175:0/2463517913 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9000066f60 0x7f9000069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.240+0000 7f901d600640 1 -- 172.21.15.175:0/2463517913 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9018085d90 con 0x7f9020147240 2024-04-25T09:08:32.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.240+0000 7f9025400640 1 --2- 172.21.15.175:0/2463517913 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9000066f60 0x7f9000069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.240+0000 7f9025400640 1 --2- 172.21.15.175:0/2463517913 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9000066f60 0x7f9000069420 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f90140ae000 tx=0x7f90140a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:32.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.244+0000 7f901d600640 1 -- 172.21.15.175:0/2463517913 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9018022030 con 0x7f9020147240 2024-04-25T09:08:32.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.428+0000 7f9026800640 1 -- 172.21.15.175:0/2463517913 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9020143580 con 0x7f9020147240 2024-04-25T09:08:32.419 INFO:tasks.ceph.mon.a.smithi175.stderr:2024-04-25T09:08:32.428+0000 7feb0ee00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:08:32.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.432+0000 7f901d600640 1 -- 172.21.15.175:0/2463517913 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9018010040 con 0x7f9020147240 2024-04-25T09:08:32.421 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:08:32.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.432+0000 7f9026800640 1 -- 172.21.15.175:0/2463517913 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9000066f60 msgr2=0x7f9000069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:32.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.432+0000 7f9026800640 1 --2- 172.21.15.175:0/2463517913 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9000066f60 0x7f9000069420 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f90140ae000 tx=0x7f90140a7000 comp rx=0 tx=0).stop 2024-04-25T09:08:32.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.432+0000 7f9026800640 1 -- 172.21.15.175:0/2463517913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9020147240 msgr2=0x7f90200b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:32.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.432+0000 7f9026800640 1 --2- 172.21.15.175:0/2463517913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9020147240 0x7f90200b0c90 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f901800efc0 tx=0x7f901800c490 comp rx=0 tx=0).stop 2024-04-25T09:08:32.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.432+0000 7f9026800640 1 -- 172.21.15.175:0/2463517913 shutdown_connections 2024-04-25T09:08:32.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.432+0000 7f9026800640 1 --2- 172.21.15.175:0/2463517913 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9000066f60 0x7f9000069420 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.432+0000 7f9026800640 1 --2- 172.21.15.175:0/2463517913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9020147240 0x7f90200b0c90 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.432+0000 7f9026800640 1 --2- 172.21.15.175:0/2463517913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90200ce0c0 0x7f90200b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.432+0000 7f9026800640 1 --2- 172.21.15.175:0/2463517913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90200af570 0x7f90201422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.432+0000 7f9026800640 1 -- 172.21.15.175:0/2463517913 >> 172.21.15.175:0/2463517913 conn(0x7f90200cc860 msgr2=0x7f90200cd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:32.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.432+0000 7f9026800640 1 -- 172.21.15.175:0/2463517913 shutdown_connections 2024-04-25T09:08:32.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.436+0000 7f9026800640 1 -- 172.21.15.175:0/2463517913 wait complete. 2024-04-25T09:08:32.432 INFO:tasks.ceph.mds.d.smithi177.stderr: -4600> 2024-04-25T09:08:19.989+0000 7f1ee4a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:08:32.443 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-04-25T09:08:32.481 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-04-25T09:08:32.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.500+0000 7f84df469080 1 Processor -- start 2024-04-25T09:08:32.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.500+0000 7f84df469080 1 -- start start 2024-04-25T09:08:32.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84df469080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a51059740 0x560a50fe7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84df469080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a51059b20 0x560a510776b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84df469080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a5105b630 0x560a50fe54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84df469080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a5105be50 con 0x560a51059b20 2024-04-25T09:08:32.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84df469080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a50f479f0 con 0x560a5105b630 2024-04-25T09:08:32.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84df469080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a5105a9b0 con 0x560a51059740 2024-04-25T09:08:32.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84dbc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a51059b20 0x560a510776b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84dbc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a51059b20 0x560a510776b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41220/0 (socket says 172.21.15.175:41220) 2024-04-25T09:08:32.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84dbc00640 1 -- 172.21.15.175:0/70991932 learned_addr learned my addr 172.21.15.175:0/70991932 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:32.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84dc600640 1 --2- 172.21.15.175:0/70991932 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a51059740 0x560a50fe7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84dd000640 1 --2- 172.21.15.175:0/70991932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a5105b630 0x560a50fe54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84dbc00640 1 -- 172.21.15.175:0/70991932 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a51059740 msgr2=0x560a50fe7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:32.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84dbc00640 1 --2- 172.21.15.175:0/70991932 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a51059740 0x560a50fe7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84dbc00640 1 -- 172.21.15.175:0/70991932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a5105b630 msgr2=0x560a50fe54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:32.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84dbc00640 1 --2- 172.21.15.175:0/70991932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a5105b630 0x560a50fe54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84dbc00640 1 -- 172.21.15.175:0/70991932 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a51079ba0 con 0x560a51059b20 2024-04-25T09:08:32.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84dbc00640 1 --2- 172.21.15.175:0/70991932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a51059b20 0x560a510776b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f84c8018f80 tx=0x7f84c8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6351739463b1d2e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:32.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84da800640 1 -- 172.21.15.175:0/70991932 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c80af040 con 0x560a51059b20 2024-04-25T09:08:32.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84da800640 1 -- 172.21.15.175:0/70991932 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c80b9070 con 0x560a51059b20 2024-04-25T09:08:32.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84da800640 1 -- 172.21.15.175:0/70991932 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c80aac70 con 0x560a51059b20 2024-04-25T09:08:32.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84df469080 1 -- 172.21.15.175:0/70991932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a51059b20 msgr2=0x560a510776b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:32.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84df469080 1 --2- 172.21.15.175:0/70991932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a51059b20 0x560a510776b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f84c8018f80 tx=0x7f84c8003030 comp rx=0 tx=0).stop 2024-04-25T09:08:32.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84df469080 1 -- 172.21.15.175:0/70991932 shutdown_connections 2024-04-25T09:08:32.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84df469080 1 --2- 172.21.15.175:0/70991932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a5105b630 0x560a50fe54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84df469080 1 --2- 172.21.15.175:0/70991932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a51059b20 0x560a510776b0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84df469080 1 --2- 172.21.15.175:0/70991932 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a51059740 0x560a50fe7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84df469080 1 -- 172.21.15.175:0/70991932 >> 172.21.15.175:0/70991932 conn(0x560a50fa1420 msgr2=0x560a50fe20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:32.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84df469080 1 -- 172.21.15.175:0/70991932 shutdown_connections 2024-04-25T09:08:32.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84df469080 1 -- 172.21.15.175:0/70991932 wait complete. 2024-04-25T09:08:32.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84df469080 1 Processor -- start 2024-04-25T09:08:32.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.504+0000 7f84df469080 1 -- start start 2024-04-25T09:08:32.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84df469080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a51059740 0x560a51063ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84df469080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a51059b20 0x560a51058bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84df469080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a5105b630 0x560a51062270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84df469080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a50fe3500 con 0x560a51059b20 2024-04-25T09:08:32.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84df469080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a50fe3260 con 0x560a51059740 2024-04-25T09:08:32.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84df469080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x560a50fe37a0 con 0x560a5105b630 2024-04-25T09:08:32.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84dbc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a51059b20 0x560a51058bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84dc600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a51059740 0x560a51063ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84dbc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a51059b20 0x560a51058bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41224/0 (socket says 172.21.15.175:41224) 2024-04-25T09:08:32.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84dbc00640 1 -- 172.21.15.175:0/4024558914 learned_addr learned my addr 172.21.15.175:0/4024558914 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:32.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84dd000640 1 --2- 172.21.15.175:0/4024558914 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a5105b630 0x560a51062270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84dbc00640 1 -- 172.21.15.175:0/4024558914 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a5105b630 msgr2=0x560a51062270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:32.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84dbc00640 1 --2- 172.21.15.175:0/4024558914 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560a5105b630 0x560a51062270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84dbc00640 1 -- 172.21.15.175:0/4024558914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a51059740 msgr2=0x560a51063ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:32.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84dbc00640 1 --2- 172.21.15.175:0/4024558914 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560a51059740 0x560a51063ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84dbc00640 1 -- 172.21.15.175:0/4024558914 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a51062fd0 con 0x560a51059b20 2024-04-25T09:08:32.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84dbc00640 1 --2- 172.21.15.175:0/4024558914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a51059b20 0x560a51058bd0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f84c80b6040 tx=0x7f84c80180f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:32.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84d9400640 1 -- 172.21.15.175:0/4024558914 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c80af040 con 0x560a51059b20 2024-04-25T09:08:32.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84d9400640 1 -- 172.21.15.175:0/4024558914 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c80c8630 con 0x560a51059b20 2024-04-25T09:08:32.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84df469080 1 -- 172.21.15.175:0/4024558914 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560a51063270 con 0x560a51059b20 2024-04-25T09:08:32.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84d9400640 1 -- 172.21.15.175:0/4024558914 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c80c8a20 con 0x560a51059b20 2024-04-25T09:08:32.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84df469080 1 -- 172.21.15.175:0/4024558914 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560a510637b0 con 0x560a51059b20 2024-04-25T09:08:32.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.508+0000 7f84d9400640 1 -- 172.21.15.175:0/4024558914 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f84c80c6020 con 0x560a51059b20 2024-04-25T09:08:32.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84d9400640 1 --2- 172.21.15.175:0/4024558914 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f84bc065970 0x7f84bc067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84d9400640 1 -- 172.21.15.175:0/4024558914 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f84c8120090 con 0x560a51059b20 2024-04-25T09:08:32.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84dc600640 1 --2- 172.21.15.175:0/4024558914 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f84bc065970 0x7f84bc067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84df469080 1 --2- 172.21.15.175:0/4024558914 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x560a51078bd0 0x560a5110f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84df469080 1 -- 172.21.15.175:0/4024558914 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:1 10.10 10:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70) v9 -- 0x560a5110fcd0 con 0x560a51078bd0 2024-04-25T09:08:32.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84dd000640 1 --2- 172.21.15.175:0/4024558914 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x560a51078bd0 0x560a5110f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84dc600640 1 --2- 172.21.15.175:0/4024558914 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f84bc065970 0x7f84bc067e30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f84cc005410 tx=0x7f84cc00c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:32.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84dd000640 1 --2- 172.21.15.175:0/4024558914 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x560a51078bd0 0x560a5110f790 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:32.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84dd000640 1 -- 172.21.15.175:0/4024558914 <== osd.4 v2:172.21.15.177:6808/236493968 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v70'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f84d4002630 con 0x560a51078bd0 2024-04-25T09:08:32.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84df469080 1 -- 172.21.15.175:0/4024558914 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x560a51078bd0 msgr2=0x560a5110f790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:32.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84df469080 1 --2- 172.21.15.175:0/4024558914 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x560a51078bd0 0x560a5110f790 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84df469080 1 -- 172.21.15.175:0/4024558914 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f84bc065970 msgr2=0x7f84bc067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:32.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84df469080 1 --2- 172.21.15.175:0/4024558914 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f84bc065970 0x7f84bc067e30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f84cc005410 tx=0x7f84cc00c040 comp rx=0 tx=0).stop 2024-04-25T09:08:32.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84df469080 1 -- 172.21.15.175:0/4024558914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a51059b20 msgr2=0x560a51058bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:32.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84df469080 1 --2- 172.21.15.175:0/4024558914 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560a51059b20 0x560a51058bd0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f84c80b6040 tx=0x7f84c80180f0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84dd000640 1 -- 172.21.15.175:0/4024558914 reap_dead start 2024-04-25T09:08:32.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84df469080 1 -- 172.21.15.175:0/4024558914 shutdown_connections 2024-04-25T09:08:32.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84df469080 1 -- 172.21.15.175:0/4024558914 >> 172.21.15.175:0/4024558914 conn(0x560a50fa1420 msgr2=0x560a51076920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:32.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84df469080 1 -- 172.21.15.175:0/4024558914 shutdown_connections 2024-04-25T09:08:32.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.512+0000 7f84df469080 1 -- 172.21.15.175:0/4024558914 wait complete. 2024-04-25T09:08:32.508 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T09:08:32.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.704+0000 7f9830000640 1 Processor -- start 2024-04-25T09:08:32.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.704+0000 7f9830000640 1 -- start start 2024-04-25T09:08:32.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.704+0000 7f9830000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98280b3230 0x7f98280b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.704+0000 7f9830000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982815dd10 con 0x7f98280b3d20 2024-04-25T09:08:32.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.704+0000 7f9830000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982815dff0 con 0x7f98280719e0 2024-04-25T09:08:32.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.704+0000 7f9830000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982815e2d0 con 0x7f98280b3230 2024-04-25T09:08:32.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.704+0000 7f982cc00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f98280b3d20 0x7f98280712d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:49714/0 (socket says 172.21.15.175:49714) 2024-04-25T09:08:32.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.704+0000 7f982cc00640 1 -- 172.21.15.175:0/3479801206 learned_addr learned my addr 172.21.15.175:0/3479801206 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:32.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.704+0000 7f982d600640 1 --2- 172.21.15.175:0/3479801206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98280b3230 0x7f98280b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.704+0000 7f9827e00640 1 -- 172.21.15.175:0/3479801206 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267797944 0 0) 0x7f982815dd10 con 0x7f98280b3d20 2024-04-25T09:08:32.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.704+0000 7f9827e00640 1 -- 172.21.15.175:0/3479801206 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9810005740 con 0x7f98280b3d20 2024-04-25T09:08:32.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.704+0000 7f982d600640 1 -- 172.21.15.175:0/3479801206 >> v1:172.21.15.177:6789/0 conn(0x7f98280719e0 legacy=0x7f982815aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:32.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.704+0000 7f982d600640 1 -- 172.21.15.175:0/3479801206 >> v1:172.21.15.175:6789/0 conn(0x7f98280b3d20 legacy=0x7f98280712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:32.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.704+0000 7f982d600640 1 -- 172.21.15.175:0/3479801206 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982815e5b0 con 0x7f98280b3230 2024-04-25T09:08:32.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.708+0000 7f982d600640 1 --2- 172.21.15.175:0/3479801206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98280b3230 0x7f98280b2660 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f981c0097f0 tx=0x7f981c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1404a679aa88a1ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:32.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.708+0000 7f9827e00640 1 -- 172.21.15.175:0/3479801206 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0aa610 con 0x7f98280b3230 2024-04-25T09:08:32.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.708+0000 7f9827e00640 1 -- 172.21.15.175:0/3479801206 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c0af070 con 0x7f98280b3230 2024-04-25T09:08:32.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.708+0000 7f9827e00640 1 -- 172.21.15.175:0/3479801206 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0aa9d0 con 0x7f98280b3230 2024-04-25T09:08:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.708+0000 7f9830000640 1 -- 172.21.15.175:0/3479801206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98280b3230 msgr2=0x7f98280b2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.708+0000 7f9830000640 1 --2- 172.21.15.175:0/3479801206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98280b3230 0x7f98280b2660 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f981c0097f0 tx=0x7f981c01c4b0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.708+0000 7f9830000640 1 -- 172.21.15.175:0/3479801206 shutdown_connections 2024-04-25T09:08:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.708+0000 7f9830000640 1 --2- 172.21.15.175:0/3479801206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98280b3230 0x7f98280b2660 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.708+0000 7f9830000640 1 -- 172.21.15.175:0/3479801206 >> 172.21.15.175:0/3479801206 conn(0x7f982806ac50 msgr2=0x7f982806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.708+0000 7f9830000640 1 -- 172.21.15.175:0/3479801206 shutdown_connections 2024-04-25T09:08:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.708+0000 7f9830000640 1 -- 172.21.15.175:0/3479801206 wait complete. 2024-04-25T09:08:32.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f9830000640 1 Processor -- start 2024-04-25T09:08:32.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f9830000640 1 -- start start 2024-04-25T09:08:32.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f9830000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98280719e0 0x7f982814aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f9830000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98280b3230 0x7f982815c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f9830000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98280b3d20 0x7f98281598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f9830000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982815b710 con 0x7f98280b3d20 2024-04-25T09:08:32.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f9830000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982815b590 con 0x7f98280719e0 2024-04-25T09:08:32.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f9830000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98280b3610 con 0x7f98280b3230 2024-04-25T09:08:32.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f982e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98280b3d20 0x7f98281598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f982e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98280b3d20 0x7f98281598e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41240/0 (socket says 172.21.15.175:41240) 2024-04-25T09:08:32.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f982e000640 1 -- 172.21.15.175:0/2458993194 learned_addr learned my addr 172.21.15.175:0/2458993194 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:32.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f982d600640 1 --2- 172.21.15.175:0/2458993194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98280719e0 0x7f982814aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f982cc00640 1 --2- 172.21.15.175:0/2458993194 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98280b3230 0x7f982815c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f982e000640 1 -- 172.21.15.175:0/2458993194 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98280b3230 msgr2=0x7f982815c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:32.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f982e000640 1 --2- 172.21.15.175:0/2458993194 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98280b3230 0x7f982815c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f982e000640 1 -- 172.21.15.175:0/2458993194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98280719e0 msgr2=0x7f982814aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:32.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f982e000640 1 --2- 172.21.15.175:0/2458993194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98280719e0 0x7f982814aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:32.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f982e000640 1 -- 172.21.15.175:0/2458993194 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9828153060 con 0x7f98280b3d20 2024-04-25T09:08:32.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f982cc00640 1 --2- 172.21.15.175:0/2458993194 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98280b3230 0x7f982815c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:32.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f982d600640 1 --2- 172.21.15.175:0/2458993194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98280719e0 0x7f982814aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:32.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f982e000640 1 --2- 172.21.15.175:0/2458993194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98280b3d20 0x7f98281598e0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f982000c730 tx=0x7f982000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:32.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f9825600640 1 -- 172.21.15.175:0/2458993194 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820003b80 con 0x7f98280b3d20 2024-04-25T09:08:32.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f9825600640 1 -- 172.21.15.175:0/2458993194 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9820003d20 con 0x7f98280b3d20 2024-04-25T09:08:32.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f9825600640 1 -- 172.21.15.175:0/2458993194 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820005310 con 0x7f98280b3d20 2024-04-25T09:08:32.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f9830000640 1 -- 172.21.15.175:0/2458993194 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9828153340 con 0x7f98280b3d20 2024-04-25T09:08:32.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f9830000640 1 -- 172.21.15.175:0/2458993194 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9828153900 con 0x7f98280b3d20 2024-04-25T09:08:32.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.712+0000 7f9830000640 1 -- 172.21.15.175:0/2458993194 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9828075160 con 0x7f98280b3d20 2024-04-25T09:08:32.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.716+0000 7f9825600640 1 -- 172.21.15.175:0/2458993194 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f98200056c0 con 0x7f98280b3d20 2024-04-25T09:08:32.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.716+0000 7f9825600640 1 --2- 172.21.15.175:0/2458993194 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9808066f60 0x7f9808069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:32.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.716+0000 7f9825600640 1 -- 172.21.15.175:0/2458993194 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9820085130 con 0x7f98280b3d20 2024-04-25T09:08:32.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.716+0000 7f982d600640 1 --2- 172.21.15.175:0/2458993194 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9808066f60 0x7f9808069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:32.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.716+0000 7f982d600640 1 --2- 172.21.15.175:0/2458993194 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9808066f60 0x7f9808069420 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f981c0ae000 tx=0x7f981c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:32.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.720+0000 7f9825600640 1 -- 172.21.15.175:0/2458993194 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f98200560d0 con 0x7f98280b3d20 2024-04-25T09:08:32.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:32.908+0000 7f9830000640 1 -- 172.21.15.175:0/2458993194 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f9828072370 con 0x7f98280b3d20 2024-04-25T09:08:33.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.431+0000 7f9825600640 1 -- 172.21.15.175:0/2458993194 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v45) v1 ==== 162+0+0 (secure 0 0 0) 0x7f98200559d0 con 0x7f98280b3d20 2024-04-25T09:08:33.423 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T09:08:33.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.435+0000 7f9830000640 1 -- 172.21.15.175:0/2458993194 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9808066f60 msgr2=0x7f9808069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:33.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.435+0000 7f9830000640 1 --2- 172.21.15.175:0/2458993194 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9808066f60 0x7f9808069420 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f981c0ae000 tx=0x7f981c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:08:33.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.435+0000 7f9830000640 1 -- 172.21.15.175:0/2458993194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98280b3d20 msgr2=0x7f98281598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:33.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.435+0000 7f9830000640 1 --2- 172.21.15.175:0/2458993194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98280b3d20 0x7f98281598e0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f982000c730 tx=0x7f982000cbf0 comp rx=0 tx=0).stop 2024-04-25T09:08:33.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.435+0000 7f9830000640 1 -- 172.21.15.175:0/2458993194 shutdown_connections 2024-04-25T09:08:33.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.435+0000 7f9830000640 1 --2- 172.21.15.175:0/2458993194 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9808066f60 0x7f9808069420 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:33.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.435+0000 7f9830000640 1 --2- 172.21.15.175:0/2458993194 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98280b3d20 0x7f98281598e0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:33.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.435+0000 7f9830000640 1 --2- 172.21.15.175:0/2458993194 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98280b3230 0x7f982815c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:33.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.435+0000 7f9830000640 1 --2- 172.21.15.175:0/2458993194 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98280719e0 0x7f982814aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:33.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.435+0000 7f9830000640 1 -- 172.21.15.175:0/2458993194 >> 172.21.15.175:0/2458993194 conn(0x7f982806ac50 msgr2=0x7f98281541d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:33.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.435+0000 7f9830000640 1 -- 172.21.15.175:0/2458993194 shutdown_connections 2024-04-25T09:08:33.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.435+0000 7f9830000640 1 -- 172.21.15.175:0/2458993194 wait complete. 2024-04-25T09:08:33.450 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:08:33.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.595+0000 7fee59600640 1 Processor -- start 2024-04-25T09:08:33.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.595+0000 7fee59600640 1 -- start start 2024-04-25T09:08:33.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.595+0000 7fee59600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fee5415db00 0x7fee5406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:33.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.595+0000 7fee59600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fee540acd90 0x7fee54161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:33.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.595+0000 7fee59600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fee54161c60 0x7fee541620f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:33.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.595+0000 7fee59600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5406f280 con 0x7fee540acd90 2024-04-25T09:08:33.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.595+0000 7fee59600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5406acf0 con 0x7fee54161c60 2024-04-25T09:08:33.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.595+0000 7fee59600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5406afd0 con 0x7fee5415db00 2024-04-25T09:08:33.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.595+0000 7fee4a000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fee540acd90 0x7fee54161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:33.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.595+0000 7fee4a000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fee540acd90 0x7fee54161720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41242/0 (socket says 172.21.15.175:41242) 2024-04-25T09:08:33.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.595+0000 7fee4a000640 1 -- 172.21.15.175:0/3982671345 learned_addr learned my addr 172.21.15.175:0/3982671345 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:33.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.595+0000 7fee52a00640 1 --2- 172.21.15.175:0/3982671345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fee5415db00 0x7fee5406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:33.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.595+0000 7fee53400640 1 --2- 172.21.15.175:0/3982671345 >> v2:172.21.15.177:3300/0 conn(0x7fee54161c60 0x7fee541620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:33.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.599+0000 7fee4a000640 1 -- 172.21.15.175:0/3982671345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fee5415db00 msgr2=0x7fee5406e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:33.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.599+0000 7fee4a000640 1 --2- 172.21.15.175:0/3982671345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fee5415db00 0x7fee5406e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:33.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.599+0000 7fee4a000640 1 -- 172.21.15.175:0/3982671345 >> v2:172.21.15.177:3300/0 conn(0x7fee54161c60 msgr2=0x7fee541620f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:33.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.599+0000 7fee4a000640 1 --2- 172.21.15.175:0/3982671345 >> v2:172.21.15.177:3300/0 conn(0x7fee54161c60 0x7fee541620f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:33.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.599+0000 7fee4a000640 1 -- 172.21.15.175:0/3982671345 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5406b2b0 con 0x7fee540acd90 2024-04-25T09:08:33.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.599+0000 7fee4a000640 1 --2- 172.21.15.175:0/3982671345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee540acd90 0x7fee54161720 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fee540cc810 tx=0x7fee3c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a572b38385b89c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:33.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.599+0000 7fee52000640 1 -- 172.21.15.175:0/3982671345 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0aa600 con 0x7fee540acd90 2024-04-25T09:08:33.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.599+0000 7fee52000640 1 -- 172.21.15.175:0/3982671345 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c0af070 con 0x7fee540acd90 2024-04-25T09:08:33.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.599+0000 7fee52000640 1 -- 172.21.15.175:0/3982671345 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0aa9c0 con 0x7fee540acd90 2024-04-25T09:08:33.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.599+0000 7fee59600640 1 -- 172.21.15.175:0/3982671345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee540acd90 msgr2=0x7fee54161720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:33.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.599+0000 7fee59600640 1 --2- 172.21.15.175:0/3982671345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee540acd90 0x7fee54161720 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fee540cc810 tx=0x7fee3c01c4c0 comp rx=0 tx=0).stop 2024-04-25T09:08:33.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee59600640 1 -- 172.21.15.175:0/3982671345 shutdown_connections 2024-04-25T09:08:33.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee59600640 1 --2- 172.21.15.175:0/3982671345 >> v2:172.21.15.177:3300/0 conn(0x7fee54161c60 0x7fee541620f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:33.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee59600640 1 --2- 172.21.15.175:0/3982671345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee540acd90 0x7fee54161720 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:33.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee59600640 1 --2- 172.21.15.175:0/3982671345 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fee5415db00 0x7fee5406e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:33.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee59600640 1 -- 172.21.15.175:0/3982671345 >> 172.21.15.175:0/3982671345 conn(0x7fee540b2200 msgr2=0x7fee540cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:33.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee59600640 1 -- 172.21.15.175:0/3982671345 shutdown_connections 2024-04-25T09:08:33.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee59600640 1 -- 172.21.15.175:0/3982671345 wait complete. 2024-04-25T09:08:33.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee59600640 1 Processor -- start 2024-04-25T09:08:33.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee59600640 1 -- start start 2024-04-25T09:08:33.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee59600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee540acd90 0x7fee540ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:33.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee59600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee5415db00 0x7fee54156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:33.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee59600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fee54161c60 0x7fee541529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:33.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee59600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540b36d0 con 0x7fee540acd90 2024-04-25T09:08:33.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee59600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540b3550 con 0x7fee5415db00 2024-04-25T09:08:33.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee59600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee540b3850 con 0x7fee54161c60 2024-04-25T09:08:33.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee52a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee540acd90 0x7fee540ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:33.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee52a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee540acd90 0x7fee540ad250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41258/0 (socket says 172.21.15.175:41258) 2024-04-25T09:08:33.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee52a00640 1 -- 172.21.15.175:0/1077116609 learned_addr learned my addr 172.21.15.175:0/1077116609 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:33.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee53400640 1 --2- 172.21.15.175:0/1077116609 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fee54161c60 0x7fee541529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:33.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee4a000640 1 --2- 172.21.15.175:0/1077116609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee5415db00 0x7fee54156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:33.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee52a00640 1 -- 172.21.15.175:0/1077116609 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fee54161c60 msgr2=0x7fee541529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:33.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee52a00640 1 --2- 172.21.15.175:0/1077116609 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fee54161c60 0x7fee541529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:33.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee52a00640 1 -- 172.21.15.175:0/1077116609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee5415db00 msgr2=0x7fee54156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:33.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee52a00640 1 --2- 172.21.15.175:0/1077116609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee5415db00 0x7fee54156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:33.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee52a00640 1 -- 172.21.15.175:0/1077116609 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee540ce860 con 0x7fee540acd90 2024-04-25T09:08:33.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee52a00640 1 --2- 172.21.15.175:0/1077116609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee540acd90 0x7fee540ad250 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fee4400e8b0 tx=0x7fee4400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:33.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee4b400640 1 -- 172.21.15.175:0/1077116609 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44017070 con 0x7fee540acd90 2024-04-25T09:08:33.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee4b400640 1 -- 172.21.15.175:0/1077116609 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4400c940 con 0x7fee540acd90 2024-04-25T09:08:33.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee59600640 1 -- 172.21.15.175:0/1077116609 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee541574a0 con 0x7fee540acd90 2024-04-25T09:08:33.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.603+0000 7fee4b400640 1 -- 172.21.15.175:0/1077116609 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4400cd10 con 0x7fee540acd90 2024-04-25T09:08:33.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.607+0000 7fee59600640 1 -- 172.21.15.175:0/1077116609 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee540cede0 con 0x7fee540acd90 2024-04-25T09:08:33.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.607+0000 7fee59600640 1 -- 172.21.15.175:0/1077116609 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee54074a60 con 0x7fee540acd90 2024-04-25T09:08:33.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.607+0000 7fee4b400640 1 -- 172.21.15.175:0/1077116609 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fee4401a070 con 0x7fee540acd90 2024-04-25T09:08:33.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.607+0000 7fee4b400640 1 --2- 172.21.15.175:0/1077116609 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fee30066f90 0x7fee30069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:33.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.607+0000 7fee4b400640 1 -- 172.21.15.175:0/1077116609 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fee44085090 con 0x7fee540acd90 2024-04-25T09:08:33.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.607+0000 7fee4a000640 1 --2- 172.21.15.175:0/1077116609 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fee30066f90 0x7fee30069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:33.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.607+0000 7fee4a000640 1 --2- 172.21.15.175:0/1077116609 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fee30066f90 0x7fee30069450 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0ae000 tx=0x7fee3c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:33.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.611+0000 7fee4b400640 1 -- 172.21.15.175:0/1077116609 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fee44055fb0 con 0x7fee540acd90 2024-04-25T09:08:33.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.799+0000 7fee59600640 1 -- 172.21.15.175:0/1077116609 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee540d0ae0 con 0x7fee540acd90 2024-04-25T09:08:33.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.799+0000 7fee4b400640 1 -- 172.21.15.175:0/1077116609 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fee440558b0 con 0x7fee540acd90 2024-04-25T09:08:33.789 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:33.789 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2493316948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2493316948},{"type":"v1","addr":"172.21.15.175:6837","nonce":2493316948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3408529232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3408529232},{"type":"v1","addr":"172.21.15.177:6834","nonce":3408529232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/46829775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":46829775},{"type":"v1","addr":"172.21.15.177:6835","nonce":46829775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:08:17.378890+0000","modified":"2024-04-25T09:08:33.439410+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6513":{"gid":6513,"name":"a","rank":0,"incarnation":46,"state":"up:replay","state_seq":1,"addr":"172.21.15.175:6836/2714482688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2714482688},{"type":"v1","addr":"172.21.15.175:6836","nonce":2714482688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:08:33.789 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 46 2024-04-25T09:08:33.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.799+0000 7fee59600640 1 -- 172.21.15.175:0/1077116609 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fee30066f90 msgr2=0x7fee30069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:33.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.799+0000 7fee59600640 1 --2- 172.21.15.175:0/1077116609 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fee30066f90 0x7fee30069450 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0ae000 tx=0x7fee3c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:08:33.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.799+0000 7fee59600640 1 -- 172.21.15.175:0/1077116609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee540acd90 msgr2=0x7fee540ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:33.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.799+0000 7fee59600640 1 --2- 172.21.15.175:0/1077116609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee540acd90 0x7fee540ad250 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fee4400e8b0 tx=0x7fee4400ed70 comp rx=0 tx=0).stop 2024-04-25T09:08:33.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.799+0000 7fee59600640 1 -- 172.21.15.175:0/1077116609 shutdown_connections 2024-04-25T09:08:33.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.799+0000 7fee59600640 1 --2- 172.21.15.175:0/1077116609 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fee30066f90 0x7fee30069450 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:33.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.799+0000 7fee59600640 1 --2- 172.21.15.175:0/1077116609 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fee54161c60 0x7fee541529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:33.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.799+0000 7fee59600640 1 --2- 172.21.15.175:0/1077116609 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee5415db00 0x7fee54156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:33.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.799+0000 7fee59600640 1 --2- 172.21.15.175:0/1077116609 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee540acd90 0x7fee540ad250 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:33.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.799+0000 7fee59600640 1 -- 172.21.15.175:0/1077116609 >> 172.21.15.175:0/1077116609 conn(0x7fee540b2200 msgr2=0x7fee5415c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:33.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.799+0000 7fee59600640 1 -- 172.21.15.175:0/1077116609 shutdown_connections 2024-04-25T09:08:33.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:33.799+0000 7fee59600640 1 -- 172.21.15.175:0/1077116609 wait complete. 2024-04-25T09:08:34.212 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:08:17.378890+0000', 'modified': '2024-04-25T09:08:33.439410+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6513}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6513': {'gid': 6513, 'name': 'a', 'rank': 0, 'incarnation': 46, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.175:6836/2714482688', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 2714482688}, {'type': 'v1', 'addr': '172.21.15.175:6836', 'nonce': 2714482688}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:08:34.213 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6513:up:replay 2024-04-25T09:08:35.214 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:08:35.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.363+0000 7faa54e00640 1 Processor -- start 2024-04-25T09:08:35.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.363+0000 7faa54e00640 1 -- start start 2024-04-25T09:08:35.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.367+0000 7faa54e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faa500aed90 0x7faa50168710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:35.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.367+0000 7faa54e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5015dfb0 con 0x7faa5015dbd0 2024-04-25T09:08:35.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.367+0000 7faa54e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa500b2980 con 0x7faa500add90 2024-04-25T09:08:35.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.367+0000 7faa54e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa500ae1d0 con 0x7faa500aed90 2024-04-25T09:08:35.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.367+0000 7faa4de00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7faa5015dbd0 0x7faa50071c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:49718/0 (socket says 172.21.15.175:49718) 2024-04-25T09:08:35.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.367+0000 7faa4de00640 1 -- 172.21.15.175:0/1533689969 learned_addr learned my addr 172.21.15.175:0/1533689969 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:35.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.367+0000 7faa4e800640 1 --2- 172.21.15.175:0/1533689969 >> v2:172.21.15.175:3300/0 conn(0x7faa500aed90 0x7faa50168710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:35.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.367+0000 7faa4ca00640 1 -- 172.21.15.175:0/1533689969 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929330351 0 0) 0x7faa5015dfb0 con 0x7faa5015dbd0 2024-04-25T09:08:35.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.367+0000 7faa4ca00640 1 -- 172.21.15.175:0/1533689969 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa34003530 con 0x7faa5015dbd0 2024-04-25T09:08:35.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.367+0000 7faa4e800640 1 -- 172.21.15.175:0/1533689969 >> v1:172.21.15.177:6789/0 conn(0x7faa500add90 legacy=0x7faa500ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:35.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.367+0000 7faa4e800640 1 -- 172.21.15.175:0/1533689969 >> v1:172.21.15.175:6789/0 conn(0x7faa5015dbd0 legacy=0x7faa50071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:35.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.367+0000 7faa4e800640 1 -- 172.21.15.175:0/1533689969 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa500b2c60 con 0x7faa500aed90 2024-04-25T09:08:35.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.367+0000 7faa4e800640 1 --2- 172.21.15.175:0/1533689969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa500aed90 0x7faa50168710 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7faa480097c0 tx=0x7faa4801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938c59f9789f1183 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:35.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa4ca00640 1 -- 172.21.15.175:0/1533689969 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480b0070 con 0x7faa500aed90 2024-04-25T09:08:35.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa4ca00640 1 -- 172.21.15.175:0/1533689969 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa480ab600 con 0x7faa500aed90 2024-04-25T09:08:35.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa4ca00640 1 -- 172.21.15.175:0/1533689969 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480ab9b0 con 0x7faa500aed90 2024-04-25T09:08:35.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa54e00640 1 -- 172.21.15.175:0/1533689969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa500aed90 msgr2=0x7faa50168710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:35.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa54e00640 1 --2- 172.21.15.175:0/1533689969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa500aed90 0x7faa50168710 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7faa480097c0 tx=0x7faa4801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:08:35.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa54e00640 1 -- 172.21.15.175:0/1533689969 shutdown_connections 2024-04-25T09:08:35.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa54e00640 1 --2- 172.21.15.175:0/1533689969 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa500aed90 0x7faa50168710 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:35.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa54e00640 1 -- 172.21.15.175:0/1533689969 >> 172.21.15.175:0/1533689969 conn(0x7faa50067150 msgr2=0x7faa5006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:35.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa54e00640 1 -- 172.21.15.175:0/1533689969 shutdown_connections 2024-04-25T09:08:35.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa54e00640 1 -- 172.21.15.175:0/1533689969 wait complete. 2024-04-25T09:08:35.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa54e00640 1 Processor -- start 2024-04-25T09:08:35.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa54e00640 1 -- start start 2024-04-25T09:08:35.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa54e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa500aed90 0x7faa5015ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:35.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa54e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa5015dbd0 0x7faa501490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:35.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa54e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa50149600 0x7faa5014ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:35.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa54e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5016b5f0 con 0x7faa5015dbd0 2024-04-25T09:08:35.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa54e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5016b470 con 0x7faa500aed90 2024-04-25T09:08:35.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa54e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5016b770 con 0x7faa50149600 2024-04-25T09:08:35.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa4d400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa5015dbd0 0x7faa501490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:35.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa4d400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa5015dbd0 0x7faa501490c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41288/0 (socket says 172.21.15.175:41288) 2024-04-25T09:08:35.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa4d400640 1 -- 172.21.15.175:0/1850866730 learned_addr learned my addr 172.21.15.175:0/1850866730 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:35.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa4de00640 1 --2- 172.21.15.175:0/1850866730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa500aed90 0x7faa5015ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:35.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa4e800640 1 --2- 172.21.15.175:0/1850866730 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa50149600 0x7faa5014ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:35.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa4d400640 1 -- 172.21.15.175:0/1850866730 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa50149600 msgr2=0x7faa5014ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:35.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa4d400640 1 --2- 172.21.15.175:0/1850866730 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa50149600 0x7faa5014ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:35.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa4d400640 1 -- 172.21.15.175:0/1850866730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa500aed90 msgr2=0x7faa5015ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:35.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa4d400640 1 --2- 172.21.15.175:0/1850866730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa500aed90 0x7faa5015ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:35.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa4d400640 1 -- 172.21.15.175:0/1850866730 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5014ddc0 con 0x7faa5015dbd0 2024-04-25T09:08:35.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.371+0000 7faa4e800640 1 --2- 172.21.15.175:0/1850866730 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa50149600 0x7faa5014ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:35.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.375+0000 7faa4d400640 1 --2- 172.21.15.175:0/1850866730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa5015dbd0 0x7faa501490c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00c3a0 tx=0x7faa3c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:35.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.375+0000 7faa46000640 1 -- 172.21.15.175:0/1850866730 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c0052d0 con 0x7faa5015dbd0 2024-04-25T09:08:35.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.375+0000 7faa46000640 1 -- 172.21.15.175:0/1850866730 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c005470 con 0x7faa5015dbd0 2024-04-25T09:08:35.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.375+0000 7faa54e00640 1 -- 172.21.15.175:0/1850866730 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5014e0a0 con 0x7faa5015dbd0 2024-04-25T09:08:35.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.375+0000 7faa46000640 1 -- 172.21.15.175:0/1850866730 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c007260 con 0x7faa5015dbd0 2024-04-25T09:08:35.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.375+0000 7faa54e00640 1 -- 172.21.15.175:0/1850866730 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5014e660 con 0x7faa5015dbd0 2024-04-25T09:08:35.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.375+0000 7faa54e00640 1 -- 172.21.15.175:0/1850866730 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa50074a60 con 0x7faa5015dbd0 2024-04-25T09:08:35.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.375+0000 7faa46000640 1 -- 172.21.15.175:0/1850866730 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faa3c007400 con 0x7faa5015dbd0 2024-04-25T09:08:35.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.375+0000 7faa46000640 1 --2- 172.21.15.175:0/1850866730 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faa30066f60 0x7faa30069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:35.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.375+0000 7faa46000640 1 -- 172.21.15.175:0/1850866730 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7faa3c084440 con 0x7faa5015dbd0 2024-04-25T09:08:35.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.375+0000 7faa4de00640 1 --2- 172.21.15.175:0/1850866730 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faa30066f60 0x7faa30069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:35.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.379+0000 7faa4de00640 1 --2- 172.21.15.175:0/1850866730 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faa30066f60 0x7faa30069420 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faa40001570 tx=0x7faa40001a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:35.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.379+0000 7faa46000640 1 -- 172.21.15.175:0/1850866730 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faa3c054d90 con 0x7faa5015dbd0 2024-04-25T09:08:35.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.567+0000 7faa54e00640 1 -- 172.21.15.175:0/1850866730 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa5006c220 con 0x7faa5015dbd0 2024-04-25T09:08:35.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.567+0000 7faa46000640 1 -- 172.21.15.175:0/1850866730 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4947 (secure 0 0 0) 0x7faa3c058e30 con 0x7faa5015dbd0 2024-04-25T09:08:35.560 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:35.560 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":48,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2493316948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2493316948},{"type":"v1","addr":"172.21.15.175:6837","nonce":2493316948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3408529232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3408529232},{"type":"v1","addr":"172.21.15.177:6834","nonce":3408529232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/46829775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":46829775},{"type":"v1","addr":"172.21.15.177:6835","nonce":46829775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:08:17.378890+0000","modified":"2024-04-25T09:08:34.448912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6513":{"gid":6513,"name":"a","rank":0,"incarnation":46,"state":"up:rejoin","state_seq":8,"addr":"172.21.15.175:6836/2714482688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2714482688},{"type":"v1","addr":"172.21.15.175:6836","nonce":2714482688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:08:35.560 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 48 2024-04-25T09:08:35.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.571+0000 7faa54e00640 1 -- 172.21.15.175:0/1850866730 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faa30066f60 msgr2=0x7faa30069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:35.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.571+0000 7faa54e00640 1 --2- 172.21.15.175:0/1850866730 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faa30066f60 0x7faa30069420 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7faa40001570 tx=0x7faa40001a00 comp rx=0 tx=0).stop 2024-04-25T09:08:35.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.571+0000 7faa54e00640 1 -- 172.21.15.175:0/1850866730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa5015dbd0 msgr2=0x7faa501490c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:35.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.571+0000 7faa54e00640 1 --2- 172.21.15.175:0/1850866730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa5015dbd0 0x7faa501490c0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00c3a0 tx=0x7faa3c00c860 comp rx=0 tx=0).stop 2024-04-25T09:08:35.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.571+0000 7faa54e00640 1 -- 172.21.15.175:0/1850866730 shutdown_connections 2024-04-25T09:08:35.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.571+0000 7faa54e00640 1 --2- 172.21.15.175:0/1850866730 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faa30066f60 0x7faa30069420 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:35.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.571+0000 7faa54e00640 1 --2- 172.21.15.175:0/1850866730 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa50149600 0x7faa5014ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:35.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.571+0000 7faa54e00640 1 --2- 172.21.15.175:0/1850866730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa5015dbd0 0x7faa501490c0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:35.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.571+0000 7faa54e00640 1 --2- 172.21.15.175:0/1850866730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa500aed90 0x7faa5015ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:35.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.571+0000 7faa54e00640 1 -- 172.21.15.175:0/1850866730 >> 172.21.15.175:0/1850866730 conn(0x7faa500add90 msgr2=0x7faa500b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:35.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.571+0000 7faa54e00640 1 -- 172.21.15.175:0/1850866730 shutdown_connections 2024-04-25T09:08:35.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:35.571+0000 7faa54e00640 1 -- 172.21.15.175:0/1850866730 wait complete. 2024-04-25T09:08:35.983 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:08:17.378890+0000', 'modified': '2024-04-25T09:08:34.448912+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6513}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6513': {'gid': 6513, 'name': 'a', 'rank': 0, 'incarnation': 46, 'state': 'up:rejoin', 'state_seq': 8, 'addr': '172.21.15.175:6836/2714482688', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 2714482688}, {'type': 'v1', 'addr': '172.21.15.175:6836', 'nonce': 2714482688}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:08:35.983 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6513:up:rejoin 2024-04-25T09:08:36.984 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:08:37.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.139+0000 7f011c000640 1 Processor -- start 2024-04-25T09:08:37.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.139+0000 7f011c000640 1 -- start start 2024-04-25T09:08:37.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.143+0000 7f011c000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f011415dbd0 0x7f0114071c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.143+0000 7f011c000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f011415dfb0 con 0x7f01140ae680 2024-04-25T09:08:37.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.143+0000 7f011c000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01140b2980 con 0x7f01140aeac0 2024-04-25T09:08:37.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.143+0000 7f011c000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01140cf670 con 0x7f011415dbd0 2024-04-25T09:08:37.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.143+0000 7f0119600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f011415dbd0 0x7f0114071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.143+0000 7f0118c00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f01140ae680 0x7f01140acd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:49724/0 (socket says 172.21.15.175:49724) 2024-04-25T09:08:37.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.143+0000 7f0118c00640 1 -- 172.21.15.175:0/2021103504 learned_addr learned my addr 172.21.15.175:0/2021103504 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:37.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.143+0000 7f0119600640 1 -- 172.21.15.175:0/2021103504 >> v1:172.21.15.177:6789/0 conn(0x7f01140aeac0 legacy=0x7f01140ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.143+0000 7f0119600640 1 -- 172.21.15.175:0/2021103504 >> v1:172.21.15.175:6789/0 conn(0x7f01140ae680 legacy=0x7f01140acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.143+0000 7f0119600640 1 -- 172.21.15.175:0/2021103504 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01140b2c60 con 0x7f011415dbd0 2024-04-25T09:08:37.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.147+0000 7f0119600640 1 --2- 172.21.15.175:0/2021103504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011415dbd0 0x7f0114071c50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f0108009d90 tx=0x7f010801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25518f87864e0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.147+0000 7f0113e00640 1 -- 172.21.15.175:0/2021103504 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01080b2070 con 0x7f011415dbd0 2024-04-25T09:08:37.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.147+0000 7f0113e00640 1 -- 172.21.15.175:0/2021103504 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01080a58e0 con 0x7f011415dbd0 2024-04-25T09:08:37.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.147+0000 7f0113e00640 1 -- 172.21.15.175:0/2021103504 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01080a5cb0 con 0x7f011415dbd0 2024-04-25T09:08:37.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.147+0000 7f011c000640 1 -- 172.21.15.175:0/2021103504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011415dbd0 msgr2=0x7f0114071c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.147+0000 7f011c000640 1 --2- 172.21.15.175:0/2021103504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011415dbd0 0x7f0114071c50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f0108009d90 tx=0x7f010801c930 comp rx=0 tx=0).stop 2024-04-25T09:08:37.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.147+0000 7f011c000640 1 -- 172.21.15.175:0/2021103504 shutdown_connections 2024-04-25T09:08:37.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.147+0000 7f011c000640 1 --2- 172.21.15.175:0/2021103504 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011415dbd0 0x7f0114071c50 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.147+0000 7f011c000640 1 -- 172.21.15.175:0/2021103504 >> 172.21.15.175:0/2021103504 conn(0x7f0114067150 msgr2=0x7f011406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.147+0000 7f011c000640 1 -- 172.21.15.175:0/2021103504 shutdown_connections 2024-04-25T09:08:37.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.147+0000 7f011c000640 1 -- 172.21.15.175:0/2021103504 wait complete. 2024-04-25T09:08:37.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.147+0000 7f011c000640 1 Processor -- start 2024-04-25T09:08:37.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.147+0000 7f011c000640 1 -- start start 2024-04-25T09:08:37.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f011c000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01140aeac0 0x7f0114148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f011c000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011415dbd0 0x7f011415ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f011c000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f011415f2a0 0x7f01140cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f011c000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01140b2580 con 0x7f011415dbd0 2024-04-25T09:08:37.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f011c000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0114072190 con 0x7f011415f2a0 2024-04-25T09:08:37.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f011c000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01140b2700 con 0x7f01140aeac0 2024-04-25T09:08:37.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f0118c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011415dbd0 0x7f011415ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f0118c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011415dbd0 0x7f011415ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41312/0 (socket says 172.21.15.175:41312) 2024-04-25T09:08:37.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f0118c00640 1 -- 172.21.15.175:0/1757114047 learned_addr learned my addr 172.21.15.175:0/1757114047 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:37.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f0118c00640 1 -- 172.21.15.175:0/1757114047 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01140aeac0 msgr2=0x7f0114148530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f0118c00640 1 --2- 172.21.15.175:0/1757114047 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01140aeac0 0x7f0114148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f0118c00640 1 -- 172.21.15.175:0/1757114047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f011415f2a0 msgr2=0x7f01140cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f0118c00640 1 --2- 172.21.15.175:0/1757114047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f011415f2a0 0x7f01140cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f0118c00640 1 -- 172.21.15.175:0/1757114047 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01140cc330 con 0x7f011415dbd0 2024-04-25T09:08:37.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f0118c00640 1 --2- 172.21.15.175:0/1757114047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011415dbd0 0x7f011415ed60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f010000c370 tx=0x7f010000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f0111600640 1 -- 172.21.15.175:0/1757114047 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0100017070 con 0x7f011415dbd0 2024-04-25T09:08:37.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f0111600640 1 -- 172.21.15.175:0/1757114047 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0100005cf0 con 0x7f011415dbd0 2024-04-25T09:08:37.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f011c000640 1 -- 172.21.15.175:0/1757114047 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011415f750 con 0x7f011415dbd0 2024-04-25T09:08:37.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f0111600640 1 -- 172.21.15.175:0/1757114047 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01000072f0 con 0x7f011415dbd0 2024-04-25T09:08:37.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f011c000640 1 -- 172.21.15.175:0/1757114047 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011415fcc0 con 0x7f011415dbd0 2024-04-25T09:08:37.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f011c000640 1 -- 172.21.15.175:0/1757114047 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0114074a60 con 0x7f011415dbd0 2024-04-25T09:08:37.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f0111600640 1 -- 172.21.15.175:0/1757114047 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f010001a070 con 0x7f011415dbd0 2024-04-25T09:08:37.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.151+0000 7f0111600640 1 --2- 172.21.15.175:0/1757114047 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f00f4066f60 0x7f00f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.155+0000 7f0111600640 1 -- 172.21.15.175:0/1757114047 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f01000843b0 con 0x7f011415dbd0 2024-04-25T09:08:37.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.155+0000 7f0119600640 1 --2- 172.21.15.175:0/1757114047 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f00f4066f60 0x7f00f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.155+0000 7f0119600640 1 --2- 172.21.15.175:0/1757114047 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f00f4066f60 0x7f00f4069420 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f01080af000 tx=0x7f0108004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.155+0000 7f0111600640 1 -- 172.21.15.175:0/1757114047 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0100055350 con 0x7f011415dbd0 2024-04-25T09:08:37.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.343+0000 7f011c000640 1 -- 172.21.15.175:0/1757114047 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f011414eb80 con 0x7f011415dbd0 2024-04-25T09:08:37.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.343+0000 7f0111600640 1 -- 172.21.15.175:0/1757114047 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f0100054c50 con 0x7f011415dbd0 2024-04-25T09:08:37.333 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:37.333 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":49,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2493316948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2493316948},{"type":"v1","addr":"172.21.15.175:6837","nonce":2493316948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3408529232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3408529232},{"type":"v1","addr":"172.21.15.177:6834","nonce":3408529232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/46829775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":46829775},{"type":"v1","addr":"172.21.15.177:6835","nonce":46829775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:08:17.378890+0000","modified":"2024-04-25T09:08:35.454831+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6513":{"gid":6513,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":9,"addr":"172.21.15.175:6836/2714482688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2714482688},{"type":"v1","addr":"172.21.15.175:6836","nonce":2714482688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:08:37.333 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 49 2024-04-25T09:08:37.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.343+0000 7f011c000640 1 -- 172.21.15.175:0/1757114047 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f00f4066f60 msgr2=0x7f00f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.343+0000 7f011c000640 1 --2- 172.21.15.175:0/1757114047 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f00f4066f60 0x7f00f4069420 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f01080af000 tx=0x7f0108004ac0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.343+0000 7f011c000640 1 -- 172.21.15.175:0/1757114047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011415dbd0 msgr2=0x7f011415ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.343+0000 7f011c000640 1 --2- 172.21.15.175:0/1757114047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011415dbd0 0x7f011415ed60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f010000c370 tx=0x7f010000c830 comp rx=0 tx=0).stop 2024-04-25T09:08:37.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.343+0000 7f011c000640 1 -- 172.21.15.175:0/1757114047 shutdown_connections 2024-04-25T09:08:37.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.343+0000 7f011c000640 1 --2- 172.21.15.175:0/1757114047 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f00f4066f60 0x7f00f4069420 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.343+0000 7f011c000640 1 --2- 172.21.15.175:0/1757114047 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f011415f2a0 0x7f01140cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.343+0000 7f011c000640 1 --2- 172.21.15.175:0/1757114047 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f011415dbd0 0x7f011415ed60 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.343+0000 7f011c000640 1 --2- 172.21.15.175:0/1757114047 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f01140aeac0 0x7f0114148530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.343+0000 7f011c000640 1 -- 172.21.15.175:0/1757114047 >> 172.21.15.175:0/1757114047 conn(0x7f01140ae680 msgr2=0x7f01140b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.343+0000 7f011c000640 1 -- 172.21.15.175:0/1757114047 shutdown_connections 2024-04-25T09:08:37.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.343+0000 7f011c000640 1 -- 172.21.15.175:0/1757114047 wait complete. 2024-04-25T09:08:37.758 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:08:17.378890+0000', 'modified': '2024-04-25T09:08:35.454831+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6513}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6513': {'gid': 6513, 'name': 'a', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.175:6836/2714482688', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 2714482688}, {'type': 'v1', 'addr': '172.21.15.175:6836', 'nonce': 2714482688}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:08:37.758 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:08:37.759 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:08:37.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.907+0000 7f2457e00640 1 Processor -- start 2024-04-25T09:08:37.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.907+0000 7f2457e00640 1 -- start start 2024-04-25T09:08:37.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.907+0000 7f2457e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f245815ba50 0x7f24580ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.907+0000 7f2457e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24580cd2a0 0x7f24580cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.907+0000 7f2457e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245815cb90 con 0x7f245806f5e0 2024-04-25T09:08:37.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.907+0000 7f2457e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245815be30 con 0x7f245815ba50 2024-04-25T09:08:37.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.907+0000 7f2457e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245815ce30 con 0x7f24580cd2a0 2024-04-25T09:08:37.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.907+0000 7f2456a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f245815ba50 0x7f24580ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.907+0000 7f244e000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f245806f5e0 0x7f24580cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:49734/0 (socket says 172.21.15.175:49734) 2024-04-25T09:08:37.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.907+0000 7f244e000640 1 -- 172.21.15.175:0/788629383 learned_addr learned my addr 172.21.15.175:0/788629383 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:37.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.907+0000 7f2456a00640 1 -- 172.21.15.175:0/788629383 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24580cd2a0 msgr2=0x7f24580cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.907+0000 7f2456a00640 1 --2- 172.21.15.175:0/788629383 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24580cd2a0 0x7f24580cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.907+0000 7f2456a00640 1 -- 172.21.15.175:0/788629383 >> v1:172.21.15.175:6789/0 conn(0x7f245806f5e0 legacy=0x7f24580cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.907+0000 7f2456000640 1 -- 172.21.15.175:0/788629383 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697782140 0 0) 0x7f245815cb90 con 0x7f245806f5e0 2024-04-25T09:08:37.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.907+0000 7f2456a00640 1 -- 172.21.15.175:0/788629383 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245806ede0 con 0x7f245815ba50 2024-04-25T09:08:37.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.911+0000 7f2456a00640 1 --2- 172.21.15.175:0/788629383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f245815ba50 0x7f24580ceeb0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f24480097c0 tx=0x7f244801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67649e8fe03af647 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.911+0000 7f2456000640 1 -- 172.21.15.175:0/788629383 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24480b1070 con 0x7f245815ba50 2024-04-25T09:08:37.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.911+0000 7f2456000640 1 -- 172.21.15.175:0/788629383 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24480ac410 con 0x7f245815ba50 2024-04-25T09:08:37.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.911+0000 7f2456000640 1 -- 172.21.15.175:0/788629383 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24480ac7e0 con 0x7f245815ba50 2024-04-25T09:08:37.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.911+0000 7f2457e00640 1 -- 172.21.15.175:0/788629383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f245815ba50 msgr2=0x7f24580ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.911+0000 7f2457e00640 1 --2- 172.21.15.175:0/788629383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f245815ba50 0x7f24580ceeb0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f24480097c0 tx=0x7f244801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.911+0000 7f2457e00640 1 -- 172.21.15.175:0/788629383 shutdown_connections 2024-04-25T09:08:37.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.911+0000 7f2457e00640 1 --2- 172.21.15.175:0/788629383 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24580cd2a0 0x7f24580cf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.911+0000 7f2457e00640 1 --2- 172.21.15.175:0/788629383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f245815ba50 0x7f24580ceeb0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.911+0000 7f2457e00640 1 -- 172.21.15.175:0/788629383 >> 172.21.15.175:0/788629383 conn(0x7f24580cc780 msgr2=0x7f24580ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.911+0000 7f2457e00640 1 -- 172.21.15.175:0/788629383 shutdown_connections 2024-04-25T09:08:37.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.911+0000 7f2457e00640 1 -- 172.21.15.175:0/788629383 wait complete. 2024-04-25T09:08:37.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2457e00640 1 Processor -- start 2024-04-25T09:08:37.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2457e00640 1 -- start start 2024-04-25T09:08:37.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2457e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f245806f5e0 0x7f2458156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2457e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24580cd2a0 0x7f245814fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2457e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f245815ba50 0x7f2458157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2457e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2458168a60 con 0x7f245806f5e0 2024-04-25T09:08:37.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2457e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24581688e0 con 0x7f24580cd2a0 2024-04-25T09:08:37.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2457e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2458168be0 con 0x7f245815ba50 2024-04-25T09:08:37.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2456a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f245806f5e0 0x7f2458156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2456a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f245806f5e0 0x7f2458156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41342/0 (socket says 172.21.15.175:41342) 2024-04-25T09:08:37.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2456a00640 1 -- 172.21.15.175:0/3126115040 learned_addr learned my addr 172.21.15.175:0/3126115040 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:37.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f244e000640 1 --2- 172.21.15.175:0/3126115040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24580cd2a0 0x7f245814fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2457400640 1 --2- 172.21.15.175:0/3126115040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f245815ba50 0x7f2458157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2456a00640 1 -- 172.21.15.175:0/3126115040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f245815ba50 msgr2=0x7f2458157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2456a00640 1 --2- 172.21.15.175:0/3126115040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f245815ba50 0x7f2458157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2456a00640 1 -- 172.21.15.175:0/3126115040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24580cd2a0 msgr2=0x7f245814fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2456a00640 1 --2- 172.21.15.175:0/3126115040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24580cd2a0 0x7f245814fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2456a00640 1 -- 172.21.15.175:0/3126115040 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245815db00 con 0x7f245806f5e0 2024-04-25T09:08:37.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f244e000640 1 --2- 172.21.15.175:0/3126115040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24580cd2a0 0x7f245814fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:37.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2456a00640 1 --2- 172.21.15.175:0/3126115040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f245806f5e0 0x7f2458156170 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f24480af040 tx=0x7f2448019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f244fe00640 1 -- 172.21.15.175:0/3126115040 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24480b1040 con 0x7f245806f5e0 2024-04-25T09:08:37.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f244fe00640 1 -- 172.21.15.175:0/3126115040 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24480bc070 con 0x7f245806f5e0 2024-04-25T09:08:37.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f244fe00640 1 -- 172.21.15.175:0/3126115040 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24480b5630 con 0x7f245806f5e0 2024-04-25T09:08:37.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2457e00640 1 -- 172.21.15.175:0/3126115040 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245815dde0 con 0x7f245806f5e0 2024-04-25T09:08:37.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.915+0000 7f2457e00640 1 -- 172.21.15.175:0/3126115040 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245815e3a0 con 0x7f245806f5e0 2024-04-25T09:08:37.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.919+0000 7f244fe00640 1 -- 172.21.15.175:0/3126115040 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f24480b57d0 con 0x7f245806f5e0 2024-04-25T09:08:37.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.919+0000 7f244fe00640 1 --2- 172.21.15.175:0/3126115040 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2434066f60 0x7f2434069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.919+0000 7f244fe00640 1 -- 172.21.15.175:0/3126115040 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f244811ecb0 con 0x7f245806f5e0 2024-04-25T09:08:37.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.919+0000 7f244e000640 1 --2- 172.21.15.175:0/3126115040 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2434066f60 0x7f2434069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.919+0000 7f2460fff000 1 Processor -- start 2024-04-25T09:08:37.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.919+0000 7f2460fff000 1 -- start start 2024-04-25T09:08:37.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.919+0000 7f244e000640 1 --2- 172.21.15.175:0/3126115040 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2434066f60 0x7f2434069420 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f24581f8230 tx=0x7f2440007cb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c8417920 0x55b4c8417d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c8418240 0x55b4c83cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c83cdf30 0x55b4c83ce310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4c82b55f0 con 0x55b4c83cdf30 2024-04-25T09:08:37.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4c821cda0 con 0x55b4c8418240 2024-04-25T09:08:37.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4c81a5150 con 0x55b4c8417920 2024-04-25T09:08:37.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2457400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c83cdf30 0x55b4c83ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2457400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c83cdf30 0x55b4c83ce310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41346/0 (socket says 172.21.15.175:41346) 2024-04-25T09:08:37.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2457400640 1 -- 172.21.15.175:0/4131119790 learned_addr learned my addr 172.21.15.175:0/4131119790 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:37.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f244e000640 1 --2- 172.21.15.175:0/4131119790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c8418240 0x55b4c83cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2456a00640 1 --2- 172.21.15.175:0/4131119790 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c8417920 0x55b4c8417d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2457400640 1 -- 172.21.15.175:0/4131119790 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c8417920 msgr2=0x55b4c8417d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2457400640 1 --2- 172.21.15.175:0/4131119790 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c8417920 0x55b4c8417d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2457400640 1 -- 172.21.15.175:0/4131119790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c8418240 msgr2=0x55b4c83cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2457400640 1 --2- 172.21.15.175:0/4131119790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c8418240 0x55b4c83cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2457400640 1 -- 172.21.15.175:0/4131119790 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4c81beca0 con 0x55b4c83cdf30 2024-04-25T09:08:37.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2457400640 1 --2- 172.21.15.175:0/4131119790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c83cdf30 0x55b4c83ce310 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f2450009ef0 tx=0x7f245000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25200e4d229632a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2447e00640 1 -- 172.21.15.175:0/4131119790 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245001a070 con 0x55b4c83cdf30 2024-04-25T09:08:37.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2447e00640 1 -- 172.21.15.175:0/4131119790 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2450015410 con 0x55b4c83cdf30 2024-04-25T09:08:37.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2447e00640 1 -- 172.21.15.175:0/4131119790 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24500157c0 con 0x55b4c83cdf30 2024-04-25T09:08:37.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 -- 172.21.15.175:0/4131119790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c83cdf30 msgr2=0x55b4c83ce310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 --2- 172.21.15.175:0/4131119790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c83cdf30 0x55b4c83ce310 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f2450009ef0 tx=0x7f245000c7f0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 -- 172.21.15.175:0/4131119790 shutdown_connections 2024-04-25T09:08:37.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 --2- 172.21.15.175:0/4131119790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c83cdf30 0x55b4c83ce310 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 --2- 172.21.15.175:0/4131119790 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c8418240 0x55b4c83cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 --2- 172.21.15.175:0/4131119790 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c8417920 0x55b4c8417d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 -- 172.21.15.175:0/4131119790 >> 172.21.15.175:0/4131119790 conn(0x55b4c83d42a0 msgr2=0x55b4c83cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 -- 172.21.15.175:0/4131119790 shutdown_connections 2024-04-25T09:08:37.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 -- 172.21.15.175:0/4131119790 wait complete. 2024-04-25T09:08:37.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 -- start start 2024-04-25T09:08:37.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 Processor -- start 2024-04-25T09:08:37.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c83cdf30 0x55b4c841ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c8417920 0x55b4c841f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c8418240 0x55b4c83d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4c81d7990 con 0x55b4c83cdf30 2024-04-25T09:08:37.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.923+0000 7f2460fff000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4c8218e40 con 0x55b4c8418240 2024-04-25T09:08:37.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4c81a8900 con 0x55b4c8417920 2024-04-25T09:08:37.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 10 client.0 _ll_register_callbacks cb 0x55b4c82d01c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:37.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2456a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c83cdf30 0x55b4c841ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2456a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c83cdf30 0x55b4c841ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41356/0 (socket says 172.21.15.175:41356) 2024-04-25T09:08:37.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2456a00640 1 -- 172.21.15.175:0/3612952354 learned_addr learned my addr 172.21.15.175:0/3612952354 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:37.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2457400640 1 --2- 172.21.15.175:0/3612952354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c8418240 0x55b4c83d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f244e000640 1 --2- 172.21.15.175:0/3612952354 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c8417920 0x55b4c841f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2456a00640 1 -- 172.21.15.175:0/3612952354 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c8417920 msgr2=0x55b4c841f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2456a00640 1 --2- 172.21.15.175:0/3612952354 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c8417920 0x55b4c841f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2456a00640 1 -- 172.21.15.175:0/3612952354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c8418240 msgr2=0x55b4c83d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2456a00640 1 --2- 172.21.15.175:0/3612952354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c8418240 0x55b4c83d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2456a00640 1 -- 172.21.15.175:0/3612952354 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b4c81d5630 con 0x55b4c83cdf30 2024-04-25T09:08:37.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2457400640 1 --2- 172.21.15.175:0/3612952354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c8418240 0x55b4c83d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:37.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2456a00640 1 --2- 172.21.15.175:0/3612952354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c83cdf30 0x55b4c841ee60 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f244801c980 tx=0x7f24480acf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ff1a6e3e4690be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2444c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:08:37.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2444c00640 1 -- 172.21.15.175:0/3612952354 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24480f3580 con 0x55b4c83cdf30 2024-04-25T09:08:37.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2444c00640 1 -- 172.21.15.175:0/3612952354 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f24480ef690 con 0x55b4c83cdf30 2024-04-25T09:08:37.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 1 -- 172.21.15.175:0/3612952354 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2450015410 con 0x55b4c83cdf30 2024-04-25T09:08:37.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2444c00640 1 -- 172.21.15.175:0/3612952354 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24480f7bd0 con 0x55b4c83cdf30 2024-04-25T09:08:37.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 10 client.6795 fetch_fsmap learned FSMap version 49 2024-04-25T09:08:37.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 1 -- 172.21.15.175:0/3612952354 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55b4c81a53a0 con 0x55b4c83cdf30 2024-04-25T09:08:37.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2444c00640 1 -- 172.21.15.175:0/3612952354 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2450015410 con 0x55b4c83cdf30 2024-04-25T09:08:37.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2444c00640 1 -- 172.21.15.175:0/3612952354 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 49) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f24480b4050 con 0x55b4c83cdf30 2024-04-25T09:08:37.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 10 client.6795 fetch_fsmap finished waiting for FSMap version 49 2024-04-25T09:08:37.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 10 client.6795 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:08:37.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 20 client.6795 populate_metadata read hostname 'smithi175' 2024-04-25T09:08:37.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 1 --2- 172.21.15.175:0/3612952354 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55b4c83d3160 0x55b4c8428ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 4 client.6795 mds_command: new command op to 6513 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:08:37.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 1 -- 172.21.15.175:0/3612952354 --> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b4c81b8a50 con 0x55b4c83d3160 2024-04-25T09:08:37.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f244e000640 1 --2- 172.21.15.175:0/3612952354 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55b4c83d3160 0x55b4c8428ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2444c00640 10 client.6795 ms_handle_connect on v2:172.21.15.175:6834/2714482688 2024-04-25T09:08:37.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f244e000640 1 --2- 172.21.15.175:0/3612952354 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55b4c83d3160 0x55b4c8428ec0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a6cac53bf99290a server_cookie=60f68b003066d9b4 in_seq=0 out_seq=0 2024-04-25T09:08:37.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2444c00640 1 -- 172.21.15.175:0/3612952354 <== mds.0 v2:172.21.15.175:6834/2714482688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b4c81b8a50 con 0x55b4c83d3160 2024-04-25T09:08:37.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2444c00640 10 client.6795 handle_command_reply: tid=0 2024-04-25T09:08:37.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 1 client.6795 shutdown 2024-04-25T09:08:37.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 1 -- 172.21.15.175:0/3612952354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c83cdf30 msgr2=0x55b4c841ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 1 --2- 172.21.15.175:0/3612952354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c83cdf30 0x55b4c841ee60 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f244801c980 tx=0x7f24480acf00 comp rx=0 tx=0).stop 2024-04-25T09:08:37.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 1 -- 172.21.15.175:0/3612952354 shutdown_connections 2024-04-25T09:08:37.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 1 --2- 172.21.15.175:0/3612952354 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55b4c83d3160 0x55b4c8428ec0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 1 --2- 172.21.15.175:0/3612952354 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c8418240 0x55b4c83d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 1 --2- 172.21.15.175:0/3612952354 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c8417920 0x55b4c841f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 1 --2- 172.21.15.175:0/3612952354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c83cdf30 0x55b4c841ee60 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2444c00640 0 client.6795 ms_handle_reset on v2:172.21.15.175:6834/2714482688 2024-04-25T09:08:37.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 1 -- 172.21.15.175:0/3612952354 >> 172.21.15.175:0/3612952354 conn(0x55b4c83d42a0 msgr2=0x55b4c83cc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 1 -- 172.21.15.175:0/3612952354 shutdown_connections 2024-04-25T09:08:37.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 1 -- 172.21.15.175:0/3612952354 wait complete. 2024-04-25T09:08:37.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.927+0000 7f2460fff000 20 client.6795 trim_cache size 0 max 16384 2024-04-25T09:08:37.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.943+0000 7f2460fff000 1 Processor -- start 2024-04-25T09:08:37.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.943+0000 7f2460fff000 1 -- start start 2024-04-25T09:08:37.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.943+0000 7f2460fff000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c83cdf30 0x55b4c8473790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.943+0000 7f2460fff000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c8417920 0x55b4c8473cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.943+0000 7f2460fff000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c8418240 0x55b4c8474210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.943+0000 7f2460fff000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24581ffeb0 con 0x55b4c8417920 2024-04-25T09:08:37.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.943+0000 7f2460fff000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24581ff310 con 0x55b4c8418240 2024-04-25T09:08:37.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.943+0000 7f2460fff000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24581ff8b0 con 0x55b4c83cdf30 2024-04-25T09:08:37.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.943+0000 7f244e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c8417920 0x55b4c8473cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.943+0000 7f244e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c8417920 0x55b4c8473cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41362/0 (socket says 172.21.15.175:41362) 2024-04-25T09:08:37.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.943+0000 7f244e000640 1 -- 172.21.15.175:0/398130397 learned_addr learned my addr 172.21.15.175:0/398130397 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:37.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2456a00640 1 --2- 172.21.15.175:0/398130397 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c83cdf30 0x55b4c8473790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2457400640 1 --2- 172.21.15.175:0/398130397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c8418240 0x55b4c8474210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f244e000640 1 -- 172.21.15.175:0/398130397 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c83cdf30 msgr2=0x55b4c8473790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f244e000640 1 --2- 172.21.15.175:0/398130397 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c83cdf30 0x55b4c8473790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f244e000640 1 -- 172.21.15.175:0/398130397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c8418240 msgr2=0x55b4c8474210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f244e000640 1 --2- 172.21.15.175:0/398130397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c8418240 0x55b4c8474210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f244e000640 1 -- 172.21.15.175:0/398130397 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4c829e600 con 0x55b4c8417920 2024-04-25T09:08:37.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2457400640 1 --2- 172.21.15.175:0/398130397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c8418240 0x55b4c8474210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:37.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f244e000640 1 --2- 172.21.15.175:0/398130397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c8417920 0x55b4c8473cd0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x55b4c81e07a0 tx=0x7f2440012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6ac6f564aeec5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2447400640 1 -- 172.21.15.175:0/398130397 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244002b070 con 0x55b4c8417920 2024-04-25T09:08:37.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2447400640 1 -- 172.21.15.175:0/398130397 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24400139b0 con 0x55b4c8417920 2024-04-25T09:08:37.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2447400640 1 -- 172.21.15.175:0/398130397 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440013ba0 con 0x55b4c8417920 2024-04-25T09:08:37.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2460fff000 1 -- 172.21.15.175:0/398130397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c8417920 msgr2=0x55b4c8473cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2460fff000 1 --2- 172.21.15.175:0/398130397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c8417920 0x55b4c8473cd0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x55b4c81e07a0 tx=0x7f2440012000 comp rx=0 tx=0).stop 2024-04-25T09:08:37.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2460fff000 1 -- 172.21.15.175:0/398130397 shutdown_connections 2024-04-25T09:08:37.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2460fff000 1 --2- 172.21.15.175:0/398130397 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c8418240 0x55b4c8474210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2460fff000 1 --2- 172.21.15.175:0/398130397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c8417920 0x55b4c8473cd0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2460fff000 1 --2- 172.21.15.175:0/398130397 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c83cdf30 0x55b4c8473790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2460fff000 1 -- 172.21.15.175:0/398130397 >> 172.21.15.175:0/398130397 conn(0x55b4c83d42a0 msgr2=0x55b4c83d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2460fff000 1 -- 172.21.15.175:0/398130397 shutdown_connections 2024-04-25T09:08:37.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2460fff000 1 -- 172.21.15.175:0/398130397 wait complete. 2024-04-25T09:08:37.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2460fff000 1 -- start start 2024-04-25T09:08:37.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2460fff000 1 Processor -- start 2024-04-25T09:08:37.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2460fff000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c83cdf30 0x55b4c8478940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2460fff000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c8417920 0x55b4c8478e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2460fff000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c8418240 0x55b4c845f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2460fff000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4c82213d0 con 0x55b4c8418240 2024-04-25T09:08:37.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2460fff000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4c82d8d50 con 0x55b4c83cdf30 2024-04-25T09:08:37.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2460fff000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4c81b7980 con 0x55b4c8417920 2024-04-25T09:08:37.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2460fff000 10 client.0 _ll_register_callbacks cb 0x7f24500096e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:37.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f244e000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c8417920 0x55b4c8478e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2456a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c83cdf30 0x55b4c8478940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f244e000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c8417920 0x55b4c8478e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:33892/0 (socket says 172.21.15.175:33892) 2024-04-25T09:08:37.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f244e000640 1 -- 172.21.15.175:0/1447330349 learned_addr learned my addr 172.21.15.175:0/1447330349 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:37.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.947+0000 7f2457400640 1 --2- 172.21.15.175:0/1447330349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c8418240 0x55b4c845f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f244e000640 1 -- 172.21.15.175:0/1447330349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c83cdf30 msgr2=0x55b4c8478940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f244e000640 1 --2- 172.21.15.175:0/1447330349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c83cdf30 0x55b4c8478940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f244e000640 1 -- 172.21.15.175:0/1447330349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c8418240 msgr2=0x55b4c845f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f244e000640 1 --2- 172.21.15.175:0/1447330349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c8418240 0x55b4c845f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f244e000640 1 -- 172.21.15.175:0/1447330349 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b4c81b19b0 con 0x55b4c8417920 2024-04-25T09:08:37.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f244e000640 1 --2- 172.21.15.175:0/1447330349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c8417920 0x55b4c8478e80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2440001870 tx=0x7f2440000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11ec4a91187614f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2444c00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3301/0 2024-04-25T09:08:37.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2444c00640 1 -- 172.21.15.175:0/1447330349 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244002b040 con 0x55b4c8417920 2024-04-25T09:08:37.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2444c00640 1 -- 172.21.15.175:0/1447330349 <== mon.2 v2:172.21.15.177:3301/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2440013ca0 con 0x55b4c8417920 2024-04-25T09:08:37.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 1 -- 172.21.15.175:0/1447330349 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f24400139b0 con 0x55b4c8417920 2024-04-25T09:08:37.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2444c00640 1 -- 172.21.15.175:0/1447330349 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24400260e0 con 0x55b4c8417920 2024-04-25T09:08:37.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 10 client.6074 fetch_fsmap learned FSMap version 49 2024-04-25T09:08:37.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 1 -- 172.21.15.175:0/1447330349 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55b4c81c40b0 con 0x55b4c8417920 2024-04-25T09:08:37.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2444c00640 1 -- 172.21.15.175:0/1447330349 <== mon.2 v2:172.21.15.177:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24400139b0 con 0x55b4c8417920 2024-04-25T09:08:37.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2444c00640 1 -- 172.21.15.175:0/1447330349 <== mon.2 v2:172.21.15.177:3301/0 5 ==== fsmap(e 49) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f244003b080 con 0x55b4c8417920 2024-04-25T09:08:37.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 10 client.6074 fetch_fsmap finished waiting for FSMap version 49 2024-04-25T09:08:37.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 10 client.6074 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:08:37.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 20 client.6074 populate_metadata read hostname 'smithi175' 2024-04-25T09:08:37.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 1 --2- 172.21.15.175:0/1447330349 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55b4c845fe80 0x55b4c8460260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 4 client.6074 mds_command: new command op to 6513 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:08:37.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 1 -- 172.21.15.175:0/1447330349 --> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b4c822a2e0 con 0x55b4c845fe80 2024-04-25T09:08:37.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2456a00640 1 --2- 172.21.15.175:0/1447330349 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55b4c845fe80 0x55b4c8460260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2444c00640 10 client.6074 ms_handle_connect on v2:172.21.15.175:6834/2714482688 2024-04-25T09:08:37.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2456a00640 1 --2- 172.21.15.175:0/1447330349 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55b4c845fe80 0x55b4c8460260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82755c54c42e3f49 server_cookie=2e6f0eca40ac5751 in_seq=0 out_seq=0 2024-04-25T09:08:37.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2444c00640 1 -- 172.21.15.175:0/1447330349 <== mds.0 v2:172.21.15.175:6834/2714482688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55b4c822a2e0 con 0x55b4c845fe80 2024-04-25T09:08:37.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2444c00640 10 client.6074 handle_command_reply: tid=0 2024-04-25T09:08:37.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 1 client.6074 shutdown 2024-04-25T09:08:37.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 1 -- 172.21.15.175:0/1447330349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c8417920 msgr2=0x55b4c8478e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 1 --2- 172.21.15.175:0/1447330349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c8417920 0x55b4c8478e80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2440001870 tx=0x7f2440000ee0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 1 -- 172.21.15.175:0/1447330349 shutdown_connections 2024-04-25T09:08:37.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 1 --2- 172.21.15.175:0/1447330349 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55b4c845fe80 0x55b4c8460260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 1 --2- 172.21.15.175:0/1447330349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55b4c8418240 0x55b4c845f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 1 --2- 172.21.15.175:0/1447330349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b4c8417920 0x55b4c8478e80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 1 --2- 172.21.15.175:0/1447330349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b4c83cdf30 0x55b4c8478940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2444c00640 0 client.6074 ms_handle_reset on v2:172.21.15.175:6834/2714482688 2024-04-25T09:08:37.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 1 -- 172.21.15.175:0/1447330349 >> 172.21.15.175:0/1447330349 conn(0x55b4c83d42a0 msgr2=0x55b4c83d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 1 -- 172.21.15.175:0/1447330349 shutdown_connections 2024-04-25T09:08:37.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 1 -- 172.21.15.175:0/1447330349 wait complete. 2024-04-25T09:08:37.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2460fff000 20 client.6074 trim_cache size 0 max 16384 2024-04-25T09:08:37.947 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:08:37.947 INFO:teuthology.orchestra.run.smithi175.stdout: "cluster_fsid": "8caed986-ca08-40e2-b5a5-12e2aade6223", 2024-04-25T09:08:37.947 INFO:teuthology.orchestra.run.smithi175.stdout: "whoami": 0, 2024-04-25T09:08:37.947 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 6513, 2024-04-25T09:08:37.947 INFO:teuthology.orchestra.run.smithi175.stdout: "want_state": "up:active", 2024-04-25T09:08:37.948 INFO:teuthology.orchestra.run.smithi175.stdout: "state": "up:active", 2024-04-25T09:08:37.948 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs", 2024-04-25T09:08:37.948 INFO:teuthology.orchestra.run.smithi175.stdout: "rank_uptime": 4.513687515, 2024-04-25T09:08:37.948 INFO:teuthology.orchestra.run.smithi175.stdout: "mdsmap_epoch": 49, 2024-04-25T09:08:37.948 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch": 70, 2024-04-25T09:08:37.948 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch_barrier": 70, 2024-04-25T09:08:37.948 INFO:teuthology.orchestra.run.smithi175.stdout: "uptime": 24.819141491 2024-04-25T09:08:37.948 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:08:37.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2457e00640 1 -- 172.21.15.175:0/3126115040 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2434066f60 msgr2=0x7f2434069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2457e00640 1 --2- 172.21.15.175:0/3126115040 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2434066f60 0x7f2434069420 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f24581f8230 tx=0x7f2440007cb0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2457e00640 1 -- 172.21.15.175:0/3126115040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f245806f5e0 msgr2=0x7f2458156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2457e00640 1 --2- 172.21.15.175:0/3126115040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f245806f5e0 0x7f2458156170 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f24480af040 tx=0x7f2448019240 comp rx=0 tx=0).stop 2024-04-25T09:08:37.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2457e00640 1 -- 172.21.15.175:0/3126115040 shutdown_connections 2024-04-25T09:08:37.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2457e00640 1 --2- 172.21.15.175:0/3126115040 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2434066f60 0x7f2434069420 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2457e00640 1 --2- 172.21.15.175:0/3126115040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f245815ba50 0x7f2458157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2457e00640 1 --2- 172.21.15.175:0/3126115040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24580cd2a0 0x7f245814fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2457e00640 1 --2- 172.21.15.175:0/3126115040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f245806f5e0 0x7f2458156170 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2457e00640 1 -- 172.21.15.175:0/3126115040 >> 172.21.15.175:0/3126115040 conn(0x7f24580cc780 msgr2=0x7f2458071920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2457e00640 1 -- 172.21.15.175:0/3126115040 shutdown_connections 2024-04-25T09:08:37.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:37.951+0000 7f2457e00640 1 -- 172.21.15.175:0/3126115040 wait complete. 2024-04-25T09:08:37.962 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:08:38.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.107+0000 7f726d200640 1 Processor -- start 2024-04-25T09:08:38.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.107+0000 7f726d200640 1 -- start start 2024-04-25T09:08:38.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.107+0000 7f726d200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f72680aeb30 0x7f7268071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.107+0000 7f726d200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726806eba0 con 0x7f726806e510 2024-04-25T09:08:38.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.107+0000 7f726d200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726806ee80 con 0x7f7268071780 2024-04-25T09:08:38.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.107+0000 7f726d200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7268071be0 con 0x7f72680aeb30 2024-04-25T09:08:38.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.107+0000 7f7265e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f72680aeb30 0x7f7268071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.107+0000 7f7266800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f726806e510 0x7f72680b2f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:49736/0 (socket says 172.21.15.175:49736) 2024-04-25T09:08:38.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.107+0000 7f7266800640 1 -- 172.21.15.175:0/2943955215 learned_addr learned my addr 172.21.15.175:0/2943955215 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:38.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.111+0000 7f7265e00640 1 -- 172.21.15.175:0/2943955215 >> v1:172.21.15.177:6789/0 conn(0x7f7268071780 legacy=0x7f726806de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.111+0000 7f7265e00640 1 -- 172.21.15.175:0/2943955215 >> v1:172.21.15.175:6789/0 conn(0x7f726806e510 legacy=0x7f72680b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.111+0000 7f7265e00640 1 -- 172.21.15.175:0/2943955215 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72680b2700 con 0x7f72680aeb30 2024-04-25T09:08:38.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.111+0000 7f7264a00640 1 -- 172.21.15.175:0/2943955215 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503473386 0 0) 0x7f726806eba0 con 0x7f726806e510 2024-04-25T09:08:38.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.111+0000 7f7265e00640 1 --2- 172.21.15.175:0/2943955215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72680aeb30 0x7f7268071240 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f72500097c0 tx=0x7f725001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ef61a0782b87c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.111+0000 7f7264a00640 1 -- 172.21.15.175:0/2943955215 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72500b1070 con 0x7f72680aeb30 2024-04-25T09:08:38.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.111+0000 7f7264a00640 1 -- 172.21.15.175:0/2943955215 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72500ac410 con 0x7f72680aeb30 2024-04-25T09:08:38.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.111+0000 7f7264a00640 1 -- 172.21.15.175:0/2943955215 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72500ac7e0 con 0x7f72680aeb30 2024-04-25T09:08:38.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.111+0000 7f726d200640 1 -- 172.21.15.175:0/2943955215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72680aeb30 msgr2=0x7f7268071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.111+0000 7f726d200640 1 --2- 172.21.15.175:0/2943955215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72680aeb30 0x7f7268071240 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f72500097c0 tx=0x7f725001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.111+0000 7f726d200640 1 -- 172.21.15.175:0/2943955215 shutdown_connections 2024-04-25T09:08:38.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.111+0000 7f726d200640 1 --2- 172.21.15.175:0/2943955215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72680aeb30 0x7f7268071240 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.111+0000 7f726d200640 1 -- 172.21.15.175:0/2943955215 >> 172.21.15.175:0/2943955215 conn(0x7f7268067150 msgr2=0x7f726806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.111+0000 7f726d200640 1 -- 172.21.15.175:0/2943955215 shutdown_connections 2024-04-25T09:08:38.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.111+0000 7f726d200640 1 -- 172.21.15.175:0/2943955215 wait complete. 2024-04-25T09:08:38.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f726d200640 1 Processor -- start 2024-04-25T09:08:38.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f726d200640 1 -- start start 2024-04-25T09:08:38.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f726d200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7268071780 0x7f72681304f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f726d200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72680aeb30 0x7f72680ad980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f726d200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7268130a30 0x7f72680adec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f726d200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72680b4230 con 0x7f7268130a30 2024-04-25T09:08:38.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f726d200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72680b40b0 con 0x7f7268071780 2024-04-25T09:08:38.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f726d200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726806e920 con 0x7f72680aeb30 2024-04-25T09:08:38.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f7266800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7268130a30 0x7f72680adec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f7266800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7268130a30 0x7f72680adec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41392/0 (socket says 172.21.15.175:41392) 2024-04-25T09:08:38.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f7266800640 1 -- 172.21.15.175:0/3105615211 learned_addr learned my addr 172.21.15.175:0/3105615211 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:38.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f7265e00640 1 --2- 172.21.15.175:0/3105615211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7268071780 0x7f72681304f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f7265400640 1 --2- 172.21.15.175:0/3105615211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72680aeb30 0x7f72680ad980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f7266800640 1 -- 172.21.15.175:0/3105615211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72680aeb30 msgr2=0x7f72680ad980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f7266800640 1 --2- 172.21.15.175:0/3105615211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72680aeb30 0x7f72680ad980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f7266800640 1 -- 172.21.15.175:0/3105615211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7268071780 msgr2=0x7f72681304f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f7266800640 1 --2- 172.21.15.175:0/3105615211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7268071780 0x7f72681304f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f7266800640 1 -- 172.21.15.175:0/3105615211 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726812fab0 con 0x7f7268130a30 2024-04-25T09:08:38.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f7266800640 1 --2- 172.21.15.175:0/3105615211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7268130a30 0x7f72680adec0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f726000c7a0 tx=0x7f726000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f725e000640 1 -- 172.21.15.175:0/3105615211 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7260018070 con 0x7f7268130a30 2024-04-25T09:08:38.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f725e000640 1 -- 172.21.15.175:0/3105615211 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726000a640 con 0x7f7268130a30 2024-04-25T09:08:38.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f725e000640 1 -- 172.21.15.175:0/3105615211 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726000aab0 con 0x7f7268130a30 2024-04-25T09:08:38.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f726d200640 1 -- 172.21.15.175:0/3105615211 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726812ea10 con 0x7f7268130a30 2024-04-25T09:08:38.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.115+0000 7f726d200640 1 -- 172.21.15.175:0/3105615211 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726812efd0 con 0x7f7268130a30 2024-04-25T09:08:38.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.119+0000 7f726d200640 1 -- 172.21.15.175:0/3105615211 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7268074a60 con 0x7f7268130a30 2024-04-25T09:08:38.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.119+0000 7f725e000640 1 -- 172.21.15.175:0/3105615211 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f726000ac50 con 0x7f7268130a30 2024-04-25T09:08:38.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.119+0000 7f725e000640 1 --2- 172.21.15.175:0/3105615211 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7244066f60 0x7f7244069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.119+0000 7f725e000640 1 -- 172.21.15.175:0/3105615211 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7260084620 con 0x7f7268130a30 2024-04-25T09:08:38.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.119+0000 7f7265e00640 1 --2- 172.21.15.175:0/3105615211 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7244066f60 0x7f7244069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.119+0000 7f7265e00640 1 --2- 172.21.15.175:0/3105615211 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7244066f60 0x7f7244069420 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f72500ae000 tx=0x7f7250008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.123+0000 7f725e000640 1 -- 172.21.15.175:0/3105615211 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7260054f80 con 0x7f7268130a30 2024-04-25T09:08:38.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.311+0000 7f726d200640 1 -- 172.21.15.175:0/3105615211 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f726812f750 con 0x7f7268130a30 2024-04-25T09:08:38.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.311+0000 7f725e000640 1 -- 172.21.15.175:0/3105615211 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7260059020 con 0x7f7268130a30 2024-04-25T09:08:38.301 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:08:38.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.311+0000 7f726d200640 1 -- 172.21.15.175:0/3105615211 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7244066f60 msgr2=0x7f7244069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.311+0000 7f726d200640 1 --2- 172.21.15.175:0/3105615211 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7244066f60 0x7f7244069420 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f72500ae000 tx=0x7f7250008040 comp rx=0 tx=0).stop 2024-04-25T09:08:38.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.311+0000 7f726d200640 1 -- 172.21.15.175:0/3105615211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7268130a30 msgr2=0x7f72680adec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.311+0000 7f726d200640 1 --2- 172.21.15.175:0/3105615211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7268130a30 0x7f72680adec0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f726000c7a0 tx=0x7f726000cc60 comp rx=0 tx=0).stop 2024-04-25T09:08:38.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.311+0000 7f726d200640 1 -- 172.21.15.175:0/3105615211 shutdown_connections 2024-04-25T09:08:38.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.311+0000 7f726d200640 1 --2- 172.21.15.175:0/3105615211 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7244066f60 0x7f7244069420 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.311+0000 7f726d200640 1 --2- 172.21.15.175:0/3105615211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7268130a30 0x7f72680adec0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.311+0000 7f726d200640 1 --2- 172.21.15.175:0/3105615211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72680aeb30 0x7f72680ad980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.311+0000 7f726d200640 1 --2- 172.21.15.175:0/3105615211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7268071780 0x7f72681304f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.311+0000 7f726d200640 1 -- 172.21.15.175:0/3105615211 >> 172.21.15.175:0/3105615211 conn(0x7f726806e510 msgr2=0x7f72680ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.311+0000 7f726d200640 1 -- 172.21.15.175:0/3105615211 shutdown_connections 2024-04-25T09:08:38.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:38.311+0000 7f726d200640 1 -- 172.21.15.175:0/3105615211 wait complete. 2024-04-25T09:08:38.322 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:08:38.322 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:08:38.322 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-25T09:08:38.322 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:08:38.322 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:08:38.322 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:08:38.322 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:08:38.322 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:08:38.323 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:08:38.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:38.323 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-25T09:08:38.332 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:08:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:08:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:08:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:08:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:38.332 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:08:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-25T09:08:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-25T09:08:38.332 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:08:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-25T09:08:38.332 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-25T09:08:38.332 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:08:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:08:38.333 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:08:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:08:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:08:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42201sec preferred_lft 42201sec 2024-04-25T09:08:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-25T09:08:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:38.333 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:08:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:0d:71:4a:a6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:08:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:08:38.333 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:38.334 INFO:teuthology.orchestra.run.smithi175.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:08:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:08:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:08:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:08:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:38.334 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:08:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:08:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:08:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:38.334 INFO:teuthology.orchestra.run.smithi175.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:08:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:08:38.334 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:08:38.335 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:38.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:38.336 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:08:38.397 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:08:38.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:38.399 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-25T09:08:38.455 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-25T09:08:38.455 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:08:38.455 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:08:38.455 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:08:38.455 INFO:teuthology.orchestra.run.smithi175.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:08:38.455 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:08:38.455 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:08:38.455 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:08:38.455 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:08:38.455 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:08:38.455 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:08:38.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:38.456 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:08:38.456 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:08:38.456 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:08:38.456 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:08:38.456 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:08:38.456 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:08:38.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:38.543 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:08:38.552 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:08:38.552 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:08:38.553 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:08:38.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:38.553 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-25T09:08:38.614 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:08:38.614 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:08:38.663 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:08:38.663 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:08:38.663 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:08:38.714 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:08:38.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:38.714 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:08:38.802 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:08:38.803 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:08:38.803 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:08:38.818 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:08:38.818 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:08:38.818 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:08:38.818 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:08:38.818 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:08:38.829 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:08:38.829 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:08:38.829 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:08:38.829 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:08:38.829 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:08:38.829 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:08:38.829 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:08:38.829 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:08:38.833 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:08:38.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:38.833 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:08:38.872 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:08:38.883 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:08:38.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:38.898 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:08:38.973 INFO:tasks.ceph.mds.a.smithi175.stderr:2024-04-25T09:08:38.983+0000 7fa250200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:08:38.981 INFO:teuthology.orchestra.run.smithi175.stdout:client6080 2024-04-25T09:08:38.981 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:08:38.981 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:08:39.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:39.031 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2024-04-25T09:08:39.086 INFO:teuthology.orchestra.run.smithi175.stdout:file_undamaged 2024-04-25T09:08:39.087 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:08:39.087 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:08:39.088 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:08:39.088 DEBUG:teuthology.orchestra.run.smithi175:> import json 2024-04-25T09:08:39.088 DEBUG:teuthology.orchestra.run.smithi175:> import sys 2024-04-25T09:08:39.088 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:08:39.088 DEBUG:teuthology.orchestra.run.smithi175:> try: 2024-04-25T09:08:39.088 DEBUG:teuthology.orchestra.run.smithi175:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2024-04-25T09:08:39.088 DEBUG:teuthology.orchestra.run.smithi175:> except OSError as e: 2024-04-25T09:08:39.088 DEBUG:teuthology.orchestra.run.smithi175:> sys.exit(e.errno) 2024-04-25T09:08:39.088 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:08:39.088 DEBUG:teuthology.orchestra.run.smithi175:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-04-25T09:08:39.088 DEBUG:teuthology.orchestra.run.smithi175:> print(json.dumps( 2024-04-25T09:08:39.088 DEBUG:teuthology.orchestra.run.smithi175:> dict([(a, getattr(s, a)) for a in attrs]), 2024-04-25T09:08:39.088 DEBUG:teuthology.orchestra.run.smithi175:> indent=2)) 2024-04-25T09:08:39.088 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:08:39.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-04-25T09:08:39.207 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-25T09:08:39.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:39.208 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-04-25T09:08:39.261 INFO:teuthology.orchestra.run.smithi175.stdout:2 2024-04-25T09:08:39.261 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:08:39.261 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:08:39.315 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:08:39.315 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:08:39.363 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:08:39.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.551+0000 7f5f79600640 1 Processor -- start 2024-04-25T09:08:39.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.551+0000 7f5f79600640 1 -- start start 2024-04-25T09:08:39.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.551+0000 7f5f79600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5f74144fc0 0x7f5f740cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:39.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.551+0000 7f5f79600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5f7415c5e0 0x7f5f740cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:39.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.551+0000 7f5f79600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7415cd00 con 0x7f5f741453a0 2024-04-25T09:08:39.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.551+0000 7f5f79600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f740ce660 con 0x7f5f74144fc0 2024-04-25T09:08:39.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.551+0000 7f5f79600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f740cc930 con 0x7f5f7415c5e0 2024-04-25T09:08:39.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.555+0000 7f5f72a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5f74144fc0 0x7f5f740cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:39.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.555+0000 7f5f72a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5f74144fc0 0x7f5f740cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49834/0 (socket says 172.21.15.175:49834) 2024-04-25T09:08:39.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.555+0000 7f5f72a00640 1 -- 172.21.15.175:0/1985408 learned_addr learned my addr 172.21.15.175:0/1985408 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:39.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.555+0000 7f5f72a00640 1 -- 172.21.15.175:0/1985408 >> v2:172.21.15.177:3300/0 conn(0x7f5f7415c5e0 msgr2=0x7f5f740cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:39.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.555+0000 7f5f72a00640 1 --2- 172.21.15.175:0/1985408 >> v2:172.21.15.177:3300/0 conn(0x7f5f7415c5e0 0x7f5f740cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:39.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.555+0000 7f5f72a00640 1 -- 172.21.15.175:0/1985408 >> v1:172.21.15.177:6789/0 conn(0x7f5f741453a0 legacy=0x7f5f7415bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:39.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.555+0000 7f5f72a00640 1 -- 172.21.15.175:0/1985408 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f740ccc10 con 0x7f5f74144fc0 2024-04-25T09:08:39.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.555+0000 7f5f72a00640 1 --2- 172.21.15.175:0/1985408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f74144fc0 0x7f5f740cbe70 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f5f64009e50 tx=0x7f5f6401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e846b172d140a2fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:39.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.555+0000 7f5f71600640 1 -- 172.21.15.175:0/1985408 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f640a5760 con 0x7f5f74144fc0 2024-04-25T09:08:39.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.555+0000 7f5f71600640 1 -- 172.21.15.175:0/1985408 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f640a5900 con 0x7f5f74144fc0 2024-04-25T09:08:39.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.555+0000 7f5f71600640 1 -- 172.21.15.175:0/1985408 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f640a5cd0 con 0x7f5f74144fc0 2024-04-25T09:08:39.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f79600640 1 -- 172.21.15.175:0/1985408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f74144fc0 msgr2=0x7f5f740cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:39.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f79600640 1 --2- 172.21.15.175:0/1985408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f74144fc0 0x7f5f740cbe70 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f5f64009e50 tx=0x7f5f6401c9b0 comp rx=0 tx=0).stop 2024-04-25T09:08:39.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f79600640 1 -- 172.21.15.175:0/1985408 shutdown_connections 2024-04-25T09:08:39.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f79600640 1 --2- 172.21.15.175:0/1985408 >> v2:172.21.15.177:3300/0 conn(0x7f5f7415c5e0 0x7f5f740cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:39.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f79600640 1 --2- 172.21.15.175:0/1985408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f74144fc0 0x7f5f740cbe70 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:39.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f79600640 1 -- 172.21.15.175:0/1985408 >> 172.21.15.175:0/1985408 conn(0x7f5f74067150 msgr2=0x7f5f7406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:39.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f79600640 1 -- 172.21.15.175:0/1985408 shutdown_connections 2024-04-25T09:08:39.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f79600640 1 -- 172.21.15.175:0/1985408 wait complete. 2024-04-25T09:08:39.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f79600640 1 Processor -- start 2024-04-25T09:08:39.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f79600640 1 -- start start 2024-04-25T09:08:39.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f79600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f741453a0 0x7f5f7413d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:39.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f79600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5f7415c5e0 0x7f5f740b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:39.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f79600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f740b4410 0x7f5f7413afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:39.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f79600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f740cff40 con 0x7f5f740b4410 2024-04-25T09:08:39.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f79600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f740cfdc0 con 0x7f5f741453a0 2024-04-25T09:08:39.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f79600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f741685f0 con 0x7f5f7415c5e0 2024-04-25T09:08:39.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f73400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f740b4410 0x7f5f7413afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:39.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f73400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f740b4410 0x7f5f7413afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49844/0 (socket says 172.21.15.175:49844) 2024-04-25T09:08:39.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f73400640 1 -- 172.21.15.175:0/586379199 learned_addr learned my addr 172.21.15.175:0/586379199 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:39.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f72000640 1 --2- 172.21.15.175:0/586379199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5f7415c5e0 0x7f5f740b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:39.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f73400640 1 -- 172.21.15.175:0/586379199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5f7415c5e0 msgr2=0x7f5f740b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:39.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f72a00640 1 --2- 172.21.15.175:0/586379199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f741453a0 0x7f5f7413d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:39.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f73400640 1 --2- 172.21.15.175:0/586379199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5f7415c5e0 0x7f5f740b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:39.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f73400640 1 -- 172.21.15.175:0/586379199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f741453a0 msgr2=0x7f5f7413d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:39.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f73400640 1 --2- 172.21.15.175:0/586379199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f741453a0 0x7f5f7413d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:39.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f73400640 1 -- 172.21.15.175:0/586379199 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f740b3370 con 0x7f5f740b4410 2024-04-25T09:08:39.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f72000640 1 --2- 172.21.15.175:0/586379199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5f7415c5e0 0x7f5f740b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:39.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f72a00640 1 --2- 172.21.15.175:0/586379199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f741453a0 0x7f5f7413d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:39.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.559+0000 7f5f73400640 1 --2- 172.21.15.175:0/586379199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f740b4410 0x7f5f7413afa0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00b390 tx=0x7f5f6c00b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:39.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.563+0000 7f5f6aa00640 1 -- 172.21.15.175:0/586379199 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c015020 con 0x7f5f740b4410 2024-04-25T09:08:39.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.563+0000 7f5f6aa00640 1 -- 172.21.15.175:0/586379199 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c011830 con 0x7f5f740b4410 2024-04-25T09:08:39.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.563+0000 7f5f79600640 1 -- 172.21.15.175:0/586379199 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f740b3650 con 0x7f5f740b4410 2024-04-25T09:08:39.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.563+0000 7f5f6aa00640 1 -- 172.21.15.175:0/586379199 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c011c20 con 0x7f5f740b4410 2024-04-25T09:08:39.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.563+0000 7f5f79600640 1 -- 172.21.15.175:0/586379199 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f740b3c10 con 0x7f5f740b4410 2024-04-25T09:08:39.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.563+0000 7f5f79600640 1 -- 172.21.15.175:0/586379199 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f74074a60 con 0x7f5f740b4410 2024-04-25T09:08:39.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.563+0000 7f5f6aa00640 1 -- 172.21.15.175:0/586379199 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5f6c018020 con 0x7f5f740b4410 2024-04-25T09:08:39.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.567+0000 7f5f6aa00640 1 --2- 172.21.15.175:0/586379199 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5f54066f60 0x7f5f54069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:39.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.567+0000 7f5f6aa00640 1 -- 172.21.15.175:0/586379199 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5f6c085580 con 0x7f5f740b4410 2024-04-25T09:08:39.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.567+0000 7f5f72a00640 1 --2- 172.21.15.175:0/586379199 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5f54066f60 0x7f5f54069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:39.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.567+0000 7f5f72a00640 1 --2- 172.21.15.175:0/586379199 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5f54066f60 0x7f5f54069420 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5f640ae000 tx=0x7f5f640a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:39.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.567+0000 7f5f6aa00640 1 -- 172.21.15.175:0/586379199 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5f6c01f020 con 0x7f5f740b4410 2024-04-25T09:08:39.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.723+0000 7f5f79600640 1 -- 172.21.15.175:0/586379199 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f7413bb40 con 0x7f5f740b4410 2024-04-25T09:08:39.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.723+0000 7f5f6aa00640 1 -- 172.21.15.175:0/586379199 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+16835 (secure 0 0 0) 0x7f5f6c00f2e0 con 0x7f5f740b4410 2024-04-25T09:08:39.715 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:08:39.716 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":70,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:08:32.433050+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:08:15.743582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T09:08:16.375168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.177:6835/1709110121":"2024-04-26T09:08:32.433027+0000","172.21.15.177:6833/1709110121":"2024-04-26T09:08:32.433027+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:08:39.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.727+0000 7f5f79600640 1 -- 172.21.15.175:0/586379199 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5f54066f60 msgr2=0x7f5f54069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:39.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.727+0000 7f5f79600640 1 --2- 172.21.15.175:0/586379199 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5f54066f60 0x7f5f54069420 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5f640ae000 tx=0x7f5f640a7070 comp rx=0 tx=0).stop 2024-04-25T09:08:39.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.727+0000 7f5f79600640 1 -- 172.21.15.175:0/586379199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f740b4410 msgr2=0x7f5f7413afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:39.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.727+0000 7f5f79600640 1 --2- 172.21.15.175:0/586379199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f740b4410 0x7f5f7413afa0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00b390 tx=0x7f5f6c00b850 comp rx=0 tx=0).stop 2024-04-25T09:08:39.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.727+0000 7f5f79600640 1 -- 172.21.15.175:0/586379199 shutdown_connections 2024-04-25T09:08:39.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.727+0000 7f5f79600640 1 --2- 172.21.15.175:0/586379199 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5f54066f60 0x7f5f54069420 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:39.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.727+0000 7f5f79600640 1 --2- 172.21.15.175:0/586379199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f740b4410 0x7f5f7413afa0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:39.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.727+0000 7f5f79600640 1 --2- 172.21.15.175:0/586379199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5f7415c5e0 0x7f5f740b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:39.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.727+0000 7f5f79600640 1 --2- 172.21.15.175:0/586379199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5f741453a0 0x7f5f7413d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:39.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.727+0000 7f5f79600640 1 -- 172.21.15.175:0/586379199 >> 172.21.15.175:0/586379199 conn(0x7f5f74144fc0 msgr2=0x7f5f7415e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:39.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.727+0000 7f5f79600640 1 -- 172.21.15.175:0/586379199 shutdown_connections 2024-04-25T09:08:39.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.727+0000 7f5f79600640 1 -- 172.21.15.175:0/586379199 wait complete. 2024-04-25T09:08:39.737 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:08:15.743582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:08:16.375168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:08:39.737 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:08:39.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.887+0000 7fc4e6c00640 1 Processor -- start 2024-04-25T09:08:39.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.887+0000 7fc4e6c00640 1 -- start start 2024-04-25T09:08:39.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.887+0000 7fc4e6c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc4e00af580 0x7fc4e015a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:39.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.887+0000 7fc4e6c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e00cead0 0x7fc4e006e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:39.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.887+0000 7fc4e6c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e00cb440 con 0x7fc4e00cabd0 2024-04-25T09:08:39.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.887+0000 7fc4e6c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e00cb720 con 0x7fc4e00af580 2024-04-25T09:08:39.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.887+0000 7fc4e6c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00cba00 con 0x7fc4e00cead0 2024-04-25T09:08:39.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.887+0000 7fc4e5800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc4e00af580 0x7fc4e015a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:39.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.887+0000 7fc4e5800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc4e00af580 0x7fc4e015a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49856/0 (socket says 172.21.15.175:49856) 2024-04-25T09:08:39.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.887+0000 7fc4e5800640 1 -- 172.21.15.175:0/528172947 learned_addr learned my addr 172.21.15.175:0/528172947 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:39.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.887+0000 7fc4e6200640 1 --2- 172.21.15.175:0/528172947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e00cead0 0x7fc4e006e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:39.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.887+0000 7fc4e5800640 1 -- 172.21.15.175:0/528172947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e00cead0 msgr2=0x7fc4e006e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:39.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.887+0000 7fc4e5800640 1 --2- 172.21.15.175:0/528172947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e00cead0 0x7fc4e006e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:39.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.887+0000 7fc4e5800640 1 -- 172.21.15.175:0/528172947 >> v1:172.21.15.177:6789/0 conn(0x7fc4e00cabd0 legacy=0x7fc4e00ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:39.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.887+0000 7fc4e5800640 1 -- 172.21.15.175:0/528172947 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e00cbce0 con 0x7fc4e00af580 2024-04-25T09:08:39.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.891+0000 7fc4e5800640 1 --2- 172.21.15.175:0/528172947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4e00af580 0x7fc4e015a470 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4006fd0 tx=0x7fc4d401e920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24494fda010e4b89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:39.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.891+0000 7fc4dfe00640 1 -- 172.21.15.175:0/528172947 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d40ad070 con 0x7fc4e00af580 2024-04-25T09:08:39.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.891+0000 7fc4dfe00640 1 -- 172.21.15.175:0/528172947 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d4004230 con 0x7fc4e00af580 2024-04-25T09:08:39.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.891+0000 7fc4dfe00640 1 -- 172.21.15.175:0/528172947 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4003620 con 0x7fc4e00af580 2024-04-25T09:08:39.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.891+0000 7fc4e6c00640 1 -- 172.21.15.175:0/528172947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4e00af580 msgr2=0x7fc4e015a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:39.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.891+0000 7fc4e6c00640 1 --2- 172.21.15.175:0/528172947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4e00af580 0x7fc4e015a470 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4006fd0 tx=0x7fc4d401e920 comp rx=0 tx=0).stop 2024-04-25T09:08:39.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.891+0000 7fc4e6c00640 1 -- 172.21.15.175:0/528172947 shutdown_connections 2024-04-25T09:08:39.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.891+0000 7fc4e6c00640 1 --2- 172.21.15.175:0/528172947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e00cead0 0x7fc4e006e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:39.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.891+0000 7fc4e6c00640 1 --2- 172.21.15.175:0/528172947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4e00af580 0x7fc4e015a470 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:39.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.891+0000 7fc4e6c00640 1 -- 172.21.15.175:0/528172947 >> 172.21.15.175:0/528172947 conn(0x7fc4e00cc860 msgr2=0x7fc4e00ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:39.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.891+0000 7fc4e6c00640 1 -- 172.21.15.175:0/528172947 shutdown_connections 2024-04-25T09:08:39.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.891+0000 7fc4e6c00640 1 -- 172.21.15.175:0/528172947 wait complete. 2024-04-25T09:08:39.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6c00640 1 Processor -- start 2024-04-25T09:08:39.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6c00640 1 -- start start 2024-04-25T09:08:39.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e00af580 0x7fc4e0147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:39.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e00cabd0 0x7fc4e00b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:39.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4e00cead0 0x7fc4e01f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:39.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e006f2d0 con 0x7fc4e00cead0 2024-04-25T09:08:39.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e006f150 con 0x7fc4e00cabd0 2024-04-25T09:08:39.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e006f450 con 0x7fc4e00af580 2024-04-25T09:08:39.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4e00cead0 0x7fc4e01f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:39.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4e00cead0 0x7fc4e01f6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49872/0 (socket says 172.21.15.175:49872) 2024-04-25T09:08:39.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6200640 1 -- 172.21.15.175:0/4230040332 learned_addr learned my addr 172.21.15.175:0/4230040332 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:39.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e5800640 1 --2- 172.21.15.175:0/4230040332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e00af580 0x7fc4e0147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:39.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e4e00640 1 --2- 172.21.15.175:0/4230040332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e00cabd0 0x7fc4e00b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:39.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6200640 1 -- 172.21.15.175:0/4230040332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e00af580 msgr2=0x7fc4e0147840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:39.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6200640 1 --2- 172.21.15.175:0/4230040332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e00af580 0x7fc4e0147840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:39.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6200640 1 -- 172.21.15.175:0/4230040332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e00cabd0 msgr2=0x7fc4e00b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:39.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6200640 1 --2- 172.21.15.175:0/4230040332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e00cabd0 0x7fc4e00b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:39.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6200640 1 -- 172.21.15.175:0/4230040332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e0147d80 con 0x7fc4e00cead0 2024-04-25T09:08:39.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e4e00640 1 --2- 172.21.15.175:0/4230040332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e00cabd0 0x7fc4e00b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:39.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6200640 1 --2- 172.21.15.175:0/4230040332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4e00cead0 0x7fc4e01f6ee0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8007e60 tx=0x7fc4d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:39.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4dd600640 1 -- 172.21.15.175:0/4230040332 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8014420 con 0x7fc4e00cead0 2024-04-25T09:08:39.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4dd600640 1 -- 172.21.15.175:0/4230040332 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d8019070 con 0x7fc4e00cead0 2024-04-25T09:08:39.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4dd600640 1 -- 172.21.15.175:0/4230040332 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8014820 con 0x7fc4e00cead0 2024-04-25T09:08:39.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6c00640 1 -- 172.21.15.175:0/4230040332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e0153bd0 con 0x7fc4e00cead0 2024-04-25T09:08:39.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6c00640 1 -- 172.21.15.175:0/4230040332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e0154190 con 0x7fc4e00cead0 2024-04-25T09:08:39.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.895+0000 7fc4e6c00640 1 -- 172.21.15.175:0/4230040332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e0074a60 con 0x7fc4e00cead0 2024-04-25T09:08:39.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.899+0000 7fc4dd600640 1 -- 172.21.15.175:0/4230040332 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc4d80149c0 con 0x7fc4e00cead0 2024-04-25T09:08:39.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.899+0000 7fc4dd600640 1 --2- 172.21.15.175:0/4230040332 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc4c0066f60 0x7fc4c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:39.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.899+0000 7fc4dd600640 1 -- 172.21.15.175:0/4230040332 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc4d8085920 con 0x7fc4e00cead0 2024-04-25T09:08:39.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.899+0000 7fc4e5800640 1 --2- 172.21.15.175:0/4230040332 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc4c0066f60 0x7fc4c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:39.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.899+0000 7fc4e5800640 1 --2- 172.21.15.175:0/4230040332 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc4c0066f60 0x7fc4c0069420 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40b1000 tx=0x7fc4d40a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:39.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:39.903+0000 7fc4dd600640 1 -- 172.21.15.175:0/4230040332 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc4d8056830 con 0x7fc4e00cead0 2024-04-25T09:08:40.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.055+0000 7fc4e6c00640 1 -- 172.21.15.175:0/4230040332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc4e00acd90 con 0x7fc4e00cead0 2024-04-25T09:08:40.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.059+0000 7fc4dd600640 1 -- 172.21.15.175:0/4230040332 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc4d8056130 con 0x7fc4e00cead0 2024-04-25T09:08:40.048 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:08:40.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.059+0000 7fc4e6c00640 1 -- 172.21.15.175:0/4230040332 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc4c0066f60 msgr2=0x7fc4c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:40.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.059+0000 7fc4e6c00640 1 --2- 172.21.15.175:0/4230040332 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc4c0066f60 0x7fc4c0069420 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40b1000 tx=0x7fc4d40a9070 comp rx=0 tx=0).stop 2024-04-25T09:08:40.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.059+0000 7fc4e6c00640 1 -- 172.21.15.175:0/4230040332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4e00cead0 msgr2=0x7fc4e01f6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:40.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.059+0000 7fc4e6c00640 1 --2- 172.21.15.175:0/4230040332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4e00cead0 0x7fc4e01f6ee0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8007e60 tx=0x7fc4d800e4b0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.059+0000 7fc4e6c00640 1 -- 172.21.15.175:0/4230040332 shutdown_connections 2024-04-25T09:08:40.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.059+0000 7fc4e6c00640 1 --2- 172.21.15.175:0/4230040332 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc4c0066f60 0x7fc4c0069420 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.059+0000 7fc4e6c00640 1 --2- 172.21.15.175:0/4230040332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4e00cead0 0x7fc4e01f6ee0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.059+0000 7fc4e6c00640 1 --2- 172.21.15.175:0/4230040332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e00cabd0 0x7fc4e00b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.059+0000 7fc4e6c00640 1 --2- 172.21.15.175:0/4230040332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4e00af580 0x7fc4e0147840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.059+0000 7fc4e6c00640 1 -- 172.21.15.175:0/4230040332 >> 172.21.15.175:0/4230040332 conn(0x7fc4e00cc860 msgr2=0x7fc4e00cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:40.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.059+0000 7fc4e6c00640 1 -- 172.21.15.175:0/4230040332 shutdown_connections 2024-04-25T09:08:40.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.059+0000 7fc4e6c00640 1 -- 172.21.15.175:0/4230040332 wait complete. 2024-04-25T09:08:40.069 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:08:40.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.215+0000 7fd5b4600640 1 Processor -- start 2024-04-25T09:08:40.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.215+0000 7fd5b4600640 1 -- start start 2024-04-25T09:08:40.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.215+0000 7fd5b4600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd5ac145250 0x7fd5ac0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.215+0000 7fd5b4600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd5ac0ce970 0x7fd5ac0cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.215+0000 7fd5b4600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5ac0cfd10 con 0x7fd5ac1600a0 2024-04-25T09:08:40.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.215+0000 7fd5b4600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ac15f650 con 0x7fd5ac145250 2024-04-25T09:08:40.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.215+0000 7fd5b4600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ac0cfff0 con 0x7fd5ac0ce970 2024-04-25T09:08:40.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.219+0000 7fd5b1c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd5ac145250 0x7fd5ac0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.219+0000 7fd5b1200640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd5ac1600a0 0x7fd5ac0cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:43262/0 (socket says 172.21.15.175:43262) 2024-04-25T09:08:40.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.219+0000 7fd5b1200640 1 -- 172.21.15.175:0/3015028386 learned_addr learned my addr 172.21.15.175:0/3015028386 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:40.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.219+0000 7fd5b2600640 1 --2- 172.21.15.175:0/3015028386 >> v2:172.21.15.177:3300/0 conn(0x7fd5ac0ce970 0x7fd5ac0cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.219+0000 7fd5b1c00640 1 -- 172.21.15.175:0/3015028386 >> v2:172.21.15.177:3300/0 conn(0x7fd5ac0ce970 msgr2=0x7fd5ac0cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:40.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.219+0000 7fd5b1c00640 1 --2- 172.21.15.175:0/3015028386 >> v2:172.21.15.177:3300/0 conn(0x7fd5ac0ce970 0x7fd5ac0cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.219+0000 7fd5b1c00640 1 -- 172.21.15.175:0/3015028386 >> v1:172.21.15.175:6789/0 conn(0x7fd5ac1600a0 legacy=0x7fd5ac0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:40.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.219+0000 7fd5b1c00640 1 -- 172.21.15.175:0/3015028386 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac15f8a0 con 0x7fd5ac145250 2024-04-25T09:08:40.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.219+0000 7fd5abe00640 1 -- 172.21.15.175:0/3015028386 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302998452 0 0) 0x7fd5ac0cfd10 con 0x7fd5ac1600a0 2024-04-25T09:08:40.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.219+0000 7fd5b1c00640 1 --2- 172.21.15.175:0/3015028386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5ac145250 0x7fd5ac0cf6b0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00097c0 tx=0x7fd5a001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f160fa77e637986b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:40.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.219+0000 7fd5abe00640 1 -- 172.21.15.175:0/3015028386 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00b0070 con 0x7fd5ac145250 2024-04-25T09:08:40.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.219+0000 7fd5abe00640 1 -- 172.21.15.175:0/3015028386 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a00ab600 con 0x7fd5ac145250 2024-04-25T09:08:40.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.219+0000 7fd5abe00640 1 -- 172.21.15.175:0/3015028386 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00ab9d0 con 0x7fd5ac145250 2024-04-25T09:08:40.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b4600640 1 -- 172.21.15.175:0/3015028386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5ac145250 msgr2=0x7fd5ac0cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:40.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b4600640 1 --2- 172.21.15.175:0/3015028386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5ac145250 0x7fd5ac0cf6b0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00097c0 tx=0x7fd5a001c3a0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b4600640 1 -- 172.21.15.175:0/3015028386 shutdown_connections 2024-04-25T09:08:40.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b4600640 1 --2- 172.21.15.175:0/3015028386 >> v2:172.21.15.177:3300/0 conn(0x7fd5ac0ce970 0x7fd5ac0cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b4600640 1 --2- 172.21.15.175:0/3015028386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5ac145250 0x7fd5ac0cf6b0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b4600640 1 -- 172.21.15.175:0/3015028386 >> 172.21.15.175:0/3015028386 conn(0x7fd5ac06ac50 msgr2=0x7fd5ac06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:40.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b4600640 1 -- 172.21.15.175:0/3015028386 shutdown_connections 2024-04-25T09:08:40.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b4600640 1 -- 172.21.15.175:0/3015028386 wait complete. 2024-04-25T09:08:40.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b4600640 1 Processor -- start 2024-04-25T09:08:40.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b4600640 1 -- start start 2024-04-25T09:08:40.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b4600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5ac0ce970 0x7fd5ac0b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b4600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5ac145250 0x7fd5ac12dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b4600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5ac1600a0 0x7fd5ac12e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b4600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac15c870 con 0x7fd5ac1600a0 2024-04-25T09:08:40.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b4600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac145630 con 0x7fd5ac0ce970 2024-04-25T09:08:40.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b4600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ac15c9f0 con 0x7fd5ac145250 2024-04-25T09:08:40.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b2600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5ac1600a0 0x7fd5ac12e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b2600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5ac1600a0 0x7fd5ac12e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49890/0 (socket says 172.21.15.175:49890) 2024-04-25T09:08:40.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b2600640 1 -- 172.21.15.175:0/3156264222 learned_addr learned my addr 172.21.15.175:0/3156264222 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:40.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b1200640 1 --2- 172.21.15.175:0/3156264222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5ac145250 0x7fd5ac12dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b1c00640 1 --2- 172.21.15.175:0/3156264222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5ac0ce970 0x7fd5ac0b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b2600640 1 -- 172.21.15.175:0/3156264222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5ac145250 msgr2=0x7fd5ac12dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:40.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b2600640 1 --2- 172.21.15.175:0/3156264222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5ac145250 0x7fd5ac12dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b2600640 1 -- 172.21.15.175:0/3156264222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5ac0ce970 msgr2=0x7fd5ac0b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:40.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b2600640 1 --2- 172.21.15.175:0/3156264222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5ac0ce970 0x7fd5ac0b3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b2600640 1 -- 172.21.15.175:0/3156264222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac12bc00 con 0x7fd5ac1600a0 2024-04-25T09:08:40.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.223+0000 7fd5b2600640 1 --2- 172.21.15.175:0/3156264222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5ac1600a0 0x7fd5ac12e020 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4007e70 tx=0x7fd5a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:40.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.227+0000 7fd5a9600640 1 -- 172.21.15.175:0/3156264222 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4014420 con 0x7fd5ac1600a0 2024-04-25T09:08:40.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.227+0000 7fd5a9600640 1 -- 172.21.15.175:0/3156264222 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a4019070 con 0x7fd5ac1600a0 2024-04-25T09:08:40.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.227+0000 7fd5a9600640 1 -- 172.21.15.175:0/3156264222 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4014820 con 0x7fd5ac1600a0 2024-04-25T09:08:40.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.227+0000 7fd5b4600640 1 -- 172.21.15.175:0/3156264222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ac15e600 con 0x7fd5ac1600a0 2024-04-25T09:08:40.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.227+0000 7fd5b4600640 1 -- 172.21.15.175:0/3156264222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ac0b4410 con 0x7fd5ac1600a0 2024-04-25T09:08:40.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.227+0000 7fd5b4600640 1 -- 172.21.15.175:0/3156264222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ac075160 con 0x7fd5ac1600a0 2024-04-25T09:08:40.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.227+0000 7fd5a9600640 1 -- 172.21.15.175:0/3156264222 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd5a40149c0 con 0x7fd5ac1600a0 2024-04-25T09:08:40.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.227+0000 7fd5a9600640 1 --2- 172.21.15.175:0/3156264222 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd58c066f60 0x7fd58c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.227+0000 7fd5a9600640 1 -- 172.21.15.175:0/3156264222 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd5a40857b0 con 0x7fd5ac1600a0 2024-04-25T09:08:40.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.227+0000 7fd5b1c00640 1 --2- 172.21.15.175:0/3156264222 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd58c066f60 0x7fd58c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.227+0000 7fd5b1c00640 1 --2- 172.21.15.175:0/3156264222 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd58c066f60 0x7fd58c069420 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac0cf630 tx=0x7fd5a00a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:40.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.231+0000 7fd5a9600640 1 -- 172.21.15.175:0/3156264222 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd5a4056070 con 0x7fd5ac1600a0 2024-04-25T09:08:40.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.383+0000 7fd5b4600640 1 -- 172.21.15.175:0/3156264222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd5ac0af890 con 0x7fd5ac1600a0 2024-04-25T09:08:40.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.387+0000 7fd5a9600640 1 -- 172.21.15.175:0/3156264222 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v70) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd5a405a110 con 0x7fd5ac1600a0 2024-04-25T09:08:40.376 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:08:40.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.387+0000 7fd5b4600640 1 -- 172.21.15.175:0/3156264222 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd58c066f60 msgr2=0x7fd58c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:40.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.387+0000 7fd5b4600640 1 --2- 172.21.15.175:0/3156264222 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd58c066f60 0x7fd58c069420 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac0cf630 tx=0x7fd5a00a6000 comp rx=0 tx=0).stop 2024-04-25T09:08:40.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.387+0000 7fd5b4600640 1 -- 172.21.15.175:0/3156264222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5ac1600a0 msgr2=0x7fd5ac12e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:40.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.387+0000 7fd5b4600640 1 --2- 172.21.15.175:0/3156264222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5ac1600a0 0x7fd5ac12e020 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4007e70 tx=0x7fd5a400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.387+0000 7fd5b4600640 1 -- 172.21.15.175:0/3156264222 shutdown_connections 2024-04-25T09:08:40.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.387+0000 7fd5b4600640 1 --2- 172.21.15.175:0/3156264222 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd58c066f60 0x7fd58c069420 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.387+0000 7fd5b4600640 1 --2- 172.21.15.175:0/3156264222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5ac1600a0 0x7fd5ac12e020 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.387+0000 7fd5b4600640 1 --2- 172.21.15.175:0/3156264222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5ac145250 0x7fd5ac12dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.387+0000 7fd5b4600640 1 --2- 172.21.15.175:0/3156264222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5ac0ce970 0x7fd5ac0b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.387+0000 7fd5b4600640 1 -- 172.21.15.175:0/3156264222 >> 172.21.15.175:0/3156264222 conn(0x7fd5ac06ac50 msgr2=0x7fd5ac0ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:40.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.387+0000 7fd5b4600640 1 -- 172.21.15.175:0/3156264222 shutdown_connections 2024-04-25T09:08:40.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.387+0000 7fd5b4600640 1 -- 172.21.15.175:0/3156264222 wait complete. 2024-04-25T09:08:40.397 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:08:40.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.543+0000 7efee6a00640 1 Processor -- start 2024-04-25T09:08:40.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.543+0000 7efee6a00640 1 -- start start 2024-04-25T09:08:40.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.547+0000 7efee6a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efee0145250 0x7efee00cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.547+0000 7efee6a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efee00ce970 0x7efee00cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.547+0000 7efee6a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee00cfd10 con 0x7efee01600a0 2024-04-25T09:08:40.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.547+0000 7efee6a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee015f650 con 0x7efee00ce970 2024-04-25T09:08:40.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.547+0000 7efee6a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee00cfff0 con 0x7efee0145250 2024-04-25T09:08:40.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.547+0000 7efedf400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7efee01600a0 0x7efee00cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:43276/0 (socket says 172.21.15.175:43276) 2024-04-25T09:08:40.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.547+0000 7efedf400640 1 -- 172.21.15.175:0/1802889907 learned_addr learned my addr 172.21.15.175:0/1802889907 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:40.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.547+0000 7efedfe00640 1 --2- 172.21.15.175:0/1802889907 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efee0145250 0x7efee00cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.547+0000 7efee4a00640 1 --2- 172.21.15.175:0/1802889907 >> v2:172.21.15.177:3300/0 conn(0x7efee00ce970 0x7efee00cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.547+0000 7efedea00640 1 -- 172.21.15.175:0/1802889907 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706495481 0 0) 0x7efee00cfd10 con 0x7efee01600a0 2024-04-25T09:08:40.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.547+0000 7efedea00640 1 -- 172.21.15.175:0/1802889907 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efec4003530 con 0x7efee01600a0 2024-04-25T09:08:40.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.547+0000 7efedfe00640 1 -- 172.21.15.175:0/1802889907 >> v2:172.21.15.177:3300/0 conn(0x7efee00ce970 msgr2=0x7efee00cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:40.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.547+0000 7efedfe00640 1 --2- 172.21.15.175:0/1802889907 >> v2:172.21.15.177:3300/0 conn(0x7efee00ce970 0x7efee00cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.547+0000 7efedfe00640 1 -- 172.21.15.175:0/1802889907 >> v1:172.21.15.175:6789/0 conn(0x7efee01600a0 legacy=0x7efee00cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:40.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.547+0000 7efedfe00640 1 -- 172.21.15.175:0/1802889907 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee015f8a0 con 0x7efee0145250 2024-04-25T09:08:40.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.551+0000 7efedfe00640 1 --2- 172.21.15.175:0/1802889907 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efee0145250 0x7efee00cf6b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efed00097c0 tx=0x7efed001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f6cd1fac4e98c09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:40.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.551+0000 7efedea00640 1 -- 172.21.15.175:0/1802889907 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed00ab600 con 0x7efee0145250 2024-04-25T09:08:40.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.551+0000 7efedea00640 1 -- 172.21.15.175:0/1802889907 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed00b0070 con 0x7efee0145250 2024-04-25T09:08:40.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.551+0000 7efedea00640 1 -- 172.21.15.175:0/1802889907 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed00ab9c0 con 0x7efee0145250 2024-04-25T09:08:40.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.551+0000 7efee6a00640 1 -- 172.21.15.175:0/1802889907 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efee0145250 msgr2=0x7efee00cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:40.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.551+0000 7efee6a00640 1 --2- 172.21.15.175:0/1802889907 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efee0145250 0x7efee00cf6b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efed00097c0 tx=0x7efed001c3e0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.551+0000 7efee6a00640 1 -- 172.21.15.175:0/1802889907 shutdown_connections 2024-04-25T09:08:40.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.551+0000 7efee6a00640 1 --2- 172.21.15.175:0/1802889907 >> v2:172.21.15.177:3300/0 conn(0x7efee00ce970 0x7efee00cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.551+0000 7efee6a00640 1 --2- 172.21.15.175:0/1802889907 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efee0145250 0x7efee00cf6b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.551+0000 7efee6a00640 1 -- 172.21.15.175:0/1802889907 >> 172.21.15.175:0/1802889907 conn(0x7efee006ac50 msgr2=0x7efee006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:40.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.551+0000 7efee6a00640 1 -- 172.21.15.175:0/1802889907 shutdown_connections 2024-04-25T09:08:40.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.551+0000 7efee6a00640 1 -- 172.21.15.175:0/1802889907 wait complete. 2024-04-25T09:08:40.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.551+0000 7efee6a00640 1 Processor -- start 2024-04-25T09:08:40.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.551+0000 7efee6a00640 1 -- start start 2024-04-25T09:08:40.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efee6a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efee00ce970 0x7efee015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efee6a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efee0145250 0x7efee015d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efee6a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efee01600a0 0x7efee015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efee6a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee0160600 con 0x7efee00ce970 2024-04-25T09:08:40.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efee6a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee0160480 con 0x7efee0145250 2024-04-25T09:08:40.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efee6a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee015c870 con 0x7efee01600a0 2024-04-25T09:08:40.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efedfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efee00ce970 0x7efee015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efedfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efee00ce970 0x7efee015b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49900/0 (socket says 172.21.15.175:49900) 2024-04-25T09:08:40.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efedfe00640 1 -- 172.21.15.175:0/3852784372 learned_addr learned my addr 172.21.15.175:0/3852784372 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:40.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efee4a00640 1 --2- 172.21.15.175:0/3852784372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efee01600a0 0x7efee015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efedf400640 1 --2- 172.21.15.175:0/3852784372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efee0145250 0x7efee015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efedfe00640 1 -- 172.21.15.175:0/3852784372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efee01600a0 msgr2=0x7efee015d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:40.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efedfe00640 1 --2- 172.21.15.175:0/3852784372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efee01600a0 0x7efee015d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efedfe00640 1 -- 172.21.15.175:0/3852784372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efee0145250 msgr2=0x7efee015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:40.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efedfe00640 1 --2- 172.21.15.175:0/3852784372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efee0145250 0x7efee015d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efedfe00640 1 -- 172.21.15.175:0/3852784372 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee013fe50 con 0x7efee00ce970 2024-04-25T09:08:40.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efedf400640 1 --2- 172.21.15.175:0/3852784372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efee0145250 0x7efee015d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:40.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efedfe00640 1 --2- 172.21.15.175:0/3852784372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efee00ce970 0x7efee015b1e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7efed00ad040 tx=0x7efed001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:40.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efed7e00640 1 -- 172.21.15.175:0/3852784372 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed00bf410 con 0x7efee00ce970 2024-04-25T09:08:40.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efed7e00640 1 -- 172.21.15.175:0/3852784372 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed00bf5b0 con 0x7efee00ce970 2024-04-25T09:08:40.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efee6a00640 1 -- 172.21.15.175:0/3852784372 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee013edb0 con 0x7efee00ce970 2024-04-25T09:08:40.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efed7e00640 1 -- 172.21.15.175:0/3852784372 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed00bf960 con 0x7efee00ce970 2024-04-25T09:08:40.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efee6a00640 1 -- 172.21.15.175:0/3852784372 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee013f370 con 0x7efee00ce970 2024-04-25T09:08:40.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efee6a00640 1 -- 172.21.15.175:0/3852784372 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee0075160 con 0x7efee00ce970 2024-04-25T09:08:40.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.555+0000 7efed7e00640 1 -- 172.21.15.175:0/3852784372 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efed00bd020 con 0x7efee00ce970 2024-04-25T09:08:40.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.559+0000 7efed7e00640 1 --2- 172.21.15.175:0/3852784372 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efec0066f60 0x7efec0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.559+0000 7efed7e00640 1 -- 172.21.15.175:0/3852784372 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7efed011f530 con 0x7efee00ce970 2024-04-25T09:08:40.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.559+0000 7efedf400640 1 --2- 172.21.15.175:0/3852784372 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efec0066f60 0x7efec0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.559+0000 7efedf400640 1 --2- 172.21.15.175:0/3852784372 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efec0066f60 0x7efec0069420 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efee0165ad0 tx=0x7efecc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:40.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.563+0000 7efed7e00640 1 -- 172.21.15.175:0/3852784372 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efed0016090 con 0x7efee00ce970 2024-04-25T09:08:40.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.715+0000 7efee6a00640 1 -- 172.21.15.175:0/3852784372 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efee006e530 con 0x7efee00ce970 2024-04-25T09:08:40.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.715+0000 7efed7e00640 1 -- 172.21.15.175:0/3852784372 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v70) v1 ==== 100+0+11 (secure 0 0 0) 0x7efed00efe80 con 0x7efee00ce970 2024-04-25T09:08:40.705 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:08:40.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.715+0000 7efee6a00640 1 -- 172.21.15.175:0/3852784372 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efec0066f60 msgr2=0x7efec0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:40.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.715+0000 7efee6a00640 1 --2- 172.21.15.175:0/3852784372 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efec0066f60 0x7efec0069420 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efee0165ad0 tx=0x7efecc009040 comp rx=0 tx=0).stop 2024-04-25T09:08:40.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.715+0000 7efee6a00640 1 -- 172.21.15.175:0/3852784372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efee00ce970 msgr2=0x7efee015b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:40.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.715+0000 7efee6a00640 1 --2- 172.21.15.175:0/3852784372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efee00ce970 0x7efee015b1e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7efed00ad040 tx=0x7efed001ac20 comp rx=0 tx=0).stop 2024-04-25T09:08:40.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.715+0000 7efee6a00640 1 -- 172.21.15.175:0/3852784372 shutdown_connections 2024-04-25T09:08:40.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.715+0000 7efee6a00640 1 --2- 172.21.15.175:0/3852784372 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efec0066f60 0x7efec0069420 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.715+0000 7efee6a00640 1 --2- 172.21.15.175:0/3852784372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efee01600a0 0x7efee015d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.715+0000 7efee6a00640 1 --2- 172.21.15.175:0/3852784372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efee0145250 0x7efee015d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.715+0000 7efee6a00640 1 --2- 172.21.15.175:0/3852784372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efee00ce970 0x7efee015b1e0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.715+0000 7efee6a00640 1 -- 172.21.15.175:0/3852784372 >> 172.21.15.175:0/3852784372 conn(0x7efee006ac50 msgr2=0x7efee015e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:40.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.715+0000 7efee6a00640 1 -- 172.21.15.175:0/3852784372 shutdown_connections 2024-04-25T09:08:40.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.715+0000 7efee6a00640 1 -- 172.21.15.175:0/3852784372 wait complete. 2024-04-25T09:08:40.727 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:08:40.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f191aa00640 1 Processor -- start 2024-04-25T09:08:40.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f191aa00640 1 -- start start 2024-04-25T09:08:40.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f191aa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f191415db00 0x7f191406ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f191aa00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1914066a10 0x7f191406b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f191aa00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1914066ed0 con 0x7f19140b2cb0 2024-04-25T09:08:40.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f191aa00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19140cdc00 con 0x7f1914066a10 2024-04-25T09:08:40.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f191aa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19140cde50 con 0x7f191415db00 2024-04-25T09:08:40.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f191a000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f19140b2cb0 0x7f19140ce930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:43280/0 (socket says 172.21.15.175:43280) 2024-04-25T09:08:40.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f191a000640 1 -- 172.21.15.175:0/1236847026 learned_addr learned my addr 172.21.15.175:0/1236847026 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:40.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f1918c00640 1 --2- 172.21.15.175:0/1236847026 >> v2:172.21.15.177:3300/0 conn(0x7f1914066a10 0x7f191406b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f1913e00640 1 -- 172.21.15.175:0/1236847026 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794588348 0 0) 0x7f1914066ed0 con 0x7f19140b2cb0 2024-04-25T09:08:40.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f1913e00640 1 -- 172.21.15.175:0/1236847026 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18fc003530 con 0x7f19140b2cb0 2024-04-25T09:08:40.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f1919600640 1 --2- 172.21.15.175:0/1236847026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f191415db00 0x7f191406ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f1913e00640 1 -- 172.21.15.175:0/1236847026 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 950783803 0 0) 0x7f18fc003530 con 0x7f19140b2cb0 2024-04-25T09:08:40.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f1913e00640 1 -- 172.21.15.175:0/1236847026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f191415db00 msgr2=0x7f191406ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:40.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f1913e00640 1 --2- 172.21.15.175:0/1236847026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f191415db00 0x7f191406ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f1913e00640 1 -- 172.21.15.175:0/1236847026 >> v2:172.21.15.177:3300/0 conn(0x7f1914066a10 msgr2=0x7f191406b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:40.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f1913e00640 1 --2- 172.21.15.175:0/1236847026 >> v2:172.21.15.177:3300/0 conn(0x7f1914066a10 0x7f191406b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f1913e00640 1 -- 172.21.15.175:0/1236847026 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19140ce130 con 0x7f19140b2cb0 2024-04-25T09:08:40.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f1913e00640 1 -- 172.21.15.175:0/1236847026 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f190c001a00 con 0x7f19140b2cb0 2024-04-25T09:08:40.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f1913e00640 1 -- 172.21.15.175:0/1236847026 >> v1:172.21.15.175:6789/0 conn(0x7f19140b2cb0 legacy=0x7f19140ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:40.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f1913e00640 1 --2- 172.21.15.175:0/1236847026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18fc0039c0 0x7f18fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f1913e00640 1 --2- 172.21.15.175:0/1236847026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18fc004810 0x7f18fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f1913e00640 1 --2- 172.21.15.175:0/1236847026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f191415db00 0x7f18fc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f1913e00640 1 -- 172.21.15.175:0/1236847026 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19140cdc00 con 0x7f18fc0039c0 2024-04-25T09:08:40.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f1913e00640 1 -- 172.21.15.175:0/1236847026 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19140cde50 con 0x7f18fc004810 2024-04-25T09:08:40.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.875+0000 7f1913e00640 1 -- 172.21.15.175:0/1236847026 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc00b9d0 con 0x7f191415db00 2024-04-25T09:08:40.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.879+0000 7f1919600640 1 --2- 172.21.15.175:0/1236847026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18fc0039c0 0x7f18fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.879+0000 7f1918c00640 1 --2- 172.21.15.175:0/1236847026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18fc004810 0x7f18fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.879+0000 7f191a000640 1 --2- 172.21.15.175:0/1236847026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f191415db00 0x7f18fc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.879+0000 7f1919600640 1 -- 172.21.15.175:0/1236847026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f191415db00 msgr2=0x7f18fc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:40.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.879+0000 7f1919600640 1 --2- 172.21.15.175:0/1236847026 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f191415db00 0x7f18fc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.879+0000 7f1919600640 1 -- 172.21.15.175:0/1236847026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18fc004810 msgr2=0x7f18fc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:40.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.879+0000 7f1919600640 1 --2- 172.21.15.175:0/1236847026 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18fc004810 0x7f18fc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.879+0000 7f1919600640 1 -- 172.21.15.175:0/1236847026 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc003530 con 0x7f18fc0039c0 2024-04-25T09:08:40.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.879+0000 7f1919600640 1 --2- 172.21.15.175:0/1236847026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18fc0039c0 0x7f18fc003de0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f1908009ae0 tx=0x7f190801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da1949e1fc42c7e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:40.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.879+0000 7f1913e00640 1 -- 172.21.15.175:0/1236847026 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19080096b0 con 0x7f18fc0039c0 2024-04-25T09:08:40.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.879+0000 7f1913e00640 1 -- 172.21.15.175:0/1236847026 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19080a9470 con 0x7f18fc0039c0 2024-04-25T09:08:40.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.879+0000 7f1913e00640 1 -- 172.21.15.175:0/1236847026 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19080a9860 con 0x7f18fc0039c0 2024-04-25T09:08:40.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f191aa00640 1 -- 172.21.15.175:0/1236847026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18fc0039c0 msgr2=0x7f18fc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:40.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f191aa00640 1 --2- 172.21.15.175:0/1236847026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18fc0039c0 0x7f18fc003de0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f1908009ae0 tx=0x7f190801ca70 comp rx=0 tx=0).stop 2024-04-25T09:08:40.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f191a000640 1 -- 172.21.15.175:0/1236847026 reap_dead start 2024-04-25T09:08:40.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f191aa00640 1 -- 172.21.15.175:0/1236847026 shutdown_connections 2024-04-25T09:08:40.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f191aa00640 1 -- 172.21.15.175:0/1236847026 >> 172.21.15.175:0/1236847026 conn(0x7f19140cc780 msgr2=0x7f19140ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:40.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f191aa00640 1 -- 172.21.15.175:0/1236847026 shutdown_connections 2024-04-25T09:08:40.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f191aa00640 1 -- 172.21.15.175:0/1236847026 wait complete. 2024-04-25T09:08:40.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f191aa00640 1 Processor -- start 2024-04-25T09:08:40.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f191aa00640 1 -- start start 2024-04-25T09:08:40.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f191aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18fc0039c0 0x7f1914159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f191aa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f191415e0f0 0x7f191414c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f191aa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f191414c660 0x7f19141f6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f191aa00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19140cd590 con 0x7f18fc0039c0 2024-04-25T09:08:40.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f191aa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191406bae0 con 0x7f191414c660 2024-04-25T09:08:40.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f191aa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1914168730 con 0x7f191415e0f0 2024-04-25T09:08:40.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f1919600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18fc0039c0 0x7f1914159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f1919600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18fc0039c0 0x7f1914159ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49914/0 (socket says 172.21.15.175:49914) 2024-04-25T09:08:40.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f1919600640 1 -- 172.21.15.175:0/1170755958 learned_addr learned my addr 172.21.15.175:0/1170755958 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:40.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f191a000640 1 --2- 172.21.15.175:0/1170755958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f191414c660 0x7f19141f6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f1918c00640 1 --2- 172.21.15.175:0/1170755958 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f191415e0f0 0x7f191414c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f1919600640 1 -- 172.21.15.175:0/1170755958 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f191415e0f0 msgr2=0x7f191414c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:40.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f1919600640 1 --2- 172.21.15.175:0/1170755958 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f191415e0f0 0x7f191414c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f1919600640 1 -- 172.21.15.175:0/1170755958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f191414c660 msgr2=0x7f19141f6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:40.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f1919600640 1 --2- 172.21.15.175:0/1170755958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f191414c660 0x7f19141f6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:40.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f1919600640 1 -- 172.21.15.175:0/1170755958 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191414cdb0 con 0x7f18fc0039c0 2024-04-25T09:08:40.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.883+0000 7f1919600640 1 --2- 172.21.15.175:0/1170755958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18fc0039c0 0x7f1914159ae0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f1908009ae0 tx=0x7f18fc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:40.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.887+0000 7f1911600640 1 -- 172.21.15.175:0/1170755958 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19080c1070 con 0x7f18fc0039c0 2024-04-25T09:08:40.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.887+0000 7f1911600640 1 -- 172.21.15.175:0/1170755958 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190800f000 con 0x7f18fc0039c0 2024-04-25T09:08:40.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.887+0000 7f191aa00640 1 -- 172.21.15.175:0/1170755958 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1914165ae0 con 0x7f18fc0039c0 2024-04-25T09:08:40.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.887+0000 7f1911600640 1 -- 172.21.15.175:0/1170755958 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19080096b0 con 0x7f18fc0039c0 2024-04-25T09:08:40.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.887+0000 7f191aa00640 1 -- 172.21.15.175:0/1170755958 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1914166060 con 0x7f18fc0039c0 2024-04-25T09:08:40.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.887+0000 7f191aa00640 1 -- 172.21.15.175:0/1170755958 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19140b49b0 con 0x7f18fc0039c0 2024-04-25T09:08:40.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.887+0000 7f1911600640 1 -- 172.21.15.175:0/1170755958 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f19080c4070 con 0x7f18fc0039c0 2024-04-25T09:08:40.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.887+0000 7f1911600640 1 --2- 172.21.15.175:0/1170755958 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f18f4066f60 0x7f18f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:40.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.887+0000 7f1911600640 1 -- 172.21.15.175:0/1170755958 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f190811f220 con 0x7f18fc0039c0 2024-04-25T09:08:40.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.887+0000 7f1918c00640 1 --2- 172.21.15.175:0/1170755958 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f18f4066f60 0x7f18f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:40.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.887+0000 7f1918c00640 1 --2- 172.21.15.175:0/1170755958 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f18f4066f60 0x7f18f4069420 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1900009b00 tx=0x7f1900009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:40.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:40.891+0000 7f1911600640 1 -- 172.21.15.175:0/1170755958 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f191414cdb0 con 0x7f18fc0039c0 2024-04-25T09:08:41.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.059+0000 7f191aa00640 1 -- 172.21.15.175:0/1170755958 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f19140b46d0 con 0x7f18fc0039c0 2024-04-25T09:08:41.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.059+0000 7f1911600640 1 -- 172.21.15.175:0/1170755958 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v70) v1 ==== 80+0+124 (secure 0 0 0) 0x7f19080ad020 con 0x7f18fc0039c0 2024-04-25T09:08:41.050 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.177:6835/1709110121 2024-04-26T09:08:32.433027+0000 2024-04-25T09:08:41.050 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.177:6833/1709110121 2024-04-26T09:08:32.433027+0000 2024-04-25T09:08:41.050 INFO:teuthology.orchestra.run.smithi175.stderr:listed 2 entries 2024-04-25T09:08:41.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.063+0000 7f191aa00640 1 -- 172.21.15.175:0/1170755958 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f18f4066f60 msgr2=0x7f18f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.063+0000 7f191aa00640 1 --2- 172.21.15.175:0/1170755958 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f18f4066f60 0x7f18f4069420 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1900009b00 tx=0x7f1900009190 comp rx=0 tx=0).stop 2024-04-25T09:08:41.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.063+0000 7f191aa00640 1 -- 172.21.15.175:0/1170755958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18fc0039c0 msgr2=0x7f1914159ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.063+0000 7f191aa00640 1 --2- 172.21.15.175:0/1170755958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18fc0039c0 0x7f1914159ae0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f1908009ae0 tx=0x7f18fc005840 comp rx=0 tx=0).stop 2024-04-25T09:08:41.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.063+0000 7f191aa00640 1 -- 172.21.15.175:0/1170755958 shutdown_connections 2024-04-25T09:08:41.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.063+0000 7f191aa00640 1 --2- 172.21.15.175:0/1170755958 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f18f4066f60 0x7f18f4069420 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.063+0000 7f191aa00640 1 --2- 172.21.15.175:0/1170755958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f191414c660 0x7f19141f6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.063+0000 7f191aa00640 1 --2- 172.21.15.175:0/1170755958 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f191415e0f0 0x7f191414c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.063+0000 7f191aa00640 1 --2- 172.21.15.175:0/1170755958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18fc0039c0 0x7f1914159ae0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.063+0000 7f191aa00640 1 -- 172.21.15.175:0/1170755958 >> 172.21.15.175:0/1170755958 conn(0x7f19140cc780 msgr2=0x7f191415ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:41.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.063+0000 7f191aa00640 1 -- 172.21.15.175:0/1170755958 shutdown_connections 2024-04-25T09:08:41.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.063+0000 7f191aa00640 1 -- 172.21.15.175:0/1170755958 wait complete. 2024-04-25T09:08:41.071 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:08:41.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:41.072 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:08:41.097 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:08:41.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:41.097 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:08:41.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:41.154 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir recursive 2024-04-25T09:08:41.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.339+0000 7fb7c0a00640 1 Processor -- start 2024-04-25T09:08:41.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.339+0000 7fb7c0a00640 1 -- start start 2024-04-25T09:08:41.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.343+0000 7fb7c0a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb7bc0b2700 0x7fb7bc0b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.343+0000 7fb7c0a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7bc15b880 con 0x7fb7bc0aebd0 2024-04-25T09:08:41.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.343+0000 7fb7c0a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7bc15bb60 con 0x7fb7bc0b47a0 2024-04-25T09:08:41.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.343+0000 7fb7c0a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc0b4c10 con 0x7fb7bc0b2700 2024-04-25T09:08:41.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.343+0000 7fb7b1400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb7bc0b2700 0x7fb7bc0b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.343+0000 7fb7b9e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb7bc0aebd0 0x7fb7bc15b030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:43284/0 (socket says 172.21.15.175:43284) 2024-04-25T09:08:41.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.343+0000 7fb7b1400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb7bc0b2700 0x7fb7bc0b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49930/0 (socket says 172.21.15.175:49930) 2024-04-25T09:08:41.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.343+0000 7fb7b9e00640 1 -- 172.21.15.175:0/1728038119 learned_addr learned my addr 172.21.15.175:0/1728038119 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:41.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.343+0000 7fb7b1400640 1 -- 172.21.15.175:0/1728038119 >> v1:172.21.15.177:6789/0 conn(0x7fb7bc0b47a0 legacy=0x7fb7bc15c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.343+0000 7fb7b1400640 1 -- 172.21.15.175:0/1728038119 >> v1:172.21.15.175:6789/0 conn(0x7fb7bc0aebd0 legacy=0x7fb7bc15b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.343+0000 7fb7b1400640 1 -- 172.21.15.175:0/1728038119 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc15be40 con 0x7fb7bc0b2700 2024-04-25T09:08:41.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.343+0000 7fb7b9400640 1 -- 172.21.15.175:0/1728038119 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022382523 0 0) 0x7fb7bc15b880 con 0x7fb7bc0aebd0 2024-04-25T09:08:41.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.343+0000 7fb7b1400640 1 --2- 172.21.15.175:0/1728038119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7bc0b2700 0x7fb7bc0b4260 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40097c0 tx=0x7fb7a401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc69b9fd10d4517 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:41.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7b9400640 1 -- 172.21.15.175:0/1728038119 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a40b1070 con 0x7fb7bc0b2700 2024-04-25T09:08:41.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7b9400640 1 -- 172.21.15.175:0/1728038119 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc0af1c0 con 0x7fb7bc0b2700 2024-04-25T09:08:41.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7b9400640 1 -- 172.21.15.175:0/1728038119 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a40ac630 con 0x7fb7bc0b2700 2024-04-25T09:08:41.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7c0a00640 1 -- 172.21.15.175:0/1728038119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7bc0b2700 msgr2=0x7fb7bc0b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7c0a00640 1 --2- 172.21.15.175:0/1728038119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7bc0b2700 0x7fb7bc0b4260 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40097c0 tx=0x7fb7a401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7c0a00640 1 -- 172.21.15.175:0/1728038119 shutdown_connections 2024-04-25T09:08:41.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7c0a00640 1 --2- 172.21.15.175:0/1728038119 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7bc0b2700 0x7fb7bc0b4260 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7c0a00640 1 -- 172.21.15.175:0/1728038119 >> 172.21.15.175:0/1728038119 conn(0x7fb7bc06ac50 msgr2=0x7fb7bc06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:41.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7c0a00640 1 -- 172.21.15.175:0/1728038119 shutdown_connections 2024-04-25T09:08:41.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7c0a00640 1 -- 172.21.15.175:0/1728038119 wait complete. 2024-04-25T09:08:41.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7c0a00640 1 Processor -- start 2024-04-25T09:08:41.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7c0a00640 1 -- start start 2024-04-25T09:08:41.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7c0a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7bc0aebd0 0x7fb7bc152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7c0a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc0b2700 0x7fb7bc0b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7c0a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7bc0b47a0 0x7fb7bc0b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7c0a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc15dc10 con 0x7fb7bc0aebd0 2024-04-25T09:08:41.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7c0a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc15da90 con 0x7fb7bc0b2700 2024-04-25T09:08:41.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7c0a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc168680 con 0x7fb7bc0b47a0 2024-04-25T09:08:41.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7b9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7bc0aebd0 0x7fb7bc152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7b9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7bc0aebd0 0x7fb7bc152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49940/0 (socket says 172.21.15.175:49940) 2024-04-25T09:08:41.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.347+0000 7fb7b9e00640 1 -- 172.21.15.175:0/2493407896 learned_addr learned my addr 172.21.15.175:0/2493407896 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:41.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7ba800640 1 --2- 172.21.15.175:0/2493407896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7bc0b47a0 0x7fb7bc0b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7b1400640 1 --2- 172.21.15.175:0/2493407896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc0b2700 0x7fb7bc0b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7b9e00640 1 -- 172.21.15.175:0/2493407896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7bc0b47a0 msgr2=0x7fb7bc0b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7b9e00640 1 --2- 172.21.15.175:0/2493407896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7bc0b47a0 0x7fb7bc0b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7b9e00640 1 -- 172.21.15.175:0/2493407896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc0b2700 msgr2=0x7fb7bc0b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7b9e00640 1 --2- 172.21.15.175:0/2493407896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc0b2700 0x7fb7bc0b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7b9e00640 1 -- 172.21.15.175:0/2493407896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc0af700 con 0x7fb7bc0aebd0 2024-04-25T09:08:41.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7b1400640 1 --2- 172.21.15.175:0/2493407896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc0b2700 0x7fb7bc0b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:41.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7ba800640 1 --2- 172.21.15.175:0/2493407896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7bc0b47a0 0x7fb7bc0b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:41.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7b9e00640 1 --2- 172.21.15.175:0/2493407896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7bc0aebd0 0x7fb7bc152b90 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00c410 tx=0x7fb7ac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:41.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7b2a00640 1 -- 172.21.15.175:0/2493407896 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac0074e0 con 0x7fb7bc0aebd0 2024-04-25T09:08:41.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7b2a00640 1 -- 172.21.15.175:0/2493407896 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ac0047f0 con 0x7fb7bc0aebd0 2024-04-25T09:08:41.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7c0a00640 1 -- 172.21.15.175:0/2493407896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7bc1530d0 con 0x7fb7bc0aebd0 2024-04-25T09:08:41.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7b2a00640 1 -- 172.21.15.175:0/2493407896 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac007680 con 0x7fb7bc0aebd0 2024-04-25T09:08:41.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7c0a00640 1 -- 172.21.15.175:0/2493407896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7bc0afc80 con 0x7fb7bc0aebd0 2024-04-25T09:08:41.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7b2a00640 1 -- 172.21.15.175:0/2493407896 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb7ac011070 con 0x7fb7bc0aebd0 2024-04-25T09:08:41.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7b2a00640 1 --2- 172.21.15.175:0/2493407896 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb798066f60 0x7fb798069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7b2a00640 1 -- 172.21.15.175:0/2493407896 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb7ac084c00 con 0x7fb7bc0aebd0 2024-04-25T09:08:41.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.351+0000 7fb7b1400640 1 --2- 172.21.15.175:0/2493407896 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb798066f60 0x7fb798069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 Processor -- start 2024-04-25T09:08:41.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 -- start start 2024-04-25T09:08:41.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7b1400640 1 --2- 172.21.15.175:0/2493407896 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb798066f60 0x7fb798069420 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40ae000 tx=0x7fb7a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:41.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fec8c0 0x55a4b1fecca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fed1e0 0x55a4b1fa2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fa2650 0x55a4b1fa2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4b1df0dd0 con 0x55a4b1fec8c0 2024-04-25T09:08:41.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4b1d79010 con 0x55a4b1fed1e0 2024-04-25T09:08:41.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a4b1dece70 con 0x55a4b1fa2650 2024-04-25T09:08:41.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7b9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fec8c0 0x55a4b1fecca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7b9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fec8c0 0x55a4b1fecca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49952/0 (socket says 172.21.15.175:49952) 2024-04-25T09:08:41.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7b9e00640 1 -- 172.21.15.175:0/546734102 learned_addr learned my addr 172.21.15.175:0/546734102 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:41.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7b1400640 1 --2- 172.21.15.175:0/546734102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fed1e0 0x55a4b1fa2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7ba800640 1 --2- 172.21.15.175:0/546734102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fa2650 0x55a4b1fa2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7b9e00640 1 -- 172.21.15.175:0/546734102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fa2650 msgr2=0x55a4b1fa2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7b9e00640 1 --2- 172.21.15.175:0/546734102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fa2650 0x55a4b1fa2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7b9e00640 1 -- 172.21.15.175:0/546734102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fed1e0 msgr2=0x55a4b1fa2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7b9e00640 1 --2- 172.21.15.175:0/546734102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fed1e0 0x55a4b1fa2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7b9e00640 1 -- 172.21.15.175:0/546734102 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4b1da99c0 con 0x55a4b1fec8c0 2024-04-25T09:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7b9e00640 1 --2- 172.21.15.175:0/546734102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fec8c0 0x55a4b1fecca0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00c3e0 tx=0x7fb7ac055d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d102c07ad36385f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7aaa00640 1 -- 172.21.15.175:0/546734102 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac05dc50 con 0x55a4b1fec8c0 2024-04-25T09:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7aaa00640 1 -- 172.21.15.175:0/546734102 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ac053840 con 0x55a4b1fec8c0 2024-04-25T09:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7aaa00640 1 -- 172.21.15.175:0/546734102 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac051bb0 con 0x55a4b1fec8c0 2024-04-25T09:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 -- 172.21.15.175:0/546734102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fec8c0 msgr2=0x55a4b1fecca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/546734102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fec8c0 0x55a4b1fecca0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00c3e0 tx=0x7fb7ac055d80 comp rx=0 tx=0).stop 2024-04-25T09:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 -- 172.21.15.175:0/546734102 shutdown_connections 2024-04-25T09:08:41.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/546734102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fa2650 0x55a4b1fa2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/546734102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fed1e0 0x55a4b1fa2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/546734102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fec8c0 0x55a4b1fecca0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 -- 172.21.15.175:0/546734102 >> 172.21.15.175:0/546734102 conn(0x55a4b1e8a870 msgr2=0x55a4b1fa09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 -- 172.21.15.175:0/546734102 shutdown_connections 2024-04-25T09:08:41.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 -- 172.21.15.175:0/546734102 wait complete. 2024-04-25T09:08:41.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 -- start start 2024-04-25T09:08:41.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.355+0000 7fb7c3f15000 1 Processor -- start 2024-04-25T09:08:41.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7c3f15000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fa2650 0x55a4b1fa6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7c3f15000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fec8c0 0x55a4b1fa74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7c3f15000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fed1e0 0x55a4b1fa79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7c3f15000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4b1dab420 con 0x55a4b1fa2650 2024-04-25T09:08:41.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7c3f15000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4b1e53000 con 0x55a4b1fec8c0 2024-04-25T09:08:41.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7c3f15000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a4b1d97ae0 con 0x55a4b1fed1e0 2024-04-25T09:08:41.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7c3f15000 10 client.0 _ll_register_callbacks cb 0x55a4b1f8df90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:41.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7b9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fa2650 0x55a4b1fa6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7b9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fa2650 0x55a4b1fa6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49954/0 (socket says 172.21.15.175:49954) 2024-04-25T09:08:41.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7b9e00640 1 -- 172.21.15.175:0/3786207443 learned_addr learned my addr 172.21.15.175:0/3786207443 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:41.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7ba800640 1 --2- 172.21.15.175:0/3786207443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fed1e0 0x55a4b1fa79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7b1400640 1 --2- 172.21.15.175:0/3786207443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fec8c0 0x55a4b1fa74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7b9e00640 1 -- 172.21.15.175:0/3786207443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fed1e0 msgr2=0x55a4b1fa79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7b9e00640 1 --2- 172.21.15.175:0/3786207443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fed1e0 0x55a4b1fa79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7b9e00640 1 -- 172.21.15.175:0/3786207443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fec8c0 msgr2=0x55a4b1fa74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7b9e00640 1 --2- 172.21.15.175:0/3786207443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fec8c0 0x55a4b1fa74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7b9e00640 1 -- 172.21.15.175:0/3786207443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a4b1d79260 con 0x55a4b1fa2650 2024-04-25T09:08:41.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7b9e00640 1 --2- 172.21.15.175:0/3786207443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fa2650 0x55a4b1fa6f60 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0554d0 tx=0x7fb7ac000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ebf7141fa4d3cec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:41.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7a3400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:08:41.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7a3400640 1 -- 172.21.15.175:0/3786207443 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ac05d9c0 con 0x55a4b1fa2650 2024-04-25T09:08:41.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7a3400640 1 -- 172.21.15.175:0/3786207443 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb7ac054990 con 0x55a4b1fa2650 2024-04-25T09:08:41.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7c3f15000 1 -- 172.21.15.175:0/3786207443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb7ac053840 con 0x55a4b1fa2650 2024-04-25T09:08:41.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7a3400640 1 -- 172.21.15.175:0/3786207443 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7ac054b90 con 0x55a4b1fa2650 2024-04-25T09:08:41.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7c3f15000 10 client.6858 fetch_fsmap learned FSMap version 49 2024-04-25T09:08:41.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7c3f15000 1 -- 172.21.15.175:0/3786207443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55a4b1dabb30 con 0x55a4b1fa2650 2024-04-25T09:08:41.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7a3400640 1 -- 172.21.15.175:0/3786207443 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ac053840 con 0x55a4b1fa2650 2024-04-25T09:08:41.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7a3400640 1 -- 172.21.15.175:0/3786207443 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 49) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb7ac059150 con 0x55a4b1fa2650 2024-04-25T09:08:41.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7c3f15000 10 client.6858 fetch_fsmap finished waiting for FSMap version 49 2024-04-25T09:08:41.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7c3f15000 10 client.6858 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:08:41.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7c3f15000 20 client.6858 populate_metadata read hostname 'smithi175' 2024-04-25T09:08:41.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/3786207443 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55a4b1fa83f0 0x55a4b1ffd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7c3f15000 4 client.6858 mds_command: new command op to 6513 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:08:41.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7c3f15000 1 -- 172.21.15.175:0/3786207443 --> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a4b1d8cc80 con 0x55a4b1fa83f0 2024-04-25T09:08:41.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7b1400640 1 --2- 172.21.15.175:0/3786207443 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55a4b1fa83f0 0x55a4b1ffd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7b1400640 1 --2- 172.21.15.175:0/3786207443 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55a4b1fa83f0 0x55a4b1ffd960 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e917284cba548cd7 server_cookie=9190a9031a4fc4b9 in_seq=0 out_seq=0 2024-04-25T09:08:41.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7a3400640 10 client.6858 ms_handle_connect on v2:172.21.15.175:6834/2714482688 2024-04-25T09:08:41.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7a3400640 1 -- 172.21.15.175:0/3786207443 <== mds.0 v2:172.21.15.175:6834/2714482688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a4b1d8cc80 con 0x55a4b1fa83f0 2024-04-25T09:08:41.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7a3400640 10 client.6858 handle_command_reply: tid=0 2024-04-25T09:08:41.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.359+0000 7fb7c3f15000 1 client.6858 shutdown 2024-04-25T09:08:41.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.363+0000 7fb7c3f15000 1 -- 172.21.15.175:0/3786207443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fa2650 msgr2=0x55a4b1fa6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.363+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/3786207443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fa2650 0x55a4b1fa6f60 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac0554d0 tx=0x7fb7ac000ee0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.363+0000 7fb7c3f15000 1 -- 172.21.15.175:0/3786207443 shutdown_connections 2024-04-25T09:08:41.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.363+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/3786207443 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55a4b1fa83f0 0x55a4b1ffd960 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.363+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/3786207443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fed1e0 0x55a4b1fa79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.363+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/3786207443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fec8c0 0x55a4b1fa74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.363+0000 7fb7a3400640 0 client.6858 ms_handle_reset on v2:172.21.15.175:6834/2714482688 2024-04-25T09:08:41.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.363+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/3786207443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fa2650 0x55a4b1fa6f60 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.363+0000 7fb7c3f15000 1 -- 172.21.15.175:0/3786207443 >> 172.21.15.175:0/3786207443 conn(0x55a4b1e8a870 msgr2=0x55a4b1fa09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:41.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.363+0000 7fb7c3f15000 1 -- 172.21.15.175:0/3786207443 shutdown_connections 2024-04-25T09:08:41.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.363+0000 7fb7c3f15000 1 -- 172.21.15.175:0/3786207443 wait complete. 2024-04-25T09:08:41.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.363+0000 7fb7c3f15000 20 client.6858 trim_cache size 0 max 16384 2024-04-25T09:08:41.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.375+0000 7fb7c3f15000 1 Processor -- start 2024-04-25T09:08:41.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.375+0000 7fb7c3f15000 1 -- start start 2024-04-25T09:08:41.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.375+0000 7fb7c3f15000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fa2650 0x55a4b1ffc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.375+0000 7fb7c3f15000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fec8c0 0x55a4b1ffcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fed1e0 0x55a4b1ffd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0cf200 con 0x55a4b1fed1e0 2024-04-25T09:08:41.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0ce600 con 0x55a4b1fa2650 2024-04-25T09:08:41.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0cec00 con 0x55a4b1fec8c0 2024-04-25T09:08:41.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7ba800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fed1e0 0x55a4b1ffd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7ba800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fed1e0 0x55a4b1ffd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49962/0 (socket says 172.21.15.175:49962) 2024-04-25T09:08:41.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7ba800640 1 -- 172.21.15.175:0/3861141317 learned_addr learned my addr 172.21.15.175:0/3861141317 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:41.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7b1400640 1 --2- 172.21.15.175:0/3861141317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fec8c0 0x55a4b1ffcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7b9e00640 1 --2- 172.21.15.175:0/3861141317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fa2650 0x55a4b1ffc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.369 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7ba800640 1 -- 172.21.15.175:0/3861141317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fec8c0 msgr2=0x55a4b1ffcea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7ba800640 1 --2- 172.21.15.175:0/3861141317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fec8c0 0x55a4b1ffcea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7ba800640 1 -- 172.21.15.175:0/3861141317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fa2650 msgr2=0x55a4b1ffc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7ba800640 1 --2- 172.21.15.175:0/3861141317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fa2650 0x55a4b1ffc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7ba800640 1 -- 172.21.15.175:0/3861141317 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4b1e766d0 con 0x55a4b1fed1e0 2024-04-25T09:08:41.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7ba800640 1 --2- 172.21.15.175:0/3861141317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fed1e0 0x55a4b1ffd3e0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fb7b40053d0 tx=0x7fb7b4005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4f0b28f5920540 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:41.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7aa000640 1 -- 172.21.15.175:0/3861141317 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4006b60 con 0x55a4b1fed1e0 2024-04-25T09:08:41.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7aa000640 1 -- 172.21.15.175:0/3861141317 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b4006d00 con 0x55a4b1fed1e0 2024-04-25T09:08:41.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7aa000640 1 -- 172.21.15.175:0/3861141317 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4011bc0 con 0x55a4b1fed1e0 2024-04-25T09:08:41.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 -- 172.21.15.175:0/3861141317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fed1e0 msgr2=0x55a4b1ffd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/3861141317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fed1e0 0x55a4b1ffd3e0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fb7b40053d0 tx=0x7fb7b4005890 comp rx=0 tx=0).stop 2024-04-25T09:08:41.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 -- 172.21.15.175:0/3861141317 shutdown_connections 2024-04-25T09:08:41.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/3861141317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fed1e0 0x55a4b1ffd3e0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/3861141317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fec8c0 0x55a4b1ffcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/3861141317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fa2650 0x55a4b1ffc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 -- 172.21.15.175:0/3861141317 >> 172.21.15.175:0/3861141317 conn(0x55a4b1e8a870 msgr2=0x55a4b1feb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:41.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 -- 172.21.15.175:0/3861141317 shutdown_connections 2024-04-25T09:08:41.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 -- 172.21.15.175:0/3861141317 wait complete. 2024-04-25T09:08:41.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 -- start start 2024-04-25T09:08:41.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 Processor -- start 2024-04-25T09:08:41.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fa2650 0x55a4b204d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fec8c0 0x55a4b204d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fed1e0 0x55a4b20073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4b1df00e0 con 0x55a4b1fec8c0 2024-04-25T09:08:41.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4b1e73470 con 0x55a4b1fa2650 2024-04-25T09:08:41.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a4b1fabc20 con 0x55a4b1fed1e0 2024-04-25T09:08:41.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.379+0000 7fb7c3f15000 10 client.0 _ll_register_callbacks cb 0x55a4b1d8d200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:41.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7ba800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fed1e0 0x55a4b20073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7b9e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fa2650 0x55a4b204d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7b1400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fec8c0 0x55a4b204d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7b9e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fa2650 0x55a4b204d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:49676/0 (socket says 172.21.15.175:49676) 2024-04-25T09:08:41.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7b1400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fec8c0 0x55a4b204d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49964/0 (socket says 172.21.15.175:49964) 2024-04-25T09:08:41.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7ba800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fed1e0 0x55a4b20073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:35212/0 (socket says 172.21.15.175:35212) 2024-04-25T09:08:41.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7b9e00640 1 -- 172.21.15.175:0/2923002883 learned_addr learned my addr 172.21.15.175:0/2923002883 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:41.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7b1400640 1 -- 172.21.15.175:0/2923002883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fed1e0 msgr2=0x55a4b20073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7b1400640 1 --2- 172.21.15.175:0/2923002883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fed1e0 0x55a4b20073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7b1400640 1 -- 172.21.15.175:0/2923002883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fa2650 msgr2=0x55a4b204d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7b1400640 1 --2- 172.21.15.175:0/2923002883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fa2650 0x55a4b204d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7b1400640 1 -- 172.21.15.175:0/2923002883 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a4b1e73900 con 0x55a4b1fec8c0 2024-04-25T09:08:41.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7b1400640 1 --2- 172.21.15.175:0/2923002883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fec8c0 0x55a4b204d650 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40ac000 tx=0x7fb7a40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a30291c3713103 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:41.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7a3400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:08:41.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7a3400640 1 -- 172.21.15.175:0/2923002883 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a40ce030 con 0x55a4b1fec8c0 2024-04-25T09:08:41.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7a3400640 1 -- 172.21.15.175:0/2923002883 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb7a40a9040 con 0x55a4b1fec8c0 2024-04-25T09:08:41.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 1 -- 172.21.15.175:0/2923002883 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb7b4006d00 con 0x55a4b1fec8c0 2024-04-25T09:08:41.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7a3400640 1 -- 172.21.15.175:0/2923002883 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7a40da050 con 0x55a4b1fec8c0 2024-04-25T09:08:41.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 10 client.6864 fetch_fsmap learned FSMap version 49 2024-04-25T09:08:41.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 1 -- 172.21.15.175:0/2923002883 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x55a4b1d97f20 con 0x55a4b1fec8c0 2024-04-25T09:08:41.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7a3400640 1 -- 172.21.15.175:0/2923002883 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b4006d00 con 0x55a4b1fec8c0 2024-04-25T09:08:41.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7a3400640 1 -- 172.21.15.175:0/2923002883 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 49) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb7a40dd020 con 0x55a4b1fec8c0 2024-04-25T09:08:41.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 10 client.6864 fetch_fsmap finished waiting for FSMap version 49 2024-04-25T09:08:41.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 10 client.6864 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:08:41.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 20 client.6864 populate_metadata read hostname 'smithi175' 2024-04-25T09:08:41.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/2923002883 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55a4b20080c0 0x55a4b20084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 4 client.6864 mds_command: new command op to 6513 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}] 2024-04-25T09:08:41.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 1 -- 172.21.15.175:0/2923002883 --> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}) v1 -- 0x55a4b1dfe310 con 0x55a4b20080c0 2024-04-25T09:08:41.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7b9e00640 1 --2- 172.21.15.175:0/2923002883 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55a4b20080c0 0x55a4b20084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7b9e00640 1 --2- 172.21.15.175:0/2923002883 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55a4b20080c0 0x55a4b20084d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afc7c2f18882afce server_cookie=46d284a8b2bde173 in_seq=0 out_seq=0 2024-04-25T09:08:41.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7a3400640 10 client.6864 ms_handle_connect on v2:172.21.15.175:6834/2714482688 2024-04-25T09:08:41.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7a3400640 1 -- 172.21.15.175:0/2923002883 <== mds.0 v2:172.21.15.175:6834/2714482688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a4b1dfe310 con 0x55a4b20080c0 2024-04-25T09:08:41.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7a3400640 10 client.6864 handle_command_reply: tid=0 2024-04-25T09:08:41.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 1 client.6864 shutdown 2024-04-25T09:08:41.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 1 -- 172.21.15.175:0/2923002883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fec8c0 msgr2=0x55a4b204d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/2923002883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fec8c0 0x55a4b204d650 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40ac000 tx=0x7fb7a40046d0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 1 -- 172.21.15.175:0/2923002883 shutdown_connections 2024-04-25T09:08:41.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/2923002883 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55a4b20080c0 0x55a4b20084d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/2923002883 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55a4b1fed1e0 0x55a4b20073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7a3400640 0 client.6864 ms_handle_reset on v2:172.21.15.175:6834/2714482688 2024-04-25T09:08:41.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/2923002883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55a4b1fec8c0 0x55a4b204d650 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 1 --2- 172.21.15.175:0/2923002883 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55a4b1fa2650 0x55a4b204d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 1 -- 172.21.15.175:0/2923002883 >> 172.21.15.175:0/2923002883 conn(0x55a4b1e8a870 msgr2=0x55a4b1febf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:41.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 1 -- 172.21.15.175:0/2923002883 shutdown_connections 2024-04-25T09:08:41.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.383+0000 7fb7c3f15000 1 -- 172.21.15.175:0/2923002883 wait complete. 2024-04-25T09:08:41.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.387+0000 7fb7c3f15000 20 client.6864 trim_cache size 0 max 16384 2024-04-25T09:08:41.380 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:08:41.380 INFO:teuthology.orchestra.run.smithi175.stdout: "return_code": 0, 2024-04-25T09:08:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_tag": "2445b356-4116-4af3-9237-759b33dd11ff", 2024-04-25T09:08:41.381 INFO:teuthology.orchestra.run.smithi175.stdout: "mode": "asynchronous" 2024-04-25T09:08:41.381 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:08:41.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.387+0000 7fb7c0a00640 1 -- 172.21.15.175:0/2493407896 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb798066f60 msgr2=0x7fb798069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.387+0000 7fb7c0a00640 1 --2- 172.21.15.175:0/2493407896 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb798066f60 0x7fb798069420 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40ae000 tx=0x7fb7a4008040 comp rx=0 tx=0).stop 2024-04-25T09:08:41.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.387+0000 7fb7c0a00640 1 -- 172.21.15.175:0/2493407896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7bc0aebd0 msgr2=0x7fb7bc152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.387+0000 7fb7c0a00640 1 --2- 172.21.15.175:0/2493407896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7bc0aebd0 0x7fb7bc152b90 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00c410 tx=0x7fb7ac00c8d0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.387+0000 7fb7c0a00640 1 -- 172.21.15.175:0/2493407896 shutdown_connections 2024-04-25T09:08:41.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.387+0000 7fb7c0a00640 1 --2- 172.21.15.175:0/2493407896 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb798066f60 0x7fb798069420 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.387+0000 7fb7c0a00640 1 --2- 172.21.15.175:0/2493407896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7bc0b47a0 0x7fb7bc0b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.387+0000 7fb7c0a00640 1 --2- 172.21.15.175:0/2493407896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7bc0b2700 0x7fb7bc0b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.387+0000 7fb7c0a00640 1 --2- 172.21.15.175:0/2493407896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7bc0aebd0 0x7fb7bc152b90 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.387+0000 7fb7c0a00640 1 -- 172.21.15.175:0/2493407896 >> 172.21.15.175:0/2493407896 conn(0x7fb7bc06ac50 msgr2=0x7fb7bc158c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:41.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.387+0000 7fb7c0a00640 1 -- 172.21.15.175:0/2493407896 shutdown_connections 2024-04-25T09:08:41.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.387+0000 7fb7c0a00640 1 -- 172.21.15.175:0/2493407896 wait complete. 2024-04-25T09:08:41.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:41.395 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T09:08:41.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.543+0000 7fa56b600640 1 Processor -- start 2024-04-25T09:08:41.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.543+0000 7fa56b600640 1 -- start start 2024-04-25T09:08:41.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.543+0000 7fa56b600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa56415af20 0x7fa5640b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.543+0000 7fa56b600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56406db60 con 0x7fa5640b4630 2024-04-25T09:08:41.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.543+0000 7fa56b600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56406de40 con 0x7fa5640cbe60 2024-04-25T09:08:41.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.543+0000 7fa56b600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5640b4aa0 con 0x7fa56415af20 2024-04-25T09:08:41.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.543+0000 7fa569600640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa5640b4630 0x7fa56415c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:43290/0 (socket says 172.21.15.175:43290) 2024-04-25T09:08:41.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.543+0000 7fa569600640 1 -- 172.21.15.175:0/2650145443 learned_addr learned my addr 172.21.15.175:0/2650145443 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:08:41.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.543+0000 7fa563e00640 1 -- 172.21.15.175:0/2650145443 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216345580 0 0) 0x7fa56406db60 con 0x7fa5640b4630 2024-04-25T09:08:41.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.543+0000 7fa55be00640 1 --2- 172.21.15.175:0/2650145443 >> v2:172.21.15.177:3300/0 conn(0x7fa56415af20 0x7fa5640b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.543+0000 7fa563e00640 1 -- 172.21.15.175:0/2650145443 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa548003530 con 0x7fa5640b4630 2024-04-25T09:08:41.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa563e00640 1 -- 172.21.15.175:0/2650145443 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4274089850 0 0) 0x7fa548003530 con 0x7fa5640b4630 2024-04-25T09:08:41.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa563e00640 1 -- 172.21.15.175:0/2650145443 >> v2:172.21.15.177:3300/0 conn(0x7fa56415af20 msgr2=0x7fa5640b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa563e00640 1 --2- 172.21.15.175:0/2650145443 >> v2:172.21.15.177:3300/0 conn(0x7fa56415af20 0x7fa5640b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa563e00640 1 -- 172.21.15.175:0/2650145443 >> v1:172.21.15.177:6789/0 conn(0x7fa5640cbe60 legacy=0x7fa56406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa563e00640 1 -- 172.21.15.175:0/2650145443 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56406e120 con 0x7fa5640b4630 2024-04-25T09:08:41.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa563e00640 1 -- 172.21.15.175:0/2650145443 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fa55c001a00 con 0x7fa5640b4630 2024-04-25T09:08:41.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa563e00640 1 -- 172.21.15.175:0/2650145443 >> v1:172.21.15.175:6789/0 conn(0x7fa5640b4630 legacy=0x7fa56415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa563e00640 1 --2- 172.21.15.175:0/2650145443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5480039c0 0x7fa548003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa563e00640 1 --2- 172.21.15.175:0/2650145443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa548004810 0x7fa548004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa563e00640 1 --2- 172.21.15.175:0/2650145443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5480051d0 0x7fa54800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa563e00640 1 -- 172.21.15.175:0/2650145443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5640b4aa0 con 0x7fa5480039c0 2024-04-25T09:08:41.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa563e00640 1 -- 172.21.15.175:0/2650145443 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54800e280 con 0x7fa5480051d0 2024-04-25T09:08:41.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa563e00640 1 -- 172.21.15.175:0/2650145443 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54800e480 con 0x7fa548004810 2024-04-25T09:08:41.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa568c00640 1 --2- 172.21.15.175:0/2650145443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5480039c0 0x7fa548003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa569600640 1 --2- 172.21.15.175:0/2650145443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5480051d0 0x7fa54800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa55be00640 1 --2- 172.21.15.175:0/2650145443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa548004810 0x7fa548004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa568c00640 1 -- 172.21.15.175:0/2650145443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa548004810 msgr2=0x7fa548004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa568c00640 1 --2- 172.21.15.175:0/2650145443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa548004810 0x7fa548004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa568c00640 1 -- 172.21.15.175:0/2650145443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5480051d0 msgr2=0x7fa54800dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa568c00640 1 --2- 172.21.15.175:0/2650145443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5480051d0 0x7fa54800dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa568c00640 1 -- 172.21.15.175:0/2650145443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa548003530 con 0x7fa5480039c0 2024-04-25T09:08:41.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa55be00640 1 --2- 172.21.15.175:0/2650145443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa548004810 0x7fa548004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:41.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa569600640 1 --2- 172.21.15.175:0/2650145443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5480051d0 0x7fa54800dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:41.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa569600640 1 -- 172.21.15.175:0/2650145443 reap_dead start 2024-04-25T09:08:41.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa568c00640 1 --2- 172.21.15.175:0/2650145443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5480039c0 0x7fa548003de0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fa554001780 tx=0x7fa55401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21473ca512c89d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:41.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa563e00640 1 -- 172.21.15.175:0/2650145443 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5540013a0 con 0x7fa5480039c0 2024-04-25T09:08:41.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa563e00640 1 -- 172.21.15.175:0/2650145443 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5540052f0 con 0x7fa5480039c0 2024-04-25T09:08:41.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.547+0000 7fa563e00640 1 -- 172.21.15.175:0/2650145443 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa554003840 con 0x7fa5480039c0 2024-04-25T09:08:41.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa56b600640 1 -- 172.21.15.175:0/2650145443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5480039c0 msgr2=0x7fa548003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa56b600640 1 --2- 172.21.15.175:0/2650145443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5480039c0 0x7fa548003de0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fa554001780 tx=0x7fa55401c400 comp rx=0 tx=0).stop 2024-04-25T09:08:41.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa56b600640 1 -- 172.21.15.175:0/2650145443 shutdown_connections 2024-04-25T09:08:41.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa56b600640 1 --2- 172.21.15.175:0/2650145443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5480039c0 0x7fa548003de0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa56b600640 1 -- 172.21.15.175:0/2650145443 >> 172.21.15.175:0/2650145443 conn(0x7fa56406ac50 msgr2=0x7fa56406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:41.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa56b600640 1 -- 172.21.15.175:0/2650145443 shutdown_connections 2024-04-25T09:08:41.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa56b600640 1 -- 172.21.15.175:0/2650145443 wait complete. 2024-04-25T09:08:41.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa56b600640 1 Processor -- start 2024-04-25T09:08:41.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa56b600640 1 -- start start 2024-04-25T09:08:41.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa56b600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5480039c0 0x7fa5640ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa56b600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5641540f0 0x7fa5640cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa56b600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5640cf720 0x7fa5640afb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa56b600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5640cc450 con 0x7fa5641540f0 2024-04-25T09:08:41.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa56b600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5640b2e70 con 0x7fa5640cf720 2024-04-25T09:08:41.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa56b600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5640b2ff0 con 0x7fa5480039c0 2024-04-25T09:08:41.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa55be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5641540f0 0x7fa5640cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa55be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5641540f0 0x7fa5640cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49978/0 (socket says 172.21.15.175:49978) 2024-04-25T09:08:41.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa55be00640 1 -- 172.21.15.175:0/2265376420 learned_addr learned my addr 172.21.15.175:0/2265376420 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:41.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa568c00640 1 --2- 172.21.15.175:0/2265376420 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5480039c0 0x7fa5640ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.551+0000 7fa569600640 1 --2- 172.21.15.175:0/2265376420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5640cf720 0x7fa5640afb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.555+0000 7fa55be00640 1 -- 172.21.15.175:0/2265376420 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5480039c0 msgr2=0x7fa5640ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.555+0000 7fa55be00640 1 --2- 172.21.15.175:0/2265376420 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5480039c0 0x7fa5640ace60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.555+0000 7fa55be00640 1 -- 172.21.15.175:0/2265376420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5640cf720 msgr2=0x7fa5640afb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.555+0000 7fa55be00640 1 --2- 172.21.15.175:0/2265376420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5640cf720 0x7fa5640afb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.555+0000 7fa55be00640 1 -- 172.21.15.175:0/2265376420 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5640cfca0 con 0x7fa5641540f0 2024-04-25T09:08:41.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.555+0000 7fa569600640 1 --2- 172.21.15.175:0/2265376420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5640cf720 0x7fa5640afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:41.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.555+0000 7fa55be00640 1 --2- 172.21.15.175:0/2265376420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5641540f0 0x7fa5640cf1e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa54c011510 tx=0x7fa54c0119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:41.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.555+0000 7fa561600640 1 -- 172.21.15.175:0/2265376420 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c004220 con 0x7fa5641540f0 2024-04-25T09:08:41.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.555+0000 7fa561600640 1 -- 172.21.15.175:0/2265376420 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c0043c0 con 0x7fa5641540f0 2024-04-25T09:08:41.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.555+0000 7fa561600640 1 -- 172.21.15.175:0/2265376420 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c015890 con 0x7fa5641540f0 2024-04-25T09:08:41.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.555+0000 7fa56b600640 1 -- 172.21.15.175:0/2265376420 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5640ac380 con 0x7fa5641540f0 2024-04-25T09:08:41.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.555+0000 7fa56b600640 1 -- 172.21.15.175:0/2265376420 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5640ad3a0 con 0x7fa5641540f0 2024-04-25T09:08:41.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.555+0000 7fa561600640 1 -- 172.21.15.175:0/2265376420 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa54c015a30 con 0x7fa5641540f0 2024-04-25T09:08:41.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.555+0000 7fa561600640 1 --2- 172.21.15.175:0/2265376420 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa540066f90 0x7fa540069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.555+0000 7fa561600640 1 -- 172.21.15.175:0/2265376420 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa54c085570 con 0x7fa5641540f0 2024-04-25T09:08:41.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.555+0000 7fa568c00640 1 --2- 172.21.15.175:0/2265376420 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa540066f90 0x7fa540069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa56eac3000 1 Processor -- start 2024-04-25T09:08:41.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa56eac3000 1 -- start start 2024-04-25T09:08:41.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa568c00640 1 --2- 172.21.15.175:0/2265376420 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa540066f90 0x7fa540069450 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa554001750 tx=0x7fa5540011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:41.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa56eac3000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 0x556393d54210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa56eac3000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d54750 0x556393d09f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa56eac3000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d0a4b0 0x556393d0a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa56eac3000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556393b52ff0 con 0x556393d0a4b0 2024-04-25T09:08:41.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa56eac3000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x556393adb150 con 0x556393d54750 2024-04-25T09:08:41.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa56eac3000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x556393b4f090 con 0x556393d53e30 2024-04-25T09:08:41.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa569600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d0a4b0 0x556393d0a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa569600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d0a4b0 0x556393d0a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49992/0 (socket says 172.21.15.175:49992) 2024-04-25T09:08:41.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa569600640 1 -- 172.21.15.175:0/2882631633 learned_addr learned my addr 172.21.15.175:0/2882631633 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:41.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa568c00640 1 --2- 172.21.15.175:0/2882631633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 0x556393d54210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa55be00640 1 --2- 172.21.15.175:0/2882631633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d54750 0x556393d09f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa569600640 1 -- 172.21.15.175:0/2882631633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 msgr2=0x556393d54210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa569600640 1 --2- 172.21.15.175:0/2882631633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 0x556393d54210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa569600640 1 -- 172.21.15.175:0/2882631633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d54750 msgr2=0x556393d09f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa569600640 1 --2- 172.21.15.175:0/2882631633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d54750 0x556393d09f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa569600640 1 -- 172.21.15.175:0/2882631633 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556393ce90d0 con 0x556393d0a4b0 2024-04-25T09:08:41.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa55be00640 1 --2- 172.21.15.175:0/2882631633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d54750 0x556393d09f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:41.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa569600640 1 --2- 172.21.15.175:0/2882631633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d0a4b0 0x556393d0a890 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fa56406bb60 tx=0x7fa55c005f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe965e0209964b81 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:41.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa559600640 1 -- 172.21.15.175:0/2882631633 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c007780 con 0x556393d0a4b0 2024-04-25T09:08:41.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa559600640 1 -- 172.21.15.175:0/2882631633 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c007920 con 0x556393d0a4b0 2024-04-25T09:08:41.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa559600640 1 -- 172.21.15.175:0/2882631633 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c014620 con 0x556393d0a4b0 2024-04-25T09:08:41.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa56eac3000 1 -- 172.21.15.175:0/2882631633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d0a4b0 msgr2=0x556393d0a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa56eac3000 1 --2- 172.21.15.175:0/2882631633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d0a4b0 0x556393d0a890 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fa56406bb60 tx=0x7fa55c005f50 comp rx=0 tx=0).stop 2024-04-25T09:08:41.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa56eac3000 1 -- 172.21.15.175:0/2882631633 shutdown_connections 2024-04-25T09:08:41.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa56eac3000 1 --2- 172.21.15.175:0/2882631633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d0a4b0 0x556393d0a890 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa56eac3000 1 --2- 172.21.15.175:0/2882631633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d54750 0x556393d09f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa56eac3000 1 --2- 172.21.15.175:0/2882631633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 0x556393d54210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa56eac3000 1 -- 172.21.15.175:0/2882631633 >> 172.21.15.175:0/2882631633 conn(0x556393d02020 msgr2=0x556393d04440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:41.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa56eac3000 1 -- 172.21.15.175:0/2882631633 shutdown_connections 2024-04-25T09:08:41.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa56eac3000 1 -- 172.21.15.175:0/2882631633 wait complete. 2024-04-25T09:08:41.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.559+0000 7fa56eac3000 1 -- start start 2024-04-25T09:08:41.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa56eac3000 1 Processor -- start 2024-04-25T09:08:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa56eac3000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d0a4b0 0x556393d537e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa56eac3000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 0x556393d10360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa56eac3000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 0x556393d108a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa56eac3000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556393b57620 con 0x556393d54750 2024-04-25T09:08:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa56eac3000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x556393b0d690 con 0x556393d0a4b0 2024-04-25T09:08:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa56eac3000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x556393adba40 con 0x556393d53e30 2024-04-25T09:08:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa56eac3000 10 client.0 _ll_register_callbacks cb 0x556393cf0e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa569600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 0x556393d108a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa569600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 0x556393d108a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50000/0 (socket says 172.21.15.175:50000) 2024-04-25T09:08:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa569600640 1 -- 172.21.15.175:0/3244635694 learned_addr learned my addr 172.21.15.175:0/3244635694 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa55be00640 1 --2- 172.21.15.175:0/3244635694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 0x556393d10360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa568c00640 1 --2- 172.21.15.175:0/3244635694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d0a4b0 0x556393d537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa569600640 1 -- 172.21.15.175:0/3244635694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 msgr2=0x556393d10360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa569600640 1 --2- 172.21.15.175:0/3244635694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 0x556393d10360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa569600640 1 -- 172.21.15.175:0/3244635694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d0a4b0 msgr2=0x556393d537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa569600640 1 --2- 172.21.15.175:0/3244635694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d0a4b0 0x556393d537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa569600640 1 -- 172.21.15.175:0/3244635694 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556393c001c0 con 0x556393d54750 2024-04-25T09:08:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa569600640 1 --2- 172.21.15.175:0/3244635694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 0x556393d108a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa55c000f90 tx=0x7fa56406e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7c2801c45cf573 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa552000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:08:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa552000640 1 -- 172.21.15.175:0/3244635694 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c023070 con 0x556393d54750 2024-04-25T09:08:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa552000640 1 -- 172.21.15.175:0/3244635694 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa55c014dc0 con 0x556393d54750 2024-04-25T09:08:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa56eac3000 1 -- 172.21.15.175:0/3244635694 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa55c007920 con 0x556393d54750 2024-04-25T09:08:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa552000640 1 -- 172.21.15.175:0/3244635694 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa55c02e050 con 0x556393d54750 2024-04-25T09:08:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa56eac3000 10 client.6876 fetch_fsmap learned FSMap version 49 2024-04-25T09:08:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa56eac3000 1 -- 172.21.15.175:0/3244635694 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x556393bfc170 con 0x556393d54750 2024-04-25T09:08:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa552000640 1 -- 172.21.15.175:0/3244635694 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c007920 con 0x556393d54750 2024-04-25T09:08:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa552000640 1 -- 172.21.15.175:0/3244635694 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 49) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa55c031020 con 0x556393d54750 2024-04-25T09:08:41.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa56eac3000 10 client.6876 fetch_fsmap finished waiting for FSMap version 49 2024-04-25T09:08:41.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa56eac3000 10 client.6876 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:08:41.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa56eac3000 20 client.6876 populate_metadata read hostname 'smithi175' 2024-04-25T09:08:41.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa56eac3000 1 --2- 172.21.15.175:0/3244635694 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x556393d11640 0x556393d660f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa56eac3000 4 client.6876 mds_command: new command op to 6513 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:08:41.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa56eac3000 1 -- 172.21.15.175:0/3244635694 --> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556393aeec60 con 0x556393d11640 2024-04-25T09:08:41.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa568c00640 1 --2- 172.21.15.175:0/3244635694 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x556393d11640 0x556393d660f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa568c00640 1 --2- 172.21.15.175:0/3244635694 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x556393d11640 0x556393d660f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4ca695056696968 server_cookie=81b18af3576f98d in_seq=0 out_seq=0 2024-04-25T09:08:41.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.563+0000 7fa552000640 10 client.6876 ms_handle_connect on v2:172.21.15.175:6834/2714482688 2024-04-25T09:08:41.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.567+0000 7fa552000640 1 -- 172.21.15.175:0/3244635694 <== mds.0 v2:172.21.15.175:6834/2714482688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556393aeec60 con 0x556393d11640 2024-04-25T09:08:41.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.567+0000 7fa552000640 10 client.6876 handle_command_reply: tid=0 2024-04-25T09:08:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.567+0000 7fa56eac3000 1 client.6876 shutdown 2024-04-25T09:08:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.567+0000 7fa56eac3000 1 -- 172.21.15.175:0/3244635694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 msgr2=0x556393d108a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.567+0000 7fa56eac3000 1 --2- 172.21.15.175:0/3244635694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 0x556393d108a0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa55c000f90 tx=0x7fa56406e010 comp rx=0 tx=0).stop 2024-04-25T09:08:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.567+0000 7fa56eac3000 1 -- 172.21.15.175:0/3244635694 shutdown_connections 2024-04-25T09:08:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.567+0000 7fa56eac3000 1 --2- 172.21.15.175:0/3244635694 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x556393d11640 0x556393d660f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.567+0000 7fa56eac3000 1 --2- 172.21.15.175:0/3244635694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 0x556393d108a0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.567+0000 7fa56eac3000 1 --2- 172.21.15.175:0/3244635694 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 0x556393d10360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.567+0000 7fa56eac3000 1 --2- 172.21.15.175:0/3244635694 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d0a4b0 0x556393d537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.567+0000 7fa552000640 0 client.6876 ms_handle_reset on v2:172.21.15.175:6834/2714482688 2024-04-25T09:08:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.567+0000 7fa56eac3000 1 -- 172.21.15.175:0/3244635694 >> 172.21.15.175:0/3244635694 conn(0x556393d02020 msgr2=0x556393d0b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.567+0000 7fa56eac3000 1 -- 172.21.15.175:0/3244635694 shutdown_connections 2024-04-25T09:08:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.567+0000 7fa56eac3000 1 -- 172.21.15.175:0/3244635694 wait complete. 2024-04-25T09:08:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.567+0000 7fa56eac3000 20 client.6876 trim_cache size 0 max 16384 2024-04-25T09:08:41.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.579+0000 7fa56eac3000 1 Processor -- start 2024-04-25T09:08:41.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.579+0000 7fa56eac3000 1 -- start start 2024-04-25T09:08:41.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa56eac3000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d0a4b0 0x556393d32d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa56eac3000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 0x556393d68110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa56eac3000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 0x556393d68650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa56eac3000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5641ff8a0 con 0x556393d54750 2024-04-25T09:08:41.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa56eac3000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5641feab0 con 0x556393d0a4b0 2024-04-25T09:08:41.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa56eac3000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5640ce1b0 con 0x556393d53e30 2024-04-25T09:08:41.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa569600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 0x556393d68650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa569600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 0x556393d68650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50014/0 (socket says 172.21.15.175:50014) 2024-04-25T09:08:41.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa569600640 1 -- 172.21.15.175:0/3085382769 learned_addr learned my addr 172.21.15.175:0/3085382769 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:41.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa55be00640 1 --2- 172.21.15.175:0/3085382769 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 0x556393d68110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa568c00640 1 --2- 172.21.15.175:0/3085382769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d0a4b0 0x556393d32d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa569600640 1 -- 172.21.15.175:0/3085382769 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 msgr2=0x556393d68110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa569600640 1 --2- 172.21.15.175:0/3085382769 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 0x556393d68110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa569600640 1 -- 172.21.15.175:0/3085382769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d0a4b0 msgr2=0x556393d32d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa569600640 1 --2- 172.21.15.175:0/3085382769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d0a4b0 0x556393d32d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa569600640 1 -- 172.21.15.175:0/3085382769 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556393b99de0 con 0x556393d54750 2024-04-25T09:08:41.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa568c00640 1 --2- 172.21.15.175:0/3085382769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d0a4b0 0x556393d32d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:41.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa569600640 1 --2- 172.21.15.175:0/3085382769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 0x556393d68650 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0019d0 tx=0x7fa55c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775d123321391e6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:41.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa558c00640 1 -- 172.21.15.175:0/3085382769 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c037070 con 0x556393d54750 2024-04-25T09:08:41.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa558c00640 1 -- 172.21.15.175:0/3085382769 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c007980 con 0x556393d54750 2024-04-25T09:08:41.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa558c00640 1 -- 172.21.15.175:0/3085382769 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c023040 con 0x556393d54750 2024-04-25T09:08:41.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa56eac3000 1 -- 172.21.15.175:0/3085382769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 msgr2=0x556393d68650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa56eac3000 1 --2- 172.21.15.175:0/3085382769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 0x556393d68650 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0019d0 tx=0x7fa55c01f000 comp rx=0 tx=0).stop 2024-04-25T09:08:41.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa56eac3000 1 -- 172.21.15.175:0/3085382769 shutdown_connections 2024-04-25T09:08:41.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa56eac3000 1 --2- 172.21.15.175:0/3085382769 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 0x556393d68650 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa56eac3000 1 --2- 172.21.15.175:0/3085382769 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 0x556393d68110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa56eac3000 1 --2- 172.21.15.175:0/3085382769 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d0a4b0 0x556393d32d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa56eac3000 1 -- 172.21.15.175:0/3085382769 >> 172.21.15.175:0/3085382769 conn(0x556393d02020 msgr2=0x556393d60b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:41.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa56eac3000 1 -- 172.21.15.175:0/3085382769 shutdown_connections 2024-04-25T09:08:41.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa56eac3000 1 -- 172.21.15.175:0/3085382769 wait complete. 2024-04-25T09:08:41.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa56eac3000 1 -- start start 2024-04-25T09:08:41.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.583+0000 7fa56eac3000 1 Processor -- start 2024-04-25T09:08:41.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d0a4b0 0x556393d660f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 0x556393d66630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 0x556393d66b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x556393aede00 con 0x556393d54750 2024-04-25T09:08:41.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5641fe5d0 con 0x556393d0a4b0 2024-04-25T09:08:41.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x556393b52300 con 0x556393d53e30 2024-04-25T09:08:41.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 10 client.0 _ll_register_callbacks cb 0x556393cd1040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:41.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa569600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 0x556393d66b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa569600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 0x556393d66b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50016/0 (socket says 172.21.15.175:50016) 2024-04-25T09:08:41.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa569600640 1 -- 172.21.15.175:0/2524503655 learned_addr learned my addr 172.21.15.175:0/2524503655 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:08:41.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa55be00640 1 --2- 172.21.15.175:0/2524503655 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 0x556393d66630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa568c00640 1 --2- 172.21.15.175:0/2524503655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d0a4b0 0x556393d660f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa569600640 1 -- 172.21.15.175:0/2524503655 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 msgr2=0x556393d66630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa569600640 1 --2- 172.21.15.175:0/2524503655 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 0x556393d66630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa569600640 1 -- 172.21.15.175:0/2524503655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d0a4b0 msgr2=0x556393d660f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:41.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa569600640 1 --2- 172.21.15.175:0/2524503655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d0a4b0 0x556393d660f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa569600640 1 -- 172.21.15.175:0/2524503655 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556393af48e0 con 0x556393d54750 2024-04-25T09:08:41.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa568c00640 1 --2- 172.21.15.175:0/2524503655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d0a4b0 0x556393d660f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:41.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa55be00640 1 --2- 172.21.15.175:0/2524503655 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 0x556393d66630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:41.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa569600640 1 --2- 172.21.15.175:0/2524503655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 0x556393d66b70 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0019d0 tx=0x7fa55c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639b8926e226070b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:41.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa552000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:08:41.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa552000640 1 -- 172.21.15.175:0/2524503655 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c037040 con 0x556393d54750 2024-04-25T09:08:41.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa552000640 1 -- 172.21.15.175:0/2524503655 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(70..70 src has 1..70) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa55c01fc50 con 0x556393d54750 2024-04-25T09:08:41.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 -- 172.21.15.175:0/2524503655 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa55c007980 con 0x556393d54750 2024-04-25T09:08:41.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa552000640 1 -- 172.21.15.175:0/2524503655 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa55c023040 con 0x556393d54750 2024-04-25T09:08:41.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 10 client.6882 fetch_fsmap learned FSMap version 49 2024-04-25T09:08:41.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 -- 172.21.15.175:0/2524503655 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x556393bac8f0 con 0x556393d54750 2024-04-25T09:08:41.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa552000640 1 -- 172.21.15.175:0/2524503655 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c007980 con 0x556393d54750 2024-04-25T09:08:41.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa552000640 1 -- 172.21.15.175:0/2524503655 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 49) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa55c031040 con 0x556393d54750 2024-04-25T09:08:41.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 10 client.6882 fetch_fsmap finished waiting for FSMap version 49 2024-04-25T09:08:41.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 10 client.6882 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:08:41.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 20 client.6882 populate_metadata read hostname 'smithi175' 2024-04-25T09:08:41.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 --2- 172.21.15.175:0/2524503655 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x556393d67560 0x556393dbbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:41.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 4 client.6882 mds_command: new command op to 6513 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:08:41.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 -- 172.21.15.175:0/2524503655 --> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556393b60530 con 0x556393d67560 2024-04-25T09:08:41.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa568c00640 1 --2- 172.21.15.175:0/2524503655 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x556393d67560 0x556393dbbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:41.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa568c00640 1 --2- 172.21.15.175:0/2524503655 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x556393d67560 0x556393dbbfe0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b932508847dd4f5 server_cookie=8f224af1ec45de51 in_seq=0 out_seq=0 2024-04-25T09:08:41.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa552000640 10 client.6882 ms_handle_connect on v2:172.21.15.175:6834/2714482688 2024-04-25T09:08:41.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa552000640 1 -- 172.21.15.175:0/2524503655 <== mds.0 v2:172.21.15.175:6834/2714482688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556393b60530 con 0x556393d67560 2024-04-25T09:08:41.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa552000640 10 client.6882 handle_command_reply: tid=0 2024-04-25T09:08:41.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 client.6882 shutdown 2024-04-25T09:08:41.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 -- 172.21.15.175:0/2524503655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 msgr2=0x556393d66b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 --2- 172.21.15.175:0/2524503655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 0x556393d66b70 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0019d0 tx=0x7fa55c009040 comp rx=0 tx=0).stop 2024-04-25T09:08:41.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 -- 172.21.15.175:0/2524503655 shutdown_connections 2024-04-25T09:08:41.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 --2- 172.21.15.175:0/2524503655 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x556393d67560 0x556393dbbfe0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 --2- 172.21.15.175:0/2524503655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556393d54750 0x556393d66b70 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 --2- 172.21.15.175:0/2524503655 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556393d53e30 0x556393d66630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 --2- 172.21.15.175:0/2524503655 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556393d0a4b0 0x556393d660f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa552000640 0 client.6882 ms_handle_reset on v2:172.21.15.175:6834/2714482688 2024-04-25T09:08:41.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 -- 172.21.15.175:0/2524503655 >> 172.21.15.175:0/2524503655 conn(0x556393d02020 msgr2=0x556393d61420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:41.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 -- 172.21.15.175:0/2524503655 shutdown_connections 2024-04-25T09:08:41.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 1 -- 172.21.15.175:0/2524503655 wait complete. 2024-04-25T09:08:41.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.587+0000 7fa56eac3000 20 client.6882 trim_cache size 0 max 16384 2024-04-25T09:08:41.584 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:08:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:08:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": { 2024-04-25T09:08:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: "2445b356-4116-4af3-9237-759b33dd11ff": { 2024-04-25T09:08:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: "path": "/subdir", 2024-04-25T09:08:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: "tag": "2445b356-4116-4af3-9237-759b33dd11ff", 2024-04-25T09:08:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: "options": "recursive" 2024-04-25T09:08:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:41.584 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:08:41.584 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:08:41.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.591+0000 7fa56b600640 1 -- 172.21.15.175:0/2265376420 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa540066f90 msgr2=0x7fa540069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.591+0000 7fa56b600640 1 --2- 172.21.15.175:0/2265376420 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa540066f90 0x7fa540069450 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa554001750 tx=0x7fa5540011a0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.591+0000 7fa56b600640 1 -- 172.21.15.175:0/2265376420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5641540f0 msgr2=0x7fa5640cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:41.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.591+0000 7fa56b600640 1 --2- 172.21.15.175:0/2265376420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5641540f0 0x7fa5640cf1e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa54c011510 tx=0x7fa54c0119d0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.591+0000 7fa56b600640 1 -- 172.21.15.175:0/2265376420 shutdown_connections 2024-04-25T09:08:41.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.591+0000 7fa56b600640 1 --2- 172.21.15.175:0/2265376420 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa540066f90 0x7fa540069450 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.591+0000 7fa56b600640 1 --2- 172.21.15.175:0/2265376420 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5640cf720 0x7fa5640afb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.591+0000 7fa56b600640 1 --2- 172.21.15.175:0/2265376420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5641540f0 0x7fa5640cf1e0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.591+0000 7fa56b600640 1 --2- 172.21.15.175:0/2265376420 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5480039c0 0x7fa5640ace60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:41.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.591+0000 7fa56b600640 1 -- 172.21.15.175:0/2265376420 >> 172.21.15.175:0/2265376420 conn(0x7fa56406ac50 msgr2=0x7fa564156620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:41.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.591+0000 7fa56b600640 1 -- 172.21.15.175:0/2265376420 shutdown_connections 2024-04-25T09:08:41.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:08:41.591+0000 7fa56b600640 1 -- 172.21.15.175:0/2265376420 wait complete. 2024-04-25T09:08:41.598 INFO:tasks.cephfs.filesystem:scrub status for tag:2445b356-4116-4af3-9237-759b33dd11ff - {'path': '/subdir', 'tag': '2445b356-4116-4af3-9237-759b33dd11ff', 'options': 'recursive'} 2024-04-25T09:08:43.465 INFO:tasks.ceph.mon.a.smithi175.stderr:2024-04-25T09:08:43.475+0000 7feb12000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T09:09:08.936 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:09:08.940 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:09:11.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:11.602 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T09:09:11.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.759+0000 7f1d42c00640 1 Processor -- start 2024-04-25T09:09:11.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.759+0000 7f1d42c00640 1 -- start start 2024-04-25T09:09:11.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.763+0000 7f1d42c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d3c0cbe60 0x7f1d3c15af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.763+0000 7f1d42c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1d3c0b4800 0x7f1d3c15c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.763+0000 7f1d42c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3c06db60 con 0x7f1d3c06d310 2024-04-25T09:09:11.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.763+0000 7f1d42c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3c06de40 con 0x7f1d3c0b4800 2024-04-25T09:09:11.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.763+0000 7f1d42c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c06e120 con 0x7f1d3c0cbe60 2024-04-25T09:09:11.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.763+0000 7f1d40c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1d3c0b4800 0x7f1d3c15c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.763+0000 7f1d40c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1d3c0b4800 0x7f1d3c15c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33536/0 (socket says 172.21.15.175:33536) 2024-04-25T09:09:11.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.763+0000 7f1d40c00640 1 -- 172.21.15.175:0/3737441654 learned_addr learned my addr 172.21.15.175:0/3737441654 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:11.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.763+0000 7f1d3be00640 1 --2- 172.21.15.175:0/3737441654 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d3c0cbe60 0x7f1d3c15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.763+0000 7f1d40c00640 1 -- 172.21.15.175:0/3737441654 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d3c0cbe60 msgr2=0x7f1d3c15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:11.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.763+0000 7f1d40c00640 1 --2- 172.21.15.175:0/3737441654 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d3c0cbe60 0x7f1d3c15af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.763+0000 7f1d40c00640 1 -- 172.21.15.175:0/3737441654 >> v1:172.21.15.177:6789/0 conn(0x7f1d3c06d310 legacy=0x7f1d3c0b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.763+0000 7f1d40c00640 1 -- 172.21.15.175:0/3737441654 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c15c2f0 con 0x7f1d3c0b4800 2024-04-25T09:09:11.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.767+0000 7f1d40c00640 1 --2- 172.21.15.175:0/3737441654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d3c0b4800 0x7f1d3c15c810 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f1d34009870 tx=0x7f1d3401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864ae26b23848939 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.767+0000 7f1d3aa00640 1 -- 172.21.15.175:0/3737441654 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d340b2070 con 0x7f1d3c0b4800 2024-04-25T09:09:11.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.767+0000 7f1d3aa00640 1 -- 172.21.15.175:0/3737441654 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d340a9070 con 0x7f1d3c0b4800 2024-04-25T09:09:11.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.767+0000 7f1d3aa00640 1 -- 172.21.15.175:0/3737441654 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d340ad880 con 0x7f1d3c0b4800 2024-04-25T09:09:11.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.767+0000 7f1d42c00640 1 -- 172.21.15.175:0/3737441654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d3c0b4800 msgr2=0x7f1d3c15c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.767+0000 7f1d42c00640 1 --2- 172.21.15.175:0/3737441654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d3c0b4800 0x7f1d3c15c810 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f1d34009870 tx=0x7f1d3401c560 comp rx=0 tx=0).stop 2024-04-25T09:09:11.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.767+0000 7f1d42c00640 1 -- 172.21.15.175:0/3737441654 shutdown_connections 2024-04-25T09:09:11.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.767+0000 7f1d42c00640 1 --2- 172.21.15.175:0/3737441654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d3c0b4800 0x7f1d3c15c810 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.767+0000 7f1d42c00640 1 --2- 172.21.15.175:0/3737441654 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d3c0cbe60 0x7f1d3c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.767+0000 7f1d42c00640 1 -- 172.21.15.175:0/3737441654 >> 172.21.15.175:0/3737441654 conn(0x7f1d3c06ac50 msgr2=0x7f1d3c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:11.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.767+0000 7f1d42c00640 1 -- 172.21.15.175:0/3737441654 shutdown_connections 2024-04-25T09:09:11.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.767+0000 7f1d42c00640 1 -- 172.21.15.175:0/3737441654 wait complete. 2024-04-25T09:09:11.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.767+0000 7f1d42c00640 1 Processor -- start 2024-04-25T09:09:11.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.767+0000 7f1d42c00640 1 -- start start 2024-04-25T09:09:11.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d42c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d3c06d310 0x7f1d3c149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d42c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d3c0b4800 0x7f1d3c14f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d42c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d3c0cbe60 0x7f1d3c14c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d42c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c15d930 con 0x7f1d3c0cbe60 2024-04-25T09:09:11.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d42c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c15d7b0 con 0x7f1d3c06d310 2024-04-25T09:09:11.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d42c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c15dab0 con 0x7f1d3c0b4800 2024-04-25T09:09:11.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d40c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d3c0cbe60 0x7f1d3c14c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d40c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d3c0cbe60 0x7f1d3c14c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33552/0 (socket says 172.21.15.175:33552) 2024-04-25T09:09:11.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d40c00640 1 -- 172.21.15.175:0/1860946289 learned_addr learned my addr 172.21.15.175:0/1860946289 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:11.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d3be00640 1 --2- 172.21.15.175:0/1860946289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d3c06d310 0x7f1d3c149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d3b400640 1 --2- 172.21.15.175:0/1860946289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d3c0b4800 0x7f1d3c14f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d40c00640 1 -- 172.21.15.175:0/1860946289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d3c0b4800 msgr2=0x7f1d3c14f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d40c00640 1 --2- 172.21.15.175:0/1860946289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d3c0b4800 0x7f1d3c14f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d40c00640 1 -- 172.21.15.175:0/1860946289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d3c06d310 msgr2=0x7f1d3c149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d40c00640 1 --2- 172.21.15.175:0/1860946289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d3c06d310 0x7f1d3c149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d40c00640 1 -- 172.21.15.175:0/1860946289 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c14ec50 con 0x7f1d3c0cbe60 2024-04-25T09:09:11.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d40c00640 1 --2- 172.21.15.175:0/1860946289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d3c0cbe60 0x7f1d3c14c4d0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f1d3401a190 tx=0x7f1d34019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d33e00640 1 -- 172.21.15.175:0/1860946289 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d340b2040 con 0x7f1d3c0cbe60 2024-04-25T09:09:11.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d33e00640 1 -- 172.21.15.175:0/1860946289 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d340bb070 con 0x7f1d3c0cbe60 2024-04-25T09:09:11.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d33e00640 1 -- 172.21.15.175:0/1860946289 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d340b6440 con 0x7f1d3c0cbe60 2024-04-25T09:09:11.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d42c00640 1 -- 172.21.15.175:0/1860946289 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3c14ef30 con 0x7f1d3c0cbe60 2024-04-25T09:09:11.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.771+0000 7f1d42c00640 1 -- 172.21.15.175:0/1860946289 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3c1534d0 con 0x7f1d3c0cbe60 2024-04-25T09:09:11.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d33e00640 1 -- 172.21.15.175:0/1860946289 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1d340ab070 con 0x7f1d3c0cbe60 2024-04-25T09:09:11.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d33e00640 1 --2- 172.21.15.175:0/1860946289 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1d1c066f60 0x7f1d1c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d33e00640 1 -- 172.21.15.175:0/1860946289 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f1d3411e9f0 con 0x7f1d3c0cbe60 2024-04-25T09:09:11.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d3be00640 1 --2- 172.21.15.175:0/1860946289 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1d1c066f60 0x7f1d1c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d46173000 1 Processor -- start 2024-04-25T09:09:11.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d46173000 1 -- start start 2024-04-25T09:09:11.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d3be00640 1 --2- 172.21.15.175:0/1860946289 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1d1c066f60 0x7f1d1c069420 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0113e0 tx=0x7f1d2c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d46173000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa874e4e30 0x55fa874e5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d46173000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa874e5750 0x55fa87498440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d46173000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa87498980 0x55fa87498d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d46173000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa872e3ff0 con 0x55fa874e4e30 2024-04-25T09:09:11.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d46173000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8726c150 con 0x55fa874e5750 2024-04-25T09:09:11.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d46173000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa872e0090 con 0x55fa87498980 2024-04-25T09:09:11.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d3be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa874e4e30 0x55fa874e5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d3be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa874e4e30 0x55fa874e5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33566/0 (socket says 172.21.15.175:33566) 2024-04-25T09:09:11.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d3be00640 1 -- 172.21.15.175:0/169181071 learned_addr learned my addr 172.21.15.175:0/169181071 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:11.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d3b400640 1 --2- 172.21.15.175:0/169181071 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa874e5750 0x55fa87498440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d40c00640 1 --2- 172.21.15.175:0/169181071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa87498980 0x55fa87498d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d3be00640 1 -- 172.21.15.175:0/169181071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa87498980 msgr2=0x55fa87498d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:11.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d3be00640 1 --2- 172.21.15.175:0/169181071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa87498980 0x55fa87498d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d3be00640 1 -- 172.21.15.175:0/169181071 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa874e5750 msgr2=0x55fa87498440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:11.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d3be00640 1 --2- 172.21.15.175:0/169181071 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa874e5750 0x55fa87498440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d3be00640 1 -- 172.21.15.175:0/169181071 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa8747a0d0 con 0x55fa874e4e30 2024-04-25T09:09:11.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d3be00640 1 --2- 172.21.15.175:0/169181071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa874e4e30 0x55fa874e5210 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c003d80 tx=0x7f1d2c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1302aaf7ddfd88 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.775+0000 7f1d30c00640 1 -- 172.21.15.175:0/169181071 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c01b070 con 0x55fa874e4e30 2024-04-25T09:09:11.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d30c00640 1 -- 172.21.15.175:0/169181071 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c027070 con 0x55fa874e4e30 2024-04-25T09:09:11.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d30c00640 1 -- 172.21.15.175:0/169181071 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c017a50 con 0x55fa874e4e30 2024-04-25T09:09:11.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 1 -- 172.21.15.175:0/169181071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa874e4e30 msgr2=0x55fa874e5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 1 --2- 172.21.15.175:0/169181071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa874e4e30 0x55fa874e5210 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c003d80 tx=0x7f1d2c014000 comp rx=0 tx=0).stop 2024-04-25T09:09:11.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 1 -- 172.21.15.175:0/169181071 shutdown_connections 2024-04-25T09:09:11.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 1 --2- 172.21.15.175:0/169181071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa87498980 0x55fa87498d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 1 --2- 172.21.15.175:0/169181071 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa874e5750 0x55fa87498440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 1 --2- 172.21.15.175:0/169181071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa874e4e30 0x55fa874e5210 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 1 -- 172.21.15.175:0/169181071 >> 172.21.15.175:0/169181071 conn(0x55fa874c59c0 msgr2=0x55fa874c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:11.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 1 -- 172.21.15.175:0/169181071 shutdown_connections 2024-04-25T09:09:11.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 1 -- 172.21.15.175:0/169181071 wait complete. 2024-04-25T09:09:11.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 1 -- start start 2024-04-25T09:09:11.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 1 Processor -- start 2024-04-25T09:09:11.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa87498980 0x55fa874cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa874e4e30 0x55fa874cb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa874e5750 0x55fa874cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa872a8250 con 0x55fa87498980 2024-04-25T09:09:11.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8729e690 con 0x55fa874e4e30 2024-04-25T09:09:11.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa8726ca40 con 0x55fa874e5750 2024-04-25T09:09:11.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 10 client.0 _ll_register_callbacks cb 0x55fa87481e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:11.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d3be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa87498980 0x55fa874cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d3be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa87498980 0x55fa874cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33576/0 (socket says 172.21.15.175:33576) 2024-04-25T09:09:11.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d3be00640 1 -- 172.21.15.175:0/1898867717 learned_addr learned my addr 172.21.15.175:0/1898867717 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:11.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d40c00640 1 --2- 172.21.15.175:0/1898867717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa874e5750 0x55fa874cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d3b400640 1 --2- 172.21.15.175:0/1898867717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa874e4e30 0x55fa874cb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d3be00640 1 -- 172.21.15.175:0/1898867717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa874e5750 msgr2=0x55fa874cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:11.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d3be00640 1 --2- 172.21.15.175:0/1898867717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa874e5750 0x55fa874cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d3be00640 1 -- 172.21.15.175:0/1898867717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa874e4e30 msgr2=0x55fa874cb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:11.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d3be00640 1 --2- 172.21.15.175:0/1898867717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa874e4e30 0x55fa874cb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d3be00640 1 -- 172.21.15.175:0/1898867717 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa873911c0 con 0x55fa87498980 2024-04-25T09:09:11.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d40c00640 1 --2- 172.21.15.175:0/1898867717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa874e5750 0x55fa874cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:11.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d3be00640 1 --2- 172.21.15.175:0/1898867717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa87498980 0x55fa874cb170 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00afd0 tx=0x7f1d2c004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc8bf3a8c06bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d25600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:09:11.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d25600640 1 -- 172.21.15.175:0/1898867717 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c01b040 con 0x55fa87498980 2024-04-25T09:09:11.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d25600640 1 -- 172.21.15.175:0/1898867717 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f1d2c037680 con 0x55fa87498980 2024-04-25T09:09:11.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 1 -- 172.21.15.175:0/1898867717 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d2c027070 con 0x55fa87498980 2024-04-25T09:09:11.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d25600640 1 -- 172.21.15.175:0/1898867717 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d2c037880 con 0x55fa87498980 2024-04-25T09:09:11.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.779+0000 7f1d46173000 10 client.6894 fetch_fsmap learned FSMap version 50 2024-04-25T09:09:11.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 1 -- 172.21.15.175:0/1898867717 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55fa8738d170 con 0x55fa87498980 2024-04-25T09:09:11.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d25600640 1 -- 172.21.15.175:0/1898867717 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c027070 con 0x55fa87498980 2024-04-25T09:09:11.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d25600640 1 -- 172.21.15.175:0/1898867717 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1d2c042020 con 0x55fa87498980 2024-04-25T09:09:11.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 10 client.6894 fetch_fsmap finished waiting for FSMap version 50 2024-04-25T09:09:11.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 10 client.6894 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:09:11.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 20 client.6894 populate_metadata read hostname 'smithi175' 2024-04-25T09:09:11.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 1 --2- 172.21.15.175:0/1898867717 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55fa874f4ed0 0x55fa874f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 4 client.6894 mds_command: new command op to 6513 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:11.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 1 -- 172.21.15.175:0/1898867717 --> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa8727fc60 con 0x55fa874f4ed0 2024-04-25T09:09:11.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d3b400640 1 --2- 172.21.15.175:0/1898867717 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55fa874f4ed0 0x55fa874f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d3b400640 1 --2- 172.21.15.175:0/1898867717 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55fa874f4ed0 0x55fa874f72c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9150fa71f1931b8e server_cookie=7014189f2e6a362b in_seq=0 out_seq=0 2024-04-25T09:09:11.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d25600640 10 client.6894 ms_handle_connect on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:11.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d25600640 1 -- 172.21.15.175:0/1898867717 <== mds.0 v2:172.21.15.175:6834/2714482688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fa8727fc60 con 0x55fa874f4ed0 2024-04-25T09:09:11.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d25600640 10 client.6894 handle_command_reply: tid=0 2024-04-25T09:09:11.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 1 client.6894 shutdown 2024-04-25T09:09:11.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 1 -- 172.21.15.175:0/1898867717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa87498980 msgr2=0x55fa874cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 1 --2- 172.21.15.175:0/1898867717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa87498980 0x55fa874cb170 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00afd0 tx=0x7f1d2c004a50 comp rx=0 tx=0).stop 2024-04-25T09:09:11.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 1 -- 172.21.15.175:0/1898867717 shutdown_connections 2024-04-25T09:09:11.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 1 --2- 172.21.15.175:0/1898867717 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55fa874f4ed0 0x55fa874f72c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 1 --2- 172.21.15.175:0/1898867717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa874e5750 0x55fa874cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 1 --2- 172.21.15.175:0/1898867717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa874e4e30 0x55fa874cb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d25600640 0 client.6894 ms_handle_reset on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:11.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 1 --2- 172.21.15.175:0/1898867717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa87498980 0x55fa874cb170 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 1 -- 172.21.15.175:0/1898867717 >> 172.21.15.175:0/1898867717 conn(0x55fa874c59c0 msgr2=0x55fa874c7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:11.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 1 -- 172.21.15.175:0/1898867717 shutdown_connections 2024-04-25T09:09:11.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 1 -- 172.21.15.175:0/1898867717 wait complete. 2024-04-25T09:09:11.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.783+0000 7f1d46173000 20 client.6894 trim_cache size 0 max 16384 2024-04-25T09:09:11.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d46173000 1 Processor -- start 2024-04-25T09:09:11.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d46173000 1 -- start start 2024-04-25T09:09:11.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d46173000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa87498980 0x55fa874f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d46173000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa874e4e30 0x55fa874f6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d46173000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa874e5750 0x55fa874f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d46173000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c1fea80 con 0x55fa874e5750 2024-04-25T09:09:11.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d46173000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c0ced70 con 0x55fa87498980 2024-04-25T09:09:11.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d46173000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c0b07f0 con 0x55fa874e4e30 2024-04-25T09:09:11.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d40c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa874e5750 0x55fa874f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d40c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa874e5750 0x55fa874f6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33578/0 (socket says 172.21.15.175:33578) 2024-04-25T09:09:11.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d40c00640 1 -- 172.21.15.175:0/3336070653 learned_addr learned my addr 172.21.15.175:0/3336070653 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:11.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d40c00640 1 -- 172.21.15.175:0/3336070653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa874e4e30 msgr2=0x55fa874f6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:11.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d40c00640 1 --2- 172.21.15.175:0/3336070653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa874e4e30 0x55fa874f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d40c00640 1 -- 172.21.15.175:0/3336070653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa87498980 msgr2=0x55fa874f62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:11.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d40c00640 1 --2- 172.21.15.175:0/3336070653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa87498980 0x55fa874f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d40c00640 1 -- 172.21.15.175:0/3336070653 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa8732ade0 con 0x55fa874e5750 2024-04-25T09:09:11.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d40c00640 1 --2- 172.21.15.175:0/3336070653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa874e5750 0x55fa874f6d40 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f1d34097e30 tx=0x7f1d340eedc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14360948fe5f607c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d27e00640 1 -- 172.21.15.175:0/3336070653 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d340f3320 con 0x55fa874e5750 2024-04-25T09:09:11.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d27e00640 1 -- 172.21.15.175:0/3336070653 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d340a9040 con 0x55fa874e5750 2024-04-25T09:09:11.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d27e00640 1 -- 172.21.15.175:0/3336070653 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d340f78e0 con 0x55fa874e5750 2024-04-25T09:09:11.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d46173000 1 -- 172.21.15.175:0/3336070653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa874e5750 msgr2=0x55fa874f6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d46173000 1 --2- 172.21.15.175:0/3336070653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa874e5750 0x55fa874f6d40 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f1d34097e30 tx=0x7f1d340eedc0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d46173000 1 -- 172.21.15.175:0/3336070653 shutdown_connections 2024-04-25T09:09:11.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d46173000 1 --2- 172.21.15.175:0/3336070653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa874e5750 0x55fa874f6d40 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d46173000 1 --2- 172.21.15.175:0/3336070653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa874e4e30 0x55fa874f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d46173000 1 --2- 172.21.15.175:0/3336070653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa87498980 0x55fa874f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d46173000 1 -- 172.21.15.175:0/3336070653 >> 172.21.15.175:0/3336070653 conn(0x55fa874c59c0 msgr2=0x55fa874f1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:11.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d46173000 1 -- 172.21.15.175:0/3336070653 shutdown_connections 2024-04-25T09:09:11.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.799+0000 7f1d46173000 1 -- 172.21.15.175:0/3336070653 wait complete. 2024-04-25T09:09:11.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 1 -- start start 2024-04-25T09:09:11.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 1 Processor -- start 2024-04-25T09:09:11.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa87498980 0x55fa875458d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa874e4e30 0x55fa87545e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa874e5750 0x55fa87500d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8727ee00 con 0x55fa87498980 2024-04-25T09:09:11.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c0b0df0 con 0x55fa874e5750 2024-04-25T09:09:11.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa872e3300 con 0x55fa874e4e30 2024-04-25T09:09:11.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 10 client.0 _ll_register_callbacks cb 0x55fa87462040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:11.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d3be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa87498980 0x55fa875458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d3be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa87498980 0x55fa875458d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33582/0 (socket says 172.21.15.175:33582) 2024-04-25T09:09:11.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d3be00640 1 -- 172.21.15.175:0/149049693 learned_addr learned my addr 172.21.15.175:0/149049693 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:11.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d40c00640 1 --2- 172.21.15.175:0/149049693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa874e5750 0x55fa87500d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d3b400640 1 --2- 172.21.15.175:0/149049693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa874e4e30 0x55fa87545e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d3be00640 1 -- 172.21.15.175:0/149049693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa874e4e30 msgr2=0x55fa87545e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:11.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d3be00640 1 --2- 172.21.15.175:0/149049693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa874e4e30 0x55fa87545e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d3be00640 1 -- 172.21.15.175:0/149049693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa874e5750 msgr2=0x55fa87500d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:11.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d3be00640 1 --2- 172.21.15.175:0/149049693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa874e5750 0x55fa87500d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d3be00640 1 -- 172.21.15.175:0/149049693 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa872858e0 con 0x55fa87498980 2024-04-25T09:09:11.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d40c00640 1 --2- 172.21.15.175:0/149049693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa874e5750 0x55fa87500d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:11.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d3be00640 1 --2- 172.21.15.175:0/149049693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa87498980 0x55fa875458d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c003f40 tx=0x7f1d2c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561d4055dc61f9ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d25600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:09:11.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d25600640 1 -- 172.21.15.175:0/149049693 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c048060 con 0x55fa87498980 2024-04-25T09:09:11.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d25600640 1 -- 172.21.15.175:0/149049693 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f1d2c022470 con 0x55fa87498980 2024-04-25T09:09:11.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 1 -- 172.21.15.175:0/149049693 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d340a9040 con 0x55fa87498980 2024-04-25T09:09:11.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d25600640 1 -- 172.21.15.175:0/149049693 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d2c04e050 con 0x55fa87498980 2024-04-25T09:09:11.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 10 client.6900 fetch_fsmap learned FSMap version 50 2024-04-25T09:09:11.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 1 -- 172.21.15.175:0/149049693 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55fa8733d8f0 con 0x55fa87498980 2024-04-25T09:09:11.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d25600640 1 -- 172.21.15.175:0/149049693 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d340a9040 con 0x55fa87498980 2024-04-25T09:09:11.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d25600640 1 -- 172.21.15.175:0/149049693 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1d2c051020 con 0x55fa87498980 2024-04-25T09:09:11.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 10 client.6900 fetch_fsmap finished waiting for FSMap version 50 2024-04-25T09:09:11.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 10 client.6900 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:09:11.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 20 client.6900 populate_metadata read hostname 'smithi175' 2024-04-25T09:09:11.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 1 --2- 172.21.15.175:0/149049693 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55fa875016a0 0x55fa87501ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 4 client.6900 mds_command: new command op to 6513 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:09:11.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 1 -- 172.21.15.175:0/149049693 --> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fa872f1530 con 0x55fa875016a0 2024-04-25T09:09:11.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d3b400640 1 --2- 172.21.15.175:0/149049693 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55fa875016a0 0x55fa87501ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d3b400640 1 --2- 172.21.15.175:0/149049693 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55fa875016a0 0x55fa87501ab0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddb7016cbca4a46c server_cookie=41b7c9710b3657ac in_seq=0 out_seq=0 2024-04-25T09:09:11.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d25600640 10 client.6900 ms_handle_connect on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:11.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d25600640 1 -- 172.21.15.175:0/149049693 <== mds.0 v2:172.21.15.175:6834/2714482688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55fa872f1530 con 0x55fa875016a0 2024-04-25T09:09:11.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d25600640 10 client.6900 handle_command_reply: tid=0 2024-04-25T09:09:11.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 1 client.6900 shutdown 2024-04-25T09:09:11.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 1 -- 172.21.15.175:0/149049693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa87498980 msgr2=0x55fa875458d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.803+0000 7f1d46173000 1 --2- 172.21.15.175:0/149049693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa87498980 0x55fa875458d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c003f40 tx=0x7f1d2c009750 comp rx=0 tx=0).stop 2024-04-25T09:09:11.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d46173000 1 -- 172.21.15.175:0/149049693 shutdown_connections 2024-04-25T09:09:11.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d46173000 1 --2- 172.21.15.175:0/149049693 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55fa875016a0 0x55fa87501ab0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d46173000 1 --2- 172.21.15.175:0/149049693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55fa874e5750 0x55fa87500d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d46173000 1 --2- 172.21.15.175:0/149049693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55fa874e4e30 0x55fa87545e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d46173000 1 --2- 172.21.15.175:0/149049693 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55fa87498980 0x55fa875458d0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d25600640 0 client.6900 ms_handle_reset on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:11.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d46173000 1 -- 172.21.15.175:0/149049693 >> 172.21.15.175:0/149049693 conn(0x55fa874c59c0 msgr2=0x55fa874f2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:11.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d46173000 1 -- 172.21.15.175:0/149049693 shutdown_connections 2024-04-25T09:09:11.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d46173000 1 -- 172.21.15.175:0/149049693 wait complete. 2024-04-25T09:09:11.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d46173000 20 client.6900 trim_cache size 0 max 16384 2024-04-25T09:09:11.800 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:09:11.800 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "no active scrubs running", 2024-04-25T09:09:11.800 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": {} 2024-04-25T09:09:11.800 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:09:11.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d42c00640 1 -- 172.21.15.175:0/1860946289 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1d1c066f60 msgr2=0x7f1d1c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d42c00640 1 --2- 172.21.15.175:0/1860946289 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1d1c066f60 0x7f1d1c069420 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0113e0 tx=0x7f1d2c00b040 comp rx=0 tx=0).stop 2024-04-25T09:09:11.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d42c00640 1 -- 172.21.15.175:0/1860946289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d3c0cbe60 msgr2=0x7f1d3c14c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d42c00640 1 --2- 172.21.15.175:0/1860946289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d3c0cbe60 0x7f1d3c14c4d0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f1d3401a190 tx=0x7f1d34019300 comp rx=0 tx=0).stop 2024-04-25T09:09:11.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d42c00640 1 -- 172.21.15.175:0/1860946289 shutdown_connections 2024-04-25T09:09:11.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d42c00640 1 --2- 172.21.15.175:0/1860946289 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1d1c066f60 0x7f1d1c069420 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d42c00640 1 --2- 172.21.15.175:0/1860946289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d3c0cbe60 0x7f1d3c14c4d0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d42c00640 1 --2- 172.21.15.175:0/1860946289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d3c0b4800 0x7f1d3c14f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d42c00640 1 --2- 172.21.15.175:0/1860946289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d3c06d310 0x7f1d3c149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d42c00640 1 -- 172.21.15.175:0/1860946289 >> 172.21.15.175:0/1860946289 conn(0x7f1d3c06ac50 msgr2=0x7f1d3c0b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:11.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d42c00640 1 -- 172.21.15.175:0/1860946289 shutdown_connections 2024-04-25T09:09:11.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.807+0000 7f1d42c00640 1 -- 172.21.15.175:0/1860946289 wait complete. 2024-04-25T09:09:11.815 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:09:11.815 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:11.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.963+0000 7f8760000640 1 Processor -- start 2024-04-25T09:09:11.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.963+0000 7f8760000640 1 -- start start 2024-04-25T09:09:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.963+0000 7f8760000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8758099a50 0x7f87580cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.963+0000 7f8760000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87580cc4c0 con 0x7f875815bc10 2024-04-25T09:09:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.963+0000 7f8760000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87580cc7a0 con 0x7f875809abb0 2024-04-25T09:09:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.963+0000 7f8760000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87580d06f0 con 0x7f8758099a50 2024-04-25T09:09:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.967+0000 7f875d600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8758099a50 0x7f87580cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.967+0000 7f875cc00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f875815bc10 0x7f8758099e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:54008/0 (socket says 172.21.15.175:54008) 2024-04-25T09:09:11.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.967+0000 7f875cc00640 1 -- 172.21.15.175:0/568666668 learned_addr learned my addr 172.21.15.175:0/568666668 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:11.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.967+0000 7f875d600640 1 -- 172.21.15.175:0/568666668 >> v1:172.21.15.177:6789/0 conn(0x7f875809abb0 legacy=0x7f87580cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:11.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.967+0000 7f875d600640 1 -- 172.21.15.175:0/568666668 >> v1:172.21.15.175:6789/0 conn(0x7f875815bc10 legacy=0x7f8758099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.967+0000 7f875d600640 1 -- 172.21.15.175:0/568666668 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87580cca80 con 0x7f8758099a50 2024-04-25T09:09:11.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.967+0000 7f8757e00640 1 -- 172.21.15.175:0/568666668 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411093160 0 0) 0x7f87580cc4c0 con 0x7f875815bc10 2024-04-25T09:09:11.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.967+0000 7f875d600640 1 --2- 172.21.15.175:0/568666668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8758099a50 0x7f87580cd280 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f874c0097c0 tx=0x7f874c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a267f4e6246a6ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.967+0000 7f8757e00640 1 -- 172.21.15.175:0/568666668 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c0b0070 con 0x7f8758099a50 2024-04-25T09:09:11.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.967+0000 7f8757e00640 1 -- 172.21.15.175:0/568666668 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874c0ab600 con 0x7f8758099a50 2024-04-25T09:09:11.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.967+0000 7f8757e00640 1 -- 172.21.15.175:0/568666668 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c0ab9d0 con 0x7f8758099a50 2024-04-25T09:09:11.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.967+0000 7f8760000640 1 -- 172.21.15.175:0/568666668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8758099a50 msgr2=0x7f87580cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.967+0000 7f8760000640 1 --2- 172.21.15.175:0/568666668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8758099a50 0x7f87580cd280 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f874c0097c0 tx=0x7f874c01c460 comp rx=0 tx=0).stop 2024-04-25T09:09:11.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f8760000640 1 -- 172.21.15.175:0/568666668 shutdown_connections 2024-04-25T09:09:11.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f8760000640 1 --2- 172.21.15.175:0/568666668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8758099a50 0x7f87580cd280 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f8760000640 1 -- 172.21.15.175:0/568666668 >> 172.21.15.175:0/568666668 conn(0x7f87580b3300 msgr2=0x7f87580b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:11.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f8760000640 1 -- 172.21.15.175:0/568666668 shutdown_connections 2024-04-25T09:09:11.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f8760000640 1 -- 172.21.15.175:0/568666668 wait complete. 2024-04-25T09:09:11.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f8760000640 1 Processor -- start 2024-04-25T09:09:11.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f8760000640 1 -- start start 2024-04-25T09:09:11.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f8760000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8758099a50 0x7f87580b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f8760000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f875809abb0 0x7f8758152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f8760000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f875815bc10 0x7f8758157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f8760000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87580c5f00 con 0x7f875815bc10 2024-04-25T09:09:11.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f8760000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87580c5d80 con 0x7f875809abb0 2024-04-25T09:09:11.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f8760000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8758169860 con 0x7f8758099a50 2024-04-25T09:09:11.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f875e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f875815bc10 0x7f8758157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f875e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f875815bc10 0x7f8758157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33594/0 (socket says 172.21.15.175:33594) 2024-04-25T09:09:11.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f875e000640 1 -- 172.21.15.175:0/4010990299 learned_addr learned my addr 172.21.15.175:0/4010990299 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:11.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f875cc00640 1 --2- 172.21.15.175:0/4010990299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f875809abb0 0x7f8758152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f875d600640 1 --2- 172.21.15.175:0/4010990299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8758099a50 0x7f87580b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f875e000640 1 -- 172.21.15.175:0/4010990299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8758099a50 msgr2=0x7f87580b6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f875e000640 1 --2- 172.21.15.175:0/4010990299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8758099a50 0x7f87580b6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f875e000640 1 -- 172.21.15.175:0/4010990299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f875809abb0 msgr2=0x7f8758152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f875e000640 1 --2- 172.21.15.175:0/4010990299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f875809abb0 0x7f8758152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f875e000640 1 -- 172.21.15.175:0/4010990299 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87580c9b30 con 0x7f875815bc10 2024-04-25T09:09:11.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f875cc00640 1 --2- 172.21.15.175:0/4010990299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f875809abb0 0x7f8758152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:11.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f875e000640 1 --2- 172.21.15.175:0/4010990299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f875815bc10 0x7f8758157ce0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f875000c780 tx=0x7f875000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f8755600640 1 -- 172.21.15.175:0/4010990299 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750017070 con 0x7f875815bc10 2024-04-25T09:09:11.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f8755600640 1 -- 172.21.15.175:0/4010990299 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8750003db0 con 0x7f875815bc10 2024-04-25T09:09:11.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.971+0000 7f8755600640 1 -- 172.21.15.175:0/4010990299 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87500052b0 con 0x7f875815bc10 2024-04-25T09:09:11.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.975+0000 7f8760000640 1 -- 172.21.15.175:0/4010990299 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87580c9e10 con 0x7f875815bc10 2024-04-25T09:09:11.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.975+0000 7f8760000640 1 -- 172.21.15.175:0/4010990299 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87580ca3d0 con 0x7f875815bc10 2024-04-25T09:09:11.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.975+0000 7f8760000640 1 -- 172.21.15.175:0/4010990299 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8758074a60 con 0x7f875815bc10 2024-04-25T09:09:11.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.975+0000 7f8755600640 1 -- 172.21.15.175:0/4010990299 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f875001a070 con 0x7f875815bc10 2024-04-25T09:09:11.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.975+0000 7f8755600640 1 --2- 172.21.15.175:0/4010990299 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8738066f60 0x7f8738069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.975+0000 7f8755600640 1 -- 172.21.15.175:0/4010990299 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8750084730 con 0x7f875815bc10 2024-04-25T09:09:11.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.975+0000 7f875d600640 1 --2- 172.21.15.175:0/4010990299 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8738066f60 0x7f8738069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.975+0000 7f875d600640 1 --2- 172.21.15.175:0/4010990299 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8738066f60 0x7f8738069420 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f874c0ad000 tx=0x7f874c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:11.979+0000 7f8755600640 1 -- 172.21.15.175:0/4010990299 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8750054fc0 con 0x7f875815bc10 2024-04-25T09:09:12.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.163+0000 7f8760000640 1 -- 172.21.15.175:0/4010990299 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87580c7cb0 con 0x7f875815bc10 2024-04-25T09:09:12.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.163+0000 7f8755600640 1 -- 172.21.15.175:0/4010990299 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f8750059060 con 0x7f875815bc10 2024-04-25T09:09:12.155 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:09:12.155 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":50,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2493316948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2493316948},{"type":"v1","addr":"172.21.15.175:6837","nonce":2493316948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3408529232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3408529232},{"type":"v1","addr":"172.21.15.177:6834","nonce":3408529232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/46829775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":46829775},{"type":"v1","addr":"172.21.15.177:6835","nonce":46829775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:08:17.378890+0000","modified":"2024-04-25T09:08:43.450704+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6513":{"gid":6513,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6836/2714482688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2714482688},{"type":"v1","addr":"172.21.15.175:6836","nonce":2714482688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:09:12.155 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 50 2024-04-25T09:09:12.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.167+0000 7f8760000640 1 -- 172.21.15.175:0/4010990299 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8738066f60 msgr2=0x7f8738069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.167+0000 7f8760000640 1 --2- 172.21.15.175:0/4010990299 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8738066f60 0x7f8738069420 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f874c0ad000 tx=0x7f874c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:09:12.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.167+0000 7f8760000640 1 -- 172.21.15.175:0/4010990299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f875815bc10 msgr2=0x7f8758157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.167+0000 7f8760000640 1 --2- 172.21.15.175:0/4010990299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f875815bc10 0x7f8758157ce0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f875000c780 tx=0x7f875000cc40 comp rx=0 tx=0).stop 2024-04-25T09:09:12.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.167+0000 7f8760000640 1 -- 172.21.15.175:0/4010990299 shutdown_connections 2024-04-25T09:09:12.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.167+0000 7f8760000640 1 --2- 172.21.15.175:0/4010990299 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8738066f60 0x7f8738069420 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.167+0000 7f8760000640 1 --2- 172.21.15.175:0/4010990299 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f875815bc10 0x7f8758157ce0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.167+0000 7f8760000640 1 --2- 172.21.15.175:0/4010990299 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f875809abb0 0x7f8758152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.167+0000 7f8760000640 1 --2- 172.21.15.175:0/4010990299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8758099a50 0x7f87580b6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.167+0000 7f8760000640 1 -- 172.21.15.175:0/4010990299 >> 172.21.15.175:0/4010990299 conn(0x7f87580b3300 msgr2=0x7f87580cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.167+0000 7f8760000640 1 -- 172.21.15.175:0/4010990299 shutdown_connections 2024-04-25T09:09:12.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.167+0000 7f8760000640 1 -- 172.21.15.175:0/4010990299 wait complete. 2024-04-25T09:09:12.176 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T09:09:12.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd260800640 1 Processor -- start 2024-04-25T09:09:12.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd260800640 1 -- start start 2024-04-25T09:09:12.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd260800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2580cdb60 0x7fd2580cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd260800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd25806ad50 0x7fd25806bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd260800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd25806c080 0x7fd2581616d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd260800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25806de20 con 0x7fd25806c080 2024-04-25T09:09:12.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd260800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd25815dfe0 con 0x7fd25806ad50 2024-04-25T09:09:12.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd260800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2580ce480 con 0x7fd2580cdb60 2024-04-25T09:09:12.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd25e800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd25806c080 0x7fd2581616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd25e800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd25806c080 0x7fd2581616d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33604/0 (socket says 172.21.15.175:33604) 2024-04-25T09:09:12.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd25e800640 1 -- 172.21.15.175:0/347678786 learned_addr learned my addr 172.21.15.175:0/347678786 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:12.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd25de00640 1 --2- 172.21.15.175:0/347678786 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2580cdb60 0x7fd2580cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd25d400640 1 --2- 172.21.15.175:0/347678786 >> v2:172.21.15.177:3300/0 conn(0x7fd25806ad50 0x7fd25806bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd25e800640 1 -- 172.21.15.175:0/347678786 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2580cdb60 msgr2=0x7fd2580cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd25e800640 1 --2- 172.21.15.175:0/347678786 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2580cdb60 0x7fd2580cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd25e800640 1 -- 172.21.15.175:0/347678786 >> v2:172.21.15.177:3300/0 conn(0x7fd25806ad50 msgr2=0x7fd25806bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd25e800640 1 --2- 172.21.15.175:0/347678786 >> v2:172.21.15.177:3300/0 conn(0x7fd25806ad50 0x7fd25806bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd25e800640 1 -- 172.21.15.175:0/347678786 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25806e090 con 0x7fd25806c080 2024-04-25T09:09:12.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.323+0000 7fd25de00640 1 --2- 172.21.15.175:0/347678786 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2580cdb60 0x7fd2580cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:12.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.327+0000 7fd25e800640 1 --2- 172.21.15.175:0/347678786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd25806c080 0x7fd2581616d0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd25809e150 tx=0x7fd25401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba69b4c47a119ab4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.327+0000 7fd25ca00640 1 -- 172.21.15.175:0/347678786 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2540a5840 con 0x7fd25806c080 2024-04-25T09:09:12.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.327+0000 7fd25ca00640 1 -- 172.21.15.175:0/347678786 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2540a59e0 con 0x7fd25806c080 2024-04-25T09:09:12.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.327+0000 7fd25ca00640 1 -- 172.21.15.175:0/347678786 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2540a5db0 con 0x7fd25806c080 2024-04-25T09:09:12.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.327+0000 7fd260800640 1 -- 172.21.15.175:0/347678786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd25806c080 msgr2=0x7fd2581616d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.327+0000 7fd260800640 1 --2- 172.21.15.175:0/347678786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd25806c080 0x7fd2581616d0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd25809e150 tx=0x7fd25401c9c0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.327+0000 7fd260800640 1 -- 172.21.15.175:0/347678786 shutdown_connections 2024-04-25T09:09:12.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.327+0000 7fd260800640 1 --2- 172.21.15.175:0/347678786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd25806c080 0x7fd2581616d0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.327+0000 7fd260800640 1 --2- 172.21.15.175:0/347678786 >> v2:172.21.15.177:3300/0 conn(0x7fd25806ad50 0x7fd25806bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.327+0000 7fd260800640 1 --2- 172.21.15.175:0/347678786 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2580cdb60 0x7fd2580cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.327+0000 7fd260800640 1 -- 172.21.15.175:0/347678786 >> 172.21.15.175:0/347678786 conn(0x7fd2580cca10 msgr2=0x7fd2580cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.327+0000 7fd260800640 1 -- 172.21.15.175:0/347678786 shutdown_connections 2024-04-25T09:09:12.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.327+0000 7fd260800640 1 -- 172.21.15.175:0/347678786 wait complete. 2024-04-25T09:09:12.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd260800640 1 Processor -- start 2024-04-25T09:09:12.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd260800640 1 -- start start 2024-04-25T09:09:12.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd260800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd25806ad50 0x7fd2581596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd260800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd25806c080 0x7fd2580b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd260800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2580cdb60 0x7fd2580c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd260800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2580aef40 con 0x7fd25806c080 2024-04-25T09:09:12.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd260800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2580aedc0 con 0x7fd25806ad50 2024-04-25T09:09:12.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd260800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd25806eb70 con 0x7fd2580cdb60 2024-04-25T09:09:12.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd25d400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd25806c080 0x7fd2580b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd25d400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd25806c080 0x7fd2580b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33618/0 (socket says 172.21.15.175:33618) 2024-04-25T09:09:12.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd25d400640 1 -- 172.21.15.175:0/725594785 learned_addr learned my addr 172.21.15.175:0/725594785 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:12.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd25e800640 1 --2- 172.21.15.175:0/725594785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2580cdb60 0x7fd2580c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd25de00640 1 --2- 172.21.15.175:0/725594785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd25806ad50 0x7fd2581596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd25d400640 1 -- 172.21.15.175:0/725594785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2580cdb60 msgr2=0x7fd2580c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd25d400640 1 --2- 172.21.15.175:0/725594785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2580cdb60 0x7fd2580c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd25d400640 1 -- 172.21.15.175:0/725594785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd25806ad50 msgr2=0x7fd2581596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd25d400640 1 --2- 172.21.15.175:0/725594785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd25806ad50 0x7fd2581596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd25d400640 1 -- 172.21.15.175:0/725594785 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2580c64b0 con 0x7fd25806c080 2024-04-25T09:09:12.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd25d400640 1 --2- 172.21.15.175:0/725594785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd25806c080 0x7fd2580b0a70 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd24800d800 tx=0x7fd24800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd252000640 1 -- 172.21.15.175:0/725594785 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248018020 con 0x7fd25806c080 2024-04-25T09:09:12.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd252000640 1 -- 172.21.15.175:0/725594785 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2480096a0 con 0x7fd25806c080 2024-04-25T09:09:12.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd252000640 1 -- 172.21.15.175:0/725594785 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248009a50 con 0x7fd25806c080 2024-04-25T09:09:12.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd260800640 1 -- 172.21.15.175:0/725594785 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2580c6730 con 0x7fd25806c080 2024-04-25T09:09:12.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.331+0000 7fd260800640 1 -- 172.21.15.175:0/725594785 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2580c4b40 con 0x7fd25806c080 2024-04-25T09:09:12.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.335+0000 7fd252000640 1 -- 172.21.15.175:0/725594785 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd24801b020 con 0x7fd25806c080 2024-04-25T09:09:12.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.335+0000 7fd252000640 1 --2- 172.21.15.175:0/725594785 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd23c066f60 0x7fd23c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.335+0000 7fd252000640 1 -- 172.21.15.175:0/725594785 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd2480856d0 con 0x7fd25806c080 2024-04-25T09:09:12.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.335+0000 7fd263ca5000 1 Processor -- start 2024-04-25T09:09:12.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.335+0000 7fd25de00640 1 --2- 172.21.15.175:0/725594785 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd23c066f60 0x7fd23c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.335+0000 7fd263ca5000 1 -- start start 2024-04-25T09:09:12.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd25de00640 1 --2- 172.21.15.175:0/725594785 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd23c066f60 0x7fd23c069420 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd24c00ba10 tx=0x7fd24c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd263ca5000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bbe72e0 0x55c75bbe76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd263ca5000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 0x55c75bb9d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd263ca5000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bb9d8e0 0x55c75bb9dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd263ca5000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c75ba84ba0 con 0x55c75bbe7c00 2024-04-25T09:09:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd263ca5000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c75b9ea090 con 0x55c75bbe72e0 2024-04-25T09:09:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd263ca5000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c75b972160 con 0x55c75bb9d8e0 2024-04-25T09:09:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd25d400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 0x55c75bb9d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd25d400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 0x55c75bb9d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33632/0 (socket says 172.21.15.175:33632) 2024-04-25T09:09:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd25d400640 1 -- 172.21.15.175:0/3342031157 learned_addr learned my addr 172.21.15.175:0/3342031157 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd25de00640 1 --2- 172.21.15.175:0/3342031157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bbe72e0 0x55c75bbe76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd25e800640 1 --2- 172.21.15.175:0/3342031157 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bb9d8e0 0x55c75bb9dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd25d400640 1 -- 172.21.15.175:0/3342031157 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bb9d8e0 msgr2=0x55c75bb9dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd25d400640 1 --2- 172.21.15.175:0/3342031157 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bb9d8e0 0x55c75bb9dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd25d400640 1 -- 172.21.15.175:0/3342031157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bbe72e0 msgr2=0x55c75bbe76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd25d400640 1 --2- 172.21.15.175:0/3342031157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bbe72e0 0x55c75bbe76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd25d400640 1 -- 172.21.15.175:0/3342031157 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c75ba93c20 con 0x55c75bbe7c00 2024-04-25T09:09:12.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd25d400640 1 --2- 172.21.15.175:0/3342031157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 0x55c75bb9d3a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fd248052310 tx=0x7fd248055eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50de5b95294c8f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd246a00640 1 -- 172.21.15.175:0/3342031157 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248025e30 con 0x55c75bbe7c00 2024-04-25T09:09:12.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd246a00640 1 -- 172.21.15.175:0/3342031157 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd248053f50 con 0x55c75bbe7c00 2024-04-25T09:09:12.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd246a00640 1 -- 172.21.15.175:0/3342031157 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248052520 con 0x55c75bbe7c00 2024-04-25T09:09:12.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd263ca5000 1 -- 172.21.15.175:0/3342031157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 msgr2=0x55c75bb9d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd263ca5000 1 --2- 172.21.15.175:0/3342031157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 0x55c75bb9d3a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fd248052310 tx=0x7fd248055eb0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd263ca5000 1 -- 172.21.15.175:0/3342031157 shutdown_connections 2024-04-25T09:09:12.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd263ca5000 1 --2- 172.21.15.175:0/3342031157 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bb9d8e0 0x55c75bb9dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd263ca5000 1 --2- 172.21.15.175:0/3342031157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 0x55c75bb9d3a0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd263ca5000 1 --2- 172.21.15.175:0/3342031157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bbe72e0 0x55c75bbe76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd263ca5000 1 -- 172.21.15.175:0/3342031157 >> 172.21.15.175:0/3342031157 conn(0x55c75bb99890 msgr2=0x55c75bb9bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd263ca5000 1 -- 172.21.15.175:0/3342031157 shutdown_connections 2024-04-25T09:09:12.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd263ca5000 1 -- 172.21.15.175:0/3342031157 wait complete. 2024-04-25T09:09:12.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd263ca5000 1 -- start start 2024-04-25T09:09:12.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.339+0000 7fd263ca5000 1 Processor -- start 2024-04-25T09:09:12.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bb9d8e0 0x55c75bbee640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bbe72e0 0x55c75bbeeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 0x55c75bbd5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c75b9e6130 con 0x55c75bbe7c00 2024-04-25T09:09:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c75b9ae130 con 0x55c75bb9d8e0 2024-04-25T09:09:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c75baa8300 con 0x55c75bbe72e0 2024-04-25T09:09:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 10 client.0 _ll_register_callbacks cb 0x55c75bb88bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd25e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 0x55c75bbd5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd25de00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bb9d8e0 0x55c75bbee640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd25e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 0x55c75bbd5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33648/0 (socket says 172.21.15.175:33648) 2024-04-25T09:09:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd25e800640 1 -- 172.21.15.175:0/3944379522 learned_addr learned my addr 172.21.15.175:0/3944379522 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd25d400640 1 --2- 172.21.15.175:0/3944379522 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bbe72e0 0x55c75bbeeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd25e800640 1 -- 172.21.15.175:0/3944379522 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bbe72e0 msgr2=0x55c75bbeeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd25e800640 1 --2- 172.21.15.175:0/3944379522 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bbe72e0 0x55c75bbeeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd25e800640 1 -- 172.21.15.175:0/3944379522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bb9d8e0 msgr2=0x55c75bbee640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd25e800640 1 --2- 172.21.15.175:0/3944379522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bb9d8e0 0x55c75bbee640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd25e800640 1 -- 172.21.15.175:0/3944379522 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c75b9c7060 con 0x55c75bbe7c00 2024-04-25T09:09:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd25e800640 1 --2- 172.21.15.175:0/3944379522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 0x55c75bbd5090 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fd25401d260 tx=0x7fd25401b200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e352c2a00f87dd90 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd23b400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:09:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd23b400640 1 -- 172.21.15.175:0/3944379522 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2540a5b40 con 0x55c75bbe7c00 2024-04-25T09:09:12.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd23b400640 1 -- 172.21.15.175:0/3944379522 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd2540a5ce0 con 0x55c75bbe7c00 2024-04-25T09:09:12.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 1 -- 172.21.15.175:0/3944379522 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd248053f50 con 0x55c75bbe7c00 2024-04-25T09:09:12.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd23b400640 1 -- 172.21.15.175:0/3944379522 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2540c1450 con 0x55c75bbe7c00 2024-04-25T09:09:12.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 10 client.6921 fetch_fsmap learned FSMap version 50 2024-04-25T09:09:12.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 1 -- 172.21.15.175:0/3944379522 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55c75b98b7c0 con 0x55c75bbe7c00 2024-04-25T09:09:12.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd23b400640 1 -- 172.21.15.175:0/3944379522 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd248053f50 con 0x55c75bbe7c00 2024-04-25T09:09:12.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd23b400640 1 -- 172.21.15.175:0/3944379522 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd2540c15f0 con 0x55c75bbe7c00 2024-04-25T09:09:12.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 10 client.6921 fetch_fsmap finished waiting for FSMap version 50 2024-04-25T09:09:12.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 10 client.6921 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:09:12.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 20 client.6921 populate_metadata read hostname 'smithi175' 2024-04-25T09:09:12.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 1 --2- 172.21.15.175:0/3944379522 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55c75bbd5e30 0x55c75bbd6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 4 client.6921 mds_command: new command op to 6513 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:12.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 1 -- 172.21.15.175:0/3944379522 --> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c75b985cd0 con 0x55c75bbd5e30 2024-04-25T09:09:12.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd25de00640 1 --2- 172.21.15.175:0/3944379522 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55c75bbd5e30 0x55c75bbd6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd25de00640 1 --2- 172.21.15.175:0/3944379522 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55c75bbd5e30 0x55c75bbd6210 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb05676f5381c85a server_cookie=83002b0d7416ac52 in_seq=0 out_seq=0 2024-04-25T09:09:12.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd23b400640 10 client.6921 ms_handle_connect on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:12.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd23b400640 1 -- 172.21.15.175:0/3944379522 <== mds.0 v2:172.21.15.175:6834/2714482688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c75b985cd0 con 0x55c75bbd5e30 2024-04-25T09:09:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd23b400640 10 client.6921 handle_command_reply: tid=0 2024-04-25T09:09:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 1 client.6921 shutdown 2024-04-25T09:09:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 1 -- 172.21.15.175:0/3944379522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 msgr2=0x55c75bbd5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 1 --2- 172.21.15.175:0/3944379522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 0x55c75bbd5090 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fd25401d260 tx=0x7fd25401b200 comp rx=0 tx=0).stop 2024-04-25T09:09:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 1 -- 172.21.15.175:0/3944379522 shutdown_connections 2024-04-25T09:09:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 1 --2- 172.21.15.175:0/3944379522 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55c75bbd5e30 0x55c75bbd6210 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 1 --2- 172.21.15.175:0/3944379522 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 0x55c75bbd5090 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 1 --2- 172.21.15.175:0/3944379522 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bbe72e0 0x55c75bbeeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd263ca5000 1 --2- 172.21.15.175:0/3944379522 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bb9d8e0 0x55c75bbee640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.343+0000 7fd23b400640 0 client.6921 ms_handle_reset on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.347+0000 7fd263ca5000 1 -- 172.21.15.175:0/3944379522 >> 172.21.15.175:0/3944379522 conn(0x55c75bb99890 msgr2=0x55c75bb9c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.347+0000 7fd263ca5000 1 -- 172.21.15.175:0/3944379522 shutdown_connections 2024-04-25T09:09:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.347+0000 7fd263ca5000 1 -- 172.21.15.175:0/3944379522 wait complete. 2024-04-25T09:09:12.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.347+0000 7fd263ca5000 20 client.6921 trim_cache size 0 max 16384 2024-04-25T09:09:12.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 Processor -- start 2024-04-25T09:09:12.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 -- start start 2024-04-25T09:09:12.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bb9d8e0 0x55c75bb9d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bbe72e0 0x55c75bbd41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bbe7c00 0x55c75bbd4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd258202620 con 0x55c75bb9d8e0 2024-04-25T09:09:12.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25815fb70 con 0x55c75bbe7c00 2024-04-25T09:09:12.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd258160170 con 0x55c75bbe72e0 2024-04-25T09:09:12.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd25de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bb9d8e0 0x55c75bb9d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd25de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bb9d8e0 0x55c75bb9d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33664/0 (socket says 172.21.15.175:33664) 2024-04-25T09:09:12.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd25de00640 1 -- 172.21.15.175:0/2102246163 learned_addr learned my addr 172.21.15.175:0/2102246163 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:12.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd25d400640 1 --2- 172.21.15.175:0/2102246163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bbe72e0 0x55c75bbd41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd25de00640 1 -- 172.21.15.175:0/2102246163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bbe72e0 msgr2=0x55c75bbd41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd25e800640 1 --2- 172.21.15.175:0/2102246163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bbe7c00 0x55c75bbd4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd25de00640 1 --2- 172.21.15.175:0/2102246163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bbe72e0 0x55c75bbd41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd25de00640 1 -- 172.21.15.175:0/2102246163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bbe7c00 msgr2=0x55c75bbd4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd25de00640 1 --2- 172.21.15.175:0/2102246163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bbe7c00 0x55c75bbd4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd25de00640 1 -- 172.21.15.175:0/2102246163 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c75b9a5fc0 con 0x55c75bb9d8e0 2024-04-25T09:09:12.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd25de00640 1 --2- 172.21.15.175:0/2102246163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bb9d8e0 0x55c75bb9d2c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fd24c010010 tx=0x7fd24c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84118fd929b1f2bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd246000640 1 -- 172.21.15.175:0/2102246163 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c02f070 con 0x55c75bb9d8e0 2024-04-25T09:09:12.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd246000640 1 -- 172.21.15.175:0/2102246163 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24c01c040 con 0x55c75bb9d8e0 2024-04-25T09:09:12.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd246000640 1 -- 172.21.15.175:0/2102246163 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c01b040 con 0x55c75bb9d8e0 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 -- 172.21.15.175:0/2102246163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bb9d8e0 msgr2=0x55c75bb9d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 --2- 172.21.15.175:0/2102246163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bb9d8e0 0x55c75bb9d2c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fd24c010010 tx=0x7fd24c015000 comp rx=0 tx=0).stop 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 -- 172.21.15.175:0/2102246163 shutdown_connections 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 --2- 172.21.15.175:0/2102246163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bbe7c00 0x55c75bbd4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 --2- 172.21.15.175:0/2102246163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bbe72e0 0x55c75bbd41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 --2- 172.21.15.175:0/2102246163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bb9d8e0 0x55c75bb9d2c0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 -- 172.21.15.175:0/2102246163 >> 172.21.15.175:0/2102246163 conn(0x55c75bb99890 msgr2=0x55c75bbf4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 -- 172.21.15.175:0/2102246163 shutdown_connections 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 -- 172.21.15.175:0/2102246163 wait complete. 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 -- start start 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.359+0000 7fd263ca5000 1 Processor -- start 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bb9d8e0 0x55c75bc4f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bbe72e0 0x55c75bc4fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 0x55c75bbeb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c75b984e70 con 0x55c75bbe7c00 2024-04-25T09:09:12.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c75b972a50 con 0x55c75bb9d8e0 2024-04-25T09:09:12.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c75b9e93a0 con 0x55c75bbe72e0 2024-04-25T09:09:12.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 10 client.0 _ll_register_callbacks cb 0x55c75b996240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:12.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd25e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 0x55c75bbeb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd25de00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bb9d8e0 0x55c75bc4f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd25e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 0x55c75bbeb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33680/0 (socket says 172.21.15.175:33680) 2024-04-25T09:09:12.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd25e800640 1 -- 172.21.15.175:0/2132037896 learned_addr learned my addr 172.21.15.175:0/2132037896 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:12.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd25d400640 1 --2- 172.21.15.175:0/2132037896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bbe72e0 0x55c75bc4fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd25e800640 1 -- 172.21.15.175:0/2132037896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bbe72e0 msgr2=0x55c75bc4fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd25e800640 1 --2- 172.21.15.175:0/2132037896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bbe72e0 0x55c75bc4fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd25e800640 1 -- 172.21.15.175:0/2132037896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bb9d8e0 msgr2=0x55c75bc4f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd25e800640 1 --2- 172.21.15.175:0/2132037896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bb9d8e0 0x55c75bc4f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd25e800640 1 -- 172.21.15.175:0/2132037896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c75ba439e0 con 0x55c75bbe7c00 2024-04-25T09:09:12.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd25e800640 1 --2- 172.21.15.175:0/2132037896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 0x55c75bbeb040 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fd2540ab000 tx=0x7fd254009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e10474ca5317429 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd23b400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:09:12.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd23b400640 1 -- 172.21.15.175:0/2132037896 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2540d0020 con 0x55c75bbe7c00 2024-04-25T09:09:12.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd23b400640 1 -- 172.21.15.175:0/2132037896 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd2540a5c50 con 0x55c75bbe7c00 2024-04-25T09:09:12.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 -- 172.21.15.175:0/2132037896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd24c01c040 con 0x55c75bbe7c00 2024-04-25T09:09:12.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd23b400640 1 -- 172.21.15.175:0/2132037896 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2540a5520 con 0x55c75bbe7c00 2024-04-25T09:09:12.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 10 client.6927 fetch_fsmap learned FSMap version 50 2024-04-25T09:09:12.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 -- 172.21.15.175:0/2132037896 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55c75b989630 con 0x55c75bbe7c00 2024-04-25T09:09:12.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd23b400640 1 -- 172.21.15.175:0/2132037896 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24c01c040 con 0x55c75bbe7c00 2024-04-25T09:09:12.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd23b400640 1 -- 172.21.15.175:0/2132037896 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd254008040 con 0x55c75bbe7c00 2024-04-25T09:09:12.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 10 client.6927 fetch_fsmap finished waiting for FSMap version 50 2024-04-25T09:09:12.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 10 client.6927 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 20 client.6927 populate_metadata read hostname 'smithi175' 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 --2- 172.21.15.175:0/2132037896 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55c75bc563b0 0x55c75bc587a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 4 client.6927 mds_command: new command op to 6513 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 -- 172.21.15.175:0/2132037896 --> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x55c75b9f75d0 con 0x55c75bc563b0 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd25de00640 1 --2- 172.21.15.175:0/2132037896 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55c75bc563b0 0x55c75bc587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd23b400640 10 client.6927 ms_handle_connect on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd25de00640 1 --2- 172.21.15.175:0/2132037896 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55c75bc563b0 0x55c75bc587a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c501349e905328e server_cookie=2ceafe623c1a5fb3 in_seq=0 out_seq=0 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd23b400640 1 -- 172.21.15.175:0/2132037896 <== mds.0 v2:172.21.15.175:6834/2714482688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+236 (crc 0 0 0) 0x55c75b9f75d0 con 0x55c75bc563b0 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd23b400640 10 client.6927 handle_command_reply: tid=0 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 client.6927 shutdown 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 -- 172.21.15.175:0/2132037896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 msgr2=0x55c75bbeb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 --2- 172.21.15.175:0/2132037896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 0x55c75bbeb040 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fd2540ab000 tx=0x7fd254009810 comp rx=0 tx=0).stop 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 -- 172.21.15.175:0/2132037896 shutdown_connections 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 --2- 172.21.15.175:0/2132037896 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55c75bc563b0 0x55c75bc587a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 --2- 172.21.15.175:0/2132037896 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c75bbe7c00 0x55c75bbeb040 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 --2- 172.21.15.175:0/2132037896 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c75bbe72e0 0x55c75bc4fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd23b400640 0 client.6927 ms_handle_reset on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 --2- 172.21.15.175:0/2132037896 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c75bb9d8e0 0x55c75bc4f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 -- 172.21.15.175:0/2132037896 >> 172.21.15.175:0/2132037896 conn(0x55c75bb99890 msgr2=0x55c75bbf4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 -- 172.21.15.175:0/2132037896 shutdown_connections 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.363+0000 7fd263ca5000 1 -- 172.21.15.175:0/2132037896 wait complete. 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.367+0000 7fd263ca5000 20 client.6927 trim_cache size 0 max 16384 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi175.stdout:[ 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi175.stdout: "damage_type": "dentry", 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 964291098, 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 1099511627776, 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi175.stdout: "frag": "*", 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi175.stdout: "dname": "file_to_be_damaged", 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi175.stdout: "snap_id": "head", 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi175.stdout: "path": "/subdir/file_to_be_damaged" 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi175.stdout:] 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.367+0000 7fd260800640 1 -- 172.21.15.175:0/725594785 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd23c066f60 msgr2=0x7fd23c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.367+0000 7fd260800640 1 --2- 172.21.15.175:0/725594785 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd23c066f60 0x7fd23c069420 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd24c00ba10 tx=0x7fd24c008040 comp rx=0 tx=0).stop 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.367+0000 7fd260800640 1 -- 172.21.15.175:0/725594785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd25806c080 msgr2=0x7fd2580b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.367+0000 7fd260800640 1 --2- 172.21.15.175:0/725594785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd25806c080 0x7fd2580b0a70 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd24800d800 tx=0x7fd24800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.367+0000 7fd260800640 1 -- 172.21.15.175:0/725594785 shutdown_connections 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.367+0000 7fd260800640 1 --2- 172.21.15.175:0/725594785 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd23c066f60 0x7fd23c069420 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.367+0000 7fd260800640 1 --2- 172.21.15.175:0/725594785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2580cdb60 0x7fd2580c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.367+0000 7fd260800640 1 --2- 172.21.15.175:0/725594785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd25806c080 0x7fd2580b0a70 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.367+0000 7fd260800640 1 --2- 172.21.15.175:0/725594785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd25806ad50 0x7fd2581596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.367+0000 7fd260800640 1 -- 172.21.15.175:0/725594785 >> 172.21.15.175:0/725594785 conn(0x7fd2580cca10 msgr2=0x7fd2580b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.367+0000 7fd260800640 1 -- 172.21.15.175:0/725594785 shutdown_connections 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.367+0000 7fd260800640 1 -- 172.21.15.175:0/725594785 wait complete. 2024-04-25T09:09:12.375 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:09:12.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.519+0000 7ff053a00640 1 Processor -- start 2024-04-25T09:09:12.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.519+0000 7ff053a00640 1 -- start start 2024-04-25T09:09:12.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.519+0000 7ff053a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff04c0cd520 0x7ff04c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.519+0000 7ff053a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff04c0cf560 0x7ff04c0cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.519+0000 7ff053a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff04c0cda00 con 0x7ff04c15a900 2024-04-25T09:09:12.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.519+0000 7ff053a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04c15bcf0 con 0x7ff04c0cf560 2024-04-25T09:09:12.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.519+0000 7ff053a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c0cfef0 con 0x7ff04c0cd520 2024-04-25T09:09:12.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.519+0000 7ff043e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff04c0cd520 0x7ff04c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.523+0000 7ff043e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff04c0cd520 0x7ff04c06e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:45246/0 (socket says 172.21.15.175:45246) 2024-04-25T09:09:12.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.523+0000 7ff043e00640 1 -- 172.21.15.175:0/1618843366 learned_addr learned my addr 172.21.15.175:0/1618843366 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:12.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.523+0000 7ff051a00640 1 --2- 172.21.15.175:0/1618843366 >> v2:172.21.15.177:3300/0 conn(0x7ff04c0cf560 0x7ff04c0cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.523+0000 7ff043e00640 1 -- 172.21.15.175:0/1618843366 >> v2:172.21.15.177:3300/0 conn(0x7ff04c0cf560 msgr2=0x7ff04c0cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.523+0000 7ff043e00640 1 --2- 172.21.15.175:0/1618843366 >> v2:172.21.15.177:3300/0 conn(0x7ff04c0cf560 0x7ff04c0cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.523+0000 7ff043e00640 1 -- 172.21.15.175:0/1618843366 >> v1:172.21.15.177:6789/0 conn(0x7ff04c15a900 legacy=0x7ff04c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.523+0000 7ff043e00640 1 -- 172.21.15.175:0/1618843366 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c0cdce0 con 0x7ff04c0cd520 2024-04-25T09:09:12.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.523+0000 7ff04be00640 1 -- 172.21.15.175:0/1618843366 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846917087 0 0) 0x7ff04c0cda00 con 0x7ff04c15a900 2024-04-25T09:09:12.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.523+0000 7ff043e00640 1 --2- 172.21.15.175:0/1618843366 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff04c0cd520 0x7ff04c06e150 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff034009870 tx=0x7ff03401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fae2da289b39de56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.523+0000 7ff04be00640 1 -- 172.21.15.175:0/1618843366 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0340ab650 con 0x7ff04c0cd520 2024-04-25T09:09:12.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.523+0000 7ff04be00640 1 -- 172.21.15.175:0/1618843366 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0340b0070 con 0x7ff04c0cd520 2024-04-25T09:09:12.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.523+0000 7ff04be00640 1 -- 172.21.15.175:0/1618843366 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0340aba10 con 0x7ff04c0cd520 2024-04-25T09:09:12.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff053a00640 1 -- 172.21.15.175:0/1618843366 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff04c0cd520 msgr2=0x7ff04c06e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff053a00640 1 --2- 172.21.15.175:0/1618843366 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff04c0cd520 0x7ff04c06e150 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff034009870 tx=0x7ff03401c560 comp rx=0 tx=0).stop 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff053a00640 1 -- 172.21.15.175:0/1618843366 shutdown_connections 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff053a00640 1 --2- 172.21.15.175:0/1618843366 >> v2:172.21.15.177:3300/0 conn(0x7ff04c0cf560 0x7ff04c0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff053a00640 1 --2- 172.21.15.175:0/1618843366 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff04c0cd520 0x7ff04c06e150 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff053a00640 1 -- 172.21.15.175:0/1618843366 >> 172.21.15.175:0/1618843366 conn(0x7ff04c067150 msgr2=0x7ff04c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff053a00640 1 -- 172.21.15.175:0/1618843366 shutdown_connections 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff053a00640 1 -- 172.21.15.175:0/1618843366 wait complete. 2024-04-25T09:09:12.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff053a00640 1 Processor -- start 2024-04-25T09:09:12.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff053a00640 1 -- start start 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff053a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff04c0cf560 0x7ff04c14e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff053a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff04c15a900 0x7ff04c143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff053a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff04c143b50 0x7ff04c167400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff053a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c06d530 con 0x7ff04c15a900 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff053a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c06d3b0 con 0x7ff04c0cf560 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff053a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c15c790 con 0x7ff04c143b50 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff043e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff04c15a900 0x7ff04c143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff043e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff04c15a900 0x7ff04c143130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33692/0 (socket says 172.21.15.175:33692) 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff043e00640 1 -- 172.21.15.175:0/3899062087 learned_addr learned my addr 172.21.15.175:0/3899062087 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff051000640 1 --2- 172.21.15.175:0/3899062087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff04c0cf560 0x7ff04c14e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff051a00640 1 --2- 172.21.15.175:0/3899062087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff04c143b50 0x7ff04c167400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff043e00640 1 -- 172.21.15.175:0/3899062087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff04c143b50 msgr2=0x7ff04c167400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff043e00640 1 --2- 172.21.15.175:0/3899062087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff04c143b50 0x7ff04c167400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff043e00640 1 -- 172.21.15.175:0/3899062087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff04c0cf560 msgr2=0x7ff04c14e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff043e00640 1 --2- 172.21.15.175:0/3899062087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff04c0cf560 0x7ff04c14e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.527+0000 7ff043e00640 1 -- 172.21.15.175:0/3899062087 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c150260 con 0x7ff04c15a900 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.531+0000 7ff043e00640 1 --2- 172.21.15.175:0/3899062087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff04c15a900 0x7ff04c143130 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ff0340ad040 tx=0x7ff03401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.531+0000 7ff049600640 1 -- 172.21.15.175:0/3899062087 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0340be5f0 con 0x7ff04c15a900 2024-04-25T09:09:12.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.531+0000 7ff049600640 1 -- 172.21.15.175:0/3899062087 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0340be790 con 0x7ff04c15a900 2024-04-25T09:09:12.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.531+0000 7ff049600640 1 -- 172.21.15.175:0/3899062087 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0340beb80 con 0x7ff04c15a900 2024-04-25T09:09:12.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.531+0000 7ff053a00640 1 -- 172.21.15.175:0/3899062087 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04c1472c0 con 0x7ff04c15a900 2024-04-25T09:09:12.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.531+0000 7ff053a00640 1 -- 172.21.15.175:0/3899062087 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04c147880 con 0x7ff04c15a900 2024-04-25T09:09:12.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.531+0000 7ff053a00640 1 -- 172.21.15.175:0/3899062087 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04c147a50 con 0x7ff04c15a900 2024-04-25T09:09:12.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.531+0000 7ff049600640 1 -- 172.21.15.175:0/3899062087 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff0340b43f0 con 0x7ff04c15a900 2024-04-25T09:09:12.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.531+0000 7ff049600640 1 --2- 172.21.15.175:0/3899062087 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff028066f60 0x7ff028069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.531+0000 7ff049600640 1 -- 172.21.15.175:0/3899062087 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7ff03411fbc0 con 0x7ff04c15a900 2024-04-25T09:09:12.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.531+0000 7ff051000640 1 --2- 172.21.15.175:0/3899062087 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff028066f60 0x7ff028069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.531+0000 7ff051000640 1 --2- 172.21.15.175:0/3899062087 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff028066f60 0x7ff028069420 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff03c007fd0 tx=0x7ff03c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.535+0000 7ff049600640 1 -- 172.21.15.175:0/3899062087 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff034016150 con 0x7ff04c15a900 2024-04-25T09:09:12.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.723+0000 7ff053a00640 1 -- 172.21.15.175:0/3899062087 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff04c074a60 con 0x7ff04c15a900 2024-04-25T09:09:12.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.723+0000 7ff049600640 1 -- 172.21.15.175:0/3899062087 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7ff0340f0450 con 0x7ff04c15a900 2024-04-25T09:09:12.714 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:09:12.715 INFO:teuthology.orchestra.run.smithi175.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-25T09:09:12.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.723+0000 7ff053a00640 1 -- 172.21.15.175:0/3899062087 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff028066f60 msgr2=0x7ff028069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.723+0000 7ff053a00640 1 --2- 172.21.15.175:0/3899062087 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff028066f60 0x7ff028069420 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff03c007fd0 tx=0x7ff03c009040 comp rx=0 tx=0).stop 2024-04-25T09:09:12.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.723+0000 7ff053a00640 1 -- 172.21.15.175:0/3899062087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff04c15a900 msgr2=0x7ff04c143130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.723+0000 7ff053a00640 1 --2- 172.21.15.175:0/3899062087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff04c15a900 0x7ff04c143130 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ff0340ad040 tx=0x7ff03401ada0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.723+0000 7ff053a00640 1 -- 172.21.15.175:0/3899062087 shutdown_connections 2024-04-25T09:09:12.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.723+0000 7ff053a00640 1 --2- 172.21.15.175:0/3899062087 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff028066f60 0x7ff028069420 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.723+0000 7ff053a00640 1 --2- 172.21.15.175:0/3899062087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff04c143b50 0x7ff04c167400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.723+0000 7ff053a00640 1 --2- 172.21.15.175:0/3899062087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff04c15a900 0x7ff04c143130 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.723+0000 7ff053a00640 1 --2- 172.21.15.175:0/3899062087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff04c0cf560 0x7ff04c14e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.723+0000 7ff053a00640 1 -- 172.21.15.175:0/3899062087 >> 172.21.15.175:0/3899062087 conn(0x7ff04c0cd520 msgr2=0x7ff04c158f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.727+0000 7ff053a00640 1 -- 172.21.15.175:0/3899062087 shutdown_connections 2024-04-25T09:09:12.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.727+0000 7ff053a00640 1 -- 172.21.15.175:0/3899062087 wait complete. 2024-04-25T09:09:12.734 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T09:09:12.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:12.735 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir repair,recursive 2024-04-25T09:09:12.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.883+0000 7f6568a00640 1 Processor -- start 2024-04-25T09:09:12.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.887+0000 7f6568a00640 1 -- start start 2024-04-25T09:09:12.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.887+0000 7f6568a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f65640cfb60 0x7f65640ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.887+0000 7f6568a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f656406d860 0x7f656406dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.887+0000 7f6568a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656406e1a0 con 0x7f65640ced10 2024-04-25T09:09:12.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.887+0000 7f6568a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65640cbed0 con 0x7f65640cfb60 2024-04-25T09:09:12.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.887+0000 7f6568a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6564071e20 con 0x7f656406d860 2024-04-25T09:09:12.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.887+0000 7f6562800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f656406d860 0x7f656406dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.887+0000 7f655be00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f65640ced10 0x7f65640712b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:44140/0 (socket says 172.21.15.175:44140) 2024-04-25T09:09:12.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.887+0000 7f655be00640 1 -- 172.21.15.175:0/2774320749 learned_addr learned my addr 172.21.15.175:0/2774320749 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:12.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.887+0000 7f6561e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f65640cfb60 0x7f65640ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.887+0000 7f6561400640 1 -- 172.21.15.175:0/2774320749 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069878432 0 0) 0x7f656406e1a0 con 0x7f65640ced10 2024-04-25T09:09:12.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.887+0000 7f6562800640 1 -- 172.21.15.175:0/2774320749 >> v2:172.21.15.177:3300/0 conn(0x7f65640cfb60 msgr2=0x7f65640ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.887+0000 7f6562800640 1 --2- 172.21.15.175:0/2774320749 >> v2:172.21.15.177:3300/0 conn(0x7f65640cfb60 0x7f65640ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.887+0000 7f6562800640 1 -- 172.21.15.175:0/2774320749 >> v1:172.21.15.177:6789/0 conn(0x7f65640ced10 legacy=0x7f65640712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.887+0000 7f6562800640 1 -- 172.21.15.175:0/2774320749 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6564072100 con 0x7f656406d860 2024-04-25T09:09:12.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.891+0000 7f6562800640 1 --2- 172.21.15.175:0/2774320749 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f656406d860 0x7f656406dc60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f655c009d90 tx=0x7f655c01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29003c06f8c99c61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.891+0000 7f6561400640 1 -- 172.21.15.175:0/2774320749 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c0b2070 con 0x7f656406d860 2024-04-25T09:09:12.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.891+0000 7f6561400640 1 -- 172.21.15.175:0/2774320749 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655c0a5970 con 0x7f656406d860 2024-04-25T09:09:12.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.891+0000 7f6561400640 1 -- 172.21.15.175:0/2774320749 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c0a5d40 con 0x7f656406d860 2024-04-25T09:09:12.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.891+0000 7f6568a00640 1 -- 172.21.15.175:0/2774320749 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f656406d860 msgr2=0x7f656406dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.891+0000 7f6568a00640 1 --2- 172.21.15.175:0/2774320749 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f656406d860 0x7f656406dc60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f655c009d90 tx=0x7f655c01c8b0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.891+0000 7f6568a00640 1 -- 172.21.15.175:0/2774320749 shutdown_connections 2024-04-25T09:09:12.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.891+0000 7f6568a00640 1 --2- 172.21.15.175:0/2774320749 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f656406d860 0x7f656406dc60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.891+0000 7f6568a00640 1 --2- 172.21.15.175:0/2774320749 >> v2:172.21.15.177:3300/0 conn(0x7f65640cfb60 0x7f65640ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.891+0000 7f6568a00640 1 -- 172.21.15.175:0/2774320749 >> 172.21.15.175:0/2774320749 conn(0x7f656406ac50 msgr2=0x7f656406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.891+0000 7f6568a00640 1 -- 172.21.15.175:0/2774320749 shutdown_connections 2024-04-25T09:09:12.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.891+0000 7f6568a00640 1 -- 172.21.15.175:0/2774320749 wait complete. 2024-04-25T09:09:12.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.891+0000 7f6568a00640 1 Processor -- start 2024-04-25T09:09:12.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.891+0000 7f6568a00640 1 -- start start 2024-04-25T09:09:12.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f6568a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f656406d860 0x7f656413d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f6568a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65640ced10 0x7f656415b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f6568a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65640cfb60 0x7f656415b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f6568a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65640d00c0 con 0x7f65640cfb60 2024-04-25T09:09:12.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f6568a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65640cff40 con 0x7f656406d860 2024-04-25T09:09:12.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f6568a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65640719c0 con 0x7f65640ced10 2024-04-25T09:09:12.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f6562800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65640cfb60 0x7f656415b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f6562800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65640cfb60 0x7f656415b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33698/0 (socket says 172.21.15.175:33698) 2024-04-25T09:09:12.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f6562800640 1 -- 172.21.15.175:0/2429391669 learned_addr learned my addr 172.21.15.175:0/2429391669 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:12.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f655be00640 1 --2- 172.21.15.175:0/2429391669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65640ced10 0x7f656415b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f6561e00640 1 --2- 172.21.15.175:0/2429391669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f656406d860 0x7f656413d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f6562800640 1 -- 172.21.15.175:0/2429391669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65640ced10 msgr2=0x7f656415b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f6562800640 1 --2- 172.21.15.175:0/2429391669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65640ced10 0x7f656415b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f6562800640 1 -- 172.21.15.175:0/2429391669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f656406d860 msgr2=0x7f656413d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f6562800640 1 --2- 172.21.15.175:0/2429391669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f656406d860 0x7f656413d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f6562800640 1 -- 172.21.15.175:0/2429391669 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656413f030 con 0x7f65640cfb60 2024-04-25T09:09:12.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f6562800640 1 --2- 172.21.15.175:0/2429391669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65640cfb60 0x7f656415b600 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f655c0b0040 tx=0x7f655c019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f655a000640 1 -- 172.21.15.175:0/2429391669 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c0b2050 con 0x7f65640cfb60 2024-04-25T09:09:12.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f655a000640 1 -- 172.21.15.175:0/2429391669 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655c0be070 con 0x7f65640cfb60 2024-04-25T09:09:12.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f655a000640 1 -- 172.21.15.175:0/2429391669 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c0ada50 con 0x7f65640cfb60 2024-04-25T09:09:12.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f6568a00640 1 -- 172.21.15.175:0/2429391669 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65640b0a60 con 0x7f65640cfb60 2024-04-25T09:09:12.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.895+0000 7f6568a00640 1 -- 172.21.15.175:0/2429391669 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65640aff80 con 0x7f65640cfb60 2024-04-25T09:09:12.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f655a000640 1 -- 172.21.15.175:0/2429391669 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f655c0adbf0 con 0x7f65640cfb60 2024-04-25T09:09:12.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f655a000640 1 --2- 172.21.15.175:0/2429391669 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6540066f60 0x7f6540069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f655a000640 1 -- 172.21.15.175:0/2429391669 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f655c1203d0 con 0x7f65640cfb60 2024-04-25T09:09:12.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f6561e00640 1 --2- 172.21.15.175:0/2429391669 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6540066f60 0x7f6540069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f656bf41000 1 Processor -- start 2024-04-25T09:09:12.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f656bf41000 1 -- start start 2024-04-25T09:09:12.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f6561e00640 1 --2- 172.21.15.175:0/2429391669 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6540066f60 0x7f6540069420 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6554009a50 tx=0x7f6554008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f656bf41000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5fed40 0x5560eb5ff120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f656bf41000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5ff660 0x5560eb5b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f656bf41000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5b55f0 0x5560eb5b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f656bf41000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560eb403c40 con 0x5560eb5b55f0 2024-04-25T09:09:12.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f656bf41000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560eb38c1d0 con 0x5560eb5ff660 2024-04-25T09:09:12.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f656bf41000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560eb3ffce0 con 0x5560eb5fed40 2024-04-25T09:09:12.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f6562800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5b55f0 0x5560eb5b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f6562800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5b55f0 0x5560eb5b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33702/0 (socket says 172.21.15.175:33702) 2024-04-25T09:09:12.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f6562800640 1 -- 172.21.15.175:0/252994147 learned_addr learned my addr 172.21.15.175:0/252994147 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:12.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f6561e00640 1 --2- 172.21.15.175:0/252994147 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5fed40 0x5560eb5ff120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f655be00640 1 --2- 172.21.15.175:0/252994147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5ff660 0x5560eb5b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f6562800640 1 -- 172.21.15.175:0/252994147 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5fed40 msgr2=0x5560eb5ff120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f6562800640 1 --2- 172.21.15.175:0/252994147 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5fed40 0x5560eb5ff120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f6562800640 1 -- 172.21.15.175:0/252994147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5ff660 msgr2=0x5560eb5b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f6562800640 1 --2- 172.21.15.175:0/252994147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5ff660 0x5560eb5b50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f6562800640 1 -- 172.21.15.175:0/252994147 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560eb4492a0 con 0x5560eb5b55f0 2024-04-25T09:09:12.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f6561e00640 1 --2- 172.21.15.175:0/252994147 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5fed40 0x5560eb5ff120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:12.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f6562800640 1 --2- 172.21.15.175:0/252994147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5b55f0 0x5560eb5b59d0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f655c0f09e0 tx=0x7f655c0b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd873bfc9cccefcc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f6552a00640 1 -- 172.21.15.175:0/252994147 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c0f4e30 con 0x5560eb5b55f0 2024-04-25T09:09:12.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f6552a00640 1 -- 172.21.15.175:0/252994147 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655c0b3040 con 0x5560eb5b55f0 2024-04-25T09:09:12.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.899+0000 7f6552a00640 1 -- 172.21.15.175:0/252994147 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c0f93f0 con 0x5560eb5b55f0 2024-04-25T09:09:12.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 -- 172.21.15.175:0/252994147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5b55f0 msgr2=0x5560eb5b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 --2- 172.21.15.175:0/252994147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5b55f0 0x5560eb5b59d0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f655c0f09e0 tx=0x7f655c0b7000 comp rx=0 tx=0).stop 2024-04-25T09:09:12.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 -- 172.21.15.175:0/252994147 shutdown_connections 2024-04-25T09:09:12.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 --2- 172.21.15.175:0/252994147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5b55f0 0x5560eb5b59d0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 --2- 172.21.15.175:0/252994147 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5ff660 0x5560eb5b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 --2- 172.21.15.175:0/252994147 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5fed40 0x5560eb5ff120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 -- 172.21.15.175:0/252994147 >> 172.21.15.175:0/252994147 conn(0x5560eb5b15a0 msgr2=0x5560eb5b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 -- 172.21.15.175:0/252994147 shutdown_connections 2024-04-25T09:09:12.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 -- 172.21.15.175:0/252994147 wait complete. 2024-04-25T09:09:12.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 -- start start 2024-04-25T09:09:12.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 Processor -- start 2024-04-25T09:09:12.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5b55f0 0x5560eb5badd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5fed40 0x5560eb5e3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5ff660 0x5560eb5e42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560eb3bea90 con 0x5560eb5ff660 2024-04-25T09:09:12.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560eb3aa8b0 con 0x5560eb5fed40 2024-04-25T09:09:12.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560eb400cb0 con 0x5560eb5b55f0 2024-04-25T09:09:12.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 10 client.0 _ll_register_callbacks cb 0x5560eb5a0410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:12.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f6562800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5ff660 0x5560eb5e42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f6562800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5ff660 0x5560eb5e42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33718/0 (socket says 172.21.15.175:33718) 2024-04-25T09:09:12.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f6562800640 1 -- 172.21.15.175:0/3009353404 learned_addr learned my addr 172.21.15.175:0/3009353404 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:12.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f6561e00640 1 --2- 172.21.15.175:0/3009353404 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5b55f0 0x5560eb5badd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f655be00640 1 --2- 172.21.15.175:0/3009353404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5fed40 0x5560eb5e3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f6562800640 1 -- 172.21.15.175:0/3009353404 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5b55f0 msgr2=0x5560eb5badd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f6562800640 1 --2- 172.21.15.175:0/3009353404 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5b55f0 0x5560eb5badd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f6562800640 1 -- 172.21.15.175:0/3009353404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5fed40 msgr2=0x5560eb5e3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f6562800640 1 --2- 172.21.15.175:0/3009353404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5fed40 0x5560eb5e3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f6562800640 1 -- 172.21.15.175:0/3009353404 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560eb3bc730 con 0x5560eb5ff660 2024-04-25T09:09:12.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f6562800640 1 --2- 172.21.15.175:0/3009353404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5ff660 0x5560eb5e42b0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f655c098490 tx=0x7f655c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e727b744a446c68b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f6547400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:09:12.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f6547400640 1 -- 172.21.15.175:0/3009353404 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c0f4e30 con 0x5560eb5ff660 2024-04-25T09:09:12.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f6547400640 1 -- 172.21.15.175:0/3009353404 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f655c1200e0 con 0x5560eb5ff660 2024-04-25T09:09:12.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 -- 172.21.15.175:0/3009353404 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f655c0b3040 con 0x5560eb5ff660 2024-04-25T09:09:12.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f6547400640 1 -- 172.21.15.175:0/3009353404 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f655c0a5870 con 0x5560eb5ff660 2024-04-25T09:09:12.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 10 client.6939 fetch_fsmap learned FSMap version 50 2024-04-25T09:09:12.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 -- 172.21.15.175:0/3009353404 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x5560eb38c420 con 0x5560eb5ff660 2024-04-25T09:09:12.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f6547400640 1 -- 172.21.15.175:0/3009353404 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655c0b3040 con 0x5560eb5ff660 2024-04-25T09:09:12.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f6547400640 1 -- 172.21.15.175:0/3009353404 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f655c0f8f60 con 0x5560eb5ff660 2024-04-25T09:09:12.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 10 client.6939 fetch_fsmap finished waiting for FSMap version 50 2024-04-25T09:09:12.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 10 client.6939 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:09:12.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 20 client.6939 populate_metadata read hostname 'smithi175' 2024-04-25T09:09:12.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 --2- 172.21.15.175:0/3009353404 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x5560eb6060d0 0x5560eb6064e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 4 client.6939 mds_command: new command op to 6513 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:12.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.903+0000 7f656bf41000 1 -- 172.21.15.175:0/3009353404 --> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5560eb39fb50 con 0x5560eb6060d0 2024-04-25T09:09:12.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.907+0000 7f6561e00640 1 --2- 172.21.15.175:0/3009353404 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x5560eb6060d0 0x5560eb6064e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.907+0000 7f6561e00640 1 --2- 172.21.15.175:0/3009353404 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x5560eb6060d0 0x5560eb6064e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3915443e623fd8 server_cookie=90d1d9503edf62dd in_seq=0 out_seq=0 2024-04-25T09:09:12.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.907+0000 7f6547400640 10 client.6939 ms_handle_connect on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:12.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.907+0000 7f6547400640 1 -- 172.21.15.175:0/3009353404 <== mds.0 v2:172.21.15.175:6834/2714482688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5560eb39fb50 con 0x5560eb6060d0 2024-04-25T09:09:12.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.907+0000 7f6547400640 10 client.6939 handle_command_reply: tid=0 2024-04-25T09:09:12.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.907+0000 7f656bf41000 1 client.6939 shutdown 2024-04-25T09:09:12.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.907+0000 7f656bf41000 1 -- 172.21.15.175:0/3009353404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5ff660 msgr2=0x5560eb5e42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.907+0000 7f656bf41000 1 --2- 172.21.15.175:0/3009353404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5ff660 0x5560eb5e42b0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f655c098490 tx=0x7f655c009750 comp rx=0 tx=0).stop 2024-04-25T09:09:12.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.907+0000 7f656bf41000 1 -- 172.21.15.175:0/3009353404 shutdown_connections 2024-04-25T09:09:12.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.907+0000 7f656bf41000 1 --2- 172.21.15.175:0/3009353404 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x5560eb6060d0 0x5560eb6064e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.907+0000 7f656bf41000 1 --2- 172.21.15.175:0/3009353404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5ff660 0x5560eb5e42b0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.907+0000 7f656bf41000 1 --2- 172.21.15.175:0/3009353404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5fed40 0x5560eb5e3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.907+0000 7f656bf41000 1 --2- 172.21.15.175:0/3009353404 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5b55f0 0x5560eb5badd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.907+0000 7f6547400640 0 client.6939 ms_handle_reset on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:12.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.907+0000 7f656bf41000 1 -- 172.21.15.175:0/3009353404 >> 172.21.15.175:0/3009353404 conn(0x5560eb5b15a0 msgr2=0x5560eb5b4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.907+0000 7f656bf41000 1 -- 172.21.15.175:0/3009353404 shutdown_connections 2024-04-25T09:09:12.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.907+0000 7f656bf41000 1 -- 172.21.15.175:0/3009353404 wait complete. 2024-04-25T09:09:12.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.907+0000 7f656bf41000 20 client.6939 trim_cache size 0 max 16384 2024-04-25T09:09:12.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f656bf41000 1 Processor -- start 2024-04-25T09:09:12.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f656bf41000 1 -- start start 2024-04-25T09:09:12.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f656bf41000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5b55f0 0x5560eb5fe270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f656bf41000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5fed40 0x5560eb5fe7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f656bf41000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5ff660 0x5560eb5fce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f656bf41000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6564202b40 con 0x5560eb5fed40 2024-04-25T09:09:12.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f656bf41000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6564160300 con 0x5560eb5b55f0 2024-04-25T09:09:12.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f656bf41000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656413aaa0 con 0x5560eb5ff660 2024-04-25T09:09:12.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f655be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5fed40 0x5560eb5fe7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f655be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5fed40 0x5560eb5fe7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33722/0 (socket says 172.21.15.175:33722) 2024-04-25T09:09:12.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f655be00640 1 -- 172.21.15.175:0/823124944 learned_addr learned my addr 172.21.15.175:0/823124944 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:12.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f6561e00640 1 --2- 172.21.15.175:0/823124944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5b55f0 0x5560eb5fe270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f6562800640 1 --2- 172.21.15.175:0/823124944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5ff660 0x5560eb5fce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f655be00640 1 -- 172.21.15.175:0/823124944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5ff660 msgr2=0x5560eb5fce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f655be00640 1 --2- 172.21.15.175:0/823124944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5ff660 0x5560eb5fce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f655be00640 1 -- 172.21.15.175:0/823124944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5b55f0 msgr2=0x5560eb5fe270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f655be00640 1 --2- 172.21.15.175:0/823124944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5b55f0 0x5560eb5fe270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f655be00640 1 -- 172.21.15.175:0/823124944 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560eb488550 con 0x5560eb5fed40 2024-04-25T09:09:12.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f6561e00640 1 --2- 172.21.15.175:0/823124944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5b55f0 0x5560eb5fe270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:12.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f655be00640 1 --2- 172.21.15.175:0/823124944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5fed40 0x5560eb5fe7b0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f654c007970 tx=0x7f654c005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a39ef511a6ac03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f6552000640 1 -- 172.21.15.175:0/823124944 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c010040 con 0x5560eb5fed40 2024-04-25T09:09:12.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f6552000640 1 -- 172.21.15.175:0/823124944 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c01a070 con 0x5560eb5fed40 2024-04-25T09:09:12.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.923+0000 7f6552000640 1 -- 172.21.15.175:0/823124944 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c001ae0 con 0x5560eb5fed40 2024-04-25T09:09:12.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 -- 172.21.15.175:0/823124944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5fed40 msgr2=0x5560eb5fe7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 --2- 172.21.15.175:0/823124944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5fed40 0x5560eb5fe7b0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f654c007970 tx=0x7f654c005bd0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 -- 172.21.15.175:0/823124944 shutdown_connections 2024-04-25T09:09:12.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 --2- 172.21.15.175:0/823124944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5ff660 0x5560eb5fce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 --2- 172.21.15.175:0/823124944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5fed40 0x5560eb5fe7b0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 --2- 172.21.15.175:0/823124944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5b55f0 0x5560eb5fe270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 -- 172.21.15.175:0/823124944 >> 172.21.15.175:0/823124944 conn(0x5560eb5b15a0 msgr2=0x5560eb60cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 -- 172.21.15.175:0/823124944 shutdown_connections 2024-04-25T09:09:12.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 -- 172.21.15.175:0/823124944 wait complete. 2024-04-25T09:09:12.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 -- start start 2024-04-25T09:09:12.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 Processor -- start 2024-04-25T09:09:12.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5b55f0 0x5560eb6609b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5fed40 0x5560eb662f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5ff660 0x5560eb665450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560eb3cf230 con 0x5560eb5fed40 2024-04-25T09:09:12.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656415fd00 con 0x5560eb5ff660 2024-04-25T09:09:12.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5560eb3aa8b0 con 0x5560eb5b55f0 2024-04-25T09:09:12.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 10 client.0 _ll_register_callbacks cb 0x7f655c0ecf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:12.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f655be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5fed40 0x5560eb662f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f655be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5fed40 0x5560eb662f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33734/0 (socket says 172.21.15.175:33734) 2024-04-25T09:09:12.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f655be00640 1 -- 172.21.15.175:0/284013575 learned_addr learned my addr 172.21.15.175:0/284013575 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:12.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f6561e00640 1 --2- 172.21.15.175:0/284013575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5b55f0 0x5560eb6609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f6562800640 1 --2- 172.21.15.175:0/284013575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5ff660 0x5560eb665450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f655be00640 1 -- 172.21.15.175:0/284013575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5b55f0 msgr2=0x5560eb6609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f655be00640 1 --2- 172.21.15.175:0/284013575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5b55f0 0x5560eb6609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f655be00640 1 -- 172.21.15.175:0/284013575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5ff660 msgr2=0x5560eb665450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f655be00640 1 --2- 172.21.15.175:0/284013575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5ff660 0x5560eb665450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f655be00640 1 -- 172.21.15.175:0/284013575 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560eb3b6490 con 0x5560eb5fed40 2024-04-25T09:09:12.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f6561e00640 1 --2- 172.21.15.175:0/284013575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5b55f0 0x5560eb6609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:12.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f655be00640 1 --2- 172.21.15.175:0/284013575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5fed40 0x5560eb662f00 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x5560eb40add0 tx=0x7f654c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721f69d910406108 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f6547400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:09:12.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f6547400640 1 -- 172.21.15.175:0/284013575 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c001d30 con 0x5560eb5fed40 2024-04-25T09:09:12.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f6547400640 1 -- 172.21.15.175:0/284013575 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f654c020410 con 0x5560eb5fed40 2024-04-25T09:09:12.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 -- 172.21.15.175:0/284013575 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f654c01a070 con 0x5560eb5fed40 2024-04-25T09:09:12.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f6547400640 1 -- 172.21.15.175:0/284013575 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f654c030050 con 0x5560eb5fed40 2024-04-25T09:09:12.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 10 client.6945 fetch_fsmap learned FSMap version 50 2024-04-25T09:09:12.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 -- 172.21.15.175:0/284013575 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x5560eb3ab1b0 con 0x5560eb5fed40 2024-04-25T09:09:12.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f6547400640 1 -- 172.21.15.175:0/284013575 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c01a070 con 0x5560eb5fed40 2024-04-25T09:09:12.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f6547400640 1 -- 172.21.15.175:0/284013575 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f654c033020 con 0x5560eb5fed40 2024-04-25T09:09:12.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 10 client.6945 fetch_fsmap finished waiting for FSMap version 50 2024-04-25T09:09:12.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 10 client.6945 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:09:12.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 20 client.6945 populate_metadata read hostname 'smithi175' 2024-04-25T09:09:12.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 --2- 172.21.15.175:0/284013575 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x5560eb665990 0x5560eb667d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 4 client.6945 mds_command: new command op to 6513 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}] 2024-04-25T09:09:12.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.927+0000 7f656bf41000 1 -- 172.21.15.175:0/284013575 --> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}) v1 -- 0x5560eb411180 con 0x5560eb665990 2024-04-25T09:09:12.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f6561e00640 1 --2- 172.21.15.175:0/284013575 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x5560eb665990 0x5560eb667d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f6561e00640 1 --2- 172.21.15.175:0/284013575 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x5560eb665990 0x5560eb667d80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b984f2f6a8d96c8 server_cookie=885edac3755f9e70 in_seq=0 out_seq=0 2024-04-25T09:09:12.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f6547400640 10 client.6945 ms_handle_connect on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:12.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f6547400640 1 -- 172.21.15.175:0/284013575 <== mds.0 v2:172.21.15.175:6834/2714482688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5560eb411180 con 0x5560eb665990 2024-04-25T09:09:12.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f6547400640 10 client.6945 handle_command_reply: tid=0 2024-04-25T09:09:12.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f656bf41000 1 client.6945 shutdown 2024-04-25T09:09:12.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f656bf41000 1 -- 172.21.15.175:0/284013575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5fed40 msgr2=0x5560eb662f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f656bf41000 1 --2- 172.21.15.175:0/284013575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5fed40 0x5560eb662f00 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x5560eb40add0 tx=0x7f654c000ee0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f656bf41000 1 -- 172.21.15.175:0/284013575 shutdown_connections 2024-04-25T09:09:12.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f656bf41000 1 --2- 172.21.15.175:0/284013575 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x5560eb665990 0x5560eb667d80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f656bf41000 1 --2- 172.21.15.175:0/284013575 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5560eb5ff660 0x5560eb665450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f656bf41000 1 --2- 172.21.15.175:0/284013575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5560eb5fed40 0x5560eb662f00 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f656bf41000 1 --2- 172.21.15.175:0/284013575 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5560eb5b55f0 0x5560eb6609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f656bf41000 1 -- 172.21.15.175:0/284013575 >> 172.21.15.175:0/284013575 conn(0x5560eb5b15a0 msgr2=0x5560eb5e3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f6547400640 0 client.6945 ms_handle_reset on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:12.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f656bf41000 1 -- 172.21.15.175:0/284013575 shutdown_connections 2024-04-25T09:09:12.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f656bf41000 1 -- 172.21.15.175:0/284013575 wait complete. 2024-04-25T09:09:12.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f656bf41000 20 client.6945 trim_cache size 0 max 16384 2024-04-25T09:09:12.927 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:09:12.927 INFO:teuthology.orchestra.run.smithi175.stdout: "return_code": 0, 2024-04-25T09:09:12.927 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_tag": "b2122a26-50a9-404a-bf9d-956cbddee9fe", 2024-04-25T09:09:12.927 INFO:teuthology.orchestra.run.smithi175.stdout: "mode": "asynchronous" 2024-04-25T09:09:12.927 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:09:12.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f6568a00640 1 -- 172.21.15.175:0/2429391669 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6540066f60 msgr2=0x7f6540069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f6568a00640 1 --2- 172.21.15.175:0/2429391669 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6540066f60 0x7f6540069420 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6554009a50 tx=0x7f6554008040 comp rx=0 tx=0).stop 2024-04-25T09:09:12.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f6568a00640 1 -- 172.21.15.175:0/2429391669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65640cfb60 msgr2=0x7f656415b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f6568a00640 1 --2- 172.21.15.175:0/2429391669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65640cfb60 0x7f656415b600 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f655c0b0040 tx=0x7f655c019650 comp rx=0 tx=0).stop 2024-04-25T09:09:12.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f6568a00640 1 -- 172.21.15.175:0/2429391669 shutdown_connections 2024-04-25T09:09:12.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f6568a00640 1 --2- 172.21.15.175:0/2429391669 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6540066f60 0x7f6540069420 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f6568a00640 1 --2- 172.21.15.175:0/2429391669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65640cfb60 0x7f656415b600 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f6568a00640 1 --2- 172.21.15.175:0/2429391669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65640ced10 0x7f656415b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f6568a00640 1 --2- 172.21.15.175:0/2429391669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f656406d860 0x7f656413d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f6568a00640 1 -- 172.21.15.175:0/2429391669 >> 172.21.15.175:0/2429391669 conn(0x7f656406ac50 msgr2=0x7f656413fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f6568a00640 1 -- 172.21.15.175:0/2429391669 shutdown_connections 2024-04-25T09:09:12.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:12.931+0000 7f6568a00640 1 -- 172.21.15.175:0/2429391669 wait complete. 2024-04-25T09:09:12.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:12.940 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T09:09:13.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.091+0000 7fd5bf400640 1 Processor -- start 2024-04-25T09:09:13.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.091+0000 7fd5bf400640 1 -- start start 2024-04-25T09:09:13.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.091+0000 7fd5bf400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd5b80cbe60 0x7fd5b815af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.091+0000 7fd5bf400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b806d310 0x7fd5b80b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.091+0000 7fd5bf400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd5b80b4630 0x7fd5b80b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.091+0000 7fd5bf400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b806db60 con 0x7fd5b80b4630 2024-04-25T09:09:13.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.091+0000 7fd5bf400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b806de40 con 0x7fd5b80cbe60 2024-04-25T09:09:13.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.091+0000 7fd5bf400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b806e120 con 0x7fd5b806d310 2024-04-25T09:09:13.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.091+0000 7fd5bd400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd5b80b4630 0x7fd5b80b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.091+0000 7fd5bd400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd5b80b4630 0x7fd5b80b2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33738/0 (socket says 172.21.15.175:33738) 2024-04-25T09:09:13.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.091+0000 7fd5bd400640 1 -- 172.21.15.175:0/47117918 learned_addr learned my addr 172.21.15.175:0/47117918 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:13.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.091+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/47117918 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b806d310 0x7fd5b80b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.091+0000 7fd5bca00640 1 --2- 172.21.15.175:0/47117918 >> v2:172.21.15.177:3300/0 conn(0x7fd5b80cbe60 0x7fd5b815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.091+0000 7fd5bd400640 1 -- 172.21.15.175:0/47117918 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b806d310 msgr2=0x7fd5b80b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:13.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.091+0000 7fd5bd400640 1 --2- 172.21.15.175:0/47117918 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b806d310 0x7fd5b80b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.091+0000 7fd5bd400640 1 -- 172.21.15.175:0/47117918 >> v2:172.21.15.177:3300/0 conn(0x7fd5b80cbe60 msgr2=0x7fd5b815af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:13.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.091+0000 7fd5bd400640 1 --2- 172.21.15.175:0/47117918 >> v2:172.21.15.177:3300/0 conn(0x7fd5b80cbe60 0x7fd5b815af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.091+0000 7fd5bd400640 1 -- 172.21.15.175:0/47117918 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b815c2f0 con 0x7fd5b80b4630 2024-04-25T09:09:13.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.095+0000 7fd5bd400640 1 --2- 172.21.15.175:0/47117918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5b80b4630 0x7fd5b80b2660 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80b4d50 tx=0x7fd5b001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e5e9af890f4bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.095+0000 7fd5b7400640 1 -- 172.21.15.175:0/47117918 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b00ac070 con 0x7fd5b80b4630 2024-04-25T09:09:13.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.095+0000 7fd5b7400640 1 -- 172.21.15.175:0/47117918 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b00a8420 con 0x7fd5b80b4630 2024-04-25T09:09:13.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.095+0000 7fd5b7400640 1 -- 172.21.15.175:0/47117918 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b00a87f0 con 0x7fd5b80b4630 2024-04-25T09:09:13.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.095+0000 7fd5bf400640 1 -- 172.21.15.175:0/47117918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5b80b4630 msgr2=0x7fd5b80b2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.095+0000 7fd5bf400640 1 --2- 172.21.15.175:0/47117918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5b80b4630 0x7fd5b80b2660 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80b4d50 tx=0x7fd5b001c730 comp rx=0 tx=0).stop 2024-04-25T09:09:13.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.095+0000 7fd5bf400640 1 -- 172.21.15.175:0/47117918 shutdown_connections 2024-04-25T09:09:13.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.095+0000 7fd5bf400640 1 --2- 172.21.15.175:0/47117918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5b80b4630 0x7fd5b80b2660 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.095+0000 7fd5bf400640 1 --2- 172.21.15.175:0/47117918 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b806d310 0x7fd5b80b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.095+0000 7fd5bf400640 1 --2- 172.21.15.175:0/47117918 >> v2:172.21.15.177:3300/0 conn(0x7fd5b80cbe60 0x7fd5b815af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.095+0000 7fd5bf400640 1 -- 172.21.15.175:0/47117918 >> 172.21.15.175:0/47117918 conn(0x7fd5b806ac50 msgr2=0x7fd5b806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:13.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.095+0000 7fd5bf400640 1 -- 172.21.15.175:0/47117918 shutdown_connections 2024-04-25T09:09:13.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.095+0000 7fd5bf400640 1 -- 172.21.15.175:0/47117918 wait complete. 2024-04-25T09:09:13.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.095+0000 7fd5bf400640 1 Processor -- start 2024-04-25T09:09:13.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.095+0000 7fd5bf400640 1 -- start start 2024-04-25T09:09:13.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5bf400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5b806d310 0x7fd5b8144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5bf400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5b80b4630 0x7fd5b8153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5bf400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b80cbe60 0x7fd5b8154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5bf400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b815cbe0 con 0x7fd5b806d310 2024-04-25T09:09:13.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5bf400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b815ca60 con 0x7fd5b80b4630 2024-04-25T09:09:13.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5bf400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b815cd60 con 0x7fd5b80cbe60 2024-04-25T09:09:13.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5bca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5b806d310 0x7fd5b8144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5bca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5b806d310 0x7fd5b8144240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33752/0 (socket says 172.21.15.175:33752) 2024-04-25T09:09:13.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5bca00640 1 -- 172.21.15.175:0/1838125391 learned_addr learned my addr 172.21.15.175:0/1838125391 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:13.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5bd400640 1 --2- 172.21.15.175:0/1838125391 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b80cbe60 0x7fd5b8154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/1838125391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5b80b4630 0x7fd5b8153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5bca00640 1 -- 172.21.15.175:0/1838125391 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b80cbe60 msgr2=0x7fd5b8154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5bca00640 1 --2- 172.21.15.175:0/1838125391 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b80cbe60 0x7fd5b8154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5bca00640 1 -- 172.21.15.175:0/1838125391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5b80b4630 msgr2=0x7fd5b8153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5bca00640 1 --2- 172.21.15.175:0/1838125391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5b80b4630 0x7fd5b8153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5bca00640 1 -- 172.21.15.175:0/1838125391 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b8159160 con 0x7fd5b806d310 2024-04-25T09:09:13.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5bca00640 1 --2- 172.21.15.175:0/1838125391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5b806d310 0x7fd5b8144240 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00d620 tx=0x7fd5ac00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5b4c00640 1 -- 172.21.15.175:0/1838125391 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac00b620 con 0x7fd5b806d310 2024-04-25T09:09:13.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5b4c00640 1 -- 172.21.15.175:0/1838125391 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ac019070 con 0x7fd5b806d310 2024-04-25T09:09:13.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5b4c00640 1 -- 172.21.15.175:0/1838125391 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac00b9e0 con 0x7fd5b806d310 2024-04-25T09:09:13.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5bf400640 1 -- 172.21.15.175:0/1838125391 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b8154cc0 con 0x7fd5b806d310 2024-04-25T09:09:13.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.099+0000 7fd5bf400640 1 -- 172.21.15.175:0/1838125391 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b8155280 con 0x7fd5b806d310 2024-04-25T09:09:13.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5b4c00640 1 -- 172.21.15.175:0/1838125391 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd5ac00bb80 con 0x7fd5b806d310 2024-04-25T09:09:13.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5b4c00640 1 --2- 172.21.15.175:0/1838125391 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd598066f90 0x7fd598069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5b4c00640 1 -- 172.21.15.175:0/1838125391 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd5ac085420 con 0x7fd5b806d310 2024-04-25T09:09:13.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/1838125391 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd598066f90 0x7fd598069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5c2931000 1 Processor -- start 2024-04-25T09:09:13.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5c2931000 1 -- start start 2024-04-25T09:09:13.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/1838125391 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd598066f90 0x7fd598069450 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8154a10 tx=0x7fd5a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5c2931000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb649d0 0x55c48cb64db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5c2931000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb652f0 0x55c48cb1ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5c2931000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb1b0a0 0x55c48cb1b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5c2931000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c48c967ff0 con 0x55c48cb649d0 2024-04-25T09:09:13.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5c2931000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c48c8f0150 con 0x55c48cb1b0a0 2024-04-25T09:09:13.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5c2931000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c48c964090 con 0x55c48cb652f0 2024-04-25T09:09:13.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5bca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb649d0 0x55c48cb64db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5bca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb649d0 0x55c48cb64db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33762/0 (socket says 172.21.15.175:33762) 2024-04-25T09:09:13.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5bca00640 1 -- 172.21.15.175:0/4003099942 learned_addr learned my addr 172.21.15.175:0/4003099942 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:13.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/4003099942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb652f0 0x55c48cb1ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5bd400640 1 --2- 172.21.15.175:0/4003099942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb1b0a0 0x55c48cb1b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5bca00640 1 -- 172.21.15.175:0/4003099942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb652f0 msgr2=0x55c48cb1ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:13.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5bca00640 1 --2- 172.21.15.175:0/4003099942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb652f0 0x55c48cb1ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5bca00640 1 -- 172.21.15.175:0/4003099942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb1b0a0 msgr2=0x55c48cb1b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:13.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5bca00640 1 --2- 172.21.15.175:0/4003099942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb1b0a0 0x55c48cb1b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5bca00640 1 -- 172.21.15.175:0/4003099942 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c48cafe0d0 con 0x55c48cb649d0 2024-04-25T09:09:13.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5bca00640 1 --2- 172.21.15.175:0/4003099942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb649d0 0x55c48cb64db0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac05de70 tx=0x7fd5ac007440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b96dd9acd03d4c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5a9600640 1 -- 172.21.15.175:0/4003099942 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac05c0c0 con 0x55c48cb649d0 2024-04-25T09:09:13.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5a9600640 1 -- 172.21.15.175:0/4003099942 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ac059de0 con 0x55c48cb649d0 2024-04-25T09:09:13.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.103+0000 7fd5a9600640 1 -- 172.21.15.175:0/4003099942 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac05e3a0 con 0x55c48cb649d0 2024-04-25T09:09:13.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 -- 172.21.15.175:0/4003099942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb649d0 msgr2=0x55c48cb64db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 --2- 172.21.15.175:0/4003099942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb649d0 0x55c48cb64db0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac05de70 tx=0x7fd5ac007440 comp rx=0 tx=0).stop 2024-04-25T09:09:13.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 -- 172.21.15.175:0/4003099942 shutdown_connections 2024-04-25T09:09:13.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 --2- 172.21.15.175:0/4003099942 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb1b0a0 0x55c48cb1b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 --2- 172.21.15.175:0/4003099942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb652f0 0x55c48cb1ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 --2- 172.21.15.175:0/4003099942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb649d0 0x55c48cb64db0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 -- 172.21.15.175:0/4003099942 >> 172.21.15.175:0/4003099942 conn(0x55c48cb17020 msgr2=0x55c48cb19440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:13.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 -- 172.21.15.175:0/4003099942 shutdown_connections 2024-04-25T09:09:13.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 -- 172.21.15.175:0/4003099942 wait complete. 2024-04-25T09:09:13.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 -- start start 2024-04-25T09:09:13.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 Processor -- start 2024-04-25T09:09:13.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb1b0a0 0x55c48cb497f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb649d0 0x55c48cb49d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb652f0 0x55c48cb4a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c48c92c250 con 0x55c48cb1b0a0 2024-04-25T09:09:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c48c922690 con 0x55c48cb652f0 2024-04-25T09:09:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c48c8f0a40 con 0x55c48cb649d0 2024-04-25T09:09:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 10 client.0 _ll_register_callbacks cb 0x55c48cb05e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5bca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb1b0a0 0x55c48cb497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5bca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb1b0a0 0x55c48cb497f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33768/0 (socket says 172.21.15.175:33768) 2024-04-25T09:09:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5bca00640 1 -- 172.21.15.175:0/2549090705 learned_addr learned my addr 172.21.15.175:0/2549090705 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/2549090705 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb649d0 0x55c48cb49d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5bd400640 1 --2- 172.21.15.175:0/2549090705 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb652f0 0x55c48cb4a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5bca00640 1 -- 172.21.15.175:0/2549090705 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb649d0 msgr2=0x55c48cb49d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5bca00640 1 --2- 172.21.15.175:0/2549090705 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb649d0 0x55c48cb49d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5bca00640 1 -- 172.21.15.175:0/2549090705 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb652f0 msgr2=0x55c48cb4a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:13.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5bca00640 1 --2- 172.21.15.175:0/2549090705 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb652f0 0x55c48cb4a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5bca00640 1 -- 172.21.15.175:0/2549090705 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c48ca151c0 con 0x55c48cb1b0a0 2024-04-25T09:09:13.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5bca00640 1 --2- 172.21.15.175:0/2549090705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb1b0a0 0x55c48cb497f0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac085010 tx=0x7fd5ac085040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd198168b6b4141 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd59e000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:09:13.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd59e000640 1 -- 172.21.15.175:0/2549090705 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac071030 con 0x55c48cb1b0a0 2024-04-25T09:09:13.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd59e000640 1 -- 172.21.15.175:0/2549090705 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd5ac0850b0 con 0x55c48cb1b0a0 2024-04-25T09:09:13.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 -- 172.21.15.175:0/2549090705 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd5ac059de0 con 0x55c48cb1b0a0 2024-04-25T09:09:13.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd59e000640 1 -- 172.21.15.175:0/2549090705 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5ac07b050 con 0x55c48cb1b0a0 2024-04-25T09:09:13.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 10 client.6957 fetch_fsmap learned FSMap version 50 2024-04-25T09:09:13.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.107+0000 7fd5c2931000 1 -- 172.21.15.175:0/2549090705 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55c48ca11170 con 0x55c48cb1b0a0 2024-04-25T09:09:13.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd59e000640 1 -- 172.21.15.175:0/2549090705 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ac059de0 con 0x55c48cb1b0a0 2024-04-25T09:09:13.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd59e000640 1 -- 172.21.15.175:0/2549090705 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd5ac013070 con 0x55c48cb1b0a0 2024-04-25T09:09:13.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5c2931000 10 client.6957 fetch_fsmap finished waiting for FSMap version 50 2024-04-25T09:09:13.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5c2931000 10 client.6957 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:09:13.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5c2931000 20 client.6957 populate_metadata read hostname 'smithi175' 2024-04-25T09:09:13.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5c2931000 1 --2- 172.21.15.175:0/2549090705 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55c48cb74c80 0x55c48cb77070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5c2931000 4 client.6957 mds_command: new command op to 6513 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5c2931000 1 -- 172.21.15.175:0/2549090705 --> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c48c903c60 con 0x55c48cb74c80 2024-04-25T09:09:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/2549090705 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55c48cb74c80 0x55c48cb77070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/2549090705 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55c48cb74c80 0x55c48cb77070 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f631d4a0aa6aa4 server_cookie=3eb0fa86af5c43a1 in_seq=0 out_seq=0 2024-04-25T09:09:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd59e000640 10 client.6957 ms_handle_connect on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd59e000640 1 -- 172.21.15.175:0/2549090705 <== mds.0 v2:172.21.15.175:6834/2714482688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c48c903c60 con 0x55c48cb74c80 2024-04-25T09:09:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd59e000640 10 client.6957 handle_command_reply: tid=0 2024-04-25T09:09:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5c2931000 1 client.6957 shutdown 2024-04-25T09:09:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5c2931000 1 -- 172.21.15.175:0/2549090705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb1b0a0 msgr2=0x55c48cb497f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5c2931000 1 --2- 172.21.15.175:0/2549090705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb1b0a0 0x55c48cb497f0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac085010 tx=0x7fd5ac085040 comp rx=0 tx=0).stop 2024-04-25T09:09:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5c2931000 1 -- 172.21.15.175:0/2549090705 shutdown_connections 2024-04-25T09:09:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5c2931000 1 --2- 172.21.15.175:0/2549090705 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55c48cb74c80 0x55c48cb77070 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5c2931000 1 --2- 172.21.15.175:0/2549090705 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb652f0 0x55c48cb4a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5c2931000 1 --2- 172.21.15.175:0/2549090705 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb649d0 0x55c48cb49d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd59e000640 0 client.6957 ms_handle_reset on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:13.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5c2931000 1 --2- 172.21.15.175:0/2549090705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb1b0a0 0x55c48cb497f0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5c2931000 1 -- 172.21.15.175:0/2549090705 >> 172.21.15.175:0/2549090705 conn(0x55c48cb17020 msgr2=0x55c48cb19ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:13.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5c2931000 1 -- 172.21.15.175:0/2549090705 shutdown_connections 2024-04-25T09:09:13.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5c2931000 1 -- 172.21.15.175:0/2549090705 wait complete. 2024-04-25T09:09:13.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.111+0000 7fd5c2931000 20 client.6957 trim_cache size 0 max 16384 2024-04-25T09:09:13.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5c2931000 1 Processor -- start 2024-04-25T09:09:13.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5c2931000 1 -- start start 2024-04-25T09:09:13.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5c2931000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb1b0a0 0x55c48cb63e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5c2931000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb649d0 0x55c48cb1a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5c2931000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb652f0 0x55c48cb1a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5c2931000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b8203110 con 0x55c48cb652f0 2024-04-25T09:09:13.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5c2931000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b8202370 con 0x55c48cb1b0a0 2024-04-25T09:09:13.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5c2931000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b81560b0 con 0x55c48cb649d0 2024-04-25T09:09:13.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5bd400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb652f0 0x55c48cb1a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5bd400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb652f0 0x55c48cb1a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33780/0 (socket says 172.21.15.175:33780) 2024-04-25T09:09:13.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5bd400640 1 -- 172.21.15.175:0/3078349326 learned_addr learned my addr 172.21.15.175:0/3078349326 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:13.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/3078349326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb649d0 0x55c48cb1a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5bca00640 1 --2- 172.21.15.175:0/3078349326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb1b0a0 0x55c48cb63e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5bd400640 1 -- 172.21.15.175:0/3078349326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb649d0 msgr2=0x55c48cb1a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:13.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5bd400640 1 --2- 172.21.15.175:0/3078349326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb649d0 0x55c48cb1a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5bd400640 1 -- 172.21.15.175:0/3078349326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb1b0a0 msgr2=0x55c48cb63e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:13.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5bd400640 1 --2- 172.21.15.175:0/3078349326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb1b0a0 0x55c48cb63e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5bd400640 1 -- 172.21.15.175:0/3078349326 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c48c9aede0 con 0x55c48cb652f0 2024-04-25T09:09:13.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5bd400640 1 --2- 172.21.15.175:0/3078349326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb652f0 0x55c48cb1a960 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fd5b00980d0 tx=0x7fd5b0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e2ab5df3390562 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5a8c00640 1 -- 172.21.15.175:0/3078349326 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b00c3070 con 0x55c48cb652f0 2024-04-25T09:09:13.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5a8c00640 1 -- 172.21.15.175:0/3078349326 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b00be450 con 0x55c48cb652f0 2024-04-25T09:09:13.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5a8c00640 1 -- 172.21.15.175:0/3078349326 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b00ac040 con 0x55c48cb652f0 2024-04-25T09:09:13.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5c2931000 1 -- 172.21.15.175:0/3078349326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb652f0 msgr2=0x55c48cb1a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5c2931000 1 --2- 172.21.15.175:0/3078349326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb652f0 0x55c48cb1a960 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fd5b00980d0 tx=0x7fd5b0004ac0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5c2931000 1 -- 172.21.15.175:0/3078349326 shutdown_connections 2024-04-25T09:09:13.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5c2931000 1 --2- 172.21.15.175:0/3078349326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb652f0 0x55c48cb1a960 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5c2931000 1 --2- 172.21.15.175:0/3078349326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb649d0 0x55c48cb1a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5c2931000 1 --2- 172.21.15.175:0/3078349326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb1b0a0 0x55c48cb63e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5c2931000 1 -- 172.21.15.175:0/3078349326 >> 172.21.15.175:0/3078349326 conn(0x55c48cb17020 msgr2=0x55c48cb630d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:13.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5c2931000 1 -- 172.21.15.175:0/3078349326 shutdown_connections 2024-04-25T09:09:13.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.127+0000 7fd5c2931000 1 -- 172.21.15.175:0/3078349326 wait complete. 2024-04-25T09:09:13.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5c2931000 1 -- start start 2024-04-25T09:09:13.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5c2931000 1 Processor -- start 2024-04-25T09:09:13.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5c2931000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb1b0a0 0x55c48cbc5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5c2931000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb649d0 0x55c48cbc5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5c2931000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb652f0 0x55c48cb77380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5c2931000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c48c902e00 con 0x55c48cb649d0 2024-04-25T09:09:13.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5c2931000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b81566b0 con 0x55c48cb1b0a0 2024-04-25T09:09:13.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5c2931000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c48c967300 con 0x55c48cb652f0 2024-04-25T09:09:13.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5c2931000 10 client.0 _ll_register_callbacks cb 0x55c48cae6040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:13.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5b7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb649d0 0x55c48cbc5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5b7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb649d0 0x55c48cbc5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:33786/0 (socket says 172.21.15.175:33786) 2024-04-25T09:09:13.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5b7e00640 1 -- 172.21.15.175:0/3795594551 learned_addr learned my addr 172.21.15.175:0/3795594551 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:13.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5bca00640 1 --2- 172.21.15.175:0/3795594551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb1b0a0 0x55c48cbc5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5bd400640 1 --2- 172.21.15.175:0/3795594551 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb652f0 0x55c48cb77380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5b7e00640 1 -- 172.21.15.175:0/3795594551 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb652f0 msgr2=0x55c48cb77380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:13.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/3795594551 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb652f0 0x55c48cb77380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5b7e00640 1 -- 172.21.15.175:0/3795594551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb1b0a0 msgr2=0x55c48cbc5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:13.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/3795594551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb1b0a0 0x55c48cbc5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5b7e00640 1 -- 172.21.15.175:0/3795594551 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c48c9098e0 con 0x55c48cb649d0 2024-04-25T09:09:13.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5bd400640 1 --2- 172.21.15.175:0/3795594551 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb652f0 0x55c48cb77380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:13.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/3795594551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb649d0 0x55c48cbc5850 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8165500 tx=0x7fd5a4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cffd3144b09579 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd59e000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:09:13.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd59e000640 1 -- 172.21.15.175:0/3795594551 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a401b040 con 0x55c48cb649d0 2024-04-25T09:09:13.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd59e000640 1 -- 172.21.15.175:0/3795594551 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd5a4005ba0 con 0x55c48cb649d0 2024-04-25T09:09:13.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5c2931000 1 -- 172.21.15.175:0/3795594551 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd5b00be450 con 0x55c48cb649d0 2024-04-25T09:09:13.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd59e000640 1 -- 172.21.15.175:0/3795594551 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5a40298c0 con 0x55c48cb649d0 2024-04-25T09:09:13.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5c2931000 10 client.6963 fetch_fsmap learned FSMap version 50 2024-04-25T09:09:13.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5c2931000 1 -- 172.21.15.175:0/3795594551 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x55c48c9c18f0 con 0x55c48cb649d0 2024-04-25T09:09:13.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd59e000640 1 -- 172.21.15.175:0/3795594551 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b00be450 con 0x55c48cb649d0 2024-04-25T09:09:13.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd59e000640 1 -- 172.21.15.175:0/3795594551 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 50) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd5a4021040 con 0x55c48cb649d0 2024-04-25T09:09:13.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5c2931000 10 client.6963 fetch_fsmap finished waiting for FSMap version 50 2024-04-25T09:09:13.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5c2931000 10 client.6963 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:09:13.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5c2931000 20 client.6963 populate_metadata read hostname 'smithi175' 2024-04-25T09:09:13.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5c2931000 1 --2- 172.21.15.175:0/3795594551 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55c48cb78100 0x55c48cb78510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5c2931000 4 client.6963 mds_command: new command op to 6513 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:09:13.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5c2931000 1 -- 172.21.15.175:0/3795594551 --> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c48c975530 con 0x55c48cb78100 2024-04-25T09:09:13.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.131+0000 7fd5bca00640 1 --2- 172.21.15.175:0/3795594551 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55c48cb78100 0x55c48cb78510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5bca00640 1 --2- 172.21.15.175:0/3795594551 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55c48cb78100 0x55c48cb78510 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1633eb3afc63d76 server_cookie=52ee6ed9fba6f4ae in_seq=0 out_seq=0 2024-04-25T09:09:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd59e000640 10 client.6963 ms_handle_connect on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd59e000640 1 -- 172.21.15.175:0/3795594551 <== mds.0 v2:172.21.15.175:6834/2714482688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x55c48c975530 con 0x55c48cb78100 2024-04-25T09:09:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd59e000640 10 client.6963 handle_command_reply: tid=0 2024-04-25T09:09:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5c2931000 1 client.6963 shutdown 2024-04-25T09:09:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5c2931000 1 -- 172.21.15.175:0/3795594551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb649d0 msgr2=0x55c48cbc5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5c2931000 1 --2- 172.21.15.175:0/3795594551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb649d0 0x55c48cbc5850 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8165500 tx=0x7fd5a4004740 comp rx=0 tx=0).stop 2024-04-25T09:09:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5c2931000 1 -- 172.21.15.175:0/3795594551 shutdown_connections 2024-04-25T09:09:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5c2931000 1 --2- 172.21.15.175:0/3795594551 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55c48cb78100 0x55c48cb78510 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5c2931000 1 --2- 172.21.15.175:0/3795594551 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c48cb652f0 0x55c48cb77380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5c2931000 1 --2- 172.21.15.175:0/3795594551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c48cb649d0 0x55c48cbc5850 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5c2931000 1 --2- 172.21.15.175:0/3795594551 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c48cb1b0a0 0x55c48cbc5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd59e000640 0 client.6963 ms_handle_reset on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:13.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5c2931000 1 -- 172.21.15.175:0/3795594551 >> 172.21.15.175:0/3795594551 conn(0x55c48cb17020 msgr2=0x55c48cb63960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:13.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5c2931000 1 -- 172.21.15.175:0/3795594551 shutdown_connections 2024-04-25T09:09:13.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5c2931000 1 -- 172.21.15.175:0/3795594551 wait complete. 2024-04-25T09:09:13.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5c2931000 20 client.6963 trim_cache size 0 max 16384 2024-04-25T09:09:13.132 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:09:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:09:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": { 2024-04-25T09:09:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: "b2122a26-50a9-404a-bf9d-956cbddee9fe": { 2024-04-25T09:09:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: "path": "/subdir", 2024-04-25T09:09:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: "tag": "b2122a26-50a9-404a-bf9d-956cbddee9fe", 2024-04-25T09:09:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: "options": "recursive,repair" 2024-04-25T09:09:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:09:13.132 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:09:13.133 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:09:13.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5bf400640 1 -- 172.21.15.175:0/1838125391 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd598066f90 msgr2=0x7fd598069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5bf400640 1 --2- 172.21.15.175:0/1838125391 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd598066f90 0x7fd598069450 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8154a10 tx=0x7fd5a4008040 comp rx=0 tx=0).stop 2024-04-25T09:09:13.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5bf400640 1 -- 172.21.15.175:0/1838125391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5b806d310 msgr2=0x7fd5b8144240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5bf400640 1 --2- 172.21.15.175:0/1838125391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5b806d310 0x7fd5b8144240 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00d620 tx=0x7fd5ac00dae0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5bf400640 1 -- 172.21.15.175:0/1838125391 shutdown_connections 2024-04-25T09:09:13.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5bf400640 1 --2- 172.21.15.175:0/1838125391 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd598066f90 0x7fd598069450 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5bf400640 1 --2- 172.21.15.175:0/1838125391 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b80cbe60 0x7fd5b8154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5bf400640 1 --2- 172.21.15.175:0/1838125391 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5b80b4630 0x7fd5b8153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5bf400640 1 --2- 172.21.15.175:0/1838125391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5b806d310 0x7fd5b8144240 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5bf400640 1 -- 172.21.15.175:0/1838125391 >> 172.21.15.175:0/1838125391 conn(0x7fd5b806ac50 msgr2=0x7fd5b80add70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:13.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5bf400640 1 -- 172.21.15.175:0/1838125391 shutdown_connections 2024-04-25T09:09:13.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:13.135+0000 7fd5bf400640 1 -- 172.21.15.175:0/1838125391 wait complete. 2024-04-25T09:09:13.145 INFO:tasks.cephfs.filesystem:scrub status for tag:b2122a26-50a9-404a-bf9d-956cbddee9fe - {'path': '/subdir', 'tag': 'b2122a26-50a9-404a-bf9d-956cbddee9fe', 'options': 'recursive,repair'} 2024-04-25T09:09:39.063 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:09:39.067 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:09:43.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:43.149 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T09:09:43.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.307+0000 7fb063400640 1 Processor -- start 2024-04-25T09:09:43.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.307+0000 7fb063400640 1 -- start start 2024-04-25T09:09:43.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb063400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05c0b4800 0x7fb05c165550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb063400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb05c06db60 con 0x7fb05c0cbe60 2024-04-25T09:09:43.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb063400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb05c06de40 con 0x7fb05c15af20 2024-04-25T09:09:43.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb063400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c06e120 con 0x7fb05c0b4800 2024-04-25T09:09:43.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb060a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb05c0cbe60 0x7fb05c06d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38106/0 (socket says 172.21.15.175:38106) 2024-04-25T09:09:43.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb060a00640 1 -- 172.21.15.175:0/2358900536 learned_addr learned my addr 172.21.15.175:0/2358900536 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:43.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb061400640 1 --2- 172.21.15.175:0/2358900536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05c0b4800 0x7fb05c165550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb05b400640 1 -- 172.21.15.175:0/2358900536 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646477648 0 0) 0x7fb05c06db60 con 0x7fb05c0cbe60 2024-04-25T09:09:43.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb05b400640 1 -- 172.21.15.175:0/2358900536 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb040005740 con 0x7fb05c0cbe60 2024-04-25T09:09:43.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb05b400640 1 -- 172.21.15.175:0/2358900536 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612467262 0 0) 0x7fb05c06de40 con 0x7fb05c15af20 2024-04-25T09:09:43.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb05b400640 1 -- 172.21.15.175:0/2358900536 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb05c06db60 con 0x7fb05c15af20 2024-04-25T09:09:43.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb05b400640 1 -- 172.21.15.175:0/2358900536 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1380308321 0 0) 0x7fb040005740 con 0x7fb05c0cbe60 2024-04-25T09:09:43.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb05b400640 1 -- 172.21.15.175:0/2358900536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05c0b4800 msgr2=0x7fb05c165550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb05b400640 1 --2- 172.21.15.175:0/2358900536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05c0b4800 0x7fb05c165550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb05b400640 1 -- 172.21.15.175:0/2358900536 >> v1:172.21.15.177:6789/0 conn(0x7fb05c15af20 legacy=0x7fb05c0b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb05b400640 1 -- 172.21.15.175:0/2358900536 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c15c2f0 con 0x7fb05c0cbe60 2024-04-25T09:09:43.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb05b400640 1 -- 172.21.15.175:0/2358900536 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fb04c001a00 con 0x7fb05c0cbe60 2024-04-25T09:09:43.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb05b400640 1 -- 172.21.15.175:0/2358900536 >> v1:172.21.15.175:6789/0 conn(0x7fb05c0cbe60 legacy=0x7fb05c06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb05b400640 1 --2- 172.21.15.175:0/2358900536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb040005d90 0x7fb040006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb05b400640 1 --2- 172.21.15.175:0/2358900536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05c0b4800 0x7fb040006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb05b400640 1 --2- 172.21.15.175:0/2358900536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb040006f60 0x7fb0400073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb05b400640 1 -- 172.21.15.175:0/2358900536 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c06e120 con 0x7fb040005d90 2024-04-25T09:09:43.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb05b400640 1 -- 172.21.15.175:0/2358900536 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04000dcc0 con 0x7fb040006f60 2024-04-25T09:09:43.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb05b400640 1 -- 172.21.15.175:0/2358900536 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04000dec0 con 0x7fb05c0b4800 2024-04-25T09:09:43.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb060a00640 1 --2- 172.21.15.175:0/2358900536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb040005d90 0x7fb040006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb061400640 1 --2- 172.21.15.175:0/2358900536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb040006f60 0x7fb0400073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb05be00640 1 --2- 172.21.15.175:0/2358900536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05c0b4800 0x7fb040006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb060a00640 1 -- 172.21.15.175:0/2358900536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05c0b4800 msgr2=0x7fb040006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb060a00640 1 --2- 172.21.15.175:0/2358900536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05c0b4800 0x7fb040006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb060a00640 1 -- 172.21.15.175:0/2358900536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb040006f60 msgr2=0x7fb0400073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb060a00640 1 --2- 172.21.15.175:0/2358900536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb040006f60 0x7fb0400073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.311+0000 7fb060a00640 1 -- 172.21.15.175:0/2358900536 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb040005740 con 0x7fb040005d90 2024-04-25T09:09:43.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.315+0000 7fb060a00640 1 --2- 172.21.15.175:0/2358900536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb040005d90 0x7fb040006190 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00a730 tx=0x7fb04c01d240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a273af22a811fb4c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:43.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.315+0000 7fb05b400640 1 -- 172.21.15.175:0/2358900536 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c00a350 con 0x7fb040005d90 2024-04-25T09:09:43.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.315+0000 7fb05b400640 1 -- 172.21.15.175:0/2358900536 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c0a9020 con 0x7fb040005d90 2024-04-25T09:09:43.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.315+0000 7fb05b400640 1 -- 172.21.15.175:0/2358900536 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c0a5e40 con 0x7fb040005d90 2024-04-25T09:09:43.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.315+0000 7fb063400640 1 -- 172.21.15.175:0/2358900536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb040005d90 msgr2=0x7fb040006190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.315+0000 7fb063400640 1 --2- 172.21.15.175:0/2358900536 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb040005d90 0x7fb040006190 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00a730 tx=0x7fb04c01d240 comp rx=0 tx=0).stop 2024-04-25T09:09:43.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.315+0000 7fb061400640 1 -- 172.21.15.175:0/2358900536 reap_dead start 2024-04-25T09:09:43.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.315+0000 7fb063400640 1 -- 172.21.15.175:0/2358900536 shutdown_connections 2024-04-25T09:09:43.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.315+0000 7fb063400640 1 -- 172.21.15.175:0/2358900536 >> 172.21.15.175:0/2358900536 conn(0x7fb05c06ac50 msgr2=0x7fb05c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:43.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.315+0000 7fb063400640 1 -- 172.21.15.175:0/2358900536 shutdown_connections 2024-04-25T09:09:43.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.315+0000 7fb063400640 1 -- 172.21.15.175:0/2358900536 wait complete. 2024-04-25T09:09:43.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb063400640 1 Processor -- start 2024-04-25T09:09:43.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb063400640 1 -- start start 2024-04-25T09:09:43.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb063400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb040005d90 0x7fb05c145b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb063400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05c149810 0x7fb05c159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb063400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05c159640 0x7fb05c0abc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb063400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c071ef0 con 0x7fb05c149810 2024-04-25T09:09:43.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb063400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c071d70 con 0x7fb040005d90 2024-04-25T09:09:43.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb063400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c072070 con 0x7fb05c159640 2024-04-25T09:09:43.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb05be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05c149810 0x7fb05c159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb05be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05c149810 0x7fb05c159100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34818/0 (socket says 172.21.15.175:34818) 2024-04-25T09:09:43.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb05be00640 1 -- 172.21.15.175:0/4287847627 learned_addr learned my addr 172.21.15.175:0/4287847627 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:43.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb061400640 1 --2- 172.21.15.175:0/4287847627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05c159640 0x7fb05c0abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb060a00640 1 --2- 172.21.15.175:0/4287847627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb040005d90 0x7fb05c145b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb05be00640 1 -- 172.21.15.175:0/4287847627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05c159640 msgr2=0x7fb05c0abc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb05be00640 1 --2- 172.21.15.175:0/4287847627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05c159640 0x7fb05c0abc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb05be00640 1 -- 172.21.15.175:0/4287847627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb040005d90 msgr2=0x7fb05c145b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb05be00640 1 --2- 172.21.15.175:0/4287847627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb040005d90 0x7fb05c145b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb05be00640 1 -- 172.21.15.175:0/4287847627 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c1464c0 con 0x7fb05c149810 2024-04-25T09:09:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb060a00640 1 --2- 172.21.15.175:0/4287847627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb040005d90 0x7fb05c145b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb05be00640 1 --2- 172.21.15.175:0/4287847627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05c149810 0x7fb05c159100 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fb04800f770 tx=0x7fb04800fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb058c00640 1 -- 172.21.15.175:0/4287847627 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04801a070 con 0x7fb05c149810 2024-04-25T09:09:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb058c00640 1 -- 172.21.15.175:0/4287847627 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04800fe80 con 0x7fb05c149810 2024-04-25T09:09:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb063400640 1 -- 172.21.15.175:0/4287847627 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05c1467a0 con 0x7fb05c149810 2024-04-25T09:09:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb058c00640 1 -- 172.21.15.175:0/4287847627 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0480067e0 con 0x7fb05c149810 2024-04-25T09:09:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.319+0000 7fb063400640 1 -- 172.21.15.175:0/4287847627 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05c146d60 con 0x7fb05c149810 2024-04-25T09:09:43.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.323+0000 7fb058c00640 1 -- 172.21.15.175:0/4287847627 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb04801d070 con 0x7fb05c149810 2024-04-25T09:09:43.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.323+0000 7fb058c00640 1 --2- 172.21.15.175:0/4287847627 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb03c066f90 0x7fb03c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.323+0000 7fb058c00640 1 -- 172.21.15.175:0/4287847627 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fb048084a20 con 0x7fb05c149810 2024-04-25T09:09:43.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.323+0000 7fb0667e4000 1 Processor -- start 2024-04-25T09:09:43.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.323+0000 7fb060a00640 1 --2- 172.21.15.175:0/4287847627 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb03c066f90 0x7fb03c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.323+0000 7fb0667e4000 1 -- start start 2024-04-25T09:09:43.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.323+0000 7fb060a00640 1 --2- 172.21.15.175:0/4287847627 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb03c066f90 0x7fb03c069450 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb04c0aa000 tx=0x7fb05c06dd30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:43.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.323+0000 7fb0667e4000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734f99d0 0x55f5734f9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.323+0000 7fb0667e4000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734fa2f0 0x55f5734afb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.323+0000 7fb0667e4000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 0x55f5734b0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.323+0000 7fb0667e4000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5732fcff0 con 0x55f5734b00a0 2024-04-25T09:09:43.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.323+0000 7fb0667e4000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f573285150 con 0x55f5734fa2f0 2024-04-25T09:09:43.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.323+0000 7fb0667e4000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5732f9090 con 0x55f5734f99d0 2024-04-25T09:09:43.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.323+0000 7fb061400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 0x55f5734b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.323+0000 7fb061400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 0x55f5734b0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34834/0 (socket says 172.21.15.175:34834) 2024-04-25T09:09:43.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.323+0000 7fb061400640 1 -- 172.21.15.175:0/2085596263 learned_addr learned my addr 172.21.15.175:0/2085596263 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.323+0000 7fb060a00640 1 --2- 172.21.15.175:0/2085596263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734f99d0 0x55f5734f9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.323+0000 7fb05be00640 1 --2- 172.21.15.175:0/2085596263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734fa2f0 0x55f5734afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb061400640 1 -- 172.21.15.175:0/2085596263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734f99d0 msgr2=0x55f5734f9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb061400640 1 --2- 172.21.15.175:0/2085596263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734f99d0 0x55f5734f9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb061400640 1 -- 172.21.15.175:0/2085596263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734fa2f0 msgr2=0x55f5734afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb061400640 1 --2- 172.21.15.175:0/2085596263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734fa2f0 0x55f5734afb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb061400640 1 -- 172.21.15.175:0/2085596263 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5734930d0 con 0x55f5734b00a0 2024-04-25T09:09:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb061400640 1 --2- 172.21.15.175:0/2085596263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 0x55f5734b0480 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb05c06e960 tx=0x7fb054009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee9921895487e98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:43.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb051600640 1 -- 172.21.15.175:0/2085596263 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb054004300 con 0x55f5734b00a0 2024-04-25T09:09:43.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb051600640 1 -- 172.21.15.175:0/2085596263 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0540044a0 con 0x55f5734b00a0 2024-04-25T09:09:43.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb051600640 1 -- 172.21.15.175:0/2085596263 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb054013a30 con 0x55f5734b00a0 2024-04-25T09:09:43.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb0667e4000 1 -- 172.21.15.175:0/2085596263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 msgr2=0x55f5734b0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb0667e4000 1 --2- 172.21.15.175:0/2085596263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 0x55f5734b0480 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fb05c06e960 tx=0x7fb054009190 comp rx=0 tx=0).stop 2024-04-25T09:09:43.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb0667e4000 1 -- 172.21.15.175:0/2085596263 shutdown_connections 2024-04-25T09:09:43.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb0667e4000 1 --2- 172.21.15.175:0/2085596263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 0x55f5734b0480 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb0667e4000 1 --2- 172.21.15.175:0/2085596263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734fa2f0 0x55f5734afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb0667e4000 1 --2- 172.21.15.175:0/2085596263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734f99d0 0x55f5734f9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb0667e4000 1 -- 172.21.15.175:0/2085596263 >> 172.21.15.175:0/2085596263 conn(0x55f5734ac020 msgr2=0x55f5734ae440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:43.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb0667e4000 1 -- 172.21.15.175:0/2085596263 shutdown_connections 2024-04-25T09:09:43.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb0667e4000 1 -- 172.21.15.175:0/2085596263 wait complete. 2024-04-25T09:09:43.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb0667e4000 1 -- start start 2024-04-25T09:09:43.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb0667e4000 1 Processor -- start 2024-04-25T09:09:43.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb0667e4000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734b00a0 0x55f5734de7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb0667e4000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734f99d0 0x55f5734ded30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb0667e4000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734fa2f0 0x55f5734df270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb0667e4000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5732c1250 con 0x55f5734f99d0 2024-04-25T09:09:43.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb0667e4000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5732b7690 con 0x55f5734b00a0 2024-04-25T09:09:43.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb0667e4000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f573285a40 con 0x55f5734fa2f0 2024-04-25T09:09:43.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb0667e4000 10 client.0 _ll_register_callbacks cb 0x55f57349ae90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:43.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb05be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734f99d0 0x55f5734ded30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb05be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734f99d0 0x55f5734ded30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34848/0 (socket says 172.21.15.175:34848) 2024-04-25T09:09:43.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb05be00640 1 -- 172.21.15.175:0/1635655864 learned_addr learned my addr 172.21.15.175:0/1635655864 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:43.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb060a00640 1 --2- 172.21.15.175:0/1635655864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734b00a0 0x55f5734de7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb061400640 1 --2- 172.21.15.175:0/1635655864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734fa2f0 0x55f5734df270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb05be00640 1 -- 172.21.15.175:0/1635655864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734fa2f0 msgr2=0x55f5734df270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb05be00640 1 --2- 172.21.15.175:0/1635655864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734fa2f0 0x55f5734df270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb05be00640 1 -- 172.21.15.175:0/1635655864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734b00a0 msgr2=0x55f5734de7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb05be00640 1 --2- 172.21.15.175:0/1635655864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734b00a0 0x55f5734de7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.327+0000 7fb05be00640 1 -- 172.21.15.175:0/1635655864 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f5733aa1c0 con 0x55f5734f99d0 2024-04-25T09:09:43.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb05be00640 1 --2- 172.21.15.175:0/1635655864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734f99d0 0x55f5734ded30 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fb048054f00 tx=0x7fb048059410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ea8cdbe5e41469 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:43.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb046000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:09:43.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb046000640 1 -- 172.21.15.175:0/1635655864 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048081060 con 0x55f5734f99d0 2024-04-25T09:09:43.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb046000640 1 -- 172.21.15.175:0/1635655864 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fb048054850 con 0x55f5734f99d0 2024-04-25T09:09:43.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 1 -- 172.21.15.175:0/1635655864 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb0540044a0 con 0x55f5734f99d0 2024-04-25T09:09:43.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb046000640 1 -- 172.21.15.175:0/1635655864 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb048071050 con 0x55f5734f99d0 2024-04-25T09:09:43.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 10 client.6975 fetch_fsmap learned FSMap version 51 2024-04-25T09:09:43.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 1 -- 172.21.15.175:0/1635655864 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55f5733a6170 con 0x55f5734f99d0 2024-04-25T09:09:43.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb046000640 1 -- 172.21.15.175:0/1635655864 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0540044a0 con 0x55f5734f99d0 2024-04-25T09:09:43.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb046000640 1 -- 172.21.15.175:0/1635655864 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 51) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb04805b2f0 con 0x55f5734f99d0 2024-04-25T09:09:43.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 10 client.6975 fetch_fsmap finished waiting for FSMap version 51 2024-04-25T09:09:43.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 10 client.6975 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:09:43.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 20 client.6975 populate_metadata read hostname 'smithi175' 2024-04-25T09:09:43.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 1 --2- 172.21.15.175:0/1635655864 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55f573509c80 0x55f57350c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 4 client.6975 mds_command: new command op to 6513 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:43.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 1 -- 172.21.15.175:0/1635655864 --> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f573298c60 con 0x55f573509c80 2024-04-25T09:09:43.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb060a00640 1 --2- 172.21.15.175:0/1635655864 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55f573509c80 0x55f57350c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb060a00640 1 --2- 172.21.15.175:0/1635655864 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55f573509c80 0x55f57350c070 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2054c5db39c0e6c4 server_cookie=7c859c7d5db53cc0 in_seq=0 out_seq=0 2024-04-25T09:09:43.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb046000640 10 client.6975 ms_handle_connect on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:43.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb046000640 1 -- 172.21.15.175:0/1635655864 <== mds.0 v2:172.21.15.175:6834/2714482688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f573298c60 con 0x55f573509c80 2024-04-25T09:09:43.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb046000640 10 client.6975 handle_command_reply: tid=0 2024-04-25T09:09:43.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 1 client.6975 shutdown 2024-04-25T09:09:43.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 1 -- 172.21.15.175:0/1635655864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734f99d0 msgr2=0x55f5734ded30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 1 --2- 172.21.15.175:0/1635655864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734f99d0 0x55f5734ded30 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fb048054f00 tx=0x7fb048059410 comp rx=0 tx=0).stop 2024-04-25T09:09:43.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 1 -- 172.21.15.175:0/1635655864 shutdown_connections 2024-04-25T09:09:43.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 1 --2- 172.21.15.175:0/1635655864 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55f573509c80 0x55f57350c070 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 1 --2- 172.21.15.175:0/1635655864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734fa2f0 0x55f5734df270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 1 --2- 172.21.15.175:0/1635655864 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734f99d0 0x55f5734ded30 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 1 --2- 172.21.15.175:0/1635655864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734b00a0 0x55f5734de7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb046000640 0 client.6975 ms_handle_reset on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:43.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 1 -- 172.21.15.175:0/1635655864 >> 172.21.15.175:0/1635655864 conn(0x55f5734ac020 msgr2=0x55f5734aeca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:43.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 1 -- 172.21.15.175:0/1635655864 shutdown_connections 2024-04-25T09:09:43.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 1 -- 172.21.15.175:0/1635655864 wait complete. 2024-04-25T09:09:43.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.331+0000 7fb0667e4000 20 client.6975 trim_cache size 0 max 16384 2024-04-25T09:09:43.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb0667e4000 1 Processor -- start 2024-04-25T09:09:43.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb0667e4000 1 -- start start 2024-04-25T09:09:43.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb0667e4000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 0x55f5735560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb0667e4000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734f99d0 0x55f573556630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb0667e4000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734fa2f0 0x55f573556b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb0667e4000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c2038c0 con 0x55f5734b00a0 2024-04-25T09:09:43.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb0667e4000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c202af0 con 0x55f5734fa2f0 2024-04-25T09:09:43.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb0667e4000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c149030 con 0x55f5734f99d0 2024-04-25T09:09:43.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb060a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 0x55f5735560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb060a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 0x55f5735560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34860/0 (socket says 172.21.15.175:34860) 2024-04-25T09:09:43.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb060a00640 1 -- 172.21.15.175:0/681756374 learned_addr learned my addr 172.21.15.175:0/681756374 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:43.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb061400640 1 --2- 172.21.15.175:0/681756374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734fa2f0 0x55f573556b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb05be00640 1 --2- 172.21.15.175:0/681756374 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734f99d0 0x55f573556630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb060a00640 1 -- 172.21.15.175:0/681756374 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734f99d0 msgr2=0x55f573556630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb060a00640 1 --2- 172.21.15.175:0/681756374 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734f99d0 0x55f573556630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb060a00640 1 -- 172.21.15.175:0/681756374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734fa2f0 msgr2=0x55f573556b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb060a00640 1 --2- 172.21.15.175:0/681756374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734fa2f0 0x55f573556b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb060a00640 1 -- 172.21.15.175:0/681756374 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f573343de0 con 0x55f5734b00a0 2024-04-25T09:09:43.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb060a00640 1 --2- 172.21.15.175:0/681756374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 0x55f5735560f0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fb04c01d070 tx=0x7fb05c06e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf4325ef45feb0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:43.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb050c00640 1 -- 172.21.15.175:0/681756374 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c0cd070 con 0x55f5734b00a0 2024-04-25T09:09:43.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb050c00640 1 -- 172.21.15.175:0/681756374 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c0a9040 con 0x55f5734b00a0 2024-04-25T09:09:43.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.347+0000 7fb050c00640 1 -- 172.21.15.175:0/681756374 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c0c84e0 con 0x55f5734b00a0 2024-04-25T09:09:43.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 -- 172.21.15.175:0/681756374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 msgr2=0x55f5735560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 --2- 172.21.15.175:0/681756374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 0x55f5735560f0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fb04c01d070 tx=0x7fb05c06e010 comp rx=0 tx=0).stop 2024-04-25T09:09:43.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 -- 172.21.15.175:0/681756374 shutdown_connections 2024-04-25T09:09:43.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 --2- 172.21.15.175:0/681756374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734fa2f0 0x55f573556b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 --2- 172.21.15.175:0/681756374 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734f99d0 0x55f573556630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 --2- 172.21.15.175:0/681756374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 0x55f5735560f0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 -- 172.21.15.175:0/681756374 >> 172.21.15.175:0/681756374 conn(0x55f5734ac020 msgr2=0x55f573506fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:43.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 -- 172.21.15.175:0/681756374 shutdown_connections 2024-04-25T09:09:43.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 -- 172.21.15.175:0/681756374 wait complete. 2024-04-25T09:09:43.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 -- start start 2024-04-25T09:09:43.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 Processor -- start 2024-04-25T09:09:43.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 0x55f57350c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734f99d0 0x55f57350c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734fa2f0 0x55f57350ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f573297e00 con 0x55f5734b00a0 2024-04-25T09:09:43.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c2024f0 con 0x55f5734f99d0 2024-04-25T09:09:43.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5732fc300 con 0x55f5734fa2f0 2024-04-25T09:09:43.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 10 client.0 _ll_register_callbacks cb 0x55f57347b040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:43.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb060a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 0x55f57350c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb060a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 0x55f57350c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34874/0 (socket says 172.21.15.175:34874) 2024-04-25T09:09:43.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb060a00640 1 -- 172.21.15.175:0/1929692640 learned_addr learned my addr 172.21.15.175:0/1929692640 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:43.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb05be00640 1 --2- 172.21.15.175:0/1929692640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734f99d0 0x55f57350c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb061400640 1 --2- 172.21.15.175:0/1929692640 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734fa2f0 0x55f57350ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb060a00640 1 -- 172.21.15.175:0/1929692640 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734fa2f0 msgr2=0x55f57350ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb060a00640 1 --2- 172.21.15.175:0/1929692640 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734fa2f0 0x55f57350ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb060a00640 1 -- 172.21.15.175:0/1929692640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734f99d0 msgr2=0x55f57350c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb060a00640 1 --2- 172.21.15.175:0/1929692640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734f99d0 0x55f57350c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb060a00640 1 -- 172.21.15.175:0/1929692640 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f57329e8e0 con 0x55f5734b00a0 2024-04-25T09:09:43.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb061400640 1 --2- 172.21.15.175:0/1929692640 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734fa2f0 0x55f57350ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:43.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb060a00640 1 --2- 172.21.15.175:0/1929692640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 0x55f57350c380 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fb04c001590 tx=0x7fb04c019fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e05967089d5f38 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:43.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb046000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:09:43.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb046000640 1 -- 172.21.15.175:0/1929692640 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c0d6070 con 0x55f5734b00a0 2024-04-25T09:09:43.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb046000640 1 -- 172.21.15.175:0/1929692640 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fb04c0c8700 con 0x55f5734b00a0 2024-04-25T09:09:43.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 -- 172.21.15.175:0/1929692640 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb04c0a9040 con 0x55f5734b00a0 2024-04-25T09:09:43.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb046000640 1 -- 172.21.15.175:0/1929692640 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb04c0cd040 con 0x55f5734b00a0 2024-04-25T09:09:43.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 10 client.6981 fetch_fsmap learned FSMap version 51 2024-04-25T09:09:43.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 1 -- 172.21.15.175:0/1929692640 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55f5733568f0 con 0x55f5734b00a0 2024-04-25T09:09:43.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb046000640 1 -- 172.21.15.175:0/1929692640 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c0a9040 con 0x55f5734b00a0 2024-04-25T09:09:43.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb046000640 1 -- 172.21.15.175:0/1929692640 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 51) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb04c0e4020 con 0x55f5734b00a0 2024-04-25T09:09:43.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 10 client.6981 fetch_fsmap finished waiting for FSMap version 51 2024-04-25T09:09:43.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 10 client.6981 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T09:09:43.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.351+0000 7fb0667e4000 20 client.6981 populate_metadata read hostname 'smithi175' 2024-04-25T09:09:43.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb0667e4000 1 --2- 172.21.15.175:0/1929692640 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55f57350d7f0 0x55f573561f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb0667e4000 4 client.6981 mds_command: new command op to 6513 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:09:43.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb0667e4000 1 -- 172.21.15.175:0/1929692640 --> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f57330a530 con 0x55f57350d7f0 2024-04-25T09:09:43.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb05be00640 1 --2- 172.21.15.175:0/1929692640 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55f57350d7f0 0x55f573561f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb05be00640 1 --2- 172.21.15.175:0/1929692640 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55f57350d7f0 0x55f573561f60 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9881e970900473ff server_cookie=8ffe8d0861c27d34 in_seq=0 out_seq=0 2024-04-25T09:09:43.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb046000640 10 client.6981 ms_handle_connect on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:43.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb046000640 1 -- 172.21.15.175:0/1929692640 <== mds.0 v2:172.21.15.175:6834/2714482688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f57330a530 con 0x55f57350d7f0 2024-04-25T09:09:43.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb046000640 10 client.6981 handle_command_reply: tid=0 2024-04-25T09:09:43.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb0667e4000 1 client.6981 shutdown 2024-04-25T09:09:43.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb0667e4000 1 -- 172.21.15.175:0/1929692640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 msgr2=0x55f57350c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb0667e4000 1 --2- 172.21.15.175:0/1929692640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 0x55f57350c380 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fb04c001590 tx=0x7fb04c019fe0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb0667e4000 1 -- 172.21.15.175:0/1929692640 shutdown_connections 2024-04-25T09:09:43.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb0667e4000 1 --2- 172.21.15.175:0/1929692640 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x55f57350d7f0 0x55f573561f60 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb0667e4000 1 --2- 172.21.15.175:0/1929692640 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55f5734fa2f0 0x55f57350ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb0667e4000 1 --2- 172.21.15.175:0/1929692640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55f5734f99d0 0x55f57350c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb046000640 0 client.6981 ms_handle_reset on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:43.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb0667e4000 1 --2- 172.21.15.175:0/1929692640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55f5734b00a0 0x55f57350c380 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb0667e4000 1 -- 172.21.15.175:0/1929692640 >> 172.21.15.175:0/1929692640 conn(0x55f5734ac020 msgr2=0x55f5734f80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:43.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb0667e4000 1 -- 172.21.15.175:0/1929692640 shutdown_connections 2024-04-25T09:09:43.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb0667e4000 1 -- 172.21.15.175:0/1929692640 wait complete. 2024-04-25T09:09:43.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb0667e4000 20 client.6981 trim_cache size 0 max 16384 2024-04-25T09:09:43.348 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:09:43.348 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "no active scrubs running", 2024-04-25T09:09:43.348 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": {} 2024-04-25T09:09:43.348 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:09:43.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb063400640 1 -- 172.21.15.175:0/4287847627 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb03c066f90 msgr2=0x7fb03c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb063400640 1 --2- 172.21.15.175:0/4287847627 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb03c066f90 0x7fb03c069450 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb04c0aa000 tx=0x7fb05c06dd30 comp rx=0 tx=0).stop 2024-04-25T09:09:43.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb063400640 1 -- 172.21.15.175:0/4287847627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05c149810 msgr2=0x7fb05c159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb063400640 1 --2- 172.21.15.175:0/4287847627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05c149810 0x7fb05c159100 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fb04800f770 tx=0x7fb04800fc30 comp rx=0 tx=0).stop 2024-04-25T09:09:43.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb063400640 1 -- 172.21.15.175:0/4287847627 shutdown_connections 2024-04-25T09:09:43.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb063400640 1 --2- 172.21.15.175:0/4287847627 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb03c066f90 0x7fb03c069450 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb063400640 1 --2- 172.21.15.175:0/4287847627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb05c159640 0x7fb05c0abc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb063400640 1 --2- 172.21.15.175:0/4287847627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb05c149810 0x7fb05c159100 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb063400640 1 --2- 172.21.15.175:0/4287847627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb040005d90 0x7fb05c145b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb063400640 1 -- 172.21.15.175:0/4287847627 >> 172.21.15.175:0/4287847627 conn(0x7fb05c06ac50 msgr2=0x7fb05c0cdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:43.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb063400640 1 -- 172.21.15.175:0/4287847627 shutdown_connections 2024-04-25T09:09:43.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.355+0000 7fb063400640 1 -- 172.21.15.175:0/4287847627 wait complete. 2024-04-25T09:09:43.364 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:09:43.365 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:43.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.511+0000 7fb0e2e00640 1 Processor -- start 2024-04-25T09:09:43.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.511+0000 7fb0e2e00640 1 -- start start 2024-04-25T09:09:43.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.511+0000 7fb0e2e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0dc15bc70 0x7fb0dc0b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.511+0000 7fb0e2e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb0dc0b1610 0x7fb0dc0b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.511+0000 7fb0e2e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0dc0b0000 con 0x7fb0dc06b780 2024-04-25T09:09:43.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.511+0000 7fb0e2e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0dc0b08f0 con 0x7fb0dc0b1610 2024-04-25T09:09:43.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.511+0000 7fb0e2e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc0b02a0 con 0x7fb0dc15bc70 2024-04-25T09:09:43.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.511+0000 7fb0db400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb0dc06b780 0x7fb0dc0cc3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38116/0 (socket says 172.21.15.175:38116) 2024-04-25T09:09:43.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.511+0000 7fb0db400640 1 -- 172.21.15.175:0/2465640517 learned_addr learned my addr 172.21.15.175:0/2465640517 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:43.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.511+0000 7fb0dbe00640 1 --2- 172.21.15.175:0/2465640517 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0dc15bc70 0x7fb0dc0b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.511+0000 7fb0e0e00640 1 --2- 172.21.15.175:0/2465640517 >> v2:172.21.15.177:3300/0 conn(0x7fb0dc0b1610 0x7fb0dc0b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.511+0000 7fb0daa00640 1 -- 172.21.15.175:0/2465640517 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509532205 0 0) 0x7fb0dc0b0000 con 0x7fb0dc06b780 2024-04-25T09:09:43.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.511+0000 7fb0daa00640 1 -- 172.21.15.175:0/2465640517 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0c0003530 con 0x7fb0dc06b780 2024-04-25T09:09:43.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.511+0000 7fb0dbe00640 1 -- 172.21.15.175:0/2465640517 >> v2:172.21.15.177:3300/0 conn(0x7fb0dc0b1610 msgr2=0x7fb0dc0b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.511+0000 7fb0dbe00640 1 --2- 172.21.15.175:0/2465640517 >> v2:172.21.15.177:3300/0 conn(0x7fb0dc0b1610 0x7fb0dc0b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.511+0000 7fb0dbe00640 1 -- 172.21.15.175:0/2465640517 >> v1:172.21.15.175:6789/0 conn(0x7fb0dc06b780 legacy=0x7fb0dc0cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.511+0000 7fb0dbe00640 1 -- 172.21.15.175:0/2465640517 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0dc0b0580 con 0x7fb0dc15bc70 2024-04-25T09:09:43.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.511+0000 7fb0e0e00640 1 --2- 172.21.15.175:0/2465640517 >> v2:172.21.15.177:3300/0 conn(0x7fb0dc0b1610 0x7fb0dc0b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:43.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.515+0000 7fb0dbe00640 1 --2- 172.21.15.175:0/2465640517 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0dc15bc70 0x7fb0dc0b0d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0097c0 tx=0x7fb0cc01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abfff1f530cf0d70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:43.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.515+0000 7fb0daa00640 1 -- 172.21.15.175:0/2465640517 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0b5070 con 0x7fb0dc15bc70 2024-04-25T09:09:43.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.515+0000 7fb0daa00640 1 -- 172.21.15.175:0/2465640517 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc0a8990 con 0x7fb0dc15bc70 2024-04-25T09:09:43.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.515+0000 7fb0daa00640 1 -- 172.21.15.175:0/2465640517 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0a8d60 con 0x7fb0dc15bc70 2024-04-25T09:09:43.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.515+0000 7fb0e2e00640 1 -- 172.21.15.175:0/2465640517 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0dc15bc70 msgr2=0x7fb0dc0b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.515+0000 7fb0e2e00640 1 --2- 172.21.15.175:0/2465640517 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0dc15bc70 0x7fb0dc0b0d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0097c0 tx=0x7fb0cc01ec90 comp rx=0 tx=0).stop 2024-04-25T09:09:43.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.515+0000 7fb0e2e00640 1 -- 172.21.15.175:0/2465640517 shutdown_connections 2024-04-25T09:09:43.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.515+0000 7fb0e2e00640 1 --2- 172.21.15.175:0/2465640517 >> v2:172.21.15.177:3300/0 conn(0x7fb0dc0b1610 0x7fb0dc0b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.515+0000 7fb0e2e00640 1 --2- 172.21.15.175:0/2465640517 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0dc15bc70 0x7fb0dc0b0d80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.515+0000 7fb0e2e00640 1 -- 172.21.15.175:0/2465640517 >> 172.21.15.175:0/2465640517 conn(0x7fb0dc0d06c0 msgr2=0x7fb0dc0d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:43.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.515+0000 7fb0e2e00640 1 -- 172.21.15.175:0/2465640517 shutdown_connections 2024-04-25T09:09:43.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.515+0000 7fb0e2e00640 1 -- 172.21.15.175:0/2465640517 wait complete. 2024-04-25T09:09:43.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e2e00640 1 Processor -- start 2024-04-25T09:09:43.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e2e00640 1 -- start start 2024-04-25T09:09:43.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e2e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0dc06b780 0x7fb0dc0b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e2e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0dc0b1610 0x7fb0dc157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e2e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0dc15bc70 0x7fb0dc15c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e2e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc0cde30 con 0x7fb0dc15bc70 2024-04-25T09:09:43.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e2e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc0ccae0 con 0x7fb0dc06b780 2024-04-25T09:09:43.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e2e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc0b12c0 con 0x7fb0dc0b1610 2024-04-25T09:09:43.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e0e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0dc15bc70 0x7fb0dc15c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e0e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0dc15bc70 0x7fb0dc15c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34884/0 (socket says 172.21.15.175:34884) 2024-04-25T09:09:43.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e0e00640 1 -- 172.21.15.175:0/1789204023 learned_addr learned my addr 172.21.15.175:0/1789204023 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:43.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0dbe00640 1 --2- 172.21.15.175:0/1789204023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0dc06b780 0x7fb0dc0b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0db400640 1 --2- 172.21.15.175:0/1789204023 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0dc0b1610 0x7fb0dc157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e0e00640 1 -- 172.21.15.175:0/1789204023 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0dc0b1610 msgr2=0x7fb0dc157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e0e00640 1 --2- 172.21.15.175:0/1789204023 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0dc0b1610 0x7fb0dc157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e0e00640 1 -- 172.21.15.175:0/1789204023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0dc06b780 msgr2=0x7fb0dc0b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e0e00640 1 --2- 172.21.15.175:0/1789204023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0dc06b780 0x7fb0dc0b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e0e00640 1 -- 172.21.15.175:0/1789204023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0dc0b38a0 con 0x7fb0dc15bc70 2024-04-25T09:09:43.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e0e00640 1 --2- 172.21.15.175:0/1789204023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0dc15bc70 0x7fb0dc15c790 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400efc0 tx=0x7fb0d4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:43.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0d3e00640 1 -- 172.21.15.175:0/1789204023 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4018030 con 0x7fb0dc15bc70 2024-04-25T09:09:43.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0d3e00640 1 -- 172.21.15.175:0/1789204023 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d400cde0 con 0x7fb0dc15bc70 2024-04-25T09:09:43.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0d3e00640 1 -- 172.21.15.175:0/1789204023 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4003bc0 con 0x7fb0dc15bc70 2024-04-25T09:09:43.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e2e00640 1 -- 172.21.15.175:0/1789204023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0dc0b3b80 con 0x7fb0dc15bc70 2024-04-25T09:09:43.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.519+0000 7fb0e2e00640 1 -- 172.21.15.175:0/1789204023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0dc0b4140 con 0x7fb0dc15bc70 2024-04-25T09:09:43.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.523+0000 7fb0e2e00640 1 -- 172.21.15.175:0/1789204023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0dc074a60 con 0x7fb0dc15bc70 2024-04-25T09:09:43.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.523+0000 7fb0d3e00640 1 -- 172.21.15.175:0/1789204023 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb0d401b070 con 0x7fb0dc15bc70 2024-04-25T09:09:43.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.523+0000 7fb0d3e00640 1 --2- 172.21.15.175:0/1789204023 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb0bc066f60 0x7fb0bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.523+0000 7fb0d3e00640 1 -- 172.21.15.175:0/1789204023 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fb0d4085aa0 con 0x7fb0dc15bc70 2024-04-25T09:09:43.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.523+0000 7fb0dbe00640 1 --2- 172.21.15.175:0/1789204023 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb0bc066f60 0x7fb0bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.523+0000 7fb0dbe00640 1 --2- 172.21.15.175:0/1789204023 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb0bc066f60 0x7fb0bc069420 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0b2000 tx=0x7fb0cc0aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:43.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.527+0000 7fb0d3e00640 1 -- 172.21.15.175:0/1789204023 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb0d4010040 con 0x7fb0dc15bc70 2024-04-25T09:09:43.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.711+0000 7fb0e2e00640 1 -- 172.21.15.175:0/1789204023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0dc0d1140 con 0x7fb0dc15bc70 2024-04-25T09:09:43.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.715+0000 7fb0d3e00640 1 -- 172.21.15.175:0/1789204023 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4948 (secure 0 0 0) 0x7fb0d4056330 con 0x7fb0dc15bc70 2024-04-25T09:09:43.703 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:09:43.704 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":51,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2493316948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2493316948},{"type":"v1","addr":"172.21.15.175:6837","nonce":2493316948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3408529232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3408529232},{"type":"v1","addr":"172.21.15.177:6834","nonce":3408529232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/46829775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":46829775},{"type":"v1","addr":"172.21.15.177:6835","nonce":46829775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:08:17.378890+0000","modified":"2024-04-25T09:09:15.457110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6513":{"gid":6513,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":19,"addr":"172.21.15.175:6836/2714482688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2714482688},{"type":"v1","addr":"172.21.15.175:6836","nonce":2714482688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:09:43.704 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 51 2024-04-25T09:09:43.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.715+0000 7fb0e2e00640 1 -- 172.21.15.175:0/1789204023 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb0bc066f60 msgr2=0x7fb0bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.715+0000 7fb0e2e00640 1 --2- 172.21.15.175:0/1789204023 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb0bc066f60 0x7fb0bc069420 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0b2000 tx=0x7fb0cc0aa070 comp rx=0 tx=0).stop 2024-04-25T09:09:43.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.715+0000 7fb0e2e00640 1 -- 172.21.15.175:0/1789204023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0dc15bc70 msgr2=0x7fb0dc15c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.715+0000 7fb0e2e00640 1 --2- 172.21.15.175:0/1789204023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0dc15bc70 0x7fb0dc15c790 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400efc0 tx=0x7fb0d4009f90 comp rx=0 tx=0).stop 2024-04-25T09:09:43.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.715+0000 7fb0e2e00640 1 -- 172.21.15.175:0/1789204023 shutdown_connections 2024-04-25T09:09:43.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.715+0000 7fb0e2e00640 1 --2- 172.21.15.175:0/1789204023 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb0bc066f60 0x7fb0bc069420 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.715+0000 7fb0e2e00640 1 --2- 172.21.15.175:0/1789204023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0dc15bc70 0x7fb0dc15c790 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.715+0000 7fb0e2e00640 1 --2- 172.21.15.175:0/1789204023 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0dc0b1610 0x7fb0dc157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.715+0000 7fb0e2e00640 1 --2- 172.21.15.175:0/1789204023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0dc06b780 0x7fb0dc0b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.715+0000 7fb0e2e00640 1 -- 172.21.15.175:0/1789204023 >> 172.21.15.175:0/1789204023 conn(0x7fb0dc0d06c0 msgr2=0x7fb0dc159ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:43.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.715+0000 7fb0e2e00640 1 -- 172.21.15.175:0/1789204023 shutdown_connections 2024-04-25T09:09:43.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.715+0000 7fb0e2e00640 1 -- 172.21.15.175:0/1789204023 wait complete. 2024-04-25T09:09:43.724 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T09:09:43.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.871+0000 7febca000640 1 Processor -- start 2024-04-25T09:09:43.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.871+0000 7febca000640 1 -- start start 2024-04-25T09:09:43.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.871+0000 7febca000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7febc415ac90 0x7febc40711d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.871+0000 7febca000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7febc4071710 0x7febc413e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.871+0000 7febca000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc4071af0 con 0x7febc40c4980 2024-04-25T09:09:43.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.871+0000 7febca000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc415bc90 con 0x7febc415ac90 2024-04-25T09:09:43.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.871+0000 7febca000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc415b120 con 0x7febc4071710 2024-04-25T09:09:43.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.871+0000 7febc3e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7febc415ac90 0x7febc40711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.871+0000 7febc3e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7febc415ac90 0x7febc40711d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34894/0 (socket says 172.21.15.175:34894) 2024-04-25T09:09:43.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.871+0000 7febc3e00640 1 -- 172.21.15.175:0/3730178739 learned_addr learned my addr 172.21.15.175:0/3730178739 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:43.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.871+0000 7febc8c00640 1 --1- 172.21.15.175:0/3730178739 >> v1:172.21.15.175:6789/0 conn(0x7febc40c4980 0x7febc40c4d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38132/0 (socket says 172.21.15.175:38132) 2024-04-25T09:09:43.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.871+0000 7febc9600640 1 --2- 172.21.15.175:0/3730178739 >> v2:172.21.15.177:3300/0 conn(0x7febc4071710 0x7febc413e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.875+0000 7febc3e00640 1 -- 172.21.15.175:0/3730178739 >> v2:172.21.15.177:3300/0 conn(0x7febc4071710 msgr2=0x7febc413e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.875+0000 7febc3e00640 1 --2- 172.21.15.175:0/3730178739 >> v2:172.21.15.177:3300/0 conn(0x7febc4071710 0x7febc413e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.875+0000 7febc3e00640 1 -- 172.21.15.175:0/3730178739 >> v1:172.21.15.175:6789/0 conn(0x7febc40c4980 legacy=0x7febc40c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.875+0000 7febc3e00640 1 -- 172.21.15.175:0/3730178739 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc415b3f0 con 0x7febc415ac90 2024-04-25T09:09:43.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.875+0000 7febc3400640 1 -- 172.21.15.175:0/3730178739 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408154829 0 0) 0x7febc4071af0 con 0x7febc40c4980 2024-04-25T09:09:43.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.875+0000 7febc3e00640 1 --2- 172.21.15.175:0/3730178739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc415ac90 0x7febc40711d0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7febc4140da0 tx=0x7febb001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f56d2a59d0c496 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:43.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.875+0000 7febc3400640 1 -- 172.21.15.175:0/3730178739 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb00b2070 con 0x7febc415ac90 2024-04-25T09:09:43.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.875+0000 7febc3400640 1 -- 172.21.15.175:0/3730178739 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb00ad680 con 0x7febc415ac90 2024-04-25T09:09:43.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.875+0000 7febc3400640 1 -- 172.21.15.175:0/3730178739 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb00ada50 con 0x7febc415ac90 2024-04-25T09:09:43.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.875+0000 7febca000640 1 -- 172.21.15.175:0/3730178739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc415ac90 msgr2=0x7febc40711d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.875+0000 7febca000640 1 --2- 172.21.15.175:0/3730178739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc415ac90 0x7febc40711d0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7febc4140da0 tx=0x7febb001c490 comp rx=0 tx=0).stop 2024-04-25T09:09:43.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.875+0000 7febca000640 1 -- 172.21.15.175:0/3730178739 shutdown_connections 2024-04-25T09:09:43.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.875+0000 7febca000640 1 --2- 172.21.15.175:0/3730178739 >> v2:172.21.15.177:3300/0 conn(0x7febc4071710 0x7febc413e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.875+0000 7febca000640 1 --2- 172.21.15.175:0/3730178739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc415ac90 0x7febc40711d0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.875+0000 7febca000640 1 -- 172.21.15.175:0/3730178739 >> 172.21.15.175:0/3730178739 conn(0x7febc406ac50 msgr2=0x7febc406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:43.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febca000640 1 -- 172.21.15.175:0/3730178739 shutdown_connections 2024-04-25T09:09:43.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febca000640 1 -- 172.21.15.175:0/3730178739 wait complete. 2024-04-25T09:09:43.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febca000640 1 Processor -- start 2024-04-25T09:09:43.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febca000640 1 -- start start 2024-04-25T09:09:43.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febca000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febc4071710 0x7febc40b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febca000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febc40c4980 0x7febc4158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febca000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc415ac90 0x7febc40b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febca000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc413f210 con 0x7febc415ac90 2024-04-25T09:09:43.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febca000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc413f090 con 0x7febc4071710 2024-04-25T09:09:43.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febca000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc413f390 con 0x7febc40c4980 2024-04-25T09:09:43.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febc9600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc415ac90 0x7febc40b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febc9600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc415ac90 0x7febc40b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34908/0 (socket says 172.21.15.175:34908) 2024-04-25T09:09:43.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febc9600640 1 -- 172.21.15.175:0/1321774498 learned_addr learned my addr 172.21.15.175:0/1321774498 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:43.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febc8c00640 1 --2- 172.21.15.175:0/1321774498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febc4071710 0x7febc40b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febc3e00640 1 --2- 172.21.15.175:0/1321774498 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febc40c4980 0x7febc4158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febc9600640 1 -- 172.21.15.175:0/1321774498 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febc40c4980 msgr2=0x7febc4158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febc9600640 1 --2- 172.21.15.175:0/1321774498 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febc40c4980 0x7febc4158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febc9600640 1 -- 172.21.15.175:0/1321774498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febc4071710 msgr2=0x7febc40b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febc9600640 1 --2- 172.21.15.175:0/1321774498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febc4071710 0x7febc40b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febc9600640 1 -- 172.21.15.175:0/1321774498 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc40b2b60 con 0x7febc415ac90 2024-04-25T09:09:43.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febc8c00640 1 --2- 172.21.15.175:0/1321774498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febc4071710 0x7febc40b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:43.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febc3e00640 1 --2- 172.21.15.175:0/1321774498 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febc40c4980 0x7febc4158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:43.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.879+0000 7febc9600640 1 --2- 172.21.15.175:0/1321774498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc415ac90 0x7febc40b24d0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7febbc00e7f0 tx=0x7febbc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:43.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.883+0000 7febc0c00640 1 -- 172.21.15.175:0/1321774498 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc017070 con 0x7febc415ac90 2024-04-25T09:09:43.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.883+0000 7febc0c00640 1 -- 172.21.15.175:0/1321774498 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc00c940 con 0x7febc415ac90 2024-04-25T09:09:43.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.883+0000 7febc0c00640 1 -- 172.21.15.175:0/1321774498 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc00eea0 con 0x7febc415ac90 2024-04-25T09:09:43.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.883+0000 7febca000640 1 -- 172.21.15.175:0/1321774498 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc40b2e40 con 0x7febc415ac90 2024-04-25T09:09:43.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.883+0000 7febca000640 1 -- 172.21.15.175:0/1321774498 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc40b3400 con 0x7febc415ac90 2024-04-25T09:09:43.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.883+0000 7febc0c00640 1 -- 172.21.15.175:0/1321774498 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7febbc01a070 con 0x7febc415ac90 2024-04-25T09:09:43.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.883+0000 7febc0c00640 1 --2- 172.21.15.175:0/1321774498 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feba4066fb0 0x7feba4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.883+0000 7febc0c00640 1 -- 172.21.15.175:0/1321774498 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7febbc084f40 con 0x7febc415ac90 2024-04-25T09:09:43.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.883+0000 7febc8c00640 1 --2- 172.21.15.175:0/1321774498 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feba4066fb0 0x7feba4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.883+0000 7febce9dd000 1 Processor -- start 2024-04-25T09:09:43.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.883+0000 7febce9dd000 1 -- start start 2024-04-25T09:09:43.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.883+0000 7febc8c00640 1 --2- 172.21.15.175:0/1321774498 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feba4066fb0 0x7feba4069470 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7febb4005fd0 tx=0x7febb4005b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:43.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febce9dd000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb11a2e0 0x5594eb11a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febce9dd000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11ac00 0x5594eb0d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febce9dd000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb0d08e0 0x5594eb0d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febce9dd000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594eafb7ba0 con 0x5594eb11ac00 2024-04-25T09:09:43.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febce9dd000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594eaf1d090 con 0x5594eb11a2e0 2024-04-25T09:09:43.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febce9dd000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594eaea5160 con 0x5594eb0d08e0 2024-04-25T09:09:43.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febc3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11ac00 0x5594eb0d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febc3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11ac00 0x5594eb0d03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34914/0 (socket says 172.21.15.175:34914) 2024-04-25T09:09:43.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febc3e00640 1 -- 172.21.15.175:0/354025294 learned_addr learned my addr 172.21.15.175:0/354025294 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:43.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febc8c00640 1 --2- 172.21.15.175:0/354025294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb11a2e0 0x5594eb11a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febc9600640 1 --2- 172.21.15.175:0/354025294 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb0d08e0 0x5594eb0d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febc3e00640 1 -- 172.21.15.175:0/354025294 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb0d08e0 msgr2=0x5594eb0d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febc3e00640 1 --2- 172.21.15.175:0/354025294 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb0d08e0 0x5594eb0d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febc3e00640 1 -- 172.21.15.175:0/354025294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb11a2e0 msgr2=0x5594eb11a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febc3e00640 1 --2- 172.21.15.175:0/354025294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb11a2e0 0x5594eb11a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febc3e00640 1 -- 172.21.15.175:0/354025294 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594eafc6c20 con 0x5594eb11ac00 2024-04-25T09:09:43.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febc9600640 1 --2- 172.21.15.175:0/354025294 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb0d08e0 0x5594eb0d0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:43.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febc8c00640 1 --2- 172.21.15.175:0/354025294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb11a2e0 0x5594eb11a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:43.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febc3e00640 1 --2- 172.21.15.175:0/354025294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11ac00 0x5594eb0d03a0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7febb001a0c0 tx=0x7febb00a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5918ab556464f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:43.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febb9600640 1 -- 172.21.15.175:0/354025294 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb00b2040 con 0x5594eb11ac00 2024-04-25T09:09:43.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febb9600640 1 -- 172.21.15.175:0/354025294 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb00adaa0 con 0x5594eb11ac00 2024-04-25T09:09:43.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febb9600640 1 -- 172.21.15.175:0/354025294 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb00b7460 con 0x5594eb11ac00 2024-04-25T09:09:43.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febce9dd000 1 -- 172.21.15.175:0/354025294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11ac00 msgr2=0x5594eb0d03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febce9dd000 1 --2- 172.21.15.175:0/354025294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11ac00 0x5594eb0d03a0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7febb001a0c0 tx=0x7febb00a7000 comp rx=0 tx=0).stop 2024-04-25T09:09:43.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febce9dd000 1 -- 172.21.15.175:0/354025294 shutdown_connections 2024-04-25T09:09:43.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febce9dd000 1 --2- 172.21.15.175:0/354025294 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb0d08e0 0x5594eb0d0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febce9dd000 1 --2- 172.21.15.175:0/354025294 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11ac00 0x5594eb0d03a0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febce9dd000 1 --2- 172.21.15.175:0/354025294 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb11a2e0 0x5594eb11a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febce9dd000 1 -- 172.21.15.175:0/354025294 >> 172.21.15.175:0/354025294 conn(0x5594eb0cc890 msgr2=0x5594eb0cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:43.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febce9dd000 1 -- 172.21.15.175:0/354025294 shutdown_connections 2024-04-25T09:09:43.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febce9dd000 1 -- 172.21.15.175:0/354025294 wait complete. 2024-04-25T09:09:43.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febce9dd000 1 -- start start 2024-04-25T09:09:43.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.887+0000 7febce9dd000 1 Processor -- start 2024-04-25T09:09:43.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb0d08e0 0x5594eb121640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11a2e0 0x5594eb121b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb11ac00 0x5594eb108090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594eaf19130 con 0x5594eb11a2e0 2024-04-25T09:09:43.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594eaee1130 con 0x5594eb0d08e0 2024-04-25T09:09:43.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594eafdb300 con 0x5594eb11ac00 2024-04-25T09:09:43.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 10 client.0 _ll_register_callbacks cb 0x5594eb0bbbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:43.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febc3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11a2e0 0x5594eb121b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febc3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11a2e0 0x5594eb121b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34928/0 (socket says 172.21.15.175:34928) 2024-04-25T09:09:43.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febc3e00640 1 -- 172.21.15.175:0/1631200347 learned_addr learned my addr 172.21.15.175:0/1631200347 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:43.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febc9600640 1 --2- 172.21.15.175:0/1631200347 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb11ac00 0x5594eb108090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febc8c00640 1 --2- 172.21.15.175:0/1631200347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb0d08e0 0x5594eb121640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febc3e00640 1 -- 172.21.15.175:0/1631200347 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb11ac00 msgr2=0x5594eb108090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febc3e00640 1 --2- 172.21.15.175:0/1631200347 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb11ac00 0x5594eb108090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febc3e00640 1 -- 172.21.15.175:0/1631200347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb0d08e0 msgr2=0x5594eb121640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febc3e00640 1 --2- 172.21.15.175:0/1631200347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb0d08e0 0x5594eb121640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febc3e00640 1 -- 172.21.15.175:0/1631200347 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594eaefa060 con 0x5594eb11a2e0 2024-04-25T09:09:43.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febc3e00640 1 --2- 172.21.15.175:0/1631200347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11a2e0 0x5594eb121b80 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7febb0097e50 tx=0x7febb001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14a105785ca815 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:43.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febae000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:09:43.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febae000640 1 -- 172.21.15.175:0/1631200347 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb00b2040 con 0x5594eb11a2e0 2024-04-25T09:09:43.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febae000640 1 -- 172.21.15.175:0/1631200347 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7febb0004030 con 0x5594eb11a2e0 2024-04-25T09:09:43.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 -- 172.21.15.175:0/1631200347 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7febb00adaa0 con 0x5594eb11a2e0 2024-04-25T09:09:43.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febae000640 1 -- 172.21.15.175:0/1631200347 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7febb00c9050 con 0x5594eb11a2e0 2024-04-25T09:09:43.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 10 client.7002 fetch_fsmap learned FSMap version 51 2024-04-25T09:09:43.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 -- 172.21.15.175:0/1631200347 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x5594eaebe7c0 con 0x5594eb11a2e0 2024-04-25T09:09:43.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febae000640 1 -- 172.21.15.175:0/1631200347 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb00adaa0 con 0x5594eb11a2e0 2024-04-25T09:09:43.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febae000640 1 -- 172.21.15.175:0/1631200347 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 51) v1 ==== 3294+0+0 (secure 0 0 0) 0x7febb00cc020 con 0x5594eb11a2e0 2024-04-25T09:09:43.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 10 client.7002 fetch_fsmap finished waiting for FSMap version 51 2024-04-25T09:09:43.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 10 client.7002 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:09:43.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 20 client.7002 populate_metadata read hostname 'smithi175' 2024-04-25T09:09:43.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 --2- 172.21.15.175:0/1631200347 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x5594eb108e30 0x5594eb109210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 4 client.7002 mds_command: new command op to 6513 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:43.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 -- 172.21.15.175:0/1631200347 --> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594eaeb8cd0 con 0x5594eb108e30 2024-04-25T09:09:43.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febc8c00640 1 --2- 172.21.15.175:0/1631200347 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x5594eb108e30 0x5594eb109210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febae000640 10 client.7002 ms_handle_connect on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:43.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febc8c00640 1 --2- 172.21.15.175:0/1631200347 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x5594eb108e30 0x5594eb109210 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=565338b68a152766 server_cookie=121a5ce8392a28ee in_seq=0 out_seq=0 2024-04-25T09:09:43.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febae000640 1 -- 172.21.15.175:0/1631200347 <== mds.0 v2:172.21.15.175:6834/2714482688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5594eaeb8cd0 con 0x5594eb108e30 2024-04-25T09:09:43.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febae000640 10 client.7002 handle_command_reply: tid=0 2024-04-25T09:09:43.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 client.7002 shutdown 2024-04-25T09:09:43.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 -- 172.21.15.175:0/1631200347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11a2e0 msgr2=0x5594eb121b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 --2- 172.21.15.175:0/1631200347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11a2e0 0x5594eb121b80 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7febb0097e50 tx=0x7febb001acd0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 -- 172.21.15.175:0/1631200347 shutdown_connections 2024-04-25T09:09:43.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 --2- 172.21.15.175:0/1631200347 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x5594eb108e30 0x5594eb109210 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 --2- 172.21.15.175:0/1631200347 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb11ac00 0x5594eb108090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 --2- 172.21.15.175:0/1631200347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11a2e0 0x5594eb121b80 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 --2- 172.21.15.175:0/1631200347 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb0d08e0 0x5594eb121640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febae000640 0 client.7002 ms_handle_reset on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:43.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 -- 172.21.15.175:0/1631200347 >> 172.21.15.175:0/1631200347 conn(0x5594eb0cc890 msgr2=0x5594eb0cf510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:43.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 -- 172.21.15.175:0/1631200347 shutdown_connections 2024-04-25T09:09:43.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.891+0000 7febce9dd000 1 -- 172.21.15.175:0/1631200347 wait complete. 2024-04-25T09:09:43.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.895+0000 7febce9dd000 20 client.7002 trim_cache size 0 max 16384 2024-04-25T09:09:43.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.903+0000 7febce9dd000 1 Processor -- start 2024-04-25T09:09:43.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.903+0000 7febce9dd000 1 -- start start 2024-04-25T09:09:43.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febce9dd000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb0d08e0 0x5594eb1071f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febce9dd000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb11a2e0 0x5594eb107730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febce9dd000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb11ac00 0x5594eb0cec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febce9dd000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc4201a80 con 0x5594eb0d08e0 2024-04-25T09:09:43.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febce9dd000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc4153f80 con 0x5594eb11ac00 2024-04-25T09:09:43.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febce9dd000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc4201480 con 0x5594eb11a2e0 2024-04-25T09:09:43.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febc8c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb0d08e0 0x5594eb1071f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febc8c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb0d08e0 0x5594eb1071f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34940/0 (socket says 172.21.15.175:34940) 2024-04-25T09:09:43.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febc8c00640 1 -- 172.21.15.175:0/533379880 learned_addr learned my addr 172.21.15.175:0/533379880 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:43.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febc3e00640 1 --2- 172.21.15.175:0/533379880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb11a2e0 0x5594eb107730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febc9600640 1 --2- 172.21.15.175:0/533379880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb11ac00 0x5594eb0cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febc8c00640 1 -- 172.21.15.175:0/533379880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb11a2e0 msgr2=0x5594eb107730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febc8c00640 1 --2- 172.21.15.175:0/533379880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb11a2e0 0x5594eb107730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febc8c00640 1 -- 172.21.15.175:0/533379880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb11ac00 msgr2=0x5594eb0cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febc8c00640 1 --2- 172.21.15.175:0/533379880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb11ac00 0x5594eb0cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febc8c00640 1 -- 172.21.15.175:0/533379880 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594eaed8fc0 con 0x5594eb0d08e0 2024-04-25T09:09:43.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febc8c00640 1 --2- 172.21.15.175:0/533379880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb0d08e0 0x5594eb1071f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x5594eaeded40 tx=0x7febb4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48b40fad283ade1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:43.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febb8c00640 1 -- 172.21.15.175:0/533379880 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb4001c90 con 0x5594eb0d08e0 2024-04-25T09:09:43.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febb8c00640 1 -- 172.21.15.175:0/533379880 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb402a030 con 0x5594eb0d08e0 2024-04-25T09:09:43.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febb8c00640 1 -- 172.21.15.175:0/533379880 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb4014900 con 0x5594eb0d08e0 2024-04-25T09:09:43.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febce9dd000 1 -- 172.21.15.175:0/533379880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb0d08e0 msgr2=0x5594eb1071f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febce9dd000 1 --2- 172.21.15.175:0/533379880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb0d08e0 0x5594eb1071f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x5594eaeded40 tx=0x7febb4012000 comp rx=0 tx=0).stop 2024-04-25T09:09:43.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febce9dd000 1 -- 172.21.15.175:0/533379880 shutdown_connections 2024-04-25T09:09:43.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febce9dd000 1 --2- 172.21.15.175:0/533379880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb11ac00 0x5594eb0cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febce9dd000 1 --2- 172.21.15.175:0/533379880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb11a2e0 0x5594eb107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febce9dd000 1 --2- 172.21.15.175:0/533379880 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb0d08e0 0x5594eb1071f0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febce9dd000 1 -- 172.21.15.175:0/533379880 >> 172.21.15.175:0/533379880 conn(0x5594eb0cc890 msgr2=0x5594eb127d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:43.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febce9dd000 1 -- 172.21.15.175:0/533379880 shutdown_connections 2024-04-25T09:09:43.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febce9dd000 1 -- 172.21.15.175:0/533379880 wait complete. 2024-04-25T09:09:43.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febce9dd000 1 -- start start 2024-04-25T09:09:43.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.907+0000 7febce9dd000 1 Processor -- start 2024-04-25T09:09:43.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb0d08e0 0x5594eb17a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb11a2e0 0x5594eb17a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11ac00 0x5594eb11e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594eaeb7e70 con 0x5594eb11ac00 2024-04-25T09:09:43.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594eaea5a50 con 0x5594eb0d08e0 2024-04-25T09:09:43.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594eaf1c3a0 con 0x5594eb11a2e0 2024-04-25T09:09:43.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 10 client.0 _ll_register_callbacks cb 0x5594eaec9240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:43.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febc9600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11ac00 0x5594eb11e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febc9600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11ac00 0x5594eb11e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34944/0 (socket says 172.21.15.175:34944) 2024-04-25T09:09:43.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febc9600640 1 -- 172.21.15.175:0/599792747 learned_addr learned my addr 172.21.15.175:0/599792747 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:43.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febc3e00640 1 --2- 172.21.15.175:0/599792747 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb11a2e0 0x5594eb17a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febc8c00640 1 --2- 172.21.15.175:0/599792747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb0d08e0 0x5594eb17a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febc9600640 1 -- 172.21.15.175:0/599792747 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb11a2e0 msgr2=0x5594eb17a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febc9600640 1 --2- 172.21.15.175:0/599792747 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb11a2e0 0x5594eb17a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febc9600640 1 -- 172.21.15.175:0/599792747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb0d08e0 msgr2=0x5594eb17a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:43.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febc9600640 1 --2- 172.21.15.175:0/599792747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb0d08e0 0x5594eb17a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febc9600640 1 -- 172.21.15.175:0/599792747 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594eaf769e0 con 0x5594eb11ac00 2024-04-25T09:09:43.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febc9600640 1 --2- 172.21.15.175:0/599792747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11ac00 0x5594eb11e4a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7febbc051c90 tx=0x7febbc059980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7552daed4ffc91be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:43.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febae000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:09:43.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febae000640 1 -- 172.21.15.175:0/599792747 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc081060 con 0x5594eb11ac00 2024-04-25T09:09:43.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febae000640 1 -- 172.21.15.175:0/599792747 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7febbc056b60 con 0x5594eb11ac00 2024-04-25T09:09:43.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 -- 172.21.15.175:0/599792747 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7febb402a030 con 0x5594eb11ac00 2024-04-25T09:09:43.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febae000640 1 -- 172.21.15.175:0/599792747 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7febbc072050 con 0x5594eb11ac00 2024-04-25T09:09:43.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 10 client.7008 fetch_fsmap learned FSMap version 51 2024-04-25T09:09:43.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 -- 172.21.15.175:0/599792747 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x5594eaebc630 con 0x5594eb11ac00 2024-04-25T09:09:43.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febae000640 1 -- 172.21.15.175:0/599792747 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb402a030 con 0x5594eb11ac00 2024-04-25T09:09:43.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febae000640 1 -- 172.21.15.175:0/599792747 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 51) v1 ==== 3294+0+0 (secure 0 0 0) 0x7febbc024060 con 0x5594eb11ac00 2024-04-25T09:09:43.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 10 client.7008 fetch_fsmap finished waiting for FSMap version 51 2024-04-25T09:09:43.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 10 client.7008 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:09:43.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 20 client.7008 populate_metadata read hostname 'smithi175' 2024-04-25T09:09:43.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 --2- 172.21.15.175:0/599792747 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x5594eb11ee60 0x5594eb11f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:43.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 4 client.7008 mds_command: new command op to 6513 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:09:43.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 -- 172.21.15.175:0/599792747 --> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x5594eaf2a5d0 con 0x5594eb11ee60 2024-04-25T09:09:43.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febc8c00640 1 --2- 172.21.15.175:0/599792747 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x5594eb11ee60 0x5594eb11f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:43.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febc8c00640 1 --2- 172.21.15.175:0/599792747 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x5594eb11ee60 0x5594eb11f240 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79cfeca59c351f2e server_cookie=27020d51d369395e in_seq=0 out_seq=0 2024-04-25T09:09:43.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febae000640 10 client.7008 ms_handle_connect on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:43.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febae000640 1 -- 172.21.15.175:0/599792747 <== mds.0 v2:172.21.15.175:6834/2714482688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5594eaf2a5d0 con 0x5594eb11ee60 2024-04-25T09:09:43.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febae000640 10 client.7008 handle_command_reply: tid=0 2024-04-25T09:09:43.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 client.7008 shutdown 2024-04-25T09:09:43.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 -- 172.21.15.175:0/599792747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11ac00 msgr2=0x5594eb11e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 --2- 172.21.15.175:0/599792747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11ac00 0x5594eb11e4a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7febbc051c90 tx=0x7febbc059980 comp rx=0 tx=0).stop 2024-04-25T09:09:43.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 -- 172.21.15.175:0/599792747 shutdown_connections 2024-04-25T09:09:43.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 --2- 172.21.15.175:0/599792747 >> [v2:172.21.15.175:6834/2714482688,v1:172.21.15.175:6836/2714482688] conn(0x5594eb11ee60 0x5594eb11f240 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 --2- 172.21.15.175:0/599792747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5594eb11ac00 0x5594eb11e4a0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 --2- 172.21.15.175:0/599792747 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5594eb11a2e0 0x5594eb17a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 --2- 172.21.15.175:0/599792747 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5594eb0d08e0 0x5594eb17a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 -- 172.21.15.175:0/599792747 >> 172.21.15.175:0/599792747 conn(0x5594eb0cc890 msgr2=0x5594eb119290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:43.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febae000640 0 client.7008 ms_handle_reset on v2:172.21.15.175:6834/2714482688 2024-04-25T09:09:43.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 -- 172.21.15.175:0/599792747 shutdown_connections 2024-04-25T09:09:43.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 1 -- 172.21.15.175:0/599792747 wait complete. 2024-04-25T09:09:43.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febce9dd000 20 client.7008 trim_cache size 0 max 16384 2024-04-25T09:09:43.907 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:09:43.907 INFO:teuthology.orchestra.run.smithi175.stdout:[] 2024-04-25T09:09:43.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febca000640 1 -- 172.21.15.175:0/1321774498 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feba4066fb0 msgr2=0x7feba4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febca000640 1 --2- 172.21.15.175:0/1321774498 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feba4066fb0 0x7feba4069470 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7febb4005fd0 tx=0x7febb4005b80 comp rx=0 tx=0).stop 2024-04-25T09:09:43.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febca000640 1 -- 172.21.15.175:0/1321774498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc415ac90 msgr2=0x7febc40b24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:43.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.911+0000 7febca000640 1 --2- 172.21.15.175:0/1321774498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc415ac90 0x7febc40b24d0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7febbc00e7f0 tx=0x7febbc00ecb0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.915+0000 7febca000640 1 -- 172.21.15.175:0/1321774498 shutdown_connections 2024-04-25T09:09:43.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.915+0000 7febca000640 1 --2- 172.21.15.175:0/1321774498 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feba4066fb0 0x7feba4069470 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.915+0000 7febca000640 1 --2- 172.21.15.175:0/1321774498 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc415ac90 0x7febc40b24d0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.915+0000 7febca000640 1 --2- 172.21.15.175:0/1321774498 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febc40c4980 0x7febc4158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.915+0000 7febca000640 1 --2- 172.21.15.175:0/1321774498 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febc4071710 0x7febc40b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:43.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.915+0000 7febca000640 1 -- 172.21.15.175:0/1321774498 >> 172.21.15.175:0/1321774498 conn(0x7febc406ac50 msgr2=0x7febc4143b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:43.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.915+0000 7febca000640 1 -- 172.21.15.175:0/1321774498 shutdown_connections 2024-04-25T09:09:43.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:43.915+0000 7febca000640 1 -- 172.21.15.175:0/1321774498 wait complete. 2024-04-25T09:09:43.922 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:09:44.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.067+0000 7f69b0a00640 1 Processor -- start 2024-04-25T09:09:44.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.067+0000 7f69b0a00640 1 -- start start 2024-04-25T09:09:44.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.067+0000 7f69b0a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f69ac099a50 0x7f69ac06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:44.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.067+0000 7f69b0a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f69ac06bd60 0x7f69ac099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:44.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.067+0000 7f69b0a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69ac09a370 con 0x7f69ac0d0d50 2024-04-25T09:09:44.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.067+0000 7f69b0a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69ac0cfcb0 con 0x7f69ac06bd60 2024-04-25T09:09:44.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.067+0000 7f69b0a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac0cff90 con 0x7f69ac099a50 2024-04-25T09:09:44.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.067+0000 7f69a9e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f69ac099a50 0x7f69ac06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:44.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.067+0000 7f69a9e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f69ac099a50 0x7f69ac06cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44564/0 (socket says 172.21.15.175:44564) 2024-04-25T09:09:44.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.067+0000 7f69a9e00640 1 -- 172.21.15.175:0/3200011811 learned_addr learned my addr 172.21.15.175:0/3200011811 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:44.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.067+0000 7f69a3e00640 1 --2- 172.21.15.175:0/3200011811 >> v2:172.21.15.177:3300/0 conn(0x7f69ac06bd60 0x7f69ac099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:44.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.067+0000 7f69a9e00640 1 -- 172.21.15.175:0/3200011811 >> v2:172.21.15.177:3300/0 conn(0x7f69ac06bd60 msgr2=0x7f69ac099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:44.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.067+0000 7f69a9e00640 1 --2- 172.21.15.175:0/3200011811 >> v2:172.21.15.177:3300/0 conn(0x7f69ac06bd60 0x7f69ac099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.067+0000 7f69a9e00640 1 -- 172.21.15.175:0/3200011811 >> v1:172.21.15.177:6789/0 conn(0x7f69ac0d0d50 legacy=0x7f69ac0cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:44.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.067+0000 7f69a9e00640 1 -- 172.21.15.175:0/3200011811 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ac0d0270 con 0x7f69ac099a50 2024-04-25T09:09:44.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.071+0000 7f69a9e00640 1 --2- 172.21.15.175:0/3200011811 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f69ac099a50 0x7f69ac06cc50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f699c009870 tx=0x7f699c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a7f2c0b3c4cfaa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:44.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.071+0000 7f69a9400640 1 -- 172.21.15.175:0/3200011811 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c0b0070 con 0x7f69ac099a50 2024-04-25T09:09:44.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.071+0000 7f69a9400640 1 -- 172.21.15.175:0/3200011811 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699c004230 con 0x7f69ac099a50 2024-04-25T09:09:44.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.071+0000 7f69a9400640 1 -- 172.21.15.175:0/3200011811 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699c003620 con 0x7f69ac099a50 2024-04-25T09:09:44.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.071+0000 7f69b0a00640 1 -- 172.21.15.175:0/3200011811 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f69ac099a50 msgr2=0x7f69ac06cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:44.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.071+0000 7f69b0a00640 1 --2- 172.21.15.175:0/3200011811 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f69ac099a50 0x7f69ac06cc50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f699c009870 tx=0x7f699c01c3f0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.071+0000 7f69b0a00640 1 -- 172.21.15.175:0/3200011811 shutdown_connections 2024-04-25T09:09:44.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.071+0000 7f69b0a00640 1 --2- 172.21.15.175:0/3200011811 >> v2:172.21.15.177:3300/0 conn(0x7f69ac06bd60 0x7f69ac099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.071+0000 7f69b0a00640 1 --2- 172.21.15.175:0/3200011811 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f69ac099a50 0x7f69ac06cc50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.071+0000 7f69b0a00640 1 -- 172.21.15.175:0/3200011811 >> 172.21.15.175:0/3200011811 conn(0x7f69ac0b3300 msgr2=0x7f69ac0b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:44.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.071+0000 7f69b0a00640 1 -- 172.21.15.175:0/3200011811 shutdown_connections 2024-04-25T09:09:44.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.071+0000 7f69b0a00640 1 -- 172.21.15.175:0/3200011811 wait complete. 2024-04-25T09:09:44.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69b0a00640 1 Processor -- start 2024-04-25T09:09:44.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69b0a00640 1 -- start start 2024-04-25T09:09:44.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69b0a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f69ac06bd60 0x7f69ac152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:44.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69b0a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69ac099a50 0x7f69ac0b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:44.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69b0a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69ac0d0d50 0x7f69ac0c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:44.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69b0a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac0cf9a0 con 0x7f69ac099a50 2024-04-25T09:09:44.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69b0a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac0d0830 con 0x7f69ac0d0d50 2024-04-25T09:09:44.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69b0a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69ac15de60 con 0x7f69ac06bd60 2024-04-25T09:09:44.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69a3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69ac099a50 0x7f69ac0b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:44.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69a3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69ac099a50 0x7f69ac0b7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34946/0 (socket says 172.21.15.175:34946) 2024-04-25T09:09:44.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69a3e00640 1 -- 172.21.15.175:0/2982600572 learned_addr learned my addr 172.21.15.175:0/2982600572 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:44.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69a9e00640 1 --2- 172.21.15.175:0/2982600572 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f69ac06bd60 0x7f69ac152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:44.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69aa800640 1 --2- 172.21.15.175:0/2982600572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69ac0d0d50 0x7f69ac0c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:44.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69a3e00640 1 -- 172.21.15.175:0/2982600572 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f69ac06bd60 msgr2=0x7f69ac152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:44.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69a3e00640 1 --2- 172.21.15.175:0/2982600572 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f69ac06bd60 0x7f69ac152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69a3e00640 1 -- 172.21.15.175:0/2982600572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69ac0d0d50 msgr2=0x7f69ac0c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:44.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69a3e00640 1 --2- 172.21.15.175:0/2982600572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69ac0d0d50 0x7f69ac0c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69a3e00640 1 -- 172.21.15.175:0/2982600572 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ac0b60c0 con 0x7f69ac099a50 2024-04-25T09:09:44.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69aa800640 1 --2- 172.21.15.175:0/2982600572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69ac0d0d50 0x7f69ac0c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:44.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69a3e00640 1 --2- 172.21.15.175:0/2982600572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69ac099a50 0x7f69ac0b7120 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f699400e870 tx=0x7f699400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:44.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69a2000640 1 -- 172.21.15.175:0/2982600572 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6994017070 con 0x7f69ac099a50 2024-04-25T09:09:44.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69a2000640 1 -- 172.21.15.175:0/2982600572 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f699400c940 con 0x7f69ac099a50 2024-04-25T09:09:44.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69a2000640 1 -- 172.21.15.175:0/2982600572 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699400ccf0 con 0x7f69ac099a50 2024-04-25T09:09:44.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69b0a00640 1 -- 172.21.15.175:0/2982600572 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ac0b6360 con 0x7f69ac099a50 2024-04-25T09:09:44.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.075+0000 7f69b0a00640 1 -- 172.21.15.175:0/2982600572 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ac0b6920 con 0x7f69ac099a50 2024-04-25T09:09:44.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.079+0000 7f69b0a00640 1 -- 172.21.15.175:0/2982600572 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69ac074a60 con 0x7f69ac099a50 2024-04-25T09:09:44.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.079+0000 7f69a2000640 1 -- 172.21.15.175:0/2982600572 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f699401a070 con 0x7f69ac099a50 2024-04-25T09:09:44.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.079+0000 7f69a2000640 1 --2- 172.21.15.175:0/2982600572 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6988066f60 0x7f6988069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:44.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.079+0000 7f69a2000640 1 -- 172.21.15.175:0/2982600572 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f69940852f0 con 0x7f69ac099a50 2024-04-25T09:09:44.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.079+0000 7f69a9e00640 1 --2- 172.21.15.175:0/2982600572 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6988066f60 0x7f6988069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:44.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.079+0000 7f69a9e00640 1 --2- 172.21.15.175:0/2982600572 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6988066f60 0x7f6988069420 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f699c0ad000 tx=0x7f699c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:44.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.083+0000 7f69a2000640 1 -- 172.21.15.175:0/2982600572 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6994056260 con 0x7f69ac099a50 2024-04-25T09:09:44.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.267+0000 7f69b0a00640 1 -- 172.21.15.175:0/2982600572 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f69ac06cf60 con 0x7f69ac099a50 2024-04-25T09:09:44.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.267+0000 7f69a2000640 1 -- 172.21.15.175:0/2982600572 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6994055b60 con 0x7f69ac099a50 2024-04-25T09:09:44.259 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:09:44.259 INFO:teuthology.orchestra.run.smithi175.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T09:09:44.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.271+0000 7f69b0a00640 1 -- 172.21.15.175:0/2982600572 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6988066f60 msgr2=0x7f6988069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:44.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.271+0000 7f69b0a00640 1 --2- 172.21.15.175:0/2982600572 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6988066f60 0x7f6988069420 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f699c0ad000 tx=0x7f699c009040 comp rx=0 tx=0).stop 2024-04-25T09:09:44.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.271+0000 7f69b0a00640 1 -- 172.21.15.175:0/2982600572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69ac099a50 msgr2=0x7f69ac0b7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:44.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.271+0000 7f69b0a00640 1 --2- 172.21.15.175:0/2982600572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69ac099a50 0x7f69ac0b7120 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f699400e870 tx=0x7f699400ec70 comp rx=0 tx=0).stop 2024-04-25T09:09:44.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.271+0000 7f69b0a00640 1 -- 172.21.15.175:0/2982600572 shutdown_connections 2024-04-25T09:09:44.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.271+0000 7f69b0a00640 1 --2- 172.21.15.175:0/2982600572 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6988066f60 0x7f6988069420 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.271+0000 7f69b0a00640 1 --2- 172.21.15.175:0/2982600572 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69ac0d0d50 0x7f69ac0c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.271+0000 7f69b0a00640 1 --2- 172.21.15.175:0/2982600572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69ac099a50 0x7f69ac0b7120 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.271+0000 7f69b0a00640 1 --2- 172.21.15.175:0/2982600572 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f69ac06bd60 0x7f69ac152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.271+0000 7f69b0a00640 1 -- 172.21.15.175:0/2982600572 >> 172.21.15.175:0/2982600572 conn(0x7f69ac0b3300 msgr2=0x7f69ac070b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:44.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.271+0000 7f69b0a00640 1 -- 172.21.15.175:0/2982600572 shutdown_connections 2024-04-25T09:09:44.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.271+0000 7f69b0a00640 1 -- 172.21.15.175:0/2982600572 wait complete. 2024-04-25T09:09:44.279 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T09:09:44.279 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:09:44.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.423+0000 7f7f6b000640 1 Processor -- start 2024-04-25T09:09:44.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.423+0000 7f7f6b000640 1 -- start start 2024-04-25T09:09:44.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.427+0000 7f7f6b000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7f6415a900 0x7f7f6406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:44.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.427+0000 7f7f6b000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7f640cd520 0x7f7f640ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:44.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.427+0000 7f7f6b000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f640cda00 con 0x7f7f640cf560 2024-04-25T09:09:44.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.427+0000 7f7f6b000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6415bcf0 con 0x7f7f640cd520 2024-04-25T09:09:44.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.427+0000 7f7f6b000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f640cdce0 con 0x7f7f6415a900 2024-04-25T09:09:44.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.427+0000 7f7f5be00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7f640cd520 0x7f7f640ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:44.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.427+0000 7f7f69000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7f640cf560 0x7f7f6415bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38138/0 (socket says 172.21.15.175:38138) 2024-04-25T09:09:44.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.427+0000 7f7f69000640 1 -- 172.21.15.175:0/521973982 learned_addr learned my addr 172.21.15.175:0/521973982 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:44.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.427+0000 7f7f63e00640 1 --2- 172.21.15.175:0/521973982 >> v2:172.21.15.177:3300/0 conn(0x7f7f6415a900 0x7f7f6406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:44.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.427+0000 7f7f5be00640 1 -- 172.21.15.175:0/521973982 >> v2:172.21.15.177:3300/0 conn(0x7f7f6415a900 msgr2=0x7f7f6406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:44.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.427+0000 7f7f5be00640 1 --2- 172.21.15.175:0/521973982 >> v2:172.21.15.177:3300/0 conn(0x7f7f6415a900 0x7f7f6406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.427+0000 7f7f5be00640 1 -- 172.21.15.175:0/521973982 >> v1:172.21.15.175:6789/0 conn(0x7f7f640cf560 legacy=0x7f7f6415bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:44.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.427+0000 7f7f5be00640 1 -- 172.21.15.175:0/521973982 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f640cdfc0 con 0x7f7f640cd520 2024-04-25T09:09:44.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f5be00640 1 --2- 172.21.15.175:0/521973982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f640cd520 0x7f7f640ceaa0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f7f640b4c70 tx=0x7f7f4c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d73e30c50b1742a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:44.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f63400640 1 -- 172.21.15.175:0/521973982 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0b2070 con 0x7f7f640cd520 2024-04-25T09:09:44.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f63400640 1 -- 172.21.15.175:0/521973982 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c0a9070 con 0x7f7f640cd520 2024-04-25T09:09:44.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f63400640 1 -- 172.21.15.175:0/521973982 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0ad880 con 0x7f7f640cd520 2024-04-25T09:09:44.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f6b000640 1 -- 172.21.15.175:0/521973982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f640cd520 msgr2=0x7f7f640ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:44.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f6b000640 1 --2- 172.21.15.175:0/521973982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f640cd520 0x7f7f640ceaa0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f7f640b4c70 tx=0x7f7f4c01c450 comp rx=0 tx=0).stop 2024-04-25T09:09:44.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f6b000640 1 -- 172.21.15.175:0/521973982 shutdown_connections 2024-04-25T09:09:44.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f6b000640 1 --2- 172.21.15.175:0/521973982 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f640cd520 0x7f7f640ceaa0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f6b000640 1 --2- 172.21.15.175:0/521973982 >> v2:172.21.15.177:3300/0 conn(0x7f7f6415a900 0x7f7f6406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f6b000640 1 -- 172.21.15.175:0/521973982 >> 172.21.15.175:0/521973982 conn(0x7f7f64067150 msgr2=0x7f7f6406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:44.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f6b000640 1 -- 172.21.15.175:0/521973982 shutdown_connections 2024-04-25T09:09:44.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f6b000640 1 -- 172.21.15.175:0/521973982 wait complete. 2024-04-25T09:09:44.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f6b000640 1 Processor -- start 2024-04-25T09:09:44.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f6b000640 1 -- start start 2024-04-25T09:09:44.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f6b000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f640cf560 0x7f7f640b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:44.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f6b000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f6415a900 0x7f7f641444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:44.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f6b000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f64144d50 0x7f7f64157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:44.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f6b000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f640cf160 con 0x7f7f64144d50 2024-04-25T09:09:44.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f6b000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f640cefe0 con 0x7f7f640cf560 2024-04-25T09:09:44.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.431+0000 7f7f6b000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6406d3b0 con 0x7f7f6415a900 2024-04-25T09:09:44.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f5be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f6415a900 0x7f7f641444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:44.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f63e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f640cf560 0x7f7f640b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:44.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f69000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f64144d50 0x7f7f64157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:44.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f5be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f6415a900 0x7f7f641444f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44588/0 (socket says 172.21.15.175:44588) 2024-04-25T09:09:44.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f63e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f640cf560 0x7f7f640b1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:53460/0 (socket says 172.21.15.175:53460) 2024-04-25T09:09:44.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f5be00640 1 -- 172.21.15.175:0/671953092 learned_addr learned my addr 172.21.15.175:0/671953092 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:44.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f5be00640 1 -- 172.21.15.175:0/671953092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f640cf560 msgr2=0x7f7f640b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:44.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f5be00640 1 --2- 172.21.15.175:0/671953092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f640cf560 0x7f7f640b1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f5be00640 1 -- 172.21.15.175:0/671953092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f64144d50 msgr2=0x7f7f64157c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:44.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f5be00640 1 --2- 172.21.15.175:0/671953092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f64144d50 0x7f7f64157c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f5be00640 1 -- 172.21.15.175:0/671953092 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f64156370 con 0x7f7f6415a900 2024-04-25T09:09:44.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f69000640 1 --2- 172.21.15.175:0/671953092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f64144d50 0x7f7f64157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:44.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f63e00640 1 --2- 172.21.15.175:0/671953092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f640cf560 0x7f7f640b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:44.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f5be00640 1 --2- 172.21.15.175:0/671953092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f6415a900 0x7f7f641444f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0b0040 tx=0x7f7f4c0191f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:44.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f60c00640 1 -- 172.21.15.175:0/671953092 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0bc070 con 0x7f7f6415a900 2024-04-25T09:09:44.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f60c00640 1 -- 172.21.15.175:0/671953092 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c0add00 con 0x7f7f6415a900 2024-04-25T09:09:44.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f6b000640 1 -- 172.21.15.175:0/671953092 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f641565f0 con 0x7f7f6415a900 2024-04-25T09:09:44.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f60c00640 1 -- 172.21.15.175:0/671953092 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c0b2040 con 0x7f7f6415a900 2024-04-25T09:09:44.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f6b000640 1 -- 172.21.15.175:0/671953092 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f64156bb0 con 0x7f7f6415a900 2024-04-25T09:09:44.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f6b000640 1 -- 172.21.15.175:0/671953092 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f64074a60 con 0x7f7f6415a900 2024-04-25T09:09:44.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.435+0000 7f7f60c00640 1 -- 172.21.15.175:0/671953092 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7f4c0bf070 con 0x7f7f6415a900 2024-04-25T09:09:44.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.439+0000 7f7f60c00640 1 --2- 172.21.15.175:0/671953092 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7f40066f60 0x7f7f40069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:44.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.439+0000 7f7f60c00640 1 -- 172.21.15.175:0/671953092 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f7f4c11e0e0 con 0x7f7f6415a900 2024-04-25T09:09:44.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.439+0000 7f7f63e00640 1 --2- 172.21.15.175:0/671953092 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7f40066f60 0x7f7f40069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:44.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.439+0000 7f7f63e00640 1 --2- 172.21.15.175:0/671953092 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7f40066f60 0x7f7f40069420 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7f54009450 tx=0x7f7f54012040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:44.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.443+0000 7f7f60c00640 1 -- 172.21.15.175:0/671953092 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7f64156370 con 0x7f7f6415a900 2024-04-25T09:09:44.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.631+0000 7f7f6b000640 1 -- 172.21.15.175:0/671953092 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7f6406ac50 con 0x7f7f6415a900 2024-04-25T09:09:44.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.631+0000 7f7f60c00640 1 -- 172.21.15.175:0/671953092 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7f4c016070 con 0x7f7f6415a900 2024-04-25T09:09:44.620 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:09:44.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.631+0000 7f7f6b000640 1 -- 172.21.15.175:0/671953092 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7f40066f60 msgr2=0x7f7f40069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:44.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.631+0000 7f7f6b000640 1 --2- 172.21.15.175:0/671953092 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7f40066f60 0x7f7f40069420 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7f54009450 tx=0x7f7f54012040 comp rx=0 tx=0).stop 2024-04-25T09:09:44.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.631+0000 7f7f6b000640 1 -- 172.21.15.175:0/671953092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f6415a900 msgr2=0x7f7f641444f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:44.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.631+0000 7f7f6b000640 1 --2- 172.21.15.175:0/671953092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f6415a900 0x7f7f641444f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0b0040 tx=0x7f7f4c0191f0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.631+0000 7f7f6b000640 1 -- 172.21.15.175:0/671953092 shutdown_connections 2024-04-25T09:09:44.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.631+0000 7f7f6b000640 1 --2- 172.21.15.175:0/671953092 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7f40066f60 0x7f7f40069420 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.631+0000 7f7f6b000640 1 --2- 172.21.15.175:0/671953092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f64144d50 0x7f7f64157c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.631+0000 7f7f6b000640 1 --2- 172.21.15.175:0/671953092 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f6415a900 0x7f7f641444f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.631+0000 7f7f6b000640 1 --2- 172.21.15.175:0/671953092 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f640cf560 0x7f7f640b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:44.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.631+0000 7f7f6b000640 1 -- 172.21.15.175:0/671953092 >> 172.21.15.175:0/671953092 conn(0x7f7f640cd520 msgr2=0x7f7f64150170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:44.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.631+0000 7f7f6b000640 1 -- 172.21.15.175:0/671953092 shutdown_connections 2024-04-25T09:09:44.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:44.631+0000 7f7f6b000640 1 -- 172.21.15.175:0/671953092 wait complete. 2024-04-25T09:09:44.642 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:09:44.642 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:09:44.642 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-25T09:09:44.642 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:09:44.642 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:09:44.642 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:09:44.642 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:09:44.642 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:09:44.642 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:09:44.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:44.643 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-25T09:09:44.651 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:09:44.651 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:09:44.651 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:09:44.652 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:44.652 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:09:44.652 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:44.652 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:09:44.652 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-25T09:09:44.652 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-25T09:09:44.652 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:09:44.652 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-25T09:09:44.652 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-25T09:09:44.652 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:09:44.652 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:09:44.652 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:09:44.652 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:09:44.653 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:09:44.653 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42134sec preferred_lft 42134sec 2024-04-25T09:09:44.653 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-25T09:09:44.653 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:44.653 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:09:44.653 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:0d:71:4a:a6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:09:44.653 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:09:44.653 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:44.653 INFO:teuthology.orchestra.run.smithi175.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:09:44.653 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:09:44.653 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:09:44.653 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:44.653 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:09:44.653 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:44.653 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:09:44.654 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:09:44.654 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:09:44.654 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:44.654 INFO:teuthology.orchestra.run.smithi175.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:09:44.654 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:09:44.654 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:09:44.654 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:44.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:44.655 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:09:44.716 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:09:44.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:44.718 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-25T09:09:44.774 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-25T09:09:44.774 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:09:44.774 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:09:44.774 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:09:44.774 INFO:teuthology.orchestra.run.smithi175.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:09:44.774 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:09:44.774 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:09:44.774 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:09:44.774 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:09:44.774 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:09:44.775 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:09:44.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:44.775 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:09:44.775 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:09:44.775 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:09:44.775 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:09:44.775 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:09:44.775 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:09:44.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:44.867 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:09:44.876 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:09:44.876 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:09:44.876 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:09:44.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:44.876 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-25T09:09:44.942 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:09:44.942 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:09:44.999 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:09:44.999 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:09:44.999 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:09:45.050 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:09:45.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:45.050 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:09:45.137 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:09:45.137 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:09:45.137 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:09:45.153 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:09:45.153 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:09:45.153 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:09:45.153 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:09:45.153 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:09:45.162 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:09:45.162 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:09:45.162 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:09:45.162 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:09:45.162 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:09:45.162 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:09:45.162 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:09:45.162 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:09:45.166 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:09:45.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:45.166 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:09:45.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:45.185 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:09:45.237 INFO:teuthology.orchestra.run.smithi175.stdout:client6685 2024-04-25T09:09:45.237 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:09:45.237 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:45.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:45.287 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-04-25T09:09:45.340 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:09:45.340 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-04-25T09:09:45.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.443+0000 7f51b3b19080 1 Processor -- start 2024-04-25T09:09:45.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.443+0000 7f51b3b19080 1 -- start start 2024-04-25T09:09:45.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5198004680 0x55dcb8a8e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:45.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcb8a8d780 0x55dcb8a8db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:45.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dcb8b332e0 0x55dcb8b336f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:45.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb8a069f0 con 0x55dcb8b332e0 2024-04-25T09:09:45.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb8a0a950 con 0x55dcb8a8d780 2024-04-25T09:09:45.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dcb8b18f80 con 0x7f5198004680 2024-04-25T09:09:45.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b1800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dcb8b332e0 0x55dcb8b336f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:45.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b1800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dcb8b332e0 0x55dcb8b336f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34994/0 (socket says 172.21.15.175:34994) 2024-04-25T09:09:45.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b1800640 1 -- 172.21.15.175:0/2625294306 learned_addr learned my addr 172.21.15.175:0/2625294306 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:45.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b1800640 1 -- 172.21.15.175:0/2625294306 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5198004680 msgr2=0x55dcb8a8e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:45.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b1800640 1 --2- 172.21.15.175:0/2625294306 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5198004680 0x55dcb8a8e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:45.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51abe00640 1 --2- 172.21.15.175:0/2625294306 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcb8a8d780 0x55dcb8a8db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:45.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b1800640 1 -- 172.21.15.175:0/2625294306 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcb8a8d780 msgr2=0x55dcb8a8db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:45.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b1800640 1 --2- 172.21.15.175:0/2625294306 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcb8a8d780 0x55dcb8a8db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:45.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b1800640 1 -- 172.21.15.175:0/2625294306 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcb8a8e0d0 con 0x55dcb8b332e0 2024-04-25T09:09:45.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b1800640 1 --2- 172.21.15.175:0/2625294306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dcb8b332e0 0x55dcb8b336f0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x55dcb8a4dac0 tx=0x7f51ac004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90df3bb71c18480b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:45.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51aaa00640 1 -- 172.21.15.175:0/2625294306 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac001a00 con 0x55dcb8b332e0 2024-04-25T09:09:45.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51aaa00640 1 -- 172.21.15.175:0/2625294306 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac00f450 con 0x55dcb8b332e0 2024-04-25T09:09:45.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51aaa00640 1 -- 172.21.15.175:0/2625294306 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac00f820 con 0x55dcb8b332e0 2024-04-25T09:09:45.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 -- 172.21.15.175:0/2625294306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dcb8b332e0 msgr2=0x55dcb8b336f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:45.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 --2- 172.21.15.175:0/2625294306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dcb8b332e0 0x55dcb8b336f0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x55dcb8a4dac0 tx=0x7f51ac004840 comp rx=0 tx=0).stop 2024-04-25T09:09:45.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 -- 172.21.15.175:0/2625294306 shutdown_connections 2024-04-25T09:09:45.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 --2- 172.21.15.175:0/2625294306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dcb8b332e0 0x55dcb8b336f0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:45.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 --2- 172.21.15.175:0/2625294306 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55dcb8a8d780 0x55dcb8a8db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:45.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 --2- 172.21.15.175:0/2625294306 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5198004680 0x55dcb8a8e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:45.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 -- 172.21.15.175:0/2625294306 >> 172.21.15.175:0/2625294306 conn(0x55dcb8a60420 msgr2=0x55dcb8b34b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:45.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 -- 172.21.15.175:0/2625294306 shutdown_connections 2024-04-25T09:09:45.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 -- 172.21.15.175:0/2625294306 wait complete. 2024-04-25T09:09:45.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 Processor -- start 2024-04-25T09:09:45.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 -- start start 2024-04-25T09:09:45.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dcb8a8d780 0x55dcb8a89c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:45.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55dcb8b332e0 0x55dcb8a60f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:45.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5198004680 0x55dcb8a614d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:45.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb8b34280 con 0x55dcb8a8d780 2024-04-25T09:09:45.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcb8b36040 con 0x7f5198004680 2024-04-25T09:09:45.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.447+0000 7f51b3b19080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dcb8b34520 con 0x55dcb8b332e0 2024-04-25T09:09:45.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.451+0000 7f51b0e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dcb8a8d780 0x55dcb8a89c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:45.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.451+0000 7f51b0e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dcb8a8d780 0x55dcb8a89c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35008/0 (socket says 172.21.15.175:35008) 2024-04-25T09:09:45.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.451+0000 7f51b0e00640 1 -- 172.21.15.175:0/780484988 learned_addr learned my addr 172.21.15.175:0/780484988 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:45.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.451+0000 7f51abe00640 1 --2- 172.21.15.175:0/780484988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55dcb8b332e0 0x55dcb8a60f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:45.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.451+0000 7f51b1800640 1 --2- 172.21.15.175:0/780484988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5198004680 0x55dcb8a614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:45.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.451+0000 7f51b0e00640 1 -- 172.21.15.175:0/780484988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55dcb8b332e0 msgr2=0x55dcb8a60f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:45.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.451+0000 7f51b0e00640 1 --2- 172.21.15.175:0/780484988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55dcb8b332e0 0x55dcb8a60f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:45.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.451+0000 7f51b0e00640 1 -- 172.21.15.175:0/780484988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5198004680 msgr2=0x55dcb8a614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:45.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.451+0000 7f51b0e00640 1 --2- 172.21.15.175:0/780484988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5198004680 0x55dcb8a614d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:45.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.451+0000 7f51b0e00640 1 -- 172.21.15.175:0/780484988 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcb8b32d40 con 0x55dcb8a8d780 2024-04-25T09:09:45.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.451+0000 7f51b0e00640 1 --2- 172.21.15.175:0/780484988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dcb8a8d780 0x55dcb8a89c80 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f51a40ad040 tx=0x7f51a4006f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:45.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.451+0000 7f51a9600640 1 -- 172.21.15.175:0/780484988 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a40af040 con 0x55dcb8a8d780 2024-04-25T09:09:45.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.451+0000 7f51a9600640 1 -- 172.21.15.175:0/780484988 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a4006450 con 0x55dcb8a8d780 2024-04-25T09:09:45.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.451+0000 7f51a9600640 1 -- 172.21.15.175:0/780484988 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a40b56b0 con 0x55dcb8a8d780 2024-04-25T09:09:45.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.451+0000 7f51b3b19080 1 -- 172.21.15.175:0/780484988 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dcb8a851a0 con 0x55dcb8a8d780 2024-04-25T09:09:45.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.451+0000 7f51b3b19080 1 -- 172.21.15.175:0/780484988 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcb8a856e0 con 0x55dcb8a8d780 2024-04-25T09:09:45.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.451+0000 7f51a9600640 1 -- 172.21.15.175:0/780484988 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f51a40bd020 con 0x55dcb8a8d780 2024-04-25T09:09:45.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.451+0000 7f51a9600640 1 --2- 172.21.15.175:0/780484988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5194065970 0x7f5194067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:45.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51a9600640 1 -- 172.21.15.175:0/780484988 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f51a411e610 con 0x55dcb8a8d780 2024-04-25T09:09:45.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51abe00640 1 --2- 172.21.15.175:0/780484988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5194065970 0x7f5194067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:45.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51b3b19080 1 --2- 172.21.15.175:0/780484988 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55dcb8a89050 0x55dcb8a84040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:45.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51b3b19080 1 -- 172.21.15.175:0/780484988 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:1 10.10 10:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72) v9 -- 0x55dcb8a84580 con 0x55dcb8a89050 2024-04-25T09:09:45.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51abe00640 1 --2- 172.21.15.175:0/780484988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5194065970 0x7f5194067e30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f51a0000c10 tx=0x7f51a000f510 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:45.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51b1800640 1 --2- 172.21.15.175:0/780484988 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55dcb8a89050 0x55dcb8a84040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:45.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51b1800640 1 --2- 172.21.15.175:0/780484988 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55dcb8a89050 0x55dcb8a84040 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:45.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51b1800640 1 -- 172.21.15.175:0/780484988 <== osd.4 v2:172.21.15.177:6808/236493968 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v72'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f51ac01d040 con 0x55dcb8a89050 2024-04-25T09:09:45.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51b3b19080 1 -- 172.21.15.175:0/780484988 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55dcb8a89050 msgr2=0x55dcb8a84040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:45.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51b3b19080 1 --2- 172.21.15.175:0/780484988 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55dcb8a89050 0x55dcb8a84040 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:45.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51b3b19080 1 -- 172.21.15.175:0/780484988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5194065970 msgr2=0x7f5194067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:45.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51b3b19080 1 --2- 172.21.15.175:0/780484988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5194065970 0x7f5194067e30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f51a0000c10 tx=0x7f51a000f510 comp rx=0 tx=0).stop 2024-04-25T09:09:45.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51b3b19080 1 -- 172.21.15.175:0/780484988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dcb8a8d780 msgr2=0x55dcb8a89c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:45.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51b3b19080 1 --2- 172.21.15.175:0/780484988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55dcb8a8d780 0x55dcb8a89c80 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f51a40ad040 tx=0x7f51a4006f30 comp rx=0 tx=0).stop 2024-04-25T09:09:45.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51b1800640 1 -- 172.21.15.175:0/780484988 reap_dead start 2024-04-25T09:09:45.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51b3b19080 1 -- 172.21.15.175:0/780484988 shutdown_connections 2024-04-25T09:09:45.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51b3b19080 1 -- 172.21.15.175:0/780484988 >> 172.21.15.175:0/780484988 conn(0x55dcb8a60420 msgr2=0x55dcb8b38910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:45.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51b3b19080 1 -- 172.21.15.175:0/780484988 shutdown_connections 2024-04-25T09:09:45.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.455+0000 7f51b3b19080 1 -- 172.21.15.175:0/780484988 wait complete. 2024-04-25T09:09:45.451 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:09:45.451 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:09:45.549 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:09:45.641 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:09:45.641 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:09:45.641 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:45.650 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:09:45.650 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:45.698 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:45.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.883+0000 7f6f92c00640 1 Processor -- start 2024-04-25T09:09:45.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.883+0000 7f6f92c00640 1 -- start start 2024-04-25T09:09:45.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.883+0000 7f6f92c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6f8c071950 0x7f6f8c06de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:45.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.883+0000 7f6f92c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6f8c06e340 0x7f6f8c0b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:45.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.883+0000 7f6f92c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8c06eba0 con 0x7f6f8c0aeb30 2024-04-25T09:09:45.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.883+0000 7f6f92c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8c0b2a70 con 0x7f6f8c06e340 2024-04-25T09:09:45.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.883+0000 7f6f92c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8c06ee80 con 0x7f6f8c071950 2024-04-25T09:09:45.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.887+0000 7f6f90c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6f8c06e340 0x7f6f8c0b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:45.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.887+0000 7f6f8be00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f6f8c0aeb30 0x7f6f8c071240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38164/0 (socket says 172.21.15.175:38164) 2024-04-25T09:09:45.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.887+0000 7f6f8be00640 1 -- 172.21.15.175:0/3083689876 learned_addr learned my addr 172.21.15.175:0/3083689876 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:45.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.887+0000 7f6f83400640 1 --2- 172.21.15.175:0/3083689876 >> v2:172.21.15.177:3300/0 conn(0x7f6f8c071950 0x7f6f8c06de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:45.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.887+0000 7f6f90c00640 1 -- 172.21.15.175:0/3083689876 >> v2:172.21.15.177:3300/0 conn(0x7f6f8c071950 msgr2=0x7f6f8c06de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:45.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.887+0000 7f6f90c00640 1 --2- 172.21.15.175:0/3083689876 >> v2:172.21.15.177:3300/0 conn(0x7f6f8c071950 0x7f6f8c06de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:45.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.887+0000 7f6f90c00640 1 -- 172.21.15.175:0/3083689876 >> v1:172.21.15.175:6789/0 conn(0x7f6f8c0aeb30 legacy=0x7f6f8c071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:45.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.887+0000 7f6f90c00640 1 -- 172.21.15.175:0/3083689876 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c0b2700 con 0x7f6f8c06e340 2024-04-25T09:09:45.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.887+0000 7f6f83400640 1 --2- 172.21.15.175:0/3083689876 >> v2:172.21.15.177:3300/0 conn(0x7f6f8c071950 0x7f6f8c06de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:45.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.887+0000 7f6f90c00640 1 --2- 172.21.15.175:0/3083689876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f8c06e340 0x7f6f8c0b2f00 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0b2340 tx=0x7f6f8401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92185169acb2e665 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:45.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.887+0000 7f6f8b400640 1 -- 172.21.15.175:0/3083689876 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f840b0070 con 0x7f6f8c06e340 2024-04-25T09:09:45.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.887+0000 7f6f8b400640 1 -- 172.21.15.175:0/3083689876 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f840ab600 con 0x7f6f8c06e340 2024-04-25T09:09:45.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.887+0000 7f6f8b400640 1 -- 172.21.15.175:0/3083689876 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f840ab9d0 con 0x7f6f8c06e340 2024-04-25T09:09:45.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f92c00640 1 -- 172.21.15.175:0/3083689876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f8c06e340 msgr2=0x7f6f8c0b2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:45.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f92c00640 1 --2- 172.21.15.175:0/3083689876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f8c06e340 0x7f6f8c0b2f00 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0b2340 tx=0x7f6f8401c3c0 comp rx=0 tx=0).stop 2024-04-25T09:09:45.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f92c00640 1 -- 172.21.15.175:0/3083689876 shutdown_connections 2024-04-25T09:09:45.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f92c00640 1 --2- 172.21.15.175:0/3083689876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f8c06e340 0x7f6f8c0b2f00 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:45.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f92c00640 1 --2- 172.21.15.175:0/3083689876 >> v2:172.21.15.177:3300/0 conn(0x7f6f8c071950 0x7f6f8c06de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:45.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f92c00640 1 -- 172.21.15.175:0/3083689876 >> 172.21.15.175:0/3083689876 conn(0x7f6f8c067150 msgr2=0x7f6f8c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:45.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f92c00640 1 -- 172.21.15.175:0/3083689876 shutdown_connections 2024-04-25T09:09:45.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f92c00640 1 -- 172.21.15.175:0/3083689876 wait complete. 2024-04-25T09:09:45.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f92c00640 1 Processor -- start 2024-04-25T09:09:45.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f92c00640 1 -- start start 2024-04-25T09:09:45.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f92c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f8c071950 0x7f6f8c141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:45.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f92c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f8c0aeb30 0x7f6f8c0cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:45.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f92c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f8c0cdc50 0x7f6f8c158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:45.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f92c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c0b37d0 con 0x7f6f8c0aeb30 2024-04-25T09:09:45.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f92c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c0b3650 con 0x7f6f8c0cdc50 2024-04-25T09:09:45.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f92c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c0b3950 con 0x7f6f8c071950 2024-04-25T09:09:45.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f83400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f8c0aeb30 0x7f6f8c0cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:45.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f83400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f8c0aeb30 0x7f6f8c0cd710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35030/0 (socket says 172.21.15.175:35030) 2024-04-25T09:09:45.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f83400640 1 -- 172.21.15.175:0/1559218195 learned_addr learned my addr 172.21.15.175:0/1559218195 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:45.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f8be00640 1 --2- 172.21.15.175:0/1559218195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f8c071950 0x7f6f8c141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:45.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f90c00640 1 --2- 172.21.15.175:0/1559218195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f8c0cdc50 0x7f6f8c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:45.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f83400640 1 -- 172.21.15.175:0/1559218195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f8c071950 msgr2=0x7f6f8c141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:45.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f83400640 1 --2- 172.21.15.175:0/1559218195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f8c071950 0x7f6f8c141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:45.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f83400640 1 -- 172.21.15.175:0/1559218195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f8c0cdc50 msgr2=0x7f6f8c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:45.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f83400640 1 --2- 172.21.15.175:0/1559218195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f8c0cdc50 0x7f6f8c158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:45.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f83400640 1 -- 172.21.15.175:0/1559218195 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c1427c0 con 0x7f6f8c0aeb30 2024-04-25T09:09:45.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.891+0000 7f6f83400640 1 --2- 172.21.15.175:0/1559218195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f8c0aeb30 0x7f6f8c0cd710 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400c7c0 tx=0x7f6f7400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:45.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.895+0000 7f6f88c00640 1 -- 172.21.15.175:0/1559218195 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f740079d0 con 0x7f6f8c0aeb30 2024-04-25T09:09:45.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.895+0000 7f6f88c00640 1 -- 172.21.15.175:0/1559218195 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f74007b70 con 0x7f6f8c0aeb30 2024-04-25T09:09:45.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.895+0000 7f6f92c00640 1 -- 172.21.15.175:0/1559218195 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8c142aa0 con 0x7f6f8c0aeb30 2024-04-25T09:09:45.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.895+0000 7f6f88c00640 1 -- 172.21.15.175:0/1559218195 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f740113f0 con 0x7f6f8c0aeb30 2024-04-25T09:09:45.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.895+0000 7f6f92c00640 1 -- 172.21.15.175:0/1559218195 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c143060 con 0x7f6f8c0aeb30 2024-04-25T09:09:45.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.895+0000 7f6f92c00640 1 -- 172.21.15.175:0/1559218195 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8c074a60 con 0x7f6f8c0aeb30 2024-04-25T09:09:45.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.895+0000 7f6f88c00640 1 -- 172.21.15.175:0/1559218195 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6f74011590 con 0x7f6f8c0aeb30 2024-04-25T09:09:45.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.895+0000 7f6f88c00640 1 --2- 172.21.15.175:0/1559218195 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6f68066f60 0x7f6f68069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:45.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.895+0000 7f6f88c00640 1 -- 172.21.15.175:0/1559218195 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f6f74085200 con 0x7f6f8c0aeb30 2024-04-25T09:09:45.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.895+0000 7f6f8be00640 1 --2- 172.21.15.175:0/1559218195 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6f68066f60 0x7f6f68069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:45.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.895+0000 7f6f8be00640 1 --2- 172.21.15.175:0/1559218195 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6f68066f60 0x7f6f68069420 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0012f0 tx=0x7f6f7c0019a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:45.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:45.899+0000 7f6f88c00640 1 -- 172.21.15.175:0/1559218195 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6f74015020 con 0x7f6f8c0aeb30 2024-04-25T09:09:46.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.063+0000 7f6f92c00640 1 -- 172.21.15.175:0/1559218195 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f8c0721c0 con 0x7f6f8c0aeb30 2024-04-25T09:09:46.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.063+0000 7f6f88c00640 1 -- 172.21.15.175:0/1559218195 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16933 (secure 0 0 0) 0x7f6f74055a90 con 0x7f6f8c0aeb30 2024-04-25T09:09:46.053 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:09:46.053 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":72,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:08:52.921396+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:08:15.743582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T09:08:16.375168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.17","mappings":[{"from":6,"to":0}]},{"pgid":"11.2e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.177:6835/1709110121":"2024-04-26T09:08:32.433027+0000","172.21.15.177:6833/1709110121":"2024-04-26T09:08:32.433027+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:46.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.063+0000 7f6f92c00640 1 -- 172.21.15.175:0/1559218195 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6f68066f60 msgr2=0x7f6f68069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.063+0000 7f6f92c00640 1 --2- 172.21.15.175:0/1559218195 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6f68066f60 0x7f6f68069420 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0012f0 tx=0x7f6f7c0019a0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.063+0000 7f6f92c00640 1 -- 172.21.15.175:0/1559218195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f8c0aeb30 msgr2=0x7f6f8c0cd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.063+0000 7f6f92c00640 1 --2- 172.21.15.175:0/1559218195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f8c0aeb30 0x7f6f8c0cd710 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400c7c0 tx=0x7f6f7400cc80 comp rx=0 tx=0).stop 2024-04-25T09:09:46.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.063+0000 7f6f92c00640 1 -- 172.21.15.175:0/1559218195 shutdown_connections 2024-04-25T09:09:46.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.063+0000 7f6f92c00640 1 --2- 172.21.15.175:0/1559218195 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6f68066f60 0x7f6f68069420 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.063+0000 7f6f92c00640 1 --2- 172.21.15.175:0/1559218195 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f8c0cdc50 0x7f6f8c158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.063+0000 7f6f92c00640 1 --2- 172.21.15.175:0/1559218195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f8c0aeb30 0x7f6f8c0cd710 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.063+0000 7f6f92c00640 1 --2- 172.21.15.175:0/1559218195 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f8c071950 0x7f6f8c141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.063+0000 7f6f92c00640 1 -- 172.21.15.175:0/1559218195 >> 172.21.15.175:0/1559218195 conn(0x7f6f8c06e340 msgr2=0x7f6f8c15bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:46.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.063+0000 7f6f92c00640 1 -- 172.21.15.175:0/1559218195 shutdown_connections 2024-04-25T09:09:46.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.063+0000 7f6f92c00640 1 -- 172.21.15.175:0/1559218195 wait complete. 2024-04-25T09:09:46.074 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:08:15.743582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:08:16.375168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:09:46.075 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:09:46.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.223+0000 7fad50e00640 1 Processor -- start 2024-04-25T09:09:46.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.223+0000 7fad50e00640 1 -- start start 2024-04-25T09:09:46.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.223+0000 7fad50e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fad4c0b3230 0x7fad4c0b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.223+0000 7fad50e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4c15dd10 con 0x7fad4c0719e0 2024-04-25T09:09:46.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.223+0000 7fad50e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad4c15dff0 con 0x7fad4c0b3d20 2024-04-25T09:09:46.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.223+0000 7fad50e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad4c15e2d0 con 0x7fad4c0b3230 2024-04-25T09:09:46.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.223+0000 7fad4a800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fad4c0719e0 0x7fad4c15aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38172/0 (socket says 172.21.15.175:38172) 2024-04-25T09:09:46.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.223+0000 7fad4a800640 1 -- 172.21.15.175:0/2523594949 learned_addr learned my addr 172.21.15.175:0/2523594949 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:46.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49e00640 1 --2- 172.21.15.175:0/2523594949 >> v2:172.21.15.177:3300/0 conn(0x7fad4c0b3230 0x7fad4c0b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49400640 1 -- 172.21.15.175:0/2523594949 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839981183 0 0) 0x7fad4c15dd10 con 0x7fad4c0719e0 2024-04-25T09:09:46.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49400640 1 -- 172.21.15.175:0/2523594949 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad30003450 con 0x7fad4c0719e0 2024-04-25T09:09:46.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49400640 1 -- 172.21.15.175:0/2523594949 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054240374 0 0) 0x7fad4c15dff0 con 0x7fad4c0b3d20 2024-04-25T09:09:46.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49400640 1 -- 172.21.15.175:0/2523594949 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad4c15dd10 con 0x7fad4c0b3d20 2024-04-25T09:09:46.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49400640 1 -- 172.21.15.175:0/2523594949 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 522052758 0 0) 0x7fad30003450 con 0x7fad4c0719e0 2024-04-25T09:09:46.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49400640 1 -- 172.21.15.175:0/2523594949 >> v2:172.21.15.177:3300/0 conn(0x7fad4c0b3230 msgr2=0x7fad4c0b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:46.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49400640 1 --2- 172.21.15.175:0/2523594949 >> v2:172.21.15.177:3300/0 conn(0x7fad4c0b3230 0x7fad4c0b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49400640 1 -- 172.21.15.175:0/2523594949 >> v1:172.21.15.177:6789/0 conn(0x7fad4c0b3d20 legacy=0x7fad4c0712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49400640 1 -- 172.21.15.175:0/2523594949 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c15e5b0 con 0x7fad4c0719e0 2024-04-25T09:09:46.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49400640 1 -- 172.21.15.175:0/2523594949 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fad440016a0 con 0x7fad4c0719e0 2024-04-25T09:09:46.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49400640 1 -- 172.21.15.175:0/2523594949 >> v1:172.21.15.175:6789/0 conn(0x7fad4c0719e0 legacy=0x7fad4c15aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49400640 1 --2- 172.21.15.175:0/2523594949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad30003c90 0x7fad30008860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49400640 1 --2- 172.21.15.175:0/2523594949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad30008da0 0x7fad3000b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49400640 1 --2- 172.21.15.175:0/2523594949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad3000b6d0 0x7fad3000dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49400640 1 -- 172.21.15.175:0/2523594949 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c15e2d0 con 0x7fad30003c90 2024-04-25T09:09:46.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49400640 1 -- 172.21.15.175:0/2523594949 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3000e2b0 con 0x7fad30008da0 2024-04-25T09:09:46.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49400640 1 -- 172.21.15.175:0/2523594949 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3000e4b0 con 0x7fad3000b6d0 2024-04-25T09:09:46.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49e00640 1 --2- 172.21.15.175:0/2523594949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad30003c90 0x7fad30008860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad41400640 1 --2- 172.21.15.175:0/2523594949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad30008da0 0x7fad3000b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad4a800640 1 --2- 172.21.15.175:0/2523594949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad3000b6d0 0x7fad3000dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49e00640 1 -- 172.21.15.175:0/2523594949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad3000b6d0 msgr2=0x7fad3000dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:46.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49e00640 1 --2- 172.21.15.175:0/2523594949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad3000b6d0 0x7fad3000dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49e00640 1 -- 172.21.15.175:0/2523594949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad30008da0 msgr2=0x7fad3000b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:46.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49e00640 1 --2- 172.21.15.175:0/2523594949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad30008da0 0x7fad3000b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad49e00640 1 -- 172.21.15.175:0/2523594949 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad30003450 con 0x7fad30003c90 2024-04-25T09:09:46.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad41400640 1 --2- 172.21.15.175:0/2523594949 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad30008da0 0x7fad3000b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:46.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.227+0000 7fad4a800640 1 -- 172.21.15.175:0/2523594949 reap_dead start 2024-04-25T09:09:46.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad49e00640 1 --2- 172.21.15.175:0/2523594949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad30003c90 0x7fad30008860 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009fc0 tx=0x7fad3c01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be976c52943d449 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:46.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad49400640 1 -- 172.21.15.175:0/2523594949 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c0b2070 con 0x7fad30003c90 2024-04-25T09:09:46.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad49400640 1 -- 172.21.15.175:0/2523594949 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c0a5b20 con 0x7fad30003c90 2024-04-25T09:09:46.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad49400640 1 -- 172.21.15.175:0/2523594949 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c009c10 con 0x7fad30003c90 2024-04-25T09:09:46.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad50e00640 1 -- 172.21.15.175:0/2523594949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad30003c90 msgr2=0x7fad30008860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad50e00640 1 --2- 172.21.15.175:0/2523594949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad30003c90 0x7fad30008860 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009fc0 tx=0x7fad3c01cc50 comp rx=0 tx=0).stop 2024-04-25T09:09:46.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad50e00640 1 -- 172.21.15.175:0/2523594949 shutdown_connections 2024-04-25T09:09:46.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad50e00640 1 --2- 172.21.15.175:0/2523594949 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad30003c90 0x7fad30008860 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad50e00640 1 -- 172.21.15.175:0/2523594949 >> 172.21.15.175:0/2523594949 conn(0x7fad4c06ac50 msgr2=0x7fad4c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:46.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad50e00640 1 -- 172.21.15.175:0/2523594949 shutdown_connections 2024-04-25T09:09:46.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad50e00640 1 -- 172.21.15.175:0/2523594949 wait complete. 2024-04-25T09:09:46.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad50e00640 1 Processor -- start 2024-04-25T09:09:46.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad50e00640 1 -- start start 2024-04-25T09:09:46.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad50e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad30003c90 0x7fad4c1e5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad50e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad4c14d110 0x7fad4c1594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad50e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad4c14d570 0x7fad4c159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad50e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c0b3610 con 0x7fad4c14d570 2024-04-25T09:09:46.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad50e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c0b2a70 con 0x7fad30003c90 2024-04-25T09:09:46.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.231+0000 7fad50e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4c0b3790 con 0x7fad4c14d110 2024-04-25T09:09:46.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad4a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad4c14d570 0x7fad4c159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad4a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad4c14d570 0x7fad4c159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35050/0 (socket says 172.21.15.175:35050) 2024-04-25T09:09:46.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad49e00640 1 --2- 172.21.15.175:0/466529874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad30003c90 0x7fad4c1e5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad4a800640 1 -- 172.21.15.175:0/466529874 learned_addr learned my addr 172.21.15.175:0/466529874 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:46.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad41400640 1 --2- 172.21.15.175:0/466529874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad4c14d110 0x7fad4c1594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad4a800640 1 -- 172.21.15.175:0/466529874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad4c14d110 msgr2=0x7fad4c1594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad4a800640 1 --2- 172.21.15.175:0/466529874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad4c14d110 0x7fad4c1594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad4a800640 1 -- 172.21.15.175:0/466529874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad30003c90 msgr2=0x7fad4c1e5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad4a800640 1 --2- 172.21.15.175:0/466529874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad30003c90 0x7fad4c1e5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad4a800640 1 -- 172.21.15.175:0/466529874 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad4c155030 con 0x7fad4c14d570 2024-04-25T09:09:46.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad4a800640 1 --2- 172.21.15.175:0/466529874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad4c14d570 0x7fad4c159a30 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fad44005fd0 tx=0x7fad4400e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:46.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad42a00640 1 -- 172.21.15.175:0/466529874 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad44019070 con 0x7fad4c14d570 2024-04-25T09:09:46.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad42a00640 1 -- 172.21.15.175:0/466529874 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad44010510 con 0x7fad4c14d570 2024-04-25T09:09:46.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad42a00640 1 -- 172.21.15.175:0/466529874 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad440108e0 con 0x7fad4c14d570 2024-04-25T09:09:46.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad50e00640 1 -- 172.21.15.175:0/466529874 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad4c155310 con 0x7fad4c14d570 2024-04-25T09:09:46.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad50e00640 1 -- 172.21.15.175:0/466529874 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4c1558d0 con 0x7fad4c14d570 2024-04-25T09:09:46.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad50e00640 1 -- 172.21.15.175:0/466529874 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4c155ad0 con 0x7fad4c14d570 2024-04-25T09:09:46.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad42a00640 1 -- 172.21.15.175:0/466529874 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fad4401c070 con 0x7fad4c14d570 2024-04-25T09:09:46.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad42a00640 1 --2- 172.21.15.175:0/466529874 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fad28066f60 0x7fad28069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad42a00640 1 -- 172.21.15.175:0/466529874 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fad44084630 con 0x7fad4c14d570 2024-04-25T09:09:46.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.235+0000 7fad49e00640 1 --2- 172.21.15.175:0/466529874 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fad28066f60 0x7fad28069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.239+0000 7fad49e00640 1 --2- 172.21.15.175:0/466529874 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fad28066f60 0x7fad28069420 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0af000 tx=0x7fad3c004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:46.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.239+0000 7fad42a00640 1 -- 172.21.15.175:0/466529874 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fad4c155ad0 con 0x7fad4c14d570 2024-04-25T09:09:46.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.395+0000 7fad50e00640 1 -- 172.21.15.175:0/466529874 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad4c075160 con 0x7fad4c14d570 2024-04-25T09:09:46.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.395+0000 7fad42a00640 1 -- 172.21.15.175:0/466529874 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad44054ec0 con 0x7fad4c14d570 2024-04-25T09:09:46.387 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:09:46.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.399+0000 7fad50e00640 1 -- 172.21.15.175:0/466529874 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fad28066f60 msgr2=0x7fad28069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.399+0000 7fad50e00640 1 --2- 172.21.15.175:0/466529874 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fad28066f60 0x7fad28069420 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0af000 tx=0x7fad3c004ac0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.399+0000 7fad50e00640 1 -- 172.21.15.175:0/466529874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad4c14d570 msgr2=0x7fad4c159a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.399+0000 7fad50e00640 1 --2- 172.21.15.175:0/466529874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad4c14d570 0x7fad4c159a30 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fad44005fd0 tx=0x7fad4400e910 comp rx=0 tx=0).stop 2024-04-25T09:09:46.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.399+0000 7fad50e00640 1 -- 172.21.15.175:0/466529874 shutdown_connections 2024-04-25T09:09:46.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.399+0000 7fad50e00640 1 --2- 172.21.15.175:0/466529874 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fad28066f60 0x7fad28069420 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.399+0000 7fad50e00640 1 --2- 172.21.15.175:0/466529874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad4c14d570 0x7fad4c159a30 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.399+0000 7fad50e00640 1 --2- 172.21.15.175:0/466529874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fad4c14d110 0x7fad4c1594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.399+0000 7fad50e00640 1 --2- 172.21.15.175:0/466529874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fad30003c90 0x7fad4c1e5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.399+0000 7fad50e00640 1 -- 172.21.15.175:0/466529874 >> 172.21.15.175:0/466529874 conn(0x7fad4c06ac50 msgr2=0x7fad4c1583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:46.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.399+0000 7fad50e00640 1 -- 172.21.15.175:0/466529874 shutdown_connections 2024-04-25T09:09:46.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.399+0000 7fad50e00640 1 -- 172.21.15.175:0/466529874 wait complete. 2024-04-25T09:09:46.408 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:09:46.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.555+0000 7f50eca00640 1 Processor -- start 2024-04-25T09:09:46.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.555+0000 7f50eca00640 1 -- start start 2024-04-25T09:09:46.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.559+0000 7f50eca00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50e80cf080 0x7f50e81600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.559+0000 7f50eca00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e80cfd10 con 0x7f50e8145250 2024-04-25T09:09:46.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.559+0000 7f50eca00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e80cfff0 con 0x7f50e80cf6b0 2024-04-25T09:09:46.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.559+0000 7f50eca00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e81605e0 con 0x7f50e80cf080 2024-04-25T09:09:46.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.559+0000 7f50e5e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f50e8145250 0x7f50e80cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38174/0 (socket says 172.21.15.175:38174) 2024-04-25T09:09:46.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.559+0000 7f50e5e00640 1 -- 172.21.15.175:0/3545400103 learned_addr learned my addr 172.21.15.175:0/3545400103 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:46.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.559+0000 7f50e6800640 1 --2- 172.21.15.175:0/3545400103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50e80cf080 0x7f50e81600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.559+0000 7f50e5400640 1 -- 172.21.15.175:0/3545400103 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172223904 0 0) 0x7f50e80cfd10 con 0x7f50e8145250 2024-04-25T09:09:46.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.559+0000 7f50e5400640 1 -- 172.21.15.175:0/3545400103 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50cc003530 con 0x7f50e8145250 2024-04-25T09:09:46.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.559+0000 7f50e5400640 1 -- 172.21.15.175:0/3545400103 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3618079793 0 0) 0x7f50e80cfff0 con 0x7f50e80cf6b0 2024-04-25T09:09:46.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.559+0000 7f50e5400640 1 -- 172.21.15.175:0/3545400103 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50e80cfd10 con 0x7f50e80cf6b0 2024-04-25T09:09:46.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.559+0000 7f50e6800640 1 -- 172.21.15.175:0/3545400103 >> v1:172.21.15.177:6789/0 conn(0x7f50e80cf6b0 legacy=0x7f50e80ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.559+0000 7f50e6800640 1 -- 172.21.15.175:0/3545400103 >> v1:172.21.15.175:6789/0 conn(0x7f50e8145250 legacy=0x7f50e80cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.559+0000 7f50e6800640 1 -- 172.21.15.175:0/3545400103 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e815f8a0 con 0x7f50e80cf080 2024-04-25T09:09:46.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.563+0000 7f50e6800640 1 --2- 172.21.15.175:0/3545400103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50e80cf080 0x7f50e81600a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009df0 tx=0x7f50e001c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77f2303f9ab43422 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:46.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.563+0000 7f50e5400640 1 -- 172.21.15.175:0/3545400103 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e00b2070 con 0x7f50e80cf080 2024-04-25T09:09:46.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.563+0000 7f50e5400640 1 -- 172.21.15.175:0/3545400103 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e00a5730 con 0x7f50e80cf080 2024-04-25T09:09:46.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.563+0000 7f50e5400640 1 -- 172.21.15.175:0/3545400103 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e00a5b00 con 0x7f50e80cf080 2024-04-25T09:09:46.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.563+0000 7f50eca00640 1 -- 172.21.15.175:0/3545400103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50e80cf080 msgr2=0x7f50e81600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.563+0000 7f50eca00640 1 --2- 172.21.15.175:0/3545400103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50e80cf080 0x7f50e81600a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009df0 tx=0x7f50e001c870 comp rx=0 tx=0).stop 2024-04-25T09:09:46.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.563+0000 7f50eca00640 1 -- 172.21.15.175:0/3545400103 shutdown_connections 2024-04-25T09:09:46.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.563+0000 7f50eca00640 1 --2- 172.21.15.175:0/3545400103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50e80cf080 0x7f50e81600a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.563+0000 7f50eca00640 1 -- 172.21.15.175:0/3545400103 >> 172.21.15.175:0/3545400103 conn(0x7f50e806ac50 msgr2=0x7f50e806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:46.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.563+0000 7f50eca00640 1 -- 172.21.15.175:0/3545400103 shutdown_connections 2024-04-25T09:09:46.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.563+0000 7f50eca00640 1 -- 172.21.15.175:0/3545400103 wait complete. 2024-04-25T09:09:46.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.563+0000 7f50eca00640 1 Processor -- start 2024-04-25T09:09:46.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.563+0000 7f50eca00640 1 -- start start 2024-04-25T09:09:46.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50eca00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e80cf080 0x7f50e81662b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50eca00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50e80cf6b0 0x7f50e81638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50eca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50e8145250 0x7f50e8143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50eca00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e815cc80 con 0x7f50e8145250 2024-04-25T09:09:46.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50eca00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e815cb00 con 0x7f50e80cf080 2024-04-25T09:09:46.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50eca00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e81697f0 con 0x7f50e80cf6b0 2024-04-25T09:09:46.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50e6800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50e8145250 0x7f50e8143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50e6800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50e8145250 0x7f50e8143f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35066/0 (socket says 172.21.15.175:35066) 2024-04-25T09:09:46.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50e6800640 1 -- 172.21.15.175:0/247385188 learned_addr learned my addr 172.21.15.175:0/247385188 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:46.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50dd400640 1 --2- 172.21.15.175:0/247385188 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50e80cf6b0 0x7f50e81638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50e5e00640 1 --2- 172.21.15.175:0/247385188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e80cf080 0x7f50e81662b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50e6800640 1 -- 172.21.15.175:0/247385188 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50e80cf6b0 msgr2=0x7f50e81638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50e6800640 1 --2- 172.21.15.175:0/247385188 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50e80cf6b0 0x7f50e81638c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50e6800640 1 -- 172.21.15.175:0/247385188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e80cf080 msgr2=0x7f50e81662b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50e6800640 1 --2- 172.21.15.175:0/247385188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e80cf080 0x7f50e81662b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50e6800640 1 -- 172.21.15.175:0/247385188 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e8131cd0 con 0x7f50e8145250 2024-04-25T09:09:46.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50e6800640 1 --2- 172.21.15.175:0/247385188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50e8145250 0x7f50e8143f70 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f50e0019480 tx=0x7f50e0019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:46.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50dea00640 1 -- 172.21.15.175:0/247385188 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e00bb020 con 0x7f50e8145250 2024-04-25T09:09:46.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50dea00640 1 -- 172.21.15.175:0/247385188 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e00ad440 con 0x7f50e8145250 2024-04-25T09:09:46.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50eca00640 1 -- 172.21.15.175:0/247385188 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e81654f0 con 0x7f50e8145250 2024-04-25T09:09:46.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50dea00640 1 -- 172.21.15.175:0/247385188 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e00b2040 con 0x7f50e8145250 2024-04-25T09:09:46.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50eca00640 1 -- 172.21.15.175:0/247385188 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e8165ab0 con 0x7f50e8145250 2024-04-25T09:09:46.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50eca00640 1 -- 172.21.15.175:0/247385188 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e8075160 con 0x7f50e8145250 2024-04-25T09:09:46.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.567+0000 7f50dea00640 1 -- 172.21.15.175:0/247385188 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f50e00be020 con 0x7f50e8145250 2024-04-25T09:09:46.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.571+0000 7f50dea00640 1 --2- 172.21.15.175:0/247385188 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f50c4066f60 0x7f50c4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.571+0000 7f50dea00640 1 -- 172.21.15.175:0/247385188 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f50e011f830 con 0x7f50e8145250 2024-04-25T09:09:46.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.571+0000 7f50e5e00640 1 --2- 172.21.15.175:0/247385188 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f50c4066f60 0x7f50c4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.571+0000 7f50e5e00640 1 --2- 172.21.15.175:0/247385188 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f50c4066f60 0x7f50c4069420 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f50d8000f70 tx=0x7f50d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:46.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.575+0000 7f50dea00640 1 -- 172.21.15.175:0/247385188 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f50e0016580 con 0x7f50e8145250 2024-04-25T09:09:46.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.727+0000 7f50eca00640 1 -- 172.21.15.175:0/247385188 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f50e80b00f0 con 0x7f50e8145250 2024-04-25T09:09:46.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.727+0000 7f50dea00640 1 -- 172.21.15.175:0/247385188 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f50e00f0710 con 0x7f50e8145250 2024-04-25T09:09:46.716 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:09:46.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.727+0000 7f50eca00640 1 -- 172.21.15.175:0/247385188 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f50c4066f60 msgr2=0x7f50c4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.727+0000 7f50eca00640 1 --2- 172.21.15.175:0/247385188 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f50c4066f60 0x7f50c4069420 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f50d8000f70 tx=0x7f50d8009040 comp rx=0 tx=0).stop 2024-04-25T09:09:46.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.727+0000 7f50eca00640 1 -- 172.21.15.175:0/247385188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50e8145250 msgr2=0x7f50e8143f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.727+0000 7f50eca00640 1 --2- 172.21.15.175:0/247385188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50e8145250 0x7f50e8143f70 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f50e0019480 tx=0x7f50e0019610 comp rx=0 tx=0).stop 2024-04-25T09:09:46.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.727+0000 7f50eca00640 1 -- 172.21.15.175:0/247385188 shutdown_connections 2024-04-25T09:09:46.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.727+0000 7f50eca00640 1 --2- 172.21.15.175:0/247385188 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f50c4066f60 0x7f50c4069420 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.727+0000 7f50eca00640 1 --2- 172.21.15.175:0/247385188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50e8145250 0x7f50e8143f70 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.727+0000 7f50eca00640 1 --2- 172.21.15.175:0/247385188 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50e80cf6b0 0x7f50e81638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.727+0000 7f50eca00640 1 --2- 172.21.15.175:0/247385188 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50e80cf080 0x7f50e81662b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.727+0000 7f50eca00640 1 -- 172.21.15.175:0/247385188 >> 172.21.15.175:0/247385188 conn(0x7f50e806ac50 msgr2=0x7f50e806b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:46.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.727+0000 7f50eca00640 1 -- 172.21.15.175:0/247385188 shutdown_connections 2024-04-25T09:09:46.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.727+0000 7f50eca00640 1 -- 172.21.15.175:0/247385188 wait complete. 2024-04-25T09:09:46.736 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:09:46.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.883+0000 7fd38ee00640 1 Processor -- start 2024-04-25T09:09:46.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.883+0000 7fd38ee00640 1 -- start start 2024-04-25T09:09:46.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.883+0000 7fd38ee00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd3880cdb60 0x7fd3880cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.883+0000 7fd38ee00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd38806ad50 0x7fd38806bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.883+0000 7fd38ee00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38806de20 con 0x7fd38806c080 2024-04-25T09:09:46.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.883+0000 7fd38ee00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38815dfe0 con 0x7fd3880cdb60 2024-04-25T09:09:46.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.883+0000 7fd38ee00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3880ce480 con 0x7fd38806ad50 2024-04-25T09:09:46.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.887+0000 7fd387e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd3880cdb60 0x7fd3880cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.887+0000 7fd38ce00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd38806c080 0x7fd3881616d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38190/0 (socket says 172.21.15.175:38190) 2024-04-25T09:09:46.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.887+0000 7fd38ce00640 1 -- 172.21.15.175:0/1409052003 learned_addr learned my addr 172.21.15.175:0/1409052003 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:46.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.887+0000 7fd387400640 1 --2- 172.21.15.175:0/1409052003 >> v2:172.21.15.177:3300/0 conn(0x7fd38806ad50 0x7fd38806bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.887+0000 7fd387e00640 1 -- 172.21.15.175:0/1409052003 >> v2:172.21.15.177:3300/0 conn(0x7fd38806ad50 msgr2=0x7fd38806bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:46.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.887+0000 7fd387e00640 1 --2- 172.21.15.175:0/1409052003 >> v2:172.21.15.177:3300/0 conn(0x7fd38806ad50 0x7fd38806bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.887+0000 7fd387e00640 1 -- 172.21.15.175:0/1409052003 >> v1:172.21.15.175:6789/0 conn(0x7fd38806c080 legacy=0x7fd3881616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.887+0000 7fd387e00640 1 -- 172.21.15.175:0/1409052003 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38806e090 con 0x7fd3880cdb60 2024-04-25T09:09:46.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.887+0000 7fd386a00640 1 -- 172.21.15.175:0/1409052003 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885030064 0 0) 0x7fd38806de20 con 0x7fd38806c080 2024-04-25T09:09:46.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.887+0000 7fd387e00640 1 --2- 172.21.15.175:0/1409052003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3880cdb60 0x7fd3880cdf40 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fd3880cc9e0 tx=0x7fd37801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d495da18a1eeff21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:46.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.887+0000 7fd386a00640 1 -- 172.21.15.175:0/1409052003 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3780b2070 con 0x7fd3880cdb60 2024-04-25T09:09:46.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.887+0000 7fd386a00640 1 -- 172.21.15.175:0/1409052003 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3780a59c0 con 0x7fd3880cdb60 2024-04-25T09:09:46.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.887+0000 7fd386a00640 1 -- 172.21.15.175:0/1409052003 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3780a5d90 con 0x7fd3880cdb60 2024-04-25T09:09:46.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd38ee00640 1 -- 172.21.15.175:0/1409052003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3880cdb60 msgr2=0x7fd3880cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd38ee00640 1 --2- 172.21.15.175:0/1409052003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3880cdb60 0x7fd3880cdf40 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fd3880cc9e0 tx=0x7fd37801c900 comp rx=0 tx=0).stop 2024-04-25T09:09:46.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd38ee00640 1 -- 172.21.15.175:0/1409052003 shutdown_connections 2024-04-25T09:09:46.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd38ee00640 1 --2- 172.21.15.175:0/1409052003 >> v2:172.21.15.177:3300/0 conn(0x7fd38806ad50 0x7fd38806bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd38ee00640 1 --2- 172.21.15.175:0/1409052003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3880cdb60 0x7fd3880cdf40 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd38ee00640 1 -- 172.21.15.175:0/1409052003 >> 172.21.15.175:0/1409052003 conn(0x7fd3880cca10 msgr2=0x7fd3880cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:46.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd38ee00640 1 -- 172.21.15.175:0/1409052003 shutdown_connections 2024-04-25T09:09:46.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd38ee00640 1 -- 172.21.15.175:0/1409052003 wait complete. 2024-04-25T09:09:46.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd38ee00640 1 Processor -- start 2024-04-25T09:09:46.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd38ee00640 1 -- start start 2024-04-25T09:09:46.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd38ee00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38806ad50 0x7fd388155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd38ee00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd38806c080 0x7fd388160c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd38ee00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3880cdb60 0x7fd388153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd38ee00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880aef40 con 0x7fd38806c080 2024-04-25T09:09:46.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd38ee00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880aedc0 con 0x7fd38806ad50 2024-04-25T09:09:46.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd38ee00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38816aa70 con 0x7fd3880cdb60 2024-04-25T09:09:46.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd387400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd38806c080 0x7fd388160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd387400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd38806c080 0x7fd388160c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35088/0 (socket says 172.21.15.175:35088) 2024-04-25T09:09:46.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd387400640 1 -- 172.21.15.175:0/4114415525 learned_addr learned my addr 172.21.15.175:0/4114415525 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:46.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd387e00640 1 --2- 172.21.15.175:0/4114415525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38806ad50 0x7fd388155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd38ce00640 1 --2- 172.21.15.175:0/4114415525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3880cdb60 0x7fd388153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd387400640 1 -- 172.21.15.175:0/4114415525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3880cdb60 msgr2=0x7fd388153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd387400640 1 --2- 172.21.15.175:0/4114415525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3880cdb60 0x7fd388153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd387400640 1 -- 172.21.15.175:0/4114415525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38806ad50 msgr2=0x7fd388155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:46.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd387400640 1 --2- 172.21.15.175:0/4114415525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38806ad50 0x7fd388155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:46.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.891+0000 7fd387400640 1 -- 172.21.15.175:0/4114415525 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388158620 con 0x7fd38806c080 2024-04-25T09:09:46.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.895+0000 7fd387400640 1 --2- 172.21.15.175:0/4114415525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd38806c080 0x7fd388160c00 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fd37400d800 tx=0x7fd37400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:46.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.895+0000 7fd37fe00640 1 -- 172.21.15.175:0/4114415525 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37400b6c0 con 0x7fd38806c080 2024-04-25T09:09:46.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.895+0000 7fd37fe00640 1 -- 172.21.15.175:0/4114415525 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd374019070 con 0x7fd38806c080 2024-04-25T09:09:46.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.895+0000 7fd37fe00640 1 -- 172.21.15.175:0/4114415525 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37400ba60 con 0x7fd38806c080 2024-04-25T09:09:46.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.895+0000 7fd38ee00640 1 -- 172.21.15.175:0/4114415525 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd388158900 con 0x7fd38806c080 2024-04-25T09:09:46.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.895+0000 7fd38ee00640 1 -- 172.21.15.175:0/4114415525 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd388158ec0 con 0x7fd38806c080 2024-04-25T09:09:46.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.895+0000 7fd38ee00640 1 -- 172.21.15.175:0/4114415525 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd388075160 con 0x7fd38806c080 2024-04-25T09:09:46.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.895+0000 7fd37fe00640 1 -- 172.21.15.175:0/4114415525 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd37400bc00 con 0x7fd38806c080 2024-04-25T09:09:46.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.895+0000 7fd37fe00640 1 --2- 172.21.15.175:0/4114415525 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd368066f60 0x7fd368069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:46.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.895+0000 7fd37fe00640 1 -- 172.21.15.175:0/4114415525 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd3740855a0 con 0x7fd38806c080 2024-04-25T09:09:46.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.895+0000 7fd387e00640 1 --2- 172.21.15.175:0/4114415525 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd368066f60 0x7fd368069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:46.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.899+0000 7fd387e00640 1 --2- 172.21.15.175:0/4114415525 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd368066f60 0x7fd368069420 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd3780af000 tx=0x7fd3780a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:46.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:46.899+0000 7fd37fe00640 1 -- 172.21.15.175:0/4114415525 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd374056480 con 0x7fd38806c080 2024-04-25T09:09:47.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.055+0000 7fd38ee00640 1 -- 172.21.15.175:0/4114415525 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd388066bc0 con 0x7fd38806c080 2024-04-25T09:09:47.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.055+0000 7fd37fe00640 1 -- 172.21.15.175:0/4114415525 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd374055d80 con 0x7fd38806c080 2024-04-25T09:09:47.046 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:09:47.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.059+0000 7fd38ee00640 1 -- 172.21.15.175:0/4114415525 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd368066f60 msgr2=0x7fd368069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:47.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.059+0000 7fd38ee00640 1 --2- 172.21.15.175:0/4114415525 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd368066f60 0x7fd368069420 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd3780af000 tx=0x7fd3780a7070 comp rx=0 tx=0).stop 2024-04-25T09:09:47.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.059+0000 7fd38ee00640 1 -- 172.21.15.175:0/4114415525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd38806c080 msgr2=0x7fd388160c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:47.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.059+0000 7fd38ee00640 1 --2- 172.21.15.175:0/4114415525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd38806c080 0x7fd388160c00 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fd37400d800 tx=0x7fd37400dcc0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.059+0000 7fd38ee00640 1 -- 172.21.15.175:0/4114415525 shutdown_connections 2024-04-25T09:09:47.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.059+0000 7fd38ee00640 1 --2- 172.21.15.175:0/4114415525 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd368066f60 0x7fd368069420 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.059+0000 7fd38ee00640 1 --2- 172.21.15.175:0/4114415525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd3880cdb60 0x7fd388153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.059+0000 7fd38ee00640 1 --2- 172.21.15.175:0/4114415525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd38806c080 0x7fd388160c00 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.059+0000 7fd38ee00640 1 --2- 172.21.15.175:0/4114415525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd38806ad50 0x7fd388155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.059+0000 7fd38ee00640 1 -- 172.21.15.175:0/4114415525 >> 172.21.15.175:0/4114415525 conn(0x7fd3880cca10 msgr2=0x7fd3880ad210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:47.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.059+0000 7fd38ee00640 1 -- 172.21.15.175:0/4114415525 shutdown_connections 2024-04-25T09:09:47.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.059+0000 7fd38ee00640 1 -- 172.21.15.175:0/4114415525 wait complete. 2024-04-25T09:09:47.068 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:09:47.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.215+0000 7fc131800640 1 Processor -- start 2024-04-25T09:09:47.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.215+0000 7fc131800640 1 -- start start 2024-04-25T09:09:47.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.215+0000 7fc131800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc12c0b3230 0x7fc12c0b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:47.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.215+0000 7fc131800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc12c0719e0 0x7fc12c0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:47.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.215+0000 7fc131800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc12c15dd10 con 0x7fc12c0b3d20 2024-04-25T09:09:47.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.215+0000 7fc131800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12c15dff0 con 0x7fc12c0b3230 2024-04-25T09:09:47.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.215+0000 7fc131800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12c15e2d0 con 0x7fc12c0719e0 2024-04-25T09:09:47.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.215+0000 7fc12aa00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc12c0b3230 0x7fc12c0b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:47.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.215+0000 7fc12aa00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc12c0b3230 0x7fc12c0b2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35096/0 (socket says 172.21.15.175:35096) 2024-04-25T09:09:47.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.215+0000 7fc12aa00640 1 -- 172.21.15.175:0/1147853569 learned_addr learned my addr 172.21.15.175:0/1147853569 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:47.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.215+0000 7fc12b400640 1 --2- 172.21.15.175:0/1147853569 >> v2:172.21.15.177:3300/0 conn(0x7fc12c0719e0 0x7fc12c0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:47.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.215+0000 7fc12aa00640 1 -- 172.21.15.175:0/1147853569 >> v2:172.21.15.177:3300/0 conn(0x7fc12c0719e0 msgr2=0x7fc12c0b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:47.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.219+0000 7fc12aa00640 1 --2- 172.21.15.175:0/1147853569 >> v2:172.21.15.177:3300/0 conn(0x7fc12c0719e0 0x7fc12c0b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.219+0000 7fc12aa00640 1 -- 172.21.15.175:0/1147853569 >> v1:172.21.15.177:6789/0 conn(0x7fc12c0b3d20 legacy=0x7fc12c0712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:47.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.219+0000 7fc12aa00640 1 -- 172.21.15.175:0/1147853569 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c15e5b0 con 0x7fc12c0b3230 2024-04-25T09:09:47.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.219+0000 7fc12aa00640 1 --2- 172.21.15.175:0/1147853569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c0b3230 0x7fc12c0b2660 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc12c15dc50 tx=0x7fc11c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6879e52793812754 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:47.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.219+0000 7fc129600640 1 -- 172.21.15.175:0/1147853569 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c0a5800 con 0x7fc12c0b3230 2024-04-25T09:09:47.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.219+0000 7fc129600640 1 -- 172.21.15.175:0/1147853569 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c0a59a0 con 0x7fc12c0b3230 2024-04-25T09:09:47.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.219+0000 7fc129600640 1 -- 172.21.15.175:0/1147853569 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c0a5d70 con 0x7fc12c0b3230 2024-04-25T09:09:47.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.219+0000 7fc131800640 1 -- 172.21.15.175:0/1147853569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c0b3230 msgr2=0x7fc12c0b2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:47.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.219+0000 7fc131800640 1 --2- 172.21.15.175:0/1147853569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c0b3230 0x7fc12c0b2660 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc12c15dc50 tx=0x7fc11c01c9c0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.219+0000 7fc131800640 1 -- 172.21.15.175:0/1147853569 shutdown_connections 2024-04-25T09:09:47.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.219+0000 7fc131800640 1 --2- 172.21.15.175:0/1147853569 >> v2:172.21.15.177:3300/0 conn(0x7fc12c0719e0 0x7fc12c0b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.219+0000 7fc131800640 1 --2- 172.21.15.175:0/1147853569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c0b3230 0x7fc12c0b2660 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.219+0000 7fc131800640 1 -- 172.21.15.175:0/1147853569 >> 172.21.15.175:0/1147853569 conn(0x7fc12c06ac50 msgr2=0x7fc12c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:47.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.219+0000 7fc131800640 1 -- 172.21.15.175:0/1147853569 shutdown_connections 2024-04-25T09:09:47.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.219+0000 7fc131800640 1 -- 172.21.15.175:0/1147853569 wait complete. 2024-04-25T09:09:47.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc131800640 1 Processor -- start 2024-04-25T09:09:47.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc131800640 1 -- start start 2024-04-25T09:09:47.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc131800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc12c0719e0 0x7fc12c1438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:47.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc131800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c0b3230 0x7fc12c14f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:47.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc131800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc12c0b3d20 0x7fc12c1f8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:47.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc131800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c15abf0 con 0x7fc12c0b3230 2024-04-25T09:09:47.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc131800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c15aa70 con 0x7fc12c0b3d20 2024-04-25T09:09:47.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc131800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c15ad70 con 0x7fc12c0719e0 2024-04-25T09:09:47.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc12a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c0b3230 0x7fc12c14f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:47.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc12a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c0b3230 0x7fc12c14f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35100/0 (socket says 172.21.15.175:35100) 2024-04-25T09:09:47.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc12a000640 1 -- 172.21.15.175:0/246796615 learned_addr learned my addr 172.21.15.175:0/246796615 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:47.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc12aa00640 1 --2- 172.21.15.175:0/246796615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc12c0719e0 0x7fc12c1438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:47.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc12b400640 1 --2- 172.21.15.175:0/246796615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc12c0b3d20 0x7fc12c1f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:47.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc12a000640 1 -- 172.21.15.175:0/246796615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc12c0719e0 msgr2=0x7fc12c1438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:47.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc12a000640 1 --2- 172.21.15.175:0/246796615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc12c0719e0 0x7fc12c1438b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc12a000640 1 -- 172.21.15.175:0/246796615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc12c0b3d20 msgr2=0x7fc12c1f8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:47.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc12a000640 1 --2- 172.21.15.175:0/246796615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc12c0b3d20 0x7fc12c1f8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc12a000640 1 -- 172.21.15.175:0/246796615 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c0cf2f0 con 0x7fc12c0b3230 2024-04-25T09:09:47.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc12aa00640 1 --2- 172.21.15.175:0/246796615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc12c0719e0 0x7fc12c1438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:47.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc12b400640 1 --2- 172.21.15.175:0/246796615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc12c0b3d20 0x7fc12c1f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:47.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc12a000640 1 --2- 172.21.15.175:0/246796615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c0b3230 0x7fc12c14f390 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fc11800c390 tx=0x7fc11800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:47.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc122a00640 1 -- 172.21.15.175:0/246796615 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc118017070 con 0x7fc12c0b3230 2024-04-25T09:09:47.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc122a00640 1 -- 172.21.15.175:0/246796615 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1180052f0 con 0x7fc12c0b3230 2024-04-25T09:09:47.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc131800640 1 -- 172.21.15.175:0/246796615 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc12c0affb0 con 0x7fc12c0b3230 2024-04-25T09:09:47.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc122a00640 1 -- 172.21.15.175:0/246796615 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc118003840 con 0x7fc12c0b3230 2024-04-25T09:09:47.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.223+0000 7fc131800640 1 -- 172.21.15.175:0/246796615 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12c14d440 con 0x7fc12c0b3230 2024-04-25T09:09:47.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.227+0000 7fc131800640 1 -- 172.21.15.175:0/246796615 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12c075160 con 0x7fc12c0b3230 2024-04-25T09:09:47.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.227+0000 7fc122a00640 1 -- 172.21.15.175:0/246796615 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc11801a070 con 0x7fc12c0b3230 2024-04-25T09:09:47.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.227+0000 7fc122a00640 1 --2- 172.21.15.175:0/246796615 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc10c066f60 0x7fc10c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:47.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.227+0000 7fc122a00640 1 -- 172.21.15.175:0/246796615 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc118084360 con 0x7fc12c0b3230 2024-04-25T09:09:47.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.227+0000 7fc12aa00640 1 --2- 172.21.15.175:0/246796615 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc10c066f60 0x7fc10c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:47.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.227+0000 7fc12aa00640 1 --2- 172.21.15.175:0/246796615 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc10c066f60 0x7fc10c069420 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc11c0ae000 tx=0x7fc11c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:47.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.231+0000 7fc122a00640 1 -- 172.21.15.175:0/246796615 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc118055370 con 0x7fc12c0b3230 2024-04-25T09:09:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.395+0000 7fc131800640 1 -- 172.21.15.175:0/246796615 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc12c072370 con 0x7fc12c0b3230 2024-04-25T09:09:47.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.395+0000 7fc122a00640 1 -- 172.21.15.175:0/246796615 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v72) v1 ==== 80+0+124 (secure 0 0 0) 0x7fc118054c70 con 0x7fc12c0b3230 2024-04-25T09:09:47.387 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.177:6835/1709110121 2024-04-26T09:08:32.433027+0000 2024-04-25T09:09:47.387 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.177:6833/1709110121 2024-04-26T09:08:32.433027+0000 2024-04-25T09:09:47.387 INFO:teuthology.orchestra.run.smithi175.stderr:listed 2 entries 2024-04-25T09:09:47.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.399+0000 7fc131800640 1 -- 172.21.15.175:0/246796615 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc10c066f60 msgr2=0x7fc10c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:47.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.399+0000 7fc131800640 1 --2- 172.21.15.175:0/246796615 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc10c066f60 0x7fc10c069420 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc11c0ae000 tx=0x7fc11c0a7070 comp rx=0 tx=0).stop 2024-04-25T09:09:47.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.399+0000 7fc131800640 1 -- 172.21.15.175:0/246796615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c0b3230 msgr2=0x7fc12c14f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:47.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.399+0000 7fc131800640 1 --2- 172.21.15.175:0/246796615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c0b3230 0x7fc12c14f390 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fc11800c390 tx=0x7fc11800c850 comp rx=0 tx=0).stop 2024-04-25T09:09:47.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.399+0000 7fc131800640 1 -- 172.21.15.175:0/246796615 shutdown_connections 2024-04-25T09:09:47.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.399+0000 7fc131800640 1 --2- 172.21.15.175:0/246796615 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc10c066f60 0x7fc10c069420 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.399+0000 7fc131800640 1 --2- 172.21.15.175:0/246796615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc12c0b3d20 0x7fc12c1f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.399+0000 7fc131800640 1 --2- 172.21.15.175:0/246796615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc12c0b3230 0x7fc12c14f390 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.399+0000 7fc131800640 1 --2- 172.21.15.175:0/246796615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc12c0719e0 0x7fc12c1438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.399+0000 7fc131800640 1 -- 172.21.15.175:0/246796615 >> 172.21.15.175:0/246796615 conn(0x7fc12c06ac50 msgr2=0x7fc12c0cb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:47.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.399+0000 7fc131800640 1 -- 172.21.15.175:0/246796615 shutdown_connections 2024-04-25T09:09:47.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.399+0000 7fc131800640 1 -- 172.21.15.175:0/246796615 wait complete. 2024-04-25T09:09:47.408 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:09:47.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:47.409 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:09:47.434 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:09:47.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:47.434 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:09:47.483 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:09:47.483 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:47.493 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:09:47.493 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:09:47.493 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:47.534 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:09:47.534 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:09:47.534 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:47.543 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:09:47.543 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:47.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.719+0000 7f4a27200640 1 Processor -- start 2024-04-25T09:09:47.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.719+0000 7f4a27200640 1 -- start start 2024-04-25T09:09:47.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.719+0000 7f4a27200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a20099a50 0x7f4a200cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:47.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.719+0000 7f4a27200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a200cc4c0 con 0x7f4a2009abb0 2024-04-25T09:09:47.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.719+0000 7f4a27200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a200cc7a0 con 0x7f4a2015bc10 2024-04-25T09:09:47.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.719+0000 7f4a27200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200d06f0 con 0x7f4a20099a50 2024-04-25T09:09:47.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.719+0000 7f4a25200640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4a2009abb0 0x7f4a200cfdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38194/0 (socket says 172.21.15.175:38194) 2024-04-25T09:09:47.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.719+0000 7f4a25200640 1 -- 172.21.15.175:0/498936618 learned_addr learned my addr 172.21.15.175:0/498936618 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:47.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.719+0000 7f4a1fe00640 1 --2- 172.21.15.175:0/498936618 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a20099a50 0x7f4a200cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:47.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.719+0000 7f4a1ea00640 1 -- 172.21.15.175:0/498936618 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259981501 0 0) 0x7f4a200cc4c0 con 0x7f4a2009abb0 2024-04-25T09:09:47.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.719+0000 7f4a1ea00640 1 -- 172.21.15.175:0/498936618 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a04003530 con 0x7f4a2009abb0 2024-04-25T09:09:47.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.719+0000 7f4a1ea00640 1 -- 172.21.15.175:0/498936618 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3308340381 0 0) 0x7f4a200cc7a0 con 0x7f4a2015bc10 2024-04-25T09:09:47.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.719+0000 7f4a1ea00640 1 -- 172.21.15.175:0/498936618 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a200cc4c0 con 0x7f4a2015bc10 2024-04-25T09:09:47.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.719+0000 7f4a1fe00640 1 -- 172.21.15.175:0/498936618 >> v1:172.21.15.177:6789/0 conn(0x7f4a2015bc10 legacy=0x7f4a20099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:47.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.719+0000 7f4a1fe00640 1 -- 172.21.15.175:0/498936618 >> v1:172.21.15.175:6789/0 conn(0x7f4a2009abb0 legacy=0x7f4a200cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:47.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.719+0000 7f4a1fe00640 1 -- 172.21.15.175:0/498936618 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a200cca80 con 0x7f4a20099a50 2024-04-25T09:09:47.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.723+0000 7f4a1fe00640 1 --2- 172.21.15.175:0/498936618 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a20099a50 0x7f4a200cd280 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4a100097f0 tx=0x7f4a1001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=409416f6f2900f97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:47.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.723+0000 7f4a1ea00640 1 -- 172.21.15.175:0/498936618 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100ab5f0 con 0x7f4a20099a50 2024-04-25T09:09:47.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.723+0000 7f4a1ea00640 1 -- 172.21.15.175:0/498936618 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a100b0070 con 0x7f4a20099a50 2024-04-25T09:09:47.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.723+0000 7f4a1ea00640 1 -- 172.21.15.175:0/498936618 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100ab9b0 con 0x7f4a20099a50 2024-04-25T09:09:47.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.723+0000 7f4a27200640 1 -- 172.21.15.175:0/498936618 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a20099a50 msgr2=0x7f4a200cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:47.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.723+0000 7f4a27200640 1 --2- 172.21.15.175:0/498936618 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a20099a50 0x7f4a200cd280 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4a100097f0 tx=0x7f4a1001c4e0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.723+0000 7f4a27200640 1 -- 172.21.15.175:0/498936618 shutdown_connections 2024-04-25T09:09:47.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.723+0000 7f4a27200640 1 --2- 172.21.15.175:0/498936618 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a20099a50 0x7f4a200cd280 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.723+0000 7f4a27200640 1 -- 172.21.15.175:0/498936618 >> 172.21.15.175:0/498936618 conn(0x7f4a200b3300 msgr2=0x7f4a200b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:47.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.723+0000 7f4a27200640 1 -- 172.21.15.175:0/498936618 shutdown_connections 2024-04-25T09:09:47.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.723+0000 7f4a27200640 1 -- 172.21.15.175:0/498936618 wait complete. 2024-04-25T09:09:47.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a27200640 1 Processor -- start 2024-04-25T09:09:47.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a27200640 1 -- start start 2024-04-25T09:09:47.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a27200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a20099a50 0x7f4a201503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:47.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a27200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a2009abb0 0x7f4a2015d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:47.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a27200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a2015bc10 0x7f4a20150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:47.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a27200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200c5f00 con 0x7f4a20099a50 2024-04-25T09:09:47.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a27200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200c5d80 con 0x7f4a2015bc10 2024-04-25T09:09:47.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a27200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a20169860 con 0x7f4a2009abb0 2024-04-25T09:09:47.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a1fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a20099a50 0x7f4a201503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:47.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a1fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a20099a50 0x7f4a201503d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35106/0 (socket says 172.21.15.175:35106) 2024-04-25T09:09:47.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a1fe00640 1 -- 172.21.15.175:0/950770462 learned_addr learned my addr 172.21.15.175:0/950770462 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:47.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a25200640 1 --2- 172.21.15.175:0/950770462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a2015bc10 0x7f4a20150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:47.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a1f400640 1 --2- 172.21.15.175:0/950770462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a2009abb0 0x7f4a2015d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:47.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a1fe00640 1 -- 172.21.15.175:0/950770462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a2009abb0 msgr2=0x7f4a2015d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:47.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a1fe00640 1 --2- 172.21.15.175:0/950770462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a2009abb0 0x7f4a2015d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a1fe00640 1 -- 172.21.15.175:0/950770462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a2015bc10 msgr2=0x7f4a20150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:47.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a1fe00640 1 --2- 172.21.15.175:0/950770462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a2015bc10 0x7f4a20150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a1fe00640 1 -- 172.21.15.175:0/950770462 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a200751f0 con 0x7f4a20099a50 2024-04-25T09:09:47.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a1fe00640 1 --2- 172.21.15.175:0/950770462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a20099a50 0x7f4a201503d0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009740 tx=0x7f4a1001ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:47.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a17e00640 1 -- 172.21.15.175:0/950770462 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100bf610 con 0x7f4a20099a50 2024-04-25T09:09:47.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a17e00640 1 -- 172.21.15.175:0/950770462 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a100bf7b0 con 0x7f4a20099a50 2024-04-25T09:09:47.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a17e00640 1 -- 172.21.15.175:0/950770462 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100bfba0 con 0x7f4a20099a50 2024-04-25T09:09:47.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a27200640 1 -- 172.21.15.175:0/950770462 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a2015c760 con 0x7f4a20099a50 2024-04-25T09:09:47.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a27200640 1 -- 172.21.15.175:0/950770462 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a2015cd20 con 0x7f4a20099a50 2024-04-25T09:09:47.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.727+0000 7f4a27200640 1 -- 172.21.15.175:0/950770462 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a20074a60 con 0x7f4a20099a50 2024-04-25T09:09:47.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.731+0000 7f4a17e00640 1 -- 172.21.15.175:0/950770462 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4a100bd020 con 0x7f4a20099a50 2024-04-25T09:09:47.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.731+0000 7f4a17e00640 1 --2- 172.21.15.175:0/950770462 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4a00066f60 0x7f4a00069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:47.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.731+0000 7f4a17e00640 1 -- 172.21.15.175:0/950770462 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f4a1011f120 con 0x7f4a20099a50 2024-04-25T09:09:47.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.731+0000 7f4a1f400640 1 --2- 172.21.15.175:0/950770462 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4a00066f60 0x7f4a00069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:47.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.731+0000 7f4a1f400640 1 --2- 172.21.15.175:0/950770462 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4a00066f60 0x7f4a00069420 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c0015e0 tx=0x7f4a0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:47.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.735+0000 7f4a17e00640 1 -- 172.21.15.175:0/950770462 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4a100c6030 con 0x7f4a20099a50 2024-04-25T09:09:47.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.919+0000 7f4a27200640 1 -- 172.21.15.175:0/950770462 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a20157a30 con 0x7f4a20099a50 2024-04-25T09:09:47.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.919+0000 7f4a17e00640 1 -- 172.21.15.175:0/950770462 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f4a100160d0 con 0x7f4a20099a50 2024-04-25T09:09:47.911 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:09:47.911 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":51,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2493316948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2493316948},{"type":"v1","addr":"172.21.15.175:6837","nonce":2493316948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3408529232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3408529232},{"type":"v1","addr":"172.21.15.177:6834","nonce":3408529232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/46829775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":46829775},{"type":"v1","addr":"172.21.15.177:6835","nonce":46829775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:08:17.378890+0000","modified":"2024-04-25T09:09:15.457110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6513":{"gid":6513,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":19,"addr":"172.21.15.175:6836/2714482688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2714482688},{"type":"v1","addr":"172.21.15.175:6836","nonce":2714482688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:09:47.911 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 51 2024-04-25T09:09:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.923+0000 7f4a27200640 1 -- 172.21.15.175:0/950770462 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4a00066f60 msgr2=0x7f4a00069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.923+0000 7f4a27200640 1 --2- 172.21.15.175:0/950770462 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4a00066f60 0x7f4a00069420 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c0015e0 tx=0x7f4a0c009040 comp rx=0 tx=0).stop 2024-04-25T09:09:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.923+0000 7f4a27200640 1 -- 172.21.15.175:0/950770462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a20099a50 msgr2=0x7f4a201503d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.923+0000 7f4a27200640 1 --2- 172.21.15.175:0/950770462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a20099a50 0x7f4a201503d0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009740 tx=0x7f4a1001ad20 comp rx=0 tx=0).stop 2024-04-25T09:09:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.923+0000 7f4a27200640 1 -- 172.21.15.175:0/950770462 shutdown_connections 2024-04-25T09:09:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.923+0000 7f4a27200640 1 --2- 172.21.15.175:0/950770462 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4a00066f60 0x7f4a00069420 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.923+0000 7f4a27200640 1 --2- 172.21.15.175:0/950770462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a2015bc10 0x7f4a20150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.923+0000 7f4a27200640 1 --2- 172.21.15.175:0/950770462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a2009abb0 0x7f4a2015d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.923+0000 7f4a27200640 1 --2- 172.21.15.175:0/950770462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a20099a50 0x7f4a201503d0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.923+0000 7f4a27200640 1 -- 172.21.15.175:0/950770462 >> 172.21.15.175:0/950770462 conn(0x7f4a200b3300 msgr2=0x7f4a200cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:47.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.923+0000 7f4a27200640 1 -- 172.21.15.175:0/950770462 shutdown_connections 2024-04-25T09:09:47.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:47.923+0000 7f4a27200640 1 -- 172.21.15.175:0/950770462 wait complete. 2024-04-25T09:09:47.932 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:48.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9fac00640 1 Processor -- start 2024-04-25T09:09:48.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9fac00640 1 -- start start 2024-04-25T09:09:48.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9fac00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc9f415a900 0x7fc9f406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9fac00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f40cf560 0x7fc9f40cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9fac00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f40cda00 con 0x7fc9f40cd520 2024-04-25T09:09:48.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9fac00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f415bcf0 con 0x7fc9f415a900 2024-04-25T09:09:48.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9fac00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f40cfef0 con 0x7fc9f40cf560 2024-04-25T09:09:48.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9eb400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc9f40cd520 0x7fc9f40ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38198/0 (socket says 172.21.15.175:38198) 2024-04-25T09:09:48.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9eb400640 1 -- 172.21.15.175:0/2680967888 learned_addr learned my addr 172.21.15.175:0/2680967888 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:48.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9f3e00640 1 --2- 172.21.15.175:0/2680967888 >> v2:172.21.15.177:3300/0 conn(0x7fc9f415a900 0x7fc9f406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9f8c00640 1 --2- 172.21.15.175:0/2680967888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f40cf560 0x7fc9f40cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9f3400640 1 -- 172.21.15.175:0/2680967888 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778332564 0 0) 0x7fc9f40cda00 con 0x7fc9f40cd520 2024-04-25T09:09:48.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9f3400640 1 -- 172.21.15.175:0/2680967888 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9d8003430 con 0x7fc9f40cd520 2024-04-25T09:09:48.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9f3400640 1 -- 172.21.15.175:0/2680967888 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3275025897 0 0) 0x7fc9d8003430 con 0x7fc9f40cd520 2024-04-25T09:09:48.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9f3400640 1 -- 172.21.15.175:0/2680967888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f40cf560 msgr2=0x7fc9f40cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:48.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9f3400640 1 --2- 172.21.15.175:0/2680967888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f40cf560 0x7fc9f40cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9f3400640 1 -- 172.21.15.175:0/2680967888 >> v2:172.21.15.177:3300/0 conn(0x7fc9f415a900 msgr2=0x7fc9f406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:48.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9f3400640 1 --2- 172.21.15.175:0/2680967888 >> v2:172.21.15.177:3300/0 conn(0x7fc9f415a900 0x7fc9f406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9f3400640 1 -- 172.21.15.175:0/2680967888 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f40cdce0 con 0x7fc9f40cd520 2024-04-25T09:09:48.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9f3400640 1 -- 172.21.15.175:0/2680967888 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fc9dc001680 con 0x7fc9f40cd520 2024-04-25T09:09:48.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9f3400640 1 -- 172.21.15.175:0/2680967888 >> v1:172.21.15.175:6789/0 conn(0x7fc9f40cd520 legacy=0x7fc9f40ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:48.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9f3400640 1 --2- 172.21.15.175:0/2680967888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9d8004aa0 0x7fc9d8004ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9f3400640 1 --2- 172.21.15.175:0/2680967888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9d80036b0 0x7fc9d8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9f3400640 1 --2- 172.21.15.175:0/2680967888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f40cf560 0x7fc9d80040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9f3400640 1 -- 172.21.15.175:0/2680967888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f40cfef0 con 0x7fc9d80036b0 2024-04-25T09:09:48.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9f3400640 1 -- 172.21.15.175:0/2680967888 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d800fcb0 con 0x7fc9d8004aa0 2024-04-25T09:09:48.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.079+0000 7fc9f3400640 1 -- 172.21.15.175:0/2680967888 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d800feb0 con 0x7fc9f40cf560 2024-04-25T09:09:48.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.083+0000 7fc9eb400640 1 --2- 172.21.15.175:0/2680967888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9d80036b0 0x7fc9d8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.083+0000 7fc9f3e00640 1 --2- 172.21.15.175:0/2680967888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9d8004aa0 0x7fc9d8004ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.083+0000 7fc9f8c00640 1 --2- 172.21.15.175:0/2680967888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f40cf560 0x7fc9d80040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.083+0000 7fc9eb400640 1 -- 172.21.15.175:0/2680967888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f40cf560 msgr2=0x7fc9d80040b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:48.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.083+0000 7fc9eb400640 1 --2- 172.21.15.175:0/2680967888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f40cf560 0x7fc9d80040b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.083+0000 7fc9eb400640 1 -- 172.21.15.175:0/2680967888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9d8004aa0 msgr2=0x7fc9d8004ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:48.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.083+0000 7fc9eb400640 1 --2- 172.21.15.175:0/2680967888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9d8004aa0 0x7fc9d8004ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.083+0000 7fc9eb400640 1 -- 172.21.15.175:0/2680967888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d8003430 con 0x7fc9d80036b0 2024-04-25T09:09:48.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.083+0000 7fc9f8c00640 1 --2- 172.21.15.175:0/2680967888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f40cf560 0x7fc9d80040b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:48.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.083+0000 7fc9eb400640 1 --2- 172.21.15.175:0/2680967888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9d80036b0 0x7fc9d8003b30 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40cd930 tx=0x7fc9dc01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c676bf98229c82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:48.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.083+0000 7fc9f3400640 1 -- 172.21.15.175:0/2680967888 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc007d60 con 0x7fc9d80036b0 2024-04-25T09:09:48.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.083+0000 7fc9f3400640 1 -- 172.21.15.175:0/2680967888 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9dc005ae0 con 0x7fc9d80036b0 2024-04-25T09:09:48.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.083+0000 7fc9f3400640 1 -- 172.21.15.175:0/2680967888 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9dc007070 con 0x7fc9d80036b0 2024-04-25T09:09:48.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.083+0000 7fc9fac00640 1 -- 172.21.15.175:0/2680967888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9d80036b0 msgr2=0x7fc9d8003b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:48.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.083+0000 7fc9fac00640 1 --2- 172.21.15.175:0/2680967888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9d80036b0 0x7fc9d8003b30 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40cd930 tx=0x7fc9dc01f3d0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.083+0000 7fc9f8c00640 1 -- 172.21.15.175:0/2680967888 reap_dead start 2024-04-25T09:09:48.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9fac00640 1 -- 172.21.15.175:0/2680967888 shutdown_connections 2024-04-25T09:09:48.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9fac00640 1 -- 172.21.15.175:0/2680967888 >> 172.21.15.175:0/2680967888 conn(0x7fc9f4067150 msgr2=0x7fc9f406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:48.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9fac00640 1 -- 172.21.15.175:0/2680967888 shutdown_connections 2024-04-25T09:09:48.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9fac00640 1 -- 172.21.15.175:0/2680967888 wait complete. 2024-04-25T09:09:48.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9fac00640 1 Processor -- start 2024-04-25T09:09:48.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9fac00640 1 -- start start 2024-04-25T09:09:48.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9fac00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9f4145e90 0x7fc9f41531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9fac00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f414e2a0 0x7fc9f40b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9fac00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4146270 0x7fc9f40b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9fac00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f40ce580 con 0x7fc9f4146270 2024-04-25T09:09:48.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9fac00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f40ce2a0 con 0x7fc9f4145e90 2024-04-25T09:09:48.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9fac00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f406d3b0 con 0x7fc9f414e2a0 2024-04-25T09:09:48.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9f8c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4146270 0x7fc9f40b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9f8c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4146270 0x7fc9f40b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35130/0 (socket says 172.21.15.175:35130) 2024-04-25T09:09:48.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9f8c00640 1 -- 172.21.15.175:0/2782209199 learned_addr learned my addr 172.21.15.175:0/2782209199 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:48.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9f3e00640 1 --2- 172.21.15.175:0/2782209199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9f4145e90 0x7fc9f41531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9eb400640 1 --2- 172.21.15.175:0/2782209199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f414e2a0 0x7fc9f40b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9f8c00640 1 -- 172.21.15.175:0/2782209199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f414e2a0 msgr2=0x7fc9f40b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:48.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9f8c00640 1 --2- 172.21.15.175:0/2782209199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f414e2a0 0x7fc9f40b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9f8c00640 1 -- 172.21.15.175:0/2782209199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9f4145e90 msgr2=0x7fc9f41531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:48.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9f8c00640 1 --2- 172.21.15.175:0/2782209199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9f4145e90 0x7fc9f41531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9f8c00640 1 -- 172.21.15.175:0/2782209199 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f4153b30 con 0x7fc9f4146270 2024-04-25T09:09:48.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9eb400640 1 --2- 172.21.15.175:0/2782209199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f414e2a0 0x7fc9f40b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:48.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9f8c00640 1 --2- 172.21.15.175:0/2782209199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4146270 0x7fc9f40b1770 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40cf4e0 tx=0x7fc9ec010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:48.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9f0c00640 1 -- 172.21.15.175:0/2782209199 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec01a030 con 0x7fc9f4146270 2024-04-25T09:09:48.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9f0c00640 1 -- 172.21.15.175:0/2782209199 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ec010e00 con 0x7fc9f4146270 2024-04-25T09:09:48.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9fac00640 1 -- 172.21.15.175:0/2782209199 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f4150650 con 0x7fc9f4146270 2024-04-25T09:09:48.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.087+0000 7fc9f0c00640 1 -- 172.21.15.175:0/2782209199 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ec003be0 con 0x7fc9f4146270 2024-04-25T09:09:48.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.091+0000 7fc9fac00640 1 -- 172.21.15.175:0/2782209199 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f4150c10 con 0x7fc9f4146270 2024-04-25T09:09:48.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.091+0000 7fc9fac00640 1 -- 172.21.15.175:0/2782209199 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f4074a60 con 0x7fc9f4146270 2024-04-25T09:09:48.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.091+0000 7fc9f0c00640 1 -- 172.21.15.175:0/2782209199 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc9ec01d070 con 0x7fc9f4146270 2024-04-25T09:09:48.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.091+0000 7fc9f0c00640 1 --2- 172.21.15.175:0/2782209199 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc9d0066f60 0x7fc9d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.091+0000 7fc9f0c00640 1 -- 172.21.15.175:0/2782209199 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc9ec0855f0 con 0x7fc9f4146270 2024-04-25T09:09:48.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.091+0000 7fc9f3e00640 1 --2- 172.21.15.175:0/2782209199 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc9d0066f60 0x7fc9d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.091+0000 7fc9f3e00640 1 --2- 172.21.15.175:0/2782209199 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc9d0066f60 0x7fc9d0069420 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009be0 tx=0x7fc9e4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:48.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.095+0000 7fc9f0c00640 1 -- 172.21.15.175:0/2782209199 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc9ec056560 con 0x7fc9f4146270 2024-04-25T09:09:48.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.251+0000 7fc9fac00640 1 -- 172.21.15.175:0/2782209199 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9f4156bb0 con 0x7fc9f4146270 2024-04-25T09:09:48.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.251+0000 7fc9f0c00640 1 -- 172.21.15.175:0/2782209199 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16933 (secure 0 0 0) 0x7fc9ec055e60 con 0x7fc9f4146270 2024-04-25T09:09:48.241 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:09:48.241 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":72,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:08:52.921396+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:08:15.743582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T09:08:16.375168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.17","mappings":[{"from":6,"to":0}]},{"pgid":"11.2e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.177:6835/1709110121":"2024-04-26T09:08:32.433027+0000","172.21.15.177:6833/1709110121":"2024-04-26T09:08:32.433027+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.251+0000 7fc9fac00640 1 -- 172.21.15.175:0/2782209199 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc9d0066f60 msgr2=0x7fc9d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.251+0000 7fc9fac00640 1 --2- 172.21.15.175:0/2782209199 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc9d0066f60 0x7fc9d0069420 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009be0 tx=0x7fc9e4009190 comp rx=0 tx=0).stop 2024-04-25T09:09:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.251+0000 7fc9fac00640 1 -- 172.21.15.175:0/2782209199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4146270 msgr2=0x7fc9f40b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.251+0000 7fc9fac00640 1 --2- 172.21.15.175:0/2782209199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4146270 0x7fc9f40b1770 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40cf4e0 tx=0x7fc9ec010590 comp rx=0 tx=0).stop 2024-04-25T09:09:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.251+0000 7fc9fac00640 1 -- 172.21.15.175:0/2782209199 shutdown_connections 2024-04-25T09:09:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.251+0000 7fc9fac00640 1 --2- 172.21.15.175:0/2782209199 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc9d0066f60 0x7fc9d0069420 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.251+0000 7fc9fac00640 1 --2- 172.21.15.175:0/2782209199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9f4146270 0x7fc9f40b1770 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.251+0000 7fc9fac00640 1 --2- 172.21.15.175:0/2782209199 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9f414e2a0 0x7fc9f40b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.251+0000 7fc9fac00640 1 --2- 172.21.15.175:0/2782209199 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9f4145e90 0x7fc9f41531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.251+0000 7fc9fac00640 1 -- 172.21.15.175:0/2782209199 >> 172.21.15.175:0/2782209199 conn(0x7fc9d80036b0 msgr2=0x7fc9f4159be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:48.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.251+0000 7fc9fac00640 1 -- 172.21.15.175:0/2782209199 shutdown_connections 2024-04-25T09:09:48.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.251+0000 7fc9fac00640 1 -- 172.21.15.175:0/2782209199 wait complete. 2024-04-25T09:09:48.262 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:08:15.743582+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:08:16.375168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:09:48.262 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:09:48.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.407+0000 7fc09a800640 1 Processor -- start 2024-04-25T09:09:48.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.411+0000 7fc09a800640 1 -- start start 2024-04-25T09:09:48.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.411+0000 7fc09a800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0940b2660 0x7fc0940b3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.411+0000 7fc09a800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc0940cfbb0 0x7fc0940712d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.411+0000 7fc09a800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0940b2a40 con 0x7fc0940cf750 2024-04-25T09:09:48.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.411+0000 7fc09a800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0940b3770 con 0x7fc0940cfbb0 2024-04-25T09:09:48.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.411+0000 7fc09a800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09415dd10 con 0x7fc0940b2660 2024-04-25T09:09:48.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.411+0000 7fc093e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc0940cfbb0 0x7fc0940712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.411+0000 7fc093e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc0940cfbb0 0x7fc0940712d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35142/0 (socket says 172.21.15.175:35142) 2024-04-25T09:09:48.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.411+0000 7fc093e00640 1 -- 172.21.15.175:0/1101867847 learned_addr learned my addr 172.21.15.175:0/1101867847 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:48.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.411+0000 7fc093400640 1 --2- 172.21.15.175:0/1101867847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0940b2660 0x7fc0940b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.411+0000 7fc093e00640 1 -- 172.21.15.175:0/1101867847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0940b2660 msgr2=0x7fc0940b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:48.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.411+0000 7fc093e00640 1 --2- 172.21.15.175:0/1101867847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0940b2660 0x7fc0940b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.411+0000 7fc093e00640 1 -- 172.21.15.175:0/1101867847 >> v1:172.21.15.177:6789/0 conn(0x7fc0940cf750 legacy=0x7fc0940b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:48.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.411+0000 7fc093e00640 1 -- 172.21.15.175:0/1101867847 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09415dff0 con 0x7fc0940cfbb0 2024-04-25T09:09:48.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.411+0000 7fc093400640 1 --2- 172.21.15.175:0/1101867847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0940b2660 0x7fc0940b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:48.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.415+0000 7fc093e00640 1 --2- 172.21.15.175:0/1101867847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0940cfbb0 0x7fc0940712d0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0098a0 tx=0x7fc08c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc08521edc710c26 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:48.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.415+0000 7fc092000640 1 -- 172.21.15.175:0/1101867847 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0ab620 con 0x7fc0940cfbb0 2024-04-25T09:09:48.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.415+0000 7fc092000640 1 -- 172.21.15.175:0/1101867847 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c0b0070 con 0x7fc0940cfbb0 2024-04-25T09:09:48.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.415+0000 7fc092000640 1 -- 172.21.15.175:0/1101867847 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0ab9e0 con 0x7fc0940cfbb0 2024-04-25T09:09:48.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.415+0000 7fc09a800640 1 -- 172.21.15.175:0/1101867847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0940cfbb0 msgr2=0x7fc0940712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:48.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.415+0000 7fc09a800640 1 --2- 172.21.15.175:0/1101867847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0940cfbb0 0x7fc0940712d0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0098a0 tx=0x7fc08c01c510 comp rx=0 tx=0).stop 2024-04-25T09:09:48.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.415+0000 7fc09a800640 1 -- 172.21.15.175:0/1101867847 shutdown_connections 2024-04-25T09:09:48.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.415+0000 7fc09a800640 1 --2- 172.21.15.175:0/1101867847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0940cfbb0 0x7fc0940712d0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.415+0000 7fc09a800640 1 --2- 172.21.15.175:0/1101867847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0940b2660 0x7fc0940b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.415+0000 7fc09a800640 1 -- 172.21.15.175:0/1101867847 >> 172.21.15.175:0/1101867847 conn(0x7fc09406ac50 msgr2=0x7fc09406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:48.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.415+0000 7fc09a800640 1 -- 172.21.15.175:0/1101867847 shutdown_connections 2024-04-25T09:09:48.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.415+0000 7fc09a800640 1 -- 172.21.15.175:0/1101867847 wait complete. 2024-04-25T09:09:48.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.415+0000 7fc09a800640 1 Processor -- start 2024-04-25T09:09:48.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.415+0000 7fc09a800640 1 -- start start 2024-04-25T09:09:48.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc09a800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0940b2660 0x7fc09414a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc09a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0940cf750 0x7fc094168720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc09a800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0940cfbb0 0x7fc094148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc09a800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940b4430 con 0x7fc0940cf750 2024-04-25T09:09:48.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc09a800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09415ec00 con 0x7fc0940b2660 2024-04-25T09:09:48.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc09a800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940b45b0 con 0x7fc0940cfbb0 2024-04-25T09:09:48.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc092a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0940cf750 0x7fc094168720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc092a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0940cf750 0x7fc094168720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35152/0 (socket says 172.21.15.175:35152) 2024-04-25T09:09:48.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc092a00640 1 -- 172.21.15.175:0/2753002337 learned_addr learned my addr 172.21.15.175:0/2753002337 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:48.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc093400640 1 --2- 172.21.15.175:0/2753002337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0940b2660 0x7fc09414a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc093e00640 1 --2- 172.21.15.175:0/2753002337 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0940cfbb0 0x7fc094148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc092a00640 1 -- 172.21.15.175:0/2753002337 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0940cfbb0 msgr2=0x7fc094148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:48.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc092a00640 1 --2- 172.21.15.175:0/2753002337 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0940cfbb0 0x7fc094148e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc092a00640 1 -- 172.21.15.175:0/2753002337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0940b2660 msgr2=0x7fc09414a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:48.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc092a00640 1 --2- 172.21.15.175:0/2753002337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0940b2660 0x7fc09414a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc092a00640 1 -- 172.21.15.175:0/2753002337 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc094147b90 con 0x7fc0940cf750 2024-04-25T09:09:48.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc093e00640 1 --2- 172.21.15.175:0/2753002337 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0940cfbb0 0x7fc094148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:48.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc093400640 1 --2- 172.21.15.175:0/2753002337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0940b2660 0x7fc09414a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:48.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc092a00640 1 --2- 172.21.15.175:0/2753002337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0940cf750 0x7fc094168720 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fc08000c3a0 tx=0x7fc08000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:48.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc08b400640 1 -- 172.21.15.175:0/2753002337 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0800052d0 con 0x7fc0940cf750 2024-04-25T09:09:48.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc08b400640 1 -- 172.21.15.175:0/2753002337 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc080005470 con 0x7fc0940cf750 2024-04-25T09:09:48.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc08b400640 1 -- 172.21.15.175:0/2753002337 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080007260 con 0x7fc0940cf750 2024-04-25T09:09:48.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc09a800640 1 -- 172.21.15.175:0/2753002337 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc094147e30 con 0x7fc0940cf750 2024-04-25T09:09:48.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc09a800640 1 -- 172.21.15.175:0/2753002337 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc094169170 con 0x7fc0940cf750 2024-04-25T09:09:48.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc09a800640 1 -- 172.21.15.175:0/2753002337 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc094075160 con 0x7fc0940cf750 2024-04-25T09:09:48.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.419+0000 7fc08b400640 1 -- 172.21.15.175:0/2753002337 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc080007400 con 0x7fc0940cf750 2024-04-25T09:09:48.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.423+0000 7fc08b400640 1 --2- 172.21.15.175:0/2753002337 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc074066f60 0x7fc074069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.423+0000 7fc08b400640 1 -- 172.21.15.175:0/2753002337 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc0800845f0 con 0x7fc0940cf750 2024-04-25T09:09:48.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.423+0000 7fc093400640 1 --2- 172.21.15.175:0/2753002337 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc074066f60 0x7fc074069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.423+0000 7fc093400640 1 --2- 172.21.15.175:0/2753002337 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc074066f60 0x7fc074069420 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc08400e3d0 tx=0x7fc084007a10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:48.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.427+0000 7fc08b400640 1 -- 172.21.15.175:0/2753002337 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc0800554d0 con 0x7fc0940cf750 2024-04-25T09:09:48.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.579+0000 7fc09a800640 1 -- 172.21.15.175:0/2753002337 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc094067cb0 con 0x7fc0940cf750 2024-04-25T09:09:48.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.579+0000 7fc08b400640 1 -- 172.21.15.175:0/2753002337 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc080054dd0 con 0x7fc0940cf750 2024-04-25T09:09:48.570 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:09:48.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.583+0000 7fc09a800640 1 -- 172.21.15.175:0/2753002337 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc074066f60 msgr2=0x7fc074069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:48.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.583+0000 7fc09a800640 1 --2- 172.21.15.175:0/2753002337 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc074066f60 0x7fc074069420 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc08400e3d0 tx=0x7fc084007a10 comp rx=0 tx=0).stop 2024-04-25T09:09:48.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.583+0000 7fc09a800640 1 -- 172.21.15.175:0/2753002337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0940cf750 msgr2=0x7fc094168720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:48.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.583+0000 7fc09a800640 1 --2- 172.21.15.175:0/2753002337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0940cf750 0x7fc094168720 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fc08000c3a0 tx=0x7fc08000c860 comp rx=0 tx=0).stop 2024-04-25T09:09:48.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.583+0000 7fc09a800640 1 -- 172.21.15.175:0/2753002337 shutdown_connections 2024-04-25T09:09:48.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.583+0000 7fc09a800640 1 --2- 172.21.15.175:0/2753002337 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc074066f60 0x7fc074069420 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.583+0000 7fc09a800640 1 --2- 172.21.15.175:0/2753002337 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0940cfbb0 0x7fc094148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.583+0000 7fc09a800640 1 --2- 172.21.15.175:0/2753002337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0940cf750 0x7fc094168720 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.583+0000 7fc09a800640 1 --2- 172.21.15.175:0/2753002337 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0940b2660 0x7fc09414a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.583+0000 7fc09a800640 1 -- 172.21.15.175:0/2753002337 >> 172.21.15.175:0/2753002337 conn(0x7fc09406ac50 msgr2=0x7fc09406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:48.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.583+0000 7fc09a800640 1 -- 172.21.15.175:0/2753002337 shutdown_connections 2024-04-25T09:09:48.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.583+0000 7fc09a800640 1 -- 172.21.15.175:0/2753002337 wait complete. 2024-04-25T09:09:48.591 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:09:48.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.739+0000 7f0bbd000640 1 Processor -- start 2024-04-25T09:09:48.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.739+0000 7f0bbd000640 1 -- start start 2024-04-25T09:09:48.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.739+0000 7f0bbd000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0bb8145250 0x7f0bb80cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.739+0000 7f0bbd000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb81600a0 0x7f0bb80cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.739+0000 7f0bbd000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0bb80ce970 0x7f0bb80cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.739+0000 7f0bbd000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb815f650 con 0x7f0bb8145250 2024-04-25T09:09:48.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.739+0000 7f0bbd000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb80cfd10 con 0x7f0bb80ce970 2024-04-25T09:09:48.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.739+0000 7f0bbd000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb80cfff0 con 0x7f0bb81600a0 2024-04-25T09:09:48.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.739+0000 7f0bb5e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0bb8145250 0x7f0bb80cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.739+0000 7f0bb5e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0bb8145250 0x7f0bb80cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35160/0 (socket says 172.21.15.175:35160) 2024-04-25T09:09:48.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.743+0000 7f0bb5e00640 1 -- 172.21.15.175:0/808720926 learned_addr learned my addr 172.21.15.175:0/808720926 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:48.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.743+0000 7f0bb6800640 1 --2- 172.21.15.175:0/808720926 >> v2:172.21.15.177:3300/0 conn(0x7f0bb80ce970 0x7f0bb80cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.743+0000 7f0bb5400640 1 --2- 172.21.15.175:0/808720926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb81600a0 0x7f0bb80cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.743+0000 7f0bb5e00640 1 -- 172.21.15.175:0/808720926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb81600a0 msgr2=0x7f0bb80cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:48.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.743+0000 7f0bb5e00640 1 --2- 172.21.15.175:0/808720926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb81600a0 0x7f0bb80cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.743+0000 7f0bb5e00640 1 -- 172.21.15.175:0/808720926 >> v2:172.21.15.177:3300/0 conn(0x7f0bb80ce970 msgr2=0x7f0bb80cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:48.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.743+0000 7f0bb5e00640 1 --2- 172.21.15.175:0/808720926 >> v2:172.21.15.177:3300/0 conn(0x7f0bb80ce970 0x7f0bb80cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.743+0000 7f0bb5e00640 1 -- 172.21.15.175:0/808720926 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb815f8a0 con 0x7f0bb8145250 2024-04-25T09:09:48.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.743+0000 7f0bb5e00640 1 --2- 172.21.15.175:0/808720926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bb8145250 0x7f0bb80cf6b0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8071260 tx=0x7f0ba801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4cef7fa2cdd3c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:48.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.743+0000 7f0bb4a00640 1 -- 172.21.15.175:0/808720926 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80a5860 con 0x7f0bb8145250 2024-04-25T09:09:48.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.743+0000 7f0bb4a00640 1 -- 172.21.15.175:0/808720926 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba80a5a00 con 0x7f0bb8145250 2024-04-25T09:09:48.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.743+0000 7f0bb4a00640 1 -- 172.21.15.175:0/808720926 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba80a5dd0 con 0x7f0bb8145250 2024-04-25T09:09:48.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bbd000640 1 -- 172.21.15.175:0/808720926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bb8145250 msgr2=0x7f0bb80cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:48.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bbd000640 1 --2- 172.21.15.175:0/808720926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bb8145250 0x7f0bb80cf6b0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8071260 tx=0x7f0ba801c9c0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bbd000640 1 -- 172.21.15.175:0/808720926 shutdown_connections 2024-04-25T09:09:48.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bbd000640 1 --2- 172.21.15.175:0/808720926 >> v2:172.21.15.177:3300/0 conn(0x7f0bb80ce970 0x7f0bb80cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bbd000640 1 --2- 172.21.15.175:0/808720926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb81600a0 0x7f0bb80cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bbd000640 1 --2- 172.21.15.175:0/808720926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bb8145250 0x7f0bb80cf6b0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bbd000640 1 -- 172.21.15.175:0/808720926 >> 172.21.15.175:0/808720926 conn(0x7f0bb806ac50 msgr2=0x7f0bb806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:48.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bbd000640 1 -- 172.21.15.175:0/808720926 shutdown_connections 2024-04-25T09:09:48.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bbd000640 1 -- 172.21.15.175:0/808720926 wait complete. 2024-04-25T09:09:48.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bbd000640 1 Processor -- start 2024-04-25T09:09:48.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bbd000640 1 -- start start 2024-04-25T09:09:48.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bbd000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb80ce970 0x7f0bb80afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bbd000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bb8145250 0x7f0bb80b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bbd000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb81600a0 0x7f0bb80b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bbd000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb8160480 con 0x7f0bb8145250 2024-04-25T09:09:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bbd000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb8145630 con 0x7f0bb80ce970 2024-04-25T09:09:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bbd000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb8160600 con 0x7f0bb81600a0 2024-04-25T09:09:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bb5400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bb8145250 0x7f0bb80b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bb5400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bb8145250 0x7f0bb80b3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35172/0 (socket says 172.21.15.175:35172) 2024-04-25T09:09:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bb5400640 1 -- 172.21.15.175:0/265622279 learned_addr learned my addr 172.21.15.175:0/265622279 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bb5e00640 1 --2- 172.21.15.175:0/265622279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb80ce970 0x7f0bb80afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bb6800640 1 --2- 172.21.15.175:0/265622279 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb81600a0 0x7f0bb80b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bb5400640 1 -- 172.21.15.175:0/265622279 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb81600a0 msgr2=0x7f0bb80b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bb5400640 1 --2- 172.21.15.175:0/265622279 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb81600a0 0x7f0bb80b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bb5400640 1 -- 172.21.15.175:0/265622279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb80ce970 msgr2=0x7f0bb80afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bb5400640 1 --2- 172.21.15.175:0/265622279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb80ce970 0x7f0bb80afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bb5400640 1 -- 172.21.15.175:0/265622279 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb80b29b0 con 0x7f0bb8145250 2024-04-25T09:09:48.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.747+0000 7f0bb5400640 1 --2- 172.21.15.175:0/265622279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bb8145250 0x7f0bb80b3d70 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0ba400e870 tx=0x7f0ba400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:48.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.751+0000 7f0bae000640 1 -- 172.21.15.175:0/265622279 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4017070 con 0x7f0bb8145250 2024-04-25T09:09:48.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.751+0000 7f0bae000640 1 -- 172.21.15.175:0/265622279 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba400c940 con 0x7f0bb8145250 2024-04-25T09:09:48.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.751+0000 7f0bae000640 1 -- 172.21.15.175:0/265622279 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba400ccf0 con 0x7f0bb8145250 2024-04-25T09:09:48.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.751+0000 7f0bbd000640 1 -- 172.21.15.175:0/265622279 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb80b2c90 con 0x7f0bb8145250 2024-04-25T09:09:48.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.751+0000 7f0bbd000640 1 -- 172.21.15.175:0/265622279 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb80b3250 con 0x7f0bb8145250 2024-04-25T09:09:48.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.751+0000 7f0bbd000640 1 -- 172.21.15.175:0/265622279 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb80b3690 con 0x7f0bb8145250 2024-04-25T09:09:48.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.751+0000 7f0bae000640 1 -- 172.21.15.175:0/265622279 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0ba401a070 con 0x7f0bb8145250 2024-04-25T09:09:48.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.751+0000 7f0bae000640 1 --2- 172.21.15.175:0/265622279 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0b98066f60 0x7f0b98069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:48.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.751+0000 7f0bae000640 1 -- 172.21.15.175:0/265622279 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f0ba4084f90 con 0x7f0bb8145250 2024-04-25T09:09:48.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.751+0000 7f0bb5e00640 1 --2- 172.21.15.175:0/265622279 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0b98066f60 0x7f0b98069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:48.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.751+0000 7f0bb5e00640 1 --2- 172.21.15.175:0/265622279 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0b98066f60 0x7f0b98069420 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80ae000 tx=0x7f0ba80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:48.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.755+0000 7f0bae000640 1 -- 172.21.15.175:0/265622279 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0ba4055820 con 0x7f0bb8145250 2024-04-25T09:09:48.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.907+0000 7f0bbd000640 1 -- 172.21.15.175:0/265622279 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0bb8075160 con 0x7f0bb8145250 2024-04-25T09:09:48.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.907+0000 7f0bae000640 1 -- 172.21.15.175:0/265622279 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ba40598c0 con 0x7f0bb8145250 2024-04-25T09:09:48.899 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:09:48.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.911+0000 7f0bbd000640 1 -- 172.21.15.175:0/265622279 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0b98066f60 msgr2=0x7f0b98069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:48.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.911+0000 7f0bbd000640 1 --2- 172.21.15.175:0/265622279 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0b98066f60 0x7f0b98069420 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80ae000 tx=0x7f0ba80a7070 comp rx=0 tx=0).stop 2024-04-25T09:09:48.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.911+0000 7f0bbd000640 1 -- 172.21.15.175:0/265622279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bb8145250 msgr2=0x7f0bb80b3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:48.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.911+0000 7f0bbd000640 1 --2- 172.21.15.175:0/265622279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bb8145250 0x7f0bb80b3d70 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0ba400e870 tx=0x7f0ba400ec70 comp rx=0 tx=0).stop 2024-04-25T09:09:48.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.911+0000 7f0bbd000640 1 -- 172.21.15.175:0/265622279 shutdown_connections 2024-04-25T09:09:48.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.911+0000 7f0bbd000640 1 --2- 172.21.15.175:0/265622279 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0b98066f60 0x7f0b98069420 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.911+0000 7f0bbd000640 1 --2- 172.21.15.175:0/265622279 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0bb81600a0 0x7f0bb80b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.911+0000 7f0bbd000640 1 --2- 172.21.15.175:0/265622279 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0bb8145250 0x7f0bb80b3d70 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.911+0000 7f0bbd000640 1 --2- 172.21.15.175:0/265622279 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0bb80ce970 0x7f0bb80afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:48.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.911+0000 7f0bbd000640 1 -- 172.21.15.175:0/265622279 >> 172.21.15.175:0/265622279 conn(0x7f0bb806ac50 msgr2=0x7f0bb80b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:48.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.911+0000 7f0bbd000640 1 -- 172.21.15.175:0/265622279 shutdown_connections 2024-04-25T09:09:48.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:48.911+0000 7f0bbd000640 1 -- 172.21.15.175:0/265622279 wait complete. 2024-04-25T09:09:48.920 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:09:49.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.067+0000 7fd661c00640 1 Processor -- start 2024-04-25T09:09:49.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.067+0000 7fd661c00640 1 -- start start 2024-04-25T09:09:49.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.071+0000 7fd661c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd65c145250 0x7fd65c0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.071+0000 7fd661c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd65c0ce970 0x7fd65c0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.071+0000 7fd661c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65c0cfd10 con 0x7fd65c1600a0 2024-04-25T09:09:49.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.071+0000 7fd661c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd65c15f650 con 0x7fd65c0ce970 2024-04-25T09:09:49.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.071+0000 7fd661c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c0cfff0 con 0x7fd65c145250 2024-04-25T09:09:49.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.071+0000 7fd65aa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd65c145250 0x7fd65c0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.071+0000 7fd65aa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd65c145250 0x7fd65c0cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:44760/0 (socket says 172.21.15.175:44760) 2024-04-25T09:09:49.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.071+0000 7fd65aa00640 1 -- 172.21.15.175:0/912402474 learned_addr learned my addr 172.21.15.175:0/912402474 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:49.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.071+0000 7fd65b400640 1 --2- 172.21.15.175:0/912402474 >> v2:172.21.15.177:3300/0 conn(0x7fd65c0ce970 0x7fd65c0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.071+0000 7fd65aa00640 1 -- 172.21.15.175:0/912402474 >> v2:172.21.15.177:3300/0 conn(0x7fd65c0ce970 msgr2=0x7fd65c0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:49.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.071+0000 7fd65aa00640 1 --2- 172.21.15.175:0/912402474 >> v2:172.21.15.177:3300/0 conn(0x7fd65c0ce970 0x7fd65c0cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.071+0000 7fd65aa00640 1 -- 172.21.15.175:0/912402474 >> v1:172.21.15.177:6789/0 conn(0x7fd65c1600a0 legacy=0x7fd65c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.071+0000 7fd65a000640 1 -- 172.21.15.175:0/912402474 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052158095 0 0) 0x7fd65c0cfd10 con 0x7fd65c1600a0 2024-04-25T09:09:49.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.071+0000 7fd65aa00640 1 -- 172.21.15.175:0/912402474 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c15f8a0 con 0x7fd65c145250 2024-04-25T09:09:49.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.075+0000 7fd65aa00640 1 --2- 172.21.15.175:0/912402474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd65c145250 0x7fd65c0cf6b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009e50 tx=0x7fd64c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f886a1bebbb34f46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.075+0000 7fd65a000640 1 -- 172.21.15.175:0/912402474 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c0a5850 con 0x7fd65c145250 2024-04-25T09:09:49.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.075+0000 7fd65a000640 1 -- 172.21.15.175:0/912402474 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64c0a59f0 con 0x7fd65c145250 2024-04-25T09:09:49.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.075+0000 7fd65a000640 1 -- 172.21.15.175:0/912402474 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c0a5dc0 con 0x7fd65c145250 2024-04-25T09:09:49.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.075+0000 7fd661c00640 1 -- 172.21.15.175:0/912402474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd65c145250 msgr2=0x7fd65c0cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.075+0000 7fd661c00640 1 --2- 172.21.15.175:0/912402474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd65c145250 0x7fd65c0cf6b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009e50 tx=0x7fd64c01c970 comp rx=0 tx=0).stop 2024-04-25T09:09:49.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.075+0000 7fd661c00640 1 -- 172.21.15.175:0/912402474 shutdown_connections 2024-04-25T09:09:49.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.075+0000 7fd661c00640 1 --2- 172.21.15.175:0/912402474 >> v2:172.21.15.177:3300/0 conn(0x7fd65c0ce970 0x7fd65c0cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.075+0000 7fd661c00640 1 --2- 172.21.15.175:0/912402474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd65c145250 0x7fd65c0cf6b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.075+0000 7fd661c00640 1 -- 172.21.15.175:0/912402474 >> 172.21.15.175:0/912402474 conn(0x7fd65c06ac50 msgr2=0x7fd65c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:49.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.075+0000 7fd661c00640 1 -- 172.21.15.175:0/912402474 shutdown_connections 2024-04-25T09:09:49.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.075+0000 7fd661c00640 1 -- 172.21.15.175:0/912402474 wait complete. 2024-04-25T09:09:49.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd661c00640 1 Processor -- start 2024-04-25T09:09:49.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd661c00640 1 -- start start 2024-04-25T09:09:49.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd661c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd65c0ce970 0x7fd65c0b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd661c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd65c145250 0x7fd65c0b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd661c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd65c1600a0 0x7fd65c1f6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd661c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c15c870 con 0x7fd65c0ce970 2024-04-25T09:09:49.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd661c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c1604c0 con 0x7fd65c1600a0 2024-04-25T09:09:49.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd661c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c15c9f0 con 0x7fd65c145250 2024-04-25T09:09:49.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd65aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd65c0ce970 0x7fd65c0b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd65aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd65c0ce970 0x7fd65c0b3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35174/0 (socket says 172.21.15.175:35174) 2024-04-25T09:09:49.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd65aa00640 1 -- 172.21.15.175:0/3339411094 learned_addr learned my addr 172.21.15.175:0/3339411094 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:49.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd652000640 1 --2- 172.21.15.175:0/3339411094 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd65c145250 0x7fd65c0b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd65b400640 1 --2- 172.21.15.175:0/3339411094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd65c1600a0 0x7fd65c1f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd65aa00640 1 -- 172.21.15.175:0/3339411094 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd65c145250 msgr2=0x7fd65c0b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd65aa00640 1 --2- 172.21.15.175:0/3339411094 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd65c145250 0x7fd65c0b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd65aa00640 1 -- 172.21.15.175:0/3339411094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd65c1600a0 msgr2=0x7fd65c1f6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd65aa00640 1 --2- 172.21.15.175:0/3339411094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd65c1600a0 0x7fd65c1f6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd65aa00640 1 -- 172.21.15.175:0/3339411094 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c1f6eb0 con 0x7fd65c0ce970 2024-04-25T09:09:49.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd65b400640 1 --2- 172.21.15.175:0/3339411094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd65c1600a0 0x7fd65c1f6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:49.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd65aa00640 1 --2- 172.21.15.175:0/3339411094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd65c0ce970 0x7fd65c0b3770 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fd64c01a5a0 tx=0x7fd64c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd653400640 1 -- 172.21.15.175:0/3339411094 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c0bc020 con 0x7fd65c0ce970 2024-04-25T09:09:49.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd653400640 1 -- 172.21.15.175:0/3339411094 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64c0b8670 con 0x7fd65c0ce970 2024-04-25T09:09:49.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd653400640 1 -- 172.21.15.175:0/3339411094 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c0b8a60 con 0x7fd65c0ce970 2024-04-25T09:09:49.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd661c00640 1 -- 172.21.15.175:0/3339411094 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65c15e2a0 con 0x7fd65c0ce970 2024-04-25T09:09:49.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd661c00640 1 -- 172.21.15.175:0/3339411094 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65c15e860 con 0x7fd65c0ce970 2024-04-25T09:09:49.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.079+0000 7fd661c00640 1 -- 172.21.15.175:0/3339411094 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65c075160 con 0x7fd65c0ce970 2024-04-25T09:09:49.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.083+0000 7fd653400640 1 -- 172.21.15.175:0/3339411094 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd64c0bf020 con 0x7fd65c0ce970 2024-04-25T09:09:49.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.083+0000 7fd653400640 1 --2- 172.21.15.175:0/3339411094 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd638066f60 0x7fd638069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.083+0000 7fd653400640 1 -- 172.21.15.175:0/3339411094 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd64c120220 con 0x7fd65c0ce970 2024-04-25T09:09:49.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.083+0000 7fd652000640 1 --2- 172.21.15.175:0/3339411094 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd638066f60 0x7fd638069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.083+0000 7fd652000640 1 --2- 172.21.15.175:0/3339411094 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd638066f60 0x7fd638069420 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd65c1449b0 tx=0x7fd644009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.087+0000 7fd653400640 1 -- 172.21.15.175:0/3339411094 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd64c0c6030 con 0x7fd65c0ce970 2024-04-25T09:09:49.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.239+0000 7fd661c00640 1 -- 172.21.15.175:0/3339411094 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd65c140640 con 0x7fd65c0ce970 2024-04-25T09:09:49.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.239+0000 7fd653400640 1 -- 172.21.15.175:0/3339411094 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd64c016620 con 0x7fd65c0ce970 2024-04-25T09:09:49.229 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:09:49.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.239+0000 7fd661c00640 1 -- 172.21.15.175:0/3339411094 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd638066f60 msgr2=0x7fd638069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.239+0000 7fd661c00640 1 --2- 172.21.15.175:0/3339411094 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd638066f60 0x7fd638069420 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd65c1449b0 tx=0x7fd644009040 comp rx=0 tx=0).stop 2024-04-25T09:09:49.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.239+0000 7fd661c00640 1 -- 172.21.15.175:0/3339411094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd65c0ce970 msgr2=0x7fd65c0b3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.239+0000 7fd661c00640 1 --2- 172.21.15.175:0/3339411094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd65c0ce970 0x7fd65c0b3770 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fd64c01a5a0 tx=0x7fd64c019710 comp rx=0 tx=0).stop 2024-04-25T09:09:49.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.239+0000 7fd661c00640 1 -- 172.21.15.175:0/3339411094 shutdown_connections 2024-04-25T09:09:49.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.239+0000 7fd661c00640 1 --2- 172.21.15.175:0/3339411094 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd638066f60 0x7fd638069420 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.239+0000 7fd661c00640 1 --2- 172.21.15.175:0/3339411094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd65c1600a0 0x7fd65c1f6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.239+0000 7fd661c00640 1 --2- 172.21.15.175:0/3339411094 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd65c145250 0x7fd65c0b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.239+0000 7fd661c00640 1 --2- 172.21.15.175:0/3339411094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd65c0ce970 0x7fd65c0b3770 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.243+0000 7fd661c00640 1 -- 172.21.15.175:0/3339411094 >> 172.21.15.175:0/3339411094 conn(0x7fd65c06ac50 msgr2=0x7fd65c164f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:49.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.243+0000 7fd661c00640 1 -- 172.21.15.175:0/3339411094 shutdown_connections 2024-04-25T09:09:49.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.243+0000 7fd661c00640 1 -- 172.21.15.175:0/3339411094 wait complete. 2024-04-25T09:09:49.250 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:49.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.395+0000 7fdc4c800640 1 Processor -- start 2024-04-25T09:09:49.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.395+0000 7fdc4c800640 1 -- start start 2024-04-25T09:09:49.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.395+0000 7fdc4c800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdc4415a900 0x7fdc4406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.395+0000 7fdc4c800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc440cf560 0x7fdc440cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.395+0000 7fdc4c800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc440cda00 con 0x7fdc440cd520 2024-04-25T09:09:49.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.395+0000 7fdc4c800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4415bcf0 con 0x7fdc4415a900 2024-04-25T09:09:49.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.395+0000 7fdc4c800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc440cfef0 con 0x7fdc440cf560 2024-04-25T09:09:49.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.395+0000 7fdc4a800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc440cf560 0x7fdc440cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.395+0000 7fdc49e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdc4415a900 0x7fdc4406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.395+0000 7fdc49400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fdc440cd520 0x7fdc440ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:48316/0 (socket says 172.21.15.175:48316) 2024-04-25T09:09:49.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.395+0000 7fdc49400640 1 -- 172.21.15.175:0/89289168 learned_addr learned my addr 172.21.15.175:0/89289168 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:49.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.395+0000 7fdc49e00640 1 -- 172.21.15.175:0/89289168 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc440cf560 msgr2=0x7fdc440cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:49.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.395+0000 7fdc49e00640 1 --2- 172.21.15.175:0/89289168 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc440cf560 0x7fdc440cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.395+0000 7fdc49e00640 1 -- 172.21.15.175:0/89289168 >> v1:172.21.15.177:6789/0 conn(0x7fdc440cd520 legacy=0x7fdc440ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.395+0000 7fdc49e00640 1 -- 172.21.15.175:0/89289168 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc440cdce0 con 0x7fdc4415a900 2024-04-25T09:09:49.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.399+0000 7fdc49e00640 1 --2- 172.21.15.175:0/89289168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc4415a900 0x7fdc4406e150 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdc380097c0 tx=0x7fdc3801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e1da31ddf0bee67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.399+0000 7fdc48a00640 1 -- 172.21.15.175:0/89289168 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc380b2070 con 0x7fdc4415a900 2024-04-25T09:09:49.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.399+0000 7fdc48a00640 1 -- 172.21.15.175:0/89289168 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc380ad640 con 0x7fdc4415a900 2024-04-25T09:09:49.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.399+0000 7fdc48a00640 1 -- 172.21.15.175:0/89289168 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc380ada10 con 0x7fdc4415a900 2024-04-25T09:09:49.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.399+0000 7fdc4c800640 1 -- 172.21.15.175:0/89289168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc4415a900 msgr2=0x7fdc4406e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.399+0000 7fdc4c800640 1 --2- 172.21.15.175:0/89289168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc4415a900 0x7fdc4406e150 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdc380097c0 tx=0x7fdc3801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.399+0000 7fdc4c800640 1 -- 172.21.15.175:0/89289168 shutdown_connections 2024-04-25T09:09:49.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.399+0000 7fdc4c800640 1 --2- 172.21.15.175:0/89289168 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc440cf560 0x7fdc440cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.399+0000 7fdc4c800640 1 --2- 172.21.15.175:0/89289168 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc4415a900 0x7fdc4406e150 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.399+0000 7fdc4c800640 1 -- 172.21.15.175:0/89289168 >> 172.21.15.175:0/89289168 conn(0x7fdc44067150 msgr2=0x7fdc4406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:49.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.399+0000 7fdc4c800640 1 -- 172.21.15.175:0/89289168 shutdown_connections 2024-04-25T09:09:49.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.399+0000 7fdc4c800640 1 -- 172.21.15.175:0/89289168 wait complete. 2024-04-25T09:09:49.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc4c800640 1 Processor -- start 2024-04-25T09:09:49.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc4c800640 1 -- start start 2024-04-25T09:09:49.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc4c800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc440cf560 0x7fdc4413bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc4c800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc4415a900 0x7fdc441509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc4c800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc44150ef0 0x7fdc4415cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc4c800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4406d530 con 0x7fdc4415a900 2024-04-25T09:09:49.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc4c800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4406d3b0 con 0x7fdc44150ef0 2024-04-25T09:09:49.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc4c800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4415c790 con 0x7fdc440cf560 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc49400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc4415a900 0x7fdc441509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc49400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc4415a900 0x7fdc441509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34146/0 (socket says 172.21.15.175:34146) 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc49400640 1 -- 172.21.15.175:0/1572596409 learned_addr learned my addr 172.21.15.175:0/1572596409 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc4a800640 1 --2- 172.21.15.175:0/1572596409 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc44150ef0 0x7fdc4415cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc49e00640 1 --2- 172.21.15.175:0/1572596409 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc440cf560 0x7fdc4413bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc49400640 1 -- 172.21.15.175:0/1572596409 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc440cf560 msgr2=0x7fdc4413bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc49400640 1 --2- 172.21.15.175:0/1572596409 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc440cf560 0x7fdc4413bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc49400640 1 -- 172.21.15.175:0/1572596409 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc44150ef0 msgr2=0x7fdc4415cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc49400640 1 --2- 172.21.15.175:0/1572596409 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc44150ef0 0x7fdc4415cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc49400640 1 -- 172.21.15.175:0/1572596409 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4415d7f0 con 0x7fdc4415a900 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc49400640 1 --2- 172.21.15.175:0/1572596409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc4415a900 0x7fdc441509b0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fdc3400c430 tx=0x7fdc3400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc3e000640 1 -- 172.21.15.175:0/1572596409 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc34017070 con 0x7fdc4415a900 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc3e000640 1 -- 172.21.15.175:0/1572596409 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc34005cf0 con 0x7fdc4415a900 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc3e000640 1 -- 172.21.15.175:0/1572596409 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc340072f0 con 0x7fdc4415a900 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc4c800640 1 -- 172.21.15.175:0/1572596409 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4415dad0 con 0x7fdc4415a900 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.403+0000 7fdc4c800640 1 -- 172.21.15.175:0/1572596409 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4413c130 con 0x7fdc4415a900 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.407+0000 7fdc4c800640 1 -- 172.21.15.175:0/1572596409 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc44151300 con 0x7fdc4415a900 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.407+0000 7fdc3e000640 1 -- 172.21.15.175:0/1572596409 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdc3401a070 con 0x7fdc4415a900 2024-04-25T09:09:49.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.407+0000 7fdc3e000640 1 --2- 172.21.15.175:0/1572596409 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdc28066f60 0x7fdc28069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.407+0000 7fdc3e000640 1 -- 172.21.15.175:0/1572596409 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fdc34084550 con 0x7fdc4415a900 2024-04-25T09:09:49.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.407+0000 7fdc49e00640 1 --2- 172.21.15.175:0/1572596409 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdc28066f60 0x7fdc28069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.407+0000 7fdc49e00640 1 --2- 172.21.15.175:0/1572596409 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdc28066f60 0x7fdc28069420 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdc380af000 tx=0x7fdc38008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.411+0000 7fdc3e000640 1 -- 172.21.15.175:0/1572596409 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdc44151300 con 0x7fdc4415a900 2024-04-25T09:09:49.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.595+0000 7fdc4c800640 1 -- 172.21.15.175:0/1572596409 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc44074a60 con 0x7fdc4415a900 2024-04-25T09:09:49.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.595+0000 7fdc3e000640 1 -- 172.21.15.175:0/1572596409 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4948 (secure 0 0 0) 0x7fdc34055430 con 0x7fdc4415a900 2024-04-25T09:09:49.586 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:09:49.586 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":51,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2493316948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2493316948},{"type":"v1","addr":"172.21.15.175:6837","nonce":2493316948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3408529232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3408529232},{"type":"v1","addr":"172.21.15.177:6834","nonce":3408529232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/46829775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":46829775},{"type":"v1","addr":"172.21.15.177:6835","nonce":46829775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:08:17.378890+0000","modified":"2024-04-25T09:09:15.457110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6513":{"gid":6513,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":19,"addr":"172.21.15.175:6836/2714482688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2714482688},{"type":"v1","addr":"172.21.15.175:6836","nonce":2714482688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:09:49.587 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 51 2024-04-25T09:09:49.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.599+0000 7fdc4c800640 1 -- 172.21.15.175:0/1572596409 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdc28066f60 msgr2=0x7fdc28069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.599+0000 7fdc4c800640 1 --2- 172.21.15.175:0/1572596409 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdc28066f60 0x7fdc28069420 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fdc380af000 tx=0x7fdc38008040 comp rx=0 tx=0).stop 2024-04-25T09:09:49.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.599+0000 7fdc4c800640 1 -- 172.21.15.175:0/1572596409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc4415a900 msgr2=0x7fdc441509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.599+0000 7fdc4c800640 1 --2- 172.21.15.175:0/1572596409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc4415a900 0x7fdc441509b0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fdc3400c430 tx=0x7fdc3400c8f0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.599+0000 7fdc4c800640 1 -- 172.21.15.175:0/1572596409 shutdown_connections 2024-04-25T09:09:49.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.599+0000 7fdc4c800640 1 --2- 172.21.15.175:0/1572596409 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdc28066f60 0x7fdc28069420 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.599+0000 7fdc4c800640 1 --2- 172.21.15.175:0/1572596409 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc44150ef0 0x7fdc4415cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.599+0000 7fdc4c800640 1 --2- 172.21.15.175:0/1572596409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc4415a900 0x7fdc441509b0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.599+0000 7fdc4c800640 1 --2- 172.21.15.175:0/1572596409 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc440cf560 0x7fdc4413bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.599+0000 7fdc4c800640 1 -- 172.21.15.175:0/1572596409 >> 172.21.15.175:0/1572596409 conn(0x7fdc440cd520 msgr2=0x7fdc4406ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:49.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.599+0000 7fdc4c800640 1 -- 172.21.15.175:0/1572596409 shutdown_connections 2024-04-25T09:09:49.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.599+0000 7fdc4c800640 1 -- 172.21.15.175:0/1572596409 wait complete. 2024-04-25T09:09:49.608 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:49.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.751+0000 7f4836800640 1 Processor -- start 2024-04-25T09:09:49.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.751+0000 7f4836800640 1 -- start start 2024-04-25T09:09:49.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.755+0000 7f4836800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f483015dab0 0x7f4830161490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.755+0000 7f4836800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f48300b1ea0 0x7f48300cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.755+0000 7f4836800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f48300b2300 0x7f48300cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.755+0000 7f4836800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48300b1a10 con 0x7f48300b1ea0 2024-04-25T09:09:49.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.755+0000 7f4836800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4830161e30 con 0x7f48300b2300 2024-04-25T09:09:49.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.755+0000 7f4836800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4830162110 con 0x7f483015dab0 2024-04-25T09:09:49.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.755+0000 7f4834a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f48300b1ea0 0x7f48300cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.755+0000 7f4834a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f48300b1ea0 0x7f48300cfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34148/0 (socket says 172.21.15.175:34148) 2024-04-25T09:09:49.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.755+0000 7f4834a00640 1 -- 172.21.15.175:0/2095183994 learned_addr learned my addr 172.21.15.175:0/2095183994 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:49.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.755+0000 7f4835e00640 1 --2- 172.21.15.175:0/2095183994 >> v2:172.21.15.177:3300/0 conn(0x7f48300b2300 0x7f48300cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.755+0000 7f4835400640 1 --2- 172.21.15.175:0/2095183994 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f483015dab0 0x7f4830161490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.755+0000 7f4834a00640 1 -- 172.21.15.175:0/2095183994 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f483015dab0 msgr2=0x7f4830161490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:49.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.755+0000 7f4834a00640 1 --2- 172.21.15.175:0/2095183994 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f483015dab0 0x7f4830161490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.755+0000 7f4834a00640 1 -- 172.21.15.175:0/2095183994 >> v2:172.21.15.177:3300/0 conn(0x7f48300b2300 msgr2=0x7f48300cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:49.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.755+0000 7f4834a00640 1 --2- 172.21.15.175:0/2095183994 >> v2:172.21.15.177:3300/0 conn(0x7f48300b2300 0x7f48300cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.755+0000 7f4834a00640 1 -- 172.21.15.175:0/2095183994 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48300b16a0 con 0x7f48300b1ea0 2024-04-25T09:09:49.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.759+0000 7f4834a00640 1 --2- 172.21.15.175:0/2095183994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48300b1ea0 0x7f48300cfa00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f48300674e0 tx=0x7f481c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d126933d3296b19 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.759+0000 7f482fe00640 1 -- 172.21.15.175:0/2095183994 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c0aa600 con 0x7f48300b1ea0 2024-04-25T09:09:49.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.759+0000 7f482fe00640 1 -- 172.21.15.175:0/2095183994 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f481c0af070 con 0x7f48300b1ea0 2024-04-25T09:09:49.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.759+0000 7f482fe00640 1 -- 172.21.15.175:0/2095183994 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c0aa9c0 con 0x7f48300b1ea0 2024-04-25T09:09:49.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.759+0000 7f4836800640 1 -- 172.21.15.175:0/2095183994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48300b1ea0 msgr2=0x7f48300cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.759+0000 7f4836800640 1 --2- 172.21.15.175:0/2095183994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48300b1ea0 0x7f48300cfa00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f48300674e0 tx=0x7f481c01c4c0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.759+0000 7f4836800640 1 -- 172.21.15.175:0/2095183994 shutdown_connections 2024-04-25T09:09:49.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.759+0000 7f4836800640 1 --2- 172.21.15.175:0/2095183994 >> v2:172.21.15.177:3300/0 conn(0x7f48300b2300 0x7f48300cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.759+0000 7f4836800640 1 --2- 172.21.15.175:0/2095183994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48300b1ea0 0x7f48300cfa00 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.759+0000 7f4836800640 1 --2- 172.21.15.175:0/2095183994 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f483015dab0 0x7f4830161490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.759+0000 7f4836800640 1 -- 172.21.15.175:0/2095183994 >> 172.21.15.175:0/2095183994 conn(0x7f483008afe0 msgr2=0x7f483008b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:49.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.759+0000 7f4836800640 1 -- 172.21.15.175:0/2095183994 shutdown_connections 2024-04-25T09:09:49.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.759+0000 7f4836800640 1 -- 172.21.15.175:0/2095183994 wait complete. 2024-04-25T09:09:49.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.759+0000 7f4836800640 1 Processor -- start 2024-04-25T09:09:49.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.759+0000 7f4836800640 1 -- start start 2024-04-25T09:09:49.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4836800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48300b1ea0 0x7f483014e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4836800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48300b2300 0x7f4830153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4836800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f483015dab0 0x7f483015a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4836800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483006cec0 con 0x7f48300b2300 2024-04-25T09:09:49.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4836800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483006cd40 con 0x7f483015dab0 2024-04-25T09:09:49.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4836800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483006d040 con 0x7f48300b1ea0 2024-04-25T09:09:49.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4834a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48300b2300 0x7f4830153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4834a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48300b2300 0x7f4830153c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34160/0 (socket says 172.21.15.175:34160) 2024-04-25T09:09:49.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4834a00640 1 -- 172.21.15.175:0/715189197 learned_addr learned my addr 172.21.15.175:0/715189197 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:49.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4835e00640 1 --2- 172.21.15.175:0/715189197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f483015dab0 0x7f483015a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4835400640 1 --2- 172.21.15.175:0/715189197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48300b1ea0 0x7f483014e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4834a00640 1 -- 172.21.15.175:0/715189197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48300b1ea0 msgr2=0x7f483014e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4834a00640 1 --2- 172.21.15.175:0/715189197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48300b1ea0 0x7f483014e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4834a00640 1 -- 172.21.15.175:0/715189197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f483015dab0 msgr2=0x7f483015a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4834a00640 1 --2- 172.21.15.175:0/715189197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f483015dab0 0x7f483015a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4834a00640 1 -- 172.21.15.175:0/715189197 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4830154680 con 0x7f48300b2300 2024-04-25T09:09:49.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4834a00640 1 --2- 172.21.15.175:0/715189197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48300b2300 0x7f4830153c00 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f481c01abd0 tx=0x7f481c01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f482d600640 1 -- 172.21.15.175:0/715189197 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c0bd3f0 con 0x7f48300b2300 2024-04-25T09:09:49.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f482d600640 1 -- 172.21.15.175:0/715189197 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4830161be0 con 0x7f48300b2300 2024-04-25T09:09:49.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f482d600640 1 -- 172.21.15.175:0/715189197 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f481c0bd7d0 con 0x7f48300b2300 2024-04-25T09:09:49.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4836800640 1 -- 172.21.15.175:0/715189197 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4830157870 con 0x7f48300b2300 2024-04-25T09:09:49.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4836800640 1 -- 172.21.15.175:0/715189197 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4830157e30 con 0x7f48300b2300 2024-04-25T09:09:49.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f4836800640 1 -- 172.21.15.175:0/715189197 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4830074a60 con 0x7f48300b2300 2024-04-25T09:09:49.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.763+0000 7f482d600640 1 -- 172.21.15.175:0/715189197 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f481c0a9070 con 0x7f48300b2300 2024-04-25T09:09:49.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.767+0000 7f482d600640 1 --2- 172.21.15.175:0/715189197 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4810066f60 0x7f4810069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.767+0000 7f482d600640 1 -- 172.21.15.175:0/715189197 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f481c11eca0 con 0x7f48300b2300 2024-04-25T09:09:49.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.767+0000 7f4835400640 1 --2- 172.21.15.175:0/715189197 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4810066f60 0x7f4810069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.767+0000 7f4835400640 1 --2- 172.21.15.175:0/715189197 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4810066f60 0x7f4810069420 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f48300d0390 tx=0x7f482400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.771+0000 7f482d600640 1 -- 172.21.15.175:0/715189197 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f481c016110 con 0x7f48300b2300 2024-04-25T09:09:49.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.927+0000 7f4836800640 1 -- 172.21.15.175:0/715189197 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48300b2a70 con 0x7f48300b2300 2024-04-25T09:09:49.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.927+0000 7f482d600640 1 -- 172.21.15.175:0/715189197 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16933 (secure 0 0 0) 0x7f481c0ef660 con 0x7f48300b2300 2024-04-25T09:09:49.918 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:09:49.918 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":72,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:08:52.921396+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:08:15.743582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T09:08:16.375168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.17","mappings":[{"from":6,"to":0}]},{"pgid":"11.2e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.177:6835/1709110121":"2024-04-26T09:08:32.433027+0000","172.21.15.177:6833/1709110121":"2024-04-26T09:08:32.433027+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:49.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.931+0000 7f4836800640 1 -- 172.21.15.175:0/715189197 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4810066f60 msgr2=0x7f4810069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.931+0000 7f4836800640 1 --2- 172.21.15.175:0/715189197 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4810066f60 0x7f4810069420 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f48300d0390 tx=0x7f482400b040 comp rx=0 tx=0).stop 2024-04-25T09:09:49.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.931+0000 7f4836800640 1 -- 172.21.15.175:0/715189197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48300b2300 msgr2=0x7f4830153c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.931+0000 7f4836800640 1 --2- 172.21.15.175:0/715189197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48300b2300 0x7f4830153c00 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f481c01abd0 tx=0x7f481c01ad60 comp rx=0 tx=0).stop 2024-04-25T09:09:49.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.931+0000 7f4836800640 1 -- 172.21.15.175:0/715189197 shutdown_connections 2024-04-25T09:09:49.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.931+0000 7f4836800640 1 --2- 172.21.15.175:0/715189197 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4810066f60 0x7f4810069420 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.931+0000 7f4836800640 1 --2- 172.21.15.175:0/715189197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f483015dab0 0x7f483015a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.931+0000 7f4836800640 1 --2- 172.21.15.175:0/715189197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48300b2300 0x7f4830153c00 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.931+0000 7f4836800640 1 --2- 172.21.15.175:0/715189197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48300b1ea0 0x7f483014e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.931+0000 7f4836800640 1 -- 172.21.15.175:0/715189197 >> 172.21.15.175:0/715189197 conn(0x7f483008afe0 msgr2=0x7f4830161260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:49.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.931+0000 7f4836800640 1 -- 172.21.15.175:0/715189197 shutdown_connections 2024-04-25T09:09:49.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:49.931+0000 7f4836800640 1 -- 172.21.15.175:0/715189197 wait complete. 2024-04-25T09:09:49.939 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:09:49.940 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:50.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.087+0000 7f8e1d200640 1 Processor -- start 2024-04-25T09:09:50.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.087+0000 7f8e1d200640 1 -- start start 2024-04-25T09:09:50.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.087+0000 7f8e1d200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8e181453a0 0x7f8e1815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.087+0000 7f8e1d200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8e1815c410 0x7f8e180cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.087+0000 7f8e1d200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e1815c8a0 con 0x7f8e18144fc0 2024-04-25T09:09:50.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.087+0000 7f8e1d200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1815cd00 con 0x7f8e1815c410 2024-04-25T09:09:50.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.087+0000 7f8e1d200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e180ce660 con 0x7f8e181453a0 2024-04-25T09:09:50.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.087+0000 7f8e16800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8e1815c410 0x7f8e180cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.087+0000 7f8e16800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8e1815c410 0x7f8e180cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34166/0 (socket says 172.21.15.175:34166) 2024-04-25T09:09:50.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.087+0000 7f8e16800640 1 -- 172.21.15.175:0/954003596 learned_addr learned my addr 172.21.15.175:0/954003596 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:50.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.087+0000 7f8e15400640 1 --2- 172.21.15.175:0/954003596 >> v2:172.21.15.177:3300/0 conn(0x7f8e181453a0 0x7f8e1815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.087+0000 7f8e16800640 1 -- 172.21.15.175:0/954003596 >> v2:172.21.15.177:3300/0 conn(0x7f8e181453a0 msgr2=0x7f8e1815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:50.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.087+0000 7f8e16800640 1 --2- 172.21.15.175:0/954003596 >> v2:172.21.15.177:3300/0 conn(0x7f8e181453a0 0x7f8e1815bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.087+0000 7f8e16800640 1 -- 172.21.15.175:0/954003596 >> v1:172.21.15.177:6789/0 conn(0x7f8e18144fc0 legacy=0x7f8e180cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:50.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.087+0000 7f8e16800640 1 -- 172.21.15.175:0/954003596 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e180cc930 con 0x7f8e1815c410 2024-04-25T09:09:50.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.087+0000 7f8e15400640 1 --2- 172.21.15.175:0/954003596 >> v2:172.21.15.177:3300/0 conn(0x7f8e181453a0 0x7f8e1815bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:50.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.091+0000 7f8e16800640 1 --2- 172.21.15.175:0/954003596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e1815c410 0x7f8e180cee20 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009e50 tx=0x7f8e1001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab524e7aa41292d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.091+0000 7f8e14a00640 1 -- 172.21.15.175:0/954003596 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e100a5760 con 0x7f8e1815c410 2024-04-25T09:09:50.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.091+0000 7f8e14a00640 1 -- 172.21.15.175:0/954003596 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e100a5900 con 0x7f8e1815c410 2024-04-25T09:09:50.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.091+0000 7f8e14a00640 1 -- 172.21.15.175:0/954003596 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e100a5cd0 con 0x7f8e1815c410 2024-04-25T09:09:50.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.091+0000 7f8e1d200640 1 -- 172.21.15.175:0/954003596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e1815c410 msgr2=0x7f8e180cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.091+0000 7f8e1d200640 1 --2- 172.21.15.175:0/954003596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e1815c410 0x7f8e180cee20 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009e50 tx=0x7f8e1001c9b0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.091+0000 7f8e1d200640 1 -- 172.21.15.175:0/954003596 shutdown_connections 2024-04-25T09:09:50.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.091+0000 7f8e1d200640 1 --2- 172.21.15.175:0/954003596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e1815c410 0x7f8e180cee20 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.091+0000 7f8e1d200640 1 --2- 172.21.15.175:0/954003596 >> v2:172.21.15.177:3300/0 conn(0x7f8e181453a0 0x7f8e1815bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.091+0000 7f8e1d200640 1 -- 172.21.15.175:0/954003596 >> 172.21.15.175:0/954003596 conn(0x7f8e18067150 msgr2=0x7f8e1806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:50.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.091+0000 7f8e1d200640 1 -- 172.21.15.175:0/954003596 shutdown_connections 2024-04-25T09:09:50.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.091+0000 7f8e1d200640 1 -- 172.21.15.175:0/954003596 wait complete. 2024-04-25T09:09:50.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e1d200640 1 Processor -- start 2024-04-25T09:09:50.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e1d200640 1 -- start start 2024-04-25T09:09:50.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e1d200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e181453a0 0x7f8e180b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e1d200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e1815c410 0x7f8e1815b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e1d200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8e180af1d0 0x7f8e1815a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e1d200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180cc580 con 0x7f8e181453a0 2024-04-25T09:09:50.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e1d200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180cfb70 con 0x7f8e1815c410 2024-04-25T09:09:50.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e1d200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e180b4660 con 0x7f8e180af1d0 2024-04-25T09:09:50.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e15e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e181453a0 0x7f8e180b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e15e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e181453a0 0x7f8e180b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34176/0 (socket says 172.21.15.175:34176) 2024-04-25T09:09:50.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e15e00640 1 -- 172.21.15.175:0/2093253439 learned_addr learned my addr 172.21.15.175:0/2093253439 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:50.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e15400640 1 --2- 172.21.15.175:0/2093253439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e1815c410 0x7f8e1815b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e16800640 1 --2- 172.21.15.175:0/2093253439 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8e180af1d0 0x7f8e1815a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e15e00640 1 -- 172.21.15.175:0/2093253439 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8e180af1d0 msgr2=0x7f8e1815a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e15e00640 1 --2- 172.21.15.175:0/2093253439 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8e180af1d0 0x7f8e1815a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e15e00640 1 -- 172.21.15.175:0/2093253439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e1815c410 msgr2=0x7f8e1815b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e15e00640 1 --2- 172.21.15.175:0/2093253439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e1815c410 0x7f8e1815b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e15e00640 1 -- 172.21.15.175:0/2093253439 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e180b4380 con 0x7f8e181453a0 2024-04-25T09:09:50.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e15e00640 1 --2- 172.21.15.175:0/2093253439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e181453a0 0x7f8e180b3c80 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800c450 tx=0x7f8e0800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e0e000640 1 -- 172.21.15.175:0/2093253439 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08011790 con 0x7f8e181453a0 2024-04-25T09:09:50.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e0e000640 1 -- 172.21.15.175:0/2093253439 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e08017070 con 0x7f8e181453a0 2024-04-25T09:09:50.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e0e000640 1 -- 172.21.15.175:0/2093253439 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08011b90 con 0x7f8e181453a0 2024-04-25T09:09:50.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e1d200640 1 -- 172.21.15.175:0/2093253439 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e18164a20 con 0x7f8e181453a0 2024-04-25T09:09:50.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e1d200640 1 -- 172.21.15.175:0/2093253439 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e18164fe0 con 0x7f8e181453a0 2024-04-25T09:09:50.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.095+0000 7f8e1d200640 1 -- 172.21.15.175:0/2093253439 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e18074a60 con 0x7f8e181453a0 2024-04-25T09:09:50.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.099+0000 7f8e0e000640 1 -- 172.21.15.175:0/2093253439 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8e08011d30 con 0x7f8e181453a0 2024-04-25T09:09:50.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.099+0000 7f8e0e000640 1 --2- 172.21.15.175:0/2093253439 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8df8066f60 0x7f8df8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.099+0000 7f8e0e000640 1 -- 172.21.15.175:0/2093253439 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8e08084f10 con 0x7f8e181453a0 2024-04-25T09:09:50.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.099+0000 7f8e15400640 1 --2- 172.21.15.175:0/2093253439 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8df8066f60 0x7f8df8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.099+0000 7f8e15400640 1 --2- 172.21.15.175:0/2093253439 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8df8066f60 0x7f8df8069420 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8e1806eca0 tx=0x7f8e04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.103+0000 7f8e0e000640 1 -- 172.21.15.175:0/2093253439 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8e08055df0 con 0x7f8e181453a0 2024-04-25T09:09:50.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.287+0000 7f8e1d200640 1 -- 172.21.15.175:0/2093253439 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e1815aeb0 con 0x7f8e181453a0 2024-04-25T09:09:50.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.287+0000 7f8e0e000640 1 -- 172.21.15.175:0/2093253439 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f8e080556f0 con 0x7f8e181453a0 2024-04-25T09:09:50.278 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:09:50.279 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":51,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2493316948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2493316948},{"type":"v1","addr":"172.21.15.175:6837","nonce":2493316948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3408529232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3408529232},{"type":"v1","addr":"172.21.15.177:6834","nonce":3408529232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/46829775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":46829775},{"type":"v1","addr":"172.21.15.177:6835","nonce":46829775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:08:17.378890+0000","modified":"2024-04-25T09:09:15.457110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6513":{"gid":6513,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":19,"addr":"172.21.15.175:6836/2714482688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2714482688},{"type":"v1","addr":"172.21.15.175:6836","nonce":2714482688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:09:50.279 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 51 2024-04-25T09:09:50.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.291+0000 7f8e1d200640 1 -- 172.21.15.175:0/2093253439 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8df8066f60 msgr2=0x7f8df8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.291+0000 7f8e1d200640 1 --2- 172.21.15.175:0/2093253439 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8df8066f60 0x7f8df8069420 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8e1806eca0 tx=0x7f8e04008040 comp rx=0 tx=0).stop 2024-04-25T09:09:50.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.291+0000 7f8e1d200640 1 -- 172.21.15.175:0/2093253439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e181453a0 msgr2=0x7f8e180b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.291+0000 7f8e1d200640 1 --2- 172.21.15.175:0/2093253439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e181453a0 0x7f8e180b3c80 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800c450 tx=0x7f8e0800c910 comp rx=0 tx=0).stop 2024-04-25T09:09:50.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.291+0000 7f8e1d200640 1 -- 172.21.15.175:0/2093253439 shutdown_connections 2024-04-25T09:09:50.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.291+0000 7f8e1d200640 1 --2- 172.21.15.175:0/2093253439 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8df8066f60 0x7f8df8069420 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.291+0000 7f8e1d200640 1 --2- 172.21.15.175:0/2093253439 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8e180af1d0 0x7f8e1815a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.291+0000 7f8e1d200640 1 --2- 172.21.15.175:0/2093253439 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8e1815c410 0x7f8e1815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.291+0000 7f8e1d200640 1 --2- 172.21.15.175:0/2093253439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e181453a0 0x7f8e180b3c80 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.291+0000 7f8e1d200640 1 -- 172.21.15.175:0/2093253439 >> 172.21.15.175:0/2093253439 conn(0x7f8e18144fc0 msgr2=0x7f8e1815dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:50.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.291+0000 7f8e1d200640 1 -- 172.21.15.175:0/2093253439 shutdown_connections 2024-04-25T09:09:50.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.291+0000 7f8e1d200640 1 -- 172.21.15.175:0/2093253439 wait complete. 2024-04-25T09:09:50.300 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:50.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.447+0000 7fb9c7e00640 1 Processor -- start 2024-04-25T09:09:50.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.447+0000 7fb9c7e00640 1 -- start start 2024-04-25T09:09:50.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.447+0000 7fb9c7e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb9c0144fc0 0x7fb9c00cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.447+0000 7fb9c7e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c015c5e0 0x7fb9c00cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.447+0000 7fb9c7e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c015cd00 con 0x7fb9c01453a0 2024-04-25T09:09:50.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.447+0000 7fb9c7e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c00ce660 con 0x7fb9c0144fc0 2024-04-25T09:09:50.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.447+0000 7fb9c7e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c00cc930 con 0x7fb9c015c5e0 2024-04-25T09:09:50.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.447+0000 7fb9c5400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb9c0144fc0 0x7fb9c00cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.447+0000 7fb9c5400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb9c0144fc0 0x7fb9c00cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34190/0 (socket says 172.21.15.175:34190) 2024-04-25T09:09:50.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.447+0000 7fb9c5400640 1 -- 172.21.15.175:0/1348900752 learned_addr learned my addr 172.21.15.175:0/1348900752 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:50.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.447+0000 7fb9c5e00640 1 --2- 172.21.15.175:0/1348900752 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c015c5e0 0x7fb9c00cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.447+0000 7fb9c5400640 1 -- 172.21.15.175:0/1348900752 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c015c5e0 msgr2=0x7fb9c00cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:50.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.447+0000 7fb9c5400640 1 --2- 172.21.15.175:0/1348900752 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c015c5e0 0x7fb9c00cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.447+0000 7fb9c5400640 1 -- 172.21.15.175:0/1348900752 >> v1:172.21.15.177:6789/0 conn(0x7fb9c01453a0 legacy=0x7fb9c015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.447+0000 7fb9c5400640 1 -- 172.21.15.175:0/1348900752 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c00ccc10 con 0x7fb9c0144fc0 2024-04-25T09:09:50.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.451+0000 7fb9c5400640 1 --2- 172.21.15.175:0/1348900752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c0144fc0 0x7fb9c00cbe70 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40098a0 tx=0x7fb9b401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82006389c70e7323 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.451+0000 7fb9bfe00640 1 -- 172.21.15.175:0/1348900752 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40ab430 con 0x7fb9c0144fc0 2024-04-25T09:09:50.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.451+0000 7fb9bfe00640 1 -- 172.21.15.175:0/1348900752 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b40b0070 con 0x7fb9c0144fc0 2024-04-25T09:09:50.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.451+0000 7fb9bfe00640 1 -- 172.21.15.175:0/1348900752 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40ab7f0 con 0x7fb9c0144fc0 2024-04-25T09:09:50.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.451+0000 7fb9c7e00640 1 -- 172.21.15.175:0/1348900752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c0144fc0 msgr2=0x7fb9c00cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.451+0000 7fb9c7e00640 1 --2- 172.21.15.175:0/1348900752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c0144fc0 0x7fb9c00cbe70 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40098a0 tx=0x7fb9b401c540 comp rx=0 tx=0).stop 2024-04-25T09:09:50.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.451+0000 7fb9c7e00640 1 -- 172.21.15.175:0/1348900752 shutdown_connections 2024-04-25T09:09:50.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.451+0000 7fb9c7e00640 1 --2- 172.21.15.175:0/1348900752 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c015c5e0 0x7fb9c00cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.451+0000 7fb9c7e00640 1 --2- 172.21.15.175:0/1348900752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c0144fc0 0x7fb9c00cbe70 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.451+0000 7fb9c7e00640 1 -- 172.21.15.175:0/1348900752 >> 172.21.15.175:0/1348900752 conn(0x7fb9c0067150 msgr2=0x7fb9c006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:50.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.451+0000 7fb9c7e00640 1 -- 172.21.15.175:0/1348900752 shutdown_connections 2024-04-25T09:09:50.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.451+0000 7fb9c7e00640 1 -- 172.21.15.175:0/1348900752 wait complete. 2024-04-25T09:09:50.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c7e00640 1 Processor -- start 2024-04-25T09:09:50.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c7e00640 1 -- start start 2024-04-25T09:09:50.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c01453a0 0x7fb9c006e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c7e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c015c5e0 0x7fb9c0143450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c0143990 0x7fb9c01392e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c7e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c00cff40 con 0x7fb9c01453a0 2024-04-25T09:09:50.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c7e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c00cfdc0 con 0x7fb9c0143990 2024-04-25T09:09:50.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c7e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c01685f0 con 0x7fb9c015c5e0 2024-04-25T09:09:50.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c5400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c01453a0 0x7fb9c006e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c5400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c01453a0 0x7fb9c006e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34206/0 (socket says 172.21.15.175:34206) 2024-04-25T09:09:50.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c5400640 1 -- 172.21.15.175:0/1649330555 learned_addr learned my addr 172.21.15.175:0/1649330555 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:50.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c4a00640 1 --2- 172.21.15.175:0/1649330555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c015c5e0 0x7fb9c0143450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c5e00640 1 --2- 172.21.15.175:0/1649330555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c0143990 0x7fb9c01392e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c5400640 1 -- 172.21.15.175:0/1649330555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c015c5e0 msgr2=0x7fb9c0143450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c5400640 1 --2- 172.21.15.175:0/1649330555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c015c5e0 0x7fb9c0143450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c5400640 1 -- 172.21.15.175:0/1649330555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c0143990 msgr2=0x7fb9c01392e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c5400640 1 --2- 172.21.15.175:0/1649330555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c0143990 0x7fb9c01392e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c5400640 1 -- 172.21.15.175:0/1649330555 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c0155580 con 0x7fb9c01453a0 2024-04-25T09:09:50.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c5e00640 1 --2- 172.21.15.175:0/1649330555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c0143990 0x7fb9c01392e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:50.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c5400640 1 --2- 172.21.15.175:0/1649330555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c01453a0 0x7fb9c006e380 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40ad040 tx=0x7fb9b40192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9bd600640 1 -- 172.21.15.175:0/1649330555 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40ba070 con 0x7fb9c01453a0 2024-04-25T09:09:50.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9bd600640 1 -- 172.21.15.175:0/1649330555 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b40abe40 con 0x7fb9c01453a0 2024-04-25T09:09:50.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9bd600640 1 -- 172.21.15.175:0/1649330555 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40b4640 con 0x7fb9c01453a0 2024-04-25T09:09:50.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c7e00640 1 -- 172.21.15.175:0/1649330555 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c0155860 con 0x7fb9c01453a0 2024-04-25T09:09:50.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c7e00640 1 -- 172.21.15.175:0/1649330555 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c0155e20 con 0x7fb9c01453a0 2024-04-25T09:09:50.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.455+0000 7fb9c7e00640 1 -- 172.21.15.175:0/1649330555 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c0074a60 con 0x7fb9c01453a0 2024-04-25T09:09:50.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.459+0000 7fb9bd600640 1 -- 172.21.15.175:0/1649330555 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb9b40bd070 con 0x7fb9c01453a0 2024-04-25T09:09:50.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.459+0000 7fb9bd600640 1 --2- 172.21.15.175:0/1649330555 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb9a0066f60 0x7fb9a0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.459+0000 7fb9bd600640 1 -- 172.21.15.175:0/1649330555 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fb9b411ee90 con 0x7fb9c01453a0 2024-04-25T09:09:50.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.459+0000 7fb9c4a00640 1 --2- 172.21.15.175:0/1649330555 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb9a0066f60 0x7fb9a0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.459+0000 7fb9c4a00640 1 --2- 172.21.15.175:0/1649330555 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb9a0066f60 0x7fb9a0069420 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0159b00 tx=0x7fb9ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.463+0000 7fb9bd600640 1 -- 172.21.15.175:0/1649330555 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb9b4016130 con 0x7fb9c01453a0 2024-04-25T09:09:50.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.647+0000 7fb9c7e00640 1 -- 172.21.15.175:0/1649330555 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9c013eb50 con 0x7fb9c01453a0 2024-04-25T09:09:50.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.647+0000 7fb9bd600640 1 -- 172.21.15.175:0/1649330555 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4948 (secure 0 0 0) 0x7fb9b40ef7b0 con 0x7fb9c01453a0 2024-04-25T09:09:50.638 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:09:50.638 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":51,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2493316948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2493316948},{"type":"v1","addr":"172.21.15.175:6837","nonce":2493316948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3408529232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3408529232},{"type":"v1","addr":"172.21.15.177:6834","nonce":3408529232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/46829775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":46829775},{"type":"v1","addr":"172.21.15.177:6835","nonce":46829775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:08:17.378890+0000","modified":"2024-04-25T09:09:15.457110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6513},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6513":{"gid":6513,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":19,"addr":"172.21.15.175:6836/2714482688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2714482688},{"type":"v1","addr":"172.21.15.175:6836","nonce":2714482688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:09:50.638 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 51 2024-04-25T09:09:50.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.651+0000 7fb9c7e00640 1 -- 172.21.15.175:0/1649330555 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb9a0066f60 msgr2=0x7fb9a0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.651+0000 7fb9c7e00640 1 --2- 172.21.15.175:0/1649330555 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb9a0066f60 0x7fb9a0069420 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0159b00 tx=0x7fb9ac009040 comp rx=0 tx=0).stop 2024-04-25T09:09:50.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.651+0000 7fb9c7e00640 1 -- 172.21.15.175:0/1649330555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c01453a0 msgr2=0x7fb9c006e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.651+0000 7fb9c7e00640 1 --2- 172.21.15.175:0/1649330555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c01453a0 0x7fb9c006e380 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40ad040 tx=0x7fb9b40192e0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.651+0000 7fb9c7e00640 1 -- 172.21.15.175:0/1649330555 shutdown_connections 2024-04-25T09:09:50.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.651+0000 7fb9c7e00640 1 --2- 172.21.15.175:0/1649330555 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb9a0066f60 0x7fb9a0069420 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.651+0000 7fb9c7e00640 1 --2- 172.21.15.175:0/1649330555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9c0143990 0x7fb9c01392e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.651+0000 7fb9c7e00640 1 --2- 172.21.15.175:0/1649330555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9c015c5e0 0x7fb9c0143450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.651+0000 7fb9c7e00640 1 --2- 172.21.15.175:0/1649330555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9c01453a0 0x7fb9c006e380 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.651+0000 7fb9c7e00640 1 -- 172.21.15.175:0/1649330555 >> 172.21.15.175:0/1649330555 conn(0x7fb9c0144fc0 msgr2=0x7fb9c015de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:50.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.651+0000 7fb9c7e00640 1 -- 172.21.15.175:0/1649330555 shutdown_connections 2024-04-25T09:09:50.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.651+0000 7fb9c7e00640 1 -- 172.21.15.175:0/1649330555 wait complete. 2024-04-25T09:09:50.659 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:50.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.803+0000 7f3b6bc00640 1 Processor -- start 2024-04-25T09:09:50.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.803+0000 7f3b6bc00640 1 -- start start 2024-04-25T09:09:50.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.807+0000 7f3b6bc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b64144fc0 0x7f3b640cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.807+0000 7f3b6bc00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3b6415c5e0 0x7f3b640cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.807+0000 7f3b6bc00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6415cd00 con 0x7f3b641453a0 2024-04-25T09:09:50.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.807+0000 7f3b6bc00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b640ce660 con 0x7f3b6415c5e0 2024-04-25T09:09:50.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.807+0000 7f3b6bc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b640cc930 con 0x7f3b64144fc0 2024-04-25T09:09:50.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.807+0000 7f3b63e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f3b641453a0 0x7f3b6415bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53330/0 (socket says 172.21.15.175:53330) 2024-04-25T09:09:50.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.807+0000 7f3b63e00640 1 -- 172.21.15.175:0/2948524766 learned_addr learned my addr 172.21.15.175:0/2948524766 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:50.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.807+0000 7f3b69200640 1 --2- 172.21.15.175:0/2948524766 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b64144fc0 0x7f3b640cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.807+0000 7f3b69c00640 1 --2- 172.21.15.175:0/2948524766 >> v2:172.21.15.177:3300/0 conn(0x7f3b6415c5e0 0x7f3b640cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.807+0000 7f3b63400640 1 -- 172.21.15.175:0/2948524766 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373508140 0 0) 0x7f3b6415cd00 con 0x7f3b641453a0 2024-04-25T09:09:50.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.807+0000 7f3b63400640 1 -- 172.21.15.175:0/2948524766 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b48003530 con 0x7f3b641453a0 2024-04-25T09:09:50.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.807+0000 7f3b69200640 1 -- 172.21.15.175:0/2948524766 >> v2:172.21.15.177:3300/0 conn(0x7f3b6415c5e0 msgr2=0x7f3b640cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:50.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.807+0000 7f3b69200640 1 --2- 172.21.15.175:0/2948524766 >> v2:172.21.15.177:3300/0 conn(0x7f3b6415c5e0 0x7f3b640cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.807+0000 7f3b69200640 1 -- 172.21.15.175:0/2948524766 >> v1:172.21.15.175:6789/0 conn(0x7f3b641453a0 legacy=0x7f3b6415bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.807+0000 7f3b63400640 1 -- 172.21.15.175:0/2948524766 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2268154892 0 0) 0x7f3b48003530 con 0x7f3b641453a0 2024-04-25T09:09:50.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.807+0000 7f3b69200640 1 -- 172.21.15.175:0/2948524766 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b640ccc10 con 0x7f3b64144fc0 2024-04-25T09:09:50.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.811+0000 7f3b69200640 1 --2- 172.21.15.175:0/2948524766 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b64144fc0 0x7f3b640cbe70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3b54009d90 tx=0x7f3b5401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edae0b8a443ab9d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.811+0000 7f3b63400640 1 -- 172.21.15.175:0/2948524766 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b540b2070 con 0x7f3b64144fc0 2024-04-25T09:09:50.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.811+0000 7f3b63400640 1 -- 172.21.15.175:0/2948524766 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b540a5920 con 0x7f3b64144fc0 2024-04-25T09:09:50.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.811+0000 7f3b63400640 1 -- 172.21.15.175:0/2948524766 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b540a5cd0 con 0x7f3b64144fc0 2024-04-25T09:09:50.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.811+0000 7f3b6bc00640 1 -- 172.21.15.175:0/2948524766 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b64144fc0 msgr2=0x7f3b640cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.811+0000 7f3b6bc00640 1 --2- 172.21.15.175:0/2948524766 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b64144fc0 0x7f3b640cbe70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3b54009d90 tx=0x7f3b5401c970 comp rx=0 tx=0).stop 2024-04-25T09:09:50.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.811+0000 7f3b6bc00640 1 -- 172.21.15.175:0/2948524766 shutdown_connections 2024-04-25T09:09:50.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.811+0000 7f3b6bc00640 1 --2- 172.21.15.175:0/2948524766 >> v2:172.21.15.177:3300/0 conn(0x7f3b6415c5e0 0x7f3b640cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.811+0000 7f3b6bc00640 1 --2- 172.21.15.175:0/2948524766 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b64144fc0 0x7f3b640cbe70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.811+0000 7f3b6bc00640 1 -- 172.21.15.175:0/2948524766 >> 172.21.15.175:0/2948524766 conn(0x7f3b64067150 msgr2=0x7f3b6406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:50.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.811+0000 7f3b6bc00640 1 -- 172.21.15.175:0/2948524766 shutdown_connections 2024-04-25T09:09:50.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.811+0000 7f3b6bc00640 1 -- 172.21.15.175:0/2948524766 wait complete. 2024-04-25T09:09:50.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.811+0000 7f3b6bc00640 1 Processor -- start 2024-04-25T09:09:50.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.811+0000 7f3b6bc00640 1 -- start start 2024-04-25T09:09:50.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b6bc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b641453a0 0x7f3b6415b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b6bc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6415c5e0 0x7f3b6413f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b6bc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b64159cb0 0x7f3b6415a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b6bc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b640cff40 con 0x7f3b641453a0 2024-04-25T09:09:50.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b6bc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b640cfdc0 con 0x7f3b6415c5e0 2024-04-25T09:09:50.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b6bc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b641685f0 con 0x7f3b64159cb0 2024-04-25T09:09:50.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b69200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b641453a0 0x7f3b6415b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b69200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b641453a0 0x7f3b6415b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34220/0 (socket says 172.21.15.175:34220) 2024-04-25T09:09:50.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b69200640 1 -- 172.21.15.175:0/1650603988 learned_addr learned my addr 172.21.15.175:0/1650603988 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:50.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b63e00640 1 --2- 172.21.15.175:0/1650603988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6415c5e0 0x7f3b6413f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b69c00640 1 --2- 172.21.15.175:0/1650603988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b64159cb0 0x7f3b6415a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b69200640 1 -- 172.21.15.175:0/1650603988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b64159cb0 msgr2=0x7f3b6415a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b69200640 1 --2- 172.21.15.175:0/1650603988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b64159cb0 0x7f3b6415a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b69200640 1 -- 172.21.15.175:0/1650603988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6415c5e0 msgr2=0x7f3b6413f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b69200640 1 --2- 172.21.15.175:0/1650603988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6415c5e0 0x7f3b6413f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b69200640 1 -- 172.21.15.175:0/1650603988 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6413fd80 con 0x7f3b641453a0 2024-04-25T09:09:50.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b63e00640 1 --2- 172.21.15.175:0/1650603988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6415c5e0 0x7f3b6413f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:50.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b69200640 1 --2- 172.21.15.175:0/1650603988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b641453a0 0x7f3b6415b1f0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f3b540b0040 tx=0x7f3b54019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b60c00640 1 -- 172.21.15.175:0/1650603988 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b540b2050 con 0x7f3b641453a0 2024-04-25T09:09:50.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b60c00640 1 -- 172.21.15.175:0/1650603988 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b540be070 con 0x7f3b641453a0 2024-04-25T09:09:50.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b60c00640 1 -- 172.21.15.175:0/1650603988 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b540ad850 con 0x7f3b641453a0 2024-04-25T09:09:50.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b6bc00640 1 -- 172.21.15.175:0/1650603988 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b64140060 con 0x7f3b641453a0 2024-04-25T09:09:50.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b6bc00640 1 -- 172.21.15.175:0/1650603988 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b64140620 con 0x7f3b641453a0 2024-04-25T09:09:50.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b6bc00640 1 -- 172.21.15.175:0/1650603988 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b64074a60 con 0x7f3b641453a0 2024-04-25T09:09:50.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.815+0000 7f3b60c00640 1 -- 172.21.15.175:0/1650603988 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3b540ad9f0 con 0x7f3b641453a0 2024-04-25T09:09:50.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.819+0000 7f3b60c00640 1 --2- 172.21.15.175:0/1650603988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3b44066f60 0x7f3b44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.819+0000 7f3b60c00640 1 -- 172.21.15.175:0/1650603988 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f3b541203b0 con 0x7f3b641453a0 2024-04-25T09:09:50.808 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.819+0000 7f3b63e00640 1 --2- 172.21.15.175:0/1650603988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3b44066f60 0x7f3b44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.808 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.819+0000 7f3b63e00640 1 --2- 172.21.15.175:0/1650603988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3b44066f60 0x7f3b44069420 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3b50007fd0 tx=0x7f3b50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.823+0000 7f3b60c00640 1 -- 172.21.15.175:0/1650603988 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3b54016560 con 0x7f3b641453a0 2024-04-25T09:09:50.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.979+0000 7f3b6bc00640 1 -- 172.21.15.175:0/1650603988 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b6415d0b0 con 0x7f3b641453a0 2024-04-25T09:09:50.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.979+0000 7f3b60c00640 1 -- 172.21.15.175:0/1650603988 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16933 (secure 0 0 0) 0x7f3b540f13b0 con 0x7f3b641453a0 2024-04-25T09:09:50.970 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:09:50.970 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":72,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:08:52.921396+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:08:15.743582+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-25T09:08:16.375168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.17","mappings":[{"from":6,"to":0}]},{"pgid":"11.2e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.177:6835/1709110121":"2024-04-26T09:08:32.433027+0000","172.21.15.177:6833/1709110121":"2024-04-26T09:08:32.433027+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:50.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.983+0000 7f3b6bc00640 1 -- 172.21.15.175:0/1650603988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3b44066f60 msgr2=0x7f3b44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.983+0000 7f3b6bc00640 1 --2- 172.21.15.175:0/1650603988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3b44066f60 0x7f3b44069420 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3b50007fd0 tx=0x7f3b50009040 comp rx=0 tx=0).stop 2024-04-25T09:09:50.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.983+0000 7f3b6bc00640 1 -- 172.21.15.175:0/1650603988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b641453a0 msgr2=0x7f3b6415b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.983+0000 7f3b6bc00640 1 --2- 172.21.15.175:0/1650603988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b641453a0 0x7f3b6415b1f0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f3b540b0040 tx=0x7f3b54019710 comp rx=0 tx=0).stop 2024-04-25T09:09:50.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.983+0000 7f3b6bc00640 1 -- 172.21.15.175:0/1650603988 shutdown_connections 2024-04-25T09:09:50.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.983+0000 7f3b6bc00640 1 --2- 172.21.15.175:0/1650603988 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3b44066f60 0x7f3b44069420 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.983+0000 7f3b6bc00640 1 --2- 172.21.15.175:0/1650603988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3b64159cb0 0x7f3b6415a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.983+0000 7f3b6bc00640 1 --2- 172.21.15.175:0/1650603988 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3b6415c5e0 0x7f3b6413f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.983+0000 7f3b6bc00640 1 --2- 172.21.15.175:0/1650603988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b641453a0 0x7f3b6415b1f0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.983+0000 7f3b6bc00640 1 -- 172.21.15.175:0/1650603988 >> 172.21.15.175:0/1650603988 conn(0x7f3b64144fc0 msgr2=0x7f3b6415d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:50.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.983+0000 7f3b6bc00640 1 -- 172.21.15.175:0/1650603988 shutdown_connections 2024-04-25T09:09:50.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:50.983+0000 7f3b6bc00640 1 -- 172.21.15.175:0/1650603988 wait complete. 2024-04-25T09:09:50.991 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:09:51.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.139+0000 7fab6f000640 1 Processor -- start 2024-04-25T09:09:51.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.139+0000 7fab6f000640 1 -- start start 2024-04-25T09:09:51.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.139+0000 7fab6f000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fab68145130 0x7fab6815cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.139+0000 7fab6f000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab68145510 0x7fab680cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.139+0000 7fab6f000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fab68072f10 0x7fab6806ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.139+0000 7fab6f000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab680d0640 con 0x7fab68145130 2024-04-25T09:09:51.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.139+0000 7fab6f000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab680d0360 con 0x7fab68072f10 2024-04-25T09:09:51.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.139+0000 7fab6f000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab68072430 con 0x7fab68145510 2024-04-25T09:09:51.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.139+0000 7fab67e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fab68145130 0x7fab6815cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.139+0000 7fab67e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fab68145130 0x7fab6815cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34236/0 (socket says 172.21.15.175:34236) 2024-04-25T09:09:51.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.139+0000 7fab67e00640 1 -- 172.21.15.175:0/663755679 learned_addr learned my addr 172.21.15.175:0/663755679 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:51.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.139+0000 7fab67400640 1 --2- 172.21.15.175:0/663755679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab68145510 0x7fab680cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.139+0000 7fab6d000640 1 --2- 172.21.15.175:0/663755679 >> v2:172.21.15.177:3300/0 conn(0x7fab68072f10 0x7fab6806ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.139+0000 7fab67e00640 1 -- 172.21.15.175:0/663755679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab68145510 msgr2=0x7fab680cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:51.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.139+0000 7fab67e00640 1 --2- 172.21.15.175:0/663755679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab68145510 0x7fab680cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.139+0000 7fab67e00640 1 -- 172.21.15.175:0/663755679 >> v2:172.21.15.177:3300/0 conn(0x7fab68072f10 msgr2=0x7fab6806ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:51.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.139+0000 7fab67e00640 1 --2- 172.21.15.175:0/663755679 >> v2:172.21.15.177:3300/0 conn(0x7fab68072f10 0x7fab6806ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.139+0000 7fab67e00640 1 -- 172.21.15.175:0/663755679 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab68072710 con 0x7fab68145130 2024-04-25T09:09:51.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.143+0000 7fab67e00640 1 --2- 172.21.15.175:0/663755679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab68145130 0x7fab6815cba0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fab680629d0 tx=0x7fab5801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b3aed86e69aaf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:51.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.143+0000 7fab66a00640 1 -- 172.21.15.175:0/663755679 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab580a56c0 con 0x7fab68145130 2024-04-25T09:09:51.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.143+0000 7fab66a00640 1 -- 172.21.15.175:0/663755679 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab580a5860 con 0x7fab68145130 2024-04-25T09:09:51.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.143+0000 7fab66a00640 1 -- 172.21.15.175:0/663755679 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab580a5c30 con 0x7fab68145130 2024-04-25T09:09:51.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.143+0000 7fab6f000640 1 -- 172.21.15.175:0/663755679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab68145130 msgr2=0x7fab6815cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.143+0000 7fab6f000640 1 --2- 172.21.15.175:0/663755679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab68145130 0x7fab6815cba0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fab680629d0 tx=0x7fab5801c930 comp rx=0 tx=0).stop 2024-04-25T09:09:51.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.143+0000 7fab6f000640 1 -- 172.21.15.175:0/663755679 shutdown_connections 2024-04-25T09:09:51.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.143+0000 7fab6f000640 1 --2- 172.21.15.175:0/663755679 >> v2:172.21.15.177:3300/0 conn(0x7fab68072f10 0x7fab6806ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.143+0000 7fab6f000640 1 --2- 172.21.15.175:0/663755679 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab68145510 0x7fab680cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.143+0000 7fab6f000640 1 --2- 172.21.15.175:0/663755679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab68145130 0x7fab6815cba0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.143+0000 7fab6f000640 1 -- 172.21.15.175:0/663755679 >> 172.21.15.175:0/663755679 conn(0x7fab680b23f0 msgr2=0x7fab680b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:51.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.143+0000 7fab6f000640 1 -- 172.21.15.175:0/663755679 shutdown_connections 2024-04-25T09:09:51.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.143+0000 7fab6f000640 1 -- 172.21.15.175:0/663755679 wait complete. 2024-04-25T09:09:51.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab6f000640 1 Processor -- start 2024-04-25T09:09:51.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab6f000640 1 -- start start 2024-04-25T09:09:51.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab6f000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab68072f10 0x7fab6815efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab6f000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab68145130 0x7fab6815d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab6f000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab68145510 0x7fab680c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab6f000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab68160210 con 0x7fab68072f10 2024-04-25T09:09:51.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab6f000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab68160090 con 0x7fab68145130 2024-04-25T09:09:51.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab6f000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab68160390 con 0x7fab68145510 2024-04-25T09:09:51.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab67e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab68072f10 0x7fab6815efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab67e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab68072f10 0x7fab6815efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34248/0 (socket says 172.21.15.175:34248) 2024-04-25T09:09:51.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab67e00640 1 -- 172.21.15.175:0/4173672204 learned_addr learned my addr 172.21.15.175:0/4173672204 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:51.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab67400640 1 --2- 172.21.15.175:0/4173672204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab68145130 0x7fab6815d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab6d000640 1 --2- 172.21.15.175:0/4173672204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab68145510 0x7fab680c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab67e00640 1 -- 172.21.15.175:0/4173672204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab68145510 msgr2=0x7fab680c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab67e00640 1 --2- 172.21.15.175:0/4173672204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab68145510 0x7fab680c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab67e00640 1 -- 172.21.15.175:0/4173672204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab68145130 msgr2=0x7fab6815d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab67e00640 1 --2- 172.21.15.175:0/4173672204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab68145130 0x7fab6815d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab67e00640 1 -- 172.21.15.175:0/4173672204 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6815df10 con 0x7fab68072f10 2024-04-25T09:09:51.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab67400640 1 --2- 172.21.15.175:0/4173672204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab68145130 0x7fab6815d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:51.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab67e00640 1 --2- 172.21.15.175:0/4173672204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab68072f10 0x7fab6815efb0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fab580af040 tx=0x7fab580196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:51.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab5fe00640 1 -- 172.21.15.175:0/4173672204 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab580bc020 con 0x7fab68072f10 2024-04-25T09:09:51.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab5fe00640 1 -- 172.21.15.175:0/4173672204 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab580b8670 con 0x7fab68072f10 2024-04-25T09:09:51.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab5fe00640 1 -- 172.21.15.175:0/4173672204 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab580b8a60 con 0x7fab68072f10 2024-04-25T09:09:51.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab6f000640 1 -- 172.21.15.175:0/4173672204 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6815e1f0 con 0x7fab68072f10 2024-04-25T09:09:51.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.147+0000 7fab6f000640 1 -- 172.21.15.175:0/4173672204 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6815e7b0 con 0x7fab68072f10 2024-04-25T09:09:51.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.151+0000 7fab6f000640 1 -- 172.21.15.175:0/4173672204 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab68075160 con 0x7fab68072f10 2024-04-25T09:09:51.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.151+0000 7fab5fe00640 1 -- 172.21.15.175:0/4173672204 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fab580bf020 con 0x7fab68072f10 2024-04-25T09:09:51.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.151+0000 7fab5fe00640 1 --2- 172.21.15.175:0/4173672204 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fab48066f60 0x7fab48069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.151+0000 7fab5fe00640 1 -- 172.21.15.175:0/4173672204 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fab58120210 con 0x7fab68072f10 2024-04-25T09:09:51.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.151+0000 7fab67400640 1 --2- 172.21.15.175:0/4173672204 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fab48066f60 0x7fab48069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.151+0000 7fab67400640 1 --2- 172.21.15.175:0/4173672204 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fab48066f60 0x7fab48069420 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fab680c5ad0 tx=0x7fab54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:51.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.155+0000 7fab5fe00640 1 -- 172.21.15.175:0/4173672204 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fab580c6030 con 0x7fab68072f10 2024-04-25T09:09:51.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.351+0000 7fab6f000640 1 -- 172.21.15.175:0/4173672204 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fab6806b780 con 0x7fab68072f10 2024-04-25T09:09:51.340 INFO:tasks.ceph.mon.a.smithi175.stderr:2024-04-25T09:09:51.351+0000 7feb0ee00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:09:51.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.355+0000 7fab5fe00640 1 -- 172.21.15.175:0/4173672204 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7fab580165e0 con 0x7fab68072f10 2024-04-25T09:09:51.343 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:09:51.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.355+0000 7fab6f000640 1 -- 172.21.15.175:0/4173672204 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fab48066f60 msgr2=0x7fab48069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.355+0000 7fab6f000640 1 --2- 172.21.15.175:0/4173672204 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fab48066f60 0x7fab48069420 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fab680c5ad0 tx=0x7fab54008040 comp rx=0 tx=0).stop 2024-04-25T09:09:51.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.355+0000 7fab6f000640 1 -- 172.21.15.175:0/4173672204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab68072f10 msgr2=0x7fab6815efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.355+0000 7fab6f000640 1 --2- 172.21.15.175:0/4173672204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab68072f10 0x7fab6815efb0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fab580af040 tx=0x7fab580196d0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.355+0000 7fab6f000640 1 -- 172.21.15.175:0/4173672204 shutdown_connections 2024-04-25T09:09:51.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.355+0000 7fab6f000640 1 --2- 172.21.15.175:0/4173672204 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fab48066f60 0x7fab48069420 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.355+0000 7fab6f000640 1 --2- 172.21.15.175:0/4173672204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab68145510 0x7fab680c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.355+0000 7fab6f000640 1 --2- 172.21.15.175:0/4173672204 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab68145130 0x7fab6815d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.355+0000 7fab6f000640 1 --2- 172.21.15.175:0/4173672204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab68072f10 0x7fab6815efb0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.355+0000 7fab6f000640 1 -- 172.21.15.175:0/4173672204 >> 172.21.15.175:0/4173672204 conn(0x7fab680b23f0 msgr2=0x7fab68165dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:51.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.355+0000 7fab6f000640 1 -- 172.21.15.175:0/4173672204 shutdown_connections 2024-04-25T09:09:51.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.355+0000 7fab6f000640 1 -- 172.21.15.175:0/4173672204 wait complete. 2024-04-25T09:09:51.356 INFO:tasks.ceph.mds.a.smithi175.stderr: -3932> 2024-04-25T09:08:38.983+0000 7fa250200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:09:51.368 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:09:51.401 INFO:tasks.ceph.mds.a.smithi175.stdout:starting mds.a at 2024-04-25T09:09:51.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f3e400640 1 Processor -- start 2024-04-25T09:09:51.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f3e400640 1 -- start start 2024-04-25T09:09:51.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f3e400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6f381454f0 0x7f6f380cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f3e400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6f380cf490 0x7f6f380d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f3e400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f380d12a0 0x7f6f3815f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f3e400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f380b4940 con 0x7f6f380cf490 2024-04-25T09:09:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f3e400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f380b4430 con 0x7f6f381454f0 2024-04-25T09:09:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f3e400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380cf8f0 con 0x7f6f380d12a0 2024-04-25T09:09:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f36a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6f380cf490 0x7f6f380d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f36a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6f380cf490 0x7f6f380d0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34288/0 (socket says 172.21.15.175:34288) 2024-04-25T09:09:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f36a00640 1 -- 172.21.15.175:0/3994997947 learned_addr learned my addr 172.21.15.175:0/3994997947 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f37e00640 1 --2- 172.21.15.175:0/3994997947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f380d12a0 0x7f6f3815f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f37400640 1 --2- 172.21.15.175:0/3994997947 >> v2:172.21.15.177:3300/0 conn(0x7f6f381454f0 0x7f6f380cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f36a00640 1 -- 172.21.15.175:0/3994997947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f380d12a0 msgr2=0x7f6f3815f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f36a00640 1 --2- 172.21.15.175:0/3994997947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f380d12a0 0x7f6f3815f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f36a00640 1 -- 172.21.15.175:0/3994997947 >> v2:172.21.15.177:3300/0 conn(0x7f6f381454f0 msgr2=0x7f6f380cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f36a00640 1 --2- 172.21.15.175:0/3994997947 >> v2:172.21.15.177:3300/0 conn(0x7f6f381454f0 0x7f6f380cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f36a00640 1 -- 172.21.15.175:0/3994997947 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f38070eb0 con 0x7f6f380cf490 2024-04-25T09:09:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.519+0000 7f6f37e00640 1 --2- 172.21.15.175:0/3994997947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f380d12a0 0x7f6f3815f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:51.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.523+0000 7f6f36a00640 1 --2- 172.21.15.175:0/3994997947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f380cf490 0x7f6f380d0d60 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f6f38070b50 tx=0x7f6f2401c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69879ed3677bd821 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:51.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.523+0000 7f6f36000640 1 -- 172.21.15.175:0/3994997947 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f240b0070 con 0x7f6f380cf490 2024-04-25T09:09:51.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.523+0000 7f6f36000640 1 -- 172.21.15.175:0/3994997947 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f240ab600 con 0x7f6f380cf490 2024-04-25T09:09:51.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.523+0000 7f6f36000640 1 -- 172.21.15.175:0/3994997947 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f240ab9d0 con 0x7f6f380cf490 2024-04-25T09:09:51.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.523+0000 7f6f3e400640 1 -- 172.21.15.175:0/3994997947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f380cf490 msgr2=0x7f6f380d0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.523+0000 7f6f3e400640 1 --2- 172.21.15.175:0/3994997947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f380cf490 0x7f6f380d0d60 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f6f38070b50 tx=0x7f6f2401c230 comp rx=0 tx=0).stop 2024-04-25T09:09:51.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.523+0000 7f6f3e400640 1 -- 172.21.15.175:0/3994997947 shutdown_connections 2024-04-25T09:09:51.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.523+0000 7f6f3e400640 1 --2- 172.21.15.175:0/3994997947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f380d12a0 0x7f6f3815f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.523+0000 7f6f3e400640 1 --2- 172.21.15.175:0/3994997947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f380cf490 0x7f6f380d0d60 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.523+0000 7f6f3e400640 1 --2- 172.21.15.175:0/3994997947 >> v2:172.21.15.177:3300/0 conn(0x7f6f381454f0 0x7f6f380cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.523+0000 7f6f3e400640 1 -- 172.21.15.175:0/3994997947 >> 172.21.15.175:0/3994997947 conn(0x7f6f380b3510 msgr2=0x7f6f380b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:51.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.523+0000 7f6f3e400640 1 -- 172.21.15.175:0/3994997947 shutdown_connections 2024-04-25T09:09:51.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.523+0000 7f6f3e400640 1 -- 172.21.15.175:0/3994997947 wait complete. 2024-04-25T09:09:51.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f3e400640 1 Processor -- start 2024-04-25T09:09:51.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f3e400640 1 -- start start 2024-04-25T09:09:51.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f3e400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f380cf490 0x7f6f38165480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f3e400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f380d12a0 0x7f6f380b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f3e400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f381454f0 0x7f6f381f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f3e400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380d16b0 con 0x7f6f381454f0 2024-04-25T09:09:51.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f3e400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f381458d0 con 0x7f6f380cf490 2024-04-25T09:09:51.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f3e400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380b4db0 con 0x7f6f380d12a0 2024-04-25T09:09:51.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f37e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f381454f0 0x7f6f381f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f37e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f381454f0 0x7f6f381f69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34302/0 (socket says 172.21.15.175:34302) 2024-04-25T09:09:51.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f37e00640 1 -- 172.21.15.175:0/1239852796 learned_addr learned my addr 172.21.15.175:0/1239852796 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:51.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f36a00640 1 --2- 172.21.15.175:0/1239852796 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f380d12a0 0x7f6f380b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f37400640 1 --2- 172.21.15.175:0/1239852796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f380cf490 0x7f6f38165480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f37e00640 1 -- 172.21.15.175:0/1239852796 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f380d12a0 msgr2=0x7f6f380b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f37e00640 1 --2- 172.21.15.175:0/1239852796 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f380d12a0 0x7f6f380b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f37e00640 1 -- 172.21.15.175:0/1239852796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f380cf490 msgr2=0x7f6f38165480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f37e00640 1 --2- 172.21.15.175:0/1239852796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f380cf490 0x7f6f38165480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f37e00640 1 -- 172.21.15.175:0/1239852796 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f381f7540 con 0x7f6f381454f0 2024-04-25T09:09:51.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f37400640 1 --2- 172.21.15.175:0/1239852796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f380cf490 0x7f6f38165480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:51.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f37e00640 1 --2- 172.21.15.175:0/1239852796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f381454f0 0x7f6f381f69e0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f6f3000e5e0 tx=0x7f6f3000eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:51.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f2f400640 1 -- 172.21.15.175:0/1239852796 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3000f040 con 0x7f6f381454f0 2024-04-25T09:09:51.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f2f400640 1 -- 172.21.15.175:0/1239852796 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f30004230 con 0x7f6f381454f0 2024-04-25T09:09:51.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f2f400640 1 -- 172.21.15.175:0/1239852796 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f30003620 con 0x7f6f381454f0 2024-04-25T09:09:51.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f3e400640 1 -- 172.21.15.175:0/1239852796 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f381f7820 con 0x7f6f381454f0 2024-04-25T09:09:51.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.527+0000 7f6f3e400640 1 -- 172.21.15.175:0/1239852796 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f38159680 con 0x7f6f381454f0 2024-04-25T09:09:51.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.531+0000 7f6f3e400640 1 -- 172.21.15.175:0/1239852796 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f38075160 con 0x7f6f381454f0 2024-04-25T09:09:51.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.531+0000 7f6f2f400640 1 -- 172.21.15.175:0/1239852796 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6f300037c0 con 0x7f6f381454f0 2024-04-25T09:09:51.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.531+0000 7f6f2f400640 1 --2- 172.21.15.175:0/1239852796 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6f18066f60 0x7f6f18069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.531+0000 7f6f2f400640 1 -- 172.21.15.175:0/1239852796 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f6f30084db0 con 0x7f6f381454f0 2024-04-25T09:09:51.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.531+0000 7f6f37400640 1 --2- 172.21.15.175:0/1239852796 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6f18066f60 0x7f6f18069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.531+0000 7f6f37400640 1 --2- 172.21.15.175:0/1239852796 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6f18066f60 0x7f6f18069420 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6f28003fd0 tx=0x7f6f280039e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:51.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.535+0000 7f6f2f400640 1 -- 172.21.15.175:0/1239852796 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6f30089070 con 0x7f6f381454f0 2024-04-25T09:09:51.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:51.719+0000 7f6f3e400640 1 -- 172.21.15.175:0/1239852796 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6f3813eba0 con 0x7f6f381454f0 2024-04-25T09:09:52.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.359+0000 7f6f2f400640 1 -- 172.21.15.175:0/1239852796 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6f30017020 con 0x7f6f381454f0 2024-04-25T09:09:52.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.363+0000 7f6f3e400640 1 -- 172.21.15.175:0/1239852796 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6f18066f60 msgr2=0x7f6f18069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:52.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.363+0000 7f6f3e400640 1 --2- 172.21.15.175:0/1239852796 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6f18066f60 0x7f6f18069420 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6f28003fd0 tx=0x7f6f280039e0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.363+0000 7f6f3e400640 1 -- 172.21.15.175:0/1239852796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f381454f0 msgr2=0x7f6f381f69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:52.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.363+0000 7f6f3e400640 1 --2- 172.21.15.175:0/1239852796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f381454f0 0x7f6f381f69e0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f6f3000e5e0 tx=0x7f6f3000eaa0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.363+0000 7f6f3e400640 1 -- 172.21.15.175:0/1239852796 shutdown_connections 2024-04-25T09:09:52.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.363+0000 7f6f3e400640 1 --2- 172.21.15.175:0/1239852796 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6f18066f60 0x7f6f18069420 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.363+0000 7f6f3e400640 1 --2- 172.21.15.175:0/1239852796 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f381454f0 0x7f6f381f69e0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.363+0000 7f6f3e400640 1 --2- 172.21.15.175:0/1239852796 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f380d12a0 0x7f6f380b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.363+0000 7f6f3e400640 1 --2- 172.21.15.175:0/1239852796 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f380cf490 0x7f6f38165480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.363+0000 7f6f3e400640 1 -- 172.21.15.175:0/1239852796 >> 172.21.15.175:0/1239852796 conn(0x7f6f380b3510 msgr2=0x7f6f3815c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:52.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.363+0000 7f6f3e400640 1 -- 172.21.15.175:0/1239852796 shutdown_connections 2024-04-25T09:09:52.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.363+0000 7f6f3e400640 1 -- 172.21.15.175:0/1239852796 wait complete. 2024-04-25T09:09:52.374 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:09:52.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.563+0000 7fdded800640 1 Processor -- start 2024-04-25T09:09:52.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.563+0000 7fdded800640 1 -- start start 2024-04-25T09:09:52.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.567+0000 7fdded800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdde806df70 0x7fdde8071740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.567+0000 7fdded800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde8071e20 con 0x7fdde80712b0 2024-04-25T09:09:52.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.567+0000 7fdded800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde8072100 con 0x7fdde80cfb60 2024-04-25T09:09:52.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.567+0000 7fdded800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde80cbed0 con 0x7fdde806df70 2024-04-25T09:09:52.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.567+0000 7fddde000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fdde80712b0 0x7fdde806d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53336/0 (socket says 172.21.15.175:53336) 2024-04-25T09:09:52.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.567+0000 7fddde000640 1 -- 172.21.15.175:0/3329900584 learned_addr learned my addr 172.21.15.175:0/3329900584 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:52.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.567+0000 7fdde7400640 1 --2- 172.21.15.175:0/3329900584 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdde806df70 0x7fdde8071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.567+0000 7fdde6000640 1 -- 172.21.15.175:0/3329900584 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628755139 0 0) 0x7fdde8071e20 con 0x7fdde80712b0 2024-04-25T09:09:52.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.567+0000 7fdde6000640 1 -- 172.21.15.175:0/3329900584 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddcc003530 con 0x7fdde80712b0 2024-04-25T09:09:52.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.567+0000 7fdde6000640 1 -- 172.21.15.175:0/3329900584 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317313915 0 0) 0x7fdde8072100 con 0x7fdde80cfb60 2024-04-25T09:09:52.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.567+0000 7fdde6000640 1 -- 172.21.15.175:0/3329900584 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdde8071e20 con 0x7fdde80cfb60 2024-04-25T09:09:52.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.567+0000 7fdde7400640 1 -- 172.21.15.175:0/3329900584 >> v1:172.21.15.177:6789/0 conn(0x7fdde80cfb60 legacy=0x7fdde80ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:52.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.567+0000 7fdde7400640 1 -- 172.21.15.175:0/3329900584 >> v1:172.21.15.175:6789/0 conn(0x7fdde80712b0 legacy=0x7fdde806d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:52.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.567+0000 7fdde7400640 1 -- 172.21.15.175:0/3329900584 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde80cc120 con 0x7fdde806df70 2024-04-25T09:09:52.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.571+0000 7fdde7400640 1 --2- 172.21.15.175:0/3329900584 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdde806df70 0x7fdde8071740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdde80cc050 tx=0x7fdde001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca53596622da6982 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:52.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.571+0000 7fdde6000640 1 -- 172.21.15.175:0/3329900584 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde00ab620 con 0x7fdde806df70 2024-04-25T09:09:52.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.571+0000 7fdde6000640 1 -- 172.21.15.175:0/3329900584 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde00b0070 con 0x7fdde806df70 2024-04-25T09:09:52.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.571+0000 7fdde6000640 1 -- 172.21.15.175:0/3329900584 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde00ab9e0 con 0x7fdde806df70 2024-04-25T09:09:52.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.571+0000 7fdded800640 1 -- 172.21.15.175:0/3329900584 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdde806df70 msgr2=0x7fdde8071740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:52.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.571+0000 7fdded800640 1 --2- 172.21.15.175:0/3329900584 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdde806df70 0x7fdde8071740 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdde80cc050 tx=0x7fdde001c400 comp rx=0 tx=0).stop 2024-04-25T09:09:52.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.571+0000 7fdded800640 1 -- 172.21.15.175:0/3329900584 shutdown_connections 2024-04-25T09:09:52.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.571+0000 7fdded800640 1 --2- 172.21.15.175:0/3329900584 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdde806df70 0x7fdde8071740 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.571+0000 7fdded800640 1 -- 172.21.15.175:0/3329900584 >> 172.21.15.175:0/3329900584 conn(0x7fdde806ac50 msgr2=0x7fdde806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:52.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.571+0000 7fdded800640 1 -- 172.21.15.175:0/3329900584 shutdown_connections 2024-04-25T09:09:52.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.571+0000 7fdded800640 1 -- 172.21.15.175:0/3329900584 wait complete. 2024-04-25T09:09:52.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.571+0000 7fdded800640 1 Processor -- start 2024-04-25T09:09:52.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.571+0000 7fdded800640 1 -- start start 2024-04-25T09:09:52.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdded800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdde806df70 0x7fdde813d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdded800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdde80712b0 0x7fdde8140790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdded800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdde80cfb60 0x7fdde813ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdded800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde80cf060 con 0x7fdde806df70 2024-04-25T09:09:52.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdded800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde80ceee0 con 0x7fdde80712b0 2024-04-25T09:09:52.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdded800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde8169730 con 0x7fdde80cfb60 2024-04-25T09:09:52.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdde6a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdde806df70 0x7fdde813d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdde6a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdde806df70 0x7fdde813d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34316/0 (socket says 172.21.15.175:34316) 2024-04-25T09:09:52.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdde6a00640 1 -- 172.21.15.175:0/2971974221 learned_addr learned my addr 172.21.15.175:0/2971974221 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:52.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fddde000640 1 --2- 172.21.15.175:0/2971974221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdde80712b0 0x7fdde8140790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdde7400640 1 --2- 172.21.15.175:0/2971974221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdde80cfb60 0x7fdde813ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdde6a00640 1 -- 172.21.15.175:0/2971974221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdde80cfb60 msgr2=0x7fdde813ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:52.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdde6a00640 1 --2- 172.21.15.175:0/2971974221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdde80cfb60 0x7fdde813ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdde6a00640 1 -- 172.21.15.175:0/2971974221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdde80712b0 msgr2=0x7fdde8140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:52.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdde6a00640 1 --2- 172.21.15.175:0/2971974221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdde80712b0 0x7fdde8140790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdde6a00640 1 -- 172.21.15.175:0/2971974221 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde815cfe0 con 0x7fdde806df70 2024-04-25T09:09:52.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdde7400640 1 --2- 172.21.15.175:0/2971974221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdde80cfb60 0x7fdde813ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:52.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdde6a00640 1 --2- 172.21.15.175:0/2971974221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdde806df70 0x7fdde813d150 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fddd800c800 tx=0x7fddd800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:52.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdddf400640 1 -- 172.21.15.175:0/2971974221 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd8003b80 con 0x7fdde806df70 2024-04-25T09:09:52.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdddf400640 1 -- 172.21.15.175:0/2971974221 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd8003d40 con 0x7fdde806df70 2024-04-25T09:09:52.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdddf400640 1 -- 172.21.15.175:0/2971974221 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd800aa90 con 0x7fdde806df70 2024-04-25T09:09:52.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdded800640 1 -- 172.21.15.175:0/2971974221 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde815c460 con 0x7fdde806df70 2024-04-25T09:09:52.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdded800640 1 -- 172.21.15.175:0/2971974221 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde815ca20 con 0x7fdde806df70 2024-04-25T09:09:52.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdded800640 1 -- 172.21.15.175:0/2971974221 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde8075160 con 0x7fdde806df70 2024-04-25T09:09:52.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.575+0000 7fdddf400640 1 -- 172.21.15.175:0/2971974221 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fddd800ac30 con 0x7fdde806df70 2024-04-25T09:09:52.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.579+0000 7fdddf400640 1 --2- 172.21.15.175:0/2971974221 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fddc4066f60 0x7fddc4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.579+0000 7fdddf400640 1 -- 172.21.15.175:0/2971974221 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5939+0+0 (secure 0 0 0) 0x7fddd8085160 con 0x7fdde806df70 2024-04-25T09:09:52.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.579+0000 7fddde000640 1 --2- 172.21.15.175:0/2971974221 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fddc4066f60 0x7fddc4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.579+0000 7fddde000640 1 --2- 172.21.15.175:0/2971974221 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fddc4066f60 0x7fddc4069420 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdde80aecc0 tx=0x7fddd0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:52.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.583+0000 7fdddf400640 1 -- 172.21.15.175:0/2971974221 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fddd8055ff0 con 0x7fdde806df70 2024-04-25T09:09:52.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:52.735+0000 7fdded800640 1 -- 172.21.15.175:0/2971974221 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdde80c50c0 con 0x7fdde806df70 2024-04-25T09:09:53.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.363+0000 7fdddf400640 1 -- 172.21.15.175:0/2971974221 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) v1 ==== 181+0+0 (secure 0 0 0) 0x7fddd80558f0 con 0x7fdde806df70 2024-04-25T09:09:53.352 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:09:53.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.363+0000 7fdded800640 1 -- 172.21.15.175:0/2971974221 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fddc4066f60 msgr2=0x7fddc4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.363+0000 7fdded800640 1 --2- 172.21.15.175:0/2971974221 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fddc4066f60 0x7fddc4069420 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdde80aecc0 tx=0x7fddd0009040 comp rx=0 tx=0).stop 2024-04-25T09:09:53.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.363+0000 7fdded800640 1 -- 172.21.15.175:0/2971974221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdde806df70 msgr2=0x7fdde813d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.363+0000 7fdded800640 1 --2- 172.21.15.175:0/2971974221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdde806df70 0x7fdde813d150 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fddd800c800 tx=0x7fddd800ccc0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.363+0000 7fdded800640 1 -- 172.21.15.175:0/2971974221 shutdown_connections 2024-04-25T09:09:53.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.363+0000 7fdded800640 1 --2- 172.21.15.175:0/2971974221 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fddc4066f60 0x7fddc4069420 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.363+0000 7fdded800640 1 --2- 172.21.15.175:0/2971974221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdde80cfb60 0x7fdde813ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.363+0000 7fdded800640 1 --2- 172.21.15.175:0/2971974221 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdde80712b0 0x7fdde8140790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.363+0000 7fdded800640 1 --2- 172.21.15.175:0/2971974221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdde806df70 0x7fdde813d150 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.363+0000 7fdded800640 1 -- 172.21.15.175:0/2971974221 >> 172.21.15.175:0/2971974221 conn(0x7fdde806ac50 msgr2=0x7fdde8142a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:53.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.363+0000 7fdded800640 1 -- 172.21.15.175:0/2971974221 shutdown_connections 2024-04-25T09:09:53.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.367+0000 7fdded800640 1 -- 172.21.15.175:0/2971974221 wait complete. 2024-04-25T09:09:53.378 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:09:53.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.527+0000 7f3dea400640 1 Processor -- start 2024-04-25T09:09:53.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.527+0000 7f3dea400640 1 -- start start 2024-04-25T09:09:53.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.527+0000 7f3dea400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3de415b2c0 0x7f3de40ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.527+0000 7f3dea400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3de40712b0 0x7f3de4071720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.527+0000 7f3dea400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de415eb90 con 0x7f3de40b4090 2024-04-25T09:09:53.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.527+0000 7f3dea400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de40cfdc0 con 0x7f3de40712b0 2024-04-25T09:09:53.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.527+0000 7f3dea400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de4071c60 con 0x7f3de415b2c0 2024-04-25T09:09:53.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.527+0000 7f3de3e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3de40712b0 0x7f3de4071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.527+0000 7f3de3e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3de40712b0 0x7f3de4071720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34318/0 (socket says 172.21.15.175:34318) 2024-04-25T09:09:53.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.527+0000 7f3de3e00640 1 -- 172.21.15.175:0/1805046826 learned_addr learned my addr 172.21.15.175:0/1805046826 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:53.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.527+0000 7f3de3400640 1 --2- 172.21.15.175:0/1805046826 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3de415b2c0 0x7f3de40ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.527+0000 7f3de3e00640 1 -- 172.21.15.175:0/1805046826 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3de415b2c0 msgr2=0x7f3de40ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:53.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.527+0000 7f3de3e00640 1 --2- 172.21.15.175:0/1805046826 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3de415b2c0 0x7f3de40ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.527+0000 7f3de3e00640 1 -- 172.21.15.175:0/1805046826 >> v1:172.21.15.177:6789/0 conn(0x7f3de40b4090 legacy=0x7f3de40cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:53.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.527+0000 7f3de3e00640 1 -- 172.21.15.175:0/1805046826 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de415ddd0 con 0x7f3de40712b0 2024-04-25T09:09:53.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.531+0000 7f3de3e00640 1 --2- 172.21.15.175:0/1805046826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3de40712b0 0x7f3de4071720 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009e80 tx=0x7f3ddc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee20961f8242d3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:53.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.531+0000 7f3de2000640 1 -- 172.21.15.175:0/1805046826 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0a5650 con 0x7f3de40712b0 2024-04-25T09:09:53.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.531+0000 7f3de2000640 1 -- 172.21.15.175:0/1805046826 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ddc0a57f0 con 0x7f3de40712b0 2024-04-25T09:09:53.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.531+0000 7f3de2000640 1 -- 172.21.15.175:0/1805046826 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ddc0a5bc0 con 0x7f3de40712b0 2024-04-25T09:09:53.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.531+0000 7f3dea400640 1 -- 172.21.15.175:0/1805046826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3de40712b0 msgr2=0x7f3de4071720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.531+0000 7f3dea400640 1 --2- 172.21.15.175:0/1805046826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3de40712b0 0x7f3de4071720 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc009e80 tx=0x7f3ddc01c9d0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.531+0000 7f3dea400640 1 -- 172.21.15.175:0/1805046826 shutdown_connections 2024-04-25T09:09:53.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.531+0000 7f3dea400640 1 --2- 172.21.15.175:0/1805046826 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3de40712b0 0x7f3de4071720 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.531+0000 7f3dea400640 1 --2- 172.21.15.175:0/1805046826 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3de415b2c0 0x7f3de40ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.531+0000 7f3dea400640 1 -- 172.21.15.175:0/1805046826 >> 172.21.15.175:0/1805046826 conn(0x7f3de406ac50 msgr2=0x7f3de406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:53.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.531+0000 7f3dea400640 1 -- 172.21.15.175:0/1805046826 shutdown_connections 2024-04-25T09:09:53.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.531+0000 7f3dea400640 1 -- 172.21.15.175:0/1805046826 wait complete. 2024-04-25T09:09:53.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3dea400640 1 Processor -- start 2024-04-25T09:09:53.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3dea400640 1 -- start start 2024-04-25T09:09:53.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3dea400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3de40712b0 0x7f3de414ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3dea400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3de40b4090 0x7f3de4151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3dea400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3de415b2c0 0x7f3de4151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3dea400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40b44f0 con 0x7f3de40712b0 2024-04-25T09:09:53.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3dea400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40aef10 con 0x7f3de40b4090 2024-04-25T09:09:53.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3dea400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40b4670 con 0x7f3de415b2c0 2024-04-25T09:09:53.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3de3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3de40712b0 0x7f3de414ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3de3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3de40712b0 0x7f3de414ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34334/0 (socket says 172.21.15.175:34334) 2024-04-25T09:09:53.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3de3400640 1 -- 172.21.15.175:0/2727381787 learned_addr learned my addr 172.21.15.175:0/2727381787 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:53.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3de3e00640 1 --2- 172.21.15.175:0/2727381787 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3de415b2c0 0x7f3de4151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3de2a00640 1 --2- 172.21.15.175:0/2727381787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3de40b4090 0x7f3de4151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3de3400640 1 -- 172.21.15.175:0/2727381787 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3de415b2c0 msgr2=0x7f3de4151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3de3400640 1 --2- 172.21.15.175:0/2727381787 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3de415b2c0 0x7f3de4151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3de3400640 1 -- 172.21.15.175:0/2727381787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3de40b4090 msgr2=0x7f3de4151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3de3400640 1 --2- 172.21.15.175:0/2727381787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3de40b4090 0x7f3de4151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3de3400640 1 -- 172.21.15.175:0/2727381787 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de4163170 con 0x7f3de40712b0 2024-04-25T09:09:53.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3de2a00640 1 --2- 172.21.15.175:0/2727381787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3de40b4090 0x7f3de4151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:53.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3de3400640 1 --2- 172.21.15.175:0/2727381787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3de40712b0 0x7f3de414ca90 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00d800 tx=0x7f3dcc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:53.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3ddb400640 1 -- 172.21.15.175:0/2727381787 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc00b6c0 con 0x7f3de40712b0 2024-04-25T09:09:53.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3ddb400640 1 -- 172.21.15.175:0/2727381787 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc019070 con 0x7f3de40712b0 2024-04-25T09:09:53.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3ddb400640 1 -- 172.21.15.175:0/2727381787 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc00ba60 con 0x7f3de40712b0 2024-04-25T09:09:53.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3dea400640 1 -- 172.21.15.175:0/2727381787 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de4163450 con 0x7f3de40712b0 2024-04-25T09:09:53.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.535+0000 7f3dea400640 1 -- 172.21.15.175:0/2727381787 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de4163a10 con 0x7f3de40712b0 2024-04-25T09:09:53.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.539+0000 7f3dea400640 1 -- 172.21.15.175:0/2727381787 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de4075160 con 0x7f3de40712b0 2024-04-25T09:09:53.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.539+0000 7f3ddb400640 1 -- 172.21.15.175:0/2727381787 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3dcc00bc00 con 0x7f3de40712b0 2024-04-25T09:09:53.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.539+0000 7f3ddb400640 1 --2- 172.21.15.175:0/2727381787 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3dc0066f90 0x7f3dc0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.539+0000 7f3ddb400640 1 -- 172.21.15.175:0/2727381787 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5501+0+0 (secure 0 0 0) 0x7f3dcc085440 con 0x7f3de40712b0 2024-04-25T09:09:53.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.539+0000 7f3de2a00640 1 --2- 172.21.15.175:0/2727381787 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3dc0066f90 0x7f3dc0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.539+0000 7f3de2a00640 1 --2- 172.21.15.175:0/2727381787 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3dc0066f90 0x7f3dc0069450 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3de40cbe90 tx=0x7f3dd4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:53.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.543+0000 7f3ddb400640 1 -- 172.21.15.175:0/2727381787 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3dcc056480 con 0x7f3de40712b0 2024-04-25T09:09:53.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:53.699+0000 7f3dea400640 1 -- 172.21.15.175:0/2727381787 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3de4072230 con 0x7f3de40712b0 2024-04-25T09:09:54.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.367+0000 7f3ddb400640 1 -- 172.21.15.175:0/2727381787 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3dcc055d80 con 0x7f3de40712b0 2024-04-25T09:09:54.357 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_data' removed 2024-04-25T09:09:54.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.371+0000 7f3dea400640 1 -- 172.21.15.175:0/2727381787 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3dc0066f90 msgr2=0x7f3dc0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.371+0000 7f3dea400640 1 --2- 172.21.15.175:0/2727381787 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3dc0066f90 0x7f3dc0069450 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3de40cbe90 tx=0x7f3dd4009040 comp rx=0 tx=0).stop 2024-04-25T09:09:54.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.371+0000 7f3dea400640 1 -- 172.21.15.175:0/2727381787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3de40712b0 msgr2=0x7f3de414ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.371+0000 7f3dea400640 1 --2- 172.21.15.175:0/2727381787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3de40712b0 0x7f3de414ca90 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00d800 tx=0x7f3dcc00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.371+0000 7f3dea400640 1 -- 172.21.15.175:0/2727381787 shutdown_connections 2024-04-25T09:09:54.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.371+0000 7f3dea400640 1 --2- 172.21.15.175:0/2727381787 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3dc0066f90 0x7f3dc0069450 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.371+0000 7f3dea400640 1 --2- 172.21.15.175:0/2727381787 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3de415b2c0 0x7f3de4151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.371+0000 7f3dea400640 1 --2- 172.21.15.175:0/2727381787 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3de40b4090 0x7f3de4151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.371+0000 7f3dea400640 1 --2- 172.21.15.175:0/2727381787 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3de40712b0 0x7f3de414ca90 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.371+0000 7f3dea400640 1 -- 172.21.15.175:0/2727381787 >> 172.21.15.175:0/2727381787 conn(0x7f3de406ac50 msgr2=0x7f3de406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:54.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.371+0000 7f3dea400640 1 -- 172.21.15.175:0/2727381787 shutdown_connections 2024-04-25T09:09:54.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.371+0000 7f3dea400640 1 -- 172.21.15.175:0/2727381787 wait complete. 2024-04-25T09:09:54.383 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:09:54.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.531+0000 7f431f000640 1 Processor -- start 2024-04-25T09:09:54.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.531+0000 7f431f000640 1 -- start start 2024-04-25T09:09:54.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.531+0000 7f431f000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4318161360 0x7f43180ad990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.531+0000 7f431f000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43180ae250 con 0x7f43180712d0 2024-04-25T09:09:54.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.531+0000 7f431f000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f431806f0e0 con 0x7f43180ae660 2024-04-25T09:09:54.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.531+0000 7f431f000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43180adf70 con 0x7f4318161360 2024-04-25T09:09:54.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.531+0000 7f4317e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4318161360 0x7f43180ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.531+0000 7f431d000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f43180712d0 0x7f43180716e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53338/0 (socket says 172.21.15.175:53338) 2024-04-25T09:09:54.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.531+0000 7f431d000640 1 -- 172.21.15.175:0/3527101831 learned_addr learned my addr 172.21.15.175:0/3527101831 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:54.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.531+0000 7f4317e00640 1 -- 172.21.15.175:0/3527101831 >> v1:172.21.15.177:6789/0 conn(0x7f43180ae660 legacy=0x7f431806e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:54.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.531+0000 7f4317e00640 1 -- 172.21.15.175:0/3527101831 >> v1:172.21.15.175:6789/0 conn(0x7f43180712d0 legacy=0x7f43180716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.531+0000 7f4317e00640 1 -- 172.21.15.175:0/3527101831 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431806def0 con 0x7f4318161360 2024-04-25T09:09:54.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.531+0000 7f4316a00640 1 -- 172.21.15.175:0/3527101831 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687963546 0 0) 0x7f43180ae250 con 0x7f43180712d0 2024-04-25T09:09:54.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.535+0000 7f4317e00640 1 --2- 172.21.15.175:0/3527101831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4318161360 0x7f43180ad990 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f43080097c0 tx=0x7f430801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce209154bfcba3d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:54.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.535+0000 7f4316a00640 1 -- 172.21.15.175:0/3527101831 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43080b1070 con 0x7f4318161360 2024-04-25T09:09:54.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.535+0000 7f4316a00640 1 -- 172.21.15.175:0/3527101831 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43080ac600 con 0x7f4318161360 2024-04-25T09:09:54.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.535+0000 7f4316a00640 1 -- 172.21.15.175:0/3527101831 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43080ac9d0 con 0x7f4318161360 2024-04-25T09:09:54.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.535+0000 7f431f000640 1 -- 172.21.15.175:0/3527101831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4318161360 msgr2=0x7f43180ad990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.535+0000 7f431f000640 1 --2- 172.21.15.175:0/3527101831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4318161360 0x7f43180ad990 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f43080097c0 tx=0x7f430801c3a0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.535+0000 7f431f000640 1 -- 172.21.15.175:0/3527101831 shutdown_connections 2024-04-25T09:09:54.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.535+0000 7f431f000640 1 --2- 172.21.15.175:0/3527101831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4318161360 0x7f43180ad990 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.535+0000 7f431f000640 1 -- 172.21.15.175:0/3527101831 >> 172.21.15.175:0/3527101831 conn(0x7f431806ac50 msgr2=0x7f431806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:54.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.535+0000 7f431f000640 1 -- 172.21.15.175:0/3527101831 shutdown_connections 2024-04-25T09:09:54.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.535+0000 7f431f000640 1 -- 172.21.15.175:0/3527101831 wait complete. 2024-04-25T09:09:54.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.535+0000 7f431f000640 1 Processor -- start 2024-04-25T09:09:54.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.535+0000 7f431f000640 1 -- start start 2024-04-25T09:09:54.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f431f000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43180712d0 0x7f431814ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f431f000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43180ae660 0x7f43181488a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f431f000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4318161360 0x7f4318151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f431f000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431816ba90 con 0x7f4318161360 2024-04-25T09:09:54.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f431f000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431816b910 con 0x7f43180712d0 2024-04-25T09:09:54.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f431f000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f431816bc10 con 0x7f43180ae660 2024-04-25T09:09:54.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f431d000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4318161360 0x7f4318151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f431d000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4318161360 0x7f4318151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34346/0 (socket says 172.21.15.175:34346) 2024-04-25T09:09:54.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f431d000640 1 -- 172.21.15.175:0/2492435387 learned_addr learned my addr 172.21.15.175:0/2492435387 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:54.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f4317e00640 1 --2- 172.21.15.175:0/2492435387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43180712d0 0x7f431814ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f4317400640 1 --2- 172.21.15.175:0/2492435387 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43180ae660 0x7f43181488a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f431d000640 1 -- 172.21.15.175:0/2492435387 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43180ae660 msgr2=0x7f43181488a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f431d000640 1 --2- 172.21.15.175:0/2492435387 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43180ae660 0x7f43181488a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f431d000640 1 -- 172.21.15.175:0/2492435387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43180712d0 msgr2=0x7f431814ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f431d000640 1 --2- 172.21.15.175:0/2492435387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43180712d0 0x7f431814ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f431d000640 1 -- 172.21.15.175:0/2492435387 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4318149e10 con 0x7f4318161360 2024-04-25T09:09:54.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f4317e00640 1 --2- 172.21.15.175:0/2492435387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43180712d0 0x7f431814ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:54.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f4317400640 1 --2- 172.21.15.175:0/2492435387 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43180ae660 0x7f43181488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:54.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f431d000640 1 --2- 172.21.15.175:0/2492435387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4318161360 0x7f4318151020 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f431000c7d0 tx=0x7f431000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:54.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f430fe00640 1 -- 172.21.15.175:0/2492435387 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310018070 con 0x7f4318161360 2024-04-25T09:09:54.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f430fe00640 1 -- 172.21.15.175:0/2492435387 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431000a640 con 0x7f4318161360 2024-04-25T09:09:54.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f430fe00640 1 -- 172.21.15.175:0/2492435387 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431000aa30 con 0x7f4318161360 2024-04-25T09:09:54.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f431f000640 1 -- 172.21.15.175:0/2492435387 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f431814a0f0 con 0x7f4318161360 2024-04-25T09:09:54.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f431f000640 1 -- 172.21.15.175:0/2492435387 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43181504c0 con 0x7f4318161360 2024-04-25T09:09:54.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.539+0000 7f431f000640 1 -- 172.21.15.175:0/2492435387 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4318075160 con 0x7f4318161360 2024-04-25T09:09:54.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.543+0000 7f430fe00640 1 -- 172.21.15.175:0/2492435387 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f431000abd0 con 0x7f4318161360 2024-04-25T09:09:54.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.543+0000 7f430fe00640 1 --2- 172.21.15.175:0/2492435387 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f42f8066f60 0x7f42f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.543+0000 7f430fe00640 1 -- 172.21.15.175:0/2492435387 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f43100843d0 con 0x7f4318161360 2024-04-25T09:09:54.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.543+0000 7f4317e00640 1 --2- 172.21.15.175:0/2492435387 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f42f8066f60 0x7f42f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.543+0000 7f4317e00640 1 --2- 172.21.15.175:0/2492435387 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f42f8066f60 0x7f42f8069420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f43080ae000 tx=0x7f43080a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:54.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.547+0000 7f430fe00640 1 -- 172.21.15.175:0/2492435387 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4310055670 con 0x7f4318161360 2024-04-25T09:09:54.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.711+0000 7f431f000640 1 -- 172.21.15.175:0/2492435387 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f43180d02a0 con 0x7f4318161360 2024-04-25T09:09:54.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.715+0000 7f430fe00640 1 -- 172.21.15.175:0/2492435387 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4310054f70 con 0x7f4318161360 2024-04-25T09:09:54.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.715+0000 7f431f000640 1 -- 172.21.15.175:0/2492435387 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f42f8066f60 msgr2=0x7f42f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.715+0000 7f431f000640 1 --2- 172.21.15.175:0/2492435387 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f42f8066f60 0x7f42f8069420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f43080ae000 tx=0x7f43080a7000 comp rx=0 tx=0).stop 2024-04-25T09:09:54.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.715+0000 7f431f000640 1 -- 172.21.15.175:0/2492435387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4318161360 msgr2=0x7f4318151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.715+0000 7f431f000640 1 --2- 172.21.15.175:0/2492435387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4318161360 0x7f4318151020 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f431000c7d0 tx=0x7f431000cc90 comp rx=0 tx=0).stop 2024-04-25T09:09:54.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.715+0000 7f431f000640 1 -- 172.21.15.175:0/2492435387 shutdown_connections 2024-04-25T09:09:54.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.715+0000 7f431f000640 1 --2- 172.21.15.175:0/2492435387 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f42f8066f60 0x7f42f8069420 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.715+0000 7f431f000640 1 --2- 172.21.15.175:0/2492435387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4318161360 0x7f4318151020 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.715+0000 7f431f000640 1 --2- 172.21.15.175:0/2492435387 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f43180ae660 0x7f43181488a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.715+0000 7f431f000640 1 --2- 172.21.15.175:0/2492435387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f43180712d0 0x7f431814ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.715+0000 7f431f000640 1 -- 172.21.15.175:0/2492435387 >> 172.21.15.175:0/2492435387 conn(0x7f431806ac50 msgr2=0x7f431815f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:54.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.715+0000 7f431f000640 1 -- 172.21.15.175:0/2492435387 shutdown_connections 2024-04-25T09:09:54.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.715+0000 7f431f000640 1 -- 172.21.15.175:0/2492435387 wait complete. 2024-04-25T09:09:54.725 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-04-25T09:09:54.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.871+0000 7f7a48000640 1 Processor -- start 2024-04-25T09:09:54.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.871+0000 7f7a48000640 1 -- start start 2024-04-25T09:09:54.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.871+0000 7f7a48000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a4015dbd0 0x7f7a40071c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.871+0000 7f7a48000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7a400ae680 0x7f7a400aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.871+0000 7f7a48000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a4015dfb0 con 0x7f7a400acd80 2024-04-25T09:09:54.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.871+0000 7f7a48000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a400cf670 con 0x7f7a400ae680 2024-04-25T09:09:54.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.871+0000 7f7a48000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400b3590 con 0x7f7a4015dbd0 2024-04-25T09:09:54.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.871+0000 7f7a45600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a4015dbd0 0x7f7a40071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.871+0000 7f7a44c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7a400ae680 0x7f7a400aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.871+0000 7f7a46000640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f7a400acd80 0x7f7a400ad210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:48378/0 (socket says 172.21.15.175:48378) 2024-04-25T09:09:54.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.871+0000 7f7a45600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a4015dbd0 0x7f7a40071c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:41428/0 (socket says 172.21.15.175:41428) 2024-04-25T09:09:54.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.871+0000 7f7a46000640 1 -- 172.21.15.175:0/3790266945 learned_addr learned my addr 172.21.15.175:0/3790266945 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:54.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.875+0000 7f7a3fe00640 1 -- 172.21.15.175:0/3790266945 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879512839 0 0) 0x7f7a4015dfb0 con 0x7f7a400acd80 2024-04-25T09:09:54.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.875+0000 7f7a3fe00640 1 -- 172.21.15.175:0/3790266945 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a28003530 con 0x7f7a400acd80 2024-04-25T09:09:54.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.875+0000 7f7a45600640 1 -- 172.21.15.175:0/3790266945 >> v2:172.21.15.177:3300/0 conn(0x7f7a400ae680 msgr2=0x7f7a400aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:54.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.875+0000 7f7a45600640 1 --2- 172.21.15.175:0/3790266945 >> v2:172.21.15.177:3300/0 conn(0x7f7a400ae680 0x7f7a400aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.875+0000 7f7a45600640 1 -- 172.21.15.175:0/3790266945 >> v1:172.21.15.177:6789/0 conn(0x7f7a400acd80 legacy=0x7f7a400ad210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.875+0000 7f7a45600640 1 -- 172.21.15.175:0/3790266945 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a400b2980 con 0x7f7a4015dbd0 2024-04-25T09:09:54.864 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.875+0000 7f7a44c00640 1 --2- 172.21.15.175:0/3790266945 >> v2:172.21.15.177:3300/0 conn(0x7f7a400ae680 0x7f7a400aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:54.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.875+0000 7f7a45600640 1 --2- 172.21.15.175:0/3790266945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a4015dbd0 0x7f7a40071c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7a340097c0 tx=0x7f7a3401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d0c9cac59d3fc00 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:54.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.875+0000 7f7a3fe00640 1 -- 172.21.15.175:0/3790266945 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a340b2070 con 0x7f7a4015dbd0 2024-04-25T09:09:54.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.875+0000 7f7a3fe00640 1 -- 172.21.15.175:0/3790266945 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a340ad640 con 0x7f7a4015dbd0 2024-04-25T09:09:54.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.875+0000 7f7a3fe00640 1 -- 172.21.15.175:0/3790266945 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a340ad9f0 con 0x7f7a4015dbd0 2024-04-25T09:09:54.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.875+0000 7f7a48000640 1 -- 172.21.15.175:0/3790266945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a4015dbd0 msgr2=0x7f7a40071c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.875+0000 7f7a48000640 1 --2- 172.21.15.175:0/3790266945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a4015dbd0 0x7f7a40071c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7a340097c0 tx=0x7f7a3401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a48000640 1 -- 172.21.15.175:0/3790266945 shutdown_connections 2024-04-25T09:09:54.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a48000640 1 --2- 172.21.15.175:0/3790266945 >> v2:172.21.15.177:3300/0 conn(0x7f7a400ae680 0x7f7a400aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a48000640 1 --2- 172.21.15.175:0/3790266945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a4015dbd0 0x7f7a40071c50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a48000640 1 -- 172.21.15.175:0/3790266945 >> 172.21.15.175:0/3790266945 conn(0x7f7a40067150 msgr2=0x7f7a4006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:54.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a48000640 1 -- 172.21.15.175:0/3790266945 shutdown_connections 2024-04-25T09:09:54.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a48000640 1 -- 172.21.15.175:0/3790266945 wait complete. 2024-04-25T09:09:54.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a48000640 1 Processor -- start 2024-04-25T09:09:54.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a48000640 1 -- start start 2024-04-25T09:09:54.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a48000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a400ae680 0x7f7a400cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a48000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a4015dbd0 0x7f7a40156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a48000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a40156b80 0x7f7a400cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a48000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400b2580 con 0x7f7a40156b80 2024-04-25T09:09:54.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a48000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a40072190 con 0x7f7a400ae680 2024-04-25T09:09:54.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a48000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400b2700 con 0x7f7a4015dbd0 2024-04-25T09:09:54.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a46000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a40156b80 0x7f7a400cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a46000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a40156b80 0x7f7a400cdb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34348/0 (socket says 172.21.15.175:34348) 2024-04-25T09:09:54.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a46000640 1 -- 172.21.15.175:0/2900829036 learned_addr learned my addr 172.21.15.175:0/2900829036 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:54.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a45600640 1 --2- 172.21.15.175:0/2900829036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a400ae680 0x7f7a400cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a44c00640 1 --2- 172.21.15.175:0/2900829036 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a4015dbd0 0x7f7a40156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a46000640 1 -- 172.21.15.175:0/2900829036 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a4015dbd0 msgr2=0x7f7a40156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a46000640 1 --2- 172.21.15.175:0/2900829036 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a4015dbd0 0x7f7a40156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a46000640 1 -- 172.21.15.175:0/2900829036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a400ae680 msgr2=0x7f7a400cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a46000640 1 --2- 172.21.15.175:0/2900829036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a400ae680 0x7f7a400cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a46000640 1 -- 172.21.15.175:0/2900829036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a400ce9c0 con 0x7f7a40156b80 2024-04-25T09:09:54.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a46000640 1 --2- 172.21.15.175:0/2900829036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a40156b80 0x7f7a400cdb90 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f7a3800caa0 tx=0x7f7a3800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:54.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a3d600640 1 -- 172.21.15.175:0/2900829036 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a38017070 con 0x7f7a40156b80 2024-04-25T09:09:54.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.879+0000 7f7a3d600640 1 -- 172.21.15.175:0/2900829036 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3800ac00 con 0x7f7a40156b80 2024-04-25T09:09:54.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.883+0000 7f7a48000640 1 -- 172.21.15.175:0/2900829036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4014df40 con 0x7f7a40156b80 2024-04-25T09:09:54.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.883+0000 7f7a3d600640 1 -- 172.21.15.175:0/2900829036 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a38012400 con 0x7f7a40156b80 2024-04-25T09:09:54.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.883+0000 7f7a48000640 1 -- 172.21.15.175:0/2900829036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a401510f0 con 0x7f7a40156b80 2024-04-25T09:09:54.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.883+0000 7f7a48000640 1 -- 172.21.15.175:0/2900829036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a40074a60 con 0x7f7a40156b80 2024-04-25T09:09:54.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.883+0000 7f7a3d600640 1 -- 172.21.15.175:0/2900829036 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7a3801a070 con 0x7f7a40156b80 2024-04-25T09:09:54.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.883+0000 7f7a3d600640 1 --2- 172.21.15.175:0/2900829036 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7a20066f60 0x7f7a20069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.883+0000 7f7a3d600640 1 -- 172.21.15.175:0/2900829036 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7a38084a70 con 0x7f7a40156b80 2024-04-25T09:09:54.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.883+0000 7f7a45600640 1 --2- 172.21.15.175:0/2900829036 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7a20066f60 0x7f7a20069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.883+0000 7f7a45600640 1 --2- 172.21.15.175:0/2900829036 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7a20066f60 0x7f7a20069420 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7a340af000 tx=0x7f7a34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:54.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:54.887+0000 7f7a3d600640 1 -- 172.21.15.175:0/2900829036 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7a380556d0 con 0x7f7a40156b80 2024-04-25T09:09:55.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.095+0000 7f7a48000640 1 -- 172.21.15.175:0/2900829036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) v1 -- 0x7f7a4006acf0 con 0x7f7a40156b80 2024-04-25T09:09:55.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.367+0000 7f7a3d600640 1 -- 172.21.15.175:0/2900829036 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v295) v1 ==== 166+0+0 (secure 0 0 0) 0x7f7a38059770 con 0x7f7a40156b80 2024-04-25T09:09:55.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.371+0000 7f7a48000640 1 -- 172.21.15.175:0/2900829036 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7a20066f60 msgr2=0x7f7a20069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.371+0000 7f7a48000640 1 --2- 172.21.15.175:0/2900829036 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7a20066f60 0x7f7a20069420 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7a340af000 tx=0x7f7a34008040 comp rx=0 tx=0).stop 2024-04-25T09:09:55.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.371+0000 7f7a48000640 1 -- 172.21.15.175:0/2900829036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a40156b80 msgr2=0x7f7a400cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.371+0000 7f7a48000640 1 --2- 172.21.15.175:0/2900829036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a40156b80 0x7f7a400cdb90 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f7a3800caa0 tx=0x7f7a3800cf60 comp rx=0 tx=0).stop 2024-04-25T09:09:55.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.371+0000 7f7a48000640 1 -- 172.21.15.175:0/2900829036 shutdown_connections 2024-04-25T09:09:55.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.371+0000 7f7a48000640 1 --2- 172.21.15.175:0/2900829036 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7a20066f60 0x7f7a20069420 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.371+0000 7f7a48000640 1 --2- 172.21.15.175:0/2900829036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a40156b80 0x7f7a400cdb90 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.371+0000 7f7a48000640 1 --2- 172.21.15.175:0/2900829036 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7a4015dbd0 0x7f7a40156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.371+0000 7f7a48000640 1 --2- 172.21.15.175:0/2900829036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7a400ae680 0x7f7a400cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.371+0000 7f7a48000640 1 -- 172.21.15.175:0/2900829036 >> 172.21.15.175:0/2900829036 conn(0x7f7a400acd80 msgr2=0x7f7a4015fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:55.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.371+0000 7f7a48000640 1 -- 172.21.15.175:0/2900829036 shutdown_connections 2024-04-25T09:09:55.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.371+0000 7f7a48000640 1 -- 172.21.15.175:0/2900829036 wait complete. 2024-04-25T09:09:55.382 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-25T09:09:55.382 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-25T09:09:55.382 INFO:tasks.cephfs_test_runner:test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:09:55.383 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:55.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffad7200640 1 Processor -- start 2024-04-25T09:09:55.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffad7200640 1 -- start start 2024-04-25T09:09:55.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffad7200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ffad0099a50 0x7ffad00cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffad7200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffad015bc10 0x7ffad0099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffad7200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffad009abb0 0x7ffad00cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffad7200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad00d06f0 con 0x7ffad015bc10 2024-04-25T09:09:55.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffad7200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad009a370 con 0x7ffad0099a50 2024-04-25T09:09:55.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffad7200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00cc4c0 con 0x7ffad009abb0 2024-04-25T09:09:55.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffacf400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffad015bc10 0x7ffad0099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffacf400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffad015bc10 0x7ffad0099e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34352/0 (socket says 172.21.15.175:34352) 2024-04-25T09:09:55.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffacf400640 1 -- 172.21.15.175:0/3859723051 learned_addr learned my addr 172.21.15.175:0/3859723051 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:55.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffacfe00640 1 --2- 172.21.15.175:0/3859723051 >> v2:172.21.15.177:3300/0 conn(0x7ffad0099a50 0x7ffad00cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffad5200640 1 --2- 172.21.15.175:0/3859723051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffad009abb0 0x7ffad00cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffacf400640 1 -- 172.21.15.175:0/3859723051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffad009abb0 msgr2=0x7ffad00cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:55.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffacf400640 1 --2- 172.21.15.175:0/3859723051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffad009abb0 0x7ffad00cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffacf400640 1 -- 172.21.15.175:0/3859723051 >> v2:172.21.15.177:3300/0 conn(0x7ffad0099a50 msgr2=0x7ffad00cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:55.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffacf400640 1 --2- 172.21.15.175:0/3859723051 >> v2:172.21.15.177:3300/0 conn(0x7ffad0099a50 0x7ffad00cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffacf400640 1 -- 172.21.15.175:0/3859723051 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad00cc7a0 con 0x7ffad015bc10 2024-04-25T09:09:55.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.531+0000 7ffad5200640 1 --2- 172.21.15.175:0/3859723051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffad009abb0 0x7ffad00cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:55.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.535+0000 7ffacf400640 1 --2- 172.21.15.175:0/3859723051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad015bc10 0x7ffad0099e30 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7ffad00b3fb0 tx=0x7ffabc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81ce3dc00f63ba3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:55.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.535+0000 7ffacea00640 1 -- 172.21.15.175:0/3859723051 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0ab5f0 con 0x7ffad015bc10 2024-04-25T09:09:55.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.535+0000 7ffacea00640 1 -- 172.21.15.175:0/3859723051 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc0b0070 con 0x7ffad015bc10 2024-04-25T09:09:55.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.535+0000 7ffacea00640 1 -- 172.21.15.175:0/3859723051 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0ab9b0 con 0x7ffad015bc10 2024-04-25T09:09:55.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.535+0000 7ffad7200640 1 -- 172.21.15.175:0/3859723051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad015bc10 msgr2=0x7ffad0099e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.535+0000 7ffad7200640 1 --2- 172.21.15.175:0/3859723051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad015bc10 0x7ffad0099e30 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7ffad00b3fb0 tx=0x7ffabc01c520 comp rx=0 tx=0).stop 2024-04-25T09:09:55.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.535+0000 7ffad7200640 1 -- 172.21.15.175:0/3859723051 shutdown_connections 2024-04-25T09:09:55.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.535+0000 7ffad7200640 1 --2- 172.21.15.175:0/3859723051 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffad009abb0 0x7ffad00cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.535+0000 7ffad7200640 1 --2- 172.21.15.175:0/3859723051 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad015bc10 0x7ffad0099e30 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.535+0000 7ffad7200640 1 --2- 172.21.15.175:0/3859723051 >> v2:172.21.15.177:3300/0 conn(0x7ffad0099a50 0x7ffad00cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.535+0000 7ffad7200640 1 -- 172.21.15.175:0/3859723051 >> 172.21.15.175:0/3859723051 conn(0x7ffad00b3300 msgr2=0x7ffad00b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:55.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.535+0000 7ffad7200640 1 -- 172.21.15.175:0/3859723051 shutdown_connections 2024-04-25T09:09:55.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.535+0000 7ffad7200640 1 -- 172.21.15.175:0/3859723051 wait complete. 2024-04-25T09:09:55.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.535+0000 7ffad7200640 1 Processor -- start 2024-04-25T09:09:55.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.535+0000 7ffad7200640 1 -- start start 2024-04-25T09:09:55.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffad7200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffad0099a50 0x7ffad00c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffad7200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad009abb0 0x7ffad015e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffad7200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffad015bc10 0x7ffad01f65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffad7200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00c5cf0 con 0x7ffad009abb0 2024-04-25T09:09:55.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffad7200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00c5b70 con 0x7ffad015bc10 2024-04-25T09:09:55.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffad7200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00c5e70 con 0x7ffad0099a50 2024-04-25T09:09:55.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffacf400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad009abb0 0x7ffad015e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffacf400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad009abb0 0x7ffad015e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34366/0 (socket says 172.21.15.175:34366) 2024-04-25T09:09:55.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffacf400640 1 -- 172.21.15.175:0/2722226943 learned_addr learned my addr 172.21.15.175:0/2722226943 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:55.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffacfe00640 1 --2- 172.21.15.175:0/2722226943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffad0099a50 0x7ffad00c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffad5200640 1 --2- 172.21.15.175:0/2722226943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffad015bc10 0x7ffad01f65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffacf400640 1 -- 172.21.15.175:0/2722226943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffad0099a50 msgr2=0x7ffad00c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffacf400640 1 --2- 172.21.15.175:0/2722226943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffad0099a50 0x7ffad00c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffacf400640 1 -- 172.21.15.175:0/2722226943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffad015bc10 msgr2=0x7ffad01f65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffacf400640 1 --2- 172.21.15.175:0/2722226943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffad015bc10 0x7ffad01f65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffacf400640 1 -- 172.21.15.175:0/2722226943 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad00c6b80 con 0x7ffad009abb0 2024-04-25T09:09:55.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffacf400640 1 --2- 172.21.15.175:0/2722226943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad009abb0 0x7ffad015e880 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7ffabc01cdc0 tx=0x7ffabc0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:55.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffac7e00640 1 -- 172.21.15.175:0/2722226943 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0bf410 con 0x7ffad009abb0 2024-04-25T09:09:55.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffac7e00640 1 -- 172.21.15.175:0/2722226943 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc0bf5b0 con 0x7ffad009abb0 2024-04-25T09:09:55.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffac7e00640 1 -- 172.21.15.175:0/2722226943 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0bf9a0 con 0x7ffad009abb0 2024-04-25T09:09:55.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffad7200640 1 -- 172.21.15.175:0/2722226943 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad00c8cc0 con 0x7ffad009abb0 2024-04-25T09:09:55.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffad7200640 1 -- 172.21.15.175:0/2722226943 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad00c6e40 con 0x7ffad009abb0 2024-04-25T09:09:55.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.539+0000 7ffad7200640 1 -- 172.21.15.175:0/2722226943 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad0074a60 con 0x7ffad009abb0 2024-04-25T09:09:55.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.543+0000 7ffac7e00640 1 -- 172.21.15.175:0/2722226943 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffabc0bd020 con 0x7ffad009abb0 2024-04-25T09:09:55.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.543+0000 7ffac7e00640 1 --2- 172.21.15.175:0/2722226943 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffab0066f90 0x7ffab0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.543+0000 7ffac7e00640 1 -- 172.21.15.175:0/2722226943 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ffabc11ead0 con 0x7ffad009abb0 2024-04-25T09:09:55.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.543+0000 7ffacfe00640 1 --2- 172.21.15.175:0/2722226943 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffab0066f90 0x7ffab0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.543+0000 7ffacfe00640 1 --2- 172.21.15.175:0/2722226943 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffab0066f90 0x7ffab0069450 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009a40 tx=0x7ffac0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:55.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.547+0000 7ffac7e00640 1 -- 172.21.15.175:0/2722226943 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffabc0c6070 con 0x7ffad009abb0 2024-04-25T09:09:55.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.711+0000 7ffad7200640 1 -- 172.21.15.175:0/2722226943 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffad00cedc0 con 0x7ffad009abb0 2024-04-25T09:09:55.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.711+0000 7ffac7e00640 1 -- 172.21.15.175:0/2722226943 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+13191 (secure 0 0 0) 0x7ffabc016110 con 0x7ffad009abb0 2024-04-25T09:09:55.700 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:09:55.700 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":75,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:09:54.366382+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6834/2714482688":"2024-04-26T09:09:51.354540+0000","172.21.15.177:6835/1709110121":"2024-04-26T09:08:32.433027+0000","172.21.15.175:6836/2714482688":"2024-04-26T09:09:51.354540+0000","172.21.15.177:6833/1709110121":"2024-04-26T09:08:32.433027+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:55.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.711+0000 7ffad7200640 1 -- 172.21.15.175:0/2722226943 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffab0066f90 msgr2=0x7ffab0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.711+0000 7ffad7200640 1 --2- 172.21.15.175:0/2722226943 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffab0066f90 0x7ffab0069450 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009a40 tx=0x7ffac0009190 comp rx=0 tx=0).stop 2024-04-25T09:09:55.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.711+0000 7ffad7200640 1 -- 172.21.15.175:0/2722226943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad009abb0 msgr2=0x7ffad015e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.711+0000 7ffad7200640 1 --2- 172.21.15.175:0/2722226943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad009abb0 0x7ffad015e880 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7ffabc01cdc0 tx=0x7ffabc0192c0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.711+0000 7ffad7200640 1 -- 172.21.15.175:0/2722226943 shutdown_connections 2024-04-25T09:09:55.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.711+0000 7ffad7200640 1 --2- 172.21.15.175:0/2722226943 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffab0066f90 0x7ffab0069450 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.711+0000 7ffad7200640 1 --2- 172.21.15.175:0/2722226943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffad015bc10 0x7ffad01f65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.711+0000 7ffad7200640 1 --2- 172.21.15.175:0/2722226943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffad009abb0 0x7ffad015e880 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.711+0000 7ffad7200640 1 --2- 172.21.15.175:0/2722226943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffad0099a50 0x7ffad00c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.711+0000 7ffad7200640 1 -- 172.21.15.175:0/2722226943 >> 172.21.15.175:0/2722226943 conn(0x7ffad00b3300 msgr2=0x7ffad006f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:55.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.711+0000 7ffad7200640 1 -- 172.21.15.175:0/2722226943 shutdown_connections 2024-04-25T09:09:55.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.711+0000 7ffad7200640 1 -- 172.21.15.175:0/2722226943 wait complete. 2024-04-25T09:09:55.722 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:09:55.722 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:09:55.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.871+0000 7f36e1000640 1 Processor -- start 2024-04-25T09:09:55.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.871+0000 7f36e1000640 1 -- start start 2024-04-25T09:09:55.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.871+0000 7f36e1000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f36dc145250 0x7f36dc0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.871+0000 7f36e1000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36dc1600a0 0x7f36dc0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.871+0000 7f36e1000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36dc0cfd10 con 0x7f36dc0ce970 2024-04-25T09:09:55.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.871+0000 7f36e1000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36dc15f650 con 0x7f36dc145250 2024-04-25T09:09:55.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.871+0000 7f36e1000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36dc0cfff0 con 0x7f36dc1600a0 2024-04-25T09:09:55.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.871+0000 7f36d9400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36dc1600a0 0x7f36dc0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.871+0000 7f36d9e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f36dc145250 0x7f36dc0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.871+0000 7f36d9400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36dc1600a0 0x7f36dc0cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:41456/0 (socket says 172.21.15.175:41456) 2024-04-25T09:09:55.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.871+0000 7f36d9400640 1 -- 172.21.15.175:0/1184461094 learned_addr learned my addr 172.21.15.175:0/1184461094 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:55.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.871+0000 7f36d9e00640 1 -- 172.21.15.175:0/1184461094 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36dc1600a0 msgr2=0x7f36dc0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:55.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.871+0000 7f36d9e00640 1 --2- 172.21.15.175:0/1184461094 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36dc1600a0 0x7f36dc0cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.871+0000 7f36d9e00640 1 -- 172.21.15.175:0/1184461094 >> v1:172.21.15.177:6789/0 conn(0x7f36dc0ce970 legacy=0x7f36dc0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.871+0000 7f36d9e00640 1 -- 172.21.15.175:0/1184461094 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36dc15f8a0 con 0x7f36dc145250 2024-04-25T09:09:55.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.875+0000 7f36d9e00640 1 --2- 172.21.15.175:0/1184461094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36dc145250 0x7f36dc0cf6b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f36cc0097c0 tx=0x7f36cc01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94784c0a79b1be5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:55.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.875+0000 7f36d8a00640 1 -- 172.21.15.175:0/1184461094 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc0ab600 con 0x7f36dc145250 2024-04-25T09:09:55.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.875+0000 7f36d8a00640 1 -- 172.21.15.175:0/1184461094 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36cc0b0070 con 0x7f36dc145250 2024-04-25T09:09:55.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.875+0000 7f36d8a00640 1 -- 172.21.15.175:0/1184461094 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36cc0ab9c0 con 0x7f36dc145250 2024-04-25T09:09:55.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.875+0000 7f36e1000640 1 -- 172.21.15.175:0/1184461094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36dc145250 msgr2=0x7f36dc0cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.875+0000 7f36e1000640 1 --2- 172.21.15.175:0/1184461094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36dc145250 0x7f36dc0cf6b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f36cc0097c0 tx=0x7f36cc01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.875+0000 7f36e1000640 1 -- 172.21.15.175:0/1184461094 shutdown_connections 2024-04-25T09:09:55.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.875+0000 7f36e1000640 1 --2- 172.21.15.175:0/1184461094 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36dc1600a0 0x7f36dc0cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.875+0000 7f36e1000640 1 --2- 172.21.15.175:0/1184461094 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36dc145250 0x7f36dc0cf6b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.875+0000 7f36e1000640 1 -- 172.21.15.175:0/1184461094 >> 172.21.15.175:0/1184461094 conn(0x7f36dc06ac50 msgr2=0x7f36dc06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:55.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.875+0000 7f36e1000640 1 -- 172.21.15.175:0/1184461094 shutdown_connections 2024-04-25T09:09:55.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.875+0000 7f36e1000640 1 -- 172.21.15.175:0/1184461094 wait complete. 2024-04-25T09:09:55.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36e1000640 1 Processor -- start 2024-04-25T09:09:55.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36e1000640 1 -- start start 2024-04-25T09:09:55.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36e1000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36dc0ce970 0x7f36dc13e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36e1000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36dc145250 0x7f36dc0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36e1000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36dc1600a0 0x7f36dc164b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36e1000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36dc160600 con 0x7f36dc145250 2024-04-25T09:09:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36e1000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36dc160480 con 0x7f36dc1600a0 2024-04-25T09:09:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36e1000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36dc15c870 con 0x7f36dc0ce970 2024-04-25T09:09:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36d9400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36dc145250 0x7f36dc0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36d9400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36dc145250 0x7f36dc0b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34370/0 (socket says 172.21.15.175:34370) 2024-04-25T09:09:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36d9400640 1 -- 172.21.15.175:0/3873515517 learned_addr learned my addr 172.21.15.175:0/3873515517 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36da800640 1 --2- 172.21.15.175:0/3873515517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36dc1600a0 0x7f36dc164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36d9e00640 1 --2- 172.21.15.175:0/3873515517 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36dc0ce970 0x7f36dc13e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36d9400640 1 -- 172.21.15.175:0/3873515517 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36dc0ce970 msgr2=0x7f36dc13e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36d9400640 1 --2- 172.21.15.175:0/3873515517 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36dc0ce970 0x7f36dc13e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36d9400640 1 -- 172.21.15.175:0/3873515517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36dc1600a0 msgr2=0x7f36dc164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36d9400640 1 --2- 172.21.15.175:0/3873515517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36dc1600a0 0x7f36dc164b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36d9400640 1 -- 172.21.15.175:0/3873515517 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36dc1f6230 con 0x7f36dc145250 2024-04-25T09:09:55.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36d9400640 1 --2- 172.21.15.175:0/3873515517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36dc145250 0x7f36dc0b2760 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f36c800e7f0 tx=0x7f36c800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:55.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36d2000640 1 -- 172.21.15.175:0/3873515517 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c8017070 con 0x7f36dc145250 2024-04-25T09:09:55.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36d2000640 1 -- 172.21.15.175:0/3873515517 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c800c940 con 0x7f36dc145250 2024-04-25T09:09:55.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36d2000640 1 -- 172.21.15.175:0/3873515517 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c800cd30 con 0x7f36dc145250 2024-04-25T09:09:55.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36e1000640 1 -- 172.21.15.175:0/3873515517 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36dc1f6510 con 0x7f36dc145250 2024-04-25T09:09:55.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.879+0000 7f36e1000640 1 -- 172.21.15.175:0/3873515517 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36dc1f6ad0 con 0x7f36dc145250 2024-04-25T09:09:55.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.883+0000 7f36e1000640 1 -- 172.21.15.175:0/3873515517 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36dc075160 con 0x7f36dc145250 2024-04-25T09:09:55.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.883+0000 7f36d2000640 1 -- 172.21.15.175:0/3873515517 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f36c801a070 con 0x7f36dc145250 2024-04-25T09:09:55.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.883+0000 7f36d2000640 1 --2- 172.21.15.175:0/3873515517 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f36bc066f60 0x7f36bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.883+0000 7f36d2000640 1 -- 172.21.15.175:0/3873515517 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f36c8084fc0 con 0x7f36dc145250 2024-04-25T09:09:55.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.883+0000 7f36d9e00640 1 --2- 172.21.15.175:0/3873515517 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f36bc066f60 0x7f36bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.883+0000 7f36d9e00640 1 --2- 172.21.15.175:0/3873515517 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f36bc066f60 0x7f36bc069420 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f36cc0af000 tx=0x7f36cc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:55.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:55.887+0000 7f36d2000640 1 -- 172.21.15.175:0/3873515517 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f36c8055c10 con 0x7f36dc145250 2024-04-25T09:09:56.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.043+0000 7f36e1000640 1 -- 172.21.15.175:0/3873515517 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36dc06b0d0 con 0x7f36dc145250 2024-04-25T09:09:56.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.043+0000 7f36d2000640 1 -- 172.21.15.175:0/3873515517 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f36c8059cb0 con 0x7f36dc145250 2024-04-25T09:09:56.033 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:09:56.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.047+0000 7f36e1000640 1 -- 172.21.15.175:0/3873515517 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f36bc066f60 msgr2=0x7f36bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.047+0000 7f36e1000640 1 --2- 172.21.15.175:0/3873515517 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f36bc066f60 0x7f36bc069420 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f36cc0af000 tx=0x7f36cc0a7000 comp rx=0 tx=0).stop 2024-04-25T09:09:56.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.047+0000 7f36e1000640 1 -- 172.21.15.175:0/3873515517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36dc145250 msgr2=0x7f36dc0b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.047+0000 7f36e1000640 1 --2- 172.21.15.175:0/3873515517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36dc145250 0x7f36dc0b2760 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f36c800e7f0 tx=0x7f36c800ecb0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.047+0000 7f36e1000640 1 -- 172.21.15.175:0/3873515517 shutdown_connections 2024-04-25T09:09:56.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.047+0000 7f36e1000640 1 --2- 172.21.15.175:0/3873515517 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f36bc066f60 0x7f36bc069420 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.047+0000 7f36e1000640 1 --2- 172.21.15.175:0/3873515517 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36dc1600a0 0x7f36dc164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.047+0000 7f36e1000640 1 --2- 172.21.15.175:0/3873515517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36dc145250 0x7f36dc0b2760 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.047+0000 7f36e1000640 1 --2- 172.21.15.175:0/3873515517 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36dc0ce970 0x7f36dc13e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.047+0000 7f36e1000640 1 -- 172.21.15.175:0/3873515517 >> 172.21.15.175:0/3873515517 conn(0x7f36dc06ac50 msgr2=0x7f36dc06ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:56.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.047+0000 7f36e1000640 1 -- 172.21.15.175:0/3873515517 shutdown_connections 2024-04-25T09:09:56.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.047+0000 7f36e1000640 1 -- 172.21.15.175:0/3873515517 wait complete. 2024-04-25T09:09:56.054 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-04-25T09:09:56.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.199+0000 7f9d95800640 1 Processor -- start 2024-04-25T09:09:56.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.199+0000 7f9d95800640 1 -- start start 2024-04-25T09:09:56.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.203+0000 7f9d95800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9d900cfc70 0x7f9d9006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.203+0000 7f9d95800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d900cda00 con 0x7f9d9015a900 2024-04-25T09:09:56.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.203+0000 7f9d95800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d900cdce0 con 0x7f9d900cd520 2024-04-25T09:09:56.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.203+0000 7f9d95800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d9015bcf0 con 0x7f9d900cfc70 2024-04-25T09:09:56.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.203+0000 7f9d8ea00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f9d9015a900 0x7f9d900ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53354/0 (socket says 172.21.15.175:53354) 2024-04-25T09:09:56.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.203+0000 7f9d8ea00640 1 -- 172.21.15.175:0/714936681 learned_addr learned my addr 172.21.15.175:0/714936681 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:56.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.203+0000 7f9d8f400640 1 --2- 172.21.15.175:0/714936681 >> v2:172.21.15.177:3300/0 conn(0x7f9d900cfc70 0x7f9d9006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.203+0000 7f9d8e000640 1 -- 172.21.15.175:0/714936681 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561945607 0 0) 0x7f9d900cda00 con 0x7f9d9015a900 2024-04-25T09:09:56.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.203+0000 7f9d8e000640 1 -- 172.21.15.175:0/714936681 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d74003530 con 0x7f9d9015a900 2024-04-25T09:09:56.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.203+0000 7f9d8e000640 1 -- 172.21.15.175:0/714936681 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 758257380 0 0) 0x7f9d900cdce0 con 0x7f9d900cd520 2024-04-25T09:09:56.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.203+0000 7f9d8e000640 1 -- 172.21.15.175:0/714936681 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d900cda00 con 0x7f9d900cd520 2024-04-25T09:09:56.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.203+0000 7f9d8e000640 1 -- 172.21.15.175:0/714936681 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4149338723 0 0) 0x7f9d74003530 con 0x7f9d9015a900 2024-04-25T09:09:56.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.203+0000 7f9d8f400640 1 -- 172.21.15.175:0/714936681 >> v1:172.21.15.177:6789/0 conn(0x7f9d900cd520 legacy=0x7f9d900cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.203+0000 7f9d8f400640 1 -- 172.21.15.175:0/714936681 >> v1:172.21.15.175:6789/0 conn(0x7f9d9015a900 legacy=0x7f9d900ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.203+0000 7f9d8f400640 1 -- 172.21.15.175:0/714936681 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d900cdfc0 con 0x7f9d900cfc70 2024-04-25T09:09:56.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d8f400640 1 --2- 172.21.15.175:0/714936681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d900cfc70 0x7f9d9006e150 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009d90 tx=0x7f9d8801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=420ab3d1911d7966 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:56.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d8e000640 1 -- 172.21.15.175:0/714936681 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d880b2070 con 0x7f9d900cfc70 2024-04-25T09:09:56.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d8e000640 1 -- 172.21.15.175:0/714936681 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d880a55c0 con 0x7f9d900cfc70 2024-04-25T09:09:56.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d8e000640 1 -- 172.21.15.175:0/714936681 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80001680 con 0x7f9d900cfc70 2024-04-25T09:09:56.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d95800640 1 -- 172.21.15.175:0/714936681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d900cfc70 msgr2=0x7f9d9006e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d95800640 1 --2- 172.21.15.175:0/714936681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d900cfc70 0x7f9d9006e150 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009d90 tx=0x7f9d8801c890 comp rx=0 tx=0).stop 2024-04-25T09:09:56.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d95800640 1 -- 172.21.15.175:0/714936681 shutdown_connections 2024-04-25T09:09:56.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d95800640 1 --2- 172.21.15.175:0/714936681 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d900cfc70 0x7f9d9006e150 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d95800640 1 -- 172.21.15.175:0/714936681 >> 172.21.15.175:0/714936681 conn(0x7f9d90067150 msgr2=0x7f9d9006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:56.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d95800640 1 -- 172.21.15.175:0/714936681 shutdown_connections 2024-04-25T09:09:56.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d95800640 1 -- 172.21.15.175:0/714936681 wait complete. 2024-04-25T09:09:56.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d95800640 1 Processor -- start 2024-04-25T09:09:56.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d95800640 1 -- start start 2024-04-25T09:09:56.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d95800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d900cfc70 0x7f9d9014ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d95800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d9015a900 0x7f9d9013b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d95800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d900714a0 0x7f9d90137f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d95800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9015c910 con 0x7f9d900cfc70 2024-04-25T09:09:56.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d95800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9015c790 con 0x7f9d9015a900 2024-04-25T09:09:56.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d95800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d90168410 con 0x7f9d900714a0 2024-04-25T09:09:56.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.207+0000 7f9d8ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d900cfc70 0x7f9d9014ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d8ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d900cfc70 0x7f9d9014ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34378/0 (socket says 172.21.15.175:34378) 2024-04-25T09:09:56.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d8ea00640 1 -- 172.21.15.175:0/3618170752 learned_addr learned my addr 172.21.15.175:0/3618170752 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:56.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d86000640 1 --2- 172.21.15.175:0/3618170752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d9015a900 0x7f9d9013b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d8f400640 1 --2- 172.21.15.175:0/3618170752 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d900714a0 0x7f9d90137f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d8ea00640 1 -- 172.21.15.175:0/3618170752 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d900714a0 msgr2=0x7f9d90137f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d8ea00640 1 --2- 172.21.15.175:0/3618170752 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d900714a0 0x7f9d90137f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d8ea00640 1 -- 172.21.15.175:0/3618170752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d9015a900 msgr2=0x7f9d9013b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d8ea00640 1 --2- 172.21.15.175:0/3618170752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d9015a900 0x7f9d9013b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d8ea00640 1 -- 172.21.15.175:0/3618170752 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9013bb80 con 0x7f9d900cfc70 2024-04-25T09:09:56.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d86000640 1 --2- 172.21.15.175:0/3618170752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d9015a900 0x7f9d9013b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:56.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d8ea00640 1 --2- 172.21.15.175:0/3618170752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d900cfc70 0x7f9d9014ccb0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000c730 tx=0x7f9d8000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:56.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d87400640 1 -- 172.21.15.175:0/3618170752 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80017070 con 0x7f9d900cfc70 2024-04-25T09:09:56.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d87400640 1 -- 172.21.15.175:0/3618170752 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d80005ae0 con 0x7f9d900cfc70 2024-04-25T09:09:56.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d95800640 1 -- 172.21.15.175:0/3618170752 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9014d290 con 0x7f9d900cfc70 2024-04-25T09:09:56.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d87400640 1 -- 172.21.15.175:0/3618170752 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d80007070 con 0x7f9d900cfc70 2024-04-25T09:09:56.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d95800640 1 -- 172.21.15.175:0/3618170752 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9014d850 con 0x7f9d900cfc70 2024-04-25T09:09:56.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d95800640 1 -- 172.21.15.175:0/3618170752 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d90074a60 con 0x7f9d900cfc70 2024-04-25T09:09:56.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d87400640 1 -- 172.21.15.175:0/3618170752 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9d8001a070 con 0x7f9d900cfc70 2024-04-25T09:09:56.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d87400640 1 --2- 172.21.15.175:0/3618170752 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9d6c066f60 0x7f9d6c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.211+0000 7f9d87400640 1 -- 172.21.15.175:0/3618170752 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9d80084260 con 0x7f9d900cfc70 2024-04-25T09:09:56.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.215+0000 7f9d86000640 1 --2- 172.21.15.175:0/3618170752 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9d6c066f60 0x7f9d6c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.215+0000 7f9d86000640 1 --2- 172.21.15.175:0/3618170752 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9d6c066f60 0x7f9d6c069420 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9d9006deb0 tx=0x7f9d78009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:56.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.215+0000 7f9d87400640 1 -- 172.21.15.175:0/3618170752 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9d9013bb80 con 0x7f9d900cfc70 2024-04-25T09:09:56.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:56.427+0000 7f9d95800640 1 -- 172.21.15.175:0/3618170752 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) v1 -- 0x7f9d9014f790 con 0x7f9d900cfc70 2024-04-25T09:09:57.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.375+0000 7f9d87400640 1 -- 172.21.15.175:0/3618170752 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v297) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9d80055510 con 0x7f9d900cfc70 2024-04-25T09:09:57.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.379+0000 7f9d95800640 1 -- 172.21.15.175:0/3618170752 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9d6c066f60 msgr2=0x7f9d6c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:57.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.379+0000 7f9d95800640 1 --2- 172.21.15.175:0/3618170752 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9d6c066f60 0x7f9d6c069420 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9d9006deb0 tx=0x7f9d78009040 comp rx=0 tx=0).stop 2024-04-25T09:09:57.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.379+0000 7f9d95800640 1 -- 172.21.15.175:0/3618170752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d900cfc70 msgr2=0x7f9d9014ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:57.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.379+0000 7f9d95800640 1 --2- 172.21.15.175:0/3618170752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d900cfc70 0x7f9d9014ccb0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000c730 tx=0x7f9d8000cbf0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.379+0000 7f9d95800640 1 -- 172.21.15.175:0/3618170752 shutdown_connections 2024-04-25T09:09:57.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.379+0000 7f9d95800640 1 --2- 172.21.15.175:0/3618170752 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9d6c066f60 0x7f9d6c069420 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.379+0000 7f9d95800640 1 --2- 172.21.15.175:0/3618170752 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d900714a0 0x7f9d90137f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.379+0000 7f9d95800640 1 --2- 172.21.15.175:0/3618170752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d9015a900 0x7f9d9013b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.379+0000 7f9d95800640 1 --2- 172.21.15.175:0/3618170752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d900cfc70 0x7f9d9014ccb0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.379+0000 7f9d95800640 1 -- 172.21.15.175:0/3618170752 >> 172.21.15.175:0/3618170752 conn(0x7f9d900cd520 msgr2=0x7f9d9006df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:57.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.383+0000 7f9d95800640 1 -- 172.21.15.175:0/3618170752 shutdown_connections 2024-04-25T09:09:57.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.383+0000 7f9d95800640 1 -- 172.21.15.175:0/3618170752 wait complete. 2024-04-25T09:09:57.394 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:09:57.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.547+0000 7f53b1800640 1 Processor -- start 2024-04-25T09:09:57.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.547+0000 7f53b1800640 1 -- start start 2024-04-25T09:09:57.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.547+0000 7f53b1800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53ac0cbe60 0x7f53ac15af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:57.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.547+0000 7f53b1800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f53ac0b4800 0x7f53ac15c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:57.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.547+0000 7f53b1800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ac06db60 con 0x7f53ac06d310 2024-04-25T09:09:57.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.547+0000 7f53b1800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ac06de40 con 0x7f53ac0b4800 2024-04-25T09:09:57.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.547+0000 7f53b1800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac06e120 con 0x7f53ac0cbe60 2024-04-25T09:09:57.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.547+0000 7f53aa000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f53ac06d310 0x7f53ac0b40f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53364/0 (socket says 172.21.15.175:53364) 2024-04-25T09:09:57.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.547+0000 7f53ab400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f53ac0b4800 0x7f53ac15c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:57.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.547+0000 7f53aa000640 1 -- 172.21.15.175:0/821947942 learned_addr learned my addr 172.21.15.175:0/821947942 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:57.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.547+0000 7f53aaa00640 1 --2- 172.21.15.175:0/821947942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53ac0cbe60 0x7f53ac15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:57.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.547+0000 7f53a9600640 1 -- 172.21.15.175:0/821947942 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902805158 0 0) 0x7f53ac06db60 con 0x7f53ac06d310 2024-04-25T09:09:57.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.547+0000 7f53a9600640 1 -- 172.21.15.175:0/821947942 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5390003530 con 0x7f53ac06d310 2024-04-25T09:09:57.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.547+0000 7f53ab400640 1 -- 172.21.15.175:0/821947942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53ac0cbe60 msgr2=0x7f53ac15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:57.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.547+0000 7f53ab400640 1 --2- 172.21.15.175:0/821947942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53ac0cbe60 0x7f53ac15af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.547+0000 7f53ab400640 1 -- 172.21.15.175:0/821947942 >> v1:172.21.15.175:6789/0 conn(0x7f53ac06d310 legacy=0x7f53ac0b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:57.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.547+0000 7f53ab400640 1 -- 172.21.15.175:0/821947942 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac15c2f0 con 0x7f53ac0b4800 2024-04-25T09:09:57.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.551+0000 7f53ab400640 1 --2- 172.21.15.175:0/821947942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53ac0b4800 0x7f53ac15c810 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009d90 tx=0x7f53a401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a0ebc14d2aa1ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:57.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.551+0000 7f53a9600640 1 -- 172.21.15.175:0/821947942 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40b2070 con 0x7f53ac0b4800 2024-04-25T09:09:57.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.551+0000 7f53a9600640 1 -- 172.21.15.175:0/821947942 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a40a5830 con 0x7f53ac0b4800 2024-04-25T09:09:57.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.551+0000 7f53a9600640 1 -- 172.21.15.175:0/821947942 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40a5be0 con 0x7f53ac0b4800 2024-04-25T09:09:57.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.551+0000 7f53b1800640 1 -- 172.21.15.175:0/821947942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53ac0b4800 msgr2=0x7f53ac15c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:57.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.551+0000 7f53b1800640 1 --2- 172.21.15.175:0/821947942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53ac0b4800 0x7f53ac15c810 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009d90 tx=0x7f53a401c970 comp rx=0 tx=0).stop 2024-04-25T09:09:57.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.551+0000 7f53b1800640 1 -- 172.21.15.175:0/821947942 shutdown_connections 2024-04-25T09:09:57.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.551+0000 7f53b1800640 1 --2- 172.21.15.175:0/821947942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53ac0b4800 0x7f53ac15c810 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.551+0000 7f53b1800640 1 --2- 172.21.15.175:0/821947942 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53ac0cbe60 0x7f53ac15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.551+0000 7f53b1800640 1 -- 172.21.15.175:0/821947942 >> 172.21.15.175:0/821947942 conn(0x7f53ac06ac50 msgr2=0x7f53ac06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:57.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.551+0000 7f53b1800640 1 -- 172.21.15.175:0/821947942 shutdown_connections 2024-04-25T09:09:57.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.551+0000 7f53b1800640 1 -- 172.21.15.175:0/821947942 wait complete. 2024-04-25T09:09:57.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53b1800640 1 Processor -- start 2024-04-25T09:09:57.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53b1800640 1 -- start start 2024-04-25T09:09:57.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53b1800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53ac06d310 0x7f53ac0b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:57.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53b1800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53ac0b4800 0x7f53ac154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:57.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53b1800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53ac0cbe60 0x7f53ac156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:57.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53b1800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac15d970 con 0x7f53ac0cbe60 2024-04-25T09:09:57.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53b1800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac15d7f0 con 0x7f53ac0b4800 2024-04-25T09:09:57.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53b1800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac15daf0 con 0x7f53ac06d310 2024-04-25T09:09:57.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53ab400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53ac0cbe60 0x7f53ac156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:57.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53ab400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53ac0cbe60 0x7f53ac156820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34384/0 (socket says 172.21.15.175:34384) 2024-04-25T09:09:57.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53ab400640 1 -- 172.21.15.175:0/2118280593 learned_addr learned my addr 172.21.15.175:0/2118280593 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:57.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53aaa00640 1 --2- 172.21.15.175:0/2118280593 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53ac06d310 0x7f53ac0b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:57.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53aa000640 1 --2- 172.21.15.175:0/2118280593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53ac0b4800 0x7f53ac154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:57.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53ab400640 1 -- 172.21.15.175:0/2118280593 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53ac06d310 msgr2=0x7f53ac0b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:57.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53ab400640 1 --2- 172.21.15.175:0/2118280593 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53ac06d310 0x7f53ac0b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53ab400640 1 -- 172.21.15.175:0/2118280593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53ac0b4800 msgr2=0x7f53ac154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:57.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53ab400640 1 --2- 172.21.15.175:0/2118280593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53ac0b4800 0x7f53ac154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53ab400640 1 -- 172.21.15.175:0/2118280593 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac155a60 con 0x7f53ac0cbe60 2024-04-25T09:09:57.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53ab400640 1 --2- 172.21.15.175:0/2118280593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53ac0cbe60 0x7f53ac156820 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f53a401b020 tx=0x7f53a4019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:57.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53a2a00640 1 -- 172.21.15.175:0/2118280593 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40b2050 con 0x7f53ac0cbe60 2024-04-25T09:09:57.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53a2a00640 1 -- 172.21.15.175:0/2118280593 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a40be070 con 0x7f53ac0cbe60 2024-04-25T09:09:57.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53a2a00640 1 -- 172.21.15.175:0/2118280593 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40ad850 con 0x7f53ac0cbe60 2024-04-25T09:09:57.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53b1800640 1 -- 172.21.15.175:0/2118280593 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ac155d40 con 0x7f53ac0cbe60 2024-04-25T09:09:57.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.555+0000 7f53b1800640 1 -- 172.21.15.175:0/2118280593 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ac156300 con 0x7f53ac0cbe60 2024-04-25T09:09:57.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.559+0000 7f53b1800640 1 -- 172.21.15.175:0/2118280593 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ac1557d0 con 0x7f53ac0cbe60 2024-04-25T09:09:57.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.559+0000 7f53a2a00640 1 -- 172.21.15.175:0/2118280593 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f53a40ad9f0 con 0x7f53ac0cbe60 2024-04-25T09:09:57.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.559+0000 7f53a2a00640 1 --2- 172.21.15.175:0/2118280593 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f538c066f60 0x7f538c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:57.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.559+0000 7f53a2a00640 1 -- 172.21.15.175:0/2118280593 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f53a411fd10 con 0x7f53ac0cbe60 2024-04-25T09:09:57.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.559+0000 7f53aaa00640 1 --2- 172.21.15.175:0/2118280593 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f538c066f60 0x7f538c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:57.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.559+0000 7f53aaa00640 1 --2- 172.21.15.175:0/2118280593 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f538c066f60 0x7f538c069420 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f539c009b60 tx=0x7f539c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:57.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.563+0000 7f53a2a00640 1 -- 172.21.15.175:0/2118280593 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f53a4125020 con 0x7f53ac0cbe60 2024-04-25T09:09:57.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.715+0000 7f53b1800640 1 -- 172.21.15.175:0/2118280593 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f53ac075160 con 0x7f53ac0cbe60 2024-04-25T09:09:57.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.719+0000 7f53a2a00640 1 -- 172.21.15.175:0/2118280593 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f53a4016560 con 0x7f53ac0cbe60 2024-04-25T09:09:57.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.723+0000 7f53b1800640 1 -- 172.21.15.175:0/2118280593 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f538c066f60 msgr2=0x7f538c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:57.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.723+0000 7f53b1800640 1 --2- 172.21.15.175:0/2118280593 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f538c066f60 0x7f538c069420 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f539c009b60 tx=0x7f539c009190 comp rx=0 tx=0).stop 2024-04-25T09:09:57.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.723+0000 7f53b1800640 1 -- 172.21.15.175:0/2118280593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53ac0cbe60 msgr2=0x7f53ac156820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:57.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.723+0000 7f53b1800640 1 --2- 172.21.15.175:0/2118280593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53ac0cbe60 0x7f53ac156820 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f53a401b020 tx=0x7f53a4019710 comp rx=0 tx=0).stop 2024-04-25T09:09:57.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.723+0000 7f53b1800640 1 -- 172.21.15.175:0/2118280593 shutdown_connections 2024-04-25T09:09:57.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.723+0000 7f53b1800640 1 --2- 172.21.15.175:0/2118280593 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f538c066f60 0x7f538c069420 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.723+0000 7f53b1800640 1 --2- 172.21.15.175:0/2118280593 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53ac0cbe60 0x7f53ac156820 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.723+0000 7f53b1800640 1 --2- 172.21.15.175:0/2118280593 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53ac0b4800 0x7f53ac154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.723+0000 7f53b1800640 1 --2- 172.21.15.175:0/2118280593 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53ac06d310 0x7f53ac0b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.723+0000 7f53b1800640 1 -- 172.21.15.175:0/2118280593 >> 172.21.15.175:0/2118280593 conn(0x7f53ac06ac50 msgr2=0x7f53ac0ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:57.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.723+0000 7f53b1800640 1 -- 172.21.15.175:0/2118280593 shutdown_connections 2024-04-25T09:09:57.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:57.723+0000 7f53b1800640 1 -- 172.21.15.175:0/2118280593 wait complete. 2024-04-25T09:09:57.731 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:09:57.731 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:09:57.861 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:09:57.957 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:09:57.957 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:09:57.957 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:57.966 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:09:57.967 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:09:57.967 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:57.976 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:09:57.976 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:09:57.976 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:58.018 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:09:58.019 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:09:58.019 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:58.030 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:09:58.030 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:09:58.030 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:58.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.207+0000 7f426ba00640 1 Processor -- start 2024-04-25T09:09:58.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.207+0000 7f426ba00640 1 -- start start 2024-04-25T09:09:58.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.207+0000 7f426ba00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f426415dbd0 0x7f4264071c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.207+0000 7f426ba00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42640aeac0 0x7f42640ad490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.207+0000 7f426ba00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426415dfb0 con 0x7f42640ae680 2024-04-25T09:09:58.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.207+0000 7f426ba00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42640cf670 con 0x7f426415dbd0 2024-04-25T09:09:58.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.207+0000 7f426ba00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42640b3590 con 0x7f42640aeac0 2024-04-25T09:09:58.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f425be00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f42640ae680 0x7f42640acd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53372/0 (socket says 172.21.15.175:53372) 2024-04-25T09:09:58.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f425be00640 1 -- 172.21.15.175:0/3659514657 learned_addr learned my addr 172.21.15.175:0/3659514657 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:58.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4269a00640 1 --2- 172.21.15.175:0/3659514657 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42640aeac0 0x7f42640ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4269000640 1 --2- 172.21.15.175:0/3659514657 >> v2:172.21.15.177:3300/0 conn(0x7f426415dbd0 0x7f4264071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4263e00640 1 -- 172.21.15.175:0/3659514657 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048638778 0 0) 0x7f426415dfb0 con 0x7f42640ae680 2024-04-25T09:09:58.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4263e00640 1 -- 172.21.15.175:0/3659514657 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4248003530 con 0x7f42640ae680 2024-04-25T09:09:58.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4263e00640 1 -- 172.21.15.175:0/3659514657 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4239061862 0 0) 0x7f4248003530 con 0x7f42640ae680 2024-04-25T09:09:58.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4263e00640 1 -- 172.21.15.175:0/3659514657 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42640aeac0 msgr2=0x7f42640ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4263e00640 1 --2- 172.21.15.175:0/3659514657 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42640aeac0 0x7f42640ad490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4263e00640 1 -- 172.21.15.175:0/3659514657 >> v2:172.21.15.177:3300/0 conn(0x7f426415dbd0 msgr2=0x7f4264071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4263e00640 1 --2- 172.21.15.175:0/3659514657 >> v2:172.21.15.177:3300/0 conn(0x7f426415dbd0 0x7f4264071c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4263e00640 1 -- 172.21.15.175:0/3659514657 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42640b2980 con 0x7f42640ae680 2024-04-25T09:09:58.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4263e00640 1 -- 172.21.15.175:0/3659514657 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f424c001680 con 0x7f42640ae680 2024-04-25T09:09:58.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4263e00640 1 -- 172.21.15.175:0/3659514657 >> v1:172.21.15.175:6789/0 conn(0x7f42640ae680 legacy=0x7f42640acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4263e00640 1 --2- 172.21.15.175:0/3659514657 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42640aeac0 0x7f42480039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4263e00640 1 --2- 172.21.15.175:0/3659514657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4248003f40 0x7f4248004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4263e00640 1 --2- 172.21.15.175:0/3659514657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4248004d50 0x7f42480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4263e00640 1 -- 172.21.15.175:0/3659514657 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640b3590 con 0x7f4248004d50 2024-04-25T09:09:58.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4263e00640 1 -- 172.21.15.175:0/3659514657 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424800b9d0 con 0x7f4248003f40 2024-04-25T09:09:58.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4263e00640 1 -- 172.21.15.175:0/3659514657 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424800bb50 con 0x7f42640aeac0 2024-04-25T09:09:58.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4269a00640 1 --2- 172.21.15.175:0/3659514657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4248004d50 0x7f42480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f425be00640 1 --2- 172.21.15.175:0/3659514657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4248003f40 0x7f4248004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4269000640 1 --2- 172.21.15.175:0/3659514657 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42640aeac0 0x7f42480039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4269a00640 1 -- 172.21.15.175:0/3659514657 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42640aeac0 msgr2=0x7f42480039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4269a00640 1 --2- 172.21.15.175:0/3659514657 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42640aeac0 0x7f42480039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4269a00640 1 -- 172.21.15.175:0/3659514657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4248003f40 msgr2=0x7f4248004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4269a00640 1 --2- 172.21.15.175:0/3659514657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4248003f40 0x7f4248004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4269a00640 1 -- 172.21.15.175:0/3659514657 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4248003530 con 0x7f4248004d50 2024-04-25T09:09:58.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.211+0000 7f4269000640 1 --2- 172.21.15.175:0/3659514657 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42640aeac0 0x7f42480039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:58.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.215+0000 7f4269a00640 1 --2- 172.21.15.175:0/3659514657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4248004d50 0x7f42480051d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f425c009fc0 tx=0x7f425c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1b19b031fe433f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.215+0000 7f4263e00640 1 -- 172.21.15.175:0/3659514657 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c0b2070 con 0x7f4248004d50 2024-04-25T09:09:58.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.215+0000 7f4263e00640 1 -- 172.21.15.175:0/3659514657 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c0a5c90 con 0x7f4248004d50 2024-04-25T09:09:58.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.215+0000 7f4263e00640 1 -- 172.21.15.175:0/3659514657 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c009c10 con 0x7f4248004d50 2024-04-25T09:09:58.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.215+0000 7f426ba00640 1 -- 172.21.15.175:0/3659514657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4248004d50 msgr2=0x7f42480051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.215+0000 7f426ba00640 1 --2- 172.21.15.175:0/3659514657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4248004d50 0x7f42480051d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f425c009fc0 tx=0x7f425c01cc20 comp rx=0 tx=0).stop 2024-04-25T09:09:58.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.215+0000 7f4269a00640 1 -- 172.21.15.175:0/3659514657 reap_dead start 2024-04-25T09:09:58.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.215+0000 7f426ba00640 1 -- 172.21.15.175:0/3659514657 shutdown_connections 2024-04-25T09:09:58.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.215+0000 7f426ba00640 1 -- 172.21.15.175:0/3659514657 >> 172.21.15.175:0/3659514657 conn(0x7f4264067150 msgr2=0x7f426406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:58.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.215+0000 7f426ba00640 1 -- 172.21.15.175:0/3659514657 shutdown_connections 2024-04-25T09:09:58.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.215+0000 7f426ba00640 1 -- 172.21.15.175:0/3659514657 wait complete. 2024-04-25T09:09:58.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.215+0000 7f426ba00640 1 Processor -- start 2024-04-25T09:09:58.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.215+0000 7f426ba00640 1 -- start start 2024-04-25T09:09:58.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f426ba00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4264151400 0x7f42640cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f426ba00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42640ccb80 0x7f4264152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f426ba00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4264152b40 0x7f426415fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f426ba00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640b3220 con 0x7f42640ccb80 2024-04-25T09:09:58.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f426ba00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640b2f40 con 0x7f4264152b40 2024-04-25T09:09:58.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f426ba00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42640aef50 con 0x7f4264151400 2024-04-25T09:09:58.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f425be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42640ccb80 0x7f4264152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f425be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42640ccb80 0x7f4264152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34398/0 (socket says 172.21.15.175:34398) 2024-04-25T09:09:58.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f425be00640 1 -- 172.21.15.175:0/2460697739 learned_addr learned my addr 172.21.15.175:0/2460697739 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:58.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f4269a00640 1 --2- 172.21.15.175:0/2460697739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4264152b40 0x7f426415fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f4269000640 1 --2- 172.21.15.175:0/2460697739 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4264151400 0x7f42640cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f425be00640 1 -- 172.21.15.175:0/2460697739 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4264151400 msgr2=0x7f42640cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f425be00640 1 --2- 172.21.15.175:0/2460697739 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4264151400 0x7f42640cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f425be00640 1 -- 172.21.15.175:0/2460697739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4264152b40 msgr2=0x7f426415fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f425be00640 1 --2- 172.21.15.175:0/2460697739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4264152b40 0x7f426415fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f425be00640 1 -- 172.21.15.175:0/2460697739 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4264154e70 con 0x7f42640ccb80 2024-04-25T09:09:58.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f4269000640 1 --2- 172.21.15.175:0/2460697739 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4264151400 0x7f42640cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:58.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f425be00640 1 --2- 172.21.15.175:0/2460697739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42640ccb80 0x7f4264152600 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f424c007340 tx=0x7f424c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f4261600640 1 -- 172.21.15.175:0/2460697739 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c01a070 con 0x7f42640ccb80 2024-04-25T09:09:58.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f4261600640 1 -- 172.21.15.175:0/2460697739 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c00f9c0 con 0x7f42640ccb80 2024-04-25T09:09:58.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f4261600640 1 -- 172.21.15.175:0/2460697739 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c00fdd0 con 0x7f42640ccb80 2024-04-25T09:09:58.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f426ba00640 1 -- 172.21.15.175:0/2460697739 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42641517e0 con 0x7f42640ccb80 2024-04-25T09:09:58.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f426ba00640 1 -- 172.21.15.175:0/2460697739 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4264153450 con 0x7f42640ccb80 2024-04-25T09:09:58.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f426ba00640 1 -- 172.21.15.175:0/2460697739 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4264153650 con 0x7f42640ccb80 2024-04-25T09:09:58.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.219+0000 7f4261600640 1 -- 172.21.15.175:0/2460697739 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f424c01d360 con 0x7f42640ccb80 2024-04-25T09:09:58.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.223+0000 7f4261600640 1 --2- 172.21.15.175:0/2460697739 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4240066f90 0x7f4240069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.223+0000 7f4261600640 1 -- 172.21.15.175:0/2460697739 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f424c084680 con 0x7f42640ccb80 2024-04-25T09:09:58.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.223+0000 7f4269000640 1 --2- 172.21.15.175:0/2460697739 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4240066f90 0x7f4240069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.223+0000 7f4269000640 1 --2- 172.21.15.175:0/2460697739 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4240066f90 0x7f4240069450 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4254009aa0 tx=0x7f4254008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.227+0000 7f4261600640 1 -- 172.21.15.175:0/2460697739 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4264153650 con 0x7f42640ccb80 2024-04-25T09:09:58.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.411+0000 7f426ba00640 1 -- 172.21.15.175:0/2460697739 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4264074a60 con 0x7f42640ccb80 2024-04-25T09:09:58.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.411+0000 7f4261600640 1 -- 172.21.15.175:0/2460697739 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f424c055920 con 0x7f42640ccb80 2024-04-25T09:09:58.402 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:09:58.402 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2493316948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2493316948},{"type":"v1","addr":"172.21.15.175:6837","nonce":2493316948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6277,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3408529232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3408529232},{"type":"v1","addr":"172.21.15.177:6834","nonce":3408529232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":38},{"gid":6454,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/46829775","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":46829775},{"type":"v1","addr":"172.21.15.177:6835","nonce":46829775}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":45},{"gid":7131,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/79239798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":79239798},{"type":"v1","addr":"172.21.15.175:6836","nonce":79239798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":53}],"filesystems":[]} 2024-04-25T09:09:58.402 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 53 2024-04-25T09:09:58.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.415+0000 7f426ba00640 1 -- 172.21.15.175:0/2460697739 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4240066f90 msgr2=0x7f4240069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.415+0000 7f426ba00640 1 --2- 172.21.15.175:0/2460697739 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4240066f90 0x7f4240069450 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4254009aa0 tx=0x7f4254008040 comp rx=0 tx=0).stop 2024-04-25T09:09:58.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.415+0000 7f426ba00640 1 -- 172.21.15.175:0/2460697739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42640ccb80 msgr2=0x7f4264152600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.415+0000 7f426ba00640 1 --2- 172.21.15.175:0/2460697739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42640ccb80 0x7f4264152600 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f424c007340 tx=0x7f424c007800 comp rx=0 tx=0).stop 2024-04-25T09:09:58.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.415+0000 7f426ba00640 1 -- 172.21.15.175:0/2460697739 shutdown_connections 2024-04-25T09:09:58.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.415+0000 7f426ba00640 1 --2- 172.21.15.175:0/2460697739 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4240066f90 0x7f4240069450 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.415+0000 7f426ba00640 1 --2- 172.21.15.175:0/2460697739 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4264152b40 0x7f426415fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.415+0000 7f426ba00640 1 --2- 172.21.15.175:0/2460697739 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42640ccb80 0x7f4264152600 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.415+0000 7f426ba00640 1 --2- 172.21.15.175:0/2460697739 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4264151400 0x7f42640cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.415+0000 7f426ba00640 1 -- 172.21.15.175:0/2460697739 >> 172.21.15.175:0/2460697739 conn(0x7f4248004d50 msgr2=0x7f42640b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:58.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.415+0000 7f426ba00640 1 -- 172.21.15.175:0/2460697739 shutdown_connections 2024-04-25T09:09:58.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.415+0000 7f426ba00640 1 -- 172.21.15.175:0/2460697739 wait complete. 2024-04-25T09:09:58.423 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:09:58.423 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:09:58.423 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:09:58.424 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:09:58.424 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:09:58.424 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:09:58.424 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:09:58.424 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:09:58.424 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:09:58.424 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:09:58.425 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:09:58.425 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:09:58.425 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:09:58.425 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:09:58.425 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:09:58.425 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:09:58.438 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:09:58.439 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:09:58.440 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:09:58.440 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:09:58.441 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:09:58.441 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:09:58.442 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:09:58.442 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:09:58.485 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:09:58.485 DEBUG:teuthology.parallel:result is None 2024-04-25T09:09:58.487 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:09:58.487 DEBUG:teuthology.parallel:result is None 2024-04-25T09:09:58.490 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:09:58.490 DEBUG:teuthology.parallel:result is None 2024-04-25T09:09:58.491 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:09:58.491 DEBUG:teuthology.parallel:result is None 2024-04-25T09:09:58.492 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:09:58.576 INFO:tasks.ceph.mds.a.smithi175.stdout:starting mds.a at 2024-04-25T09:09:58.577 INFO:tasks.ceph.mds.c.smithi175.stdout:starting mds.c at 2024-04-25T09:09:58.579 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-04-25T09:09:58.579 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-04-25T09:09:58.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.647+0000 7ff7a6a00640 1 Processor -- start 2024-04-25T09:09:58.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.647+0000 7ff7a6a00640 1 -- start start 2024-04-25T09:09:58.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.647+0000 7ff7a6a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff7a006ad50 0x7ff7a006bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.647+0000 7ff7a6a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7a006c080 0x7ff7a006eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.647+0000 7ff7a6a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a006de20 con 0x7ff7a00cdb60 2024-04-25T09:09:58.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.647+0000 7ff7a6a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a015dfe0 con 0x7ff7a006ad50 2024-04-25T09:09:58.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.647+0000 7ff7a6a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a006e090 con 0x7ff7a006c080 2024-04-25T09:09:58.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.647+0000 7ff79fe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff7a00cdb60 0x7ff7a00cdf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53416/0 (socket says 172.21.15.175:53416) 2024-04-25T09:09:58.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.647+0000 7ff79f400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff7a006ad50 0x7ff7a006bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.647+0000 7ff79fe00640 1 -- 172.21.15.175:0/3744363474 learned_addr learned my addr 172.21.15.175:0/3744363474 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:58.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.647+0000 7ff7a4a00640 1 --2- 172.21.15.175:0/3744363474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7a006c080 0x7ff7a006eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.647+0000 7ff79f400640 1 -- 172.21.15.175:0/3744363474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7a006c080 msgr2=0x7ff7a006eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:58.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.647+0000 7ff79f400640 1 --2- 172.21.15.175:0/3744363474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7a006c080 0x7ff7a006eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.647+0000 7ff79f400640 1 -- 172.21.15.175:0/3744363474 >> v1:172.21.15.175:6789/0 conn(0x7ff7a00cdb60 legacy=0x7ff7a00cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.647+0000 7ff79f400640 1 -- 172.21.15.175:0/3744363474 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a006e370 con 0x7ff7a006ad50 2024-04-25T09:09:58.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.647+0000 7ff79ea00640 1 -- 172.21.15.175:0/3744363474 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078402489 0 0) 0x7ff7a006de20 con 0x7ff7a00cdb60 2024-04-25T09:09:58.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.651+0000 7ff79f400640 1 --2- 172.21.15.175:0/3744363474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a006ad50 0x7ff7a006bb40 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0097c0 tx=0x7ff78c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a60c27863905e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.651+0000 7ff79ea00640 1 -- 172.21.15.175:0/3744363474 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c0aa5f0 con 0x7ff7a006ad50 2024-04-25T09:09:58.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.651+0000 7ff79ea00640 1 -- 172.21.15.175:0/3744363474 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c0af070 con 0x7ff7a006ad50 2024-04-25T09:09:58.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.651+0000 7ff79ea00640 1 -- 172.21.15.175:0/3744363474 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c0aa9b0 con 0x7ff7a006ad50 2024-04-25T09:09:58.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.651+0000 7ff7a6a00640 1 -- 172.21.15.175:0/3744363474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a006ad50 msgr2=0x7ff7a006bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.651+0000 7ff7a6a00640 1 --2- 172.21.15.175:0/3744363474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a006ad50 0x7ff7a006bb40 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0097c0 tx=0x7ff78c01c470 comp rx=0 tx=0).stop 2024-04-25T09:09:58.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.651+0000 7ff7a6a00640 1 -- 172.21.15.175:0/3744363474 shutdown_connections 2024-04-25T09:09:58.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.651+0000 7ff7a6a00640 1 --2- 172.21.15.175:0/3744363474 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7a006c080 0x7ff7a006eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.651+0000 7ff7a6a00640 1 --2- 172.21.15.175:0/3744363474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a006ad50 0x7ff7a006bb40 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.651+0000 7ff7a6a00640 1 -- 172.21.15.175:0/3744363474 >> 172.21.15.175:0/3744363474 conn(0x7ff7a00cca10 msgr2=0x7ff7a00cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:58.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.651+0000 7ff7a6a00640 1 -- 172.21.15.175:0/3744363474 shutdown_connections 2024-04-25T09:09:58.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.651+0000 7ff7a6a00640 1 -- 172.21.15.175:0/3744363474 wait complete. 2024-04-25T09:09:58.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a6a00640 1 Processor -- start 2024-04-25T09:09:58.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a6a00640 1 -- start start 2024-04-25T09:09:58.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a6a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7a006ad50 0x7ff7a00af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a6a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7a006c080 0x7ff7a01536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a6a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a00cdb60 0x7ff7a0153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a6a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a016aa70 con 0x7ff7a00cdb60 2024-04-25T09:09:58.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a6a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a00aefd0 con 0x7ff7a006c080 2024-04-25T09:09:58.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a6a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a016abf0 con 0x7ff7a006ad50 2024-04-25T09:09:58.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a4a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a00cdb60 0x7ff7a0153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a4a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a00cdb60 0x7ff7a0153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:34438/0 (socket says 172.21.15.175:34438) 2024-04-25T09:09:58.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a4a00640 1 -- 172.21.15.175:0/1879961680 learned_addr learned my addr 172.21.15.175:0/1879961680 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:58.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff79f400640 1 --2- 172.21.15.175:0/1879961680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7a006c080 0x7ff7a01536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff79fe00640 1 --2- 172.21.15.175:0/1879961680 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7a006ad50 0x7ff7a00af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a4a00640 1 -- 172.21.15.175:0/1879961680 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7a006ad50 msgr2=0x7ff7a00af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a4a00640 1 --2- 172.21.15.175:0/1879961680 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7a006ad50 0x7ff7a00af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a4a00640 1 -- 172.21.15.175:0/1879961680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7a006c080 msgr2=0x7ff7a01536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a4a00640 1 --2- 172.21.15.175:0/1879961680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7a006c080 0x7ff7a01536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a4a00640 1 -- 172.21.15.175:0/1879961680 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a0154f40 con 0x7ff7a00cdb60 2024-04-25T09:09:58.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff79f400640 1 --2- 172.21.15.175:0/1879961680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7a006c080 0x7ff7a01536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:58.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a4a00640 1 --2- 172.21.15.175:0/1879961680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a00cdb60 0x7ff7a0153c10 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7ff79800ef90 tx=0x7ff79800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff797e00640 1 -- 172.21.15.175:0/1879961680 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798018020 con 0x7ff7a00cdb60 2024-04-25T09:09:58.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff797e00640 1 -- 172.21.15.175:0/1879961680 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff798014480 con 0x7ff7a00cdb60 2024-04-25T09:09:58.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a6a00640 1 -- 172.21.15.175:0/1879961680 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a0155220 con 0x7ff7a00cdb60 2024-04-25T09:09:58.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff797e00640 1 -- 172.21.15.175:0/1879961680 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798014870 con 0x7ff7a00cdb60 2024-04-25T09:09:58.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.655+0000 7ff7a6a00640 1 -- 172.21.15.175:0/1879961680 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a00c9cf0 con 0x7ff7a00cdb60 2024-04-25T09:09:58.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.659+0000 7ff7a6a00640 1 -- 172.21.15.175:0/1879961680 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a0075160 con 0x7ff7a00cdb60 2024-04-25T09:09:58.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.659+0000 7ff797e00640 1 -- 172.21.15.175:0/1879961680 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff79801b020 con 0x7ff7a00cdb60 2024-04-25T09:09:58.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.659+0000 7ff797e00640 1 --2- 172.21.15.175:0/1879961680 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff780066f60 0x7ff780069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.659+0000 7ff797e00640 1 -- 172.21.15.175:0/1879961680 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff7980862a0 con 0x7ff7a00cdb60 2024-04-25T09:09:58.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.659+0000 7ff79fe00640 1 --2- 172.21.15.175:0/1879961680 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff780066f60 0x7ff780069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.659+0000 7ff79fe00640 1 --2- 172.21.15.175:0/1879961680 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff780066f60 0x7ff780069420 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff790000f70 tx=0x7ff790007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.663+0000 7ff797e00640 1 -- 172.21.15.175:0/1879961680 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff798022030 con 0x7ff7a00cdb60 2024-04-25T09:09:58.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:58.835+0000 7ff7a6a00640 1 -- 172.21.15.175:0/1879961680 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff7a0067ec0 con 0x7ff7a00cdb60 2024-04-25T09:09:59.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.739+0000 7ff797e00640 1 -- 172.21.15.175:0/1879961680 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v80) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff798010040 con 0x7ff7a00cdb60 2024-04-25T09:09:59.727 INFO:teuthology.orchestra.run.smithi175.stderr: removed all blocklist entries 2024-04-25T09:09:59.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.739+0000 7ff7a6a00640 1 -- 172.21.15.175:0/1879961680 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff780066f60 msgr2=0x7ff780069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.739+0000 7ff7a6a00640 1 --2- 172.21.15.175:0/1879961680 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff780066f60 0x7ff780069420 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff790000f70 tx=0x7ff790007c10 comp rx=0 tx=0).stop 2024-04-25T09:09:59.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.739+0000 7ff7a6a00640 1 -- 172.21.15.175:0/1879961680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a00cdb60 msgr2=0x7ff7a0153c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.739+0000 7ff7a6a00640 1 --2- 172.21.15.175:0/1879961680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a00cdb60 0x7ff7a0153c10 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7ff79800ef90 tx=0x7ff79800c490 comp rx=0 tx=0).stop 2024-04-25T09:09:59.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.739+0000 7ff7a6a00640 1 -- 172.21.15.175:0/1879961680 shutdown_connections 2024-04-25T09:09:59.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.739+0000 7ff7a6a00640 1 --2- 172.21.15.175:0/1879961680 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff780066f60 0x7ff780069420 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.739+0000 7ff7a6a00640 1 --2- 172.21.15.175:0/1879961680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7a00cdb60 0x7ff7a0153c10 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.739+0000 7ff7a6a00640 1 --2- 172.21.15.175:0/1879961680 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7a006c080 0x7ff7a01536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.739+0000 7ff7a6a00640 1 --2- 172.21.15.175:0/1879961680 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7a006ad50 0x7ff7a00af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.739+0000 7ff7a6a00640 1 -- 172.21.15.175:0/1879961680 >> 172.21.15.175:0/1879961680 conn(0x7ff7a00cca10 msgr2=0x7ff7a00b56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:59.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.739+0000 7ff7a6a00640 1 -- 172.21.15.175:0/1879961680 shutdown_connections 2024-04-25T09:09:59.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.739+0000 7ff7a6a00640 1 -- 172.21.15.175:0/1879961680 wait complete. 2024-04-25T09:09:59.753 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:09:59.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.903+0000 7fd9ff200640 1 Processor -- start 2024-04-25T09:09:59.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.903+0000 7fd9ff200640 1 -- start start 2024-04-25T09:09:59.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.903+0000 7fd9ff200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fda000cd890 0x7fda0009a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.903+0000 7fd9ff200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda0009ab50 0x7fda00099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.903+0000 7fd9ff200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda000cf740 con 0x7fda00099f90 2024-04-25T09:09:59.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.903+0000 7fd9ff200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda0006c6e0 con 0x7fda000cd890 2024-04-25T09:09:59.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.903+0000 7fd9ff200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0006c9c0 con 0x7fda0009ab50 2024-04-25T09:09:59.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.903+0000 7fd9fe800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fda00099f90 0x7fda001618b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45442/0 (socket says 172.21.15.175:45442) 2024-04-25T09:09:59.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.903+0000 7fd9fde00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fda000cd890 0x7fda0009a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.903+0000 7fd9fe800640 1 -- 172.21.15.175:0/2716500319 learned_addr learned my addr 172.21.15.175:0/2716500319 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:09:59.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.903+0000 7fd9fd400640 1 --2- 172.21.15.175:0/2716500319 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda0009ab50 0x7fda00099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.903+0000 7fd9fde00640 1 -- 172.21.15.175:0/2716500319 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda0009ab50 msgr2=0x7fda00099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:59.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.903+0000 7fd9fde00640 1 --2- 172.21.15.175:0/2716500319 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda0009ab50 0x7fda00099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.903+0000 7fd9fde00640 1 -- 172.21.15.175:0/2716500319 >> v1:172.21.15.175:6789/0 conn(0x7fda00099f90 legacy=0x7fda001618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.903+0000 7fd9fde00640 1 -- 172.21.15.175:0/2716500319 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0006cca0 con 0x7fda000cd890 2024-04-25T09:09:59.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.903+0000 7fd9fca00640 1 -- 172.21.15.175:0/2716500319 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149195242 0 0) 0x7fda000cf740 con 0x7fda00099f90 2024-04-25T09:09:59.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.907+0000 7fd9fde00640 1 --2- 172.21.15.175:0/2716500319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda000cd890 0x7fda0009a610 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00097c0 tx=0x7fd9f001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce93693f25b5857 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:59.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.907+0000 7fd9fca00640 1 -- 172.21.15.175:0/2716500319 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f00b0070 con 0x7fda000cd890 2024-04-25T09:09:59.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.907+0000 7fd9fca00640 1 -- 172.21.15.175:0/2716500319 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f00a4e50 con 0x7fda000cd890 2024-04-25T09:09:59.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.907+0000 7fd9fca00640 1 -- 172.21.15.175:0/2716500319 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f00ab820 con 0x7fda000cd890 2024-04-25T09:09:59.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.907+0000 7fd9ff200640 1 -- 172.21.15.175:0/2716500319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda000cd890 msgr2=0x7fda0009a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.907+0000 7fd9ff200640 1 --2- 172.21.15.175:0/2716500319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda000cd890 0x7fda0009a610 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00097c0 tx=0x7fd9f001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.907+0000 7fd9ff200640 1 -- 172.21.15.175:0/2716500319 shutdown_connections 2024-04-25T09:09:59.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.907+0000 7fd9ff200640 1 --2- 172.21.15.175:0/2716500319 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda0009ab50 0x7fda00099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.907+0000 7fd9ff200640 1 --2- 172.21.15.175:0/2716500319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda000cd890 0x7fda0009a610 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.907+0000 7fd9ff200640 1 -- 172.21.15.175:0/2716500319 >> 172.21.15.175:0/2716500319 conn(0x7fda000b31b0 msgr2=0x7fda000b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:59.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.907+0000 7fd9ff200640 1 -- 172.21.15.175:0/2716500319 shutdown_connections 2024-04-25T09:09:59.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.907+0000 7fd9ff200640 1 -- 172.21.15.175:0/2716500319 wait complete. 2024-04-25T09:09:59.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.907+0000 7fd9ff200640 1 Processor -- start 2024-04-25T09:09:59.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.907+0000 7fd9ff200640 1 -- start start 2024-04-25T09:09:59.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9ff200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda00099f90 0x7fda000b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9ff200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda0009ab50 0x7fda0014a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9ff200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda000cd890 0x7fda000b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9ff200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda000ccd20 con 0x7fda00099f90 2024-04-25T09:09:59.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9ff200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0006d780 con 0x7fda0009ab50 2024-04-25T09:09:59.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9ff200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0016abf0 con 0x7fda000cd890 2024-04-25T09:09:59.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9fde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda00099f90 0x7fda000b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9fde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda00099f90 0x7fda000b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54444/0 (socket says 172.21.15.175:54444) 2024-04-25T09:09:59.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9fde00640 1 -- 172.21.15.175:0/1055849607 learned_addr learned my addr 172.21.15.175:0/1055849607 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:09:59.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9fe800640 1 --2- 172.21.15.175:0/1055849607 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda000cd890 0x7fda000b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9fd400640 1 --2- 172.21.15.175:0/1055849607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda0009ab50 0x7fda0014a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9fde00640 1 -- 172.21.15.175:0/1055849607 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda000cd890 msgr2=0x7fda000b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9fde00640 1 --2- 172.21.15.175:0/1055849607 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda000cd890 0x7fda000b5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9fde00640 1 -- 172.21.15.175:0/1055849607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda0009ab50 msgr2=0x7fda0014a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9fde00640 1 --2- 172.21.15.175:0/1055849607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda0009ab50 0x7fda0014a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9fde00640 1 -- 172.21.15.175:0/1055849607 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda000b49c0 con 0x7fda00099f90 2024-04-25T09:09:59.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9fe800640 1 --2- 172.21.15.175:0/1055849607 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda000cd890 0x7fda000b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:59.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9fd400640 1 --2- 172.21.15.175:0/1055849607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda0009ab50 0x7fda0014a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:59.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9fde00640 1 --2- 172.21.15.175:0/1055849607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda00099f90 0x7fda000b4170 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00ae040 tx=0x7fd9f001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:59.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9f6000640 1 -- 172.21.15.175:0/1055849607 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f00b0050 con 0x7fda00099f90 2024-04-25T09:09:59.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9f6000640 1 -- 172.21.15.175:0/1055849607 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f00bc070 con 0x7fda00099f90 2024-04-25T09:09:59.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9ff200640 1 -- 172.21.15.175:0/1055849607 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda000b4ca0 con 0x7fda00099f90 2024-04-25T09:09:59.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9f6000640 1 -- 172.21.15.175:0/1055849607 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f00b7690 con 0x7fda00099f90 2024-04-25T09:09:59.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9ff200640 1 -- 172.21.15.175:0/1055849607 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda000b5260 con 0x7fda00099f90 2024-04-25T09:09:59.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9ff200640 1 -- 172.21.15.175:0/1055849607 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda00074a60 con 0x7fda00099f90 2024-04-25T09:09:59.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.911+0000 7fd9f6000640 1 -- 172.21.15.175:0/1055849607 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd9f00b7830 con 0x7fda00099f90 2024-04-25T09:09:59.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.915+0000 7fd9f6000640 1 --2- 172.21.15.175:0/1055849607 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd9e0066f90 0x7fd9e0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.915+0000 7fd9f6000640 1 -- 172.21.15.175:0/1055849607 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd9f011f290 con 0x7fda00099f90 2024-04-25T09:09:59.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.915+0000 7fd9fd400640 1 --2- 172.21.15.175:0/1055849607 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd9e0066f90 0x7fd9e0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.915+0000 7fd9fd400640 1 --2- 172.21.15.175:0/1055849607 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd9e0066f90 0x7fd9e0069450 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fda000b5d60 tx=0x7fd9ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:59.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:09:59.919+0000 7fd9f6000640 1 -- 172.21.15.175:0/1055849607 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd9f0016090 con 0x7fda00099f90 2024-04-25T09:10:00.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.135+0000 7fd9ff200640 1 -- 172.21.15.175:0/1055849607 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fda0006ff30 con 0x7fda00099f90 2024-04-25T09:10:00.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.135+0000 7fd9f6000640 1 -- 172.21.15.175:0/1055849607 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd9f00f05e0 con 0x7fda00099f90 2024-04-25T09:10:00.126 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:10:00.126 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:10:00.126 INFO:teuthology.orchestra.run.smithi175.stdout: "auth_dump": [ 2024-04-25T09:10:00.126 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.126 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.a", 2024-04-25T09:10:00.126 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpm3usiKxAAROh+31LaNyuh2SdeW6pKjQ==", 2024-04-25T09:10:00.127 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.127 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:10:00.127 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:10:00.127 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:10:00.127 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:10:00.127 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.127 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:00.127 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.127 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.b", 2024-04-25T09:10:00.127 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmYJoRNxAAZfRvDn1aoR0wa2mEKBrr+A==", 2024-04-25T09:10:00.127 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.127 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:10:00.127 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:10:00.127 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:10:00.128 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:10:00.128 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:00.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.128 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.c", 2024-04-25T09:10:00.128 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmk8M3MhAA6aIN33aWvVcvVEFtHL8SWA==", 2024-04-25T09:10:00.128 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.128 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:10:00.128 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:10:00.128 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:10:00.128 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:10:00.128 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.128 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:00.128 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.129 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.d", 2024-04-25T09:10:00.129 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmLAHLAhAA+mWUfpb6izHixJa073r9Jw==", 2024-04-25T09:10:00.129 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.129 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:10:00.129 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:10:00.129 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:10:00.129 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:10:00.129 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.129 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:00.129 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.129 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.0", 2024-04-25T09:10:00.129 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBSHCpm2xftAxAAxs9n8AE2H3HpPHEUZA4Cng==", 2024-04-25T09:10:00.129 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.129 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:00.129 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:10:00.129 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:10:00.130 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:00.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.130 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.1", 2024-04-25T09:10:00.130 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBVHCpm/OOlDRAAA7zaD8qsqS2TOCKhDFheJw==", 2024-04-25T09:10:00.130 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.130 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:00.130 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:10:00.130 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:10:00.130 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.130 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:00.130 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.130 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.2", 2024-04-25T09:10:00.130 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBYHCpmy/kmFxAAwCADFI/jMe27gAmyuAJZHQ==", 2024-04-25T09:10:00.131 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.131 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:00.131 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:10:00.131 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:10:00.131 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:00.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.131 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.3", 2024-04-25T09:10:00.131 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBbHCpm89a7HhAAVTueOuS0/Ksf8SdWK+Nm1g==", 2024-04-25T09:10:00.131 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.131 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:00.131 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:10:00.131 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:10:00.131 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.131 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:00.131 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.131 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.4", 2024-04-25T09:10:00.132 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBhHCpm5EAtFRAAeADhjja0BOIvxY3RB+n6+A==", 2024-04-25T09:10:00.132 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.132 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:00.132 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:10:00.132 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:10:00.132 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:00.132 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.132 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.5", 2024-04-25T09:10:00.132 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBkHCpmrLilHRAA+H8Bejnk49YfaUvl3Nrrhw==", 2024-04-25T09:10:00.132 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.132 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:00.132 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:10:00.132 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:10:00.132 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.132 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:00.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.133 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.6", 2024-04-25T09:10:00.133 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBnHCpm6uDxJRAAX5EwEelnZXwEHnNnv+XQ6A==", 2024-04-25T09:10:00.133 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.133 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:00.133 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:10:00.133 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:10:00.133 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.133 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:00.133 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.133 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.7", 2024-04-25T09:10:00.133 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBqHCpmwow5MBAA7b/Q9DiPO6Bfldq1+rf+/w==", 2024-04-25T09:10:00.133 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.133 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:00.133 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:10:00.133 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:10:00.134 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:00.134 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.134 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.0", 2024-04-25T09:10:00.134 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmhyCUBhAA8k9xLKIw8R04i6HSJykDfw==", 2024-04-25T09:10:00.134 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.134 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:10:00.134 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow r", 2024-04-25T09:10:00.134 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:10:00.134 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.134 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:00.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.135 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.1", 2024-04-25T09:10:00.135 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmQigrEBAAoWfP1ZEosbLELev5z+C9/g==", 2024-04-25T09:10:00.135 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.135 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:10:00.135 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:10:00.135 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:10:00.135 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:10:00.135 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.135 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:00.135 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.135 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.2", 2024-04-25T09:10:00.135 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpm0xaSDBAAup34GS3pnMwjksVuuUGOkw==", 2024-04-25T09:10:00.136 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.136 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:10:00.136 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:10:00.136 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:10:00.136 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:10:00.136 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.136 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:00.136 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.136 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.3", 2024-04-25T09:10:00.136 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpm6+doFhAAA18OgwfM8gXgQ6g0KUo7Hw==", 2024-04-25T09:10:00.136 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.136 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:10:00.137 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:10:00.137 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:10:00.137 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:10:00.137 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.137 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:00.137 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.137 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.admin", 2024-04-25T09:10:00.137 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmRZAYDRAA9sepw/fI2OhoZXER6Rmd+g==", 2024-04-25T09:10:00.137 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.137 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:10:00.137 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:10:00.137 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:10:00.137 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:10:00.137 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:00.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.138 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mgr.x", 2024-04-25T09:10:00.138 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpm5q4gJxAA9zPRlimxM0+Rb5RQkcoxzQ==", 2024-04-25T09:10:00.138 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.138 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:10:00.138 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile mgr", 2024-04-25T09:10:00.138 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:10:00.138 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.138 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:00.138 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:00.138 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mgr.y", 2024-04-25T09:10:00.138 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmMLIqIxAAiMo8+3lU0fXNoI6kBrro+Q==", 2024-04-25T09:10:00.138 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:10:00.139 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:10:00.139 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile mgr", 2024-04-25T09:10:00.139 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:10:00.139 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.139 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:00.139 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-25T09:10:00.139 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:10:00.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.139+0000 7fd9ff200640 1 -- 172.21.15.175:0/1055849607 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd9e0066f90 msgr2=0x7fd9e0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.139+0000 7fd9ff200640 1 --2- 172.21.15.175:0/1055849607 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd9e0066f90 0x7fd9e0069450 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fda000b5d60 tx=0x7fd9ec008040 comp rx=0 tx=0).stop 2024-04-25T09:10:00.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.139+0000 7fd9ff200640 1 -- 172.21.15.175:0/1055849607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda00099f90 msgr2=0x7fda000b4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.139+0000 7fd9ff200640 1 --2- 172.21.15.175:0/1055849607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda00099f90 0x7fda000b4170 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00ae040 tx=0x7fd9f001ace0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.139+0000 7fd9ff200640 1 -- 172.21.15.175:0/1055849607 shutdown_connections 2024-04-25T09:10:00.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.139+0000 7fd9ff200640 1 --2- 172.21.15.175:0/1055849607 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd9e0066f90 0x7fd9e0069450 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.139+0000 7fd9ff200640 1 --2- 172.21.15.175:0/1055849607 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda000cd890 0x7fda000b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.139+0000 7fd9ff200640 1 --2- 172.21.15.175:0/1055849607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda0009ab50 0x7fda0014a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.139+0000 7fd9ff200640 1 --2- 172.21.15.175:0/1055849607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda00099f90 0x7fda000b4170 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.139+0000 7fd9ff200640 1 -- 172.21.15.175:0/1055849607 >> 172.21.15.175:0/1055849607 conn(0x7fda000b31b0 msgr2=0x7fda00161890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:00.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.139+0000 7fd9ff200640 1 -- 172.21.15.175:0/1055849607 shutdown_connections 2024-04-25T09:10:00.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.139+0000 7fd9ff200640 1 -- 172.21.15.175:0/1055849607 wait complete. 2024-04-25T09:10:00.149 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:00.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.295+0000 7f844ea00640 1 Processor -- start 2024-04-25T09:10:00.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.295+0000 7f844ea00640 1 -- start start 2024-04-25T09:10:00.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.295+0000 7f844ea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f844806b0e0 0x7f844806b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.295+0000 7f844ea00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f84480b0c50 0x7f84480cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.295+0000 7f844ea00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84480d0450 con 0x7f84480b1090 2024-04-25T09:10:00.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.295+0000 7f844ea00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84480b07c0 con 0x7f84480b0c50 2024-04-25T09:10:00.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.295+0000 7f844ea00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84480afe90 con 0x7f844806b0e0 2024-04-25T09:10:00.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.295+0000 7f8447400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f84480b0c50 0x7f84480cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.295+0000 7f8447400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f84480b0c50 0x7f84480cfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54452/0 (socket says 172.21.15.175:54452) 2024-04-25T09:10:00.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.295+0000 7f8447400640 1 -- 172.21.15.175:0/677533276 learned_addr learned my addr 172.21.15.175:0/677533276 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:00.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.295+0000 7f8447e00640 1 --2- 172.21.15.175:0/677533276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f844806b0e0 0x7f844806b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.295+0000 7f8447400640 1 -- 172.21.15.175:0/677533276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f844806b0e0 msgr2=0x7f844806b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:00.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.295+0000 7f8447400640 1 --2- 172.21.15.175:0/677533276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f844806b0e0 0x7f844806b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.295+0000 7f8447400640 1 -- 172.21.15.175:0/677533276 >> v1:172.21.15.177:6789/0 conn(0x7f84480b1090 legacy=0x7f84480b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.295+0000 7f8447400640 1 -- 172.21.15.175:0/677533276 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84480b0170 con 0x7f84480b0c50 2024-04-25T09:10:00.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.299+0000 7f8447400640 1 --2- 172.21.15.175:0/677533276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84480b0c50 0x7f84480cfac0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f8434009870 tx=0x7f843401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e38454547de545 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:00.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.299+0000 7f8446a00640 1 -- 172.21.15.175:0/677533276 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84340b5070 con 0x7f84480b0c50 2024-04-25T09:10:00.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.299+0000 7f8446a00640 1 -- 172.21.15.175:0/677533276 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84340a8a50 con 0x7f84480b0c50 2024-04-25T09:10:00.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.299+0000 7f8446a00640 1 -- 172.21.15.175:0/677533276 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84340a8e20 con 0x7f84480b0c50 2024-04-25T09:10:00.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.299+0000 7f844ea00640 1 -- 172.21.15.175:0/677533276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84480b0c50 msgr2=0x7f84480cfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.299+0000 7f844ea00640 1 --2- 172.21.15.175:0/677533276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84480b0c50 0x7f84480cfac0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f8434009870 tx=0x7f843401ed50 comp rx=0 tx=0).stop 2024-04-25T09:10:00.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.299+0000 7f844ea00640 1 -- 172.21.15.175:0/677533276 shutdown_connections 2024-04-25T09:10:00.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.299+0000 7f844ea00640 1 --2- 172.21.15.175:0/677533276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84480b0c50 0x7f84480cfac0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.299+0000 7f844ea00640 1 --2- 172.21.15.175:0/677533276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f844806b0e0 0x7f844806b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.299+0000 7f844ea00640 1 -- 172.21.15.175:0/677533276 >> 172.21.15.175:0/677533276 conn(0x7f84480d06c0 msgr2=0x7f84480d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:00.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.299+0000 7f844ea00640 1 -- 172.21.15.175:0/677533276 shutdown_connections 2024-04-25T09:10:00.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.299+0000 7f844ea00640 1 -- 172.21.15.175:0/677533276 wait complete. 2024-04-25T09:10:00.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f844ea00640 1 Processor -- start 2024-04-25T09:10:00.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f844ea00640 1 -- start start 2024-04-25T09:10:00.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f844ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f844806b0e0 0x7f84481e9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f844ea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84480b0c50 0x7f84481f8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f844ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84480b1090 0x7f84480c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f844ea00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844806bb80 con 0x7f844806b0e0 2024-04-25T09:10:00.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f844ea00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844806ba00 con 0x7f84480b1090 2024-04-25T09:10:00.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f844ea00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84480d0000 con 0x7f84480b0c50 2024-04-25T09:10:00.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f8447e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f844806b0e0 0x7f84481e9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f8447e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f844806b0e0 0x7f84481e9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54468/0 (socket says 172.21.15.175:54468) 2024-04-25T09:10:00.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f8447e00640 1 -- 172.21.15.175:0/1715035695 learned_addr learned my addr 172.21.15.175:0/1715035695 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:00.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f8447400640 1 --2- 172.21.15.175:0/1715035695 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84480b0c50 0x7f84481f8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f844ca00640 1 --2- 172.21.15.175:0/1715035695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84480b1090 0x7f84480c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f8447e00640 1 -- 172.21.15.175:0/1715035695 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84480b0c50 msgr2=0x7f84481f8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f8447e00640 1 --2- 172.21.15.175:0/1715035695 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84480b0c50 0x7f84481f8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f8447e00640 1 -- 172.21.15.175:0/1715035695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84480b1090 msgr2=0x7f84480c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f8447e00640 1 --2- 172.21.15.175:0/1715035695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84480b1090 0x7f84480c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f8447e00640 1 -- 172.21.15.175:0/1715035695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84481ea460 con 0x7f844806b0e0 2024-04-25T09:10:00.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f8447e00640 1 --2- 172.21.15.175:0/1715035695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f844806b0e0 0x7f84481e9d80 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f843800d800 tx=0x7f843800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:00.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f843fe00640 1 -- 172.21.15.175:0/1715035695 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843800b6c0 con 0x7f844806b0e0 2024-04-25T09:10:00.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f843fe00640 1 -- 172.21.15.175:0/1715035695 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8438019070 con 0x7f844806b0e0 2024-04-25T09:10:00.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f844ea00640 1 -- 172.21.15.175:0/1715035695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84480c5a30 con 0x7f844806b0e0 2024-04-25T09:10:00.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f843fe00640 1 -- 172.21.15.175:0/1715035695 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843800ba60 con 0x7f844806b0e0 2024-04-25T09:10:00.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f844ea00640 1 -- 172.21.15.175:0/1715035695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84480c5ff0 con 0x7f844806b0e0 2024-04-25T09:10:00.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.303+0000 7f844ea00640 1 -- 172.21.15.175:0/1715035695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8448074a60 con 0x7f844806b0e0 2024-04-25T09:10:00.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.307+0000 7f843fe00640 1 -- 172.21.15.175:0/1715035695 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f843800bc00 con 0x7f844806b0e0 2024-04-25T09:10:00.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.307+0000 7f843fe00640 1 --2- 172.21.15.175:0/1715035695 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8428066f60 0x7f8428069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.307+0000 7f843fe00640 1 -- 172.21.15.175:0/1715035695 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8438084fe0 con 0x7f844806b0e0 2024-04-25T09:10:00.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.307+0000 7f8447400640 1 --2- 172.21.15.175:0/1715035695 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8428066f60 0x7f8428069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.307+0000 7f8447400640 1 --2- 172.21.15.175:0/1715035695 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8428066f60 0x7f8428069420 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f84340b2000 tx=0x7f8434009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:00.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.311+0000 7f843fe00640 1 -- 172.21.15.175:0/1715035695 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8438055d80 con 0x7f844806b0e0 2024-04-25T09:10:00.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.463+0000 7f844ea00640 1 -- 172.21.15.175:0/1715035695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8448070bd0 con 0x7f844806b0e0 2024-04-25T09:10:00.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.467+0000 7f843fe00640 1 -- 172.21.15.175:0/1715035695 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+12928 (secure 0 0 0) 0x7f8438059e20 con 0x7f844806b0e0 2024-04-25T09:10:00.455 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:10:00.455 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":80,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:09:59.739454+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:00.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.467+0000 7f844ea00640 1 -- 172.21.15.175:0/1715035695 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8428066f60 msgr2=0x7f8428069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.467+0000 7f844ea00640 1 --2- 172.21.15.175:0/1715035695 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8428066f60 0x7f8428069420 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f84340b2000 tx=0x7f8434009040 comp rx=0 tx=0).stop 2024-04-25T09:10:00.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.467+0000 7f844ea00640 1 -- 172.21.15.175:0/1715035695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f844806b0e0 msgr2=0x7f84481e9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.467+0000 7f844ea00640 1 --2- 172.21.15.175:0/1715035695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f844806b0e0 0x7f84481e9d80 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f843800d800 tx=0x7f843800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.467+0000 7f844ea00640 1 -- 172.21.15.175:0/1715035695 shutdown_connections 2024-04-25T09:10:00.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.467+0000 7f844ea00640 1 --2- 172.21.15.175:0/1715035695 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8428066f60 0x7f8428069420 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.467+0000 7f844ea00640 1 --2- 172.21.15.175:0/1715035695 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84480b1090 0x7f84480c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.467+0000 7f844ea00640 1 --2- 172.21.15.175:0/1715035695 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f84480b0c50 0x7f84481f8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.467+0000 7f844ea00640 1 --2- 172.21.15.175:0/1715035695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f844806b0e0 0x7f84481e9d80 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.467+0000 7f844ea00640 1 -- 172.21.15.175:0/1715035695 >> 172.21.15.175:0/1715035695 conn(0x7f84480d06c0 msgr2=0x7f84480d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:00.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.467+0000 7f844ea00640 1 -- 172.21.15.175:0/1715035695 shutdown_connections 2024-04-25T09:10:00.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.467+0000 7f844ea00640 1 -- 172.21.15.175:0/1715035695 wait complete. 2024-04-25T09:10:00.477 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:10:00.477 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:10:00.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.627+0000 7f864aa00640 1 Processor -- start 2024-04-25T09:10:00.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.627+0000 7f864aa00640 1 -- start start 2024-04-25T09:10:00.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.627+0000 7f864aa00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f86440cbe60 0x7f864415af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.627+0000 7f864aa00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f864406d310 0x7f86440b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.627+0000 7f864aa00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864406db60 con 0x7f86440b4630 2024-04-25T09:10:00.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.627+0000 7f864aa00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86440b4aa0 con 0x7f86440cbe60 2024-04-25T09:10:00.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.627+0000 7f864aa00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864406de40 con 0x7f864406d310 2024-04-25T09:10:00.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.627+0000 7f8643e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f86440cbe60 0x7f864415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.627+0000 7f8648a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f86440b4630 0x7f86440b2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45444/0 (socket says 172.21.15.175:45444) 2024-04-25T09:10:00.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.627+0000 7f8648a00640 1 -- 172.21.15.175:0/995781709 learned_addr learned my addr 172.21.15.175:0/995781709 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:10:00.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.627+0000 7f863b400640 1 --2- 172.21.15.175:0/995781709 >> v2:172.21.15.177:3300/0 conn(0x7f864406d310 0x7f86440b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.627+0000 7f8643e00640 1 -- 172.21.15.175:0/995781709 >> v2:172.21.15.177:3300/0 conn(0x7f864406d310 msgr2=0x7f86440b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:00.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.627+0000 7f8643e00640 1 --2- 172.21.15.175:0/995781709 >> v2:172.21.15.177:3300/0 conn(0x7f864406d310 0x7f86440b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.627+0000 7f8643e00640 1 -- 172.21.15.175:0/995781709 >> v1:172.21.15.175:6789/0 conn(0x7f86440b4630 legacy=0x7f86440b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.627+0000 7f8643400640 1 -- 172.21.15.175:0/995781709 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436989809 0 0) 0x7f864406db60 con 0x7f86440b4630 2024-04-25T09:10:00.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.627+0000 7f8643e00640 1 -- 172.21.15.175:0/995781709 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864406e120 con 0x7f86440cbe60 2024-04-25T09:10:00.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.631+0000 7f8643e00640 1 --2- 172.21.15.175:0/995781709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86440cbe60 0x7f864415af20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f8644072450 tx=0x7f863401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd8772e6590a5cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:00.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.631+0000 7f8643400640 1 -- 172.21.15.175:0/995781709 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86340b2070 con 0x7f86440cbe60 2024-04-25T09:10:00.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.631+0000 7f8643400640 1 -- 172.21.15.175:0/995781709 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86340a5900 con 0x7f86440cbe60 2024-04-25T09:10:00.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.631+0000 7f8643400640 1 -- 172.21.15.175:0/995781709 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86340a5cd0 con 0x7f86440cbe60 2024-04-25T09:10:00.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.631+0000 7f864aa00640 1 -- 172.21.15.175:0/995781709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86440cbe60 msgr2=0x7f864415af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.631+0000 7f864aa00640 1 --2- 172.21.15.175:0/995781709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86440cbe60 0x7f864415af20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f8644072450 tx=0x7f863401c930 comp rx=0 tx=0).stop 2024-04-25T09:10:00.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.631+0000 7f864aa00640 1 -- 172.21.15.175:0/995781709 shutdown_connections 2024-04-25T09:10:00.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.631+0000 7f864aa00640 1 --2- 172.21.15.175:0/995781709 >> v2:172.21.15.177:3300/0 conn(0x7f864406d310 0x7f86440b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.631+0000 7f864aa00640 1 --2- 172.21.15.175:0/995781709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86440cbe60 0x7f864415af20 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.631+0000 7f864aa00640 1 -- 172.21.15.175:0/995781709 >> 172.21.15.175:0/995781709 conn(0x7f864406ac50 msgr2=0x7f864406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:00.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.631+0000 7f864aa00640 1 -- 172.21.15.175:0/995781709 shutdown_connections 2024-04-25T09:10:00.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.631+0000 7f864aa00640 1 -- 172.21.15.175:0/995781709 wait complete. 2024-04-25T09:10:00.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f864aa00640 1 Processor -- start 2024-04-25T09:10:00.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f864aa00640 1 -- start start 2024-04-25T09:10:00.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f864aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f864406d310 0x7f86441502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f864aa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86440b4630 0x7f8644151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f864aa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86440cbe60 0x7f864414c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f864aa00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8644167560 con 0x7f864406d310 2024-04-25T09:10:00.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f864aa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864406d900 con 0x7f86440cbe60 2024-04-25T09:10:00.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f864aa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86441676e0 con 0x7f86440b4630 2024-04-25T09:10:00.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f8643e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f864406d310 0x7f86441502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f8643e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f864406d310 0x7f86441502c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54490/0 (socket says 172.21.15.175:54490) 2024-04-25T09:10:00.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f8643e00640 1 -- 172.21.15.175:0/1188965441 learned_addr learned my addr 172.21.15.175:0/1188965441 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:00.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f8648a00640 1 --2- 172.21.15.175:0/1188965441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86440cbe60 0x7f864414c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f863b400640 1 --2- 172.21.15.175:0/1188965441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86440b4630 0x7f8644151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f8643e00640 1 -- 172.21.15.175:0/1188965441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86440b4630 msgr2=0x7f8644151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f8643e00640 1 --2- 172.21.15.175:0/1188965441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86440b4630 0x7f8644151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f8643e00640 1 -- 172.21.15.175:0/1188965441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86440cbe60 msgr2=0x7f864414c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f8643e00640 1 --2- 172.21.15.175:0/1188965441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86440cbe60 0x7f864414c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f8643e00640 1 -- 172.21.15.175:0/1188965441 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864414d250 con 0x7f864406d310 2024-04-25T09:10:00.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f863b400640 1 --2- 172.21.15.175:0/1188965441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86440b4630 0x7f8644151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:00.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f8643e00640 1 --2- 172.21.15.175:0/1188965441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f864406d310 0x7f86441502c0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f86340b0040 tx=0x7f86340196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:00.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f8640c00640 1 -- 172.21.15.175:0/1188965441 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86340bd030 con 0x7f864406d310 2024-04-25T09:10:00.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f8640c00640 1 -- 172.21.15.175:0/1188965441 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86340b8470 con 0x7f864406d310 2024-04-25T09:10:00.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f864aa00640 1 -- 172.21.15.175:0/1188965441 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8644155f50 con 0x7f864406d310 2024-04-25T09:10:00.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f8640c00640 1 -- 172.21.15.175:0/1188965441 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86340b2040 con 0x7f864406d310 2024-04-25T09:10:00.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.635+0000 7f864aa00640 1 -- 172.21.15.175:0/1188965441 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8644156510 con 0x7f864406d310 2024-04-25T09:10:00.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.639+0000 7f864aa00640 1 -- 172.21.15.175:0/1188965441 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8644156710 con 0x7f864406d310 2024-04-25T09:10:00.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.639+0000 7f8640c00640 1 -- 172.21.15.175:0/1188965441 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f86340c0070 con 0x7f864406d310 2024-04-25T09:10:00.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.639+0000 7f8640c00640 1 --2- 172.21.15.175:0/1188965441 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8620066f60 0x7f8620069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.639+0000 7f8640c00640 1 -- 172.21.15.175:0/1188965441 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f863411f5f0 con 0x7f864406d310 2024-04-25T09:10:00.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.639+0000 7f863b400640 1 --2- 172.21.15.175:0/1188965441 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8620066f60 0x7f8620069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.639+0000 7f863b400640 1 --2- 172.21.15.175:0/1188965441 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8620066f60 0x7f8620069420 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f86440cbb90 tx=0x7f862c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:00.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.643+0000 7f8640c00640 1 -- 172.21.15.175:0/1188965441 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8644156710 con 0x7f864406d310 2024-04-25T09:10:00.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.803+0000 7f864aa00640 1 -- 172.21.15.175:0/1188965441 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8644075160 con 0x7f864406d310 2024-04-25T09:10:00.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.803+0000 7f8640c00640 1 -- 172.21.15.175:0/1188965441 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8634016520 con 0x7f864406d310 2024-04-25T09:10:00.793 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:10:00.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.803+0000 7f864aa00640 1 -- 172.21.15.175:0/1188965441 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8620066f60 msgr2=0x7f8620069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.803+0000 7f864aa00640 1 --2- 172.21.15.175:0/1188965441 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8620066f60 0x7f8620069420 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f86440cbb90 tx=0x7f862c008040 comp rx=0 tx=0).stop 2024-04-25T09:10:00.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.803+0000 7f864aa00640 1 -- 172.21.15.175:0/1188965441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f864406d310 msgr2=0x7f86441502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.803+0000 7f864aa00640 1 --2- 172.21.15.175:0/1188965441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f864406d310 0x7f86441502c0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f86340b0040 tx=0x7f86340196d0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.803+0000 7f864aa00640 1 -- 172.21.15.175:0/1188965441 shutdown_connections 2024-04-25T09:10:00.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.803+0000 7f864aa00640 1 --2- 172.21.15.175:0/1188965441 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8620066f60 0x7f8620069420 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.803+0000 7f864aa00640 1 --2- 172.21.15.175:0/1188965441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86440cbe60 0x7f864414c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.803+0000 7f864aa00640 1 --2- 172.21.15.175:0/1188965441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86440b4630 0x7f8644151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.803+0000 7f864aa00640 1 --2- 172.21.15.175:0/1188965441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f864406d310 0x7f86441502c0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.803+0000 7f864aa00640 1 -- 172.21.15.175:0/1188965441 >> 172.21.15.175:0/1188965441 conn(0x7f864406ac50 msgr2=0x7f8644071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:00.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.807+0000 7f864aa00640 1 -- 172.21.15.175:0/1188965441 shutdown_connections 2024-04-25T09:10:00.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.807+0000 7f864aa00640 1 -- 172.21.15.175:0/1188965441 wait complete. 2024-04-25T09:10:00.814 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:10:00.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.959+0000 7fd5bf400640 1 Processor -- start 2024-04-25T09:10:00.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.959+0000 7fd5bf400640 1 -- start start 2024-04-25T09:10:00.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.959+0000 7fd5bf400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b815db00 0x7fd5b806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.959+0000 7fd5bf400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd5b80acd90 0x7fd5b8161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.959+0000 7fd5bf400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b806f280 con 0x7fd5b8161c60 2024-04-25T09:10:00.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.959+0000 7fd5bf400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b806acf0 con 0x7fd5b80acd90 2024-04-25T09:10:00.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.959+0000 7fd5bf400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b806afd0 con 0x7fd5b815db00 2024-04-25T09:10:00.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5bd400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd5b8161c60 0x7fd5b80b2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45454/0 (socket says 172.21.15.175:45454) 2024-04-25T09:10:00.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5bd400640 1 -- 172.21.15.175:0/845222459 learned_addr learned my addr 172.21.15.175:0/845222459 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:10:00.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/845222459 >> v2:172.21.15.177:3300/0 conn(0x7fd5b80acd90 0x7fd5b8161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5bca00640 1 --2- 172.21.15.175:0/845222459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b815db00 0x7fd5b806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7400640 1 -- 172.21.15.175:0/845222459 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576865252 0 0) 0x7fd5b806f280 con 0x7fd5b8161c60 2024-04-25T09:10:00.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7400640 1 -- 172.21.15.175:0/845222459 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5a0003530 con 0x7fd5b8161c60 2024-04-25T09:10:00.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7400640 1 -- 172.21.15.175:0/845222459 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2438927090 0 0) 0x7fd5a0003530 con 0x7fd5b8161c60 2024-04-25T09:10:00.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7400640 1 -- 172.21.15.175:0/845222459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b815db00 msgr2=0x7fd5b806e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:00.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7400640 1 --2- 172.21.15.175:0/845222459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b815db00 0x7fd5b806e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7400640 1 -- 172.21.15.175:0/845222459 >> v2:172.21.15.177:3300/0 conn(0x7fd5b80acd90 msgr2=0x7fd5b8161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:00.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7400640 1 --2- 172.21.15.175:0/845222459 >> v2:172.21.15.177:3300/0 conn(0x7fd5b80acd90 0x7fd5b8161720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7400640 1 -- 172.21.15.175:0/845222459 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b806b2b0 con 0x7fd5b8161c60 2024-04-25T09:10:00.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7400640 1 -- 172.21.15.175:0/845222459 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fd5b0001a00 con 0x7fd5b8161c60 2024-04-25T09:10:00.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7400640 1 -- 172.21.15.175:0/845222459 >> v1:172.21.15.175:6789/0 conn(0x7fd5b8161c60 legacy=0x7fd5b80b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7400640 1 --2- 172.21.15.175:0/845222459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b815db00 0x7fd5a00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7400640 1 --2- 172.21.15.175:0/845222459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5a0003f40 0x7fd5a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7400640 1 --2- 172.21.15.175:0/845222459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5a0004d50 0x7fd5a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7400640 1 -- 172.21.15.175:0/845222459 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b806acf0 con 0x7fd5a0003f40 2024-04-25T09:10:00.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7400640 1 -- 172.21.15.175:0/845222459 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b806afd0 con 0x7fd5a0004d50 2024-04-25T09:10:00.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7400640 1 -- 172.21.15.175:0/845222459 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a000b9d0 con 0x7fd5b815db00 2024-04-25T09:10:00.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/845222459 >> v2:172.21.15.177:3300/0 conn(0x7fd5b80acd90 0x7fd5b8161720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:00.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/845222459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5a0003f40 0x7fd5a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5bd400640 1 --2- 172.21.15.175:0/845222459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5a0004d50 0x7fd5a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5bca00640 1 --2- 172.21.15.175:0/845222459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b815db00 0x7fd5a00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7e00640 1 -- 172.21.15.175:0/845222459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b815db00 msgr2=0x7fd5a00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:00.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/845222459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b815db00 0x7fd5a00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7e00640 1 -- 172.21.15.175:0/845222459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5a0004d50 msgr2=0x7fd5a00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:00.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/845222459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5a0004d50 0x7fd5a00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5b7e00640 1 -- 172.21.15.175:0/845222459 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a0003530 con 0x7fd5a0003f40 2024-04-25T09:10:00.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.963+0000 7fd5bca00640 1 --2- 172.21.15.175:0/845222459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b815db00 0x7fd5a00039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:00.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/845222459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5a0003f40 0x7fd5a0004810 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009c90 tx=0x7fd5a401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d410109e052911af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:00.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5b7400640 1 -- 172.21.15.175:0/845222459 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4009860 con 0x7fd5a0003f40 2024-04-25T09:10:00.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5b7400640 1 -- 172.21.15.175:0/845222459 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a4004020 con 0x7fd5a0003f40 2024-04-25T09:10:00.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5b7400640 1 -- 172.21.15.175:0/845222459 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4004450 con 0x7fd5a0003f40 2024-04-25T09:10:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5bf400640 1 -- 172.21.15.175:0/845222459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5a0003f40 msgr2=0x7fd5a0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5bf400640 1 --2- 172.21.15.175:0/845222459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5a0003f40 0x7fd5a0004810 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009c90 tx=0x7fd5a401cc10 comp rx=0 tx=0).stop 2024-04-25T09:10:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5bd400640 1 -- 172.21.15.175:0/845222459 reap_dead start 2024-04-25T09:10:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5bf400640 1 -- 172.21.15.175:0/845222459 shutdown_connections 2024-04-25T09:10:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5bf400640 1 -- 172.21.15.175:0/845222459 >> 172.21.15.175:0/845222459 conn(0x7fd5b80b2200 msgr2=0x7fd5b80cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5bf400640 1 -- 172.21.15.175:0/845222459 shutdown_connections 2024-04-25T09:10:00.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5bf400640 1 -- 172.21.15.175:0/845222459 wait complete. 2024-04-25T09:10:00.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5bf400640 1 Processor -- start 2024-04-25T09:10:00.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5bf400640 1 -- start start 2024-04-25T09:10:00.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5bf400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5a0003f40 0x7fd5b81f7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5bf400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5b81555e0 0x7fd5b814e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5bf400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b81519e0 0x7fd5b8151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5bf400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b81620f0 con 0x7fd5b81555e0 2024-04-25T09:10:00.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5bf400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b815dee0 con 0x7fd5a0003f40 2024-04-25T09:10:00.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.967+0000 7fd5bf400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b8162270 con 0x7fd5b81519e0 2024-04-25T09:10:00.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5b7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5b81555e0 0x7fd5b814e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5b7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5b81555e0 0x7fd5b814e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54504/0 (socket says 172.21.15.175:54504) 2024-04-25T09:10:00.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5b7e00640 1 -- 172.21.15.175:0/1366452602 learned_addr learned my addr 172.21.15.175:0/1366452602 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:00.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5bca00640 1 --2- 172.21.15.175:0/1366452602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5a0003f40 0x7fd5b81f7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5bd400640 1 --2- 172.21.15.175:0/1366452602 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b81519e0 0x7fd5b8151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5b7e00640 1 -- 172.21.15.175:0/1366452602 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b81519e0 msgr2=0x7fd5b8151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/1366452602 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b81519e0 0x7fd5b8151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5b7e00640 1 -- 172.21.15.175:0/1366452602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5a0003f40 msgr2=0x7fd5b81f7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/1366452602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5a0003f40 0x7fd5b81f7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5b7e00640 1 -- 172.21.15.175:0/1366452602 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b8155aa0 con 0x7fd5b81555e0 2024-04-25T09:10:00.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5b7e00640 1 --2- 172.21.15.175:0/1366452602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5b81555e0 0x7fd5b814e700 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40af040 tx=0x7fd5a0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:00.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5b4c00640 1 -- 172.21.15.175:0/1366452602 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a40bb070 con 0x7fd5b81555e0 2024-04-25T09:10:00.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5b4c00640 1 -- 172.21.15.175:0/1366452602 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a4005db0 con 0x7fd5b81555e0 2024-04-25T09:10:00.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5bf400640 1 -- 172.21.15.175:0/1366452602 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b814ff20 con 0x7fd5b81555e0 2024-04-25T09:10:00.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5b4c00640 1 -- 172.21.15.175:0/1366452602 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a40a5a40 con 0x7fd5b81555e0 2024-04-25T09:10:00.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5bf400640 1 -- 172.21.15.175:0/1366452602 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b814ec40 con 0x7fd5b81555e0 2024-04-25T09:10:00.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5bf400640 1 -- 172.21.15.175:0/1366452602 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b8074a60 con 0x7fd5b81555e0 2024-04-25T09:10:00.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5b4c00640 1 -- 172.21.15.175:0/1366452602 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd5a4006040 con 0x7fd5b81555e0 2024-04-25T09:10:00.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.971+0000 7fd5b4c00640 1 --2- 172.21.15.175:0/1366452602 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd598066f90 0x7fd598069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.975+0000 7fd5b4c00640 1 -- 172.21.15.175:0/1366452602 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd5a411ef10 con 0x7fd5b81555e0 2024-04-25T09:10:00.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.975+0000 7fd5bca00640 1 --2- 172.21.15.175:0/1366452602 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd598066f90 0x7fd598069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.975+0000 7fd5bca00640 1 --2- 172.21.15.175:0/1366452602 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd598066f90 0x7fd598069450 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac009a80 tx=0x7fd5ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:00.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:00.979+0000 7fd5b4c00640 1 -- 172.21.15.175:0/1366452602 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd5a40c4020 con 0x7fd5b81555e0 2024-04-25T09:10:01.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.135+0000 7fd5bf400640 1 -- 172.21.15.175:0/1366452602 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd5b80751a0 con 0x7fd5b81555e0 2024-04-25T09:10:01.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.135+0000 7fd5b4c00640 1 -- 172.21.15.175:0/1366452602 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd5a4016980 con 0x7fd5b81555e0 2024-04-25T09:10:01.124 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:10:01.124 INFO:teuthology.orchestra.run.smithi175.stdout:[ 2024-04-25T09:10:01.125 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:01.125 INFO:teuthology.orchestra.run.smithi175.stdout: "poolnum": 1, 2024-04-25T09:10:01.125 INFO:teuthology.orchestra.run.smithi175.stdout: "poolname": ".mgr" 2024-04-25T09:10:01.125 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:01.125 INFO:teuthology.orchestra.run.smithi175.stdout:] 2024-04-25T09:10:01.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.135+0000 7fd5bf400640 1 -- 172.21.15.175:0/1366452602 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd598066f90 msgr2=0x7fd598069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:01.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.135+0000 7fd5bf400640 1 --2- 172.21.15.175:0/1366452602 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd598066f90 0x7fd598069450 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac009a80 tx=0x7fd5ac008040 comp rx=0 tx=0).stop 2024-04-25T09:10:01.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.135+0000 7fd5bf400640 1 -- 172.21.15.175:0/1366452602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5b81555e0 msgr2=0x7fd5b814e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:01.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.135+0000 7fd5bf400640 1 --2- 172.21.15.175:0/1366452602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5b81555e0 0x7fd5b814e700 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40af040 tx=0x7fd5a0005840 comp rx=0 tx=0).stop 2024-04-25T09:10:01.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.135+0000 7fd5bf400640 1 -- 172.21.15.175:0/1366452602 shutdown_connections 2024-04-25T09:10:01.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.135+0000 7fd5bf400640 1 --2- 172.21.15.175:0/1366452602 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd598066f90 0x7fd598069450 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.135+0000 7fd5bf400640 1 --2- 172.21.15.175:0/1366452602 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5b81519e0 0x7fd5b8151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.135+0000 7fd5bf400640 1 --2- 172.21.15.175:0/1366452602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5b81555e0 0x7fd5b814e700 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.135+0000 7fd5bf400640 1 --2- 172.21.15.175:0/1366452602 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5a0003f40 0x7fd5b81f7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.135+0000 7fd5bf400640 1 -- 172.21.15.175:0/1366452602 >> 172.21.15.175:0/1366452602 conn(0x7fd5b80b2200 msgr2=0x7fd5b806dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:01.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.135+0000 7fd5bf400640 1 -- 172.21.15.175:0/1366452602 shutdown_connections 2024-04-25T09:10:01.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.135+0000 7fd5bf400640 1 -- 172.21.15.175:0/1366452602 wait complete. 2024-04-25T09:10:01.146 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:10:01.146 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:10:01.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.295+0000 7f3baac00640 1 Processor -- start 2024-04-25T09:10:01.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.295+0000 7f3baac00640 1 -- start start 2024-04-25T09:10:01.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.295+0000 7f3baac00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ba40712b0 0x7f3ba4071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.295+0000 7f3baac00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3ba406d860 0x7f3ba406dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.295+0000 7f3baac00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba4071e20 con 0x7f3ba40cfb60 2024-04-25T09:10:01.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.295+0000 7f3baac00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba40cbed0 con 0x7f3ba406d860 2024-04-25T09:10:01.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.295+0000 7f3baac00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba406e1d0 con 0x7f3ba40712b0 2024-04-25T09:10:01.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.295+0000 7f3ba3e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f3ba40cfb60 0x7f3ba40ce7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45456/0 (socket says 172.21.15.175:45456) 2024-04-25T09:10:01.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.295+0000 7f3ba3e00640 1 -- 172.21.15.175:0/2123824239 learned_addr learned my addr 172.21.15.175:0/2123824239 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:10:01.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.295+0000 7f3b9b400640 1 --2- 172.21.15.175:0/2123824239 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ba40712b0 0x7f3ba4071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.295+0000 7f3ba8c00640 1 --2- 172.21.15.175:0/2123824239 >> v2:172.21.15.177:3300/0 conn(0x7f3ba406d860 0x7f3ba406dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.299+0000 7f3ba3400640 1 -- 172.21.15.175:0/2123824239 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388157653 0 0) 0x7f3ba4071e20 con 0x7f3ba40cfb60 2024-04-25T09:10:01.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.299+0000 7f3ba3400640 1 -- 172.21.15.175:0/2123824239 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b88003530 con 0x7f3ba40cfb60 2024-04-25T09:10:01.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.299+0000 7f3ba3400640 1 -- 172.21.15.175:0/2123824239 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3564061496 0 0) 0x7f3b88003530 con 0x7f3ba40cfb60 2024-04-25T09:10:01.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.299+0000 7f3b9b400640 1 -- 172.21.15.175:0/2123824239 >> v2:172.21.15.177:3300/0 conn(0x7f3ba406d860 msgr2=0x7f3ba406dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:01.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.299+0000 7f3b9b400640 1 --2- 172.21.15.175:0/2123824239 >> v2:172.21.15.177:3300/0 conn(0x7f3ba406d860 0x7f3ba406dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.299+0000 7f3b9b400640 1 -- 172.21.15.175:0/2123824239 >> v1:172.21.15.175:6789/0 conn(0x7f3ba40cfb60 legacy=0x7f3ba40ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:01.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.299+0000 7f3b9b400640 1 -- 172.21.15.175:0/2123824239 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba4072100 con 0x7f3ba40712b0 2024-04-25T09:10:01.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.299+0000 7f3b9b400640 1 --2- 172.21.15.175:0/2123824239 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ba40712b0 0x7f3ba4071710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0097c0 tx=0x7f3b8c01c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9877bc22d7e4b30e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:01.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.299+0000 7f3ba3400640 1 -- 172.21.15.175:0/2123824239 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c0b0070 con 0x7f3ba40712b0 2024-04-25T09:10:01.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.299+0000 7f3ba3400640 1 -- 172.21.15.175:0/2123824239 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c0ab400 con 0x7f3ba40712b0 2024-04-25T09:10:01.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.299+0000 7f3ba3400640 1 -- 172.21.15.175:0/2123824239 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94001680 con 0x7f3ba40712b0 2024-04-25T09:10:01.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3baac00640 1 -- 172.21.15.175:0/2123824239 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ba40712b0 msgr2=0x7f3ba4071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:01.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3baac00640 1 --2- 172.21.15.175:0/2123824239 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ba40712b0 0x7f3ba4071710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0097c0 tx=0x7f3b8c01c330 comp rx=0 tx=0).stop 2024-04-25T09:10:01.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3baac00640 1 -- 172.21.15.175:0/2123824239 shutdown_connections 2024-04-25T09:10:01.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3baac00640 1 --2- 172.21.15.175:0/2123824239 >> v2:172.21.15.177:3300/0 conn(0x7f3ba406d860 0x7f3ba406dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3baac00640 1 --2- 172.21.15.175:0/2123824239 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ba40712b0 0x7f3ba4071710 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3baac00640 1 -- 172.21.15.175:0/2123824239 >> 172.21.15.175:0/2123824239 conn(0x7f3ba406ac50 msgr2=0x7f3ba406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:01.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3baac00640 1 -- 172.21.15.175:0/2123824239 shutdown_connections 2024-04-25T09:10:01.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3baac00640 1 -- 172.21.15.175:0/2123824239 wait complete. 2024-04-25T09:10:01.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3baac00640 1 Processor -- start 2024-04-25T09:10:01.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3baac00640 1 -- start start 2024-04-25T09:10:01.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3baac00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ba406d860 0x7f3ba41f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3baac00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ba40712b0 0x7f3ba413d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3baac00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ba40cfb60 0x7f3ba413e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3baac00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40d00c0 con 0x7f3ba40cfb60 2024-04-25T09:10:01.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3baac00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40cff40 con 0x7f3ba406d860 2024-04-25T09:10:01.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3baac00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba40ceee0 con 0x7f3ba40712b0 2024-04-25T09:10:01.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3ba8c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ba40cfb60 0x7f3ba413e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3ba8c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ba40cfb60 0x7f3ba413e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54514/0 (socket says 172.21.15.175:54514) 2024-04-25T09:10:01.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3ba8c00640 1 -- 172.21.15.175:0/2648620975 learned_addr learned my addr 172.21.15.175:0/2648620975 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:01.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3b9b400640 1 --2- 172.21.15.175:0/2648620975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ba40712b0 0x7f3ba413d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3ba3e00640 1 --2- 172.21.15.175:0/2648620975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ba406d860 0x7f3ba41f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3ba8c00640 1 -- 172.21.15.175:0/2648620975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ba40712b0 msgr2=0x7f3ba413d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:01.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3ba8c00640 1 --2- 172.21.15.175:0/2648620975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ba40712b0 0x7f3ba413d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3ba8c00640 1 -- 172.21.15.175:0/2648620975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ba406d860 msgr2=0x7f3ba41f6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:01.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3ba8c00640 1 --2- 172.21.15.175:0/2648620975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ba406d860 0x7f3ba41f6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3ba8c00640 1 -- 172.21.15.175:0/2648620975 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba415d1e0 con 0x7f3ba40cfb60 2024-04-25T09:10:01.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.303+0000 7f3ba3e00640 1 --2- 172.21.15.175:0/2648620975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ba406d860 0x7f3ba41f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:01.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.307+0000 7f3ba8c00640 1 --2- 172.21.15.175:0/2648620975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ba40cfb60 0x7f3ba413e120 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c00efc0 tx=0x7f3b9c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:01.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.307+0000 7f3ba0c00640 1 -- 172.21.15.175:0/2648620975 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c018020 con 0x7f3ba40cfb60 2024-04-25T09:10:01.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.307+0000 7f3ba0c00640 1 -- 172.21.15.175:0/2648620975 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9c014480 con 0x7f3ba40cfb60 2024-04-25T09:10:01.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.307+0000 7f3ba0c00640 1 -- 172.21.15.175:0/2648620975 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c014870 con 0x7f3ba40cfb60 2024-04-25T09:10:01.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.307+0000 7f3baac00640 1 -- 172.21.15.175:0/2648620975 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba415d4c0 con 0x7f3ba40cfb60 2024-04-25T09:10:01.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.307+0000 7f3baac00640 1 -- 172.21.15.175:0/2648620975 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba415da80 con 0x7f3ba40cfb60 2024-04-25T09:10:01.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.307+0000 7f3baac00640 1 -- 172.21.15.175:0/2648620975 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba4075160 con 0x7f3ba40cfb60 2024-04-25T09:10:01.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.307+0000 7f3ba0c00640 1 -- 172.21.15.175:0/2648620975 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3b9c01b020 con 0x7f3ba40cfb60 2024-04-25T09:10:01.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.307+0000 7f3ba0c00640 1 --2- 172.21.15.175:0/2648620975 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3b80066f60 0x7f3b80069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.307+0000 7f3ba0c00640 1 -- 172.21.15.175:0/2648620975 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3b9c0858e0 con 0x7f3ba40cfb60 2024-04-25T09:10:01.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.307+0000 7f3ba3e00640 1 --2- 172.21.15.175:0/2648620975 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3b80066f60 0x7f3b80069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.311+0000 7f3ba3e00640 1 --2- 172.21.15.175:0/2648620975 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3b80066f60 0x7f3b80069420 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3b94007af0 tx=0x7f3b94009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:01.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.311+0000 7f3ba0c00640 1 -- 172.21.15.175:0/2648620975 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3b9c022030 con 0x7f3ba40cfb60 2024-04-25T09:10:01.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:01.471+0000 7f3baac00640 1 -- 172.21.15.175:0/2648620975 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3ba41f7040 con 0x7f3ba40cfb60 2024-04-25T09:10:02.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.395+0000 7f3ba0c00640 1 -- 172.21.15.175:0/2648620975 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3b9c010040 con 0x7f3ba40cfb60 2024-04-25T09:10:02.385 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_metadata' created 2024-04-25T09:10:02.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.399+0000 7f3baac00640 1 -- 172.21.15.175:0/2648620975 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3b80066f60 msgr2=0x7f3b80069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:02.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.399+0000 7f3baac00640 1 --2- 172.21.15.175:0/2648620975 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3b80066f60 0x7f3b80069420 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3b94007af0 tx=0x7f3b94009040 comp rx=0 tx=0).stop 2024-04-25T09:10:02.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.399+0000 7f3baac00640 1 -- 172.21.15.175:0/2648620975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ba40cfb60 msgr2=0x7f3ba413e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:02.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.399+0000 7f3baac00640 1 --2- 172.21.15.175:0/2648620975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ba40cfb60 0x7f3ba413e120 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c00efc0 tx=0x7f3b9c00c490 comp rx=0 tx=0).stop 2024-04-25T09:10:02.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.399+0000 7f3baac00640 1 -- 172.21.15.175:0/2648620975 shutdown_connections 2024-04-25T09:10:02.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.399+0000 7f3baac00640 1 --2- 172.21.15.175:0/2648620975 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3b80066f60 0x7f3b80069420 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.399+0000 7f3baac00640 1 --2- 172.21.15.175:0/2648620975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ba40cfb60 0x7f3ba413e120 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.399+0000 7f3baac00640 1 --2- 172.21.15.175:0/2648620975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3ba40712b0 0x7f3ba413d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.399+0000 7f3baac00640 1 --2- 172.21.15.175:0/2648620975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3ba406d860 0x7f3ba41f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.399+0000 7f3baac00640 1 -- 172.21.15.175:0/2648620975 >> 172.21.15.175:0/2648620975 conn(0x7f3ba406ac50 msgr2=0x7f3ba40741d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:02.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.399+0000 7f3baac00640 1 -- 172.21.15.175:0/2648620975 shutdown_connections 2024-04-25T09:10:02.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.399+0000 7f3baac00640 1 -- 172.21.15.175:0/2648620975 wait complete. 2024-04-25T09:10:02.412 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:10:02.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.563+0000 7f5e86800640 1 Processor -- start 2024-04-25T09:10:02.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.563+0000 7f5e86800640 1 -- start start 2024-04-25T09:10:02.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e86800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5e8006dd90 0x7f5e800718f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:02.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e86800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e800cf7e0 con 0x7f5e80071e30 2024-04-25T09:10:02.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e86800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e800cc310 con 0x7f5e80071510 2024-04-25T09:10:02.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e86800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e800ccc40 con 0x7f5e8006dd90 2024-04-25T09:10:02.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7fe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5e80071e30 0x7f5e801654a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45462/0 (socket says 172.21.15.175:45462) 2024-04-25T09:10:02.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7fe00640 1 -- 172.21.15.175:0/4128660489 learned_addr learned my addr 172.21.15.175:0/4128660489 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:10:02.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e76a00640 1 --2- 172.21.15.175:0/4128660489 >> v2:172.21.15.177:3300/0 conn(0x7f5e8006dd90 0x7f5e800718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:02.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7ea00640 1 -- 172.21.15.175:0/4128660489 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915311465 0 0) 0x7f5e800cf7e0 con 0x7f5e80071e30 2024-04-25T09:10:02.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7ea00640 1 -- 172.21.15.175:0/4128660489 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e64003530 con 0x7f5e80071e30 2024-04-25T09:10:02.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7ea00640 1 -- 172.21.15.175:0/4128660489 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 773597553 0 0) 0x7f5e64003530 con 0x7f5e80071e30 2024-04-25T09:10:02.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7ea00640 1 -- 172.21.15.175:0/4128660489 >> v2:172.21.15.177:3300/0 conn(0x7f5e8006dd90 msgr2=0x7f5e800718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:02.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7ea00640 1 --2- 172.21.15.175:0/4128660489 >> v2:172.21.15.177:3300/0 conn(0x7f5e8006dd90 0x7f5e800718f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7ea00640 1 -- 172.21.15.175:0/4128660489 >> v1:172.21.15.177:6789/0 conn(0x7f5e80071510 legacy=0x7f5e800cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:02.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7ea00640 1 -- 172.21.15.175:0/4128660489 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e800cc5f0 con 0x7f5e80071e30 2024-04-25T09:10:02.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7ea00640 1 -- 172.21.15.175:0/4128660489 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f5e78001a00 con 0x7f5e80071e30 2024-04-25T09:10:02.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7ea00640 1 -- 172.21.15.175:0/4128660489 >> v1:172.21.15.175:6789/0 conn(0x7f5e80071e30 legacy=0x7f5e801654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:02.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7ea00640 1 --2- 172.21.15.175:0/4128660489 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e640039c0 0x7f5e64003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:02.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7ea00640 1 --2- 172.21.15.175:0/4128660489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e64004810 0x7f5e64004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:02.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7ea00640 1 --2- 172.21.15.175:0/4128660489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e640051d0 0x7f5e6400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:02.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7ea00640 1 -- 172.21.15.175:0/4128660489 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800ccc40 con 0x7f5e64004810 2024-04-25T09:10:02.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7ea00640 1 -- 172.21.15.175:0/4128660489 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6400c070 con 0x7f5e640051d0 2024-04-25T09:10:02.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7ea00640 1 -- 172.21.15.175:0/4128660489 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6400c270 con 0x7f5e640039c0 2024-04-25T09:10:02.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e76a00640 1 --2- 172.21.15.175:0/4128660489 >> v2:172.21.15.177:3300/0 conn(0x7f5e8006dd90 0x7f5e800718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:02.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e76a00640 1 --2- 172.21.15.175:0/4128660489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e64004810 0x7f5e64004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:02.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7fe00640 1 --2- 172.21.15.175:0/4128660489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e640051d0 0x7f5e6400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:02.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7f400640 1 --2- 172.21.15.175:0/4128660489 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e640039c0 0x7f5e64003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:02.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e76a00640 1 -- 172.21.15.175:0/4128660489 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e640039c0 msgr2=0x7f5e64003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:02.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e76a00640 1 --2- 172.21.15.175:0/4128660489 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e640039c0 0x7f5e64003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e76a00640 1 -- 172.21.15.175:0/4128660489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e640051d0 msgr2=0x7f5e6400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:02.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e76a00640 1 --2- 172.21.15.175:0/4128660489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e640051d0 0x7f5e6400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e76a00640 1 -- 172.21.15.175:0/4128660489 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e64003530 con 0x7f5e64004810 2024-04-25T09:10:02.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.567+0000 7f5e7fe00640 1 -- 172.21.15.175:0/4128660489 reap_dead start 2024-04-25T09:10:02.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.571+0000 7f5e76a00640 1 --2- 172.21.15.175:0/4128660489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e64004810 0x7f5e64004c90 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009c90 tx=0x7f5e6801cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f98a0547c2b610d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:02.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.571+0000 7f5e7ea00640 1 -- 172.21.15.175:0/4128660489 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68009860 con 0x7f5e64004810 2024-04-25T09:10:02.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.571+0000 7f5e7ea00640 1 -- 172.21.15.175:0/4128660489 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e68004020 con 0x7f5e64004810 2024-04-25T09:10:02.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.571+0000 7f5e7ea00640 1 -- 172.21.15.175:0/4128660489 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68004450 con 0x7f5e64004810 2024-04-25T09:10:02.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.571+0000 7f5e86800640 1 -- 172.21.15.175:0/4128660489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e64004810 msgr2=0x7f5e64004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:02.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.571+0000 7f5e86800640 1 --2- 172.21.15.175:0/4128660489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e64004810 0x7f5e64004c90 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009c90 tx=0x7f5e6801cbf0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.571+0000 7f5e86800640 1 -- 172.21.15.175:0/4128660489 shutdown_connections 2024-04-25T09:10:02.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.571+0000 7f5e86800640 1 --2- 172.21.15.175:0/4128660489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e64004810 0x7f5e64004c90 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.571+0000 7f5e86800640 1 -- 172.21.15.175:0/4128660489 >> 172.21.15.175:0/4128660489 conn(0x7f5e8006ac50 msgr2=0x7f5e8006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:02.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.571+0000 7f5e86800640 1 -- 172.21.15.175:0/4128660489 shutdown_connections 2024-04-25T09:10:02.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.571+0000 7f5e86800640 1 -- 172.21.15.175:0/4128660489 wait complete. 2024-04-25T09:10:02.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e86800640 1 Processor -- start 2024-04-25T09:10:02.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e86800640 1 -- start start 2024-04-25T09:10:02.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e86800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e64004810 0x7f5e80143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:02.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e86800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e8015ab60 0x7f5e8015afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:02.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e86800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e800aca80 0x7f5e800acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:02.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e86800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8006e210 con 0x7f5e800aca80 2024-04-25T09:10:02.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e86800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800cd0d0 con 0x7f5e8015ab60 2024-04-25T09:10:02.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e86800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8015b520 con 0x7f5e64004810 2024-04-25T09:10:02.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e7fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e800aca80 0x7f5e800acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:02.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e76a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e8015ab60 0x7f5e8015afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:02.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e7f400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e64004810 0x7f5e80143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:02.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e7fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e800aca80 0x7f5e800acf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54524/0 (socket says 172.21.15.175:54524) 2024-04-25T09:10:02.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e7fe00640 1 -- 172.21.15.175:0/1483199534 learned_addr learned my addr 172.21.15.175:0/1483199534 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:02.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e76a00640 1 --2- 172.21.15.175:0/1483199534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e8015ab60 0x7f5e8015afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:41826/0 (socket says 172.21.15.175:41826) 2024-04-25T09:10:02.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e7fe00640 1 -- 172.21.15.175:0/1483199534 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e64004810 msgr2=0x7f5e80143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:02.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e7fe00640 1 --2- 172.21.15.175:0/1483199534 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e64004810 0x7f5e80143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e7fe00640 1 -- 172.21.15.175:0/1483199534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e8015ab60 msgr2=0x7f5e8015afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:02.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e7fe00640 1 --2- 172.21.15.175:0/1483199534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e8015ab60 0x7f5e8015afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e7fe00640 1 -- 172.21.15.175:0/1483199534 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e800ad7f0 con 0x7f5e800aca80 2024-04-25T09:10:02.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e7fe00640 1 --2- 172.21.15.175:0/1483199534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e800aca80 0x7f5e800acf00 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f5e80072210 tx=0x7f5e78007a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:02.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e77e00640 1 -- 172.21.15.175:0/1483199534 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7801c070 con 0x7f5e800aca80 2024-04-25T09:10:02.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e77e00640 1 -- 172.21.15.175:0/1483199534 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e78011a00 con 0x7f5e800aca80 2024-04-25T09:10:02.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e77e00640 1 -- 172.21.15.175:0/1483199534 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e78010040 con 0x7f5e800aca80 2024-04-25T09:10:02.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e86800640 1 -- 172.21.15.175:0/1483199534 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e800adad0 con 0x7f5e800aca80 2024-04-25T09:10:02.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e86800640 1 -- 172.21.15.175:0/1483199534 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e800ae090 con 0x7f5e800aca80 2024-04-25T09:10:02.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.575+0000 7f5e86800640 1 -- 172.21.15.175:0/1483199534 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e80074a60 con 0x7f5e800aca80 2024-04-25T09:10:02.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.579+0000 7f5e77e00640 1 -- 172.21.15.175:0/1483199534 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5e78006110 con 0x7f5e800aca80 2024-04-25T09:10:02.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.579+0000 7f5e77e00640 1 --2- 172.21.15.175:0/1483199534 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5e5c066f60 0x7f5e5c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:02.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.579+0000 7f5e77e00640 1 -- 172.21.15.175:0/1483199534 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f5e78087c00 con 0x7f5e800aca80 2024-04-25T09:10:02.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.579+0000 7f5e7f400640 1 --2- 172.21.15.175:0/1483199534 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5e5c066f60 0x7f5e5c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:02.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.579+0000 7f5e7f400640 1 --2- 172.21.15.175:0/1483199534 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5e5c066f60 0x7f5e5c069420 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5e70000c10 tx=0x7f5e70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:02.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.583+0000 7f5e77e00640 1 -- 172.21.15.175:0/1483199534 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5e78058790 con 0x7f5e800aca80 2024-04-25T09:10:02.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:02.739+0000 7f5e86800640 1 -- 172.21.15.175:0/1483199534 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5e8013ecf0 con 0x7f5e800aca80 2024-04-25T09:10:03.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.399+0000 7f5e77e00640 1 -- 172.21.15.175:0/1483199534 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v82) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5e7805c830 con 0x7f5e800aca80 2024-04-25T09:10:03.388 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_data' created 2024-04-25T09:10:03.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.399+0000 7f5e86800640 1 -- 172.21.15.175:0/1483199534 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5e5c066f60 msgr2=0x7f5e5c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:03.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.399+0000 7f5e86800640 1 --2- 172.21.15.175:0/1483199534 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5e5c066f60 0x7f5e5c069420 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5e70000c10 tx=0x7f5e70009040 comp rx=0 tx=0).stop 2024-04-25T09:10:03.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.399+0000 7f5e86800640 1 -- 172.21.15.175:0/1483199534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e800aca80 msgr2=0x7f5e800acf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:03.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.399+0000 7f5e86800640 1 --2- 172.21.15.175:0/1483199534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e800aca80 0x7f5e800acf00 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f5e80072210 tx=0x7f5e78007a70 comp rx=0 tx=0).stop 2024-04-25T09:10:03.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.399+0000 7f5e86800640 1 -- 172.21.15.175:0/1483199534 shutdown_connections 2024-04-25T09:10:03.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.399+0000 7f5e86800640 1 --2- 172.21.15.175:0/1483199534 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5e5c066f60 0x7f5e5c069420 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.399+0000 7f5e86800640 1 --2- 172.21.15.175:0/1483199534 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e800aca80 0x7f5e800acf00 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.399+0000 7f5e86800640 1 --2- 172.21.15.175:0/1483199534 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e8015ab60 0x7f5e8015afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.399+0000 7f5e86800640 1 --2- 172.21.15.175:0/1483199534 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e64004810 0x7f5e80143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.399+0000 7f5e86800640 1 -- 172.21.15.175:0/1483199534 >> 172.21.15.175:0/1483199534 conn(0x7f5e8006ac50 msgr2=0x7f5e800cd550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:03.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.399+0000 7f5e86800640 1 -- 172.21.15.175:0/1483199534 shutdown_connections 2024-04-25T09:10:03.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.403+0000 7f5e86800640 1 -- 172.21.15.175:0/1483199534 wait complete. 2024-04-25T09:10:03.428 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:10:03.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.579+0000 7fd53a600640 1 Processor -- start 2024-04-25T09:10:03.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.579+0000 7fd53a600640 1 -- start start 2024-04-25T09:10:03.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.579+0000 7fd53a600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd5340cf6b0 0x7fd5341600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:03.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.579+0000 7fd53a600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd5340ce970 0x7fd5340cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:03.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.579+0000 7fd53a600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5340cfd10 con 0x7fd534145250 2024-04-25T09:10:03.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.579+0000 7fd53a600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5341605e0 con 0x7fd5340ce970 2024-04-25T09:10:03.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.579+0000 7fd53a600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53415f650 con 0x7fd5340cf6b0 2024-04-25T09:10:03.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.579+0000 7fd533e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd5340ce970 0x7fd5340cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:03.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.579+0000 7fd533e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd5340ce970 0x7fd5340cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54534/0 (socket says 172.21.15.175:54534) 2024-04-25T09:10:03.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.579+0000 7fd533e00640 1 -- 172.21.15.175:0/795340156 learned_addr learned my addr 172.21.15.175:0/795340156 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:03.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.579+0000 7fd52aa00640 1 --2- 172.21.15.175:0/795340156 >> v2:172.21.15.177:3300/0 conn(0x7fd5340cf6b0 0x7fd5341600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:03.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.579+0000 7fd533e00640 1 -- 172.21.15.175:0/795340156 >> v2:172.21.15.177:3300/0 conn(0x7fd5340cf6b0 msgr2=0x7fd5341600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:03.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.579+0000 7fd533e00640 1 --2- 172.21.15.175:0/795340156 >> v2:172.21.15.177:3300/0 conn(0x7fd5340cf6b0 0x7fd5341600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.579+0000 7fd533e00640 1 -- 172.21.15.175:0/795340156 >> v1:172.21.15.177:6789/0 conn(0x7fd534145250 legacy=0x7fd5340cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:03.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.579+0000 7fd533e00640 1 -- 172.21.15.175:0/795340156 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340cfff0 con 0x7fd5340ce970 2024-04-25T09:10:03.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.583+0000 7fd533e00640 1 --2- 172.21.15.175:0/795340156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5340ce970 0x7fd5340cedc0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009e50 tx=0x7fd52c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be654b28ded8a05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:03.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.583+0000 7fd532a00640 1 -- 172.21.15.175:0/795340156 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0a5710 con 0x7fd5340ce970 2024-04-25T09:10:03.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.583+0000 7fd532a00640 1 -- 172.21.15.175:0/795340156 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c0a58b0 con 0x7fd5340ce970 2024-04-25T09:10:03.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.583+0000 7fd532a00640 1 -- 172.21.15.175:0/795340156 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0a5c80 con 0x7fd5340ce970 2024-04-25T09:10:03.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.583+0000 7fd53a600640 1 -- 172.21.15.175:0/795340156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5340ce970 msgr2=0x7fd5340cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:03.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.583+0000 7fd53a600640 1 --2- 172.21.15.175:0/795340156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5340ce970 0x7fd5340cedc0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009e50 tx=0x7fd52c01c960 comp rx=0 tx=0).stop 2024-04-25T09:10:03.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.583+0000 7fd53a600640 1 -- 172.21.15.175:0/795340156 shutdown_connections 2024-04-25T09:10:03.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.583+0000 7fd53a600640 1 --2- 172.21.15.175:0/795340156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5340ce970 0x7fd5340cedc0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.583+0000 7fd53a600640 1 --2- 172.21.15.175:0/795340156 >> v2:172.21.15.177:3300/0 conn(0x7fd5340cf6b0 0x7fd5341600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.583+0000 7fd53a600640 1 -- 172.21.15.175:0/795340156 >> 172.21.15.175:0/795340156 conn(0x7fd53406ac50 msgr2=0x7fd53406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:03.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.583+0000 7fd53a600640 1 -- 172.21.15.175:0/795340156 shutdown_connections 2024-04-25T09:10:03.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.583+0000 7fd53a600640 1 -- 172.21.15.175:0/795340156 wait complete. 2024-04-25T09:10:03.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd53a600640 1 Processor -- start 2024-04-25T09:10:03.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd53a600640 1 -- start start 2024-04-25T09:10:03.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd53a600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5340ce970 0x7fd53413f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:03.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd53a600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5340cf6b0 0x7fd5340ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:03.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd53a600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd534145250 0x7fd5340ae590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:03.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd53a600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53415c870 con 0x7fd534145250 2024-04-25T09:10:03.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd53a600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd534145630 con 0x7fd5340cf6b0 2024-04-25T09:10:03.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd53a600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53415c9f0 con 0x7fd5340ce970 2024-04-25T09:10:03.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd533e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd534145250 0x7fd5340ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:03.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd52aa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5340cf6b0 0x7fd5340ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:03.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd52aa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5340cf6b0 0x7fd5340ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:41836/0 (socket says 172.21.15.175:41836) 2024-04-25T09:10:03.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd52aa00640 1 -- 172.21.15.175:0/2733692502 learned_addr learned my addr 172.21.15.175:0/2733692502 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:03.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd533400640 1 --2- 172.21.15.175:0/2733692502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5340ce970 0x7fd53413f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:03.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd52aa00640 1 -- 172.21.15.175:0/2733692502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5340ce970 msgr2=0x7fd53413f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:03.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd52aa00640 1 --2- 172.21.15.175:0/2733692502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5340ce970 0x7fd53413f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd52aa00640 1 -- 172.21.15.175:0/2733692502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd534145250 msgr2=0x7fd5340ae590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:03.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd52aa00640 1 --2- 172.21.15.175:0/2733692502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd534145250 0x7fd5340ae590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd52aa00640 1 -- 172.21.15.175:0/2733692502 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340b2c60 con 0x7fd5340cf6b0 2024-04-25T09:10:03.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd533e00640 1 --2- 172.21.15.175:0/2733692502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd534145250 0x7fd5340ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:03.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd52aa00640 1 --2- 172.21.15.175:0/2733692502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5340cf6b0 0x7fd5340ae050 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00d800 tx=0x7fd51c00dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:03.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd52be00640 1 -- 172.21.15.175:0/2733692502 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c00b6c0 con 0x7fd5340cf6b0 2024-04-25T09:10:03.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd52be00640 1 -- 172.21.15.175:0/2733692502 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c019070 con 0x7fd5340cf6b0 2024-04-25T09:10:03.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd52be00640 1 -- 172.21.15.175:0/2733692502 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c00bae0 con 0x7fd5340cf6b0 2024-04-25T09:10:03.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd53a600640 1 -- 172.21.15.175:0/2733692502 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5340b2f40 con 0x7fd5340cf6b0 2024-04-25T09:10:03.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd53a600640 1 -- 172.21.15.175:0/2733692502 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5340b3500 con 0x7fd5340cf6b0 2024-04-25T09:10:03.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.587+0000 7fd53a600640 1 -- 172.21.15.175:0/2733692502 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd534075160 con 0x7fd5340cf6b0 2024-04-25T09:10:03.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.591+0000 7fd52be00640 1 -- 172.21.15.175:0/2733692502 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd51c00bc80 con 0x7fd5340cf6b0 2024-04-25T09:10:03.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.591+0000 7fd52be00640 1 --2- 172.21.15.175:0/2733692502 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd510066f60 0x7fd510069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:03.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.591+0000 7fd52be00640 1 -- 172.21.15.175:0/2733692502 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fd51c085660 con 0x7fd5340cf6b0 2024-04-25T09:10:03.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.591+0000 7fd533400640 1 --2- 172.21.15.175:0/2733692502 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd510066f60 0x7fd510069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:03.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.591+0000 7fd533400640 1 --2- 172.21.15.175:0/2733692502 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd510066f60 0x7fd510069420 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd524001770 tx=0x7fd524009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:03.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.595+0000 7fd52be00640 1 -- 172.21.15.175:0/2733692502 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd51c056060 con 0x7fd5340cf6b0 2024-04-25T09:10:03.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:03.779+0000 7fd53a600640 1 -- 172.21.15.175:0/2733692502 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd5340d0680 con 0x7fd5340cf6b0 2024-04-25T09:10:04.441 INFO:teuthology.orchestra.run.smithi175.stderr:new fs with metadata pool 12 and data pool 13 2024-04-25T09:10:04.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.451+0000 7fd52be00640 1 -- 172.21.15.175:0/2733692502 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v55) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd51c05a100 con 0x7fd5340cf6b0 2024-04-25T09:10:04.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.459+0000 7fd53a600640 1 -- 172.21.15.175:0/2733692502 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd510066f60 msgr2=0x7fd510069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.459+0000 7fd53a600640 1 --2- 172.21.15.175:0/2733692502 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd510066f60 0x7fd510069420 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd524001770 tx=0x7fd524009040 comp rx=0 tx=0).stop 2024-04-25T09:10:04.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.459+0000 7fd53a600640 1 -- 172.21.15.175:0/2733692502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5340cf6b0 msgr2=0x7fd5340ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.459+0000 7fd53a600640 1 --2- 172.21.15.175:0/2733692502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5340cf6b0 0x7fd5340ae050 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00d800 tx=0x7fd51c00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.459+0000 7fd53a600640 1 -- 172.21.15.175:0/2733692502 shutdown_connections 2024-04-25T09:10:04.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.459+0000 7fd53a600640 1 --2- 172.21.15.175:0/2733692502 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd510066f60 0x7fd510069420 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.459+0000 7fd53a600640 1 --2- 172.21.15.175:0/2733692502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd534145250 0x7fd5340ae590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.459+0000 7fd53a600640 1 --2- 172.21.15.175:0/2733692502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5340cf6b0 0x7fd5340ae050 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.459+0000 7fd53a600640 1 --2- 172.21.15.175:0/2733692502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5340ce970 0x7fd53413f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.459+0000 7fd53a600640 1 -- 172.21.15.175:0/2733692502 >> 172.21.15.175:0/2733692502 conn(0x7fd53406ac50 msgr2=0x7fd534165fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:04.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.463+0000 7fd53a600640 1 -- 172.21.15.175:0/2733692502 shutdown_connections 2024-04-25T09:10:04.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.463+0000 7fd53a600640 1 -- 172.21.15.175:0/2733692502 wait complete. 2024-04-25T09:10:04.474 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:04.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.619+0000 7fa782400640 1 Processor -- start 2024-04-25T09:10:04.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.619+0000 7fa782400640 1 -- start start 2024-04-25T09:10:04.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.619+0000 7fa782400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa77c144fc0 0x7fa77c0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.619+0000 7fa782400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa77c15c5e0 0x7fa77c0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.619+0000 7fa782400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77c15cd00 con 0x7fa77c1453a0 2024-04-25T09:10:04.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.619+0000 7fa782400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77c0ce660 con 0x7fa77c15c5e0 2024-04-25T09:10:04.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.619+0000 7fa782400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c0cc930 con 0x7fa77c144fc0 2024-04-25T09:10:04.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.623+0000 7fa77be00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa77c15c5e0 0x7fa77c0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.623+0000 7fa77be00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa77c15c5e0 0x7fa77c0cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54556/0 (socket says 172.21.15.175:54556) 2024-04-25T09:10:04.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.623+0000 7fa77be00640 1 -- 172.21.15.175:0/1107312461 learned_addr learned my addr 172.21.15.175:0/1107312461 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:04.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.623+0000 7fa77b400640 1 --2- 172.21.15.175:0/1107312461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa77c144fc0 0x7fa77c0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.623+0000 7fa77be00640 1 -- 172.21.15.175:0/1107312461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa77c144fc0 msgr2=0x7fa77c0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:04.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.623+0000 7fa77be00640 1 --2- 172.21.15.175:0/1107312461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa77c144fc0 0x7fa77c0cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.623+0000 7fa77be00640 1 -- 172.21.15.175:0/1107312461 >> v1:172.21.15.177:6789/0 conn(0x7fa77c1453a0 legacy=0x7fa77c15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:04.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.623+0000 7fa77be00640 1 -- 172.21.15.175:0/1107312461 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c0ccc10 con 0x7fa77c15c5e0 2024-04-25T09:10:04.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.623+0000 7fa77b400640 1 --2- 172.21.15.175:0/1107312461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa77c144fc0 0x7fa77c0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:04.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.623+0000 7fa77be00640 1 --2- 172.21.15.175:0/1107312461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c15c5e0 0x7fa77c0cee20 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fa774009e50 tx=0x7fa77401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c344ff4ec166b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.623+0000 7fa77aa00640 1 -- 172.21.15.175:0/1107312461 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7740a5760 con 0x7fa77c15c5e0 2024-04-25T09:10:04.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.623+0000 7fa77aa00640 1 -- 172.21.15.175:0/1107312461 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7740a5900 con 0x7fa77c15c5e0 2024-04-25T09:10:04.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.623+0000 7fa77aa00640 1 -- 172.21.15.175:0/1107312461 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7740a5cd0 con 0x7fa77c15c5e0 2024-04-25T09:10:04.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa782400640 1 -- 172.21.15.175:0/1107312461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c15c5e0 msgr2=0x7fa77c0cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa782400640 1 --2- 172.21.15.175:0/1107312461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c15c5e0 0x7fa77c0cee20 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fa774009e50 tx=0x7fa77401c9f0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa782400640 1 -- 172.21.15.175:0/1107312461 shutdown_connections 2024-04-25T09:10:04.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa782400640 1 --2- 172.21.15.175:0/1107312461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c15c5e0 0x7fa77c0cee20 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa782400640 1 --2- 172.21.15.175:0/1107312461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa77c144fc0 0x7fa77c0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa782400640 1 -- 172.21.15.175:0/1107312461 >> 172.21.15.175:0/1107312461 conn(0x7fa77c067150 msgr2=0x7fa77c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:04.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa782400640 1 -- 172.21.15.175:0/1107312461 shutdown_connections 2024-04-25T09:10:04.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa782400640 1 -- 172.21.15.175:0/1107312461 wait complete. 2024-04-25T09:10:04.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa782400640 1 Processor -- start 2024-04-25T09:10:04.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa782400640 1 -- start start 2024-04-25T09:10:04.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa782400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa77c1453a0 0x7fa77c13bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa782400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c15c5e0 0x7fa77c0af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa782400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa77c13c270 0x7fa77c0af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa782400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c0cff80 con 0x7fa77c15c5e0 2024-04-25T09:10:04.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa782400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c0cfe00 con 0x7fa77c1453a0 2024-04-25T09:10:04.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa782400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c1685f0 con 0x7fa77c13c270 2024-04-25T09:10:04.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa772a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c15c5e0 0x7fa77c0af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa772a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c15c5e0 0x7fa77c0af1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54570/0 (socket says 172.21.15.175:54570) 2024-04-25T09:10:04.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa772a00640 1 -- 172.21.15.175:0/2857974816 learned_addr learned my addr 172.21.15.175:0/2857974816 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:04.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa77b400640 1 --2- 172.21.15.175:0/2857974816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa77c1453a0 0x7fa77c13bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa77be00640 1 --2- 172.21.15.175:0/2857974816 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa77c13c270 0x7fa77c0af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa772a00640 1 -- 172.21.15.175:0/2857974816 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa77c13c270 msgr2=0x7fa77c0af710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa772a00640 1 --2- 172.21.15.175:0/2857974816 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa77c13c270 0x7fa77c0af710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa772a00640 1 -- 172.21.15.175:0/2857974816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa77c1453a0 msgr2=0x7fa77c13bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa772a00640 1 --2- 172.21.15.175:0/2857974816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa77c1453a0 0x7fa77c13bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.627+0000 7fa772a00640 1 -- 172.21.15.175:0/2857974816 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c143a40 con 0x7fa77c15c5e0 2024-04-25T09:10:04.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.631+0000 7fa772a00640 1 --2- 172.21.15.175:0/2857974816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c15c5e0 0x7fa77c0af1d0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fa76400c450 tx=0x7fa76400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.631+0000 7fa773e00640 1 -- 172.21.15.175:0/2857974816 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764012830 con 0x7fa77c15c5e0 2024-04-25T09:10:04.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.631+0000 7fa773e00640 1 -- 172.21.15.175:0/2857974816 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa764017070 con 0x7fa77c15c5e0 2024-04-25T09:10:04.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.631+0000 7fa782400640 1 -- 172.21.15.175:0/2857974816 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77c143d20 con 0x7fa77c15c5e0 2024-04-25T09:10:04.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.631+0000 7fa773e00640 1 -- 172.21.15.175:0/2857974816 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764012c30 con 0x7fa77c15c5e0 2024-04-25T09:10:04.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.631+0000 7fa782400640 1 -- 172.21.15.175:0/2857974816 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77c0afc50 con 0x7fa77c15c5e0 2024-04-25T09:10:04.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.631+0000 7fa782400640 1 -- 172.21.15.175:0/2857974816 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77c0b2130 con 0x7fa77c15c5e0 2024-04-25T09:10:04.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.631+0000 7fa773e00640 1 -- 172.21.15.175:0/2857974816 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa76401c460 con 0x7fa77c15c5e0 2024-04-25T09:10:04.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.631+0000 7fa773e00640 1 --2- 172.21.15.175:0/2857974816 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa758066f90 0x7fa758069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.631+0000 7fa773e00640 1 -- 172.21.15.175:0/2857974816 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa764085800 con 0x7fa77c15c5e0 2024-04-25T09:10:04.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.631+0000 7fa77b400640 1 --2- 172.21.15.175:0/2857974816 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa758066f90 0x7fa758069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.635+0000 7fa77b400640 1 --2- 172.21.15.175:0/2857974816 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa758066f90 0x7fa758069450 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa76c006fd0 tx=0x7fa76c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.635+0000 7fa773e00640 1 -- 172.21.15.175:0/2857974816 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa7640561a0 con 0x7fa77c15c5e0 2024-04-25T09:10:04.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.795+0000 7fa782400640 1 -- 172.21.15.175:0/2857974816 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa77c074a60 con 0x7fa77c15c5e0 2024-04-25T09:10:04.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.795+0000 7fa773e00640 1 -- 172.21.15.175:0/2857974816 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16709 (secure 0 0 0) 0x7fa764083e20 con 0x7fa77c15c5e0 2024-04-25T09:10:04.785 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:10:04.785 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":83,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:10:03.786590+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:01.518283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:02.788015+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:04.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.795+0000 7fa782400640 1 -- 172.21.15.175:0/2857974816 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa758066f90 msgr2=0x7fa758069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.795+0000 7fa782400640 1 --2- 172.21.15.175:0/2857974816 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa758066f90 0x7fa758069450 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa76c006fd0 tx=0x7fa76c008040 comp rx=0 tx=0).stop 2024-04-25T09:10:04.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.795+0000 7fa782400640 1 -- 172.21.15.175:0/2857974816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c15c5e0 msgr2=0x7fa77c0af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.795+0000 7fa782400640 1 --2- 172.21.15.175:0/2857974816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c15c5e0 0x7fa77c0af1d0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fa76400c450 tx=0x7fa76400c910 comp rx=0 tx=0).stop 2024-04-25T09:10:04.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.795+0000 7fa782400640 1 -- 172.21.15.175:0/2857974816 shutdown_connections 2024-04-25T09:10:04.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.795+0000 7fa782400640 1 --2- 172.21.15.175:0/2857974816 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa758066f90 0x7fa758069450 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.795+0000 7fa782400640 1 --2- 172.21.15.175:0/2857974816 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa77c13c270 0x7fa77c0af710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.795+0000 7fa782400640 1 --2- 172.21.15.175:0/2857974816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa77c15c5e0 0x7fa77c0af1d0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.795+0000 7fa782400640 1 --2- 172.21.15.175:0/2857974816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa77c1453a0 0x7fa77c13bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.795+0000 7fa782400640 1 -- 172.21.15.175:0/2857974816 >> 172.21.15.175:0/2857974816 conn(0x7fa77c144fc0 msgr2=0x7fa77c13c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:04.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.795+0000 7fa782400640 1 -- 172.21.15.175:0/2857974816 shutdown_connections 2024-04-25T09:10:04.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.795+0000 7fa782400640 1 -- 172.21.15.175:0/2857974816 wait complete. 2024-04-25T09:10:04.806 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:04.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.951+0000 7fcd46000640 1 Processor -- start 2024-04-25T09:10:04.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.951+0000 7fcd46000640 1 -- start start 2024-04-25T09:10:04.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.955+0000 7fcd46000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd400cd520 0x7fcd4006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.955+0000 7fcd46000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcd400cf560 0x7fcd400cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.955+0000 7fcd46000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd400cda00 con 0x7fcd4015a900 2024-04-25T09:10:04.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.955+0000 7fcd46000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd4015bcf0 con 0x7fcd400cf560 2024-04-25T09:10:04.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.955+0000 7fcd46000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400cfef0 con 0x7fcd400cd520 2024-04-25T09:10:04.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.955+0000 7fcd3fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcd400cf560 0x7fcd400cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.955+0000 7fcd3fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcd400cf560 0x7fcd400cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54582/0 (socket says 172.21.15.175:54582) 2024-04-25T09:10:04.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.955+0000 7fcd3fe00640 1 -- 172.21.15.175:0/3526905566 learned_addr learned my addr 172.21.15.175:0/3526905566 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:04.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.955+0000 7fcd36a00640 1 --2- 172.21.15.175:0/3526905566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd400cd520 0x7fcd4006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.955+0000 7fcd3fe00640 1 -- 172.21.15.175:0/3526905566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd400cd520 msgr2=0x7fcd4006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:04.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.955+0000 7fcd3fe00640 1 --2- 172.21.15.175:0/3526905566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd400cd520 0x7fcd4006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.955+0000 7fcd3fe00640 1 -- 172.21.15.175:0/3526905566 >> v1:172.21.15.177:6789/0 conn(0x7fcd4015a900 legacy=0x7fcd400ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.955+0000 7fcd3fe00640 1 -- 172.21.15.175:0/3526905566 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd400cdce0 con 0x7fcd400cf560 2024-04-25T09:10:04.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.955+0000 7fcd36a00640 1 --2- 172.21.15.175:0/3526905566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd400cd520 0x7fcd4006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:04.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.959+0000 7fcd3fe00640 1 --2- 172.21.15.175:0/3526905566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd400cf560 0x7fcd400cf9b0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009870 tx=0x7fcd3801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3c7fdef4efd6e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.959+0000 7fcd3ea00640 1 -- 172.21.15.175:0/3526905566 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd380ab650 con 0x7fcd400cf560 2024-04-25T09:10:04.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.959+0000 7fcd3ea00640 1 -- 172.21.15.175:0/3526905566 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd380b0070 con 0x7fcd400cf560 2024-04-25T09:10:04.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.959+0000 7fcd3ea00640 1 -- 172.21.15.175:0/3526905566 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd380aba10 con 0x7fcd400cf560 2024-04-25T09:10:04.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.959+0000 7fcd46000640 1 -- 172.21.15.175:0/3526905566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd400cf560 msgr2=0x7fcd400cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.959+0000 7fcd46000640 1 --2- 172.21.15.175:0/3526905566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd400cf560 0x7fcd400cf9b0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009870 tx=0x7fcd3801c560 comp rx=0 tx=0).stop 2024-04-25T09:10:04.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.959+0000 7fcd46000640 1 -- 172.21.15.175:0/3526905566 shutdown_connections 2024-04-25T09:10:04.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.959+0000 7fcd46000640 1 --2- 172.21.15.175:0/3526905566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd400cf560 0x7fcd400cf9b0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.959+0000 7fcd46000640 1 --2- 172.21.15.175:0/3526905566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd400cd520 0x7fcd4006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.959+0000 7fcd46000640 1 -- 172.21.15.175:0/3526905566 >> 172.21.15.175:0/3526905566 conn(0x7fcd40067150 msgr2=0x7fcd4006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:04.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.959+0000 7fcd46000640 1 -- 172.21.15.175:0/3526905566 shutdown_connections 2024-04-25T09:10:04.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.959+0000 7fcd46000640 1 -- 172.21.15.175:0/3526905566 wait complete. 2024-04-25T09:10:04.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.959+0000 7fcd46000640 1 Processor -- start 2024-04-25T09:10:04.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.959+0000 7fcd46000640 1 -- start start 2024-04-25T09:10:04.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd46000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd400cf560 0x7fcd4014bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd46000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd4015a900 0x7fcd40151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd46000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd40152d80 0x7fcd40136cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd46000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4006d530 con 0x7fcd4015a900 2024-04-25T09:10:04.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd46000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4006d3b0 con 0x7fcd40152d80 2024-04-25T09:10:04.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd46000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4015c790 con 0x7fcd400cf560 2024-04-25T09:10:04.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd36a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd4015a900 0x7fcd40151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd36a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd4015a900 0x7fcd40151130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54592/0 (socket says 172.21.15.175:54592) 2024-04-25T09:10:04.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd36a00640 1 -- 172.21.15.175:0/1034275716 learned_addr learned my addr 172.21.15.175:0/1034275716 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:04.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd3f400640 1 --2- 172.21.15.175:0/1034275716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd400cf560 0x7fcd4014bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd3fe00640 1 --2- 172.21.15.175:0/1034275716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd40152d80 0x7fcd40136cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd36a00640 1 -- 172.21.15.175:0/1034275716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd400cf560 msgr2=0x7fcd4014bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd36a00640 1 --2- 172.21.15.175:0/1034275716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd400cf560 0x7fcd4014bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd36a00640 1 -- 172.21.15.175:0/1034275716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd40152d80 msgr2=0x7fcd40136cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd36a00640 1 --2- 172.21.15.175:0/1034275716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd40152d80 0x7fcd40136cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd36a00640 1 -- 172.21.15.175:0/1034275716 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd40134fb0 con 0x7fcd4015a900 2024-04-25T09:10:04.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd36a00640 1 --2- 172.21.15.175:0/1034275716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd4015a900 0x7fcd40151130 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800e810 tx=0x7fcd2800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd37e00640 1 -- 172.21.15.175:0/1034275716 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28017070 con 0x7fcd4015a900 2024-04-25T09:10:04.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd37e00640 1 -- 172.21.15.175:0/1034275716 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2800c670 con 0x7fcd4015a900 2024-04-25T09:10:04.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd46000640 1 -- 172.21.15.175:0/1034275716 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd40135290 con 0x7fcd4015a900 2024-04-25T09:10:04.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd37e00640 1 -- 172.21.15.175:0/1034275716 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2800f040 con 0x7fcd4015a900 2024-04-25T09:10:04.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd46000640 1 -- 172.21.15.175:0/1034275716 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd40135850 con 0x7fcd4015a900 2024-04-25T09:10:04.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd46000640 1 -- 172.21.15.175:0/1034275716 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd40074a60 con 0x7fcd4015a900 2024-04-25T09:10:04.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.963+0000 7fcd37e00640 1 -- 172.21.15.175:0/1034275716 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcd2801a070 con 0x7fcd4015a900 2024-04-25T09:10:04.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.967+0000 7fcd37e00640 1 --2- 172.21.15.175:0/1034275716 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd1c066f90 0x7fcd1c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.967+0000 7fcd37e00640 1 -- 172.21.15.175:0/1034275716 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd28084b70 con 0x7fcd4015a900 2024-04-25T09:10:04.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.967+0000 7fcd3f400640 1 --2- 172.21.15.175:0/1034275716 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd1c066f90 0x7fcd1c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.967+0000 7fcd3f400640 1 --2- 172.21.15.175:0/1034275716 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd1c066f90 0x7fcd1c069450 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcd4014cc30 tx=0x7fcd30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:04.971+0000 7fcd37e00640 1 -- 172.21.15.175:0/1034275716 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcd28055b70 con 0x7fcd4015a900 2024-04-25T09:10:05.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.127+0000 7fcd46000640 1 -- 172.21.15.175:0/1034275716 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd401579b0 con 0x7fcd4015a900 2024-04-25T09:10:05.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.127+0000 7fcd37e00640 1 -- 172.21.15.175:0/1034275716 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+16709 (secure 0 0 0) 0x7fcd28055470 con 0x7fcd4015a900 2024-04-25T09:10:05.116 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:10:05.116 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":83,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:10:03.786590+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:01.518283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:02.788015+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:05.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.127+0000 7fcd46000640 1 -- 172.21.15.175:0/1034275716 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd1c066f90 msgr2=0x7fcd1c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.127+0000 7fcd46000640 1 --2- 172.21.15.175:0/1034275716 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd1c066f90 0x7fcd1c069450 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fcd4014cc30 tx=0x7fcd30009040 comp rx=0 tx=0).stop 2024-04-25T09:10:05.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.127+0000 7fcd46000640 1 -- 172.21.15.175:0/1034275716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd4015a900 msgr2=0x7fcd40151130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.127+0000 7fcd46000640 1 --2- 172.21.15.175:0/1034275716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd4015a900 0x7fcd40151130 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800e810 tx=0x7fcd2800ecd0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.127+0000 7fcd46000640 1 -- 172.21.15.175:0/1034275716 shutdown_connections 2024-04-25T09:10:05.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.127+0000 7fcd46000640 1 --2- 172.21.15.175:0/1034275716 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd1c066f90 0x7fcd1c069450 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.127+0000 7fcd46000640 1 --2- 172.21.15.175:0/1034275716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd40152d80 0x7fcd40136cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.127+0000 7fcd46000640 1 --2- 172.21.15.175:0/1034275716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd4015a900 0x7fcd40151130 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.127+0000 7fcd46000640 1 --2- 172.21.15.175:0/1034275716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd400cf560 0x7fcd4014bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.127+0000 7fcd46000640 1 -- 172.21.15.175:0/1034275716 >> 172.21.15.175:0/1034275716 conn(0x7fcd400cd520 msgr2=0x7fcd401504e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:05.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.127+0000 7fcd46000640 1 -- 172.21.15.175:0/1034275716 shutdown_connections 2024-04-25T09:10:05.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.127+0000 7fcd46000640 1 -- 172.21.15.175:0/1034275716 wait complete. 2024-04-25T09:10:05.137 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:10:05.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.283+0000 7ff16f600640 1 Processor -- start 2024-04-25T09:10:05.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff16f600640 1 -- start start 2024-04-25T09:10:05.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff16f600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff16815af20 0x7ff1680b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff16f600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16806db60 con 0x7ff1680cbe60 2024-04-25T09:10:05.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff16f600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16806de40 con 0x7ff1680b4630 2024-04-25T09:10:05.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff16f600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16806e120 con 0x7ff16815af20 2024-04-25T09:10:05.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff16cc00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff1680cbe60 0x7ff16806d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45472/0 (socket says 172.21.15.175:45472) 2024-04-25T09:10:05.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff16cc00640 1 -- 172.21.15.175:0/2627947502 learned_addr learned my addr 172.21.15.175:0/2627947502 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:10:05.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff15fe00640 1 --2- 172.21.15.175:0/2627947502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff16815af20 0x7ff1680b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff167e00640 1 -- 172.21.15.175:0/2627947502 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679493594 0 0) 0x7ff16806db60 con 0x7ff1680cbe60 2024-04-25T09:10:05.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff167e00640 1 -- 172.21.15.175:0/2627947502 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff14c003530 con 0x7ff1680cbe60 2024-04-25T09:10:05.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff167e00640 1 -- 172.21.15.175:0/2627947502 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1956252621 0 0) 0x7ff16806de40 con 0x7ff1680b4630 2024-04-25T09:10:05.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff167e00640 1 -- 172.21.15.175:0/2627947502 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff16806db60 con 0x7ff1680b4630 2024-04-25T09:10:05.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff167e00640 1 -- 172.21.15.175:0/2627947502 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 370712465 0 0) 0x7ff14c003530 con 0x7ff1680cbe60 2024-04-25T09:10:05.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff167e00640 1 -- 172.21.15.175:0/2627947502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff16815af20 msgr2=0x7ff1680b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:05.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff167e00640 1 --2- 172.21.15.175:0/2627947502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff16815af20 0x7ff1680b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff167e00640 1 -- 172.21.15.175:0/2627947502 >> v1:172.21.15.177:6789/0 conn(0x7ff1680b4630 legacy=0x7ff16815c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff167e00640 1 -- 172.21.15.175:0/2627947502 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16815c2f0 con 0x7ff1680cbe60 2024-04-25T09:10:05.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff167e00640 1 -- 172.21.15.175:0/2627947502 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7ff158001680 con 0x7ff1680cbe60 2024-04-25T09:10:05.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff167e00640 1 -- 172.21.15.175:0/2627947502 >> v1:172.21.15.175:6789/0 conn(0x7ff1680cbe60 legacy=0x7ff16806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff167e00640 1 --2- 172.21.15.175:0/2627947502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff14c003b80 0x7ff14c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff167e00640 1 --2- 172.21.15.175:0/2627947502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff14c004810 0x7ff14c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff167e00640 1 --2- 172.21.15.175:0/2627947502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff16815af20 0x7ff14c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff167e00640 1 -- 172.21.15.175:0/2627947502 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16806e120 con 0x7ff14c004810 2024-04-25T09:10:05.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff167e00640 1 -- 172.21.15.175:0/2627947502 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c00ba80 con 0x7ff14c003b80 2024-04-25T09:10:05.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff167e00640 1 -- 172.21.15.175:0/2627947502 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c00bc50 con 0x7ff16815af20 2024-04-25T09:10:05.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff15fe00640 1 --2- 172.21.15.175:0/2627947502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff14c004810 0x7ff14c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff16cc00640 1 --2- 172.21.15.175:0/2627947502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff14c003b80 0x7ff14c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff16d600640 1 --2- 172.21.15.175:0/2627947502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff16815af20 0x7ff14c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff15fe00640 1 -- 172.21.15.175:0/2627947502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff16815af20 msgr2=0x7ff14c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:05.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff15fe00640 1 --2- 172.21.15.175:0/2627947502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff16815af20 0x7ff14c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff15fe00640 1 -- 172.21.15.175:0/2627947502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff14c003b80 msgr2=0x7ff14c003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:05.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff15fe00640 1 --2- 172.21.15.175:0/2627947502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff14c003b80 0x7ff14c003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff15fe00640 1 -- 172.21.15.175:0/2627947502 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c003530 con 0x7ff14c004810 2024-04-25T09:10:05.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.287+0000 7ff16d600640 1 --2- 172.21.15.175:0/2627947502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff16815af20 0x7ff14c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:05.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.291+0000 7ff15fe00640 1 --2- 172.21.15.175:0/2627947502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff14c004810 0x7ff14c004c90 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7ff150009ae0 tx=0x7ff15001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7c68cac3b1ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:05.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.291+0000 7ff167e00640 1 -- 172.21.15.175:0/2627947502 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1500b2070 con 0x7ff14c004810 2024-04-25T09:10:05.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.291+0000 7ff167e00640 1 -- 172.21.15.175:0/2627947502 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1500a5600 con 0x7ff14c004810 2024-04-25T09:10:05.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.291+0000 7ff167e00640 1 -- 172.21.15.175:0/2627947502 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1500096b0 con 0x7ff14c004810 2024-04-25T09:10:05.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.291+0000 7ff16f600640 1 -- 172.21.15.175:0/2627947502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff14c004810 msgr2=0x7ff14c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.291+0000 7ff16f600640 1 --2- 172.21.15.175:0/2627947502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff14c004810 0x7ff14c004c90 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7ff150009ae0 tx=0x7ff15001ca10 comp rx=0 tx=0).stop 2024-04-25T09:10:05.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.291+0000 7ff16d600640 1 -- 172.21.15.175:0/2627947502 reap_dead start 2024-04-25T09:10:05.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.291+0000 7ff16f600640 1 -- 172.21.15.175:0/2627947502 shutdown_connections 2024-04-25T09:10:05.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.291+0000 7ff16f600640 1 -- 172.21.15.175:0/2627947502 >> 172.21.15.175:0/2627947502 conn(0x7ff16806ac50 msgr2=0x7ff16806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:05.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.291+0000 7ff16f600640 1 -- 172.21.15.175:0/2627947502 shutdown_connections 2024-04-25T09:10:05.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.291+0000 7ff16f600640 1 -- 172.21.15.175:0/2627947502 wait complete. 2024-04-25T09:10:05.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff16f600640 1 Processor -- start 2024-04-25T09:10:05.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff16f600640 1 -- start start 2024-04-25T09:10:05.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff16f600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff14c004810 0x7ff1680b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff16f600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff16814ce70 0x7ff1681f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff16f600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1681f7a60 0x7ff1681f7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff16f600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680b4270 con 0x7ff16814ce70 2024-04-25T09:10:05.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff16f600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680b40f0 con 0x7ff14c004810 2024-04-25T09:10:05.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff16f600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680b43f0 con 0x7ff1681f7a60 2024-04-25T09:10:05.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff15fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff16814ce70 0x7ff1681f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff15fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff16814ce70 0x7ff1681f7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54610/0 (socket says 172.21.15.175:54610) 2024-04-25T09:10:05.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff15fe00640 1 -- 172.21.15.175:0/4113505252 learned_addr learned my addr 172.21.15.175:0/4113505252 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:05.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff16cc00640 1 --2- 172.21.15.175:0/4113505252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff14c004810 0x7ff1680b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff16d600640 1 --2- 172.21.15.175:0/4113505252 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1681f7a60 0x7ff1681f7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff15fe00640 1 -- 172.21.15.175:0/4113505252 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1681f7a60 msgr2=0x7ff1681f7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff15fe00640 1 --2- 172.21.15.175:0/4113505252 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1681f7a60 0x7ff1681f7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff15fe00640 1 -- 172.21.15.175:0/4113505252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff14c004810 msgr2=0x7ff1680b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff15fe00640 1 --2- 172.21.15.175:0/4113505252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff14c004810 0x7ff1680b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff15fe00640 1 -- 172.21.15.175:0/4113505252 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16814d350 con 0x7ff16814ce70 2024-04-25T09:10:05.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff15fe00640 1 --2- 172.21.15.175:0/4113505252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff16814ce70 0x7ff1681f7520 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7ff15001c840 tx=0x7ff14c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:05.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff165600640 1 -- 172.21.15.175:0/4113505252 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1500bc020 con 0x7ff16814ce70 2024-04-25T09:10:05.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff165600640 1 -- 172.21.15.175:0/4113505252 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff150004020 con 0x7ff16814ce70 2024-04-25T09:10:05.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff16f600640 1 -- 172.21.15.175:0/4113505252 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16814d630 con 0x7ff16814ce70 2024-04-25T09:10:05.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff165600640 1 -- 172.21.15.175:0/4113505252 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1500b2040 con 0x7ff16814ce70 2024-04-25T09:10:05.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.295+0000 7ff16f600640 1 -- 172.21.15.175:0/4113505252 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16814dbf0 con 0x7ff16814ce70 2024-04-25T09:10:05.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.299+0000 7ff16f600640 1 -- 172.21.15.175:0/4113505252 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff168075160 con 0x7ff16814ce70 2024-04-25T09:10:05.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.299+0000 7ff165600640 1 -- 172.21.15.175:0/4113505252 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff150003620 con 0x7ff16814ce70 2024-04-25T09:10:05.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.299+0000 7ff165600640 1 --2- 172.21.15.175:0/4113505252 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff144066f90 0x7ff144069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.299+0000 7ff165600640 1 -- 172.21.15.175:0/4113505252 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff15011f3c0 con 0x7ff16814ce70 2024-04-25T09:10:05.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.299+0000 7ff16cc00640 1 --2- 172.21.15.175:0/4113505252 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff144066f90 0x7ff144069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.299+0000 7ff16cc00640 1 --2- 172.21.15.175:0/4113505252 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff144066f90 0x7ff144069450 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff158001210 tx=0x7ff158001e60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:05.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.303+0000 7ff165600640 1 -- 172.21.15.175:0/4113505252 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff1500c6020 con 0x7ff16814ce70 2024-04-25T09:10:05.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:05.495+0000 7ff16f600640 1 -- 172.21.15.175:0/4113505252 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff168151540 con 0x7ff16814ce70 2024-04-25T09:10:06.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.439+0000 7ff165600640 1 -- 172.21.15.175:0/4113505252 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v57) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff150016760 con 0x7ff16814ce70 2024-04-25T09:10:06.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.443+0000 7ff16f600640 1 -- 172.21.15.175:0/4113505252 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff144066f90 msgr2=0x7ff144069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.443+0000 7ff16f600640 1 --2- 172.21.15.175:0/4113505252 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff144066f90 0x7ff144069450 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7ff158001210 tx=0x7ff158001e60 comp rx=0 tx=0).stop 2024-04-25T09:10:06.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.443+0000 7ff16f600640 1 -- 172.21.15.175:0/4113505252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff16814ce70 msgr2=0x7ff1681f7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.443+0000 7ff16f600640 1 --2- 172.21.15.175:0/4113505252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff16814ce70 0x7ff1681f7520 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7ff15001c840 tx=0x7ff14c005840 comp rx=0 tx=0).stop 2024-04-25T09:10:06.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.443+0000 7ff16f600640 1 -- 172.21.15.175:0/4113505252 shutdown_connections 2024-04-25T09:10:06.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.443+0000 7ff16f600640 1 --2- 172.21.15.175:0/4113505252 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff144066f90 0x7ff144069450 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.443+0000 7ff16f600640 1 --2- 172.21.15.175:0/4113505252 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff1681f7a60 0x7ff1681f7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.443+0000 7ff16f600640 1 --2- 172.21.15.175:0/4113505252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff16814ce70 0x7ff1681f7520 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.443+0000 7ff16f600640 1 --2- 172.21.15.175:0/4113505252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff14c004810 0x7ff1680b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.443+0000 7ff16f600640 1 -- 172.21.15.175:0/4113505252 >> 172.21.15.175:0/4113505252 conn(0x7ff16806ac50 msgr2=0x7ff1680b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:06.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.443+0000 7ff16f600640 1 -- 172.21.15.175:0/4113505252 shutdown_connections 2024-04-25T09:10:06.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.443+0000 7ff16f600640 1 -- 172.21.15.175:0/4113505252 wait complete. 2024-04-25T09:10:06.455 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:10:06.455 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:10:06.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.607+0000 7f773e000640 1 Processor -- start 2024-04-25T09:10:06.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.607+0000 7f773e000640 1 -- start start 2024-04-25T09:10:06.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.607+0000 7f773e000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77380cf6b0 0x7f77381600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.607+0000 7f773e000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f77380ce970 0x7f77380cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.607+0000 7f773e000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77380cfd10 con 0x7f7738145250 2024-04-25T09:10:06.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.607+0000 7f773e000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77381605e0 con 0x7f77380ce970 2024-04-25T09:10:06.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.607+0000 7f773e000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773815f650 con 0x7f77380cf6b0 2024-04-25T09:10:06.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.607+0000 7f7737e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f77380ce970 0x7f77380cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.607+0000 7f7737e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f77380ce970 0x7f77380cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54626/0 (socket says 172.21.15.175:54626) 2024-04-25T09:10:06.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.607+0000 7f7737e00640 1 -- 172.21.15.175:0/2396131563 learned_addr learned my addr 172.21.15.175:0/2396131563 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:06.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.607+0000 7f7736a00640 1 --2- 172.21.15.175:0/2396131563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77380cf6b0 0x7f77381600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.607+0000 7f7737e00640 1 -- 172.21.15.175:0/2396131563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77380cf6b0 msgr2=0x7f77381600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:06.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.607+0000 7f7737e00640 1 --2- 172.21.15.175:0/2396131563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77380cf6b0 0x7f77381600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.611+0000 7f7737e00640 1 -- 172.21.15.175:0/2396131563 >> v1:172.21.15.177:6789/0 conn(0x7f7738145250 legacy=0x7f77380cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.611+0000 7f7737e00640 1 -- 172.21.15.175:0/2396131563 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77380cfff0 con 0x7f77380ce970 2024-04-25T09:10:06.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.611+0000 7f7736a00640 1 --2- 172.21.15.175:0/2396131563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77380cf6b0 0x7f77381600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:06.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.611+0000 7f7737e00640 1 --2- 172.21.15.175:0/2396131563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77380ce970 0x7f77380cee00 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f7730009870 tx=0x7f773001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d020e1287cbc352f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:06.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.611+0000 7f7736000640 1 -- 172.21.15.175:0/2396131563 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77300b1070 con 0x7f77380ce970 2024-04-25T09:10:06.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.611+0000 7f7736000640 1 -- 172.21.15.175:0/2396131563 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77300ac620 con 0x7f77380ce970 2024-04-25T09:10:06.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.611+0000 7f7736000640 1 -- 172.21.15.175:0/2396131563 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77300ac9f0 con 0x7f77380ce970 2024-04-25T09:10:06.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.611+0000 7f773e000640 1 -- 172.21.15.175:0/2396131563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77380ce970 msgr2=0x7f77380cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.611+0000 7f773e000640 1 --2- 172.21.15.175:0/2396131563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77380ce970 0x7f77380cee00 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f7730009870 tx=0x7f773001c4d0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.611+0000 7f773e000640 1 -- 172.21.15.175:0/2396131563 shutdown_connections 2024-04-25T09:10:06.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.611+0000 7f773e000640 1 --2- 172.21.15.175:0/2396131563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77380ce970 0x7f77380cee00 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.611+0000 7f773e000640 1 --2- 172.21.15.175:0/2396131563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77380cf6b0 0x7f77381600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.611+0000 7f773e000640 1 -- 172.21.15.175:0/2396131563 >> 172.21.15.175:0/2396131563 conn(0x7f773806ac50 msgr2=0x7f773806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:06.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.611+0000 7f773e000640 1 -- 172.21.15.175:0/2396131563 shutdown_connections 2024-04-25T09:10:06.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.611+0000 7f773e000640 1 -- 172.21.15.175:0/2396131563 wait complete. 2024-04-25T09:10:06.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f773e000640 1 Processor -- start 2024-04-25T09:10:06.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f773e000640 1 -- start start 2024-04-25T09:10:06.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f773e000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77380ce970 0x7f773813f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f773e000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77380cf6b0 0x7f773815e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f773e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7738145250 0x7f7738161cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f773e000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773815c870 con 0x7f7738145250 2024-04-25T09:10:06.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f773e000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7738145630 con 0x7f77380cf6b0 2024-04-25T09:10:06.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f773e000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773815c9f0 con 0x7f77380ce970 2024-04-25T09:10:06.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f7737e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7738145250 0x7f7738161cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f7737400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77380ce970 0x7f773813f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f7737e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7738145250 0x7f7738161cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54642/0 (socket says 172.21.15.175:54642) 2024-04-25T09:10:06.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f7737e00640 1 -- 172.21.15.175:0/2514902894 learned_addr learned my addr 172.21.15.175:0/2514902894 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:06.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f7736a00640 1 --2- 172.21.15.175:0/2514902894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77380cf6b0 0x7f773815e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f7737e00640 1 -- 172.21.15.175:0/2514902894 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77380ce970 msgr2=0x7f773813f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f7737e00640 1 --2- 172.21.15.175:0/2514902894 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77380ce970 0x7f773813f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f7737e00640 1 -- 172.21.15.175:0/2514902894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77380cf6b0 msgr2=0x7f773815e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f7737e00640 1 --2- 172.21.15.175:0/2514902894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77380cf6b0 0x7f773815e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f7737e00640 1 -- 172.21.15.175:0/2514902894 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77381628a0 con 0x7f7738145250 2024-04-25T09:10:06.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f7737e00640 1 --2- 172.21.15.175:0/2514902894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7738145250 0x7f7738161cc0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f773001a100 tx=0x7f773001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:06.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f772f400640 1 -- 172.21.15.175:0/2514902894 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77300bb020 con 0x7f7738145250 2024-04-25T09:10:06.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f772f400640 1 -- 172.21.15.175:0/2514902894 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77300b7420 con 0x7f7738145250 2024-04-25T09:10:06.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f773e000640 1 -- 172.21.15.175:0/2514902894 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773813eb40 con 0x7f7738145250 2024-04-25T09:10:06.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f772f400640 1 -- 172.21.15.175:0/2514902894 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77300b1040 con 0x7f7738145250 2024-04-25T09:10:06.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.615+0000 7f773e000640 1 -- 172.21.15.175:0/2514902894 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773813f100 con 0x7f7738145250 2024-04-25T09:10:06.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.619+0000 7f773e000640 1 -- 172.21.15.175:0/2514902894 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7738075160 con 0x7f7738145250 2024-04-25T09:10:06.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.619+0000 7f772f400640 1 -- 172.21.15.175:0/2514902894 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f77300be020 con 0x7f7738145250 2024-04-25T09:10:06.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.619+0000 7f772f400640 1 --2- 172.21.15.175:0/2514902894 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7718066f60 0x7f7718069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.619+0000 7f772f400640 1 -- 172.21.15.175:0/2514902894 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f773011f380 con 0x7f7738145250 2024-04-25T09:10:06.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.619+0000 7f7737400640 1 --2- 172.21.15.175:0/2514902894 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7718066f60 0x7f7718069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.619+0000 7f7737400640 1 --2- 172.21.15.175:0/2514902894 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7718066f60 0x7f7718069420 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7728001e00 tx=0x7f7728009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:06.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.623+0000 7f772f400640 1 -- 172.21.15.175:0/2514902894 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f77300c5030 con 0x7f7738145250 2024-04-25T09:10:06.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:06.811+0000 7f773e000640 1 -- 172.21.15.175:0/2514902894 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f773815be40 con 0x7f7738145250 2024-04-25T09:10:07.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.443+0000 7f772f400640 1 -- 172.21.15.175:0/2514902894 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7730016150 con 0x7f7738145250 2024-04-25T09:10:07.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.443+0000 7f773e000640 1 -- 172.21.15.175:0/2514902894 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7718066f60 msgr2=0x7f7718069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.443+0000 7f773e000640 1 --2- 172.21.15.175:0/2514902894 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7718066f60 0x7f7718069420 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7728001e00 tx=0x7f7728009040 comp rx=0 tx=0).stop 2024-04-25T09:10:07.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.443+0000 7f773e000640 1 -- 172.21.15.175:0/2514902894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7738145250 msgr2=0x7f7738161cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.443+0000 7f773e000640 1 --2- 172.21.15.175:0/2514902894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7738145250 0x7f7738161cc0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f773001a100 tx=0x7f773001ad10 comp rx=0 tx=0).stop 2024-04-25T09:10:07.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.443+0000 7f773e000640 1 -- 172.21.15.175:0/2514902894 shutdown_connections 2024-04-25T09:10:07.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.443+0000 7f773e000640 1 --2- 172.21.15.175:0/2514902894 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7718066f60 0x7f7718069420 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.443+0000 7f773e000640 1 --2- 172.21.15.175:0/2514902894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7738145250 0x7f7738161cc0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.443+0000 7f773e000640 1 --2- 172.21.15.175:0/2514902894 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77380cf6b0 0x7f773815e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.443+0000 7f773e000640 1 --2- 172.21.15.175:0/2514902894 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77380ce970 0x7f773813f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.443+0000 7f773e000640 1 -- 172.21.15.175:0/2514902894 >> 172.21.15.175:0/2514902894 conn(0x7f773806ac50 msgr2=0x7f773813e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:07.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.443+0000 7f773e000640 1 -- 172.21.15.175:0/2514902894 shutdown_connections 2024-04-25T09:10:07.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.443+0000 7f773e000640 1 -- 172.21.15.175:0/2514902894 wait complete. 2024-04-25T09:10:07.455 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:10:07.456 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:07.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.603+0000 7fbf98400640 1 Processor -- start 2024-04-25T09:10:07.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.603+0000 7fbf98400640 1 -- start start 2024-04-25T09:10:07.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.603+0000 7fbf98400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf900b5b70 0x7fbf900d3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.603+0000 7fbf98400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbf900b9570 0x7fbf900d1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.603+0000 7fbf98400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf900d23f0 con 0x7fbf9015dac0 2024-04-25T09:10:07.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.603+0000 7fbf98400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf900b99e0 con 0x7fbf900b9570 2024-04-25T09:10:07.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.603+0000 7fbf98400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf900d3000 con 0x7fbf900b5b70 2024-04-25T09:10:07.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.603+0000 7fbf96400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbf900b9570 0x7fbf900d1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.603+0000 7fbf95a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fbf9015dac0 0x7fbf900b5460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45478/0 (socket says 172.21.15.175:45478) 2024-04-25T09:10:07.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.603+0000 7fbf95a00640 1 -- 172.21.15.175:0/3835773619 learned_addr learned my addr 172.21.15.175:0/3835773619 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:10:07.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.603+0000 7fbf95000640 1 --2- 172.21.15.175:0/3835773619 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf900b5b70 0x7fbf900d3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.603+0000 7fbf96400640 1 -- 172.21.15.175:0/3835773619 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf900b5b70 msgr2=0x7fbf900d3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:07.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.603+0000 7fbf96400640 1 --2- 172.21.15.175:0/3835773619 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf900b5b70 0x7fbf900d3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.603+0000 7fbf96400640 1 -- 172.21.15.175:0/3835773619 >> v1:172.21.15.175:6789/0 conn(0x7fbf9015dac0 legacy=0x7fbf900b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.603+0000 7fbf96400640 1 -- 172.21.15.175:0/3835773619 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf900d26d0 con 0x7fbf900b9570 2024-04-25T09:10:07.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.603+0000 7fbf95000640 1 --2- 172.21.15.175:0/3835773619 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf900b5b70 0x7fbf900d3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:07.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.607+0000 7fbf96400640 1 --2- 172.21.15.175:0/3835773619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf900b9570 0x7fbf900d1ce0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009dc0 tx=0x7fbf8801f140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36cb85e0fc57918b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:07.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.607+0000 7fbf8fe00640 1 -- 172.21.15.175:0/3835773619 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf880b4070 con 0x7fbf900b9570 2024-04-25T09:10:07.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.607+0000 7fbf8fe00640 1 -- 172.21.15.175:0/3835773619 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf880af600 con 0x7fbf900b9570 2024-04-25T09:10:07.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.607+0000 7fbf8fe00640 1 -- 172.21.15.175:0/3835773619 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf880af9d0 con 0x7fbf900b9570 2024-04-25T09:10:07.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.607+0000 7fbf98400640 1 -- 172.21.15.175:0/3835773619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf900b9570 msgr2=0x7fbf900d1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.607+0000 7fbf98400640 1 --2- 172.21.15.175:0/3835773619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf900b9570 0x7fbf900d1ce0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009dc0 tx=0x7fbf8801f140 comp rx=0 tx=0).stop 2024-04-25T09:10:07.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.607+0000 7fbf98400640 1 -- 172.21.15.175:0/3835773619 shutdown_connections 2024-04-25T09:10:07.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.607+0000 7fbf98400640 1 --2- 172.21.15.175:0/3835773619 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf900b9570 0x7fbf900d1ce0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.607+0000 7fbf98400640 1 --2- 172.21.15.175:0/3835773619 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf900b5b70 0x7fbf900d3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.607+0000 7fbf98400640 1 -- 172.21.15.175:0/3835773619 >> 172.21.15.175:0/3835773619 conn(0x7fbf90072980 msgr2=0x7fbf900d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:07.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.607+0000 7fbf98400640 1 -- 172.21.15.175:0/3835773619 shutdown_connections 2024-04-25T09:10:07.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.607+0000 7fbf98400640 1 -- 172.21.15.175:0/3835773619 wait complete. 2024-04-25T09:10:07.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.607+0000 7fbf98400640 1 Processor -- start 2024-04-25T09:10:07.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.607+0000 7fbf98400640 1 -- start start 2024-04-25T09:10:07.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf98400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf900b5b70 0x7fbf901572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf98400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf900b9570 0x7fbf900caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf98400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf9015dac0 0x7fbf900cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf98400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9015dea0 con 0x7fbf9015dac0 2024-04-25T09:10:07.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf98400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf900d2c90 con 0x7fbf900b5b70 2024-04-25T09:10:07.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf98400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf900b69a0 con 0x7fbf900b9570 2024-04-25T09:10:07.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf96400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf9015dac0 0x7fbf900cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf96400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf9015dac0 0x7fbf900cc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54672/0 (socket says 172.21.15.175:54672) 2024-04-25T09:10:07.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf96400640 1 -- 172.21.15.175:0/4118065748 learned_addr learned my addr 172.21.15.175:0/4118065748 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:07.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf95000640 1 --2- 172.21.15.175:0/4118065748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf900b9570 0x7fbf900caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf95a00640 1 --2- 172.21.15.175:0/4118065748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf900b5b70 0x7fbf901572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf96400640 1 -- 172.21.15.175:0/4118065748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf900b9570 msgr2=0x7fbf900caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf96400640 1 --2- 172.21.15.175:0/4118065748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf900b9570 0x7fbf900caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf96400640 1 -- 172.21.15.175:0/4118065748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf900b5b70 msgr2=0x7fbf901572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf96400640 1 --2- 172.21.15.175:0/4118065748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf900b5b70 0x7fbf901572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf96400640 1 -- 172.21.15.175:0/4118065748 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf900cb4e0 con 0x7fbf9015dac0 2024-04-25T09:10:07.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf96400640 1 --2- 172.21.15.175:0/4118065748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf9015dac0 0x7fbf900cc6f0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fbf8801cd70 tx=0x7fbf8801bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:07.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf8d600640 1 -- 172.21.15.175:0/4118065748 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf880b4040 con 0x7fbf9015dac0 2024-04-25T09:10:07.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf8d600640 1 -- 172.21.15.175:0/4118065748 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf880c1070 con 0x7fbf9015dac0 2024-04-25T09:10:07.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf8d600640 1 -- 172.21.15.175:0/4118065748 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf880ba6b0 con 0x7fbf9015dac0 2024-04-25T09:10:07.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf98400640 1 -- 172.21.15.175:0/4118065748 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf900cb7c0 con 0x7fbf9015dac0 2024-04-25T09:10:07.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf98400640 1 -- 172.21.15.175:0/4118065748 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9015e0c0 con 0x7fbf9015dac0 2024-04-25T09:10:07.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf98400640 1 -- 172.21.15.175:0/4118065748 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf90074a60 con 0x7fbf9015dac0 2024-04-25T09:10:07.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.611+0000 7fbf8d600640 1 -- 172.21.15.175:0/4118065748 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbf880ba850 con 0x7fbf9015dac0 2024-04-25T09:10:07.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.615+0000 7fbf8d600640 1 --2- 172.21.15.175:0/4118065748 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbf70066f60 0x7fbf70069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.615+0000 7fbf8d600640 1 -- 172.21.15.175:0/4118065748 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf88123d90 con 0x7fbf9015dac0 2024-04-25T09:10:07.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.615+0000 7fbf95a00640 1 --2- 172.21.15.175:0/4118065748 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbf70066f60 0x7fbf70069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.615+0000 7fbf95a00640 1 --2- 172.21.15.175:0/4118065748 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbf70066f60 0x7fbf70069420 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbf900b91f0 tx=0x7fbf84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:07.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.619+0000 7fbf8d600640 1 -- 172.21.15.175:0/4118065748 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbf88018ca0 con 0x7fbf9015dac0 2024-04-25T09:10:07.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.803+0000 7fbf98400640 1 -- 172.21.15.175:0/4118065748 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf9006b130 con 0x7fbf9015dac0 2024-04-25T09:10:07.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.807+0000 7fbf8d600640 1 -- 172.21.15.175:0/4118065748 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4949 (secure 0 0 0) 0x7fbf880f4ee0 con 0x7fbf9015dac0 2024-04-25T09:10:07.795 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:10:07.796 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3229536012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3229536012},{"type":"v1","addr":"172.21.15.177:6834","nonce":3229536012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/222649735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":222649735},{"type":"v1","addr":"172.21.15.177:6835","nonce":222649735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2888989442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2888989442},{"type":"v1","addr":"172.21.15.175:6836","nonce":2888989442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:03.786939+0000","modified":"2024-04-25T09:10:06.815078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7215":{"gid":7215,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1755192276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1755192276},{"type":"v1","addr":"172.21.15.175:6837","nonce":1755192276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:10:07.796 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 58 2024-04-25T09:10:07.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.807+0000 7fbf98400640 1 -- 172.21.15.175:0/4118065748 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbf70066f60 msgr2=0x7fbf70069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.807+0000 7fbf98400640 1 --2- 172.21.15.175:0/4118065748 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbf70066f60 0x7fbf70069420 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbf900b91f0 tx=0x7fbf84009040 comp rx=0 tx=0).stop 2024-04-25T09:10:07.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.807+0000 7fbf98400640 1 -- 172.21.15.175:0/4118065748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf9015dac0 msgr2=0x7fbf900cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.807+0000 7fbf98400640 1 --2- 172.21.15.175:0/4118065748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf9015dac0 0x7fbf900cc6f0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fbf8801cd70 tx=0x7fbf8801bee0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.807+0000 7fbf98400640 1 -- 172.21.15.175:0/4118065748 shutdown_connections 2024-04-25T09:10:07.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.807+0000 7fbf98400640 1 --2- 172.21.15.175:0/4118065748 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbf70066f60 0x7fbf70069420 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.807+0000 7fbf98400640 1 --2- 172.21.15.175:0/4118065748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf9015dac0 0x7fbf900cc6f0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.807+0000 7fbf98400640 1 --2- 172.21.15.175:0/4118065748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf900b9570 0x7fbf900caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.807+0000 7fbf98400640 1 --2- 172.21.15.175:0/4118065748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf900b5b70 0x7fbf901572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.807+0000 7fbf98400640 1 -- 172.21.15.175:0/4118065748 >> 172.21.15.175:0/4118065748 conn(0x7fbf90072980 msgr2=0x7fbf900b38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:07.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.807+0000 7fbf98400640 1 -- 172.21.15.175:0/4118065748 shutdown_connections 2024-04-25T09:10:07.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.807+0000 7fbf98400640 1 -- 172.21.15.175:0/4118065748 wait complete. 2024-04-25T09:10:07.817 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:07.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.963+0000 7f0431800640 1 Processor -- start 2024-04-25T09:10:07.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.963+0000 7f0431800640 1 -- start start 2024-04-25T09:10:07.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.963+0000 7f0431800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042c144fc0 0x7f042c0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.963+0000 7f0431800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f042c1453a0 0x7f042c15bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.963+0000 7f0431800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f042c0cc3b0 0x7f042c15c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.963+0000 7f0431800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042c15cd00 con 0x7f042c1453a0 2024-04-25T09:10:07.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.963+0000 7f0431800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042c0ce660 con 0x7f042c0cc3b0 2024-04-25T09:10:07.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.963+0000 7f0431800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042c0cc930 con 0x7f042c144fc0 2024-04-25T09:10:07.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.963+0000 7f0422000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f042c1453a0 0x7f042c15bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.963+0000 7f0422000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f042c1453a0 0x7f042c15bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54682/0 (socket says 172.21.15.175:54682) 2024-04-25T09:10:07.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.963+0000 7f0422000640 1 -- 172.21.15.175:0/3316312947 learned_addr learned my addr 172.21.15.175:0/3316312947 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:07.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.967+0000 7f042aa00640 1 --2- 172.21.15.175:0/3316312947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042c144fc0 0x7f042c0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.967+0000 7f042b400640 1 --2- 172.21.15.175:0/3316312947 >> v2:172.21.15.177:3300/0 conn(0x7f042c0cc3b0 0x7f042c15c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.967+0000 7f0422000640 1 -- 172.21.15.175:0/3316312947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042c144fc0 msgr2=0x7f042c0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:07.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.967+0000 7f0422000640 1 --2- 172.21.15.175:0/3316312947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042c144fc0 0x7f042c0cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.967+0000 7f0422000640 1 -- 172.21.15.175:0/3316312947 >> v2:172.21.15.177:3300/0 conn(0x7f042c0cc3b0 msgr2=0x7f042c15c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:07.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.967+0000 7f0422000640 1 --2- 172.21.15.175:0/3316312947 >> v2:172.21.15.177:3300/0 conn(0x7f042c0cc3b0 0x7f042c15c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.967+0000 7f0422000640 1 -- 172.21.15.175:0/3316312947 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c0ccc10 con 0x7f042c1453a0 2024-04-25T09:10:07.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.967+0000 7f0422000640 1 --2- 172.21.15.175:0/3316312947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f042c1453a0 0x7f042c15bed0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f042c06f610 tx=0x7f041401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dba56e4725678e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:07.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.967+0000 7f042a000640 1 -- 172.21.15.175:0/3316312947 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04140ab5f0 con 0x7f042c1453a0 2024-04-25T09:10:07.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.967+0000 7f042a000640 1 -- 172.21.15.175:0/3316312947 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04140b0070 con 0x7f042c1453a0 2024-04-25T09:10:07.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.967+0000 7f042a000640 1 -- 172.21.15.175:0/3316312947 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04140ab9b0 con 0x7f042c1453a0 2024-04-25T09:10:07.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.967+0000 7f0431800640 1 -- 172.21.15.175:0/3316312947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f042c1453a0 msgr2=0x7f042c15bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.967+0000 7f0431800640 1 --2- 172.21.15.175:0/3316312947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f042c1453a0 0x7f042c15bed0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f042c06f610 tx=0x7f041401c520 comp rx=0 tx=0).stop 2024-04-25T09:10:07.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f0431800640 1 -- 172.21.15.175:0/3316312947 shutdown_connections 2024-04-25T09:10:07.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f0431800640 1 --2- 172.21.15.175:0/3316312947 >> v2:172.21.15.177:3300/0 conn(0x7f042c0cc3b0 0x7f042c15c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f0431800640 1 --2- 172.21.15.175:0/3316312947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f042c1453a0 0x7f042c15bed0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f0431800640 1 --2- 172.21.15.175:0/3316312947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042c144fc0 0x7f042c0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f0431800640 1 -- 172.21.15.175:0/3316312947 >> 172.21.15.175:0/3316312947 conn(0x7f042c067150 msgr2=0x7f042c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:07.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f0431800640 1 -- 172.21.15.175:0/3316312947 shutdown_connections 2024-04-25T09:10:07.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f0431800640 1 -- 172.21.15.175:0/3316312947 wait complete. 2024-04-25T09:10:07.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f0431800640 1 Processor -- start 2024-04-25T09:10:07.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f0431800640 1 -- start start 2024-04-25T09:10:07.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f0431800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f042c144fc0 0x7f042c152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f0431800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f042c1453a0 0x7f042c156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f0431800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042c1571b0 0x7f042c153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f0431800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c160060 con 0x7f042c144fc0 2024-04-25T09:10:07.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f0431800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c15fee0 con 0x7f042c1453a0 2024-04-25T09:10:07.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f0431800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042c1601e0 con 0x7f042c1571b0 2024-04-25T09:10:07.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f042aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f042c144fc0 0x7f042c152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f042aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f042c144fc0 0x7f042c152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54688/0 (socket says 172.21.15.175:54688) 2024-04-25T09:10:07.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f042aa00640 1 -- 172.21.15.175:0/1038126495 learned_addr learned my addr 172.21.15.175:0/1038126495 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:07.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f042b400640 1 --2- 172.21.15.175:0/1038126495 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042c1571b0 0x7f042c153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f0422000640 1 --2- 172.21.15.175:0/1038126495 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f042c1453a0 0x7f042c156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f042aa00640 1 -- 172.21.15.175:0/1038126495 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042c1571b0 msgr2=0x7f042c153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f042aa00640 1 --2- 172.21.15.175:0/1038126495 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042c1571b0 0x7f042c153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f042aa00640 1 -- 172.21.15.175:0/1038126495 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f042c1453a0 msgr2=0x7f042c156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f042aa00640 1 --2- 172.21.15.175:0/1038126495 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f042c1453a0 0x7f042c156c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f042aa00640 1 -- 172.21.15.175:0/1038126495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c0b0ee0 con 0x7f042c144fc0 2024-04-25T09:10:07.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.971+0000 7f042aa00640 1 --2- 172.21.15.175:0/1038126495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f042c144fc0 0x7f042c152210 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f041c00d620 tx=0x7f041c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:07.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.975+0000 7f0423400640 1 -- 172.21.15.175:0/1038126495 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c00b620 con 0x7f042c144fc0 2024-04-25T09:10:07.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.975+0000 7f0423400640 1 -- 172.21.15.175:0/1038126495 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041c019070 con 0x7f042c144fc0 2024-04-25T09:10:07.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.975+0000 7f0423400640 1 -- 172.21.15.175:0/1038126495 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c00b9e0 con 0x7f042c144fc0 2024-04-25T09:10:07.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.975+0000 7f0431800640 1 -- 172.21.15.175:0/1038126495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f042c0afe40 con 0x7f042c144fc0 2024-04-25T09:10:07.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.975+0000 7f0431800640 1 -- 172.21.15.175:0/1038126495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042c0b0400 con 0x7f042c144fc0 2024-04-25T09:10:07.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.975+0000 7f0431800640 1 -- 172.21.15.175:0/1038126495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042c074a60 con 0x7f042c144fc0 2024-04-25T09:10:07.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.975+0000 7f0423400640 1 -- 172.21.15.175:0/1038126495 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f041c00bb80 con 0x7f042c144fc0 2024-04-25T09:10:07.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.975+0000 7f0423400640 1 --2- 172.21.15.175:0/1038126495 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0408066f60 0x7f0408069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.975+0000 7f0423400640 1 -- 172.21.15.175:0/1038126495 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f041c0853c0 con 0x7f042c144fc0 2024-04-25T09:10:07.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.975+0000 7f0422000640 1 --2- 172.21.15.175:0/1038126495 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0408066f60 0x7f0408069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.975+0000 7f0422000640 1 --2- 172.21.15.175:0/1038126495 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0408066f60 0x7f0408069420 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f04140af000 tx=0x7f04140a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:07.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:07.979+0000 7f0423400640 1 -- 172.21.15.175:0/1038126495 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f041c0563c0 con 0x7f042c144fc0 2024-04-25T09:10:08.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.135+0000 7f0431800640 1 -- 172.21.15.175:0/1038126495 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f042c15d9b0 con 0x7f042c144fc0 2024-04-25T09:10:08.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.135+0000 7f0423400640 1 -- 172.21.15.175:0/1038126495 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16696 (secure 0 0 0) 0x7f041c055cc0 con 0x7f042c144fc0 2024-04-25T09:10:08.124 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:10:08.124 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":84,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:10:05.420729+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:01.518283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:02.788015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:08.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.135+0000 7f0431800640 1 -- 172.21.15.175:0/1038126495 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0408066f60 msgr2=0x7f0408069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.135+0000 7f0431800640 1 --2- 172.21.15.175:0/1038126495 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0408066f60 0x7f0408069420 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f04140af000 tx=0x7f04140a7000 comp rx=0 tx=0).stop 2024-04-25T09:10:08.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.135+0000 7f0431800640 1 -- 172.21.15.175:0/1038126495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f042c144fc0 msgr2=0x7f042c152210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.135+0000 7f0431800640 1 --2- 172.21.15.175:0/1038126495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f042c144fc0 0x7f042c152210 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f041c00d620 tx=0x7f041c00dae0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.135+0000 7f0431800640 1 -- 172.21.15.175:0/1038126495 shutdown_connections 2024-04-25T09:10:08.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.135+0000 7f0431800640 1 --2- 172.21.15.175:0/1038126495 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0408066f60 0x7f0408069420 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.135+0000 7f0431800640 1 --2- 172.21.15.175:0/1038126495 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042c1571b0 0x7f042c153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.135+0000 7f0431800640 1 --2- 172.21.15.175:0/1038126495 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f042c1453a0 0x7f042c156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.135+0000 7f0431800640 1 --2- 172.21.15.175:0/1038126495 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f042c144fc0 0x7f042c152210 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.135+0000 7f0431800640 1 -- 172.21.15.175:0/1038126495 >> 172.21.15.175:0/1038126495 conn(0x7f042c0cc3b0 msgr2=0x7f042c06eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:08.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.135+0000 7f0431800640 1 -- 172.21.15.175:0/1038126495 shutdown_connections 2024-04-25T09:10:08.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.135+0000 7f0431800640 1 -- 172.21.15.175:0/1038126495 wait complete. 2024-04-25T09:10:08.145 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:10:08.146 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:10:08.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.291+0000 7fb34ba00640 1 Processor -- start 2024-04-25T09:10:08.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.291+0000 7fb34ba00640 1 -- start start 2024-04-25T09:10:08.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.291+0000 7fb34ba00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb34415a900 0x7fb34406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.291+0000 7fb34ba00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3440cf560 0x7fb3440cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.291+0000 7fb34ba00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3440cda00 con 0x7fb3440cd520 2024-04-25T09:10:08.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.291+0000 7fb34ba00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb34415bcf0 con 0x7fb34415a900 2024-04-25T09:10:08.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.291+0000 7fb34ba00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3440cfef0 con 0x7fb3440cf560 2024-04-25T09:10:08.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.291+0000 7fb349a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3440cf560 0x7fb3440cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.291+0000 7fb349a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3440cf560 0x7fb3440cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:48900/0 (socket says 172.21.15.175:48900) 2024-04-25T09:10:08.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.291+0000 7fb349a00640 1 -- 172.21.15.175:0/229747257 learned_addr learned my addr 172.21.15.175:0/229747257 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:08.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.291+0000 7fb349000640 1 --2- 172.21.15.175:0/229747257 >> v2:172.21.15.177:3300/0 conn(0x7fb34415a900 0x7fb34406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.291+0000 7fb349a00640 1 -- 172.21.15.175:0/229747257 >> v2:172.21.15.177:3300/0 conn(0x7fb34415a900 msgr2=0x7fb34406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:08.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.291+0000 7fb349a00640 1 --2- 172.21.15.175:0/229747257 >> v2:172.21.15.177:3300/0 conn(0x7fb34415a900 0x7fb34406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.295+0000 7fb349a00640 1 -- 172.21.15.175:0/229747257 >> v1:172.21.15.177:6789/0 conn(0x7fb3440cd520 legacy=0x7fb3440ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.295+0000 7fb349a00640 1 -- 172.21.15.175:0/229747257 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3440cdce0 con 0x7fb3440cf560 2024-04-25T09:10:08.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.295+0000 7fb349a00640 1 --2- 172.21.15.175:0/229747257 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3440cf560 0x7fb3440cf9b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009e50 tx=0x7fb33c01ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a66bc7614242f06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:08.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.295+0000 7fb343400640 1 -- 172.21.15.175:0/229747257 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c0a57f0 con 0x7fb3440cf560 2024-04-25T09:10:08.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.295+0000 7fb343400640 1 -- 172.21.15.175:0/229747257 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c0a5990 con 0x7fb3440cf560 2024-04-25T09:10:08.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.295+0000 7fb343400640 1 -- 172.21.15.175:0/229747257 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c0a5d60 con 0x7fb3440cf560 2024-04-25T09:10:08.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.295+0000 7fb34ba00640 1 -- 172.21.15.175:0/229747257 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3440cf560 msgr2=0x7fb3440cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.295+0000 7fb34ba00640 1 --2- 172.21.15.175:0/229747257 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3440cf560 0x7fb3440cf9b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb33c009e50 tx=0x7fb33c01ca30 comp rx=0 tx=0).stop 2024-04-25T09:10:08.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.295+0000 7fb34ba00640 1 -- 172.21.15.175:0/229747257 shutdown_connections 2024-04-25T09:10:08.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.295+0000 7fb34ba00640 1 --2- 172.21.15.175:0/229747257 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3440cf560 0x7fb3440cf9b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.295+0000 7fb34ba00640 1 --2- 172.21.15.175:0/229747257 >> v2:172.21.15.177:3300/0 conn(0x7fb34415a900 0x7fb34406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.295+0000 7fb34ba00640 1 -- 172.21.15.175:0/229747257 >> 172.21.15.175:0/229747257 conn(0x7fb344067150 msgr2=0x7fb34406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:08.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb34ba00640 1 -- 172.21.15.175:0/229747257 shutdown_connections 2024-04-25T09:10:08.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb34ba00640 1 -- 172.21.15.175:0/229747257 wait complete. 2024-04-25T09:10:08.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb34ba00640 1 Processor -- start 2024-04-25T09:10:08.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb34ba00640 1 -- start start 2024-04-25T09:10:08.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb34ba00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3440cf560 0x7fb34413fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb34ba00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb34415a900 0x7fb34413c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb34ba00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb34413cf80 0x7fb344150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb34ba00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34406d530 con 0x7fb34415a900 2024-04-25T09:10:08.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb34ba00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34406d3b0 con 0x7fb3440cf560 2024-04-25T09:10:08.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb34ba00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34415c790 con 0x7fb34413cf80 2024-04-25T09:10:08.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb343e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb34415a900 0x7fb34413c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb343e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb34415a900 0x7fb34413c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54698/0 (socket says 172.21.15.175:54698) 2024-04-25T09:10:08.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb343e00640 1 -- 172.21.15.175:0/2897769738 learned_addr learned my addr 172.21.15.175:0/2897769738 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:08.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb349000640 1 --2- 172.21.15.175:0/2897769738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3440cf560 0x7fb34413fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb349a00640 1 --2- 172.21.15.175:0/2897769738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb34413cf80 0x7fb344150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb343e00640 1 -- 172.21.15.175:0/2897769738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb34413cf80 msgr2=0x7fb344150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb343e00640 1 --2- 172.21.15.175:0/2897769738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb34413cf80 0x7fb344150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb343e00640 1 -- 172.21.15.175:0/2897769738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3440cf560 msgr2=0x7fb34413fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb343e00640 1 --2- 172.21.15.175:0/2897769738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3440cf560 0x7fb34413fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb343e00640 1 -- 172.21.15.175:0/2897769738 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34413ff60 con 0x7fb34415a900 2024-04-25T09:10:08.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb349a00640 1 --2- 172.21.15.175:0/2897769738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb34413cf80 0x7fb344150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:08.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.299+0000 7fb343e00640 1 --2- 172.21.15.175:0/2897769738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb34415a900 0x7fb34413c620 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c430 tx=0x7fb33000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:08.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.303+0000 7fb340c00640 1 -- 172.21.15.175:0/2897769738 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3300052d0 con 0x7fb34415a900 2024-04-25T09:10:08.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.303+0000 7fb340c00640 1 -- 172.21.15.175:0/2897769738 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb330005470 con 0x7fb34415a900 2024-04-25T09:10:08.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.303+0000 7fb340c00640 1 -- 172.21.15.175:0/2897769738 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb330007260 con 0x7fb34415a900 2024-04-25T09:10:08.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.303+0000 7fb34ba00640 1 -- 172.21.15.175:0/2897769738 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3440b1da0 con 0x7fb34415a900 2024-04-25T09:10:08.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.303+0000 7fb34ba00640 1 -- 172.21.15.175:0/2897769738 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3441536d0 con 0x7fb34415a900 2024-04-25T09:10:08.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.303+0000 7fb34ba00640 1 -- 172.21.15.175:0/2897769738 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb344074a60 con 0x7fb34415a900 2024-04-25T09:10:08.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.303+0000 7fb340c00640 1 -- 172.21.15.175:0/2897769738 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb330007400 con 0x7fb34415a900 2024-04-25T09:10:08.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.303+0000 7fb340c00640 1 --2- 172.21.15.175:0/2897769738 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb324066f60 0x7fb324069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.303+0000 7fb340c00640 1 -- 172.21.15.175:0/2897769738 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3300844f0 con 0x7fb34415a900 2024-04-25T09:10:08.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.303+0000 7fb349000640 1 --2- 172.21.15.175:0/2897769738 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb324066f60 0x7fb324069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.307+0000 7fb349000640 1 --2- 172.21.15.175:0/2897769738 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb324066f60 0x7fb324069420 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb334009ac0 tx=0x7fb334009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:08.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.307+0000 7fb340c00640 1 -- 172.21.15.175:0/2897769738 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb34413ff60 con 0x7fb34415a900 2024-04-25T09:10:08.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.463+0000 7fb34ba00640 1 -- 172.21.15.175:0/2897769738 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb344165000 con 0x7fb324066f60 2024-04-25T09:10:08.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.467+0000 7fb340c00640 1 -- 172.21.15.175:0/2897769738 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252087 (secure 0 0 0) 0x7fb344165000 con 0x7fb324066f60 2024-04-25T09:10:08.461 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:10:08.463 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:10:08.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.471+0000 7fb34ba00640 1 -- 172.21.15.175:0/2897769738 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb324066f60 msgr2=0x7fb324069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.471+0000 7fb34ba00640 1 --2- 172.21.15.175:0/2897769738 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb324066f60 0x7fb324069420 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb334009ac0 tx=0x7fb334009190 comp rx=0 tx=0).stop 2024-04-25T09:10:08.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.471+0000 7fb34ba00640 1 -- 172.21.15.175:0/2897769738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb34415a900 msgr2=0x7fb34413c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.471+0000 7fb34ba00640 1 --2- 172.21.15.175:0/2897769738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb34415a900 0x7fb34413c620 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fb33000c430 tx=0x7fb33000c8f0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.471+0000 7fb34ba00640 1 -- 172.21.15.175:0/2897769738 shutdown_connections 2024-04-25T09:10:08.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.471+0000 7fb34ba00640 1 --2- 172.21.15.175:0/2897769738 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb324066f60 0x7fb324069420 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.471+0000 7fb34ba00640 1 --2- 172.21.15.175:0/2897769738 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb34413cf80 0x7fb344150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.471+0000 7fb34ba00640 1 --2- 172.21.15.175:0/2897769738 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb34415a900 0x7fb34413c620 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.471+0000 7fb34ba00640 1 --2- 172.21.15.175:0/2897769738 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3440cf560 0x7fb34413fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.471+0000 7fb34ba00640 1 -- 172.21.15.175:0/2897769738 >> 172.21.15.175:0/2897769738 conn(0x7fb3440cd520 msgr2=0x7fb344157d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:08.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.471+0000 7fb34ba00640 1 -- 172.21.15.175:0/2897769738 shutdown_connections 2024-04-25T09:10:08.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.471+0000 7fb34ba00640 1 -- 172.21.15.175:0/2897769738 wait complete. 2024-04-25T09:10:08.481 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-04-25T09:10:07.870812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258728,"kb_used_data":9288,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715992,"statfs":{"total":773094113280,"available":772829175808,"internally_reserved":0,"allocated":9510912,"data_stored":4709980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.470727"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430900+0000","last_change":"2024-04-25T09:10:04.443411+0000","last_active":"2024-04-25T09:10:05.430900+0000","last_peered":"2024-04-25T09:10:05.430900+0000","last_clean":"2024-04-25T09:10:05.430900+0000","last_became_active":"2024-04-25T09:10:04.443140+0000","last_became_peered":"2024-04-25T09:10:04.443140+0000","last_unstale":"2024-04-25T09:10:05.430900+0000","last_undegraded":"2024-04-25T09:10:05.430900+0000","last_fullsized":"2024-04-25T09:10:05.430900+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:11.752700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450945+0000","last_change":"2024-04-25T09:10:04.441050+0000","last_active":"2024-04-25T09:10:05.450945+0000","last_peered":"2024-04-25T09:10:05.450945+0000","last_clean":"2024-04-25T09:10:05.450945+0000","last_became_active":"2024-04-25T09:10:04.440509+0000","last_became_peered":"2024-04-25T09:10:04.440509+0000","last_unstale":"2024-04-25T09:10:05.450945+0000","last_undegraded":"2024-04-25T09:10:05.450945+0000","last_fullsized":"2024-04-25T09:10:05.450945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:26.572531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430536+0000","last_change":"2024-04-25T09:10:04.442118+0000","last_active":"2024-04-25T09:10:05.430536+0000","last_peered":"2024-04-25T09:10:05.430536+0000","last_clean":"2024-04-25T09:10:05.430536+0000","last_became_active":"2024-04-25T09:10:04.441858+0000","last_became_peered":"2024-04-25T09:10:04.441858+0000","last_unstale":"2024-04-25T09:10:05.430536+0000","last_undegraded":"2024-04-25T09:10:05.430536+0000","last_fullsized":"2024-04-25T09:10:05.430536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:57.534503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.425050+0000","last_change":"2024-04-25T09:10:04.454313+0000","last_active":"2024-04-25T09:10:05.425050+0000","last_peered":"2024-04-25T09:10:05.425050+0000","last_clean":"2024-04-25T09:10:05.425050+0000","last_became_active":"2024-04-25T09:10:04.454029+0000","last_became_peered":"2024-04-25T09:10:04.454029+0000","last_unstale":"2024-04-25T09:10:05.425050+0000","last_undegraded":"2024-04-25T09:10:05.425050+0000","last_fullsized":"2024-04-25T09:10:05.425050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:16.815965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949429+0000","last_change":"2024-04-25T09:10:04.447506+0000","last_active":"2024-04-25T09:10:05.949429+0000","last_peered":"2024-04-25T09:10:05.949429+0000","last_clean":"2024-04-25T09:10:05.949429+0000","last_became_active":"2024-04-25T09:10:04.447110+0000","last_became_peered":"2024-04-25T09:10:04.447110+0000","last_unstale":"2024-04-25T09:10:05.949429+0000","last_undegraded":"2024-04-25T09:10:05.949429+0000","last_fullsized":"2024-04-25T09:10:05.949429+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:01.172241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949668+0000","last_change":"2024-04-25T09:10:04.457915+0000","last_active":"2024-04-25T09:10:05.949668+0000","last_peered":"2024-04-25T09:10:05.949668+0000","last_clean":"2024-04-25T09:10:05.949668+0000","last_became_active":"2024-04-25T09:10:04.456187+0000","last_became_peered":"2024-04-25T09:10:04.456187+0000","last_unstale":"2024-04-25T09:10:05.949668+0000","last_undegraded":"2024-04-25T09:10:05.949668+0000","last_fullsized":"2024-04-25T09:10:05.949668+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:34.955952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.424908+0000","last_change":"2024-04-25T09:10:04.451237+0000","last_active":"2024-04-25T09:10:05.424908+0000","last_peered":"2024-04-25T09:10:05.424908+0000","last_clean":"2024-04-25T09:10:05.424908+0000","last_became_active":"2024-04-25T09:10:04.450104+0000","last_became_peered":"2024-04-25T09:10:04.450104+0000","last_unstale":"2024-04-25T09:10:05.424908+0000","last_undegraded":"2024-04-25T09:10:05.424908+0000","last_fullsized":"2024-04-25T09:10:05.424908+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:46.296387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949540+0000","last_change":"2024-04-25T09:10:04.448662+0000","last_active":"2024-04-25T09:10:05.949540+0000","last_peered":"2024-04-25T09:10:05.949540+0000","last_clean":"2024-04-25T09:10:05.949540+0000","last_became_active":"2024-04-25T09:10:04.448272+0000","last_became_peered":"2024-04-25T09:10:04.448272+0000","last_unstale":"2024-04-25T09:10:05.949540+0000","last_undegraded":"2024-04-25T09:10:05.949540+0000","last_fullsized":"2024-04-25T09:10:05.949540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:37.394114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949756+0000","last_change":"2024-04-25T09:10:04.455021+0000","last_active":"2024-04-25T09:10:05.949756+0000","last_peered":"2024-04-25T09:10:05.949756+0000","last_clean":"2024-04-25T09:10:05.949756+0000","last_became_active":"2024-04-25T09:10:04.454361+0000","last_became_peered":"2024-04-25T09:10:04.454361+0000","last_unstale":"2024-04-25T09:10:05.949756+0000","last_undegraded":"2024-04-25T09:10:05.949756+0000","last_fullsized":"2024-04-25T09:10:05.949756+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:43.122093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430501+0000","last_change":"2024-04-25T09:10:04.435262+0000","last_active":"2024-04-25T09:10:05.430501+0000","last_peered":"2024-04-25T09:10:05.430501+0000","last_clean":"2024-04-25T09:10:05.430501+0000","last_became_active":"2024-04-25T09:10:04.434816+0000","last_became_peered":"2024-04-25T09:10:04.434816+0000","last_unstale":"2024-04-25T09:10:05.430501+0000","last_undegraded":"2024-04-25T09:10:05.430501+0000","last_fullsized":"2024-04-25T09:10:05.430501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:07.888924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450844+0000","last_change":"2024-04-25T09:10:04.443021+0000","last_active":"2024-04-25T09:10:05.450844+0000","last_peered":"2024-04-25T09:10:05.450844+0000","last_clean":"2024-04-25T09:10:05.450844+0000","last_became_active":"2024-04-25T09:10:04.442755+0000","last_became_peered":"2024-04-25T09:10:04.442755+0000","last_unstale":"2024-04-25T09:10:05.450844+0000","last_undegraded":"2024-04-25T09:10:05.450844+0000","last_fullsized":"2024-04-25T09:10:05.450844+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:20.877552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430638+0000","last_change":"2024-04-25T09:10:04.439352+0000","last_active":"2024-04-25T09:10:05.430638+0000","last_peered":"2024-04-25T09:10:05.430638+0000","last_clean":"2024-04-25T09:10:05.430638+0000","last_became_active":"2024-04-25T09:10:04.439027+0000","last_became_peered":"2024-04-25T09:10:04.439027+0000","last_unstale":"2024-04-25T09:10:05.430638+0000","last_undegraded":"2024-04-25T09:10:05.430638+0000","last_fullsized":"2024-04-25T09:10:05.430638+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:05.392347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.429568+0000","last_change":"2024-04-25T09:10:04.450636+0000","last_active":"2024-04-25T09:10:05.429568+0000","last_peered":"2024-04-25T09:10:05.429568+0000","last_clean":"2024-04-25T09:10:05.429568+0000","last_became_active":"2024-04-25T09:10:04.450121+0000","last_became_peered":"2024-04-25T09:10:04.450121+0000","last_unstale":"2024-04-25T09:10:05.429568+0000","last_undegraded":"2024-04-25T09:10:05.429568+0000","last_fullsized":"2024-04-25T09:10:05.429568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:02.096352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.425088+0000","last_change":"2024-04-25T09:10:04.452811+0000","last_active":"2024-04-25T09:10:05.425088+0000","last_peered":"2024-04-25T09:10:05.425088+0000","last_clean":"2024-04-25T09:10:05.425088+0000","last_became_active":"2024-04-25T09:10:04.452567+0000","last_became_peered":"2024-04-25T09:10:04.452567+0000","last_unstale":"2024-04-25T09:10:05.425088+0000","last_undegraded":"2024-04-25T09:10:05.425088+0000","last_fullsized":"2024-04-25T09:10:05.425088+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:21.240284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.947348+0000","last_change":"2024-04-25T09:10:04.432865+0000","last_active":"2024-04-25T09:10:05.947348+0000","last_peered":"2024-04-25T09:10:05.947348+0000","last_clean":"2024-04-25T09:10:05.947348+0000","last_became_active":"2024-04-25T09:10:04.432283+0000","last_became_peered":"2024-04-25T09:10:04.432283+0000","last_unstale":"2024-04-25T09:10:05.947348+0000","last_undegraded":"2024-04-25T09:10:05.947348+0000","last_fullsized":"2024-04-25T09:10:05.947348+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:28.599145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949406+0000","last_change":"2024-04-25T09:10:04.450123+0000","last_active":"2024-04-25T09:10:05.949406+0000","last_peered":"2024-04-25T09:10:05.949406+0000","last_clean":"2024-04-25T09:10:05.949406+0000","last_became_active":"2024-04-25T09:10:04.449765+0000","last_became_peered":"2024-04-25T09:10:04.449765+0000","last_unstale":"2024-04-25T09:10:05.949406+0000","last_undegraded":"2024-04-25T09:10:05.949406+0000","last_fullsized":"2024-04-25T09:10:05.949406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:05.392347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.950447+0000","last_change":"2024-04-25T09:10:04.456138+0000","last_active":"2024-04-25T09:10:05.950447+0000","last_peered":"2024-04-25T09:10:05.950447+0000","last_clean":"2024-04-25T09:10:05.950447+0000","last_became_active":"2024-04-25T09:10:04.455873+0000","last_became_peered":"2024-04-25T09:10:04.455873+0000","last_unstale":"2024-04-25T09:10:05.950447+0000","last_undegraded":"2024-04-25T09:10:05.950447+0000","last_fullsized":"2024-04-25T09:10:05.950447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:02.096352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.425350+0000","last_change":"2024-04-25T09:10:04.449133+0000","last_active":"2024-04-25T09:10:05.425350+0000","last_peered":"2024-04-25T09:10:05.425350+0000","last_clean":"2024-04-25T09:10:05.425350+0000","last_became_active":"2024-04-25T09:10:04.448854+0000","last_became_peered":"2024-04-25T09:10:04.448854+0000","last_unstale":"2024-04-25T09:10:05.425350+0000","last_undegraded":"2024-04-25T09:10:05.425350+0000","last_fullsized":"2024-04-25T09:10:05.425350+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:25.111009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453917+0000","last_change":"2024-04-25T09:10:04.438872+0000","last_active":"2024-04-25T09:10:05.453917+0000","last_peered":"2024-04-25T09:10:05.453917+0000","last_clean":"2024-04-25T09:10:05.453917+0000","last_became_active":"2024-04-25T09:10:04.438546+0000","last_became_peered":"2024-04-25T09:10:04.438546+0000","last_unstale":"2024-04-25T09:10:05.453917+0000","last_undegraded":"2024-04-25T09:10:05.453917+0000","last_fullsized":"2024-04-25T09:10:05.453917+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:34.955952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.425229+0000","last_change":"2024-04-25T09:10:04.463973+0000","last_active":"2024-04-25T09:10:05.425229+0000","last_peered":"2024-04-25T09:10:05.425229+0000","last_clean":"2024-04-25T09:10:05.425229+0000","last_became_active":"2024-04-25T09:10:04.463228+0000","last_became_peered":"2024-04-25T09:10:04.463228+0000","last_unstale":"2024-04-25T09:10:05.425229+0000","last_undegraded":"2024-04-25T09:10:05.425229+0000","last_fullsized":"2024-04-25T09:10:05.425229+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:02.128113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.425280+0000","last_change":"2024-04-25T09:10:04.454896+0000","last_active":"2024-04-25T09:10:05.425280+0000","last_peered":"2024-04-25T09:10:05.425280+0000","last_clean":"2024-04-25T09:10:05.425280+0000","last_became_active":"2024-04-25T09:10:04.454644+0000","last_became_peered":"2024-04-25T09:10:04.454644+0000","last_unstale":"2024-04-25T09:10:05.425280+0000","last_undegraded":"2024-04-25T09:10:05.425280+0000","last_fullsized":"2024-04-25T09:10:05.425280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:33.282954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450511+0000","last_change":"2024-04-25T09:10:04.452444+0000","last_active":"2024-04-25T09:10:05.450511+0000","last_peered":"2024-04-25T09:10:05.450511+0000","last_clean":"2024-04-25T09:10:05.450511+0000","last_became_active":"2024-04-25T09:10:04.452099+0000","last_became_peered":"2024-04-25T09:10:04.452099+0000","last_unstale":"2024-04-25T09:10:05.450511+0000","last_undegraded":"2024-04-25T09:10:05.450511+0000","last_fullsized":"2024-04-25T09:10:05.450511+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:27:48.687048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430195+0000","last_change":"2024-04-25T09:10:04.438561+0000","last_active":"2024-04-25T09:10:05.430195+0000","last_peered":"2024-04-25T09:10:05.430195+0000","last_clean":"2024-04-25T09:10:05.430195+0000","last_became_active":"2024-04-25T09:10:04.438239+0000","last_became_peered":"2024-04-25T09:10:04.438239+0000","last_unstale":"2024-04-25T09:10:05.430195+0000","last_undegraded":"2024-04-25T09:10:05.430195+0000","last_fullsized":"2024-04-25T09:10:05.430195+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:33.058609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.425000+0000","last_change":"2024-04-25T09:10:04.453565+0000","last_active":"2024-04-25T09:10:05.425000+0000","last_peered":"2024-04-25T09:10:05.425000+0000","last_clean":"2024-04-25T09:10:05.425000+0000","last_became_active":"2024-04-25T09:10:04.453206+0000","last_became_peered":"2024-04-25T09:10:04.453206+0000","last_unstale":"2024-04-25T09:10:05.425000+0000","last_undegraded":"2024-04-25T09:10:05.425000+0000","last_fullsized":"2024-04-25T09:10:05.425000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:53.567645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450868+0000","last_change":"2024-04-25T09:10:04.441468+0000","last_active":"2024-04-25T09:10:05.450868+0000","last_peered":"2024-04-25T09:10:05.450868+0000","last_clean":"2024-04-25T09:10:05.450868+0000","last_became_active":"2024-04-25T09:10:04.440827+0000","last_became_peered":"2024-04-25T09:10:04.440827+0000","last_unstale":"2024-04-25T09:10:05.450868+0000","last_undegraded":"2024-04-25T09:10:05.450868+0000","last_fullsized":"2024-04-25T09:10:05.450868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:23.767027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430247+0000","last_change":"2024-04-25T09:10:04.446572+0000","last_active":"2024-04-25T09:10:05.430247+0000","last_peered":"2024-04-25T09:10:05.430247+0000","last_clean":"2024-04-25T09:10:05.430247+0000","last_became_active":"2024-04-25T09:10:04.446048+0000","last_became_peered":"2024-04-25T09:10:04.446048+0000","last_unstale":"2024-04-25T09:10:05.430247+0000","last_undegraded":"2024-04-25T09:10:05.430247+0000","last_fullsized":"2024-04-25T09:10:05.430247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:33.101698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949958+0000","last_change":"2024-04-25T09:10:04.442803+0000","last_active":"2024-04-25T09:10:05.949958+0000","last_peered":"2024-04-25T09:10:05.949958+0000","last_clean":"2024-04-25T09:10:05.949958+0000","last_became_active":"2024-04-25T09:10:04.442511+0000","last_became_peered":"2024-04-25T09:10:04.442511+0000","last_unstale":"2024-04-25T09:10:05.949958+0000","last_undegraded":"2024-04-25T09:10:05.949958+0000","last_fullsized":"2024-04-25T09:10:05.949958+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:37.394114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430518+0000","last_change":"2024-04-25T09:10:04.444527+0000","last_active":"2024-04-25T09:10:05.430518+0000","last_peered":"2024-04-25T09:10:05.430518+0000","last_clean":"2024-04-25T09:10:05.430518+0000","last_became_active":"2024-04-25T09:10:04.444211+0000","last_became_peered":"2024-04-25T09:10:04.444211+0000","last_unstale":"2024-04-25T09:10:05.430518+0000","last_undegraded":"2024-04-25T09:10:05.430518+0000","last_fullsized":"2024-04-25T09:10:05.430518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:49.559960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450510+0000","last_change":"2024-04-25T09:10:04.438873+0000","last_active":"2024-04-25T09:10:05.450510+0000","last_peered":"2024-04-25T09:10:05.450510+0000","last_clean":"2024-04-25T09:10:05.450510+0000","last_became_active":"2024-04-25T09:10:04.438597+0000","last_became_peered":"2024-04-25T09:10:04.438597+0000","last_unstale":"2024-04-25T09:10:05.450510+0000","last_undegraded":"2024-04-25T09:10:05.450510+0000","last_fullsized":"2024-04-25T09:10:05.450510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:27.453812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450519+0000","last_change":"2024-04-25T09:10:04.442121+0000","last_active":"2024-04-25T09:10:05.450519+0000","last_peered":"2024-04-25T09:10:05.450519+0000","last_clean":"2024-04-25T09:10:05.450519+0000","last_became_active":"2024-04-25T09:10:04.441807+0000","last_became_peered":"2024-04-25T09:10:04.441807+0000","last_unstale":"2024-04-25T09:10:05.450519+0000","last_undegraded":"2024-04-25T09:10:05.450519+0000","last_fullsized":"2024-04-25T09:10:05.450519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:30.709454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949329+0000","last_change":"2024-04-25T09:10:04.445701+0000","last_active":"2024-04-25T09:10:05.949329+0000","last_peered":"2024-04-25T09:10:05.949329+0000","last_clean":"2024-04-25T09:10:05.949329+0000","last_became_active":"2024-04-25T09:10:04.445257+0000","last_became_peered":"2024-04-25T09:10:04.445257+0000","last_unstale":"2024-04-25T09:10:05.949329+0000","last_undegraded":"2024-04-25T09:10:05.949329+0000","last_fullsized":"2024-04-25T09:10:05.949329+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:45.916188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.429608+0000","last_change":"2024-04-25T09:10:04.445089+0000","last_active":"2024-04-25T09:10:05.429608+0000","last_peered":"2024-04-25T09:10:05.429608+0000","last_clean":"2024-04-25T09:10:05.429608+0000","last_became_active":"2024-04-25T09:10:04.442706+0000","last_became_peered":"2024-04-25T09:10:04.442706+0000","last_unstale":"2024-04-25T09:10:05.429608+0000","last_undegraded":"2024-04-25T09:10:05.429608+0000","last_fullsized":"2024-04-25T09:10:05.429608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:10.013964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.950264+0000","last_change":"2024-04-25T09:10:04.443693+0000","last_active":"2024-04-25T09:10:05.950264+0000","last_peered":"2024-04-25T09:10:05.950264+0000","last_clean":"2024-04-25T09:10:05.950264+0000","last_became_active":"2024-04-25T09:10:04.443381+0000","last_became_peered":"2024-04-25T09:10:04.443381+0000","last_unstale":"2024-04-25T09:10:05.950264+0000","last_undegraded":"2024-04-25T09:10:05.950264+0000","last_fullsized":"2024-04-25T09:10:05.950264+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:45.908313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"83'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430827+0000","last_change":"2024-04-25T09:10:03.436687+0000","last_active":"2024-04-25T09:10:05.430827+0000","last_peered":"2024-04-25T09:10:05.430827+0000","last_clean":"2024-04-25T09:10:05.430827+0000","last_became_active":"2024-04-25T09:10:03.436288+0000","last_became_peered":"2024-04-25T09:10:03.436288+0000","last_unstale":"2024-04-25T09:10:05.430827+0000","last_undegraded":"2024-04-25T09:10:05.430827+0000","last_fullsized":"2024-04-25T09:10:05.430827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:18.581402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430616+0000","last_change":"2024-04-25T09:10:04.449915+0000","last_active":"2024-04-25T09:10:05.430616+0000","last_peered":"2024-04-25T09:10:05.430616+0000","last_clean":"2024-04-25T09:10:05.430616+0000","last_became_active":"2024-04-25T09:10:04.447401+0000","last_became_peered":"2024-04-25T09:10:04.447401+0000","last_unstale":"2024-04-25T09:10:05.430616+0000","last_undegraded":"2024-04-25T09:10:05.430616+0000","last_fullsized":"2024-04-25T09:10:05.430616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:45.916188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.950338+0000","last_change":"2024-04-25T09:10:03.425410+0000","last_active":"2024-04-25T09:10:05.950338+0000","last_peered":"2024-04-25T09:10:05.950338+0000","last_clean":"2024-04-25T09:10:05.950338+0000","last_became_active":"2024-04-25T09:10:03.424751+0000","last_became_peered":"2024-04-25T09:10:03.424751+0000","last_unstale":"2024-04-25T09:10:05.950338+0000","last_undegraded":"2024-04-25T09:10:05.950338+0000","last_fullsized":"2024-04-25T09:10:05.950338+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:19.871387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430739+0000","last_change":"2024-04-25T09:10:04.444769+0000","last_active":"2024-04-25T09:10:05.430739+0000","last_peered":"2024-04-25T09:10:05.430739+0000","last_clean":"2024-04-25T09:10:05.430739+0000","last_became_active":"2024-04-25T09:10:04.441253+0000","last_became_peered":"2024-04-25T09:10:04.441253+0000","last_unstale":"2024-04-25T09:10:05.430739+0000","last_undegraded":"2024-04-25T09:10:05.430739+0000","last_fullsized":"2024-04-25T09:10:05.430739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:01.172241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453945+0000","last_change":"2024-04-25T09:10:03.431841+0000","last_active":"2024-04-25T09:10:05.453945+0000","last_peered":"2024-04-25T09:10:05.453945+0000","last_clean":"2024-04-25T09:10:05.453945+0000","last_became_active":"2024-04-25T09:10:03.431492+0000","last_became_peered":"2024-04-25T09:10:03.431492+0000","last_unstale":"2024-04-25T09:10:05.453945+0000","last_undegraded":"2024-04-25T09:10:05.453945+0000","last_fullsized":"2024-04-25T09:10:05.453945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:55.169506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430042+0000","last_change":"2024-04-25T09:10:04.449115+0000","last_active":"2024-04-25T09:10:05.430042+0000","last_peered":"2024-04-25T09:10:05.430042+0000","last_clean":"2024-04-25T09:10:05.430042+0000","last_became_active":"2024-04-25T09:10:04.448720+0000","last_became_peered":"2024-04-25T09:10:04.448720+0000","last_unstale":"2024-04-25T09:10:05.430042+0000","last_undegraded":"2024-04-25T09:10:05.430042+0000","last_fullsized":"2024-04-25T09:10:05.430042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:13.030329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453648+0000","last_change":"2024-04-25T09:10:03.432622+0000","last_active":"2024-04-25T09:10:05.453648+0000","last_peered":"2024-04-25T09:10:05.453648+0000","last_clean":"2024-04-25T09:10:05.453648+0000","last_became_active":"2024-04-25T09:10:03.432251+0000","last_became_peered":"2024-04-25T09:10:03.432251+0000","last_unstale":"2024-04-25T09:10:05.453648+0000","last_undegraded":"2024-04-25T09:10:05.453648+0000","last_fullsized":"2024-04-25T09:10:05.453648+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:32.030773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450677+0000","last_change":"2024-04-25T09:10:04.443662+0000","last_active":"2024-04-25T09:10:05.450677+0000","last_peered":"2024-04-25T09:10:05.450677+0000","last_clean":"2024-04-25T09:10:05.450677+0000","last_became_active":"2024-04-25T09:10:04.442394+0000","last_became_peered":"2024-04-25T09:10:04.442394+0000","last_unstale":"2024-04-25T09:10:05.450677+0000","last_undegraded":"2024-04-25T09:10:05.450677+0000","last_fullsized":"2024-04-25T09:10:05.450677+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:10.350630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949862+0000","last_change":"2024-04-25T09:10:03.436434+0000","last_active":"2024-04-25T09:10:05.949862+0000","last_peered":"2024-04-25T09:10:05.949862+0000","last_clean":"2024-04-25T09:10:05.949862+0000","last_became_active":"2024-04-25T09:10:03.436085+0000","last_became_peered":"2024-04-25T09:10:03.436085+0000","last_unstale":"2024-04-25T09:10:05.949862+0000","last_undegraded":"2024-04-25T09:10:05.949862+0000","last_fullsized":"2024-04-25T09:10:05.949862+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:07.725630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949806+0000","last_change":"2024-04-25T09:10:04.457099+0000","last_active":"2024-04-25T09:10:05.949806+0000","last_peered":"2024-04-25T09:10:05.949806+0000","last_clean":"2024-04-25T09:10:05.949806+0000","last_became_active":"2024-04-25T09:10:04.456707+0000","last_became_peered":"2024-04-25T09:10:04.456707+0000","last_unstale":"2024-04-25T09:10:05.949806+0000","last_undegraded":"2024-04-25T09:10:05.949806+0000","last_fullsized":"2024-04-25T09:10:05.949806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:37.645631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949474+0000","last_change":"2024-04-25T09:10:03.426428+0000","last_active":"2024-04-25T09:10:05.949474+0000","last_peered":"2024-04-25T09:10:05.949474+0000","last_clean":"2024-04-25T09:10:05.949474+0000","last_became_active":"2024-04-25T09:10:03.426068+0000","last_became_peered":"2024-04-25T09:10:03.426068+0000","last_unstale":"2024-04-25T09:10:05.949474+0000","last_undegraded":"2024-04-25T09:10:05.949474+0000","last_fullsized":"2024-04-25T09:10:05.949474+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:27:47.680883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.429616+0000","last_change":"2024-04-25T09:10:04.455684+0000","last_active":"2024-04-25T09:10:05.429616+0000","last_peered":"2024-04-25T09:10:05.429616+0000","last_clean":"2024-04-25T09:10:05.429616+0000","last_became_active":"2024-04-25T09:10:04.453288+0000","last_became_peered":"2024-04-25T09:10:04.453288+0000","last_unstale":"2024-04-25T09:10:05.429616+0000","last_undegraded":"2024-04-25T09:10:05.429616+0000","last_fullsized":"2024-04-25T09:10:05.429616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:27.742849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453415+0000","last_change":"2024-04-25T09:10:03.424024+0000","last_active":"2024-04-25T09:10:05.453415+0000","last_peered":"2024-04-25T09:10:05.453415+0000","last_clean":"2024-04-25T09:10:05.453415+0000","last_became_active":"2024-04-25T09:10:03.423750+0000","last_became_peered":"2024-04-25T09:10:03.423750+0000","last_unstale":"2024-04-25T09:10:05.453415+0000","last_undegraded":"2024-04-25T09:10:05.453415+0000","last_fullsized":"2024-04-25T09:10:05.453415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:55.449792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.947505+0000","last_change":"2024-04-25T09:10:04.433074+0000","last_active":"2024-04-25T09:10:05.947505+0000","last_peered":"2024-04-25T09:10:05.947505+0000","last_clean":"2024-04-25T09:10:05.947505+0000","last_became_active":"2024-04-25T09:10:04.432702+0000","last_became_peered":"2024-04-25T09:10:04.432702+0000","last_unstale":"2024-04-25T09:10:05.947505+0000","last_undegraded":"2024-04-25T09:10:05.947505+0000","last_fullsized":"2024-04-25T09:10:05.947505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:12.565200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450331+0000","last_change":"2024-04-25T09:10:03.432227+0000","last_active":"2024-04-25T09:10:05.450331+0000","last_peered":"2024-04-25T09:10:05.450331+0000","last_clean":"2024-04-25T09:10:05.450331+0000","last_became_active":"2024-04-25T09:10:03.431968+0000","last_became_peered":"2024-04-25T09:10:03.431968+0000","last_unstale":"2024-04-25T09:10:05.450331+0000","last_undegraded":"2024-04-25T09:10:05.450331+0000","last_fullsized":"2024-04-25T09:10:05.450331+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:40.420668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.947612+0000","last_change":"2024-04-25T09:10:04.440378+0000","last_active":"2024-04-25T09:10:05.947612+0000","last_peered":"2024-04-25T09:10:05.947612+0000","last_clean":"2024-04-25T09:10:05.947612+0000","last_became_active":"2024-04-25T09:10:04.440122+0000","last_became_peered":"2024-04-25T09:10:04.440122+0000","last_unstale":"2024-04-25T09:10:05.947612+0000","last_undegraded":"2024-04-25T09:10:05.947612+0000","last_fullsized":"2024-04-25T09:10:05.947612+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:34.591966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430965+0000","last_change":"2024-04-25T09:10:03.425949+0000","last_active":"2024-04-25T09:10:05.430965+0000","last_peered":"2024-04-25T09:10:05.430965+0000","last_clean":"2024-04-25T09:10:05.430965+0000","last_became_active":"2024-04-25T09:10:03.425634+0000","last_became_peered":"2024-04-25T09:10:03.425634+0000","last_unstale":"2024-04-25T09:10:05.430965+0000","last_undegraded":"2024-04-25T09:10:05.430965+0000","last_fullsized":"2024-04-25T09:10:05.430965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:12.647044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949894+0000","last_change":"2024-04-25T09:10:04.459624+0000","last_active":"2024-04-25T09:10:05.949894+0000","last_peered":"2024-04-25T09:10:05.949894+0000","last_clean":"2024-04-25T09:10:05.949894+0000","last_became_active":"2024-04-25T09:10:04.459168+0000","last_became_peered":"2024-04-25T09:10:04.459168+0000","last_unstale":"2024-04-25T09:10:05.949894+0000","last_undegraded":"2024-04-25T09:10:05.949894+0000","last_fullsized":"2024-04-25T09:10:05.949894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:45.908313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430536+0000","last_change":"2024-04-25T09:10:03.424690+0000","last_active":"2024-04-25T09:10:05.430536+0000","last_peered":"2024-04-25T09:10:05.430536+0000","last_clean":"2024-04-25T09:10:05.430536+0000","last_became_active":"2024-04-25T09:10:03.424277+0000","last_became_peered":"2024-04-25T09:10:03.424277+0000","last_unstale":"2024-04-25T09:10:05.430536+0000","last_undegraded":"2024-04-25T09:10:05.430536+0000","last_fullsized":"2024-04-25T09:10:05.430536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:10.907603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453723+0000","last_change":"2024-04-25T09:10:04.447880+0000","last_active":"2024-04-25T09:10:05.453723+0000","last_peered":"2024-04-25T09:10:05.453723+0000","last_clean":"2024-04-25T09:10:05.453723+0000","last_became_active":"2024-04-25T09:10:04.447632+0000","last_became_peered":"2024-04-25T09:10:04.447632+0000","last_unstale":"2024-04-25T09:10:05.453723+0000","last_undegraded":"2024-04-25T09:10:05.453723+0000","last_fullsized":"2024-04-25T09:10:05.453723+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:37.645631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"83'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430079+0000","last_change":"2024-04-25T09:10:03.434653+0000","last_active":"2024-04-25T09:10:05.430079+0000","last_peered":"2024-04-25T09:10:05.430079+0000","last_clean":"2024-04-25T09:10:05.430079+0000","last_became_active":"2024-04-25T09:10:03.434113+0000","last_became_peered":"2024-04-25T09:10:03.434113+0000","last_unstale":"2024-04-25T09:10:05.430079+0000","last_undegraded":"2024-04-25T09:10:05.430079+0000","last_fullsized":"2024-04-25T09:10:05.430079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:44.926620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.950189+0000","last_change":"2024-04-25T09:10:04.447064+0000","last_active":"2024-04-25T09:10:05.950189+0000","last_peered":"2024-04-25T09:10:05.950189+0000","last_clean":"2024-04-25T09:10:05.950189+0000","last_became_active":"2024-04-25T09:10:04.445717+0000","last_became_peered":"2024-04-25T09:10:04.445717+0000","last_unstale":"2024-04-25T09:10:05.950189+0000","last_undegraded":"2024-04-25T09:10:05.950189+0000","last_fullsized":"2024-04-25T09:10:05.950189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:34.955952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"83'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949667+0000","last_change":"2024-04-25T09:10:03.429618+0000","last_active":"2024-04-25T09:10:05.949667+0000","last_peered":"2024-04-25T09:10:05.949667+0000","last_clean":"2024-04-25T09:10:05.949667+0000","last_became_active":"2024-04-25T09:10:03.429366+0000","last_became_peered":"2024-04-25T09:10:03.429366+0000","last_unstale":"2024-04-25T09:10:05.949667+0000","last_undegraded":"2024-04-25T09:10:05.949667+0000","last_fullsized":"2024-04-25T09:10:05.949667+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:55.169506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453596+0000","last_change":"2024-04-25T09:10:04.450290+0000","last_active":"2024-04-25T09:10:05.453596+0000","last_peered":"2024-04-25T09:10:05.453596+0000","last_clean":"2024-04-25T09:10:05.453596+0000","last_became_active":"2024-04-25T09:10:04.444897+0000","last_became_peered":"2024-04-25T09:10:04.444897+0000","last_unstale":"2024-04-25T09:10:05.453596+0000","last_undegraded":"2024-04-25T09:10:05.453596+0000","last_fullsized":"2024-04-25T09:10:05.453596+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:01.172241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450511+0000","last_change":"2024-04-25T09:10:03.426587+0000","last_active":"2024-04-25T09:10:05.450511+0000","last_peered":"2024-04-25T09:10:05.450511+0000","last_clean":"2024-04-25T09:10:05.450511+0000","last_became_active":"2024-04-25T09:10:03.426256+0000","last_became_peered":"2024-04-25T09:10:03.426256+0000","last_unstale":"2024-04-25T09:10:05.450511+0000","last_undegraded":"2024-04-25T09:10:05.450511+0000","last_fullsized":"2024-04-25T09:10:05.450511+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:00.268343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430377+0000","last_change":"2024-04-25T09:10:04.462289+0000","last_active":"2024-04-25T09:10:05.430377+0000","last_peered":"2024-04-25T09:10:05.430377+0000","last_clean":"2024-04-25T09:10:05.430377+0000","last_became_active":"2024-04-25T09:10:04.461982+0000","last_became_peered":"2024-04-25T09:10:04.461982+0000","last_unstale":"2024-04-25T09:10:05.430377+0000","last_undegraded":"2024-04-25T09:10:05.430377+0000","last_fullsized":"2024-04-25T09:10:05.430377+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:18.362576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.947510+0000","last_change":"2024-04-25T09:10:03.433995+0000","last_active":"2024-04-25T09:10:05.947510+0000","last_peered":"2024-04-25T09:10:05.947510+0000","last_clean":"2024-04-25T09:10:05.947510+0000","last_became_active":"2024-04-25T09:10:03.433660+0000","last_became_peered":"2024-04-25T09:10:03.433660+0000","last_unstale":"2024-04-25T09:10:05.947510+0000","last_undegraded":"2024-04-25T09:10:05.947510+0000","last_fullsized":"2024-04-25T09:10:05.947510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:39.050335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450289+0000","last_change":"2024-04-25T09:10:04.461685+0000","last_active":"2024-04-25T09:10:05.450289+0000","last_peered":"2024-04-25T09:10:05.450289+0000","last_clean":"2024-04-25T09:10:05.450289+0000","last_became_active":"2024-04-25T09:10:04.461209+0000","last_became_peered":"2024-04-25T09:10:04.461209+0000","last_unstale":"2024-04-25T09:10:05.450289+0000","last_undegraded":"2024-04-25T09:10:05.450289+0000","last_fullsized":"2024-04-25T09:10:05.450289+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:09.435934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949207+0000","last_change":"2024-04-25T09:10:03.426943+0000","last_active":"2024-04-25T09:10:05.949207+0000","last_peered":"2024-04-25T09:10:05.949207+0000","last_clean":"2024-04-25T09:10:05.949207+0000","last_became_active":"2024-04-25T09:10:03.426562+0000","last_became_peered":"2024-04-25T09:10:03.426562+0000","last_unstale":"2024-04-25T09:10:05.949207+0000","last_undegraded":"2024-04-25T09:10:05.949207+0000","last_fullsized":"2024-04-25T09:10:05.949207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:55.449792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450279+0000","last_change":"2024-04-25T09:10:04.440386+0000","last_active":"2024-04-25T09:10:05.450279+0000","last_peered":"2024-04-25T09:10:05.450279+0000","last_clean":"2024-04-25T09:10:05.450279+0000","last_became_active":"2024-04-25T09:10:04.438483+0000","last_became_peered":"2024-04-25T09:10:04.438483+0000","last_unstale":"2024-04-25T09:10:05.450279+0000","last_undegraded":"2024-04-25T09:10:05.450279+0000","last_fullsized":"2024-04-25T09:10:05.450279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:13.653209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"83'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453413+0000","last_change":"2024-04-25T09:10:03.426287+0000","last_active":"2024-04-25T09:10:05.453413+0000","last_peered":"2024-04-25T09:10:05.453413+0000","last_clean":"2024-04-25T09:10:05.453413+0000","last_became_active":"2024-04-25T09:10:03.425786+0000","last_became_peered":"2024-04-25T09:10:03.425786+0000","last_unstale":"2024-04-25T09:10:05.453413+0000","last_undegraded":"2024-04-25T09:10:05.453413+0000","last_fullsized":"2024-04-25T09:10:05.453413+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:33.458045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.429905+0000","last_change":"2024-04-25T09:10:04.447220+0000","last_active":"2024-04-25T09:10:05.429905+0000","last_peered":"2024-04-25T09:10:05.429905+0000","last_clean":"2024-04-25T09:10:05.429905+0000","last_became_active":"2024-04-25T09:10:04.446947+0000","last_became_peered":"2024-04-25T09:10:04.446947+0000","last_unstale":"2024-04-25T09:10:05.429905+0000","last_undegraded":"2024-04-25T09:10:05.429905+0000","last_fullsized":"2024-04-25T09:10:05.429905+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:26.150596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.431061+0000","last_change":"2024-04-25T09:10:03.423715+0000","last_active":"2024-04-25T09:10:05.431061+0000","last_peered":"2024-04-25T09:10:05.431061+0000","last_clean":"2024-04-25T09:10:05.431061+0000","last_became_active":"2024-04-25T09:10:03.423426+0000","last_became_peered":"2024-04-25T09:10:03.423426+0000","last_unstale":"2024-04-25T09:10:05.431061+0000","last_undegraded":"2024-04-25T09:10:05.431061+0000","last_fullsized":"2024-04-25T09:10:05.431061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:08.429769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430772+0000","last_change":"2024-04-25T09:10:04.440206+0000","last_active":"2024-04-25T09:10:05.430772+0000","last_peered":"2024-04-25T09:10:05.430772+0000","last_clean":"2024-04-25T09:10:05.430772+0000","last_became_active":"2024-04-25T09:10:04.439902+0000","last_became_peered":"2024-04-25T09:10:04.439902+0000","last_unstale":"2024-04-25T09:10:05.430772+0000","last_undegraded":"2024-04-25T09:10:05.430772+0000","last_fullsized":"2024-04-25T09:10:05.430772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:37.645631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453824+0000","last_change":"2024-04-25T09:10:03.427380+0000","last_active":"2024-04-25T09:10:05.453824+0000","last_peered":"2024-04-25T09:10:05.453824+0000","last_clean":"2024-04-25T09:10:05.453824+0000","last_became_active":"2024-04-25T09:10:03.427112+0000","last_became_peered":"2024-04-25T09:10:03.427112+0000","last_unstale":"2024-04-25T09:10:05.453824+0000","last_undegraded":"2024-04-25T09:10:05.453824+0000","last_fullsized":"2024-04-25T09:10:05.453824+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:32.052444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.950255+0000","last_change":"2024-04-25T09:10:04.449882+0000","last_active":"2024-04-25T09:10:05.950255+0000","last_peered":"2024-04-25T09:10:05.950255+0000","last_clean":"2024-04-25T09:10:05.950255+0000","last_became_active":"2024-04-25T09:10:04.449501+0000","last_became_peered":"2024-04-25T09:10:04.449501+0000","last_unstale":"2024-04-25T09:10:05.950255+0000","last_undegraded":"2024-04-25T09:10:05.950255+0000","last_fullsized":"2024-04-25T09:10:05.950255+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:43.122093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453764+0000","last_change":"2024-04-25T09:10:03.423246+0000","last_active":"2024-04-25T09:10:05.453764+0000","last_peered":"2024-04-25T09:10:05.453764+0000","last_clean":"2024-04-25T09:10:05.453764+0000","last_became_active":"2024-04-25T09:10:03.422961+0000","last_became_peered":"2024-04-25T09:10:03.422961+0000","last_unstale":"2024-04-25T09:10:05.453764+0000","last_undegraded":"2024-04-25T09:10:05.453764+0000","last_fullsized":"2024-04-25T09:10:05.453764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:09.007800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.425118+0000","last_change":"2024-04-25T09:10:04.446242+0000","last_active":"2024-04-25T09:10:05.425118+0000","last_peered":"2024-04-25T09:10:05.425118+0000","last_clean":"2024-04-25T09:10:05.425118+0000","last_became_active":"2024-04-25T09:10:04.445468+0000","last_became_peered":"2024-04-25T09:10:04.445468+0000","last_unstale":"2024-04-25T09:10:05.425118+0000","last_undegraded":"2024-04-25T09:10:05.425118+0000","last_fullsized":"2024-04-25T09:10:05.425118+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:16.986227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.947471+0000","last_change":"2024-04-25T09:10:03.435208+0000","last_active":"2024-04-25T09:10:05.947471+0000","last_peered":"2024-04-25T09:10:05.947471+0000","last_clean":"2024-04-25T09:10:05.947471+0000","last_became_active":"2024-04-25T09:10:03.434912+0000","last_became_peered":"2024-04-25T09:10:03.434912+0000","last_unstale":"2024-04-25T09:10:05.947471+0000","last_undegraded":"2024-04-25T09:10:05.947471+0000","last_fullsized":"2024-04-25T09:10:05.947471+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:32.095533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949288+0000","last_change":"2024-04-25T09:10:04.441955+0000","last_active":"2024-04-25T09:10:05.949288+0000","last_peered":"2024-04-25T09:10:05.949288+0000","last_clean":"2024-04-25T09:10:05.949288+0000","last_became_active":"2024-04-25T09:10:04.441691+0000","last_became_peered":"2024-04-25T09:10:04.441691+0000","last_unstale":"2024-04-25T09:10:05.949288+0000","last_undegraded":"2024-04-25T09:10:05.949288+0000","last_fullsized":"2024-04-25T09:10:05.949288+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:05.392347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.425141+0000","last_change":"2024-04-25T09:10:03.431132+0000","last_active":"2024-04-25T09:10:05.425141+0000","last_peered":"2024-04-25T09:10:05.425141+0000","last_clean":"2024-04-25T09:10:05.425141+0000","last_became_active":"2024-04-25T09:10:03.430844+0000","last_became_peered":"2024-04-25T09:10:03.430844+0000","last_unstale":"2024-04-25T09:10:05.425141+0000","last_undegraded":"2024-04-25T09:10:05.425141+0000","last_fullsized":"2024-04-25T09:10:05.425141+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:46.757533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.424920+0000","last_change":"2024-04-25T09:10:04.445371+0000","last_active":"2024-04-25T09:10:05.424920+0000","last_peered":"2024-04-25T09:10:05.424920+0000","last_clean":"2024-04-25T09:10:05.424920+0000","last_became_active":"2024-04-25T09:10:04.444978+0000","last_became_peered":"2024-04-25T09:10:04.444978+0000","last_unstale":"2024-04-25T09:10:05.424920+0000","last_undegraded":"2024-04-25T09:10:05.424920+0000","last_fullsized":"2024-04-25T09:10:05.424920+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:23.444295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.424855+0000","last_change":"2024-04-25T09:10:03.431259+0000","last_active":"2024-04-25T09:10:05.424855+0000","last_peered":"2024-04-25T09:10:05.424855+0000","last_clean":"2024-04-25T09:10:05.424855+0000","last_became_active":"2024-04-25T09:10:03.430978+0000","last_became_peered":"2024-04-25T09:10:03.430978+0000","last_unstale":"2024-04-25T09:10:05.424855+0000","last_undegraded":"2024-04-25T09:10:05.424855+0000","last_fullsized":"2024-04-25T09:10:05.424855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:38.905836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949381+0000","last_change":"2024-04-25T09:10:04.454137+0000","last_active":"2024-04-25T09:10:05.949381+0000","last_peered":"2024-04-25T09:10:05.949381+0000","last_clean":"2024-04-25T09:10:05.949381+0000","last_became_active":"2024-04-25T09:10:04.453775+0000","last_became_peered":"2024-04-25T09:10:04.453775+0000","last_unstale":"2024-04-25T09:10:05.949381+0000","last_undegraded":"2024-04-25T09:10:05.949381+0000","last_fullsized":"2024-04-25T09:10:05.949381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:37.645631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.947223+0000","last_change":"2024-04-25T09:10:03.430323+0000","last_active":"2024-04-25T09:10:05.947223+0000","last_peered":"2024-04-25T09:10:05.947223+0000","last_clean":"2024-04-25T09:10:05.947223+0000","last_became_active":"2024-04-25T09:10:03.430028+0000","last_became_peered":"2024-04-25T09:10:03.430028+0000","last_unstale":"2024-04-25T09:10:05.947223+0000","last_undegraded":"2024-04-25T09:10:05.947223+0000","last_fullsized":"2024-04-25T09:10:05.947223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:12.024164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.950347+0000","last_change":"2024-04-25T09:10:04.451333+0000","last_active":"2024-04-25T09:10:05.950347+0000","last_peered":"2024-04-25T09:10:05.950347+0000","last_clean":"2024-04-25T09:10:05.950347+0000","last_became_active":"2024-04-25T09:10:04.449717+0000","last_became_peered":"2024-04-25T09:10:04.449717+0000","last_unstale":"2024-04-25T09:10:05.950347+0000","last_undegraded":"2024-04-25T09:10:05.950347+0000","last_fullsized":"2024-04-25T09:10:05.950347+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:17.489189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450742+0000","last_change":"2024-04-25T09:10:03.433168+0000","last_active":"2024-04-25T09:10:05.450742+0000","last_peered":"2024-04-25T09:10:05.450742+0000","last_clean":"2024-04-25T09:10:05.450742+0000","last_became_active":"2024-04-25T09:10:03.430842+0000","last_became_peered":"2024-04-25T09:10:03.430842+0000","last_unstale":"2024-04-25T09:10:05.450742+0000","last_undegraded":"2024-04-25T09:10:05.450742+0000","last_fullsized":"2024-04-25T09:10:05.450742+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:41.109146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430073+0000","last_change":"2024-04-25T09:10:04.443494+0000","last_active":"2024-04-25T09:10:05.430073+0000","last_peered":"2024-04-25T09:10:05.430073+0000","last_clean":"2024-04-25T09:10:05.430073+0000","last_became_active":"2024-04-25T09:10:04.443200+0000","last_became_peered":"2024-04-25T09:10:04.443200+0000","last_unstale":"2024-04-25T09:10:05.430073+0000","last_undegraded":"2024-04-25T09:10:05.430073+0000","last_fullsized":"2024-04-25T09:10:05.430073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:40.056500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"84'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450939+0000","last_change":"2024-04-25T09:10:03.431136+0000","last_active":"2024-04-25T09:10:05.450939+0000","last_peered":"2024-04-25T09:10:05.450939+0000","last_clean":"2024-04-25T09:10:05.450939+0000","last_became_active":"2024-04-25T09:10:03.430829+0000","last_became_peered":"2024-04-25T09:10:03.430829+0000","last_unstale":"2024-04-25T09:10:05.450939+0000","last_undegraded":"2024-04-25T09:10:05.450939+0000","last_fullsized":"2024-04-25T09:10:05.450939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:18.894715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430778+0000","last_change":"2024-04-25T09:10:04.454759+0000","last_active":"2024-04-25T09:10:05.430778+0000","last_peered":"2024-04-25T09:10:05.430778+0000","last_clean":"2024-04-25T09:10:05.430778+0000","last_became_active":"2024-04-25T09:10:04.451834+0000","last_became_peered":"2024-04-25T09:10:04.451834+0000","last_unstale":"2024-04-25T09:10:05.430778+0000","last_undegraded":"2024-04-25T09:10:05.430778+0000","last_fullsized":"2024-04-25T09:10:05.430778+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:37.394114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430030+0000","last_change":"2024-04-25T09:10:03.433850+0000","last_active":"2024-04-25T09:10:05.430030+0000","last_peered":"2024-04-25T09:10:05.430030+0000","last_clean":"2024-04-25T09:10:05.430030+0000","last_became_active":"2024-04-25T09:10:03.433570+0000","last_became_peered":"2024-04-25T09:10:03.433570+0000","last_unstale":"2024-04-25T09:10:05.430030+0000","last_undegraded":"2024-04-25T09:10:05.430030+0000","last_fullsized":"2024-04-25T09:10:05.430030+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:07.869866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.950417+0000","last_change":"2024-04-25T09:10:04.447482+0000","last_active":"2024-04-25T09:10:05.950417+0000","last_peered":"2024-04-25T09:10:05.950417+0000","last_clean":"2024-04-25T09:10:05.950417+0000","last_became_active":"2024-04-25T09:10:04.447161+0000","last_became_peered":"2024-04-25T09:10:04.447161+0000","last_unstale":"2024-04-25T09:10:05.950417+0000","last_undegraded":"2024-04-25T09:10:05.950417+0000","last_fullsized":"2024-04-25T09:10:05.950417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:06.710228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430800+0000","last_change":"2024-04-25T09:10:03.430873+0000","last_active":"2024-04-25T09:10:05.430800+0000","last_peered":"2024-04-25T09:10:05.430800+0000","last_clean":"2024-04-25T09:10:05.430800+0000","last_became_active":"2024-04-25T09:10:03.430420+0000","last_became_peered":"2024-04-25T09:10:03.430420+0000","last_unstale":"2024-04-25T09:10:05.430800+0000","last_undegraded":"2024-04-25T09:10:05.430800+0000","last_fullsized":"2024-04-25T09:10:05.430800+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:25.981518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949316+0000","last_change":"2024-04-25T09:10:04.444891+0000","last_active":"2024-04-25T09:10:05.949316+0000","last_peered":"2024-04-25T09:10:05.949316+0000","last_clean":"2024-04-25T09:10:05.949316+0000","last_became_active":"2024-04-25T09:10:04.444598+0000","last_became_peered":"2024-04-25T09:10:04.444598+0000","last_unstale":"2024-04-25T09:10:05.949316+0000","last_undegraded":"2024-04-25T09:10:05.949316+0000","last_fullsized":"2024-04-25T09:10:05.949316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:01.172241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453648+0000","last_change":"2024-04-25T09:10:03.430280+0000","last_active":"2024-04-25T09:10:05.453648+0000","last_peered":"2024-04-25T09:10:05.453648+0000","last_clean":"2024-04-25T09:10:05.453648+0000","last_became_active":"2024-04-25T09:10:03.429859+0000","last_became_peered":"2024-04-25T09:10:03.429859+0000","last_unstale":"2024-04-25T09:10:05.453648+0000","last_undegraded":"2024-04-25T09:10:05.453648+0000","last_fullsized":"2024-04-25T09:10:05.453648+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:21.489427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453741+0000","last_change":"2024-04-25T09:10:04.451045+0000","last_active":"2024-04-25T09:10:05.453741+0000","last_peered":"2024-04-25T09:10:05.453741+0000","last_clean":"2024-04-25T09:10:05.453741+0000","last_became_active":"2024-04-25T09:10:04.450587+0000","last_became_peered":"2024-04-25T09:10:04.450587+0000","last_unstale":"2024-04-25T09:10:05.453741+0000","last_undegraded":"2024-04-25T09:10:05.453741+0000","last_fullsized":"2024-04-25T09:10:05.453741+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:37.394114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949508+0000","last_change":"2024-04-25T09:10:03.426068+0000","last_active":"2024-04-25T09:10:05.949508+0000","last_peered":"2024-04-25T09:10:05.949508+0000","last_clean":"2024-04-25T09:10:05.949508+0000","last_became_active":"2024-04-25T09:10:03.425740+0000","last_became_peered":"2024-04-25T09:10:03.425740+0000","last_unstale":"2024-04-25T09:10:05.949508+0000","last_undegraded":"2024-04-25T09:10:05.949508+0000","last_fullsized":"2024-04-25T09:10:05.949508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:29.703290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.429766+0000","last_change":"2024-04-25T09:10:04.447696+0000","last_active":"2024-04-25T09:10:05.429766+0000","last_peered":"2024-04-25T09:10:05.429766+0000","last_clean":"2024-04-25T09:10:05.429766+0000","last_became_active":"2024-04-25T09:10:04.447311+0000","last_became_peered":"2024-04-25T09:10:04.447311+0000","last_unstale":"2024-04-25T09:10:05.429766+0000","last_undegraded":"2024-04-25T09:10:05.429766+0000","last_fullsized":"2024-04-25T09:10:05.429766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:12.746593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430484+0000","last_change":"2024-04-25T09:10:03.430837+0000","last_active":"2024-04-25T09:10:05.430484+0000","last_peered":"2024-04-25T09:10:05.430484+0000","last_clean":"2024-04-25T09:10:05.430484+0000","last_became_active":"2024-04-25T09:10:03.430496+0000","last_became_peered":"2024-04-25T09:10:03.430496+0000","last_unstale":"2024-04-25T09:10:05.430484+0000","last_undegraded":"2024-04-25T09:10:05.430484+0000","last_fullsized":"2024-04-25T09:10:05.430484+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:36.177094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430389+0000","last_change":"2024-04-25T09:10:04.444396+0000","last_active":"2024-04-25T09:10:05.430389+0000","last_peered":"2024-04-25T09:10:05.430389+0000","last_clean":"2024-04-25T09:10:05.430389+0000","last_became_active":"2024-04-25T09:10:04.444103+0000","last_became_peered":"2024-04-25T09:10:04.444103+0000","last_unstale":"2024-04-25T09:10:05.430389+0000","last_undegraded":"2024-04-25T09:10:05.430389+0000","last_fullsized":"2024-04-25T09:10:05.430389+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:33.036938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949476+0000","last_change":"2024-04-25T09:10:03.417488+0000","last_active":"2024-04-25T09:10:05.949476+0000","last_peered":"2024-04-25T09:10:05.949476+0000","last_clean":"2024-04-25T09:10:05.949476+0000","last_became_active":"2024-04-25T09:10:03.417171+0000","last_became_peered":"2024-04-25T09:10:03.417171+0000","last_unstale":"2024-04-25T09:10:05.949476+0000","last_undegraded":"2024-04-25T09:10:05.949476+0000","last_fullsized":"2024-04-25T09:10:05.949476+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:09.344466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450693+0000","last_change":"2024-04-25T09:10:04.440943+0000","last_active":"2024-04-25T09:10:05.450693+0000","last_peered":"2024-04-25T09:10:05.450693+0000","last_clean":"2024-04-25T09:10:05.450693+0000","last_became_active":"2024-04-25T09:10:04.439935+0000","last_became_peered":"2024-04-25T09:10:04.439935+0000","last_unstale":"2024-04-25T09:10:05.450693+0000","last_undegraded":"2024-04-25T09:10:05.450693+0000","last_fullsized":"2024-04-25T09:10:05.450693+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:08.731795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430096+0000","last_change":"2024-04-25T09:10:03.438063+0000","last_active":"2024-04-25T09:10:05.430096+0000","last_peered":"2024-04-25T09:10:05.430096+0000","last_clean":"2024-04-25T09:10:05.430096+0000","last_became_active":"2024-04-25T09:10:03.437736+0000","last_became_peered":"2024-04-25T09:10:03.437736+0000","last_unstale":"2024-04-25T09:10:05.430096+0000","last_undegraded":"2024-04-25T09:10:05.430096+0000","last_fullsized":"2024-04-25T09:10:05.430096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:44.910024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":290,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.429787+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:10:05.429787+0000","last_peered":"2024-04-25T09:10:05.429787+0000","last_clean":"2024-04-25T09:10:05.429787+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:10:05.429787+0000","last_undegraded":"2024-04-25T09:10:05.429787+0000","last_fullsized":"2024-04-25T09:10:05.429787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1630208,"data_stored":1030991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1044480,"data_stored":441247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":442187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1032192,"data_stored":440553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1044480,"data_stored":442165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1036288,"data_stored":441135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1044480,"data_stored":440747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1630208,"data_stored":1030955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:10:08.486 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:10:08.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.667+0000 7f1bc9200640 1 Processor -- start 2024-04-25T09:10:08.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.667+0000 7f1bc9200640 1 -- start start 2024-04-25T09:10:08.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.667+0000 7f1bc9200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1bc4144fc0 0x7f1bc40cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.667+0000 7f1bc9200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1bc415c5e0 0x7f1bc40cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.667+0000 7f1bc9200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc415cd00 con 0x7f1bc41453a0 2024-04-25T09:10:08.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.667+0000 7f1bc9200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc40ce660 con 0x7f1bc4144fc0 2024-04-25T09:10:08.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.667+0000 7f1bc9200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc40cc930 con 0x7f1bc415c5e0 2024-04-25T09:10:08.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.667+0000 7f1bc1e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1bc4144fc0 0x7f1bc40cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.667+0000 7f1bc1e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1bc4144fc0 0x7f1bc40cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54702/0 (socket says 172.21.15.175:54702) 2024-04-25T09:10:08.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.667+0000 7f1bc1e00640 1 -- 172.21.15.175:0/3949005009 learned_addr learned my addr 172.21.15.175:0/3949005009 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:08.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.667+0000 7f1bc2800640 1 --2- 172.21.15.175:0/3949005009 >> v2:172.21.15.177:3300/0 conn(0x7f1bc415c5e0 0x7f1bc40cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.667+0000 7f1bc1e00640 1 -- 172.21.15.175:0/3949005009 >> v2:172.21.15.177:3300/0 conn(0x7f1bc415c5e0 msgr2=0x7f1bc40cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:08.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.667+0000 7f1bc1e00640 1 --2- 172.21.15.175:0/3949005009 >> v2:172.21.15.177:3300/0 conn(0x7f1bc415c5e0 0x7f1bc40cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.667+0000 7f1bc1e00640 1 -- 172.21.15.175:0/3949005009 >> v1:172.21.15.177:6789/0 conn(0x7f1bc41453a0 legacy=0x7f1bc415bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:08.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.667+0000 7f1bc1e00640 1 -- 172.21.15.175:0/3949005009 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc40ccc10 con 0x7f1bc4144fc0 2024-04-25T09:10:08.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.667+0000 7f1bc2800640 1 --2- 172.21.15.175:0/3949005009 >> v2:172.21.15.177:3300/0 conn(0x7f1bc415c5e0 0x7f1bc40cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:08.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.671+0000 7f1bc1e00640 1 --2- 172.21.15.175:0/3949005009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc4144fc0 0x7f1bc40cbe70 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4009e50 tx=0x7f1bb401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce311becbb7f7bda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:08.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.671+0000 7f1bc0a00640 1 -- 172.21.15.175:0/3949005009 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40a5760 con 0x7f1bc4144fc0 2024-04-25T09:10:08.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.671+0000 7f1bc0a00640 1 -- 172.21.15.175:0/3949005009 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb40a5900 con 0x7f1bc4144fc0 2024-04-25T09:10:08.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.671+0000 7f1bc0a00640 1 -- 172.21.15.175:0/3949005009 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40a5cd0 con 0x7f1bc4144fc0 2024-04-25T09:10:08.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.671+0000 7f1bc9200640 1 -- 172.21.15.175:0/3949005009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc4144fc0 msgr2=0x7f1bc40cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.671+0000 7f1bc9200640 1 --2- 172.21.15.175:0/3949005009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc4144fc0 0x7f1bc40cbe70 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4009e50 tx=0x7f1bb401c9b0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.671+0000 7f1bc9200640 1 -- 172.21.15.175:0/3949005009 shutdown_connections 2024-04-25T09:10:08.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.671+0000 7f1bc9200640 1 --2- 172.21.15.175:0/3949005009 >> v2:172.21.15.177:3300/0 conn(0x7f1bc415c5e0 0x7f1bc40cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.671+0000 7f1bc9200640 1 --2- 172.21.15.175:0/3949005009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc4144fc0 0x7f1bc40cbe70 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.671+0000 7f1bc9200640 1 -- 172.21.15.175:0/3949005009 >> 172.21.15.175:0/3949005009 conn(0x7f1bc4067150 msgr2=0x7f1bc406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:08.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.671+0000 7f1bc9200640 1 -- 172.21.15.175:0/3949005009 shutdown_connections 2024-04-25T09:10:08.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.671+0000 7f1bc9200640 1 -- 172.21.15.175:0/3949005009 wait complete. 2024-04-25T09:10:08.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc9200640 1 Processor -- start 2024-04-25T09:10:08.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc9200640 1 -- start start 2024-04-25T09:10:08.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc9200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bc41453a0 0x7f1bc4139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc9200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc415c5e0 0x7f1bc40b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc9200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc4159740 0x7f1bc4159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc9200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc40cff00 con 0x7f1bc4159740 2024-04-25T09:10:08.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc9200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc40cfd80 con 0x7f1bc415c5e0 2024-04-25T09:10:08.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc9200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc413e120 con 0x7f1bc41453a0 2024-04-25T09:10:08.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc2800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc4159740 0x7f1bc4159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc2800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc4159740 0x7f1bc4159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54714/0 (socket says 172.21.15.175:54714) 2024-04-25T09:10:08.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc2800640 1 -- 172.21.15.175:0/2475670273 learned_addr learned my addr 172.21.15.175:0/2475670273 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:08.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc1400640 1 --2- 172.21.15.175:0/2475670273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc415c5e0 0x7f1bc40b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc1e00640 1 --2- 172.21.15.175:0/2475670273 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bc41453a0 0x7f1bc4139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc2800640 1 -- 172.21.15.175:0/2475670273 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bc41453a0 msgr2=0x7f1bc4139940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc2800640 1 --2- 172.21.15.175:0/2475670273 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bc41453a0 0x7f1bc4139940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc2800640 1 -- 172.21.15.175:0/2475670273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc415c5e0 msgr2=0x7f1bc40b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc2800640 1 --2- 172.21.15.175:0/2475670273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc415c5e0 0x7f1bc40b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc2800640 1 -- 172.21.15.175:0/2475670273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc413e400 con 0x7f1bc4159740 2024-04-25T09:10:08.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc2800640 1 --2- 172.21.15.175:0/2475670273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc4159740 0x7f1bc4159f80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00c7f0 tx=0x7f1bbc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:08.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bba000640 1 -- 172.21.15.175:0/2475670273 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc015020 con 0x7f1bc4159740 2024-04-25T09:10:08.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bba000640 1 -- 172.21.15.175:0/2475670273 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc004250 con 0x7f1bc4159740 2024-04-25T09:10:08.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc9200640 1 -- 172.21.15.175:0/2475670273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc413e6e0 con 0x7f1bc4159740 2024-04-25T09:10:08.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bba000640 1 -- 172.21.15.175:0/2475670273 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc003620 con 0x7f1bc4159740 2024-04-25T09:10:08.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.675+0000 7f1bc9200640 1 -- 172.21.15.175:0/2475670273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc4159bf0 con 0x7f1bc4159740 2024-04-25T09:10:08.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.679+0000 7f1bc9200640 1 -- 172.21.15.175:0/2475670273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc4074a60 con 0x7f1bc4159740 2024-04-25T09:10:08.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.679+0000 7f1bba000640 1 -- 172.21.15.175:0/2475670273 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1bbc018020 con 0x7f1bc4159740 2024-04-25T09:10:08.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.679+0000 7f1bba000640 1 --2- 172.21.15.175:0/2475670273 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1ba4066f90 0x7f1ba4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.679+0000 7f1bba000640 1 -- 172.21.15.175:0/2475670273 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1bbc085360 con 0x7f1bc4159740 2024-04-25T09:10:08.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.679+0000 7f1bc1e00640 1 --2- 172.21.15.175:0/2475670273 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1ba4066f90 0x7f1ba4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.679+0000 7f1bc1e00640 1 --2- 172.21.15.175:0/2475670273 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1ba4066f90 0x7f1ba4069450 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40ae000 tx=0x7f1bb40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:08.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.683+0000 7f1bba000640 1 -- 172.21.15.175:0/2475670273 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1bbc01f020 con 0x7f1bc4159740 2024-04-25T09:10:08.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.835+0000 7f1bc9200640 1 -- 172.21.15.175:0/2475670273 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1bc415fec0 con 0x7f1ba4066f90 2024-04-25T09:10:08.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.843+0000 7f1bba000640 1 -- 172.21.15.175:0/2475670273 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252087 (secure 0 0 0) 0x7f1bc415fec0 con 0x7f1ba4066f90 2024-04-25T09:10:08.834 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:10:08.835 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:10:08.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.847+0000 7f1bc9200640 1 -- 172.21.15.175:0/2475670273 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1ba4066f90 msgr2=0x7f1ba4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.847+0000 7f1bc9200640 1 --2- 172.21.15.175:0/2475670273 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1ba4066f90 0x7f1ba4069450 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40ae000 tx=0x7f1bb40a7070 comp rx=0 tx=0).stop 2024-04-25T09:10:08.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.847+0000 7f1bc9200640 1 -- 172.21.15.175:0/2475670273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc4159740 msgr2=0x7f1bc4159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.847+0000 7f1bc9200640 1 --2- 172.21.15.175:0/2475670273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc4159740 0x7f1bc4159f80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00c7f0 tx=0x7f1bbc00ccb0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.847+0000 7f1bc9200640 1 -- 172.21.15.175:0/2475670273 shutdown_connections 2024-04-25T09:10:08.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.847+0000 7f1bc9200640 1 --2- 172.21.15.175:0/2475670273 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1ba4066f90 0x7f1ba4069450 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.847+0000 7f1bc9200640 1 --2- 172.21.15.175:0/2475670273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc4159740 0x7f1bc4159f80 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.847+0000 7f1bc9200640 1 --2- 172.21.15.175:0/2475670273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bc415c5e0 0x7f1bc40b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.847+0000 7f1bc9200640 1 --2- 172.21.15.175:0/2475670273 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bc41453a0 0x7f1bc4139940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.847+0000 7f1bc9200640 1 -- 172.21.15.175:0/2475670273 >> 172.21.15.175:0/2475670273 conn(0x7f1bc4144fc0 msgr2=0x7f1bc415f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:08.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.847+0000 7f1bc9200640 1 -- 172.21.15.175:0/2475670273 shutdown_connections 2024-04-25T09:10:08.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:08.847+0000 7f1bc9200640 1 -- 172.21.15.175:0/2475670273 wait complete. 2024-04-25T09:10:08.855 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-04-25T09:10:07.870812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258728,"kb_used_data":9288,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715992,"statfs":{"total":773094113280,"available":772829175808,"internally_reserved":0,"allocated":9510912,"data_stored":4709980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.470727"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430900+0000","last_change":"2024-04-25T09:10:04.443411+0000","last_active":"2024-04-25T09:10:05.430900+0000","last_peered":"2024-04-25T09:10:05.430900+0000","last_clean":"2024-04-25T09:10:05.430900+0000","last_became_active":"2024-04-25T09:10:04.443140+0000","last_became_peered":"2024-04-25T09:10:04.443140+0000","last_unstale":"2024-04-25T09:10:05.430900+0000","last_undegraded":"2024-04-25T09:10:05.430900+0000","last_fullsized":"2024-04-25T09:10:05.430900+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:11.752700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450945+0000","last_change":"2024-04-25T09:10:04.441050+0000","last_active":"2024-04-25T09:10:05.450945+0000","last_peered":"2024-04-25T09:10:05.450945+0000","last_clean":"2024-04-25T09:10:05.450945+0000","last_became_active":"2024-04-25T09:10:04.440509+0000","last_became_peered":"2024-04-25T09:10:04.440509+0000","last_unstale":"2024-04-25T09:10:05.450945+0000","last_undegraded":"2024-04-25T09:10:05.450945+0000","last_fullsized":"2024-04-25T09:10:05.450945+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:26.572531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430536+0000","last_change":"2024-04-25T09:10:04.442118+0000","last_active":"2024-04-25T09:10:05.430536+0000","last_peered":"2024-04-25T09:10:05.430536+0000","last_clean":"2024-04-25T09:10:05.430536+0000","last_became_active":"2024-04-25T09:10:04.441858+0000","last_became_peered":"2024-04-25T09:10:04.441858+0000","last_unstale":"2024-04-25T09:10:05.430536+0000","last_undegraded":"2024-04-25T09:10:05.430536+0000","last_fullsized":"2024-04-25T09:10:05.430536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:57.534503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.425050+0000","last_change":"2024-04-25T09:10:04.454313+0000","last_active":"2024-04-25T09:10:05.425050+0000","last_peered":"2024-04-25T09:10:05.425050+0000","last_clean":"2024-04-25T09:10:05.425050+0000","last_became_active":"2024-04-25T09:10:04.454029+0000","last_became_peered":"2024-04-25T09:10:04.454029+0000","last_unstale":"2024-04-25T09:10:05.425050+0000","last_undegraded":"2024-04-25T09:10:05.425050+0000","last_fullsized":"2024-04-25T09:10:05.425050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:16.815965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949429+0000","last_change":"2024-04-25T09:10:04.447506+0000","last_active":"2024-04-25T09:10:05.949429+0000","last_peered":"2024-04-25T09:10:05.949429+0000","last_clean":"2024-04-25T09:10:05.949429+0000","last_became_active":"2024-04-25T09:10:04.447110+0000","last_became_peered":"2024-04-25T09:10:04.447110+0000","last_unstale":"2024-04-25T09:10:05.949429+0000","last_undegraded":"2024-04-25T09:10:05.949429+0000","last_fullsized":"2024-04-25T09:10:05.949429+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:01.172241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949668+0000","last_change":"2024-04-25T09:10:04.457915+0000","last_active":"2024-04-25T09:10:05.949668+0000","last_peered":"2024-04-25T09:10:05.949668+0000","last_clean":"2024-04-25T09:10:05.949668+0000","last_became_active":"2024-04-25T09:10:04.456187+0000","last_became_peered":"2024-04-25T09:10:04.456187+0000","last_unstale":"2024-04-25T09:10:05.949668+0000","last_undegraded":"2024-04-25T09:10:05.949668+0000","last_fullsized":"2024-04-25T09:10:05.949668+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:34.955952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.424908+0000","last_change":"2024-04-25T09:10:04.451237+0000","last_active":"2024-04-25T09:10:05.424908+0000","last_peered":"2024-04-25T09:10:05.424908+0000","last_clean":"2024-04-25T09:10:05.424908+0000","last_became_active":"2024-04-25T09:10:04.450104+0000","last_became_peered":"2024-04-25T09:10:04.450104+0000","last_unstale":"2024-04-25T09:10:05.424908+0000","last_undegraded":"2024-04-25T09:10:05.424908+0000","last_fullsized":"2024-04-25T09:10:05.424908+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:46.296387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949540+0000","last_change":"2024-04-25T09:10:04.448662+0000","last_active":"2024-04-25T09:10:05.949540+0000","last_peered":"2024-04-25T09:10:05.949540+0000","last_clean":"2024-04-25T09:10:05.949540+0000","last_became_active":"2024-04-25T09:10:04.448272+0000","last_became_peered":"2024-04-25T09:10:04.448272+0000","last_unstale":"2024-04-25T09:10:05.949540+0000","last_undegraded":"2024-04-25T09:10:05.949540+0000","last_fullsized":"2024-04-25T09:10:05.949540+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:37.394114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949756+0000","last_change":"2024-04-25T09:10:04.455021+0000","last_active":"2024-04-25T09:10:05.949756+0000","last_peered":"2024-04-25T09:10:05.949756+0000","last_clean":"2024-04-25T09:10:05.949756+0000","last_became_active":"2024-04-25T09:10:04.454361+0000","last_became_peered":"2024-04-25T09:10:04.454361+0000","last_unstale":"2024-04-25T09:10:05.949756+0000","last_undegraded":"2024-04-25T09:10:05.949756+0000","last_fullsized":"2024-04-25T09:10:05.949756+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:43.122093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430501+0000","last_change":"2024-04-25T09:10:04.435262+0000","last_active":"2024-04-25T09:10:05.430501+0000","last_peered":"2024-04-25T09:10:05.430501+0000","last_clean":"2024-04-25T09:10:05.430501+0000","last_became_active":"2024-04-25T09:10:04.434816+0000","last_became_peered":"2024-04-25T09:10:04.434816+0000","last_unstale":"2024-04-25T09:10:05.430501+0000","last_undegraded":"2024-04-25T09:10:05.430501+0000","last_fullsized":"2024-04-25T09:10:05.430501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:07.888924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450844+0000","last_change":"2024-04-25T09:10:04.443021+0000","last_active":"2024-04-25T09:10:05.450844+0000","last_peered":"2024-04-25T09:10:05.450844+0000","last_clean":"2024-04-25T09:10:05.450844+0000","last_became_active":"2024-04-25T09:10:04.442755+0000","last_became_peered":"2024-04-25T09:10:04.442755+0000","last_unstale":"2024-04-25T09:10:05.450844+0000","last_undegraded":"2024-04-25T09:10:05.450844+0000","last_fullsized":"2024-04-25T09:10:05.450844+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:20.877552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430638+0000","last_change":"2024-04-25T09:10:04.439352+0000","last_active":"2024-04-25T09:10:05.430638+0000","last_peered":"2024-04-25T09:10:05.430638+0000","last_clean":"2024-04-25T09:10:05.430638+0000","last_became_active":"2024-04-25T09:10:04.439027+0000","last_became_peered":"2024-04-25T09:10:04.439027+0000","last_unstale":"2024-04-25T09:10:05.430638+0000","last_undegraded":"2024-04-25T09:10:05.430638+0000","last_fullsized":"2024-04-25T09:10:05.430638+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:05.392347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.429568+0000","last_change":"2024-04-25T09:10:04.450636+0000","last_active":"2024-04-25T09:10:05.429568+0000","last_peered":"2024-04-25T09:10:05.429568+0000","last_clean":"2024-04-25T09:10:05.429568+0000","last_became_active":"2024-04-25T09:10:04.450121+0000","last_became_peered":"2024-04-25T09:10:04.450121+0000","last_unstale":"2024-04-25T09:10:05.429568+0000","last_undegraded":"2024-04-25T09:10:05.429568+0000","last_fullsized":"2024-04-25T09:10:05.429568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:02.096352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.425088+0000","last_change":"2024-04-25T09:10:04.452811+0000","last_active":"2024-04-25T09:10:05.425088+0000","last_peered":"2024-04-25T09:10:05.425088+0000","last_clean":"2024-04-25T09:10:05.425088+0000","last_became_active":"2024-04-25T09:10:04.452567+0000","last_became_peered":"2024-04-25T09:10:04.452567+0000","last_unstale":"2024-04-25T09:10:05.425088+0000","last_undegraded":"2024-04-25T09:10:05.425088+0000","last_fullsized":"2024-04-25T09:10:05.425088+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:21.240284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.947348+0000","last_change":"2024-04-25T09:10:04.432865+0000","last_active":"2024-04-25T09:10:05.947348+0000","last_peered":"2024-04-25T09:10:05.947348+0000","last_clean":"2024-04-25T09:10:05.947348+0000","last_became_active":"2024-04-25T09:10:04.432283+0000","last_became_peered":"2024-04-25T09:10:04.432283+0000","last_unstale":"2024-04-25T09:10:05.947348+0000","last_undegraded":"2024-04-25T09:10:05.947348+0000","last_fullsized":"2024-04-25T09:10:05.947348+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:28.599145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949406+0000","last_change":"2024-04-25T09:10:04.450123+0000","last_active":"2024-04-25T09:10:05.949406+0000","last_peered":"2024-04-25T09:10:05.949406+0000","last_clean":"2024-04-25T09:10:05.949406+0000","last_became_active":"2024-04-25T09:10:04.449765+0000","last_became_peered":"2024-04-25T09:10:04.449765+0000","last_unstale":"2024-04-25T09:10:05.949406+0000","last_undegraded":"2024-04-25T09:10:05.949406+0000","last_fullsized":"2024-04-25T09:10:05.949406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:05.392347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.950447+0000","last_change":"2024-04-25T09:10:04.456138+0000","last_active":"2024-04-25T09:10:05.950447+0000","last_peered":"2024-04-25T09:10:05.950447+0000","last_clean":"2024-04-25T09:10:05.950447+0000","last_became_active":"2024-04-25T09:10:04.455873+0000","last_became_peered":"2024-04-25T09:10:04.455873+0000","last_unstale":"2024-04-25T09:10:05.950447+0000","last_undegraded":"2024-04-25T09:10:05.950447+0000","last_fullsized":"2024-04-25T09:10:05.950447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:02.096352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.425350+0000","last_change":"2024-04-25T09:10:04.449133+0000","last_active":"2024-04-25T09:10:05.425350+0000","last_peered":"2024-04-25T09:10:05.425350+0000","last_clean":"2024-04-25T09:10:05.425350+0000","last_became_active":"2024-04-25T09:10:04.448854+0000","last_became_peered":"2024-04-25T09:10:04.448854+0000","last_unstale":"2024-04-25T09:10:05.425350+0000","last_undegraded":"2024-04-25T09:10:05.425350+0000","last_fullsized":"2024-04-25T09:10:05.425350+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:25.111009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453917+0000","last_change":"2024-04-25T09:10:04.438872+0000","last_active":"2024-04-25T09:10:05.453917+0000","last_peered":"2024-04-25T09:10:05.453917+0000","last_clean":"2024-04-25T09:10:05.453917+0000","last_became_active":"2024-04-25T09:10:04.438546+0000","last_became_peered":"2024-04-25T09:10:04.438546+0000","last_unstale":"2024-04-25T09:10:05.453917+0000","last_undegraded":"2024-04-25T09:10:05.453917+0000","last_fullsized":"2024-04-25T09:10:05.453917+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:34.955952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.425229+0000","last_change":"2024-04-25T09:10:04.463973+0000","last_active":"2024-04-25T09:10:05.425229+0000","last_peered":"2024-04-25T09:10:05.425229+0000","last_clean":"2024-04-25T09:10:05.425229+0000","last_became_active":"2024-04-25T09:10:04.463228+0000","last_became_peered":"2024-04-25T09:10:04.463228+0000","last_unstale":"2024-04-25T09:10:05.425229+0000","last_undegraded":"2024-04-25T09:10:05.425229+0000","last_fullsized":"2024-04-25T09:10:05.425229+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:02.128113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.425280+0000","last_change":"2024-04-25T09:10:04.454896+0000","last_active":"2024-04-25T09:10:05.425280+0000","last_peered":"2024-04-25T09:10:05.425280+0000","last_clean":"2024-04-25T09:10:05.425280+0000","last_became_active":"2024-04-25T09:10:04.454644+0000","last_became_peered":"2024-04-25T09:10:04.454644+0000","last_unstale":"2024-04-25T09:10:05.425280+0000","last_undegraded":"2024-04-25T09:10:05.425280+0000","last_fullsized":"2024-04-25T09:10:05.425280+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:33.282954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450511+0000","last_change":"2024-04-25T09:10:04.452444+0000","last_active":"2024-04-25T09:10:05.450511+0000","last_peered":"2024-04-25T09:10:05.450511+0000","last_clean":"2024-04-25T09:10:05.450511+0000","last_became_active":"2024-04-25T09:10:04.452099+0000","last_became_peered":"2024-04-25T09:10:04.452099+0000","last_unstale":"2024-04-25T09:10:05.450511+0000","last_undegraded":"2024-04-25T09:10:05.450511+0000","last_fullsized":"2024-04-25T09:10:05.450511+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:27:48.687048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430195+0000","last_change":"2024-04-25T09:10:04.438561+0000","last_active":"2024-04-25T09:10:05.430195+0000","last_peered":"2024-04-25T09:10:05.430195+0000","last_clean":"2024-04-25T09:10:05.430195+0000","last_became_active":"2024-04-25T09:10:04.438239+0000","last_became_peered":"2024-04-25T09:10:04.438239+0000","last_unstale":"2024-04-25T09:10:05.430195+0000","last_undegraded":"2024-04-25T09:10:05.430195+0000","last_fullsized":"2024-04-25T09:10:05.430195+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:33.058609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.425000+0000","last_change":"2024-04-25T09:10:04.453565+0000","last_active":"2024-04-25T09:10:05.425000+0000","last_peered":"2024-04-25T09:10:05.425000+0000","last_clean":"2024-04-25T09:10:05.425000+0000","last_became_active":"2024-04-25T09:10:04.453206+0000","last_became_peered":"2024-04-25T09:10:04.453206+0000","last_unstale":"2024-04-25T09:10:05.425000+0000","last_undegraded":"2024-04-25T09:10:05.425000+0000","last_fullsized":"2024-04-25T09:10:05.425000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:53.567645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450868+0000","last_change":"2024-04-25T09:10:04.441468+0000","last_active":"2024-04-25T09:10:05.450868+0000","last_peered":"2024-04-25T09:10:05.450868+0000","last_clean":"2024-04-25T09:10:05.450868+0000","last_became_active":"2024-04-25T09:10:04.440827+0000","last_became_peered":"2024-04-25T09:10:04.440827+0000","last_unstale":"2024-04-25T09:10:05.450868+0000","last_undegraded":"2024-04-25T09:10:05.450868+0000","last_fullsized":"2024-04-25T09:10:05.450868+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:58:23.767027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430247+0000","last_change":"2024-04-25T09:10:04.446572+0000","last_active":"2024-04-25T09:10:05.430247+0000","last_peered":"2024-04-25T09:10:05.430247+0000","last_clean":"2024-04-25T09:10:05.430247+0000","last_became_active":"2024-04-25T09:10:04.446048+0000","last_became_peered":"2024-04-25T09:10:04.446048+0000","last_unstale":"2024-04-25T09:10:05.430247+0000","last_undegraded":"2024-04-25T09:10:05.430247+0000","last_fullsized":"2024-04-25T09:10:05.430247+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:33.101698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949958+0000","last_change":"2024-04-25T09:10:04.442803+0000","last_active":"2024-04-25T09:10:05.949958+0000","last_peered":"2024-04-25T09:10:05.949958+0000","last_clean":"2024-04-25T09:10:05.949958+0000","last_became_active":"2024-04-25T09:10:04.442511+0000","last_became_peered":"2024-04-25T09:10:04.442511+0000","last_unstale":"2024-04-25T09:10:05.949958+0000","last_undegraded":"2024-04-25T09:10:05.949958+0000","last_fullsized":"2024-04-25T09:10:05.949958+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:37.394114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430518+0000","last_change":"2024-04-25T09:10:04.444527+0000","last_active":"2024-04-25T09:10:05.430518+0000","last_peered":"2024-04-25T09:10:05.430518+0000","last_clean":"2024-04-25T09:10:05.430518+0000","last_became_active":"2024-04-25T09:10:04.444211+0000","last_became_peered":"2024-04-25T09:10:04.444211+0000","last_unstale":"2024-04-25T09:10:05.430518+0000","last_undegraded":"2024-04-25T09:10:05.430518+0000","last_fullsized":"2024-04-25T09:10:05.430518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:49.559960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450510+0000","last_change":"2024-04-25T09:10:04.438873+0000","last_active":"2024-04-25T09:10:05.450510+0000","last_peered":"2024-04-25T09:10:05.450510+0000","last_clean":"2024-04-25T09:10:05.450510+0000","last_became_active":"2024-04-25T09:10:04.438597+0000","last_became_peered":"2024-04-25T09:10:04.438597+0000","last_unstale":"2024-04-25T09:10:05.450510+0000","last_undegraded":"2024-04-25T09:10:05.450510+0000","last_fullsized":"2024-04-25T09:10:05.450510+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:27.453812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450519+0000","last_change":"2024-04-25T09:10:04.442121+0000","last_active":"2024-04-25T09:10:05.450519+0000","last_peered":"2024-04-25T09:10:05.450519+0000","last_clean":"2024-04-25T09:10:05.450519+0000","last_became_active":"2024-04-25T09:10:04.441807+0000","last_became_peered":"2024-04-25T09:10:04.441807+0000","last_unstale":"2024-04-25T09:10:05.450519+0000","last_undegraded":"2024-04-25T09:10:05.450519+0000","last_fullsized":"2024-04-25T09:10:05.450519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:30.709454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949329+0000","last_change":"2024-04-25T09:10:04.445701+0000","last_active":"2024-04-25T09:10:05.949329+0000","last_peered":"2024-04-25T09:10:05.949329+0000","last_clean":"2024-04-25T09:10:05.949329+0000","last_became_active":"2024-04-25T09:10:04.445257+0000","last_became_peered":"2024-04-25T09:10:04.445257+0000","last_unstale":"2024-04-25T09:10:05.949329+0000","last_undegraded":"2024-04-25T09:10:05.949329+0000","last_fullsized":"2024-04-25T09:10:05.949329+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:45.916188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.429608+0000","last_change":"2024-04-25T09:10:04.445089+0000","last_active":"2024-04-25T09:10:05.429608+0000","last_peered":"2024-04-25T09:10:05.429608+0000","last_clean":"2024-04-25T09:10:05.429608+0000","last_became_active":"2024-04-25T09:10:04.442706+0000","last_became_peered":"2024-04-25T09:10:04.442706+0000","last_unstale":"2024-04-25T09:10:05.429608+0000","last_undegraded":"2024-04-25T09:10:05.429608+0000","last_fullsized":"2024-04-25T09:10:05.429608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:10.013964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.950264+0000","last_change":"2024-04-25T09:10:04.443693+0000","last_active":"2024-04-25T09:10:05.950264+0000","last_peered":"2024-04-25T09:10:05.950264+0000","last_clean":"2024-04-25T09:10:05.950264+0000","last_became_active":"2024-04-25T09:10:04.443381+0000","last_became_peered":"2024-04-25T09:10:04.443381+0000","last_unstale":"2024-04-25T09:10:05.950264+0000","last_undegraded":"2024-04-25T09:10:05.950264+0000","last_fullsized":"2024-04-25T09:10:05.950264+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:45.908313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"83'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430827+0000","last_change":"2024-04-25T09:10:03.436687+0000","last_active":"2024-04-25T09:10:05.430827+0000","last_peered":"2024-04-25T09:10:05.430827+0000","last_clean":"2024-04-25T09:10:05.430827+0000","last_became_active":"2024-04-25T09:10:03.436288+0000","last_became_peered":"2024-04-25T09:10:03.436288+0000","last_unstale":"2024-04-25T09:10:05.430827+0000","last_undegraded":"2024-04-25T09:10:05.430827+0000","last_fullsized":"2024-04-25T09:10:05.430827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:18.581402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430616+0000","last_change":"2024-04-25T09:10:04.449915+0000","last_active":"2024-04-25T09:10:05.430616+0000","last_peered":"2024-04-25T09:10:05.430616+0000","last_clean":"2024-04-25T09:10:05.430616+0000","last_became_active":"2024-04-25T09:10:04.447401+0000","last_became_peered":"2024-04-25T09:10:04.447401+0000","last_unstale":"2024-04-25T09:10:05.430616+0000","last_undegraded":"2024-04-25T09:10:05.430616+0000","last_fullsized":"2024-04-25T09:10:05.430616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:45.916188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.950338+0000","last_change":"2024-04-25T09:10:03.425410+0000","last_active":"2024-04-25T09:10:05.950338+0000","last_peered":"2024-04-25T09:10:05.950338+0000","last_clean":"2024-04-25T09:10:05.950338+0000","last_became_active":"2024-04-25T09:10:03.424751+0000","last_became_peered":"2024-04-25T09:10:03.424751+0000","last_unstale":"2024-04-25T09:10:05.950338+0000","last_undegraded":"2024-04-25T09:10:05.950338+0000","last_fullsized":"2024-04-25T09:10:05.950338+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:19.871387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430739+0000","last_change":"2024-04-25T09:10:04.444769+0000","last_active":"2024-04-25T09:10:05.430739+0000","last_peered":"2024-04-25T09:10:05.430739+0000","last_clean":"2024-04-25T09:10:05.430739+0000","last_became_active":"2024-04-25T09:10:04.441253+0000","last_became_peered":"2024-04-25T09:10:04.441253+0000","last_unstale":"2024-04-25T09:10:05.430739+0000","last_undegraded":"2024-04-25T09:10:05.430739+0000","last_fullsized":"2024-04-25T09:10:05.430739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:01.172241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453945+0000","last_change":"2024-04-25T09:10:03.431841+0000","last_active":"2024-04-25T09:10:05.453945+0000","last_peered":"2024-04-25T09:10:05.453945+0000","last_clean":"2024-04-25T09:10:05.453945+0000","last_became_active":"2024-04-25T09:10:03.431492+0000","last_became_peered":"2024-04-25T09:10:03.431492+0000","last_unstale":"2024-04-25T09:10:05.453945+0000","last_undegraded":"2024-04-25T09:10:05.453945+0000","last_fullsized":"2024-04-25T09:10:05.453945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:55.169506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430042+0000","last_change":"2024-04-25T09:10:04.449115+0000","last_active":"2024-04-25T09:10:05.430042+0000","last_peered":"2024-04-25T09:10:05.430042+0000","last_clean":"2024-04-25T09:10:05.430042+0000","last_became_active":"2024-04-25T09:10:04.448720+0000","last_became_peered":"2024-04-25T09:10:04.448720+0000","last_unstale":"2024-04-25T09:10:05.430042+0000","last_undegraded":"2024-04-25T09:10:05.430042+0000","last_fullsized":"2024-04-25T09:10:05.430042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:13.030329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453648+0000","last_change":"2024-04-25T09:10:03.432622+0000","last_active":"2024-04-25T09:10:05.453648+0000","last_peered":"2024-04-25T09:10:05.453648+0000","last_clean":"2024-04-25T09:10:05.453648+0000","last_became_active":"2024-04-25T09:10:03.432251+0000","last_became_peered":"2024-04-25T09:10:03.432251+0000","last_unstale":"2024-04-25T09:10:05.453648+0000","last_undegraded":"2024-04-25T09:10:05.453648+0000","last_fullsized":"2024-04-25T09:10:05.453648+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:32.030773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450677+0000","last_change":"2024-04-25T09:10:04.443662+0000","last_active":"2024-04-25T09:10:05.450677+0000","last_peered":"2024-04-25T09:10:05.450677+0000","last_clean":"2024-04-25T09:10:05.450677+0000","last_became_active":"2024-04-25T09:10:04.442394+0000","last_became_peered":"2024-04-25T09:10:04.442394+0000","last_unstale":"2024-04-25T09:10:05.450677+0000","last_undegraded":"2024-04-25T09:10:05.450677+0000","last_fullsized":"2024-04-25T09:10:05.450677+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:10.350630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949862+0000","last_change":"2024-04-25T09:10:03.436434+0000","last_active":"2024-04-25T09:10:05.949862+0000","last_peered":"2024-04-25T09:10:05.949862+0000","last_clean":"2024-04-25T09:10:05.949862+0000","last_became_active":"2024-04-25T09:10:03.436085+0000","last_became_peered":"2024-04-25T09:10:03.436085+0000","last_unstale":"2024-04-25T09:10:05.949862+0000","last_undegraded":"2024-04-25T09:10:05.949862+0000","last_fullsized":"2024-04-25T09:10:05.949862+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:07.725630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949806+0000","last_change":"2024-04-25T09:10:04.457099+0000","last_active":"2024-04-25T09:10:05.949806+0000","last_peered":"2024-04-25T09:10:05.949806+0000","last_clean":"2024-04-25T09:10:05.949806+0000","last_became_active":"2024-04-25T09:10:04.456707+0000","last_became_peered":"2024-04-25T09:10:04.456707+0000","last_unstale":"2024-04-25T09:10:05.949806+0000","last_undegraded":"2024-04-25T09:10:05.949806+0000","last_fullsized":"2024-04-25T09:10:05.949806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:37.645631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949474+0000","last_change":"2024-04-25T09:10:03.426428+0000","last_active":"2024-04-25T09:10:05.949474+0000","last_peered":"2024-04-25T09:10:05.949474+0000","last_clean":"2024-04-25T09:10:05.949474+0000","last_became_active":"2024-04-25T09:10:03.426068+0000","last_became_peered":"2024-04-25T09:10:03.426068+0000","last_unstale":"2024-04-25T09:10:05.949474+0000","last_undegraded":"2024-04-25T09:10:05.949474+0000","last_fullsized":"2024-04-25T09:10:05.949474+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:27:47.680883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.429616+0000","last_change":"2024-04-25T09:10:04.455684+0000","last_active":"2024-04-25T09:10:05.429616+0000","last_peered":"2024-04-25T09:10:05.429616+0000","last_clean":"2024-04-25T09:10:05.429616+0000","last_became_active":"2024-04-25T09:10:04.453288+0000","last_became_peered":"2024-04-25T09:10:04.453288+0000","last_unstale":"2024-04-25T09:10:05.429616+0000","last_undegraded":"2024-04-25T09:10:05.429616+0000","last_fullsized":"2024-04-25T09:10:05.429616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:27.742849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453415+0000","last_change":"2024-04-25T09:10:03.424024+0000","last_active":"2024-04-25T09:10:05.453415+0000","last_peered":"2024-04-25T09:10:05.453415+0000","last_clean":"2024-04-25T09:10:05.453415+0000","last_became_active":"2024-04-25T09:10:03.423750+0000","last_became_peered":"2024-04-25T09:10:03.423750+0000","last_unstale":"2024-04-25T09:10:05.453415+0000","last_undegraded":"2024-04-25T09:10:05.453415+0000","last_fullsized":"2024-04-25T09:10:05.453415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:55.449792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.947505+0000","last_change":"2024-04-25T09:10:04.433074+0000","last_active":"2024-04-25T09:10:05.947505+0000","last_peered":"2024-04-25T09:10:05.947505+0000","last_clean":"2024-04-25T09:10:05.947505+0000","last_became_active":"2024-04-25T09:10:04.432702+0000","last_became_peered":"2024-04-25T09:10:04.432702+0000","last_unstale":"2024-04-25T09:10:05.947505+0000","last_undegraded":"2024-04-25T09:10:05.947505+0000","last_fullsized":"2024-04-25T09:10:05.947505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:12.565200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450331+0000","last_change":"2024-04-25T09:10:03.432227+0000","last_active":"2024-04-25T09:10:05.450331+0000","last_peered":"2024-04-25T09:10:05.450331+0000","last_clean":"2024-04-25T09:10:05.450331+0000","last_became_active":"2024-04-25T09:10:03.431968+0000","last_became_peered":"2024-04-25T09:10:03.431968+0000","last_unstale":"2024-04-25T09:10:05.450331+0000","last_undegraded":"2024-04-25T09:10:05.450331+0000","last_fullsized":"2024-04-25T09:10:05.450331+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:40.420668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.947612+0000","last_change":"2024-04-25T09:10:04.440378+0000","last_active":"2024-04-25T09:10:05.947612+0000","last_peered":"2024-04-25T09:10:05.947612+0000","last_clean":"2024-04-25T09:10:05.947612+0000","last_became_active":"2024-04-25T09:10:04.440122+0000","last_became_peered":"2024-04-25T09:10:04.440122+0000","last_unstale":"2024-04-25T09:10:05.947612+0000","last_undegraded":"2024-04-25T09:10:05.947612+0000","last_fullsized":"2024-04-25T09:10:05.947612+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:34.591966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430965+0000","last_change":"2024-04-25T09:10:03.425949+0000","last_active":"2024-04-25T09:10:05.430965+0000","last_peered":"2024-04-25T09:10:05.430965+0000","last_clean":"2024-04-25T09:10:05.430965+0000","last_became_active":"2024-04-25T09:10:03.425634+0000","last_became_peered":"2024-04-25T09:10:03.425634+0000","last_unstale":"2024-04-25T09:10:05.430965+0000","last_undegraded":"2024-04-25T09:10:05.430965+0000","last_fullsized":"2024-04-25T09:10:05.430965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:12.647044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949894+0000","last_change":"2024-04-25T09:10:04.459624+0000","last_active":"2024-04-25T09:10:05.949894+0000","last_peered":"2024-04-25T09:10:05.949894+0000","last_clean":"2024-04-25T09:10:05.949894+0000","last_became_active":"2024-04-25T09:10:04.459168+0000","last_became_peered":"2024-04-25T09:10:04.459168+0000","last_unstale":"2024-04-25T09:10:05.949894+0000","last_undegraded":"2024-04-25T09:10:05.949894+0000","last_fullsized":"2024-04-25T09:10:05.949894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:45.908313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430536+0000","last_change":"2024-04-25T09:10:03.424690+0000","last_active":"2024-04-25T09:10:05.430536+0000","last_peered":"2024-04-25T09:10:05.430536+0000","last_clean":"2024-04-25T09:10:05.430536+0000","last_became_active":"2024-04-25T09:10:03.424277+0000","last_became_peered":"2024-04-25T09:10:03.424277+0000","last_unstale":"2024-04-25T09:10:05.430536+0000","last_undegraded":"2024-04-25T09:10:05.430536+0000","last_fullsized":"2024-04-25T09:10:05.430536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:10.907603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453723+0000","last_change":"2024-04-25T09:10:04.447880+0000","last_active":"2024-04-25T09:10:05.453723+0000","last_peered":"2024-04-25T09:10:05.453723+0000","last_clean":"2024-04-25T09:10:05.453723+0000","last_became_active":"2024-04-25T09:10:04.447632+0000","last_became_peered":"2024-04-25T09:10:04.447632+0000","last_unstale":"2024-04-25T09:10:05.453723+0000","last_undegraded":"2024-04-25T09:10:05.453723+0000","last_fullsized":"2024-04-25T09:10:05.453723+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:37.645631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"83'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430079+0000","last_change":"2024-04-25T09:10:03.434653+0000","last_active":"2024-04-25T09:10:05.430079+0000","last_peered":"2024-04-25T09:10:05.430079+0000","last_clean":"2024-04-25T09:10:05.430079+0000","last_became_active":"2024-04-25T09:10:03.434113+0000","last_became_peered":"2024-04-25T09:10:03.434113+0000","last_unstale":"2024-04-25T09:10:05.430079+0000","last_undegraded":"2024-04-25T09:10:05.430079+0000","last_fullsized":"2024-04-25T09:10:05.430079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:44.926620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.950189+0000","last_change":"2024-04-25T09:10:04.447064+0000","last_active":"2024-04-25T09:10:05.950189+0000","last_peered":"2024-04-25T09:10:05.950189+0000","last_clean":"2024-04-25T09:10:05.950189+0000","last_became_active":"2024-04-25T09:10:04.445717+0000","last_became_peered":"2024-04-25T09:10:04.445717+0000","last_unstale":"2024-04-25T09:10:05.950189+0000","last_undegraded":"2024-04-25T09:10:05.950189+0000","last_fullsized":"2024-04-25T09:10:05.950189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:34.955952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"83'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949667+0000","last_change":"2024-04-25T09:10:03.429618+0000","last_active":"2024-04-25T09:10:05.949667+0000","last_peered":"2024-04-25T09:10:05.949667+0000","last_clean":"2024-04-25T09:10:05.949667+0000","last_became_active":"2024-04-25T09:10:03.429366+0000","last_became_peered":"2024-04-25T09:10:03.429366+0000","last_unstale":"2024-04-25T09:10:05.949667+0000","last_undegraded":"2024-04-25T09:10:05.949667+0000","last_fullsized":"2024-04-25T09:10:05.949667+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:55.169506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453596+0000","last_change":"2024-04-25T09:10:04.450290+0000","last_active":"2024-04-25T09:10:05.453596+0000","last_peered":"2024-04-25T09:10:05.453596+0000","last_clean":"2024-04-25T09:10:05.453596+0000","last_became_active":"2024-04-25T09:10:04.444897+0000","last_became_peered":"2024-04-25T09:10:04.444897+0000","last_unstale":"2024-04-25T09:10:05.453596+0000","last_undegraded":"2024-04-25T09:10:05.453596+0000","last_fullsized":"2024-04-25T09:10:05.453596+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:01.172241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450511+0000","last_change":"2024-04-25T09:10:03.426587+0000","last_active":"2024-04-25T09:10:05.450511+0000","last_peered":"2024-04-25T09:10:05.450511+0000","last_clean":"2024-04-25T09:10:05.450511+0000","last_became_active":"2024-04-25T09:10:03.426256+0000","last_became_peered":"2024-04-25T09:10:03.426256+0000","last_unstale":"2024-04-25T09:10:05.450511+0000","last_undegraded":"2024-04-25T09:10:05.450511+0000","last_fullsized":"2024-04-25T09:10:05.450511+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:00.268343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430377+0000","last_change":"2024-04-25T09:10:04.462289+0000","last_active":"2024-04-25T09:10:05.430377+0000","last_peered":"2024-04-25T09:10:05.430377+0000","last_clean":"2024-04-25T09:10:05.430377+0000","last_became_active":"2024-04-25T09:10:04.461982+0000","last_became_peered":"2024-04-25T09:10:04.461982+0000","last_unstale":"2024-04-25T09:10:05.430377+0000","last_undegraded":"2024-04-25T09:10:05.430377+0000","last_fullsized":"2024-04-25T09:10:05.430377+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:18.362576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.947510+0000","last_change":"2024-04-25T09:10:03.433995+0000","last_active":"2024-04-25T09:10:05.947510+0000","last_peered":"2024-04-25T09:10:05.947510+0000","last_clean":"2024-04-25T09:10:05.947510+0000","last_became_active":"2024-04-25T09:10:03.433660+0000","last_became_peered":"2024-04-25T09:10:03.433660+0000","last_unstale":"2024-04-25T09:10:05.947510+0000","last_undegraded":"2024-04-25T09:10:05.947510+0000","last_fullsized":"2024-04-25T09:10:05.947510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:39.050335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450289+0000","last_change":"2024-04-25T09:10:04.461685+0000","last_active":"2024-04-25T09:10:05.450289+0000","last_peered":"2024-04-25T09:10:05.450289+0000","last_clean":"2024-04-25T09:10:05.450289+0000","last_became_active":"2024-04-25T09:10:04.461209+0000","last_became_peered":"2024-04-25T09:10:04.461209+0000","last_unstale":"2024-04-25T09:10:05.450289+0000","last_undegraded":"2024-04-25T09:10:05.450289+0000","last_fullsized":"2024-04-25T09:10:05.450289+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:09.435934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949207+0000","last_change":"2024-04-25T09:10:03.426943+0000","last_active":"2024-04-25T09:10:05.949207+0000","last_peered":"2024-04-25T09:10:05.949207+0000","last_clean":"2024-04-25T09:10:05.949207+0000","last_became_active":"2024-04-25T09:10:03.426562+0000","last_became_peered":"2024-04-25T09:10:03.426562+0000","last_unstale":"2024-04-25T09:10:05.949207+0000","last_undegraded":"2024-04-25T09:10:05.949207+0000","last_fullsized":"2024-04-25T09:10:05.949207+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:55.449792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450279+0000","last_change":"2024-04-25T09:10:04.440386+0000","last_active":"2024-04-25T09:10:05.450279+0000","last_peered":"2024-04-25T09:10:05.450279+0000","last_clean":"2024-04-25T09:10:05.450279+0000","last_became_active":"2024-04-25T09:10:04.438483+0000","last_became_peered":"2024-04-25T09:10:04.438483+0000","last_unstale":"2024-04-25T09:10:05.450279+0000","last_undegraded":"2024-04-25T09:10:05.450279+0000","last_fullsized":"2024-04-25T09:10:05.450279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:13.653209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"83'8","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453413+0000","last_change":"2024-04-25T09:10:03.426287+0000","last_active":"2024-04-25T09:10:05.453413+0000","last_peered":"2024-04-25T09:10:05.453413+0000","last_clean":"2024-04-25T09:10:05.453413+0000","last_became_active":"2024-04-25T09:10:03.425786+0000","last_became_peered":"2024-04-25T09:10:03.425786+0000","last_unstale":"2024-04-25T09:10:05.453413+0000","last_undegraded":"2024-04-25T09:10:05.453413+0000","last_fullsized":"2024-04-25T09:10:05.453413+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:33.458045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.429905+0000","last_change":"2024-04-25T09:10:04.447220+0000","last_active":"2024-04-25T09:10:05.429905+0000","last_peered":"2024-04-25T09:10:05.429905+0000","last_clean":"2024-04-25T09:10:05.429905+0000","last_became_active":"2024-04-25T09:10:04.446947+0000","last_became_peered":"2024-04-25T09:10:04.446947+0000","last_unstale":"2024-04-25T09:10:05.429905+0000","last_undegraded":"2024-04-25T09:10:05.429905+0000","last_fullsized":"2024-04-25T09:10:05.429905+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:05:26.150596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.431061+0000","last_change":"2024-04-25T09:10:03.423715+0000","last_active":"2024-04-25T09:10:05.431061+0000","last_peered":"2024-04-25T09:10:05.431061+0000","last_clean":"2024-04-25T09:10:05.431061+0000","last_became_active":"2024-04-25T09:10:03.423426+0000","last_became_peered":"2024-04-25T09:10:03.423426+0000","last_unstale":"2024-04-25T09:10:05.431061+0000","last_undegraded":"2024-04-25T09:10:05.431061+0000","last_fullsized":"2024-04-25T09:10:05.431061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:08.429769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430772+0000","last_change":"2024-04-25T09:10:04.440206+0000","last_active":"2024-04-25T09:10:05.430772+0000","last_peered":"2024-04-25T09:10:05.430772+0000","last_clean":"2024-04-25T09:10:05.430772+0000","last_became_active":"2024-04-25T09:10:04.439902+0000","last_became_peered":"2024-04-25T09:10:04.439902+0000","last_unstale":"2024-04-25T09:10:05.430772+0000","last_undegraded":"2024-04-25T09:10:05.430772+0000","last_fullsized":"2024-04-25T09:10:05.430772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:37.645631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453824+0000","last_change":"2024-04-25T09:10:03.427380+0000","last_active":"2024-04-25T09:10:05.453824+0000","last_peered":"2024-04-25T09:10:05.453824+0000","last_clean":"2024-04-25T09:10:05.453824+0000","last_became_active":"2024-04-25T09:10:03.427112+0000","last_became_peered":"2024-04-25T09:10:03.427112+0000","last_unstale":"2024-04-25T09:10:05.453824+0000","last_undegraded":"2024-04-25T09:10:05.453824+0000","last_fullsized":"2024-04-25T09:10:05.453824+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:32.052444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.950255+0000","last_change":"2024-04-25T09:10:04.449882+0000","last_active":"2024-04-25T09:10:05.950255+0000","last_peered":"2024-04-25T09:10:05.950255+0000","last_clean":"2024-04-25T09:10:05.950255+0000","last_became_active":"2024-04-25T09:10:04.449501+0000","last_became_peered":"2024-04-25T09:10:04.449501+0000","last_unstale":"2024-04-25T09:10:05.950255+0000","last_undegraded":"2024-04-25T09:10:05.950255+0000","last_fullsized":"2024-04-25T09:10:05.950255+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:43.122093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453764+0000","last_change":"2024-04-25T09:10:03.423246+0000","last_active":"2024-04-25T09:10:05.453764+0000","last_peered":"2024-04-25T09:10:05.453764+0000","last_clean":"2024-04-25T09:10:05.453764+0000","last_became_active":"2024-04-25T09:10:03.422961+0000","last_became_peered":"2024-04-25T09:10:03.422961+0000","last_unstale":"2024-04-25T09:10:05.453764+0000","last_undegraded":"2024-04-25T09:10:05.453764+0000","last_fullsized":"2024-04-25T09:10:05.453764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:53:09.007800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.425118+0000","last_change":"2024-04-25T09:10:04.446242+0000","last_active":"2024-04-25T09:10:05.425118+0000","last_peered":"2024-04-25T09:10:05.425118+0000","last_clean":"2024-04-25T09:10:05.425118+0000","last_became_active":"2024-04-25T09:10:04.445468+0000","last_became_peered":"2024-04-25T09:10:04.445468+0000","last_unstale":"2024-04-25T09:10:05.425118+0000","last_undegraded":"2024-04-25T09:10:05.425118+0000","last_fullsized":"2024-04-25T09:10:05.425118+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:16.986227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.947471+0000","last_change":"2024-04-25T09:10:03.435208+0000","last_active":"2024-04-25T09:10:05.947471+0000","last_peered":"2024-04-25T09:10:05.947471+0000","last_clean":"2024-04-25T09:10:05.947471+0000","last_became_active":"2024-04-25T09:10:03.434912+0000","last_became_peered":"2024-04-25T09:10:03.434912+0000","last_unstale":"2024-04-25T09:10:05.947471+0000","last_undegraded":"2024-04-25T09:10:05.947471+0000","last_fullsized":"2024-04-25T09:10:05.947471+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:32.095533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949288+0000","last_change":"2024-04-25T09:10:04.441955+0000","last_active":"2024-04-25T09:10:05.949288+0000","last_peered":"2024-04-25T09:10:05.949288+0000","last_clean":"2024-04-25T09:10:05.949288+0000","last_became_active":"2024-04-25T09:10:04.441691+0000","last_became_peered":"2024-04-25T09:10:04.441691+0000","last_unstale":"2024-04-25T09:10:05.949288+0000","last_undegraded":"2024-04-25T09:10:05.949288+0000","last_fullsized":"2024-04-25T09:10:05.949288+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:05.392347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.425141+0000","last_change":"2024-04-25T09:10:03.431132+0000","last_active":"2024-04-25T09:10:05.425141+0000","last_peered":"2024-04-25T09:10:05.425141+0000","last_clean":"2024-04-25T09:10:05.425141+0000","last_became_active":"2024-04-25T09:10:03.430844+0000","last_became_peered":"2024-04-25T09:10:03.430844+0000","last_unstale":"2024-04-25T09:10:05.425141+0000","last_undegraded":"2024-04-25T09:10:05.425141+0000","last_fullsized":"2024-04-25T09:10:05.425141+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:46.757533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.424920+0000","last_change":"2024-04-25T09:10:04.445371+0000","last_active":"2024-04-25T09:10:05.424920+0000","last_peered":"2024-04-25T09:10:05.424920+0000","last_clean":"2024-04-25T09:10:05.424920+0000","last_became_active":"2024-04-25T09:10:04.444978+0000","last_became_peered":"2024-04-25T09:10:04.444978+0000","last_unstale":"2024-04-25T09:10:05.424920+0000","last_undegraded":"2024-04-25T09:10:05.424920+0000","last_fullsized":"2024-04-25T09:10:05.424920+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:23.444295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.424855+0000","last_change":"2024-04-25T09:10:03.431259+0000","last_active":"2024-04-25T09:10:05.424855+0000","last_peered":"2024-04-25T09:10:05.424855+0000","last_clean":"2024-04-25T09:10:05.424855+0000","last_became_active":"2024-04-25T09:10:03.430978+0000","last_became_peered":"2024-04-25T09:10:03.430978+0000","last_unstale":"2024-04-25T09:10:05.424855+0000","last_undegraded":"2024-04-25T09:10:05.424855+0000","last_fullsized":"2024-04-25T09:10:05.424855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:38.905836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949381+0000","last_change":"2024-04-25T09:10:04.454137+0000","last_active":"2024-04-25T09:10:05.949381+0000","last_peered":"2024-04-25T09:10:05.949381+0000","last_clean":"2024-04-25T09:10:05.949381+0000","last_became_active":"2024-04-25T09:10:04.453775+0000","last_became_peered":"2024-04-25T09:10:04.453775+0000","last_unstale":"2024-04-25T09:10:05.949381+0000","last_undegraded":"2024-04-25T09:10:05.949381+0000","last_fullsized":"2024-04-25T09:10:05.949381+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:37.645631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.947223+0000","last_change":"2024-04-25T09:10:03.430323+0000","last_active":"2024-04-25T09:10:05.947223+0000","last_peered":"2024-04-25T09:10:05.947223+0000","last_clean":"2024-04-25T09:10:05.947223+0000","last_became_active":"2024-04-25T09:10:03.430028+0000","last_became_peered":"2024-04-25T09:10:03.430028+0000","last_unstale":"2024-04-25T09:10:05.947223+0000","last_undegraded":"2024-04-25T09:10:05.947223+0000","last_fullsized":"2024-04-25T09:10:05.947223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:12.024164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.950347+0000","last_change":"2024-04-25T09:10:04.451333+0000","last_active":"2024-04-25T09:10:05.950347+0000","last_peered":"2024-04-25T09:10:05.950347+0000","last_clean":"2024-04-25T09:10:05.950347+0000","last_became_active":"2024-04-25T09:10:04.449717+0000","last_became_peered":"2024-04-25T09:10:04.449717+0000","last_unstale":"2024-04-25T09:10:05.950347+0000","last_undegraded":"2024-04-25T09:10:05.950347+0000","last_fullsized":"2024-04-25T09:10:05.950347+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:17.489189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"83'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450742+0000","last_change":"2024-04-25T09:10:03.433168+0000","last_active":"2024-04-25T09:10:05.450742+0000","last_peered":"2024-04-25T09:10:05.450742+0000","last_clean":"2024-04-25T09:10:05.450742+0000","last_became_active":"2024-04-25T09:10:03.430842+0000","last_became_peered":"2024-04-25T09:10:03.430842+0000","last_unstale":"2024-04-25T09:10:05.450742+0000","last_undegraded":"2024-04-25T09:10:05.450742+0000","last_fullsized":"2024-04-25T09:10:05.450742+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:46:41.109146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430073+0000","last_change":"2024-04-25T09:10:04.443494+0000","last_active":"2024-04-25T09:10:05.430073+0000","last_peered":"2024-04-25T09:10:05.430073+0000","last_clean":"2024-04-25T09:10:05.430073+0000","last_became_active":"2024-04-25T09:10:04.443200+0000","last_became_peered":"2024-04-25T09:10:04.443200+0000","last_unstale":"2024-04-25T09:10:05.430073+0000","last_undegraded":"2024-04-25T09:10:05.430073+0000","last_fullsized":"2024-04-25T09:10:05.430073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:40.056500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"84'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450939+0000","last_change":"2024-04-25T09:10:03.431136+0000","last_active":"2024-04-25T09:10:05.450939+0000","last_peered":"2024-04-25T09:10:05.450939+0000","last_clean":"2024-04-25T09:10:05.450939+0000","last_became_active":"2024-04-25T09:10:03.430829+0000","last_became_peered":"2024-04-25T09:10:03.430829+0000","last_unstale":"2024-04-25T09:10:05.450939+0000","last_undegraded":"2024-04-25T09:10:05.450939+0000","last_fullsized":"2024-04-25T09:10:05.450939+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:18.894715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430778+0000","last_change":"2024-04-25T09:10:04.454759+0000","last_active":"2024-04-25T09:10:05.430778+0000","last_peered":"2024-04-25T09:10:05.430778+0000","last_clean":"2024-04-25T09:10:05.430778+0000","last_became_active":"2024-04-25T09:10:04.451834+0000","last_became_peered":"2024-04-25T09:10:04.451834+0000","last_unstale":"2024-04-25T09:10:05.430778+0000","last_undegraded":"2024-04-25T09:10:05.430778+0000","last_fullsized":"2024-04-25T09:10:05.430778+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:37.394114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430030+0000","last_change":"2024-04-25T09:10:03.433850+0000","last_active":"2024-04-25T09:10:05.430030+0000","last_peered":"2024-04-25T09:10:05.430030+0000","last_clean":"2024-04-25T09:10:05.430030+0000","last_became_active":"2024-04-25T09:10:03.433570+0000","last_became_peered":"2024-04-25T09:10:03.433570+0000","last_unstale":"2024-04-25T09:10:05.430030+0000","last_undegraded":"2024-04-25T09:10:05.430030+0000","last_fullsized":"2024-04-25T09:10:05.430030+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:37:07.869866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.950417+0000","last_change":"2024-04-25T09:10:04.447482+0000","last_active":"2024-04-25T09:10:05.950417+0000","last_peered":"2024-04-25T09:10:05.950417+0000","last_clean":"2024-04-25T09:10:05.950417+0000","last_became_active":"2024-04-25T09:10:04.447161+0000","last_became_peered":"2024-04-25T09:10:04.447161+0000","last_unstale":"2024-04-25T09:10:05.950417+0000","last_undegraded":"2024-04-25T09:10:05.950417+0000","last_fullsized":"2024-04-25T09:10:05.950417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:06.710228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430800+0000","last_change":"2024-04-25T09:10:03.430873+0000","last_active":"2024-04-25T09:10:05.430800+0000","last_peered":"2024-04-25T09:10:05.430800+0000","last_clean":"2024-04-25T09:10:05.430800+0000","last_became_active":"2024-04-25T09:10:03.430420+0000","last_became_peered":"2024-04-25T09:10:03.430420+0000","last_unstale":"2024-04-25T09:10:05.430800+0000","last_undegraded":"2024-04-25T09:10:05.430800+0000","last_fullsized":"2024-04-25T09:10:05.430800+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:39:25.981518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949316+0000","last_change":"2024-04-25T09:10:04.444891+0000","last_active":"2024-04-25T09:10:05.949316+0000","last_peered":"2024-04-25T09:10:05.949316+0000","last_clean":"2024-04-25T09:10:05.949316+0000","last_became_active":"2024-04-25T09:10:04.444598+0000","last_became_peered":"2024-04-25T09:10:04.444598+0000","last_unstale":"2024-04-25T09:10:05.949316+0000","last_undegraded":"2024-04-25T09:10:05.949316+0000","last_fullsized":"2024-04-25T09:10:05.949316+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:01.172241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453648+0000","last_change":"2024-04-25T09:10:03.430280+0000","last_active":"2024-04-25T09:10:05.453648+0000","last_peered":"2024-04-25T09:10:05.453648+0000","last_clean":"2024-04-25T09:10:05.453648+0000","last_became_active":"2024-04-25T09:10:03.429859+0000","last_became_peered":"2024-04-25T09:10:03.429859+0000","last_unstale":"2024-04-25T09:10:05.453648+0000","last_undegraded":"2024-04-25T09:10:05.453648+0000","last_fullsized":"2024-04-25T09:10:05.453648+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:21.489427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.453741+0000","last_change":"2024-04-25T09:10:04.451045+0000","last_active":"2024-04-25T09:10:05.453741+0000","last_peered":"2024-04-25T09:10:05.453741+0000","last_clean":"2024-04-25T09:10:05.453741+0000","last_became_active":"2024-04-25T09:10:04.450587+0000","last_became_peered":"2024-04-25T09:10:04.450587+0000","last_unstale":"2024-04-25T09:10:05.453741+0000","last_undegraded":"2024-04-25T09:10:05.453741+0000","last_fullsized":"2024-04-25T09:10:05.453741+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:37.394114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949508+0000","last_change":"2024-04-25T09:10:03.426068+0000","last_active":"2024-04-25T09:10:05.949508+0000","last_peered":"2024-04-25T09:10:05.949508+0000","last_clean":"2024-04-25T09:10:05.949508+0000","last_became_active":"2024-04-25T09:10:03.425740+0000","last_became_peered":"2024-04-25T09:10:03.425740+0000","last_unstale":"2024-04-25T09:10:05.949508+0000","last_undegraded":"2024-04-25T09:10:05.949508+0000","last_fullsized":"2024-04-25T09:10:05.949508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:04:29.703290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.429766+0000","last_change":"2024-04-25T09:10:04.447696+0000","last_active":"2024-04-25T09:10:05.429766+0000","last_peered":"2024-04-25T09:10:05.429766+0000","last_clean":"2024-04-25T09:10:05.429766+0000","last_became_active":"2024-04-25T09:10:04.447311+0000","last_became_peered":"2024-04-25T09:10:04.447311+0000","last_unstale":"2024-04-25T09:10:05.429766+0000","last_undegraded":"2024-04-25T09:10:05.429766+0000","last_fullsized":"2024-04-25T09:10:05.429766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:12.746593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430484+0000","last_change":"2024-04-25T09:10:03.430837+0000","last_active":"2024-04-25T09:10:05.430484+0000","last_peered":"2024-04-25T09:10:05.430484+0000","last_clean":"2024-04-25T09:10:05.430484+0000","last_became_active":"2024-04-25T09:10:03.430496+0000","last_became_peered":"2024-04-25T09:10:03.430496+0000","last_unstale":"2024-04-25T09:10:05.430484+0000","last_undegraded":"2024-04-25T09:10:05.430484+0000","last_fullsized":"2024-04-25T09:10:05.430484+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:36.177094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430389+0000","last_change":"2024-04-25T09:10:04.444396+0000","last_active":"2024-04-25T09:10:05.430389+0000","last_peered":"2024-04-25T09:10:05.430389+0000","last_clean":"2024-04-25T09:10:05.430389+0000","last_became_active":"2024-04-25T09:10:04.444103+0000","last_became_peered":"2024-04-25T09:10:04.444103+0000","last_unstale":"2024-04-25T09:10:05.430389+0000","last_undegraded":"2024-04-25T09:10:05.430389+0000","last_fullsized":"2024-04-25T09:10:05.430389+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:33.036938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.949476+0000","last_change":"2024-04-25T09:10:03.417488+0000","last_active":"2024-04-25T09:10:05.949476+0000","last_peered":"2024-04-25T09:10:05.949476+0000","last_clean":"2024-04-25T09:10:05.949476+0000","last_became_active":"2024-04-25T09:10:03.417171+0000","last_became_peered":"2024-04-25T09:10:03.417171+0000","last_unstale":"2024-04-25T09:10:05.949476+0000","last_undegraded":"2024-04-25T09:10:05.949476+0000","last_fullsized":"2024-04-25T09:10:05.949476+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:09.344466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.450693+0000","last_change":"2024-04-25T09:10:04.440943+0000","last_active":"2024-04-25T09:10:05.450693+0000","last_peered":"2024-04-25T09:10:05.450693+0000","last_clean":"2024-04-25T09:10:05.450693+0000","last_became_active":"2024-04-25T09:10:04.439935+0000","last_became_peered":"2024-04-25T09:10:04.439935+0000","last_unstale":"2024-04-25T09:10:05.450693+0000","last_undegraded":"2024-04-25T09:10:05.450693+0000","last_fullsized":"2024-04-25T09:10:05.450693+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:03.399548+0000","last_clean_scrub_stamp":"2024-04-25T09:10:03.399548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:08.731795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.430096+0000","last_change":"2024-04-25T09:10:03.438063+0000","last_active":"2024-04-25T09:10:05.430096+0000","last_peered":"2024-04-25T09:10:05.430096+0000","last_clean":"2024-04-25T09:10:05.430096+0000","last_became_active":"2024-04-25T09:10:03.437736+0000","last_became_peered":"2024-04-25T09:10:03.437736+0000","last_unstale":"2024-04-25T09:10:05.430096+0000","last_undegraded":"2024-04-25T09:10:05.430096+0000","last_fullsized":"2024-04-25T09:10:05.430096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:02.393383+0000","last_clean_scrub_stamp":"2024-04-25T09:10:02.393383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:12:44.910024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":290,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-04-25T09:10:05.429787+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:10:05.429787+0000","last_peered":"2024-04-25T09:10:05.429787+0000","last_clean":"2024-04-25T09:10:05.429787+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:10:05.429787+0000","last_undegraded":"2024-04-25T09:10:05.429787+0000","last_fullsized":"2024-04-25T09:10:05.429787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574925,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1630208,"data_stored":1030991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1044480,"data_stored":441247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574924,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":442187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1032192,"data_stored":440553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1044480,"data_stored":442165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574926,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1036288,"data_stored":441135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1044480,"data_stored":440747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1630208,"data_stored":1030955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:10:08.858 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:10:08.858 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:10:09.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4bea600640 1 Processor -- start 2024-04-25T09:10:09.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4bea600640 1 -- start start 2024-04-25T09:10:09.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4bea600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4be4071510 0x7f4be40cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4bea600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be40cf7e0 con 0x7f4be4163490 2024-04-25T09:10:09.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4bea600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be40cc310 con 0x7f4be406dd90 2024-04-25T09:10:09.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4bea600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be40ccc40 con 0x7f4be4071510 2024-04-25T09:10:09.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4be3e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4be4163490 0x7f4be4165880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45484/0 (socket says 172.21.15.175:45484) 2024-04-25T09:10:09.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4be3e00640 1 -- 172.21.15.175:0/313981201 learned_addr learned my addr 172.21.15.175:0/313981201 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:10:09.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4be3400640 1 --2- 172.21.15.175:0/313981201 >> v2:172.21.15.177:3300/0 conn(0x7f4be4071510 0x7f4be40cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4be2000640 1 -- 172.21.15.175:0/313981201 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918564724 0 0) 0x7f4be40cf7e0 con 0x7f4be4163490 2024-04-25T09:10:09.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4be2000640 1 -- 172.21.15.175:0/313981201 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bc8003530 con 0x7f4be4163490 2024-04-25T09:10:09.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4be2000640 1 -- 172.21.15.175:0/313981201 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3757905193 0 0) 0x7f4bc8003530 con 0x7f4be4163490 2024-04-25T09:10:09.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4be2000640 1 -- 172.21.15.175:0/313981201 >> v2:172.21.15.177:3300/0 conn(0x7f4be4071510 msgr2=0x7f4be40cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:09.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4be2000640 1 --2- 172.21.15.175:0/313981201 >> v2:172.21.15.177:3300/0 conn(0x7f4be4071510 0x7f4be40cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4be2000640 1 -- 172.21.15.175:0/313981201 >> v1:172.21.15.177:6789/0 conn(0x7f4be406dd90 legacy=0x7f4be40718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4be2000640 1 -- 172.21.15.175:0/313981201 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be40cc5f0 con 0x7f4be4163490 2024-04-25T09:10:09.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4be2000640 1 -- 172.21.15.175:0/313981201 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f4bdc001680 con 0x7f4be4163490 2024-04-25T09:10:09.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4be2000640 1 -- 172.21.15.175:0/313981201 >> v1:172.21.15.175:6789/0 conn(0x7f4be4163490 legacy=0x7f4be4165880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4be2000640 1 --2- 172.21.15.175:0/313981201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bc80039c0 0x7f4bc8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4be2000640 1 --2- 172.21.15.175:0/313981201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bc80043c0 0x7f4bc8004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4be2000640 1 --2- 172.21.15.175:0/313981201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bc8005090 0x7f4bc800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4be2000640 1 -- 172.21.15.175:0/313981201 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be40ccc40 con 0x7f4bc80039c0 2024-04-25T09:10:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4be2000640 1 -- 172.21.15.175:0/313981201 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc800bff0 con 0x7f4bc80043c0 2024-04-25T09:10:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.055+0000 7f4be2000640 1 -- 172.21.15.175:0/313981201 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc800c1f0 con 0x7f4bc8005090 2024-04-25T09:10:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.059+0000 7f4be3400640 1 --2- 172.21.15.175:0/313981201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bc80039c0 0x7f4bc8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.059+0000 7f4be2a00640 1 --2- 172.21.15.175:0/313981201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bc80043c0 0x7f4bc8004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.059+0000 7f4be3e00640 1 --2- 172.21.15.175:0/313981201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bc8005090 0x7f4bc800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.059+0000 7f4be3400640 1 -- 172.21.15.175:0/313981201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bc8005090 msgr2=0x7f4bc800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.059+0000 7f4be3400640 1 --2- 172.21.15.175:0/313981201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4bc8005090 0x7f4bc800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.059+0000 7f4be3400640 1 -- 172.21.15.175:0/313981201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bc80043c0 msgr2=0x7f4bc8004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.059+0000 7f4be3400640 1 --2- 172.21.15.175:0/313981201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bc80043c0 0x7f4bc8004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.059+0000 7f4be3400640 1 -- 172.21.15.175:0/313981201 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc8003530 con 0x7f4bc80039c0 2024-04-25T09:10:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.059+0000 7f4be2a00640 1 --2- 172.21.15.175:0/313981201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bc80043c0 0x7f4bc8004890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:09.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.059+0000 7f4be3e00640 1 -- 172.21.15.175:0/313981201 reap_dead start 2024-04-25T09:10:09.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.059+0000 7f4be3400640 1 --2- 172.21.15.175:0/313981201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bc80039c0 0x7f4bc8003da0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009fc0 tx=0x7f4bd401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07ed9dcee29d31d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.059+0000 7f4be2000640 1 -- 172.21.15.175:0/313981201 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd40b2070 con 0x7f4bc80039c0 2024-04-25T09:10:09.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.059+0000 7f4be2000640 1 -- 172.21.15.175:0/313981201 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd40a5c90 con 0x7f4bc80039c0 2024-04-25T09:10:09.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.059+0000 7f4be2000640 1 -- 172.21.15.175:0/313981201 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4009c10 con 0x7f4bc80039c0 2024-04-25T09:10:09.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.059+0000 7f4bea600640 1 -- 172.21.15.175:0/313981201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bc80039c0 msgr2=0x7f4bc8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.059+0000 7f4bea600640 1 --2- 172.21.15.175:0/313981201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bc80039c0 0x7f4bc8003da0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4009fc0 tx=0x7f4bd401cc80 comp rx=0 tx=0).stop 2024-04-25T09:10:09.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4bea600640 1 -- 172.21.15.175:0/313981201 shutdown_connections 2024-04-25T09:10:09.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4bea600640 1 --2- 172.21.15.175:0/313981201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4bc80039c0 0x7f4bc8003da0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4bea600640 1 -- 172.21.15.175:0/313981201 >> 172.21.15.175:0/313981201 conn(0x7f4be406ac50 msgr2=0x7f4be406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:09.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4bea600640 1 -- 172.21.15.175:0/313981201 shutdown_connections 2024-04-25T09:10:09.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4bea600640 1 -- 172.21.15.175:0/313981201 wait complete. 2024-04-25T09:10:09.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4bea600640 1 Processor -- start 2024-04-25T09:10:09.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4bea600640 1 -- start start 2024-04-25T09:10:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4bea600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bc80039c0 0x7f4be413dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4bea600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4be414fab0 0x7f4be413b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4bea600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4be413bd20 0x7f4be4138690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4bea600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be406e210 con 0x7f4be413bd20 2024-04-25T09:10:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4bea600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be40cd0d0 con 0x7f4bc80039c0 2024-04-25T09:10:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4bea600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be413e100 con 0x7f4be414fab0 2024-04-25T09:10:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4be3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4be413bd20 0x7f4be4138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4be3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4be413bd20 0x7f4be4138690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54742/0 (socket says 172.21.15.175:54742) 2024-04-25T09:10:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4be3e00640 1 -- 172.21.15.175:0/3794092256 learned_addr learned my addr 172.21.15.175:0/3794092256 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:09.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4be3400640 1 --2- 172.21.15.175:0/3794092256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bc80039c0 0x7f4be413dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4be2a00640 1 --2- 172.21.15.175:0/3794092256 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4be414fab0 0x7f4be413b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4be3e00640 1 -- 172.21.15.175:0/3794092256 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4be414fab0 msgr2=0x7f4be413b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4be3e00640 1 --2- 172.21.15.175:0/3794092256 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4be414fab0 0x7f4be413b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4be3e00640 1 -- 172.21.15.175:0/3794092256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bc80039c0 msgr2=0x7f4be413dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4be3e00640 1 --2- 172.21.15.175:0/3794092256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bc80039c0 0x7f4be413dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4be3e00640 1 -- 172.21.15.175:0/3794092256 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be413cb20 con 0x7f4be413bd20 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.063+0000 7f4be3e00640 1 --2- 172.21.15.175:0/3794092256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4be413bd20 0x7f4be4138690 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f4be4072cc0 tx=0x7f4bdc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.067+0000 7f4bdb400640 1 -- 172.21.15.175:0/3794092256 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc019070 con 0x7f4be413bd20 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.067+0000 7f4bdb400640 1 -- 172.21.15.175:0/3794092256 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc00c610 con 0x7f4be413bd20 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.067+0000 7f4bdb400640 1 -- 172.21.15.175:0/3794092256 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc00c9e0 con 0x7f4be413bd20 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.067+0000 7f4bea600640 1 -- 172.21.15.175:0/3794092256 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be413ce00 con 0x7f4be413bd20 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.067+0000 7f4bea600640 1 -- 172.21.15.175:0/3794092256 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be413d3c0 con 0x7f4be413bd20 2024-04-25T09:10:09.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.067+0000 7f4bea600640 1 -- 172.21.15.175:0/3794092256 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be4074a60 con 0x7f4be413bd20 2024-04-25T09:10:09.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.067+0000 7f4bdb400640 1 -- 172.21.15.175:0/3794092256 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4bdc01c070 con 0x7f4be413bd20 2024-04-25T09:10:09.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.067+0000 7f4bdb400640 1 --2- 172.21.15.175:0/3794092256 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4bc4066f90 0x7f4bc4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.067+0000 7f4bdb400640 1 -- 172.21.15.175:0/3794092256 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4bdc0843f0 con 0x7f4be413bd20 2024-04-25T09:10:09.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.067+0000 7f4be3400640 1 --2- 172.21.15.175:0/3794092256 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4bc4066f90 0x7f4bc4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.067+0000 7f4be3400640 1 --2- 172.21.15.175:0/3794092256 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4bc4066f90 0x7f4bc4069450 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40af000 tx=0x7f4bd40a7040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.071+0000 7f4bdb400640 1 -- 172.21.15.175:0/3794092256 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4bdc054da0 con 0x7f4be413bd20 2024-04-25T09:10:09.121 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:10:09.124 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:10:09.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.283+0000 7f4bea600640 1 -- 172.21.15.175:0/3794092256 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4be40b40d0 con 0x7f4be413bd20 2024-04-25T09:10:09.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.283+0000 7f4bdb400640 1 -- 172.21.15.175:0/3794092256 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7f4bdc058e40 con 0x7f4be413bd20 2024-04-25T09:10:09.274 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2024-04-25T09:10:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBPHCpmhyCUBhAA8k9xLKIw8R04i6HSJykDfw== 2024-04-25T09:10:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: caps mds = "allow" 2024-04-25T09:10:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: caps mon = "allow r" 2024-04-25T09:10:09.275 INFO:teuthology.orchestra.run.smithi175.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:10:09.275 INFO:teuthology.orchestra.run.smithi175.stderr:updated caps for client.0 2024-04-25T09:10:09.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.287+0000 7f4bea600640 1 -- 172.21.15.175:0/3794092256 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4bc4066f90 msgr2=0x7f4bc4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.287+0000 7f4bea600640 1 --2- 172.21.15.175:0/3794092256 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4bc4066f90 0x7f4bc4069450 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40af000 tx=0x7f4bd40a7040 comp rx=0 tx=0).stop 2024-04-25T09:10:09.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.287+0000 7f4bea600640 1 -- 172.21.15.175:0/3794092256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4be413bd20 msgr2=0x7f4be4138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.287+0000 7f4bea600640 1 --2- 172.21.15.175:0/3794092256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4be413bd20 0x7f4be4138690 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f4be4072cc0 tx=0x7f4bdc00eb90 comp rx=0 tx=0).stop 2024-04-25T09:10:09.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.287+0000 7f4bea600640 1 -- 172.21.15.175:0/3794092256 shutdown_connections 2024-04-25T09:10:09.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.287+0000 7f4bea600640 1 --2- 172.21.15.175:0/3794092256 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4bc4066f90 0x7f4bc4069450 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.287+0000 7f4bea600640 1 --2- 172.21.15.175:0/3794092256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4be413bd20 0x7f4be4138690 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.287+0000 7f4bea600640 1 --2- 172.21.15.175:0/3794092256 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4be414fab0 0x7f4be413b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.287+0000 7f4bea600640 1 --2- 172.21.15.175:0/3794092256 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4bc80039c0 0x7f4be413dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.287+0000 7f4bea600640 1 -- 172.21.15.175:0/3794092256 >> 172.21.15.175:0/3794092256 conn(0x7f4be406ac50 msgr2=0x7f4be413fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:09.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.287+0000 7f4bea600640 1 -- 172.21.15.175:0/3794092256 shutdown_connections 2024-04-25T09:10:09.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.287+0000 7f4bea600640 1 -- 172.21.15.175:0/3794092256 wait complete. 2024-04-25T09:10:09.296 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:09.382 INFO:tasks.ceph.mds.c.smithi175.stderr:2024-04-25T09:10:09.391+0000 7f5461e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:10:09.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.443+0000 7f11c2000640 1 Processor -- start 2024-04-25T09:10:09.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.443+0000 7f11c2000640 1 -- start start 2024-04-25T09:10:09.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.443+0000 7f11c2000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc15b920 0x7f11bc0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.443+0000 7f11c2000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f11bc0cfc50 0x7f11bc0d13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.443+0000 7f11c2000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11bc0d0360 con 0x7f11bc15b540 2024-04-25T09:10:09.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.443+0000 7f11c2000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11bc0b15c0 con 0x7f11bc0cfc50 2024-04-25T09:10:09.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.443+0000 7f11c2000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc0b18a0 con 0x7f11bc15b920 2024-04-25T09:10:09.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.443+0000 7f11c1600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f11bc0cfc50 0x7f11bc0d13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.443+0000 7f11c1600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f11bc0cfc50 0x7f11bc0d13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35064/0 (socket says 172.21.15.175:35064) 2024-04-25T09:10:09.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.443+0000 7f11c1600640 1 -- 172.21.15.175:0/3225778170 learned_addr learned my addr 172.21.15.175:0/3225778170 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:09.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.443+0000 7f11bbe00640 1 --2- 172.21.15.175:0/3225778170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc15b920 0x7f11bc0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.443+0000 7f11c1600640 1 -- 172.21.15.175:0/3225778170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc15b920 msgr2=0x7f11bc0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:09.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.443+0000 7f11c1600640 1 --2- 172.21.15.175:0/3225778170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc15b920 0x7f11bc0cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.443+0000 7f11c1600640 1 -- 172.21.15.175:0/3225778170 >> v1:172.21.15.177:6789/0 conn(0x7f11bc15b540 legacy=0x7f11bc0b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.443+0000 7f11c1600640 1 -- 172.21.15.175:0/3225778170 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc0b1b80 con 0x7f11bc0cfc50 2024-04-25T09:10:09.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.447+0000 7f11c1600640 1 --2- 172.21.15.175:0/3225778170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11bc0cfc50 0x7f11bc0d13e0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009e50 tx=0x7f11b401d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd4b5d54c8ca8c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.447+0000 7f11bb400640 1 -- 172.21.15.175:0/3225778170 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b40a58f0 con 0x7f11bc0cfc50 2024-04-25T09:10:09.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.447+0000 7f11bb400640 1 -- 172.21.15.175:0/3225778170 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b40a5a90 con 0x7f11bc0cfc50 2024-04-25T09:10:09.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.447+0000 7f11bb400640 1 -- 172.21.15.175:0/3225778170 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b40a5e60 con 0x7f11bc0cfc50 2024-04-25T09:10:09.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.447+0000 7f11c2000640 1 -- 172.21.15.175:0/3225778170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11bc0cfc50 msgr2=0x7f11bc0d13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.447+0000 7f11c2000640 1 --2- 172.21.15.175:0/3225778170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11bc0cfc50 0x7f11bc0d13e0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009e50 tx=0x7f11b401d460 comp rx=0 tx=0).stop 2024-04-25T09:10:09.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.447+0000 7f11c2000640 1 -- 172.21.15.175:0/3225778170 shutdown_connections 2024-04-25T09:10:09.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.447+0000 7f11c2000640 1 --2- 172.21.15.175:0/3225778170 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11bc0cfc50 0x7f11bc0d13e0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.447+0000 7f11c2000640 1 --2- 172.21.15.175:0/3225778170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc15b920 0x7f11bc0cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.447+0000 7f11c2000640 1 -- 172.21.15.175:0/3225778170 >> 172.21.15.175:0/3225778170 conn(0x7f11bc08afe0 msgr2=0x7f11bc08b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:09.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.447+0000 7f11c2000640 1 -- 172.21.15.175:0/3225778170 shutdown_connections 2024-04-25T09:10:09.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.447+0000 7f11c2000640 1 -- 172.21.15.175:0/3225778170 wait complete. 2024-04-25T09:10:09.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c2000640 1 Processor -- start 2024-04-25T09:10:09.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c2000640 1 -- start start 2024-04-25T09:10:09.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c2000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11bc0cfc50 0x7f11bc15a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c2000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc15b540 0x7f11bc159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c2000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11bc15b920 0x7f11bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c2000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc0ccba0 con 0x7f11bc15b920 2024-04-25T09:10:09.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c2000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc0cca20 con 0x7f11bc0cfc50 2024-04-25T09:10:09.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c2000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc0ccd20 con 0x7f11bc15b540 2024-04-25T09:10:09.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c1600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11bc15b920 0x7f11bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c1600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11bc15b920 0x7f11bc06d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35080/0 (socket says 172.21.15.175:35080) 2024-04-25T09:10:09.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c1600640 1 -- 172.21.15.175:0/393671153 learned_addr learned my addr 172.21.15.175:0/393671153 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:09.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11bbe00640 1 --2- 172.21.15.175:0/393671153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc15b540 0x7f11bc159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c0c00640 1 --2- 172.21.15.175:0/393671153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11bc0cfc50 0x7f11bc15a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c1600640 1 -- 172.21.15.175:0/393671153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc15b540 msgr2=0x7f11bc159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c1600640 1 --2- 172.21.15.175:0/393671153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc15b540 0x7f11bc159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c1600640 1 -- 172.21.15.175:0/393671153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11bc0cfc50 msgr2=0x7f11bc15a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c1600640 1 --2- 172.21.15.175:0/393671153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11bc0cfc50 0x7f11bc15a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c1600640 1 -- 172.21.15.175:0/393671153 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc163aa0 con 0x7f11bc15b920 2024-04-25T09:10:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c1600640 1 --2- 172.21.15.175:0/393671153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11bc15b920 0x7f11bc06d330 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f11b40af040 tx=0x7f11b40197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11b8c00640 1 -- 172.21.15.175:0/393671153 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b40bc020 con 0x7f11bc15b920 2024-04-25T09:10:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11b8c00640 1 -- 172.21.15.175:0/393671153 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b40b8470 con 0x7f11bc15b920 2024-04-25T09:10:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11b8c00640 1 -- 172.21.15.175:0/393671153 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b40a58f0 con 0x7f11bc15b920 2024-04-25T09:10:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c2000640 1 -- 172.21.15.175:0/393671153 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11bc0cb6f0 con 0x7f11bc15b920 2024-04-25T09:10:09.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.451+0000 7f11c2000640 1 -- 172.21.15.175:0/393671153 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11bc164110 con 0x7f11bc15b920 2024-04-25T09:10:09.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.455+0000 7f11c2000640 1 -- 172.21.15.175:0/393671153 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11bc074a60 con 0x7f11bc15b920 2024-04-25T09:10:09.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.455+0000 7f11b8c00640 1 -- 172.21.15.175:0/393671153 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f11b40bf020 con 0x7f11bc15b920 2024-04-25T09:10:09.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.455+0000 7f11b8c00640 1 --2- 172.21.15.175:0/393671153 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f119c066f60 0x7f119c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.455+0000 7f11b8c00640 1 -- 172.21.15.175:0/393671153 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11b4120460 con 0x7f11bc15b920 2024-04-25T09:10:09.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.455+0000 7f11c0c00640 1 --2- 172.21.15.175:0/393671153 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f119c066f60 0x7f119c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.455+0000 7f11c0c00640 1 --2- 172.21.15.175:0/393671153 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f119c066f60 0x7f119c069420 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f11bc15b2b0 tx=0x7f11b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.459+0000 7f11b8c00640 1 -- 172.21.15.175:0/393671153 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f11b40c6030 con 0x7f11bc15b920 2024-04-25T09:10:09.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.643+0000 7f11c2000640 1 -- 172.21.15.175:0/393671153 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11bc06e1e0 con 0x7f11bc15b920 2024-04-25T09:10:09.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.647+0000 7f11b8c00640 1 -- 172.21.15.175:0/393671153 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f11b4016620 con 0x7f11bc15b920 2024-04-25T09:10:09.635 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:10:09.635 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3229536012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3229536012},{"type":"v1","addr":"172.21.15.177:6834","nonce":3229536012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/222649735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":222649735},{"type":"v1","addr":"172.21.15.177:6835","nonce":222649735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2888989442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2888989442},{"type":"v1","addr":"172.21.15.175:6836","nonce":2888989442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:03.786939+0000","modified":"2024-04-25T09:10:06.815078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7215":{"gid":7215,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1755192276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1755192276},{"type":"v1","addr":"172.21.15.175:6837","nonce":1755192276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:10:09.635 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 58 2024-04-25T09:10:09.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.647+0000 7f11c2000640 1 -- 172.21.15.175:0/393671153 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f119c066f60 msgr2=0x7f119c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.647+0000 7f11c2000640 1 --2- 172.21.15.175:0/393671153 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f119c066f60 0x7f119c069420 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f11bc15b2b0 tx=0x7f11b0009040 comp rx=0 tx=0).stop 2024-04-25T09:10:09.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.647+0000 7f11c2000640 1 -- 172.21.15.175:0/393671153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11bc15b920 msgr2=0x7f11bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.647+0000 7f11c2000640 1 --2- 172.21.15.175:0/393671153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11bc15b920 0x7f11bc06d330 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f11b40af040 tx=0x7f11b40197a0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.647+0000 7f11c2000640 1 -- 172.21.15.175:0/393671153 shutdown_connections 2024-04-25T09:10:09.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.647+0000 7f11c2000640 1 --2- 172.21.15.175:0/393671153 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f119c066f60 0x7f119c069420 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.647+0000 7f11c2000640 1 --2- 172.21.15.175:0/393671153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11bc15b920 0x7f11bc06d330 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.647+0000 7f11c2000640 1 --2- 172.21.15.175:0/393671153 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f11bc15b540 0x7f11bc159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.647+0000 7f11c2000640 1 --2- 172.21.15.175:0/393671153 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f11bc0cfc50 0x7f11bc15a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.647+0000 7f11c2000640 1 -- 172.21.15.175:0/393671153 >> 172.21.15.175:0/393671153 conn(0x7f11bc08afe0 msgr2=0x7f11bc0cf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:09.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.647+0000 7f11c2000640 1 -- 172.21.15.175:0/393671153 shutdown_connections 2024-04-25T09:10:09.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:09.647+0000 7f11c2000640 1 -- 172.21.15.175:0/393671153 wait complete. 2024-04-25T09:10:10.058 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:10:03.786939+0000', 'modified': '2024-04-25T09:10:06.815078+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7215}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7215': {'gid': 7215, 'name': 'c', 'rank': 0, 'incarnation': 55, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6837/1755192276', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6835', 'nonce': 1755192276}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 1755192276}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:10:10.058 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:10:10.058 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:10:10.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.207+0000 7f802b200640 1 Processor -- start 2024-04-25T09:10:10.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.207+0000 7f802b200640 1 -- start start 2024-04-25T09:10:10.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.207+0000 7f802b200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f80240cbe60 0x7f802415af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.207+0000 7f802b200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f802406d310 0x7f80240b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.207+0000 7f802b200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f80240b4630 0x7f80240b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.207+0000 7f802b200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802406db60 con 0x7f80240b4630 2024-04-25T09:10:10.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.207+0000 7f802b200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802406de40 con 0x7f80240cbe60 2024-04-25T09:10:10.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.207+0000 7f802b200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802406e120 con 0x7f802406d310 2024-04-25T09:10:10.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.207+0000 7f8029200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f80240b4630 0x7f80240b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.207+0000 7f8029200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f80240b4630 0x7f80240b2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35092/0 (socket says 172.21.15.175:35092) 2024-04-25T09:10:10.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.207+0000 7f8029200640 1 -- 172.21.15.175:0/3764468093 learned_addr learned my addr 172.21.15.175:0/3764468093 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:10.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f8023e00640 1 --2- 172.21.15.175:0/3764468093 >> v2:172.21.15.177:3300/0 conn(0x7f80240cbe60 0x7f802415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f8023400640 1 --2- 172.21.15.175:0/3764468093 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f802406d310 0x7f80240b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f8029200640 1 -- 172.21.15.175:0/3764468093 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f802406d310 msgr2=0x7f80240b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:10.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f8029200640 1 --2- 172.21.15.175:0/3764468093 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f802406d310 0x7f80240b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f8029200640 1 -- 172.21.15.175:0/3764468093 >> v2:172.21.15.177:3300/0 conn(0x7f80240cbe60 msgr2=0x7f802415af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:10.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f8029200640 1 --2- 172.21.15.175:0/3764468093 >> v2:172.21.15.177:3300/0 conn(0x7f80240cbe60 0x7f802415af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f8029200640 1 -- 172.21.15.175:0/3764468093 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802415c2f0 con 0x7f80240b4630 2024-04-25T09:10:10.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f8023400640 1 --2- 172.21.15.175:0/3764468093 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f802406d310 0x7f80240b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:10.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f8029200640 1 --2- 172.21.15.175:0/3764468093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80240b4630 0x7f80240b2660 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f80240b4d50 tx=0x7f801c01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b6fe5ee913e54e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f8022a00640 1 -- 172.21.15.175:0/3764468093 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c0b0070 con 0x7f80240b4630 2024-04-25T09:10:10.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f8022a00640 1 -- 172.21.15.175:0/3764468093 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c0ab600 con 0x7f80240b4630 2024-04-25T09:10:10.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f8022a00640 1 -- 172.21.15.175:0/3764468093 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c0ab9d0 con 0x7f80240b4630 2024-04-25T09:10:10.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f802b200640 1 -- 172.21.15.175:0/3764468093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80240b4630 msgr2=0x7f80240b2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f802b200640 1 --2- 172.21.15.175:0/3764468093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80240b4630 0x7f80240b2660 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f80240b4d50 tx=0x7f801c01c260 comp rx=0 tx=0).stop 2024-04-25T09:10:10.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f802b200640 1 -- 172.21.15.175:0/3764468093 shutdown_connections 2024-04-25T09:10:10.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f802b200640 1 --2- 172.21.15.175:0/3764468093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80240b4630 0x7f80240b2660 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f802b200640 1 --2- 172.21.15.175:0/3764468093 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f802406d310 0x7f80240b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f802b200640 1 --2- 172.21.15.175:0/3764468093 >> v2:172.21.15.177:3300/0 conn(0x7f80240cbe60 0x7f802415af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.211+0000 7f802b200640 1 -- 172.21.15.175:0/3764468093 >> 172.21.15.175:0/3764468093 conn(0x7f802406ac50 msgr2=0x7f802406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:10.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f802b200640 1 -- 172.21.15.175:0/3764468093 shutdown_connections 2024-04-25T09:10:10.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f802b200640 1 -- 172.21.15.175:0/3764468093 wait complete. 2024-04-25T09:10:10.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f802b200640 1 Processor -- start 2024-04-25T09:10:10.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f802b200640 1 -- start start 2024-04-25T09:10:10.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f802b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f802406d310 0x7f8024142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f802b200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80240b4630 0x7f80240cf190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f802b200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80240cbe60 0x7f80240ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f802b200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80240716a0 con 0x7f802406d310 2024-04-25T09:10:10.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f802b200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8024071520 con 0x7f80240cbe60 2024-04-25T09:10:10.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f802b200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8024071820 con 0x7f80240b4630 2024-04-25T09:10:10.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f8023e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f802406d310 0x7f8024142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f8023e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f802406d310 0x7f8024142120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35104/0 (socket says 172.21.15.175:35104) 2024-04-25T09:10:10.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f8023e00640 1 -- 172.21.15.175:0/80254348 learned_addr learned my addr 172.21.15.175:0/80254348 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:10.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f8023e00640 1 -- 172.21.15.175:0/80254348 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80240b4630 msgr2=0x7f80240cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f8023e00640 1 --2- 172.21.15.175:0/80254348 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80240b4630 0x7f80240cf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f8023e00640 1 -- 172.21.15.175:0/80254348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80240cbe60 msgr2=0x7f80240ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f8023e00640 1 --2- 172.21.15.175:0/80254348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80240cbe60 0x7f80240ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f8023e00640 1 -- 172.21.15.175:0/80254348 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80240acaa0 con 0x7f802406d310 2024-04-25T09:10:10.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f8023e00640 1 --2- 172.21.15.175:0/80254348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f802406d310 0x7f8024142120 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f801400efc0 tx=0x7f801400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f801be00640 1 -- 172.21.15.175:0/80254348 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014018020 con 0x7f802406d310 2024-04-25T09:10:10.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f801be00640 1 -- 172.21.15.175:0/80254348 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8014014480 con 0x7f802406d310 2024-04-25T09:10:10.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f801be00640 1 -- 172.21.15.175:0/80254348 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014014850 con 0x7f802406d310 2024-04-25T09:10:10.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f802b200640 1 -- 172.21.15.175:0/80254348 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80240acd80 con 0x7f802406d310 2024-04-25T09:10:10.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.215+0000 7f802b200640 1 -- 172.21.15.175:0/80254348 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8024142660 con 0x7f802406d310 2024-04-25T09:10:10.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.219+0000 7f801be00640 1 -- 172.21.15.175:0/80254348 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f801401b020 con 0x7f802406d310 2024-04-25T09:10:10.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.219+0000 7f801be00640 1 --2- 172.21.15.175:0/80254348 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8004066f90 0x7f8004069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.219+0000 7f801be00640 1 -- 172.21.15.175:0/80254348 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8014085b80 con 0x7f802406d310 2024-04-25T09:10:10.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.219+0000 7f8023400640 1 --2- 172.21.15.175:0/80254348 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8004066f90 0x7f8004069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.219+0000 7f802e68a000 1 Processor -- start 2024-04-25T09:10:10.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.219+0000 7f802e68a000 1 -- start start 2024-04-25T09:10:10.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.219+0000 7f8023400640 1 --2- 172.21.15.175:0/80254348 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8004066f90 0x7f8004069450 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8010006f10 tx=0x7f8010008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191a920 0x55686191ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191b240 0x5568618d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568618d0f30 0x5568618d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568617b85f0 con 0x55686191b240 2024-04-25T09:10:10.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686171fda0 con 0x55686191a920 2024-04-25T09:10:10.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568616a8150 con 0x5568618d0f30 2024-04-25T09:10:10.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f8023400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191b240 0x5568618d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f8023400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191b240 0x5568618d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35110/0 (socket says 172.21.15.175:35110) 2024-04-25T09:10:10.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f8023400640 1 -- 172.21.15.175:0/3957593250 learned_addr learned my addr 172.21.15.175:0/3957593250 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:10.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f8023e00640 1 --2- 172.21.15.175:0/3957593250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191a920 0x55686191ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f8029200640 1 --2- 172.21.15.175:0/3957593250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568618d0f30 0x5568618d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f8023400640 1 -- 172.21.15.175:0/3957593250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568618d0f30 msgr2=0x5568618d1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:10.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f8023400640 1 --2- 172.21.15.175:0/3957593250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568618d0f30 0x5568618d1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f8023400640 1 -- 172.21.15.175:0/3957593250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191a920 msgr2=0x55686191ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:10.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f8023400640 1 --2- 172.21.15.175:0/3957593250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191a920 0x55686191ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f8023400640 1 -- 172.21.15.175:0/3957593250 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568616c1ca0 con 0x55686191b240 2024-04-25T09:10:10.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f8029200640 1 --2- 172.21.15.175:0/3957593250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568618d0f30 0x5568618d1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:10.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f8023e00640 1 --2- 172.21.15.175:0/3957593250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191a920 0x55686191ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:10.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f8023400640 1 --2- 172.21.15.175:0/3957593250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191b240 0x5568618d09f0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f801000e810 tx=0x7f8010011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1954462e72467093 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f8018c00640 1 -- 172.21.15.175:0/3957593250 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8010025070 con 0x55686191b240 2024-04-25T09:10:10.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f8018c00640 1 -- 172.21.15.175:0/3957593250 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8010015640 con 0x55686191b240 2024-04-25T09:10:10.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f8018c00640 1 -- 172.21.15.175:0/3957593250 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801000f040 con 0x55686191b240 2024-04-25T09:10:10.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 -- 172.21.15.175:0/3957593250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191b240 msgr2=0x5568618d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 --2- 172.21.15.175:0/3957593250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191b240 0x5568618d09f0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f801000e810 tx=0x7f8010011000 comp rx=0 tx=0).stop 2024-04-25T09:10:10.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 -- 172.21.15.175:0/3957593250 shutdown_connections 2024-04-25T09:10:10.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 --2- 172.21.15.175:0/3957593250 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568618d0f30 0x5568618d1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 --2- 172.21.15.175:0/3957593250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191b240 0x5568618d09f0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 --2- 172.21.15.175:0/3957593250 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191a920 0x55686191ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 -- 172.21.15.175:0/3957593250 >> 172.21.15.175:0/3957593250 conn(0x5568618d72a0 msgr2=0x5568618cf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:10.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 -- 172.21.15.175:0/3957593250 shutdown_connections 2024-04-25T09:10:10.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 -- 172.21.15.175:0/3957593250 wait complete. 2024-04-25T09:10:10.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 -- start start 2024-04-25T09:10:10.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 Processor -- start 2024-04-25T09:10:10.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568618d0f30 0x556861921c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191a920 0x5568619221c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.223+0000 7f802e68a000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191b240 0x5568618d4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568616da990 con 0x55686191a920 2024-04-25T09:10:10.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55686171be40 con 0x55686191b240 2024-04-25T09:10:10.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568616ab900 con 0x5568618d0f30 2024-04-25T09:10:10.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 10 client.0 _ll_register_callbacks cb 0x5568617d31c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:10.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f8023400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191a920 0x5568619221c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f8023400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191a920 0x5568619221c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35112/0 (socket says 172.21.15.175:35112) 2024-04-25T09:10:10.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f8023400640 1 -- 172.21.15.175:0/1060645245 learned_addr learned my addr 172.21.15.175:0/1060645245 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:10.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f8023400640 1 -- 172.21.15.175:0/1060645245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568618d0f30 msgr2=0x556861921c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:10.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f8023400640 1 --2- 172.21.15.175:0/1060645245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568618d0f30 0x556861921c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f8023400640 1 -- 172.21.15.175:0/1060645245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191b240 msgr2=0x5568618d4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:10.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f8023400640 1 --2- 172.21.15.175:0/1060645245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191b240 0x5568618d4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f8023400640 1 -- 172.21.15.175:0/1060645245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568616d8630 con 0x55686191a920 2024-04-25T09:10:10.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f8023400640 1 --2- 172.21.15.175:0/1060645245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191a920 0x5568619221c0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f8010018040 tx=0x7f8010006e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c40a54dbf4817c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f800d600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:10:10.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f800d600640 1 -- 172.21.15.175:0/1060645245 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8010030060 con 0x55686191a920 2024-04-25T09:10:10.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 1 -- 172.21.15.175:0/1060645245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8010015640 con 0x55686191a920 2024-04-25T09:10:10.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f800d600640 1 -- 172.21.15.175:0/1060645245 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f801002b440 con 0x55686191a920 2024-04-25T09:10:10.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f800d600640 1 -- 172.21.15.175:0/1060645245 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8010036050 con 0x55686191a920 2024-04-25T09:10:10.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 10 client.7350 fetch_fsmap learned FSMap version 58 2024-04-25T09:10:10.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 1 -- 172.21.15.175:0/1060645245 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x5568616a83a0 con 0x55686191a920 2024-04-25T09:10:10.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f800d600640 1 -- 172.21.15.175:0/1060645245 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8010015640 con 0x55686191a920 2024-04-25T09:10:10.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f800d600640 1 -- 172.21.15.175:0/1060645245 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8010039020 con 0x55686191a920 2024-04-25T09:10:10.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 10 client.7350 fetch_fsmap finished waiting for FSMap version 58 2024-04-25T09:10:10.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 10 client.7350 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:10:10.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 20 client.7350 populate_metadata read hostname 'smithi175' 2024-04-25T09:10:10.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 1 --2- 172.21.15.175:0/1060645245 >> [v2:172.21.15.175:6835/1755192276,v1:172.21.15.175:6837/1755192276] conn(0x5568618d6160 0x55686192bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 4 client.7350 mds_command: new command op to 7215 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:10.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 1 -- 172.21.15.175:0/1060645245 --> [v2:172.21.15.175:6835/1755192276,v1:172.21.15.175:6837/1755192276] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568616bba50 con 0x5568618d6160 2024-04-25T09:10:10.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f8023e00640 1 --2- 172.21.15.175:0/1060645245 >> [v2:172.21.15.175:6835/1755192276,v1:172.21.15.175:6837/1755192276] conn(0x5568618d6160 0x55686192bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f8023e00640 1 --2- 172.21.15.175:0/1060645245 >> [v2:172.21.15.175:6835/1755192276,v1:172.21.15.175:6837/1755192276] conn(0x5568618d6160 0x55686192bce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac0286648383042e server_cookie=598fe7aa0726579b in_seq=0 out_seq=0 2024-04-25T09:10:10.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f800d600640 10 client.7350 ms_handle_connect on v2:172.21.15.175:6835/1755192276 2024-04-25T09:10:10.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f800d600640 1 -- 172.21.15.175:0/1060645245 <== mds.0 v2:172.21.15.175:6835/1755192276 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5568616bba50 con 0x5568618d6160 2024-04-25T09:10:10.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f800d600640 10 client.7350 handle_command_reply: tid=0 2024-04-25T09:10:10.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 1 client.7350 shutdown 2024-04-25T09:10:10.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 1 -- 172.21.15.175:0/1060645245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191a920 msgr2=0x5568619221c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 1 --2- 172.21.15.175:0/1060645245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191a920 0x5568619221c0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f8010018040 tx=0x7f8010006e00 comp rx=0 tx=0).stop 2024-04-25T09:10:10.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 1 -- 172.21.15.175:0/1060645245 shutdown_connections 2024-04-25T09:10:10.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 1 --2- 172.21.15.175:0/1060645245 >> [v2:172.21.15.175:6835/1755192276,v1:172.21.15.175:6837/1755192276] conn(0x5568618d6160 0x55686192bce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 1 --2- 172.21.15.175:0/1060645245 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191b240 0x5568618d4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 1 --2- 172.21.15.175:0/1060645245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191a920 0x5568619221c0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f800d600640 0 client.7350 ms_handle_reset on v2:172.21.15.175:6835/1755192276 2024-04-25T09:10:10.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 1 --2- 172.21.15.175:0/1060645245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568618d0f30 0x556861921c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 1 -- 172.21.15.175:0/1060645245 >> 172.21.15.175:0/1060645245 conn(0x5568618d72a0 msgr2=0x5568618cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:10.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 1 -- 172.21.15.175:0/1060645245 shutdown_connections 2024-04-25T09:10:10.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 1 -- 172.21.15.175:0/1060645245 wait complete. 2024-04-25T09:10:10.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.227+0000 7f802e68a000 20 client.7350 trim_cache size 0 max 16384 2024-04-25T09:10:10.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.243+0000 7f802e68a000 1 Processor -- start 2024-04-25T09:10:10.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.243+0000 7f802e68a000 1 -- start start 2024-04-25T09:10:10.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.243+0000 7f802e68a000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568618d0f30 0x5568618d42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.243+0000 7f802e68a000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191a920 0x5568618d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.243+0000 7f802e68a000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55686191b240 0x556861923710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.243+0000 7f802e68a000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8024202120 con 0x5568618d0f30 2024-04-25T09:10:10.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.243+0000 7f802e68a000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80240cdc60 con 0x55686191a920 2024-04-25T09:10:10.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.243+0000 7f802e68a000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80240ce260 con 0x55686191b240 2024-04-25T09:10:10.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f8023e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568618d0f30 0x5568618d42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f8023e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568618d0f30 0x5568618d42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35128/0 (socket says 172.21.15.175:35128) 2024-04-25T09:10:10.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f8023e00640 1 -- 172.21.15.175:0/2802097541 learned_addr learned my addr 172.21.15.175:0/2802097541 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:10.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f8023400640 1 --2- 172.21.15.175:0/2802097541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191a920 0x5568618d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f8023e00640 1 -- 172.21.15.175:0/2802097541 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55686191b240 msgr2=0x556861923710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:10.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f8023e00640 1 --2- 172.21.15.175:0/2802097541 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55686191b240 0x556861923710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f8023e00640 1 -- 172.21.15.175:0/2802097541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191a920 msgr2=0x5568618d4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:10.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f8023e00640 1 --2- 172.21.15.175:0/2802097541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191a920 0x5568618d4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f8023e00640 1 -- 172.21.15.175:0/2802097541 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55686191b070 con 0x5568618d0f30 2024-04-25T09:10:10.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f8023e00640 1 --2- 172.21.15.175:0/2802097541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568618d0f30 0x5568618d42c0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f80140562f0 tx=0x7f8014083ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7b046b8ed4a537 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f800fe00640 1 -- 172.21.15.175:0/2802097541 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014081070 con 0x5568618d0f30 2024-04-25T09:10:10.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f800fe00640 1 -- 172.21.15.175:0/2802097541 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801406f030 con 0x5568618d0f30 2024-04-25T09:10:10.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f800fe00640 1 -- 172.21.15.175:0/2802097541 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014054660 con 0x5568618d0f30 2024-04-25T09:10:10.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f802e68a000 1 -- 172.21.15.175:0/2802097541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568618d0f30 msgr2=0x5568618d42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f802e68a000 1 --2- 172.21.15.175:0/2802097541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568618d0f30 0x5568618d42c0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f80140562f0 tx=0x7f8014083ee0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f802e68a000 1 -- 172.21.15.175:0/2802097541 shutdown_connections 2024-04-25T09:10:10.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f802e68a000 1 --2- 172.21.15.175:0/2802097541 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55686191b240 0x556861923710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f802e68a000 1 --2- 172.21.15.175:0/2802097541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191a920 0x5568618d4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f802e68a000 1 --2- 172.21.15.175:0/2802097541 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5568618d0f30 0x5568618d42c0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f802e68a000 1 -- 172.21.15.175:0/2802097541 >> 172.21.15.175:0/2802097541 conn(0x5568618d72a0 msgr2=0x5568618d3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:10.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f802e68a000 1 -- 172.21.15.175:0/2802097541 shutdown_connections 2024-04-25T09:10:10.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f802e68a000 1 -- 172.21.15.175:0/2802097541 wait complete. 2024-04-25T09:10:10.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f802e68a000 1 -- start start 2024-04-25T09:10:10.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f802e68a000 1 Processor -- start 2024-04-25T09:10:10.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f802e68a000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568618d0f30 0x556861926d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f802e68a000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191a920 0x55686195e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f802e68a000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191b240 0x55686195e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f802e68a000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568617243d0 con 0x55686191a920 2024-04-25T09:10:10.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f802e68a000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568617dbd50 con 0x55686191b240 2024-04-25T09:10:10.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f802e68a000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5568616ba980 con 0x5568618d0f30 2024-04-25T09:10:10.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f802e68a000 10 client.0 _ll_register_callbacks cb 0x7f8010009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:10.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f8023400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191a920 0x55686195e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f8023e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568618d0f30 0x556861926d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f8023400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191a920 0x55686195e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35144/0 (socket says 172.21.15.175:35144) 2024-04-25T09:10:10.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f8023e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568618d0f30 0x556861926d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:33952/0 (socket says 172.21.15.175:33952) 2024-04-25T09:10:10.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f8023400640 1 -- 172.21.15.175:0/1574453636 learned_addr learned my addr 172.21.15.175:0/1574453636 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:10.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.247+0000 7f8029200640 1 --2- 172.21.15.175:0/1574453636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191b240 0x55686195e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f8023400640 1 -- 172.21.15.175:0/1574453636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568618d0f30 msgr2=0x556861926d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:10.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f8023400640 1 --2- 172.21.15.175:0/1574453636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568618d0f30 0x556861926d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f8023400640 1 -- 172.21.15.175:0/1574453636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191b240 msgr2=0x55686195e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:10.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f8023400640 1 --2- 172.21.15.175:0/1574453636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191b240 0x55686195e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f8023400640 1 -- 172.21.15.175:0/1574453636 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568617a1600 con 0x55686191a920 2024-04-25T09:10:10.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f8023400640 1 --2- 172.21.15.175:0/1574453636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191a920 0x55686195e3e0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f8010010010 tx=0x7f8010014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d24574ae52df268 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f800d600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:10:10.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f800d600640 1 -- 172.21.15.175:0/1574453636 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801003f060 con 0x55686191a920 2024-04-25T09:10:10.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f800d600640 1 -- 172.21.15.175:0/1574453636 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8010005ba0 con 0x55686191a920 2024-04-25T09:10:10.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 1 -- 172.21.15.175:0/1574453636 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f801406f030 con 0x55686191a920 2024-04-25T09:10:10.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f800d600640 1 -- 172.21.15.175:0/1574453636 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8010045050 con 0x55686191a920 2024-04-25T09:10:10.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 10 client.7356 fetch_fsmap learned FSMap version 58 2024-04-25T09:10:10.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 1 -- 172.21.15.175:0/1574453636 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x5568616b49b0 con 0x55686191a920 2024-04-25T09:10:10.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f800d600640 1 -- 172.21.15.175:0/1574453636 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801406f030 con 0x55686191a920 2024-04-25T09:10:10.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f800d600640 1 -- 172.21.15.175:0/1574453636 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 58) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8010048020 con 0x55686191a920 2024-04-25T09:10:10.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 10 client.7356 fetch_fsmap finished waiting for FSMap version 58 2024-04-25T09:10:10.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 10 client.7356 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:10:10.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 20 client.7356 populate_metadata read hostname 'smithi175' 2024-04-25T09:10:10.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 1 --2- 172.21.15.175:0/1574453636 >> [v2:172.21.15.175:6835/1755192276,v1:172.21.15.175:6837/1755192276] conn(0x5568618d6e60 0x55686195f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 4 client.7356 mds_command: new command op to 7215 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:10:10.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 1 -- 172.21.15.175:0/1574453636 --> [v2:172.21.15.175:6835/1755192276,v1:172.21.15.175:6837/1755192276] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55686172d2e0 con 0x5568618d6e60 2024-04-25T09:10:10.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f8023e00640 1 --2- 172.21.15.175:0/1574453636 >> [v2:172.21.15.175:6835/1755192276,v1:172.21.15.175:6837/1755192276] conn(0x5568618d6e60 0x55686195f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f800d600640 10 client.7356 ms_handle_connect on v2:172.21.15.175:6835/1755192276 2024-04-25T09:10:10.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f8023e00640 1 --2- 172.21.15.175:0/1574453636 >> [v2:172.21.15.175:6835/1755192276,v1:172.21.15.175:6837/1755192276] conn(0x5568618d6e60 0x55686195f230 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df3e6b8af916aca9 server_cookie=ba43633653425d81 in_seq=0 out_seq=0 2024-04-25T09:10:10.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f800d600640 1 -- 172.21.15.175:0/1574453636 <== mds.0 v2:172.21.15.175:6835/1755192276 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55686172d2e0 con 0x5568618d6e60 2024-04-25T09:10:10.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f800d600640 10 client.7356 handle_command_reply: tid=0 2024-04-25T09:10:10.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 1 client.7356 shutdown 2024-04-25T09:10:10.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 1 -- 172.21.15.175:0/1574453636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191a920 msgr2=0x55686195e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 1 --2- 172.21.15.175:0/1574453636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191a920 0x55686195e3e0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f8010010010 tx=0x7f8010014000 comp rx=0 tx=0).stop 2024-04-25T09:10:10.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 1 -- 172.21.15.175:0/1574453636 shutdown_connections 2024-04-25T09:10:10.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 1 --2- 172.21.15.175:0/1574453636 >> [v2:172.21.15.175:6835/1755192276,v1:172.21.15.175:6837/1755192276] conn(0x5568618d6e60 0x55686195f230 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 1 --2- 172.21.15.175:0/1574453636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55686191b240 0x55686195e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f800d600640 0 client.7356 ms_handle_reset on v2:172.21.15.175:6835/1755192276 2024-04-25T09:10:10.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 1 --2- 172.21.15.175:0/1574453636 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55686191a920 0x55686195e3e0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 1 --2- 172.21.15.175:0/1574453636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5568618d0f30 0x556861926d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 1 -- 172.21.15.175:0/1574453636 >> 172.21.15.175:0/1574453636 conn(0x5568618d72a0 msgr2=0x5568618d42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:10.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 1 -- 172.21.15.175:0/1574453636 shutdown_connections 2024-04-25T09:10:10.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 1 -- 172.21.15.175:0/1574453636 wait complete. 2024-04-25T09:10:10.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802e68a000 20 client.7356 trim_cache size 0 max 16384 2024-04-25T09:10:10.247 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:10:10.247 INFO:teuthology.orchestra.run.smithi175.stdout: "cluster_fsid": "8caed986-ca08-40e2-b5a5-12e2aade6223", 2024-04-25T09:10:10.247 INFO:teuthology.orchestra.run.smithi175.stdout: "whoami": 0, 2024-04-25T09:10:10.247 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 7215, 2024-04-25T09:10:10.247 INFO:teuthology.orchestra.run.smithi175.stdout: "want_state": "up:active", 2024-04-25T09:10:10.247 INFO:teuthology.orchestra.run.smithi175.stdout: "state": "up:active", 2024-04-25T09:10:10.247 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs", 2024-04-25T09:10:10.247 INFO:teuthology.orchestra.run.smithi175.stdout: "rank_uptime": 5.8164542519999998, 2024-04-25T09:10:10.247 INFO:teuthology.orchestra.run.smithi175.stdout: "mdsmap_epoch": 58, 2024-04-25T09:10:10.247 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch": 84, 2024-04-25T09:10:10.247 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch_barrier": 84, 2024-04-25T09:10:10.247 INFO:teuthology.orchestra.run.smithi175.stdout: "uptime": 11.659124017 2024-04-25T09:10:10.247 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:10:10.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802b200640 1 -- 172.21.15.175:0/80254348 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8004066f90 msgr2=0x7f8004069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802b200640 1 --2- 172.21.15.175:0/80254348 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8004066f90 0x7f8004069450 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8010006f10 tx=0x7f8010008040 comp rx=0 tx=0).stop 2024-04-25T09:10:10.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802b200640 1 -- 172.21.15.175:0/80254348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f802406d310 msgr2=0x7f8024142120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802b200640 1 --2- 172.21.15.175:0/80254348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f802406d310 0x7f8024142120 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f801400efc0 tx=0x7f801400c490 comp rx=0 tx=0).stop 2024-04-25T09:10:10.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802b200640 1 -- 172.21.15.175:0/80254348 shutdown_connections 2024-04-25T09:10:10.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802b200640 1 --2- 172.21.15.175:0/80254348 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8004066f90 0x7f8004069450 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802b200640 1 --2- 172.21.15.175:0/80254348 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f80240cbe60 0x7f80240ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802b200640 1 --2- 172.21.15.175:0/80254348 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f80240b4630 0x7f80240cf190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802b200640 1 --2- 172.21.15.175:0/80254348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f802406d310 0x7f8024142120 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802b200640 1 -- 172.21.15.175:0/80254348 >> 172.21.15.175:0/80254348 conn(0x7f802406ac50 msgr2=0x7f80240b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:10.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802b200640 1 -- 172.21.15.175:0/80254348 shutdown_connections 2024-04-25T09:10:10.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.251+0000 7f802b200640 1 -- 172.21.15.175:0/80254348 wait complete. 2024-04-25T09:10:10.261 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:10:10.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.407+0000 7fdee1600640 1 Processor -- start 2024-04-25T09:10:10.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.407+0000 7fdee1600640 1 -- start start 2024-04-25T09:10:10.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.407+0000 7fdee1600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdedc0cfc70 0x7fdedc06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.407+0000 7fdee1600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdedc0cda00 con 0x7fdedc0cd520 2024-04-25T09:10:10.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.407+0000 7fdee1600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdedc0cdce0 con 0x7fdedc15a900 2024-04-25T09:10:10.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.407+0000 7fdee1600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdedc15bcf0 con 0x7fdedc0cfc70 2024-04-25T09:10:10.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.411+0000 7fdedb400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdedc0cfc70 0x7fdedc06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.411+0000 7fdeda000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fdedc0cd520 0x7fdedc0cf560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:37716/0 (socket says 172.21.15.175:37716) 2024-04-25T09:10:10.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.411+0000 7fdeda000640 1 -- 172.21.15.175:0/2268177278 learned_addr learned my addr 172.21.15.175:0/2268177278 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:10:10.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.411+0000 7fdedb400640 1 -- 172.21.15.175:0/2268177278 >> v1:172.21.15.177:6789/0 conn(0x7fdedc15a900 legacy=0x7fdedc0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.411+0000 7fdedb400640 1 -- 172.21.15.175:0/2268177278 >> v1:172.21.15.175:6789/0 conn(0x7fdedc0cd520 legacy=0x7fdedc0cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.411+0000 7fdedb400640 1 -- 172.21.15.175:0/2268177278 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc0cdfc0 con 0x7fdedc0cfc70 2024-04-25T09:10:10.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.411+0000 7fdedb400640 1 --2- 172.21.15.175:0/2268177278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdedc0cfc70 0x7fdedc06e150 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fded40097c0 tx=0x7fded401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa188bed3ab5752c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.411+0000 7fded9600640 1 -- 172.21.15.175:0/2268177278 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded40b1070 con 0x7fdedc0cfc70 2024-04-25T09:10:10.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.411+0000 7fded9600640 1 -- 172.21.15.175:0/2268177278 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded40ac5f0 con 0x7fdedc0cfc70 2024-04-25T09:10:10.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.411+0000 7fded9600640 1 -- 172.21.15.175:0/2268177278 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded40ac9c0 con 0x7fdedc0cfc70 2024-04-25T09:10:10.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdee1600640 1 -- 172.21.15.175:0/2268177278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdedc0cfc70 msgr2=0x7fdedc06e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdee1600640 1 --2- 172.21.15.175:0/2268177278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdedc0cfc70 0x7fdedc06e150 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fded40097c0 tx=0x7fded401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdee1600640 1 -- 172.21.15.175:0/2268177278 shutdown_connections 2024-04-25T09:10:10.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdee1600640 1 --2- 172.21.15.175:0/2268177278 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdedc0cfc70 0x7fdedc06e150 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdee1600640 1 -- 172.21.15.175:0/2268177278 >> 172.21.15.175:0/2268177278 conn(0x7fdedc067150 msgr2=0x7fdedc06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:10.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdee1600640 1 -- 172.21.15.175:0/2268177278 shutdown_connections 2024-04-25T09:10:10.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdee1600640 1 -- 172.21.15.175:0/2268177278 wait complete. 2024-04-25T09:10:10.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdee1600640 1 Processor -- start 2024-04-25T09:10:10.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdee1600640 1 -- start start 2024-04-25T09:10:10.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdee1600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdedc0cfc70 0x7fdedc0b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdee1600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdedc15a900 0x7fdedc0b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdee1600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdedc13ac00 0x7fdedc13b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdee1600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc15c910 con 0x7fdedc15a900 2024-04-25T09:10:10.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdee1600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc15c790 con 0x7fdedc13ac00 2024-04-25T09:10:10.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdee1600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc168410 con 0x7fdedc0cfc70 2024-04-25T09:10:10.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdeda000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdedc15a900 0x7fdedc0b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdeda000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdedc15a900 0x7fdedc0b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35150/0 (socket says 172.21.15.175:35150) 2024-04-25T09:10:10.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdeda000640 1 -- 172.21.15.175:0/2920940569 learned_addr learned my addr 172.21.15.175:0/2920940569 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:10.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdedaa00640 1 --2- 172.21.15.175:0/2920940569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdedc0cfc70 0x7fdedc0b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdedb400640 1 --2- 172.21.15.175:0/2920940569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdedc13ac00 0x7fdedc13b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdeda000640 1 -- 172.21.15.175:0/2920940569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdedc0cfc70 msgr2=0x7fdedc0b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdeda000640 1 --2- 172.21.15.175:0/2920940569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdedc0cfc70 0x7fdedc0b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdeda000640 1 -- 172.21.15.175:0/2920940569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdedc13ac00 msgr2=0x7fdedc13b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdeda000640 1 --2- 172.21.15.175:0/2920940569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdedc13ac00 0x7fdedc13b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdeda000640 1 -- 172.21.15.175:0/2920940569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc0b1d20 con 0x7fdedc15a900 2024-04-25T09:10:10.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.415+0000 7fdedaa00640 1 --2- 172.21.15.175:0/2920940569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdedc0cfc70 0x7fdedc0b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:10.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.419+0000 7fdeda000640 1 --2- 172.21.15.175:0/2920940569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdedc15a900 0x7fdedc0b2fd0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fdec800c4d0 tx=0x7fdec800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.419+0000 7fded2a00640 1 -- 172.21.15.175:0/2920940569 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8017070 con 0x7fdedc15a900 2024-04-25T09:10:10.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.419+0000 7fded2a00640 1 -- 172.21.15.175:0/2920940569 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec8005cf0 con 0x7fdedc15a900 2024-04-25T09:10:10.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.419+0000 7fdee1600640 1 -- 172.21.15.175:0/2920940569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdedc13b7a0 con 0x7fdedc15a900 2024-04-25T09:10:10.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.419+0000 7fded2a00640 1 -- 172.21.15.175:0/2920940569 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8007270 con 0x7fdedc15a900 2024-04-25T09:10:10.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.419+0000 7fdee1600640 1 -- 172.21.15.175:0/2920940569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdedc0b0fe0 con 0x7fdedc15a900 2024-04-25T09:10:10.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.419+0000 7fdee1600640 1 -- 172.21.15.175:0/2920940569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdedc074a60 con 0x7fdedc15a900 2024-04-25T09:10:10.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.419+0000 7fded2a00640 1 -- 172.21.15.175:0/2920940569 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdec801a070 con 0x7fdedc15a900 2024-04-25T09:10:10.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.419+0000 7fded2a00640 1 --2- 172.21.15.175:0/2920940569 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdebc066f90 0x7fdebc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.419+0000 7fded2a00640 1 -- 172.21.15.175:0/2920940569 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdec80841a0 con 0x7fdedc15a900 2024-04-25T09:10:10.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.419+0000 7fdedaa00640 1 --2- 172.21.15.175:0/2920940569 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdebc066f90 0x7fdebc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.419+0000 7fdedaa00640 1 --2- 172.21.15.175:0/2920940569 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdebc066f90 0x7fdebc069450 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdecc001d70 tx=0x7fdecc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.423+0000 7fded2a00640 1 -- 172.21.15.175:0/2920940569 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdec8054b50 con 0x7fdedc15a900 2024-04-25T09:10:10.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.615+0000 7fdee1600640 1 -- 172.21.15.175:0/2920940569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdedc06c220 con 0x7fdedc15a900 2024-04-25T09:10:10.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.615+0000 7fded2a00640 1 -- 172.21.15.175:0/2920940569 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdec8058bf0 con 0x7fdedc15a900 2024-04-25T09:10:10.604 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:10:10.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.615+0000 7fdee1600640 1 -- 172.21.15.175:0/2920940569 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdebc066f90 msgr2=0x7fdebc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.615+0000 7fdee1600640 1 --2- 172.21.15.175:0/2920940569 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdebc066f90 0x7fdebc069450 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdecc001d70 tx=0x7fdecc009040 comp rx=0 tx=0).stop 2024-04-25T09:10:10.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.615+0000 7fdee1600640 1 -- 172.21.15.175:0/2920940569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdedc15a900 msgr2=0x7fdedc0b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.615+0000 7fdee1600640 1 --2- 172.21.15.175:0/2920940569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdedc15a900 0x7fdedc0b2fd0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fdec800c4d0 tx=0x7fdec800c990 comp rx=0 tx=0).stop 2024-04-25T09:10:10.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.615+0000 7fdee1600640 1 -- 172.21.15.175:0/2920940569 shutdown_connections 2024-04-25T09:10:10.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.615+0000 7fdee1600640 1 --2- 172.21.15.175:0/2920940569 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdebc066f90 0x7fdebc069450 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.615+0000 7fdee1600640 1 --2- 172.21.15.175:0/2920940569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdedc13ac00 0x7fdedc13b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.615+0000 7fdee1600640 1 --2- 172.21.15.175:0/2920940569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdedc15a900 0x7fdedc0b2fd0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.615+0000 7fdee1600640 1 --2- 172.21.15.175:0/2920940569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdedc0cfc70 0x7fdedc0b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.615+0000 7fdee1600640 1 -- 172.21.15.175:0/2920940569 >> 172.21.15.175:0/2920940569 conn(0x7fdedc0cd520 msgr2=0x7fdedc0cf540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:10.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.615+0000 7fdee1600640 1 -- 172.21.15.175:0/2920940569 shutdown_connections 2024-04-25T09:10:10.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:10.615+0000 7fdee1600640 1 -- 172.21.15.175:0/2920940569 wait complete. 2024-04-25T09:10:10.626 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:10:10.626 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:10:10.626 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-25T09:10:10.626 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:10:10.626 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:10.626 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:10:10.626 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:10:10.626 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:10:10.626 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:10:10.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:10.626 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-25T09:10:10.636 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:10:10.636 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:10:10.636 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:10:10.636 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:10.636 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:10:10.636 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:10.636 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:10:10.636 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:10.636 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-25T09:10:10.637 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:10:10.637 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:10.637 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-25T09:10:10.637 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:10:10.637 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:10.637 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:10:10.637 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:10.637 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:10:10.637 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42108sec preferred_lft 42108sec 2024-04-25T09:10:10.637 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-25T09:10:10.637 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:10.637 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:10:10.637 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:0d:71:4a:a6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:10.637 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:10:10.637 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:10.638 INFO:teuthology.orchestra.run.smithi175.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:10:10.638 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:10.638 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:10:10.638 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:10.638 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:10:10.638 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:10.638 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:10:10.638 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:10:10.638 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:10:10.638 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:10.638 INFO:teuthology.orchestra.run.smithi175.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:10:10.638 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:10:10.638 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:10:10.638 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:10.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:10.639 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:10:10.696 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:10:10.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:10.698 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-25T09:10:10.749 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-25T09:10:10.749 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:10:10.749 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:10:10.749 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:10:10.749 INFO:teuthology.orchestra.run.smithi175.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:10:10.749 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:10:10.750 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:10:10.750 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:10:10.750 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:10:10.750 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:10:10.750 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:10:10.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:10.750 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:10:10.750 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:10:10.750 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:10:10.750 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:10:10.751 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:10:10.751 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:10:10.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:10.839 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:10:10.848 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:10:10.848 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:10:10.848 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:10:10.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:10.849 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-25T09:10:10.909 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:10:10.909 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:10.962 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:10:10.962 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:10:10.962 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:11.009 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:10:11.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:11.010 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:11.097 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:11.097 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:10:11.097 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:10:11.112 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:11.112 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:10:11.112 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:10:11.112 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:10:11.113 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:10:11.121 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:11.121 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:10:11.121 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:10:11.121 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:10:11.121 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:10:11.121 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:10:11.121 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:10:11.121 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:10:11.125 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:10:11.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:11.125 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:11.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:11.144 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:10:11.201 INFO:teuthology.orchestra.run.smithi175.stdout:client7368 2024-04-25T09:10:11.202 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:10:11.202 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:11.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:11.250 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir) 2024-04-25T09:10:11.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:11.308 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir/file) 2024-04-25T09:10:11.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:11.360 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-04-25T09:10:11.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:11.413 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir/file testdir/hardlink) 2024-04-25T09:10:11.472 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:10:11.472 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:10:11.472 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:10:11.472 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:10:11.472 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir").st_ino) 2024-04-25T09:10:11.472 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:10:11.577 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627776 2024-04-25T09:10:11.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:10:11.586 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:10:11.586 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:11.639 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:10:11.639 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:11.694 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:11.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.879+0000 7ffac5600640 1 Processor -- start 2024-04-25T09:10:11.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.879+0000 7ffac5600640 1 -- start start 2024-04-25T09:10:11.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.883+0000 7ffac5600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffac0144fc0 0x7ffac00cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.883+0000 7ffac5600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffac015c5e0 0x7ffac00cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.883+0000 7ffac5600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac015cd00 con 0x7ffac01453a0 2024-04-25T09:10:11.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.883+0000 7ffac5600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac00ce660 con 0x7ffac0144fc0 2024-04-25T09:10:11.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.883+0000 7ffac5600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac00cc930 con 0x7ffac015c5e0 2024-04-25T09:10:11.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.883+0000 7ffabea00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffac0144fc0 0x7ffac00cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.883+0000 7ffabea00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffac0144fc0 0x7ffac00cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35156/0 (socket says 172.21.15.175:35156) 2024-04-25T09:10:11.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.883+0000 7ffabea00640 1 -- 172.21.15.175:0/1157625416 learned_addr learned my addr 172.21.15.175:0/1157625416 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:11.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.883+0000 7ffabf400640 1 --2- 172.21.15.175:0/1157625416 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffac015c5e0 0x7ffac00cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.883+0000 7ffabea00640 1 -- 172.21.15.175:0/1157625416 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffac015c5e0 msgr2=0x7ffac00cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:11.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.883+0000 7ffabea00640 1 --2- 172.21.15.175:0/1157625416 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffac015c5e0 0x7ffac00cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.883+0000 7ffabea00640 1 -- 172.21.15.175:0/1157625416 >> v1:172.21.15.177:6789/0 conn(0x7ffac01453a0 legacy=0x7ffac015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:11.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.883+0000 7ffabea00640 1 -- 172.21.15.175:0/1157625416 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac00ccc10 con 0x7ffac0144fc0 2024-04-25T09:10:11.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.883+0000 7ffabf400640 1 --2- 172.21.15.175:0/1157625416 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffac015c5e0 0x7ffac00cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:11.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.883+0000 7ffabea00640 1 --2- 172.21.15.175:0/1157625416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffac0144fc0 0x7ffac00cbe70 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009e80 tx=0x7ffab001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc08cbe97ae6cfc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:11.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffabd600640 1 -- 172.21.15.175:0/1157625416 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab00a5740 con 0x7ffac0144fc0 2024-04-25T09:10:11.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffabd600640 1 -- 172.21.15.175:0/1157625416 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab00a58e0 con 0x7ffac0144fc0 2024-04-25T09:10:11.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffabd600640 1 -- 172.21.15.175:0/1157625416 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab00a5cb0 con 0x7ffac0144fc0 2024-04-25T09:10:11.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffac5600640 1 -- 172.21.15.175:0/1157625416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffac0144fc0 msgr2=0x7ffac00cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffac5600640 1 --2- 172.21.15.175:0/1157625416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffac0144fc0 0x7ffac00cbe70 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7ffab0009e80 tx=0x7ffab001c9d0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffac5600640 1 -- 172.21.15.175:0/1157625416 shutdown_connections 2024-04-25T09:10:11.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffac5600640 1 --2- 172.21.15.175:0/1157625416 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffac015c5e0 0x7ffac00cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffac5600640 1 --2- 172.21.15.175:0/1157625416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffac0144fc0 0x7ffac00cbe70 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffac5600640 1 -- 172.21.15.175:0/1157625416 >> 172.21.15.175:0/1157625416 conn(0x7ffac0067150 msgr2=0x7ffac006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:11.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffac5600640 1 -- 172.21.15.175:0/1157625416 shutdown_connections 2024-04-25T09:10:11.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffac5600640 1 -- 172.21.15.175:0/1157625416 wait complete. 2024-04-25T09:10:11.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffac5600640 1 Processor -- start 2024-04-25T09:10:11.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffac5600640 1 -- start start 2024-04-25T09:10:11.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffac5600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffac01453a0 0x7ffac0157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffac5600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffac015c5e0 0x7ffac015d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffac5600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffac015dcf0 0x7ffac01585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffac5600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac00cff40 con 0x7ffac01453a0 2024-04-25T09:10:11.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffac5600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac00cfdc0 con 0x7ffac015dcf0 2024-04-25T09:10:11.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffac5600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac01685f0 con 0x7ffac015c5e0 2024-04-25T09:10:11.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffabea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffac01453a0 0x7ffac0157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffabea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffac01453a0 0x7ffac0157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35176/0 (socket says 172.21.15.175:35176) 2024-04-25T09:10:11.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.887+0000 7ffabea00640 1 -- 172.21.15.175:0/1845472002 learned_addr learned my addr 172.21.15.175:0/1845472002 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:11.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.891+0000 7ffabf400640 1 --2- 172.21.15.175:0/1845472002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffac015dcf0 0x7ffac01585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.891+0000 7ffabe000640 1 --2- 172.21.15.175:0/1845472002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffac015c5e0 0x7ffac015d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.891+0000 7ffabea00640 1 -- 172.21.15.175:0/1845472002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffac015c5e0 msgr2=0x7ffac015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.891+0000 7ffabea00640 1 --2- 172.21.15.175:0/1845472002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffac015c5e0 0x7ffac015d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.891+0000 7ffabea00640 1 -- 172.21.15.175:0/1845472002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffac015dcf0 msgr2=0x7ffac01585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.891+0000 7ffabea00640 1 --2- 172.21.15.175:0/1845472002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffac015dcf0 0x7ffac01585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.891+0000 7ffabea00640 1 -- 172.21.15.175:0/1845472002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac015e250 con 0x7ffac01453a0 2024-04-25T09:10:11.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.891+0000 7ffabf400640 1 --2- 172.21.15.175:0/1845472002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffac015dcf0 0x7ffac01585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:11.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.891+0000 7ffabea00640 1 --2- 172.21.15.175:0/1845472002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffac01453a0 0x7ffac0157890 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7ffab00af040 tx=0x7ffab0019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:11.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.891+0000 7ffab6a00640 1 -- 172.21.15.175:0/1845472002 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab00b8670 con 0x7ffac01453a0 2024-04-25T09:10:11.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.891+0000 7ffab6a00640 1 -- 172.21.15.175:0/1845472002 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab00be070 con 0x7ffac01453a0 2024-04-25T09:10:11.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.891+0000 7ffab6a00640 1 -- 172.21.15.175:0/1845472002 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab00b8a70 con 0x7ffac01453a0 2024-04-25T09:10:11.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.891+0000 7ffac5600640 1 -- 172.21.15.175:0/1845472002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac015e530 con 0x7ffac01453a0 2024-04-25T09:10:11.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.891+0000 7ffac5600640 1 -- 172.21.15.175:0/1845472002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac015eaf0 con 0x7ffac01453a0 2024-04-25T09:10:11.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.891+0000 7ffac5600640 1 -- 172.21.15.175:0/1845472002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac0074a60 con 0x7ffac01453a0 2024-04-25T09:10:11.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.891+0000 7ffab6a00640 1 -- 172.21.15.175:0/1845472002 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffab00b8c10 con 0x7ffac01453a0 2024-04-25T09:10:11.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.895+0000 7ffab6a00640 1 --2- 172.21.15.175:0/1845472002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffaa0066f60 0x7ffaa0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.895+0000 7ffab6a00640 1 -- 172.21.15.175:0/1845472002 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffab0120370 con 0x7ffac01453a0 2024-04-25T09:10:11.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.895+0000 7ffabe000640 1 --2- 172.21.15.175:0/1845472002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffaa0066f60 0x7ffaa0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.895+0000 7ffabe000640 1 --2- 172.21.15.175:0/1845472002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffaa0066f60 0x7ffaa0069420 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ffac01fa1c0 tx=0x7ffaac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:11.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:11.899+0000 7ffab6a00640 1 -- 172.21.15.175:0/1845472002 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffab00165c0 con 0x7ffac01453a0 2024-04-25T09:10:12.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.051+0000 7ffac5600640 1 -- 172.21.15.175:0/1845472002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffac00cbeb0 con 0x7ffac01453a0 2024-04-25T09:10:12.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.055+0000 7ffab6a00640 1 -- 172.21.15.175:0/1845472002 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16696 (secure 0 0 0) 0x7ffab00f12e0 con 0x7ffac01453a0 2024-04-25T09:10:12.044 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:10:12.044 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":84,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:10:05.420729+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:01.518283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:02.788015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:12.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.055+0000 7ffac5600640 1 -- 172.21.15.175:0/1845472002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffaa0066f60 msgr2=0x7ffaa0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.055+0000 7ffac5600640 1 --2- 172.21.15.175:0/1845472002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffaa0066f60 0x7ffaa0069420 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ffac01fa1c0 tx=0x7ffaac009040 comp rx=0 tx=0).stop 2024-04-25T09:10:12.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.055+0000 7ffac5600640 1 -- 172.21.15.175:0/1845472002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffac01453a0 msgr2=0x7ffac0157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.055+0000 7ffac5600640 1 --2- 172.21.15.175:0/1845472002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffac01453a0 0x7ffac0157890 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7ffab00af040 tx=0x7ffab0019770 comp rx=0 tx=0).stop 2024-04-25T09:10:12.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.055+0000 7ffac5600640 1 -- 172.21.15.175:0/1845472002 shutdown_connections 2024-04-25T09:10:12.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.055+0000 7ffac5600640 1 --2- 172.21.15.175:0/1845472002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ffaa0066f60 0x7ffaa0069420 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.055+0000 7ffac5600640 1 --2- 172.21.15.175:0/1845472002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffac015dcf0 0x7ffac01585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.055+0000 7ffac5600640 1 --2- 172.21.15.175:0/1845472002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffac015c5e0 0x7ffac015d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.055+0000 7ffac5600640 1 --2- 172.21.15.175:0/1845472002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffac01453a0 0x7ffac0157890 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.055+0000 7ffac5600640 1 -- 172.21.15.175:0/1845472002 >> 172.21.15.175:0/1845472002 conn(0x7ffac0144fc0 msgr2=0x7ffac013ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:12.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.055+0000 7ffac5600640 1 -- 172.21.15.175:0/1845472002 shutdown_connections 2024-04-25T09:10:12.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.055+0000 7ffac5600640 1 -- 172.21.15.175:0/1845472002 wait complete. 2024-04-25T09:10:12.064 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:10:01.518283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:10:02.788015+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:10:12.064 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:10:12.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.215+0000 7f8275400640 1 Processor -- start 2024-04-25T09:10:12.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.215+0000 7f8275400640 1 -- start start 2024-04-25T09:10:12.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.215+0000 7f8275400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f82700cbe60 0x7f827015af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.215+0000 7f8275400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f827006d310 0x7f82700b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.215+0000 7f8275400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f827006db60 con 0x7f82700b4630 2024-04-25T09:10:12.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.215+0000 7f8275400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f827006de40 con 0x7f82700cbe60 2024-04-25T09:10:12.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.215+0000 7f8275400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827006e120 con 0x7f827006d310 2024-04-25T09:10:12.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.215+0000 7f826e800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f82700cbe60 0x7f827015af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.215+0000 7f826e800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f82700cbe60 0x7f827015af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35182/0 (socket says 172.21.15.175:35182) 2024-04-25T09:10:12.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.215+0000 7f826e800640 1 -- 172.21.15.175:0/3530457477 learned_addr learned my addr 172.21.15.175:0/3530457477 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:12.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.215+0000 7f8265e00640 1 --2- 172.21.15.175:0/3530457477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f827006d310 0x7f82700b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.215+0000 7f826e800640 1 -- 172.21.15.175:0/3530457477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f827006d310 msgr2=0x7f82700b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:12.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.215+0000 7f826e800640 1 --2- 172.21.15.175:0/3530457477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f827006d310 0x7f82700b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.215+0000 7f826e800640 1 -- 172.21.15.175:0/3530457477 >> v1:172.21.15.177:6789/0 conn(0x7f82700b4630 legacy=0x7f82700b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.215+0000 7f826e800640 1 -- 172.21.15.175:0/3530457477 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827015c2f0 con 0x7f82700cbe60 2024-04-25T09:10:12.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.219+0000 7f826e800640 1 --2- 172.21.15.175:0/3530457477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82700cbe60 0x7f827015af20 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f826000d150 tx=0x7f826001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be008c573405a4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.219+0000 7f826de00640 1 -- 172.21.15.175:0/3530457477 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826000b2d0 con 0x7f82700cbe60 2024-04-25T09:10:12.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.219+0000 7f826de00640 1 -- 172.21.15.175:0/3530457477 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826000b470 con 0x7f82700cbe60 2024-04-25T09:10:12.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.219+0000 7f826de00640 1 -- 172.21.15.175:0/3530457477 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82600a7b20 con 0x7f82700cbe60 2024-04-25T09:10:12.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.219+0000 7f8275400640 1 -- 172.21.15.175:0/3530457477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82700cbe60 msgr2=0x7f827015af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.219+0000 7f8275400640 1 --2- 172.21.15.175:0/3530457477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82700cbe60 0x7f827015af20 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f826000d150 tx=0x7f826001ec30 comp rx=0 tx=0).stop 2024-04-25T09:10:12.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.219+0000 7f8275400640 1 -- 172.21.15.175:0/3530457477 shutdown_connections 2024-04-25T09:10:12.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.219+0000 7f8275400640 1 --2- 172.21.15.175:0/3530457477 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f827006d310 0x7f82700b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.219+0000 7f8275400640 1 --2- 172.21.15.175:0/3530457477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82700cbe60 0x7f827015af20 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.219+0000 7f8275400640 1 -- 172.21.15.175:0/3530457477 >> 172.21.15.175:0/3530457477 conn(0x7f827006ac50 msgr2=0x7f827006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:12.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.219+0000 7f8275400640 1 -- 172.21.15.175:0/3530457477 shutdown_connections 2024-04-25T09:10:12.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.219+0000 7f8275400640 1 -- 172.21.15.175:0/3530457477 wait complete. 2024-04-25T09:10:12.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.219+0000 7f8275400640 1 Processor -- start 2024-04-25T09:10:12.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f8275400640 1 -- start start 2024-04-25T09:10:12.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f8275400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f827006d310 0x7f827014c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f8275400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f82700b4630 0x7f82701537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f8275400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82700cbe60 0x7f82700cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f8275400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82700716e0 con 0x7f82700cbe60 2024-04-25T09:10:12.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f8275400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8270071560 con 0x7f827006d310 2024-04-25T09:10:12.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f8275400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8270071860 con 0x7f82700b4630 2024-04-25T09:10:12.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f826f200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82700cbe60 0x7f82700cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f826f200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82700cbe60 0x7f82700cc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35184/0 (socket says 172.21.15.175:35184) 2024-04-25T09:10:12.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f826f200640 1 -- 172.21.15.175:0/3931867322 learned_addr learned my addr 172.21.15.175:0/3931867322 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:12.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f8265e00640 1 --2- 172.21.15.175:0/3931867322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f82700b4630 0x7f82701537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f826e800640 1 --2- 172.21.15.175:0/3931867322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f827006d310 0x7f827014c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f826f200640 1 -- 172.21.15.175:0/3931867322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f82700b4630 msgr2=0x7f82701537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f826f200640 1 --2- 172.21.15.175:0/3931867322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f82700b4630 0x7f82701537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f826f200640 1 -- 172.21.15.175:0/3931867322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f827006d310 msgr2=0x7f827014c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f826f200640 1 --2- 172.21.15.175:0/3931867322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f827006d310 0x7f827014c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f826f200640 1 -- 172.21.15.175:0/3931867322 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8270157920 con 0x7f82700cbe60 2024-04-25T09:10:12.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f8265e00640 1 --2- 172.21.15.175:0/3931867322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f82700b4630 0x7f82701537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:12.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f826f200640 1 --2- 172.21.15.175:0/3931867322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82700cbe60 0x7f82700cc450 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f826800c430 tx=0x7f826800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f8267400640 1 -- 172.21.15.175:0/3931867322 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268005220 con 0x7f82700cbe60 2024-04-25T09:10:12.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f8267400640 1 -- 172.21.15.175:0/3931867322 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82680053c0 con 0x7f82700cbe60 2024-04-25T09:10:12.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f8267400640 1 -- 172.21.15.175:0/3931867322 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268007270 con 0x7f82700cbe60 2024-04-25T09:10:12.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f8275400640 1 -- 172.21.15.175:0/3931867322 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8270154e40 con 0x7f82700cbe60 2024-04-25T09:10:12.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f8275400640 1 -- 172.21.15.175:0/3931867322 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8270154880 con 0x7f82700cbe60 2024-04-25T09:10:12.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.223+0000 7f8275400640 1 -- 172.21.15.175:0/3931867322 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8270075160 con 0x7f82700cbe60 2024-04-25T09:10:12.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.227+0000 7f8267400640 1 -- 172.21.15.175:0/3931867322 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8268019020 con 0x7f82700cbe60 2024-04-25T09:10:12.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.227+0000 7f8267400640 1 --2- 172.21.15.175:0/3931867322 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f824c066f60 0x7f824c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.227+0000 7f8267400640 1 -- 172.21.15.175:0/3931867322 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82680843d0 con 0x7f82700cbe60 2024-04-25T09:10:12.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.227+0000 7f826e800640 1 --2- 172.21.15.175:0/3931867322 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f824c066f60 0x7f824c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.227+0000 7f826e800640 1 --2- 172.21.15.175:0/3931867322 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f824c066f60 0x7f824c069420 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f82600b0000 tx=0x7f82600a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.231+0000 7f8267400640 1 -- 172.21.15.175:0/3931867322 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8270157920 con 0x7f82700cbe60 2024-04-25T09:10:12.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.383+0000 7f8275400640 1 -- 172.21.15.175:0/3931867322 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8270072350 con 0x7f82700cbe60 2024-04-25T09:10:12.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.383+0000 7f8267400640 1 -- 172.21.15.175:0/3931867322 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8268055340 con 0x7f82700cbe60 2024-04-25T09:10:12.374 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:10:12.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.387+0000 7f8275400640 1 -- 172.21.15.175:0/3931867322 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f824c066f60 msgr2=0x7f824c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.387+0000 7f8275400640 1 --2- 172.21.15.175:0/3931867322 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f824c066f60 0x7f824c069420 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f82600b0000 tx=0x7f82600a9070 comp rx=0 tx=0).stop 2024-04-25T09:10:12.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.387+0000 7f8275400640 1 -- 172.21.15.175:0/3931867322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82700cbe60 msgr2=0x7f82700cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.387+0000 7f8275400640 1 --2- 172.21.15.175:0/3931867322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82700cbe60 0x7f82700cc450 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f826800c430 tx=0x7f826800c8f0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.387+0000 7f8275400640 1 -- 172.21.15.175:0/3931867322 shutdown_connections 2024-04-25T09:10:12.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.387+0000 7f8275400640 1 --2- 172.21.15.175:0/3931867322 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f824c066f60 0x7f824c069420 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.387+0000 7f8275400640 1 --2- 172.21.15.175:0/3931867322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82700cbe60 0x7f82700cc450 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.387+0000 7f8275400640 1 --2- 172.21.15.175:0/3931867322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f82700b4630 0x7f82701537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.387+0000 7f8275400640 1 --2- 172.21.15.175:0/3931867322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f827006d310 0x7f827014c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.387+0000 7f8275400640 1 -- 172.21.15.175:0/3931867322 >> 172.21.15.175:0/3931867322 conn(0x7f827006ac50 msgr2=0x7f82700b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:12.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.387+0000 7f8275400640 1 -- 172.21.15.175:0/3931867322 shutdown_connections 2024-04-25T09:10:12.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.387+0000 7f8275400640 1 -- 172.21.15.175:0/3931867322 wait complete. 2024-04-25T09:10:12.394 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:10:12.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.547+0000 7f1801e00640 1 Processor -- start 2024-04-25T09:10:12.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.547+0000 7f1801e00640 1 -- start start 2024-04-25T09:10:12.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.547+0000 7f1801e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17fc145250 0x7f17fc0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.547+0000 7f1801e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f17fc1600a0 0x7f17fc0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.547+0000 7f1801e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17fc0cfd10 con 0x7f17fc0ce970 2024-04-25T09:10:12.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.547+0000 7f1801e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17fc15f650 con 0x7f17fc1600a0 2024-04-25T09:10:12.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.547+0000 7f1801e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc0cfff0 con 0x7f17fc145250 2024-04-25T09:10:12.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.551+0000 7f17fa000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f17fc1600a0 0x7f17fc0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.551+0000 7f17fb400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f17fc0ce970 0x7f17fc0cee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:37730/0 (socket says 172.21.15.175:37730) 2024-04-25T09:10:12.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.551+0000 7f17fb400640 1 -- 172.21.15.175:0/853075518 learned_addr learned my addr 172.21.15.175:0/853075518 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:10:12.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.551+0000 7f17faa00640 1 --2- 172.21.15.175:0/853075518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17fc145250 0x7f17fc0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.551+0000 7f17fa000640 1 -- 172.21.15.175:0/853075518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17fc145250 msgr2=0x7f17fc0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:12.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.551+0000 7f17fa000640 1 --2- 172.21.15.175:0/853075518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17fc145250 0x7f17fc0cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.551+0000 7f17fa000640 1 -- 172.21.15.175:0/853075518 >> v1:172.21.15.175:6789/0 conn(0x7f17fc0ce970 legacy=0x7f17fc0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.551+0000 7f17fa000640 1 -- 172.21.15.175:0/853075518 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17fc15f8a0 con 0x7f17fc1600a0 2024-04-25T09:10:12.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.551+0000 7f17fa000640 1 --2- 172.21.15.175:0/853075518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17fc1600a0 0x7f17fc0cc410 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f17e80097c0 tx=0x7f17e801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742612538e63c605 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.551+0000 7f17f9600640 1 -- 172.21.15.175:0/853075518 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80ab600 con 0x7f17fc1600a0 2024-04-25T09:10:12.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.551+0000 7f17f9600640 1 -- 172.21.15.175:0/853075518 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e80b0070 con 0x7f17fc1600a0 2024-04-25T09:10:12.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.551+0000 7f17f9600640 1 -- 172.21.15.175:0/853075518 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80ab9c0 con 0x7f17fc1600a0 2024-04-25T09:10:12.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f1801e00640 1 -- 172.21.15.175:0/853075518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17fc1600a0 msgr2=0x7f17fc0cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f1801e00640 1 --2- 172.21.15.175:0/853075518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17fc1600a0 0x7f17fc0cc410 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f17e80097c0 tx=0x7f17e801c3e0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f1801e00640 1 -- 172.21.15.175:0/853075518 shutdown_connections 2024-04-25T09:10:12.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f1801e00640 1 --2- 172.21.15.175:0/853075518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17fc1600a0 0x7f17fc0cc410 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f1801e00640 1 --2- 172.21.15.175:0/853075518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17fc145250 0x7f17fc0cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f1801e00640 1 -- 172.21.15.175:0/853075518 >> 172.21.15.175:0/853075518 conn(0x7f17fc06ac50 msgr2=0x7f17fc06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:12.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f1801e00640 1 -- 172.21.15.175:0/853075518 shutdown_connections 2024-04-25T09:10:12.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f1801e00640 1 -- 172.21.15.175:0/853075518 wait complete. 2024-04-25T09:10:12.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f1801e00640 1 Processor -- start 2024-04-25T09:10:12.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f1801e00640 1 -- start start 2024-04-25T09:10:12.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f1801e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17fc0ce970 0x7f17fc13f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f1801e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17fc145250 0x7f17fc165d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f1801e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17fc1600a0 0x7f17fc13fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f1801e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc15c870 con 0x7f17fc145250 2024-04-25T09:10:12.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f1801e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc145630 con 0x7f17fc1600a0 2024-04-25T09:10:12.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f1801e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc15c9f0 con 0x7f17fc0ce970 2024-04-25T09:10:12.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f17fa000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17fc145250 0x7f17fc165d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f17fa000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17fc145250 0x7f17fc165d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35192/0 (socket says 172.21.15.175:35192) 2024-04-25T09:10:12.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f17fa000640 1 -- 172.21.15.175:0/2890185742 learned_addr learned my addr 172.21.15.175:0/2890185742 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:12.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f17faa00640 1 --2- 172.21.15.175:0/2890185742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17fc0ce970 0x7f17fc13f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f17fb400640 1 --2- 172.21.15.175:0/2890185742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17fc1600a0 0x7f17fc13fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f17fa000640 1 -- 172.21.15.175:0/2890185742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17fc0ce970 msgr2=0x7f17fc13f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f17fa000640 1 --2- 172.21.15.175:0/2890185742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17fc0ce970 0x7f17fc13f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f17fa000640 1 -- 172.21.15.175:0/2890185742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17fc1600a0 msgr2=0x7f17fc13fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f17fa000640 1 --2- 172.21.15.175:0/2890185742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17fc1600a0 0x7f17fc13fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.555+0000 7f17fa000640 1 -- 172.21.15.175:0/2890185742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17fc162810 con 0x7f17fc145250 2024-04-25T09:10:12.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.559+0000 7f17fa000640 1 --2- 172.21.15.175:0/2890185742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17fc145250 0x7f17fc165d90 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f17e801aa90 tx=0x7f17e8019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.559+0000 7f17f3400640 1 -- 172.21.15.175:0/2890185742 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80abcb0 con 0x7f17fc145250 2024-04-25T09:10:12.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.559+0000 7f17f3400640 1 -- 172.21.15.175:0/2890185742 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e80abe50 con 0x7f17fc145250 2024-04-25T09:10:12.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.559+0000 7f1801e00640 1 -- 172.21.15.175:0/2890185742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17fc162af0 con 0x7f17fc145250 2024-04-25T09:10:12.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.559+0000 7f17f3400640 1 -- 172.21.15.175:0/2890185742 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e80bf690 con 0x7f17fc145250 2024-04-25T09:10:12.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.559+0000 7f1801e00640 1 -- 172.21.15.175:0/2890185742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17fc1630b0 con 0x7f17fc145250 2024-04-25T09:10:12.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.559+0000 7f1801e00640 1 -- 172.21.15.175:0/2890185742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17fc075160 con 0x7f17fc145250 2024-04-25T09:10:12.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.559+0000 7f17f3400640 1 -- 172.21.15.175:0/2890185742 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f17e80aa070 con 0x7f17fc145250 2024-04-25T09:10:12.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.559+0000 7f17f3400640 1 --2- 172.21.15.175:0/2890185742 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f17dc066f60 0x7f17dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.559+0000 7f17f3400640 1 -- 172.21.15.175:0/2890185742 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17e811f8e0 con 0x7f17fc145250 2024-04-25T09:10:12.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.559+0000 7f17faa00640 1 --2- 172.21.15.175:0/2890185742 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f17dc066f60 0x7f17dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.563+0000 7f17faa00640 1 --2- 172.21.15.175:0/2890185742 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f17dc066f60 0x7f17dc069420 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0074a0 tx=0x7f17ec00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.563+0000 7f17f3400640 1 -- 172.21.15.175:0/2890185742 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f17e8016090 con 0x7f17fc145250 2024-04-25T09:10:12.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.715+0000 7f1801e00640 1 -- 172.21.15.175:0/2890185742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17fc0ce350 con 0x7f17fc145250 2024-04-25T09:10:12.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.715+0000 7f17f3400640 1 -- 172.21.15.175:0/2890185742 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f17e80f0960 con 0x7f17fc145250 2024-04-25T09:10:12.706 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:10:12.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.719+0000 7f1801e00640 1 -- 172.21.15.175:0/2890185742 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f17dc066f60 msgr2=0x7f17dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.719+0000 7f1801e00640 1 --2- 172.21.15.175:0/2890185742 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f17dc066f60 0x7f17dc069420 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0074a0 tx=0x7f17ec00b040 comp rx=0 tx=0).stop 2024-04-25T09:10:12.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.719+0000 7f1801e00640 1 -- 172.21.15.175:0/2890185742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17fc145250 msgr2=0x7f17fc165d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.719+0000 7f1801e00640 1 --2- 172.21.15.175:0/2890185742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17fc145250 0x7f17fc165d90 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f17e801aa90 tx=0x7f17e8019180 comp rx=0 tx=0).stop 2024-04-25T09:10:12.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.719+0000 7f1801e00640 1 -- 172.21.15.175:0/2890185742 shutdown_connections 2024-04-25T09:10:12.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.719+0000 7f1801e00640 1 --2- 172.21.15.175:0/2890185742 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f17dc066f60 0x7f17dc069420 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.719+0000 7f1801e00640 1 --2- 172.21.15.175:0/2890185742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17fc1600a0 0x7f17fc13fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.719+0000 7f1801e00640 1 --2- 172.21.15.175:0/2890185742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17fc145250 0x7f17fc165d90 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.719+0000 7f1801e00640 1 --2- 172.21.15.175:0/2890185742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17fc0ce970 0x7f17fc13f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.719+0000 7f1801e00640 1 -- 172.21.15.175:0/2890185742 >> 172.21.15.175:0/2890185742 conn(0x7f17fc06ac50 msgr2=0x7f17fc0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:12.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.719+0000 7f1801e00640 1 -- 172.21.15.175:0/2890185742 shutdown_connections 2024-04-25T09:10:12.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.719+0000 7f1801e00640 1 -- 172.21.15.175:0/2890185742 wait complete. 2024-04-25T09:10:12.727 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:10:12.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.875+0000 7f0e88000640 1 Processor -- start 2024-04-25T09:10:12.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.875+0000 7f0e88000640 1 -- start start 2024-04-25T09:10:12.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.875+0000 7f0e88000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e8015af20 0x7f0e800b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.875+0000 7f0e88000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e8006db60 con 0x7f0e800cbe60 2024-04-25T09:10:12.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.875+0000 7f0e88000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e8006de40 con 0x7f0e800b4630 2024-04-25T09:10:12.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.875+0000 7f0e88000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8006e120 con 0x7f0e8015af20 2024-04-25T09:10:12.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.875+0000 7f0e85600640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f0e800cbe60 0x7f0e8006d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:37746/0 (socket says 172.21.15.175:37746) 2024-04-25T09:10:12.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.875+0000 7f0e85600640 1 -- 172.21.15.175:0/3044769917 learned_addr learned my addr 172.21.15.175:0/3044769917 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:10:12.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.879+0000 7f0e84c00640 1 --2- 172.21.15.175:0/3044769917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e8015af20 0x7f0e800b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.879+0000 7f0e7fe00640 1 -- 172.21.15.175:0/3044769917 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046758801 0 0) 0x7f0e8006db60 con 0x7f0e800cbe60 2024-04-25T09:10:12.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.879+0000 7f0e7fe00640 1 -- 172.21.15.175:0/3044769917 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e68003530 con 0x7f0e800cbe60 2024-04-25T09:10:12.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.879+0000 7f0e7fe00640 1 -- 172.21.15.175:0/3044769917 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238953451 0 0) 0x7f0e8006de40 con 0x7f0e800b4630 2024-04-25T09:10:12.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.879+0000 7f0e7fe00640 1 -- 172.21.15.175:0/3044769917 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e8006db60 con 0x7f0e800b4630 2024-04-25T09:10:12.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.879+0000 7f0e84c00640 1 -- 172.21.15.175:0/3044769917 >> v1:172.21.15.177:6789/0 conn(0x7f0e800b4630 legacy=0x7f0e8015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.879+0000 7f0e84c00640 1 -- 172.21.15.175:0/3044769917 >> v1:172.21.15.175:6789/0 conn(0x7f0e800cbe60 legacy=0x7f0e8006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.879+0000 7f0e7fe00640 1 -- 172.21.15.175:0/3044769917 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2184278265 0 0) 0x7f0e68003530 con 0x7f0e800cbe60 2024-04-25T09:10:12.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.879+0000 7f0e84c00640 1 -- 172.21.15.175:0/3044769917 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8015c2f0 con 0x7f0e8015af20 2024-04-25T09:10:12.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.879+0000 7f0e84c00640 1 --2- 172.21.15.175:0/3044769917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e8015af20 0x7f0e800b40f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0097f0 tx=0x7f0e6c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc7f2494ac7bf2ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e7fe00640 1 -- 172.21.15.175:0/3044769917 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c0b0070 con 0x7f0e8015af20 2024-04-25T09:10:12.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e7fe00640 1 -- 172.21.15.175:0/3044769917 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6c0ab400 con 0x7f0e8015af20 2024-04-25T09:10:12.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e7fe00640 1 -- 172.21.15.175:0/3044769917 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e74001a00 con 0x7f0e8015af20 2024-04-25T09:10:12.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e88000640 1 -- 172.21.15.175:0/3044769917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e8015af20 msgr2=0x7f0e800b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e88000640 1 --2- 172.21.15.175:0/3044769917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e8015af20 0x7f0e800b40f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0097f0 tx=0x7f0e6c01c400 comp rx=0 tx=0).stop 2024-04-25T09:10:12.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e88000640 1 -- 172.21.15.175:0/3044769917 shutdown_connections 2024-04-25T09:10:12.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e88000640 1 --2- 172.21.15.175:0/3044769917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e8015af20 0x7f0e800b40f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e88000640 1 -- 172.21.15.175:0/3044769917 >> 172.21.15.175:0/3044769917 conn(0x7f0e8006ac50 msgr2=0x7f0e8006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:12.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e88000640 1 -- 172.21.15.175:0/3044769917 shutdown_connections 2024-04-25T09:10:12.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e88000640 1 -- 172.21.15.175:0/3044769917 wait complete. 2024-04-25T09:10:12.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e88000640 1 Processor -- start 2024-04-25T09:10:12.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e88000640 1 -- start start 2024-04-25T09:10:12.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e88000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e800b4630 0x7f0e8014bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e88000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e800cbe60 0x7f0e80152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e88000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e8015af20 0x7f0e80150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e88000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8015db40 con 0x7f0e800b4630 2024-04-25T09:10:12.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e88000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8015d9c0 con 0x7f0e8015af20 2024-04-25T09:10:12.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e88000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800cc450 con 0x7f0e800cbe60 2024-04-25T09:10:12.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e85600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e800b4630 0x7f0e8014bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e85600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e800b4630 0x7f0e8014bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35194/0 (socket says 172.21.15.175:35194) 2024-04-25T09:10:12.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e85600640 1 -- 172.21.15.175:0/3363077651 learned_addr learned my addr 172.21.15.175:0/3363077651 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:12.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e86000640 1 --2- 172.21.15.175:0/3363077651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e8015af20 0x7f0e80150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e84c00640 1 --2- 172.21.15.175:0/3363077651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e800cbe60 0x7f0e80152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e85600640 1 -- 172.21.15.175:0/3363077651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e800cbe60 msgr2=0x7f0e80152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e85600640 1 --2- 172.21.15.175:0/3363077651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e800cbe60 0x7f0e80152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e85600640 1 -- 172.21.15.175:0/3363077651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e8015af20 msgr2=0x7f0e80150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e85600640 1 --2- 172.21.15.175:0/3363077651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e8015af20 0x7f0e80150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e85600640 1 -- 172.21.15.175:0/3363077651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8014c2b0 con 0x7f0e800b4630 2024-04-25T09:10:12.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.883+0000 7f0e86000640 1 --2- 172.21.15.175:0/3363077651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e8015af20 0x7f0e80150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:12.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.887+0000 7f0e85600640 1 --2- 172.21.15.175:0/3363077651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e800b4630 0x7f0e8014bbb0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f0e74002010 tx=0x7f0e7400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.887+0000 7f0e7d600640 1 -- 172.21.15.175:0/3363077651 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e74012400 con 0x7f0e800b4630 2024-04-25T09:10:12.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.887+0000 7f0e7d600640 1 -- 172.21.15.175:0/3363077651 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e740125a0 con 0x7f0e800b4630 2024-04-25T09:10:12.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.887+0000 7f0e88000640 1 -- 172.21.15.175:0/3363077651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e8014c590 con 0x7f0e800b4630 2024-04-25T09:10:12.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.887+0000 7f0e7d600640 1 -- 172.21.15.175:0/3363077651 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e74012990 con 0x7f0e800b4630 2024-04-25T09:10:12.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.887+0000 7f0e88000640 1 -- 172.21.15.175:0/3363077651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e8014cb50 con 0x7f0e800b4630 2024-04-25T09:10:12.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.887+0000 7f0e88000640 1 -- 172.21.15.175:0/3363077651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e80075160 con 0x7f0e800b4630 2024-04-25T09:10:12.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.887+0000 7f0e7d600640 1 -- 172.21.15.175:0/3363077651 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0e74012b30 con 0x7f0e800b4630 2024-04-25T09:10:12.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.887+0000 7f0e7d600640 1 --2- 172.21.15.175:0/3363077651 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0e60066f60 0x7f0e60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.887+0000 7f0e7d600640 1 -- 172.21.15.175:0/3363077651 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e74085900 con 0x7f0e800b4630 2024-04-25T09:10:12.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.887+0000 7f0e84c00640 1 --2- 172.21.15.175:0/3363077651 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0e60066f60 0x7f0e60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.891+0000 7f0e84c00640 1 --2- 172.21.15.175:0/3363077651 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0e60066f60 0x7f0e60069420 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0ad000 tx=0x7f0e6c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:12.891+0000 7f0e7d600640 1 -- 172.21.15.175:0/3363077651 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0e74012e20 con 0x7f0e800b4630 2024-04-25T09:10:13.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.047+0000 7f0e88000640 1 -- 172.21.15.175:0/3363077651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0e80072230 con 0x7f0e800b4630 2024-04-25T09:10:13.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.047+0000 7f0e7d600640 1 -- 172.21.15.175:0/3363077651 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0e74085070 con 0x7f0e800b4630 2024-04-25T09:10:13.037 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:10:13.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.047+0000 7f0e88000640 1 -- 172.21.15.175:0/3363077651 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0e60066f60 msgr2=0x7f0e60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.047+0000 7f0e88000640 1 --2- 172.21.15.175:0/3363077651 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0e60066f60 0x7f0e60069420 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0ad000 tx=0x7f0e6c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:10:13.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.047+0000 7f0e88000640 1 -- 172.21.15.175:0/3363077651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e800b4630 msgr2=0x7f0e8014bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.047+0000 7f0e88000640 1 --2- 172.21.15.175:0/3363077651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e800b4630 0x7f0e8014bbb0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f0e74002010 tx=0x7f0e7400a430 comp rx=0 tx=0).stop 2024-04-25T09:10:13.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.047+0000 7f0e88000640 1 -- 172.21.15.175:0/3363077651 shutdown_connections 2024-04-25T09:10:13.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.047+0000 7f0e88000640 1 --2- 172.21.15.175:0/3363077651 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0e60066f60 0x7f0e60069420 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.047+0000 7f0e88000640 1 --2- 172.21.15.175:0/3363077651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e8015af20 0x7f0e80150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.047+0000 7f0e88000640 1 --2- 172.21.15.175:0/3363077651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e800cbe60 0x7f0e80152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.047+0000 7f0e88000640 1 --2- 172.21.15.175:0/3363077651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e800b4630 0x7f0e8014bbb0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.051+0000 7f0e88000640 1 -- 172.21.15.175:0/3363077651 >> 172.21.15.175:0/3363077651 conn(0x7f0e8006ac50 msgr2=0x7f0e800b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:13.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.051+0000 7f0e88000640 1 -- 172.21.15.175:0/3363077651 shutdown_connections 2024-04-25T09:10:13.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.051+0000 7f0e88000640 1 -- 172.21.15.175:0/3363077651 wait complete. 2024-04-25T09:10:13.058 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:10:13.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.207+0000 7fd832a00640 1 Processor -- start 2024-04-25T09:10:13.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.207+0000 7fd832a00640 1 -- start start 2024-04-25T09:10:13.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.207+0000 7fd832a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd82c145250 0x7fd82c0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.207+0000 7fd832a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd82c1600a0 0x7fd82c0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.207+0000 7fd832a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd82c0ce970 0x7fd82c0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.207+0000 7fd832a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd82c15f650 con 0x7fd82c0ce970 2024-04-25T09:10:13.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.207+0000 7fd832a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd82c0cfd10 con 0x7fd82c1600a0 2024-04-25T09:10:13.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.207+0000 7fd832a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c0cfff0 con 0x7fd82c145250 2024-04-25T09:10:13.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.207+0000 7fd830a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd82c0ce970 0x7fd82c0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.207+0000 7fd830a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd82c0ce970 0x7fd82c0cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35200/0 (socket says 172.21.15.175:35200) 2024-04-25T09:10:13.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.207+0000 7fd830a00640 1 -- 172.21.15.175:0/2079919040 learned_addr learned my addr 172.21.15.175:0/2079919040 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:13.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.207+0000 7fd82be00640 1 --2- 172.21.15.175:0/2079919040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd82c145250 0x7fd82c0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.207+0000 7fd823400640 1 --2- 172.21.15.175:0/2079919040 >> v2:172.21.15.177:3300/0 conn(0x7fd82c1600a0 0x7fd82c0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.207+0000 7fd830a00640 1 -- 172.21.15.175:0/2079919040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd82c145250 msgr2=0x7fd82c0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:13.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.207+0000 7fd830a00640 1 --2- 172.21.15.175:0/2079919040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd82c145250 0x7fd82c0cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.207+0000 7fd830a00640 1 -- 172.21.15.175:0/2079919040 >> v2:172.21.15.177:3300/0 conn(0x7fd82c1600a0 msgr2=0x7fd82c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:13.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.207+0000 7fd830a00640 1 --2- 172.21.15.175:0/2079919040 >> v2:172.21.15.177:3300/0 conn(0x7fd82c1600a0 0x7fd82c0cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.207+0000 7fd830a00640 1 -- 172.21.15.175:0/2079919040 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c15f8a0 con 0x7fd82c0ce970 2024-04-25T09:10:13.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.211+0000 7fd830a00640 1 --2- 172.21.15.175:0/2079919040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c0ce970 0x7fd82c0cee00 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fd82c06bbe0 tx=0x7fd82401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a325b80d7618d0f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:13.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.211+0000 7fd82b400640 1 -- 172.21.15.175:0/2079919040 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8240a5860 con 0x7fd82c0ce970 2024-04-25T09:10:13.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.211+0000 7fd82b400640 1 -- 172.21.15.175:0/2079919040 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8240a5a00 con 0x7fd82c0ce970 2024-04-25T09:10:13.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.211+0000 7fd82b400640 1 -- 172.21.15.175:0/2079919040 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8240a5dd0 con 0x7fd82c0ce970 2024-04-25T09:10:13.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.211+0000 7fd832a00640 1 -- 172.21.15.175:0/2079919040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c0ce970 msgr2=0x7fd82c0cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.211+0000 7fd832a00640 1 --2- 172.21.15.175:0/2079919040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c0ce970 0x7fd82c0cee00 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fd82c06bbe0 tx=0x7fd82401c9c0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.211+0000 7fd832a00640 1 -- 172.21.15.175:0/2079919040 shutdown_connections 2024-04-25T09:10:13.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.211+0000 7fd832a00640 1 --2- 172.21.15.175:0/2079919040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c0ce970 0x7fd82c0cee00 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.211+0000 7fd832a00640 1 --2- 172.21.15.175:0/2079919040 >> v2:172.21.15.177:3300/0 conn(0x7fd82c1600a0 0x7fd82c0cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.211+0000 7fd832a00640 1 --2- 172.21.15.175:0/2079919040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd82c145250 0x7fd82c0cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.211+0000 7fd832a00640 1 -- 172.21.15.175:0/2079919040 >> 172.21.15.175:0/2079919040 conn(0x7fd82c06ac50 msgr2=0x7fd82c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:13.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.211+0000 7fd832a00640 1 -- 172.21.15.175:0/2079919040 shutdown_connections 2024-04-25T09:10:13.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.211+0000 7fd832a00640 1 -- 172.21.15.175:0/2079919040 wait complete. 2024-04-25T09:10:13.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.211+0000 7fd832a00640 1 Processor -- start 2024-04-25T09:10:13.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.211+0000 7fd832a00640 1 -- start start 2024-04-25T09:10:13.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd832a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c0ce970 0x7fd82c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd832a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd82c145250 0x7fd82c0a9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd832a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd82c1600a0 0x7fd82c0ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd832a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c160480 con 0x7fd82c0ce970 2024-04-25T09:10:13.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd832a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c145630 con 0x7fd82c145250 2024-04-25T09:10:13.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd832a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c160600 con 0x7fd82c1600a0 2024-04-25T09:10:13.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd82be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c0ce970 0x7fd82c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd82be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c0ce970 0x7fd82c06edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35216/0 (socket says 172.21.15.175:35216) 2024-04-25T09:10:13.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd82be00640 1 -- 172.21.15.175:0/1772001012 learned_addr learned my addr 172.21.15.175:0/1772001012 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:13.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd823400640 1 --2- 172.21.15.175:0/1772001012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd82c145250 0x7fd82c0a9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd830a00640 1 --2- 172.21.15.175:0/1772001012 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd82c1600a0 0x7fd82c0ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd82be00640 1 -- 172.21.15.175:0/1772001012 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd82c1600a0 msgr2=0x7fd82c0ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd82be00640 1 --2- 172.21.15.175:0/1772001012 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd82c1600a0 0x7fd82c0ae3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd82be00640 1 -- 172.21.15.175:0/1772001012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd82c145250 msgr2=0x7fd82c0a9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd82be00640 1 --2- 172.21.15.175:0/1772001012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd82c145250 0x7fd82c0a9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd82be00640 1 -- 172.21.15.175:0/1772001012 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c0abee0 con 0x7fd82c0ce970 2024-04-25T09:10:13.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd82be00640 1 --2- 172.21.15.175:0/1772001012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c0ce970 0x7fd82c06edb0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00d800 tx=0x7fd81c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:13.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd828c00640 1 -- 172.21.15.175:0/1772001012 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81c018020 con 0x7fd82c0ce970 2024-04-25T09:10:13.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd828c00640 1 -- 172.21.15.175:0/1772001012 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81c0096a0 con 0x7fd82c0ce970 2024-04-25T09:10:13.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd832a00640 1 -- 172.21.15.175:0/1772001012 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd82c0ab120 con 0x7fd82c0ce970 2024-04-25T09:10:13.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd828c00640 1 -- 172.21.15.175:0/1772001012 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81c009a50 con 0x7fd82c0ce970 2024-04-25T09:10:13.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd832a00640 1 -- 172.21.15.175:0/1772001012 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82c0ab6e0 con 0x7fd82c0ce970 2024-04-25T09:10:13.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.215+0000 7fd832a00640 1 -- 172.21.15.175:0/1772001012 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82c075160 con 0x7fd82c0ce970 2024-04-25T09:10:13.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.219+0000 7fd828c00640 1 -- 172.21.15.175:0/1772001012 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd81c01b020 con 0x7fd82c0ce970 2024-04-25T09:10:13.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.219+0000 7fd828c00640 1 --2- 172.21.15.175:0/1772001012 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd808066f60 0x7fd808069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.219+0000 7fd828c00640 1 -- 172.21.15.175:0/1772001012 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd81c085560 con 0x7fd82c0ce970 2024-04-25T09:10:13.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.219+0000 7fd823400640 1 --2- 172.21.15.175:0/1772001012 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd808066f60 0x7fd808069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.219+0000 7fd823400640 1 --2- 172.21.15.175:0/1772001012 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd808066f60 0x7fd808069420 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd82c067e00 tx=0x7fd814008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:13.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.223+0000 7fd828c00640 1 -- 172.21.15.175:0/1772001012 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd81c022020 con 0x7fd82c0ce970 2024-04-25T09:10:13.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.387+0000 7fd832a00640 1 -- 172.21.15.175:0/1772001012 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd82c0af500 con 0x7fd82c0ce970 2024-04-25T09:10:13.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.387+0000 7fd828c00640 1 -- 172.21.15.175:0/1772001012 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v84) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd81c056560 con 0x7fd82c0ce970 2024-04-25T09:10:13.377 INFO:teuthology.orchestra.run.smithi175.stderr:listed 0 entries 2024-04-25T09:10:13.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.387+0000 7fd832a00640 1 -- 172.21.15.175:0/1772001012 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd808066f60 msgr2=0x7fd808069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.387+0000 7fd832a00640 1 --2- 172.21.15.175:0/1772001012 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd808066f60 0x7fd808069420 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd82c067e00 tx=0x7fd814008040 comp rx=0 tx=0).stop 2024-04-25T09:10:13.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.387+0000 7fd832a00640 1 -- 172.21.15.175:0/1772001012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c0ce970 msgr2=0x7fd82c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.387+0000 7fd832a00640 1 --2- 172.21.15.175:0/1772001012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c0ce970 0x7fd82c06edb0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00d800 tx=0x7fd81c00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.387+0000 7fd832a00640 1 -- 172.21.15.175:0/1772001012 shutdown_connections 2024-04-25T09:10:13.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.387+0000 7fd832a00640 1 --2- 172.21.15.175:0/1772001012 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd808066f60 0x7fd808069420 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.387+0000 7fd832a00640 1 --2- 172.21.15.175:0/1772001012 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd82c1600a0 0x7fd82c0ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.387+0000 7fd832a00640 1 --2- 172.21.15.175:0/1772001012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd82c145250 0x7fd82c0a9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.387+0000 7fd832a00640 1 --2- 172.21.15.175:0/1772001012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd82c0ce970 0x7fd82c06edb0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.387+0000 7fd832a00640 1 -- 172.21.15.175:0/1772001012 >> 172.21.15.175:0/1772001012 conn(0x7fd82c06ac50 msgr2=0x7fd82c06b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:13.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.387+0000 7fd832a00640 1 -- 172.21.15.175:0/1772001012 shutdown_connections 2024-04-25T09:10:13.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.387+0000 7fd832a00640 1 -- 172.21.15.175:0/1772001012 wait complete. 2024-04-25T09:10:13.398 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:10:13.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:13.398 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:13.444 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:10:13.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:13.444 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:10:13.499 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:13.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.690+0000 7fde12e00640 1 Processor -- start 2024-04-25T09:10:13.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.690+0000 7fde12e00640 1 -- start start 2024-04-25T09:10:13.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.690+0000 7fde12e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde0c144fc0 0x7fde0c0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.690+0000 7fde12e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fde0c1453a0 0x7fde0c15bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.690+0000 7fde12e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c15cd00 con 0x7fde0c0cc3b0 2024-04-25T09:10:13.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.690+0000 7fde12e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0c0ce660 con 0x7fde0c1453a0 2024-04-25T09:10:13.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.690+0000 7fde12e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c0cc930 con 0x7fde0c144fc0 2024-04-25T09:10:13.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.690+0000 7fde03400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fde0c1453a0 0x7fde0c15bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.690+0000 7fde03400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fde0c1453a0 0x7fde0c15bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35232/0 (socket says 172.21.15.175:35232) 2024-04-25T09:10:13.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.690+0000 7fde03400640 1 -- 172.21.15.175:0/1154846245 learned_addr learned my addr 172.21.15.175:0/1154846245 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:13.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.690+0000 7fde0be00640 1 --2- 172.21.15.175:0/1154846245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde0c144fc0 0x7fde0c0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.694+0000 7fde03400640 1 -- 172.21.15.175:0/1154846245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde0c144fc0 msgr2=0x7fde0c0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:13.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.694+0000 7fde03400640 1 --2- 172.21.15.175:0/1154846245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde0c144fc0 0x7fde0c0cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.694+0000 7fde03400640 1 -- 172.21.15.175:0/1154846245 >> v1:172.21.15.177:6789/0 conn(0x7fde0c0cc3b0 legacy=0x7fde0c15f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.694+0000 7fde03400640 1 -- 172.21.15.175:0/1154846245 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c0ccc10 con 0x7fde0c1453a0 2024-04-25T09:10:13.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.694+0000 7fde03400640 1 --2- 172.21.15.175:0/1154846245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde0c1453a0 0x7fde0c15bed0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fddf4009870 tx=0x7fddf401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6cacf0a9ebcc0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:13.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.694+0000 7fde0b400640 1 -- 172.21.15.175:0/1154846245 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf40ab650 con 0x7fde0c1453a0 2024-04-25T09:10:13.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.694+0000 7fde0b400640 1 -- 172.21.15.175:0/1154846245 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf40b0070 con 0x7fde0c1453a0 2024-04-25T09:10:13.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.694+0000 7fde0b400640 1 -- 172.21.15.175:0/1154846245 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf40aba10 con 0x7fde0c1453a0 2024-04-25T09:10:13.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.694+0000 7fde12e00640 1 -- 172.21.15.175:0/1154846245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde0c1453a0 msgr2=0x7fde0c15bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.694+0000 7fde12e00640 1 --2- 172.21.15.175:0/1154846245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde0c1453a0 0x7fde0c15bed0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fddf4009870 tx=0x7fddf401c560 comp rx=0 tx=0).stop 2024-04-25T09:10:13.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.694+0000 7fde12e00640 1 -- 172.21.15.175:0/1154846245 shutdown_connections 2024-04-25T09:10:13.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.694+0000 7fde12e00640 1 --2- 172.21.15.175:0/1154846245 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde0c1453a0 0x7fde0c15bed0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.694+0000 7fde12e00640 1 --2- 172.21.15.175:0/1154846245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde0c144fc0 0x7fde0c0cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.694+0000 7fde12e00640 1 -- 172.21.15.175:0/1154846245 >> 172.21.15.175:0/1154846245 conn(0x7fde0c067150 msgr2=0x7fde0c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:13.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.694+0000 7fde12e00640 1 -- 172.21.15.175:0/1154846245 shutdown_connections 2024-04-25T09:10:13.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.694+0000 7fde12e00640 1 -- 172.21.15.175:0/1154846245 wait complete. 2024-04-25T09:10:13.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde12e00640 1 Processor -- start 2024-04-25T09:10:13.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde12e00640 1 -- start start 2024-04-25T09:10:13.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde12e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde0c144fc0 0x7fde0c15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde12e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde0c1453a0 0x7fde0c13c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde12e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde0c15b260 0x7fde0c13e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde12e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c0cffb0 con 0x7fde0c144fc0 2024-04-25T09:10:13.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde12e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c0cfe30 con 0x7fde0c1453a0 2024-04-25T09:10:13.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde12e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c1685f0 con 0x7fde0c15b260 2024-04-25T09:10:13.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde0be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde0c144fc0 0x7fde0c15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde0be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde0c144fc0 0x7fde0c15e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35240/0 (socket says 172.21.15.175:35240) 2024-04-25T09:10:13.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde0be00640 1 -- 172.21.15.175:0/1133310097 learned_addr learned my addr 172.21.15.175:0/1133310097 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:13.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde0be00640 1 -- 172.21.15.175:0/1133310097 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde0c15b260 msgr2=0x7fde0c13e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde0be00640 1 --2- 172.21.15.175:0/1133310097 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde0c15b260 0x7fde0c13e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde0be00640 1 -- 172.21.15.175:0/1133310097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde0c1453a0 msgr2=0x7fde0c13c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde0be00640 1 --2- 172.21.15.175:0/1133310097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde0c1453a0 0x7fde0c13c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde0be00640 1 -- 172.21.15.175:0/1133310097 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c13c880 con 0x7fde0c144fc0 2024-04-25T09:10:13.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde0be00640 1 --2- 172.21.15.175:0/1133310097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde0c144fc0 0x7fde0c15e3f0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00d800 tx=0x7fddfc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:13.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde08c00640 1 -- 172.21.15.175:0/1133310097 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc00b6c0 con 0x7fde0c144fc0 2024-04-25T09:10:13.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde08c00640 1 -- 172.21.15.175:0/1133310097 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddfc019070 con 0x7fde0c144fc0 2024-04-25T09:10:13.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde08c00640 1 -- 172.21.15.175:0/1133310097 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc00ba60 con 0x7fde0c144fc0 2024-04-25T09:10:13.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde12e00640 1 -- 172.21.15.175:0/1133310097 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0c15ea80 con 0x7fde0c144fc0 2024-04-25T09:10:13.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.698+0000 7fde12e00640 1 -- 172.21.15.175:0/1133310097 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0c13a840 con 0x7fde0c144fc0 2024-04-25T09:10:13.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.702+0000 7fde12e00640 1 -- 172.21.15.175:0/1133310097 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0c15efa0 con 0x7fde0c144fc0 2024-04-25T09:10:13.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.702+0000 7fde08c00640 1 -- 172.21.15.175:0/1133310097 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fddfc00bc00 con 0x7fde0c144fc0 2024-04-25T09:10:13.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.702+0000 7fde08c00640 1 --2- 172.21.15.175:0/1133310097 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdde8066f60 0x7fdde8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.702+0000 7fde08c00640 1 -- 172.21.15.175:0/1133310097 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddfc0854e0 con 0x7fde0c144fc0 2024-04-25T09:10:13.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.702+0000 7fde03400640 1 --2- 172.21.15.175:0/1133310097 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdde8066f60 0x7fdde8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.702+0000 7fde03400640 1 --2- 172.21.15.175:0/1133310097 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdde8066f60 0x7fdde8069420 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fddf40af000 tx=0x7fddf4004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:13.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.706+0000 7fde08c00640 1 -- 172.21.15.175:0/1133310097 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fddfc0564e0 con 0x7fde0c144fc0 2024-04-25T09:10:13.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.894+0000 7fde12e00640 1 -- 172.21.15.175:0/1133310097 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde0c074a60 con 0x7fde0c144fc0 2024-04-25T09:10:13.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.894+0000 7fde08c00640 1 -- 172.21.15.175:0/1133310097 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4949 (secure 0 0 0) 0x7fddfc055de0 con 0x7fde0c144fc0 2024-04-25T09:10:13.885 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:10:13.885 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":58,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3229536012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3229536012},{"type":"v1","addr":"172.21.15.177:6834","nonce":3229536012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/222649735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":222649735},{"type":"v1","addr":"172.21.15.177:6835","nonce":222649735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2888989442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2888989442},{"type":"v1","addr":"172.21.15.175:6836","nonce":2888989442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:03.786939+0000","modified":"2024-04-25T09:10:06.815078+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7215},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7215":{"gid":7215,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/1755192276","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1755192276},{"type":"v1","addr":"172.21.15.175:6837","nonce":1755192276}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:10:13.885 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 58 2024-04-25T09:10:13.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.894+0000 7fde12e00640 1 -- 172.21.15.175:0/1133310097 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdde8066f60 msgr2=0x7fdde8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.894+0000 7fde12e00640 1 --2- 172.21.15.175:0/1133310097 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdde8066f60 0x7fdde8069420 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fddf40af000 tx=0x7fddf4004740 comp rx=0 tx=0).stop 2024-04-25T09:10:13.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.894+0000 7fde12e00640 1 -- 172.21.15.175:0/1133310097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde0c144fc0 msgr2=0x7fde0c15e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.894+0000 7fde12e00640 1 --2- 172.21.15.175:0/1133310097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde0c144fc0 0x7fde0c15e3f0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00d800 tx=0x7fddfc00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.894+0000 7fde12e00640 1 -- 172.21.15.175:0/1133310097 shutdown_connections 2024-04-25T09:10:13.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.894+0000 7fde12e00640 1 --2- 172.21.15.175:0/1133310097 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdde8066f60 0x7fdde8069420 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.894+0000 7fde12e00640 1 --2- 172.21.15.175:0/1133310097 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde0c15b260 0x7fde0c13e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.894+0000 7fde12e00640 1 --2- 172.21.15.175:0/1133310097 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde0c1453a0 0x7fde0c13c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.894+0000 7fde12e00640 1 --2- 172.21.15.175:0/1133310097 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde0c144fc0 0x7fde0c15e3f0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.894+0000 7fde12e00640 1 -- 172.21.15.175:0/1133310097 >> 172.21.15.175:0/1133310097 conn(0x7fde0c0cc3b0 msgr2=0x7fde0c06ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:13.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.894+0000 7fde12e00640 1 -- 172.21.15.175:0/1133310097 shutdown_connections 2024-04-25T09:10:13.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:13.898+0000 7fde12e00640 1 -- 172.21.15.175:0/1133310097 wait complete. 2024-04-25T09:10:13.906 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T09:10:14.070 INFO:teuthology.orchestra.run.smithi175.stdout:{"message":"","return_code":0} 2024-04-25T09:10:14.070 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:10:14.070 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:10:14.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.218+0000 7efc3dc00640 1 Processor -- start 2024-04-25T09:10:14.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.218+0000 7efc3dc00640 1 -- start start 2024-04-25T09:10:14.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.218+0000 7efc3dc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc3806dc80 0x7efc3806e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.218+0000 7efc3dc00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efc380b4c60 0x7efc380cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.218+0000 7efc3dc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3806c5c0 con 0x7efc380ce140 2024-04-25T09:10:14.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.218+0000 7efc3dc00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3806e5a0 con 0x7efc380b4c60 2024-04-25T09:10:14.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.218+0000 7efc3dc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3806c2e0 con 0x7efc3806dc80 2024-04-25T09:10:14.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.218+0000 7efc37e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc3806dc80 0x7efc3806e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.218+0000 7efc2fe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efc380b4c60 0x7efc380cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.218+0000 7efc3d200640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7efc380ce140 0x7efc380b3e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:48040/0 (socket says 172.21.15.175:48040) 2024-04-25T09:10:14.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.218+0000 7efc3d200640 1 -- 172.21.15.175:0/3206751441 learned_addr learned my addr 172.21.15.175:0/3206751441 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:10:14.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.218+0000 7efc2fe00640 1 -- 172.21.15.175:0/3206751441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc3806dc80 msgr2=0x7efc3806e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.218+0000 7efc2fe00640 1 --2- 172.21.15.175:0/3206751441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc3806dc80 0x7efc3806e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.218+0000 7efc2fe00640 1 -- 172.21.15.175:0/3206751441 >> v1:172.21.15.177:6789/0 conn(0x7efc380ce140 legacy=0x7efc380b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.218+0000 7efc2fe00640 1 -- 172.21.15.175:0/3206751441 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc380cd3b0 con 0x7efc380b4c60 2024-04-25T09:10:14.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.218+0000 7efc37e00640 1 --2- 172.21.15.175:0/3206751441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc3806dc80 0x7efc3806e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:14.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.222+0000 7efc2fe00640 1 --2- 172.21.15.175:0/3206751441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc380b4c60 0x7efc380cdc00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efc200097c0 tx=0x7efc2001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20a70a6feaa0b785 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.222+0000 7efc37400640 1 -- 172.21.15.175:0/3206751441 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc200ab680 con 0x7efc380b4c60 2024-04-25T09:10:14.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.222+0000 7efc37400640 1 -- 172.21.15.175:0/3206751441 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc200b0070 con 0x7efc380b4c60 2024-04-25T09:10:14.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.222+0000 7efc37400640 1 -- 172.21.15.175:0/3206751441 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc200aba40 con 0x7efc380b4c60 2024-04-25T09:10:14.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.222+0000 7efc3dc00640 1 -- 172.21.15.175:0/3206751441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc380b4c60 msgr2=0x7efc380cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.222+0000 7efc3dc00640 1 --2- 172.21.15.175:0/3206751441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc380b4c60 0x7efc380cdc00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efc200097c0 tx=0x7efc2001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.222+0000 7efc3dc00640 1 -- 172.21.15.175:0/3206751441 shutdown_connections 2024-04-25T09:10:14.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.222+0000 7efc3dc00640 1 --2- 172.21.15.175:0/3206751441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc380b4c60 0x7efc380cdc00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.222+0000 7efc3dc00640 1 --2- 172.21.15.175:0/3206751441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc3806dc80 0x7efc3806e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.222+0000 7efc3dc00640 1 -- 172.21.15.175:0/3206751441 >> 172.21.15.175:0/3206751441 conn(0x7efc380cc780 msgr2=0x7efc380ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.222+0000 7efc3dc00640 1 -- 172.21.15.175:0/3206751441 shutdown_connections 2024-04-25T09:10:14.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.222+0000 7efc3dc00640 1 -- 172.21.15.175:0/3206751441 wait complete. 2024-04-25T09:10:14.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc3dc00640 1 Processor -- start 2024-04-25T09:10:14.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc3dc00640 1 -- start start 2024-04-25T09:10:14.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc3dc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc3806dc80 0x7efc380ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc3dc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc380b4c60 0x7efc381574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc3dc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc380ce140 0x7efc38157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc3dc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc380cf3d0 con 0x7efc3806dc80 2024-04-25T09:10:14.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc3dc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc380ce570 con 0x7efc380ce140 2024-04-25T09:10:14.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc3dc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc380cf550 con 0x7efc380b4c60 2024-04-25T09:10:14.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc37e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc3806dc80 0x7efc380ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc37e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc3806dc80 0x7efc380ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35248/0 (socket says 172.21.15.175:35248) 2024-04-25T09:10:14.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc37e00640 1 -- 172.21.15.175:0/1522411766 learned_addr learned my addr 172.21.15.175:0/1522411766 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:14.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc3d200640 1 --2- 172.21.15.175:0/1522411766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc380ce140 0x7efc38157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc2fe00640 1 --2- 172.21.15.175:0/1522411766 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc380b4c60 0x7efc381574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc37e00640 1 -- 172.21.15.175:0/1522411766 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc380b4c60 msgr2=0x7efc381574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc37e00640 1 --2- 172.21.15.175:0/1522411766 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc380b4c60 0x7efc381574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc37e00640 1 -- 172.21.15.175:0/1522411766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc380ce140 msgr2=0x7efc38157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc37e00640 1 --2- 172.21.15.175:0/1522411766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc380ce140 0x7efc38157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc37e00640 1 -- 172.21.15.175:0/1522411766 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc380af100 con 0x7efc3806dc80 2024-04-25T09:10:14.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc37e00640 1 --2- 172.21.15.175:0/1522411766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc3806dc80 0x7efc380ad230 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7efc2800e980 tx=0x7efc2800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc34c00640 1 -- 172.21.15.175:0/1522411766 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc28017070 con 0x7efc3806dc80 2024-04-25T09:10:14.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc34c00640 1 -- 172.21.15.175:0/1522411766 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2800ca00 con 0x7efc3806dc80 2024-04-25T09:10:14.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc3dc00640 1 -- 172.21.15.175:0/1522411766 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc38164760 con 0x7efc3806dc80 2024-04-25T09:10:14.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc34c00640 1 -- 172.21.15.175:0/1522411766 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2800cdd0 con 0x7efc3806dc80 2024-04-25T09:10:14.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.226+0000 7efc3dc00640 1 -- 172.21.15.175:0/1522411766 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc38164d20 con 0x7efc3806dc80 2024-04-25T09:10:14.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.230+0000 7efc3dc00640 1 -- 172.21.15.175:0/1522411766 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc38074a60 con 0x7efc3806dc80 2024-04-25T09:10:14.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.230+0000 7efc34c00640 1 -- 172.21.15.175:0/1522411766 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efc2801a070 con 0x7efc3806dc80 2024-04-25T09:10:14.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.230+0000 7efc34c00640 1 --2- 172.21.15.175:0/1522411766 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efc14066f60 0x7efc14069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.230+0000 7efc34c00640 1 -- 172.21.15.175:0/1522411766 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc280852f0 con 0x7efc3806dc80 2024-04-25T09:10:14.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.230+0000 7efc2fe00640 1 --2- 172.21.15.175:0/1522411766 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efc14066f60 0x7efc14069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.230+0000 7efc2fe00640 1 --2- 172.21.15.175:0/1522411766 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efc14066f60 0x7efc14069420 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7efc200af000 tx=0x7efc200a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.234+0000 7efc34c00640 1 -- 172.21.15.175:0/1522411766 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efc28055c10 con 0x7efc3806dc80 2024-04-25T09:10:14.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.418+0000 7efc3dc00640 1 -- 172.21.15.175:0/1522411766 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efc3809d900 con 0x7efc3806dc80 2024-04-25T09:10:14.410 INFO:tasks.ceph.mon.a.smithi175.stderr:2024-04-25T09:10:14.418+0000 7feb0ee00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:10:14.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.422+0000 7efc34c00640 1 -- 172.21.15.175:0/1522411766 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) v1 ==== 161+0+0 (secure 0 0 0) 0x7efc28059cb0 con 0x7efc3806dc80 2024-04-25T09:10:14.412 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:10:14.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.426+0000 7efc3dc00640 1 -- 172.21.15.175:0/1522411766 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efc14066f60 msgr2=0x7efc14069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.426+0000 7efc3dc00640 1 --2- 172.21.15.175:0/1522411766 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efc14066f60 0x7efc14069420 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7efc200af000 tx=0x7efc200a7000 comp rx=0 tx=0).stop 2024-04-25T09:10:14.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.426+0000 7efc3dc00640 1 -- 172.21.15.175:0/1522411766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc3806dc80 msgr2=0x7efc380ad230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.426+0000 7efc3dc00640 1 --2- 172.21.15.175:0/1522411766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc3806dc80 0x7efc380ad230 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7efc2800e980 tx=0x7efc2800ee40 comp rx=0 tx=0).stop 2024-04-25T09:10:14.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.426+0000 7efc3dc00640 1 -- 172.21.15.175:0/1522411766 shutdown_connections 2024-04-25T09:10:14.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.426+0000 7efc3dc00640 1 --2- 172.21.15.175:0/1522411766 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efc14066f60 0x7efc14069420 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.426+0000 7efc3dc00640 1 --2- 172.21.15.175:0/1522411766 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efc380ce140 0x7efc38157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.426+0000 7efc3dc00640 1 --2- 172.21.15.175:0/1522411766 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efc380b4c60 0x7efc381574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.426+0000 7efc3dc00640 1 --2- 172.21.15.175:0/1522411766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc3806dc80 0x7efc380ad230 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.426+0000 7efc3dc00640 1 -- 172.21.15.175:0/1522411766 >> 172.21.15.175:0/1522411766 conn(0x7efc380cc780 msgr2=0x7efc3815b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.426+0000 7efc3dc00640 1 -- 172.21.15.175:0/1522411766 shutdown_connections 2024-04-25T09:10:14.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.426+0000 7efc3dc00640 1 -- 172.21.15.175:0/1522411766 wait complete. 2024-04-25T09:10:14.425 INFO:tasks.ceph.mds.c.smithi175.stderr: -4736> 2024-04-25T09:10:09.391+0000 7f5461e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:10:14.436 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 10000000000.00000000 2024-04-25T09:10:14.476 INFO:tasks.ceph.mds.c.smithi175.stdout:starting mds.c at 2024-04-25T09:10:14.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.490+0000 7feaad203080 1 Processor -- start 2024-04-25T09:10:14.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.490+0000 7feaad203080 1 -- start start 2024-04-25T09:10:14.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df71ef3740 0x55df71f11030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df71ef3b20 0x55df71e82b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df71ef4000 0x55df71e66b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df71ef4c50 con 0x55df71ef4000 2024-04-25T09:10:14.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df71de19f0 con 0x55df71ef3b20 2024-04-25T09:10:14.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df71ef4ef0 con 0x55df71ef3740 2024-04-25T09:10:14.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaaae00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df71ef4000 0x55df71e66b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaaae00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df71ef4000 0x55df71e66b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35290/0 (socket says 172.21.15.175:35290) 2024-04-25T09:10:14.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaaae00640 1 -- 172.21.15.175:0/246725891 learned_addr learned my addr 172.21.15.175:0/246725891 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:14.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaaa400640 1 --2- 172.21.15.175:0/246725891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df71ef3740 0x55df71f11030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaa9a00640 1 --2- 172.21.15.175:0/246725891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df71ef3b20 0x55df71e82b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaaae00640 1 -- 172.21.15.175:0/246725891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df71ef3740 msgr2=0x55df71f11030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaaae00640 1 --2- 172.21.15.175:0/246725891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df71ef3740 0x55df71f11030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaaae00640 1 -- 172.21.15.175:0/246725891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df71ef3b20 msgr2=0x55df71e82b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaaae00640 1 --2- 172.21.15.175:0/246725891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df71ef3b20 0x55df71e82b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaaae00640 1 -- 172.21.15.175:0/246725891 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df71e81c50 con 0x55df71ef4000 2024-04-25T09:10:14.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaaa400640 1 --2- 172.21.15.175:0/246725891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df71ef3740 0x55df71f11030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:14.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaa9a00640 1 --2- 172.21.15.175:0/246725891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df71ef3b20 0x55df71e82b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:14.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaaae00640 1 --2- 172.21.15.175:0/246725891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df71ef4000 0x55df71e66b80 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7feaa400a4b0 tx=0x7feaa40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db605ecaba60b932 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaa3e00640 1 -- 172.21.15.175:0/246725891 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa40b3420 con 0x55df71ef4000 2024-04-25T09:10:14.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaa3e00640 1 -- 172.21.15.175:0/246725891 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa40b35c0 con 0x55df71ef4000 2024-04-25T09:10:14.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaa3e00640 1 -- 172.21.15.175:0/246725891 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa40b3990 con 0x55df71ef4000 2024-04-25T09:10:14.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 -- 172.21.15.175:0/246725891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df71ef4000 msgr2=0x55df71e66b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 --2- 172.21.15.175:0/246725891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df71ef4000 0x55df71e66b80 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7feaa400a4b0 tx=0x7feaa40033b0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 -- 172.21.15.175:0/246725891 shutdown_connections 2024-04-25T09:10:14.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 --2- 172.21.15.175:0/246725891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df71ef4000 0x55df71e66b80 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 --2- 172.21.15.175:0/246725891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df71ef3b20 0x55df71e82b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 --2- 172.21.15.175:0/246725891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df71ef3740 0x55df71f11030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 -- 172.21.15.175:0/246725891 >> 172.21.15.175:0/246725891 conn(0x55df71e3b420 msgr2=0x55df71ef5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 -- 172.21.15.175:0/246725891 shutdown_connections 2024-04-25T09:10:14.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 -- 172.21.15.175:0/246725891 wait complete. 2024-04-25T09:10:14.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 Processor -- start 2024-04-25T09:10:14.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 -- start start 2024-04-25T09:10:14.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df71ef3740 0x55df71e64410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df71ef3b20 0x55df71f0fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df71ef4000 0x55df71f12f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df71e82190 con 0x55df71ef4000 2024-04-25T09:10:14.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df71e81ef0 con 0x55df71ef3b20 2024-04-25T09:10:14.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.494+0000 7feaad203080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df71e82430 con 0x55df71ef3740 2024-04-25T09:10:14.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaaa400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df71ef3740 0x55df71e64410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaaa400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df71ef3740 0x55df71e64410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:34104/0 (socket says 172.21.15.175:34104) 2024-04-25T09:10:14.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaaa400640 1 -- 172.21.15.175:0/3307216014 learned_addr learned my addr 172.21.15.175:0/3307216014 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:14.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaaae00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df71ef4000 0x55df71f12f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaa9a00640 1 --2- 172.21.15.175:0/3307216014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df71ef3b20 0x55df71f0fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaaa400640 1 -- 172.21.15.175:0/3307216014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df71ef3b20 msgr2=0x55df71f0fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaaa400640 1 --2- 172.21.15.175:0/3307216014 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55df71ef3b20 0x55df71f0fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaaa400640 1 -- 172.21.15.175:0/3307216014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df71ef4000 msgr2=0x55df71f12f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaaa400640 1 --2- 172.21.15.175:0/3307216014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55df71ef4000 0x55df71f12f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaaa400640 1 -- 172.21.15.175:0/3307216014 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df71f15150 con 0x55df71ef3740 2024-04-25T09:10:14.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaaa400640 1 --2- 172.21.15.175:0/3307216014 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df71ef3740 0x55df71e64410 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0087e0 tx=0x7fea9c008ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaa2a00640 1 -- 172.21.15.175:0/3307216014 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c006b20 con 0x55df71ef3740 2024-04-25T09:10:14.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaa2a00640 1 -- 172.21.15.175:0/3307216014 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c006cc0 con 0x55df71ef3740 2024-04-25T09:10:14.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaa2a00640 1 -- 172.21.15.175:0/3307216014 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c015660 con 0x55df71ef3740 2024-04-25T09:10:14.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaad203080 1 -- 172.21.15.175:0/3307216014 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55df71f153f0 con 0x55df71ef3740 2024-04-25T09:10:14.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaad203080 1 -- 172.21.15.175:0/3307216014 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df71f15930 con 0x55df71ef3740 2024-04-25T09:10:14.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaa2a00640 1 -- 172.21.15.175:0/3307216014 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fea9c01c020 con 0x55df71ef3740 2024-04-25T09:10:14.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaa2a00640 1 --2- 172.21.15.175:0/3307216014 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea8c065940 0x7fea8c067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.498+0000 7feaa2a00640 1 -- 172.21.15.175:0/3307216014 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fea9c0842d0 con 0x55df71ef3740 2024-04-25T09:10:14.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.502+0000 7feaa9a00640 1 --2- 172.21.15.175:0/3307216014 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea8c065940 0x7fea8c067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.502+0000 7feaad203080 1 --2- 172.21.15.175:0/3307216014 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55df71f10160 0x55df71f1a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.502+0000 7feaad203080 1 -- 172.21.15.175:0/3307216014 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:1 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e85) v9 -- 0x55df71e66f20 con 0x55df71f10160 2024-04-25T09:10:14.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.502+0000 7feaaae00640 1 --2- 172.21.15.175:0/3307216014 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55df71f10160 0x55df71f1a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.502+0000 7feaa9a00640 1 --2- 172.21.15.175:0/3307216014 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea8c065940 0x7fea8c067e00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fea98010560 tx=0x7fea98003900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.502+0000 7feaaae00640 1 --2- 172.21.15.175:0/3307216014 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55df71f10160 0x55df71f1a320 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.506+0000 7feaaae00640 1 -- 172.21.15.175:0/3307216014 <== osd.0 v2:172.21.15.175:6800/1093269849 1 ==== osd_op_reply(1 10000000000.00000000 [delete] v85'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7feaa40bc040 con 0x55df71f10160 2024-04-25T09:10:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.506+0000 7feaad203080 1 -- 172.21.15.175:0/3307216014 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55df71f10160 msgr2=0x55df71f1a320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.506+0000 7feaad203080 1 --2- 172.21.15.175:0/3307216014 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55df71f10160 0x55df71f1a320 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.506+0000 7feaad203080 1 -- 172.21.15.175:0/3307216014 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea8c065940 msgr2=0x7fea8c067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.506+0000 7feaad203080 1 --2- 172.21.15.175:0/3307216014 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea8c065940 0x7fea8c067e00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fea98010560 tx=0x7fea98003900 comp rx=0 tx=0).stop 2024-04-25T09:10:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.506+0000 7feaad203080 1 -- 172.21.15.175:0/3307216014 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df71ef3740 msgr2=0x55df71e64410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.506+0000 7feaad203080 1 --2- 172.21.15.175:0/3307216014 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55df71ef3740 0x55df71e64410 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fea9c0087e0 tx=0x7fea9c008ca0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.506+0000 7feaaae00640 1 -- 172.21.15.175:0/3307216014 reap_dead start 2024-04-25T09:10:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.506+0000 7feaad203080 1 -- 172.21.15.175:0/3307216014 shutdown_connections 2024-04-25T09:10:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.506+0000 7feaad203080 1 -- 172.21.15.175:0/3307216014 >> 172.21.15.175:0/3307216014 conn(0x55df71e3b420 msgr2=0x55df71e39770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.506+0000 7feaad203080 1 -- 172.21.15.175:0/3307216014 shutdown_connections 2024-04-25T09:10:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.506+0000 7feaad203080 1 -- 172.21.15.175:0/3307216014 wait complete. 2024-04-25T09:10:14.500 DEBUG:teuthology.orchestra.run.smithi175:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2024-04-25T09:10:14.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.598+0000 7ffa49138400 1 -- start start 2024-04-25T09:10:14.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.598+0000 7ffa49138400 1 Processor -- start 2024-04-25T09:10:14.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.598+0000 7ffa49138400 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbae377800 0x55bbae530580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.598+0000 7ffa49138400 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbae377400 0x55bbae530b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.598+0000 7ffa49138400 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbae377000 0x55bbae531080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.598+0000 7ffa49138400 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbae46a600 con 0x55bbae377800 2024-04-25T09:10:14.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.598+0000 7ffa49138400 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbae46a480 con 0x55bbae377400 2024-04-25T09:10:14.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.598+0000 7ffa49138400 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bbae46a300 con 0x55bbae377000 2024-04-25T09:10:14.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.598+0000 7ffa47200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbae377800 0x55bbae530580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.598+0000 7ffa47200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbae377800 0x55bbae530580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35306/0 (socket says 172.21.15.175:35306) 2024-04-25T09:10:14.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.598+0000 7ffa47200640 1 -- 172.21.15.175:0/2260948889 learned_addr learned my addr 172.21.15.175:0/2260948889 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:14.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.598+0000 7ffa46800640 1 --2- 172.21.15.175:0/2260948889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbae377400 0x55bbae530b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.598+0000 7ffa47c00640 1 --2- 172.21.15.175:0/2260948889 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbae377000 0x55bbae531080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.598+0000 7ffa47200640 1 -- 172.21.15.175:0/2260948889 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbae377000 msgr2=0x55bbae531080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.598+0000 7ffa47200640 1 --2- 172.21.15.175:0/2260948889 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbae377000 0x55bbae531080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.598+0000 7ffa47200640 1 -- 172.21.15.175:0/2260948889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbae377400 msgr2=0x55bbae530b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.598+0000 7ffa47200640 1 --2- 172.21.15.175:0/2260948889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbae377400 0x55bbae530b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa47200640 1 -- 172.21.15.175:0/2260948889 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbae40e960 con 0x55bbae377800 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa47200640 1 --2- 172.21.15.175:0/2260948889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbae377800 0x55bbae530580 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x55bbaf1d5380 tx=0x55bbaf278240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1986dca3640cd56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa44000640 1 -- 172.21.15.175:0/2260948889 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bbae3ac4e0 con 0x55bbae377800 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa44000640 1 -- 172.21.15.175:0/2260948889 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bbae3c0540 con 0x55bbae377800 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa44000640 1 -- 172.21.15.175:0/2260948889 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bbae3acb60 con 0x55bbae377800 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa49138400 1 -- 172.21.15.175:0/2260948889 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbae40ed20 con 0x55bbae377800 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa49138400 1 -- 172.21.15.175:0/2260948889 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55bbae40ef00 con 0x55bbae377800 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa49138400 4 waiting for MDS map... 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa44000640 1 -- 172.21.15.175:0/2260948889 <== mon.0 v2:172.21.15.175:3300/0 4 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x55bbaf294600 con 0x55bbae377800 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa44000640 1 -- 172.21.15.175:0/2260948889 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 59) v1 ==== 2723+0+0 (secure 0 0 0) 0x55bbae3cd180 con 0x55bbae377800 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa49138400 4 Got MDS map 59 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa49138400 10 main: JournalTool::main 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa49138400 4 main: JournalTool: connecting to RADOS... 2024-04-25T09:10:14.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa49138400 1 Processor -- start 2024-04-25T09:10:14.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa49138400 1 -- start start 2024-04-25T09:10:14.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa49138400 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbaf274c00 0x55bbae531600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa49138400 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbaf275000 0x55bbae531b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa49138400 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275400 0x55bbae532100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa49138400 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbae46a180 con 0x55bbaf275400 2024-04-25T09:10:14.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa49138400 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbae3d6480 con 0x55bbaf274c00 2024-04-25T09:10:14.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa49138400 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bbae3d6900 con 0x55bbaf275000 2024-04-25T09:10:14.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa46800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275400 0x55bbae532100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa46800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275400 0x55bbae532100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35314/0 (socket says 172.21.15.175:35314) 2024-04-25T09:10:14.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa46800640 1 -- 172.21.15.175:0/2492955588 learned_addr learned my addr 172.21.15.175:0/2492955588 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:14.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa47200640 1 --2- 172.21.15.175:0/2492955588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbaf275000 0x55bbae531b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa47c00640 1 --2- 172.21.15.175:0/2492955588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbaf274c00 0x55bbae531600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa46800640 1 -- 172.21.15.175:0/2492955588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbaf275000 msgr2=0x55bbae531b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa46800640 1 --2- 172.21.15.175:0/2492955588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbaf275000 0x55bbae531b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa46800640 1 -- 172.21.15.175:0/2492955588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbaf274c00 msgr2=0x55bbae531600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa46800640 1 --2- 172.21.15.175:0/2492955588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbaf274c00 0x55bbae531600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa46800640 1 -- 172.21.15.175:0/2492955588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbae40ed20 con 0x55bbaf275400 2024-04-25T09:10:14.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa46800640 1 --2- 172.21.15.175:0/2492955588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275400 0x55bbae532100 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x55bbaf1d4990 tx=0x55bbae42ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1024b047710119f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa41800640 1 -- 172.21.15.175:0/2492955588 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bbae3ac9c0 con 0x55bbaf275400 2024-04-25T09:10:14.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa41800640 1 -- 172.21.15.175:0/2492955588 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bbae3c0a80 con 0x55bbaf275400 2024-04-25T09:10:14.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.602+0000 7ffa41800640 1 -- 172.21.15.175:0/2492955588 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bbae3ac4e0 con 0x55bbaf275400 2024-04-25T09:10:14.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 -- 172.21.15.175:0/2492955588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275400 msgr2=0x55bbae532100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 --2- 172.21.15.175:0/2492955588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275400 0x55bbae532100 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x55bbaf1d4990 tx=0x55bbae42ff20 comp rx=0 tx=0).stop 2024-04-25T09:10:14.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 -- 172.21.15.175:0/2492955588 shutdown_connections 2024-04-25T09:10:14.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 --2- 172.21.15.175:0/2492955588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275400 0x55bbae532100 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 --2- 172.21.15.175:0/2492955588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbaf275000 0x55bbae531b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 --2- 172.21.15.175:0/2492955588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbaf274c00 0x55bbae531600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 -- 172.21.15.175:0/2492955588 >> 172.21.15.175:0/2492955588 conn(0x55bbae376c00 msgr2=0x55bbae3a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 -- 172.21.15.175:0/2492955588 shutdown_connections 2024-04-25T09:10:14.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 -- 172.21.15.175:0/2492955588 wait complete. 2024-04-25T09:10:14.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 Processor -- start 2024-04-25T09:10:14.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 -- start start 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbaf274c00 0x55bbae533180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275000 0x55bbae532c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbaf275400 0x55bbae532680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbae46b200 con 0x55bbaf275000 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbae46a180 con 0x55bbaf274c00 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bbae46b380 con 0x55bbaf275400 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa47200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275000 0x55bbae532c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa47200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275000 0x55bbae532c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35322/0 (socket says 172.21.15.175:35322) 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa47200640 1 -- 172.21.15.175:0/4293702984 learned_addr learned my addr 172.21.15.175:0/4293702984 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa47c00640 1 --2- 172.21.15.175:0/4293702984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbaf274c00 0x55bbae533180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa46800640 1 --2- 172.21.15.175:0/4293702984 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbaf275400 0x55bbae532680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa47200640 1 -- 172.21.15.175:0/4293702984 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbaf275400 msgr2=0x55bbae532680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa47200640 1 --2- 172.21.15.175:0/4293702984 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbaf275400 0x55bbae532680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa47200640 1 -- 172.21.15.175:0/4293702984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbaf274c00 msgr2=0x55bbae533180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa47200640 1 --2- 172.21.15.175:0/4293702984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbaf274c00 0x55bbae533180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa47200640 1 -- 172.21.15.175:0/4293702984 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbae40fa40 con 0x55bbaf275000 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa47200640 1 --2- 172.21.15.175:0/4293702984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275000 0x55bbae532c00 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x55bbaf2873b0 tx=0x55bbaf278060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa3fa00640 1 -- 172.21.15.175:0/4293702984 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bbae3ac340 con 0x55bbaf275000 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa3fa00640 1 -- 172.21.15.175:0/4293702984 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bbae3c1500 con 0x55bbaf275000 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 -- 172.21.15.175:0/4293702984 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bbae40fc20 con 0x55bbaf275000 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa3fa00640 1 -- 172.21.15.175:0/4293702984 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bbae3ac9c0 con 0x55bbaf275000 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 1 -- 172.21.15.175:0/4293702984 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbae40e1e0 con 0x55bbaf275000 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.606+0000 7ffa49138400 4 main: JournalTool: resolving pool 12 2024-04-25T09:10:14.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.610+0000 7ffa3fa00640 1 -- 172.21.15.175:0/4293702984 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x55bbaf2f0c00 con 0x55bbaf275000 2024-04-25T09:10:14.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.610+0000 7ffa3fa00640 1 --2- 172.21.15.175:0/4293702984 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55bbae6a7000 0x55bbae533700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.610+0000 7ffa3fa00640 1 -- 172.21.15.175:0/4293702984 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x55bbae6a4600 con 0x55bbaf275000 2024-04-25T09:10:14.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.610+0000 7ffa49138400 4 main: JournalTool: creating IoCtx.. 2024-04-25T09:10:14.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.610+0000 7ffa49138400 4 main: Executing for rank 0 2024-04-25T09:10:14.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.610+0000 7ffa47c00640 1 --2- 172.21.15.175:0/4293702984 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55bbae6a7000 0x55bbae533700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.610+0000 7ffa47c00640 1 --2- 172.21.15.175:0/4293702984 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55bbae6a7000 0x55bbae533700 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x55bbae4847e0 tx=0x55bbae798c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.610+0000 7ffa49138400 1 -- start start 2024-04-25T09:10:14.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.610+0000 7ffa49138400 1 Processor -- start 2024-04-25T09:10:14.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.610+0000 7ffa49138400 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275c00 0x55bbae532100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.610+0000 7ffa49138400 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbae7e8000 0x55bbae531b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.610+0000 7ffa49138400 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbae7e8400 0x55bbae531600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.610+0000 7ffa49138400 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbae46b680 con 0x55bbaf275c00 2024-04-25T09:10:14.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.610+0000 7ffa49138400 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbae46b800 con 0x55bbae7e8400 2024-04-25T09:10:14.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.610+0000 7ffa49138400 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bbae3d6900 con 0x55bbae7e8000 2024-04-25T09:10:14.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.610+0000 7ffa47c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275c00 0x55bbae532100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.610+0000 7ffa47c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275c00 0x55bbae532100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35338/0 (socket says 172.21.15.175:35338) 2024-04-25T09:10:14.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.610+0000 7ffa47c00640 1 -- 172.21.15.175:0/1219409370 learned_addr learned my addr 172.21.15.175:0/1219409370 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:14.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa47200640 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbae7e8000 0x55bbae531b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa46800640 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbae7e8400 0x55bbae531600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa47c00640 1 -- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbae7e8000 msgr2=0x55bbae531b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa47c00640 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbae7e8000 0x55bbae531b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa47c00640 1 -- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbae7e8400 msgr2=0x55bbae531600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa47c00640 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbae7e8400 0x55bbae531600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa47c00640 1 -- 172.21.15.175:0/1219409370 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbae7e05a0 con 0x55bbaf275c00 2024-04-25T09:10:14.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa47200640 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbae7e8000 0x55bbae531b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:14.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa47c00640 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275c00 0x55bbae532100 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x55bbae74f680 tx=0x55bbaf278180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b62cce9f97492c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa3be00640 1 -- 172.21.15.175:0/1219409370 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bbae6de1a0 con 0x55bbaf275c00 2024-04-25T09:10:14.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa3be00640 1 -- 172.21.15.175:0/1219409370 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bbae3c01c0 con 0x55bbaf275c00 2024-04-25T09:10:14.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa3be00640 1 -- 172.21.15.175:0/1219409370 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bbae6df6c0 con 0x55bbaf275c00 2024-04-25T09:10:14.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbae7e0780 con 0x55bbaf275c00 2024-04-25T09:10:14.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55bbae7e0960 con 0x55bbaf275c00 2024-04-25T09:10:14.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa49138400 4 waiting for MDS map... 2024-04-25T09:10:14.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa3be00640 1 -- 172.21.15.175:0/1219409370 <== mon.0 v2:172.21.15.175:3300/0 4 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x55bbae7ee600 con 0x55bbaf275c00 2024-04-25T09:10:14.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa3be00640 1 -- 172.21.15.175:0/1219409370 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 59) v1 ==== 2723+0+0 (secure 0 0 0) 0x55bbae7f4000 con 0x55bbaf275c00 2024-04-25T09:10:14.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa49138400 4 Got MDS map 59 2024-04-25T09:10:14.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa49138400 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55bbae7e8800 0x55bbae806000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:1 12.f 12:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e85) v9 -- 0x55bbae7e8c00 con 0x55bbae7e8800 2024-04-25T09:10:14.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa47200640 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55bbae7e8800 0x55bbae806000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa47200640 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55bbae7e8800 0x55bbae806000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=41102dd79623d021 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa47200640 1 -- 172.21.15.175:0/1219409370 <== osd.6 v2:172.21.15.177:6822/4132808595 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55bbae4f2000 con 0x55bbae7e8800 2024-04-25T09:10:14.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa49138400 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55bbae7e9000 0x55bbae806580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:2 12.14 12:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e85) v9 -- 0x55bbae7e9400 con 0x55bbae7e9000 2024-04-25T09:10:14.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa46800640 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55bbae7e9000 0x55bbae806580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.614+0000 7ffa46800640 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55bbae7e9000 0x55bbae806580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=2bb4d88dad17b188 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.618+0000 7ffa46800640 1 -- 172.21.15.175:0/1219409370 <== osd.5 v2:172.21.15.177:6816/3311807078 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55bbae4f2500 con 0x55bbae7e9000 2024-04-25T09:10:14.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.618+0000 7ffa3a000640 1 -- 172.21.15.175:0/1219409370 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:3 12.14 12:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e85) v9 -- 0x55bbaf147400 con 0x55bbae7e9000 2024-04-25T09:10:14.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.618+0000 7ffa3a000640 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55bbaf147000 0x55bbae808680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.618+0000 7ffa3a000640 1 -- 172.21.15.175:0/1219409370 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:4 12.1b 12:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e85) v9 -- 0x55bbaf146c00 con 0x55bbaf147000 2024-04-25T09:10:14.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.618+0000 7ffa46800640 1 -- 172.21.15.175:0/1219409370 <== osd.5 v2:172.21.15.177:6816/3311807078 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv17 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x55bbae4f2500 con 0x55bbae7e9000 2024-04-25T09:10:14.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.618+0000 7ffa47c00640 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55bbaf147000 0x55bbae808680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.618+0000 7ffa47c00640 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55bbaf147000 0x55bbae808680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=9d64955c7783ef3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.618+0000 7ffa47c00640 1 -- 172.21.15.175:0/1219409370 <== osd.4 v2:172.21.15.177:6808/236493968 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bbae4f2780 con 0x55bbaf147000 2024-04-25T09:10:14.612 INFO:teuthology.orchestra.run.smithi175.stdout:old journal was 4212018~2544 2024-04-25T09:10:14.612 INFO:teuthology.orchestra.run.smithi175.stdout:new journal start will be 8388608 (4174046 bytes past old end) 2024-04-25T09:10:14.612 INFO:teuthology.orchestra.run.smithi175.stdout:writing journal head 2024-04-25T09:10:14.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.618+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:5 12.14 12:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85) v9 -- 0x55bbae7e9800 con 0x55bbae7e9000 2024-04-25T09:10:14.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.622+0000 7ffa46800640 1 -- 172.21.15.175:0/1219409370 <== osd.5 v2:172.21.15.177:6816/3311807078 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v85'21 uv21 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55bbae4f2500 con 0x55bbae7e9000 2024-04-25T09:10:14.613 INFO:teuthology.orchestra.run.smithi175.stdout:writing EResetJournal entry 2024-04-25T09:10:14.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.622+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:6 12.1b 12:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85) v9 -- 0x55bbae7f1400 con 0x55bbaf147000 2024-04-25T09:10:14.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.622+0000 7ffa49138400 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55bbae7f1800 0x55bbae806b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.622+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:7 12.b 12:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85) v9 -- 0x55bbae7f1c00 con 0x55bbae7f1800 2024-04-25T09:10:14.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.622+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:8 12.1f 12:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85) v9 -- 0x55bbae7e9400 con 0x55bbae7e8800 2024-04-25T09:10:14.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.622+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:9 12.1a 12:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85) v9 -- 0x55bbaf146800 con 0x55bbaf147000 2024-04-25T09:10:14.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.622+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:10 12.1e 12:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85) v9 -- 0x55bbae81a000 con 0x55bbaf147000 2024-04-25T09:10:14.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.622+0000 7ffa49138400 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55bbae81a400 0x55bbae807080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.622+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:11 12.1d 12:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85) v9 -- 0x55bbae81a800 con 0x55bbae81a400 2024-04-25T09:10:14.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.622+0000 7ffa47200640 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55bbae7f1800 0x55bbae806b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.622+0000 7ffa46800640 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55bbae81a400 0x55bbae807080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.622+0000 7ffa47200640 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55bbae7f1800 0x55bbae806b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=8d28feba48352c1a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.622+0000 7ffa46800640 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55bbae81a400 0x55bbae807080 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=6caf28c50c804fac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.622+0000 7ffa47c00640 1 -- 172.21.15.175:0/1219409370 <== osd.4 v2:172.21.15.177:6808/236493968 2 ==== osd_op_reply(6 200.00000002 [delete] v85'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bbae4f2780 con 0x55bbaf147000 2024-04-25T09:10:14.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.622+0000 7ffa47c00640 1 -- 172.21.15.175:0/1219409370 <== osd.4 v2:172.21.15.177:6808/236493968 3 ==== osd_op_reply(9 200.00000005 [delete] v85'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bbae4f2780 con 0x55bbaf147000 2024-04-25T09:10:14.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa47c00640 1 -- 172.21.15.175:0/1219409370 <== osd.4 v2:172.21.15.177:6808/236493968 4 ==== osd_op_reply(10 200.00000006 [delete] v85'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bbae4f2780 con 0x55bbaf147000 2024-04-25T09:10:14.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa47200640 1 -- 172.21.15.175:0/1219409370 <== osd.6 v2:172.21.15.177:6822/4132808595 2 ==== osd_op_reply(8 200.00000004 [delete] v85'7 uv6 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bbae4f2000 con 0x55bbae7e8800 2024-04-25T09:10:14.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa47200640 1 -- 172.21.15.175:0/1219409370 <== osd.3 v2:172.21.15.175:6816/4078277957 1 ==== osd_op_reply(7 200.00000003 [delete] v85'4 uv3 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bbae4f2000 con 0x55bbae7f1800 2024-04-25T09:10:14.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa3a000640 1 -- 172.21.15.175:0/1219409370 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:12 12.1b 12:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85) v9 -- 0x55bbae7f0c00 con 0x55bbaf147000 2024-04-25T09:10:14.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa46800640 1 -- 172.21.15.175:0/1219409370 <== osd.0 v2:172.21.15.175:6800/1093269849 1 ==== osd_op_reply(11 200.00000007 [delete] v85'3 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bbae4f2500 con 0x55bbae81a400 2024-04-25T09:10:14.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa47c00640 1 -- 172.21.15.175:0/1219409370 <== osd.4 v2:172.21.15.177:6808/236493968 5 ==== osd_op_reply(12 200.00000002 [write 0~48] v85'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55bbae4f2780 con 0x55bbaf147000 2024-04-25T09:10:14.618 INFO:teuthology.orchestra.run.smithi175.stdout:done 2024-04-25T09:10:14.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55bbae81a400 msgr2=0x55bbae807080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55bbae81a400 0x55bbae807080 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55bbae7f1800 msgr2=0x55bbae806b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55bbae7f1800 0x55bbae806b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55bbaf147000 msgr2=0x55bbae808680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55bbaf147000 0x55bbae808680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55bbae7e9000 msgr2=0x55bbae806580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55bbae7e9000 0x55bbae806580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55bbae7e8800 msgr2=0x55bbae806000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55bbae7e8800 0x55bbae806000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275c00 msgr2=0x55bbae532100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa46800640 1 -- 172.21.15.175:0/1219409370 reap_dead start 2024-04-25T09:10:14.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 --2- 172.21.15.175:0/1219409370 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275c00 0x55bbae532100 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x55bbae74f680 tx=0x55bbaf278180 comp rx=0 tx=0).stop 2024-04-25T09:10:14.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa46800640 1 -- 172.21.15.175:0/1219409370 reap_dead start 2024-04-25T09:10:14.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa46800640 1 -- 172.21.15.175:0/1219409370 reap_dead start 2024-04-25T09:10:14.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 shutdown_connections 2024-04-25T09:10:14.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 >> 172.21.15.175:0/1219409370 conn(0x55bbaf275800 msgr2=0x55bbae3a2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 shutdown_connections 2024-04-25T09:10:14.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 -- 172.21.15.175:0/1219409370 wait complete. 2024-04-25T09:10:14.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 -- 172.21.15.175:0/4293702984 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55bbae6a7000 msgr2=0x55bbae533700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 --2- 172.21.15.175:0/4293702984 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55bbae6a7000 0x55bbae533700 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x55bbae4847e0 tx=0x55bbae798c00 comp rx=0 tx=0).stop 2024-04-25T09:10:14.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 -- 172.21.15.175:0/4293702984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275000 msgr2=0x55bbae532c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 --2- 172.21.15.175:0/4293702984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275000 0x55bbae532c00 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x55bbaf2873b0 tx=0x55bbaf278060 comp rx=0 tx=0).stop 2024-04-25T09:10:14.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 -- 172.21.15.175:0/4293702984 shutdown_connections 2024-04-25T09:10:14.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 --2- 172.21.15.175:0/4293702984 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55bbae6a7000 0x55bbae533700 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 --2- 172.21.15.175:0/4293702984 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbaf275400 0x55bbae532680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 --2- 172.21.15.175:0/4293702984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbaf275000 0x55bbae532c00 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 --2- 172.21.15.175:0/4293702984 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbaf274c00 0x55bbae533180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 -- 172.21.15.175:0/4293702984 >> 172.21.15.175:0/4293702984 conn(0x55bbae376c00 msgr2=0x55bbae3a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.626+0000 7ffa49138400 1 -- 172.21.15.175:0/4293702984 shutdown_connections 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.630+0000 7ffa49138400 1 -- 172.21.15.175:0/4293702984 wait complete. 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.630+0000 7ffa49138400 1 -- 172.21.15.175:0/2260948889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbae377800 msgr2=0x55bbae530580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.630+0000 7ffa49138400 1 --2- 172.21.15.175:0/2260948889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbae377800 0x55bbae530580 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x55bbaf1d5380 tx=0x55bbaf278240 comp rx=0 tx=0).stop 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.630+0000 7ffa49138400 1 -- 172.21.15.175:0/2260948889 shutdown_connections 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.630+0000 7ffa49138400 1 --2- 172.21.15.175:0/2260948889 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55bbae377000 0x55bbae531080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.630+0000 7ffa49138400 1 --2- 172.21.15.175:0/2260948889 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55bbae377400 0x55bbae530b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.630+0000 7ffa49138400 1 --2- 172.21.15.175:0/2260948889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55bbae377800 0x55bbae530580 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.630+0000 7ffa49138400 1 -- 172.21.15.175:0/2260948889 >> 172.21.15.175:0/2260948889 conn(0x55bbae377c00 msgr2=0x55bbae3a3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.630+0000 7ffa49138400 1 -- 172.21.15.175:0/2260948889 shutdown_connections 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.630+0000 7ffa49138400 1 -- 172.21.15.175:0/2260948889 wait complete. 2024-04-25T09:10:14.624 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:00.123814, result: old journal was 4212018~2544 new journal start will be 8388608 (4174046 bytes past old end) writing journal head writing EResetJournal entry done 2024-04-25T09:10:14.624 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T09:10:14.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.810+0000 7f787da00640 1 Processor -- start 2024-04-25T09:10:14.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f787da00640 1 -- start start 2024-04-25T09:10:14.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f787da00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7878145250 0x7f78780cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f787da00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f78781600a0 0x7f78780cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f787da00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f78780ce970 0x7f78780cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f787da00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787815f650 con 0x7f78781600a0 2024-04-25T09:10:14.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f787da00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78780cfd10 con 0x7f78780ce970 2024-04-25T09:10:14.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f787da00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78780cfff0 con 0x7f7878145250 2024-04-25T09:10:14.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f786fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f78781600a0 0x7f78780cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f786fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f78781600a0 0x7f78780cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35340/0 (socket says 172.21.15.175:35340) 2024-04-25T09:10:14.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f786fe00640 1 -- 172.21.15.175:0/2517512953 learned_addr learned my addr 172.21.15.175:0/2517512953 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:14.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f7876a00640 1 --2- 172.21.15.175:0/2517512953 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7878145250 0x7f78780cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f786fe00640 1 -- 172.21.15.175:0/2517512953 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7878145250 msgr2=0x7f78780cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f7877400640 1 --2- 172.21.15.175:0/2517512953 >> v2:172.21.15.177:3300/0 conn(0x7f78780ce970 0x7f78780cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f786fe00640 1 --2- 172.21.15.175:0/2517512953 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7878145250 0x7f78780cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f786fe00640 1 -- 172.21.15.175:0/2517512953 >> v2:172.21.15.177:3300/0 conn(0x7f78780ce970 msgr2=0x7f78780cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f786fe00640 1 --2- 172.21.15.175:0/2517512953 >> v2:172.21.15.177:3300/0 conn(0x7f78780ce970 0x7f78780cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f786fe00640 1 -- 172.21.15.175:0/2517512953 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787815f8a0 con 0x7f78781600a0 2024-04-25T09:10:14.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f7876a00640 1 --2- 172.21.15.175:0/2517512953 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7878145250 0x7f78780cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:14.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.814+0000 7f7877400640 1 --2- 172.21.15.175:0/2517512953 >> v2:172.21.15.177:3300/0 conn(0x7f78780ce970 0x7f78780cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:14.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.818+0000 7f786fe00640 1 --2- 172.21.15.175:0/2517512953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78781600a0 0x7f78780cc410 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f7878071260 tx=0x7f786001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969e61f895ece15f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.818+0000 7f7876000640 1 -- 172.21.15.175:0/2517512953 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78600aa430 con 0x7f78781600a0 2024-04-25T09:10:14.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.818+0000 7f7876000640 1 -- 172.21.15.175:0/2517512953 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78600af070 con 0x7f78781600a0 2024-04-25T09:10:14.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.818+0000 7f7876000640 1 -- 172.21.15.175:0/2517512953 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78600aa7f0 con 0x7f78781600a0 2024-04-25T09:10:14.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.818+0000 7f787da00640 1 -- 172.21.15.175:0/2517512953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78781600a0 msgr2=0x7f78780cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.818+0000 7f787da00640 1 --2- 172.21.15.175:0/2517512953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78781600a0 0x7f78780cc410 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f7878071260 tx=0x7f786001c4f0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.818+0000 7f787da00640 1 -- 172.21.15.175:0/2517512953 shutdown_connections 2024-04-25T09:10:14.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.818+0000 7f787da00640 1 --2- 172.21.15.175:0/2517512953 >> v2:172.21.15.177:3300/0 conn(0x7f78780ce970 0x7f78780cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.818+0000 7f787da00640 1 --2- 172.21.15.175:0/2517512953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78781600a0 0x7f78780cc410 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.818+0000 7f787da00640 1 --2- 172.21.15.175:0/2517512953 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7878145250 0x7f78780cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.818+0000 7f787da00640 1 -- 172.21.15.175:0/2517512953 >> 172.21.15.175:0/2517512953 conn(0x7f787806ac50 msgr2=0x7f787806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.818+0000 7f787da00640 1 -- 172.21.15.175:0/2517512953 shutdown_connections 2024-04-25T09:10:14.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.818+0000 7f787da00640 1 -- 172.21.15.175:0/2517512953 wait complete. 2024-04-25T09:10:14.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.818+0000 7f787da00640 1 Processor -- start 2024-04-25T09:10:14.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.818+0000 7f787da00640 1 -- start start 2024-04-25T09:10:14.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f787da00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78780ce970 0x7f7878140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f787da00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7878145250 0x7f787815a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f787da00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78781600a0 0x7f7878163ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f787da00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7878145630 con 0x7f7878145250 2024-04-25T09:10:14.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f787da00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7878160500 con 0x7f78781600a0 2024-04-25T09:10:14.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f787da00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787815c870 con 0x7f78780ce970 2024-04-25T09:10:14.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f786fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7878145250 0x7f787815a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f786fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7878145250 0x7f787815a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35346/0 (socket says 172.21.15.175:35346) 2024-04-25T09:10:14.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f786fe00640 1 -- 172.21.15.175:0/3682759603 learned_addr learned my addr 172.21.15.175:0/3682759603 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:14.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f7876a00640 1 --2- 172.21.15.175:0/3682759603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78780ce970 0x7f7878140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f7877400640 1 --2- 172.21.15.175:0/3682759603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78781600a0 0x7f7878163ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f786fe00640 1 -- 172.21.15.175:0/3682759603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78780ce970 msgr2=0x7f7878140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f786fe00640 1 --2- 172.21.15.175:0/3682759603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78780ce970 0x7f7878140430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f786fe00640 1 -- 172.21.15.175:0/3682759603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78781600a0 msgr2=0x7f7878163ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f786fe00640 1 --2- 172.21.15.175:0/3682759603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78781600a0 0x7f7878163ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f786fe00640 1 -- 172.21.15.175:0/3682759603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7878160c40 con 0x7f7878145250 2024-04-25T09:10:14.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f7876a00640 1 --2- 172.21.15.175:0/3682759603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78780ce970 0x7f7878140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:14.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f786fe00640 1 --2- 172.21.15.175:0/3682759603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7878145250 0x7f787815a990 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f78600ac040 tx=0x7f7860019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f786ea00640 1 -- 172.21.15.175:0/3682759603 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78600b4610 con 0x7f7878145250 2024-04-25T09:10:14.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f786ea00640 1 -- 172.21.15.175:0/3682759603 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78600b47d0 con 0x7f7878145250 2024-04-25T09:10:14.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f787da00640 1 -- 172.21.15.175:0/3682759603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7878160f20 con 0x7f7878145250 2024-04-25T09:10:14.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f786ea00640 1 -- 172.21.15.175:0/3682759603 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78600b4bc0 con 0x7f7878145250 2024-04-25T09:10:14.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f787da00640 1 -- 172.21.15.175:0/3682759603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78781614e0 con 0x7f7878145250 2024-04-25T09:10:14.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f787da00640 1 -- 172.21.15.175:0/3682759603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7878075160 con 0x7f7878145250 2024-04-25T09:10:14.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.822+0000 7f786ea00640 1 -- 172.21.15.175:0/3682759603 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f78600bc020 con 0x7f7878145250 2024-04-25T09:10:14.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.826+0000 7f786ea00640 1 --2- 172.21.15.175:0/3682759603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7854066f60 0x7f7854069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.826+0000 7f786ea00640 1 -- 172.21.15.175:0/3682759603 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f786011f860 con 0x7f7878145250 2024-04-25T09:10:14.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.826+0000 7f7876a00640 1 --2- 172.21.15.175:0/3682759603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7854066f60 0x7f7854069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.826+0000 7f7876a00640 1 --2- 172.21.15.175:0/3682759603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7854066f60 0x7f7854069420 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7868006fd0 tx=0x7f7868008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:14.830+0000 7f786ea00640 1 -- 172.21.15.175:0/3682759603 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7860016110 con 0x7f7878145250 2024-04-25T09:10:15.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.018+0000 7f787da00640 1 -- 172.21.15.175:0/3682759603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f787815be40 con 0x7f7878145250 2024-04-25T09:10:15.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.486+0000 7f786ea00640 1 -- 172.21.15.175:0/3682759603 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v60) v1 ==== 162+0+0 (secure 0 0 0) 0x7f78600f0800 con 0x7f7878145250 2024-04-25T09:10:15.478 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T09:10:15.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.490+0000 7f787da00640 1 -- 172.21.15.175:0/3682759603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7854066f60 msgr2=0x7f7854069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.490+0000 7f787da00640 1 --2- 172.21.15.175:0/3682759603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7854066f60 0x7f7854069420 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7868006fd0 tx=0x7f7868008040 comp rx=0 tx=0).stop 2024-04-25T09:10:15.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.490+0000 7f787da00640 1 -- 172.21.15.175:0/3682759603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7878145250 msgr2=0x7f787815a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.490+0000 7f787da00640 1 --2- 172.21.15.175:0/3682759603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7878145250 0x7f787815a990 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f78600ac040 tx=0x7f7860019290 comp rx=0 tx=0).stop 2024-04-25T09:10:15.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.490+0000 7f787da00640 1 -- 172.21.15.175:0/3682759603 shutdown_connections 2024-04-25T09:10:15.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.490+0000 7f787da00640 1 --2- 172.21.15.175:0/3682759603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7854066f60 0x7f7854069420 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.490+0000 7f787da00640 1 --2- 172.21.15.175:0/3682759603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78781600a0 0x7f7878163ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.490+0000 7f787da00640 1 --2- 172.21.15.175:0/3682759603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7878145250 0x7f787815a990 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.490+0000 7f787da00640 1 --2- 172.21.15.175:0/3682759603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78780ce970 0x7f7878140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.490+0000 7f787da00640 1 -- 172.21.15.175:0/3682759603 >> 172.21.15.175:0/3682759603 conn(0x7f787806ac50 msgr2=0x7f78780b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:15.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.490+0000 7f787da00640 1 -- 172.21.15.175:0/3682759603 shutdown_connections 2024-04-25T09:10:15.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.490+0000 7f787da00640 1 -- 172.21.15.175:0/3682759603 wait complete. 2024-04-25T09:10:15.507 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:15.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.654+0000 7f1bd9600640 1 Processor -- start 2024-04-25T09:10:15.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.654+0000 7f1bd9600640 1 -- start start 2024-04-25T09:10:15.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.654+0000 7f1bd9600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bd4144fc0 0x7f1bd40cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:15.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.654+0000 7f1bd9600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1bd41453a0 0x7f1bd415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:15.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.654+0000 7f1bd9600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd415cd00 con 0x7f1bd40cc3b0 2024-04-25T09:10:15.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.654+0000 7f1bd9600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd40ce660 con 0x7f1bd41453a0 2024-04-25T09:10:15.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.654+0000 7f1bd9600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40cc930 con 0x7f1bd4144fc0 2024-04-25T09:10:15.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.654+0000 7f1bca000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1bd41453a0 0x7f1bd415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:15.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.654+0000 7f1bca000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1bd41453a0 0x7f1bd415bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35358/0 (socket says 172.21.15.175:35358) 2024-04-25T09:10:15.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.654+0000 7f1bca000640 1 -- 172.21.15.175:0/2863875908 learned_addr learned my addr 172.21.15.175:0/2863875908 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:15.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.654+0000 7f1bd2a00640 1 --2- 172.21.15.175:0/2863875908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bd4144fc0 0x7f1bd40cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:15.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.654+0000 7f1bca000640 1 -- 172.21.15.175:0/2863875908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bd4144fc0 msgr2=0x7f1bd40cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:15.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.654+0000 7f1bca000640 1 --2- 172.21.15.175:0/2863875908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bd4144fc0 0x7f1bd40cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.654+0000 7f1bca000640 1 -- 172.21.15.175:0/2863875908 >> v1:172.21.15.175:6789/0 conn(0x7f1bd40cc3b0 legacy=0x7f1bd415f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.654+0000 7f1bca000640 1 -- 172.21.15.175:0/2863875908 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd40ccc10 con 0x7f1bd41453a0 2024-04-25T09:10:15.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.654+0000 7f1bd2000640 1 -- 172.21.15.175:0/2863875908 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341346908 0 0) 0x7f1bd415cd00 con 0x7f1bd40cc3b0 2024-04-25T09:10:15.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.654+0000 7f1bd2a00640 1 --2- 172.21.15.175:0/2863875908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bd4144fc0 0x7f1bd40cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:15.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.658+0000 7f1bca000640 1 --2- 172.21.15.175:0/2863875908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bd41453a0 0x7f1bd415bed0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009870 tx=0x7f1bbc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faac43779c55bbf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:15.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.658+0000 7f1bd2000640 1 -- 172.21.15.175:0/2863875908 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0ab650 con 0x7f1bd41453a0 2024-04-25T09:10:15.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.658+0000 7f1bd2000640 1 -- 172.21.15.175:0/2863875908 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc0b0070 con 0x7f1bd41453a0 2024-04-25T09:10:15.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.658+0000 7f1bd2000640 1 -- 172.21.15.175:0/2863875908 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0aba10 con 0x7f1bd41453a0 2024-04-25T09:10:15.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.658+0000 7f1bd9600640 1 -- 172.21.15.175:0/2863875908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bd41453a0 msgr2=0x7f1bd415bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.658+0000 7f1bd9600640 1 --2- 172.21.15.175:0/2863875908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bd41453a0 0x7f1bd415bed0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009870 tx=0x7f1bbc01c560 comp rx=0 tx=0).stop 2024-04-25T09:10:15.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.658+0000 7f1bd9600640 1 -- 172.21.15.175:0/2863875908 shutdown_connections 2024-04-25T09:10:15.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.658+0000 7f1bd9600640 1 --2- 172.21.15.175:0/2863875908 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bd41453a0 0x7f1bd415bed0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.658+0000 7f1bd9600640 1 --2- 172.21.15.175:0/2863875908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bd4144fc0 0x7f1bd40cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.658+0000 7f1bd9600640 1 -- 172.21.15.175:0/2863875908 >> 172.21.15.175:0/2863875908 conn(0x7f1bd4067150 msgr2=0x7f1bd406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:15.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.658+0000 7f1bd9600640 1 -- 172.21.15.175:0/2863875908 shutdown_connections 2024-04-25T09:10:15.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.658+0000 7f1bd9600640 1 -- 172.21.15.175:0/2863875908 wait complete. 2024-04-25T09:10:15.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd9600640 1 Processor -- start 2024-04-25T09:10:15.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd9600640 1 -- start start 2024-04-25T09:10:15.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd9600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bd4144fc0 0x7f1bd40af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:15.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd9600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bd41453a0 0x7f1bd413e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:15.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd9600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bd415b080 0x7f1bd40b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:15.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd9600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40cffb0 con 0x7f1bd415b080 2024-04-25T09:10:15.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd9600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40cfe30 con 0x7f1bd41453a0 2024-04-25T09:10:15.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd9600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd41685f0 con 0x7f1bd4144fc0 2024-04-25T09:10:15.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bd415b080 0x7f1bd40b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:15.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bd415b080 0x7f1bd40b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35372/0 (socket says 172.21.15.175:35372) 2024-04-25T09:10:15.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd3400640 1 -- 172.21.15.175:0/1411544028 learned_addr learned my addr 172.21.15.175:0/1411544028 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:15.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd2a00640 1 --2- 172.21.15.175:0/1411544028 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bd4144fc0 0x7f1bd40af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:15.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bca000640 1 --2- 172.21.15.175:0/1411544028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bd41453a0 0x7f1bd413e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:15.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd3400640 1 -- 172.21.15.175:0/1411544028 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bd4144fc0 msgr2=0x7f1bd40af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd3400640 1 --2- 172.21.15.175:0/1411544028 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bd4144fc0 0x7f1bd40af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd3400640 1 -- 172.21.15.175:0/1411544028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bd41453a0 msgr2=0x7f1bd413e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd3400640 1 --2- 172.21.15.175:0/1411544028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bd41453a0 0x7f1bd413e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd3400640 1 -- 172.21.15.175:0/1411544028 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd40af710 con 0x7f1bd415b080 2024-04-25T09:10:15.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd3400640 1 --2- 172.21.15.175:0/1411544028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bd415b080 0x7f1bd40b1770 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc00c7b0 tx=0x7f1bcc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:15.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bcb400640 1 -- 172.21.15.175:0/1411544028 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc003db0 con 0x7f1bd415b080 2024-04-25T09:10:15.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bcb400640 1 -- 172.21.15.175:0/1411544028 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc005070 con 0x7f1bd415b080 2024-04-25T09:10:15.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bcb400640 1 -- 172.21.15.175:0/1411544028 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc005460 con 0x7f1bd415b080 2024-04-25T09:10:15.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd9600640 1 -- 172.21.15.175:0/1411544028 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd40af9b0 con 0x7f1bd415b080 2024-04-25T09:10:15.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd9600640 1 -- 172.21.15.175:0/1411544028 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd40aff70 con 0x7f1bd415b080 2024-04-25T09:10:15.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.662+0000 7f1bd9600640 1 -- 172.21.15.175:0/1411544028 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd4074a60 con 0x7f1bd415b080 2024-04-25T09:10:15.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.666+0000 7f1bcb400640 1 -- 172.21.15.175:0/1411544028 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1bcc005600 con 0x7f1bd415b080 2024-04-25T09:10:15.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.666+0000 7f1bcb400640 1 --2- 172.21.15.175:0/1411544028 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1bb0066f90 0x7f1bb0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:15.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.666+0000 7f1bcb400640 1 -- 172.21.15.175:0/1411544028 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f1bcc084eb0 con 0x7f1bd415b080 2024-04-25T09:10:15.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.666+0000 7f1bd2a00640 1 --2- 172.21.15.175:0/1411544028 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1bb0066f90 0x7f1bb0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:15.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.666+0000 7f1bd2a00640 1 --2- 172.21.15.175:0/1411544028 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1bb0066f90 0x7f1bb0069450 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4006e90 tx=0x7f1bc4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:15.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.670+0000 7f1bcb400640 1 -- 172.21.15.175:0/1411544028 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1bcc055770 con 0x7f1bd415b080 2024-04-25T09:10:15.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.858+0000 7f1bd9600640 1 -- 172.21.15.175:0/1411544028 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bd40cbce0 con 0x7f1bd415b080 2024-04-25T09:10:15.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.858+0000 7f1bcb400640 1 -- 172.21.15.175:0/1411544028 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f1bcc059810 con 0x7f1bd415b080 2024-04-25T09:10:15.849 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:10:15.849 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":61,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3229536012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3229536012},{"type":"v1","addr":"172.21.15.177:6834","nonce":3229536012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/222649735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":222649735},{"type":"v1","addr":"172.21.15.177:6835","nonce":222649735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2888989442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2888989442},{"type":"v1","addr":"172.21.15.175:6836","nonce":2888989442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:03.786939+0000","modified":"2024-04-25T09:10:15.495609+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7419":{"gid":7419,"name":"c","rank":0,"incarnation":61,"state":"up:replay","state_seq":1,"addr":"172.21.15.175:6837/1399691338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1399691338},{"type":"v1","addr":"172.21.15.175:6837","nonce":1399691338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:10:15.850 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 61 2024-04-25T09:10:15.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.862+0000 7f1bd9600640 1 -- 172.21.15.175:0/1411544028 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1bb0066f90 msgr2=0x7f1bb0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.862+0000 7f1bd9600640 1 --2- 172.21.15.175:0/1411544028 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1bb0066f90 0x7f1bb0069450 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4006e90 tx=0x7f1bc4008040 comp rx=0 tx=0).stop 2024-04-25T09:10:15.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.862+0000 7f1bd9600640 1 -- 172.21.15.175:0/1411544028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bd415b080 msgr2=0x7f1bd40b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:15.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.862+0000 7f1bd9600640 1 --2- 172.21.15.175:0/1411544028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bd415b080 0x7f1bd40b1770 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc00c7b0 tx=0x7f1bcc00cc70 comp rx=0 tx=0).stop 2024-04-25T09:10:15.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.862+0000 7f1bd9600640 1 -- 172.21.15.175:0/1411544028 shutdown_connections 2024-04-25T09:10:15.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.862+0000 7f1bd9600640 1 --2- 172.21.15.175:0/1411544028 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1bb0066f90 0x7f1bb0069450 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.862+0000 7f1bd9600640 1 --2- 172.21.15.175:0/1411544028 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bd415b080 0x7f1bd40b1770 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.862+0000 7f1bd9600640 1 --2- 172.21.15.175:0/1411544028 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1bd41453a0 0x7f1bd413e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.862+0000 7f1bd9600640 1 --2- 172.21.15.175:0/1411544028 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1bd4144fc0 0x7f1bd40af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.862+0000 7f1bd9600640 1 -- 172.21.15.175:0/1411544028 >> 172.21.15.175:0/1411544028 conn(0x7f1bd40cc3b0 msgr2=0x7f1bd415ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:15.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.862+0000 7f1bd9600640 1 -- 172.21.15.175:0/1411544028 shutdown_connections 2024-04-25T09:10:15.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:15.862+0000 7f1bd9600640 1 -- 172.21.15.175:0/1411544028 wait complete. 2024-04-25T09:10:16.273 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:10:03.786939+0000', 'modified': '2024-04-25T09:10:15.495609+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 85, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7419}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7419': {'gid': 7419, 'name': 'c', 'rank': 0, 'incarnation': 61, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.175:6837/1399691338', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6835', 'nonce': 1399691338}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 1399691338}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:10:16.273 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7419:up:replay 2024-04-25T09:10:17.274 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:17.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.430+0000 7f1707400640 1 Processor -- start 2024-04-25T09:10:17.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.430+0000 7f1707400640 1 -- start start 2024-04-25T09:10:17.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.430+0000 7f1707400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1700099a50 0x7f17000cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.430+0000 7f1707400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f170015bc10 0x7f1700099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.430+0000 7f1707400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170009a370 con 0x7f170009abb0 2024-04-25T09:10:17.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.430+0000 7f1707400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17000d06f0 con 0x7f1700099a50 2024-04-25T09:10:17.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.430+0000 7f1707400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17000cc4c0 con 0x7f170015bc10 2024-04-25T09:10:17.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.430+0000 7f1704a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1700099a50 0x7f17000cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.430+0000 7f1704a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1700099a50 0x7f17000cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35374/0 (socket says 172.21.15.175:35374) 2024-04-25T09:10:17.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.430+0000 7f1704a00640 1 -- 172.21.15.175:0/3302837988 learned_addr learned my addr 172.21.15.175:0/3302837988 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:17.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.430+0000 7f16f7e00640 1 --2- 172.21.15.175:0/3302837988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f170015bc10 0x7f1700099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.430+0000 7f1704a00640 1 -- 172.21.15.175:0/3302837988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f170015bc10 msgr2=0x7f1700099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:17.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.430+0000 7f1704a00640 1 --2- 172.21.15.175:0/3302837988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f170015bc10 0x7f1700099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.430+0000 7f1704a00640 1 -- 172.21.15.175:0/3302837988 >> v1:172.21.15.177:6789/0 conn(0x7f170009abb0 legacy=0x7f17000cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:17.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.430+0000 7f1704a00640 1 -- 172.21.15.175:0/3302837988 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17000cc7a0 con 0x7f1700099a50 2024-04-25T09:10:17.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.434+0000 7f1704a00640 1 --2- 172.21.15.175:0/3302837988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1700099a50 0x7f17000cd280 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009870 tx=0x7f16f001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4981a83e99c976 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:17.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.434+0000 7f16ffe00640 1 -- 172.21.15.175:0/3302837988 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f00a7070 con 0x7f1700099a50 2024-04-25T09:10:17.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.434+0000 7f16ffe00640 1 -- 172.21.15.175:0/3302837988 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f00b0070 con 0x7f1700099a50 2024-04-25T09:10:17.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.434+0000 7f16ffe00640 1 -- 172.21.15.175:0/3302837988 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f00ab890 con 0x7f1700099a50 2024-04-25T09:10:17.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.434+0000 7f1707400640 1 -- 172.21.15.175:0/3302837988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1700099a50 msgr2=0x7f17000cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.434+0000 7f1707400640 1 --2- 172.21.15.175:0/3302837988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1700099a50 0x7f17000cd280 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f16f0009870 tx=0x7f16f001c560 comp rx=0 tx=0).stop 2024-04-25T09:10:17.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.434+0000 7f1707400640 1 -- 172.21.15.175:0/3302837988 shutdown_connections 2024-04-25T09:10:17.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.434+0000 7f1707400640 1 --2- 172.21.15.175:0/3302837988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f170015bc10 0x7f1700099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.434+0000 7f1707400640 1 --2- 172.21.15.175:0/3302837988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1700099a50 0x7f17000cd280 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.434+0000 7f1707400640 1 -- 172.21.15.175:0/3302837988 >> 172.21.15.175:0/3302837988 conn(0x7f17000b3300 msgr2=0x7f17000b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:17.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.434+0000 7f1707400640 1 -- 172.21.15.175:0/3302837988 shutdown_connections 2024-04-25T09:10:17.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.434+0000 7f1707400640 1 -- 172.21.15.175:0/3302837988 wait complete. 2024-04-25T09:10:17.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f1707400640 1 Processor -- start 2024-04-25T09:10:17.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f1707400640 1 -- start start 2024-04-25T09:10:17.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f1707400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1700099a50 0x7f1700150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f1707400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f170009abb0 0x7f17000c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f1707400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170015bc10 0x7f1700154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f1707400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17000c5f00 con 0x7f170009abb0 2024-04-25T09:10:17.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f1707400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17000c5d80 con 0x7f170015bc10 2024-04-25T09:10:17.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f1707400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1700168850 con 0x7f1700099a50 2024-04-25T09:10:17.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f16f7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f170009abb0 0x7f17000c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f16f7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f170009abb0 0x7f17000c9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35386/0 (socket says 172.21.15.175:35386) 2024-04-25T09:10:17.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f16f7e00640 1 -- 172.21.15.175:0/1699729087 learned_addr learned my addr 172.21.15.175:0/1699729087 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:17.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f1704a00640 1 --2- 172.21.15.175:0/1699729087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1700099a50 0x7f1700150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f1705400640 1 --2- 172.21.15.175:0/1699729087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170015bc10 0x7f1700154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f16f7e00640 1 -- 172.21.15.175:0/1699729087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1700099a50 msgr2=0x7f1700150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f16f7e00640 1 --2- 172.21.15.175:0/1699729087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1700099a50 0x7f1700150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f16f7e00640 1 -- 172.21.15.175:0/1699729087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170015bc10 msgr2=0x7f1700154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f16f7e00640 1 --2- 172.21.15.175:0/1699729087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170015bc10 0x7f1700154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f16f7e00640 1 -- 172.21.15.175:0/1699729087 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1700151460 con 0x7f170009abb0 2024-04-25T09:10:17.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f16f7e00640 1 --2- 172.21.15.175:0/1699729087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f170009abb0 0x7f17000c9460 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f16e800d5f0 tx=0x7f16e800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:17.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f16fd600640 1 -- 172.21.15.175:0/1699729087 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e80125f0 con 0x7f170009abb0 2024-04-25T09:10:17.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f16fd600640 1 -- 172.21.15.175:0/1699729087 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e8019070 con 0x7f170009abb0 2024-04-25T09:10:17.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f1707400640 1 -- 172.21.15.175:0/1699729087 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1700155c00 con 0x7f170009abb0 2024-04-25T09:10:17.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f16fd600640 1 -- 172.21.15.175:0/1699729087 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e80129b0 con 0x7f170009abb0 2024-04-25T09:10:17.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.438+0000 7f1707400640 1 -- 172.21.15.175:0/1699729087 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1700156180 con 0x7f170009abb0 2024-04-25T09:10:17.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.442+0000 7f1707400640 1 -- 172.21.15.175:0/1699729087 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1700074a60 con 0x7f170009abb0 2024-04-25T09:10:17.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.442+0000 7f16fd600640 1 -- 172.21.15.175:0/1699729087 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f16e8012b50 con 0x7f170009abb0 2024-04-25T09:10:17.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.442+0000 7f16fd600640 1 --2- 172.21.15.175:0/1699729087 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f16dc066f60 0x7f16dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.442+0000 7f16fd600640 1 -- 172.21.15.175:0/1699729087 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f16e80854c0 con 0x7f170009abb0 2024-04-25T09:10:17.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.442+0000 7f1704a00640 1 --2- 172.21.15.175:0/1699729087 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f16dc066f60 0x7f16dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.442+0000 7f1704a00640 1 --2- 172.21.15.175:0/1699729087 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f16dc066f60 0x7f16dc069420 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f16f00af000 tx=0x7f16f00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:17.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.446+0000 7f16fd600640 1 -- 172.21.15.175:0/1699729087 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f16e80563d0 con 0x7f170009abb0 2024-04-25T09:10:17.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.646+0000 7f1707400640 1 -- 172.21.15.175:0/1699729087 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17000cdc40 con 0x7f170009abb0 2024-04-25T09:10:17.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.646+0000 7f16fd600640 1 -- 172.21.15.175:0/1699729087 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f16e805c0d0 con 0x7f170009abb0 2024-04-25T09:10:17.637 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:10:17.637 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":63,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3229536012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3229536012},{"type":"v1","addr":"172.21.15.177:6834","nonce":3229536012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/222649735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":222649735},{"type":"v1","addr":"172.21.15.177:6835","nonce":222649735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2888989442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2888989442},{"type":"v1","addr":"172.21.15.175:6836","nonce":2888989442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:03.786939+0000","modified":"2024-04-25T09:10:16.503175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7419":{"gid":7419,"name":"c","rank":0,"incarnation":61,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.175:6837/1399691338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1399691338},{"type":"v1","addr":"172.21.15.175:6837","nonce":1399691338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:10:17.637 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 63 2024-04-25T09:10:17.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.646+0000 7f1707400640 1 -- 172.21.15.175:0/1699729087 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f16dc066f60 msgr2=0x7f16dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.646+0000 7f1707400640 1 --2- 172.21.15.175:0/1699729087 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f16dc066f60 0x7f16dc069420 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f16f00af000 tx=0x7f16f00a7000 comp rx=0 tx=0).stop 2024-04-25T09:10:17.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.646+0000 7f1707400640 1 -- 172.21.15.175:0/1699729087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f170009abb0 msgr2=0x7f17000c9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.646+0000 7f1707400640 1 --2- 172.21.15.175:0/1699729087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f170009abb0 0x7f17000c9460 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f16e800d5f0 tx=0x7f16e800dab0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.650+0000 7f1707400640 1 -- 172.21.15.175:0/1699729087 shutdown_connections 2024-04-25T09:10:17.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.650+0000 7f1707400640 1 --2- 172.21.15.175:0/1699729087 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f16dc066f60 0x7f16dc069420 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.650+0000 7f1707400640 1 --2- 172.21.15.175:0/1699729087 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f170015bc10 0x7f1700154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.650+0000 7f1707400640 1 --2- 172.21.15.175:0/1699729087 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f170009abb0 0x7f17000c9460 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.650+0000 7f1707400640 1 --2- 172.21.15.175:0/1699729087 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1700099a50 0x7f1700150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.650+0000 7f1707400640 1 -- 172.21.15.175:0/1699729087 >> 172.21.15.175:0/1699729087 conn(0x7f17000b3300 msgr2=0x7f170015a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:17.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.650+0000 7f1707400640 1 -- 172.21.15.175:0/1699729087 shutdown_connections 2024-04-25T09:10:17.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:17.650+0000 7f1707400640 1 -- 172.21.15.175:0/1699729087 wait complete. 2024-04-25T09:10:18.061 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:10:03.786939+0000', 'modified': '2024-04-25T09:10:16.503175+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 85, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7419}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7419': {'gid': 7419, 'name': 'c', 'rank': 0, 'incarnation': 61, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.175:6837/1399691338', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6835', 'nonce': 1399691338}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 1399691338}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:10:18.061 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7419:up:rejoin 2024-04-25T09:10:19.063 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:19.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.214+0000 7f92ed600640 1 Processor -- start 2024-04-25T09:10:19.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.214+0000 7f92ed600640 1 -- start start 2024-04-25T09:10:19.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.214+0000 7f92ed600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f92e81594f0 0x7f92e815bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.214+0000 7f92ed600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f92e80b2c20 0x7f92e815fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.214+0000 7f92ed600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92e815c670 con 0x7f92e8160160 2024-04-25T09:10:19.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.214+0000 7f92ed600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e815f790 con 0x7f92e80b2c20 2024-04-25T09:10:19.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.214+0000 7f92ed600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e815c950 con 0x7f92e81594f0 2024-04-25T09:10:19.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.214+0000 7f92e7400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f92e80b2c20 0x7f92e815fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.214+0000 7f92e7400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f92e80b2c20 0x7f92e815fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35392/0 (socket says 172.21.15.175:35392) 2024-04-25T09:10:19.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.214+0000 7f92e7400640 1 -- 172.21.15.175:0/3701325033 learned_addr learned my addr 172.21.15.175:0/3701325033 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:19.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.214+0000 7f92e7e00640 1 --2- 172.21.15.175:0/3701325033 >> v2:172.21.15.177:3300/0 conn(0x7f92e81594f0 0x7f92e815bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.214+0000 7f92e7400640 1 -- 172.21.15.175:0/3701325033 >> v2:172.21.15.177:3300/0 conn(0x7f92e81594f0 msgr2=0x7f92e815bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:19.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.214+0000 7f92e7400640 1 --2- 172.21.15.175:0/3701325033 >> v2:172.21.15.177:3300/0 conn(0x7f92e81594f0 0x7f92e815bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.214+0000 7f92e7400640 1 -- 172.21.15.175:0/3701325033 >> v1:172.21.15.177:6789/0 conn(0x7f92e8160160 legacy=0x7f92e806ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.214+0000 7f92e7400640 1 -- 172.21.15.175:0/3701325033 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e815cc30 con 0x7f92e80b2c20 2024-04-25T09:10:19.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.214+0000 7f92e7e00640 1 --2- 172.21.15.175:0/3701325033 >> v2:172.21.15.177:3300/0 conn(0x7f92e81594f0 0x7f92e815bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:19.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.218+0000 7f92e7400640 1 --2- 172.21.15.175:0/3701325033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e80b2c20 0x7f92e815fc20 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f92e809a300 tx=0x7f92d401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47842f8f50c3168 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:19.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.218+0000 7f92e6a00640 1 -- 172.21.15.175:0/3701325033 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d40ab430 con 0x7f92e80b2c20 2024-04-25T09:10:19.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.218+0000 7f92e6a00640 1 -- 172.21.15.175:0/3701325033 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d40b0070 con 0x7f92e80b2c20 2024-04-25T09:10:19.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.218+0000 7f92e6a00640 1 -- 172.21.15.175:0/3701325033 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d40ab7f0 con 0x7f92e80b2c20 2024-04-25T09:10:19.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.218+0000 7f92ed600640 1 -- 172.21.15.175:0/3701325033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e80b2c20 msgr2=0x7f92e815fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.218+0000 7f92ed600640 1 --2- 172.21.15.175:0/3701325033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e80b2c20 0x7f92e815fc20 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f92e809a300 tx=0x7f92d401c520 comp rx=0 tx=0).stop 2024-04-25T09:10:19.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.218+0000 7f92ed600640 1 -- 172.21.15.175:0/3701325033 shutdown_connections 2024-04-25T09:10:19.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.218+0000 7f92ed600640 1 --2- 172.21.15.175:0/3701325033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e80b2c20 0x7f92e815fc20 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.218+0000 7f92ed600640 1 --2- 172.21.15.175:0/3701325033 >> v2:172.21.15.177:3300/0 conn(0x7f92e81594f0 0x7f92e815bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.218+0000 7f92ed600640 1 -- 172.21.15.175:0/3701325033 >> 172.21.15.175:0/3701325033 conn(0x7f92e8099a50 msgr2=0x7f92e80b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:19.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.218+0000 7f92ed600640 1 -- 172.21.15.175:0/3701325033 shutdown_connections 2024-04-25T09:10:19.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.218+0000 7f92ed600640 1 -- 172.21.15.175:0/3701325033 wait complete. 2024-04-25T09:10:19.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92ed600640 1 Processor -- start 2024-04-25T09:10:19.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92ed600640 1 -- start start 2024-04-25T09:10:19.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92ed600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e80b2c20 0x7f92e815ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92ed600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92e81594f0 0x7f92e814e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92ed600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92e8160160 0x7f92e814eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92ed600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e8168900 con 0x7f92e80b2c20 2024-04-25T09:10:19.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92ed600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e806b570 con 0x7f92e8160160 2024-04-25T09:10:19.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92ed600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e8168a80 con 0x7f92e81594f0 2024-04-25T09:10:19.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92e7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e80b2c20 0x7f92e815ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92e7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e80b2c20 0x7f92e815ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35406/0 (socket says 172.21.15.175:35406) 2024-04-25T09:10:19.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92e7e00640 1 -- 172.21.15.175:0/2236052588 learned_addr learned my addr 172.21.15.175:0/2236052588 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:19.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92e7400640 1 --2- 172.21.15.175:0/2236052588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92e81594f0 0x7f92e814e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92ecc00640 1 --2- 172.21.15.175:0/2236052588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92e8160160 0x7f92e814eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92e7e00640 1 -- 172.21.15.175:0/2236052588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92e81594f0 msgr2=0x7f92e814e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92e7e00640 1 --2- 172.21.15.175:0/2236052588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92e81594f0 0x7f92e814e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92e7e00640 1 -- 172.21.15.175:0/2236052588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92e8160160 msgr2=0x7f92e814eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92e7e00640 1 --2- 172.21.15.175:0/2236052588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92e8160160 0x7f92e814eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92e7e00640 1 -- 172.21.15.175:0/2236052588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e80c5560 con 0x7f92e80b2c20 2024-04-25T09:10:19.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92e7e00640 1 --2- 172.21.15.175:0/2236052588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e80b2c20 0x7f92e815ae20 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f92d800e840 tx=0x7f92d800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:19.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92dfe00640 1 -- 172.21.15.175:0/2236052588 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d8017070 con 0x7f92e80b2c20 2024-04-25T09:10:19.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92dfe00640 1 -- 172.21.15.175:0/2236052588 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d800c8d0 con 0x7f92e80b2c20 2024-04-25T09:10:19.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92dfe00640 1 -- 172.21.15.175:0/2236052588 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d800f040 con 0x7f92e80b2c20 2024-04-25T09:10:19.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92ed600640 1 -- 172.21.15.175:0/2236052588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e80c5840 con 0x7f92e80b2c20 2024-04-25T09:10:19.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92ed600640 1 -- 172.21.15.175:0/2236052588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e80c5e00 con 0x7f92e80b2c20 2024-04-25T09:10:19.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.222+0000 7f92ed600640 1 -- 172.21.15.175:0/2236052588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e8074a60 con 0x7f92e80b2c20 2024-04-25T09:10:19.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.226+0000 7f92dfe00640 1 -- 172.21.15.175:0/2236052588 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f92d801a070 con 0x7f92e80b2c20 2024-04-25T09:10:19.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.226+0000 7f92dfe00640 1 --2- 172.21.15.175:0/2236052588 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f92c8066f60 0x7f92c8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.226+0000 7f92dfe00640 1 -- 172.21.15.175:0/2236052588 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f92d8084c70 con 0x7f92e80b2c20 2024-04-25T09:10:19.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.226+0000 7f92e7400640 1 --2- 172.21.15.175:0/2236052588 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f92c8066f60 0x7f92c8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.226+0000 7f92e7400640 1 --2- 172.21.15.175:0/2236052588 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f92c8066f60 0x7f92c8069420 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f92d40af000 tx=0x7f92d40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:19.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.230+0000 7f92dfe00640 1 -- 172.21.15.175:0/2236052588 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f92d8055530 con 0x7f92e80b2c20 2024-04-25T09:10:19.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.418+0000 7f92ed600640 1 -- 172.21.15.175:0/2236052588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92e809a010 con 0x7f92e80b2c20 2024-04-25T09:10:19.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.418+0000 7f92dfe00640 1 -- 172.21.15.175:0/2236052588 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f92d80595d0 con 0x7f92e80b2c20 2024-04-25T09:10:19.409 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:10:19.409 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":64,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3229536012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3229536012},{"type":"v1","addr":"172.21.15.177:6834","nonce":3229536012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/222649735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":222649735},{"type":"v1","addr":"172.21.15.177:6835","nonce":222649735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2888989442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2888989442},{"type":"v1","addr":"172.21.15.175:6836","nonce":2888989442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:03.786939+0000","modified":"2024-04-25T09:10:17.508979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7419":{"gid":7419,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6837/1399691338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1399691338},{"type":"v1","addr":"172.21.15.175:6837","nonce":1399691338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:10:19.409 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 64 2024-04-25T09:10:19.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.418+0000 7f92ed600640 1 -- 172.21.15.175:0/2236052588 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f92c8066f60 msgr2=0x7f92c8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.418+0000 7f92ed600640 1 --2- 172.21.15.175:0/2236052588 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f92c8066f60 0x7f92c8069420 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f92d40af000 tx=0x7f92d40a7000 comp rx=0 tx=0).stop 2024-04-25T09:10:19.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.418+0000 7f92ed600640 1 -- 172.21.15.175:0/2236052588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e80b2c20 msgr2=0x7f92e815ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.418+0000 7f92ed600640 1 --2- 172.21.15.175:0/2236052588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e80b2c20 0x7f92e815ae20 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f92d800e840 tx=0x7f92d800ed00 comp rx=0 tx=0).stop 2024-04-25T09:10:19.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.422+0000 7f92ed600640 1 -- 172.21.15.175:0/2236052588 shutdown_connections 2024-04-25T09:10:19.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.422+0000 7f92ed600640 1 --2- 172.21.15.175:0/2236052588 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f92c8066f60 0x7f92c8069420 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.422+0000 7f92ed600640 1 --2- 172.21.15.175:0/2236052588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92e8160160 0x7f92e814eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.422+0000 7f92ed600640 1 --2- 172.21.15.175:0/2236052588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92e81594f0 0x7f92e814e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.422+0000 7f92ed600640 1 --2- 172.21.15.175:0/2236052588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92e80b2c20 0x7f92e815ae20 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.422+0000 7f92ed600640 1 -- 172.21.15.175:0/2236052588 >> 172.21.15.175:0/2236052588 conn(0x7f92e8099a50 msgr2=0x7f92e80742f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:19.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.422+0000 7f92ed600640 1 -- 172.21.15.175:0/2236052588 shutdown_connections 2024-04-25T09:10:19.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.422+0000 7f92ed600640 1 -- 172.21.15.175:0/2236052588 wait complete. 2024-04-25T09:10:19.833 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 64, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:10:03.786939+0000', 'modified': '2024-04-25T09:10:17.508979+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 85, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7419}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7419': {'gid': 7419, 'name': 'c', 'rank': 0, 'incarnation': 61, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.175:6837/1399691338', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6835', 'nonce': 1399691338}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 1399691338}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:10:19.834 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:10:19.834 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:10:19.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.982+0000 7f8d57000640 1 Processor -- start 2024-04-25T09:10:19.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.982+0000 7f8d57000640 1 -- start start 2024-04-25T09:10:19.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.986+0000 7f8d57000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8d50145250 0x7f8d500cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.986+0000 7f8d57000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8d501600a0 0x7f8d500cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.986+0000 7f8d57000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d500cfd10 con 0x7f8d500ce970 2024-04-25T09:10:19.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.986+0000 7f8d57000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d5015f650 con 0x7f8d501600a0 2024-04-25T09:10:19.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.986+0000 7f8d57000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d500cfff0 con 0x7f8d50145250 2024-04-25T09:10:19.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.986+0000 7f8d4f400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8d501600a0 0x7f8d500cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.986+0000 7f8d4f400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8d501600a0 0x7f8d500cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37798/0 (socket says 172.21.15.175:37798) 2024-04-25T09:10:19.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.986+0000 7f8d4f400640 1 -- 172.21.15.175:0/650108957 learned_addr learned my addr 172.21.15.175:0/650108957 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:19.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.986+0000 7f8d4f400640 1 -- 172.21.15.175:0/650108957 >> v2:172.21.15.177:3300/0 conn(0x7f8d50145250 msgr2=0x7f8d500cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:19.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.986+0000 7f8d4f400640 1 --2- 172.21.15.175:0/650108957 >> v2:172.21.15.177:3300/0 conn(0x7f8d50145250 0x7f8d500cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.986+0000 7f8d4f400640 1 -- 172.21.15.175:0/650108957 >> v1:172.21.15.177:6789/0 conn(0x7f8d500ce970 legacy=0x7f8d500cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:19.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.986+0000 7f8d4f400640 1 -- 172.21.15.175:0/650108957 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5015f8a0 con 0x7f8d501600a0 2024-04-25T09:10:19.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.986+0000 7f8d4f400640 1 --2- 172.21.15.175:0/650108957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d501600a0 0x7f8d500cc410 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009870 tx=0x7f8d3c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ff71602adeb01d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:19.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d4ea00640 1 -- 172.21.15.175:0/650108957 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c0aa5f0 con 0x7f8d501600a0 2024-04-25T09:10:19.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d4ea00640 1 -- 172.21.15.175:0/650108957 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c0af070 con 0x7f8d501600a0 2024-04-25T09:10:19.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d4ea00640 1 -- 172.21.15.175:0/650108957 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c0aa9b0 con 0x7f8d501600a0 2024-04-25T09:10:19.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d57000640 1 -- 172.21.15.175:0/650108957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d501600a0 msgr2=0x7f8d500cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d57000640 1 --2- 172.21.15.175:0/650108957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d501600a0 0x7f8d500cc410 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c009870 tx=0x7f8d3c01c4b0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d57000640 1 -- 172.21.15.175:0/650108957 shutdown_connections 2024-04-25T09:10:19.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d57000640 1 --2- 172.21.15.175:0/650108957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d501600a0 0x7f8d500cc410 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d57000640 1 --2- 172.21.15.175:0/650108957 >> v2:172.21.15.177:3300/0 conn(0x7f8d50145250 0x7f8d500cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d57000640 1 -- 172.21.15.175:0/650108957 >> 172.21.15.175:0/650108957 conn(0x7f8d5006ac50 msgr2=0x7f8d5006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:19.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d57000640 1 -- 172.21.15.175:0/650108957 shutdown_connections 2024-04-25T09:10:19.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d57000640 1 -- 172.21.15.175:0/650108957 wait complete. 2024-04-25T09:10:19.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d57000640 1 Processor -- start 2024-04-25T09:10:19.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d57000640 1 -- start start 2024-04-25T09:10:19.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d57000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d500ce970 0x7f8d50140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d57000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d50145250 0x7f8d5006dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d57000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d501600a0 0x7f8d501414a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d57000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5015c870 con 0x7f8d50145250 2024-04-25T09:10:19.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d57000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50145630 con 0x7f8d501600a0 2024-04-25T09:10:19.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d57000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5015c9f0 con 0x7f8d500ce970 2024-04-25T09:10:19.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d4f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d50145250 0x7f8d5006dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d4f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d50145250 0x7f8d5006dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37814/0 (socket says 172.21.15.175:37814) 2024-04-25T09:10:19.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d4f400640 1 -- 172.21.15.175:0/1524980416 learned_addr learned my addr 172.21.15.175:0/1524980416 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:19.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d4fe00640 1 --2- 172.21.15.175:0/1524980416 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d500ce970 0x7f8d50140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d55000640 1 --2- 172.21.15.175:0/1524980416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d501600a0 0x7f8d501414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d4f400640 1 -- 172.21.15.175:0/1524980416 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d500ce970 msgr2=0x7f8d50140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d4f400640 1 --2- 172.21.15.175:0/1524980416 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d500ce970 0x7f8d50140da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d4f400640 1 -- 172.21.15.175:0/1524980416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d501600a0 msgr2=0x7f8d501414a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d4f400640 1 --2- 172.21.15.175:0/1524980416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d501600a0 0x7f8d501414a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d4f400640 1 -- 172.21.15.175:0/1524980416 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5015b6f0 con 0x7f8d50145250 2024-04-25T09:10:19.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.990+0000 7f8d55000640 1 --2- 172.21.15.175:0/1524980416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d501600a0 0x7f8d501414a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:19.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.994+0000 7f8d4f400640 1 --2- 172.21.15.175:0/1524980416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d50145250 0x7f8d5006dc10 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0ac040 tx=0x7f8d3c019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:19.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.994+0000 7f8d47e00640 1 -- 172.21.15.175:0/1524980416 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c0be610 con 0x7f8d50145250 2024-04-25T09:10:19.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.994+0000 7f8d47e00640 1 -- 172.21.15.175:0/1524980416 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3c0be7d0 con 0x7f8d50145250 2024-04-25T09:10:19.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.994+0000 7f8d47e00640 1 -- 172.21.15.175:0/1524980416 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c0bebc0 con 0x7f8d50145250 2024-04-25T09:10:19.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.994+0000 7f8d57000640 1 -- 172.21.15.175:0/1524980416 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d50142010 con 0x7f8d50145250 2024-04-25T09:10:19.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.994+0000 7f8d57000640 1 -- 172.21.15.175:0/1524980416 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d501405a0 con 0x7f8d50145250 2024-04-25T09:10:19.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.994+0000 7f8d47e00640 1 -- 172.21.15.175:0/1524980416 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8d3c0bc020 con 0x7f8d50145250 2024-04-25T09:10:19.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.994+0000 7f8d47e00640 1 --2- 172.21.15.175:0/1524980416 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8d30066f60 0x7f8d30069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.994+0000 7f8d47e00640 1 -- 172.21.15.175:0/1524980416 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8d3c11f430 con 0x7f8d50145250 2024-04-25T09:10:19.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.994+0000 7f8d4fe00640 1 --2- 172.21.15.175:0/1524980416 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8d30066f60 0x7f8d30069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d5a3b9000 1 Processor -- start 2024-04-25T09:10:19.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d5a3b9000 1 -- start start 2024-04-25T09:10:19.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d4fe00640 1 --2- 172.21.15.175:0/1524980416 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8d30066f60 0x7f8d30069420 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009f20 tx=0x7f8d400094f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d5a3b9000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5ea1920 0x559aa5ea1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d5a3b9000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5ea2240 0x559aa5e579f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d5a3b9000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5e57f30 0x559aa5e58310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d5a3b9000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aa5d3f5f0 con 0x559aa5ea1920 2024-04-25T09:10:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d5a3b9000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aa5ca6da0 con 0x559aa5e57f30 2024-04-25T09:10:19.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d5a3b9000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x559aa5c2f150 con 0x559aa5ea2240 2024-04-25T09:10:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d4fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5ea1920 0x559aa5ea1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d4fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5ea1920 0x559aa5ea1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37818/0 (socket says 172.21.15.175:37818) 2024-04-25T09:10:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d4fe00640 1 -- 172.21.15.175:0/74374473 learned_addr learned my addr 172.21.15.175:0/74374473 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d4f400640 1 --2- 172.21.15.175:0/74374473 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5ea2240 0x559aa5e579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d55000640 1 --2- 172.21.15.175:0/74374473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5e57f30 0x559aa5e58310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d4fe00640 1 -- 172.21.15.175:0/74374473 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5ea2240 msgr2=0x559aa5e579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d4fe00640 1 --2- 172.21.15.175:0/74374473 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5ea2240 0x559aa5e579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d4fe00640 1 -- 172.21.15.175:0/74374473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5e57f30 msgr2=0x559aa5e58310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d4fe00640 1 --2- 172.21.15.175:0/74374473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5e57f30 0x559aa5e58310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d4fe00640 1 -- 172.21.15.175:0/74374473 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559aa5c48ca0 con 0x559aa5ea1920 2024-04-25T09:10:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d4fe00640 1 --2- 172.21.15.175:0/74374473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5ea1920 0x559aa5ea1d00 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f8d40017770 tx=0x7f8d40011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed474f1e14267b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d44c00640 1 -- 172.21.15.175:0/74374473 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40027070 con 0x559aa5ea1920 2024-04-25T09:10:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d44c00640 1 -- 172.21.15.175:0/74374473 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d40017e20 con 0x559aa5ea1920 2024-04-25T09:10:19.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d44c00640 1 -- 172.21.15.175:0/74374473 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40022420 con 0x559aa5ea1920 2024-04-25T09:10:19.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/74374473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5ea1920 msgr2=0x559aa5ea1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/74374473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5ea1920 0x559aa5ea1d00 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f8d40017770 tx=0x7f8d40011000 comp rx=0 tx=0).stop 2024-04-25T09:10:19.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/74374473 shutdown_connections 2024-04-25T09:10:19.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/74374473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5e57f30 0x559aa5e58310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/74374473 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5ea2240 0x559aa5e579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/74374473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5ea1920 0x559aa5ea1d00 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/74374473 >> 172.21.15.175:0/74374473 conn(0x559aa5e5e2a0 msgr2=0x559aa5e562d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:19.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/74374473 shutdown_connections 2024-04-25T09:10:19.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:19.998+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/74374473 wait complete. 2024-04-25T09:10:19.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d5a3b9000 1 -- start start 2024-04-25T09:10:19.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d5a3b9000 1 Processor -- start 2024-04-25T09:10:19.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d5a3b9000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5e57f30 0x559aa5e926c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d5a3b9000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5ea1920 0x559aa5eafc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d5a3b9000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5ea2240 0x559aa5eb21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d5a3b9000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aa5c61990 con 0x559aa5e57f30 2024-04-25T09:10:19.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d5a3b9000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aa5ca2e40 con 0x559aa5ea1920 2024-04-25T09:10:19.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d5a3b9000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x559aa5c32900 con 0x559aa5ea2240 2024-04-25T09:10:19.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d5a3b9000 10 client.0 _ll_register_callbacks cb 0x559aa5d5a1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:19.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d4fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5e57f30 0x559aa5e926c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d4fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5e57f30 0x559aa5e926c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37820/0 (socket says 172.21.15.175:37820) 2024-04-25T09:10:19.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d4fe00640 1 -- 172.21.15.175:0/2411710382 learned_addr learned my addr 172.21.15.175:0/2411710382 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:19.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d4f400640 1 --2- 172.21.15.175:0/2411710382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5ea1920 0x559aa5eafc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d55000640 1 --2- 172.21.15.175:0/2411710382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5ea2240 0x559aa5eb21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d4fe00640 1 -- 172.21.15.175:0/2411710382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5ea2240 msgr2=0x559aa5eb21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:19.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d4fe00640 1 --2- 172.21.15.175:0/2411710382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5ea2240 0x559aa5eb21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d4fe00640 1 -- 172.21.15.175:0/2411710382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5ea1920 msgr2=0x559aa5eafc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:19.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d4fe00640 1 --2- 172.21.15.175:0/2411710382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5ea1920 0x559aa5eafc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d4fe00640 1 -- 172.21.15.175:0/2411710382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559aa5c5f630 con 0x559aa5e57f30 2024-04-25T09:10:19.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d55000640 1 --2- 172.21.15.175:0/2411710382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5ea2240 0x559aa5eb21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:19.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d4fe00640 1 --2- 172.21.15.175:0/2411710382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5e57f30 0x559aa5e926c0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000cc80 tx=0x7f8d40004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610622c3af91c2c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:19.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d39600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:10:19.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d39600640 1 -- 172.21.15.175:0/2411710382 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40027040 con 0x559aa5e57f30 2024-04-25T09:10:19.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d39600640 1 -- 172.21.15.175:0/2411710382 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8d4001d040 con 0x559aa5e57f30 2024-04-25T09:10:19.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/2411710382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d40017e20 con 0x559aa5e57f30 2024-04-25T09:10:19.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d39600640 1 -- 172.21.15.175:0/2411710382 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d40039050 con 0x559aa5e57f30 2024-04-25T09:10:19.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d5a3b9000 10 client.7482 fetch_fsmap learned FSMap version 64 2024-04-25T09:10:19.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/2411710382 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x559aa5c2f3a0 con 0x559aa5e57f30 2024-04-25T09:10:19.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d39600640 1 -- 172.21.15.175:0/2411710382 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d40017e20 con 0x559aa5e57f30 2024-04-25T09:10:19.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d39600640 1 -- 172.21.15.175:0/2411710382 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 64) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8d40022910 con 0x559aa5e57f30 2024-04-25T09:10:19.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d5a3b9000 10 client.7482 fetch_fsmap finished waiting for FSMap version 64 2024-04-25T09:10:19.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d5a3b9000 10 client.7482 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:10:19.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d5a3b9000 20 client.7482 populate_metadata read hostname 'smithi175' 2024-04-25T09:10:19.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/2411710382 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x559aa5eb4ed0 0x559aa5eb72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d5a3b9000 4 client.7482 mds_command: new command op to 7419 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:19.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/2411710382 --> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559aa5c42a50 con 0x559aa5eb4ed0 2024-04-25T09:10:19.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.002+0000 7f8d4f400640 1 --2- 172.21.15.175:0/2411710382 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x559aa5eb4ed0 0x559aa5eb72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.006+0000 7f8d39600640 10 client.7482 ms_handle_connect on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:19.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.006+0000 7f8d4f400640 1 --2- 172.21.15.175:0/2411710382 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x559aa5eb4ed0 0x559aa5eb72c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fa22711feded97c server_cookie=655f2100fb64bd84 in_seq=0 out_seq=0 2024-04-25T09:10:19.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.006+0000 7f8d39600640 1 -- 172.21.15.175:0/2411710382 <== mds.0 v2:172.21.15.175:6835/1399691338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559aa5c42a50 con 0x559aa5eb4ed0 2024-04-25T09:10:19.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.006+0000 7f8d39600640 10 client.7482 handle_command_reply: tid=0 2024-04-25T09:10:19.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.006+0000 7f8d5a3b9000 1 client.7482 shutdown 2024-04-25T09:10:19.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.006+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/2411710382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5e57f30 msgr2=0x559aa5e926c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.006+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/2411710382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5e57f30 0x559aa5e926c0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f8d4000cc80 tx=0x7f8d40004a50 comp rx=0 tx=0).stop 2024-04-25T09:10:19.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.006+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/2411710382 shutdown_connections 2024-04-25T09:10:19.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.006+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/2411710382 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x559aa5eb4ed0 0x559aa5eb72c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.006+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/2411710382 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5ea2240 0x559aa5eb21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.006+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/2411710382 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5ea1920 0x559aa5eafc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.006+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/2411710382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5e57f30 0x559aa5e926c0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.006+0000 7f8d39600640 0 client.7482 ms_handle_reset on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:20.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.006+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/2411710382 >> 172.21.15.175:0/2411710382 conn(0x559aa5e5e2a0 msgr2=0x559aa5e569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:20.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.006+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/2411710382 shutdown_connections 2024-04-25T09:10:20.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.006+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/2411710382 wait complete. 2024-04-25T09:10:20.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.006+0000 7f8d5a3b9000 20 client.7482 trim_cache size 0 max 16384 2024-04-25T09:10:20.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d5a3b9000 1 Processor -- start 2024-04-25T09:10:20.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d5a3b9000 1 -- start start 2024-04-25T09:10:20.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d5a3b9000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5e57f30 0x559aa5f01140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d5a3b9000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5ea1920 0x559aa5f01680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d5a3b9000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5ea2240 0x559aa5f01bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d5a3b9000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500b3970 con 0x559aa5e57f30 2024-04-25T09:10:20.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d5a3b9000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5013d750 con 0x559aa5ea2240 2024-04-25T09:10:20.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d5a3b9000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5015a860 con 0x559aa5ea1920 2024-04-25T09:10:20.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d4fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5e57f30 0x559aa5f01140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d4fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5e57f30 0x559aa5f01140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37830/0 (socket says 172.21.15.175:37830) 2024-04-25T09:10:20.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d4fe00640 1 -- 172.21.15.175:0/1403900588 learned_addr learned my addr 172.21.15.175:0/1403900588 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:20.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d4f400640 1 --2- 172.21.15.175:0/1403900588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5ea1920 0x559aa5f01680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d55000640 1 --2- 172.21.15.175:0/1403900588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5ea2240 0x559aa5f01bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d4fe00640 1 -- 172.21.15.175:0/1403900588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5ea1920 msgr2=0x559aa5f01680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:20.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d4fe00640 1 --2- 172.21.15.175:0/1403900588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5ea1920 0x559aa5f01680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d4fe00640 1 -- 172.21.15.175:0/1403900588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5ea2240 msgr2=0x559aa5f01bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:20.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d4fe00640 1 --2- 172.21.15.175:0/1403900588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5ea2240 0x559aa5f01bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d4fe00640 1 -- 172.21.15.175:0/1403900588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559aa5ea2070 con 0x559aa5e57f30 2024-04-25T09:10:20.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d55000640 1 --2- 172.21.15.175:0/1403900588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5ea2240 0x559aa5f01bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:20.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d4fe00640 1 --2- 172.21.15.175:0/1403900588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5e57f30 0x559aa5f01140 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009890 tx=0x7f8d40028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4b3259a88307e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:20.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d3be00640 1 -- 172.21.15.175:0/1403900588 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40042070 con 0x559aa5e57f30 2024-04-25T09:10:20.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d3be00640 1 -- 172.21.15.175:0/1403900588 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d40022730 con 0x559aa5e57f30 2024-04-25T09:10:20.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d3be00640 1 -- 172.21.15.175:0/1403900588 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d40027040 con 0x559aa5e57f30 2024-04-25T09:10:20.015 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/1403900588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5e57f30 msgr2=0x559aa5f01140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/1403900588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5e57f30 0x559aa5f01140 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009890 tx=0x7f8d40028000 comp rx=0 tx=0).stop 2024-04-25T09:10:20.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/1403900588 shutdown_connections 2024-04-25T09:10:20.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/1403900588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5ea2240 0x559aa5f01bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/1403900588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5ea1920 0x559aa5f01680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/1403900588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5e57f30 0x559aa5f01140 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/1403900588 >> 172.21.15.175:0/1403900588 conn(0x559aa5e5e2a0 msgr2=0x559aa5eb1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:20.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/1403900588 shutdown_connections 2024-04-25T09:10:20.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.022+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/1403900588 wait complete. 2024-04-25T09:10:20.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d5a3b9000 1 -- start start 2024-04-25T09:10:20.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d5a3b9000 1 Processor -- start 2024-04-25T09:10:20.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d5a3b9000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5e57f30 0x559aa5e5d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d5a3b9000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5ea1920 0x559aa5eea3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d5a3b9000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5ea2240 0x559aa5eea930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d5a3b9000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aa5cab3d0 con 0x559aa5ea1920 2024-04-25T09:10:20.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d5a3b9000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aa5d62d50 con 0x559aa5ea2240 2024-04-25T09:10:20.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d5a3b9000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x559aa5c41980 con 0x559aa5e57f30 2024-04-25T09:10:20.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d5a3b9000 10 client.0 _ll_register_callbacks cb 0x7f8d400096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:20.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d4f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5ea1920 0x559aa5eea3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d4f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5ea1920 0x559aa5eea3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37846/0 (socket says 172.21.15.175:37846) 2024-04-25T09:10:20.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d4f400640 1 -- 172.21.15.175:0/1795939165 learned_addr learned my addr 172.21.15.175:0/1795939165 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:20.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d4fe00640 1 --2- 172.21.15.175:0/1795939165 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5e57f30 0x559aa5e5d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d55000640 1 --2- 172.21.15.175:0/1795939165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5ea2240 0x559aa5eea930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d4f400640 1 -- 172.21.15.175:0/1795939165 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5e57f30 msgr2=0x559aa5e5d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:20.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d4f400640 1 --2- 172.21.15.175:0/1795939165 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5e57f30 0x559aa5e5d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d4f400640 1 -- 172.21.15.175:0/1795939165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5ea2240 msgr2=0x559aa5eea930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:20.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d4f400640 1 --2- 172.21.15.175:0/1795939165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5ea2240 0x559aa5eea930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d4f400640 1 -- 172.21.15.175:0/1795939165 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559aa5d28600 con 0x559aa5ea1920 2024-04-25T09:10:20.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d4fe00640 1 --2- 172.21.15.175:0/1795939165 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5e57f30 0x559aa5e5d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:20.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d4f400640 1 --2- 172.21.15.175:0/1795939165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5ea1920 0x559aa5eea3f0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c01ab60 tx=0x7f8d3c11f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b123b82c7d28aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:20.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d39600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:10:20.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d39600640 1 -- 172.21.15.175:0/1795939165 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3c0f8480 con 0x559aa5ea1920 2024-04-25T09:10:20.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d39600640 1 -- 172.21.15.175:0/1795939165 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8d3c0ee070 con 0x559aa5ea1920 2024-04-25T09:10:20.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/1795939165 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d40022730 con 0x559aa5ea1920 2024-04-25T09:10:20.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d39600640 1 -- 172.21.15.175:0/1795939165 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d3c0f60b0 con 0x559aa5ea1920 2024-04-25T09:10:20.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d5a3b9000 10 client.7488 fetch_fsmap learned FSMap version 64 2024-04-25T09:10:20.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/1795939165 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x559aa5c3b9b0 con 0x559aa5ea1920 2024-04-25T09:10:20.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d39600640 1 -- 172.21.15.175:0/1795939165 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d40022730 con 0x559aa5ea1920 2024-04-25T09:10:20.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d39600640 1 -- 172.21.15.175:0/1795939165 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 64) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8d3c118070 con 0x559aa5ea1920 2024-04-25T09:10:20.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d5a3b9000 10 client.7488 fetch_fsmap finished waiting for FSMap version 64 2024-04-25T09:10:20.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d5a3b9000 10 client.7488 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:10:20.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d5a3b9000 20 client.7488 populate_metadata read hostname 'smithi175' 2024-04-25T09:10:20.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/1795939165 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x559aa5eeae70 0x559aa5f06690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d5a3b9000 4 client.7488 mds_command: new command op to 7419 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:10:20.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/1795939165 --> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559aa5cb42e0 con 0x559aa5eeae70 2024-04-25T09:10:20.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d4fe00640 1 --2- 172.21.15.175:0/1795939165 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x559aa5eeae70 0x559aa5f06690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d39600640 10 client.7488 ms_handle_connect on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:20.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d4fe00640 1 --2- 172.21.15.175:0/1795939165 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x559aa5eeae70 0x559aa5f06690 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c883af9258ebd45e server_cookie=8deaa59b18948ceb in_seq=0 out_seq=0 2024-04-25T09:10:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.026+0000 7f8d39600640 1 -- 172.21.15.175:0/1795939165 <== mds.0 v2:172.21.15.175:6835/1399691338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x559aa5cb42e0 con 0x559aa5eeae70 2024-04-25T09:10:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d39600640 10 client.7488 handle_command_reply: tid=0 2024-04-25T09:10:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d5a3b9000 1 client.7488 shutdown 2024-04-25T09:10:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/1795939165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5ea1920 msgr2=0x559aa5eea3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/1795939165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5ea1920 0x559aa5eea3f0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c01ab60 tx=0x7f8d3c11f040 comp rx=0 tx=0).stop 2024-04-25T09:10:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/1795939165 shutdown_connections 2024-04-25T09:10:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/1795939165 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x559aa5eeae70 0x559aa5f06690 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/1795939165 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559aa5ea2240 0x559aa5eea930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/1795939165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559aa5ea1920 0x559aa5eea3f0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d5a3b9000 1 --2- 172.21.15.175:0/1795939165 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559aa5e57f30 0x559aa5e5d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d39600640 0 client.7488 ms_handle_reset on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/1795939165 >> 172.21.15.175:0/1795939165 conn(0x559aa5e5e2a0 msgr2=0x559aa5e58310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/1795939165 shutdown_connections 2024-04-25T09:10:20.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d5a3b9000 1 -- 172.21.15.175:0/1795939165 wait complete. 2024-04-25T09:10:20.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d5a3b9000 20 client.7488 trim_cache size 0 max 16384 2024-04-25T09:10:20.024 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:10:20.024 INFO:teuthology.orchestra.run.smithi175.stdout: "cluster_fsid": "8caed986-ca08-40e2-b5a5-12e2aade6223", 2024-04-25T09:10:20.024 INFO:teuthology.orchestra.run.smithi175.stdout: "whoami": 0, 2024-04-25T09:10:20.024 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 7419, 2024-04-25T09:10:20.024 INFO:teuthology.orchestra.run.smithi175.stdout: "want_state": "up:active", 2024-04-25T09:10:20.024 INFO:teuthology.orchestra.run.smithi175.stdout: "state": "up:active", 2024-04-25T09:10:20.024 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs", 2024-04-25T09:10:20.024 INFO:teuthology.orchestra.run.smithi175.stdout: "rank_uptime": 4.5316065649999997, 2024-04-25T09:10:20.024 INFO:teuthology.orchestra.run.smithi175.stdout: "mdsmap_epoch": 64, 2024-04-25T09:10:20.025 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch": 85, 2024-04-25T09:10:20.025 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch_barrier": 85, 2024-04-25T09:10:20.025 INFO:teuthology.orchestra.run.smithi175.stdout: "uptime": 5.5393586969999999 2024-04-25T09:10:20.025 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:10:20.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d57000640 1 -- 172.21.15.175:0/1524980416 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8d30066f60 msgr2=0x7f8d30069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d57000640 1 --2- 172.21.15.175:0/1524980416 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8d30066f60 0x7f8d30069420 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8d40009f20 tx=0x7f8d400094f0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d57000640 1 -- 172.21.15.175:0/1524980416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d50145250 msgr2=0x7f8d5006dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d57000640 1 --2- 172.21.15.175:0/1524980416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d50145250 0x7f8d5006dc10 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0ac040 tx=0x7f8d3c019250 comp rx=0 tx=0).stop 2024-04-25T09:10:20.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d57000640 1 -- 172.21.15.175:0/1524980416 shutdown_connections 2024-04-25T09:10:20.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d57000640 1 --2- 172.21.15.175:0/1524980416 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8d30066f60 0x7f8d30069420 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d57000640 1 --2- 172.21.15.175:0/1524980416 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d501600a0 0x7f8d501414a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d57000640 1 --2- 172.21.15.175:0/1524980416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d50145250 0x7f8d5006dc10 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d57000640 1 --2- 172.21.15.175:0/1524980416 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d500ce970 0x7f8d50140da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d57000640 1 -- 172.21.15.175:0/1524980416 >> 172.21.15.175:0/1524980416 conn(0x7f8d5006ac50 msgr2=0x7f8d500b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:20.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d57000640 1 -- 172.21.15.175:0/1524980416 shutdown_connections 2024-04-25T09:10:20.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.030+0000 7f8d57000640 1 -- 172.21.15.175:0/1524980416 wait complete. 2024-04-25T09:10:20.039 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:10:20.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.182+0000 7f1e17200640 1 Processor -- start 2024-04-25T09:10:20.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.182+0000 7f1e17200640 1 -- start start 2024-04-25T09:10:20.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e17200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e180cf460 0x7f1e18099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e17200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e180ccd30 con 0x7f1e18099f90 2024-04-25T09:10:20.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e17200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e180cd010 con 0x7f1e1815b9f0 2024-04-25T09:10:20.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e17200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180cd940 con 0x7f1e180cf460 2024-04-25T09:10:20.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e16800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f1e18099f90 0x7f1e180b0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:49340/0 (socket says 172.21.15.175:49340) 2024-04-25T09:10:20.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e16800640 1 -- 172.21.15.175:0/680532342 learned_addr learned my addr 172.21.15.175:0/680532342 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:10:20.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e0fe00640 1 --2- 172.21.15.175:0/680532342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e180cf460 0x7f1e18099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15400640 1 -- 172.21.15.175:0/680532342 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342643239 0 0) 0x7f1e180ccd30 con 0x7f1e18099f90 2024-04-25T09:10:20.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15400640 1 -- 172.21.15.175:0/680532342 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dfc003530 con 0x7f1e18099f90 2024-04-25T09:10:20.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15400640 1 -- 172.21.15.175:0/680532342 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2802335528 0 0) 0x7f1dfc003530 con 0x7f1e18099f90 2024-04-25T09:10:20.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15400640 1 -- 172.21.15.175:0/680532342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e180cf460 msgr2=0x7f1e18099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:20.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15400640 1 --2- 172.21.15.175:0/680532342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e180cf460 0x7f1e18099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15400640 1 -- 172.21.15.175:0/680532342 >> v1:172.21.15.177:6789/0 conn(0x7f1e1815b9f0 legacy=0x7f1e180cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15400640 1 -- 172.21.15.175:0/680532342 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e180cd2f0 con 0x7f1e18099f90 2024-04-25T09:10:20.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15400640 1 -- 172.21.15.175:0/680532342 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f1e10001a00 con 0x7f1e18099f90 2024-04-25T09:10:20.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15400640 1 -- 172.21.15.175:0/680532342 >> v1:172.21.15.175:6789/0 conn(0x7f1e18099f90 legacy=0x7f1e180b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15400640 1 --2- 172.21.15.175:0/680532342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dfc003a60 0x7f1dfc003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15400640 1 --2- 172.21.15.175:0/680532342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dfc004810 0x7f1dfc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15400640 1 --2- 172.21.15.175:0/680532342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dfc0051d0 0x7f1dfc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15400640 1 -- 172.21.15.175:0/680532342 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180cd940 con 0x7f1dfc003a60 2024-04-25T09:10:20.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15400640 1 -- 172.21.15.175:0/680532342 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc00bfc0 con 0x7f1dfc0051d0 2024-04-25T09:10:20.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15400640 1 -- 172.21.15.175:0/680532342 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc00c1c0 con 0x7f1dfc004810 2024-04-25T09:10:20.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e0fe00640 1 --2- 172.21.15.175:0/680532342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e180cf460 0x7f1e18099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:20.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15e00640 1 --2- 172.21.15.175:0/680532342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dfc003a60 0x7f1dfc003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e16800640 1 --2- 172.21.15.175:0/680532342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dfc0051d0 0x7f1dfc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e0fe00640 1 --2- 172.21.15.175:0/680532342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dfc004810 0x7f1dfc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15e00640 1 -- 172.21.15.175:0/680532342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dfc004810 msgr2=0x7f1dfc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:20.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15e00640 1 --2- 172.21.15.175:0/680532342 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dfc004810 0x7f1dfc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15e00640 1 -- 172.21.15.175:0/680532342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dfc0051d0 msgr2=0x7f1dfc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:20.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15e00640 1 --2- 172.21.15.175:0/680532342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dfc0051d0 0x7f1dfc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e15e00640 1 -- 172.21.15.175:0/680532342 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc003530 con 0x7f1dfc003a60 2024-04-25T09:10:20.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.186+0000 7f1e16800640 1 --2- 172.21.15.175:0/680532342 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dfc0051d0 0x7f1dfc00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:20.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.190+0000 7f1e15e00640 1 --2- 172.21.15.175:0/680532342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dfc003a60 0x7f1dfc003e40 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f1e08001910 tx=0x7f1e0801c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e983c6e0eee061b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:20.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.190+0000 7f1e15400640 1 -- 172.21.15.175:0/680532342 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e080b1070 con 0x7f1dfc003a60 2024-04-25T09:10:20.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.190+0000 7f1e15400640 1 -- 172.21.15.175:0/680532342 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e080ac410 con 0x7f1dfc003a60 2024-04-25T09:10:20.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.190+0000 7f1e15400640 1 -- 172.21.15.175:0/680532342 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e08001510 con 0x7f1dfc003a60 2024-04-25T09:10:20.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.190+0000 7f1e17200640 1 -- 172.21.15.175:0/680532342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dfc003a60 msgr2=0x7f1dfc003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.190+0000 7f1e17200640 1 --2- 172.21.15.175:0/680532342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dfc003a60 0x7f1dfc003e40 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f1e08001910 tx=0x7f1e0801c580 comp rx=0 tx=0).stop 2024-04-25T09:10:20.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.190+0000 7f1e16800640 1 -- 172.21.15.175:0/680532342 reap_dead start 2024-04-25T09:10:20.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.190+0000 7f1e17200640 1 -- 172.21.15.175:0/680532342 shutdown_connections 2024-04-25T09:10:20.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.190+0000 7f1e17200640 1 -- 172.21.15.175:0/680532342 >> 172.21.15.175:0/680532342 conn(0x7f1e180b3170 msgr2=0x7f1e180b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:20.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.190+0000 7f1e17200640 1 -- 172.21.15.175:0/680532342 shutdown_connections 2024-04-25T09:10:20.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.190+0000 7f1e17200640 1 -- 172.21.15.175:0/680532342 wait complete. 2024-04-25T09:10:20.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.190+0000 7f1e17200640 1 Processor -- start 2024-04-25T09:10:20.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.190+0000 7f1e17200640 1 -- start start 2024-04-25T09:10:20.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e17200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dfc003a60 0x7f1e181537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e17200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e181663c0 0x7f1e18152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e17200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e1806bd60 0x7f1e1806c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e17200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e18167910 con 0x7f1dfc003a60 2024-04-25T09:10:20.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e17200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1809a3a0 con 0x7f1e181663c0 2024-04-25T09:10:20.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e17200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e18167a90 con 0x7f1e1806bd60 2024-04-25T09:10:20.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e15e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dfc003a60 0x7f1e181537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e15e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dfc003a60 0x7f1e181537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37866/0 (socket says 172.21.15.175:37866) 2024-04-25T09:10:20.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e15e00640 1 -- 172.21.15.175:0/3479718338 learned_addr learned my addr 172.21.15.175:0/3479718338 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:20.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e0fe00640 1 --2- 172.21.15.175:0/3479718338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e181663c0 0x7f1e18152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e16800640 1 --2- 172.21.15.175:0/3479718338 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e1806bd60 0x7f1e1806c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e15e00640 1 -- 172.21.15.175:0/3479718338 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e1806bd60 msgr2=0x7f1e1806c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e15e00640 1 --2- 172.21.15.175:0/3479718338 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e1806bd60 0x7f1e1806c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e15e00640 1 -- 172.21.15.175:0/3479718338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e181663c0 msgr2=0x7f1e18152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e15e00640 1 --2- 172.21.15.175:0/3479718338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e181663c0 0x7f1e18152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e15e00640 1 -- 172.21.15.175:0/3479718338 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e18165ec0 con 0x7f1dfc003a60 2024-04-25T09:10:20.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e15e00640 1 --2- 172.21.15.175:0/3479718338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dfc003a60 0x7f1e181537c0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f1e0801c3b0 tx=0x7f1dfc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:20.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e0e000640 1 -- 172.21.15.175:0/3479718338 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e080ba020 con 0x7f1dfc003a60 2024-04-25T09:10:20.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e0e000640 1 -- 172.21.15.175:0/3479718338 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e080014f0 con 0x7f1dfc003a60 2024-04-25T09:10:20.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e17200640 1 -- 172.21.15.175:0/3479718338 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e18153f30 con 0x7f1dfc003a60 2024-04-25T09:10:20.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e0e000640 1 -- 172.21.15.175:0/3479718338 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e080b1040 con 0x7f1dfc003a60 2024-04-25T09:10:20.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e17200640 1 -- 172.21.15.175:0/3479718338 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e181544f0 con 0x7f1dfc003a60 2024-04-25T09:10:20.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.194+0000 7f1e17200640 1 -- 172.21.15.175:0/3479718338 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e18074a60 con 0x7f1dfc003a60 2024-04-25T09:10:20.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.198+0000 7f1e0e000640 1 -- 172.21.15.175:0/3479718338 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1e080bd020 con 0x7f1dfc003a60 2024-04-25T09:10:20.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.198+0000 7f1e0e000640 1 --2- 172.21.15.175:0/3479718338 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1df4066f60 0x7f1df4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:20.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.198+0000 7f1e0e000640 1 -- 172.21.15.175:0/3479718338 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f1e0811eca0 con 0x7f1dfc003a60 2024-04-25T09:10:20.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.198+0000 7f1e0fe00640 1 --2- 172.21.15.175:0/3479718338 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1df4066f60 0x7f1df4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:20.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.198+0000 7f1e0fe00640 1 --2- 172.21.15.175:0/3479718338 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1df4066f60 0x7f1df4069420 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1e181667c0 tx=0x7f1e00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:20.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.202+0000 7f1e0e000640 1 -- 172.21.15.175:0/3479718338 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1e080c4030 con 0x7f1dfc003a60 2024-04-25T09:10:20.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.390+0000 7f1e17200640 1 -- 172.21.15.175:0/3479718338 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1e1809a8b0 con 0x7f1dfc003a60 2024-04-25T09:10:20.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.390+0000 7f1e0e000640 1 -- 172.21.15.175:0/3479718338 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v64) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1e08016290 con 0x7f1dfc003a60 2024-04-25T09:10:20.381 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:10:20.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.390+0000 7f1e17200640 1 -- 172.21.15.175:0/3479718338 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1df4066f60 msgr2=0x7f1df4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.390+0000 7f1e17200640 1 --2- 172.21.15.175:0/3479718338 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1df4066f60 0x7f1df4069420 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1e181667c0 tx=0x7f1e00008040 comp rx=0 tx=0).stop 2024-04-25T09:10:20.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.390+0000 7f1e17200640 1 -- 172.21.15.175:0/3479718338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dfc003a60 msgr2=0x7f1e181537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:20.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.390+0000 7f1e17200640 1 --2- 172.21.15.175:0/3479718338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dfc003a60 0x7f1e181537c0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f1e0801c3b0 tx=0x7f1dfc005840 comp rx=0 tx=0).stop 2024-04-25T09:10:20.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.390+0000 7f1e17200640 1 -- 172.21.15.175:0/3479718338 shutdown_connections 2024-04-25T09:10:20.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.390+0000 7f1e17200640 1 --2- 172.21.15.175:0/3479718338 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1df4066f60 0x7f1df4069420 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.390+0000 7f1e17200640 1 --2- 172.21.15.175:0/3479718338 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e1806bd60 0x7f1e1806c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.390+0000 7f1e17200640 1 --2- 172.21.15.175:0/3479718338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e181663c0 0x7f1e18152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.390+0000 7f1e17200640 1 --2- 172.21.15.175:0/3479718338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dfc003a60 0x7f1e181537c0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:20.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.390+0000 7f1e17200640 1 -- 172.21.15.175:0/3479718338 >> 172.21.15.175:0/3479718338 conn(0x7f1e180b3170 msgr2=0x7f1e180b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:20.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.390+0000 7f1e17200640 1 -- 172.21.15.175:0/3479718338 shutdown_connections 2024-04-25T09:10:20.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:20.390+0000 7f1e17200640 1 -- 172.21.15.175:0/3479718338 wait complete. 2024-04-25T09:10:20.402 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:10:20.402 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:10:20.402 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-25T09:10:20.402 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:10:20.402 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:20.403 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:10:20.403 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:10:20.403 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:10:20.403 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:10:20.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:20.403 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-25T09:10:20.412 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:10:20.412 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:10:20.412 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:10:20.412 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:20.412 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:10:20.412 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:20.412 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:10:20.412 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:20.412 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-25T09:10:20.412 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:10:20.413 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:20.413 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-25T09:10:20.413 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:10:20.413 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:20.413 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:10:20.413 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:20.413 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:10:20.413 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42099sec preferred_lft 42099sec 2024-04-25T09:10:20.413 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-25T09:10:20.413 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:20.413 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:10:20.413 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:0d:71:4a:a6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:20.413 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:10:20.413 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:20.413 INFO:teuthology.orchestra.run.smithi175.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:10:20.414 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:20.414 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:10:20.414 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:20.414 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:10:20.414 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:20.414 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:10:20.414 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:10:20.414 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:10:20.414 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:20.414 INFO:teuthology.orchestra.run.smithi175.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:10:20.414 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:10:20.414 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:10:20.414 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:20.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:20.415 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:10:20.476 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:10:20.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:20.478 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-25T09:10:20.489 INFO:tasks.ceph.mds.c.smithi175.stderr:2024-04-25T09:10:20.498+0000 7f8346200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:10:20.500 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-25T09:10:20.500 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:10:20.500 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:10:20.500 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:10:20.500 INFO:teuthology.orchestra.run.smithi175.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:10:20.500 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:10:20.501 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:10:20.501 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:10:20.501 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:10:20.501 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:10:20.501 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:10:20.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:20.501 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:10:20.501 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:10:20.501 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:10:20.501 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:10:20.502 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:10:20.502 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:10:20.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:20.591 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:10:20.643 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:10:20.643 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:10:20.643 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:10:20.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:20.643 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-25T09:10:20.706 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:10:20.706 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:20.755 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:10:20.755 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:10:20.756 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:20.810 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:10:20.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:20.810 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:20.901 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:20.902 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:10:20.902 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:10:20.917 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:20.917 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:10:20.917 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:10:20.917 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:10:20.917 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:10:20.926 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:20.926 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:10:20.926 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:10:20.926 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:10:20.927 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:10:20.927 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:10:20.927 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:10:20.927 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:10:20.931 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:10:20.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:20.931 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:20.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:20.993 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:10:21.045 INFO:teuthology.orchestra.run.smithi175.stdout:client7096 2024-04-25T09:10:21.046 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:10:21.046 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:21.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:21.098 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat testdir/hardlink) 2024-04-25T09:10:21.153 INFO:tasks.ceph.mds.c.smithi175.stderr:2024-04-25T09:10:21.162+0000 7f8341200640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-25T09:10:21.154 INFO:teuthology.orchestra.run.smithi175.stderr:stat: cannot statx 'testdir/hardlink': Input/output error 2024-04-25T09:10:21.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:10:21.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:21.155 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive 2024-04-25T09:10:21.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.346+0000 7fa30e000640 1 Processor -- start 2024-04-25T09:10:21.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.346+0000 7fa30e000640 1 -- start start 2024-04-25T09:10:21.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.346+0000 7fa30e000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3080712b0 0x7fa308071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.346+0000 7fa30e000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa308071e20 con 0x7fa30806d860 2024-04-25T09:10:21.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.346+0000 7fa30e000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa308072100 con 0x7fa3080cfb60 2024-04-25T09:10:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.346+0000 7fa30e000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080cbed0 con 0x7fa3080712b0 2024-04-25T09:10:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.346+0000 7fa307e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa30806d860 0x7fa3080cc920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:49356/0 (socket says 172.21.15.175:49356) 2024-04-25T09:10:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.346+0000 7fa307e00640 1 -- 172.21.15.175:0/1050554265 learned_addr learned my addr 172.21.15.175:0/1050554265 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:10:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.346+0000 7fa306a00640 1 --2- 172.21.15.175:0/1050554265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3080712b0 0x7fa308071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.346+0000 7fa306000640 1 -- 172.21.15.175:0/1050554265 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279407217 0 0) 0x7fa308071e20 con 0x7fa30806d860 2024-04-25T09:10:21.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306000640 1 -- 172.21.15.175:0/1050554265 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2ec003530 con 0x7fa30806d860 2024-04-25T09:10:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306000640 1 -- 172.21.15.175:0/1050554265 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2250641413 0 0) 0x7fa308072100 con 0x7fa3080cfb60 2024-04-25T09:10:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306000640 1 -- 172.21.15.175:0/1050554265 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa308071e20 con 0x7fa3080cfb60 2024-04-25T09:10:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306000640 1 -- 172.21.15.175:0/1050554265 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3429241031 0 0) 0x7fa2ec003530 con 0x7fa30806d860 2024-04-25T09:10:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306000640 1 -- 172.21.15.175:0/1050554265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3080712b0 msgr2=0x7fa308071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306000640 1 --2- 172.21.15.175:0/1050554265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3080712b0 0x7fa308071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306000640 1 -- 172.21.15.175:0/1050554265 >> v1:172.21.15.177:6789/0 conn(0x7fa3080cfb60 legacy=0x7fa3080ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306000640 1 -- 172.21.15.175:0/1050554265 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3080cc120 con 0x7fa30806d860 2024-04-25T09:10:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306000640 1 -- 172.21.15.175:0/1050554265 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fa300001680 con 0x7fa30806d860 2024-04-25T09:10:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306000640 1 -- 172.21.15.175:0/1050554265 >> v1:172.21.15.175:6789/0 conn(0x7fa30806d860 legacy=0x7fa3080cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306000640 1 --2- 172.21.15.175:0/1050554265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2ec003b80 0x7fa2ec003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306000640 1 --2- 172.21.15.175:0/1050554265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2ec004810 0x7fa2ec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306000640 1 --2- 172.21.15.175:0/1050554265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2ec0051d0 0x7fa2ec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306000640 1 -- 172.21.15.175:0/1050554265 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080cbed0 con 0x7fa2ec0051d0 2024-04-25T09:10:21.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306000640 1 -- 172.21.15.175:0/1050554265 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec00c0a0 con 0x7fa2ec004810 2024-04-25T09:10:21.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306000640 1 -- 172.21.15.175:0/1050554265 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec00c2a0 con 0x7fa2ec003b80 2024-04-25T09:10:21.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306a00640 1 --2- 172.21.15.175:0/1050554265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3080712b0 0x7fa308071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:21.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa307e00640 1 --2- 172.21.15.175:0/1050554265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2ec0051d0 0x7fa2ec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306a00640 1 --2- 172.21.15.175:0/1050554265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2ec004810 0x7fa2ec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa307400640 1 --2- 172.21.15.175:0/1050554265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2ec003b80 0x7fa2ec003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa307e00640 1 -- 172.21.15.175:0/1050554265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2ec003b80 msgr2=0x7fa2ec003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa307e00640 1 --2- 172.21.15.175:0/1050554265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa2ec003b80 0x7fa2ec003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa307e00640 1 -- 172.21.15.175:0/1050554265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2ec004810 msgr2=0x7fa2ec004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa307e00640 1 --2- 172.21.15.175:0/1050554265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2ec004810 0x7fa2ec004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa307e00640 1 -- 172.21.15.175:0/1050554265 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec003530 con 0x7fa2ec0051d0 2024-04-25T09:10:21.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa306a00640 1 --2- 172.21.15.175:0/1050554265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa2ec004810 0x7fa2ec004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:21.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.350+0000 7fa307e00640 1 --2- 172.21.15.175:0/1050554265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2ec0051d0 0x7fa2ec00b9d0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fa30000c190 tx=0x7fa30001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e05fd64be9e77b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa306000640 1 -- 172.21.15.175:0/1050554265 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300007cd0 con 0x7fa2ec0051d0 2024-04-25T09:10:21.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa306000640 1 -- 172.21.15.175:0/1050554265 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3000a9020 con 0x7fa2ec0051d0 2024-04-25T09:10:21.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa306000640 1 -- 172.21.15.175:0/1050554265 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3000a5b00 con 0x7fa2ec0051d0 2024-04-25T09:10:21.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa30e000640 1 -- 172.21.15.175:0/1050554265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2ec0051d0 msgr2=0x7fa2ec00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa30e000640 1 --2- 172.21.15.175:0/1050554265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2ec0051d0 0x7fa2ec00b9d0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fa30000c190 tx=0x7fa30001cc00 comp rx=0 tx=0).stop 2024-04-25T09:10:21.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa307e00640 1 -- 172.21.15.175:0/1050554265 reap_dead start 2024-04-25T09:10:21.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa30e000640 1 -- 172.21.15.175:0/1050554265 shutdown_connections 2024-04-25T09:10:21.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa30e000640 1 -- 172.21.15.175:0/1050554265 >> 172.21.15.175:0/1050554265 conn(0x7fa30806ac50 msgr2=0x7fa30806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa30e000640 1 -- 172.21.15.175:0/1050554265 shutdown_connections 2024-04-25T09:10:21.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa30e000640 1 -- 172.21.15.175:0/1050554265 wait complete. 2024-04-25T09:10:21.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa30e000640 1 Processor -- start 2024-04-25T09:10:21.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa30e000640 1 -- start start 2024-04-25T09:10:21.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa30e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2ec0051d0 0x7fa3081e8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa30e000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa308141d50 0x7fa30815df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa30e000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa308141150 0x7fa3081415d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa30e000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080cff40 con 0x7fa2ec0051d0 2024-04-25T09:10:21.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa30e000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30806e650 con 0x7fa308141d50 2024-04-25T09:10:21.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa30e000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080d00c0 con 0x7fa308141150 2024-04-25T09:10:21.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa307400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2ec0051d0 0x7fa3081e8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa307400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2ec0051d0 0x7fa3081e8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37890/0 (socket says 172.21.15.175:37890) 2024-04-25T09:10:21.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.354+0000 7fa307400640 1 -- 172.21.15.175:0/2958117229 learned_addr learned my addr 172.21.15.175:0/2958117229 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:21.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa307400640 1 -- 172.21.15.175:0/2958117229 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa308141150 msgr2=0x7fa3081415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa307e00640 1 --2- 172.21.15.175:0/2958117229 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa308141150 0x7fa3081415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa307400640 1 --2- 172.21.15.175:0/2958117229 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa308141150 0x7fa3081415d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa306a00640 1 --2- 172.21.15.175:0/2958117229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa308141d50 0x7fa30815df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa307400640 1 -- 172.21.15.175:0/2958117229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa308141d50 msgr2=0x7fa30815df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa307400640 1 --2- 172.21.15.175:0/2958117229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa308141d50 0x7fa30815df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa307400640 1 -- 172.21.15.175:0/2958117229 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3081e6b00 con 0x7fa2ec0051d0 2024-04-25T09:10:21.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa307e00640 1 --2- 172.21.15.175:0/2958117229 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa308141150 0x7fa3081415d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:21.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa306a00640 1 --2- 172.21.15.175:0/2958117229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa308141d50 0x7fa30815df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:21.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa307400640 1 --2- 172.21.15.175:0/2958117229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2ec0051d0 0x7fa3081e8ef0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8011d40 tx=0x7fa2f800f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa2ff400640 1 -- 172.21.15.175:0/2958117229 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8010040 con 0x7fa2ec0051d0 2024-04-25T09:10:21.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa2ff400640 1 -- 172.21.15.175:0/2958117229 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f801a070 con 0x7fa2ec0051d0 2024-04-25T09:10:21.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa2ff400640 1 -- 172.21.15.175:0/2958117229 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f800fe60 con 0x7fa2ec0051d0 2024-04-25T09:10:21.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa30e000640 1 -- 172.21.15.175:0/2958117229 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3081e6820 con 0x7fa2ec0051d0 2024-04-25T09:10:21.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa30e000640 1 -- 172.21.15.175:0/2958117229 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3080b2e90 con 0x7fa2ec0051d0 2024-04-25T09:10:21.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa2ff400640 1 -- 172.21.15.175:0/2958117229 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa2f8015890 con 0x7fa2ec0051d0 2024-04-25T09:10:21.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa2ff400640 1 --2- 172.21.15.175:0/2958117229 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa2e8066f60 0x7fa2e8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa311513000 1 Processor -- start 2024-04-25T09:10:21.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.358+0000 7fa2ff400640 1 -- 172.21.15.175:0/2958117229 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa2f80888a0 con 0x7fa2ec0051d0 2024-04-25T09:10:21.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa306a00640 1 --2- 172.21.15.175:0/2958117229 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa2e8066f60 0x7fa2e8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa311513000 1 -- start start 2024-04-25T09:10:21.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa306a00640 1 --2- 172.21.15.175:0/2958117229 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa2e8066f60 0x7fa2e8069420 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa3080cd390 tx=0x7fa2f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa311513000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 0x563ad3492da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa311513000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad34932e0 0x563ad34771e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa311513000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad3477720 0x563ad3477b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa311513000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ad328dfd0 con 0x563ad34929c0 2024-04-25T09:10:21.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa311513000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ad3216170 con 0x563ad3477720 2024-04-25T09:10:21.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa311513000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ad328a070 con 0x563ad34932e0 2024-04-25T09:10:21.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa307400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 0x563ad3492da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa307400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 0x563ad3492da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37892/0 (socket says 172.21.15.175:37892) 2024-04-25T09:10:21.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa307400640 1 -- 172.21.15.175:0/4031220286 learned_addr learned my addr 172.21.15.175:0/4031220286 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:21.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa307e00640 1 --2- 172.21.15.175:0/4031220286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad3477720 0x563ad3477b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa306a00640 1 --2- 172.21.15.175:0/4031220286 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad34932e0 0x563ad34771e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa307400640 1 -- 172.21.15.175:0/4031220286 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad34932e0 msgr2=0x563ad34771e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa307400640 1 --2- 172.21.15.175:0/4031220286 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad34932e0 0x563ad34771e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa307400640 1 -- 172.21.15.175:0/4031220286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad3477720 msgr2=0x563ad3477b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa307400640 1 --2- 172.21.15.175:0/4031220286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad3477720 0x563ad3477b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa307400640 1 -- 172.21.15.175:0/4031220286 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ad32d4d20 con 0x563ad34929c0 2024-04-25T09:10:21.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa306a00640 1 --2- 172.21.15.175:0/4031220286 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad34932e0 0x563ad34771e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:21.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa307400640 1 --2- 172.21.15.175:0/4031220286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 0x563ad3492da0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8058db0 tx=0x7fa2f801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65852ba07dd36e46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa2f3e00640 1 -- 172.21.15.175:0/4031220286 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f805d200 con 0x563ad34929c0 2024-04-25T09:10:21.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa2f3e00640 1 -- 172.21.15.175:0/4031220286 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f80617c0 con 0x563ad34929c0 2024-04-25T09:10:21.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa2f3e00640 1 -- 172.21.15.175:0/4031220286 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8055720 con 0x563ad34929c0 2024-04-25T09:10:21.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa311513000 1 -- 172.21.15.175:0/4031220286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 msgr2=0x563ad3492da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa311513000 1 --2- 172.21.15.175:0/4031220286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 0x563ad3492da0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8058db0 tx=0x7fa2f801f000 comp rx=0 tx=0).stop 2024-04-25T09:10:21.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa311513000 1 -- 172.21.15.175:0/4031220286 shutdown_connections 2024-04-25T09:10:21.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa311513000 1 --2- 172.21.15.175:0/4031220286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad3477720 0x563ad3477b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa311513000 1 --2- 172.21.15.175:0/4031220286 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad34932e0 0x563ad34771e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa311513000 1 --2- 172.21.15.175:0/4031220286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 0x563ad3492da0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa311513000 1 -- 172.21.15.175:0/4031220286 >> 172.21.15.175:0/4031220286 conn(0x563ad3446710 msgr2=0x563ad3446af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa311513000 1 -- 172.21.15.175:0/4031220286 shutdown_connections 2024-04-25T09:10:21.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa311513000 1 -- 172.21.15.175:0/4031220286 wait complete. 2024-04-25T09:10:21.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa311513000 1 -- start start 2024-04-25T09:10:21.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.362+0000 7fa311513000 1 Processor -- start 2024-04-25T09:10:21.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa311513000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad3477720 0x563ad349a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa311513000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad34929c0 0x563ad349a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa311513000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34932e0 0x563ad3477b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa311513000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ad334bc10 con 0x563ad34932e0 2024-04-25T09:10:21.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa311513000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ad3248680 con 0x563ad3477720 2024-04-25T09:10:21.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa311513000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ad3292600 con 0x563ad34929c0 2024-04-25T09:10:21.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa311513000 10 client.0 _ll_register_callbacks cb 0x563ad3343080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:21.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa307e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34932e0 0x563ad3477b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa307e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34932e0 0x563ad3477b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37904/0 (socket says 172.21.15.175:37904) 2024-04-25T09:10:21.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa307400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad3477720 0x563ad349a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa307e00640 1 -- 172.21.15.175:0/1568791470 learned_addr learned my addr 172.21.15.175:0/1568791470 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:21.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa306a00640 1 --2- 172.21.15.175:0/1568791470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad34929c0 0x563ad349a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa307e00640 1 -- 172.21.15.175:0/1568791470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad34929c0 msgr2=0x563ad349a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa307e00640 1 --2- 172.21.15.175:0/1568791470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad34929c0 0x563ad349a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa307e00640 1 -- 172.21.15.175:0/1568791470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad3477720 msgr2=0x563ad349a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa307e00640 1 --2- 172.21.15.175:0/1568791470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad3477720 0x563ad349a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa307e00640 1 -- 172.21.15.175:0/1568791470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ad3265d30 con 0x563ad34932e0 2024-04-25T09:10:21.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa307e00640 1 --2- 172.21.15.175:0/1568791470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34932e0 0x563ad3477b00 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fa30001ca30 tx=0x7fa3000199a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ad93bef6c9c6e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa2f0c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:10:21.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa2f0c00640 1 -- 172.21.15.175:0/1568791470 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300007cd0 con 0x563ad34932e0 2024-04-25T09:10:21.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa2f0c00640 1 -- 172.21.15.175:0/1568791470 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa3000b9b70 con 0x563ad34932e0 2024-04-25T09:10:21.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa311513000 1 -- 172.21.15.175:0/1568791470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2f80617c0 con 0x563ad34932e0 2024-04-25T09:10:21.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa2f0c00640 1 -- 172.21.15.175:0/1568791470 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3000b9d70 con 0x563ad34932e0 2024-04-25T09:10:21.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa311513000 10 client.7506 fetch_fsmap learned FSMap version 64 2024-04-25T09:10:21.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa311513000 1 -- 172.21.15.175:0/1568791470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x563ad32163c0 con 0x563ad34932e0 2024-04-25T09:10:21.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa2f0c00640 1 -- 172.21.15.175:0/1568791470 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f80617c0 con 0x563ad34932e0 2024-04-25T09:10:21.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa2f0c00640 1 -- 172.21.15.175:0/1568791470 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 64) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa3000a5900 con 0x563ad34932e0 2024-04-25T09:10:21.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa311513000 10 client.7506 fetch_fsmap finished waiting for FSMap version 64 2024-04-25T09:10:21.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa311513000 10 client.7506 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:10:21.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa311513000 20 client.7506 populate_metadata read hostname 'smithi175' 2024-04-25T09:10:21.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa311513000 1 --2- 172.21.15.175:0/1568791470 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x563ad3478870 0x563ad3478c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa311513000 4 client.7506 mds_command: new command op to 7419 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:21.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa311513000 1 -- 172.21.15.175:0/1568791470 --> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563ad3229e00 con 0x563ad3478870 2024-04-25T09:10:21.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa307400640 1 --2- 172.21.15.175:0/1568791470 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x563ad3478870 0x563ad3478c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa307400640 1 --2- 172.21.15.175:0/1568791470 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x563ad3478870 0x563ad3478c50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c920e474f86d479e server_cookie=e1338f137b21cda0 in_seq=0 out_seq=0 2024-04-25T09:10:21.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa2f0c00640 10 client.7506 ms_handle_connect on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:21.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa2f0c00640 1 -- 172.21.15.175:0/1568791470 <== mds.0 v2:172.21.15.175:6835/1399691338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563ad3229e00 con 0x563ad3478870 2024-04-25T09:10:21.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa2f0c00640 10 client.7506 handle_command_reply: tid=0 2024-04-25T09:10:21.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.366+0000 7fa311513000 1 client.7506 shutdown 2024-04-25T09:10:21.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.370+0000 7fa311513000 1 -- 172.21.15.175:0/1568791470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34932e0 msgr2=0x563ad3477b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.370+0000 7fa311513000 1 --2- 172.21.15.175:0/1568791470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34932e0 0x563ad3477b00 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fa30001ca30 tx=0x7fa3000199a0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.370+0000 7fa311513000 1 -- 172.21.15.175:0/1568791470 shutdown_connections 2024-04-25T09:10:21.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.370+0000 7fa311513000 1 --2- 172.21.15.175:0/1568791470 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x563ad3478870 0x563ad3478c50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.370+0000 7fa311513000 1 --2- 172.21.15.175:0/1568791470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34932e0 0x563ad3477b00 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.370+0000 7fa2f0c00640 0 client.7506 ms_handle_reset on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:21.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.370+0000 7fa311513000 1 --2- 172.21.15.175:0/1568791470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad34929c0 0x563ad349a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.370+0000 7fa311513000 1 --2- 172.21.15.175:0/1568791470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad3477720 0x563ad349a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.370+0000 7fa311513000 1 -- 172.21.15.175:0/1568791470 >> 172.21.15.175:0/1568791470 conn(0x563ad3446710 msgr2=0x563ad343e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.370+0000 7fa311513000 1 -- 172.21.15.175:0/1568791470 shutdown_connections 2024-04-25T09:10:21.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.370+0000 7fa311513000 1 -- 172.21.15.175:0/1568791470 wait complete. 2024-04-25T09:10:21.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.370+0000 7fa311513000 20 client.7506 trim_cache size 0 max 16384 2024-04-25T09:10:21.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.382+0000 7fa311513000 1 Processor -- start 2024-04-25T09:10:21.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.382+0000 7fa311513000 1 -- start start 2024-04-25T09:10:21.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad3477720 0x563ad3490d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 0x563ad3491250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad34932e0 0x563ad3491790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080aba30 con 0x563ad34929c0 2024-04-25T09:10:21.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080aac50 con 0x563ad34932e0 2024-04-25T09:10:21.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080aa050 con 0x563ad3477720 2024-04-25T09:10:21.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa306a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 0x563ad3491250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa306a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 0x563ad3491250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37916/0 (socket says 172.21.15.175:37916) 2024-04-25T09:10:21.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa306a00640 1 -- 172.21.15.175:0/2841766440 learned_addr learned my addr 172.21.15.175:0/2841766440 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:21.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa306a00640 1 -- 172.21.15.175:0/2841766440 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad3477720 msgr2=0x563ad3490d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa306a00640 1 --2- 172.21.15.175:0/2841766440 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad3477720 0x563ad3490d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa306a00640 1 -- 172.21.15.175:0/2841766440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad34932e0 msgr2=0x563ad3491790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa306a00640 1 --2- 172.21.15.175:0/2841766440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad34932e0 0x563ad3491790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa306a00640 1 -- 172.21.15.175:0/2841766440 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ad3477e70 con 0x563ad34929c0 2024-04-25T09:10:21.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa306a00640 1 --2- 172.21.15.175:0/2841766440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 0x563ad3491250 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4012cd0 tx=0x7fa2f4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7cdfe022a9fddd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa2f3400640 1 -- 172.21.15.175:0/2841766440 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4028070 con 0x563ad34929c0 2024-04-25T09:10:21.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa2f3400640 1 -- 172.21.15.175:0/2841766440 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f401b040 con 0x563ad34929c0 2024-04-25T09:10:21.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa2f3400640 1 -- 172.21.15.175:0/2841766440 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f402d880 con 0x563ad34929c0 2024-04-25T09:10:21.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 -- 172.21.15.175:0/2841766440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 msgr2=0x563ad3491250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 --2- 172.21.15.175:0/2841766440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 0x563ad3491250 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4012cd0 tx=0x7fa2f4015000 comp rx=0 tx=0).stop 2024-04-25T09:10:21.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 -- 172.21.15.175:0/2841766440 shutdown_connections 2024-04-25T09:10:21.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 --2- 172.21.15.175:0/2841766440 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad34932e0 0x563ad3491790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 --2- 172.21.15.175:0/2841766440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 0x563ad3491250 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 --2- 172.21.15.175:0/2841766440 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad3477720 0x563ad3490d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 -- 172.21.15.175:0/2841766440 >> 172.21.15.175:0/2841766440 conn(0x563ad3446710 msgr2=0x563ad3476740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 -- 172.21.15.175:0/2841766440 shutdown_connections 2024-04-25T09:10:21.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 -- 172.21.15.175:0/2841766440 wait complete. 2024-04-25T09:10:21.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 -- start start 2024-04-25T09:10:21.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 Processor -- start 2024-04-25T09:10:21.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad3477720 0x563ad34f3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 0x563ad34f3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad34932e0 0x563ad343fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ad3251860 con 0x563ad34929c0 2024-04-25T09:10:21.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3080aa650 con 0x563ad34932e0 2024-04-25T09:10:21.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ad3234d40 con 0x563ad3477720 2024-04-25T09:10:21.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa311513000 10 client.0 _ll_register_callbacks cb 0x563ad322bb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:21.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.386+0000 7fa306a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 0x563ad34f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa306a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 0x563ad34f3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37930/0 (socket says 172.21.15.175:37930) 2024-04-25T09:10:21.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa306a00640 1 -- 172.21.15.175:0/4172945858 learned_addr learned my addr 172.21.15.175:0/4172945858 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:21.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa307400640 1 --2- 172.21.15.175:0/4172945858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad3477720 0x563ad34f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa307e00640 1 --2- 172.21.15.175:0/4172945858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad34932e0 0x563ad343fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa306a00640 1 -- 172.21.15.175:0/4172945858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad3477720 msgr2=0x563ad34f3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa306a00640 1 --2- 172.21.15.175:0/4172945858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad3477720 0x563ad34f3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa306a00640 1 -- 172.21.15.175:0/4172945858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad34932e0 msgr2=0x563ad343fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa306a00640 1 --2- 172.21.15.175:0/4172945858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad34932e0 0x563ad343fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa306a00640 1 -- 172.21.15.175:0/4172945858 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ad33100f0 con 0x563ad34929c0 2024-04-25T09:10:21.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa306a00640 1 --2- 172.21.15.175:0/4172945858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 0x563ad34f3760 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4008010 tx=0x7fa2f4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32afe486a8c9db6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa2f0c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:10:21.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa2f0c00640 1 -- 172.21.15.175:0/4172945858 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4028050 con 0x563ad34929c0 2024-04-25T09:10:21.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa2f0c00640 1 -- 172.21.15.175:0/4172945858 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa2f4006670 con 0x563ad34929c0 2024-04-25T09:10:21.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 1 -- 172.21.15.175:0/4172945858 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2f401b040 con 0x563ad34929c0 2024-04-25T09:10:21.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa2f0c00640 1 -- 172.21.15.175:0/4172945858 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2f403f050 con 0x563ad34929c0 2024-04-25T09:10:21.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 10 client.7512 fetch_fsmap learned FSMap version 64 2024-04-25T09:10:21.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 1 -- 172.21.15.175:0/4172945858 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x563ad3222d20 con 0x563ad34929c0 2024-04-25T09:10:21.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa2f0c00640 1 -- 172.21.15.175:0/4172945858 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f401b040 con 0x563ad34929c0 2024-04-25T09:10:21.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa2f0c00640 1 -- 172.21.15.175:0/4172945858 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 64) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa2f4042020 con 0x563ad34929c0 2024-04-25T09:10:21.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 10 client.7512 fetch_fsmap finished waiting for FSMap version 64 2024-04-25T09:10:21.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 10 client.7512 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:10:21.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 20 client.7512 populate_metadata read hostname 'smithi175' 2024-04-25T09:10:21.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 1 --2- 172.21.15.175:0/4172945858 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x563ad34403b0 0x563ad3440790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 4 client.7512 mds_command: new command op to 7419 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}] 2024-04-25T09:10:21.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 1 -- 172.21.15.175:0/4172945858 --> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}) v1 -- 0x563ad329b510 con 0x563ad34403b0 2024-04-25T09:10:21.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa307400640 1 --2- 172.21.15.175:0/4172945858 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x563ad34403b0 0x563ad3440790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa2f0c00640 10 client.7512 ms_handle_connect on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:21.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa307400640 1 --2- 172.21.15.175:0/4172945858 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x563ad34403b0 0x563ad3440790 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c56f918329cefe6 server_cookie=45f305b3942bcebc in_seq=0 out_seq=0 2024-04-25T09:10:21.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa2f0c00640 1 -- 172.21.15.175:0/4172945858 <== mds.0 v2:172.21.15.175:6835/1399691338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x563ad329b510 con 0x563ad34403b0 2024-04-25T09:10:21.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa2f0c00640 10 client.7512 handle_command_reply: tid=0 2024-04-25T09:10:21.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 1 client.7512 shutdown 2024-04-25T09:10:21.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 1 -- 172.21.15.175:0/4172945858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 msgr2=0x563ad34f3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 1 --2- 172.21.15.175:0/4172945858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 0x563ad34f3760 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4008010 tx=0x7fa2f4004740 comp rx=0 tx=0).stop 2024-04-25T09:10:21.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 1 -- 172.21.15.175:0/4172945858 shutdown_connections 2024-04-25T09:10:21.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 1 --2- 172.21.15.175:0/4172945858 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x563ad34403b0 0x563ad3440790 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 1 --2- 172.21.15.175:0/4172945858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ad34932e0 0x563ad343fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 1 --2- 172.21.15.175:0/4172945858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ad34929c0 0x563ad34f3760 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 1 --2- 172.21.15.175:0/4172945858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ad3477720 0x563ad34f3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 1 -- 172.21.15.175:0/4172945858 >> 172.21.15.175:0/4172945858 conn(0x563ad3446710 msgr2=0x563ad34459f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa2f0c00640 0 client.7512 ms_handle_reset on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:21.385 INFO:tasks.ceph.mds.c.smithi175.stderr:2024-04-25T09:10:21.390+0000 7f8341200640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-04-25T09:10:11.367023+0000 1=1+0) n(v0 rc2024-04-25T09:10:11.479022+0000 2=1+1) (iversion lock) | dirfrag=0 authpin=1 scrubqueue=0 0x55ca89620100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T09:10:11.367023+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T09:10:11.479022+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-25T09:10:21.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 1 -- 172.21.15.175:0/4172945858 shutdown_connections 2024-04-25T09:10:21.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 1 -- 172.21.15.175:0/4172945858 wait complete. 2024-04-25T09:10:21.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa311513000 20 client.7512 trim_cache size 0 max 16384 2024-04-25T09:10:21.386 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:10:21.387 INFO:teuthology.orchestra.run.smithi175.stdout: "return_code": 0, 2024-04-25T09:10:21.387 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_tag": "842975d5-f3d5-446b-8411-f5bb720970ea", 2024-04-25T09:10:21.387 INFO:teuthology.orchestra.run.smithi175.stdout: "mode": "asynchronous" 2024-04-25T09:10:21.387 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:10:21.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa30e000640 1 -- 172.21.15.175:0/2958117229 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa2e8066f60 msgr2=0x7fa2e8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa30e000640 1 --2- 172.21.15.175:0/2958117229 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa2e8066f60 0x7fa2e8069420 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa3080cd390 tx=0x7fa2f4008040 comp rx=0 tx=0).stop 2024-04-25T09:10:21.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa30e000640 1 -- 172.21.15.175:0/2958117229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2ec0051d0 msgr2=0x7fa3081e8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa30e000640 1 --2- 172.21.15.175:0/2958117229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2ec0051d0 0x7fa3081e8ef0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8011d40 tx=0x7fa2f800f540 comp rx=0 tx=0).stop 2024-04-25T09:10:21.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa30e000640 1 -- 172.21.15.175:0/2958117229 shutdown_connections 2024-04-25T09:10:21.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa30e000640 1 --2- 172.21.15.175:0/2958117229 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa2e8066f60 0x7fa2e8069420 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.390+0000 7fa30e000640 1 --2- 172.21.15.175:0/2958117229 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa308141150 0x7fa3081415d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.394+0000 7fa30e000640 1 --2- 172.21.15.175:0/2958117229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa308141d50 0x7fa30815df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.394+0000 7fa30e000640 1 --2- 172.21.15.175:0/2958117229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2ec0051d0 0x7fa3081e8ef0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.394+0000 7fa30e000640 1 -- 172.21.15.175:0/2958117229 >> 172.21.15.175:0/2958117229 conn(0x7fa30806ac50 msgr2=0x7fa3080b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.394+0000 7fa30e000640 1 -- 172.21.15.175:0/2958117229 shutdown_connections 2024-04-25T09:10:21.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.394+0000 7fa30e000640 1 -- 172.21.15.175:0/2958117229 wait complete. 2024-04-25T09:10:21.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:21.402 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:10:21.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.550+0000 7ff2dd800640 1 Processor -- start 2024-04-25T09:10:21.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.550+0000 7ff2dd800640 1 -- start start 2024-04-25T09:10:21.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.554+0000 7ff2dd800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2d80cf6b0 0x7ff2d81600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.554+0000 7ff2dd800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff2d80ce970 0x7ff2d80cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.554+0000 7ff2dd800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d80cfd10 con 0x7ff2d8145250 2024-04-25T09:10:21.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.554+0000 7ff2dd800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d81605e0 con 0x7ff2d80ce970 2024-04-25T09:10:21.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.554+0000 7ff2dd800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d815f650 con 0x7ff2d80cf6b0 2024-04-25T09:10:21.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.554+0000 7ff2d7400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff2d80ce970 0x7ff2d80cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.554+0000 7ff2d7400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff2d80ce970 0x7ff2d80cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37936/0 (socket says 172.21.15.175:37936) 2024-04-25T09:10:21.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.554+0000 7ff2d7400640 1 -- 172.21.15.175:0/2496963258 learned_addr learned my addr 172.21.15.175:0/2496963258 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:21.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.554+0000 7ff2ce000640 1 --2- 172.21.15.175:0/2496963258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2d80cf6b0 0x7ff2d81600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.554+0000 7ff2d7400640 1 -- 172.21.15.175:0/2496963258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2d80cf6b0 msgr2=0x7ff2d81600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.554+0000 7ff2d7400640 1 --2- 172.21.15.175:0/2496963258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2d80cf6b0 0x7ff2d81600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.554+0000 7ff2d7400640 1 -- 172.21.15.175:0/2496963258 >> v1:172.21.15.177:6789/0 conn(0x7ff2d8145250 legacy=0x7ff2d80cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.554+0000 7ff2d7400640 1 -- 172.21.15.175:0/2496963258 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d80cfff0 con 0x7ff2d80ce970 2024-04-25T09:10:21.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2d7400640 1 --2- 172.21.15.175:0/2496963258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d80ce970 0x7ff2d80cee00 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009e50 tx=0x7ff2d001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e54fff2a38c6a8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2d6000640 1 -- 172.21.15.175:0/2496963258 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00a5750 con 0x7ff2d80ce970 2024-04-25T09:10:21.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2d6000640 1 -- 172.21.15.175:0/2496963258 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d00a58f0 con 0x7ff2d80ce970 2024-04-25T09:10:21.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2d6000640 1 -- 172.21.15.175:0/2496963258 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00a5cc0 con 0x7ff2d80ce970 2024-04-25T09:10:21.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2dd800640 1 -- 172.21.15.175:0/2496963258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d80ce970 msgr2=0x7ff2d80cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2dd800640 1 --2- 172.21.15.175:0/2496963258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d80ce970 0x7ff2d80cee00 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009e50 tx=0x7ff2d001c9a0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2dd800640 1 -- 172.21.15.175:0/2496963258 shutdown_connections 2024-04-25T09:10:21.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2dd800640 1 --2- 172.21.15.175:0/2496963258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d80ce970 0x7ff2d80cee00 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2dd800640 1 --2- 172.21.15.175:0/2496963258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2d80cf6b0 0x7ff2d81600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2dd800640 1 -- 172.21.15.175:0/2496963258 >> 172.21.15.175:0/2496963258 conn(0x7ff2d806ac50 msgr2=0x7ff2d806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2dd800640 1 -- 172.21.15.175:0/2496963258 shutdown_connections 2024-04-25T09:10:21.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2dd800640 1 -- 172.21.15.175:0/2496963258 wait complete. 2024-04-25T09:10:21.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2dd800640 1 Processor -- start 2024-04-25T09:10:21.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2dd800640 1 -- start start 2024-04-25T09:10:21.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2dd800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2d80ce970 0x7ff2d80b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2dd800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d80cf6b0 0x7ff2d80b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2dd800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2d8145250 0x7ff2d80af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2dd800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d815c870 con 0x7ff2d80cf6b0 2024-04-25T09:10:21.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2dd800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d8145630 con 0x7ff2d80ce970 2024-04-25T09:10:21.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2dd800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d815c9f0 con 0x7ff2d8145250 2024-04-25T09:10:21.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.558+0000 7ff2ce000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d80cf6b0 0x7ff2d80b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.562+0000 7ff2ce000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d80cf6b0 0x7ff2d80b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37950/0 (socket says 172.21.15.175:37950) 2024-04-25T09:10:21.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.562+0000 7ff2ce000640 1 -- 172.21.15.175:0/1056079569 learned_addr learned my addr 172.21.15.175:0/1056079569 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:21.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.562+0000 7ff2d7400640 1 --2- 172.21.15.175:0/1056079569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2d8145250 0x7ff2d80af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.562+0000 7ff2d6a00640 1 --2- 172.21.15.175:0/1056079569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2d80ce970 0x7ff2d80b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.562+0000 7ff2ce000640 1 -- 172.21.15.175:0/1056079569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2d8145250 msgr2=0x7ff2d80af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.562+0000 7ff2ce000640 1 --2- 172.21.15.175:0/1056079569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2d8145250 0x7ff2d80af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.562+0000 7ff2ce000640 1 -- 172.21.15.175:0/1056079569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2d80ce970 msgr2=0x7ff2d80b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.562+0000 7ff2ce000640 1 --2- 172.21.15.175:0/1056079569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2d80ce970 0x7ff2d80b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.562+0000 7ff2ce000640 1 -- 172.21.15.175:0/1056079569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d80b4360 con 0x7ff2d80cf6b0 2024-04-25T09:10:21.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.562+0000 7ff2ce000640 1 --2- 172.21.15.175:0/1056079569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d80cf6b0 0x7ff2d80b3a60 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000e930 tx=0x7ff2c000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.562+0000 7ff2cf400640 1 -- 172.21.15.175:0/1056079569 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0017070 con 0x7ff2d80cf6b0 2024-04-25T09:10:21.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.562+0000 7ff2cf400640 1 -- 172.21.15.175:0/1056079569 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c000ca00 con 0x7ff2d80cf6b0 2024-04-25T09:10:21.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.562+0000 7ff2dd800640 1 -- 172.21.15.175:0/1056079569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d80b4640 con 0x7ff2d80cf6b0 2024-04-25T09:10:21.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.562+0000 7ff2cf400640 1 -- 172.21.15.175:0/1056079569 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c000cdb0 con 0x7ff2d80cf6b0 2024-04-25T09:10:21.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.562+0000 7ff2dd800640 1 -- 172.21.15.175:0/1056079569 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d80b2a40 con 0x7ff2d80cf6b0 2024-04-25T09:10:21.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.562+0000 7ff2cf400640 1 -- 172.21.15.175:0/1056079569 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff2c001a070 con 0x7ff2d80cf6b0 2024-04-25T09:10:21.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2cf400640 1 --2- 172.21.15.175:0/1056079569 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff2b4066f60 0x7ff2b4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2cf400640 1 -- 172.21.15.175:0/1056079569 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff2c00853e0 con 0x7ff2d80cf6b0 2024-04-25T09:10:21.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2d6a00640 1 --2- 172.21.15.175:0/1056079569 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff2b4066f60 0x7ff2b4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2e0c73000 1 Processor -- start 2024-04-25T09:10:21.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2e0c73000 1 -- start start 2024-04-25T09:10:21.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2d6a00640 1 --2- 172.21.15.175:0/1056079569 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff2b4066f60 0x7ff2b4069420 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff2d815bd30 tx=0x7ff2c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2e0c73000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a95009d0 0x5626a9500db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2e0c73000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a95012f0 0x5626a94b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2e0c73000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a94b70a0 0x5626a94b7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2e0c73000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a9303ff0 con 0x5626a94b70a0 2024-04-25T09:10:21.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2e0c73000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a928c150 con 0x5626a95012f0 2024-04-25T09:10:21.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2e0c73000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626a9300090 con 0x5626a95009d0 2024-04-25T09:10:21.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2d7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a94b70a0 0x5626a94b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2d7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a94b70a0 0x5626a94b7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37966/0 (socket says 172.21.15.175:37966) 2024-04-25T09:10:21.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2d7400640 1 -- 172.21.15.175:0/458683103 learned_addr learned my addr 172.21.15.175:0/458683103 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:21.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2d6a00640 1 --2- 172.21.15.175:0/458683103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a95009d0 0x5626a9500db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2ce000640 1 --2- 172.21.15.175:0/458683103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a95012f0 0x5626a94b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2d7400640 1 -- 172.21.15.175:0/458683103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a95009d0 msgr2=0x5626a9500db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2d7400640 1 --2- 172.21.15.175:0/458683103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a95009d0 0x5626a9500db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2d7400640 1 -- 172.21.15.175:0/458683103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a95012f0 msgr2=0x5626a94b6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2d7400640 1 --2- 172.21.15.175:0/458683103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a95012f0 0x5626a94b6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2d7400640 1 -- 172.21.15.175:0/458683103 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626a949a0d0 con 0x5626a94b70a0 2024-04-25T09:10:21.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2d7400640 1 --2- 172.21.15.175:0/458683103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a94b70a0 0x5626a94b7480 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7ff2d001c9e0 tx=0x7ff2d0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28884ebef7b32d16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2c7400640 1 -- 172.21.15.175:0/458683103 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00a5950 con 0x5626a94b70a0 2024-04-25T09:10:21.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2c7400640 1 -- 172.21.15.175:0/458683103 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d00a5af0 con 0x5626a94b70a0 2024-04-25T09:10:21.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2c7400640 1 -- 172.21.15.175:0/458683103 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00b63f0 con 0x5626a94b70a0 2024-04-25T09:10:21.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2e0c73000 1 -- 172.21.15.175:0/458683103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a94b70a0 msgr2=0x5626a94b7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.566+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/458683103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a94b70a0 0x5626a94b7480 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7ff2d001c9e0 tx=0x7ff2d0004ac0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 -- 172.21.15.175:0/458683103 shutdown_connections 2024-04-25T09:10:21.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/458683103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a94b70a0 0x5626a94b7480 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/458683103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a95012f0 0x5626a94b6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/458683103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a95009d0 0x5626a9500db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 -- 172.21.15.175:0/458683103 >> 172.21.15.175:0/458683103 conn(0x5626a94b3020 msgr2=0x5626a94b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 -- 172.21.15.175:0/458683103 shutdown_connections 2024-04-25T09:10:21.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 -- 172.21.15.175:0/458683103 wait complete. 2024-04-25T09:10:21.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 -- start start 2024-04-25T09:10:21.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 Processor -- start 2024-04-25T09:10:21.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a94b70a0 0x5626a94e57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95009d0 0x5626a94e5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a95012f0 0x5626a94e6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a92c8250 con 0x5626a95009d0 2024-04-25T09:10:21.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a92be690 con 0x5626a94b70a0 2024-04-25T09:10:21.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626a928ca40 con 0x5626a95012f0 2024-04-25T09:10:21.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 10 client.0 _ll_register_callbacks cb 0x5626a94a1e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:21.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2ce000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95009d0 0x5626a94e5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2ce000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95009d0 0x5626a94e5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37968/0 (socket says 172.21.15.175:37968) 2024-04-25T09:10:21.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2ce000640 1 -- 172.21.15.175:0/1204559325 learned_addr learned my addr 172.21.15.175:0/1204559325 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:21.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2d6a00640 1 --2- 172.21.15.175:0/1204559325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a94b70a0 0x5626a94e57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2d7400640 1 --2- 172.21.15.175:0/1204559325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a95012f0 0x5626a94e6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2ce000640 1 -- 172.21.15.175:0/1204559325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a95012f0 msgr2=0x5626a94e6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2ce000640 1 --2- 172.21.15.175:0/1204559325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a95012f0 0x5626a94e6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2ce000640 1 -- 172.21.15.175:0/1204559325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a94b70a0 msgr2=0x5626a94e57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2ce000640 1 --2- 172.21.15.175:0/1204559325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a94b70a0 0x5626a94e57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2ce000640 1 -- 172.21.15.175:0/1204559325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5626a93b11c0 con 0x5626a95009d0 2024-04-25T09:10:21.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2d6a00640 1 --2- 172.21.15.175:0/1204559325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a94b70a0 0x5626a94e57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:21.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2ce000640 1 --2- 172.21.15.175:0/1204559325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95009d0 0x5626a94e5d30 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000e900 tx=0x7ff2c0055f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0dac215108f9bab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:10:21.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2bbe00640 1 -- 172.21.15.175:0/1204559325 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0021040 con 0x5626a95009d0 2024-04-25T09:10:21.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2bbe00640 1 -- 172.21.15.175:0/1204559325 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff2c0055250 con 0x5626a95009d0 2024-04-25T09:10:21.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 -- 172.21.15.175:0/1204559325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff2d00a5af0 con 0x5626a95009d0 2024-04-25T09:10:21.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2bbe00640 1 -- 172.21.15.175:0/1204559325 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2c00541c0 con 0x5626a95009d0 2024-04-25T09:10:21.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 10 client.7524 fetch_fsmap learned FSMap version 64 2024-04-25T09:10:21.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 -- 172.21.15.175:0/1204559325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x5626a93ad170 con 0x5626a95009d0 2024-04-25T09:10:21.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2bbe00640 1 -- 172.21.15.175:0/1204559325 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d00a5af0 con 0x5626a95009d0 2024-04-25T09:10:21.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2bbe00640 1 -- 172.21.15.175:0/1204559325 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 64) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff2c0051b50 con 0x5626a95009d0 2024-04-25T09:10:21.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 10 client.7524 fetch_fsmap finished waiting for FSMap version 64 2024-04-25T09:10:21.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 10 client.7524 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:10:21.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 20 client.7524 populate_metadata read hostname 'smithi175' 2024-04-25T09:10:21.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/1204559325 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5626a9510c80 0x5626a9513070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 4 client.7524 mds_command: new command op to 7419 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:21.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2e0c73000 1 -- 172.21.15.175:0/1204559325 --> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5626a929fc60 con 0x5626a9510c80 2024-04-25T09:10:21.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.570+0000 7ff2d6a00640 1 --2- 172.21.15.175:0/1204559325 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5626a9510c80 0x5626a9513070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.574+0000 7ff2d6a00640 1 --2- 172.21.15.175:0/1204559325 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5626a9510c80 0x5626a9513070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44f9bb4fbb0e765 server_cookie=6c6eed061b5c4d34 in_seq=0 out_seq=0 2024-04-25T09:10:21.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.574+0000 7ff2bbe00640 10 client.7524 ms_handle_connect on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:21.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.574+0000 7ff2bbe00640 1 -- 172.21.15.175:0/1204559325 <== mds.0 v2:172.21.15.175:6835/1399691338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5626a929fc60 con 0x5626a9510c80 2024-04-25T09:10:21.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.574+0000 7ff2bbe00640 10 client.7524 handle_command_reply: tid=0 2024-04-25T09:10:21.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.574+0000 7ff2e0c73000 1 client.7524 shutdown 2024-04-25T09:10:21.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.574+0000 7ff2e0c73000 1 -- 172.21.15.175:0/1204559325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95009d0 msgr2=0x5626a94e5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.574+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/1204559325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95009d0 0x5626a94e5d30 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000e900 tx=0x7ff2c0055f40 comp rx=0 tx=0).stop 2024-04-25T09:10:21.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.574+0000 7ff2e0c73000 1 -- 172.21.15.175:0/1204559325 shutdown_connections 2024-04-25T09:10:21.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.574+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/1204559325 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5626a9510c80 0x5626a9513070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.574+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/1204559325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a95012f0 0x5626a94e6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.574+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/1204559325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95009d0 0x5626a94e5d30 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.574+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/1204559325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a94b70a0 0x5626a94e57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.574+0000 7ff2bbe00640 0 client.7524 ms_handle_reset on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:21.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.574+0000 7ff2e0c73000 1 -- 172.21.15.175:0/1204559325 >> 172.21.15.175:0/1204559325 conn(0x5626a94b3020 msgr2=0x5626a94b5ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.574+0000 7ff2e0c73000 1 -- 172.21.15.175:0/1204559325 shutdown_connections 2024-04-25T09:10:21.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.574+0000 7ff2e0c73000 1 -- 172.21.15.175:0/1204559325 wait complete. 2024-04-25T09:10:21.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.574+0000 7ff2e0c73000 20 client.7524 trim_cache size 0 max 16384 2024-04-25T09:10:21.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 Processor -- start 2024-04-25T09:10:21.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 -- start start 2024-04-25T09:10:21.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a94b70a0 0x5626a94ffe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95009d0 0x5626a94b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a95012f0 0x5626a94b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d8202c50 con 0x5626a95009d0 2024-04-25T09:10:21.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d8201e40 con 0x5626a95012f0 2024-04-25T09:10:21.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d8141890 con 0x5626a94b70a0 2024-04-25T09:10:21.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2ce000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95009d0 0x5626a94b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2ce000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95009d0 0x5626a94b6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37980/0 (socket says 172.21.15.175:37980) 2024-04-25T09:10:21.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2ce000640 1 -- 172.21.15.175:0/3895068970 learned_addr learned my addr 172.21.15.175:0/3895068970 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:21.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2d7400640 1 --2- 172.21.15.175:0/3895068970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a95012f0 0x5626a94b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2d6a00640 1 --2- 172.21.15.175:0/3895068970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a94b70a0 0x5626a94ffe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2ce000640 1 -- 172.21.15.175:0/3895068970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a94b70a0 msgr2=0x5626a94ffe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2ce000640 1 --2- 172.21.15.175:0/3895068970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a94b70a0 0x5626a94ffe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2ce000640 1 -- 172.21.15.175:0/3895068970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a95012f0 msgr2=0x5626a94b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2ce000640 1 --2- 172.21.15.175:0/3895068970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a95012f0 0x5626a94b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2ce000640 1 -- 172.21.15.175:0/3895068970 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626a934ade0 con 0x5626a95009d0 2024-04-25T09:10:21.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2d7400640 1 --2- 172.21.15.175:0/3895068970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a95012f0 0x5626a94b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:21.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2d6a00640 1 --2- 172.21.15.175:0/3895068970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a94b70a0 0x5626a94ffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:21.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2ce000640 1 --2- 172.21.15.175:0/3895068970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95009d0 0x5626a94b6420 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009730 tx=0x7ff2c001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7926c42fdb9b0a64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2c6a00640 1 -- 172.21.15.175:0/3895068970 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0063070 con 0x5626a95009d0 2024-04-25T09:10:21.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2c6a00640 1 -- 172.21.15.175:0/3895068970 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c0079030 con 0x5626a95009d0 2024-04-25T09:10:21.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2c6a00640 1 -- 172.21.15.175:0/3895068970 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0021050 con 0x5626a95009d0 2024-04-25T09:10:21.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 -- 172.21.15.175:0/3895068970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95009d0 msgr2=0x5626a94b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/3895068970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95009d0 0x5626a94b6420 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0009730 tx=0x7ff2c001d000 comp rx=0 tx=0).stop 2024-04-25T09:10:21.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 -- 172.21.15.175:0/3895068970 shutdown_connections 2024-04-25T09:10:21.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/3895068970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a95012f0 0x5626a94b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/3895068970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95009d0 0x5626a94b6420 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/3895068970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a94b70a0 0x5626a94ffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 -- 172.21.15.175:0/3895068970 >> 172.21.15.175:0/3895068970 conn(0x5626a94b3020 msgr2=0x5626a94ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 -- 172.21.15.175:0/3895068970 shutdown_connections 2024-04-25T09:10:21.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 -- 172.21.15.175:0/3895068970 wait complete. 2024-04-25T09:10:21.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 -- start start 2024-04-25T09:10:21.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.590+0000 7ff2e0c73000 1 Processor -- start 2024-04-25T09:10:21.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a94b70a0 0x5626a9569d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a95009d0 0x5626a956a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95012f0 0x5626a9513380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626a929ee00 con 0x5626a95012f0 2024-04-25T09:10:21.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d81f7000 con 0x5626a94b70a0 2024-04-25T09:10:21.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626a9303300 con 0x5626a95009d0 2024-04-25T09:10:21.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 10 client.0 _ll_register_callbacks cb 0x5626a9482040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:21.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2d7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95012f0 0x5626a9513380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2d7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95012f0 0x5626a9513380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:37984/0 (socket says 172.21.15.175:37984) 2024-04-25T09:10:21.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2d7400640 1 -- 172.21.15.175:0/1630990120 learned_addr learned my addr 172.21.15.175:0/1630990120 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:21.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2d6a00640 1 --2- 172.21.15.175:0/1630990120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a94b70a0 0x5626a9569d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2ce000640 1 --2- 172.21.15.175:0/1630990120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a95009d0 0x5626a956a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2d7400640 1 -- 172.21.15.175:0/1630990120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a95009d0 msgr2=0x5626a956a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2d7400640 1 --2- 172.21.15.175:0/1630990120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a95009d0 0x5626a956a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2d7400640 1 -- 172.21.15.175:0/1630990120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a94b70a0 msgr2=0x5626a9569d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2d7400640 1 --2- 172.21.15.175:0/1630990120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a94b70a0 0x5626a9569d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2d7400640 1 -- 172.21.15.175:0/1630990120 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5626a92a58e0 con 0x5626a95012f0 2024-04-25T09:10:21.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2d7400640 1 --2- 172.21.15.175:0/1630990120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95012f0 0x5626a9513380 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0098470 tx=0x7ff2d001b1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dea72e25e90e660 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:10:21.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2bbe00640 1 -- 172.21.15.175:0/1630990120 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00ce060 con 0x5626a95012f0 2024-04-25T09:10:21.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2bbe00640 1 -- 172.21.15.175:0/1630990120 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff2d00091d0 con 0x5626a95012f0 2024-04-25T09:10:21.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 1 -- 172.21.15.175:0/1630990120 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff2c0079030 con 0x5626a95012f0 2024-04-25T09:10:21.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2bbe00640 1 -- 172.21.15.175:0/1630990120 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2d00d4050 con 0x5626a95012f0 2024-04-25T09:10:21.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 10 client.7530 fetch_fsmap learned FSMap version 64 2024-04-25T09:10:21.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 1 -- 172.21.15.175:0/1630990120 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x5626a935d8f0 con 0x5626a95012f0 2024-04-25T09:10:21.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2bbe00640 1 -- 172.21.15.175:0/1630990120 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c0079030 con 0x5626a95012f0 2024-04-25T09:10:21.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2bbe00640 1 -- 172.21.15.175:0/1630990120 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 64) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff2d00d7020 con 0x5626a95012f0 2024-04-25T09:10:21.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 10 client.7530 fetch_fsmap finished waiting for FSMap version 64 2024-04-25T09:10:21.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 10 client.7530 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:10:21.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 20 client.7530 populate_metadata read hostname 'smithi175' 2024-04-25T09:10:21.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/1630990120 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5626a9513d70 0x5626a9514180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 4 client.7530 mds_command: new command op to 7419 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:10:21.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 1 -- 172.21.15.175:0/1630990120 --> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5626a9311530 con 0x5626a9513d70 2024-04-25T09:10:21.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2d6a00640 1 --2- 172.21.15.175:0/1630990120 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5626a9513d70 0x5626a9514180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2d6a00640 1 --2- 172.21.15.175:0/1630990120 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5626a9513d70 0x5626a9514180 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9fcd9f0069f8aee server_cookie=e44aecf854ef23fe in_seq=0 out_seq=0 2024-04-25T09:10:21.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2bbe00640 10 client.7530 ms_handle_connect on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:21.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2bbe00640 1 -- 172.21.15.175:0/1630990120 <== mds.0 v2:172.21.15.175:6835/1399691338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+256 (crc 0 0 0) 0x5626a9311530 con 0x5626a9513d70 2024-04-25T09:10:21.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2bbe00640 10 client.7530 handle_command_reply: tid=0 2024-04-25T09:10:21.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 1 client.7530 shutdown 2024-04-25T09:10:21.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 1 -- 172.21.15.175:0/1630990120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95012f0 msgr2=0x5626a9513380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.594+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/1630990120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95012f0 0x5626a9513380 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0098470 tx=0x7ff2d001b1e0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2e0c73000 1 -- 172.21.15.175:0/1630990120 shutdown_connections 2024-04-25T09:10:21.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/1630990120 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5626a9513d70 0x5626a9514180 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/1630990120 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5626a95012f0 0x5626a9513380 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/1630990120 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5626a95009d0 0x5626a956a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2e0c73000 1 --2- 172.21.15.175:0/1630990120 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5626a94b70a0 0x5626a9569d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2bbe00640 0 client.7530 ms_handle_reset on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:21.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2e0c73000 1 -- 172.21.15.175:0/1630990120 >> 172.21.15.175:0/1630990120 conn(0x5626a94b3020 msgr2=0x5626a94ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2e0c73000 1 -- 172.21.15.175:0/1630990120 shutdown_connections 2024-04-25T09:10:21.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2e0c73000 1 -- 172.21.15.175:0/1630990120 wait complete. 2024-04-25T09:10:21.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2e0c73000 20 client.7530 trim_cache size 0 max 16384 2024-04-25T09:10:21.591 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:10:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:10:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": { 2024-04-25T09:10:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: "842975d5-f3d5-446b-8411-f5bb720970ea": { 2024-04-25T09:10:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: "path": "/dir", 2024-04-25T09:10:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: "tag": "842975d5-f3d5-446b-8411-f5bb720970ea", 2024-04-25T09:10:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: "options": "recursive" 2024-04-25T09:10:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:21.592 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:21.592 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:10:21.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2dd800640 1 -- 172.21.15.175:0/1056079569 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff2b4066f60 msgr2=0x7ff2b4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2dd800640 1 --2- 172.21.15.175:0/1056079569 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff2b4066f60 0x7ff2b4069420 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff2d815bd30 tx=0x7ff2c8009040 comp rx=0 tx=0).stop 2024-04-25T09:10:21.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2dd800640 1 -- 172.21.15.175:0/1056079569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d80cf6b0 msgr2=0x7ff2d80b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2dd800640 1 --2- 172.21.15.175:0/1056079569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d80cf6b0 0x7ff2d80b3a60 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000e930 tx=0x7ff2c000edf0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2dd800640 1 -- 172.21.15.175:0/1056079569 shutdown_connections 2024-04-25T09:10:21.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2dd800640 1 --2- 172.21.15.175:0/1056079569 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff2b4066f60 0x7ff2b4069420 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2dd800640 1 --2- 172.21.15.175:0/1056079569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2d8145250 0x7ff2d80af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2dd800640 1 --2- 172.21.15.175:0/1056079569 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d80cf6b0 0x7ff2d80b3a60 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2dd800640 1 --2- 172.21.15.175:0/1056079569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2d80ce970 0x7ff2d80b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2dd800640 1 -- 172.21.15.175:0/1056079569 >> 172.21.15.175:0/1056079569 conn(0x7ff2d806ac50 msgr2=0x7ff2d8165fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2dd800640 1 -- 172.21.15.175:0/1056079569 shutdown_connections 2024-04-25T09:10:21.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:21.598+0000 7ff2dd800640 1 -- 172.21.15.175:0/1056079569 wait complete. 2024-04-25T09:10:21.607 INFO:tasks.cephfs.filesystem:scrub status for tag:842975d5-f3d5-446b-8411-f5bb720970ea - {'path': '/dir', 'tag': '842975d5-f3d5-446b-8411-f5bb720970ea', 'options': 'recursive'} 2024-04-25T09:10:25.915 INFO:tasks.ceph.mon.a.smithi175.stderr:2024-04-25T09:10:25.922+0000 7feb12000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T09:10:39.175 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:10:39.179 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:10:51.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:51.607 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:10:51.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.766+0000 7fda29000640 1 Processor -- start 2024-04-25T09:10:51.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.766+0000 7fda29000640 1 -- start start 2024-04-25T09:10:51.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.766+0000 7fda29000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fda240cbe60 0x7fda2415af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.766+0000 7fda29000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda240b4800 0x7fda2415c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.766+0000 7fda29000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2406db60 con 0x7fda2406d310 2024-04-25T09:10:51.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.766+0000 7fda29000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2406de40 con 0x7fda240cbe60 2024-04-25T09:10:51.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.766+0000 7fda29000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2406e120 con 0x7fda240b4800 2024-04-25T09:10:51.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.766+0000 7fda22800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda240b4800 0x7fda2415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.766+0000 7fda21e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fda240cbe60 0x7fda2415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.766+0000 7fda21400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fda2406d310 0x7fda240b40f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:51336/0 (socket says 172.21.15.175:51336) 2024-04-25T09:10:51.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.766+0000 7fda21400640 1 -- 172.21.15.175:0/3450536251 learned_addr learned my addr 172.21.15.175:0/3450536251 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:10:51.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.766+0000 7fda20a00640 1 -- 172.21.15.175:0/3450536251 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304736657 0 0) 0x7fda2406db60 con 0x7fda2406d310 2024-04-25T09:10:51.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.766+0000 7fda20a00640 1 -- 172.21.15.175:0/3450536251 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda08003530 con 0x7fda2406d310 2024-04-25T09:10:51.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.770+0000 7fda21e00640 1 -- 172.21.15.175:0/3450536251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda240b4800 msgr2=0x7fda2415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:51.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.770+0000 7fda21e00640 1 --2- 172.21.15.175:0/3450536251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda240b4800 0x7fda2415c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.770+0000 7fda21e00640 1 -- 172.21.15.175:0/3450536251 >> v1:172.21.15.177:6789/0 conn(0x7fda2406d310 legacy=0x7fda240b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:51.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.770+0000 7fda21e00640 1 -- 172.21.15.175:0/3450536251 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2415c2f0 con 0x7fda240cbe60 2024-04-25T09:10:51.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.770+0000 7fda22800640 1 --2- 172.21.15.175:0/3450536251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda240b4800 0x7fda2415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.770+0000 7fda21e00640 1 --2- 172.21.15.175:0/3450536251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda240cbe60 0x7fda2415af20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fda14009d90 tx=0x7fda1401c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d57b388f43933373 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.770+0000 7fda20a00640 1 -- 172.21.15.175:0/3450536251 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda140b2070 con 0x7fda240cbe60 2024-04-25T09:10:51.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.770+0000 7fda20a00640 1 -- 172.21.15.175:0/3450536251 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda140a57b0 con 0x7fda240cbe60 2024-04-25T09:10:51.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.770+0000 7fda20a00640 1 -- 172.21.15.175:0/3450536251 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda140a5b80 con 0x7fda240cbe60 2024-04-25T09:10:51.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.770+0000 7fda29000640 1 -- 172.21.15.175:0/3450536251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda240cbe60 msgr2=0x7fda2415af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:51.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.770+0000 7fda29000640 1 --2- 172.21.15.175:0/3450536251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda240cbe60 0x7fda2415af20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fda14009d90 tx=0x7fda1401c930 comp rx=0 tx=0).stop 2024-04-25T09:10:51.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.770+0000 7fda29000640 1 -- 172.21.15.175:0/3450536251 shutdown_connections 2024-04-25T09:10:51.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.770+0000 7fda29000640 1 --2- 172.21.15.175:0/3450536251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda240b4800 0x7fda2415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.770+0000 7fda29000640 1 --2- 172.21.15.175:0/3450536251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda240cbe60 0x7fda2415af20 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.770+0000 7fda29000640 1 -- 172.21.15.175:0/3450536251 >> 172.21.15.175:0/3450536251 conn(0x7fda2406ac50 msgr2=0x7fda2406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:51.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.770+0000 7fda29000640 1 -- 172.21.15.175:0/3450536251 shutdown_connections 2024-04-25T09:10:51.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.770+0000 7fda29000640 1 -- 172.21.15.175:0/3450536251 wait complete. 2024-04-25T09:10:51.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda29000640 1 Processor -- start 2024-04-25T09:10:51.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda29000640 1 -- start start 2024-04-25T09:10:51.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda29000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda2406d310 0x7fda241468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda29000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda240b4800 0x7fda24164840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda29000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda240cbe60 0x7fda2415e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda29000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2415d8f0 con 0x7fda240cbe60 2024-04-25T09:10:51.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda29000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2415d770 con 0x7fda240b4800 2024-04-25T09:10:51.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda29000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2415da70 con 0x7fda2406d310 2024-04-25T09:10:51.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda22800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda240cbe60 0x7fda2415e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda22800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda240cbe60 0x7fda2415e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54766/0 (socket says 172.21.15.175:54766) 2024-04-25T09:10:51.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda22800640 1 -- 172.21.15.175:0/2943853265 learned_addr learned my addr 172.21.15.175:0/2943853265 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:51.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda21400640 1 --2- 172.21.15.175:0/2943853265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda240b4800 0x7fda24164840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda21e00640 1 --2- 172.21.15.175:0/2943853265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda2406d310 0x7fda241468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda22800640 1 -- 172.21.15.175:0/2943853265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda2406d310 msgr2=0x7fda241468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:51.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda22800640 1 --2- 172.21.15.175:0/2943853265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda2406d310 0x7fda241468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda22800640 1 -- 172.21.15.175:0/2943853265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda240b4800 msgr2=0x7fda24164840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:51.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda22800640 1 --2- 172.21.15.175:0/2943853265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda240b4800 0x7fda24164840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda22800640 1 -- 172.21.15.175:0/2943853265 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda24146e30 con 0x7fda240cbe60 2024-04-25T09:10:51.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda21e00640 1 --2- 172.21.15.175:0/2943853265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda2406d310 0x7fda241468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:51.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda22800640 1 --2- 172.21.15.175:0/2943853265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda240cbe60 0x7fda2415e470 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fda1c00e950 tx=0x7fda1c00ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:51.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda1a000640 1 -- 172.21.15.175:0/2943853265 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c017070 con 0x7fda240cbe60 2024-04-25T09:10:51.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda1a000640 1 -- 172.21.15.175:0/2943853265 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c00ca00 con 0x7fda240cbe60 2024-04-25T09:10:51.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda1a000640 1 -- 172.21.15.175:0/2943853265 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c00cdb0 con 0x7fda240cbe60 2024-04-25T09:10:51.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda29000640 1 -- 172.21.15.175:0/2943853265 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda24145850 con 0x7fda240cbe60 2024-04-25T09:10:51.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.774+0000 7fda29000640 1 -- 172.21.15.175:0/2943853265 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda24145e10 con 0x7fda240cbe60 2024-04-25T09:10:51.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.778+0000 7fda1a000640 1 -- 172.21.15.175:0/2943853265 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fda1c01a070 con 0x7fda240cbe60 2024-04-25T09:10:51.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.778+0000 7fda1a000640 1 --2- 172.21.15.175:0/2943853265 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fda04066f60 0x7fda04069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.778+0000 7fda1a000640 1 -- 172.21.15.175:0/2943853265 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fda1c085330 con 0x7fda240cbe60 2024-04-25T09:10:51.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.778+0000 7fda21e00640 1 --2- 172.21.15.175:0/2943853265 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fda04066f60 0x7fda04069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.778+0000 7fda2c402000 1 Processor -- start 2024-04-25T09:10:51.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.778+0000 7fda2c402000 1 -- start start 2024-04-25T09:10:51.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.778+0000 7fda21e00640 1 --2- 172.21.15.175:0/2943853265 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fda04066f60 0x7fda04069420 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fda140af000 tx=0x7fda140a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda2c402000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c9115699d0 0x55c911569db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda2c402000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 0x55c91151fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda2c402000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115200a0 0x55c911520480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda2c402000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c91136cff0 con 0x55c91156a2f0 2024-04-25T09:10:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda2c402000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9112f5150 con 0x55c9115200a0 2024-04-25T09:10:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda2c402000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c911369090 con 0x55c9115699d0 2024-04-25T09:10:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda21400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 0x55c91151fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda21400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 0x55c91151fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54770/0 (socket says 172.21.15.175:54770) 2024-04-25T09:10:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda21400640 1 -- 172.21.15.175:0/3188427951 learned_addr learned my addr 172.21.15.175:0/3188427951 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda21e00640 1 --2- 172.21.15.175:0/3188427951 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c9115699d0 0x55c911569db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda22800640 1 --2- 172.21.15.175:0/3188427951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115200a0 0x55c911520480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda21400640 1 -- 172.21.15.175:0/3188427951 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c9115699d0 msgr2=0x55c911569db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:51.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda21400640 1 --2- 172.21.15.175:0/3188427951 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c9115699d0 0x55c911569db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda21400640 1 -- 172.21.15.175:0/3188427951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115200a0 msgr2=0x55c911520480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:51.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda21400640 1 --2- 172.21.15.175:0/3188427951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115200a0 0x55c911520480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda21400640 1 -- 172.21.15.175:0/3188427951 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9115030d0 con 0x55c91156a2f0 2024-04-25T09:10:51.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda21400640 1 --2- 172.21.15.175:0/3188427951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 0x55c91151fb60 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fda10007680 tx=0x7fda10004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0dab73f6b00e765 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:51.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda0ea00640 1 -- 172.21.15.175:0/3188427951 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1001a070 con 0x55c91156a2f0 2024-04-25T09:10:51.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda0ea00640 1 -- 172.21.15.175:0/3188427951 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda10001800 con 0x55c91156a2f0 2024-04-25T09:10:51.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda0ea00640 1 -- 172.21.15.175:0/3188427951 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10001bb0 con 0x55c91156a2f0 2024-04-25T09:10:51.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda2c402000 1 -- 172.21.15.175:0/3188427951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 msgr2=0x55c91151fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:51.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda2c402000 1 --2- 172.21.15.175:0/3188427951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 0x55c91151fb60 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fda10007680 tx=0x7fda10004bc0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda2c402000 1 -- 172.21.15.175:0/3188427951 shutdown_connections 2024-04-25T09:10:51.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda2c402000 1 --2- 172.21.15.175:0/3188427951 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115200a0 0x55c911520480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda2c402000 1 --2- 172.21.15.175:0/3188427951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 0x55c91151fb60 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda2c402000 1 --2- 172.21.15.175:0/3188427951 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c9115699d0 0x55c911569db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda2c402000 1 -- 172.21.15.175:0/3188427951 >> 172.21.15.175:0/3188427951 conn(0x55c91151c020 msgr2=0x55c91151e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:51.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda2c402000 1 -- 172.21.15.175:0/3188427951 shutdown_connections 2024-04-25T09:10:51.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda2c402000 1 -- 172.21.15.175:0/3188427951 wait complete. 2024-04-25T09:10:51.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda2c402000 1 -- start start 2024-04-25T09:10:51.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.782+0000 7fda2c402000 1 Processor -- start 2024-04-25T09:10:51.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c9115200a0 0x55c91154e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115699d0 0x55c91154ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 0x55c91154f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c911331250 con 0x55c91156a2f0 2024-04-25T09:10:51.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c911327690 con 0x55c9115699d0 2024-04-25T09:10:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9112f5a40 con 0x55c9115200a0 2024-04-25T09:10:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 10 client.0 _ll_register_callbacks cb 0x55c91150ae90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda22800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 0x55c91154f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda22800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 0x55c91154f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54772/0 (socket says 172.21.15.175:54772) 2024-04-25T09:10:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda22800640 1 -- 172.21.15.175:0/356830260 learned_addr learned my addr 172.21.15.175:0/356830260 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda21e00640 1 --2- 172.21.15.175:0/356830260 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c9115200a0 0x55c91154e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda21400640 1 --2- 172.21.15.175:0/356830260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115699d0 0x55c91154ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda22800640 1 -- 172.21.15.175:0/356830260 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c9115200a0 msgr2=0x55c91154e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda22800640 1 --2- 172.21.15.175:0/356830260 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c9115200a0 0x55c91154e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda22800640 1 -- 172.21.15.175:0/356830260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115699d0 msgr2=0x55c91154ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda22800640 1 --2- 172.21.15.175:0/356830260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115699d0 0x55c91154ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda22800640 1 -- 172.21.15.175:0/356830260 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c91141a1c0 con 0x55c91156a2f0 2024-04-25T09:10:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda22800640 1 --2- 172.21.15.175:0/356830260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 0x55c91154f270 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fda1c083760 tx=0x7fda1c055bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c9e41de01756c3e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:51.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda03400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:10:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda03400640 1 -- 172.21.15.175:0/356830260 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c021040 con 0x55c91156a2f0 2024-04-25T09:10:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda03400640 1 -- 172.21.15.175:0/356830260 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fda1c05abb0 con 0x55c91156a2f0 2024-04-25T09:10:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 -- 172.21.15.175:0/356830260 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda10001800 con 0x55c91156a2f0 2024-04-25T09:10:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda03400640 1 -- 172.21.15.175:0/356830260 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda1c05adb0 con 0x55c91156a2f0 2024-04-25T09:10:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 10 client.7539 fetch_fsmap learned FSMap version 65 2024-04-25T09:10:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 -- 172.21.15.175:0/356830260 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x55c911416170 con 0x55c91156a2f0 2024-04-25T09:10:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda03400640 1 -- 172.21.15.175:0/356830260 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda10001800 con 0x55c91156a2f0 2024-04-25T09:10:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda03400640 1 -- 172.21.15.175:0/356830260 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fda1c083b80 con 0x55c91156a2f0 2024-04-25T09:10:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 10 client.7539 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:10:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 10 client.7539 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:10:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 20 client.7539 populate_metadata read hostname 'smithi175' 2024-04-25T09:10:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 --2- 172.21.15.175:0/356830260 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55c911579c80 0x55c91157c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 4 client.7539 mds_command: new command op to 7419 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 -- 172.21.15.175:0/356830260 --> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c911308c60 con 0x55c911579c80 2024-04-25T09:10:51.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda21e00640 1 --2- 172.21.15.175:0/356830260 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55c911579c80 0x55c91157c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda21e00640 1 --2- 172.21.15.175:0/356830260 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55c911579c80 0x55c91157c070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7602a4f5f72f5267 server_cookie=a99b89171e1f20d0 in_seq=0 out_seq=0 2024-04-25T09:10:51.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda03400640 10 client.7539 ms_handle_connect on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:51.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda03400640 1 -- 172.21.15.175:0/356830260 <== mds.0 v2:172.21.15.175:6835/1399691338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c911308c60 con 0x55c911579c80 2024-04-25T09:10:51.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda03400640 10 client.7539 handle_command_reply: tid=0 2024-04-25T09:10:51.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 client.7539 shutdown 2024-04-25T09:10:51.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 -- 172.21.15.175:0/356830260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 msgr2=0x55c91154f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:51.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 --2- 172.21.15.175:0/356830260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 0x55c91154f270 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fda1c083760 tx=0x7fda1c055bf0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 -- 172.21.15.175:0/356830260 shutdown_connections 2024-04-25T09:10:51.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 --2- 172.21.15.175:0/356830260 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55c911579c80 0x55c91157c070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 --2- 172.21.15.175:0/356830260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 0x55c91154f270 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 --2- 172.21.15.175:0/356830260 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115699d0 0x55c91154ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda03400640 0 client.7539 ms_handle_reset on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:51.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 --2- 172.21.15.175:0/356830260 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c9115200a0 0x55c91154e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.786+0000 7fda2c402000 1 -- 172.21.15.175:0/356830260 >> 172.21.15.175:0/356830260 conn(0x55c91151c020 msgr2=0x55c91151eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:51.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.790+0000 7fda2c402000 1 -- 172.21.15.175:0/356830260 shutdown_connections 2024-04-25T09:10:51.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.790+0000 7fda2c402000 1 -- 172.21.15.175:0/356830260 wait complete. 2024-04-25T09:10:51.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.790+0000 7fda2c402000 20 client.7539 trim_cache size 0 max 16384 2024-04-25T09:10:51.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.802+0000 7fda2c402000 1 Processor -- start 2024-04-25T09:10:51.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.802+0000 7fda2c402000 1 -- start start 2024-04-25T09:10:51.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.802+0000 7fda2c402000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115200a0 0x55c91151fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.802+0000 7fda2c402000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9115699d0 0x55c911576e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.802+0000 7fda2c402000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c91156a2f0 0x55c911577380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.802+0000 7fda2c402000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda24202c20 con 0x55c9115699d0 2024-04-25T09:10:51.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.802+0000 7fda2c402000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda24201de0 con 0x55c9115200a0 2024-04-25T09:10:51.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.802+0000 7fda2c402000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda24155fb0 con 0x55c91156a2f0 2024-04-25T09:10:51.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.802+0000 7fda21400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9115699d0 0x55c911576e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.802+0000 7fda21400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9115699d0 0x55c911576e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54786/0 (socket says 172.21.15.175:54786) 2024-04-25T09:10:51.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.802+0000 7fda21400640 1 -- 172.21.15.175:0/2287127721 learned_addr learned my addr 172.21.15.175:0/2287127721 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:51.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda21e00640 1 --2- 172.21.15.175:0/2287127721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115200a0 0x55c91151fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda21400640 1 -- 172.21.15.175:0/2287127721 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c91156a2f0 msgr2=0x55c911577380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:51.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda21400640 1 --2- 172.21.15.175:0/2287127721 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c91156a2f0 0x55c911577380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda21400640 1 -- 172.21.15.175:0/2287127721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115200a0 msgr2=0x55c91151fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:51.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda21400640 1 --2- 172.21.15.175:0/2287127721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115200a0 0x55c91151fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda21400640 1 -- 172.21.15.175:0/2287127721 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9113b3de0 con 0x55c9115699d0 2024-04-25T09:10:51.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda21e00640 1 --2- 172.21.15.175:0/2287127721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115200a0 0x55c91151fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:51.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda21400640 1 --2- 172.21.15.175:0/2287127721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9115699d0 0x55c911576e40 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fda10007650 tx=0x7fda1000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f80049f3d5f66fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:51.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda0e000640 1 -- 172.21.15.175:0/2287127721 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1001a040 con 0x55c9115699d0 2024-04-25T09:10:51.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda0e000640 1 -- 172.21.15.175:0/2287127721 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1000b040 con 0x55c9115699d0 2024-04-25T09:10:51.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda0e000640 1 -- 172.21.15.175:0/2287127721 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10014690 con 0x55c9115699d0 2024-04-25T09:10:51.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda2c402000 1 -- 172.21.15.175:0/2287127721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9115699d0 msgr2=0x55c911576e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:51.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda2c402000 1 --2- 172.21.15.175:0/2287127721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9115699d0 0x55c911576e40 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fda10007650 tx=0x7fda1000c000 comp rx=0 tx=0).stop 2024-04-25T09:10:51.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda2c402000 1 -- 172.21.15.175:0/2287127721 shutdown_connections 2024-04-25T09:10:51.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda2c402000 1 --2- 172.21.15.175:0/2287127721 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c91156a2f0 0x55c911577380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda2c402000 1 --2- 172.21.15.175:0/2287127721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c9115699d0 0x55c911576e40 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda2c402000 1 --2- 172.21.15.175:0/2287127721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115200a0 0x55c91151fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda2c402000 1 -- 172.21.15.175:0/2287127721 >> 172.21.15.175:0/2287127721 conn(0x55c91151c020 msgr2=0x55c911576730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:51.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda2c402000 1 -- 172.21.15.175:0/2287127721 shutdown_connections 2024-04-25T09:10:51.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda2c402000 1 -- 172.21.15.175:0/2287127721 wait complete. 2024-04-25T09:10:51.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda2c402000 1 -- start start 2024-04-25T09:10:51.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda2c402000 1 Processor -- start 2024-04-25T09:10:51.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda2c402000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115200a0 0x55c9115d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda2c402000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c9115699d0 0x55c9115d2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda2c402000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 0x55c91157bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda2c402000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c911307e00 con 0x55c91156a2f0 2024-04-25T09:10:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda2c402000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda24201910 con 0x55c9115200a0 2024-04-25T09:10:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda2c402000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c91136c300 con 0x55c9115699d0 2024-04-25T09:10:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda2c402000 10 client.0 _ll_register_callbacks cb 0x55c9114eb040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda22800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 0x55c91157bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda22800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 0x55c91157bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54796/0 (socket says 172.21.15.175:54796) 2024-04-25T09:10:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda22800640 1 -- 172.21.15.175:0/4185279316 learned_addr learned my addr 172.21.15.175:0/4185279316 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda21400640 1 --2- 172.21.15.175:0/4185279316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c9115699d0 0x55c9115d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda21e00640 1 --2- 172.21.15.175:0/4185279316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115200a0 0x55c9115d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda22800640 1 -- 172.21.15.175:0/4185279316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c9115699d0 msgr2=0x55c9115d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda22800640 1 --2- 172.21.15.175:0/4185279316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c9115699d0 0x55c9115d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda22800640 1 -- 172.21.15.175:0/4185279316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115200a0 msgr2=0x55c9115d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda22800640 1 --2- 172.21.15.175:0/4185279316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115200a0 0x55c9115d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.806+0000 7fda22800640 1 -- 172.21.15.175:0/4185279316 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c91130e8e0 con 0x55c91156a2f0 2024-04-25T09:10:51.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda22800640 1 --2- 172.21.15.175:0/4185279316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 0x55c91157bab0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fda1c053ea0 tx=0x7fda1c083630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d448ef31af7f24b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda03400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:10:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda03400640 1 -- 172.21.15.175:0/4185279316 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c021070 con 0x55c91156a2f0 2024-04-25T09:10:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda03400640 1 -- 172.21.15.175:0/4185279316 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fda1c053ef0 con 0x55c91156a2f0 2024-04-25T09:10:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 1 -- 172.21.15.175:0/4185279316 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda1000b040 con 0x55c91156a2f0 2024-04-25T09:10:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda03400640 1 -- 172.21.15.175:0/4185279316 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda1c055730 con 0x55c91156a2f0 2024-04-25T09:10:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 10 client.7545 fetch_fsmap learned FSMap version 65 2024-04-25T09:10:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 1 -- 172.21.15.175:0/4185279316 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x55c9113c68f0 con 0x55c91156a2f0 2024-04-25T09:10:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda03400640 1 -- 172.21.15.175:0/4185279316 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1000b040 con 0x55c91156a2f0 2024-04-25T09:10:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda03400640 1 -- 172.21.15.175:0/4185279316 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fda1c069b00 con 0x55c91156a2f0 2024-04-25T09:10:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 10 client.7545 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:10:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 10 client.7545 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:10:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 20 client.7545 populate_metadata read hostname 'smithi175' 2024-04-25T09:10:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 1 --2- 172.21.15.175:0/4185279316 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55c91157c440 0x55c91157c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 4 client.7545 mds_command: new command op to 7419 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:10:51.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 1 -- 172.21.15.175:0/4185279316 --> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c91137a530 con 0x55c91157c440 2024-04-25T09:10:51.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda21e00640 1 --2- 172.21.15.175:0/4185279316 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55c91157c440 0x55c91157c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda03400640 10 client.7545 ms_handle_connect on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:51.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda21e00640 1 --2- 172.21.15.175:0/4185279316 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55c91157c440 0x55c91157c850 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9836650a556ffc36 server_cookie=276a641dd5fcb4c1 in_seq=0 out_seq=0 2024-04-25T09:10:51.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda03400640 1 -- 172.21.15.175:0/4185279316 <== mds.0 v2:172.21.15.175:6835/1399691338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c91137a530 con 0x55c91157c440 2024-04-25T09:10:51.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda03400640 10 client.7545 handle_command_reply: tid=0 2024-04-25T09:10:51.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 1 client.7545 shutdown 2024-04-25T09:10:51.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 1 -- 172.21.15.175:0/4185279316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 msgr2=0x55c91157bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:51.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 1 --2- 172.21.15.175:0/4185279316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 0x55c91157bab0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fda1c053ea0 tx=0x7fda1c083630 comp rx=0 tx=0).stop 2024-04-25T09:10:51.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 1 -- 172.21.15.175:0/4185279316 shutdown_connections 2024-04-25T09:10:51.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 1 --2- 172.21.15.175:0/4185279316 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55c91157c440 0x55c91157c850 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 1 --2- 172.21.15.175:0/4185279316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c91156a2f0 0x55c91157bab0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 1 --2- 172.21.15.175:0/4185279316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c9115699d0 0x55c9115d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda03400640 0 client.7545 ms_handle_reset on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:51.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 1 --2- 172.21.15.175:0/4185279316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c9115200a0 0x55c9115d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 1 -- 172.21.15.175:0/4185279316 >> 172.21.15.175:0/4185279316 conn(0x55c91151c020 msgr2=0x55c911576fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:51.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 1 -- 172.21.15.175:0/4185279316 shutdown_connections 2024-04-25T09:10:51.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 1 -- 172.21.15.175:0/4185279316 wait complete. 2024-04-25T09:10:51.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda2c402000 20 client.7545 trim_cache size 0 max 16384 2024-04-25T09:10:51.806 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:10:51.806 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "no active scrubs running", 2024-04-25T09:10:51.806 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": {} 2024-04-25T09:10:51.806 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:10:51.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda29000640 1 -- 172.21.15.175:0/2943853265 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fda04066f60 msgr2=0x7fda04069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:51.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda29000640 1 --2- 172.21.15.175:0/2943853265 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fda04066f60 0x7fda04069420 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fda140af000 tx=0x7fda140a7070 comp rx=0 tx=0).stop 2024-04-25T09:10:51.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda29000640 1 -- 172.21.15.175:0/2943853265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda240cbe60 msgr2=0x7fda2415e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:51.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda29000640 1 --2- 172.21.15.175:0/2943853265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda240cbe60 0x7fda2415e470 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fda1c00e950 tx=0x7fda1c00ee10 comp rx=0 tx=0).stop 2024-04-25T09:10:51.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda29000640 1 -- 172.21.15.175:0/2943853265 shutdown_connections 2024-04-25T09:10:51.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda29000640 1 --2- 172.21.15.175:0/2943853265 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fda04066f60 0x7fda04069420 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda29000640 1 --2- 172.21.15.175:0/2943853265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda240cbe60 0x7fda2415e470 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda29000640 1 --2- 172.21.15.175:0/2943853265 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda240b4800 0x7fda24164840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda29000640 1 --2- 172.21.15.175:0/2943853265 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda2406d310 0x7fda241468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda29000640 1 -- 172.21.15.175:0/2943853265 >> 172.21.15.175:0/2943853265 conn(0x7fda2406ac50 msgr2=0x7fda240b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:51.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda29000640 1 -- 172.21.15.175:0/2943853265 shutdown_connections 2024-04-25T09:10:51.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.810+0000 7fda29000640 1 -- 172.21.15.175:0/2943853265 wait complete. 2024-04-25T09:10:51.820 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:10:51.820 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:51.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.966+0000 7f4138a00640 1 Processor -- start 2024-04-25T09:10:51.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.966+0000 7f4138a00640 1 -- start start 2024-04-25T09:10:51.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.970+0000 7f4138a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f413415a900 0x7f413406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.970+0000 7f4138a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41340cf560 0x7f41340cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.970+0000 7f4138a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41340cda00 con 0x7f41340cd520 2024-04-25T09:10:51.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.970+0000 7f4138a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f413415bcf0 con 0x7f41340cf560 2024-04-25T09:10:51.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.970+0000 7f4138a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41340cfed0 con 0x7f413415a900 2024-04-25T09:10:51.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.970+0000 7f4132800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41340cf560 0x7f41340cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.970+0000 7f4132800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41340cf560 0x7f41340cf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54806/0 (socket says 172.21.15.175:54806) 2024-04-25T09:10:51.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.970+0000 7f4132800640 1 -- 172.21.15.175:0/1736517259 learned_addr learned my addr 172.21.15.175:0/1736517259 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:51.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.970+0000 7f4131e00640 1 --2- 172.21.15.175:0/1736517259 >> v2:172.21.15.177:3300/0 conn(0x7f413415a900 0x7f413406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.970+0000 7f4132800640 1 -- 172.21.15.175:0/1736517259 >> v2:172.21.15.177:3300/0 conn(0x7f413415a900 msgr2=0x7f413406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:51.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.970+0000 7f4132800640 1 --2- 172.21.15.175:0/1736517259 >> v2:172.21.15.177:3300/0 conn(0x7f413415a900 0x7f413406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.970+0000 7f4132800640 1 -- 172.21.15.175:0/1736517259 >> v1:172.21.15.177:6789/0 conn(0x7f41340cd520 legacy=0x7f41340ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:51.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.970+0000 7f4132800640 1 -- 172.21.15.175:0/1736517259 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41340cdce0 con 0x7f41340cf560 2024-04-25T09:10:51.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4132800640 1 --2- 172.21.15.175:0/1736517259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41340cf560 0x7f41340cf990 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f41340b4c70 tx=0x7f412c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d660ce4b8420f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:51.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4131400640 1 -- 172.21.15.175:0/1736517259 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c0a5760 con 0x7f41340cf560 2024-04-25T09:10:51.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4131400640 1 -- 172.21.15.175:0/1736517259 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412c0a5900 con 0x7f41340cf560 2024-04-25T09:10:51.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4131400640 1 -- 172.21.15.175:0/1736517259 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c0a5cd0 con 0x7f41340cf560 2024-04-25T09:10:51.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4138a00640 1 -- 172.21.15.175:0/1736517259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41340cf560 msgr2=0x7f41340cf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:51.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4138a00640 1 --2- 172.21.15.175:0/1736517259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41340cf560 0x7f41340cf990 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f41340b4c70 tx=0x7f412c01c9b0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4138a00640 1 -- 172.21.15.175:0/1736517259 shutdown_connections 2024-04-25T09:10:51.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4138a00640 1 --2- 172.21.15.175:0/1736517259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41340cf560 0x7f41340cf990 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4138a00640 1 --2- 172.21.15.175:0/1736517259 >> v2:172.21.15.177:3300/0 conn(0x7f413415a900 0x7f413406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4138a00640 1 -- 172.21.15.175:0/1736517259 >> 172.21.15.175:0/1736517259 conn(0x7f4134067150 msgr2=0x7f413406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:51.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4138a00640 1 -- 172.21.15.175:0/1736517259 shutdown_connections 2024-04-25T09:10:51.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4138a00640 1 -- 172.21.15.175:0/1736517259 wait complete. 2024-04-25T09:10:51.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4138a00640 1 Processor -- start 2024-04-25T09:10:51.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4138a00640 1 -- start start 2024-04-25T09:10:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4138a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41340cf560 0x7f41340b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4138a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f413415a900 0x7f4134146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4138a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41340af070 0x7f41341594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4138a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413406d530 con 0x7f41340af070 2024-04-25T09:10:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4138a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413406d3b0 con 0x7f41340cf560 2024-04-25T09:10:51.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4138a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413415c790 con 0x7f413415a900 2024-04-25T09:10:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4132800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41340af070 0x7f41341594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4132800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41340af070 0x7f41341594b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54810/0 (socket says 172.21.15.175:54810) 2024-04-25T09:10:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.974+0000 7f4132800640 1 -- 172.21.15.175:0/967009810 learned_addr learned my addr 172.21.15.175:0/967009810 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f4129400640 1 --2- 172.21.15.175:0/967009810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f413415a900 0x7f4134146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f4131e00640 1 --2- 172.21.15.175:0/967009810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41340cf560 0x7f41340b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f4132800640 1 -- 172.21.15.175:0/967009810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f413415a900 msgr2=0x7f4134146400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f4132800640 1 --2- 172.21.15.175:0/967009810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f413415a900 0x7f4134146400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f4132800640 1 -- 172.21.15.175:0/967009810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41340cf560 msgr2=0x7f41340b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f4132800640 1 --2- 172.21.15.175:0/967009810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41340cf560 0x7f41340b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f4132800640 1 -- 172.21.15.175:0/967009810 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41340afac0 con 0x7f41340af070 2024-04-25T09:10:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f4129400640 1 --2- 172.21.15.175:0/967009810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f413415a900 0x7f4134146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f4131e00640 1 --2- 172.21.15.175:0/967009810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41340cf560 0x7f41340b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f4132800640 1 --2- 172.21.15.175:0/967009810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41340af070 0x7f41341594b0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f412c01a5e0 tx=0x7f412c019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:51.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f412aa00640 1 -- 172.21.15.175:0/967009810 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c0b8670 con 0x7f41340af070 2024-04-25T09:10:51.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f412aa00640 1 -- 172.21.15.175:0/967009810 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412c0be070 con 0x7f41340af070 2024-04-25T09:10:51.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f4138a00640 1 -- 172.21.15.175:0/967009810 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41340afda0 con 0x7f41340af070 2024-04-25T09:10:51.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f412aa00640 1 -- 172.21.15.175:0/967009810 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c0b8a70 con 0x7f41340af070 2024-04-25T09:10:51.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f4138a00640 1 -- 172.21.15.175:0/967009810 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41340b0360 con 0x7f41340af070 2024-04-25T09:10:51.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f4138a00640 1 -- 172.21.15.175:0/967009810 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4134074a60 con 0x7f41340af070 2024-04-25T09:10:51.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f412aa00640 1 -- 172.21.15.175:0/967009810 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f412c0b8c10 con 0x7f41340af070 2024-04-25T09:10:51.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f412aa00640 1 --2- 172.21.15.175:0/967009810 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4110066f60 0x7f4110069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:51.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f412aa00640 1 -- 172.21.15.175:0/967009810 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f412c120200 con 0x7f41340af070 2024-04-25T09:10:51.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.978+0000 7f4131e00640 1 --2- 172.21.15.175:0/967009810 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4110066f60 0x7f4110069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:51.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.982+0000 7f4131e00640 1 --2- 172.21.15.175:0/967009810 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4110066f60 0x7f4110069420 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f412400b9f0 tx=0x7f4124008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:51.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:51.982+0000 7f412aa00640 1 -- 172.21.15.175:0/967009810 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f412c0165a0 con 0x7f41340af070 2024-04-25T09:10:52.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.170+0000 7f4138a00640 1 -- 172.21.15.175:0/967009810 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f413414fcc0 con 0x7f41340af070 2024-04-25T09:10:52.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.170+0000 7f412aa00640 1 -- 172.21.15.175:0/967009810 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f412c0f11d0 con 0x7f41340af070 2024-04-25T09:10:52.162 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:10:52.162 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3229536012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3229536012},{"type":"v1","addr":"172.21.15.177:6834","nonce":3229536012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/222649735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":222649735},{"type":"v1","addr":"172.21.15.177:6835","nonce":222649735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2888989442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2888989442},{"type":"v1","addr":"172.21.15.175:6836","nonce":2888989442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:03.786939+0000","modified":"2024-04-25T09:10:25.509619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7419":{"gid":7419,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6837/1399691338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1399691338},{"type":"v1","addr":"172.21.15.175:6837","nonce":1399691338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:10:52.162 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 65 2024-04-25T09:10:52.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.174+0000 7f4138a00640 1 -- 172.21.15.175:0/967009810 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4110066f60 msgr2=0x7f4110069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.174+0000 7f4138a00640 1 --2- 172.21.15.175:0/967009810 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4110066f60 0x7f4110069420 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f412400b9f0 tx=0x7f4124008040 comp rx=0 tx=0).stop 2024-04-25T09:10:52.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.174+0000 7f4138a00640 1 -- 172.21.15.175:0/967009810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41340af070 msgr2=0x7f41341594b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.174+0000 7f4138a00640 1 --2- 172.21.15.175:0/967009810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41340af070 0x7f41341594b0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f412c01a5e0 tx=0x7f412c019750 comp rx=0 tx=0).stop 2024-04-25T09:10:52.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.174+0000 7f4138a00640 1 -- 172.21.15.175:0/967009810 shutdown_connections 2024-04-25T09:10:52.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.174+0000 7f4138a00640 1 --2- 172.21.15.175:0/967009810 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4110066f60 0x7f4110069420 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.174+0000 7f4138a00640 1 --2- 172.21.15.175:0/967009810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41340af070 0x7f41341594b0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.174+0000 7f4138a00640 1 --2- 172.21.15.175:0/967009810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f413415a900 0x7f4134146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.174+0000 7f4138a00640 1 --2- 172.21.15.175:0/967009810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41340cf560 0x7f41340b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.174+0000 7f4138a00640 1 -- 172.21.15.175:0/967009810 >> 172.21.15.175:0/967009810 conn(0x7f41340cd520 msgr2=0x7f41341501e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:52.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.174+0000 7f4138a00640 1 -- 172.21.15.175:0/967009810 shutdown_connections 2024-04-25T09:10:52.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.174+0000 7f4138a00640 1 -- 172.21.15.175:0/967009810 wait complete. 2024-04-25T09:10:52.184 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-25T09:10:52.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.330+0000 7f2ea0e00640 1 Processor -- start 2024-04-25T09:10:52.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.330+0000 7f2ea0e00640 1 -- start start 2024-04-25T09:10:52.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.330+0000 7f2ea0e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2e9c0cbe60 0x7f2e9c15af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.330+0000 7f2ea0e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2e9c0b4800 0x7f2e9c15c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.330+0000 7f2ea0e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9c06db60 con 0x7f2e9c06d310 2024-04-25T09:10:52.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.330+0000 7f2ea0e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c06de40 con 0x7f2e9c0b4800 2024-04-25T09:10:52.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.330+0000 7f2ea0e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c06e120 con 0x7f2e9c0cbe60 2024-04-25T09:10:52.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.330+0000 7f2e9a800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2e9c0b4800 0x7f2e9c15c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.330+0000 7f2e9a800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2e9c0b4800 0x7f2e9c15c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54820/0 (socket says 172.21.15.175:54820) 2024-04-25T09:10:52.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.330+0000 7f2e9a800640 1 -- 172.21.15.175:0/2103266359 learned_addr learned my addr 172.21.15.175:0/2103266359 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:52.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.330+0000 7f2e99e00640 1 --2- 172.21.15.175:0/2103266359 >> v2:172.21.15.177:3300/0 conn(0x7f2e9c0cbe60 0x7f2e9c15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.334+0000 7f2e9a800640 1 -- 172.21.15.175:0/2103266359 >> v2:172.21.15.177:3300/0 conn(0x7f2e9c0cbe60 msgr2=0x7f2e9c15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.334+0000 7f2e9a800640 1 --2- 172.21.15.175:0/2103266359 >> v2:172.21.15.177:3300/0 conn(0x7f2e9c0cbe60 0x7f2e9c15af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.334+0000 7f2e9a800640 1 -- 172.21.15.175:0/2103266359 >> v1:172.21.15.177:6789/0 conn(0x7f2e9c06d310 legacy=0x7f2e9c0b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.334+0000 7f2e9a800640 1 -- 172.21.15.175:0/2103266359 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c15c2f0 con 0x7f2e9c0b4800 2024-04-25T09:10:52.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.334+0000 7f2e9a800640 1 --2- 172.21.15.175:0/2103266359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c0b4800 0x7f2e9c15c810 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0b4d50 tx=0x7f2e9401e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76dccb1857c200c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:52.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.334+0000 7f2e99400640 1 -- 172.21.15.175:0/2103266359 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e940ab400 con 0x7f2e9c0b4800 2024-04-25T09:10:52.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.334+0000 7f2e99400640 1 -- 172.21.15.175:0/2103266359 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e940ab5a0 con 0x7f2e9c0b4800 2024-04-25T09:10:52.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.334+0000 7f2e99400640 1 -- 172.21.15.175:0/2103266359 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e940ab970 con 0x7f2e9c0b4800 2024-04-25T09:10:52.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.334+0000 7f2ea0e00640 1 -- 172.21.15.175:0/2103266359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c0b4800 msgr2=0x7f2e9c15c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.334+0000 7f2ea0e00640 1 --2- 172.21.15.175:0/2103266359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c0b4800 0x7f2e9c15c810 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0b4d50 tx=0x7f2e9401e730 comp rx=0 tx=0).stop 2024-04-25T09:10:52.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.334+0000 7f2ea0e00640 1 -- 172.21.15.175:0/2103266359 shutdown_connections 2024-04-25T09:10:52.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.334+0000 7f2ea0e00640 1 --2- 172.21.15.175:0/2103266359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c0b4800 0x7f2e9c15c810 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.334+0000 7f2ea0e00640 1 --2- 172.21.15.175:0/2103266359 >> v2:172.21.15.177:3300/0 conn(0x7f2e9c0cbe60 0x7f2e9c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.334+0000 7f2ea0e00640 1 -- 172.21.15.175:0/2103266359 >> 172.21.15.175:0/2103266359 conn(0x7f2e9c06ac50 msgr2=0x7f2e9c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:52.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.334+0000 7f2ea0e00640 1 -- 172.21.15.175:0/2103266359 shutdown_connections 2024-04-25T09:10:52.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2ea0e00640 1 -- 172.21.15.175:0/2103266359 wait complete. 2024-04-25T09:10:52.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2ea0e00640 1 Processor -- start 2024-04-25T09:10:52.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2ea0e00640 1 -- start start 2024-04-25T09:10:52.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2ea0e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c06d310 0x7f2e9c1491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2ea0e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e9c0b4800 0x7f2e9c13d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2ea0e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e9c0cbe60 0x7f2e9c0af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2ea0e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c15d930 con 0x7f2e9c06d310 2024-04-25T09:10:52.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2ea0e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c15d7b0 con 0x7f2e9c0b4800 2024-04-25T09:10:52.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2ea0e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c15dab0 con 0x7f2e9c0cbe60 2024-04-25T09:10:52.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2e99e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c06d310 0x7f2e9c1491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2e99e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c06d310 0x7f2e9c1491b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54826/0 (socket says 172.21.15.175:54826) 2024-04-25T09:10:52.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2e99e00640 1 -- 172.21.15.175:0/736498384 learned_addr learned my addr 172.21.15.175:0/736498384 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:52.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2e91400640 1 --2- 172.21.15.175:0/736498384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e9c0b4800 0x7f2e9c13d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2e9a800640 1 --2- 172.21.15.175:0/736498384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e9c0cbe60 0x7f2e9c0af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2e99e00640 1 -- 172.21.15.175:0/736498384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e9c0cbe60 msgr2=0x7f2e9c0af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2e99e00640 1 --2- 172.21.15.175:0/736498384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e9c0cbe60 0x7f2e9c0af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2e99e00640 1 -- 172.21.15.175:0/736498384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e9c0b4800 msgr2=0x7f2e9c13d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2e99e00640 1 --2- 172.21.15.175:0/736498384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e9c0b4800 0x7f2e9c13d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2e99e00640 1 -- 172.21.15.175:0/736498384 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c14c570 con 0x7f2e9c06d310 2024-04-25T09:10:52.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2e99e00640 1 --2- 172.21.15.175:0/736498384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c06d310 0x7f2e9c1491b0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00efc0 tx=0x7f2e8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:52.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2e92a00640 1 -- 172.21.15.175:0/736498384 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c018020 con 0x7f2e9c06d310 2024-04-25T09:10:52.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2e92a00640 1 -- 172.21.15.175:0/736498384 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c014480 con 0x7f2e9c06d310 2024-04-25T09:10:52.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2e92a00640 1 -- 172.21.15.175:0/736498384 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c014850 con 0x7f2e9c06d310 2024-04-25T09:10:52.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.338+0000 7f2ea0e00640 1 -- 172.21.15.175:0/736498384 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c14c850 con 0x7f2e9c06d310 2024-04-25T09:10:52.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.342+0000 7f2ea0e00640 1 -- 172.21.15.175:0/736498384 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c149d60 con 0x7f2e9c06d310 2024-04-25T09:10:52.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.342+0000 7f2e92a00640 1 -- 172.21.15.175:0/736498384 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2e8c01b020 con 0x7f2e9c06d310 2024-04-25T09:10:52.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.342+0000 7f2e92a00640 1 --2- 172.21.15.175:0/736498384 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e78066f90 0x7f2e78069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.342+0000 7f2e92a00640 1 -- 172.21.15.175:0/736498384 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2e8c085b00 con 0x7f2e9c06d310 2024-04-25T09:10:52.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.342+0000 7f2e91400640 1 --2- 172.21.15.175:0/736498384 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e78066f90 0x7f2e78069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.342+0000 7f2ea4281000 1 Processor -- start 2024-04-25T09:10:52.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.342+0000 7f2ea4281000 1 -- start start 2024-04-25T09:10:52.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.342+0000 7f2e91400640 1 --2- 172.21.15.175:0/736498384 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e78066f90 0x7f2e78069450 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c155cf0 tx=0x7f2e84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:52.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2ea4281000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a5182e0 0x55e92a5186c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2ea4281000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a518c00 0x55e92a4ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2ea4281000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a4ce8e0 0x55e92a4cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2ea4281000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e92a3b5ba0 con 0x55e92a5182e0 2024-04-25T09:10:52.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2ea4281000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e92a31b090 con 0x55e92a518c00 2024-04-25T09:10:52.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2ea4281000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e92a2a3160 con 0x55e92a4ce8e0 2024-04-25T09:10:52.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2e99e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a5182e0 0x55e92a5186c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2e99e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a5182e0 0x55e92a5186c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54842/0 (socket says 172.21.15.175:54842) 2024-04-25T09:10:52.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2e99e00640 1 -- 172.21.15.175:0/1123083039 learned_addr learned my addr 172.21.15.175:0/1123083039 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:52.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2e91400640 1 --2- 172.21.15.175:0/1123083039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a518c00 0x55e92a4ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2e9a800640 1 --2- 172.21.15.175:0/1123083039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a4ce8e0 0x55e92a4cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2e99e00640 1 -- 172.21.15.175:0/1123083039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a4ce8e0 msgr2=0x55e92a4cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2e99e00640 1 --2- 172.21.15.175:0/1123083039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a4ce8e0 0x55e92a4cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2e99e00640 1 -- 172.21.15.175:0/1123083039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a518c00 msgr2=0x55e92a4ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2e99e00640 1 --2- 172.21.15.175:0/1123083039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a518c00 0x55e92a4ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2e99e00640 1 -- 172.21.15.175:0/1123083039 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e92a3c4c20 con 0x55e92a5182e0 2024-04-25T09:10:52.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2e99e00640 1 --2- 172.21.15.175:0/1123083039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a5182e0 0x55e92a5186c0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c052820 tx=0x7f2e8c056540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ef92172506f48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:52.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2e8aa00640 1 -- 172.21.15.175:0/1123083039 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c05a160 con 0x55e92a5182e0 2024-04-25T09:10:52.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2e8aa00640 1 -- 172.21.15.175:0/1123083039 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c052a30 con 0x55e92a5182e0 2024-04-25T09:10:52.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2e8aa00640 1 -- 172.21.15.175:0/1123083039 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c055a10 con 0x55e92a5182e0 2024-04-25T09:10:52.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2ea4281000 1 -- 172.21.15.175:0/1123083039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a5182e0 msgr2=0x55e92a5186c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2ea4281000 1 --2- 172.21.15.175:0/1123083039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a5182e0 0x55e92a5186c0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c052820 tx=0x7f2e8c056540 comp rx=0 tx=0).stop 2024-04-25T09:10:52.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2ea4281000 1 -- 172.21.15.175:0/1123083039 shutdown_connections 2024-04-25T09:10:52.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2ea4281000 1 --2- 172.21.15.175:0/1123083039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a4ce8e0 0x55e92a4cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2ea4281000 1 --2- 172.21.15.175:0/1123083039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a518c00 0x55e92a4ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2ea4281000 1 --2- 172.21.15.175:0/1123083039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a5182e0 0x55e92a5186c0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2ea4281000 1 -- 172.21.15.175:0/1123083039 >> 172.21.15.175:0/1123083039 conn(0x55e92a4ca890 msgr2=0x55e92a4ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:52.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2ea4281000 1 -- 172.21.15.175:0/1123083039 shutdown_connections 2024-04-25T09:10:52.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2ea4281000 1 -- 172.21.15.175:0/1123083039 wait complete. 2024-04-25T09:10:52.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2ea4281000 1 -- start start 2024-04-25T09:10:52.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2ea4281000 1 Processor -- start 2024-04-25T09:10:52.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.346+0000 7f2ea4281000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a4ce8e0 0x55e92a51f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a5182e0 0x55e92a51fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a518c00 0x55e92a506090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e92a317130 con 0x55e92a4ce8e0 2024-04-25T09:10:52.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e92a2df130 con 0x55e92a518c00 2024-04-25T09:10:52.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e92a3d9300 con 0x55e92a5182e0 2024-04-25T09:10:52.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 10 client.0 _ll_register_callbacks cb 0x55e92a4b9bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:52.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e99e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a4ce8e0 0x55e92a51f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e99e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a4ce8e0 0x55e92a51f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54844/0 (socket says 172.21.15.175:54844) 2024-04-25T09:10:52.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e99e00640 1 -- 172.21.15.175:0/4202405513 learned_addr learned my addr 172.21.15.175:0/4202405513 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:52.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e9a800640 1 --2- 172.21.15.175:0/4202405513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a518c00 0x55e92a506090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e91400640 1 --2- 172.21.15.175:0/4202405513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a5182e0 0x55e92a51fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e99e00640 1 -- 172.21.15.175:0/4202405513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a5182e0 msgr2=0x55e92a51fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e99e00640 1 --2- 172.21.15.175:0/4202405513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a5182e0 0x55e92a51fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e99e00640 1 -- 172.21.15.175:0/4202405513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a518c00 msgr2=0x55e92a506090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e99e00640 1 --2- 172.21.15.175:0/4202405513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a518c00 0x55e92a506090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e99e00640 1 -- 172.21.15.175:0/4202405513 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e92a2f8060 con 0x55e92a4ce8e0 2024-04-25T09:10:52.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e9a800640 1 --2- 172.21.15.175:0/4202405513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a518c00 0x55e92a506090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:52.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e99e00640 1 --2- 172.21.15.175:0/4202405513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a4ce8e0 0x55e92a51f640 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c054670 tx=0x7f2e8c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cf25d08e3d6773 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:52.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e7f400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:10:52.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e7f400640 1 -- 172.21.15.175:0/4202405513 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c052660 con 0x55e92a4ce8e0 2024-04-25T09:10:52.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e7f400640 1 -- 172.21.15.175:0/4202405513 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2e8c075e60 con 0x55e92a4ce8e0 2024-04-25T09:10:52.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 -- 172.21.15.175:0/4202405513 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e8c052a30 con 0x55e92a4ce8e0 2024-04-25T09:10:52.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e7f400640 1 -- 172.21.15.175:0/4202405513 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e8c074390 con 0x55e92a4ce8e0 2024-04-25T09:10:52.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 10 client.7563 fetch_fsmap learned FSMap version 65 2024-04-25T09:10:52.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 -- 172.21.15.175:0/4202405513 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x55e92a2bc7c0 con 0x55e92a4ce8e0 2024-04-25T09:10:52.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e7f400640 1 -- 172.21.15.175:0/4202405513 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c052a30 con 0x55e92a4ce8e0 2024-04-25T09:10:52.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e7f400640 1 -- 172.21.15.175:0/4202405513 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2e8c07d3d0 con 0x55e92a4ce8e0 2024-04-25T09:10:52.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 10 client.7563 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:10:52.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 10 client.7563 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:10:52.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 20 client.7563 populate_metadata read hostname 'smithi175' 2024-04-25T09:10:52.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 --2- 172.21.15.175:0/4202405513 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55e92a506e30 0x55e92a507210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 4 client.7563 mds_command: new command op to 7419 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:52.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 -- 172.21.15.175:0/4202405513 --> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e92a2b6cd0 con 0x55e92a506e30 2024-04-25T09:10:52.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e91400640 1 --2- 172.21.15.175:0/4202405513 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55e92a506e30 0x55e92a507210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e7f400640 10 client.7563 ms_handle_connect on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:52.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e91400640 1 --2- 172.21.15.175:0/4202405513 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55e92a506e30 0x55e92a507210 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf164aa444a6611 server_cookie=44093644616fc80a in_seq=0 out_seq=0 2024-04-25T09:10:52.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e7f400640 1 -- 172.21.15.175:0/4202405513 <== mds.0 v2:172.21.15.175:6835/1399691338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e92a2b6cd0 con 0x55e92a506e30 2024-04-25T09:10:52.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e7f400640 10 client.7563 handle_command_reply: tid=0 2024-04-25T09:10:52.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 client.7563 shutdown 2024-04-25T09:10:52.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 -- 172.21.15.175:0/4202405513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a4ce8e0 msgr2=0x55e92a51f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 --2- 172.21.15.175:0/4202405513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a4ce8e0 0x55e92a51f640 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c054670 tx=0x7f2e8c000f50 comp rx=0 tx=0).stop 2024-04-25T09:10:52.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 -- 172.21.15.175:0/4202405513 shutdown_connections 2024-04-25T09:10:52.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 --2- 172.21.15.175:0/4202405513 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55e92a506e30 0x55e92a507210 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 --2- 172.21.15.175:0/4202405513 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a518c00 0x55e92a506090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 --2- 172.21.15.175:0/4202405513 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a5182e0 0x55e92a51fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 --2- 172.21.15.175:0/4202405513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a4ce8e0 0x55e92a51f640 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2e7f400640 0 client.7563 ms_handle_reset on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:52.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 -- 172.21.15.175:0/4202405513 >> 172.21.15.175:0/4202405513 conn(0x55e92a4ca890 msgr2=0x55e92a4cd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:52.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 -- 172.21.15.175:0/4202405513 shutdown_connections 2024-04-25T09:10:52.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 1 -- 172.21.15.175:0/4202405513 wait complete. 2024-04-25T09:10:52.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.350+0000 7f2ea4281000 20 client.7563 trim_cache size 0 max 16384 2024-04-25T09:10:52.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.362+0000 7f2ea4281000 1 Processor -- start 2024-04-25T09:10:52.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.362+0000 7f2ea4281000 1 -- start start 2024-04-25T09:10:52.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a4ce8e0 0x55e92a4ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a5182e0 0x55e92a5051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a518c00 0x55e92a505730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c2020b0 con 0x55e92a518c00 2024-04-25T09:10:52.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0ce850 con 0x55e92a5182e0 2024-04-25T09:10:52.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0cee50 con 0x55e92a4ce8e0 2024-04-25T09:10:52.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2e9a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a518c00 0x55e92a505730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2e9a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a518c00 0x55e92a505730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54846/0 (socket says 172.21.15.175:54846) 2024-04-25T09:10:52.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2e9a800640 1 -- 172.21.15.175:0/2862360243 learned_addr learned my addr 172.21.15.175:0/2862360243 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:52.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2e99e00640 1 --2- 172.21.15.175:0/2862360243 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a4ce8e0 0x55e92a4ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2e91400640 1 --2- 172.21.15.175:0/2862360243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a5182e0 0x55e92a5051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2e9a800640 1 -- 172.21.15.175:0/2862360243 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a4ce8e0 msgr2=0x55e92a4ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2e9a800640 1 --2- 172.21.15.175:0/2862360243 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a4ce8e0 0x55e92a4ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2e9a800640 1 -- 172.21.15.175:0/2862360243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a5182e0 msgr2=0x55e92a5051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2e9a800640 1 --2- 172.21.15.175:0/2862360243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a5182e0 0x55e92a5051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2e9a800640 1 -- 172.21.15.175:0/2862360243 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e92a2d6fc0 con 0x55e92a518c00 2024-04-25T09:10:52.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2e9a800640 1 --2- 172.21.15.175:0/2862360243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a518c00 0x55e92a505730 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f2e9401b340 tx=0x7f2e940a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02b63a4a08abcf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:52.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2e8a000640 1 -- 172.21.15.175:0/2862360243 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e940ab720 con 0x55e92a518c00 2024-04-25T09:10:52.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2e8a000640 1 -- 172.21.15.175:0/2862360243 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e940ab8c0 con 0x55e92a518c00 2024-04-25T09:10:52.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2e8a000640 1 -- 172.21.15.175:0/2862360243 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e940abc70 con 0x55e92a518c00 2024-04-25T09:10:52.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 -- 172.21.15.175:0/2862360243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a518c00 msgr2=0x55e92a505730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 --2- 172.21.15.175:0/2862360243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a518c00 0x55e92a505730 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f2e9401b340 tx=0x7f2e940a9000 comp rx=0 tx=0).stop 2024-04-25T09:10:52.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 -- 172.21.15.175:0/2862360243 shutdown_connections 2024-04-25T09:10:52.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 --2- 172.21.15.175:0/2862360243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a518c00 0x55e92a505730 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 --2- 172.21.15.175:0/2862360243 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a5182e0 0x55e92a5051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 --2- 172.21.15.175:0/2862360243 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a4ce8e0 0x55e92a4ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 -- 172.21.15.175:0/2862360243 >> 172.21.15.175:0/2862360243 conn(0x55e92a4ca890 msgr2=0x55e92a525d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:52.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 -- 172.21.15.175:0/2862360243 shutdown_connections 2024-04-25T09:10:52.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 -- 172.21.15.175:0/2862360243 wait complete. 2024-04-25T09:10:52.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 -- start start 2024-04-25T09:10:52.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 Processor -- start 2024-04-25T09:10:52.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a4ce8e0 0x55e92a580550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a5182e0 0x55e92a580a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a518c00 0x55e92a51c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e92a2b5e70 con 0x55e92a5182e0 2024-04-25T09:10:52.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e92a2a3a50 con 0x55e92a518c00 2024-04-25T09:10:52.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e92a31a3a0 con 0x55e92a4ce8e0 2024-04-25T09:10:52.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.366+0000 7f2ea4281000 10 client.0 _ll_register_callbacks cb 0x55e92a2c7240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:52.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e91400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a5182e0 0x55e92a580a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e99e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a4ce8e0 0x55e92a580550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e9a800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a518c00 0x55e92a51c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e99e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a4ce8e0 0x55e92a580550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:45092/0 (socket says 172.21.15.175:45092) 2024-04-25T09:10:52.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e99e00640 1 -- 172.21.15.175:0/727159574 learned_addr learned my addr 172.21.15.175:0/727159574 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:52.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e91400640 1 -- 172.21.15.175:0/727159574 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a4ce8e0 msgr2=0x55e92a580550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e91400640 1 --2- 172.21.15.175:0/727159574 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a4ce8e0 0x55e92a580550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e91400640 1 -- 172.21.15.175:0/727159574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a518c00 msgr2=0x55e92a51c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e91400640 1 --2- 172.21.15.175:0/727159574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a518c00 0x55e92a51c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e91400640 1 -- 172.21.15.175:0/727159574 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e92a3749e0 con 0x55e92a5182e0 2024-04-25T09:10:52.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e91400640 1 --2- 172.21.15.175:0/727159574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a5182e0 0x55e92a580a90 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x55e92a2d3be0 tx=0x7f2e84007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c8dada160f22b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:52.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e7f400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:10:52.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e7f400640 1 -- 172.21.15.175:0/727159574 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840263e0 con 0x55e92a5182e0 2024-04-25T09:10:52.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 1 -- 172.21.15.175:0/727159574 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e940ab8c0 con 0x55e92a5182e0 2024-04-25T09:10:52.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e7f400640 1 -- 172.21.15.175:0/727159574 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2e8401e040 con 0x55e92a5182e0 2024-04-25T09:10:52.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e7f400640 1 -- 172.21.15.175:0/727159574 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e84031050 con 0x55e92a5182e0 2024-04-25T09:10:52.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 10 client.7569 fetch_fsmap learned FSMap version 65 2024-04-25T09:10:52.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 1 -- 172.21.15.175:0/727159574 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x55e92a2ba630 con 0x55e92a5182e0 2024-04-25T09:10:52.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e7f400640 1 -- 172.21.15.175:0/727159574 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e940ab8c0 con 0x55e92a5182e0 2024-04-25T09:10:52.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e7f400640 1 -- 172.21.15.175:0/727159574 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2e84034020 con 0x55e92a5182e0 2024-04-25T09:10:52.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 10 client.7569 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:10:52.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 10 client.7569 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:10:52.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 20 client.7569 populate_metadata read hostname 'smithi175' 2024-04-25T09:10:52.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 1 --2- 172.21.15.175:0/727159574 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55e92a5873b0 0x55e92a5897a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 4 client.7569 mds_command: new command op to 7419 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:10:52.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 1 -- 172.21.15.175:0/727159574 --> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x55e92a3285d0 con 0x55e92a5873b0 2024-04-25T09:10:52.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e99e00640 1 --2- 172.21.15.175:0/727159574 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55e92a5873b0 0x55e92a5897a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e99e00640 1 --2- 172.21.15.175:0/727159574 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55e92a5873b0 0x55e92a5897a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63f106fd3a412ae4 server_cookie=dbb8930f769ee2d9 in_seq=0 out_seq=0 2024-04-25T09:10:52.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e7f400640 10 client.7569 ms_handle_connect on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:52.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e7f400640 1 -- 172.21.15.175:0/727159574 <== mds.0 v2:172.21.15.175:6835/1399691338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+419 (crc 0 0 0) 0x55e92a3285d0 con 0x55e92a5873b0 2024-04-25T09:10:52.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e7f400640 10 client.7569 handle_command_reply: tid=0 2024-04-25T09:10:52.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 1 client.7569 shutdown 2024-04-25T09:10:52.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 1 -- 172.21.15.175:0/727159574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a5182e0 msgr2=0x55e92a580a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 1 --2- 172.21.15.175:0/727159574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a5182e0 0x55e92a580a90 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x55e92a2d3be0 tx=0x7f2e84007f90 comp rx=0 tx=0).stop 2024-04-25T09:10:52.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 1 -- 172.21.15.175:0/727159574 shutdown_connections 2024-04-25T09:10:52.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 1 --2- 172.21.15.175:0/727159574 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55e92a5873b0 0x55e92a5897a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 1 --2- 172.21.15.175:0/727159574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e92a518c00 0x55e92a51c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 1 --2- 172.21.15.175:0/727159574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e92a5182e0 0x55e92a580a90 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2e7f400640 0 client.7569 ms_handle_reset on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:52.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 1 --2- 172.21.15.175:0/727159574 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e92a4ce8e0 0x55e92a580550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 1 -- 172.21.15.175:0/727159574 >> 172.21.15.175:0/727159574 conn(0x55e92a4ca890 msgr2=0x55e92a525d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:52.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 1 -- 172.21.15.175:0/727159574 shutdown_connections 2024-04-25T09:10:52.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 1 -- 172.21.15.175:0/727159574 wait complete. 2024-04-25T09:10:52.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea4281000 20 client.7569 trim_cache size 0 max 16384 2024-04-25T09:10:52.365 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:10:52.365 INFO:teuthology.orchestra.run.smithi175.stdout:[ 2024-04-25T09:10:52.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:52.365 INFO:teuthology.orchestra.run.smithi175.stdout: "damage_type": "backtrace", 2024-04-25T09:10:52.365 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 346491909, 2024-04-25T09:10:52.365 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 1099511627776, 2024-04-25T09:10:52.365 INFO:teuthology.orchestra.run.smithi175.stdout: "path": "/dir" 2024-04-25T09:10:52.365 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:52.365 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:52.366 INFO:teuthology.orchestra.run.smithi175.stdout: "damage_type": "dir_frag", 2024-04-25T09:10:52.366 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 1484293710, 2024-04-25T09:10:52.366 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 1099511627776, 2024-04-25T09:10:52.366 INFO:teuthology.orchestra.run.smithi175.stdout: "frag": "*", 2024-04-25T09:10:52.366 INFO:teuthology.orchestra.run.smithi175.stdout: "path": "/dir" 2024-04-25T09:10:52.366 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:10:52.366 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:10:52.366 INFO:teuthology.orchestra.run.smithi175.stdout: "damage_type": "backtrace", 2024-04-25T09:10:52.366 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 3650189667, 2024-04-25T09:10:52.366 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 1099511627777, 2024-04-25T09:10:52.366 INFO:teuthology.orchestra.run.smithi175.stdout: "path": "/testdir/hardlink" 2024-04-25T09:10:52.366 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:52.366 INFO:teuthology.orchestra.run.smithi175.stdout:] 2024-04-25T09:10:52.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea0e00640 1 -- 172.21.15.175:0/736498384 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e78066f90 msgr2=0x7f2e78069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea0e00640 1 --2- 172.21.15.175:0/736498384 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e78066f90 0x7f2e78069450 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c155cf0 tx=0x7f2e84009040 comp rx=0 tx=0).stop 2024-04-25T09:10:52.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea0e00640 1 -- 172.21.15.175:0/736498384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c06d310 msgr2=0x7f2e9c1491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea0e00640 1 --2- 172.21.15.175:0/736498384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c06d310 0x7f2e9c1491b0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00efc0 tx=0x7f2e8c00c490 comp rx=0 tx=0).stop 2024-04-25T09:10:52.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea0e00640 1 -- 172.21.15.175:0/736498384 shutdown_connections 2024-04-25T09:10:52.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea0e00640 1 --2- 172.21.15.175:0/736498384 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e78066f90 0x7f2e78069450 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea0e00640 1 --2- 172.21.15.175:0/736498384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e9c0cbe60 0x7f2e9c0af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea0e00640 1 --2- 172.21.15.175:0/736498384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e9c0b4800 0x7f2e9c13d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea0e00640 1 --2- 172.21.15.175:0/736498384 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c06d310 0x7f2e9c1491b0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea0e00640 1 -- 172.21.15.175:0/736498384 >> 172.21.15.175:0/736498384 conn(0x7f2e9c06ac50 msgr2=0x7f2e9c155d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:52.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea0e00640 1 -- 172.21.15.175:0/736498384 shutdown_connections 2024-04-25T09:10:52.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.370+0000 7f2ea0e00640 1 -- 172.21.15.175:0/736498384 wait complete. 2024-04-25T09:10:52.381 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:10:52.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37f5e00640 1 Processor -- start 2024-04-25T09:10:52.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37f5e00640 1 -- start start 2024-04-25T09:10:52.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37f5e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f37f0099a50 0x7f37f00cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37f5e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f37f015bc10 0x7f37f0099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37f5e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37f009abb0 0x7f37f00cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37f5e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f00d06f0 con 0x7f37f0099a50 2024-04-25T09:10:52.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37f5e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37f009a370 con 0x7f37f015bc10 2024-04-25T09:10:52.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37f5e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00cc4c0 con 0x7f37f009abb0 2024-04-25T09:10:52.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37eea00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f37f0099a50 0x7f37f00cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37eea00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f37f0099a50 0x7f37f00cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54864/0 (socket says 172.21.15.175:54864) 2024-04-25T09:10:52.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37eea00640 1 -- 172.21.15.175:0/1523841897 learned_addr learned my addr 172.21.15.175:0/1523841897 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:52.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37ef400640 1 --2- 172.21.15.175:0/1523841897 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37f009abb0 0x7f37f00cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37e7e00640 1 --2- 172.21.15.175:0/1523841897 >> v2:172.21.15.177:3300/0 conn(0x7f37f015bc10 0x7f37f0099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37eea00640 1 -- 172.21.15.175:0/1523841897 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37f009abb0 msgr2=0x7f37f00cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37eea00640 1 --2- 172.21.15.175:0/1523841897 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37f009abb0 0x7f37f00cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37eea00640 1 -- 172.21.15.175:0/1523841897 >> v2:172.21.15.177:3300/0 conn(0x7f37f015bc10 msgr2=0x7f37f0099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37eea00640 1 --2- 172.21.15.175:0/1523841897 >> v2:172.21.15.177:3300/0 conn(0x7f37f015bc10 0x7f37f0099e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37eea00640 1 -- 172.21.15.175:0/1523841897 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f00cc7a0 con 0x7f37f0099a50 2024-04-25T09:10:52.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37e7e00640 1 --2- 172.21.15.175:0/1523841897 >> v2:172.21.15.177:3300/0 conn(0x7f37f015bc10 0x7f37f0099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:52.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.530+0000 7f37ef400640 1 --2- 172.21.15.175:0/1523841897 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37f009abb0 0x7f37f00cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:52.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.534+0000 7f37eea00640 1 --2- 172.21.15.175:0/1523841897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f0099a50 0x7f37f00cd280 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f37f009a6a0 tx=0x7f37e001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a5616abaa94447 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:52.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.534+0000 7f37ee000640 1 -- 172.21.15.175:0/1523841897 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e00ab5f0 con 0x7f37f0099a50 2024-04-25T09:10:52.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.534+0000 7f37ee000640 1 -- 172.21.15.175:0/1523841897 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e00b0070 con 0x7f37f0099a50 2024-04-25T09:10:52.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.534+0000 7f37ee000640 1 -- 172.21.15.175:0/1523841897 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e00ab9b0 con 0x7f37f0099a50 2024-04-25T09:10:52.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.534+0000 7f37f5e00640 1 -- 172.21.15.175:0/1523841897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f0099a50 msgr2=0x7f37f00cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.534+0000 7f37f5e00640 1 --2- 172.21.15.175:0/1523841897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f0099a50 0x7f37f00cd280 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f37f009a6a0 tx=0x7f37e001c520 comp rx=0 tx=0).stop 2024-04-25T09:10:52.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.534+0000 7f37f5e00640 1 -- 172.21.15.175:0/1523841897 shutdown_connections 2024-04-25T09:10:52.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.534+0000 7f37f5e00640 1 --2- 172.21.15.175:0/1523841897 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37f009abb0 0x7f37f00cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.534+0000 7f37f5e00640 1 --2- 172.21.15.175:0/1523841897 >> v2:172.21.15.177:3300/0 conn(0x7f37f015bc10 0x7f37f0099e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.534+0000 7f37f5e00640 1 --2- 172.21.15.175:0/1523841897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f0099a50 0x7f37f00cd280 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.534+0000 7f37f5e00640 1 -- 172.21.15.175:0/1523841897 >> 172.21.15.175:0/1523841897 conn(0x7f37f00b3300 msgr2=0x7f37f00b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:52.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.534+0000 7f37f5e00640 1 -- 172.21.15.175:0/1523841897 shutdown_connections 2024-04-25T09:10:52.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.534+0000 7f37f5e00640 1 -- 172.21.15.175:0/1523841897 wait complete. 2024-04-25T09:10:52.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37f5e00640 1 Processor -- start 2024-04-25T09:10:52.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37f5e00640 1 -- start start 2024-04-25T09:10:52.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37f5e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f0099a50 0x7f37f0146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37f5e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37f009abb0 0x7f37f00b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37f5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37f015bc10 0x7f37f00c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37f5e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00c5cf0 con 0x7f37f0099a50 2024-04-25T09:10:52.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37f5e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00c5b70 con 0x7f37f015bc10 2024-04-25T09:10:52.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37f5e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f00c5e70 con 0x7f37f009abb0 2024-04-25T09:10:52.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37eea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f0099a50 0x7f37f0146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37eea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f0099a50 0x7f37f0146f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54866/0 (socket says 172.21.15.175:54866) 2024-04-25T09:10:52.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37eea00640 1 -- 172.21.15.175:0/2674298099 learned_addr learned my addr 172.21.15.175:0/2674298099 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:52.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37e7e00640 1 --2- 172.21.15.175:0/2674298099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37f009abb0 0x7f37f00b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37ef400640 1 --2- 172.21.15.175:0/2674298099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37f015bc10 0x7f37f00c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37eea00640 1 -- 172.21.15.175:0/2674298099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37f009abb0 msgr2=0x7f37f00b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37eea00640 1 --2- 172.21.15.175:0/2674298099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37f009abb0 0x7f37f00b5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37eea00640 1 -- 172.21.15.175:0/2674298099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37f015bc10 msgr2=0x7f37f00c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37eea00640 1 --2- 172.21.15.175:0/2674298099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37f015bc10 0x7f37f00c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37eea00640 1 -- 172.21.15.175:0/2674298099 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f00cfd60 con 0x7f37f0099a50 2024-04-25T09:10:52.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37eea00640 1 --2- 172.21.15.175:0/2674298099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f0099a50 0x7f37f0146f10 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f37e001cdc0 tx=0x7f37e001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:52.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37e7400640 1 -- 172.21.15.175:0/2674298099 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e00be5f0 con 0x7f37f0099a50 2024-04-25T09:10:52.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37e7400640 1 -- 172.21.15.175:0/2674298099 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e00be7b0 con 0x7f37f0099a50 2024-04-25T09:10:52.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37e7400640 1 -- 172.21.15.175:0/2674298099 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e00beba0 con 0x7f37f0099a50 2024-04-25T09:10:52.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37f5e00640 1 -- 172.21.15.175:0/2674298099 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f00b4420 con 0x7f37f0099a50 2024-04-25T09:10:52.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37f5e00640 1 -- 172.21.15.175:0/2674298099 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f00b49e0 con 0x7f37f0099a50 2024-04-25T09:10:52.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.538+0000 7f37f5e00640 1 -- 172.21.15.175:0/2674298099 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f0074a60 con 0x7f37f0099a50 2024-04-25T09:10:52.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.542+0000 7f37e7400640 1 -- 172.21.15.175:0/2674298099 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f37e00b43f0 con 0x7f37f0099a50 2024-04-25T09:10:52.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.542+0000 7f37e7400640 1 --2- 172.21.15.175:0/2674298099 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f37cc066f60 0x7f37cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.542+0000 7f37e7400640 1 -- 172.21.15.175:0/2674298099 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f37e011eff0 con 0x7f37f0099a50 2024-04-25T09:10:52.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.542+0000 7f37e7e00640 1 --2- 172.21.15.175:0/2674298099 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f37cc066f60 0x7f37cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.542+0000 7f37e7e00640 1 --2- 172.21.15.175:0/2674298099 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f37cc066f60 0x7f37cc069420 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f37f006fd00 tx=0x7f37d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:52.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.546+0000 7f37e7400640 1 -- 172.21.15.175:0/2674298099 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f37e0016110 con 0x7f37f0099a50 2024-04-25T09:10:52.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.730+0000 7f37f5e00640 1 -- 172.21.15.175:0/2674298099 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f37f00cedc0 con 0x7f37f0099a50 2024-04-25T09:10:52.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.730+0000 7f37e7400640 1 -- 172.21.15.175:0/2674298099 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f37e00efa10 con 0x7f37f0099a50 2024-04-25T09:10:52.722 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:10:52.722 INFO:teuthology.orchestra.run.smithi175.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-25T09:10:52.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.734+0000 7f37f5e00640 1 -- 172.21.15.175:0/2674298099 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f37cc066f60 msgr2=0x7f37cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.734+0000 7f37f5e00640 1 --2- 172.21.15.175:0/2674298099 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f37cc066f60 0x7f37cc069420 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f37f006fd00 tx=0x7f37d8008040 comp rx=0 tx=0).stop 2024-04-25T09:10:52.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.734+0000 7f37f5e00640 1 -- 172.21.15.175:0/2674298099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f0099a50 msgr2=0x7f37f0146f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.734+0000 7f37f5e00640 1 --2- 172.21.15.175:0/2674298099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f0099a50 0x7f37f0146f10 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f37e001cdc0 tx=0x7f37e001ad60 comp rx=0 tx=0).stop 2024-04-25T09:10:52.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.734+0000 7f37f5e00640 1 -- 172.21.15.175:0/2674298099 shutdown_connections 2024-04-25T09:10:52.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.734+0000 7f37f5e00640 1 --2- 172.21.15.175:0/2674298099 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f37cc066f60 0x7f37cc069420 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.734+0000 7f37f5e00640 1 --2- 172.21.15.175:0/2674298099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37f015bc10 0x7f37f00c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.734+0000 7f37f5e00640 1 --2- 172.21.15.175:0/2674298099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37f009abb0 0x7f37f00b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.734+0000 7f37f5e00640 1 --2- 172.21.15.175:0/2674298099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37f0099a50 0x7f37f0146f10 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.734+0000 7f37f5e00640 1 -- 172.21.15.175:0/2674298099 >> 172.21.15.175:0/2674298099 conn(0x7f37f00b3300 msgr2=0x7f37f00cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:52.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.734+0000 7f37f5e00640 1 -- 172.21.15.175:0/2674298099 shutdown_connections 2024-04-25T09:10:52.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.734+0000 7f37f5e00640 1 -- 172.21.15.175:0/2674298099 wait complete. 2024-04-25T09:10:52.742 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T09:10:52.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:52.743 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-04-25T09:10:52.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.894+0000 7f5a4bc00640 1 Processor -- start 2024-04-25T09:10:52.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.894+0000 7f5a4bc00640 1 -- start start 2024-04-25T09:10:52.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.894+0000 7f5a4bc00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5a440cfb60 0x7f5a440ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.894+0000 7f5a4bc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a4406d860 0x7f5a4406dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.894+0000 7f5a4bc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4406e1a0 con 0x7f5a440ced10 2024-04-25T09:10:52.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.894+0000 7f5a4bc00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a440cbed0 con 0x7f5a440cfb60 2024-04-25T09:10:52.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.894+0000 7f5a4bc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a44071e20 con 0x7f5a4406d860 2024-04-25T09:10:52.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.894+0000 7f5a49c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a4406d860 0x7f5a4406dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.894+0000 7f5a49200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5a440cfb60 0x7f5a440ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.894+0000 7f5a49c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a4406d860 0x7f5a4406dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:45120/0 (socket says 172.21.15.175:45120) 2024-04-25T09:10:52.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.894+0000 7f5a49c00640 1 -- 172.21.15.175:0/3886092965 learned_addr learned my addr 172.21.15.175:0/3886092965 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:52.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.894+0000 7f5a43e00640 1 --1- 172.21.15.175:0/3886092965 >> v1:172.21.15.177:6789/0 conn(0x7f5a440ced10 0x7f5a440712b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:51380/0 (socket says 172.21.15.175:51380) 2024-04-25T09:10:52.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.894+0000 7f5a49200640 1 -- 172.21.15.175:0/3886092965 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a4406d860 msgr2=0x7f5a4406dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.894+0000 7f5a49200640 1 --2- 172.21.15.175:0/3886092965 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a4406d860 0x7f5a4406dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.894+0000 7f5a49200640 1 -- 172.21.15.175:0/3886092965 >> v1:172.21.15.177:6789/0 conn(0x7f5a440ced10 legacy=0x7f5a440712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.894+0000 7f5a49200640 1 -- 172.21.15.175:0/3886092965 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a44072100 con 0x7f5a440cfb60 2024-04-25T09:10:52.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.894+0000 7f5a49c00640 1 --2- 172.21.15.175:0/3886092965 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a4406d860 0x7f5a4406dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:52.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.894+0000 7f5a43400640 1 -- 172.21.15.175:0/3886092965 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032157324 0 0) 0x7f5a4406e1a0 con 0x7f5a440ced10 2024-04-25T09:10:52.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.898+0000 7f5a49200640 1 --2- 172.21.15.175:0/3886092965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a440cfb60 0x7f5a440ce7d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5a340097c0 tx=0x7f5a3401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38193e2aa21cb646 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:52.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.898+0000 7f5a43400640 1 -- 172.21.15.175:0/3886092965 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340b1070 con 0x7f5a440cfb60 2024-04-25T09:10:52.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.898+0000 7f5a43400640 1 -- 172.21.15.175:0/3886092965 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a340a8050 con 0x7f5a440cfb60 2024-04-25T09:10:52.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.898+0000 7f5a43400640 1 -- 172.21.15.175:0/3886092965 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340ac860 con 0x7f5a440cfb60 2024-04-25T09:10:52.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.898+0000 7f5a4bc00640 1 -- 172.21.15.175:0/3886092965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a440cfb60 msgr2=0x7f5a440ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.898+0000 7f5a4bc00640 1 --2- 172.21.15.175:0/3886092965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a440cfb60 0x7f5a440ce7d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5a340097c0 tx=0x7f5a3401c3e0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.898+0000 7f5a4bc00640 1 -- 172.21.15.175:0/3886092965 shutdown_connections 2024-04-25T09:10:52.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.898+0000 7f5a4bc00640 1 --2- 172.21.15.175:0/3886092965 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a4406d860 0x7f5a4406dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.898+0000 7f5a4bc00640 1 --2- 172.21.15.175:0/3886092965 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a440cfb60 0x7f5a440ce7d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.898+0000 7f5a4bc00640 1 -- 172.21.15.175:0/3886092965 >> 172.21.15.175:0/3886092965 conn(0x7f5a4406ac50 msgr2=0x7f5a4406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:52.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.898+0000 7f5a4bc00640 1 -- 172.21.15.175:0/3886092965 shutdown_connections 2024-04-25T09:10:52.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.898+0000 7f5a4bc00640 1 -- 172.21.15.175:0/3886092965 wait complete. 2024-04-25T09:10:52.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a4bc00640 1 Processor -- start 2024-04-25T09:10:52.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a4bc00640 1 -- start start 2024-04-25T09:10:52.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a4bc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a4406d860 0x7f5a4415ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a4bc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a440ced10 0x7f5a441439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a4bc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a440cfb60 0x7f5a440a8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a4bc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a440d00c0 con 0x7f5a440cfb60 2024-04-25T09:10:52.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a4bc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a440cff40 con 0x7f5a440ced10 2024-04-25T09:10:52.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a4bc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a440719c0 con 0x7f5a4406d860 2024-04-25T09:10:52.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a49c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a440cfb60 0x7f5a440a8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a49200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a4406d860 0x7f5a4415ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a49c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a440cfb60 0x7f5a440a8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54876/0 (socket says 172.21.15.175:54876) 2024-04-25T09:10:52.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a43e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a440ced10 0x7f5a441439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a49c00640 1 -- 172.21.15.175:0/1260612506 learned_addr learned my addr 172.21.15.175:0/1260612506 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:52.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a49c00640 1 -- 172.21.15.175:0/1260612506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a4406d860 msgr2=0x7f5a4415ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a49c00640 1 --2- 172.21.15.175:0/1260612506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a4406d860 0x7f5a4415ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a49c00640 1 -- 172.21.15.175:0/1260612506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a440ced10 msgr2=0x7f5a441439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a49c00640 1 --2- 172.21.15.175:0/1260612506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a440ced10 0x7f5a441439b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a49c00640 1 -- 172.21.15.175:0/1260612506 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a44142910 con 0x7f5a440cfb60 2024-04-25T09:10:52.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a49200640 1 --2- 172.21.15.175:0/1260612506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a4406d860 0x7f5a4415ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:52.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a49c00640 1 --2- 172.21.15.175:0/1260612506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a440cfb60 0x7f5a440a8520 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00efc0 tx=0x7f5a3c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:52.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a40c00640 1 -- 172.21.15.175:0/1260612506 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c00cbe0 con 0x7f5a440cfb60 2024-04-25T09:10:52.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a40c00640 1 -- 172.21.15.175:0/1260612506 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c00cd80 con 0x7f5a440cfb60 2024-04-25T09:10:52.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a40c00640 1 -- 172.21.15.175:0/1260612506 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c003bc0 con 0x7f5a440cfb60 2024-04-25T09:10:52.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a4bc00640 1 -- 172.21.15.175:0/1260612506 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a44142bf0 con 0x7f5a440cfb60 2024-04-25T09:10:52.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.902+0000 7f5a4bc00640 1 -- 172.21.15.175:0/1260612506 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a441431b0 con 0x7f5a440cfb60 2024-04-25T09:10:52.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.906+0000 7f5a40c00640 1 -- 172.21.15.175:0/1260612506 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5a3c01b030 con 0x7f5a440cfb60 2024-04-25T09:10:52.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.906+0000 7f5a40c00640 1 --2- 172.21.15.175:0/1260612506 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5a24066f60 0x7f5a24069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.906+0000 7f5a40c00640 1 -- 172.21.15.175:0/1260612506 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5a3c0852b0 con 0x7f5a440cfb60 2024-04-25T09:10:52.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.906+0000 7f5a49200640 1 --2- 172.21.15.175:0/1260612506 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5a24066f60 0x7f5a24069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.906+0000 7f5a4f151000 1 Processor -- start 2024-04-25T09:10:52.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.906+0000 7f5a4f151000 1 -- start start 2024-04-25T09:10:52.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.906+0000 7f5a49200640 1 --2- 172.21.15.175:0/1260612506 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5a24066f60 0x7f5a24069420 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5a340ae000 tx=0x7f5a340a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:52.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.906+0000 7f5a4f151000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c2c90 0x558f965c3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.906+0000 7f5a4f151000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f965c35b0 0x558f96578d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.906+0000 7f5a4f151000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f96579290 0x558f96579670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.906+0000 7f5a4f151000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f9645ff40 con 0x558f965c35b0 2024-04-25T09:10:52.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.906+0000 7f5a4f151000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f963c7070 con 0x558f965c2c90 2024-04-25T09:10:52.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.906+0000 7f5a4f151000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f9634f1a0 con 0x558f96579290 2024-04-25T09:10:52.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.906+0000 7f5a43e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f965c35b0 0x558f96578d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.906+0000 7f5a43e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f965c35b0 0x558f96578d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54890/0 (socket says 172.21.15.175:54890) 2024-04-25T09:10:52.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.906+0000 7f5a43e00640 1 -- 172.21.15.175:0/3485263596 learned_addr learned my addr 172.21.15.175:0/3485263596 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:52.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.906+0000 7f5a49200640 1 --2- 172.21.15.175:0/3485263596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c2c90 0x558f965c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.906+0000 7f5a49c00640 1 --2- 172.21.15.175:0/3485263596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f96579290 0x558f96579670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a43e00640 1 -- 172.21.15.175:0/3485263596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f96579290 msgr2=0x558f96579670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a43e00640 1 --2- 172.21.15.175:0/3485263596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f96579290 0x558f96579670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a43e00640 1 -- 172.21.15.175:0/3485263596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c2c90 msgr2=0x558f965c3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a43e00640 1 --2- 172.21.15.175:0/3485263596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c2c90 0x558f965c3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a43e00640 1 -- 172.21.15.175:0/3485263596 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f9634d510 con 0x558f965c35b0 2024-04-25T09:10:52.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a43e00640 1 --2- 172.21.15.175:0/3485263596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f965c35b0 0x558f96578d50 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f5a300011f0 tx=0x7f5a30004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd67e958ac757253 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:52.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a39600640 1 -- 172.21.15.175:0/3485263596 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3001a070 con 0x558f965c35b0 2024-04-25T09:10:52.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a39600640 1 -- 172.21.15.175:0/3485263596 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a300018e0 con 0x558f965c35b0 2024-04-25T09:10:52.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a39600640 1 -- 172.21.15.175:0/3485263596 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30001cd0 con 0x558f965c35b0 2024-04-25T09:10:52.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a4f151000 1 -- 172.21.15.175:0/3485263596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f965c35b0 msgr2=0x558f96578d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a4f151000 1 --2- 172.21.15.175:0/3485263596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f965c35b0 0x558f96578d50 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f5a300011f0 tx=0x7f5a30004bc0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a4f151000 1 -- 172.21.15.175:0/3485263596 shutdown_connections 2024-04-25T09:10:52.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a4f151000 1 --2- 172.21.15.175:0/3485263596 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f96579290 0x558f96579670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a4f151000 1 --2- 172.21.15.175:0/3485263596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f965c35b0 0x558f96578d50 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a4f151000 1 --2- 172.21.15.175:0/3485263596 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c2c90 0x558f965c3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a4f151000 1 -- 172.21.15.175:0/3485263596 >> 172.21.15.175:0/3485263596 conn(0x558f96575240 msgr2=0x558f96577630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:52.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a4f151000 1 -- 172.21.15.175:0/3485263596 shutdown_connections 2024-04-25T09:10:52.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a4f151000 1 -- 172.21.15.175:0/3485263596 wait complete. 2024-04-25T09:10:52.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a4f151000 1 -- start start 2024-04-25T09:10:52.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a4f151000 1 Processor -- start 2024-04-25T09:10:52.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a4f151000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f96579290 0x558f96583e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a4f151000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f965c2c90 0x558f96584370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a4f151000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c35b0 0x558f965848b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a4f151000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f963816c0 con 0x558f965c2c90 2024-04-25T09:10:52.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a4f151000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f963c3110 con 0x558f965c35b0 2024-04-25T09:10:52.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a4f151000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f963c6380 con 0x558f96579290 2024-04-25T09:10:52.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a4f151000 10 client.0 _ll_register_callbacks cb 0x558f96564570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:52.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a43e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f965c2c90 0x558f96584370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a43e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f965c2c90 0x558f96584370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54902/0 (socket says 172.21.15.175:54902) 2024-04-25T09:10:52.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a43e00640 1 -- 172.21.15.175:0/693500322 learned_addr learned my addr 172.21.15.175:0/693500322 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:52.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a49200640 1 --2- 172.21.15.175:0/693500322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f96579290 0x558f96583e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a49c00640 1 --2- 172.21.15.175:0/693500322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c35b0 0x558f965848b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a43e00640 1 -- 172.21.15.175:0/693500322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f96579290 msgr2=0x558f96583e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a43e00640 1 --2- 172.21.15.175:0/693500322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f96579290 0x558f96583e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a43e00640 1 -- 172.21.15.175:0/693500322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c35b0 msgr2=0x558f965848b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a43e00640 1 --2- 172.21.15.175:0/693500322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c35b0 0x558f965848b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a43e00640 1 -- 172.21.15.175:0/693500322 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f9634f3b0 con 0x558f965c2c90 2024-04-25T09:10:52.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.910+0000 7f5a49200640 1 --2- 172.21.15.175:0/693500322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f96579290 0x558f96583e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:52.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a43e00640 1 --2- 172.21.15.175:0/693500322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f965c2c90 0x558f96584370 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x558f96389810 tx=0x7f5a30000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6696f3c766633fa5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:52.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a2e000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:10:52.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a2e000640 1 -- 172.21.15.175:0/693500322 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30025060 con 0x558f965c2c90 2024-04-25T09:10:52.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a2e000640 1 -- 172.21.15.175:0/693500322 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5a30015c20 con 0x558f965c2c90 2024-04-25T09:10:52.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 1 -- 172.21.15.175:0/693500322 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5a300018e0 con 0x558f965c2c90 2024-04-25T09:10:52.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a2e000640 1 -- 172.21.15.175:0/693500322 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a3002b050 con 0x558f965c2c90 2024-04-25T09:10:52.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 10 client.7584 fetch_fsmap learned FSMap version 65 2024-04-25T09:10:52.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 1 -- 172.21.15.175:0/693500322 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x558f96448e00 con 0x558f965c2c90 2024-04-25T09:10:52.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a2e000640 1 -- 172.21.15.175:0/693500322 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a300018e0 con 0x558f965c2c90 2024-04-25T09:10:52.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a2e000640 1 -- 172.21.15.175:0/693500322 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5a30020420 con 0x558f965c2c90 2024-04-25T09:10:52.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 10 client.7584 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:10:52.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 10 client.7584 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:10:52.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 20 client.7584 populate_metadata read hostname 'smithi175' 2024-04-25T09:10:52.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 1 --2- 172.21.15.175:0/693500322 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x558f96585150 0x558f965d4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 4 client.7584 mds_command: new command op to 7419 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:52.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 1 -- 172.21.15.175:0/693500322 --> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558f96362d60 con 0x558f96585150 2024-04-25T09:10:52.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a49200640 1 --2- 172.21.15.175:0/693500322 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x558f96585150 0x558f965d4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a49200640 1 --2- 172.21.15.175:0/693500322 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x558f96585150 0x558f965d4410 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57ac92f527177bff server_cookie=3bf3ab46851556ac in_seq=0 out_seq=0 2024-04-25T09:10:52.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a2e000640 10 client.7584 ms_handle_connect on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:52.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a2e000640 1 -- 172.21.15.175:0/693500322 <== mds.0 v2:172.21.15.175:6835/1399691338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558f96362d60 con 0x558f96585150 2024-04-25T09:10:52.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a2e000640 10 client.7584 handle_command_reply: tid=0 2024-04-25T09:10:52.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 1 client.7584 shutdown 2024-04-25T09:10:52.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 1 -- 172.21.15.175:0/693500322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f965c2c90 msgr2=0x558f96584370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 1 --2- 172.21.15.175:0/693500322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f965c2c90 0x558f96584370 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x558f96389810 tx=0x7f5a30000ee0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 1 -- 172.21.15.175:0/693500322 shutdown_connections 2024-04-25T09:10:52.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 1 --2- 172.21.15.175:0/693500322 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x558f96585150 0x558f965d4410 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 1 --2- 172.21.15.175:0/693500322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c35b0 0x558f965848b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 1 --2- 172.21.15.175:0/693500322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f965c2c90 0x558f96584370 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 1 --2- 172.21.15.175:0/693500322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f96579290 0x558f96583e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a2e000640 0 client.7584 ms_handle_reset on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:52.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 1 -- 172.21.15.175:0/693500322 >> 172.21.15.175:0/693500322 conn(0x558f96575240 msgr2=0x558f96577ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:52.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 1 -- 172.21.15.175:0/693500322 shutdown_connections 2024-04-25T09:10:52.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 1 -- 172.21.15.175:0/693500322 wait complete. 2024-04-25T09:10:52.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.914+0000 7f5a4f151000 20 client.7584 trim_cache size 0 max 16384 2024-04-25T09:10:52.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a4f151000 1 Processor -- start 2024-04-25T09:10:52.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a4f151000 1 -- start start 2024-04-25T09:10:52.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a4f151000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f96579290 0x558f96578640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a4f151000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f965c2c90 0x558f96578b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a4f151000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c35b0 0x558f965d4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a4f151000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a44202c30 con 0x558f96579290 2024-04-25T09:10:52.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a4f151000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a44140660 con 0x558f965c35b0 2024-04-25T09:10:52.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a4f151000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a441f7700 con 0x558f965c2c90 2024-04-25T09:10:52.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a49200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f96579290 0x558f96578640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a49200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f96579290 0x558f96578640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54916/0 (socket says 172.21.15.175:54916) 2024-04-25T09:10:52.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a49200640 1 -- 172.21.15.175:0/3203109236 learned_addr learned my addr 172.21.15.175:0/3203109236 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:52.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a49c00640 1 --2- 172.21.15.175:0/3203109236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c35b0 0x558f965d4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a43e00640 1 --2- 172.21.15.175:0/3203109236 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f965c2c90 0x558f96578b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a49200640 1 -- 172.21.15.175:0/3203109236 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f965c2c90 msgr2=0x558f96578b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a49200640 1 --2- 172.21.15.175:0/3203109236 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f965c2c90 0x558f96578b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a49200640 1 -- 172.21.15.175:0/3203109236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c35b0 msgr2=0x558f965d4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a49200640 1 --2- 172.21.15.175:0/3203109236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c35b0 0x558f965d4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a49200640 1 -- 172.21.15.175:0/3203109236 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f9641ec50 con 0x558f96579290 2024-04-25T09:10:52.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a49c00640 1 --2- 172.21.15.175:0/3203109236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c35b0 0x558f965d4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:52.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.930+0000 7f5a49200640 1 --2- 172.21.15.175:0/3203109236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f96579290 0x558f96578640 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f5a34000c10 tx=0x7f5a34004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf9066d9a4944d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:52.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.934+0000 7f5a38c00640 1 -- 172.21.15.175:0/3203109236 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340cbe60 con 0x558f96579290 2024-04-25T09:10:52.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.934+0000 7f5a38c00640 1 -- 172.21.15.175:0/3203109236 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a340d0070 con 0x558f96579290 2024-04-25T09:10:52.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.934+0000 7f5a38c00640 1 -- 172.21.15.175:0/3203109236 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340b1050 con 0x558f96579290 2024-04-25T09:10:52.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.934+0000 7f5a4f151000 1 -- 172.21.15.175:0/3203109236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f96579290 msgr2=0x558f96578640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.934+0000 7f5a4f151000 1 --2- 172.21.15.175:0/3203109236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f96579290 0x558f96578640 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f5a34000c10 tx=0x7f5a34004740 comp rx=0 tx=0).stop 2024-04-25T09:10:52.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.934+0000 7f5a4f151000 1 -- 172.21.15.175:0/3203109236 shutdown_connections 2024-04-25T09:10:52.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.934+0000 7f5a4f151000 1 --2- 172.21.15.175:0/3203109236 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c35b0 0x558f965d4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.934+0000 7f5a4f151000 1 --2- 172.21.15.175:0/3203109236 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f965c2c90 0x558f96578b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.934+0000 7f5a4f151000 1 --2- 172.21.15.175:0/3203109236 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f96579290 0x558f96578640 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.934+0000 7f5a4f151000 1 -- 172.21.15.175:0/3203109236 >> 172.21.15.175:0/3203109236 conn(0x558f96575240 msgr2=0x558f9657dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:52.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.934+0000 7f5a4f151000 1 -- 172.21.15.175:0/3203109236 shutdown_connections 2024-04-25T09:10:52.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.934+0000 7f5a4f151000 1 -- 172.21.15.175:0/3203109236 wait complete. 2024-04-25T09:10:52.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.934+0000 7f5a4f151000 1 -- start start 2024-04-25T09:10:52.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.934+0000 7f5a4f151000 1 Processor -- start 2024-04-25T09:10:52.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a4f151000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f96579290 0x558f965d6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a4f151000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f965c2c90 0x558f965deee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a4f151000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c35b0 0x558f965df420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a4f151000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f96369bd0 con 0x558f96579290 2024-04-25T09:10:52.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a4f151000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a44140060 con 0x558f965c35b0 2024-04-25T09:10:52.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a4f151000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x558f965750c0 con 0x558f965c2c90 2024-04-25T09:10:52.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a4f151000 10 client.0 _ll_register_callbacks cb 0x7f5a300070e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:52.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a49200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f96579290 0x558f965d6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a49200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f96579290 0x558f965d6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54922/0 (socket says 172.21.15.175:54922) 2024-04-25T09:10:52.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a49200640 1 -- 172.21.15.175:0/9512219 learned_addr learned my addr 172.21.15.175:0/9512219 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:52.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a49c00640 1 --2- 172.21.15.175:0/9512219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c35b0 0x558f965df420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a43e00640 1 --2- 172.21.15.175:0/9512219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f965c2c90 0x558f965deee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a49200640 1 -- 172.21.15.175:0/9512219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f965c2c90 msgr2=0x558f965deee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a49200640 1 --2- 172.21.15.175:0/9512219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f965c2c90 0x558f965deee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a49200640 1 -- 172.21.15.175:0/9512219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c35b0 msgr2=0x558f965df420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:52.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a49200640 1 --2- 172.21.15.175:0/9512219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c35b0 0x558f965df420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a49200640 1 -- 172.21.15.175:0/9512219 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f9638f120 con 0x558f96579290 2024-04-25T09:10:52.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a49200640 1 --2- 172.21.15.175:0/9512219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f96579290 0x558f965d6440 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f5a3401a010 tx=0x7f5a3401ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2ae26f8c485680 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:52.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a2e000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:10:52.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a2e000640 1 -- 172.21.15.175:0/9512219 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340d9060 con 0x558f96579290 2024-04-25T09:10:52.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a2e000640 1 -- 172.21.15.175:0/9512219 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f5a340acc70 con 0x558f96579290 2024-04-25T09:10:52.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a4f151000 1 -- 172.21.15.175:0/9512219 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5a340d0070 con 0x558f96579290 2024-04-25T09:10:52.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a2e000640 1 -- 172.21.15.175:0/9512219 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a340b1040 con 0x558f96579290 2024-04-25T09:10:52.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a4f151000 10 client.7590 fetch_fsmap learned FSMap version 65 2024-04-25T09:10:52.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a4f151000 1 -- 172.21.15.175:0/9512219 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x558f9636e170 con 0x558f96579290 2024-04-25T09:10:52.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a2e000640 1 -- 172.21.15.175:0/9512219 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a340d0070 con 0x558f96579290 2024-04-25T09:10:52.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a2e000640 1 -- 172.21.15.175:0/9512219 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5a340cb150 con 0x558f96579290 2024-04-25T09:10:52.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a4f151000 10 client.7590 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:10:52.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a4f151000 10 client.7590 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:10:52.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a4f151000 20 client.7590 populate_metadata read hostname 'smithi175' 2024-04-25T09:10:52.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a4f151000 1 --2- 172.21.15.175:0/9512219 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x558f96622f70 0x558f96623380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:52.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a4f151000 4 client.7590 mds_command: new command op to 7419 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-04-25T09:10:52.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a4f151000 1 -- 172.21.15.175:0/9512219 --> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) v1 -- 0x558f965c2a20 con 0x558f96622f70 2024-04-25T09:10:52.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.938+0000 7f5a43e00640 1 --2- 172.21.15.175:0/9512219 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x558f96622f70 0x558f96623380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:52.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a43e00640 1 --2- 172.21.15.175:0/9512219 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x558f96622f70 0x558f96623380 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e5d463ce1e8db9d server_cookie=76098161fbf64da6 in_seq=0 out_seq=0 2024-04-25T09:10:52.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a2e000640 10 client.7590 ms_handle_connect on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:52.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a2e000640 1 -- 172.21.15.175:0/9512219 <== mds.0 v2:172.21.15.175:6835/1399691338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x558f965c2a20 con 0x558f96622f70 2024-04-25T09:10:52.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a2e000640 10 client.7590 handle_command_reply: tid=0 2024-04-25T09:10:52.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4f151000 1 client.7590 shutdown 2024-04-25T09:10:52.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4f151000 1 -- 172.21.15.175:0/9512219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f96579290 msgr2=0x558f965d6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4f151000 1 --2- 172.21.15.175:0/9512219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f96579290 0x558f965d6440 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f5a3401a010 tx=0x7f5a3401ac20 comp rx=0 tx=0).stop 2024-04-25T09:10:52.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4f151000 1 -- 172.21.15.175:0/9512219 shutdown_connections 2024-04-25T09:10:52.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4f151000 1 --2- 172.21.15.175:0/9512219 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x558f96622f70 0x558f96623380 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4f151000 1 --2- 172.21.15.175:0/9512219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x558f965c35b0 0x558f965df420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4f151000 1 --2- 172.21.15.175:0/9512219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x558f965c2c90 0x558f965deee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4f151000 1 --2- 172.21.15.175:0/9512219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x558f96579290 0x558f965d6440 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a2e000640 0 client.7590 ms_handle_reset on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:52.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4f151000 1 -- 172.21.15.175:0/9512219 >> 172.21.15.175:0/9512219 conn(0x558f96575240 msgr2=0x558f9657e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:52.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4f151000 1 -- 172.21.15.175:0/9512219 shutdown_connections 2024-04-25T09:10:52.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4f151000 1 -- 172.21.15.175:0/9512219 wait complete. 2024-04-25T09:10:52.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4f151000 20 client.7590 trim_cache size 0 max 16384 2024-04-25T09:10:52.935 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:10:52.935 INFO:teuthology.orchestra.run.smithi175.stdout: "return_code": 0, 2024-04-25T09:10:52.935 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_tag": "ce8621b4-34ba-49a9-92d8-2373a3fbd6c3", 2024-04-25T09:10:52.935 INFO:teuthology.orchestra.run.smithi175.stdout: "mode": "asynchronous" 2024-04-25T09:10:52.935 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:10:52.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4bc00640 1 -- 172.21.15.175:0/1260612506 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5a24066f60 msgr2=0x7f5a24069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4bc00640 1 --2- 172.21.15.175:0/1260612506 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5a24066f60 0x7f5a24069420 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5a340ae000 tx=0x7f5a340a7000 comp rx=0 tx=0).stop 2024-04-25T09:10:52.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4bc00640 1 -- 172.21.15.175:0/1260612506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a440cfb60 msgr2=0x7f5a440a8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:52.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4bc00640 1 --2- 172.21.15.175:0/1260612506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a440cfb60 0x7f5a440a8520 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00efc0 tx=0x7f5a3c00c490 comp rx=0 tx=0).stop 2024-04-25T09:10:52.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4bc00640 1 -- 172.21.15.175:0/1260612506 shutdown_connections 2024-04-25T09:10:52.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4bc00640 1 --2- 172.21.15.175:0/1260612506 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5a24066f60 0x7f5a24069420 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4bc00640 1 --2- 172.21.15.175:0/1260612506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a440cfb60 0x7f5a440a8520 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4bc00640 1 --2- 172.21.15.175:0/1260612506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a440ced10 0x7f5a441439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4bc00640 1 --2- 172.21.15.175:0/1260612506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a4406d860 0x7f5a4415ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:52.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4bc00640 1 -- 172.21.15.175:0/1260612506 >> 172.21.15.175:0/1260612506 conn(0x7f5a4406ac50 msgr2=0x7f5a440b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:52.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4bc00640 1 -- 172.21.15.175:0/1260612506 shutdown_connections 2024-04-25T09:10:52.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f5a4bc00640 1 -- 172.21.15.175:0/1260612506 wait complete. 2024-04-25T09:10:52.937 INFO:tasks.ceph.mds.c.smithi175.stderr:2024-04-25T09:10:52.942+0000 7f8341200640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv20 ap=3 DIRTYPARENT f(v0 m2024-04-25T09:10:11.367023+0000 1=1+0)->f(v1 m2024-04-25T09:10:11.367023+0000) n(v0 rc2024-04-25T09:10:11.479022+0000 2=1+1)->n(v0 rc2024-04-25T09:10:11.479022+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x55ca89620100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T09:10:11.367023+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T09:10:11.479022+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-04-25T09:10:52.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:52.955 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:10:53.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.102+0000 7f30a5600640 1 Processor -- start 2024-04-25T09:10:53.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.102+0000 7f30a5600640 1 -- start start 2024-04-25T09:10:53.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.102+0000 7f30a5600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f30a0071ea0 0x7f30a00cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.102+0000 7f30a5600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30a00b4cb0 0x7f30a00b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.102+0000 7f30a5600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a00af510 con 0x7f30a015b810 2024-04-25T09:10:53.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.102+0000 7f30a5600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a00cd340 con 0x7f30a0071ea0 2024-04-25T09:10:53.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.102+0000 7f30a5600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00cc730 con 0x7f30a00b4cb0 2024-04-25T09:10:53.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.102+0000 7f3097400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f30a0071ea0 0x7f30a00cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.102+0000 7f3097400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f30a0071ea0 0x7f30a00cf670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54924/0 (socket says 172.21.15.175:54924) 2024-04-25T09:10:53.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.102+0000 7f3097400640 1 -- 172.21.15.175:0/3372726837 learned_addr learned my addr 172.21.15.175:0/3372726837 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:53.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.102+0000 7f309fe00640 1 --1- 172.21.15.175:0/3372726837 >> v1:172.21.15.175:6789/0 conn(0x7f30a015b810 0x7f30a0071790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:37890/0 (socket says 172.21.15.175:37890) 2024-04-25T09:10:53.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.102+0000 7f3097400640 1 -- 172.21.15.175:0/3372726837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30a00b4cb0 msgr2=0x7f30a00b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:53.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.102+0000 7f30a4c00640 1 --2- 172.21.15.175:0/3372726837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30a00b4cb0 0x7f30a00b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.102+0000 7f3097400640 1 --2- 172.21.15.175:0/3372726837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30a00b4cb0 0x7f30a00b2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.102+0000 7f3097400640 1 -- 172.21.15.175:0/3372726837 >> v1:172.21.15.175:6789/0 conn(0x7f30a015b810 legacy=0x7f30a0071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:53.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.102+0000 7f309f400640 1 -- 172.21.15.175:0/3372726837 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945770809 0 0) 0x7f3090001120 con 0x7f30a015b810 2024-04-25T09:10:53.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.102+0000 7f3097400640 1 -- 172.21.15.175:0/3372726837 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a00cca10 con 0x7f30a0071ea0 2024-04-25T09:10:53.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.102+0000 7f30a4c00640 1 --2- 172.21.15.175:0/3372726837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30a00b4cb0 0x7f30a00b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:53.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.106+0000 7f3097400640 1 --2- 172.21.15.175:0/3372726837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30a0071ea0 0x7f30a00cf670 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f3088009870 tx=0x7f308801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b682e60dbf4665 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:53.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.106+0000 7f309f400640 1 -- 172.21.15.175:0/3372726837 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30880ab650 con 0x7f30a0071ea0 2024-04-25T09:10:53.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.106+0000 7f309f400640 1 -- 172.21.15.175:0/3372726837 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30880b0070 con 0x7f30a0071ea0 2024-04-25T09:10:53.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.106+0000 7f309f400640 1 -- 172.21.15.175:0/3372726837 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30880aba10 con 0x7f30a0071ea0 2024-04-25T09:10:53.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.106+0000 7f30a5600640 1 -- 172.21.15.175:0/3372726837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30a0071ea0 msgr2=0x7f30a00cf670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:53.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.106+0000 7f30a5600640 1 --2- 172.21.15.175:0/3372726837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30a0071ea0 0x7f30a00cf670 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f3088009870 tx=0x7f308801c560 comp rx=0 tx=0).stop 2024-04-25T09:10:53.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.106+0000 7f30a5600640 1 -- 172.21.15.175:0/3372726837 shutdown_connections 2024-04-25T09:10:53.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.106+0000 7f30a5600640 1 --2- 172.21.15.175:0/3372726837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30a00b4cb0 0x7f30a00b2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.106+0000 7f30a5600640 1 --2- 172.21.15.175:0/3372726837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30a0071ea0 0x7f30a00cf670 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.106+0000 7f30a5600640 1 -- 172.21.15.175:0/3372726837 >> 172.21.15.175:0/3372726837 conn(0x7f30a00cfbb0 msgr2=0x7f30a00cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:53.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.106+0000 7f30a5600640 1 -- 172.21.15.175:0/3372726837 shutdown_connections 2024-04-25T09:10:53.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.106+0000 7f30a5600640 1 -- 172.21.15.175:0/3372726837 wait complete. 2024-04-25T09:10:53.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a5600640 1 Processor -- start 2024-04-25T09:10:53.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a5600640 1 -- start start 2024-04-25T09:10:53.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a5600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30a0071ea0 0x7f30a0140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a5600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30a00b4cb0 0x7f30a00ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a5600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30a015b810 0x7f30a00aad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a5600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00b3a70 con 0x7f30a015b810 2024-04-25T09:10:53.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a5600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00b38f0 con 0x7f30a0071ea0 2024-04-25T09:10:53.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a5600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00b3bf0 con 0x7f30a00b4cb0 2024-04-25T09:10:53.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a4c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30a015b810 0x7f30a00aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a4c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30a015b810 0x7f30a00aad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54930/0 (socket says 172.21.15.175:54930) 2024-04-25T09:10:53.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a4c00640 1 -- 172.21.15.175:0/2320150669 learned_addr learned my addr 172.21.15.175:0/2320150669 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:53.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f309fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30a0071ea0 0x7f30a0140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f3097400640 1 --2- 172.21.15.175:0/2320150669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30a00b4cb0 0x7f30a00ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a4c00640 1 -- 172.21.15.175:0/2320150669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30a00b4cb0 msgr2=0x7f30a00ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:53.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a4c00640 1 --2- 172.21.15.175:0/2320150669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30a00b4cb0 0x7f30a00ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a4c00640 1 -- 172.21.15.175:0/2320150669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30a0071ea0 msgr2=0x7f30a0140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:53.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a4c00640 1 --2- 172.21.15.175:0/2320150669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30a0071ea0 0x7f30a0140880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a4c00640 1 -- 172.21.15.175:0/2320150669 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a0140dc0 con 0x7f30a015b810 2024-04-25T09:10:53.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a4c00640 1 --2- 172.21.15.175:0/2320150669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30a015b810 0x7f30a00aad40 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f309800cf20 tx=0x7f309800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:53.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f309cc00640 1 -- 172.21.15.175:0/2320150669 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309801a070 con 0x7f30a015b810 2024-04-25T09:10:53.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f309cc00640 1 -- 172.21.15.175:0/2320150669 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309800d840 con 0x7f30a015b810 2024-04-25T09:10:53.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f309cc00640 1 -- 172.21.15.175:0/2320150669 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309800dc30 con 0x7f30a015b810 2024-04-25T09:10:53.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a5600640 1 -- 172.21.15.175:0/2320150669 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a00a84b0 con 0x7f30a015b810 2024-04-25T09:10:53.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.110+0000 7f30a5600640 1 -- 172.21.15.175:0/2320150669 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a00ae470 con 0x7f30a015b810 2024-04-25T09:10:53.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.114+0000 7f309cc00640 1 -- 172.21.15.175:0/2320150669 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f309801d070 con 0x7f30a015b810 2024-04-25T09:10:53.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.114+0000 7f309cc00640 1 --2- 172.21.15.175:0/2320150669 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f307c066f60 0x7f307c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.114+0000 7f30aa138000 1 Processor -- start 2024-04-25T09:10:53.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.114+0000 7f309cc00640 1 -- 172.21.15.175:0/2320150669 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f3098085900 con 0x7f30a015b810 2024-04-25T09:10:53.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.114+0000 7f309fe00640 1 --2- 172.21.15.175:0/2320150669 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f307c066f60 0x7f307c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.114+0000 7f30aa138000 1 -- start start 2024-04-25T09:10:53.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.114+0000 7f309fe00640 1 --2- 172.21.15.175:0/2320150669 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f307c066f60 0x7f307c069420 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3090000f70 tx=0x7f3090007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:53.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.114+0000 7f30aa138000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8f89d0 0x5592db8f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.114+0000 7f30aa138000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8f92f0 0x5592db8aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.114+0000 7f30aa138000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8af0a0 0x5592db8af480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.114+0000 7f30aa138000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592db6fbff0 con 0x5592db8f92f0 2024-04-25T09:10:53.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.114+0000 7f30aa138000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592db684150 con 0x5592db8f89d0 2024-04-25T09:10:53.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.114+0000 7f30aa138000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5592db6f8090 con 0x5592db8af0a0 2024-04-25T09:10:53.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f3097400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8f92f0 0x5592db8aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f3097400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8f92f0 0x5592db8aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54944/0 (socket says 172.21.15.175:54944) 2024-04-25T09:10:53.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f3097400640 1 -- 172.21.15.175:0/1901298561 learned_addr learned my addr 172.21.15.175:0/1901298561 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:53.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f309fe00640 1 --2- 172.21.15.175:0/1901298561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8f89d0 0x5592db8f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30a4c00640 1 --2- 172.21.15.175:0/1901298561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8af0a0 0x5592db8af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f3097400640 1 -- 172.21.15.175:0/1901298561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8af0a0 msgr2=0x5592db8af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:53.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f3097400640 1 --2- 172.21.15.175:0/1901298561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8af0a0 0x5592db8af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f3097400640 1 -- 172.21.15.175:0/1901298561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8f89d0 msgr2=0x5592db8f8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:53.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f3097400640 1 --2- 172.21.15.175:0/1901298561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8f89d0 0x5592db8f8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f3097400640 1 -- 172.21.15.175:0/1901298561 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592db8920d0 con 0x5592db8f92f0 2024-04-25T09:10:53.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f3097400640 1 --2- 172.21.15.175:0/1901298561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8f92f0 0x5592db8aeb60 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f308801ce00 tx=0x7f3088004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ccfdc2ff1f7cb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:53.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f3094c00640 1 -- 172.21.15.175:0/1901298561 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30880044d0 con 0x5592db8f92f0 2024-04-25T09:10:53.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f3094c00640 1 -- 172.21.15.175:0/1901298561 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30880b0040 con 0x5592db8f92f0 2024-04-25T09:10:53.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f3094c00640 1 -- 172.21.15.175:0/1901298561 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3088003820 con 0x5592db8f92f0 2024-04-25T09:10:53.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30aa138000 1 -- 172.21.15.175:0/1901298561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8f92f0 msgr2=0x5592db8aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:53.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30aa138000 1 --2- 172.21.15.175:0/1901298561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8f92f0 0x5592db8aeb60 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f308801ce00 tx=0x7f3088004740 comp rx=0 tx=0).stop 2024-04-25T09:10:53.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30aa138000 1 -- 172.21.15.175:0/1901298561 shutdown_connections 2024-04-25T09:10:53.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30aa138000 1 --2- 172.21.15.175:0/1901298561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8af0a0 0x5592db8af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30aa138000 1 --2- 172.21.15.175:0/1901298561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8f92f0 0x5592db8aeb60 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30aa138000 1 --2- 172.21.15.175:0/1901298561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8f89d0 0x5592db8f8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30aa138000 1 -- 172.21.15.175:0/1901298561 >> 172.21.15.175:0/1901298561 conn(0x5592db8ab020 msgr2=0x5592db8ad440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:53.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30aa138000 1 -- 172.21.15.175:0/1901298561 shutdown_connections 2024-04-25T09:10:53.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30aa138000 1 -- 172.21.15.175:0/1901298561 wait complete. 2024-04-25T09:10:53.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30aa138000 1 -- start start 2024-04-25T09:10:53.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30aa138000 1 Processor -- start 2024-04-25T09:10:53.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30aa138000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8af0a0 0x5592db8e1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30aa138000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8f89d0 0x5592db8e2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30aa138000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8f92f0 0x5592db8e2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30aa138000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592db6c0250 con 0x5592db8af0a0 2024-04-25T09:10:53.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30aa138000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592db6b6690 con 0x5592db8f92f0 2024-04-25T09:10:53.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30aa138000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5592db684a40 con 0x5592db8f89d0 2024-04-25T09:10:53.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f30aa138000 10 client.0 _ll_register_callbacks cb 0x5592db899e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:53.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.118+0000 7f309fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8af0a0 0x5592db8e1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f3097400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8f89d0 0x5592db8e2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f309fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8af0a0 0x5592db8e1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54956/0 (socket says 172.21.15.175:54956) 2024-04-25T09:10:53.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f309fe00640 1 -- 172.21.15.175:0/2662291543 learned_addr learned my addr 172.21.15.175:0/2662291543 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:53.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30a4c00640 1 --2- 172.21.15.175:0/2662291543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8f92f0 0x5592db8e2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f3097400640 1 -- 172.21.15.175:0/2662291543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8f92f0 msgr2=0x5592db8e2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:53.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f3097400640 1 --2- 172.21.15.175:0/2662291543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8f92f0 0x5592db8e2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f3097400640 1 -- 172.21.15.175:0/2662291543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8af0a0 msgr2=0x5592db8e1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:53.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f3097400640 1 --2- 172.21.15.175:0/2662291543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8af0a0 0x5592db8e1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f3097400640 1 -- 172.21.15.175:0/2662291543 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5592db7a91c0 con 0x5592db8f89d0 2024-04-25T09:10:53.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f309fe00640 1 --2- 172.21.15.175:0/2662291543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8af0a0 0x5592db8e1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f3097400640 1 --2- 172.21.15.175:0/2662291543 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8f89d0 0x5592db8e2530 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f308801ac10 tx=0x7f308801ada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45d1e808986aba2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f308d600640 10 client.0 ms_handle_connect on v2:172.21.15.177:3301/0 2024-04-25T09:10:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f308d600640 1 -- 172.21.15.175:0/2662291543 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30880044d0 con 0x5592db8f89d0 2024-04-25T09:10:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f308d600640 1 -- 172.21.15.175:0/2662291543 <== mon.2 v2:172.21.15.177:3301/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f3088003b70 con 0x5592db8f89d0 2024-04-25T09:10:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 1 -- 172.21.15.175:0/2662291543 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f30880b0040 con 0x5592db8f89d0 2024-04-25T09:10:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f308d600640 1 -- 172.21.15.175:0/2662291543 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3088003d70 con 0x5592db8f89d0 2024-04-25T09:10:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 10 client.6683 fetch_fsmap learned FSMap version 65 2024-04-25T09:10:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 1 -- 172.21.15.175:0/2662291543 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x5592db7a5170 con 0x5592db8f89d0 2024-04-25T09:10:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f308d600640 1 -- 172.21.15.175:0/2662291543 <== mon.2 v2:172.21.15.177:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30880b0040 con 0x5592db8f89d0 2024-04-25T09:10:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f308d600640 1 -- 172.21.15.175:0/2662291543 <== mon.2 v2:172.21.15.177:3301/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f30880d0080 con 0x5592db8f89d0 2024-04-25T09:10:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 10 client.6683 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:10:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 10 client.6683 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:10:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 20 client.6683 populate_metadata read hostname 'smithi175' 2024-04-25T09:10:53.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 1 --2- 172.21.15.175:0/2662291543 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5592db8e3340 0x5592db90f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 4 client.6683 mds_command: new command op to 7419 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:53.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 1 -- 172.21.15.175:0/2662291543 --> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5592db697c60 con 0x5592db8e3340 2024-04-25T09:10:53.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f309fe00640 1 --2- 172.21.15.175:0/2662291543 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5592db8e3340 0x5592db90f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f309fe00640 1 --2- 172.21.15.175:0/2662291543 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5592db8e3340 0x5592db90f1a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e64491f5a6cddb server_cookie=39063636a98a8eb1 in_seq=0 out_seq=0 2024-04-25T09:10:53.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f308d600640 10 client.6683 ms_handle_connect on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:53.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f308d600640 1 -- 172.21.15.175:0/2662291543 <== mds.0 v2:172.21.15.175:6835/1399691338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5592db697c60 con 0x5592db8e3340 2024-04-25T09:10:53.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f308d600640 10 client.6683 handle_command_reply: tid=0 2024-04-25T09:10:53.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 1 client.6683 shutdown 2024-04-25T09:10:53.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 1 -- 172.21.15.175:0/2662291543 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8f89d0 msgr2=0x5592db8e2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:53.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 1 --2- 172.21.15.175:0/2662291543 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8f89d0 0x5592db8e2530 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f308801ac10 tx=0x7f308801ada0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 1 -- 172.21.15.175:0/2662291543 shutdown_connections 2024-04-25T09:10:53.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 1 --2- 172.21.15.175:0/2662291543 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5592db8e3340 0x5592db90f1a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 1 --2- 172.21.15.175:0/2662291543 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8f92f0 0x5592db8e2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 1 --2- 172.21.15.175:0/2662291543 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8f89d0 0x5592db8e2530 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 1 --2- 172.21.15.175:0/2662291543 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8af0a0 0x5592db8e1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 1 -- 172.21.15.175:0/2662291543 >> 172.21.15.175:0/2662291543 conn(0x5592db8ab020 msgr2=0x5592db8adca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:53.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f308d600640 0 client.6683 ms_handle_reset on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:53.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 1 -- 172.21.15.175:0/2662291543 shutdown_connections 2024-04-25T09:10:53.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 1 -- 172.21.15.175:0/2662291543 wait complete. 2024-04-25T09:10:53.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.122+0000 7f30aa138000 20 client.6683 trim_cache size 0 max 16384 2024-04-25T09:10:53.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f30aa138000 1 Processor -- start 2024-04-25T09:10:53.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f30aa138000 1 -- start start 2024-04-25T09:10:53.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f30aa138000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8af0a0 0x5592db9115e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f30aa138000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8f89d0 0x5592db8f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f30aa138000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8f92f0 0x5592db8f7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f30aa138000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a006f4f0 con 0x5592db8af0a0 2024-04-25T09:10:53.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f30aa138000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a0157870 con 0x5592db8f92f0 2024-04-25T09:10:53.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f30aa138000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a0152960 con 0x5592db8f89d0 2024-04-25T09:10:53.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f309fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8af0a0 0x5592db9115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f309fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8af0a0 0x5592db9115e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:54958/0 (socket says 172.21.15.175:54958) 2024-04-25T09:10:53.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f309fe00640 1 -- 172.21.15.175:0/2624695216 learned_addr learned my addr 172.21.15.175:0/2624695216 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:53.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f3097400640 1 --2- 172.21.15.175:0/2624695216 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8f89d0 0x5592db8f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f309fe00640 1 -- 172.21.15.175:0/2624695216 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8f89d0 msgr2=0x5592db8f77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:53.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f30a4c00640 1 --2- 172.21.15.175:0/2624695216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8f92f0 0x5592db8f7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f309fe00640 1 --2- 172.21.15.175:0/2624695216 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8f89d0 0x5592db8f77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f309fe00640 1 -- 172.21.15.175:0/2624695216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8f92f0 msgr2=0x5592db8f7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:53.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f309fe00640 1 --2- 172.21.15.175:0/2624695216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8f92f0 0x5592db8f7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f309fe00640 1 -- 172.21.15.175:0/2624695216 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592db742de0 con 0x5592db8af0a0 2024-04-25T09:10:53.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f3097400640 1 --2- 172.21.15.175:0/2624695216 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8f89d0 0x5592db8f77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:53.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.138+0000 7f30a4c00640 1 --2- 172.21.15.175:0/2624695216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8f92f0 0x5592db8f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:53.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f309fe00640 1 --2- 172.21.15.175:0/2624695216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8af0a0 0x5592db9115e0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f3090028c90 tx=0x7f309000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8493e7e5026d8abb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:53.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f308fe00640 1 -- 172.21.15.175:0/2624695216 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090026030 con 0x5592db8af0a0 2024-04-25T09:10:53.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f308fe00640 1 -- 172.21.15.175:0/2624695216 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309002c020 con 0x5592db8af0a0 2024-04-25T09:10:53.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f308fe00640 1 -- 172.21.15.175:0/2624695216 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090014cd0 con 0x5592db8af0a0 2024-04-25T09:10:53.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 1 -- 172.21.15.175:0/2624695216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8af0a0 msgr2=0x5592db9115e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:53.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 1 --2- 172.21.15.175:0/2624695216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8af0a0 0x5592db9115e0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f3090028c90 tx=0x7f309000c000 comp rx=0 tx=0).stop 2024-04-25T09:10:53.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 1 -- 172.21.15.175:0/2624695216 shutdown_connections 2024-04-25T09:10:53.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 1 --2- 172.21.15.175:0/2624695216 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8f92f0 0x5592db8f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 1 --2- 172.21.15.175:0/2624695216 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8f89d0 0x5592db8f77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 1 --2- 172.21.15.175:0/2624695216 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8af0a0 0x5592db9115e0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 1 -- 172.21.15.175:0/2624695216 >> 172.21.15.175:0/2624695216 conn(0x5592db8ab020 msgr2=0x5592db8dbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:53.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 1 -- 172.21.15.175:0/2624695216 shutdown_connections 2024-04-25T09:10:53.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 1 -- 172.21.15.175:0/2624695216 wait complete. 2024-04-25T09:10:53.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 1 -- start start 2024-04-25T09:10:53.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 1 Processor -- start 2024-04-25T09:10:53.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8af0a0 0x5592db911700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8f89d0 0x5592db90f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8f92f0 0x5592db90f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592db696e00 con 0x5592db8f89d0 2024-04-25T09:10:53.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a0157270 con 0x5592db8af0a0 2024-04-25T09:10:53.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5592db6fb300 con 0x5592db8f92f0 2024-04-25T09:10:53.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 10 client.0 _ll_register_callbacks cb 0x5592db87a040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:53.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f3097400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8f89d0 0x5592db90f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f309fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8af0a0 0x5592db911700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f309fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8af0a0 0x5592db911700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:57338/0 (socket says 172.21.15.175:57338) 2024-04-25T09:10:53.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f309fe00640 1 -- 172.21.15.175:0/3905232201 learned_addr learned my addr 172.21.15.175:0/3905232201 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:10:53.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30a4c00640 1 --2- 172.21.15.175:0/3905232201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8f92f0 0x5592db90f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f3097400640 1 -- 172.21.15.175:0/3905232201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8f92f0 msgr2=0x5592db90f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:53.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f3097400640 1 --2- 172.21.15.175:0/3905232201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8f92f0 0x5592db90f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f3097400640 1 -- 172.21.15.175:0/3905232201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8af0a0 msgr2=0x5592db911700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:53.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f3097400640 1 --2- 172.21.15.175:0/3905232201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8af0a0 0x5592db911700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f3097400640 1 -- 172.21.15.175:0/3905232201 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5592db69d8e0 con 0x5592db8f89d0 2024-04-25T09:10:53.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f3097400640 1 --2- 172.21.15.175:0/3905232201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8f89d0 0x5592db90f1a0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f3088003f30 tx=0x7f30880a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11ee11e80227130 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:53.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f308d600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:10:53.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f308d600640 1 -- 172.21.15.175:0/3905232201 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30880d3060 con 0x5592db8f89d0 2024-04-25T09:10:53.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f308d600640 1 -- 172.21.15.175:0/3905232201 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f30880ab950 con 0x5592db8f89d0 2024-04-25T09:10:53.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.142+0000 7f30aa138000 1 -- 172.21.15.175:0/3905232201 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f309002c020 con 0x5592db8f89d0 2024-04-25T09:10:53.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f308d600640 1 -- 172.21.15.175:0/3905232201 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30880abb50 con 0x5592db8f89d0 2024-04-25T09:10:53.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 10 client.7611 fetch_fsmap learned FSMap version 65 2024-04-25T09:10:53.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 1 -- 172.21.15.175:0/3905232201 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x5592db7558f0 con 0x5592db8f89d0 2024-04-25T09:10:53.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f308d600640 1 -- 172.21.15.175:0/3905232201 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309002c020 con 0x5592db8f89d0 2024-04-25T09:10:53.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f308d600640 1 -- 172.21.15.175:0/3905232201 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f30880bd410 con 0x5592db8f89d0 2024-04-25T09:10:53.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 10 client.7611 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:10:53.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 10 client.7611 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:10:53.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 20 client.7611 populate_metadata read hostname 'smithi175' 2024-04-25T09:10:53.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 1 --2- 172.21.15.175:0/3905232201 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5592db9100d0 0x5592db9104e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:53.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 4 client.7611 mds_command: new command op to 7419 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:10:53.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 1 -- 172.21.15.175:0/3905232201 --> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5592db709530 con 0x5592db9100d0 2024-04-25T09:10:53.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f309fe00640 1 --2- 172.21.15.175:0/3905232201 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5592db9100d0 0x5592db9104e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:53.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f309fe00640 1 --2- 172.21.15.175:0/3905232201 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5592db9100d0 0x5592db9104e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5e25fef4a8ac606 server_cookie=efd011fd4b5db3e7 in_seq=0 out_seq=0 2024-04-25T09:10:53.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f308d600640 10 client.7611 ms_handle_connect on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:53.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f308d600640 1 -- 172.21.15.175:0/3905232201 <== mds.0 v2:172.21.15.175:6835/1399691338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+263 (crc 0 0 0) 0x5592db709530 con 0x5592db9100d0 2024-04-25T09:10:53.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f308d600640 10 client.7611 handle_command_reply: tid=0 2024-04-25T09:10:53.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 1 client.7611 shutdown 2024-04-25T09:10:53.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 1 -- 172.21.15.175:0/3905232201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8f89d0 msgr2=0x5592db90f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:53.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 1 --2- 172.21.15.175:0/3905232201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8f89d0 0x5592db90f1a0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f3088003f30 tx=0x7f30880a7000 comp rx=0 tx=0).stop 2024-04-25T09:10:53.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 1 -- 172.21.15.175:0/3905232201 shutdown_connections 2024-04-25T09:10:53.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 1 --2- 172.21.15.175:0/3905232201 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5592db9100d0 0x5592db9104e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 1 --2- 172.21.15.175:0/3905232201 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5592db8f92f0 0x5592db90f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 1 --2- 172.21.15.175:0/3905232201 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5592db8f89d0 0x5592db90f1a0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 1 --2- 172.21.15.175:0/3905232201 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5592db8af0a0 0x5592db911700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f308d600640 0 client.7611 ms_handle_reset on v2:172.21.15.175:6835/1399691338 2024-04-25T09:10:53.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 1 -- 172.21.15.175:0/3905232201 >> 172.21.15.175:0/3905232201 conn(0x5592db8ab020 msgr2=0x5592db8f77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:53.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 1 -- 172.21.15.175:0/3905232201 shutdown_connections 2024-04-25T09:10:53.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 1 -- 172.21.15.175:0/3905232201 wait complete. 2024-04-25T09:10:53.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30aa138000 20 client.7611 trim_cache size 0 max 16384 2024-04-25T09:10:53.141 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:10:53.141 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:10:53.141 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": { 2024-04-25T09:10:53.141 INFO:teuthology.orchestra.run.smithi175.stdout: "ce8621b4-34ba-49a9-92d8-2373a3fbd6c3": { 2024-04-25T09:10:53.141 INFO:teuthology.orchestra.run.smithi175.stdout: "path": "/dir", 2024-04-25T09:10:53.141 INFO:teuthology.orchestra.run.smithi175.stdout: "tag": "ce8621b4-34ba-49a9-92d8-2373a3fbd6c3", 2024-04-25T09:10:53.141 INFO:teuthology.orchestra.run.smithi175.stdout: "options": "recursive,repair" 2024-04-25T09:10:53.141 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:53.142 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:10:53.142 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:10:53.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30a5600640 1 -- 172.21.15.175:0/2320150669 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f307c066f60 msgr2=0x7f307c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:53.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30a5600640 1 --2- 172.21.15.175:0/2320150669 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f307c066f60 0x7f307c069420 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3090000f70 tx=0x7f3090007df0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30a5600640 1 -- 172.21.15.175:0/2320150669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30a015b810 msgr2=0x7f30a00aad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:53.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30a5600640 1 --2- 172.21.15.175:0/2320150669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30a015b810 0x7f30a00aad40 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f309800cf20 tx=0x7f309800a7d0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30a5600640 1 -- 172.21.15.175:0/2320150669 shutdown_connections 2024-04-25T09:10:53.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30a5600640 1 --2- 172.21.15.175:0/2320150669 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f307c066f60 0x7f307c069420 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30a5600640 1 --2- 172.21.15.175:0/2320150669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30a015b810 0x7f30a00aad40 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30a5600640 1 --2- 172.21.15.175:0/2320150669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f30a00b4cb0 0x7f30a00ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30a5600640 1 --2- 172.21.15.175:0/2320150669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30a0071ea0 0x7f30a0140880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:53.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30a5600640 1 -- 172.21.15.175:0/2320150669 >> 172.21.15.175:0/2320150669 conn(0x7f30a00cfbb0 msgr2=0x7f30a015cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:53.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30a5600640 1 -- 172.21.15.175:0/2320150669 shutdown_connections 2024-04-25T09:10:53.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:10:53.146+0000 7f30a5600640 1 -- 172.21.15.175:0/2320150669 wait complete. 2024-04-25T09:10:53.155 INFO:tasks.cephfs.filesystem:scrub status for tag:ce8621b4-34ba-49a9-92d8-2373a3fbd6c3 - {'path': '/dir', 'tag': 'ce8621b4-34ba-49a9-92d8-2373a3fbd6c3', 'options': 'recursive,repair'} 2024-04-25T09:11:09.230 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:11:09.235 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:11:23.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:23.156 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:11:23.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.314+0000 7fe590200640 1 Processor -- start 2024-04-25T09:11:23.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.314+0000 7fe590200640 1 -- start start 2024-04-25T09:11:23.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.314+0000 7fe590200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe588145250 0x7fe5880cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.314+0000 7fe590200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe5880ce970 0x7fe5880cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.314+0000 7fe590200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5880cfd10 con 0x7fe5881600a0 2024-04-25T09:11:23.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.314+0000 7fe590200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58815f650 con 0x7fe5880ce970 2024-04-25T09:11:23.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.314+0000 7fe590200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5880cfff0 con 0x7fe588145250 2024-04-25T09:11:23.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.318+0000 7fe58ce00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe5881600a0 0x7fe5880cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:33508/0 (socket says 172.21.15.175:33508) 2024-04-25T09:11:23.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.318+0000 7fe58ce00640 1 -- 172.21.15.175:0/15290572 learned_addr learned my addr 172.21.15.175:0/15290572 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:11:23.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.318+0000 7fe58e200640 1 --2- 172.21.15.175:0/15290572 >> v2:172.21.15.175:3300/0 conn(0x7fe5880ce970 0x7fe5880cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.318+0000 7fe58d800640 1 --2- 172.21.15.175:0/15290572 >> v2:172.21.15.177:3300/0 conn(0x7fe588145250 0x7fe5880cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.318+0000 7fe587e00640 1 -- 172.21.15.175:0/15290572 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413847639 0 0) 0x7fe5880cfd10 con 0x7fe5881600a0 2024-04-25T09:11:23.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.318+0000 7fe587e00640 1 -- 172.21.15.175:0/15290572 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe570003530 con 0x7fe5881600a0 2024-04-25T09:11:23.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.318+0000 7fe58e200640 1 -- 172.21.15.175:0/15290572 >> v2:172.21.15.177:3300/0 conn(0x7fe588145250 msgr2=0x7fe5880cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.318+0000 7fe58e200640 1 --2- 172.21.15.175:0/15290572 >> v2:172.21.15.177:3300/0 conn(0x7fe588145250 0x7fe5880cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.318+0000 7fe58e200640 1 -- 172.21.15.175:0/15290572 >> v1:172.21.15.175:6789/0 conn(0x7fe5881600a0 legacy=0x7fe5880cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.318+0000 7fe58e200640 1 -- 172.21.15.175:0/15290572 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58815f8a0 con 0x7fe5880ce970 2024-04-25T09:11:23.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.318+0000 7fe58e200640 1 --2- 172.21.15.175:0/15290572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5880ce970 0x7fe5880cedc0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fe580009d90 tx=0x7fe58001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2899bb1fe7322432 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.318+0000 7fe587e00640 1 -- 172.21.15.175:0/15290572 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5800b2070 con 0x7fe5880ce970 2024-04-25T09:11:23.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.318+0000 7fe587e00640 1 -- 172.21.15.175:0/15290572 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5800a58c0 con 0x7fe5880ce970 2024-04-25T09:11:23.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.318+0000 7fe587e00640 1 -- 172.21.15.175:0/15290572 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5800a5c90 con 0x7fe5880ce970 2024-04-25T09:11:23.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe590200640 1 -- 172.21.15.175:0/15290572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5880ce970 msgr2=0x7fe5880cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe590200640 1 --2- 172.21.15.175:0/15290572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5880ce970 0x7fe5880cedc0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fe580009d90 tx=0x7fe58001c870 comp rx=0 tx=0).stop 2024-04-25T09:11:23.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe590200640 1 -- 172.21.15.175:0/15290572 shutdown_connections 2024-04-25T09:11:23.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe590200640 1 --2- 172.21.15.175:0/15290572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5880ce970 0x7fe5880cedc0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe590200640 1 --2- 172.21.15.175:0/15290572 >> v2:172.21.15.177:3300/0 conn(0x7fe588145250 0x7fe5880cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe590200640 1 -- 172.21.15.175:0/15290572 >> 172.21.15.175:0/15290572 conn(0x7fe58806ac50 msgr2=0x7fe58806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe590200640 1 -- 172.21.15.175:0/15290572 shutdown_connections 2024-04-25T09:11:23.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe590200640 1 -- 172.21.15.175:0/15290572 wait complete. 2024-04-25T09:11:23.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe590200640 1 Processor -- start 2024-04-25T09:11:23.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe590200640 1 -- start start 2024-04-25T09:11:23.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe590200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5880ce970 0x7fe5880b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe590200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe588145250 0x7fe5880a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe590200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5881600a0 0x7fe588165cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe590200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58815c870 con 0x7fe5881600a0 2024-04-25T09:11:23.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe590200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5881604b0 con 0x7fe588145250 2024-04-25T09:11:23.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe590200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58815c9f0 con 0x7fe5880ce970 2024-04-25T09:11:23.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe58e200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5881600a0 0x7fe588165cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe58e200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5881600a0 0x7fe588165cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46564/0 (socket says 172.21.15.175:46564) 2024-04-25T09:11:23.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe58e200640 1 -- 172.21.15.175:0/739057666 learned_addr learned my addr 172.21.15.175:0/739057666 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:23.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe58d800640 1 --2- 172.21.15.175:0/739057666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5880ce970 0x7fe5880b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.322+0000 7fe58ce00640 1 --2- 172.21.15.175:0/739057666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe588145250 0x7fe5880a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.326+0000 7fe58e200640 1 -- 172.21.15.175:0/739057666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5880ce970 msgr2=0x7fe5880b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.326+0000 7fe58e200640 1 --2- 172.21.15.175:0/739057666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5880ce970 0x7fe5880b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.326+0000 7fe58e200640 1 -- 172.21.15.175:0/739057666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe588145250 msgr2=0x7fe5880a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.326+0000 7fe58e200640 1 --2- 172.21.15.175:0/739057666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe588145250 0x7fe5880a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.326+0000 7fe58e200640 1 -- 172.21.15.175:0/739057666 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5880a8be0 con 0x7fe5881600a0 2024-04-25T09:11:23.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.326+0000 7fe58e200640 1 --2- 172.21.15.175:0/739057666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5881600a0 0x7fe588165cf0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fe58001a4a0 tx=0x7fe580019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.326+0000 7fe585600640 1 -- 172.21.15.175:0/739057666 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5800b2050 con 0x7fe5881600a0 2024-04-25T09:11:23.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.326+0000 7fe585600640 1 -- 172.21.15.175:0/739057666 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5800be070 con 0x7fe5881600a0 2024-04-25T09:11:23.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.326+0000 7fe585600640 1 -- 172.21.15.175:0/739057666 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5800ad850 con 0x7fe5881600a0 2024-04-25T09:11:23.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.326+0000 7fe590200640 1 -- 172.21.15.175:0/739057666 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5880a8ec0 con 0x7fe5881600a0 2024-04-25T09:11:23.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.326+0000 7fe590200640 1 -- 172.21.15.175:0/739057666 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5880a9480 con 0x7fe5881600a0 2024-04-25T09:11:23.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.326+0000 7fe585600640 1 -- 172.21.15.175:0/739057666 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe5800ad9f0 con 0x7fe5881600a0 2024-04-25T09:11:23.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe585600640 1 --2- 172.21.15.175:0/739057666 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe568066f60 0x7fe568069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe585600640 1 -- 172.21.15.175:0/739057666 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fe58011ffc0 con 0x7fe5881600a0 2024-04-25T09:11:23.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe58d800640 1 --2- 172.21.15.175:0/739057666 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe568066f60 0x7fe568069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe593672000 1 Processor -- start 2024-04-25T09:11:23.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe593672000 1 -- start start 2024-04-25T09:11:23.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe58d800640 1 --2- 172.21.15.175:0/739057666 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe568066f60 0x7fe568069420 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009b60 tx=0x7fe57c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe593672000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4eca9d0 0x5620f4ecadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe593672000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4ecb2f0 0x5620f4e80b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe593672000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4e810a0 0x5620f4e81480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe593672000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620f4ccdff0 con 0x5620f4ecb2f0 2024-04-25T09:11:23.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe593672000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620f4c56150 con 0x5620f4eca9d0 2024-04-25T09:11:23.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe593672000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5620f4cca090 con 0x5620f4e810a0 2024-04-25T09:11:23.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe58ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4ecb2f0 0x5620f4e80b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe58ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4ecb2f0 0x5620f4e80b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46570/0 (socket says 172.21.15.175:46570) 2024-04-25T09:11:23.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe58ce00640 1 -- 172.21.15.175:0/2149845862 learned_addr learned my addr 172.21.15.175:0/2149845862 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:23.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe58d800640 1 --2- 172.21.15.175:0/2149845862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4eca9d0 0x5620f4ecadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe58e200640 1 --2- 172.21.15.175:0/2149845862 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4e810a0 0x5620f4e81480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe58ce00640 1 -- 172.21.15.175:0/2149845862 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4e810a0 msgr2=0x5620f4e81480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe58ce00640 1 --2- 172.21.15.175:0/2149845862 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4e810a0 0x5620f4e81480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe58ce00640 1 -- 172.21.15.175:0/2149845862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4eca9d0 msgr2=0x5620f4ecadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe58ce00640 1 --2- 172.21.15.175:0/2149845862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4eca9d0 0x5620f4ecadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe58ce00640 1 -- 172.21.15.175:0/2149845862 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620f4e640d0 con 0x5620f4ecb2f0 2024-04-25T09:11:23.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe58e200640 1 --2- 172.21.15.175:0/2149845862 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4e810a0 0x5620f4e81480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:23.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe58ce00640 1 --2- 172.21.15.175:0/2149845862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4ecb2f0 0x5620f4e80b60 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fe574001800 tx=0x7fe574000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1374a35acf4f1eea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe57a000640 1 -- 172.21.15.175:0/2149845862 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574005ad0 con 0x5620f4ecb2f0 2024-04-25T09:11:23.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe57a000640 1 -- 172.21.15.175:0/2149845862 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe574018070 con 0x5620f4ecb2f0 2024-04-25T09:11:23.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe57a000640 1 -- 172.21.15.175:0/2149845862 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740070d0 con 0x5620f4ecb2f0 2024-04-25T09:11:23.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe593672000 1 -- 172.21.15.175:0/2149845862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4ecb2f0 msgr2=0x5620f4e80b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe593672000 1 --2- 172.21.15.175:0/2149845862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4ecb2f0 0x5620f4e80b60 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fe574001800 tx=0x7fe574000bd0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe593672000 1 -- 172.21.15.175:0/2149845862 shutdown_connections 2024-04-25T09:11:23.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe593672000 1 --2- 172.21.15.175:0/2149845862 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4e810a0 0x5620f4e81480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe593672000 1 --2- 172.21.15.175:0/2149845862 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4ecb2f0 0x5620f4e80b60 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe593672000 1 --2- 172.21.15.175:0/2149845862 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4eca9d0 0x5620f4ecadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe593672000 1 -- 172.21.15.175:0/2149845862 >> 172.21.15.175:0/2149845862 conn(0x5620f4e7d020 msgr2=0x5620f4e7f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe593672000 1 -- 172.21.15.175:0/2149845862 shutdown_connections 2024-04-25T09:11:23.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.330+0000 7fe593672000 1 -- 172.21.15.175:0/2149845862 wait complete. 2024-04-25T09:11:23.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe593672000 1 -- start start 2024-04-25T09:11:23.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe593672000 1 Processor -- start 2024-04-25T09:11:23.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe593672000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4e810a0 0x5620f4eaf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe593672000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4eca9d0 0x5620f4eafd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe593672000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4ecb2f0 0x5620f4eb0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe593672000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620f4c92250 con 0x5620f4e810a0 2024-04-25T09:11:23.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe593672000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620f4c88690 con 0x5620f4eca9d0 2024-04-25T09:11:23.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe593672000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5620f4c56a40 con 0x5620f4ecb2f0 2024-04-25T09:11:23.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe593672000 10 client.0 _ll_register_callbacks cb 0x5620f4e6be90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:23.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe58d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4e810a0 0x5620f4eaf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe58d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4e810a0 0x5620f4eaf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46586/0 (socket says 172.21.15.175:46586) 2024-04-25T09:11:23.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe58d800640 1 -- 172.21.15.175:0/2060194825 learned_addr learned my addr 172.21.15.175:0/2060194825 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:23.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe58e200640 1 --2- 172.21.15.175:0/2060194825 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4ecb2f0 0x5620f4eb0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe58ce00640 1 --2- 172.21.15.175:0/2060194825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4eca9d0 0x5620f4eafd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe58d800640 1 -- 172.21.15.175:0/2060194825 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4ecb2f0 msgr2=0x5620f4eb0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe58d800640 1 --2- 172.21.15.175:0/2060194825 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4ecb2f0 0x5620f4eb0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe58d800640 1 -- 172.21.15.175:0/2060194825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4eca9d0 msgr2=0x5620f4eafd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe58d800640 1 --2- 172.21.15.175:0/2060194825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4eca9d0 0x5620f4eafd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe58d800640 1 -- 172.21.15.175:0/2060194825 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5620f4d7b1c0 con 0x5620f4e810a0 2024-04-25T09:11:23.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe58ce00640 1 --2- 172.21.15.175:0/2060194825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4eca9d0 0x5620f4eafd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:23.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe58d800640 1 --2- 172.21.15.175:0/2060194825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4e810a0 0x5620f4eaf7f0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0038d0 tx=0x7fe57c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ea5f616e8fc606 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe56ea00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:11:23.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe56ea00640 1 -- 172.21.15.175:0/2060194825 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c027070 con 0x5620f4e810a0 2024-04-25T09:11:23.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe56ea00640 1 -- 172.21.15.175:0/2060194825 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fe57c014650 con 0x5620f4e810a0 2024-04-25T09:11:23.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe593672000 1 -- 172.21.15.175:0/2060194825 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe574018070 con 0x5620f4e810a0 2024-04-25T09:11:23.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe56ea00640 1 -- 172.21.15.175:0/2060194825 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe57c0044b0 con 0x5620f4e810a0 2024-04-25T09:11:23.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe593672000 10 client.7626 fetch_fsmap learned FSMap version 65 2024-04-25T09:11:23.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe593672000 1 -- 172.21.15.175:0/2060194825 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x5620f4d77170 con 0x5620f4e810a0 2024-04-25T09:11:23.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe56ea00640 1 -- 172.21.15.175:0/2060194825 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe574018070 con 0x5620f4e810a0 2024-04-25T09:11:23.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe56ea00640 1 -- 172.21.15.175:0/2060194825 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe57c035080 con 0x5620f4e810a0 2024-04-25T09:11:23.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe593672000 10 client.7626 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:11:23.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe593672000 10 client.7626 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:11:23.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe593672000 20 client.7626 populate_metadata read hostname 'smithi175' 2024-04-25T09:11:23.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe593672000 1 --2- 172.21.15.175:0/2060194825 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5620f4edac80 0x5620f4edd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe593672000 4 client.7626 mds_command: new command op to 7419 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:11:23.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe593672000 1 -- 172.21.15.175:0/2060194825 --> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5620f4c69c60 con 0x5620f4edac80 2024-04-25T09:11:23.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.334+0000 7fe58ce00640 1 --2- 172.21.15.175:0/2060194825 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5620f4edac80 0x5620f4edd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.338+0000 7fe58ce00640 1 --2- 172.21.15.175:0/2060194825 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5620f4edac80 0x5620f4edd070 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbd81b55e28b35 server_cookie=8d2755e3ee551df in_seq=0 out_seq=0 2024-04-25T09:11:23.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.338+0000 7fe56ea00640 10 client.7626 ms_handle_connect on v2:172.21.15.175:6835/1399691338 2024-04-25T09:11:23.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.338+0000 7fe56ea00640 1 -- 172.21.15.175:0/2060194825 <== mds.0 v2:172.21.15.175:6835/1399691338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5620f4c69c60 con 0x5620f4edac80 2024-04-25T09:11:23.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.338+0000 7fe56ea00640 10 client.7626 handle_command_reply: tid=0 2024-04-25T09:11:23.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.338+0000 7fe593672000 1 client.7626 shutdown 2024-04-25T09:11:23.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.338+0000 7fe593672000 1 -- 172.21.15.175:0/2060194825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4e810a0 msgr2=0x5620f4eaf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.338+0000 7fe593672000 1 --2- 172.21.15.175:0/2060194825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4e810a0 0x5620f4eaf7f0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0038d0 tx=0x7fe57c0046d0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.338+0000 7fe593672000 1 -- 172.21.15.175:0/2060194825 shutdown_connections 2024-04-25T09:11:23.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.338+0000 7fe593672000 1 --2- 172.21.15.175:0/2060194825 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5620f4edac80 0x5620f4edd070 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.338+0000 7fe593672000 1 --2- 172.21.15.175:0/2060194825 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4ecb2f0 0x5620f4eb0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.338+0000 7fe593672000 1 --2- 172.21.15.175:0/2060194825 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4eca9d0 0x5620f4eafd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.338+0000 7fe593672000 1 --2- 172.21.15.175:0/2060194825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4e810a0 0x5620f4eaf7f0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.338+0000 7fe56ea00640 0 client.7626 ms_handle_reset on v2:172.21.15.175:6835/1399691338 2024-04-25T09:11:23.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.338+0000 7fe593672000 1 -- 172.21.15.175:0/2060194825 >> 172.21.15.175:0/2060194825 conn(0x5620f4e7d020 msgr2=0x5620f4e7fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.338+0000 7fe593672000 1 -- 172.21.15.175:0/2060194825 shutdown_connections 2024-04-25T09:11:23.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.338+0000 7fe593672000 1 -- 172.21.15.175:0/2060194825 wait complete. 2024-04-25T09:11:23.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.338+0000 7fe593672000 20 client.7626 trim_cache size 0 max 16384 2024-04-25T09:11:23.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.350+0000 7fe593672000 1 Processor -- start 2024-04-25T09:11:23.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.350+0000 7fe593672000 1 -- start start 2024-04-25T09:11:23.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe593672000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4e810a0 0x5620f4ec9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe593672000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4eca9d0 0x5620f4eca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe593672000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4ecb2f0 0x5620f4e80420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe593672000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5882029b0 con 0x5620f4e810a0 2024-04-25T09:11:23.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe593672000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5880b31e0 con 0x5620f4ecb2f0 2024-04-25T09:11:23.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe593672000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58813e570 con 0x5620f4eca9d0 2024-04-25T09:11:23.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe58d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4e810a0 0x5620f4ec9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe58d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4e810a0 0x5620f4ec9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46588/0 (socket says 172.21.15.175:46588) 2024-04-25T09:11:23.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe58d800640 1 -- 172.21.15.175:0/37483162 learned_addr learned my addr 172.21.15.175:0/37483162 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:23.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe58e200640 1 --2- 172.21.15.175:0/37483162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4ecb2f0 0x5620f4e80420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe58ce00640 1 --2- 172.21.15.175:0/37483162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4eca9d0 0x5620f4eca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe58d800640 1 -- 172.21.15.175:0/37483162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4eca9d0 msgr2=0x5620f4eca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe58d800640 1 --2- 172.21.15.175:0/37483162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4eca9d0 0x5620f4eca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe58d800640 1 -- 172.21.15.175:0/37483162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4ecb2f0 msgr2=0x5620f4e80420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe58d800640 1 --2- 172.21.15.175:0/37483162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4ecb2f0 0x5620f4e80420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe58d800640 1 -- 172.21.15.175:0/37483162 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620f4d14de0 con 0x5620f4e810a0 2024-04-25T09:11:23.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe58ce00640 1 --2- 172.21.15.175:0/37483162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4eca9d0 0x5620f4eca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:23.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe58d800640 1 --2- 172.21.15.175:0/37483162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4e810a0 0x5620f4ec9c00 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fe57c011850 tx=0x7fe57c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3151c6ef1d344a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe579600640 1 -- 172.21.15.175:0/37483162 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c027040 con 0x5620f4e810a0 2024-04-25T09:11:23.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe579600640 1 -- 172.21.15.175:0/37483162 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c003d90 con 0x5620f4e810a0 2024-04-25T09:11:23.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe579600640 1 -- 172.21.15.175:0/37483162 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c03d480 con 0x5620f4e810a0 2024-04-25T09:11:23.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe593672000 1 -- 172.21.15.175:0/37483162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4e810a0 msgr2=0x5620f4ec9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe593672000 1 --2- 172.21.15.175:0/37483162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4e810a0 0x5620f4ec9c00 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fe57c011850 tx=0x7fe57c01b000 comp rx=0 tx=0).stop 2024-04-25T09:11:23.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe593672000 1 -- 172.21.15.175:0/37483162 shutdown_connections 2024-04-25T09:11:23.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe593672000 1 --2- 172.21.15.175:0/37483162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4ecb2f0 0x5620f4e80420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe593672000 1 --2- 172.21.15.175:0/37483162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4eca9d0 0x5620f4eca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe593672000 1 --2- 172.21.15.175:0/37483162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4e810a0 0x5620f4ec9c00 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe593672000 1 -- 172.21.15.175:0/37483162 >> 172.21.15.175:0/37483162 conn(0x5620f4e7d020 msgr2=0x5620f4ec90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe593672000 1 -- 172.21.15.175:0/37483162 shutdown_connections 2024-04-25T09:11:23.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe593672000 1 -- 172.21.15.175:0/37483162 wait complete. 2024-04-25T09:11:23.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe593672000 1 -- start start 2024-04-25T09:11:23.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.354+0000 7fe593672000 1 Processor -- start 2024-04-25T09:11:23.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4e810a0 0x5620f4f2b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4eca9d0 0x5620f4f2b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4ecb2f0 0x5620f4edd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620f4c68e00 con 0x5620f4eca9d0 2024-04-25T09:11:23.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5880b2be0 con 0x5620f4e810a0 2024-04-25T09:11:23.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5620f4ccd300 con 0x5620f4ecb2f0 2024-04-25T09:11:23.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 10 client.0 _ll_register_callbacks cb 0x5620f4e4c040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:23.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe58ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4eca9d0 0x5620f4f2b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe58ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4eca9d0 0x5620f4f2b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46602/0 (socket says 172.21.15.175:46602) 2024-04-25T09:11:23.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe58ce00640 1 -- 172.21.15.175:0/2408239964 learned_addr learned my addr 172.21.15.175:0/2408239964 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:23.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe58d800640 1 --2- 172.21.15.175:0/2408239964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4e810a0 0x5620f4f2b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe58e200640 1 --2- 172.21.15.175:0/2408239964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4ecb2f0 0x5620f4edd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe58ce00640 1 -- 172.21.15.175:0/2408239964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4ecb2f0 msgr2=0x5620f4edd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe58ce00640 1 --2- 172.21.15.175:0/2408239964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4ecb2f0 0x5620f4edd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe58ce00640 1 -- 172.21.15.175:0/2408239964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4e810a0 msgr2=0x5620f4f2b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe58ce00640 1 --2- 172.21.15.175:0/2408239964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4e810a0 0x5620f4f2b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe58ce00640 1 -- 172.21.15.175:0/2408239964 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5620f4c6f8e0 con 0x5620f4eca9d0 2024-04-25T09:11:23.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe58e200640 1 --2- 172.21.15.175:0/2408239964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4ecb2f0 0x5620f4edd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:23.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe58ce00640 1 --2- 172.21.15.175:0/2408239964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4eca9d0 0x5620f4f2b850 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fe574005890 tx=0x7fe574000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9661ce6d8655bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe56ea00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:11:23.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe56ea00640 1 -- 172.21.15.175:0/2408239964 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57402b060 con 0x5620f4eca9d0 2024-04-25T09:11:23.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe56ea00640 1 -- 172.21.15.175:0/2408239964 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fe574025240 con 0x5620f4eca9d0 2024-04-25T09:11:23.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 -- 172.21.15.175:0/2408239964 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe57c003d90 con 0x5620f4eca9d0 2024-04-25T09:11:23.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe56ea00640 1 -- 172.21.15.175:0/2408239964 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe574031050 con 0x5620f4eca9d0 2024-04-25T09:11:23.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 10 client.7632 fetch_fsmap learned FSMap version 65 2024-04-25T09:11:23.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 -- 172.21.15.175:0/2408239964 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x5620f4d278f0 con 0x5620f4eca9d0 2024-04-25T09:11:23.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe56ea00640 1 -- 172.21.15.175:0/2408239964 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c003d90 con 0x5620f4eca9d0 2024-04-25T09:11:23.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe56ea00640 1 -- 172.21.15.175:0/2408239964 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe574034020 con 0x5620f4eca9d0 2024-04-25T09:11:23.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 10 client.7632 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:11:23.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 10 client.7632 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:11:23.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 20 client.7632 populate_metadata read hostname 'smithi175' 2024-04-25T09:11:23.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 --2- 172.21.15.175:0/2408239964 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5620f4eddcb0 0x5620f4ede0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 4 client.7632 mds_command: new command op to 7419 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:11:23.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 -- 172.21.15.175:0/2408239964 --> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5620f4cdb530 con 0x5620f4eddcb0 2024-04-25T09:11:23.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe58d800640 1 --2- 172.21.15.175:0/2408239964 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5620f4eddcb0 0x5620f4ede0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe58d800640 1 --2- 172.21.15.175:0/2408239964 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5620f4eddcb0 0x5620f4ede0c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba34abacc715f333 server_cookie=3e78fbed77e41e88 in_seq=0 out_seq=0 2024-04-25T09:11:23.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe56ea00640 10 client.7632 ms_handle_connect on v2:172.21.15.175:6835/1399691338 2024-04-25T09:11:23.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe56ea00640 1 -- 172.21.15.175:0/2408239964 <== mds.0 v2:172.21.15.175:6835/1399691338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5620f4cdb530 con 0x5620f4eddcb0 2024-04-25T09:11:23.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe56ea00640 10 client.7632 handle_command_reply: tid=0 2024-04-25T09:11:23.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 client.7632 shutdown 2024-04-25T09:11:23.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 -- 172.21.15.175:0/2408239964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4eca9d0 msgr2=0x5620f4f2b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 --2- 172.21.15.175:0/2408239964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4eca9d0 0x5620f4f2b850 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fe574005890 tx=0x7fe574000ee0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 -- 172.21.15.175:0/2408239964 shutdown_connections 2024-04-25T09:11:23.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 --2- 172.21.15.175:0/2408239964 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x5620f4eddcb0 0x5620f4ede0c0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 --2- 172.21.15.175:0/2408239964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5620f4ecb2f0 0x5620f4edd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 --2- 172.21.15.175:0/2408239964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5620f4eca9d0 0x5620f4f2b850 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 --2- 172.21.15.175:0/2408239964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5620f4e810a0 0x5620f4f2b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe56ea00640 0 client.7632 ms_handle_reset on v2:172.21.15.175:6835/1399691338 2024-04-25T09:11:23.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 -- 172.21.15.175:0/2408239964 >> 172.21.15.175:0/2408239964 conn(0x5620f4e7d020 msgr2=0x5620f4ec9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 -- 172.21.15.175:0/2408239964 shutdown_connections 2024-04-25T09:11:23.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 1 -- 172.21.15.175:0/2408239964 wait complete. 2024-04-25T09:11:23.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.358+0000 7fe593672000 20 client.7632 trim_cache size 0 max 16384 2024-04-25T09:11:23.354 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:11:23.354 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "no active scrubs running", 2024-04-25T09:11:23.354 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": {} 2024-04-25T09:11:23.354 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:11:23.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.362+0000 7fe590200640 1 -- 172.21.15.175:0/739057666 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe568066f60 msgr2=0x7fe568069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.362+0000 7fe590200640 1 --2- 172.21.15.175:0/739057666 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe568066f60 0x7fe568069420 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009b60 tx=0x7fe57c009190 comp rx=0 tx=0).stop 2024-04-25T09:11:23.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.362+0000 7fe590200640 1 -- 172.21.15.175:0/739057666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5881600a0 msgr2=0x7fe588165cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.362+0000 7fe590200640 1 --2- 172.21.15.175:0/739057666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5881600a0 0x7fe588165cf0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fe58001a4a0 tx=0x7fe580019610 comp rx=0 tx=0).stop 2024-04-25T09:11:23.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.362+0000 7fe590200640 1 -- 172.21.15.175:0/739057666 shutdown_connections 2024-04-25T09:11:23.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.362+0000 7fe590200640 1 --2- 172.21.15.175:0/739057666 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe568066f60 0x7fe568069420 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.362+0000 7fe590200640 1 --2- 172.21.15.175:0/739057666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5881600a0 0x7fe588165cf0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.362+0000 7fe590200640 1 --2- 172.21.15.175:0/739057666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe588145250 0x7fe5880a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.362+0000 7fe590200640 1 --2- 172.21.15.175:0/739057666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5880ce970 0x7fe5880b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.362+0000 7fe590200640 1 -- 172.21.15.175:0/739057666 >> 172.21.15.175:0/739057666 conn(0x7fe58806ac50 msgr2=0x7fe5880b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.362+0000 7fe590200640 1 -- 172.21.15.175:0/739057666 shutdown_connections 2024-04-25T09:11:23.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.362+0000 7fe590200640 1 -- 172.21.15.175:0/739057666 wait complete. 2024-04-25T09:11:23.370 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:11:23.370 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:23.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fcba00640 1 Processor -- start 2024-04-25T09:11:23.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fcba00640 1 -- start start 2024-04-25T09:11:23.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fcba00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc415bc10 0x7f0fc40cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fcba00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0fc409abb0 0x7f0fc40cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fcba00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc40cc4c0 con 0x7f0fc4099a50 2024-04-25T09:11:23.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fcba00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc40d06f0 con 0x7f0fc409abb0 2024-04-25T09:11:23.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fcba00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40cc7a0 con 0x7f0fc415bc10 2024-04-25T09:11:23.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc9000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f0fc4099a50 0x7f0fc4099e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:33518/0 (socket says 172.21.15.175:33518) 2024-04-25T09:11:23.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc9000640 1 -- 172.21.15.175:0/3339698450 learned_addr learned my addr 172.21.15.175:0/3339698450 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:11:23.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc3e00640 1 --2- 172.21.15.175:0/3339698450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc415bc10 0x7f0fc40cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc9a00640 1 --2- 172.21.15.175:0/3339698450 >> v2:172.21.15.177:3300/0 conn(0x7f0fc409abb0 0x7f0fc40cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc3400640 1 -- 172.21.15.175:0/3339698450 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86388533 0 0) 0x7f0fc40cc4c0 con 0x7f0fc4099a50 2024-04-25T09:11:23.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc3400640 1 -- 172.21.15.175:0/3339698450 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fa8003530 con 0x7f0fc4099a50 2024-04-25T09:11:23.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc3400640 1 -- 172.21.15.175:0/3339698450 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3302499374 0 0) 0x7f0fa8003530 con 0x7f0fc4099a50 2024-04-25T09:11:23.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc3400640 1 -- 172.21.15.175:0/3339698450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc415bc10 msgr2=0x7f0fc40cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc3400640 1 --2- 172.21.15.175:0/3339698450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc415bc10 0x7f0fc40cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc3400640 1 -- 172.21.15.175:0/3339698450 >> v2:172.21.15.177:3300/0 conn(0x7f0fc409abb0 msgr2=0x7f0fc40cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc3400640 1 --2- 172.21.15.175:0/3339698450 >> v2:172.21.15.177:3300/0 conn(0x7f0fc409abb0 0x7f0fc40cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc3400640 1 -- 172.21.15.175:0/3339698450 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc40cca80 con 0x7f0fc4099a50 2024-04-25T09:11:23.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc3400640 1 -- 172.21.15.175:0/3339698450 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f0fb4001a00 con 0x7f0fc4099a50 2024-04-25T09:11:23.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc3400640 1 -- 172.21.15.175:0/3339698450 >> v1:172.21.15.175:6789/0 conn(0x7f0fc4099a50 legacy=0x7f0fc4099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc3400640 1 --2- 172.21.15.175:0/3339698450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa80039c0 0x7f0fa8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc3400640 1 --2- 172.21.15.175:0/3339698450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa8004810 0x7f0fa8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc3400640 1 --2- 172.21.15.175:0/3339698450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc415bc10 0x7f0fa80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc3400640 1 -- 172.21.15.175:0/3339698450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40d06f0 con 0x7f0fa80039c0 2024-04-25T09:11:23.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.518+0000 7f0fc3400640 1 -- 172.21.15.175:0/3339698450 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40cc7a0 con 0x7f0fa8004810 2024-04-25T09:11:23.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.522+0000 7f0fc3400640 1 -- 172.21.15.175:0/3339698450 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa800b9d0 con 0x7f0fc415bc10 2024-04-25T09:11:23.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.522+0000 7f0fc9000640 1 --2- 172.21.15.175:0/3339698450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa80039c0 0x7f0fa8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.522+0000 7f0fc9a00640 1 --2- 172.21.15.175:0/3339698450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc415bc10 0x7f0fa80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.522+0000 7f0fc3e00640 1 --2- 172.21.15.175:0/3339698450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa8004810 0x7f0fa8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.522+0000 7f0fc9000640 1 -- 172.21.15.175:0/3339698450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc415bc10 msgr2=0x7f0fa80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.522+0000 7f0fc9000640 1 --2- 172.21.15.175:0/3339698450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc415bc10 0x7f0fa80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.522+0000 7f0fc9000640 1 -- 172.21.15.175:0/3339698450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa8004810 msgr2=0x7f0fa8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.522+0000 7f0fc9000640 1 --2- 172.21.15.175:0/3339698450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fa8004810 0x7f0fa8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.522+0000 7f0fc9000640 1 -- 172.21.15.175:0/3339698450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa8003530 con 0x7f0fa80039c0 2024-04-25T09:11:23.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.522+0000 7f0fc9000640 1 --2- 172.21.15.175:0/3339698450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa80039c0 0x7f0fa8003de0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400a920 tx=0x7f0fb401d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b100b42e066a620c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.522+0000 7f0fc3400640 1 -- 172.21.15.175:0/3339698450 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb400a4c0 con 0x7f0fa80039c0 2024-04-25T09:11:23.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.522+0000 7f0fc3400640 1 -- 172.21.15.175:0/3339698450 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb40ad650 con 0x7f0fa80039c0 2024-04-25T09:11:23.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.522+0000 7f0fc3400640 1 -- 172.21.15.175:0/3339698450 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40ada40 con 0x7f0fa80039c0 2024-04-25T09:11:23.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fcba00640 1 -- 172.21.15.175:0/3339698450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa80039c0 msgr2=0x7f0fa8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fcba00640 1 --2- 172.21.15.175:0/3339698450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa80039c0 0x7f0fa8003de0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f0fb400a920 tx=0x7f0fb401d440 comp rx=0 tx=0).stop 2024-04-25T09:11:23.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fc9a00640 1 -- 172.21.15.175:0/3339698450 reap_dead start 2024-04-25T09:11:23.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fcba00640 1 -- 172.21.15.175:0/3339698450 shutdown_connections 2024-04-25T09:11:23.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fcba00640 1 -- 172.21.15.175:0/3339698450 >> 172.21.15.175:0/3339698450 conn(0x7f0fc40b3300 msgr2=0x7f0fc40b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fcba00640 1 -- 172.21.15.175:0/3339698450 shutdown_connections 2024-04-25T09:11:23.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fcba00640 1 -- 172.21.15.175:0/3339698450 wait complete. 2024-04-25T09:11:23.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fcba00640 1 Processor -- start 2024-04-25T09:11:23.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fcba00640 1 -- start start 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fcba00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa80039c0 0x7f0fc415a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fcba00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fc40c88e0 0x7f0fc4161650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fcba00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc4161b90 0x7f0fc415c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fcba00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40c5cf0 con 0x7f0fa80039c0 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fcba00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40c5b70 con 0x7f0fc40c88e0 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fcba00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc40c5e70 con 0x7f0fc4161b90 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fc9000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa80039c0 0x7f0fc415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fc9000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa80039c0 0x7f0fc415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46622/0 (socket says 172.21.15.175:46622) 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fc9000640 1 -- 172.21.15.175:0/1793776831 learned_addr learned my addr 172.21.15.175:0/1793776831 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fc3e00640 1 --2- 172.21.15.175:0/1793776831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fc40c88e0 0x7f0fc4161650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fc9a00640 1 --2- 172.21.15.175:0/1793776831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc4161b90 0x7f0fc415c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fc9000640 1 -- 172.21.15.175:0/1793776831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc4161b90 msgr2=0x7f0fc415c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fc9000640 1 --2- 172.21.15.175:0/1793776831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc4161b90 0x7f0fc415c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fc9000640 1 -- 172.21.15.175:0/1793776831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fc40c88e0 msgr2=0x7f0fc4161650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fc9000640 1 --2- 172.21.15.175:0/1793776831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fc40c88e0 0x7f0fc4161650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.526+0000 7f0fc9000640 1 -- 172.21.15.175:0/1793776831 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc415a940 con 0x7f0fa80039c0 2024-04-25T09:11:23.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.530+0000 7f0fc9000640 1 --2- 172.21.15.175:0/1793776831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa80039c0 0x7f0fc415a400 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4000f90 tx=0x7f0fa8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.530+0000 7f0fc0c00640 1 -- 172.21.15.175:0/1793776831 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40b2040 con 0x7f0fa80039c0 2024-04-25T09:11:23.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.530+0000 7f0fc0c00640 1 -- 172.21.15.175:0/1793776831 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb40ad800 con 0x7f0fa80039c0 2024-04-25T09:11:23.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.530+0000 7f0fcba00640 1 -- 172.21.15.175:0/1793776831 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc415cd90 con 0x7f0fa80039c0 2024-04-25T09:11:23.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.530+0000 7f0fc0c00640 1 -- 172.21.15.175:0/1793776831 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40017c0 con 0x7f0fa80039c0 2024-04-25T09:11:23.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.530+0000 7f0fcba00640 1 -- 172.21.15.175:0/1793776831 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc415d850 con 0x7f0fa80039c0 2024-04-25T09:11:23.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.530+0000 7f0fcba00640 1 -- 172.21.15.175:0/1793776831 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc4074a60 con 0x7f0fa80039c0 2024-04-25T09:11:23.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.530+0000 7f0fc0c00640 1 -- 172.21.15.175:0/1793776831 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0fb40be020 con 0x7f0fa80039c0 2024-04-25T09:11:23.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.530+0000 7f0fc0c00640 1 --2- 172.21.15.175:0/1793776831 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0fa4066f90 0x7f0fa4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.530+0000 7f0fc0c00640 1 -- 172.21.15.175:0/1793776831 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f0fb411f350 con 0x7f0fa80039c0 2024-04-25T09:11:23.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.530+0000 7f0fc3e00640 1 --2- 172.21.15.175:0/1793776831 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0fa4066f90 0x7f0fa4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.530+0000 7f0fc3e00640 1 --2- 172.21.15.175:0/1793776831 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0fa4066f90 0x7f0fa4069450 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40c8d00 tx=0x7f0fb0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.534+0000 7f0fc0c00640 1 -- 172.21.15.175:0/1793776831 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0fb40c5020 con 0x7f0fa80039c0 2024-04-25T09:11:23.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.722+0000 7f0fcba00640 1 -- 172.21.15.175:0/1793776831 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fc40b4060 con 0x7f0fa80039c0 2024-04-25T09:11:23.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.722+0000 7f0fc0c00640 1 -- 172.21.15.175:0/1793776831 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f0fb4017150 con 0x7f0fa80039c0 2024-04-25T09:11:23.712 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:11:23.712 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3229536012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3229536012},{"type":"v1","addr":"172.21.15.177:6834","nonce":3229536012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/222649735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":222649735},{"type":"v1","addr":"172.21.15.177:6835","nonce":222649735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2888989442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2888989442},{"type":"v1","addr":"172.21.15.175:6836","nonce":2888989442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:03.786939+0000","modified":"2024-04-25T09:10:25.509619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7419":{"gid":7419,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6837/1399691338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1399691338},{"type":"v1","addr":"172.21.15.175:6837","nonce":1399691338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:11:23.712 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 65 2024-04-25T09:11:23.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.722+0000 7f0fcba00640 1 -- 172.21.15.175:0/1793776831 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0fa4066f90 msgr2=0x7f0fa4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.722+0000 7f0fcba00640 1 --2- 172.21.15.175:0/1793776831 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0fa4066f90 0x7f0fa4069450 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40c8d00 tx=0x7f0fb0009190 comp rx=0 tx=0).stop 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.722+0000 7f0fcba00640 1 -- 172.21.15.175:0/1793776831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa80039c0 msgr2=0x7f0fc415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.722+0000 7f0fcba00640 1 --2- 172.21.15.175:0/1793776831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa80039c0 0x7f0fc415a400 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f0fb4000f90 tx=0x7f0fa8005840 comp rx=0 tx=0).stop 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.722+0000 7f0fcba00640 1 -- 172.21.15.175:0/1793776831 shutdown_connections 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.722+0000 7f0fcba00640 1 --2- 172.21.15.175:0/1793776831 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0fa4066f90 0x7f0fa4069450 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.722+0000 7f0fcba00640 1 --2- 172.21.15.175:0/1793776831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0fc4161b90 0x7f0fc415c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.722+0000 7f0fcba00640 1 --2- 172.21.15.175:0/1793776831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0fc40c88e0 0x7f0fc4161650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.722+0000 7f0fcba00640 1 --2- 172.21.15.175:0/1793776831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fa80039c0 0x7f0fc415a400 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.722+0000 7f0fcba00640 1 -- 172.21.15.175:0/1793776831 >> 172.21.15.175:0/1793776831 conn(0x7f0fc40b3300 msgr2=0x7f0fc4070af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.722+0000 7f0fcba00640 1 -- 172.21.15.175:0/1793776831 shutdown_connections 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.722+0000 7f0fcba00640 1 -- 172.21.15.175:0/1793776831 wait complete. 2024-04-25T09:11:23.734 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-25T09:11:23.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.882+0000 7fd14bc00640 1 Processor -- start 2024-04-25T09:11:23.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.882+0000 7fd14bc00640 1 -- start start 2024-04-25T09:11:23.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.882+0000 7fd14bc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd14415af20 0x7fd1440b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.882+0000 7fd14bc00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd1440b4630 0x7fd14415c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.882+0000 7fd14bc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd14406db60 con 0x7fd1440cbe60 2024-04-25T09:11:23.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.882+0000 7fd14bc00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14406de40 con 0x7fd1440b4630 2024-04-25T09:11:23.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.882+0000 7fd14bc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14406e120 con 0x7fd14415af20 2024-04-25T09:11:23.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.882+0000 7fd149c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd1440b4630 0x7fd14415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.882+0000 7fd143e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd14415af20 0x7fd1440b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.882+0000 7fd149c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd1440b4630 0x7fd14415c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:58810/0 (socket says 172.21.15.175:58810) 2024-04-25T09:11:23.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.882+0000 7fd149c00640 1 -- 172.21.15.175:0/3088978557 learned_addr learned my addr 172.21.15.175:0/3088978557 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:23.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.882+0000 7fd143e00640 1 -- 172.21.15.175:0/3088978557 >> v2:172.21.15.177:3300/0 conn(0x7fd1440b4630 msgr2=0x7fd14415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.882+0000 7fd143e00640 1 --2- 172.21.15.175:0/3088978557 >> v2:172.21.15.177:3300/0 conn(0x7fd1440b4630 0x7fd14415c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.882+0000 7fd143e00640 1 -- 172.21.15.175:0/3088978557 >> v1:172.21.15.177:6789/0 conn(0x7fd1440cbe60 legacy=0x7fd14406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.882+0000 7fd143e00640 1 -- 172.21.15.175:0/3088978557 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14415c2f0 con 0x7fd14415af20 2024-04-25T09:11:23.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.886+0000 7fd143e00640 1 --2- 172.21.15.175:0/3088978557 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd14415af20 0x7fd1440b40f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd1300097c0 tx=0x7fd13001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc760f3203ea5cab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.886+0000 7fd143400640 1 -- 172.21.15.175:0/3088978557 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1300b0070 con 0x7fd14415af20 2024-04-25T09:11:23.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.886+0000 7fd143400640 1 -- 172.21.15.175:0/3088978557 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1300ab600 con 0x7fd14415af20 2024-04-25T09:11:23.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.886+0000 7fd143400640 1 -- 172.21.15.175:0/3088978557 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1300ab9d0 con 0x7fd14415af20 2024-04-25T09:11:23.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.886+0000 7fd14bc00640 1 -- 172.21.15.175:0/3088978557 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd14415af20 msgr2=0x7fd1440b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.886+0000 7fd14bc00640 1 --2- 172.21.15.175:0/3088978557 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd14415af20 0x7fd1440b40f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd1300097c0 tx=0x7fd13001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.886+0000 7fd14bc00640 1 -- 172.21.15.175:0/3088978557 shutdown_connections 2024-04-25T09:11:23.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.886+0000 7fd14bc00640 1 --2- 172.21.15.175:0/3088978557 >> v2:172.21.15.177:3300/0 conn(0x7fd1440b4630 0x7fd14415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.886+0000 7fd14bc00640 1 --2- 172.21.15.175:0/3088978557 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd14415af20 0x7fd1440b40f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.886+0000 7fd14bc00640 1 -- 172.21.15.175:0/3088978557 >> 172.21.15.175:0/3088978557 conn(0x7fd14406ac50 msgr2=0x7fd14406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.886+0000 7fd14bc00640 1 -- 172.21.15.175:0/3088978557 shutdown_connections 2024-04-25T09:11:23.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.886+0000 7fd14bc00640 1 -- 172.21.15.175:0/3088978557 wait complete. 2024-04-25T09:11:23.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd14bc00640 1 Processor -- start 2024-04-25T09:11:23.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd14bc00640 1 -- start start 2024-04-25T09:11:23.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd14bc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1440b4630 0x7fd1440ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd14bc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1440cbe60 0x7fd144138820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd14bc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd14415af20 0x7fd1440b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd14bc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14415d970 con 0x7fd14415af20 2024-04-25T09:11:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd14bc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14415d7f0 con 0x7fd1440cbe60 2024-04-25T09:11:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd14bc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14415daf0 con 0x7fd1440b4630 2024-04-25T09:11:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd149c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd14415af20 0x7fd1440b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd149c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd14415af20 0x7fd1440b0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46626/0 (socket says 172.21.15.175:46626) 2024-04-25T09:11:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd149c00640 1 -- 172.21.15.175:0/811489588 learned_addr learned my addr 172.21.15.175:0/811489588 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd143e00640 1 --2- 172.21.15.175:0/811489588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1440cbe60 0x7fd144138820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd149200640 1 --2- 172.21.15.175:0/811489588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1440b4630 0x7fd1440ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd149c00640 1 -- 172.21.15.175:0/811489588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1440b4630 msgr2=0x7fd1440ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd149c00640 1 --2- 172.21.15.175:0/811489588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1440b4630 0x7fd1440ae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd149c00640 1 -- 172.21.15.175:0/811489588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1440cbe60 msgr2=0x7fd144138820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd149c00640 1 --2- 172.21.15.175:0/811489588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1440cbe60 0x7fd144138820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd149c00640 1 -- 172.21.15.175:0/811489588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1440ae880 con 0x7fd14415af20 2024-04-25T09:11:23.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd149c00640 1 --2- 172.21.15.175:0/811489588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd14415af20 0x7fd1440b0450 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00e7f0 tx=0x7fd13c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd140c00640 1 -- 172.21.15.175:0/811489588 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c017070 con 0x7fd14415af20 2024-04-25T09:11:23.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd140c00640 1 -- 172.21.15.175:0/811489588 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13c00c940 con 0x7fd14415af20 2024-04-25T09:11:23.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd14bc00640 1 -- 172.21.15.175:0/811489588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1440ad9b0 con 0x7fd14415af20 2024-04-25T09:11:23.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd140c00640 1 -- 172.21.15.175:0/811489588 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c00eea0 con 0x7fd14415af20 2024-04-25T09:11:23.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.890+0000 7fd14bc00640 1 -- 172.21.15.175:0/811489588 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1440ad110 con 0x7fd14415af20 2024-04-25T09:11:23.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.894+0000 7fd140c00640 1 -- 172.21.15.175:0/811489588 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd13c01a070 con 0x7fd14415af20 2024-04-25T09:11:23.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.894+0000 7fd140c00640 1 --2- 172.21.15.175:0/811489588 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd124066f90 0x7fd124069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.894+0000 7fd140c00640 1 -- 172.21.15.175:0/811489588 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fd13c084e70 con 0x7fd14415af20 2024-04-25T09:11:23.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.894+0000 7fd149200640 1 --2- 172.21.15.175:0/811489588 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd124066f90 0x7fd124069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.894+0000 7fd14f10a000 1 Processor -- start 2024-04-25T09:11:23.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.894+0000 7fd14f10a000 1 -- start start 2024-04-25T09:11:23.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.894+0000 7fd149200640 1 --2- 172.21.15.175:0/811489588 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd124066f90 0x7fd124069450 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd134001e00 tx=0x7fd134009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.894+0000 7fd14f10a000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c952e0 0x55e397c956c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.894+0000 7fd14f10a000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c95c00 0x55e397c4b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.894+0000 7fd14f10a000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c4b8e0 0x55e397c4bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.894+0000 7fd14f10a000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e397b32ba0 con 0x55e397c95c00 2024-04-25T09:11:23.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.894+0000 7fd14f10a000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e397a98090 con 0x55e397c4b8e0 2024-04-25T09:11:23.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.894+0000 7fd14f10a000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e397a20160 con 0x55e397c952e0 2024-04-25T09:11:23.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.894+0000 7fd143e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c95c00 0x55e397c4b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd143e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c95c00 0x55e397c4b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46636/0 (socket says 172.21.15.175:46636) 2024-04-25T09:11:23.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd143e00640 1 -- 172.21.15.175:0/2828628430 learned_addr learned my addr 172.21.15.175:0/2828628430 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:23.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd143e00640 1 -- 172.21.15.175:0/2828628430 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c952e0 msgr2=0x55e397c956c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd143e00640 1 --2- 172.21.15.175:0/2828628430 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c952e0 0x55e397c956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd143e00640 1 -- 172.21.15.175:0/2828628430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c4b8e0 msgr2=0x55e397c4bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd143e00640 1 --2- 172.21.15.175:0/2828628430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c4b8e0 0x55e397c4bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd143e00640 1 -- 172.21.15.175:0/2828628430 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e397b41c20 con 0x55e397c95c00 2024-04-25T09:11:23.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd143e00640 1 --2- 172.21.15.175:0/2828628430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c95c00 0x55e397c4b3a0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fd1300ae040 tx=0x7fd1300a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e344fa7dfe229dae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd139600640 1 -- 172.21.15.175:0/2828628430 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1300b0040 con 0x55e397c95c00 2024-04-25T09:11:23.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd139600640 1 -- 172.21.15.175:0/2828628430 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1300ab6c0 con 0x55e397c95c00 2024-04-25T09:11:23.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd139600640 1 -- 172.21.15.175:0/2828628430 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1300abad0 con 0x55e397c95c00 2024-04-25T09:11:23.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd14f10a000 1 -- 172.21.15.175:0/2828628430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c95c00 msgr2=0x55e397c4b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd14f10a000 1 --2- 172.21.15.175:0/2828628430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c95c00 0x55e397c4b3a0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fd1300ae040 tx=0x7fd1300a6000 comp rx=0 tx=0).stop 2024-04-25T09:11:23.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd14f10a000 1 -- 172.21.15.175:0/2828628430 shutdown_connections 2024-04-25T09:11:23.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd14f10a000 1 --2- 172.21.15.175:0/2828628430 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c4b8e0 0x55e397c4bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd14f10a000 1 --2- 172.21.15.175:0/2828628430 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c95c00 0x55e397c4b3a0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd14f10a000 1 --2- 172.21.15.175:0/2828628430 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c952e0 0x55e397c956c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd14f10a000 1 -- 172.21.15.175:0/2828628430 >> 172.21.15.175:0/2828628430 conn(0x55e397c47890 msgr2=0x55e397c49c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd14f10a000 1 -- 172.21.15.175:0/2828628430 shutdown_connections 2024-04-25T09:11:23.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd14f10a000 1 -- 172.21.15.175:0/2828628430 wait complete. 2024-04-25T09:11:23.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd14f10a000 1 -- start start 2024-04-25T09:11:23.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd14f10a000 1 Processor -- start 2024-04-25T09:11:23.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd14f10a000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c4b8e0 0x55e397c9c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd14f10a000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c952e0 0x55e397c9cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd14f10a000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c95c00 0x55e397c83090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd14f10a000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e397a94130 con 0x55e397c95c00 2024-04-25T09:11:23.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd14f10a000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e397a5c130 con 0x55e397c4b8e0 2024-04-25T09:11:23.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd14f10a000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e397b56300 con 0x55e397c952e0 2024-04-25T09:11:23.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd14f10a000 10 client.0 _ll_register_callbacks cb 0x55e397c36bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:23.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd149c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c95c00 0x55e397c83090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd149c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c95c00 0x55e397c83090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46642/0 (socket says 172.21.15.175:46642) 2024-04-25T09:11:23.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd149c00640 1 -- 172.21.15.175:0/539205259 learned_addr learned my addr 172.21.15.175:0/539205259 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:23.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd149200640 1 --2- 172.21.15.175:0/539205259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c4b8e0 0x55e397c9c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.898+0000 7fd143e00640 1 --2- 172.21.15.175:0/539205259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c952e0 0x55e397c9cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd149c00640 1 -- 172.21.15.175:0/539205259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c952e0 msgr2=0x55e397c9cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd149c00640 1 --2- 172.21.15.175:0/539205259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c952e0 0x55e397c9cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd149c00640 1 -- 172.21.15.175:0/539205259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c4b8e0 msgr2=0x55e397c9c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd149c00640 1 --2- 172.21.15.175:0/539205259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c4b8e0 0x55e397c9c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd149c00640 1 -- 172.21.15.175:0/539205259 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e397a75060 con 0x55e397c95c00 2024-04-25T09:11:23.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd149c00640 1 --2- 172.21.15.175:0/539205259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c95c00 0x55e397c83090 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fd13c051c30 tx=0x7fd13c055910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4712e6d537970812 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd12e000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:11:23.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd12e000640 1 -- 172.21.15.175:0/539205259 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c06d020 con 0x55e397c95c00 2024-04-25T09:11:23.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd12e000640 1 -- 172.21.15.175:0/539205259 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fd13c00cd50 con 0x55e397c95c00 2024-04-25T09:11:23.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 1 -- 172.21.15.175:0/539205259 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd1300ab6c0 con 0x55e397c95c00 2024-04-25T09:11:23.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd12e000640 1 -- 172.21.15.175:0/539205259 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd13c021070 con 0x55e397c95c00 2024-04-25T09:11:23.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 10 client.7647 fetch_fsmap learned FSMap version 65 2024-04-25T09:11:23.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 1 -- 172.21.15.175:0/539205259 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x55e397a397c0 con 0x55e397c95c00 2024-04-25T09:11:23.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd12e000640 1 -- 172.21.15.175:0/539205259 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1300ab6c0 con 0x55e397c95c00 2024-04-25T09:11:23.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd12e000640 1 -- 172.21.15.175:0/539205259 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd13c024060 con 0x55e397c95c00 2024-04-25T09:11:23.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 10 client.7647 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:11:23.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 10 client.7647 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:11:23.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 20 client.7647 populate_metadata read hostname 'smithi175' 2024-04-25T09:11:23.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 1 --2- 172.21.15.175:0/539205259 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55e397c83e30 0x55e397c84210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 4 client.7647 mds_command: new command op to 7419 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:11:23.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 1 -- 172.21.15.175:0/539205259 --> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e397a33cd0 con 0x55e397c83e30 2024-04-25T09:11:23.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd149200640 1 --2- 172.21.15.175:0/539205259 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55e397c83e30 0x55e397c84210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd149200640 1 --2- 172.21.15.175:0/539205259 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55e397c83e30 0x55e397c84210 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71ce237ae1bfef89 server_cookie=3483ad710fd1aed4 in_seq=0 out_seq=0 2024-04-25T09:11:23.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd12e000640 10 client.7647 ms_handle_connect on v2:172.21.15.175:6835/1399691338 2024-04-25T09:11:23.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd12e000640 1 -- 172.21.15.175:0/539205259 <== mds.0 v2:172.21.15.175:6835/1399691338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e397a33cd0 con 0x55e397c83e30 2024-04-25T09:11:23.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd12e000640 10 client.7647 handle_command_reply: tid=0 2024-04-25T09:11:23.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 1 client.7647 shutdown 2024-04-25T09:11:23.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 1 -- 172.21.15.175:0/539205259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c95c00 msgr2=0x55e397c83090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 1 --2- 172.21.15.175:0/539205259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c95c00 0x55e397c83090 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fd13c051c30 tx=0x7fd13c055910 comp rx=0 tx=0).stop 2024-04-25T09:11:23.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 1 -- 172.21.15.175:0/539205259 shutdown_connections 2024-04-25T09:11:23.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 1 --2- 172.21.15.175:0/539205259 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55e397c83e30 0x55e397c84210 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 1 --2- 172.21.15.175:0/539205259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c95c00 0x55e397c83090 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 1 --2- 172.21.15.175:0/539205259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c952e0 0x55e397c9cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 1 --2- 172.21.15.175:0/539205259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c4b8e0 0x55e397c9c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 1 -- 172.21.15.175:0/539205259 >> 172.21.15.175:0/539205259 conn(0x55e397c47890 msgr2=0x55e397c4a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd12e000640 0 client.7647 ms_handle_reset on v2:172.21.15.175:6835/1399691338 2024-04-25T09:11:23.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 1 -- 172.21.15.175:0/539205259 shutdown_connections 2024-04-25T09:11:23.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 1 -- 172.21.15.175:0/539205259 wait complete. 2024-04-25T09:11:23.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.902+0000 7fd14f10a000 20 client.7647 trim_cache size 0 max 16384 2024-04-25T09:11:23.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.914+0000 7fd14f10a000 1 Processor -- start 2024-04-25T09:11:23.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.914+0000 7fd14f10a000 1 -- start start 2024-04-25T09:11:23.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c4b8e0 0x55e397c821f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c952e0 0x55e397c82730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c95c00 0x55e397c49c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd144201f40 con 0x55e397c4b8e0 2024-04-25T09:11:23.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd144139e00 con 0x55e397c95c00 2024-04-25T09:11:23.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14413a3d0 con 0x55e397c952e0 2024-04-25T09:11:23.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd149200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c4b8e0 0x55e397c821f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd149200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c4b8e0 0x55e397c821f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46644/0 (socket says 172.21.15.175:46644) 2024-04-25T09:11:23.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd149200640 1 -- 172.21.15.175:0/4080000142 learned_addr learned my addr 172.21.15.175:0/4080000142 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:23.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd143e00640 1 --2- 172.21.15.175:0/4080000142 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c952e0 0x55e397c82730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd149c00640 1 --2- 172.21.15.175:0/4080000142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c95c00 0x55e397c49c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd149200640 1 -- 172.21.15.175:0/4080000142 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c952e0 msgr2=0x55e397c82730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd149200640 1 --2- 172.21.15.175:0/4080000142 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c952e0 0x55e397c82730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd149200640 1 -- 172.21.15.175:0/4080000142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c95c00 msgr2=0x55e397c49c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd149200640 1 --2- 172.21.15.175:0/4080000142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c95c00 0x55e397c49c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd149200640 1 -- 172.21.15.175:0/4080000142 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e397a53fc0 con 0x55e397c4b8e0 2024-04-25T09:11:23.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd149200640 1 --2- 172.21.15.175:0/4080000142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c4b8e0 0x55e397c821f0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fd13400f660 tx=0x7fd134012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b20c8fd1e542f42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd138c00640 1 -- 172.21.15.175:0/4080000142 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd134029030 con 0x55e397c4b8e0 2024-04-25T09:11:23.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd138c00640 1 -- 172.21.15.175:0/4080000142 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd134024420 con 0x55e397c4b8e0 2024-04-25T09:11:23.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd138c00640 1 -- 172.21.15.175:0/4080000142 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1340245d0 con 0x55e397c4b8e0 2024-04-25T09:11:23.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 -- 172.21.15.175:0/4080000142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c4b8e0 msgr2=0x55e397c821f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 --2- 172.21.15.175:0/4080000142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c4b8e0 0x55e397c821f0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fd13400f660 tx=0x7fd134012000 comp rx=0 tx=0).stop 2024-04-25T09:11:23.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 -- 172.21.15.175:0/4080000142 shutdown_connections 2024-04-25T09:11:23.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 --2- 172.21.15.175:0/4080000142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c95c00 0x55e397c49c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 --2- 172.21.15.175:0/4080000142 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c952e0 0x55e397c82730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 --2- 172.21.15.175:0/4080000142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c4b8e0 0x55e397c821f0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 -- 172.21.15.175:0/4080000142 >> 172.21.15.175:0/4080000142 conn(0x55e397c47890 msgr2=0x55e397ca2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 -- 172.21.15.175:0/4080000142 shutdown_connections 2024-04-25T09:11:23.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 -- 172.21.15.175:0/4080000142 wait complete. 2024-04-25T09:11:23.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 -- start start 2024-04-25T09:11:23.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 Processor -- start 2024-04-25T09:11:23.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c4b8e0 0x55e397cf4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c952e0 0x55e397cf5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c95c00 0x55e397c99040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e397a32e70 con 0x55e397c952e0 2024-04-25T09:11:23.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e397a20a50 con 0x55e397c4b8e0 2024-04-25T09:11:23.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e397a973a0 con 0x55e397c95c00 2024-04-25T09:11:23.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.918+0000 7fd14f10a000 10 client.0 _ll_register_callbacks cb 0x55e397a44240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:23.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd143e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c952e0 0x55e397cf5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd143e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c952e0 0x55e397cf5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46648/0 (socket says 172.21.15.175:46648) 2024-04-25T09:11:23.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd143e00640 1 -- 172.21.15.175:0/3638492387 learned_addr learned my addr 172.21.15.175:0/3638492387 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:23.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd149200640 1 --2- 172.21.15.175:0/3638492387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c4b8e0 0x55e397cf4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd149c00640 1 --2- 172.21.15.175:0/3638492387 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c95c00 0x55e397c99040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd143e00640 1 -- 172.21.15.175:0/3638492387 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c95c00 msgr2=0x55e397c99040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd143e00640 1 --2- 172.21.15.175:0/3638492387 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c95c00 0x55e397c99040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd143e00640 1 -- 172.21.15.175:0/3638492387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c4b8e0 msgr2=0x55e397cf4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd143e00640 1 --2- 172.21.15.175:0/3638492387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c4b8e0 0x55e397cf4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd143e00640 1 -- 172.21.15.175:0/3638492387 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e397af19e0 con 0x55e397c952e0 2024-04-25T09:11:23.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd143e00640 1 --2- 172.21.15.175:0/3638492387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c952e0 0x55e397cf5280 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fd13001ab50 tx=0x7fd13001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3740561864a8288e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd12e000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:11:23.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd12e000640 1 -- 172.21.15.175:0/3638492387 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1300b0070 con 0x55e397c952e0 2024-04-25T09:11:23.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd12e000640 1 -- 172.21.15.175:0/3638492387 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fd1300ab800 con 0x55e397c952e0 2024-04-25T09:11:23.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 1 -- 172.21.15.175:0/3638492387 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd134024420 con 0x55e397c952e0 2024-04-25T09:11:23.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd12e000640 1 -- 172.21.15.175:0/3638492387 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1300aba00 con 0x55e397c952e0 2024-04-25T09:11:23.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 10 client.7653 fetch_fsmap learned FSMap version 65 2024-04-25T09:11:23.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 1 -- 172.21.15.175:0/3638492387 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x55e397a37630 con 0x55e397c952e0 2024-04-25T09:11:23.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd12e000640 1 -- 172.21.15.175:0/3638492387 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd134024420 con 0x55e397c952e0 2024-04-25T09:11:23.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd12e000640 1 -- 172.21.15.175:0/3638492387 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd1300abba0 con 0x55e397c952e0 2024-04-25T09:11:23.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 10 client.7653 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:11:23.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 10 client.7653 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:11:23.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 20 client.7653 populate_metadata read hostname 'smithi175' 2024-04-25T09:11:23.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 1 --2- 172.21.15.175:0/3638492387 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55e397c99970 0x55e397c99d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 4 client.7653 mds_command: new command op to 7419 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:11:23.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 1 -- 172.21.15.175:0/3638492387 --> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x55e397aa55d0 con 0x55e397c99970 2024-04-25T09:11:23.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd149200640 1 --2- 172.21.15.175:0/3638492387 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55e397c99970 0x55e397c99d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd149200640 1 --2- 172.21.15.175:0/3638492387 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55e397c99970 0x55e397c99d50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a13aa2a19c452c8 server_cookie=e052badcad8c9179 in_seq=0 out_seq=0 2024-04-25T09:11:23.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd12e000640 10 client.7653 ms_handle_connect on v2:172.21.15.175:6835/1399691338 2024-04-25T09:11:23.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd12e000640 1 -- 172.21.15.175:0/3638492387 <== mds.0 v2:172.21.15.175:6835/1399691338 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+144 (crc 0 0 0) 0x55e397aa55d0 con 0x55e397c99970 2024-04-25T09:11:23.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd12e000640 10 client.7653 handle_command_reply: tid=0 2024-04-25T09:11:23.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 1 client.7653 shutdown 2024-04-25T09:11:23.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 1 -- 172.21.15.175:0/3638492387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c952e0 msgr2=0x55e397cf5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 1 --2- 172.21.15.175:0/3638492387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c952e0 0x55e397cf5280 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fd13001ab50 tx=0x7fd13001ace0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 1 -- 172.21.15.175:0/3638492387 shutdown_connections 2024-04-25T09:11:23.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 1 --2- 172.21.15.175:0/3638492387 >> [v2:172.21.15.175:6835/1399691338,v1:172.21.15.175:6837/1399691338] conn(0x55e397c99970 0x55e397c99d50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 1 --2- 172.21.15.175:0/3638492387 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e397c95c00 0x55e397c99040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 1 --2- 172.21.15.175:0/3638492387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e397c952e0 0x55e397cf5280 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 1 --2- 172.21.15.175:0/3638492387 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e397c4b8e0 0x55e397cf4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 1 -- 172.21.15.175:0/3638492387 >> 172.21.15.175:0/3638492387 conn(0x55e397c47890 msgr2=0x55e397ca2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd12e000640 0 client.7653 ms_handle_reset on v2:172.21.15.175:6835/1399691338 2024-04-25T09:11:23.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 1 -- 172.21.15.175:0/3638492387 shutdown_connections 2024-04-25T09:11:23.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 1 -- 172.21.15.175:0/3638492387 wait complete. 2024-04-25T09:11:23.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14f10a000 20 client.7653 trim_cache size 0 max 16384 2024-04-25T09:11:23.917 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:11:23.917 INFO:teuthology.orchestra.run.smithi175.stdout:[ 2024-04-25T09:11:23.917 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:11:23.917 INFO:teuthology.orchestra.run.smithi175.stdout: "damage_type": "backtrace", 2024-04-25T09:11:23.917 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 3650189667, 2024-04-25T09:11:23.917 INFO:teuthology.orchestra.run.smithi175.stdout: "ino": 1099511627777, 2024-04-25T09:11:23.917 INFO:teuthology.orchestra.run.smithi175.stdout: "path": "/testdir/hardlink" 2024-04-25T09:11:23.917 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:11:23.917 INFO:teuthology.orchestra.run.smithi175.stdout:] 2024-04-25T09:11:23.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14bc00640 1 -- 172.21.15.175:0/811489588 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd124066f90 msgr2=0x7fd124069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14bc00640 1 --2- 172.21.15.175:0/811489588 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd124066f90 0x7fd124069450 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd134001e00 tx=0x7fd134009040 comp rx=0 tx=0).stop 2024-04-25T09:11:23.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14bc00640 1 -- 172.21.15.175:0/811489588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd14415af20 msgr2=0x7fd1440b0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.922+0000 7fd14bc00640 1 --2- 172.21.15.175:0/811489588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd14415af20 0x7fd1440b0450 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00e7f0 tx=0x7fd13c00ecb0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.926+0000 7fd14bc00640 1 -- 172.21.15.175:0/811489588 shutdown_connections 2024-04-25T09:11:23.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.926+0000 7fd14bc00640 1 --2- 172.21.15.175:0/811489588 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd124066f90 0x7fd124069450 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.926+0000 7fd14bc00640 1 --2- 172.21.15.175:0/811489588 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd14415af20 0x7fd1440b0450 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.926+0000 7fd14bc00640 1 --2- 172.21.15.175:0/811489588 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1440cbe60 0x7fd144138820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.926+0000 7fd14bc00640 1 --2- 172.21.15.175:0/811489588 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1440b4630 0x7fd1440ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.926+0000 7fd14bc00640 1 -- 172.21.15.175:0/811489588 >> 172.21.15.175:0/811489588 conn(0x7fd14406ac50 msgr2=0x7fd1440ce550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.926+0000 7fd14bc00640 1 -- 172.21.15.175:0/811489588 shutdown_connections 2024-04-25T09:11:23.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:23.926+0000 7fd14bc00640 1 -- 172.21.15.175:0/811489588 wait complete. 2024-04-25T09:11:23.934 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:11:23.934 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:23.942 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:11:23.942 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:23.994 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:24.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.186+0000 7f8c54a00640 1 Processor -- start 2024-04-25T09:11:24.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.186+0000 7f8c54a00640 1 -- start start 2024-04-25T09:11:24.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.186+0000 7f8c54a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8c5015a900 0x7f8c5006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.186+0000 7f8c54a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c500cf560 0x7f8c500cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.186+0000 7f8c54a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c500cda00 con 0x7f8c500cd520 2024-04-25T09:11:24.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.186+0000 7f8c54a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c5015bcf0 con 0x7f8c5015a900 2024-04-25T09:11:24.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.186+0000 7f8c54a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c500cfef0 con 0x7f8c500cf560 2024-04-25T09:11:24.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.186+0000 7f8c45400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f8c500cd520 0x7f8c500ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:33520/0 (socket says 172.21.15.175:33520) 2024-04-25T09:11:24.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.186+0000 7f8c45400640 1 -- 172.21.15.175:0/2716502518 learned_addr learned my addr 172.21.15.175:0/2716502518 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:11:24.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.186+0000 7f8c4e800640 1 --2- 172.21.15.175:0/2716502518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c500cf560 0x7f8c500cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.186+0000 7f8c4de00640 1 --2- 172.21.15.175:0/2716502518 >> v2:172.21.15.177:3300/0 conn(0x7f8c5015a900 0x7f8c5006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.190+0000 7f8c4d400640 1 -- 172.21.15.175:0/2716502518 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759118883 0 0) 0x7f8c500cda00 con 0x7f8c500cd520 2024-04-25T09:11:24.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.190+0000 7f8c4d400640 1 -- 172.21.15.175:0/2716502518 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c34005740 con 0x7f8c500cd520 2024-04-25T09:11:24.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.190+0000 7f8c4e800640 1 -- 172.21.15.175:0/2716502518 >> v2:172.21.15.177:3300/0 conn(0x7f8c5015a900 msgr2=0x7f8c5006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:24.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.190+0000 7f8c4e800640 1 --2- 172.21.15.175:0/2716502518 >> v2:172.21.15.177:3300/0 conn(0x7f8c5015a900 0x7f8c5006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.190+0000 7f8c4e800640 1 -- 172.21.15.175:0/2716502518 >> v1:172.21.15.175:6789/0 conn(0x7f8c500cd520 legacy=0x7f8c500ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.190+0000 7f8c4e800640 1 -- 172.21.15.175:0/2716502518 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c500cdce0 con 0x7f8c500cf560 2024-04-25T09:11:24.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.190+0000 7f8c4e800640 1 --2- 172.21.15.175:0/2716502518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c500cf560 0x7f8c500cf9b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8c480097c0 tx=0x7f8c4801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33cc3ee8fd3c22c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:24.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.190+0000 7f8c4d400640 1 -- 172.21.15.175:0/2716502518 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c480b2070 con 0x7f8c500cf560 2024-04-25T09:11:24.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.190+0000 7f8c4d400640 1 -- 172.21.15.175:0/2716502518 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c480ad640 con 0x7f8c500cf560 2024-04-25T09:11:24.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.190+0000 7f8c4d400640 1 -- 172.21.15.175:0/2716502518 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c480ad9f0 con 0x7f8c500cf560 2024-04-25T09:11:24.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c54a00640 1 -- 172.21.15.175:0/2716502518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c500cf560 msgr2=0x7f8c500cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c54a00640 1 --2- 172.21.15.175:0/2716502518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c500cf560 0x7f8c500cf9b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8c480097c0 tx=0x7f8c4801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c54a00640 1 -- 172.21.15.175:0/2716502518 shutdown_connections 2024-04-25T09:11:24.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c54a00640 1 --2- 172.21.15.175:0/2716502518 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c500cf560 0x7f8c500cf9b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c54a00640 1 --2- 172.21.15.175:0/2716502518 >> v2:172.21.15.177:3300/0 conn(0x7f8c5015a900 0x7f8c5006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c54a00640 1 -- 172.21.15.175:0/2716502518 >> 172.21.15.175:0/2716502518 conn(0x7f8c50067150 msgr2=0x7f8c5006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:24.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c54a00640 1 -- 172.21.15.175:0/2716502518 shutdown_connections 2024-04-25T09:11:24.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c54a00640 1 -- 172.21.15.175:0/2716502518 wait complete. 2024-04-25T09:11:24.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c54a00640 1 Processor -- start 2024-04-25T09:11:24.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c54a00640 1 -- start start 2024-04-25T09:11:24.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c54a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c500cf560 0x7f8c5014d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c54a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c5015a900 0x7f8c5014fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c54a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c5014db80 0x7f8c50150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c54a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5006d530 con 0x7f8c500cf560 2024-04-25T09:11:24.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c54a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5006d3b0 con 0x7f8c5015a900 2024-04-25T09:11:24.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c54a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5015c790 con 0x7f8c5014db80 2024-04-25T09:11:24.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c4de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c500cf560 0x7f8c5014d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c4de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c500cf560 0x7f8c5014d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46664/0 (socket says 172.21.15.175:46664) 2024-04-25T09:11:24.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c4de00640 1 -- 172.21.15.175:0/2341171823 learned_addr learned my addr 172.21.15.175:0/2341171823 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:24.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c45400640 1 --2- 172.21.15.175:0/2341171823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c5015a900 0x7f8c5014fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c4e800640 1 --2- 172.21.15.175:0/2341171823 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c5014db80 0x7f8c50150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c4de00640 1 -- 172.21.15.175:0/2341171823 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c5014db80 msgr2=0x7f8c50150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c4de00640 1 --2- 172.21.15.175:0/2341171823 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c5014db80 0x7f8c50150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c4de00640 1 -- 172.21.15.175:0/2341171823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c5015a900 msgr2=0x7f8c5014fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c4de00640 1 --2- 172.21.15.175:0/2341171823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c5015a900 0x7f8c5014fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.194+0000 7f8c4de00640 1 -- 172.21.15.175:0/2341171823 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5014f540 con 0x7f8c500cf560 2024-04-25T09:11:24.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.198+0000 7f8c4de00640 1 --2- 172.21.15.175:0/2341171823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c500cf560 0x7f8c5014d2c0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000efc0 tx=0x7f8c4000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:24.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.198+0000 7f8c46a00640 1 -- 172.21.15.175:0/2341171823 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c40018020 con 0x7f8c500cf560 2024-04-25T09:11:24.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.198+0000 7f8c46a00640 1 -- 172.21.15.175:0/2341171823 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c40014480 con 0x7f8c500cf560 2024-04-25T09:11:24.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.198+0000 7f8c46a00640 1 -- 172.21.15.175:0/2341171823 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c40014850 con 0x7f8c500cf560 2024-04-25T09:11:24.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.198+0000 7f8c54a00640 1 -- 172.21.15.175:0/2341171823 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c50151120 con 0x7f8c500cf560 2024-04-25T09:11:24.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.198+0000 7f8c54a00640 1 -- 172.21.15.175:0/2341171823 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5014f7e0 con 0x7f8c500cf560 2024-04-25T09:11:24.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.198+0000 7f8c54a00640 1 -- 172.21.15.175:0/2341171823 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c50074a60 con 0x7f8c500cf560 2024-04-25T09:11:24.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.198+0000 7f8c46a00640 1 -- 172.21.15.175:0/2341171823 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8c4001b020 con 0x7f8c500cf560 2024-04-25T09:11:24.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.198+0000 7f8c46a00640 1 --2- 172.21.15.175:0/2341171823 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8c2c066f60 0x7f8c2c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.198+0000 7f8c46a00640 1 -- 172.21.15.175:0/2341171823 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f8c40085b90 con 0x7f8c500cf560 2024-04-25T09:11:24.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.198+0000 7f8c45400640 1 --2- 172.21.15.175:0/2341171823 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8c2c066f60 0x7f8c2c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.202+0000 7f8c45400640 1 --2- 172.21.15.175:0/2341171823 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8c2c066f60 0x7f8c2c069420 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8c50150a00 tx=0x7f8c38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:24.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.202+0000 7f8c46a00640 1 -- 172.21.15.175:0/2341171823 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8c40022070 con 0x7f8c500cf560 2024-04-25T09:11:24.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.358+0000 7f8c54a00640 1 -- 172.21.15.175:0/2341171823 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c5014fa20 con 0x7f8c500cf560 2024-04-25T09:11:24.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.358+0000 7f8c46a00640 1 -- 172.21.15.175:0/2341171823 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16877 (secure 0 0 0) 0x7f8c40010040 con 0x7f8c500cf560 2024-04-25T09:11:24.350 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:11:24.351 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":87,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:10:53.941598+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:01.518283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:02.788015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.38","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6837/1755192276":"2024-04-26T09:10:14.425304+0000","172.21.15.175:6835/1755192276":"2024-04-26T09:10:14.425304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:24.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.362+0000 7f8c54a00640 1 -- 172.21.15.175:0/2341171823 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8c2c066f60 msgr2=0x7f8c2c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.362+0000 7f8c54a00640 1 --2- 172.21.15.175:0/2341171823 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8c2c066f60 0x7f8c2c069420 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8c50150a00 tx=0x7f8c38009040 comp rx=0 tx=0).stop 2024-04-25T09:11:24.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.362+0000 7f8c54a00640 1 -- 172.21.15.175:0/2341171823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c500cf560 msgr2=0x7f8c5014d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.362+0000 7f8c54a00640 1 --2- 172.21.15.175:0/2341171823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c500cf560 0x7f8c5014d2c0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f8c4000efc0 tx=0x7f8c4000c490 comp rx=0 tx=0).stop 2024-04-25T09:11:24.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.362+0000 7f8c54a00640 1 -- 172.21.15.175:0/2341171823 shutdown_connections 2024-04-25T09:11:24.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.362+0000 7f8c54a00640 1 --2- 172.21.15.175:0/2341171823 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8c2c066f60 0x7f8c2c069420 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.362+0000 7f8c54a00640 1 --2- 172.21.15.175:0/2341171823 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c5014db80 0x7f8c50150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.362+0000 7f8c54a00640 1 --2- 172.21.15.175:0/2341171823 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c5015a900 0x7f8c5014fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.362+0000 7f8c54a00640 1 --2- 172.21.15.175:0/2341171823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8c500cf560 0x7f8c5014d2c0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.362+0000 7f8c54a00640 1 -- 172.21.15.175:0/2341171823 >> 172.21.15.175:0/2341171823 conn(0x7f8c500cd520 msgr2=0x7f8c5006e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:24.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.362+0000 7f8c54a00640 1 -- 172.21.15.175:0/2341171823 shutdown_connections 2024-04-25T09:11:24.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.362+0000 7f8c54a00640 1 -- 172.21.15.175:0/2341171823 wait complete. 2024-04-25T09:11:24.372 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:10:01.518283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:10:02.788015+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:11:24.372 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:11:24.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.522+0000 7fabbb800640 1 Processor -- start 2024-04-25T09:11:24.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.526+0000 7fabbb800640 1 -- start start 2024-04-25T09:11:24.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.526+0000 7fabbb800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabb40cbe60 0x7fabb415af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.526+0000 7fabbb800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fabb406d310 0x7fabb40b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.526+0000 7fabbb800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fabb40b4630 0x7fabb40b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.526+0000 7fabbb800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb406db60 con 0x7fabb406d310 2024-04-25T09:11:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.526+0000 7fabbb800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb406de40 con 0x7fabb40b4630 2024-04-25T09:11:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.526+0000 7fabbb800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb406e120 con 0x7fabb40cbe60 2024-04-25T09:11:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.526+0000 7fabb3e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fabb406d310 0x7fabb40b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.526+0000 7fabb3e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fabb406d310 0x7fabb40b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46676/0 (socket says 172.21.15.175:46676) 2024-04-25T09:11:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.526+0000 7fabb3e00640 1 -- 172.21.15.175:0/3487853149 learned_addr learned my addr 172.21.15.175:0/3487853149 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.526+0000 7fabb8e00640 1 --2- 172.21.15.175:0/3487853149 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabb40cbe60 0x7fabb415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.526+0000 7fabb9800640 1 --2- 172.21.15.175:0/3487853149 >> v2:172.21.15.177:3300/0 conn(0x7fabb40b4630 0x7fabb40b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.526+0000 7fabb3e00640 1 -- 172.21.15.175:0/3487853149 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabb40cbe60 msgr2=0x7fabb415af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.526+0000 7fabb3e00640 1 --2- 172.21.15.175:0/3487853149 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabb40cbe60 0x7fabb415af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.526+0000 7fabb3e00640 1 -- 172.21.15.175:0/3487853149 >> v2:172.21.15.177:3300/0 conn(0x7fabb40b4630 msgr2=0x7fabb40b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:24.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.526+0000 7fabb3e00640 1 --2- 172.21.15.175:0/3487853149 >> v2:172.21.15.177:3300/0 conn(0x7fabb40b4630 0x7fabb40b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.526+0000 7fabb3e00640 1 -- 172.21.15.175:0/3487853149 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb415c2f0 con 0x7fabb406d310 2024-04-25T09:11:24.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.526+0000 7fabb9800640 1 --2- 172.21.15.175:0/3487853149 >> v2:172.21.15.177:3300/0 conn(0x7fabb40b4630 0x7fabb40b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:24.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.530+0000 7fabb3e00640 1 --2- 172.21.15.175:0/3487853149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb406d310 0x7fabb40b40f0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fabb406ec50 tx=0x7faba001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a0861d790b4ab2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:24.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.530+0000 7fabb3400640 1 -- 172.21.15.175:0/3487853149 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba00b0070 con 0x7fabb406d310 2024-04-25T09:11:24.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.530+0000 7fabb3400640 1 -- 172.21.15.175:0/3487853149 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba00ab600 con 0x7fabb406d310 2024-04-25T09:11:24.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.530+0000 7fabb3400640 1 -- 172.21.15.175:0/3487853149 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba00ab9d0 con 0x7fabb406d310 2024-04-25T09:11:24.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.530+0000 7fabbb800640 1 -- 172.21.15.175:0/3487853149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb406d310 msgr2=0x7fabb40b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.530+0000 7fabbb800640 1 --2- 172.21.15.175:0/3487853149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb406d310 0x7fabb40b40f0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fabb406ec50 tx=0x7faba001c260 comp rx=0 tx=0).stop 2024-04-25T09:11:24.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.530+0000 7fabbb800640 1 -- 172.21.15.175:0/3487853149 shutdown_connections 2024-04-25T09:11:24.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.530+0000 7fabbb800640 1 --2- 172.21.15.175:0/3487853149 >> v2:172.21.15.177:3300/0 conn(0x7fabb40b4630 0x7fabb40b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.530+0000 7fabbb800640 1 --2- 172.21.15.175:0/3487853149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb406d310 0x7fabb40b40f0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.530+0000 7fabbb800640 1 --2- 172.21.15.175:0/3487853149 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabb40cbe60 0x7fabb415af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.530+0000 7fabbb800640 1 -- 172.21.15.175:0/3487853149 >> 172.21.15.175:0/3487853149 conn(0x7fabb406ac50 msgr2=0x7fabb406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:24.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.530+0000 7fabbb800640 1 -- 172.21.15.175:0/3487853149 shutdown_connections 2024-04-25T09:11:24.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.530+0000 7fabbb800640 1 -- 172.21.15.175:0/3487853149 wait complete. 2024-04-25T09:11:24.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.530+0000 7fabbb800640 1 Processor -- start 2024-04-25T09:11:24.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.530+0000 7fabbb800640 1 -- start start 2024-04-25T09:11:24.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabbb800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb406d310 0x7fabb4145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabbb800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb40b4630 0x7fabb40cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabbb800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabb40cbe60 0x7fabb40712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabbb800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb415cbe0 con 0x7fabb40b4630 2024-04-25T09:11:24.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabbb800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb415ca60 con 0x7fabb406d310 2024-04-25T09:11:24.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabbb800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb415cd60 con 0x7fabb40cbe60 2024-04-25T09:11:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabb3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb40b4630 0x7fabb40cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabb3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb40b4630 0x7fabb40cdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46680/0 (socket says 172.21.15.175:46680) 2024-04-25T09:11:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabb3e00640 1 -- 172.21.15.175:0/707426389 learned_addr learned my addr 172.21.15.175:0/707426389 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabb9800640 1 --2- 172.21.15.175:0/707426389 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabb40cbe60 0x7fabb40712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabb8e00640 1 --2- 172.21.15.175:0/707426389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb406d310 0x7fabb4145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabb3e00640 1 -- 172.21.15.175:0/707426389 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabb40cbe60 msgr2=0x7fabb40712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabb3e00640 1 --2- 172.21.15.175:0/707426389 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabb40cbe60 0x7fabb40712d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabb3e00640 1 -- 172.21.15.175:0/707426389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb406d310 msgr2=0x7fabb4145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabb3e00640 1 --2- 172.21.15.175:0/707426389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb406d310 0x7fabb4145000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabb3e00640 1 -- 172.21.15.175:0/707426389 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb4145540 con 0x7fabb40b4630 2024-04-25T09:11:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabb8e00640 1 --2- 172.21.15.175:0/707426389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb406d310 0x7fabb4145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabb3e00640 1 --2- 172.21.15.175:0/707426389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb40b4630 0x7fabb40cdf20 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7faba001a910 tx=0x7faba0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabb0c00640 1 -- 172.21.15.175:0/707426389 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba00ba070 con 0x7fabb40b4630 2024-04-25T09:11:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabb0c00640 1 -- 172.21.15.175:0/707426389 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba00b4420 con 0x7fabb40b4630 2024-04-25T09:11:24.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabbb800640 1 -- 172.21.15.175:0/707426389 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb40ce8e0 con 0x7fabb40b4630 2024-04-25T09:11:24.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabb0c00640 1 -- 172.21.15.175:0/707426389 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba00b0040 con 0x7fabb40b4630 2024-04-25T09:11:24.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabbb800640 1 -- 172.21.15.175:0/707426389 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb40ceea0 con 0x7fabb40b4630 2024-04-25T09:11:24.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.534+0000 7fabbb800640 1 -- 172.21.15.175:0/707426389 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb4075160 con 0x7fabb40b4630 2024-04-25T09:11:24.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.538+0000 7fabb0c00640 1 -- 172.21.15.175:0/707426389 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faba00bd070 con 0x7fabb40b4630 2024-04-25T09:11:24.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.538+0000 7fabb0c00640 1 --2- 172.21.15.175:0/707426389 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fab94066f60 0x7fab94069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.538+0000 7fabb0c00640 1 -- 172.21.15.175:0/707426389 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5824+0+0 (secure 0 0 0) 0x7faba011e0b0 con 0x7fabb40b4630 2024-04-25T09:11:24.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.538+0000 7fabb8e00640 1 --2- 172.21.15.175:0/707426389 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fab94066f60 0x7fab94069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.538+0000 7fabb8e00640 1 --2- 172.21.15.175:0/707426389 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fab94066f60 0x7fab94069420 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fabb4159400 tx=0x7faba8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:24.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.542+0000 7fabb0c00640 1 -- 172.21.15.175:0/707426389 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faba0016110 con 0x7fabb40b4630 2024-04-25T09:11:24.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.694+0000 7fabbb800640 1 -- 172.21.15.175:0/707426389 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fabb4158cf0 con 0x7fabb40b4630 2024-04-25T09:11:24.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.698+0000 7fabb0c00640 1 -- 172.21.15.175:0/707426389 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7faba00eeaa0 con 0x7fabb40b4630 2024-04-25T09:11:24.686 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:11:24.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.698+0000 7fabbb800640 1 -- 172.21.15.175:0/707426389 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fab94066f60 msgr2=0x7fab94069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.698+0000 7fabbb800640 1 --2- 172.21.15.175:0/707426389 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fab94066f60 0x7fab94069420 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fabb4159400 tx=0x7faba8008040 comp rx=0 tx=0).stop 2024-04-25T09:11:24.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.698+0000 7fabbb800640 1 -- 172.21.15.175:0/707426389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb40b4630 msgr2=0x7fabb40cdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.698+0000 7fabbb800640 1 --2- 172.21.15.175:0/707426389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb40b4630 0x7fabb40cdf20 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7faba001a910 tx=0x7faba0019000 comp rx=0 tx=0).stop 2024-04-25T09:11:24.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.698+0000 7fabbb800640 1 -- 172.21.15.175:0/707426389 shutdown_connections 2024-04-25T09:11:24.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.698+0000 7fabbb800640 1 --2- 172.21.15.175:0/707426389 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fab94066f60 0x7fab94069420 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.698+0000 7fabbb800640 1 --2- 172.21.15.175:0/707426389 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fabb40cbe60 0x7fabb40712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.698+0000 7fabbb800640 1 --2- 172.21.15.175:0/707426389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb40b4630 0x7fabb40cdf20 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.698+0000 7fabbb800640 1 --2- 172.21.15.175:0/707426389 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fabb406d310 0x7fabb4145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.698+0000 7fabbb800640 1 -- 172.21.15.175:0/707426389 >> 172.21.15.175:0/707426389 conn(0x7fabb406ac50 msgr2=0x7fabb415b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:24.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.698+0000 7fabbb800640 1 -- 172.21.15.175:0/707426389 shutdown_connections 2024-04-25T09:11:24.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.698+0000 7fabbb800640 1 -- 172.21.15.175:0/707426389 wait complete. 2024-04-25T09:11:24.707 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:11:24.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.854+0000 7efdb5a00640 1 Processor -- start 2024-04-25T09:11:24.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.854+0000 7efdb5a00640 1 -- start start 2024-04-25T09:11:24.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.854+0000 7efdb5a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efdb00b3230 0x7efdb00b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.854+0000 7efdb5a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efdb00b3d20 0x7efdb00b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.854+0000 7efdb5a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb015dd10 con 0x7efdb00712d0 2024-04-25T09:11:24.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.854+0000 7efdb5a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb015dff0 con 0x7efdb00b3230 2024-04-25T09:11:24.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.858+0000 7efdb5a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb015e2d0 con 0x7efdb00b3d20 2024-04-25T09:11:24.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.858+0000 7efdaea00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efdb00b3230 0x7efdb00b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.858+0000 7efdaea00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efdb00b3230 0x7efdb00b2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46688/0 (socket says 172.21.15.175:46688) 2024-04-25T09:11:24.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.858+0000 7efdaea00640 1 -- 172.21.15.175:0/1440799741 learned_addr learned my addr 172.21.15.175:0/1440799741 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:24.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.858+0000 7efdaea00640 1 -- 172.21.15.175:0/1440799741 >> v2:172.21.15.177:3300/0 conn(0x7efdb00b3d20 msgr2=0x7efdb00b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:24.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.858+0000 7efdaea00640 1 --2- 172.21.15.175:0/1440799741 >> v2:172.21.15.177:3300/0 conn(0x7efdb00b3d20 0x7efdb00b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.858+0000 7efdaea00640 1 -- 172.21.15.175:0/1440799741 >> v1:172.21.15.177:6789/0 conn(0x7efdb00712d0 legacy=0x7efdb015aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:24.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.858+0000 7efdaea00640 1 -- 172.21.15.175:0/1440799741 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb015e5b0 con 0x7efdb00b3230 2024-04-25T09:11:24.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.858+0000 7efdaea00640 1 --2- 172.21.15.175:0/1440799741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb00b3230 0x7efdb00b2660 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7efdb0072340 tx=0x7efda001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3eea60cc1f7be94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:24.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.858+0000 7efdae000640 1 -- 172.21.15.175:0/1440799741 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda00aa610 con 0x7efdb00b3230 2024-04-25T09:11:24.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.858+0000 7efdae000640 1 -- 172.21.15.175:0/1440799741 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda00af070 con 0x7efdb00b3230 2024-04-25T09:11:24.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.858+0000 7efdae000640 1 -- 172.21.15.175:0/1440799741 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda00aa9d0 con 0x7efdb00b3230 2024-04-25T09:11:24.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdb5a00640 1 -- 172.21.15.175:0/1440799741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb00b3230 msgr2=0x7efdb00b2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdb5a00640 1 --2- 172.21.15.175:0/1440799741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb00b3230 0x7efdb00b2660 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7efdb0072340 tx=0x7efda001c4b0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdb5a00640 1 -- 172.21.15.175:0/1440799741 shutdown_connections 2024-04-25T09:11:24.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdb5a00640 1 --2- 172.21.15.175:0/1440799741 >> v2:172.21.15.177:3300/0 conn(0x7efdb00b3d20 0x7efdb00b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdb5a00640 1 --2- 172.21.15.175:0/1440799741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb00b3230 0x7efdb00b2660 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdb5a00640 1 -- 172.21.15.175:0/1440799741 >> 172.21.15.175:0/1440799741 conn(0x7efdb006ac50 msgr2=0x7efdb006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:24.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdb5a00640 1 -- 172.21.15.175:0/1440799741 shutdown_connections 2024-04-25T09:11:24.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdb5a00640 1 -- 172.21.15.175:0/1440799741 wait complete. 2024-04-25T09:11:24.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdb5a00640 1 Processor -- start 2024-04-25T09:11:24.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdb5a00640 1 -- start start 2024-04-25T09:11:24.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdb5a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efdb00712d0 0x7efdb00cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdb5a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efdb00b3230 0x7efdb0154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdb5a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb00b3d20 0x7efdb0153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdb5a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb015b710 con 0x7efdb00b3d20 2024-04-25T09:11:24.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdb5a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb015b590 con 0x7efdb00b3230 2024-04-25T09:11:24.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdb5a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00b3610 con 0x7efdb00712d0 2024-04-25T09:11:24.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdaf400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb00b3d20 0x7efdb0153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdaf400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb00b3d20 0x7efdb0153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46704/0 (socket says 172.21.15.175:46704) 2024-04-25T09:11:24.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdaf400640 1 -- 172.21.15.175:0/468146281 learned_addr learned my addr 172.21.15.175:0/468146281 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:24.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efda6000640 1 --2- 172.21.15.175:0/468146281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efdb00b3230 0x7efdb0154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdaea00640 1 --2- 172.21.15.175:0/468146281 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efdb00712d0 0x7efdb00cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdaf400640 1 -- 172.21.15.175:0/468146281 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efdb00712d0 msgr2=0x7efdb00cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdaf400640 1 --2- 172.21.15.175:0/468146281 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efdb00712d0 0x7efdb00cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdaf400640 1 -- 172.21.15.175:0/468146281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efdb00b3230 msgr2=0x7efdb0154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:24.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdaf400640 1 --2- 172.21.15.175:0/468146281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efdb00b3230 0x7efdb0154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:24.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.862+0000 7efdaf400640 1 -- 172.21.15.175:0/468146281 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb00cf3d0 con 0x7efdb00b3d20 2024-04-25T09:11:24.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.866+0000 7efdaf400640 1 --2- 172.21.15.175:0/468146281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb00b3d20 0x7efdb0153ff0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7efda800c7b0 tx=0x7efda800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:24.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.866+0000 7efda7400640 1 -- 172.21.15.175:0/468146281 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8017070 con 0x7efdb00b3d20 2024-04-25T09:11:24.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.866+0000 7efda7400640 1 -- 172.21.15.175:0/468146281 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda8003db0 con 0x7efdb00b3d20 2024-04-25T09:11:24.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.866+0000 7efdb5a00640 1 -- 172.21.15.175:0/468146281 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb014f370 con 0x7efdb00b3d20 2024-04-25T09:11:24.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.866+0000 7efda7400640 1 -- 172.21.15.175:0/468146281 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda80052b0 con 0x7efdb00b3d20 2024-04-25T09:11:24.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.866+0000 7efdb5a00640 1 -- 172.21.15.175:0/468146281 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb0154530 con 0x7efdb00b3d20 2024-04-25T09:11:24.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.866+0000 7efdb5a00640 1 -- 172.21.15.175:0/468146281 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb0075160 con 0x7efdb00b3d20 2024-04-25T09:11:24.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.866+0000 7efda7400640 1 -- 172.21.15.175:0/468146281 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efda801a070 con 0x7efdb00b3d20 2024-04-25T09:11:24.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.866+0000 7efda7400640 1 --2- 172.21.15.175:0/468146281 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efd8c066f60 0x7efd8c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:24.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.866+0000 7efda7400640 1 -- 172.21.15.175:0/468146281 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5824+0+0 (secure 0 0 0) 0x7efda8084720 con 0x7efdb00b3d20 2024-04-25T09:11:24.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.866+0000 7efdaea00640 1 --2- 172.21.15.175:0/468146281 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efd8c066f60 0x7efd8c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:24.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.870+0000 7efdaea00640 1 --2- 172.21.15.175:0/468146281 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efd8c066f60 0x7efd8c069420 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7efda00ae000 tx=0x7efda00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:24.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:24.870+0000 7efda7400640 1 -- 172.21.15.175:0/468146281 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efda80556d0 con 0x7efdb00b3d20 2024-04-25T09:11:25.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.026+0000 7efdb5a00640 1 -- 172.21.15.175:0/468146281 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efdb0158f80 con 0x7efdb00b3d20 2024-04-25T09:11:25.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.026+0000 7efda7400640 1 -- 172.21.15.175:0/468146281 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7efda8054fd0 con 0x7efdb00b3d20 2024-04-25T09:11:25.016 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:11:25.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.030+0000 7efdb5a00640 1 -- 172.21.15.175:0/468146281 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efd8c066f60 msgr2=0x7efd8c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.030+0000 7efdb5a00640 1 --2- 172.21.15.175:0/468146281 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efd8c066f60 0x7efd8c069420 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7efda00ae000 tx=0x7efda00a7000 comp rx=0 tx=0).stop 2024-04-25T09:11:25.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.030+0000 7efdb5a00640 1 -- 172.21.15.175:0/468146281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb00b3d20 msgr2=0x7efdb0153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.030+0000 7efdb5a00640 1 --2- 172.21.15.175:0/468146281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb00b3d20 0x7efdb0153ff0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7efda800c7b0 tx=0x7efda800cc70 comp rx=0 tx=0).stop 2024-04-25T09:11:25.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.030+0000 7efdb5a00640 1 -- 172.21.15.175:0/468146281 shutdown_connections 2024-04-25T09:11:25.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.030+0000 7efdb5a00640 1 --2- 172.21.15.175:0/468146281 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efd8c066f60 0x7efd8c069420 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.030+0000 7efdb5a00640 1 --2- 172.21.15.175:0/468146281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb00b3d20 0x7efdb0153ff0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.030+0000 7efdb5a00640 1 --2- 172.21.15.175:0/468146281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efdb00b3230 0x7efdb0154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.030+0000 7efdb5a00640 1 --2- 172.21.15.175:0/468146281 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efdb00712d0 0x7efdb00cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.030+0000 7efdb5a00640 1 -- 172.21.15.175:0/468146281 >> 172.21.15.175:0/468146281 conn(0x7efdb006ac50 msgr2=0x7efdb0159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:25.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.030+0000 7efdb5a00640 1 -- 172.21.15.175:0/468146281 shutdown_connections 2024-04-25T09:11:25.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.030+0000 7efdb5a00640 1 -- 172.21.15.175:0/468146281 wait complete. 2024-04-25T09:11:25.037 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:11:25.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.186+0000 7f0f30000640 1 Processor -- start 2024-04-25T09:11:25.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.186+0000 7f0f30000640 1 -- start start 2024-04-25T09:11:25.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.186+0000 7f0f30000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0f280b4800 0x7f0f28165550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.186+0000 7f0f30000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f2806db60 con 0x7f0f280cbe60 2024-04-25T09:11:25.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.186+0000 7f0f30000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f2806de40 con 0x7f0f2815af20 2024-04-25T09:11:25.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.186+0000 7f0f30000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f2806e120 con 0x7f0f280b4800 2024-04-25T09:11:25.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.186+0000 7f0f2d600640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f0f280cbe60 0x7f0f2806d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:33526/0 (socket says 172.21.15.175:33526) 2024-04-25T09:11:25.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.186+0000 7f0f2d600640 1 -- 172.21.15.175:0/388690502 learned_addr learned my addr 172.21.15.175:0/388690502 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:11:25.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.186+0000 7f0f2e000640 1 --2- 172.21.15.175:0/388690502 >> v2:172.21.15.177:3300/0 conn(0x7f0f280b4800 0x7f0f28165550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.186+0000 7f0f27e00640 1 -- 172.21.15.175:0/388690502 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 803590827 0 0) 0x7f0f2806db60 con 0x7f0f280cbe60 2024-04-25T09:11:25.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.186+0000 7f0f27e00640 1 -- 172.21.15.175:0/388690502 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f10003530 con 0x7f0f280cbe60 2024-04-25T09:11:25.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.186+0000 7f0f2e000640 1 -- 172.21.15.175:0/388690502 >> v1:172.21.15.177:6789/0 conn(0x7f0f2815af20 legacy=0x7f0f280b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.186+0000 7f0f27e00640 1 -- 172.21.15.175:0/388690502 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1064023841 0 0) 0x7f0f10003530 con 0x7f0f280cbe60 2024-04-25T09:11:25.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.186+0000 7f0f2e000640 1 -- 172.21.15.175:0/388690502 >> v1:172.21.15.175:6789/0 conn(0x7f0f280cbe60 legacy=0x7f0f2806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.186+0000 7f0f2e000640 1 -- 172.21.15.175:0/388690502 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2815c2f0 con 0x7f0f280b4800 2024-04-25T09:11:25.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.190+0000 7f0f2e000640 1 --2- 172.21.15.175:0/388690502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f280b4800 0x7f0f28165550 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0f20009d90 tx=0x7f0f2001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=392814b3882e9450 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:25.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.190+0000 7f0f27e00640 1 -- 172.21.15.175:0/388690502 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c001680 con 0x7f0f280b4800 2024-04-25T09:11:25.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.190+0000 7f0f27e00640 1 -- 172.21.15.175:0/388690502 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f200a64e0 con 0x7f0f280b4800 2024-04-25T09:11:25.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.190+0000 7f0f27e00640 1 -- 172.21.15.175:0/388690502 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f200a68b0 con 0x7f0f280b4800 2024-04-25T09:11:25.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.190+0000 7f0f30000640 1 -- 172.21.15.175:0/388690502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f280b4800 msgr2=0x7f0f28165550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.190+0000 7f0f30000640 1 --2- 172.21.15.175:0/388690502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f280b4800 0x7f0f28165550 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0f20009d90 tx=0x7f0f2001c890 comp rx=0 tx=0).stop 2024-04-25T09:11:25.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.190+0000 7f0f30000640 1 -- 172.21.15.175:0/388690502 shutdown_connections 2024-04-25T09:11:25.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.190+0000 7f0f30000640 1 --2- 172.21.15.175:0/388690502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f280b4800 0x7f0f28165550 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.190+0000 7f0f30000640 1 -- 172.21.15.175:0/388690502 >> 172.21.15.175:0/388690502 conn(0x7f0f2806ac50 msgr2=0x7f0f2806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:25.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.190+0000 7f0f30000640 1 -- 172.21.15.175:0/388690502 shutdown_connections 2024-04-25T09:11:25.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.190+0000 7f0f30000640 1 -- 172.21.15.175:0/388690502 wait complete. 2024-04-25T09:11:25.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f30000640 1 Processor -- start 2024-04-25T09:11:25.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f30000640 1 -- start start 2024-04-25T09:11:25.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f30000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f280b4800 0x7f0f2814c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f30000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f280cbe60 0x7f0f2814b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f30000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f2815af20 0x7f0f28150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f30000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f281688d0 con 0x7f0f280b4800 2024-04-25T09:11:25.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f30000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f280cc450 con 0x7f0f280cbe60 2024-04-25T09:11:25.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f30000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f28168a50 con 0x7f0f2815af20 2024-04-25T09:11:25.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f2d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f280b4800 0x7f0f2814c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f2d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f280b4800 0x7f0f2814c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46718/0 (socket says 172.21.15.175:46718) 2024-04-25T09:11:25.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f2d600640 1 -- 172.21.15.175:0/375788212 learned_addr learned my addr 172.21.15.175:0/375788212 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:25.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f2cc00640 1 --2- 172.21.15.175:0/375788212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f280cbe60 0x7f0f2814b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f2e000640 1 --2- 172.21.15.175:0/375788212 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f2815af20 0x7f0f28150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f2d600640 1 -- 172.21.15.175:0/375788212 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f2815af20 msgr2=0x7f0f28150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f2d600640 1 --2- 172.21.15.175:0/375788212 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f2815af20 0x7f0f28150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f2d600640 1 -- 172.21.15.175:0/375788212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f280cbe60 msgr2=0x7f0f2814b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f2d600640 1 --2- 172.21.15.175:0/375788212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f280cbe60 0x7f0f2814b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f2d600640 1 -- 172.21.15.175:0/375788212 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f281574a0 con 0x7f0f280b4800 2024-04-25T09:11:25.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f2e000640 1 --2- 172.21.15.175:0/375788212 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f2815af20 0x7f0f28150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:25.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f2d600640 1 --2- 172.21.15.175:0/375788212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f280b4800 0x7f0f2814c400 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00c730 tx=0x7f0f1c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:25.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f25600640 1 -- 172.21.15.175:0/375788212 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c017070 con 0x7f0f280b4800 2024-04-25T09:11:25.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f25600640 1 -- 172.21.15.175:0/375788212 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1c005b00 con 0x7f0f280b4800 2024-04-25T09:11:25.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f25600640 1 -- 172.21.15.175:0/375788212 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c007070 con 0x7f0f280b4800 2024-04-25T09:11:25.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f30000640 1 -- 172.21.15.175:0/375788212 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f28157780 con 0x7f0f280b4800 2024-04-25T09:11:25.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.194+0000 7f0f30000640 1 -- 172.21.15.175:0/375788212 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f28157d40 con 0x7f0f280b4800 2024-04-25T09:11:25.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.198+0000 7f0f30000640 1 -- 172.21.15.175:0/375788212 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f28075160 con 0x7f0f280b4800 2024-04-25T09:11:25.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.198+0000 7f0f25600640 1 -- 172.21.15.175:0/375788212 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0f1c01a070 con 0x7f0f280b4800 2024-04-25T09:11:25.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.198+0000 7f0f25600640 1 --2- 172.21.15.175:0/375788212 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f08066f60 0x7f0f08069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.198+0000 7f0f25600640 1 -- 172.21.15.175:0/375788212 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f0f1c084560 con 0x7f0f280b4800 2024-04-25T09:11:25.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.198+0000 7f0f2cc00640 1 --2- 172.21.15.175:0/375788212 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f08066f60 0x7f0f08069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.198+0000 7f0f2cc00640 1 --2- 172.21.15.175:0/375788212 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f08066f60 0x7f0f08069420 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0f28159410 tx=0x7f0f14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:25.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.202+0000 7f0f25600640 1 -- 172.21.15.175:0/375788212 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0f1c054ec0 con 0x7f0f280b4800 2024-04-25T09:11:25.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.358+0000 7f0f30000640 1 -- 172.21.15.175:0/375788212 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f28155700 con 0x7f0f280b4800 2024-04-25T09:11:25.349 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.358+0000 7f0f25600640 1 -- 172.21.15.175:0/375788212 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f1c058f60 con 0x7f0f280b4800 2024-04-25T09:11:25.349 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:11:25.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.362+0000 7f0f30000640 1 -- 172.21.15.175:0/375788212 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f08066f60 msgr2=0x7f0f08069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.362+0000 7f0f30000640 1 --2- 172.21.15.175:0/375788212 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f08066f60 0x7f0f08069420 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0f28159410 tx=0x7f0f14009040 comp rx=0 tx=0).stop 2024-04-25T09:11:25.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.362+0000 7f0f30000640 1 -- 172.21.15.175:0/375788212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f280b4800 msgr2=0x7f0f2814c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.362+0000 7f0f30000640 1 --2- 172.21.15.175:0/375788212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f280b4800 0x7f0f2814c400 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00c730 tx=0x7f0f1c00cbf0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.362+0000 7f0f30000640 1 -- 172.21.15.175:0/375788212 shutdown_connections 2024-04-25T09:11:25.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.362+0000 7f0f30000640 1 --2- 172.21.15.175:0/375788212 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f08066f60 0x7f0f08069420 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.362+0000 7f0f30000640 1 --2- 172.21.15.175:0/375788212 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f2815af20 0x7f0f28150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.362+0000 7f0f30000640 1 --2- 172.21.15.175:0/375788212 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f280cbe60 0x7f0f2814b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.362+0000 7f0f30000640 1 --2- 172.21.15.175:0/375788212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f280b4800 0x7f0f2814c400 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.362+0000 7f0f30000640 1 -- 172.21.15.175:0/375788212 >> 172.21.15.175:0/375788212 conn(0x7f0f2806ac50 msgr2=0x7f0f280adb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:25.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.362+0000 7f0f30000640 1 -- 172.21.15.175:0/375788212 shutdown_connections 2024-04-25T09:11:25.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.362+0000 7f0f30000640 1 -- 172.21.15.175:0/375788212 wait complete. 2024-04-25T09:11:25.371 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:11:25.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.518+0000 7fba6a000640 1 Processor -- start 2024-04-25T09:11:25.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.518+0000 7fba6a000640 1 -- start start 2024-04-25T09:11:25.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.518+0000 7fba6a000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fba64145250 0x7fba640cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.518+0000 7fba6a000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba641600a0 0x7fba640cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.518+0000 7fba6a000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fba640ce970 0x7fba640cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.518+0000 7fba6a000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba6415f650 con 0x7fba64145250 2024-04-25T09:11:25.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.518+0000 7fba6a000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba640cfd10 con 0x7fba640ce970 2024-04-25T09:11:25.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.518+0000 7fba6a000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba640cfff0 con 0x7fba641600a0 2024-04-25T09:11:25.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.518+0000 7fba63400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fba64145250 0x7fba640cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.518+0000 7fba63400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fba64145250 0x7fba640cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46728/0 (socket says 172.21.15.175:46728) 2024-04-25T09:11:25.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.518+0000 7fba63400640 1 -- 172.21.15.175:0/1486902290 learned_addr learned my addr 172.21.15.175:0/1486902290 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:25.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.518+0000 7fba62a00640 1 --2- 172.21.15.175:0/1486902290 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba641600a0 0x7fba640cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.518+0000 7fba63e00640 1 --2- 172.21.15.175:0/1486902290 >> v2:172.21.15.177:3300/0 conn(0x7fba640ce970 0x7fba640cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.518+0000 7fba63400640 1 -- 172.21.15.175:0/1486902290 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba641600a0 msgr2=0x7fba640cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:25.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.518+0000 7fba63400640 1 --2- 172.21.15.175:0/1486902290 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba641600a0 0x7fba640cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.518+0000 7fba63400640 1 -- 172.21.15.175:0/1486902290 >> v2:172.21.15.177:3300/0 conn(0x7fba640ce970 msgr2=0x7fba640cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:25.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.518+0000 7fba63400640 1 --2- 172.21.15.175:0/1486902290 >> v2:172.21.15.177:3300/0 conn(0x7fba640ce970 0x7fba640cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.518+0000 7fba63400640 1 -- 172.21.15.175:0/1486902290 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6415f8a0 con 0x7fba64145250 2024-04-25T09:11:25.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.522+0000 7fba63400640 1 --2- 172.21.15.175:0/1486902290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba64145250 0x7fba640cf6b0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fba64071260 tx=0x7fba5401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586be79346b2cc6f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:25.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.522+0000 7fba62000640 1 -- 172.21.15.175:0/1486902290 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba540aa430 con 0x7fba64145250 2024-04-25T09:11:25.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.522+0000 7fba62000640 1 -- 172.21.15.175:0/1486902290 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba540af070 con 0x7fba64145250 2024-04-25T09:11:25.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.522+0000 7fba62000640 1 -- 172.21.15.175:0/1486902290 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba540aa7f0 con 0x7fba64145250 2024-04-25T09:11:25.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.522+0000 7fba6a000640 1 -- 172.21.15.175:0/1486902290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba64145250 msgr2=0x7fba640cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.522+0000 7fba6a000640 1 --2- 172.21.15.175:0/1486902290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba64145250 0x7fba640cf6b0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fba64071260 tx=0x7fba5401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.522+0000 7fba6a000640 1 -- 172.21.15.175:0/1486902290 shutdown_connections 2024-04-25T09:11:25.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.522+0000 7fba6a000640 1 --2- 172.21.15.175:0/1486902290 >> v2:172.21.15.177:3300/0 conn(0x7fba640ce970 0x7fba640cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.522+0000 7fba6a000640 1 --2- 172.21.15.175:0/1486902290 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba641600a0 0x7fba640cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.522+0000 7fba6a000640 1 --2- 172.21.15.175:0/1486902290 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba64145250 0x7fba640cf6b0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.522+0000 7fba6a000640 1 -- 172.21.15.175:0/1486902290 >> 172.21.15.175:0/1486902290 conn(0x7fba6406ac50 msgr2=0x7fba6406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:25.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.522+0000 7fba6a000640 1 -- 172.21.15.175:0/1486902290 shutdown_connections 2024-04-25T09:11:25.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.522+0000 7fba6a000640 1 -- 172.21.15.175:0/1486902290 wait complete. 2024-04-25T09:11:25.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba6a000640 1 Processor -- start 2024-04-25T09:11:25.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba6a000640 1 -- start start 2024-04-25T09:11:25.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba6a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba640ce970 0x7fba64143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba6a000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba64145250 0x7fba64142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba6a000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba641600a0 0x7fba64165c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba6a000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba64160480 con 0x7fba640ce970 2024-04-25T09:11:25.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba6a000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba64145630 con 0x7fba641600a0 2024-04-25T09:11:25.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba6a000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba64160600 con 0x7fba64145250 2024-04-25T09:11:25.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba63400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba640ce970 0x7fba64143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba63400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba640ce970 0x7fba64143870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46742/0 (socket says 172.21.15.175:46742) 2024-04-25T09:11:25.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba63400640 1 -- 172.21.15.175:0/2855097178 learned_addr learned my addr 172.21.15.175:0/2855097178 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:25.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba62a00640 1 --2- 172.21.15.175:0/2855097178 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba64145250 0x7fba64142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba63e00640 1 --2- 172.21.15.175:0/2855097178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba641600a0 0x7fba64165c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba63400640 1 -- 172.21.15.175:0/2855097178 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba64145250 msgr2=0x7fba64142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba63400640 1 --2- 172.21.15.175:0/2855097178 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba64145250 0x7fba64142870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba63400640 1 -- 172.21.15.175:0/2855097178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba641600a0 msgr2=0x7fba64165c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba63400640 1 --2- 172.21.15.175:0/2855097178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba641600a0 0x7fba64165c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba63400640 1 -- 172.21.15.175:0/2855097178 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba64141480 con 0x7fba640ce970 2024-04-25T09:11:25.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba63400640 1 --2- 172.21.15.175:0/2855097178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba640ce970 0x7fba64143870 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fba5401cd90 tx=0x7fba5401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:25.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba5b400640 1 -- 172.21.15.175:0/2855097178 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba540bd5f0 con 0x7fba640ce970 2024-04-25T09:11:25.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba5b400640 1 -- 172.21.15.175:0/2855097178 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba540bd790 con 0x7fba640ce970 2024-04-25T09:11:25.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba5b400640 1 -- 172.21.15.175:0/2855097178 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba540bdb60 con 0x7fba640ce970 2024-04-25T09:11:25.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba6a000640 1 -- 172.21.15.175:0/2855097178 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba64141760 con 0x7fba640ce970 2024-04-25T09:11:25.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.526+0000 7fba6a000640 1 -- 172.21.15.175:0/2855097178 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba64141d20 con 0x7fba640ce970 2024-04-25T09:11:25.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.530+0000 7fba6a000640 1 -- 172.21.15.175:0/2855097178 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba64075160 con 0x7fba640ce970 2024-04-25T09:11:25.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.530+0000 7fba5b400640 1 -- 172.21.15.175:0/2855097178 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fba540b33f0 con 0x7fba640ce970 2024-04-25T09:11:25.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.530+0000 7fba5b400640 1 --2- 172.21.15.175:0/2855097178 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fba44066f60 0x7fba44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.530+0000 7fba5b400640 1 -- 172.21.15.175:0/2855097178 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fba5411f4e0 con 0x7fba640ce970 2024-04-25T09:11:25.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.530+0000 7fba62a00640 1 --2- 172.21.15.175:0/2855097178 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fba44066f60 0x7fba44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.530+0000 7fba62a00640 1 --2- 172.21.15.175:0/2855097178 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fba44066f60 0x7fba44069420 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fba640cbb20 tx=0x7fba50008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:25.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.534+0000 7fba5b400640 1 -- 172.21.15.175:0/2855097178 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fba54016110 con 0x7fba640ce970 2024-04-25T09:11:25.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.698+0000 7fba6a000640 1 -- 172.21.15.175:0/2855097178 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fba64141f60 con 0x7fba640ce970 2024-04-25T09:11:25.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.698+0000 7fba5b400640 1 -- 172.21.15.175:0/2855097178 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v87) v1 ==== 80+0+124 (secure 0 0 0) 0x7fba540efec0 con 0x7fba640ce970 2024-04-25T09:11:25.689 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175:6837/1755192276 2024-04-26T09:10:14.425304+0000 2024-04-25T09:11:25.689 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175:6835/1755192276 2024-04-26T09:10:14.425304+0000 2024-04-25T09:11:25.689 INFO:teuthology.orchestra.run.smithi175.stderr:listed 2 entries 2024-04-25T09:11:25.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.702+0000 7fba6a000640 1 -- 172.21.15.175:0/2855097178 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fba44066f60 msgr2=0x7fba44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.702+0000 7fba6a000640 1 --2- 172.21.15.175:0/2855097178 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fba44066f60 0x7fba44069420 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fba640cbb20 tx=0x7fba50008040 comp rx=0 tx=0).stop 2024-04-25T09:11:25.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.702+0000 7fba6a000640 1 -- 172.21.15.175:0/2855097178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba640ce970 msgr2=0x7fba64143870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.702+0000 7fba6a000640 1 --2- 172.21.15.175:0/2855097178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba640ce970 0x7fba64143870 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fba5401cd90 tx=0x7fba5401ad30 comp rx=0 tx=0).stop 2024-04-25T09:11:25.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.702+0000 7fba6a000640 1 -- 172.21.15.175:0/2855097178 shutdown_connections 2024-04-25T09:11:25.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.702+0000 7fba6a000640 1 --2- 172.21.15.175:0/2855097178 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fba44066f60 0x7fba44069420 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.702+0000 7fba6a000640 1 --2- 172.21.15.175:0/2855097178 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba641600a0 0x7fba64165c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.702+0000 7fba6a000640 1 --2- 172.21.15.175:0/2855097178 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba64145250 0x7fba64142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.702+0000 7fba6a000640 1 --2- 172.21.15.175:0/2855097178 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba640ce970 0x7fba64143870 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.702+0000 7fba6a000640 1 -- 172.21.15.175:0/2855097178 >> 172.21.15.175:0/2855097178 conn(0x7fba6406ac50 msgr2=0x7fba640cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:25.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.702+0000 7fba6a000640 1 -- 172.21.15.175:0/2855097178 shutdown_connections 2024-04-25T09:11:25.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.702+0000 7fba6a000640 1 -- 172.21.15.175:0/2855097178 wait complete. 2024-04-25T09:11:25.710 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:11:25.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:25.710 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:25.738 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:11:25.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:25.738 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:11:25.791 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:25.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.982+0000 7f0a52000640 1 Processor -- start 2024-04-25T09:11:25.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.982+0000 7f0a52000640 1 -- start start 2024-04-25T09:11:25.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.982+0000 7f0a52000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a4c0d0140 0x7f0a4c0d1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.982+0000 7f0a52000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0a4c0cf470 0x7f0a4c06ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.982+0000 7f0a52000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a4c0d06b0 con 0x7f0a4c15ba90 2024-04-25T09:11:25.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.982+0000 7f0a52000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4c0d0c90 con 0x7f0a4c0cf470 2024-04-25T09:11:25.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.982+0000 7f0a52000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c06b2f0 con 0x7f0a4c0d0140 2024-04-25T09:11:25.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.982+0000 7f0a50c00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f0a4c15ba90 0x7f0a4c0cfa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:33528/0 (socket says 172.21.15.175:33528) 2024-04-25T09:11:25.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.982+0000 7f0a50c00640 1 -- 172.21.15.175:0/1954789647 learned_addr learned my addr 172.21.15.175:0/1954789647 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:11:25.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.982+0000 7f0a4be00640 1 --2- 172.21.15.175:0/1954789647 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a4c0d0140 0x7f0a4c0d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.982+0000 7f0a51600640 1 --2- 172.21.15.175:0/1954789647 >> v2:172.21.15.177:3300/0 conn(0x7f0a4c0cf470 0x7f0a4c06ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.982+0000 7f0a4b400640 1 -- 172.21.15.175:0/1954789647 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5148133 0 0) 0x7f0a4c0d06b0 con 0x7f0a4c15ba90 2024-04-25T09:11:25.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.982+0000 7f0a4b400640 1 -- 172.21.15.175:0/1954789647 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a34003530 con 0x7f0a4c15ba90 2024-04-25T09:11:25.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.982+0000 7f0a51600640 1 -- 172.21.15.175:0/1954789647 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a4c0d0140 msgr2=0x7f0a4c0d1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:25.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.982+0000 7f0a51600640 1 --2- 172.21.15.175:0/1954789647 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a4c0d0140 0x7f0a4c0d1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.982+0000 7f0a51600640 1 -- 172.21.15.175:0/1954789647 >> v1:172.21.15.175:6789/0 conn(0x7f0a4c15ba90 legacy=0x7f0a4c0cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.982+0000 7f0a51600640 1 -- 172.21.15.175:0/1954789647 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c0d0920 con 0x7f0a4c0cf470 2024-04-25T09:11:25.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.982+0000 7f0a4be00640 1 --2- 172.21.15.175:0/1954789647 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a4c0d0140 0x7f0a4c0d1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:25.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.986+0000 7f0a51600640 1 --2- 172.21.15.175:0/1954789647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a4c0cf470 0x7f0a4c06ac50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0a44009d90 tx=0x7f0a4401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35c07c7809561d1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:25.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.986+0000 7f0a4b400640 1 -- 172.21.15.175:0/1954789647 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a440b2070 con 0x7f0a4c0cf470 2024-04-25T09:11:25.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.986+0000 7f0a4b400640 1 -- 172.21.15.175:0/1954789647 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a440a5940 con 0x7f0a4c0cf470 2024-04-25T09:11:25.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.986+0000 7f0a4b400640 1 -- 172.21.15.175:0/1954789647 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a440a5d10 con 0x7f0a4c0cf470 2024-04-25T09:11:25.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.986+0000 7f0a52000640 1 -- 172.21.15.175:0/1954789647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a4c0cf470 msgr2=0x7f0a4c06ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.986+0000 7f0a52000640 1 --2- 172.21.15.175:0/1954789647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a4c0cf470 0x7f0a4c06ac50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0a44009d90 tx=0x7f0a4401c970 comp rx=0 tx=0).stop 2024-04-25T09:11:25.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.986+0000 7f0a52000640 1 -- 172.21.15.175:0/1954789647 shutdown_connections 2024-04-25T09:11:25.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.986+0000 7f0a52000640 1 --2- 172.21.15.175:0/1954789647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a4c0cf470 0x7f0a4c06ac50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.986+0000 7f0a52000640 1 --2- 172.21.15.175:0/1954789647 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a4c0d0140 0x7f0a4c0d1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.986+0000 7f0a52000640 1 -- 172.21.15.175:0/1954789647 >> 172.21.15.175:0/1954789647 conn(0x7f0a4c072760 msgr2=0x7f0a4c099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:25.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.986+0000 7f0a52000640 1 -- 172.21.15.175:0/1954789647 shutdown_connections 2024-04-25T09:11:25.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.986+0000 7f0a52000640 1 -- 172.21.15.175:0/1954789647 wait complete. 2024-04-25T09:11:25.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a52000640 1 Processor -- start 2024-04-25T09:11:25.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a52000640 1 -- start start 2024-04-25T09:11:25.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a52000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a4c0cf470 0x7f0a4c1539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a52000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a4c0d0140 0x7f0a4c0b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a52000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a4c15ba90 0x7f0a4c06fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a52000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c0adf30 con 0x7f0a4c0d0140 2024-04-25T09:11:25.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a52000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c0addb0 con 0x7f0a4c0cf470 2024-04-25T09:11:25.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a52000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c0ae0b0 con 0x7f0a4c15ba90 2024-04-25T09:11:25.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a4be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a4c0d0140 0x7f0a4c0b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a4be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a4c0d0140 0x7f0a4c0b1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46750/0 (socket says 172.21.15.175:46750) 2024-04-25T09:11:25.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a4be00640 1 -- 172.21.15.175:0/3293680762 learned_addr learned my addr 172.21.15.175:0/3293680762 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:25.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a50c00640 1 --2- 172.21.15.175:0/3293680762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a4c0cf470 0x7f0a4c1539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a51600640 1 --2- 172.21.15.175:0/3293680762 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a4c15ba90 0x7f0a4c06fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a4be00640 1 -- 172.21.15.175:0/3293680762 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a4c15ba90 msgr2=0x7f0a4c06fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a4be00640 1 --2- 172.21.15.175:0/3293680762 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a4c15ba90 0x7f0a4c06fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a4be00640 1 -- 172.21.15.175:0/3293680762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a4c0cf470 msgr2=0x7f0a4c1539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a4be00640 1 --2- 172.21.15.175:0/3293680762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a4c0cf470 0x7f0a4c1539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a4be00640 1 -- 172.21.15.175:0/3293680762 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c0b2380 con 0x7f0a4c0d0140 2024-04-25T09:11:25.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a4be00640 1 --2- 172.21.15.175:0/3293680762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a4c0d0140 0x7f0a4c0b1950 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800ebe0 tx=0x7f0a3800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:25.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a48c00640 1 -- 172.21.15.175:0/3293680762 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38017070 con 0x7f0a4c0d0140 2024-04-25T09:11:25.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a48c00640 1 -- 172.21.15.175:0/3293680762 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3800cc30 con 0x7f0a4c0d0140 2024-04-25T09:11:25.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a48c00640 1 -- 172.21.15.175:0/3293680762 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38013470 con 0x7f0a4c0d0140 2024-04-25T09:11:25.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a52000640 1 -- 172.21.15.175:0/3293680762 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4c06ed70 con 0x7f0a4c0d0140 2024-04-25T09:11:25.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a52000640 1 -- 172.21.15.175:0/3293680762 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c06f330 con 0x7f0a4c0d0140 2024-04-25T09:11:25.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.990+0000 7f0a52000640 1 -- 172.21.15.175:0/3293680762 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4c067900 con 0x7f0a4c0d0140 2024-04-25T09:11:25.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.994+0000 7f0a48c00640 1 -- 172.21.15.175:0/3293680762 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0a3801a070 con 0x7f0a4c0d0140 2024-04-25T09:11:25.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.994+0000 7f0a48c00640 1 --2- 172.21.15.175:0/3293680762 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0a2c066f90 0x7f0a2c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.994+0000 7f0a48c00640 1 -- 172.21.15.175:0/3293680762 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f0a380852f0 con 0x7f0a4c0d0140 2024-04-25T09:11:25.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.994+0000 7f0a50c00640 1 --2- 172.21.15.175:0/3293680762 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0a2c066f90 0x7f0a2c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.994+0000 7f0a50c00640 1 --2- 172.21.15.175:0/3293680762 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0a2c066f90 0x7f0a2c069450 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0a40007fd0 tx=0x7f0a40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:25.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:25.998+0000 7f0a48c00640 1 -- 172.21.15.175:0/3293680762 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0a38055c40 con 0x7f0a4c0d0140 2024-04-25T09:11:26.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.186+0000 7f0a52000640 1 -- 172.21.15.175:0/3293680762 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a4c074a60 con 0x7f0a4c0d0140 2024-04-25T09:11:26.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.186+0000 7f0a48c00640 1 -- 172.21.15.175:0/3293680762 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f0a38059ce0 con 0x7f0a4c0d0140 2024-04-25T09:11:26.176 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:11:26.176 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3229536012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3229536012},{"type":"v1","addr":"172.21.15.177:6834","nonce":3229536012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/222649735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":222649735},{"type":"v1","addr":"172.21.15.177:6835","nonce":222649735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2888989442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2888989442},{"type":"v1","addr":"172.21.15.175:6836","nonce":2888989442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:03.786939+0000","modified":"2024-04-25T09:10:25.509619+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":85,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7419},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7419":{"gid":7419,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":6,"addr":"172.21.15.175:6837/1399691338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":1399691338},{"type":"v1","addr":"172.21.15.175:6837","nonce":1399691338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:11:26.176 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 65 2024-04-25T09:11:26.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.186+0000 7f0a52000640 1 -- 172.21.15.175:0/3293680762 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0a2c066f90 msgr2=0x7f0a2c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.186+0000 7f0a52000640 1 --2- 172.21.15.175:0/3293680762 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0a2c066f90 0x7f0a2c069450 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0a40007fd0 tx=0x7f0a40009040 comp rx=0 tx=0).stop 2024-04-25T09:11:26.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.186+0000 7f0a52000640 1 -- 172.21.15.175:0/3293680762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a4c0d0140 msgr2=0x7f0a4c0b1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.186+0000 7f0a52000640 1 --2- 172.21.15.175:0/3293680762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a4c0d0140 0x7f0a4c0b1950 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800ebe0 tx=0x7f0a3800c520 comp rx=0 tx=0).stop 2024-04-25T09:11:26.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.186+0000 7f0a52000640 1 -- 172.21.15.175:0/3293680762 shutdown_connections 2024-04-25T09:11:26.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.186+0000 7f0a52000640 1 --2- 172.21.15.175:0/3293680762 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0a2c066f90 0x7f0a2c069450 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.186+0000 7f0a52000640 1 --2- 172.21.15.175:0/3293680762 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a4c15ba90 0x7f0a4c06fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.186+0000 7f0a52000640 1 --2- 172.21.15.175:0/3293680762 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a4c0d0140 0x7f0a4c0b1950 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.186+0000 7f0a52000640 1 --2- 172.21.15.175:0/3293680762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a4c0cf470 0x7f0a4c1539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.186+0000 7f0a52000640 1 -- 172.21.15.175:0/3293680762 >> 172.21.15.175:0/3293680762 conn(0x7f0a4c072760 msgr2=0x7f0a4c099a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:26.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.186+0000 7f0a52000640 1 -- 172.21.15.175:0/3293680762 shutdown_connections 2024-04-25T09:11:26.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.186+0000 7f0a52000640 1 -- 172.21.15.175:0/3293680762 wait complete. 2024-04-25T09:11:26.197 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T09:11:26.362 INFO:teuthology.orchestra.run.smithi175.stdout:{"message":"","return_code":0} 2024-04-25T09:11:26.362 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:11:26.362 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:11:26.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.506+0000 7f883d600640 1 Processor -- start 2024-04-25T09:11:26.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.506+0000 7f883d600640 1 -- start start 2024-04-25T09:11:26.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.510+0000 7f883d600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f88380cf080 0x7f88381600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.510+0000 7f883d600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88380cfd10 con 0x7f8838145250 2024-04-25T09:11:26.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.510+0000 7f883d600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88380cfff0 con 0x7f88380cf6b0 2024-04-25T09:11:26.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.510+0000 7f883d600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88381605e0 con 0x7f88380cf080 2024-04-25T09:11:26.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.510+0000 7f8836a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f8838145250 0x7f88380cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:33532/0 (socket says 172.21.15.175:33532) 2024-04-25T09:11:26.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.510+0000 7f8836a00640 1 -- 172.21.15.175:0/3777912486 learned_addr learned my addr 172.21.15.175:0/3777912486 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:11:26.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.510+0000 7f8837400640 1 --2- 172.21.15.175:0/3777912486 >> v2:172.21.15.175:3300/0 conn(0x7f88380cf080 0x7f88381600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.510+0000 7f8836000640 1 -- 172.21.15.175:0/3777912486 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322168968 0 0) 0x7f88380cfd10 con 0x7f8838145250 2024-04-25T09:11:26.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.510+0000 7f8836000640 1 -- 172.21.15.175:0/3777912486 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f881c003530 con 0x7f8838145250 2024-04-25T09:11:26.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.510+0000 7f8837400640 1 -- 172.21.15.175:0/3777912486 >> v1:172.21.15.177:6789/0 conn(0x7f88380cf6b0 legacy=0x7f88380ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.510+0000 7f8837400640 1 -- 172.21.15.175:0/3777912486 >> v1:172.21.15.175:6789/0 conn(0x7f8838145250 legacy=0x7f88380cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.510+0000 7f8837400640 1 -- 172.21.15.175:0/3777912486 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883815f8a0 con 0x7f88380cf080 2024-04-25T09:11:26.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.514+0000 7f8837400640 1 --2- 172.21.15.175:0/3777912486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88380cf080 0x7f88381600a0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f8830009dc0 tx=0x7f883001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabb99b1b9e3f44f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.514+0000 7f8836000640 1 -- 172.21.15.175:0/3777912486 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88300b2070 con 0x7f88380cf080 2024-04-25T09:11:26.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.514+0000 7f8836000640 1 -- 172.21.15.175:0/3777912486 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88300a5780 con 0x7f88380cf080 2024-04-25T09:11:26.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.514+0000 7f8836000640 1 -- 172.21.15.175:0/3777912486 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88300a5b50 con 0x7f88380cf080 2024-04-25T09:11:26.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.514+0000 7f883d600640 1 -- 172.21.15.175:0/3777912486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88380cf080 msgr2=0x7f88381600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.514+0000 7f883d600640 1 --2- 172.21.15.175:0/3777912486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88380cf080 0x7f88381600a0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f8830009dc0 tx=0x7f883001c8c0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.514+0000 7f883d600640 1 -- 172.21.15.175:0/3777912486 shutdown_connections 2024-04-25T09:11:26.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.514+0000 7f883d600640 1 --2- 172.21.15.175:0/3777912486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88380cf080 0x7f88381600a0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.514+0000 7f883d600640 1 -- 172.21.15.175:0/3777912486 >> 172.21.15.175:0/3777912486 conn(0x7f883806ac50 msgr2=0x7f883806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:26.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.514+0000 7f883d600640 1 -- 172.21.15.175:0/3777912486 shutdown_connections 2024-04-25T09:11:26.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.514+0000 7f883d600640 1 -- 172.21.15.175:0/3777912486 wait complete. 2024-04-25T09:11:26.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.514+0000 7f883d600640 1 Processor -- start 2024-04-25T09:11:26.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.514+0000 7f883d600640 1 -- start start 2024-04-25T09:11:26.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f883d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88380cf080 0x7f88381464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f883d600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88380cf6b0 0x7f88380ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f883d600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8838145250 0x7f883813cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f883d600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883815cc80 con 0x7f88380cf080 2024-04-25T09:11:26.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f883d600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883815cb00 con 0x7f88380cf6b0 2024-04-25T09:11:26.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f883d600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88381697f0 con 0x7f8838145250 2024-04-25T09:11:26.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f8836a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88380cf080 0x7f88381464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f8836a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88380cf080 0x7f88381464f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46766/0 (socket says 172.21.15.175:46766) 2024-04-25T09:11:26.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f8836a00640 1 -- 172.21.15.175:0/351814470 learned_addr learned my addr 172.21.15.175:0/351814470 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:26.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f882e000640 1 --2- 172.21.15.175:0/351814470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88380cf6b0 0x7f88380ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f8837400640 1 --2- 172.21.15.175:0/351814470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8838145250 0x7f883813cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f8836a00640 1 -- 172.21.15.175:0/351814470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8838145250 msgr2=0x7f883813cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f8836a00640 1 --2- 172.21.15.175:0/351814470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8838145250 0x7f883813cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f8836a00640 1 -- 172.21.15.175:0/351814470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88380cf6b0 msgr2=0x7f88380ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f8836a00640 1 --2- 172.21.15.175:0/351814470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88380cf6b0 0x7f88380ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f8836a00640 1 -- 172.21.15.175:0/351814470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88380ae080 con 0x7f88380cf080 2024-04-25T09:11:26.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f8836a00640 1 --2- 172.21.15.175:0/351814470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88380cf080 0x7f88381464f0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f882800c4d0 tx=0x7f882800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f882f400640 1 -- 172.21.15.175:0/351814470 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828017070 con 0x7f88380cf080 2024-04-25T09:11:26.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f882f400640 1 -- 172.21.15.175:0/351814470 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8828005cf0 con 0x7f88380cf080 2024-04-25T09:11:26.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f882f400640 1 -- 172.21.15.175:0/351814470 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828007270 con 0x7f88380cf080 2024-04-25T09:11:26.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f883d600640 1 -- 172.21.15.175:0/351814470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88380ae360 con 0x7f88380cf080 2024-04-25T09:11:26.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f883d600640 1 -- 172.21.15.175:0/351814470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88380ae920 con 0x7f88380cf080 2024-04-25T09:11:26.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f883d600640 1 -- 172.21.15.175:0/351814470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8838075160 con 0x7f88380cf080 2024-04-25T09:11:26.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.518+0000 7f882f400640 1 -- 172.21.15.175:0/351814470 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f882801a070 con 0x7f88380cf080 2024-04-25T09:11:26.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.522+0000 7f882f400640 1 --2- 172.21.15.175:0/351814470 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8814066f60 0x7f8814069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.522+0000 7f882f400640 1 -- 172.21.15.175:0/351814470 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f8828084470 con 0x7f88380cf080 2024-04-25T09:11:26.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.522+0000 7f882e000640 1 --2- 172.21.15.175:0/351814470 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8814066f60 0x7f8814069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.522+0000 7f882e000640 1 --2- 172.21.15.175:0/351814470 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8814066f60 0x7f8814069420 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f88380b48f0 tx=0x7f8820009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.526+0000 7f882f400640 1 -- 172.21.15.175:0/351814470 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8828054d40 con 0x7f88380cf080 2024-04-25T09:11:26.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.710+0000 7f883d600640 1 -- 172.21.15.175:0/351814470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8838146c10 con 0x7f88380cf080 2024-04-25T09:11:26.700 INFO:tasks.ceph.mon.a.smithi175.stderr:2024-04-25T09:11:26.710+0000 7feb0ee00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:11:26.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.710+0000 7f882f400640 1 -- 172.21.15.175:0/351814470 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v66) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8828058de0 con 0x7f88380cf080 2024-04-25T09:11:26.702 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:11:26.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.714+0000 7f883d600640 1 -- 172.21.15.175:0/351814470 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8814066f60 msgr2=0x7f8814069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.714+0000 7f883d600640 1 --2- 172.21.15.175:0/351814470 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8814066f60 0x7f8814069420 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f88380b48f0 tx=0x7f8820009040 comp rx=0 tx=0).stop 2024-04-25T09:11:26.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.714+0000 7f883d600640 1 -- 172.21.15.175:0/351814470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88380cf080 msgr2=0x7f88381464f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.714+0000 7f883d600640 1 --2- 172.21.15.175:0/351814470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88380cf080 0x7f88381464f0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f882800c4d0 tx=0x7f882800c990 comp rx=0 tx=0).stop 2024-04-25T09:11:26.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.714+0000 7f883d600640 1 -- 172.21.15.175:0/351814470 shutdown_connections 2024-04-25T09:11:26.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.714+0000 7f883d600640 1 --2- 172.21.15.175:0/351814470 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8814066f60 0x7f8814069420 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.714+0000 7f883d600640 1 --2- 172.21.15.175:0/351814470 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8838145250 0x7f883813cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.714+0000 7f883d600640 1 --2- 172.21.15.175:0/351814470 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88380cf6b0 0x7f88380ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.714+0000 7f883d600640 1 --2- 172.21.15.175:0/351814470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88380cf080 0x7f88381464f0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.714+0000 7f883d600640 1 -- 172.21.15.175:0/351814470 >> 172.21.15.175:0/351814470 conn(0x7f883806ac50 msgr2=0x7f88380b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:26.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.714+0000 7f883d600640 1 -- 172.21.15.175:0/351814470 shutdown_connections 2024-04-25T09:11:26.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.714+0000 7f883d600640 1 -- 172.21.15.175:0/351814470 wait complete. 2024-04-25T09:11:26.715 INFO:tasks.ceph.mds.c.smithi175.stderr: -4569> 2024-04-25T09:10:20.498+0000 7f8346200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:11:26.715 INFO:tasks.ceph.mds.c.smithi175.stderr: -4235> 2024-04-25T09:10:21.162+0000 7f8341200640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-25T09:11:26.715 INFO:tasks.ceph.mds.c.smithi175.stderr: -4073> 2024-04-25T09:10:21.390+0000 7f8341200640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-04-25T09:10:11.367023+0000 1=1+0) n(v0 rc2024-04-25T09:10:11.479022+0000 2=1+1) (iversion lock) | dirfrag=0 authpin=1 scrubqueue=0 0x55ca89620100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T09:10:11.367023+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T09:10:11.479022+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-25T09:11:26.719 INFO:tasks.ceph.mds.c.smithi175.stderr: -2224> 2024-04-25T09:10:52.942+0000 7f8341200640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv20 ap=3 DIRTYPARENT f(v0 m2024-04-25T09:10:11.367023+0000 1=1+0)->f(v1 m2024-04-25T09:10:11.367023+0000) n(v0 rc2024-04-25T09:10:11.479022+0000 2=1+1)->n(v0 rc2024-04-25T09:10:11.479022+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x55ca89620100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T09:10:11.367023+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T09:10:11.479022+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-04-25T09:11:26.726 DEBUG:teuthology.orchestra.run.smithi175:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-04-25T09:11:26.763 INFO:tasks.ceph.mds.c.smithi175.stdout:starting mds.c at 2024-04-25T09:11:26.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f75339848c0 1 -- start start 2024-04-25T09:11:26.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f75339848c0 1 Processor -- start 2024-04-25T09:11:26.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f75339848c0 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c1dcb800 0x55d7c1f84580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f75339848c0 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d7c1dcb400 0x55d7c1f84b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f75339848c0 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c1dcb000 0x55d7c1f85080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f75339848c0 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7c2ba4180 con 0x55d7c1dcb800 2024-04-25T09:11:26.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f75339848c0 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7c2ba4300 con 0x55d7c1dcb000 2024-04-25T09:11:26.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f75339848c0 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7c2ba4480 con 0x55d7c1dcb400 2024-04-25T09:11:26.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f7531a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c1dcb800 0x55d7c1f84580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f7531a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c1dcb800 0x55d7c1f84580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46786/0 (socket says 172.21.15.175:46786) 2024-04-25T09:11:26.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f7531a00640 1 -- 172.21.15.175:0/3206425830 learned_addr learned my addr 172.21.15.175:0/3206425830 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:26.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f7532400640 1 --2- 172.21.15.175:0/3206425830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c1dcb000 0x55d7c1f85080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f7531000640 1 --2- 172.21.15.175:0/3206425830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d7c1dcb400 0x55d7c1f84b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f7531a00640 1 -- 172.21.15.175:0/3206425830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d7c1dcb400 msgr2=0x55d7c1f84b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:26.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f7531a00640 1 --2- 172.21.15.175:0/3206425830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d7c1dcb400 0x55d7c1f84b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f7531a00640 1 -- 172.21.15.175:0/3206425830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c1dcb000 msgr2=0x55d7c1f85080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:26.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f7531a00640 1 --2- 172.21.15.175:0/3206425830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c1dcb000 0x55d7c1f85080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f7531a00640 1 -- 172.21.15.175:0/3206425830 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7c1df01e0 con 0x55d7c1dcb800 2024-04-25T09:11:26.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f7531000640 1 --2- 172.21.15.175:0/3206425830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d7c1dcb400 0x55d7c1f84b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:26.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f7531a00640 1 --2- 172.21.15.175:0/3206425830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c1dcb800 0x55d7c1f84580 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x55d7c2c11110 tx=0x55d7c1e85d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e7f039eefcddc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f752e800640 1 -- 172.21.15.175:0/3206425830 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d7c1e009c0 con 0x55d7c1dcb800 2024-04-25T09:11:26.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f752e800640 1 -- 172.21.15.175:0/3206425830 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d7c1e141c0 con 0x55d7c1dcb800 2024-04-25T09:11:26.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f752e800640 1 -- 172.21.15.175:0/3206425830 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d7c1e004e0 con 0x55d7c1dcb800 2024-04-25T09:11:26.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f75339848c0 1 -- 172.21.15.175:0/3206425830 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7c1df12c0 con 0x55d7c1dcb800 2024-04-25T09:11:26.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f75339848c0 1 -- 172.21.15.175:0/3206425830 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55d7c1df03c0 con 0x55d7c1dcb800 2024-04-25T09:11:26.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f75339848c0 4 waiting for MDS map... 2024-04-25T09:11:26.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f752e800640 1 -- 172.21.15.175:0/3206425830 <== mon.0 v2:172.21.15.175:3300/0 4 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x55d7c2cd8200 con 0x55d7c1dcb800 2024-04-25T09:11:26.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f752e800640 1 -- 172.21.15.175:0/3206425830 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 66) v1 ==== 2723+0+0 (secure 0 0 0) 0x55d7c1e21180 con 0x55d7c1dcb800 2024-04-25T09:11:26.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f75339848c0 4 Got MDS map 66 2024-04-25T09:11:26.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f75339848c0 4 datascan.main: Using metadata pool output 2024-04-25T09:11:26.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f75339848c0 4 datascan.main: connecting to RADOS... 2024-04-25T09:11:26.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f75339848c0 1 Processor -- start 2024-04-25T09:11:26.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.782+0000 7f75339848c0 1 -- start start 2024-04-25T09:11:26.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d7c1ec5800 0x55d7c1f85600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c1ec5c00 0x55d7c1f85b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c2d3c000 0x55d7c1f86100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7c2ba4600 con 0x55d7c2d3c000 2024-04-25T09:11:26.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7c2ba4780 con 0x55d7c1ec5c00 2024-04-25T09:11:26.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7c2ba4900 con 0x55d7c1ec5800 2024-04-25T09:11:26.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f7531000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c2d3c000 0x55d7c1f86100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f7531000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c2d3c000 0x55d7c1f86100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46790/0 (socket says 172.21.15.175:46790) 2024-04-25T09:11:26.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f7531000640 1 -- 172.21.15.175:0/2308704614 learned_addr learned my addr 172.21.15.175:0/2308704614 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:26.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f7532400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d7c1ec5800 0x55d7c1f85600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f7531a00640 1 --2- 172.21.15.175:0/2308704614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c1ec5c00 0x55d7c1f85b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f7531a00640 1 -- 172.21.15.175:0/2308704614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d7c1ec5800 msgr2=0x55d7c1f85600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:26.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f7531a00640 1 --2- 172.21.15.175:0/2308704614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d7c1ec5800 0x55d7c1f85600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f7531a00640 1 -- 172.21.15.175:0/2308704614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c2d3c000 msgr2=0x55d7c1f86100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:26.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f7531a00640 1 --2- 172.21.15.175:0/2308704614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c2d3c000 0x55d7c1f86100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f7531a00640 1 -- 172.21.15.175:0/2308704614 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7c1df01e0 con 0x55d7c1ec5c00 2024-04-25T09:11:26.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f7531000640 1 --2- 172.21.15.175:0/2308704614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c2d3c000 0x55d7c1f86100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:26.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f7531a00640 1 --2- 172.21.15.175:0/2308704614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c1ec5c00 0x55d7c1f85b80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x55d7c2c11d70 tx=0x55d7c1e85da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=add5deb030c92e60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f752c000640 1 -- 172.21.15.175:0/2308704614 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d7c1e00b60 con 0x55d7c1ec5c00 2024-04-25T09:11:26.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f752c000640 1 -- 172.21.15.175:0/2308704614 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d7c1e14e00 con 0x55d7c1ec5c00 2024-04-25T09:11:26.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f752c000640 1 -- 172.21.15.175:0/2308704614 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d7c1e00340 con 0x55d7c1ec5c00 2024-04-25T09:11:26.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 -- 172.21.15.175:0/2308704614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c1ec5c00 msgr2=0x55d7c1f85b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 --2- 172.21.15.175:0/2308704614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c1ec5c00 0x55d7c1f85b80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x55d7c2c11d70 tx=0x55d7c1e85da0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 -- 172.21.15.175:0/2308704614 shutdown_connections 2024-04-25T09:11:26.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 --2- 172.21.15.175:0/2308704614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c2d3c000 0x55d7c1f86100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 --2- 172.21.15.175:0/2308704614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c1ec5c00 0x55d7c1f85b80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 --2- 172.21.15.175:0/2308704614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d7c1ec5800 0x55d7c1f85600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 -- 172.21.15.175:0/2308704614 >> 172.21.15.175:0/2308704614 conn(0x55d7c1dcac00 msgr2=0x55d7c1df9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:26.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 -- 172.21.15.175:0/2308704614 shutdown_connections 2024-04-25T09:11:26.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 -- 172.21.15.175:0/2308704614 wait complete. 2024-04-25T09:11:26.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 Processor -- start 2024-04-25T09:11:26.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 -- start start 2024-04-25T09:11:26.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d7c1ec5c00 0x55d7c1f87180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c1ec5800 0x55d7c1f86c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c2d3d800 0x55d7c1f86680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7c2ba4d80 con 0x55d7c2d3d800 2024-04-25T09:11:26.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7c2ba5680 con 0x55d7c1ec5800 2024-04-25T09:11:26.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.786+0000 7f75339848c0 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7c2ba4a80 con 0x55d7c1ec5c00 2024-04-25T09:11:26.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f7531000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c2d3d800 0x55d7c1f86680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f7531000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c2d3d800 0x55d7c1f86680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46802/0 (socket says 172.21.15.175:46802) 2024-04-25T09:11:26.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 learned_addr learned my addr 172.21.15.175:0/817224887 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:26.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f7532400640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d7c1ec5c00 0x55d7c1f87180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f7531a00640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c1ec5800 0x55d7c1f86c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d7c1ec5c00 msgr2=0x55d7c1f87180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f7531000640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d7c1ec5c00 0x55d7c1f87180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c1ec5800 msgr2=0x55d7c1f86c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f7531000640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c1ec5800 0x55d7c1f86c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7c1df14a0 con 0x55d7c2d3d800 2024-04-25T09:11:26.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f7531000640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c2d3d800 0x55d7c1f86680 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x55d7c2b95aa0 tx=0x55d7c2d48c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f752a200640 1 -- 172.21.15.175:0/817224887 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d7c1e00b60 con 0x55d7c2d3d800 2024-04-25T09:11:26.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f752a200640 1 -- 172.21.15.175:0/817224887 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d7c1e14c40 con 0x55d7c2d3d800 2024-04-25T09:11:26.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f752a200640 1 -- 172.21.15.175:0/817224887 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d7c1e00340 con 0x55d7c2d3d800 2024-04-25T09:11:26.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d7c1df1a40 con 0x55d7c2d3d800 2024-04-25T09:11:26.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7c1df1c20 con 0x55d7c2d3d800 2024-04-25T09:11:26.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f75339848c0 4 datascan.init: resolving metadata pool 12 2024-04-25T09:11:26.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f752a200640 1 -- 172.21.15.175:0/817224887 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x55d7c2d42c00 con 0x55d7c2d3d800 2024-04-25T09:11:26.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f752a200640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55d7c2d4ac00 0x55d7c1f87700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f752a200640 1 -- 172.21.15.175:0/817224887 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x55d7c2d3ee00 con 0x55d7c2d3d800 2024-04-25T09:11:26.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f75339848c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T09:11:26.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f75339848c0 4 datascan.main: data pool 'cephfs_data' has ID 13 2024-04-25T09:11:26.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f75339848c0 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T09:11:26.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f75339848c0 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55d7c2d3d400 0x55d7c1f86100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f7532400640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55d7c2d4ac00 0x55d7c1f87700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.790+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:1 13.0 13:00000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2d3d000 con 0x55d7c2d3d400 2024-04-25T09:11:26.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.794+0000 7f7531a00640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55d7c2d3d400 0x55d7c1f86100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.794+0000 7f7532400640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55d7c2d4ac00 0x55d7c1f87700 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x55d7c1ea6ed0 tx=0x55d7c2d48f60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.794+0000 7f7531a00640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55d7c2d3d400 0x55d7c1f86100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.794+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.7 v2:172.21.15.177:6800/3881136076 1 ==== osd_op_reply(1 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c2d3d400 2024-04-25T09:11:26.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.794+0000 7f752b600640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55d7c2d4bc00 0x55d7c21ec000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.794+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:2 13.20 13:04000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c21f6000 con 0x55d7c2d4bc00 2024-04-25T09:11:26.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.794+0000 7f7532400640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55d7c2d4bc00 0x55d7c21ec000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.798+0000 7f7532400640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55d7c2d4bc00 0x55d7c21ec000 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.798+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.6 v2:172.21.15.177:6822/4132808595 1 ==== osd_op_reply(2 [pgnls start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c2d4bc00 2024-04-25T09:11:26.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.798+0000 7f752c000640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55d7c21f6800 0x55d7c21ec580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.798+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:3 13.10 13:08000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c21f6c00 con 0x55d7c21f6800 2024-04-25T09:11:26.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.798+0000 7f7531a00640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55d7c21f6800 0x55d7c21ec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.798+0000 7f7531a00640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55d7c21f6800 0x55d7c21ec580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.798+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.1 v2:172.21.15.175:6802/594808902 1 ==== osd_op_reply(3 [pgnls start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c21f6800 2024-04-25T09:11:26.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.798+0000 7f752b600640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55d7c21f6400 0x55d7c21ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.798+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:4 13.30 13:0c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c21f7400 con 0x55d7c21f6400 2024-04-25T09:11:26.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.798+0000 7f7531000640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55d7c21f6400 0x55d7c21ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.802+0000 7f7531000640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55d7c21f6400 0x55d7c21ecb00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.802+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 <== osd.4 v2:172.21.15.177:6808/236493968 1 ==== osd_op_reply(4 [pgnls start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e780 con 0x55d7c21f6400 2024-04-25T09:11:26.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.802+0000 7f752c000640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x55d7c21f7000 0x55d7c21ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.802+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:5 13.8 13:10000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220a000 con 0x55d7c21f7000 2024-04-25T09:11:26.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.802+0000 7f7532400640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x55d7c21f7000 0x55d7c21ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.802+0000 7f7532400640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x55d7c21f7000 0x55d7c21ed600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.802+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.2 v2:172.21.15.175:6821/3247063283 1 ==== osd_op_reply(5 [pgnls start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c21f7000 2024-04-25T09:11:26.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.802+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:6 13.28 13:14000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c21f7800 con 0x55d7c21f7000 2024-04-25T09:11:26.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.802+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.2 v2:172.21.15.175:6821/3247063283 2 ==== osd_op_reply(6 [pgnls start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c21f7000 2024-04-25T09:11:26.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.802+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:7 13.18 13:18000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220a400 con 0x55d7c2d3d400 2024-04-25T09:11:26.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.802+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.7 v2:172.21.15.177:6800/3881136076 2 ==== osd_op_reply(7 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c2d3d400 2024-04-25T09:11:26.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.802+0000 7f752b600640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55d7c21f7c00 0x55d7c21ed080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.802+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:8 13.38 13:1c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220a000 con 0x55d7c21f7c00 2024-04-25T09:11:26.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.802+0000 7f7531a00640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55d7c21f7c00 0x55d7c21ed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.802+0000 7f7531a00640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55d7c21f7c00 0x55d7c21ed080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.806+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.5 v2:172.21.15.177:6816/3311807078 1 ==== osd_op_reply(8 [pgnls start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c21f7c00 2024-04-25T09:11:26.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.806+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:9 13.4 13:20000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220a800 con 0x55d7c2d4bc00 2024-04-25T09:11:26.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.806+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.6 v2:172.21.15.177:6822/4132808595 2 ==== osd_op_reply(9 [pgnls start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c2d4bc00 2024-04-25T09:11:26.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.806+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:10 13.24 13:24000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c21f6000 con 0x55d7c2d4bc00 2024-04-25T09:11:26.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.806+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.6 v2:172.21.15.177:6822/4132808595 3 ==== osd_op_reply(10 [pgnls start_epoch 88 out=49b] v84'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c2d4bc00 2024-04-25T09:11:26.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.806+0000 7f752c000640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55d7c21f6c00 0x55d7c21edb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.806+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:11 13.14 13:28000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2d3dc00 con 0x55d7c21f6c00 2024-04-25T09:11:26.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.806+0000 7f7531000640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55d7c21f6c00 0x55d7c21edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.806+0000 7f7531000640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55d7c21f6c00 0x55d7c21edb80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.810+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 <== osd.0 v2:172.21.15.175:6800/1093269849 1 ==== osd_op_reply(11 [pgnls start_epoch 88 out=49b] v84'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e780 con 0x55d7c21f6c00 2024-04-25T09:11:26.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.810+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:12 13.34 13:2c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c21f7800 con 0x55d7c2d4bc00 2024-04-25T09:11:26.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.810+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.6 v2:172.21.15.177:6822/4132808595 4 ==== osd_op_reply(12 [pgnls start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c2d4bc00 2024-04-25T09:11:26.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.810+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:13 13.c 13:30000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2d3d000 con 0x55d7c21f6800 2024-04-25T09:11:26.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.810+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.1 v2:172.21.15.175:6802/594808902 2 ==== osd_op_reply(13 [pgnls start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c21f6800 2024-04-25T09:11:26.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.810+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:14 13.2c 13:34000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2d4b800 con 0x55d7c21f7000 2024-04-25T09:11:26.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.810+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.2 v2:172.21.15.175:6821/3247063283 3 ==== osd_op_reply(14 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c21f7000 2024-04-25T09:11:26.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.810+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:15 13.1c 13:38000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c1ec5400 con 0x55d7c2d4bc00 2024-04-25T09:11:26.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.810+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.6 v2:172.21.15.177:6822/4132808595 5 ==== osd_op_reply(15 [pgnls start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c2d4bc00 2024-04-25T09:11:26.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.810+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:16 13.3c 13:3c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c1ec5400 con 0x55d7c21f7000 2024-04-25T09:11:26.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.810+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.2 v2:172.21.15.175:6821/3247063283 4 ==== osd_op_reply(16 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c21f7000 2024-04-25T09:11:26.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.810+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:17 13.2 13:40000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220a000 con 0x55d7c21f7c00 2024-04-25T09:11:26.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.810+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.5 v2:172.21.15.177:6816/3311807078 2 ==== osd_op_reply(17 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c21f7c00 2024-04-25T09:11:26.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:18 13.22 13:44000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2d4b800 con 0x55d7c21f6800 2024-04-25T09:11:26.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.1 v2:172.21.15.175:6802/594808902 3 ==== osd_op_reply(18 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c21f6800 2024-04-25T09:11:26.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:19 13.12 13:48000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220a400 con 0x55d7c21f6c00 2024-04-25T09:11:26.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 <== osd.0 v2:172.21.15.175:6800/1093269849 2 ==== osd_op_reply(19 [pgnls start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e780 con 0x55d7c21f6c00 2024-04-25T09:11:26.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:20 13.32 13:4c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c21f6000 con 0x55d7c21f7000 2024-04-25T09:11:26.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.2 v2:172.21.15.175:6821/3247063283 5 ==== osd_op_reply(20 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c21f7000 2024-04-25T09:11:26.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:21 13.a 13:50000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220a800 con 0x55d7c21f7000 2024-04-25T09:11:26.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.2 v2:172.21.15.175:6821/3247063283 6 ==== osd_op_reply(21 [pgnls start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c21f7000 2024-04-25T09:11:26.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:22 13.2a 13:54000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c21f7800 con 0x55d7c21f6800 2024-04-25T09:11:26.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.1 v2:172.21.15.175:6802/594808902 4 ==== osd_op_reply(22 [pgnls start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c21f6800 2024-04-25T09:11:26.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:23 13.1a 13:58000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220ac00 con 0x55d7c21f6800 2024-04-25T09:11:26.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.1 v2:172.21.15.175:6802/594808902 5 ==== osd_op_reply(23 [pgnls start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c21f6800 2024-04-25T09:11:26.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:24 13.3a 13:5c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220b400 con 0x55d7c21f7c00 2024-04-25T09:11:26.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.5 v2:172.21.15.177:6816/3311807078 3 ==== osd_op_reply(24 [pgnls start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c21f7c00 2024-04-25T09:11:26.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:25 13.6 13:60000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220b000 con 0x55d7c21f6400 2024-04-25T09:11:26.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 <== osd.4 v2:172.21.15.177:6808/236493968 2 ==== osd_op_reply(25 [pgnls start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e780 con 0x55d7c21f6400 2024-04-25T09:11:26.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:26 13.26 13:64000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220b800 con 0x55d7c2d3d400 2024-04-25T09:11:26.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.7 v2:172.21.15.177:6800/3881136076 3 ==== osd_op_reply(26 [pgnls start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c2d3d400 2024-04-25T09:11:26.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f752c000640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55d7c220a000 0x55d7c21ee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:27 13.16 13:68000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2d3d000 con 0x55d7c220a000 2024-04-25T09:11:26.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f7532400640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55d7c220a000 0x55d7c21ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.814+0000 7f7532400640 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55d7c220a000 0x55d7c21ee100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.808 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.818+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.3 v2:172.21.15.175:6816/4078277957 1 ==== osd_op_reply(27 [pgnls start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c220a000 2024-04-25T09:11:26.808 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.818+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:28 13.36 13:6c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220bc00 con 0x55d7c2d4bc00 2024-04-25T09:11:26.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.818+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.6 v2:172.21.15.177:6822/4132808595 6 ==== osd_op_reply(28 [pgnls start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c2d4bc00 2024-04-25T09:11:26.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.818+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:29 13.e 13:70000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2d3dc00 con 0x55d7c2d3d400 2024-04-25T09:11:26.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.818+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.7 v2:172.21.15.177:6800/3881136076 4 ==== osd_op_reply(29 [pgnls start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c2d3d400 2024-04-25T09:11:26.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.818+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:30 13.2e 13:74000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220ac00 con 0x55d7c21f7000 2024-04-25T09:11:26.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.818+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.2 v2:172.21.15.175:6821/3247063283 7 ==== osd_op_reply(30 [pgnls start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c21f7000 2024-04-25T09:11:26.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.818+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:31 13.1e 13:78000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c21f7800 con 0x55d7c21f6400 2024-04-25T09:11:26.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.818+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 <== osd.4 v2:172.21.15.177:6808/236493968 3 ==== osd_op_reply(31 [pgnls start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e780 con 0x55d7c21f6400 2024-04-25T09:11:26.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.818+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:32 13.3e 13:7c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220b400 con 0x55d7c21f6800 2024-04-25T09:11:26.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.818+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.1 v2:172.21.15.175:6802/594808902 6 ==== osd_op_reply(32 [pgnls start_epoch 88 out=49b] v84'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c21f6800 2024-04-25T09:11:26.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.818+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:33 13.1 13:80000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c21f7400 con 0x55d7c2d4bc00 2024-04-25T09:11:26.811 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.6 v2:172.21.15.177:6822/4132808595 7 ==== osd_op_reply(33 [pgnls start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c2d4bc00 2024-04-25T09:11:26.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:34 13.21 13:84000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220b800 con 0x55d7c21f6400 2024-04-25T09:11:26.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 <== osd.4 v2:172.21.15.177:6808/236493968 4 ==== osd_op_reply(34 [pgnls start_epoch 88 out=49b] v84'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e780 con 0x55d7c21f6400 2024-04-25T09:11:26.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:35 13.11 13:88000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2d4b800 con 0x55d7c21f6800 2024-04-25T09:11:26.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.1 v2:172.21.15.175:6802/594808902 7 ==== osd_op_reply(35 [pgnls start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c21f6800 2024-04-25T09:11:26.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:36 13.31 13:8c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220a400 con 0x55d7c220a000 2024-04-25T09:11:26.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.3 v2:172.21.15.175:6816/4078277957 2 ==== osd_op_reply(36 [pgnls start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c220a000 2024-04-25T09:11:26.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:37 13.9 13:90000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220a800 con 0x55d7c21f7c00 2024-04-25T09:11:26.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.5 v2:172.21.15.177:6816/3311807078 4 ==== osd_op_reply(37 [pgnls start_epoch 88 out=49b] v84'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c21f7c00 2024-04-25T09:11:26.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:38 13.29 13:94000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220b000 con 0x55d7c2d4bc00 2024-04-25T09:11:26.813 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.6 v2:172.21.15.177:6822/4132808595 8 ==== osd_op_reply(38 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c2d4bc00 2024-04-25T09:11:26.813 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:39 13.19 13:98000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220bc00 con 0x55d7c220a000 2024-04-25T09:11:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.3 v2:172.21.15.175:6816/4078277957 3 ==== osd_op_reply(39 [pgnls start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c220a000 2024-04-25T09:11:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:40 13.39 13:9c000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2222000 con 0x55d7c21f7000 2024-04-25T09:11:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.2 v2:172.21.15.175:6821/3247063283 8 ==== osd_op_reply(40 [pgnls start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c21f7000 2024-04-25T09:11:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:41 13.5 13:a0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220ac00 con 0x55d7c21f6400 2024-04-25T09:11:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 <== osd.4 v2:172.21.15.177:6808/236493968 5 ==== osd_op_reply(41 [pgnls start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e780 con 0x55d7c21f6400 2024-04-25T09:11:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:42 13.25 13:a4000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2222400 con 0x55d7c21f6400 2024-04-25T09:11:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 <== osd.4 v2:172.21.15.177:6808/236493968 6 ==== osd_op_reply(42 [pgnls start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e780 con 0x55d7c21f6400 2024-04-25T09:11:26.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:43 13.15 13:a8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2d3d000 con 0x55d7c21f6400 2024-04-25T09:11:26.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 <== osd.4 v2:172.21.15.177:6808/236493968 7 ==== osd_op_reply(43 [pgnls start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e780 con 0x55d7c21f6400 2024-04-25T09:11:26.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.822+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:44 13.35 13:ac000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2222800 con 0x55d7c21f6800 2024-04-25T09:11:26.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.1 v2:172.21.15.175:6802/594808902 8 ==== osd_op_reply(44 [pgnls start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c21f6800 2024-04-25T09:11:26.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:45 13.d 13:b0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c21f6000 con 0x55d7c21f6400 2024-04-25T09:11:26.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 <== osd.4 v2:172.21.15.177:6808/236493968 8 ==== osd_op_reply(45 [pgnls start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e780 con 0x55d7c21f6400 2024-04-25T09:11:26.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:46 13.2d 13:b4000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2222c00 con 0x55d7c21f6c00 2024-04-25T09:11:26.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 <== osd.0 v2:172.21.15.175:6800/1093269849 3 ==== osd_op_reply(46 [pgnls start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e780 con 0x55d7c21f6c00 2024-04-25T09:11:26.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:47 13.1d 13:b8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c1ec5400 con 0x55d7c2d3d400 2024-04-25T09:11:26.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.7 v2:172.21.15.177:6800/3881136076 5 ==== osd_op_reply(47 [pgnls start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c2d3d400 2024-04-25T09:11:26.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:48 13.3d 13:bc000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2223000 con 0x55d7c2d3d400 2024-04-25T09:11:26.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.7 v2:172.21.15.177:6800/3881136076 6 ==== osd_op_reply(48 [pgnls start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c2d3d400 2024-04-25T09:11:26.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:49 13.3 13:c0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2d3d000 con 0x55d7c21f6c00 2024-04-25T09:11:26.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 <== osd.0 v2:172.21.15.175:6800/1093269849 4 ==== osd_op_reply(49 [pgnls start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e780 con 0x55d7c21f6c00 2024-04-25T09:11:26.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:50 13.23 13:c4000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2223400 con 0x55d7c21f6800 2024-04-25T09:11:26.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.1 v2:172.21.15.175:6802/594808902 9 ==== osd_op_reply(50 [pgnls start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c21f6800 2024-04-25T09:11:26.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:51 13.13 13:c8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2222400 con 0x55d7c2d3d400 2024-04-25T09:11:26.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.7 v2:172.21.15.177:6800/3881136076 7 ==== osd_op_reply(51 [pgnls start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c2d3d400 2024-04-25T09:11:26.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:52 13.33 13:cc000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2223800 con 0x55d7c2d3d400 2024-04-25T09:11:26.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.7 v2:172.21.15.177:6800/3881136076 8 ==== osd_op_reply(52 [pgnls start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c2d3d400 2024-04-25T09:11:26.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:53 13.b 13:d0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220b800 con 0x55d7c21f7c00 2024-04-25T09:11:26.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.5 v2:172.21.15.177:6816/3311807078 5 ==== osd_op_reply(53 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c21f7c00 2024-04-25T09:11:26.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:54 13.2b 13:d4000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2223c00 con 0x55d7c21f7000 2024-04-25T09:11:26.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.2 v2:172.21.15.175:6821/3247063283 9 ==== osd_op_reply(54 [pgnls start_epoch 88 out=49b] v84'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c21f7000 2024-04-25T09:11:26.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.826+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:55 13.1b 13:d8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c220ac00 con 0x55d7c21f6400 2024-04-25T09:11:26.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.830+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 <== osd.4 v2:172.21.15.177:6808/236493968 9 ==== osd_op_reply(55 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e780 con 0x55d7c21f6400 2024-04-25T09:11:26.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.830+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:56 13.3b 13:dc000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2222800 con 0x55d7c21f6400 2024-04-25T09:11:26.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.830+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 <== osd.4 v2:172.21.15.177:6808/236493968 10 ==== osd_op_reply(56 [pgnls start_epoch 88 out=49b] v84'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e780 con 0x55d7c21f6400 2024-04-25T09:11:26.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.830+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:57 13.7 13:e0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c21f7800 con 0x55d7c2d3d400 2024-04-25T09:11:26.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.830+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.7 v2:172.21.15.177:6800/3881136076 9 ==== osd_op_reply(57 [pgnls start_epoch 88 out=81b] v84'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c2d3d400 2024-04-25T09:11:26.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.830+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:58 13.7 13:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2d3cc00 con 0x55d7c2d3d400 2024-04-25T09:11:26.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.830+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.7 v2:172.21.15.177:6800/3881136076 10 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c2d3d400 2024-04-25T09:11:26.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.830+0000 7f75339848c0 10 datascan.operator(): handling object 1099511627777.0 2024-04-25T09:11:26.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.830+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:59 13.7 13:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2d3c800 con 0x55d7c2d3d400 2024-04-25T09:11:26.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.830+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.7 v2:172.21.15.177:6800/3881136076 11 ==== osd_op_reply(59 10000000001.00000000 [call] v88'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c2d3d400 2024-04-25T09:11:26.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.830+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:60 13.27 13:e4000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2d3c400 con 0x55d7c21f6800 2024-04-25T09:11:26.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.830+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.1 v2:172.21.15.175:6802/594808902 10 ==== osd_op_reply(60 [pgnls start_epoch 88 out=49b] v84'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c21f6800 2024-04-25T09:11:26.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.830+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:61 13.17 13:e8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2228000 con 0x55d7c21f7c00 2024-04-25T09:11:26.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.830+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.5 v2:172.21.15.177:6816/3311807078 6 ==== osd_op_reply(61 [pgnls start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c21f7c00 2024-04-25T09:11:26.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.830+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:62 13.37 13:ec000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2223000 con 0x55d7c21f7c00 2024-04-25T09:11:26.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f7531a00640 1 -- 172.21.15.175:0/817224887 <== osd.5 v2:172.21.15.177:6816/3311807078 7 ==== osd_op_reply(62 [pgnls start_epoch 88 out=49b] v84'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e000 con 0x55d7c21f7c00 2024-04-25T09:11:26.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:63 13.f 13:f0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2228400 con 0x55d7c2d4bc00 2024-04-25T09:11:26.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.6 v2:172.21.15.177:6822/4132808595 9 ==== osd_op_reply(63 [pgnls start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c2d4bc00 2024-04-25T09:11:26.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:64 13.2f 13:f4000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2223400 con 0x55d7c21f6400 2024-04-25T09:11:26.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 <== osd.4 v2:172.21.15.177:6808/236493968 11 ==== osd_op_reply(64 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e780 con 0x55d7c21f6400 2024-04-25T09:11:26.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f752c000640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:65 13.1f 13:f8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c2228800 con 0x55d7c2d4bc00 2024-04-25T09:11:26.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.6 v2:172.21.15.177:6822/4132808595 10 ==== osd_op_reply(65 [pgnls start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c2d4bc00 2024-04-25T09:11:26.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f752b600640 1 -- 172.21.15.175:0/817224887 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:66 13.3f 13:fc000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x55d7c1ec5400 con 0x55d7c2d4bc00 2024-04-25T09:11:26.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f7532400640 1 -- 172.21.15.175:0/817224887 <== osd.6 v2:172.21.15.177:6822/4132808595 11 ==== osd_op_reply(66 [pgnls start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d7c1e7e500 con 0x55d7c2d4bc00 2024-04-25T09:11:26.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55d7c21f6c00 msgr2=0x55d7c21edb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55d7c21f6c00 0x55d7c21edb80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55d7c21f6800 msgr2=0x55d7c21ec580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55d7c21f6800 0x55d7c21ec580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x55d7c21f7000 msgr2=0x55d7c21ed600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x55d7c21f7000 0x55d7c21ed600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55d7c220a000 msgr2=0x55d7c21ee100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55d7c220a000 0x55d7c21ee100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55d7c21f6400 msgr2=0x55d7c21ecb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55d7c21f6400 0x55d7c21ecb00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55d7c21f7c00 msgr2=0x55d7c21ed080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55d7c21f7c00 0x55d7c21ed080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55d7c2d4bc00 msgr2=0x55d7c21ec000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55d7c2d4bc00 0x55d7c21ec000 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55d7c2d3d400 msgr2=0x55d7c1f86100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 reap_dead start 2024-04-25T09:11:26.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55d7c2d3d400 0x55d7c1f86100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 reap_dead start 2024-04-25T09:11:26.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f7531000640 1 -- 172.21.15.175:0/817224887 reap_dead start 2024-04-25T09:11:26.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55d7c2d4ac00 msgr2=0x55d7c1f87700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55d7c2d4ac00 0x55d7c1f87700 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x55d7c1ea6ed0 tx=0x55d7c2d48f60 comp rx=0 tx=0).stop 2024-04-25T09:11:26.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c2d3d800 msgr2=0x55d7c1f86680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c2d3d800 0x55d7c1f86680 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x55d7c2b95aa0 tx=0x55d7c2d48c00 comp rx=0 tx=0).stop 2024-04-25T09:11:26.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 shutdown_connections 2024-04-25T09:11:26.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55d7c2d4ac00 0x55d7c1f87700 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 --2- 172.21.15.175:0/817224887 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c2d3d800 0x55d7c1f86680 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 >> 172.21.15.175:0/817224887 conn(0x55d7c1dcac00 msgr2=0x55d7c1df9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:26.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 shutdown_connections 2024-04-25T09:11:26.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/817224887 wait complete. 2024-04-25T09:11:26.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/3206425830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c1dcb800 msgr2=0x55d7c1f84580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 --2- 172.21.15.175:0/3206425830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c1dcb800 0x55d7c1f84580 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x55d7c2c11110 tx=0x55d7c1e85d40 comp rx=0 tx=0).stop 2024-04-25T09:11:26.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/3206425830 shutdown_connections 2024-04-25T09:11:26.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 --2- 172.21.15.175:0/3206425830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d7c1dcb000 0x55d7c1f85080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 --2- 172.21.15.175:0/3206425830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d7c1dcb400 0x55d7c1f84b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 --2- 172.21.15.175:0/3206425830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d7c1dcb800 0x55d7c1f84580 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/3206425830 >> 172.21.15.175:0/3206425830 conn(0x55d7c1dcbc00 msgr2=0x55d7c1df9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:26.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/3206425830 shutdown_connections 2024-04-25T09:11:26.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.834+0000 7f75339848c0 1 -- 172.21.15.175:0/3206425830 wait complete. 2024-04-25T09:11:26.830 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.104193, result: 2024-04-25T09:11:26.831 DEBUG:teuthology.orchestra.run.smithi175:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes cephfs_data 2024-04-25T09:11:26.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f485b00b8c0 1 -- start start 2024-04-25T09:11:26.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f485b00b8c0 1 Processor -- start 2024-04-25T09:11:26.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f485b00b8c0 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c95223800 0x555c953dc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f485b00b8c0 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c95223400 0x555c953dcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f485b00b8c0 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c95223000 0x555c953dd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f485b00b8c0 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9611c180 con 0x555c95223000 2024-04-25T09:11:26.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f485b00b8c0 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9611c300 con 0x555c95223400 2024-04-25T09:11:26.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f485b00b8c0 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c9611c480 con 0x555c95223800 2024-04-25T09:11:26.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f4859a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c95223000 0x555c953dd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f4859a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c95223000 0x555c953dd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46828/0 (socket says 172.21.15.175:46828) 2024-04-25T09:11:26.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f4859a00640 1 -- 172.21.15.175:0/419201961 learned_addr learned my addr 172.21.15.175:0/419201961 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:26.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f4859000640 1 --2- 172.21.15.175:0/419201961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c95223800 0x555c953dc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f4858600640 1 --2- 172.21.15.175:0/419201961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c95223400 0x555c953dcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f4859a00640 1 -- 172.21.15.175:0/419201961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c95223800 msgr2=0x555c953dc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:26.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f4859a00640 1 --2- 172.21.15.175:0/419201961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c95223800 0x555c953dc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f4859a00640 1 -- 172.21.15.175:0/419201961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c95223400 msgr2=0x555c953dcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:26.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f4859a00640 1 --2- 172.21.15.175:0/419201961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c95223400 0x555c953dcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f4859a00640 1 -- 172.21.15.175:0/419201961 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c952481e0 con 0x555c95223000 2024-04-25T09:11:26.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f4859000640 1 --2- 172.21.15.175:0/419201961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c95223800 0x555c953dc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:26.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f4858600640 1 --2- 172.21.15.175:0/419201961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c95223400 0x555c953dcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:26.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f4859a00640 1 --2- 172.21.15.175:0/419201961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c95223000 0x555c953dd080 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x555c96069860 tx=0x555c9612a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=449e57c1dcaeaf6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f4855e00640 1 -- 172.21.15.175:0/419201961 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555c952584e0 con 0x555c95223000 2024-04-25T09:11:26.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f4855e00640 1 -- 172.21.15.175:0/419201961 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555c9526ce00 con 0x555c95223000 2024-04-25T09:11:26.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f4855e00640 1 -- 172.21.15.175:0/419201961 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555c95258b60 con 0x555c95223000 2024-04-25T09:11:26.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f485b00b8c0 1 -- 172.21.15.175:0/419201961 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c952492c0 con 0x555c95223000 2024-04-25T09:11:26.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f485b00b8c0 1 -- 172.21.15.175:0/419201961 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x555c95249a40 con 0x555c95223000 2024-04-25T09:11:26.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.930+0000 7f485b00b8c0 4 waiting for MDS map... 2024-04-25T09:11:26.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f4855e00640 1 -- 172.21.15.175:0/419201961 <== mon.0 v2:172.21.15.175:3300/0 4 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x555c9613a600 con 0x555c95223000 2024-04-25T09:11:26.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f4855e00640 1 -- 172.21.15.175:0/419201961 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 66) v1 ==== 2723+0+0 (secure 0 0 0) 0x555c95279180 con 0x555c95223000 2024-04-25T09:11:26.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 4 Got MDS map 66 2024-04-25T09:11:26.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 4 datascan.main: Using metadata pool output 2024-04-25T09:11:26.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 4 datascan.main: connecting to RADOS... 2024-04-25T09:11:26.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 1 Processor -- start 2024-04-25T09:11:26.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 1 -- start start 2024-04-25T09:11:26.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c9613ec00 0x555c953dd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c9613f000 0x555c953ddb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c9613f400 0x555c953de100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9611c600 con 0x555c9613ec00 2024-04-25T09:11:26.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9611c780 con 0x555c9613f000 2024-04-25T09:11:26.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c9611c900 con 0x555c9613f400 2024-04-25T09:11:26.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f4858600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c9613ec00 0x555c953dd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f4859000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c9613f000 0x555c953ddb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f4858600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c9613ec00 0x555c953dd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46844/0 (socket says 172.21.15.175:46844) 2024-04-25T09:11:26.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f4858600640 1 -- 172.21.15.175:0/537174850 learned_addr learned my addr 172.21.15.175:0/537174850 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:26.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f4858600640 1 --2- 172.21.15.175:0/537174850 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c9613f400 0x555c953de100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f4859000640 1 -- 172.21.15.175:0/537174850 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c9613f400 msgr2=0x555c953de100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f4859000640 1 --2- 172.21.15.175:0/537174850 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c9613f400 0x555c953de100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f4859000640 1 -- 172.21.15.175:0/537174850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c9613ec00 msgr2=0x555c953dd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f4859000640 1 --2- 172.21.15.175:0/537174850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c9613ec00 0x555c953dd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f4859000640 1 -- 172.21.15.175:0/537174850 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c95249c20 con 0x555c9613f000 2024-04-25T09:11:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f4858600640 1 --2- 172.21.15.175:0/537174850 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c9613f400 0x555c953de100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f4859000640 1 --2- 172.21.15.175:0/537174850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c9613f000 0x555c953ddb80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x555c96152cf0 tx=0x555c952ddf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3132dbfb3f79071 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f4853600640 1 -- 172.21.15.175:0/537174850 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555c952589c0 con 0x555c9613f000 2024-04-25T09:11:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f4853600640 1 -- 172.21.15.175:0/537174850 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555c9526cc40 con 0x555c9613f000 2024-04-25T09:11:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f4853600640 1 -- 172.21.15.175:0/537174850 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555c952584e0 con 0x555c9613f000 2024-04-25T09:11:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 1 -- 172.21.15.175:0/537174850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c9613f000 msgr2=0x555c953ddb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/537174850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c9613f000 0x555c953ddb80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x555c96152cf0 tx=0x555c952ddf20 comp rx=0 tx=0).stop 2024-04-25T09:11:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 1 -- 172.21.15.175:0/537174850 shutdown_connections 2024-04-25T09:11:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/537174850 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c9613f400 0x555c953de100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/537174850 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c9613f000 0x555c953ddb80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/537174850 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c9613ec00 0x555c953dd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 1 -- 172.21.15.175:0/537174850 >> 172.21.15.175:0/537174850 conn(0x555c95222c00 msgr2=0x555c95251800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:26.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 1 -- 172.21.15.175:0/537174850 shutdown_connections 2024-04-25T09:11:26.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.934+0000 7f485b00b8c0 1 -- 172.21.15.175:0/537174850 wait complete. 2024-04-25T09:11:26.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f485b00b8c0 1 Processor -- start 2024-04-25T09:11:26.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f485b00b8c0 1 -- start start 2024-04-25T09:11:26.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f485b00b8c0 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c9613ec00 0x555c953df180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f485b00b8c0 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c9613f000 0x555c953dec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f485b00b8c0 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c9613f400 0x555c953de680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f485b00b8c0 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9611db00 con 0x555c9613f400 2024-04-25T09:11:26.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f485b00b8c0 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9611d980 con 0x555c9613ec00 2024-04-25T09:11:26.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f485b00b8c0 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x555c9611d800 con 0x555c9613f000 2024-04-25T09:11:26.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f4859000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c9613f000 0x555c953dec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f4858600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c9613ec00 0x555c953df180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f4859000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c9613f000 0x555c953dec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:47448/0 (socket says 172.21.15.175:47448) 2024-04-25T09:11:26.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 learned_addr learned my addr 172.21.15.175:0/3814493418 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:26.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f4858600640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c9613f400 0x555c953de680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c9613ec00 msgr2=0x555c953df180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f4859000640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c9613ec00 0x555c953df180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c9613f400 msgr2=0x555c953de680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f4859000640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c9613f400 0x555c953de680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c952494a0 con 0x555c9613f000 2024-04-25T09:11:26.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f4858600640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c9613ec00 0x555c953df180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:26.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f4859000640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c9613f000 0x555c953dec00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x555c96153020 tx=0x555c952ddec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f4851800640 1 -- 172.21.15.175:0/3814493418 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555c95258b60 con 0x555c9613f000 2024-04-25T09:11:26.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f4851800640 1 -- 172.21.15.175:0/3814493418 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555c9526ca80 con 0x555c9613f000 2024-04-25T09:11:26.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555c952483c0 con 0x555c9613f000 2024-04-25T09:11:26.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f4851800640 1 -- 172.21.15.175:0/3814493418 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555c95258000 con 0x555c9613f000 2024-04-25T09:11:26.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555c95249c20 con 0x555c9613f000 2024-04-25T09:11:26.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.938+0000 7f485b00b8c0 4 datascan.init: resolving metadata pool 12 2024-04-25T09:11:26.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f4851800640 1 -- 172.21.15.175:0/3814493418 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x555c9554ac00 con 0x555c9613f000 2024-04-25T09:11:26.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f4851800640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x555c95560400 0x555c953df700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f4851800640 1 -- 172.21.15.175:0/3814493418 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x555c95566400 con 0x555c9613f000 2024-04-25T09:11:26.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f485b00b8c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T09:11:26.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f485b00b8c0 4 datascan.main: data pool 'cephfs_data' has ID 13 2024-04-25T09:11:26.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f485b00b8c0 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T09:11:26.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x555c9613f800 0x555c953de100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:1 12.14 12:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9613fc00 con 0x555c9613f800 2024-04-25T09:11:26.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f4858600640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x555c95560400 0x555c953df700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f4858600640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x555c9613f800 0x555c953de100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f4858600640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x555c95560400 0x555c953df700 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x555c96152c60 tx=0x555c96160c60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f4858600640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x555c9613f800 0x555c953de100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.5 v2:172.21.15.177:6816/3311807078 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv25 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x555c95332000 con 0x555c9613f800 2024-04-25T09:11:26.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x555c95561000 0x555c953ddb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:2 12.1f 12:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95561400 con 0x555c95561000 2024-04-25T09:11:26.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f4859a00640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x555c95561000 0x555c953ddb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f4859a00640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x555c95561000 0x555c953ddb80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x555c95561800 0x555c953dd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.942+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:3 13.0 13:00000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95561c00 con 0x555c95561800 2024-04-25T09:11:26.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.946+0000 7f4859000640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x555c95561800 0x555c953dd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.946+0000 7f4859000640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x555c95561800 0x555c953dd600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.946+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.946+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:4 13.20 13:04000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95662000 con 0x555c95561000 2024-04-25T09:11:26.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.946+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 2 ==== osd_op_reply(4 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.946+0000 7f4853600640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x555c95662400 0x555c95668000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.946+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:5 13.10 13:08000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95662800 con 0x555c95662400 2024-04-25T09:11:26.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.946+0000 7f4858600640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x555c95662400 0x555c95668000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.946+0000 7f4858600640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x555c95662400 0x555c95668000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.946+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.946+0000 7f4852c00640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x555c95663000 0x555c95668580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.946+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:6 13.30 13:0c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95663400 con 0x555c95663000 2024-04-25T09:11:26.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.946+0000 7f4859a00640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x555c95663000 0x555c95668580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.946+0000 7f4859a00640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x555c95663000 0x555c95668580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.946+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 1 ==== osd_op_reply(6 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.946+0000 7f4853600640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x555c95662c00 0x555c95668b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.946+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:7 13.8 13:10000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95561400 con 0x555c95662c00 2024-04-25T09:11:26.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.946+0000 7f4859000640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x555c95662c00 0x555c95668b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.950+0000 7f4859000640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x555c95662c00 0x555c95668b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.950+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.2 v2:172.21.15.175:6821/3247063283 1 ==== osd_op_reply(7 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95662c00 2024-04-25T09:11:26.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.950+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:8 13.28 13:14000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95662000 con 0x555c95662c00 2024-04-25T09:11:26.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.950+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.2 v2:172.21.15.175:6821/3247063283 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95662c00 2024-04-25T09:11:26.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.950+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:9 13.18 13:18000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9613e800 con 0x555c95561800 2024-04-25T09:11:26.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.950+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 2 ==== osd_op_reply(9 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.950+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:10 13.38 13:1c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95663400 con 0x555c9613f800 2024-04-25T09:11:26.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.950+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.5 v2:172.21.15.177:6816/3311807078 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613f800 2024-04-25T09:11:26.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.950+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:11 13.4 13:20000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9613e400 con 0x555c95561000 2024-04-25T09:11:26.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.950+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 3 ==== osd_op_reply(11 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.950+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:12 13.24 13:24000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95663800 con 0x555c95561000 2024-04-25T09:11:26.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.950+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 4 ==== osd_op_reply(12 [pgnls-filter start_epoch 88 out=49b] v84'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.950+0000 7f4853600640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x555c9613e800 0x555c95669080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.950+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:13 13.14 13:28000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95561c00 con 0x555c9613e800 2024-04-25T09:11:26.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.950+0000 7f4858600640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x555c9613e800 0x555c95669080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.950+0000 7f4858600640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x555c9613e800 0x555c95669080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.950+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.0 v2:172.21.15.175:6800/1093269849 1 ==== osd_op_reply(13 [pgnls-filter start_epoch 88 out=49b] v84'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613e800 2024-04-25T09:11:26.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.950+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:14 13.34 13:2c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95662800 con 0x555c95561000 2024-04-25T09:11:26.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 5 ==== osd_op_reply(14 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:15 13.c 13:30000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95561400 con 0x555c95662400 2024-04-25T09:11:26.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 2 ==== osd_op_reply(15 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:16 13.2c 13:34000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95663400 con 0x555c95662c00 2024-04-25T09:11:26.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.2 v2:172.21.15.175:6821/3247063283 3 ==== osd_op_reply(16 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95662c00 2024-04-25T09:11:26.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:17 13.1c 13:38000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95321400 con 0x555c95561000 2024-04-25T09:11:26.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 6 ==== osd_op_reply(17 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:18 13.3c 13:3c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95561c00 con 0x555c95662c00 2024-04-25T09:11:26.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.2 v2:172.21.15.175:6821/3247063283 4 ==== osd_op_reply(18 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95662c00 2024-04-25T09:11:26.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:19 13.2 13:40000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95662000 con 0x555c9613f800 2024-04-25T09:11:26.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.5 v2:172.21.15.177:6816/3311807078 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613f800 2024-04-25T09:11:26.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:20 13.22 13:44000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9613fc00 con 0x555c95662400 2024-04-25T09:11:26.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:21 13.12 13:48000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95663c00 con 0x555c9613e800 2024-04-25T09:11:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.0 v2:172.21.15.175:6800/1093269849 2 ==== osd_op_reply(21 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613e800 2024-04-25T09:11:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:22 13.32 13:4c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95676000 con 0x555c95662c00 2024-04-25T09:11:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.2 v2:172.21.15.175:6821/3247063283 5 ==== osd_op_reply(22 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95662c00 2024-04-25T09:11:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:23 13.a 13:50000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95677400 con 0x555c95662c00 2024-04-25T09:11:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.2 v2:172.21.15.175:6821/3247063283 6 ==== osd_op_reply(23 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95662c00 2024-04-25T09:11:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:24 13.2a 13:54000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95676400 con 0x555c95662400 2024-04-25T09:11:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:25 13.1a 13:58000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95677800 con 0x555c95662400 2024-04-25T09:11:26.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 5 ==== osd_op_reply(25 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.954+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:26 13.3a 13:5c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95676800 con 0x555c9613f800 2024-04-25T09:11:26.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.5 v2:172.21.15.177:6816/3311807078 4 ==== osd_op_reply(26 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613f800 2024-04-25T09:11:26.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:27 13.6 13:60000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95677c00 con 0x555c95663000 2024-04-25T09:11:26.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 2 ==== osd_op_reply(27 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:28 13.26 13:64000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95676c00 con 0x555c95561800 2024-04-25T09:11:26.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 3 ==== osd_op_reply(28 [pgnls-filter start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4853600640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x555c95676400 0x555c95669600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:29 13.16 13:68000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95662000 con 0x555c95676400 2024-04-25T09:11:26.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4859a00640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x555c95676400 0x555c95669600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4859a00640 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x555c95676400 0x555c95669600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.3 v2:172.21.15.175:6816/4078277957 1 ==== osd_op_reply(29 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95676400 2024-04-25T09:11:26.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:30 13.36 13:6c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95677000 con 0x555c95561000 2024-04-25T09:11:26.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 7 ==== osd_op_reply(30 [pgnls-filter start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:31 13.e 13:70000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95663c00 con 0x555c95561800 2024-04-25T09:11:26.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 4 ==== osd_op_reply(31 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:32 13.2e 13:74000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95676000 con 0x555c95662c00 2024-04-25T09:11:26.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.2 v2:172.21.15.175:6821/3247063283 7 ==== osd_op_reply(32 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95662c00 2024-04-25T09:11:26.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:33 13.1e 13:78000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9613fc00 con 0x555c95663000 2024-04-25T09:11:26.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 3 ==== osd_op_reply(33 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.958+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:34 13.3e 13:7c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95677400 con 0x555c95662400 2024-04-25T09:11:26.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 6 ==== osd_op_reply(34 [pgnls-filter start_epoch 88 out=49b] v84'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:35 13.1 13:80000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95561400 con 0x555c95561000 2024-04-25T09:11:26.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 8 ==== osd_op_reply(35 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:36 13.21 13:84000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95676c00 con 0x555c95663000 2024-04-25T09:11:26.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 88 out=49b] v84'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:37 13.11 13:88000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95663400 con 0x555c95662400 2024-04-25T09:11:26.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 7 ==== osd_op_reply(37 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:38 13.31 13:8c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95321400 con 0x555c95676400 2024-04-25T09:11:26.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.3 v2:172.21.15.175:6816/4078277957 2 ==== osd_op_reply(38 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95676400 2024-04-25T09:11:26.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:39 13.9 13:90000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95663c00 con 0x555c9613f800 2024-04-25T09:11:26.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.5 v2:172.21.15.177:6816/3311807078 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 88 out=49b] v84'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613f800 2024-04-25T09:11:26.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:40 13.29 13:94000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9613e400 con 0x555c95561000 2024-04-25T09:11:26.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 9 ==== osd_op_reply(40 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:41 13.19 13:98000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95663800 con 0x555c95676400 2024-04-25T09:11:26.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.3 v2:172.21.15.175:6816/4078277957 3 ==== osd_op_reply(41 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95676400 2024-04-25T09:11:26.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:42 13.39 13:9c000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95561c00 con 0x555c95662c00 2024-04-25T09:11:26.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.2 v2:172.21.15.175:6821/3247063283 8 ==== osd_op_reply(42 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95662c00 2024-04-25T09:11:26.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:43 13.5 13:a0000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95662800 con 0x555c95663000 2024-04-25T09:11:26.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 5 ==== osd_op_reply(43 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:44 13.25 13:a4000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95663800 con 0x555c95663000 2024-04-25T09:11:26.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 6 ==== osd_op_reply(44 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.962+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:45 13.15 13:a8000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95662000 con 0x555c95663000 2024-04-25T09:11:26.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 7 ==== osd_op_reply(45 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:46 13.35 13:ac000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9613fc00 con 0x555c95662400 2024-04-25T09:11:26.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 8 ==== osd_op_reply(46 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:47 13.d 13:b0000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95677c00 con 0x555c95663000 2024-04-25T09:11:26.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 8 ==== osd_op_reply(47 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:48 13.2d 13:b4000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9613e400 con 0x555c9613e800 2024-04-25T09:11:26.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.0 v2:172.21.15.175:6800/1093269849 3 ==== osd_op_reply(48 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613e800 2024-04-25T09:11:26.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:49 13.1d 13:b8000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9613fc00 con 0x555c95561800 2024-04-25T09:11:26.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 5 ==== osd_op_reply(49 [pgnls-filter start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:50 13.3d 13:bc000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95321400 con 0x555c95561800 2024-04-25T09:11:26.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 6 ==== osd_op_reply(50 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:51 13.3 13:c0000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95663400 con 0x555c9613e800 2024-04-25T09:11:26.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.0 v2:172.21.15.175:6800/1093269849 4 ==== osd_op_reply(51 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613e800 2024-04-25T09:11:26.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:52 13.23 13:c4000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95677000 con 0x555c95662400 2024-04-25T09:11:26.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 9 ==== osd_op_reply(52 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:53 13.13 13:c8000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95663c00 con 0x555c95561800 2024-04-25T09:11:26.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 7 ==== osd_op_reply(53 [pgnls-filter start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:54 13.33 13:cc000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95676c00 con 0x555c95561800 2024-04-25T09:11:26.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 8 ==== osd_op_reply(54 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:55 13.b 13:d0000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95677800 con 0x555c9613f800 2024-04-25T09:11:26.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.5 v2:172.21.15.177:6816/3311807078 6 ==== osd_op_reply(55 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613f800 2024-04-25T09:11:26.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:56 13.2b 13:d4000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95561400 con 0x555c95662c00 2024-04-25T09:11:26.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.2 v2:172.21.15.175:6821/3247063283 9 ==== osd_op_reply(56 [pgnls-filter start_epoch 88 out=49b] v84'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95662c00 2024-04-25T09:11:26.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.966+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:57 13.1b 13:d8000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95676800 con 0x555c95663000 2024-04-25T09:11:26.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 9 ==== osd_op_reply(57 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:58 13.3b 13:dc000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95561c00 con 0x555c95663000 2024-04-25T09:11:26.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 10 ==== osd_op_reply(58 [pgnls-filter start_epoch 88 out=49b] v84'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:59 13.7 13:e0000000::::head [pgnls-filter start_epoch 88 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95677400 con 0x555c95561800 2024-04-25T09:11:26.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 9 ==== osd_op_reply(59 [pgnls-filter start_epoch 88 out=81b] v88'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:60 13.0 13:00000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95686000 con 0x555c95561800 2024-04-25T09:11:26.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 10 ==== osd_op_reply(60 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:61 13.20 13:04000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95688000 con 0x555c95561000 2024-04-25T09:11:26.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 10 ==== osd_op_reply(61 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:62 13.10 13:08000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95561400 con 0x555c95662400 2024-04-25T09:11:26.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 10 ==== osd_op_reply(62 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:63 13.30 13:0c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95688400 con 0x555c95663000 2024-04-25T09:11:26.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 11 ==== osd_op_reply(63 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:64 13.8 13:10000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95676000 con 0x555c95662c00 2024-04-25T09:11:26.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.2 v2:172.21.15.175:6821/3247063283 10 ==== osd_op_reply(64 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95662c00 2024-04-25T09:11:26.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:65 13.28 13:14000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95688800 con 0x555c95662c00 2024-04-25T09:11:26.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.2 v2:172.21.15.175:6821/3247063283 11 ==== osd_op_reply(65 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95662c00 2024-04-25T09:11:26.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:66 13.18 13:18000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95676c00 con 0x555c95561800 2024-04-25T09:11:26.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 11 ==== osd_op_reply(66 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:67 13.38 13:1c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95688c00 con 0x555c9613f800 2024-04-25T09:11:26.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.5 v2:172.21.15.177:6816/3311807078 7 ==== osd_op_reply(67 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613f800 2024-04-25T09:11:26.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.970+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:68 13.4 13:20000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95663c00 con 0x555c95561000 2024-04-25T09:11:26.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 11 ==== osd_op_reply(68 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:69 13.24 13:24000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95689000 con 0x555c95561000 2024-04-25T09:11:26.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 12 ==== osd_op_reply(69 [pgnls-filter start_epoch 88 out=49b] v84'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:70 13.14 13:28000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95321400 con 0x555c9613e800 2024-04-25T09:11:26.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.0 v2:172.21.15.175:6800/1093269849 5 ==== osd_op_reply(70 [pgnls-filter start_epoch 88 out=49b] v84'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613e800 2024-04-25T09:11:26.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:71 13.34 13:2c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95689400 con 0x555c95561000 2024-04-25T09:11:26.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 13 ==== osd_op_reply(71 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:72 13.c 13:30000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9613fc00 con 0x555c95662400 2024-04-25T09:11:26.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 11 ==== osd_op_reply(72 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:73 13.2c 13:34000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95689800 con 0x555c95662c00 2024-04-25T09:11:26.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.2 v2:172.21.15.175:6821/3247063283 12 ==== osd_op_reply(73 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95662c00 2024-04-25T09:11:26.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:74 13.1c 13:38000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95677000 con 0x555c95561000 2024-04-25T09:11:26.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 14 ==== osd_op_reply(74 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:75 13.3c 13:3c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95689c00 con 0x555c95662c00 2024-04-25T09:11:26.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.2 v2:172.21.15.175:6821/3247063283 13 ==== osd_op_reply(75 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95662c00 2024-04-25T09:11:26.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:76 13.2 13:40000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95677800 con 0x555c9613f800 2024-04-25T09:11:26.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.5 v2:172.21.15.177:6816/3311807078 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613f800 2024-04-25T09:11:26.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:77 13.22 13:44000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95688c00 con 0x555c95662400 2024-04-25T09:11:26.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 12 ==== osd_op_reply(77 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:78 13.12 13:48000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95677c00 con 0x555c9613e800 2024-04-25T09:11:26.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.0 v2:172.21.15.175:6800/1093269849 6 ==== osd_op_reply(78 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613e800 2024-04-25T09:11:26.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:79 13.32 13:4c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95688000 con 0x555c95662c00 2024-04-25T09:11:26.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.2 v2:172.21.15.175:6821/3247063283 14 ==== osd_op_reply(79 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95662c00 2024-04-25T09:11:26.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.974+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:80 13.a 13:50000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95663400 con 0x555c95662c00 2024-04-25T09:11:26.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.2 v2:172.21.15.175:6821/3247063283 15 ==== osd_op_reply(80 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95662c00 2024-04-25T09:11:26.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:81 13.2a 13:54000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95688400 con 0x555c95662400 2024-04-25T09:11:26.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 13 ==== osd_op_reply(81 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:82 13.1a 13:58000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95662800 con 0x555c95662400 2024-04-25T09:11:26.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 14 ==== osd_op_reply(82 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:83 13.3a 13:5c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95561400 con 0x555c9613f800 2024-04-25T09:11:26.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.5 v2:172.21.15.177:6816/3311807078 9 ==== osd_op_reply(83 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613f800 2024-04-25T09:11:26.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:84 13.6 13:60000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95663800 con 0x555c95663000 2024-04-25T09:11:26.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 12 ==== osd_op_reply(84 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:85 13.26 13:64000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95561c00 con 0x555c95561800 2024-04-25T09:11:26.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 12 ==== osd_op_reply(85 [pgnls-filter start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:86 13.16 13:68000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95662000 con 0x555c95676400 2024-04-25T09:11:26.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.3 v2:172.21.15.175:6816/4078277957 4 ==== osd_op_reply(86 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95676400 2024-04-25T09:11:26.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:87 13.36 13:6c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95676800 con 0x555c95561000 2024-04-25T09:11:26.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 15 ==== osd_op_reply(87 [pgnls-filter start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:88 13.e 13:70000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95321400 con 0x555c95561800 2024-04-25T09:11:26.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 13 ==== osd_op_reply(88 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:89 13.2e 13:74000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95688800 con 0x555c95662c00 2024-04-25T09:11:26.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.2 v2:172.21.15.175:6821/3247063283 16 ==== osd_op_reply(89 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95662c00 2024-04-25T09:11:26.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:90 13.1e 13:78000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9613e400 con 0x555c95663000 2024-04-25T09:11:26.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 13 ==== osd_op_reply(90 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.978+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:91 13.3e 13:7c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95689800 con 0x555c95662400 2024-04-25T09:11:26.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 15 ==== osd_op_reply(91 [pgnls-filter start_epoch 88 out=49b] v84'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:92 13.1 13:80000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95688c00 con 0x555c95561000 2024-04-25T09:11:26.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 16 ==== osd_op_reply(92 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:93 13.21 13:84000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95689c00 con 0x555c95663000 2024-04-25T09:11:26.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 14 ==== osd_op_reply(93 [pgnls-filter start_epoch 88 out=49b] v84'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:94 13.11 13:88000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95688400 con 0x555c95662400 2024-04-25T09:11:26.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 16 ==== osd_op_reply(94 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:95 13.31 13:8c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95688000 con 0x555c95676400 2024-04-25T09:11:26.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.3 v2:172.21.15.175:6816/4078277957 5 ==== osd_op_reply(95 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95676400 2024-04-25T09:11:26.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:96 13.9 13:90000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95689800 con 0x555c9613f800 2024-04-25T09:11:26.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.5 v2:172.21.15.177:6816/3311807078 10 ==== osd_op_reply(96 [pgnls-filter start_epoch 88 out=49b] v84'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613f800 2024-04-25T09:11:26.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:97 13.29 13:94000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95677400 con 0x555c95561000 2024-04-25T09:11:26.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 17 ==== osd_op_reply(97 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:98 13.19 13:98000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95561400 con 0x555c95676400 2024-04-25T09:11:26.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.3 v2:172.21.15.175:6816/4078277957 6 ==== osd_op_reply(98 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95676400 2024-04-25T09:11:26.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:99 13.39 13:9c000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95676000 con 0x555c95662c00 2024-04-25T09:11:26.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.2 v2:172.21.15.175:6821/3247063283 17 ==== osd_op_reply(99 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95662c00 2024-04-25T09:11:26.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:100 13.5 13:a0000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95662800 con 0x555c95663000 2024-04-25T09:11:26.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 15 ==== osd_op_reply(100 [pgnls-filter start_epoch 88 out=49b] v84'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:101 13.25 13:a4000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95676c00 con 0x555c95663000 2024-04-25T09:11:26.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 16 ==== osd_op_reply(101 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.982+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:102 13.15 13:a8000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95677800 con 0x555c95663000 2024-04-25T09:11:26.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 17 ==== osd_op_reply(102 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:103 13.35 13:ac000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95686000 con 0x555c95662400 2024-04-25T09:11:26.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 17 ==== osd_op_reply(103 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:104 13.d 13:b0000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95677c00 con 0x555c95663000 2024-04-25T09:11:26.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 18 ==== osd_op_reply(104 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:105 13.2d 13:b4000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95689000 con 0x555c9613e800 2024-04-25T09:11:26.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.0 v2:172.21.15.175:6800/1093269849 7 ==== osd_op_reply(105 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613e800 2024-04-25T09:11:26.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:106 13.1d 13:b8000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9613fc00 con 0x555c95561800 2024-04-25T09:11:26.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 14 ==== osd_op_reply(106 [pgnls-filter start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:107 13.3d 13:bc000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95689400 con 0x555c95561800 2024-04-25T09:11:26.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 15 ==== osd_op_reply(107 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:108 13.3 13:c0000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9568a000 con 0x555c9613e800 2024-04-25T09:11:26.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.0 v2:172.21.15.175:6800/1093269849 8 ==== osd_op_reply(108 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613e800 2024-04-25T09:11:26.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:109 13.23 13:c4000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95688c00 con 0x555c95662400 2024-04-25T09:11:26.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 18 ==== osd_op_reply(109 [pgnls-filter start_epoch 88 out=49b] v84'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:110 13.13 13:c8000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9568a400 con 0x555c95561800 2024-04-25T09:11:26.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 16 ==== osd_op_reply(110 [pgnls-filter start_epoch 88 out=49b] v84'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:111 13.33 13:cc000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9613e400 con 0x555c95561800 2024-04-25T09:11:26.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 17 ==== osd_op_reply(111 [pgnls-filter start_epoch 88 out=49b] v84'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:112 13.b 13:d0000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9568a800 con 0x555c9613f800 2024-04-25T09:11:26.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.5 v2:172.21.15.177:6816/3311807078 11 ==== osd_op_reply(112 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613f800 2024-04-25T09:11:26.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:113 13.2b 13:d4000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95677000 con 0x555c95662c00 2024-04-25T09:11:26.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.2 v2:172.21.15.175:6821/3247063283 18 ==== osd_op_reply(113 [pgnls-filter start_epoch 88 out=49b] v84'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332780 con 0x555c95662c00 2024-04-25T09:11:26.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.986+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:114 13.1b 13:d8000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9568ac00 con 0x555c95663000 2024-04-25T09:11:26.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 19 ==== osd_op_reply(114 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:115 13.3b 13:dc000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95676800 con 0x555c95663000 2024-04-25T09:11:26.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 20 ==== osd_op_reply(115 [pgnls-filter start_epoch 88 out=49b] v84'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:116 13.7 13:e0000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9568b000 con 0x555c95561800 2024-04-25T09:11:26.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 18 ==== osd_op_reply(116 [pgnls-filter start_epoch 88 out=81b] v88'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2024-04-25T09:11:26.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 10 datascan.operator(): handling object 10000000001.0 2024-04-25T09:11:26.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:117 13.7 13:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95686800 con 0x555c95561800 2024-04-25T09:11:26.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 <== osd.7 v2:172.21.15.177:6800/3881136076 19 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x555c95332780 con 0x555c95561800 2024-04-25T09:11:26.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2024-04-25T09:11:26.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/file 2024-04-25T09:11:26.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=file 2024-04-25T09:11:26.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:118 12.10 12:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95686c00 con 0x555c9613e800 2024-04-25T09:11:26.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.0 v2:172.21.15.175:6800/1093269849 9 ==== osd_op_reply(118 10000000000.00000000 [getxattr (59) out=59b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+59 (crc 0 0 0) 0x555c95332000 con 0x555c9613e800 2024-04-25T09:11:26.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 20 datascan.get_frag_of: got backtrace parent 0x1/dir 2024-04-25T09:11:26.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:119 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95687000 con 0x555c95561000 2024-04-25T09:11:26.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 18 ==== osd_op_reply(119 1.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+520 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 20 datascan.read_dentry: oid=1.00000000 dname=dir frag=*, r=0 2024-04-25T09:11:26.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 20 datascan.get_frag_of: fast path, fragtree is fragtree_t() 2024-04-25T09:11:26.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 20 datascan.get_frag_of: frag is * 2024-04-25T09:11:26.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:120 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95687400 con 0x555c9613e800 2024-04-25T09:11:26.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.0 v2:172.21.15.175:6800/1093269849 10 ==== osd_op_reply(120 10000000000.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x555c95332000 con 0x555c9613e800 2024-04-25T09:11:26.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 10 datascan.find_or_create_dirfrag: read_version = 17 2024-04-25T09:11:26.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2024-04-25T09:11:26.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:121 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95687800 con 0x555c9613e800 2024-04-25T09:11:26.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.0 v2:172.21.15.175:6800/1093269849 11 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x555c95332000 con 0x555c9613e800 2024-04-25T09:11:26.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-25T09:11:26.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 20 datascan.read_dentry: file_head not found in result 2024-04-25T09:11:26.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/file with size=0 bytes 2024-04-25T09:11:26.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.990+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:122 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95687c00 con 0x555c9613e800 2024-04-25T09:11:26.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.994+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.0 v2:172.21.15.175:6800/1093269849 12 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v88'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x555c95332000 con 0x555c9613e800 2024-04-25T09:11:26.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.994+0000 7f485b00b8c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-25T09:11:26.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.994+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:123 13.27 13:e4000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95677400 con 0x555c95662400 2024-04-25T09:11:26.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.994+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.1 v2:172.21.15.175:6802/594808902 19 ==== osd_op_reply(123 [pgnls-filter start_epoch 88 out=49b] v84'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c95662400 2024-04-25T09:11:26.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.994+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:124 13.17 13:e8000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9568b400 con 0x555c9613f800 2024-04-25T09:11:26.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.994+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.5 v2:172.21.15.177:6816/3311807078 12 ==== osd_op_reply(124 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613f800 2024-04-25T09:11:26.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.994+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:125 13.37 13:ec000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95663c00 con 0x555c9613f800 2024-04-25T09:11:26.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.994+0000 7f4858600640 1 -- 172.21.15.175:0/3814493418 <== osd.5 v2:172.21.15.177:6816/3311807078 13 ==== osd_op_reply(125 [pgnls-filter start_epoch 88 out=49b] v84'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332000 con 0x555c9613f800 2024-04-25T09:11:26.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.994+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:126 13.f 13:f0000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9568b800 con 0x555c95561000 2024-04-25T09:11:26.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.994+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 19 ==== osd_op_reply(126 [pgnls-filter start_epoch 88 out=49b] v84'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.994+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:127 13.2f 13:f4000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95663800 con 0x555c95663000 2024-04-25T09:11:26.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.994+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.4 v2:172.21.15.177:6808/236493968 21 ==== osd_op_reply(127 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95663000 2024-04-25T09:11:26.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.994+0000 7f4852c00640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:128 13.1f 13:f8000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c9568bc00 con 0x555c95561000 2024-04-25T09:11:26.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 20 ==== osd_op_reply(128 [pgnls-filter start_epoch 88 out=49b] v84'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f4853600640 1 -- 172.21.15.175:0/3814493418 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:129 13.3f 13:fc000000::::head [pgnls-filter start_epoch 88 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x555c95662000 con 0x555c95561000 2024-04-25T09:11:26.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f4859a00640 1 -- 172.21.15.175:0/3814493418 <== osd.6 v2:172.21.15.177:6822/4132808595 21 ==== osd_op_reply(129 [pgnls-filter start_epoch 88 out=49b] v84'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555c95332500 con 0x555c95561000 2024-04-25T09:11:26.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x555c9613e800 msgr2=0x555c95669080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x555c9613e800 0x555c95669080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x555c95662400 msgr2=0x555c95668000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x555c95662400 0x555c95668000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x555c95662c00 msgr2=0x555c95668b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x555c95662c00 0x555c95668b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x555c95676400 msgr2=0x555c95669600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x555c95676400 0x555c95669600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 reap_dead start 2024-04-25T09:11:26.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x555c95663000 msgr2=0x555c95668580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x555c95663000 0x555c95668580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x555c9613f800 msgr2=0x555c953de100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x555c9613f800 0x555c953de100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x555c95561000 msgr2=0x555c953ddb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x555c95561000 0x555c953ddb80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x555c95561800 msgr2=0x555c953dd600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x555c95561800 0x555c953dd600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f4859000640 1 -- 172.21.15.175:0/3814493418 reap_dead start 2024-04-25T09:11:26.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x555c95560400 msgr2=0x555c953df700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x555c95560400 0x555c953df700 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x555c96152c60 tx=0x555c96160c60 comp rx=0 tx=0).stop 2024-04-25T09:11:26.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c9613f000 msgr2=0x555c953dec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c9613f000 0x555c953dec00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x555c96153020 tx=0x555c952ddec0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 shutdown_connections 2024-04-25T09:11:26.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x555c95560400 0x555c953df700 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/3814493418 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c9613f000 0x555c953dec00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 >> 172.21.15.175:0/3814493418 conn(0x555c95222c00 msgr2=0x555c95251800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:26.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 shutdown_connections 2024-04-25T09:11:26.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/3814493418 wait complete. 2024-04-25T09:11:26.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/419201961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c95223000 msgr2=0x555c953dd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/419201961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c95223000 0x555c953dd080 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x555c96069860 tx=0x555c9612a120 comp rx=0 tx=0).stop 2024-04-25T09:11:26.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/419201961 shutdown_connections 2024-04-25T09:11:26.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/419201961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x555c95223000 0x555c953dd080 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/419201961 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x555c95223400 0x555c953dcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 --2- 172.21.15.175:0/419201961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x555c95223800 0x555c953dc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/419201961 >> 172.21.15.175:0/419201961 conn(0x555c95223c00 msgr2=0x555c95251000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:26.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/419201961 shutdown_connections 2024-04-25T09:11:26.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:26.998+0000 7f485b00b8c0 1 -- 172.21.15.175:0/419201961 wait complete. 2024-04-25T09:11:26.993 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', 'cephfs_data'] in time 0:00:00.162774, result: 2024-04-25T09:11:26.994 DEBUG:teuthology.orchestra.run.smithi175:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-04-25T09:11:27.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f2bc38c0 1 -- start start 2024-04-25T09:11:27.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f2bc38c0 1 Processor -- start 2024-04-25T09:11:27.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f2bc38c0 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56052a3ce000 0x56052a48f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f2bc38c0 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a2d5c00 0x56052a48eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f2bc38c0 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56052a3cf000 0x56052a48fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f2bc38c0 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56052b1e2000 con 0x56052a3cf000 2024-04-25T09:11:27.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f2bc38c0 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x56052b1e2180 con 0x56052a2d5c00 2024-04-25T09:11:27.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f2bc38c0 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x56052b1e2300 con 0x56052a3ce000 2024-04-25T09:11:27.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f1600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56052a3cf000 0x56052a48fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f1600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56052a3cf000 0x56052a48fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46870/0 (socket says 172.21.15.175:46870) 2024-04-25T09:11:27.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f1600640 1 -- 172.21.15.175:0/2965950487 learned_addr learned my addr 172.21.15.175:0/2965950487 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:27.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f0200640 1 --2- 172.21.15.175:0/2965950487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a2d5c00 0x56052a48eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f0c00640 1 --2- 172.21.15.175:0/2965950487 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56052a3ce000 0x56052a48f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f1600640 1 -- 172.21.15.175:0/2965950487 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56052a3ce000 msgr2=0x56052a48f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f1600640 1 --2- 172.21.15.175:0/2965950487 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56052a3ce000 0x56052a48f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f1600640 1 -- 172.21.15.175:0/2965950487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a2d5c00 msgr2=0x56052a48eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f1600640 1 --2- 172.21.15.175:0/2965950487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a2d5c00 0x56052a48eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f1600640 1 -- 172.21.15.175:0/2965950487 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56052a2fa1e0 con 0x56052a3cf000 2024-04-25T09:11:27.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.090+0000 7f66f0200640 1 --2- 172.21.15.175:0/2965950487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a2d5c00 0x56052a48eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:27.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f1600640 1 --2- 172.21.15.175:0/2965950487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56052a3cf000 0x56052a48fb80 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x56052b121b30 tx=0x56052b1f0300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217410598feb2bfc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66eda00640 1 -- 172.21.15.175:0/2965950487 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56052a30a1a0 con 0x56052a3cf000 2024-04-25T09:11:27.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66eda00640 1 -- 172.21.15.175:0/2965950487 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56052a31ec40 con 0x56052a3cf000 2024-04-25T09:11:27.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/2965950487 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56052a2fb4a0 con 0x56052a3cf000 2024-04-25T09:11:27.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/2965950487 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56052a2fb2c0 con 0x56052a3cf000 2024-04-25T09:11:27.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f2bc38c0 4 waiting for MDS map... 2024-04-25T09:11:27.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66eda00640 1 -- 172.21.15.175:0/2965950487 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56052a30a4e0 con 0x56052a3cf000 2024-04-25T09:11:27.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66eda00640 1 -- 172.21.15.175:0/2965950487 <== mon.0 v2:172.21.15.175:3300/0 4 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x56052b1fa600 con 0x56052a3cf000 2024-04-25T09:11:27.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66eda00640 1 -- 172.21.15.175:0/2965950487 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 66) v1 ==== 2723+0+0 (secure 0 0 0) 0x56052a32b180 con 0x56052a3cf000 2024-04-25T09:11:27.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f2bc38c0 4 Got MDS map 66 2024-04-25T09:11:27.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f2bc38c0 4 datascan.main: Using metadata pool output 2024-04-25T09:11:27.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f2bc38c0 4 datascan.main: connecting to RADOS... 2024-04-25T09:11:27.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f2bc38c0 1 Processor -- start 2024-04-25T09:11:27.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f2bc38c0 1 -- start start 2024-04-25T09:11:27.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f2bc38c0 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a3cf800 0x56052a48f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f2bc38c0 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56052a3cfc00 0x56052a490100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f2bc38c0 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56052b1f8c00 0x56052a490680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f2bc38c0 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56052b1e2480 con 0x56052b1f8c00 2024-04-25T09:11:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f2bc38c0 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x56052b1e2600 con 0x56052a3cf800 2024-04-25T09:11:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f2bc38c0 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x56052b1e2780 con 0x56052a3cfc00 2024-04-25T09:11:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f0200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56052b1f8c00 0x56052a490680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f0c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56052a3cfc00 0x56052a490100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f0200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a3cf800 0x56052a48f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f0c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56052a3cfc00 0x56052a490100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:47474/0 (socket says 172.21.15.175:47474) 2024-04-25T09:11:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f0c00640 1 -- 172.21.15.175:0/642759323 learned_addr learned my addr 172.21.15.175:0/642759323 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f0200640 1 -- 172.21.15.175:0/642759323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56052a3cfc00 msgr2=0x56052a490100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f0200640 1 --2- 172.21.15.175:0/642759323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56052a3cfc00 0x56052a490100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f0200640 1 -- 172.21.15.175:0/642759323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56052b1f8c00 msgr2=0x56052a490680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f0200640 1 --2- 172.21.15.175:0/642759323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56052b1f8c00 0x56052a490680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f0200640 1 -- 172.21.15.175:0/642759323 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56052a2fbe00 con 0x56052a3cf800 2024-04-25T09:11:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66f0200640 1 --2- 172.21.15.175:0/642759323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a3cf800 0x56052a48f600 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x56052b20aff0 tx=0x56052b218cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93c6866b4e2e40b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66eb200640 1 -- 172.21.15.175:0/642759323 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56052a30a1a0 con 0x56052a3cf800 2024-04-25T09:11:27.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66eb200640 1 -- 172.21.15.175:0/642759323 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56052a31ea80 con 0x56052a3cf800 2024-04-25T09:11:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.094+0000 7f66eb200640 1 -- 172.21.15.175:0/642759323 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56052a30a4e0 con 0x56052a3cf800 2024-04-25T09:11:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/642759323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a3cf800 msgr2=0x56052a48f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/642759323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a3cf800 0x56052a48f600 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x56052b20aff0 tx=0x56052b218cc0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/642759323 shutdown_connections 2024-04-25T09:11:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/642759323 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56052b1f8c00 0x56052a490680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/642759323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56052a3cfc00 0x56052a490100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/642759323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a3cf800 0x56052a48f600 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/642759323 >> 172.21.15.175:0/642759323 conn(0x56052a3cf400 msgr2=0x56052a303800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/642759323 shutdown_connections 2024-04-25T09:11:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/642759323 wait complete. 2024-04-25T09:11:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 Processor -- start 2024-04-25T09:11:27.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 -- start start 2024-04-25T09:11:27.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56052a3cfc00 0x56052a491700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a3cf800 0x56052a491180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56052b1f9c00 0x56052a490c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x56052b1e3e00 con 0x56052b1f9c00 2024-04-25T09:11:27.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x56052b1e3c80 con 0x56052a3cf800 2024-04-25T09:11:27.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x56052b1e3b00 con 0x56052a3cfc00 2024-04-25T09:11:27.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f0c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a3cf800 0x56052a491180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f0c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a3cf800 0x56052a491180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:59102/0 (socket says 172.21.15.175:59102) 2024-04-25T09:11:27.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 learned_addr learned my addr 172.21.15.175:0/3374233301 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:27.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f0200640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56052b1f9c00 0x56052a490c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f0200640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56052a3cfc00 0x56052a491700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56052a3cfc00 msgr2=0x56052a491700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f0c00640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56052a3cfc00 0x56052a491700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56052b1f9c00 msgr2=0x56052a490c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f0c00640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56052b1f9c00 0x56052a490c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56052a2fa1e0 con 0x56052a3cf800 2024-04-25T09:11:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f0200640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56052a3cfc00 0x56052a491700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f0c00640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a3cf800 0x56052a491180 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x56052b121050 tx=0x56052b1f0120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66e9400640 1 -- 172.21.15.175:0/3374233301 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56052a30a1a0 con 0x56052a3cf800 2024-04-25T09:11:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66e9400640 1 -- 172.21.15.175:0/3374233301 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56052a31e540 con 0x56052a3cf800 2024-04-25T09:11:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56052a2fb4a0 con 0x56052a3cf800 2024-04-25T09:11:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66e9400640 1 -- 172.21.15.175:0/3374233301 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56052a30a4e0 con 0x56052a3cf800 2024-04-25T09:11:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56052a2fbc20 con 0x56052a3cf800 2024-04-25T09:11:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.098+0000 7f66f2bc38c0 4 datascan.init: resolving metadata pool 12 2024-04-25T09:11:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66e9400640 1 -- 172.21.15.175:0/3374233301 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x56052a606c00 con 0x56052a3cf800 2024-04-25T09:11:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66e9400640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x56052a614c00 0x56052a6fe000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66e9400640 1 -- 172.21.15.175:0/3374233301 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x56052a604e00 con 0x56052a3cf800 2024-04-25T09:11:27.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66f2bc38c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T09:11:27.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66f2bc38c0 4 datascan.main: resolving metadata pool 12 2024-04-25T09:11:27.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x56052b1f9800 0x56052a490680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:1 12.0 12:00000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052b1f9400 con 0x56052b1f9800 2024-04-25T09:11:27.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66f0200640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x56052a614c00 0x56052a6fe000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66f0200640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x56052b1f9800 0x56052a490680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66f0200640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x56052a614c00 0x56052a6fe000 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x56052b20b140 tx=0x56052a38fe60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66f0200640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x56052b1f9800 0x56052a490680 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.4 v2:172.21.15.177:6808/236493968 1 ==== osd_op_reply(1 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388000 con 0x56052b1f9800 2024-04-25T09:11:27.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66f0200640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x56052b1f9400 0x56052a6fe580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:2 12.10 12:08000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a614800 con 0x56052b1f9400 2024-04-25T09:11:27.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66f1600640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x56052b1f9400 0x56052a6fe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66f1600640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x56052b1f9400 0x56052a6fe580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 1 ==== osd_op_reply(2 [pgnls start_epoch 88 out=177b] v88'18 uv18 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66f1600640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x56052a614800 0x56052a48e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.102+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:3 12.8 12:10000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615000 con 0x56052a614800 2024-04-25T09:11:27.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.106+0000 7f66f0c00640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x56052a614800 0x56052a48e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.106+0000 7f66f0c00640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x56052a614800 0x56052a48e580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.106+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 <== osd.3 v2:172.21.15.175:6816/4078277957 1 ==== osd_op_reply(3 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388780 con 0x56052a614800 2024-04-25T09:11:27.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.106+0000 7f66f0c00640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x56052a615000 0x56052a6feb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.106+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:4 12.18 12:18000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a3cec00 con 0x56052a615000 2024-04-25T09:11:27.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.106+0000 7f66f0200640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x56052a615000 0x56052a6feb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.106+0000 7f66f0200640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x56052a615000 0x56052a6feb00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.106+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.1 v2:172.21.15.175:6802/594808902 1 ==== osd_op_reply(4 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388000 con 0x56052a615000 2024-04-25T09:11:27.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.106+0000 7f66f0200640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x56052a3cec00 0x56052a6ff080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.106+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:5 12.4 12:20000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70e000 con 0x56052a3cec00 2024-04-25T09:11:27.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.106+0000 7f66f1600640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x56052a3cec00 0x56052a6ff080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.106+0000 7f66f1600640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x56052a3cec00 0x56052a6ff080 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.106+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 1 ==== osd_op_reply(5 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.106+0000 7f66f1600640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x56052a70e000 0x56052a6ffb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.106+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:6 12.14 12:28000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615400 con 0x56052a70e000 2024-04-25T09:11:27.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.106+0000 7f66f0c00640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x56052a70e000 0x56052a6ffb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.106+0000 7f66f0c00640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x56052a70e000 0x56052a6ffb80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 <== osd.5 v2:172.21.15.177:6816/3311807078 1 ==== osd_op_reply(6 [pgnls start_epoch 88 out=149b] v87'28 uv28 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x56052a388780 con 0x56052a70e000 2024-04-25T09:11:27.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:7 12.c 12:30000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615400 con 0x56052b1f9400 2024-04-25T09:11:27.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 2 ==== osd_op_reply(7 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:8 12.1c 12:38000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615400 con 0x56052b1f9400 2024-04-25T09:11:27.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 3 ==== osd_op_reply(8 [pgnls start_epoch 88 out=73b] v87'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:9 12.2 12:40000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615400 con 0x56052b1f9800 2024-04-25T09:11:27.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.4 v2:172.21.15.177:6808/236493968 2 ==== osd_op_reply(9 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388000 con 0x56052b1f9800 2024-04-25T09:11:27.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:10 12.12 12:48000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615400 con 0x56052a614800 2024-04-25T09:11:27.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 <== osd.3 v2:172.21.15.175:6816/4078277957 2 ==== osd_op_reply(10 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388780 con 0x56052a614800 2024-04-25T09:11:27.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f0c00640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x56052a615400 0x56052a700680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:11 12.a 12:50000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70ec00 con 0x56052a615400 2024-04-25T09:11:27.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f0200640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x56052a615400 0x56052a700680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f0200640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x56052a615400 0x56052a700680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.2 v2:172.21.15.175:6821/3247063283 1 ==== osd_op_reply(11 [pgnls start_epoch 88 out=81b] v87'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56052a388000 con 0x56052a615400 2024-04-25T09:11:27.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:12 12.1a 12:58000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70ec00 con 0x56052b1f9800 2024-04-25T09:11:27.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.4 v2:172.21.15.177:6808/236493968 3 ==== osd_op_reply(12 [pgnls start_epoch 88 out=49b] v85'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388000 con 0x56052b1f9800 2024-04-25T09:11:27.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:13 12.6 12:60000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70ec00 con 0x56052a615000 2024-04-25T09:11:27.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.1 v2:172.21.15.175:6802/594808902 2 ==== osd_op_reply(13 [pgnls start_epoch 88 out=77b] v87'8 uv8 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x56052a388000 con 0x56052a615000 2024-04-25T09:11:27.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:14 12.16 12:68000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70ec00 con 0x56052a3cec00 2024-04-25T09:11:27.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 2 ==== osd_op_reply(14 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:15 12.e 12:70000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70ec00 con 0x56052b1f9400 2024-04-25T09:11:27.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.110+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 4 ==== osd_op_reply(15 [pgnls start_epoch 88 out=73b] v87'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:16 12.1e 12:78000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70ec00 con 0x56052b1f9800 2024-04-25T09:11:27.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.4 v2:172.21.15.177:6808/236493968 4 ==== osd_op_reply(16 [pgnls start_epoch 88 out=49b] v85'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388000 con 0x56052b1f9800 2024-04-25T09:11:27.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:17 12.1 12:80000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70ec00 con 0x56052a3cec00 2024-04-25T09:11:27.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 3 ==== osd_op_reply(17 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:18 12.11 12:88000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70ec00 con 0x56052a70e000 2024-04-25T09:11:27.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 <== osd.5 v2:172.21.15.177:6816/3311807078 2 ==== osd_op_reply(18 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388780 con 0x56052a70e000 2024-04-25T09:11:27.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:19 12.9 12:90000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70ec00 con 0x56052a615400 2024-04-25T09:11:27.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.2 v2:172.21.15.175:6821/3247063283 2 ==== osd_op_reply(19 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388000 con 0x56052a615400 2024-04-25T09:11:27.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:20 12.19 12:98000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70ec00 con 0x56052b1f9400 2024-04-25T09:11:27.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 5 ==== osd_op_reply(20 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:21 12.5 12:a0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70ec00 con 0x56052a3cec00 2024-04-25T09:11:27.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 4 ==== osd_op_reply(21 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:22 12.15 12:a8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70ec00 con 0x56052a3cec00 2024-04-25T09:11:27.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 5 ==== osd_op_reply(22 [pgnls start_epoch 88 out=97b] v87'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f1600640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x56052a70ec00 0x56052a700100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:23 12.d 12:b0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615800 con 0x56052a70ec00 2024-04-25T09:11:27.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f1600640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x56052a70ec00 0x56052a700100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f1600640 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x56052a70ec00 0x56052a700100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.7 v2:172.21.15.177:6800/3881136076 1 ==== osd_op_reply(23 [pgnls start_epoch 88 out=74b] v83'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x56052a388500 con 0x56052a70ec00 2024-04-25T09:11:27.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:24 12.1d 12:b8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615800 con 0x56052b1f9400 2024-04-25T09:11:27.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 6 ==== osd_op_reply(24 [pgnls start_epoch 88 out=73b] v87'5 uv5 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.114+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:25 12.3 12:c0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615800 con 0x56052b1f9400 2024-04-25T09:11:27.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 7 ==== osd_op_reply(25 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:26 12.13 12:c8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615800 con 0x56052a615000 2024-04-25T09:11:27.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.1 v2:172.21.15.175:6802/594808902 3 ==== osd_op_reply(26 [pgnls start_epoch 88 out=98b] v87'4 uv4 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x56052a388000 con 0x56052a615000 2024-04-25T09:11:27.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:27 12.b 12:d0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615800 con 0x56052a614800 2024-04-25T09:11:27.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 <== osd.3 v2:172.21.15.175:6816/4078277957 3 ==== osd_op_reply(27 [pgnls start_epoch 88 out=76b] v87'6 uv6 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x56052a388780 con 0x56052a614800 2024-04-25T09:11:27.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:28 12.1b 12:d8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615800 con 0x56052b1f9800 2024-04-25T09:11:27.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.4 v2:172.21.15.177:6808/236493968 5 ==== osd_op_reply(28 [pgnls start_epoch 88 out=73b] v87'10 uv10 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56052a388000 con 0x56052b1f9800 2024-04-25T09:11:27.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:29 12.7 12:e0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615800 con 0x56052a615000 2024-04-25T09:11:27.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.1 v2:172.21.15.175:6802/594808902 4 ==== osd_op_reply(29 [pgnls start_epoch 88 out=73b] v87'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56052a388000 con 0x56052a615000 2024-04-25T09:11:27.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:30 12.17 12:e8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615800 con 0x56052a3cec00 2024-04-25T09:11:27.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 6 ==== osd_op_reply(30 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:31 12.f 12:f0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615800 con 0x56052a3cec00 2024-04-25T09:11:27.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 7 ==== osd_op_reply(31 [pgnls start_epoch 88 out=73b] v83'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:32 12.1f 12:f8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615800 con 0x56052a3cec00 2024-04-25T09:11:27.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 8 ==== osd_op_reply(32 [pgnls start_epoch 88 out=101b] v87'9 uv9 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 601.00000000 2024-04-25T09:11:27.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:33 12.10 12:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052b1f9000 con 0x56052b1f9400 2024-04-25T09:11:27.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 8 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 602.00000000 2024-04-25T09:11:27.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:34 12.10 12:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052b1f8c00 con 0x56052b1f9400 2024-04-25T09:11:27.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 9 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-25T09:11:27.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:35 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70fc00 con 0x56052b1f9400 2024-04-25T09:11:27.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 10 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f2bc38c0 20 datascan.scan_links: injected ino detected 2024-04-25T09:11:27.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 600.00000000 2024-04-25T09:11:27.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:36 12.10 12:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720000 con 0x56052b1f9400 2024-04-25T09:11:27.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 11 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 603.00000000 2024-04-25T09:11:27.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.118+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:37 12.10 12:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052b1f9400 2024-04-25T09:11:27.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 12 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-25T09:11:27.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T09:11:27.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 200.00000000 2024-04-25T09:11:27.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T09:11:27.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 200.00000001 2024-04-25T09:11:27.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T09:11:27.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 606.00000000 2024-04-25T09:11:27.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:38 12.14 12:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720800 con 0x56052a70e000 2024-04-25T09:11:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 <== osd.5 v2:172.21.15.177:6816/3311807078 3 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv26 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388780 con 0x56052a70e000 2024-04-25T09:11:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 607.00000000 2024-04-25T09:11:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:39 12.1c 12:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720c00 con 0x56052b1f9400 2024-04-25T09:11:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 13 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 100000001f6.00000000 2024-04-25T09:11:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:40 12.a 12:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a721000 con 0x56052a615400 2024-04-25T09:11:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.2 v2:172.21.15.175:6821/3247063283 3 ==== osd_op_reply(40 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+54 (crc 0 0 0) 0x56052a388000 con 0x56052a615400 2024-04-25T09:11:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-04-25T09:11:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T09:11:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 608.00000000 2024-04-25T09:11:27.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:41 12.e 12:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a721400 con 0x56052b1f9400 2024-04-25T09:11:27.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 14 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 604.00000000 2024-04-25T09:11:27.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:42 12.15 12:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a721800 con 0x56052a3cec00 2024-04-25T09:11:27.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 9 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 500.00000000 2024-04-25T09:11:27.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T09:11:27.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-25T09:11:27.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T09:11:27.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 605.00000000 2024-04-25T09:11:27.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:43 12.1d 12:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a721c00 con 0x56052b1f9400 2024-04-25T09:11:27.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 15 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-25T09:11:27.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T09:11:27.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-25T09:11:27.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:44 12.13 12:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720000 con 0x56052a615000 2024-04-25T09:11:27.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.1 v2:172.21.15.175:6802/594808902 5 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x56052a388000 con 0x56052a615000 2024-04-25T09:11:27.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-25T09:11:27.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T09:11:27.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 200.00000002 2024-04-25T09:11:27.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-04-25T09:11:27.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 609.00000000 2024-04-25T09:11:27.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:45 12.7 12:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70fc00 con 0x56052a615000 2024-04-25T09:11:27.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.1 v2:172.21.15.175:6802/594808902 6 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388000 con 0x56052a615000 2024-04-25T09:11:27.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 400.00000000 2024-04-25T09:11:27.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T09:11:27.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-25T09:11:27.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T09:11:27.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-25T09:11:27.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:46 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052b1f9000 con 0x56052a3cec00 2024-04-25T09:11:27.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 10 ==== osd_op_reply(46 1.00000000 [omap-get-vals out=1041b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+1041 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:47 12.0 12:00000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052b1f8c00 con 0x56052b1f9800 2024-04-25T09:11:27.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.4 v2:172.21.15.177:6808/236493968 6 ==== osd_op_reply(47 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388000 con 0x56052b1f9800 2024-04-25T09:11:27.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.122+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:48 12.10 12:08000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052b1f8c00 con 0x56052b1f9400 2024-04-25T09:11:27.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 16 ==== osd_op_reply(48 [pgnls start_epoch 88 out=177b] v88'18 uv18 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:49 12.8 12:10000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a614800 2024-04-25T09:11:27.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 <== osd.3 v2:172.21.15.175:6816/4078277957 4 ==== osd_op_reply(49 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388780 con 0x56052a614800 2024-04-25T09:11:27.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:50 12.18 12:18000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a615000 2024-04-25T09:11:27.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.1 v2:172.21.15.175:6802/594808902 7 ==== osd_op_reply(50 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388000 con 0x56052a615000 2024-04-25T09:11:27.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:51 12.4 12:20000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a3cec00 2024-04-25T09:11:27.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 11 ==== osd_op_reply(51 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:52 12.14 12:28000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a70e000 2024-04-25T09:11:27.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 <== osd.5 v2:172.21.15.177:6816/3311807078 4 ==== osd_op_reply(52 [pgnls start_epoch 88 out=149b] v87'28 uv28 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x56052a388780 con 0x56052a70e000 2024-04-25T09:11:27.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:53 12.c 12:30000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052b1f9400 2024-04-25T09:11:27.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 17 ==== osd_op_reply(53 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:54 12.1c 12:38000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052b1f9400 2024-04-25T09:11:27.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 18 ==== osd_op_reply(54 [pgnls start_epoch 88 out=73b] v87'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:55 12.2 12:40000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052b1f9800 2024-04-25T09:11:27.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.4 v2:172.21.15.177:6808/236493968 7 ==== osd_op_reply(55 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388000 con 0x56052b1f9800 2024-04-25T09:11:27.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:56 12.12 12:48000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a614800 2024-04-25T09:11:27.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 <== osd.3 v2:172.21.15.175:6816/4078277957 5 ==== osd_op_reply(56 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388780 con 0x56052a614800 2024-04-25T09:11:27.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:57 12.a 12:50000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a615400 2024-04-25T09:11:27.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.2 v2:172.21.15.175:6821/3247063283 4 ==== osd_op_reply(57 [pgnls start_epoch 88 out=81b] v87'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56052a388000 con 0x56052a615400 2024-04-25T09:11:27.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:58 12.1a 12:58000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052b1f9800 2024-04-25T09:11:27.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.4 v2:172.21.15.177:6808/236493968 8 ==== osd_op_reply(58 [pgnls start_epoch 88 out=49b] v85'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388000 con 0x56052b1f9800 2024-04-25T09:11:27.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.126+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:59 12.6 12:60000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a615000 2024-04-25T09:11:27.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.1 v2:172.21.15.175:6802/594808902 8 ==== osd_op_reply(59 [pgnls start_epoch 88 out=77b] v87'8 uv8 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x56052a388000 con 0x56052a615000 2024-04-25T09:11:27.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:60 12.16 12:68000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a3cec00 2024-04-25T09:11:27.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 12 ==== osd_op_reply(60 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:61 12.e 12:70000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052b1f9400 2024-04-25T09:11:27.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 19 ==== osd_op_reply(61 [pgnls start_epoch 88 out=73b] v87'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:62 12.1e 12:78000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052b1f9800 2024-04-25T09:11:27.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.4 v2:172.21.15.177:6808/236493968 9 ==== osd_op_reply(62 [pgnls start_epoch 88 out=49b] v85'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388000 con 0x56052b1f9800 2024-04-25T09:11:27.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:63 12.1 12:80000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a3cec00 2024-04-25T09:11:27.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 13 ==== osd_op_reply(63 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:64 12.11 12:88000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a70e000 2024-04-25T09:11:27.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 <== osd.5 v2:172.21.15.177:6816/3311807078 5 ==== osd_op_reply(64 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388780 con 0x56052a70e000 2024-04-25T09:11:27.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:65 12.9 12:90000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a615400 2024-04-25T09:11:27.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.2 v2:172.21.15.175:6821/3247063283 5 ==== osd_op_reply(65 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388000 con 0x56052a615400 2024-04-25T09:11:27.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:66 12.19 12:98000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052b1f9400 2024-04-25T09:11:27.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 20 ==== osd_op_reply(66 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:67 12.5 12:a0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a3cec00 2024-04-25T09:11:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 14 ==== osd_op_reply(67 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:68 12.15 12:a8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a3cec00 2024-04-25T09:11:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 15 ==== osd_op_reply(68 [pgnls start_epoch 88 out=97b] v87'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:69 12.d 12:b0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a70ec00 2024-04-25T09:11:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.7 v2:172.21.15.177:6800/3881136076 2 ==== osd_op_reply(69 [pgnls start_epoch 88 out=74b] v83'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x56052a388500 con 0x56052a70ec00 2024-04-25T09:11:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:70 12.1d 12:b8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052b1f9400 2024-04-25T09:11:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 21 ==== osd_op_reply(70 [pgnls start_epoch 88 out=73b] v87'5 uv5 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.130+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:71 12.3 12:c0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052b1f9400 2024-04-25T09:11:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 22 ==== osd_op_reply(71 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:72 12.13 12:c8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a615000 2024-04-25T09:11:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.1 v2:172.21.15.175:6802/594808902 9 ==== osd_op_reply(72 [pgnls start_epoch 88 out=98b] v87'4 uv4 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x56052a388000 con 0x56052a615000 2024-04-25T09:11:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:73 12.b 12:d0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a614800 2024-04-25T09:11:27.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 <== osd.3 v2:172.21.15.175:6816/4078277957 6 ==== osd_op_reply(73 [pgnls start_epoch 88 out=76b] v87'6 uv6 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x56052a388780 con 0x56052a614800 2024-04-25T09:11:27.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:74 12.1b 12:d8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052b1f9800 2024-04-25T09:11:27.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.4 v2:172.21.15.177:6808/236493968 10 ==== osd_op_reply(74 [pgnls start_epoch 88 out=73b] v87'10 uv10 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56052a388000 con 0x56052b1f9800 2024-04-25T09:11:27.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:75 12.7 12:e0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a615000 2024-04-25T09:11:27.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.1 v2:172.21.15.175:6802/594808902 10 ==== osd_op_reply(75 [pgnls start_epoch 88 out=73b] v87'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56052a388000 con 0x56052a615000 2024-04-25T09:11:27.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:76 12.17 12:e8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a3cec00 2024-04-25T09:11:27.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 16 ==== osd_op_reply(76 [pgnls start_epoch 88 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:77 12.f 12:f0000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a3cec00 2024-04-25T09:11:27.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 17 ==== osd_op_reply(77 [pgnls start_epoch 88 out=73b] v83'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:78 12.1f 12:f8000000::::head [pgnls start_epoch 88 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052a3cec00 2024-04-25T09:11:27.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 18 ==== osd_op_reply(78 [pgnls start_epoch 88 out=101b] v87'9 uv9 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 601.00000000 2024-04-25T09:11:27.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:79 12.10 12:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615c00 con 0x56052b1f9400 2024-04-25T09:11:27.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 23 ==== osd_op_reply(79 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 602.00000000 2024-04-25T09:11:27.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:80 12.10 12:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615800 con 0x56052b1f9400 2024-04-25T09:11:27.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 24 ==== osd_op_reply(80 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-25T09:11:27.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:81 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a721c00 con 0x56052b1f9400 2024-04-25T09:11:27.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 25 ==== osd_op_reply(81 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f2bc38c0 20 datascan.scan_links: injected ino detected 2024-04-25T09:11:27.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f2bc38c0 -1 datascan.scan_links: Bad nlink on 0x10000000001 expected 2 has 1 2024-04-25T09:11:27.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f2bc38c0 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2024-04-25T09:11:27.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 600.00000000 2024-04-25T09:11:27.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:82 12.10 12:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a721800 con 0x56052b1f9400 2024-04-25T09:11:27.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 26 ==== osd_op_reply(82 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 603.00000000 2024-04-25T09:11:27.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.134+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:83 12.10 12:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a721400 con 0x56052b1f9400 2024-04-25T09:11:27.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 27 ==== osd_op_reply(83 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-25T09:11:27.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T09:11:27.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 200.00000000 2024-04-25T09:11:27.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T09:11:27.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 200.00000001 2024-04-25T09:11:27.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T09:11:27.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 606.00000000 2024-04-25T09:11:27.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:84 12.14 12:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720c00 con 0x56052a70e000 2024-04-25T09:11:27.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 <== osd.5 v2:172.21.15.177:6816/3311807078 6 ==== osd_op_reply(84 606.00000000 [omap-get-vals out=5b] v0'0 uv26 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388780 con 0x56052a70e000 2024-04-25T09:11:27.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 607.00000000 2024-04-25T09:11:27.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:85 12.1c 12:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720400 con 0x56052b1f9400 2024-04-25T09:11:27.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 28 ==== osd_op_reply(85 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 100000001f6.00000000 2024-04-25T09:11:27.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:86 12.a 12:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a721000 con 0x56052a615400 2024-04-25T09:11:27.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.2 v2:172.21.15.175:6821/3247063283 6 ==== osd_op_reply(86 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+54 (crc 0 0 0) 0x56052a388000 con 0x56052a615400 2024-04-25T09:11:27.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-04-25T09:11:27.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T09:11:27.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 608.00000000 2024-04-25T09:11:27.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:87 12.e 12:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a720000 con 0x56052b1f9400 2024-04-25T09:11:27.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 29 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 604.00000000 2024-04-25T09:11:27.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:88 12.15 12:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615c00 con 0x56052a3cec00 2024-04-25T09:11:27.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 19 ==== osd_op_reply(88 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 500.00000000 2024-04-25T09:11:27.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T09:11:27.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-25T09:11:27.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T09:11:27.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 605.00000000 2024-04-25T09:11:27.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615800 con 0x56052b1f9400 2024-04-25T09:11:27.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 30 ==== osd_op_reply(89 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-25T09:11:27.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T09:11:27.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-25T09:11:27.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:90 12.13 12:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052b1f8c00 con 0x56052a615000 2024-04-25T09:11:27.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.1 v2:172.21.15.175:6802/594808902 11 ==== osd_op_reply(90 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x56052a388000 con 0x56052a615000 2024-04-25T09:11:27.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-25T09:11:27.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T09:11:27.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 200.00000002 2024-04-25T09:11:27.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-04-25T09:11:27.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 609.00000000 2024-04-25T09:11:27.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:91 12.7 12:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052b1f9000 con 0x56052a615000 2024-04-25T09:11:27.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.1 v2:172.21.15.175:6802/594808902 12 ==== osd_op_reply(91 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x56052a388000 con 0x56052a615000 2024-04-25T09:11:27.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 400.00000000 2024-04-25T09:11:27.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T09:11:27.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-25T09:11:27.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T09:11:27.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-25T09:11:27.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:92 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70e800 con 0x56052a3cec00 2024-04-25T09:11:27.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.6 v2:172.21.15.177:6822/4132808595 20 ==== osd_op_reply(92 1.00000000 [omap-get-vals out=1041b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+1041 (crc 0 0 0) 0x56052a388500 con 0x56052a3cec00 2024-04-25T09:11:27.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: processing 0 dup_primaries, 1 remote_links 2024-04-25T09:11:27.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-25T09:11:27.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: processing 1 bad_nlink_inos 2024-04-25T09:11:27.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 10 datascan.scan_links: handling bad_nlink_ino 0x10000000001 2024-04-25T09:11:27.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:93 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70e400 con 0x56052b1f9400 2024-04-25T09:11:27.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 31 ==== osd_op_reply(93 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+505 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-25T09:11:27.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.138+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:94 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70fc00 con 0x56052b1f9400 2024-04-25T09:11:27.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.142+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 32 ==== osd_op_reply(94 10000000000.00000000 [omap-set-vals] v88'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.142+0000 7f66f2bc38c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-25T09:11:27.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.142+0000 7f66f2bc38c0 10 datascan.scan_links: processing 1 injected_inos 2024-04-25T09:11:27.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.142+0000 7f66f2bc38c0 10 datascan.scan_links: handling injected_ino 0x10000000001 2024-04-25T09:11:27.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.142+0000 7f66f2bc38c0 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:file 2024-04-25T09:11:27.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.142+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:95 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70e800 con 0x56052b1f9400 2024-04-25T09:11:27.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.142+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 33 ==== osd_op_reply(95 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+505 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.142+0000 7f66f2bc38c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-25T09:11:27.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.142+0000 7f66f2bc38c0 20 datascan.scan_links: first is now 2 2024-04-25T09:11:27.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.142+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:96 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70e400 con 0x56052b1f9400 2024-04-25T09:11:27.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.0 v2:172.21.15.175:6800/1093269849 34 ==== osd_op_reply(96 10000000000.00000000 [omap-set-vals] v88'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56052a388500 con 0x56052b1f9400 2024-04-25T09:11:27.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-25T09:11:27.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 10 datascan.scan_links: updating inotable 2024-04-25T09:11:27.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:97 12.13 12:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a70fc00 con 0x56052a615000 2024-04-25T09:11:27.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.1 v2:172.21.15.175:6802/594808902 13 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+50 (crc 0 0 0) 0x56052a388000 con 0x56052a615000 2024-04-25T09:11:27.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 10 mds.0.inotable: skip_inos was [0x10000000002~0x1f4,0x100000001f7~0xfffffffe09] 2024-04-25T09:11:27.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 10 mds.0.inotable: skip_inos now [0x100000001f7~0xfffffffe09] 2024-04-25T09:11:27.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:98 12.13 12:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615c00 con 0x56052a615000 2024-04-25T09:11:27.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f0200640 1 -- 172.21.15.175:0/3374233301 <== osd.1 v2:172.21.15.175:6802/594808902 14 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v88'5 uv5 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x56052a388000 con 0x56052a615000 2024-04-25T09:11:27.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 10 datascan.scan_links: updating snaptable 2024-04-25T09:11:27.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:99 12.d 12:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88) v9 -- 0x56052a615800 con 0x56052a70ec00 2024-04-25T09:11:27.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f1600640 1 -- 172.21.15.175:0/3374233301 <== osd.7 v2:172.21.15.177:6800/3881136076 3 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x56052a388280 con 0x56052a70ec00 2024-04-25T09:11:27.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x56052b1f9400 msgr2=0x56052a6fe580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x56052b1f9400 0x56052a6fe580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x56052a615000 msgr2=0x56052a6feb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x56052a615000 0x56052a6feb00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x56052a615400 msgr2=0x56052a700680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x56052a615400 0x56052a700680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x56052a614800 msgr2=0x56052a48e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x56052a614800 0x56052a48e580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x56052b1f9800 msgr2=0x56052a490680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x56052b1f9800 0x56052a490680 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x56052a70e000 msgr2=0x56052a6ffb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x56052a70e000 0x56052a6ffb80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 reap_dead start 2024-04-25T09:11:27.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x56052a3cec00 msgr2=0x56052a6ff080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x56052a3cec00 0x56052a6ff080 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x56052a70ec00 msgr2=0x56052a700100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 reap_dead start 2024-04-25T09:11:27.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x56052a70ec00 0x56052a700100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 reap_dead start 2024-04-25T09:11:27.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f0c00640 1 -- 172.21.15.175:0/3374233301 reap_dead start 2024-04-25T09:11:27.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x56052a614c00 msgr2=0x56052a6fe000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x56052a614c00 0x56052a6fe000 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x56052b20b140 tx=0x56052a38fe60 comp rx=0 tx=0).stop 2024-04-25T09:11:27.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a3cf800 msgr2=0x56052a491180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a3cf800 0x56052a491180 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x56052b121050 tx=0x56052b1f0120 comp rx=0 tx=0).stop 2024-04-25T09:11:27.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 shutdown_connections 2024-04-25T09:11:27.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x56052a614c00 0x56052a6fe000 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/3374233301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a3cf800 0x56052a491180 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 >> 172.21.15.175:0/3374233301 conn(0x56052a3cf400 msgr2=0x56052a303800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 shutdown_connections 2024-04-25T09:11:27.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/3374233301 wait complete. 2024-04-25T09:11:27.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/2965950487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56052a3cf000 msgr2=0x56052a48fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/2965950487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56052a3cf000 0x56052a48fb80 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x56052b121b30 tx=0x56052b1f0300 comp rx=0 tx=0).stop 2024-04-25T09:11:27.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/2965950487 shutdown_connections 2024-04-25T09:11:27.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/2965950487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56052a3cf000 0x56052a48fb80 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/2965950487 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56052a2d5c00 0x56052a48eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 --2- 172.21.15.175:0/2965950487 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56052a3ce000 0x56052a48f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/2965950487 >> 172.21.15.175:0/2965950487 conn(0x56052a2d4c00 msgr2=0x56052a302800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/2965950487 shutdown_connections 2024-04-25T09:11:27.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.146+0000 7f66f2bc38c0 1 -- 172.21.15.175:0/2965950487 wait complete. 2024-04-25T09:11:27.143 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.149299, result: 2024-04-25T09:11:27.143 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T09:11:27.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.334+0000 7fc7faa00640 1 Processor -- start 2024-04-25T09:11:27.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.334+0000 7fc7faa00640 1 -- start start 2024-04-25T09:11:27.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.334+0000 7fc7faa00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc7f406b5c0 0x7fc7f40ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.334+0000 7fc7faa00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f406bbd0 con 0x7fc7f406b1e0 2024-04-25T09:11:27.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.334+0000 7fc7faa00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f406beb0 con 0x7fc7f40cab20 2024-04-25T09:11:27.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.334+0000 7fc7faa00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f40caf50 con 0x7fc7f406b5c0 2024-04-25T09:11:27.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.334+0000 7fc7f3e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc7f406b1e0 0x7fc7f4145160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:33560/0 (socket says 172.21.15.175:33560) 2024-04-25T09:11:27.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.334+0000 7fc7f3e00640 1 -- 172.21.15.175:0/1724103289 learned_addr learned my addr 172.21.15.175:0/1724103289 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:11:27.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.334+0000 7fc7eb400640 1 --2- 172.21.15.175:0/1724103289 >> v2:172.21.15.177:3300/0 conn(0x7fc7f406b5c0 0x7fc7f40ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.334+0000 7fc7f3400640 1 -- 172.21.15.175:0/1724103289 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880948456 0 0) 0x7fc7f406bbd0 con 0x7fc7f406b1e0 2024-04-25T09:11:27.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.334+0000 7fc7f3400640 1 -- 172.21.15.175:0/1724103289 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7d8003530 con 0x7fc7f406b1e0 2024-04-25T09:11:27.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.334+0000 7fc7f3400640 1 -- 172.21.15.175:0/1724103289 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2143066565 0 0) 0x7fc7f406beb0 con 0x7fc7f40cab20 2024-04-25T09:11:27.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.334+0000 7fc7f3400640 1 -- 172.21.15.175:0/1724103289 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7f406bbd0 con 0x7fc7f40cab20 2024-04-25T09:11:27.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.334+0000 7fc7eb400640 1 -- 172.21.15.175:0/1724103289 >> v1:172.21.15.177:6789/0 conn(0x7fc7f40cab20 legacy=0x7fc7f40cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.334+0000 7fc7eb400640 1 -- 172.21.15.175:0/1724103289 >> v1:172.21.15.175:6789/0 conn(0x7fc7f406b1e0 legacy=0x7fc7f4145160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.334+0000 7fc7f3400640 1 -- 172.21.15.175:0/1724103289 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2950436383 0 0) 0x7fc7d8003530 con 0x7fc7f406b1e0 2024-04-25T09:11:27.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.334+0000 7fc7eb400640 1 -- 172.21.15.175:0/1724103289 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f406c190 con 0x7fc7f406b5c0 2024-04-25T09:11:27.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.338+0000 7fc7eb400640 1 --2- 172.21.15.175:0/1724103289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406b5c0 0x7fc7f40ca5e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0097c0 tx=0x7fc7dc01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bf72cd79166e35f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.338+0000 7fc7f3400640 1 -- 172.21.15.175:0/1724103289 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0b0070 con 0x7fc7f406b5c0 2024-04-25T09:11:27.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.338+0000 7fc7f3400640 1 -- 172.21.15.175:0/1724103289 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc0ab400 con 0x7fc7f406b5c0 2024-04-25T09:11:27.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.338+0000 7fc7f3400640 1 -- 172.21.15.175:0/1724103289 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4001a00 con 0x7fc7f406b5c0 2024-04-25T09:11:27.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.338+0000 7fc7faa00640 1 -- 172.21.15.175:0/1724103289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406b5c0 msgr2=0x7fc7f40ca5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.338+0000 7fc7faa00640 1 --2- 172.21.15.175:0/1724103289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406b5c0 0x7fc7f40ca5e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0097c0 tx=0x7fc7dc01c3c0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.338+0000 7fc7faa00640 1 -- 172.21.15.175:0/1724103289 shutdown_connections 2024-04-25T09:11:27.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.338+0000 7fc7faa00640 1 --2- 172.21.15.175:0/1724103289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406b5c0 0x7fc7f40ca5e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.338+0000 7fc7faa00640 1 -- 172.21.15.175:0/1724103289 >> 172.21.15.175:0/1724103289 conn(0x7fc7f40cca10 msgr2=0x7fc7f40cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.338+0000 7fc7faa00640 1 -- 172.21.15.175:0/1724103289 shutdown_connections 2024-04-25T09:11:27.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.338+0000 7fc7faa00640 1 -- 172.21.15.175:0/1724103289 wait complete. 2024-04-25T09:11:27.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7faa00640 1 Processor -- start 2024-04-25T09:11:27.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7faa00640 1 -- start start 2024-04-25T09:11:27.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7faa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7f406b1e0 0x7fc7f40b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7faa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406b5c0 0x7fc7f40c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7faa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7f40cab20 0x7fc7f4159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7faa00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f40cf2e0 con 0x7fc7f406b1e0 2024-04-25T09:11:27.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7faa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f40cf160 con 0x7fc7f406b5c0 2024-04-25T09:11:27.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7faa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f4169860 con 0x7fc7f40cab20 2024-04-25T09:11:27.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7f3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7f406b1e0 0x7fc7f40b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7f3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7f406b1e0 0x7fc7f40b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46898/0 (socket says 172.21.15.175:46898) 2024-04-25T09:11:27.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7f3e00640 1 -- 172.21.15.175:0/1966119046 learned_addr learned my addr 172.21.15.175:0/1966119046 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:27.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7eb400640 1 --2- 172.21.15.175:0/1966119046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406b5c0 0x7fc7f40c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7f8a00640 1 --2- 172.21.15.175:0/1966119046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7f40cab20 0x7fc7f4159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7f3e00640 1 -- 172.21.15.175:0/1966119046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7f40cab20 msgr2=0x7fc7f4159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7f3e00640 1 --2- 172.21.15.175:0/1966119046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7f40cab20 0x7fc7f4159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7f3e00640 1 -- 172.21.15.175:0/1966119046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406b5c0 msgr2=0x7fc7f40c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7f3e00640 1 --2- 172.21.15.175:0/1966119046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406b5c0 0x7fc7f40c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7f3e00640 1 -- 172.21.15.175:0/1966119046 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f40b2ff0 con 0x7fc7f406b1e0 2024-04-25T09:11:27.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7f8a00640 1 --2- 172.21.15.175:0/1966119046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7f40cab20 0x7fc7f4159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:27.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7eb400640 1 --2- 172.21.15.175:0/1966119046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406b5c0 0x7fc7f40c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:27.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7f3e00640 1 --2- 172.21.15.175:0/1966119046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7f406b1e0 0x7fc7f40b4090 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4001f40 tx=0x7fc7e400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7f0c00640 1 -- 172.21.15.175:0/1966119046 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4017070 con 0x7fc7f406b1e0 2024-04-25T09:11:27.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7f0c00640 1 -- 172.21.15.175:0/1966119046 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e4012400 con 0x7fc7f406b1e0 2024-04-25T09:11:27.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7f0c00640 1 -- 172.21.15.175:0/1966119046 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4012870 con 0x7fc7f406b1e0 2024-04-25T09:11:27.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7faa00640 1 -- 172.21.15.175:0/1966119046 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f40b32d0 con 0x7fc7f406b1e0 2024-04-25T09:11:27.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.342+0000 7fc7faa00640 1 -- 172.21.15.175:0/1966119046 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f40b3890 con 0x7fc7f406b1e0 2024-04-25T09:11:27.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.346+0000 7fc7faa00640 1 -- 172.21.15.175:0/1966119046 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f4075160 con 0x7fc7f406b1e0 2024-04-25T09:11:27.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.346+0000 7fc7f0c00640 1 -- 172.21.15.175:0/1966119046 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc7e401a070 con 0x7fc7f406b1e0 2024-04-25T09:11:27.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.346+0000 7fc7f0c00640 1 --2- 172.21.15.175:0/1966119046 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc7d0066f60 0x7fc7d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.346+0000 7fc7f0c00640 1 -- 172.21.15.175:0/1966119046 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fc7e40850f0 con 0x7fc7f406b1e0 2024-04-25T09:11:27.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.346+0000 7fc7eb400640 1 --2- 172.21.15.175:0/1966119046 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc7d0066f60 0x7fc7d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.346+0000 7fc7eb400640 1 --2- 172.21.15.175:0/1966119046 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc7d0066f60 0x7fc7d0069420 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0ad000 tx=0x7fc7dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.350+0000 7fc7f0c00640 1 -- 172.21.15.175:0/1966119046 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc7e4056020 con 0x7fc7f406b1e0 2024-04-25T09:11:27.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.542+0000 7fc7faa00640 1 -- 172.21.15.175:0/1966119046 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fc7f409da90 con 0x7fc7f406b1e0 2024-04-25T09:11:27.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.714+0000 7fc7f0c00640 1 -- 172.21.15.175:0/1966119046 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v67) v1 ==== 162+0+0 (secure 0 0 0) 0x7fc7e4055920 con 0x7fc7f406b1e0 2024-04-25T09:11:27.704 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T09:11:27.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.718+0000 7fc7faa00640 1 -- 172.21.15.175:0/1966119046 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc7d0066f60 msgr2=0x7fc7d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.718+0000 7fc7faa00640 1 --2- 172.21.15.175:0/1966119046 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc7d0066f60 0x7fc7d0069420 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc0ad000 tx=0x7fc7dc008040 comp rx=0 tx=0).stop 2024-04-25T09:11:27.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.718+0000 7fc7faa00640 1 -- 172.21.15.175:0/1966119046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7f406b1e0 msgr2=0x7fc7f40b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.718+0000 7fc7faa00640 1 --2- 172.21.15.175:0/1966119046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7f406b1e0 0x7fc7f40b4090 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4001f40 tx=0x7fc7e400a430 comp rx=0 tx=0).stop 2024-04-25T09:11:27.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.718+0000 7fc7faa00640 1 -- 172.21.15.175:0/1966119046 shutdown_connections 2024-04-25T09:11:27.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.718+0000 7fc7faa00640 1 --2- 172.21.15.175:0/1966119046 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc7d0066f60 0x7fc7d0069420 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.718+0000 7fc7faa00640 1 --2- 172.21.15.175:0/1966119046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7f40cab20 0x7fc7f4159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.718+0000 7fc7faa00640 1 --2- 172.21.15.175:0/1966119046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7f406b5c0 0x7fc7f40c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.718+0000 7fc7faa00640 1 --2- 172.21.15.175:0/1966119046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7f406b1e0 0x7fc7f40b4090 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.718+0000 7fc7faa00640 1 -- 172.21.15.175:0/1966119046 >> 172.21.15.175:0/1966119046 conn(0x7fc7f40cca10 msgr2=0x7fc7f40ade10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.718+0000 7fc7faa00640 1 -- 172.21.15.175:0/1966119046 shutdown_connections 2024-04-25T09:11:27.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.718+0000 7fc7faa00640 1 -- 172.21.15.175:0/1966119046 wait complete. 2024-04-25T09:11:27.731 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:27.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.874+0000 7fd4b2200640 1 Processor -- start 2024-04-25T09:11:27.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.878+0000 7fd4b2200640 1 -- start start 2024-04-25T09:11:27.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.878+0000 7fd4b2200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd4ac144fc0 0x7fd4ac0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.878+0000 7fd4b2200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd4ac15c5e0 0x7fd4ac0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.878+0000 7fd4b2200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ac15cd00 con 0x7fd4ac1453a0 2024-04-25T09:11:27.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.878+0000 7fd4b2200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ac0ce660 con 0x7fd4ac144fc0 2024-04-25T09:11:27.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.878+0000 7fd4b2200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ac0cc930 con 0x7fd4ac15c5e0 2024-04-25T09:11:27.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.878+0000 7fd4ab400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd4ac144fc0 0x7fd4ac0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.878+0000 7fd4a2a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd4ac1453a0 0x7fd4ac15bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:33564/0 (socket says 172.21.15.175:33564) 2024-04-25T09:11:27.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.878+0000 7fd4a2a00640 1 -- 172.21.15.175:0/1817400019 learned_addr learned my addr 172.21.15.175:0/1817400019 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:11:27.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.878+0000 7fd4abe00640 1 --2- 172.21.15.175:0/1817400019 >> v2:172.21.15.177:3300/0 conn(0x7fd4ac15c5e0 0x7fd4ac0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.878+0000 7fd4aaa00640 1 -- 172.21.15.175:0/1817400019 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642231769 0 0) 0x7fd4ac15cd00 con 0x7fd4ac1453a0 2024-04-25T09:11:27.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.878+0000 7fd4aaa00640 1 -- 172.21.15.175:0/1817400019 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd48c003530 con 0x7fd4ac1453a0 2024-04-25T09:11:27.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.878+0000 7fd4ab400640 1 -- 172.21.15.175:0/1817400019 >> v2:172.21.15.177:3300/0 conn(0x7fd4ac15c5e0 msgr2=0x7fd4ac0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.878+0000 7fd4ab400640 1 --2- 172.21.15.175:0/1817400019 >> v2:172.21.15.177:3300/0 conn(0x7fd4ac15c5e0 0x7fd4ac0cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.878+0000 7fd4ab400640 1 -- 172.21.15.175:0/1817400019 >> v1:172.21.15.175:6789/0 conn(0x7fd4ac1453a0 legacy=0x7fd4ac15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.878+0000 7fd4ab400640 1 -- 172.21.15.175:0/1817400019 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac0ccc10 con 0x7fd4ac144fc0 2024-04-25T09:11:27.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.878+0000 7fd4abe00640 1 --2- 172.21.15.175:0/1817400019 >> v2:172.21.15.177:3300/0 conn(0x7fd4ac15c5e0 0x7fd4ac0cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:27.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.882+0000 7fd4ab400640 1 --2- 172.21.15.175:0/1817400019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4ac144fc0 0x7fd4ac0cbe70 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fd49c0097c0 tx=0x7fd49c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb890e10d7d49810 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.882+0000 7fd4aaa00640 1 -- 172.21.15.175:0/1817400019 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c0b0070 con 0x7fd4ac144fc0 2024-04-25T09:11:27.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.882+0000 7fd4aaa00640 1 -- 172.21.15.175:0/1817400019 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49c004230 con 0x7fd4ac144fc0 2024-04-25T09:11:27.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.882+0000 7fd4aaa00640 1 -- 172.21.15.175:0/1817400019 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c003620 con 0x7fd4ac144fc0 2024-04-25T09:11:27.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.882+0000 7fd4b2200640 1 -- 172.21.15.175:0/1817400019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4ac144fc0 msgr2=0x7fd4ac0cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.882+0000 7fd4b2200640 1 --2- 172.21.15.175:0/1817400019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4ac144fc0 0x7fd4ac0cbe70 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fd49c0097c0 tx=0x7fd49c01c460 comp rx=0 tx=0).stop 2024-04-25T09:11:27.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.882+0000 7fd4b2200640 1 -- 172.21.15.175:0/1817400019 shutdown_connections 2024-04-25T09:11:27.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.882+0000 7fd4b2200640 1 --2- 172.21.15.175:0/1817400019 >> v2:172.21.15.177:3300/0 conn(0x7fd4ac15c5e0 0x7fd4ac0cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.882+0000 7fd4b2200640 1 --2- 172.21.15.175:0/1817400019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4ac144fc0 0x7fd4ac0cbe70 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.882+0000 7fd4b2200640 1 -- 172.21.15.175:0/1817400019 >> 172.21.15.175:0/1817400019 conn(0x7fd4ac067150 msgr2=0x7fd4ac06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.882+0000 7fd4b2200640 1 -- 172.21.15.175:0/1817400019 shutdown_connections 2024-04-25T09:11:27.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.882+0000 7fd4b2200640 1 -- 172.21.15.175:0/1817400019 wait complete. 2024-04-25T09:11:27.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.882+0000 7fd4b2200640 1 Processor -- start 2024-04-25T09:11:27.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.882+0000 7fd4b2200640 1 -- start start 2024-04-25T09:11:27.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4b2200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4ac1453a0 0x7fd4ac0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4b2200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4ac15c5e0 0x7fd4ac15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4b2200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4ac0af1d0 0x7fd4ac0b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4b2200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0cff00 con 0x7fd4ac15c5e0 2024-04-25T09:11:27.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4b2200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0cfd80 con 0x7fd4ac0af1d0 2024-04-25T09:11:27.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4b2200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac0b0eb0 con 0x7fd4ac1453a0 2024-04-25T09:11:27.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4a2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4ac15c5e0 0x7fd4ac15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4a2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4ac15c5e0 0x7fd4ac15b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46914/0 (socket says 172.21.15.175:46914) 2024-04-25T09:11:27.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4a2a00640 1 -- 172.21.15.175:0/720008319 learned_addr learned my addr 172.21.15.175:0/720008319 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:27.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4ab400640 1 --2- 172.21.15.175:0/720008319 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4ac1453a0 0x7fd4ac0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4abe00640 1 --2- 172.21.15.175:0/720008319 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4ac0af1d0 0x7fd4ac0b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4a2a00640 1 -- 172.21.15.175:0/720008319 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4ac1453a0 msgr2=0x7fd4ac0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4a2a00640 1 --2- 172.21.15.175:0/720008319 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4ac1453a0 0x7fd4ac0b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4a2a00640 1 -- 172.21.15.175:0/720008319 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4ac0af1d0 msgr2=0x7fd4ac0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4a2a00640 1 --2- 172.21.15.175:0/720008319 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4ac0af1d0 0x7fd4ac0b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4a2a00640 1 -- 172.21.15.175:0/720008319 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ac0af6d0 con 0x7fd4ac15c5e0 2024-04-25T09:11:27.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4ab400640 1 --2- 172.21.15.175:0/720008319 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4ac1453a0 0x7fd4ac0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:27.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4abe00640 1 --2- 172.21.15.175:0/720008319 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4ac0af1d0 0x7fd4ac0b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:27.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4a2a00640 1 --2- 172.21.15.175:0/720008319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4ac15c5e0 0x7fd4ac15b0e0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fd49400c410 tx=0x7fd49400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4a3e00640 1 -- 172.21.15.175:0/720008319 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494017070 con 0x7fd4ac15c5e0 2024-04-25T09:11:27.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4a3e00640 1 -- 172.21.15.175:0/720008319 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd494005cf0 con 0x7fd4ac15c5e0 2024-04-25T09:11:27.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4a3e00640 1 -- 172.21.15.175:0/720008319 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4940072d0 con 0x7fd4ac15c5e0 2024-04-25T09:11:27.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4b2200640 1 -- 172.21.15.175:0/720008319 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ac0b10e0 con 0x7fd4ac15c5e0 2024-04-25T09:11:27.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4b2200640 1 -- 172.21.15.175:0/720008319 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac0b4510 con 0x7fd4ac15c5e0 2024-04-25T09:11:27.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4b2200640 1 -- 172.21.15.175:0/720008319 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ac074a60 con 0x7fd4ac15c5e0 2024-04-25T09:11:27.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.886+0000 7fd4a3e00640 1 -- 172.21.15.175:0/720008319 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd49401a070 con 0x7fd4ac15c5e0 2024-04-25T09:11:27.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.890+0000 7fd4a3e00640 1 --2- 172.21.15.175:0/720008319 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd488066f60 0x7fd488069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.890+0000 7fd4a3e00640 1 -- 172.21.15.175:0/720008319 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fd494084380 con 0x7fd4ac15c5e0 2024-04-25T09:11:27.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.890+0000 7fd4ab400640 1 --2- 172.21.15.175:0/720008319 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd488066f60 0x7fd488069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.890+0000 7fd4ab400640 1 --2- 172.21.15.175:0/720008319 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd488066f60 0x7fd488069420 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd49c0ad000 tx=0x7fd49c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:27.894+0000 7fd4a3e00640 1 -- 172.21.15.175:0/720008319 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd494054d00 con 0x7fd4ac15c5e0 2024-04-25T09:11:28.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:28.082+0000 7fd4b2200640 1 -- 172.21.15.175:0/720008319 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4ac0723b0 con 0x7fd4ac15c5e0 2024-04-25T09:11:28.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:28.082+0000 7fd4a3e00640 1 -- 172.21.15.175:0/720008319 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fd494058da0 con 0x7fd4ac15c5e0 2024-04-25T09:11:28.074 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:11:28.074 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":68,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3229536012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3229536012},{"type":"v1","addr":"172.21.15.177:6834","nonce":3229536012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/222649735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":222649735},{"type":"v1","addr":"172.21.15.177:6835","nonce":222649735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2888989442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2888989442},{"type":"v1","addr":"172.21.15.175:6836","nonce":2888989442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:03.786939+0000","modified":"2024-04-25T09:11:27.721599+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7303":{"gid":7303,"name":"c","rank":0,"incarnation":68,"state":"up:replay","state_seq":1,"addr":"172.21.15.175:6837/279367590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":279367590},{"type":"v1","addr":"172.21.15.175:6837","nonce":279367590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:11:28.074 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 68 2024-04-25T09:11:28.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:28.086+0000 7fd4b2200640 1 -- 172.21.15.175:0/720008319 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd488066f60 msgr2=0x7fd488069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:28.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:28.086+0000 7fd4b2200640 1 --2- 172.21.15.175:0/720008319 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd488066f60 0x7fd488069420 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd49c0ad000 tx=0x7fd49c008040 comp rx=0 tx=0).stop 2024-04-25T09:11:28.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:28.086+0000 7fd4b2200640 1 -- 172.21.15.175:0/720008319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4ac15c5e0 msgr2=0x7fd4ac15b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:28.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:28.086+0000 7fd4b2200640 1 --2- 172.21.15.175:0/720008319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4ac15c5e0 0x7fd4ac15b0e0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fd49400c410 tx=0x7fd49400c8d0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:28.086+0000 7fd4b2200640 1 -- 172.21.15.175:0/720008319 shutdown_connections 2024-04-25T09:11:28.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:28.086+0000 7fd4b2200640 1 --2- 172.21.15.175:0/720008319 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd488066f60 0x7fd488069420 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:28.086+0000 7fd4b2200640 1 --2- 172.21.15.175:0/720008319 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd4ac0af1d0 0x7fd4ac0b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:28.086+0000 7fd4b2200640 1 --2- 172.21.15.175:0/720008319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4ac15c5e0 0x7fd4ac15b0e0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:28.086+0000 7fd4b2200640 1 --2- 172.21.15.175:0/720008319 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd4ac1453a0 0x7fd4ac0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:28.086+0000 7fd4b2200640 1 -- 172.21.15.175:0/720008319 >> 172.21.15.175:0/720008319 conn(0x7fd4ac144fc0 msgr2=0x7fd4ac0cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:28.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:28.086+0000 7fd4b2200640 1 -- 172.21.15.175:0/720008319 shutdown_connections 2024-04-25T09:11:28.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:28.086+0000 7fd4b2200640 1 -- 172.21.15.175:0/720008319 wait complete. 2024-04-25T09:11:28.497 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:10:03.786939+0000', 'modified': '2024-04-25T09:11:27.721599+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 88, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7303}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7303': {'gid': 7303, 'name': 'c', 'rank': 0, 'incarnation': 68, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.175:6837/279367590', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6835', 'nonce': 279367590}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 279367590}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:11:28.498 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7303:up:replay 2024-04-25T09:11:29.499 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:29.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.650+0000 7f05dd600640 1 Processor -- start 2024-04-25T09:11:29.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.650+0000 7f05dd600640 1 -- start start 2024-04-25T09:11:29.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.650+0000 7f05dd600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f05d815a900 0x7f05d806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.650+0000 7f05dd600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05d80cf560 0x7f05d80cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.650+0000 7f05dd600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d80cda00 con 0x7f05d80cd520 2024-04-25T09:11:29.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.650+0000 7f05dd600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d815bcf0 con 0x7f05d815a900 2024-04-25T09:11:29.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.650+0000 7f05dd600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d80cfef0 con 0x7f05d80cf560 2024-04-25T09:11:29.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.650+0000 7f05d6a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f05d815a900 0x7f05d806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.650+0000 7f05d6a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f05d815a900 0x7f05d806e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50752/0 (socket says 172.21.15.175:50752) 2024-04-25T09:11:29.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.650+0000 7f05d6a00640 1 -- 172.21.15.175:0/917894801 learned_addr learned my addr 172.21.15.175:0/917894801 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:29.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.654+0000 7f05d7400640 1 --2- 172.21.15.175:0/917894801 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05d80cf560 0x7f05d80cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.654+0000 7f05d6a00640 1 -- 172.21.15.175:0/917894801 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05d80cf560 msgr2=0x7f05d80cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:29.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.654+0000 7f05d6a00640 1 --2- 172.21.15.175:0/917894801 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05d80cf560 0x7f05d80cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.654+0000 7f05d6a00640 1 -- 172.21.15.175:0/917894801 >> v1:172.21.15.177:6789/0 conn(0x7f05d80cd520 legacy=0x7f05d80ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:29.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.654+0000 7f05d6a00640 1 -- 172.21.15.175:0/917894801 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d80cdce0 con 0x7f05d815a900 2024-04-25T09:11:29.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.654+0000 7f05d6a00640 1 --2- 172.21.15.175:0/917894801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05d815a900 0x7f05d806e150 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009e50 tx=0x7f05c801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c345651f74d1b265 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:29.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.654+0000 7f05d6000640 1 -- 172.21.15.175:0/917894801 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c80a57f0 con 0x7f05d815a900 2024-04-25T09:11:29.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.654+0000 7f05d6000640 1 -- 172.21.15.175:0/917894801 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c80a5990 con 0x7f05d815a900 2024-04-25T09:11:29.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.654+0000 7f05d6000640 1 -- 172.21.15.175:0/917894801 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c80a5d60 con 0x7f05d815a900 2024-04-25T09:11:29.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05dd600640 1 -- 172.21.15.175:0/917894801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05d815a900 msgr2=0x7f05d806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05dd600640 1 --2- 172.21.15.175:0/917894801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05d815a900 0x7f05d806e150 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009e50 tx=0x7f05c801ca30 comp rx=0 tx=0).stop 2024-04-25T09:11:29.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05dd600640 1 -- 172.21.15.175:0/917894801 shutdown_connections 2024-04-25T09:11:29.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05dd600640 1 --2- 172.21.15.175:0/917894801 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05d80cf560 0x7f05d80cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05dd600640 1 --2- 172.21.15.175:0/917894801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05d815a900 0x7f05d806e150 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05dd600640 1 -- 172.21.15.175:0/917894801 >> 172.21.15.175:0/917894801 conn(0x7f05d8067150 msgr2=0x7f05d806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:29.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05dd600640 1 -- 172.21.15.175:0/917894801 shutdown_connections 2024-04-25T09:11:29.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05dd600640 1 -- 172.21.15.175:0/917894801 wait complete. 2024-04-25T09:11:29.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05dd600640 1 Processor -- start 2024-04-25T09:11:29.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05dd600640 1 -- start start 2024-04-25T09:11:29.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05dd600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05d80cf560 0x7f05d814f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05dd600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05d815a900 0x7f05d80b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05dd600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05d80b3560 0x7f05d8071240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05dd600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d806d530 con 0x7f05d80b3560 2024-04-25T09:11:29.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05dd600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d806d3b0 con 0x7f05d815a900 2024-04-25T09:11:29.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05dd600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d815c790 con 0x7f05d80cf560 2024-04-25T09:11:29.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05d7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05d80b3560 0x7f05d8071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05d7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05d80b3560 0x7f05d8071240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50756/0 (socket says 172.21.15.175:50756) 2024-04-25T09:11:29.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05d7400640 1 -- 172.21.15.175:0/156174251 learned_addr learned my addr 172.21.15.175:0/156174251 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:29.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05d6a00640 1 --2- 172.21.15.175:0/156174251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05d80cf560 0x7f05d814f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05ce000640 1 --2- 172.21.15.175:0/156174251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05d815a900 0x7f05d80b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05d7400640 1 -- 172.21.15.175:0/156174251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05d80cf560 msgr2=0x7f05d814f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05d7400640 1 --2- 172.21.15.175:0/156174251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05d80cf560 0x7f05d814f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05d7400640 1 -- 172.21.15.175:0/156174251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05d815a900 msgr2=0x7f05d80b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05d7400640 1 --2- 172.21.15.175:0/156174251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05d815a900 0x7f05d80b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05d7400640 1 -- 172.21.15.175:0/156174251 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d8067680 con 0x7f05d80b3560 2024-04-25T09:11:29.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.658+0000 7f05d7400640 1 --2- 172.21.15.175:0/156174251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05d80b3560 0x7f05d8071240 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f05d000d800 tx=0x7f05d000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:29.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.662+0000 7f05cf400640 1 -- 172.21.15.175:0/156174251 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d000b6c0 con 0x7f05d80b3560 2024-04-25T09:11:29.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.662+0000 7f05cf400640 1 -- 172.21.15.175:0/156174251 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d0019070 con 0x7f05d80b3560 2024-04-25T09:11:29.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.662+0000 7f05cf400640 1 -- 172.21.15.175:0/156174251 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d000baa0 con 0x7f05d80b3560 2024-04-25T09:11:29.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.662+0000 7f05dd600640 1 -- 172.21.15.175:0/156174251 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d814f670 con 0x7f05d80b3560 2024-04-25T09:11:29.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.662+0000 7f05dd600640 1 -- 172.21.15.175:0/156174251 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d80adf40 con 0x7f05d80b3560 2024-04-25T09:11:29.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.662+0000 7f05dd600640 1 -- 172.21.15.175:0/156174251 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d8074a60 con 0x7f05d80b3560 2024-04-25T09:11:29.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.662+0000 7f05cf400640 1 -- 172.21.15.175:0/156174251 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f05d000bc40 con 0x7f05d80b3560 2024-04-25T09:11:29.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.662+0000 7f05cf400640 1 --2- 172.21.15.175:0/156174251 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f05b4066f60 0x7f05b4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.662+0000 7f05cf400640 1 -- 172.21.15.175:0/156174251 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f05d00854a0 con 0x7f05d80b3560 2024-04-25T09:11:29.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.662+0000 7f05d6a00640 1 --2- 172.21.15.175:0/156174251 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f05b4066f60 0x7f05b4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.662+0000 7f05d6a00640 1 --2- 172.21.15.175:0/156174251 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f05b4066f60 0x7f05b4069420 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f05c80ae000 tx=0x7f05c80a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:29.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.666+0000 7f05cf400640 1 -- 172.21.15.175:0/156174251 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f05d00563d0 con 0x7f05d80b3560 2024-04-25T09:11:29.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.854+0000 7f05dd600640 1 -- 172.21.15.175:0/156174251 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05d806e890 con 0x7f05d80b3560 2024-04-25T09:11:29.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.854+0000 7f05cf400640 1 -- 172.21.15.175:0/156174251 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f05d005c0d0 con 0x7f05d80b3560 2024-04-25T09:11:29.844 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:11:29.844 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":70,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3229536012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3229536012},{"type":"v1","addr":"172.21.15.177:6834","nonce":3229536012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/222649735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":222649735},{"type":"v1","addr":"172.21.15.177:6835","nonce":222649735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2888989442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2888989442},{"type":"v1","addr":"172.21.15.175:6836","nonce":2888989442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:03.786939+0000","modified":"2024-04-25T09:11:28.733217+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7303":{"gid":7303,"name":"c","rank":0,"incarnation":68,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.175:6837/279367590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":279367590},{"type":"v1","addr":"172.21.15.175:6837","nonce":279367590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:11:29.844 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 70 2024-04-25T09:11:29.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.854+0000 7f05dd600640 1 -- 172.21.15.175:0/156174251 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f05b4066f60 msgr2=0x7f05b4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.854+0000 7f05dd600640 1 --2- 172.21.15.175:0/156174251 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f05b4066f60 0x7f05b4069420 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f05c80ae000 tx=0x7f05c80a7070 comp rx=0 tx=0).stop 2024-04-25T09:11:29.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.854+0000 7f05dd600640 1 -- 172.21.15.175:0/156174251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05d80b3560 msgr2=0x7f05d8071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.854+0000 7f05dd600640 1 --2- 172.21.15.175:0/156174251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05d80b3560 0x7f05d8071240 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f05d000d800 tx=0x7f05d000dcc0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.854+0000 7f05dd600640 1 -- 172.21.15.175:0/156174251 shutdown_connections 2024-04-25T09:11:29.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.854+0000 7f05dd600640 1 --2- 172.21.15.175:0/156174251 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f05b4066f60 0x7f05b4069420 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.854+0000 7f05dd600640 1 --2- 172.21.15.175:0/156174251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05d80b3560 0x7f05d8071240 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.854+0000 7f05dd600640 1 --2- 172.21.15.175:0/156174251 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05d815a900 0x7f05d80b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.854+0000 7f05dd600640 1 --2- 172.21.15.175:0/156174251 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05d80cf560 0x7f05d814f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.854+0000 7f05dd600640 1 -- 172.21.15.175:0/156174251 >> 172.21.15.175:0/156174251 conn(0x7f05d80cd520 msgr2=0x7f05d806ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.854+0000 7f05dd600640 1 -- 172.21.15.175:0/156174251 shutdown_connections 2024-04-25T09:11:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:29.858+0000 7f05dd600640 1 -- 172.21.15.175:0/156174251 wait complete. 2024-04-25T09:11:30.268 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:10:03.786939+0000', 'modified': '2024-04-25T09:11:28.733217+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 88, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7303}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7303': {'gid': 7303, 'name': 'c', 'rank': 0, 'incarnation': 68, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.175:6837/279367590', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6835', 'nonce': 279367590}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 279367590}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:11:30.268 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7303:up:rejoin 2024-04-25T09:11:31.269 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:31.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.426+0000 7f1f7b200640 1 Processor -- start 2024-04-25T09:11:31.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.426+0000 7f1f7b200640 1 -- start start 2024-04-25T09:11:31.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.426+0000 7f1f7b200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1f7c06c090 0x7f1f7c0ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.426+0000 7f1f7b200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c06ef90 0x7f1f7c0cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.426+0000 7f1f7b200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7c06e4f0 con 0x7f1f7c15a5b0 2024-04-25T09:11:31.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.426+0000 7f1f7b200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7c06f440 con 0x7f1f7c06c090 2024-04-25T09:11:31.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.426+0000 7f1f7b200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c066d60 con 0x7f1f7c06ef90 2024-04-25T09:11:31.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.426+0000 7f1f79e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f1f7c15a5b0 0x7f1f7c0cd9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:47100/0 (socket says 172.21.15.175:47100) 2024-04-25T09:11:31.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.426+0000 7f1f79e00640 1 -- 172.21.15.175:0/494672326 learned_addr learned my addr 172.21.15.175:0/494672326 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:11:31.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.426+0000 7f1f73e00640 1 --2- 172.21.15.175:0/494672326 >> v2:172.21.15.177:3300/0 conn(0x7f1f7c06c090 0x7f1f7c0ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.426+0000 7f1f7a800640 1 --2- 172.21.15.175:0/494672326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c06ef90 0x7f1f7c0cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.430+0000 7f1f79400640 1 -- 172.21.15.175:0/494672326 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265800867 0 0) 0x7f1f7c06e4f0 con 0x7f1f7c15a5b0 2024-04-25T09:11:31.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.430+0000 7f1f79400640 1 -- 172.21.15.175:0/494672326 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f60003530 con 0x7f1f7c15a5b0 2024-04-25T09:11:31.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.430+0000 7f1f73e00640 1 -- 172.21.15.175:0/494672326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c06ef90 msgr2=0x7f1f7c0cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:31.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.430+0000 7f1f73e00640 1 --2- 172.21.15.175:0/494672326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c06ef90 0x7f1f7c0cb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.430+0000 7f1f73e00640 1 -- 172.21.15.175:0/494672326 >> v1:172.21.15.175:6789/0 conn(0x7f1f7c15a5b0 legacy=0x7f1f7c0cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.430+0000 7f1f73e00640 1 -- 172.21.15.175:0/494672326 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c06e790 con 0x7f1f7c06c090 2024-04-25T09:11:31.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.430+0000 7f1f73e00640 1 --2- 172.21.15.175:0/494672326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f7c06c090 0x7f1f7c0ce0c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1f640097c0 tx=0x7f1f6401c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c2a35f97dd307a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:31.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.430+0000 7f1f79400640 1 -- 172.21.15.175:0/494672326 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f640b0070 con 0x7f1f7c06c090 2024-04-25T09:11:31.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.430+0000 7f1f79400640 1 -- 172.21.15.175:0/494672326 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f640ab600 con 0x7f1f7c06c090 2024-04-25T09:11:31.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.430+0000 7f1f79400640 1 -- 172.21.15.175:0/494672326 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f640ab9d0 con 0x7f1f7c06c090 2024-04-25T09:11:31.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f7b200640 1 -- 172.21.15.175:0/494672326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f7c06c090 msgr2=0x7f1f7c0ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f7b200640 1 --2- 172.21.15.175:0/494672326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f7c06c090 0x7f1f7c0ce0c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1f640097c0 tx=0x7f1f6401c460 comp rx=0 tx=0).stop 2024-04-25T09:11:31.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f7b200640 1 -- 172.21.15.175:0/494672326 shutdown_connections 2024-04-25T09:11:31.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f7b200640 1 --2- 172.21.15.175:0/494672326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c06ef90 0x7f1f7c0cb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f7b200640 1 --2- 172.21.15.175:0/494672326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f7c06c090 0x7f1f7c0ce0c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f7b200640 1 -- 172.21.15.175:0/494672326 >> 172.21.15.175:0/494672326 conn(0x7f1f7c0cc860 msgr2=0x7f1f7c0ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:31.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f7b200640 1 -- 172.21.15.175:0/494672326 shutdown_connections 2024-04-25T09:11:31.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f7b200640 1 -- 172.21.15.175:0/494672326 wait complete. 2024-04-25T09:11:31.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f7b200640 1 Processor -- start 2024-04-25T09:11:31.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f7b200640 1 -- start start 2024-04-25T09:11:31.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f7b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f7c06c090 0x7f1f7c0b2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f7b200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f7c06ef90 0x7f1f7c144120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f7b200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c15a5b0 0x7f1f7c0b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f7b200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c165580 con 0x7f1f7c06c090 2024-04-25T09:11:31.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f7b200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c15a990 con 0x7f1f7c06ef90 2024-04-25T09:11:31.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f7b200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c165700 con 0x7f1f7c15a5b0 2024-04-25T09:11:31.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f79e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f7c06c090 0x7f1f7c0b2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f79e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f7c06c090 0x7f1f7c0b2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50772/0 (socket says 172.21.15.175:50772) 2024-04-25T09:11:31.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f79e00640 1 -- 172.21.15.175:0/3105968891 learned_addr learned my addr 172.21.15.175:0/3105968891 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:31.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f73e00640 1 --2- 172.21.15.175:0/3105968891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f7c06ef90 0x7f1f7c144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.434+0000 7f1f7a800640 1 --2- 172.21.15.175:0/3105968891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c15a5b0 0x7f1f7c0b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.438+0000 7f1f79e00640 1 -- 172.21.15.175:0/3105968891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c15a5b0 msgr2=0x7f1f7c0b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.438+0000 7f1f79e00640 1 --2- 172.21.15.175:0/3105968891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c15a5b0 0x7f1f7c0b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.438+0000 7f1f79e00640 1 -- 172.21.15.175:0/3105968891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f7c06ef90 msgr2=0x7f1f7c144120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.438+0000 7f1f79e00640 1 --2- 172.21.15.175:0/3105968891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f7c06ef90 0x7f1f7c144120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.438+0000 7f1f79e00640 1 -- 172.21.15.175:0/3105968891 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c0b5a40 con 0x7f1f7c06c090 2024-04-25T09:11:31.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.438+0000 7f1f79e00640 1 --2- 172.21.15.175:0/3105968891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f7c06c090 0x7f1f7c0b2ba0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c00c450 tx=0x7f1f6c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:31.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.438+0000 7f1f72000640 1 -- 172.21.15.175:0/3105968891 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c018070 con 0x7f1f7c06c090 2024-04-25T09:11:31.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.438+0000 7f1f72000640 1 -- 172.21.15.175:0/3105968891 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6c0074e0 con 0x7f1f7c06c090 2024-04-25T09:11:31.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.438+0000 7f1f7b200640 1 -- 172.21.15.175:0/3105968891 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7c0acfe0 con 0x7f1f7c06c090 2024-04-25T09:11:31.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.438+0000 7f1f72000640 1 -- 172.21.15.175:0/3105968891 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c004a30 con 0x7f1f7c06c090 2024-04-25T09:11:31.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.438+0000 7f1f7b200640 1 -- 172.21.15.175:0/3105968891 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7c0b55a0 con 0x7f1f7c06c090 2024-04-25T09:11:31.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.438+0000 7f1f7b200640 1 -- 172.21.15.175:0/3105968891 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7c074a60 con 0x7f1f7c06c090 2024-04-25T09:11:31.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.438+0000 7f1f72000640 1 -- 172.21.15.175:0/3105968891 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1f6c01b070 con 0x7f1f7c06c090 2024-04-25T09:11:31.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.438+0000 7f1f72000640 1 --2- 172.21.15.175:0/3105968891 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1f58066f60 0x7f1f58069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.438+0000 7f1f72000640 1 -- 172.21.15.175:0/3105968891 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f1f6c084370 con 0x7f1f7c06c090 2024-04-25T09:11:31.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.438+0000 7f1f73e00640 1 --2- 172.21.15.175:0/3105968891 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1f58066f60 0x7f1f58069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.442+0000 7f1f73e00640 1 --2- 172.21.15.175:0/3105968891 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1f58066f60 0x7f1f58069420 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1f640ad000 tx=0x7f1f640a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:31.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.446+0000 7f1f72000640 1 -- 172.21.15.175:0/3105968891 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1f6c054bc0 con 0x7f1f7c06c090 2024-04-25T09:11:31.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.634+0000 7f1f7b200640 1 -- 172.21.15.175:0/3105968891 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f7c148560 con 0x7f1f7c06c090 2024-04-25T09:11:31.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.634+0000 7f1f72000640 1 -- 172.21.15.175:0/3105968891 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f1f6c058c60 con 0x7f1f7c06c090 2024-04-25T09:11:31.625 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:11:31.625 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":71,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3229536012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3229536012},{"type":"v1","addr":"172.21.15.177:6834","nonce":3229536012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/222649735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":222649735},{"type":"v1","addr":"172.21.15.177:6835","nonce":222649735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2888989442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2888989442},{"type":"v1","addr":"172.21.15.175:6836","nonce":2888989442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:03.786939+0000","modified":"2024-04-25T09:11:29.735549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7303":{"gid":7303,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6837/279367590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":279367590},{"type":"v1","addr":"172.21.15.175:6837","nonce":279367590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:11:31.625 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 71 2024-04-25T09:11:31.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.638+0000 7f1f7b200640 1 -- 172.21.15.175:0/3105968891 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1f58066f60 msgr2=0x7f1f58069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.638+0000 7f1f7b200640 1 --2- 172.21.15.175:0/3105968891 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1f58066f60 0x7f1f58069420 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1f640ad000 tx=0x7f1f640a6000 comp rx=0 tx=0).stop 2024-04-25T09:11:31.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.638+0000 7f1f7b200640 1 -- 172.21.15.175:0/3105968891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f7c06c090 msgr2=0x7f1f7c0b2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.638+0000 7f1f7b200640 1 --2- 172.21.15.175:0/3105968891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f7c06c090 0x7f1f7c0b2ba0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c00c450 tx=0x7f1f6c00c910 comp rx=0 tx=0).stop 2024-04-25T09:11:31.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.638+0000 7f1f7b200640 1 -- 172.21.15.175:0/3105968891 shutdown_connections 2024-04-25T09:11:31.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.638+0000 7f1f7b200640 1 --2- 172.21.15.175:0/3105968891 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1f58066f60 0x7f1f58069420 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.638+0000 7f1f7b200640 1 --2- 172.21.15.175:0/3105968891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1f7c15a5b0 0x7f1f7c0b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.638+0000 7f1f7b200640 1 --2- 172.21.15.175:0/3105968891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1f7c06ef90 0x7f1f7c144120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.638+0000 7f1f7b200640 1 --2- 172.21.15.175:0/3105968891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f7c06c090 0x7f1f7c0b2ba0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.638+0000 7f1f7b200640 1 -- 172.21.15.175:0/3105968891 >> 172.21.15.175:0/3105968891 conn(0x7f1f7c0cc860 msgr2=0x7f1f7c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:31.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.638+0000 7f1f7b200640 1 -- 172.21.15.175:0/3105968891 shutdown_connections 2024-04-25T09:11:31.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:31.638+0000 7f1f7b200640 1 -- 172.21.15.175:0/3105968891 wait complete. 2024-04-25T09:11:32.050 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:10:03.786939+0000', 'modified': '2024-04-25T09:11:29.735549+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 88, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7303}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7303': {'gid': 7303, 'name': 'c', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.175:6837/279367590', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6835', 'nonce': 279367590}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 279367590}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:11:32.050 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:11:32.050 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:11:32.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.198+0000 7fbf0f200640 1 Processor -- start 2024-04-25T09:11:32.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.198+0000 7fbf0f200640 1 -- start start 2024-04-25T09:11:32.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.198+0000 7fbf0f200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbf1006b370 0x7fbf100b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.198+0000 7fbf0f200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbf100b0ff0 0x7fbf100b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.198+0000 7fbf0f200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf100aff50 con 0x7fbf100cf870 2024-04-25T09:11:32.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.198+0000 7fbf0f200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf1006b750 con 0x7fbf100b0ff0 2024-04-25T09:11:32.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.198+0000 7fbf0f200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf100b0b60 con 0x7fbf1006b370 2024-04-25T09:11:32.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.198+0000 7fbf05400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbf100b0ff0 0x7fbf100b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.198+0000 7fbf05400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbf100b0ff0 0x7fbf100b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50780/0 (socket says 172.21.15.175:50780) 2024-04-25T09:11:32.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.198+0000 7fbf05400640 1 -- 172.21.15.175:0/144002657 learned_addr learned my addr 172.21.15.175:0/144002657 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:32.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.198+0000 7fbf0de00640 1 --2- 172.21.15.175:0/144002657 >> v2:172.21.15.177:3300/0 conn(0x7fbf1006b370 0x7fbf100b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.198+0000 7fbf05400640 1 -- 172.21.15.175:0/144002657 >> v2:172.21.15.177:3300/0 conn(0x7fbf1006b370 msgr2=0x7fbf100b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:32.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.198+0000 7fbf05400640 1 --2- 172.21.15.175:0/144002657 >> v2:172.21.15.177:3300/0 conn(0x7fbf1006b370 0x7fbf100b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.198+0000 7fbf05400640 1 -- 172.21.15.175:0/144002657 >> v1:172.21.15.177:6789/0 conn(0x7fbf100cf870 legacy=0x7fbf100cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.198+0000 7fbf05400640 1 -- 172.21.15.175:0/144002657 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf100b0230 con 0x7fbf100b0ff0 2024-04-25T09:11:32.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.202+0000 7fbf05400640 1 --2- 172.21.15.175:0/144002657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf100b0ff0 0x7fbf100b1af0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fbf1006db80 tx=0x7fbef801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0f1074c7c96de3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.202+0000 7fbf0d400640 1 -- 172.21.15.175:0/144002657 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef80aa650 con 0x7fbf100b0ff0 2024-04-25T09:11:32.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.202+0000 7fbf0d400640 1 -- 172.21.15.175:0/144002657 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef80af070 con 0x7fbf100b0ff0 2024-04-25T09:11:32.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.202+0000 7fbf0d400640 1 -- 172.21.15.175:0/144002657 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef80aaa10 con 0x7fbf100b0ff0 2024-04-25T09:11:32.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.202+0000 7fbf0f200640 1 -- 172.21.15.175:0/144002657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf100b0ff0 msgr2=0x7fbf100b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.202+0000 7fbf0f200640 1 --2- 172.21.15.175:0/144002657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf100b0ff0 0x7fbf100b1af0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fbf1006db80 tx=0x7fbef801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.202+0000 7fbf0f200640 1 -- 172.21.15.175:0/144002657 shutdown_connections 2024-04-25T09:11:32.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.202+0000 7fbf0f200640 1 --2- 172.21.15.175:0/144002657 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf100b0ff0 0x7fbf100b1af0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.202+0000 7fbf0f200640 1 --2- 172.21.15.175:0/144002657 >> v2:172.21.15.177:3300/0 conn(0x7fbf1006b370 0x7fbf100b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.202+0000 7fbf0f200640 1 -- 172.21.15.175:0/144002657 >> 172.21.15.175:0/144002657 conn(0x7fbf10099a50 msgr2=0x7fbf100d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:32.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.202+0000 7fbf0f200640 1 -- 172.21.15.175:0/144002657 shutdown_connections 2024-04-25T09:11:32.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.202+0000 7fbf0f200640 1 -- 172.21.15.175:0/144002657 wait complete. 2024-04-25T09:11:32.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0f200640 1 Processor -- start 2024-04-25T09:11:32.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0f200640 1 -- start start 2024-04-25T09:11:32.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0f200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf1006b370 0x7fbf1013f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0f200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf100b0ff0 0x7fbf101551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0f200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf100cf870 0x7fbf10140b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0f200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1015db60 con 0x7fbf100cf870 2024-04-25T09:11:32.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0f200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1015d9e0 con 0x7fbf100b0ff0 2024-04-25T09:11:32.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0f200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1015dce0 con 0x7fbf1006b370 2024-04-25T09:11:32.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf100cf870 0x7fbf10140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf100cf870 0x7fbf10140b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50788/0 (socket says 172.21.15.175:50788) 2024-04-25T09:11:32.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0e800640 1 -- 172.21.15.175:0/2612535558 learned_addr learned my addr 172.21.15.175:0/2612535558 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:32.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf05400640 1 --2- 172.21.15.175:0/2612535558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf100b0ff0 0x7fbf101551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0de00640 1 --2- 172.21.15.175:0/2612535558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf1006b370 0x7fbf1013f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0e800640 1 -- 172.21.15.175:0/2612535558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf1006b370 msgr2=0x7fbf1013f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0e800640 1 --2- 172.21.15.175:0/2612535558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf1006b370 0x7fbf1013f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0e800640 1 -- 172.21.15.175:0/2612535558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf100b0ff0 msgr2=0x7fbf101551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0e800640 1 --2- 172.21.15.175:0/2612535558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf100b0ff0 0x7fbf101551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0e800640 1 -- 172.21.15.175:0/2612535558 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1013fa70 con 0x7fbf100cf870 2024-04-25T09:11:32.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0e800640 1 --2- 172.21.15.175:0/2612535558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf100cf870 0x7fbf10140b10 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800c730 tx=0x7fbf0800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf06a00640 1 -- 172.21.15.175:0/2612535558 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf08003b80 con 0x7fbf100cf870 2024-04-25T09:11:32.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf06a00640 1 -- 172.21.15.175:0/2612535558 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf08003d20 con 0x7fbf100cf870 2024-04-25T09:11:32.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf06a00640 1 -- 172.21.15.175:0/2612535558 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0800aa30 con 0x7fbf100cf870 2024-04-25T09:11:32.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0f200640 1 -- 172.21.15.175:0/2612535558 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf1013fd50 con 0x7fbf100cf870 2024-04-25T09:11:32.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.206+0000 7fbf0f200640 1 -- 172.21.15.175:0/2612535558 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf10140310 con 0x7fbf100cf870 2024-04-25T09:11:32.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf06a00640 1 -- 172.21.15.175:0/2612535558 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbf0800abd0 con 0x7fbf100cf870 2024-04-25T09:11:32.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf06a00640 1 --2- 172.21.15.175:0/2612535558 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbeec066f60 0x7fbeec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf06a00640 1 -- 172.21.15.175:0/2612535558 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fbf08084ec0 con 0x7fbf100cf870 2024-04-25T09:11:32.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf0de00640 1 --2- 172.21.15.175:0/2612535558 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbeec066f60 0x7fbeec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf186a8000 1 Processor -- start 2024-04-25T09:11:32.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf186a8000 1 -- start start 2024-04-25T09:11:32.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf0de00640 1 --2- 172.21.15.175:0/2612535558 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbeec066f60 0x7fbeec069420 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbf00006aa0 tx=0x7fbf00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf186a8000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 0x55aaaf8b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf186a8000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf8b1240 0x55aaaf8669f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf186a8000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf866f30 0x55aaaf867310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf186a8000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaaf74e5f0 con 0x55aaaf8b0920 2024-04-25T09:11:32.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf186a8000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaaf6b5da0 con 0x55aaaf8b1240 2024-04-25T09:11:32.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf186a8000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aaaf63e150 con 0x55aaaf866f30 2024-04-25T09:11:32.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf0de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 0x55aaaf8b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf0de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 0x55aaaf8b0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50804/0 (socket says 172.21.15.175:50804) 2024-04-25T09:11:32.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf0de00640 1 -- 172.21.15.175:0/3934126867 learned_addr learned my addr 172.21.15.175:0/3934126867 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:32.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf0de00640 1 -- 172.21.15.175:0/3934126867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf866f30 msgr2=0x55aaaf867310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:32.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf0de00640 1 --2- 172.21.15.175:0/3934126867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf866f30 0x55aaaf867310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf05400640 1 --2- 172.21.15.175:0/3934126867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf8b1240 0x55aaaf8669f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf0de00640 1 -- 172.21.15.175:0/3934126867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf8b1240 msgr2=0x55aaaf8669f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:32.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf0de00640 1 --2- 172.21.15.175:0/3934126867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf8b1240 0x55aaaf8669f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf0de00640 1 -- 172.21.15.175:0/3934126867 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aaaf657ca0 con 0x55aaaf8b0920 2024-04-25T09:11:32.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.210+0000 7fbf05400640 1 --2- 172.21.15.175:0/3934126867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf8b1240 0x55aaaf8669f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:32.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf0de00640 1 --2- 172.21.15.175:0/3934126867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 0x55aaaf8b0d00 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fbf000041f0 tx=0x7fbf00013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c24c6cd345d60e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbefea00640 1 -- 172.21.15.175:0/3934126867 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf00027070 con 0x55aaaf8b0920 2024-04-25T09:11:32.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbefea00640 1 -- 172.21.15.175:0/3934126867 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf000038f0 con 0x55aaaf8b0920 2024-04-25T09:11:32.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbefea00640 1 -- 172.21.15.175:0/3934126867 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf00003ca0 con 0x55aaaf8b0920 2024-04-25T09:11:32.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf186a8000 1 -- 172.21.15.175:0/3934126867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 msgr2=0x55aaaf8b0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf186a8000 1 --2- 172.21.15.175:0/3934126867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 0x55aaaf8b0d00 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fbf000041f0 tx=0x7fbf00013000 comp rx=0 tx=0).stop 2024-04-25T09:11:32.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf186a8000 1 -- 172.21.15.175:0/3934126867 shutdown_connections 2024-04-25T09:11:32.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf186a8000 1 --2- 172.21.15.175:0/3934126867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf866f30 0x55aaaf867310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf186a8000 1 --2- 172.21.15.175:0/3934126867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf8b1240 0x55aaaf8669f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf186a8000 1 --2- 172.21.15.175:0/3934126867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 0x55aaaf8b0d00 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf186a8000 1 -- 172.21.15.175:0/3934126867 >> 172.21.15.175:0/3934126867 conn(0x55aaaf86d2a0 msgr2=0x55aaaf8652d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:32.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf186a8000 1 -- 172.21.15.175:0/3934126867 shutdown_connections 2024-04-25T09:11:32.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf186a8000 1 -- 172.21.15.175:0/3934126867 wait complete. 2024-04-25T09:11:32.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf186a8000 1 -- start start 2024-04-25T09:11:32.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf186a8000 1 Processor -- start 2024-04-25T09:11:32.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf186a8000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf866f30 0x55aaaf89d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf186a8000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 0x55aaaf8ba920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf186a8000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf8b1240 0x55aaaf8bce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf186a8000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaaf670990 con 0x55aaaf8b0920 2024-04-25T09:11:32.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf186a8000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaaf6b1e40 con 0x55aaaf866f30 2024-04-25T09:11:32.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf186a8000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aaaf641900 con 0x55aaaf8b1240 2024-04-25T09:11:32.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf186a8000 10 client.0 _ll_register_callbacks cb 0x55aaaf7691c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:32.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf05400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 0x55aaaf8ba920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf05400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 0x55aaaf8ba920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50806/0 (socket says 172.21.15.175:50806) 2024-04-25T09:11:32.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf05400640 1 -- 172.21.15.175:0/3974625134 learned_addr learned my addr 172.21.15.175:0/3974625134 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:32.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf0de00640 1 --2- 172.21.15.175:0/3974625134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf866f30 0x55aaaf89d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf0e800640 1 --2- 172.21.15.175:0/3974625134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf8b1240 0x55aaaf8bce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf05400640 1 -- 172.21.15.175:0/3974625134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf8b1240 msgr2=0x55aaaf8bce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:32.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf05400640 1 --2- 172.21.15.175:0/3974625134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf8b1240 0x55aaaf8bce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf05400640 1 -- 172.21.15.175:0/3974625134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf866f30 msgr2=0x55aaaf89d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:32.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf05400640 1 --2- 172.21.15.175:0/3974625134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf866f30 0x55aaaf89d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf05400640 1 -- 172.21.15.175:0/3974625134 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aaaf66e630 con 0x55aaaf8b0920 2024-04-25T09:11:32.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbf05400640 1 --2- 172.21.15.175:0/3974625134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 0x55aaaf8ba920 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fbef80ac040 tx=0x7fbef80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40967f2baf0fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.214+0000 7fbef3400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:11:32.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbef3400640 1 -- 172.21.15.175:0/3974625134 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef80aab50 con 0x55aaaf8b0920 2024-04-25T09:11:32.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbef3400640 1 -- 172.21.15.175:0/3974625134 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fbef80aacf0 con 0x55aaaf8b0920 2024-04-25T09:11:32.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 1 -- 172.21.15.175:0/3974625134 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbf000038f0 con 0x55aaaf8b0920 2024-04-25T09:11:32.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbef3400640 1 -- 172.21.15.175:0/3974625134 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbef80b33f0 con 0x55aaaf8b0920 2024-04-25T09:11:32.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 10 client.7776 fetch_fsmap learned FSMap version 71 2024-04-25T09:11:32.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 1 -- 172.21.15.175:0/3974625134 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x55aaaf63e3a0 con 0x55aaaf8b0920 2024-04-25T09:11:32.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbef3400640 1 -- 172.21.15.175:0/3974625134 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf000038f0 con 0x55aaaf8b0920 2024-04-25T09:11:32.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbef3400640 1 -- 172.21.15.175:0/3974625134 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 71) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbef80c6050 con 0x55aaaf8b0920 2024-04-25T09:11:32.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 10 client.7776 fetch_fsmap finished waiting for FSMap version 71 2024-04-25T09:11:32.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 10 client.7776 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:11:32.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 20 client.7776 populate_metadata read hostname 'smithi175' 2024-04-25T09:11:32.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 1 --2- 172.21.15.175:0/3974625134 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55aaaf8bf6b0 0x55aaaf8c1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 4 client.7776 mds_command: new command op to 7303 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:11:32.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 1 -- 172.21.15.175:0/3974625134 --> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aaaf651a50 con 0x55aaaf8bf6b0 2024-04-25T09:11:32.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf0de00640 1 --2- 172.21.15.175:0/3974625134 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55aaaf8bf6b0 0x55aaaf8c1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf0de00640 1 --2- 172.21.15.175:0/3974625134 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55aaaf8bf6b0 0x55aaaf8c1aa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a096e525a3084e5 server_cookie=ed49e8e7e98fd099 in_seq=0 out_seq=0 2024-04-25T09:11:32.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbef3400640 10 client.7776 ms_handle_connect on v2:172.21.15.175:6835/279367590 2024-04-25T09:11:32.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbef3400640 1 -- 172.21.15.175:0/3974625134 <== mds.0 v2:172.21.15.175:6835/279367590 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55aaaf651a50 con 0x55aaaf8bf6b0 2024-04-25T09:11:32.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbef3400640 10 client.7776 handle_command_reply: tid=0 2024-04-25T09:11:32.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 1 client.7776 shutdown 2024-04-25T09:11:32.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 1 -- 172.21.15.175:0/3974625134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 msgr2=0x55aaaf8ba920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 1 --2- 172.21.15.175:0/3974625134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 0x55aaaf8ba920 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fbef80ac040 tx=0x7fbef80046d0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 1 -- 172.21.15.175:0/3974625134 shutdown_connections 2024-04-25T09:11:32.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 1 --2- 172.21.15.175:0/3974625134 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55aaaf8bf6b0 0x55aaaf8c1aa0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 1 --2- 172.21.15.175:0/3974625134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf8b1240 0x55aaaf8bce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 1 --2- 172.21.15.175:0/3974625134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 0x55aaaf8ba920 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 1 --2- 172.21.15.175:0/3974625134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf866f30 0x55aaaf89d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbef3400640 0 client.7776 ms_handle_reset on v2:172.21.15.175:6835/279367590 2024-04-25T09:11:32.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 1 -- 172.21.15.175:0/3974625134 >> 172.21.15.175:0/3974625134 conn(0x55aaaf86d2a0 msgr2=0x55aaaf8659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:32.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 1 -- 172.21.15.175:0/3974625134 shutdown_connections 2024-04-25T09:11:32.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 1 -- 172.21.15.175:0/3974625134 wait complete. 2024-04-25T09:11:32.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.218+0000 7fbf186a8000 20 client.7776 trim_cache size 0 max 16384 2024-04-25T09:11:32.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.234+0000 7fbf186a8000 1 Processor -- start 2024-04-25T09:11:32.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.234+0000 7fbf186a8000 1 -- start start 2024-04-25T09:11:32.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.234+0000 7fbf186a8000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf866f30 0x55aaaf8bc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.234+0000 7fbf186a8000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 0x55aaaf8bcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.234+0000 7fbf186a8000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf8b1240 0x55aaaf869320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.234+0000 7fbf186a8000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf10142200 con 0x55aaaf8b0920 2024-04-25T09:11:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.234+0000 7fbf186a8000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf10141600 con 0x55aaaf8b1240 2024-04-25T09:11:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.234+0000 7fbf186a8000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf10141c00 con 0x55aaaf866f30 2024-04-25T09:11:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.234+0000 7fbf05400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 0x55aaaf8bcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.234+0000 7fbf05400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 0x55aaaf8bcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50808/0 (socket says 172.21.15.175:50808) 2024-04-25T09:11:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.234+0000 7fbf05400640 1 -- 172.21.15.175:0/4205043197 learned_addr learned my addr 172.21.15.175:0/4205043197 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.234+0000 7fbf05400640 1 -- 172.21.15.175:0/4205043197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf866f30 msgr2=0x55aaaf8bc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.234+0000 7fbf05400640 1 --2- 172.21.15.175:0/4205043197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf866f30 0x55aaaf8bc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.234+0000 7fbf05400640 1 -- 172.21.15.175:0/4205043197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf8b1240 msgr2=0x55aaaf869320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.234+0000 7fbf05400640 1 --2- 172.21.15.175:0/4205043197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf8b1240 0x55aaaf869320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.234+0000 7fbf05400640 1 -- 172.21.15.175:0/4205043197 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aaaf8b1070 con 0x55aaaf8b0920 2024-04-25T09:11:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.234+0000 7fbf05400640 1 --2- 172.21.15.175:0/4205043197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 0x55aaaf8bcbc0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fbef8097fc0 tx=0x7fbef80b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacbd77f4e355627 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbefe000640 1 -- 172.21.15.175:0/4205043197 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef80b3cb0 con 0x55aaaf8b0920 2024-04-25T09:11:32.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbefe000640 1 -- 172.21.15.175:0/4205043197 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef8000e50 con 0x55aaaf8b0920 2024-04-25T09:11:32.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbefe000640 1 -- 172.21.15.175:0/4205043197 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef80aa9f0 con 0x55aaaf8b0920 2024-04-25T09:11:32.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 -- 172.21.15.175:0/4205043197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 msgr2=0x55aaaf8bcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 --2- 172.21.15.175:0/4205043197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 0x55aaaf8bcbc0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fbef8097fc0 tx=0x7fbef80b7000 comp rx=0 tx=0).stop 2024-04-25T09:11:32.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 -- 172.21.15.175:0/4205043197 shutdown_connections 2024-04-25T09:11:32.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 --2- 172.21.15.175:0/4205043197 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf8b1240 0x55aaaf869320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 --2- 172.21.15.175:0/4205043197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b0920 0x55aaaf8bcbc0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 --2- 172.21.15.175:0/4205043197 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf866f30 0x55aaaf8bc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 -- 172.21.15.175:0/4205043197 >> 172.21.15.175:0/4205043197 conn(0x55aaaf86d2a0 msgr2=0x55aaaf89c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:32.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 -- 172.21.15.175:0/4205043197 shutdown_connections 2024-04-25T09:11:32.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 -- 172.21.15.175:0/4205043197 wait complete. 2024-04-25T09:11:32.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 -- start start 2024-04-25T09:11:32.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 Processor -- start 2024-04-25T09:11:32.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf866f30 0x55aaaf86c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf8b0920 0x55aaaf86c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b1240 0x55aaaf90d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaaf6ba3d0 con 0x55aaaf8b1240 2024-04-25T09:11:32.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaaf771d50 con 0x55aaaf8b0920 2024-04-25T09:11:32.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55aaaf650980 con 0x55aaaf866f30 2024-04-25T09:11:32.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 10 client.0 _ll_register_callbacks cb 0x7fbf00007730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:32.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf0e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b1240 0x55aaaf90d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf0e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b1240 0x55aaaf90d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50812/0 (socket says 172.21.15.175:50812) 2024-04-25T09:11:32.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf0e800640 1 -- 172.21.15.175:0/910490818 learned_addr learned my addr 172.21.15.175:0/910490818 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:32.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf05400640 1 --2- 172.21.15.175:0/910490818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf8b0920 0x55aaaf86c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf0de00640 1 --2- 172.21.15.175:0/910490818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf866f30 0x55aaaf86c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf0e800640 1 -- 172.21.15.175:0/910490818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf866f30 msgr2=0x55aaaf86c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:32.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf0e800640 1 --2- 172.21.15.175:0/910490818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf866f30 0x55aaaf86c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf0e800640 1 -- 172.21.15.175:0/910490818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf8b0920 msgr2=0x55aaaf86c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:32.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf0e800640 1 --2- 172.21.15.175:0/910490818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf8b0920 0x55aaaf86c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf0e800640 1 -- 172.21.15.175:0/910490818 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aaaf737600 con 0x55aaaf8b1240 2024-04-25T09:11:32.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf05400640 1 --2- 172.21.15.175:0/910490818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf8b0920 0x55aaaf86c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:32.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf0de00640 1 --2- 172.21.15.175:0/910490818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf866f30 0x55aaaf86c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:32.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf0e800640 1 --2- 172.21.15.175:0/910490818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b1240 0x55aaaf90d280 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fbf080556a0 tx=0x7fbf08055710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403a2c89d59c84b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbef3400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:11:32.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbef3400640 1 -- 172.21.15.175:0/910490818 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf08054b60 con 0x55aaaf8b1240 2024-04-25T09:11:32.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbef3400640 1 -- 172.21.15.175:0/910490818 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fbf0806ada0 con 0x55aaaf8b1240 2024-04-25T09:11:32.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 -- 172.21.15.175:0/910490818 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbef8000e50 con 0x55aaaf8b1240 2024-04-25T09:11:32.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbef3400640 1 -- 172.21.15.175:0/910490818 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf08054d00 con 0x55aaaf8b1240 2024-04-25T09:11:32.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 10 client.7782 fetch_fsmap learned FSMap version 71 2024-04-25T09:11:32.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.238+0000 7fbf186a8000 1 -- 172.21.15.175:0/910490818 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x55aaaf64a9b0 con 0x55aaaf8b1240 2024-04-25T09:11:32.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbef3400640 1 -- 172.21.15.175:0/910490818 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef8000e50 con 0x55aaaf8b1240 2024-04-25T09:11:32.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbef3400640 1 -- 172.21.15.175:0/910490818 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 71) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbf0807cbe0 con 0x55aaaf8b1240 2024-04-25T09:11:32.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf186a8000 10 client.7782 fetch_fsmap finished waiting for FSMap version 71 2024-04-25T09:11:32.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf186a8000 10 client.7782 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:11:32.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf186a8000 20 client.7782 populate_metadata read hostname 'smithi175' 2024-04-25T09:11:32.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf186a8000 1 --2- 172.21.15.175:0/910490818 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55aaaf90d9d0 0x55aaaf8cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf186a8000 4 client.7782 mds_command: new command op to 7303 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:11:32.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf186a8000 1 -- 172.21.15.175:0/910490818 --> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55aaaf6c32e0 con 0x55aaaf90d9d0 2024-04-25T09:11:32.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf0de00640 1 --2- 172.21.15.175:0/910490818 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55aaaf90d9d0 0x55aaaf8cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf0de00640 1 --2- 172.21.15.175:0/910490818 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55aaaf90d9d0 0x55aaaf8cb520 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bfe6b21885ee39d server_cookie=5138721adcb626b7 in_seq=0 out_seq=0 2024-04-25T09:11:32.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbef3400640 10 client.7782 ms_handle_connect on v2:172.21.15.175:6835/279367590 2024-04-25T09:11:32.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbef3400640 1 -- 172.21.15.175:0/910490818 <== mds.0 v2:172.21.15.175:6835/279367590 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55aaaf6c32e0 con 0x55aaaf90d9d0 2024-04-25T09:11:32.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbef3400640 10 client.7782 handle_command_reply: tid=0 2024-04-25T09:11:32.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf186a8000 1 client.7782 shutdown 2024-04-25T09:11:32.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf186a8000 1 -- 172.21.15.175:0/910490818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b1240 msgr2=0x55aaaf90d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf186a8000 1 --2- 172.21.15.175:0/910490818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b1240 0x55aaaf90d280 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fbf080556a0 tx=0x7fbf08055710 comp rx=0 tx=0).stop 2024-04-25T09:11:32.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf186a8000 1 -- 172.21.15.175:0/910490818 shutdown_connections 2024-04-25T09:11:32.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf186a8000 1 --2- 172.21.15.175:0/910490818 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55aaaf90d9d0 0x55aaaf8cb520 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf186a8000 1 --2- 172.21.15.175:0/910490818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55aaaf8b1240 0x55aaaf90d280 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf186a8000 1 --2- 172.21.15.175:0/910490818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55aaaf8b0920 0x55aaaf86c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf186a8000 1 --2- 172.21.15.175:0/910490818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55aaaf866f30 0x55aaaf86c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf186a8000 1 -- 172.21.15.175:0/910490818 >> 172.21.15.175:0/910490818 conn(0x55aaaf86d2a0 msgr2=0x55aaaf89d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:32.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbef3400640 0 client.7782 ms_handle_reset on v2:172.21.15.175:6835/279367590 2024-04-25T09:11:32.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf186a8000 1 -- 172.21.15.175:0/910490818 shutdown_connections 2024-04-25T09:11:32.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf186a8000 1 -- 172.21.15.175:0/910490818 wait complete. 2024-04-25T09:11:32.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf186a8000 20 client.7782 trim_cache size 0 max 16384 2024-04-25T09:11:32.237 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:11:32.237 INFO:teuthology.orchestra.run.smithi175.stdout: "cluster_fsid": "8caed986-ca08-40e2-b5a5-12e2aade6223", 2024-04-25T09:11:32.237 INFO:teuthology.orchestra.run.smithi175.stdout: "whoami": 0, 2024-04-25T09:11:32.237 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 7303, 2024-04-25T09:11:32.237 INFO:teuthology.orchestra.run.smithi175.stdout: "want_state": "up:active", 2024-04-25T09:11:32.237 INFO:teuthology.orchestra.run.smithi175.stdout: "state": "up:active", 2024-04-25T09:11:32.237 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs", 2024-04-25T09:11:32.238 INFO:teuthology.orchestra.run.smithi175.stdout: "rank_uptime": 4.519506078, 2024-04-25T09:11:32.238 INFO:teuthology.orchestra.run.smithi175.stdout: "mdsmap_epoch": 71, 2024-04-25T09:11:32.238 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch": 88, 2024-04-25T09:11:32.238 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch_barrier": 88, 2024-04-25T09:11:32.238 INFO:teuthology.orchestra.run.smithi175.stdout: "uptime": 5.4645178650000004 2024-04-25T09:11:32.238 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:11:32.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf0f200640 1 -- 172.21.15.175:0/2612535558 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbeec066f60 msgr2=0x7fbeec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf0f200640 1 --2- 172.21.15.175:0/2612535558 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbeec066f60 0x7fbeec069420 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbf00006aa0 tx=0x7fbf00008040 comp rx=0 tx=0).stop 2024-04-25T09:11:32.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf0f200640 1 -- 172.21.15.175:0/2612535558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf100cf870 msgr2=0x7fbf10140b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf0f200640 1 --2- 172.21.15.175:0/2612535558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf100cf870 0x7fbf10140b10 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800c730 tx=0x7fbf0800cbf0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf0f200640 1 -- 172.21.15.175:0/2612535558 shutdown_connections 2024-04-25T09:11:32.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf0f200640 1 --2- 172.21.15.175:0/2612535558 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbeec066f60 0x7fbeec069420 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf0f200640 1 --2- 172.21.15.175:0/2612535558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf100cf870 0x7fbf10140b10 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf0f200640 1 --2- 172.21.15.175:0/2612535558 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf100b0ff0 0x7fbf101551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf0f200640 1 --2- 172.21.15.175:0/2612535558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf1006b370 0x7fbf1013f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf0f200640 1 -- 172.21.15.175:0/2612535558 >> 172.21.15.175:0/2612535558 conn(0x7fbf10099a50 msgr2=0x7fbf100aee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:32.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf0f200640 1 -- 172.21.15.175:0/2612535558 shutdown_connections 2024-04-25T09:11:32.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.242+0000 7fbf0f200640 1 -- 172.21.15.175:0/2612535558 wait complete. 2024-04-25T09:11:32.252 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:11:32.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.398+0000 7fe390200640 1 Processor -- start 2024-04-25T09:11:32.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.398+0000 7fe390200640 1 -- start start 2024-04-25T09:11:32.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.398+0000 7fe390200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe38815db00 0x7fe38806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.398+0000 7fe390200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe3880acd90 0x7fe388161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.398+0000 7fe390200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38806f280 con 0x7fe388161c60 2024-04-25T09:11:32.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.398+0000 7fe390200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe38806acf0 con 0x7fe3880acd90 2024-04-25T09:11:32.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.398+0000 7fe390200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe38806afd0 con 0x7fe38815db00 2024-04-25T09:11:32.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.398+0000 7fe38ce00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe3880acd90 0x7fe388161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.398+0000 7fe38ce00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe3880acd90 0x7fe388161720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50828/0 (socket says 172.21.15.175:50828) 2024-04-25T09:11:32.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.398+0000 7fe38ce00640 1 -- 172.21.15.175:0/1719679647 learned_addr learned my addr 172.21.15.175:0/1719679647 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:32.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.398+0000 7fe38e200640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe388161c60 0x7fe3880b2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:47114/0 (socket says 172.21.15.175:47114) 2024-04-25T09:11:32.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.398+0000 7fe38d800640 1 --2- 172.21.15.175:0/1719679647 >> v2:172.21.15.177:3300/0 conn(0x7fe38815db00 0x7fe38806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.398+0000 7fe38ce00640 1 -- 172.21.15.175:0/1719679647 >> v2:172.21.15.177:3300/0 conn(0x7fe38815db00 msgr2=0x7fe38806e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:32.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.398+0000 7fe38ce00640 1 --2- 172.21.15.175:0/1719679647 >> v2:172.21.15.177:3300/0 conn(0x7fe38815db00 0x7fe38806e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.398+0000 7fe38ce00640 1 -- 172.21.15.175:0/1719679647 >> v1:172.21.15.175:6789/0 conn(0x7fe388161c60 legacy=0x7fe3880b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.398+0000 7fe38ce00640 1 -- 172.21.15.175:0/1719679647 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38806b2b0 con 0x7fe3880acd90 2024-04-25T09:11:32.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.398+0000 7fe387e00640 1 -- 172.21.15.175:0/1719679647 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549451293 0 0) 0x7fe38806f280 con 0x7fe388161c60 2024-04-25T09:11:32.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.402+0000 7fe38ce00640 1 --2- 172.21.15.175:0/1719679647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3880acd90 0x7fe388161720 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fe374009870 tx=0x7fe37401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469d4dd1e84c43bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.402+0000 7fe387e00640 1 -- 172.21.15.175:0/1719679647 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3740a6040 con 0x7fe3880acd90 2024-04-25T09:11:32.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.402+0000 7fe387e00640 1 -- 172.21.15.175:0/1719679647 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3740af070 con 0x7fe3880acd90 2024-04-25T09:11:32.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.402+0000 7fe387e00640 1 -- 172.21.15.175:0/1719679647 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3740aa860 con 0x7fe3880acd90 2024-04-25T09:11:32.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.402+0000 7fe390200640 1 -- 172.21.15.175:0/1719679647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3880acd90 msgr2=0x7fe388161720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.402+0000 7fe390200640 1 --2- 172.21.15.175:0/1719679647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3880acd90 0x7fe388161720 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fe374009870 tx=0x7fe37401c4c0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.402+0000 7fe390200640 1 -- 172.21.15.175:0/1719679647 shutdown_connections 2024-04-25T09:11:32.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.402+0000 7fe390200640 1 --2- 172.21.15.175:0/1719679647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3880acd90 0x7fe388161720 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.402+0000 7fe390200640 1 --2- 172.21.15.175:0/1719679647 >> v2:172.21.15.177:3300/0 conn(0x7fe38815db00 0x7fe38806e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.402+0000 7fe390200640 1 -- 172.21.15.175:0/1719679647 >> 172.21.15.175:0/1719679647 conn(0x7fe3880b2200 msgr2=0x7fe3880cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:32.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.402+0000 7fe390200640 1 -- 172.21.15.175:0/1719679647 shutdown_connections 2024-04-25T09:11:32.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.402+0000 7fe390200640 1 -- 172.21.15.175:0/1719679647 wait complete. 2024-04-25T09:11:32.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.402+0000 7fe390200640 1 Processor -- start 2024-04-25T09:11:32.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe390200640 1 -- start start 2024-04-25T09:11:32.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe390200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3880acd90 0x7fe388160900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe390200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe38815db00 0x7fe38815baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe390200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe388161c60 0x7fe38815bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe390200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38806f060 con 0x7fe3880acd90 2024-04-25T09:11:32.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe390200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38806eee0 con 0x7fe388161c60 2024-04-25T09:11:32.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe390200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38816aac0 con 0x7fe38815db00 2024-04-25T09:11:32.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe38d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3880acd90 0x7fe388160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe38d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3880acd90 0x7fe388160900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50832/0 (socket says 172.21.15.175:50832) 2024-04-25T09:11:32.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe38d800640 1 -- 172.21.15.175:0/499215574 learned_addr learned my addr 172.21.15.175:0/499215574 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:32.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe38e200640 1 --2- 172.21.15.175:0/499215574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe388161c60 0x7fe38815bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe38ce00640 1 --2- 172.21.15.175:0/499215574 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe38815db00 0x7fe38815baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe38d800640 1 -- 172.21.15.175:0/499215574 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe38815db00 msgr2=0x7fe38815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe38d800640 1 --2- 172.21.15.175:0/499215574 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe38815db00 0x7fe38815baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe38d800640 1 -- 172.21.15.175:0/499215574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe388161c60 msgr2=0x7fe38815bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe38d800640 1 --2- 172.21.15.175:0/499215574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe388161c60 0x7fe38815bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe38d800640 1 -- 172.21.15.175:0/499215574 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38814af00 con 0x7fe3880acd90 2024-04-25T09:11:32.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe38ce00640 1 --2- 172.21.15.175:0/499215574 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe38815db00 0x7fe38815baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:32.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe38e200640 1 --2- 172.21.15.175:0/499215574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe388161c60 0x7fe38815bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:32.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe38d800640 1 --2- 172.21.15.175:0/499215574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3880acd90 0x7fe388160900 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00d800 tx=0x7fe37c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe385600640 1 -- 172.21.15.175:0/499215574 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c00b6c0 con 0x7fe3880acd90 2024-04-25T09:11:32.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe385600640 1 -- 172.21.15.175:0/499215574 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37c019070 con 0x7fe3880acd90 2024-04-25T09:11:32.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe385600640 1 -- 172.21.15.175:0/499215574 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c00ba60 con 0x7fe3880acd90 2024-04-25T09:11:32.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe390200640 1 -- 172.21.15.175:0/499215574 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38815c6f0 con 0x7fe3880acd90 2024-04-25T09:11:32.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe390200640 1 -- 172.21.15.175:0/499215574 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe388152230 con 0x7fe3880acd90 2024-04-25T09:11:32.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.406+0000 7fe390200640 1 -- 172.21.15.175:0/499215574 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe388074a60 con 0x7fe3880acd90 2024-04-25T09:11:32.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.410+0000 7fe385600640 1 -- 172.21.15.175:0/499215574 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe37c00bc00 con 0x7fe3880acd90 2024-04-25T09:11:32.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.410+0000 7fe385600640 1 --2- 172.21.15.175:0/499215574 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe368066f60 0x7fe368069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.410+0000 7fe385600640 1 -- 172.21.15.175:0/499215574 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fe37c085510 con 0x7fe3880acd90 2024-04-25T09:11:32.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.410+0000 7fe38ce00640 1 --2- 172.21.15.175:0/499215574 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe368066f60 0x7fe368069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.410+0000 7fe38ce00640 1 --2- 172.21.15.175:0/499215574 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe368066f60 0x7fe368069420 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe3740ae000 tx=0x7fe374008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.414+0000 7fe385600640 1 -- 172.21.15.175:0/499215574 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe38814af00 con 0x7fe3880acd90 2024-04-25T09:11:32.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.606+0000 7fe390200640 1 -- 172.21.15.175:0/499215574 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe38815aec0 con 0x7fe3880acd90 2024-04-25T09:11:32.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.606+0000 7fe385600640 1 -- 172.21.15.175:0/499215574 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v71) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe37c0564e0 con 0x7fe3880acd90 2024-04-25T09:11:32.596 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:11:32.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.606+0000 7fe390200640 1 -- 172.21.15.175:0/499215574 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe368066f60 msgr2=0x7fe368069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.606+0000 7fe390200640 1 --2- 172.21.15.175:0/499215574 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe368066f60 0x7fe368069420 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe3740ae000 tx=0x7fe374008040 comp rx=0 tx=0).stop 2024-04-25T09:11:32.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.606+0000 7fe390200640 1 -- 172.21.15.175:0/499215574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3880acd90 msgr2=0x7fe388160900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.606+0000 7fe390200640 1 --2- 172.21.15.175:0/499215574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3880acd90 0x7fe388160900 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00d800 tx=0x7fe37c00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.606+0000 7fe390200640 1 -- 172.21.15.175:0/499215574 shutdown_connections 2024-04-25T09:11:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.606+0000 7fe390200640 1 --2- 172.21.15.175:0/499215574 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe368066f60 0x7fe368069420 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.606+0000 7fe390200640 1 --2- 172.21.15.175:0/499215574 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe388161c60 0x7fe38815bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.606+0000 7fe390200640 1 --2- 172.21.15.175:0/499215574 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe38815db00 0x7fe38815baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.606+0000 7fe390200640 1 --2- 172.21.15.175:0/499215574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3880acd90 0x7fe388160900 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.606+0000 7fe390200640 1 -- 172.21.15.175:0/499215574 >> 172.21.15.175:0/499215574 conn(0x7fe3880b2200 msgr2=0x7fe388159f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.610+0000 7fe390200640 1 -- 172.21.15.175:0/499215574 shutdown_connections 2024-04-25T09:11:32.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:32.610+0000 7fe390200640 1 -- 172.21.15.175:0/499215574 wait complete. 2024-04-25T09:11:32.616 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:11:32.616 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:11:32.617 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-25T09:11:32.617 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:11:32.617 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:32.617 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:11:32.617 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:11:32.617 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:11:32.617 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:11:32.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:32.617 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-25T09:11:32.626 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:11:32.626 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:11:32.626 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:11:32.626 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:32.626 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:11:32.626 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:32.626 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:11:32.626 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:32.626 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-25T09:11:32.626 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:11:32.626 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:32.626 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-25T09:11:32.627 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:11:32.627 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:32.627 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:11:32.627 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:32.627 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:11:32.627 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42026sec preferred_lft 42026sec 2024-04-25T09:11:32.627 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-25T09:11:32.627 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:32.627 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:11:32.627 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:0d:71:4a:a6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:32.627 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:11:32.627 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:32.627 INFO:teuthology.orchestra.run.smithi175.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:11:32.628 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:32.628 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:11:32.628 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:32.628 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:11:32.628 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:32.628 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:11:32.628 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:11:32.628 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:11:32.628 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:32.628 INFO:teuthology.orchestra.run.smithi175.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:11:32.628 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:11:32.628 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:11:32.628 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:32.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:32.629 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:11:32.687 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:11:32.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:32.690 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-25T09:11:32.714 INFO:tasks.ceph.mds.c.smithi175.stderr:2024-04-25T09:11:32.722+0000 7f6748c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:11:32.725 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-25T09:11:32.725 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:11:32.725 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:11:32.726 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:11:32.726 INFO:teuthology.orchestra.run.smithi175.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:11:32.726 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:11:32.726 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:11:32.726 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:11:32.726 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:11:32.726 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:11:32.726 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:11:32.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:32.726 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:11:32.727 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:11:32.727 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:11:32.727 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:11:32.727 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:11:32.727 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:11:32.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:32.815 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:11:32.823 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:11:32.824 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:11:32.824 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:11:32.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:32.825 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-25T09:11:32.885 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:11:32.885 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:32.933 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:11:32.934 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:11:32.934 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:32.985 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:11:32.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:32.985 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:33.073 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:33.073 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:11:33.073 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:11:33.089 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:33.089 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:11:33.089 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:11:33.089 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:11:33.089 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:11:33.097 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:33.097 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:11:33.097 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:11:33.097 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:11:33.097 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:11:33.097 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:11:33.097 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:11:33.097 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:11:33.101 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:11:33.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:33.101 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:33.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:33.164 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:11:33.220 INFO:teuthology.orchestra.run.smithi175.stdout:client6815 2024-04-25T09:11:33.221 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:11:33.221 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:33.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:33.270 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-04-25T09:11:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.462+0000 7fb3cf800640 1 Processor -- start 2024-04-25T09:11:33.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.462+0000 7fb3cf800640 1 -- start start 2024-04-25T09:11:33.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.462+0000 7fb3cf800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb3c80aebd0 0x7fb3c815b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.462+0000 7fb3cf800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3c80b4970 0x7fb3c815c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.462+0000 7fb3cf800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c815b880 con 0x7fb3c80b2700 2024-04-25T09:11:33.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.462+0000 7fb3cf800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c815bb60 con 0x7fb3c80aebd0 2024-04-25T09:11:33.454 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.462+0000 7fb3cf800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c815be40 con 0x7fb3c80b4970 2024-04-25T09:11:33.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.462+0000 7fb3cce00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb3c80aebd0 0x7fb3c815b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.462+0000 7fb3cce00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb3c80aebd0 0x7fb3c815b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50842/0 (socket says 172.21.15.175:50842) 2024-04-25T09:11:33.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.462+0000 7fb3cce00640 1 -- 172.21.15.175:0/2974637822 learned_addr learned my addr 172.21.15.175:0/2974637822 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:33.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.462+0000 7fb3cd800640 1 --2- 172.21.15.175:0/2974637822 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3c80b4970 0x7fb3c815c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.466+0000 7fb3cce00640 1 -- 172.21.15.175:0/2974637822 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3c80b4970 msgr2=0x7fb3c815c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:33.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.466+0000 7fb3cce00640 1 --2- 172.21.15.175:0/2974637822 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3c80b4970 0x7fb3c815c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.466+0000 7fb3cce00640 1 -- 172.21.15.175:0/2974637822 >> v1:172.21.15.177:6789/0 conn(0x7fb3c80b2700 legacy=0x7fb3c80b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.466+0000 7fb3cce00640 1 -- 172.21.15.175:0/2974637822 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c815c400 con 0x7fb3c80aebd0 2024-04-25T09:11:33.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.466+0000 7fb3cd800640 1 --2- 172.21.15.175:0/2974637822 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3c80b4970 0x7fb3c815c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:33.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.466+0000 7fb3cce00640 1 --2- 172.21.15.175:0/2974637822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c80aebd0 0x7fb3c815b030 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800bb10 tx=0x7fb3b801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabec2bcd8ce7280 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:33.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.466+0000 7fb3c7e00640 1 -- 172.21.15.175:0/2974637822 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b80b4070 con 0x7fb3c80aebd0 2024-04-25T09:11:33.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.466+0000 7fb3c7e00640 1 -- 172.21.15.175:0/2974637822 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c80af1c0 con 0x7fb3c80aebd0 2024-04-25T09:11:33.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.466+0000 7fb3c7e00640 1 -- 172.21.15.175:0/2974637822 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b80a7e30 con 0x7fb3c80aebd0 2024-04-25T09:11:33.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.466+0000 7fb3cf800640 1 -- 172.21.15.175:0/2974637822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c80aebd0 msgr2=0x7fb3c815b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.466+0000 7fb3cf800640 1 --2- 172.21.15.175:0/2974637822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c80aebd0 0x7fb3c815b030 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800bb10 tx=0x7fb3b801ec30 comp rx=0 tx=0).stop 2024-04-25T09:11:33.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.466+0000 7fb3cf800640 1 -- 172.21.15.175:0/2974637822 shutdown_connections 2024-04-25T09:11:33.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.466+0000 7fb3cf800640 1 --2- 172.21.15.175:0/2974637822 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3c80b4970 0x7fb3c815c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.466+0000 7fb3cf800640 1 --2- 172.21.15.175:0/2974637822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c80aebd0 0x7fb3c815b030 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.466+0000 7fb3cf800640 1 -- 172.21.15.175:0/2974637822 >> 172.21.15.175:0/2974637822 conn(0x7fb3c806ac50 msgr2=0x7fb3c806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:33.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.466+0000 7fb3cf800640 1 -- 172.21.15.175:0/2974637822 shutdown_connections 2024-04-25T09:11:33.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.466+0000 7fb3cf800640 1 -- 172.21.15.175:0/2974637822 wait complete. 2024-04-25T09:11:33.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3cf800640 1 Processor -- start 2024-04-25T09:11:33.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3cf800640 1 -- start start 2024-04-25T09:11:33.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3cf800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3c80aebd0 0x7fb3c80ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3cf800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c80b2700 0x7fb3c814ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3cf800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3c80b4970 0x7fb3c814c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3cf800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c815da00 con 0x7fb3c80b2700 2024-04-25T09:11:33.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3cf800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c815d880 con 0x7fb3c80aebd0 2024-04-25T09:11:33.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3cf800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c815db80 con 0x7fb3c80b4970 2024-04-25T09:11:33.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3bfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c80b2700 0x7fb3c814ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3bfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c80b2700 0x7fb3c814ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50858/0 (socket says 172.21.15.175:50858) 2024-04-25T09:11:33.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3bfe00640 1 -- 172.21.15.175:0/1275999043 learned_addr learned my addr 172.21.15.175:0/1275999043 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:33.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3cce00640 1 --2- 172.21.15.175:0/1275999043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3c80aebd0 0x7fb3c80ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3cd800640 1 --2- 172.21.15.175:0/1275999043 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3c80b4970 0x7fb3c814c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3bfe00640 1 -- 172.21.15.175:0/1275999043 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3c80b4970 msgr2=0x7fb3c814c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3bfe00640 1 --2- 172.21.15.175:0/1275999043 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3c80b4970 0x7fb3c814c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3bfe00640 1 -- 172.21.15.175:0/1275999043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3c80aebd0 msgr2=0x7fb3c80ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3bfe00640 1 --2- 172.21.15.175:0/1275999043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3c80aebd0 0x7fb3c80ad290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3bfe00640 1 -- 172.21.15.175:0/1275999043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c80af8e0 con 0x7fb3c80b2700 2024-04-25T09:11:33.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3bfe00640 1 --2- 172.21.15.175:0/1275999043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c80b2700 0x7fb3c814ed20 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000c3a0 tx=0x7fb3b000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:33.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3c5600640 1 -- 172.21.15.175:0/1275999043 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00052d0 con 0x7fb3c80b2700 2024-04-25T09:11:33.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3c5600640 1 -- 172.21.15.175:0/1275999043 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b0005470 con 0x7fb3c80b2700 2024-04-25T09:11:33.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3c5600640 1 -- 172.21.15.175:0/1275999043 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0007260 con 0x7fb3c80b2700 2024-04-25T09:11:33.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3cf800640 1 -- 172.21.15.175:0/1275999043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c80afbc0 con 0x7fb3c80b2700 2024-04-25T09:11:33.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.470+0000 7fb3cf800640 1 -- 172.21.15.175:0/1275999043 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c80b0180 con 0x7fb3c80b2700 2024-04-25T09:11:33.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.474+0000 7fb3c5600640 1 -- 172.21.15.175:0/1275999043 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb3b0007400 con 0x7fb3c80b2700 2024-04-25T09:11:33.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.474+0000 7fb3c5600640 1 --2- 172.21.15.175:0/1275999043 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb3a4066f60 0x7fb3a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.474+0000 7fb3c5600640 1 -- 172.21.15.175:0/1275999043 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fb3b0084580 con 0x7fb3c80b2700 2024-04-25T09:11:33.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.474+0000 7fb3cce00640 1 --2- 172.21.15.175:0/1275999043 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb3a4066f60 0x7fb3a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.474+0000 7fb3d2d6e000 1 Processor -- start 2024-04-25T09:11:33.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.474+0000 7fb3d2d6e000 1 -- start start 2024-04-25T09:11:33.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.474+0000 7fb3cce00640 1 --2- 172.21.15.175:0/1275999043 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb3a4066f60 0x7fb3a4069420 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80b1000 tx=0x7fb3b80a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:33.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3d2d6e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 0x564e7ac22070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3d2d6e000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7ac225b0 0x564e7abd7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3d2d6e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7abd8290 0x564e7abd8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3d2d6e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7aabef40 con 0x564e7ac21c90 2024-04-25T09:11:33.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3d2d6e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7aa26070 con 0x564e7abd8290 2024-04-25T09:11:33.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3d2d6e000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e7a9ae1a0 con 0x564e7ac225b0 2024-04-25T09:11:33.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3cce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 0x564e7ac22070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3cce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 0x564e7ac22070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50862/0 (socket says 172.21.15.175:50862) 2024-04-25T09:11:33.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3cce00640 1 -- 172.21.15.175:0/2060116211 learned_addr learned my addr 172.21.15.175:0/2060116211 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:33.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3bfe00640 1 --2- 172.21.15.175:0/2060116211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7ac225b0 0x564e7abd7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3cd800640 1 --2- 172.21.15.175:0/2060116211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7abd8290 0x564e7abd8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3cce00640 1 -- 172.21.15.175:0/2060116211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7ac225b0 msgr2=0x564e7abd7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:33.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3cce00640 1 --2- 172.21.15.175:0/2060116211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7ac225b0 0x564e7abd7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3cce00640 1 -- 172.21.15.175:0/2060116211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7abd8290 msgr2=0x564e7abd8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:33.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3cce00640 1 --2- 172.21.15.175:0/2060116211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7abd8290 0x564e7abd8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3cce00640 1 -- 172.21.15.175:0/2060116211 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e7a9ac510 con 0x564e7ac21c90 2024-04-25T09:11:33.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3bfe00640 1 --2- 172.21.15.175:0/2060116211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7ac225b0 0x564e7abd7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:33.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3cd800640 1 --2- 172.21.15.175:0/2060116211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7abd8290 0x564e7abd8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:33.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3cce00640 1 --2- 172.21.15.175:0/2060116211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 0x564e7ac22070 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80b2040 tx=0x7fb3b800b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1776774de74bc044 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:33.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3bd600640 1 -- 172.21.15.175:0/2060116211 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b80ca070 con 0x564e7ac21c90 2024-04-25T09:11:33.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3bd600640 1 -- 172.21.15.175:0/2060116211 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b80b9b30 con 0x564e7ac21c90 2024-04-25T09:11:33.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3bd600640 1 -- 172.21.15.175:0/2060116211 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b80b4040 con 0x564e7ac21c90 2024-04-25T09:11:33.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/2060116211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 msgr2=0x564e7ac22070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/2060116211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 0x564e7ac22070 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80b2040 tx=0x7fb3b800b450 comp rx=0 tx=0).stop 2024-04-25T09:11:33.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/2060116211 shutdown_connections 2024-04-25T09:11:33.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/2060116211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7abd8290 0x564e7abd8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/2060116211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7ac225b0 0x564e7abd7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/2060116211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 0x564e7ac22070 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/2060116211 >> 172.21.15.175:0/2060116211 conn(0x564e7abd4240 msgr2=0x564e7abd6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:33.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/2060116211 shutdown_connections 2024-04-25T09:11:33.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/2060116211 wait complete. 2024-04-25T09:11:33.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3d2d6e000 1 -- start start 2024-04-25T09:11:33.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3d2d6e000 1 Processor -- start 2024-04-25T09:11:33.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.478+0000 7fb3d2d6e000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7abd8290 0x564e7abe2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 0x564e7abe3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7ac225b0 0x564e7abe38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7a9e06c0 con 0x564e7ac21c90 2024-04-25T09:11:33.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7aa22110 con 0x564e7ac225b0 2024-04-25T09:11:33.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e7abe1200 con 0x564e7abd8290 2024-04-25T09:11:33.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 10 client.0 _ll_register_callbacks cb 0x564e7abc3570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:33.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3bfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 0x564e7abe3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3bfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 0x564e7abe3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50874/0 (socket says 172.21.15.175:50874) 2024-04-25T09:11:33.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3bfe00640 1 -- 172.21.15.175:0/2324927650 learned_addr learned my addr 172.21.15.175:0/2324927650 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:33.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3cce00640 1 --2- 172.21.15.175:0/2324927650 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7abd8290 0x564e7abe2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3cd800640 1 --2- 172.21.15.175:0/2324927650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7ac225b0 0x564e7abe38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3bfe00640 1 -- 172.21.15.175:0/2324927650 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7abd8290 msgr2=0x564e7abe2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:33.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3bfe00640 1 --2- 172.21.15.175:0/2324927650 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7abd8290 0x564e7abe2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3bfe00640 1 -- 172.21.15.175:0/2324927650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7ac225b0 msgr2=0x564e7abe38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:33.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3bfe00640 1 --2- 172.21.15.175:0/2324927650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7ac225b0 0x564e7abe38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3bfe00640 1 -- 172.21.15.175:0/2324927650 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564e7a9ae3b0 con 0x564e7ac21c90 2024-04-25T09:11:33.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3cd800640 1 --2- 172.21.15.175:0/2324927650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7ac225b0 0x564e7abe38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:33.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3bfe00640 1 --2- 172.21.15.175:0/2324927650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 0x564e7abe3370 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0054d60 tx=0x7fb3b0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1379896ad64183 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:33.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3b6000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:11:33.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3b6000640 1 -- 172.21.15.175:0/2324927650 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b005d430 con 0x564e7ac21c90 2024-04-25T09:11:33.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3b6000640 1 -- 172.21.15.175:0/2324927650 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fb3b0051440 con 0x564e7ac21c90 2024-04-25T09:11:33.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/2324927650 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb3b80b9b30 con 0x564e7ac21c90 2024-04-25T09:11:33.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3b6000640 1 -- 172.21.15.175:0/2324927650 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3b00840e0 con 0x564e7ac21c90 2024-04-25T09:11:33.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 10 client.7803 fetch_fsmap learned FSMap version 71 2024-04-25T09:11:33.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/2324927650 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x564e7aaa7e00 con 0x564e7ac21c90 2024-04-25T09:11:33.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3b6000640 1 -- 172.21.15.175:0/2324927650 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b80b9b30 con 0x564e7ac21c90 2024-04-25T09:11:33.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3b6000640 1 -- 172.21.15.175:0/2324927650 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 71) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb3b0068ce0 con 0x564e7ac21c90 2024-04-25T09:11:33.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 10 client.7803 fetch_fsmap finished waiting for FSMap version 71 2024-04-25T09:11:33.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 10 client.7803 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:11:33.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 20 client.7803 populate_metadata read hostname 'smithi175' 2024-04-25T09:11:33.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/2324927650 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x564e7abe4150 0x564e7ac33410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 4 client.7803 mds_command: new command op to 7303 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:11:33.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/2324927650 --> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564e7a9c1d60 con 0x564e7abe4150 2024-04-25T09:11:33.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3cce00640 1 --2- 172.21.15.175:0/2324927650 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x564e7abe4150 0x564e7ac33410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3cce00640 1 --2- 172.21.15.175:0/2324927650 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x564e7abe4150 0x564e7ac33410 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d203a126909a6f8 server_cookie=b78f019a3d2b4fa3 in_seq=0 out_seq=0 2024-04-25T09:11:33.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3b6000640 10 client.7803 ms_handle_connect on v2:172.21.15.175:6835/279367590 2024-04-25T09:11:33.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3b6000640 1 -- 172.21.15.175:0/2324927650 <== mds.0 v2:172.21.15.175:6835/279367590 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564e7a9c1d60 con 0x564e7abe4150 2024-04-25T09:11:33.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3b6000640 10 client.7803 handle_command_reply: tid=0 2024-04-25T09:11:33.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 client.7803 shutdown 2024-04-25T09:11:33.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/2324927650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 msgr2=0x564e7abe3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/2324927650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 0x564e7abe3370 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0054d60 tx=0x7fb3b0000bd0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/2324927650 shutdown_connections 2024-04-25T09:11:33.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/2324927650 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x564e7abe4150 0x564e7ac33410 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/2324927650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7ac225b0 0x564e7abe38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/2324927650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 0x564e7abe3370 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3b6000640 0 client.7803 ms_handle_reset on v2:172.21.15.175:6835/279367590 2024-04-25T09:11:33.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/2324927650 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7abd8290 0x564e7abe2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/2324927650 >> 172.21.15.175:0/2324927650 conn(0x564e7abd4240 msgr2=0x564e7abd6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:33.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/2324927650 shutdown_connections 2024-04-25T09:11:33.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/2324927650 wait complete. 2024-04-25T09:11:33.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.482+0000 7fb3d2d6e000 20 client.7803 trim_cache size 0 max 16384 2024-04-25T09:11:33.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.498+0000 7fb3d2d6e000 1 Processor -- start 2024-04-25T09:11:33.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.498+0000 7fb3d2d6e000 1 -- start start 2024-04-25T09:11:33.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.498+0000 7fb3d2d6e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7abd8290 0x564e7ac35420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.498+0000 7fb3d2d6e000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7ac21c90 0x564e7ac35960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.498+0000 7fb3d2d6e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac225b0 0x564e7ac832d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.498+0000 7fb3d2d6e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c8202dc0 con 0x564e7ac225b0 2024-04-25T09:11:33.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.498+0000 7fb3d2d6e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c8202040 con 0x564e7abd8290 2024-04-25T09:11:33.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.498+0000 7fb3d2d6e000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c80cdb10 con 0x564e7ac21c90 2024-04-25T09:11:33.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.498+0000 7fb3cd800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac225b0 0x564e7ac832d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.498+0000 7fb3cd800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac225b0 0x564e7ac832d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50884/0 (socket says 172.21.15.175:50884) 2024-04-25T09:11:33.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.498+0000 7fb3cd800640 1 -- 172.21.15.175:0/1651746040 learned_addr learned my addr 172.21.15.175:0/1651746040 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:33.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3bfe00640 1 --2- 172.21.15.175:0/1651746040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7ac21c90 0x564e7ac35960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3cce00640 1 --2- 172.21.15.175:0/1651746040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7abd8290 0x564e7ac35420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3cd800640 1 -- 172.21.15.175:0/1651746040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7ac21c90 msgr2=0x564e7ac35960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:33.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3cd800640 1 --2- 172.21.15.175:0/1651746040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7ac21c90 0x564e7ac35960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3cd800640 1 -- 172.21.15.175:0/1651746040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7abd8290 msgr2=0x564e7ac35420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:33.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3cd800640 1 --2- 172.21.15.175:0/1651746040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7abd8290 0x564e7ac35420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3cd800640 1 -- 172.21.15.175:0/1651746040 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e7aa7dc50 con 0x564e7ac225b0 2024-04-25T09:11:33.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3bfe00640 1 --2- 172.21.15.175:0/1651746040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7ac21c90 0x564e7ac35960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:33.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3cce00640 1 --2- 172.21.15.175:0/1651746040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7abd8290 0x564e7ac35420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:33.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3cd800640 1 --2- 172.21.15.175:0/1651746040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac225b0 0x564e7ac832d0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009770 tx=0x7fb3c0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf76517ce3e956b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:33.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3bcc00640 1 -- 172.21.15.175:0/1651746040 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c001b070 con 0x564e7ac225b0 2024-04-25T09:11:33.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3bcc00640 1 -- 172.21.15.175:0/1651746040 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c0017850 con 0x564e7ac225b0 2024-04-25T09:11:33.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3bcc00640 1 -- 172.21.15.175:0/1651746040 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0017c40 con 0x564e7ac225b0 2024-04-25T09:11:33.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/1651746040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac225b0 msgr2=0x564e7ac832d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/1651746040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac225b0 0x564e7ac832d0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009770 tx=0x7fb3c0004040 comp rx=0 tx=0).stop 2024-04-25T09:11:33.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/1651746040 shutdown_connections 2024-04-25T09:11:33.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/1651746040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac225b0 0x564e7ac832d0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/1651746040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7ac21c90 0x564e7ac35960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/1651746040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7abd8290 0x564e7ac35420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/1651746040 >> 172.21.15.175:0/1651746040 conn(0x564e7abd4240 msgr2=0x564e7abdcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:33.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/1651746040 shutdown_connections 2024-04-25T09:11:33.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/1651746040 wait complete. 2024-04-25T09:11:33.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3d2d6e000 1 -- start start 2024-04-25T09:11:33.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3d2d6e000 1 Processor -- start 2024-04-25T09:11:33.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3d2d6e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7abd8290 0x564e7ac35580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3d2d6e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 0x564e7ac3dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3d2d6e000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7ac225b0 0x564e7ac3e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3d2d6e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e7a9c8bd0 con 0x564e7ac21c90 2024-04-25T09:11:33.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3d2d6e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c80ce110 con 0x564e7abd8290 2024-04-25T09:11:33.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3d2d6e000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x564e7aadcf20 con 0x564e7ac225b0 2024-04-25T09:11:33.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3d2d6e000 10 client.0 _ll_register_callbacks cb 0x7fb3b800b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:33.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3bfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 0x564e7ac3dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3bfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 0x564e7ac3dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50894/0 (socket says 172.21.15.175:50894) 2024-04-25T09:11:33.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3bfe00640 1 -- 172.21.15.175:0/3196642451 learned_addr learned my addr 172.21.15.175:0/3196642451 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:33.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3cce00640 1 --2- 172.21.15.175:0/3196642451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7abd8290 0x564e7ac35580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3cd800640 1 --2- 172.21.15.175:0/3196642451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7ac225b0 0x564e7ac3e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3bfe00640 1 -- 172.21.15.175:0/3196642451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7ac225b0 msgr2=0x564e7ac3e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:33.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3bfe00640 1 --2- 172.21.15.175:0/3196642451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7ac225b0 0x564e7ac3e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3bfe00640 1 -- 172.21.15.175:0/3196642451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7abd8290 msgr2=0x564e7ac35580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:33.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3bfe00640 1 --2- 172.21.15.175:0/3196642451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7abd8290 0x564e7ac35580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.502+0000 7fb3bfe00640 1 -- 172.21.15.175:0/3196642451 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564e7a9ee120 con 0x564e7ac21c90 2024-04-25T09:11:33.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3bfe00640 1 --2- 172.21.15.175:0/3196642451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 0x564e7ac3dee0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0000c10 tx=0x7fb3b0082810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8d97049f35a6d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:33.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3b6000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:11:33.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3b6000640 1 -- 172.21.15.175:0/3196642451 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b005d430 con 0x564e7ac21c90 2024-04-25T09:11:33.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3b6000640 1 -- 172.21.15.175:0/3196642451 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fb3b0050b20 con 0x564e7ac21c90 2024-04-25T09:11:33.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/3196642451 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb3c0017850 con 0x564e7ac21c90 2024-04-25T09:11:33.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3b6000640 1 -- 172.21.15.175:0/3196642451 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3b0050d20 con 0x564e7ac21c90 2024-04-25T09:11:33.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 10 client.7809 fetch_fsmap learned FSMap version 71 2024-04-25T09:11:33.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/3196642451 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x564e7a9cd170 con 0x564e7ac21c90 2024-04-25T09:11:33.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3b6000640 1 -- 172.21.15.175:0/3196642451 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c0017850 con 0x564e7ac21c90 2024-04-25T09:11:33.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3b6000640 1 -- 172.21.15.175:0/3196642451 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 71) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb3b0068ce0 con 0x564e7ac21c90 2024-04-25T09:11:33.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 10 client.7809 fetch_fsmap finished waiting for FSMap version 71 2024-04-25T09:11:33.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 10 client.7809 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:11:33.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 20 client.7809 populate_metadata read hostname 'smithi175' 2024-04-25T09:11:33.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/3196642451 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x564e7ac3e960 0x564e7ac81b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 4 client.7809 mds_command: new command op to 7303 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-04-25T09:11:33.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/3196642451 --> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) v1 -- 0x564e7aa335b0 con 0x564e7ac3e960 2024-04-25T09:11:33.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3cce00640 1 --2- 172.21.15.175:0/3196642451 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x564e7ac3e960 0x564e7ac81b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3cce00640 1 --2- 172.21.15.175:0/3196642451 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x564e7ac3e960 0x564e7ac81b50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6181de64a45962d0 server_cookie=504f04e3a6592d3c in_seq=0 out_seq=0 2024-04-25T09:11:33.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3b6000640 10 client.7809 ms_handle_connect on v2:172.21.15.175:6835/279367590 2024-04-25T09:11:33.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3b6000640 1 -- 172.21.15.175:0/3196642451 <== mds.0 v2:172.21.15.175:6835/279367590 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564e7aa335b0 con 0x564e7ac3e960 2024-04-25T09:11:33.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3b6000640 10 client.7809 handle_command_reply: tid=0 2024-04-25T09:11:33.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 1 client.7809 shutdown 2024-04-25T09:11:33.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/3196642451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 msgr2=0x564e7ac3dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/3196642451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 0x564e7ac3dee0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0000c10 tx=0x7fb3b0082810 comp rx=0 tx=0).stop 2024-04-25T09:11:33.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/3196642451 shutdown_connections 2024-04-25T09:11:33.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/3196642451 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x564e7ac3e960 0x564e7ac81b50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/3196642451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564e7ac225b0 0x564e7ac3e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/3196642451 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564e7ac21c90 0x564e7ac3dee0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3b6000640 0 client.7809 ms_handle_reset on v2:172.21.15.175:6835/279367590 2024-04-25T09:11:33.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 1 --2- 172.21.15.175:0/3196642451 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564e7abd8290 0x564e7ac35580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/3196642451 >> 172.21.15.175:0/3196642451 conn(0x564e7abd4240 msgr2=0x564e7abdd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:33.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/3196642451 shutdown_connections 2024-04-25T09:11:33.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 1 -- 172.21.15.175:0/3196642451 wait complete. 2024-04-25T09:11:33.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3d2d6e000 20 client.7809 trim_cache size 0 max 16384 2024-04-25T09:11:33.501 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:11:33.501 INFO:teuthology.orchestra.run.smithi175.stdout: "return_code": 0, 2024-04-25T09:11:33.501 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_tag": "beda0e8d-d56c-4d32-b8fd-c85da844445e", 2024-04-25T09:11:33.501 INFO:teuthology.orchestra.run.smithi175.stdout: "mode": "asynchronous" 2024-04-25T09:11:33.501 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:11:33.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3cf800640 1 -- 172.21.15.175:0/1275999043 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb3a4066f60 msgr2=0x7fb3a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3cf800640 1 --2- 172.21.15.175:0/1275999043 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb3a4066f60 0x7fb3a4069420 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80b1000 tx=0x7fb3b80a9070 comp rx=0 tx=0).stop 2024-04-25T09:11:33.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3cf800640 1 -- 172.21.15.175:0/1275999043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c80b2700 msgr2=0x7fb3c814ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3cf800640 1 --2- 172.21.15.175:0/1275999043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c80b2700 0x7fb3c814ed20 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000c3a0 tx=0x7fb3b000c860 comp rx=0 tx=0).stop 2024-04-25T09:11:33.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3cf800640 1 -- 172.21.15.175:0/1275999043 shutdown_connections 2024-04-25T09:11:33.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3cf800640 1 --2- 172.21.15.175:0/1275999043 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb3a4066f60 0x7fb3a4069420 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3cf800640 1 --2- 172.21.15.175:0/1275999043 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb3c80b4970 0x7fb3c814c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3cf800640 1 --2- 172.21.15.175:0/1275999043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c80b2700 0x7fb3c814ed20 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3cf800640 1 --2- 172.21.15.175:0/1275999043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3c80aebd0 0x7fb3c80ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3cf800640 1 -- 172.21.15.175:0/1275999043 >> 172.21.15.175:0/1275999043 conn(0x7fb3c806ac50 msgr2=0x7fb3c8159910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:33.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3cf800640 1 -- 172.21.15.175:0/1275999043 shutdown_connections 2024-04-25T09:11:33.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.506+0000 7fb3cf800640 1 -- 172.21.15.175:0/1275999043 wait complete. 2024-04-25T09:11:33.503 INFO:tasks.ceph.mds.c.smithi175.stderr:2024-04-25T09:11:33.506+0000 7f6743c00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55bfdcf60680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(13)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(13)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:11:33.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:33.516 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:11:33.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.662+0000 7f6d35e00640 1 Processor -- start 2024-04-25T09:11:33.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.666+0000 7f6d35e00640 1 -- start start 2024-04-25T09:11:33.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.666+0000 7f6d35e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6d30145250 0x7f6d300cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.666+0000 7f6d35e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d301600a0 0x7f6d300cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.666+0000 7f6d35e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d300cfd10 con 0x7f6d300ce970 2024-04-25T09:11:33.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.666+0000 7f6d35e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d3015f650 con 0x7f6d30145250 2024-04-25T09:11:33.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.666+0000 7f6d35e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d300cfff0 con 0x7f6d301600a0 2024-04-25T09:11:33.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.666+0000 7f6d2f400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f6d300ce970 0x7f6d300cee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:47124/0 (socket says 172.21.15.175:47124) 2024-04-25T09:11:33.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.666+0000 7f6d2f400640 1 -- 172.21.15.175:0/3025763392 learned_addr learned my addr 172.21.15.175:0/3025763392 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:11:33.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.666+0000 7f6d26000640 1 --2- 172.21.15.175:0/3025763392 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d301600a0 0x7f6d300cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.666+0000 7f6d2ea00640 1 --2- 172.21.15.175:0/3025763392 >> v2:172.21.15.177:3300/0 conn(0x7f6d30145250 0x7f6d300cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.666+0000 7f6d2e000640 1 -- 172.21.15.175:0/3025763392 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452010536 0 0) 0x7f6d300cfd10 con 0x7f6d300ce970 2024-04-25T09:11:33.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.666+0000 7f6d2e000640 1 -- 172.21.15.175:0/3025763392 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d14003530 con 0x7f6d300ce970 2024-04-25T09:11:33.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.666+0000 7f6d26000640 1 -- 172.21.15.175:0/3025763392 >> v2:172.21.15.177:3300/0 conn(0x7f6d30145250 msgr2=0x7f6d300cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:33.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.666+0000 7f6d26000640 1 --2- 172.21.15.175:0/3025763392 >> v2:172.21.15.177:3300/0 conn(0x7f6d30145250 0x7f6d300cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.666+0000 7f6d2e000640 1 -- 172.21.15.175:0/3025763392 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2443599714 0 0) 0x7f6d14003530 con 0x7f6d300ce970 2024-04-25T09:11:33.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.666+0000 7f6d26000640 1 -- 172.21.15.175:0/3025763392 >> v1:172.21.15.175:6789/0 conn(0x7f6d300ce970 legacy=0x7f6d300cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.666+0000 7f6d26000640 1 -- 172.21.15.175:0/3025763392 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3015f8a0 con 0x7f6d301600a0 2024-04-25T09:11:33.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.670+0000 7f6d26000640 1 --2- 172.21.15.175:0/3025763392 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d301600a0 0x7f6d300cc410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6d180097c0 tx=0x7f6d1801c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5641a757079d4339 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:33.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.670+0000 7f6d2e000640 1 -- 172.21.15.175:0/3025763392 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d180b0070 con 0x7f6d301600a0 2024-04-25T09:11:33.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.670+0000 7f6d2e000640 1 -- 172.21.15.175:0/3025763392 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d180ab400 con 0x7f6d301600a0 2024-04-25T09:11:33.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.670+0000 7f6d2e000640 1 -- 172.21.15.175:0/3025763392 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d28001680 con 0x7f6d301600a0 2024-04-25T09:11:33.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.670+0000 7f6d35e00640 1 -- 172.21.15.175:0/3025763392 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d301600a0 msgr2=0x7f6d300cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.670+0000 7f6d35e00640 1 --2- 172.21.15.175:0/3025763392 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d301600a0 0x7f6d300cc410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6d180097c0 tx=0x7f6d1801c300 comp rx=0 tx=0).stop 2024-04-25T09:11:33.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.670+0000 7f6d35e00640 1 -- 172.21.15.175:0/3025763392 shutdown_connections 2024-04-25T09:11:33.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.670+0000 7f6d35e00640 1 --2- 172.21.15.175:0/3025763392 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d301600a0 0x7f6d300cc410 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.670+0000 7f6d35e00640 1 --2- 172.21.15.175:0/3025763392 >> v2:172.21.15.177:3300/0 conn(0x7f6d30145250 0x7f6d300cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.670+0000 7f6d35e00640 1 -- 172.21.15.175:0/3025763392 >> 172.21.15.175:0/3025763392 conn(0x7f6d3006ac50 msgr2=0x7f6d3006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:33.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.670+0000 7f6d35e00640 1 -- 172.21.15.175:0/3025763392 shutdown_connections 2024-04-25T09:11:33.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.670+0000 7f6d35e00640 1 -- 172.21.15.175:0/3025763392 wait complete. 2024-04-25T09:11:33.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.670+0000 7f6d35e00640 1 Processor -- start 2024-04-25T09:11:33.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.670+0000 7f6d35e00640 1 -- start start 2024-04-25T09:11:33.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d35e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d300ce970 0x7f6d3013e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d35e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d30145250 0x7f6d300af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d35e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d301600a0 0x7f6d300afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d35e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3015c870 con 0x7f6d30145250 2024-04-25T09:11:33.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d35e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d30145630 con 0x7f6d300ce970 2024-04-25T09:11:33.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d35e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3015c9f0 con 0x7f6d301600a0 2024-04-25T09:11:33.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d26000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d30145250 0x7f6d300af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d2ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d300ce970 0x7f6d3013e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d26000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d30145250 0x7f6d300af870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50902/0 (socket says 172.21.15.175:50902) 2024-04-25T09:11:33.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d26000640 1 -- 172.21.15.175:0/829869458 learned_addr learned my addr 172.21.15.175:0/829869458 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:33.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d2f400640 1 --2- 172.21.15.175:0/829869458 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d301600a0 0x7f6d300afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d26000640 1 -- 172.21.15.175:0/829869458 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d301600a0 msgr2=0x7f6d300afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d26000640 1 --2- 172.21.15.175:0/829869458 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d301600a0 0x7f6d300afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d26000640 1 -- 172.21.15.175:0/829869458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d300ce970 msgr2=0x7f6d3013e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d26000640 1 --2- 172.21.15.175:0/829869458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d300ce970 0x7f6d3013e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d26000640 1 -- 172.21.15.175:0/829869458 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d300b2760 con 0x7f6d30145250 2024-04-25T09:11:33.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d26000640 1 --2- 172.21.15.175:0/829869458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d30145250 0x7f6d300af870 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f6d1801cba0 tx=0x7f6d180190a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:33.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d27e00640 1 -- 172.21.15.175:0/829869458 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d180bb070 con 0x7f6d30145250 2024-04-25T09:11:33.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d27e00640 1 -- 172.21.15.175:0/829869458 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d180b7460 con 0x7f6d30145250 2024-04-25T09:11:33.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d27e00640 1 -- 172.21.15.175:0/829869458 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d180b0040 con 0x7f6d30145250 2024-04-25T09:11:33.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d35e00640 1 -- 172.21.15.175:0/829869458 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d300b2a40 con 0x7f6d30145250 2024-04-25T09:11:33.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.674+0000 7f6d35e00640 1 -- 172.21.15.175:0/829869458 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d300b3000 con 0x7f6d30145250 2024-04-25T09:11:33.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d27e00640 1 -- 172.21.15.175:0/829869458 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6d180be070 con 0x7f6d30145250 2024-04-25T09:11:33.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d27e00640 1 --2- 172.21.15.175:0/829869458 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6d0c066f60 0x7f6d0c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d27e00640 1 -- 172.21.15.175:0/829869458 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f6d1811f5c0 con 0x7f6d30145250 2024-04-25T09:11:33.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d2ea00640 1 --2- 172.21.15.175:0/829869458 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6d0c066f60 0x7f6d0c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d3922e000 1 Processor -- start 2024-04-25T09:11:33.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d3922e000 1 -- start start 2024-04-25T09:11:33.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d2ea00640 1 --2- 172.21.15.175:0/829869458 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6d0c066f60 0x7f6d0c069420 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6d200113e0 tx=0x7f6d2000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:33.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d3922e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93b429d0 0x560b93b42db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d3922e000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b432f0 0x560b93af8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d3922e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93af90a0 0x560b93af9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d3922e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b93945ff0 con 0x560b93b429d0 2024-04-25T09:11:33.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d3922e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b938ce150 con 0x560b93af90a0 2024-04-25T09:11:33.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d3922e000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x560b93942090 con 0x560b93b432f0 2024-04-25T09:11:33.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d2ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93b429d0 0x560b93b42db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d2ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93b429d0 0x560b93b42db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50904/0 (socket says 172.21.15.175:50904) 2024-04-25T09:11:33.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d2ea00640 1 -- 172.21.15.175:0/2157935715 learned_addr learned my addr 172.21.15.175:0/2157935715 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:33.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d26000640 1 --2- 172.21.15.175:0/2157935715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b432f0 0x560b93af8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d2ea00640 1 -- 172.21.15.175:0/2157935715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b432f0 msgr2=0x560b93af8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:33.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d2f400640 1 --2- 172.21.15.175:0/2157935715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93af90a0 0x560b93af9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d2ea00640 1 --2- 172.21.15.175:0/2157935715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b432f0 0x560b93af8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d2ea00640 1 -- 172.21.15.175:0/2157935715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93af90a0 msgr2=0x560b93af9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:33.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d2ea00640 1 --2- 172.21.15.175:0/2157935715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93af90a0 0x560b93af9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d2ea00640 1 -- 172.21.15.175:0/2157935715 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b93adc0d0 con 0x560b93b429d0 2024-04-25T09:11:33.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d26000640 1 --2- 172.21.15.175:0/2157935715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b432f0 0x560b93af8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:33.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d2f400640 1 --2- 172.21.15.175:0/2157935715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93af90a0 0x560b93af9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:33.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d2ea00640 1 --2- 172.21.15.175:0/2157935715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93b429d0 0x560b93b42db0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f6d20017820 tx=0x7f6d20014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b857b10e28f663f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:33.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d1fe00640 1 -- 172.21.15.175:0/2157935715 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2001b070 con 0x560b93b429d0 2024-04-25T09:11:33.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d1fe00640 1 -- 172.21.15.175:0/2157935715 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d20027070 con 0x560b93b429d0 2024-04-25T09:11:33.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.678+0000 7f6d1fe00640 1 -- 172.21.15.175:0/2157935715 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d20015d90 con 0x560b93b429d0 2024-04-25T09:11:33.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 -- 172.21.15.175:0/2157935715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93b429d0 msgr2=0x560b93b42db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 --2- 172.21.15.175:0/2157935715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93b429d0 0x560b93b42db0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f6d20017820 tx=0x7f6d20014000 comp rx=0 tx=0).stop 2024-04-25T09:11:33.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 -- 172.21.15.175:0/2157935715 shutdown_connections 2024-04-25T09:11:33.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 --2- 172.21.15.175:0/2157935715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93af90a0 0x560b93af9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 --2- 172.21.15.175:0/2157935715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b432f0 0x560b93af8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 --2- 172.21.15.175:0/2157935715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93b429d0 0x560b93b42db0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 -- 172.21.15.175:0/2157935715 >> 172.21.15.175:0/2157935715 conn(0x560b93af5020 msgr2=0x560b93af7440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:33.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 -- 172.21.15.175:0/2157935715 shutdown_connections 2024-04-25T09:11:33.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 -- 172.21.15.175:0/2157935715 wait complete. 2024-04-25T09:11:33.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 -- start start 2024-04-25T09:11:33.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 Processor -- start 2024-04-25T09:11:33.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93af90a0 0x560b93b277f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b429d0 0x560b93b27d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93b432f0 0x560b93b28270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b9390a250 con 0x560b93af90a0 2024-04-25T09:11:33.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b93900690 con 0x560b93b432f0 2024-04-25T09:11:33.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x560b938cea40 con 0x560b93b429d0 2024-04-25T09:11:33.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 10 client.0 _ll_register_callbacks cb 0x560b93ae3e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:33.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d2ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93af90a0 0x560b93b277f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d2ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93af90a0 0x560b93b277f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50914/0 (socket says 172.21.15.175:50914) 2024-04-25T09:11:33.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d2ea00640 1 -- 172.21.15.175:0/3597276638 learned_addr learned my addr 172.21.15.175:0/3597276638 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:33.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d26000640 1 --2- 172.21.15.175:0/3597276638 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b429d0 0x560b93b27d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d2f400640 1 --2- 172.21.15.175:0/3597276638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93b432f0 0x560b93b28270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d2ea00640 1 -- 172.21.15.175:0/3597276638 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b429d0 msgr2=0x560b93b27d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:33.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d2ea00640 1 --2- 172.21.15.175:0/3597276638 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b429d0 0x560b93b27d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d2ea00640 1 -- 172.21.15.175:0/3597276638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93b432f0 msgr2=0x560b93b28270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:33.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d2ea00640 1 --2- 172.21.15.175:0/3597276638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93b432f0 0x560b93b28270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d2ea00640 1 -- 172.21.15.175:0/3597276638 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560b939f31c0 con 0x560b93af90a0 2024-04-25T09:11:33.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d2ea00640 1 --2- 172.21.15.175:0/3597276638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93af90a0 0x560b93b277f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f6d20009fa0 tx=0x7f6d20004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ec9d166aca5155 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:33.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d1cc00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:11:33.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d1cc00640 1 -- 172.21.15.175:0/3597276638 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2001b040 con 0x560b93af90a0 2024-04-25T09:11:33.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d1cc00640 1 -- 172.21.15.175:0/3597276638 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f6d20037bb0 con 0x560b93af90a0 2024-04-25T09:11:33.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 -- 172.21.15.175:0/3597276638 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6d20027070 con 0x560b93af90a0 2024-04-25T09:11:33.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d1cc00640 1 -- 172.21.15.175:0/3597276638 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d20037db0 con 0x560b93af90a0 2024-04-25T09:11:33.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 10 client.7821 fetch_fsmap learned FSMap version 71 2024-04-25T09:11:33.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.682+0000 7f6d3922e000 1 -- 172.21.15.175:0/3597276638 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x560b939ef170 con 0x560b93af90a0 2024-04-25T09:11:33.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d1cc00640 1 -- 172.21.15.175:0/3597276638 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d20027070 con 0x560b93af90a0 2024-04-25T09:11:33.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d1cc00640 1 -- 172.21.15.175:0/3597276638 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 71) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6d2003e050 con 0x560b93af90a0 2024-04-25T09:11:33.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d3922e000 10 client.7821 fetch_fsmap finished waiting for FSMap version 71 2024-04-25T09:11:33.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d3922e000 10 client.7821 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:11:33.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d3922e000 20 client.7821 populate_metadata read hostname 'smithi175' 2024-04-25T09:11:33.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d3922e000 1 --2- 172.21.15.175:0/3597276638 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x560b93b52c80 0x560b93b55070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d3922e000 4 client.7821 mds_command: new command op to 7303 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:11:33.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d3922e000 1 -- 172.21.15.175:0/3597276638 --> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560b938e1c60 con 0x560b93b52c80 2024-04-25T09:11:33.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d26000640 1 --2- 172.21.15.175:0/3597276638 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x560b93b52c80 0x560b93b55070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d26000640 1 --2- 172.21.15.175:0/3597276638 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x560b93b52c80 0x560b93b55070 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be1290fff193ba28 server_cookie=54a61f917a2df1fc in_seq=0 out_seq=0 2024-04-25T09:11:33.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d1cc00640 10 client.7821 ms_handle_connect on v2:172.21.15.175:6835/279367590 2024-04-25T09:11:33.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d1cc00640 1 -- 172.21.15.175:0/3597276638 <== mds.0 v2:172.21.15.175:6835/279367590 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560b938e1c60 con 0x560b93b52c80 2024-04-25T09:11:33.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d1cc00640 10 client.7821 handle_command_reply: tid=0 2024-04-25T09:11:33.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d3922e000 1 client.7821 shutdown 2024-04-25T09:11:33.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d3922e000 1 -- 172.21.15.175:0/3597276638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93af90a0 msgr2=0x560b93b277f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d3922e000 1 --2- 172.21.15.175:0/3597276638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93af90a0 0x560b93b277f0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f6d20009fa0 tx=0x7f6d20004a50 comp rx=0 tx=0).stop 2024-04-25T09:11:33.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d3922e000 1 -- 172.21.15.175:0/3597276638 shutdown_connections 2024-04-25T09:11:33.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d3922e000 1 --2- 172.21.15.175:0/3597276638 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x560b93b52c80 0x560b93b55070 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d3922e000 1 --2- 172.21.15.175:0/3597276638 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93b432f0 0x560b93b28270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d3922e000 1 --2- 172.21.15.175:0/3597276638 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b429d0 0x560b93b27d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d3922e000 1 --2- 172.21.15.175:0/3597276638 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93af90a0 0x560b93b277f0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d1cc00640 0 client.7821 ms_handle_reset on v2:172.21.15.175:6835/279367590 2024-04-25T09:11:33.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d3922e000 1 -- 172.21.15.175:0/3597276638 >> 172.21.15.175:0/3597276638 conn(0x560b93af5020 msgr2=0x560b93af7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:33.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d3922e000 1 -- 172.21.15.175:0/3597276638 shutdown_connections 2024-04-25T09:11:33.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d3922e000 1 -- 172.21.15.175:0/3597276638 wait complete. 2024-04-25T09:11:33.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.686+0000 7f6d3922e000 20 client.7821 trim_cache size 0 max 16384 2024-04-25T09:11:33.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d3922e000 1 Processor -- start 2024-04-25T09:11:33.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d3922e000 1 -- start start 2024-04-25T09:11:33.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d3922e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93af90a0 0x560b93b9f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d3922e000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b429d0 0x560b93b9f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d3922e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93b432f0 0x560b93b9fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d3922e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d30202b20 con 0x560b93b432f0 2024-04-25T09:11:33.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d3922e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d30201db0 con 0x560b93af90a0 2024-04-25T09:11:33.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d3922e000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3015de50 con 0x560b93b429d0 2024-04-25T09:11:33.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d2f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93b432f0 0x560b93b9fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d2f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93b432f0 0x560b93b9fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50920/0 (socket says 172.21.15.175:50920) 2024-04-25T09:11:33.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d2f400640 1 -- 172.21.15.175:0/2128093501 learned_addr learned my addr 172.21.15.175:0/2128093501 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:33.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d2f400640 1 -- 172.21.15.175:0/2128093501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b429d0 msgr2=0x560b93b9f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:33.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d2f400640 1 --2- 172.21.15.175:0/2128093501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b429d0 0x560b93b9f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d2f400640 1 -- 172.21.15.175:0/2128093501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93af90a0 msgr2=0x560b93b9f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:33.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d2ea00640 1 --2- 172.21.15.175:0/2128093501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93af90a0 0x560b93b9f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d2f400640 1 --2- 172.21.15.175:0/2128093501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93af90a0 0x560b93b9f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d2f400640 1 -- 172.21.15.175:0/2128093501 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b9398cde0 con 0x560b93b432f0 2024-04-25T09:11:33.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d2ea00640 1 --2- 172.21.15.175:0/2128093501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93af90a0 0x560b93b9f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:33.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d2f400640 1 --2- 172.21.15.175:0/2128093501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93b432f0 0x560b93b9fb70 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f6d28006a20 tx=0x7f6d28006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e55c6d0898980b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:33.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d1f400640 1 -- 172.21.15.175:0/2128093501 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2801a070 con 0x560b93b432f0 2024-04-25T09:11:33.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d1f400640 1 -- 172.21.15.175:0/2128093501 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d280139b0 con 0x560b93b432f0 2024-04-25T09:11:33.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d1f400640 1 -- 172.21.15.175:0/2128093501 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d28013d60 con 0x560b93b432f0 2024-04-25T09:11:33.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d3922e000 1 -- 172.21.15.175:0/2128093501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93b432f0 msgr2=0x560b93b9fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d3922e000 1 --2- 172.21.15.175:0/2128093501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93b432f0 0x560b93b9fb70 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f6d28006a20 tx=0x7f6d28006ee0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d3922e000 1 -- 172.21.15.175:0/2128093501 shutdown_connections 2024-04-25T09:11:33.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d3922e000 1 --2- 172.21.15.175:0/2128093501 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93b432f0 0x560b93b9fb70 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d3922e000 1 --2- 172.21.15.175:0/2128093501 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b429d0 0x560b93b9f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d3922e000 1 --2- 172.21.15.175:0/2128093501 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93af90a0 0x560b93b9f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d3922e000 1 -- 172.21.15.175:0/2128093501 >> 172.21.15.175:0/2128093501 conn(0x560b93af5020 msgr2=0x560b93b4ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:33.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d3922e000 1 -- 172.21.15.175:0/2128093501 shutdown_connections 2024-04-25T09:11:33.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.702+0000 7f6d3922e000 1 -- 172.21.15.175:0/2128093501 wait complete. 2024-04-25T09:11:33.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d3922e000 1 -- start start 2024-04-25T09:11:33.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d3922e000 1 Processor -- start 2024-04-25T09:11:33.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d3922e000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93af90a0 0x560b93b55380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d3922e000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93b429d0 0x560b93b558c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d3922e000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b432f0 0x560b93b55e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d3922e000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b93945300 con 0x560b93af90a0 2024-04-25T09:11:33.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d3922e000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b938e0e00 con 0x560b93b429d0 2024-04-25T09:11:33.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d3922e000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x560b9394a620 con 0x560b93b432f0 2024-04-25T09:11:33.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d3922e000 10 client.0 _ll_register_callbacks cb 0x560b93ac4040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:33.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d2ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93af90a0 0x560b93b55380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d2ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93af90a0 0x560b93b55380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50922/0 (socket says 172.21.15.175:50922) 2024-04-25T09:11:33.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d2ea00640 1 -- 172.21.15.175:0/322512176 learned_addr learned my addr 172.21.15.175:0/322512176 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:11:33.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d26000640 1 --2- 172.21.15.175:0/322512176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93b429d0 0x560b93b558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d2f400640 1 --2- 172.21.15.175:0/322512176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b432f0 0x560b93b55e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d2ea00640 1 -- 172.21.15.175:0/322512176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b432f0 msgr2=0x560b93b55e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:33.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d2ea00640 1 --2- 172.21.15.175:0/322512176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b432f0 0x560b93b55e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d2ea00640 1 -- 172.21.15.175:0/322512176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93b429d0 msgr2=0x560b93b558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:33.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d2ea00640 1 --2- 172.21.15.175:0/322512176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93b429d0 0x560b93b558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d2ea00640 1 -- 172.21.15.175:0/322512176 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560b938e78e0 con 0x560b93af90a0 2024-04-25T09:11:33.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d2ea00640 1 --2- 172.21.15.175:0/322512176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93af90a0 0x560b93b55380 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f6d20038fd0 tx=0x7f6d20018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4612aa044e667fa1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:33.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d1cc00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:11:33.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d1cc00640 1 -- 172.21.15.175:0/322512176 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d20045030 con 0x560b93af90a0 2024-04-25T09:11:33.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d3922e000 1 -- 172.21.15.175:0/322512176 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6d280139b0 con 0x560b93af90a0 2024-04-25T09:11:33.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d1cc00640 1 -- 172.21.15.175:0/322512176 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f6d20022cb0 con 0x560b93af90a0 2024-04-25T09:11:33.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d1cc00640 1 -- 172.21.15.175:0/322512176 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d2001b040 con 0x560b93af90a0 2024-04-25T09:11:33.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d3922e000 10 client.7827 fetch_fsmap learned FSMap version 71 2024-04-25T09:11:33.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d3922e000 1 -- 172.21.15.175:0/322512176 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x560b9399f8f0 con 0x560b93af90a0 2024-04-25T09:11:33.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d1cc00640 1 -- 172.21.15.175:0/322512176 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d280139b0 con 0x560b93af90a0 2024-04-25T09:11:33.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d1cc00640 1 -- 172.21.15.175:0/322512176 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 71) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6d2003e050 con 0x560b93af90a0 2024-04-25T09:11:33.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d3922e000 10 client.7827 fetch_fsmap finished waiting for FSMap version 71 2024-04-25T09:11:33.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d3922e000 10 client.7827 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:11:33.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d3922e000 20 client.7827 populate_metadata read hostname 'smithi175' 2024-04-25T09:11:33.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d3922e000 1 --2- 172.21.15.175:0/322512176 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x560b93b567c0 0x560b93baaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:33.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d3922e000 4 client.7827 mds_command: new command op to 7303 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:11:33.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d3922e000 1 -- 172.21.15.175:0/322512176 --> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560b93953530 con 0x560b93b567c0 2024-04-25T09:11:33.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d26000640 1 --2- 172.21.15.175:0/322512176 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x560b93b567c0 0x560b93baaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:33.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d26000640 1 --2- 172.21.15.175:0/322512176 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x560b93b567c0 0x560b93baaf60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f219b7112442006 server_cookie=63431b1e0847debc in_seq=0 out_seq=0 2024-04-25T09:11:33.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.706+0000 7f6d1cc00640 10 client.7827 ms_handle_connect on v2:172.21.15.175:6835/279367590 2024-04-25T09:11:33.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d1cc00640 1 -- 172.21.15.175:0/322512176 <== mds.0 v2:172.21.15.175:6835/279367590 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+263 (crc 0 0 0) 0x560b93953530 con 0x560b93b567c0 2024-04-25T09:11:33.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d1cc00640 10 client.7827 handle_command_reply: tid=0 2024-04-25T09:11:33.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d3922e000 1 client.7827 shutdown 2024-04-25T09:11:33.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d3922e000 1 -- 172.21.15.175:0/322512176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93af90a0 msgr2=0x560b93b55380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d3922e000 1 --2- 172.21.15.175:0/322512176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93af90a0 0x560b93b55380 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f6d20038fd0 tx=0x7f6d20018000 comp rx=0 tx=0).stop 2024-04-25T09:11:33.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d3922e000 1 -- 172.21.15.175:0/322512176 shutdown_connections 2024-04-25T09:11:33.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d3922e000 1 --2- 172.21.15.175:0/322512176 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x560b93b567c0 0x560b93baaf60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d3922e000 1 --2- 172.21.15.175:0/322512176 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560b93b432f0 0x560b93b55e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d3922e000 1 --2- 172.21.15.175:0/322512176 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560b93b429d0 0x560b93b558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d1cc00640 0 client.7827 ms_handle_reset on v2:172.21.15.175:6835/279367590 2024-04-25T09:11:33.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d3922e000 1 --2- 172.21.15.175:0/322512176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560b93af90a0 0x560b93b55380 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d3922e000 1 -- 172.21.15.175:0/322512176 >> 172.21.15.175:0/322512176 conn(0x560b93af5020 msgr2=0x560b93b410d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:33.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d3922e000 1 -- 172.21.15.175:0/322512176 shutdown_connections 2024-04-25T09:11:33.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d3922e000 1 -- 172.21.15.175:0/322512176 wait complete. 2024-04-25T09:11:33.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d3922e000 20 client.7827 trim_cache size 0 max 16384 2024-04-25T09:11:33.704 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:11:33.704 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:11:33.704 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": { 2024-04-25T09:11:33.704 INFO:teuthology.orchestra.run.smithi175.stdout: "beda0e8d-d56c-4d32-b8fd-c85da844445e": { 2024-04-25T09:11:33.704 INFO:teuthology.orchestra.run.smithi175.stdout: "path": "/dir", 2024-04-25T09:11:33.705 INFO:teuthology.orchestra.run.smithi175.stdout: "tag": "beda0e8d-d56c-4d32-b8fd-c85da844445e", 2024-04-25T09:11:33.705 INFO:teuthology.orchestra.run.smithi175.stdout: "options": "recursive,repair" 2024-04-25T09:11:33.705 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:11:33.705 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:11:33.705 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:11:33.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d35e00640 1 -- 172.21.15.175:0/829869458 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6d0c066f60 msgr2=0x7f6d0c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d35e00640 1 --2- 172.21.15.175:0/829869458 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6d0c066f60 0x7f6d0c069420 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f6d200113e0 tx=0x7f6d2000b040 comp rx=0 tx=0).stop 2024-04-25T09:11:33.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d35e00640 1 -- 172.21.15.175:0/829869458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d30145250 msgr2=0x7f6d300af870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d35e00640 1 --2- 172.21.15.175:0/829869458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d30145250 0x7f6d300af870 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f6d1801cba0 tx=0x7f6d180190a0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d35e00640 1 -- 172.21.15.175:0/829869458 shutdown_connections 2024-04-25T09:11:33.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d35e00640 1 --2- 172.21.15.175:0/829869458 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6d0c066f60 0x7f6d0c069420 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d35e00640 1 --2- 172.21.15.175:0/829869458 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6d301600a0 0x7f6d300afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d35e00640 1 --2- 172.21.15.175:0/829869458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d30145250 0x7f6d300af870 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d35e00640 1 --2- 172.21.15.175:0/829869458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6d300ce970 0x7f6d3013e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d35e00640 1 -- 172.21.15.175:0/829869458 >> 172.21.15.175:0/829869458 conn(0x7f6d3006ac50 msgr2=0x7f6d301435f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:33.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d35e00640 1 -- 172.21.15.175:0/829869458 shutdown_connections 2024-04-25T09:11:33.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:11:33.710+0000 7f6d35e00640 1 -- 172.21.15.175:0/829869458 wait complete. 2024-04-25T09:11:33.717 INFO:tasks.cephfs.filesystem:scrub status for tag:beda0e8d-d56c-4d32-b8fd-c85da844445e - {'path': '/dir', 'tag': 'beda0e8d-d56c-4d32-b8fd-c85da844445e', 'options': 'recursive,repair'} 2024-04-25T09:11:39.310 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:11:39.313 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:12:03.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:03.719 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:12:03.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.881+0000 7fda4ba00640 1 Processor -- start 2024-04-25T09:12:03.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.881+0000 7fda4ba00640 1 -- start start 2024-04-25T09:12:03.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.881+0000 7fda4ba00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fda440cf080 0x7fda441600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.881+0000 7fda4ba00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda440cfd10 con 0x7fda44145250 2024-04-25T09:12:03.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.881+0000 7fda4ba00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda440cfff0 con 0x7fda440cf6b0 2024-04-25T09:12:03.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.881+0000 7fda4ba00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda441605e0 con 0x7fda440cf080 2024-04-25T09:12:03.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda49000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fda44145250 0x7fda440cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:41364/0 (socket says 172.21.15.175:41364) 2024-04-25T09:12:03.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda49000640 1 -- 172.21.15.175:0/2858192021 learned_addr learned my addr 172.21.15.175:0/2858192021 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:03.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda49a00640 1 --2- 172.21.15.175:0/2858192021 >> v2:172.21.15.177:3300/0 conn(0x7fda440cf080 0x7fda441600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43400640 1 -- 172.21.15.175:0/2858192021 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902435987 0 0) 0x7fda440cfd10 con 0x7fda44145250 2024-04-25T09:12:03.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43400640 1 -- 172.21.15.175:0/2858192021 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda28003530 con 0x7fda44145250 2024-04-25T09:12:03.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43400640 1 -- 172.21.15.175:0/2858192021 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3755173875 0 0) 0x7fda28003530 con 0x7fda44145250 2024-04-25T09:12:03.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43400640 1 -- 172.21.15.175:0/2858192021 >> v2:172.21.15.177:3300/0 conn(0x7fda440cf080 msgr2=0x7fda441600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:03.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43400640 1 --2- 172.21.15.175:0/2858192021 >> v2:172.21.15.177:3300/0 conn(0x7fda440cf080 0x7fda441600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43400640 1 -- 172.21.15.175:0/2858192021 >> v1:172.21.15.177:6789/0 conn(0x7fda440cf6b0 legacy=0x7fda440ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43400640 1 -- 172.21.15.175:0/2858192021 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4415f8a0 con 0x7fda44145250 2024-04-25T09:12:03.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43400640 1 -- 172.21.15.175:0/2858192021 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fda34001a00 con 0x7fda44145250 2024-04-25T09:12:03.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43400640 1 -- 172.21.15.175:0/2858192021 >> v1:172.21.15.175:6789/0 conn(0x7fda44145250 legacy=0x7fda440cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43400640 1 --2- 172.21.15.175:0/2858192021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda28003a10 0x7fda28003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43400640 1 --2- 172.21.15.175:0/2858192021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda28004810 0x7fda28004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43400640 1 --2- 172.21.15.175:0/2858192021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda28005220 0x7fda2800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43400640 1 -- 172.21.15.175:0/2858192021 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda441605e0 con 0x7fda28004810 2024-04-25T09:12:03.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43400640 1 -- 172.21.15.175:0/2858192021 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2800c170 con 0x7fda28003a10 2024-04-25T09:12:03.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43400640 1 -- 172.21.15.175:0/2858192021 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2800c370 con 0x7fda28005220 2024-04-25T09:12:03.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43e00640 1 --2- 172.21.15.175:0/2858192021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda28004810 0x7fda28004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda49000640 1 --2- 172.21.15.175:0/2858192021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda28003a10 0x7fda28003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda49a00640 1 --2- 172.21.15.175:0/2858192021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda28005220 0x7fda2800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43e00640 1 -- 172.21.15.175:0/2858192021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda28005220 msgr2=0x7fda2800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:03.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43e00640 1 --2- 172.21.15.175:0/2858192021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda28005220 0x7fda2800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43e00640 1 -- 172.21.15.175:0/2858192021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda28003a10 msgr2=0x7fda28003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:03.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43e00640 1 --2- 172.21.15.175:0/2858192021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda28003a10 0x7fda28003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda43e00640 1 -- 172.21.15.175:0/2858192021 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda28003530 con 0x7fda28004810 2024-04-25T09:12:03.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda49a00640 1 --2- 172.21.15.175:0/2858192021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda28005220 0x7fda2800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:03.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda49000640 1 --2- 172.21.15.175:0/2858192021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda28003a10 0x7fda28003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:03.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.885+0000 7fda49a00640 1 -- 172.21.15.175:0/2858192021 reap_dead start 2024-04-25T09:12:03.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.889+0000 7fda43e00640 1 --2- 172.21.15.175:0/2858192021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda28004810 0x7fda28004c90 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fda30001750 tx=0x7fda3001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481d59b6dd65a2d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.889+0000 7fda43400640 1 -- 172.21.15.175:0/2858192021 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda300013a0 con 0x7fda28004810 2024-04-25T09:12:03.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.889+0000 7fda43400640 1 -- 172.21.15.175:0/2858192021 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda300052f0 con 0x7fda28004810 2024-04-25T09:12:03.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.889+0000 7fda43400640 1 -- 172.21.15.175:0/2858192021 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda30003840 con 0x7fda28004810 2024-04-25T09:12:03.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.889+0000 7fda4ba00640 1 -- 172.21.15.175:0/2858192021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda28004810 msgr2=0x7fda28004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.889+0000 7fda4ba00640 1 --2- 172.21.15.175:0/2858192021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda28004810 0x7fda28004c90 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fda30001750 tx=0x7fda3001c3c0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.889+0000 7fda4ba00640 1 -- 172.21.15.175:0/2858192021 shutdown_connections 2024-04-25T09:12:03.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.889+0000 7fda4ba00640 1 --2- 172.21.15.175:0/2858192021 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda28004810 0x7fda28004c90 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.889+0000 7fda4ba00640 1 -- 172.21.15.175:0/2858192021 >> 172.21.15.175:0/2858192021 conn(0x7fda4406ac50 msgr2=0x7fda4406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:03.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.889+0000 7fda4ba00640 1 -- 172.21.15.175:0/2858192021 shutdown_connections 2024-04-25T09:12:03.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.889+0000 7fda4ba00640 1 -- 172.21.15.175:0/2858192021 wait complete. 2024-04-25T09:12:03.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.889+0000 7fda4ba00640 1 Processor -- start 2024-04-25T09:12:03.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.889+0000 7fda4ba00640 1 -- start start 2024-04-25T09:12:03.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda4ba00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda28004810 0x7fda441593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda4ba00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda4415d760 0x7fda4415dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda4ba00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda44140260 0x7fda441406e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda4ba00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4415c870 con 0x7fda4415d760 2024-04-25T09:12:03.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda4ba00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4415f650 con 0x7fda28004810 2024-04-25T09:12:03.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda4ba00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4415c9f0 con 0x7fda44140260 2024-04-25T09:12:03.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda43e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda4415d760 0x7fda4415dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda43e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda4415d760 0x7fda4415dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50160/0 (socket says 172.21.15.175:50160) 2024-04-25T09:12:03.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda43e00640 1 -- 172.21.15.175:0/1409097616 learned_addr learned my addr 172.21.15.175:0/1409097616 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:03.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda49000640 1 --2- 172.21.15.175:0/1409097616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda28004810 0x7fda441593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda49a00640 1 --2- 172.21.15.175:0/1409097616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda44140260 0x7fda441406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda43e00640 1 -- 172.21.15.175:0/1409097616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda44140260 msgr2=0x7fda441406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda43e00640 1 --2- 172.21.15.175:0/1409097616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda44140260 0x7fda441406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda43e00640 1 -- 172.21.15.175:0/1409097616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda28004810 msgr2=0x7fda441593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda43e00640 1 --2- 172.21.15.175:0/1409097616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda28004810 0x7fda441593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda43e00640 1 -- 172.21.15.175:0/1409097616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda44159920 con 0x7fda4415d760 2024-04-25T09:12:03.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda49000640 1 --2- 172.21.15.175:0/1409097616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda28004810 0x7fda441593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:03.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda43e00640 1 --2- 172.21.15.175:0/1409097616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda4415d760 0x7fda4415dbe0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fda30005040 tx=0x7fda28005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda40c00640 1 -- 172.21.15.175:0/1409097616 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda300013a0 con 0x7fda4415d760 2024-04-25T09:12:03.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda40c00640 1 -- 172.21.15.175:0/1409097616 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda300bb070 con 0x7fda4415d760 2024-04-25T09:12:03.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda40c00640 1 -- 172.21.15.175:0/1409097616 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda30007a40 con 0x7fda4415d760 2024-04-25T09:12:03.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda4ba00640 1 -- 172.21.15.175:0/1409097616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda44140f20 con 0x7fda4415d760 2024-04-25T09:12:03.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.893+0000 7fda4ba00640 1 -- 172.21.15.175:0/1409097616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda441414e0 con 0x7fda4415d760 2024-04-25T09:12:03.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda40c00640 1 -- 172.21.15.175:0/1409097616 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fda300b4040 con 0x7fda4415d760 2024-04-25T09:12:03.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda40c00640 1 --2- 172.21.15.175:0/1409097616 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fda24066f90 0x7fda24069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda40c00640 1 -- 172.21.15.175:0/1409097616 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fda3011ef80 con 0x7fda4415d760 2024-04-25T09:12:03.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda49000640 1 --2- 172.21.15.175:0/1409097616 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fda24066f90 0x7fda24069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda4efaa000 1 Processor -- start 2024-04-25T09:12:03.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda4efaa000 1 -- start start 2024-04-25T09:12:03.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda49000640 1 --2- 172.21.15.175:0/1409097616 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fda24066f90 0x7fda24069450 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fda340013a0 tx=0x7fda34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda4efaa000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553def9d0 0x55e553defdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda4efaa000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553df02f0 0x55e553da5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda4efaa000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553da60a0 0x55e553da6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda4efaa000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e553bf2ff0 con 0x55e553def9d0 2024-04-25T09:12:03.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda4efaa000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e553b7b150 con 0x55e553df02f0 2024-04-25T09:12:03.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda4efaa000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e553bef090 con 0x55e553da60a0 2024-04-25T09:12:03.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda49000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553def9d0 0x55e553defdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda49000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553def9d0 0x55e553defdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50162/0 (socket says 172.21.15.175:50162) 2024-04-25T09:12:03.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda49000640 1 -- 172.21.15.175:0/49625072 learned_addr learned my addr 172.21.15.175:0/49625072 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:03.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda49a00640 1 --2- 172.21.15.175:0/49625072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553da60a0 0x55e553da6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda43e00640 1 --2- 172.21.15.175:0/49625072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553df02f0 0x55e553da5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda49000640 1 -- 172.21.15.175:0/49625072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553da60a0 msgr2=0x55e553da6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:03.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda49000640 1 --2- 172.21.15.175:0/49625072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553da60a0 0x55e553da6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda49000640 1 -- 172.21.15.175:0/49625072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553df02f0 msgr2=0x55e553da5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:03.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda49000640 1 --2- 172.21.15.175:0/49625072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553df02f0 0x55e553da5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda49000640 1 -- 172.21.15.175:0/49625072 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e553d890d0 con 0x55e553def9d0 2024-04-25T09:12:03.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda49000640 1 --2- 172.21.15.175:0/49625072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553def9d0 0x55e553defdb0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fda34004b70 tx=0x7fda34013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4141164f2c151c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda39600640 1 -- 172.21.15.175:0/49625072 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34027070 con 0x55e553def9d0 2024-04-25T09:12:03.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda39600640 1 -- 172.21.15.175:0/49625072 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda34005890 con 0x55e553def9d0 2024-04-25T09:12:03.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.897+0000 7fda39600640 1 -- 172.21.15.175:0/49625072 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34014620 con 0x55e553def9d0 2024-04-25T09:12:03.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 -- 172.21.15.175:0/49625072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553def9d0 msgr2=0x55e553defdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 --2- 172.21.15.175:0/49625072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553def9d0 0x55e553defdb0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fda34004b70 tx=0x7fda34013000 comp rx=0 tx=0).stop 2024-04-25T09:12:03.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 -- 172.21.15.175:0/49625072 shutdown_connections 2024-04-25T09:12:03.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 --2- 172.21.15.175:0/49625072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553da60a0 0x55e553da6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 --2- 172.21.15.175:0/49625072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553df02f0 0x55e553da5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 --2- 172.21.15.175:0/49625072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553def9d0 0x55e553defdb0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 -- 172.21.15.175:0/49625072 >> 172.21.15.175:0/49625072 conn(0x55e553da2020 msgr2=0x55e553da4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:03.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 -- 172.21.15.175:0/49625072 shutdown_connections 2024-04-25T09:12:03.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 -- 172.21.15.175:0/49625072 wait complete. 2024-04-25T09:12:03.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 -- start start 2024-04-25T09:12:03.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 Processor -- start 2024-04-25T09:12:03.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553da60a0 0x55e553dd47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553def9d0 0x55e553dd4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553df02f0 0x55e553dd5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e553bb7250 con 0x55e553df02f0 2024-04-25T09:12:03.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e553bad690 con 0x55e553da60a0 2024-04-25T09:12:03.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e553b7ba40 con 0x55e553def9d0 2024-04-25T09:12:03.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 10 client.0 _ll_register_callbacks cb 0x55e553d90e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:03.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda49a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553df02f0 0x55e553dd5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda49a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553df02f0 0x55e553dd5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50166/0 (socket says 172.21.15.175:50166) 2024-04-25T09:12:03.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda49a00640 1 -- 172.21.15.175:0/4164050709 learned_addr learned my addr 172.21.15.175:0/4164050709 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:03.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda43e00640 1 --2- 172.21.15.175:0/4164050709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553def9d0 0x55e553dd4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda49000640 1 --2- 172.21.15.175:0/4164050709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553da60a0 0x55e553dd47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda49a00640 1 -- 172.21.15.175:0/4164050709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553def9d0 msgr2=0x55e553dd4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:03.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda49a00640 1 --2- 172.21.15.175:0/4164050709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553def9d0 0x55e553dd4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda49a00640 1 -- 172.21.15.175:0/4164050709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553da60a0 msgr2=0x55e553dd47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:03.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda49a00640 1 --2- 172.21.15.175:0/4164050709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553da60a0 0x55e553dd47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda49a00640 1 -- 172.21.15.175:0/4164050709 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e553ca01c0 con 0x55e553df02f0 2024-04-25T09:12:03.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda49a00640 1 --2- 172.21.15.175:0/4164050709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553df02f0 0x55e553dd5270 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fda4406f360 tx=0x7fda3c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffda00c0838122d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda2e000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:12:03.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda2e000640 1 -- 172.21.15.175:0/4164050709 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c01b030 con 0x55e553df02f0 2024-04-25T09:12:03.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda2e000640 1 -- 172.21.15.175:0/4164050709 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fda3c017470 con 0x55e553df02f0 2024-04-25T09:12:03.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 -- 172.21.15.175:0/4164050709 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda34005890 con 0x55e553df02f0 2024-04-25T09:12:03.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda2e000640 1 -- 172.21.15.175:0/4164050709 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda3c027050 con 0x55e553df02f0 2024-04-25T09:12:03.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 10 client.7839 fetch_fsmap learned FSMap version 71 2024-04-25T09:12:03.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 1 -- 172.21.15.175:0/4164050709 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x55e553c9c170 con 0x55e553df02f0 2024-04-25T09:12:03.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda2e000640 1 -- 172.21.15.175:0/4164050709 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda34005890 con 0x55e553df02f0 2024-04-25T09:12:03.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda2e000640 1 -- 172.21.15.175:0/4164050709 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 71) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fda3c02a020 con 0x55e553df02f0 2024-04-25T09:12:03.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 10 client.7839 fetch_fsmap finished waiting for FSMap version 71 2024-04-25T09:12:03.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 10 client.7839 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:12:03.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.901+0000 7fda4efaa000 20 client.7839 populate_metadata read hostname 'smithi175' 2024-04-25T09:12:03.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda4efaa000 1 --2- 172.21.15.175:0/4164050709 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55e553dffc80 0x55e553e02070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda4efaa000 4 client.7839 mds_command: new command op to 7303 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:12:03.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda4efaa000 1 -- 172.21.15.175:0/4164050709 --> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e553b8ec60 con 0x55e553dffc80 2024-04-25T09:12:03.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda49000640 1 --2- 172.21.15.175:0/4164050709 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55e553dffc80 0x55e553e02070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda49000640 1 --2- 172.21.15.175:0/4164050709 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55e553dffc80 0x55e553e02070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a275da3144cccc7 server_cookie=d95818d9e8322c72 in_seq=0 out_seq=0 2024-04-25T09:12:03.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda2e000640 10 client.7839 ms_handle_connect on v2:172.21.15.175:6835/279367590 2024-04-25T09:12:03.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda2e000640 1 -- 172.21.15.175:0/4164050709 <== mds.0 v2:172.21.15.175:6835/279367590 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e553b8ec60 con 0x55e553dffc80 2024-04-25T09:12:03.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda2e000640 10 client.7839 handle_command_reply: tid=0 2024-04-25T09:12:03.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda4efaa000 1 client.7839 shutdown 2024-04-25T09:12:03.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda4efaa000 1 -- 172.21.15.175:0/4164050709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553df02f0 msgr2=0x55e553dd5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda4efaa000 1 --2- 172.21.15.175:0/4164050709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553df02f0 0x55e553dd5270 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fda4406f360 tx=0x7fda3c009f90 comp rx=0 tx=0).stop 2024-04-25T09:12:03.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda4efaa000 1 -- 172.21.15.175:0/4164050709 shutdown_connections 2024-04-25T09:12:03.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda4efaa000 1 --2- 172.21.15.175:0/4164050709 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55e553dffc80 0x55e553e02070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda4efaa000 1 --2- 172.21.15.175:0/4164050709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553df02f0 0x55e553dd5270 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda4efaa000 1 --2- 172.21.15.175:0/4164050709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553def9d0 0x55e553dd4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda4efaa000 1 --2- 172.21.15.175:0/4164050709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553da60a0 0x55e553dd47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda2e000640 0 client.7839 ms_handle_reset on v2:172.21.15.175:6835/279367590 2024-04-25T09:12:03.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda4efaa000 1 -- 172.21.15.175:0/4164050709 >> 172.21.15.175:0/4164050709 conn(0x55e553da2020 msgr2=0x55e553da4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:03.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda4efaa000 1 -- 172.21.15.175:0/4164050709 shutdown_connections 2024-04-25T09:12:03.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda4efaa000 1 -- 172.21.15.175:0/4164050709 wait complete. 2024-04-25T09:12:03.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.905+0000 7fda4efaa000 20 client.7839 trim_cache size 0 max 16384 2024-04-25T09:12:03.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda4efaa000 1 Processor -- start 2024-04-25T09:12:03.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda4efaa000 1 -- start start 2024-04-25T09:12:03.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda4efaa000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553da60a0 0x55e553da4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda4efaa000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553def9d0 0x55e553da4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda4efaa000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553df02f0 0x55e553da4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda4efaa000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda44201d50 con 0x55e553def9d0 2024-04-25T09:12:03.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda4efaa000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda44200f80 con 0x55e553df02f0 2024-04-25T09:12:03.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda4efaa000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4413ce30 con 0x55e553da60a0 2024-04-25T09:12:03.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda43e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553def9d0 0x55e553da4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda43e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553def9d0 0x55e553da4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50182/0 (socket says 172.21.15.175:50182) 2024-04-25T09:12:03.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda43e00640 1 -- 172.21.15.175:0/689695073 learned_addr learned my addr 172.21.15.175:0/689695073 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:03.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda49000640 1 --2- 172.21.15.175:0/689695073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553da60a0 0x55e553da4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda49a00640 1 --2- 172.21.15.175:0/689695073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553df02f0 0x55e553da4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda43e00640 1 -- 172.21.15.175:0/689695073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553da60a0 msgr2=0x55e553da4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:03.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda43e00640 1 --2- 172.21.15.175:0/689695073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553da60a0 0x55e553da4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda43e00640 1 -- 172.21.15.175:0/689695073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553df02f0 msgr2=0x55e553da4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:03.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda43e00640 1 --2- 172.21.15.175:0/689695073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553df02f0 0x55e553da4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda43e00640 1 -- 172.21.15.175:0/689695073 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e553c39de0 con 0x55e553def9d0 2024-04-25T09:12:03.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda43e00640 1 --2- 172.21.15.175:0/689695073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553def9d0 0x55e553da4950 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fda30001750 tx=0x7fda30007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9928ecf839ec34 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda38c00640 1 -- 172.21.15.175:0/689695073 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda300f3a30 con 0x55e553def9d0 2024-04-25T09:12:03.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda38c00640 1 -- 172.21.15.175:0/689695073 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3011b070 con 0x55e553def9d0 2024-04-25T09:12:03.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda38c00640 1 -- 172.21.15.175:0/689695073 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda300f7ff0 con 0x55e553def9d0 2024-04-25T09:12:03.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda4efaa000 1 -- 172.21.15.175:0/689695073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553def9d0 msgr2=0x55e553da4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda4efaa000 1 --2- 172.21.15.175:0/689695073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553def9d0 0x55e553da4950 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fda30001750 tx=0x7fda30007720 comp rx=0 tx=0).stop 2024-04-25T09:12:03.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda4efaa000 1 -- 172.21.15.175:0/689695073 shutdown_connections 2024-04-25T09:12:03.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda4efaa000 1 --2- 172.21.15.175:0/689695073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553df02f0 0x55e553da4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda4efaa000 1 --2- 172.21.15.175:0/689695073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553def9d0 0x55e553da4950 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda4efaa000 1 --2- 172.21.15.175:0/689695073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553da60a0 0x55e553da4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda4efaa000 1 -- 172.21.15.175:0/689695073 >> 172.21.15.175:0/689695073 conn(0x55e553da2020 msgr2=0x55e553dee0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:03.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda4efaa000 1 -- 172.21.15.175:0/689695073 shutdown_connections 2024-04-25T09:12:03.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda4efaa000 1 -- 172.21.15.175:0/689695073 wait complete. 2024-04-25T09:12:03.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.921+0000 7fda4efaa000 1 -- start start 2024-04-25T09:12:03.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 1 Processor -- start 2024-04-25T09:12:03.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553da60a0 0x55e553e02380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553def9d0 0x55e553e028c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553df02f0 0x55e553e02e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e553b8de00 con 0x55e553df02f0 2024-04-25T09:12:03.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda44200980 con 0x55e553da60a0 2024-04-25T09:12:03.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e553bf2300 con 0x55e553def9d0 2024-04-25T09:12:03.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 10 client.0 _ll_register_callbacks cb 0x55e553d71040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:03.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda49a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553df02f0 0x55e553e02e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda43e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553def9d0 0x55e553e028c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda49a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553df02f0 0x55e553e02e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50184/0 (socket says 172.21.15.175:50184) 2024-04-25T09:12:03.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda49a00640 1 -- 172.21.15.175:0/3304619607 learned_addr learned my addr 172.21.15.175:0/3304619607 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:03.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda49000640 1 --2- 172.21.15.175:0/3304619607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553da60a0 0x55e553e02380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda49a00640 1 -- 172.21.15.175:0/3304619607 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553def9d0 msgr2=0x55e553e028c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:03.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda49a00640 1 --2- 172.21.15.175:0/3304619607 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553def9d0 0x55e553e028c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda49a00640 1 -- 172.21.15.175:0/3304619607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553da60a0 msgr2=0x55e553e02380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:03.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda49a00640 1 --2- 172.21.15.175:0/3304619607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553da60a0 0x55e553e02380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda49a00640 1 -- 172.21.15.175:0/3304619607 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e553b948e0 con 0x55e553df02f0 2024-04-25T09:12:03.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda49a00640 1 --2- 172.21.15.175:0/3304619607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553df02f0 0x55e553e02e00 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fda3c009570 tx=0x7fda3c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f567fba4a5d7b8e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda2e000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:12:03.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda2e000640 1 -- 172.21.15.175:0/3304619607 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c01b040 con 0x55e553df02f0 2024-04-25T09:12:03.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda2e000640 1 -- 172.21.15.175:0/3304619607 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fda3c017470 con 0x55e553df02f0 2024-04-25T09:12:03.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 1 -- 172.21.15.175:0/3304619607 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda3011b070 con 0x55e553df02f0 2024-04-25T09:12:03.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda2e000640 1 -- 172.21.15.175:0/3304619607 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda3c039050 con 0x55e553df02f0 2024-04-25T09:12:03.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 10 client.7845 fetch_fsmap learned FSMap version 71 2024-04-25T09:12:03.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 1 -- 172.21.15.175:0/3304619607 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x55e553c4c8f0 con 0x55e553df02f0 2024-04-25T09:12:03.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda2e000640 1 -- 172.21.15.175:0/3304619607 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3011b070 con 0x55e553df02f0 2024-04-25T09:12:03.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda2e000640 1 -- 172.21.15.175:0/3304619607 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 71) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fda3c03c020 con 0x55e553df02f0 2024-04-25T09:12:03.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 10 client.7845 fetch_fsmap finished waiting for FSMap version 71 2024-04-25T09:12:03.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 10 client.7845 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T09:12:03.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 20 client.7845 populate_metadata read hostname 'smithi175' 2024-04-25T09:12:03.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 1 --2- 172.21.15.175:0/3304619607 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55e553e037c0 0x55e553e57f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 4 client.7845 mds_command: new command op to 7303 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:12:03.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 1 -- 172.21.15.175:0/3304619607 --> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e553c00530 con 0x55e553e037c0 2024-04-25T09:12:03.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda49000640 1 --2- 172.21.15.175:0/3304619607 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55e553e037c0 0x55e553e57f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda49000640 1 --2- 172.21.15.175:0/3304619607 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55e553e037c0 0x55e553e57f60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a497baf7388b266b server_cookie=f805dd1a31da49b5 in_seq=0 out_seq=0 2024-04-25T09:12:03.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda2e000640 10 client.7845 ms_handle_connect on v2:172.21.15.175:6835/279367590 2024-04-25T09:12:03.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda2e000640 1 -- 172.21.15.175:0/3304619607 <== mds.0 v2:172.21.15.175:6835/279367590 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e553c00530 con 0x55e553e037c0 2024-04-25T09:12:03.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda2e000640 10 client.7845 handle_command_reply: tid=0 2024-04-25T09:12:03.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 1 client.7845 shutdown 2024-04-25T09:12:03.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 1 -- 172.21.15.175:0/3304619607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553df02f0 msgr2=0x55e553e02e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.925+0000 7fda4efaa000 1 --2- 172.21.15.175:0/3304619607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553df02f0 0x55e553e02e00 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fda3c009570 tx=0x7fda3c004740 comp rx=0 tx=0).stop 2024-04-25T09:12:03.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4efaa000 1 -- 172.21.15.175:0/3304619607 shutdown_connections 2024-04-25T09:12:03.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4efaa000 1 --2- 172.21.15.175:0/3304619607 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55e553e037c0 0x55e553e57f60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4efaa000 1 --2- 172.21.15.175:0/3304619607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e553df02f0 0x55e553e02e00 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4efaa000 1 --2- 172.21.15.175:0/3304619607 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e553def9d0 0x55e553e028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda2e000640 0 client.7845 ms_handle_reset on v2:172.21.15.175:6835/279367590 2024-04-25T09:12:03.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4efaa000 1 --2- 172.21.15.175:0/3304619607 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e553da60a0 0x55e553e02380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4efaa000 1 -- 172.21.15.175:0/3304619607 >> 172.21.15.175:0/3304619607 conn(0x55e553da2020 msgr2=0x55e553dee960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:03.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4efaa000 1 -- 172.21.15.175:0/3304619607 shutdown_connections 2024-04-25T09:12:03.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4efaa000 1 -- 172.21.15.175:0/3304619607 wait complete. 2024-04-25T09:12:03.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4efaa000 20 client.7845 trim_cache size 0 max 16384 2024-04-25T09:12:03.920 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:12:03.921 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "no active scrubs running", 2024-04-25T09:12:03.921 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": {} 2024-04-25T09:12:03.921 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:12:03.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4ba00640 1 -- 172.21.15.175:0/1409097616 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fda24066f90 msgr2=0x7fda24069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4ba00640 1 --2- 172.21.15.175:0/1409097616 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fda24066f90 0x7fda24069450 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fda340013a0 tx=0x7fda34009040 comp rx=0 tx=0).stop 2024-04-25T09:12:03.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4ba00640 1 -- 172.21.15.175:0/1409097616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda4415d760 msgr2=0x7fda4415dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4ba00640 1 --2- 172.21.15.175:0/1409097616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda4415d760 0x7fda4415dbe0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fda30005040 tx=0x7fda28005840 comp rx=0 tx=0).stop 2024-04-25T09:12:03.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4ba00640 1 -- 172.21.15.175:0/1409097616 shutdown_connections 2024-04-25T09:12:03.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4ba00640 1 --2- 172.21.15.175:0/1409097616 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fda24066f90 0x7fda24069450 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4ba00640 1 --2- 172.21.15.175:0/1409097616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda44140260 0x7fda441406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4ba00640 1 --2- 172.21.15.175:0/1409097616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda4415d760 0x7fda4415dbe0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4ba00640 1 --2- 172.21.15.175:0/1409097616 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda28004810 0x7fda441593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4ba00640 1 -- 172.21.15.175:0/1409097616 >> 172.21.15.175:0/1409097616 conn(0x7fda4406ac50 msgr2=0x7fda440ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:03.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4ba00640 1 -- 172.21.15.175:0/1409097616 shutdown_connections 2024-04-25T09:12:03.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:03.929+0000 7fda4ba00640 1 -- 172.21.15.175:0/1409097616 wait complete. 2024-04-25T09:12:03.935 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:12:03.935 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:04.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.081+0000 7f85eee00640 1 Processor -- start 2024-04-25T09:12:04.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.085+0000 7f85eee00640 1 -- start start 2024-04-25T09:12:04.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.085+0000 7f85eee00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f85e806cc50 0x7f85e80cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.085+0000 7f85eee00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e80cfcb0 con 0x7f85e8099a50 2024-04-25T09:12:04.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.085+0000 7f85eee00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e80cff90 con 0x7f85e806bd60 2024-04-25T09:12:04.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.085+0000 7f85eee00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e80d1460 con 0x7f85e806cc50 2024-04-25T09:12:04.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.085+0000 7f85ece00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f85e806cc50 0x7f85e80cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.085+0000 7f85e7e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f85e8099a50 0x7f85e8099e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:41374/0 (socket says 172.21.15.175:41374) 2024-04-25T09:12:04.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.085+0000 7f85e7e00640 1 -- 172.21.15.175:0/1992520947 learned_addr learned my addr 172.21.15.175:0/1992520947 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:04.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.085+0000 7f85ece00640 1 -- 172.21.15.175:0/1992520947 >> v1:172.21.15.177:6789/0 conn(0x7f85e806bd60 legacy=0x7f85e80d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.085+0000 7f85ece00640 1 -- 172.21.15.175:0/1992520947 >> v1:172.21.15.175:6789/0 conn(0x7f85e8099a50 legacy=0x7f85e8099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.085+0000 7f85ece00640 1 -- 172.21.15.175:0/1992520947 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e80d0270 con 0x7f85e806cc50 2024-04-25T09:12:04.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.089+0000 7f85ece00640 1 --2- 172.21.15.175:0/1992520947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85e806cc50 0x7f85e80cbe60 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009d90 tx=0x7f85e001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fe50b2a6cee6957 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.089+0000 7f85e6a00640 1 -- 172.21.15.175:0/1992520947 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00b2070 con 0x7f85e806cc50 2024-04-25T09:12:04.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.089+0000 7f85e6a00640 1 -- 172.21.15.175:0/1992520947 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e00a5920 con 0x7f85e806cc50 2024-04-25T09:12:04.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.089+0000 7f85e6a00640 1 -- 172.21.15.175:0/1992520947 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00a5cf0 con 0x7f85e806cc50 2024-04-25T09:12:04.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.089+0000 7f85eee00640 1 -- 172.21.15.175:0/1992520947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85e806cc50 msgr2=0x7f85e80cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.089+0000 7f85eee00640 1 --2- 172.21.15.175:0/1992520947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85e806cc50 0x7f85e80cbe60 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009d90 tx=0x7f85e001c970 comp rx=0 tx=0).stop 2024-04-25T09:12:04.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.089+0000 7f85eee00640 1 -- 172.21.15.175:0/1992520947 shutdown_connections 2024-04-25T09:12:04.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.089+0000 7f85eee00640 1 --2- 172.21.15.175:0/1992520947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85e806cc50 0x7f85e80cbe60 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.089+0000 7f85eee00640 1 -- 172.21.15.175:0/1992520947 >> 172.21.15.175:0/1992520947 conn(0x7f85e80b3300 msgr2=0x7f85e80b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.089+0000 7f85eee00640 1 -- 172.21.15.175:0/1992520947 shutdown_connections 2024-04-25T09:12:04.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.089+0000 7f85eee00640 1 -- 172.21.15.175:0/1992520947 wait complete. 2024-04-25T09:12:04.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.089+0000 7f85eee00640 1 Processor -- start 2024-04-25T09:12:04.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.089+0000 7f85eee00640 1 -- start start 2024-04-25T09:12:04.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85eee00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e806bd60 0x7f85e80707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85eee00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85e806cc50 0x7f85e815b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85eee00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85e8099a50 0x7f85e815bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85eee00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80cc7b0 con 0x7f85e8099a50 2024-04-25T09:12:04.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85eee00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e806d060 con 0x7f85e806bd60 2024-04-25T09:12:04.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85eee00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80cc930 con 0x7f85e806cc50 2024-04-25T09:12:04.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85ece00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85e8099a50 0x7f85e815bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85ece00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85e8099a50 0x7f85e815bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50206/0 (socket says 172.21.15.175:50206) 2024-04-25T09:12:04.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85ece00640 1 -- 172.21.15.175:0/1199648004 learned_addr learned my addr 172.21.15.175:0/1199648004 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:04.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85e7e00640 1 --2- 172.21.15.175:0/1199648004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e806bd60 0x7f85e80707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85e7400640 1 --2- 172.21.15.175:0/1199648004 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85e806cc50 0x7f85e815b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85ece00640 1 -- 172.21.15.175:0/1199648004 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85e806cc50 msgr2=0x7f85e815b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85ece00640 1 --2- 172.21.15.175:0/1199648004 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85e806cc50 0x7f85e815b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85ece00640 1 -- 172.21.15.175:0/1199648004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e806bd60 msgr2=0x7f85e80707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85ece00640 1 --2- 172.21.15.175:0/1199648004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e806bd60 0x7f85e80707c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85ece00640 1 -- 172.21.15.175:0/1199648004 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e815c420 con 0x7f85e8099a50 2024-04-25T09:12:04.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85ece00640 1 --2- 172.21.15.175:0/1199648004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85e8099a50 0x7f85e815bdf0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f85e001a5a0 tx=0x7f85e0019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85dfe00640 1 -- 172.21.15.175:0/1199648004 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00b2050 con 0x7f85e8099a50 2024-04-25T09:12:04.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85dfe00640 1 -- 172.21.15.175:0/1199648004 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e00be070 con 0x7f85e8099a50 2024-04-25T09:12:04.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85dfe00640 1 -- 172.21.15.175:0/1199648004 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00adad0 con 0x7f85e8099a50 2024-04-25T09:12:04.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85eee00640 1 -- 172.21.15.175:0/1199648004 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e815c700 con 0x7f85e8099a50 2024-04-25T09:12:04.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85eee00640 1 -- 172.21.15.175:0/1199648004 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e815ccc0 con 0x7f85e8099a50 2024-04-25T09:12:04.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.093+0000 7f85eee00640 1 -- 172.21.15.175:0/1199648004 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e8074a60 con 0x7f85e8099a50 2024-04-25T09:12:04.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.097+0000 7f85dfe00640 1 -- 172.21.15.175:0/1199648004 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f85e00adc70 con 0x7f85e8099a50 2024-04-25T09:12:04.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.097+0000 7f85dfe00640 1 --2- 172.21.15.175:0/1199648004 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f85c8066f60 0x7f85c8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.097+0000 7f85dfe00640 1 -- 172.21.15.175:0/1199648004 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f85e0120460 con 0x7f85e8099a50 2024-04-25T09:12:04.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.097+0000 7f85e7e00640 1 --2- 172.21.15.175:0/1199648004 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f85c8066f60 0x7f85c8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.097+0000 7f85e7e00640 1 --2- 172.21.15.175:0/1199648004 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f85c8066f60 0x7f85c8069420 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f85d8005890 tx=0x7f85d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.101+0000 7f85dfe00640 1 -- 172.21.15.175:0/1199648004 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f85e0016560 con 0x7f85e8099a50 2024-04-25T09:12:04.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.285+0000 7f85eee00640 1 -- 172.21.15.175:0/1199648004 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85e80b0810 con 0x7f85e8099a50 2024-04-25T09:12:04.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.285+0000 7f85dfe00640 1 -- 172.21.15.175:0/1199648004 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f85e00f1310 con 0x7f85e8099a50 2024-04-25T09:12:04.274 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:04.274 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":71,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3229536012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3229536012},{"type":"v1","addr":"172.21.15.177:6834","nonce":3229536012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/222649735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":222649735},{"type":"v1","addr":"172.21.15.177:6835","nonce":222649735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2888989442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2888989442},{"type":"v1","addr":"172.21.15.175:6836","nonce":2888989442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:03.786939+0000","modified":"2024-04-25T09:11:29.735549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7303":{"gid":7303,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6837/279367590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":279367590},{"type":"v1","addr":"172.21.15.175:6837","nonce":279367590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:12:04.274 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 71 2024-04-25T09:12:04.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.289+0000 7f85eee00640 1 -- 172.21.15.175:0/1199648004 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f85c8066f60 msgr2=0x7f85c8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.289+0000 7f85eee00640 1 --2- 172.21.15.175:0/1199648004 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f85c8066f60 0x7f85c8069420 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f85d8005890 tx=0x7f85d8009040 comp rx=0 tx=0).stop 2024-04-25T09:12:04.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.289+0000 7f85eee00640 1 -- 172.21.15.175:0/1199648004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85e8099a50 msgr2=0x7f85e815bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.289+0000 7f85eee00640 1 --2- 172.21.15.175:0/1199648004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85e8099a50 0x7f85e815bdf0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f85e001a5a0 tx=0x7f85e0019710 comp rx=0 tx=0).stop 2024-04-25T09:12:04.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.289+0000 7f85eee00640 1 -- 172.21.15.175:0/1199648004 shutdown_connections 2024-04-25T09:12:04.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.289+0000 7f85eee00640 1 --2- 172.21.15.175:0/1199648004 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f85c8066f60 0x7f85c8069420 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.289+0000 7f85eee00640 1 --2- 172.21.15.175:0/1199648004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85e8099a50 0x7f85e815bdf0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.289+0000 7f85eee00640 1 --2- 172.21.15.175:0/1199648004 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85e806cc50 0x7f85e815b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.289+0000 7f85eee00640 1 --2- 172.21.15.175:0/1199648004 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85e806bd60 0x7f85e80707c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.289+0000 7f85eee00640 1 -- 172.21.15.175:0/1199648004 >> 172.21.15.175:0/1199648004 conn(0x7f85e80b3300 msgr2=0x7f85e80741d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.289+0000 7f85eee00640 1 -- 172.21.15.175:0/1199648004 shutdown_connections 2024-04-25T09:12:04.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.289+0000 7f85eee00640 1 -- 172.21.15.175:0/1199648004 wait complete. 2024-04-25T09:12:04.295 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-25T09:12:04.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.445+0000 7f0c65600640 1 Processor -- start 2024-04-25T09:12:04.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.449+0000 7f0c65600640 1 -- start start 2024-04-25T09:12:04.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.449+0000 7f0c65600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c6015b810 0x7f0c6015bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.449+0000 7f0c65600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6015c330 con 0x7f0c6006ac50 2024-04-25T09:12:04.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.449+0000 7f0c65600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6015c610 con 0x7f0c600cc310 2024-04-25T09:12:04.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.449+0000 7f0c65600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6015cf40 con 0x7f0c6015b810 2024-04-25T09:12:04.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.449+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c6015b810 0x7f0c6015bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.449+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c6015b810 0x7f0c6015bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:55504/0 (socket says 172.21.15.175:55504) 2024-04-25T09:12:04.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.449+0000 7f0c5fe00640 1 -- 172.21.15.175:0/3121452405 learned_addr learned my addr 172.21.15.175:0/3121452405 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:04.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.449+0000 7f0c5f400640 1 --1- 172.21.15.175:0/3121452405 >> v1:172.21.15.177:6789/0 conn(0x7f0c600cc310 0x7f0c600d0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:50056/0 (socket says 172.21.15.175:50056) 2024-04-25T09:12:04.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.449+0000 7f0c5ea00640 1 -- 172.21.15.175:0/3121452405 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3070630744 0 0) 0x7f0c6015c330 con 0x7f0c6006ac50 2024-04-25T09:12:04.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.449+0000 7f0c5fe00640 1 -- 172.21.15.175:0/3121452405 >> v1:172.21.15.177:6789/0 conn(0x7f0c600cc310 legacy=0x7f0c600d0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.449+0000 7f0c5fe00640 1 -- 172.21.15.175:0/3121452405 >> v1:172.21.15.175:6789/0 conn(0x7f0c6006ac50 legacy=0x7f0c600ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.449+0000 7f0c5fe00640 1 -- 172.21.15.175:0/3121452405 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6015c8f0 con 0x7f0c6015b810 2024-04-25T09:12:04.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.453+0000 7f0c5fe00640 1 --2- 172.21.15.175:0/3121452405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c6015b810 0x7f0c6015bbf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0c6015d0c0 tx=0x7f0c5001c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30f0954141ec5eef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.453+0000 7f0c5ea00640 1 -- 172.21.15.175:0/3121452405 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c500b0070 con 0x7f0c6015b810 2024-04-25T09:12:04.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.453+0000 7f0c5ea00640 1 -- 172.21.15.175:0/3121452405 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c500ab600 con 0x7f0c6015b810 2024-04-25T09:12:04.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.453+0000 7f0c5ea00640 1 -- 172.21.15.175:0/3121452405 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c500ab9d0 con 0x7f0c6015b810 2024-04-25T09:12:04.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.453+0000 7f0c65600640 1 -- 172.21.15.175:0/3121452405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c6015b810 msgr2=0x7f0c6015bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.453+0000 7f0c65600640 1 --2- 172.21.15.175:0/3121452405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c6015b810 0x7f0c6015bbf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0c6015d0c0 tx=0x7f0c5001c320 comp rx=0 tx=0).stop 2024-04-25T09:12:04.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.453+0000 7f0c65600640 1 -- 172.21.15.175:0/3121452405 shutdown_connections 2024-04-25T09:12:04.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.453+0000 7f0c65600640 1 --2- 172.21.15.175:0/3121452405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c6015b810 0x7f0c6015bbf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.453+0000 7f0c65600640 1 -- 172.21.15.175:0/3121452405 >> 172.21.15.175:0/3121452405 conn(0x7f0c60099a50 msgr2=0x7f0c600d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.453+0000 7f0c65600640 1 -- 172.21.15.175:0/3121452405 shutdown_connections 2024-04-25T09:12:04.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.453+0000 7f0c65600640 1 -- 172.21.15.175:0/3121452405 wait complete. 2024-04-25T09:12:04.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c65600640 1 Processor -- start 2024-04-25T09:12:04.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c65600640 1 -- start start 2024-04-25T09:12:04.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c65600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c6006ac50 0x7f0c600ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c65600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c600cc310 0x7f0c6015ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c65600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c6015b810 0x7f0c60149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c65600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600cc8b0 con 0x7f0c6006ac50 2024-04-25T09:12:04.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c65600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600cc730 con 0x7f0c6015b810 2024-04-25T09:12:04.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c65600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600cefd0 con 0x7f0c600cc310 2024-04-25T09:12:04.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c6006ac50 0x7f0c600ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c6006ac50 0x7f0c600ae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50208/0 (socket says 172.21.15.175:50208) 2024-04-25T09:12:04.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c5fe00640 1 -- 172.21.15.175:0/710646324 learned_addr learned my addr 172.21.15.175:0/710646324 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:04.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c5f400640 1 --2- 172.21.15.175:0/710646324 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c600cc310 0x7f0c6015ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c64c00640 1 --2- 172.21.15.175:0/710646324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c6015b810 0x7f0c60149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c5fe00640 1 -- 172.21.15.175:0/710646324 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c600cc310 msgr2=0x7f0c6015ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c5fe00640 1 --2- 172.21.15.175:0/710646324 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c600cc310 0x7f0c6015ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c5fe00640 1 -- 172.21.15.175:0/710646324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c6015b810 msgr2=0x7f0c60149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c5fe00640 1 --2- 172.21.15.175:0/710646324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c6015b810 0x7f0c60149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c5fe00640 1 -- 172.21.15.175:0/710646324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c60149fd0 con 0x7f0c6006ac50 2024-04-25T09:12:04.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c5f400640 1 --2- 172.21.15.175:0/710646324 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c600cc310 0x7f0c6015ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:04.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c64c00640 1 --2- 172.21.15.175:0/710646324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c6015b810 0x7f0c60149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:04.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c5fe00640 1 --2- 172.21.15.175:0/710646324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c6006ac50 0x7f0c600ae8f0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f0c500ae040 tx=0x7f0c5001ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c57e00640 1 -- 172.21.15.175:0/710646324 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c500ba020 con 0x7f0c6006ac50 2024-04-25T09:12:04.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c57e00640 1 -- 172.21.15.175:0/710646324 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c500b6640 con 0x7f0c6006ac50 2024-04-25T09:12:04.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c57e00640 1 -- 172.21.15.175:0/710646324 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c500b0040 con 0x7f0c6006ac50 2024-04-25T09:12:04.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c65600640 1 -- 172.21.15.175:0/710646324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c600ad850 con 0x7f0c6006ac50 2024-04-25T09:12:04.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.457+0000 7f0c65600640 1 -- 172.21.15.175:0/710646324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c600ade10 con 0x7f0c6006ac50 2024-04-25T09:12:04.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c57e00640 1 -- 172.21.15.175:0/710646324 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0c500bd020 con 0x7f0c6006ac50 2024-04-25T09:12:04.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c57e00640 1 --2- 172.21.15.175:0/710646324 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0c40066f90 0x7f0c40069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c57e00640 1 -- 172.21.15.175:0/710646324 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f0c5011f460 con 0x7f0c6006ac50 2024-04-25T09:12:04.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c5f400640 1 --2- 172.21.15.175:0/710646324 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0c40066f90 0x7f0c40069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c69fc4000 1 Processor -- start 2024-04-25T09:12:04.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c69fc4000 1 -- start start 2024-04-25T09:12:04.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c5f400640 1 --2- 172.21.15.175:0/710646324 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0c40066f90 0x7f0c40069450 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0c600b30d0 tx=0x7f0c4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c69fc4000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c3697c42e0 0x55c3697c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c69fc4000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c3697c4c00 0x55c36977a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c69fc4000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c36977a8e0 0x55c36977acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c69fc4000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c369661ba0 con 0x55c36977a8e0 2024-04-25T09:12:04.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c69fc4000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3695c7090 con 0x55c3697c4c00 2024-04-25T09:12:04.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c69fc4000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c36954f160 con 0x55c3697c42e0 2024-04-25T09:12:04.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c64c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c36977a8e0 0x55c36977acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c3697c42e0 0x55c3697c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c64c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c36977a8e0 0x55c36977acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50220/0 (socket says 172.21.15.175:50220) 2024-04-25T09:12:04.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c64c00640 1 -- 172.21.15.175:0/2951042771 learned_addr learned my addr 172.21.15.175:0/2951042771 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:04.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c5f400640 1 --2- 172.21.15.175:0/2951042771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c3697c4c00 0x55c36977a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c64c00640 1 -- 172.21.15.175:0/2951042771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c3697c42e0 msgr2=0x55c3697c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:04.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c64c00640 1 --2- 172.21.15.175:0/2951042771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c3697c42e0 0x55c3697c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c64c00640 1 -- 172.21.15.175:0/2951042771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c3697c4c00 msgr2=0x55c36977a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:04.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c64c00640 1 --2- 172.21.15.175:0/2951042771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c3697c4c00 0x55c36977a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c64c00640 1 -- 172.21.15.175:0/2951042771 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c369670c20 con 0x55c36977a8e0 2024-04-25T09:12:04.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c5fe00640 1 --2- 172.21.15.175:0/2951042771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c3697c42e0 0x55c3697c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:04.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.461+0000 7f0c64c00640 1 --2- 172.21.15.175:0/2951042771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c36977a8e0 0x55c36977acc0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f0c58001db0 tx=0x7f0c5800d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52244292cc8dd259 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c54c00640 1 -- 172.21.15.175:0/2951042771 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58018070 con 0x55c36977a8e0 2024-04-25T09:12:04.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c54c00640 1 -- 172.21.15.175:0/2951042771 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c58003db0 con 0x55c36977a8e0 2024-04-25T09:12:04.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c54c00640 1 -- 172.21.15.175:0/2951042771 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58006d60 con 0x55c36977a8e0 2024-04-25T09:12:04.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c69fc4000 1 -- 172.21.15.175:0/2951042771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c36977a8e0 msgr2=0x55c36977acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/2951042771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c36977a8e0 0x55c36977acc0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f0c58001db0 tx=0x7f0c5800d150 comp rx=0 tx=0).stop 2024-04-25T09:12:04.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c69fc4000 1 -- 172.21.15.175:0/2951042771 shutdown_connections 2024-04-25T09:12:04.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/2951042771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c36977a8e0 0x55c36977acc0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/2951042771 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c3697c4c00 0x55c36977a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/2951042771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c3697c42e0 0x55c3697c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c69fc4000 1 -- 172.21.15.175:0/2951042771 >> 172.21.15.175:0/2951042771 conn(0x55c369776890 msgr2=0x55c369778c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c69fc4000 1 -- 172.21.15.175:0/2951042771 shutdown_connections 2024-04-25T09:12:04.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c69fc4000 1 -- 172.21.15.175:0/2951042771 wait complete. 2024-04-25T09:12:04.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c69fc4000 1 -- start start 2024-04-25T09:12:04.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c69fc4000 1 Processor -- start 2024-04-25T09:12:04.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c69fc4000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c36977a8e0 0x55c369785480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c69fc4000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3697c42e0 0x55c3697859c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c69fc4000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c3697c4c00 0x55c369785f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c69fc4000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3695c3130 con 0x55c3697c42e0 2024-04-25T09:12:04.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c69fc4000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c36958b130 con 0x55c36977a8e0 2024-04-25T09:12:04.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c69fc4000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c369685300 con 0x55c3697c4c00 2024-04-25T09:12:04.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c69fc4000 10 client.0 _ll_register_callbacks cb 0x55c369765bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:04.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c5f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3697c42e0 0x55c3697859c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c5f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3697c42e0 0x55c3697859c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50222/0 (socket says 172.21.15.175:50222) 2024-04-25T09:12:04.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c5f400640 1 -- 172.21.15.175:0/973013721 learned_addr learned my addr 172.21.15.175:0/973013721 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:04.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c5fe00640 1 --2- 172.21.15.175:0/973013721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c36977a8e0 0x55c369785480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c64c00640 1 --2- 172.21.15.175:0/973013721 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c3697c4c00 0x55c369785f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c5f400640 1 -- 172.21.15.175:0/973013721 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c3697c4c00 msgr2=0x55c369785f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:04.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c5f400640 1 --2- 172.21.15.175:0/973013721 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c3697c4c00 0x55c369785f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c5f400640 1 -- 172.21.15.175:0/973013721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c36977a8e0 msgr2=0x55c369785480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:04.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c5f400640 1 --2- 172.21.15.175:0/973013721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c36977a8e0 0x55c369785480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c5f400640 1 -- 172.21.15.175:0/973013721 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c3695a4060 con 0x55c3697c42e0 2024-04-25T09:12:04.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c5fe00640 1 --2- 172.21.15.175:0/973013721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c36977a8e0 0x55c369785480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:04.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c64c00640 1 --2- 172.21.15.175:0/973013721 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c3697c4c00 0x55c369785f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:04.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c5f400640 1 --2- 172.21.15.175:0/973013721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3697c42e0 0x55c3697859c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f0c6009e6e0 tx=0x7f0c4c001220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282ca6e8f65226dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c49600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:12:04.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c49600640 1 -- 172.21.15.175:0/973013721 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c027060 con 0x55c3697c42e0 2024-04-25T09:12:04.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.465+0000 7f0c49600640 1 -- 172.21.15.175:0/973013721 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f0c4c022bd0 con 0x55c3697c42e0 2024-04-25T09:12:04.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 1 -- 172.21.15.175:0/973013721 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0c58003db0 con 0x55c3697c42e0 2024-04-25T09:12:04.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c49600640 1 -- 172.21.15.175:0/973013721 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c4c012410 con 0x55c3697c42e0 2024-04-25T09:12:04.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 10 client.7866 fetch_fsmap learned FSMap version 71 2024-04-25T09:12:04.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 1 -- 172.21.15.175:0/973013721 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x55c3695687c0 con 0x55c3697c42e0 2024-04-25T09:12:04.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c49600640 1 -- 172.21.15.175:0/973013721 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c58003db0 con 0x55c3697c42e0 2024-04-25T09:12:04.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c49600640 1 -- 172.21.15.175:0/973013721 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 71) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0c4c0125b0 con 0x55c3697c42e0 2024-04-25T09:12:04.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 10 client.7866 fetch_fsmap finished waiting for FSMap version 71 2024-04-25T09:12:04.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 10 client.7866 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:12:04.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 20 client.7866 populate_metadata read hostname 'smithi175' 2024-04-25T09:12:04.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/973013721 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55c3697867d0 0x55c3697d5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 4 client.7866 mds_command: new command op to 7303 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:12:04.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 1 -- 172.21.15.175:0/973013721 --> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c369562cd0 con 0x55c3697867d0 2024-04-25T09:12:04.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c5fe00640 1 --2- 172.21.15.175:0/973013721 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55c3697867d0 0x55c3697d5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c5fe00640 1 --2- 172.21.15.175:0/973013721 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55c3697867d0 0x55c3697d5850 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20bc64fcde230b5d server_cookie=3ad23d4616218984 in_seq=0 out_seq=0 2024-04-25T09:12:04.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c49600640 10 client.7866 ms_handle_connect on v2:172.21.15.175:6835/279367590 2024-04-25T09:12:04.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c49600640 1 -- 172.21.15.175:0/973013721 <== mds.0 v2:172.21.15.175:6835/279367590 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x7f0c5011ca90 con 0x55c3697867d0 2024-04-25T09:12:04.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c49600640 10 client.7866 handle_command_reply: tid=0 2024-04-25T09:12:04.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 1 client.7866 shutdown 2024-04-25T09:12:04.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 1 -- 172.21.15.175:0/973013721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3697c42e0 msgr2=0x55c3697859c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/973013721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3697c42e0 0x55c3697859c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f0c6009e6e0 tx=0x7f0c4c001220 comp rx=0 tx=0).stop 2024-04-25T09:12:04.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 1 -- 172.21.15.175:0/973013721 shutdown_connections 2024-04-25T09:12:04.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/973013721 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55c3697867d0 0x55c3697d5850 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/973013721 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c3697c4c00 0x55c369785f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/973013721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c3697c42e0 0x55c3697859c0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/973013721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c36977a8e0 0x55c369785480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c49600640 0 client.7866 ms_handle_reset on v2:172.21.15.175:6835/279367590 2024-04-25T09:12:04.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 1 -- 172.21.15.175:0/973013721 >> 172.21.15.175:0/973013721 conn(0x55c369776890 msgr2=0x55c369779510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 1 -- 172.21.15.175:0/973013721 shutdown_connections 2024-04-25T09:12:04.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 1 -- 172.21.15.175:0/973013721 wait complete. 2024-04-25T09:12:04.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.469+0000 7f0c69fc4000 20 client.7866 trim_cache size 0 max 16384 2024-04-25T09:12:04.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.481+0000 7f0c69fc4000 1 Processor -- start 2024-04-25T09:12:04.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.481+0000 7f0c69fc4000 1 -- start start 2024-04-25T09:12:04.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.481+0000 7f0c69fc4000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c369776890 0x55c3697c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.481+0000 7f0c69fc4000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c36977a8e0 0x55c369779c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.481+0000 7f0c69fc4000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c3697c42e0 0x55c36977a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.481+0000 7f0c69fc4000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c60152650 con 0x55c369776890 2024-04-25T09:12:04.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.481+0000 7f0c69fc4000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c60151a50 con 0x55c36977a8e0 2024-04-25T09:12:04.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.481+0000 7f0c69fc4000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c60152050 con 0x55c3697c42e0 2024-04-25T09:12:04.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.481+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c369776890 0x55c3697c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.481+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c369776890 0x55c3697c38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50232/0 (socket says 172.21.15.175:50232) 2024-04-25T09:12:04.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.481+0000 7f0c5fe00640 1 -- 172.21.15.175:0/4009686804 learned_addr learned my addr 172.21.15.175:0/4009686804 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:04.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.481+0000 7f0c5fe00640 1 -- 172.21.15.175:0/4009686804 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c3697c42e0 msgr2=0x55c36977a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:04.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.481+0000 7f0c5fe00640 1 --2- 172.21.15.175:0/4009686804 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c3697c42e0 0x55c36977a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.481+0000 7f0c5fe00640 1 -- 172.21.15.175:0/4009686804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c36977a8e0 msgr2=0x55c369779c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:04.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.481+0000 7f0c5fe00640 1 --2- 172.21.15.175:0/4009686804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c36977a8e0 0x55c369779c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.481+0000 7f0c5fe00640 1 -- 172.21.15.175:0/4009686804 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c369582fc0 con 0x55c369776890 2024-04-25T09:12:04.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c5fe00640 1 --2- 172.21.15.175:0/4009686804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c369776890 0x55c3697c38c0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f0c5011d820 tx=0x7f0c5011d6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204abbeb13c4375a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c4be00640 1 -- 172.21.15.175:0/4009686804 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5010c070 con 0x55c369776890 2024-04-25T09:12:04.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c4be00640 1 -- 172.21.15.175:0/4009686804 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c50118030 con 0x55c369776890 2024-04-25T09:12:04.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c4be00640 1 -- 172.21.15.175:0/4009686804 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c500edf00 con 0x55c369776890 2024-04-25T09:12:04.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 -- 172.21.15.175:0/4009686804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c369776890 msgr2=0x55c3697c38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/4009686804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c369776890 0x55c3697c38c0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f0c5011d820 tx=0x7f0c5011d6f0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 -- 172.21.15.175:0/4009686804 shutdown_connections 2024-04-25T09:12:04.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/4009686804 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c3697c42e0 0x55c36977a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/4009686804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c36977a8e0 0x55c369779c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/4009686804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c369776890 0x55c3697c38c0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 -- 172.21.15.175:0/4009686804 >> 172.21.15.175:0/4009686804 conn(0x55c369785ec0 msgr2=0x55c3697c2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 -- 172.21.15.175:0/4009686804 shutdown_connections 2024-04-25T09:12:04.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 -- 172.21.15.175:0/4009686804 wait complete. 2024-04-25T09:12:04.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 -- start start 2024-04-25T09:12:04.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 Processor -- start 2024-04-25T09:12:04.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c369776890 0x55c369823a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c36977a8e0 0x55c369823f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c3697c42e0 0x55c3697df2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c369561e70 con 0x55c369776890 2024-04-25T09:12:04.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c36954fa50 con 0x55c3697c42e0 2024-04-25T09:12:04.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3695c63a0 con 0x55c36977a8e0 2024-04-25T09:12:04.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 10 client.0 _ll_register_callbacks cb 0x55c369573240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:04.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c369776890 0x55c369823a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c369776890 0x55c369823a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50248/0 (socket says 172.21.15.175:50248) 2024-04-25T09:12:04.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c5fe00640 1 -- 172.21.15.175:0/2369776589 learned_addr learned my addr 172.21.15.175:0/2369776589 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:04.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c5f400640 1 --2- 172.21.15.175:0/2369776589 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c36977a8e0 0x55c369823f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c64c00640 1 --2- 172.21.15.175:0/2369776589 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c3697c42e0 0x55c3697df2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c5fe00640 1 -- 172.21.15.175:0/2369776589 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c36977a8e0 msgr2=0x55c369823f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:04.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c5fe00640 1 --2- 172.21.15.175:0/2369776589 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c36977a8e0 0x55c369823f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c5fe00640 1 -- 172.21.15.175:0/2369776589 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c3697c42e0 msgr2=0x55c3697df2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:04.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c5fe00640 1 --2- 172.21.15.175:0/2369776589 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c3697c42e0 0x55c3697df2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c5fe00640 1 -- 172.21.15.175:0/2369776589 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c3696209e0 con 0x55c369776890 2024-04-25T09:12:04.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c5fe00640 1 --2- 172.21.15.175:0/2369776589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c369776890 0x55c369823a40 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f0c500efb90 tx=0x7f0c500f6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d03dc2d5cc94d11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c49600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:12:04.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c49600640 1 -- 172.21.15.175:0/2369776589 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5010c070 con 0x55c369776890 2024-04-25T09:12:04.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c49600640 1 -- 172.21.15.175:0/2369776589 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f0c500ec270 con 0x55c369776890 2024-04-25T09:12:04.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 -- 172.21.15.175:0/2369776589 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0c50118030 con 0x55c369776890 2024-04-25T09:12:04.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c49600640 1 -- 172.21.15.175:0/2369776589 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c5011f0b0 con 0x55c369776890 2024-04-25T09:12:04.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 10 client.7872 fetch_fsmap learned FSMap version 71 2024-04-25T09:12:04.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c69fc4000 1 -- 172.21.15.175:0/2369776589 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x55c369566630 con 0x55c369776890 2024-04-25T09:12:04.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.485+0000 7f0c49600640 1 -- 172.21.15.175:0/2369776589 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c50118030 con 0x55c369776890 2024-04-25T09:12:04.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c49600640 1 -- 172.21.15.175:0/2369776589 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 71) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0c500b3030 con 0x55c369776890 2024-04-25T09:12:04.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c69fc4000 10 client.7872 fetch_fsmap finished waiting for FSMap version 71 2024-04-25T09:12:04.477 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c69fc4000 10 client.7872 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:12:04.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c69fc4000 20 client.7872 populate_metadata read hostname 'smithi175' 2024-04-25T09:12:04.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/2369776589 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55c3697c4c00 0x55c3697dfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c69fc4000 4 client.7872 mds_command: new command op to 7303 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:12:04.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c69fc4000 1 -- 172.21.15.175:0/2369776589 --> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x55c3695d45d0 con 0x55c3697c4c00 2024-04-25T09:12:04.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c5f400640 1 --2- 172.21.15.175:0/2369776589 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55c3697c4c00 0x55c3697dfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c49600640 10 client.7872 ms_handle_connect on v2:172.21.15.175:6835/279367590 2024-04-25T09:12:04.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c5f400640 1 --2- 172.21.15.175:0/2369776589 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55c3697c4c00 0x55c3697dfc90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd9fd79a9b8b7381 server_cookie=80974428939cbca7 in_seq=0 out_seq=0 2024-04-25T09:12:04.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c49600640 1 -- 172.21.15.175:0/2369776589 <== mds.0 v2:172.21.15.175:6835/279367590 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c3695d45d0 con 0x55c3697c4c00 2024-04-25T09:12:04.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c49600640 10 client.7872 handle_command_reply: tid=0 2024-04-25T09:12:04.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c69fc4000 1 client.7872 shutdown 2024-04-25T09:12:04.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c69fc4000 1 -- 172.21.15.175:0/2369776589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c369776890 msgr2=0x55c369823a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/2369776589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c369776890 0x55c369823a40 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f0c500efb90 tx=0x7f0c500f6040 comp rx=0 tx=0).stop 2024-04-25T09:12:04.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c69fc4000 1 -- 172.21.15.175:0/2369776589 shutdown_connections 2024-04-25T09:12:04.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/2369776589 >> [v2:172.21.15.175:6835/279367590,v1:172.21.15.175:6837/279367590] conn(0x55c3697c4c00 0x55c3697dfc90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/2369776589 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c3697c42e0 0x55c3697df2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/2369776589 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c36977a8e0 0x55c369823f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c49600640 0 client.7872 ms_handle_reset on v2:172.21.15.175:6835/279367590 2024-04-25T09:12:04.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c69fc4000 1 --2- 172.21.15.175:0/2369776589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c369776890 0x55c369823a40 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c69fc4000 1 -- 172.21.15.175:0/2369776589 >> 172.21.15.175:0/2369776589 conn(0x55c369785ec0 msgr2=0x55c3697c3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c69fc4000 1 -- 172.21.15.175:0/2369776589 shutdown_connections 2024-04-25T09:12:04.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c69fc4000 1 -- 172.21.15.175:0/2369776589 wait complete. 2024-04-25T09:12:04.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c69fc4000 20 client.7872 trim_cache size 0 max 16384 2024-04-25T09:12:04.479 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:04.479 INFO:teuthology.orchestra.run.smithi175.stdout:[] 2024-04-25T09:12:04.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c65600640 1 -- 172.21.15.175:0/710646324 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0c40066f90 msgr2=0x7f0c40069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c65600640 1 --2- 172.21.15.175:0/710646324 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0c40066f90 0x7f0c40069450 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f0c600b30d0 tx=0x7f0c4c009040 comp rx=0 tx=0).stop 2024-04-25T09:12:04.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c65600640 1 -- 172.21.15.175:0/710646324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c6006ac50 msgr2=0x7f0c600ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c65600640 1 --2- 172.21.15.175:0/710646324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c6006ac50 0x7f0c600ae8f0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f0c500ae040 tx=0x7f0c5001ab60 comp rx=0 tx=0).stop 2024-04-25T09:12:04.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c65600640 1 -- 172.21.15.175:0/710646324 shutdown_connections 2024-04-25T09:12:04.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c65600640 1 --2- 172.21.15.175:0/710646324 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0c40066f90 0x7f0c40069450 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c65600640 1 --2- 172.21.15.175:0/710646324 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c6015b810 0x7f0c60149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c65600640 1 --2- 172.21.15.175:0/710646324 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c600cc310 0x7f0c6015ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c65600640 1 --2- 172.21.15.175:0/710646324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c6006ac50 0x7f0c600ae8f0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c65600640 1 -- 172.21.15.175:0/710646324 >> 172.21.15.175:0/710646324 conn(0x7f0c60099a50 msgr2=0x7f0c600b4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c65600640 1 -- 172.21.15.175:0/710646324 shutdown_connections 2024-04-25T09:12:04.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.489+0000 7f0c65600640 1 -- 172.21.15.175:0/710646324 wait complete. 2024-04-25T09:12:04.495 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:12:04.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.645+0000 7f926ee00640 1 Processor -- start 2024-04-25T09:12:04.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.645+0000 7f926ee00640 1 -- start start 2024-04-25T09:12:04.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.645+0000 7f926ee00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f926815bc70 0x7f92680b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.645+0000 7f926ee00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f926806b780 0x7f92680cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.645+0000 7f926ee00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92680b0000 con 0x7f92680cc910 2024-04-25T09:12:04.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.645+0000 7f926ee00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92680b08f0 con 0x7f926815bc70 2024-04-25T09:12:04.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.645+0000 7f926ee00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92680b02a0 con 0x7f926806b780 2024-04-25T09:12:04.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.645+0000 7f9267e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f926815bc70 0x7f92680b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.645+0000 7f926ce00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f92680cc910 0x7f92680b1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:41388/0 (socket says 172.21.15.175:41388) 2024-04-25T09:12:04.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.645+0000 7f926ce00640 1 -- 172.21.15.175:0/846380953 learned_addr learned my addr 172.21.15.175:0/846380953 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:04.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.645+0000 7f925fe00640 1 --2- 172.21.15.175:0/846380953 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f926806b780 0x7f92680cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.645+0000 7f9267e00640 1 -- 172.21.15.175:0/846380953 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f926806b780 msgr2=0x7f92680cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:04.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.645+0000 7f9267e00640 1 --2- 172.21.15.175:0/846380953 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f926806b780 0x7f92680cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.645+0000 7f9267e00640 1 -- 172.21.15.175:0/846380953 >> v1:172.21.15.175:6789/0 conn(0x7f92680cc910 legacy=0x7f92680b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.645+0000 7f9267e00640 1 -- 172.21.15.175:0/846380953 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92680b0580 con 0x7f926815bc70 2024-04-25T09:12:04.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.645+0000 7f925fe00640 1 --2- 172.21.15.175:0/846380953 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f926806b780 0x7f92680cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:04.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.649+0000 7f9267e00640 1 --2- 172.21.15.175:0/846380953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f926815bc70 0x7f92680b0d80 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f92580097c0 tx=0x7f925801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1069121282a193e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.649+0000 7f9267400640 1 -- 172.21.15.175:0/846380953 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92580b5070 con 0x7f926815bc70 2024-04-25T09:12:04.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.649+0000 7f9267400640 1 -- 172.21.15.175:0/846380953 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92580a8990 con 0x7f926815bc70 2024-04-25T09:12:04.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.649+0000 7f9267400640 1 -- 172.21.15.175:0/846380953 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92580a8d60 con 0x7f926815bc70 2024-04-25T09:12:04.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.649+0000 7f926ee00640 1 -- 172.21.15.175:0/846380953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f926815bc70 msgr2=0x7f92680b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.649+0000 7f926ee00640 1 --2- 172.21.15.175:0/846380953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f926815bc70 0x7f92680b0d80 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f92580097c0 tx=0x7f925801ec90 comp rx=0 tx=0).stop 2024-04-25T09:12:04.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.649+0000 7f926ee00640 1 -- 172.21.15.175:0/846380953 shutdown_connections 2024-04-25T09:12:04.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.649+0000 7f926ee00640 1 --2- 172.21.15.175:0/846380953 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f926806b780 0x7f92680cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.649+0000 7f926ee00640 1 --2- 172.21.15.175:0/846380953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f926815bc70 0x7f92680b0d80 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.649+0000 7f926ee00640 1 -- 172.21.15.175:0/846380953 >> 172.21.15.175:0/846380953 conn(0x7f92680d06c0 msgr2=0x7f92680d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.649+0000 7f926ee00640 1 -- 172.21.15.175:0/846380953 shutdown_connections 2024-04-25T09:12:04.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.649+0000 7f926ee00640 1 -- 172.21.15.175:0/846380953 wait complete. 2024-04-25T09:12:04.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.649+0000 7f926ee00640 1 Processor -- start 2024-04-25T09:12:04.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.649+0000 7f926ee00640 1 -- start start 2024-04-25T09:12:04.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f926ee00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f926806b780 0x7f92681f7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f926ee00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92680cc910 0x7f9268159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f926ee00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f926815bc70 0x7f92681f3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f926ee00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92680b12c0 con 0x7f92680cc910 2024-04-25T09:12:04.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f926ee00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92680cde30 con 0x7f926815bc70 2024-04-25T09:12:04.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f926ee00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92680b1d20 con 0x7f926806b780 2024-04-25T09:12:04.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f925fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92680cc910 0x7f9268159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f925fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92680cc910 0x7f9268159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50272/0 (socket says 172.21.15.175:50272) 2024-04-25T09:12:04.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f925fe00640 1 -- 172.21.15.175:0/386748127 learned_addr learned my addr 172.21.15.175:0/386748127 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:04.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f9267e00640 1 --2- 172.21.15.175:0/386748127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f926806b780 0x7f92681f7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f926ce00640 1 --2- 172.21.15.175:0/386748127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f926815bc70 0x7f92681f3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f925fe00640 1 -- 172.21.15.175:0/386748127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f926806b780 msgr2=0x7f92681f7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f925fe00640 1 --2- 172.21.15.175:0/386748127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f926806b780 0x7f92681f7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f925fe00640 1 -- 172.21.15.175:0/386748127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f926815bc70 msgr2=0x7f92681f3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f925fe00640 1 --2- 172.21.15.175:0/386748127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f926815bc70 0x7f92681f3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f925fe00640 1 -- 172.21.15.175:0/386748127 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92681f47a0 con 0x7f92680cc910 2024-04-25T09:12:04.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f926ce00640 1 --2- 172.21.15.175:0/386748127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f926815bc70 0x7f92681f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:04.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f925fe00640 1 --2- 172.21.15.175:0/386748127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92680cc910 0x7f9268159c50 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f925000c7f0 tx=0x7f925000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f9264c00640 1 -- 172.21.15.175:0/386748127 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250015070 con 0x7f92680cc910 2024-04-25T09:12:04.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f9264c00640 1 -- 172.21.15.175:0/386748127 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9250007a30 con 0x7f92680cc910 2024-04-25T09:12:04.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f926ee00640 1 -- 172.21.15.175:0/386748127 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92681f41e0 con 0x7f92680cc910 2024-04-25T09:12:04.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f9264c00640 1 -- 172.21.15.175:0/386748127 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250007e00 con 0x7f92680cc910 2024-04-25T09:12:04.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f926ee00640 1 -- 172.21.15.175:0/386748127 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92681f6f90 con 0x7f92680cc910 2024-04-25T09:12:04.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f926ee00640 1 -- 172.21.15.175:0/386748127 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9268074a60 con 0x7f92680cc910 2024-04-25T09:12:04.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.653+0000 7f9264c00640 1 -- 172.21.15.175:0/386748127 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9250018070 con 0x7f92680cc910 2024-04-25T09:12:04.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.657+0000 7f9264c00640 1 --2- 172.21.15.175:0/386748127 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9244066f60 0x7f9244069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.657+0000 7f9264c00640 1 -- 172.21.15.175:0/386748127 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f9250084fd0 con 0x7f92680cc910 2024-04-25T09:12:04.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.657+0000 7f9267e00640 1 --2- 172.21.15.175:0/386748127 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9244066f60 0x7f9244069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.657+0000 7f9267e00640 1 --2- 172.21.15.175:0/386748127 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9244066f60 0x7f9244069420 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f92580b2000 tx=0x7f9258008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.661+0000 7f9264c00640 1 -- 172.21.15.175:0/386748127 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f92500558b0 con 0x7f92680cc910 2024-04-25T09:12:04.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.845+0000 7f926ee00640 1 -- 172.21.15.175:0/386748127 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f926815b200 con 0x7f92680cc910 2024-04-25T09:12:04.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.845+0000 7f9264c00640 1 -- 172.21.15.175:0/386748127 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9250059950 con 0x7f92680cc910 2024-04-25T09:12:04.832 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:04.832 INFO:teuthology.orchestra.run.smithi175.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T09:12:04.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.849+0000 7f926ee00640 1 -- 172.21.15.175:0/386748127 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9244066f60 msgr2=0x7f9244069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.849+0000 7f926ee00640 1 --2- 172.21.15.175:0/386748127 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9244066f60 0x7f9244069420 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f92580b2000 tx=0x7f9258008040 comp rx=0 tx=0).stop 2024-04-25T09:12:04.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.849+0000 7f926ee00640 1 -- 172.21.15.175:0/386748127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92680cc910 msgr2=0x7f9268159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.849+0000 7f926ee00640 1 --2- 172.21.15.175:0/386748127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92680cc910 0x7f9268159c50 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f925000c7f0 tx=0x7f925000ccb0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.849+0000 7f926ee00640 1 -- 172.21.15.175:0/386748127 shutdown_connections 2024-04-25T09:12:04.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.849+0000 7f926ee00640 1 --2- 172.21.15.175:0/386748127 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9244066f60 0x7f9244069420 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.849+0000 7f926ee00640 1 --2- 172.21.15.175:0/386748127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f926815bc70 0x7f92681f3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.849+0000 7f926ee00640 1 --2- 172.21.15.175:0/386748127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f92680cc910 0x7f9268159c50 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.849+0000 7f926ee00640 1 --2- 172.21.15.175:0/386748127 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f926806b780 0x7f92681f7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.849+0000 7f926ee00640 1 -- 172.21.15.175:0/386748127 >> 172.21.15.175:0/386748127 conn(0x7f92680d06c0 msgr2=0x7f92680ae5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.849+0000 7f926ee00640 1 -- 172.21.15.175:0/386748127 shutdown_connections 2024-04-25T09:12:04.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:04.849+0000 7f926ee00640 1 -- 172.21.15.175:0/386748127 wait complete. 2024-04-25T09:12:04.853 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T09:12:04.854 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:12:04.854 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:12:04.948 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:12:05.074 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:12:05.075 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:12:05.075 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:05.083 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:12:05.083 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:05.134 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:05.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.325+0000 7f0808400640 1 Processor -- start 2024-04-25T09:12:05.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.325+0000 7f0808400640 1 -- start start 2024-04-25T09:12:05.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.325+0000 7f0808400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f08000cfc70 0x7f080006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.325+0000 7f0808400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08000cda00 con 0x7f080015a900 2024-04-25T09:12:05.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.325+0000 7f0808400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08000cdce0 con 0x7f08000cd520 2024-04-25T09:12:05.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.325+0000 7f0808400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f080015bcf0 con 0x7f08000cfc70 2024-04-25T09:12:05.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.325+0000 7f0805a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f080015a900 0x7f08000ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:41404/0 (socket says 172.21.15.175:41404) 2024-04-25T09:12:05.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.325+0000 7f0805a00640 1 -- 172.21.15.175:0/376031037 learned_addr learned my addr 172.21.15.175:0/376031037 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:05.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.325+0000 7f0806400640 1 --2- 172.21.15.175:0/376031037 >> v2:172.21.15.177:3300/0 conn(0x7f08000cfc70 0x7f080006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.325+0000 7f07ffe00640 1 -- 172.21.15.175:0/376031037 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504685140 0 0) 0x7f08000cda00 con 0x7f080015a900 2024-04-25T09:12:05.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.325+0000 7f07ffe00640 1 -- 172.21.15.175:0/376031037 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e8003530 con 0x7f080015a900 2024-04-25T09:12:05.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f07ffe00640 1 -- 172.21.15.175:0/376031037 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1048267989 0 0) 0x7f07e8003530 con 0x7f080015a900 2024-04-25T09:12:05.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f07ffe00640 1 -- 172.21.15.175:0/376031037 >> v2:172.21.15.177:3300/0 conn(0x7f08000cfc70 msgr2=0x7f080006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f07ffe00640 1 --2- 172.21.15.175:0/376031037 >> v2:172.21.15.177:3300/0 conn(0x7f08000cfc70 0x7f080006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f07ffe00640 1 -- 172.21.15.175:0/376031037 >> v1:172.21.15.177:6789/0 conn(0x7f08000cd520 legacy=0x7f08000cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f07ffe00640 1 -- 172.21.15.175:0/376031037 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08000cdfc0 con 0x7f080015a900 2024-04-25T09:12:05.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f07ffe00640 1 -- 172.21.15.175:0/376031037 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f07f4001680 con 0x7f080015a900 2024-04-25T09:12:05.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f07ffe00640 1 -- 172.21.15.175:0/376031037 >> v1:172.21.15.175:6789/0 conn(0x7f080015a900 legacy=0x7f08000ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f07ffe00640 1 --2- 172.21.15.175:0/376031037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07e80039c0 0x7f07e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f07ffe00640 1 --2- 172.21.15.175:0/376031037 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07e80043c0 0x7f07e8004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f07ffe00640 1 --2- 172.21.15.175:0/376031037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07e8005090 0x7f07e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f07ffe00640 1 -- 172.21.15.175:0/376031037 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e800bfc0 con 0x7f07e8005090 2024-04-25T09:12:05.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f07ffe00640 1 -- 172.21.15.175:0/376031037 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e800c170 con 0x7f07e80039c0 2024-04-25T09:12:05.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f07ffe00640 1 -- 172.21.15.175:0/376031037 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e800c370 con 0x7f07e80043c0 2024-04-25T09:12:05.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f0805a00640 1 --2- 172.21.15.175:0/376031037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07e80039c0 0x7f07e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f0806400640 1 --2- 172.21.15.175:0/376031037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07e8005090 0x7f07e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f0805000640 1 --2- 172.21.15.175:0/376031037 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07e80043c0 0x7f07e8004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f0806400640 1 -- 172.21.15.175:0/376031037 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07e80043c0 msgr2=0x7f07e8004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f0806400640 1 --2- 172.21.15.175:0/376031037 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07e80043c0 0x7f07e8004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f0806400640 1 -- 172.21.15.175:0/376031037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07e80039c0 msgr2=0x7f07e8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f0806400640 1 --2- 172.21.15.175:0/376031037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07e80039c0 0x7f07e8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f0806400640 1 -- 172.21.15.175:0/376031037 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e8003530 con 0x7f07e8005090 2024-04-25T09:12:05.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f0806400640 1 -- 172.21.15.175:0/376031037 reap_dead start 2024-04-25T09:12:05.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.329+0000 7f0806400640 1 --2- 172.21.15.175:0/376031037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07e8005090 0x7f07e800b9d0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009fc0 tx=0x7f07f801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b341e9608ba041a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f07ffe00640 1 -- 172.21.15.175:0/376031037 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f8009c10 con 0x7f07e8005090 2024-04-25T09:12:05.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f07ffe00640 1 -- 172.21.15.175:0/376031037 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f80a5d10 con 0x7f07e8005090 2024-04-25T09:12:05.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f07ffe00640 1 -- 172.21.15.175:0/376031037 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f8003be0 con 0x7f07e8005090 2024-04-25T09:12:05.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0808400640 1 -- 172.21.15.175:0/376031037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07e8005090 msgr2=0x7f07e800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0808400640 1 --2- 172.21.15.175:0/376031037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07e8005090 0x7f07e800b9d0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009fc0 tx=0x7f07f801ccc0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0808400640 1 -- 172.21.15.175:0/376031037 shutdown_connections 2024-04-25T09:12:05.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0808400640 1 --2- 172.21.15.175:0/376031037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07e8005090 0x7f07e800b9d0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0808400640 1 -- 172.21.15.175:0/376031037 >> 172.21.15.175:0/376031037 conn(0x7f0800067150 msgr2=0x7f080006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0808400640 1 -- 172.21.15.175:0/376031037 shutdown_connections 2024-04-25T09:12:05.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0808400640 1 -- 172.21.15.175:0/376031037 wait complete. 2024-04-25T09:12:05.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0808400640 1 Processor -- start 2024-04-25T09:12:05.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0808400640 1 -- start start 2024-04-25T09:12:05.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0808400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0800071a50 0x7f080015cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0808400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0800071e30 0x7f08000b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0808400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0800145c30 0x7f0800146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0808400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080006d3b0 con 0x7f0800145c30 2024-04-25T09:12:05.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0808400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08000ce580 con 0x7f0800071e30 2024-04-25T09:12:05.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0808400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080006d530 con 0x7f0800071a50 2024-04-25T09:12:05.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0806400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0800145c30 0x7f0800146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0806400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0800145c30 0x7f0800146090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50286/0 (socket says 172.21.15.175:50286) 2024-04-25T09:12:05.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0806400640 1 -- 172.21.15.175:0/3000031836 learned_addr learned my addr 172.21.15.175:0/3000031836 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:05.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0805000640 1 --2- 172.21.15.175:0/3000031836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0800071e30 0x7f08000b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0805a00640 1 --2- 172.21.15.175:0/3000031836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0800071a50 0x7f080015cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0806400640 1 -- 172.21.15.175:0/3000031836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0800071a50 msgr2=0x7f080015cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0806400640 1 --2- 172.21.15.175:0/3000031836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0800071a50 0x7f080015cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0806400640 1 -- 172.21.15.175:0/3000031836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0800071e30 msgr2=0x7f08000b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0806400640 1 --2- 172.21.15.175:0/3000031836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0800071e30 0x7f08000b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0806400640 1 -- 172.21.15.175:0/3000031836 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08000b0bb0 con 0x7f0800145c30 2024-04-25T09:12:05.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.333+0000 7f0805a00640 1 --2- 172.21.15.175:0/3000031836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0800071a50 0x7f080015cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:05.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.337+0000 7f0806400640 1 --2- 172.21.15.175:0/3000031836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0800145c30 0x7f0800146090 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f07f80987f0 tx=0x7f07f8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.337+0000 7f07fd600640 1 -- 172.21.15.175:0/3000031836 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f8003bb0 con 0x7f0800145c30 2024-04-25T09:12:05.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.337+0000 7f07fd600640 1 -- 172.21.15.175:0/3000031836 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f80bd070 con 0x7f0800145c30 2024-04-25T09:12:05.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.337+0000 7f0808400640 1 -- 172.21.15.175:0/3000031836 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08001f65b0 con 0x7f0800145c30 2024-04-25T09:12:05.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.337+0000 7f07fd600640 1 -- 172.21.15.175:0/3000031836 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f80ae930 con 0x7f0800145c30 2024-04-25T09:12:05.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.337+0000 7f0808400640 1 -- 172.21.15.175:0/3000031836 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08001f6b70 con 0x7f0800145c30 2024-04-25T09:12:05.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.337+0000 7f0808400640 1 -- 172.21.15.175:0/3000031836 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0800074a60 con 0x7f0800145c30 2024-04-25T09:12:05.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.337+0000 7f07fd600640 1 -- 172.21.15.175:0/3000031836 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f07f80aead0 con 0x7f0800145c30 2024-04-25T09:12:05.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.337+0000 7f07fd600640 1 --2- 172.21.15.175:0/3000031836 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f07e0066f60 0x7f07e0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.337+0000 7f07fd600640 1 -- 172.21.15.175:0/3000031836 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f07f8120a90 con 0x7f0800145c30 2024-04-25T09:12:05.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.337+0000 7f0805a00640 1 --2- 172.21.15.175:0/3000031836 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f07e0066f60 0x7f07e0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.341+0000 7f0805a00640 1 --2- 172.21.15.175:0/3000031836 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f07e0066f60 0x7f07e0069420 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f07f4001060 tx=0x7f07f4001e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.345+0000 7f07fd600640 1 -- 172.21.15.175:0/3000031836 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f07f80169d0 con 0x7f0800145c30 2024-04-25T09:12:05.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.497+0000 7f0808400640 1 -- 172.21.15.175:0/3000031836 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f080014be00 con 0x7f0800145c30 2024-04-25T09:12:05.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.497+0000 7f07fd600640 1 -- 172.21.15.175:0/3000031836 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+17009 (secure 0 0 0) 0x7f07f80c13c0 con 0x7f0800145c30 2024-04-25T09:12:05.486 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:05.486 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":88,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:11:26.715623+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:01.518283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:02.788015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.38","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6837/1399691338":"2024-04-26T09:11:26.715601+0000","172.21.15.175:6835/1399691338":"2024-04-26T09:11:26.715601+0000","172.21.15.175:6837/1755192276":"2024-04-26T09:10:14.425304+0000","172.21.15.175:6835/1755192276":"2024-04-26T09:10:14.425304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:05.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.501+0000 7f0808400640 1 -- 172.21.15.175:0/3000031836 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f07e0066f60 msgr2=0x7f07e0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.501+0000 7f0808400640 1 --2- 172.21.15.175:0/3000031836 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f07e0066f60 0x7f07e0069420 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f07f4001060 tx=0x7f07f4001e30 comp rx=0 tx=0).stop 2024-04-25T09:12:05.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.501+0000 7f0808400640 1 -- 172.21.15.175:0/3000031836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0800145c30 msgr2=0x7f0800146090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.501+0000 7f0808400640 1 --2- 172.21.15.175:0/3000031836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0800145c30 0x7f0800146090 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f07f80987f0 tx=0x7f07f8009750 comp rx=0 tx=0).stop 2024-04-25T09:12:05.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.501+0000 7f0808400640 1 -- 172.21.15.175:0/3000031836 shutdown_connections 2024-04-25T09:12:05.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.501+0000 7f0808400640 1 --2- 172.21.15.175:0/3000031836 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f07e0066f60 0x7f07e0069420 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.501+0000 7f0808400640 1 --2- 172.21.15.175:0/3000031836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0800145c30 0x7f0800146090 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.501+0000 7f0808400640 1 --2- 172.21.15.175:0/3000031836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0800071e30 0x7f08000b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.501+0000 7f0808400640 1 --2- 172.21.15.175:0/3000031836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0800071a50 0x7f080015cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.501+0000 7f0808400640 1 -- 172.21.15.175:0/3000031836 >> 172.21.15.175:0/3000031836 conn(0x7f07e8005090 msgr2=0x7f0800157220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.501+0000 7f0808400640 1 -- 172.21.15.175:0/3000031836 shutdown_connections 2024-04-25T09:12:05.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.501+0000 7f0808400640 1 -- 172.21.15.175:0/3000031836 wait complete. 2024-04-25T09:12:05.508 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:10:01.518283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:10:02.788015+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:12:05.508 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:12:05.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.657+0000 7f69ca000640 1 Processor -- start 2024-04-25T09:12:05.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.657+0000 7f69ca000640 1 -- start start 2024-04-25T09:12:05.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.661+0000 7f69ca000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f69c4145250 0x7f69c40cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.661+0000 7f69ca000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f69c41600a0 0x7f69c40cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.661+0000 7f69ca000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c40cfd10 con 0x7f69c40ce970 2024-04-25T09:12:05.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.661+0000 7f69ca000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c415f650 con 0x7f69c4145250 2024-04-25T09:12:05.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.661+0000 7f69ca000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69c40cfff0 con 0x7f69c41600a0 2024-04-25T09:12:05.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.661+0000 7f69c3400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f69c4145250 0x7f69c40cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.661+0000 7f69c3400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f69c4145250 0x7f69c40cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50302/0 (socket says 172.21.15.175:50302) 2024-04-25T09:12:05.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.661+0000 7f69c3400640 1 -- 172.21.15.175:0/2177642267 learned_addr learned my addr 172.21.15.175:0/2177642267 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:05.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.661+0000 7f69c3e00640 1 --1- 172.21.15.175:0/2177642267 >> v1:172.21.15.175:6789/0 conn(0x7f69c40ce970 0x7f69c40cedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:41410/0 (socket says 172.21.15.175:41410) 2024-04-25T09:12:05.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.661+0000 7f69c2a00640 1 --2- 172.21.15.175:0/2177642267 >> v2:172.21.15.177:3300/0 conn(0x7f69c41600a0 0x7f69c40cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.661+0000 7f69c3400640 1 -- 172.21.15.175:0/2177642267 >> v2:172.21.15.177:3300/0 conn(0x7f69c41600a0 msgr2=0x7f69c40cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.661+0000 7f69c3400640 1 --2- 172.21.15.175:0/2177642267 >> v2:172.21.15.177:3300/0 conn(0x7f69c41600a0 0x7f69c40cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.661+0000 7f69c3400640 1 -- 172.21.15.175:0/2177642267 >> v1:172.21.15.175:6789/0 conn(0x7f69c40ce970 legacy=0x7f69c40cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.661+0000 7f69c3400640 1 -- 172.21.15.175:0/2177642267 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c415f8a0 con 0x7f69c4145250 2024-04-25T09:12:05.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.661+0000 7f69c2000640 1 -- 172.21.15.175:0/2177642267 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370782669 0 0) 0x7f69c40cfd10 con 0x7f69c40ce970 2024-04-25T09:12:05.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.665+0000 7f69c3400640 1 --2- 172.21.15.175:0/2177642267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69c4145250 0x7f69c40cf6b0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009e50 tx=0x7f69b401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e4f2513c2f813c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.665+0000 7f69c2000640 1 -- 172.21.15.175:0/2177642267 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b40a58a0 con 0x7f69c4145250 2024-04-25T09:12:05.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.665+0000 7f69c2000640 1 -- 172.21.15.175:0/2177642267 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b40a5a40 con 0x7f69c4145250 2024-04-25T09:12:05.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.665+0000 7f69c2000640 1 -- 172.21.15.175:0/2177642267 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b40a5e10 con 0x7f69c4145250 2024-04-25T09:12:05.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.665+0000 7f69ca000640 1 -- 172.21.15.175:0/2177642267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69c4145250 msgr2=0x7f69c40cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.665+0000 7f69ca000640 1 --2- 172.21.15.175:0/2177642267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69c4145250 0x7f69c40cf6b0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009e50 tx=0x7f69b401c9c0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.665+0000 7f69ca000640 1 -- 172.21.15.175:0/2177642267 shutdown_connections 2024-04-25T09:12:05.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.665+0000 7f69ca000640 1 --2- 172.21.15.175:0/2177642267 >> v2:172.21.15.177:3300/0 conn(0x7f69c41600a0 0x7f69c40cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.665+0000 7f69ca000640 1 --2- 172.21.15.175:0/2177642267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69c4145250 0x7f69c40cf6b0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.665+0000 7f69ca000640 1 -- 172.21.15.175:0/2177642267 >> 172.21.15.175:0/2177642267 conn(0x7f69c406ac50 msgr2=0x7f69c406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.665+0000 7f69ca000640 1 -- 172.21.15.175:0/2177642267 shutdown_connections 2024-04-25T09:12:05.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.665+0000 7f69ca000640 1 -- 172.21.15.175:0/2177642267 wait complete. 2024-04-25T09:12:05.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.665+0000 7f69ca000640 1 Processor -- start 2024-04-25T09:12:05.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.665+0000 7f69ca000640 1 -- start start 2024-04-25T09:12:05.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.665+0000 7f69ca000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69c40ce970 0x7f69c415b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.665+0000 7f69ca000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69c4145250 0x7f69c41f6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.665+0000 7f69ca000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f69c41600a0 0x7f69c40b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69ca000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c415c870 con 0x7f69c4145250 2024-04-25T09:12:05.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69ca000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c41604b0 con 0x7f69c40ce970 2024-04-25T09:12:05.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69ca000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c415c9f0 con 0x7f69c41600a0 2024-04-25T09:12:05.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69c2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69c4145250 0x7f69c41f6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69c2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69c4145250 0x7f69c41f6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50306/0 (socket says 172.21.15.175:50306) 2024-04-25T09:12:05.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69c2a00640 1 -- 172.21.15.175:0/962024885 learned_addr learned my addr 172.21.15.175:0/962024885 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:05.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69c3400640 1 --2- 172.21.15.175:0/962024885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69c40ce970 0x7f69c415b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69c3e00640 1 --2- 172.21.15.175:0/962024885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f69c41600a0 0x7f69c40b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69c2a00640 1 -- 172.21.15.175:0/962024885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f69c41600a0 msgr2=0x7f69c40b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69c2a00640 1 --2- 172.21.15.175:0/962024885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f69c41600a0 0x7f69c40b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69c2a00640 1 -- 172.21.15.175:0/962024885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69c40ce970 msgr2=0x7f69c415b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69c2a00640 1 --2- 172.21.15.175:0/962024885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69c40ce970 0x7f69c415b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69c2a00640 1 -- 172.21.15.175:0/962024885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c41f7120 con 0x7f69c4145250 2024-04-25T09:12:05.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69c2a00640 1 --2- 172.21.15.175:0/962024885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69c4145250 0x7f69c41f6be0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f69b000d620 tx=0x7f69b000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69bb400640 1 -- 172.21.15.175:0/962024885 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b000b620 con 0x7f69c4145250 2024-04-25T09:12:05.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69bb400640 1 -- 172.21.15.175:0/962024885 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b0019070 con 0x7f69c4145250 2024-04-25T09:12:05.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69ca000640 1 -- 172.21.15.175:0/962024885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c4142310 con 0x7f69c4145250 2024-04-25T09:12:05.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69bb400640 1 -- 172.21.15.175:0/962024885 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b000b9e0 con 0x7f69c4145250 2024-04-25T09:12:05.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69ca000640 1 -- 172.21.15.175:0/962024885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c4142d20 con 0x7f69c4145250 2024-04-25T09:12:05.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69ca000640 1 -- 172.21.15.175:0/962024885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c4142830 con 0x7f69c4145250 2024-04-25T09:12:05.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.669+0000 7f69bb400640 1 -- 172.21.15.175:0/962024885 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f69b000bb80 con 0x7f69c4145250 2024-04-25T09:12:05.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.673+0000 7f69bb400640 1 --2- 172.21.15.175:0/962024885 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f69a4066f60 0x7f69a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.673+0000 7f69bb400640 1 -- 172.21.15.175:0/962024885 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f69b0085410 con 0x7f69c4145250 2024-04-25T09:12:05.658 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.673+0000 7f69c3400640 1 --2- 172.21.15.175:0/962024885 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f69a4066f60 0x7f69a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.673+0000 7f69c3400640 1 --2- 172.21.15.175:0/962024885 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f69a4066f60 0x7f69a4069420 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f69b40ae000 tx=0x7f69b40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.677+0000 7f69bb400640 1 -- 172.21.15.175:0/962024885 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f69c41f7120 con 0x7f69c4145250 2024-04-25T09:12:05.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.833+0000 7f69ca000640 1 -- 172.21.15.175:0/962024885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f69c4075160 con 0x7f69c4145250 2024-04-25T09:12:05.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.833+0000 7f69bb400640 1 -- 172.21.15.175:0/962024885 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f69b0056340 con 0x7f69c4145250 2024-04-25T09:12:05.819 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:12:05.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.833+0000 7f69ca000640 1 -- 172.21.15.175:0/962024885 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f69a4066f60 msgr2=0x7f69a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.833+0000 7f69ca000640 1 --2- 172.21.15.175:0/962024885 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f69a4066f60 0x7f69a4069420 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f69b40ae000 tx=0x7f69b40a7070 comp rx=0 tx=0).stop 2024-04-25T09:12:05.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.833+0000 7f69ca000640 1 -- 172.21.15.175:0/962024885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69c4145250 msgr2=0x7f69c41f6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.833+0000 7f69ca000640 1 --2- 172.21.15.175:0/962024885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69c4145250 0x7f69c41f6be0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f69b000d620 tx=0x7f69b000dae0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.833+0000 7f69ca000640 1 -- 172.21.15.175:0/962024885 shutdown_connections 2024-04-25T09:12:05.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.833+0000 7f69ca000640 1 --2- 172.21.15.175:0/962024885 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f69a4066f60 0x7f69a4069420 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.833+0000 7f69ca000640 1 --2- 172.21.15.175:0/962024885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f69c41600a0 0x7f69c40b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.833+0000 7f69ca000640 1 --2- 172.21.15.175:0/962024885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69c4145250 0x7f69c41f6be0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.833+0000 7f69ca000640 1 --2- 172.21.15.175:0/962024885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69c40ce970 0x7f69c415b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.833+0000 7f69ca000640 1 -- 172.21.15.175:0/962024885 >> 172.21.15.175:0/962024885 conn(0x7f69c406ac50 msgr2=0x7f69c406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.833+0000 7f69ca000640 1 -- 172.21.15.175:0/962024885 shutdown_connections 2024-04-25T09:12:05.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.833+0000 7f69ca000640 1 -- 172.21.15.175:0/962024885 wait complete. 2024-04-25T09:12:05.840 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:12:05.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.993+0000 7f10cf600640 1 Processor -- start 2024-04-25T09:12:05.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.993+0000 7f10cf600640 1 -- start start 2024-04-25T09:12:05.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.993+0000 7f10cf600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f10c8145250 0x7f10c80cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.993+0000 7f10cf600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f10c80ce970 0x7f10c80cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.993+0000 7f10cf600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c80cfd10 con 0x7f10c81600a0 2024-04-25T09:12:05.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.993+0000 7f10cf600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c815f650 con 0x7f10c8145250 2024-04-25T09:12:05.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.993+0000 7f10cf600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c80cfff0 con 0x7f10c80ce970 2024-04-25T09:12:05.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.993+0000 7f10ccc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f10c8145250 0x7f10c80cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.993+0000 7f10ccc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f10c8145250 0x7f10c80cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50314/0 (socket says 172.21.15.175:50314) 2024-04-25T09:12:05.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.993+0000 7f10ccc00640 1 -- 172.21.15.175:0/287837509 learned_addr learned my addr 172.21.15.175:0/287837509 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:05.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.993+0000 7f10c7e00640 1 --1- 172.21.15.175:0/287837509 >> v1:172.21.15.175:6789/0 conn(0x7f10c81600a0 0x7f10c80cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:41426/0 (socket says 172.21.15.175:41426) 2024-04-25T09:12:05.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.993+0000 7f10cd600640 1 --2- 172.21.15.175:0/287837509 >> v2:172.21.15.177:3300/0 conn(0x7f10c80ce970 0x7f10c80cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.993+0000 7f10ccc00640 1 -- 172.21.15.175:0/287837509 >> v2:172.21.15.177:3300/0 conn(0x7f10c80ce970 msgr2=0x7f10c80cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.993+0000 7f10ccc00640 1 --2- 172.21.15.175:0/287837509 >> v2:172.21.15.177:3300/0 conn(0x7f10c80ce970 0x7f10c80cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.993+0000 7f10ccc00640 1 -- 172.21.15.175:0/287837509 >> v1:172.21.15.175:6789/0 conn(0x7f10c81600a0 legacy=0x7f10c80cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.993+0000 7f10ccc00640 1 -- 172.21.15.175:0/287837509 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c815f8a0 con 0x7f10c8145250 2024-04-25T09:12:05.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.993+0000 7f10c7400640 1 -- 172.21.15.175:0/287837509 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958334122 0 0) 0x7f10c80cfd10 con 0x7f10c81600a0 2024-04-25T09:12:05.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.997+0000 7f10ccc00640 1 --2- 172.21.15.175:0/287837509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10c8145250 0x7f10c80cf6b0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f10b8009e50 tx=0x7f10b801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3708011980e1199e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.997+0000 7f10c7400640 1 -- 172.21.15.175:0/287837509 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b80a5790 con 0x7f10c8145250 2024-04-25T09:12:05.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.997+0000 7f10c7400640 1 -- 172.21.15.175:0/287837509 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b80a5930 con 0x7f10c8145250 2024-04-25T09:12:05.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.997+0000 7f10c7400640 1 -- 172.21.15.175:0/287837509 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b80a5d00 con 0x7f10c8145250 2024-04-25T09:12:05.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.997+0000 7f10cf600640 1 -- 172.21.15.175:0/287837509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10c8145250 msgr2=0x7f10c80cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.997+0000 7f10cf600640 1 --2- 172.21.15.175:0/287837509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10c8145250 0x7f10c80cf6b0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f10b8009e50 tx=0x7f10b801c930 comp rx=0 tx=0).stop 2024-04-25T09:12:05.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.997+0000 7f10cf600640 1 -- 172.21.15.175:0/287837509 shutdown_connections 2024-04-25T09:12:05.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.997+0000 7f10cf600640 1 --2- 172.21.15.175:0/287837509 >> v2:172.21.15.177:3300/0 conn(0x7f10c80ce970 0x7f10c80cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.997+0000 7f10cf600640 1 --2- 172.21.15.175:0/287837509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10c8145250 0x7f10c80cf6b0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.997+0000 7f10cf600640 1 -- 172.21.15.175:0/287837509 >> 172.21.15.175:0/287837509 conn(0x7f10c806ac50 msgr2=0x7f10c806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.997+0000 7f10cf600640 1 -- 172.21.15.175:0/287837509 shutdown_connections 2024-04-25T09:12:05.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:05.997+0000 7f10cf600640 1 -- 172.21.15.175:0/287837509 wait complete. 2024-04-25T09:12:05.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10cf600640 1 Processor -- start 2024-04-25T09:12:05.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10cf600640 1 -- start start 2024-04-25T09:12:05.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10cf600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10c80ce970 0x7f10c815b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10cf600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10c8145250 0x7f10c812e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10cf600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10c81600a0 0x7f10c80b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10cf600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c815c870 con 0x7f10c80ce970 2024-04-25T09:12:05.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10cf600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c8145630 con 0x7f10c81600a0 2024-04-25T09:12:05.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10cf600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c815c9f0 con 0x7f10c8145250 2024-04-25T09:12:05.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10ccc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10c80ce970 0x7f10c815b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10ccc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10c80ce970 0x7f10c815b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50324/0 (socket says 172.21.15.175:50324) 2024-04-25T09:12:05.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10ccc00640 1 -- 172.21.15.175:0/368739179 learned_addr learned my addr 172.21.15.175:0/368739179 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:05.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10cd600640 1 --2- 172.21.15.175:0/368739179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10c81600a0 0x7f10c80b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10c7e00640 1 --2- 172.21.15.175:0/368739179 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10c8145250 0x7f10c812e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10ccc00640 1 -- 172.21.15.175:0/368739179 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10c8145250 msgr2=0x7f10c812e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10ccc00640 1 --2- 172.21.15.175:0/368739179 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10c8145250 0x7f10c812e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10ccc00640 1 -- 172.21.15.175:0/368739179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10c81600a0 msgr2=0x7f10c80b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10ccc00640 1 --2- 172.21.15.175:0/368739179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10c81600a0 0x7f10c80b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10ccc00640 1 -- 172.21.15.175:0/368739179 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c815be50 con 0x7f10c80ce970 2024-04-25T09:12:05.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10ccc00640 1 --2- 172.21.15.175:0/368739179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10c80ce970 0x7f10c815b910 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f10b8019540 tx=0x7f10b80196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10c4c00640 1 -- 172.21.15.175:0/368739179 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b80bc020 con 0x7f10c80ce970 2024-04-25T09:12:05.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10c4c00640 1 -- 172.21.15.175:0/368739179 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b80b8670 con 0x7f10c80ce970 2024-04-25T09:12:05.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10c4c00640 1 -- 172.21.15.175:0/368739179 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b80b8a60 con 0x7f10c80ce970 2024-04-25T09:12:05.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10cf600640 1 -- 172.21.15.175:0/368739179 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c812ebe0 con 0x7f10c80ce970 2024-04-25T09:12:05.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.001+0000 7f10cf600640 1 -- 172.21.15.175:0/368739179 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c812c310 con 0x7f10c80ce970 2024-04-25T09:12:05.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.005+0000 7f10cf600640 1 -- 172.21.15.175:0/368739179 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c8075160 con 0x7f10c80ce970 2024-04-25T09:12:05.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.005+0000 7f10c4c00640 1 -- 172.21.15.175:0/368739179 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f10b80bf020 con 0x7f10c80ce970 2024-04-25T09:12:05.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.005+0000 7f10c4c00640 1 --2- 172.21.15.175:0/368739179 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f10a8066f60 0x7f10a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.005+0000 7f10c4c00640 1 -- 172.21.15.175:0/368739179 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f10b81200f0 con 0x7f10c80ce970 2024-04-25T09:12:05.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.005+0000 7f10c7e00640 1 --2- 172.21.15.175:0/368739179 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f10a8066f60 0x7f10a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.005+0000 7f10c7e00640 1 --2- 172.21.15.175:0/368739179 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f10a8066f60 0x7f10a8069420 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f10c813f7a0 tx=0x7f10b4007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.009+0000 7f10c4c00640 1 -- 172.21.15.175:0/368739179 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f10b80c6030 con 0x7f10c80ce970 2024-04-25T09:12:06.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.165+0000 7f10cf600640 1 -- 172.21.15.175:0/368739179 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10c80676b0 con 0x7f10c80ce970 2024-04-25T09:12:06.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.165+0000 7f10c4c00640 1 -- 172.21.15.175:0/368739179 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10b80165e0 con 0x7f10c80ce970 2024-04-25T09:12:06.151 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:12:06.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.165+0000 7f10cf600640 1 -- 172.21.15.175:0/368739179 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f10a8066f60 msgr2=0x7f10a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.165+0000 7f10cf600640 1 --2- 172.21.15.175:0/368739179 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f10a8066f60 0x7f10a8069420 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f10c813f7a0 tx=0x7f10b4007df0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.165+0000 7f10cf600640 1 -- 172.21.15.175:0/368739179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10c80ce970 msgr2=0x7f10c815b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.165+0000 7f10cf600640 1 --2- 172.21.15.175:0/368739179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10c80ce970 0x7f10c815b910 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f10b8019540 tx=0x7f10b80196d0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.165+0000 7f10cf600640 1 -- 172.21.15.175:0/368739179 shutdown_connections 2024-04-25T09:12:06.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.165+0000 7f10cf600640 1 --2- 172.21.15.175:0/368739179 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f10a8066f60 0x7f10a8069420 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.165+0000 7f10cf600640 1 --2- 172.21.15.175:0/368739179 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f10c81600a0 0x7f10c80b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.165+0000 7f10cf600640 1 --2- 172.21.15.175:0/368739179 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f10c8145250 0x7f10c812e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.165+0000 7f10cf600640 1 --2- 172.21.15.175:0/368739179 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10c80ce970 0x7f10c815b910 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.165+0000 7f10cf600640 1 -- 172.21.15.175:0/368739179 >> 172.21.15.175:0/368739179 conn(0x7f10c806ac50 msgr2=0x7f10c8164b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.165+0000 7f10cf600640 1 -- 172.21.15.175:0/368739179 shutdown_connections 2024-04-25T09:12:06.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.165+0000 7f10cf600640 1 -- 172.21.15.175:0/368739179 wait complete. 2024-04-25T09:12:06.172 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:12:06.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.325+0000 7fb327000640 1 Processor -- start 2024-04-25T09:12:06.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.325+0000 7fb327000640 1 -- start start 2024-04-25T09:12:06.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.325+0000 7fb327000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb32015bca0 0x7fb3200b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.325+0000 7fb327000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3200cd7f0 con 0x7fb32009aa90 2024-04-25T09:12:06.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.325+0000 7fb327000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3200cff90 con 0x7fb32009a160 2024-04-25T09:12:06.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.325+0000 7fb327000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32009af10 con 0x7fb32015bca0 2024-04-25T09:12:06.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.325+0000 7fb31f400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb32009aa90 0x7fb320099a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:41434/0 (socket says 172.21.15.175:41434) 2024-04-25T09:12:06.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.325+0000 7fb31f400640 1 -- 172.21.15.175:0/1896281928 learned_addr learned my addr 172.21.15.175:0/1896281928 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:06.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.325+0000 7fb31fe00640 1 --2- 172.21.15.175:0/1896281928 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb32015bca0 0x7fb3200b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.325+0000 7fb31ea00640 1 -- 172.21.15.175:0/1896281928 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766985033 0 0) 0x7fb3200cd7f0 con 0x7fb32009aa90 2024-04-25T09:12:06.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.325+0000 7fb31ea00640 1 -- 172.21.15.175:0/1896281928 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb304003530 con 0x7fb32009aa90 2024-04-25T09:12:06.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.325+0000 7fb31ea00640 1 -- 172.21.15.175:0/1896281928 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673668428 0 0) 0x7fb3200cff90 con 0x7fb32009a160 2024-04-25T09:12:06.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.325+0000 7fb31ea00640 1 -- 172.21.15.175:0/1896281928 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3200cd7f0 con 0x7fb32009a160 2024-04-25T09:12:06.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.325+0000 7fb31fe00640 1 -- 172.21.15.175:0/1896281928 >> v1:172.21.15.177:6789/0 conn(0x7fb32009a160 legacy=0x7fb3200b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.325+0000 7fb31fe00640 1 -- 172.21.15.175:0/1896281928 >> v1:172.21.15.175:6789/0 conn(0x7fb32009aa90 legacy=0x7fb320099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.325+0000 7fb31fe00640 1 -- 172.21.15.175:0/1896281928 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3200d0230 con 0x7fb32015bca0 2024-04-25T09:12:06.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.329+0000 7fb31fe00640 1 --2- 172.21.15.175:0/1896281928 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb32015bca0 0x7fb3200b0ac0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb310009dc0 tx=0x7fb31001c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=998440cc8d65c9a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.329+0000 7fb31ea00640 1 -- 172.21.15.175:0/1896281928 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100b2070 con 0x7fb32015bca0 2024-04-25T09:12:06.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.329+0000 7fb31ea00640 1 -- 172.21.15.175:0/1896281928 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3100a5a20 con 0x7fb32015bca0 2024-04-25T09:12:06.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.329+0000 7fb31ea00640 1 -- 172.21.15.175:0/1896281928 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100a5df0 con 0x7fb32015bca0 2024-04-25T09:12:06.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.329+0000 7fb327000640 1 -- 172.21.15.175:0/1896281928 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb32015bca0 msgr2=0x7fb3200b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.329+0000 7fb327000640 1 --2- 172.21.15.175:0/1896281928 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb32015bca0 0x7fb3200b0ac0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb310009dc0 tx=0x7fb31001c960 comp rx=0 tx=0).stop 2024-04-25T09:12:06.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.329+0000 7fb327000640 1 -- 172.21.15.175:0/1896281928 shutdown_connections 2024-04-25T09:12:06.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.329+0000 7fb327000640 1 --2- 172.21.15.175:0/1896281928 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb32015bca0 0x7fb3200b0ac0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.329+0000 7fb327000640 1 -- 172.21.15.175:0/1896281928 >> 172.21.15.175:0/1896281928 conn(0x7fb3200b3400 msgr2=0x7fb3200b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.329+0000 7fb327000640 1 -- 172.21.15.175:0/1896281928 shutdown_connections 2024-04-25T09:12:06.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.329+0000 7fb327000640 1 -- 172.21.15.175:0/1896281928 wait complete. 2024-04-25T09:12:06.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb327000640 1 Processor -- start 2024-04-25T09:12:06.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb327000640 1 -- start start 2024-04-25T09:12:06.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb327000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb32009a160 0x7fb3201557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb327000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb32009aa90 0x7fb32015eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb327000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb32015bca0 0x7fb320158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb327000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3200b28d0 con 0x7fb32009aa90 2024-04-25T09:12:06.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb327000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3200b2750 con 0x7fb32015bca0 2024-04-25T09:12:06.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb327000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3200b2a50 con 0x7fb32009a160 2024-04-25T09:12:06.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb31f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb32009aa90 0x7fb32015eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb31f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb32009aa90 0x7fb32015eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50332/0 (socket says 172.21.15.175:50332) 2024-04-25T09:12:06.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb31f400640 1 -- 172.21.15.175:0/1434192995 learned_addr learned my addr 172.21.15.175:0/1434192995 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:06.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb31fe00640 1 --2- 172.21.15.175:0/1434192995 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb32009a160 0x7fb3201557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb325000640 1 --2- 172.21.15.175:0/1434192995 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb32015bca0 0x7fb320158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb31f400640 1 -- 172.21.15.175:0/1434192995 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb32009a160 msgr2=0x7fb3201557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb31f400640 1 --2- 172.21.15.175:0/1434192995 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb32009a160 0x7fb3201557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb31f400640 1 -- 172.21.15.175:0/1434192995 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb32015bca0 msgr2=0x7fb320158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb31f400640 1 --2- 172.21.15.175:0/1434192995 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb32015bca0 0x7fb320158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb31f400640 1 -- 172.21.15.175:0/1434192995 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3200cc7c0 con 0x7fb32009aa90 2024-04-25T09:12:06.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb31fe00640 1 --2- 172.21.15.175:0/1434192995 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb32009a160 0x7fb3201557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:06.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb31f400640 1 --2- 172.21.15.175:0/1434192995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb32009aa90 0x7fb32015eb80 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00c4d0 tx=0x7fb30c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb317e00640 1 -- 172.21.15.175:0/1434192995 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c017070 con 0x7fb32009aa90 2024-04-25T09:12:06.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb317e00640 1 -- 172.21.15.175:0/1434192995 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30c005cf0 con 0x7fb32009aa90 2024-04-25T09:12:06.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb327000640 1 -- 172.21.15.175:0/1434192995 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3200ccaa0 con 0x7fb32009aa90 2024-04-25T09:12:06.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb317e00640 1 -- 172.21.15.175:0/1434192995 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c0072b0 con 0x7fb32009aa90 2024-04-25T09:12:06.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb327000640 1 -- 172.21.15.175:0/1434192995 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32015c790 con 0x7fb32009aa90 2024-04-25T09:12:06.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.333+0000 7fb327000640 1 -- 172.21.15.175:0/1434192995 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb320075160 con 0x7fb32009aa90 2024-04-25T09:12:06.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.337+0000 7fb317e00640 1 -- 172.21.15.175:0/1434192995 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb30c01a070 con 0x7fb32009aa90 2024-04-25T09:12:06.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.337+0000 7fb317e00640 1 --2- 172.21.15.175:0/1434192995 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb300066f60 0x7fb300069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.337+0000 7fb317e00640 1 -- 172.21.15.175:0/1434192995 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fb30c084510 con 0x7fb32009aa90 2024-04-25T09:12:06.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.337+0000 7fb31fe00640 1 --2- 172.21.15.175:0/1434192995 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb300066f60 0x7fb300069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.337+0000 7fb31fe00640 1 --2- 172.21.15.175:0/1434192995 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb300066f60 0x7fb300069420 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb3100af000 tx=0x7fb3100a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.341+0000 7fb317e00640 1 -- 172.21.15.175:0/1434192995 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb30c055450 con 0x7fb32009aa90 2024-04-25T09:12:06.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.493+0000 7fb327000640 1 -- 172.21.15.175:0/1434192995 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb32015e960 con 0x7fb32009aa90 2024-04-25T09:12:06.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.493+0000 7fb317e00640 1 -- 172.21.15.175:0/1434192995 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb30c054d50 con 0x7fb32009aa90 2024-04-25T09:12:06.480 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:12:06.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.493+0000 7fb327000640 1 -- 172.21.15.175:0/1434192995 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb300066f60 msgr2=0x7fb300069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.493+0000 7fb327000640 1 --2- 172.21.15.175:0/1434192995 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb300066f60 0x7fb300069420 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb3100af000 tx=0x7fb3100a7070 comp rx=0 tx=0).stop 2024-04-25T09:12:06.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.493+0000 7fb327000640 1 -- 172.21.15.175:0/1434192995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb32009aa90 msgr2=0x7fb32015eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.493+0000 7fb327000640 1 --2- 172.21.15.175:0/1434192995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb32009aa90 0x7fb32015eb80 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fb30c00c4d0 tx=0x7fb30c00c990 comp rx=0 tx=0).stop 2024-04-25T09:12:06.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.493+0000 7fb327000640 1 -- 172.21.15.175:0/1434192995 shutdown_connections 2024-04-25T09:12:06.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.493+0000 7fb327000640 1 --2- 172.21.15.175:0/1434192995 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb300066f60 0x7fb300069420 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.493+0000 7fb327000640 1 --2- 172.21.15.175:0/1434192995 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb32015bca0 0x7fb320158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.493+0000 7fb327000640 1 --2- 172.21.15.175:0/1434192995 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb32009aa90 0x7fb32015eb80 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.493+0000 7fb327000640 1 --2- 172.21.15.175:0/1434192995 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb32009a160 0x7fb3201557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.493+0000 7fb327000640 1 -- 172.21.15.175:0/1434192995 >> 172.21.15.175:0/1434192995 conn(0x7fb3200b3400 msgr2=0x7fb320166d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.493+0000 7fb327000640 1 -- 172.21.15.175:0/1434192995 shutdown_connections 2024-04-25T09:12:06.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.493+0000 7fb327000640 1 -- 172.21.15.175:0/1434192995 wait complete. 2024-04-25T09:12:06.502 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:12:06.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.649+0000 7f4a2b600640 1 Processor -- start 2024-04-25T09:12:06.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a2b600640 1 -- start start 2024-04-25T09:12:06.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a2b600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a24145250 0x7f4a240cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a2b600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a240cfd10 con 0x7f4a241600a0 2024-04-25T09:12:06.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a2b600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a240cfff0 con 0x7f4a240ce970 2024-04-25T09:12:06.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a2b600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2415f650 con 0x7f4a24145250 2024-04-25T09:12:06.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a1be00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4a241600a0 0x7f4a240cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:41436/0 (socket says 172.21.15.175:41436) 2024-04-25T09:12:06.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a1be00640 1 -- 172.21.15.175:0/881409069 learned_addr learned my addr 172.21.15.175:0/881409069 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:06.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a28c00640 1 --2- 172.21.15.175:0/881409069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a24145250 0x7f4a240cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a23e00640 1 -- 172.21.15.175:0/881409069 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856391827 0 0) 0x7f4a240cfd10 con 0x7f4a241600a0 2024-04-25T09:12:06.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a23e00640 1 -- 172.21.15.175:0/881409069 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a08003530 con 0x7f4a241600a0 2024-04-25T09:12:06.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a23e00640 1 -- 172.21.15.175:0/881409069 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507363574 0 0) 0x7f4a240cfff0 con 0x7f4a240ce970 2024-04-25T09:12:06.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a23e00640 1 -- 172.21.15.175:0/881409069 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a240cfd10 con 0x7f4a240ce970 2024-04-25T09:12:06.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a23e00640 1 -- 172.21.15.175:0/881409069 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3498447583 0 0) 0x7f4a08003530 con 0x7f4a241600a0 2024-04-25T09:12:06.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a23e00640 1 -- 172.21.15.175:0/881409069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a24145250 msgr2=0x7f4a240cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a23e00640 1 --2- 172.21.15.175:0/881409069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a24145250 0x7f4a240cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a23e00640 1 -- 172.21.15.175:0/881409069 >> v1:172.21.15.177:6789/0 conn(0x7f4a240ce970 legacy=0x7f4a240cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a23e00640 1 -- 172.21.15.175:0/881409069 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2415f8a0 con 0x7f4a241600a0 2024-04-25T09:12:06.642 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a23e00640 1 -- 172.21.15.175:0/881409069 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f4a0c001680 con 0x7f4a241600a0 2024-04-25T09:12:06.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a28c00640 1 --2- 172.21.15.175:0/881409069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a24145250 0x7f4a240cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:06.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a23e00640 1 -- 172.21.15.175:0/881409069 >> v1:172.21.15.175:6789/0 conn(0x7f4a241600a0 legacy=0x7f4a240cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a23e00640 1 --2- 172.21.15.175:0/881409069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a08003b80 0x7f4a08003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a23e00640 1 --2- 172.21.15.175:0/881409069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a24145250 0x7f4a08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a23e00640 1 --2- 172.21.15.175:0/881409069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a08004d50 0x7f4a080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a23e00640 1 -- 172.21.15.175:0/881409069 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2415f650 con 0x7f4a08004d50 2024-04-25T09:12:06.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a23e00640 1 -- 172.21.15.175:0/881409069 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0800bb60 con 0x7f4a08003b80 2024-04-25T09:12:06.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a23e00640 1 -- 172.21.15.175:0/881409069 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0800bd60 con 0x7f4a24145250 2024-04-25T09:12:06.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a29600640 1 --2- 172.21.15.175:0/881409069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a08004d50 0x7f4a080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a28c00640 1 --2- 172.21.15.175:0/881409069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a08003b80 0x7f4a08003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a1be00640 1 --2- 172.21.15.175:0/881409069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a24145250 0x7f4a08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a29600640 1 -- 172.21.15.175:0/881409069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a24145250 msgr2=0x7f4a08004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a29600640 1 --2- 172.21.15.175:0/881409069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a24145250 0x7f4a08004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a29600640 1 -- 172.21.15.175:0/881409069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a08003b80 msgr2=0x7f4a08003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a29600640 1 --2- 172.21.15.175:0/881409069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a08003b80 0x7f4a08003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a29600640 1 -- 172.21.15.175:0/881409069 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a08003530 con 0x7f4a08004d50 2024-04-25T09:12:06.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.653+0000 7f4a28c00640 1 --2- 172.21.15.175:0/881409069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a08003b80 0x7f4a08003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:06.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.657+0000 7f4a29600640 1 --2- 172.21.15.175:0/881409069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a08004d50 0x7f4a080051d0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c001fd0 tx=0x7f4a1c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a87427a025262e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.657+0000 7f4a23e00640 1 -- 172.21.15.175:0/881409069 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c001c20 con 0x7f4a08004d50 2024-04-25T09:12:06.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.657+0000 7f4a23e00640 1 -- 172.21.15.175:0/881409069 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c003ba0 con 0x7f4a08004d50 2024-04-25T09:12:06.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.657+0000 7f4a23e00640 1 -- 172.21.15.175:0/881409069 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c0050d0 con 0x7f4a08004d50 2024-04-25T09:12:06.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.657+0000 7f4a2b600640 1 -- 172.21.15.175:0/881409069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a08004d50 msgr2=0x7f4a080051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.657+0000 7f4a2b600640 1 --2- 172.21.15.175:0/881409069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a08004d50 0x7f4a080051d0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c001fd0 tx=0x7f4a1c01c8d0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.657+0000 7f4a29600640 1 -- 172.21.15.175:0/881409069 reap_dead start 2024-04-25T09:12:06.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.657+0000 7f4a2b600640 1 -- 172.21.15.175:0/881409069 shutdown_connections 2024-04-25T09:12:06.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.657+0000 7f4a2b600640 1 -- 172.21.15.175:0/881409069 >> 172.21.15.175:0/881409069 conn(0x7f4a2406ac50 msgr2=0x7f4a2406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.657+0000 7f4a2b600640 1 -- 172.21.15.175:0/881409069 shutdown_connections 2024-04-25T09:12:06.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.657+0000 7f4a2b600640 1 -- 172.21.15.175:0/881409069 wait complete. 2024-04-25T09:12:06.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a2b600640 1 Processor -- start 2024-04-25T09:12:06.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a2b600640 1 -- start start 2024-04-25T09:12:06.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a2b600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a2415acd0 0x7f4a2414c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a2b600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a2415b0b0 0x7f4a2414e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a2b600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a2415bb70 0x7f4a2413f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a2b600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2415c9f0 con 0x7f4a2415b0b0 2024-04-25T09:12:06.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a2b600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2415c870 con 0x7f4a2415acd0 2024-04-25T09:12:06.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a2b600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2415cb70 con 0x7f4a2415bb70 2024-04-25T09:12:06.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a1be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a2415b0b0 0x7f4a2414e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a1be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a2415b0b0 0x7f4a2414e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50350/0 (socket says 172.21.15.175:50350) 2024-04-25T09:12:06.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a1be00640 1 -- 172.21.15.175:0/2171784689 learned_addr learned my addr 172.21.15.175:0/2171784689 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:06.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a28c00640 1 --2- 172.21.15.175:0/2171784689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a2415acd0 0x7f4a2414c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a29600640 1 --2- 172.21.15.175:0/2171784689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a2415bb70 0x7f4a2413f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a1be00640 1 -- 172.21.15.175:0/2171784689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a2415bb70 msgr2=0x7f4a2413f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a1be00640 1 --2- 172.21.15.175:0/2171784689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a2415bb70 0x7f4a2413f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a1be00640 1 -- 172.21.15.175:0/2171784689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a2415acd0 msgr2=0x7f4a2414c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a1be00640 1 --2- 172.21.15.175:0/2171784689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a2415acd0 0x7f4a2414c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a1be00640 1 -- 172.21.15.175:0/2171784689 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2414e9a0 con 0x7f4a2415b0b0 2024-04-25T09:12:06.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a1be00640 1 --2- 172.21.15.175:0/2171784689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a2415b0b0 0x7f4a2414e070 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c0070e0 tx=0x7f4a0c004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a21600640 1 -- 172.21.15.175:0/2171784689 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c007720 con 0x7f4a2415b0b0 2024-04-25T09:12:06.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a21600640 1 -- 172.21.15.175:0/2171784689 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c018070 con 0x7f4a2415b0b0 2024-04-25T09:12:06.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a2b600640 1 -- 172.21.15.175:0/2171784689 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a2414ec80 con 0x7f4a2415b0b0 2024-04-25T09:12:06.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a21600640 1 -- 172.21.15.175:0/2171784689 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c00fb80 con 0x7f4a2415b0b0 2024-04-25T09:12:06.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.661+0000 7f4a2b600640 1 -- 172.21.15.175:0/2171784689 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a24141100 con 0x7f4a2415b0b0 2024-04-25T09:12:06.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.665+0000 7f4a2b600640 1 -- 172.21.15.175:0/2171784689 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a24075160 con 0x7f4a2415b0b0 2024-04-25T09:12:06.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.665+0000 7f4a21600640 1 -- 172.21.15.175:0/2171784689 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4a0c00fd20 con 0x7f4a2415b0b0 2024-04-25T09:12:06.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.665+0000 7f4a21600640 1 --2- 172.21.15.175:0/2171784689 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4a00066f60 0x7f4a00069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.665+0000 7f4a21600640 1 -- 172.21.15.175:0/2171784689 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f4a0c084fa0 con 0x7f4a2415b0b0 2024-04-25T09:12:06.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.665+0000 7f4a28c00640 1 --2- 172.21.15.175:0/2171784689 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4a00066f60 0x7f4a00069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.653 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.665+0000 7f4a28c00640 1 --2- 172.21.15.175:0/2171784689 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4a00066f60 0x7f4a00069420 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009d70 tx=0x7f4a14009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.669+0000 7f4a21600640 1 -- 172.21.15.175:0/2171784689 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4a0c0557f0 con 0x7f4a2415b0b0 2024-04-25T09:12:06.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.833+0000 7f4a2b600640 1 -- 172.21.15.175:0/2171784689 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4a2414c550 con 0x7f4a2415b0b0 2024-04-25T09:12:06.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.833+0000 7f4a21600640 1 -- 172.21.15.175:0/2171784689 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v88) v1 ==== 80+0+248 (secure 0 0 0) 0x7f4a0c059890 con 0x7f4a2415b0b0 2024-04-25T09:12:06.821 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175:6837/1399691338 2024-04-26T09:11:26.715601+0000 2024-04-25T09:12:06.821 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175:6835/1399691338 2024-04-26T09:11:26.715601+0000 2024-04-25T09:12:06.821 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175:6837/1755192276 2024-04-26T09:10:14.425304+0000 2024-04-25T09:12:06.821 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175:6835/1755192276 2024-04-26T09:10:14.425304+0000 2024-04-25T09:12:06.822 INFO:teuthology.orchestra.run.smithi175.stderr:listed 4 entries 2024-04-25T09:12:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.837+0000 7f4a2b600640 1 -- 172.21.15.175:0/2171784689 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4a00066f60 msgr2=0x7f4a00069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.837+0000 7f4a2b600640 1 --2- 172.21.15.175:0/2171784689 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4a00066f60 0x7f4a00069420 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4a14009d70 tx=0x7f4a14009190 comp rx=0 tx=0).stop 2024-04-25T09:12:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.837+0000 7f4a2b600640 1 -- 172.21.15.175:0/2171784689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a2415b0b0 msgr2=0x7f4a2414e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.837+0000 7f4a2b600640 1 --2- 172.21.15.175:0/2171784689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a2415b0b0 0x7f4a2414e070 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c0070e0 tx=0x7f4a0c004f90 comp rx=0 tx=0).stop 2024-04-25T09:12:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.837+0000 7f4a2b600640 1 -- 172.21.15.175:0/2171784689 shutdown_connections 2024-04-25T09:12:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.837+0000 7f4a2b600640 1 --2- 172.21.15.175:0/2171784689 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4a00066f60 0x7f4a00069420 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.837+0000 7f4a2b600640 1 --2- 172.21.15.175:0/2171784689 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a2415bb70 0x7f4a2413f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.837+0000 7f4a2b600640 1 --2- 172.21.15.175:0/2171784689 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a2415b0b0 0x7f4a2414e070 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.837+0000 7f4a2b600640 1 --2- 172.21.15.175:0/2171784689 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a2415acd0 0x7f4a2414c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.837+0000 7f4a2b600640 1 -- 172.21.15.175:0/2171784689 >> 172.21.15.175:0/2171784689 conn(0x7f4a2406ac50 msgr2=0x7f4a2406eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.837+0000 7f4a2b600640 1 -- 172.21.15.175:0/2171784689 shutdown_connections 2024-04-25T09:12:06.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:06.837+0000 7f4a2b600640 1 -- 172.21.15.175:0/2171784689 wait complete. 2024-04-25T09:12:06.842 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:12:06.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:06.842 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:06.867 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:12:06.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:06.868 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:12:06.919 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:12:06.919 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:06.928 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:12:06.929 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:12:06.929 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:06.970 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:12:06.970 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:12:06.970 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:06.980 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:12:06.980 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:07.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.161+0000 7fcbb1000640 1 Processor -- start 2024-04-25T09:12:07.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.161+0000 7fcbb1000640 1 -- start start 2024-04-25T09:12:07.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.161+0000 7fcbb1000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcbac144fc0 0x7fcbac0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.161+0000 7fcbb1000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbac15cd00 con 0x7fcbac15c5e0 2024-04-25T09:12:07.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.161+0000 7fcbb1000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbac0ce660 con 0x7fcbac1453a0 2024-04-25T09:12:07.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.161+0000 7fcbb1000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbac0cc930 con 0x7fcbac144fc0 2024-04-25T09:12:07.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.161+0000 7fcbaa800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fcbac15c5e0 0x7fcbac0cee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:41442/0 (socket says 172.21.15.175:41442) 2024-04-25T09:12:07.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.161+0000 7fcbaa800640 1 -- 172.21.15.175:0/1971405631 learned_addr learned my addr 172.21.15.175:0/1971405631 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:07.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.165+0000 7fcba9e00640 1 --2- 172.21.15.175:0/1971405631 >> v2:172.21.15.177:3300/0 conn(0x7fcbac144fc0 0x7fcbac0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.165+0000 7fcba9400640 1 -- 172.21.15.175:0/1971405631 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2285991702 0 0) 0x7fcbac15cd00 con 0x7fcbac15c5e0 2024-04-25T09:12:07.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.165+0000 7fcba9400640 1 -- 172.21.15.175:0/1971405631 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb90003530 con 0x7fcbac15c5e0 2024-04-25T09:12:07.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.165+0000 7fcba9400640 1 -- 172.21.15.175:0/1971405631 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413641995 0 0) 0x7fcbac0ce660 con 0x7fcbac1453a0 2024-04-25T09:12:07.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.165+0000 7fcba9400640 1 -- 172.21.15.175:0/1971405631 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbac15cd00 con 0x7fcbac1453a0 2024-04-25T09:12:07.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.165+0000 7fcba9e00640 1 -- 172.21.15.175:0/1971405631 >> v1:172.21.15.177:6789/0 conn(0x7fcbac1453a0 legacy=0x7fcbac15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.165+0000 7fcba9e00640 1 -- 172.21.15.175:0/1971405631 >> v1:172.21.15.175:6789/0 conn(0x7fcbac15c5e0 legacy=0x7fcbac0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.165+0000 7fcba9e00640 1 -- 172.21.15.175:0/1971405631 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac0ccc10 con 0x7fcbac144fc0 2024-04-25T09:12:07.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.165+0000 7fcba9e00640 1 --2- 172.21.15.175:0/1971405631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbac144fc0 0x7fcbac0cbe70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0097f0 tx=0x7fcb9c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f38e8bfd58dafbbe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.165+0000 7fcba9400640 1 -- 172.21.15.175:0/1971405631 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c0b1070 con 0x7fcbac144fc0 2024-04-25T09:12:07.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.165+0000 7fcba9400640 1 -- 172.21.15.175:0/1971405631 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9c0ac5f0 con 0x7fcbac144fc0 2024-04-25T09:12:07.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.165+0000 7fcba9400640 1 -- 172.21.15.175:0/1971405631 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c0ac9c0 con 0x7fcbac144fc0 2024-04-25T09:12:07.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcbb1000640 1 -- 172.21.15.175:0/1971405631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbac144fc0 msgr2=0x7fcbac0cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcbb1000640 1 --2- 172.21.15.175:0/1971405631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbac144fc0 0x7fcbac0cbe70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0097f0 tx=0x7fcb9c01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcbb1000640 1 -- 172.21.15.175:0/1971405631 shutdown_connections 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcbb1000640 1 --2- 172.21.15.175:0/1971405631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbac144fc0 0x7fcbac0cbe70 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcbb1000640 1 -- 172.21.15.175:0/1971405631 >> 172.21.15.175:0/1971405631 conn(0x7fcbac067150 msgr2=0x7fcbac06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcbb1000640 1 -- 172.21.15.175:0/1971405631 shutdown_connections 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcbb1000640 1 -- 172.21.15.175:0/1971405631 wait complete. 2024-04-25T09:12:07.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcbb1000640 1 Processor -- start 2024-04-25T09:12:07.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcbb1000640 1 -- start start 2024-04-25T09:12:07.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcbb1000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbac1453a0 0x7fcbac0cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcbb1000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbac15c5e0 0x7fcbac1461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcbb1000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcbac146730 0x7fcbac0b1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcbb1000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac169600 con 0x7fcbac15c5e0 2024-04-25T09:12:07.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcbb1000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac0cff50 con 0x7fcbac1453a0 2024-04-25T09:12:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcbb1000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac169780 con 0x7fcbac146730 2024-04-25T09:12:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcba1400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbac15c5e0 0x7fcbac1461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcba1400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbac15c5e0 0x7fcbac1461f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50354/0 (socket says 172.21.15.175:50354) 2024-04-25T09:12:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcba1400640 1 -- 172.21.15.175:0/3076924379 learned_addr learned my addr 172.21.15.175:0/3076924379 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcba9e00640 1 --2- 172.21.15.175:0/3076924379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbac1453a0 0x7fcbac0cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcbaa800640 1 --2- 172.21.15.175:0/3076924379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcbac146730 0x7fcbac0b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcba1400640 1 -- 172.21.15.175:0/3076924379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcbac146730 msgr2=0x7fcbac0b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcba1400640 1 --2- 172.21.15.175:0/3076924379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcbac146730 0x7fcbac0b1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcba1400640 1 -- 172.21.15.175:0/3076924379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbac1453a0 msgr2=0x7fcbac0cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcba1400640 1 --2- 172.21.15.175:0/3076924379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbac1453a0 0x7fcbac0cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.169+0000 7fcba1400640 1 -- 172.21.15.175:0/3076924379 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac0b02c0 con 0x7fcbac15c5e0 2024-04-25T09:12:07.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.173+0000 7fcba1400640 1 --2- 172.21.15.175:0/3076924379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbac15c5e0 0x7fcbac1461f0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400c420 tx=0x7fcb9400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.173+0000 7fcba2a00640 1 -- 172.21.15.175:0/3076924379 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94017070 con 0x7fcbac15c5e0 2024-04-25T09:12:07.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.173+0000 7fcba2a00640 1 -- 172.21.15.175:0/3076924379 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb940052d0 con 0x7fcbac15c5e0 2024-04-25T09:12:07.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.173+0000 7fcba2a00640 1 -- 172.21.15.175:0/3076924379 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb940054c0 con 0x7fcbac15c5e0 2024-04-25T09:12:07.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.173+0000 7fcbb1000640 1 -- 172.21.15.175:0/3076924379 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbac0b05a0 con 0x7fcbac15c5e0 2024-04-25T09:12:07.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.173+0000 7fcbb1000640 1 -- 172.21.15.175:0/3076924379 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac0b0b60 con 0x7fcbac15c5e0 2024-04-25T09:12:07.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.173+0000 7fcbb1000640 1 -- 172.21.15.175:0/3076924379 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbac074a60 con 0x7fcbac15c5e0 2024-04-25T09:12:07.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.173+0000 7fcba2a00640 1 -- 172.21.15.175:0/3076924379 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcb9401a070 con 0x7fcbac15c5e0 2024-04-25T09:12:07.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.173+0000 7fcba2a00640 1 --2- 172.21.15.175:0/3076924379 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcb88066f60 0x7fcb88069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.173+0000 7fcba2a00640 1 -- 172.21.15.175:0/3076924379 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fcb940843b0 con 0x7fcbac15c5e0 2024-04-25T09:12:07.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.173+0000 7fcba9e00640 1 --2- 172.21.15.175:0/3076924379 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcb88066f60 0x7fcb88069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.177+0000 7fcba9e00640 1 --2- 172.21.15.175:0/3076924379 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcb88066f60 0x7fcb88069420 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0ae000 tx=0x7fcb9c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.177+0000 7fcba2a00640 1 -- 172.21.15.175:0/3076924379 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcb94054ca0 con 0x7fcbac15c5e0 2024-04-25T09:12:07.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.365+0000 7fcbb1000640 1 -- 172.21.15.175:0/3076924379 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbac0cb670 con 0x7fcbac15c5e0 2024-04-25T09:12:07.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.365+0000 7fcba2a00640 1 -- 172.21.15.175:0/3076924379 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fcb94058d40 con 0x7fcbac15c5e0 2024-04-25T09:12:07.352 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:07.352 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":71,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3229536012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3229536012},{"type":"v1","addr":"172.21.15.177:6834","nonce":3229536012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/222649735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":222649735},{"type":"v1","addr":"172.21.15.177:6835","nonce":222649735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2888989442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2888989442},{"type":"v1","addr":"172.21.15.175:6836","nonce":2888989442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:03.786939+0000","modified":"2024-04-25T09:11:29.735549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7303":{"gid":7303,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6837/279367590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":279367590},{"type":"v1","addr":"172.21.15.175:6837","nonce":279367590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:12:07.352 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 71 2024-04-25T09:12:07.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.365+0000 7fcbb1000640 1 -- 172.21.15.175:0/3076924379 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcb88066f60 msgr2=0x7fcb88069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.365+0000 7fcbb1000640 1 --2- 172.21.15.175:0/3076924379 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcb88066f60 0x7fcb88069420 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0ae000 tx=0x7fcb9c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:12:07.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.365+0000 7fcbb1000640 1 -- 172.21.15.175:0/3076924379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbac15c5e0 msgr2=0x7fcbac1461f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.365+0000 7fcbb1000640 1 --2- 172.21.15.175:0/3076924379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbac15c5e0 0x7fcbac1461f0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400c420 tx=0x7fcb9400c8e0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.365+0000 7fcbb1000640 1 -- 172.21.15.175:0/3076924379 shutdown_connections 2024-04-25T09:12:07.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.365+0000 7fcbb1000640 1 --2- 172.21.15.175:0/3076924379 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcb88066f60 0x7fcb88069420 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.365+0000 7fcbb1000640 1 --2- 172.21.15.175:0/3076924379 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcbac146730 0x7fcbac0b1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.365+0000 7fcbb1000640 1 --2- 172.21.15.175:0/3076924379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbac15c5e0 0x7fcbac1461f0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.365+0000 7fcbb1000640 1 --2- 172.21.15.175:0/3076924379 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcbac1453a0 0x7fcbac0cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.365+0000 7fcbb1000640 1 -- 172.21.15.175:0/3076924379 >> 172.21.15.175:0/3076924379 conn(0x7fcbac144fc0 msgr2=0x7fcbac0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:07.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.369+0000 7fcbb1000640 1 -- 172.21.15.175:0/3076924379 shutdown_connections 2024-04-25T09:12:07.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.369+0000 7fcbb1000640 1 -- 172.21.15.175:0/3076924379 wait complete. 2024-04-25T09:12:07.373 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:07.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.521+0000 7f94f3000640 1 Processor -- start 2024-04-25T09:12:07.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.521+0000 7f94f3000640 1 -- start start 2024-04-25T09:12:07.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94f3000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f94ec15a900 0x7f94ec06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94f3000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ec0cda00 con 0x7f94ec0cd520 2024-04-25T09:12:07.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94f3000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ec0cdce0 con 0x7f94ec0cf560 2024-04-25T09:12:07.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94f3000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ec15bcf0 con 0x7f94ec15a900 2024-04-25T09:12:07.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94e3400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f94ec0cd520 0x7f94ec0ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:41444/0 (socket says 172.21.15.175:41444) 2024-04-25T09:12:07.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94e3400640 1 -- 172.21.15.175:0/2086615088 learned_addr learned my addr 172.21.15.175:0/2086615088 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:07.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94eb400640 1 -- 172.21.15.175:0/2086615088 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402148936 0 0) 0x7f94ec0cda00 con 0x7f94ec0cd520 2024-04-25T09:12:07.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94eb400640 1 -- 172.21.15.175:0/2086615088 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94d0003530 con 0x7f94ec0cd520 2024-04-25T09:12:07.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94ebe00640 1 --2- 172.21.15.175:0/2086615088 >> v2:172.21.15.177:3300/0 conn(0x7f94ec15a900 0x7f94ec06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94eb400640 1 -- 172.21.15.175:0/2086615088 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 91551947 0 0) 0x7f94d0003530 con 0x7f94ec0cd520 2024-04-25T09:12:07.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94eb400640 1 -- 172.21.15.175:0/2086615088 >> v2:172.21.15.177:3300/0 conn(0x7f94ec15a900 msgr2=0x7f94ec06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:07.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94eb400640 1 --2- 172.21.15.175:0/2086615088 >> v2:172.21.15.177:3300/0 conn(0x7f94ec15a900 0x7f94ec06e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94eb400640 1 -- 172.21.15.175:0/2086615088 >> v1:172.21.15.177:6789/0 conn(0x7f94ec0cf560 legacy=0x7f94ec15bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94eb400640 1 -- 172.21.15.175:0/2086615088 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec0cdfc0 con 0x7f94ec0cd520 2024-04-25T09:12:07.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94eb400640 1 -- 172.21.15.175:0/2086615088 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f94d4001680 con 0x7f94ec0cd520 2024-04-25T09:12:07.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94eb400640 1 -- 172.21.15.175:0/2086615088 >> v1:172.21.15.175:6789/0 conn(0x7f94ec0cd520 legacy=0x7f94ec0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94eb400640 1 --2- 172.21.15.175:0/2086615088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d00039c0 0x7f94d0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94eb400640 1 --2- 172.21.15.175:0/2086615088 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d0004810 0x7f94d0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94eb400640 1 --2- 172.21.15.175:0/2086615088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94d00051d0 0x7f94d000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94eb400640 1 -- 172.21.15.175:0/2086615088 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d000c0f0 con 0x7f94d00039c0 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94eb400640 1 -- 172.21.15.175:0/2086615088 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d000c2a0 con 0x7f94d00051d0 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94eb400640 1 -- 172.21.15.175:0/2086615088 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94d000c4a0 con 0x7f94d0004810 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94ebe00640 1 --2- 172.21.15.175:0/2086615088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d00039c0 0x7f94d0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94e3400640 1 --2- 172.21.15.175:0/2086615088 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d0004810 0x7f94d0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94f1000640 1 --2- 172.21.15.175:0/2086615088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94d00051d0 0x7f94d000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94ebe00640 1 -- 172.21.15.175:0/2086615088 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d0004810 msgr2=0x7f94d0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94ebe00640 1 --2- 172.21.15.175:0/2086615088 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94d0004810 0x7f94d0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94ebe00640 1 -- 172.21.15.175:0/2086615088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94d00051d0 msgr2=0x7f94d000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94ebe00640 1 --2- 172.21.15.175:0/2086615088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94d00051d0 0x7f94d000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94ebe00640 1 -- 172.21.15.175:0/2086615088 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d0003530 con 0x7f94d00039c0 2024-04-25T09:12:07.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.525+0000 7f94f1000640 1 -- 172.21.15.175:0/2086615088 reap_dead start 2024-04-25T09:12:07.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.529+0000 7f94ebe00640 1 --2- 172.21.15.175:0/2086615088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d00039c0 0x7f94d0003de0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00ba30 tx=0x7f94dc01c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb1f49b919ef458 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.529+0000 7f94eb400640 1 -- 172.21.15.175:0/2086615088 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc00b600 con 0x7f94d00039c0 2024-04-25T09:12:07.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.529+0000 7f94eb400640 1 -- 172.21.15.175:0/2086615088 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc0b0070 con 0x7f94d00039c0 2024-04-25T09:12:07.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.529+0000 7f94eb400640 1 -- 172.21.15.175:0/2086615088 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc0ab8c0 con 0x7f94d00039c0 2024-04-25T09:12:07.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.529+0000 7f94f3000640 1 -- 172.21.15.175:0/2086615088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d00039c0 msgr2=0x7f94d0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.529+0000 7f94f3000640 1 --2- 172.21.15.175:0/2086615088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d00039c0 0x7f94d0003de0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00ba30 tx=0x7f94dc01c670 comp rx=0 tx=0).stop 2024-04-25T09:12:07.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.529+0000 7f94f3000640 1 -- 172.21.15.175:0/2086615088 shutdown_connections 2024-04-25T09:12:07.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.529+0000 7f94f3000640 1 --2- 172.21.15.175:0/2086615088 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94d00039c0 0x7f94d0003de0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.529+0000 7f94f3000640 1 -- 172.21.15.175:0/2086615088 >> 172.21.15.175:0/2086615088 conn(0x7f94ec067150 msgr2=0x7f94ec06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:07.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.529+0000 7f94f3000640 1 -- 172.21.15.175:0/2086615088 shutdown_connections 2024-04-25T09:12:07.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.529+0000 7f94f3000640 1 -- 172.21.15.175:0/2086615088 wait complete. 2024-04-25T09:12:07.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.529+0000 7f94f3000640 1 Processor -- start 2024-04-25T09:12:07.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.529+0000 7f94f3000640 1 -- start start 2024-04-25T09:12:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94f3000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94ec148f50 0x7f94ec1498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94f3000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94ec152450 0x7f94ec0b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94f3000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94ec149330 0x7f94ec153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94f3000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec0cfed0 con 0x7f94ec148f50 2024-04-25T09:12:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94f3000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec0cfd50 con 0x7f94ec149330 2024-04-25T09:12:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94f3000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec06d3b0 con 0x7f94ec152450 2024-04-25T09:12:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94ebe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94ec148f50 0x7f94ec1498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94ebe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94ec148f50 0x7f94ec1498b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50376/0 (socket says 172.21.15.175:50376) 2024-04-25T09:12:07.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94ebe00640 1 -- 172.21.15.175:0/2677782648 learned_addr learned my addr 172.21.15.175:0/2677782648 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:07.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94ebe00640 1 -- 172.21.15.175:0/2677782648 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94ec152450 msgr2=0x7f94ec0b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94ebe00640 1 --2- 172.21.15.175:0/2677782648 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94ec152450 0x7f94ec0b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94ebe00640 1 -- 172.21.15.175:0/2677782648 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94ec149330 msgr2=0x7f94ec153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94ebe00640 1 --2- 172.21.15.175:0/2677782648 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94ec149330 0x7f94ec153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94ebe00640 1 -- 172.21.15.175:0/2677782648 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec15d030 con 0x7f94ec148f50 2024-04-25T09:12:07.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94ebe00640 1 --2- 172.21.15.175:0/2677782648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94ec148f50 0x7f94ec1498b0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0ad040 tx=0x7f94d0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94e8c00640 1 -- 172.21.15.175:0/2677782648 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc0ba070 con 0x7f94ec148f50 2024-04-25T09:12:07.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94e8c00640 1 -- 172.21.15.175:0/2677782648 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc004220 con 0x7f94ec148f50 2024-04-25T09:12:07.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94f3000640 1 -- 172.21.15.175:0/2677782648 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ec15d310 con 0x7f94ec148f50 2024-04-25T09:12:07.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94e8c00640 1 -- 172.21.15.175:0/2677782648 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc0ab950 con 0x7f94ec148f50 2024-04-25T09:12:07.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94f3000640 1 -- 172.21.15.175:0/2677782648 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ec15d8d0 con 0x7f94ec148f50 2024-04-25T09:12:07.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94f3000640 1 -- 172.21.15.175:0/2677782648 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ec074a60 con 0x7f94ec148f50 2024-04-25T09:12:07.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.533+0000 7f94e8c00640 1 -- 172.21.15.175:0/2677782648 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f94dc0abaf0 con 0x7f94ec148f50 2024-04-25T09:12:07.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.537+0000 7f94e8c00640 1 --2- 172.21.15.175:0/2677782648 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f94c8066f60 0x7f94c8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.537+0000 7f94e8c00640 1 -- 172.21.15.175:0/2677782648 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f94dc11fb60 con 0x7f94ec148f50 2024-04-25T09:12:07.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.537+0000 7f94e3400640 1 --2- 172.21.15.175:0/2677782648 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f94c8066f60 0x7f94c8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.537+0000 7f94e3400640 1 --2- 172.21.15.175:0/2677782648 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f94c8066f60 0x7f94c8069420 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f94d4001210 tx=0x7f94d4001160 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.541+0000 7f94e8c00640 1 -- 172.21.15.175:0/2677782648 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f94dc0c4060 con 0x7f94ec148f50 2024-04-25T09:12:07.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.693+0000 7f94f3000640 1 -- 172.21.15.175:0/2677782648 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94ec158fb0 con 0x7f94ec148f50 2024-04-25T09:12:07.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.693+0000 7f94e8c00640 1 -- 172.21.15.175:0/2677782648 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+17009 (secure 0 0 0) 0x7f94dc0163b0 con 0x7f94ec148f50 2024-04-25T09:12:07.681 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:07.681 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":88,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:11:26.715623+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:01.518283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:02.788015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.38","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6837/1399691338":"2024-04-26T09:11:26.715601+0000","172.21.15.175:6835/1399691338":"2024-04-26T09:11:26.715601+0000","172.21.15.175:6837/1755192276":"2024-04-26T09:10:14.425304+0000","172.21.15.175:6835/1755192276":"2024-04-26T09:10:14.425304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:07.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.697+0000 7f94f3000640 1 -- 172.21.15.175:0/2677782648 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f94c8066f60 msgr2=0x7f94c8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.697+0000 7f94f3000640 1 --2- 172.21.15.175:0/2677782648 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f94c8066f60 0x7f94c8069420 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f94d4001210 tx=0x7f94d4001160 comp rx=0 tx=0).stop 2024-04-25T09:12:07.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.697+0000 7f94f3000640 1 -- 172.21.15.175:0/2677782648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94ec148f50 msgr2=0x7f94ec1498b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.697+0000 7f94f3000640 1 --2- 172.21.15.175:0/2677782648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94ec148f50 0x7f94ec1498b0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0ad040 tx=0x7f94d0005840 comp rx=0 tx=0).stop 2024-04-25T09:12:07.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.697+0000 7f94f3000640 1 -- 172.21.15.175:0/2677782648 shutdown_connections 2024-04-25T09:12:07.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.697+0000 7f94f3000640 1 --2- 172.21.15.175:0/2677782648 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f94c8066f60 0x7f94c8069420 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.697+0000 7f94f3000640 1 --2- 172.21.15.175:0/2677782648 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f94ec149330 0x7f94ec153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.697+0000 7f94f3000640 1 --2- 172.21.15.175:0/2677782648 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f94ec152450 0x7f94ec0b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.697+0000 7f94f3000640 1 --2- 172.21.15.175:0/2677782648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94ec148f50 0x7f94ec1498b0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.697+0000 7f94f3000640 1 -- 172.21.15.175:0/2677782648 >> 172.21.15.175:0/2677782648 conn(0x7f94d00039c0 msgr2=0x7f94ec071240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:07.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.697+0000 7f94f3000640 1 -- 172.21.15.175:0/2677782648 shutdown_connections 2024-04-25T09:12:07.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.697+0000 7f94f3000640 1 -- 172.21.15.175:0/2677782648 wait complete. 2024-04-25T09:12:07.702 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:10:01.518283+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:10:02.788015+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:12:07.702 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:12:07.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.853+0000 7fc46fc00640 1 Processor -- start 2024-04-25T09:12:07.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.853+0000 7fc46fc00640 1 -- start start 2024-04-25T09:12:07.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.853+0000 7fc46fc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc46815ddf0 0x7fc468099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.857+0000 7fc46fc00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4680d0b40 con 0x7fc46806cd70 2024-04-25T09:12:07.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.857+0000 7fc46fc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4680d0e20 con 0x7fc4680d0630 2024-04-25T09:12:07.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.857+0000 7fc46fc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4680cbf60 con 0x7fc46815ddf0 2024-04-25T09:12:07.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.857+0000 7fc46dc00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc46806cd70 0x7fc4680ccb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:41460/0 (socket says 172.21.15.175:41460) 2024-04-25T09:12:07.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.857+0000 7fc46dc00640 1 -- 172.21.15.175:0/1081931710 learned_addr learned my addr 172.21.15.175:0/1081931710 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:07.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.857+0000 7fc46d200640 1 --2- 172.21.15.175:0/1081931710 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc46815ddf0 0x7fc468099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.857+0000 7fc467e00640 1 -- 172.21.15.175:0/1081931710 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741811591 0 0) 0x7fc4680d0b40 con 0x7fc46806cd70 2024-04-25T09:12:07.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.857+0000 7fc467e00640 1 -- 172.21.15.175:0/1081931710 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc44c003530 con 0x7fc46806cd70 2024-04-25T09:12:07.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.857+0000 7fc467e00640 1 -- 172.21.15.175:0/1081931710 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389443491 0 0) 0x7fc4680d0e20 con 0x7fc4680d0630 2024-04-25T09:12:07.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.857+0000 7fc467e00640 1 -- 172.21.15.175:0/1081931710 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4680d0b40 con 0x7fc4680d0630 2024-04-25T09:12:07.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.857+0000 7fc46d200640 1 -- 172.21.15.175:0/1081931710 >> v1:172.21.15.177:6789/0 conn(0x7fc4680d0630 legacy=0x7fc4680cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.857+0000 7fc46d200640 1 -- 172.21.15.175:0/1081931710 >> v1:172.21.15.175:6789/0 conn(0x7fc46806cd70 legacy=0x7fc4680ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.857+0000 7fc46d200640 1 -- 172.21.15.175:0/1081931710 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4680d1100 con 0x7fc46815ddf0 2024-04-25T09:12:07.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc46d200640 1 --2- 172.21.15.175:0/1081931710 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc46815ddf0 0x7fc468099a50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc4580097f0 tx=0x7fc45801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a03a7f51c012339a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc467e00640 1 -- 172.21.15.175:0/1081931710 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4580b0070 con 0x7fc46815ddf0 2024-04-25T09:12:07.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc467e00640 1 -- 172.21.15.175:0/1081931710 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4580ab600 con 0x7fc46815ddf0 2024-04-25T09:12:07.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc467e00640 1 -- 172.21.15.175:0/1081931710 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4580ab9b0 con 0x7fc46815ddf0 2024-04-25T09:12:07.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc46fc00640 1 -- 172.21.15.175:0/1081931710 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc46815ddf0 msgr2=0x7fc468099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc46fc00640 1 --2- 172.21.15.175:0/1081931710 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc46815ddf0 0x7fc468099a50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc4580097f0 tx=0x7fc45801c4e0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc46fc00640 1 -- 172.21.15.175:0/1081931710 shutdown_connections 2024-04-25T09:12:07.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc46fc00640 1 --2- 172.21.15.175:0/1081931710 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc46815ddf0 0x7fc468099a50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc46fc00640 1 -- 172.21.15.175:0/1081931710 >> 172.21.15.175:0/1081931710 conn(0x7fc4680b3400 msgr2=0x7fc4680b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:07.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc46fc00640 1 -- 172.21.15.175:0/1081931710 shutdown_connections 2024-04-25T09:12:07.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc46fc00640 1 -- 172.21.15.175:0/1081931710 wait complete. 2024-04-25T09:12:07.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc46fc00640 1 Processor -- start 2024-04-25T09:12:07.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc46fc00640 1 -- start start 2024-04-25T09:12:07.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc46fc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc46806cd70 0x7fc4680b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc46fc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4680d0630 0x7fc468154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc46fc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc46815ddf0 0x7fc4680ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc46fc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46816c080 con 0x7fc4680d0630 2024-04-25T09:12:07.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc46fc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46809a3a0 con 0x7fc46806cd70 2024-04-25T09:12:07.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc46fc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46816c200 con 0x7fc46815ddf0 2024-04-25T09:12:07.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.861+0000 7fc45fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4680d0630 0x7fc468154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc45fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4680d0630 0x7fc468154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50388/0 (socket says 172.21.15.175:50388) 2024-04-25T09:12:07.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc45fe00640 1 -- 172.21.15.175:0/3231327378 learned_addr learned my addr 172.21.15.175:0/3231327378 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:07.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc46d200640 1 --2- 172.21.15.175:0/3231327378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc46806cd70 0x7fc4680b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc46dc00640 1 --2- 172.21.15.175:0/3231327378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc46815ddf0 0x7fc4680ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc45fe00640 1 -- 172.21.15.175:0/3231327378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc46815ddf0 msgr2=0x7fc4680ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc45fe00640 1 --2- 172.21.15.175:0/3231327378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc46815ddf0 0x7fc4680ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc45fe00640 1 -- 172.21.15.175:0/3231327378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc46806cd70 msgr2=0x7fc4680b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc45fe00640 1 --2- 172.21.15.175:0/3231327378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc46806cd70 0x7fc4680b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc45fe00640 1 -- 172.21.15.175:0/3231327378 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4680c9db0 con 0x7fc4680d0630 2024-04-25T09:12:07.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc45fe00640 1 --2- 172.21.15.175:0/3231327378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4680d0630 0x7fc468154e40 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fc45000c440 tx=0x7fc45000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc465600640 1 -- 172.21.15.175:0/3231327378 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4500052d0 con 0x7fc4680d0630 2024-04-25T09:12:07.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc465600640 1 -- 172.21.15.175:0/3231327378 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc450005470 con 0x7fc4680d0630 2024-04-25T09:12:07.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc46fc00640 1 -- 172.21.15.175:0/3231327378 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4680b3d20 con 0x7fc4680d0630 2024-04-25T09:12:07.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc46fc00640 1 -- 172.21.15.175:0/3231327378 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4680ca050 con 0x7fc4680d0630 2024-04-25T09:12:07.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc465600640 1 -- 172.21.15.175:0/3231327378 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450012870 con 0x7fc4680d0630 2024-04-25T09:12:07.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc46fc00640 1 -- 172.21.15.175:0/3231327378 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4400052a0 con 0x7fc4680d0630 2024-04-25T09:12:07.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc465600640 1 -- 172.21.15.175:0/3231327378 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc450012a10 con 0x7fc4680d0630 2024-04-25T09:12:07.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc465600640 1 --2- 172.21.15.175:0/3231327378 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc444066f60 0x7fc444069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc465600640 1 -- 172.21.15.175:0/3231327378 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fc450084c50 con 0x7fc4680d0630 2024-04-25T09:12:07.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.865+0000 7fc46d200640 1 --2- 172.21.15.175:0/3231327378 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc444066f60 0x7fc444069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.869+0000 7fc46d200640 1 --2- 172.21.15.175:0/3231327378 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc444066f60 0x7fc444069420 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc4580ad000 tx=0x7fc4580a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:07.869+0000 7fc465600640 1 -- 172.21.15.175:0/3231327378 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc4500554b0 con 0x7fc4680d0630 2024-04-25T09:12:08.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.029+0000 7fc46fc00640 1 -- 172.21.15.175:0/3231327378 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc440005da0 con 0x7fc4680d0630 2024-04-25T09:12:08.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.029+0000 7fc465600640 1 -- 172.21.15.175:0/3231327378 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc450059550 con 0x7fc4680d0630 2024-04-25T09:12:08.015 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:12:08.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.029+0000 7fc46fc00640 1 -- 172.21.15.175:0/3231327378 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc444066f60 msgr2=0x7fc444069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.029+0000 7fc46fc00640 1 --2- 172.21.15.175:0/3231327378 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc444066f60 0x7fc444069420 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc4580ad000 tx=0x7fc4580a6000 comp rx=0 tx=0).stop 2024-04-25T09:12:08.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.029+0000 7fc46fc00640 1 -- 172.21.15.175:0/3231327378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4680d0630 msgr2=0x7fc468154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.029+0000 7fc46fc00640 1 --2- 172.21.15.175:0/3231327378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4680d0630 0x7fc468154e40 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fc45000c440 tx=0x7fc45000c900 comp rx=0 tx=0).stop 2024-04-25T09:12:08.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.029+0000 7fc46fc00640 1 -- 172.21.15.175:0/3231327378 shutdown_connections 2024-04-25T09:12:08.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.029+0000 7fc46fc00640 1 --2- 172.21.15.175:0/3231327378 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc444066f60 0x7fc444069420 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.029+0000 7fc46fc00640 1 --2- 172.21.15.175:0/3231327378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc46815ddf0 0x7fc4680ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.029+0000 7fc46fc00640 1 --2- 172.21.15.175:0/3231327378 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4680d0630 0x7fc468154e40 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.029+0000 7fc46fc00640 1 --2- 172.21.15.175:0/3231327378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc46806cd70 0x7fc4680b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.029+0000 7fc46fc00640 1 -- 172.21.15.175:0/3231327378 >> 172.21.15.175:0/3231327378 conn(0x7fc4680b3400 msgr2=0x7fc4680b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:08.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.029+0000 7fc46fc00640 1 -- 172.21.15.175:0/3231327378 shutdown_connections 2024-04-25T09:12:08.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.029+0000 7fc46fc00640 1 -- 172.21.15.175:0/3231327378 wait complete. 2024-04-25T09:12:08.035 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:12:08.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.185+0000 7f932ac00640 1 Processor -- start 2024-04-25T09:12:08.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.185+0000 7f932ac00640 1 -- start start 2024-04-25T09:12:08.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.189+0000 7f932ac00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f93240cf6b0 0x7f93241600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.189+0000 7f932ac00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93240cfd10 con 0x7f9324145250 2024-04-25T09:12:08.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.189+0000 7f932ac00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93240cfff0 con 0x7f93240ce970 2024-04-25T09:12:08.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.189+0000 7f932ac00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93241605e0 con 0x7f93240cf6b0 2024-04-25T09:12:08.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.189+0000 7f931b400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f93240cf6b0 0x7f93241600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.189+0000 7f931b400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f93240cf6b0 0x7f93241600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50404/0 (socket says 172.21.15.175:50404) 2024-04-25T09:12:08.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.189+0000 7f9323e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f9324145250 0x7f93240cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:41474/0 (socket says 172.21.15.175:41474) 2024-04-25T09:12:08.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.189+0000 7f931b400640 1 -- 172.21.15.175:0/1140964921 learned_addr learned my addr 172.21.15.175:0/1140964921 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:08.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.189+0000 7f931b400640 1 -- 172.21.15.175:0/1140964921 >> v1:172.21.15.177:6789/0 conn(0x7f93240ce970 legacy=0x7f93240cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:08.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.189+0000 7f931b400640 1 -- 172.21.15.175:0/1140964921 >> v1:172.21.15.175:6789/0 conn(0x7f9324145250 legacy=0x7f93240cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.189+0000 7f931b400640 1 -- 172.21.15.175:0/1140964921 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932415f8a0 con 0x7f93240cf6b0 2024-04-25T09:12:08.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.189+0000 7f9323400640 1 -- 172.21.15.175:0/1140964921 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987284289 0 0) 0x7f93240cfd10 con 0x7f9324145250 2024-04-25T09:12:08.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.189+0000 7f931b400640 1 --2- 172.21.15.175:0/1140964921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93240cf6b0 0x7f93241600a0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f930c0098a0 tx=0x7f930c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ddf0de3c6bdcfc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.189+0000 7f9323400640 1 -- 172.21.15.175:0/1140964921 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c0b0070 con 0x7f93240cf6b0 2024-04-25T09:12:08.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.189+0000 7f9323400640 1 -- 172.21.15.175:0/1140964921 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930c0ab600 con 0x7f93240cf6b0 2024-04-25T09:12:08.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f9323400640 1 -- 172.21.15.175:0/1140964921 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c0ab9d0 con 0x7f93240cf6b0 2024-04-25T09:12:08.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f932ac00640 1 -- 172.21.15.175:0/1140964921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93240cf6b0 msgr2=0x7f93241600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f932ac00640 1 --2- 172.21.15.175:0/1140964921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93240cf6b0 0x7f93241600a0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f930c0098a0 tx=0x7f930c01c470 comp rx=0 tx=0).stop 2024-04-25T09:12:08.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f932ac00640 1 -- 172.21.15.175:0/1140964921 shutdown_connections 2024-04-25T09:12:08.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f932ac00640 1 --2- 172.21.15.175:0/1140964921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93240cf6b0 0x7f93241600a0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f932ac00640 1 -- 172.21.15.175:0/1140964921 >> 172.21.15.175:0/1140964921 conn(0x7f932406ac50 msgr2=0x7f932406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:08.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f932ac00640 1 -- 172.21.15.175:0/1140964921 shutdown_connections 2024-04-25T09:12:08.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f932ac00640 1 -- 172.21.15.175:0/1140964921 wait complete. 2024-04-25T09:12:08.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f932ac00640 1 Processor -- start 2024-04-25T09:12:08.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f932ac00640 1 -- start start 2024-04-25T09:12:08.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f932ac00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93240ce970 0x7f93240b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f932ac00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93240cf6b0 0x7f932413fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f932ac00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9324145250 0x7f93241402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f932ac00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932415cc40 con 0x7f9324145250 2024-04-25T09:12:08.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f932ac00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932415cac0 con 0x7f93240ce970 2024-04-25T09:12:08.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f932ac00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93241697f0 con 0x7f93240cf6b0 2024-04-25T09:12:08.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f9328c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9324145250 0x7f93241402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f9328c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9324145250 0x7f93241402a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50420/0 (socket says 172.21.15.175:50420) 2024-04-25T09:12:08.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f9328c00640 1 -- 172.21.15.175:0/358546293 learned_addr learned my addr 172.21.15.175:0/358546293 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:08.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f9323e00640 1 --2- 172.21.15.175:0/358546293 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93240ce970 0x7f93240b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.193+0000 7f931b400640 1 --2- 172.21.15.175:0/358546293 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93240cf6b0 0x7f932413fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.197+0000 7f9328c00640 1 -- 172.21.15.175:0/358546293 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93240cf6b0 msgr2=0x7f932413fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.197+0000 7f9328c00640 1 --2- 172.21.15.175:0/358546293 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93240cf6b0 0x7f932413fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.197+0000 7f9328c00640 1 -- 172.21.15.175:0/358546293 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93240ce970 msgr2=0x7f93240b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.197+0000 7f9328c00640 1 --2- 172.21.15.175:0/358546293 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93240ce970 0x7f93240b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.197+0000 7f9328c00640 1 -- 172.21.15.175:0/358546293 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93240b32a0 con 0x7f9324145250 2024-04-25T09:12:08.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.197+0000 7f9328c00640 1 --2- 172.21.15.175:0/358546293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9324145250 0x7f93241402a0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f931c00c780 tx=0x7f931c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.197+0000 7f9320c00640 1 -- 172.21.15.175:0/358546293 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c004b70 con 0x7f9324145250 2024-04-25T09:12:08.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.197+0000 7f9320c00640 1 -- 172.21.15.175:0/358546293 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c004d10 con 0x7f9324145250 2024-04-25T09:12:08.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.197+0000 7f9320c00640 1 -- 172.21.15.175:0/358546293 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c00aa90 con 0x7f9324145250 2024-04-25T09:12:08.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.197+0000 7f932ac00640 1 -- 172.21.15.175:0/358546293 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93240b3580 con 0x7f9324145250 2024-04-25T09:12:08.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.197+0000 7f932ac00640 1 -- 172.21.15.175:0/358546293 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93240b3b40 con 0x7f9324145250 2024-04-25T09:12:08.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.197+0000 7f932ac00640 1 -- 172.21.15.175:0/358546293 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93240b3d40 con 0x7f9324145250 2024-04-25T09:12:08.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.197+0000 7f9320c00640 1 -- 172.21.15.175:0/358546293 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f931c00ac30 con 0x7f9324145250 2024-04-25T09:12:08.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.197+0000 7f9320c00640 1 --2- 172.21.15.175:0/358546293 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9300066f60 0x7f9300069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.197+0000 7f9320c00640 1 -- 172.21.15.175:0/358546293 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f931c0852e0 con 0x7f9324145250 2024-04-25T09:12:08.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.197+0000 7f9323e00640 1 --2- 172.21.15.175:0/358546293 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9300066f60 0x7f9300069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.201+0000 7f9323e00640 1 --2- 172.21.15.175:0/358546293 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9300066f60 0x7f9300069420 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9314000f70 tx=0x7f9314007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.201+0000 7f9320c00640 1 -- 172.21.15.175:0/358546293 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f93240b3d40 con 0x7f9324145250 2024-04-25T09:12:08.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.353+0000 7f932ac00640 1 -- 172.21.15.175:0/358546293 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9324140b00 con 0x7f9324145250 2024-04-25T09:12:08.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.357+0000 7f9320c00640 1 -- 172.21.15.175:0/358546293 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f931c020070 con 0x7f9324145250 2024-04-25T09:12:08.342 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:12:08.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.357+0000 7f932ac00640 1 -- 172.21.15.175:0/358546293 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9300066f60 msgr2=0x7f9300069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.357+0000 7f932ac00640 1 --2- 172.21.15.175:0/358546293 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9300066f60 0x7f9300069420 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9314000f70 tx=0x7f9314007df0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.357+0000 7f932ac00640 1 -- 172.21.15.175:0/358546293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9324145250 msgr2=0x7f93241402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.357+0000 7f932ac00640 1 --2- 172.21.15.175:0/358546293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9324145250 0x7f93241402a0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f931c00c780 tx=0x7f931c00cc40 comp rx=0 tx=0).stop 2024-04-25T09:12:08.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.357+0000 7f932ac00640 1 -- 172.21.15.175:0/358546293 shutdown_connections 2024-04-25T09:12:08.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.357+0000 7f932ac00640 1 --2- 172.21.15.175:0/358546293 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9300066f60 0x7f9300069420 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.357+0000 7f932ac00640 1 --2- 172.21.15.175:0/358546293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9324145250 0x7f93241402a0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.357+0000 7f932ac00640 1 --2- 172.21.15.175:0/358546293 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93240cf6b0 0x7f932413fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.357+0000 7f932ac00640 1 --2- 172.21.15.175:0/358546293 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93240ce970 0x7f93240b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.357+0000 7f932ac00640 1 -- 172.21.15.175:0/358546293 >> 172.21.15.175:0/358546293 conn(0x7f932406ac50 msgr2=0x7f93240cb970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:08.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.357+0000 7f932ac00640 1 -- 172.21.15.175:0/358546293 shutdown_connections 2024-04-25T09:12:08.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.357+0000 7f932ac00640 1 -- 172.21.15.175:0/358546293 wait complete. 2024-04-25T09:12:08.363 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:12:08.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.513+0000 7f935d200640 1 Processor -- start 2024-04-25T09:12:08.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.513+0000 7f935d200640 1 -- start start 2024-04-25T09:12:08.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.513+0000 7f935d200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9358145250 0x7f93580cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.513+0000 7f935d200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f93580ce970 0x7f93580cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.513+0000 7f935d200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93580cfd10 con 0x7f93581600a0 2024-04-25T09:12:08.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.513+0000 7f935d200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935815f650 con 0x7f9358145250 2024-04-25T09:12:08.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.513+0000 7f935d200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93580cfff0 con 0x7f93580ce970 2024-04-25T09:12:08.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.517+0000 7f9355e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9358145250 0x7f93580cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.517+0000 7f9355e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9358145250 0x7f93580cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50428/0 (socket says 172.21.15.175:50428) 2024-04-25T09:12:08.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.517+0000 7f9355e00640 1 -- 172.21.15.175:0/501225549 learned_addr learned my addr 172.21.15.175:0/501225549 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:08.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.517+0000 7f9356800640 1 --2- 172.21.15.175:0/501225549 >> v2:172.21.15.177:3300/0 conn(0x7f93580ce970 0x7f93580cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.517+0000 7f9355e00640 1 -- 172.21.15.175:0/501225549 >> v2:172.21.15.177:3300/0 conn(0x7f93580ce970 msgr2=0x7f93580cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:08.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.517+0000 7f9355e00640 1 --2- 172.21.15.175:0/501225549 >> v2:172.21.15.177:3300/0 conn(0x7f93580ce970 0x7f93580cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.517+0000 7f9355e00640 1 -- 172.21.15.175:0/501225549 >> v1:172.21.15.177:6789/0 conn(0x7f93581600a0 legacy=0x7f93580cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.517+0000 7f9355e00640 1 -- 172.21.15.175:0/501225549 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935815f8a0 con 0x7f9358145250 2024-04-25T09:12:08.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.517+0000 7f9355e00640 1 --2- 172.21.15.175:0/501225549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9358145250 0x7f93580cf6b0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f9348009870 tx=0x7f934801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b978e1b27889b69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.517+0000 7f9355400640 1 -- 172.21.15.175:0/501225549 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93480ab5f0 con 0x7f9358145250 2024-04-25T09:12:08.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.517+0000 7f9355400640 1 -- 172.21.15.175:0/501225549 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93480b0070 con 0x7f9358145250 2024-04-25T09:12:08.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.517+0000 7f9355400640 1 -- 172.21.15.175:0/501225549 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93480ab9b0 con 0x7f9358145250 2024-04-25T09:12:08.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f935d200640 1 -- 172.21.15.175:0/501225549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9358145250 msgr2=0x7f93580cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f935d200640 1 --2- 172.21.15.175:0/501225549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9358145250 0x7f93580cf6b0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f9348009870 tx=0x7f934801c460 comp rx=0 tx=0).stop 2024-04-25T09:12:08.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f935d200640 1 -- 172.21.15.175:0/501225549 shutdown_connections 2024-04-25T09:12:08.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f935d200640 1 --2- 172.21.15.175:0/501225549 >> v2:172.21.15.177:3300/0 conn(0x7f93580ce970 0x7f93580cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f935d200640 1 --2- 172.21.15.175:0/501225549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9358145250 0x7f93580cf6b0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f935d200640 1 -- 172.21.15.175:0/501225549 >> 172.21.15.175:0/501225549 conn(0x7f935806ac50 msgr2=0x7f935806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:08.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f935d200640 1 -- 172.21.15.175:0/501225549 shutdown_connections 2024-04-25T09:12:08.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f935d200640 1 -- 172.21.15.175:0/501225549 wait complete. 2024-04-25T09:12:08.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f935d200640 1 Processor -- start 2024-04-25T09:12:08.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f935d200640 1 -- start start 2024-04-25T09:12:08.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f935d200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93580ce970 0x7f935813ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f935d200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9358145250 0x7f9358139b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f935d200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93581600a0 0x7f935813d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f935d200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935815c870 con 0x7f9358145250 2024-04-25T09:12:08.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f935d200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93581604b0 con 0x7f93581600a0 2024-04-25T09:12:08.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f935d200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935815c9f0 con 0x7f93580ce970 2024-04-25T09:12:08.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f934fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9358145250 0x7f9358139b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f934fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9358145250 0x7f9358139b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50436/0 (socket says 172.21.15.175:50436) 2024-04-25T09:12:08.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f934fe00640 1 -- 172.21.15.175:0/1293615232 learned_addr learned my addr 172.21.15.175:0/1293615232 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:08.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f934fe00640 1 -- 172.21.15.175:0/1293615232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93580ce970 msgr2=0x7f935813ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f934fe00640 1 --2- 172.21.15.175:0/1293615232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93580ce970 0x7f935813ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f934fe00640 1 -- 172.21.15.175:0/1293615232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93581600a0 msgr2=0x7f935813d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f934fe00640 1 --2- 172.21.15.175:0/1293615232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93581600a0 0x7f935813d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f934fe00640 1 -- 172.21.15.175:0/1293615232 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935813f1a0 con 0x7f9358145250 2024-04-25T09:12:08.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.521+0000 7f934fe00640 1 --2- 172.21.15.175:0/1293615232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9358145250 0x7f9358139b50 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f934000c370 tx=0x7f934000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.525+0000 7f934e000640 1 -- 172.21.15.175:0/1293615232 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93400052d0 con 0x7f9358145250 2024-04-25T09:12:08.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.525+0000 7f934e000640 1 -- 172.21.15.175:0/1293615232 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9340005470 con 0x7f9358145250 2024-04-25T09:12:08.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.525+0000 7f934e000640 1 -- 172.21.15.175:0/1293615232 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340007240 con 0x7f9358145250 2024-04-25T09:12:08.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.525+0000 7f935d200640 1 -- 172.21.15.175:0/1293615232 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935815e7f0 con 0x7f9358145250 2024-04-25T09:12:08.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.525+0000 7f935d200640 1 -- 172.21.15.175:0/1293615232 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935813d610 con 0x7f9358145250 2024-04-25T09:12:08.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.525+0000 7f935d200640 1 -- 172.21.15.175:0/1293615232 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9358075160 con 0x7f9358145250 2024-04-25T09:12:08.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.525+0000 7f934e000640 1 -- 172.21.15.175:0/1293615232 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f93400073e0 con 0x7f9358145250 2024-04-25T09:12:08.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.525+0000 7f934e000640 1 --2- 172.21.15.175:0/1293615232 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9334066f60 0x7f9334069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.525+0000 7f934e000640 1 -- 172.21.15.175:0/1293615232 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f9340084520 con 0x7f9358145250 2024-04-25T09:12:08.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.525+0000 7f9355e00640 1 --2- 172.21.15.175:0/1293615232 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9334066f60 0x7f9334069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.525+0000 7f9355e00640 1 --2- 172.21.15.175:0/1293615232 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9334066f60 0x7f9334069420 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f93480af000 tx=0x7f9348004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.529+0000 7f934e000640 1 -- 172.21.15.175:0/1293615232 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9340055450 con 0x7f9358145250 2024-04-25T09:12:08.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.681+0000 7f935d200640 1 -- 172.21.15.175:0/1293615232 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f93580aeaa0 con 0x7f9358145250 2024-04-25T09:12:08.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.685+0000 7f934e000640 1 -- 172.21.15.175:0/1293615232 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9340054d50 con 0x7f9358145250 2024-04-25T09:12:08.671 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:12:08.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.685+0000 7f935d200640 1 -- 172.21.15.175:0/1293615232 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9334066f60 msgr2=0x7f9334069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.685+0000 7f935d200640 1 --2- 172.21.15.175:0/1293615232 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9334066f60 0x7f9334069420 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f93480af000 tx=0x7f9348004740 comp rx=0 tx=0).stop 2024-04-25T09:12:08.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.685+0000 7f935d200640 1 -- 172.21.15.175:0/1293615232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9358145250 msgr2=0x7f9358139b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.685+0000 7f935d200640 1 --2- 172.21.15.175:0/1293615232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9358145250 0x7f9358139b50 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f934000c370 tx=0x7f934000c830 comp rx=0 tx=0).stop 2024-04-25T09:12:08.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.685+0000 7f935d200640 1 -- 172.21.15.175:0/1293615232 shutdown_connections 2024-04-25T09:12:08.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.685+0000 7f935d200640 1 --2- 172.21.15.175:0/1293615232 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9334066f60 0x7f9334069420 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.685+0000 7f935d200640 1 --2- 172.21.15.175:0/1293615232 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93581600a0 0x7f935813d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.685+0000 7f935d200640 1 --2- 172.21.15.175:0/1293615232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9358145250 0x7f9358139b50 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.685+0000 7f935d200640 1 --2- 172.21.15.175:0/1293615232 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93580ce970 0x7f935813ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.685+0000 7f935d200640 1 -- 172.21.15.175:0/1293615232 >> 172.21.15.175:0/1293615232 conn(0x7f935806ac50 msgr2=0x7f93580cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:08.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.685+0000 7f935d200640 1 -- 172.21.15.175:0/1293615232 shutdown_connections 2024-04-25T09:12:08.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.685+0000 7f935d200640 1 -- 172.21.15.175:0/1293615232 wait complete. 2024-04-25T09:12:08.692 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:08.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.841+0000 7fc2fd600640 1 Processor -- start 2024-04-25T09:12:08.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.841+0000 7fc2fd600640 1 -- start start 2024-04-25T09:12:08.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2fd600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc2f80cff30 0x7fc2f80c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2fd600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f80cd6d0 con 0x7fc2f80cfaf0 2024-04-25T09:12:08.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2fd600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f80cd970 con 0x7fc2f815b830 2024-04-25T09:12:08.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2fd600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f80c5580 con 0x7fc2f80cff30 2024-04-25T09:12:08.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2ef400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc2f80cfaf0 0x7fc2f80c5a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:41484/0 (socket says 172.21.15.175:41484) 2024-04-25T09:12:08.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2ef400640 1 -- 172.21.15.175:0/1303338905 learned_addr learned my addr 172.21.15.175:0/1303338905 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:08.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2fcc00640 1 --2- 172.21.15.175:0/1303338905 >> v2:172.21.15.177:3300/0 conn(0x7fc2f80cff30 0x7fc2f80c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2f7400640 1 -- 172.21.15.175:0/1303338905 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 395743420 0 0) 0x7fc2f80cd6d0 con 0x7fc2f80cfaf0 2024-04-25T09:12:08.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2f7400640 1 -- 172.21.15.175:0/1303338905 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2dc003530 con 0x7fc2f80cfaf0 2024-04-25T09:12:08.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2f7400640 1 -- 172.21.15.175:0/1303338905 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723628305 0 0) 0x7fc2f80cd970 con 0x7fc2f815b830 2024-04-25T09:12:08.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2f7400640 1 -- 172.21.15.175:0/1303338905 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2f80cd6d0 con 0x7fc2f815b830 2024-04-25T09:12:08.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2f7400640 1 -- 172.21.15.175:0/1303338905 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 672515554 0 0) 0x7fc2dc003530 con 0x7fc2f80cfaf0 2024-04-25T09:12:08.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2f7400640 1 -- 172.21.15.175:0/1303338905 >> v2:172.21.15.177:3300/0 conn(0x7fc2f80cff30 msgr2=0x7fc2f80c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:08.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2f7400640 1 --2- 172.21.15.175:0/1303338905 >> v2:172.21.15.177:3300/0 conn(0x7fc2f80cff30 0x7fc2f80c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2f7400640 1 -- 172.21.15.175:0/1303338905 >> v1:172.21.15.177:6789/0 conn(0x7fc2f815b830 legacy=0x7fc2f80ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2f7400640 1 -- 172.21.15.175:0/1303338905 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f80cdc50 con 0x7fc2f80cfaf0 2024-04-25T09:12:08.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2f7400640 1 -- 172.21.15.175:0/1303338905 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fc2e0001a20 con 0x7fc2f80cfaf0 2024-04-25T09:12:08.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2f7400640 1 -- 172.21.15.175:0/1303338905 >> v1:172.21.15.175:6789/0 conn(0x7fc2f80cfaf0 legacy=0x7fc2f80c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2f7400640 1 --2- 172.21.15.175:0/1303338905 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2dc003bc0 0x7fc2dc003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2f7400640 1 --2- 172.21.15.175:0/1303338905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2dc004810 0x7fc2dc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2f7400640 1 --2- 172.21.15.175:0/1303338905 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2dc0051d0 0x7fc2dc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2f7400640 1 -- 172.21.15.175:0/1303338905 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80c5580 con 0x7fc2dc004810 2024-04-25T09:12:08.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2f7400640 1 -- 172.21.15.175:0/1303338905 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc00c0d0 con 0x7fc2dc0051d0 2024-04-25T09:12:08.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2f7400640 1 -- 172.21.15.175:0/1303338905 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc00c2d0 con 0x7fc2dc003bc0 2024-04-25T09:12:08.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2ef400640 1 --2- 172.21.15.175:0/1303338905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2dc004810 0x7fc2dc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2f7e00640 1 --2- 172.21.15.175:0/1303338905 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2dc003bc0 0x7fc2dc003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2fcc00640 1 --2- 172.21.15.175:0/1303338905 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2dc0051d0 0x7fc2dc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2ef400640 1 -- 172.21.15.175:0/1303338905 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2dc003bc0 msgr2=0x7fc2dc003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:08.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2ef400640 1 --2- 172.21.15.175:0/1303338905 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2dc003bc0 0x7fc2dc003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2ef400640 1 -- 172.21.15.175:0/1303338905 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2dc0051d0 msgr2=0x7fc2dc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:08.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2ef400640 1 --2- 172.21.15.175:0/1303338905 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2dc0051d0 0x7fc2dc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2ef400640 1 -- 172.21.15.175:0/1303338905 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc003530 con 0x7fc2dc004810 2024-04-25T09:12:08.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.845+0000 7fc2fcc00640 1 -- 172.21.15.175:0/1303338905 reap_dead start 2024-04-25T09:12:08.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.849+0000 7fc2ef400640 1 --2- 172.21.15.175:0/1303338905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2dc004810 0x7fc2dc004c90 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fc2e000a7f0 tx=0x7fc2e001d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da7f5d085571fd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.849+0000 7fc2f7400640 1 -- 172.21.15.175:0/1303338905 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e000a450 con 0x7fc2dc004810 2024-04-25T09:12:08.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.849+0000 7fc2f7400640 1 -- 172.21.15.175:0/1303338905 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e00070d0 con 0x7fc2dc004810 2024-04-25T09:12:08.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.849+0000 7fc2f7400640 1 -- 172.21.15.175:0/1303338905 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e00074e0 con 0x7fc2dc004810 2024-04-25T09:12:08.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.849+0000 7fc2fd600640 1 -- 172.21.15.175:0/1303338905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2dc004810 msgr2=0x7fc2dc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.849+0000 7fc2fd600640 1 --2- 172.21.15.175:0/1303338905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2dc004810 0x7fc2dc004c90 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fc2e000a7f0 tx=0x7fc2e001d2c0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.849+0000 7fc2fd600640 1 -- 172.21.15.175:0/1303338905 shutdown_connections 2024-04-25T09:12:08.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.849+0000 7fc2fd600640 1 --2- 172.21.15.175:0/1303338905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2dc004810 0x7fc2dc004c90 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.849+0000 7fc2fd600640 1 -- 172.21.15.175:0/1303338905 >> 172.21.15.175:0/1303338905 conn(0x7fc2f809aa90 msgr2=0x7fc2f808afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:08.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.849+0000 7fc2fd600640 1 -- 172.21.15.175:0/1303338905 shutdown_connections 2024-04-25T09:12:08.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.849+0000 7fc2fd600640 1 -- 172.21.15.175:0/1303338905 wait complete. 2024-04-25T09:12:08.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2fd600640 1 Processor -- start 2024-04-25T09:12:08.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2fd600640 1 -- start start 2024-04-25T09:12:08.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2fd600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2dc004810 0x7fc2f8156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2fd600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2f80c6a50 0x7fc2f80c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2fd600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f815c1b0 0x7fc2f815c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2fd600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80d0360 con 0x7fc2f80c6a50 2024-04-25T09:12:08.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2fd600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80d15c0 con 0x7fc2dc004810 2024-04-25T09:12:08.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2fd600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f815bc10 con 0x7fc2f815c1b0 2024-04-25T09:12:08.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2ef400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2f80c6a50 0x7fc2f80c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2ef400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2f80c6a50 0x7fc2f80c6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50454/0 (socket says 172.21.15.175:50454) 2024-04-25T09:12:08.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2ef400640 1 -- 172.21.15.175:0/996046283 learned_addr learned my addr 172.21.15.175:0/996046283 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:08.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2f7e00640 1 --2- 172.21.15.175:0/996046283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2dc004810 0x7fc2f8156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2fcc00640 1 --2- 172.21.15.175:0/996046283 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f815c1b0 0x7fc2f815c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2ef400640 1 -- 172.21.15.175:0/996046283 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f815c1b0 msgr2=0x7fc2f815c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2ef400640 1 --2- 172.21.15.175:0/996046283 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f815c1b0 0x7fc2f815c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2ef400640 1 -- 172.21.15.175:0/996046283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2dc004810 msgr2=0x7fc2f8156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2ef400640 1 --2- 172.21.15.175:0/996046283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2dc004810 0x7fc2f8156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2ef400640 1 -- 172.21.15.175:0/996046283 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f80b7570 con 0x7fc2f80c6a50 2024-04-25T09:12:08.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2fcc00640 1 --2- 172.21.15.175:0/996046283 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f815c1b0 0x7fc2f815c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:08.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2ef400640 1 --2- 172.21.15.175:0/996046283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2f80c6a50 0x7fc2f80c6ed0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0001ca0 tx=0x7fc2dc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2f4c00640 1 -- 172.21.15.175:0/996046283 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e00bd070 con 0x7fc2f80c6a50 2024-04-25T09:12:08.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2f4c00640 1 -- 172.21.15.175:0/996046283 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e0004b70 con 0x7fc2f80c6a50 2024-04-25T09:12:08.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2f4c00640 1 -- 172.21.15.175:0/996046283 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e00b2040 con 0x7fc2f80c6a50 2024-04-25T09:12:08.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2fd600640 1 -- 172.21.15.175:0/996046283 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f815ce70 con 0x7fc2f80c6a50 2024-04-25T09:12:08.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2fd600640 1 -- 172.21.15.175:0/996046283 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f815d430 con 0x7fc2f80c6a50 2024-04-25T09:12:08.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.853+0000 7fc2fd600640 1 -- 172.21.15.175:0/996046283 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f8074a60 con 0x7fc2f80c6a50 2024-04-25T09:12:08.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.857+0000 7fc2f4c00640 1 -- 172.21.15.175:0/996046283 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc2e00ad430 con 0x7fc2f80c6a50 2024-04-25T09:12:08.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.857+0000 7fc2f4c00640 1 --2- 172.21.15.175:0/996046283 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc2d4066f60 0x7fc2d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.857+0000 7fc2f4c00640 1 -- 172.21.15.175:0/996046283 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fc2e011f4d0 con 0x7fc2f80c6a50 2024-04-25T09:12:08.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.857+0000 7fc2f7e00640 1 --2- 172.21.15.175:0/996046283 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc2d4066f60 0x7fc2d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.857+0000 7fc2f7e00640 1 --2- 172.21.15.175:0/996046283 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc2d4066f60 0x7fc2d4069420 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8005680 tx=0x7fc2e8007f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:08.861+0000 7fc2f4c00640 1 -- 172.21.15.175:0/996046283 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc2e0016fd0 con 0x7fc2f80c6a50 2024-04-25T09:12:09.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.049+0000 7fc2fd600640 1 -- 172.21.15.175:0/996046283 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2f8157300 con 0x7fc2f80c6a50 2024-04-25T09:12:09.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.049+0000 7fc2f4c00640 1 -- 172.21.15.175:0/996046283 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fc2e00efe50 con 0x7fc2f80c6a50 2024-04-25T09:12:09.036 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:09.036 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":71,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3229536012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3229536012},{"type":"v1","addr":"172.21.15.177:6834","nonce":3229536012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/222649735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":222649735},{"type":"v1","addr":"172.21.15.177:6835","nonce":222649735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2888989442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2888989442},{"type":"v1","addr":"172.21.15.175:6836","nonce":2888989442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:03.786939+0000","modified":"2024-04-25T09:11:29.735549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7303":{"gid":7303,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6837/279367590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":279367590},{"type":"v1","addr":"172.21.15.175:6837","nonce":279367590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:12:09.036 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 71 2024-04-25T09:12:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.049+0000 7fc2fd600640 1 -- 172.21.15.175:0/996046283 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc2d4066f60 msgr2=0x7fc2d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.049+0000 7fc2fd600640 1 --2- 172.21.15.175:0/996046283 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc2d4066f60 0x7fc2d4069420 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8005680 tx=0x7fc2e8007f90 comp rx=0 tx=0).stop 2024-04-25T09:12:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.049+0000 7fc2fd600640 1 -- 172.21.15.175:0/996046283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2f80c6a50 msgr2=0x7fc2f80c6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.049+0000 7fc2fd600640 1 --2- 172.21.15.175:0/996046283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2f80c6a50 0x7fc2f80c6ed0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0001ca0 tx=0x7fc2dc005840 comp rx=0 tx=0).stop 2024-04-25T09:12:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.049+0000 7fc2fd600640 1 -- 172.21.15.175:0/996046283 shutdown_connections 2024-04-25T09:12:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.049+0000 7fc2fd600640 1 --2- 172.21.15.175:0/996046283 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc2d4066f60 0x7fc2d4069420 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.049+0000 7fc2fd600640 1 --2- 172.21.15.175:0/996046283 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2f815c1b0 0x7fc2f815c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.049+0000 7fc2fd600640 1 --2- 172.21.15.175:0/996046283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2f80c6a50 0x7fc2f80c6ed0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.049+0000 7fc2fd600640 1 --2- 172.21.15.175:0/996046283 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2dc004810 0x7fc2f8156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.049+0000 7fc2fd600640 1 -- 172.21.15.175:0/996046283 >> 172.21.15.175:0/996046283 conn(0x7fc2f809aa90 msgr2=0x7fc2f80d1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.049+0000 7fc2fd600640 1 -- 172.21.15.175:0/996046283 shutdown_connections 2024-04-25T09:12:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.049+0000 7fc2fd600640 1 -- 172.21.15.175:0/996046283 wait complete. 2024-04-25T09:12:09.057 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:09.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.205+0000 7f5376e00640 1 Processor -- start 2024-04-25T09:12:09.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.205+0000 7f5376e00640 1 -- start start 2024-04-25T09:12:09.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.205+0000 7f5376e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f53700cfe30 0x7f53701665e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.205+0000 7f5376e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537015cd00 con 0x7f5370144fc0 2024-04-25T09:12:09.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.205+0000 7f5376e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53700ce660 con 0x7f53701453a0 2024-04-25T09:12:09.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.205+0000 7f5376e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53700cc930 con 0x7f53700cfe30 2024-04-25T09:12:09.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.205+0000 7f536fe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5370144fc0 0x7f53700cbe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:41488/0 (socket says 172.21.15.175:41488) 2024-04-25T09:12:09.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.205+0000 7f536fe00640 1 -- 172.21.15.175:0/2682507228 learned_addr learned my addr 172.21.15.175:0/2682507228 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:09.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.205+0000 7f5374e00640 1 --2- 172.21.15.175:0/2682507228 >> v2:172.21.15.177:3300/0 conn(0x7f53700cfe30 0x7f53701665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.205+0000 7f536ea00640 1 -- 172.21.15.175:0/2682507228 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2768007596 0 0) 0x7f537015cd00 con 0x7f5370144fc0 2024-04-25T09:12:09.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.205+0000 7f536ea00640 1 -- 172.21.15.175:0/2682507228 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5354003530 con 0x7f5370144fc0 2024-04-25T09:12:09.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.205+0000 7f536ea00640 1 -- 172.21.15.175:0/2682507228 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 524411411 0 0) 0x7f53700ce660 con 0x7f53701453a0 2024-04-25T09:12:09.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.205+0000 7f536ea00640 1 -- 172.21.15.175:0/2682507228 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f537015cd00 con 0x7f53701453a0 2024-04-25T09:12:09.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.205+0000 7f5374e00640 1 -- 172.21.15.175:0/2682507228 >> v1:172.21.15.177:6789/0 conn(0x7f53701453a0 legacy=0x7f537015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.205+0000 7f5374e00640 1 -- 172.21.15.175:0/2682507228 >> v1:172.21.15.175:6789/0 conn(0x7f5370144fc0 legacy=0x7f53700cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.205+0000 7f5374e00640 1 -- 172.21.15.175:0/2682507228 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53700ccc10 con 0x7f53700cfe30 2024-04-25T09:12:09.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.209+0000 7f5374e00640 1 --2- 172.21.15.175:0/2682507228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53700cfe30 0x7f53701665e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f53680097f0 tx=0x7f536801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=666608ae4ff13d93 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.209+0000 7f536ea00640 1 -- 172.21.15.175:0/2682507228 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53680b1070 con 0x7f53700cfe30 2024-04-25T09:12:09.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.209+0000 7f536ea00640 1 -- 172.21.15.175:0/2682507228 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53680ac5f0 con 0x7f53700cfe30 2024-04-25T09:12:09.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.209+0000 7f536ea00640 1 -- 172.21.15.175:0/2682507228 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53680ac9c0 con 0x7f53700cfe30 2024-04-25T09:12:09.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.209+0000 7f5376e00640 1 -- 172.21.15.175:0/2682507228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53700cfe30 msgr2=0x7f53701665e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.209+0000 7f5376e00640 1 --2- 172.21.15.175:0/2682507228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53700cfe30 0x7f53701665e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f53680097f0 tx=0x7f536801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.209+0000 7f5376e00640 1 -- 172.21.15.175:0/2682507228 shutdown_connections 2024-04-25T09:12:09.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.209+0000 7f5376e00640 1 --2- 172.21.15.175:0/2682507228 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53700cfe30 0x7f53701665e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.209+0000 7f5376e00640 1 -- 172.21.15.175:0/2682507228 >> 172.21.15.175:0/2682507228 conn(0x7f5370067150 msgr2=0x7f537006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:09.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.209+0000 7f5376e00640 1 -- 172.21.15.175:0/2682507228 shutdown_connections 2024-04-25T09:12:09.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.209+0000 7f5376e00640 1 -- 172.21.15.175:0/2682507228 wait complete. 2024-04-25T09:12:09.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5376e00640 1 Processor -- start 2024-04-25T09:12:09.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5376e00640 1 -- start start 2024-04-25T09:12:09.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5376e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5370144fc0 0x7f537013e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5376e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53701453a0 0x7f5370140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5376e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f537015b720 0x7f5370140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5376e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53701698d0 con 0x7f537015b720 2024-04-25T09:12:09.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5376e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5370169750 con 0x7f53701453a0 2024-04-25T09:12:09.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5376e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5370169a50 con 0x7f5370144fc0 2024-04-25T09:12:09.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5374e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f537015b720 0x7f5370140fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5374e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f537015b720 0x7f5370140fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50462/0 (socket says 172.21.15.175:50462) 2024-04-25T09:12:09.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5374e00640 1 -- 172.21.15.175:0/3800645606 learned_addr learned my addr 172.21.15.175:0/3800645606 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:09.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5374e00640 1 -- 172.21.15.175:0/3800645606 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5370144fc0 msgr2=0x7f537013e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5374e00640 1 --2- 172.21.15.175:0/3800645606 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5370144fc0 0x7f537013e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5374e00640 1 -- 172.21.15.175:0/3800645606 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53701453a0 msgr2=0x7f5370140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5374e00640 1 --2- 172.21.15.175:0/3800645606 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53701453a0 0x7f5370140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5374e00640 1 -- 172.21.15.175:0/3800645606 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5370160050 con 0x7f537015b720 2024-04-25T09:12:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5374e00640 1 --2- 172.21.15.175:0/3800645606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f537015b720 0x7f5370140fc0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f53680af040 tx=0x7f5368019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5367e00640 1 -- 172.21.15.175:0/3800645606 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53680b9020 con 0x7f537015b720 2024-04-25T09:12:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5367e00640 1 -- 172.21.15.175:0/3800645606 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53680ace20 con 0x7f537015b720 2024-04-25T09:12:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5367e00640 1 -- 172.21.15.175:0/3800645606 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53680b1040 con 0x7f537015b720 2024-04-25T09:12:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5376e00640 1 -- 172.21.15.175:0/3800645606 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537013f030 con 0x7f537015b720 2024-04-25T09:12:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.213+0000 7f5376e00640 1 -- 172.21.15.175:0/3800645606 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53701602f0 con 0x7f537015b720 2024-04-25T09:12:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.217+0000 7f5376e00640 1 -- 172.21.15.175:0/3800645606 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5370074a60 con 0x7f537015b720 2024-04-25T09:12:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.217+0000 7f5367e00640 1 -- 172.21.15.175:0/3800645606 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f53680bc020 con 0x7f537015b720 2024-04-25T09:12:09.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.217+0000 7f5367e00640 1 --2- 172.21.15.175:0/3800645606 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5350066f60 0x7f5350069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.217+0000 7f5367e00640 1 -- 172.21.15.175:0/3800645606 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f536811eac0 con 0x7f537015b720 2024-04-25T09:12:09.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.217+0000 7f536fe00640 1 --2- 172.21.15.175:0/3800645606 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5350066f60 0x7f5350069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.217+0000 7f536fe00640 1 --2- 172.21.15.175:0/3800645606 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5350066f60 0x7f5350069420 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5360001590 tx=0x7f53600016e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.221+0000 7f5367e00640 1 -- 172.21.15.175:0/3800645606 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f53680c3030 con 0x7f537015b720 2024-04-25T09:12:09.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.373+0000 7f5376e00640 1 -- 172.21.15.175:0/3800645606 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f537015e310 con 0x7f537015b720 2024-04-25T09:12:09.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.377+0000 7f5367e00640 1 -- 172.21.15.175:0/3800645606 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+17009 (secure 0 0 0) 0x7f53680a9070 con 0x7f537015b720 2024-04-25T09:12:09.362 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:09.363 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":88,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:11:26.715623+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:01.518283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:02.788015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.38","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6837/1399691338":"2024-04-26T09:11:26.715601+0000","172.21.15.175:6835/1399691338":"2024-04-26T09:11:26.715601+0000","172.21.15.175:6837/1755192276":"2024-04-26T09:10:14.425304+0000","172.21.15.175:6835/1755192276":"2024-04-26T09:10:14.425304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:09.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.377+0000 7f5376e00640 1 -- 172.21.15.175:0/3800645606 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5350066f60 msgr2=0x7f5350069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.377+0000 7f5376e00640 1 --2- 172.21.15.175:0/3800645606 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5350066f60 0x7f5350069420 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5360001590 tx=0x7f53600016e0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.377+0000 7f5376e00640 1 -- 172.21.15.175:0/3800645606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f537015b720 msgr2=0x7f5370140fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.377+0000 7f5376e00640 1 --2- 172.21.15.175:0/3800645606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f537015b720 0x7f5370140fc0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f53680af040 tx=0x7f5368019240 comp rx=0 tx=0).stop 2024-04-25T09:12:09.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.377+0000 7f5376e00640 1 -- 172.21.15.175:0/3800645606 shutdown_connections 2024-04-25T09:12:09.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.377+0000 7f5376e00640 1 --2- 172.21.15.175:0/3800645606 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5350066f60 0x7f5350069420 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.377+0000 7f5376e00640 1 --2- 172.21.15.175:0/3800645606 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f537015b720 0x7f5370140fc0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.377+0000 7f5376e00640 1 --2- 172.21.15.175:0/3800645606 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53701453a0 0x7f5370140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.377+0000 7f5376e00640 1 --2- 172.21.15.175:0/3800645606 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5370144fc0 0x7f537013e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.377+0000 7f5376e00640 1 -- 172.21.15.175:0/3800645606 >> 172.21.15.175:0/3800645606 conn(0x7f53700cfe30 msgr2=0x7f537006e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:09.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.377+0000 7f5376e00640 1 -- 172.21.15.175:0/3800645606 shutdown_connections 2024-04-25T09:12:09.365 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.377+0000 7f5376e00640 1 -- 172.21.15.175:0/3800645606 wait complete. 2024-04-25T09:12:09.365 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:12:09.368 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:12:09.385 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:12:09.386 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:09.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.577+0000 7f1562c00640 1 Processor -- start 2024-04-25T09:12:09.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.577+0000 7f1562c00640 1 -- start start 2024-04-25T09:12:09.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.581+0000 7f1562c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f155c0aeb30 0x7f155c071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.581+0000 7f1562c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f155c071780 0x7f155c06de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.581+0000 7f1562c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f155c06e340 0x7f155c15db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.581+0000 7f1562c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155c071be0 con 0x7f155c06e340 2024-04-25T09:12:09.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.581+0000 7f1562c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155c0b2a70 con 0x7f155c071780 2024-04-25T09:12:09.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.581+0000 7f1562c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c06eba0 con 0x7f155c0aeb30 2024-04-25T09:12:09.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.581+0000 7f1560c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f155c06e340 0x7f155c15db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.581+0000 7f1560c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f155c06e340 0x7f155c15db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45862/0 (socket says 172.21.15.175:45862) 2024-04-25T09:12:09.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.581+0000 7f1560c00640 1 -- 172.21.15.175:0/1124076730 learned_addr learned my addr 172.21.15.175:0/1124076730 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:09.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.581+0000 7f1560c00640 1 -- 172.21.15.175:0/1124076730 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f155c0aeb30 msgr2=0x7f155c071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:09.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.581+0000 7f155be00640 1 --2- 172.21.15.175:0/1124076730 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f155c0aeb30 0x7f155c071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.581+0000 7f1553400640 1 --2- 172.21.15.175:0/1124076730 >> v2:172.21.15.177:3300/0 conn(0x7f155c071780 0x7f155c06de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.581+0000 7f1560c00640 1 --2- 172.21.15.175:0/1124076730 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f155c0aeb30 0x7f155c071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.581+0000 7f1560c00640 1 -- 172.21.15.175:0/1124076730 >> v2:172.21.15.177:3300/0 conn(0x7f155c071780 msgr2=0x7f155c06de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:09.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.581+0000 7f1560c00640 1 --2- 172.21.15.175:0/1124076730 >> v2:172.21.15.177:3300/0 conn(0x7f155c071780 0x7f155c06de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.581+0000 7f1560c00640 1 -- 172.21.15.175:0/1124076730 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c06ee80 con 0x7f155c06e340 2024-04-25T09:12:09.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.581+0000 7f1553400640 1 --2- 172.21.15.175:0/1124076730 >> v2:172.21.15.177:3300/0 conn(0x7f155c071780 0x7f155c06de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:09.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.581+0000 7f155be00640 1 --2- 172.21.15.175:0/1124076730 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f155c0aeb30 0x7f155c071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:09.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.585+0000 7f1560c00640 1 --2- 172.21.15.175:0/1124076730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f155c06e340 0x7f155c15db60 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f155c06f750 tx=0x7f155401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a246fae0bae81a0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.585+0000 7f155b400640 1 -- 172.21.15.175:0/1124076730 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15540ab680 con 0x7f155c06e340 2024-04-25T09:12:09.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.585+0000 7f155b400640 1 -- 172.21.15.175:0/1124076730 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15540b0070 con 0x7f155c06e340 2024-04-25T09:12:09.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.585+0000 7f155b400640 1 -- 172.21.15.175:0/1124076730 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15540aba40 con 0x7f155c06e340 2024-04-25T09:12:09.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.585+0000 7f1562c00640 1 -- 172.21.15.175:0/1124076730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f155c06e340 msgr2=0x7f155c15db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.585+0000 7f1562c00640 1 --2- 172.21.15.175:0/1124076730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f155c06e340 0x7f155c15db60 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f155c06f750 tx=0x7f155401c520 comp rx=0 tx=0).stop 2024-04-25T09:12:09.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.585+0000 7f1562c00640 1 -- 172.21.15.175:0/1124076730 shutdown_connections 2024-04-25T09:12:09.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.585+0000 7f1562c00640 1 --2- 172.21.15.175:0/1124076730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f155c06e340 0x7f155c15db60 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.585+0000 7f1562c00640 1 --2- 172.21.15.175:0/1124076730 >> v2:172.21.15.177:3300/0 conn(0x7f155c071780 0x7f155c06de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.585+0000 7f1562c00640 1 --2- 172.21.15.175:0/1124076730 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f155c0aeb30 0x7f155c071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.585+0000 7f1562c00640 1 -- 172.21.15.175:0/1124076730 >> 172.21.15.175:0/1124076730 conn(0x7f155c067150 msgr2=0x7f155c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:09.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.585+0000 7f1562c00640 1 -- 172.21.15.175:0/1124076730 shutdown_connections 2024-04-25T09:12:09.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.585+0000 7f1562c00640 1 -- 172.21.15.175:0/1124076730 wait complete. 2024-04-25T09:12:09.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.585+0000 7f1562c00640 1 Processor -- start 2024-04-25T09:12:09.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.585+0000 7f1562c00640 1 -- start start 2024-04-25T09:12:09.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f1562c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f155c071780 0x7f155c0add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f1562c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f155c0aeb30 0x7f155c0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f1562c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f155c142ee0 0x7f155c0b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f1562c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c15e220 con 0x7f155c071780 2024-04-25T09:12:09.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f1562c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c15e0a0 con 0x7f155c0aeb30 2024-04-25T09:12:09.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f1562c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c15e3a0 con 0x7f155c142ee0 2024-04-25T09:12:09.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f155be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f155c071780 0x7f155c0add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f155be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f155c071780 0x7f155c0add60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45868/0 (socket says 172.21.15.175:45868) 2024-04-25T09:12:09.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f155be00640 1 -- 172.21.15.175:0/1023863102 learned_addr learned my addr 172.21.15.175:0/1023863102 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:09.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f1553400640 1 --2- 172.21.15.175:0/1023863102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f155c0aeb30 0x7f155c0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f1560c00640 1 --2- 172.21.15.175:0/1023863102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f155c142ee0 0x7f155c0b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f155be00640 1 -- 172.21.15.175:0/1023863102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f155c142ee0 msgr2=0x7f155c0b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f155be00640 1 --2- 172.21.15.175:0/1023863102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f155c142ee0 0x7f155c0b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f155be00640 1 -- 172.21.15.175:0/1023863102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f155c0aeb30 msgr2=0x7f155c0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f155be00640 1 --2- 172.21.15.175:0/1023863102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f155c0aeb30 0x7f155c0b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f155be00640 1 -- 172.21.15.175:0/1023863102 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c0b03f0 con 0x7f155c071780 2024-04-25T09:12:09.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f1560c00640 1 --2- 172.21.15.175:0/1023863102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f155c142ee0 0x7f155c0b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:09.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f155be00640 1 --2- 172.21.15.175:0/1023863102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f155c071780 0x7f155c0add60 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f154c00ce00 tx=0x7f154c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f1558c00640 1 -- 172.21.15.175:0/1023863102 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c00f890 con 0x7f155c071780 2024-04-25T09:12:09.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f1558c00640 1 -- 172.21.15.175:0/1023863102 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c00fa30 con 0x7f155c071780 2024-04-25T09:12:09.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f1562c00640 1 -- 172.21.15.175:0/1023863102 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155c0b0110 con 0x7f155c071780 2024-04-25T09:12:09.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f1558c00640 1 -- 172.21.15.175:0/1023863102 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c00fe40 con 0x7f155c071780 2024-04-25T09:12:09.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f1562c00640 1 -- 172.21.15.175:0/1023863102 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155c165350 con 0x7f155c071780 2024-04-25T09:12:09.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f1562c00640 1 -- 172.21.15.175:0/1023863102 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155c074a60 con 0x7f155c071780 2024-04-25T09:12:09.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f1558c00640 1 -- 172.21.15.175:0/1023863102 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f154c018400 con 0x7f155c071780 2024-04-25T09:12:09.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.589+0000 7f1558c00640 1 --2- 172.21.15.175:0/1023863102 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1538066f90 0x7f1538069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.593+0000 7f1558c00640 1 -- 172.21.15.175:0/1023863102 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f154c085f70 con 0x7f155c071780 2024-04-25T09:12:09.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.593+0000 7f1553400640 1 --2- 172.21.15.175:0/1023863102 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1538066f90 0x7f1538069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.593+0000 7f1553400640 1 --2- 172.21.15.175:0/1023863102 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1538066f90 0x7f1538069450 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f155c15d860 tx=0x7f1544008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.593+0000 7f1558c00640 1 -- 172.21.15.175:0/1023863102 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f154c014030 con 0x7f155c071780 2024-04-25T09:12:09.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.781+0000 7f1562c00640 1 -- 172.21.15.175:0/1023863102 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f155c0721c0 con 0x7f155c071780 2024-04-25T09:12:09.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.781+0000 7f1558c00640 1 -- 172.21.15.175:0/1023863102 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f154c00ae20 con 0x7f155c071780 2024-04-25T09:12:09.769 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:09.769 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":71,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3229536012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3229536012},{"type":"v1","addr":"172.21.15.177:6834","nonce":3229536012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/222649735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":222649735},{"type":"v1","addr":"172.21.15.177:6835","nonce":222649735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2888989442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2888989442},{"type":"v1","addr":"172.21.15.175:6836","nonce":2888989442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:03.786939+0000","modified":"2024-04-25T09:11:29.735549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7303":{"gid":7303,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6837/279367590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":279367590},{"type":"v1","addr":"172.21.15.175:6837","nonce":279367590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:12:09.769 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 71 2024-04-25T09:12:09.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.785+0000 7f1562c00640 1 -- 172.21.15.175:0/1023863102 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1538066f90 msgr2=0x7f1538069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.785+0000 7f1562c00640 1 --2- 172.21.15.175:0/1023863102 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1538066f90 0x7f1538069450 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f155c15d860 tx=0x7f1544008040 comp rx=0 tx=0).stop 2024-04-25T09:12:09.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.785+0000 7f1562c00640 1 -- 172.21.15.175:0/1023863102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f155c071780 msgr2=0x7f155c0add60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.785+0000 7f1562c00640 1 --2- 172.21.15.175:0/1023863102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f155c071780 0x7f155c0add60 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f154c00ce00 tx=0x7f154c00a650 comp rx=0 tx=0).stop 2024-04-25T09:12:09.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.785+0000 7f1562c00640 1 -- 172.21.15.175:0/1023863102 shutdown_connections 2024-04-25T09:12:09.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.785+0000 7f1562c00640 1 --2- 172.21.15.175:0/1023863102 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1538066f90 0x7f1538069450 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.785+0000 7f1562c00640 1 --2- 172.21.15.175:0/1023863102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f155c142ee0 0x7f155c0b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.785+0000 7f1562c00640 1 --2- 172.21.15.175:0/1023863102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f155c0aeb30 0x7f155c0b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.785+0000 7f1562c00640 1 --2- 172.21.15.175:0/1023863102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f155c071780 0x7f155c0add60 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.785+0000 7f1562c00640 1 -- 172.21.15.175:0/1023863102 >> 172.21.15.175:0/1023863102 conn(0x7f155c06e340 msgr2=0x7f155c15b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:09.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.785+0000 7f1562c00640 1 -- 172.21.15.175:0/1023863102 shutdown_connections 2024-04-25T09:12:09.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.785+0000 7f1562c00640 1 -- 172.21.15.175:0/1023863102 wait complete. 2024-04-25T09:12:09.790 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:09.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.937+0000 7f055bc00640 1 Processor -- start 2024-04-25T09:12:09.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.937+0000 7f055bc00640 1 -- start start 2024-04-25T09:12:09.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f055bc00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f05540cfc70 0x7f055406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f055bc00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05540cda00 con 0x7f055415a900 2024-04-25T09:12:09.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f055bc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05540cdce0 con 0x7f05540cd520 2024-04-25T09:12:09.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f055bc00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055415bcf0 con 0x7f05540cfc70 2024-04-25T09:12:09.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0559200640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f055415a900 0x7f05540ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38102/0 (socket says 172.21.15.175:38102) 2024-04-25T09:12:09.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0559200640 1 -- 172.21.15.175:0/2314497773 learned_addr learned my addr 172.21.15.175:0/2314497773 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:09.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0559c00640 1 --2- 172.21.15.175:0/2314497773 >> v2:172.21.15.177:3300/0 conn(0x7f05540cfc70 0x7f055406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0553e00640 1 -- 172.21.15.175:0/2314497773 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902427185 0 0) 0x7f05540cda00 con 0x7f055415a900 2024-04-25T09:12:09.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0553e00640 1 -- 172.21.15.175:0/2314497773 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0538005740 con 0x7f055415a900 2024-04-25T09:12:09.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0553e00640 1 -- 172.21.15.175:0/2314497773 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234901270 0 0) 0x7f05540cdce0 con 0x7f05540cd520 2024-04-25T09:12:09.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0553e00640 1 -- 172.21.15.175:0/2314497773 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05540cda00 con 0x7f05540cd520 2024-04-25T09:12:09.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0553e00640 1 -- 172.21.15.175:0/2314497773 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3346099559 0 0) 0x7f0538005740 con 0x7f055415a900 2024-04-25T09:12:09.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0553e00640 1 -- 172.21.15.175:0/2314497773 >> v2:172.21.15.177:3300/0 conn(0x7f05540cfc70 msgr2=0x7f055406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:09.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0553e00640 1 --2- 172.21.15.175:0/2314497773 >> v2:172.21.15.177:3300/0 conn(0x7f05540cfc70 0x7f055406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0553e00640 1 -- 172.21.15.175:0/2314497773 >> v1:172.21.15.177:6789/0 conn(0x7f05540cd520 legacy=0x7f05540cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0553e00640 1 -- 172.21.15.175:0/2314497773 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05540cdfc0 con 0x7f055415a900 2024-04-25T09:12:09.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0553e00640 1 -- 172.21.15.175:0/2314497773 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f0544001680 con 0x7f055415a900 2024-04-25T09:12:09.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0559c00640 1 --2- 172.21.15.175:0/2314497773 >> v2:172.21.15.177:3300/0 conn(0x7f05540cfc70 0x7f055406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:09.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0553e00640 1 -- 172.21.15.175:0/2314497773 >> v1:172.21.15.175:6789/0 conn(0x7f055415a900 legacy=0x7f05540ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0553e00640 1 --2- 172.21.15.175:0/2314497773 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0538005d60 0x7f0538006160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0553e00640 1 --2- 172.21.15.175:0/2314497773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0538006a20 0x7f0538006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0553e00640 1 --2- 172.21.15.175:0/2314497773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05380073e0 0x7f053800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0553e00640 1 -- 172.21.15.175:0/2314497773 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053800e230 con 0x7f0538006a20 2024-04-25T09:12:09.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0553e00640 1 -- 172.21.15.175:0/2314497773 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053800e3e0 con 0x7f05380073e0 2024-04-25T09:12:09.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0553e00640 1 -- 172.21.15.175:0/2314497773 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053800e5e0 con 0x7f0538005d60 2024-04-25T09:12:09.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f054be00640 1 --2- 172.21.15.175:0/2314497773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0538006a20 0x7f0538006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0559200640 1 --2- 172.21.15.175:0/2314497773 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0538005d60 0x7f0538006160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0559c00640 1 --2- 172.21.15.175:0/2314497773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05380073e0 0x7f053800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f054be00640 1 -- 172.21.15.175:0/2314497773 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0538005d60 msgr2=0x7f0538006160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:09.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f054be00640 1 --2- 172.21.15.175:0/2314497773 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0538005d60 0x7f0538006160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f054be00640 1 -- 172.21.15.175:0/2314497773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05380073e0 msgr2=0x7f053800dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:09.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f054be00640 1 --2- 172.21.15.175:0/2314497773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05380073e0 0x7f053800dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f054be00640 1 -- 172.21.15.175:0/2314497773 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0538005740 con 0x7f0538006a20 2024-04-25T09:12:09.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0559c00640 1 --2- 172.21.15.175:0/2314497773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05380073e0 0x7f053800dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:09.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0559200640 1 --2- 172.21.15.175:0/2314497773 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0538005d60 0x7f0538006160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:09.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.941+0000 7f0559c00640 1 -- 172.21.15.175:0/2314497773 reap_dead start 2024-04-25T09:12:09.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.945+0000 7f054be00640 1 --2- 172.21.15.175:0/2314497773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0538006a20 0x7f0538006ea0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f05540cd930 tx=0x7f053c01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb03338c925bd14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.945+0000 7f0553e00640 1 -- 172.21.15.175:0/2314497773 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c001520 con 0x7f0538006a20 2024-04-25T09:12:09.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.945+0000 7f0553e00640 1 -- 172.21.15.175:0/2314497773 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c0052f0 con 0x7f0538006a20 2024-04-25T09:12:09.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.945+0000 7f0553e00640 1 -- 172.21.15.175:0/2314497773 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c0a88d0 con 0x7f0538006a20 2024-04-25T09:12:09.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.945+0000 7f055bc00640 1 -- 172.21.15.175:0/2314497773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0538006a20 msgr2=0x7f0538006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.945+0000 7f055bc00640 1 --2- 172.21.15.175:0/2314497773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0538006a20 0x7f0538006ea0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f05540cd930 tx=0x7f053c01ec70 comp rx=0 tx=0).stop 2024-04-25T09:12:09.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.945+0000 7f055bc00640 1 -- 172.21.15.175:0/2314497773 shutdown_connections 2024-04-25T09:12:09.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.945+0000 7f055bc00640 1 --2- 172.21.15.175:0/2314497773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0538006a20 0x7f0538006ea0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.945+0000 7f055bc00640 1 -- 172.21.15.175:0/2314497773 >> 172.21.15.175:0/2314497773 conn(0x7f0554067150 msgr2=0x7f055406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:09.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.945+0000 7f055bc00640 1 -- 172.21.15.175:0/2314497773 shutdown_connections 2024-04-25T09:12:09.933 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.945+0000 7f055bc00640 1 -- 172.21.15.175:0/2314497773 wait complete. 2024-04-25T09:12:09.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f055bc00640 1 Processor -- start 2024-04-25T09:12:09.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f055bc00640 1 -- start start 2024-04-25T09:12:09.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f055bc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05540acd70 0x7f05540b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f055bc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05540ad150 0x7f05540b1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f055bc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0554147d80 0x7f0554148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f055bc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055406d3b0 con 0x7f05540ad150 2024-04-25T09:12:09.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f055bc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05540ce580 con 0x7f05540acd70 2024-04-25T09:12:09.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f055bc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055406d530 con 0x7f0554147d80 2024-04-25T09:12:09.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f054be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05540ad150 0x7f05540b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f054be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05540ad150 0x7f05540b1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45894/0 (socket says 172.21.15.175:45894) 2024-04-25T09:12:09.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f054be00640 1 -- 172.21.15.175:0/1951799293 learned_addr learned my addr 172.21.15.175:0/1951799293 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:09.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f0559200640 1 --2- 172.21.15.175:0/1951799293 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05540acd70 0x7f05540b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f0559c00640 1 --2- 172.21.15.175:0/1951799293 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0554147d80 0x7f0554148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f054be00640 1 -- 172.21.15.175:0/1951799293 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0554147d80 msgr2=0x7f0554148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f054be00640 1 --2- 172.21.15.175:0/1951799293 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0554147d80 0x7f0554148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f054be00640 1 -- 172.21.15.175:0/1951799293 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05540acd70 msgr2=0x7f05540b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f054be00640 1 --2- 172.21.15.175:0/1951799293 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05540acd70 0x7f05540b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f054be00640 1 -- 172.21.15.175:0/1951799293 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05540af510 con 0x7f05540ad150 2024-04-25T09:12:09.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f0559200640 1 --2- 172.21.15.175:0/1951799293 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05540acd70 0x7f05540b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:09.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f054be00640 1 --2- 172.21.15.175:0/1951799293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05540ad150 0x7f05540b1100 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f053c01eaa0 tx=0x7f0538007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f0551600640 1 -- 172.21.15.175:0/1951799293 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c0bd070 con 0x7f05540ad150 2024-04-25T09:12:09.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f0551600640 1 -- 172.21.15.175:0/1951799293 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c0054a0 con 0x7f05540ad150 2024-04-25T09:12:09.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f0551600640 1 -- 172.21.15.175:0/1951799293 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c001500 con 0x7f05540ad150 2024-04-25T09:12:09.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f055bc00640 1 -- 172.21.15.175:0/1951799293 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05540af7f0 con 0x7f05540ad150 2024-04-25T09:12:09.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f055bc00640 1 -- 172.21.15.175:0/1951799293 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05540afdb0 con 0x7f05540ad150 2024-04-25T09:12:09.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.949+0000 7f055bc00640 1 -- 172.21.15.175:0/1951799293 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0554074a60 con 0x7f05540ad150 2024-04-25T09:12:09.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.953+0000 7f0551600640 1 -- 172.21.15.175:0/1951799293 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f053c0c0070 con 0x7f05540ad150 2024-04-25T09:12:09.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.953+0000 7f0551600640 1 --2- 172.21.15.175:0/1951799293 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0530066f60 0x7f0530069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.953+0000 7f0551600640 1 -- 172.21.15.175:0/1951799293 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f053c1217b0 con 0x7f05540ad150 2024-04-25T09:12:09.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.953+0000 7f0559200640 1 --2- 172.21.15.175:0/1951799293 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0530066f60 0x7f0530069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.953+0000 7f0559200640 1 --2- 172.21.15.175:0/1951799293 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0530066f60 0x7f0530069420 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0544000c10 tx=0x7f0544009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.943 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:09.957+0000 7f0551600640 1 -- 172.21.15.175:0/1951799293 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f053c018980 con 0x7f05540ad150 2024-04-25T09:12:10.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.149+0000 7f055bc00640 1 -- 172.21.15.175:0/1951799293 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05540ae720 con 0x7f05540ad150 2024-04-25T09:12:10.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.149+0000 7f0551600640 1 -- 172.21.15.175:0/1951799293 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f053c0f26f0 con 0x7f05540ad150 2024-04-25T09:12:10.136 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:10.136 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":71,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3229536012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3229536012},{"type":"v1","addr":"172.21.15.177:6834","nonce":3229536012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/222649735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":222649735},{"type":"v1","addr":"172.21.15.177:6835","nonce":222649735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2888989442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2888989442},{"type":"v1","addr":"172.21.15.175:6836","nonce":2888989442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:03.786939+0000","modified":"2024-04-25T09:11:29.735549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7303":{"gid":7303,"name":"c","rank":0,"incarnation":68,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6837/279367590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":279367590},{"type":"v1","addr":"172.21.15.175:6837","nonce":279367590}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:12:10.137 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 71 2024-04-25T09:12:10.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.149+0000 7f055bc00640 1 -- 172.21.15.175:0/1951799293 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0530066f60 msgr2=0x7f0530069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.149+0000 7f055bc00640 1 --2- 172.21.15.175:0/1951799293 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0530066f60 0x7f0530069420 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0544000c10 tx=0x7f0544009040 comp rx=0 tx=0).stop 2024-04-25T09:12:10.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.149+0000 7f055bc00640 1 -- 172.21.15.175:0/1951799293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05540ad150 msgr2=0x7f05540b1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.149+0000 7f055bc00640 1 --2- 172.21.15.175:0/1951799293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05540ad150 0x7f05540b1100 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f053c01eaa0 tx=0x7f0538007a50 comp rx=0 tx=0).stop 2024-04-25T09:12:10.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.153+0000 7f055bc00640 1 -- 172.21.15.175:0/1951799293 shutdown_connections 2024-04-25T09:12:10.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.153+0000 7f055bc00640 1 --2- 172.21.15.175:0/1951799293 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0530066f60 0x7f0530069420 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.153+0000 7f055bc00640 1 --2- 172.21.15.175:0/1951799293 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0554147d80 0x7f0554148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.153+0000 7f055bc00640 1 --2- 172.21.15.175:0/1951799293 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05540ad150 0x7f05540b1100 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.153+0000 7f055bc00640 1 --2- 172.21.15.175:0/1951799293 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05540acd70 0x7f05540b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.153+0000 7f055bc00640 1 -- 172.21.15.175:0/1951799293 >> 172.21.15.175:0/1951799293 conn(0x7f0538006a20 msgr2=0x7f055406d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:10.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.153+0000 7f055bc00640 1 -- 172.21.15.175:0/1951799293 shutdown_connections 2024-04-25T09:12:10.139 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.153+0000 7f055bc00640 1 -- 172.21.15.175:0/1951799293 wait complete. 2024-04-25T09:12:10.157 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:10.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.305+0000 7f9d47800640 1 Processor -- start 2024-04-25T09:12:10.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.305+0000 7f9d47800640 1 -- start start 2024-04-25T09:12:10.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.305+0000 7f9d47800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9d4015a900 0x7f9d4006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d47800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d400cd520 0x7f9d400ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d47800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9d400cf560 0x7f9d400cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d47800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d400cfef0 con 0x7f9d4015a900 2024-04-25T09:12:10.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d47800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d400cda00 con 0x7f9d400cf560 2024-04-25T09:12:10.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d47800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d400cdce0 con 0x7f9d400cd520 2024-04-25T09:12:10.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d44e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9d4015a900 0x7f9d4006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d44e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9d4015a900 0x7f9d4006e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45900/0 (socket says 172.21.15.175:45900) 2024-04-25T09:12:10.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d44e00640 1 -- 172.21.15.175:0/2894524901 learned_addr learned my addr 172.21.15.175:0/2894524901 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:10.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d45800640 1 --2- 172.21.15.175:0/2894524901 >> v2:172.21.15.177:3300/0 conn(0x7f9d400cf560 0x7f9d400cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d44e00640 1 -- 172.21.15.175:0/2894524901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d400cd520 msgr2=0x7f9d400ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:10.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d37e00640 1 --2- 172.21.15.175:0/2894524901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d400cd520 0x7f9d400ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d44e00640 1 --2- 172.21.15.175:0/2894524901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d400cd520 0x7f9d400ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d44e00640 1 -- 172.21.15.175:0/2894524901 >> v2:172.21.15.177:3300/0 conn(0x7f9d400cf560 msgr2=0x7f9d400cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:10.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d44e00640 1 --2- 172.21.15.175:0/2894524901 >> v2:172.21.15.177:3300/0 conn(0x7f9d400cf560 0x7f9d400cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d44e00640 1 -- 172.21.15.175:0/2894524901 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d400cdfc0 con 0x7f9d4015a900 2024-04-25T09:12:10.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d45800640 1 --2- 172.21.15.175:0/2894524901 >> v2:172.21.15.177:3300/0 conn(0x7f9d400cf560 0x7f9d400cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:10.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d37e00640 1 --2- 172.21.15.175:0/2894524901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d400cd520 0x7f9d400ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:10.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d44e00640 1 --2- 172.21.15.175:0/2894524901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4015a900 0x7f9d4006e150 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f9d4015e2f0 tx=0x7f9d3001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653ded2c74460475 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:10.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d3fe00640 1 -- 172.21.15.175:0/2894524901 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d300aa610 con 0x7f9d4015a900 2024-04-25T09:12:10.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d3fe00640 1 -- 172.21.15.175:0/2894524901 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d300af070 con 0x7f9d4015a900 2024-04-25T09:12:10.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.309+0000 7f9d3fe00640 1 -- 172.21.15.175:0/2894524901 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d300aa9d0 con 0x7f9d4015a900 2024-04-25T09:12:10.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d47800640 1 -- 172.21.15.175:0/2894524901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4015a900 msgr2=0x7f9d4006e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d47800640 1 --2- 172.21.15.175:0/2894524901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4015a900 0x7f9d4006e150 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f9d4015e2f0 tx=0x7f9d3001c4f0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d47800640 1 -- 172.21.15.175:0/2894524901 shutdown_connections 2024-04-25T09:12:10.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d47800640 1 --2- 172.21.15.175:0/2894524901 >> v2:172.21.15.177:3300/0 conn(0x7f9d400cf560 0x7f9d400cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d47800640 1 --2- 172.21.15.175:0/2894524901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d400cd520 0x7f9d400ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d47800640 1 --2- 172.21.15.175:0/2894524901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d4015a900 0x7f9d4006e150 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d47800640 1 -- 172.21.15.175:0/2894524901 >> 172.21.15.175:0/2894524901 conn(0x7f9d40067150 msgr2=0x7f9d4006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:10.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d47800640 1 -- 172.21.15.175:0/2894524901 shutdown_connections 2024-04-25T09:12:10.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d47800640 1 -- 172.21.15.175:0/2894524901 wait complete. 2024-04-25T09:12:10.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d47800640 1 Processor -- start 2024-04-25T09:12:10.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d47800640 1 -- start start 2024-04-25T09:12:10.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d47800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d400cf560 0x7f9d40140080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d47800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d4015a900 0x7f9d400b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d47800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d400b2e60 0x7f9d40150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d47800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4006d530 con 0x7f9d400b2e60 2024-04-25T09:12:10.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d47800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4006d3b0 con 0x7f9d4015a900 2024-04-25T09:12:10.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d47800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4015c790 con 0x7f9d400cf560 2024-04-25T09:12:10.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d45800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d400b2e60 0x7f9d40150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d45800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d400b2e60 0x7f9d40150870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45908/0 (socket says 172.21.15.175:45908) 2024-04-25T09:12:10.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d45800640 1 -- 172.21.15.175:0/2137677509 learned_addr learned my addr 172.21.15.175:0/2137677509 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:10.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d44e00640 1 --2- 172.21.15.175:0/2137677509 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d400cf560 0x7f9d40140080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d37e00640 1 --2- 172.21.15.175:0/2137677509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d4015a900 0x7f9d400b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d45800640 1 -- 172.21.15.175:0/2137677509 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d400cf560 msgr2=0x7f9d40140080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d45800640 1 --2- 172.21.15.175:0/2137677509 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d400cf560 0x7f9d40140080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d45800640 1 -- 172.21.15.175:0/2137677509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d4015a900 msgr2=0x7f9d400b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.313+0000 7f9d45800640 1 --2- 172.21.15.175:0/2137677509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d4015a900 0x7f9d400b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.317+0000 7f9d45800640 1 -- 172.21.15.175:0/2137677509 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d400b3490 con 0x7f9d400b2e60 2024-04-25T09:12:10.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.317+0000 7f9d45800640 1 --2- 172.21.15.175:0/2137677509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d400b2e60 0x7f9d40150870 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800cef0 tx=0x7f9d3800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:10.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.317+0000 7f9d3d600640 1 -- 172.21.15.175:0/2137677509 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3801a070 con 0x7f9d400b2e60 2024-04-25T09:12:10.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.317+0000 7f9d3d600640 1 -- 172.21.15.175:0/2137677509 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3800d860 con 0x7f9d400b2e60 2024-04-25T09:12:10.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.317+0000 7f9d3d600640 1 -- 172.21.15.175:0/2137677509 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3800dc50 con 0x7f9d400b2e60 2024-04-25T09:12:10.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.317+0000 7f9d47800640 1 -- 172.21.15.175:0/2137677509 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d400b3770 con 0x7f9d400b2e60 2024-04-25T09:12:10.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.317+0000 7f9d47800640 1 -- 172.21.15.175:0/2137677509 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d400b3d30 con 0x7f9d400b2e60 2024-04-25T09:12:10.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.317+0000 7f9d47800640 1 -- 172.21.15.175:0/2137677509 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d40074a60 con 0x7f9d400b2e60 2024-04-25T09:12:10.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.317+0000 7f9d3d600640 1 -- 172.21.15.175:0/2137677509 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9d3801d070 con 0x7f9d400b2e60 2024-04-25T09:12:10.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.317+0000 7f9d3d600640 1 --2- 172.21.15.175:0/2137677509 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9d1c066f90 0x7f9d1c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.317+0000 7f9d3d600640 1 -- 172.21.15.175:0/2137677509 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f9d38085980 con 0x7f9d400b2e60 2024-04-25T09:12:10.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.317+0000 7f9d44e00640 1 --2- 172.21.15.175:0/2137677509 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9d1c066f90 0x7f9d1c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.321+0000 7f9d44e00640 1 --2- 172.21.15.175:0/2137677509 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9d1c066f90 0x7f9d1c069450 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9d300ae000 tx=0x7f9d300a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:10.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.321+0000 7f9d3d600640 1 -- 172.21.15.175:0/2137677509 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9d380561d0 con 0x7f9d400b2e60 2024-04-25T09:12:10.465 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.477+0000 7f9d47800640 1 -- 172.21.15.175:0/2137677509 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d400cce90 con 0x7f9d400b2e60 2024-04-25T09:12:10.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.481+0000 7f9d3d600640 1 -- 172.21.15.175:0/2137677509 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+17009 (secure 0 0 0) 0x7f9d3805a270 con 0x7f9d400b2e60 2024-04-25T09:12:10.467 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:10.467 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":88,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:11:26.715623+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:01.518283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:02.788015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.38","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6837/1399691338":"2024-04-26T09:11:26.715601+0000","172.21.15.175:6835/1399691338":"2024-04-26T09:11:26.715601+0000","172.21.15.175:6837/1755192276":"2024-04-26T09:10:14.425304+0000","172.21.15.175:6835/1755192276":"2024-04-26T09:10:14.425304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:10.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.481+0000 7f9d47800640 1 -- 172.21.15.175:0/2137677509 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9d1c066f90 msgr2=0x7f9d1c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.481+0000 7f9d47800640 1 --2- 172.21.15.175:0/2137677509 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9d1c066f90 0x7f9d1c069450 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9d300ae000 tx=0x7f9d300a7000 comp rx=0 tx=0).stop 2024-04-25T09:12:10.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.481+0000 7f9d47800640 1 -- 172.21.15.175:0/2137677509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d400b2e60 msgr2=0x7f9d40150870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.481+0000 7f9d47800640 1 --2- 172.21.15.175:0/2137677509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d400b2e60 0x7f9d40150870 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f9d3800cef0 tx=0x7f9d3800a710 comp rx=0 tx=0).stop 2024-04-25T09:12:10.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.481+0000 7f9d47800640 1 -- 172.21.15.175:0/2137677509 shutdown_connections 2024-04-25T09:12:10.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.481+0000 7f9d47800640 1 --2- 172.21.15.175:0/2137677509 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9d1c066f90 0x7f9d1c069450 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.481+0000 7f9d47800640 1 --2- 172.21.15.175:0/2137677509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d400b2e60 0x7f9d40150870 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.481+0000 7f9d47800640 1 --2- 172.21.15.175:0/2137677509 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d4015a900 0x7f9d400b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.481+0000 7f9d47800640 1 --2- 172.21.15.175:0/2137677509 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d400cf560 0x7f9d40140080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.481+0000 7f9d47800640 1 -- 172.21.15.175:0/2137677509 >> 172.21.15.175:0/2137677509 conn(0x7f9d400cd520 msgr2=0x7f9d4006ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:10.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.481+0000 7f9d47800640 1 -- 172.21.15.175:0/2137677509 shutdown_connections 2024-04-25T09:12:10.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.481+0000 7f9d47800640 1 -- 172.21.15.175:0/2137677509 wait complete. 2024-04-25T09:12:10.487 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:12:10.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.637+0000 7fc0bc600640 1 Processor -- start 2024-04-25T09:12:10.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.637+0000 7fc0bc600640 1 -- start start 2024-04-25T09:12:10.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.637+0000 7fc0bc600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0b40b4810 0x7fc0b40b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.637+0000 7fc0bc600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc0b40ceb50 0x7fc0b40cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.637+0000 7fc0bc600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b406dd80 con 0x7fc0b4070e10 2024-04-25T09:12:10.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.637+0000 7fc0bc600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b406d8f0 con 0x7fc0b40ceb50 2024-04-25T09:12:10.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.637+0000 7fc0bc600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b406cd70 con 0x7fc0b40b4810 2024-04-25T09:12:10.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.637+0000 7fc0ba600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc0b40ceb50 0x7fc0b40cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.637+0000 7fc0ba600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc0b40ceb50 0x7fc0b40cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45918/0 (socket says 172.21.15.175:45918) 2024-04-25T09:12:10.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.637+0000 7fc0ba600640 1 -- 172.21.15.175:0/1153715742 learned_addr learned my addr 172.21.15.175:0/1153715742 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:10.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.637+0000 7fc0b9200640 1 --2- 172.21.15.175:0/1153715742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0b40b4810 0x7fc0b40b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.637+0000 7fc0ba600640 1 -- 172.21.15.175:0/1153715742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0b40b4810 msgr2=0x7fc0b40b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:10.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.637+0000 7fc0ba600640 1 --2- 172.21.15.175:0/1153715742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0b40b4810 0x7fc0b40b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.637+0000 7fc0ba600640 1 -- 172.21.15.175:0/1153715742 >> v1:172.21.15.177:6789/0 conn(0x7fc0b4070e10 legacy=0x7fc0b40711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.637+0000 7fc0ba600640 1 -- 172.21.15.175:0/1153715742 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b406cfc0 con 0x7fc0b40ceb50 2024-04-25T09:12:10.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.641+0000 7fc0ba600640 1 --2- 172.21.15.175:0/1153715742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b40ceb50 0x7fc0b40cefe0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009e50 tx=0x7fc0ac01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc990a2f9476f4a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:10.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.641+0000 7fc0b3e00640 1 -- 172.21.15.175:0/1153715742 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac0a58d0 con 0x7fc0b40ceb50 2024-04-25T09:12:10.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.641+0000 7fc0b3e00640 1 -- 172.21.15.175:0/1153715742 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ac0a5a70 con 0x7fc0b40ceb50 2024-04-25T09:12:10.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.641+0000 7fc0b3e00640 1 -- 172.21.15.175:0/1153715742 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac0a5e40 con 0x7fc0b40ceb50 2024-04-25T09:12:10.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.641+0000 7fc0bc600640 1 -- 172.21.15.175:0/1153715742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b40ceb50 msgr2=0x7fc0b40cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.641+0000 7fc0bc600640 1 --2- 172.21.15.175:0/1153715742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b40ceb50 0x7fc0b40cefe0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009e50 tx=0x7fc0ac01ca00 comp rx=0 tx=0).stop 2024-04-25T09:12:10.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.641+0000 7fc0bc600640 1 -- 172.21.15.175:0/1153715742 shutdown_connections 2024-04-25T09:12:10.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.641+0000 7fc0bc600640 1 --2- 172.21.15.175:0/1153715742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b40ceb50 0x7fc0b40cefe0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.641+0000 7fc0bc600640 1 --2- 172.21.15.175:0/1153715742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0b40b4810 0x7fc0b40b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.641+0000 7fc0bc600640 1 -- 172.21.15.175:0/1153715742 >> 172.21.15.175:0/1153715742 conn(0x7fc0b40b3510 msgr2=0x7fc0b40b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:10.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.641+0000 7fc0bc600640 1 -- 172.21.15.175:0/1153715742 shutdown_connections 2024-04-25T09:12:10.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.641+0000 7fc0bc600640 1 -- 172.21.15.175:0/1153715742 wait complete. 2024-04-25T09:12:10.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0bc600640 1 Processor -- start 2024-04-25T09:12:10.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0bc600640 1 -- start start 2024-04-25T09:12:10.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0bc600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0b4070e10 0x7fc0b40b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0bc600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0b40b4810 0x7fc0b40b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0bc600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b40ceb50 0x7fc0b41593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0bc600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b416a440 con 0x7fc0b40ceb50 2024-04-25T09:12:10.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0bc600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b415e110 con 0x7fc0b4070e10 2024-04-25T09:12:10.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0bc600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b416a5c0 con 0x7fc0b40b4810 2024-04-25T09:12:10.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0ba600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b40ceb50 0x7fc0b41593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0ba600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b40ceb50 0x7fc0b41593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45924/0 (socket says 172.21.15.175:45924) 2024-04-25T09:12:10.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0ba600640 1 -- 172.21.15.175:0/3529890356 learned_addr learned my addr 172.21.15.175:0/3529890356 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:10.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0b9200640 1 --2- 172.21.15.175:0/3529890356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0b40b4810 0x7fc0b40b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0b9c00640 1 --2- 172.21.15.175:0/3529890356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0b4070e10 0x7fc0b40b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0ba600640 1 -- 172.21.15.175:0/3529890356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0b40b4810 msgr2=0x7fc0b40b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0ba600640 1 --2- 172.21.15.175:0/3529890356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0b40b4810 0x7fc0b40b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0ba600640 1 -- 172.21.15.175:0/3529890356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0b4070e10 msgr2=0x7fc0b40b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0ba600640 1 --2- 172.21.15.175:0/3529890356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0b4070e10 0x7fc0b40b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0ba600640 1 -- 172.21.15.175:0/3529890356 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b414b450 con 0x7fc0b40ceb50 2024-04-25T09:12:10.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0b9c00640 1 --2- 172.21.15.175:0/3529890356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0b4070e10 0x7fc0b40b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:10.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0ba600640 1 --2- 172.21.15.175:0/3529890356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b40ceb50 0x7fc0b41593d0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac0af040 tx=0x7fc0ac0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:10.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0b1600640 1 -- 172.21.15.175:0/3529890356 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac0bc020 con 0x7fc0b40ceb50 2024-04-25T09:12:10.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0b1600640 1 -- 172.21.15.175:0/3529890356 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ac007df0 con 0x7fc0b40ceb50 2024-04-25T09:12:10.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0b1600640 1 -- 172.21.15.175:0/3529890356 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac0a58d0 con 0x7fc0b40ceb50 2024-04-25T09:12:10.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0bc600640 1 -- 172.21.15.175:0/3529890356 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b40b1af0 con 0x7fc0b40ceb50 2024-04-25T09:12:10.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.645+0000 7fc0bc600640 1 -- 172.21.15.175:0/3529890356 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b40b20b0 con 0x7fc0b40ceb50 2024-04-25T09:12:10.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.649+0000 7fc0bc600640 1 -- 172.21.15.175:0/3529890356 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b414b620 con 0x7fc0b40ceb50 2024-04-25T09:12:10.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.649+0000 7fc0b1600640 1 -- 172.21.15.175:0/3529890356 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc0ac0bf020 con 0x7fc0b40ceb50 2024-04-25T09:12:10.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.649+0000 7fc0b1600640 1 --2- 172.21.15.175:0/3529890356 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc094066f60 0x7fc094069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.649+0000 7fc0b1600640 1 -- 172.21.15.175:0/3529890356 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fc0ac120590 con 0x7fc0b40ceb50 2024-04-25T09:12:10.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.649+0000 7fc0b9c00640 1 --2- 172.21.15.175:0/3529890356 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc094066f60 0x7fc094069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:10.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.649+0000 7fc0b9c00640 1 --2- 172.21.15.175:0/3529890356 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc094066f60 0x7fc094069420 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8001710 tx=0x7fc0a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:10.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.653+0000 7fc0b1600640 1 -- 172.21.15.175:0/3529890356 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc0ac0c6030 con 0x7fc0b40ceb50 2024-04-25T09:12:10.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.841+0000 7fc0bc600640 1 -- 172.21.15.175:0/3529890356 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc0b4075160 con 0x7fc0b40ceb50 2024-04-25T09:12:10.826 INFO:tasks.ceph.mon.a.smithi175.stderr:2024-04-25T09:12:10.841+0000 7feb0ee00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:12:10.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.841+0000 7fc0b1600640 1 -- 172.21.15.175:0/3529890356 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v72) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc0ac016620 con 0x7fc0b40ceb50 2024-04-25T09:12:10.829 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:12:10.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.845+0000 7fc0bc600640 1 -- 172.21.15.175:0/3529890356 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc094066f60 msgr2=0x7fc094069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.845+0000 7fc0bc600640 1 --2- 172.21.15.175:0/3529890356 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc094066f60 0x7fc094069420 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8001710 tx=0x7fc0a8009040 comp rx=0 tx=0).stop 2024-04-25T09:12:10.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.845+0000 7fc0bc600640 1 -- 172.21.15.175:0/3529890356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b40ceb50 msgr2=0x7fc0b41593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:10.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.845+0000 7fc0bc600640 1 --2- 172.21.15.175:0/3529890356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b40ceb50 0x7fc0b41593d0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac0af040 tx=0x7fc0ac0197a0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.845+0000 7fc0bc600640 1 -- 172.21.15.175:0/3529890356 shutdown_connections 2024-04-25T09:12:10.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.845+0000 7fc0bc600640 1 --2- 172.21.15.175:0/3529890356 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc094066f60 0x7fc094069420 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.845+0000 7fc0bc600640 1 --2- 172.21.15.175:0/3529890356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0b40ceb50 0x7fc0b41593d0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.845+0000 7fc0bc600640 1 --2- 172.21.15.175:0/3529890356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0b40b4810 0x7fc0b40b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.845+0000 7fc0bc600640 1 --2- 172.21.15.175:0/3529890356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0b4070e10 0x7fc0b40b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:10.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.845+0000 7fc0bc600640 1 -- 172.21.15.175:0/3529890356 >> 172.21.15.175:0/3529890356 conn(0x7fc0b40b3510 msgr2=0x7fc0b414df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:10.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.845+0000 7fc0bc600640 1 -- 172.21.15.175:0/3529890356 shutdown_connections 2024-04-25T09:12:10.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:10.845+0000 7fc0bc600640 1 -- 172.21.15.175:0/3529890356 wait complete. 2024-04-25T09:12:10.840 INFO:tasks.ceph.mds.c.smithi175.stderr: -2342> 2024-04-25T09:11:32.722+0000 7f6748c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:12:10.841 INFO:tasks.ceph.mds.c.smithi175.stderr: -1950> 2024-04-25T09:11:33.506+0000 7f6743c00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55bfdcf60680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(13)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(13)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:12:10.854 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:12:10.887 INFO:tasks.ceph.mds.c.smithi175.stdout:starting mds.c at 2024-04-25T09:12:10.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.009+0000 7f09cbe00640 1 Processor -- start 2024-04-25T09:12:10.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.009+0000 7f09cbe00640 1 -- start start 2024-04-25T09:12:10.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.013+0000 7f09cbe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09c4145250 0x7f09c40cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.013+0000 7f09cbe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f09c41600a0 0x7f09c40cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.013+0000 7f09cbe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f09c40ce970 0x7f09c40cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:10.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.013+0000 7f09cbe00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c415f650 con 0x7f09c40ce970 2024-04-25T09:12:11.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.013+0000 7f09cbe00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c40cfd10 con 0x7f09c41600a0 2024-04-25T09:12:11.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.013+0000 7f09cbe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c40cfff0 con 0x7f09c4145250 2024-04-25T09:12:11.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.013+0000 7f09c9e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f09c40ce970 0x7f09c40cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:11.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.013+0000 7f09c9e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f09c40ce970 0x7f09c40cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45940/0 (socket says 172.21.15.175:45940) 2024-04-25T09:12:11.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.013+0000 7f09c9e00640 1 -- 172.21.15.175:0/2806974275 learned_addr learned my addr 172.21.15.175:0/2806974275 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:11.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.013+0000 7f09c8a00640 1 --2- 172.21.15.175:0/2806974275 >> v2:172.21.15.177:3300/0 conn(0x7f09c41600a0 0x7f09c40cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:11.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.013+0000 7f09c9400640 1 --2- 172.21.15.175:0/2806974275 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09c4145250 0x7f09c40cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:11.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.013+0000 7f09c9e00640 1 -- 172.21.15.175:0/2806974275 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09c4145250 msgr2=0x7f09c40cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:11.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.013+0000 7f09c9e00640 1 --2- 172.21.15.175:0/2806974275 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09c4145250 0x7f09c40cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.013+0000 7f09c9e00640 1 -- 172.21.15.175:0/2806974275 >> v2:172.21.15.177:3300/0 conn(0x7f09c41600a0 msgr2=0x7f09c40cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:11.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.013+0000 7f09c9e00640 1 --2- 172.21.15.175:0/2806974275 >> v2:172.21.15.177:3300/0 conn(0x7f09c41600a0 0x7f09c40cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.013+0000 7f09c9e00640 1 -- 172.21.15.175:0/2806974275 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c415f8a0 con 0x7f09c40ce970 2024-04-25T09:12:11.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.017+0000 7f09c9e00640 1 --2- 172.21.15.175:0/2806974275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c40ce970 0x7f09c40cee00 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f09c406bbe0 tx=0x7f09bc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c266a80eb9fd8f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:11.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.017+0000 7f09c3e00640 1 -- 172.21.15.175:0/2806974275 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc0aa430 con 0x7f09c40ce970 2024-04-25T09:12:11.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.017+0000 7f09c3e00640 1 -- 172.21.15.175:0/2806974275 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09bc0af070 con 0x7f09c40ce970 2024-04-25T09:12:11.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.017+0000 7f09c3e00640 1 -- 172.21.15.175:0/2806974275 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc0aa7f0 con 0x7f09c40ce970 2024-04-25T09:12:11.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.017+0000 7f09cbe00640 1 -- 172.21.15.175:0/2806974275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c40ce970 msgr2=0x7f09c40cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:11.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.017+0000 7f09cbe00640 1 --2- 172.21.15.175:0/2806974275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c40ce970 0x7f09c40cee00 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f09c406bbe0 tx=0x7f09bc01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.017+0000 7f09cbe00640 1 -- 172.21.15.175:0/2806974275 shutdown_connections 2024-04-25T09:12:11.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.017+0000 7f09cbe00640 1 --2- 172.21.15.175:0/2806974275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c40ce970 0x7f09c40cee00 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.017+0000 7f09cbe00640 1 --2- 172.21.15.175:0/2806974275 >> v2:172.21.15.177:3300/0 conn(0x7f09c41600a0 0x7f09c40cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.017+0000 7f09cbe00640 1 --2- 172.21.15.175:0/2806974275 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09c4145250 0x7f09c40cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.017+0000 7f09cbe00640 1 -- 172.21.15.175:0/2806974275 >> 172.21.15.175:0/2806974275 conn(0x7f09c406ac50 msgr2=0x7f09c406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:11.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.017+0000 7f09cbe00640 1 -- 172.21.15.175:0/2806974275 shutdown_connections 2024-04-25T09:12:11.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.017+0000 7f09cbe00640 1 -- 172.21.15.175:0/2806974275 wait complete. 2024-04-25T09:12:11.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.017+0000 7f09cbe00640 1 Processor -- start 2024-04-25T09:12:11.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.017+0000 7f09cbe00640 1 -- start start 2024-04-25T09:12:11.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09cbe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09c40ce970 0x7f09c4164b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:11.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09cbe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09c4145250 0x7f09c41650d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:11.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09cbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c41600a0 0x7f09c40b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:11.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09cbe00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c4160480 con 0x7f09c41600a0 2024-04-25T09:12:11.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09cbe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c4145630 con 0x7f09c40ce970 2024-04-25T09:12:11.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09cbe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c4160600 con 0x7f09c4145250 2024-04-25T09:12:11.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09c9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c41600a0 0x7f09c40b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:11.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09c9e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c41600a0 0x7f09c40b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45950/0 (socket says 172.21.15.175:45950) 2024-04-25T09:12:11.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09c9e00640 1 -- 172.21.15.175:0/4076979624 learned_addr learned my addr 172.21.15.175:0/4076979624 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:11.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09c8a00640 1 --2- 172.21.15.175:0/4076979624 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09c4145250 0x7f09c41650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:11.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09c9400640 1 --2- 172.21.15.175:0/4076979624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09c40ce970 0x7f09c4164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:11.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09c9e00640 1 -- 172.21.15.175:0/4076979624 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09c4145250 msgr2=0x7f09c41650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:11.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09c9e00640 1 --2- 172.21.15.175:0/4076979624 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09c4145250 0x7f09c41650d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09c9e00640 1 -- 172.21.15.175:0/4076979624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09c40ce970 msgr2=0x7f09c4164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:11.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09c9e00640 1 --2- 172.21.15.175:0/4076979624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09c40ce970 0x7f09c4164b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09c9e00640 1 -- 172.21.15.175:0/4076979624 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c40b2890 con 0x7f09c41600a0 2024-04-25T09:12:11.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09c8a00640 1 --2- 172.21.15.175:0/4076979624 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09c4145250 0x7f09c41650d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:11.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09c9e00640 1 --2- 172.21.15.175:0/4076979624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c41600a0 0x7f09c40b3d20 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0ac040 tx=0x7f09bc01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:11.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09c1600640 1 -- 172.21.15.175:0/4076979624 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc0bd5f0 con 0x7f09c41600a0 2024-04-25T09:12:11.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09c1600640 1 -- 172.21.15.175:0/4076979624 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09bc0bd790 con 0x7f09c41600a0 2024-04-25T09:12:11.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09cbe00640 1 -- 172.21.15.175:0/4076979624 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c40b2b70 con 0x7f09c41600a0 2024-04-25T09:12:11.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09c1600640 1 -- 172.21.15.175:0/4076979624 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc0bdb40 con 0x7f09c41600a0 2024-04-25T09:12:11.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09cbe00640 1 -- 172.21.15.175:0/4076979624 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c40b3130 con 0x7f09c41600a0 2024-04-25T09:12:11.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09cbe00640 1 -- 172.21.15.175:0/4076979624 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c4075160 con 0x7f09c41600a0 2024-04-25T09:12:11.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.021+0000 7f09c1600640 1 -- 172.21.15.175:0/4076979624 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f09bc0b33f0 con 0x7f09c41600a0 2024-04-25T09:12:11.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.025+0000 7f09c1600640 1 --2- 172.21.15.175:0/4076979624 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f09a4066f60 0x7f09a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:11.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.025+0000 7f09c1600640 1 -- 172.21.15.175:0/4076979624 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5996+0+0 (secure 0 0 0) 0x7f09bc11ff10 con 0x7f09c41600a0 2024-04-25T09:12:11.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.025+0000 7f09c9400640 1 --2- 172.21.15.175:0/4076979624 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f09a4066f60 0x7f09a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:11.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.025+0000 7f09c9400640 1 --2- 172.21.15.175:0/4076979624 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f09a4066f60 0x7f09a4069420 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f09b8003fd0 tx=0x7f09b8003a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:11.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.029+0000 7f09c1600640 1 -- 172.21.15.175:0/4076979624 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f09bc0c3060 con 0x7f09c41600a0 2024-04-25T09:12:11.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.213+0000 7f09cbe00640 1 -- 172.21.15.175:0/4076979624 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f09c40b24d0 con 0x7f09c41600a0 2024-04-25T09:12:11.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.845+0000 7f09c1600640 1 -- 172.21.15.175:0/4076979624 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v73) v1 ==== 104+0+0 (secure 0 0 0) 0x7f09bc016110 con 0x7f09c41600a0 2024-04-25T09:12:11.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.845+0000 7f09cbe00640 1 -- 172.21.15.175:0/4076979624 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f09a4066f60 msgr2=0x7f09a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:11.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.845+0000 7f09cbe00640 1 --2- 172.21.15.175:0/4076979624 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f09a4066f60 0x7f09a4069420 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f09b8003fd0 tx=0x7f09b8003a00 comp rx=0 tx=0).stop 2024-04-25T09:12:11.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.845+0000 7f09cbe00640 1 -- 172.21.15.175:0/4076979624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c41600a0 msgr2=0x7f09c40b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:11.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.845+0000 7f09cbe00640 1 --2- 172.21.15.175:0/4076979624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c41600a0 0x7f09c40b3d20 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0ac040 tx=0x7f09bc01ad30 comp rx=0 tx=0).stop 2024-04-25T09:12:11.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.845+0000 7f09cbe00640 1 -- 172.21.15.175:0/4076979624 shutdown_connections 2024-04-25T09:12:11.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.845+0000 7f09cbe00640 1 --2- 172.21.15.175:0/4076979624 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f09a4066f60 0x7f09a4069420 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.845+0000 7f09cbe00640 1 --2- 172.21.15.175:0/4076979624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09c41600a0 0x7f09c40b3d20 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.845+0000 7f09cbe00640 1 --2- 172.21.15.175:0/4076979624 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09c4145250 0x7f09c41650d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.845+0000 7f09cbe00640 1 --2- 172.21.15.175:0/4076979624 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09c40ce970 0x7f09c4164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:11.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.845+0000 7f09cbe00640 1 -- 172.21.15.175:0/4076979624 >> 172.21.15.175:0/4076979624 conn(0x7f09c406ac50 msgr2=0x7f09c40b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:11.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.845+0000 7f09cbe00640 1 -- 172.21.15.175:0/4076979624 shutdown_connections 2024-04-25T09:12:11.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:11.845+0000 7f09cbe00640 1 -- 172.21.15.175:0/4076979624 wait complete. 2024-04-25T09:12:11.855 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:12:12.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.049+0000 7f7769600640 1 Processor -- start 2024-04-25T09:12:12.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.049+0000 7f7769600640 1 -- start start 2024-04-25T09:12:12.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.053+0000 7f7769600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f77640cfb60 0x7f77640ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.053+0000 7f7769600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77640ced10 0x7f77640712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.053+0000 7f7769600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7764071e20 con 0x7f77640717f0 2024-04-25T09:12:12.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.053+0000 7f7769600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77640cbed0 con 0x7f77640cfb60 2024-04-25T09:12:12.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.053+0000 7f7769600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7764072100 con 0x7f77640ced10 2024-04-25T09:12:12.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.053+0000 7f7762a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f77640cfb60 0x7f77640ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.053+0000 7f7762a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f77640cfb60 0x7f77640ce7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45956/0 (socket says 172.21.15.175:45956) 2024-04-25T09:12:12.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.053+0000 7f7762a00640 1 -- 172.21.15.175:0/1518680810 learned_addr learned my addr 172.21.15.175:0/1518680810 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:12.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.053+0000 7f775a000640 1 --2- 172.21.15.175:0/1518680810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77640ced10 0x7f77640712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.053+0000 7f7762a00640 1 -- 172.21.15.175:0/1518680810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77640ced10 msgr2=0x7f77640712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:12.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.053+0000 7f7762a00640 1 --2- 172.21.15.175:0/1518680810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77640ced10 0x7f77640712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.053+0000 7f7762a00640 1 -- 172.21.15.175:0/1518680810 >> v1:172.21.15.177:6789/0 conn(0x7f77640717f0 legacy=0x7f776406d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.053+0000 7f7762a00640 1 -- 172.21.15.175:0/1518680810 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77640cc120 con 0x7f77640cfb60 2024-04-25T09:12:12.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7762a00640 1 --2- 172.21.15.175:0/1518680810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77640cfb60 0x7f77640ce7d0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f7754009e50 tx=0x7f775401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb7ff32d2c84686 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:12.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7762000640 1 -- 172.21.15.175:0/1518680810 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77540a5660 con 0x7f77640cfb60 2024-04-25T09:12:12.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7762000640 1 -- 172.21.15.175:0/1518680810 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77540a5800 con 0x7f77640cfb60 2024-04-25T09:12:12.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7762000640 1 -- 172.21.15.175:0/1518680810 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77540a5bd0 con 0x7f77640cfb60 2024-04-25T09:12:12.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7769600640 1 -- 172.21.15.175:0/1518680810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77640cfb60 msgr2=0x7f77640ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7769600640 1 --2- 172.21.15.175:0/1518680810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77640cfb60 0x7f77640ce7d0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f7754009e50 tx=0x7f775401c9a0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7769600640 1 -- 172.21.15.175:0/1518680810 shutdown_connections 2024-04-25T09:12:12.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7769600640 1 --2- 172.21.15.175:0/1518680810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77640ced10 0x7f77640712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7769600640 1 --2- 172.21.15.175:0/1518680810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77640cfb60 0x7f77640ce7d0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7769600640 1 -- 172.21.15.175:0/1518680810 >> 172.21.15.175:0/1518680810 conn(0x7f776406ac50 msgr2=0x7f776406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:12.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7769600640 1 -- 172.21.15.175:0/1518680810 shutdown_connections 2024-04-25T09:12:12.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7769600640 1 -- 172.21.15.175:0/1518680810 wait complete. 2024-04-25T09:12:12.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7769600640 1 Processor -- start 2024-04-25T09:12:12.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7769600640 1 -- start start 2024-04-25T09:12:12.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7769600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77640717f0 0x7f77640a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7769600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77640ced10 0x7f7764131e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7769600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77640cfb60 0x7f77641f6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7769600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77640cd2b0 con 0x7f77640717f0 2024-04-25T09:12:12.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7769600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77640cd130 con 0x7f77640ced10 2024-04-25T09:12:12.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7769600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776406df70 con 0x7f77640cfb60 2024-04-25T09:12:12.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7762a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77640717f0 0x7f77640a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7762a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77640717f0 0x7f77640a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45966/0 (socket says 172.21.15.175:45966) 2024-04-25T09:12:12.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7762a00640 1 -- 172.21.15.175:0/4189775262 learned_addr learned my addr 172.21.15.175:0/4189775262 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:12.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f7763400640 1 --2- 172.21.15.175:0/4189775262 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77640cfb60 0x7f77641f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.057+0000 7f775a000640 1 --2- 172.21.15.175:0/4189775262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77640ced10 0x7f7764131e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.061+0000 7f7762a00640 1 -- 172.21.15.175:0/4189775262 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77640cfb60 msgr2=0x7f77641f6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.061+0000 7f7762a00640 1 --2- 172.21.15.175:0/4189775262 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77640cfb60 0x7f77641f6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.061+0000 7f7762a00640 1 -- 172.21.15.175:0/4189775262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77640ced10 msgr2=0x7f7764131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.061+0000 7f7762a00640 1 --2- 172.21.15.175:0/4189775262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77640ced10 0x7f7764131e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.061+0000 7f7762a00640 1 -- 172.21.15.175:0/4189775262 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77640a8c00 con 0x7f77640717f0 2024-04-25T09:12:12.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.061+0000 7f775a000640 1 --2- 172.21.15.175:0/4189775262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77640ced10 0x7f7764131e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:12.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.061+0000 7f7762a00640 1 --2- 172.21.15.175:0/4189775262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77640717f0 0x7f77640a84b0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f77540af040 tx=0x7f7754019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:12.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.061+0000 7f775b400640 1 -- 172.21.15.175:0/4189775262 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754009510 con 0x7f77640717f0 2024-04-25T09:12:12.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.061+0000 7f775b400640 1 -- 172.21.15.175:0/4189775262 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77540be070 con 0x7f77640717f0 2024-04-25T09:12:12.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.061+0000 7f7769600640 1 -- 172.21.15.175:0/4189775262 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f776415ced0 con 0x7f77640717f0 2024-04-25T09:12:12.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.061+0000 7f775b400640 1 -- 172.21.15.175:0/4189775262 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77540b88d0 con 0x7f77640717f0 2024-04-25T09:12:12.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.061+0000 7f7769600640 1 -- 172.21.15.175:0/4189775262 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f776415d490 con 0x7f77640717f0 2024-04-25T09:12:12.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.061+0000 7f7769600640 1 -- 172.21.15.175:0/4189775262 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7764075160 con 0x7f77640717f0 2024-04-25T09:12:12.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.061+0000 7f775b400640 1 -- 172.21.15.175:0/4189775262 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f77540b8a70 con 0x7f77640717f0 2024-04-25T09:12:12.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.061+0000 7f775b400640 1 --2- 172.21.15.175:0/4189775262 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7740066f60 0x7f7740069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:12.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.061+0000 7f775b400640 1 -- 172.21.15.175:0/4189775262 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5996+0+0 (secure 0 0 0) 0x7f7754120430 con 0x7f77640717f0 2024-04-25T09:12:12.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.061+0000 7f775a000640 1 --2- 172.21.15.175:0/4189775262 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7740066f60 0x7f7740069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:12.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.065+0000 7f775a000640 1 --2- 172.21.15.175:0/4189775262 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7740066f60 0x7f7740069420 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f77641f9d80 tx=0x7f774c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:12.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.065+0000 7f775b400640 1 -- 172.21.15.175:0/4189775262 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7754016620 con 0x7f77640717f0 2024-04-25T09:12:12.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.221+0000 7f7769600640 1 -- 172.21.15.175:0/4189775262 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f77640ae960 con 0x7f77640717f0 2024-04-25T09:12:12.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.989+0000 7f775b400640 1 -- 172.21.15.175:0/4189775262 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) v1 ==== 181+0+0 (secure 0 0 0) 0x7f77540f1310 con 0x7f77640717f0 2024-04-25T09:12:12.974 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:12:12.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.989+0000 7f7769600640 1 -- 172.21.15.175:0/4189775262 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7740066f60 msgr2=0x7f7740069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.989+0000 7f7769600640 1 --2- 172.21.15.175:0/4189775262 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7740066f60 0x7f7740069420 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f77641f9d80 tx=0x7f774c008040 comp rx=0 tx=0).stop 2024-04-25T09:12:12.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.989+0000 7f7769600640 1 -- 172.21.15.175:0/4189775262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77640717f0 msgr2=0x7f77640a84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:12.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.989+0000 7f7769600640 1 --2- 172.21.15.175:0/4189775262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77640717f0 0x7f77640a84b0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f77540af040 tx=0x7f7754019740 comp rx=0 tx=0).stop 2024-04-25T09:12:12.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.989+0000 7f7769600640 1 -- 172.21.15.175:0/4189775262 shutdown_connections 2024-04-25T09:12:12.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.989+0000 7f7769600640 1 --2- 172.21.15.175:0/4189775262 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7740066f60 0x7f7740069420 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.989+0000 7f7769600640 1 --2- 172.21.15.175:0/4189775262 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f77640cfb60 0x7f77641f6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.989+0000 7f7769600640 1 --2- 172.21.15.175:0/4189775262 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f77640ced10 0x7f7764131e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:12.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.989+0000 7f7769600640 1 --2- 172.21.15.175:0/4189775262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77640717f0 0x7f77640a84b0 secure :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f77540af040 tx=0x7f7754019740 comp rx=0 tx=0).stop 2024-04-25T09:12:12.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.989+0000 7f7769600640 1 -- 172.21.15.175:0/4189775262 >> 172.21.15.175:0/4189775262 conn(0x7f776406ac50 msgr2=0x7f77640b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:12.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.993+0000 7f7769600640 1 -- 172.21.15.175:0/4189775262 shutdown_connections 2024-04-25T09:12:12.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:12.993+0000 7f7769600640 1 -- 172.21.15.175:0/4189775262 wait complete. 2024-04-25T09:12:13.002 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:12:13.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.157+0000 7f6647400640 1 Processor -- start 2024-04-25T09:12:13.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.157+0000 7f6647400640 1 -- start start 2024-04-25T09:12:13.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.157+0000 7f6647400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f664015b700 0x7f66400b7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:13.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.157+0000 7f6647400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f664015fb90 0x7f664015fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:13.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.157+0000 7f6647400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f664015c670 con 0x7f664015bae0 2024-04-25T09:12:13.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.157+0000 7f6647400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66400b7850 con 0x7f664015b700 2024-04-25T09:12:13.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.157+0000 7f6647400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f664015f700 con 0x7f664015fb90 2024-04-25T09:12:13.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.157+0000 7f6644a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f664015b700 0x7f66400b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:13.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.157+0000 7f6645400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f664015bae0 0x7f66400cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38122/0 (socket says 172.21.15.175:38122) 2024-04-25T09:12:13.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.157+0000 7f6645400640 1 -- 172.21.15.175:0/1422469651 learned_addr learned my addr 172.21.15.175:0/1422469651 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:13.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.157+0000 7f663fe00640 1 --2- 172.21.15.175:0/1422469651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f664015fb90 0x7f664015fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:13.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.157+0000 7f663f400640 1 -- 172.21.15.175:0/1422469651 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889553820 0 0) 0x7f664015c670 con 0x7f664015bae0 2024-04-25T09:12:13.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.157+0000 7f663f400640 1 -- 172.21.15.175:0/1422469651 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6624003530 con 0x7f664015bae0 2024-04-25T09:12:13.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.157+0000 7f6644a00640 1 -- 172.21.15.175:0/1422469651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f664015fb90 msgr2=0x7f664015fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:13.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.157+0000 7f6644a00640 1 --2- 172.21.15.175:0/1422469651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f664015fb90 0x7f664015fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:13.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.157+0000 7f6644a00640 1 -- 172.21.15.175:0/1422469651 >> v1:172.21.15.175:6789/0 conn(0x7f664015bae0 legacy=0x7f66400cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:13.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.157+0000 7f6644a00640 1 -- 172.21.15.175:0/1422469651 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664015c950 con 0x7f664015b700 2024-04-25T09:12:13.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.161+0000 7f6644a00640 1 --2- 172.21.15.175:0/1422469651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f664015b700 0x7f66400b7310 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f66300097c0 tx=0x7f663001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68df003c6dcea23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:13.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.161+0000 7f663f400640 1 -- 172.21.15.175:0/1422469651 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66300aa620 con 0x7f664015b700 2024-04-25T09:12:13.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.161+0000 7f663f400640 1 -- 172.21.15.175:0/1422469651 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66300af070 con 0x7f664015b700 2024-04-25T09:12:13.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.161+0000 7f663f400640 1 -- 172.21.15.175:0/1422469651 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66300aa9e0 con 0x7f664015b700 2024-04-25T09:12:13.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.161+0000 7f6647400640 1 -- 172.21.15.175:0/1422469651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f664015b700 msgr2=0x7f66400b7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:13.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.161+0000 7f6647400640 1 --2- 172.21.15.175:0/1422469651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f664015b700 0x7f66400b7310 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f66300097c0 tx=0x7f663001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:12:13.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.161+0000 7f6647400640 1 -- 172.21.15.175:0/1422469651 shutdown_connections 2024-04-25T09:12:13.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.161+0000 7f6647400640 1 --2- 172.21.15.175:0/1422469651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f664015fb90 0x7f664015fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:13.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.161+0000 7f6647400640 1 --2- 172.21.15.175:0/1422469651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f664015b700 0x7f66400b7310 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:13.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.161+0000 7f6647400640 1 -- 172.21.15.175:0/1422469651 >> 172.21.15.175:0/1422469651 conn(0x7f66400d1880 msgr2=0x7f66400d1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:13.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.161+0000 7f6647400640 1 -- 172.21.15.175:0/1422469651 shutdown_connections 2024-04-25T09:12:13.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.161+0000 7f6647400640 1 -- 172.21.15.175:0/1422469651 wait complete. 2024-04-25T09:12:13.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f6647400640 1 Processor -- start 2024-04-25T09:12:13.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f6647400640 1 -- start start 2024-04-25T09:12:13.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f6647400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f664015b700 0x7f664006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:13.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f6647400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f664015bae0 0x7f664006bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:13.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f6647400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f664015fb90 0x7f664015def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:13.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f6647400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6640168660 con 0x7f664015bae0 2024-04-25T09:12:13.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f6647400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66400cfce0 con 0x7f664015b700 2024-04-25T09:12:13.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f6647400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66401687e0 con 0x7f664015fb90 2024-04-25T09:12:13.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f663fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f664015bae0 0x7f664006bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:13.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f663fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f664015bae0 0x7f664006bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45988/0 (socket says 172.21.15.175:45988) 2024-04-25T09:12:13.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f663fe00640 1 -- 172.21.15.175:0/2578926317 learned_addr learned my addr 172.21.15.175:0/2578926317 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:13.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f6645400640 1 --2- 172.21.15.175:0/2578926317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f664015fb90 0x7f664015def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:13.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f6644a00640 1 --2- 172.21.15.175:0/2578926317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f664015b700 0x7f664006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:13.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f663fe00640 1 -- 172.21.15.175:0/2578926317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f664015fb90 msgr2=0x7f664015def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:13.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f663fe00640 1 --2- 172.21.15.175:0/2578926317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f664015fb90 0x7f664015def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:13.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f663fe00640 1 -- 172.21.15.175:0/2578926317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f664015b700 msgr2=0x7f664006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:13.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f663fe00640 1 --2- 172.21.15.175:0/2578926317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f664015b700 0x7f664006d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:13.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f663fe00640 1 -- 172.21.15.175:0/2578926317 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66401f99a0 con 0x7f664015bae0 2024-04-25T09:12:13.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f6644a00640 1 --2- 172.21.15.175:0/2578926317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f664015b700 0x7f664006d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:13.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f663fe00640 1 --2- 172.21.15.175:0/2578926317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f664015bae0 0x7f664006bd60 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f662c00e930 tx=0x7f662c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:13.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f663cc00640 1 -- 172.21.15.175:0/2578926317 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c017070 con 0x7f664015bae0 2024-04-25T09:12:13.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f663cc00640 1 -- 172.21.15.175:0/2578926317 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c00ca00 con 0x7f664015bae0 2024-04-25T09:12:13.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f663cc00640 1 -- 172.21.15.175:0/2578926317 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c00cdd0 con 0x7f664015bae0 2024-04-25T09:12:13.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f6647400640 1 -- 172.21.15.175:0/2578926317 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66401f9c80 con 0x7f664015bae0 2024-04-25T09:12:13.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.165+0000 7f6647400640 1 -- 172.21.15.175:0/2578926317 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66401fa240 con 0x7f664015bae0 2024-04-25T09:12:13.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.169+0000 7f6647400640 1 -- 172.21.15.175:0/2578926317 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6640075160 con 0x7f664015bae0 2024-04-25T09:12:13.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.169+0000 7f663cc00640 1 -- 172.21.15.175:0/2578926317 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f662c01a070 con 0x7f664015bae0 2024-04-25T09:12:13.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.169+0000 7f663cc00640 1 --2- 172.21.15.175:0/2578926317 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6620066f90 0x7f6620069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:13.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.169+0000 7f663cc00640 1 -- 172.21.15.175:0/2578926317 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5558+0+0 (secure 0 0 0) 0x7f662c085300 con 0x7f664015bae0 2024-04-25T09:12:13.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.169+0000 7f6644a00640 1 --2- 172.21.15.175:0/2578926317 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6620066f90 0x7f6620069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:13.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.169+0000 7f6644a00640 1 --2- 172.21.15.175:0/2578926317 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6620066f90 0x7f6620069450 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f66300ae000 tx=0x7f66300a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:13.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.173+0000 7f663cc00640 1 -- 172.21.15.175:0/2578926317 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f662c055d70 con 0x7f664015bae0 2024-04-25T09:12:13.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.329+0000 7f6647400640 1 -- 172.21.15.175:0/2578926317 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f664006e5a0 con 0x7f664015bae0 2024-04-25T09:12:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.997+0000 7f663cc00640 1 -- 172.21.15.175:0/2578926317 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) v1 ==== 169+0+0 (secure 0 0 0) 0x7f662c059e10 con 0x7f664015bae0 2024-04-25T09:12:13.982 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_data' removed 2024-04-25T09:12:13.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.997+0000 7f6647400640 1 -- 172.21.15.175:0/2578926317 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6620066f90 msgr2=0x7f6620069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:13.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.997+0000 7f6647400640 1 --2- 172.21.15.175:0/2578926317 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6620066f90 0x7f6620069450 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f66300ae000 tx=0x7f66300a7000 comp rx=0 tx=0).stop 2024-04-25T09:12:13.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.997+0000 7f6647400640 1 -- 172.21.15.175:0/2578926317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f664015bae0 msgr2=0x7f664006bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:13.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.997+0000 7f6647400640 1 --2- 172.21.15.175:0/2578926317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f664015bae0 0x7f664006bd60 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f662c00e930 tx=0x7f662c00edf0 comp rx=0 tx=0).stop 2024-04-25T09:12:13.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.997+0000 7f6647400640 1 -- 172.21.15.175:0/2578926317 shutdown_connections 2024-04-25T09:12:13.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.997+0000 7f6647400640 1 --2- 172.21.15.175:0/2578926317 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6620066f90 0x7f6620069450 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:13.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.997+0000 7f6647400640 1 --2- 172.21.15.175:0/2578926317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f664015fb90 0x7f664015def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:13.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.997+0000 7f6647400640 1 --2- 172.21.15.175:0/2578926317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f664015bae0 0x7f664006bd60 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:13.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.997+0000 7f6647400640 1 --2- 172.21.15.175:0/2578926317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f664015b700 0x7f664006d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:13.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.997+0000 7f6647400640 1 -- 172.21.15.175:0/2578926317 >> 172.21.15.175:0/2578926317 conn(0x7f66400d1880 msgr2=0x7f66400b6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:13.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.997+0000 7f6647400640 1 -- 172.21.15.175:0/2578926317 shutdown_connections 2024-04-25T09:12:13.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:13.997+0000 7f6647400640 1 -- 172.21.15.175:0/2578926317 wait complete. 2024-04-25T09:12:14.013 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:12:14.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.165+0000 7f7cf2800640 1 Processor -- start 2024-04-25T09:12:14.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.165+0000 7f7cf2800640 1 -- start start 2024-04-25T09:12:14.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.165+0000 7f7cf2800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cec15af20 0x7f7cec0b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.165+0000 7f7cf2800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cec06db60 con 0x7f7cec0cbe60 2024-04-25T09:12:14.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.165+0000 7f7cf2800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cec06de40 con 0x7f7cec0b4630 2024-04-25T09:12:14.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.165+0000 7f7cf2800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec06e120 con 0x7f7cec15af20 2024-04-25T09:12:14.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.165+0000 7f7ceb400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7cec0cbe60 0x7f7cec06d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38130/0 (socket says 172.21.15.175:38130) 2024-04-25T09:12:14.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.165+0000 7f7ceb400640 1 -- 172.21.15.175:0/3892146424 learned_addr learned my addr 172.21.15.175:0/3892146424 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:14.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.165+0000 7f7ceaa00640 1 --2- 172.21.15.175:0/3892146424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cec15af20 0x7f7cec0b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.165+0000 7f7cea000640 1 -- 172.21.15.175:0/3892146424 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892545116 0 0) 0x7f7cec06db60 con 0x7f7cec0cbe60 2024-04-25T09:12:14.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7cea000640 1 -- 172.21.15.175:0/3892146424 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cd0005740 con 0x7f7cec0cbe60 2024-04-25T09:12:14.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7cea000640 1 -- 172.21.15.175:0/3892146424 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4159172566 0 0) 0x7f7cd0005740 con 0x7f7cec0cbe60 2024-04-25T09:12:14.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7cea000640 1 -- 172.21.15.175:0/3892146424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cec15af20 msgr2=0x7f7cec0b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:14.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7cea000640 1 --2- 172.21.15.175:0/3892146424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cec15af20 0x7f7cec0b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7cea000640 1 -- 172.21.15.175:0/3892146424 >> v1:172.21.15.177:6789/0 conn(0x7f7cec0b4630 legacy=0x7f7cec15c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7cea000640 1 -- 172.21.15.175:0/3892146424 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec15c2f0 con 0x7f7cec0cbe60 2024-04-25T09:12:14.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7cea000640 1 -- 172.21.15.175:0/3892146424 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f7cdc001a00 con 0x7f7cec0cbe60 2024-04-25T09:12:14.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7cea000640 1 -- 172.21.15.175:0/3892146424 >> v1:172.21.15.175:6789/0 conn(0x7f7cec0cbe60 legacy=0x7f7cec06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7cea000640 1 --2- 172.21.15.175:0/3892146424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cd0005c00 0x7f7cd0005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7cea000640 1 --2- 172.21.15.175:0/3892146424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd00065b0 0x7f7cd0006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7cea000640 1 --2- 172.21.15.175:0/3892146424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cec15af20 0x7f7cd00072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7cea000640 1 -- 172.21.15.175:0/3892146424 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec06e120 con 0x7f7cd00065b0 2024-04-25T09:12:14.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7cea000640 1 -- 172.21.15.175:0/3892146424 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd000dbe0 con 0x7f7cd0005c00 2024-04-25T09:12:14.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7cea000640 1 -- 172.21.15.175:0/3892146424 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd000dde0 con 0x7f7cec15af20 2024-04-25T09:12:14.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7ceaa00640 1 --2- 172.21.15.175:0/3892146424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd00065b0 0x7f7cd0006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7ceb400640 1 --2- 172.21.15.175:0/3892146424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cd0005c00 0x7f7cd0005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7cebe00640 1 --2- 172.21.15.175:0/3892146424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cec15af20 0x7f7cd00072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7ceaa00640 1 -- 172.21.15.175:0/3892146424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cec15af20 msgr2=0x7f7cd00072e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:14.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7ceaa00640 1 --2- 172.21.15.175:0/3892146424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cec15af20 0x7f7cd00072e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7ceaa00640 1 -- 172.21.15.175:0/3892146424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cd0005c00 msgr2=0x7f7cd0005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:14.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7ceaa00640 1 --2- 172.21.15.175:0/3892146424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cd0005c00 0x7f7cd0005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.169+0000 7f7ceaa00640 1 -- 172.21.15.175:0/3892146424 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd0005740 con 0x7f7cd00065b0 2024-04-25T09:12:14.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7ceaa00640 1 --2- 172.21.15.175:0/3892146424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd00065b0 0x7f7cd0006a80 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009ae0 tx=0x7f7cd801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45439b211dee082f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:14.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7cea000640 1 -- 172.21.15.175:0/3892146424 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd80b2070 con 0x7f7cd00065b0 2024-04-25T09:12:14.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7cea000640 1 -- 172.21.15.175:0/3892146424 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd80a5660 con 0x7f7cd00065b0 2024-04-25T09:12:14.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7cea000640 1 -- 172.21.15.175:0/3892146424 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd80096b0 con 0x7f7cd00065b0 2024-04-25T09:12:14.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7cf2800640 1 -- 172.21.15.175:0/3892146424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd00065b0 msgr2=0x7f7cd0006a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7cf2800640 1 --2- 172.21.15.175:0/3892146424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cd00065b0 0x7f7cd0006a80 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009ae0 tx=0x7f7cd801ca70 comp rx=0 tx=0).stop 2024-04-25T09:12:14.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7cebe00640 1 -- 172.21.15.175:0/3892146424 reap_dead start 2024-04-25T09:12:14.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7cf2800640 1 -- 172.21.15.175:0/3892146424 shutdown_connections 2024-04-25T09:12:14.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7cf2800640 1 -- 172.21.15.175:0/3892146424 >> 172.21.15.175:0/3892146424 conn(0x7f7cec06ac50 msgr2=0x7f7cec06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:14.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7cf2800640 1 -- 172.21.15.175:0/3892146424 shutdown_connections 2024-04-25T09:12:14.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7cf2800640 1 -- 172.21.15.175:0/3892146424 wait complete. 2024-04-25T09:12:14.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7cf2800640 1 Processor -- start 2024-04-25T09:12:14.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7cf2800640 1 -- start start 2024-04-25T09:12:14.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7cf2800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cec147020 0x7f7cec0ad870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7cf2800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cec14a770 0x7f7cec0712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7cf2800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cec147400 0x7f7cec071810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7cf2800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec0b40f0 con 0x7f7cec14a770 2024-04-25T09:12:14.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7cf2800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec0cc490 con 0x7f7cec147020 2024-04-25T09:12:14.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7cf2800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cec0b4270 con 0x7f7cec147400 2024-04-25T09:12:14.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7ceaa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cec14a770 0x7f7cec0712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7ceaa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cec14a770 0x7f7cec0712d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46014/0 (socket says 172.21.15.175:46014) 2024-04-25T09:12:14.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.173+0000 7f7ceaa00640 1 -- 172.21.15.175:0/2993286520 learned_addr learned my addr 172.21.15.175:0/2993286520 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:14.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.177+0000 7f7ceb400640 1 --2- 172.21.15.175:0/2993286520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cec147020 0x7f7cec0ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.177+0000 7f7cebe00640 1 --2- 172.21.15.175:0/2993286520 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cec147400 0x7f7cec071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.177+0000 7f7ceaa00640 1 -- 172.21.15.175:0/2993286520 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cec147400 msgr2=0x7f7cec071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.177+0000 7f7ceaa00640 1 --2- 172.21.15.175:0/2993286520 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cec147400 0x7f7cec071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.177+0000 7f7ceaa00640 1 -- 172.21.15.175:0/2993286520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cec147020 msgr2=0x7f7cec0ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.177+0000 7f7ceaa00640 1 --2- 172.21.15.175:0/2993286520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cec147020 0x7f7cec0ad870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.177+0000 7f7ceaa00640 1 -- 172.21.15.175:0/2993286520 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec0a95a0 con 0x7f7cec14a770 2024-04-25T09:12:14.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.177+0000 7f7ceaa00640 1 --2- 172.21.15.175:0/2993286520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cec14a770 0x7f7cec0712d0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8098480 tx=0x7f7cd8019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:14.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.177+0000 7f7ce3400640 1 -- 172.21.15.175:0/2993286520 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd80be070 con 0x7f7cec14a770 2024-04-25T09:12:14.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.177+0000 7f7ce3400640 1 -- 172.21.15.175:0/2993286520 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd8004030 con 0x7f7cec14a770 2024-04-25T09:12:14.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.177+0000 7f7ce3400640 1 -- 172.21.15.175:0/2993286520 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd80b2040 con 0x7f7cec14a770 2024-04-25T09:12:14.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.177+0000 7f7cf2800640 1 -- 172.21.15.175:0/2993286520 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cec0a9880 con 0x7f7cec14a770 2024-04-25T09:12:14.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.177+0000 7f7cf2800640 1 -- 172.21.15.175:0/2993286520 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cec0a9e40 con 0x7f7cec14a770 2024-04-25T09:12:14.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.177+0000 7f7cf2800640 1 -- 172.21.15.175:0/2993286520 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cec075160 con 0x7f7cec14a770 2024-04-25T09:12:14.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.177+0000 7f7ce3400640 1 -- 172.21.15.175:0/2993286520 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7cd80c1070 con 0x7f7cec14a770 2024-04-25T09:12:14.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.177+0000 7f7ce3400640 1 --2- 172.21.15.175:0/2993286520 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7ccc066f90 0x7f7ccc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.177+0000 7f7ce3400640 1 -- 172.21.15.175:0/2993286520 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f7cd811eb50 con 0x7f7cec14a770 2024-04-25T09:12:14.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.177+0000 7f7ceb400640 1 --2- 172.21.15.175:0/2993286520 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7ccc066f90 0x7f7ccc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.181+0000 7f7ceb400640 1 --2- 172.21.15.175:0/2993286520 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7ccc066f90 0x7f7ccc069450 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc004bd0 tx=0x7f7cdc006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:14.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.181+0000 7f7ce3400640 1 -- 172.21.15.175:0/2993286520 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7cd8016780 con 0x7f7cec14a770 2024-04-25T09:12:14.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.337+0000 7f7cf2800640 1 -- 172.21.15.175:0/2993286520 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7cec06c2d0 con 0x7f7cec14a770 2024-04-25T09:12:14.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.341+0000 7f7ce3400640 1 -- 172.21.15.175:0/2993286520 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7cd80ef780 con 0x7f7cec14a770 2024-04-25T09:12:14.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.345+0000 7f7cf2800640 1 -- 172.21.15.175:0/2993286520 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7ccc066f90 msgr2=0x7f7ccc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.345+0000 7f7cf2800640 1 --2- 172.21.15.175:0/2993286520 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7ccc066f90 0x7f7ccc069450 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc004bd0 tx=0x7f7cdc006040 comp rx=0 tx=0).stop 2024-04-25T09:12:14.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.345+0000 7f7cf2800640 1 -- 172.21.15.175:0/2993286520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cec14a770 msgr2=0x7f7cec0712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.345+0000 7f7cf2800640 1 --2- 172.21.15.175:0/2993286520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cec14a770 0x7f7cec0712d0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8098480 tx=0x7f7cd8019810 comp rx=0 tx=0).stop 2024-04-25T09:12:14.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.345+0000 7f7cf2800640 1 -- 172.21.15.175:0/2993286520 shutdown_connections 2024-04-25T09:12:14.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.345+0000 7f7cf2800640 1 --2- 172.21.15.175:0/2993286520 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7ccc066f90 0x7f7ccc069450 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.345+0000 7f7cf2800640 1 --2- 172.21.15.175:0/2993286520 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7cec147400 0x7f7cec071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.345+0000 7f7cf2800640 1 --2- 172.21.15.175:0/2993286520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cec14a770 0x7f7cec0712d0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.345+0000 7f7cf2800640 1 --2- 172.21.15.175:0/2993286520 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cec147020 0x7f7cec0ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.345+0000 7f7cf2800640 1 -- 172.21.15.175:0/2993286520 >> 172.21.15.175:0/2993286520 conn(0x7f7cec06ac50 msgr2=0x7f7cec0b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:14.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.345+0000 7f7cf2800640 1 -- 172.21.15.175:0/2993286520 shutdown_connections 2024-04-25T09:12:14.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.345+0000 7f7cf2800640 1 -- 172.21.15.175:0/2993286520 wait complete. 2024-04-25T09:12:14.355 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-04-25T09:12:14.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.505+0000 7f7e82800640 1 Processor -- start 2024-04-25T09:12:14.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.505+0000 7f7e82800640 1 -- start start 2024-04-25T09:12:14.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.505+0000 7f7e82800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7e7c0cd520 0x7f7e7c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.505+0000 7f7e82800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e7c0cf560 0x7f7e7c0cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.505+0000 7f7e82800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7c0cda00 con 0x7f7e7c15a900 2024-04-25T09:12:14.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.505+0000 7f7e82800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7c15bcf0 con 0x7f7e7c0cd520 2024-04-25T09:12:14.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.505+0000 7f7e82800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c0cfef0 con 0x7f7e7c0cf560 2024-04-25T09:12:14.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.505+0000 7f7e7b400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7e7c15a900 0x7f7e7c0ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38144/0 (socket says 172.21.15.175:38144) 2024-04-25T09:12:14.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.505+0000 7f7e7b400640 1 -- 172.21.15.175:0/4256145540 learned_addr learned my addr 172.21.15.175:0/4256145540 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7be00640 1 --2- 172.21.15.175:0/4256145540 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e7c0cf560 0x7f7e7c0cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7aa00640 1 --2- 172.21.15.175:0/4256145540 >> v2:172.21.15.177:3300/0 conn(0x7f7e7c0cd520 0x7f7e7c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7a000640 1 -- 172.21.15.175:0/4256145540 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966742212 0 0) 0x7f7e7c0cda00 con 0x7f7e7c15a900 2024-04-25T09:12:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7a000640 1 -- 172.21.15.175:0/4256145540 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e60003530 con 0x7f7e7c15a900 2024-04-25T09:12:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7a000640 1 -- 172.21.15.175:0/4256145540 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2431516222 0 0) 0x7f7e60003530 con 0x7f7e7c15a900 2024-04-25T09:12:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7a000640 1 -- 172.21.15.175:0/4256145540 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e7c0cf560 msgr2=0x7f7e7c0cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7a000640 1 --2- 172.21.15.175:0/4256145540 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e7c0cf560 0x7f7e7c0cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7a000640 1 -- 172.21.15.175:0/4256145540 >> v2:172.21.15.177:3300/0 conn(0x7f7e7c0cd520 msgr2=0x7f7e7c06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7a000640 1 --2- 172.21.15.175:0/4256145540 >> v2:172.21.15.177:3300/0 conn(0x7f7e7c0cd520 0x7f7e7c06e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7a000640 1 -- 172.21.15.175:0/4256145540 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c0cdce0 con 0x7f7e7c15a900 2024-04-25T09:12:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7a000640 1 -- 172.21.15.175:0/4256145540 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f7e6c001a00 con 0x7f7e7c15a900 2024-04-25T09:12:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7a000640 1 -- 172.21.15.175:0/4256145540 >> v1:172.21.15.175:6789/0 conn(0x7f7e7c15a900 legacy=0x7f7e7c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7a000640 1 --2- 172.21.15.175:0/4256145540 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e7c0cf560 0x7f7e600039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7a000640 1 --2- 172.21.15.175:0/4256145540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e60003f90 0x7f7e60004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7a000640 1 --2- 172.21.15.175:0/4256145540 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e60004d50 0x7f7e600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7a000640 1 -- 172.21.15.175:0/4256145540 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c0cfef0 con 0x7f7e60003f90 2024-04-25T09:12:14.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7a000640 1 -- 172.21.15.175:0/4256145540 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6000b9d0 con 0x7f7e60004d50 2024-04-25T09:12:14.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7a000640 1 -- 172.21.15.175:0/4256145540 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6000bb50 con 0x7f7e7c0cf560 2024-04-25T09:12:14.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7aa00640 1 --2- 172.21.15.175:0/4256145540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e60003f90 0x7f7e60004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7b400640 1 --2- 172.21.15.175:0/4256145540 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e7c0cf560 0x7f7e600039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7be00640 1 --2- 172.21.15.175:0/4256145540 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e60004d50 0x7f7e600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7aa00640 1 -- 172.21.15.175:0/4256145540 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e7c0cf560 msgr2=0x7f7e600039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:14.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7aa00640 1 --2- 172.21.15.175:0/4256145540 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e7c0cf560 0x7f7e600039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7aa00640 1 -- 172.21.15.175:0/4256145540 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e60004d50 msgr2=0x7f7e600051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:14.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7aa00640 1 --2- 172.21.15.175:0/4256145540 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e60004d50 0x7f7e600051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.509+0000 7f7e7aa00640 1 -- 172.21.15.175:0/4256145540 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e60003530 con 0x7f7e60003f90 2024-04-25T09:12:14.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e7aa00640 1 --2- 172.21.15.175:0/4256145540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e60003f90 0x7f7e60004810 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800bfc0 tx=0x7f7e6801ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb482e9a92ba5c0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:14.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e7a000640 1 -- 172.21.15.175:0/4256145540 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e680b4070 con 0x7f7e60003f90 2024-04-25T09:12:14.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e7a000640 1 -- 172.21.15.175:0/4256145540 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e680a7c90 con 0x7f7e60003f90 2024-04-25T09:12:14.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e7a000640 1 -- 172.21.15.175:0/4256145540 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6800bc10 con 0x7f7e60003f90 2024-04-25T09:12:14.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e82800640 1 -- 172.21.15.175:0/4256145540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e60003f90 msgr2=0x7f7e60004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e82800640 1 --2- 172.21.15.175:0/4256145540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e60003f90 0x7f7e60004810 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800bfc0 tx=0x7f7e6801ec80 comp rx=0 tx=0).stop 2024-04-25T09:12:14.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e7be00640 1 -- 172.21.15.175:0/4256145540 reap_dead start 2024-04-25T09:12:14.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e82800640 1 -- 172.21.15.175:0/4256145540 shutdown_connections 2024-04-25T09:12:14.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e82800640 1 -- 172.21.15.175:0/4256145540 >> 172.21.15.175:0/4256145540 conn(0x7f7e7c067150 msgr2=0x7f7e7c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:14.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e82800640 1 -- 172.21.15.175:0/4256145540 shutdown_connections 2024-04-25T09:12:14.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e82800640 1 -- 172.21.15.175:0/4256145540 wait complete. 2024-04-25T09:12:14.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e82800640 1 Processor -- start 2024-04-25T09:12:14.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e82800640 1 -- start start 2024-04-25T09:12:14.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e82800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e7c144bf0 0x7f7e7c1f7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e82800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e7c14f490 0x7f7e7c1f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e82800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e7c1f3810 0x7f7e7c0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e82800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c0ce580 con 0x7f7e7c1f3810 2024-04-25T09:12:14.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e82800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c0ce2a0 con 0x7f7e7c14f490 2024-04-25T09:12:14.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.513+0000 7f7e82800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c06d3b0 con 0x7f7e7c144bf0 2024-04-25T09:12:14.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e7be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e7c1f3810 0x7f7e7c0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e7be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e7c1f3810 0x7f7e7c0b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46044/0 (socket says 172.21.15.175:46044) 2024-04-25T09:12:14.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e7be00640 1 -- 172.21.15.175:0/3707789105 learned_addr learned my addr 172.21.15.175:0/3707789105 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e7b400640 1 --2- 172.21.15.175:0/3707789105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e7c144bf0 0x7f7e7c1f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e7aa00640 1 --2- 172.21.15.175:0/3707789105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e7c14f490 0x7f7e7c1f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e7be00640 1 -- 172.21.15.175:0/3707789105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e7c144bf0 msgr2=0x7f7e7c1f7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e7be00640 1 --2- 172.21.15.175:0/3707789105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e7c144bf0 0x7f7e7c1f7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e7be00640 1 -- 172.21.15.175:0/3707789105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e7c14f490 msgr2=0x7f7e7c1f32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e7be00640 1 --2- 172.21.15.175:0/3707789105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e7c14f490 0x7f7e7c1f32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e7be00640 1 -- 172.21.15.175:0/3707789105 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c1f7780 con 0x7f7e7c1f3810 2024-04-25T09:12:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e7b400640 1 --2- 172.21.15.175:0/3707789105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e7c144bf0 0x7f7e7c1f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e7aa00640 1 --2- 172.21.15.175:0/3707789105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e7c14f490 0x7f7e7c1f32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e7be00640 1 --2- 172.21.15.175:0/3707789105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e7c1f3810 0x7f7e7c0b3220 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c15bf30 tx=0x7f7e74011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e73400640 1 -- 172.21.15.175:0/3707789105 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74003620 con 0x7f7e7c1f3810 2024-04-25T09:12:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e73400640 1 -- 172.21.15.175:0/3707789105 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7401b070 con 0x7f7e7c1f3810 2024-04-25T09:12:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e82800640 1 -- 172.21.15.175:0/3707789105 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e7c1f3c90 con 0x7f7e7c1f3810 2024-04-25T09:12:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e73400640 1 -- 172.21.15.175:0/3707789105 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74003a20 con 0x7f7e7c1f3810 2024-04-25T09:12:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e82800640 1 -- 172.21.15.175:0/3707789105 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e7c1f6a40 con 0x7f7e7c1f3810 2024-04-25T09:12:14.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e82800640 1 -- 172.21.15.175:0/3707789105 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7c1f41b0 con 0x7f7e7c1f3810 2024-04-25T09:12:14.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e73400640 1 -- 172.21.15.175:0/3707789105 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7e74003bc0 con 0x7f7e7c1f3810 2024-04-25T09:12:14.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.517+0000 7f7e73400640 1 --2- 172.21.15.175:0/3707789105 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7e5c066f60 0x7f7e5c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:14.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.521+0000 7f7e73400640 1 -- 172.21.15.175:0/3707789105 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f7e74084a80 con 0x7f7e7c1f3810 2024-04-25T09:12:14.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.521+0000 7f7e7b400640 1 --2- 172.21.15.175:0/3707789105 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7e5c066f60 0x7f7e5c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:14.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.521+0000 7f7e7b400640 1 --2- 172.21.15.175:0/3707789105 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7e5c066f60 0x7f7e5c069420 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c002240 tx=0x7f7e6c002190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:14.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.525+0000 7f7e73400640 1 -- 172.21.15.175:0/3707789105 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7e7c1f41b0 con 0x7f7e7c1f3810 2024-04-25T09:12:14.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.729+0000 7f7e82800640 1 -- 172.21.15.175:0/3707789105 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) v1 -- 0x7f7e7c074a60 con 0x7f7e7c1f3810 2024-04-25T09:12:14.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.997+0000 7f7e73400640 1 -- 172.21.15.175:0/3707789105 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v390) v1 ==== 167+0+0 (secure 0 0 0) 0x7f7e74086e20 con 0x7f7e7c1f3810 2024-04-25T09:12:14.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.997+0000 7f7e82800640 1 -- 172.21.15.175:0/3707789105 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7e5c066f60 msgr2=0x7f7e5c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.997+0000 7f7e82800640 1 --2- 172.21.15.175:0/3707789105 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7e5c066f60 0x7f7e5c069420 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c002240 tx=0x7f7e6c002190 comp rx=0 tx=0).stop 2024-04-25T09:12:14.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.997+0000 7f7e82800640 1 -- 172.21.15.175:0/3707789105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e7c1f3810 msgr2=0x7f7e7c0b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:14.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.997+0000 7f7e82800640 1 --2- 172.21.15.175:0/3707789105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e7c1f3810 0x7f7e7c0b3220 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c15bf30 tx=0x7f7e74011920 comp rx=0 tx=0).stop 2024-04-25T09:12:14.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.997+0000 7f7e82800640 1 -- 172.21.15.175:0/3707789105 shutdown_connections 2024-04-25T09:12:14.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.997+0000 7f7e82800640 1 --2- 172.21.15.175:0/3707789105 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7e5c066f60 0x7f7e5c069420 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.997+0000 7f7e82800640 1 --2- 172.21.15.175:0/3707789105 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e7c1f3810 0x7f7e7c0b3220 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.997+0000 7f7e82800640 1 --2- 172.21.15.175:0/3707789105 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e7c14f490 0x7f7e7c1f32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.997+0000 7f7e82800640 1 --2- 172.21.15.175:0/3707789105 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e7c144bf0 0x7f7e7c1f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:14.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:14.997+0000 7f7e82800640 1 -- 172.21.15.175:0/3707789105 >> 172.21.15.175:0/3707789105 conn(0x7f7e60003f90 msgr2=0x7f7e7c06e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:14.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.001+0000 7f7e82800640 1 -- 172.21.15.175:0/3707789105 shutdown_connections 2024-04-25T09:12:14.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.001+0000 7f7e82800640 1 -- 172.21.15.175:0/3707789105 wait complete. 2024-04-25T09:12:15.005 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-25T09:12:15.005 INFO:tasks.cephfs_test_runner:Starting test: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:12:15.006 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:15.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.153+0000 7f7844000640 1 Processor -- start 2024-04-25T09:12:15.142 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.157+0000 7f7844000640 1 -- start start 2024-04-25T09:12:15.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.157+0000 7f7844000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f783c147780 0x7f783c0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.157+0000 7f7844000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f783c06e960 0x7f783c06ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.157+0000 7f7844000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f783c0cee90 con 0x7f783c0716e0 2024-04-25T09:12:15.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.157+0000 7f7844000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f783c0cd2d0 con 0x7f783c147780 2024-04-25T09:12:15.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.157+0000 7f7844000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783c161860 con 0x7f783c06e960 2024-04-25T09:12:15.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.157+0000 7f7841600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f783c147780 0x7f783c0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.157+0000 7f7841600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f783c147780 0x7f783c0ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46048/0 (socket says 172.21.15.175:46048) 2024-04-25T09:12:15.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.157+0000 7f7841600640 1 -- 172.21.15.175:0/3166304834 learned_addr learned my addr 172.21.15.175:0/3166304834 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:15.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.157+0000 7f7842000640 1 --2- 172.21.15.175:0/3166304834 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f783c06e960 0x7f783c06ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.157+0000 7f7841600640 1 -- 172.21.15.175:0/3166304834 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f783c06e960 msgr2=0x7f783c06ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:15.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.157+0000 7f7841600640 1 --2- 172.21.15.175:0/3166304834 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f783c06e960 0x7f783c06ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.157+0000 7f7841600640 1 -- 172.21.15.175:0/3166304834 >> v1:172.21.15.177:6789/0 conn(0x7f783c0716e0 legacy=0x7f783c161fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:15.145 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.157+0000 7f7841600640 1 -- 172.21.15.175:0/3166304834 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c0cf150 con 0x7f783c147780 2024-04-25T09:12:15.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.161+0000 7f7841600640 1 --2- 172.21.15.175:0/3166304834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f783c147780 0x7f783c0ce950 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f7830009870 tx=0x7f783001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=559275ad2e8f2b07 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:15.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.161+0000 7f783be00640 1 -- 172.21.15.175:0/3166304834 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78300b0070 con 0x7f783c147780 2024-04-25T09:12:15.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.161+0000 7f783be00640 1 -- 172.21.15.175:0/3166304834 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78300ab600 con 0x7f783c147780 2024-04-25T09:12:15.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.161+0000 7f783be00640 1 -- 172.21.15.175:0/3166304834 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78300ab9d0 con 0x7f783c147780 2024-04-25T09:12:15.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.161+0000 7f7844000640 1 -- 172.21.15.175:0/3166304834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f783c147780 msgr2=0x7f783c0ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.161+0000 7f7844000640 1 --2- 172.21.15.175:0/3166304834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f783c147780 0x7f783c0ce950 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f7830009870 tx=0x7f783001c490 comp rx=0 tx=0).stop 2024-04-25T09:12:15.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.161+0000 7f7844000640 1 -- 172.21.15.175:0/3166304834 shutdown_connections 2024-04-25T09:12:15.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.161+0000 7f7844000640 1 --2- 172.21.15.175:0/3166304834 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f783c06e960 0x7f783c06ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.161+0000 7f7844000640 1 --2- 172.21.15.175:0/3166304834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f783c147780 0x7f783c0ce950 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.161+0000 7f7844000640 1 -- 172.21.15.175:0/3166304834 >> 172.21.15.175:0/3166304834 conn(0x7f783c0cc550 msgr2=0x7f783c0cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:15.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.161+0000 7f7844000640 1 -- 172.21.15.175:0/3166304834 shutdown_connections 2024-04-25T09:12:15.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.161+0000 7f7844000640 1 -- 172.21.15.175:0/3166304834 wait complete. 2024-04-25T09:12:15.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.161+0000 7f7844000640 1 Processor -- start 2024-04-25T09:12:15.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7844000640 1 -- start start 2024-04-25T09:12:15.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7844000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f783c06e960 0x7f783c15d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7844000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f783c0716e0 0x7f783c1385a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7844000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c147780 0x7f783c138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7844000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c16aba0 con 0x7f783c0716e0 2024-04-25T09:12:15.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7844000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c1626e0 con 0x7f783c147780 2024-04-25T09:12:15.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7844000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783c16ad20 con 0x7f783c06e960 2024-04-25T09:12:15.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7840c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f783c0716e0 0x7f783c1385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7840c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f783c0716e0 0x7f783c1385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46060/0 (socket says 172.21.15.175:46060) 2024-04-25T09:12:15.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7840c00640 1 -- 172.21.15.175:0/2662535932 learned_addr learned my addr 172.21.15.175:0/2662535932 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:15.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7841600640 1 --2- 172.21.15.175:0/2662535932 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f783c06e960 0x7f783c15d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7842000640 1 --2- 172.21.15.175:0/2662535932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c147780 0x7f783c138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7840c00640 1 -- 172.21.15.175:0/2662535932 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f783c06e960 msgr2=0x7f783c15d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7840c00640 1 --2- 172.21.15.175:0/2662535932 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f783c06e960 0x7f783c15d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7840c00640 1 -- 172.21.15.175:0/2662535932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c147780 msgr2=0x7f783c138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7840c00640 1 --2- 172.21.15.175:0/2662535932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c147780 0x7f783c138ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7840c00640 1 -- 172.21.15.175:0/2662535932 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c0c9e60 con 0x7f783c0716e0 2024-04-25T09:12:15.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7840c00640 1 --2- 172.21.15.175:0/2662535932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f783c0716e0 0x7f783c1385a0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f782800c440 tx=0x7f782800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:15.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7839600640 1 -- 172.21.15.175:0/2662535932 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828016020 con 0x7f783c0716e0 2024-04-25T09:12:15.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7839600640 1 -- 172.21.15.175:0/2662535932 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7828012830 con 0x7f783c0716e0 2024-04-25T09:12:15.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7839600640 1 -- 172.21.15.175:0/2662535932 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7828012c20 con 0x7f783c0716e0 2024-04-25T09:12:15.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7844000640 1 -- 172.21.15.175:0/2662535932 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f783c13a970 con 0x7f783c0716e0 2024-04-25T09:12:15.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7844000640 1 -- 172.21.15.175:0/2662535932 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f783c13af30 con 0x7f783c0716e0 2024-04-25T09:12:15.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.165+0000 7f7844000640 1 -- 172.21.15.175:0/2662535932 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f783c146fb0 con 0x7f783c0716e0 2024-04-25T09:12:15.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.169+0000 7f7839600640 1 -- 172.21.15.175:0/2662535932 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7828019020 con 0x7f783c0716e0 2024-04-25T09:12:15.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.169+0000 7f7839600640 1 --2- 172.21.15.175:0/2662535932 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f781c066f60 0x7f781c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.169+0000 7f7839600640 1 -- 172.21.15.175:0/2662535932 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f7828084c90 con 0x7f783c0716e0 2024-04-25T09:12:15.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.169+0000 7f7841600640 1 --2- 172.21.15.175:0/2662535932 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f781c066f60 0x7f781c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.169+0000 7f7841600640 1 --2- 172.21.15.175:0/2662535932 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f781c066f60 0x7f781c069420 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f78300ad000 tx=0x7f78300a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:15.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.173+0000 7f7839600640 1 -- 172.21.15.175:0/2662535932 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7828020020 con 0x7f783c0716e0 2024-04-25T09:12:15.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.337+0000 7f7844000640 1 -- 172.21.15.175:0/2662535932 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f783c074a40 con 0x7f783c0716e0 2024-04-25T09:12:15.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.337+0000 7f7839600640 1 -- 172.21.15.175:0/2662535932 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+13321 (secure 0 0 0) 0x7f78280558a0 con 0x7f783c0716e0 2024-04-25T09:12:15.325 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:15.325 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":91,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:12:13.990249+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6835/279367590":"2024-04-26T09:12:10.842301+0000","172.21.15.175:6837/1399691338":"2024-04-26T09:11:26.715601+0000","172.21.15.175:6835/1399691338":"2024-04-26T09:11:26.715601+0000","172.21.15.175:6837/279367590":"2024-04-26T09:12:10.842301+0000","172.21.15.175:6837/1755192276":"2024-04-26T09:10:14.425304+0000","172.21.15.175:6835/1755192276":"2024-04-26T09:10:14.425304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:15.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.341+0000 7f7844000640 1 -- 172.21.15.175:0/2662535932 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f781c066f60 msgr2=0x7f781c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.341+0000 7f7844000640 1 --2- 172.21.15.175:0/2662535932 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f781c066f60 0x7f781c069420 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f78300ad000 tx=0x7f78300a6000 comp rx=0 tx=0).stop 2024-04-25T09:12:15.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.341+0000 7f7844000640 1 -- 172.21.15.175:0/2662535932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f783c0716e0 msgr2=0x7f783c1385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.341+0000 7f7844000640 1 --2- 172.21.15.175:0/2662535932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f783c0716e0 0x7f783c1385a0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f782800c440 tx=0x7f782800c900 comp rx=0 tx=0).stop 2024-04-25T09:12:15.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.341+0000 7f7844000640 1 -- 172.21.15.175:0/2662535932 shutdown_connections 2024-04-25T09:12:15.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.341+0000 7f7844000640 1 --2- 172.21.15.175:0/2662535932 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f781c066f60 0x7f781c069420 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.341+0000 7f7844000640 1 --2- 172.21.15.175:0/2662535932 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f783c147780 0x7f783c138ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.341+0000 7f7844000640 1 --2- 172.21.15.175:0/2662535932 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f783c0716e0 0x7f783c1385a0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.341+0000 7f7844000640 1 --2- 172.21.15.175:0/2662535932 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f783c06e960 0x7f783c15d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.341+0000 7f7844000640 1 -- 172.21.15.175:0/2662535932 >> 172.21.15.175:0/2662535932 conn(0x7f783c0cc550 msgr2=0x7f783c06d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:15.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.341+0000 7f7844000640 1 -- 172.21.15.175:0/2662535932 shutdown_connections 2024-04-25T09:12:15.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.341+0000 7f7844000640 1 -- 172.21.15.175:0/2662535932 wait complete. 2024-04-25T09:12:15.347 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:12:15.347 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:12:15.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.505+0000 7fbb43600640 1 Processor -- start 2024-04-25T09:12:15.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.505+0000 7fbb43600640 1 -- start start 2024-04-25T09:12:15.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.505+0000 7fbb43600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbb3c161360 0x7fbb3c0ad990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.505+0000 7fbb43600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbb3c0712d0 0x7fbb3c0716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.505+0000 7fbb43600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3c071c20 con 0x7fbb3c0ae660 2024-04-25T09:12:15.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.505+0000 7fbb43600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3c0ae250 con 0x7fbb3c0712d0 2024-04-25T09:12:15.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.505+0000 7fbb43600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3c06f0e0 con 0x7fbb3c161360 2024-04-25T09:12:15.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.505+0000 7fbb41600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbb3c0712d0 0x7fbb3c0716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.505+0000 7fbb41600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbb3c0712d0 0x7fbb3c0716e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46068/0 (socket says 172.21.15.175:46068) 2024-04-25T09:12:15.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.505+0000 7fbb41600640 1 -- 172.21.15.175:0/3337338059 learned_addr learned my addr 172.21.15.175:0/3337338059 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:15.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.505+0000 7fbb40c00640 1 --2- 172.21.15.175:0/3337338059 >> v2:172.21.15.177:3300/0 conn(0x7fbb3c161360 0x7fbb3c0ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.505+0000 7fbb41600640 1 -- 172.21.15.175:0/3337338059 >> v2:172.21.15.177:3300/0 conn(0x7fbb3c161360 msgr2=0x7fbb3c0ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:15.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.505+0000 7fbb41600640 1 --2- 172.21.15.175:0/3337338059 >> v2:172.21.15.177:3300/0 conn(0x7fbb3c161360 0x7fbb3c0ad990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.505+0000 7fbb41600640 1 -- 172.21.15.175:0/3337338059 >> v1:172.21.15.177:6789/0 conn(0x7fbb3c0ae660 legacy=0x7fbb3c06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.505+0000 7fbb41600640 1 -- 172.21.15.175:0/3337338059 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c0adf70 con 0x7fbb3c0712d0 2024-04-25T09:12:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.509+0000 7fbb41600640 1 --2- 172.21.15.175:0/3337338059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c0716e0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c06bb30 tx=0x7fbb3401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8012c77d2184f00c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.509+0000 7fbb3b400640 1 -- 172.21.15.175:0/3337338059 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb340a57f0 con 0x7fbb3c0712d0 2024-04-25T09:12:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.509+0000 7fbb3b400640 1 -- 172.21.15.175:0/3337338059 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb340a5990 con 0x7fbb3c0712d0 2024-04-25T09:12:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.509+0000 7fbb3b400640 1 -- 172.21.15.175:0/3337338059 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb340a5d60 con 0x7fbb3c0712d0 2024-04-25T09:12:15.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.509+0000 7fbb43600640 1 -- 172.21.15.175:0/3337338059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb3c0712d0 msgr2=0x7fbb3c0716e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.509+0000 7fbb43600640 1 --2- 172.21.15.175:0/3337338059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c0716e0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c06bb30 tx=0x7fbb3401c930 comp rx=0 tx=0).stop 2024-04-25T09:12:15.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.509+0000 7fbb43600640 1 -- 172.21.15.175:0/3337338059 shutdown_connections 2024-04-25T09:12:15.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.509+0000 7fbb43600640 1 --2- 172.21.15.175:0/3337338059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c0716e0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.509+0000 7fbb43600640 1 --2- 172.21.15.175:0/3337338059 >> v2:172.21.15.177:3300/0 conn(0x7fbb3c161360 0x7fbb3c0ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.509+0000 7fbb43600640 1 -- 172.21.15.175:0/3337338059 >> 172.21.15.175:0/3337338059 conn(0x7fbb3c06ac50 msgr2=0x7fbb3c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:15.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.509+0000 7fbb43600640 1 -- 172.21.15.175:0/3337338059 shutdown_connections 2024-04-25T09:12:15.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.509+0000 7fbb43600640 1 -- 172.21.15.175:0/3337338059 wait complete. 2024-04-25T09:12:15.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.509+0000 7fbb43600640 1 Processor -- start 2024-04-25T09:12:15.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb43600640 1 -- start start 2024-04-25T09:12:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb43600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb43600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb3c0ae660 0x7fbb3c15d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb43600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb3c161360 0x7fbb3c0b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb43600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c072110 con 0x7fbb3c0ae660 2024-04-25T09:12:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb43600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c071f90 con 0x7fbb3c0712d0 2024-04-25T09:12:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb43600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c16a900 con 0x7fbb3c161360 2024-04-25T09:12:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb3be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb3c0ae660 0x7fbb3c15d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb3be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb3c0ae660 0x7fbb3c15d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46072/0 (socket says 172.21.15.175:46072) 2024-04-25T09:12:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb3be00640 1 -- 172.21.15.175:0/166700238 learned_addr learned my addr 172.21.15.175:0/166700238 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb40c00640 1 --2- 172.21.15.175:0/166700238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb41600640 1 --2- 172.21.15.175:0/166700238 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb3c161360 0x7fbb3c0b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb3be00640 1 -- 172.21.15.175:0/166700238 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb3c161360 msgr2=0x7fbb3c0b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb3be00640 1 --2- 172.21.15.175:0/166700238 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb3c161360 0x7fbb3c0b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb3be00640 1 -- 172.21.15.175:0/166700238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb3c0712d0 msgr2=0x7fbb3c146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb3be00640 1 --2- 172.21.15.175:0/166700238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c146d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb3be00640 1 -- 172.21.15.175:0/166700238 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c1478a0 con 0x7fbb3c0ae660 2024-04-25T09:12:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb40c00640 1 --2- 172.21.15.175:0/166700238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb3be00640 1 --2- 172.21.15.175:0/166700238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb3c0ae660 0x7fbb3c15d4b0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800c450 tx=0x7fbb2800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb38c00640 1 -- 172.21.15.175:0/166700238 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb28016020 con 0x7fbb3c0ae660 2024-04-25T09:12:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb38c00640 1 -- 172.21.15.175:0/166700238 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb280052d0 con 0x7fbb3c0ae660 2024-04-25T09:12:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb43600640 1 -- 172.21.15.175:0/166700238 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3c147b80 con 0x7fbb3c0ae660 2024-04-25T09:12:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb38c00640 1 -- 172.21.15.175:0/166700238 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb28007260 con 0x7fbb3c0ae660 2024-04-25T09:12:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb43600640 1 -- 172.21.15.175:0/166700238 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3c148140 con 0x7fbb3c0ae660 2024-04-25T09:12:15.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.513+0000 7fbb43600640 1 -- 172.21.15.175:0/166700238 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3c075160 con 0x7fbb3c0ae660 2024-04-25T09:12:15.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.517+0000 7fbb38c00640 1 -- 172.21.15.175:0/166700238 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbb28007400 con 0x7fbb3c0ae660 2024-04-25T09:12:15.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.517+0000 7fbb38c00640 1 --2- 172.21.15.175:0/166700238 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbb1c066f60 0x7fbb1c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.517+0000 7fbb38c00640 1 -- 172.21.15.175:0/166700238 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fbb28084720 con 0x7fbb3c0ae660 2024-04-25T09:12:15.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.517+0000 7fbb40c00640 1 --2- 172.21.15.175:0/166700238 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbb1c066f60 0x7fbb1c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.517+0000 7fbb40c00640 1 --2- 172.21.15.175:0/166700238 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbb1c066f60 0x7fbb1c069420 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000b9f0 tx=0x7fbb30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:15.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.521+0000 7fbb38c00640 1 -- 172.21.15.175:0/166700238 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbb28020020 con 0x7fbb3c0ae660 2024-04-25T09:12:15.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.677+0000 7fbb43600640 1 -- 172.21.15.175:0/166700238 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb3c151910 con 0x7fbb3c0ae660 2024-04-25T09:12:15.662 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.677+0000 7fbb38c00640 1 -- 172.21.15.175:0/166700238 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb3c071c20 con 0x7fbb3c0ae660 2024-04-25T09:12:15.663 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:12:15.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.677+0000 7fbb43600640 1 -- 172.21.15.175:0/166700238 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbb1c066f60 msgr2=0x7fbb1c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.677+0000 7fbb43600640 1 --2- 172.21.15.175:0/166700238 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbb1c066f60 0x7fbb1c069420 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000b9f0 tx=0x7fbb30008040 comp rx=0 tx=0).stop 2024-04-25T09:12:15.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.677+0000 7fbb43600640 1 -- 172.21.15.175:0/166700238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb3c0ae660 msgr2=0x7fbb3c15d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.677+0000 7fbb43600640 1 --2- 172.21.15.175:0/166700238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb3c0ae660 0x7fbb3c15d4b0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800c450 tx=0x7fbb2800c910 comp rx=0 tx=0).stop 2024-04-25T09:12:15.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.677+0000 7fbb43600640 1 -- 172.21.15.175:0/166700238 shutdown_connections 2024-04-25T09:12:15.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.677+0000 7fbb43600640 1 --2- 172.21.15.175:0/166700238 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbb1c066f60 0x7fbb1c069420 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.677+0000 7fbb43600640 1 --2- 172.21.15.175:0/166700238 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbb3c161360 0x7fbb3c0b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.677+0000 7fbb43600640 1 --2- 172.21.15.175:0/166700238 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb3c0ae660 0x7fbb3c15d4b0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.677+0000 7fbb43600640 1 --2- 172.21.15.175:0/166700238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbb3c0712d0 0x7fbb3c146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.677+0000 7fbb43600640 1 -- 172.21.15.175:0/166700238 >> 172.21.15.175:0/166700238 conn(0x7fbb3c06ac50 msgr2=0x7fbb3c0b3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:15.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.677+0000 7fbb43600640 1 -- 172.21.15.175:0/166700238 shutdown_connections 2024-04-25T09:12:15.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.677+0000 7fbb43600640 1 -- 172.21.15.175:0/166700238 wait complete. 2024-04-25T09:12:15.684 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-04-25T09:12:15.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.833+0000 7fea2b200640 1 Processor -- start 2024-04-25T09:12:15.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.833+0000 7fea2b200640 1 -- start start 2024-04-25T09:12:15.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.833+0000 7fea2b200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea24144fc0 0x7fea240cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.833+0000 7fea2b200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fea241453a0 0x7fea2415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.833+0000 7fea2b200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2415cd00 con 0x7fea240cc3b0 2024-04-25T09:12:15.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.833+0000 7fea2b200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea240ce660 con 0x7fea241453a0 2024-04-25T09:12:15.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.833+0000 7fea2b200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea240cc930 con 0x7fea24144fc0 2024-04-25T09:12:15.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.833+0000 7fea23400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fea241453a0 0x7fea2415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.833+0000 7fea23400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fea241453a0 0x7fea2415bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46076/0 (socket says 172.21.15.175:46076) 2024-04-25T09:12:15.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.833+0000 7fea23400640 1 -- 172.21.15.175:0/1021914992 learned_addr learned my addr 172.21.15.175:0/1021914992 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:15.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.833+0000 7fea23e00640 1 --2- 172.21.15.175:0/1021914992 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea24144fc0 0x7fea240cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.833+0000 7fea23400640 1 -- 172.21.15.175:0/1021914992 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea24144fc0 msgr2=0x7fea240cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:15.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.833+0000 7fea23400640 1 --2- 172.21.15.175:0/1021914992 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea24144fc0 0x7fea240cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.833+0000 7fea23400640 1 -- 172.21.15.175:0/1021914992 >> v1:172.21.15.177:6789/0 conn(0x7fea240cc3b0 legacy=0x7fea2415f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.833+0000 7fea23400640 1 -- 172.21.15.175:0/1021914992 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea240ccc10 con 0x7fea241453a0 2024-04-25T09:12:15.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.837+0000 7fea23400640 1 --2- 172.21.15.175:0/1021914992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea241453a0 0x7fea2415bed0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fea10009870 tx=0x7fea1001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df44548c811d97c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:15.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.837+0000 7fea22a00640 1 -- 172.21.15.175:0/1021914992 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea100ab650 con 0x7fea241453a0 2024-04-25T09:12:15.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.837+0000 7fea22a00640 1 -- 172.21.15.175:0/1021914992 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea100b0070 con 0x7fea241453a0 2024-04-25T09:12:15.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.837+0000 7fea22a00640 1 -- 172.21.15.175:0/1021914992 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea100aba10 con 0x7fea241453a0 2024-04-25T09:12:15.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.837+0000 7fea2b200640 1 -- 172.21.15.175:0/1021914992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea241453a0 msgr2=0x7fea2415bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.837+0000 7fea2b200640 1 --2- 172.21.15.175:0/1021914992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea241453a0 0x7fea2415bed0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fea10009870 tx=0x7fea1001c560 comp rx=0 tx=0).stop 2024-04-25T09:12:15.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.837+0000 7fea2b200640 1 -- 172.21.15.175:0/1021914992 shutdown_connections 2024-04-25T09:12:15.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.837+0000 7fea2b200640 1 --2- 172.21.15.175:0/1021914992 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea241453a0 0x7fea2415bed0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.837+0000 7fea2b200640 1 --2- 172.21.15.175:0/1021914992 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea24144fc0 0x7fea240cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.837+0000 7fea2b200640 1 -- 172.21.15.175:0/1021914992 >> 172.21.15.175:0/1021914992 conn(0x7fea24067150 msgr2=0x7fea2406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:15.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.837+0000 7fea2b200640 1 -- 172.21.15.175:0/1021914992 shutdown_connections 2024-04-25T09:12:15.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.837+0000 7fea2b200640 1 -- 172.21.15.175:0/1021914992 wait complete. 2024-04-25T09:12:15.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea2b200640 1 Processor -- start 2024-04-25T09:12:15.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea2b200640 1 -- start start 2024-04-25T09:12:15.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea2b200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea24144fc0 0x7fea241570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea2b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea241453a0 0x7fea2415ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea2b200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea2415b170 0x7fea24138450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea2b200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea240cffb0 con 0x7fea241453a0 2024-04-25T09:12:15.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea2b200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea240cfe30 con 0x7fea2415b170 2024-04-25T09:12:15.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea2b200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea241685f0 con 0x7fea24144fc0 2024-04-25T09:12:15.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea23400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea241453a0 0x7fea2415ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea23400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea241453a0 0x7fea2415ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46092/0 (socket says 172.21.15.175:46092) 2024-04-25T09:12:15.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea23e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea24144fc0 0x7fea241570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea23400640 1 -- 172.21.15.175:0/1782941080 learned_addr learned my addr 172.21.15.175:0/1782941080 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:15.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea29200640 1 --2- 172.21.15.175:0/1782941080 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea2415b170 0x7fea24138450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea23400640 1 -- 172.21.15.175:0/1782941080 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea24144fc0 msgr2=0x7fea241570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea23400640 1 --2- 172.21.15.175:0/1782941080 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea24144fc0 0x7fea241570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea23400640 1 -- 172.21.15.175:0/1782941080 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea2415b170 msgr2=0x7fea24138450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:15.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea23400640 1 --2- 172.21.15.175:0/1782941080 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea2415b170 0x7fea24138450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:15.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea23400640 1 -- 172.21.15.175:0/1782941080 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea24139160 con 0x7fea241453a0 2024-04-25T09:12:15.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea23400640 1 --2- 172.21.15.175:0/1782941080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea241453a0 0x7fea2415ac30 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fea100ad040 tx=0x7fea1001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:15.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea1be00640 1 -- 172.21.15.175:0/1782941080 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea100be5f0 con 0x7fea241453a0 2024-04-25T09:12:15.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea1be00640 1 -- 172.21.15.175:0/1782941080 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea100be790 con 0x7fea241453a0 2024-04-25T09:12:15.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea1be00640 1 -- 172.21.15.175:0/1782941080 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea100beb80 con 0x7fea241453a0 2024-04-25T09:12:15.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea2b200640 1 -- 172.21.15.175:0/1782941080 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea24139440 con 0x7fea241453a0 2024-04-25T09:12:15.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea2b200640 1 -- 172.21.15.175:0/1782941080 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea240b3200 con 0x7fea241453a0 2024-04-25T09:12:15.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.841+0000 7fea2b200640 1 -- 172.21.15.175:0/1782941080 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea2415b580 con 0x7fea241453a0 2024-04-25T09:12:15.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.845+0000 7fea1be00640 1 -- 172.21.15.175:0/1782941080 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fea100b43f0 con 0x7fea241453a0 2024-04-25T09:12:15.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.845+0000 7fea1be00640 1 --2- 172.21.15.175:0/1782941080 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea04066f90 0x7fea04069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:15.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.845+0000 7fea1be00640 1 -- 172.21.15.175:0/1782941080 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fea1011f230 con 0x7fea241453a0 2024-04-25T09:12:15.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.845+0000 7fea23e00640 1 --2- 172.21.15.175:0/1782941080 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea04066f90 0x7fea04069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:15.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.845+0000 7fea23e00640 1 --2- 172.21.15.175:0/1782941080 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea04066f90 0x7fea04069450 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fea14003b90 tx=0x7fea140098d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:15.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:15.849+0000 7fea1be00640 1 -- 172.21.15.175:0/1782941080 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fea2415b580 con 0x7fea241453a0 2024-04-25T09:12:16.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:16.057+0000 7fea2b200640 1 -- 172.21.15.175:0/1782941080 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) v1 -- 0x7fea24074a60 con 0x7fea241453a0 2024-04-25T09:12:16.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.005+0000 7fea1be00640 1 -- 172.21.15.175:0/1782941080 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v392) v1 ==== 149+0+0 (secure 0 0 0) 0x7fea10016150 con 0x7fea241453a0 2024-04-25T09:12:16.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.005+0000 7fea2b200640 1 -- 172.21.15.175:0/1782941080 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea04066f90 msgr2=0x7fea04069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.005+0000 7fea2b200640 1 --2- 172.21.15.175:0/1782941080 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea04066f90 0x7fea04069450 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fea14003b90 tx=0x7fea140098d0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.005+0000 7fea2b200640 1 -- 172.21.15.175:0/1782941080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea241453a0 msgr2=0x7fea2415ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:16.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.005+0000 7fea2b200640 1 --2- 172.21.15.175:0/1782941080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea241453a0 0x7fea2415ac30 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fea100ad040 tx=0x7fea1001ada0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.005+0000 7fea2b200640 1 -- 172.21.15.175:0/1782941080 shutdown_connections 2024-04-25T09:12:16.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.005+0000 7fea2b200640 1 --2- 172.21.15.175:0/1782941080 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea04066f90 0x7fea04069450 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.005+0000 7fea2b200640 1 --2- 172.21.15.175:0/1782941080 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea2415b170 0x7fea24138450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.005+0000 7fea2b200640 1 --2- 172.21.15.175:0/1782941080 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea241453a0 0x7fea2415ac30 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.005+0000 7fea2b200640 1 --2- 172.21.15.175:0/1782941080 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea24144fc0 0x7fea241570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:16.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.009+0000 7fea2b200640 1 -- 172.21.15.175:0/1782941080 >> 172.21.15.175:0/1782941080 conn(0x7fea240cc3b0 msgr2=0x7fea2415d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:16.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.009+0000 7fea2b200640 1 -- 172.21.15.175:0/1782941080 shutdown_connections 2024-04-25T09:12:16.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.009+0000 7fea2b200640 1 -- 172.21.15.175:0/1782941080 wait complete. 2024-04-25T09:12:17.018 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:12:17.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.173+0000 7fb680c00640 1 Processor -- start 2024-04-25T09:12:17.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.173+0000 7fb680c00640 1 -- start start 2024-04-25T09:12:17.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.173+0000 7fb680c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67c0b2660 0x7fb67c0712d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.173+0000 7fb680c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67c15dd10 con 0x7fb67c0b3230 2024-04-25T09:12:17.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.173+0000 7fb680c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67c15dff0 con 0x7fb67c071810 2024-04-25T09:12:17.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.173+0000 7fb680c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c071c80 con 0x7fb67c0b2660 2024-04-25T09:12:17.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.177+0000 7fb679e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb67c0b3230 0x7fb67c0b3d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38160/0 (socket says 172.21.15.175:38160) 2024-04-25T09:12:17.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.177+0000 7fb679e00640 1 -- 172.21.15.175:0/1113559032 learned_addr learned my addr 172.21.15.175:0/1113559032 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:17.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.177+0000 7fb679400640 1 --2- 172.21.15.175:0/1113559032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67c0b2660 0x7fb67c0712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.177+0000 7fb678a00640 1 -- 172.21.15.175:0/1113559032 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537937129 0 0) 0x7fb67c15dd10 con 0x7fb67c0b3230 2024-04-25T09:12:17.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.177+0000 7fb678a00640 1 -- 172.21.15.175:0/1113559032 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb660003530 con 0x7fb67c0b3230 2024-04-25T09:12:17.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.177+0000 7fb678a00640 1 -- 172.21.15.175:0/1113559032 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907167660 0 0) 0x7fb67c15dff0 con 0x7fb67c071810 2024-04-25T09:12:17.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.177+0000 7fb678a00640 1 -- 172.21.15.175:0/1113559032 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb67c15dd10 con 0x7fb67c071810 2024-04-25T09:12:17.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.177+0000 7fb679400640 1 -- 172.21.15.175:0/1113559032 >> v1:172.21.15.177:6789/0 conn(0x7fb67c071810 legacy=0x7fb67c15aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.177+0000 7fb679400640 1 -- 172.21.15.175:0/1113559032 >> v1:172.21.15.175:6789/0 conn(0x7fb67c0b3230 legacy=0x7fb67c0b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.177+0000 7fb678a00640 1 -- 172.21.15.175:0/1113559032 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2220754763 0 0) 0x7fb660003530 con 0x7fb67c0b3230 2024-04-25T09:12:17.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.177+0000 7fb679400640 1 -- 172.21.15.175:0/1113559032 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c15e2d0 con 0x7fb67c0b2660 2024-04-25T09:12:17.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.177+0000 7fb679400640 1 --2- 172.21.15.175:0/1113559032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67c0b2660 0x7fb67c0712d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb6680097f0 tx=0x7fb66801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4482643786faab6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb678a00640 1 -- 172.21.15.175:0/1113559032 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6680b0070 con 0x7fb67c0b2660 2024-04-25T09:12:17.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb678a00640 1 -- 172.21.15.175:0/1113559032 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6680ab400 con 0x7fb67c0b2660 2024-04-25T09:12:17.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb678a00640 1 -- 172.21.15.175:0/1113559032 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c001a00 con 0x7fb67c0b2660 2024-04-25T09:12:17.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb680c00640 1 -- 172.21.15.175:0/1113559032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67c0b2660 msgr2=0x7fb67c0712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb680c00640 1 --2- 172.21.15.175:0/1113559032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67c0b2660 0x7fb67c0712d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb6680097f0 tx=0x7fb66801c400 comp rx=0 tx=0).stop 2024-04-25T09:12:17.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb680c00640 1 -- 172.21.15.175:0/1113559032 shutdown_connections 2024-04-25T09:12:17.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb680c00640 1 --2- 172.21.15.175:0/1113559032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67c0b2660 0x7fb67c0712d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb680c00640 1 -- 172.21.15.175:0/1113559032 >> 172.21.15.175:0/1113559032 conn(0x7fb67c06ac50 msgr2=0x7fb67c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:17.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb680c00640 1 -- 172.21.15.175:0/1113559032 shutdown_connections 2024-04-25T09:12:17.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb680c00640 1 -- 172.21.15.175:0/1113559032 wait complete. 2024-04-25T09:12:17.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb680c00640 1 Processor -- start 2024-04-25T09:12:17.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb680c00640 1 -- start start 2024-04-25T09:12:17.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb680c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb67c071810 0x7fb67c14ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb680c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67c0b2660 0x7fb67c15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb680c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67c0b3230 0x7fb67c15be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb680c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c15b710 con 0x7fb67c071810 2024-04-25T09:12:17.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb680c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c15b590 con 0x7fb67c0b2660 2024-04-25T09:12:17.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb680c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c0b3610 con 0x7fb67c0b3230 2024-04-25T09:12:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.181+0000 7fb679e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb67c071810 0x7fb67c14ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb679e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb67c071810 0x7fb67c14ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46104/0 (socket says 172.21.15.175:46104) 2024-04-25T09:12:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb679e00640 1 -- 172.21.15.175:0/1388001740 learned_addr learned my addr 172.21.15.175:0/1388001740 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb679400640 1 --2- 172.21.15.175:0/1388001740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67c0b2660 0x7fb67c15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb67a800640 1 --2- 172.21.15.175:0/1388001740 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67c0b3230 0x7fb67c15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb679e00640 1 -- 172.21.15.175:0/1388001740 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67c0b3230 msgr2=0x7fb67c15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb679e00640 1 --2- 172.21.15.175:0/1388001740 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67c0b3230 0x7fb67c15be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb679e00640 1 -- 172.21.15.175:0/1388001740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67c0b2660 msgr2=0x7fb67c15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb679e00640 1 --2- 172.21.15.175:0/1388001740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67c0b2660 0x7fb67c15b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb679e00640 1 -- 172.21.15.175:0/1388001740 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c0b2d80 con 0x7fb67c071810 2024-04-25T09:12:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb679e00640 1 --2- 172.21.15.175:0/1388001740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb67c071810 0x7fb67c14ff20 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fb66c001f40 tx=0x7fb66c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb672000640 1 -- 172.21.15.175:0/1388001740 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c017070 con 0x7fb67c071810 2024-04-25T09:12:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb672000640 1 -- 172.21.15.175:0/1388001740 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66c012400 con 0x7fb67c071810 2024-04-25T09:12:17.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb672000640 1 -- 172.21.15.175:0/1388001740 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66c012870 con 0x7fb67c071810 2024-04-25T09:12:17.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb680c00640 1 -- 172.21.15.175:0/1388001740 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67c06b570 con 0x7fb67c071810 2024-04-25T09:12:17.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb680c00640 1 -- 172.21.15.175:0/1388001740 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67c150460 con 0x7fb67c071810 2024-04-25T09:12:17.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb680c00640 1 -- 172.21.15.175:0/1388001740 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67c075160 con 0x7fb67c071810 2024-04-25T09:12:17.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb672000640 1 -- 172.21.15.175:0/1388001740 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb66c01a070 con 0x7fb67c071810 2024-04-25T09:12:17.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb672000640 1 --2- 172.21.15.175:0/1388001740 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb65c066f60 0x7fb65c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.185+0000 7fb672000640 1 -- 172.21.15.175:0/1388001740 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fb66c084d70 con 0x7fb67c071810 2024-04-25T09:12:17.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.189+0000 7fb679400640 1 --2- 172.21.15.175:0/1388001740 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb65c066f60 0x7fb65c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.189+0000 7fb679400640 1 --2- 172.21.15.175:0/1388001740 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb65c066f60 0x7fb65c069420 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb6680ad000 tx=0x7fb6680a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.189+0000 7fb672000640 1 -- 172.21.15.175:0/1388001740 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb66c055970 con 0x7fb67c071810 2024-04-25T09:12:17.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.345+0000 7fb680c00640 1 -- 172.21.15.175:0/1388001740 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb67c072370 con 0x7fb67c071810 2024-04-25T09:12:17.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.349+0000 7fb672000640 1 -- 172.21.15.175:0/1388001740 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb66c059a10 con 0x7fb67c071810 2024-04-25T09:12:17.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.349+0000 7fb680c00640 1 -- 172.21.15.175:0/1388001740 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb65c066f60 msgr2=0x7fb65c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.349+0000 7fb680c00640 1 --2- 172.21.15.175:0/1388001740 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb65c066f60 0x7fb65c069420 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb6680ad000 tx=0x7fb6680a6000 comp rx=0 tx=0).stop 2024-04-25T09:12:17.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.349+0000 7fb680c00640 1 -- 172.21.15.175:0/1388001740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb67c071810 msgr2=0x7fb67c14ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.349+0000 7fb680c00640 1 --2- 172.21.15.175:0/1388001740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb67c071810 0x7fb67c14ff20 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fb66c001f40 tx=0x7fb66c00a430 comp rx=0 tx=0).stop 2024-04-25T09:12:17.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.349+0000 7fb680c00640 1 -- 172.21.15.175:0/1388001740 shutdown_connections 2024-04-25T09:12:17.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.349+0000 7fb680c00640 1 --2- 172.21.15.175:0/1388001740 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb65c066f60 0x7fb65c069420 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.349+0000 7fb680c00640 1 --2- 172.21.15.175:0/1388001740 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb67c0b3230 0x7fb67c15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.349+0000 7fb680c00640 1 --2- 172.21.15.175:0/1388001740 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb67c0b2660 0x7fb67c15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.349+0000 7fb680c00640 1 --2- 172.21.15.175:0/1388001740 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb67c071810 0x7fb67c14ff20 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.349+0000 7fb680c00640 1 -- 172.21.15.175:0/1388001740 >> 172.21.15.175:0/1388001740 conn(0x7fb67c06ac50 msgr2=0x7fb67c06e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:17.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.349+0000 7fb680c00640 1 -- 172.21.15.175:0/1388001740 shutdown_connections 2024-04-25T09:12:17.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.349+0000 7fb680c00640 1 -- 172.21.15.175:0/1388001740 wait complete. 2024-04-25T09:12:17.356 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:12:17.356 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:12:17.405 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:12:17.510 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:12:17.510 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:12:17.510 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:17.519 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:12:17.519 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:12:17.519 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:17.528 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:12:17.528 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:12:17.528 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:17.573 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:12:17.574 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:12:17.574 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:17.583 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:12:17.583 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:12:17.583 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:17.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.769+0000 7f4ebbc00640 1 Processor -- start 2024-04-25T09:12:17.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.769+0000 7f4ebbc00640 1 -- start start 2024-04-25T09:12:17.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.769+0000 7f4ebbc00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4eb415dbd0 0x7f4eb4071c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.769+0000 7f4ebbc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4eb40aeac0 0x7f4eb40ad490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.769+0000 7f4ebbc00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb415dfb0 con 0x7f4eb40ae680 2024-04-25T09:12:17.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.769+0000 7f4ebbc00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb40cf670 con 0x7f4eb415dbd0 2024-04-25T09:12:17.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.769+0000 7f4ebbc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40b3590 con 0x7f4eb40aeac0 2024-04-25T09:12:17.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.769+0000 7f4eabe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4eb40ae680 0x7f4eb40acd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38176/0 (socket says 172.21.15.175:38176) 2024-04-25T09:12:17.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.769+0000 7f4eabe00640 1 -- 172.21.15.175:0/1906310690 learned_addr learned my addr 172.21.15.175:0/1906310690 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:17.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb9200640 1 --2- 172.21.15.175:0/1906310690 >> v2:172.21.15.177:3300/0 conn(0x7f4eb415dbd0 0x7f4eb4071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb9c00640 1 --2- 172.21.15.175:0/1906310690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4eb40aeac0 0x7f4eb40ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb3e00640 1 -- 172.21.15.175:0/1906310690 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223036898 0 0) 0x7f4eb415dfb0 con 0x7f4eb40ae680 2024-04-25T09:12:17.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb3e00640 1 -- 172.21.15.175:0/1906310690 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e98003530 con 0x7f4eb40ae680 2024-04-25T09:12:17.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb3e00640 1 -- 172.21.15.175:0/1906310690 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3461088266 0 0) 0x7f4e98003530 con 0x7f4eb40ae680 2024-04-25T09:12:17.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb3e00640 1 -- 172.21.15.175:0/1906310690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4eb40aeac0 msgr2=0x7f4eb40ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:17.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb3e00640 1 --2- 172.21.15.175:0/1906310690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4eb40aeac0 0x7f4eb40ad490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb3e00640 1 -- 172.21.15.175:0/1906310690 >> v2:172.21.15.177:3300/0 conn(0x7f4eb415dbd0 msgr2=0x7f4eb4071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:17.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb3e00640 1 --2- 172.21.15.175:0/1906310690 >> v2:172.21.15.177:3300/0 conn(0x7f4eb415dbd0 0x7f4eb4071c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb3e00640 1 -- 172.21.15.175:0/1906310690 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb40b2980 con 0x7f4eb40ae680 2024-04-25T09:12:17.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb3e00640 1 -- 172.21.15.175:0/1906310690 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f4e9c001680 con 0x7f4eb40ae680 2024-04-25T09:12:17.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb3e00640 1 -- 172.21.15.175:0/1906310690 >> v1:172.21.15.175:6789/0 conn(0x7f4eb40ae680 legacy=0x7f4eb40acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb3e00640 1 --2- 172.21.15.175:0/1906310690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4eb40aeac0 0x7f4e980039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb3e00640 1 --2- 172.21.15.175:0/1906310690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e98003f40 0x7f4e98004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb3e00640 1 --2- 172.21.15.175:0/1906310690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e98004d50 0x7f4e980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb3e00640 1 -- 172.21.15.175:0/1906310690 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40b3590 con 0x7f4e98004d50 2024-04-25T09:12:17.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb3e00640 1 -- 172.21.15.175:0/1906310690 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9800b9d0 con 0x7f4e98003f40 2024-04-25T09:12:17.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb3e00640 1 -- 172.21.15.175:0/1906310690 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9800bb50 con 0x7f4eb40aeac0 2024-04-25T09:12:17.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb9c00640 1 --2- 172.21.15.175:0/1906310690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e98004d50 0x7f4e980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb9200640 1 --2- 172.21.15.175:0/1906310690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4eb40aeac0 0x7f4e980039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eabe00640 1 --2- 172.21.15.175:0/1906310690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e98003f40 0x7f4e98004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb9c00640 1 -- 172.21.15.175:0/1906310690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4eb40aeac0 msgr2=0x7f4e980039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:17.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb9c00640 1 --2- 172.21.15.175:0/1906310690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4eb40aeac0 0x7f4e980039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb9c00640 1 -- 172.21.15.175:0/1906310690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e98003f40 msgr2=0x7f4e98004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:17.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb9c00640 1 --2- 172.21.15.175:0/1906310690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e98003f40 0x7f4e98004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.773+0000 7f4eb9c00640 1 -- 172.21.15.175:0/1906310690 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e98003530 con 0x7f4e98004d50 2024-04-25T09:12:17.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4eb9c00640 1 --2- 172.21.15.175:0/1906310690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e98004d50 0x7f4e980051d0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009fc0 tx=0x7f4eac01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38c1cded949def2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4eb3e00640 1 -- 172.21.15.175:0/1906310690 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac0b2070 con 0x7f4e98004d50 2024-04-25T09:12:17.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4eb3e00640 1 -- 172.21.15.175:0/1906310690 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eac0a5c90 con 0x7f4e98004d50 2024-04-25T09:12:17.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4eb3e00640 1 -- 172.21.15.175:0/1906310690 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac009c10 con 0x7f4e98004d50 2024-04-25T09:12:17.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4ebbc00640 1 -- 172.21.15.175:0/1906310690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e98004d50 msgr2=0x7f4e980051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4ebbc00640 1 --2- 172.21.15.175:0/1906310690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e98004d50 0x7f4e980051d0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009fc0 tx=0x7f4eac01cc20 comp rx=0 tx=0).stop 2024-04-25T09:12:17.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4eb9c00640 1 -- 172.21.15.175:0/1906310690 reap_dead start 2024-04-25T09:12:17.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4ebbc00640 1 -- 172.21.15.175:0/1906310690 shutdown_connections 2024-04-25T09:12:17.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4ebbc00640 1 -- 172.21.15.175:0/1906310690 >> 172.21.15.175:0/1906310690 conn(0x7f4eb4067150 msgr2=0x7f4eb406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:17.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4ebbc00640 1 -- 172.21.15.175:0/1906310690 shutdown_connections 2024-04-25T09:12:17.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4ebbc00640 1 -- 172.21.15.175:0/1906310690 wait complete. 2024-04-25T09:12:17.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4ebbc00640 1 Processor -- start 2024-04-25T09:12:17.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4ebbc00640 1 -- start start 2024-04-25T09:12:17.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4ebbc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eb4151400 0x7f4eb40cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4ebbc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4eb40ccb80 0x7f4eb4152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4ebbc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4eb4152b40 0x7f4eb415fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4ebbc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40b3220 con 0x7f4eb4151400 2024-04-25T09:12:17.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4ebbc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40b2f40 con 0x7f4eb4152b40 2024-04-25T09:12:17.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4ebbc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb40aef50 con 0x7f4eb40ccb80 2024-04-25T09:12:17.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.777+0000 7f4eb9200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eb4151400 0x7f4eb40cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4eb9200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eb4151400 0x7f4eb40cc640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46116/0 (socket says 172.21.15.175:46116) 2024-04-25T09:12:17.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4eb9200640 1 -- 172.21.15.175:0/3457610730 learned_addr learned my addr 172.21.15.175:0/3457610730 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:17.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4eabe00640 1 --2- 172.21.15.175:0/3457610730 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4eb40ccb80 0x7f4eb4152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4eb9c00640 1 --2- 172.21.15.175:0/3457610730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4eb4152b40 0x7f4eb415fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4eb9200640 1 -- 172.21.15.175:0/3457610730 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4eb40ccb80 msgr2=0x7f4eb4152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4eb9200640 1 --2- 172.21.15.175:0/3457610730 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4eb40ccb80 0x7f4eb4152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4eb9200640 1 -- 172.21.15.175:0/3457610730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4eb4152b40 msgr2=0x7f4eb415fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4eb9200640 1 --2- 172.21.15.175:0/3457610730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4eb4152b40 0x7f4eb415fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4eb9200640 1 -- 172.21.15.175:0/3457610730 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb4154e70 con 0x7f4eb4151400 2024-04-25T09:12:17.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4eb9200640 1 --2- 172.21.15.175:0/3457610730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eb4151400 0x7f4eb40cc640 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4011b00 tx=0x7f4ea4011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4eb1600640 1 -- 172.21.15.175:0/3457610730 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea400fbb0 con 0x7f4eb4151400 2024-04-25T09:12:17.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4eb1600640 1 -- 172.21.15.175:0/3457610730 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea400fd50 con 0x7f4eb4151400 2024-04-25T09:12:17.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4eb1600640 1 -- 172.21.15.175:0/3457610730 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4014680 con 0x7f4eb4151400 2024-04-25T09:12:17.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4ebbc00640 1 -- 172.21.15.175:0/3457610730 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb41517e0 con 0x7f4eb4151400 2024-04-25T09:12:17.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4ebbc00640 1 -- 172.21.15.175:0/3457610730 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb4153450 con 0x7f4eb4151400 2024-04-25T09:12:17.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4ebbc00640 1 -- 172.21.15.175:0/3457610730 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb4153650 con 0x7f4eb4151400 2024-04-25T09:12:17.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4eb1600640 1 -- 172.21.15.175:0/3457610730 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4ea4012040 con 0x7f4eb4151400 2024-04-25T09:12:17.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4eb1600640 1 --2- 172.21.15.175:0/3457610730 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4e90066f90 0x7f4e90069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:17.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.781+0000 7f4eb1600640 1 -- 172.21.15.175:0/3457610730 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f4ea4085340 con 0x7f4eb4151400 2024-04-25T09:12:17.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.785+0000 7f4eabe00640 1 --2- 172.21.15.175:0/3457610730 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4e90066f90 0x7f4e90069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:17.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.785+0000 7f4eabe00640 1 --2- 172.21.15.175:0/3457610730 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4e90066f90 0x7f4e90069450 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4eb41f1bc0 tx=0x7f4e9c007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:17.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.785+0000 7f4eb1600640 1 -- 172.21.15.175:0/3457610730 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4eb4153650 con 0x7f4eb4151400 2024-04-25T09:12:17.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.973+0000 7f4ebbc00640 1 -- 172.21.15.175:0/3457610730 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4eb4074a60 con 0x7f4eb4151400 2024-04-25T09:12:17.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.973+0000 7f4eb1600640 1 -- 172.21.15.175:0/3457610730 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+3708 (secure 0 0 0) 0x7f4ea4019030 con 0x7f4eb4151400 2024-04-25T09:12:17.962 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:17.962 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":73,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3229536012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3229536012},{"type":"v1","addr":"172.21.15.177:6834","nonce":3229536012}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":6395,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/222649735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":222649735},{"type":"v1","addr":"172.21.15.177:6835","nonce":222649735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2888989442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2888989442},{"type":"v1","addr":"172.21.15.175:6836","nonce":2888989442}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":54},{"gid":7995,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3730350186","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3730350186},{"type":"v1","addr":"172.21.15.175:6837","nonce":3730350186}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":73}],"filesystems":[]} 2024-04-25T09:12:17.962 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 73 2024-04-25T09:12:17.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.977+0000 7f4ebbc00640 1 -- 172.21.15.175:0/3457610730 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4e90066f90 msgr2=0x7f4e90069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.977+0000 7f4ebbc00640 1 --2- 172.21.15.175:0/3457610730 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4e90066f90 0x7f4e90069450 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4eb41f1bc0 tx=0x7f4e9c007900 comp rx=0 tx=0).stop 2024-04-25T09:12:17.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.977+0000 7f4ebbc00640 1 -- 172.21.15.175:0/3457610730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eb4151400 msgr2=0x7f4eb40cc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:17.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.977+0000 7f4ebbc00640 1 --2- 172.21.15.175:0/3457610730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eb4151400 0x7f4eb40cc640 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4011b00 tx=0x7f4ea4011f00 comp rx=0 tx=0).stop 2024-04-25T09:12:17.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.977+0000 7f4ebbc00640 1 -- 172.21.15.175:0/3457610730 shutdown_connections 2024-04-25T09:12:17.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.977+0000 7f4ebbc00640 1 --2- 172.21.15.175:0/3457610730 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4e90066f90 0x7f4e90069450 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.977+0000 7f4ebbc00640 1 --2- 172.21.15.175:0/3457610730 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4eb4152b40 0x7f4eb415fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.977+0000 7f4ebbc00640 1 --2- 172.21.15.175:0/3457610730 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4eb40ccb80 0x7f4eb4152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.977+0000 7f4ebbc00640 1 --2- 172.21.15.175:0/3457610730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eb4151400 0x7f4eb40cc640 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:17.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.977+0000 7f4ebbc00640 1 -- 172.21.15.175:0/3457610730 >> 172.21.15.175:0/3457610730 conn(0x7f4e98004d50 msgr2=0x7f4eb40b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:17.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.977+0000 7f4ebbc00640 1 -- 172.21.15.175:0/3457610730 shutdown_connections 2024-04-25T09:12:17.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:17.977+0000 7f4ebbc00640 1 -- 172.21.15.175:0/3457610730 wait complete. 2024-04-25T09:12:17.984 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:12:17.984 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:12:17.984 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:12:17.984 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:17.984 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:12:17.984 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:12:17.985 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:12:17.985 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:17.985 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:12:17.985 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:12:17.985 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:12:17.985 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:17.985 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:12:17.985 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:12:17.986 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:12:17.986 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:17.996 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:12:17.996 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:12:17.997 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:12:17.997 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:12:18.000 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:12:18.000 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:12:18.001 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:12:18.001 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:12:18.041 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:12:18.041 DEBUG:teuthology.parallel:result is None 2024-04-25T09:12:18.042 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:12:18.042 DEBUG:teuthology.parallel:result is None 2024-04-25T09:12:18.050 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:12:18.050 DEBUG:teuthology.parallel:result is None 2024-04-25T09:12:18.051 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:12:18.052 DEBUG:teuthology.parallel:result is None 2024-04-25T09:12:18.052 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:12:18.126 INFO:tasks.ceph.mds.c.smithi175.stdout:starting mds.c at 2024-04-25T09:12:18.127 INFO:tasks.ceph.mds.a.smithi175.stdout:starting mds.a at 2024-04-25T09:12:18.141 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-04-25T09:12:18.141 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-04-25T09:12:18.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.209+0000 7f24d5600640 1 Processor -- start 2024-04-25T09:12:18.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.209+0000 7f24d5600640 1 -- start start 2024-04-25T09:12:18.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.209+0000 7f24d5600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f24d0145250 0x7f24d00cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:18.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.209+0000 7f24d5600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d00ce970 0x7f24d00cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:18.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.209+0000 7f24d5600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d00cfd10 con 0x7f24d01600a0 2024-04-25T09:12:18.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.209+0000 7f24d5600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d015f650 con 0x7f24d0145250 2024-04-25T09:12:18.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.209+0000 7f24d5600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00cfff0 con 0x7f24d00ce970 2024-04-25T09:12:18.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.213+0000 7f24cf400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d00ce970 0x7f24d00cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:18.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.213+0000 7f24cea00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f24d0145250 0x7f24d00cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:18.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.213+0000 7f24ce000640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f24d01600a0 0x7f24d00cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:43278/0 (socket says 172.21.15.175:43278) 2024-04-25T09:12:18.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.213+0000 7f24ce000640 1 -- 172.21.15.175:0/17128671 learned_addr learned my addr 172.21.15.175:0/17128671 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:18.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.213+0000 7f24cf400640 1 -- 172.21.15.175:0/17128671 >> v2:172.21.15.177:3300/0 conn(0x7f24d0145250 msgr2=0x7f24d00cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:18.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.213+0000 7f24cf400640 1 --2- 172.21.15.175:0/17128671 >> v2:172.21.15.177:3300/0 conn(0x7f24d0145250 0x7f24d00cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.213+0000 7f24cf400640 1 -- 172.21.15.175:0/17128671 >> v1:172.21.15.177:6789/0 conn(0x7f24d01600a0 legacy=0x7f24d00cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:18.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.213+0000 7f24cf400640 1 -- 172.21.15.175:0/17128671 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d015f8a0 con 0x7f24d00ce970 2024-04-25T09:12:18.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.213+0000 7f24cf400640 1 --2- 172.21.15.175:0/17128671 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d00ce970 0x7f24d00cee00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f24c80097f0 tx=0x7f24c801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f33b4f97a8e353ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:18.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.213+0000 7f24cd600640 1 -- 172.21.15.175:0/17128671 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80ab600 con 0x7f24d00ce970 2024-04-25T09:12:18.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.213+0000 7f24cd600640 1 -- 172.21.15.175:0/17128671 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c80b0070 con 0x7f24d00ce970 2024-04-25T09:12:18.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.213+0000 7f24cd600640 1 -- 172.21.15.175:0/17128671 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80ab9c0 con 0x7f24d00ce970 2024-04-25T09:12:18.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24d5600640 1 -- 172.21.15.175:0/17128671 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d00ce970 msgr2=0x7f24d00cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:18.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24d5600640 1 --2- 172.21.15.175:0/17128671 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d00ce970 0x7f24d00cee00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f24c80097f0 tx=0x7f24c801c3e0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24d5600640 1 -- 172.21.15.175:0/17128671 shutdown_connections 2024-04-25T09:12:18.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24d5600640 1 --2- 172.21.15.175:0/17128671 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d00ce970 0x7f24d00cee00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24d5600640 1 --2- 172.21.15.175:0/17128671 >> v2:172.21.15.177:3300/0 conn(0x7f24d0145250 0x7f24d00cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24d5600640 1 -- 172.21.15.175:0/17128671 >> 172.21.15.175:0/17128671 conn(0x7f24d006ac50 msgr2=0x7f24d006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:18.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24d5600640 1 -- 172.21.15.175:0/17128671 shutdown_connections 2024-04-25T09:12:18.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24d5600640 1 -- 172.21.15.175:0/17128671 wait complete. 2024-04-25T09:12:18.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24d5600640 1 Processor -- start 2024-04-25T09:12:18.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24d5600640 1 -- start start 2024-04-25T09:12:18.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24d5600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24d00ce970 0x7f24d015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:18.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24d5600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24d0145250 0x7f24d013de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:18.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24d5600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d01600a0 0x7f24d013e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:18.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24d5600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d015c870 con 0x7f24d0145250 2024-04-25T09:12:18.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24d5600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d01604b0 con 0x7f24d00ce970 2024-04-25T09:12:18.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24d5600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d015c9f0 con 0x7f24d01600a0 2024-04-25T09:12:18.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24ce000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24d0145250 0x7f24d013de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:18.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24ce000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24d0145250 0x7f24d013de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:46154/0 (socket says 172.21.15.175:46154) 2024-04-25T09:12:18.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24ce000640 1 -- 172.21.15.175:0/2569345443 learned_addr learned my addr 172.21.15.175:0/2569345443 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:18.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24cea00640 1 --2- 172.21.15.175:0/2569345443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24d00ce970 0x7f24d015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:18.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24cf400640 1 --2- 172.21.15.175:0/2569345443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d01600a0 0x7f24d013e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:18.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24ce000640 1 -- 172.21.15.175:0/2569345443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d01600a0 msgr2=0x7f24d013e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:18.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24ce000640 1 --2- 172.21.15.175:0/2569345443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d01600a0 0x7f24d013e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24ce000640 1 -- 172.21.15.175:0/2569345443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24d00ce970 msgr2=0x7f24d015a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:18.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24ce000640 1 --2- 172.21.15.175:0/2569345443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24d00ce970 0x7f24d015a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:18.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24ce000640 1 -- 172.21.15.175:0/2569345443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d013ecf0 con 0x7f24d0145250 2024-04-25T09:12:18.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.217+0000 7f24cea00640 1 --2- 172.21.15.175:0/2569345443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24d00ce970 0x7f24d015a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:18.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.221+0000 7f24ce000640 1 --2- 172.21.15.175:0/2569345443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24d0145250 0x7f24d013de70 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00c3a0 tx=0x7f24bc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:18.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.221+0000 7f24c6a00640 1 -- 172.21.15.175:0/2569345443 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc017070 con 0x7f24d0145250 2024-04-25T09:12:18.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.221+0000 7f24d5600640 1 -- 172.21.15.175:0/2569345443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d013efd0 con 0x7f24d0145250 2024-04-25T09:12:18.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.221+0000 7f24c6a00640 1 -- 172.21.15.175:0/2569345443 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc005cf0 con 0x7f24d0145250 2024-04-25T09:12:18.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.221+0000 7f24c6a00640 1 -- 172.21.15.175:0/2569345443 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc0072f0 con 0x7f24d0145250 2024-04-25T09:12:18.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.221+0000 7f24d5600640 1 -- 172.21.15.175:0/2569345443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d015aa30 con 0x7f24d0145250 2024-04-25T09:12:18.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.221+0000 7f24d5600640 1 -- 172.21.15.175:0/2569345443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d0075160 con 0x7f24d0145250 2024-04-25T09:12:18.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.221+0000 7f24c6a00640 1 -- 172.21.15.175:0/2569345443 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f24bc01a070 con 0x7f24d0145250 2024-04-25T09:12:18.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.221+0000 7f24c6a00640 1 --2- 172.21.15.175:0/2569345443 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f24b0066f60 0x7f24b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:18.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.221+0000 7f24c6a00640 1 -- 172.21.15.175:0/2569345443 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f24bc0841c0 con 0x7f24d0145250 2024-04-25T09:12:18.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.221+0000 7f24cea00640 1 --2- 172.21.15.175:0/2569345443 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f24b0066f60 0x7f24b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:18.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.225+0000 7f24cea00640 1 --2- 172.21.15.175:0/2569345443 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f24b0066f60 0x7f24b0069420 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f24d015e9c0 tx=0x7f24c000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:18.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.225+0000 7f24c6a00640 1 -- 172.21.15.175:0/2569345443 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f24bc054cb0 con 0x7f24d0145250 2024-04-25T09:12:18.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:18.401+0000 7f24d5600640 1 -- 172.21.15.175:0/2569345443 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f24d00cc440 con 0x7f24d0145250 2024-04-25T09:12:19.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.377+0000 7f24c6a00640 1 -- 172.21.15.175:0/2569345443 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v96) v1 ==== 97+0+0 (secure 0 0 0) 0x7f24bc058d50 con 0x7f24d0145250 2024-04-25T09:12:19.364 INFO:teuthology.orchestra.run.smithi175.stderr: removed all blocklist entries 2024-04-25T09:12:19.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.381+0000 7f24d5600640 1 -- 172.21.15.175:0/2569345443 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f24b0066f60 msgr2=0x7f24b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.381+0000 7f24d5600640 1 --2- 172.21.15.175:0/2569345443 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f24b0066f60 0x7f24b0069420 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f24d015e9c0 tx=0x7f24c000b040 comp rx=0 tx=0).stop 2024-04-25T09:12:19.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.381+0000 7f24d5600640 1 -- 172.21.15.175:0/2569345443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24d0145250 msgr2=0x7f24d013de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.381+0000 7f24d5600640 1 --2- 172.21.15.175:0/2569345443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24d0145250 0x7f24d013de70 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00c3a0 tx=0x7f24bc00c860 comp rx=0 tx=0).stop 2024-04-25T09:12:19.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.381+0000 7f24d5600640 1 -- 172.21.15.175:0/2569345443 shutdown_connections 2024-04-25T09:12:19.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.381+0000 7f24d5600640 1 --2- 172.21.15.175:0/2569345443 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f24b0066f60 0x7f24b0069420 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.381+0000 7f24d5600640 1 --2- 172.21.15.175:0/2569345443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24d01600a0 0x7f24d013e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.381+0000 7f24d5600640 1 --2- 172.21.15.175:0/2569345443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f24d0145250 0x7f24d013de70 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.381+0000 7f24d5600640 1 --2- 172.21.15.175:0/2569345443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24d00ce970 0x7f24d015a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.381+0000 7f24d5600640 1 -- 172.21.15.175:0/2569345443 >> 172.21.15.175:0/2569345443 conn(0x7f24d006ac50 msgr2=0x7f24d01651b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:19.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.381+0000 7f24d5600640 1 -- 172.21.15.175:0/2569345443 shutdown_connections 2024-04-25T09:12:19.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.381+0000 7f24d5600640 1 -- 172.21.15.175:0/2569345443 wait complete. 2024-04-25T09:12:19.389 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:12:19.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.541+0000 7f1970c00640 1 Processor -- start 2024-04-25T09:12:19.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.541+0000 7f1970c00640 1 -- start start 2024-04-25T09:12:19.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.541+0000 7f1970c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f196c15d950 0x7f196c06bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.541+0000 7f1970c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196c0d1d60 0x7f196c0b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.541+0000 7f1970c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196c15dd30 con 0x7f196c06c2a0 2024-04-25T09:12:19.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.541+0000 7f1970c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196c06c790 con 0x7f196c15d950 2024-04-25T09:12:19.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.541+0000 7f1970c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c06ca70 con 0x7f196c0d1d60 2024-04-25T09:12:19.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.541+0000 7f196b400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f196c15d950 0x7f196c06bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.541+0000 7f196be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196c0d1d60 0x7f196c0b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.541+0000 7f196aa00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f196c06c2a0 0x7f196c0d1650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:43556/0 (socket says 172.21.15.175:43556) 2024-04-25T09:12:19.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.541+0000 7f196aa00640 1 -- 172.21.15.175:0/602718632 learned_addr learned my addr 172.21.15.175:0/602718632 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:19.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.541+0000 7f196a000640 1 -- 172.21.15.175:0/602718632 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619271321 0 0) 0x7f196c15dd30 con 0x7f196c06c2a0 2024-04-25T09:12:19.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.541+0000 7f196a000640 1 -- 172.21.15.175:0/602718632 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1950003530 con 0x7f196c06c2a0 2024-04-25T09:12:19.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.541+0000 7f196b400640 1 -- 172.21.15.175:0/602718632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196c0d1d60 msgr2=0x7f196c0b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:19.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.541+0000 7f196b400640 1 --2- 172.21.15.175:0/602718632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196c0d1d60 0x7f196c0b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.541+0000 7f196b400640 1 -- 172.21.15.175:0/602718632 >> v1:172.21.15.177:6789/0 conn(0x7f196c06c2a0 legacy=0x7f196c0d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.541+0000 7f196b400640 1 -- 172.21.15.175:0/602718632 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c06cd50 con 0x7f196c15d950 2024-04-25T09:12:19.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.541+0000 7f196be00640 1 --2- 172.21.15.175:0/602718632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196c0d1d60 0x7f196c0b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:19.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.545+0000 7f196b400640 1 --2- 172.21.15.175:0/602718632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c15d950 0x7f196c06bd60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f195c0097a0 tx=0x7f195c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=806cb30cbf0d767 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:19.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.545+0000 7f196a000640 1 -- 172.21.15.175:0/602718632 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c0ab650 con 0x7f196c15d950 2024-04-25T09:12:19.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.545+0000 7f196a000640 1 -- 172.21.15.175:0/602718632 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195c0b0070 con 0x7f196c15d950 2024-04-25T09:12:19.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.545+0000 7f196a000640 1 -- 172.21.15.175:0/602718632 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c0aba10 con 0x7f196c15d950 2024-04-25T09:12:19.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.545+0000 7f1970c00640 1 -- 172.21.15.175:0/602718632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c15d950 msgr2=0x7f196c06bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.545+0000 7f1970c00640 1 --2- 172.21.15.175:0/602718632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c15d950 0x7f196c06bd60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f195c0097a0 tx=0x7f195c01c450 comp rx=0 tx=0).stop 2024-04-25T09:12:19.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.545+0000 7f1970c00640 1 -- 172.21.15.175:0/602718632 shutdown_connections 2024-04-25T09:12:19.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.545+0000 7f1970c00640 1 --2- 172.21.15.175:0/602718632 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196c0d1d60 0x7f196c0b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.545+0000 7f1970c00640 1 --2- 172.21.15.175:0/602718632 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c15d950 0x7f196c06bd60 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.545+0000 7f1970c00640 1 -- 172.21.15.175:0/602718632 >> 172.21.15.175:0/602718632 conn(0x7f196c09aa90 msgr2=0x7f196c08afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:19.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.545+0000 7f1970c00640 1 -- 172.21.15.175:0/602718632 shutdown_connections 2024-04-25T09:12:19.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.545+0000 7f1970c00640 1 -- 172.21.15.175:0/602718632 wait complete. 2024-04-25T09:12:19.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f1970c00640 1 Processor -- start 2024-04-25T09:12:19.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f1970c00640 1 -- start start 2024-04-25T09:12:19.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f1970c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196c06c2a0 0x7f196c151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f1970c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c0d1d60 0x7f196c0b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f1970c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f196c15d950 0x7f196c0b6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f1970c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c0b0ca0 con 0x7f196c15d950 2024-04-25T09:12:19.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f1970c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c0b0b20 con 0x7f196c0d1d60 2024-04-25T09:12:19.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f1970c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c0b21c0 con 0x7f196c06c2a0 2024-04-25T09:12:19.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f196be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f196c15d950 0x7f196c0b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f196b400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196c06c2a0 0x7f196c151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f196be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f196c15d950 0x7f196c0b6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41208/0 (socket says 172.21.15.175:41208) 2024-04-25T09:12:19.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f196aa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c0d1d60 0x7f196c0b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f196be00640 1 -- 172.21.15.175:0/745784683 learned_addr learned my addr 172.21.15.175:0/745784683 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:19.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f196be00640 1 -- 172.21.15.175:0/745784683 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196c06c2a0 msgr2=0x7f196c151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f196be00640 1 --2- 172.21.15.175:0/745784683 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196c06c2a0 0x7f196c151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f196be00640 1 -- 172.21.15.175:0/745784683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c0d1d60 msgr2=0x7f196c0b62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f196be00640 1 --2- 172.21.15.175:0/745784683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c0d1d60 0x7f196c0b62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f196be00640 1 -- 172.21.15.175:0/745784683 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c153f90 con 0x7f196c15d950 2024-04-25T09:12:19.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f196be00640 1 --2- 172.21.15.175:0/745784683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f196c15d950 0x7f196c0b6830 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f196400ef90 tx=0x7f1964009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:19.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f1963400640 1 -- 172.21.15.175:0/745784683 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964018020 con 0x7f196c15d950 2024-04-25T09:12:19.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f1963400640 1 -- 172.21.15.175:0/745784683 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1964014480 con 0x7f196c15d950 2024-04-25T09:12:19.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f1963400640 1 -- 172.21.15.175:0/745784683 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964014870 con 0x7f196c15d950 2024-04-25T09:12:19.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f1970c00640 1 -- 172.21.15.175:0/745784683 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c0c7540 con 0x7f196c15d950 2024-04-25T09:12:19.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.549+0000 7f1970c00640 1 -- 172.21.15.175:0/745784683 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c15f4d0 con 0x7f196c15d950 2024-04-25T09:12:19.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.553+0000 7f1970c00640 1 -- 172.21.15.175:0/745784683 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c074a60 con 0x7f196c15d950 2024-04-25T09:12:19.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.553+0000 7f1963400640 1 -- 172.21.15.175:0/745784683 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f196401b020 con 0x7f196c15d950 2024-04-25T09:12:19.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.553+0000 7f1963400640 1 --2- 172.21.15.175:0/745784683 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f194c066f60 0x7f194c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.553+0000 7f1963400640 1 -- 172.21.15.175:0/745784683 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f19640858c0 con 0x7f196c15d950 2024-04-25T09:12:19.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.553+0000 7f196b400640 1 --2- 172.21.15.175:0/745784683 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f194c066f60 0x7f194c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.553+0000 7f196b400640 1 --2- 172.21.15.175:0/745784683 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f194c066f60 0x7f194c069420 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f195c0af000 tx=0x7f195c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:19.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.557+0000 7f1963400640 1 -- 172.21.15.175:0/745784683 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1964022030 con 0x7f196c15d950 2024-04-25T09:12:19.749 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.761+0000 7f1970c00640 1 -- 172.21.15.175:0/745784683 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f196c0aef00 con 0x7f196c15d950 2024-04-25T09:12:19.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.765+0000 7f1963400640 1 -- 172.21.15.175:0/745784683 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f1964010040 con 0x7f196c15d950 2024-04-25T09:12:19.751 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:19.751 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:12:19.751 INFO:teuthology.orchestra.run.smithi175.stdout: "auth_dump": [ 2024-04-25T09:12:19.751 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.751 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.a", 2024-04-25T09:12:19.751 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpm3usiKxAAROh+31LaNyuh2SdeW6pKjQ==", 2024-04-25T09:12:19.751 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.751 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:12:19.751 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:12:19.751 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:12:19.751 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:12:19.751 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:12:19.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.752 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.b", 2024-04-25T09:12:19.752 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmYJoRNxAAZfRvDn1aoR0wa2mEKBrr+A==", 2024-04-25T09:12:19.752 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.752 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:12:19.752 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:12:19.752 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:12:19.752 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:12:19.752 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.752 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:12:19.752 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.752 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.c", 2024-04-25T09:12:19.752 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmk8M3MhAA6aIN33aWvVcvVEFtHL8SWA==", 2024-04-25T09:12:19.752 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.753 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:12:19.753 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:12:19.753 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:12:19.753 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:12:19.753 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.753 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:12:19.753 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.753 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.d", 2024-04-25T09:12:19.754 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmLAHLAhAA+mWUfpb6izHixJa073r9Jw==", 2024-04-25T09:12:19.754 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.754 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:12:19.754 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:12:19.754 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:12:19.754 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:12:19.754 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.754 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:12:19.754 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.754 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.0", 2024-04-25T09:12:19.754 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBSHCpm2xftAxAAxs9n8AE2H3HpPHEUZA4Cng==", 2024-04-25T09:12:19.754 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.754 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:12:19.755 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:12:19.755 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:12:19.755 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:12:19.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.755 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.1", 2024-04-25T09:12:19.755 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBVHCpm/OOlDRAAA7zaD8qsqS2TOCKhDFheJw==", 2024-04-25T09:12:19.755 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.755 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:12:19.755 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:12:19.755 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:12:19.755 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.755 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:12:19.755 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.756 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.2", 2024-04-25T09:12:19.756 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBYHCpmy/kmFxAAwCADFI/jMe27gAmyuAJZHQ==", 2024-04-25T09:12:19.756 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.756 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:12:19.756 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:12:19.756 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:12:19.756 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.756 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:12:19.756 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.756 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.3", 2024-04-25T09:12:19.756 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBbHCpm89a7HhAAVTueOuS0/Ksf8SdWK+Nm1g==", 2024-04-25T09:12:19.756 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.756 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:12:19.756 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:12:19.756 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:12:19.757 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:12:19.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.757 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.4", 2024-04-25T09:12:19.757 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBhHCpm5EAtFRAAeADhjja0BOIvxY3RB+n6+A==", 2024-04-25T09:12:19.757 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.757 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:12:19.757 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:12:19.757 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:12:19.757 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.757 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:12:19.757 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.757 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.5", 2024-04-25T09:12:19.757 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBkHCpmrLilHRAA+H8Bejnk49YfaUvl3Nrrhw==", 2024-04-25T09:12:19.757 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.758 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:12:19.758 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:12:19.758 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:12:19.758 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.758 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:12:19.758 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.758 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.6", 2024-04-25T09:12:19.758 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBnHCpm6uDxJRAAX5EwEelnZXwEHnNnv+XQ6A==", 2024-04-25T09:12:19.758 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.758 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:12:19.758 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:12:19.759 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:12:19.759 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:12:19.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.759 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.7", 2024-04-25T09:12:19.759 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBqHCpmwow5MBAA7b/Q9DiPO6Bfldq1+rf+/w==", 2024-04-25T09:12:19.759 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.759 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:12:19.759 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:12:19.759 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:12:19.759 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.759 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:12:19.759 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.759 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.0", 2024-04-25T09:12:19.759 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmhyCUBhAA8k9xLKIw8R04i6HSJykDfw==", 2024-04-25T09:12:19.760 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.760 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:12:19.760 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow r", 2024-04-25T09:12:19.760 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:12:19.760 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.760 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:12:19.760 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.760 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.1", 2024-04-25T09:12:19.760 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmQigrEBAAoWfP1ZEosbLELev5z+C9/g==", 2024-04-25T09:12:19.760 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.760 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:12:19.760 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:12:19.760 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:12:19.760 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:12:19.760 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:12:19.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.761 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.2", 2024-04-25T09:12:19.761 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpm0xaSDBAAup34GS3pnMwjksVuuUGOkw==", 2024-04-25T09:12:19.761 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.761 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:12:19.761 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:12:19.761 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:12:19.761 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:12:19.761 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.761 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:12:19.761 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.761 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.3", 2024-04-25T09:12:19.761 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpm6+doFhAAA18OgwfM8gXgQ6g0KUo7Hw==", 2024-04-25T09:12:19.761 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.761 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:12:19.762 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:12:19.762 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:12:19.762 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:12:19.762 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.762 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:12:19.762 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.762 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.admin", 2024-04-25T09:12:19.762 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmRZAYDRAA9sepw/fI2OhoZXER6Rmd+g==", 2024-04-25T09:12:19.762 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.762 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:12:19.762 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:12:19.762 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:12:19.762 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:12:19.762 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:12:19.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.763 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mgr.x", 2024-04-25T09:12:19.763 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpm5q4gJxAA9zPRlimxM0+Rb5RQkcoxzQ==", 2024-04-25T09:12:19.763 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.763 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:12:19.763 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile mgr", 2024-04-25T09:12:19.763 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:12:19.763 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.763 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:12:19.763 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:19.763 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mgr.y", 2024-04-25T09:12:19.763 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmMLIqIxAAiMo8+3lU0fXNoI6kBrro+Q==", 2024-04-25T09:12:19.763 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:12:19.763 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:12:19.764 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile mgr", 2024-04-25T09:12:19.764 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:12:19.764 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.764 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:19.764 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-25T09:12:19.764 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:12:19.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.765+0000 7f1970c00640 1 -- 172.21.15.175:0/745784683 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f194c066f60 msgr2=0x7f194c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.765+0000 7f1970c00640 1 --2- 172.21.15.175:0/745784683 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f194c066f60 0x7f194c069420 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f195c0af000 tx=0x7f195c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:12:19.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.765+0000 7f1970c00640 1 -- 172.21.15.175:0/745784683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f196c15d950 msgr2=0x7f196c0b6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.765+0000 7f1970c00640 1 --2- 172.21.15.175:0/745784683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f196c15d950 0x7f196c0b6830 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f196400ef90 tx=0x7f1964009f90 comp rx=0 tx=0).stop 2024-04-25T09:12:19.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.765+0000 7f1970c00640 1 -- 172.21.15.175:0/745784683 shutdown_connections 2024-04-25T09:12:19.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.765+0000 7f1970c00640 1 --2- 172.21.15.175:0/745784683 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f194c066f60 0x7f194c069420 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.765+0000 7f1970c00640 1 --2- 172.21.15.175:0/745784683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f196c15d950 0x7f196c0b6830 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.765+0000 7f1970c00640 1 --2- 172.21.15.175:0/745784683 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f196c0d1d60 0x7f196c0b62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.765+0000 7f1970c00640 1 --2- 172.21.15.175:0/745784683 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f196c06c2a0 0x7f196c151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.765+0000 7f1970c00640 1 -- 172.21.15.175:0/745784683 >> 172.21.15.175:0/745784683 conn(0x7f196c09aa90 msgr2=0x7f196c070c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:19.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.765+0000 7f1970c00640 1 -- 172.21.15.175:0/745784683 shutdown_connections 2024-04-25T09:12:19.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.765+0000 7f1970c00640 1 -- 172.21.15.175:0/745784683 wait complete. 2024-04-25T09:12:19.773 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:19.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.921+0000 7fee76c00640 1 Processor -- start 2024-04-25T09:12:19.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.921+0000 7fee76c00640 1 -- start start 2024-04-25T09:12:19.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.921+0000 7fee76c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fee701453a0 0x7fee7015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.921+0000 7fee76c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fee7015c410 0x7fee700cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.921+0000 7fee76c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee7015c8a0 con 0x7fee70144fc0 2024-04-25T09:12:19.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.921+0000 7fee76c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7015cd00 con 0x7fee701453a0 2024-04-25T09:12:19.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.921+0000 7fee76c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee700ce660 con 0x7fee7015c410 2024-04-25T09:12:19.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.921+0000 7fee6fe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fee70144fc0 0x7fee700cbe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:34346/0 (socket says 172.21.15.175:34346) 2024-04-25T09:12:19.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.921+0000 7fee6fe00640 1 -- 172.21.15.175:0/3722824452 learned_addr learned my addr 172.21.15.175:0/3722824452 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:19.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.921+0000 7fee6f400640 1 --2- 172.21.15.175:0/3722824452 >> v2:172.21.15.175:3300/0 conn(0x7fee701453a0 0x7fee7015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.921+0000 7fee74c00640 1 --2- 172.21.15.175:0/3722824452 >> v2:172.21.15.177:3300/0 conn(0x7fee7015c410 0x7fee700cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.921+0000 7fee6ea00640 1 -- 172.21.15.175:0/3722824452 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945505547 0 0) 0x7fee7015c8a0 con 0x7fee70144fc0 2024-04-25T09:12:19.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.921+0000 7fee6ea00640 1 -- 172.21.15.175:0/3722824452 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee54003530 con 0x7fee70144fc0 2024-04-25T09:12:19.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.921+0000 7fee6f400640 1 -- 172.21.15.175:0/3722824452 >> v2:172.21.15.177:3300/0 conn(0x7fee7015c410 msgr2=0x7fee700cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:19.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.921+0000 7fee6f400640 1 --2- 172.21.15.175:0/3722824452 >> v2:172.21.15.177:3300/0 conn(0x7fee7015c410 0x7fee700cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.921+0000 7fee6f400640 1 -- 172.21.15.175:0/3722824452 >> v1:172.21.15.175:6789/0 conn(0x7fee70144fc0 legacy=0x7fee700cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.921+0000 7fee6f400640 1 -- 172.21.15.175:0/3722824452 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee700cc930 con 0x7fee701453a0 2024-04-25T09:12:19.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.925+0000 7fee6f400640 1 --2- 172.21.15.175:0/3722824452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee701453a0 0x7fee7015bed0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0097c0 tx=0x7fee5c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacd959f1300595a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:19.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.925+0000 7fee6ea00640 1 -- 172.21.15.175:0/3722824452 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0b0070 con 0x7fee701453a0 2024-04-25T09:12:19.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.925+0000 7fee6ea00640 1 -- 172.21.15.175:0/3722824452 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c004230 con 0x7fee701453a0 2024-04-25T09:12:19.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.925+0000 7fee6ea00640 1 -- 172.21.15.175:0/3722824452 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c003620 con 0x7fee701453a0 2024-04-25T09:12:19.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.925+0000 7fee76c00640 1 -- 172.21.15.175:0/3722824452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee701453a0 msgr2=0x7fee7015bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.925+0000 7fee76c00640 1 --2- 172.21.15.175:0/3722824452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee701453a0 0x7fee7015bed0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0097c0 tx=0x7fee5c01c460 comp rx=0 tx=0).stop 2024-04-25T09:12:19.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.925+0000 7fee76c00640 1 -- 172.21.15.175:0/3722824452 shutdown_connections 2024-04-25T09:12:19.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.925+0000 7fee76c00640 1 --2- 172.21.15.175:0/3722824452 >> v2:172.21.15.177:3300/0 conn(0x7fee7015c410 0x7fee700cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.925+0000 7fee76c00640 1 --2- 172.21.15.175:0/3722824452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee701453a0 0x7fee7015bed0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.925+0000 7fee76c00640 1 -- 172.21.15.175:0/3722824452 >> 172.21.15.175:0/3722824452 conn(0x7fee70067150 msgr2=0x7fee7006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:19.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.925+0000 7fee76c00640 1 -- 172.21.15.175:0/3722824452 shutdown_connections 2024-04-25T09:12:19.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.925+0000 7fee76c00640 1 -- 172.21.15.175:0/3722824452 wait complete. 2024-04-25T09:12:19.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee76c00640 1 Processor -- start 2024-04-25T09:12:19.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee76c00640 1 -- start start 2024-04-25T09:12:19.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee76c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee701453a0 0x7fee700b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee76c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fee7015c410 0x7fee7015a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee76c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee70159170 0x7fee70141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee76c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee700cc580 con 0x7fee701453a0 2024-04-25T09:12:19.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee76c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee700cfb70 con 0x7fee70159170 2024-04-25T09:12:19.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee76c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee70159620 con 0x7fee7015c410 2024-04-25T09:12:19.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee6fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee701453a0 0x7fee700b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee6fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee701453a0 0x7fee700b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41216/0 (socket says 172.21.15.175:41216) 2024-04-25T09:12:19.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee6fe00640 1 -- 172.21.15.175:0/3139071658 learned_addr learned my addr 172.21.15.175:0/3139071658 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:19.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee74c00640 1 --2- 172.21.15.175:0/3139071658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee70159170 0x7fee70141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee6f400640 1 --2- 172.21.15.175:0/3139071658 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fee7015c410 0x7fee7015a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee6fe00640 1 -- 172.21.15.175:0/3139071658 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fee7015c410 msgr2=0x7fee7015a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee6fe00640 1 --2- 172.21.15.175:0/3139071658 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fee7015c410 0x7fee7015a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee6fe00640 1 -- 172.21.15.175:0/3139071658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee70159170 msgr2=0x7fee70141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:19.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee6fe00640 1 --2- 172.21.15.175:0/3139071658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee70159170 0x7fee70141690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:19.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee6fe00640 1 -- 172.21.15.175:0/3139071658 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee70159990 con 0x7fee701453a0 2024-04-25T09:12:19.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee6f400640 1 --2- 172.21.15.175:0/3139071658 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fee7015c410 0x7fee7015a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:19.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee74c00640 1 --2- 172.21.15.175:0/3139071658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee70159170 0x7fee70141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:19.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee6fe00640 1 --2- 172.21.15.175:0/3139071658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee701453a0 0x7fee700b1b10 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fee6000cb40 tx=0x7fee6000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:19.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee67e00640 1 -- 172.21.15.175:0/3139071658 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60017070 con 0x7fee701453a0 2024-04-25T09:12:19.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee67e00640 1 -- 172.21.15.175:0/3139071658 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6000aca0 con 0x7fee701453a0 2024-04-25T09:12:19.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee67e00640 1 -- 172.21.15.175:0/3139071658 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60012620 con 0x7fee701453a0 2024-04-25T09:12:19.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee76c00640 1 -- 172.21.15.175:0/3139071658 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee70159c70 con 0x7fee701453a0 2024-04-25T09:12:19.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.929+0000 7fee76c00640 1 -- 172.21.15.175:0/3139071658 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7015a230 con 0x7fee701453a0 2024-04-25T09:12:19.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.933+0000 7fee76c00640 1 -- 172.21.15.175:0/3139071658 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee70074a60 con 0x7fee701453a0 2024-04-25T09:12:19.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.933+0000 7fee67e00640 1 -- 172.21.15.175:0/3139071658 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fee6001a070 con 0x7fee701453a0 2024-04-25T09:12:19.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.933+0000 7fee67e00640 1 --2- 172.21.15.175:0/3139071658 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fee50066f90 0x7fee50069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:19.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.933+0000 7fee67e00640 1 -- 172.21.15.175:0/3139071658 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fee60084b70 con 0x7fee701453a0 2024-04-25T09:12:19.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.933+0000 7fee6f400640 1 --2- 172.21.15.175:0/3139071658 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fee50066f90 0x7fee50069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:19.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.933+0000 7fee6f400640 1 --2- 172.21.15.175:0/3139071658 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fee50066f90 0x7fee50069450 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0ad000 tx=0x7fee5c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:19.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:19.937+0000 7fee67e00640 1 -- 172.21.15.175:0/3139071658 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fee60055e30 con 0x7fee701453a0 2024-04-25T09:12:20.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.097+0000 7fee76c00640 1 -- 172.21.15.175:0/3139071658 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee7015a400 con 0x7fee701453a0 2024-04-25T09:12:20.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.097+0000 7fee67e00640 1 -- 172.21.15.175:0/3139071658 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+12928 (secure 0 0 0) 0x7fee60055730 con 0x7fee701453a0 2024-04-25T09:12:20.083 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:20.084 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":96,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:12:19.377388+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:20.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.097+0000 7fee76c00640 1 -- 172.21.15.175:0/3139071658 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fee50066f90 msgr2=0x7fee50069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.097+0000 7fee76c00640 1 --2- 172.21.15.175:0/3139071658 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fee50066f90 0x7fee50069450 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0ad000 tx=0x7fee5c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:12:20.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.097+0000 7fee76c00640 1 -- 172.21.15.175:0/3139071658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee701453a0 msgr2=0x7fee700b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.097+0000 7fee76c00640 1 --2- 172.21.15.175:0/3139071658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee701453a0 0x7fee700b1b10 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fee6000cb40 tx=0x7fee6000a060 comp rx=0 tx=0).stop 2024-04-25T09:12:20.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.097+0000 7fee76c00640 1 -- 172.21.15.175:0/3139071658 shutdown_connections 2024-04-25T09:12:20.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.097+0000 7fee76c00640 1 --2- 172.21.15.175:0/3139071658 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fee50066f90 0x7fee50069450 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.097+0000 7fee76c00640 1 --2- 172.21.15.175:0/3139071658 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fee70159170 0x7fee70141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.097+0000 7fee76c00640 1 --2- 172.21.15.175:0/3139071658 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fee7015c410 0x7fee7015a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.097+0000 7fee76c00640 1 --2- 172.21.15.175:0/3139071658 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fee701453a0 0x7fee700b1b10 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.097+0000 7fee76c00640 1 -- 172.21.15.175:0/3139071658 >> 172.21.15.175:0/3139071658 conn(0x7fee70144fc0 msgr2=0x7fee7015e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:20.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.097+0000 7fee76c00640 1 -- 172.21.15.175:0/3139071658 shutdown_connections 2024-04-25T09:12:20.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.097+0000 7fee76c00640 1 -- 172.21.15.175:0/3139071658 wait complete. 2024-04-25T09:12:20.107 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:12:20.107 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:12:20.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.257+0000 7f5375400640 1 Processor -- start 2024-04-25T09:12:20.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.257+0000 7f5375400640 1 -- start start 2024-04-25T09:12:20.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.261+0000 7f5375400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f537015b8e0 0x7f537009a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.261+0000 7f5375400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f537015bcc0 0x7f53700cfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.261+0000 7f5375400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5370099b80 con 0x7f53701601b0 2024-04-25T09:12:20.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.261+0000 7f5375400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537009a4b0 con 0x7f537015bcc0 2024-04-25T09:12:20.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.261+0000 7f5375400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5370099e60 con 0x7f537015b8e0 2024-04-25T09:12:20.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.261+0000 7f5367400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f537015bcc0 0x7f53700cfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.261+0000 7f5374a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f53701601b0 0x7f537015f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:34358/0 (socket says 172.21.15.175:34358) 2024-04-25T09:12:20.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.261+0000 7f5374a00640 1 -- 172.21.15.175:0/4083102559 learned_addr learned my addr 172.21.15.175:0/4083102559 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:20.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.261+0000 7f536fe00640 1 --2- 172.21.15.175:0/4083102559 >> v2:172.21.15.177:3300/0 conn(0x7f537015b8e0 0x7f537009a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.261+0000 7f5367400640 1 -- 172.21.15.175:0/4083102559 >> v2:172.21.15.177:3300/0 conn(0x7f537015b8e0 msgr2=0x7f537009a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:20.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.261+0000 7f5367400640 1 --2- 172.21.15.175:0/4083102559 >> v2:172.21.15.177:3300/0 conn(0x7f537015b8e0 0x7f537009a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.261+0000 7f5367400640 1 -- 172.21.15.175:0/4083102559 >> v1:172.21.15.175:6789/0 conn(0x7f53701601b0 legacy=0x7f537015f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.261+0000 7f536f400640 1 -- 172.21.15.175:0/4083102559 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956048506 0 0) 0x7f5370099b80 con 0x7f53701601b0 2024-04-25T09:12:20.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.261+0000 7f5367400640 1 -- 172.21.15.175:0/4083102559 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537009a140 con 0x7f537015bcc0 2024-04-25T09:12:20.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.261+0000 7f5367400640 1 --2- 172.21.15.175:0/4083102559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f537015bcc0 0x7f53700cfc30 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f53700726c0 tx=0x7f535801ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18eaf63d6fed017d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:20.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f536f400640 1 -- 172.21.15.175:0/4083102559 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53580ab610 con 0x7f537015bcc0 2024-04-25T09:12:20.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f536f400640 1 -- 172.21.15.175:0/4083102559 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53580b0070 con 0x7f537015bcc0 2024-04-25T09:12:20.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f536f400640 1 -- 172.21.15.175:0/4083102559 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53580ab9d0 con 0x7f537015bcc0 2024-04-25T09:12:20.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5375400640 1 -- 172.21.15.175:0/4083102559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f537015bcc0 msgr2=0x7f53700cfc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5375400640 1 --2- 172.21.15.175:0/4083102559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f537015bcc0 0x7f53700cfc30 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f53700726c0 tx=0x7f535801ce50 comp rx=0 tx=0).stop 2024-04-25T09:12:20.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5375400640 1 -- 172.21.15.175:0/4083102559 shutdown_connections 2024-04-25T09:12:20.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5375400640 1 --2- 172.21.15.175:0/4083102559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f537015bcc0 0x7f53700cfc30 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5375400640 1 --2- 172.21.15.175:0/4083102559 >> v2:172.21.15.177:3300/0 conn(0x7f537015b8e0 0x7f537009a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5375400640 1 -- 172.21.15.175:0/4083102559 >> 172.21.15.175:0/4083102559 conn(0x7f53700b3140 msgr2=0x7f53700b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:20.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5375400640 1 -- 172.21.15.175:0/4083102559 shutdown_connections 2024-04-25T09:12:20.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5375400640 1 -- 172.21.15.175:0/4083102559 wait complete. 2024-04-25T09:12:20.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5375400640 1 Processor -- start 2024-04-25T09:12:20.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5375400640 1 -- start start 2024-04-25T09:12:20.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5375400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f537015b8e0 0x7f53700c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5375400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f537015bcc0 0x7f53700b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5375400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53701601b0 0x7f5370156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5375400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537015fcb0 con 0x7f53701601b0 2024-04-25T09:12:20.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5375400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53700d0380 con 0x7f537015bcc0 2024-04-25T09:12:20.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5375400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537015fe30 con 0x7f537015b8e0 2024-04-25T09:12:20.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5374a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53701601b0 0x7f5370156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5374a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53701601b0 0x7f5370156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41226/0 (socket says 172.21.15.175:41226) 2024-04-25T09:12:20.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.265+0000 7f5374a00640 1 -- 172.21.15.175:0/1022597922 learned_addr learned my addr 172.21.15.175:0/1022597922 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:20.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.269+0000 7f536fe00640 1 --2- 172.21.15.175:0/1022597922 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f537015b8e0 0x7f53700c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.269+0000 7f5367400640 1 --2- 172.21.15.175:0/1022597922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f537015bcc0 0x7f53700b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.269+0000 7f5374a00640 1 -- 172.21.15.175:0/1022597922 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f537015b8e0 msgr2=0x7f53700c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.269+0000 7f5374a00640 1 --2- 172.21.15.175:0/1022597922 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f537015b8e0 0x7f53700c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.269+0000 7f5374a00640 1 -- 172.21.15.175:0/1022597922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f537015bcc0 msgr2=0x7f53700b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.269+0000 7f5374a00640 1 --2- 172.21.15.175:0/1022597922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f537015bcc0 0x7f53700b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.269+0000 7f5374a00640 1 -- 172.21.15.175:0/1022597922 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53700b6510 con 0x7f53701601b0 2024-04-25T09:12:20.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.269+0000 7f5374a00640 1 --2- 172.21.15.175:0/1022597922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53701601b0 0x7f5370156190 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f536800c6d0 tx=0x7f536800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:20.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.269+0000 7f536cc00640 1 -- 172.21.15.175:0/1022597922 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5368018070 con 0x7f53701601b0 2024-04-25T09:12:20.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.269+0000 7f536cc00640 1 -- 172.21.15.175:0/1022597922 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5368004d70 con 0x7f53701601b0 2024-04-25T09:12:20.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.269+0000 7f536cc00640 1 -- 172.21.15.175:0/1022597922 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536800a880 con 0x7f53701601b0 2024-04-25T09:12:20.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.269+0000 7f5375400640 1 -- 172.21.15.175:0/1022597922 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53700b67f0 con 0x7f53701601b0 2024-04-25T09:12:20.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.269+0000 7f5375400640 1 -- 172.21.15.175:0/1022597922 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53700b72d0 con 0x7f53701601b0 2024-04-25T09:12:20.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.269+0000 7f5375400640 1 -- 172.21.15.175:0/1022597922 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5370074a60 con 0x7f53701601b0 2024-04-25T09:12:20.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.269+0000 7f536cc00640 1 -- 172.21.15.175:0/1022597922 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f536800ac30 con 0x7f53701601b0 2024-04-25T09:12:20.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.269+0000 7f536cc00640 1 --2- 172.21.15.175:0/1022597922 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f534c066f60 0x7f534c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.269+0000 7f536cc00640 1 -- 172.21.15.175:0/1022597922 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5368084480 con 0x7f53701601b0 2024-04-25T09:12:20.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.269+0000 7f536fe00640 1 --2- 172.21.15.175:0/1022597922 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f534c066f60 0x7f534c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.273+0000 7f536fe00640 1 --2- 172.21.15.175:0/1022597922 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f534c066f60 0x7f534c069420 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5370157c10 tx=0x7f5360008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:20.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.273+0000 7f536cc00640 1 -- 172.21.15.175:0/1022597922 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f53680550f0 con 0x7f53701601b0 2024-04-25T09:12:20.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.429+0000 7f5375400640 1 -- 172.21.15.175:0/1022597922 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53700b3ec0 con 0x7f53701601b0 2024-04-25T09:12:20.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.429+0000 7f536cc00640 1 -- 172.21.15.175:0/1022597922 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5368059190 con 0x7f53701601b0 2024-04-25T09:12:20.417 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:12:20.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.433+0000 7f5375400640 1 -- 172.21.15.175:0/1022597922 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f534c066f60 msgr2=0x7f534c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.433+0000 7f5375400640 1 --2- 172.21.15.175:0/1022597922 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f534c066f60 0x7f534c069420 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f5370157c10 tx=0x7f5360008040 comp rx=0 tx=0).stop 2024-04-25T09:12:20.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.433+0000 7f5375400640 1 -- 172.21.15.175:0/1022597922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53701601b0 msgr2=0x7f5370156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.433+0000 7f5375400640 1 --2- 172.21.15.175:0/1022597922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53701601b0 0x7f5370156190 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f536800c6d0 tx=0x7f536800cb90 comp rx=0 tx=0).stop 2024-04-25T09:12:20.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.433+0000 7f5375400640 1 -- 172.21.15.175:0/1022597922 shutdown_connections 2024-04-25T09:12:20.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.433+0000 7f5375400640 1 --2- 172.21.15.175:0/1022597922 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f534c066f60 0x7f534c069420 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.433+0000 7f5375400640 1 --2- 172.21.15.175:0/1022597922 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53701601b0 0x7f5370156190 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.433+0000 7f5375400640 1 --2- 172.21.15.175:0/1022597922 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f537015bcc0 0x7f53700b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.433+0000 7f5375400640 1 --2- 172.21.15.175:0/1022597922 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f537015b8e0 0x7f53700c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.433+0000 7f5375400640 1 -- 172.21.15.175:0/1022597922 >> 172.21.15.175:0/1022597922 conn(0x7f53700b3140 msgr2=0x7f537015e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:20.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.433+0000 7f5375400640 1 -- 172.21.15.175:0/1022597922 shutdown_connections 2024-04-25T09:12:20.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.433+0000 7f5375400640 1 -- 172.21.15.175:0/1022597922 wait complete. 2024-04-25T09:12:20.439 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:12:20.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.589+0000 7f6085e00640 1 Processor -- start 2024-04-25T09:12:20.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.589+0000 7f6085e00640 1 -- start start 2024-04-25T09:12:20.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.589+0000 7f6085e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f60800cd890 0x7f608009a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.589+0000 7f6085e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f608009ab50 0x7f6080099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.589+0000 7f6085e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60800cf740 con 0x7f6080099f90 2024-04-25T09:12:20.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.589+0000 7f6085e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608006c6e0 con 0x7f60800cd890 2024-04-25T09:12:20.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.589+0000 7f6085e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608006c9c0 con 0x7f608009ab50 2024-04-25T09:12:20.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.589+0000 7f6084a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f60800cd890 0x7f608009a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.589+0000 7f607fe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f608009ab50 0x7f6080099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.589+0000 7f6084a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f60800cd890 0x7f608009a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:59012/0 (socket says 172.21.15.175:59012) 2024-04-25T09:12:20.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.589+0000 7f6084a00640 1 -- 172.21.15.175:0/1523002031 learned_addr learned my addr 172.21.15.175:0/1523002031 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:20.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.589+0000 7f6085400640 1 --1- 172.21.15.175:0/1523002031 >> v1:172.21.15.177:6789/0 conn(0x7f6080099f90 0x7f60801618b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:43570/0 (socket says 172.21.15.175:43570) 2024-04-25T09:12:20.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.589+0000 7f607fe00640 1 -- 172.21.15.175:0/1523002031 >> v2:172.21.15.177:3300/0 conn(0x7f60800cd890 msgr2=0x7f608009a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:20.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.589+0000 7f607fe00640 1 --2- 172.21.15.175:0/1523002031 >> v2:172.21.15.177:3300/0 conn(0x7f60800cd890 0x7f608009a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.589+0000 7f607fe00640 1 -- 172.21.15.175:0/1523002031 >> v1:172.21.15.177:6789/0 conn(0x7f6080099f90 legacy=0x7f60801618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.589+0000 7f607fe00640 1 -- 172.21.15.175:0/1523002031 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608006cca0 con 0x7f608009ab50 2024-04-25T09:12:20.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.593+0000 7f607fe00640 1 --2- 172.21.15.175:0/1523002031 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f608009ab50 0x7f6080099a50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f606c0097c0 tx=0x7f606c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd4fce852fc32488 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:20.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.593+0000 7f607f400640 1 -- 172.21.15.175:0/1523002031 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c0b0070 con 0x7f608009ab50 2024-04-25T09:12:20.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.593+0000 7f607f400640 1 -- 172.21.15.175:0/1523002031 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c0a4e50 con 0x7f608009ab50 2024-04-25T09:12:20.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.593+0000 7f607f400640 1 -- 172.21.15.175:0/1523002031 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c0ab820 con 0x7f608009ab50 2024-04-25T09:12:20.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.593+0000 7f6085e00640 1 -- 172.21.15.175:0/1523002031 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f608009ab50 msgr2=0x7f6080099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.593+0000 7f6085e00640 1 --2- 172.21.15.175:0/1523002031 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f608009ab50 0x7f6080099a50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f606c0097c0 tx=0x7f606c01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.593+0000 7f6085e00640 1 -- 172.21.15.175:0/1523002031 shutdown_connections 2024-04-25T09:12:20.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.593+0000 7f6085e00640 1 --2- 172.21.15.175:0/1523002031 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f608009ab50 0x7f6080099a50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.593+0000 7f6085e00640 1 --2- 172.21.15.175:0/1523002031 >> v2:172.21.15.177:3300/0 conn(0x7f60800cd890 0x7f608009a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.593+0000 7f6085e00640 1 -- 172.21.15.175:0/1523002031 >> 172.21.15.175:0/1523002031 conn(0x7f60800b31b0 msgr2=0x7f60800b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:20.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.593+0000 7f6085e00640 1 -- 172.21.15.175:0/1523002031 shutdown_connections 2024-04-25T09:12:20.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.593+0000 7f6085e00640 1 -- 172.21.15.175:0/1523002031 wait complete. 2024-04-25T09:12:20.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f6085e00640 1 Processor -- start 2024-04-25T09:12:20.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f6085e00640 1 -- start start 2024-04-25T09:12:20.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f6085e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6080099f90 0x7f6080159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f6085e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f608009ab50 0x7f60800b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f6085e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60800cd890 0x7f60800b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f6085e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60800ccd20 con 0x7f608009ab50 2024-04-25T09:12:20.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f6085e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608006d780 con 0x7f60800cd890 2024-04-25T09:12:20.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f6085e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608016abf0 con 0x7f6080099f90 2024-04-25T09:12:20.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f607fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f608009ab50 0x7f60800b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f607fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f608009ab50 0x7f60800b6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41242/0 (socket says 172.21.15.175:41242) 2024-04-25T09:12:20.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f607fe00640 1 -- 172.21.15.175:0/1774324741 learned_addr learned my addr 172.21.15.175:0/1774324741 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:20.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f6084a00640 1 --2- 172.21.15.175:0/1774324741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6080099f90 0x7f6080159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f6085400640 1 --2- 172.21.15.175:0/1774324741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60800cd890 0x7f60800b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f607fe00640 1 -- 172.21.15.175:0/1774324741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6080099f90 msgr2=0x7f6080159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f607fe00640 1 --2- 172.21.15.175:0/1774324741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6080099f90 0x7f6080159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f607fe00640 1 -- 172.21.15.175:0/1774324741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60800cd890 msgr2=0x7f60800b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f607fe00640 1 --2- 172.21.15.175:0/1774324741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60800cd890 0x7f60800b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f607fe00640 1 -- 172.21.15.175:0/1774324741 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60800c6870 con 0x7f608009ab50 2024-04-25T09:12:20.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f607fe00640 1 --2- 172.21.15.175:0/1774324741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f608009ab50 0x7f60800b6580 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f606c01a0d0 tx=0x7f606c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:20.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f607cc00640 1 -- 172.21.15.175:0/1774324741 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c0b0040 con 0x7f608009ab50 2024-04-25T09:12:20.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f607cc00640 1 -- 172.21.15.175:0/1774324741 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c0b9070 con 0x7f608009ab50 2024-04-25T09:12:20.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f6085e00640 1 -- 172.21.15.175:0/1774324741 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608015a4e0 con 0x7f608009ab50 2024-04-25T09:12:20.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f607cc00640 1 -- 172.21.15.175:0/1774324741 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c0b4870 con 0x7f608009ab50 2024-04-25T09:12:20.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f6085e00640 1 -- 172.21.15.175:0/1774324741 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608015eb50 con 0x7f608009ab50 2024-04-25T09:12:20.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.597+0000 7f6085e00640 1 -- 172.21.15.175:0/1774324741 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6080074a60 con 0x7f608009ab50 2024-04-25T09:12:20.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.601+0000 7f607cc00640 1 -- 172.21.15.175:0/1774324741 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f606c0b4a10 con 0x7f608009ab50 2024-04-25T09:12:20.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.601+0000 7f607cc00640 1 --2- 172.21.15.175:0/1774324741 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6060066f60 0x7f6060069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.601+0000 7f607cc00640 1 -- 172.21.15.175:0/1774324741 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f606c11eb30 con 0x7f608009ab50 2024-04-25T09:12:20.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.601+0000 7f6084a00640 1 --2- 172.21.15.175:0/1774324741 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6060066f60 0x7f6060069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.601+0000 7f6084a00640 1 --2- 172.21.15.175:0/1774324741 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6060066f60 0x7f6060069420 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f60801613b0 tx=0x7f6074009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:20.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.605+0000 7f607cc00640 1 -- 172.21.15.175:0/1774324741 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f60800c6870 con 0x7f608009ab50 2024-04-25T09:12:20.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.761+0000 7f6085e00640 1 -- 172.21.15.175:0/1774324741 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f608006da70 con 0x7f608009ab50 2024-04-25T09:12:20.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.761+0000 7f607cc00640 1 -- 172.21.15.175:0/1774324741 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v96) v1 ==== 84+0+65 (secure 0 0 0) 0x7f606c016090 con 0x7f608009ab50 2024-04-25T09:12:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:20.749 INFO:teuthology.orchestra.run.smithi175.stdout:[ 2024-04-25T09:12:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:12:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: "poolnum": 1, 2024-04-25T09:12:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: "poolname": ".mgr" 2024-04-25T09:12:20.749 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:20.749 INFO:teuthology.orchestra.run.smithi175.stdout:] 2024-04-25T09:12:20.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.765+0000 7f6085e00640 1 -- 172.21.15.175:0/1774324741 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6060066f60 msgr2=0x7f6060069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.765+0000 7f6085e00640 1 --2- 172.21.15.175:0/1774324741 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6060066f60 0x7f6060069420 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f60801613b0 tx=0x7f6074009240 comp rx=0 tx=0).stop 2024-04-25T09:12:20.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.765+0000 7f6085e00640 1 -- 172.21.15.175:0/1774324741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f608009ab50 msgr2=0x7f60800b6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.765+0000 7f6085e00640 1 --2- 172.21.15.175:0/1774324741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f608009ab50 0x7f60800b6580 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f606c01a0d0 tx=0x7f606c019240 comp rx=0 tx=0).stop 2024-04-25T09:12:20.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.765+0000 7f6085e00640 1 -- 172.21.15.175:0/1774324741 shutdown_connections 2024-04-25T09:12:20.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.765+0000 7f6085e00640 1 --2- 172.21.15.175:0/1774324741 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6060066f60 0x7f6060069420 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.765+0000 7f6085e00640 1 --2- 172.21.15.175:0/1774324741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f60800cd890 0x7f60800b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.765+0000 7f6085e00640 1 --2- 172.21.15.175:0/1774324741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f608009ab50 0x7f60800b6580 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.765+0000 7f6085e00640 1 --2- 172.21.15.175:0/1774324741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6080099f90 0x7f6080159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.765+0000 7f6085e00640 1 -- 172.21.15.175:0/1774324741 >> 172.21.15.175:0/1774324741 conn(0x7f60800b31b0 msgr2=0x7f60800ce140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:20.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.765+0000 7f6085e00640 1 -- 172.21.15.175:0/1774324741 shutdown_connections 2024-04-25T09:12:20.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.765+0000 7f6085e00640 1 -- 172.21.15.175:0/1774324741 wait complete. 2024-04-25T09:12:20.770 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:12:20.770 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:12:20.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.921+0000 7f0911800640 1 Processor -- start 2024-04-25T09:12:20.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.921+0000 7f0911800640 1 -- start start 2024-04-25T09:12:20.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.925+0000 7f0911800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f090c0cdb40 0x7f090c0cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.925+0000 7f0911800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f090c1656f0 0x7f090c167ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.925+0000 7f0911800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f090c15dfa0 con 0x7f090c06bb20 2024-04-25T09:12:20.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.925+0000 7f0911800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090c0ce460 con 0x7f090c0cdb40 2024-04-25T09:12:20.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.925+0000 7f0911800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090c06dc60 con 0x7f090c1656f0 2024-04-25T09:12:20.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.925+0000 7f090aa00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f090c0cdb40 0x7f090c0cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.925+0000 7f090aa00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f090c0cdb40 0x7f090c0cdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41256/0 (socket says 172.21.15.175:41256) 2024-04-25T09:12:20.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.925+0000 7f090aa00640 1 -- 172.21.15.175:0/1044765402 learned_addr learned my addr 172.21.15.175:0/1044765402 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:20.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.925+0000 7f090b400640 1 --2- 172.21.15.175:0/1044765402 >> v2:172.21.15.177:3300/0 conn(0x7f090c1656f0 0x7f090c167ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.925+0000 7f090aa00640 1 -- 172.21.15.175:0/1044765402 >> v2:172.21.15.177:3300/0 conn(0x7f090c1656f0 msgr2=0x7f090c167ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:20.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.925+0000 7f090aa00640 1 --2- 172.21.15.175:0/1044765402 >> v2:172.21.15.177:3300/0 conn(0x7f090c1656f0 0x7f090c167ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.925+0000 7f090aa00640 1 -- 172.21.15.175:0/1044765402 >> v1:172.21.15.177:6789/0 conn(0x7f090c06bb20 legacy=0x7f090c06bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:20.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.925+0000 7f090aa00640 1 -- 172.21.15.175:0/1044765402 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c06df40 con 0x7f090c0cdb40 2024-04-25T09:12:20.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.925+0000 7f090b400640 1 --2- 172.21.15.175:0/1044765402 >> v2:172.21.15.177:3300/0 conn(0x7f090c1656f0 0x7f090c167ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:20.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.929+0000 7f090aa00640 1 --2- 172.21.15.175:0/1044765402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f090c0cdb40 0x7f090c0cdf20 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f090c067240 tx=0x7f08fc01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f902956451113c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:20.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.929+0000 7f090a000640 1 -- 172.21.15.175:0/1044765402 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc0b0070 con 0x7f090c0cdb40 2024-04-25T09:12:20.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.929+0000 7f090a000640 1 -- 172.21.15.175:0/1044765402 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08fc0ab600 con 0x7f090c0cdb40 2024-04-25T09:12:20.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.929+0000 7f090a000640 1 -- 172.21.15.175:0/1044765402 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc0ab9d0 con 0x7f090c0cdb40 2024-04-25T09:12:20.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.929+0000 7f0911800640 1 -- 172.21.15.175:0/1044765402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f090c0cdb40 msgr2=0x7f090c0cdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.929+0000 7f0911800640 1 --2- 172.21.15.175:0/1044765402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f090c0cdb40 0x7f090c0cdf20 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f090c067240 tx=0x7f08fc01c4e0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.929+0000 7f0911800640 1 -- 172.21.15.175:0/1044765402 shutdown_connections 2024-04-25T09:12:20.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.929+0000 7f0911800640 1 --2- 172.21.15.175:0/1044765402 >> v2:172.21.15.177:3300/0 conn(0x7f090c1656f0 0x7f090c167ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.929+0000 7f0911800640 1 --2- 172.21.15.175:0/1044765402 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f090c0cdb40 0x7f090c0cdf20 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.929+0000 7f0911800640 1 -- 172.21.15.175:0/1044765402 >> 172.21.15.175:0/1044765402 conn(0x7f090c0cc9f0 msgr2=0x7f090c0cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:20.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.929+0000 7f0911800640 1 -- 172.21.15.175:0/1044765402 shutdown_connections 2024-04-25T09:12:20.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.929+0000 7f0911800640 1 -- 172.21.15.175:0/1044765402 wait complete. 2024-04-25T09:12:20.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.929+0000 7f0911800640 1 Processor -- start 2024-04-25T09:12:20.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.929+0000 7f0911800640 1 -- start start 2024-04-25T09:12:20.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.929+0000 7f0911800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f090c06bb20 0x7f090c1566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.929+0000 7f0911800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f090c0cdb40 0x7f090c0c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.929+0000 7f0911800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f090c1656f0 0x7f090c0adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.929+0000 7f0911800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c147570 con 0x7f090c1656f0 2024-04-25T09:12:20.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f0911800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c0ace00 con 0x7f090c06bb20 2024-04-25T09:12:20.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f0911800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090c1476f0 con 0x7f090c0cdb40 2024-04-25T09:12:20.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f090b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f090c1656f0 0x7f090c0adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f090b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f090c1656f0 0x7f090c0adfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41272/0 (socket says 172.21.15.175:41272) 2024-04-25T09:12:20.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f090b400640 1 -- 172.21.15.175:0/3570838987 learned_addr learned my addr 172.21.15.175:0/3570838987 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:20.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f0902000640 1 --2- 172.21.15.175:0/3570838987 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f090c0cdb40 0x7f090c0c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f090aa00640 1 --2- 172.21.15.175:0/3570838987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f090c06bb20 0x7f090c1566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f090b400640 1 -- 172.21.15.175:0/3570838987 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f090c0cdb40 msgr2=0x7f090c0c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f090b400640 1 --2- 172.21.15.175:0/3570838987 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f090c0cdb40 0x7f090c0c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f090b400640 1 -- 172.21.15.175:0/3570838987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f090c06bb20 msgr2=0x7f090c1566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:20.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f090b400640 1 --2- 172.21.15.175:0/3570838987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f090c06bb20 0x7f090c1566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:20.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f090b400640 1 -- 172.21.15.175:0/3570838987 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c159ce0 con 0x7f090c1656f0 2024-04-25T09:12:20.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f090b400640 1 --2- 172.21.15.175:0/3570838987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f090c1656f0 0x7f090c0adfd0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f090400cf20 tx=0x7f090400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:20.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f0903400640 1 -- 172.21.15.175:0/3570838987 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090401a070 con 0x7f090c1656f0 2024-04-25T09:12:20.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f0903400640 1 -- 172.21.15.175:0/3570838987 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090400d840 con 0x7f090c1656f0 2024-04-25T09:12:20.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f0903400640 1 -- 172.21.15.175:0/3570838987 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090400dc30 con 0x7f090c1656f0 2024-04-25T09:12:20.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f0911800640 1 -- 172.21.15.175:0/3570838987 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090c0b2db0 con 0x7f090c1656f0 2024-04-25T09:12:20.922 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f0911800640 1 -- 172.21.15.175:0/3570838987 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090c0b3370 con 0x7f090c1656f0 2024-04-25T09:12:20.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f0911800640 1 -- 172.21.15.175:0/3570838987 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090c0b3570 con 0x7f090c1656f0 2024-04-25T09:12:20.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f0903400640 1 -- 172.21.15.175:0/3570838987 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f090401d070 con 0x7f090c1656f0 2024-04-25T09:12:20.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.933+0000 7f0903400640 1 --2- 172.21.15.175:0/3570838987 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f08e8066f60 0x7f08e8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:20.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.937+0000 7f0903400640 1 -- 172.21.15.175:0/3570838987 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f09040853e0 con 0x7f090c1656f0 2024-04-25T09:12:20.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.937+0000 7f090aa00640 1 --2- 172.21.15.175:0/3570838987 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f08e8066f60 0x7f08e8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:20.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.937+0000 7f090aa00640 1 --2- 172.21.15.175:0/3570838987 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f08e8066f60 0x7f08e8069420 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0ad000 tx=0x7f08fc0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:20.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:20.937+0000 7f0903400640 1 -- 172.21.15.175:0/3570838987 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f090c0b3570 con 0x7f090c1656f0 2024-04-25T09:12:21.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:21.093+0000 7f0911800640 1 -- 172.21.15.175:0/3570838987 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f090c075160 con 0x7f090c1656f0 2024-04-25T09:12:22.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.025+0000 7f0903400640 1 -- 172.21.15.175:0/3570838987 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v97) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0904056890 con 0x7f090c1656f0 2024-04-25T09:12:22.013 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_metadata' created 2024-04-25T09:12:22.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.029+0000 7f0911800640 1 -- 172.21.15.175:0/3570838987 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f08e8066f60 msgr2=0x7f08e8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.029+0000 7f0911800640 1 --2- 172.21.15.175:0/3570838987 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f08e8066f60 0x7f08e8069420 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0ad000 tx=0x7f08fc0a6000 comp rx=0 tx=0).stop 2024-04-25T09:12:22.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.029+0000 7f0911800640 1 -- 172.21.15.175:0/3570838987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f090c1656f0 msgr2=0x7f090c0adfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.029+0000 7f0911800640 1 --2- 172.21.15.175:0/3570838987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f090c1656f0 0x7f090c0adfd0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f090400cf20 tx=0x7f090400a7d0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.029+0000 7f0911800640 1 -- 172.21.15.175:0/3570838987 shutdown_connections 2024-04-25T09:12:22.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.029+0000 7f0911800640 1 --2- 172.21.15.175:0/3570838987 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f08e8066f60 0x7f08e8069420 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.029+0000 7f0911800640 1 --2- 172.21.15.175:0/3570838987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f090c1656f0 0x7f090c0adfd0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.029+0000 7f0911800640 1 --2- 172.21.15.175:0/3570838987 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f090c0cdb40 0x7f090c0c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.029+0000 7f0911800640 1 --2- 172.21.15.175:0/3570838987 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f090c06bb20 0x7f090c1566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.029+0000 7f0911800640 1 -- 172.21.15.175:0/3570838987 >> 172.21.15.175:0/3570838987 conn(0x7f090c0cc9f0 msgr2=0x7f090c1664d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:22.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.029+0000 7f0911800640 1 -- 172.21.15.175:0/3570838987 shutdown_connections 2024-04-25T09:12:22.017 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.029+0000 7f0911800640 1 -- 172.21.15.175:0/3570838987 wait complete. 2024-04-25T09:12:22.044 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:12:22.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.201+0000 7f08f1800640 1 Processor -- start 2024-04-25T09:12:22.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.205+0000 7f08f1800640 1 -- start start 2024-04-25T09:12:22.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.205+0000 7f08f1800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f08ec0b4710 0x7f08ec15ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.205+0000 7f08f1800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f08ec0ae9c0 0x7f08ec0cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.205+0000 7f08f1800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08ec0b3660 con 0x7f08ec15de90 2024-04-25T09:12:22.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.205+0000 7f08f1800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ec0b28a0 con 0x7f08ec0b4710 2024-04-25T09:12:22.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.205+0000 7f08f1800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ec0b2b80 con 0x7f08ec0ae9c0 2024-04-25T09:12:22.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.205+0000 7f08eaa00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f08ec15de90 0x7f08ec0b4000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:34366/0 (socket says 172.21.15.175:34366) 2024-04-25T09:12:22.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.205+0000 7f08eaa00640 1 -- 172.21.15.175:0/3643567686 learned_addr learned my addr 172.21.15.175:0/3643567686 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:22.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.205+0000 7f08ea000640 1 --2- 172.21.15.175:0/3643567686 >> v2:172.21.15.175:3300/0 conn(0x7f08ec0b4710 0x7f08ec15ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.205+0000 7f08eb400640 1 --2- 172.21.15.175:0/3643567686 >> v2:172.21.15.177:3300/0 conn(0x7f08ec0ae9c0 0x7f08ec0cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.205+0000 7f08e9600640 1 -- 172.21.15.175:0/3643567686 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167024267 0 0) 0x7f08ec0b3660 con 0x7f08ec15de90 2024-04-25T09:12:22.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.205+0000 7f08e9600640 1 -- 172.21.15.175:0/3643567686 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08d0005740 con 0x7f08ec15de90 2024-04-25T09:12:22.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.205+0000 7f08ea000640 1 -- 172.21.15.175:0/3643567686 >> v2:172.21.15.177:3300/0 conn(0x7f08ec0ae9c0 msgr2=0x7f08ec0cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:22.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.205+0000 7f08ea000640 1 --2- 172.21.15.175:0/3643567686 >> v2:172.21.15.177:3300/0 conn(0x7f08ec0ae9c0 0x7f08ec0cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.205+0000 7f08ea000640 1 -- 172.21.15.175:0/3643567686 >> v1:172.21.15.175:6789/0 conn(0x7f08ec15de90 legacy=0x7f08ec0b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.205+0000 7f08ea000640 1 -- 172.21.15.175:0/3643567686 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ec0b2e60 con 0x7f08ec0b4710 2024-04-25T09:12:22.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.209+0000 7f08ea000640 1 --2- 172.21.15.175:0/3643567686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08ec0b4710 0x7f08ec15ee20 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f08ec06eaf0 tx=0x7f08d401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35275b30010aa5b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:22.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.209+0000 7f08e9600640 1 -- 172.21.15.175:0/3643567686 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d40b0070 con 0x7f08ec0b4710 2024-04-25T09:12:22.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.209+0000 7f08e9600640 1 -- 172.21.15.175:0/3643567686 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d40ab600 con 0x7f08ec0b4710 2024-04-25T09:12:22.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.209+0000 7f08e9600640 1 -- 172.21.15.175:0/3643567686 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d40ab9d0 con 0x7f08ec0b4710 2024-04-25T09:12:22.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.209+0000 7f08f1800640 1 -- 172.21.15.175:0/3643567686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08ec0b4710 msgr2=0x7f08ec15ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.209+0000 7f08f1800640 1 --2- 172.21.15.175:0/3643567686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08ec0b4710 0x7f08ec15ee20 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f08ec06eaf0 tx=0x7f08d401c3f0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.209+0000 7f08f1800640 1 -- 172.21.15.175:0/3643567686 shutdown_connections 2024-04-25T09:12:22.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.209+0000 7f08f1800640 1 --2- 172.21.15.175:0/3643567686 >> v2:172.21.15.177:3300/0 conn(0x7f08ec0ae9c0 0x7f08ec0cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.209+0000 7f08f1800640 1 --2- 172.21.15.175:0/3643567686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08ec0b4710 0x7f08ec15ee20 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.209+0000 7f08f1800640 1 -- 172.21.15.175:0/3643567686 >> 172.21.15.175:0/3643567686 conn(0x7f08ec06ac50 msgr2=0x7f08ec06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:22.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.209+0000 7f08f1800640 1 -- 172.21.15.175:0/3643567686 shutdown_connections 2024-04-25T09:12:22.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.209+0000 7f08f1800640 1 -- 172.21.15.175:0/3643567686 wait complete. 2024-04-25T09:12:22.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.209+0000 7f08f1800640 1 Processor -- start 2024-04-25T09:12:22.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.209+0000 7f08f1800640 1 -- start start 2024-04-25T09:12:22.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08f1800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08ec0ae9c0 0x7f08ec14b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08f1800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08ec15de90 0x7f08ec159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08f1800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08ec0ad5b0 0x7f08ec15c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08f1800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec0ce810 con 0x7f08ec0ad5b0 2024-04-25T09:12:22.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08f1800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec0ce690 con 0x7f08ec15de90 2024-04-25T09:12:22.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08f1800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec0712b0 con 0x7f08ec0ae9c0 2024-04-25T09:12:22.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08eb400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08ec0ad5b0 0x7f08ec15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08eb400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08ec0ad5b0 0x7f08ec15c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41292/0 (socket says 172.21.15.175:41292) 2024-04-25T09:12:22.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08eb400640 1 -- 172.21.15.175:0/3857242112 learned_addr learned my addr 172.21.15.175:0/3857242112 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:22.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08eaa00640 1 --2- 172.21.15.175:0/3857242112 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08ec0ae9c0 0x7f08ec14b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08ea000640 1 --2- 172.21.15.175:0/3857242112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08ec15de90 0x7f08ec159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08eb400640 1 -- 172.21.15.175:0/3857242112 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08ec0ae9c0 msgr2=0x7f08ec14b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08eb400640 1 --2- 172.21.15.175:0/3857242112 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08ec0ae9c0 0x7f08ec14b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08eb400640 1 -- 172.21.15.175:0/3857242112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08ec15de90 msgr2=0x7f08ec159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:22.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08eb400640 1 --2- 172.21.15.175:0/3857242112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08ec15de90 0x7f08ec159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:22.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08eb400640 1 -- 172.21.15.175:0/3857242112 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ec0aee90 con 0x7f08ec0ad5b0 2024-04-25T09:12:22.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08eb400640 1 --2- 172.21.15.175:0/3857242112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08ec0ad5b0 0x7f08ec15c610 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f08e400efc0 tx=0x7f08e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:22.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08e2a00640 1 -- 172.21.15.175:0/3857242112 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e4018020 con 0x7f08ec0ad5b0 2024-04-25T09:12:22.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08e2a00640 1 -- 172.21.15.175:0/3857242112 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e4014480 con 0x7f08ec0ad5b0 2024-04-25T09:12:22.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08e2a00640 1 -- 172.21.15.175:0/3857242112 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e4014870 con 0x7f08ec0ad5b0 2024-04-25T09:12:22.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08f1800640 1 -- 172.21.15.175:0/3857242112 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ec0cf180 con 0x7f08ec0ad5b0 2024-04-25T09:12:22.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08f1800640 1 -- 172.21.15.175:0/3857242112 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ec1582f0 con 0x7f08ec0ad5b0 2024-04-25T09:12:22.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.213+0000 7f08f1800640 1 -- 172.21.15.175:0/3857242112 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ec074a60 con 0x7f08ec0ad5b0 2024-04-25T09:12:22.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.217+0000 7f08e2a00640 1 -- 172.21.15.175:0/3857242112 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f08e401b020 con 0x7f08ec0ad5b0 2024-04-25T09:12:22.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.217+0000 7f08e2a00640 1 --2- 172.21.15.175:0/3857242112 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f08c8066f60 0x7f08c8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:22.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.217+0000 7f08e2a00640 1 -- 172.21.15.175:0/3857242112 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f08e40857c0 con 0x7f08ec0ad5b0 2024-04-25T09:12:22.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.217+0000 7f08eaa00640 1 --2- 172.21.15.175:0/3857242112 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f08c8066f60 0x7f08c8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:22.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.217+0000 7f08eaa00640 1 --2- 172.21.15.175:0/3857242112 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f08c8066f60 0x7f08c8069420 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f08dc007fd0 tx=0x7f08dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:22.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.221+0000 7f08e2a00640 1 -- 172.21.15.175:0/3857242112 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f08e4022070 con 0x7f08ec0ad5b0 2024-04-25T09:12:22.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:22.377+0000 7f08f1800640 1 -- 172.21.15.175:0/3857242112 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f08ec06e6a0 con 0x7f08ec0ad5b0 2024-04-25T09:12:23.016 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.029+0000 7f08e2a00640 1 -- 172.21.15.175:0/3857242112 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v98) v1 ==== 170+0+0 (secure 0 0 0) 0x7f08e4010040 con 0x7f08ec0ad5b0 2024-04-25T09:12:23.016 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_data' created 2024-04-25T09:12:23.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.033+0000 7f08f1800640 1 -- 172.21.15.175:0/3857242112 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f08c8066f60 msgr2=0x7f08c8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:23.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.033+0000 7f08f1800640 1 --2- 172.21.15.175:0/3857242112 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f08c8066f60 0x7f08c8069420 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f08dc007fd0 tx=0x7f08dc009040 comp rx=0 tx=0).stop 2024-04-25T09:12:23.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.033+0000 7f08f1800640 1 -- 172.21.15.175:0/3857242112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08ec0ad5b0 msgr2=0x7f08ec15c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:23.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.033+0000 7f08f1800640 1 --2- 172.21.15.175:0/3857242112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08ec0ad5b0 0x7f08ec15c610 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f08e400efc0 tx=0x7f08e400c490 comp rx=0 tx=0).stop 2024-04-25T09:12:23.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.033+0000 7f08f1800640 1 -- 172.21.15.175:0/3857242112 shutdown_connections 2024-04-25T09:12:23.018 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.033+0000 7f08f1800640 1 --2- 172.21.15.175:0/3857242112 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f08c8066f60 0x7f08c8069420 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:23.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.033+0000 7f08f1800640 1 --2- 172.21.15.175:0/3857242112 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08ec0ad5b0 0x7f08ec15c610 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:23.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.033+0000 7f08f1800640 1 --2- 172.21.15.175:0/3857242112 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f08ec15de90 0x7f08ec159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:23.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.033+0000 7f08f1800640 1 --2- 172.21.15.175:0/3857242112 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f08ec0ae9c0 0x7f08ec14b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:23.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.033+0000 7f08f1800640 1 -- 172.21.15.175:0/3857242112 >> 172.21.15.175:0/3857242112 conn(0x7f08ec06ac50 msgr2=0x7f08ec15e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:23.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.033+0000 7f08f1800640 1 -- 172.21.15.175:0/3857242112 shutdown_connections 2024-04-25T09:12:23.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.033+0000 7f08f1800640 1 -- 172.21.15.175:0/3857242112 wait complete. 2024-04-25T09:12:23.057 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:12:23.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.209+0000 7f41ab200640 1 Processor -- start 2024-04-25T09:12:23.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.209+0000 7f41ab200640 1 -- start start 2024-04-25T09:12:23.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.209+0000 7f41ab200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41a40cf6b0 0x7f41a41600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:23.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.209+0000 7f41ab200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f41a40ce970 0x7f41a40cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:23.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.209+0000 7f41ab200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a40cfd10 con 0x7f41a4145250 2024-04-25T09:12:23.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.209+0000 7f41ab200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a41605e0 con 0x7f41a40cf6b0 2024-04-25T09:12:23.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.209+0000 7f41ab200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a415f650 con 0x7f41a40ce970 2024-04-25T09:12:23.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.209+0000 7f419b400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41a40cf6b0 0x7f41a41600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:23.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.209+0000 7f419b400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41a40cf6b0 0x7f41a41600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41296/0 (socket says 172.21.15.175:41296) 2024-04-25T09:12:23.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.209+0000 7f419b400640 1 -- 172.21.15.175:0/2178351346 learned_addr learned my addr 172.21.15.175:0/2178351346 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:23.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.209+0000 7f41a9200640 1 --2- 172.21.15.175:0/2178351346 >> v2:172.21.15.177:3300/0 conn(0x7f41a40ce970 0x7f41a40cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:23.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.209+0000 7f419b400640 1 -- 172.21.15.175:0/2178351346 >> v2:172.21.15.177:3300/0 conn(0x7f41a40ce970 msgr2=0x7f41a40cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:23.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.209+0000 7f419b400640 1 --2- 172.21.15.175:0/2178351346 >> v2:172.21.15.177:3300/0 conn(0x7f41a40ce970 0x7f41a40cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:23.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.209+0000 7f419b400640 1 -- 172.21.15.175:0/2178351346 >> v1:172.21.15.177:6789/0 conn(0x7f41a4145250 legacy=0x7f41a40cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:23.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.209+0000 7f419b400640 1 -- 172.21.15.175:0/2178351346 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a40cfff0 con 0x7f41a40cf6b0 2024-04-25T09:12:23.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.213+0000 7f419b400640 1 --2- 172.21.15.175:0/2178351346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a40cf6b0 0x7f41a41600a0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f418c009870 tx=0x7f418c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e293f8c337152a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:23.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.213+0000 7f41a3400640 1 -- 172.21.15.175:0/2178351346 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c0b2070 con 0x7f41a40cf6b0 2024-04-25T09:12:23.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.213+0000 7f41a3400640 1 -- 172.21.15.175:0/2178351346 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c0ad680 con 0x7f41a40cf6b0 2024-04-25T09:12:23.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.213+0000 7f41a3400640 1 -- 172.21.15.175:0/2178351346 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c0ada50 con 0x7f41a40cf6b0 2024-04-25T09:12:23.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.213+0000 7f41ab200640 1 -- 172.21.15.175:0/2178351346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a40cf6b0 msgr2=0x7f41a41600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:23.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.213+0000 7f41ab200640 1 --2- 172.21.15.175:0/2178351346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a40cf6b0 0x7f41a41600a0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f418c009870 tx=0x7f418c01c490 comp rx=0 tx=0).stop 2024-04-25T09:12:23.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.213+0000 7f41ab200640 1 -- 172.21.15.175:0/2178351346 shutdown_connections 2024-04-25T09:12:23.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.213+0000 7f41ab200640 1 --2- 172.21.15.175:0/2178351346 >> v2:172.21.15.177:3300/0 conn(0x7f41a40ce970 0x7f41a40cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:23.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.213+0000 7f41ab200640 1 --2- 172.21.15.175:0/2178351346 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a40cf6b0 0x7f41a41600a0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:23.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.213+0000 7f41ab200640 1 -- 172.21.15.175:0/2178351346 >> 172.21.15.175:0/2178351346 conn(0x7f41a406ac50 msgr2=0x7f41a406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:23.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.213+0000 7f41ab200640 1 -- 172.21.15.175:0/2178351346 shutdown_connections 2024-04-25T09:12:23.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.213+0000 7f41ab200640 1 -- 172.21.15.175:0/2178351346 wait complete. 2024-04-25T09:12:23.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41ab200640 1 Processor -- start 2024-04-25T09:12:23.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41ab200640 1 -- start start 2024-04-25T09:12:23.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41ab200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41a40ce970 0x7f41a4142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:23.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41ab200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41a40cf6b0 0x7f41a4143250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:23.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41ab200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a4145250 0x7f41a4141980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:23.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41ab200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a415c870 con 0x7f41a4145250 2024-04-25T09:12:23.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41ab200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a4145630 con 0x7f41a40ce970 2024-04-25T09:12:23.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41ab200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a415c9f0 con 0x7f41a40cf6b0 2024-04-25T09:12:23.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41a9200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a4145250 0x7f41a4141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:23.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41a9200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a4145250 0x7f41a4141980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41308/0 (socket says 172.21.15.175:41308) 2024-04-25T09:12:23.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41a9200640 1 -- 172.21.15.175:0/771112098 learned_addr learned my addr 172.21.15.175:0/771112098 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:23.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41a3e00640 1 --2- 172.21.15.175:0/771112098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41a40ce970 0x7f41a4142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:23.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f419b400640 1 --2- 172.21.15.175:0/771112098 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41a40cf6b0 0x7f41a4143250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:23.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41a9200640 1 -- 172.21.15.175:0/771112098 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41a40cf6b0 msgr2=0x7f41a4143250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:23.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41a9200640 1 --2- 172.21.15.175:0/771112098 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41a40cf6b0 0x7f41a4143250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:23.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41a9200640 1 -- 172.21.15.175:0/771112098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41a40ce970 msgr2=0x7f41a4142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:23.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41a9200640 1 --2- 172.21.15.175:0/771112098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41a40ce970 0x7f41a4142d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:23.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41a9200640 1 -- 172.21.15.175:0/771112098 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a4164930 con 0x7f41a4145250 2024-04-25T09:12:23.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41a3e00640 1 --2- 172.21.15.175:0/771112098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41a40ce970 0x7f41a4142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:23.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41a9200640 1 --2- 172.21.15.175:0/771112098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a4145250 0x7f41a4141980 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f419c00efc0 tx=0x7f419c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:23.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41a0c00640 1 -- 172.21.15.175:0/771112098 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c018020 con 0x7f41a4145250 2024-04-25T09:12:23.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41a0c00640 1 -- 172.21.15.175:0/771112098 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c014480 con 0x7f41a4145250 2024-04-25T09:12:23.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41ab200640 1 -- 172.21.15.175:0/771112098 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a4164c10 con 0x7f41a4145250 2024-04-25T09:12:23.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41a0c00640 1 -- 172.21.15.175:0/771112098 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c014870 con 0x7f41a4145250 2024-04-25T09:12:23.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41ab200640 1 -- 172.21.15.175:0/771112098 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a41651d0 con 0x7f41a4145250 2024-04-25T09:12:23.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.217+0000 7f41ab200640 1 -- 172.21.15.175:0/771112098 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a4075160 con 0x7f41a4145250 2024-04-25T09:12:23.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.221+0000 7f41a0c00640 1 -- 172.21.15.175:0/771112098 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f419c01b020 con 0x7f41a4145250 2024-04-25T09:12:23.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.221+0000 7f41a0c00640 1 --2- 172.21.15.175:0/771112098 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4180066f90 0x7f4180069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:23.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.221+0000 7f41a0c00640 1 -- 172.21.15.175:0/771112098 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f419c0860c0 con 0x7f41a4145250 2024-04-25T09:12:23.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.221+0000 7f41a3e00640 1 --2- 172.21.15.175:0/771112098 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4180066f90 0x7f4180069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:23.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.221+0000 7f41a3e00640 1 --2- 172.21.15.175:0/771112098 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4180066f90 0x7f4180069450 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f41a415e6f0 tx=0x7f4194009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:23.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.225+0000 7f41a0c00640 1 -- 172.21.15.175:0/771112098 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f419c022070 con 0x7f41a4145250 2024-04-25T09:12:23.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:23.413+0000 7f41ab200640 1 -- 172.21.15.175:0/771112098 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f41a40cc1f0 con 0x7f41a4145250 2024-04-25T09:12:24.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.061+0000 7f41a0c00640 1 -- 172.21.15.175:0/771112098 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v75) v1 ==== 174+0+0 (secure 0 0 0) 0x7f419c010040 con 0x7f41a4145250 2024-04-25T09:12:24.050 INFO:teuthology.orchestra.run.smithi175.stderr:new fs with metadata pool 14 and data pool 15 2024-04-25T09:12:24.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.069+0000 7f41ab200640 1 -- 172.21.15.175:0/771112098 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4180066f90 msgr2=0x7f4180069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.069+0000 7f41ab200640 1 --2- 172.21.15.175:0/771112098 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4180066f90 0x7f4180069450 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f41a415e6f0 tx=0x7f4194009040 comp rx=0 tx=0).stop 2024-04-25T09:12:24.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.069+0000 7f41ab200640 1 -- 172.21.15.175:0/771112098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a4145250 msgr2=0x7f41a4141980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.069+0000 7f41ab200640 1 --2- 172.21.15.175:0/771112098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a4145250 0x7f41a4141980 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f419c00efc0 tx=0x7f419c00c490 comp rx=0 tx=0).stop 2024-04-25T09:12:24.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.069+0000 7f41ab200640 1 -- 172.21.15.175:0/771112098 shutdown_connections 2024-04-25T09:12:24.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.069+0000 7f41ab200640 1 --2- 172.21.15.175:0/771112098 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4180066f90 0x7f4180069450 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.069+0000 7f41ab200640 1 --2- 172.21.15.175:0/771112098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a4145250 0x7f41a4141980 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.069+0000 7f41ab200640 1 --2- 172.21.15.175:0/771112098 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41a40cf6b0 0x7f41a4143250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.069+0000 7f41ab200640 1 --2- 172.21.15.175:0/771112098 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41a40ce970 0x7f41a4142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.069+0000 7f41ab200640 1 -- 172.21.15.175:0/771112098 >> 172.21.15.175:0/771112098 conn(0x7f41a406ac50 msgr2=0x7f41a40afbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:24.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.069+0000 7f41ab200640 1 -- 172.21.15.175:0/771112098 shutdown_connections 2024-04-25T09:12:24.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.073+0000 7f41ab200640 1 -- 172.21.15.175:0/771112098 wait complete. 2024-04-25T09:12:24.087 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:24.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.237+0000 7f172f800640 1 Processor -- start 2024-04-25T09:12:24.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.237+0000 7f172f800640 1 -- start start 2024-04-25T09:12:24.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.237+0000 7f172f800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f17281453a0 0x7f172815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.237+0000 7f172f800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172815c8a0 con 0x7f172815c410 2024-04-25T09:12:24.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.237+0000 7f172f800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172815cd00 con 0x7f1728144fc0 2024-04-25T09:12:24.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.237+0000 7f172f800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17280ce660 con 0x7f17281453a0 2024-04-25T09:12:24.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.237+0000 7f1727e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f17281453a0 0x7f172815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.237+0000 7f172d800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f172815c410 0x7f17280cee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:34376/0 (socket says 172.21.15.175:34376) 2024-04-25T09:12:24.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.237+0000 7f172d800640 1 -- 172.21.15.175:0/3266059318 learned_addr learned my addr 172.21.15.175:0/3266059318 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:24.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.237+0000 7f1727e00640 1 -- 172.21.15.175:0/3266059318 >> v1:172.21.15.177:6789/0 conn(0x7f1728144fc0 legacy=0x7f17280cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.237+0000 7f1727e00640 1 -- 172.21.15.175:0/3266059318 >> v1:172.21.15.175:6789/0 conn(0x7f172815c410 legacy=0x7f17280cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.237+0000 7f1727e00640 1 -- 172.21.15.175:0/3266059318 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17280cc930 con 0x7f17281453a0 2024-04-25T09:12:24.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.241+0000 7f1727e00640 1 --2- 172.21.15.175:0/3266059318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17281453a0 0x7f172815bed0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f17140097f0 tx=0x7f171401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e5f56ccf11748f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:24.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.241+0000 7f1727400640 1 -- 172.21.15.175:0/3266059318 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17140b1070 con 0x7f17281453a0 2024-04-25T09:12:24.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.241+0000 7f1727400640 1 -- 172.21.15.175:0/3266059318 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17140ac5f0 con 0x7f17281453a0 2024-04-25T09:12:24.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.241+0000 7f1727400640 1 -- 172.21.15.175:0/3266059318 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17140ac9c0 con 0x7f17281453a0 2024-04-25T09:12:24.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.241+0000 7f172f800640 1 -- 172.21.15.175:0/3266059318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17281453a0 msgr2=0x7f172815bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.241+0000 7f172f800640 1 --2- 172.21.15.175:0/3266059318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17281453a0 0x7f172815bed0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f17140097f0 tx=0x7f171401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.241+0000 7f172f800640 1 -- 172.21.15.175:0/3266059318 shutdown_connections 2024-04-25T09:12:24.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.241+0000 7f172f800640 1 --2- 172.21.15.175:0/3266059318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17281453a0 0x7f172815bed0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.241+0000 7f172f800640 1 -- 172.21.15.175:0/3266059318 >> 172.21.15.175:0/3266059318 conn(0x7f1728067150 msgr2=0x7f172806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:24.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.241+0000 7f172f800640 1 -- 172.21.15.175:0/3266059318 shutdown_connections 2024-04-25T09:12:24.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.241+0000 7f172f800640 1 -- 172.21.15.175:0/3266059318 wait complete. 2024-04-25T09:12:24.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172f800640 1 Processor -- start 2024-04-25T09:12:24.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172f800640 1 -- start start 2024-04-25T09:12:24.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172f800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17281453a0 0x7f172815b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172f800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f172815c410 0x7f17281358f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172f800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17280af1d0 0x7f1728136390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172f800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280cc580 con 0x7f17281453a0 2024-04-25T09:12:24.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172f800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17280cfd40 con 0x7f172815c410 2024-04-25T09:12:24.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172f800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17280af6d0 con 0x7f17280af1d0 2024-04-25T09:12:24.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17281453a0 0x7f172815b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17281453a0 0x7f172815b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41322/0 (socket says 172.21.15.175:41322) 2024-04-25T09:12:24.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172ce00640 1 -- 172.21.15.175:0/3893378388 learned_addr learned my addr 172.21.15.175:0/3893378388 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:24.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f1727e00640 1 --2- 172.21.15.175:0/3893378388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f172815c410 0x7f17281358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172d800640 1 --2- 172.21.15.175:0/3893378388 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17280af1d0 0x7f1728136390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172ce00640 1 -- 172.21.15.175:0/3893378388 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17280af1d0 msgr2=0x7f1728136390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172ce00640 1 --2- 172.21.15.175:0/3893378388 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17280af1d0 0x7f1728136390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172ce00640 1 -- 172.21.15.175:0/3893378388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f172815c410 msgr2=0x7f17281358f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172ce00640 1 --2- 172.21.15.175:0/3893378388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f172815c410 0x7f17281358f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172ce00640 1 -- 172.21.15.175:0/3893378388 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17280af9b0 con 0x7f17281453a0 2024-04-25T09:12:24.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172d800640 1 --2- 172.21.15.175:0/3893378388 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17280af1d0 0x7f1728136390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:24.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172ce00640 1 --2- 172.21.15.175:0/3893378388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17281453a0 0x7f172815b220 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f171800c7c0 tx=0x7f171800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:24.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f1724c00640 1 -- 172.21.15.175:0/3893378388 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718016020 con 0x7f17281453a0 2024-04-25T09:12:24.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f1724c00640 1 -- 172.21.15.175:0/3893378388 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1718006d60 con 0x7f17281453a0 2024-04-25T09:12:24.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f1724c00640 1 -- 172.21.15.175:0/3893378388 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718003bc0 con 0x7f17281453a0 2024-04-25T09:12:24.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172f800640 1 -- 172.21.15.175:0/3893378388 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17280afc90 con 0x7f17281453a0 2024-04-25T09:12:24.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172f800640 1 -- 172.21.15.175:0/3893378388 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17280b0250 con 0x7f17281453a0 2024-04-25T09:12:24.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.245+0000 7f172f800640 1 -- 172.21.15.175:0/3893378388 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1728074a60 con 0x7f17281453a0 2024-04-25T09:12:24.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.249+0000 7f1724c00640 1 -- 172.21.15.175:0/3893378388 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f171800a850 con 0x7f17281453a0 2024-04-25T09:12:24.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.249+0000 7f1724c00640 1 --2- 172.21.15.175:0/3893378388 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1708066f60 0x7f1708069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.249+0000 7f1724c00640 1 -- 172.21.15.175:0/3893378388 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1718084d30 con 0x7f17281453a0 2024-04-25T09:12:24.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.249+0000 7f1727e00640 1 --2- 172.21.15.175:0/3893378388 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1708066f60 0x7f1708069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.249+0000 7f1727e00640 1 --2- 172.21.15.175:0/3893378388 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1708066f60 0x7f1708069420 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f17140ae000 tx=0x7f1714008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:24.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.253+0000 7f1724c00640 1 -- 172.21.15.175:0/3893378388 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1718020020 con 0x7f17281453a0 2024-04-25T09:12:24.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.409+0000 7f172f800640 1 -- 172.21.15.175:0/3893378388 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f172815e8d0 con 0x7f17281453a0 2024-04-25T09:12:24.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.409+0000 7f1724c00640 1 -- 172.21.15.175:0/3893378388 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+16657 (secure 0 0 0) 0x7f1718055ca0 con 0x7f17281453a0 2024-04-25T09:12:24.397 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:24.397 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":99,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:12:23.414570+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:12:21.141676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:12:22.422455+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:24.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.413+0000 7f172f800640 1 -- 172.21.15.175:0/3893378388 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1708066f60 msgr2=0x7f1708069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.413+0000 7f172f800640 1 --2- 172.21.15.175:0/3893378388 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1708066f60 0x7f1708069420 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f17140ae000 tx=0x7f1714008040 comp rx=0 tx=0).stop 2024-04-25T09:12:24.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.413+0000 7f172f800640 1 -- 172.21.15.175:0/3893378388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17281453a0 msgr2=0x7f172815b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.413+0000 7f172f800640 1 --2- 172.21.15.175:0/3893378388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17281453a0 0x7f172815b220 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f171800c7c0 tx=0x7f171800cc80 comp rx=0 tx=0).stop 2024-04-25T09:12:24.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.413+0000 7f172f800640 1 -- 172.21.15.175:0/3893378388 shutdown_connections 2024-04-25T09:12:24.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.413+0000 7f172f800640 1 --2- 172.21.15.175:0/3893378388 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1708066f60 0x7f1708069420 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.413+0000 7f172f800640 1 --2- 172.21.15.175:0/3893378388 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17280af1d0 0x7f1728136390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.413+0000 7f172f800640 1 --2- 172.21.15.175:0/3893378388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f172815c410 0x7f17281358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.413+0000 7f172f800640 1 --2- 172.21.15.175:0/3893378388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17281453a0 0x7f172815b220 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.413+0000 7f172f800640 1 -- 172.21.15.175:0/3893378388 >> 172.21.15.175:0/3893378388 conn(0x7f1728144fc0 msgr2=0x7f1728139400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:24.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.413+0000 7f172f800640 1 -- 172.21.15.175:0/3893378388 shutdown_connections 2024-04-25T09:12:24.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.413+0000 7f172f800640 1 -- 172.21.15.175:0/3893378388 wait complete. 2024-04-25T09:12:24.420 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:24.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.569+0000 7f0d89a00640 1 Processor -- start 2024-04-25T09:12:24.555 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.569+0000 7f0d89a00640 1 -- start start 2024-04-25T09:12:24.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.569+0000 7f0d89a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0d84099a50 0x7f0d8406cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.569+0000 7f0d89a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0d8406bd60 0x7f0d84099e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.569+0000 7f0d89a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8409a370 con 0x7f0d840d0d50 2024-04-25T09:12:24.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.569+0000 7f0d89a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d840cfcb0 con 0x7f0d8406bd60 2024-04-25T09:12:24.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.569+0000 7f0d89a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d840cff90 con 0x7f0d84099a50 2024-04-25T09:12:24.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.569+0000 7f0d82000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0d8406bd60 0x7f0d84099e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.569+0000 7f0d83400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f0d840d0d50 0x7f0d840cbe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:34392/0 (socket says 172.21.15.175:34392) 2024-04-25T09:12:24.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.569+0000 7f0d83400640 1 -- 172.21.15.175:0/197768960 learned_addr learned my addr 172.21.15.175:0/197768960 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:24.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.569+0000 7f0d82a00640 1 --2- 172.21.15.175:0/197768960 >> v2:172.21.15.177:3300/0 conn(0x7f0d84099a50 0x7f0d8406cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.569+0000 7f0d82000640 1 -- 172.21.15.175:0/197768960 >> v2:172.21.15.177:3300/0 conn(0x7f0d84099a50 msgr2=0x7f0d8406cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:24.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.569+0000 7f0d82000640 1 --2- 172.21.15.175:0/197768960 >> v2:172.21.15.177:3300/0 conn(0x7f0d84099a50 0x7f0d8406cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.569+0000 7f0d82000640 1 -- 172.21.15.175:0/197768960 >> v1:172.21.15.175:6789/0 conn(0x7f0d840d0d50 legacy=0x7f0d840cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.569+0000 7f0d82000640 1 -- 172.21.15.175:0/197768960 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d840d0270 con 0x7f0d8406bd60 2024-04-25T09:12:24.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.569+0000 7f0d82a00640 1 --2- 172.21.15.175:0/197768960 >> v2:172.21.15.177:3300/0 conn(0x7f0d84099a50 0x7f0d8406cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:24.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.569+0000 7f0d81600640 1 -- 172.21.15.175:0/197768960 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733744380 0 0) 0x7f0d8409a370 con 0x7f0d840d0d50 2024-04-25T09:12:24.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.573+0000 7f0d82000640 1 --2- 172.21.15.175:0/197768960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d8406bd60 0x7f0d84099e30 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f0d84071ee0 tx=0x7f0d7001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929ada279e67a7d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:24.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.573+0000 7f0d81600640 1 -- 172.21.15.175:0/197768960 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700b0070 con 0x7f0d8406bd60 2024-04-25T09:12:24.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.573+0000 7f0d81600640 1 -- 172.21.15.175:0/197768960 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d700ab600 con 0x7f0d8406bd60 2024-04-25T09:12:24.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.573+0000 7f0d81600640 1 -- 172.21.15.175:0/197768960 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700ab9d0 con 0x7f0d8406bd60 2024-04-25T09:12:24.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.573+0000 7f0d89a00640 1 -- 172.21.15.175:0/197768960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d8406bd60 msgr2=0x7f0d84099e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.573+0000 7f0d89a00640 1 --2- 172.21.15.175:0/197768960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d8406bd60 0x7f0d84099e30 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f0d84071ee0 tx=0x7f0d7001c480 comp rx=0 tx=0).stop 2024-04-25T09:12:24.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.573+0000 7f0d89a00640 1 -- 172.21.15.175:0/197768960 shutdown_connections 2024-04-25T09:12:24.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.573+0000 7f0d89a00640 1 --2- 172.21.15.175:0/197768960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d8406bd60 0x7f0d84099e30 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.573+0000 7f0d89a00640 1 --2- 172.21.15.175:0/197768960 >> v2:172.21.15.177:3300/0 conn(0x7f0d84099a50 0x7f0d8406cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.573+0000 7f0d89a00640 1 -- 172.21.15.175:0/197768960 >> 172.21.15.175:0/197768960 conn(0x7f0d840b3300 msgr2=0x7f0d840b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:24.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.573+0000 7f0d89a00640 1 -- 172.21.15.175:0/197768960 shutdown_connections 2024-04-25T09:12:24.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.573+0000 7f0d89a00640 1 -- 172.21.15.175:0/197768960 wait complete. 2024-04-25T09:12:24.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d89a00640 1 Processor -- start 2024-04-25T09:12:24.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d89a00640 1 -- start start 2024-04-25T09:12:24.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d89a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d8406bd60 0x7f0d840b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d89a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d84099a50 0x7f0d84155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d89a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d840d0d50 0x7f0d84151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d89a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8415dfe0 con 0x7f0d8406bd60 2024-04-25T09:12:24.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d89a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8415de60 con 0x7f0d840d0d50 2024-04-25T09:12:24.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d89a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8416b260 con 0x7f0d84099a50 2024-04-25T09:12:24.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d82a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d8406bd60 0x7f0d840b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d82a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d8406bd60 0x7f0d840b6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41344/0 (socket says 172.21.15.175:41344) 2024-04-25T09:12:24.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d82a00640 1 -- 172.21.15.175:0/2496454311 learned_addr learned my addr 172.21.15.175:0/2496454311 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:24.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d82000640 1 --2- 172.21.15.175:0/2496454311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d84099a50 0x7f0d84155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d83400640 1 --2- 172.21.15.175:0/2496454311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d840d0d50 0x7f0d84151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d82a00640 1 -- 172.21.15.175:0/2496454311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d84099a50 msgr2=0x7f0d84155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d82a00640 1 --2- 172.21.15.175:0/2496454311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d84099a50 0x7f0d84155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d82a00640 1 -- 172.21.15.175:0/2496454311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d840d0d50 msgr2=0x7f0d84151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d82a00640 1 --2- 172.21.15.175:0/2496454311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d840d0d50 0x7f0d84151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d82a00640 1 -- 172.21.15.175:0/2496454311 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d84156120 con 0x7f0d8406bd60 2024-04-25T09:12:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d83400640 1 --2- 172.21.15.175:0/2496454311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d840d0d50 0x7f0d84151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d82000640 1 --2- 172.21.15.175:0/2496454311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d84099a50 0x7f0d84155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d82a00640 1 --2- 172.21.15.175:0/2496454311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d8406bd60 0x7f0d840b6ca0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400e810 tx=0x7f0d7400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d7aa00640 1 -- 172.21.15.175:0/2496454311 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74017070 con 0x7f0d8406bd60 2024-04-25T09:12:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d7aa00640 1 -- 172.21.15.175:0/2496454311 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7400c8d0 con 0x7f0d8406bd60 2024-04-25T09:12:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d7aa00640 1 -- 172.21.15.175:0/2496454311 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7400f040 con 0x7f0d8406bd60 2024-04-25T09:12:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d89a00640 1 -- 172.21.15.175:0/2496454311 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d84154b40 con 0x7f0d8406bd60 2024-04-25T09:12:24.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d89a00640 1 -- 172.21.15.175:0/2496454311 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d84155100 con 0x7f0d8406bd60 2024-04-25T09:12:24.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.577+0000 7f0d89a00640 1 -- 172.21.15.175:0/2496454311 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d84074a60 con 0x7f0d8406bd60 2024-04-25T09:12:24.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.581+0000 7f0d7aa00640 1 -- 172.21.15.175:0/2496454311 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0d7401a070 con 0x7f0d8406bd60 2024-04-25T09:12:24.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.581+0000 7f0d7aa00640 1 --2- 172.21.15.175:0/2496454311 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0d64066f60 0x7f0d64069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.581+0000 7f0d7aa00640 1 -- 172.21.15.175:0/2496454311 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d74084c70 con 0x7f0d8406bd60 2024-04-25T09:12:24.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.581+0000 7f0d82000640 1 --2- 172.21.15.175:0/2496454311 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0d64066f60 0x7f0d64069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.581+0000 7f0d82000640 1 --2- 172.21.15.175:0/2496454311 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0d64066f60 0x7f0d64069420 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0d700ad000 tx=0x7f0d70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:24.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.585+0000 7f0d7aa00640 1 -- 172.21.15.175:0/2496454311 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0d74055be0 con 0x7f0d8406bd60 2024-04-25T09:12:24.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.741+0000 7f0d89a00640 1 -- 172.21.15.175:0/2496454311 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d8409aee0 con 0x7f0d8406bd60 2024-04-25T09:12:24.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.741+0000 7f0d7aa00640 1 -- 172.21.15.175:0/2496454311 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+16657 (secure 0 0 0) 0x7f0d740554e0 con 0x7f0d8406bd60 2024-04-25T09:12:24.729 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:24.729 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":99,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:12:23.414570+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:12:21.141676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:12:22.422455+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:24.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.745+0000 7f0d89a00640 1 -- 172.21.15.175:0/2496454311 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0d64066f60 msgr2=0x7f0d64069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.745+0000 7f0d89a00640 1 --2- 172.21.15.175:0/2496454311 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0d64066f60 0x7f0d64069420 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0d700ad000 tx=0x7f0d70008040 comp rx=0 tx=0).stop 2024-04-25T09:12:24.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.745+0000 7f0d89a00640 1 -- 172.21.15.175:0/2496454311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d8406bd60 msgr2=0x7f0d840b6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.745+0000 7f0d89a00640 1 --2- 172.21.15.175:0/2496454311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d8406bd60 0x7f0d840b6ca0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400e810 tx=0x7f0d7400ecd0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.745+0000 7f0d89a00640 1 -- 172.21.15.175:0/2496454311 shutdown_connections 2024-04-25T09:12:24.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.745+0000 7f0d89a00640 1 --2- 172.21.15.175:0/2496454311 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0d64066f60 0x7f0d64069420 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.745+0000 7f0d89a00640 1 --2- 172.21.15.175:0/2496454311 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0d840d0d50 0x7f0d84151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.745+0000 7f0d89a00640 1 --2- 172.21.15.175:0/2496454311 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0d84099a50 0x7f0d84155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.745+0000 7f0d89a00640 1 --2- 172.21.15.175:0/2496454311 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d8406bd60 0x7f0d840b6ca0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.745+0000 7f0d89a00640 1 -- 172.21.15.175:0/2496454311 >> 172.21.15.175:0/2496454311 conn(0x7f0d840b3300 msgr2=0x7f0d84156c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:24.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.745+0000 7f0d89a00640 1 -- 172.21.15.175:0/2496454311 shutdown_connections 2024-04-25T09:12:24.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.745+0000 7f0d89a00640 1 -- 172.21.15.175:0/2496454311 wait complete. 2024-04-25T09:12:24.751 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:12:24.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.901+0000 7f41ba000640 1 Processor -- start 2024-04-25T09:12:24.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.901+0000 7f41ba000640 1 -- start start 2024-04-25T09:12:24.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.905+0000 7f41ba000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41b40cbe60 0x7f41b415af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.905+0000 7f41ba000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41b406d310 0x7f41b40b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.905+0000 7f41ba000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f41b40b4630 0x7f41b40b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.905+0000 7f41ba000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b406db60 con 0x7f41b406d310 2024-04-25T09:12:24.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.905+0000 7f41ba000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b406de40 con 0x7f41b40b4630 2024-04-25T09:12:24.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.905+0000 7f41ba000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b406e120 con 0x7f41b40cbe60 2024-04-25T09:12:24.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.905+0000 7f41b2a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41b406d310 0x7f41b40b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.905+0000 7f41b2a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41b406d310 0x7f41b40b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41352/0 (socket says 172.21.15.175:41352) 2024-04-25T09:12:24.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.905+0000 7f41b2a00640 1 -- 172.21.15.175:0/1998387854 learned_addr learned my addr 172.21.15.175:0/1998387854 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:24.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.905+0000 7f41b3400640 1 --2- 172.21.15.175:0/1998387854 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41b40cbe60 0x7f41b415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.905+0000 7f41b3e00640 1 --2- 172.21.15.175:0/1998387854 >> v2:172.21.15.177:3300/0 conn(0x7f41b40b4630 0x7f41b40b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.905+0000 7f41b2a00640 1 -- 172.21.15.175:0/1998387854 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41b40cbe60 msgr2=0x7f41b415af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:24.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.905+0000 7f41b2a00640 1 --2- 172.21.15.175:0/1998387854 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41b40cbe60 0x7f41b415af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.905+0000 7f41b2a00640 1 -- 172.21.15.175:0/1998387854 >> v2:172.21.15.177:3300/0 conn(0x7f41b40b4630 msgr2=0x7f41b40b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:24.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.905+0000 7f41b2a00640 1 --2- 172.21.15.175:0/1998387854 >> v2:172.21.15.177:3300/0 conn(0x7f41b40b4630 0x7f41b40b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.905+0000 7f41b2a00640 1 -- 172.21.15.175:0/1998387854 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b415c2f0 con 0x7f41b406d310 2024-04-25T09:12:24.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.905+0000 7f41b3e00640 1 --2- 172.21.15.175:0/1998387854 >> v2:172.21.15.177:3300/0 conn(0x7f41b40b4630 0x7f41b40b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:24.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41b2a00640 1 --2- 172.21.15.175:0/1998387854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41b406d310 0x7f41b40b40f0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f41b406ec50 tx=0x7f41a001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e1aa44ed5f3e4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:24.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41b2000640 1 -- 172.21.15.175:0/1998387854 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a00b0070 con 0x7f41b406d310 2024-04-25T09:12:24.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41b2000640 1 -- 172.21.15.175:0/1998387854 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a00ab600 con 0x7f41b406d310 2024-04-25T09:12:24.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41b2000640 1 -- 172.21.15.175:0/1998387854 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a00ab9d0 con 0x7f41b406d310 2024-04-25T09:12:24.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41ba000640 1 -- 172.21.15.175:0/1998387854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41b406d310 msgr2=0x7f41b40b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41ba000640 1 --2- 172.21.15.175:0/1998387854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41b406d310 0x7f41b40b40f0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f41b406ec50 tx=0x7f41a001c260 comp rx=0 tx=0).stop 2024-04-25T09:12:24.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41ba000640 1 -- 172.21.15.175:0/1998387854 shutdown_connections 2024-04-25T09:12:24.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41ba000640 1 --2- 172.21.15.175:0/1998387854 >> v2:172.21.15.177:3300/0 conn(0x7f41b40b4630 0x7f41b40b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41ba000640 1 --2- 172.21.15.175:0/1998387854 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41b406d310 0x7f41b40b40f0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41ba000640 1 --2- 172.21.15.175:0/1998387854 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41b40cbe60 0x7f41b415af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41ba000640 1 -- 172.21.15.175:0/1998387854 >> 172.21.15.175:0/1998387854 conn(0x7f41b406ac50 msgr2=0x7f41b406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:24.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41ba000640 1 -- 172.21.15.175:0/1998387854 shutdown_connections 2024-04-25T09:12:24.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41ba000640 1 -- 172.21.15.175:0/1998387854 wait complete. 2024-04-25T09:12:24.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41ba000640 1 Processor -- start 2024-04-25T09:12:24.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41ba000640 1 -- start start 2024-04-25T09:12:24.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41ba000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41b406d310 0x7f41b4147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41ba000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41b40b4630 0x7f41b4156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41ba000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41b40cbe60 0x7f41b41555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41ba000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b415cbe0 con 0x7f41b406d310 2024-04-25T09:12:24.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41ba000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b415ca60 con 0x7f41b40cbe60 2024-04-25T09:12:24.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.909+0000 7f41ba000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b415cd60 con 0x7f41b40b4630 2024-04-25T09:12:24.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41b3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41b406d310 0x7f41b4147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41b3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41b406d310 0x7f41b4147020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41356/0 (socket says 172.21.15.175:41356) 2024-04-25T09:12:24.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41b3400640 1 -- 172.21.15.175:0/6600866 learned_addr learned my addr 172.21.15.175:0/6600866 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:24.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41b2a00640 1 --2- 172.21.15.175:0/6600866 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41b40b4630 0x7f41b4156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41b3e00640 1 --2- 172.21.15.175:0/6600866 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41b40cbe60 0x7f41b41555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41b3400640 1 -- 172.21.15.175:0/6600866 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41b40b4630 msgr2=0x7f41b4156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41b3400640 1 --2- 172.21.15.175:0/6600866 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41b40b4630 0x7f41b4156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41b3400640 1 -- 172.21.15.175:0/6600866 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41b40cbe60 msgr2=0x7f41b41555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:24.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41b3400640 1 --2- 172.21.15.175:0/6600866 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41b40cbe60 0x7f41b41555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:24.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41b3400640 1 -- 172.21.15.175:0/6600866 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b4156bc0 con 0x7f41b406d310 2024-04-25T09:12:24.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41b3400640 1 --2- 172.21.15.175:0/6600866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41b406d310 0x7f41b4147020 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f41a400d5f0 tx=0x7f41a400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:24.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41ab400640 1 -- 172.21.15.175:0/6600866 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a40125f0 con 0x7f41b406d310 2024-04-25T09:12:24.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41ab400640 1 -- 172.21.15.175:0/6600866 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a4019070 con 0x7f41b406d310 2024-04-25T09:12:24.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41ab400640 1 -- 172.21.15.175:0/6600866 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a40129b0 con 0x7f41b406d310 2024-04-25T09:12:24.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41ba000640 1 -- 172.21.15.175:0/6600866 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b4156e60 con 0x7f41b406d310 2024-04-25T09:12:24.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41ba000640 1 -- 172.21.15.175:0/6600866 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b4157420 con 0x7f41b406d310 2024-04-25T09:12:24.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41ba000640 1 -- 172.21.15.175:0/6600866 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b4075160 con 0x7f41b406d310 2024-04-25T09:12:24.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41ab400640 1 -- 172.21.15.175:0/6600866 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f41a4012b50 con 0x7f41b406d310 2024-04-25T09:12:24.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41ab400640 1 --2- 172.21.15.175:0/6600866 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4194066f60 0x7f4194069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:24.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.913+0000 7f41ab400640 1 -- 172.21.15.175:0/6600866 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41a4085480 con 0x7f41b406d310 2024-04-25T09:12:24.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.917+0000 7f41b2a00640 1 --2- 172.21.15.175:0/6600866 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4194066f60 0x7f4194069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:24.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.917+0000 7f41b2a00640 1 --2- 172.21.15.175:0/6600866 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4194066f60 0x7f4194069420 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f41a00ad000 tx=0x7f41a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:24.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:24.921+0000 7f41ab400640 1 -- 172.21.15.175:0/6600866 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f41a40563f0 con 0x7f41b406d310 2024-04-25T09:12:25.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:25.113+0000 7f41ba000640 1 -- 172.21.15.175:0/6600866 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f41b4158c60 con 0x7f41b406d310 2024-04-25T09:12:26.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.069+0000 7f41ab400640 1 -- 172.21.15.175:0/6600866 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v77) v1 ==== 118+0+0 (secure 0 0 0) 0x7f41a4055cf0 con 0x7f41b406d310 2024-04-25T09:12:26.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.073+0000 7f41ba000640 1 -- 172.21.15.175:0/6600866 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4194066f60 msgr2=0x7f4194069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:26.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.073+0000 7f41ba000640 1 --2- 172.21.15.175:0/6600866 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4194066f60 0x7f4194069420 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f41a00ad000 tx=0x7f41a0008040 comp rx=0 tx=0).stop 2024-04-25T09:12:26.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.073+0000 7f41ba000640 1 -- 172.21.15.175:0/6600866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41b406d310 msgr2=0x7f41b4147020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:26.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.073+0000 7f41ba000640 1 --2- 172.21.15.175:0/6600866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41b406d310 0x7f41b4147020 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f41a400d5f0 tx=0x7f41a400dab0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.073+0000 7f41ba000640 1 -- 172.21.15.175:0/6600866 shutdown_connections 2024-04-25T09:12:26.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.073+0000 7f41ba000640 1 --2- 172.21.15.175:0/6600866 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4194066f60 0x7f4194069420 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.073+0000 7f41ba000640 1 --2- 172.21.15.175:0/6600866 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f41b40cbe60 0x7f41b41555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.073+0000 7f41ba000640 1 --2- 172.21.15.175:0/6600866 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f41b40b4630 0x7f41b4156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.073+0000 7f41ba000640 1 --2- 172.21.15.175:0/6600866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41b406d310 0x7f41b4147020 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.073+0000 7f41ba000640 1 -- 172.21.15.175:0/6600866 >> 172.21.15.175:0/6600866 conn(0x7f41b406ac50 msgr2=0x7f41b415b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:26.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.073+0000 7f41ba000640 1 -- 172.21.15.175:0/6600866 shutdown_connections 2024-04-25T09:12:26.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.073+0000 7f41ba000640 1 -- 172.21.15.175:0/6600866 wait complete. 2024-04-25T09:12:26.081 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:12:26.081 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:12:26.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.237+0000 7f6958000640 1 Processor -- start 2024-04-25T09:12:26.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.237+0000 7f6958000640 1 -- start start 2024-04-25T09:12:26.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.237+0000 7f6958000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f69500cbe60 0x7f695015af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:26.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.237+0000 7f6958000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695006db60 con 0x7f69500b4800 2024-04-25T09:12:26.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.237+0000 7f6958000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695006de40 con 0x7f695006d310 2024-04-25T09:12:26.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.237+0000 7f6958000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695006e120 con 0x7f69500cbe60 2024-04-25T09:12:26.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.237+0000 7f6955600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f69500cbe60 0x7f695015af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:26.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.237+0000 7f6956000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f69500b4800 0x7f695015c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:34398/0 (socket says 172.21.15.175:34398) 2024-04-25T09:12:26.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.237+0000 7f6956000640 1 -- 172.21.15.175:0/4286963229 learned_addr learned my addr 172.21.15.175:0/4286963229 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:26.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.237+0000 7f6955600640 1 -- 172.21.15.175:0/4286963229 >> v1:172.21.15.177:6789/0 conn(0x7f695006d310 legacy=0x7f69500b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:26.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.237+0000 7f6955600640 1 -- 172.21.15.175:0/4286963229 >> v1:172.21.15.175:6789/0 conn(0x7f69500b4800 legacy=0x7f695015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:26.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.237+0000 7f6955600640 1 -- 172.21.15.175:0/4286963229 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695015c2f0 con 0x7f69500cbe60 2024-04-25T09:12:26.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.237+0000 7f694fe00640 1 -- 172.21.15.175:0/4286963229 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743413388 0 0) 0x7f695006db60 con 0x7f69500b4800 2024-04-25T09:12:26.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.241+0000 7f6955600640 1 --2- 172.21.15.175:0/4286963229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69500cbe60 0x7f695015af20 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f69440097c0 tx=0x7f694401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5823f981e37052 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:26.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.241+0000 7f694fe00640 1 -- 172.21.15.175:0/4286963229 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69440b0070 con 0x7f69500cbe60 2024-04-25T09:12:26.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.241+0000 7f694fe00640 1 -- 172.21.15.175:0/4286963229 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69440ab600 con 0x7f69500cbe60 2024-04-25T09:12:26.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.241+0000 7f694fe00640 1 -- 172.21.15.175:0/4286963229 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69440ab9d0 con 0x7f69500cbe60 2024-04-25T09:12:26.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.241+0000 7f6958000640 1 -- 172.21.15.175:0/4286963229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69500cbe60 msgr2=0x7f695015af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:26.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.241+0000 7f6958000640 1 --2- 172.21.15.175:0/4286963229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69500cbe60 0x7f695015af20 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f69440097c0 tx=0x7f694401c460 comp rx=0 tx=0).stop 2024-04-25T09:12:26.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.241+0000 7f6958000640 1 -- 172.21.15.175:0/4286963229 shutdown_connections 2024-04-25T09:12:26.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.241+0000 7f6958000640 1 --2- 172.21.15.175:0/4286963229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69500cbe60 0x7f695015af20 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.241+0000 7f6958000640 1 -- 172.21.15.175:0/4286963229 >> 172.21.15.175:0/4286963229 conn(0x7f695006ac50 msgr2=0x7f695006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:26.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.241+0000 7f6958000640 1 -- 172.21.15.175:0/4286963229 shutdown_connections 2024-04-25T09:12:26.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.241+0000 7f6958000640 1 -- 172.21.15.175:0/4286963229 wait complete. 2024-04-25T09:12:26.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6958000640 1 Processor -- start 2024-04-25T09:12:26.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6958000640 1 -- start start 2024-04-25T09:12:26.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6958000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f695006d310 0x7f6950151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:26.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6958000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69500b4800 0x7f695014a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:26.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6958000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69500cbe60 0x7f6950139e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:26.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6958000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695015d980 con 0x7f69500b4800 2024-04-25T09:12:26.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6958000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69500cc450 con 0x7f69500cbe60 2024-04-25T09:12:26.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6958000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695015db00 con 0x7f695006d310 2024-04-25T09:12:26.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6954c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69500b4800 0x7f695014a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:26.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6954c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69500b4800 0x7f695014a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41370/0 (socket says 172.21.15.175:41370) 2024-04-25T09:12:26.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6954c00640 1 -- 172.21.15.175:0/3907434858 learned_addr learned my addr 172.21.15.175:0/3907434858 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:26.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6955600640 1 --2- 172.21.15.175:0/3907434858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f695006d310 0x7f6950151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:26.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6956000640 1 --2- 172.21.15.175:0/3907434858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69500cbe60 0x7f6950139e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:26.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6954c00640 1 -- 172.21.15.175:0/3907434858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f695006d310 msgr2=0x7f6950151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:26.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6954c00640 1 --2- 172.21.15.175:0/3907434858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f695006d310 0x7f6950151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6954c00640 1 -- 172.21.15.175:0/3907434858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69500cbe60 msgr2=0x7f6950139e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:26.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6954c00640 1 --2- 172.21.15.175:0/3907434858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69500cbe60 0x7f6950139e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:26.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6954c00640 1 -- 172.21.15.175:0/3907434858 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695014e730 con 0x7f69500b4800 2024-04-25T09:12:26.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6954c00640 1 --2- 172.21.15.175:0/3907434858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69500b4800 0x7f695014a250 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f693c00c480 tx=0x7f693c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:26.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f694d600640 1 -- 172.21.15.175:0/3907434858 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c012830 con 0x7f69500b4800 2024-04-25T09:12:26.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f694d600640 1 -- 172.21.15.175:0/3907434858 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693c017070 con 0x7f69500b4800 2024-04-25T09:12:26.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f694d600640 1 -- 172.21.15.175:0/3907434858 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c012c30 con 0x7f69500b4800 2024-04-25T09:12:26.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6958000640 1 -- 172.21.15.175:0/3907434858 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69501546b0 con 0x7f69500b4800 2024-04-25T09:12:26.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6958000640 1 -- 172.21.15.175:0/3907434858 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69500ce190 con 0x7f69500b4800 2024-04-25T09:12:26.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.245+0000 7f6958000640 1 -- 172.21.15.175:0/3907434858 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6950075160 con 0x7f69500b4800 2024-04-25T09:12:26.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.249+0000 7f694d600640 1 -- 172.21.15.175:0/3907434858 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f693c01c460 con 0x7f69500b4800 2024-04-25T09:12:26.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.249+0000 7f694d600640 1 --2- 172.21.15.175:0/3907434858 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6930066f60 0x7f6930069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:26.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.249+0000 7f694d600640 1 -- 172.21.15.175:0/3907434858 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f693c084d20 con 0x7f69500b4800 2024-04-25T09:12:26.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.249+0000 7f6955600640 1 --2- 172.21.15.175:0/3907434858 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6930066f60 0x7f6930069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:26.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.249+0000 7f6955600640 1 --2- 172.21.15.175:0/3907434858 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6930066f60 0x7f6930069420 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f69440ad000 tx=0x7f69440a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:26.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.253+0000 7f694d600640 1 -- 172.21.15.175:0/3907434858 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f693c0556d0 con 0x7f69500b4800 2024-04-25T09:12:26.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:26.441+0000 7f6958000640 1 -- 172.21.15.175:0/3907434858 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f69500b2980 con 0x7f69500b4800 2024-04-25T09:12:27.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.073+0000 7f694d600640 1 -- 172.21.15.175:0/3907434858 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v78) v1 ==== 122+0+0 (secure 0 0 0) 0x7f693c059770 con 0x7f69500b4800 2024-04-25T09:12:27.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.073+0000 7f6958000640 1 -- 172.21.15.175:0/3907434858 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6930066f60 msgr2=0x7f6930069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.073+0000 7f6958000640 1 --2- 172.21.15.175:0/3907434858 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6930066f60 0x7f6930069420 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f69440ad000 tx=0x7f69440a6000 comp rx=0 tx=0).stop 2024-04-25T09:12:27.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.073+0000 7f6958000640 1 -- 172.21.15.175:0/3907434858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69500b4800 msgr2=0x7f695014a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.073+0000 7f6958000640 1 --2- 172.21.15.175:0/3907434858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69500b4800 0x7f695014a250 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f693c00c480 tx=0x7f693c00c940 comp rx=0 tx=0).stop 2024-04-25T09:12:27.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.073+0000 7f6958000640 1 -- 172.21.15.175:0/3907434858 shutdown_connections 2024-04-25T09:12:27.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.073+0000 7f6958000640 1 --2- 172.21.15.175:0/3907434858 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6930066f60 0x7f6930069420 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.073+0000 7f6958000640 1 --2- 172.21.15.175:0/3907434858 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69500cbe60 0x7f6950139e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.073+0000 7f6958000640 1 --2- 172.21.15.175:0/3907434858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69500b4800 0x7f695014a250 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.073+0000 7f6958000640 1 --2- 172.21.15.175:0/3907434858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f695006d310 0x7f6950151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.073+0000 7f6958000640 1 -- 172.21.15.175:0/3907434858 >> 172.21.15.175:0/3907434858 conn(0x7f695006ac50 msgr2=0x7f69500af610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:27.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.073+0000 7f6958000640 1 -- 172.21.15.175:0/3907434858 shutdown_connections 2024-04-25T09:12:27.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.077+0000 7f6958000640 1 -- 172.21.15.175:0/3907434858 wait complete. 2024-04-25T09:12:27.087 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:12:27.087 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:27.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.237+0000 7fc9aa200640 1 Processor -- start 2024-04-25T09:12:27.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.237+0000 7fc9aa200640 1 -- start start 2024-04-25T09:12:27.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.241+0000 7fc9aa200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc9a40cd520 0x7fc9a406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.241+0000 7fc9aa200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9a40cf560 0x7fc9a40cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.241+0000 7fc9aa200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a40cda00 con 0x7fc9a415a900 2024-04-25T09:12:27.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.241+0000 7fc9aa200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a415bcf0 con 0x7fc9a40cd520 2024-04-25T09:12:27.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.241+0000 7fc9aa200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a40cfef0 con 0x7fc9a40cf560 2024-04-25T09:12:27.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.241+0000 7fc9a3400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc9a415a900 0x7fc9a40ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:34406/0 (socket says 172.21.15.175:34406) 2024-04-25T09:12:27.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.241+0000 7fc9a3400640 1 -- 172.21.15.175:0/3785012524 learned_addr learned my addr 172.21.15.175:0/3785012524 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:27.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.241+0000 7fc99aa00640 1 --2- 172.21.15.175:0/3785012524 >> v2:172.21.15.177:3300/0 conn(0x7fc9a40cd520 0x7fc9a406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.241+0000 7fc9a3e00640 1 --2- 172.21.15.175:0/3785012524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9a40cf560 0x7fc9a40cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.241+0000 7fc9a2a00640 1 -- 172.21.15.175:0/3785012524 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1764865383 0 0) 0x7fc9a40cda00 con 0x7fc9a415a900 2024-04-25T09:12:27.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.241+0000 7fc9a2a00640 1 -- 172.21.15.175:0/3785012524 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc988003530 con 0x7fc9a415a900 2024-04-25T09:12:27.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.241+0000 7fc9a3e00640 1 -- 172.21.15.175:0/3785012524 >> v2:172.21.15.177:3300/0 conn(0x7fc9a40cd520 msgr2=0x7fc9a406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:27.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.241+0000 7fc9a3e00640 1 --2- 172.21.15.175:0/3785012524 >> v2:172.21.15.177:3300/0 conn(0x7fc9a40cd520 0x7fc9a406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.241+0000 7fc9a3e00640 1 -- 172.21.15.175:0/3785012524 >> v1:172.21.15.175:6789/0 conn(0x7fc9a415a900 legacy=0x7fc9a40ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.241+0000 7fc9a3e00640 1 -- 172.21.15.175:0/3785012524 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a40cdce0 con 0x7fc9a40cf560 2024-04-25T09:12:27.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.241+0000 7fc99aa00640 1 --2- 172.21.15.175:0/3785012524 >> v2:172.21.15.177:3300/0 conn(0x7fc9a40cd520 0x7fc9a406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:27.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.245+0000 7fc9a3e00640 1 --2- 172.21.15.175:0/3785012524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9a40cf560 0x7fc9a40cf9b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009d90 tx=0x7fc99c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aad75a9f95a5e28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:27.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.245+0000 7fc9a2a00640 1 -- 172.21.15.175:0/3785012524 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c0b2070 con 0x7fc9a40cf560 2024-04-25T09:12:27.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.245+0000 7fc9a2a00640 1 -- 172.21.15.175:0/3785012524 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99c0a5920 con 0x7fc9a40cf560 2024-04-25T09:12:27.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.245+0000 7fc9a2a00640 1 -- 172.21.15.175:0/3785012524 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99c0a5cf0 con 0x7fc9a40cf560 2024-04-25T09:12:27.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.245+0000 7fc9aa200640 1 -- 172.21.15.175:0/3785012524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9a40cf560 msgr2=0x7fc9a40cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.245+0000 7fc9aa200640 1 --2- 172.21.15.175:0/3785012524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9a40cf560 0x7fc9a40cf9b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc99c009d90 tx=0x7fc99c01c970 comp rx=0 tx=0).stop 2024-04-25T09:12:27.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.245+0000 7fc9aa200640 1 -- 172.21.15.175:0/3785012524 shutdown_connections 2024-04-25T09:12:27.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.245+0000 7fc9aa200640 1 --2- 172.21.15.175:0/3785012524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9a40cf560 0x7fc9a40cf9b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.245+0000 7fc9aa200640 1 --2- 172.21.15.175:0/3785012524 >> v2:172.21.15.177:3300/0 conn(0x7fc9a40cd520 0x7fc9a406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.245+0000 7fc9aa200640 1 -- 172.21.15.175:0/3785012524 >> 172.21.15.175:0/3785012524 conn(0x7fc9a4067150 msgr2=0x7fc9a406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:27.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.245+0000 7fc9aa200640 1 -- 172.21.15.175:0/3785012524 shutdown_connections 2024-04-25T09:12:27.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.245+0000 7fc9aa200640 1 -- 172.21.15.175:0/3785012524 wait complete. 2024-04-25T09:12:27.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.245+0000 7fc9aa200640 1 Processor -- start 2024-04-25T09:12:27.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9aa200640 1 -- start start 2024-04-25T09:12:27.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9aa200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9a40cf560 0x7fc9a414e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9aa200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9a415a900 0x7fc9a40b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9aa200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9a414eb90 0x7fc9a40acf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9aa200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a406d530 con 0x7fc9a40cf560 2024-04-25T09:12:27.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9aa200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a406d3b0 con 0x7fc9a415a900 2024-04-25T09:12:27.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9aa200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a415c790 con 0x7fc9a414eb90 2024-04-25T09:12:27.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9a3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9a40cf560 0x7fc9a414e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9a3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9a40cf560 0x7fc9a414e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41378/0 (socket says 172.21.15.175:41378) 2024-04-25T09:12:27.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9a3400640 1 -- 172.21.15.175:0/1474966183 learned_addr learned my addr 172.21.15.175:0/1474966183 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:27.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9a3e00640 1 --2- 172.21.15.175:0/1474966183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9a414eb90 0x7fc9a40acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc99aa00640 1 --2- 172.21.15.175:0/1474966183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9a415a900 0x7fc9a40b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9a3400640 1 -- 172.21.15.175:0/1474966183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9a414eb90 msgr2=0x7fc9a40acf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9a3400640 1 --2- 172.21.15.175:0/1474966183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9a414eb90 0x7fc9a40acf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9a3400640 1 -- 172.21.15.175:0/1474966183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9a415a900 msgr2=0x7fc9a40b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9a3400640 1 --2- 172.21.15.175:0/1474966183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9a415a900 0x7fc9a40b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9a3400640 1 -- 172.21.15.175:0/1474966183 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a41590b0 con 0x7fc9a40cf560 2024-04-25T09:12:27.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9a3400640 1 --2- 172.21.15.175:0/1474966183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9a40cf560 0x7fc9a414e3d0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fc99400c3c0 tx=0x7fc99400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:27.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc99be00640 1 -- 172.21.15.175:0/1474966183 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994017070 con 0x7fc9a40cf560 2024-04-25T09:12:27.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc99be00640 1 -- 172.21.15.175:0/1474966183 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc994005cf0 con 0x7fc9a40cf560 2024-04-25T09:12:27.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc99be00640 1 -- 172.21.15.175:0/1474966183 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9940072f0 con 0x7fc9a40cf560 2024-04-25T09:12:27.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9aa200640 1 -- 172.21.15.175:0/1474966183 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a4159390 con 0x7fc9a40cf560 2024-04-25T09:12:27.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9aa200640 1 -- 172.21.15.175:0/1474966183 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a40aca60 con 0x7fc9a40cf560 2024-04-25T09:12:27.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.249+0000 7fc9aa200640 1 -- 172.21.15.175:0/1474966183 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a41598b0 con 0x7fc9a40cf560 2024-04-25T09:12:27.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.253+0000 7fc99be00640 1 -- 172.21.15.175:0/1474966183 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc99401a070 con 0x7fc9a40cf560 2024-04-25T09:12:27.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.253+0000 7fc99be00640 1 --2- 172.21.15.175:0/1474966183 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc980066f60 0x7fc980069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.253+0000 7fc99be00640 1 -- 172.21.15.175:0/1474966183 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc994084490 con 0x7fc9a40cf560 2024-04-25T09:12:27.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.253+0000 7fc99aa00640 1 --2- 172.21.15.175:0/1474966183 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc980066f60 0x7fc980069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.253+0000 7fc99aa00640 1 --2- 172.21.15.175:0/1474966183 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc980066f60 0x7fc980069420 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009580 tx=0x7fc98c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:27.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.257+0000 7fc99be00640 1 -- 172.21.15.175:0/1474966183 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc9a41598b0 con 0x7fc9a40cf560 2024-04-25T09:12:27.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.445+0000 7fc9aa200640 1 -- 172.21.15.175:0/1474966183 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9a4074a60 con 0x7fc9a40cf560 2024-04-25T09:12:27.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.445+0000 7fc99be00640 1 -- 172.21.15.175:0/1474966183 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4949 (secure 0 0 0) 0x7fc994055480 con 0x7fc9a40cf560 2024-04-25T09:12:27.431 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:27.431 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":78,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6998,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3519467288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3519467288},{"type":"v1","addr":"172.21.15.177:6834","nonce":3519467288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2181426238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2181426238},{"type":"v1","addr":"172.21.15.177:6835","nonce":2181426238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/936884340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":936884340},{"type":"v1","addr":"172.21.15.175:6836","nonce":936884340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:23.414911+0000","modified":"2024-04-25T09:12:26.444040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8067":{"gid":8067,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/3952378765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3952378765},{"type":"v1","addr":"172.21.15.175:6837","nonce":3952378765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:12:27.431 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 78 2024-04-25T09:12:27.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.445+0000 7fc9aa200640 1 -- 172.21.15.175:0/1474966183 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc980066f60 msgr2=0x7fc980069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.445+0000 7fc9aa200640 1 --2- 172.21.15.175:0/1474966183 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc980066f60 0x7fc980069420 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009580 tx=0x7fc98c008040 comp rx=0 tx=0).stop 2024-04-25T09:12:27.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.445+0000 7fc9aa200640 1 -- 172.21.15.175:0/1474966183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9a40cf560 msgr2=0x7fc9a414e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.445+0000 7fc9aa200640 1 --2- 172.21.15.175:0/1474966183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9a40cf560 0x7fc9a414e3d0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fc99400c3c0 tx=0x7fc99400c880 comp rx=0 tx=0).stop 2024-04-25T09:12:27.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.445+0000 7fc9aa200640 1 -- 172.21.15.175:0/1474966183 shutdown_connections 2024-04-25T09:12:27.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.445+0000 7fc9aa200640 1 --2- 172.21.15.175:0/1474966183 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc980066f60 0x7fc980069420 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.445+0000 7fc9aa200640 1 --2- 172.21.15.175:0/1474966183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9a414eb90 0x7fc9a40acf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.445+0000 7fc9aa200640 1 --2- 172.21.15.175:0/1474966183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9a415a900 0x7fc9a40b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.445+0000 7fc9aa200640 1 --2- 172.21.15.175:0/1474966183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9a40cf560 0x7fc9a414e3d0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.445+0000 7fc9aa200640 1 -- 172.21.15.175:0/1474966183 >> 172.21.15.175:0/1474966183 conn(0x7fc9a40cd520 msgr2=0x7fc9a40ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:27.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.445+0000 7fc9aa200640 1 -- 172.21.15.175:0/1474966183 shutdown_connections 2024-04-25T09:12:27.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.445+0000 7fc9aa200640 1 -- 172.21.15.175:0/1474966183 wait complete. 2024-04-25T09:12:27.452 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:27.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35d2800640 1 Processor -- start 2024-04-25T09:12:27.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35d2800640 1 -- start start 2024-04-25T09:12:27.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35d2800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35cc06cc50 0x7f35cc0cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35d2800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35cc0cfcb0 con 0x7f35cc099a50 2024-04-25T09:12:27.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35d2800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35cc0cff90 con 0x7f35cc06bd60 2024-04-25T09:12:27.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35d2800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc0d1460 con 0x7f35cc06cc50 2024-04-25T09:12:27.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35cb400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f35cc099a50 0x7f35cc099e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:34410/0 (socket says 172.21.15.175:34410) 2024-04-25T09:12:27.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35cb400640 1 -- 172.21.15.175:0/2524619189 learned_addr learned my addr 172.21.15.175:0/2524619189 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:27.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35ca000640 1 -- 172.21.15.175:0/2524619189 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680929133 0 0) 0x7f35cc0cfcb0 con 0x7f35cc099a50 2024-04-25T09:12:27.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35ca000640 1 -- 172.21.15.175:0/2524619189 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35b0003530 con 0x7f35cc099a50 2024-04-25T09:12:27.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35cbe00640 1 --2- 172.21.15.175:0/2524619189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35cc06cc50 0x7f35cc0cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35ca000640 1 -- 172.21.15.175:0/2524619189 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2457630443 0 0) 0x7f35b0003530 con 0x7f35cc099a50 2024-04-25T09:12:27.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35ca000640 1 -- 172.21.15.175:0/2524619189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35cc06cc50 msgr2=0x7f35cc0cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:27.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35ca000640 1 --2- 172.21.15.175:0/2524619189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35cc06cc50 0x7f35cc0cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35ca000640 1 -- 172.21.15.175:0/2524619189 >> v1:172.21.15.177:6789/0 conn(0x7f35cc06bd60 legacy=0x7f35cc0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35ca000640 1 -- 172.21.15.175:0/2524619189 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc0d0270 con 0x7f35cc099a50 2024-04-25T09:12:27.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35ca000640 1 -- 172.21.15.175:0/2524619189 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f35bc001680 con 0x7f35cc099a50 2024-04-25T09:12:27.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35ca000640 1 -- 172.21.15.175:0/2524619189 >> v1:172.21.15.175:6789/0 conn(0x7f35cc099a50 legacy=0x7f35cc099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35ca000640 1 --2- 172.21.15.175:0/2524619189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35b00039f0 0x7f35b0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35ca000640 1 --2- 172.21.15.175:0/2524619189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35cc06cc50 0x7f35b0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35ca000640 1 --2- 172.21.15.175:0/2524619189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0004d50 0x7f35b00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35ca000640 1 -- 172.21.15.175:0/2524619189 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b000ba80 con 0x7f35b0004d50 2024-04-25T09:12:27.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35ca000640 1 -- 172.21.15.175:0/2524619189 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b000bc30 con 0x7f35b00039f0 2024-04-25T09:12:27.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.601+0000 7f35ca000640 1 -- 172.21.15.175:0/2524619189 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b000be30 con 0x7f35cc06cc50 2024-04-25T09:12:27.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.605+0000 7f35cbe00640 1 --2- 172.21.15.175:0/2524619189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0004d50 0x7f35b00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.605+0000 7f35caa00640 1 --2- 172.21.15.175:0/2524619189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35cc06cc50 0x7f35b0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.605+0000 7f35cb400640 1 --2- 172.21.15.175:0/2524619189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35b00039f0 0x7f35b0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.605+0000 7f35cbe00640 1 -- 172.21.15.175:0/2524619189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35cc06cc50 msgr2=0x7f35b0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:27.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.605+0000 7f35cbe00640 1 --2- 172.21.15.175:0/2524619189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35cc06cc50 0x7f35b0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.605+0000 7f35cbe00640 1 -- 172.21.15.175:0/2524619189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35b00039f0 msgr2=0x7f35b0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:27.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.605+0000 7f35cbe00640 1 --2- 172.21.15.175:0/2524619189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35b00039f0 0x7f35b0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.605+0000 7f35cbe00640 1 -- 172.21.15.175:0/2524619189 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b0003530 con 0x7f35b0004d50 2024-04-25T09:12:27.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.605+0000 7f35cbe00640 1 --2- 172.21.15.175:0/2524619189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0004d50 0x7f35b00051d0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009f90 tx=0x7f35c401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591f46cdc4474390 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:27.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.605+0000 7f35ca000640 1 -- 172.21.15.175:0/2524619189 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c40b2070 con 0x7f35b0004d50 2024-04-25T09:12:27.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.605+0000 7f35ca000640 1 -- 172.21.15.175:0/2524619189 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c40a5c50 con 0x7f35b0004d50 2024-04-25T09:12:27.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.605+0000 7f35ca000640 1 -- 172.21.15.175:0/2524619189 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4009c10 con 0x7f35b0004d50 2024-04-25T09:12:27.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.605+0000 7f35d2800640 1 -- 172.21.15.175:0/2524619189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0004d50 msgr2=0x7f35b00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.605+0000 7f35d2800640 1 --2- 172.21.15.175:0/2524619189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35b0004d50 0x7f35b00051d0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009f90 tx=0x7f35c401cc40 comp rx=0 tx=0).stop 2024-04-25T09:12:27.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35cbe00640 1 -- 172.21.15.175:0/2524619189 reap_dead start 2024-04-25T09:12:27.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35d2800640 1 -- 172.21.15.175:0/2524619189 shutdown_connections 2024-04-25T09:12:27.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35d2800640 1 -- 172.21.15.175:0/2524619189 >> 172.21.15.175:0/2524619189 conn(0x7f35cc0b3300 msgr2=0x7f35cc0b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:27.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35d2800640 1 -- 172.21.15.175:0/2524619189 shutdown_connections 2024-04-25T09:12:27.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35d2800640 1 -- 172.21.15.175:0/2524619189 wait complete. 2024-04-25T09:12:27.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35d2800640 1 Processor -- start 2024-04-25T09:12:27.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35d2800640 1 -- start start 2024-04-25T09:12:27.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35d2800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35b0004d50 0x7f35cc0c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35d2800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35cc0b53e0 0x7f35cc0af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35d2800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35cc14edd0 0x7f35cc14f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35d2800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc0cf9a0 con 0x7f35cc0b53e0 2024-04-25T09:12:27.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35d2800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc0d0830 con 0x7f35b0004d50 2024-04-25T09:12:27.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35d2800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc06d060 con 0x7f35cc14edd0 2024-04-25T09:12:27.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35caa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35cc0b53e0 0x7f35cc0af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35caa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35cc0b53e0 0x7f35cc0af150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41408/0 (socket says 172.21.15.175:41408) 2024-04-25T09:12:27.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35caa00640 1 -- 172.21.15.175:0/360895941 learned_addr learned my addr 172.21.15.175:0/360895941 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:27.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35cb400640 1 --2- 172.21.15.175:0/360895941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35b0004d50 0x7f35cc0c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35cbe00640 1 --2- 172.21.15.175:0/360895941 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35cc14edd0 0x7f35cc14f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35caa00640 1 -- 172.21.15.175:0/360895941 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35cc14edd0 msgr2=0x7f35cc14f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35caa00640 1 --2- 172.21.15.175:0/360895941 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35cc14edd0 0x7f35cc14f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35caa00640 1 -- 172.21.15.175:0/360895941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35b0004d50 msgr2=0x7f35cc0c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35caa00640 1 --2- 172.21.15.175:0/360895941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35b0004d50 0x7f35cc0c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35caa00640 1 -- 172.21.15.175:0/360895941 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc0c5c40 con 0x7f35cc0b53e0 2024-04-25T09:12:27.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35caa00640 1 --2- 172.21.15.175:0/360895941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35cc0b53e0 0x7f35cc0af150 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f35b400f7f0 tx=0x7f35b400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:27.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35c3400640 1 -- 172.21.15.175:0/360895941 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b40050d0 con 0x7f35cc0b53e0 2024-04-25T09:12:27.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35c3400640 1 -- 172.21.15.175:0/360895941 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b4018070 con 0x7f35cc0b53e0 2024-04-25T09:12:27.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35c3400640 1 -- 172.21.15.175:0/360895941 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b400d730 con 0x7f35cc0b53e0 2024-04-25T09:12:27.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.609+0000 7f35d2800640 1 -- 172.21.15.175:0/360895941 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35cc0c5f20 con 0x7f35cc0b53e0 2024-04-25T09:12:27.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.613+0000 7f35d2800640 1 -- 172.21.15.175:0/360895941 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35cc0c6950 con 0x7f35cc0b53e0 2024-04-25T09:12:27.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.613+0000 7f35d2800640 1 -- 172.21.15.175:0/360895941 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35cc074a60 con 0x7f35cc0b53e0 2024-04-25T09:12:27.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.613+0000 7f35c3400640 1 -- 172.21.15.175:0/360895941 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f35b400d8d0 con 0x7f35cc0b53e0 2024-04-25T09:12:27.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.613+0000 7f35c3400640 1 --2- 172.21.15.175:0/360895941 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f35a8066f60 0x7f35a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.613+0000 7f35c3400640 1 -- 172.21.15.175:0/360895941 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35b4084e00 con 0x7f35cc0b53e0 2024-04-25T09:12:27.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.613+0000 7f35cb400640 1 --2- 172.21.15.175:0/360895941 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f35a8066f60 0x7f35a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.613+0000 7f35cb400640 1 --2- 172.21.15.175:0/360895941 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f35a8066f60 0x7f35a8069420 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f35bc001060 tx=0x7f35bc000ff0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:27.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.617+0000 7f35c3400640 1 -- 172.21.15.175:0/360895941 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f35b4055720 con 0x7f35cc0b53e0 2024-04-25T09:12:27.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.773+0000 7f35d2800640 1 -- 172.21.15.175:0/360895941 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35cc0b01e0 con 0x7f35cc0b53e0 2024-04-25T09:12:27.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.773+0000 7f35c3400640 1 -- 172.21.15.175:0/360895941 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16646 (secure 0 0 0) 0x7f35b40597c0 con 0x7f35cc0b53e0 2024-04-25T09:12:27.760 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:27.760 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":100,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:12:25.044197+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:12:21.141676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:12:22.422455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:27.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.773+0000 7f35d2800640 1 -- 172.21.15.175:0/360895941 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f35a8066f60 msgr2=0x7f35a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.773+0000 7f35d2800640 1 --2- 172.21.15.175:0/360895941 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f35a8066f60 0x7f35a8069420 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f35bc001060 tx=0x7f35bc000ff0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.773+0000 7f35d2800640 1 -- 172.21.15.175:0/360895941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35cc0b53e0 msgr2=0x7f35cc0af150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.773+0000 7f35d2800640 1 --2- 172.21.15.175:0/360895941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35cc0b53e0 0x7f35cc0af150 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f35b400f7f0 tx=0x7f35b400fcb0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.777+0000 7f35d2800640 1 -- 172.21.15.175:0/360895941 shutdown_connections 2024-04-25T09:12:27.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.777+0000 7f35d2800640 1 --2- 172.21.15.175:0/360895941 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f35a8066f60 0x7f35a8069420 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.777+0000 7f35d2800640 1 --2- 172.21.15.175:0/360895941 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35cc14edd0 0x7f35cc14f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.777+0000 7f35d2800640 1 --2- 172.21.15.175:0/360895941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35cc0b53e0 0x7f35cc0af150 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.777+0000 7f35d2800640 1 --2- 172.21.15.175:0/360895941 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35b0004d50 0x7f35cc0c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.777+0000 7f35d2800640 1 -- 172.21.15.175:0/360895941 >> 172.21.15.175:0/360895941 conn(0x7f35cc0b3300 msgr2=0x7f35cc156db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:27.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.777+0000 7f35d2800640 1 -- 172.21.15.175:0/360895941 shutdown_connections 2024-04-25T09:12:27.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.777+0000 7f35d2800640 1 -- 172.21.15.175:0/360895941 wait complete. 2024-04-25T09:12:27.781 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:12:27.781 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:12:27.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.933+0000 7feb87e00640 1 Processor -- start 2024-04-25T09:12:27.919 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.933+0000 7feb87e00640 1 -- start start 2024-04-25T09:12:27.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.933+0000 7feb87e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7feb880b5370 0x7feb880b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.933+0000 7feb87e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feb880d2d20 0x7feb880b9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.933+0000 7feb87e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb880b5c90 con 0x7feb880d3260 2024-04-25T09:12:27.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.933+0000 7feb87e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb880d19a0 con 0x7feb880d2d20 2024-04-25T09:12:27.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.933+0000 7feb87e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb880d1c80 con 0x7feb880b5370 2024-04-25T09:12:27.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.933+0000 7feb86000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feb880d2d20 0x7feb880b9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.933+0000 7feb86000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feb880d2d20 0x7feb880b9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41412/0 (socket says 172.21.15.175:41412) 2024-04-25T09:12:27.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.933+0000 7feb86000640 1 -- 172.21.15.175:0/2206728458 learned_addr learned my addr 172.21.15.175:0/2206728458 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:27.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.933+0000 7feb86a00640 1 --2- 172.21.15.175:0/2206728458 >> v2:172.21.15.177:3300/0 conn(0x7feb880b5370 0x7feb880b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.933+0000 7feb86000640 1 -- 172.21.15.175:0/2206728458 >> v2:172.21.15.177:3300/0 conn(0x7feb880b5370 msgr2=0x7feb880b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:27.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.933+0000 7feb86000640 1 --2- 172.21.15.175:0/2206728458 >> v2:172.21.15.177:3300/0 conn(0x7feb880b5370 0x7feb880b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.933+0000 7feb86000640 1 -- 172.21.15.175:0/2206728458 >> v1:172.21.15.175:6789/0 conn(0x7feb880d3260 legacy=0x7feb880d36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:27.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.933+0000 7feb86000640 1 -- 172.21.15.175:0/2206728458 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb880d1f60 con 0x7feb880d2d20 2024-04-25T09:12:27.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.937+0000 7feb86000640 1 --2- 172.21.15.175:0/2206728458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb880d2d20 0x7feb880b9210 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7feb8806cf00 tx=0x7feb7401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4e62ead74a9b68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:27.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.937+0000 7feb85600640 1 -- 172.21.15.175:0/2206728458 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb740aa680 con 0x7feb880d2d20 2024-04-25T09:12:27.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.937+0000 7feb85600640 1 -- 172.21.15.175:0/2206728458 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb740af070 con 0x7feb880d2d20 2024-04-25T09:12:27.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.937+0000 7feb85600640 1 -- 172.21.15.175:0/2206728458 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb740aaa40 con 0x7feb880d2d20 2024-04-25T09:12:27.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.937+0000 7feb87e00640 1 -- 172.21.15.175:0/2206728458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb880d2d20 msgr2=0x7feb880b9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.937+0000 7feb87e00640 1 --2- 172.21.15.175:0/2206728458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb880d2d20 0x7feb880b9210 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7feb8806cf00 tx=0x7feb7401c520 comp rx=0 tx=0).stop 2024-04-25T09:12:27.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.937+0000 7feb87e00640 1 -- 172.21.15.175:0/2206728458 shutdown_connections 2024-04-25T09:12:27.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.937+0000 7feb87e00640 1 --2- 172.21.15.175:0/2206728458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb880d2d20 0x7feb880b9210 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.937+0000 7feb87e00640 1 --2- 172.21.15.175:0/2206728458 >> v2:172.21.15.177:3300/0 conn(0x7feb880b5370 0x7feb880b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.937+0000 7feb87e00640 1 -- 172.21.15.175:0/2206728458 >> 172.21.15.175:0/2206728458 conn(0x7feb88072780 msgr2=0x7feb88072b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:27.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.937+0000 7feb87e00640 1 -- 172.21.15.175:0/2206728458 shutdown_connections 2024-04-25T09:12:27.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.937+0000 7feb87e00640 1 -- 172.21.15.175:0/2206728458 wait complete. 2024-04-25T09:12:27.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.937+0000 7feb87e00640 1 Processor -- start 2024-04-25T09:12:27.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87e00640 1 -- start start 2024-04-25T09:12:27.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb880b5370 0x7feb8814e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb880d2d20 0x7feb880cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb880d3260 0x7feb880ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb880b9750 con 0x7feb880d3260 2024-04-25T09:12:27.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb880b6140 con 0x7feb880d2d20 2024-04-25T09:12:27.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8816a9f0 con 0x7feb880b5370 2024-04-25T09:12:27.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb880d3260 0x7feb880ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb880d3260 0x7feb880ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41428/0 (socket says 172.21.15.175:41428) 2024-04-25T09:12:27.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87400640 1 -- 172.21.15.175:0/1987634295 learned_addr learned my addr 172.21.15.175:0/1987634295 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:27.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb86a00640 1 --2- 172.21.15.175:0/1987634295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb880b5370 0x7feb8814e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb86000640 1 --2- 172.21.15.175:0/1987634295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb880d2d20 0x7feb880cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87400640 1 -- 172.21.15.175:0/1987634295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb880b5370 msgr2=0x7feb8814e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87400640 1 --2- 172.21.15.175:0/1987634295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb880b5370 0x7feb8814e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87400640 1 -- 172.21.15.175:0/1987634295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb880d2d20 msgr2=0x7feb880cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:27.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87400640 1 --2- 172.21.15.175:0/1987634295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb880d2d20 0x7feb880cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:27.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87400640 1 -- 172.21.15.175:0/1987634295 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8806cb00 con 0x7feb880d3260 2024-04-25T09:12:27.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87400640 1 --2- 172.21.15.175:0/1987634295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb880d3260 0x7feb880ccaf0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c770 tx=0x7feb8000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:27.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb7ea00640 1 -- 172.21.15.175:0/1987634295 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80003b80 con 0x7feb880d3260 2024-04-25T09:12:27.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb7ea00640 1 -- 172.21.15.175:0/1987634295 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb80003d20 con 0x7feb880d3260 2024-04-25T09:12:27.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb7ea00640 1 -- 172.21.15.175:0/1987634295 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8000aa90 con 0x7feb880d3260 2024-04-25T09:12:27.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87e00640 1 -- 172.21.15.175:0/1987634295 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8814e5b0 con 0x7feb880d3260 2024-04-25T09:12:27.929 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87e00640 1 -- 172.21.15.175:0/1987634295 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8815b710 con 0x7feb880d3260 2024-04-25T09:12:27.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.941+0000 7feb87e00640 1 -- 172.21.15.175:0/1987634295 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb88074a60 con 0x7feb880d3260 2024-04-25T09:12:27.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.945+0000 7feb7ea00640 1 -- 172.21.15.175:0/1987634295 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feb8000ac30 con 0x7feb880d3260 2024-04-25T09:12:27.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.945+0000 7feb7ea00640 1 --2- 172.21.15.175:0/1987634295 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feb68066f60 0x7feb68069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:27.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.945+0000 7feb7ea00640 1 -- 172.21.15.175:0/1987634295 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb80084ec0 con 0x7feb880d3260 2024-04-25T09:12:27.931 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.945+0000 7feb86a00640 1 --2- 172.21.15.175:0/1987634295 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feb68066f60 0x7feb68069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:27.932 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.945+0000 7feb86a00640 1 --2- 172.21.15.175:0/1987634295 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feb68066f60 0x7feb68069420 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7feb880681f0 tx=0x7feb78009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:27.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:27.949+0000 7feb7ea00640 1 -- 172.21.15.175:0/1987634295 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feb800557e0 con 0x7feb880d3260 2024-04-25T09:12:28.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.101+0000 7feb87e00640 1 -- 172.21.15.175:0/1987634295 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb880c9da0 con 0x7feb68066f60 2024-04-25T09:12:28.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.109+0000 7feb7ea00640 1 -- 172.21.15.175:0/1987634295 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252183 (secure 0 0 0) 0x7feb880c9da0 con 0x7feb68066f60 2024-04-25T09:12:28.097 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:28.098 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:12:28.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.109+0000 7feb87e00640 1 -- 172.21.15.175:0/1987634295 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feb68066f60 msgr2=0x7feb68069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:28.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.109+0000 7feb87e00640 1 --2- 172.21.15.175:0/1987634295 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feb68066f60 0x7feb68069420 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7feb880681f0 tx=0x7feb78009190 comp rx=0 tx=0).stop 2024-04-25T09:12:28.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.109+0000 7feb87e00640 1 -- 172.21.15.175:0/1987634295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb880d3260 msgr2=0x7feb880ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:28.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.109+0000 7feb87e00640 1 --2- 172.21.15.175:0/1987634295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb880d3260 0x7feb880ccaf0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7feb8000c770 tx=0x7feb8000cc30 comp rx=0 tx=0).stop 2024-04-25T09:12:28.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.109+0000 7feb87e00640 1 -- 172.21.15.175:0/1987634295 shutdown_connections 2024-04-25T09:12:28.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.109+0000 7feb87e00640 1 --2- 172.21.15.175:0/1987634295 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feb68066f60 0x7feb68069420 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.109+0000 7feb87e00640 1 --2- 172.21.15.175:0/1987634295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb880d3260 0x7feb880ccaf0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.109+0000 7feb87e00640 1 --2- 172.21.15.175:0/1987634295 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7feb880d2d20 0x7feb880cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.109+0000 7feb87e00640 1 --2- 172.21.15.175:0/1987634295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7feb880b5370 0x7feb8814e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.109+0000 7feb87e00640 1 -- 172.21.15.175:0/1987634295 >> 172.21.15.175:0/1987634295 conn(0x7feb88072780 msgr2=0x7feb881599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:28.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.109+0000 7feb87e00640 1 -- 172.21.15.175:0/1987634295 shutdown_connections 2024-04-25T09:12:28.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.109+0000 7feb87e00640 1 -- 172.21.15.175:0/1987634295 wait complete. 2024-04-25T09:12:28.117 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2024-04-25T09:12:27.904706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260360,"kb_used_data":10888,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714360,"statfs":{"total":773094113280,"available":772827504640,"internally_reserved":0,"allocated":11149312,"data_stored":5464348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.875557"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230082+0000","last_change":"2024-04-25T09:12:24.063406+0000","last_active":"2024-04-25T09:12:25.230082+0000","last_peered":"2024-04-25T09:12:25.230082+0000","last_clean":"2024-04-25T09:12:25.230082+0000","last_became_active":"2024-04-25T09:12:24.063111+0000","last_became_peered":"2024-04-25T09:12:24.063111+0000","last_unstale":"2024-04-25T09:12:25.230082+0000","last_undegraded":"2024-04-25T09:12:25.230082+0000","last_fullsized":"2024-04-25T09:12:25.230082+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:23.232804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072924+0000","last_change":"2024-04-25T09:12:24.071818+0000","last_active":"2024-04-25T09:12:25.072924+0000","last_peered":"2024-04-25T09:12:25.072924+0000","last_clean":"2024-04-25T09:12:25.072924+0000","last_became_active":"2024-04-25T09:12:24.071513+0000","last_became_peered":"2024-04-25T09:12:24.071513+0000","last_unstale":"2024-04-25T09:12:25.072924+0000","last_undegraded":"2024-04-25T09:12:25.072924+0000","last_fullsized":"2024-04-25T09:12:25.072924+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:12.699624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230044+0000","last_change":"2024-04-25T09:12:24.072710+0000","last_active":"2024-04-25T09:12:25.230044+0000","last_peered":"2024-04-25T09:12:25.230044+0000","last_clean":"2024-04-25T09:12:25.230044+0000","last_became_active":"2024-04-25T09:12:24.072359+0000","last_became_peered":"2024-04-25T09:12:24.072359+0000","last_unstale":"2024-04-25T09:12:25.230044+0000","last_undegraded":"2024-04-25T09:12:25.230044+0000","last_fullsized":"2024-04-25T09:12:25.230044+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:51.350547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230258+0000","last_change":"2024-04-25T09:12:24.060876+0000","last_active":"2024-04-25T09:12:25.230258+0000","last_peered":"2024-04-25T09:12:25.230258+0000","last_clean":"2024-04-25T09:12:25.230258+0000","last_became_active":"2024-04-25T09:12:24.058126+0000","last_became_peered":"2024-04-25T09:12:24.058126+0000","last_unstale":"2024-04-25T09:12:25.230258+0000","last_undegraded":"2024-04-25T09:12:25.230258+0000","last_fullsized":"2024-04-25T09:12:25.230258+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:16.493641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.058028+0000","last_change":"2024-04-25T09:12:24.061744+0000","last_active":"2024-04-25T09:12:25.058028+0000","last_peered":"2024-04-25T09:12:25.058028+0000","last_clean":"2024-04-25T09:12:25.058028+0000","last_became_active":"2024-04-25T09:12:24.061438+0000","last_became_peered":"2024-04-25T09:12:24.061438+0000","last_unstale":"2024-04-25T09:12:25.058028+0000","last_undegraded":"2024-04-25T09:12:25.058028+0000","last_fullsized":"2024-04-25T09:12:25.058028+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:06.054189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234249+0000","last_change":"2024-04-25T09:12:24.074595+0000","last_active":"2024-04-25T09:12:25.234249+0000","last_peered":"2024-04-25T09:12:25.234249+0000","last_clean":"2024-04-25T09:12:25.234249+0000","last_became_active":"2024-04-25T09:12:24.074332+0000","last_became_peered":"2024-04-25T09:12:24.074332+0000","last_unstale":"2024-04-25T09:12:25.234249+0000","last_undegraded":"2024-04-25T09:12:25.234249+0000","last_fullsized":"2024-04-25T09:12:25.234249+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:20.600418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.233932+0000","last_change":"2024-04-25T09:12:24.070168+0000","last_active":"2024-04-25T09:12:25.233932+0000","last_peered":"2024-04-25T09:12:25.233932+0000","last_clean":"2024-04-25T09:12:25.233932+0000","last_became_active":"2024-04-25T09:12:24.069862+0000","last_became_peered":"2024-04-25T09:12:24.069862+0000","last_unstale":"2024-04-25T09:12:25.233932+0000","last_undegraded":"2024-04-25T09:12:25.233932+0000","last_fullsized":"2024-04-25T09:12:25.233932+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:33.872828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072780+0000","last_change":"2024-04-25T09:12:24.062933+0000","last_active":"2024-04-25T09:12:25.072780+0000","last_peered":"2024-04-25T09:12:25.072780+0000","last_clean":"2024-04-25T09:12:25.072780+0000","last_became_active":"2024-04-25T09:12:24.062698+0000","last_became_peered":"2024-04-25T09:12:24.062698+0000","last_unstale":"2024-04-25T09:12:25.072780+0000","last_undegraded":"2024-04-25T09:12:25.072780+0000","last_fullsized":"2024-04-25T09:12:25.072780+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:47.295703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057376+0000","last_change":"2024-04-25T09:12:24.059607+0000","last_active":"2024-04-25T09:12:25.057376+0000","last_peered":"2024-04-25T09:12:25.057376+0000","last_clean":"2024-04-25T09:12:25.057376+0000","last_became_active":"2024-04-25T09:12:24.059280+0000","last_became_peered":"2024-04-25T09:12:24.059280+0000","last_unstale":"2024-04-25T09:12:25.057376+0000","last_undegraded":"2024-04-25T09:12:25.057376+0000","last_fullsized":"2024-04-25T09:12:25.057376+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:37.214846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057983+0000","last_change":"2024-04-25T09:12:24.065811+0000","last_active":"2024-04-25T09:12:25.057983+0000","last_peered":"2024-04-25T09:12:25.057983+0000","last_clean":"2024-04-25T09:12:25.057983+0000","last_became_active":"2024-04-25T09:12:24.065481+0000","last_became_peered":"2024-04-25T09:12:24.065481+0000","last_unstale":"2024-04-25T09:12:25.057983+0000","last_undegraded":"2024-04-25T09:12:25.057983+0000","last_fullsized":"2024-04-25T09:12:25.057983+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:51.544140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234199+0000","last_change":"2024-04-25T09:12:24.075606+0000","last_active":"2024-04-25T09:12:25.234199+0000","last_peered":"2024-04-25T09:12:25.234199+0000","last_clean":"2024-04-25T09:12:25.234199+0000","last_became_active":"2024-04-25T09:12:24.074978+0000","last_became_peered":"2024-04-25T09:12:24.074978+0000","last_unstale":"2024-04-25T09:12:25.234199+0000","last_undegraded":"2024-04-25T09:12:25.234199+0000","last_fullsized":"2024-04-25T09:12:25.234199+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:47.295703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057453+0000","last_change":"2024-04-25T09:12:24.072663+0000","last_active":"2024-04-25T09:12:25.057453+0000","last_peered":"2024-04-25T09:12:25.057453+0000","last_clean":"2024-04-25T09:12:25.057453+0000","last_became_active":"2024-04-25T09:12:24.072339+0000","last_became_peered":"2024-04-25T09:12:24.072339+0000","last_unstale":"2024-04-25T09:12:25.057453+0000","last_undegraded":"2024-04-25T09:12:25.057453+0000","last_fullsized":"2024-04-25T09:12:25.057453+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:05.494039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230473+0000","last_change":"2024-04-25T09:12:24.053708+0000","last_active":"2024-04-25T09:12:25.230473+0000","last_peered":"2024-04-25T09:12:25.230473+0000","last_clean":"2024-04-25T09:12:25.230473+0000","last_became_active":"2024-04-25T09:12:24.053392+0000","last_became_peered":"2024-04-25T09:12:24.053392+0000","last_unstale":"2024-04-25T09:12:25.230473+0000","last_undegraded":"2024-04-25T09:12:25.230473+0000","last_fullsized":"2024-04-25T09:12:25.230473+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:12.699624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.048964+0000","last_change":"2024-04-25T09:12:24.071342+0000","last_active":"2024-04-25T09:12:25.048964+0000","last_peered":"2024-04-25T09:12:25.048964+0000","last_clean":"2024-04-25T09:12:25.048964+0000","last_became_active":"2024-04-25T09:12:24.071108+0000","last_became_peered":"2024-04-25T09:12:24.071108+0000","last_unstale":"2024-04-25T09:12:25.048964+0000","last_undegraded":"2024-04-25T09:12:25.048964+0000","last_fullsized":"2024-04-25T09:12:25.048964+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:10.641589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229761+0000","last_change":"2024-04-25T09:12:24.068307+0000","last_active":"2024-04-25T09:12:25.229761+0000","last_peered":"2024-04-25T09:12:25.229761+0000","last_clean":"2024-04-25T09:12:25.229761+0000","last_became_active":"2024-04-25T09:12:24.068046+0000","last_became_peered":"2024-04-25T09:12:24.068046+0000","last_unstale":"2024-04-25T09:12:25.229761+0000","last_undegraded":"2024-04-25T09:12:25.229761+0000","last_fullsized":"2024-04-25T09:12:25.229761+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:47.295703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.233669+0000","last_change":"2024-04-25T09:12:24.073701+0000","last_active":"2024-04-25T09:12:25.233669+0000","last_peered":"2024-04-25T09:12:25.233669+0000","last_clean":"2024-04-25T09:12:25.233669+0000","last_became_active":"2024-04-25T09:12:24.072204+0000","last_became_peered":"2024-04-25T09:12:24.072204+0000","last_unstale":"2024-04-25T09:12:25.233669+0000","last_undegraded":"2024-04-25T09:12:25.233669+0000","last_fullsized":"2024-04-25T09:12:25.233669+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:47.091378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.073396+0000","last_change":"2024-04-25T09:12:24.063392+0000","last_active":"2024-04-25T09:12:25.073396+0000","last_peered":"2024-04-25T09:12:25.073396+0000","last_clean":"2024-04-25T09:12:25.073396+0000","last_became_active":"2024-04-25T09:12:24.061146+0000","last_became_peered":"2024-04-25T09:12:24.061146+0000","last_unstale":"2024-04-25T09:12:25.073396+0000","last_undegraded":"2024-04-25T09:12:25.073396+0000","last_fullsized":"2024-04-25T09:12:25.073396+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:56.426634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230475+0000","last_change":"2024-04-25T09:12:24.063232+0000","last_active":"2024-04-25T09:12:25.230475+0000","last_peered":"2024-04-25T09:12:25.230475+0000","last_clean":"2024-04-25T09:12:25.230475+0000","last_became_active":"2024-04-25T09:12:24.062612+0000","last_became_peered":"2024-04-25T09:12:24.062612+0000","last_unstale":"2024-04-25T09:12:25.230475+0000","last_undegraded":"2024-04-25T09:12:25.230475+0000","last_fullsized":"2024-04-25T09:12:25.230475+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:17.924700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049427+0000","last_change":"2024-04-25T09:12:24.072906+0000","last_active":"2024-04-25T09:12:25.049427+0000","last_peered":"2024-04-25T09:12:25.049427+0000","last_clean":"2024-04-25T09:12:25.049427+0000","last_became_active":"2024-04-25T09:12:24.072629+0000","last_became_peered":"2024-04-25T09:12:24.072629+0000","last_unstale":"2024-04-25T09:12:25.049427+0000","last_undegraded":"2024-04-25T09:12:25.049427+0000","last_fullsized":"2024-04-25T09:12:25.049427+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:16.767414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057763+0000","last_change":"2024-04-25T09:12:24.060091+0000","last_active":"2024-04-25T09:12:25.057763+0000","last_peered":"2024-04-25T09:12:25.057763+0000","last_clean":"2024-04-25T09:12:25.057763+0000","last_became_active":"2024-04-25T09:12:24.059795+0000","last_became_peered":"2024-04-25T09:12:24.059795+0000","last_unstale":"2024-04-25T09:12:25.057763+0000","last_undegraded":"2024-04-25T09:12:25.057763+0000","last_fullsized":"2024-04-25T09:12:25.057763+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:33.872828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049343+0000","last_change":"2024-04-25T09:12:24.067353+0000","last_active":"2024-04-25T09:12:25.049343+0000","last_peered":"2024-04-25T09:12:25.049343+0000","last_clean":"2024-04-25T09:12:25.049343+0000","last_became_active":"2024-04-25T09:12:24.066652+0000","last_became_peered":"2024-04-25T09:12:24.066652+0000","last_unstale":"2024-04-25T09:12:25.049343+0000","last_undegraded":"2024-04-25T09:12:25.049343+0000","last_fullsized":"2024-04-25T09:12:25.049343+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:25.814545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072894+0000","last_change":"2024-04-25T09:12:24.068954+0000","last_active":"2024-04-25T09:12:25.072894+0000","last_peered":"2024-04-25T09:12:25.072894+0000","last_clean":"2024-04-25T09:12:25.072894+0000","last_became_active":"2024-04-25T09:12:24.068661+0000","last_became_peered":"2024-04-25T09:12:24.068661+0000","last_unstale":"2024-04-25T09:12:25.072894+0000","last_undegraded":"2024-04-25T09:12:25.072894+0000","last_fullsized":"2024-04-25T09:12:25.072894+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:40.274184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072821+0000","last_change":"2024-04-25T09:12:24.061685+0000","last_active":"2024-04-25T09:12:25.072821+0000","last_peered":"2024-04-25T09:12:25.072821+0000","last_clean":"2024-04-25T09:12:25.072821+0000","last_became_active":"2024-04-25T09:12:24.061302+0000","last_became_peered":"2024-04-25T09:12:24.061302+0000","last_unstale":"2024-04-25T09:12:25.072821+0000","last_undegraded":"2024-04-25T09:12:25.072821+0000","last_fullsized":"2024-04-25T09:12:25.072821+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:20.600418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234065+0000","last_change":"2024-04-25T09:12:24.073919+0000","last_active":"2024-04-25T09:12:25.234065+0000","last_peered":"2024-04-25T09:12:25.234065+0000","last_clean":"2024-04-25T09:12:25.234065+0000","last_became_active":"2024-04-25T09:12:24.073434+0000","last_became_peered":"2024-04-25T09:12:24.073434+0000","last_unstale":"2024-04-25T09:12:25.234065+0000","last_undegraded":"2024-04-25T09:12:25.234065+0000","last_fullsized":"2024-04-25T09:12:25.234065+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:33.816127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.058336+0000","last_change":"2024-04-25T09:12:24.074799+0000","last_active":"2024-04-25T09:12:25.058336+0000","last_peered":"2024-04-25T09:12:25.058336+0000","last_clean":"2024-04-25T09:12:25.058336+0000","last_became_active":"2024-04-25T09:12:24.073723+0000","last_became_peered":"2024-04-25T09:12:24.073723+0000","last_unstale":"2024-04-25T09:12:25.058336+0000","last_undegraded":"2024-04-25T09:12:25.058336+0000","last_fullsized":"2024-04-25T09:12:25.058336+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:52.135000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.073090+0000","last_change":"2024-04-25T09:12:24.061407+0000","last_active":"2024-04-25T09:12:25.073090+0000","last_peered":"2024-04-25T09:12:25.073090+0000","last_clean":"2024-04-25T09:12:25.073090+0000","last_became_active":"2024-04-25T09:12:24.061069+0000","last_became_peered":"2024-04-25T09:12:24.061069+0000","last_unstale":"2024-04-25T09:12:25.073090+0000","last_undegraded":"2024-04-25T09:12:25.073090+0000","last_fullsized":"2024-04-25T09:12:25.073090+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:16.493641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234414+0000","last_change":"2024-04-25T09:12:24.071145+0000","last_active":"2024-04-25T09:12:25.234414+0000","last_peered":"2024-04-25T09:12:25.234414+0000","last_clean":"2024-04-25T09:12:25.234414+0000","last_became_active":"2024-04-25T09:12:24.070805+0000","last_became_peered":"2024-04-25T09:12:24.070805+0000","last_unstale":"2024-04-25T09:12:25.234414+0000","last_undegraded":"2024-04-25T09:12:25.234414+0000","last_fullsized":"2024-04-25T09:12:25.234414+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:40.274184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.058153+0000","last_change":"2024-04-25T09:12:24.061674+0000","last_active":"2024-04-25T09:12:25.058153+0000","last_peered":"2024-04-25T09:12:25.058153+0000","last_clean":"2024-04-25T09:12:25.058153+0000","last_became_active":"2024-04-25T09:12:24.061351+0000","last_became_peered":"2024-04-25T09:12:24.061351+0000","last_unstale":"2024-04-25T09:12:25.058153+0000","last_undegraded":"2024-04-25T09:12:25.058153+0000","last_fullsized":"2024-04-25T09:12:25.058153+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:48.406721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.073276+0000","last_change":"2024-04-25T09:12:24.060902+0000","last_active":"2024-04-25T09:12:25.073276+0000","last_peered":"2024-04-25T09:12:25.073276+0000","last_clean":"2024-04-25T09:12:25.073276+0000","last_became_active":"2024-04-25T09:12:24.060636+0000","last_became_peered":"2024-04-25T09:12:24.060636+0000","last_unstale":"2024-04-25T09:12:25.073276+0000","last_undegraded":"2024-04-25T09:12:25.073276+0000","last_fullsized":"2024-04-25T09:12:25.073276+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:28.166932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049009+0000","last_change":"2024-04-25T09:12:24.067004+0000","last_active":"2024-04-25T09:12:25.049009+0000","last_peered":"2024-04-25T09:12:25.049009+0000","last_clean":"2024-04-25T09:12:25.049009+0000","last_became_active":"2024-04-25T09:12:24.066694+0000","last_became_peered":"2024-04-25T09:12:24.066694+0000","last_unstale":"2024-04-25T09:12:25.049009+0000","last_undegraded":"2024-04-25T09:12:25.049009+0000","last_fullsized":"2024-04-25T09:12:25.049009+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:33:43.297904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229938+0000","last_change":"2024-04-25T09:12:24.056994+0000","last_active":"2024-04-25T09:12:25.229938+0000","last_peered":"2024-04-25T09:12:25.229938+0000","last_clean":"2024-04-25T09:12:25.229938+0000","last_became_active":"2024-04-25T09:12:24.056655+0000","last_became_peered":"2024-04-25T09:12:24.056655+0000","last_unstale":"2024-04-25T09:12:25.229938+0000","last_undegraded":"2024-04-25T09:12:25.229938+0000","last_fullsized":"2024-04-25T09:12:25.229938+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:40.274184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229553+0000","last_change":"2024-04-25T09:12:24.069510+0000","last_active":"2024-04-25T09:12:25.229553+0000","last_peered":"2024-04-25T09:12:25.229553+0000","last_clean":"2024-04-25T09:12:25.229553+0000","last_became_active":"2024-04-25T09:12:24.069221+0000","last_became_peered":"2024-04-25T09:12:24.069221+0000","last_unstale":"2024-04-25T09:12:25.229553+0000","last_undegraded":"2024-04-25T09:12:25.229553+0000","last_fullsized":"2024-04-25T09:12:25.229553+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:36.387540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049561+0000","last_change":"2024-04-25T09:12:24.062361+0000","last_active":"2024-04-25T09:12:25.049561+0000","last_peered":"2024-04-25T09:12:25.049561+0000","last_clean":"2024-04-25T09:12:25.049561+0000","last_became_active":"2024-04-25T09:12:24.062133+0000","last_became_peered":"2024-04-25T09:12:24.062133+0000","last_unstale":"2024-04-25T09:12:25.049561+0000","last_undegraded":"2024-04-25T09:12:25.049561+0000","last_fullsized":"2024-04-25T09:12:25.049561+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:00.060648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"99'4","reported_seq":18,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.073344+0000","last_change":"2024-04-25T09:12:23.059374+0000","last_active":"2024-04-25T09:12:25.073344+0000","last_peered":"2024-04-25T09:12:25.073344+0000","last_clean":"2024-04-25T09:12:25.073344+0000","last_became_active":"2024-04-25T09:12:23.059108+0000","last_became_peered":"2024-04-25T09:12:23.059108+0000","last_unstale":"2024-04-25T09:12:25.073344+0000","last_undegraded":"2024-04-25T09:12:25.073344+0000","last_fullsized":"2024-04-25T09:12:25.073344+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:56.750430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230558+0000","last_change":"2024-04-25T09:12:24.062260+0000","last_active":"2024-04-25T09:12:25.230558+0000","last_peered":"2024-04-25T09:12:25.230558+0000","last_clean":"2024-04-25T09:12:25.230558+0000","last_became_active":"2024-04-25T09:12:24.061961+0000","last_became_peered":"2024-04-25T09:12:24.061961+0000","last_unstale":"2024-04-25T09:12:25.230558+0000","last_undegraded":"2024-04-25T09:12:25.230558+0000","last_fullsized":"2024-04-25T09:12:25.230558+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:56.079266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"99'1","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234320+0000","last_change":"2024-04-25T09:12:23.062596+0000","last_active":"2024-04-25T09:12:25.234320+0000","last_peered":"2024-04-25T09:12:25.234320+0000","last_clean":"2024-04-25T09:12:25.234320+0000","last_became_active":"2024-04-25T09:12:23.062060+0000","last_became_peered":"2024-04-25T09:12:23.062060+0000","last_unstale":"2024-04-25T09:12:25.234320+0000","last_undegraded":"2024-04-25T09:12:25.234320+0000","last_fullsized":"2024-04-25T09:12:25.234320+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:08.014892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230044+0000","last_change":"2024-04-25T09:12:24.076495+0000","last_active":"2024-04-25T09:12:25.230044+0000","last_peered":"2024-04-25T09:12:25.230044+0000","last_clean":"2024-04-25T09:12:25.230044+0000","last_became_active":"2024-04-25T09:12:24.076148+0000","last_became_peered":"2024-04-25T09:12:24.076148+0000","last_unstale":"2024-04-25T09:12:25.230044+0000","last_undegraded":"2024-04-25T09:12:25.230044+0000","last_fullsized":"2024-04-25T09:12:25.230044+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:19.686462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"99'2","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072869+0000","last_change":"2024-04-25T09:12:23.056086+0000","last_active":"2024-04-25T09:12:25.072869+0000","last_peered":"2024-04-25T09:12:25.072869+0000","last_clean":"2024-04-25T09:12:25.072869+0000","last_became_active":"2024-04-25T09:12:23.055862+0000","last_became_peered":"2024-04-25T09:12:23.055862+0000","last_unstale":"2024-04-25T09:12:25.072869+0000","last_undegraded":"2024-04-25T09:12:25.072869+0000","last_fullsized":"2024-04-25T09:12:25.072869+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:08.014892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057569+0000","last_change":"2024-04-25T09:12:24.068603+0000","last_active":"2024-04-25T09:12:25.057569+0000","last_peered":"2024-04-25T09:12:25.057569+0000","last_clean":"2024-04-25T09:12:25.057569+0000","last_became_active":"2024-04-25T09:12:24.068296+0000","last_became_peered":"2024-04-25T09:12:24.068296+0000","last_unstale":"2024-04-25T09:12:25.057569+0000","last_undegraded":"2024-04-25T09:12:25.057569+0000","last_fullsized":"2024-04-25T09:12:25.057569+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:47.091378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"99'2","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072925+0000","last_change":"2024-04-25T09:12:23.056489+0000","last_active":"2024-04-25T09:12:25.072925+0000","last_peered":"2024-04-25T09:12:25.072925+0000","last_clean":"2024-04-25T09:12:25.072925+0000","last_became_active":"2024-04-25T09:12:23.056185+0000","last_became_peered":"2024-04-25T09:12:23.056185+0000","last_unstale":"2024-04-25T09:12:25.072925+0000","last_undegraded":"2024-04-25T09:12:25.072925+0000","last_fullsized":"2024-04-25T09:12:25.072925+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:33.782597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.233923+0000","last_change":"2024-04-25T09:12:24.079049+0000","last_active":"2024-04-25T09:12:25.233923+0000","last_peered":"2024-04-25T09:12:25.233923+0000","last_clean":"2024-04-25T09:12:25.233923+0000","last_became_active":"2024-04-25T09:12:24.078705+0000","last_became_peered":"2024-04-25T09:12:24.078705+0000","last_unstale":"2024-04-25T09:12:25.233923+0000","last_undegraded":"2024-04-25T09:12:25.233923+0000","last_fullsized":"2024-04-25T09:12:25.233923+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:00.546189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"99'1","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229751+0000","last_change":"2024-04-25T09:12:23.052540+0000","last_active":"2024-04-25T09:12:25.229751+0000","last_peered":"2024-04-25T09:12:25.229751+0000","last_clean":"2024-04-25T09:12:25.229751+0000","last_became_active":"2024-04-25T09:12:23.052315+0000","last_became_peered":"2024-04-25T09:12:23.052315+0000","last_unstale":"2024-04-25T09:12:25.229751+0000","last_undegraded":"2024-04-25T09:12:25.229751+0000","last_fullsized":"2024-04-25T09:12:25.229751+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:59.053797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234543+0000","last_change":"2024-04-25T09:12:24.076776+0000","last_active":"2024-04-25T09:12:25.234543+0000","last_peered":"2024-04-25T09:12:25.234543+0000","last_clean":"2024-04-25T09:12:25.234543+0000","last_became_active":"2024-04-25T09:12:24.076410+0000","last_became_peered":"2024-04-25T09:12:24.076410+0000","last_unstale":"2024-04-25T09:12:25.234543+0000","last_undegraded":"2024-04-25T09:12:25.234543+0000","last_fullsized":"2024-04-25T09:12:25.234543+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:16.493641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"99'1","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072692+0000","last_change":"2024-04-25T09:12:23.057844+0000","last_active":"2024-04-25T09:12:25.072692+0000","last_peered":"2024-04-25T09:12:25.072692+0000","last_clean":"2024-04-25T09:12:25.072692+0000","last_became_active":"2024-04-25T09:12:23.057584+0000","last_became_peered":"2024-04-25T09:12:23.057584+0000","last_unstale":"2024-04-25T09:12:25.072692+0000","last_undegraded":"2024-04-25T09:12:25.072692+0000","last_fullsized":"2024-04-25T09:12:25.072692+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:42.719555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229761+0000","last_change":"2024-04-25T09:12:24.068243+0000","last_active":"2024-04-25T09:12:25.229761+0000","last_peered":"2024-04-25T09:12:25.229761+0000","last_clean":"2024-04-25T09:12:25.229761+0000","last_became_active":"2024-04-25T09:12:24.067997+0000","last_became_peered":"2024-04-25T09:12:24.067997+0000","last_unstale":"2024-04-25T09:12:25.229761+0000","last_undegraded":"2024-04-25T09:12:25.229761+0000","last_fullsized":"2024-04-25T09:12:25.229761+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:33.816127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.058193+0000","last_change":"2024-04-25T09:12:23.062684+0000","last_active":"2024-04-25T09:12:25.058193+0000","last_peered":"2024-04-25T09:12:25.058193+0000","last_clean":"2024-04-25T09:12:25.058193+0000","last_became_active":"2024-04-25T09:12:23.062358+0000","last_became_peered":"2024-04-25T09:12:23.062358+0000","last_unstale":"2024-04-25T09:12:25.058193+0000","last_undegraded":"2024-04-25T09:12:25.058193+0000","last_fullsized":"2024-04-25T09:12:25.058193+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:22:05.401271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.056832+0000","last_change":"2024-04-25T09:12:24.068501+0000","last_active":"2024-04-25T09:12:25.056832+0000","last_peered":"2024-04-25T09:12:25.056832+0000","last_clean":"2024-04-25T09:12:25.056832+0000","last_became_active":"2024-04-25T09:12:24.068066+0000","last_became_peered":"2024-04-25T09:12:24.068066+0000","last_unstale":"2024-04-25T09:12:25.056832+0000","last_undegraded":"2024-04-25T09:12:25.056832+0000","last_fullsized":"2024-04-25T09:12:25.056832+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:10.258994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229502+0000","last_change":"2024-04-25T09:12:23.053968+0000","last_active":"2024-04-25T09:12:25.229502+0000","last_peered":"2024-04-25T09:12:25.229502+0000","last_clean":"2024-04-25T09:12:25.229502+0000","last_became_active":"2024-04-25T09:12:23.051835+0000","last_became_peered":"2024-04-25T09:12:23.051835+0000","last_unstale":"2024-04-25T09:12:25.229502+0000","last_undegraded":"2024-04-25T09:12:25.229502+0000","last_fullsized":"2024-04-25T09:12:25.229502+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.316987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.073127+0000","last_change":"2024-04-25T09:12:24.066175+0000","last_active":"2024-04-25T09:12:25.073127+0000","last_peered":"2024-04-25T09:12:25.073127+0000","last_clean":"2024-04-25T09:12:25.073127+0000","last_became_active":"2024-04-25T09:12:24.065868+0000","last_became_peered":"2024-04-25T09:12:24.065868+0000","last_unstale":"2024-04-25T09:12:25.073127+0000","last_undegraded":"2024-04-25T09:12:25.073127+0000","last_fullsized":"2024-04-25T09:12:25.073127+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:17.924700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230386+0000","last_change":"2024-04-25T09:12:23.054844+0000","last_active":"2024-04-25T09:12:25.230386+0000","last_peered":"2024-04-25T09:12:25.230386+0000","last_clean":"2024-04-25T09:12:25.230386+0000","last_became_active":"2024-04-25T09:12:23.053859+0000","last_became_peered":"2024-04-25T09:12:23.053859+0000","last_unstale":"2024-04-25T09:12:25.230386+0000","last_undegraded":"2024-04-25T09:12:25.230386+0000","last_fullsized":"2024-04-25T09:12:25.230386+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:45.020865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057278+0000","last_change":"2024-04-25T09:12:24.069250+0000","last_active":"2024-04-25T09:12:25.057278+0000","last_peered":"2024-04-25T09:12:25.057278+0000","last_clean":"2024-04-25T09:12:25.057278+0000","last_became_active":"2024-04-25T09:12:24.068938+0000","last_became_peered":"2024-04-25T09:12:24.068938+0000","last_unstale":"2024-04-25T09:12:25.057278+0000","last_undegraded":"2024-04-25T09:12:25.057278+0000","last_fullsized":"2024-04-25T09:12:25.057278+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:41.021989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230365+0000","last_change":"2024-04-25T09:12:23.060146+0000","last_active":"2024-04-25T09:12:25.230365+0000","last_peered":"2024-04-25T09:12:25.230365+0000","last_clean":"2024-04-25T09:12:25.230365+0000","last_became_active":"2024-04-25T09:12:23.059847+0000","last_became_peered":"2024-04-25T09:12:23.059847+0000","last_unstale":"2024-04-25T09:12:25.230365+0000","last_undegraded":"2024-04-25T09:12:25.230365+0000","last_fullsized":"2024-04-25T09:12:25.230365+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:05.047339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.058186+0000","last_change":"2024-04-25T09:12:24.068747+0000","last_active":"2024-04-25T09:12:25.058186+0000","last_peered":"2024-04-25T09:12:25.058186+0000","last_clean":"2024-04-25T09:12:25.058186+0000","last_became_active":"2024-04-25T09:12:24.068497+0000","last_became_peered":"2024-04-25T09:12:24.068497+0000","last_unstale":"2024-04-25T09:12:25.058186+0000","last_undegraded":"2024-04-25T09:12:25.058186+0000","last_fullsized":"2024-04-25T09:12:25.058186+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:10.258994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"99'3","reported_seq":17,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234513+0000","last_change":"2024-04-25T09:12:23.061705+0000","last_active":"2024-04-25T09:12:25.234513+0000","last_peered":"2024-04-25T09:12:25.234513+0000","last_clean":"2024-04-25T09:12:25.234513+0000","last_became_active":"2024-04-25T09:12:23.061374+0000","last_became_peered":"2024-04-25T09:12:23.061374+0000","last_unstale":"2024-04-25T09:12:25.234513+0000","last_undegraded":"2024-04-25T09:12:25.234513+0000","last_fullsized":"2024-04-25T09:12:25.234513+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:59.539339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234430+0000","last_change":"2024-04-25T09:12:24.075828+0000","last_active":"2024-04-25T09:12:25.234430+0000","last_peered":"2024-04-25T09:12:25.234430+0000","last_clean":"2024-04-25T09:12:25.234430+0000","last_became_active":"2024-04-25T09:12:24.075346+0000","last_became_peered":"2024-04-25T09:12:24.075346+0000","last_unstale":"2024-04-25T09:12:25.234430+0000","last_undegraded":"2024-04-25T09:12:25.234430+0000","last_fullsized":"2024-04-25T09:12:25.234430+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:12.699624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"99'6","reported_seq":20,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057643+0000","last_change":"2024-04-25T09:12:23.055885+0000","last_active":"2024-04-25T09:12:25.057643+0000","last_peered":"2024-04-25T09:12:25.057643+0000","last_clean":"2024-04-25T09:12:25.057643+0000","last_became_active":"2024-04-25T09:12:23.054998+0000","last_became_peered":"2024-04-25T09:12:23.054998+0000","last_unstale":"2024-04-25T09:12:25.057643+0000","last_undegraded":"2024-04-25T09:12:25.057643+0000","last_fullsized":"2024-04-25T09:12:25.057643+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:56.750430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229902+0000","last_change":"2024-04-25T09:12:24.062472+0000","last_active":"2024-04-25T09:12:25.229902+0000","last_peered":"2024-04-25T09:12:25.229902+0000","last_clean":"2024-04-25T09:12:25.229902+0000","last_became_active":"2024-04-25T09:12:24.062247+0000","last_became_peered":"2024-04-25T09:12:24.062247+0000","last_unstale":"2024-04-25T09:12:25.229902+0000","last_undegraded":"2024-04-25T09:12:25.229902+0000","last_fullsized":"2024-04-25T09:12:25.229902+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:20.600418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"99'2","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049395+0000","last_change":"2024-04-25T09:12:23.055156+0000","last_active":"2024-04-25T09:12:25.049395+0000","last_peered":"2024-04-25T09:12:25.049395+0000","last_clean":"2024-04-25T09:12:25.049395+0000","last_became_active":"2024-04-25T09:12:23.054917+0000","last_became_peered":"2024-04-25T09:12:23.054917+0000","last_unstale":"2024-04-25T09:12:25.049395+0000","last_undegraded":"2024-04-25T09:12:25.049395+0000","last_fullsized":"2024-04-25T09:12:25.049395+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:20.718434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229671+0000","last_change":"2024-04-25T09:12:24.063967+0000","last_active":"2024-04-25T09:12:25.229671+0000","last_peered":"2024-04-25T09:12:25.229671+0000","last_clean":"2024-04-25T09:12:25.229671+0000","last_became_active":"2024-04-25T09:12:24.063717+0000","last_became_peered":"2024-04-25T09:12:24.063717+0000","last_unstale":"2024-04-25T09:12:25.229671+0000","last_undegraded":"2024-04-25T09:12:25.229671+0000","last_fullsized":"2024-04-25T09:12:25.229671+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:29.097869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049076+0000","last_change":"2024-04-25T09:12:23.057129+0000","last_active":"2024-04-25T09:12:25.049076+0000","last_peered":"2024-04-25T09:12:25.049076+0000","last_clean":"2024-04-25T09:12:25.049076+0000","last_became_active":"2024-04-25T09:12:23.056664+0000","last_became_peered":"2024-04-25T09:12:23.056664+0000","last_unstale":"2024-04-25T09:12:25.049076+0000","last_undegraded":"2024-04-25T09:12:25.049076+0000","last_fullsized":"2024-04-25T09:12:25.049076+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:25.332310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.056816+0000","last_change":"2024-04-25T09:12:24.076302+0000","last_active":"2024-04-25T09:12:25.056816+0000","last_peered":"2024-04-25T09:12:25.056816+0000","last_clean":"2024-04-25T09:12:25.056816+0000","last_became_active":"2024-04-25T09:12:24.074302+0000","last_became_peered":"2024-04-25T09:12:24.074302+0000","last_unstale":"2024-04-25T09:12:25.056816+0000","last_undegraded":"2024-04-25T09:12:25.056816+0000","last_fullsized":"2024-04-25T09:12:25.056816+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:11.609532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.056759+0000","last_change":"2024-04-25T09:12:23.055467+0000","last_active":"2024-04-25T09:12:25.056759+0000","last_peered":"2024-04-25T09:12:25.056759+0000","last_clean":"2024-04-25T09:12:25.056759+0000","last_became_active":"2024-04-25T09:12:23.055142+0000","last_became_peered":"2024-04-25T09:12:23.055142+0000","last_unstale":"2024-04-25T09:12:25.056759+0000","last_undegraded":"2024-04-25T09:12:25.056759+0000","last_fullsized":"2024-04-25T09:12:25.056759+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:48.980621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.048919+0000","last_change":"2024-04-25T09:12:24.061715+0000","last_active":"2024-04-25T09:12:25.048919+0000","last_peered":"2024-04-25T09:12:25.048919+0000","last_clean":"2024-04-25T09:12:25.048919+0000","last_became_active":"2024-04-25T09:12:24.061439+0000","last_became_peered":"2024-04-25T09:12:24.061439+0000","last_unstale":"2024-04-25T09:12:25.048919+0000","last_undegraded":"2024-04-25T09:12:25.048919+0000","last_fullsized":"2024-04-25T09:12:25.048919+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:23.879939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"99'8","reported_seq":22,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229609+0000","last_change":"2024-04-25T09:12:23.053363+0000","last_active":"2024-04-25T09:12:25.229609+0000","last_peered":"2024-04-25T09:12:25.229609+0000","last_clean":"2024-04-25T09:12:25.229609+0000","last_became_active":"2024-04-25T09:12:23.053112+0000","last_became_peered":"2024-04-25T09:12:23.053112+0000","last_unstale":"2024-04-25T09:12:25.229609+0000","last_undegraded":"2024-04-25T09:12:25.229609+0000","last_fullsized":"2024-04-25T09:12:25.229609+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:38.776342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.058374+0000","last_change":"2024-04-25T09:12:24.059216+0000","last_active":"2024-04-25T09:12:25.058374+0000","last_peered":"2024-04-25T09:12:25.058374+0000","last_clean":"2024-04-25T09:12:25.058374+0000","last_became_active":"2024-04-25T09:12:24.058659+0000","last_became_peered":"2024-04-25T09:12:24.058659+0000","last_unstale":"2024-04-25T09:12:25.058374+0000","last_undegraded":"2024-04-25T09:12:25.058374+0000","last_fullsized":"2024-04-25T09:12:25.058374+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:41.021989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"99'2","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057160+0000","last_change":"2024-04-25T09:12:23.055875+0000","last_active":"2024-04-25T09:12:25.057160+0000","last_peered":"2024-04-25T09:12:25.057160+0000","last_clean":"2024-04-25T09:12:25.057160+0000","last_became_active":"2024-04-25T09:12:23.055379+0000","last_became_peered":"2024-04-25T09:12:23.055379+0000","last_unstale":"2024-04-25T09:12:25.057160+0000","last_undegraded":"2024-04-25T09:12:25.057160+0000","last_fullsized":"2024-04-25T09:12:25.057160+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:47.535455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.233732+0000","last_change":"2024-04-25T09:12:24.070077+0000","last_active":"2024-04-25T09:12:25.233732+0000","last_peered":"2024-04-25T09:12:25.233732+0000","last_clean":"2024-04-25T09:12:25.233732+0000","last_became_active":"2024-04-25T09:12:24.069809+0000","last_became_peered":"2024-04-25T09:12:24.069809+0000","last_unstale":"2024-04-25T09:12:25.233732+0000","last_undegraded":"2024-04-25T09:12:25.233732+0000","last_fullsized":"2024-04-25T09:12:25.233732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:34.789448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"99'1","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057997+0000","last_change":"2024-04-25T09:12:23.058015+0000","last_active":"2024-04-25T09:12:25.057997+0000","last_peered":"2024-04-25T09:12:25.057997+0000","last_clean":"2024-04-25T09:12:25.057997+0000","last_became_active":"2024-04-25T09:12:23.057742+0000","last_became_peered":"2024-04-25T09:12:23.057742+0000","last_unstale":"2024-04-25T09:12:25.057997+0000","last_undegraded":"2024-04-25T09:12:25.057997+0000","last_fullsized":"2024-04-25T09:12:25.057997+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:59.672125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234561+0000","last_change":"2024-04-25T09:12:24.077389+0000","last_active":"2024-04-25T09:12:25.234561+0000","last_peered":"2024-04-25T09:12:25.234561+0000","last_clean":"2024-04-25T09:12:25.234561+0000","last_became_active":"2024-04-25T09:12:24.075761+0000","last_became_peered":"2024-04-25T09:12:24.075761+0000","last_unstale":"2024-04-25T09:12:25.234561+0000","last_undegraded":"2024-04-25T09:12:25.234561+0000","last_fullsized":"2024-04-25T09:12:25.234561+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:17.924700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.073039+0000","last_change":"2024-04-25T09:12:23.055213+0000","last_active":"2024-04-25T09:12:25.073039+0000","last_peered":"2024-04-25T09:12:25.073039+0000","last_clean":"2024-04-25T09:12:25.073039+0000","last_became_active":"2024-04-25T09:12:23.054821+0000","last_became_peered":"2024-04-25T09:12:23.054821+0000","last_unstale":"2024-04-25T09:12:25.073039+0000","last_undegraded":"2024-04-25T09:12:25.073039+0000","last_fullsized":"2024-04-25T09:12:25.073039+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:59.539339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049047+0000","last_change":"2024-04-25T09:12:24.073838+0000","last_active":"2024-04-25T09:12:25.049047+0000","last_peered":"2024-04-25T09:12:25.049047+0000","last_clean":"2024-04-25T09:12:25.049047+0000","last_became_active":"2024-04-25T09:12:24.073221+0000","last_became_peered":"2024-04-25T09:12:24.073221+0000","last_unstale":"2024-04-25T09:12:25.049047+0000","last_undegraded":"2024-04-25T09:12:25.049047+0000","last_fullsized":"2024-04-25T09:12:25.049047+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:10.040351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"99'2","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072980+0000","last_change":"2024-04-25T09:12:23.058243+0000","last_active":"2024-04-25T09:12:25.072980+0000","last_peered":"2024-04-25T09:12:25.072980+0000","last_clean":"2024-04-25T09:12:25.072980+0000","last_became_active":"2024-04-25T09:12:23.057987+0000","last_became_peered":"2024-04-25T09:12:23.057987+0000","last_unstale":"2024-04-25T09:12:25.072980+0000","last_undegraded":"2024-04-25T09:12:25.072980+0000","last_fullsized":"2024-04-25T09:12:25.072980+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:48.980621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049353+0000","last_change":"2024-04-25T09:12:24.068141+0000","last_active":"2024-04-25T09:12:25.049353+0000","last_peered":"2024-04-25T09:12:25.049353+0000","last_clean":"2024-04-25T09:12:25.049353+0000","last_became_active":"2024-04-25T09:12:24.067646+0000","last_became_peered":"2024-04-25T09:12:24.067646+0000","last_unstale":"2024-04-25T09:12:25.049353+0000","last_undegraded":"2024-04-25T09:12:25.049353+0000","last_fullsized":"2024-04-25T09:12:25.049353+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:12.033149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.233877+0000","last_change":"2024-04-25T09:12:23.063000+0000","last_active":"2024-04-25T09:12:25.233877+0000","last_peered":"2024-04-25T09:12:25.233877+0000","last_clean":"2024-04-25T09:12:25.233877+0000","last_became_active":"2024-04-25T09:12:23.062652+0000","last_became_peered":"2024-04-25T09:12:23.062652+0000","last_unstale":"2024-04-25T09:12:25.233877+0000","last_undegraded":"2024-04-25T09:12:25.233877+0000","last_fullsized":"2024-04-25T09:12:25.233877+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:47.535455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.048903+0000","last_change":"2024-04-25T09:12:24.070793+0000","last_active":"2024-04-25T09:12:25.048903+0000","last_peered":"2024-04-25T09:12:25.048903+0000","last_clean":"2024-04-25T09:12:25.048903+0000","last_became_active":"2024-04-25T09:12:24.070524+0000","last_became_peered":"2024-04-25T09:12:24.070524+0000","last_unstale":"2024-04-25T09:12:25.048903+0000","last_undegraded":"2024-04-25T09:12:25.048903+0000","last_fullsized":"2024-04-25T09:12:25.048903+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:41.004200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.233575+0000","last_change":"2024-04-25T09:12:23.059633+0000","last_active":"2024-04-25T09:12:25.233575+0000","last_peered":"2024-04-25T09:12:25.233575+0000","last_clean":"2024-04-25T09:12:25.233575+0000","last_became_active":"2024-04-25T09:12:23.058515+0000","last_became_peered":"2024-04-25T09:12:23.058515+0000","last_unstale":"2024-04-25T09:12:25.233575+0000","last_undegraded":"2024-04-25T09:12:25.233575+0000","last_fullsized":"2024-04-25T09:12:25.233575+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:48.980621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057724+0000","last_change":"2024-04-25T09:12:24.069967+0000","last_active":"2024-04-25T09:12:25.057724+0000","last_peered":"2024-04-25T09:12:25.057724+0000","last_clean":"2024-04-25T09:12:25.057724+0000","last_became_active":"2024-04-25T09:12:24.069692+0000","last_became_peered":"2024-04-25T09:12:24.069692+0000","last_unstale":"2024-04-25T09:12:25.057724+0000","last_undegraded":"2024-04-25T09:12:25.057724+0000","last_fullsized":"2024-04-25T09:12:25.057724+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:00.546189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072690+0000","last_change":"2024-04-25T09:12:23.060466+0000","last_active":"2024-04-25T09:12:25.072690+0000","last_peered":"2024-04-25T09:12:25.072690+0000","last_clean":"2024-04-25T09:12:25.072690+0000","last_became_active":"2024-04-25T09:12:23.060103+0000","last_became_peered":"2024-04-25T09:12:23.060103+0000","last_unstale":"2024-04-25T09:12:25.072690+0000","last_undegraded":"2024-04-25T09:12:25.072690+0000","last_fullsized":"2024-04-25T09:12:25.072690+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:47.535455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.073234+0000","last_change":"2024-04-25T09:12:24.064997+0000","last_active":"2024-04-25T09:12:25.073234+0000","last_peered":"2024-04-25T09:12:25.073234+0000","last_clean":"2024-04-25T09:12:25.073234+0000","last_became_active":"2024-04-25T09:12:24.063771+0000","last_became_peered":"2024-04-25T09:12:24.063771+0000","last_unstale":"2024-04-25T09:12:25.073234+0000","last_undegraded":"2024-04-25T09:12:25.073234+0000","last_fullsized":"2024-04-25T09:12:25.073234+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:56.079266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"99'2","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234122+0000","last_change":"2024-04-25T09:12:23.058892+0000","last_active":"2024-04-25T09:12:25.234122+0000","last_peered":"2024-04-25T09:12:25.234122+0000","last_clean":"2024-04-25T09:12:25.234122+0000","last_became_active":"2024-04-25T09:12:23.058545+0000","last_became_peered":"2024-04-25T09:12:23.058545+0000","last_unstale":"2024-04-25T09:12:25.234122+0000","last_undegraded":"2024-04-25T09:12:25.234122+0000","last_fullsized":"2024-04-25T09:12:25.234122+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:56.750430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230339+0000","last_change":"2024-04-25T09:12:24.067062+0000","last_active":"2024-04-25T09:12:25.230339+0000","last_peered":"2024-04-25T09:12:25.230339+0000","last_clean":"2024-04-25T09:12:25.230339+0000","last_became_active":"2024-04-25T09:12:24.066766+0000","last_became_peered":"2024-04-25T09:12:24.066766+0000","last_unstale":"2024-04-25T09:12:25.230339+0000","last_undegraded":"2024-04-25T09:12:25.230339+0000","last_fullsized":"2024-04-25T09:12:25.230339+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:29.486558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"100'1","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.073281+0000","last_change":"2024-04-25T09:12:23.058800+0000","last_active":"2024-04-25T09:12:25.073281+0000","last_peered":"2024-04-25T09:12:25.073281+0000","last_clean":"2024-04-25T09:12:25.073281+0000","last_became_active":"2024-04-25T09:12:23.058544+0000","last_became_peered":"2024-04-25T09:12:23.058544+0000","last_unstale":"2024-04-25T09:12:25.073281+0000","last_undegraded":"2024-04-25T09:12:25.073281+0000","last_fullsized":"2024-04-25T09:12:25.073281+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:05.047339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230191+0000","last_change":"2024-04-25T09:12:24.064696+0000","last_active":"2024-04-25T09:12:25.230191+0000","last_peered":"2024-04-25T09:12:25.230191+0000","last_clean":"2024-04-25T09:12:25.230191+0000","last_became_active":"2024-04-25T09:12:24.064410+0000","last_became_peered":"2024-04-25T09:12:24.064410+0000","last_unstale":"2024-04-25T09:12:25.230191+0000","last_undegraded":"2024-04-25T09:12:25.230191+0000","last_fullsized":"2024-04-25T09:12:25.230191+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:09.756071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072917+0000","last_change":"2024-04-25T09:12:23.055872+0000","last_active":"2024-04-25T09:12:25.072917+0000","last_peered":"2024-04-25T09:12:25.072917+0000","last_clean":"2024-04-25T09:12:25.072917+0000","last_became_active":"2024-04-25T09:12:23.055631+0000","last_became_peered":"2024-04-25T09:12:23.055631+0000","last_unstale":"2024-04-25T09:12:25.072917+0000","last_undegraded":"2024-04-25T09:12:25.072917+0000","last_fullsized":"2024-04-25T09:12:25.072917+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:50.537289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.058170+0000","last_change":"2024-04-25T09:12:24.066311+0000","last_active":"2024-04-25T09:12:25.058170+0000","last_peered":"2024-04-25T09:12:25.058170+0000","last_clean":"2024-04-25T09:12:25.058170+0000","last_became_active":"2024-04-25T09:12:24.065985+0000","last_became_peered":"2024-04-25T09:12:24.065985+0000","last_unstale":"2024-04-25T09:12:25.058170+0000","last_undegraded":"2024-04-25T09:12:25.058170+0000","last_fullsized":"2024-04-25T09:12:25.058170+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:11.609532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.058228+0000","last_change":"2024-04-25T09:12:23.056486+0000","last_active":"2024-04-25T09:12:25.058228+0000","last_peered":"2024-04-25T09:12:25.058228+0000","last_clean":"2024-04-25T09:12:25.058228+0000","last_became_active":"2024-04-25T09:12:23.056222+0000","last_became_peered":"2024-04-25T09:12:23.056222+0000","last_unstale":"2024-04-25T09:12:25.058228+0000","last_undegraded":"2024-04-25T09:12:25.058228+0000","last_fullsized":"2024-04-25T09:12:25.058228+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:17.914872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049158+0000","last_change":"2024-04-25T09:12:24.067132+0000","last_active":"2024-04-25T09:12:25.049158+0000","last_peered":"2024-04-25T09:12:25.049158+0000","last_clean":"2024-04-25T09:12:25.049158+0000","last_became_active":"2024-04-25T09:12:24.060905+0000","last_became_peered":"2024-04-25T09:12:24.060905+0000","last_unstale":"2024-04-25T09:12:25.049158+0000","last_undegraded":"2024-04-25T09:12:25.049158+0000","last_fullsized":"2024-04-25T09:12:25.049158+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:18.994741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.073089+0000","last_change":"2024-04-25T09:12:23.053679+0000","last_active":"2024-04-25T09:12:25.073089+0000","last_peered":"2024-04-25T09:12:25.073089+0000","last_clean":"2024-04-25T09:12:25.073089+0000","last_became_active":"2024-04-25T09:12:23.053377+0000","last_became_peered":"2024-04-25T09:12:23.053377+0000","last_unstale":"2024-04-25T09:12:25.073089+0000","last_undegraded":"2024-04-25T09:12:25.073089+0000","last_fullsized":"2024-04-25T09:12:25.073089+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:36.540104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057189+0000","last_change":"2024-04-25T09:12:24.067684+0000","last_active":"2024-04-25T09:12:25.057189+0000","last_peered":"2024-04-25T09:12:25.057189+0000","last_clean":"2024-04-25T09:12:25.057189+0000","last_became_active":"2024-04-25T09:12:24.067380+0000","last_became_peered":"2024-04-25T09:12:24.067380+0000","last_unstale":"2024-04-25T09:12:25.057189+0000","last_undegraded":"2024-04-25T09:12:25.057189+0000","last_fullsized":"2024-04-25T09:12:25.057189+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:52.135000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057540+0000","last_change":"2024-04-25T09:12:23.057801+0000","last_active":"2024-04-25T09:12:25.057540+0000","last_peered":"2024-04-25T09:12:25.057540+0000","last_clean":"2024-04-25T09:12:25.057540+0000","last_became_active":"2024-04-25T09:12:23.057437+0000","last_became_peered":"2024-04-25T09:12:23.057437+0000","last_unstale":"2024-04-25T09:12:25.057540+0000","last_undegraded":"2024-04-25T09:12:25.057540+0000","last_fullsized":"2024-04-25T09:12:25.057540+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:33.694941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.048913+0000","last_change":"2024-04-25T09:12:24.065155+0000","last_active":"2024-04-25T09:12:25.048913+0000","last_peered":"2024-04-25T09:12:25.048913+0000","last_clean":"2024-04-25T09:12:25.048913+0000","last_became_active":"2024-04-25T09:12:24.064887+0000","last_became_peered":"2024-04-25T09:12:24.064887+0000","last_unstale":"2024-04-25T09:12:25.048913+0000","last_undegraded":"2024-04-25T09:12:25.048913+0000","last_fullsized":"2024-04-25T09:12:25.048913+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:38.808549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229987+0000","last_change":"2024-04-25T09:12:23.053810+0000","last_active":"2024-04-25T09:12:25.229987+0000","last_peered":"2024-04-25T09:12:25.229987+0000","last_clean":"2024-04-25T09:12:25.229987+0000","last_became_active":"2024-04-25T09:12:23.053499+0000","last_became_peered":"2024-04-25T09:12:23.053499+0000","last_unstale":"2024-04-25T09:12:25.229987+0000","last_undegraded":"2024-04-25T09:12:25.229987+0000","last_fullsized":"2024-04-25T09:12:25.229987+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:47.399870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057829+0000","last_change":"2024-04-25T09:12:24.067169+0000","last_active":"2024-04-25T09:12:25.057829+0000","last_peered":"2024-04-25T09:12:25.057829+0000","last_clean":"2024-04-25T09:12:25.057829+0000","last_became_active":"2024-04-25T09:12:24.066885+0000","last_became_peered":"2024-04-25T09:12:24.066885+0000","last_unstale":"2024-04-25T09:12:25.057829+0000","last_undegraded":"2024-04-25T09:12:25.057829+0000","last_fullsized":"2024-04-25T09:12:25.057829+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:09.021743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.048962+0000","last_change":"2024-04-25T09:12:23.058716+0000","last_active":"2024-04-25T09:12:25.048962+0000","last_peered":"2024-04-25T09:12:25.048962+0000","last_clean":"2024-04-25T09:12:25.048962+0000","last_became_active":"2024-04-25T09:12:23.058484+0000","last_became_peered":"2024-04-25T09:12:23.058484+0000","last_unstale":"2024-04-25T09:12:25.048962+0000","last_undegraded":"2024-04-25T09:12:25.048962+0000","last_fullsized":"2024-04-25T09:12:25.048962+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:46.364931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049697+0000","last_change":"2024-04-25T09:12:24.070865+0000","last_active":"2024-04-25T09:12:25.049697+0000","last_peered":"2024-04-25T09:12:25.049697+0000","last_clean":"2024-04-25T09:12:25.049697+0000","last_became_active":"2024-04-25T09:12:24.070558+0000","last_became_peered":"2024-04-25T09:12:24.070558+0000","last_unstale":"2024-04-25T09:12:25.049697+0000","last_undegraded":"2024-04-25T09:12:25.049697+0000","last_fullsized":"2024-04-25T09:12:25.049697+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:46.027715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"99'1","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234351+0000","last_change":"2024-04-25T09:12:23.064267+0000","last_active":"2024-04-25T09:12:25.234351+0000","last_peered":"2024-04-25T09:12:25.234351+0000","last_clean":"2024-04-25T09:12:25.234351+0000","last_became_active":"2024-04-25T09:12:23.063855+0000","last_became_peered":"2024-04-25T09:12:23.063855+0000","last_unstale":"2024-04-25T09:12:25.234351+0000","last_undegraded":"2024-04-25T09:12:25.234351+0000","last_fullsized":"2024-04-25T09:12:25.234351+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:33.782597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":319,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234135+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:12:25.234135+0000","last_peered":"2024-04-25T09:12:25.234135+0000","last_clean":"2024-04-25T09:12:25.234135+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:12:25.234135+0000","last_undegraded":"2024-04-25T09:12:25.234135+0000","last_fullsized":"2024-04-25T09:12:25.234135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574953,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":1839104,"data_stored":1125329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574955,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1245184,"data_stored":535501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574952,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1241088,"data_stored":534919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574952,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1257472,"data_stored":536585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574954,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1253376,"data_stored":536483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1241088,"data_stored":534883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1236992,"data_stored":534849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1835008,"data_stored":1125799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:12:28.121 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:12:28.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.309+0000 7f32ae600640 1 Processor -- start 2024-04-25T09:12:28.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.309+0000 7f32ae600640 1 -- start start 2024-04-25T09:12:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.309+0000 7f32ae600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a815a900 0x7f32a806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.309+0000 7f32ae600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f32a80cf560 0x7f32a80cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.309+0000 7f32ae600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a80cda00 con 0x7f32a80cd520 2024-04-25T09:12:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.309+0000 7f32ae600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a815bcf0 con 0x7f32a80cf560 2024-04-25T09:12:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.309+0000 7f32ae600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a80cfef0 con 0x7f32a815a900 2024-04-25T09:12:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f329ea00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f32a80cd520 0x7f32a80ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:34424/0 (socket says 172.21.15.175:34424) 2024-04-25T09:12:28.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f329ea00640 1 -- 172.21.15.175:0/2975747276 learned_addr learned my addr 172.21.15.175:0/2975747276 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a7400640 1 --2- 172.21.15.175:0/2975747276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a815a900 0x7f32a806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a7e00640 1 --2- 172.21.15.175:0/2975747276 >> v2:172.21.15.177:3300/0 conn(0x7f32a80cf560 0x7f32a80cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a6a00640 1 -- 172.21.15.175:0/2975747276 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117924550 0 0) 0x7f32a80cda00 con 0x7f32a80cd520 2024-04-25T09:12:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a6a00640 1 -- 172.21.15.175:0/2975747276 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f328c003530 con 0x7f32a80cd520 2024-04-25T09:12:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a6a00640 1 -- 172.21.15.175:0/2975747276 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2321455417 0 0) 0x7f328c003530 con 0x7f32a80cd520 2024-04-25T09:12:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a6a00640 1 -- 172.21.15.175:0/2975747276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a815a900 msgr2=0x7f32a806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a6a00640 1 --2- 172.21.15.175:0/2975747276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a815a900 0x7f32a806e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a6a00640 1 -- 172.21.15.175:0/2975747276 >> v2:172.21.15.177:3300/0 conn(0x7f32a80cf560 msgr2=0x7f32a80cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:28.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a6a00640 1 --2- 172.21.15.175:0/2975747276 >> v2:172.21.15.177:3300/0 conn(0x7f32a80cf560 0x7f32a80cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a6a00640 1 -- 172.21.15.175:0/2975747276 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a80cdce0 con 0x7f32a80cd520 2024-04-25T09:12:28.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a6a00640 1 -- 172.21.15.175:0/2975747276 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f3290001680 con 0x7f32a80cd520 2024-04-25T09:12:28.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a6a00640 1 -- 172.21.15.175:0/2975747276 >> v1:172.21.15.175:6789/0 conn(0x7f32a80cd520 legacy=0x7f32a80ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:28.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a6a00640 1 --2- 172.21.15.175:0/2975747276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f328c0039c0 0x7f328c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:28.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a6a00640 1 --2- 172.21.15.175:0/2975747276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f328c004810 0x7f328c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:28.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a6a00640 1 --2- 172.21.15.175:0/2975747276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a815a900 0x7f328c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:28.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a6a00640 1 -- 172.21.15.175:0/2975747276 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a80cfef0 con 0x7f328c0039c0 2024-04-25T09:12:28.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a6a00640 1 -- 172.21.15.175:0/2975747276 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c00b9d0 con 0x7f328c004810 2024-04-25T09:12:28.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a6a00640 1 -- 172.21.15.175:0/2975747276 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328c00bb50 con 0x7f32a815a900 2024-04-25T09:12:28.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a7400640 1 --2- 172.21.15.175:0/2975747276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f328c0039c0 0x7f328c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:28.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f329ea00640 1 --2- 172.21.15.175:0/2975747276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f328c004810 0x7f328c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:28.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a7e00640 1 --2- 172.21.15.175:0/2975747276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a815a900 0x7f328c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:28.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a7400640 1 -- 172.21.15.175:0/2975747276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a815a900 msgr2=0x7f328c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:28.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a7400640 1 --2- 172.21.15.175:0/2975747276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a815a900 0x7f328c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a7400640 1 -- 172.21.15.175:0/2975747276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f328c004810 msgr2=0x7f328c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:28.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a7400640 1 --2- 172.21.15.175:0/2975747276 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f328c004810 0x7f328c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a7400640 1 -- 172.21.15.175:0/2975747276 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c003530 con 0x7f328c0039c0 2024-04-25T09:12:28.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.313+0000 7f32a7e00640 1 --2- 172.21.15.175:0/2975747276 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a815a900 0x7f328c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:28.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32a7400640 1 --2- 172.21.15.175:0/2975747276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f328c0039c0 0x7f328c003de0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f3298009ae0 tx=0x7f329801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd681616436aaf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:28.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32a6a00640 1 -- 172.21.15.175:0/2975747276 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32980096b0 con 0x7f328c0039c0 2024-04-25T09:12:28.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32a6a00640 1 -- 172.21.15.175:0/2975747276 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32980a6480 con 0x7f328c0039c0 2024-04-25T09:12:28.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32a6a00640 1 -- 172.21.15.175:0/2975747276 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32980a6870 con 0x7f328c0039c0 2024-04-25T09:12:28.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32ae600640 1 -- 172.21.15.175:0/2975747276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f328c0039c0 msgr2=0x7f328c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:28.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32ae600640 1 --2- 172.21.15.175:0/2975747276 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f328c0039c0 0x7f328c003de0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f3298009ae0 tx=0x7f329801ca70 comp rx=0 tx=0).stop 2024-04-25T09:12:28.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32a7e00640 1 -- 172.21.15.175:0/2975747276 reap_dead start 2024-04-25T09:12:28.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32ae600640 1 -- 172.21.15.175:0/2975747276 shutdown_connections 2024-04-25T09:12:28.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32ae600640 1 -- 172.21.15.175:0/2975747276 >> 172.21.15.175:0/2975747276 conn(0x7f32a8067150 msgr2=0x7f32a806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:28.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32ae600640 1 -- 172.21.15.175:0/2975747276 shutdown_connections 2024-04-25T09:12:28.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32ae600640 1 -- 172.21.15.175:0/2975747276 wait complete. 2024-04-25T09:12:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32ae600640 1 Processor -- start 2024-04-25T09:12:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32ae600640 1 -- start start 2024-04-25T09:12:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32ae600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32a81f9010 0x7f32a80b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32ae600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a81f7500 0x7f32a80b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32ae600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32a81f93f0 0x7f32a80aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32ae600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a806d3b0 con 0x7f32a81f93f0 2024-04-25T09:12:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32ae600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a80ce580 con 0x7f32a81f9010 2024-04-25T09:12:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.317+0000 7f32ae600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a806d530 con 0x7f32a81f7500 2024-04-25T09:12:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f32a7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32a81f93f0 0x7f32a80aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f32a7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32a81f93f0 0x7f32a80aca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41446/0 (socket says 172.21.15.175:41446) 2024-04-25T09:12:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f32a7e00640 1 -- 172.21.15.175:0/1593297979 learned_addr learned my addr 172.21.15.175:0/1593297979 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f32a7400640 1 --2- 172.21.15.175:0/1593297979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32a81f9010 0x7f32a80b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f329ea00640 1 --2- 172.21.15.175:0/1593297979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a81f7500 0x7f32a80b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:28.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f32a7e00640 1 -- 172.21.15.175:0/1593297979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a81f7500 msgr2=0x7f32a80b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:28.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f32a7e00640 1 --2- 172.21.15.175:0/1593297979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a81f7500 0x7f32a80b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f32a7e00640 1 -- 172.21.15.175:0/1593297979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32a81f9010 msgr2=0x7f32a80b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:28.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f32a7e00640 1 --2- 172.21.15.175:0/1593297979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32a81f9010 0x7f32a80b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f32a7e00640 1 -- 172.21.15.175:0/1593297979 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a8158100 con 0x7f32a81f93f0 2024-04-25T09:12:28.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f32a7e00640 1 --2- 172.21.15.175:0/1593297979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32a81f93f0 0x7f32a80aca10 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f32a80af070 tx=0x7f32a0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:28.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f329fe00640 1 -- 172.21.15.175:0/1593297979 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a001a030 con 0x7f32a81f93f0 2024-04-25T09:12:28.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f329fe00640 1 -- 172.21.15.175:0/1593297979 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a0010e80 con 0x7f32a81f93f0 2024-04-25T09:12:28.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f32ae600640 1 -- 172.21.15.175:0/1593297979 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a80ad740 con 0x7f32a81f93f0 2024-04-25T09:12:28.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f329fe00640 1 -- 172.21.15.175:0/1593297979 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a0003be0 con 0x7f32a81f93f0 2024-04-25T09:12:28.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f32ae600640 1 -- 172.21.15.175:0/1593297979 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a81586a0 con 0x7f32a81f93f0 2024-04-25T09:12:28.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f32ae600640 1 -- 172.21.15.175:0/1593297979 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a8074a60 con 0x7f32a81f93f0 2024-04-25T09:12:28.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f329fe00640 1 -- 172.21.15.175:0/1593297979 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f32a001d070 con 0x7f32a81f93f0 2024-04-25T09:12:28.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.321+0000 7f329fe00640 1 --2- 172.21.15.175:0/1593297979 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3284066f90 0x7f3284069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:28.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.325+0000 7f329fe00640 1 -- 172.21.15.175:0/1593297979 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32a00853f0 con 0x7f32a81f93f0 2024-04-25T09:12:28.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.325+0000 7f32a7400640 1 --2- 172.21.15.175:0/1593297979 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3284066f90 0x7f3284069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:28.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.325+0000 7f32a7400640 1 --2- 172.21.15.175:0/1593297979 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3284066f90 0x7f3284069450 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f32980ad000 tx=0x7f32980b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:28.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.329+0000 7f329fe00640 1 -- 172.21.15.175:0/1593297979 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f32a0055e40 con 0x7f32a81f93f0 2024-04-25T09:12:28.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.477+0000 7f32ae600640 1 -- 172.21.15.175:0/1593297979 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32a806c220 con 0x7f3284066f90 2024-04-25T09:12:28.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.485+0000 7f329fe00640 1 -- 172.21.15.175:0/1593297979 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252183 (secure 0 0 0) 0x7f32980fd930 con 0x7f3284066f90 2024-04-25T09:12:28.472 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:28.474 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:12:28.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.485+0000 7f32ae600640 1 -- 172.21.15.175:0/1593297979 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3284066f90 msgr2=0x7f3284069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:28.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.485+0000 7f32ae600640 1 --2- 172.21.15.175:0/1593297979 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3284066f90 0x7f3284069450 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f32980ad000 tx=0x7f32980b3040 comp rx=0 tx=0).stop 2024-04-25T09:12:28.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.485+0000 7f32ae600640 1 -- 172.21.15.175:0/1593297979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32a81f93f0 msgr2=0x7f32a80aca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:28.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.485+0000 7f32ae600640 1 --2- 172.21.15.175:0/1593297979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32a81f93f0 0x7f32a80aca10 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f32a80af070 tx=0x7f32a0009f90 comp rx=0 tx=0).stop 2024-04-25T09:12:28.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.489+0000 7f32ae600640 1 -- 172.21.15.175:0/1593297979 shutdown_connections 2024-04-25T09:12:28.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.489+0000 7f32ae600640 1 --2- 172.21.15.175:0/1593297979 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3284066f90 0x7f3284069450 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.489+0000 7f32ae600640 1 --2- 172.21.15.175:0/1593297979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f32a81f93f0 0x7f32a80aca10 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.489+0000 7f32ae600640 1 --2- 172.21.15.175:0/1593297979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32a81f7500 0x7f32a80b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.489+0000 7f32ae600640 1 --2- 172.21.15.175:0/1593297979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32a81f9010 0x7f32a80b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.489+0000 7f32ae600640 1 -- 172.21.15.175:0/1593297979 >> 172.21.15.175:0/1593297979 conn(0x7f328c0039c0 msgr2=0x7f32a80af360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:28.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.489+0000 7f32ae600640 1 -- 172.21.15.175:0/1593297979 shutdown_connections 2024-04-25T09:12:28.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.489+0000 7f32ae600640 1 -- 172.21.15.175:0/1593297979 wait complete. 2024-04-25T09:12:28.493 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2024-04-25T09:12:27.904706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260360,"kb_used_data":10888,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714360,"statfs":{"total":773094113280,"available":772827504640,"internally_reserved":0,"allocated":11149312,"data_stored":5464348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.875557"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230082+0000","last_change":"2024-04-25T09:12:24.063406+0000","last_active":"2024-04-25T09:12:25.230082+0000","last_peered":"2024-04-25T09:12:25.230082+0000","last_clean":"2024-04-25T09:12:25.230082+0000","last_became_active":"2024-04-25T09:12:24.063111+0000","last_became_peered":"2024-04-25T09:12:24.063111+0000","last_unstale":"2024-04-25T09:12:25.230082+0000","last_undegraded":"2024-04-25T09:12:25.230082+0000","last_fullsized":"2024-04-25T09:12:25.230082+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:23.232804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072924+0000","last_change":"2024-04-25T09:12:24.071818+0000","last_active":"2024-04-25T09:12:25.072924+0000","last_peered":"2024-04-25T09:12:25.072924+0000","last_clean":"2024-04-25T09:12:25.072924+0000","last_became_active":"2024-04-25T09:12:24.071513+0000","last_became_peered":"2024-04-25T09:12:24.071513+0000","last_unstale":"2024-04-25T09:12:25.072924+0000","last_undegraded":"2024-04-25T09:12:25.072924+0000","last_fullsized":"2024-04-25T09:12:25.072924+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:12.699624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230044+0000","last_change":"2024-04-25T09:12:24.072710+0000","last_active":"2024-04-25T09:12:25.230044+0000","last_peered":"2024-04-25T09:12:25.230044+0000","last_clean":"2024-04-25T09:12:25.230044+0000","last_became_active":"2024-04-25T09:12:24.072359+0000","last_became_peered":"2024-04-25T09:12:24.072359+0000","last_unstale":"2024-04-25T09:12:25.230044+0000","last_undegraded":"2024-04-25T09:12:25.230044+0000","last_fullsized":"2024-04-25T09:12:25.230044+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:51.350547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230258+0000","last_change":"2024-04-25T09:12:24.060876+0000","last_active":"2024-04-25T09:12:25.230258+0000","last_peered":"2024-04-25T09:12:25.230258+0000","last_clean":"2024-04-25T09:12:25.230258+0000","last_became_active":"2024-04-25T09:12:24.058126+0000","last_became_peered":"2024-04-25T09:12:24.058126+0000","last_unstale":"2024-04-25T09:12:25.230258+0000","last_undegraded":"2024-04-25T09:12:25.230258+0000","last_fullsized":"2024-04-25T09:12:25.230258+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:16.493641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.058028+0000","last_change":"2024-04-25T09:12:24.061744+0000","last_active":"2024-04-25T09:12:25.058028+0000","last_peered":"2024-04-25T09:12:25.058028+0000","last_clean":"2024-04-25T09:12:25.058028+0000","last_became_active":"2024-04-25T09:12:24.061438+0000","last_became_peered":"2024-04-25T09:12:24.061438+0000","last_unstale":"2024-04-25T09:12:25.058028+0000","last_undegraded":"2024-04-25T09:12:25.058028+0000","last_fullsized":"2024-04-25T09:12:25.058028+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:06.054189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234249+0000","last_change":"2024-04-25T09:12:24.074595+0000","last_active":"2024-04-25T09:12:25.234249+0000","last_peered":"2024-04-25T09:12:25.234249+0000","last_clean":"2024-04-25T09:12:25.234249+0000","last_became_active":"2024-04-25T09:12:24.074332+0000","last_became_peered":"2024-04-25T09:12:24.074332+0000","last_unstale":"2024-04-25T09:12:25.234249+0000","last_undegraded":"2024-04-25T09:12:25.234249+0000","last_fullsized":"2024-04-25T09:12:25.234249+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:20.600418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.233932+0000","last_change":"2024-04-25T09:12:24.070168+0000","last_active":"2024-04-25T09:12:25.233932+0000","last_peered":"2024-04-25T09:12:25.233932+0000","last_clean":"2024-04-25T09:12:25.233932+0000","last_became_active":"2024-04-25T09:12:24.069862+0000","last_became_peered":"2024-04-25T09:12:24.069862+0000","last_unstale":"2024-04-25T09:12:25.233932+0000","last_undegraded":"2024-04-25T09:12:25.233932+0000","last_fullsized":"2024-04-25T09:12:25.233932+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:33.872828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072780+0000","last_change":"2024-04-25T09:12:24.062933+0000","last_active":"2024-04-25T09:12:25.072780+0000","last_peered":"2024-04-25T09:12:25.072780+0000","last_clean":"2024-04-25T09:12:25.072780+0000","last_became_active":"2024-04-25T09:12:24.062698+0000","last_became_peered":"2024-04-25T09:12:24.062698+0000","last_unstale":"2024-04-25T09:12:25.072780+0000","last_undegraded":"2024-04-25T09:12:25.072780+0000","last_fullsized":"2024-04-25T09:12:25.072780+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:47.295703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057376+0000","last_change":"2024-04-25T09:12:24.059607+0000","last_active":"2024-04-25T09:12:25.057376+0000","last_peered":"2024-04-25T09:12:25.057376+0000","last_clean":"2024-04-25T09:12:25.057376+0000","last_became_active":"2024-04-25T09:12:24.059280+0000","last_became_peered":"2024-04-25T09:12:24.059280+0000","last_unstale":"2024-04-25T09:12:25.057376+0000","last_undegraded":"2024-04-25T09:12:25.057376+0000","last_fullsized":"2024-04-25T09:12:25.057376+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:37.214846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057983+0000","last_change":"2024-04-25T09:12:24.065811+0000","last_active":"2024-04-25T09:12:25.057983+0000","last_peered":"2024-04-25T09:12:25.057983+0000","last_clean":"2024-04-25T09:12:25.057983+0000","last_became_active":"2024-04-25T09:12:24.065481+0000","last_became_peered":"2024-04-25T09:12:24.065481+0000","last_unstale":"2024-04-25T09:12:25.057983+0000","last_undegraded":"2024-04-25T09:12:25.057983+0000","last_fullsized":"2024-04-25T09:12:25.057983+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:51.544140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234199+0000","last_change":"2024-04-25T09:12:24.075606+0000","last_active":"2024-04-25T09:12:25.234199+0000","last_peered":"2024-04-25T09:12:25.234199+0000","last_clean":"2024-04-25T09:12:25.234199+0000","last_became_active":"2024-04-25T09:12:24.074978+0000","last_became_peered":"2024-04-25T09:12:24.074978+0000","last_unstale":"2024-04-25T09:12:25.234199+0000","last_undegraded":"2024-04-25T09:12:25.234199+0000","last_fullsized":"2024-04-25T09:12:25.234199+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:47.295703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057453+0000","last_change":"2024-04-25T09:12:24.072663+0000","last_active":"2024-04-25T09:12:25.057453+0000","last_peered":"2024-04-25T09:12:25.057453+0000","last_clean":"2024-04-25T09:12:25.057453+0000","last_became_active":"2024-04-25T09:12:24.072339+0000","last_became_peered":"2024-04-25T09:12:24.072339+0000","last_unstale":"2024-04-25T09:12:25.057453+0000","last_undegraded":"2024-04-25T09:12:25.057453+0000","last_fullsized":"2024-04-25T09:12:25.057453+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:05.494039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230473+0000","last_change":"2024-04-25T09:12:24.053708+0000","last_active":"2024-04-25T09:12:25.230473+0000","last_peered":"2024-04-25T09:12:25.230473+0000","last_clean":"2024-04-25T09:12:25.230473+0000","last_became_active":"2024-04-25T09:12:24.053392+0000","last_became_peered":"2024-04-25T09:12:24.053392+0000","last_unstale":"2024-04-25T09:12:25.230473+0000","last_undegraded":"2024-04-25T09:12:25.230473+0000","last_fullsized":"2024-04-25T09:12:25.230473+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:12.699624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.048964+0000","last_change":"2024-04-25T09:12:24.071342+0000","last_active":"2024-04-25T09:12:25.048964+0000","last_peered":"2024-04-25T09:12:25.048964+0000","last_clean":"2024-04-25T09:12:25.048964+0000","last_became_active":"2024-04-25T09:12:24.071108+0000","last_became_peered":"2024-04-25T09:12:24.071108+0000","last_unstale":"2024-04-25T09:12:25.048964+0000","last_undegraded":"2024-04-25T09:12:25.048964+0000","last_fullsized":"2024-04-25T09:12:25.048964+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:05:10.641589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229761+0000","last_change":"2024-04-25T09:12:24.068307+0000","last_active":"2024-04-25T09:12:25.229761+0000","last_peered":"2024-04-25T09:12:25.229761+0000","last_clean":"2024-04-25T09:12:25.229761+0000","last_became_active":"2024-04-25T09:12:24.068046+0000","last_became_peered":"2024-04-25T09:12:24.068046+0000","last_unstale":"2024-04-25T09:12:25.229761+0000","last_undegraded":"2024-04-25T09:12:25.229761+0000","last_fullsized":"2024-04-25T09:12:25.229761+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:45:47.295703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.233669+0000","last_change":"2024-04-25T09:12:24.073701+0000","last_active":"2024-04-25T09:12:25.233669+0000","last_peered":"2024-04-25T09:12:25.233669+0000","last_clean":"2024-04-25T09:12:25.233669+0000","last_became_active":"2024-04-25T09:12:24.072204+0000","last_became_peered":"2024-04-25T09:12:24.072204+0000","last_unstale":"2024-04-25T09:12:25.233669+0000","last_undegraded":"2024-04-25T09:12:25.233669+0000","last_fullsized":"2024-04-25T09:12:25.233669+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:47.091378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.073396+0000","last_change":"2024-04-25T09:12:24.063392+0000","last_active":"2024-04-25T09:12:25.073396+0000","last_peered":"2024-04-25T09:12:25.073396+0000","last_clean":"2024-04-25T09:12:25.073396+0000","last_became_active":"2024-04-25T09:12:24.061146+0000","last_became_peered":"2024-04-25T09:12:24.061146+0000","last_unstale":"2024-04-25T09:12:25.073396+0000","last_undegraded":"2024-04-25T09:12:25.073396+0000","last_fullsized":"2024-04-25T09:12:25.073396+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:56.426634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230475+0000","last_change":"2024-04-25T09:12:24.063232+0000","last_active":"2024-04-25T09:12:25.230475+0000","last_peered":"2024-04-25T09:12:25.230475+0000","last_clean":"2024-04-25T09:12:25.230475+0000","last_became_active":"2024-04-25T09:12:24.062612+0000","last_became_peered":"2024-04-25T09:12:24.062612+0000","last_unstale":"2024-04-25T09:12:25.230475+0000","last_undegraded":"2024-04-25T09:12:25.230475+0000","last_fullsized":"2024-04-25T09:12:25.230475+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:17.924700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049427+0000","last_change":"2024-04-25T09:12:24.072906+0000","last_active":"2024-04-25T09:12:25.049427+0000","last_peered":"2024-04-25T09:12:25.049427+0000","last_clean":"2024-04-25T09:12:25.049427+0000","last_became_active":"2024-04-25T09:12:24.072629+0000","last_became_peered":"2024-04-25T09:12:24.072629+0000","last_unstale":"2024-04-25T09:12:25.049427+0000","last_undegraded":"2024-04-25T09:12:25.049427+0000","last_fullsized":"2024-04-25T09:12:25.049427+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:16.767414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057763+0000","last_change":"2024-04-25T09:12:24.060091+0000","last_active":"2024-04-25T09:12:25.057763+0000","last_peered":"2024-04-25T09:12:25.057763+0000","last_clean":"2024-04-25T09:12:25.057763+0000","last_became_active":"2024-04-25T09:12:24.059795+0000","last_became_peered":"2024-04-25T09:12:24.059795+0000","last_unstale":"2024-04-25T09:12:25.057763+0000","last_undegraded":"2024-04-25T09:12:25.057763+0000","last_fullsized":"2024-04-25T09:12:25.057763+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:33.872828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049343+0000","last_change":"2024-04-25T09:12:24.067353+0000","last_active":"2024-04-25T09:12:25.049343+0000","last_peered":"2024-04-25T09:12:25.049343+0000","last_clean":"2024-04-25T09:12:25.049343+0000","last_became_active":"2024-04-25T09:12:24.066652+0000","last_became_peered":"2024-04-25T09:12:24.066652+0000","last_unstale":"2024-04-25T09:12:25.049343+0000","last_undegraded":"2024-04-25T09:12:25.049343+0000","last_fullsized":"2024-04-25T09:12:25.049343+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:25.814545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072894+0000","last_change":"2024-04-25T09:12:24.068954+0000","last_active":"2024-04-25T09:12:25.072894+0000","last_peered":"2024-04-25T09:12:25.072894+0000","last_clean":"2024-04-25T09:12:25.072894+0000","last_became_active":"2024-04-25T09:12:24.068661+0000","last_became_peered":"2024-04-25T09:12:24.068661+0000","last_unstale":"2024-04-25T09:12:25.072894+0000","last_undegraded":"2024-04-25T09:12:25.072894+0000","last_fullsized":"2024-04-25T09:12:25.072894+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:40.274184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072821+0000","last_change":"2024-04-25T09:12:24.061685+0000","last_active":"2024-04-25T09:12:25.072821+0000","last_peered":"2024-04-25T09:12:25.072821+0000","last_clean":"2024-04-25T09:12:25.072821+0000","last_became_active":"2024-04-25T09:12:24.061302+0000","last_became_peered":"2024-04-25T09:12:24.061302+0000","last_unstale":"2024-04-25T09:12:25.072821+0000","last_undegraded":"2024-04-25T09:12:25.072821+0000","last_fullsized":"2024-04-25T09:12:25.072821+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:20.600418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234065+0000","last_change":"2024-04-25T09:12:24.073919+0000","last_active":"2024-04-25T09:12:25.234065+0000","last_peered":"2024-04-25T09:12:25.234065+0000","last_clean":"2024-04-25T09:12:25.234065+0000","last_became_active":"2024-04-25T09:12:24.073434+0000","last_became_peered":"2024-04-25T09:12:24.073434+0000","last_unstale":"2024-04-25T09:12:25.234065+0000","last_undegraded":"2024-04-25T09:12:25.234065+0000","last_fullsized":"2024-04-25T09:12:25.234065+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:33.816127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.058336+0000","last_change":"2024-04-25T09:12:24.074799+0000","last_active":"2024-04-25T09:12:25.058336+0000","last_peered":"2024-04-25T09:12:25.058336+0000","last_clean":"2024-04-25T09:12:25.058336+0000","last_became_active":"2024-04-25T09:12:24.073723+0000","last_became_peered":"2024-04-25T09:12:24.073723+0000","last_unstale":"2024-04-25T09:12:25.058336+0000","last_undegraded":"2024-04-25T09:12:25.058336+0000","last_fullsized":"2024-04-25T09:12:25.058336+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:52.135000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.073090+0000","last_change":"2024-04-25T09:12:24.061407+0000","last_active":"2024-04-25T09:12:25.073090+0000","last_peered":"2024-04-25T09:12:25.073090+0000","last_clean":"2024-04-25T09:12:25.073090+0000","last_became_active":"2024-04-25T09:12:24.061069+0000","last_became_peered":"2024-04-25T09:12:24.061069+0000","last_unstale":"2024-04-25T09:12:25.073090+0000","last_undegraded":"2024-04-25T09:12:25.073090+0000","last_fullsized":"2024-04-25T09:12:25.073090+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:16.493641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234414+0000","last_change":"2024-04-25T09:12:24.071145+0000","last_active":"2024-04-25T09:12:25.234414+0000","last_peered":"2024-04-25T09:12:25.234414+0000","last_clean":"2024-04-25T09:12:25.234414+0000","last_became_active":"2024-04-25T09:12:24.070805+0000","last_became_peered":"2024-04-25T09:12:24.070805+0000","last_unstale":"2024-04-25T09:12:25.234414+0000","last_undegraded":"2024-04-25T09:12:25.234414+0000","last_fullsized":"2024-04-25T09:12:25.234414+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:40.274184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.058153+0000","last_change":"2024-04-25T09:12:24.061674+0000","last_active":"2024-04-25T09:12:25.058153+0000","last_peered":"2024-04-25T09:12:25.058153+0000","last_clean":"2024-04-25T09:12:25.058153+0000","last_became_active":"2024-04-25T09:12:24.061351+0000","last_became_peered":"2024-04-25T09:12:24.061351+0000","last_unstale":"2024-04-25T09:12:25.058153+0000","last_undegraded":"2024-04-25T09:12:25.058153+0000","last_fullsized":"2024-04-25T09:12:25.058153+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:48.406721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.073276+0000","last_change":"2024-04-25T09:12:24.060902+0000","last_active":"2024-04-25T09:12:25.073276+0000","last_peered":"2024-04-25T09:12:25.073276+0000","last_clean":"2024-04-25T09:12:25.073276+0000","last_became_active":"2024-04-25T09:12:24.060636+0000","last_became_peered":"2024-04-25T09:12:24.060636+0000","last_unstale":"2024-04-25T09:12:25.073276+0000","last_undegraded":"2024-04-25T09:12:25.073276+0000","last_fullsized":"2024-04-25T09:12:25.073276+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:28.166932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049009+0000","last_change":"2024-04-25T09:12:24.067004+0000","last_active":"2024-04-25T09:12:25.049009+0000","last_peered":"2024-04-25T09:12:25.049009+0000","last_clean":"2024-04-25T09:12:25.049009+0000","last_became_active":"2024-04-25T09:12:24.066694+0000","last_became_peered":"2024-04-25T09:12:24.066694+0000","last_unstale":"2024-04-25T09:12:25.049009+0000","last_undegraded":"2024-04-25T09:12:25.049009+0000","last_fullsized":"2024-04-25T09:12:25.049009+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:33:43.297904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229938+0000","last_change":"2024-04-25T09:12:24.056994+0000","last_active":"2024-04-25T09:12:25.229938+0000","last_peered":"2024-04-25T09:12:25.229938+0000","last_clean":"2024-04-25T09:12:25.229938+0000","last_became_active":"2024-04-25T09:12:24.056655+0000","last_became_peered":"2024-04-25T09:12:24.056655+0000","last_unstale":"2024-04-25T09:12:25.229938+0000","last_undegraded":"2024-04-25T09:12:25.229938+0000","last_fullsized":"2024-04-25T09:12:25.229938+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:40.274184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229553+0000","last_change":"2024-04-25T09:12:24.069510+0000","last_active":"2024-04-25T09:12:25.229553+0000","last_peered":"2024-04-25T09:12:25.229553+0000","last_clean":"2024-04-25T09:12:25.229553+0000","last_became_active":"2024-04-25T09:12:24.069221+0000","last_became_peered":"2024-04-25T09:12:24.069221+0000","last_unstale":"2024-04-25T09:12:25.229553+0000","last_undegraded":"2024-04-25T09:12:25.229553+0000","last_fullsized":"2024-04-25T09:12:25.229553+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:50:36.387540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049561+0000","last_change":"2024-04-25T09:12:24.062361+0000","last_active":"2024-04-25T09:12:25.049561+0000","last_peered":"2024-04-25T09:12:25.049561+0000","last_clean":"2024-04-25T09:12:25.049561+0000","last_became_active":"2024-04-25T09:12:24.062133+0000","last_became_peered":"2024-04-25T09:12:24.062133+0000","last_unstale":"2024-04-25T09:12:25.049561+0000","last_undegraded":"2024-04-25T09:12:25.049561+0000","last_fullsized":"2024-04-25T09:12:25.049561+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:00.060648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"99'4","reported_seq":18,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.073344+0000","last_change":"2024-04-25T09:12:23.059374+0000","last_active":"2024-04-25T09:12:25.073344+0000","last_peered":"2024-04-25T09:12:25.073344+0000","last_clean":"2024-04-25T09:12:25.073344+0000","last_became_active":"2024-04-25T09:12:23.059108+0000","last_became_peered":"2024-04-25T09:12:23.059108+0000","last_unstale":"2024-04-25T09:12:25.073344+0000","last_undegraded":"2024-04-25T09:12:25.073344+0000","last_fullsized":"2024-04-25T09:12:25.073344+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:56.750430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230558+0000","last_change":"2024-04-25T09:12:24.062260+0000","last_active":"2024-04-25T09:12:25.230558+0000","last_peered":"2024-04-25T09:12:25.230558+0000","last_clean":"2024-04-25T09:12:25.230558+0000","last_became_active":"2024-04-25T09:12:24.061961+0000","last_became_peered":"2024-04-25T09:12:24.061961+0000","last_unstale":"2024-04-25T09:12:25.230558+0000","last_undegraded":"2024-04-25T09:12:25.230558+0000","last_fullsized":"2024-04-25T09:12:25.230558+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:56.079266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"99'1","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234320+0000","last_change":"2024-04-25T09:12:23.062596+0000","last_active":"2024-04-25T09:12:25.234320+0000","last_peered":"2024-04-25T09:12:25.234320+0000","last_clean":"2024-04-25T09:12:25.234320+0000","last_became_active":"2024-04-25T09:12:23.062060+0000","last_became_peered":"2024-04-25T09:12:23.062060+0000","last_unstale":"2024-04-25T09:12:25.234320+0000","last_undegraded":"2024-04-25T09:12:25.234320+0000","last_fullsized":"2024-04-25T09:12:25.234320+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:08.014892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230044+0000","last_change":"2024-04-25T09:12:24.076495+0000","last_active":"2024-04-25T09:12:25.230044+0000","last_peered":"2024-04-25T09:12:25.230044+0000","last_clean":"2024-04-25T09:12:25.230044+0000","last_became_active":"2024-04-25T09:12:24.076148+0000","last_became_peered":"2024-04-25T09:12:24.076148+0000","last_unstale":"2024-04-25T09:12:25.230044+0000","last_undegraded":"2024-04-25T09:12:25.230044+0000","last_fullsized":"2024-04-25T09:12:25.230044+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:19.686462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"99'2","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072869+0000","last_change":"2024-04-25T09:12:23.056086+0000","last_active":"2024-04-25T09:12:25.072869+0000","last_peered":"2024-04-25T09:12:25.072869+0000","last_clean":"2024-04-25T09:12:25.072869+0000","last_became_active":"2024-04-25T09:12:23.055862+0000","last_became_peered":"2024-04-25T09:12:23.055862+0000","last_unstale":"2024-04-25T09:12:25.072869+0000","last_undegraded":"2024-04-25T09:12:25.072869+0000","last_fullsized":"2024-04-25T09:12:25.072869+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:08.014892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057569+0000","last_change":"2024-04-25T09:12:24.068603+0000","last_active":"2024-04-25T09:12:25.057569+0000","last_peered":"2024-04-25T09:12:25.057569+0000","last_clean":"2024-04-25T09:12:25.057569+0000","last_became_active":"2024-04-25T09:12:24.068296+0000","last_became_peered":"2024-04-25T09:12:24.068296+0000","last_unstale":"2024-04-25T09:12:25.057569+0000","last_undegraded":"2024-04-25T09:12:25.057569+0000","last_fullsized":"2024-04-25T09:12:25.057569+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:47.091378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"99'2","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072925+0000","last_change":"2024-04-25T09:12:23.056489+0000","last_active":"2024-04-25T09:12:25.072925+0000","last_peered":"2024-04-25T09:12:25.072925+0000","last_clean":"2024-04-25T09:12:25.072925+0000","last_became_active":"2024-04-25T09:12:23.056185+0000","last_became_peered":"2024-04-25T09:12:23.056185+0000","last_unstale":"2024-04-25T09:12:25.072925+0000","last_undegraded":"2024-04-25T09:12:25.072925+0000","last_fullsized":"2024-04-25T09:12:25.072925+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:33.782597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.233923+0000","last_change":"2024-04-25T09:12:24.079049+0000","last_active":"2024-04-25T09:12:25.233923+0000","last_peered":"2024-04-25T09:12:25.233923+0000","last_clean":"2024-04-25T09:12:25.233923+0000","last_became_active":"2024-04-25T09:12:24.078705+0000","last_became_peered":"2024-04-25T09:12:24.078705+0000","last_unstale":"2024-04-25T09:12:25.233923+0000","last_undegraded":"2024-04-25T09:12:25.233923+0000","last_fullsized":"2024-04-25T09:12:25.233923+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:00.546189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"99'1","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229751+0000","last_change":"2024-04-25T09:12:23.052540+0000","last_active":"2024-04-25T09:12:25.229751+0000","last_peered":"2024-04-25T09:12:25.229751+0000","last_clean":"2024-04-25T09:12:25.229751+0000","last_became_active":"2024-04-25T09:12:23.052315+0000","last_became_peered":"2024-04-25T09:12:23.052315+0000","last_unstale":"2024-04-25T09:12:25.229751+0000","last_undegraded":"2024-04-25T09:12:25.229751+0000","last_fullsized":"2024-04-25T09:12:25.229751+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:35:59.053797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234543+0000","last_change":"2024-04-25T09:12:24.076776+0000","last_active":"2024-04-25T09:12:25.234543+0000","last_peered":"2024-04-25T09:12:25.234543+0000","last_clean":"2024-04-25T09:12:25.234543+0000","last_became_active":"2024-04-25T09:12:24.076410+0000","last_became_peered":"2024-04-25T09:12:24.076410+0000","last_unstale":"2024-04-25T09:12:25.234543+0000","last_undegraded":"2024-04-25T09:12:25.234543+0000","last_fullsized":"2024-04-25T09:12:25.234543+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:16.493641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"99'1","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072692+0000","last_change":"2024-04-25T09:12:23.057844+0000","last_active":"2024-04-25T09:12:25.072692+0000","last_peered":"2024-04-25T09:12:25.072692+0000","last_clean":"2024-04-25T09:12:25.072692+0000","last_became_active":"2024-04-25T09:12:23.057584+0000","last_became_peered":"2024-04-25T09:12:23.057584+0000","last_unstale":"2024-04-25T09:12:25.072692+0000","last_undegraded":"2024-04-25T09:12:25.072692+0000","last_fullsized":"2024-04-25T09:12:25.072692+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:42.719555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229761+0000","last_change":"2024-04-25T09:12:24.068243+0000","last_active":"2024-04-25T09:12:25.229761+0000","last_peered":"2024-04-25T09:12:25.229761+0000","last_clean":"2024-04-25T09:12:25.229761+0000","last_became_active":"2024-04-25T09:12:24.067997+0000","last_became_peered":"2024-04-25T09:12:24.067997+0000","last_unstale":"2024-04-25T09:12:25.229761+0000","last_undegraded":"2024-04-25T09:12:25.229761+0000","last_fullsized":"2024-04-25T09:12:25.229761+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:56:33.816127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.058193+0000","last_change":"2024-04-25T09:12:23.062684+0000","last_active":"2024-04-25T09:12:25.058193+0000","last_peered":"2024-04-25T09:12:25.058193+0000","last_clean":"2024-04-25T09:12:25.058193+0000","last_became_active":"2024-04-25T09:12:23.062358+0000","last_became_peered":"2024-04-25T09:12:23.062358+0000","last_unstale":"2024-04-25T09:12:25.058193+0000","last_undegraded":"2024-04-25T09:12:25.058193+0000","last_fullsized":"2024-04-25T09:12:25.058193+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:22:05.401271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.056832+0000","last_change":"2024-04-25T09:12:24.068501+0000","last_active":"2024-04-25T09:12:25.056832+0000","last_peered":"2024-04-25T09:12:25.056832+0000","last_clean":"2024-04-25T09:12:25.056832+0000","last_became_active":"2024-04-25T09:12:24.068066+0000","last_became_peered":"2024-04-25T09:12:24.068066+0000","last_unstale":"2024-04-25T09:12:25.056832+0000","last_undegraded":"2024-04-25T09:12:25.056832+0000","last_fullsized":"2024-04-25T09:12:25.056832+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:10.258994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229502+0000","last_change":"2024-04-25T09:12:23.053968+0000","last_active":"2024-04-25T09:12:25.229502+0000","last_peered":"2024-04-25T09:12:25.229502+0000","last_clean":"2024-04-25T09:12:25.229502+0000","last_became_active":"2024-04-25T09:12:23.051835+0000","last_became_peered":"2024-04-25T09:12:23.051835+0000","last_unstale":"2024-04-25T09:12:25.229502+0000","last_undegraded":"2024-04-25T09:12:25.229502+0000","last_fullsized":"2024-04-25T09:12:25.229502+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:24:47.316987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.073127+0000","last_change":"2024-04-25T09:12:24.066175+0000","last_active":"2024-04-25T09:12:25.073127+0000","last_peered":"2024-04-25T09:12:25.073127+0000","last_clean":"2024-04-25T09:12:25.073127+0000","last_became_active":"2024-04-25T09:12:24.065868+0000","last_became_peered":"2024-04-25T09:12:24.065868+0000","last_unstale":"2024-04-25T09:12:25.073127+0000","last_undegraded":"2024-04-25T09:12:25.073127+0000","last_fullsized":"2024-04-25T09:12:25.073127+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:17.924700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230386+0000","last_change":"2024-04-25T09:12:23.054844+0000","last_active":"2024-04-25T09:12:25.230386+0000","last_peered":"2024-04-25T09:12:25.230386+0000","last_clean":"2024-04-25T09:12:25.230386+0000","last_became_active":"2024-04-25T09:12:23.053859+0000","last_became_peered":"2024-04-25T09:12:23.053859+0000","last_unstale":"2024-04-25T09:12:25.230386+0000","last_undegraded":"2024-04-25T09:12:25.230386+0000","last_fullsized":"2024-04-25T09:12:25.230386+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:45.020865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057278+0000","last_change":"2024-04-25T09:12:24.069250+0000","last_active":"2024-04-25T09:12:25.057278+0000","last_peered":"2024-04-25T09:12:25.057278+0000","last_clean":"2024-04-25T09:12:25.057278+0000","last_became_active":"2024-04-25T09:12:24.068938+0000","last_became_peered":"2024-04-25T09:12:24.068938+0000","last_unstale":"2024-04-25T09:12:25.057278+0000","last_undegraded":"2024-04-25T09:12:25.057278+0000","last_fullsized":"2024-04-25T09:12:25.057278+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:41.021989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230365+0000","last_change":"2024-04-25T09:12:23.060146+0000","last_active":"2024-04-25T09:12:25.230365+0000","last_peered":"2024-04-25T09:12:25.230365+0000","last_clean":"2024-04-25T09:12:25.230365+0000","last_became_active":"2024-04-25T09:12:23.059847+0000","last_became_peered":"2024-04-25T09:12:23.059847+0000","last_unstale":"2024-04-25T09:12:25.230365+0000","last_undegraded":"2024-04-25T09:12:25.230365+0000","last_fullsized":"2024-04-25T09:12:25.230365+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:05.047339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.058186+0000","last_change":"2024-04-25T09:12:24.068747+0000","last_active":"2024-04-25T09:12:25.058186+0000","last_peered":"2024-04-25T09:12:25.058186+0000","last_clean":"2024-04-25T09:12:25.058186+0000","last_became_active":"2024-04-25T09:12:24.068497+0000","last_became_peered":"2024-04-25T09:12:24.068497+0000","last_unstale":"2024-04-25T09:12:25.058186+0000","last_undegraded":"2024-04-25T09:12:25.058186+0000","last_fullsized":"2024-04-25T09:12:25.058186+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:10.258994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"99'3","reported_seq":17,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234513+0000","last_change":"2024-04-25T09:12:23.061705+0000","last_active":"2024-04-25T09:12:25.234513+0000","last_peered":"2024-04-25T09:12:25.234513+0000","last_clean":"2024-04-25T09:12:25.234513+0000","last_became_active":"2024-04-25T09:12:23.061374+0000","last_became_peered":"2024-04-25T09:12:23.061374+0000","last_unstale":"2024-04-25T09:12:25.234513+0000","last_undegraded":"2024-04-25T09:12:25.234513+0000","last_fullsized":"2024-04-25T09:12:25.234513+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:59.539339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234430+0000","last_change":"2024-04-25T09:12:24.075828+0000","last_active":"2024-04-25T09:12:25.234430+0000","last_peered":"2024-04-25T09:12:25.234430+0000","last_clean":"2024-04-25T09:12:25.234430+0000","last_became_active":"2024-04-25T09:12:24.075346+0000","last_became_peered":"2024-04-25T09:12:24.075346+0000","last_unstale":"2024-04-25T09:12:25.234430+0000","last_undegraded":"2024-04-25T09:12:25.234430+0000","last_fullsized":"2024-04-25T09:12:25.234430+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:12.699624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"99'6","reported_seq":20,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057643+0000","last_change":"2024-04-25T09:12:23.055885+0000","last_active":"2024-04-25T09:12:25.057643+0000","last_peered":"2024-04-25T09:12:25.057643+0000","last_clean":"2024-04-25T09:12:25.057643+0000","last_became_active":"2024-04-25T09:12:23.054998+0000","last_became_peered":"2024-04-25T09:12:23.054998+0000","last_unstale":"2024-04-25T09:12:25.057643+0000","last_undegraded":"2024-04-25T09:12:25.057643+0000","last_fullsized":"2024-04-25T09:12:25.057643+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:56.750430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229902+0000","last_change":"2024-04-25T09:12:24.062472+0000","last_active":"2024-04-25T09:12:25.229902+0000","last_peered":"2024-04-25T09:12:25.229902+0000","last_clean":"2024-04-25T09:12:25.229902+0000","last_became_active":"2024-04-25T09:12:24.062247+0000","last_became_peered":"2024-04-25T09:12:24.062247+0000","last_unstale":"2024-04-25T09:12:25.229902+0000","last_undegraded":"2024-04-25T09:12:25.229902+0000","last_fullsized":"2024-04-25T09:12:25.229902+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:58:20.600418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"99'2","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049395+0000","last_change":"2024-04-25T09:12:23.055156+0000","last_active":"2024-04-25T09:12:25.049395+0000","last_peered":"2024-04-25T09:12:25.049395+0000","last_clean":"2024-04-25T09:12:25.049395+0000","last_became_active":"2024-04-25T09:12:23.054917+0000","last_became_peered":"2024-04-25T09:12:23.054917+0000","last_unstale":"2024-04-25T09:12:25.049395+0000","last_undegraded":"2024-04-25T09:12:25.049395+0000","last_fullsized":"2024-04-25T09:12:25.049395+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:20.718434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229671+0000","last_change":"2024-04-25T09:12:24.063967+0000","last_active":"2024-04-25T09:12:25.229671+0000","last_peered":"2024-04-25T09:12:25.229671+0000","last_clean":"2024-04-25T09:12:25.229671+0000","last_became_active":"2024-04-25T09:12:24.063717+0000","last_became_peered":"2024-04-25T09:12:24.063717+0000","last_unstale":"2024-04-25T09:12:25.229671+0000","last_undegraded":"2024-04-25T09:12:25.229671+0000","last_fullsized":"2024-04-25T09:12:25.229671+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:29.097869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049076+0000","last_change":"2024-04-25T09:12:23.057129+0000","last_active":"2024-04-25T09:12:25.049076+0000","last_peered":"2024-04-25T09:12:25.049076+0000","last_clean":"2024-04-25T09:12:25.049076+0000","last_became_active":"2024-04-25T09:12:23.056664+0000","last_became_peered":"2024-04-25T09:12:23.056664+0000","last_unstale":"2024-04-25T09:12:25.049076+0000","last_undegraded":"2024-04-25T09:12:25.049076+0000","last_fullsized":"2024-04-25T09:12:25.049076+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:25.332310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.056816+0000","last_change":"2024-04-25T09:12:24.076302+0000","last_active":"2024-04-25T09:12:25.056816+0000","last_peered":"2024-04-25T09:12:25.056816+0000","last_clean":"2024-04-25T09:12:25.056816+0000","last_became_active":"2024-04-25T09:12:24.074302+0000","last_became_peered":"2024-04-25T09:12:24.074302+0000","last_unstale":"2024-04-25T09:12:25.056816+0000","last_undegraded":"2024-04-25T09:12:25.056816+0000","last_fullsized":"2024-04-25T09:12:25.056816+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:11.609532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.056759+0000","last_change":"2024-04-25T09:12:23.055467+0000","last_active":"2024-04-25T09:12:25.056759+0000","last_peered":"2024-04-25T09:12:25.056759+0000","last_clean":"2024-04-25T09:12:25.056759+0000","last_became_active":"2024-04-25T09:12:23.055142+0000","last_became_peered":"2024-04-25T09:12:23.055142+0000","last_unstale":"2024-04-25T09:12:25.056759+0000","last_undegraded":"2024-04-25T09:12:25.056759+0000","last_fullsized":"2024-04-25T09:12:25.056759+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:48.980621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.048919+0000","last_change":"2024-04-25T09:12:24.061715+0000","last_active":"2024-04-25T09:12:25.048919+0000","last_peered":"2024-04-25T09:12:25.048919+0000","last_clean":"2024-04-25T09:12:25.048919+0000","last_became_active":"2024-04-25T09:12:24.061439+0000","last_became_peered":"2024-04-25T09:12:24.061439+0000","last_unstale":"2024-04-25T09:12:25.048919+0000","last_undegraded":"2024-04-25T09:12:25.048919+0000","last_fullsized":"2024-04-25T09:12:25.048919+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:23.879939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"99'8","reported_seq":22,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229609+0000","last_change":"2024-04-25T09:12:23.053363+0000","last_active":"2024-04-25T09:12:25.229609+0000","last_peered":"2024-04-25T09:12:25.229609+0000","last_clean":"2024-04-25T09:12:25.229609+0000","last_became_active":"2024-04-25T09:12:23.053112+0000","last_became_peered":"2024-04-25T09:12:23.053112+0000","last_unstale":"2024-04-25T09:12:25.229609+0000","last_undegraded":"2024-04-25T09:12:25.229609+0000","last_fullsized":"2024-04-25T09:12:25.229609+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:38.776342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.058374+0000","last_change":"2024-04-25T09:12:24.059216+0000","last_active":"2024-04-25T09:12:25.058374+0000","last_peered":"2024-04-25T09:12:25.058374+0000","last_clean":"2024-04-25T09:12:25.058374+0000","last_became_active":"2024-04-25T09:12:24.058659+0000","last_became_peered":"2024-04-25T09:12:24.058659+0000","last_unstale":"2024-04-25T09:12:25.058374+0000","last_undegraded":"2024-04-25T09:12:25.058374+0000","last_fullsized":"2024-04-25T09:12:25.058374+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:41.021989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"99'2","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057160+0000","last_change":"2024-04-25T09:12:23.055875+0000","last_active":"2024-04-25T09:12:25.057160+0000","last_peered":"2024-04-25T09:12:25.057160+0000","last_clean":"2024-04-25T09:12:25.057160+0000","last_became_active":"2024-04-25T09:12:23.055379+0000","last_became_peered":"2024-04-25T09:12:23.055379+0000","last_unstale":"2024-04-25T09:12:25.057160+0000","last_undegraded":"2024-04-25T09:12:25.057160+0000","last_fullsized":"2024-04-25T09:12:25.057160+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:47.535455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.233732+0000","last_change":"2024-04-25T09:12:24.070077+0000","last_active":"2024-04-25T09:12:25.233732+0000","last_peered":"2024-04-25T09:12:25.233732+0000","last_clean":"2024-04-25T09:12:25.233732+0000","last_became_active":"2024-04-25T09:12:24.069809+0000","last_became_peered":"2024-04-25T09:12:24.069809+0000","last_unstale":"2024-04-25T09:12:25.233732+0000","last_undegraded":"2024-04-25T09:12:25.233732+0000","last_fullsized":"2024-04-25T09:12:25.233732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:34.789448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"99'1","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057997+0000","last_change":"2024-04-25T09:12:23.058015+0000","last_active":"2024-04-25T09:12:25.057997+0000","last_peered":"2024-04-25T09:12:25.057997+0000","last_clean":"2024-04-25T09:12:25.057997+0000","last_became_active":"2024-04-25T09:12:23.057742+0000","last_became_peered":"2024-04-25T09:12:23.057742+0000","last_unstale":"2024-04-25T09:12:25.057997+0000","last_undegraded":"2024-04-25T09:12:25.057997+0000","last_fullsized":"2024-04-25T09:12:25.057997+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:59.672125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234561+0000","last_change":"2024-04-25T09:12:24.077389+0000","last_active":"2024-04-25T09:12:25.234561+0000","last_peered":"2024-04-25T09:12:25.234561+0000","last_clean":"2024-04-25T09:12:25.234561+0000","last_became_active":"2024-04-25T09:12:24.075761+0000","last_became_peered":"2024-04-25T09:12:24.075761+0000","last_unstale":"2024-04-25T09:12:25.234561+0000","last_undegraded":"2024-04-25T09:12:25.234561+0000","last_fullsized":"2024-04-25T09:12:25.234561+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:17.924700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.073039+0000","last_change":"2024-04-25T09:12:23.055213+0000","last_active":"2024-04-25T09:12:25.073039+0000","last_peered":"2024-04-25T09:12:25.073039+0000","last_clean":"2024-04-25T09:12:25.073039+0000","last_became_active":"2024-04-25T09:12:23.054821+0000","last_became_peered":"2024-04-25T09:12:23.054821+0000","last_unstale":"2024-04-25T09:12:25.073039+0000","last_undegraded":"2024-04-25T09:12:25.073039+0000","last_fullsized":"2024-04-25T09:12:25.073039+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:59.539339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049047+0000","last_change":"2024-04-25T09:12:24.073838+0000","last_active":"2024-04-25T09:12:25.049047+0000","last_peered":"2024-04-25T09:12:25.049047+0000","last_clean":"2024-04-25T09:12:25.049047+0000","last_became_active":"2024-04-25T09:12:24.073221+0000","last_became_peered":"2024-04-25T09:12:24.073221+0000","last_unstale":"2024-04-25T09:12:25.049047+0000","last_undegraded":"2024-04-25T09:12:25.049047+0000","last_fullsized":"2024-04-25T09:12:25.049047+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:10.040351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"99'2","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072980+0000","last_change":"2024-04-25T09:12:23.058243+0000","last_active":"2024-04-25T09:12:25.072980+0000","last_peered":"2024-04-25T09:12:25.072980+0000","last_clean":"2024-04-25T09:12:25.072980+0000","last_became_active":"2024-04-25T09:12:23.057987+0000","last_became_peered":"2024-04-25T09:12:23.057987+0000","last_unstale":"2024-04-25T09:12:25.072980+0000","last_undegraded":"2024-04-25T09:12:25.072980+0000","last_fullsized":"2024-04-25T09:12:25.072980+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:48.980621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049353+0000","last_change":"2024-04-25T09:12:24.068141+0000","last_active":"2024-04-25T09:12:25.049353+0000","last_peered":"2024-04-25T09:12:25.049353+0000","last_clean":"2024-04-25T09:12:25.049353+0000","last_became_active":"2024-04-25T09:12:24.067646+0000","last_became_peered":"2024-04-25T09:12:24.067646+0000","last_unstale":"2024-04-25T09:12:25.049353+0000","last_undegraded":"2024-04-25T09:12:25.049353+0000","last_fullsized":"2024-04-25T09:12:25.049353+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:12.033149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.233877+0000","last_change":"2024-04-25T09:12:23.063000+0000","last_active":"2024-04-25T09:12:25.233877+0000","last_peered":"2024-04-25T09:12:25.233877+0000","last_clean":"2024-04-25T09:12:25.233877+0000","last_became_active":"2024-04-25T09:12:23.062652+0000","last_became_peered":"2024-04-25T09:12:23.062652+0000","last_unstale":"2024-04-25T09:12:25.233877+0000","last_undegraded":"2024-04-25T09:12:25.233877+0000","last_fullsized":"2024-04-25T09:12:25.233877+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:47.535455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.048903+0000","last_change":"2024-04-25T09:12:24.070793+0000","last_active":"2024-04-25T09:12:25.048903+0000","last_peered":"2024-04-25T09:12:25.048903+0000","last_clean":"2024-04-25T09:12:25.048903+0000","last_became_active":"2024-04-25T09:12:24.070524+0000","last_became_peered":"2024-04-25T09:12:24.070524+0000","last_unstale":"2024-04-25T09:12:25.048903+0000","last_undegraded":"2024-04-25T09:12:25.048903+0000","last_fullsized":"2024-04-25T09:12:25.048903+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:41.004200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.233575+0000","last_change":"2024-04-25T09:12:23.059633+0000","last_active":"2024-04-25T09:12:25.233575+0000","last_peered":"2024-04-25T09:12:25.233575+0000","last_clean":"2024-04-25T09:12:25.233575+0000","last_became_active":"2024-04-25T09:12:23.058515+0000","last_became_peered":"2024-04-25T09:12:23.058515+0000","last_unstale":"2024-04-25T09:12:25.233575+0000","last_undegraded":"2024-04-25T09:12:25.233575+0000","last_fullsized":"2024-04-25T09:12:25.233575+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:48.980621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057724+0000","last_change":"2024-04-25T09:12:24.069967+0000","last_active":"2024-04-25T09:12:25.057724+0000","last_peered":"2024-04-25T09:12:25.057724+0000","last_clean":"2024-04-25T09:12:25.057724+0000","last_became_active":"2024-04-25T09:12:24.069692+0000","last_became_peered":"2024-04-25T09:12:24.069692+0000","last_unstale":"2024-04-25T09:12:25.057724+0000","last_undegraded":"2024-04-25T09:12:25.057724+0000","last_fullsized":"2024-04-25T09:12:25.057724+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:00.546189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072690+0000","last_change":"2024-04-25T09:12:23.060466+0000","last_active":"2024-04-25T09:12:25.072690+0000","last_peered":"2024-04-25T09:12:25.072690+0000","last_clean":"2024-04-25T09:12:25.072690+0000","last_became_active":"2024-04-25T09:12:23.060103+0000","last_became_peered":"2024-04-25T09:12:23.060103+0000","last_unstale":"2024-04-25T09:12:25.072690+0000","last_undegraded":"2024-04-25T09:12:25.072690+0000","last_fullsized":"2024-04-25T09:12:25.072690+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:47.535455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.073234+0000","last_change":"2024-04-25T09:12:24.064997+0000","last_active":"2024-04-25T09:12:25.073234+0000","last_peered":"2024-04-25T09:12:25.073234+0000","last_clean":"2024-04-25T09:12:25.073234+0000","last_became_active":"2024-04-25T09:12:24.063771+0000","last_became_peered":"2024-04-25T09:12:24.063771+0000","last_unstale":"2024-04-25T09:12:25.073234+0000","last_undegraded":"2024-04-25T09:12:25.073234+0000","last_fullsized":"2024-04-25T09:12:25.073234+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:17:56.079266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"99'2","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234122+0000","last_change":"2024-04-25T09:12:23.058892+0000","last_active":"2024-04-25T09:12:25.234122+0000","last_peered":"2024-04-25T09:12:25.234122+0000","last_clean":"2024-04-25T09:12:25.234122+0000","last_became_active":"2024-04-25T09:12:23.058545+0000","last_became_peered":"2024-04-25T09:12:23.058545+0000","last_unstale":"2024-04-25T09:12:25.234122+0000","last_undegraded":"2024-04-25T09:12:25.234122+0000","last_fullsized":"2024-04-25T09:12:25.234122+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:56.750430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230339+0000","last_change":"2024-04-25T09:12:24.067062+0000","last_active":"2024-04-25T09:12:25.230339+0000","last_peered":"2024-04-25T09:12:25.230339+0000","last_clean":"2024-04-25T09:12:25.230339+0000","last_became_active":"2024-04-25T09:12:24.066766+0000","last_became_peered":"2024-04-25T09:12:24.066766+0000","last_unstale":"2024-04-25T09:12:25.230339+0000","last_undegraded":"2024-04-25T09:12:25.230339+0000","last_fullsized":"2024-04-25T09:12:25.230339+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:29.486558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"100'1","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.073281+0000","last_change":"2024-04-25T09:12:23.058800+0000","last_active":"2024-04-25T09:12:25.073281+0000","last_peered":"2024-04-25T09:12:25.073281+0000","last_clean":"2024-04-25T09:12:25.073281+0000","last_became_active":"2024-04-25T09:12:23.058544+0000","last_became_peered":"2024-04-25T09:12:23.058544+0000","last_unstale":"2024-04-25T09:12:25.073281+0000","last_undegraded":"2024-04-25T09:12:25.073281+0000","last_fullsized":"2024-04-25T09:12:25.073281+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:05.047339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.230191+0000","last_change":"2024-04-25T09:12:24.064696+0000","last_active":"2024-04-25T09:12:25.230191+0000","last_peered":"2024-04-25T09:12:25.230191+0000","last_clean":"2024-04-25T09:12:25.230191+0000","last_became_active":"2024-04-25T09:12:24.064410+0000","last_became_peered":"2024-04-25T09:12:24.064410+0000","last_unstale":"2024-04-25T09:12:25.230191+0000","last_undegraded":"2024-04-25T09:12:25.230191+0000","last_fullsized":"2024-04-25T09:12:25.230191+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:09.756071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.072917+0000","last_change":"2024-04-25T09:12:23.055872+0000","last_active":"2024-04-25T09:12:25.072917+0000","last_peered":"2024-04-25T09:12:25.072917+0000","last_clean":"2024-04-25T09:12:25.072917+0000","last_became_active":"2024-04-25T09:12:23.055631+0000","last_became_peered":"2024-04-25T09:12:23.055631+0000","last_unstale":"2024-04-25T09:12:25.072917+0000","last_undegraded":"2024-04-25T09:12:25.072917+0000","last_fullsized":"2024-04-25T09:12:25.072917+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:50.537289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.058170+0000","last_change":"2024-04-25T09:12:24.066311+0000","last_active":"2024-04-25T09:12:25.058170+0000","last_peered":"2024-04-25T09:12:25.058170+0000","last_clean":"2024-04-25T09:12:25.058170+0000","last_became_active":"2024-04-25T09:12:24.065985+0000","last_became_peered":"2024-04-25T09:12:24.065985+0000","last_unstale":"2024-04-25T09:12:25.058170+0000","last_undegraded":"2024-04-25T09:12:25.058170+0000","last_fullsized":"2024-04-25T09:12:25.058170+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:11.609532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.058228+0000","last_change":"2024-04-25T09:12:23.056486+0000","last_active":"2024-04-25T09:12:25.058228+0000","last_peered":"2024-04-25T09:12:25.058228+0000","last_clean":"2024-04-25T09:12:25.058228+0000","last_became_active":"2024-04-25T09:12:23.056222+0000","last_became_peered":"2024-04-25T09:12:23.056222+0000","last_unstale":"2024-04-25T09:12:25.058228+0000","last_undegraded":"2024-04-25T09:12:25.058228+0000","last_fullsized":"2024-04-25T09:12:25.058228+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:17.914872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049158+0000","last_change":"2024-04-25T09:12:24.067132+0000","last_active":"2024-04-25T09:12:25.049158+0000","last_peered":"2024-04-25T09:12:25.049158+0000","last_clean":"2024-04-25T09:12:25.049158+0000","last_became_active":"2024-04-25T09:12:24.060905+0000","last_became_peered":"2024-04-25T09:12:24.060905+0000","last_unstale":"2024-04-25T09:12:25.049158+0000","last_undegraded":"2024-04-25T09:12:25.049158+0000","last_fullsized":"2024-04-25T09:12:25.049158+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:47:18.994741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.073089+0000","last_change":"2024-04-25T09:12:23.053679+0000","last_active":"2024-04-25T09:12:25.073089+0000","last_peered":"2024-04-25T09:12:25.073089+0000","last_clean":"2024-04-25T09:12:25.073089+0000","last_became_active":"2024-04-25T09:12:23.053377+0000","last_became_peered":"2024-04-25T09:12:23.053377+0000","last_unstale":"2024-04-25T09:12:25.073089+0000","last_undegraded":"2024-04-25T09:12:25.073089+0000","last_fullsized":"2024-04-25T09:12:25.073089+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:36.540104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057189+0000","last_change":"2024-04-25T09:12:24.067684+0000","last_active":"2024-04-25T09:12:25.057189+0000","last_peered":"2024-04-25T09:12:25.057189+0000","last_clean":"2024-04-25T09:12:25.057189+0000","last_became_active":"2024-04-25T09:12:24.067380+0000","last_became_peered":"2024-04-25T09:12:24.067380+0000","last_unstale":"2024-04-25T09:12:25.057189+0000","last_undegraded":"2024-04-25T09:12:25.057189+0000","last_fullsized":"2024-04-25T09:12:25.057189+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:52.135000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057540+0000","last_change":"2024-04-25T09:12:23.057801+0000","last_active":"2024-04-25T09:12:25.057540+0000","last_peered":"2024-04-25T09:12:25.057540+0000","last_clean":"2024-04-25T09:12:25.057540+0000","last_became_active":"2024-04-25T09:12:23.057437+0000","last_became_peered":"2024-04-25T09:12:23.057437+0000","last_unstale":"2024-04-25T09:12:25.057540+0000","last_undegraded":"2024-04-25T09:12:25.057540+0000","last_fullsized":"2024-04-25T09:12:25.057540+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:33.694941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.048913+0000","last_change":"2024-04-25T09:12:24.065155+0000","last_active":"2024-04-25T09:12:25.048913+0000","last_peered":"2024-04-25T09:12:25.048913+0000","last_clean":"2024-04-25T09:12:25.048913+0000","last_became_active":"2024-04-25T09:12:24.064887+0000","last_became_peered":"2024-04-25T09:12:24.064887+0000","last_unstale":"2024-04-25T09:12:25.048913+0000","last_undegraded":"2024-04-25T09:12:25.048913+0000","last_fullsized":"2024-04-25T09:12:25.048913+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:38.808549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.229987+0000","last_change":"2024-04-25T09:12:23.053810+0000","last_active":"2024-04-25T09:12:25.229987+0000","last_peered":"2024-04-25T09:12:25.229987+0000","last_clean":"2024-04-25T09:12:25.229987+0000","last_became_active":"2024-04-25T09:12:23.053499+0000","last_became_peered":"2024-04-25T09:12:23.053499+0000","last_unstale":"2024-04-25T09:12:25.229987+0000","last_undegraded":"2024-04-25T09:12:25.229987+0000","last_fullsized":"2024-04-25T09:12:25.229987+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:47.399870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.057829+0000","last_change":"2024-04-25T09:12:24.067169+0000","last_active":"2024-04-25T09:12:25.057829+0000","last_peered":"2024-04-25T09:12:25.057829+0000","last_clean":"2024-04-25T09:12:25.057829+0000","last_became_active":"2024-04-25T09:12:24.066885+0000","last_became_peered":"2024-04-25T09:12:24.066885+0000","last_unstale":"2024-04-25T09:12:25.057829+0000","last_undegraded":"2024-04-25T09:12:25.057829+0000","last_fullsized":"2024-04-25T09:12:25.057829+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:09.021743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.048962+0000","last_change":"2024-04-25T09:12:23.058716+0000","last_active":"2024-04-25T09:12:25.048962+0000","last_peered":"2024-04-25T09:12:25.048962+0000","last_clean":"2024-04-25T09:12:25.048962+0000","last_became_active":"2024-04-25T09:12:23.058484+0000","last_became_peered":"2024-04-25T09:12:23.058484+0000","last_unstale":"2024-04-25T09:12:25.048962+0000","last_undegraded":"2024-04-25T09:12:25.048962+0000","last_fullsized":"2024-04-25T09:12:25.048962+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:46.364931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.049697+0000","last_change":"2024-04-25T09:12:24.070865+0000","last_active":"2024-04-25T09:12:25.049697+0000","last_peered":"2024-04-25T09:12:25.049697+0000","last_clean":"2024-04-25T09:12:25.049697+0000","last_became_active":"2024-04-25T09:12:24.070558+0000","last_became_peered":"2024-04-25T09:12:24.070558+0000","last_unstale":"2024-04-25T09:12:25.049697+0000","last_undegraded":"2024-04-25T09:12:25.049697+0000","last_fullsized":"2024-04-25T09:12:25.049697+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:23.028480+0000","last_clean_scrub_stamp":"2024-04-25T09:12:23.028480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:46.027715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"99'1","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234351+0000","last_change":"2024-04-25T09:12:23.064267+0000","last_active":"2024-04-25T09:12:25.234351+0000","last_peered":"2024-04-25T09:12:25.234351+0000","last_clean":"2024-04-25T09:12:25.234351+0000","last_became_active":"2024-04-25T09:12:23.063855+0000","last_became_peered":"2024-04-25T09:12:23.063855+0000","last_unstale":"2024-04-25T09:12:25.234351+0000","last_undegraded":"2024-04-25T09:12:25.234351+0000","last_fullsized":"2024-04-25T09:12:25.234351+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:12:22.021630+0000","last_clean_scrub_stamp":"2024-04-25T09:12:22.021630+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:52:33.782597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":319,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-25T09:12:25.234135+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:12:25.234135+0000","last_peered":"2024-04-25T09:12:25.234135+0000","last_clean":"2024-04-25T09:12:25.234135+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:12:25.234135+0000","last_undegraded":"2024-04-25T09:12:25.234135+0000","last_fullsized":"2024-04-25T09:12:25.234135+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574953,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":1796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":1839104,"data_stored":1125329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574955,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32400,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339440,"statfs":{"total":96636764160,"available":96603586560,"internally_reserved":0,"allocated":1245184,"data_stored":535501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574952,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1241088,"data_stored":534919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574952,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1257472,"data_stored":536585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574954,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1253376,"data_stored":536483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1241088,"data_stored":534883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1236992,"data_stored":534849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1835008,"data_stored":1125799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:12:28.496 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:12:28.497 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:12:28.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee8400640 1 Processor -- start 2024-04-25T09:12:28.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee8400640 1 -- start start 2024-04-25T09:12:28.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee8400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ee015db80 0x7f9ee00ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:28.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee8400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9ee00cee90 0x7f9ee00cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:28.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee8400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ee00cfc30 0x7f9ee00d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:28.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee8400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee00d0390 con 0x7f9ee015db80 2024-04-25T09:12:28.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee8400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee00d00b0 con 0x7f9ee00cee90 2024-04-25T09:12:28.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee8400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee00cc130 con 0x7f9ee00cfc30 2024-04-25T09:12:28.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee5a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ee015db80 0x7f9ee00ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:28.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee5a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ee015db80 0x7f9ee00ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41450/0 (socket says 172.21.15.175:41450) 2024-04-25T09:12:28.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee5a00640 1 -- 172.21.15.175:0/3795215396 learned_addr learned my addr 172.21.15.175:0/3795215396 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:28.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee5000640 1 --2- 172.21.15.175:0/3795215396 >> v2:172.21.15.177:3300/0 conn(0x7f9ee00cee90 0x7f9ee00cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:28.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee6400640 1 --2- 172.21.15.175:0/3795215396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ee00cfc30 0x7f9ee00d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:28.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee5a00640 1 -- 172.21.15.175:0/3795215396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ee00cfc30 msgr2=0x7f9ee00d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:28.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee5a00640 1 --2- 172.21.15.175:0/3795215396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ee00cfc30 0x7f9ee00d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee5a00640 1 -- 172.21.15.175:0/3795215396 >> v2:172.21.15.177:3300/0 conn(0x7f9ee00cee90 msgr2=0x7f9ee00cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:28.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee5a00640 1 --2- 172.21.15.175:0/3795215396 >> v2:172.21.15.177:3300/0 conn(0x7f9ee00cee90 0x7f9ee00cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee5a00640 1 -- 172.21.15.175:0/3795215396 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee00cc410 con 0x7f9ee015db80 2024-04-25T09:12:28.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee5000640 1 --2- 172.21.15.175:0/3795215396 >> v2:172.21.15.177:3300/0 conn(0x7f9ee00cee90 0x7f9ee00cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:28.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.697+0000 7f9ee6400640 1 --2- 172.21.15.175:0/3795215396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ee00cfc30 0x7f9ee00d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:28.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.701+0000 7f9ee5a00640 1 --2- 172.21.15.175:0/3795215396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee015db80 0x7f9ee00ccc10 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00d2680 tx=0x7f9ed401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c64a39014df0b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:28.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.701+0000 7f9edfe00640 1 -- 172.21.15.175:0/3795215396 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed40a5670 con 0x7f9ee015db80 2024-04-25T09:12:28.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.701+0000 7f9edfe00640 1 -- 172.21.15.175:0/3795215396 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed40a5810 con 0x7f9ee015db80 2024-04-25T09:12:28.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.701+0000 7f9edfe00640 1 -- 172.21.15.175:0/3795215396 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed40a5be0 con 0x7f9ee015db80 2024-04-25T09:12:28.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.701+0000 7f9ee8400640 1 -- 172.21.15.175:0/3795215396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee015db80 msgr2=0x7f9ee00ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:28.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.701+0000 7f9ee8400640 1 --2- 172.21.15.175:0/3795215396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee015db80 0x7f9ee00ccc10 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00d2680 tx=0x7f9ed401c9f0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.701+0000 7f9ee8400640 1 -- 172.21.15.175:0/3795215396 shutdown_connections 2024-04-25T09:12:28.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.701+0000 7f9ee8400640 1 --2- 172.21.15.175:0/3795215396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ee00cfc30 0x7f9ee00d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.701+0000 7f9ee8400640 1 --2- 172.21.15.175:0/3795215396 >> v2:172.21.15.177:3300/0 conn(0x7f9ee00cee90 0x7f9ee00cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.701+0000 7f9ee8400640 1 --2- 172.21.15.175:0/3795215396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee015db80 0x7f9ee00ccc10 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.701+0000 7f9ee8400640 1 -- 172.21.15.175:0/3795215396 >> 172.21.15.175:0/3795215396 conn(0x7f9ee0070f40 msgr2=0x7f9ee0071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:28.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.701+0000 7f9ee8400640 1 -- 172.21.15.175:0/3795215396 shutdown_connections 2024-04-25T09:12:28.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.701+0000 7f9ee8400640 1 -- 172.21.15.175:0/3795215396 wait complete. 2024-04-25T09:12:28.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee8400640 1 Processor -- start 2024-04-25T09:12:28.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee8400640 1 -- start start 2024-04-25T09:12:28.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee8400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ee00cfc30 0x7f9ee00b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:28.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee8400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee015db80 0x7f9ee0166ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:28.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee8400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ee0167400 0x7f9ee0147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:28.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee8400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee006c6f0 con 0x7f9ee015db80 2024-04-25T09:12:28.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee8400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee006c570 con 0x7f9ee0167400 2024-04-25T09:12:28.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee8400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee0161760 con 0x7f9ee00cfc30 2024-04-25T09:12:28.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee5000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee015db80 0x7f9ee0166ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:28.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee5000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee015db80 0x7f9ee0166ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41456/0 (socket says 172.21.15.175:41456) 2024-04-25T09:12:28.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee5000640 1 -- 172.21.15.175:0/3367148113 learned_addr learned my addr 172.21.15.175:0/3367148113 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:28.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee5a00640 1 --2- 172.21.15.175:0/3367148113 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ee00cfc30 0x7f9ee00b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:28.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee6400640 1 --2- 172.21.15.175:0/3367148113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ee0167400 0x7f9ee0147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:28.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee5000640 1 -- 172.21.15.175:0/3367148113 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ee00cfc30 msgr2=0x7f9ee00b6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:28.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee5000640 1 --2- 172.21.15.175:0/3367148113 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ee00cfc30 0x7f9ee00b6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee5000640 1 -- 172.21.15.175:0/3367148113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ee0167400 msgr2=0x7f9ee0147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:28.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee5000640 1 --2- 172.21.15.175:0/3367148113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ee0167400 0x7f9ee0147750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee5000640 1 -- 172.21.15.175:0/3367148113 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee00b59d0 con 0x7f9ee015db80 2024-04-25T09:12:28.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee5000640 1 --2- 172.21.15.175:0/3367148113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee015db80 0x7f9ee0166ec0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00c7c0 tx=0x7f9ecc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:28.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9edd600640 1 -- 172.21.15.175:0/3367148113 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc015070 con 0x7f9ee015db80 2024-04-25T09:12:28.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9edd600640 1 -- 172.21.15.175:0/3367148113 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc007a30 con 0x7f9ee015db80 2024-04-25T09:12:28.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9edd600640 1 -- 172.21.15.175:0/3367148113 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc007e00 con 0x7f9ee015db80 2024-04-25T09:12:28.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee8400640 1 -- 172.21.15.175:0/3367148113 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee00b5cb0 con 0x7f9ee015db80 2024-04-25T09:12:28.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.705+0000 7f9ee8400640 1 -- 172.21.15.175:0/3367148113 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee00b6270 con 0x7f9ee015db80 2024-04-25T09:12:28.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.709+0000 7f9ee8400640 1 -- 172.21.15.175:0/3367148113 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee0074a60 con 0x7f9ee015db80 2024-04-25T09:12:28.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.709+0000 7f9edd600640 1 -- 172.21.15.175:0/3367148113 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9ecc018070 con 0x7f9ee015db80 2024-04-25T09:12:28.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.709+0000 7f9edd600640 1 --2- 172.21.15.175:0/3367148113 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9ec0066f60 0x7f9ec0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:28.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.709+0000 7f9edd600640 1 -- 172.21.15.175:0/3367148113 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ecc084f20 con 0x7f9ee015db80 2024-04-25T09:12:28.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.709+0000 7f9ee5a00640 1 --2- 172.21.15.175:0/3367148113 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9ec0066f60 0x7f9ec0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:28.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.709+0000 7f9ee5a00640 1 --2- 172.21.15.175:0/3367148113 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9ec0066f60 0x7f9ec0069420 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40ae000 tx=0x7f9ed40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:28.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.713+0000 7f9edd600640 1 -- 172.21.15.175:0/3367148113 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9ecc055840 con 0x7f9ee015db80 2024-04-25T09:12:28.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.929+0000 7f9ee8400640 1 -- 172.21.15.175:0/3367148113 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9ee00cbc20 con 0x7f9ee015db80 2024-04-25T09:12:28.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.933+0000 7f9edd600640 1 -- 172.21.15.175:0/3367148113 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7f9ecc0598e0 con 0x7f9ee015db80 2024-04-25T09:12:28.921 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2024-04-25T09:12:28.921 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBPHCpmhyCUBhAA8k9xLKIw8R04i6HSJykDfw== 2024-04-25T09:12:28.921 INFO:teuthology.orchestra.run.smithi175.stdout: caps mds = "allow" 2024-04-25T09:12:28.921 INFO:teuthology.orchestra.run.smithi175.stdout: caps mon = "allow r" 2024-04-25T09:12:28.921 INFO:teuthology.orchestra.run.smithi175.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:12:28.921 INFO:teuthology.orchestra.run.smithi175.stderr:updated caps for client.0 2024-04-25T09:12:28.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.937+0000 7f9ee8400640 1 -- 172.21.15.175:0/3367148113 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9ec0066f60 msgr2=0x7f9ec0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:28.923 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.937+0000 7f9ee8400640 1 --2- 172.21.15.175:0/3367148113 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9ec0066f60 0x7f9ec0069420 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40ae000 tx=0x7f9ed40a7070 comp rx=0 tx=0).stop 2024-04-25T09:12:28.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.937+0000 7f9ee8400640 1 -- 172.21.15.175:0/3367148113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee015db80 msgr2=0x7f9ee0166ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:28.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.937+0000 7f9ee8400640 1 --2- 172.21.15.175:0/3367148113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee015db80 0x7f9ee0166ec0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00c7c0 tx=0x7f9ecc00cc80 comp rx=0 tx=0).stop 2024-04-25T09:12:28.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.937+0000 7f9ee8400640 1 -- 172.21.15.175:0/3367148113 shutdown_connections 2024-04-25T09:12:28.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.937+0000 7f9ee8400640 1 --2- 172.21.15.175:0/3367148113 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9ec0066f60 0x7f9ec0069420 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.937+0000 7f9ee8400640 1 --2- 172.21.15.175:0/3367148113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ee0167400 0x7f9ee0147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.937+0000 7f9ee8400640 1 --2- 172.21.15.175:0/3367148113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ee015db80 0x7f9ee0166ec0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.937+0000 7f9ee8400640 1 --2- 172.21.15.175:0/3367148113 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ee00cfc30 0x7f9ee00b6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:28.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.937+0000 7f9ee8400640 1 -- 172.21.15.175:0/3367148113 >> 172.21.15.175:0/3367148113 conn(0x7f9ee0070f40 msgr2=0x7f9ee006d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:28.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.937+0000 7f9ee8400640 1 -- 172.21.15.175:0/3367148113 shutdown_connections 2024-04-25T09:12:28.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:28.937+0000 7f9ee8400640 1 -- 172.21.15.175:0/3367148113 wait complete. 2024-04-25T09:12:28.943 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:29.009 INFO:tasks.ceph.mds.a.smithi175.stderr:2024-04-25T09:12:29.021+0000 7fc0ba000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:12:29.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.093+0000 7fe930600640 1 Processor -- start 2024-04-25T09:12:29.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.093+0000 7fe930600640 1 -- start start 2024-04-25T09:12:29.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.093+0000 7fe930600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe92815dac0 0x7fe9280d3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.093+0000 7fe930600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe9280b5b70 0x7fe9280d1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.093+0000 7fe930600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9280b99b0 con 0x7fe9280b9570 2024-04-25T09:12:29.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.093+0000 7fe930600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9280d3000 con 0x7fe9280b5b70 2024-04-25T09:12:29.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.093+0000 7fe930600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280d23f0 con 0x7fe92815dac0 2024-04-25T09:12:29.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.093+0000 7fe92e600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe9280b5b70 0x7fe9280d1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.093+0000 7fe92dc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe92815dac0 0x7fe9280d3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.093+0000 7fe92e600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe9280b5b70 0x7fe9280d1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41472/0 (socket says 172.21.15.175:41472) 2024-04-25T09:12:29.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.093+0000 7fe92e600640 1 -- 172.21.15.175:0/2106036096 learned_addr learned my addr 172.21.15.175:0/2106036096 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:29.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.093+0000 7fe92e600640 1 -- 172.21.15.175:0/2106036096 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe92815dac0 msgr2=0x7fe9280d3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:29.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.093+0000 7fe92e600640 1 --2- 172.21.15.175:0/2106036096 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe92815dac0 0x7fe9280d3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.093+0000 7fe92e600640 1 -- 172.21.15.175:0/2106036096 >> v1:172.21.15.177:6789/0 conn(0x7fe9280b9570 legacy=0x7fe9280b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.093+0000 7fe92e600640 1 -- 172.21.15.175:0/2106036096 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9280d26d0 con 0x7fe9280b5b70 2024-04-25T09:12:29.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.097+0000 7fe92e600640 1 --2- 172.21.15.175:0/2106036096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9280b5b70 0x7fe9280d1ce0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fe920009e50 tx=0x7fe92001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb610e10b44a6d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:29.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.097+0000 7fe927e00640 1 -- 172.21.15.175:0/2106036096 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9200b4070 con 0x7fe9280b5b70 2024-04-25T09:12:29.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.097+0000 7fe927e00640 1 -- 172.21.15.175:0/2106036096 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9200af400 con 0x7fe9280b5b70 2024-04-25T09:12:29.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.097+0000 7fe927e00640 1 -- 172.21.15.175:0/2106036096 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9200af7d0 con 0x7fe9280b5b70 2024-04-25T09:12:29.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.097+0000 7fe930600640 1 -- 172.21.15.175:0/2106036096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9280b5b70 msgr2=0x7fe9280d1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.097+0000 7fe930600640 1 --2- 172.21.15.175:0/2106036096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9280b5b70 0x7fe9280d1ce0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fe920009e50 tx=0x7fe92001f210 comp rx=0 tx=0).stop 2024-04-25T09:12:29.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.097+0000 7fe930600640 1 -- 172.21.15.175:0/2106036096 shutdown_connections 2024-04-25T09:12:29.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.097+0000 7fe930600640 1 --2- 172.21.15.175:0/2106036096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9280b5b70 0x7fe9280d1ce0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.097+0000 7fe930600640 1 --2- 172.21.15.175:0/2106036096 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe92815dac0 0x7fe9280d3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.097+0000 7fe930600640 1 -- 172.21.15.175:0/2106036096 >> 172.21.15.175:0/2106036096 conn(0x7fe928072980 msgr2=0x7fe9280d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:29.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.097+0000 7fe930600640 1 -- 172.21.15.175:0/2106036096 shutdown_connections 2024-04-25T09:12:29.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.097+0000 7fe930600640 1 -- 172.21.15.175:0/2106036096 wait complete. 2024-04-25T09:12:29.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe930600640 1 Processor -- start 2024-04-25T09:12:29.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe930600640 1 -- start start 2024-04-25T09:12:29.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe930600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9280b5b70 0x7fe9281f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe930600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe9280b9570 0x7fe9280cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe930600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe92815dac0 0x7fe9280c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe930600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92815dea0 con 0x7fe9280b5b70 2024-04-25T09:12:29.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe930600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280d2c90 con 0x7fe92815dac0 2024-04-25T09:12:29.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe930600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280b69a0 con 0x7fe9280b9570 2024-04-25T09:12:29.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe92dc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9280b5b70 0x7fe9281f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe92dc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9280b5b70 0x7fe9281f06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41474/0 (socket says 172.21.15.175:41474) 2024-04-25T09:12:29.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe92dc00640 1 -- 172.21.15.175:0/1156140977 learned_addr learned my addr 172.21.15.175:0/1156140977 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:29.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe92e600640 1 --2- 172.21.15.175:0/1156140977 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe92815dac0 0x7fe9280c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe92d200640 1 --2- 172.21.15.175:0/1156140977 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe9280b9570 0x7fe9280cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe92dc00640 1 -- 172.21.15.175:0/1156140977 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe9280b9570 msgr2=0x7fe9280cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe92dc00640 1 --2- 172.21.15.175:0/1156140977 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe9280b9570 0x7fe9280cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe92dc00640 1 -- 172.21.15.175:0/1156140977 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe92815dac0 msgr2=0x7fe9280c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe92dc00640 1 --2- 172.21.15.175:0/1156140977 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe92815dac0 0x7fe9280c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe92dc00640 1 -- 172.21.15.175:0/1156140977 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9281f3650 con 0x7fe9280b5b70 2024-04-25T09:12:29.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe92d200640 1 --2- 172.21.15.175:0/1156140977 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe9280b9570 0x7fe9280cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:29.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe92dc00640 1 --2- 172.21.15.175:0/1156140977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9280b5b70 0x7fe9281f06c0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00e870 tx=0x7fe91c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:29.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe925600640 1 -- 172.21.15.175:0/1156140977 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c017070 con 0x7fe9280b5b70 2024-04-25T09:12:29.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe925600640 1 -- 172.21.15.175:0/1156140977 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c00c940 con 0x7fe9280b5b70 2024-04-25T09:12:29.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe925600640 1 -- 172.21.15.175:0/1156140977 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c00ccf0 con 0x7fe9280b5b70 2024-04-25T09:12:29.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe930600640 1 -- 172.21.15.175:0/1156140977 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9281f3930 con 0x7fe9280b5b70 2024-04-25T09:12:29.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.101+0000 7fe930600640 1 -- 172.21.15.175:0/1156140977 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9281f3ef0 con 0x7fe9280b5b70 2024-04-25T09:12:29.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.105+0000 7fe930600640 1 -- 172.21.15.175:0/1156140977 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe928074a60 con 0x7fe9280b5b70 2024-04-25T09:12:29.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.105+0000 7fe925600640 1 -- 172.21.15.175:0/1156140977 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe91c01a070 con 0x7fe9280b5b70 2024-04-25T09:12:29.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.105+0000 7fe925600640 1 --2- 172.21.15.175:0/1156140977 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe908066f60 0x7fe908069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.105+0000 7fe925600640 1 -- 172.21.15.175:0/1156140977 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe91c084fb0 con 0x7fe9280b5b70 2024-04-25T09:12:29.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.105+0000 7fe92d200640 1 --2- 172.21.15.175:0/1156140977 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe908066f60 0x7fe908069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.105+0000 7fe92d200640 1 --2- 172.21.15.175:0/1156140977 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe908066f60 0x7fe908069420 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe9280b25f0 tx=0x7fe914009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:29.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.109+0000 7fe925600640 1 -- 172.21.15.175:0/1156140977 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe91c055f20 con 0x7fe9280b5b70 2024-04-25T09:12:29.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.293+0000 7fe930600640 1 -- 172.21.15.175:0/1156140977 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe92806b130 con 0x7fe9280b5b70 2024-04-25T09:12:29.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.293+0000 7fe925600640 1 -- 172.21.15.175:0/1156140977 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4949 (secure 0 0 0) 0x7fe91c055820 con 0x7fe9280b5b70 2024-04-25T09:12:29.282 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:29.282 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":78,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6998,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3519467288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3519467288},{"type":"v1","addr":"172.21.15.177:6834","nonce":3519467288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2181426238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2181426238},{"type":"v1","addr":"172.21.15.177:6835","nonce":2181426238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/936884340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":936884340},{"type":"v1","addr":"172.21.15.175:6836","nonce":936884340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:23.414911+0000","modified":"2024-04-25T09:12:26.444040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8067":{"gid":8067,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/3952378765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3952378765},{"type":"v1","addr":"172.21.15.175:6837","nonce":3952378765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:12:29.282 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 78 2024-04-25T09:12:29.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.297+0000 7fe930600640 1 -- 172.21.15.175:0/1156140977 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe908066f60 msgr2=0x7fe908069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.297+0000 7fe930600640 1 --2- 172.21.15.175:0/1156140977 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe908066f60 0x7fe908069420 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe9280b25f0 tx=0x7fe914009040 comp rx=0 tx=0).stop 2024-04-25T09:12:29.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.297+0000 7fe930600640 1 -- 172.21.15.175:0/1156140977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9280b5b70 msgr2=0x7fe9281f06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.297+0000 7fe930600640 1 --2- 172.21.15.175:0/1156140977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9280b5b70 0x7fe9281f06c0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fe91c00e870 tx=0x7fe91c00ec70 comp rx=0 tx=0).stop 2024-04-25T09:12:29.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.297+0000 7fe930600640 1 -- 172.21.15.175:0/1156140977 shutdown_connections 2024-04-25T09:12:29.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.297+0000 7fe930600640 1 --2- 172.21.15.175:0/1156140977 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe908066f60 0x7fe908069420 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.297+0000 7fe930600640 1 --2- 172.21.15.175:0/1156140977 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe92815dac0 0x7fe9280c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.297+0000 7fe930600640 1 --2- 172.21.15.175:0/1156140977 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe9280b9570 0x7fe9280cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.297+0000 7fe930600640 1 --2- 172.21.15.175:0/1156140977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9280b5b70 0x7fe9281f06c0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.297+0000 7fe930600640 1 -- 172.21.15.175:0/1156140977 >> 172.21.15.175:0/1156140977 conn(0x7fe928072980 msgr2=0x7fe9280b3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:29.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.297+0000 7fe930600640 1 -- 172.21.15.175:0/1156140977 shutdown_connections 2024-04-25T09:12:29.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.297+0000 7fe930600640 1 -- 172.21.15.175:0/1156140977 wait complete. 2024-04-25T09:12:29.705 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:12:23.414911+0000', 'modified': '2024-04-25T09:12:26.444040+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8067}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8067': {'gid': 8067, 'name': 'a', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6837/3952378765', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6835', 'nonce': 3952378765}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 3952378765}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:12:29.705 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:12:29.705 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:12:29.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4eda00640 1 Processor -- start 2024-04-25T09:12:29.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4eda00640 1 -- start start 2024-04-25T09:12:29.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4eda00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa4e80b2b40 0x7fa4e80cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4eda00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e809ae40 con 0x7fa4e806c2c0 2024-04-25T09:12:29.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4eda00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e80b2f20 con 0x7fa4e8161d40 2024-04-25T09:12:29.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4eda00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e80d0250 con 0x7fa4e80b2b40 2024-04-25T09:12:29.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4e7400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa4e806c2c0 0x7fa4e8161630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:37964/0 (socket says 172.21.15.175:37964) 2024-04-25T09:12:29.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4e7400640 1 -- 172.21.15.175:0/835149841 learned_addr learned my addr 172.21.15.175:0/835149841 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:29.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4e7e00640 1 --2- 172.21.15.175:0/835149841 >> v2:172.21.15.177:3300/0 conn(0x7fa4e80b2b40 0x7fa4e80cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4e6a00640 1 -- 172.21.15.175:0/835149841 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982403570 0 0) 0x7fa4e809ae40 con 0x7fa4e806c2c0 2024-04-25T09:12:29.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4e6a00640 1 -- 172.21.15.175:0/835149841 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4cc003530 con 0x7fa4e806c2c0 2024-04-25T09:12:29.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4e6a00640 1 -- 172.21.15.175:0/835149841 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1076587292 0 0) 0x7fa4cc003530 con 0x7fa4e806c2c0 2024-04-25T09:12:29.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4e6a00640 1 -- 172.21.15.175:0/835149841 >> v2:172.21.15.177:3300/0 conn(0x7fa4e80b2b40 msgr2=0x7fa4e80cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:29.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4e6a00640 1 --2- 172.21.15.175:0/835149841 >> v2:172.21.15.177:3300/0 conn(0x7fa4e80b2b40 0x7fa4e80cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4e6a00640 1 -- 172.21.15.175:0/835149841 >> v1:172.21.15.177:6789/0 conn(0x7fa4e8161d40 legacy=0x7fa4e815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4e6a00640 1 -- 172.21.15.175:0/835149841 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e80d0530 con 0x7fa4e806c2c0 2024-04-25T09:12:29.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4e6a00640 1 -- 172.21.15.175:0/835149841 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fa4d4001680 con 0x7fa4e806c2c0 2024-04-25T09:12:29.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4e6a00640 1 -- 172.21.15.175:0/835149841 >> v1:172.21.15.175:6789/0 conn(0x7fa4e806c2c0 legacy=0x7fa4e8161630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4e6a00640 1 --2- 172.21.15.175:0/835149841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc003a10 0x7fa4cc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4e6a00640 1 --2- 172.21.15.175:0/835149841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4cc004810 0x7fa4cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4e6a00640 1 --2- 172.21.15.175:0/835149841 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4cc005240 0x7fa4cc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4e6a00640 1 -- 172.21.15.175:0/835149841 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e80d0250 con 0x7fa4cc003a10 2024-04-25T09:12:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4e6a00640 1 -- 172.21.15.175:0/835149841 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc00c1a0 con 0x7fa4cc004810 2024-04-25T09:12:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.857+0000 7fa4e6a00640 1 -- 172.21.15.175:0/835149841 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc00c3a0 con 0x7fa4cc005240 2024-04-25T09:12:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.861+0000 7fa4e7e00640 1 --2- 172.21.15.175:0/835149841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc003a10 0x7fa4cc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.861+0000 7fa4e7400640 1 --2- 172.21.15.175:0/835149841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4cc004810 0x7fa4cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.861+0000 7fa4ed000640 1 --2- 172.21.15.175:0/835149841 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4cc005240 0x7fa4cc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.861+0000 7fa4e7e00640 1 -- 172.21.15.175:0/835149841 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4cc005240 msgr2=0x7fa4cc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.861+0000 7fa4e7e00640 1 --2- 172.21.15.175:0/835149841 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4cc005240 0x7fa4cc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.861+0000 7fa4e7e00640 1 -- 172.21.15.175:0/835149841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4cc004810 msgr2=0x7fa4cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.861+0000 7fa4e7e00640 1 --2- 172.21.15.175:0/835149841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4cc004810 0x7fa4cc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.861+0000 7fa4e7e00640 1 -- 172.21.15.175:0/835149841 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4cc003530 con 0x7fa4cc003a10 2024-04-25T09:12:29.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.861+0000 7fa4ed000640 1 --2- 172.21.15.175:0/835149841 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4cc005240 0x7fa4cc00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:29.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.861+0000 7fa4ed000640 1 -- 172.21.15.175:0/835149841 reap_dead start 2024-04-25T09:12:29.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.861+0000 7fa4e7e00640 1 --2- 172.21.15.175:0/835149841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc003a10 0x7fa4cc003e50 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009fc0 tx=0x7fa4d801cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0f3b3111b491fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:29.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.861+0000 7fa4e6a00640 1 -- 172.21.15.175:0/835149841 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d80b2070 con 0x7fa4cc003a10 2024-04-25T09:12:29.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.861+0000 7fa4e6a00640 1 -- 172.21.15.175:0/835149841 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d80a5b80 con 0x7fa4cc003a10 2024-04-25T09:12:29.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.861+0000 7fa4e6a00640 1 -- 172.21.15.175:0/835149841 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8009c10 con 0x7fa4cc003a10 2024-04-25T09:12:29.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.861+0000 7fa4eda00640 1 -- 172.21.15.175:0/835149841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc003a10 msgr2=0x7fa4cc003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.861+0000 7fa4eda00640 1 --2- 172.21.15.175:0/835149841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc003a10 0x7fa4cc003e50 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8009fc0 tx=0x7fa4d801cb90 comp rx=0 tx=0).stop 2024-04-25T09:12:29.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4eda00640 1 -- 172.21.15.175:0/835149841 shutdown_connections 2024-04-25T09:12:29.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4eda00640 1 --2- 172.21.15.175:0/835149841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4cc003a10 0x7fa4cc003e50 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4eda00640 1 -- 172.21.15.175:0/835149841 >> 172.21.15.175:0/835149841 conn(0x7fa4e80b3140 msgr2=0x7fa4e80b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:29.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4eda00640 1 -- 172.21.15.175:0/835149841 shutdown_connections 2024-04-25T09:12:29.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4eda00640 1 -- 172.21.15.175:0/835149841 wait complete. 2024-04-25T09:12:29.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4eda00640 1 Processor -- start 2024-04-25T09:12:29.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4eda00640 1 -- start start 2024-04-25T09:12:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4eda00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4cc003a10 0x7fa4e814f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4eda00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4e814fed0 0x7fa4e80b5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4eda00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4e80b59b0 0x7fa4e80c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4eda00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e8161bc0 con 0x7fa4e80b59b0 2024-04-25T09:12:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4eda00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e8161a40 con 0x7fa4e814fed0 2024-04-25T09:12:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4eda00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e8099e30 con 0x7fa4cc003a10 2024-04-25T09:12:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4ed000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4e80b59b0 0x7fa4e80c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4ed000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4e80b59b0 0x7fa4e80c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43540/0 (socket says 172.21.15.175:43540) 2024-04-25T09:12:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4ed000640 1 -- 172.21.15.175:0/2386844886 learned_addr learned my addr 172.21.15.175:0/2386844886 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4e7400640 1 --2- 172.21.15.175:0/2386844886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4e814fed0 0x7fa4e80b5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4e7e00640 1 --2- 172.21.15.175:0/2386844886 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4cc003a10 0x7fa4e814f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4ed000640 1 -- 172.21.15.175:0/2386844886 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4cc003a10 msgr2=0x7fa4e814f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4ed000640 1 --2- 172.21.15.175:0/2386844886 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4cc003a10 0x7fa4e814f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4ed000640 1 -- 172.21.15.175:0/2386844886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4e814fed0 msgr2=0x7fa4e80b5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4ed000640 1 --2- 172.21.15.175:0/2386844886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4e814fed0 0x7fa4e80b5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4ed000640 1 -- 172.21.15.175:0/2386844886 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e80b61a0 con 0x7fa4e80b59b0 2024-04-25T09:12:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4ed000640 1 --2- 172.21.15.175:0/2386844886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4e80b59b0 0x7fa4e80c5e90 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80732d0 tx=0x7fa4e000e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:29.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.865+0000 7fa4dfe00640 1 -- 172.21.15.175:0/2386844886 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0019070 con 0x7fa4e80b59b0 2024-04-25T09:12:29.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.869+0000 7fa4dfe00640 1 -- 172.21.15.175:0/2386844886 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e0007e40 con 0x7fa4e80b59b0 2024-04-25T09:12:29.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.869+0000 7fa4dfe00640 1 -- 172.21.15.175:0/2386844886 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0003600 con 0x7fa4e80b59b0 2024-04-25T09:12:29.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.869+0000 7fa4eda00640 1 -- 172.21.15.175:0/2386844886 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e80b6480 con 0x7fa4e80b59b0 2024-04-25T09:12:29.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.869+0000 7fa4eda00640 1 -- 172.21.15.175:0/2386844886 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e80c5970 con 0x7fa4e80b59b0 2024-04-25T09:12:29.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.869+0000 7fa4dfe00640 1 -- 172.21.15.175:0/2386844886 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa4e001c070 con 0x7fa4e80b59b0 2024-04-25T09:12:29.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.869+0000 7fa4dfe00640 1 --2- 172.21.15.175:0/2386844886 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa4c8066f60 0x7fa4c8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.869+0000 7fa4dfe00640 1 -- 172.21.15.175:0/2386844886 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4e0084330 con 0x7fa4e80b59b0 2024-04-25T09:12:29.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.869+0000 7fa4e7e00640 1 --2- 172.21.15.175:0/2386844886 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa4c8066f60 0x7fa4c8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 Processor -- start 2024-04-25T09:12:29.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 -- start start 2024-04-25T09:12:29.858 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4e7e00640 1 --2- 172.21.15.175:0/2386844886 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa4c8066f60 0x7fa4c8069420 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80af000 tx=0x7fa4d8004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b3d3920 0x55584b3d3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3d4240 0x55584b3899f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b389f30 0x55584b38a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55584b2715f0 con 0x55584b3d4240 2024-04-25T09:12:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55584b1d8da0 con 0x55584b3d3920 2024-04-25T09:12:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55584b161150 con 0x55584b389f30 2024-04-25T09:12:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4e7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3d4240 0x55584b3899f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4e7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3d4240 0x55584b3899f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43556/0 (socket says 172.21.15.175:43556) 2024-04-25T09:12:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4e7400640 1 -- 172.21.15.175:0/2823157367 learned_addr learned my addr 172.21.15.175:0/2823157367 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4e7e00640 1 --2- 172.21.15.175:0/2823157367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b3d3920 0x55584b3d3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4ed000640 1 --2- 172.21.15.175:0/2823157367 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b389f30 0x55584b38a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4e7400640 1 -- 172.21.15.175:0/2823157367 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b389f30 msgr2=0x55584b38a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4e7400640 1 --2- 172.21.15.175:0/2823157367 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b389f30 0x55584b38a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4e7400640 1 -- 172.21.15.175:0/2823157367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b3d3920 msgr2=0x55584b3d3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4e7400640 1 --2- 172.21.15.175:0/2823157367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b3d3920 0x55584b3d3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4e7400640 1 -- 172.21.15.175:0/2823157367 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55584b17aca0 con 0x55584b3d4240 2024-04-25T09:12:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4e7400640 1 --2- 172.21.15.175:0/2823157367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3d4240 0x55584b3899f0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4007df0 tx=0x7fa4d4004bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d420c1b5149b0766 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4dcc00640 1 -- 172.21.15.175:0/2823157367 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4004cf0 con 0x55584b3d4240 2024-04-25T09:12:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4dcc00640 1 -- 172.21.15.175:0/2823157367 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d401a070 con 0x55584b3d4240 2024-04-25T09:12:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4dcc00640 1 -- 172.21.15.175:0/2823157367 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4015680 con 0x55584b3d4240 2024-04-25T09:12:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 -- 172.21.15.175:0/2823157367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3d4240 msgr2=0x55584b3899f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 --2- 172.21.15.175:0/2823157367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3d4240 0x55584b3899f0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4007df0 tx=0x7fa4d4004bc0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 -- 172.21.15.175:0/2823157367 shutdown_connections 2024-04-25T09:12:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 --2- 172.21.15.175:0/2823157367 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b389f30 0x55584b38a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 --2- 172.21.15.175:0/2823157367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3d4240 0x55584b3899f0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 --2- 172.21.15.175:0/2823157367 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b3d3920 0x55584b3d3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 -- 172.21.15.175:0/2823157367 >> 172.21.15.175:0/2823157367 conn(0x55584b3902a0 msgr2=0x55584b3882d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 -- 172.21.15.175:0/2823157367 shutdown_connections 2024-04-25T09:12:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 -- 172.21.15.175:0/2823157367 wait complete. 2024-04-25T09:12:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 -- start start 2024-04-25T09:12:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.873+0000 7fa4f2400000 1 Processor -- start 2024-04-25T09:12:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4f2400000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b389f30 0x55584b3daf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4f2400000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b3d3920 0x55584b3db4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4f2400000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3d4240 0x55584b38daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4f2400000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55584b193990 con 0x55584b3d4240 2024-04-25T09:12:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4f2400000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55584b1d4e40 con 0x55584b3d3920 2024-04-25T09:12:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4f2400000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55584b164900 con 0x55584b389f30 2024-04-25T09:12:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4f2400000 10 client.0 _ll_register_callbacks cb 0x55584b28c1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4ed000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3d4240 0x55584b38daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4ed000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3d4240 0x55584b38daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43558/0 (socket says 172.21.15.175:43558) 2024-04-25T09:12:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4e7e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b389f30 0x55584b3daf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4ed000640 1 -- 172.21.15.175:0/737152647 learned_addr learned my addr 172.21.15.175:0/737152647 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4e7400640 1 --2- 172.21.15.175:0/737152647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b3d3920 0x55584b3db4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4ed000640 1 -- 172.21.15.175:0/737152647 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b389f30 msgr2=0x55584b3daf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4ed000640 1 --2- 172.21.15.175:0/737152647 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b389f30 0x55584b3daf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4ed000640 1 -- 172.21.15.175:0/737152647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b3d3920 msgr2=0x55584b3db4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4ed000640 1 --2- 172.21.15.175:0/737152647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b3d3920 0x55584b3db4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4ed000640 1 -- 172.21.15.175:0/737152647 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55584b191630 con 0x55584b3d4240 2024-04-25T09:12:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4e7400640 1 --2- 172.21.15.175:0/737152647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b3d3920 0x55584b3db4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4ed000640 1 --2- 172.21.15.175:0/737152647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3d4240 0x55584b38daa0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fa4e000ed20 tx=0x7fa4e0054c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3fbbe4a5927e6d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4d1600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:12:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4d1600640 1 -- 172.21.15.175:0/737152647 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00512c0 con 0x55584b3d4240 2024-04-25T09:12:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4d1600640 1 -- 172.21.15.175:0/737152647 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4e0068b60 con 0x55584b3d4240 2024-04-25T09:12:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4f2400000 1 -- 172.21.15.175:0/737152647 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa4d401a070 con 0x55584b3d4240 2024-04-25T09:12:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4d1600640 1 -- 172.21.15.175:0/737152647 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4e0071050 con 0x55584b3d4240 2024-04-25T09:12:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4f2400000 10 client.8211 fetch_fsmap learned FSMap version 78 2024-04-25T09:12:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4f2400000 1 -- 172.21.15.175:0/737152647 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55584b1613a0 con 0x55584b3d4240 2024-04-25T09:12:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4d1600640 1 -- 172.21.15.175:0/737152647 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d401a070 con 0x55584b3d4240 2024-04-25T09:12:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4d1600640 1 -- 172.21.15.175:0/737152647 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa4e00540a0 con 0x55584b3d4240 2024-04-25T09:12:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4f2400000 10 client.8211 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:12:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4f2400000 10 client.8211 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:12:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4f2400000 20 client.8211 populate_metadata read hostname 'smithi175' 2024-04-25T09:12:29.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4f2400000 1 --2- 172.21.15.175:0/737152647 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55584b38f160 0x55584b3e4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4f2400000 4 client.8211 mds_command: new command op to 8067 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:12:29.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4f2400000 1 -- 172.21.15.175:0/737152647 --> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55584b174a50 con 0x55584b38f160 2024-04-25T09:12:29.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4e7e00640 1 --2- 172.21.15.175:0/737152647 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55584b38f160 0x55584b3e4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4d1600640 10 client.8211 ms_handle_connect on v2:172.21.15.175:6835/3952378765 2024-04-25T09:12:29.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4e7e00640 1 --2- 172.21.15.175:0/737152647 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55584b38f160 0x55584b3e4fd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dcec1eb6afff0cd server_cookie=c73fc28cb8ff7efb in_seq=0 out_seq=0 2024-04-25T09:12:29.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4d1600640 1 -- 172.21.15.175:0/737152647 <== mds.0 v2:172.21.15.175:6835/3952378765 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55584b174a50 con 0x55584b38f160 2024-04-25T09:12:29.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4d1600640 10 client.8211 handle_command_reply: tid=0 2024-04-25T09:12:29.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.877+0000 7fa4f2400000 1 client.8211 shutdown 2024-04-25T09:12:29.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.881+0000 7fa4f2400000 1 -- 172.21.15.175:0/737152647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3d4240 msgr2=0x55584b38daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.881+0000 7fa4f2400000 1 --2- 172.21.15.175:0/737152647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3d4240 0x55584b38daa0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fa4e000ed20 tx=0x7fa4e0054c50 comp rx=0 tx=0).stop 2024-04-25T09:12:29.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.881+0000 7fa4f2400000 1 -- 172.21.15.175:0/737152647 shutdown_connections 2024-04-25T09:12:29.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.881+0000 7fa4f2400000 1 --2- 172.21.15.175:0/737152647 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55584b38f160 0x55584b3e4fd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.881+0000 7fa4f2400000 1 --2- 172.21.15.175:0/737152647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3d4240 0x55584b38daa0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.881+0000 7fa4f2400000 1 --2- 172.21.15.175:0/737152647 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b3d3920 0x55584b3db4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.881+0000 7fa4d1600640 0 client.8211 ms_handle_reset on v2:172.21.15.175:6835/3952378765 2024-04-25T09:12:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.881+0000 7fa4f2400000 1 --2- 172.21.15.175:0/737152647 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b389f30 0x55584b3daf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.881+0000 7fa4f2400000 1 -- 172.21.15.175:0/737152647 >> 172.21.15.175:0/737152647 conn(0x55584b3902a0 msgr2=0x55584b3889e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.881+0000 7fa4f2400000 1 -- 172.21.15.175:0/737152647 shutdown_connections 2024-04-25T09:12:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.881+0000 7fa4f2400000 1 -- 172.21.15.175:0/737152647 wait complete. 2024-04-25T09:12:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.881+0000 7fa4f2400000 20 client.8211 trim_cache size 0 max 16384 2024-04-25T09:12:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.893+0000 7fa4f2400000 1 Processor -- start 2024-04-25T09:12:29.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.893+0000 7fa4f2400000 1 -- start start 2024-04-25T09:12:29.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4f2400000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3902a0 0x55584b437c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4f2400000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b389f30 0x55584b4381d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4f2400000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b3d3920 0x55584b438710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4f2400000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e82028d0 con 0x55584b3902a0 2024-04-25T09:12:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4f2400000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e81eb800 con 0x55584b389f30 2024-04-25T09:12:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4f2400000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e81ebe00 con 0x55584b3d3920 2024-04-25T09:12:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4e7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3902a0 0x55584b437c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4e7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3902a0 0x55584b437c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43568/0 (socket says 172.21.15.175:43568) 2024-04-25T09:12:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4e7e00640 1 -- 172.21.15.175:0/1792110855 learned_addr learned my addr 172.21.15.175:0/1792110855 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4e7400640 1 --2- 172.21.15.175:0/1792110855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b389f30 0x55584b4381d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4ed000640 1 --2- 172.21.15.175:0/1792110855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b3d3920 0x55584b438710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4e7e00640 1 -- 172.21.15.175:0/1792110855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b3d3920 msgr2=0x55584b438710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4e7e00640 1 --2- 172.21.15.175:0/1792110855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b3d3920 0x55584b438710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4e7e00640 1 -- 172.21.15.175:0/1792110855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b389f30 msgr2=0x55584b4381d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4e7e00640 1 --2- 172.21.15.175:0/1792110855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b389f30 0x55584b4381d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4e7e00640 1 -- 172.21.15.175:0/1792110855 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55584b3d4070 con 0x55584b3902a0 2024-04-25T09:12:29.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4e7400640 1 --2- 172.21.15.175:0/1792110855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b389f30 0x55584b4381d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:29.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4ed000640 1 --2- 172.21.15.175:0/1792110855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b3d3920 0x55584b438710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:29.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4e7e00640 1 --2- 172.21.15.175:0/1792110855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3902a0 0x55584b437c90 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80b0040 tx=0x7fa4d8004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb94b6bdf29d966 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:29.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4d3e00640 1 -- 172.21.15.175:0/1792110855 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d80b2040 con 0x55584b3902a0 2024-04-25T09:12:29.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4d3e00640 1 -- 172.21.15.175:0/1792110855 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d80cf070 con 0x55584b3902a0 2024-04-25T09:12:29.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4d3e00640 1 -- 172.21.15.175:0/1792110855 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d80ca240 con 0x55584b3902a0 2024-04-25T09:12:29.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4f2400000 1 -- 172.21.15.175:0/1792110855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3902a0 msgr2=0x55584b437c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4f2400000 1 --2- 172.21.15.175:0/1792110855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3902a0 0x55584b437c90 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80b0040 tx=0x7fa4d8004a50 comp rx=0 tx=0).stop 2024-04-25T09:12:29.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4f2400000 1 -- 172.21.15.175:0/1792110855 shutdown_connections 2024-04-25T09:12:29.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4f2400000 1 --2- 172.21.15.175:0/1792110855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b3d3920 0x55584b438710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4f2400000 1 --2- 172.21.15.175:0/1792110855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b389f30 0x55584b4381d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4f2400000 1 --2- 172.21.15.175:0/1792110855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3902a0 0x55584b437c90 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4f2400000 1 -- 172.21.15.175:0/1792110855 >> 172.21.15.175:0/1792110855 conn(0x55584b3db070 msgr2=0x55584b38d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4f2400000 1 -- 172.21.15.175:0/1792110855 shutdown_connections 2024-04-25T09:12:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4f2400000 1 -- 172.21.15.175:0/1792110855 wait complete. 2024-04-25T09:12:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4f2400000 1 -- start start 2024-04-25T09:12:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.897+0000 7fa4f2400000 1 Processor -- start 2024-04-25T09:12:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b389f30 0x55584b3dff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3902a0 0x55584b3e0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b3d3920 0x55584b3f7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55584b1dd3d0 con 0x55584b3902a0 2024-04-25T09:12:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55584b294d50 con 0x55584b389f30 2024-04-25T09:12:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55584b173980 con 0x55584b3d3920 2024-04-25T09:12:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 10 client.0 _ll_register_callbacks cb 0x55584b179330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:29.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4e7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3902a0 0x55584b3e0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4e7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3902a0 0x55584b3e0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43582/0 (socket says 172.21.15.175:43582) 2024-04-25T09:12:29.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4e7400640 1 -- 172.21.15.175:0/3200353714 learned_addr learned my addr 172.21.15.175:0/3200353714 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:29.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4ed000640 1 --2- 172.21.15.175:0/3200353714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b3d3920 0x55584b3f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4e7e00640 1 --2- 172.21.15.175:0/3200353714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b389f30 0x55584b3dff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4e7400640 1 -- 172.21.15.175:0/3200353714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b3d3920 msgr2=0x55584b3f7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:29.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4e7400640 1 --2- 172.21.15.175:0/3200353714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b3d3920 0x55584b3f7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4e7400640 1 -- 172.21.15.175:0/3200353714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b389f30 msgr2=0x55584b3dff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:29.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4e7400640 1 --2- 172.21.15.175:0/3200353714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b389f30 0x55584b3dff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4e7400640 1 -- 172.21.15.175:0/3200353714 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55584b25a600 con 0x55584b3902a0 2024-04-25T09:12:29.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4e7400640 1 --2- 172.21.15.175:0/3200353714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3902a0 0x55584b3e0470 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4001060 tx=0x7fa4e80d0700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5e43c9edf1b0df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:29.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4d1600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:12:29.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4d1600640 1 -- 172.21.15.175:0/3200353714 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4015b80 con 0x55584b3902a0 2024-04-25T09:12:29.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4d1600640 1 -- 172.21.15.175:0/3200353714 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4d4015d20 con 0x55584b3902a0 2024-04-25T09:12:29.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 -- 172.21.15.175:0/3200353714 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa4d80cf070 con 0x55584b3902a0 2024-04-25T09:12:29.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4d1600640 1 -- 172.21.15.175:0/3200353714 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4d4032050 con 0x55584b3902a0 2024-04-25T09:12:29.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 10 client.8217 fetch_fsmap learned FSMap version 78 2024-04-25T09:12:29.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 -- 172.21.15.175:0/3200353714 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55584b16d9b0 con 0x55584b3902a0 2024-04-25T09:12:29.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4d1600640 1 -- 172.21.15.175:0/3200353714 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d80cf070 con 0x55584b3902a0 2024-04-25T09:12:29.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4d1600640 1 -- 172.21.15.175:0/3200353714 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa4d4035020 con 0x55584b3902a0 2024-04-25T09:12:29.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 10 client.8217 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:12:29.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 10 client.8217 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:12:29.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 20 client.8217 populate_metadata read hostname 'smithi175' 2024-04-25T09:12:29.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 --2- 172.21.15.175:0/3200353714 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55584b3d4240 0x55584b3f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 4 client.8217 mds_command: new command op to 8067 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:12:29.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 -- 172.21.15.175:0/3200353714 --> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55584b1e62e0 con 0x55584b3d4240 2024-04-25T09:12:29.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4e7e00640 1 --2- 172.21.15.175:0/3200353714 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55584b3d4240 0x55584b3f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:29.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4e7e00640 1 --2- 172.21.15.175:0/3200353714 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55584b3d4240 0x55584b3f77a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1faa08d329e5a1a server_cookie=b855eb75c0563c62 in_seq=0 out_seq=0 2024-04-25T09:12:29.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4d1600640 10 client.8217 ms_handle_connect on v2:172.21.15.175:6835/3952378765 2024-04-25T09:12:29.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4d1600640 1 -- 172.21.15.175:0/3200353714 <== mds.0 v2:172.21.15.175:6835/3952378765 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55584b1e62e0 con 0x55584b3d4240 2024-04-25T09:12:29.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4d1600640 10 client.8217 handle_command_reply: tid=0 2024-04-25T09:12:29.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 client.8217 shutdown 2024-04-25T09:12:29.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 -- 172.21.15.175:0/3200353714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3902a0 msgr2=0x55584b3e0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 --2- 172.21.15.175:0/3200353714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3902a0 0x55584b3e0470 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4001060 tx=0x7fa4e80d0700 comp rx=0 tx=0).stop 2024-04-25T09:12:29.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 -- 172.21.15.175:0/3200353714 shutdown_connections 2024-04-25T09:12:29.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 --2- 172.21.15.175:0/3200353714 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55584b3d4240 0x55584b3f77a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 --2- 172.21.15.175:0/3200353714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55584b3d3920 0x55584b3f7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 --2- 172.21.15.175:0/3200353714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55584b3902a0 0x55584b3e0470 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4d1600640 0 client.8217 ms_handle_reset on v2:172.21.15.175:6835/3952378765 2024-04-25T09:12:29.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 --2- 172.21.15.175:0/3200353714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55584b389f30 0x55584b3dff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 -- 172.21.15.175:0/3200353714 >> 172.21.15.175:0/3200353714 conn(0x55584b3db070 msgr2=0x55584b3dba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:29.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 -- 172.21.15.175:0/3200353714 shutdown_connections 2024-04-25T09:12:29.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 1 -- 172.21.15.175:0/3200353714 wait complete. 2024-04-25T09:12:29.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.901+0000 7fa4f2400000 20 client.8217 trim_cache size 0 max 16384 2024-04-25T09:12:29.894 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:12:29.894 INFO:teuthology.orchestra.run.smithi175.stdout: "cluster_fsid": "8caed986-ca08-40e2-b5a5-12e2aade6223", 2024-04-25T09:12:29.894 INFO:teuthology.orchestra.run.smithi175.stdout: "whoami": 0, 2024-04-25T09:12:29.894 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 8067, 2024-04-25T09:12:29.894 INFO:teuthology.orchestra.run.smithi175.stdout: "want_state": "up:active", 2024-04-25T09:12:29.894 INFO:teuthology.orchestra.run.smithi175.stdout: "state": "up:active", 2024-04-25T09:12:29.894 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs", 2024-04-25T09:12:29.894 INFO:teuthology.orchestra.run.smithi175.stdout: "rank_uptime": 5.8445973660000003, 2024-04-25T09:12:29.894 INFO:teuthology.orchestra.run.smithi175.stdout: "mdsmap_epoch": 78, 2024-04-25T09:12:29.894 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch": 100, 2024-04-25T09:12:29.895 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch_barrier": 100, 2024-04-25T09:12:29.895 INFO:teuthology.orchestra.run.smithi175.stdout: "uptime": 11.758574447000001 2024-04-25T09:12:29.895 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:12:29.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.905+0000 7fa4eda00640 1 -- 172.21.15.175:0/2386844886 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa4c8066f60 msgr2=0x7fa4c8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.905+0000 7fa4eda00640 1 --2- 172.21.15.175:0/2386844886 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa4c8066f60 0x7fa4c8069420 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80af000 tx=0x7fa4d8004ac0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.905+0000 7fa4eda00640 1 -- 172.21.15.175:0/2386844886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4e80b59b0 msgr2=0x7fa4e80c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:29.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.905+0000 7fa4eda00640 1 --2- 172.21.15.175:0/2386844886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4e80b59b0 0x7fa4e80c5e90 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80732d0 tx=0x7fa4e000e820 comp rx=0 tx=0).stop 2024-04-25T09:12:29.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.905+0000 7fa4eda00640 1 -- 172.21.15.175:0/2386844886 shutdown_connections 2024-04-25T09:12:29.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.905+0000 7fa4eda00640 1 --2- 172.21.15.175:0/2386844886 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa4c8066f60 0x7fa4c8069420 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.905+0000 7fa4eda00640 1 --2- 172.21.15.175:0/2386844886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4e80b59b0 0x7fa4e80c5e90 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.905+0000 7fa4eda00640 1 --2- 172.21.15.175:0/2386844886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4e814fed0 0x7fa4e80b5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.905+0000 7fa4eda00640 1 --2- 172.21.15.175:0/2386844886 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4cc003a10 0x7fa4e814f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:29.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.905+0000 7fa4eda00640 1 -- 172.21.15.175:0/2386844886 >> 172.21.15.175:0/2386844886 conn(0x7fa4e80b3140 msgr2=0x7fa4e80b0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:29.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.905+0000 7fa4eda00640 1 -- 172.21.15.175:0/2386844886 shutdown_connections 2024-04-25T09:12:29.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:29.905+0000 7fa4eda00640 1 -- 172.21.15.175:0/2386844886 wait complete. 2024-04-25T09:12:29.908 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:12:30.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.057+0000 7f2e78800640 1 Processor -- start 2024-04-25T09:12:30.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.057+0000 7f2e78800640 1 -- start start 2024-04-25T09:12:30.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.057+0000 7f2e78800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2e70144fc0 0x7f2e700cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.057+0000 7f2e78800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e701453a0 0x7f2e7015bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.057+0000 7f2e78800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2e700cc3b0 0x7f2e7015c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.057+0000 7f2e78800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7015cd00 con 0x7f2e700cc3b0 2024-04-25T09:12:30.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.057+0000 7f2e78800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e700ce660 con 0x7f2e70144fc0 2024-04-25T09:12:30.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.057+0000 7f2e78800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e700cc930 con 0x7f2e701453a0 2024-04-25T09:12:30.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.061+0000 7f2e76800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2e700cc3b0 0x7f2e7015c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.061+0000 7f2e76800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2e700cc3b0 0x7f2e7015c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43590/0 (socket says 172.21.15.175:43590) 2024-04-25T09:12:30.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.061+0000 7f2e76800640 1 -- 172.21.15.175:0/1992795527 learned_addr learned my addr 172.21.15.175:0/1992795527 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:30.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.061+0000 7f2e75400640 1 --2- 172.21.15.175:0/1992795527 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e701453a0 0x7f2e7015bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.061+0000 7f2e75e00640 1 --2- 172.21.15.175:0/1992795527 >> v2:172.21.15.177:3300/0 conn(0x7f2e70144fc0 0x7f2e700cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.061+0000 7f2e76800640 1 -- 172.21.15.175:0/1992795527 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e701453a0 msgr2=0x7f2e7015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:30.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.061+0000 7f2e76800640 1 --2- 172.21.15.175:0/1992795527 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e701453a0 0x7f2e7015bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.061+0000 7f2e76800640 1 -- 172.21.15.175:0/1992795527 >> v2:172.21.15.177:3300/0 conn(0x7f2e70144fc0 msgr2=0x7f2e700cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:30.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.061+0000 7f2e76800640 1 --2- 172.21.15.175:0/1992795527 >> v2:172.21.15.177:3300/0 conn(0x7f2e70144fc0 0x7f2e700cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.061+0000 7f2e76800640 1 -- 172.21.15.175:0/1992795527 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e700ccc10 con 0x7f2e700cc3b0 2024-04-25T09:12:30.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.061+0000 7f2e75400640 1 --2- 172.21.15.175:0/1992795527 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e701453a0 0x7f2e7015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:30.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.061+0000 7f2e75e00640 1 --2- 172.21.15.175:0/1992795527 >> v2:172.21.15.177:3300/0 conn(0x7f2e70144fc0 0x7f2e700cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:30.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.061+0000 7f2e76800640 1 --2- 172.21.15.175:0/1992795527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e700cc3b0 0x7f2e7015c410 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f2e700b4c00 tx=0x7f2e6c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b252ffd784ebfee6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:30.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.061+0000 7f2e74a00640 1 -- 172.21.15.175:0/1992795527 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c0a5780 con 0x7f2e700cc3b0 2024-04-25T09:12:30.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.061+0000 7f2e74a00640 1 -- 172.21.15.175:0/1992795527 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6c0a5920 con 0x7f2e700cc3b0 2024-04-25T09:12:30.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.061+0000 7f2e74a00640 1 -- 172.21.15.175:0/1992795527 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c0a5cf0 con 0x7f2e700cc3b0 2024-04-25T09:12:30.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e78800640 1 -- 172.21.15.175:0/1992795527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e700cc3b0 msgr2=0x7f2e7015c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e78800640 1 --2- 172.21.15.175:0/1992795527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e700cc3b0 0x7f2e7015c410 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f2e700b4c00 tx=0x7f2e6c01c9f0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e78800640 1 -- 172.21.15.175:0/1992795527 shutdown_connections 2024-04-25T09:12:30.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e78800640 1 --2- 172.21.15.175:0/1992795527 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e700cc3b0 0x7f2e7015c410 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e78800640 1 --2- 172.21.15.175:0/1992795527 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e701453a0 0x7f2e7015bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e78800640 1 --2- 172.21.15.175:0/1992795527 >> v2:172.21.15.177:3300/0 conn(0x7f2e70144fc0 0x7f2e700cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e78800640 1 -- 172.21.15.175:0/1992795527 >> 172.21.15.175:0/1992795527 conn(0x7f2e70067150 msgr2=0x7f2e7006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:30.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e78800640 1 -- 172.21.15.175:0/1992795527 shutdown_connections 2024-04-25T09:12:30.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e78800640 1 -- 172.21.15.175:0/1992795527 wait complete. 2024-04-25T09:12:30.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e78800640 1 Processor -- start 2024-04-25T09:12:30.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e78800640 1 -- start start 2024-04-25T09:12:30.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e78800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e70144fc0 0x7f2e70143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e78800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e701453a0 0x7f2e70143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e78800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e7015aea0 0x7f2e7013e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e78800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e70160020 con 0x7f2e70144fc0 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e78800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7015fea0 con 0x7f2e7015aea0 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e78800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e701601a0 con 0x7f2e701453a0 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e75e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e70144fc0 0x7f2e70143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e75e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e70144fc0 0x7f2e70143400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43598/0 (socket says 172.21.15.175:43598) 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e75e00640 1 -- 172.21.15.175:0/1581504442 learned_addr learned my addr 172.21.15.175:0/1581504442 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e75400640 1 --2- 172.21.15.175:0/1581504442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e701453a0 0x7f2e70143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e76800640 1 --2- 172.21.15.175:0/1581504442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e7015aea0 0x7f2e7013e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e75e00640 1 -- 172.21.15.175:0/1581504442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e701453a0 msgr2=0x7f2e70143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e75e00640 1 --2- 172.21.15.175:0/1581504442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e701453a0 0x7f2e70143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e75e00640 1 -- 172.21.15.175:0/1581504442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e7015aea0 msgr2=0x7f2e7013e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e75e00640 1 --2- 172.21.15.175:0/1581504442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e7015aea0 0x7f2e7013e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e75e00640 1 -- 172.21.15.175:0/1581504442 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7015b640 con 0x7f2e70144fc0 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e76800640 1 --2- 172.21.15.175:0/1581504442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e7015aea0 0x7f2e7013e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:30.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.065+0000 7f2e75400640 1 --2- 172.21.15.175:0/1581504442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e701453a0 0x7f2e70143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:30.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.069+0000 7f2e75e00640 1 --2- 172.21.15.175:0/1581504442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e70144fc0 0x7f2e70143400 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400c7f0 tx=0x7f2e6400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:30.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.069+0000 7f2e6a000640 1 -- 172.21.15.175:0/1581504442 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64015070 con 0x7f2e70144fc0 2024-04-25T09:12:30.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.069+0000 7f2e6a000640 1 -- 172.21.15.175:0/1581504442 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e64007820 con 0x7f2e70144fc0 2024-04-25T09:12:30.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.069+0000 7f2e6a000640 1 -- 172.21.15.175:0/1581504442 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64007c10 con 0x7f2e70144fc0 2024-04-25T09:12:30.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.069+0000 7f2e78800640 1 -- 172.21.15.175:0/1581504442 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7013ee30 con 0x7f2e70144fc0 2024-04-25T09:12:30.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.069+0000 7f2e78800640 1 -- 172.21.15.175:0/1581504442 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7013f3f0 con 0x7f2e70144fc0 2024-04-25T09:12:30.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.069+0000 7f2e78800640 1 -- 172.21.15.175:0/1581504442 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e70074a60 con 0x7f2e70144fc0 2024-04-25T09:12:30.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.069+0000 7f2e6a000640 1 -- 172.21.15.175:0/1581504442 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2e64018070 con 0x7f2e70144fc0 2024-04-25T09:12:30.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.069+0000 7f2e6a000640 1 --2- 172.21.15.175:0/1581504442 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e54066f90 0x7f2e54069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.069+0000 7f2e6a000640 1 -- 172.21.15.175:0/1581504442 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e64085150 con 0x7f2e70144fc0 2024-04-25T09:12:30.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.069+0000 7f2e75400640 1 --2- 172.21.15.175:0/1581504442 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e54066f90 0x7f2e54069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.069+0000 7f2e75400640 1 --2- 172.21.15.175:0/1581504442 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e54066f90 0x7f2e54069450 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2e701429f0 tx=0x7f2e60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:30.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.073+0000 7f2e6a000640 1 -- 172.21.15.175:0/1581504442 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2e7015b640 con 0x7f2e70144fc0 2024-04-25T09:12:30.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.261+0000 7f2e78800640 1 -- 172.21.15.175:0/1581504442 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2e701431e0 con 0x7f2e70144fc0 2024-04-25T09:12:30.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.265+0000 7f2e6a000640 1 -- 172.21.15.175:0/1581504442 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2e640560c0 con 0x7f2e70144fc0 2024-04-25T09:12:30.251 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:12:30.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.265+0000 7f2e78800640 1 -- 172.21.15.175:0/1581504442 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e54066f90 msgr2=0x7f2e54069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.265+0000 7f2e78800640 1 --2- 172.21.15.175:0/1581504442 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e54066f90 0x7f2e54069450 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f2e701429f0 tx=0x7f2e60008040 comp rx=0 tx=0).stop 2024-04-25T09:12:30.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.265+0000 7f2e78800640 1 -- 172.21.15.175:0/1581504442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e70144fc0 msgr2=0x7f2e70143400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.265+0000 7f2e78800640 1 --2- 172.21.15.175:0/1581504442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e70144fc0 0x7f2e70143400 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400c7f0 tx=0x7f2e6400ccb0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.265+0000 7f2e78800640 1 -- 172.21.15.175:0/1581504442 shutdown_connections 2024-04-25T09:12:30.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.265+0000 7f2e78800640 1 --2- 172.21.15.175:0/1581504442 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2e54066f90 0x7f2e54069450 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.265+0000 7f2e78800640 1 --2- 172.21.15.175:0/1581504442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e7015aea0 0x7f2e7013e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.265+0000 7f2e78800640 1 --2- 172.21.15.175:0/1581504442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e701453a0 0x7f2e70143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.265+0000 7f2e78800640 1 --2- 172.21.15.175:0/1581504442 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e70144fc0 0x7f2e70143400 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.265+0000 7f2e78800640 1 -- 172.21.15.175:0/1581504442 >> 172.21.15.175:0/1581504442 conn(0x7f2e700cc3b0 msgr2=0x7f2e7006ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:30.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.265+0000 7f2e78800640 1 -- 172.21.15.175:0/1581504442 shutdown_connections 2024-04-25T09:12:30.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:30.265+0000 7f2e78800640 1 -- 172.21.15.175:0/1581504442 wait complete. 2024-04-25T09:12:30.272 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:12:30.272 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:12:30.272 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-25T09:12:30.272 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:12:30.272 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:30.272 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:12:30.272 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:12:30.272 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:12:30.272 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:12:30.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:30.272 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-25T09:12:30.281 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:12:30.281 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:12:30.282 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:12:30.282 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:30.282 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:12:30.282 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:30.282 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:12:30.282 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-25T09:12:30.282 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-25T09:12:30.282 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:12:30.282 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-25T09:12:30.282 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-25T09:12:30.282 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:12:30.282 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:12:30.282 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:12:30.283 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:12:30.283 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:12:30.283 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 41969sec preferred_lft 41969sec 2024-04-25T09:12:30.283 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-25T09:12:30.283 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:30.283 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:12:30.283 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:0d:71:4a:a6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:12:30.283 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:12:30.283 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:30.283 INFO:teuthology.orchestra.run.smithi175.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:12:30.283 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:12:30.283 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:12:30.283 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:30.283 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:12:30.284 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:30.284 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:12:30.284 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:12:30.284 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:12:30.284 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:30.284 INFO:teuthology.orchestra.run.smithi175.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:12:30.284 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:12:30.284 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:12:30.284 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:30.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:30.285 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:12:30.343 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:12:30.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:30.345 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-25T09:12:30.397 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-25T09:12:30.397 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:12:30.397 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:12:30.398 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:12:30.398 INFO:teuthology.orchestra.run.smithi175.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:12:30.398 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:12:30.398 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:12:30.398 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:12:30.398 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:12:30.398 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:12:30.398 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:12:30.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:30.399 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:12:30.399 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:12:30.399 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:12:30.399 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:12:30.399 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:12:30.399 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:12:30.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:30.489 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:12:30.497 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:12:30.497 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:12:30.498 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:12:30.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:30.498 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-25T09:12:30.561 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:12:30.561 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:30.610 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:12:30.610 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:12:30.610 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:30.661 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:12:30.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:30.661 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:12:30.749 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:12:30.750 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:12:30.750 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:12:30.765 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:12:30.765 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:12:30.765 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:12:30.765 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:12:30.765 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:12:30.773 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:12:30.773 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:12:30.773 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:12:30.774 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:12:30.774 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:12:30.774 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:12:30.774 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:12:30.774 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:12:30.777 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:12:30.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:30.777 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:30.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:30.797 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:12:30.853 INFO:teuthology.orchestra.run.smithi175.stdout:client8226 2024-04-25T09:12:30.853 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:12:30.853 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:30.902 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:12:30.902 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:30.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:30.954 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file1_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-25T09:12:31.120 INFO:teuthology.orchestra.run.smithi175.stderr:6+0 records in 2024-04-25T09:12:31.120 INFO:teuthology.orchestra.run.smithi175.stderr:6+0 records out 2024-04-25T09:12:31.120 INFO:teuthology.orchestra.run.smithi175.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.110013 s, 57.2 MB/s 2024-04-25T09:12:31.121 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:12:31.121 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:31.130 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:12:31.131 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:31.182 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:31.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.373+0000 7fcd9f000640 1 Processor -- start 2024-04-25T09:12:31.360 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.373+0000 7fcd9f000640 1 -- start start 2024-04-25T09:12:31.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.373+0000 7fcd9f000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd980add90 0x7fcd980ae680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.373+0000 7fcd9f000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9815dfb0 con 0x7fcd980aebc0 2024-04-25T09:12:31.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.373+0000 7fcd9f000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd980b2980 con 0x7fcd9815dbd0 2024-04-25T09:12:31.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.373+0000 7fcd9f000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd980ae1d0 con 0x7fcd980add90 2024-04-25T09:12:31.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.373+0000 7fcd9d000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fcd980aebc0 0x7fcd98167700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:37978/0 (socket says 172.21.15.175:37978) 2024-04-25T09:12:31.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.373+0000 7fcd9d000640 1 -- 172.21.15.175:0/2963183073 learned_addr learned my addr 172.21.15.175:0/2963183073 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:31.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.373+0000 7fcd8f400640 1 --2- 172.21.15.175:0/2963183073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd980add90 0x7fcd980ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.373+0000 7fcd97400640 1 -- 172.21.15.175:0/2963183073 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899721799 0 0) 0x7fcd9815dfb0 con 0x7fcd980aebc0 2024-04-25T09:12:31.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.373+0000 7fcd97400640 1 -- 172.21.15.175:0/2963183073 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd7c003530 con 0x7fcd980aebc0 2024-04-25T09:12:31.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd97400640 1 -- 172.21.15.175:0/2963183073 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 503278237 0 0) 0x7fcd7c003530 con 0x7fcd980aebc0 2024-04-25T09:12:31.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd97400640 1 -- 172.21.15.175:0/2963183073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd980add90 msgr2=0x7fcd980ae680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:31.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd97400640 1 --2- 172.21.15.175:0/2963183073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd980add90 0x7fcd980ae680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd97400640 1 -- 172.21.15.175:0/2963183073 >> v1:172.21.15.177:6789/0 conn(0x7fcd9815dbd0 legacy=0x7fcd98071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd97400640 1 -- 172.21.15.175:0/2963183073 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd980b2c60 con 0x7fcd980aebc0 2024-04-25T09:12:31.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd97400640 1 -- 172.21.15.175:0/2963183073 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fcd90001680 con 0x7fcd980aebc0 2024-04-25T09:12:31.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd97400640 1 -- 172.21.15.175:0/2963183073 >> v1:172.21.15.175:6789/0 conn(0x7fcd980aebc0 legacy=0x7fcd98167700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd97400640 1 --2- 172.21.15.175:0/2963183073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd7c0039f0 0x7fcd7c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd97400640 1 --2- 172.21.15.175:0/2963183073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd980add90 0x7fcd7c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd97400640 1 --2- 172.21.15.175:0/2963183073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd7c004d50 0x7fcd7c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd97400640 1 -- 172.21.15.175:0/2963183073 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd980ae1d0 con 0x7fcd7c004d50 2024-04-25T09:12:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd97400640 1 -- 172.21.15.175:0/2963183073 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c00ba80 con 0x7fcd7c0039f0 2024-04-25T09:12:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd97400640 1 -- 172.21.15.175:0/2963183073 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c00bc30 con 0x7fcd980add90 2024-04-25T09:12:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd9d000640 1 --2- 172.21.15.175:0/2963183073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd7c004d50 0x7fcd7c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd97e00640 1 --2- 172.21.15.175:0/2963183073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd7c0039f0 0x7fcd7c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd8f400640 1 --2- 172.21.15.175:0/2963183073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd980add90 0x7fcd7c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd9d000640 1 -- 172.21.15.175:0/2963183073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd980add90 msgr2=0x7fcd7c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd9d000640 1 --2- 172.21.15.175:0/2963183073 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd980add90 0x7fcd7c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd9d000640 1 -- 172.21.15.175:0/2963183073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd7c0039f0 msgr2=0x7fcd7c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd9d000640 1 --2- 172.21.15.175:0/2963183073 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd7c0039f0 0x7fcd7c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd9d000640 1 -- 172.21.15.175:0/2963183073 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c003530 con 0x7fcd7c004d50 2024-04-25T09:12:31.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.377+0000 7fcd9d000640 1 --2- 172.21.15.175:0/2963183073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd7c004d50 0x7fcd7c0051d0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000c190 tx=0x7fcd9001f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2212647d44219a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:31.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd97400640 1 -- 172.21.15.175:0/2963183073 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90007c70 con 0x7fcd7c004d50 2024-04-25T09:12:31.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd97400640 1 -- 172.21.15.175:0/2963183073 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd90005ae0 con 0x7fcd7c004d50 2024-04-25T09:12:31.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd97400640 1 -- 172.21.15.175:0/2963183073 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90007070 con 0x7fcd7c004d50 2024-04-25T09:12:31.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd9f000640 1 -- 172.21.15.175:0/2963183073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd7c004d50 msgr2=0x7fcd7c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd9f000640 1 --2- 172.21.15.175:0/2963183073 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd7c004d50 0x7fcd7c0051d0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fcd9000c190 tx=0x7fcd9001f310 comp rx=0 tx=0).stop 2024-04-25T09:12:31.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd9d000640 1 -- 172.21.15.175:0/2963183073 reap_dead start 2024-04-25T09:12:31.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd9f000640 1 -- 172.21.15.175:0/2963183073 shutdown_connections 2024-04-25T09:12:31.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd9f000640 1 -- 172.21.15.175:0/2963183073 >> 172.21.15.175:0/2963183073 conn(0x7fcd98067150 msgr2=0x7fcd9806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:31.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd9f000640 1 -- 172.21.15.175:0/2963183073 shutdown_connections 2024-04-25T09:12:31.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd9f000640 1 -- 172.21.15.175:0/2963183073 wait complete. 2024-04-25T09:12:31.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd9f000640 1 Processor -- start 2024-04-25T09:12:31.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd9f000640 1 -- start start 2024-04-25T09:12:31.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd9f000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd981f2d70 0x7fcd9814b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd9f000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd980cdf60 0x7fcd980c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd9f000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd980cc900 0x7fcd980c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd9f000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd980b3590 con 0x7fcd980cc900 2024-04-25T09:12:31.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd9f000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd980b3220 con 0x7fcd981f2d70 2024-04-25T09:12:31.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd9f000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd980b2580 con 0x7fcd980cdf60 2024-04-25T09:12:31.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd9d000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd980cc900 0x7fcd980c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd9d000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd980cc900 0x7fcd980c4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43612/0 (socket says 172.21.15.175:43612) 2024-04-25T09:12:31.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd9d000640 1 -- 172.21.15.175:0/2235488489 learned_addr learned my addr 172.21.15.175:0/2235488489 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:31.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd8f400640 1 --2- 172.21.15.175:0/2235488489 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd980cdf60 0x7fcd980c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.381+0000 7fcd97e00640 1 --2- 172.21.15.175:0/2235488489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd981f2d70 0x7fcd9814b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.385+0000 7fcd9d000640 1 -- 172.21.15.175:0/2235488489 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd980cdf60 msgr2=0x7fcd980c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.385+0000 7fcd9d000640 1 --2- 172.21.15.175:0/2235488489 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd980cdf60 0x7fcd980c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.385+0000 7fcd9d000640 1 -- 172.21.15.175:0/2235488489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd981f2d70 msgr2=0x7fcd9814b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.385+0000 7fcd9d000640 1 --2- 172.21.15.175:0/2235488489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd981f2d70 0x7fcd9814b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.385+0000 7fcd9d000640 1 -- 172.21.15.175:0/2235488489 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9814bb90 con 0x7fcd980cc900 2024-04-25T09:12:31.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.385+0000 7fcd9d000640 1 --2- 172.21.15.175:0/2235488489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd980cc900 0x7fcd980c4a30 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fcd9001f140 tx=0x7fcd7c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:31.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.385+0000 7fcd94c00640 1 -- 172.21.15.175:0/2235488489 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90007c70 con 0x7fcd980cc900 2024-04-25T09:12:31.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.385+0000 7fcd94c00640 1 -- 172.21.15.175:0/2235488489 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd900b6040 con 0x7fcd980cc900 2024-04-25T09:12:31.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.385+0000 7fcd94c00640 1 -- 172.21.15.175:0/2235488489 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90000e50 con 0x7fcd980cc900 2024-04-25T09:12:31.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.385+0000 7fcd9f000640 1 -- 172.21.15.175:0/2235488489 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd980ccec0 con 0x7fcd980cc900 2024-04-25T09:12:31.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.385+0000 7fcd9f000640 1 -- 172.21.15.175:0/2235488489 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd980cd480 con 0x7fcd980cc900 2024-04-25T09:12:31.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.385+0000 7fcd9f000640 1 -- 172.21.15.175:0/2235488489 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd980cf630 con 0x7fcd980cc900 2024-04-25T09:12:31.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.385+0000 7fcd94c00640 1 -- 172.21.15.175:0/2235488489 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcd900049f0 con 0x7fcd980cc900 2024-04-25T09:12:31.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.389+0000 7fcd94c00640 1 --2- 172.21.15.175:0/2235488489 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd74066f90 0x7fcd74069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.389+0000 7fcd94c00640 1 -- 172.21.15.175:0/2235488489 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd90121990 con 0x7fcd980cc900 2024-04-25T09:12:31.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.389+0000 7fcd97e00640 1 --2- 172.21.15.175:0/2235488489 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd74066f90 0x7fcd74069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.389+0000 7fcd97e00640 1 --2- 172.21.15.175:0/2235488489 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd74066f90 0x7fcd74069450 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fcd88007fd0 tx=0x7fcd88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:31.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.393+0000 7fcd94c00640 1 -- 172.21.15.175:0/2235488489 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcd900c2070 con 0x7fcd980cc900 2024-04-25T09:12:31.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.545+0000 7fcd9f000640 1 -- 172.21.15.175:0/2235488489 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd98148910 con 0x7fcd980cc900 2024-04-25T09:12:31.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.545+0000 7fcd94c00640 1 -- 172.21.15.175:0/2235488489 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16646 (secure 0 0 0) 0x7fcd98148910 con 0x7fcd980cc900 2024-04-25T09:12:31.532 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:31.532 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":100,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:12:25.044197+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:12:21.141676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:12:22.422455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:31.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.545+0000 7fcd9f000640 1 -- 172.21.15.175:0/2235488489 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd74066f90 msgr2=0x7fcd74069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.545+0000 7fcd9f000640 1 --2- 172.21.15.175:0/2235488489 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd74066f90 0x7fcd74069450 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fcd88007fd0 tx=0x7fcd88009040 comp rx=0 tx=0).stop 2024-04-25T09:12:31.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.545+0000 7fcd9f000640 1 -- 172.21.15.175:0/2235488489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd980cc900 msgr2=0x7fcd980c4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.545+0000 7fcd9f000640 1 --2- 172.21.15.175:0/2235488489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd980cc900 0x7fcd980c4a30 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fcd9001f140 tx=0x7fcd7c005840 comp rx=0 tx=0).stop 2024-04-25T09:12:31.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.545+0000 7fcd9f000640 1 -- 172.21.15.175:0/2235488489 shutdown_connections 2024-04-25T09:12:31.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.545+0000 7fcd9f000640 1 --2- 172.21.15.175:0/2235488489 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd74066f90 0x7fcd74069450 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.545+0000 7fcd9f000640 1 --2- 172.21.15.175:0/2235488489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd980cc900 0x7fcd980c4a30 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.545+0000 7fcd9f000640 1 --2- 172.21.15.175:0/2235488489 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd980cdf60 0x7fcd980c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.545+0000 7fcd9f000640 1 --2- 172.21.15.175:0/2235488489 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd981f2d70 0x7fcd9814b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.545+0000 7fcd9f000640 1 -- 172.21.15.175:0/2235488489 >> 172.21.15.175:0/2235488489 conn(0x7fcd7c004d50 msgr2=0x7fcd98071ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:31.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.545+0000 7fcd9f000640 1 -- 172.21.15.175:0/2235488489 shutdown_connections 2024-04-25T09:12:31.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.545+0000 7fcd9f000640 1 -- 172.21.15.175:0/2235488489 wait complete. 2024-04-25T09:12:31.552 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:12:21.141676+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:12:22.422455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:12:31.553 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:12:31.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.705+0000 7fd02b800640 1 Processor -- start 2024-04-25T09:12:31.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.705+0000 7fd02b800640 1 -- start start 2024-04-25T09:12:31.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.705+0000 7fd02b800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd024145250 0x7fd0240cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.705+0000 7fd02b800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0241600a0 0x7fd0240cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.705+0000 7fd02b800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0240cfd10 con 0x7fd0240ce970 2024-04-25T09:12:31.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.705+0000 7fd02b800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd02415f650 con 0x7fd024145250 2024-04-25T09:12:31.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.705+0000 7fd02b800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0240cfff0 con 0x7fd0241600a0 2024-04-25T09:12:31.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.705+0000 7fd029800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd0240ce970 0x7fd0240cee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:37994/0 (socket says 172.21.15.175:37994) 2024-04-25T09:12:31.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.705+0000 7fd029800640 1 -- 172.21.15.175:0/62544164 learned_addr learned my addr 172.21.15.175:0/62544164 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:31.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.705+0000 7fd023e00640 1 --2- 172.21.15.175:0/62544164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0241600a0 0x7fd0240cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.705+0000 7fd028e00640 1 --2- 172.21.15.175:0/62544164 >> v2:172.21.15.177:3300/0 conn(0x7fd024145250 0x7fd0240cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.705+0000 7fd023400640 1 -- 172.21.15.175:0/62544164 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101070267 0 0) 0x7fd0240cfd10 con 0x7fd0240ce970 2024-04-25T09:12:31.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.705+0000 7fd023400640 1 -- 172.21.15.175:0/62544164 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd008003530 con 0x7fd0240ce970 2024-04-25T09:12:31.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd023400640 1 -- 172.21.15.175:0/62544164 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 141154727 0 0) 0x7fd008003530 con 0x7fd0240ce970 2024-04-25T09:12:31.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd023400640 1 -- 172.21.15.175:0/62544164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0241600a0 msgr2=0x7fd0240cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:31.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd023400640 1 --2- 172.21.15.175:0/62544164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0241600a0 0x7fd0240cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd023400640 1 -- 172.21.15.175:0/62544164 >> v2:172.21.15.177:3300/0 conn(0x7fd024145250 msgr2=0x7fd0240cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:31.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd023400640 1 --2- 172.21.15.175:0/62544164 >> v2:172.21.15.177:3300/0 conn(0x7fd024145250 0x7fd0240cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd023400640 1 -- 172.21.15.175:0/62544164 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02415f8a0 con 0x7fd0240ce970 2024-04-25T09:12:31.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd028e00640 1 --2- 172.21.15.175:0/62544164 >> v2:172.21.15.177:3300/0 conn(0x7fd024145250 0x7fd0240cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:31.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd023400640 1 -- 172.21.15.175:0/62544164 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fd01c001680 con 0x7fd0240ce970 2024-04-25T09:12:31.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd023400640 1 -- 172.21.15.175:0/62544164 >> v1:172.21.15.175:6789/0 conn(0x7fd0240ce970 legacy=0x7fd0240cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd023400640 1 --2- 172.21.15.175:0/62544164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0080039c0 0x7fd008003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd023400640 1 --2- 172.21.15.175:0/62544164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0241600a0 0x7fd008004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd023400640 1 --2- 172.21.15.175:0/62544164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd008004d50 0x7fd0080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd023400640 1 -- 172.21.15.175:0/62544164 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02415f650 con 0x7fd008004d50 2024-04-25T09:12:31.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd023400640 1 -- 172.21.15.175:0/62544164 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0240cfff0 con 0x7fd0080039c0 2024-04-25T09:12:31.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd023400640 1 -- 172.21.15.175:0/62544164 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00800ba00 con 0x7fd0241600a0 2024-04-25T09:12:31.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd029800640 1 --2- 172.21.15.175:0/62544164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd008004d50 0x7fd0080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd028e00640 1 --2- 172.21.15.175:0/62544164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0080039c0 0x7fd008003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd023e00640 1 --2- 172.21.15.175:0/62544164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0241600a0 0x7fd008004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd029800640 1 -- 172.21.15.175:0/62544164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0241600a0 msgr2=0x7fd008004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:31.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd029800640 1 --2- 172.21.15.175:0/62544164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0241600a0 0x7fd008004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd029800640 1 -- 172.21.15.175:0/62544164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0080039c0 msgr2=0x7fd008003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:31.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd029800640 1 --2- 172.21.15.175:0/62544164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0080039c0 0x7fd008003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd029800640 1 -- 172.21.15.175:0/62544164 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd008003530 con 0x7fd008004d50 2024-04-25T09:12:31.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.709+0000 7fd029800640 1 --2- 172.21.15.175:0/62544164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd008004d50 0x7fd0080051d0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00c240 tx=0x7fd01c01f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d52043871f40c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:31.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd023400640 1 -- 172.21.15.175:0/62544164 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c007d40 con 0x7fd008004d50 2024-04-25T09:12:31.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd023400640 1 -- 172.21.15.175:0/62544164 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01c005b00 con 0x7fd008004d50 2024-04-25T09:12:31.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd023400640 1 -- 172.21.15.175:0/62544164 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c007070 con 0x7fd008004d50 2024-04-25T09:12:31.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd02b800640 1 -- 172.21.15.175:0/62544164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd008004d50 msgr2=0x7fd0080051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd02b800640 1 --2- 172.21.15.175:0/62544164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd008004d50 0x7fd0080051d0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fd01c00c240 tx=0x7fd01c01f410 comp rx=0 tx=0).stop 2024-04-25T09:12:31.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd029800640 1 -- 172.21.15.175:0/62544164 reap_dead start 2024-04-25T09:12:31.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd02b800640 1 -- 172.21.15.175:0/62544164 shutdown_connections 2024-04-25T09:12:31.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd02b800640 1 -- 172.21.15.175:0/62544164 >> 172.21.15.175:0/62544164 conn(0x7fd02406ac50 msgr2=0x7fd02406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:31.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd02b800640 1 -- 172.21.15.175:0/62544164 shutdown_connections 2024-04-25T09:12:31.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd02b800640 1 -- 172.21.15.175:0/62544164 wait complete. 2024-04-25T09:12:31.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd02b800640 1 Processor -- start 2024-04-25T09:12:31.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd02b800640 1 -- start start 2024-04-25T09:12:31.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd02b800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0240adb70 0x7fd0241f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd02b800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0240caf80 0x7fd0240c6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd02b800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0240adf50 0x7fd024140ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd02b800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd024145630 con 0x7fd0240adb70 2024-04-25T09:12:31.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd02b800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd024160500 con 0x7fd0240adf50 2024-04-25T09:12:31.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd02b800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0240cc410 con 0x7fd0240caf80 2024-04-25T09:12:31.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd028e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0240adb70 0x7fd0241f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd028e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0240adb70 0x7fd0241f4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43628/0 (socket says 172.21.15.175:43628) 2024-04-25T09:12:31.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd028e00640 1 -- 172.21.15.175:0/2985412664 learned_addr learned my addr 172.21.15.175:0/2985412664 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:31.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd028e00640 1 -- 172.21.15.175:0/2985412664 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0240caf80 msgr2=0x7fd0240c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd028e00640 1 --2- 172.21.15.175:0/2985412664 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0240caf80 0x7fd0240c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd028e00640 1 -- 172.21.15.175:0/2985412664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0240adf50 msgr2=0x7fd024140ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd028e00640 1 --2- 172.21.15.175:0/2985412664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0240adf50 0x7fd024140ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.713+0000 7fd028e00640 1 -- 172.21.15.175:0/2985412664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0240c6ac0 con 0x7fd0240adb70 2024-04-25T09:12:31.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.717+0000 7fd028e00640 1 --2- 172.21.15.175:0/2985412664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0240adb70 0x7fd0241f4980 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fd01400f460 tx=0x7fd01400f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:31.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.717+0000 7fd020c00640 1 -- 172.21.15.175:0/2985412664 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014003ba0 con 0x7fd0240adb70 2024-04-25T09:12:31.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.717+0000 7fd020c00640 1 -- 172.21.15.175:0/2985412664 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd014003d40 con 0x7fd0240adb70 2024-04-25T09:12:31.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.717+0000 7fd02b800640 1 -- 172.21.15.175:0/2985412664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0241f3ea0 con 0x7fd0240adb70 2024-04-25T09:12:31.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.717+0000 7fd020c00640 1 -- 172.21.15.175:0/2985412664 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014015860 con 0x7fd0240adb70 2024-04-25T09:12:31.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.717+0000 7fd02b800640 1 -- 172.21.15.175:0/2985412664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0241f4460 con 0x7fd0240adb70 2024-04-25T09:12:31.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.717+0000 7fd02b800640 1 -- 172.21.15.175:0/2985412664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd024075160 con 0x7fd0240adb70 2024-04-25T09:12:31.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.717+0000 7fd020c00640 1 -- 172.21.15.175:0/2985412664 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd014015a00 con 0x7fd0240adb70 2024-04-25T09:12:31.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.717+0000 7fd020c00640 1 --2- 172.21.15.175:0/2985412664 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd004066f90 0x7fd004069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:31.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.717+0000 7fd020c00640 1 -- 172.21.15.175:0/2985412664 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd014086110 con 0x7fd0240adb70 2024-04-25T09:12:31.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.717+0000 7fd023e00640 1 --2- 172.21.15.175:0/2985412664 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd004066f90 0x7fd004069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:31.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.721+0000 7fd023e00640 1 --2- 172.21.15.175:0/2985412664 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd004066f90 0x7fd004069450 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd024143c40 tx=0x7fd0100095f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:31.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.721+0000 7fd020c00640 1 -- 172.21.15.175:0/2985412664 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd014019070 con 0x7fd0240adb70 2024-04-25T09:12:31.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.881+0000 7fd02b800640 1 -- 172.21.15.175:0/2985412664 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0240b4700 con 0x7fd0240adb70 2024-04-25T09:12:31.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.881+0000 7fd020c00640 1 -- 172.21.15.175:0/2985412664 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v100) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd014010040 con 0x7fd0240adb70 2024-04-25T09:12:31.867 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:12:31.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.881+0000 7fd02b800640 1 -- 172.21.15.175:0/2985412664 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd004066f90 msgr2=0x7fd004069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.881+0000 7fd02b800640 1 --2- 172.21.15.175:0/2985412664 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd004066f90 0x7fd004069450 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd024143c40 tx=0x7fd0100095f0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.881+0000 7fd02b800640 1 -- 172.21.15.175:0/2985412664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0240adb70 msgr2=0x7fd0241f4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:31.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.881+0000 7fd02b800640 1 --2- 172.21.15.175:0/2985412664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0240adb70 0x7fd0241f4980 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fd01400f460 tx=0x7fd01400f920 comp rx=0 tx=0).stop 2024-04-25T09:12:31.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.881+0000 7fd02b800640 1 -- 172.21.15.175:0/2985412664 shutdown_connections 2024-04-25T09:12:31.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.881+0000 7fd02b800640 1 --2- 172.21.15.175:0/2985412664 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd004066f90 0x7fd004069450 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.881+0000 7fd02b800640 1 --2- 172.21.15.175:0/2985412664 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0240adf50 0x7fd024140ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.881+0000 7fd02b800640 1 --2- 172.21.15.175:0/2985412664 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0240caf80 0x7fd0240c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.881+0000 7fd02b800640 1 --2- 172.21.15.175:0/2985412664 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0240adb70 0x7fd0241f4980 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:31.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.881+0000 7fd02b800640 1 -- 172.21.15.175:0/2985412664 >> 172.21.15.175:0/2985412664 conn(0x7fd02406ac50 msgr2=0x7fd024144400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:31.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.881+0000 7fd02b800640 1 -- 172.21.15.175:0/2985412664 shutdown_connections 2024-04-25T09:12:31.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:31.881+0000 7fd02b800640 1 -- 172.21.15.175:0/2985412664 wait complete. 2024-04-25T09:12:31.888 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:12:32.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.041+0000 7fcf36200640 1 Processor -- start 2024-04-25T09:12:32.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.041+0000 7fcf36200640 1 -- start start 2024-04-25T09:12:32.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.041+0000 7fcf36200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcf300d1460 0x7fcf300cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.041+0000 7fcf36200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf300cc730 con 0x7fcf300b3610 2024-04-25T09:12:32.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.041+0000 7fcf36200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf300cb690 con 0x7fcf3015e550 2024-04-25T09:12:32.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.041+0000 7fcf36200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf300cb970 con 0x7fcf300d1460 2024-04-25T09:12:32.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.041+0000 7fcf2fe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fcf300b3610 0x7fcf300b3a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:37998/0 (socket says 172.21.15.175:37998) 2024-04-25T09:12:32.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.041+0000 7fcf2fe00640 1 -- 172.21.15.175:0/3352742934 learned_addr learned my addr 172.21.15.175:0/3352742934 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:32.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.041+0000 7fcf27e00640 1 --2- 172.21.15.175:0/3352742934 >> v2:172.21.15.177:3300/0 conn(0x7fcf300d1460 0x7fcf300cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.041+0000 7fcf2ea00640 1 -- 172.21.15.175:0/3352742934 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1118626615 0 0) 0x7fcf300cc730 con 0x7fcf300b3610 2024-04-25T09:12:32.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.041+0000 7fcf2ea00640 1 -- 172.21.15.175:0/3352742934 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf14003530 con 0x7fcf300b3610 2024-04-25T09:12:32.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.041+0000 7fcf27e00640 1 -- 172.21.15.175:0/3352742934 >> v1:172.21.15.177:6789/0 conn(0x7fcf3015e550 legacy=0x7fcf3015e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.041+0000 7fcf2ea00640 1 -- 172.21.15.175:0/3352742934 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096945448 0 0) 0x7fcf300cb690 con 0x7fcf3015e550 2024-04-25T09:12:32.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.041+0000 7fcf27e00640 1 -- 172.21.15.175:0/3352742934 >> v1:172.21.15.175:6789/0 conn(0x7fcf300b3610 legacy=0x7fcf300b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.041+0000 7fcf27e00640 1 -- 172.21.15.175:0/3352742934 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf300cbc50 con 0x7fcf300d1460 2024-04-25T09:12:32.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.045+0000 7fcf27e00640 1 --2- 172.21.15.175:0/3352742934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf300d1460 0x7fcf300cf270 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcf180097f0 tx=0x7fcf1801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5829eef57168147f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:32.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.045+0000 7fcf2ea00640 1 -- 172.21.15.175:0/3352742934 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf180b1070 con 0x7fcf300d1460 2024-04-25T09:12:32.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.045+0000 7fcf2ea00640 1 -- 172.21.15.175:0/3352742934 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf180ac5f0 con 0x7fcf300d1460 2024-04-25T09:12:32.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.045+0000 7fcf2ea00640 1 -- 172.21.15.175:0/3352742934 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf180ac9c0 con 0x7fcf300d1460 2024-04-25T09:12:32.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.045+0000 7fcf36200640 1 -- 172.21.15.175:0/3352742934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf300d1460 msgr2=0x7fcf300cf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.045+0000 7fcf36200640 1 --2- 172.21.15.175:0/3352742934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf300d1460 0x7fcf300cf270 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcf180097f0 tx=0x7fcf1801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.045+0000 7fcf36200640 1 -- 172.21.15.175:0/3352742934 shutdown_connections 2024-04-25T09:12:32.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.045+0000 7fcf36200640 1 --2- 172.21.15.175:0/3352742934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf300d1460 0x7fcf300cf270 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.045+0000 7fcf36200640 1 -- 172.21.15.175:0/3352742934 >> 172.21.15.175:0/3352742934 conn(0x7fcf300d07e0 msgr2=0x7fcf300d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:32.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.045+0000 7fcf36200640 1 -- 172.21.15.175:0/3352742934 shutdown_connections 2024-04-25T09:12:32.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.045+0000 7fcf36200640 1 -- 172.21.15.175:0/3352742934 wait complete. 2024-04-25T09:12:32.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf36200640 1 Processor -- start 2024-04-25T09:12:32.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf36200640 1 -- start start 2024-04-25T09:12:32.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf36200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf300b3610 0x7fcf30158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf36200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf300d1460 0x7fcf30148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf36200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf3015e550 0x7fcf300c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf36200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300b4580 con 0x7fcf300b3610 2024-04-25T09:12:32.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf36200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300cf7b0 con 0x7fcf300d1460 2024-04-25T09:12:32.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf36200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300c5d80 con 0x7fcf3015e550 2024-04-25T09:12:32.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf2f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf300b3610 0x7fcf30158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf2f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf300b3610 0x7fcf30158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43640/0 (socket says 172.21.15.175:43640) 2024-04-25T09:12:32.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf2f400640 1 -- 172.21.15.175:0/875489841 learned_addr learned my addr 172.21.15.175:0/875489841 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:32.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf2f400640 1 -- 172.21.15.175:0/875489841 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf3015e550 msgr2=0x7fcf300c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf2f400640 1 --2- 172.21.15.175:0/875489841 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf3015e550 0x7fcf300c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf2f400640 1 -- 172.21.15.175:0/875489841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf300d1460 msgr2=0x7fcf30148310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf2f400640 1 --2- 172.21.15.175:0/875489841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf300d1460 0x7fcf30148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf2f400640 1 -- 172.21.15.175:0/875489841 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf300c6060 con 0x7fcf300b3610 2024-04-25T09:12:32.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf2f400640 1 --2- 172.21.15.175:0/875489841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf300b3610 0x7fcf30158610 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000c410 tx=0x7fcf2000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:32.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf27400640 1 -- 172.21.15.175:0/875489841 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20017070 con 0x7fcf300b3610 2024-04-25T09:12:32.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf27400640 1 -- 172.21.15.175:0/875489841 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf20003600 con 0x7fcf300b3610 2024-04-25T09:12:32.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf27400640 1 -- 172.21.15.175:0/875489841 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf200039f0 con 0x7fcf300b3610 2024-04-25T09:12:32.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf36200640 1 -- 172.21.15.175:0/875489841 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf300c6340 con 0x7fcf300b3610 2024-04-25T09:12:32.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.049+0000 7fcf36200640 1 -- 172.21.15.175:0/875489841 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf301582a0 con 0x7fcf300b3610 2024-04-25T09:12:32.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.053+0000 7fcf36200640 1 -- 172.21.15.175:0/875489841 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf300c6860 con 0x7fcf300b3610 2024-04-25T09:12:32.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.053+0000 7fcf27400640 1 -- 172.21.15.175:0/875489841 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcf2001a070 con 0x7fcf300b3610 2024-04-25T09:12:32.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.053+0000 7fcf27400640 1 --2- 172.21.15.175:0/875489841 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcf0c066f60 0x7fcf0c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.053+0000 7fcf27400640 1 -- 172.21.15.175:0/875489841 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf200844a0 con 0x7fcf300b3610 2024-04-25T09:12:32.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.053+0000 7fcf27e00640 1 --2- 172.21.15.175:0/875489841 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcf0c066f60 0x7fcf0c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.053+0000 7fcf27e00640 1 --2- 172.21.15.175:0/875489841 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcf0c066f60 0x7fcf0c069420 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fcf180ae000 tx=0x7fcf18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:32.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.057+0000 7fcf27400640 1 -- 172.21.15.175:0/875489841 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcf200554a0 con 0x7fcf300b3610 2024-04-25T09:12:32.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.217+0000 7fcf36200640 1 -- 172.21.15.175:0/875489841 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcf30075160 con 0x7fcf300b3610 2024-04-25T09:12:32.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.217+0000 7fcf27400640 1 -- 172.21.15.175:0/875489841 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v100) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcf20054da0 con 0x7fcf300b3610 2024-04-25T09:12:32.203 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:12:32.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.217+0000 7fcf36200640 1 -- 172.21.15.175:0/875489841 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcf0c066f60 msgr2=0x7fcf0c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.217+0000 7fcf36200640 1 --2- 172.21.15.175:0/875489841 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcf0c066f60 0x7fcf0c069420 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fcf180ae000 tx=0x7fcf18008040 comp rx=0 tx=0).stop 2024-04-25T09:12:32.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.217+0000 7fcf36200640 1 -- 172.21.15.175:0/875489841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf300b3610 msgr2=0x7fcf30158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.217+0000 7fcf36200640 1 --2- 172.21.15.175:0/875489841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf300b3610 0x7fcf30158610 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000c410 tx=0x7fcf2000c8d0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.217+0000 7fcf36200640 1 -- 172.21.15.175:0/875489841 shutdown_connections 2024-04-25T09:12:32.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.217+0000 7fcf36200640 1 --2- 172.21.15.175:0/875489841 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcf0c066f60 0x7fcf0c069420 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.217+0000 7fcf36200640 1 --2- 172.21.15.175:0/875489841 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf3015e550 0x7fcf300c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.217+0000 7fcf36200640 1 --2- 172.21.15.175:0/875489841 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf300d1460 0x7fcf30148310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.217+0000 7fcf36200640 1 --2- 172.21.15.175:0/875489841 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcf300b3610 0x7fcf30158610 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.217+0000 7fcf36200640 1 -- 172.21.15.175:0/875489841 >> 172.21.15.175:0/875489841 conn(0x7fcf300d07e0 msgr2=0x7fcf300cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:32.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.217+0000 7fcf36200640 1 -- 172.21.15.175:0/875489841 shutdown_connections 2024-04-25T09:12:32.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.217+0000 7fcf36200640 1 -- 172.21.15.175:0/875489841 wait complete. 2024-04-25T09:12:32.223 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:12:32.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.373+0000 7fdd0ba00640 1 Processor -- start 2024-04-25T09:12:32.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.373+0000 7fdd0ba00640 1 -- start start 2024-04-25T09:12:32.362 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.377+0000 7fdd0ba00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdd04145250 0x7fdd040cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.377+0000 7fdd0ba00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd041600a0 0x7fdd040cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.377+0000 7fdd0ba00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd040cfd10 con 0x7fdd040ce970 2024-04-25T09:12:32.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.377+0000 7fdd0ba00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0415f650 con 0x7fdd04145250 2024-04-25T09:12:32.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.377+0000 7fdd0ba00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd040cfff0 con 0x7fdd041600a0 2024-04-25T09:12:32.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.377+0000 7fdd09000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdd04145250 0x7fdd040cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.377+0000 7fdd09000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdd04145250 0x7fdd040cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43650/0 (socket says 172.21.15.175:43650) 2024-04-25T09:12:32.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.377+0000 7fdd09000640 1 -- 172.21.15.175:0/1040858260 learned_addr learned my addr 172.21.15.175:0/1040858260 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:32.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.377+0000 7fdd03e00640 1 --2- 172.21.15.175:0/1040858260 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd041600a0 0x7fdd040cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.377+0000 7fdd09000640 1 -- 172.21.15.175:0/1040858260 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd041600a0 msgr2=0x7fdd040cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:32.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.377+0000 7fdd09000640 1 --2- 172.21.15.175:0/1040858260 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd041600a0 0x7fdd040cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.377+0000 7fdd09000640 1 -- 172.21.15.175:0/1040858260 >> v1:172.21.15.177:6789/0 conn(0x7fdd040ce970 legacy=0x7fdd040cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.377+0000 7fdd09000640 1 -- 172.21.15.175:0/1040858260 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0415f8a0 con 0x7fdd04145250 2024-04-25T09:12:32.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.377+0000 7fdd03e00640 1 --2- 172.21.15.175:0/1040858260 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd041600a0 0x7fdd040cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:32.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd09000640 1 --2- 172.21.15.175:0/1040858260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd04145250 0x7fdd040cf6b0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009870 tx=0x7fdcf401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1daa73b3cc7aee1d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:32.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd03400640 1 -- 172.21.15.175:0/1040858260 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf40aa620 con 0x7fdd04145250 2024-04-25T09:12:32.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd03400640 1 -- 172.21.15.175:0/1040858260 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf40af070 con 0x7fdd04145250 2024-04-25T09:12:32.366 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd03400640 1 -- 172.21.15.175:0/1040858260 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf40aa9e0 con 0x7fdd04145250 2024-04-25T09:12:32.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd0ba00640 1 -- 172.21.15.175:0/1040858260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd04145250 msgr2=0x7fdd040cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd0ba00640 1 --2- 172.21.15.175:0/1040858260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd04145250 0x7fdd040cf6b0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009870 tx=0x7fdcf401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd0ba00640 1 -- 172.21.15.175:0/1040858260 shutdown_connections 2024-04-25T09:12:32.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd0ba00640 1 --2- 172.21.15.175:0/1040858260 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd041600a0 0x7fdd040cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd0ba00640 1 --2- 172.21.15.175:0/1040858260 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd04145250 0x7fdd040cf6b0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd0ba00640 1 -- 172.21.15.175:0/1040858260 >> 172.21.15.175:0/1040858260 conn(0x7fdd0406ac50 msgr2=0x7fdd0406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:32.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd0ba00640 1 -- 172.21.15.175:0/1040858260 shutdown_connections 2024-04-25T09:12:32.367 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd0ba00640 1 -- 172.21.15.175:0/1040858260 wait complete. 2024-04-25T09:12:32.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd0ba00640 1 Processor -- start 2024-04-25T09:12:32.368 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd0ba00640 1 -- start start 2024-04-25T09:12:32.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd0ba00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd040ce970 0x7fdd0415b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd0ba00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd04145250 0x7fdd040b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd0ba00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd041600a0 0x7fdd04141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd0ba00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd04160600 con 0x7fdd040ce970 2024-04-25T09:12:32.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd0ba00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd04160480 con 0x7fdd041600a0 2024-04-25T09:12:32.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd0ba00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0415c870 con 0x7fdd04145250 2024-04-25T09:12:32.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd09000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd040ce970 0x7fdd0415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd09000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd040ce970 0x7fdd0415b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43658/0 (socket says 172.21.15.175:43658) 2024-04-25T09:12:32.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd09000640 1 -- 172.21.15.175:0/1325908831 learned_addr learned my addr 172.21.15.175:0/1325908831 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:32.370 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd03e00640 1 --2- 172.21.15.175:0/1325908831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd04145250 0x7fdd040b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.381+0000 7fdd09a00640 1 --2- 172.21.15.175:0/1325908831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd041600a0 0x7fdd04141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.385+0000 7fdd09000640 1 -- 172.21.15.175:0/1325908831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd04145250 msgr2=0x7fdd040b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.385+0000 7fdd09000640 1 --2- 172.21.15.175:0/1325908831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd04145250 0x7fdd040b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.385+0000 7fdd09000640 1 -- 172.21.15.175:0/1325908831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd041600a0 msgr2=0x7fdd04141e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.385+0000 7fdd09000640 1 --2- 172.21.15.175:0/1325908831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd041600a0 0x7fdd04141e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.385+0000 7fdd09000640 1 -- 172.21.15.175:0/1325908831 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd04140db0 con 0x7fdd040ce970 2024-04-25T09:12:32.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.385+0000 7fdd09a00640 1 --2- 172.21.15.175:0/1325908831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd041600a0 0x7fdd04141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:32.371 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.385+0000 7fdd03e00640 1 --2- 172.21.15.175:0/1325908831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd04145250 0x7fdd040b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:32.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.385+0000 7fdd09000640 1 --2- 172.21.15.175:0/1325908831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd040ce970 0x7fdd0415b300 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40ac040 tx=0x7fdcf401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:32.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.385+0000 7fdd00c00640 1 -- 172.21.15.175:0/1325908831 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf40aadb0 con 0x7fdd040ce970 2024-04-25T09:12:32.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.385+0000 7fdd00c00640 1 -- 172.21.15.175:0/1325908831 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf40bd3f0 con 0x7fdd040ce970 2024-04-25T09:12:32.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.385+0000 7fdd00c00640 1 -- 172.21.15.175:0/1325908831 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf40bd7e0 con 0x7fdd040ce970 2024-04-25T09:12:32.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.385+0000 7fdd0ba00640 1 -- 172.21.15.175:0/1325908831 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd04141090 con 0x7fdd040ce970 2024-04-25T09:12:32.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.385+0000 7fdd0ba00640 1 -- 172.21.15.175:0/1325908831 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd04141650 con 0x7fdd040ce970 2024-04-25T09:12:32.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.385+0000 7fdd0ba00640 1 -- 172.21.15.175:0/1325908831 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd04075160 con 0x7fdd040ce970 2024-04-25T09:12:32.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.385+0000 7fdd00c00640 1 -- 172.21.15.175:0/1325908831 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdcf40b33f0 con 0x7fdd040ce970 2024-04-25T09:12:32.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.385+0000 7fdd00c00640 1 --2- 172.21.15.175:0/1325908831 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdce4066fb0 0x7fdce4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.385+0000 7fdd00c00640 1 -- 172.21.15.175:0/1325908831 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcf411f500 con 0x7fdd040ce970 2024-04-25T09:12:32.373 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.385+0000 7fdd03e00640 1 --2- 172.21.15.175:0/1325908831 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdce4066fb0 0x7fdce4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.374 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.389+0000 7fdd03e00640 1 --2- 172.21.15.175:0/1325908831 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdce4066fb0 0x7fdce4069470 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fdd04131b40 tx=0x7fdcf0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:32.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.389+0000 7fdd00c00640 1 -- 172.21.15.175:0/1325908831 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdcf40c3060 con 0x7fdd040ce970 2024-04-25T09:12:32.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.545+0000 7fdd0ba00640 1 -- 172.21.15.175:0/1325908831 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdd04143e70 con 0x7fdd040ce970 2024-04-25T09:12:32.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.545+0000 7fdd00c00640 1 -- 172.21.15.175:0/1325908831 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v100) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdcf4016150 con 0x7fdd040ce970 2024-04-25T09:12:32.532 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:12:32.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.545+0000 7fdd0ba00640 1 -- 172.21.15.175:0/1325908831 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdce4066fb0 msgr2=0x7fdce4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.545+0000 7fdd0ba00640 1 --2- 172.21.15.175:0/1325908831 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdce4066fb0 0x7fdce4069470 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fdd04131b40 tx=0x7fdcf0008040 comp rx=0 tx=0).stop 2024-04-25T09:12:32.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.545+0000 7fdd0ba00640 1 -- 172.21.15.175:0/1325908831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd040ce970 msgr2=0x7fdd0415b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.545+0000 7fdd0ba00640 1 --2- 172.21.15.175:0/1325908831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd040ce970 0x7fdd0415b300 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40ac040 tx=0x7fdcf401ace0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.545+0000 7fdd0ba00640 1 -- 172.21.15.175:0/1325908831 shutdown_connections 2024-04-25T09:12:32.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.545+0000 7fdd0ba00640 1 --2- 172.21.15.175:0/1325908831 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdce4066fb0 0x7fdce4069470 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.545+0000 7fdd0ba00640 1 --2- 172.21.15.175:0/1325908831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd041600a0 0x7fdd04141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.545+0000 7fdd0ba00640 1 --2- 172.21.15.175:0/1325908831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd04145250 0x7fdd040b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.545+0000 7fdd0ba00640 1 --2- 172.21.15.175:0/1325908831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd040ce970 0x7fdd0415b300 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.545+0000 7fdd0ba00640 1 -- 172.21.15.175:0/1325908831 >> 172.21.15.175:0/1325908831 conn(0x7fdd0406ac50 msgr2=0x7fdd04164b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:32.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.545+0000 7fdd0ba00640 1 -- 172.21.15.175:0/1325908831 shutdown_connections 2024-04-25T09:12:32.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.545+0000 7fdd0ba00640 1 -- 172.21.15.175:0/1325908831 wait complete. 2024-04-25T09:12:32.553 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:12:32.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.701+0000 7fc408a00640 1 Processor -- start 2024-04-25T09:12:32.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.701+0000 7fc408a00640 1 -- start start 2024-04-25T09:12:32.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.701+0000 7fc408a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc404145250 0x7fc4040cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.701+0000 7fc408a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc4040ce970 0x7fc4040cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.701+0000 7fc408a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4040cfd10 con 0x7fc4041600a0 2024-04-25T09:12:32.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.701+0000 7fc408a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40415f650 con 0x7fc4040ce970 2024-04-25T09:12:32.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.701+0000 7fc408a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4040cfff0 con 0x7fc404145250 2024-04-25T09:12:32.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.705+0000 7fc402800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc4040ce970 0x7fc4040cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.705+0000 7fc401400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc4041600a0 0x7fc4040cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38002/0 (socket says 172.21.15.175:38002) 2024-04-25T09:12:32.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.705+0000 7fc402800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc4040ce970 0x7fc4040cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43666/0 (socket says 172.21.15.175:43666) 2024-04-25T09:12:32.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.705+0000 7fc401400640 1 -- 172.21.15.175:0/352397905 learned_addr learned my addr 172.21.15.175:0/352397905 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:32.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.705+0000 7fc401e00640 1 --2- 172.21.15.175:0/352397905 >> v2:172.21.15.177:3300/0 conn(0x7fc404145250 0x7fc4040cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.705+0000 7fc402800640 1 -- 172.21.15.175:0/352397905 >> v2:172.21.15.177:3300/0 conn(0x7fc404145250 msgr2=0x7fc4040cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:32.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.705+0000 7fc402800640 1 --2- 172.21.15.175:0/352397905 >> v2:172.21.15.177:3300/0 conn(0x7fc404145250 0x7fc4040cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.705+0000 7fc402800640 1 -- 172.21.15.175:0/352397905 >> v1:172.21.15.175:6789/0 conn(0x7fc4041600a0 legacy=0x7fc4040cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.705+0000 7fc402800640 1 -- 172.21.15.175:0/352397905 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40415f8a0 con 0x7fc4040ce970 2024-04-25T09:12:32.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.705+0000 7fc402800640 1 --2- 172.21.15.175:0/352397905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4040ce970 0x7fc4040cedc0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009d90 tx=0x7fc3fc01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9b1b0f8daf730f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:32.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.705+0000 7fc400a00640 1 -- 172.21.15.175:0/352397905 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc0b2070 con 0x7fc4040ce970 2024-04-25T09:12:32.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.705+0000 7fc400a00640 1 -- 172.21.15.175:0/352397905 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc0a58c0 con 0x7fc4040ce970 2024-04-25T09:12:32.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.705+0000 7fc400a00640 1 -- 172.21.15.175:0/352397905 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc0a5c90 con 0x7fc4040ce970 2024-04-25T09:12:32.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc408a00640 1 -- 172.21.15.175:0/352397905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4040ce970 msgr2=0x7fc4040cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc408a00640 1 --2- 172.21.15.175:0/352397905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4040ce970 0x7fc4040cedc0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009d90 tx=0x7fc3fc01c870 comp rx=0 tx=0).stop 2024-04-25T09:12:32.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc408a00640 1 -- 172.21.15.175:0/352397905 shutdown_connections 2024-04-25T09:12:32.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc408a00640 1 --2- 172.21.15.175:0/352397905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4040ce970 0x7fc4040cedc0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc408a00640 1 --2- 172.21.15.175:0/352397905 >> v2:172.21.15.177:3300/0 conn(0x7fc404145250 0x7fc4040cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc408a00640 1 -- 172.21.15.175:0/352397905 >> 172.21.15.175:0/352397905 conn(0x7fc40406ac50 msgr2=0x7fc40406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:32.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc408a00640 1 -- 172.21.15.175:0/352397905 shutdown_connections 2024-04-25T09:12:32.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc408a00640 1 -- 172.21.15.175:0/352397905 wait complete. 2024-04-25T09:12:32.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc408a00640 1 Processor -- start 2024-04-25T09:12:32.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc408a00640 1 -- start start 2024-04-25T09:12:32.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc408a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4040ce970 0x7fc40415e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc408a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc404145250 0x7fc40413f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc408a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4041600a0 0x7fc4040b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc408a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40415c870 con 0x7fc404145250 2024-04-25T09:12:32.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc408a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4041604b0 con 0x7fc4041600a0 2024-04-25T09:12:32.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc408a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40415c9f0 con 0x7fc4040ce970 2024-04-25T09:12:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc401400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc404145250 0x7fc40413f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc401400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc404145250 0x7fc40413f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43674/0 (socket says 172.21.15.175:43674) 2024-04-25T09:12:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc401400640 1 -- 172.21.15.175:0/31670625 learned_addr learned my addr 172.21.15.175:0/31670625 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc401e00640 1 --2- 172.21.15.175:0/31670625 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4040ce970 0x7fc40415e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc402800640 1 --2- 172.21.15.175:0/31670625 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4041600a0 0x7fc4040b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc401400640 1 -- 172.21.15.175:0/31670625 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4040ce970 msgr2=0x7fc40415e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc401400640 1 --2- 172.21.15.175:0/31670625 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4040ce970 0x7fc40415e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc401400640 1 -- 172.21.15.175:0/31670625 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4041600a0 msgr2=0x7fc4040b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc401400640 1 --2- 172.21.15.175:0/31670625 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4041600a0 0x7fc4040b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.709+0000 7fc401400640 1 -- 172.21.15.175:0/31670625 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc404140bd0 con 0x7fc404145250 2024-04-25T09:12:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.713+0000 7fc401400640 1 --2- 172.21.15.175:0/31670625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc404145250 0x7fc40413f030 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000c370 tx=0x7fc3f000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.713+0000 7fc3fa000640 1 -- 172.21.15.175:0/31670625 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0017070 con 0x7fc404145250 2024-04-25T09:12:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.713+0000 7fc3fa000640 1 -- 172.21.15.175:0/31670625 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f0005cf0 con 0x7fc404145250 2024-04-25T09:12:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.713+0000 7fc408a00640 1 -- 172.21.15.175:0/31670625 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc404140e40 con 0x7fc404145250 2024-04-25T09:12:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.713+0000 7fc3fa000640 1 -- 172.21.15.175:0/31670625 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f00072f0 con 0x7fc404145250 2024-04-25T09:12:32.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.713+0000 7fc408a00640 1 -- 172.21.15.175:0/31670625 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc404141400 con 0x7fc404145250 2024-04-25T09:12:32.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.713+0000 7fc408a00640 1 -- 172.21.15.175:0/31670625 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc404075160 con 0x7fc404145250 2024-04-25T09:12:32.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.713+0000 7fc3fa000640 1 -- 172.21.15.175:0/31670625 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc3f001a070 con 0x7fc404145250 2024-04-25T09:12:32.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.713+0000 7fc3fa000640 1 --2- 172.21.15.175:0/31670625 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc3e4066f90 0x7fc3e4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:32.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.713+0000 7fc3fa000640 1 -- 172.21.15.175:0/31670625 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3f00842e0 con 0x7fc404145250 2024-04-25T09:12:32.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.713+0000 7fc401e00640 1 --2- 172.21.15.175:0/31670625 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc3e4066f90 0x7fc3e4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:32.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.717+0000 7fc401e00640 1 --2- 172.21.15.175:0/31670625 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc3e4066f90 0x7fc3e4069450 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4007a60 tx=0x7fc3f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:32.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.717+0000 7fc3fa000640 1 -- 172.21.15.175:0/31670625 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc3f0054c90 con 0x7fc404145250 2024-04-25T09:12:32.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.881+0000 7fc408a00640 1 -- 172.21.15.175:0/31670625 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc40406c2d0 con 0x7fc404145250 2024-04-25T09:12:32.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.881+0000 7fc3fa000640 1 -- 172.21.15.175:0/31670625 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v100) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc3f0058d30 con 0x7fc404145250 2024-04-25T09:12:32.870 INFO:teuthology.orchestra.run.smithi175.stderr:listed 0 entries 2024-04-25T09:12:32.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.885+0000 7fc408a00640 1 -- 172.21.15.175:0/31670625 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc3e4066f90 msgr2=0x7fc3e4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.885+0000 7fc408a00640 1 --2- 172.21.15.175:0/31670625 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc3e4066f90 0x7fc3e4069450 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4007a60 tx=0x7fc3f4008040 comp rx=0 tx=0).stop 2024-04-25T09:12:32.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.885+0000 7fc408a00640 1 -- 172.21.15.175:0/31670625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc404145250 msgr2=0x7fc40413f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:32.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.885+0000 7fc408a00640 1 --2- 172.21.15.175:0/31670625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc404145250 0x7fc40413f030 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000c370 tx=0x7fc3f000c830 comp rx=0 tx=0).stop 2024-04-25T09:12:32.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.885+0000 7fc408a00640 1 -- 172.21.15.175:0/31670625 shutdown_connections 2024-04-25T09:12:32.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.885+0000 7fc408a00640 1 --2- 172.21.15.175:0/31670625 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc3e4066f90 0x7fc3e4069450 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.885+0000 7fc408a00640 1 --2- 172.21.15.175:0/31670625 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4041600a0 0x7fc4040b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.885+0000 7fc408a00640 1 --2- 172.21.15.175:0/31670625 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc404145250 0x7fc40413f030 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.885+0000 7fc408a00640 1 --2- 172.21.15.175:0/31670625 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4040ce970 0x7fc40415e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:32.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.885+0000 7fc408a00640 1 -- 172.21.15.175:0/31670625 >> 172.21.15.175:0/31670625 conn(0x7fc40406ac50 msgr2=0x7fc40406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:32.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.885+0000 7fc408a00640 1 -- 172.21.15.175:0/31670625 shutdown_connections 2024-04-25T09:12:32.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:32.885+0000 7fc408a00640 1 -- 172.21.15.175:0/31670625 wait complete. 2024-04-25T09:12:32.891 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:12:32.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:32.891 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:32.920 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:12:32.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:32.920 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:12:32.970 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:33.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.169+0000 7f069ce00640 1 Processor -- start 2024-04-25T09:12:33.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.169+0000 7f069ce00640 1 -- start start 2024-04-25T09:12:33.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.169+0000 7f069ce00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0698099a50 0x7f06980cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.169+0000 7f069ce00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f069809abb0 0x7f06980cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.169+0000 7f069ce00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06980cc4c0 con 0x7f069815bc10 2024-04-25T09:12:33.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.169+0000 7f069ce00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06980d06f0 con 0x7f0698099a50 2024-04-25T09:12:33.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.169+0000 7f069ce00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06980cc7a0 con 0x7f069809abb0 2024-04-25T09:12:33.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.169+0000 7f0695e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0698099a50 0x7f06980cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.169+0000 7f0695e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0698099a50 0x7f06980cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43682/0 (socket says 172.21.15.175:43682) 2024-04-25T09:12:33.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.169+0000 7f0695e00640 1 -- 172.21.15.175:0/4033115805 learned_addr learned my addr 172.21.15.175:0/4033115805 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:33.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.169+0000 7f0696800640 1 --2- 172.21.15.175:0/4033115805 >> v2:172.21.15.177:3300/0 conn(0x7f069809abb0 0x7f06980cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.169+0000 7f0695e00640 1 -- 172.21.15.175:0/4033115805 >> v2:172.21.15.177:3300/0 conn(0x7f069809abb0 msgr2=0x7f06980cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:33.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.169+0000 7f0695e00640 1 --2- 172.21.15.175:0/4033115805 >> v2:172.21.15.177:3300/0 conn(0x7f069809abb0 0x7f06980cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.169+0000 7f0695e00640 1 -- 172.21.15.175:0/4033115805 >> v1:172.21.15.177:6789/0 conn(0x7f069815bc10 legacy=0x7f0698099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:33.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.169+0000 7f0695e00640 1 -- 172.21.15.175:0/4033115805 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06980cca80 con 0x7f0698099a50 2024-04-25T09:12:33.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.169+0000 7f0696800640 1 --2- 172.21.15.175:0/4033115805 >> v2:172.21.15.177:3300/0 conn(0x7f069809abb0 0x7f06980cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:33.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.173+0000 7f0695e00640 1 --2- 172.21.15.175:0/4033115805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0698099a50 0x7f06980cd280 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f06980d28f0 tx=0x7f068801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a02dccc5bd2d1b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:33.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.173+0000 7f0694a00640 1 -- 172.21.15.175:0/4033115805 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06880a5780 con 0x7f0698099a50 2024-04-25T09:12:33.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.173+0000 7f0694a00640 1 -- 172.21.15.175:0/4033115805 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06880a5920 con 0x7f0698099a50 2024-04-25T09:12:33.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.173+0000 7f0694a00640 1 -- 172.21.15.175:0/4033115805 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06880a5cf0 con 0x7f0698099a50 2024-04-25T09:12:33.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.173+0000 7f069ce00640 1 -- 172.21.15.175:0/4033115805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0698099a50 msgr2=0x7f06980cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.173+0000 7f069ce00640 1 --2- 172.21.15.175:0/4033115805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0698099a50 0x7f06980cd280 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f06980d28f0 tx=0x7f068801c9b0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.173+0000 7f069ce00640 1 -- 172.21.15.175:0/4033115805 shutdown_connections 2024-04-25T09:12:33.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.173+0000 7f069ce00640 1 --2- 172.21.15.175:0/4033115805 >> v2:172.21.15.177:3300/0 conn(0x7f069809abb0 0x7f06980cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.173+0000 7f069ce00640 1 --2- 172.21.15.175:0/4033115805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0698099a50 0x7f06980cd280 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.173+0000 7f069ce00640 1 -- 172.21.15.175:0/4033115805 >> 172.21.15.175:0/4033115805 conn(0x7f06980b3300 msgr2=0x7f06980b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:33.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.173+0000 7f069ce00640 1 -- 172.21.15.175:0/4033115805 shutdown_connections 2024-04-25T09:12:33.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.173+0000 7f069ce00640 1 -- 172.21.15.175:0/4033115805 wait complete. 2024-04-25T09:12:33.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f069ce00640 1 Processor -- start 2024-04-25T09:12:33.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f069ce00640 1 -- start start 2024-04-25T09:12:33.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f069ce00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0698099a50 0x7f069814ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f069ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f069809abb0 0x7f06980b5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f069ce00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f069815bc10 0x7f06980b6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f069ce00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06980c5f00 con 0x7f069809abb0 2024-04-25T09:12:33.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f069ce00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06980c5d80 con 0x7f069815bc10 2024-04-25T09:12:33.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f069ce00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0698168850 con 0x7f0698099a50 2024-04-25T09:12:33.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f0695400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f069809abb0 0x7f06980b5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f0695e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0698099a50 0x7f069814ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f0695400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f069809abb0 0x7f06980b5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43696/0 (socket says 172.21.15.175:43696) 2024-04-25T09:12:33.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f0695400640 1 -- 172.21.15.175:0/2619161113 learned_addr learned my addr 172.21.15.175:0/2619161113 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:33.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f0696800640 1 --2- 172.21.15.175:0/2619161113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f069815bc10 0x7f06980b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f0695400640 1 -- 172.21.15.175:0/2619161113 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0698099a50 msgr2=0x7f069814ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f0695400640 1 --2- 172.21.15.175:0/2619161113 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0698099a50 0x7f069814ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f0695400640 1 -- 172.21.15.175:0/2619161113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f069815bc10 msgr2=0x7f06980b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f0695400640 1 --2- 172.21.15.175:0/2619161113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f069815bc10 0x7f06980b6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f0695400640 1 -- 172.21.15.175:0/2619161113 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06980b6ab0 con 0x7f069809abb0 2024-04-25T09:12:33.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f0695400640 1 --2- 172.21.15.175:0/2619161113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f069809abb0 0x7f06980b5ef0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f068400b410 tx=0x7f068400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:33.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f068e000640 1 -- 172.21.15.175:0/2619161113 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684015030 con 0x7f069809abb0 2024-04-25T09:12:33.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f068e000640 1 -- 172.21.15.175:0/2619161113 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0684004020 con 0x7f069809abb0 2024-04-25T09:12:33.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f069ce00640 1 -- 172.21.15.175:0/2619161113 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06980b6d90 con 0x7f069809abb0 2024-04-25T09:12:33.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f068e000640 1 -- 172.21.15.175:0/2619161113 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684004450 con 0x7f069809abb0 2024-04-25T09:12:33.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f069ce00640 1 -- 172.21.15.175:0/2619161113 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06980b44b0 con 0x7f069809abb0 2024-04-25T09:12:33.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.177+0000 7f069ce00640 1 -- 172.21.15.175:0/2619161113 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0698074a60 con 0x7f069809abb0 2024-04-25T09:12:33.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.181+0000 7f068e000640 1 -- 172.21.15.175:0/2619161113 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0684018070 con 0x7f069809abb0 2024-04-25T09:12:33.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.181+0000 7f068e000640 1 --2- 172.21.15.175:0/2619161113 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0678066f60 0x7f0678069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.181+0000 7f068e000640 1 -- 172.21.15.175:0/2619161113 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0684084ad0 con 0x7f069809abb0 2024-04-25T09:12:33.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.181+0000 7f0695e00640 1 --2- 172.21.15.175:0/2619161113 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0678066f60 0x7f0678069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.181+0000 7f0695e00640 1 --2- 172.21.15.175:0/2619161113 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0678066f60 0x7f0678069420 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f06880ae000 tx=0x7f06880a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:33.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.185+0000 7f068e000640 1 -- 172.21.15.175:0/2619161113 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0684055480 con 0x7f069809abb0 2024-04-25T09:12:33.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.373+0000 7f069ce00640 1 -- 172.21.15.175:0/2619161113 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06980cdc40 con 0x7f069809abb0 2024-04-25T09:12:33.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.373+0000 7f068e000640 1 -- 172.21.15.175:0/2619161113 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f0684059520 con 0x7f069809abb0 2024-04-25T09:12:33.359 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:33.359 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":78,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6998,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3519467288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3519467288},{"type":"v1","addr":"172.21.15.177:6834","nonce":3519467288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2181426238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2181426238},{"type":"v1","addr":"172.21.15.177:6835","nonce":2181426238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/936884340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":936884340},{"type":"v1","addr":"172.21.15.175:6836","nonce":936884340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:23.414911+0000","modified":"2024-04-25T09:12:26.444040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8067":{"gid":8067,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/3952378765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3952378765},{"type":"v1","addr":"172.21.15.175:6837","nonce":3952378765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:12:33.359 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 78 2024-04-25T09:12:33.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.373+0000 7f069ce00640 1 -- 172.21.15.175:0/2619161113 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0678066f60 msgr2=0x7f0678069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.373+0000 7f069ce00640 1 --2- 172.21.15.175:0/2619161113 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0678066f60 0x7f0678069420 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f06880ae000 tx=0x7f06880a7070 comp rx=0 tx=0).stop 2024-04-25T09:12:33.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.373+0000 7f069ce00640 1 -- 172.21.15.175:0/2619161113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f069809abb0 msgr2=0x7f06980b5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.373+0000 7f069ce00640 1 --2- 172.21.15.175:0/2619161113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f069809abb0 0x7f06980b5ef0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f068400b410 tx=0x7f068400b8d0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.373+0000 7f069ce00640 1 -- 172.21.15.175:0/2619161113 shutdown_connections 2024-04-25T09:12:33.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.373+0000 7f069ce00640 1 --2- 172.21.15.175:0/2619161113 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0678066f60 0x7f0678069420 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.373+0000 7f069ce00640 1 --2- 172.21.15.175:0/2619161113 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f069815bc10 0x7f06980b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.373+0000 7f069ce00640 1 --2- 172.21.15.175:0/2619161113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f069809abb0 0x7f06980b5ef0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.373+0000 7f069ce00640 1 --2- 172.21.15.175:0/2619161113 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0698099a50 0x7f069814ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.373+0000 7f069ce00640 1 -- 172.21.15.175:0/2619161113 >> 172.21.15.175:0/2619161113 conn(0x7f06980b3300 msgr2=0x7f06981552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:33.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.373+0000 7f069ce00640 1 -- 172.21.15.175:0/2619161113 shutdown_connections 2024-04-25T09:12:33.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.373+0000 7f069ce00640 1 -- 172.21.15.175:0/2619161113 wait complete. 2024-04-25T09:12:33.379 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T09:12:33.541 INFO:teuthology.orchestra.run.smithi175.stdout:{"message":"","return_code":0} 2024-04-25T09:12:33.542 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:12:33.542 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:33.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.689+0000 7fc9a5e00640 1 Processor -- start 2024-04-25T09:12:33.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.689+0000 7fc9a5e00640 1 -- start start 2024-04-25T09:12:33.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.693+0000 7fc9a5e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc9a015a010 0x7fc9a00b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.693+0000 7fc9a5e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc9a00b3b20 0x7fc9a006d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.693+0000 7fc9a5e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a006d460 con 0x7fc9a0159c30 2024-04-25T09:12:33.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.693+0000 7fc9a5e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a00cf110 con 0x7fc9a00b3b20 2024-04-25T09:12:33.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.693+0000 7fc9a5e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a00ce870 con 0x7fc9a015a010 2024-04-25T09:12:33.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.693+0000 7fc9a5400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc9a00b3b20 0x7fc9a006d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.693+0000 7fc9a4a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc9a0159c30 0x7fc9a00b3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38008/0 (socket says 172.21.15.175:38008) 2024-04-25T09:12:33.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.693+0000 7fc9a4a00640 1 -- 172.21.15.175:0/4134287024 learned_addr learned my addr 172.21.15.175:0/4134287024 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:33.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.693+0000 7fc99fe00640 1 --2- 172.21.15.175:0/4134287024 >> v2:172.21.15.177:3300/0 conn(0x7fc9a015a010 0x7fc9a00b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.693+0000 7fc9a5400640 1 -- 172.21.15.175:0/4134287024 >> v2:172.21.15.177:3300/0 conn(0x7fc9a015a010 msgr2=0x7fc9a00b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:33.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.693+0000 7fc9a5400640 1 --2- 172.21.15.175:0/4134287024 >> v2:172.21.15.177:3300/0 conn(0x7fc9a015a010 0x7fc9a00b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.693+0000 7fc9a5400640 1 -- 172.21.15.175:0/4134287024 >> v1:172.21.15.175:6789/0 conn(0x7fc9a0159c30 legacy=0x7fc9a00b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.693+0000 7fc9a5400640 1 -- 172.21.15.175:0/4134287024 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a00ceb50 con 0x7fc9a00b3b20 2024-04-25T09:12:33.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.693+0000 7fc99f400640 1 -- 172.21.15.175:0/4134287024 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735910498 0 0) 0x7fc9a006d460 con 0x7fc9a0159c30 2024-04-25T09:12:33.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.697+0000 7fc9a5400640 1 --2- 172.21.15.175:0/4134287024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9a00b3b20 0x7fc9a006d940 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fc9a006f2c0 tx=0x7fc99801d7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e26c9623045158f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:33.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.697+0000 7fc99f400640 1 -- 172.21.15.175:0/4134287024 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99800b040 con 0x7fc9a00b3b20 2024-04-25T09:12:33.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.697+0000 7fc99f400640 1 -- 172.21.15.175:0/4134287024 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9980a7620 con 0x7fc9a00b3b20 2024-04-25T09:12:33.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.697+0000 7fc99f400640 1 -- 172.21.15.175:0/4134287024 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9980a79f0 con 0x7fc9a00b3b20 2024-04-25T09:12:33.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.697+0000 7fc9a5e00640 1 -- 172.21.15.175:0/4134287024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9a00b3b20 msgr2=0x7fc9a006d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.697+0000 7fc9a5e00640 1 --2- 172.21.15.175:0/4134287024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9a00b3b20 0x7fc9a006d940 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fc9a006f2c0 tx=0x7fc99801d7c0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.697+0000 7fc9a5e00640 1 -- 172.21.15.175:0/4134287024 shutdown_connections 2024-04-25T09:12:33.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.697+0000 7fc9a5e00640 1 --2- 172.21.15.175:0/4134287024 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9a00b3b20 0x7fc9a006d940 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.697+0000 7fc9a5e00640 1 --2- 172.21.15.175:0/4134287024 >> v2:172.21.15.177:3300/0 conn(0x7fc9a015a010 0x7fc9a00b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.697+0000 7fc9a5e00640 1 -- 172.21.15.175:0/4134287024 >> 172.21.15.175:0/4134287024 conn(0x7fc9a006b250 msgr2=0x7fc9a00b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:33.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.697+0000 7fc9a5e00640 1 -- 172.21.15.175:0/4134287024 shutdown_connections 2024-04-25T09:12:33.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.697+0000 7fc9a5e00640 1 -- 172.21.15.175:0/4134287024 wait complete. 2024-04-25T09:12:33.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.697+0000 7fc9a5e00640 1 Processor -- start 2024-04-25T09:12:33.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.697+0000 7fc9a5e00640 1 -- start start 2024-04-25T09:12:33.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a5e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9a00b3b20 0x7fc9a0143bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a5e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9a0159c30 0x7fc9a0150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a5e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9a015a010 0x7fc9a01f9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a5e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a006e210 con 0x7fc9a00b3b20 2024-04-25T09:12:33.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a5e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a006e090 con 0x7fc9a0159c30 2024-04-25T09:12:33.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a5e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a006e390 con 0x7fc9a015a010 2024-04-25T09:12:33.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a4a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9a00b3b20 0x7fc9a0143bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a4a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9a00b3b20 0x7fc9a0143bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43710/0 (socket says 172.21.15.175:43710) 2024-04-25T09:12:33.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a4a00640 1 -- 172.21.15.175:0/1083634268 learned_addr learned my addr 172.21.15.175:0/1083634268 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:33.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc99fe00640 1 --2- 172.21.15.175:0/1083634268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9a0159c30 0x7fc9a0150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a5400640 1 --2- 172.21.15.175:0/1083634268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9a015a010 0x7fc9a01f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a4a00640 1 -- 172.21.15.175:0/1083634268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9a015a010 msgr2=0x7fc9a01f9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a4a00640 1 --2- 172.21.15.175:0/1083634268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9a015a010 0x7fc9a01f9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a4a00640 1 -- 172.21.15.175:0/1083634268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9a0159c30 msgr2=0x7fc9a0150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a4a00640 1 --2- 172.21.15.175:0/1083634268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9a0159c30 0x7fc9a0150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a4a00640 1 -- 172.21.15.175:0/1083634268 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a0150c70 con 0x7fc9a00b3b20 2024-04-25T09:12:33.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc99fe00640 1 --2- 172.21.15.175:0/1083634268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9a0159c30 0x7fc9a0150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:33.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a4a00640 1 --2- 172.21.15.175:0/1083634268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9a00b3b20 0x7fc9a0143bc0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fc990001570 tx=0x7fc99000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:33.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc99cc00640 1 -- 172.21.15.175:0/1083634268 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990018070 con 0x7fc9a00b3b20 2024-04-25T09:12:33.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc99cc00640 1 -- 172.21.15.175:0/1083634268 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99000a5e0 con 0x7fc9a00b3b20 2024-04-25T09:12:33.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc99cc00640 1 -- 172.21.15.175:0/1083634268 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99000a9d0 con 0x7fc9a00b3b20 2024-04-25T09:12:33.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a5e00640 1 -- 172.21.15.175:0/1083634268 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a0150f40 con 0x7fc9a00b3b20 2024-04-25T09:12:33.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a5e00640 1 -- 172.21.15.175:0/1083634268 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a0151500 con 0x7fc9a00b3b20 2024-04-25T09:12:33.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc9a5e00640 1 -- 172.21.15.175:0/1083634268 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a0074a60 con 0x7fc9a00b3b20 2024-04-25T09:12:33.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.701+0000 7fc99cc00640 1 -- 172.21.15.175:0/1083634268 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc99000ab70 con 0x7fc9a00b3b20 2024-04-25T09:12:33.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.705+0000 7fc99cc00640 1 --2- 172.21.15.175:0/1083634268 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc980066f60 0x7fc980069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.705+0000 7fc99cc00640 1 -- 172.21.15.175:0/1083634268 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc990084760 con 0x7fc9a00b3b20 2024-04-25T09:12:33.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.705+0000 7fc99fe00640 1 --2- 172.21.15.175:0/1083634268 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc980066f60 0x7fc980069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.705+0000 7fc99fe00640 1 --2- 172.21.15.175:0/1083634268 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc980066f60 0x7fc980069420 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0135760 tx=0x7fc98c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:33.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.709+0000 7fc99cc00640 1 -- 172.21.15.175:0/1083634268 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc990055760 con 0x7fc9a00b3b20 2024-04-25T09:12:33.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.893+0000 7fc9a5e00640 1 -- 172.21.15.175:0/1083634268 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9a0157760 con 0x7fc9a00b3b20 2024-04-25T09:12:33.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.897+0000 7fc99cc00640 1 -- 172.21.15.175:0/1083634268 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4949 (secure 0 0 0) 0x7fc990055060 con 0x7fc9a00b3b20 2024-04-25T09:12:33.882 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:33.882 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":78,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6998,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3519467288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3519467288},{"type":"v1","addr":"172.21.15.177:6834","nonce":3519467288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2181426238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2181426238},{"type":"v1","addr":"172.21.15.177:6835","nonce":2181426238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/936884340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":936884340},{"type":"v1","addr":"172.21.15.175:6836","nonce":936884340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:23.414911+0000","modified":"2024-04-25T09:12:26.444040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8067":{"gid":8067,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/3952378765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3952378765},{"type":"v1","addr":"172.21.15.175:6837","nonce":3952378765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:12:33.883 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 78 2024-04-25T09:12:33.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.897+0000 7fc9a5e00640 1 -- 172.21.15.175:0/1083634268 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc980066f60 msgr2=0x7fc980069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.897+0000 7fc9a5e00640 1 --2- 172.21.15.175:0/1083634268 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc980066f60 0x7fc980069420 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0135760 tx=0x7fc98c008040 comp rx=0 tx=0).stop 2024-04-25T09:12:33.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.897+0000 7fc9a5e00640 1 -- 172.21.15.175:0/1083634268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9a00b3b20 msgr2=0x7fc9a0143bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.897+0000 7fc9a5e00640 1 --2- 172.21.15.175:0/1083634268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9a00b3b20 0x7fc9a0143bc0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fc990001570 tx=0x7fc99000cd20 comp rx=0 tx=0).stop 2024-04-25T09:12:33.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.897+0000 7fc9a5e00640 1 -- 172.21.15.175:0/1083634268 shutdown_connections 2024-04-25T09:12:33.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.897+0000 7fc9a5e00640 1 --2- 172.21.15.175:0/1083634268 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc980066f60 0x7fc980069420 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.897+0000 7fc9a5e00640 1 --2- 172.21.15.175:0/1083634268 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9a015a010 0x7fc9a01f9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.897+0000 7fc9a5e00640 1 --2- 172.21.15.175:0/1083634268 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9a0159c30 0x7fc9a0150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.897+0000 7fc9a5e00640 1 --2- 172.21.15.175:0/1083634268 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9a00b3b20 0x7fc9a0143bc0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.897+0000 7fc9a5e00640 1 -- 172.21.15.175:0/1083634268 >> 172.21.15.175:0/1083634268 conn(0x7fc9a006b250 msgr2=0x7fc9a0156840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:33.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.897+0000 7fc9a5e00640 1 -- 172.21.15.175:0/1083634268 shutdown_connections 2024-04-25T09:12:33.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.897+0000 7fc9a5e00640 1 -- 172.21.15.175:0/1083634268 wait complete. 2024-04-25T09:12:33.903 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata get mds0_inotable - 2024-04-25T09:12:33.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.961+0000 7ff132338080 1 Processor -- start 2024-04-25T09:12:33.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.961+0000 7ff132338080 1 -- start start 2024-04-25T09:12:33.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.961+0000 7ff132338080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5636f79f6510 0x5636f7a810c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.961+0000 7ff132338080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636f79f68f0 0x5636f7b152d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.961+0000 7ff132338080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636f7a83550 0x5636f7a7f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.961+0000 7ff132338080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636f79e0360 con 0x5636f79f68f0 2024-04-25T09:12:33.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.961+0000 7ff132338080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636f79529f0 con 0x5636f7a83550 2024-04-25T09:12:33.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.961+0000 7ff132338080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636f79f7f40 con 0x5636f79f6510 2024-04-25T09:12:33.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.961+0000 7ff127e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636f79f68f0 0x5636f7b152d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.961+0000 7ff127e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636f79f68f0 0x5636f7b152d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43720/0 (socket says 172.21.15.175:43720) 2024-04-25T09:12:33.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.961+0000 7ff127e00640 1 -- 172.21.15.175:0/2157962751 learned_addr learned my addr 172.21.15.175:0/2157962751 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:33.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.961+0000 7ff130000640 1 --2- 172.21.15.175:0/2157962751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636f7a83550 0x5636f7a7f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.950 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff127e00640 1 -- 172.21.15.175:0/2157962751 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5636f79f6510 msgr2=0x5636f7a810c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:33.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.961+0000 7ff12f600640 1 --2- 172.21.15.175:0/2157962751 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5636f79f6510 0x5636f7a810c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff127e00640 1 --2- 172.21.15.175:0/2157962751 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5636f79f6510 0x5636f7a810c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff127e00640 1 -- 172.21.15.175:0/2157962751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636f7a83550 msgr2=0x5636f7a7f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:33.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff127e00640 1 --2- 172.21.15.175:0/2157962751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636f7a83550 0x5636f7a7f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff127e00640 1 -- 172.21.15.175:0/2157962751 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636f7a8dd90 con 0x5636f79f68f0 2024-04-25T09:12:33.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff130000640 1 --2- 172.21.15.175:0/2157962751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636f7a83550 0x5636f7a7f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:33.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff12f600640 1 --2- 172.21.15.175:0/2157962751 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5636f79f6510 0x5636f7a810c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:33.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff127e00640 1 --2- 172.21.15.175:0/2157962751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636f79f68f0 0x5636f7b152d0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7ff118009a10 tx=0x7ff118005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c79388dc2fb61e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:33.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff12e200640 1 -- 172.21.15.175:0/2157962751 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118008e00 con 0x5636f79f68f0 2024-04-25T09:12:33.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff12e200640 1 -- 172.21.15.175:0/2157962751 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff118018070 con 0x5636f79f68f0 2024-04-25T09:12:33.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff12e200640 1 -- 172.21.15.175:0/2157962751 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118013620 con 0x5636f79f68f0 2024-04-25T09:12:33.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff132338080 1 -- 172.21.15.175:0/2157962751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636f79f68f0 msgr2=0x5636f7b152d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff132338080 1 --2- 172.21.15.175:0/2157962751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636f79f68f0 0x5636f7b152d0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7ff118009a10 tx=0x7ff118005a10 comp rx=0 tx=0).stop 2024-04-25T09:12:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff132338080 1 -- 172.21.15.175:0/2157962751 shutdown_connections 2024-04-25T09:12:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff132338080 1 --2- 172.21.15.175:0/2157962751 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636f7a83550 0x5636f7a7f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff132338080 1 --2- 172.21.15.175:0/2157962751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636f79f68f0 0x5636f7b152d0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff132338080 1 --2- 172.21.15.175:0/2157962751 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5636f79f6510 0x5636f7a810c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff132338080 1 -- 172.21.15.175:0/2157962751 >> 172.21.15.175:0/2157962751 conn(0x5636f79da430 msgr2=0x5636f7a817a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff132338080 1 -- 172.21.15.175:0/2157962751 shutdown_connections 2024-04-25T09:12:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff132338080 1 -- 172.21.15.175:0/2157962751 wait complete. 2024-04-25T09:12:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff132338080 1 Processor -- start 2024-04-25T09:12:33.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff132338080 1 -- start start 2024-04-25T09:12:33.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff132338080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636f79f6510 0x5636f7a67750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff132338080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5636f79f68f0 0x5636f7a7f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff132338080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636f7a83550 0x5636f7a7f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff132338080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636f7a81600 con 0x5636f7a83550 2024-04-25T09:12:33.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff132338080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636f7a8e030 con 0x5636f79f6510 2024-04-25T09:12:33.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff132338080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5636f7a7ad60 con 0x5636f79f68f0 2024-04-25T09:12:33.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff130000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636f7a83550 0x5636f7a7f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff130000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636f7a83550 0x5636f7a7f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43734/0 (socket says 172.21.15.175:43734) 2024-04-25T09:12:33.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff130000640 1 -- 172.21.15.175:0/4211134780 learned_addr learned my addr 172.21.15.175:0/4211134780 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:33.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff127e00640 1 --2- 172.21.15.175:0/4211134780 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5636f79f68f0 0x5636f7a7f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff12f600640 1 --2- 172.21.15.175:0/4211134780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636f79f6510 0x5636f7a67750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff130000640 1 -- 172.21.15.175:0/4211134780 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5636f79f68f0 msgr2=0x5636f7a7f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff130000640 1 --2- 172.21.15.175:0/4211134780 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5636f79f68f0 0x5636f7a7f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff130000640 1 -- 172.21.15.175:0/4211134780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636f79f6510 msgr2=0x5636f7a67750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff130000640 1 --2- 172.21.15.175:0/4211134780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636f79f6510 0x5636f7a67750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff130000640 1 -- 172.21.15.175:0/4211134780 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636f7a7b000 con 0x5636f7a83550 2024-04-25T09:12:33.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff127e00640 1 --2- 172.21.15.175:0/4211134780 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5636f79f68f0 0x5636f7a7f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:33.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff12f600640 1 --2- 172.21.15.175:0/4211134780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5636f79f6510 0x5636f7a67750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:33.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.965+0000 7ff130000640 1 --2- 172.21.15.175:0/4211134780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636f7a83550 0x5636f7a7f9d0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7ff12800c230 tx=0x7ff128006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:33.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.969+0000 7ff12ce00640 1 -- 172.21.15.175:0/4211134780 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128017070 con 0x5636f7a83550 2024-04-25T09:12:33.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.969+0000 7ff12ce00640 1 -- 172.21.15.175:0/4211134780 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12800ce50 con 0x5636f7a83550 2024-04-25T09:12:33.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.969+0000 7ff132338080 1 -- 172.21.15.175:0/4211134780 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5636f7a7b2a0 con 0x5636f7a83550 2024-04-25T09:12:33.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.969+0000 7ff12ce00640 1 -- 172.21.15.175:0/4211134780 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1280046f0 con 0x5636f7a83550 2024-04-25T09:12:33.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.969+0000 7ff132338080 1 -- 172.21.15.175:0/4211134780 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5636f7a7b7e0 con 0x5636f7a83550 2024-04-25T09:12:33.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.969+0000 7ff12ce00640 1 -- 172.21.15.175:0/4211134780 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff12801a070 con 0x5636f7a83550 2024-04-25T09:12:33.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.969+0000 7ff12ce00640 1 --2- 172.21.15.175:0/4211134780 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff10c065970 0x7ff10c067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.969+0000 7ff12ce00640 1 -- 172.21.15.175:0/4211134780 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1280835b0 con 0x5636f7a83550 2024-04-25T09:12:33.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.969+0000 7ff12f600640 1 --2- 172.21.15.175:0/4211134780 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff10c065970 0x7ff10c067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.969+0000 7ff132338080 1 --2- 172.21.15.175:0/4211134780 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x5636f7a79fe0 0x5636f79dd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:33.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.969+0000 7ff132338080 1 -- 172.21.15.175:0/4211134780 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e100) v9 -- 0x5636f79ddbe0 con 0x5636f7a79fe0 2024-04-25T09:12:33.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.969+0000 7ff127e00640 1 --2- 172.21.15.175:0/4211134780 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x5636f7a79fe0 0x5636f79dd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:33.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.969+0000 7ff12f600640 1 --2- 172.21.15.175:0/4211134780 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff10c065970 0x7ff10c067e30 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff1200ad000 tx=0x7ff1200a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:33.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.969+0000 7ff127e00640 1 --2- 172.21.15.175:0/4211134780 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x5636f7a79fe0 0x5636f79dd6a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:33.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.973+0000 7ff127e00640 1 -- 172.21.15.175:0/4211134780 <== osd.2 v2:172.21.15.175:6821/3247063283 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x7ff118013420 con 0x5636f7a79fe0 2024-04-25T09:12:33.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.973+0000 7ff132338080 1 -- 172.21.15.175:0/4211134780 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x5636f7a79fe0 msgr2=0x5636f79dd6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.973+0000 7ff132338080 1 --2- 172.21.15.175:0/4211134780 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x5636f7a79fe0 0x5636f79dd6a0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:33.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.973+0000 7ff132338080 1 -- 172.21.15.175:0/4211134780 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff10c065970 msgr2=0x7ff10c067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.973+0000 7ff132338080 1 --2- 172.21.15.175:0/4211134780 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff10c065970 0x7ff10c067e30 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff1200ad000 tx=0x7ff1200a6000 comp rx=0 tx=0).stop 2024-04-25T09:12:33.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.973+0000 7ff132338080 1 -- 172.21.15.175:0/4211134780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636f7a83550 msgr2=0x5636f7a7f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:33.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.973+0000 7ff132338080 1 --2- 172.21.15.175:0/4211134780 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5636f7a83550 0x5636f7a7f9d0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7ff12800c230 tx=0x7ff128006f90 comp rx=0 tx=0).stop 2024-04-25T09:12:33.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.973+0000 7ff130000640 1 -- 172.21.15.175:0/4211134780 reap_dead start 2024-04-25T09:12:33.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.973+0000 7ff132338080 1 -- 172.21.15.175:0/4211134780 shutdown_connections 2024-04-25T09:12:33.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.973+0000 7ff132338080 1 -- 172.21.15.175:0/4211134780 >> 172.21.15.175:0/4211134780 conn(0x5636f79da430 msgr2=0x5636f7a85730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:33.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.973+0000 7ff132338080 1 -- 172.21.15.175:0/4211134780 shutdown_connections 2024-04-25T09:12:33.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:33.973+0000 7ff132338080 1 -- 172.21.15.175:0/4211134780 wait complete. 2024-04-25T09:12:33.963 INFO:teuthology.orchestra.run.smithi175.stdout:����� 2024-04-25T09:12:33.963 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:12:34.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f406ea00640 1 Processor -- start 2024-04-25T09:12:34.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f406ea00640 1 -- start start 2024-04-25T09:12:34.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f406ea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4068144fc0 0x7f40680cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:34.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f406ea00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406815cd00 con 0x7f40681453a0 2024-04-25T09:12:34.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f406ea00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40680ce660 con 0x7f406815c5e0 2024-04-25T09:12:34.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f406ea00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40680cc930 con 0x7f4068144fc0 2024-04-25T09:12:34.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f405f400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f40681453a0 0x7f406815bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38028/0 (socket says 172.21.15.175:38028) 2024-04-25T09:12:34.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f405f400640 1 -- 172.21.15.175:0/3539703 learned_addr learned my addr 172.21.15.175:0/3539703 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:34.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067e00640 1 --2- 172.21.15.175:0/3539703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4068144fc0 0x7f40680cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:34.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067400640 1 -- 172.21.15.175:0/3539703 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849901780 0 0) 0x7f406815cd00 con 0x7f40681453a0 2024-04-25T09:12:34.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067400640 1 -- 172.21.15.175:0/3539703 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f404c003530 con 0x7f40681453a0 2024-04-25T09:12:34.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067400640 1 -- 172.21.15.175:0/3539703 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739631744 0 0) 0x7f40680ce660 con 0x7f406815c5e0 2024-04-25T09:12:34.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067400640 1 -- 172.21.15.175:0/3539703 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f406815cd00 con 0x7f406815c5e0 2024-04-25T09:12:34.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067400640 1 -- 172.21.15.175:0/3539703 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3993661577 0 0) 0x7f404c003530 con 0x7f40681453a0 2024-04-25T09:12:34.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067400640 1 -- 172.21.15.175:0/3539703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4068144fc0 msgr2=0x7f40680cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:34.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067400640 1 --2- 172.21.15.175:0/3539703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4068144fc0 0x7f40680cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067400640 1 -- 172.21.15.175:0/3539703 >> v1:172.21.15.177:6789/0 conn(0x7f406815c5e0 legacy=0x7f40680cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:34.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067400640 1 -- 172.21.15.175:0/3539703 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40680ccc10 con 0x7f40681453a0 2024-04-25T09:12:34.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067400640 1 -- 172.21.15.175:0/3539703 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f4050001680 con 0x7f40681453a0 2024-04-25T09:12:34.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067400640 1 -- 172.21.15.175:0/3539703 >> v1:172.21.15.175:6789/0 conn(0x7f40681453a0 legacy=0x7f406815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:34.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067400640 1 --2- 172.21.15.175:0/3539703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f404c003b80 0x7f404c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:34.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067400640 1 --2- 172.21.15.175:0/3539703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f404c004810 0x7f404c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:34.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067400640 1 --2- 172.21.15.175:0/3539703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4068144fc0 0x7f404c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:34.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067400640 1 -- 172.21.15.175:0/3539703 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40680cc930 con 0x7f404c004810 2024-04-25T09:12:34.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067400640 1 -- 172.21.15.175:0/3539703 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404c00ba80 con 0x7f404c003b80 2024-04-25T09:12:34.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067400640 1 -- 172.21.15.175:0/3539703 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404c00bc80 con 0x7f4068144fc0 2024-04-25T09:12:34.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f405f400640 1 --2- 172.21.15.175:0/3539703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f404c004810 0x7f404c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:34.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f4067e00640 1 --2- 172.21.15.175:0/3539703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f404c003b80 0x7f404c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:34.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f406ca00640 1 --2- 172.21.15.175:0/3539703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4068144fc0 0x7f404c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:34.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f405f400640 1 -- 172.21.15.175:0/3539703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4068144fc0 msgr2=0x7f404c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:34.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f405f400640 1 --2- 172.21.15.175:0/3539703 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4068144fc0 0x7f404c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f405f400640 1 -- 172.21.15.175:0/3539703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f404c003b80 msgr2=0x7f404c003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:34.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f405f400640 1 --2- 172.21.15.175:0/3539703 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f404c003b80 0x7f404c003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.161+0000 7f405f400640 1 -- 172.21.15.175:0/3539703 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c003530 con 0x7f404c004810 2024-04-25T09:12:34.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.165+0000 7f405f400640 1 --2- 172.21.15.175:0/3539703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f404c004810 0x7f404c004c90 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f4050007fd0 tx=0x7f405001cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb571fe81c86b499 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:34.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.165+0000 7f4067400640 1 -- 172.21.15.175:0/3539703 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050007bf0 con 0x7f404c004810 2024-04-25T09:12:34.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.165+0000 7f4067400640 1 -- 172.21.15.175:0/3539703 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40500a9070 con 0x7f404c004810 2024-04-25T09:12:34.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.165+0000 7f4067400640 1 -- 172.21.15.175:0/3539703 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4050005ce0 con 0x7f404c004810 2024-04-25T09:12:34.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.165+0000 7f406ea00640 1 -- 172.21.15.175:0/3539703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f404c004810 msgr2=0x7f404c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:34.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.165+0000 7f406ea00640 1 --2- 172.21.15.175:0/3539703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f404c004810 0x7f404c004c90 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f4050007fd0 tx=0x7f405001cb40 comp rx=0 tx=0).stop 2024-04-25T09:12:34.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.165+0000 7f406ca00640 1 -- 172.21.15.175:0/3539703 reap_dead start 2024-04-25T09:12:34.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.165+0000 7f406ea00640 1 -- 172.21.15.175:0/3539703 shutdown_connections 2024-04-25T09:12:34.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.165+0000 7f406ea00640 1 -- 172.21.15.175:0/3539703 >> 172.21.15.175:0/3539703 conn(0x7f4068067150 msgr2=0x7f406806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:34.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.165+0000 7f406ea00640 1 -- 172.21.15.175:0/3539703 shutdown_connections 2024-04-25T09:12:34.154 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.165+0000 7f406ea00640 1 -- 172.21.15.175:0/3539703 wait complete. 2024-04-25T09:12:34.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ea00640 1 Processor -- start 2024-04-25T09:12:34.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ea00640 1 -- start start 2024-04-25T09:12:34.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ea00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4068151300 0x7f40680b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:34.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40680af000 0x7f40680b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:34.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f406815b000 0x7f4068141460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:34.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ea00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40680cbe70 con 0x7f406815b000 2024-04-25T09:12:34.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ea00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40680ce900 con 0x7f4068151300 2024-04-25T09:12:34.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ea00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40680cbff0 con 0x7f40680af000 2024-04-25T09:12:34.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f406815b000 0x7f4068141460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:34.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f406815b000 0x7f4068141460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43744/0 (socket says 172.21.15.175:43744) 2024-04-25T09:12:34.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ca00640 1 -- 172.21.15.175:0/4063377921 learned_addr learned my addr 172.21.15.175:0/4063377921 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:34.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f4067e00640 1 --2- 172.21.15.175:0/4063377921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4068151300 0x7f40680b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:34.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f405f400640 1 --2- 172.21.15.175:0/4063377921 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40680af000 0x7f40680b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:34.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ca00640 1 -- 172.21.15.175:0/4063377921 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40680af000 msgr2=0x7f40680b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:34.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ca00640 1 --2- 172.21.15.175:0/4063377921 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40680af000 0x7f40680b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ca00640 1 -- 172.21.15.175:0/4063377921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4068151300 msgr2=0x7f40680b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:34.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ca00640 1 --2- 172.21.15.175:0/4063377921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4068151300 0x7f40680b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ca00640 1 -- 172.21.15.175:0/4063377921 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40680b02c0 con 0x7f406815b000 2024-04-25T09:12:34.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ca00640 1 --2- 172.21.15.175:0/4063377921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f406815b000 0x7f4068141460 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f40680b2610 tx=0x7f4060012bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:34.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f4064c00640 1 -- 172.21.15.175:0/4063377921 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4060010aa0 con 0x7f406815b000 2024-04-25T09:12:34.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f4064c00640 1 -- 172.21.15.175:0/4063377921 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406001b070 con 0x7f406815b000 2024-04-25T09:12:34.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ea00640 1 -- 172.21.15.175:0/4063377921 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40680b05a0 con 0x7f406815b000 2024-04-25T09:12:34.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f4064c00640 1 -- 172.21.15.175:0/4063377921 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4060010e40 con 0x7f406815b000 2024-04-25T09:12:34.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.169+0000 7f406ea00640 1 -- 172.21.15.175:0/4063377921 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4068140f40 con 0x7f406815b000 2024-04-25T09:12:34.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.173+0000 7f406ea00640 1 -- 172.21.15.175:0/4063377921 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4068074a60 con 0x7f406815b000 2024-04-25T09:12:34.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.173+0000 7f4064c00640 1 -- 172.21.15.175:0/4063377921 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4060016480 con 0x7f406815b000 2024-04-25T09:12:34.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.173+0000 7f4064c00640 1 --2- 172.21.15.175:0/4063377921 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4044066f60 0x7f4044069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:34.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.173+0000 7f4064c00640 1 -- 172.21.15.175:0/4063377921 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4060088520 con 0x7f406815b000 2024-04-25T09:12:34.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.173+0000 7f4067e00640 1 --2- 172.21.15.175:0/4063377921 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4044066f60 0x7f4044069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:34.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.173+0000 7f4067e00640 1 --2- 172.21.15.175:0/4063377921 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4044066f60 0x7f4044069420 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4058009b00 tx=0x7f4058009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:34.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.177+0000 7f4064c00640 1 -- 172.21.15.175:0/4063377921 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4060059520 con 0x7f406815b000 2024-04-25T09:12:34.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.365+0000 7f406ea00640 1 -- 172.21.15.175:0/4063377921 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f40680ae2f0 con 0x7f406815b000 2024-04-25T09:12:34.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.365+0000 7f4064c00640 1 -- 172.21.15.175:0/4063377921 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4060058e20 con 0x7f406815b000 2024-04-25T09:12:34.351 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:12:34.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.365+0000 7f406ea00640 1 -- 172.21.15.175:0/4063377921 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4044066f60 msgr2=0x7f4044069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:34.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.365+0000 7f406ea00640 1 --2- 172.21.15.175:0/4063377921 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4044066f60 0x7f4044069420 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4058009b00 tx=0x7f4058009190 comp rx=0 tx=0).stop 2024-04-25T09:12:34.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.365+0000 7f406ea00640 1 -- 172.21.15.175:0/4063377921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f406815b000 msgr2=0x7f4068141460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:34.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.365+0000 7f406ea00640 1 --2- 172.21.15.175:0/4063377921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f406815b000 0x7f4068141460 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f40680b2610 tx=0x7f4060012bd0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.365+0000 7f406ea00640 1 -- 172.21.15.175:0/4063377921 shutdown_connections 2024-04-25T09:12:34.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.365+0000 7f406ea00640 1 --2- 172.21.15.175:0/4063377921 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4044066f60 0x7f4044069420 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.365+0000 7f406ea00640 1 --2- 172.21.15.175:0/4063377921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f406815b000 0x7f4068141460 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.365+0000 7f406ea00640 1 --2- 172.21.15.175:0/4063377921 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40680af000 0x7f40680b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.365+0000 7f406ea00640 1 --2- 172.21.15.175:0/4063377921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4068151300 0x7f40680b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:34.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.365+0000 7f406ea00640 1 -- 172.21.15.175:0/4063377921 >> 172.21.15.175:0/4063377921 conn(0x7f404c004810 msgr2=0x7f406813fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:34.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.365+0000 7f406ea00640 1 -- 172.21.15.175:0/4063377921 shutdown_connections 2024-04-25T09:12:34.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:34.365+0000 7f406ea00640 1 -- 172.21.15.175:0/4063377921 wait complete. 2024-04-25T09:12:34.372 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:12:34.372 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:12:34.372 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-25T09:12:34.372 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:12:34.372 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:34.373 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:12:34.373 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:12:34.373 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:12:34.373 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:12:34.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:34.373 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-25T09:12:34.383 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:12:34.383 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:12:34.384 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:12:34.384 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:34.384 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:12:34.384 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:34.384 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:12:34.384 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-25T09:12:34.384 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-25T09:12:34.384 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:12:34.384 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-25T09:12:34.385 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-25T09:12:34.385 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:12:34.385 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:12:34.385 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:12:34.385 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:12:34.385 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:12:34.385 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 41965sec preferred_lft 41965sec 2024-04-25T09:12:34.385 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-25T09:12:34.385 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:34.386 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:12:34.386 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:0d:71:4a:a6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:12:34.386 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:12:34.386 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:34.386 INFO:teuthology.orchestra.run.smithi175.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:12:34.386 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:12:34.386 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:12:34.386 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:34.387 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:12:34.387 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:34.387 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:12:34.387 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:12:34.387 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:12:34.387 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:34.387 INFO:teuthology.orchestra.run.smithi175.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:12:34.387 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:12:34.387 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:12:34.388 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:12:34.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:34.388 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:12:34.442 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:12:34.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:34.445 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-25T09:12:34.497 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-25T09:12:34.497 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:12:34.497 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:12:34.497 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:12:34.497 INFO:teuthology.orchestra.run.smithi175.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:12:34.497 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:12:34.497 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:12:34.497 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:12:34.498 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:12:34.498 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:12:34.498 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:12:34.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:34.498 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:12:34.498 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:12:34.498 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:12:34.498 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:12:34.498 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:12:34.498 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:12:34.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:34.586 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:12:34.641 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:12:34.642 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:12:34.643 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:12:34.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:34.643 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-25T09:12:34.705 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:12:34.705 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:34.753 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:12:34.754 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:12:34.754 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:34.805 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:12:34.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:34.805 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:12:34.898 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:12:34.898 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:12:34.898 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:12:34.913 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:12:34.913 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:12:34.913 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:12:34.913 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:12:34.913 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:12:34.923 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:12:34.923 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:12:34.923 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:12:34.923 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:12:34.923 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:12:34.923 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:12:34.923 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:12:34.923 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:12:34.927 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:12:34.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:34.927 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:34.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:34.946 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:12:35.000 INFO:teuthology.orchestra.run.smithi175.stdout:client7121 2024-04-25T09:12:35.000 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:12:35.000 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:35.053 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:12:35.053 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:35.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:35.102 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file2_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-25T09:12:35.244 INFO:teuthology.orchestra.run.smithi175.stderr:6+0 records in 2024-04-25T09:12:35.244 INFO:teuthology.orchestra.run.smithi175.stderr:6+0 records out 2024-04-25T09:12:35.244 INFO:teuthology.orchestra.run.smithi175.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0865958 s, 72.7 MB/s 2024-04-25T09:12:35.245 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:12:35.245 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:35.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:35.254 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file3_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-25T09:12:35.398 INFO:teuthology.orchestra.run.smithi175.stderr:6+0 records in 2024-04-25T09:12:35.399 INFO:teuthology.orchestra.run.smithi175.stderr:6+0 records out 2024-04-25T09:12:35.399 INFO:teuthology.orchestra.run.smithi175.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0914718 s, 68.8 MB/s 2024-04-25T09:12:35.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:35.400 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T09:12:35.410 INFO:teuthology.orchestra.run.smithi175.stdout:./ 2024-04-25T09:12:35.411 INFO:teuthology.orchestra.run.smithi175.stdout:./file2_sixmegs 2024-04-25T09:12:35.411 INFO:teuthology.orchestra.run.smithi175.stdout:./file3_sixmegs 2024-04-25T09:12:35.411 INFO:teuthology.orchestra.run.smithi175.stdout:./file1_sixmegs 2024-04-25T09:12:35.412 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:12:35.412 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:12:35.412 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:12:35.412 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:12:35.412 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T09:12:35.412 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:12:35.516 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:12:35.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:12:35.525 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:12:35.525 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:12:35.525 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:12:35.525 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:12:35.525 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file2_sixmegs").st_ino) 2024-04-25T09:12:35.525 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:12:35.632 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627777 2024-04-25T09:12:35.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:12:35.642 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:12:35.642 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:12:35.642 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:12:35.642 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:12:35.642 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file3_sixmegs").st_ino) 2024-04-25T09:12:35.642 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:12:35.753 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627778 2024-04-25T09:12:35.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:12:35.762 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:12:35.762 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:12:35.762 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:12:35.762 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:12:35.762 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file1_sixmegs").st_ino) 2024-04-25T09:12:35.762 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:12:35.869 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627776 2024-04-25T09:12:35.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:12:35.878 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:12:35.878 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:35.935 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:12:35.935 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:35.985 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:36.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.177+0000 7f1747e00640 1 Processor -- start 2024-04-25T09:12:36.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.177+0000 7f1747e00640 1 -- start start 2024-04-25T09:12:36.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.177+0000 7f1747e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17480ced90 0x7f17480aed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:36.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.177+0000 7f1747e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f174806e3d0 0x7f174806e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:36.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.177+0000 7f1747e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17480cca10 con 0x7f17480cc2a0 2024-04-25T09:12:36.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.177+0000 7f1747e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174815f180 con 0x7f174806e3d0 2024-04-25T09:12:36.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.177+0000 7f1747e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174806ed60 con 0x7f17480ced90 2024-04-25T09:12:36.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.177+0000 7f1746a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17480ced90 0x7f17480aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:36.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.177+0000 7f1747400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f174806e3d0 0x7f174806e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:36.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.177+0000 7f1747400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f174806e3d0 0x7f174806e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:53780/0 (socket says 172.21.15.175:53780) 2024-04-25T09:12:36.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.177+0000 7f1747400640 1 -- 172.21.15.175:0/2333008769 learned_addr learned my addr 172.21.15.175:0/2333008769 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:36.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.177+0000 7f1746a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17480ced90 0x7f17480aed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:49344/0 (socket says 172.21.15.175:49344) 2024-04-25T09:12:36.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.177+0000 7f1746a00640 1 -- 172.21.15.175:0/2333008769 >> v2:172.21.15.177:3300/0 conn(0x7f174806e3d0 msgr2=0x7f174806e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:36.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.177+0000 7f1746a00640 1 --2- 172.21.15.175:0/2333008769 >> v2:172.21.15.177:3300/0 conn(0x7f174806e3d0 0x7f174806e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.177+0000 7f1746a00640 1 -- 172.21.15.175:0/2333008769 >> v1:172.21.15.177:6789/0 conn(0x7f17480cc2a0 legacy=0x7f174815ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:36.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.177+0000 7f1746a00640 1 -- 172.21.15.175:0/2333008769 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17480cccf0 con 0x7f17480ced90 2024-04-25T09:12:36.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.177+0000 7f1747400640 1 --2- 172.21.15.175:0/2333008769 >> v2:172.21.15.177:3300/0 conn(0x7f174806e3d0 0x7f174806e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:36.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.181+0000 7f1746a00640 1 --2- 172.21.15.175:0/2333008769 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17480ced90 0x7f17480aed80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f17380097c0 tx=0x7f173801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fef4fd23105e2e6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:36.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.181+0000 7f1745600640 1 -- 172.21.15.175:0/2333008769 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17380a7070 con 0x7f17480ced90 2024-04-25T09:12:36.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.181+0000 7f1745600640 1 -- 172.21.15.175:0/2333008769 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17380b0070 con 0x7f17480ced90 2024-04-25T09:12:36.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.181+0000 7f1745600640 1 -- 172.21.15.175:0/2333008769 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17380ab890 con 0x7f17480ced90 2024-04-25T09:12:36.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.181+0000 7f1747e00640 1 -- 172.21.15.175:0/2333008769 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17480ced90 msgr2=0x7f17480aed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:36.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.181+0000 7f1747e00640 1 --2- 172.21.15.175:0/2333008769 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17480ced90 0x7f17480aed80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f17380097c0 tx=0x7f173801c470 comp rx=0 tx=0).stop 2024-04-25T09:12:36.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.181+0000 7f1747e00640 1 -- 172.21.15.175:0/2333008769 shutdown_connections 2024-04-25T09:12:36.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.181+0000 7f1747e00640 1 --2- 172.21.15.175:0/2333008769 >> v2:172.21.15.177:3300/0 conn(0x7f174806e3d0 0x7f174806e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.181+0000 7f1747e00640 1 --2- 172.21.15.175:0/2333008769 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17480ced90 0x7f17480aed80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.181+0000 7f1747e00640 1 -- 172.21.15.175:0/2333008769 >> 172.21.15.175:0/2333008769 conn(0x7f174806b250 msgr2=0x7f17480b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:36.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.181+0000 7f1747e00640 1 -- 172.21.15.175:0/2333008769 shutdown_connections 2024-04-25T09:12:36.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.181+0000 7f1747e00640 1 -- 172.21.15.175:0/2333008769 wait complete. 2024-04-25T09:12:36.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.181+0000 7f1747e00640 1 Processor -- start 2024-04-25T09:12:36.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.181+0000 7f1747e00640 1 -- start start 2024-04-25T09:12:36.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1747e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f174806e3d0 0x7f1748154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:36.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1747e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17480cc2a0 0x7f174813cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:36.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1747e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17480ced90 0x7f174813cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:36.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1747e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17480cf170 con 0x7f174806e3d0 2024-04-25T09:12:36.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1747e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17480cc6b0 con 0x7f17480ced90 2024-04-25T09:12:36.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1747e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17480cf2f0 con 0x7f17480cc2a0 2024-04-25T09:12:36.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1746a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f174806e3d0 0x7f1748154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:36.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1746a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f174806e3d0 0x7f1748154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43750/0 (socket says 172.21.15.175:43750) 2024-04-25T09:12:36.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1746a00640 1 -- 172.21.15.175:0/536877399 learned_addr learned my addr 172.21.15.175:0/536877399 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:36.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1746000640 1 --2- 172.21.15.175:0/536877399 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17480cc2a0 0x7f174813cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:36.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1747400640 1 --2- 172.21.15.175:0/536877399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17480ced90 0x7f174813cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:36.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1746a00640 1 -- 172.21.15.175:0/536877399 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17480cc2a0 msgr2=0x7f174813cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:36.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1746a00640 1 --2- 172.21.15.175:0/536877399 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17480cc2a0 0x7f174813cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1746a00640 1 -- 172.21.15.175:0/536877399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17480ced90 msgr2=0x7f174813cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:36.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1746a00640 1 --2- 172.21.15.175:0/536877399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17480ced90 0x7f174813cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1746a00640 1 -- 172.21.15.175:0/536877399 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174815d610 con 0x7f174806e3d0 2024-04-25T09:12:36.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1746a00640 1 --2- 172.21.15.175:0/536877399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f174806e3d0 0x7f1748154e90 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f173801a0a0 tx=0x7f173801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:36.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f173ea00640 1 -- 172.21.15.175:0/536877399 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17380bf610 con 0x7f174806e3d0 2024-04-25T09:12:36.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f173ea00640 1 -- 172.21.15.175:0/536877399 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17380bf7d0 con 0x7f174806e3d0 2024-04-25T09:12:36.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f173ea00640 1 -- 172.21.15.175:0/536877399 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17380bfbc0 con 0x7f174806e3d0 2024-04-25T09:12:36.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1747e00640 1 -- 172.21.15.175:0/536877399 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174815d8f0 con 0x7f174806e3d0 2024-04-25T09:12:36.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1747e00640 1 -- 172.21.15.175:0/536877399 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17481553d0 con 0x7f174806e3d0 2024-04-25T09:12:36.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.185+0000 7f1747e00640 1 -- 172.21.15.175:0/536877399 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174806bbe0 con 0x7f174806e3d0 2024-04-25T09:12:36.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.189+0000 7f173ea00640 1 -- 172.21.15.175:0/536877399 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f17380bd020 con 0x7f174806e3d0 2024-04-25T09:12:36.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.189+0000 7f173ea00640 1 --2- 172.21.15.175:0/536877399 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1728066f60 0x7f1728069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:36.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.189+0000 7f173ea00640 1 -- 172.21.15.175:0/536877399 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f173811f370 con 0x7f174806e3d0 2024-04-25T09:12:36.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.189+0000 7f1746000640 1 --2- 172.21.15.175:0/536877399 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1728066f60 0x7f1728069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:36.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.189+0000 7f1746000640 1 --2- 172.21.15.175:0/536877399 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1728066f60 0x7f1728069420 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1748155f70 tx=0x7f1734009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:36.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.193+0000 7f173ea00640 1 -- 172.21.15.175:0/536877399 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f17380c6070 con 0x7f174806e3d0 2024-04-25T09:12:36.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.349+0000 7f1747e00640 1 -- 172.21.15.175:0/536877399 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1748074a60 con 0x7f174806e3d0 2024-04-25T09:12:36.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.349+0000 7f173ea00640 1 -- 172.21.15.175:0/536877399 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16646 (secure 0 0 0) 0x7f1738016090 con 0x7f174806e3d0 2024-04-25T09:12:36.336 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:36.336 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":100,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:12:25.044197+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:12:21.141676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:12:22.422455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:36.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.349+0000 7f1747e00640 1 -- 172.21.15.175:0/536877399 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1728066f60 msgr2=0x7f1728069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:36.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.349+0000 7f1747e00640 1 --2- 172.21.15.175:0/536877399 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1728066f60 0x7f1728069420 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1748155f70 tx=0x7f1734009040 comp rx=0 tx=0).stop 2024-04-25T09:12:36.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.349+0000 7f1747e00640 1 -- 172.21.15.175:0/536877399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f174806e3d0 msgr2=0x7f1748154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:36.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.349+0000 7f1747e00640 1 --2- 172.21.15.175:0/536877399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f174806e3d0 0x7f1748154e90 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f173801a0a0 tx=0x7f173801acb0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.349+0000 7f1747e00640 1 -- 172.21.15.175:0/536877399 shutdown_connections 2024-04-25T09:12:36.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.349+0000 7f1747e00640 1 --2- 172.21.15.175:0/536877399 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1728066f60 0x7f1728069420 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.349+0000 7f1747e00640 1 --2- 172.21.15.175:0/536877399 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17480ced90 0x7f174813cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.349+0000 7f1747e00640 1 --2- 172.21.15.175:0/536877399 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17480cc2a0 0x7f174813cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.349+0000 7f1747e00640 1 --2- 172.21.15.175:0/536877399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f174806e3d0 0x7f1748154e90 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.349+0000 7f1747e00640 1 -- 172.21.15.175:0/536877399 >> 172.21.15.175:0/536877399 conn(0x7f174806b250 msgr2=0x7f1748152ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:36.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.349+0000 7f1747e00640 1 -- 172.21.15.175:0/536877399 shutdown_connections 2024-04-25T09:12:36.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.349+0000 7f1747e00640 1 -- 172.21.15.175:0/536877399 wait complete. 2024-04-25T09:12:36.357 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:12:21.141676+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:12:22.422455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:12:36.358 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:12:36.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.509+0000 7ff80a200640 1 Processor -- start 2024-04-25T09:12:36.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.509+0000 7ff80a200640 1 -- start start 2024-04-25T09:12:36.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.509+0000 7ff80a200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff8040b3230 0x7ff8040b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:36.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.509+0000 7ff80a200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff8040b3d20 0x7ff8040b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:36.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.509+0000 7ff80a200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80415dd10 con 0x7ff8040712d0 2024-04-25T09:12:36.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.509+0000 7ff80a200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff80415dff0 con 0x7ff8040b3230 2024-04-25T09:12:36.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.509+0000 7ff80a200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80415e2d0 con 0x7ff8040b3d20 2024-04-25T09:12:36.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.509+0000 7ff803400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff8040b3230 0x7ff8040b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:36.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.509+0000 7ff803400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff8040b3230 0x7ff8040b2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43752/0 (socket says 172.21.15.175:43752) 2024-04-25T09:12:36.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.509+0000 7ff803e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff8040712d0 0x7ff80415aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38030/0 (socket says 172.21.15.175:38030) 2024-04-25T09:12:36.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.509+0000 7ff803400640 1 -- 172.21.15.175:0/1763894695 learned_addr learned my addr 172.21.15.175:0/1763894695 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:36.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.509+0000 7ff802a00640 1 --2- 172.21.15.175:0/1763894695 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff8040b3d20 0x7ff8040b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:36.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.509+0000 7ff803400640 1 -- 172.21.15.175:0/1763894695 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff8040b3d20 msgr2=0x7ff8040b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:36.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.509+0000 7ff803400640 1 --2- 172.21.15.175:0/1763894695 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff8040b3d20 0x7ff8040b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.509+0000 7ff803400640 1 -- 172.21.15.175:0/1763894695 >> v1:172.21.15.175:6789/0 conn(0x7ff8040712d0 legacy=0x7ff80415aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:36.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.509+0000 7ff803400640 1 -- 172.21.15.175:0/1763894695 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80415e5b0 con 0x7ff8040b3230 2024-04-25T09:12:36.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.509+0000 7ff802a00640 1 --2- 172.21.15.175:0/1763894695 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff8040b3d20 0x7ff8040b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:36.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.513+0000 7ff803400640 1 --2- 172.21.15.175:0/1763894695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8040b3230 0x7ff8040b2660 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4009e50 tx=0x7ff7f401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376ccf0fb369c6c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:36.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.513+0000 7ff802000640 1 -- 172.21.15.175:0/1763894695 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f40a56e0 con 0x7ff8040b3230 2024-04-25T09:12:36.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.513+0000 7ff802000640 1 -- 172.21.15.175:0/1763894695 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f40a5880 con 0x7ff8040b3230 2024-04-25T09:12:36.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.513+0000 7ff802000640 1 -- 172.21.15.175:0/1763894695 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f40a5c50 con 0x7ff8040b3230 2024-04-25T09:12:36.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.513+0000 7ff80a200640 1 -- 172.21.15.175:0/1763894695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8040b3230 msgr2=0x7ff8040b2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:36.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.513+0000 7ff80a200640 1 --2- 172.21.15.175:0/1763894695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8040b3230 0x7ff8040b2660 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4009e50 tx=0x7ff7f401ca30 comp rx=0 tx=0).stop 2024-04-25T09:12:36.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.513+0000 7ff80a200640 1 -- 172.21.15.175:0/1763894695 shutdown_connections 2024-04-25T09:12:36.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.513+0000 7ff80a200640 1 --2- 172.21.15.175:0/1763894695 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff8040b3d20 0x7ff8040b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.513+0000 7ff80a200640 1 --2- 172.21.15.175:0/1763894695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8040b3230 0x7ff8040b2660 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.513+0000 7ff80a200640 1 -- 172.21.15.175:0/1763894695 >> 172.21.15.175:0/1763894695 conn(0x7ff80406ac50 msgr2=0x7ff80406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:36.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.513+0000 7ff80a200640 1 -- 172.21.15.175:0/1763894695 shutdown_connections 2024-04-25T09:12:36.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.513+0000 7ff80a200640 1 -- 172.21.15.175:0/1763894695 wait complete. 2024-04-25T09:12:36.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff80a200640 1 Processor -- start 2024-04-25T09:12:36.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff80a200640 1 -- start start 2024-04-25T09:12:36.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff80a200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8040712d0 0x7ff80414dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:36.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff80a200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff8040b3230 0x7ff80414e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:36.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff80a200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8040b3d20 0x7ff804153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:36.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff80a200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80415b710 con 0x7ff8040712d0 2024-04-25T09:12:36.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff80a200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80415b590 con 0x7ff8040b3d20 2024-04-25T09:12:36.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff80a200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8040b3610 con 0x7ff8040b3230 2024-04-25T09:12:36.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff803400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8040712d0 0x7ff80414dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:36.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff803400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8040712d0 0x7ff80414dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43760/0 (socket says 172.21.15.175:43760) 2024-04-25T09:12:36.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff803400640 1 -- 172.21.15.175:0/2242719415 learned_addr learned my addr 172.21.15.175:0/2242719415 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:36.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff802a00640 1 --2- 172.21.15.175:0/2242719415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff8040b3230 0x7ff80414e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:36.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff803e00640 1 --2- 172.21.15.175:0/2242719415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8040b3d20 0x7ff804153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:36.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff803400640 1 -- 172.21.15.175:0/2242719415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff8040b3230 msgr2=0x7ff80414e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:36.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff803400640 1 --2- 172.21.15.175:0/2242719415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff8040b3230 0x7ff80414e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff803400640 1 -- 172.21.15.175:0/2242719415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8040b3d20 msgr2=0x7ff804153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:36.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff803400640 1 --2- 172.21.15.175:0/2242719415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8040b3d20 0x7ff804153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff803400640 1 -- 172.21.15.175:0/2242719415 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8041571e0 con 0x7ff8040712d0 2024-04-25T09:12:36.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff802a00640 1 --2- 172.21.15.175:0/2242719415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff8040b3230 0x7ff80414e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:36.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff803400640 1 --2- 172.21.15.175:0/2242719415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8040712d0 0x7ff80414dab0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7ff7f401a660 tx=0x7ff7f40197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:36.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff7fb400640 1 -- 172.21.15.175:0/2242719415 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f40bc020 con 0x7ff8040712d0 2024-04-25T09:12:36.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff7fb400640 1 -- 172.21.15.175:0/2242719415 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f40b8670 con 0x7ff8040712d0 2024-04-25T09:12:36.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff80a200640 1 -- 172.21.15.175:0/2242719415 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8041574c0 con 0x7ff8040712d0 2024-04-25T09:12:36.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff7fb400640 1 -- 172.21.15.175:0/2242719415 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4009510 con 0x7ff8040712d0 2024-04-25T09:12:36.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.517+0000 7ff80a200640 1 -- 172.21.15.175:0/2242719415 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80414e590 con 0x7ff8040712d0 2024-04-25T09:12:36.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.521+0000 7ff80a200640 1 -- 172.21.15.175:0/2242719415 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff804075160 con 0x7ff8040712d0 2024-04-25T09:12:36.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.521+0000 7ff7fb400640 1 -- 172.21.15.175:0/2242719415 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff7f40bf020 con 0x7ff8040712d0 2024-04-25T09:12:36.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.521+0000 7ff7fb400640 1 --2- 172.21.15.175:0/2242719415 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7e4066f60 0x7ff7e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:36.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.521+0000 7ff7fb400640 1 -- 172.21.15.175:0/2242719415 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7f4120060 con 0x7ff8040712d0 2024-04-25T09:12:36.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.521+0000 7ff802a00640 1 --2- 172.21.15.175:0/2242719415 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7e4066f60 0x7ff7e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:36.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.521+0000 7ff802a00640 1 --2- 172.21.15.175:0/2242719415 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7e4066f60 0x7ff7e4069420 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff804154a20 tx=0x7ff7f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:36.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.525+0000 7ff7fb400640 1 -- 172.21.15.175:0/2242719415 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff7f40c6030 con 0x7ff8040712d0 2024-04-25T09:12:36.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.677+0000 7ff80a200640 1 -- 172.21.15.175:0/2242719415 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff804072370 con 0x7ff8040712d0 2024-04-25T09:12:36.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.677+0000 7ff7fb400640 1 -- 172.21.15.175:0/2242719415 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v100) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff7f4016620 con 0x7ff8040712d0 2024-04-25T09:12:36.665 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:12:36.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.681+0000 7ff80a200640 1 -- 172.21.15.175:0/2242719415 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7e4066f60 msgr2=0x7ff7e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:36.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.681+0000 7ff80a200640 1 --2- 172.21.15.175:0/2242719415 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7e4066f60 0x7ff7e4069420 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7ff804154a20 tx=0x7ff7f0008040 comp rx=0 tx=0).stop 2024-04-25T09:12:36.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.681+0000 7ff80a200640 1 -- 172.21.15.175:0/2242719415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8040712d0 msgr2=0x7ff80414dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:36.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.681+0000 7ff80a200640 1 --2- 172.21.15.175:0/2242719415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8040712d0 0x7ff80414dab0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7ff7f401a660 tx=0x7ff7f40197d0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.681+0000 7ff80a200640 1 -- 172.21.15.175:0/2242719415 shutdown_connections 2024-04-25T09:12:36.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.681+0000 7ff80a200640 1 --2- 172.21.15.175:0/2242719415 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7e4066f60 0x7ff7e4069420 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.681+0000 7ff80a200640 1 --2- 172.21.15.175:0/2242719415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8040b3d20 0x7ff804153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.681+0000 7ff80a200640 1 --2- 172.21.15.175:0/2242719415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff8040b3230 0x7ff80414e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.681+0000 7ff80a200640 1 --2- 172.21.15.175:0/2242719415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff8040712d0 0x7ff80414dab0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.681+0000 7ff80a200640 1 -- 172.21.15.175:0/2242719415 >> 172.21.15.175:0/2242719415 conn(0x7ff80406ac50 msgr2=0x7ff8040b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:36.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.681+0000 7ff80a200640 1 -- 172.21.15.175:0/2242719415 shutdown_connections 2024-04-25T09:12:36.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.681+0000 7ff80a200640 1 -- 172.21.15.175:0/2242719415 wait complete. 2024-04-25T09:12:36.686 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:12:36.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.837+0000 7fb9a3200640 1 Processor -- start 2024-04-25T09:12:36.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.837+0000 7fb9a3200640 1 -- start start 2024-04-25T09:12:36.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.841+0000 7fb9a3200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a409a090 0x7fb9a406c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:36.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.841+0000 7fb9a3200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb9a40b27c0 0x7fb9a415d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:36.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.841+0000 7fb9a3200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a406cef0 con 0x7fb9a4099cb0 2024-04-25T09:12:36.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.841+0000 7fb9a3200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a40cf8b0 con 0x7fb9a40b27c0 2024-04-25T09:12:36.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.841+0000 7fb9a3200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a406ccb0 con 0x7fb9a409a090 2024-04-25T09:12:36.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.841+0000 7fb9a1e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb9a4099cb0 0x7fb9a40cbcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38042/0 (socket says 172.21.15.175:38042) 2024-04-25T09:12:36.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.841+0000 7fb9a1e00640 1 -- 172.21.15.175:0/455286472 learned_addr learned my addr 172.21.15.175:0/455286472 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:36.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.841+0000 7fb9a2800640 1 --2- 172.21.15.175:0/455286472 >> v2:172.21.15.177:3300/0 conn(0x7fb9a40b27c0 0x7fb9a415d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:36.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.841+0000 7fb999400640 1 --2- 172.21.15.175:0/455286472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a409a090 0x7fb9a406c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:36.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.841+0000 7fb9a1400640 1 -- 172.21.15.175:0/455286472 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576877686 0 0) 0x7fb9a406cef0 con 0x7fb9a4099cb0 2024-04-25T09:12:36.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.841+0000 7fb9a1400640 1 -- 172.21.15.175:0/455286472 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb988003530 con 0x7fb9a4099cb0 2024-04-25T09:12:36.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.841+0000 7fb9a1400640 1 -- 172.21.15.175:0/455286472 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1018319665 0 0) 0x7fb988003530 con 0x7fb9a4099cb0 2024-04-25T09:12:36.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.841+0000 7fb999400640 1 -- 172.21.15.175:0/455286472 >> v2:172.21.15.177:3300/0 conn(0x7fb9a40b27c0 msgr2=0x7fb9a415d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:36.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.841+0000 7fb999400640 1 --2- 172.21.15.175:0/455286472 >> v2:172.21.15.177:3300/0 conn(0x7fb9a40b27c0 0x7fb9a415d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.841+0000 7fb999400640 1 -- 172.21.15.175:0/455286472 >> v1:172.21.15.175:6789/0 conn(0x7fb9a4099cb0 legacy=0x7fb9a40cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:36.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.841+0000 7fb999400640 1 -- 172.21.15.175:0/455286472 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a40cfae0 con 0x7fb9a409a090 2024-04-25T09:12:36.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.841+0000 7fb9a2800640 1 --2- 172.21.15.175:0/455286472 >> v2:172.21.15.177:3300/0 conn(0x7fb9a40b27c0 0x7fb9a415d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:36.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.845+0000 7fb999400640 1 --2- 172.21.15.175:0/455286472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a409a090 0x7fb9a406c770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0097c0 tx=0x7fb98c01c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0b8329d77284e8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:36.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.845+0000 7fb9a1400640 1 -- 172.21.15.175:0/455286472 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c0b0070 con 0x7fb9a409a090 2024-04-25T09:12:36.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.845+0000 7fb9a1400640 1 -- 172.21.15.175:0/455286472 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98c0ab400 con 0x7fb9a409a090 2024-04-25T09:12:36.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.845+0000 7fb9a1400640 1 -- 172.21.15.175:0/455286472 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb994001680 con 0x7fb9a409a090 2024-04-25T09:12:36.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.845+0000 7fb9a3200640 1 -- 172.21.15.175:0/455286472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a409a090 msgr2=0x7fb9a406c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:36.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.845+0000 7fb9a3200640 1 --2- 172.21.15.175:0/455286472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a409a090 0x7fb9a406c770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0097c0 tx=0x7fb98c01c330 comp rx=0 tx=0).stop 2024-04-25T09:12:36.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.845+0000 7fb9a3200640 1 -- 172.21.15.175:0/455286472 shutdown_connections 2024-04-25T09:12:36.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.845+0000 7fb9a3200640 1 --2- 172.21.15.175:0/455286472 >> v2:172.21.15.177:3300/0 conn(0x7fb9a40b27c0 0x7fb9a415d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.845+0000 7fb9a3200640 1 --2- 172.21.15.175:0/455286472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a409a090 0x7fb9a406c770 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.845+0000 7fb9a3200640 1 -- 172.21.15.175:0/455286472 >> 172.21.15.175:0/455286472 conn(0x7fb9a40b3160 msgr2=0x7fb9a40b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:36.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.845+0000 7fb9a3200640 1 -- 172.21.15.175:0/455286472 shutdown_connections 2024-04-25T09:12:36.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.845+0000 7fb9a3200640 1 -- 172.21.15.175:0/455286472 wait complete. 2024-04-25T09:12:36.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.845+0000 7fb9a3200640 1 Processor -- start 2024-04-25T09:12:36.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.845+0000 7fb9a3200640 1 -- start start 2024-04-25T09:12:36.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb9a3200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a4099cb0 0x7fb9a40b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:36.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb9a3200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9a409a090 0x7fb9a4158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:36.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb9a3200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9a40b27c0 0x7fb9a4153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:36.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb9a3200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a40d0f50 con 0x7fb9a409a090 2024-04-25T09:12:36.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb9a3200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a40d0dd0 con 0x7fb9a40b27c0 2024-04-25T09:12:36.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb9a3200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a40d10d0 con 0x7fb9a4099cb0 2024-04-25T09:12:36.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb999400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9a409a090 0x7fb9a4158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:36.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb999400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9a409a090 0x7fb9a4158cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43776/0 (socket says 172.21.15.175:43776) 2024-04-25T09:12:36.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb999400640 1 -- 172.21.15.175:0/1550417719 learned_addr learned my addr 172.21.15.175:0/1550417719 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:36.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb9a1e00640 1 --2- 172.21.15.175:0/1550417719 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a4099cb0 0x7fb9a40b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:36.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb9a2800640 1 --2- 172.21.15.175:0/1550417719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9a40b27c0 0x7fb9a4153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:36.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb999400640 1 -- 172.21.15.175:0/1550417719 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a4099cb0 msgr2=0x7fb9a40b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:36.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb999400640 1 --2- 172.21.15.175:0/1550417719 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a4099cb0 0x7fb9a40b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb999400640 1 -- 172.21.15.175:0/1550417719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9a40b27c0 msgr2=0x7fb9a4153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:36.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb999400640 1 --2- 172.21.15.175:0/1550417719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9a40b27c0 0x7fb9a4153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb999400640 1 -- 172.21.15.175:0/1550417719 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a415b300 con 0x7fb9a409a090 2024-04-25T09:12:36.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb999400640 1 --2- 172.21.15.175:0/1550417719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9a409a090 0x7fb9a4158cd0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fb98c01a9e0 tx=0x7fb98c0190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:36.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb99aa00640 1 -- 172.21.15.175:0/1550417719 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c0b0040 con 0x7fb9a409a090 2024-04-25T09:12:36.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb99aa00640 1 -- 172.21.15.175:0/1550417719 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98c0b9070 con 0x7fb9a409a090 2024-04-25T09:12:36.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb99aa00640 1 -- 172.21.15.175:0/1550417719 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c0b4890 con 0x7fb9a409a090 2024-04-25T09:12:36.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb9a3200640 1 -- 172.21.15.175:0/1550417719 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a415b5e0 con 0x7fb9a409a090 2024-04-25T09:12:36.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb9a3200640 1 -- 172.21.15.175:0/1550417719 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a415bba0 con 0x7fb9a409a090 2024-04-25T09:12:36.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb9a3200640 1 -- 172.21.15.175:0/1550417719 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a4074a60 con 0x7fb9a409a090 2024-04-25T09:12:36.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.849+0000 7fb99aa00640 1 -- 172.21.15.175:0/1550417719 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb98c0b4a30 con 0x7fb9a409a090 2024-04-25T09:12:36.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.853+0000 7fb99aa00640 1 --2- 172.21.15.175:0/1550417719 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb980066f60 0x7fb980069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:36.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.853+0000 7fb99aa00640 1 -- 172.21.15.175:0/1550417719 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb98c11efe0 con 0x7fb9a409a090 2024-04-25T09:12:36.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.853+0000 7fb9a1e00640 1 --2- 172.21.15.175:0/1550417719 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb980066f60 0x7fb980069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:36.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.853+0000 7fb9a1e00640 1 --2- 172.21.15.175:0/1550417719 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb980066f60 0x7fb980069420 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb994007950 tx=0x7fb994009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:36.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:36.857+0000 7fb99aa00640 1 -- 172.21.15.175:0/1550417719 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb98c015fb0 con 0x7fb9a409a090 2024-04-25T09:12:36.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.009+0000 7fb9a3200640 1 -- 172.21.15.175:0/1550417719 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9a40b3f70 con 0x7fb9a409a090 2024-04-25T09:12:36.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.009+0000 7fb99aa00640 1 -- 172.21.15.175:0/1550417719 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v100) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb98c0f0040 con 0x7fb9a409a090 2024-04-25T09:12:36.996 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:12:36.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.013+0000 7fb9a3200640 1 -- 172.21.15.175:0/1550417719 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb980066f60 msgr2=0x7fb980069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:36.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.013+0000 7fb9a3200640 1 --2- 172.21.15.175:0/1550417719 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb980066f60 0x7fb980069420 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb994007950 tx=0x7fb994009040 comp rx=0 tx=0).stop 2024-04-25T09:12:36.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.013+0000 7fb9a3200640 1 -- 172.21.15.175:0/1550417719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9a409a090 msgr2=0x7fb9a4158cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:36.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.013+0000 7fb9a3200640 1 --2- 172.21.15.175:0/1550417719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9a409a090 0x7fb9a4158cd0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fb98c01a9e0 tx=0x7fb98c0190d0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.013+0000 7fb9a3200640 1 -- 172.21.15.175:0/1550417719 shutdown_connections 2024-04-25T09:12:36.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.013+0000 7fb9a3200640 1 --2- 172.21.15.175:0/1550417719 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb980066f60 0x7fb980069420 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.013+0000 7fb9a3200640 1 --2- 172.21.15.175:0/1550417719 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9a40b27c0 0x7fb9a4153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.013+0000 7fb9a3200640 1 --2- 172.21.15.175:0/1550417719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb9a409a090 0x7fb9a4158cd0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.013+0000 7fb9a3200640 1 --2- 172.21.15.175:0/1550417719 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a4099cb0 0x7fb9a40b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:36.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.013+0000 7fb9a3200640 1 -- 172.21.15.175:0/1550417719 >> 172.21.15.175:0/1550417719 conn(0x7fb9a40b3160 msgr2=0x7fb9a415a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:36.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.013+0000 7fb9a3200640 1 -- 172.21.15.175:0/1550417719 shutdown_connections 2024-04-25T09:12:36.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.013+0000 7fb9a3200640 1 -- 172.21.15.175:0/1550417719 wait complete. 2024-04-25T09:12:37.018 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:12:37.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.169+0000 7f0af3000640 1 Processor -- start 2024-04-25T09:12:37.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.169+0000 7f0af3000640 1 -- start start 2024-04-25T09:12:37.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.169+0000 7f0af3000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0aec0cbe60 0x7f0aec15af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.173+0000 7f0af3000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0aec0b4800 0x7f0aec15c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.173+0000 7f0af3000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aec06db60 con 0x7f0aec06d310 2024-04-25T09:12:37.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.173+0000 7f0af3000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aec06de40 con 0x7f0aec0b4800 2024-04-25T09:12:37.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.173+0000 7f0af3000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aec06e120 con 0x7f0aec0cbe60 2024-04-25T09:12:37.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.173+0000 7f0af1000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0aec0b4800 0x7f0aec15c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.173+0000 7f0af1000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0aec0b4800 0x7f0aec15c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43782/0 (socket says 172.21.15.175:43782) 2024-04-25T09:12:37.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.173+0000 7f0af1000640 1 -- 172.21.15.175:0/1882851626 learned_addr learned my addr 172.21.15.175:0/1882851626 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:37.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.173+0000 7f0aebe00640 1 --2- 172.21.15.175:0/1882851626 >> v2:172.21.15.177:3300/0 conn(0x7f0aec0cbe60 0x7f0aec15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.173+0000 7f0af1000640 1 -- 172.21.15.175:0/1882851626 >> v2:172.21.15.177:3300/0 conn(0x7f0aec0cbe60 msgr2=0x7f0aec15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:37.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.173+0000 7f0af1000640 1 --2- 172.21.15.175:0/1882851626 >> v2:172.21.15.177:3300/0 conn(0x7f0aec0cbe60 0x7f0aec15af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.173+0000 7f0af1000640 1 -- 172.21.15.175:0/1882851626 >> v1:172.21.15.177:6789/0 conn(0x7f0aec06d310 legacy=0x7f0aec0b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.173+0000 7f0af1000640 1 -- 172.21.15.175:0/1882851626 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec15c2f0 con 0x7f0aec0b4800 2024-04-25T09:12:37.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.173+0000 7f0af1000640 1 --2- 172.21.15.175:0/1882851626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0aec0b4800 0x7f0aec15c810 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0b4d50 tx=0x7f0ae401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44424619a5089c7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:37.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.173+0000 7f0aeaa00640 1 -- 172.21.15.175:0/1882851626 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40b0070 con 0x7f0aec0b4800 2024-04-25T09:12:37.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.173+0000 7f0aeaa00640 1 -- 172.21.15.175:0/1882851626 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae40ab600 con 0x7f0aec0b4800 2024-04-25T09:12:37.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.173+0000 7f0aeaa00640 1 -- 172.21.15.175:0/1882851626 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40ab9d0 con 0x7f0aec0b4800 2024-04-25T09:12:37.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af3000640 1 -- 172.21.15.175:0/1882851626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0aec0b4800 msgr2=0x7f0aec15c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af3000640 1 --2- 172.21.15.175:0/1882851626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0aec0b4800 0x7f0aec15c810 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0b4d50 tx=0x7f0ae401c520 comp rx=0 tx=0).stop 2024-04-25T09:12:37.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af3000640 1 -- 172.21.15.175:0/1882851626 shutdown_connections 2024-04-25T09:12:37.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af3000640 1 --2- 172.21.15.175:0/1882851626 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0aec0b4800 0x7f0aec15c810 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af3000640 1 --2- 172.21.15.175:0/1882851626 >> v2:172.21.15.177:3300/0 conn(0x7f0aec0cbe60 0x7f0aec15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af3000640 1 -- 172.21.15.175:0/1882851626 >> 172.21.15.175:0/1882851626 conn(0x7f0aec06ac50 msgr2=0x7f0aec06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:37.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af3000640 1 -- 172.21.15.175:0/1882851626 shutdown_connections 2024-04-25T09:12:37.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af3000640 1 -- 172.21.15.175:0/1882851626 wait complete. 2024-04-25T09:12:37.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af3000640 1 Processor -- start 2024-04-25T09:12:37.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af3000640 1 -- start start 2024-04-25T09:12:37.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af3000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0aec06d310 0x7f0aec155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af3000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0aec0b4800 0x7f0aec14a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af3000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0aec0cbe60 0x7f0aec150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af3000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec15d930 con 0x7f0aec0cbe60 2024-04-25T09:12:37.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af3000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec15d7b0 con 0x7f0aec06d310 2024-04-25T09:12:37.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af3000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec15dab0 con 0x7f0aec0b4800 2024-04-25T09:12:37.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af1000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0aec0cbe60 0x7f0aec150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af1000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0aec0cbe60 0x7f0aec150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43794/0 (socket says 172.21.15.175:43794) 2024-04-25T09:12:37.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0af1000640 1 -- 172.21.15.175:0/4290589778 learned_addr learned my addr 172.21.15.175:0/4290589778 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:37.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0aebe00640 1 --2- 172.21.15.175:0/4290589778 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0aec06d310 0x7f0aec155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.177+0000 7f0aeb400640 1 --2- 172.21.15.175:0/4290589778 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0aec0b4800 0x7f0aec14a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.181+0000 7f0af1000640 1 -- 172.21.15.175:0/4290589778 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0aec0b4800 msgr2=0x7f0aec14a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.181+0000 7f0af1000640 1 --2- 172.21.15.175:0/4290589778 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0aec0b4800 0x7f0aec14a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.181+0000 7f0af1000640 1 -- 172.21.15.175:0/4290589778 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0aec06d310 msgr2=0x7f0aec155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.181+0000 7f0af1000640 1 --2- 172.21.15.175:0/4290589778 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0aec06d310 0x7f0aec155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.181+0000 7f0af1000640 1 -- 172.21.15.175:0/4290589778 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec156380 con 0x7f0aec0cbe60 2024-04-25T09:12:37.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.181+0000 7f0af1000640 1 --2- 172.21.15.175:0/4290589778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0aec0cbe60 0x7f0aec150c70 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f0ae401ca00 tx=0x7f0ae40192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:37.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.181+0000 7f0ae3e00640 1 -- 172.21.15.175:0/4290589778 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40b0040 con 0x7f0aec0cbe60 2024-04-25T09:12:37.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.181+0000 7f0ae3e00640 1 -- 172.21.15.175:0/4290589778 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae40ba070 con 0x7f0aec0cbe60 2024-04-25T09:12:37.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.181+0000 7f0ae3e00640 1 -- 172.21.15.175:0/4290589778 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40b4630 con 0x7f0aec0cbe60 2024-04-25T09:12:37.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.181+0000 7f0af3000640 1 -- 172.21.15.175:0/4290589778 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aec156660 con 0x7f0aec0cbe60 2024-04-25T09:12:37.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.181+0000 7f0af3000640 1 -- 172.21.15.175:0/4290589778 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aec156c20 con 0x7f0aec0cbe60 2024-04-25T09:12:37.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.181+0000 7f0af3000640 1 -- 172.21.15.175:0/4290589778 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aec075160 con 0x7f0aec0cbe60 2024-04-25T09:12:37.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.181+0000 7f0ae3e00640 1 -- 172.21.15.175:0/4290589778 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0ae40b47d0 con 0x7f0aec0cbe60 2024-04-25T09:12:37.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.181+0000 7f0ae3e00640 1 --2- 172.21.15.175:0/4290589778 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0acc066f90 0x7f0acc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.185+0000 7f0ae3e00640 1 -- 172.21.15.175:0/4290589778 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ae411eb50 con 0x7f0aec0cbe60 2024-04-25T09:12:37.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.185+0000 7f0aebe00640 1 --2- 172.21.15.175:0/4290589778 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0acc066f90 0x7f0acc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.185+0000 7f0aebe00640 1 --2- 172.21.15.175:0/4290589778 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0acc066f90 0x7f0acc069450 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0113e0 tx=0x7f0adc00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:37.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.189+0000 7f0ae3e00640 1 -- 172.21.15.175:0/4290589778 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0ae4016110 con 0x7f0aec0cbe60 2024-04-25T09:12:37.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.341+0000 7f0af3000640 1 -- 172.21.15.175:0/4290589778 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0aec072030 con 0x7f0aec0cbe60 2024-04-25T09:12:37.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.341+0000 7f0ae3e00640 1 -- 172.21.15.175:0/4290589778 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v100) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ae40ef470 con 0x7f0aec0cbe60 2024-04-25T09:12:37.327 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:12:37.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.341+0000 7f0af3000640 1 -- 172.21.15.175:0/4290589778 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0acc066f90 msgr2=0x7f0acc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.341+0000 7f0af3000640 1 --2- 172.21.15.175:0/4290589778 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0acc066f90 0x7f0acc069450 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0113e0 tx=0x7f0adc00b040 comp rx=0 tx=0).stop 2024-04-25T09:12:37.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.341+0000 7f0af3000640 1 -- 172.21.15.175:0/4290589778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0aec0cbe60 msgr2=0x7f0aec150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.341+0000 7f0af3000640 1 --2- 172.21.15.175:0/4290589778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0aec0cbe60 0x7f0aec150c70 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f0ae401ca00 tx=0x7f0ae40192c0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.341+0000 7f0af3000640 1 -- 172.21.15.175:0/4290589778 shutdown_connections 2024-04-25T09:12:37.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.341+0000 7f0af3000640 1 --2- 172.21.15.175:0/4290589778 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0acc066f90 0x7f0acc069450 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.341+0000 7f0af3000640 1 --2- 172.21.15.175:0/4290589778 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0aec0cbe60 0x7f0aec150c70 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.341+0000 7f0af3000640 1 --2- 172.21.15.175:0/4290589778 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0aec0b4800 0x7f0aec14a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.341+0000 7f0af3000640 1 --2- 172.21.15.175:0/4290589778 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0aec06d310 0x7f0aec155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.341+0000 7f0af3000640 1 -- 172.21.15.175:0/4290589778 >> 172.21.15.175:0/4290589778 conn(0x7f0aec06ac50 msgr2=0x7f0aec0ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:37.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.341+0000 7f0af3000640 1 -- 172.21.15.175:0/4290589778 shutdown_connections 2024-04-25T09:12:37.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.341+0000 7f0af3000640 1 -- 172.21.15.175:0/4290589778 wait complete. 2024-04-25T09:12:37.348 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:12:37.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.497+0000 7f7cb4e00640 1 Processor -- start 2024-04-25T09:12:37.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.497+0000 7f7cb4e00640 1 -- start start 2024-04-25T09:12:37.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.497+0000 7f7cb4e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7cb006ac50 0x7f7cb015db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.497+0000 7f7cb4e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb00ceec0 con 0x7f7cb015e770 2024-04-25T09:12:37.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.497+0000 7f7cb4e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb00caf70 con 0x7f7cb015a200 2024-04-25T09:12:37.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.497+0000 7f7cb4e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb0067120 con 0x7f7cb006ac50 2024-04-25T09:12:37.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.497+0000 7f7cade00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7cb015e770 0x7f7cb0066a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38050/0 (socket says 172.21.15.175:38050) 2024-04-25T09:12:37.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.497+0000 7f7cade00640 1 -- 172.21.15.175:0/2423180768 learned_addr learned my addr 172.21.15.175:0/2423180768 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:37.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.497+0000 7f7cae800640 1 --2- 172.21.15.175:0/2423180768 >> v2:172.21.15.177:3300/0 conn(0x7f7cb006ac50 0x7f7cb015db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7caca00640 1 -- 172.21.15.175:0/2423180768 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371825810 0 0) 0x7f7cb00ceec0 con 0x7f7cb015e770 2024-04-25T09:12:37.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7caca00640 1 -- 172.21.15.175:0/2423180768 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c94003530 con 0x7f7cb015e770 2024-04-25T09:12:37.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7caca00640 1 -- 172.21.15.175:0/2423180768 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1996610938 0 0) 0x7f7c94003530 con 0x7f7cb015e770 2024-04-25T09:12:37.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7caca00640 1 -- 172.21.15.175:0/2423180768 >> v2:172.21.15.177:3300/0 conn(0x7f7cb006ac50 msgr2=0x7f7cb015db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:37.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7caca00640 1 --2- 172.21.15.175:0/2423180768 >> v2:172.21.15.177:3300/0 conn(0x7f7cb006ac50 0x7f7cb015db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7caca00640 1 -- 172.21.15.175:0/2423180768 >> v1:172.21.15.177:6789/0 conn(0x7f7cb015a200 legacy=0x7f7cb00ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7caca00640 1 -- 172.21.15.175:0/2423180768 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb00cb250 con 0x7f7cb015e770 2024-04-25T09:12:37.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7caca00640 1 -- 172.21.15.175:0/2423180768 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f7ca0001a00 con 0x7f7cb015e770 2024-04-25T09:12:37.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7caca00640 1 -- 172.21.15.175:0/2423180768 >> v1:172.21.15.175:6789/0 conn(0x7f7cb015e770 legacy=0x7f7cb0066a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7caca00640 1 --2- 172.21.15.175:0/2423180768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c940039c0 0x7f7c94003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7caca00640 1 --2- 172.21.15.175:0/2423180768 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c940043c0 0x7f7c94004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7caca00640 1 --2- 172.21.15.175:0/2423180768 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c94005090 0x7f7c9400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7caca00640 1 -- 172.21.15.175:0/2423180768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb0067120 con 0x7f7c940039c0 2024-04-25T09:12:37.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7caca00640 1 -- 172.21.15.175:0/2423180768 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9400bff0 con 0x7f7c940043c0 2024-04-25T09:12:37.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7caca00640 1 -- 172.21.15.175:0/2423180768 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9400e400 con 0x7f7c94005090 2024-04-25T09:12:37.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7cade00640 1 --2- 172.21.15.175:0/2423180768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c940039c0 0x7f7c94003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7cad400640 1 --2- 172.21.15.175:0/2423180768 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c940043c0 0x7f7c94004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7cae800640 1 --2- 172.21.15.175:0/2423180768 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c94005090 0x7f7c9400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7cade00640 1 -- 172.21.15.175:0/2423180768 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c94005090 msgr2=0x7f7c9400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:37.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7cade00640 1 --2- 172.21.15.175:0/2423180768 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c94005090 0x7f7c9400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7cade00640 1 -- 172.21.15.175:0/2423180768 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c940043c0 msgr2=0x7f7c94004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:37.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7cade00640 1 --2- 172.21.15.175:0/2423180768 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c940043c0 0x7f7c94004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7cade00640 1 -- 172.21.15.175:0/2423180768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c94003530 con 0x7f7c940039c0 2024-04-25T09:12:37.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.501+0000 7f7cae800640 1 -- 172.21.15.175:0/2423180768 reap_dead start 2024-04-25T09:12:37.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7cade00640 1 --2- 172.21.15.175:0/2423180768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c940039c0 0x7f7c94003da0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000a810 tx=0x7f7ca001d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa43f2cd7ce613be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:37.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7caca00640 1 -- 172.21.15.175:0/2423180768 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca000a430 con 0x7f7c940039c0 2024-04-25T09:12:37.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7caca00640 1 -- 172.21.15.175:0/2423180768 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca00ad630 con 0x7f7c940039c0 2024-04-25T09:12:37.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7caca00640 1 -- 172.21.15.175:0/2423180768 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00ada60 con 0x7f7c940039c0 2024-04-25T09:12:37.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7cb4e00640 1 -- 172.21.15.175:0/2423180768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c940039c0 msgr2=0x7f7c94003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7cb4e00640 1 --2- 172.21.15.175:0/2423180768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c940039c0 0x7f7c94003da0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f7ca000a810 tx=0x7f7ca001d2c0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7cb4e00640 1 -- 172.21.15.175:0/2423180768 shutdown_connections 2024-04-25T09:12:37.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7cb4e00640 1 --2- 172.21.15.175:0/2423180768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c940039c0 0x7f7c94003da0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7cb4e00640 1 -- 172.21.15.175:0/2423180768 >> 172.21.15.175:0/2423180768 conn(0x7f7cb00cca10 msgr2=0x7f7cb00cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:37.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7cb4e00640 1 -- 172.21.15.175:0/2423180768 shutdown_connections 2024-04-25T09:12:37.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7cb4e00640 1 -- 172.21.15.175:0/2423180768 wait complete. 2024-04-25T09:12:37.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7cb4e00640 1 Processor -- start 2024-04-25T09:12:37.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7cb4e00640 1 -- start start 2024-04-25T09:12:37.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7cb4e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c940039c0 0x7f7cb0150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7cb4e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cb006ee40 0x7f7cb006f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7cb4e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb00c5fd0 0x7f7cb00c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7cb4e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb015def0 con 0x7f7cb00c5fd0 2024-04-25T09:12:37.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7cb4e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb015dd70 con 0x7f7cb006ee40 2024-04-25T09:12:37.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7cb4e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb015e070 con 0x7f7c940039c0 2024-04-25T09:12:37.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.505+0000 7f7cae800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb00c5fd0 0x7f7cb00c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7cae800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb00c5fd0 0x7f7cb00c6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43816/0 (socket says 172.21.15.175:43816) 2024-04-25T09:12:37.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7cae800640 1 -- 172.21.15.175:0/3071411472 learned_addr learned my addr 172.21.15.175:0/3071411472 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:37.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7cad400640 1 --2- 172.21.15.175:0/3071411472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cb006ee40 0x7f7cb006f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7cade00640 1 --2- 172.21.15.175:0/3071411472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c940039c0 0x7f7cb0150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7cae800640 1 -- 172.21.15.175:0/3071411472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c940039c0 msgr2=0x7f7cb0150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7cae800640 1 --2- 172.21.15.175:0/3071411472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c940039c0 0x7f7cb0150900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7cae800640 1 -- 172.21.15.175:0/3071411472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cb006ee40 msgr2=0x7f7cb006f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7cae800640 1 --2- 172.21.15.175:0/3071411472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cb006ee40 0x7f7cb006f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7cae800640 1 -- 172.21.15.175:0/3071411472 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb00c6990 con 0x7f7cb00c5fd0 2024-04-25T09:12:37.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7cae800640 1 --2- 172.21.15.175:0/3071411472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb00c5fd0 0x7f7cb00c6450 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8011490 tx=0x7f7ca8011950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:37.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7ca6000640 1 -- 172.21.15.175:0/3071411472 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8003620 con 0x7f7cb00c5fd0 2024-04-25T09:12:37.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7ca6000640 1 -- 172.21.15.175:0/3071411472 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca801b070 con 0x7f7cb00c5fd0 2024-04-25T09:12:37.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7cb4e00640 1 -- 172.21.15.175:0/3071411472 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb00c4c90 con 0x7f7cb00c5fd0 2024-04-25T09:12:37.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7ca6000640 1 -- 172.21.15.175:0/3071411472 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8003a40 con 0x7f7cb00c5fd0 2024-04-25T09:12:37.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7cb4e00640 1 -- 172.21.15.175:0/3071411472 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb00c5250 con 0x7f7cb00c5fd0 2024-04-25T09:12:37.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7cb4e00640 1 -- 172.21.15.175:0/3071411472 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb0075160 con 0x7f7cb00c5fd0 2024-04-25T09:12:37.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7ca6000640 1 -- 172.21.15.175:0/3071411472 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7ca8003be0 con 0x7f7cb00c5fd0 2024-04-25T09:12:37.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7ca6000640 1 --2- 172.21.15.175:0/3071411472 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7c90066f60 0x7f7c90069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7ca6000640 1 -- 172.21.15.175:0/3071411472 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ca8084c30 con 0x7f7cb00c5fd0 2024-04-25T09:12:37.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.509+0000 7f7cade00640 1 --2- 172.21.15.175:0/3071411472 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7c90066f60 0x7f7c90069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.513+0000 7f7cade00640 1 --2- 172.21.15.175:0/3071411472 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7c90066f60 0x7f7c90069420 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00ad000 tx=0x7f7ca00af040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:37.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.513+0000 7f7ca6000640 1 -- 172.21.15.175:0/3071411472 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7ca8024020 con 0x7f7cb00c5fd0 2024-04-25T09:12:37.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.681+0000 7f7cb4e00640 1 -- 172.21.15.175:0/3071411472 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7cb006dee0 con 0x7f7cb00c5fd0 2024-04-25T09:12:37.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.681+0000 7f7ca6000640 1 -- 172.21.15.175:0/3071411472 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v100) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7ca8055550 con 0x7f7cb00c5fd0 2024-04-25T09:12:37.667 INFO:teuthology.orchestra.run.smithi175.stderr:listed 0 entries 2024-04-25T09:12:37.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.681+0000 7f7cb4e00640 1 -- 172.21.15.175:0/3071411472 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7c90066f60 msgr2=0x7f7c90069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.681+0000 7f7cb4e00640 1 --2- 172.21.15.175:0/3071411472 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7c90066f60 0x7f7c90069420 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7ca00ad000 tx=0x7f7ca00af040 comp rx=0 tx=0).stop 2024-04-25T09:12:37.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.681+0000 7f7cb4e00640 1 -- 172.21.15.175:0/3071411472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb00c5fd0 msgr2=0x7f7cb00c6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.681+0000 7f7cb4e00640 1 --2- 172.21.15.175:0/3071411472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb00c5fd0 0x7f7cb00c6450 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8011490 tx=0x7f7ca8011950 comp rx=0 tx=0).stop 2024-04-25T09:12:37.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.681+0000 7f7cb4e00640 1 -- 172.21.15.175:0/3071411472 shutdown_connections 2024-04-25T09:12:37.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.681+0000 7f7cb4e00640 1 --2- 172.21.15.175:0/3071411472 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7c90066f60 0x7f7c90069420 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.681+0000 7f7cb4e00640 1 --2- 172.21.15.175:0/3071411472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cb00c5fd0 0x7f7cb00c6450 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.681+0000 7f7cb4e00640 1 --2- 172.21.15.175:0/3071411472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7cb006ee40 0x7f7cb006f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.681+0000 7f7cb4e00640 1 --2- 172.21.15.175:0/3071411472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c940039c0 0x7f7cb0150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.681+0000 7f7cb4e00640 1 -- 172.21.15.175:0/3071411472 >> 172.21.15.175:0/3071411472 conn(0x7f7cb00cca10 msgr2=0x7f7cb0157de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:37.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.681+0000 7f7cb4e00640 1 -- 172.21.15.175:0/3071411472 shutdown_connections 2024-04-25T09:12:37.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.681+0000 7f7cb4e00640 1 -- 172.21.15.175:0/3071411472 wait complete. 2024-04-25T09:12:37.688 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:12:37.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:37.688 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:12:37.741 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:12:37.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:37.741 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:12:37.768 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:37.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.961+0000 7f7de8000640 1 Processor -- start 2024-04-25T09:12:37.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.961+0000 7f7de8000640 1 -- start start 2024-04-25T09:12:37.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.961+0000 7f7de8000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7de00b5b70 0x7f7de00d3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.961+0000 7f7de8000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7de00b9570 0x7f7de00d1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.961+0000 7f7de8000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de00d23f0 con 0x7f7de015dac0 2024-04-25T09:12:37.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.961+0000 7f7de8000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de00b9a00 con 0x7f7de00b5b70 2024-04-25T09:12:37.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.961+0000 7f7de8000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de00d3000 con 0x7f7de00b9570 2024-04-25T09:12:37.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.961+0000 7f7de4c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7de00b5b70 0x7f7de00d3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.961+0000 7f7de4c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7de00b5b70 0x7f7de00d3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43820/0 (socket says 172.21.15.175:43820) 2024-04-25T09:12:37.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.961+0000 7f7de4c00640 1 -- 172.21.15.175:0/2929383874 learned_addr learned my addr 172.21.15.175:0/2929383874 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:37.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.961+0000 7f7de4c00640 1 -- 172.21.15.175:0/2929383874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7de00b9570 msgr2=0x7f7de00d1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:37.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.961+0000 7f7de4c00640 1 --2- 172.21.15.175:0/2929383874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7de00b9570 0x7f7de00d1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.961+0000 7f7de4c00640 1 -- 172.21.15.175:0/2929383874 >> v1:172.21.15.177:6789/0 conn(0x7f7de015dac0 legacy=0x7f7de00b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:37.949 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.961+0000 7f7de4c00640 1 -- 172.21.15.175:0/2929383874 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de00d26d0 con 0x7f7de00b5b70 2024-04-25T09:12:37.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.965+0000 7f7de4c00640 1 --2- 172.21.15.175:0/2929383874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de00b5b70 0x7f7de00d3490 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc009870 tx=0x7f7dcc01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c2e89ce762ae14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:37.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.965+0000 7f7ddfe00640 1 -- 172.21.15.175:0/2929383874 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0b5070 con 0x7f7de00b5b70 2024-04-25T09:12:37.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.965+0000 7f7ddfe00640 1 -- 172.21.15.175:0/2929383874 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc0a89d0 con 0x7f7de00b5b70 2024-04-25T09:12:37.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.965+0000 7f7ddfe00640 1 -- 172.21.15.175:0/2929383874 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0a8da0 con 0x7f7de00b5b70 2024-04-25T09:12:37.952 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.965+0000 7f7de8000640 1 -- 172.21.15.175:0/2929383874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de00b5b70 msgr2=0x7f7de00d3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.965+0000 7f7de8000640 1 --2- 172.21.15.175:0/2929383874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de00b5b70 0x7f7de00d3490 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc009870 tx=0x7f7dcc01ed10 comp rx=0 tx=0).stop 2024-04-25T09:12:37.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.965+0000 7f7de8000640 1 -- 172.21.15.175:0/2929383874 shutdown_connections 2024-04-25T09:12:37.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.965+0000 7f7de8000640 1 --2- 172.21.15.175:0/2929383874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7de00b9570 0x7f7de00d1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.965+0000 7f7de8000640 1 --2- 172.21.15.175:0/2929383874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de00b5b70 0x7f7de00d3490 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.965+0000 7f7de8000640 1 -- 172.21.15.175:0/2929383874 >> 172.21.15.175:0/2929383874 conn(0x7f7de0072980 msgr2=0x7f7de00d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:37.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.965+0000 7f7de8000640 1 -- 172.21.15.175:0/2929383874 shutdown_connections 2024-04-25T09:12:37.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.965+0000 7f7de8000640 1 -- 172.21.15.175:0/2929383874 wait complete. 2024-04-25T09:12:37.953 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.965+0000 7f7de8000640 1 Processor -- start 2024-04-25T09:12:37.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.965+0000 7f7de8000640 1 -- start start 2024-04-25T09:12:37.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de8000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de00b5b70 0x7f7de0159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de8000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7de00b9570 0x7f7de00ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de8000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7de015dac0 0x7f7de015ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de8000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de015dea0 con 0x7f7de00b5b70 2024-04-25T09:12:37.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de8000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de00d2c90 con 0x7f7de00b9570 2024-04-25T09:12:37.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de8000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de00b69a0 con 0x7f7de015dac0 2024-04-25T09:12:37.955 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de5600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de00b5b70 0x7f7de0159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de5600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de00b5b70 0x7f7de0159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43832/0 (socket says 172.21.15.175:43832) 2024-04-25T09:12:37.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de5600640 1 -- 172.21.15.175:0/790768148 learned_addr learned my addr 172.21.15.175:0/790768148 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:37.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de4c00640 1 --2- 172.21.15.175:0/790768148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7de00b9570 0x7f7de00ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de6000640 1 --2- 172.21.15.175:0/790768148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7de015dac0 0x7f7de015ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de5600640 1 -- 172.21.15.175:0/790768148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7de015dac0 msgr2=0x7f7de015ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de5600640 1 --2- 172.21.15.175:0/790768148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7de015dac0 0x7f7de015ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de5600640 1 -- 172.21.15.175:0/790768148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7de00b9570 msgr2=0x7f7de00ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:37.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de5600640 1 --2- 172.21.15.175:0/790768148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7de00b9570 0x7f7de00ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:37.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de5600640 1 -- 172.21.15.175:0/790768148 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de00cd920 con 0x7f7de00b5b70 2024-04-25T09:12:37.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de5600640 1 --2- 172.21.15.175:0/790768148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de00b5b70 0x7f7de0159dc0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400b410 tx=0x7f7dd400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:37.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7ddd600640 1 -- 172.21.15.175:0/790768148 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4015030 con 0x7f7de00b5b70 2024-04-25T09:12:37.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7ddd600640 1 -- 172.21.15.175:0/790768148 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd4004020 con 0x7f7de00b5b70 2024-04-25T09:12:37.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7ddd600640 1 -- 172.21.15.175:0/790768148 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4004450 con 0x7f7de00b5b70 2024-04-25T09:12:37.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de8000640 1 -- 172.21.15.175:0/790768148 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de015e0c0 con 0x7f7de00b5b70 2024-04-25T09:12:37.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de8000640 1 -- 172.21.15.175:0/790768148 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de015e960 con 0x7f7de00b5b70 2024-04-25T09:12:37.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.969+0000 7f7de8000640 1 -- 172.21.15.175:0/790768148 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de015e290 con 0x7f7de00b5b70 2024-04-25T09:12:37.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.973+0000 7f7ddd600640 1 -- 172.21.15.175:0/790768148 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7dd4018070 con 0x7f7de00b5b70 2024-04-25T09:12:37.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.973+0000 7f7ddd600640 1 --2- 172.21.15.175:0/790768148 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7dc0066f60 0x7f7dc0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:37.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.973+0000 7f7ddd600640 1 -- 172.21.15.175:0/790768148 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dd4084b60 con 0x7f7de00b5b70 2024-04-25T09:12:37.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.973+0000 7f7de4c00640 1 --2- 172.21.15.175:0/790768148 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7dc0066f60 0x7f7dc0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:37.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.973+0000 7f7de4c00640 1 --2- 172.21.15.175:0/790768148 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7dc0066f60 0x7f7dc0069420 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0b2000 tx=0x7f7dcc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:37.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:37.977+0000 7f7ddd600640 1 -- 172.21.15.175:0/790768148 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7dd4055480 con 0x7f7de00b5b70 2024-04-25T09:12:38.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.165+0000 7f7de8000640 1 -- 172.21.15.175:0/790768148 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7de0074a60 con 0x7f7de00b5b70 2024-04-25T09:12:38.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.165+0000 7f7ddd600640 1 -- 172.21.15.175:0/790768148 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f7dd4059520 con 0x7f7de00b5b70 2024-04-25T09:12:38.153 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:38.153 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":78,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6998,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3519467288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3519467288},{"type":"v1","addr":"172.21.15.177:6834","nonce":3519467288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2181426238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2181426238},{"type":"v1","addr":"172.21.15.177:6835","nonce":2181426238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/936884340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":936884340},{"type":"v1","addr":"172.21.15.175:6836","nonce":936884340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:23.414911+0000","modified":"2024-04-25T09:12:26.444040+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8067},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8067":{"gid":8067,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/3952378765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":3952378765},{"type":"v1","addr":"172.21.15.175:6837","nonce":3952378765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:12:38.153 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 78 2024-04-25T09:12:38.155 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.169+0000 7f7de8000640 1 -- 172.21.15.175:0/790768148 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7dc0066f60 msgr2=0x7f7dc0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.169+0000 7f7de8000640 1 --2- 172.21.15.175:0/790768148 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7dc0066f60 0x7f7dc0069420 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0b2000 tx=0x7f7dcc008040 comp rx=0 tx=0).stop 2024-04-25T09:12:38.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.169+0000 7f7de8000640 1 -- 172.21.15.175:0/790768148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de00b5b70 msgr2=0x7f7de0159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.169+0000 7f7de8000640 1 --2- 172.21.15.175:0/790768148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de00b5b70 0x7f7de0159dc0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400b410 tx=0x7f7dd400b8d0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.169+0000 7f7de8000640 1 -- 172.21.15.175:0/790768148 shutdown_connections 2024-04-25T09:12:38.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.169+0000 7f7de8000640 1 --2- 172.21.15.175:0/790768148 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7dc0066f60 0x7f7dc0069420 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.169+0000 7f7de8000640 1 --2- 172.21.15.175:0/790768148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7de015dac0 0x7f7de015ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.169+0000 7f7de8000640 1 --2- 172.21.15.175:0/790768148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7de00b9570 0x7f7de00ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.169+0000 7f7de8000640 1 --2- 172.21.15.175:0/790768148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de00b5b70 0x7f7de0159dc0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.169+0000 7f7de8000640 1 -- 172.21.15.175:0/790768148 >> 172.21.15.175:0/790768148 conn(0x7f7de0072980 msgr2=0x7f7de00c7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.169+0000 7f7de8000640 1 -- 172.21.15.175:0/790768148 shutdown_connections 2024-04-25T09:12:38.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.169+0000 7f7de8000640 1 -- 172.21.15.175:0/790768148 wait complete. 2024-04-25T09:12:38.174 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T09:12:38.340 INFO:teuthology.orchestra.run.smithi175.stdout:{"message":"","return_code":0} 2024-04-25T09:12:38.340 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:12:38.340 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:12:38.341 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:38.349 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:12:38.349 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:12:38.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:38.349 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:12:38.400 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-25T09:12:38.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:12:38.401 DEBUG:teuthology.orchestra.run.smithi175:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-25T09:12:38.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:38.452 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-04-25T09:12:38.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.605+0000 7fdba2200640 1 Processor -- start 2024-04-25T09:12:38.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdba2200640 1 -- start start 2024-04-25T09:12:38.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdba2200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdb9c15bab0 0x7fdb9c0cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdba2200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c06b360 0x7fdb9c0ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdba2200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9c0b1db0 con 0x7fdb9c0b13d0 2024-04-25T09:12:38.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdba2200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9c15be90 con 0x7fdb9c15bab0 2024-04-25T09:12:38.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdba2200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0b2090 con 0x7fdb9c06b360 2024-04-25T09:12:38.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb93e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fdb9c0b13d0 0x7fdb9c06ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38060/0 (socket says 172.21.15.175:38060) 2024-04-25T09:12:38.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb93e00640 1 -- 172.21.15.175:0/2108194180 learned_addr learned my addr 172.21.15.175:0/2108194180 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:38.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9b400640 1 --2- 172.21.15.175:0/2108194180 >> v2:172.21.15.177:3300/0 conn(0x7fdb9c15bab0 0x7fdb9c0cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9be00640 1 --2- 172.21.15.175:0/2108194180 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c06b360 0x7fdb9c0ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9aa00640 1 -- 172.21.15.175:0/2108194180 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918426571 0 0) 0x7fdb9c0b1db0 con 0x7fdb9c0b13d0 2024-04-25T09:12:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9aa00640 1 -- 172.21.15.175:0/2108194180 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb80003530 con 0x7fdb9c0b13d0 2024-04-25T09:12:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9aa00640 1 -- 172.21.15.175:0/2108194180 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2119447297 0 0) 0x7fdb80003530 con 0x7fdb9c0b13d0 2024-04-25T09:12:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9aa00640 1 -- 172.21.15.175:0/2108194180 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c06b360 msgr2=0x7fdb9c0ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9aa00640 1 --2- 172.21.15.175:0/2108194180 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c06b360 0x7fdb9c0ad4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9aa00640 1 -- 172.21.15.175:0/2108194180 >> v2:172.21.15.177:3300/0 conn(0x7fdb9c15bab0 msgr2=0x7fdb9c0cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9aa00640 1 --2- 172.21.15.175:0/2108194180 >> v2:172.21.15.177:3300/0 conn(0x7fdb9c15bab0 0x7fdb9c0cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9aa00640 1 -- 172.21.15.175:0/2108194180 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c0cce00 con 0x7fdb9c0b13d0 2024-04-25T09:12:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9aa00640 1 -- 172.21.15.175:0/2108194180 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fdb84001680 con 0x7fdb9c0b13d0 2024-04-25T09:12:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9b400640 1 --2- 172.21.15.175:0/2108194180 >> v2:172.21.15.177:3300/0 conn(0x7fdb9c15bab0 0x7fdb9c0cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9aa00640 1 -- 172.21.15.175:0/2108194180 >> v1:172.21.15.175:6789/0 conn(0x7fdb9c0b13d0 legacy=0x7fdb9c06ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9aa00640 1 --2- 172.21.15.175:0/2108194180 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c06b360 0x7fdb800039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9aa00640 1 --2- 172.21.15.175:0/2108194180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb80003f40 0x7fdb80004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9aa00640 1 --2- 172.21.15.175:0/2108194180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb80004d50 0x7fdb800051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9aa00640 1 -- 172.21.15.175:0/2108194180 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c15be90 con 0x7fdb80004d50 2024-04-25T09:12:38.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9aa00640 1 -- 172.21.15.175:0/2108194180 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0b2090 con 0x7fdb80003f40 2024-04-25T09:12:38.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9aa00640 1 -- 172.21.15.175:0/2108194180 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8000ba00 con 0x7fdb9c06b360 2024-04-25T09:12:38.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9be00640 1 --2- 172.21.15.175:0/2108194180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb80004d50 0x7fdb800051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb93e00640 1 --2- 172.21.15.175:0/2108194180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb80003f40 0x7fdb80004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9b400640 1 --2- 172.21.15.175:0/2108194180 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c06b360 0x7fdb800039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9be00640 1 -- 172.21.15.175:0/2108194180 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c06b360 msgr2=0x7fdb800039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9be00640 1 --2- 172.21.15.175:0/2108194180 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb9c06b360 0x7fdb800039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9be00640 1 -- 172.21.15.175:0/2108194180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb80003f40 msgr2=0x7fdb80004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9be00640 1 --2- 172.21.15.175:0/2108194180 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb80003f40 0x7fdb80004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.609+0000 7fdb9be00640 1 -- 172.21.15.175:0/2108194180 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb80003530 con 0x7fdb80004d50 2024-04-25T09:12:38.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.613+0000 7fdb9be00640 1 --2- 172.21.15.175:0/2108194180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb80004d50 0x7fdb800051d0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009fc0 tx=0x7fdb9401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd53afe48d5c4de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.613+0000 7fdb9aa00640 1 -- 172.21.15.175:0/2108194180 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb940b2070 con 0x7fdb80004d50 2024-04-25T09:12:38.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.613+0000 7fdb9aa00640 1 -- 172.21.15.175:0/2108194180 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb940a5c90 con 0x7fdb80004d50 2024-04-25T09:12:38.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.613+0000 7fdb9aa00640 1 -- 172.21.15.175:0/2108194180 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94009c10 con 0x7fdb80004d50 2024-04-25T09:12:38.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.613+0000 7fdba2200640 1 -- 172.21.15.175:0/2108194180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb80004d50 msgr2=0x7fdb800051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.613+0000 7fdba2200640 1 --2- 172.21.15.175:0/2108194180 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb80004d50 0x7fdb800051d0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009fc0 tx=0x7fdb9401cc80 comp rx=0 tx=0).stop 2024-04-25T09:12:38.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.613+0000 7fdb9be00640 1 -- 172.21.15.175:0/2108194180 reap_dead start 2024-04-25T09:12:38.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.613+0000 7fdba2200640 1 -- 172.21.15.175:0/2108194180 shutdown_connections 2024-04-25T09:12:38.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.613+0000 7fdba2200640 1 -- 172.21.15.175:0/2108194180 >> 172.21.15.175:0/2108194180 conn(0x7fdb9c0d0750 msgr2=0x7fdb9c0d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.613+0000 7fdba2200640 1 -- 172.21.15.175:0/2108194180 shutdown_connections 2024-04-25T09:12:38.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.613+0000 7fdba2200640 1 -- 172.21.15.175:0/2108194180 wait complete. 2024-04-25T09:12:38.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdba2200640 1 Processor -- start 2024-04-25T09:12:38.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdba2200640 1 -- start start 2024-04-25T09:12:38.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdba2200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb80004d50 0x7fdb9c157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdba2200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb9c0adea0 0x7fdb9c0af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdba2200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb9c0afe60 0x7fdb9c151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdba2200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0c3ec0 con 0x7fdb9c0afe60 2024-04-25T09:12:38.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdba2200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0cd3c0 con 0x7fdb9c0adea0 2024-04-25T09:12:38.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdba2200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0c4040 con 0x7fdb80004d50 2024-04-25T09:12:38.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdb9be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb9c0afe60 0x7fdb9c151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdb9be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb9c0afe60 0x7fdb9c151640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43852/0 (socket says 172.21.15.175:43852) 2024-04-25T09:12:38.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdb9be00640 1 -- 172.21.15.175:0/2924395803 learned_addr learned my addr 172.21.15.175:0/2924395803 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:38.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdb9b400640 1 --2- 172.21.15.175:0/2924395803 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb80004d50 0x7fdb9c157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdb93e00640 1 --2- 172.21.15.175:0/2924395803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb9c0adea0 0x7fdb9c0af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdb9be00640 1 -- 172.21.15.175:0/2924395803 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb80004d50 msgr2=0x7fdb9c157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdb9be00640 1 --2- 172.21.15.175:0/2924395803 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb80004d50 0x7fdb9c157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdb9be00640 1 -- 172.21.15.175:0/2924395803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb9c0adea0 msgr2=0x7fdb9c0af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdb9be00640 1 --2- 172.21.15.175:0/2924395803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb9c0adea0 0x7fdb9c0af920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdb9be00640 1 -- 172.21.15.175:0/2924395803 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c0ae880 con 0x7fdb9c0afe60 2024-04-25T09:12:38.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdb9b400640 1 --2- 172.21.15.175:0/2924395803 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb80004d50 0x7fdb9c157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:38.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdb93e00640 1 --2- 172.21.15.175:0/2924395803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb9c0adea0 0x7fdb9c0af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:38.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdb9be00640 1 --2- 172.21.15.175:0/2924395803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb9c0afe60 0x7fdb9c151640 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fdb94002240 tx=0x7fdb94009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdb93400640 1 -- 172.21.15.175:0/2924395803 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb940bd070 con 0x7fdb9c0afe60 2024-04-25T09:12:38.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdb93400640 1 -- 172.21.15.175:0/2924395803 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb940a5a90 con 0x7fdb9c0afe60 2024-04-25T09:12:38.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdb93400640 1 -- 172.21.15.175:0/2924395803 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb940b2040 con 0x7fdb9c0afe60 2024-04-25T09:12:38.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdba2200640 1 -- 172.21.15.175:0/2924395803 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9c0aeb60 con 0x7fdb9c0afe60 2024-04-25T09:12:38.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.617+0000 7fdba2200640 1 -- 172.21.15.175:0/2924395803 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9c0af120 con 0x7fdb9c0afe60 2024-04-25T09:12:38.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.621+0000 7fdb93400640 1 -- 172.21.15.175:0/2924395803 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdb940c0070 con 0x7fdb9c0afe60 2024-04-25T09:12:38.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.621+0000 7fdba5692000 1 Processor -- start 2024-04-25T09:12:38.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.621+0000 7fdba5692000 1 -- start start 2024-04-25T09:12:38.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.621+0000 7fdb93400640 1 --2- 172.21.15.175:0/2924395803 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdb78066f90 0x7fdb78069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.621+0000 7fdb93400640 1 -- 172.21.15.175:0/2924395803 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb9411efa0 con 0x7fdb9c0afe60 2024-04-25T09:12:38.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.621+0000 7fdb93e00640 1 --2- 172.21.15.175:0/2924395803 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdb78066f90 0x7fdb78069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdba5692000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837bc90 0x55c53837c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdba5692000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c53837c5b0 0x55c538331d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdba5692000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c538332290 0x55c538332670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdba5692000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c538218f40 con 0x55c53837c5b0 2024-04-25T09:12:38.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdba5692000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c538180070 con 0x55c53837bc90 2024-04-25T09:12:38.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdba5692000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c5381081a0 con 0x55c538332290 2024-04-25T09:12:38.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdb93e00640 1 --2- 172.21.15.175:0/2924395803 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdb78066f90 0x7fdb78069450 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fdb84001060 tx=0x7fdb84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdb93e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c53837c5b0 0x55c538331d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdb9b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837bc90 0x55c53837c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdb93e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c53837c5b0 0x55c538331d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43864/0 (socket says 172.21.15.175:43864) 2024-04-25T09:12:38.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdb9be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c538332290 0x55c538332670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdb93e00640 1 -- 172.21.15.175:0/1610048537 learned_addr learned my addr 172.21.15.175:0/1610048537 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:38.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdb93e00640 1 -- 172.21.15.175:0/1610048537 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c538332290 msgr2=0x55c538332670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdb93e00640 1 --2- 172.21.15.175:0/1610048537 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c538332290 0x55c538332670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdb93e00640 1 -- 172.21.15.175:0/1610048537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837bc90 msgr2=0x55c53837c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdb93e00640 1 --2- 172.21.15.175:0/1610048537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837bc90 0x55c53837c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdb93e00640 1 -- 172.21.15.175:0/1610048537 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c538106510 con 0x55c53837c5b0 2024-04-25T09:12:38.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdb93e00640 1 --2- 172.21.15.175:0/1610048537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c53837c5b0 0x55c538331d50 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fdb84004db0 tx=0x7fdb84014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a4b8e28a3d19be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdb8be00640 1 -- 172.21.15.175:0/1610048537 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb84027070 con 0x55c53837c5b0 2024-04-25T09:12:38.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdb8be00640 1 -- 172.21.15.175:0/1610048537 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb84015d80 con 0x55c53837c5b0 2024-04-25T09:12:38.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdb8be00640 1 -- 172.21.15.175:0/1610048537 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb840145d0 con 0x55c53837c5b0 2024-04-25T09:12:38.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdba5692000 1 -- 172.21.15.175:0/1610048537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c53837c5b0 msgr2=0x55c538331d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdba5692000 1 --2- 172.21.15.175:0/1610048537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c53837c5b0 0x55c538331d50 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fdb84004db0 tx=0x7fdb84014000 comp rx=0 tx=0).stop 2024-04-25T09:12:38.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdba5692000 1 -- 172.21.15.175:0/1610048537 shutdown_connections 2024-04-25T09:12:38.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdba5692000 1 --2- 172.21.15.175:0/1610048537 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c538332290 0x55c538332670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdba5692000 1 --2- 172.21.15.175:0/1610048537 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c53837c5b0 0x55c538331d50 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdba5692000 1 --2- 172.21.15.175:0/1610048537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837bc90 0x55c53837c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdba5692000 1 -- 172.21.15.175:0/1610048537 >> 172.21.15.175:0/1610048537 conn(0x55c53832e240 msgr2=0x55c538330630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdba5692000 1 -- 172.21.15.175:0/1610048537 shutdown_connections 2024-04-25T09:12:38.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdba5692000 1 -- 172.21.15.175:0/1610048537 wait complete. 2024-04-25T09:12:38.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.625+0000 7fdba5692000 1 -- start start 2024-04-25T09:12:38.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdba5692000 1 Processor -- start 2024-04-25T09:12:38.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdba5692000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c538332290 0x55c53833ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdba5692000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c53837bc90 0x55c53833d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdba5692000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837c5b0 0x55c53833d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdba5692000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c53813a6c0 con 0x55c538332290 2024-04-25T09:12:38.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdba5692000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c53817c110 con 0x55c53837c5b0 2024-04-25T09:12:38.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdba5692000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c53833b200 con 0x55c53837bc90 2024-04-25T09:12:38.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdba5692000 10 client.0 _ll_register_callbacks cb 0x55c53831d570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:38.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdb9b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c538332290 0x55c53833ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdb9b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c538332290 0x55c53833ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43866/0 (socket says 172.21.15.175:43866) 2024-04-25T09:12:38.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdb9b400640 1 -- 172.21.15.175:0/3347267748 learned_addr learned my addr 172.21.15.175:0/3347267748 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:38.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdb9be00640 1 --2- 172.21.15.175:0/3347267748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837c5b0 0x55c53833d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdb93e00640 1 --2- 172.21.15.175:0/3347267748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c53837bc90 0x55c53833d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdb9b400640 1 -- 172.21.15.175:0/3347267748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c53837bc90 msgr2=0x55c53833d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdb9b400640 1 --2- 172.21.15.175:0/3347267748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c53837bc90 0x55c53833d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdb9b400640 1 -- 172.21.15.175:0/3347267748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837c5b0 msgr2=0x55c53833d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdb9b400640 1 --2- 172.21.15.175:0/3347267748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837c5b0 0x55c53833d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdb9b400640 1 -- 172.21.15.175:0/3347267748 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c5381083b0 con 0x55c538332290 2024-04-25T09:12:38.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdb93e00640 1 --2- 172.21.15.175:0/3347267748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c53837bc90 0x55c53833d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:38.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdb9b400640 1 --2- 172.21.15.175:0/3347267748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c538332290 0x55c53833ce30 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c017b50 tx=0x7fdb8c017f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6dd8582b78f6b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdb88c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:12:38.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdb88c00640 1 -- 172.21.15.175:0/3347267748 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c024060 con 0x55c538332290 2024-04-25T09:12:38.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdb88c00640 1 -- 172.21.15.175:0/3347267748 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb8c00f040 con 0x55c538332290 2024-04-25T09:12:38.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdba5692000 1 -- 172.21.15.175:0/3347267748 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb84015d80 con 0x55c538332290 2024-04-25T09:12:38.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdb88c00640 1 -- 172.21.15.175:0/3347267748 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb8c02a050 con 0x55c538332290 2024-04-25T09:12:38.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdba5692000 10 client.8337 fetch_fsmap learned FSMap version 78 2024-04-25T09:12:38.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdba5692000 1 -- 172.21.15.175:0/3347267748 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55c538201e00 con 0x55c538332290 2024-04-25T09:12:38.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdb88c00640 1 -- 172.21.15.175:0/3347267748 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb84015d80 con 0x55c538332290 2024-04-25T09:12:38.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdb88c00640 1 -- 172.21.15.175:0/3347267748 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdb8c02d020 con 0x55c538332290 2024-04-25T09:12:38.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdba5692000 10 client.8337 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:12:38.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdba5692000 10 client.8337 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:12:38.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdba5692000 20 client.8337 populate_metadata read hostname 'smithi175' 2024-04-25T09:12:38.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdba5692000 1 --2- 172.21.15.175:0/3347267748 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55c53833e120 0x55c53838d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdba5692000 4 client.8337 mds_command: new command op to 8067 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:12:38.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.629+0000 7fdba5692000 1 -- 172.21.15.175:0/3347267748 --> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c53811bd60 con 0x55c53833e120 2024-04-25T09:12:38.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fdb93e00640 1 --2- 172.21.15.175:0/3347267748 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55c53833e120 0x55c53838d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fdb93e00640 1 --2- 172.21.15.175:0/3347267748 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55c53833e120 0x55c53838d410 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d7dfcfdbee1ddcc server_cookie=5a8986c68bb9ec58 in_seq=0 out_seq=0 2024-04-25T09:12:38.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fdb88c00640 10 client.8337 ms_handle_connect on v2:172.21.15.175:6835/3952378765 2024-04-25T09:12:38.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fdb88c00640 1 -- 172.21.15.175:0/3347267748 <== mds.0 v2:172.21.15.175:6835/3952378765 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c53811bd60 con 0x55c53833e120 2024-04-25T09:12:38.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fdb88c00640 10 client.8337 handle_command_reply: tid=0 2024-04-25T09:12:38.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fdba5692000 1 client.8337 shutdown 2024-04-25T09:12:38.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fdba5692000 1 -- 172.21.15.175:0/3347267748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c538332290 msgr2=0x55c53833ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fdba5692000 1 --2- 172.21.15.175:0/3347267748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c538332290 0x55c53833ce30 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c017b50 tx=0x7fdb8c017f50 comp rx=0 tx=0).stop 2024-04-25T09:12:38.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fdba5692000 1 -- 172.21.15.175:0/3347267748 shutdown_connections 2024-04-25T09:12:38.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fdba5692000 1 --2- 172.21.15.175:0/3347267748 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55c53833e120 0x55c53838d410 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fdba5692000 1 --2- 172.21.15.175:0/3347267748 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837c5b0 0x55c53833d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fdba5692000 1 --2- 172.21.15.175:0/3347267748 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c53837bc90 0x55c53833d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fdba5692000 1 --2- 172.21.15.175:0/3347267748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c538332290 0x55c53833ce30 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fdba5692000 1 -- 172.21.15.175:0/3347267748 >> 172.21.15.175:0/3347267748 conn(0x55c53832e240 msgr2=0x55c538330ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fdb88c00640 0 client.8337 ms_handle_reset on v2:172.21.15.175:6835/3952378765 2024-04-25T09:12:38.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fdba5692000 1 -- 172.21.15.175:0/3347267748 shutdown_connections 2024-04-25T09:12:38.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fdba5692000 1 -- 172.21.15.175:0/3347267748 wait complete. 2024-04-25T09:12:38.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fdba5692000 20 client.8337 trim_cache size 0 max 16384 2024-04-25T09:12:38.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fe286000640 1 Processor -- start 2024-04-25T09:12:38.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.633+0000 7fe286000640 1 -- start start 2024-04-25T09:12:38.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.637+0000 7fe286000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2800d1400 0x7fe280099e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.637+0000 7fe286000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe28015fb00 0x7fe28015ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.637+0000 7fe286000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2800cc6b0 con 0x7fe2800cfad0 2024-04-25T09:12:38.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.637+0000 7fe286000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2800cc990 con 0x7fe28015fb00 2024-04-25T09:12:38.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.637+0000 7fe286000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2800ccc70 con 0x7fe2800d1400 2024-04-25T09:12:38.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.637+0000 7fe27f400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe2800cfad0 0x7fe2800cfeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:41528/0 (socket says 172.21.15.175:41528) 2024-04-25T09:12:38.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.637+0000 7fe27f400640 1 -- 172.21.15.175:0/4222216318 learned_addr learned my addr 172.21.15.175:0/4222216318 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:38.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.637+0000 7fe27fe00640 1 --2- 172.21.15.175:0/4222216318 >> v2:172.21.15.177:3300/0 conn(0x7fe28015fb00 0x7fe28015ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.637+0000 7fe27ea00640 1 --2- 172.21.15.175:0/4222216318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2800d1400 0x7fe280099e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.637+0000 7fe27e000640 1 -- 172.21.15.175:0/4222216318 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275906490 0 0) 0x7fe2800cc6b0 con 0x7fe2800cfad0 2024-04-25T09:12:38.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.637+0000 7fe27e000640 1 -- 172.21.15.175:0/4222216318 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe264003530 con 0x7fe2800cfad0 2024-04-25T09:12:38.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.637+0000 7fe27ea00640 1 -- 172.21.15.175:0/4222216318 >> v2:172.21.15.177:3300/0 conn(0x7fe28015fb00 msgr2=0x7fe28015ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.637+0000 7fe27ea00640 1 --2- 172.21.15.175:0/4222216318 >> v2:172.21.15.177:3300/0 conn(0x7fe28015fb00 0x7fe28015ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.637+0000 7fe27ea00640 1 -- 172.21.15.175:0/4222216318 >> v1:172.21.15.177:6789/0 conn(0x7fe2800cfad0 legacy=0x7fe2800cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.637+0000 7fe27ea00640 1 -- 172.21.15.175:0/4222216318 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2800ccf50 con 0x7fe2800d1400 2024-04-25T09:12:38.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.637+0000 7fe27fe00640 1 --2- 172.21.15.175:0/4222216318 >> v2:172.21.15.177:3300/0 conn(0x7fe28015fb00 0x7fe28015ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:38.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.641+0000 7fe27ea00640 1 --2- 172.21.15.175:0/4222216318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2800d1400 0x7fe280099e60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0097c0 tx=0x7fe26c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd87df1b907545d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.641+0000 7fe27e000640 1 -- 172.21.15.175:0/4222216318 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c0b0070 con 0x7fe2800d1400 2024-04-25T09:12:38.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.641+0000 7fe27e000640 1 -- 172.21.15.175:0/4222216318 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26c0ab600 con 0x7fe2800d1400 2024-04-25T09:12:38.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.641+0000 7fe27e000640 1 -- 172.21.15.175:0/4222216318 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26c0ab9b0 con 0x7fe2800d1400 2024-04-25T09:12:38.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.641+0000 7fe286000640 1 -- 172.21.15.175:0/4222216318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2800d1400 msgr2=0x7fe280099e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.641+0000 7fe286000640 1 --2- 172.21.15.175:0/4222216318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2800d1400 0x7fe280099e60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0097c0 tx=0x7fe26c01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.641+0000 7fe286000640 1 -- 172.21.15.175:0/4222216318 shutdown_connections 2024-04-25T09:12:38.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.641+0000 7fe286000640 1 --2- 172.21.15.175:0/4222216318 >> v2:172.21.15.177:3300/0 conn(0x7fe28015fb00 0x7fe28015ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.641+0000 7fe286000640 1 --2- 172.21.15.175:0/4222216318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2800d1400 0x7fe280099e60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.641+0000 7fe286000640 1 -- 172.21.15.175:0/4222216318 >> 172.21.15.175:0/4222216318 conn(0x7fe280099a50 msgr2=0x7fe2800d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.641+0000 7fe286000640 1 -- 172.21.15.175:0/4222216318 shutdown_connections 2024-04-25T09:12:38.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.641+0000 7fe286000640 1 -- 172.21.15.175:0/4222216318 wait complete. 2024-04-25T09:12:38.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe286000640 1 Processor -- start 2024-04-25T09:12:38.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe286000640 1 -- start start 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe286000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2800cfad0 0x7fe28014eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe286000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2800d1400 0x7fe2801560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe286000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe28015fb00 0x7fe28014df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe286000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28015c550 con 0x7fe2800cfad0 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe286000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28015c3d0 con 0x7fe2800d1400 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe286000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28015c6d0 con 0x7fe28015fb00 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe27f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2800cfad0 0x7fe28014eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe27f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2800cfad0 0x7fe28014eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43878/0 (socket says 172.21.15.175:43878) 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe27f400640 1 -- 172.21.15.175:0/11675954 learned_addr learned my addr 172.21.15.175:0/11675954 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe27fe00640 1 --2- 172.21.15.175:0/11675954 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe28015fb00 0x7fe28014df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe27ea00640 1 --2- 172.21.15.175:0/11675954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2800d1400 0x7fe2801560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe27f400640 1 -- 172.21.15.175:0/11675954 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe28015fb00 msgr2=0x7fe28014df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe27f400640 1 --2- 172.21.15.175:0/11675954 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe28015fb00 0x7fe28014df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe27f400640 1 -- 172.21.15.175:0/11675954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2800d1400 msgr2=0x7fe2801560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe27f400640 1 --2- 172.21.15.175:0/11675954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2800d1400 0x7fe2801560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe27f400640 1 -- 172.21.15.175:0/11675954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe280070540 con 0x7fe2800cfad0 2024-04-25T09:12:38.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.645+0000 7fe27ea00640 1 --2- 172.21.15.175:0/11675954 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2800d1400 0x7fe2801560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:38.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.649+0000 7fe27f400640 1 --2- 172.21.15.175:0/11675954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe2800cfad0 0x7fe28014eb80 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fe27000c420 tx=0x7fe27000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.649+0000 7fe277400640 1 -- 172.21.15.175:0/11675954 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270017070 con 0x7fe2800cfad0 2024-04-25T09:12:38.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.649+0000 7fe277400640 1 -- 172.21.15.175:0/11675954 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe270005cf0 con 0x7fe2800cfad0 2024-04-25T09:12:38.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.649+0000 7fe286000640 1 -- 172.21.15.175:0/11675954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28006eed0 con 0x7fe2800cfad0 2024-04-25T09:12:38.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.649+0000 7fe277400640 1 -- 172.21.15.175:0/11675954 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2700072d0 con 0x7fe2800cfad0 2024-04-25T09:12:38.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.649+0000 7fe286000640 1 -- 172.21.15.175:0/11675954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2801501e0 con 0x7fe2800cfad0 2024-04-25T09:12:38.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.649+0000 7fe286000640 1 -- 172.21.15.175:0/11675954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fe28014ffd0 con 0x7fe2800cfad0 2024-04-25T09:12:38.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.649+0000 7fe277400640 1 -- 172.21.15.175:0/11675954 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe27001a070 con 0x7fe2800cfad0 2024-04-25T09:12:38.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.649+0000 7fe277400640 1 --2- 172.21.15.175:0/11675954 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe260066f90 0x7fe260069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.653+0000 7fe277400640 1 -- 172.21.15.175:0/11675954 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe270084310 con 0x7fe2800cfad0 2024-04-25T09:12:38.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.653+0000 7fe27ea00640 1 --2- 172.21.15.175:0/11675954 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe260066f90 0x7fe260069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.653+0000 7fe277400640 1 -- 172.21.15.175:0/11675954 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+511 (secure 0 0 0) 0x7fe280070540 con 0x7fe2800cfad0 2024-04-25T09:12:38.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.653+0000 7fe286000640 1 -- 172.21.15.175:0/11675954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fe280074a60 con 0x7fe2800cfad0 2024-04-25T09:12:38.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.653+0000 7fe27ea00640 1 --2- 172.21.15.175:0/11675954 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe260066f90 0x7fe260069450 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0ad000 tx=0x7fe26c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.653+0000 7fdba5692000 1 Processor -- start 2024-04-25T09:12:38.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.653+0000 7fdba5692000 1 -- start start 2024-04-25T09:12:38.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdba5692000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c538332290 0x55c53838f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdba5692000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c53837bc90 0x55c53838f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdba5692000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837c5b0 0x55c53838d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdba5692000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c2001c0 con 0x55c538332290 2024-04-25T09:12:38.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdba5692000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c1ff3a0 con 0x55c53837c5b0 2024-04-25T09:12:38.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdba5692000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c0cf8b0 con 0x55c53837bc90 2024-04-25T09:12:38.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdb9b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c538332290 0x55c53838f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdb9b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c538332290 0x55c53838f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43886/0 (socket says 172.21.15.175:43886) 2024-04-25T09:12:38.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdb9b400640 1 -- 172.21.15.175:0/2530083628 learned_addr learned my addr 172.21.15.175:0/2530083628 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:38.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdb93e00640 1 --2- 172.21.15.175:0/2530083628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c53837bc90 0x55c53838f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdb9be00640 1 --2- 172.21.15.175:0/2530083628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837c5b0 0x55c53838d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdb9b400640 1 -- 172.21.15.175:0/2530083628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c53837bc90 msgr2=0x55c53838f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdb9b400640 1 --2- 172.21.15.175:0/2530083628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c53837bc90 0x55c53838f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdb9b400640 1 -- 172.21.15.175:0/2530083628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837c5b0 msgr2=0x55c53838d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdb9b400640 1 --2- 172.21.15.175:0/2530083628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837c5b0 0x55c53838d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdb9b400640 1 -- 172.21.15.175:0/2530083628 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5381d7c50 con 0x55c538332290 2024-04-25T09:12:38.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdb9b400640 1 --2- 172.21.15.175:0/2530083628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c538332290 0x55c53838f160 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c017b20 tx=0x7fdb8c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a95da7b9e5221b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdb8b400640 1 -- 172.21.15.175:0/2530083628 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c032030 con 0x55c538332290 2024-04-25T09:12:38.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdb8b400640 1 -- 172.21.15.175:0/2530083628 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c009910 con 0x55c538332290 2024-04-25T09:12:38.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdb8b400640 1 -- 172.21.15.175:0/2530083628 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c024020 con 0x55c538332290 2024-04-25T09:12:38.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdba5692000 1 -- 172.21.15.175:0/2530083628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c538332290 msgr2=0x55c53838f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdba5692000 1 --2- 172.21.15.175:0/2530083628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c538332290 0x55c53838f160 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c017b20 tx=0x7fdb8c01a000 comp rx=0 tx=0).stop 2024-04-25T09:12:38.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdba5692000 1 -- 172.21.15.175:0/2530083628 shutdown_connections 2024-04-25T09:12:38.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdba5692000 1 --2- 172.21.15.175:0/2530083628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837c5b0 0x55c53838d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdba5692000 1 --2- 172.21.15.175:0/2530083628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c53837bc90 0x55c53838f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdba5692000 1 --2- 172.21.15.175:0/2530083628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c538332290 0x55c53838f160 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdba5692000 1 -- 172.21.15.175:0/2530083628 >> 172.21.15.175:0/2530083628 conn(0x55c53832e240 msgr2=0x55c538336d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdba5692000 1 -- 172.21.15.175:0/2530083628 shutdown_connections 2024-04-25T09:12:38.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdba5692000 1 -- 172.21.15.175:0/2530083628 wait complete. 2024-04-25T09:12:38.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdba5692000 1 -- start start 2024-04-25T09:12:38.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.657+0000 7fdba5692000 1 Processor -- start 2024-04-25T09:12:38.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c538332290 0x55c53838f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837bc90 0x55c538397ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c53837c5b0 0x55c538398420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c538236f20 con 0x55c53837c5b0 2024-04-25T09:12:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c1feda0 con 0x55c53837bc90 2024-04-25T09:12:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c538122bd0 con 0x55c538332290 2024-04-25T09:12:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 10 client.0 _ll_register_callbacks cb 0x7fdb840013c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb9be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c53837c5b0 0x55c538398420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb9be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c53837c5b0 0x55c538398420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43892/0 (socket says 172.21.15.175:43892) 2024-04-25T09:12:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb9be00640 1 -- 172.21.15.175:0/1392648782 learned_addr learned my addr 172.21.15.175:0/1392648782 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb9b400640 1 --2- 172.21.15.175:0/1392648782 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c538332290 0x55c53838f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb93e00640 1 --2- 172.21.15.175:0/1392648782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837bc90 0x55c538397ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb9be00640 1 -- 172.21.15.175:0/1392648782 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c538332290 msgr2=0x55c53838f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb9be00640 1 --2- 172.21.15.175:0/1392648782 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c538332290 0x55c53838f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb9be00640 1 -- 172.21.15.175:0/1392648782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837bc90 msgr2=0x55c538397ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb9be00640 1 --2- 172.21.15.175:0/1392648782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837bc90 0x55c538397ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb9be00640 1 -- 172.21.15.175:0/1392648782 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c538148120 con 0x55c53837c5b0 2024-04-25T09:12:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb9be00640 1 --2- 172.21.15.175:0/1392648782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c53837c5b0 0x55c538398420 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fdb940ef5d0 tx=0x7fdb9401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246f10465d6f2ee7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb88c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:12:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb88c00640 1 -- 172.21.15.175:0/1392648782 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb940f7fc0 con 0x55c53837c5b0 2024-04-25T09:12:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb88c00640 1 -- 172.21.15.175:0/1392648782 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb94009c10 con 0x55c53837c5b0 2024-04-25T09:12:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 -- 172.21.15.175:0/1392648782 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb8c009910 con 0x55c53837c5b0 2024-04-25T09:12:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb88c00640 1 -- 172.21.15.175:0/1392648782 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb940aed60 con 0x55c53837c5b0 2024-04-25T09:12:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 10 client.8346 fetch_fsmap learned FSMap version 78 2024-04-25T09:12:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 -- 172.21.15.175:0/1392648782 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55c538127170 con 0x55c53837c5b0 2024-04-25T09:12:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb88c00640 1 -- 172.21.15.175:0/1392648782 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c009910 con 0x55c53837c5b0 2024-04-25T09:12:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb88c00640 1 -- 172.21.15.175:0/1392648782 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdb940b5050 con 0x55c53837c5b0 2024-04-25T09:12:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 10 client.8346 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:12:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 10 client.8346 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:12:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 20 client.8346 populate_metadata read hostname 'smithi175' 2024-04-25T09:12:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 --2- 172.21.15.175:0/1392648782 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55c5383dbd60 0x55c5383dc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 4 client.8346 mds_command: new command op to 8067 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-25T09:12:38.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 -- 172.21.15.175:0/1392648782 --> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x55c53818d5b0 con 0x55c5383dbd60 2024-04-25T09:12:38.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb9b400640 1 --2- 172.21.15.175:0/1392648782 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55c5383dbd60 0x55c5383dc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb88c00640 10 client.8346 ms_handle_connect on v2:172.21.15.175:6835/3952378765 2024-04-25T09:12:38.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb9b400640 1 --2- 172.21.15.175:0/1392648782 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55c5383dbd60 0x55c5383dc170 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50f89a9e1efce553 server_cookie=b2de85e712daae70 in_seq=0 out_seq=0 2024-04-25T09:12:38.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb88c00640 1 -- 172.21.15.175:0/1392648782 <== mds.0 v2:172.21.15.175:6835/3952378765 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c53818d5b0 con 0x55c5383dbd60 2024-04-25T09:12:38.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb88c00640 10 client.8346 handle_command_reply: tid=0 2024-04-25T09:12:38.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 client.8346 shutdown 2024-04-25T09:12:38.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 -- 172.21.15.175:0/1392648782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c53837c5b0 msgr2=0x55c538398420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 --2- 172.21.15.175:0/1392648782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c53837c5b0 0x55c538398420 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fdb940ef5d0 tx=0x7fdb9401cc80 comp rx=0 tx=0).stop 2024-04-25T09:12:38.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 -- 172.21.15.175:0/1392648782 shutdown_connections 2024-04-25T09:12:38.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 --2- 172.21.15.175:0/1392648782 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55c5383dbd60 0x55c5383dc170 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 --2- 172.21.15.175:0/1392648782 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55c53837c5b0 0x55c538398420 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 --2- 172.21.15.175:0/1392648782 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55c53837bc90 0x55c538397ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 --2- 172.21.15.175:0/1392648782 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55c538332290 0x55c53838f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdba5692000 1 -- 172.21.15.175:0/1392648782 >> 172.21.15.175:0/1392648782 conn(0x55c53832e240 msgr2=0x55c538337470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.661+0000 7fdb88c00640 0 client.8346 ms_handle_reset on v2:172.21.15.175:6835/3952378765 2024-04-25T09:12:38.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.665+0000 7fdba5692000 1 -- 172.21.15.175:0/1392648782 shutdown_connections 2024-04-25T09:12:38.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.665+0000 7fdba5692000 1 -- 172.21.15.175:0/1392648782 wait complete. 2024-04-25T09:12:38.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.665+0000 7fdba5692000 20 client.8346 trim_cache size 0 max 16384 2024-04-25T09:12:38.653 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:12:38.653 INFO:teuthology.orchestra.run.smithi175.stdout: "return_code": 0, 2024-04-25T09:12:38.653 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_tag": "3913c04f-93bb-4ed3-a211-790df9011090", 2024-04-25T09:12:38.653 INFO:teuthology.orchestra.run.smithi175.stdout: "mode": "asynchronous" 2024-04-25T09:12:38.653 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:12:38.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.665+0000 7fdba2200640 1 -- 172.21.15.175:0/2924395803 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdb78066f90 msgr2=0x7fdb78069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.665+0000 7fdba2200640 1 --2- 172.21.15.175:0/2924395803 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdb78066f90 0x7fdb78069450 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fdb84001060 tx=0x7fdb84009040 comp rx=0 tx=0).stop 2024-04-25T09:12:38.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.665+0000 7fdba2200640 1 -- 172.21.15.175:0/2924395803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb9c0afe60 msgr2=0x7fdb9c151640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.665+0000 7fdba2200640 1 --2- 172.21.15.175:0/2924395803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb9c0afe60 0x7fdb9c151640 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fdb94002240 tx=0x7fdb94009750 comp rx=0 tx=0).stop 2024-04-25T09:12:38.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.665+0000 7fdba2200640 1 -- 172.21.15.175:0/2924395803 shutdown_connections 2024-04-25T09:12:38.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.665+0000 7fdba2200640 1 --2- 172.21.15.175:0/2924395803 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdb78066f90 0x7fdb78069450 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.665+0000 7fdba2200640 1 --2- 172.21.15.175:0/2924395803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb9c0afe60 0x7fdb9c151640 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.665+0000 7fdba2200640 1 --2- 172.21.15.175:0/2924395803 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb9c0adea0 0x7fdb9c0af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.665+0000 7fdba2200640 1 --2- 172.21.15.175:0/2924395803 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb80004d50 0x7fdb9c157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.665+0000 7fdba2200640 1 -- 172.21.15.175:0/2924395803 >> 172.21.15.175:0/2924395803 conn(0x7fdb9c0d0750 msgr2=0x7fdb9c0c48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.665+0000 7fdba2200640 1 -- 172.21.15.175:0/2924395803 shutdown_connections 2024-04-25T09:12:38.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.665+0000 7fdba2200640 1 -- 172.21.15.175:0/2924395803 wait complete. 2024-04-25T09:12:38.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:38.670 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T09:12:38.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.821+0000 7f86d3800640 1 Processor -- start 2024-04-25T09:12:38.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.821+0000 7f86d3800640 1 -- start start 2024-04-25T09:12:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.821+0000 7f86d3800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f86cc145250 0x7f86cc0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.821+0000 7f86d3800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86cc0cfd10 con 0x7f86cc1600a0 2024-04-25T09:12:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.821+0000 7f86d3800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86cc0cfff0 con 0x7f86cc0ce970 2024-04-25T09:12:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.821+0000 7f86d3800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86cc15f650 con 0x7f86cc145250 2024-04-25T09:12:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.821+0000 7f86cbe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f86cc1600a0 0x7f86cc0cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:38062/0 (socket says 172.21.15.175:38062) 2024-04-25T09:12:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.821+0000 7f86cbe00640 1 -- 172.21.15.175:0/623754108 learned_addr learned my addr 172.21.15.175:0/623754108 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:12:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.821+0000 7f86d0e00640 1 --2- 172.21.15.175:0/623754108 >> v2:172.21.15.177:3300/0 conn(0x7f86cc145250 0x7f86cc0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.821+0000 7f86cb400640 1 -- 172.21.15.175:0/623754108 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704580441 0 0) 0x7f86cc0cfd10 con 0x7f86cc1600a0 2024-04-25T09:12:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.821+0000 7f86cb400640 1 -- 172.21.15.175:0/623754108 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86b0003530 con 0x7f86cc1600a0 2024-04-25T09:12:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.821+0000 7f86d0e00640 1 -- 172.21.15.175:0/623754108 >> v1:172.21.15.177:6789/0 conn(0x7f86cc0ce970 legacy=0x7f86cc0cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.821+0000 7f86d0e00640 1 -- 172.21.15.175:0/623754108 >> v1:172.21.15.175:6789/0 conn(0x7f86cc1600a0 legacy=0x7f86cc0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.821+0000 7f86d0e00640 1 -- 172.21.15.175:0/623754108 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86cc15f8a0 con 0x7f86cc145250 2024-04-25T09:12:38.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.825+0000 7f86d0e00640 1 --2- 172.21.15.175:0/623754108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86cc145250 0x7f86cc0cf6b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f86cc15f7d0 tx=0x7f86bc01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9150cc245a1095b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.812 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.825+0000 7f86cb400640 1 -- 172.21.15.175:0/623754108 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0b1070 con 0x7f86cc145250 2024-04-25T09:12:38.813 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.825+0000 7f86cb400640 1 -- 172.21.15.175:0/623754108 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc0a8050 con 0x7f86cc145250 2024-04-25T09:12:38.813 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.825+0000 7f86cb400640 1 -- 172.21.15.175:0/623754108 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0ac860 con 0x7f86cc145250 2024-04-25T09:12:38.813 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.825+0000 7f86d3800640 1 -- 172.21.15.175:0/623754108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86cc145250 msgr2=0x7f86cc0cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.813 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.825+0000 7f86d3800640 1 --2- 172.21.15.175:0/623754108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86cc145250 0x7f86cc0cf6b0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f86cc15f7d0 tx=0x7f86bc01c3c0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.825+0000 7f86d3800640 1 -- 172.21.15.175:0/623754108 shutdown_connections 2024-04-25T09:12:38.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.825+0000 7f86d3800640 1 --2- 172.21.15.175:0/623754108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86cc145250 0x7f86cc0cf6b0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.825+0000 7f86d3800640 1 -- 172.21.15.175:0/623754108 >> 172.21.15.175:0/623754108 conn(0x7f86cc06ac50 msgr2=0x7f86cc06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.825+0000 7f86d3800640 1 -- 172.21.15.175:0/623754108 shutdown_connections 2024-04-25T09:12:38.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.825+0000 7f86d3800640 1 -- 172.21.15.175:0/623754108 wait complete. 2024-04-25T09:12:38.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86d3800640 1 Processor -- start 2024-04-25T09:12:38.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86d3800640 1 -- start start 2024-04-25T09:12:38.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86d3800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86cc0ce970 0x7f86cc15b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86d3800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86cc145250 0x7f86cc143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86d3800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86cc1600a0 0x7f86cc0ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86d3800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc15c9f0 con 0x7f86cc145250 2024-04-25T09:12:38.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86d3800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc15c870 con 0x7f86cc1600a0 2024-04-25T09:12:38.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86d3800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc15cb70 con 0x7f86cc0ce970 2024-04-25T09:12:38.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86cbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86cc145250 0x7f86cc143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86cbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86cc145250 0x7f86cc143fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43894/0 (socket says 172.21.15.175:43894) 2024-04-25T09:12:38.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86cbe00640 1 -- 172.21.15.175:0/359362164 learned_addr learned my addr 172.21.15.175:0/359362164 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:38.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86d0e00640 1 --2- 172.21.15.175:0/359362164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86cc0ce970 0x7f86cc15b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86d1800640 1 --2- 172.21.15.175:0/359362164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86cc1600a0 0x7f86cc0ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86cbe00640 1 -- 172.21.15.175:0/359362164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86cc0ce970 msgr2=0x7f86cc15b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86cbe00640 1 --2- 172.21.15.175:0/359362164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86cc0ce970 0x7f86cc15b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86cbe00640 1 -- 172.21.15.175:0/359362164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86cc1600a0 msgr2=0x7f86cc0ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86cbe00640 1 --2- 172.21.15.175:0/359362164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86cc1600a0 0x7f86cc0ae460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86cbe00640 1 -- 172.21.15.175:0/359362164 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86cc0ad400 con 0x7f86cc145250 2024-04-25T09:12:38.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86d1800640 1 --2- 172.21.15.175:0/359362164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86cc1600a0 0x7f86cc0ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:38.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86cbe00640 1 --2- 172.21.15.175:0/359362164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86cc145250 0x7f86cc143fd0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f86b800c4d0 tx=0x7f86b800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86c8c00640 1 -- 172.21.15.175:0/359362164 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8017070 con 0x7f86cc145250 2024-04-25T09:12:38.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86c8c00640 1 -- 172.21.15.175:0/359362164 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b8005cf0 con 0x7f86cc145250 2024-04-25T09:12:38.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86d3800640 1 -- 172.21.15.175:0/359362164 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86cc13e410 con 0x7f86cc145250 2024-04-25T09:12:38.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86c8c00640 1 -- 172.21.15.175:0/359362164 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8007270 con 0x7f86cc145250 2024-04-25T09:12:38.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.829+0000 7f86d3800640 1 -- 172.21.15.175:0/359362164 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86cc0ad980 con 0x7f86cc145250 2024-04-25T09:12:38.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.833+0000 7f86c8c00640 1 -- 172.21.15.175:0/359362164 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f86b801a070 con 0x7f86cc145250 2024-04-25T09:12:38.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.833+0000 7f86c8c00640 1 --2- 172.21.15.175:0/359362164 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86ac066f60 0x7f86ac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.833+0000 7f86c8c00640 1 -- 172.21.15.175:0/359362164 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86b8084320 con 0x7f86cc145250 2024-04-25T09:12:38.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.833+0000 7f86d0e00640 1 --2- 172.21.15.175:0/359362164 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86ac066f60 0x7f86ac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.833+0000 7f86d6d5a000 1 Processor -- start 2024-04-25T09:12:38.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.833+0000 7f86d6d5a000 1 -- start start 2024-04-25T09:12:38.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.833+0000 7f86d0e00640 1 --2- 172.21.15.175:0/359362164 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86ac066f60 0x7f86ac069420 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0ae000 tx=0x7f86bc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.833+0000 7f86d6d5a000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87df4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.833+0000 7f86d6d5a000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87df52f0 0x559d87daab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.833+0000 7f86d6d5a000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87dab0a0 0x559d87dab480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.833+0000 7f86d6d5a000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d87bf7ff0 con 0x559d87df49d0 2024-04-25T09:12:38.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.833+0000 7f86d6d5a000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d87b80150 con 0x559d87dab0a0 2024-04-25T09:12:38.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.833+0000 7f86d6d5a000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d87bf4090 con 0x559d87df52f0 2024-04-25T09:12:38.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.833+0000 7f86d0e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87df4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.833+0000 7f86d0e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87df4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43908/0 (socket says 172.21.15.175:43908) 2024-04-25T09:12:38.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.833+0000 7f86d0e00640 1 -- 172.21.15.175:0/4060137017 learned_addr learned my addr 172.21.15.175:0/4060137017 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:38.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.833+0000 7f86d1800640 1 --2- 172.21.15.175:0/4060137017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87dab0a0 0x559d87dab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.833+0000 7f86cbe00640 1 --2- 172.21.15.175:0/4060137017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87df52f0 0x559d87daab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d0e00640 1 -- 172.21.15.175:0/4060137017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87df52f0 msgr2=0x559d87daab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d0e00640 1 --2- 172.21.15.175:0/4060137017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87df52f0 0x559d87daab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d0e00640 1 -- 172.21.15.175:0/4060137017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87dab0a0 msgr2=0x559d87dab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d0e00640 1 --2- 172.21.15.175:0/4060137017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87dab0a0 0x559d87dab480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d0e00640 1 -- 172.21.15.175:0/4060137017 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d87d8e0d0 con 0x559d87df49d0 2024-04-25T09:12:38.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d0e00640 1 --2- 172.21.15.175:0/4060137017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87df4db0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f86bc01c8a0 tx=0x7f86bc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88e3dc082ba153b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86c1600640 1 -- 172.21.15.175:0/4060137017 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0c9070 con 0x559d87df49d0 2024-04-25T09:12:38.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86c1600640 1 -- 172.21.15.175:0/4060137017 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc0ace10 con 0x559d87df49d0 2024-04-25T09:12:38.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86c1600640 1 -- 172.21.15.175:0/4060137017 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0b1040 con 0x559d87df49d0 2024-04-25T09:12:38.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d6d5a000 1 -- 172.21.15.175:0/4060137017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 msgr2=0x559d87df4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/4060137017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87df4db0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f86bc01c8a0 tx=0x7f86bc004740 comp rx=0 tx=0).stop 2024-04-25T09:12:38.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d6d5a000 1 -- 172.21.15.175:0/4060137017 shutdown_connections 2024-04-25T09:12:38.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/4060137017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87dab0a0 0x559d87dab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/4060137017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87df52f0 0x559d87daab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/4060137017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87df4db0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d6d5a000 1 -- 172.21.15.175:0/4060137017 >> 172.21.15.175:0/4060137017 conn(0x559d87da7020 msgr2=0x559d87da9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d6d5a000 1 -- 172.21.15.175:0/4060137017 shutdown_connections 2024-04-25T09:12:38.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d6d5a000 1 -- 172.21.15.175:0/4060137017 wait complete. 2024-04-25T09:12:38.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d6d5a000 1 -- start start 2024-04-25T09:12:38.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d6d5a000 1 Processor -- start 2024-04-25T09:12:38.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d6d5a000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87dab0a0 0x559d87dd97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d6d5a000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87dd9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d6d5a000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87df52f0 0x559d87dda270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d6d5a000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d87bbc250 con 0x559d87df49d0 2024-04-25T09:12:38.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d6d5a000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d87bb2690 con 0x559d87dab0a0 2024-04-25T09:12:38.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d6d5a000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d87b80a40 con 0x559d87df52f0 2024-04-25T09:12:38.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d6d5a000 10 client.0 _ll_register_callbacks cb 0x559d87d95e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:38.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86cbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87dd9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86cbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87dd9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43912/0 (socket says 172.21.15.175:43912) 2024-04-25T09:12:38.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86cbe00640 1 -- 172.21.15.175:0/3477742685 learned_addr learned my addr 172.21.15.175:0/3477742685 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:38.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d1800640 1 --2- 172.21.15.175:0/3477742685 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87df52f0 0x559d87dda270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86d0e00640 1 --2- 172.21.15.175:0/3477742685 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87dab0a0 0x559d87dd97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86cbe00640 1 -- 172.21.15.175:0/3477742685 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87df52f0 msgr2=0x559d87dda270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86cbe00640 1 --2- 172.21.15.175:0/3477742685 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87df52f0 0x559d87dda270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86cbe00640 1 -- 172.21.15.175:0/3477742685 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87dab0a0 msgr2=0x559d87dd97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86cbe00640 1 --2- 172.21.15.175:0/3477742685 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87dab0a0 0x559d87dd97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.837+0000 7f86cbe00640 1 -- 172.21.15.175:0/3477742685 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d87ca51c0 con 0x559d87df49d0 2024-04-25T09:12:38.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86cbe00640 1 --2- 172.21.15.175:0/3477742685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87dd9d30 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f86b8007fd0 tx=0x7f86b805d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea12d9404ea24ebc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86b6000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:12:38.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86b6000640 1 -- 172.21.15.175:0/3477742685 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8068de0 con 0x559d87df49d0 2024-04-25T09:12:38.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86b6000640 1 -- 172.21.15.175:0/3477742685 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86b805cea0 con 0x559d87df49d0 2024-04-25T09:12:38.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 1 -- 172.21.15.175:0/3477742685 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f86bc0ace10 con 0x559d87df49d0 2024-04-25T09:12:38.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86b6000640 1 -- 172.21.15.175:0/3477742685 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86b805d0a0 con 0x559d87df49d0 2024-04-25T09:12:38.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 10 client.8358 fetch_fsmap learned FSMap version 78 2024-04-25T09:12:38.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 1 -- 172.21.15.175:0/3477742685 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x559d87ca1170 con 0x559d87df49d0 2024-04-25T09:12:38.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86b6000640 1 -- 172.21.15.175:0/3477742685 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc0ace10 con 0x559d87df49d0 2024-04-25T09:12:38.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86b6000640 1 -- 172.21.15.175:0/3477742685 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f86b8054120 con 0x559d87df49d0 2024-04-25T09:12:38.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 10 client.8358 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:12:38.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 10 client.8358 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:12:38.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 20 client.8358 populate_metadata read hostname 'smithi175' 2024-04-25T09:12:38.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/3477742685 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x559d87e04c80 0x559d87e07070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 4 client.8358 mds_command: new command op to 8067 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:12:38.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 1 -- 172.21.15.175:0/3477742685 --> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d87b93c60 con 0x559d87e04c80 2024-04-25T09:12:38.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d0e00640 1 --2- 172.21.15.175:0/3477742685 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x559d87e04c80 0x559d87e07070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d0e00640 1 --2- 172.21.15.175:0/3477742685 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x559d87e04c80 0x559d87e07070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a53cbac6d724478f server_cookie=2bdf85180fbc086 in_seq=0 out_seq=0 2024-04-25T09:12:38.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86b6000640 10 client.8358 ms_handle_connect on v2:172.21.15.175:6835/3952378765 2024-04-25T09:12:38.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86b6000640 1 -- 172.21.15.175:0/3477742685 <== mds.0 v2:172.21.15.175:6835/3952378765 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559d87b93c60 con 0x559d87e04c80 2024-04-25T09:12:38.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86b6000640 10 client.8358 handle_command_reply: tid=0 2024-04-25T09:12:38.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 1 client.8358 shutdown 2024-04-25T09:12:38.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 1 -- 172.21.15.175:0/3477742685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 msgr2=0x559d87dd9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/3477742685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87dd9d30 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f86b8007fd0 tx=0x7f86b805d330 comp rx=0 tx=0).stop 2024-04-25T09:12:38.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 1 -- 172.21.15.175:0/3477742685 shutdown_connections 2024-04-25T09:12:38.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/3477742685 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x559d87e04c80 0x559d87e07070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/3477742685 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87df52f0 0x559d87dda270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/3477742685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87dd9d30 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86b6000640 0 client.8358 ms_handle_reset on v2:172.21.15.175:6835/3952378765 2024-04-25T09:12:38.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/3477742685 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87dab0a0 0x559d87dd97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 1 -- 172.21.15.175:0/3477742685 >> 172.21.15.175:0/3477742685 conn(0x559d87da7020 msgr2=0x559d87da9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 1 -- 172.21.15.175:0/3477742685 shutdown_connections 2024-04-25T09:12:38.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 1 -- 172.21.15.175:0/3477742685 wait complete. 2024-04-25T09:12:38.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.841+0000 7f86d6d5a000 20 client.8358 trim_cache size 0 max 16384 2024-04-25T09:12:38.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86d6d5a000 1 Processor -- start 2024-04-25T09:12:38.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86d6d5a000 1 -- start start 2024-04-25T09:12:38.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86d6d5a000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87dab0a0 0x559d87df3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86d6d5a000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87daa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86d6d5a000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87df52f0 0x559d87daa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86d6d5a000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc2028a0 con 0x559d87df49d0 2024-04-25T09:12:38.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86d6d5a000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc0b2a60 con 0x559d87df52f0 2024-04-25T09:12:38.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86d6d5a000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc0b1e60 con 0x559d87dab0a0 2024-04-25T09:12:38.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86cbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87daa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86cbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87daa420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43922/0 (socket says 172.21.15.175:43922) 2024-04-25T09:12:38.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86cbe00640 1 -- 172.21.15.175:0/2074474298 learned_addr learned my addr 172.21.15.175:0/2074474298 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:38.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86cbe00640 1 -- 172.21.15.175:0/2074474298 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87dab0a0 msgr2=0x559d87df3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86cbe00640 1 --2- 172.21.15.175:0/2074474298 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87dab0a0 0x559d87df3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86cbe00640 1 -- 172.21.15.175:0/2074474298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87df52f0 msgr2=0x559d87daa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86cbe00640 1 --2- 172.21.15.175:0/2074474298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87df52f0 0x559d87daa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86cbe00640 1 -- 172.21.15.175:0/2074474298 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d87c3ede0 con 0x559d87df49d0 2024-04-25T09:12:38.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86cbe00640 1 --2- 172.21.15.175:0/2074474298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87daa420 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f86b806a040 tx=0x7f86b8056000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6a0669edf0e612 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86c0c00640 1 -- 172.21.15.175:0/2074474298 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8054120 con 0x559d87df49d0 2024-04-25T09:12:38.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86c0c00640 1 -- 172.21.15.175:0/2074474298 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b8068be0 con 0x559d87df49d0 2024-04-25T09:12:38.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86c0c00640 1 -- 172.21.15.175:0/2074474298 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8007610 con 0x559d87df49d0 2024-04-25T09:12:38.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86d6d5a000 1 -- 172.21.15.175:0/2074474298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 msgr2=0x559d87daa420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/2074474298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87daa420 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f86b806a040 tx=0x7f86b8056000 comp rx=0 tx=0).stop 2024-04-25T09:12:38.849 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.857+0000 7f86d6d5a000 1 -- 172.21.15.175:0/2074474298 shutdown_connections 2024-04-25T09:12:38.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/2074474298 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87df52f0 0x559d87daa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/2074474298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87daa420 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/2074474298 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87dab0a0 0x559d87df3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 1 -- 172.21.15.175:0/2074474298 >> 172.21.15.175:0/2074474298 conn(0x559d87da7020 msgr2=0x559d87df30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 1 -- 172.21.15.175:0/2074474298 shutdown_connections 2024-04-25T09:12:38.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 1 -- 172.21.15.175:0/2074474298 wait complete. 2024-04-25T09:12:38.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 1 -- start start 2024-04-25T09:12:38.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 1 Processor -- start 2024-04-25T09:12:38.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87dab0a0 0x559d87e55520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87e55a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87df52f0 0x559d87e07380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d87b92e00 con 0x559d87df49d0 2024-04-25T09:12:38.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc0b2460 con 0x559d87df52f0 2024-04-25T09:12:38.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d87bf7300 con 0x559d87dab0a0 2024-04-25T09:12:38.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 10 client.0 _ll_register_callbacks cb 0x559d87d76040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:12:38.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86cbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87e55a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86cbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87e55a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43936/0 (socket says 172.21.15.175:43936) 2024-04-25T09:12:38.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86cbe00640 1 -- 172.21.15.175:0/1748899373 learned_addr learned my addr 172.21.15.175:0/1748899373 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:12:38.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d0e00640 1 --2- 172.21.15.175:0/1748899373 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87dab0a0 0x559d87e55520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d1800640 1 --2- 172.21.15.175:0/1748899373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87df52f0 0x559d87e07380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86cbe00640 1 -- 172.21.15.175:0/1748899373 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87dab0a0 msgr2=0x559d87e55520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86cbe00640 1 --2- 172.21.15.175:0/1748899373 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87dab0a0 0x559d87e55520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86cbe00640 1 -- 172.21.15.175:0/1748899373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87df52f0 msgr2=0x559d87e07380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:38.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86cbe00640 1 --2- 172.21.15.175:0/1748899373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87df52f0 0x559d87e07380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86cbe00640 1 -- 172.21.15.175:0/1748899373 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d87b998e0 con 0x559d87df49d0 2024-04-25T09:12:38.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d1800640 1 --2- 172.21.15.175:0/1748899373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87df52f0 0x559d87e07380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:38.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86cbe00640 1 --2- 172.21.15.175:0/1748899373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87e55a60 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f86b80547a0 tx=0x7f86b8082710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bebeca3ac4b663c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:38.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86b6000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:12:38.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86b6000640 1 -- 172.21.15.175:0/1748899373 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8068d90 con 0x559d87df49d0 2024-04-25T09:12:38.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86b6000640 1 -- 172.21.15.175:0/1748899373 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86b8007620 con 0x559d87df49d0 2024-04-25T09:12:38.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 1 -- 172.21.15.175:0/1748899373 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f86b8068be0 con 0x559d87df49d0 2024-04-25T09:12:38.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86b6000640 1 -- 172.21.15.175:0/1748899373 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86b8062050 con 0x559d87df49d0 2024-04-25T09:12:38.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 10 client.8364 fetch_fsmap learned FSMap version 78 2024-04-25T09:12:38.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 1 -- 172.21.15.175:0/1748899373 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x559d87c518f0 con 0x559d87df49d0 2024-04-25T09:12:38.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86b6000640 1 -- 172.21.15.175:0/1748899373 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b8068be0 con 0x559d87df49d0 2024-04-25T09:12:38.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86b6000640 1 -- 172.21.15.175:0/1748899373 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f86b8065020 con 0x559d87df49d0 2024-04-25T09:12:38.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 10 client.8364 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:12:38.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 10 client.8364 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:12:38.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 20 client.8364 populate_metadata read hostname 'smithi175' 2024-04-25T09:12:38.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/1748899373 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x559d87e07d40 0x559d87e08150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:38.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 4 client.8364 mds_command: new command op to 8067 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:12:38.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d6d5a000 1 -- 172.21.15.175:0/1748899373 --> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559d87c05530 con 0x559d87e07d40 2024-04-25T09:12:38.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.861+0000 7f86d0e00640 1 --2- 172.21.15.175:0/1748899373 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x559d87e07d40 0x559d87e08150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:38.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d0e00640 1 --2- 172.21.15.175:0/1748899373 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x559d87e07d40 0x559d87e08150 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5288dae1e3ccbe7 server_cookie=7a8eff0899d91990 in_seq=0 out_seq=0 2024-04-25T09:12:38.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86b6000640 10 client.8364 ms_handle_connect on v2:172.21.15.175:6835/3952378765 2024-04-25T09:12:38.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86b6000640 1 -- 172.21.15.175:0/1748899373 <== mds.0 v2:172.21.15.175:6835/3952378765 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x559d87c05530 con 0x559d87e07d40 2024-04-25T09:12:38.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86b6000640 10 client.8364 handle_command_reply: tid=0 2024-04-25T09:12:38.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d6d5a000 1 client.8364 shutdown 2024-04-25T09:12:38.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d6d5a000 1 -- 172.21.15.175:0/1748899373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 msgr2=0x559d87e55a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/1748899373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87e55a60 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f86b80547a0 tx=0x7f86b8082710 comp rx=0 tx=0).stop 2024-04-25T09:12:38.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d6d5a000 1 -- 172.21.15.175:0/1748899373 shutdown_connections 2024-04-25T09:12:38.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/1748899373 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x559d87e07d40 0x559d87e08150 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/1748899373 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559d87df52f0 0x559d87e07380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/1748899373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x559d87df49d0 0x559d87e55a60 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d6d5a000 1 --2- 172.21.15.175:0/1748899373 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559d87dab0a0 0x559d87e55520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d6d5a000 1 -- 172.21.15.175:0/1748899373 >> 172.21.15.175:0/1748899373 conn(0x559d87da7020 msgr2=0x559d87df3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86b6000640 0 client.8364 ms_handle_reset on v2:172.21.15.175:6835/3952378765 2024-04-25T09:12:38.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d6d5a000 1 -- 172.21.15.175:0/1748899373 shutdown_connections 2024-04-25T09:12:38.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d6d5a000 1 -- 172.21.15.175:0/1748899373 wait complete. 2024-04-25T09:12:38.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d6d5a000 20 client.8364 trim_cache size 0 max 16384 2024-04-25T09:12:38.855 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:12:38.855 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:12:38.855 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": { 2024-04-25T09:12:38.855 INFO:teuthology.orchestra.run.smithi175.stdout: "3913c04f-93bb-4ed3-a211-790df9011090": { 2024-04-25T09:12:38.855 INFO:teuthology.orchestra.run.smithi175.stdout: "path": "/", 2024-04-25T09:12:38.855 INFO:teuthology.orchestra.run.smithi175.stdout: "tag": "3913c04f-93bb-4ed3-a211-790df9011090", 2024-04-25T09:12:38.855 INFO:teuthology.orchestra.run.smithi175.stdout: "options": "recursive,repair" 2024-04-25T09:12:38.855 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:38.855 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:12:38.856 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:12:38.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d3800640 1 -- 172.21.15.175:0/359362164 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86ac066f60 msgr2=0x7f86ac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d3800640 1 --2- 172.21.15.175:0/359362164 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86ac066f60 0x7f86ac069420 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0ae000 tx=0x7f86bc0a7000 comp rx=0 tx=0).stop 2024-04-25T09:12:38.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d3800640 1 -- 172.21.15.175:0/359362164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86cc145250 msgr2=0x7f86cc143fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:38.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d3800640 1 --2- 172.21.15.175:0/359362164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86cc145250 0x7f86cc143fd0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f86b800c4d0 tx=0x7f86b800c990 comp rx=0 tx=0).stop 2024-04-25T09:12:38.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d3800640 1 -- 172.21.15.175:0/359362164 shutdown_connections 2024-04-25T09:12:38.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d3800640 1 --2- 172.21.15.175:0/359362164 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86ac066f60 0x7f86ac069420 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d3800640 1 --2- 172.21.15.175:0/359362164 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86cc1600a0 0x7f86cc0ae460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d3800640 1 --2- 172.21.15.175:0/359362164 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f86cc145250 0x7f86cc143fd0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d3800640 1 --2- 172.21.15.175:0/359362164 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86cc0ce970 0x7f86cc15b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:38.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d3800640 1 -- 172.21.15.175:0/359362164 >> 172.21.15.175:0/359362164 conn(0x7f86cc06ac50 msgr2=0x7f86cc0cc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:38.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d3800640 1 -- 172.21.15.175:0/359362164 shutdown_connections 2024-04-25T09:12:38.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:38.865+0000 7f86d3800640 1 -- 172.21.15.175:0/359362164 wait complete. 2024-04-25T09:12:38.870 INFO:tasks.cephfs.filesystem:scrub status for tag:3913c04f-93bb-4ed3-a211-790df9011090 - {'path': '/', 'tag': '3913c04f-93bb-4ed3-a211-790df9011090', 'options': 'recursive,repair'} 2024-04-25T09:12:39.434 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:12:39.437 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:12:40.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:40.133+0000 7fe277400640 1 -- 172.21.15.175:0/11675954 <== mon.0 v2:172.21.15.175:3300/0 7 ==== log(4 entries from seq 1 at 2024-04-25T09:12:38.664768+0000) v1 ==== 695+0+0 (secure 0 0 0) 0x7fe270052cd0 con 0x7fe2800cfad0 2024-04-25T09:12:40.119 INFO:teuthology.orchestra.run.smithi175.stdout: cluster: 2024-04-25T09:12:40.119 INFO:teuthology.orchestra.run.smithi175.stdout: id: 8caed986-ca08-40e2-b5a5-12e2aade6223 2024-04-25T09:12:40.119 INFO:teuthology.orchestra.run.smithi175.stdout: health: HEALTH_OK 2024-04-25T09:12:40.119 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:40.119 INFO:teuthology.orchestra.run.smithi175.stdout: services: 2024-04-25T09:12:40.119 INFO:teuthology.orchestra.run.smithi175.stdout: mon: 3 daemons, quorum a,b,c (age 8m) 2024-04-25T09:12:40.119 INFO:teuthology.orchestra.run.smithi175.stdout: mgr: y(active, since 8m), standbys: x 2024-04-25T09:12:40.119 INFO:teuthology.orchestra.run.smithi175.stdout: mds: 1/1 daemons up, 3 standby 2024-04-25T09:12:40.119 INFO:teuthology.orchestra.run.smithi175.stdout: osd: 8 osds: 8 up (since 8m), 8 in (since 8m) 2024-04-25T09:12:40.119 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:40.119 INFO:teuthology.orchestra.run.smithi175.stdout: data: 2024-04-25T09:12:40.120 INFO:teuthology.orchestra.run.smithi175.stdout: volumes: 1/1 healthy 2024-04-25T09:12:40.120 INFO:teuthology.orchestra.run.smithi175.stdout: pools: 3 pools, 97 pgs 2024-04-25T09:12:40.120 INFO:teuthology.orchestra.run.smithi175.stdout: objects: 30 objects, 19 MiB 2024-04-25T09:12:40.120 INFO:teuthology.orchestra.run.smithi175.stdout: usage: 290 MiB used, 720 GiB / 720 GiB avail 2024-04-25T09:12:40.120 INFO:teuthology.orchestra.run.smithi175.stdout: pgs: 97 active+clean 2024-04-25T09:12:40.120 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:40.120 INFO:teuthology.orchestra.run.smithi175.stdout: io: 2024-04-25T09:12:40.120 INFO:teuthology.orchestra.run.smithi175.stdout: client: 85 B/s rd, 1.5 MiB/s wr, 0 op/s rd, 7 op/s wr 2024-04-25T09:12:40.120 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:40.120 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:12:40.120 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:12:38.664768+0000 mds.a [INF] scrub queued for path: / 2024-04-25T09:12:40.120 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:12:38.664771+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-04-25T09:12:40.120 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:12:38.664776+0000 mds.a [INF] scrub summary: active paths [/] 2024-04-25T09:12:40.120 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:12:38.666257+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-04-25T09:12:43.956 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:12:43.969+0000 7fe277400640 1 -- 172.21.15.175:0/11675954 <== mon.0 v2:172.21.15.175:3300/0 8 ==== log(1 entries from seq 5 at 2024-04-25T09:12:43.149481+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7fe270052f30 con 0x7fe2800cfad0 2024-04-25T09:12:43.956 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:12:43.149481+0000 mds.a [INF] scrub summary: idle 2024-04-25T09:13:08.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:08.871 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T09:13:09.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.032+0000 7f334f600640 1 Processor -- start 2024-04-25T09:13:09.019 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.032+0000 7f334f600640 1 -- start start 2024-04-25T09:13:09.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.032+0000 7f334f600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3348145250 0x7f33480cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.032+0000 7f334f600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f33480ce970 0x7f33480cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.032+0000 7f334f600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33480cfd10 con 0x7f33481600a0 2024-04-25T09:13:09.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.032+0000 7f334f600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f334815f650 con 0x7f33480ce970 2024-04-25T09:13:09.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.032+0000 7f334f600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33480cfff0 con 0x7f3348145250 2024-04-25T09:13:09.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.032+0000 7f3347e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f33481600a0 0x7f33480cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:34124/0 (socket says 172.21.15.175:34124) 2024-04-25T09:13:09.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.032+0000 7f3347e00640 1 -- 172.21.15.175:0/2855511389 learned_addr learned my addr 172.21.15.175:0/2855511389 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:09.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.032+0000 7f334d600640 1 --2- 172.21.15.175:0/2855511389 >> v2:172.21.15.177:3300/0 conn(0x7f33480ce970 0x7f33480cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.032+0000 7f334cc00640 1 --2- 172.21.15.175:0/2855511389 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3348145250 0x7f33480cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.032+0000 7f3347400640 1 -- 172.21.15.175:0/2855511389 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747212063 0 0) 0x7f33480cfd10 con 0x7f33481600a0 2024-04-25T09:13:09.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.036+0000 7f3347400640 1 -- 172.21.15.175:0/2855511389 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f332c003530 con 0x7f33481600a0 2024-04-25T09:13:09.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.036+0000 7f334cc00640 1 -- 172.21.15.175:0/2855511389 >> v2:172.21.15.177:3300/0 conn(0x7f33480ce970 msgr2=0x7f33480cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.036+0000 7f334cc00640 1 --2- 172.21.15.175:0/2855511389 >> v2:172.21.15.177:3300/0 conn(0x7f33480ce970 0x7f33480cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.036+0000 7f334cc00640 1 -- 172.21.15.175:0/2855511389 >> v1:172.21.15.175:6789/0 conn(0x7f33481600a0 legacy=0x7f33480cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.036+0000 7f334cc00640 1 -- 172.21.15.175:0/2855511389 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334815f8a0 con 0x7f3348145250 2024-04-25T09:13:09.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.036+0000 7f334d600640 1 --2- 172.21.15.175:0/2855511389 >> v2:172.21.15.177:3300/0 conn(0x7f33480ce970 0x7f33480cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:09.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.036+0000 7f334cc00640 1 --2- 172.21.15.175:0/2855511389 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3348145250 0x7f33480cf6b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3338009d90 tx=0x7f333801c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c57ebf82f2a6bff0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.036+0000 7f3347400640 1 -- 172.21.15.175:0/2855511389 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33380b2070 con 0x7f3348145250 2024-04-25T09:13:09.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.036+0000 7f3347400640 1 -- 172.21.15.175:0/2855511389 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33380a5990 con 0x7f3348145250 2024-04-25T09:13:09.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.036+0000 7f3347400640 1 -- 172.21.15.175:0/2855511389 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33380a5d40 con 0x7f3348145250 2024-04-25T09:13:09.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334f600640 1 -- 172.21.15.175:0/2855511389 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3348145250 msgr2=0x7f33480cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334f600640 1 --2- 172.21.15.175:0/2855511389 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3348145250 0x7f33480cf6b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3338009d90 tx=0x7f333801c8b0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334f600640 1 -- 172.21.15.175:0/2855511389 shutdown_connections 2024-04-25T09:13:09.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334f600640 1 --2- 172.21.15.175:0/2855511389 >> v2:172.21.15.177:3300/0 conn(0x7f33480ce970 0x7f33480cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334f600640 1 --2- 172.21.15.175:0/2855511389 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3348145250 0x7f33480cf6b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334f600640 1 -- 172.21.15.175:0/2855511389 >> 172.21.15.175:0/2855511389 conn(0x7f334806ac50 msgr2=0x7f334806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:09.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334f600640 1 -- 172.21.15.175:0/2855511389 shutdown_connections 2024-04-25T09:13:09.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334f600640 1 -- 172.21.15.175:0/2855511389 wait complete. 2024-04-25T09:13:09.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334f600640 1 Processor -- start 2024-04-25T09:13:09.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334f600640 1 -- start start 2024-04-25T09:13:09.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334f600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33480ce970 0x7f33481422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334f600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3348145250 0x7f33480b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334f600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33481600a0 0x7f33481414f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334f600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3348160600 con 0x7f33480ce970 2024-04-25T09:13:09.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334f600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3348160480 con 0x7f3348145250 2024-04-25T09:13:09.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334f600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334815c870 con 0x7f33481600a0 2024-04-25T09:13:09.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33480ce970 0x7f33481422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33480ce970 0x7f33481422f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51072/0 (socket says 172.21.15.175:51072) 2024-04-25T09:13:09.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334cc00640 1 -- 172.21.15.175:0/2867584146 learned_addr learned my addr 172.21.15.175:0/2867584146 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:09.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334cc00640 1 -- 172.21.15.175:0/2867584146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33481600a0 msgr2=0x7f33481414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334cc00640 1 --2- 172.21.15.175:0/2867584146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33481600a0 0x7f33481414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334cc00640 1 -- 172.21.15.175:0/2867584146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3348145250 msgr2=0x7f33480b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334cc00640 1 --2- 172.21.15.175:0/2867584146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3348145250 0x7f33480b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.040+0000 7f334cc00640 1 -- 172.21.15.175:0/2867584146 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33480b4070 con 0x7f33480ce970 2024-04-25T09:13:09.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.044+0000 7f334cc00640 1 --2- 172.21.15.175:0/2867584146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33480ce970 0x7f33481422f0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f333801a4e0 tx=0x7f3338019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.044+0000 7f3344c00640 1 -- 172.21.15.175:0/2867584146 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33380bd020 con 0x7f33480ce970 2024-04-25T09:13:09.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.044+0000 7f3344c00640 1 -- 172.21.15.175:0/2867584146 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33380b8670 con 0x7f33480ce970 2024-04-25T09:13:09.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.044+0000 7f3344c00640 1 -- 172.21.15.175:0/2867584146 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33380b2040 con 0x7f33480ce970 2024-04-25T09:13:09.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.044+0000 7f334f600640 1 -- 172.21.15.175:0/2867584146 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33480b2a90 con 0x7f33480ce970 2024-04-25T09:13:09.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.044+0000 7f334f600640 1 -- 172.21.15.175:0/2867584146 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33480b3330 con 0x7f33480ce970 2024-04-25T09:13:09.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.044+0000 7f3344c00640 1 -- 172.21.15.175:0/2867584146 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f33380c0020 con 0x7f33480ce970 2024-04-25T09:13:09.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3344c00640 1 --2- 172.21.15.175:0/2867584146 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3328066f60 0x7f3328069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3344c00640 1 -- 172.21.15.175:0/2867584146 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f333811ffe0 con 0x7f33480ce970 2024-04-25T09:13:09.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3347e00640 1 --2- 172.21.15.175:0/2867584146 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3328066f60 0x7f3328069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3352ab1000 1 Processor -- start 2024-04-25T09:13:09.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3352ab1000 1 -- start start 2024-04-25T09:13:09.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3347e00640 1 --2- 172.21.15.175:0/2867584146 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3328066f60 0x7f3328069420 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3334007fd0 tx=0x7f3334007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3352ab1000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa719d0 0x55e4caa71db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3352ab1000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa722f0 0x55e4caa27b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3352ab1000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa280a0 0x55e4caa28480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3352ab1000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca874ff0 con 0x55e4caa719d0 2024-04-25T09:13:09.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3352ab1000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca7fd150 con 0x55e4caa722f0 2024-04-25T09:13:09.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3352ab1000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca871090 con 0x55e4caa280a0 2024-04-25T09:13:09.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f334cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa719d0 0x55e4caa71db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f334cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa719d0 0x55e4caa71db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51074/0 (socket says 172.21.15.175:51074) 2024-04-25T09:13:09.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f334cc00640 1 -- 172.21.15.175:0/2190751927 learned_addr learned my addr 172.21.15.175:0/2190751927 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:09.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f334d600640 1 --2- 172.21.15.175:0/2190751927 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa280a0 0x55e4caa28480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3347e00640 1 --2- 172.21.15.175:0/2190751927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa722f0 0x55e4caa27b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f334cc00640 1 -- 172.21.15.175:0/2190751927 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa280a0 msgr2=0x55e4caa28480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f334cc00640 1 --2- 172.21.15.175:0/2190751927 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa280a0 0x55e4caa28480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f334cc00640 1 -- 172.21.15.175:0/2190751927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa722f0 msgr2=0x55e4caa27b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f334cc00640 1 --2- 172.21.15.175:0/2190751927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa722f0 0x55e4caa27b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f334cc00640 1 -- 172.21.15.175:0/2190751927 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4caa0b0d0 con 0x55e4caa719d0 2024-04-25T09:13:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f334cc00640 1 --2- 172.21.15.175:0/2190751927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa719d0 0x55e4caa71db0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f33380f8ac0 tx=0x7f3338009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67db4bcf3d9866 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f333d600640 1 -- 172.21.15.175:0/2190751927 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33380f4a30 con 0x55e4caa719d0 2024-04-25T09:13:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f333d600640 1 -- 172.21.15.175:0/2190751927 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33380f8ff0 con 0x55e4caa719d0 2024-04-25T09:13:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f333d600640 1 -- 172.21.15.175:0/2190751927 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33380eebe0 con 0x55e4caa719d0 2024-04-25T09:13:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3352ab1000 1 -- 172.21.15.175:0/2190751927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa719d0 msgr2=0x55e4caa71db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3352ab1000 1 --2- 172.21.15.175:0/2190751927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa719d0 0x55e4caa71db0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f33380f8ac0 tx=0x7f3338009750 comp rx=0 tx=0).stop 2024-04-25T09:13:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3352ab1000 1 -- 172.21.15.175:0/2190751927 shutdown_connections 2024-04-25T09:13:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3352ab1000 1 --2- 172.21.15.175:0/2190751927 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa280a0 0x55e4caa28480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3352ab1000 1 --2- 172.21.15.175:0/2190751927 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa722f0 0x55e4caa27b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3352ab1000 1 --2- 172.21.15.175:0/2190751927 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa719d0 0x55e4caa71db0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3352ab1000 1 -- 172.21.15.175:0/2190751927 >> 172.21.15.175:0/2190751927 conn(0x55e4caa24020 msgr2=0x55e4caa26440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3352ab1000 1 -- 172.21.15.175:0/2190751927 shutdown_connections 2024-04-25T09:13:09.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3352ab1000 1 -- 172.21.15.175:0/2190751927 wait complete. 2024-04-25T09:13:09.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.048+0000 7f3352ab1000 1 -- start start 2024-04-25T09:13:09.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3352ab1000 1 Processor -- start 2024-04-25T09:13:09.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3352ab1000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa280a0 0x55e4caa567f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3352ab1000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa719d0 0x55e4caa56d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3352ab1000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa722f0 0x55e4caa57270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3352ab1000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca839250 con 0x55e4caa719d0 2024-04-25T09:13:09.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3352ab1000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca82f690 con 0x55e4caa280a0 2024-04-25T09:13:09.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3352ab1000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca7fda40 con 0x55e4caa722f0 2024-04-25T09:13:09.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3352ab1000 10 client.0 _ll_register_callbacks cb 0x55e4caa12e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:13:09.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3347e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa719d0 0x55e4caa56d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3347e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa719d0 0x55e4caa56d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51076/0 (socket says 172.21.15.175:51076) 2024-04-25T09:13:09.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3347e00640 1 -- 172.21.15.175:0/250381530 learned_addr learned my addr 172.21.15.175:0/250381530 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:09.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f334cc00640 1 --2- 172.21.15.175:0/250381530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa280a0 0x55e4caa567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f334d600640 1 --2- 172.21.15.175:0/250381530 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa722f0 0x55e4caa57270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3347e00640 1 -- 172.21.15.175:0/250381530 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa722f0 msgr2=0x55e4caa57270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3347e00640 1 --2- 172.21.15.175:0/250381530 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa722f0 0x55e4caa57270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3347e00640 1 -- 172.21.15.175:0/250381530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa280a0 msgr2=0x55e4caa567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3347e00640 1 --2- 172.21.15.175:0/250381530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa280a0 0x55e4caa567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3347e00640 1 -- 172.21.15.175:0/250381530 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4ca9221c0 con 0x55e4caa719d0 2024-04-25T09:13:09.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3347e00640 1 --2- 172.21.15.175:0/250381530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa719d0 0x55e4caa56d30 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f33481f9bc0 tx=0x7f3334000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2af4403d6b7405 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3332000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:13:09.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3332000640 1 -- 172.21.15.175:0/250381530 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3334016b20 con 0x55e4caa719d0 2024-04-25T09:13:09.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3332000640 1 -- 172.21.15.175:0/250381530 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3334016cc0 con 0x55e4caa719d0 2024-04-25T09:13:09.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3352ab1000 1 -- 172.21.15.175:0/250381530 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f33380f8ff0 con 0x55e4caa719d0 2024-04-25T09:13:09.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3332000640 1 -- 172.21.15.175:0/250381530 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3334007710 con 0x55e4caa719d0 2024-04-25T09:13:09.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3352ab1000 10 client.8376 fetch_fsmap learned FSMap version 78 2024-04-25T09:13:09.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3352ab1000 1 -- 172.21.15.175:0/250381530 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55e4ca91e170 con 0x55e4caa719d0 2024-04-25T09:13:09.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3332000640 1 -- 172.21.15.175:0/250381530 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33380f8ff0 con 0x55e4caa719d0 2024-04-25T09:13:09.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3332000640 1 -- 172.21.15.175:0/250381530 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f333402a050 con 0x55e4caa719d0 2024-04-25T09:13:09.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3352ab1000 10 client.8376 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:13:09.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3352ab1000 10 client.8376 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:13:09.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3352ab1000 20 client.8376 populate_metadata read hostname 'smithi175' 2024-04-25T09:13:09.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3352ab1000 1 --2- 172.21.15.175:0/250381530 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55e4caa81c80 0x55e4caa84070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3352ab1000 4 client.8376 mds_command: new command op to 8067 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:13:09.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3352ab1000 1 -- 172.21.15.175:0/250381530 --> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e4ca810c60 con 0x55e4caa81c80 2024-04-25T09:13:09.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f334cc00640 1 --2- 172.21.15.175:0/250381530 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55e4caa81c80 0x55e4caa84070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f334cc00640 1 --2- 172.21.15.175:0/250381530 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55e4caa81c80 0x55e4caa84070 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59f754aa11d2da05 server_cookie=346587f819edeebb in_seq=0 out_seq=0 2024-04-25T09:13:09.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.052+0000 7f3332000640 10 client.8376 ms_handle_connect on v2:172.21.15.175:6835/3952378765 2024-04-25T09:13:09.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.056+0000 7f3332000640 1 -- 172.21.15.175:0/250381530 <== mds.0 v2:172.21.15.175:6835/3952378765 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e4ca810c60 con 0x55e4caa81c80 2024-04-25T09:13:09.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.056+0000 7f3332000640 10 client.8376 handle_command_reply: tid=0 2024-04-25T09:13:09.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.056+0000 7f3352ab1000 1 client.8376 shutdown 2024-04-25T09:13:09.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.056+0000 7f3352ab1000 1 -- 172.21.15.175:0/250381530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa719d0 msgr2=0x55e4caa56d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.056+0000 7f3352ab1000 1 --2- 172.21.15.175:0/250381530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa719d0 0x55e4caa56d30 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f33481f9bc0 tx=0x7f3334000ee0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.056+0000 7f3352ab1000 1 -- 172.21.15.175:0/250381530 shutdown_connections 2024-04-25T09:13:09.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.056+0000 7f3352ab1000 1 --2- 172.21.15.175:0/250381530 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55e4caa81c80 0x55e4caa84070 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.056+0000 7f3352ab1000 1 --2- 172.21.15.175:0/250381530 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa722f0 0x55e4caa57270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.056+0000 7f3352ab1000 1 --2- 172.21.15.175:0/250381530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa719d0 0x55e4caa56d30 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.056+0000 7f3332000640 0 client.8376 ms_handle_reset on v2:172.21.15.175:6835/3952378765 2024-04-25T09:13:09.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.056+0000 7f3352ab1000 1 --2- 172.21.15.175:0/250381530 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa280a0 0x55e4caa567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.056+0000 7f3352ab1000 1 -- 172.21.15.175:0/250381530 >> 172.21.15.175:0/250381530 conn(0x55e4caa24020 msgr2=0x55e4caa26ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:09.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.056+0000 7f3352ab1000 1 -- 172.21.15.175:0/250381530 shutdown_connections 2024-04-25T09:13:09.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.056+0000 7f3352ab1000 1 -- 172.21.15.175:0/250381530 wait complete. 2024-04-25T09:13:09.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.056+0000 7f3352ab1000 20 client.8376 trim_cache size 0 max 16384 2024-04-25T09:13:09.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.068+0000 7f3352ab1000 1 Processor -- start 2024-04-25T09:13:09.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.068+0000 7f3352ab1000 1 -- start start 2024-04-25T09:13:09.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa280a0 0x55e4caace300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa719d0 0x55e4caace840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa722f0 0x55e4caaced80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3348202830 con 0x55e4caa280a0 2024-04-25T09:13:09.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33480a90b0 con 0x55e4caa722f0 2024-04-25T09:13:09.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33480a84b0 con 0x55e4caa719d0 2024-04-25T09:13:09.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f334cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa280a0 0x55e4caace300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f334cc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa280a0 0x55e4caace300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51080/0 (socket says 172.21.15.175:51080) 2024-04-25T09:13:09.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f334cc00640 1 -- 172.21.15.175:0/147877597 learned_addr learned my addr 172.21.15.175:0/147877597 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:09.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3347e00640 1 --2- 172.21.15.175:0/147877597 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa719d0 0x55e4caace840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f334d600640 1 --2- 172.21.15.175:0/147877597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa722f0 0x55e4caaced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f334cc00640 1 -- 172.21.15.175:0/147877597 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa719d0 msgr2=0x55e4caace840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f334cc00640 1 --2- 172.21.15.175:0/147877597 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa719d0 0x55e4caace840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f334cc00640 1 -- 172.21.15.175:0/147877597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa722f0 msgr2=0x55e4caaced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f334cc00640 1 --2- 172.21.15.175:0/147877597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa722f0 0x55e4caaced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f334cc00640 1 -- 172.21.15.175:0/147877597 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4ca8bbde0 con 0x55e4caa280a0 2024-04-25T09:13:09.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f334d600640 1 --2- 172.21.15.175:0/147877597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa722f0 0x55e4caaced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:09.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f334cc00640 1 --2- 172.21.15.175:0/147877597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa280a0 0x55e4caace300 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f333801cd90 tx=0x7f33380c4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470f8a40fe3e8947 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f333cc00640 1 -- 172.21.15.175:0/147877597 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338117e60 con 0x55e4caa280a0 2024-04-25T09:13:09.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f333cc00640 1 -- 172.21.15.175:0/147877597 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33380f8ff0 con 0x55e4caa280a0 2024-04-25T09:13:09.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f333cc00640 1 -- 172.21.15.175:0/147877597 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33380eebe0 con 0x55e4caa280a0 2024-04-25T09:13:09.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 -- 172.21.15.175:0/147877597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa280a0 msgr2=0x55e4caace300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 --2- 172.21.15.175:0/147877597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa280a0 0x55e4caace300 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f333801cd90 tx=0x7f33380c4000 comp rx=0 tx=0).stop 2024-04-25T09:13:09.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 -- 172.21.15.175:0/147877597 shutdown_connections 2024-04-25T09:13:09.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 --2- 172.21.15.175:0/147877597 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa722f0 0x55e4caaced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 --2- 172.21.15.175:0/147877597 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa719d0 0x55e4caace840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 --2- 172.21.15.175:0/147877597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa280a0 0x55e4caace300 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 -- 172.21.15.175:0/147877597 >> 172.21.15.175:0/147877597 conn(0x55e4caa24020 msgr2=0x55e4caa7efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:09.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 -- 172.21.15.175:0/147877597 shutdown_connections 2024-04-25T09:13:09.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 -- 172.21.15.175:0/147877597 wait complete. 2024-04-25T09:13:09.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 -- start start 2024-04-25T09:13:09.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 Processor -- start 2024-04-25T09:13:09.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa280a0 0x55e4caa84770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa719d0 0x55e4caa84cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa722f0 0x55e4caa851f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca80fe00 con 0x55e4caa722f0 2024-04-25T09:13:09.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33480a8ab0 con 0x55e4caa280a0 2024-04-25T09:13:09.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4ca874300 con 0x55e4caa719d0 2024-04-25T09:13:09.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3352ab1000 10 client.0 _ll_register_callbacks cb 0x55e4ca9f3040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:13:09.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f334d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa722f0 0x55e4caa851f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f334d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa722f0 0x55e4caa851f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51088/0 (socket says 172.21.15.175:51088) 2024-04-25T09:13:09.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f334d600640 1 -- 172.21.15.175:0/32112906 learned_addr learned my addr 172.21.15.175:0/32112906 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:09.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f3347e00640 1 --2- 172.21.15.175:0/32112906 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa719d0 0x55e4caa84cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.072+0000 7f334cc00640 1 --2- 172.21.15.175:0/32112906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa280a0 0x55e4caa84770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334d600640 1 -- 172.21.15.175:0/32112906 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa719d0 msgr2=0x55e4caa84cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334d600640 1 --2- 172.21.15.175:0/32112906 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa719d0 0x55e4caa84cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334d600640 1 -- 172.21.15.175:0/32112906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa280a0 msgr2=0x55e4caa84770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334d600640 1 --2- 172.21.15.175:0/32112906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa280a0 0x55e4caa84770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334d600640 1 -- 172.21.15.175:0/32112906 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4ca8168e0 con 0x55e4caa722f0 2024-04-25T09:13:09.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334cc00640 1 --2- 172.21.15.175:0/32112906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa280a0 0x55e4caa84770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:09.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334d600640 1 --2- 172.21.15.175:0/32112906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa722f0 0x55e4caa851f0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f3340014390 tx=0x7f3340014850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352c4b430951c435 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3332000640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:13:09.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3332000640 1 -- 172.21.15.175:0/32112906 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334001c070 con 0x55e4caa722f0 2024-04-25T09:13:09.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3332000640 1 -- 172.21.15.175:0/32112906 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3340017880 con 0x55e4caa722f0 2024-04-25T09:13:09.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 1 -- 172.21.15.175:0/32112906 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f33380f8ff0 con 0x55e4caa722f0 2024-04-25T09:13:09.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3332000640 1 -- 172.21.15.175:0/32112906 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3340027050 con 0x55e4caa722f0 2024-04-25T09:13:09.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 10 client.8382 fetch_fsmap learned FSMap version 78 2024-04-25T09:13:09.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 1 -- 172.21.15.175:0/32112906 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55e4ca8ce8f0 con 0x55e4caa722f0 2024-04-25T09:13:09.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3332000640 1 -- 172.21.15.175:0/32112906 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33380f8ff0 con 0x55e4caa722f0 2024-04-25T09:13:09.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3332000640 1 -- 172.21.15.175:0/32112906 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f334002a020 con 0x55e4caa722f0 2024-04-25T09:13:09.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 10 client.8382 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:13:09.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 10 client.8382 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:13:09.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 20 client.8382 populate_metadata read hostname 'smithi175' 2024-04-25T09:13:09.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 1 --2- 172.21.15.175:0/32112906 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55e4caad7f50 0x55e4caada340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 4 client.8382 mds_command: new command op to 8067 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:13:09.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 1 -- 172.21.15.175:0/32112906 --> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e4ca882530 con 0x55e4caad7f50 2024-04-25T09:13:09.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334cc00640 1 --2- 172.21.15.175:0/32112906 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55e4caad7f50 0x55e4caada340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334cc00640 1 --2- 172.21.15.175:0/32112906 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55e4caad7f50 0x55e4caada340 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da68f6465860b467 server_cookie=5c01e3f29032a238 in_seq=0 out_seq=0 2024-04-25T09:13:09.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3332000640 10 client.8382 ms_handle_connect on v2:172.21.15.175:6835/3952378765 2024-04-25T09:13:09.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3332000640 1 -- 172.21.15.175:0/32112906 <== mds.0 v2:172.21.15.175:6835/3952378765 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e4ca882530 con 0x55e4caad7f50 2024-04-25T09:13:09.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3332000640 10 client.8382 handle_command_reply: tid=0 2024-04-25T09:13:09.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 1 client.8382 shutdown 2024-04-25T09:13:09.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 1 -- 172.21.15.175:0/32112906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa722f0 msgr2=0x55e4caa851f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 1 --2- 172.21.15.175:0/32112906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa722f0 0x55e4caa851f0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f3340014390 tx=0x7f3340014850 comp rx=0 tx=0).stop 2024-04-25T09:13:09.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 1 -- 172.21.15.175:0/32112906 shutdown_connections 2024-04-25T09:13:09.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 1 --2- 172.21.15.175:0/32112906 >> [v2:172.21.15.175:6835/3952378765,v1:172.21.15.175:6837/3952378765] conn(0x55e4caad7f50 0x55e4caada340 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 1 --2- 172.21.15.175:0/32112906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55e4caa722f0 0x55e4caa851f0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 1 --2- 172.21.15.175:0/32112906 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55e4caa719d0 0x55e4caa84cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 1 --2- 172.21.15.175:0/32112906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55e4caa280a0 0x55e4caa84770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3332000640 0 client.8382 ms_handle_reset on v2:172.21.15.175:6835/3952378765 2024-04-25T09:13:09.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 1 -- 172.21.15.175:0/32112906 >> 172.21.15.175:0/32112906 conn(0x55e4caa24020 msgr2=0x55e4caa700a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:09.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 1 -- 172.21.15.175:0/32112906 shutdown_connections 2024-04-25T09:13:09.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 1 -- 172.21.15.175:0/32112906 wait complete. 2024-04-25T09:13:09.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f3352ab1000 20 client.8382 trim_cache size 0 max 16384 2024-04-25T09:13:09.068 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:13:09.069 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "no active scrubs running", 2024-04-25T09:13:09.069 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": {} 2024-04-25T09:13:09.069 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:13:09.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334f600640 1 -- 172.21.15.175:0/2867584146 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3328066f60 msgr2=0x7f3328069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334f600640 1 --2- 172.21.15.175:0/2867584146 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3328066f60 0x7f3328069420 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3334007fd0 tx=0x7f3334007900 comp rx=0 tx=0).stop 2024-04-25T09:13:09.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334f600640 1 -- 172.21.15.175:0/2867584146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33480ce970 msgr2=0x7f33481422f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334f600640 1 --2- 172.21.15.175:0/2867584146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33480ce970 0x7f33481422f0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f333801a4e0 tx=0x7f3338019650 comp rx=0 tx=0).stop 2024-04-25T09:13:09.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334f600640 1 -- 172.21.15.175:0/2867584146 shutdown_connections 2024-04-25T09:13:09.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334f600640 1 --2- 172.21.15.175:0/2867584146 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3328066f60 0x7f3328069420 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334f600640 1 --2- 172.21.15.175:0/2867584146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33481600a0 0x7f33481414f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334f600640 1 --2- 172.21.15.175:0/2867584146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3348145250 0x7f33480b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334f600640 1 --2- 172.21.15.175:0/2867584146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33480ce970 0x7f33481422f0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334f600640 1 -- 172.21.15.175:0/2867584146 >> 172.21.15.175:0/2867584146 conn(0x7f334806ac50 msgr2=0x7f33480cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:09.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334f600640 1 -- 172.21.15.175:0/2867584146 shutdown_connections 2024-04-25T09:13:09.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.076+0000 7f334f600640 1 -- 172.21.15.175:0/2867584146 wait complete. 2024-04-25T09:13:09.084 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:13:09.185 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:13:09.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.336+0000 7f4035e00640 1 Processor -- start 2024-04-25T09:13:09.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.336+0000 7f4035e00640 1 -- start start 2024-04-25T09:13:09.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.336+0000 7f4035e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f403015bac0 0x7f40300cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.336+0000 7f4035e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40300b2f20 con 0x7f40300b1950 2024-04-25T09:13:09.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.336+0000 7f4035e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40300ccc50 con 0x7f403006ac50 2024-04-25T09:13:09.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.336+0000 7f4035e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40300cd580 con 0x7f403015bac0 2024-04-25T09:13:09.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.336+0000 7f4034a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f403015bac0 0x7f40300cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.336+0000 7f4035400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f40300b1950 0x7f40300b33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:52674/0 (socket says 172.21.15.175:52674) 2024-04-25T09:13:09.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.336+0000 7f4035400640 1 -- 172.21.15.175:0/1918195367 learned_addr learned my addr 172.21.15.175:0/1918195367 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:09.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.336+0000 7f402f400640 1 -- 172.21.15.175:0/1918195367 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673397028 0 0) 0x7f40280014a0 con 0x7f40300b1950 2024-04-25T09:13:09.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.336+0000 7f4034a00640 1 -- 172.21.15.175:0/1918195367 >> v1:172.21.15.177:6789/0 conn(0x7f403006ac50 legacy=0x7f40300b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.336+0000 7f4034a00640 1 -- 172.21.15.175:0/1918195367 >> v1:172.21.15.175:6789/0 conn(0x7f40300b1950 legacy=0x7f40300b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.336+0000 7f4034a00640 1 -- 172.21.15.175:0/1918195367 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40300ccf30 con 0x7f403015bac0 2024-04-25T09:13:09.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.340+0000 7f4034a00640 1 --2- 172.21.15.175:0/1918195367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f403015bac0 0x7f40300cda10 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f40240097c0 tx=0x7f402401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20edad42245d8027 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.340+0000 7f402f400640 1 -- 172.21.15.175:0/1918195367 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40240ab610 con 0x7f403015bac0 2024-04-25T09:13:09.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.340+0000 7f402f400640 1 -- 172.21.15.175:0/1918195367 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40240b0070 con 0x7f403015bac0 2024-04-25T09:13:09.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.340+0000 7f402f400640 1 -- 172.21.15.175:0/1918195367 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40240ab9d0 con 0x7f403015bac0 2024-04-25T09:13:09.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.340+0000 7f4035e00640 1 -- 172.21.15.175:0/1918195367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f403015bac0 msgr2=0x7f40300cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.340+0000 7f4035e00640 1 --2- 172.21.15.175:0/1918195367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f403015bac0 0x7f40300cda10 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f40240097c0 tx=0x7f402401c470 comp rx=0 tx=0).stop 2024-04-25T09:13:09.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.340+0000 7f4035e00640 1 -- 172.21.15.175:0/1918195367 shutdown_connections 2024-04-25T09:13:09.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.340+0000 7f4035e00640 1 --2- 172.21.15.175:0/1918195367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f403015bac0 0x7f40300cda10 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.340+0000 7f4035e00640 1 -- 172.21.15.175:0/1918195367 >> 172.21.15.175:0/1918195367 conn(0x7f4030099a50 msgr2=0x7f40300b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:09.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.340+0000 7f4035e00640 1 -- 172.21.15.175:0/1918195367 shutdown_connections 2024-04-25T09:13:09.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.340+0000 7f4035e00640 1 -- 172.21.15.175:0/1918195367 wait complete. 2024-04-25T09:13:09.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4035e00640 1 Processor -- start 2024-04-25T09:13:09.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4035e00640 1 -- start start 2024-04-25T09:13:09.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4035e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f403006ac50 0x7f403014f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4035e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40300b1950 0x7f4030148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4035e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4030154ce0 0x7f40300cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4035e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40300b4070 con 0x7f403006ac50 2024-04-25T09:13:09.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4035e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40300b3ef0 con 0x7f4030154ce0 2024-04-25T09:13:09.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4035e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4030169d90 con 0x7f40300b1950 2024-04-25T09:13:09.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4034a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f403006ac50 0x7f403014f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4034a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f403006ac50 0x7f403014f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38842/0 (socket says 172.21.15.175:38842) 2024-04-25T09:13:09.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4034a00640 1 -- 172.21.15.175:0/3873726274 learned_addr learned my addr 172.21.15.175:0/3873726274 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:09.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4035400640 1 --2- 172.21.15.175:0/3873726274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4030154ce0 0x7f40300cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f402fe00640 1 --2- 172.21.15.175:0/3873726274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40300b1950 0x7f4030148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4034a00640 1 -- 172.21.15.175:0/3873726274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40300b1950 msgr2=0x7f4030148640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4034a00640 1 --2- 172.21.15.175:0/3873726274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40300b1950 0x7f4030148640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4034a00640 1 -- 172.21.15.175:0/3873726274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4030154ce0 msgr2=0x7f40300cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4034a00640 1 --2- 172.21.15.175:0/3873726274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4030154ce0 0x7f40300cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4034a00640 1 -- 172.21.15.175:0/3873726274 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4030157df0 con 0x7f403006ac50 2024-04-25T09:13:09.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f402fe00640 1 --2- 172.21.15.175:0/3873726274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40300b1950 0x7f4030148640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:09.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4034a00640 1 --2- 172.21.15.175:0/3873726274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f403006ac50 0x7f403014f900 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f40240097c0 tx=0x7f402401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f402cc00640 1 -- 172.21.15.175:0/3873726274 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024004230 con 0x7f403006ac50 2024-04-25T09:13:09.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f402cc00640 1 -- 172.21.15.175:0/3873726274 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40240043d0 con 0x7f403006ac50 2024-04-25T09:13:09.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f402cc00640 1 -- 172.21.15.175:0/3873726274 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024003820 con 0x7f403006ac50 2024-04-25T09:13:09.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4035e00640 1 -- 172.21.15.175:0/3873726274 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f403014fe40 con 0x7f403006ac50 2024-04-25T09:13:09.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.344+0000 7f4035e00640 1 -- 172.21.15.175:0/3873726274 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40301503f0 con 0x7f403006ac50 2024-04-25T09:13:09.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.348+0000 7f4035e00640 1 -- 172.21.15.175:0/3873726274 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4030074a60 con 0x7f403006ac50 2024-04-25T09:13:09.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.348+0000 7f402cc00640 1 -- 172.21.15.175:0/3873726274 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f40240039c0 con 0x7f403006ac50 2024-04-25T09:13:09.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.348+0000 7f402cc00640 1 --2- 172.21.15.175:0/3873726274 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4010066f60 0x7f4010069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.348+0000 7f402cc00640 1 -- 172.21.15.175:0/3873726274 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f402411f7d0 con 0x7f403006ac50 2024-04-25T09:13:09.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.348+0000 7f402fe00640 1 --2- 172.21.15.175:0/3873726274 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4010066f60 0x7f4010069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.336 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.348+0000 7f402fe00640 1 --2- 172.21.15.175:0/3873726274 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4010066f60 0x7f4010069420 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4030066fd0 tx=0x7f401c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.352+0000 7f402cc00640 1 -- 172.21.15.175:0/3873726274 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f40240c6030 con 0x7f403006ac50 2024-04-25T09:13:09.508 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:13:09.511 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:13:09.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.544+0000 7f4035e00640 1 -- 172.21.15.175:0/3873726274 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f40300b2500 con 0x7f403006ac50 2024-04-25T09:13:09.530 INFO:tasks.ceph.mon.a.smithi175.stderr:2024-04-25T09:13:09.544+0000 7feb0ee00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:13:09.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.544+0000 7f402cc00640 1 -- 172.21.15.175:0/3873726274 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v79) v1 ==== 161+0+0 (secure 0 0 0) 0x7f40240a8050 con 0x7f403006ac50 2024-04-25T09:13:09.533 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:13:09.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.548+0000 7f4035e00640 1 -- 172.21.15.175:0/3873726274 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4010066f60 msgr2=0x7f4010069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.548+0000 7f4035e00640 1 --2- 172.21.15.175:0/3873726274 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4010066f60 0x7f4010069420 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4030066fd0 tx=0x7f401c009040 comp rx=0 tx=0).stop 2024-04-25T09:13:09.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.548+0000 7f4035e00640 1 -- 172.21.15.175:0/3873726274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f403006ac50 msgr2=0x7f403014f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.548+0000 7f4035e00640 1 --2- 172.21.15.175:0/3873726274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f403006ac50 0x7f403014f900 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f40240097c0 tx=0x7f402401acb0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.548+0000 7f4035e00640 1 -- 172.21.15.175:0/3873726274 shutdown_connections 2024-04-25T09:13:09.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.548+0000 7f4035e00640 1 --2- 172.21.15.175:0/3873726274 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4010066f60 0x7f4010069420 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.548+0000 7f4035e00640 1 --2- 172.21.15.175:0/3873726274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4030154ce0 0x7f40300cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.548+0000 7f4035e00640 1 --2- 172.21.15.175:0/3873726274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40300b1950 0x7f4030148640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.548+0000 7f4035e00640 1 --2- 172.21.15.175:0/3873726274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f403006ac50 0x7f403014f900 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.548+0000 7f4035e00640 1 -- 172.21.15.175:0/3873726274 >> 172.21.15.175:0/3873726274 conn(0x7f4030099a50 msgr2=0x7f403006eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:09.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.548+0000 7f4035e00640 1 -- 172.21.15.175:0/3873726274 shutdown_connections 2024-04-25T09:13:09.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.548+0000 7f4035e00640 1 -- 172.21.15.175:0/3873726274 wait complete. 2024-04-25T09:13:09.547 INFO:tasks.ceph.mds.a.smithi175.stderr: -6869> 2024-04-25T09:12:29.021+0000 7fc0ba000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:13:09.557 DEBUG:teuthology.orchestra.run.smithi175:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627777 summary 2024-04-25T09:13:09.596 INFO:tasks.ceph.mds.a.smithi175.stdout:starting mds.a at 2024-04-25T09:13:09.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f41068c1400 1 -- start start 2024-04-25T09:13:09.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f41068c1400 1 Processor -- start 2024-04-25T09:13:09.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f41068c1400 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a1b6800 0x55899a299b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f41068c1400 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55899a0dfc00 0x55899a298b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f41068c1400 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55899a1b7000 0x55899a299600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f41068c1400 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55899aec2480 con 0x55899a1b6800 2024-04-25T09:13:09.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f41068c1400 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55899aec2600 con 0x55899a1b7000 2024-04-25T09:13:09.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f41068c1400 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55899aec2780 con 0x55899a0dfc00 2024-04-25T09:13:09.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f4104a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a1b6800 0x55899a299b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f4104a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a1b6800 0x55899a299b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38876/0 (socket says 172.21.15.175:38876) 2024-04-25T09:13:09.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f4104a00640 1 -- 172.21.15.175:0/2821085473 learned_addr learned my addr 172.21.15.175:0/2821085473 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:09.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f4104000640 1 --2- 172.21.15.175:0/2821085473 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55899a0dfc00 0x55899a298b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f4105400640 1 --2- 172.21.15.175:0/2821085473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55899a1b7000 0x55899a299600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f4104a00640 1 -- 172.21.15.175:0/2821085473 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55899a0dfc00 msgr2=0x55899a298b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f4104a00640 1 --2- 172.21.15.175:0/2821085473 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55899a0dfc00 0x55899a298b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f4104a00640 1 -- 172.21.15.175:0/2821085473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55899a1b7000 msgr2=0x55899a299600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f4104a00640 1 --2- 172.21.15.175:0/2821085473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55899a1b7000 0x55899a299600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f4104a00640 1 -- 172.21.15.175:0/2821085473 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55899a180b40 con 0x55899a1b6800 2024-04-25T09:13:09.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f4105400640 1 --2- 172.21.15.175:0/2821085473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55899a1b7000 0x55899a299600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:09.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f4104a00640 1 --2- 172.21.15.175:0/2821085473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a1b6800 0x55899a299b80 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x55899af35350 tx=0x55899affa000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6492289e5d0a4713 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f4101800640 1 -- 172.21.15.175:0/2821085473 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55899a114b60 con 0x55899a1b6800 2024-04-25T09:13:09.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f4101800640 1 -- 172.21.15.175:0/2821085473 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55899a1281c0 con 0x55899a1b6800 2024-04-25T09:13:09.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f4101800640 1 -- 172.21.15.175:0/2821085473 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55899a114340 con 0x55899a1b6800 2024-04-25T09:13:09.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f41068c1400 1 -- 172.21.15.175:0/2821085473 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55899a1810e0 con 0x55899a1b6800 2024-04-25T09:13:09.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f41068c1400 1 -- 172.21.15.175:0/2821085473 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55899a1812c0 con 0x55899a1b6800 2024-04-25T09:13:09.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f41068c1400 4 waiting for MDS map... 2024-04-25T09:13:09.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f4101800640 1 -- 172.21.15.175:0/2821085473 <== mon.0 v2:172.21.15.175:3300/0 4 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x55899af58400 con 0x55899a1b6800 2024-04-25T09:13:09.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f4101800640 1 -- 172.21.15.175:0/2821085473 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 79) v1 ==== 2723+0+0 (secure 0 0 0) 0x55899a135180 con 0x55899a1b6800 2024-04-25T09:13:09.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f41068c1400 4 Got MDS map 79 2024-04-25T09:13:09.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f41068c1400 10 main: JournalTool::main 2024-04-25T09:13:09.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.656+0000 7f41068c1400 4 main: JournalTool: connecting to RADOS... 2024-04-25T09:13:09.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 Processor -- start 2024-04-25T09:13:09.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 -- start start 2024-04-25T09:13:09.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55899a1b6400 0x55899a29a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55899a1b6000 0x55899a29a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899affcc00 0x55899a29ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55899a13e180 con 0x55899affcc00 2024-04-25T09:13:09.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55899aec2f00 con 0x55899a1b6000 2024-04-25T09:13:09.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55899aec3080 con 0x55899a1b6400 2024-04-25T09:13:09.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f4104000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899affcc00 0x55899a29ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f4104000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899affcc00 0x55899a29ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38888/0 (socket says 172.21.15.175:38888) 2024-04-25T09:13:09.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f4104000640 1 -- 172.21.15.175:0/927311102 learned_addr learned my addr 172.21.15.175:0/927311102 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:09.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f4104a00640 1 --2- 172.21.15.175:0/927311102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55899a1b6000 0x55899a29a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f4105400640 1 --2- 172.21.15.175:0/927311102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55899a1b6400 0x55899a29a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f4104000640 1 -- 172.21.15.175:0/927311102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55899a1b6400 msgr2=0x55899a29a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f4104000640 1 --2- 172.21.15.175:0/927311102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55899a1b6400 0x55899a29a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f4104000640 1 -- 172.21.15.175:0/927311102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55899a1b6000 msgr2=0x55899a29a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f4104000640 1 --2- 172.21.15.175:0/927311102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55899a1b6000 0x55899a29a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f4104000640 1 -- 172.21.15.175:0/927311102 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55899a1801e0 con 0x55899affcc00 2024-04-25T09:13:09.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f4104000640 1 --2- 172.21.15.175:0/927311102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899affcc00 0x55899a29ac00 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x55899b0108d0 tx=0x55899aec4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d1c8fa467e0c16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f40ff000640 1 -- 172.21.15.175:0/927311102 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55899a114b60 con 0x55899affcc00 2024-04-25T09:13:09.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f40ff000640 1 -- 172.21.15.175:0/927311102 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55899a128c40 con 0x55899affcc00 2024-04-25T09:13:09.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f40ff000640 1 -- 172.21.15.175:0/927311102 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55899a114340 con 0x55899affcc00 2024-04-25T09:13:09.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 -- 172.21.15.175:0/927311102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899affcc00 msgr2=0x55899a29ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 --2- 172.21.15.175:0/927311102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899affcc00 0x55899a29ac00 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x55899b0108d0 tx=0x55899aec4000 comp rx=0 tx=0).stop 2024-04-25T09:13:09.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 -- 172.21.15.175:0/927311102 shutdown_connections 2024-04-25T09:13:09.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 --2- 172.21.15.175:0/927311102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899affcc00 0x55899a29ac00 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 --2- 172.21.15.175:0/927311102 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55899a1b6000 0x55899a29a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 --2- 172.21.15.175:0/927311102 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55899a1b6400 0x55899a29a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 -- 172.21.15.175:0/927311102 >> 172.21.15.175:0/927311102 conn(0x55899a1b7400 msgr2=0x55899b062000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:09.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 -- 172.21.15.175:0/927311102 shutdown_connections 2024-04-25T09:13:09.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 -- 172.21.15.175:0/927311102 wait complete. 2024-04-25T09:13:09.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 Processor -- start 2024-04-25T09:13:09.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.660+0000 7f41068c1400 1 -- start start 2024-04-25T09:13:09.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f41068c1400 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55899a1b6400 0x55899a29a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f41068c1400 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55899a1b6000 0x55899a29a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f41068c1400 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899affdc00 0x55899a29ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f41068c1400 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55899aec3380 con 0x55899affdc00 2024-04-25T09:13:09.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f41068c1400 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55899aec3200 con 0x55899a1b6000 2024-04-25T09:13:09.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f41068c1400 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55899aec3500 con 0x55899a1b6400 2024-04-25T09:13:09.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f4104000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899affdc00 0x55899a29ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f4104000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899affdc00 0x55899a29ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38890/0 (socket says 172.21.15.175:38890) 2024-04-25T09:13:09.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f4104000640 1 -- 172.21.15.175:0/957107913 learned_addr learned my addr 172.21.15.175:0/957107913 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:09.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f4104a00640 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55899a1b6000 0x55899a29a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f4105400640 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55899a1b6400 0x55899a29a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f4104000640 1 -- 172.21.15.175:0/957107913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55899a1b6400 msgr2=0x55899a29a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f4104000640 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55899a1b6400 0x55899a29a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f4104000640 1 -- 172.21.15.175:0/957107913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55899a1b6000 msgr2=0x55899a29a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f4104000640 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55899a1b6000 0x55899a29a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f4104000640 1 -- 172.21.15.175:0/957107913 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55899a181c20 con 0x55899affdc00 2024-04-25T09:13:09.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f4104000640 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899affdc00 0x55899a29ac00 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x55899b011590 tx=0x55899a1a1680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f40fd200640 1 -- 172.21.15.175:0/957107913 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55899a114b60 con 0x55899affdc00 2024-04-25T09:13:09.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f40fd200640 1 -- 172.21.15.175:0/957107913 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55899a128a80 con 0x55899affdc00 2024-04-25T09:13:09.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f41068c1400 1 -- 172.21.15.175:0/957107913 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55899a181e00 con 0x55899affdc00 2024-04-25T09:13:09.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f40fd200640 1 -- 172.21.15.175:0/957107913 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55899a114340 con 0x55899affdc00 2024-04-25T09:13:09.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f41068c1400 1 -- 172.21.15.175:0/957107913 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55899a181c20 con 0x55899affdc00 2024-04-25T09:13:09.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f41068c1400 4 main: JournalTool: resolving pool 14 2024-04-25T09:13:09.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f40fd200640 1 -- 172.21.15.175:0/957107913 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x55899b066c00 con 0x55899affdc00 2024-04-25T09:13:09.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f40fd200640 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55899b05cc00 0x55899a504000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f40fd200640 1 -- 172.21.15.175:0/957107913 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x55899a422400 con 0x55899affdc00 2024-04-25T09:13:09.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.664+0000 7f41068c1400 4 main: JournalTool: creating IoCtx.. 2024-04-25T09:13:09.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.668+0000 7f41068c1400 4 main: Executing for rank 0 2024-04-25T09:13:09.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.668+0000 7f41068c1400 4 Filtering by inode '1099511627777' 2024-04-25T09:13:09.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.668+0000 7f41068c1400 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55899affd800 0x55899a29b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.668+0000 7f41068c1400 1 -- 172.21.15.175:0/957107913 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101) v9 -- 0x55899affd400 con 0x55899affd800 2024-04-25T09:13:09.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.668+0000 7f4105400640 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55899b05cc00 0x55899a504000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.668+0000 7f4104a00640 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55899affd800 0x55899a29b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.668+0000 7f4105400640 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55899b05cc00 0x55899a504000 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x55899a12fa40 tx=0x55899a1a16e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.668+0000 7f4104a00640 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55899affd800 0x55899a29b180 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.668+0000 7f4104a00640 1 -- 172.21.15.175:0/957107913 <== osd.7 v2:172.21.15.177:6800/3881136076 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55899a25a000 con 0x55899affd800 2024-04-25T09:13:09.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.668+0000 7f41068c1400 4 Pointer 400.00000000 is readable 2024-04-25T09:13:09.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.668+0000 7f41068c1400 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-25T09:13:09.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.668+0000 7f41068c1400 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55899affd000 0x55899a29b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.668+0000 7f41068c1400 1 -- 172.21.15.175:0/957107913 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:2 14.14 14:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101) v9 -- 0x55899affcc00 con 0x55899affd000 2024-04-25T09:13:09.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.668+0000 7f4105400640 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55899affd000 0x55899a29b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.657 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.668+0000 7f4105400640 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55899affd000 0x55899a29b700 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.672+0000 7f4105400640 1 -- 172.21.15.175:0/957107913 <== osd.4 v2:172.21.15.177:6808/236493968 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv32 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55899a25a500 con 0x55899affd000 2024-04-25T09:13:09.659 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.672+0000 7f41068c1400 10 Header 0x400000 0x407953 0x407ccf 2024-04-25T09:13:09.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.672+0000 7f41068c1400 10 Starting journal scan from offset 0x407953 2024-04-25T09:13:09.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.672+0000 7f41068c1400 1 -- 172.21.15.175:0/957107913 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:3 14.14 14:2e2fa760:::200.00000001:head [read 31059~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101) v9 -- 0x55899b05d000 con 0x55899affd000 2024-04-25T09:13:09.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.672+0000 7f4105400640 1 -- 172.21.15.175:0/957107913 <== osd.4 v2:172.21.15.177:6808/236493968 2 ==== osd_op_reply(3 200.00000001 [read 31059~892 out=892b] v0'0 uv29 ondisk = 0) v8 ==== 156+0+892 (crc 0 0 0) 0x55899a25a500 con 0x55899affd000 2024-04-25T09:13:09.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.672+0000 7f41068c1400 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-25T09:13:09.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.672+0000 7f41068c1400 10 Parsing data, 0x37c bytes available 2024-04-25T09:13:09.660 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.672+0000 7f41068c1400 10 Attempting decode at 0x407953 2024-04-25T09:13:09.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.672+0000 7f41068c1400 10 Consumed 0x37c bytes 2024-04-25T09:13:09.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.672+0000 7f41068c1400 10 Valid entry at 0x407953 2024-04-25T09:13:09.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.672+0000 7f41068c1400 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55899b05d400 0x55899a504580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.672+0000 7f41068c1400 1 -- 172.21.15.175:0/957107913 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:4 14.1b 14:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101) v9 -- 0x55899b05d800 con 0x55899b05d400 2024-04-25T09:13:09.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.672+0000 7f4104a00640 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55899b05d400 0x55899a504580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.661 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.672+0000 7f4104a00640 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55899b05d400 0x55899a504580 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f4104a00640 1 -- 172.21.15.175:0/957107913 <== osd.1 v2:172.21.15.175:6802/594808902 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55899a25a000 con 0x55899b05d400 2024-04-25T09:13:09.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 4 Reached end of journal objects 2024-04-25T09:13:09.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 4 Scanned objects, 0 missing, 1 valid 2024-04-25T09:13:09.663 INFO:teuthology.orchestra.run.smithi175.stdout:Events by type: 2024-04-25T09:13:09.664 INFO:teuthology.orchestra.run.smithi175.stdout:Errors: 0 2024-04-25T09:13:09.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 4 Events scanned, 0 gaps 2024-04-25T09:13:09.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 4 Found 1 valid events 2024-04-25T09:13:09.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 4 Selected 0 events events for processing 2024-04-25T09:13:09.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 4 0 events 2024-04-25T09:13:09.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 -- 172.21.15.175:0/957107913 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55899b05d400 msgr2=0x55899a504580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55899b05d400 0x55899a504580 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 -- 172.21.15.175:0/957107913 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55899affd000 msgr2=0x55899a29b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55899affd000 0x55899a29b700 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 -- 172.21.15.175:0/957107913 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55899affd800 msgr2=0x55899a29b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55899affd800 0x55899a29b180 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f4104000640 1 -- 172.21.15.175:0/957107913 reap_dead start 2024-04-25T09:13:09.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 -- 172.21.15.175:0/957107913 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55899b05cc00 msgr2=0x55899a504000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55899b05cc00 0x55899a504000 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x55899a12fa40 tx=0x55899a1a16e0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 -- 172.21.15.175:0/957107913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899affdc00 msgr2=0x55899a29ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899affdc00 0x55899a29ac00 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x55899b011590 tx=0x55899a1a1680 comp rx=0 tx=0).stop 2024-04-25T09:13:09.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 -- 172.21.15.175:0/957107913 shutdown_connections 2024-04-25T09:13:09.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55899b05cc00 0x55899a504000 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 --2- 172.21.15.175:0/957107913 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899affdc00 0x55899a29ac00 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 -- 172.21.15.175:0/957107913 >> 172.21.15.175:0/957107913 conn(0x55899a1b7400 msgr2=0x55899b062000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:09.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 -- 172.21.15.175:0/957107913 shutdown_connections 2024-04-25T09:13:09.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 -- 172.21.15.175:0/957107913 wait complete. 2024-04-25T09:13:09.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 -- 172.21.15.175:0/2821085473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a1b6800 msgr2=0x55899a299b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 --2- 172.21.15.175:0/2821085473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a1b6800 0x55899a299b80 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x55899af35350 tx=0x55899affa000 comp rx=0 tx=0).stop 2024-04-25T09:13:09.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 -- 172.21.15.175:0/2821085473 shutdown_connections 2024-04-25T09:13:09.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 --2- 172.21.15.175:0/2821085473 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55899a1b7000 0x55899a299600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 --2- 172.21.15.175:0/2821085473 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55899a0dfc00 0x55899a298b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 --2- 172.21.15.175:0/2821085473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55899a1b6800 0x55899a299b80 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 -- 172.21.15.175:0/2821085473 >> 172.21.15.175:0/2821085473 conn(0x55899a0dec00 msgr2=0x55899a10d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:09.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 -- 172.21.15.175:0/2821085473 shutdown_connections 2024-04-25T09:13:09.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.676+0000 7f41068c1400 1 -- 172.21.15.175:0/2821085473 wait complete. 2024-04-25T09:13:09.669 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627777', 'summary'] in time 0:00:00.112545, result: Events by type: Errors: 0 2024-04-25T09:13:09.669 DEBUG:teuthology.orchestra.run.smithi175:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627778 summary 2024-04-25T09:13:09.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f439c81a400 1 -- start start 2024-04-25T09:13:09.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f439c81a400 1 Processor -- start 2024-04-25T09:13:09.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f439c81a400 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed5f0d9800 0x55ed5f292580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f439c81a400 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ed5f0d9400 0x55ed5f292b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f439c81a400 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5f0d9000 0x55ed5f293080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f439c81a400 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed5f1cc780 con 0x55ed5f0d9000 2024-04-25T09:13:09.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f439c81a400 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed5f1cc600 con 0x55ed5f0d9800 2024-04-25T09:13:09.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f439c81a400 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed5f1cc480 con 0x55ed5f0d9400 2024-04-25T09:13:09.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f439b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5f0d9000 0x55ed5f293080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f439b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5f0d9000 0x55ed5f293080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38896/0 (socket says 172.21.15.175:38896) 2024-04-25T09:13:09.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f439b200640 1 -- 172.21.15.175:0/516779785 learned_addr learned my addr 172.21.15.175:0/516779785 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:09.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f439a800640 1 --2- 172.21.15.175:0/516779785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed5f0d9800 0x55ed5f292580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f4399e00640 1 --2- 172.21.15.175:0/516779785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ed5f0d9400 0x55ed5f292b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f439b200640 1 -- 172.21.15.175:0/516779785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ed5f0d9400 msgr2=0x55ed5f292b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f439b200640 1 --2- 172.21.15.175:0/516779785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ed5f0d9400 0x55ed5f292b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f439b200640 1 -- 172.21.15.175:0/516779785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed5f0d9800 msgr2=0x55ed5f292580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f439b200640 1 --2- 172.21.15.175:0/516779785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed5f0d9800 0x55ed5f292580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f439b200640 1 -- 172.21.15.175:0/516779785 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed5f170b40 con 0x55ed5f0d9000 2024-04-25T09:13:09.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.776+0000 7f439b200640 1 --2- 172.21.15.175:0/516779785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5f0d9000 0x55ed5f293080 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x55ed5ff3b380 tx=0x55ed5ffe4120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626208149a7a8096 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f4397600640 1 -- 172.21.15.175:0/516779785 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ed5f10e4e0 con 0x55ed5f0d9000 2024-04-25T09:13:09.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f4397600640 1 -- 172.21.15.175:0/516779785 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed5f122e00 con 0x55ed5f0d9000 2024-04-25T09:13:09.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f4397600640 1 -- 172.21.15.175:0/516779785 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ed5f10eb60 con 0x55ed5f0d9000 2024-04-25T09:13:09.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 -- 172.21.15.175:0/516779785 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed5f170d20 con 0x55ed5f0d9000 2024-04-25T09:13:09.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 -- 172.21.15.175:0/516779785 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55ed5f170f00 con 0x55ed5f0d9000 2024-04-25T09:13:09.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 4 waiting for MDS map... 2024-04-25T09:13:09.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f4397600640 1 -- 172.21.15.175:0/516779785 <== mon.0 v2:172.21.15.175:3300/0 4 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x55ed5fff2600 con 0x55ed5f0d9000 2024-04-25T09:13:09.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f4397600640 1 -- 172.21.15.175:0/516779785 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 79) v1 ==== 2723+0+0 (secure 0 0 0) 0x55ed5f12f180 con 0x55ed5f0d9000 2024-04-25T09:13:09.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 4 Got MDS map 79 2024-04-25T09:13:09.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 10 main: JournalTool::main 2024-04-25T09:13:09.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 4 main: JournalTool: connecting to RADOS... 2024-04-25T09:13:09.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 Processor -- start 2024-04-25T09:13:09.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 -- start start 2024-04-25T09:13:09.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ed5feacc00 0x55ed5f293600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed5fead000 0x55ed5f293b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5fead400 0x55ed5f294100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed5f1cc300 con 0x55ed5fead400 2024-04-25T09:13:09.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed5f1cc000 con 0x55ed5fead000 2024-04-25T09:13:09.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed5f138900 con 0x55ed5feacc00 2024-04-25T09:13:09.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f4399e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5fead400 0x55ed5f294100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439a800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed5fead000 0x55ed5f293b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f4399e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5fead400 0x55ed5f294100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38906/0 (socket says 172.21.15.175:38906) 2024-04-25T09:13:09.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f4399e00640 1 -- 172.21.15.175:0/2942762322 learned_addr learned my addr 172.21.15.175:0/2942762322 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:09.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f4399e00640 1 --2- 172.21.15.175:0/2942762322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ed5feacc00 0x55ed5f293600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439a800640 1 -- 172.21.15.175:0/2942762322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ed5feacc00 msgr2=0x55ed5f293600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439a800640 1 --2- 172.21.15.175:0/2942762322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ed5feacc00 0x55ed5f293600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439a800640 1 -- 172.21.15.175:0/2942762322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5fead400 msgr2=0x55ed5f294100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439a800640 1 --2- 172.21.15.175:0/2942762322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5fead400 0x55ed5f294100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439a800640 1 -- 172.21.15.175:0/2942762322 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed5f170d20 con 0x55ed5fead000 2024-04-25T09:13:09.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439a800640 1 --2- 172.21.15.175:0/2942762322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed5fead000 0x55ed5f293b80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x55ed5ff3a900 tx=0x55ed5f191e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5f2c506130271ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f4394e00640 1 -- 172.21.15.175:0/2942762322 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ed5f10e9c0 con 0x55ed5fead000 2024-04-25T09:13:09.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f4394e00640 1 -- 172.21.15.175:0/2942762322 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed5f122c40 con 0x55ed5fead000 2024-04-25T09:13:09.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f4394e00640 1 -- 172.21.15.175:0/2942762322 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ed5f10e4e0 con 0x55ed5fead000 2024-04-25T09:13:09.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 -- 172.21.15.175:0/2942762322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed5fead000 msgr2=0x55ed5f293b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 --2- 172.21.15.175:0/2942762322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed5fead000 0x55ed5f293b80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x55ed5ff3a900 tx=0x55ed5f191e60 comp rx=0 tx=0).stop 2024-04-25T09:13:09.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 -- 172.21.15.175:0/2942762322 shutdown_connections 2024-04-25T09:13:09.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 --2- 172.21.15.175:0/2942762322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5fead400 0x55ed5f294100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 --2- 172.21.15.175:0/2942762322 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed5fead000 0x55ed5f293b80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 --2- 172.21.15.175:0/2942762322 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ed5feacc00 0x55ed5f293600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 -- 172.21.15.175:0/2942762322 >> 172.21.15.175:0/2942762322 conn(0x55ed5f0d8c00 msgr2=0x55ed5f107800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:09.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 -- 172.21.15.175:0/2942762322 shutdown_connections 2024-04-25T09:13:09.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.780+0000 7f439c81a400 1 -- 172.21.15.175:0/2942762322 wait complete. 2024-04-25T09:13:09.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439c81a400 1 Processor -- start 2024-04-25T09:13:09.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439c81a400 1 -- start start 2024-04-25T09:13:09.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439c81a400 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed5feacc00 0x55ed5f295180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439c81a400 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5fead000 0x55ed5f294c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439c81a400 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ed5fead400 0x55ed5f294680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439c81a400 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed5f1cd380 con 0x55ed5fead000 2024-04-25T09:13:09.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439c81a400 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed5f1cc300 con 0x55ed5feacc00 2024-04-25T09:13:09.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439c81a400 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed5f1cd500 con 0x55ed5fead400 2024-04-25T09:13:09.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5fead000 0x55ed5f294c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5fead000 0x55ed5f294c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38914/0 (socket says 172.21.15.175:38914) 2024-04-25T09:13:09.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439a800640 1 -- 172.21.15.175:0/3692872437 learned_addr learned my addr 172.21.15.175:0/3692872437 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:09.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f4399e00640 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ed5fead400 0x55ed5f294680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f4399e00640 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed5feacc00 0x55ed5f295180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439a800640 1 -- 172.21.15.175:0/3692872437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ed5fead400 msgr2=0x55ed5f294680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439a800640 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ed5fead400 0x55ed5f294680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439a800640 1 -- 172.21.15.175:0/3692872437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed5feacc00 msgr2=0x55ed5f295180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439a800640 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed5feacc00 0x55ed5f295180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439a800640 1 -- 172.21.15.175:0/3692872437 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed5f171c20 con 0x55ed5fead000 2024-04-25T09:13:09.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439a800640 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5fead000 0x55ed5f294c00 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x55ed60000870 tx=0x55ed5f191da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f4393000640 1 -- 172.21.15.175:0/3692872437 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ed5f10eb60 con 0x55ed5fead000 2024-04-25T09:13:09.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f4393000640 1 -- 172.21.15.175:0/3692872437 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ed5f122a80 con 0x55ed5fead000 2024-04-25T09:13:09.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439c81a400 1 -- 172.21.15.175:0/3692872437 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ed5f171e00 con 0x55ed5fead000 2024-04-25T09:13:09.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f4393000640 1 -- 172.21.15.175:0/3692872437 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ed5f10e000 con 0x55ed5fead000 2024-04-25T09:13:09.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439c81a400 1 -- 172.21.15.175:0/3692872437 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed5f1701e0 con 0x55ed5fead000 2024-04-25T09:13:09.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.784+0000 7f439c81a400 4 main: JournalTool: resolving pool 14 2024-04-25T09:13:09.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f4393000640 1 -- 172.21.15.175:0/3692872437 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x55ed6005ac00 con 0x55ed5fead000 2024-04-25T09:13:09.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f4393000640 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55ed5f4f6000 0x55ed5f295700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f4393000640 1 -- 172.21.15.175:0/3692872437 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x55ed5f410600 con 0x55ed5fead000 2024-04-25T09:13:09.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439c81a400 4 main: JournalTool: creating IoCtx.. 2024-04-25T09:13:09.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439c81a400 4 main: Executing for rank 0 2024-04-25T09:13:09.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439c81a400 4 Filtering by inode '1099511627778' 2024-04-25T09:13:09.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439c81a400 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55ed5fead800 0x55ed5f294100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f4399e00640 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55ed5f4f6000 0x55ed5f295700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439c81a400 1 -- 172.21.15.175:0/3692872437 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101) v9 -- 0x55ed5feadc00 con 0x55ed5fead800 2024-04-25T09:13:09.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f4399e00640 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55ed5fead800 0x55ed5f294100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f4399e00640 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55ed5f4f6000 0x55ed5f295700 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x55ed60000660 tx=0x55ed5f40a060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f4399e00640 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55ed5fead800 0x55ed5f294100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f4399e00640 1 -- 172.21.15.175:0/3692872437 <== osd.7 v2:172.21.15.177:6800/3881136076 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55ed5f254000 con 0x55ed5fead800 2024-04-25T09:13:09.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439c81a400 4 Pointer 400.00000000 is readable 2024-04-25T09:13:09.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439c81a400 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-25T09:13:09.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439c81a400 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55ed5f4f7000 0x55ed5f293b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439c81a400 1 -- 172.21.15.175:0/3692872437 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:2 14.14 14:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101) v9 -- 0x55ed5f4f7400 con 0x55ed5f4f7000 2024-04-25T09:13:09.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439b200640 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55ed5f4f7000 0x55ed5f293b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439b200640 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55ed5f4f7000 0x55ed5f293b80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439b200640 1 -- 172.21.15.175:0/3692872437 <== osd.4 v2:172.21.15.177:6808/236493968 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv32 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55ed5f254500 con 0x55ed5f4f7000 2024-04-25T09:13:09.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439c81a400 10 Header 0x400000 0x407953 0x407ccf 2024-04-25T09:13:09.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439c81a400 10 Starting journal scan from offset 0x407953 2024-04-25T09:13:09.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439c81a400 1 -- 172.21.15.175:0/3692872437 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:3 14.14 14:2e2fa760:::200.00000001:head [read 31059~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101) v9 -- 0x55ed5f4f7800 con 0x55ed5f4f7000 2024-04-25T09:13:09.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439b200640 1 -- 172.21.15.175:0/3692872437 <== osd.4 v2:172.21.15.177:6808/236493968 2 ==== osd_op_reply(3 200.00000001 [read 31059~892 out=892b] v0'0 uv29 ondisk = 0) v8 ==== 156+0+892 (crc 0 0 0) 0x55ed5f254500 con 0x55ed5f4f7000 2024-04-25T09:13:09.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439c81a400 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-25T09:13:09.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439c81a400 10 Parsing data, 0x37c bytes available 2024-04-25T09:13:09.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439c81a400 10 Attempting decode at 0x407953 2024-04-25T09:13:09.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439c81a400 10 Consumed 0x37c bytes 2024-04-25T09:13:09.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.788+0000 7f439c81a400 10 Valid entry at 0x407953 2024-04-25T09:13:09.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55ed5f4f7c00 0x55ed5f293600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 -- 172.21.15.175:0/3692872437 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:4 14.1b 14:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e101) v9 -- 0x55ed5f508000 con 0x55ed5f4f7c00 2024-04-25T09:13:09.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439a800640 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55ed5f4f7c00 0x55ed5f293600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439a800640 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55ed5f4f7c00 0x55ed5f293600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439a800640 1 -- 172.21.15.175:0/3692872437 <== osd.1 v2:172.21.15.175:6802/594808902 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55ed5f254780 con 0x55ed5f4f7c00 2024-04-25T09:13:09.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 4 Reached end of journal objects 2024-04-25T09:13:09.781 INFO:teuthology.orchestra.run.smithi175.stdout:Events by type: 2024-04-25T09:13:09.781 INFO:teuthology.orchestra.run.smithi175.stdout:Errors: 0 2024-04-25T09:13:09.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 4 Scanned objects, 0 missing, 1 valid 2024-04-25T09:13:09.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 4 Events scanned, 0 gaps 2024-04-25T09:13:09.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 4 Found 1 valid events 2024-04-25T09:13:09.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 4 Selected 0 events events for processing 2024-04-25T09:13:09.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 4 0 events 2024-04-25T09:13:09.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 -- 172.21.15.175:0/3692872437 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55ed5f4f7c00 msgr2=0x55ed5f293600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55ed5f4f7c00 0x55ed5f293600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 -- 172.21.15.175:0/3692872437 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55ed5f4f7000 msgr2=0x55ed5f293b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x55ed5f4f7000 0x55ed5f293b80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 -- 172.21.15.175:0/3692872437 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55ed5fead800 msgr2=0x55ed5f294100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55ed5fead800 0x55ed5f294100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439a800640 1 -- 172.21.15.175:0/3692872437 reap_dead start 2024-04-25T09:13:09.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 -- 172.21.15.175:0/3692872437 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55ed5f4f6000 msgr2=0x55ed5f295700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55ed5f4f6000 0x55ed5f295700 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x55ed60000660 tx=0x55ed5f40a060 comp rx=0 tx=0).stop 2024-04-25T09:13:09.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 -- 172.21.15.175:0/3692872437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5fead000 msgr2=0x55ed5f294c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5fead000 0x55ed5f294c00 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x55ed60000870 tx=0x55ed5f191da0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 -- 172.21.15.175:0/3692872437 shutdown_connections 2024-04-25T09:13:09.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55ed5f4f6000 0x55ed5f295700 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 --2- 172.21.15.175:0/3692872437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5fead000 0x55ed5f294c00 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 -- 172.21.15.175:0/3692872437 >> 172.21.15.175:0/3692872437 conn(0x55ed5f0d8c00 msgr2=0x55ed5f107800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:09.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 -- 172.21.15.175:0/3692872437 shutdown_connections 2024-04-25T09:13:09.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 -- 172.21.15.175:0/3692872437 wait complete. 2024-04-25T09:13:09.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 -- 172.21.15.175:0/516779785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5f0d9000 msgr2=0x55ed5f293080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 --2- 172.21.15.175:0/516779785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5f0d9000 0x55ed5f293080 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x55ed5ff3b380 tx=0x55ed5ffe4120 comp rx=0 tx=0).stop 2024-04-25T09:13:09.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 -- 172.21.15.175:0/516779785 shutdown_connections 2024-04-25T09:13:09.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 --2- 172.21.15.175:0/516779785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ed5f0d9000 0x55ed5f293080 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 --2- 172.21.15.175:0/516779785 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ed5f0d9400 0x55ed5f292b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 --2- 172.21.15.175:0/516779785 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ed5f0d9800 0x55ed5f292580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 -- 172.21.15.175:0/516779785 >> 172.21.15.175:0/516779785 conn(0x55ed5f0d9c00 msgr2=0x55ed5f107000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:09.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 -- 172.21.15.175:0/516779785 shutdown_connections 2024-04-25T09:13:09.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.792+0000 7f439c81a400 1 -- 172.21.15.175:0/516779785 wait complete. 2024-04-25T09:13:09.785 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627778', 'summary'] in time 0:00:00.115190, result: Events by type: Errors: 0 2024-04-25T09:13:09.785 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2024-04-25T09:13:09.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bf2414080 1 Processor -- start 2024-04-25T09:13:09.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bf2414080 1 -- start start 2024-04-25T09:13:09.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bf2414080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640b8e65920 0x5640b8e8d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bf2414080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640b8e65d00 0x5640b8f43af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bf2414080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5640b8e92050 0x5640b8e86280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bf2414080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640b8e099f0 con 0x5640b8e65920 2024-04-25T09:13:09.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bf2414080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640b8e0d950 con 0x5640b8e65d00 2024-04-25T09:13:09.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bf2414080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640b8e92870 con 0x5640b8e92050 2024-04-25T09:13:09.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bef600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640b8e65920 0x5640b8e8d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bef600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640b8e65920 0x5640b8e8d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38946/0 (socket says 172.21.15.175:38946) 2024-04-25T09:13:09.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bef600640 1 -- 172.21.15.175:0/801957711 learned_addr learned my addr 172.21.15.175:0/801957711 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:09.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3beec00640 1 --2- 172.21.15.175:0/801957711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640b8e65d00 0x5640b8f43af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bf0000640 1 --2- 172.21.15.175:0/801957711 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5640b8e92050 0x5640b8e86280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bef600640 1 -- 172.21.15.175:0/801957711 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5640b8e92050 msgr2=0x5640b8e86280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bef600640 1 --2- 172.21.15.175:0/801957711 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5640b8e92050 0x5640b8e86280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bef600640 1 -- 172.21.15.175:0/801957711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640b8e65d00 msgr2=0x5640b8f43af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:09.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bef600640 1 --2- 172.21.15.175:0/801957711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640b8e65d00 0x5640b8f43af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bef600640 1 -- 172.21.15.175:0/801957711 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640b8e87db0 con 0x5640b8e65920 2024-04-25T09:13:09.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3beec00640 1 --2- 172.21.15.175:0/801957711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640b8e65d00 0x5640b8f43af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:09.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bef600640 1 --2- 172.21.15.175:0/801957711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640b8e65920 0x5640b8e8d940 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f3be000b330 tx=0x7f3be000b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2172035e82aefa6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bed800640 1 -- 172.21.15.175:0/801957711 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0012020 con 0x5640b8e65920 2024-04-25T09:13:09.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bed800640 1 -- 172.21.15.175:0/801957711 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be000e690 con 0x5640b8e65920 2024-04-25T09:13:09.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bed800640 1 -- 172.21.15.175:0/801957711 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be000ea60 con 0x5640b8e65920 2024-04-25T09:13:09.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bf2414080 1 -- 172.21.15.175:0/801957711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640b8e65920 msgr2=0x5640b8e8d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.844+0000 7f3bf2414080 1 --2- 172.21.15.175:0/801957711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640b8e65920 0x5640b8e8d940 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f3be000b330 tx=0x7f3be000b7f0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf2414080 1 -- 172.21.15.175:0/801957711 shutdown_connections 2024-04-25T09:13:09.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf2414080 1 --2- 172.21.15.175:0/801957711 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5640b8e92050 0x5640b8e86280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf2414080 1 --2- 172.21.15.175:0/801957711 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640b8e65d00 0x5640b8f43af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf2414080 1 --2- 172.21.15.175:0/801957711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640b8e65920 0x5640b8e8d940 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf2414080 1 -- 172.21.15.175:0/801957711 >> 172.21.15.175:0/801957711 conn(0x5640b8e63420 msgr2=0x5640b8e86db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:09.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf2414080 1 -- 172.21.15.175:0/801957711 shutdown_connections 2024-04-25T09:13:09.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf2414080 1 -- 172.21.15.175:0/801957711 wait complete. 2024-04-25T09:13:09.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf2414080 1 Processor -- start 2024-04-25T09:13:09.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf2414080 1 -- start start 2024-04-25T09:13:09.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf2414080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640b8e65920 0x5640b8f227b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf2414080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5640b8e65d00 0x5640b8ea9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf2414080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640b8e92050 0x5640b8eaa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf2414080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640b8e8f430 con 0x5640b8e65920 2024-04-25T09:13:09.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf2414080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640b8e88050 con 0x5640b8e92050 2024-04-25T09:13:09.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf2414080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640b8e8efd0 con 0x5640b8e65d00 2024-04-25T09:13:09.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bef600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640b8e65920 0x5640b8f227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bef600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640b8e65920 0x5640b8f227b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38958/0 (socket says 172.21.15.175:38958) 2024-04-25T09:13:09.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bef600640 1 -- 172.21.15.175:0/3831276528 learned_addr learned my addr 172.21.15.175:0/3831276528 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:09.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bef600640 1 -- 172.21.15.175:0/3831276528 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5640b8e65d00 msgr2=0x5640b8ea9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf0000640 1 --2- 172.21.15.175:0/3831276528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640b8e92050 0x5640b8eaa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3beec00640 1 --2- 172.21.15.175:0/3831276528 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5640b8e65d00 0x5640b8ea9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bef600640 1 --2- 172.21.15.175:0/3831276528 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5640b8e65d00 0x5640b8ea9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bef600640 1 -- 172.21.15.175:0/3831276528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640b8e92050 msgr2=0x5640b8eaa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bef600640 1 --2- 172.21.15.175:0/3831276528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640b8e92050 0x5640b8eaa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bef600640 1 -- 172.21.15.175:0/3831276528 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640b8e8cf10 con 0x5640b8e65920 2024-04-25T09:13:09.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf0000640 1 --2- 172.21.15.175:0/3831276528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5640b8e92050 0x5640b8eaa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:09.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3beec00640 1 --2- 172.21.15.175:0/3831276528 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5640b8e65d00 0x5640b8ea9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:09.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bef600640 1 --2- 172.21.15.175:0/3831276528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640b8e65920 0x5640b8f227b0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f3be0004180 tx=0x7f3be0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3be7e00640 1 -- 172.21.15.175:0/3831276528 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0027070 con 0x5640b8e65920 2024-04-25T09:13:09.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3be7e00640 1 -- 172.21.15.175:0/3831276528 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be00195c0 con 0x5640b8e65920 2024-04-25T09:13:09.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf2414080 1 -- 172.21.15.175:0/3831276528 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5640b8f23e60 con 0x5640b8e65920 2024-04-25T09:13:09.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3be7e00640 1 -- 172.21.15.175:0/3831276528 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0019990 con 0x5640b8e65920 2024-04-25T09:13:09.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.848+0000 7f3bf2414080 1 -- 172.21.15.175:0/3831276528 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5640b8f243a0 con 0x5640b8e65920 2024-04-25T09:13:09.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.852+0000 7f3be7e00640 1 -- 172.21.15.175:0/3831276528 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3be0015020 con 0x5640b8e65920 2024-04-25T09:13:09.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.852+0000 7f3be7e00640 1 --2- 172.21.15.175:0/3831276528 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3bd0065970 0x7f3bd0067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.852+0000 7f3be7e00640 1 -- 172.21.15.175:0/3831276528 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3be00855b0 con 0x5640b8e65920 2024-04-25T09:13:09.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.852+0000 7f3beec00640 1 --2- 172.21.15.175:0/3831276528 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3bd0065970 0x7f3bd0067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.852+0000 7f3bf2414080 1 --2- 172.21.15.175:0/3831276528 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x5640b8e88ac0 0x5640b8e88ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:09.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.852+0000 7f3bf2414080 1 -- 172.21.15.175:0/3831276528 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101) v9 -- 0x5640b8e893e0 con 0x5640b8e88ac0 2024-04-25T09:13:09.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.852+0000 7f3bf0000640 1 --2- 172.21.15.175:0/3831276528 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x5640b8e88ac0 0x5640b8e88ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:09.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.852+0000 7f3beec00640 1 --2- 172.21.15.175:0/3831276528 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3bd0065970 0x7f3bd0067e30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0ad000 tx=0x7f3bdc0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.852+0000 7f3bf0000640 1 --2- 172.21.15.175:0/3831276528 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x5640b8e88ac0 0x5640b8e88ea0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:09.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.856+0000 7f3bf0000640 1 -- 172.21.15.175:0/3831276528 <== osd.2 v2:172.21.15.175:6821/3247063283 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v101'5 uv5 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3be800e1d0 con 0x5640b8e88ac0 2024-04-25T09:13:09.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.856+0000 7f3bf2414080 1 -- 172.21.15.175:0/3831276528 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x5640b8e88ac0 msgr2=0x5640b8e88ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.856+0000 7f3bf2414080 1 --2- 172.21.15.175:0/3831276528 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x5640b8e88ac0 0x5640b8e88ea0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.856+0000 7f3bf2414080 1 -- 172.21.15.175:0/3831276528 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3bd0065970 msgr2=0x7f3bd0067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.856+0000 7f3bf2414080 1 --2- 172.21.15.175:0/3831276528 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3bd0065970 0x7f3bd0067e30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0ad000 tx=0x7f3bdc0a6000 comp rx=0 tx=0).stop 2024-04-25T09:13:09.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.856+0000 7f3bf2414080 1 -- 172.21.15.175:0/3831276528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640b8e65920 msgr2=0x5640b8f227b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:09.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.856+0000 7f3bf2414080 1 --2- 172.21.15.175:0/3831276528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5640b8e65920 0x5640b8f227b0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f3be0004180 tx=0x7f3be0000ee0 comp rx=0 tx=0).stop 2024-04-25T09:13:09.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.856+0000 7f3bf0000640 1 -- 172.21.15.175:0/3831276528 reap_dead start 2024-04-25T09:13:09.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.856+0000 7f3bf2414080 1 -- 172.21.15.175:0/3831276528 shutdown_connections 2024-04-25T09:13:09.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.856+0000 7f3bf2414080 1 -- 172.21.15.175:0/3831276528 >> 172.21.15.175:0/3831276528 conn(0x5640b8e63420 msgr2=0x5640b8e8d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:09.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.856+0000 7f3bf2414080 1 -- 172.21.15.175:0/3831276528 shutdown_connections 2024-04-25T09:13:09.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:09.856+0000 7f3bf2414080 1 -- 172.21.15.175:0/3831276528 wait complete. 2024-04-25T09:13:09.847 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T09:13:10.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.040+0000 7febcae00640 1 Processor -- start 2024-04-25T09:13:10.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.040+0000 7febcae00640 1 -- start start 2024-04-25T09:13:10.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.044+0000 7febcae00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7febc415af20 0x7febc40b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.044+0000 7febcae00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febc40b4630 0x7febc415c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.044+0000 7febcae00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc406db60 con 0x7febc40cbe60 2024-04-25T09:13:10.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.044+0000 7febcae00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc406de40 con 0x7febc415af20 2024-04-25T09:13:10.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.044+0000 7febcae00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc406e120 con 0x7febc40b4630 2024-04-25T09:13:10.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.044+0000 7febbbe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7febc415af20 0x7febc40b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.044+0000 7febbbe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7febc415af20 0x7febc40b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:40150/0 (socket says 172.21.15.175:40150) 2024-04-25T09:13:10.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.044+0000 7febbbe00640 1 -- 172.21.15.175:0/2652011891 learned_addr learned my addr 172.21.15.175:0/2652011891 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:10.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.044+0000 7febc3e00640 1 --1- 172.21.15.175:0/2652011891 >> v1:172.21.15.177:6789/0 conn(0x7febc40cbe60 0x7febc406d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:39202/0 (socket says 172.21.15.175:39202) 2024-04-25T09:13:10.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.044+0000 7febc8e00640 1 --2- 172.21.15.175:0/2652011891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febc40b4630 0x7febc415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.044+0000 7febbbe00640 1 -- 172.21.15.175:0/2652011891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febc40b4630 msgr2=0x7febc415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:10.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.044+0000 7febbbe00640 1 --2- 172.21.15.175:0/2652011891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febc40b4630 0x7febc415c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.044+0000 7febbbe00640 1 -- 172.21.15.175:0/2652011891 >> v1:172.21.15.177:6789/0 conn(0x7febc40cbe60 legacy=0x7febc406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.044+0000 7febbbe00640 1 -- 172.21.15.175:0/2652011891 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc415c2f0 con 0x7febc415af20 2024-04-25T09:13:10.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.044+0000 7febc3400640 1 -- 172.21.15.175:0/2652011891 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387525134 0 0) 0x7febc406db60 con 0x7febc40cbe60 2024-04-25T09:13:10.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febbbe00640 1 --2- 172.21.15.175:0/2652011891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febc415af20 0x7febc40b40f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7febac009870 tx=0x7febac01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=521009c8eda609e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:10.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febc3400640 1 -- 172.21.15.175:0/2652011891 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac0b2070 con 0x7febc415af20 2024-04-25T09:13:10.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febc3400640 1 -- 172.21.15.175:0/2652011891 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac0a9070 con 0x7febc415af20 2024-04-25T09:13:10.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febc3400640 1 -- 172.21.15.175:0/2652011891 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac0ad880 con 0x7febc415af20 2024-04-25T09:13:10.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febcae00640 1 -- 172.21.15.175:0/2652011891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febc415af20 msgr2=0x7febc40b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febcae00640 1 --2- 172.21.15.175:0/2652011891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febc415af20 0x7febc40b40f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7febac009870 tx=0x7febac01c560 comp rx=0 tx=0).stop 2024-04-25T09:13:10.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febcae00640 1 -- 172.21.15.175:0/2652011891 shutdown_connections 2024-04-25T09:13:10.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febcae00640 1 --2- 172.21.15.175:0/2652011891 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febc40b4630 0x7febc415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febcae00640 1 --2- 172.21.15.175:0/2652011891 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febc415af20 0x7febc40b40f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febcae00640 1 -- 172.21.15.175:0/2652011891 >> 172.21.15.175:0/2652011891 conn(0x7febc406ac50 msgr2=0x7febc406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:10.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febcae00640 1 -- 172.21.15.175:0/2652011891 shutdown_connections 2024-04-25T09:13:10.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febcae00640 1 -- 172.21.15.175:0/2652011891 wait complete. 2024-04-25T09:13:10.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febcae00640 1 Processor -- start 2024-04-25T09:13:10.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febcae00640 1 -- start start 2024-04-25T09:13:10.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febcae00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc40b4630 0x7febc41f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febcae00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febc40cbe60 0x7febc40cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febcae00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febc415af20 0x7febc40cf120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febcae00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc415d7f0 con 0x7febc40b4630 2024-04-25T09:13:10.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febcae00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc40cc450 con 0x7febc415af20 2024-04-25T09:13:10.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.048+0000 7febcae00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc415d970 con 0x7febc40cbe60 2024-04-25T09:13:10.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.052+0000 7febc3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc40b4630 0x7febc41f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.052+0000 7febc3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc40b4630 0x7febc41f5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38970/0 (socket says 172.21.15.175:38970) 2024-04-25T09:13:10.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.052+0000 7febc3e00640 1 -- 172.21.15.175:0/1831596752 learned_addr learned my addr 172.21.15.175:0/1831596752 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:10.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.052+0000 7febbbe00640 1 --2- 172.21.15.175:0/1831596752 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febc40cbe60 0x7febc40cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.052+0000 7febc8e00640 1 --2- 172.21.15.175:0/1831596752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febc415af20 0x7febc40cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.052+0000 7febc3e00640 1 -- 172.21.15.175:0/1831596752 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febc40cbe60 msgr2=0x7febc40cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.052+0000 7febc3e00640 1 --2- 172.21.15.175:0/1831596752 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febc40cbe60 0x7febc40cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.052+0000 7febc3e00640 1 -- 172.21.15.175:0/1831596752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febc415af20 msgr2=0x7febc40cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.052+0000 7febc3e00640 1 --2- 172.21.15.175:0/1831596752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febc415af20 0x7febc40cf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.052+0000 7febc3e00640 1 -- 172.21.15.175:0/1831596752 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc40ce080 con 0x7febc40b4630 2024-04-25T09:13:10.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.052+0000 7febc3e00640 1 --2- 172.21.15.175:0/1831596752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc40b4630 0x7febc41f5b50 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7febb400c480 tx=0x7febb400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:10.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.052+0000 7febc0c00640 1 -- 172.21.15.175:0/1831596752 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb4018070 con 0x7febc40b4630 2024-04-25T09:13:10.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.052+0000 7febc0c00640 1 -- 172.21.15.175:0/1831596752 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb4007500 con 0x7febc40b4630 2024-04-25T09:13:10.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.052+0000 7febcae00640 1 -- 172.21.15.175:0/1831596752 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc40ce360 con 0x7febc40b4630 2024-04-25T09:13:10.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.052+0000 7febc0c00640 1 -- 172.21.15.175:0/1831596752 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb4004a30 con 0x7febc40b4630 2024-04-25T09:13:10.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.052+0000 7febcae00640 1 -- 172.21.15.175:0/1831596752 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc40ce920 con 0x7febc40b4630 2024-04-25T09:13:10.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.052+0000 7febcae00640 1 -- 172.21.15.175:0/1831596752 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc4075160 con 0x7febc40b4630 2024-04-25T09:13:10.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.052+0000 7febc0c00640 1 -- 172.21.15.175:0/1831596752 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7febb401b070 con 0x7febc40b4630 2024-04-25T09:13:10.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.056+0000 7febc0c00640 1 --2- 172.21.15.175:0/1831596752 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feba0066f60 0x7feba0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.056+0000 7febc0c00640 1 -- 172.21.15.175:0/1831596752 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7febb4084470 con 0x7febc40b4630 2024-04-25T09:13:10.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.056+0000 7febbbe00640 1 --2- 172.21.15.175:0/1831596752 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feba0066f60 0x7feba0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.056+0000 7febbbe00640 1 --2- 172.21.15.175:0/1831596752 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feba0066f60 0x7feba0069420 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7febac0af000 tx=0x7febac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:10.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.060+0000 7febc0c00640 1 -- 172.21.15.175:0/1831596752 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7febb4055410 con 0x7febc40b4630 2024-04-25T09:13:10.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.248+0000 7febcae00640 1 -- 172.21.15.175:0/1831596752 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7febc4068120 con 0x7febc40b4630 2024-04-25T09:13:10.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.604+0000 7febc0c00640 1 -- 172.21.15.175:0/1831596752 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v80) v1 ==== 162+0+0 (secure 0 0 0) 0x7febb4054d10 con 0x7febc40b4630 2024-04-25T09:13:10.590 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T09:13:10.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.604+0000 7febcae00640 1 -- 172.21.15.175:0/1831596752 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feba0066f60 msgr2=0x7feba0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.604+0000 7febcae00640 1 --2- 172.21.15.175:0/1831596752 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feba0066f60 0x7feba0069420 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7febac0af000 tx=0x7febac008040 comp rx=0 tx=0).stop 2024-04-25T09:13:10.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.604+0000 7febcae00640 1 -- 172.21.15.175:0/1831596752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc40b4630 msgr2=0x7febc41f5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.604+0000 7febcae00640 1 --2- 172.21.15.175:0/1831596752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc40b4630 0x7febc41f5b50 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7febb400c480 tx=0x7febb400c940 comp rx=0 tx=0).stop 2024-04-25T09:13:10.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.604+0000 7febcae00640 1 -- 172.21.15.175:0/1831596752 shutdown_connections 2024-04-25T09:13:10.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.604+0000 7febcae00640 1 --2- 172.21.15.175:0/1831596752 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7feba0066f60 0x7feba0069420 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.604+0000 7febcae00640 1 --2- 172.21.15.175:0/1831596752 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7febc415af20 0x7febc40cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.604+0000 7febcae00640 1 --2- 172.21.15.175:0/1831596752 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7febc40cbe60 0x7febc40cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.604+0000 7febcae00640 1 --2- 172.21.15.175:0/1831596752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc40b4630 0x7febc41f5b50 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.604+0000 7febcae00640 1 -- 172.21.15.175:0/1831596752 >> 172.21.15.175:0/1831596752 conn(0x7febc406ac50 msgr2=0x7febc40af360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:10.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.604+0000 7febcae00640 1 -- 172.21.15.175:0/1831596752 shutdown_connections 2024-04-25T09:13:10.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.604+0000 7febcae00640 1 -- 172.21.15.175:0/1831596752 wait complete. 2024-04-25T09:13:10.617 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:10.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.764+0000 7ff291000640 1 Processor -- start 2024-04-25T09:13:10.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.764+0000 7ff291000640 1 -- start start 2024-04-25T09:13:10.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff291000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff28c0cfc10 0x7ff28c0cc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff291000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff28c06eee0 0x7ff28c0cca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff291000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28c0b29d0 con 0x7ff28c162070 2024-04-25T09:13:10.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff291000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28c0b35e0 con 0x7ff28c0cfc10 2024-04-25T09:13:10.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff291000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c0b2cb0 con 0x7ff28c06eee0 2024-04-25T09:13:10.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff289e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff28c162070 0x7ff28c0cf500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:52708/0 (socket says 172.21.15.175:52708) 2024-04-25T09:13:10.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff289e00640 1 -- 172.21.15.175:0/1017487227 learned_addr learned my addr 172.21.15.175:0/1017487227 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:10.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff28a800640 1 --2- 172.21.15.175:0/1017487227 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff28c06eee0 0x7ff28c0cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff289400640 1 --2- 172.21.15.175:0/1017487227 >> v2:172.21.15.177:3300/0 conn(0x7ff28c0cfc10 0x7ff28c0cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff288a00640 1 -- 172.21.15.175:0/1017487227 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290791208 0 0) 0x7ff28c0b29d0 con 0x7ff28c162070 2024-04-25T09:13:10.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff288a00640 1 -- 172.21.15.175:0/1017487227 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff270003530 con 0x7ff28c162070 2024-04-25T09:13:10.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff288a00640 1 -- 172.21.15.175:0/1017487227 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4220108447 0 0) 0x7ff270003530 con 0x7ff28c162070 2024-04-25T09:13:10.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff288a00640 1 -- 172.21.15.175:0/1017487227 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff28c06eee0 msgr2=0x7ff28c0cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:10.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff288a00640 1 --2- 172.21.15.175:0/1017487227 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff28c06eee0 0x7ff28c0cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff288a00640 1 -- 172.21.15.175:0/1017487227 >> v2:172.21.15.177:3300/0 conn(0x7ff28c0cfc10 msgr2=0x7ff28c0cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:10.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff288a00640 1 --2- 172.21.15.175:0/1017487227 >> v2:172.21.15.177:3300/0 conn(0x7ff28c0cfc10 0x7ff28c0cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff288a00640 1 -- 172.21.15.175:0/1017487227 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c0b2f90 con 0x7ff28c162070 2024-04-25T09:13:10.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff288a00640 1 -- 172.21.15.175:0/1017487227 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7ff27c001680 con 0x7ff28c162070 2024-04-25T09:13:10.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff28a800640 1 --2- 172.21.15.175:0/1017487227 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff28c06eee0 0x7ff28c0cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:10.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff289400640 1 --2- 172.21.15.175:0/1017487227 >> v2:172.21.15.177:3300/0 conn(0x7ff28c0cfc10 0x7ff28c0cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:10.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff288a00640 1 -- 172.21.15.175:0/1017487227 >> v1:172.21.15.175:6789/0 conn(0x7ff28c162070 legacy=0x7ff28c0cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff288a00640 1 --2- 172.21.15.175:0/1017487227 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff28c06eee0 0x7ff2700039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff288a00640 1 --2- 172.21.15.175:0/1017487227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff270003f00 0x7ff270004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff288a00640 1 --2- 172.21.15.175:0/1017487227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff270004d50 0x7ff2700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff288a00640 1 -- 172.21.15.175:0/1017487227 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c0b35e0 con 0x7ff270004d50 2024-04-25T09:13:10.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff288a00640 1 -- 172.21.15.175:0/1017487227 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c0b2cb0 con 0x7ff270003f00 2024-04-25T09:13:10.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff288a00640 1 -- 172.21.15.175:0/1017487227 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27000b9d0 con 0x7ff28c06eee0 2024-04-25T09:13:10.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff28a800640 1 --2- 172.21.15.175:0/1017487227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff270004d50 0x7ff2700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff289e00640 1 --2- 172.21.15.175:0/1017487227 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff28c06eee0 0x7ff2700039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff289400640 1 --2- 172.21.15.175:0/1017487227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff270003f00 0x7ff270004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff28a800640 1 -- 172.21.15.175:0/1017487227 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff28c06eee0 msgr2=0x7ff2700039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:10.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff28a800640 1 --2- 172.21.15.175:0/1017487227 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff28c06eee0 0x7ff2700039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff28a800640 1 -- 172.21.15.175:0/1017487227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff270003f00 msgr2=0x7ff270004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:10.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff28a800640 1 --2- 172.21.15.175:0/1017487227 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff270003f00 0x7ff270004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.768+0000 7ff28a800640 1 -- 172.21.15.175:0/1017487227 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff270003530 con 0x7ff270004d50 2024-04-25T09:13:10.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.772+0000 7ff28a800640 1 --2- 172.21.15.175:0/1017487227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff270004d50 0x7ff2700051d0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7ff28400e320 tx=0x7ff28401cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50312156d2448101 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:10.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.772+0000 7ff288a00640 1 -- 172.21.15.175:0/1017487227 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2840b2070 con 0x7ff270004d50 2024-04-25T09:13:10.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.772+0000 7ff288a00640 1 -- 172.21.15.175:0/1017487227 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2840a5dd0 con 0x7ff270004d50 2024-04-25T09:13:10.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.772+0000 7ff288a00640 1 -- 172.21.15.175:0/1017487227 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff284009de0 con 0x7ff270004d50 2024-04-25T09:13:10.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.772+0000 7ff291000640 1 -- 172.21.15.175:0/1017487227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff270004d50 msgr2=0x7ff2700051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.772+0000 7ff291000640 1 --2- 172.21.15.175:0/1017487227 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff270004d50 0x7ff2700051d0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7ff28400e320 tx=0x7ff28401cdc0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.772+0000 7ff28a800640 1 -- 172.21.15.175:0/1017487227 reap_dead start 2024-04-25T09:13:10.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.772+0000 7ff291000640 1 -- 172.21.15.175:0/1017487227 shutdown_connections 2024-04-25T09:13:10.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.772+0000 7ff291000640 1 -- 172.21.15.175:0/1017487227 >> 172.21.15.175:0/1017487227 conn(0x7ff28c067150 msgr2=0x7ff28c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:10.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.772+0000 7ff291000640 1 -- 172.21.15.175:0/1017487227 shutdown_connections 2024-04-25T09:13:10.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.772+0000 7ff291000640 1 -- 172.21.15.175:0/1017487227 wait complete. 2024-04-25T09:13:10.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff291000640 1 Processor -- start 2024-04-25T09:13:10.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff291000640 1 -- start start 2024-04-25T09:13:10.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff291000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff28c1527f0 0x7ff28c163620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff291000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff28c152bd0 0x7ff28c163b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff291000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff28c0ca2c0 0x7ff28c0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff291000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c0b2580 con 0x7ff28c0ca2c0 2024-04-25T09:13:10.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff291000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c162450 con 0x7ff28c152bd0 2024-04-25T09:13:10.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff291000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c0b2700 con 0x7ff28c1527f0 2024-04-25T09:13:10.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff28a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff28c0ca2c0 0x7ff28c0ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff28a800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff28c0ca2c0 0x7ff28c0ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:38998/0 (socket says 172.21.15.175:38998) 2024-04-25T09:13:10.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff28a800640 1 -- 172.21.15.175:0/2643682491 learned_addr learned my addr 172.21.15.175:0/2643682491 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:10.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff289400640 1 --2- 172.21.15.175:0/2643682491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff28c152bd0 0x7ff28c163b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff289e00640 1 --2- 172.21.15.175:0/2643682491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff28c1527f0 0x7ff28c163620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff28a800640 1 -- 172.21.15.175:0/2643682491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff28c1527f0 msgr2=0x7ff28c163620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff28a800640 1 --2- 172.21.15.175:0/2643682491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff28c1527f0 0x7ff28c163620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff28a800640 1 -- 172.21.15.175:0/2643682491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff28c152bd0 msgr2=0x7ff28c163b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff28a800640 1 --2- 172.21.15.175:0/2643682491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff28c152bd0 0x7ff28c163b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff28a800640 1 -- 172.21.15.175:0/2643682491 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c0cb060 con 0x7ff28c0ca2c0 2024-04-25T09:13:10.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff289e00640 1 --2- 172.21.15.175:0/2643682491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff28c1527f0 0x7ff28c163620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:10.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff28a800640 1 --2- 172.21.15.175:0/2643682491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff28c0ca2c0 0x7ff28c0ca770 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7ff284002240 tx=0x7ff284009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:10.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff282000640 1 -- 172.21.15.175:0/2643682491 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2840b2040 con 0x7ff28c0ca2c0 2024-04-25T09:13:10.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff282000640 1 -- 172.21.15.175:0/2643682491 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff284009a50 con 0x7ff28c0ca2c0 2024-04-25T09:13:10.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff282000640 1 -- 172.21.15.175:0/2643682491 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff284009de0 con 0x7ff28c0ca2c0 2024-04-25T09:13:10.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff291000640 1 -- 172.21.15.175:0/2643682491 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28c0cb340 con 0x7ff28c0ca2c0 2024-04-25T09:13:10.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff291000640 1 -- 172.21.15.175:0/2643682491 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28c0cb900 con 0x7ff28c0ca2c0 2024-04-25T09:13:10.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.776+0000 7ff291000640 1 -- 172.21.15.175:0/2643682491 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28c0cbb00 con 0x7ff28c0ca2c0 2024-04-25T09:13:10.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.780+0000 7ff282000640 1 -- 172.21.15.175:0/2643682491 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff2840be020 con 0x7ff28c0ca2c0 2024-04-25T09:13:10.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.780+0000 7ff282000640 1 --2- 172.21.15.175:0/2643682491 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff26c066f60 0x7ff26c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:10.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.780+0000 7ff282000640 1 -- 172.21.15.175:0/2643682491 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff28411efb0 con 0x7ff28c0ca2c0 2024-04-25T09:13:10.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.780+0000 7ff289e00640 1 --2- 172.21.15.175:0/2643682491 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff26c066f60 0x7ff26c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:10.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.780+0000 7ff289e00640 1 --2- 172.21.15.175:0/2643682491 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff26c066f60 0x7ff26c069420 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff27c004850 tx=0x7ff27c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:10.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.784+0000 7ff282000640 1 -- 172.21.15.175:0/2643682491 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff2840c5020 con 0x7ff28c0ca2c0 2024-04-25T09:13:10.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.972+0000 7ff291000640 1 -- 172.21.15.175:0/2643682491 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff28c06ec30 con 0x7ff28c0ca2c0 2024-04-25T09:13:10.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.972+0000 7ff282000640 1 -- 172.21.15.175:0/2643682491 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4951 (secure 0 0 0) 0x7ff284016ad0 con 0x7ff28c0ca2c0 2024-04-25T09:13:10.959 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:13:10.959 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":81,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6998,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3519467288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3519467288},{"type":"v1","addr":"172.21.15.177:6834","nonce":3519467288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2181426238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2181426238},{"type":"v1","addr":"172.21.15.177:6835","nonce":2181426238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/936884340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":936884340},{"type":"v1","addr":"172.21.15.175:6836","nonce":936884340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:23.414911+0000","modified":"2024-04-25T09:13:10.608892+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8397},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8397":{"gid":8397,"name":"a","rank":0,"incarnation":81,"state":"up:replay","state_seq":1,"addr":"172.21.15.175:6837/2646458577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2646458577},{"type":"v1","addr":"172.21.15.175:6837","nonce":2646458577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:13:10.960 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 81 2024-04-25T09:13:10.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.972+0000 7ff291000640 1 -- 172.21.15.175:0/2643682491 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff26c066f60 msgr2=0x7ff26c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.972+0000 7ff291000640 1 --2- 172.21.15.175:0/2643682491 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff26c066f60 0x7ff26c069420 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff27c004850 tx=0x7ff27c009040 comp rx=0 tx=0).stop 2024-04-25T09:13:10.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.972+0000 7ff291000640 1 -- 172.21.15.175:0/2643682491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff28c0ca2c0 msgr2=0x7ff28c0ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:10.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.972+0000 7ff291000640 1 --2- 172.21.15.175:0/2643682491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff28c0ca2c0 0x7ff28c0ca770 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7ff284002240 tx=0x7ff284009750 comp rx=0 tx=0).stop 2024-04-25T09:13:10.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.972+0000 7ff291000640 1 -- 172.21.15.175:0/2643682491 shutdown_connections 2024-04-25T09:13:10.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.972+0000 7ff291000640 1 --2- 172.21.15.175:0/2643682491 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff26c066f60 0x7ff26c069420 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.972+0000 7ff291000640 1 --2- 172.21.15.175:0/2643682491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff28c0ca2c0 0x7ff28c0ca770 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.972+0000 7ff291000640 1 --2- 172.21.15.175:0/2643682491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff28c152bd0 0x7ff28c163b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.972+0000 7ff291000640 1 --2- 172.21.15.175:0/2643682491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff28c1527f0 0x7ff28c163620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:10.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.972+0000 7ff291000640 1 -- 172.21.15.175:0/2643682491 >> 172.21.15.175:0/2643682491 conn(0x7ff28c161600 msgr2=0x7ff28c0b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:10.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.972+0000 7ff291000640 1 -- 172.21.15.175:0/2643682491 shutdown_connections 2024-04-25T09:13:10.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:10.972+0000 7ff291000640 1 -- 172.21.15.175:0/2643682491 wait complete. 2024-04-25T09:13:11.383 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 81, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:12:23.414911+0000', 'modified': '2024-04-25T09:13:10.608892+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8397}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8397': {'gid': 8397, 'name': 'a', 'rank': 0, 'incarnation': 81, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.175:6837/2646458577', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6835', 'nonce': 2646458577}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 2646458577}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:13:11.383 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8397:up:replay 2024-04-25T09:13:12.383 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:12.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.544+0000 7f462b800640 1 Processor -- start 2024-04-25T09:13:12.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.544+0000 7f462b800640 1 -- start start 2024-04-25T09:13:12.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.544+0000 7f462b800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f462406bd60 0x7f462406cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:12.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.544+0000 7f462b800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f46240d0d50 0x7f46240cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:12.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.544+0000 7f462b800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46240cfcb0 con 0x7f4624099a50 2024-04-25T09:13:12.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.544+0000 7f462b800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46240cff90 con 0x7f46240d0d50 2024-04-25T09:13:12.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.544+0000 7f462b800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46240d0270 con 0x7f462406bd60 2024-04-25T09:13:12.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.544+0000 7f4628e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4624099a50 0x7f4624099e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:52710/0 (socket says 172.21.15.175:52710) 2024-04-25T09:13:12.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.544+0000 7f4628e00640 1 -- 172.21.15.175:0/800103806 learned_addr learned my addr 172.21.15.175:0/800103806 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:12.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.544+0000 7f4629800640 1 --2- 172.21.15.175:0/800103806 >> v2:172.21.15.175:3300/0 conn(0x7f46240d0d50 0x7f46240cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:12.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.544+0000 7f461be00640 1 --2- 172.21.15.175:0/800103806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f462406bd60 0x7f462406cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:12.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.544+0000 7f4623e00640 1 -- 172.21.15.175:0/800103806 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3630942230 0 0) 0x7f46240cfcb0 con 0x7f4624099a50 2024-04-25T09:13:12.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.544+0000 7f4623e00640 1 -- 172.21.15.175:0/800103806 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4608003530 con 0x7f4624099a50 2024-04-25T09:13:12.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.544+0000 7f4629800640 1 -- 172.21.15.175:0/800103806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f462406bd60 msgr2=0x7f462406cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:12.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.544+0000 7f4629800640 1 --2- 172.21.15.175:0/800103806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f462406bd60 0x7f462406cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.544+0000 7f4629800640 1 -- 172.21.15.175:0/800103806 >> v1:172.21.15.175:6789/0 conn(0x7f4624099a50 legacy=0x7f4624099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:12.534 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.544+0000 7f4629800640 1 -- 172.21.15.175:0/800103806 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46240d0550 con 0x7f46240d0d50 2024-04-25T09:13:12.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.548+0000 7f4629800640 1 --2- 172.21.15.175:0/800103806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46240d0d50 0x7f46240cbe60 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f461c009d90 tx=0x7f461c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d76a97edd255fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:12.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.548+0000 7f4623e00640 1 -- 172.21.15.175:0/800103806 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c0b2070 con 0x7f46240d0d50 2024-04-25T09:13:12.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.548+0000 7f4623e00640 1 -- 172.21.15.175:0/800103806 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461c0a5830 con 0x7f46240d0d50 2024-04-25T09:13:12.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.548+0000 7f4623e00640 1 -- 172.21.15.175:0/800103806 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c0a5be0 con 0x7f46240d0d50 2024-04-25T09:13:12.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.548+0000 7f462b800640 1 -- 172.21.15.175:0/800103806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46240d0d50 msgr2=0x7f46240cbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:12.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.548+0000 7f462b800640 1 --2- 172.21.15.175:0/800103806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46240d0d50 0x7f46240cbe60 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f461c009d90 tx=0x7f461c01c970 comp rx=0 tx=0).stop 2024-04-25T09:13:12.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.548+0000 7f462b800640 1 -- 172.21.15.175:0/800103806 shutdown_connections 2024-04-25T09:13:12.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.548+0000 7f462b800640 1 --2- 172.21.15.175:0/800103806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f46240d0d50 0x7f46240cbe60 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.548+0000 7f462b800640 1 --2- 172.21.15.175:0/800103806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f462406bd60 0x7f462406cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.548+0000 7f462b800640 1 -- 172.21.15.175:0/800103806 >> 172.21.15.175:0/800103806 conn(0x7f46240b3300 msgr2=0x7f46240b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:12.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.548+0000 7f462b800640 1 -- 172.21.15.175:0/800103806 shutdown_connections 2024-04-25T09:13:12.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.548+0000 7f462b800640 1 -- 172.21.15.175:0/800103806 wait complete. 2024-04-25T09:13:12.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f462b800640 1 Processor -- start 2024-04-25T09:13:12.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f462b800640 1 -- start start 2024-04-25T09:13:12.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f462b800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f462406bd60 0x7f4624151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:12.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f462b800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4624099a50 0x7f4624154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:12.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f462b800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46240d0d50 0x7f4624153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:12.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f462b800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462415dfe0 con 0x7f4624099a50 2024-04-25T09:13:12.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f462b800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462415de60 con 0x7f462406bd60 2024-04-25T09:13:12.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f462b800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462416b260 con 0x7f46240d0d50 2024-04-25T09:13:12.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f461be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4624099a50 0x7f4624154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:12.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f461be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4624099a50 0x7f4624154ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39028/0 (socket says 172.21.15.175:39028) 2024-04-25T09:13:12.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f461be00640 1 -- 172.21.15.175:0/3314915565 learned_addr learned my addr 172.21.15.175:0/3314915565 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:12.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f4629800640 1 --2- 172.21.15.175:0/3314915565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46240d0d50 0x7f4624153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:12.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f4628e00640 1 --2- 172.21.15.175:0/3314915565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f462406bd60 0x7f4624151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:12.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f461be00640 1 -- 172.21.15.175:0/3314915565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46240d0d50 msgr2=0x7f4624153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:12.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f461be00640 1 --2- 172.21.15.175:0/3314915565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46240d0d50 0x7f4624153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f461be00640 1 -- 172.21.15.175:0/3314915565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f462406bd60 msgr2=0x7f4624151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:12.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f461be00640 1 --2- 172.21.15.175:0/3314915565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f462406bd60 0x7f4624151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f461be00640 1 -- 172.21.15.175:0/3314915565 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46241558c0 con 0x7f4624099a50 2024-04-25T09:13:12.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f4628e00640 1 --2- 172.21.15.175:0/3314915565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f462406bd60 0x7f4624151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:12.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f461be00640 1 --2- 172.21.15.175:0/3314915565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4624099a50 0x7f4624154ee0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f460c00e8a0 tx=0x7f460c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:12.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f4621600640 1 -- 172.21.15.175:0/3314915565 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c017070 con 0x7f4624099a50 2024-04-25T09:13:12.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f4621600640 1 -- 172.21.15.175:0/3314915565 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460c00c940 con 0x7f4624099a50 2024-04-25T09:13:12.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f4621600640 1 -- 172.21.15.175:0/3314915565 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c00ccf0 con 0x7f4624099a50 2024-04-25T09:13:12.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f462b800640 1 -- 172.21.15.175:0/3314915565 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4624155ba0 con 0x7f4624099a50 2024-04-25T09:13:12.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.552+0000 7f462b800640 1 -- 172.21.15.175:0/3314915565 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4624156160 con 0x7f4624099a50 2024-04-25T09:13:12.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.556+0000 7f462b800640 1 -- 172.21.15.175:0/3314915565 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4624074a60 con 0x7f4624099a50 2024-04-25T09:13:12.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.556+0000 7f4621600640 1 -- 172.21.15.175:0/3314915565 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f460c01a070 con 0x7f4624099a50 2024-04-25T09:13:12.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.556+0000 7f4621600640 1 --2- 172.21.15.175:0/3314915565 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4600066f60 0x7f4600069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:12.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.556+0000 7f4621600640 1 -- 172.21.15.175:0/3314915565 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f460c0852e0 con 0x7f4624099a50 2024-04-25T09:13:12.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.556+0000 7f4628e00640 1 --2- 172.21.15.175:0/3314915565 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4600066f60 0x7f4600069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:12.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.556+0000 7f4628e00640 1 --2- 172.21.15.175:0/3314915565 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4600066f60 0x7f4600069420 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4614005890 tx=0x7f4614009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:12.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.560+0000 7f4621600640 1 -- 172.21.15.175:0/3314915565 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f460c055ba0 con 0x7f4624099a50 2024-04-25T09:13:12.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.744+0000 7f462b800640 1 -- 172.21.15.175:0/3314915565 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f462409aee0 con 0x7f4624099a50 2024-04-25T09:13:12.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.748+0000 7f4621600640 1 -- 172.21.15.175:0/3314915565 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4951 (secure 0 0 0) 0x7f460c0850e0 con 0x7f4624099a50 2024-04-25T09:13:12.734 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:13:12.734 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":83,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6998,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3519467288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3519467288},{"type":"v1","addr":"172.21.15.177:6834","nonce":3519467288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2181426238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2181426238},{"type":"v1","addr":"172.21.15.177:6835","nonce":2181426238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/936884340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":936884340},{"type":"v1","addr":"172.21.15.175:6836","nonce":936884340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:23.414911+0000","modified":"2024-04-25T09:13:11.617486+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8397},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8397":{"gid":8397,"name":"a","rank":0,"incarnation":81,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.175:6837/2646458577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2646458577},{"type":"v1","addr":"172.21.15.175:6837","nonce":2646458577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:13:12.734 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 83 2024-04-25T09:13:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.748+0000 7f462b800640 1 -- 172.21.15.175:0/3314915565 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4600066f60 msgr2=0x7f4600069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.748+0000 7f462b800640 1 --2- 172.21.15.175:0/3314915565 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4600066f60 0x7f4600069420 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f4614005890 tx=0x7f4614009040 comp rx=0 tx=0).stop 2024-04-25T09:13:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.748+0000 7f462b800640 1 -- 172.21.15.175:0/3314915565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4624099a50 msgr2=0x7f4624154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.748+0000 7f462b800640 1 --2- 172.21.15.175:0/3314915565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4624099a50 0x7f4624154ee0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f460c00e8a0 tx=0x7f460c00eca0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.748+0000 7f462b800640 1 -- 172.21.15.175:0/3314915565 shutdown_connections 2024-04-25T09:13:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.748+0000 7f462b800640 1 --2- 172.21.15.175:0/3314915565 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4600066f60 0x7f4600069420 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.748+0000 7f462b800640 1 --2- 172.21.15.175:0/3314915565 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46240d0d50 0x7f4624153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.748+0000 7f462b800640 1 --2- 172.21.15.175:0/3314915565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4624099a50 0x7f4624154ee0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.748+0000 7f462b800640 1 --2- 172.21.15.175:0/3314915565 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f462406bd60 0x7f4624151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:12.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.748+0000 7f462b800640 1 -- 172.21.15.175:0/3314915565 >> 172.21.15.175:0/3314915565 conn(0x7f46240b3300 msgr2=0x7f462415a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:12.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.748+0000 7f462b800640 1 -- 172.21.15.175:0/3314915565 shutdown_connections 2024-04-25T09:13:12.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:12.748+0000 7f462b800640 1 -- 172.21.15.175:0/3314915565 wait complete. 2024-04-25T09:13:13.158 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:12:23.414911+0000', 'modified': '2024-04-25T09:13:11.617486+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8397}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8397': {'gid': 8397, 'name': 'a', 'rank': 0, 'incarnation': 81, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.175:6837/2646458577', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6835', 'nonce': 2646458577}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 2646458577}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:13:13.158 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8397:up:rejoin 2024-04-25T09:13:14.159 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:14.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.312+0000 7fe54ee00640 1 Processor -- start 2024-04-25T09:13:14.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.312+0000 7fe54ee00640 1 -- start start 2024-04-25T09:13:14.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.312+0000 7fe54ee00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5480aeb30 0x7fe548071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.316+0000 7fe54ee00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54806eba0 con 0x7fe548071780 2024-04-25T09:13:14.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.316+0000 7fe54ee00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54806ee80 con 0x7fe54806e510 2024-04-25T09:13:14.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.316+0000 7fe54ee00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe548071be0 con 0x7fe5480aeb30 2024-04-25T09:13:14.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.316+0000 7fe53f400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe548071780 0x7fe54806de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:52712/0 (socket says 172.21.15.175:52712) 2024-04-25T09:13:14.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.316+0000 7fe53f400640 1 -- 172.21.15.175:0/2337124358 learned_addr learned my addr 172.21.15.175:0/2337124358 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:14.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.316+0000 7fe547e00640 1 --2- 172.21.15.175:0/2337124358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5480aeb30 0x7fe548071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.316+0000 7fe547400640 1 -- 172.21.15.175:0/2337124358 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682976287 0 0) 0x7fe54806eba0 con 0x7fe548071780 2024-04-25T09:13:14.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.316+0000 7fe547400640 1 -- 172.21.15.175:0/2337124358 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe52c003450 con 0x7fe548071780 2024-04-25T09:13:14.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.316+0000 7fe547e00640 1 -- 172.21.15.175:0/2337124358 >> v1:172.21.15.177:6789/0 conn(0x7fe54806e510 legacy=0x7fe5480b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.316+0000 7fe547e00640 1 -- 172.21.15.175:0/2337124358 >> v1:172.21.15.175:6789/0 conn(0x7fe548071780 legacy=0x7fe54806de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.316+0000 7fe547400640 1 -- 172.21.15.175:0/2337124358 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959107539 0 0) 0x7fe54806ee80 con 0x7fe54806e510 2024-04-25T09:13:14.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.316+0000 7fe547e00640 1 -- 172.21.15.175:0/2337124358 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5480b2700 con 0x7fe5480aeb30 2024-04-25T09:13:14.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe547e00640 1 --2- 172.21.15.175:0/2337124358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5480aeb30 0x7fe548071240 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe5300097f0 tx=0x7fe53001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e549cb358a54db4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:14.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe547400640 1 -- 172.21.15.175:0/2337124358 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5300b0070 con 0x7fe5480aeb30 2024-04-25T09:13:14.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe547400640 1 -- 172.21.15.175:0/2337124358 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5300ab600 con 0x7fe5480aeb30 2024-04-25T09:13:14.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe547400640 1 -- 172.21.15.175:0/2337124358 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5300ab9b0 con 0x7fe5480aeb30 2024-04-25T09:13:14.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe54ee00640 1 -- 172.21.15.175:0/2337124358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5480aeb30 msgr2=0x7fe548071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe54ee00640 1 --2- 172.21.15.175:0/2337124358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5480aeb30 0x7fe548071240 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe5300097f0 tx=0x7fe53001c4e0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe54ee00640 1 -- 172.21.15.175:0/2337124358 shutdown_connections 2024-04-25T09:13:14.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe54ee00640 1 --2- 172.21.15.175:0/2337124358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5480aeb30 0x7fe548071240 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe54ee00640 1 -- 172.21.15.175:0/2337124358 >> 172.21.15.175:0/2337124358 conn(0x7fe548067150 msgr2=0x7fe54806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:14.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe54ee00640 1 -- 172.21.15.175:0/2337124358 shutdown_connections 2024-04-25T09:13:14.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe54ee00640 1 -- 172.21.15.175:0/2337124358 wait complete. 2024-04-25T09:13:14.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe54ee00640 1 Processor -- start 2024-04-25T09:13:14.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe54ee00640 1 -- start start 2024-04-25T09:13:14.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe54ee00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe548071780 0x7fe54815d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe54ee00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5480aeb30 0x7fe548157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe54ee00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5480afb80 0x7fe5480b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe54ee00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480b41f0 con 0x7fe5480afb80 2024-04-25T09:13:14.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe54ee00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480b4070 con 0x7fe548071780 2024-04-25T09:13:14.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe54ee00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480b2a70 con 0x7fe5480aeb30 2024-04-25T09:13:14.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe54ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5480afb80 0x7fe5480b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe54ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5480afb80 0x7fe5480b10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39034/0 (socket says 172.21.15.175:39034) 2024-04-25T09:13:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.320+0000 7fe54ce00640 1 -- 172.21.15.175:0/219146121 learned_addr learned my addr 172.21.15.175:0/219146121 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.324+0000 7fe547e00640 1 --2- 172.21.15.175:0/219146121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe548071780 0x7fe54815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.324+0000 7fe53f400640 1 --2- 172.21.15.175:0/219146121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5480aeb30 0x7fe548157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.324+0000 7fe54ce00640 1 -- 172.21.15.175:0/219146121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5480aeb30 msgr2=0x7fe548157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.324+0000 7fe54ce00640 1 --2- 172.21.15.175:0/219146121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5480aeb30 0x7fe548157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.324+0000 7fe54ce00640 1 -- 172.21.15.175:0/219146121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe548071780 msgr2=0x7fe54815d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.324+0000 7fe54ce00640 1 --2- 172.21.15.175:0/219146121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe548071780 0x7fe54815d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.324+0000 7fe54ce00640 1 -- 172.21.15.175:0/219146121 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe548158230 con 0x7fe5480afb80 2024-04-25T09:13:14.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.324+0000 7fe54ce00640 1 --2- 172.21.15.175:0/219146121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5480afb80 0x7fe5480b10e0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fe54000c7b0 tx=0x7fe54000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:14.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.324+0000 7fe544c00640 1 -- 172.21.15.175:0/219146121 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540003db0 con 0x7fe5480afb80 2024-04-25T09:13:14.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.324+0000 7fe544c00640 1 -- 172.21.15.175:0/219146121 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe540005070 con 0x7fe5480afb80 2024-04-25T09:13:14.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.324+0000 7fe544c00640 1 -- 172.21.15.175:0/219146121 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540005460 con 0x7fe5480afb80 2024-04-25T09:13:14.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.324+0000 7fe54ee00640 1 -- 172.21.15.175:0/219146121 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5480b0360 con 0x7fe5480afb80 2024-04-25T09:13:14.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.324+0000 7fe54ee00640 1 -- 172.21.15.175:0/219146121 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54815ae20 con 0x7fe5480afb80 2024-04-25T09:13:14.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.324+0000 7fe54ee00640 1 -- 172.21.15.175:0/219146121 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54806adf0 con 0x7fe5480afb80 2024-04-25T09:13:14.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.324+0000 7fe544c00640 1 -- 172.21.15.175:0/219146121 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe540005600 con 0x7fe5480afb80 2024-04-25T09:13:14.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.328+0000 7fe544c00640 1 --2- 172.21.15.175:0/219146121 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe524066f60 0x7fe524069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:14.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.328+0000 7fe544c00640 1 -- 172.21.15.175:0/219146121 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe540084e70 con 0x7fe5480afb80 2024-04-25T09:13:14.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.328+0000 7fe547e00640 1 --2- 172.21.15.175:0/219146121 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe524066f60 0x7fe524069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:14.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.328+0000 7fe547e00640 1 --2- 172.21.15.175:0/219146121 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe524066f60 0x7fe524069420 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe5300ad000 tx=0x7fe5300a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:14.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.332+0000 7fe544c00640 1 -- 172.21.15.175:0/219146121 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe5400557c0 con 0x7fe5480afb80 2024-04-25T09:13:14.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.516+0000 7fe54ee00640 1 -- 172.21.15.175:0/219146121 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe54815a8f0 con 0x7fe5480afb80 2024-04-25T09:13:14.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.516+0000 7fe544c00640 1 -- 172.21.15.175:0/219146121 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4951 (secure 0 0 0) 0x7fe540059860 con 0x7fe5480afb80 2024-04-25T09:13:14.503 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:13:14.503 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":84,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6998,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3519467288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3519467288},{"type":"v1","addr":"172.21.15.177:6834","nonce":3519467288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2181426238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2181426238},{"type":"v1","addr":"172.21.15.177:6835","nonce":2181426238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/936884340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":936884340},{"type":"v1","addr":"172.21.15.175:6836","nonce":936884340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:23.414911+0000","modified":"2024-04-25T09:13:12.626490+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8397},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8397":{"gid":8397,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6837/2646458577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2646458577},{"type":"v1","addr":"172.21.15.175:6837","nonce":2646458577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:13:14.503 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 84 2024-04-25T09:13:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.516+0000 7fe54ee00640 1 -- 172.21.15.175:0/219146121 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe524066f60 msgr2=0x7fe524069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.516+0000 7fe54ee00640 1 --2- 172.21.15.175:0/219146121 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe524066f60 0x7fe524069420 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe5300ad000 tx=0x7fe5300a6000 comp rx=0 tx=0).stop 2024-04-25T09:13:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.516+0000 7fe54ee00640 1 -- 172.21.15.175:0/219146121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5480afb80 msgr2=0x7fe5480b10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:14.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.516+0000 7fe54ee00640 1 --2- 172.21.15.175:0/219146121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5480afb80 0x7fe5480b10e0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fe54000c7b0 tx=0x7fe54000cc70 comp rx=0 tx=0).stop 2024-04-25T09:13:14.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.516+0000 7fe54ee00640 1 -- 172.21.15.175:0/219146121 shutdown_connections 2024-04-25T09:13:14.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.516+0000 7fe54ee00640 1 --2- 172.21.15.175:0/219146121 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe524066f60 0x7fe524069420 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.516+0000 7fe54ee00640 1 --2- 172.21.15.175:0/219146121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5480afb80 0x7fe5480b10e0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.516+0000 7fe54ee00640 1 --2- 172.21.15.175:0/219146121 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5480aeb30 0x7fe548157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.516+0000 7fe54ee00640 1 --2- 172.21.15.175:0/219146121 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe548071780 0x7fe54815d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:14.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.516+0000 7fe54ee00640 1 -- 172.21.15.175:0/219146121 >> 172.21.15.175:0/219146121 conn(0x7fe54806e510 msgr2=0x7fe5480cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:14.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.516+0000 7fe54ee00640 1 -- 172.21.15.175:0/219146121 shutdown_connections 2024-04-25T09:13:14.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:14.516+0000 7fe54ee00640 1 -- 172.21.15.175:0/219146121 wait complete. 2024-04-25T09:13:14.926 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:12:23.414911+0000', 'modified': '2024-04-25T09:13:12.626490+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8397}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8397': {'gid': 8397, 'name': 'a', 'rank': 0, 'incarnation': 81, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.175:6837/2646458577', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6835', 'nonce': 2646458577}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 2646458577}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:13:14.927 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:13:14.927 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:13:15.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.076+0000 7f75d8400640 1 Processor -- start 2024-04-25T09:13:15.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.076+0000 7f75d8400640 1 -- start start 2024-04-25T09:13:15.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.076+0000 7f75d8400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75d0145250 0x7f75d00cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.076+0000 7f75d8400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f75d01600a0 0x7f75d00cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.076+0000 7f75d8400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f75d00ce970 0x7f75d00cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.076+0000 7f75d8400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d015f650 con 0x7f75d01600a0 2024-04-25T09:13:15.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.076+0000 7f75d8400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d00cfd10 con 0x7f75d00ce970 2024-04-25T09:13:15.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.076+0000 7f75d8400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d00cfff0 con 0x7f75d0145250 2024-04-25T09:13:15.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.076+0000 7f75d5000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f75d01600a0 0x7f75d00cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.076+0000 7f75d5000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f75d01600a0 0x7f75d00cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39050/0 (socket says 172.21.15.175:39050) 2024-04-25T09:13:15.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.076+0000 7f75d5000640 1 -- 172.21.15.175:0/1749610146 learned_addr learned my addr 172.21.15.175:0/1749610146 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:15.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75d5000640 1 -- 172.21.15.175:0/1749610146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75d0145250 msgr2=0x7f75d00cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75d5000640 1 --2- 172.21.15.175:0/1749610146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75d0145250 0x7f75d00cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75d5000640 1 -- 172.21.15.175:0/1749610146 >> v2:172.21.15.177:3300/0 conn(0x7f75d00ce970 msgr2=0x7f75d00cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75d6400640 1 --2- 172.21.15.175:0/1749610146 >> v2:172.21.15.177:3300/0 conn(0x7f75d00ce970 0x7f75d00cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75d5000640 1 --2- 172.21.15.175:0/1749610146 >> v2:172.21.15.177:3300/0 conn(0x7f75d00ce970 0x7f75d00cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75d5000640 1 -- 172.21.15.175:0/1749610146 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d015f8a0 con 0x7f75d01600a0 2024-04-25T09:13:15.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75d6400640 1 --2- 172.21.15.175:0/1749610146 >> v2:172.21.15.177:3300/0 conn(0x7f75d00ce970 0x7f75d00cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:15.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75d5000640 1 --2- 172.21.15.175:0/1749610146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d01600a0 0x7f75d00cc410 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f75d0071260 tx=0x7f75bc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627dbcdbcffe9738 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75cfe00640 1 -- 172.21.15.175:0/1749610146 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0aa430 con 0x7f75d01600a0 2024-04-25T09:13:15.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75cfe00640 1 -- 172.21.15.175:0/1749610146 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc0af070 con 0x7f75d01600a0 2024-04-25T09:13:15.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75cfe00640 1 -- 172.21.15.175:0/1749610146 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0aa7f0 con 0x7f75d01600a0 2024-04-25T09:13:15.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75d8400640 1 -- 172.21.15.175:0/1749610146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d01600a0 msgr2=0x7f75d00cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75d8400640 1 --2- 172.21.15.175:0/1749610146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d01600a0 0x7f75d00cc410 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f75d0071260 tx=0x7f75bc01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75d8400640 1 -- 172.21.15.175:0/1749610146 shutdown_connections 2024-04-25T09:13:15.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75d8400640 1 --2- 172.21.15.175:0/1749610146 >> v2:172.21.15.177:3300/0 conn(0x7f75d00ce970 0x7f75d00cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75d8400640 1 --2- 172.21.15.175:0/1749610146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d01600a0 0x7f75d00cc410 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75d8400640 1 --2- 172.21.15.175:0/1749610146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75d0145250 0x7f75d00cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75d8400640 1 -- 172.21.15.175:0/1749610146 >> 172.21.15.175:0/1749610146 conn(0x7f75d006ac50 msgr2=0x7f75d006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75d8400640 1 -- 172.21.15.175:0/1749610146 shutdown_connections 2024-04-25T09:13:15.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.080+0000 7f75d8400640 1 -- 172.21.15.175:0/1749610146 wait complete. 2024-04-25T09:13:15.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d8400640 1 Processor -- start 2024-04-25T09:13:15.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d8400640 1 -- start start 2024-04-25T09:13:15.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d8400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75d00ce970 0x7f75d015a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d8400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d0145250 0x7f75d0141650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d8400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75d01600a0 0x7f75d015aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d8400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d0145630 con 0x7f75d0145250 2024-04-25T09:13:15.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d8400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d0160500 con 0x7f75d00ce970 2024-04-25T09:13:15.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d8400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d015c870 con 0x7f75d01600a0 2024-04-25T09:13:15.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d5000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d0145250 0x7f75d0141650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d5000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d0145250 0x7f75d0141650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39066/0 (socket says 172.21.15.175:39066) 2024-04-25T09:13:15.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d5000640 1 -- 172.21.15.175:0/3281303281 learned_addr learned my addr 172.21.15.175:0/3281303281 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:15.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d5000640 1 -- 172.21.15.175:0/3281303281 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75d01600a0 msgr2=0x7f75d015aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d5000640 1 --2- 172.21.15.175:0/3281303281 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75d01600a0 0x7f75d015aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d5000640 1 -- 172.21.15.175:0/3281303281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75d00ce970 msgr2=0x7f75d015a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d5a00640 1 --2- 172.21.15.175:0/3281303281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75d00ce970 0x7f75d015a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d5000640 1 --2- 172.21.15.175:0/3281303281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75d00ce970 0x7f75d015a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d5000640 1 -- 172.21.15.175:0/3281303281 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d00ae7a0 con 0x7f75d0145250 2024-04-25T09:13:15.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d5a00640 1 --2- 172.21.15.175:0/3281303281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75d00ce970 0x7f75d015a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:15.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d5000640 1 --2- 172.21.15.175:0/3281303281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d0145250 0x7f75d0141650 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0ac040 tx=0x7f75bc019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75cd600640 1 -- 172.21.15.175:0/3281303281 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0b4810 con 0x7f75d0145250 2024-04-25T09:13:15.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75cd600640 1 -- 172.21.15.175:0/3281303281 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc0b49d0 con 0x7f75d0145250 2024-04-25T09:13:15.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75cd600640 1 -- 172.21.15.175:0/3281303281 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0b4dc0 con 0x7f75d0145250 2024-04-25T09:13:15.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d8400640 1 -- 172.21.15.175:0/3281303281 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d00b38a0 con 0x7f75d0145250 2024-04-25T09:13:15.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.084+0000 7f75d8400640 1 -- 172.21.15.175:0/3281303281 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d015b660 con 0x7f75d0145250 2024-04-25T09:13:15.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.088+0000 7f75cd600640 1 -- 172.21.15.175:0/3281303281 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f75bc0bc020 con 0x7f75d0145250 2024-04-25T09:13:15.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.088+0000 7f75cd600640 1 --2- 172.21.15.175:0/3281303281 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f75b0066f60 0x7f75b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.088+0000 7f75cd600640 1 -- 172.21.15.175:0/3281303281 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f75bc11f430 con 0x7f75d0145250 2024-04-25T09:13:15.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.088+0000 7f75d5a00640 1 --2- 172.21.15.175:0/3281303281 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f75b0066f60 0x7f75b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.088+0000 7f75db8a8000 1 Processor -- start 2024-04-25T09:13:15.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.088+0000 7f75db8a8000 1 -- start start 2024-04-25T09:13:15.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.088+0000 7f75d5a00640 1 --2- 172.21.15.175:0/3281303281 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f75b0066f60 0x7f75b0069420 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f75d00adbe0 tx=0x7f75c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426e22920 0x560426e22d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 0x560426dd89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426dd8f30 0x560426dd9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560426cc05f0 con 0x560426e23240 2024-04-25T09:13:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x560426c27da0 con 0x560426e22920 2024-04-25T09:13:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x560426bb0150 con 0x560426dd8f30 2024-04-25T09:13:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75d5000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 0x560426dd89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75d5000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 0x560426dd89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39082/0 (socket says 172.21.15.175:39082) 2024-04-25T09:13:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75d5000640 1 -- 172.21.15.175:0/735029554 learned_addr learned my addr 172.21.15.175:0/735029554 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75d5a00640 1 --2- 172.21.15.175:0/735029554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426e22920 0x560426e22d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75d6400640 1 --2- 172.21.15.175:0/735029554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426dd8f30 0x560426dd9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75d5000640 1 -- 172.21.15.175:0/735029554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426dd8f30 msgr2=0x560426dd9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75d5000640 1 --2- 172.21.15.175:0/735029554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426dd8f30 0x560426dd9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75d5000640 1 -- 172.21.15.175:0/735029554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426e22920 msgr2=0x560426e22d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75d5000640 1 --2- 172.21.15.175:0/735029554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426e22920 0x560426e22d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75d5000640 1 -- 172.21.15.175:0/735029554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560426bc9ca0 con 0x560426e23240 2024-04-25T09:13:15.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75d5000640 1 --2- 172.21.15.175:0/735029554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 0x560426dd89f0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0ef9d0 tx=0x7f75bc009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a5791fa6d27222 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75c2000640 1 -- 172.21.15.175:0/735029554 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0efcd0 con 0x560426e23240 2024-04-25T09:13:15.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75c2000640 1 -- 172.21.15.175:0/735029554 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc0af050 con 0x560426e23240 2024-04-25T09:13:15.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75c2000640 1 -- 172.21.15.175:0/735029554 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0f3e20 con 0x560426e23240 2024-04-25T09:13:15.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 -- 172.21.15.175:0/735029554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 msgr2=0x560426dd89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 --2- 172.21.15.175:0/735029554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 0x560426dd89f0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0ef9d0 tx=0x7f75bc009240 comp rx=0 tx=0).stop 2024-04-25T09:13:15.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 -- 172.21.15.175:0/735029554 shutdown_connections 2024-04-25T09:13:15.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 --2- 172.21.15.175:0/735029554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426dd8f30 0x560426dd9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 --2- 172.21.15.175:0/735029554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 0x560426dd89f0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 --2- 172.21.15.175:0/735029554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426e22920 0x560426e22d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 -- 172.21.15.175:0/735029554 >> 172.21.15.175:0/735029554 conn(0x560426ddf2a0 msgr2=0x560426dd72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 -- 172.21.15.175:0/735029554 shutdown_connections 2024-04-25T09:13:15.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 -- 172.21.15.175:0/735029554 wait complete. 2024-04-25T09:13:15.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 -- start start 2024-04-25T09:13:15.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 Processor -- start 2024-04-25T09:13:15.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426dd8f30 0x560426ddce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426e22920 0x560426ddd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426e23240 0x560426ddd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560426be2990 con 0x560426dd8f30 2024-04-25T09:13:15.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x560426c23e40 con 0x560426e22920 2024-04-25T09:13:15.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x560426bb3900 con 0x560426e23240 2024-04-25T09:13:15.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75db8a8000 10 client.0 _ll_register_callbacks cb 0x560426cdb1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:13:15.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75d5a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426dd8f30 0x560426ddce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.092+0000 7f75d5a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426dd8f30 0x560426ddce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39084/0 (socket says 172.21.15.175:39084) 2024-04-25T09:13:15.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75d5a00640 1 -- 172.21.15.175:0/418791453 learned_addr learned my addr 172.21.15.175:0/418791453 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:15.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75d5000640 1 --2- 172.21.15.175:0/418791453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426e22920 0x560426ddd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75d6400640 1 --2- 172.21.15.175:0/418791453 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426e23240 0x560426ddd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75d5a00640 1 -- 172.21.15.175:0/418791453 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426e23240 msgr2=0x560426ddd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75d5a00640 1 --2- 172.21.15.175:0/418791453 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426e23240 0x560426ddd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75d5a00640 1 -- 172.21.15.175:0/418791453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426e22920 msgr2=0x560426ddd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75d5a00640 1 --2- 172.21.15.175:0/418791453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426e22920 0x560426ddd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75d5a00640 1 -- 172.21.15.175:0/418791453 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560426be0630 con 0x560426dd8f30 2024-04-25T09:13:15.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75d5a00640 1 --2- 172.21.15.175:0/418791453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426dd8f30 0x560426ddce90 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f75c400cf10 tx=0x7f75c40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a28878dad14d7291 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75b6a00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:13:15.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75b6a00640 1 -- 172.21.15.175:0/418791453 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4013e30 con 0x560426dd8f30 2024-04-25T09:13:15.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75b6a00640 1 -- 172.21.15.175:0/418791453 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f75c40115e0 con 0x560426dd8f30 2024-04-25T09:13:15.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 1 -- 172.21.15.175:0/418791453 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f75bc0af050 con 0x560426dd8f30 2024-04-25T09:13:15.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75b6a00640 1 -- 172.21.15.175:0/418791453 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75c402c050 con 0x560426dd8f30 2024-04-25T09:13:15.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 10 client.8466 fetch_fsmap learned FSMap version 84 2024-04-25T09:13:15.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 1 -- 172.21.15.175:0/418791453 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x560426bb03a0 con 0x560426dd8f30 2024-04-25T09:13:15.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75b6a00640 1 -- 172.21.15.175:0/418791453 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc0af050 con 0x560426dd8f30 2024-04-25T09:13:15.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75b6a00640 1 -- 172.21.15.175:0/418791453 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f75c402f020 con 0x560426dd8f30 2024-04-25T09:13:15.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 10 client.8466 fetch_fsmap finished waiting for FSMap version 84 2024-04-25T09:13:15.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 10 client.8466 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:13:15.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 20 client.8466 populate_metadata read hostname 'smithi175' 2024-04-25T09:13:15.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 1 --2- 172.21.15.175:0/418791453 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x560426e31bc0 0x560426e33fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 4 client.8466 mds_command: new command op to 8397 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:13:15.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 1 -- 172.21.15.175:0/418791453 --> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560426bc3a50 con 0x560426e31bc0 2024-04-25T09:13:15.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75d5000640 1 --2- 172.21.15.175:0/418791453 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x560426e31bc0 0x560426e33fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75d5000640 1 --2- 172.21.15.175:0/418791453 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x560426e31bc0 0x560426e33fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9a3952c5ea1aff9 server_cookie=65834982069275f3 in_seq=0 out_seq=0 2024-04-25T09:13:15.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75b6a00640 10 client.8466 ms_handle_connect on v2:172.21.15.175:6835/2646458577 2024-04-25T09:13:15.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75b6a00640 1 -- 172.21.15.175:0/418791453 <== mds.0 v2:172.21.15.175:6835/2646458577 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560426bc3a50 con 0x560426e31bc0 2024-04-25T09:13:15.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75b6a00640 10 client.8466 handle_command_reply: tid=0 2024-04-25T09:13:15.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 1 client.8466 shutdown 2024-04-25T09:13:15.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 1 -- 172.21.15.175:0/418791453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426dd8f30 msgr2=0x560426ddce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 1 --2- 172.21.15.175:0/418791453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426dd8f30 0x560426ddce90 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f75c400cf10 tx=0x7f75c40046d0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 1 -- 172.21.15.175:0/418791453 shutdown_connections 2024-04-25T09:13:15.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 1 --2- 172.21.15.175:0/418791453 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x560426e31bc0 0x560426e33fb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 1 --2- 172.21.15.175:0/418791453 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426e23240 0x560426ddd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 1 --2- 172.21.15.175:0/418791453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426e22920 0x560426ddd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 1 --2- 172.21.15.175:0/418791453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426dd8f30 0x560426ddce90 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75b6a00640 0 client.8466 ms_handle_reset on v2:172.21.15.175:6835/2646458577 2024-04-25T09:13:15.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 1 -- 172.21.15.175:0/418791453 >> 172.21.15.175:0/418791453 conn(0x560426ddf2a0 msgr2=0x560426dd79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 1 -- 172.21.15.175:0/418791453 shutdown_connections 2024-04-25T09:13:15.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 1 -- 172.21.15.175:0/418791453 wait complete. 2024-04-25T09:13:15.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.096+0000 7f75db8a8000 20 client.8466 trim_cache size 0 max 16384 2024-04-25T09:13:15.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.112+0000 7f75db8a8000 1 Processor -- start 2024-04-25T09:13:15.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.112+0000 7f75db8a8000 1 -- start start 2024-04-25T09:13:15.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.112+0000 7f75db8a8000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426dd8f30 0x560426ddd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.112+0000 7f75db8a8000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426e22920 0x560426ddd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.112+0000 7f75db8a8000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 0x560426dd9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.112+0000 7f75db8a8000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d0201cd0 con 0x560426e23240 2024-04-25T09:13:15.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.112+0000 7f75db8a8000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d00b34d0 con 0x560426dd8f30 2024-04-25T09:13:15.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.112+0000 7f75db8a8000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d0164fb0 con 0x560426e22920 2024-04-25T09:13:15.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75d6400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 0x560426dd9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75d6400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 0x560426dd9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39092/0 (socket says 172.21.15.175:39092) 2024-04-25T09:13:15.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75d6400640 1 -- 172.21.15.175:0/4243735246 learned_addr learned my addr 172.21.15.175:0/4243735246 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:15.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75d5a00640 1 --2- 172.21.15.175:0/4243735246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426dd8f30 0x560426ddd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75d5000640 1 --2- 172.21.15.175:0/4243735246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426e22920 0x560426ddd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75d6400640 1 -- 172.21.15.175:0/4243735246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426e22920 msgr2=0x560426ddd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75d6400640 1 --2- 172.21.15.175:0/4243735246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426e22920 0x560426ddd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75d6400640 1 -- 172.21.15.175:0/4243735246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426dd8f30 msgr2=0x560426ddd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75d6400640 1 --2- 172.21.15.175:0/4243735246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426dd8f30 0x560426ddd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75d6400640 1 -- 172.21.15.175:0/4243735246 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560426ca9600 con 0x560426e23240 2024-04-25T09:13:15.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75d6400640 1 --2- 172.21.15.175:0/4243735246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 0x560426dd9310 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f75c8008f10 tx=0x7f75c800f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8628812582bb51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75c1600640 1 -- 172.21.15.175:0/4243735246 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c80039a0 con 0x560426e23240 2024-04-25T09:13:15.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75c1600640 1 -- 172.21.15.175:0/4243735246 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c8003b60 con 0x560426e23240 2024-04-25T09:13:15.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75c1600640 1 -- 172.21.15.175:0/4243735246 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c800d700 con 0x560426e23240 2024-04-25T09:13:15.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75db8a8000 1 -- 172.21.15.175:0/4243735246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 msgr2=0x560426dd9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75db8a8000 1 --2- 172.21.15.175:0/4243735246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 0x560426dd9310 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f75c8008f10 tx=0x7f75c800f820 comp rx=0 tx=0).stop 2024-04-25T09:13:15.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75db8a8000 1 -- 172.21.15.175:0/4243735246 shutdown_connections 2024-04-25T09:13:15.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75db8a8000 1 --2- 172.21.15.175:0/4243735246 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 0x560426dd9310 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75db8a8000 1 --2- 172.21.15.175:0/4243735246 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426e22920 0x560426ddd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75db8a8000 1 --2- 172.21.15.175:0/4243735246 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426dd8f30 0x560426ddd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75db8a8000 1 -- 172.21.15.175:0/4243735246 >> 172.21.15.175:0/4243735246 conn(0x560426ddf2a0 msgr2=0x560426dd81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75db8a8000 1 -- 172.21.15.175:0/4243735246 shutdown_connections 2024-04-25T09:13:15.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75db8a8000 1 -- 172.21.15.175:0/4243735246 wait complete. 2024-04-25T09:13:15.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75db8a8000 1 -- start start 2024-04-25T09:13:15.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75db8a8000 1 Processor -- start 2024-04-25T09:13:15.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75db8a8000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426dd8f30 0x560426ddd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75db8a8000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426e22920 0x560426e67500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75db8a8000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 0x560426e67a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75db8a8000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x560426c2c3d0 con 0x560426e23240 2024-04-25T09:13:15.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75db8a8000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x560426ce3d50 con 0x560426dd8f30 2024-04-25T09:13:15.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75db8a8000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x560426bc2980 con 0x560426e22920 2024-04-25T09:13:15.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75db8a8000 10 client.0 _ll_register_callbacks cb 0x7f75bc0094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:13:15.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75d6400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 0x560426e67a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75d6400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 0x560426e67a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39108/0 (socket says 172.21.15.175:39108) 2024-04-25T09:13:15.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75d6400640 1 -- 172.21.15.175:0/2271896938 learned_addr learned my addr 172.21.15.175:0/2271896938 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:15.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75d5000640 1 --2- 172.21.15.175:0/2271896938 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426e22920 0x560426e67500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.116+0000 7f75d5a00640 1 --2- 172.21.15.175:0/2271896938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426dd8f30 0x560426ddd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d6400640 1 -- 172.21.15.175:0/2271896938 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426e22920 msgr2=0x560426e67500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d6400640 1 --2- 172.21.15.175:0/2271896938 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426e22920 0x560426e67500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d6400640 1 -- 172.21.15.175:0/2271896938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426dd8f30 msgr2=0x560426ddd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d6400640 1 --2- 172.21.15.175:0/2271896938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426dd8f30 0x560426ddd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d6400640 1 -- 172.21.15.175:0/2271896938 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560426bbc9b0 con 0x560426e23240 2024-04-25T09:13:15.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d6400640 1 --2- 172.21.15.175:0/2271896938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 0x560426e67a40 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f75c801a040 tx=0x7f75c8005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9e5d86f9a6816d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75b6a00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:13:15.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75b6a00640 1 -- 172.21.15.175:0/2271896938 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8027020 con 0x560426e23240 2024-04-25T09:13:15.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75b6a00640 1 -- 172.21.15.175:0/2271896938 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f75c800d910 con 0x560426e23240 2024-04-25T09:13:15.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 1 -- 172.21.15.175:0/2271896938 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f75c8003b60 con 0x560426e23240 2024-04-25T09:13:15.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75b6a00640 1 -- 172.21.15.175:0/2271896938 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75c8031050 con 0x560426e23240 2024-04-25T09:13:15.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 10 client.8472 fetch_fsmap learned FSMap version 84 2024-04-25T09:13:15.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 1 -- 172.21.15.175:0/2271896938 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x560426bcf0b0 con 0x560426e23240 2024-04-25T09:13:15.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75b6a00640 1 -- 172.21.15.175:0/2271896938 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c8003b60 con 0x560426e23240 2024-04-25T09:13:15.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75b6a00640 1 -- 172.21.15.175:0/2271896938 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f75c8034020 con 0x560426e23240 2024-04-25T09:13:15.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 10 client.8472 fetch_fsmap finished waiting for FSMap version 84 2024-04-25T09:13:15.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 10 client.8472 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:13:15.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 20 client.8472 populate_metadata read hostname 'smithi175' 2024-04-25T09:13:15.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 1 --2- 172.21.15.175:0/2271896938 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x560426ddda20 0x560426e67f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 4 client.8472 mds_command: new command op to 8397 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:13:15.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 1 -- 172.21.15.175:0/2271896938 --> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560426c352e0 con 0x560426ddda20 2024-04-25T09:13:15.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d5a00640 1 --2- 172.21.15.175:0/2271896938 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x560426ddda20 0x560426e67f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d5a00640 1 --2- 172.21.15.175:0/2271896938 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x560426ddda20 0x560426e67f80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc057175c2a54e3a server_cookie=4c19f939ca0bcbc7 in_seq=0 out_seq=0 2024-04-25T09:13:15.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75b6a00640 10 client.8472 ms_handle_connect on v2:172.21.15.175:6835/2646458577 2024-04-25T09:13:15.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75b6a00640 1 -- 172.21.15.175:0/2271896938 <== mds.0 v2:172.21.15.175:6835/2646458577 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x560426c352e0 con 0x560426ddda20 2024-04-25T09:13:15.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75b6a00640 10 client.8472 handle_command_reply: tid=0 2024-04-25T09:13:15.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 1 client.8472 shutdown 2024-04-25T09:13:15.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 1 -- 172.21.15.175:0/2271896938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 msgr2=0x560426e67a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 1 --2- 172.21.15.175:0/2271896938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 0x560426e67a40 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f75c801a040 tx=0x7f75c8005d20 comp rx=0 tx=0).stop 2024-04-25T09:13:15.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 1 -- 172.21.15.175:0/2271896938 shutdown_connections 2024-04-25T09:13:15.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 1 --2- 172.21.15.175:0/2271896938 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x560426ddda20 0x560426e67f80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 1 --2- 172.21.15.175:0/2271896938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x560426e23240 0x560426e67a40 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 1 --2- 172.21.15.175:0/2271896938 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x560426e22920 0x560426e67500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75b6a00640 0 client.8472 ms_handle_reset on v2:172.21.15.175:6835/2646458577 2024-04-25T09:13:15.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 1 --2- 172.21.15.175:0/2271896938 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x560426dd8f30 0x560426ddd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 1 -- 172.21.15.175:0/2271896938 >> 172.21.15.175:0/2271896938 conn(0x560426ddf2a0 msgr2=0x560426e0e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 1 -- 172.21.15.175:0/2271896938 shutdown_connections 2024-04-25T09:13:15.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 1 -- 172.21.15.175:0/2271896938 wait complete. 2024-04-25T09:13:15.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75db8a8000 20 client.8472 trim_cache size 0 max 16384 2024-04-25T09:13:15.112 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:13:15.112 INFO:teuthology.orchestra.run.smithi175.stdout: "cluster_fsid": "8caed986-ca08-40e2-b5a5-12e2aade6223", 2024-04-25T09:13:15.112 INFO:teuthology.orchestra.run.smithi175.stdout: "whoami": 0, 2024-04-25T09:13:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 8397, 2024-04-25T09:13:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: "want_state": "up:active", 2024-04-25T09:13:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: "state": "up:active", 2024-04-25T09:13:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs", 2024-04-25T09:13:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: "rank_uptime": 4.5089874249999999, 2024-04-25T09:13:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: "mdsmap_epoch": 84, 2024-04-25T09:13:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch": 101, 2024-04-25T09:13:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch_barrier": 101, 2024-04-25T09:13:15.113 INFO:teuthology.orchestra.run.smithi175.stdout: "uptime": 5.5081984659999996 2024-04-25T09:13:15.113 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:13:15.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d8400640 1 -- 172.21.15.175:0/3281303281 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f75b0066f60 msgr2=0x7f75b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d8400640 1 --2- 172.21.15.175:0/3281303281 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f75b0066f60 0x7f75b0069420 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f75d00adbe0 tx=0x7f75c4008040 comp rx=0 tx=0).stop 2024-04-25T09:13:15.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d8400640 1 -- 172.21.15.175:0/3281303281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d0145250 msgr2=0x7f75d0141650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d8400640 1 --2- 172.21.15.175:0/3281303281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d0145250 0x7f75d0141650 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f75bc0ac040 tx=0x7f75bc019290 comp rx=0 tx=0).stop 2024-04-25T09:13:15.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d8400640 1 -- 172.21.15.175:0/3281303281 shutdown_connections 2024-04-25T09:13:15.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d8400640 1 --2- 172.21.15.175:0/3281303281 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f75b0066f60 0x7f75b0069420 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d8400640 1 --2- 172.21.15.175:0/3281303281 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f75d01600a0 0x7f75d015aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d8400640 1 --2- 172.21.15.175:0/3281303281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d0145250 0x7f75d0141650 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d8400640 1 --2- 172.21.15.175:0/3281303281 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f75d00ce970 0x7f75d015a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d8400640 1 -- 172.21.15.175:0/3281303281 >> 172.21.15.175:0/3281303281 conn(0x7f75d006ac50 msgr2=0x7f75d00cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d8400640 1 -- 172.21.15.175:0/3281303281 shutdown_connections 2024-04-25T09:13:15.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.120+0000 7f75d8400640 1 -- 172.21.15.175:0/3281303281 wait complete. 2024-04-25T09:13:15.127 DEBUG:teuthology.orchestra.run.smithi175:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-25T09:13:15.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:15.131 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-04-25T09:13:15.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.284+0000 7f1702400640 1 Processor -- start 2024-04-25T09:13:15.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.284+0000 7f1702400640 1 -- start start 2024-04-25T09:13:15.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.288+0000 7f1702400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f16fc15b700 0x7f16fc0b7310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.288+0000 7f1702400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f16fc15fb90 0x7f16fc160020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.288+0000 7f1702400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16fc15c670 con 0x7f16fc15bae0 2024-04-25T09:13:15.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.288+0000 7f1702400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16fc0b7850 con 0x7f16fc15fb90 2024-04-25T09:13:15.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.288+0000 7f1702400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16fc15f700 con 0x7f16fc15b700 2024-04-25T09:13:15.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.288+0000 7f16faa00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f16fc15fb90 0x7f16fc160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.288+0000 7f16faa00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f16fc15fb90 0x7f16fc160020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39124/0 (socket says 172.21.15.175:39124) 2024-04-25T09:13:15.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.288+0000 7f16faa00640 1 -- 172.21.15.175:0/3692584550 learned_addr learned my addr 172.21.15.175:0/3692584550 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:15.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.288+0000 7f16fb400640 1 --2- 172.21.15.175:0/3692584550 >> v2:172.21.15.177:3300/0 conn(0x7f16fc15b700 0x7f16fc0b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.288+0000 7f16faa00640 1 -- 172.21.15.175:0/3692584550 >> v2:172.21.15.177:3300/0 conn(0x7f16fc15b700 msgr2=0x7f16fc0b7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.288+0000 7f16faa00640 1 --2- 172.21.15.175:0/3692584550 >> v2:172.21.15.177:3300/0 conn(0x7f16fc15b700 0x7f16fc0b7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.288+0000 7f16faa00640 1 -- 172.21.15.175:0/3692584550 >> v1:172.21.15.177:6789/0 conn(0x7f16fc15bae0 legacy=0x7f16fc0cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.276 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.288+0000 7f16faa00640 1 -- 172.21.15.175:0/3692584550 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc15c950 con 0x7f16fc15fb90 2024-04-25T09:13:15.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.292+0000 7f16faa00640 1 --2- 172.21.15.175:0/3692584550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16fc15fb90 0x7f16fc160020 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0705a0 tx=0x7f16e801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342c2b1daed547d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.292+0000 7f16fa000640 1 -- 172.21.15.175:0/3692584550 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e80ab680 con 0x7f16fc15fb90 2024-04-25T09:13:15.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.292+0000 7f16fa000640 1 -- 172.21.15.175:0/3692584550 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e80b0070 con 0x7f16fc15fb90 2024-04-25T09:13:15.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.292+0000 7f16fa000640 1 -- 172.21.15.175:0/3692584550 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e80aba40 con 0x7f16fc15fb90 2024-04-25T09:13:15.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.292+0000 7f1702400640 1 -- 172.21.15.175:0/3692584550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16fc15fb90 msgr2=0x7f16fc160020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.292+0000 7f1702400640 1 --2- 172.21.15.175:0/3692584550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16fc15fb90 0x7f16fc160020 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0705a0 tx=0x7f16e801c520 comp rx=0 tx=0).stop 2024-04-25T09:13:15.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.292+0000 7f1702400640 1 -- 172.21.15.175:0/3692584550 shutdown_connections 2024-04-25T09:13:15.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.292+0000 7f1702400640 1 --2- 172.21.15.175:0/3692584550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16fc15fb90 0x7f16fc160020 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.292+0000 7f1702400640 1 --2- 172.21.15.175:0/3692584550 >> v2:172.21.15.177:3300/0 conn(0x7f16fc15b700 0x7f16fc0b7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.292+0000 7f1702400640 1 -- 172.21.15.175:0/3692584550 >> 172.21.15.175:0/3692584550 conn(0x7f16fc0d1880 msgr2=0x7f16fc0d1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.292+0000 7f1702400640 1 -- 172.21.15.175:0/3692584550 shutdown_connections 2024-04-25T09:13:15.280 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.292+0000 7f1702400640 1 -- 172.21.15.175:0/3692584550 wait complete. 2024-04-25T09:13:15.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.292+0000 7f1702400640 1 Processor -- start 2024-04-25T09:13:15.281 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.292+0000 7f1702400640 1 -- start start 2024-04-25T09:13:15.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f1702400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16fc15b700 0x7f16fc0d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f1702400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16fc15bae0 0x7f16fc151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f1702400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16fc15fb90 0x7f16fc0c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f1702400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc1687e0 con 0x7f16fc15b700 2024-04-25T09:13:15.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f1702400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc168660 con 0x7f16fc15bae0 2024-04-25T09:13:15.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f1702400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc168960 con 0x7f16fc15fb90 2024-04-25T09:13:15.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f16fb400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16fc15b700 0x7f16fc0d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f16fb400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16fc15b700 0x7f16fc0d0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39128/0 (socket says 172.21.15.175:39128) 2024-04-25T09:13:15.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f16fb400640 1 -- 172.21.15.175:0/1315828723 learned_addr learned my addr 172.21.15.175:0/1315828723 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:15.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f16faa00640 1 --2- 172.21.15.175:0/1315828723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16fc15bae0 0x7f16fc151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f16fbe00640 1 --2- 172.21.15.175:0/1315828723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16fc15fb90 0x7f16fc0c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f16fb400640 1 -- 172.21.15.175:0/1315828723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16fc15fb90 msgr2=0x7f16fc0c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f16fb400640 1 --2- 172.21.15.175:0/1315828723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16fc15fb90 0x7f16fc0c7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f16fb400640 1 -- 172.21.15.175:0/1315828723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16fc15bae0 msgr2=0x7f16fc151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f16fb400640 1 --2- 172.21.15.175:0/1315828723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16fc15bae0 0x7f16fc151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f16fb400640 1 -- 172.21.15.175:0/1315828723 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc0cff20 con 0x7f16fc15b700 2024-04-25T09:13:15.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f16fb400640 1 --2- 172.21.15.175:0/1315828723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16fc15b700 0x7f16fc0d0f50 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00e8a0 tx=0x7f16ec00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f16f3400640 1 -- 172.21.15.175:0/1315828723 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec017070 con 0x7f16fc15b700 2024-04-25T09:13:15.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f16f3400640 1 -- 172.21.15.175:0/1315828723 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec00c940 con 0x7f16fc15b700 2024-04-25T09:13:15.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f16f3400640 1 -- 172.21.15.175:0/1315828723 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec00ccf0 con 0x7f16fc15b700 2024-04-25T09:13:15.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f1702400640 1 -- 172.21.15.175:0/1315828723 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16fc0d0190 con 0x7f16fc15b700 2024-04-25T09:13:15.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.296+0000 7f1702400640 1 -- 172.21.15.175:0/1315828723 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16fc0d0750 con 0x7f16fc15b700 2024-04-25T09:13:15.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.300+0000 7f16f3400640 1 -- 172.21.15.175:0/1315828723 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f16ec01a070 con 0x7f16fc15b700 2024-04-25T09:13:15.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.300+0000 7f16f3400640 1 --2- 172.21.15.175:0/1315828723 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f16dc066f90 0x7f16dc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.300+0000 7f170593d000 1 Processor -- start 2024-04-25T09:13:15.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.300+0000 7f16f3400640 1 -- 172.21.15.175:0/1315828723 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f16ec084dc0 con 0x7f16fc15b700 2024-04-25T09:13:15.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.300+0000 7f16faa00640 1 --2- 172.21.15.175:0/1315828723 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f16dc066f90 0x7f16dc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.300+0000 7f170593d000 1 -- start start 2024-04-25T09:13:15.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.300+0000 7f16faa00640 1 --2- 172.21.15.175:0/1315828723 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f16dc066f90 0x7f16dc069450 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f16e80af000 tx=0x7f16e80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.300+0000 7f170593d000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a676bc90 0x55d8a676c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.300+0000 7f170593d000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a676c5b0 0x55d8a6721d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.300+0000 7f170593d000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a6722290 0x55d8a6722670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.300+0000 7f170593d000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8a6608f40 con 0x55d8a6722290 2024-04-25T09:13:15.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.300+0000 7f170593d000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8a6570070 con 0x55d8a676c5b0 2024-04-25T09:13:15.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.300+0000 7f170593d000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8a64f81a0 con 0x55d8a676bc90 2024-04-25T09:13:15.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.300+0000 7f16fbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a6722290 0x55d8a6722670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.300+0000 7f16fbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a6722290 0x55d8a6722670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39144/0 (socket says 172.21.15.175:39144) 2024-04-25T09:13:15.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f16fbe00640 1 -- 172.21.15.175:0/2429570755 learned_addr learned my addr 172.21.15.175:0/2429570755 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:15.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f16fb400640 1 --2- 172.21.15.175:0/2429570755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a676bc90 0x55d8a676c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f16faa00640 1 --2- 172.21.15.175:0/2429570755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a676c5b0 0x55d8a6721d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f16fbe00640 1 -- 172.21.15.175:0/2429570755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a676bc90 msgr2=0x55d8a676c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f16fbe00640 1 --2- 172.21.15.175:0/2429570755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a676bc90 0x55d8a676c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f16fbe00640 1 -- 172.21.15.175:0/2429570755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a676c5b0 msgr2=0x55d8a6721d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f16fbe00640 1 --2- 172.21.15.175:0/2429570755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a676c5b0 0x55d8a6721d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f16fbe00640 1 -- 172.21.15.175:0/2429570755 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8a64f6510 con 0x55d8a6722290 2024-04-25T09:13:15.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f16faa00640 1 --2- 172.21.15.175:0/2429570755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a676c5b0 0x55d8a6721d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:15.291 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f16fbe00640 1 --2- 172.21.15.175:0/2429570755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a6722290 0x55d8a6722670 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f16f4001f50 tx=0x7f16f40016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f052275985558c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.292 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f16e7e00640 1 -- 172.21.15.175:0/2429570755 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f400fe50 con 0x55d8a6722290 2024-04-25T09:13:15.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f16e7e00640 1 -- 172.21.15.175:0/2429570755 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f4018070 con 0x55d8a6722290 2024-04-25T09:13:15.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f16e7e00640 1 -- 172.21.15.175:0/2429570755 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4003b80 con 0x55d8a6722290 2024-04-25T09:13:15.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f170593d000 1 -- 172.21.15.175:0/2429570755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a6722290 msgr2=0x55d8a6722670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f170593d000 1 --2- 172.21.15.175:0/2429570755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a6722290 0x55d8a6722670 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f16f4001f50 tx=0x7f16f40016b0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f170593d000 1 -- 172.21.15.175:0/2429570755 shutdown_connections 2024-04-25T09:13:15.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f170593d000 1 --2- 172.21.15.175:0/2429570755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a6722290 0x55d8a6722670 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f170593d000 1 --2- 172.21.15.175:0/2429570755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a676c5b0 0x55d8a6721d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f170593d000 1 --2- 172.21.15.175:0/2429570755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a676bc90 0x55d8a676c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f170593d000 1 -- 172.21.15.175:0/2429570755 >> 172.21.15.175:0/2429570755 conn(0x55d8a671e240 msgr2=0x55d8a6720630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f170593d000 1 -- 172.21.15.175:0/2429570755 shutdown_connections 2024-04-25T09:13:15.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f170593d000 1 -- 172.21.15.175:0/2429570755 wait complete. 2024-04-25T09:13:15.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f170593d000 1 -- start start 2024-04-25T09:13:15.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f170593d000 1 Processor -- start 2024-04-25T09:13:15.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f170593d000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a6722290 0x55d8a672ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f170593d000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a676bc90 0x55d8a672d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f170593d000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a676c5b0 0x55d8a672d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.296 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f170593d000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8a652a6c0 con 0x55d8a676bc90 2024-04-25T09:13:15.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f170593d000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8a656c110 con 0x55d8a6722290 2024-04-25T09:13:15.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f170593d000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8a6626f20 con 0x55d8a676c5b0 2024-04-25T09:13:15.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f170593d000 10 client.0 _ll_register_callbacks cb 0x55d8a670d570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:13:15.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f16faa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a676bc90 0x55d8a672d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f16faa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a676bc90 0x55d8a672d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39156/0 (socket says 172.21.15.175:39156) 2024-04-25T09:13:15.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f16faa00640 1 -- 172.21.15.175:0/3851136776 learned_addr learned my addr 172.21.15.175:0/3851136776 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:15.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.304+0000 7f16fb400640 1 --2- 172.21.15.175:0/3851136776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a6722290 0x55d8a672ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16fbe00640 1 --2- 172.21.15.175:0/3851136776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a676c5b0 0x55d8a672d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16faa00640 1 -- 172.21.15.175:0/3851136776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a676c5b0 msgr2=0x55d8a672d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16faa00640 1 --2- 172.21.15.175:0/3851136776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a676c5b0 0x55d8a672d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16faa00640 1 -- 172.21.15.175:0/3851136776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a6722290 msgr2=0x55d8a672ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16faa00640 1 --2- 172.21.15.175:0/3851136776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a6722290 0x55d8a672ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16faa00640 1 -- 172.21.15.175:0/3851136776 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8a64f83b0 con 0x55d8a676bc90 2024-04-25T09:13:15.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16faa00640 1 --2- 172.21.15.175:0/3851136776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a676bc90 0x55d8a672d370 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f16e801c560 tx=0x7f16e80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13de2e90f00dfef2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16e4c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:13:15.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16e4c00640 1 -- 172.21.15.175:0/3851136776 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e80cf060 con 0x55d8a676bc90 2024-04-25T09:13:15.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16e4c00640 1 -- 172.21.15.175:0/3851136776 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f16e80abdf0 con 0x55d8a676bc90 2024-04-25T09:13:15.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f170593d000 1 -- 172.21.15.175:0/3851136776 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f16f4018070 con 0x55d8a676bc90 2024-04-25T09:13:15.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16e4c00640 1 -- 172.21.15.175:0/3851136776 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16e80bc070 con 0x55d8a676bc90 2024-04-25T09:13:15.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f170593d000 10 client.8484 fetch_fsmap learned FSMap version 84 2024-04-25T09:13:15.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f170593d000 1 -- 172.21.15.175:0/3851136776 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x55d8a65f1e00 con 0x55d8a676bc90 2024-04-25T09:13:15.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16e4c00640 1 -- 172.21.15.175:0/3851136776 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f4018070 con 0x55d8a676bc90 2024-04-25T09:13:15.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16e4c00640 1 -- 172.21.15.175:0/3851136776 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f16fc0b3b90 con 0x55d8a676bc90 2024-04-25T09:13:15.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f170593d000 10 client.8484 fetch_fsmap finished waiting for FSMap version 84 2024-04-25T09:13:15.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f170593d000 10 client.8484 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:13:15.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f170593d000 20 client.8484 populate_metadata read hostname 'smithi175' 2024-04-25T09:13:15.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f170593d000 1 --2- 172.21.15.175:0/3851136776 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x55d8a672e150 0x55d8a677d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f170593d000 4 client.8484 mds_command: new command op to 8397 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:13:15.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f170593d000 1 -- 172.21.15.175:0/3851136776 --> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8a650bd60 con 0x55d8a672e150 2024-04-25T09:13:15.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16fb400640 1 --2- 172.21.15.175:0/3851136776 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x55d8a672e150 0x55d8a677d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16fb400640 1 --2- 172.21.15.175:0/3851136776 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x55d8a672e150 0x55d8a677d410 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b6d1f24a47c0204 server_cookie=a8816c3d6fcf7c50 in_seq=0 out_seq=0 2024-04-25T09:13:15.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16e4c00640 10 client.8484 ms_handle_connect on v2:172.21.15.175:6835/2646458577 2024-04-25T09:13:15.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16e4c00640 1 -- 172.21.15.175:0/3851136776 <== mds.0 v2:172.21.15.175:6835/2646458577 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d8a650bd60 con 0x55d8a672e150 2024-04-25T09:13:15.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16e4c00640 10 client.8484 handle_command_reply: tid=0 2024-04-25T09:13:15.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f170593d000 1 client.8484 shutdown 2024-04-25T09:13:15.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f170593d000 1 -- 172.21.15.175:0/3851136776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a676bc90 msgr2=0x55d8a672d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f170593d000 1 --2- 172.21.15.175:0/3851136776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a676bc90 0x55d8a672d370 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f16e801c560 tx=0x7f16e80046d0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f170593d000 1 -- 172.21.15.175:0/3851136776 shutdown_connections 2024-04-25T09:13:15.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f170593d000 1 --2- 172.21.15.175:0/3851136776 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x55d8a672e150 0x55d8a677d410 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f170593d000 1 --2- 172.21.15.175:0/3851136776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a676c5b0 0x55d8a672d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f170593d000 1 --2- 172.21.15.175:0/3851136776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a676bc90 0x55d8a672d370 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f16e4c00640 0 client.8484 ms_handle_reset on v2:172.21.15.175:6835/2646458577 2024-04-25T09:13:15.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f170593d000 1 --2- 172.21.15.175:0/3851136776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a6722290 0x55d8a672ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.308+0000 7f170593d000 1 -- 172.21.15.175:0/3851136776 >> 172.21.15.175:0/3851136776 conn(0x55d8a671e240 msgr2=0x55d8a6720ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.312+0000 7f170593d000 1 -- 172.21.15.175:0/3851136776 shutdown_connections 2024-04-25T09:13:15.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.312+0000 7f170593d000 1 -- 172.21.15.175:0/3851136776 wait complete. 2024-04-25T09:13:15.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.312+0000 7f170593d000 20 client.8484 trim_cache size 0 max 16384 2024-04-25T09:13:15.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.312+0000 7f7e76400640 1 Processor -- start 2024-04-25T09:13:15.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.312+0000 7f7e76400640 1 -- start start 2024-04-25T09:13:15.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.312+0000 7f7e76400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7e700ce810 0x7f7e700ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.312+0000 7f7e76400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e700cd570 0x7f7e700cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.312+0000 7f7e76400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e700af1d0 con 0x7f7e700aedf0 2024-04-25T09:13:15.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.312+0000 7f7e76400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e700cf1e0 con 0x7f7e700ce810 2024-04-25T09:13:15.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.312+0000 7f7e76400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7015e300 con 0x7f7e700cd570 2024-04-25T09:13:15.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.316+0000 7f7e75000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7e700aedf0 0x7f7e7006ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:52728/0 (socket says 172.21.15.175:52728) 2024-04-25T09:13:15.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.316+0000 7f7e75000640 1 -- 172.21.15.175:0/3725891536 learned_addr learned my addr 172.21.15.175:0/3725891536 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:15.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.316+0000 7f7e6fe00640 1 --2- 172.21.15.175:0/3725891536 >> v2:172.21.15.177:3300/0 conn(0x7f7e700ce810 0x7f7e700ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.316+0000 7f7e75a00640 1 --2- 172.21.15.175:0/3725891536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e700cd570 0x7f7e700cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.316+0000 7f7e6f400640 1 -- 172.21.15.175:0/3725891536 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001903088 0 0) 0x7f7e700af1d0 con 0x7f7e700aedf0 2024-04-25T09:13:15.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.316+0000 7f7e6f400640 1 -- 172.21.15.175:0/3725891536 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e58003530 con 0x7f7e700aedf0 2024-04-25T09:13:15.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.316+0000 7f7e6fe00640 1 -- 172.21.15.175:0/3725891536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e700cd570 msgr2=0x7f7e700cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.316+0000 7f7e6fe00640 1 --2- 172.21.15.175:0/3725891536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e700cd570 0x7f7e700cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.316+0000 7f7e6fe00640 1 -- 172.21.15.175:0/3725891536 >> v1:172.21.15.175:6789/0 conn(0x7f7e700aedf0 legacy=0x7f7e7006ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.316+0000 7f7e6fe00640 1 -- 172.21.15.175:0/3725891536 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7015e5e0 con 0x7f7e700ce810 2024-04-25T09:13:15.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.316+0000 7f7e6fe00640 1 --2- 172.21.15.175:0/3725891536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e700ce810 0x7f7e700ceca0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c0097c0 tx=0x7f7e5c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=128ca773d6591836 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e6f400640 1 -- 172.21.15.175:0/3725891536 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c0b0070 con 0x7f7e700ce810 2024-04-25T09:13:15.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e6f400640 1 -- 172.21.15.175:0/3725891536 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c0ab600 con 0x7f7e700ce810 2024-04-25T09:13:15.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e6f400640 1 -- 172.21.15.175:0/3725891536 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c0ab9d0 con 0x7f7e700ce810 2024-04-25T09:13:15.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e76400640 1 -- 172.21.15.175:0/3725891536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e700ce810 msgr2=0x7f7e700ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e76400640 1 --2- 172.21.15.175:0/3725891536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e700ce810 0x7f7e700ceca0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c0097c0 tx=0x7f7e5c01c410 comp rx=0 tx=0).stop 2024-04-25T09:13:15.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e76400640 1 -- 172.21.15.175:0/3725891536 shutdown_connections 2024-04-25T09:13:15.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e76400640 1 --2- 172.21.15.175:0/3725891536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e700cd570 0x7f7e700cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e76400640 1 --2- 172.21.15.175:0/3725891536 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e700ce810 0x7f7e700ceca0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e76400640 1 -- 172.21.15.175:0/3725891536 >> 172.21.15.175:0/3725891536 conn(0x7f7e700b15e0 msgr2=0x7f7e700b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e76400640 1 -- 172.21.15.175:0/3725891536 shutdown_connections 2024-04-25T09:13:15.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e76400640 1 -- 172.21.15.175:0/3725891536 wait complete. 2024-04-25T09:13:15.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e76400640 1 Processor -- start 2024-04-25T09:13:15.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e76400640 1 -- start start 2024-04-25T09:13:15.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e76400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e700aedf0 0x7f7e7014bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e76400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e700cd570 0x7f7e700c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e76400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e700ce810 0x7f7e700c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e76400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7006f1e0 con 0x7f7e700ce810 2024-04-25T09:13:15.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e76400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7015baa0 con 0x7f7e700aedf0 2024-04-25T09:13:15.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e76400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e70167fb0 con 0x7f7e700cd570 2024-04-25T09:13:15.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e75a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e700ce810 0x7f7e700c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e75a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e700ce810 0x7f7e700c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39168/0 (socket says 172.21.15.175:39168) 2024-04-25T09:13:15.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e75a00640 1 -- 172.21.15.175:0/3222526753 learned_addr learned my addr 172.21.15.175:0/3222526753 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:15.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e75000640 1 --2- 172.21.15.175:0/3222526753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e700aedf0 0x7f7e7014bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.320+0000 7f7e6fe00640 1 --2- 172.21.15.175:0/3222526753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e700cd570 0x7f7e700c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.324+0000 7f7e75a00640 1 -- 172.21.15.175:0/3222526753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e700cd570 msgr2=0x7f7e700c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.324+0000 7f7e75a00640 1 --2- 172.21.15.175:0/3222526753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e700cd570 0x7f7e700c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.324+0000 7f7e75a00640 1 -- 172.21.15.175:0/3222526753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e700aedf0 msgr2=0x7f7e7014bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.324+0000 7f7e75a00640 1 --2- 172.21.15.175:0/3222526753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e700aedf0 0x7f7e7014bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.324+0000 7f7e75a00640 1 -- 172.21.15.175:0/3222526753 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e70168220 con 0x7f7e700ce810 2024-04-25T09:13:15.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.324+0000 7f7e75000640 1 --2- 172.21.15.175:0/3222526753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e700aedf0 0x7f7e7014bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:15.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.324+0000 7f7e75a00640 1 --2- 172.21.15.175:0/3222526753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e700ce810 0x7f7e700c91a0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f7e68009d20 tx=0x7f7e6800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.324+0000 7f7e6cc00640 1 -- 172.21.15.175:0/3222526753 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68018020 con 0x7f7e700ce810 2024-04-25T09:13:15.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.324+0000 7f7e6cc00640 1 -- 172.21.15.175:0/3222526753 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e68009b10 con 0x7f7e700ce810 2024-04-25T09:13:15.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.324+0000 7f7e6cc00640 1 -- 172.21.15.175:0/3222526753 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e680146c0 con 0x7f7e700ce810 2024-04-25T09:13:15.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.324+0000 7f7e76400640 1 -- 172.21.15.175:0/3222526753 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e70168500 con 0x7f7e700ce810 2024-04-25T09:13:15.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.324+0000 7f7e76400640 1 -- 172.21.15.175:0/3222526753 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e7014c270 con 0x7f7e700ce810 2024-04-25T09:13:15.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.324+0000 7f7e76400640 1 -- 172.21.15.175:0/3222526753 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f7e70074a60 con 0x7f7e700ce810 2024-04-25T09:13:15.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.324+0000 7f7e6cc00640 1 -- 172.21.15.175:0/3222526753 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7e6801b020 con 0x7f7e700ce810 2024-04-25T09:13:15.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.324+0000 7f7e6cc00640 1 --2- 172.21.15.175:0/3222526753 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7e50066f60 0x7f7e50069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.324+0000 7f7e6cc00640 1 -- 172.21.15.175:0/3222526753 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f7e680862f0 con 0x7f7e700ce810 2024-04-25T09:13:15.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.324+0000 7f7e75000640 1 --2- 172.21.15.175:0/3222526753 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7e50066f60 0x7f7e50069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f7e6cc00640 1 -- 172.21.15.175:0/3222526753 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+512 (secure 0 0 0) 0x7f7e68022070 con 0x7f7e700ce810 2024-04-25T09:13:15.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f7e76400640 1 -- 172.21.15.175:0/3222526753 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f7e700cd0e0 con 0x7f7e700ce810 2024-04-25T09:13:15.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f7e6cc00640 1 -- 172.21.15.175:0/3222526753 <== mon.0 v2:172.21.15.175:3300/0 7 ==== log(2 entries from seq 1120 at 2024-04-25T09:13:13.625187+0000) v1 ==== 389+0+0 (secure 0 0 0) 0x7f7e68054ba0 con 0x7f7e700ce810 2024-04-25T09:13:15.314 INFO:teuthology.orchestra.run.smithi175.stdout: cluster: 2024-04-25T09:13:15.315 INFO:teuthology.orchestra.run.smithi175.stdout: id: 8caed986-ca08-40e2-b5a5-12e2aade6223 2024-04-25T09:13:15.315 INFO:teuthology.orchestra.run.smithi175.stdout: health: HEALTH_OK 2024-04-25T09:13:15.315 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:13:15.315 INFO:teuthology.orchestra.run.smithi175.stdout: services: 2024-04-25T09:13:15.315 INFO:teuthology.orchestra.run.smithi175.stdout: mon: 3 daemons, quorum a,b,c (age 9m) 2024-04-25T09:13:15.315 INFO:teuthology.orchestra.run.smithi175.stdout: mgr: y(active, since 9m), standbys: x 2024-04-25T09:13:15.315 INFO:teuthology.orchestra.run.smithi175.stdout: mds: 1/1 daemons up, 3 standby 2024-04-25T09:13:15.315 INFO:teuthology.orchestra.run.smithi175.stdout: osd: 8 osds: 8 up (since 9m), 8 in (since 9m) 2024-04-25T09:13:15.315 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:13:15.315 INFO:teuthology.orchestra.run.smithi175.stdout: data: 2024-04-25T09:13:15.315 INFO:teuthology.orchestra.run.smithi175.stdout: volumes: 1/1 healthy 2024-04-25T09:13:15.315 INFO:teuthology.orchestra.run.smithi175.stdout: pools: 3 pools, 97 pgs 2024-04-25T09:13:15.316 INFO:teuthology.orchestra.run.smithi175.stdout: objects: 30 objects, 19 MiB 2024-04-25T09:13:15.316 INFO:teuthology.orchestra.run.smithi175.stdout: usage: 290 MiB used, 720 GiB / 720 GiB avail 2024-04-25T09:13:15.316 INFO:teuthology.orchestra.run.smithi175.stdout: pgs: 97 active+clean 2024-04-25T09:13:15.316 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:13:15.316 INFO:teuthology.orchestra.run.smithi175.stdout: io: 2024-04-25T09:13:15.316 INFO:teuthology.orchestra.run.smithi175.stdout: client: 1.8 KiB/s rd, 102 B/s wr, 1 op/s rd, 0 op/s wr 2024-04-25T09:13:15.316 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:13:15.316 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:13:15.316 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:13:13.625187+0000 mon.a [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T09:13:15.316 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:13:13.625207+0000 mon.a [INF] Cluster is now healthy 2024-04-25T09:13:15.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f7e75000640 1 --2- 172.21.15.175:0/3222526753 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7e50066f60 0x7f7e50069420 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7e70150bc0 tx=0x7f7e64009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f170593d000 1 Processor -- start 2024-04-25T09:13:15.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f170593d000 1 -- start start 2024-04-25T09:13:15.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f170593d000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a6722290 0x55d8a6721640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f170593d000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a676bc90 0x55d8a6721b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f170593d000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a676c5b0 0x55d8a677d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f170593d000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc2033d0 con 0x55d8a6722290 2024-04-25T09:13:15.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f170593d000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc2025d0 con 0x55d8a676c5b0 2024-04-25T09:13:15.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f170593d000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc157820 con 0x55d8a676bc90 2024-04-25T09:13:15.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f16fb400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a6722290 0x55d8a6721640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f16fb400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a6722290 0x55d8a6721640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39170/0 (socket says 172.21.15.175:39170) 2024-04-25T09:13:15.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f16fb400640 1 -- 172.21.15.175:0/2913998633 learned_addr learned my addr 172.21.15.175:0/2913998633 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:15.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f16faa00640 1 --2- 172.21.15.175:0/2913998633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a676bc90 0x55d8a6721b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f16fbe00640 1 --2- 172.21.15.175:0/2913998633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a676c5b0 0x55d8a677d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f16fb400640 1 -- 172.21.15.175:0/2913998633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a676bc90 msgr2=0x55d8a6721b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f16fb400640 1 --2- 172.21.15.175:0/2913998633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a676bc90 0x55d8a6721b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f16fb400640 1 -- 172.21.15.175:0/2913998633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a676c5b0 msgr2=0x55d8a677d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f16fb400640 1 --2- 172.21.15.175:0/2913998633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a676c5b0 0x55d8a677d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f16fb400640 1 -- 172.21.15.175:0/2913998633 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8a65c7c50 con 0x55d8a6722290 2024-04-25T09:13:15.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f16fb400640 1 --2- 172.21.15.175:0/2913998633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a6722290 0x55d8a6721640 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00e870 tx=0x7f16ec058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec020ab74416821e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f16e7400640 1 -- 172.21.15.175:0/2913998633 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec021040 con 0x55d8a6722290 2024-04-25T09:13:15.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f16e7400640 1 -- 172.21.15.175:0/2913998633 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec053ab0 con 0x55d8a6722290 2024-04-25T09:13:15.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f16e7400640 1 -- 172.21.15.175:0/2913998633 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec06d0c0 con 0x55d8a6722290 2024-04-25T09:13:15.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f170593d000 1 -- 172.21.15.175:0/2913998633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a6722290 msgr2=0x55d8a6721640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.328+0000 7f170593d000 1 --2- 172.21.15.175:0/2913998633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a6722290 0x55d8a6721640 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00e870 tx=0x7f16ec058040 comp rx=0 tx=0).stop 2024-04-25T09:13:15.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 -- 172.21.15.175:0/2913998633 shutdown_connections 2024-04-25T09:13:15.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 --2- 172.21.15.175:0/2913998633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a676c5b0 0x55d8a677d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 --2- 172.21.15.175:0/2913998633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a676bc90 0x55d8a6721b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 --2- 172.21.15.175:0/2913998633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a6722290 0x55d8a6721640 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 -- 172.21.15.175:0/2913998633 >> 172.21.15.175:0/2913998633 conn(0x55d8a671e240 msgr2=0x55d8a6726d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 -- 172.21.15.175:0/2913998633 shutdown_connections 2024-04-25T09:13:15.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 -- 172.21.15.175:0/2913998633 wait complete. 2024-04-25T09:13:15.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 -- start start 2024-04-25T09:13:15.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 Processor -- start 2024-04-25T09:13:15.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a6722290 0x55d8a677f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a676bc90 0x55d8a6787ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a676c5b0 0x55d8a6788420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8a672b200 con 0x55d8a676bc90 2024-04-25T09:13:15.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16fc06cf40 con 0x55d8a676c5b0 2024-04-25T09:13:15.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8a656c110 con 0x55d8a6722290 2024-04-25T09:13:15.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 10 client.0 _ll_register_callbacks cb 0x7f16f40019c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:13:15.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f16faa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a676bc90 0x55d8a6787ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f16fb400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a6722290 0x55d8a677f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f16fb400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a6722290 0x55d8a677f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:46332/0 (socket says 172.21.15.175:46332) 2024-04-25T09:13:15.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f16fb400640 1 -- 172.21.15.175:0/875739885 learned_addr learned my addr 172.21.15.175:0/875739885 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:15.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f16faa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a676bc90 0x55d8a6787ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39172/0 (socket says 172.21.15.175:39172) 2024-04-25T09:13:15.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f16fbe00640 1 --2- 172.21.15.175:0/875739885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a676c5b0 0x55d8a6788420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f16faa00640 1 -- 172.21.15.175:0/875739885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a6722290 msgr2=0x55d8a677f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f16faa00640 1 --2- 172.21.15.175:0/875739885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a6722290 0x55d8a677f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f16faa00640 1 -- 172.21.15.175:0/875739885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a676c5b0 msgr2=0x55d8a6788420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f16faa00640 1 --2- 172.21.15.175:0/875739885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a676c5b0 0x55d8a6788420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f16faa00640 1 -- 172.21.15.175:0/875739885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8a6538120 con 0x55d8a676bc90 2024-04-25T09:13:15.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f16faa00640 1 --2- 172.21.15.175:0/875739885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a676bc90 0x55d8a6787ee0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f16e801ca00 tx=0x7f16e801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04e6cfbf872e4d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f16e4c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:13:15.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f16e4c00640 1 -- 172.21.15.175:0/875739885 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e80de020 con 0x55d8a676bc90 2024-04-25T09:13:15.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f16e4c00640 1 -- 172.21.15.175:0/875739885 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f16e80da480 con 0x55d8a676bc90 2024-04-25T09:13:15.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 -- 172.21.15.175:0/875739885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f16ec053ab0 con 0x55d8a676bc90 2024-04-25T09:13:15.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f16e4c00640 1 -- 172.21.15.175:0/875739885 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16e80e8050 con 0x55d8a676bc90 2024-04-25T09:13:15.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 10 client.8496 fetch_fsmap learned FSMap version 84 2024-04-25T09:13:15.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 -- 172.21.15.175:0/875739885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x55d8a6517170 con 0x55d8a676bc90 2024-04-25T09:13:15.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f16e4c00640 1 -- 172.21.15.175:0/875739885 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ec053ab0 con 0x55d8a676bc90 2024-04-25T09:13:15.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f16e4c00640 1 -- 172.21.15.175:0/875739885 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f16e80eb020 con 0x55d8a676bc90 2024-04-25T09:13:15.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 10 client.8496 fetch_fsmap finished waiting for FSMap version 84 2024-04-25T09:13:15.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 10 client.8496 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:13:15.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 20 client.8496 populate_metadata read hostname 'smithi175' 2024-04-25T09:13:15.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 --2- 172.21.15.175:0/875739885 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x55d8a67cbf70 0x55d8a67cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 4 client.8496 mds_command: new command op to 8397 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-25T09:13:15.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.332+0000 7f170593d000 1 -- 172.21.15.175:0/875739885 --> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x55d8a657d5b0 con 0x55d8a67cbf70 2024-04-25T09:13:15.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f16fb400640 1 --2- 172.21.15.175:0/875739885 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x55d8a67cbf70 0x55d8a67cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f16fb400640 1 --2- 172.21.15.175:0/875739885 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x55d8a67cbf70 0x55d8a67cc350 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0d4fe131b98f3a9 server_cookie=bc96234657761483 in_seq=0 out_seq=0 2024-04-25T09:13:15.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f16e4c00640 10 client.8496 ms_handle_connect on v2:172.21.15.175:6835/2646458577 2024-04-25T09:13:15.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f16e4c00640 1 -- 172.21.15.175:0/875739885 <== mds.0 v2:172.21.15.175:6835/2646458577 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55d8a657d5b0 con 0x55d8a67cbf70 2024-04-25T09:13:15.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f16e4c00640 10 client.8496 handle_command_reply: tid=0 2024-04-25T09:13:15.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f170593d000 1 client.8496 shutdown 2024-04-25T09:13:15.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f170593d000 1 -- 172.21.15.175:0/875739885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a676bc90 msgr2=0x55d8a6787ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f170593d000 1 --2- 172.21.15.175:0/875739885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a676bc90 0x55d8a6787ee0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f16e801ca00 tx=0x7f16e801ad60 comp rx=0 tx=0).stop 2024-04-25T09:13:15.327 INFO:tasks.ceph.mds.a.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f39ef800640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-04-25T09:13:15.327 INFO:tasks.ceph.mds.a.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f39ef800640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-04-25T09:13:15.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f170593d000 1 -- 172.21.15.175:0/875739885 shutdown_connections 2024-04-25T09:13:15.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f170593d000 1 --2- 172.21.15.175:0/875739885 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x55d8a67cbf70 0x55d8a67cc350 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.328 INFO:tasks.ceph.mds.a.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f39ef800640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-04-25T09:13:15.328 INFO:tasks.ceph.mds.a.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f39ef800640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-04-25T09:13:15.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f170593d000 1 --2- 172.21.15.175:0/875739885 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55d8a676c5b0 0x55d8a6788420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f170593d000 1 --2- 172.21.15.175:0/875739885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d8a676bc90 0x55d8a6787ee0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f170593d000 1 --2- 172.21.15.175:0/875739885 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55d8a6722290 0x55d8a677f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f170593d000 1 -- 172.21.15.175:0/875739885 >> 172.21.15.175:0/875739885 conn(0x55d8a671e240 msgr2=0x55d8a6727460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f16e4c00640 0 client.8496 ms_handle_reset on v2:172.21.15.175:6835/2646458577 2024-04-25T09:13:15.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f170593d000 1 -- 172.21.15.175:0/875739885 shutdown_connections 2024-04-25T09:13:15.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f170593d000 1 -- 172.21.15.175:0/875739885 wait complete. 2024-04-25T09:13:15.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f170593d000 20 client.8496 trim_cache size 0 max 16384 2024-04-25T09:13:15.330 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:13:15.330 INFO:teuthology.orchestra.run.smithi175.stdout: "return_code": 0, 2024-04-25T09:13:15.330 INFO:teuthology.orchestra.run.smithi175.stdout: "scrub_tag": "fdaebb13-8f4c-4829-a7e5-b4906a40aa7b", 2024-04-25T09:13:15.330 INFO:teuthology.orchestra.run.smithi175.stdout: "mode": "asynchronous" 2024-04-25T09:13:15.330 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:13:15.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f1702400640 1 -- 172.21.15.175:0/1315828723 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f16dc066f90 msgr2=0x7f16dc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f1702400640 1 --2- 172.21.15.175:0/1315828723 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f16dc066f90 0x7f16dc069450 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f16e80af000 tx=0x7f16e80a7000 comp rx=0 tx=0).stop 2024-04-25T09:13:15.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f1702400640 1 -- 172.21.15.175:0/1315828723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16fc15b700 msgr2=0x7f16fc0d0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f1702400640 1 --2- 172.21.15.175:0/1315828723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16fc15b700 0x7f16fc0d0f50 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00e8a0 tx=0x7f16ec00eca0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f1702400640 1 -- 172.21.15.175:0/1315828723 shutdown_connections 2024-04-25T09:13:15.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f1702400640 1 --2- 172.21.15.175:0/1315828723 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f16dc066f90 0x7f16dc069450 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f1702400640 1 --2- 172.21.15.175:0/1315828723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f16fc15fb90 0x7f16fc0c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f1702400640 1 --2- 172.21.15.175:0/1315828723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f16fc15bae0 0x7f16fc151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f1702400640 1 --2- 172.21.15.175:0/1315828723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16fc15b700 0x7f16fc0d0f50 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f1702400640 1 -- 172.21.15.175:0/1315828723 >> 172.21.15.175:0/1315828723 conn(0x7f16fc0d1880 msgr2=0x7f16fc159f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f1702400640 1 -- 172.21.15.175:0/1315828723 shutdown_connections 2024-04-25T09:13:15.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.336+0000 7f1702400640 1 -- 172.21.15.175:0/1315828723 wait complete. 2024-04-25T09:13:15.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:15.344 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T09:13:15.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.492+0000 7f34aa000640 1 Processor -- start 2024-04-25T09:13:15.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.492+0000 7f34aa000640 1 -- start start 2024-04-25T09:13:15.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.496+0000 7f34aa000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f34a40b2660 0x7f34a40712d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.496+0000 7f34aa000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34a4071810 0x7f34a415aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.496+0000 7f34aa000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a415dd10 con 0x7f34a40b3230 2024-04-25T09:13:15.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.496+0000 7f34aa000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a4071c80 con 0x7f34a40b2660 2024-04-25T09:13:15.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.496+0000 7f34aa000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a415dff0 con 0x7f34a4071810 2024-04-25T09:13:15.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.496+0000 7f34a3400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f34a40b3230 0x7f34a40b3d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:52740/0 (socket says 172.21.15.175:52740) 2024-04-25T09:13:15.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.496+0000 7f34a3400640 1 -- 172.21.15.175:0/83800821 learned_addr learned my addr 172.21.15.175:0/83800821 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:15.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.496+0000 7f34a2a00640 1 --2- 172.21.15.175:0/83800821 >> v2:172.21.15.177:3300/0 conn(0x7f34a40b2660 0x7f34a40712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.496+0000 7f34a3e00640 1 --2- 172.21.15.175:0/83800821 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34a4071810 0x7f34a415aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.496+0000 7f34a2000640 1 -- 172.21.15.175:0/83800821 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968886319 0 0) 0x7f34a415dd10 con 0x7f34a40b3230 2024-04-25T09:13:15.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.496+0000 7f34a2000640 1 -- 172.21.15.175:0/83800821 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3488003530 con 0x7f34a40b3230 2024-04-25T09:13:15.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.496+0000 7f34a2a00640 1 -- 172.21.15.175:0/83800821 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34a4071810 msgr2=0x7f34a415aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.496+0000 7f34a2a00640 1 --2- 172.21.15.175:0/83800821 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34a4071810 0x7f34a415aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.496+0000 7f34a2a00640 1 -- 172.21.15.175:0/83800821 >> v1:172.21.15.175:6789/0 conn(0x7f34a40b3230 legacy=0x7f34a40b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.496+0000 7f34a2a00640 1 -- 172.21.15.175:0/83800821 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a415e2d0 con 0x7f34a40b2660 2024-04-25T09:13:15.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.500+0000 7f34a2a00640 1 --2- 172.21.15.175:0/83800821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34a40b2660 0x7f34a40712d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f349000a960 tx=0x7f349001d870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=240c35ca2b0e92aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.500+0000 7f34a2000640 1 -- 172.21.15.175:0/83800821 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900b3070 con 0x7f34a40b2660 2024-04-25T09:13:15.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.500+0000 7f34a2000640 1 -- 172.21.15.175:0/83800821 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34900a68a0 con 0x7f34a40b2660 2024-04-25T09:13:15.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.500+0000 7f34a2000640 1 -- 172.21.15.175:0/83800821 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349000b040 con 0x7f34a40b2660 2024-04-25T09:13:15.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.500+0000 7f34aa000640 1 -- 172.21.15.175:0/83800821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34a40b2660 msgr2=0x7f34a40712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.500+0000 7f34aa000640 1 --2- 172.21.15.175:0/83800821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34a40b2660 0x7f34a40712d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f349000a960 tx=0x7f349001d870 comp rx=0 tx=0).stop 2024-04-25T09:13:15.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.500+0000 7f34aa000640 1 -- 172.21.15.175:0/83800821 shutdown_connections 2024-04-25T09:13:15.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.500+0000 7f34aa000640 1 --2- 172.21.15.175:0/83800821 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34a4071810 0x7f34a415aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.500+0000 7f34aa000640 1 --2- 172.21.15.175:0/83800821 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34a40b2660 0x7f34a40712d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.500+0000 7f34aa000640 1 -- 172.21.15.175:0/83800821 >> 172.21.15.175:0/83800821 conn(0x7f34a406ac50 msgr2=0x7f34a406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.500+0000 7f34aa000640 1 -- 172.21.15.175:0/83800821 shutdown_connections 2024-04-25T09:13:15.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.500+0000 7f34aa000640 1 -- 172.21.15.175:0/83800821 wait complete. 2024-04-25T09:13:15.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.500+0000 7f34aa000640 1 Processor -- start 2024-04-25T09:13:15.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.500+0000 7f34aa000640 1 -- start start 2024-04-25T09:13:15.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34aa000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34a4071810 0x7f34a4150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34aa000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34a40b2660 0x7f34a40adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34aa000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34a40b3230 0x7f34a4156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34aa000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a40b3790 con 0x7f34a40b3230 2024-04-25T09:13:15.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34aa000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a40b3610 con 0x7f34a4071810 2024-04-25T09:13:15.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34aa000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a40b4430 con 0x7f34a40b2660 2024-04-25T09:13:15.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34a3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34a40b3230 0x7f34a4156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34a3400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34a4071810 0x7f34a4150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34a3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34a40b3230 0x7f34a4156900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39180/0 (socket says 172.21.15.175:39180) 2024-04-25T09:13:15.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34a3e00640 1 -- 172.21.15.175:0/1280561650 learned_addr learned my addr 172.21.15.175:0/1280561650 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:15.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34a2a00640 1 --2- 172.21.15.175:0/1280561650 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34a40b2660 0x7f34a40adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34a3e00640 1 -- 172.21.15.175:0/1280561650 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34a40b2660 msgr2=0x7f34a40adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34a3e00640 1 --2- 172.21.15.175:0/1280561650 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34a40b2660 0x7f34a40adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34a3e00640 1 -- 172.21.15.175:0/1280561650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34a4071810 msgr2=0x7f34a4150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34a3e00640 1 --2- 172.21.15.175:0/1280561650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34a4071810 0x7f34a4150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34a3e00640 1 -- 172.21.15.175:0/1280561650 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a40ccfc0 con 0x7f34a40b3230 2024-04-25T09:13:15.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34a3e00640 1 --2- 172.21.15.175:0/1280561650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34a40b3230 0x7f34a4156900 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f349c00e7f0 tx=0x7f349c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f349b400640 1 -- 172.21.15.175:0/1280561650 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c017070 con 0x7f34a40b3230 2024-04-25T09:13:15.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f349b400640 1 -- 172.21.15.175:0/1280561650 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c00c940 con 0x7f34a40b3230 2024-04-25T09:13:15.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34aa000640 1 -- 172.21.15.175:0/1280561650 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a4157060 con 0x7f34a40b3230 2024-04-25T09:13:15.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f349b400640 1 -- 172.21.15.175:0/1280561650 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c00eea0 con 0x7f34a40b3230 2024-04-25T09:13:15.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f34aa000640 1 -- 172.21.15.175:0/1280561650 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a4157620 con 0x7f34a40b3230 2024-04-25T09:13:15.493 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.504+0000 7f349b400640 1 -- 172.21.15.175:0/1280561650 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f349c01a070 con 0x7f34a40b3230 2024-04-25T09:13:15.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f349b400640 1 --2- 172.21.15.175:0/1280561650 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3484066f60 0x7f3484069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f349b400640 1 -- 172.21.15.175:0/1280561650 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f349c085240 con 0x7f34a40b3230 2024-04-25T09:13:15.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34a3400640 1 --2- 172.21.15.175:0/1280561650 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3484066f60 0x7f3484069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34ad5a8000 1 Processor -- start 2024-04-25T09:13:15.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34ad5a8000 1 -- start start 2024-04-25T09:13:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34a3400640 1 --2- 172.21.15.175:0/1280561650 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3484066f60 0x7f3484069420 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3494005c10 tx=0x7f3494009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34ad5a8000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc809d0 0x561f9cc80db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34ad5a8000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc812f0 0x561f9cc36b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34ad5a8000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc370a0 0x561f9cc37480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34ad5a8000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f9ca83ff0 con 0x561f9cc812f0 2024-04-25T09:13:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34ad5a8000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f9ca0c150 con 0x561f9cc370a0 2024-04-25T09:13:15.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34ad5a8000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f9ca80090 con 0x561f9cc809d0 2024-04-25T09:13:15.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34a2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc812f0 0x561f9cc36b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34a2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc812f0 0x561f9cc36b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39188/0 (socket says 172.21.15.175:39188) 2024-04-25T09:13:15.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34a2a00640 1 -- 172.21.15.175:0/3766333846 learned_addr learned my addr 172.21.15.175:0/3766333846 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:15.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34a2a00640 1 -- 172.21.15.175:0/3766333846 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc809d0 msgr2=0x561f9cc80db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34a2a00640 1 --2- 172.21.15.175:0/3766333846 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc809d0 0x561f9cc80db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34a2a00640 1 -- 172.21.15.175:0/3766333846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc370a0 msgr2=0x561f9cc37480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34a2a00640 1 --2- 172.21.15.175:0/3766333846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc370a0 0x561f9cc37480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34a2a00640 1 -- 172.21.15.175:0/3766333846 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f9cc1a0d0 con 0x561f9cc812f0 2024-04-25T09:13:15.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34a2a00640 1 --2- 172.21.15.175:0/3766333846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc812f0 0x561f9cc36b60 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f349001b4a0 tx=0x7f349000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874009bedd81a2d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.498 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f348fe00640 1 -- 172.21.15.175:0/3766333846 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900bd070 con 0x561f9cc812f0 2024-04-25T09:13:15.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f348fe00640 1 -- 172.21.15.175:0/3766333846 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34900b4040 con 0x561f9cc812f0 2024-04-25T09:13:15.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f348fe00640 1 -- 172.21.15.175:0/3766333846 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900b3070 con 0x561f9cc812f0 2024-04-25T09:13:15.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34ad5a8000 1 -- 172.21.15.175:0/3766333846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc812f0 msgr2=0x561f9cc36b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/3766333846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc812f0 0x561f9cc36b60 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f349001b4a0 tx=0x7f349000c040 comp rx=0 tx=0).stop 2024-04-25T09:13:15.499 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34ad5a8000 1 -- 172.21.15.175:0/3766333846 shutdown_connections 2024-04-25T09:13:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/3766333846 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc370a0 0x561f9cc37480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/3766333846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc812f0 0x561f9cc36b60 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/3766333846 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc809d0 0x561f9cc80db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34ad5a8000 1 -- 172.21.15.175:0/3766333846 >> 172.21.15.175:0/3766333846 conn(0x561f9cc33020 msgr2=0x561f9cc35440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.508+0000 7f34ad5a8000 1 -- 172.21.15.175:0/3766333846 shutdown_connections 2024-04-25T09:13:15.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 1 -- 172.21.15.175:0/3766333846 wait complete. 2024-04-25T09:13:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 1 -- start start 2024-04-25T09:13:15.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 1 Processor -- start 2024-04-25T09:13:15.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc370a0 0x561f9cc657f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc809d0 0x561f9cc65d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc812f0 0x561f9cc66270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f9ca48250 con 0x561f9cc370a0 2024-04-25T09:13:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f9ca3e690 con 0x561f9cc812f0 2024-04-25T09:13:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f9ca0ca40 con 0x561f9cc809d0 2024-04-25T09:13:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 10 client.0 _ll_register_callbacks cb 0x561f9cc21e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:13:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34a3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc370a0 0x561f9cc657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34a3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc370a0 0x561f9cc657f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39190/0 (socket says 172.21.15.175:39190) 2024-04-25T09:13:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34a3400640 1 -- 172.21.15.175:0/2530739415 learned_addr learned my addr 172.21.15.175:0/2530739415 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34a2a00640 1 --2- 172.21.15.175:0/2530739415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc809d0 0x561f9cc65d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34a3e00640 1 --2- 172.21.15.175:0/2530739415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc812f0 0x561f9cc66270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34a3400640 1 -- 172.21.15.175:0/2530739415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc809d0 msgr2=0x561f9cc65d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34a3400640 1 --2- 172.21.15.175:0/2530739415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc809d0 0x561f9cc65d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34a3400640 1 -- 172.21.15.175:0/2530739415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc812f0 msgr2=0x561f9cc66270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34a3400640 1 --2- 172.21.15.175:0/2530739415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc812f0 0x561f9cc66270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34a3400640 1 -- 172.21.15.175:0/2530739415 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561f9cb311c0 con 0x561f9cc370a0 2024-04-25T09:13:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34a3e00640 1 --2- 172.21.15.175:0/2530739415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc812f0 0x561f9cc66270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34a3400640 1 --2- 172.21.15.175:0/2530739415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc370a0 0x561f9cc657f0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f3494015bc0 tx=0x7f34940019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45cf0bc420e000dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f348cc00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:13:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f348cc00640 1 -- 172.21.15.175:0/2530739415 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494025060 con 0x561f9cc370a0 2024-04-25T09:13:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f348cc00640 1 -- 172.21.15.175:0/2530739415 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3494012be0 con 0x561f9cc370a0 2024-04-25T09:13:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 1 -- 172.21.15.175:0/2530739415 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f34900b4040 con 0x561f9cc370a0 2024-04-25T09:13:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f348cc00640 1 -- 172.21.15.175:0/2530739415 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f349402b050 con 0x561f9cc370a0 2024-04-25T09:13:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 10 client.8508 fetch_fsmap learned FSMap version 84 2024-04-25T09:13:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 1 -- 172.21.15.175:0/2530739415 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x561f9cb2d170 con 0x561f9cc370a0 2024-04-25T09:13:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f348cc00640 1 -- 172.21.15.175:0/2530739415 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34900b4040 con 0x561f9cc370a0 2024-04-25T09:13:15.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f348cc00640 1 -- 172.21.15.175:0/2530739415 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f349402e020 con 0x561f9cc370a0 2024-04-25T09:13:15.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 10 client.8508 fetch_fsmap finished waiting for FSMap version 84 2024-04-25T09:13:15.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 10 client.8508 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:13:15.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 20 client.8508 populate_metadata read hostname 'smithi175' 2024-04-25T09:13:15.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/2530739415 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x561f9cc90c80 0x561f9cc93070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 4 client.8508 mds_command: new command op to 8397 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:13:15.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34ad5a8000 1 -- 172.21.15.175:0/2530739415 --> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561f9ca1fc60 con 0x561f9cc90c80 2024-04-25T09:13:15.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.512+0000 7f34a2a00640 1 --2- 172.21.15.175:0/2530739415 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x561f9cc90c80 0x561f9cc93070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.516+0000 7f34a2a00640 1 --2- 172.21.15.175:0/2530739415 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x561f9cc90c80 0x561f9cc93070 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=828013db43311fb5 server_cookie=73baafebfbfe5d2c in_seq=0 out_seq=0 2024-04-25T09:13:15.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.516+0000 7f348cc00640 10 client.8508 ms_handle_connect on v2:172.21.15.175:6835/2646458577 2024-04-25T09:13:15.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.516+0000 7f348cc00640 1 -- 172.21.15.175:0/2530739415 <== mds.0 v2:172.21.15.175:6835/2646458577 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561f9ca1fc60 con 0x561f9cc90c80 2024-04-25T09:13:15.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.516+0000 7f348cc00640 10 client.8508 handle_command_reply: tid=0 2024-04-25T09:13:15.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.516+0000 7f34ad5a8000 1 client.8508 shutdown 2024-04-25T09:13:15.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.516+0000 7f34ad5a8000 1 -- 172.21.15.175:0/2530739415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc370a0 msgr2=0x561f9cc657f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.516+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/2530739415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc370a0 0x561f9cc657f0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f3494015bc0 tx=0x7f34940019e0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.516+0000 7f34ad5a8000 1 -- 172.21.15.175:0/2530739415 shutdown_connections 2024-04-25T09:13:15.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.516+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/2530739415 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x561f9cc90c80 0x561f9cc93070 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.516+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/2530739415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc812f0 0x561f9cc66270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.516+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/2530739415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc809d0 0x561f9cc65d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.516+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/2530739415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc370a0 0x561f9cc657f0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.516+0000 7f348cc00640 0 client.8508 ms_handle_reset on v2:172.21.15.175:6835/2646458577 2024-04-25T09:13:15.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.516+0000 7f34ad5a8000 1 -- 172.21.15.175:0/2530739415 >> 172.21.15.175:0/2530739415 conn(0x561f9cc33020 msgr2=0x561f9cc35ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.516+0000 7f34ad5a8000 1 -- 172.21.15.175:0/2530739415 shutdown_connections 2024-04-25T09:13:15.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.516+0000 7f34ad5a8000 1 -- 172.21.15.175:0/2530739415 wait complete. 2024-04-25T09:13:15.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.516+0000 7f34ad5a8000 20 client.8508 trim_cache size 0 max 16384 2024-04-25T09:13:15.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 Processor -- start 2024-04-25T09:13:15.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 -- start start 2024-04-25T09:13:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc370a0 0x561f9cc7fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc809d0 0x561f9cc36420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc812f0 0x561f9cc36960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a4202d00 con 0x561f9cc809d0 2024-04-25T09:13:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a40ce4a0 con 0x561f9cc370a0 2024-04-25T09:13:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a40ad410 con 0x561f9cc812f0 2024-04-25T09:13:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34a2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc809d0 0x561f9cc36420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34a2a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc809d0 0x561f9cc36420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39192/0 (socket says 172.21.15.175:39192) 2024-04-25T09:13:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34a2a00640 1 -- 172.21.15.175:0/1039962755 learned_addr learned my addr 172.21.15.175:0/1039962755 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34a3400640 1 --2- 172.21.15.175:0/1039962755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc370a0 0x561f9cc7fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34a3e00640 1 --2- 172.21.15.175:0/1039962755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc812f0 0x561f9cc36960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34a2a00640 1 -- 172.21.15.175:0/1039962755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc812f0 msgr2=0x561f9cc36960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34a2a00640 1 --2- 172.21.15.175:0/1039962755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc812f0 0x561f9cc36960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34a2a00640 1 -- 172.21.15.175:0/1039962755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc370a0 msgr2=0x561f9cc7fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34a2a00640 1 --2- 172.21.15.175:0/1039962755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc370a0 0x561f9cc7fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34a2a00640 1 -- 172.21.15.175:0/1039962755 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f9cacade0 con 0x561f9cc809d0 2024-04-25T09:13:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34a3400640 1 --2- 172.21.15.175:0/1039962755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc370a0 0x561f9cc7fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34a3e00640 1 --2- 172.21.15.175:0/1039962755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc812f0 0x561f9cc36960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34a2a00640 1 --2- 172.21.15.175:0/1039962755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc809d0 0x561f9cc36420 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f349001a480 tx=0x7f3490004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196699efd86eab15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f348f400640 1 -- 172.21.15.175:0/1039962755 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900bd040 con 0x561f9cc809d0 2024-04-25T09:13:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f348f400640 1 -- 172.21.15.175:0/1039962755 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3490000e50 con 0x561f9cc809d0 2024-04-25T09:13:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f348f400640 1 -- 172.21.15.175:0/1039962755 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34900b3040 con 0x561f9cc809d0 2024-04-25T09:13:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 -- 172.21.15.175:0/1039962755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc809d0 msgr2=0x561f9cc36420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/1039962755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc809d0 0x561f9cc36420 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f349001a480 tx=0x7f3490004740 comp rx=0 tx=0).stop 2024-04-25T09:13:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 -- 172.21.15.175:0/1039962755 shutdown_connections 2024-04-25T09:13:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/1039962755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc812f0 0x561f9cc36960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/1039962755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc809d0 0x561f9cc36420 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/1039962755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc370a0 0x561f9cc7fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 -- 172.21.15.175:0/1039962755 >> 172.21.15.175:0/1039962755 conn(0x561f9cc33020 msgr2=0x561f9cc7f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 -- 172.21.15.175:0/1039962755 shutdown_connections 2024-04-25T09:13:15.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 -- 172.21.15.175:0/1039962755 wait complete. 2024-04-25T09:13:15.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 -- start start 2024-04-25T09:13:15.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.532+0000 7f34ad5a8000 1 Processor -- start 2024-04-25T09:13:15.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc370a0 0x561f9cce1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc809d0 0x561f9cce1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc812f0 0x561f9cc93380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f9ca1ee00 con 0x561f9cc370a0 2024-04-25T09:13:15.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a40cdea0 con 0x561f9cc812f0 2024-04-25T09:13:15.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x561f9ca83300 con 0x561f9cc809d0 2024-04-25T09:13:15.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 10 client.0 _ll_register_callbacks cb 0x561f9cc02040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:13:15.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34a3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc370a0 0x561f9cce1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34a3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc370a0 0x561f9cce1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:39206/0 (socket says 172.21.15.175:39206) 2024-04-25T09:13:15.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34a3400640 1 -- 172.21.15.175:0/2257861646 learned_addr learned my addr 172.21.15.175:0/2257861646 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:15.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34a2a00640 1 --2- 172.21.15.175:0/2257861646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc809d0 0x561f9cce1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34a3e00640 1 --2- 172.21.15.175:0/2257861646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc812f0 0x561f9cc93380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34a3400640 1 -- 172.21.15.175:0/2257861646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc809d0 msgr2=0x561f9cce1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34a3400640 1 --2- 172.21.15.175:0/2257861646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc809d0 0x561f9cce1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34a3400640 1 -- 172.21.15.175:0/2257861646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc812f0 msgr2=0x561f9cc93380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:15.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34a3400640 1 --2- 172.21.15.175:0/2257861646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc812f0 0x561f9cc93380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34a3400640 1 -- 172.21.15.175:0/2257861646 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561f9ca258e0 con 0x561f9cc370a0 2024-04-25T09:13:15.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34a3400640 1 --2- 172.21.15.175:0/2257861646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc370a0 0x561f9cce1520 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f3494015bc0 tx=0x7f3494012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b4d642e3eda61e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:15.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f348cc00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:13:15.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f348cc00640 1 -- 172.21.15.175:0/2257861646 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3494020690 con 0x561f9cc370a0 2024-04-25T09:13:15.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f348cc00640 1 -- 172.21.15.175:0/2257861646 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3494020830 con 0x561f9cc370a0 2024-04-25T09:13:15.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 -- 172.21.15.175:0/2257861646 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3490000e50 con 0x561f9cc370a0 2024-04-25T09:13:15.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f348cc00640 1 -- 172.21.15.175:0/2257861646 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f349403e050 con 0x561f9cc370a0 2024-04-25T09:13:15.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 10 client.8514 fetch_fsmap learned FSMap version 84 2024-04-25T09:13:15.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 -- 172.21.15.175:0/2257861646 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x561f9cadd8f0 con 0x561f9cc370a0 2024-04-25T09:13:15.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f348cc00640 1 -- 172.21.15.175:0/2257861646 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3490000e50 con 0x561f9cc370a0 2024-04-25T09:13:15.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f348cc00640 1 -- 172.21.15.175:0/2257861646 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3494041020 con 0x561f9cc370a0 2024-04-25T09:13:15.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 10 client.8514 fetch_fsmap finished waiting for FSMap version 84 2024-04-25T09:13:15.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 10 client.8514 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:13:15.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 20 client.8514 populate_metadata read hostname 'smithi175' 2024-04-25T09:13:15.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/2257861646 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x561f9cc940c0 0x561f9cc944d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:15.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 4 client.8514 mds_command: new command op to 8397 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:13:15.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 -- 172.21.15.175:0/2257861646 --> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561f9ca91530 con 0x561f9cc940c0 2024-04-25T09:13:15.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34a2a00640 1 --2- 172.21.15.175:0/2257861646 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x561f9cc940c0 0x561f9cc944d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:15.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34a2a00640 1 --2- 172.21.15.175:0/2257861646 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x561f9cc940c0 0x561f9cc944d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8582f9499d6f003d server_cookie=1262f44bf39dd67b in_seq=0 out_seq=0 2024-04-25T09:13:15.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f348cc00640 10 client.8514 ms_handle_connect on v2:172.21.15.175:6835/2646458577 2024-04-25T09:13:15.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f348cc00640 1 -- 172.21.15.175:0/2257861646 <== mds.0 v2:172.21.15.175:6835/2646458577 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x561f9ca91530 con 0x561f9cc940c0 2024-04-25T09:13:15.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f348cc00640 10 client.8514 handle_command_reply: tid=0 2024-04-25T09:13:15.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 client.8514 shutdown 2024-04-25T09:13:15.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 -- 172.21.15.175:0/2257861646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc370a0 msgr2=0x561f9cce1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/2257861646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc370a0 0x561f9cce1520 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f3494015bc0 tx=0x7f3494012000 comp rx=0 tx=0).stop 2024-04-25T09:13:15.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 -- 172.21.15.175:0/2257861646 shutdown_connections 2024-04-25T09:13:15.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/2257861646 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x561f9cc940c0 0x561f9cc944d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/2257861646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561f9cc812f0 0x561f9cc93380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/2257861646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x561f9cc809d0 0x561f9cce1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 --2- 172.21.15.175:0/2257861646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561f9cc370a0 0x561f9cce1520 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f348cc00640 0 client.8514 ms_handle_reset on v2:172.21.15.175:6835/2646458577 2024-04-25T09:13:15.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 -- 172.21.15.175:0/2257861646 >> 172.21.15.175:0/2257861646 conn(0x561f9cc33020 msgr2=0x561f9cc7f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 -- 172.21.15.175:0/2257861646 shutdown_connections 2024-04-25T09:13:15.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 1 -- 172.21.15.175:0/2257861646 wait complete. 2024-04-25T09:13:15.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.536+0000 7f34ad5a8000 20 client.8514 trim_cache size 0 max 16384 2024-04-25T09:13:15.530 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:13:15.530 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:13:15.530 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": { 2024-04-25T09:13:15.530 INFO:teuthology.orchestra.run.smithi175.stdout: "fdaebb13-8f4c-4829-a7e5-b4906a40aa7b": { 2024-04-25T09:13:15.530 INFO:teuthology.orchestra.run.smithi175.stdout: "path": "/", 2024-04-25T09:13:15.530 INFO:teuthology.orchestra.run.smithi175.stdout: "tag": "fdaebb13-8f4c-4829-a7e5-b4906a40aa7b", 2024-04-25T09:13:15.530 INFO:teuthology.orchestra.run.smithi175.stdout: "options": "recursive,repair" 2024-04-25T09:13:15.530 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:13:15.530 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:13:15.530 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:13:15.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.540+0000 7f34aa000640 1 -- 172.21.15.175:0/1280561650 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3484066f60 msgr2=0x7f3484069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.540+0000 7f34aa000640 1 --2- 172.21.15.175:0/1280561650 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3484066f60 0x7f3484069420 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3494005c10 tx=0x7f3494009040 comp rx=0 tx=0).stop 2024-04-25T09:13:15.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.540+0000 7f34aa000640 1 -- 172.21.15.175:0/1280561650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34a40b3230 msgr2=0x7f34a4156900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:15.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.540+0000 7f34aa000640 1 --2- 172.21.15.175:0/1280561650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34a40b3230 0x7f34a4156900 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f349c00e7f0 tx=0x7f349c00ecb0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.540+0000 7f34aa000640 1 -- 172.21.15.175:0/1280561650 shutdown_connections 2024-04-25T09:13:15.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.540+0000 7f34aa000640 1 --2- 172.21.15.175:0/1280561650 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3484066f60 0x7f3484069420 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.540+0000 7f34aa000640 1 --2- 172.21.15.175:0/1280561650 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34a40b3230 0x7f34a4156900 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.540+0000 7f34aa000640 1 --2- 172.21.15.175:0/1280561650 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f34a40b2660 0x7f34a40adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.540+0000 7f34aa000640 1 --2- 172.21.15.175:0/1280561650 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34a4071810 0x7f34a4150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:15.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.540+0000 7f34aa000640 1 -- 172.21.15.175:0/1280561650 >> 172.21.15.175:0/1280561650 conn(0x7f34a406ac50 msgr2=0x7f34a40aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:15.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.540+0000 7f34aa000640 1 -- 172.21.15.175:0/1280561650 shutdown_connections 2024-04-25T09:13:15.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.540+0000 7f34aa000640 1 -- 172.21.15.175:0/1280561650 wait complete. 2024-04-25T09:13:15.545 INFO:tasks.cephfs.filesystem:scrub status for tag:fdaebb13-8f4c-4829-a7e5-b4906a40aa7b - {'path': '/', 'tag': 'fdaebb13-8f4c-4829-a7e5-b4906a40aa7b', 'options': 'recursive,repair'} 2024-04-25T09:13:15.601 INFO:tasks.ceph.mds.a.smithi175.stderr:2024-04-25T09:13:15.612+0000 7f39f4800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:13:15.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:15.636+0000 7f7e6cc00640 1 -- 172.21.15.175:0/3222526753 <== mon.0 v2:172.21.15.175:3300/0 8 ==== log(8 entries from seq 1 at 2024-04-25T09:13:15.338691+0000) v1 ==== 1407+0+0 (secure 0 0 0) 0x7f7e68054e00 con 0x7f7e700ce810 2024-04-25T09:13:15.626 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:13:15.338691+0000 mds.a [INF] scrub queued for path: / 2024-04-25T09:13:15.626 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:13:15.338695+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-04-25T09:13:15.626 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:13:15.338699+0000 mds.a [INF] scrub summary: active paths [/] 2024-04-25T09:13:15.626 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:13:15.339518+0000 mds.a [ERR] scrub: inode wrongly marked free: 0x10000000002 2024-04-25T09:13:15.626 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:13:15.339525+0000 mds.a [ERR] inode table repaired for inode: 0x10000000002 2024-04-25T09:13:15.626 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:13:15.339597+0000 mds.a [ERR] scrub: inode wrongly marked free: 0x10000000001 2024-04-25T09:13:15.626 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:13:15.339603+0000 mds.a [ERR] inode table repaired for inode: 0x10000000001 2024-04-25T09:13:15.626 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:13:15.340306+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-04-25T09:13:21.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:21.020+0000 7f7e6cc00640 1 -- 172.21.15.175:0/3222526753 <== mon.0 v2:172.21.15.175:3300/0 9 ==== log(1 entries from seq 9 at 2024-04-25T09:13:19.618759+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7f7e68084830 con 0x7f7e700ce810 2024-04-25T09:13:21.009 INFO:teuthology.orchestra.run.smithi175.stdout:2024-04-25T09:13:19.618759+0000 mds.a [INF] scrub summary: idle 2024-04-25T09:13:39.563 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:13:39.567 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:13:45.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:13:45.546 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T09:13:45.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.704+0000 7f688a000640 1 Processor -- start 2024-04-25T09:13:45.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.708+0000 7f688a000640 1 -- start start 2024-04-25T09:13:45.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.708+0000 7f688a000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f68840cbe60 0x7f688415af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.708+0000 7f688a000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f68840b4800 0x7f688415c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.708+0000 7f688a000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688406db60 con 0x7f688406d310 2024-04-25T09:13:45.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.708+0000 7f688a000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688406de40 con 0x7f68840b4800 2024-04-25T09:13:45.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.708+0000 7f688a000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688406e120 con 0x7f68840cbe60 2024-04-25T09:13:45.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.708+0000 7f687be00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f688406d310 0x7f68840b40f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53342/0 (socket says 172.21.15.175:53342) 2024-04-25T09:13:45.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.708+0000 7f687be00640 1 -- 172.21.15.175:0/2826231814 learned_addr learned my addr 172.21.15.175:0/2826231814 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:45.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.708+0000 7f6883e00640 1 --2- 172.21.15.175:0/2826231814 >> v2:172.21.15.175:3300/0 conn(0x7f68840b4800 0x7f688415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.708+0000 7f6883400640 1 --2- 172.21.15.175:0/2826231814 >> v2:172.21.15.177:3300/0 conn(0x7f68840cbe60 0x7f688415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.708+0000 7f6882a00640 1 -- 172.21.15.175:0/2826231814 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382185046 0 0) 0x7f688406db60 con 0x7f688406d310 2024-04-25T09:13:45.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.708+0000 7f6882a00640 1 -- 172.21.15.175:0/2826231814 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6868005740 con 0x7f688406d310 2024-04-25T09:13:45.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.708+0000 7f6883e00640 1 -- 172.21.15.175:0/2826231814 >> v2:172.21.15.177:3300/0 conn(0x7f68840cbe60 msgr2=0x7f688415af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:45.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.708+0000 7f6883e00640 1 --2- 172.21.15.175:0/2826231814 >> v2:172.21.15.177:3300/0 conn(0x7f68840cbe60 0x7f688415af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.708+0000 7f6883e00640 1 -- 172.21.15.175:0/2826231814 >> v1:172.21.15.175:6789/0 conn(0x7f688406d310 legacy=0x7f68840b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:45.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.708+0000 7f6883e00640 1 -- 172.21.15.175:0/2826231814 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688415c2f0 con 0x7f68840b4800 2024-04-25T09:13:45.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.708+0000 7f6883400640 1 --2- 172.21.15.175:0/2826231814 >> v2:172.21.15.177:3300/0 conn(0x7f68840cbe60 0x7f688415af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:45.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.712+0000 7f6883e00640 1 --2- 172.21.15.175:0/2826231814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68840b4800 0x7f688415c810 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f68840b4d50 tx=0x7f687c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d445232ebd00a2d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:45.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.712+0000 7f6882a00640 1 -- 172.21.15.175:0/2826231814 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c0b2070 con 0x7f68840b4800 2024-04-25T09:13:45.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.712+0000 7f6882a00640 1 -- 172.21.15.175:0/2826231814 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c0a57f0 con 0x7f68840b4800 2024-04-25T09:13:45.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.712+0000 7f6882a00640 1 -- 172.21.15.175:0/2826231814 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c0a5bc0 con 0x7f68840b4800 2024-04-25T09:13:45.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.712+0000 7f688a000640 1 -- 172.21.15.175:0/2826231814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68840b4800 msgr2=0x7f688415c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:45.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.712+0000 7f688a000640 1 --2- 172.21.15.175:0/2826231814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68840b4800 0x7f688415c810 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f68840b4d50 tx=0x7f687c01c930 comp rx=0 tx=0).stop 2024-04-25T09:13:45.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.712+0000 7f688a000640 1 -- 172.21.15.175:0/2826231814 shutdown_connections 2024-04-25T09:13:45.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.712+0000 7f688a000640 1 --2- 172.21.15.175:0/2826231814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68840b4800 0x7f688415c810 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.712+0000 7f688a000640 1 --2- 172.21.15.175:0/2826231814 >> v2:172.21.15.177:3300/0 conn(0x7f68840cbe60 0x7f688415af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.712+0000 7f688a000640 1 -- 172.21.15.175:0/2826231814 >> 172.21.15.175:0/2826231814 conn(0x7f688406ac50 msgr2=0x7f688406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:45.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.712+0000 7f688a000640 1 -- 172.21.15.175:0/2826231814 shutdown_connections 2024-04-25T09:13:45.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.712+0000 7f688a000640 1 -- 172.21.15.175:0/2826231814 wait complete. 2024-04-25T09:13:45.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.712+0000 7f688a000640 1 Processor -- start 2024-04-25T09:13:45.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.712+0000 7f688a000640 1 -- start start 2024-04-25T09:13:45.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f688a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f688406d310 0x7f6884145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f688a000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68840b4800 0x7f6884156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f688a000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68840cbe60 0x7f68840cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f688a000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688415d930 con 0x7f688406d310 2024-04-25T09:13:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f688a000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688415d7b0 con 0x7f68840cbe60 2024-04-25T09:13:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f688a000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688415dab0 con 0x7f68840b4800 2024-04-25T09:13:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f6883400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f688406d310 0x7f6884145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f6883400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f688406d310 0x7f6884145f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41580/0 (socket says 172.21.15.175:41580) 2024-04-25T09:13:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f6883400640 1 -- 172.21.15.175:0/3949282888 learned_addr learned my addr 172.21.15.175:0/3949282888 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f687be00640 1 --2- 172.21.15.175:0/3949282888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68840b4800 0x7f6884156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f6883e00640 1 --2- 172.21.15.175:0/3949282888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68840cbe60 0x7f68840cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f6883400640 1 -- 172.21.15.175:0/3949282888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68840b4800 msgr2=0x7f6884156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f6883400640 1 --2- 172.21.15.175:0/3949282888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68840b4800 0x7f6884156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f6883400640 1 -- 172.21.15.175:0/3949282888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68840cbe60 msgr2=0x7f68840cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f6883400640 1 --2- 172.21.15.175:0/3949282888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68840cbe60 0x7f68840cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f6883400640 1 -- 172.21.15.175:0/3949282888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6884154900 con 0x7f688406d310 2024-04-25T09:13:45.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f6883400640 1 --2- 172.21.15.175:0/3949282888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f688406d310 0x7f6884145f10 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f687400e810 tx=0x7f687400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:45.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f687b400640 1 -- 172.21.15.175:0/3949282888 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874017070 con 0x7f688406d310 2024-04-25T09:13:45.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f687b400640 1 -- 172.21.15.175:0/3949282888 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687400c8d0 con 0x7f688406d310 2024-04-25T09:13:45.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f687b400640 1 -- 172.21.15.175:0/3949282888 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687400f040 con 0x7f688406d310 2024-04-25T09:13:45.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f688a000640 1 -- 172.21.15.175:0/3949282888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6884154bc0 con 0x7f688406d310 2024-04-25T09:13:45.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.716+0000 7f688a000640 1 -- 172.21.15.175:0/3949282888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6884148f50 con 0x7f688406d310 2024-04-25T09:13:45.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f687b400640 1 -- 172.21.15.175:0/3949282888 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f687401a070 con 0x7f688406d310 2024-04-25T09:13:45.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f687b400640 1 --2- 172.21.15.175:0/3949282888 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6860066f90 0x7f6860069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f687b400640 1 -- 172.21.15.175:0/3949282888 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6874084b40 con 0x7f688406d310 2024-04-25T09:13:45.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f687be00640 1 --2- 172.21.15.175:0/3949282888 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6860066f90 0x7f6860069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f688d51f000 1 Processor -- start 2024-04-25T09:13:45.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f688d51f000 1 -- start start 2024-04-25T09:13:45.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f687be00640 1 --2- 172.21.15.175:0/3949282888 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6860066f90 0x7f6860069450 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f686c007fd0 tx=0x7f686c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:45.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f688d51f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b43b7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f688d51f000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b43b82f0 0x5638b436db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f688d51f000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b436e0a0 0x5638b436e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f688d51f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638b41baff0 con 0x5638b43b79d0 2024-04-25T09:13:45.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f688d51f000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638b4143150 con 0x5638b43b82f0 2024-04-25T09:13:45.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f688d51f000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5638b41b7090 con 0x5638b436e0a0 2024-04-25T09:13:45.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f6883400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b43b7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f6883400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b43b7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41596/0 (socket says 172.21.15.175:41596) 2024-04-25T09:13:45.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f6883400640 1 -- 172.21.15.175:0/523843981 learned_addr learned my addr 172.21.15.175:0/523843981 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:45.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f6883e00640 1 --2- 172.21.15.175:0/523843981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b436e0a0 0x5638b436e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f687be00640 1 --2- 172.21.15.175:0/523843981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b43b82f0 0x5638b436db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f6883400640 1 -- 172.21.15.175:0/523843981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b436e0a0 msgr2=0x5638b436e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:45.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f6883400640 1 --2- 172.21.15.175:0/523843981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b436e0a0 0x5638b436e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f6883400640 1 -- 172.21.15.175:0/523843981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b43b82f0 msgr2=0x5638b436db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:45.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f6883400640 1 --2- 172.21.15.175:0/523843981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b43b82f0 0x5638b436db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f6883400640 1 -- 172.21.15.175:0/523843981 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638b43510d0 con 0x5638b43b79d0 2024-04-25T09:13:45.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f6883400640 1 --2- 172.21.15.175:0/523843981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b43b7db0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f6874009fd0 tx=0x7f6874055490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc04730ba02b3385 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:45.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f6873e00640 1 -- 172.21.15.175:0/523843981 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874021040 con 0x5638b43b79d0 2024-04-25T09:13:45.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f6873e00640 1 -- 172.21.15.175:0/523843981 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6874053790 con 0x5638b43b79d0 2024-04-25T09:13:45.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.720+0000 7f6873e00640 1 -- 172.21.15.175:0/523843981 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687400ccc0 con 0x5638b43b79d0 2024-04-25T09:13:45.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 -- 172.21.15.175:0/523843981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 msgr2=0x5638b43b7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:45.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 --2- 172.21.15.175:0/523843981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b43b7db0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f6874009fd0 tx=0x7f6874055490 comp rx=0 tx=0).stop 2024-04-25T09:13:45.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 -- 172.21.15.175:0/523843981 shutdown_connections 2024-04-25T09:13:45.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 --2- 172.21.15.175:0/523843981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b436e0a0 0x5638b436e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 --2- 172.21.15.175:0/523843981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b43b82f0 0x5638b436db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 --2- 172.21.15.175:0/523843981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b43b7db0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 -- 172.21.15.175:0/523843981 >> 172.21.15.175:0/523843981 conn(0x5638b436a020 msgr2=0x5638b436c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:45.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 -- 172.21.15.175:0/523843981 shutdown_connections 2024-04-25T09:13:45.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 -- 172.21.15.175:0/523843981 wait complete. 2024-04-25T09:13:45.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 -- start start 2024-04-25T09:13:45.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 Processor -- start 2024-04-25T09:13:45.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b436e0a0 0x5638b439c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b439cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b43b82f0 0x5638b439d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638b417f250 con 0x5638b43b79d0 2024-04-25T09:13:45.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638b4175690 con 0x5638b436e0a0 2024-04-25T09:13:45.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5638b4143a40 con 0x5638b43b82f0 2024-04-25T09:13:45.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 10 client.0 _ll_register_callbacks cb 0x5638b4358e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:13:45.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f687be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b439cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f687be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b439cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41612/0 (socket says 172.21.15.175:41612) 2024-04-25T09:13:45.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f687be00640 1 -- 172.21.15.175:0/2621142692 learned_addr learned my addr 172.21.15.175:0/2621142692 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:45.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f6883e00640 1 --2- 172.21.15.175:0/2621142692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b43b82f0 0x5638b439d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f6883400640 1 --2- 172.21.15.175:0/2621142692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b436e0a0 0x5638b439c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f687be00640 1 -- 172.21.15.175:0/2621142692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b43b82f0 msgr2=0x5638b439d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:45.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f687be00640 1 --2- 172.21.15.175:0/2621142692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b43b82f0 0x5638b439d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f687be00640 1 -- 172.21.15.175:0/2621142692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b436e0a0 msgr2=0x5638b439c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:45.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f687be00640 1 --2- 172.21.15.175:0/2621142692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b436e0a0 0x5638b439c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f687be00640 1 -- 172.21.15.175:0/2621142692 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638b42681c0 con 0x5638b43b79d0 2024-04-25T09:13:45.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f6883e00640 1 --2- 172.21.15.175:0/2621142692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b43b82f0 0x5638b439d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:45.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f687be00640 1 --2- 172.21.15.175:0/2621142692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b439cd30 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f686c005890 tx=0x7f686c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735783bc1fb706e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:45.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f6870c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:13:45.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f6870c00640 1 -- 172.21.15.175:0/2621142692 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c021600 con 0x5638b43b79d0 2024-04-25T09:13:45.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f6870c00640 1 -- 172.21.15.175:0/2621142692 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f686c010040 con 0x5638b43b79d0 2024-04-25T09:13:45.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 -- 172.21.15.175:0/2621142692 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6874053790 con 0x5638b43b79d0 2024-04-25T09:13:45.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f6870c00640 1 -- 172.21.15.175:0/2621142692 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f686c02e050 con 0x5638b43b79d0 2024-04-25T09:13:45.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 10 client.8529 fetch_fsmap learned FSMap version 84 2024-04-25T09:13:45.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.724+0000 7f688d51f000 1 -- 172.21.15.175:0/2621142692 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x5638b4264170 con 0x5638b43b79d0 2024-04-25T09:13:45.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f6870c00640 1 -- 172.21.15.175:0/2621142692 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6874053790 con 0x5638b43b79d0 2024-04-25T09:13:45.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f6870c00640 1 -- 172.21.15.175:0/2621142692 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f686c031020 con 0x5638b43b79d0 2024-04-25T09:13:45.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f688d51f000 10 client.8529 fetch_fsmap finished waiting for FSMap version 84 2024-04-25T09:13:45.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f688d51f000 10 client.8529 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:13:45.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f688d51f000 20 client.8529 populate_metadata read hostname 'smithi175' 2024-04-25T09:13:45.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f688d51f000 1 --2- 172.21.15.175:0/2621142692 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x5638b43c7c80 0x5638b43ca070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f688d51f000 4 client.8529 mds_command: new command op to 8397 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:13:45.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f688d51f000 1 -- 172.21.15.175:0/2621142692 --> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5638b4156c60 con 0x5638b43c7c80 2024-04-25T09:13:45.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f6883400640 1 --2- 172.21.15.175:0/2621142692 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x5638b43c7c80 0x5638b43ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f6883400640 1 --2- 172.21.15.175:0/2621142692 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x5638b43c7c80 0x5638b43ca070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49008f3be3766cd3 server_cookie=1edae64def20ddd9 in_seq=0 out_seq=0 2024-04-25T09:13:45.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f6870c00640 10 client.8529 ms_handle_connect on v2:172.21.15.175:6835/2646458577 2024-04-25T09:13:45.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f6870c00640 1 -- 172.21.15.175:0/2621142692 <== mds.0 v2:172.21.15.175:6835/2646458577 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5638b4156c60 con 0x5638b43c7c80 2024-04-25T09:13:45.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f6870c00640 10 client.8529 handle_command_reply: tid=0 2024-04-25T09:13:45.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f688d51f000 1 client.8529 shutdown 2024-04-25T09:13:45.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f688d51f000 1 -- 172.21.15.175:0/2621142692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 msgr2=0x5638b439cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:45.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f688d51f000 1 --2- 172.21.15.175:0/2621142692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b439cd30 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f686c005890 tx=0x7f686c000bd0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f688d51f000 1 -- 172.21.15.175:0/2621142692 shutdown_connections 2024-04-25T09:13:45.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f688d51f000 1 --2- 172.21.15.175:0/2621142692 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x5638b43c7c80 0x5638b43ca070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f688d51f000 1 --2- 172.21.15.175:0/2621142692 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b43b82f0 0x5638b439d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f688d51f000 1 --2- 172.21.15.175:0/2621142692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b439cd30 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f688d51f000 1 --2- 172.21.15.175:0/2621142692 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b436e0a0 0x5638b439c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f6870c00640 0 client.8529 ms_handle_reset on v2:172.21.15.175:6835/2646458577 2024-04-25T09:13:45.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f688d51f000 1 -- 172.21.15.175:0/2621142692 >> 172.21.15.175:0/2621142692 conn(0x5638b436a020 msgr2=0x5638b436cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:45.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f688d51f000 1 -- 172.21.15.175:0/2621142692 shutdown_connections 2024-04-25T09:13:45.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f688d51f000 1 -- 172.21.15.175:0/2621142692 wait complete. 2024-04-25T09:13:45.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.728+0000 7f688d51f000 20 client.8529 trim_cache size 0 max 16384 2024-04-25T09:13:45.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f688d51f000 1 Processor -- start 2024-04-25T09:13:45.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f688d51f000 1 -- start start 2024-04-25T09:13:45.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f688d51f000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b436e0a0 0x5638b43b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f688d51f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b43b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f688d51f000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b43b82f0 0x5638b43b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f688d51f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68841fe7d0 con 0x5638b43b79d0 2024-04-25T09:13:45.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f688d51f000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68841fd9c0 con 0x5638b43b82f0 2024-04-25T09:13:45.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f688d51f000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68841597e0 con 0x5638b436e0a0 2024-04-25T09:13:45.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f687be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b43b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f687be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b43b65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41616/0 (socket says 172.21.15.175:41616) 2024-04-25T09:13:45.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f687be00640 1 -- 172.21.15.175:0/4286717103 learned_addr learned my addr 172.21.15.175:0/4286717103 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:45.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f6883400640 1 --2- 172.21.15.175:0/4286717103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b436e0a0 0x5638b43b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f6883e00640 1 --2- 172.21.15.175:0/4286717103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b43b82f0 0x5638b43b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f687be00640 1 -- 172.21.15.175:0/4286717103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b436e0a0 msgr2=0x5638b43b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:45.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f687be00640 1 --2- 172.21.15.175:0/4286717103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b436e0a0 0x5638b43b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f687be00640 1 -- 172.21.15.175:0/4286717103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b43b82f0 msgr2=0x5638b43b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:45.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f687be00640 1 --2- 172.21.15.175:0/4286717103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b43b82f0 0x5638b43b6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f687be00640 1 -- 172.21.15.175:0/4286717103 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638b4201de0 con 0x5638b43b79d0 2024-04-25T09:13:45.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f6883e00640 1 --2- 172.21.15.175:0/4286717103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b43b82f0 0x5638b43b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:45.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f687be00640 1 --2- 172.21.15.175:0/4286717103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b43b65e0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f686c000c10 tx=0x7f686c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84777de37030091 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:45.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f6873400640 1 -- 172.21.15.175:0/4286717103 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c001540 con 0x5638b43b79d0 2024-04-25T09:13:45.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f6873400640 1 -- 172.21.15.175:0/4286717103 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686c026070 con 0x5638b43b79d0 2024-04-25T09:13:45.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f6873400640 1 -- 172.21.15.175:0/4286717103 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c021d90 con 0x5638b43b79d0 2024-04-25T09:13:45.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f688d51f000 1 -- 172.21.15.175:0/4286717103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 msgr2=0x5638b43b65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:45.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f688d51f000 1 --2- 172.21.15.175:0/4286717103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b43b65e0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f686c000c10 tx=0x7f686c020000 comp rx=0 tx=0).stop 2024-04-25T09:13:45.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f688d51f000 1 -- 172.21.15.175:0/4286717103 shutdown_connections 2024-04-25T09:13:45.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f688d51f000 1 --2- 172.21.15.175:0/4286717103 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b43b82f0 0x5638b43b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f688d51f000 1 --2- 172.21.15.175:0/4286717103 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b43b65e0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f688d51f000 1 --2- 172.21.15.175:0/4286717103 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b436e0a0 0x5638b43b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f688d51f000 1 -- 172.21.15.175:0/4286717103 >> 172.21.15.175:0/4286717103 conn(0x5638b436a020 msgr2=0x5638b43c4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:45.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f688d51f000 1 -- 172.21.15.175:0/4286717103 shutdown_connections 2024-04-25T09:13:45.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.744+0000 7f688d51f000 1 -- 172.21.15.175:0/4286717103 wait complete. 2024-04-25T09:13:45.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f688d51f000 1 -- start start 2024-04-25T09:13:45.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f688d51f000 1 Processor -- start 2024-04-25T09:13:45.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f688d51f000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b436e0a0 0x5638b436d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f688d51f000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b43cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f688d51f000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b43b82f0 0x5638b43cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f688d51f000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638b4155e00 con 0x5638b43b79d0 2024-04-25T09:13:45.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f688d51f000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6884159de0 con 0x5638b436e0a0 2024-04-25T09:13:45.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f688d51f000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5638b41ba300 con 0x5638b43b82f0 2024-04-25T09:13:45.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f688d51f000 10 client.0 _ll_register_callbacks cb 0x5638b4339040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:13:45.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f687be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b43cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f687be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b43cb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41630/0 (socket says 172.21.15.175:41630) 2024-04-25T09:13:45.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f687be00640 1 -- 172.21.15.175:0/18321184 learned_addr learned my addr 172.21.15.175:0/18321184 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:45.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f6883400640 1 --2- 172.21.15.175:0/18321184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b436e0a0 0x5638b436d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f6883e00640 1 --2- 172.21.15.175:0/18321184 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b43b82f0 0x5638b43cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f687be00640 1 -- 172.21.15.175:0/18321184 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b43b82f0 msgr2=0x5638b43cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:45.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f687be00640 1 --2- 172.21.15.175:0/18321184 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b43b82f0 0x5638b43cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f687be00640 1 -- 172.21.15.175:0/18321184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b436e0a0 msgr2=0x5638b436d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:45.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f687be00640 1 --2- 172.21.15.175:0/18321184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b436e0a0 0x5638b436d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f687be00640 1 -- 172.21.15.175:0/18321184 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638b415c8e0 con 0x5638b43b79d0 2024-04-25T09:13:45.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f687be00640 1 --2- 172.21.15.175:0/18321184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b43cb0c0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f686c0068a0 tx=0x7f686c00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81e774ccfdeb3e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:45.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f6870c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:13:45.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f6870c00640 1 -- 172.21.15.175:0/18321184 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c0047f0 con 0x5638b43b79d0 2024-04-25T09:13:45.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f6870c00640 1 -- 172.21.15.175:0/18321184 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f686c044b00 con 0x5638b43b79d0 2024-04-25T09:13:45.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f688d51f000 1 -- 172.21.15.175:0/18321184 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f686c026070 con 0x5638b43b79d0 2024-04-25T09:13:45.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f6870c00640 1 -- 172.21.15.175:0/18321184 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f686c044d00 con 0x5638b43b79d0 2024-04-25T09:13:45.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f688d51f000 10 client.8535 fetch_fsmap learned FSMap version 84 2024-04-25T09:13:45.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f688d51f000 1 -- 172.21.15.175:0/18321184 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x5638b42148f0 con 0x5638b43b79d0 2024-04-25T09:13:45.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f6870c00640 1 -- 172.21.15.175:0/18321184 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686c026070 con 0x5638b43b79d0 2024-04-25T09:13:45.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f6870c00640 1 -- 172.21.15.175:0/18321184 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f686c031040 con 0x5638b43b79d0 2024-04-25T09:13:45.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f688d51f000 10 client.8535 fetch_fsmap finished waiting for FSMap version 84 2024-04-25T09:13:45.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f688d51f000 10 client.8535 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:13:45.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f688d51f000 20 client.8535 populate_metadata read hostname 'smithi175' 2024-04-25T09:13:45.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f688d51f000 1 --2- 172.21.15.175:0/18321184 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x5638b4426760 0x5638b4428b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f688d51f000 4 client.8535 mds_command: new command op to 8397 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:13:45.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f688d51f000 1 -- 172.21.15.175:0/18321184 --> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5638b41c8530 con 0x5638b4426760 2024-04-25T09:13:45.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f6883400640 1 --2- 172.21.15.175:0/18321184 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x5638b4426760 0x5638b4428b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:45.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f6870c00640 10 client.8535 ms_handle_connect on v2:172.21.15.175:6835/2646458577 2024-04-25T09:13:45.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.748+0000 7f6883400640 1 --2- 172.21.15.175:0/18321184 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x5638b4426760 0x5638b4428b50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35dabc91ffb9f2be server_cookie=63b7e9e26fd9efdb in_seq=0 out_seq=0 2024-04-25T09:13:45.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f6870c00640 1 -- 172.21.15.175:0/18321184 <== mds.0 v2:172.21.15.175:6835/2646458577 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5638b41c8530 con 0x5638b4426760 2024-04-25T09:13:45.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f6870c00640 10 client.8535 handle_command_reply: tid=0 2024-04-25T09:13:45.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688d51f000 1 client.8535 shutdown 2024-04-25T09:13:45.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688d51f000 1 -- 172.21.15.175:0/18321184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 msgr2=0x5638b43cb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:45.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688d51f000 1 --2- 172.21.15.175:0/18321184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b43cb0c0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f686c0068a0 tx=0x7f686c00a000 comp rx=0 tx=0).stop 2024-04-25T09:13:45.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688d51f000 1 -- 172.21.15.175:0/18321184 shutdown_connections 2024-04-25T09:13:45.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688d51f000 1 --2- 172.21.15.175:0/18321184 >> [v2:172.21.15.175:6835/2646458577,v1:172.21.15.175:6837/2646458577] conn(0x5638b4426760 0x5638b4428b50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688d51f000 1 --2- 172.21.15.175:0/18321184 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5638b43b82f0 0x5638b43cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688d51f000 1 --2- 172.21.15.175:0/18321184 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5638b43b79d0 0x5638b43cb0c0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688d51f000 1 --2- 172.21.15.175:0/18321184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5638b436e0a0 0x5638b436d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f6870c00640 0 client.8535 ms_handle_reset on v2:172.21.15.175:6835/2646458577 2024-04-25T09:13:45.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688d51f000 1 -- 172.21.15.175:0/18321184 >> 172.21.15.175:0/18321184 conn(0x5638b436a020 msgr2=0x5638b43b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:45.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688d51f000 1 -- 172.21.15.175:0/18321184 shutdown_connections 2024-04-25T09:13:45.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688d51f000 1 -- 172.21.15.175:0/18321184 wait complete. 2024-04-25T09:13:45.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688d51f000 20 client.8535 trim_cache size 0 max 16384 2024-04-25T09:13:45.742 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:13:45.742 INFO:teuthology.orchestra.run.smithi175.stdout: "status": "no active scrubs running", 2024-04-25T09:13:45.742 INFO:teuthology.orchestra.run.smithi175.stdout: "scrubs": {} 2024-04-25T09:13:45.742 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:13:45.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688a000640 1 -- 172.21.15.175:0/3949282888 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6860066f90 msgr2=0x7f6860069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:45.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688a000640 1 --2- 172.21.15.175:0/3949282888 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6860066f90 0x7f6860069450 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f686c007fd0 tx=0x7f686c009040 comp rx=0 tx=0).stop 2024-04-25T09:13:45.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688a000640 1 -- 172.21.15.175:0/3949282888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f688406d310 msgr2=0x7f6884145f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:45.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688a000640 1 --2- 172.21.15.175:0/3949282888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f688406d310 0x7f6884145f10 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f687400e810 tx=0x7f687400ecd0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688a000640 1 -- 172.21.15.175:0/3949282888 shutdown_connections 2024-04-25T09:13:45.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688a000640 1 --2- 172.21.15.175:0/3949282888 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6860066f90 0x7f6860069450 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688a000640 1 --2- 172.21.15.175:0/3949282888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f68840cbe60 0x7f68840cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688a000640 1 --2- 172.21.15.175:0/3949282888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f68840b4800 0x7f6884156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688a000640 1 --2- 172.21.15.175:0/3949282888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f688406d310 0x7f6884145f10 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:45.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688a000640 1 -- 172.21.15.175:0/3949282888 >> 172.21.15.175:0/3949282888 conn(0x7f688406ac50 msgr2=0x7f68840b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:45.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688a000640 1 -- 172.21.15.175:0/3949282888 shutdown_connections 2024-04-25T09:13:45.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:45.752+0000 7f688a000640 1 -- 172.21.15.175:0/3949282888 wait complete. 2024-04-25T09:13:45.757 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:13:45.858 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:13:45.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.008+0000 7f5b73600640 1 Processor -- start 2024-04-25T09:13:45.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.008+0000 7f5b73600640 1 -- start start 2024-04-25T09:13:45.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.012+0000 7f5b73600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b6c0cbe60 0x7f5b6c15af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.012+0000 7f5b73600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5b6c06d310 0x7f5b6c0b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:45.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.012+0000 7f5b73600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b6c06db60 con 0x7f5b6c0b4630 2024-04-25T09:13:46.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.012+0000 7f5b73600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b6c06de40 con 0x7f5b6c06d310 2024-04-25T09:13:46.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.012+0000 7f5b73600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c06e120 con 0x7f5b6c0cbe60 2024-04-25T09:13:46.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.012+0000 7f5b71600640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5b6c0b4630 0x7f5b6c0b2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53344/0 (socket says 172.21.15.175:53344) 2024-04-25T09:13:46.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.012+0000 7f5b71600640 1 -- 172.21.15.175:0/2563592673 learned_addr learned my addr 172.21.15.175:0/2563592673 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:46.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.012+0000 7f5b63e00640 1 --2- 172.21.15.175:0/2563592673 >> v2:172.21.15.177:3300/0 conn(0x7f5b6c06d310 0x7f5b6c0b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.012+0000 7f5b70c00640 1 --2- 172.21.15.175:0/2563592673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b6c0cbe60 0x7f5b6c15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.012+0000 7f5b6be00640 1 -- 172.21.15.175:0/2563592673 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685095284 0 0) 0x7f5b6c06db60 con 0x7f5b6c0b4630 2024-04-25T09:13:46.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.012+0000 7f5b6be00640 1 -- 172.21.15.175:0/2563592673 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b50003530 con 0x7f5b6c0b4630 2024-04-25T09:13:46.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.012+0000 7f5b63e00640 1 -- 172.21.15.175:0/2563592673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b6c0cbe60 msgr2=0x7f5b6c15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:46.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.012+0000 7f5b6be00640 1 -- 172.21.15.175:0/2563592673 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2030049133 0 0) 0x7f5b50003530 con 0x7f5b6c0b4630 2024-04-25T09:13:46.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.012+0000 7f5b63e00640 1 --2- 172.21.15.175:0/2563592673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b6c0cbe60 0x7f5b6c15af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.012+0000 7f5b63e00640 1 -- 172.21.15.175:0/2563592673 >> v1:172.21.15.175:6789/0 conn(0x7f5b6c0b4630 legacy=0x7f5b6c0b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.012+0000 7f5b63e00640 1 -- 172.21.15.175:0/2563592673 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c15c2f0 con 0x7f5b6c06d310 2024-04-25T09:13:46.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.012+0000 7f5b70c00640 1 --2- 172.21.15.175:0/2563592673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b6c0cbe60 0x7f5b6c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:46.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.016+0000 7f5b63e00640 1 --2- 172.21.15.175:0/2563592673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b6c06d310 0x7f5b6c0b40f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5b540097c0 tx=0x7f5b5401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae14e0a88101e9f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:46.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.016+0000 7f5b6be00640 1 -- 172.21.15.175:0/2563592673 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b540b0070 con 0x7f5b6c06d310 2024-04-25T09:13:46.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.016+0000 7f5b6be00640 1 -- 172.21.15.175:0/2563592673 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b540ab400 con 0x7f5b6c06d310 2024-04-25T09:13:46.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.016+0000 7f5b6be00640 1 -- 172.21.15.175:0/2563592673 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b64001a00 con 0x7f5b6c06d310 2024-04-25T09:13:46.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.016+0000 7f5b73600640 1 -- 172.21.15.175:0/2563592673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b6c06d310 msgr2=0x7f5b6c0b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.016+0000 7f5b73600640 1 --2- 172.21.15.175:0/2563592673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b6c06d310 0x7f5b6c0b40f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5b540097c0 tx=0x7f5b5401c3c0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.016+0000 7f5b73600640 1 -- 172.21.15.175:0/2563592673 shutdown_connections 2024-04-25T09:13:46.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.016+0000 7f5b73600640 1 --2- 172.21.15.175:0/2563592673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b6c06d310 0x7f5b6c0b40f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.016+0000 7f5b73600640 1 --2- 172.21.15.175:0/2563592673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b6c0cbe60 0x7f5b6c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.016+0000 7f5b73600640 1 -- 172.21.15.175:0/2563592673 >> 172.21.15.175:0/2563592673 conn(0x7f5b6c06ac50 msgr2=0x7f5b6c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:46.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.016+0000 7f5b73600640 1 -- 172.21.15.175:0/2563592673 shutdown_connections 2024-04-25T09:13:46.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.016+0000 7f5b73600640 1 -- 172.21.15.175:0/2563592673 wait complete. 2024-04-25T09:13:46.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.016+0000 7f5b73600640 1 Processor -- start 2024-04-25T09:13:46.005 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.016+0000 7f5b73600640 1 -- start start 2024-04-25T09:13:46.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b73600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b6c06d310 0x7f5b6c14af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b73600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b6c0b4630 0x7f5b6c14a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b73600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b6c0cbe60 0x7f5b6c153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b73600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c167770 con 0x7f5b6c0b4630 2024-04-25T09:13:46.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b73600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c0cc450 con 0x7f5b6c0cbe60 2024-04-25T09:13:46.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b73600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6c1678f0 con 0x7f5b6c06d310 2024-04-25T09:13:46.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b63e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b6c0b4630 0x7f5b6c14a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b63e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b6c0b4630 0x7f5b6c14a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41632/0 (socket says 172.21.15.175:41632) 2024-04-25T09:13:46.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b63e00640 1 -- 172.21.15.175:0/1387246054 learned_addr learned my addr 172.21.15.175:0/1387246054 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:46.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b63e00640 1 -- 172.21.15.175:0/1387246054 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b6c06d310 msgr2=0x7f5b6c14af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b63e00640 1 --2- 172.21.15.175:0/1387246054 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b6c06d310 0x7f5b6c14af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b63e00640 1 -- 172.21.15.175:0/1387246054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b6c0cbe60 msgr2=0x7f5b6c153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b63e00640 1 --2- 172.21.15.175:0/1387246054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b6c0cbe60 0x7f5b6c153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b63e00640 1 -- 172.21.15.175:0/1387246054 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c159590 con 0x7f5b6c0b4630 2024-04-25T09:13:46.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b63e00640 1 --2- 172.21.15.175:0/1387246054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b6c0b4630 0x7f5b6c14a8f0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f5b540ae040 tx=0x7f5b54019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:46.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b69600640 1 -- 172.21.15.175:0/1387246054 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b540b0040 con 0x7f5b6c0b4630 2024-04-25T09:13:46.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b69600640 1 -- 172.21.15.175:0/1387246054 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b540b9070 con 0x7f5b6c0b4630 2024-04-25T09:13:46.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b73600640 1 -- 172.21.15.175:0/1387246054 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6c159870 con 0x7f5b6c0b4630 2024-04-25T09:13:46.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b69600640 1 -- 172.21.15.175:0/1387246054 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b540b4890 con 0x7f5b6c0b4630 2024-04-25T09:13:46.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b73600640 1 -- 172.21.15.175:0/1387246054 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6c154210 con 0x7f5b6c0b4630 2024-04-25T09:13:46.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b73600640 1 -- 172.21.15.175:0/1387246054 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6c075160 con 0x7f5b6c0b4630 2024-04-25T09:13:46.009 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.020+0000 7f5b69600640 1 -- 172.21.15.175:0/1387246054 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5b540b4a30 con 0x7f5b6c0b4630 2024-04-25T09:13:46.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.024+0000 7f5b69600640 1 --2- 172.21.15.175:0/1387246054 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5b48066f90 0x7f5b48069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.024+0000 7f5b69600640 1 -- 172.21.15.175:0/1387246054 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5b5411f070 con 0x7f5b6c0b4630 2024-04-25T09:13:46.010 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.024+0000 7f5b70c00640 1 --2- 172.21.15.175:0/1387246054 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5b48066f90 0x7f5b48069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.024+0000 7f5b70c00640 1 --2- 172.21.15.175:0/1387246054 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5b48066f90 0x7f5b48069450 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c006e90 tx=0x7f5b5c006de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:46.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.028+0000 7f5b69600640 1 -- 172.21.15.175:0/1387246054 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5b54015fb0 con 0x7f5b6c0b4630 2024-04-25T09:13:46.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.212+0000 7f5b73600640 1 -- 172.21.15.175:0/1387246054 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5b6c155070 con 0x7f5b6c0b4630 2024-04-25T09:13:46.201 INFO:tasks.ceph.mon.a.smithi175.stderr:2024-04-25T09:13:46.212+0000 7feb0ee00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:13:46.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.216+0000 7f5b69600640 1 -- 172.21.15.175:0/1387246054 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v85) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5b540eff80 con 0x7f5b6c0b4630 2024-04-25T09:13:46.203 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:13:46.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.220+0000 7f5b73600640 1 -- 172.21.15.175:0/1387246054 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5b48066f90 msgr2=0x7f5b48069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.220+0000 7f5b73600640 1 --2- 172.21.15.175:0/1387246054 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5b48066f90 0x7f5b48069450 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c006e90 tx=0x7f5b5c006de0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.220+0000 7f5b73600640 1 -- 172.21.15.175:0/1387246054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b6c0b4630 msgr2=0x7f5b6c14a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.220+0000 7f5b73600640 1 --2- 172.21.15.175:0/1387246054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b6c0b4630 0x7f5b6c14a8f0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f5b540ae040 tx=0x7f5b54019160 comp rx=0 tx=0).stop 2024-04-25T09:13:46.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.220+0000 7f5b73600640 1 -- 172.21.15.175:0/1387246054 shutdown_connections 2024-04-25T09:13:46.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.220+0000 7f5b73600640 1 --2- 172.21.15.175:0/1387246054 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5b48066f90 0x7f5b48069450 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.220+0000 7f5b73600640 1 --2- 172.21.15.175:0/1387246054 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b6c0cbe60 0x7f5b6c153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.220+0000 7f5b73600640 1 --2- 172.21.15.175:0/1387246054 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b6c0b4630 0x7f5b6c14a8f0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.220+0000 7f5b73600640 1 --2- 172.21.15.175:0/1387246054 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b6c06d310 0x7f5b6c14af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.220+0000 7f5b73600640 1 -- 172.21.15.175:0/1387246054 >> 172.21.15.175:0/1387246054 conn(0x7f5b6c06ac50 msgr2=0x7f5b6c071600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:46.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.220+0000 7f5b73600640 1 -- 172.21.15.175:0/1387246054 shutdown_connections 2024-04-25T09:13:46.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.220+0000 7f5b73600640 1 -- 172.21.15.175:0/1387246054 wait complete. 2024-04-25T09:13:46.212 INFO:tasks.ceph.mds.a.smithi175.stderr: -1148> 2024-04-25T09:13:15.336+0000 7f39ef800640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-04-25T09:13:46.213 INFO:tasks.ceph.mds.a.smithi175.stderr: -1145> 2024-04-25T09:13:15.336+0000 7f39ef800640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-04-25T09:13:46.213 INFO:tasks.ceph.mds.a.smithi175.stderr: -1129> 2024-04-25T09:13:15.336+0000 7f39ef800640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-04-25T09:13:46.213 INFO:tasks.ceph.mds.a.smithi175.stderr: -1126> 2024-04-25T09:13:15.336+0000 7f39ef800640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-04-25T09:13:46.213 INFO:tasks.ceph.mds.a.smithi175.stderr: -986> 2024-04-25T09:13:15.612+0000 7f39f4800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:13:46.228 DEBUG:teuthology.orchestra.run.smithi175:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show inode 2024-04-25T09:13:46.254 INFO:tasks.ceph.mds.a.smithi175.stdout:starting mds.a at 2024-04-25T09:13:46.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365f731400 1 -- start start 2024-04-25T09:13:46.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365f731400 1 Processor -- start 2024-04-25T09:13:46.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365f731400 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557681e87800 0x557682040580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365f731400 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557681e87400 0x557682040b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365f731400 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557681e87000 0x557682041080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365f731400 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557682c50180 con 0x557681e87400 2024-04-25T09:13:46.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365f731400 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x557682c50300 con 0x557681e87800 2024-04-25T09:13:46.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365f731400 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x557682c50480 con 0x557681e87000 2024-04-25T09:13:46.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557681e87400 0x557682040b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365ce00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557681e87400 0x557682040b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41654/0 (socket says 172.21.15.175:41654) 2024-04-25T09:13:46.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365ce00640 1 -- 172.21.15.175:0/2232868741 learned_addr learned my addr 172.21.15.175:0/2232868741 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:46.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365e200640 1 --2- 172.21.15.175:0/2232868741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557681e87000 0x557682041080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365d800640 1 --2- 172.21.15.175:0/2232868741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557681e87800 0x557682040580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365ce00640 1 -- 172.21.15.175:0/2232868741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557681e87000 msgr2=0x557682041080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:46.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365ce00640 1 --2- 172.21.15.175:0/2232868741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557681e87000 0x557682041080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365ce00640 1 -- 172.21.15.175:0/2232868741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557681e87800 msgr2=0x557682040580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:46.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365ce00640 1 --2- 172.21.15.175:0/2232868741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557681e87800 0x557682040580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365ce00640 1 -- 172.21.15.175:0/2232868741 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557682c3eb40 con 0x557681e87400 2024-04-25T09:13:46.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365ce00640 1 --2- 172.21.15.175:0/2232868741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557681e87400 0x557682040b00 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x557682ce91a0 tx=0x557682d96120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361e23b090fa5d54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:46.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365a600640 1 -- 172.21.15.175:0/2232868741 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557681ebc4e0 con 0x557681e87400 2024-04-25T09:13:46.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365a600640 1 -- 172.21.15.175:0/2232868741 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557681ed0e00 con 0x557681e87400 2024-04-25T09:13:46.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365a600640 1 -- 172.21.15.175:0/2232868741 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557681ebcb60 con 0x557681e87400 2024-04-25T09:13:46.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365f731400 1 -- 172.21.15.175:0/2232868741 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557682c3ed20 con 0x557681e87400 2024-04-25T09:13:46.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365f731400 1 -- 172.21.15.175:0/2232868741 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x557682c3ef00 con 0x557681e87400 2024-04-25T09:13:46.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365f731400 4 waiting for MDS map... 2024-04-25T09:13:46.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365a600640 1 -- 172.21.15.175:0/2232868741 <== mon.0 v2:172.21.15.175:3300/0 4 ==== osd_map(102..102 src has 1..102) v4 ==== 5881+0+0 (secure 0 0 0) 0x557682d9e600 con 0x557681e87400 2024-04-25T09:13:46.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365a600640 1 -- 172.21.15.175:0/2232868741 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 85) v1 ==== 2723+0+0 (secure 0 0 0) 0x557681edd180 con 0x557681e87400 2024-04-25T09:13:46.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365f731400 4 Got MDS map 85 2024-04-25T09:13:46.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365f731400 10 main: main 2024-04-25T09:13:46.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.288+0000 7f365f731400 4 main: connecting to RADOS... 2024-04-25T09:13:46.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 Processor -- start 2024-04-25T09:13:46.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 -- start start 2024-04-25T09:13:46.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557682da2c00 0x557682041600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557682da3000 0x557682041b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557682da3400 0x557682042100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557682c50600 con 0x557682da3000 2024-04-25T09:13:46.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x557682c50780 con 0x557682da3400 2024-04-25T09:13:46.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x557682c50900 con 0x557682da2c00 2024-04-25T09:13:46.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557682da3000 0x557682041b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557682da3000 0x557682041b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41656/0 (socket says 172.21.15.175:41656) 2024-04-25T09:13:46.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365d800640 1 -- 172.21.15.175:0/3640844046 learned_addr learned my addr 172.21.15.175:0/3640844046 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:46.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365e200640 1 --2- 172.21.15.175:0/3640844046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557682da2c00 0x557682041600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365ce00640 1 --2- 172.21.15.175:0/3640844046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557682da3400 0x557682042100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365d800640 1 -- 172.21.15.175:0/3640844046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557682da2c00 msgr2=0x557682041600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:46.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365d800640 1 --2- 172.21.15.175:0/3640844046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557682da2c00 0x557682041600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365d800640 1 -- 172.21.15.175:0/3640844046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557682da3400 msgr2=0x557682042100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:46.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365d800640 1 --2- 172.21.15.175:0/3640844046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557682da3400 0x557682042100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365d800640 1 -- 172.21.15.175:0/3640844046 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557682c3ed20 con 0x557682da3000 2024-04-25T09:13:46.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365d800640 1 --2- 172.21.15.175:0/3640844046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557682da3000 0x557682041b80 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x557682e0c060 tx=0x557682d97f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d10dd7b283f1e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:46.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f3657e00640 1 -- 172.21.15.175:0/3640844046 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557681ebc4e0 con 0x557682da3000 2024-04-25T09:13:46.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f3657e00640 1 -- 172.21.15.175:0/3640844046 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557681ed0540 con 0x557682da3000 2024-04-25T09:13:46.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f3657e00640 1 -- 172.21.15.175:0/3640844046 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557681ebcb60 con 0x557682da3000 2024-04-25T09:13:46.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 -- 172.21.15.175:0/3640844046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557682da3000 msgr2=0x557682041b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 --2- 172.21.15.175:0/3640844046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557682da3000 0x557682041b80 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x557682e0c060 tx=0x557682d97f20 comp rx=0 tx=0).stop 2024-04-25T09:13:46.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 -- 172.21.15.175:0/3640844046 shutdown_connections 2024-04-25T09:13:46.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 --2- 172.21.15.175:0/3640844046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557682da3400 0x557682042100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 --2- 172.21.15.175:0/3640844046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557682da3000 0x557682041b80 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 --2- 172.21.15.175:0/3640844046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557682da2c00 0x557682041600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 -- 172.21.15.175:0/3640844046 >> 172.21.15.175:0/3640844046 conn(0x557681e86c00 msgr2=0x557681eb5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:46.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 -- 172.21.15.175:0/3640844046 shutdown_connections 2024-04-25T09:13:46.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 -- 172.21.15.175:0/3640844046 wait complete. 2024-04-25T09:13:46.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 Processor -- start 2024-04-25T09:13:46.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.292+0000 7f365f731400 1 -- start start 2024-04-25T09:13:46.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365f731400 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557682da2c00 0x557682043180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365f731400 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557682da3000 0x557682042c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365f731400 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557682da3400 0x557682042680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.286 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365f731400 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557682c51c80 con 0x557682da3000 2024-04-25T09:13:46.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365f731400 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x557682c51b00 con 0x557682da2c00 2024-04-25T09:13:46.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365f731400 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x557682c51980 con 0x557682da3400 2024-04-25T09:13:46.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557682da3000 0x557682042c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365e200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557682da2c00 0x557682043180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557682da3000 0x557682042c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41672/0 (socket says 172.21.15.175:41672) 2024-04-25T09:13:46.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365d800640 1 -- 172.21.15.175:0/371262157 learned_addr learned my addr 172.21.15.175:0/371262157 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:46.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365ce00640 1 --2- 172.21.15.175:0/371262157 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557682da3400 0x557682042680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365d800640 1 -- 172.21.15.175:0/371262157 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557682da3400 msgr2=0x557682042680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365d800640 1 --2- 172.21.15.175:0/371262157 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557682da3400 0x557682042680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365d800640 1 -- 172.21.15.175:0/371262157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557682da2c00 msgr2=0x557682043180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365d800640 1 --2- 172.21.15.175:0/371262157 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557682da2c00 0x557682043180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365d800640 1 -- 172.21.15.175:0/371262157 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557682c3fc20 con 0x557682da3000 2024-04-25T09:13:46.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365d800640 1 --2- 172.21.15.175:0/371262157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557682da3000 0x557682042c00 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x557682e0d320 tx=0x5576821b8b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:46.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f3656000640 1 -- 172.21.15.175:0/371262157 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557681ebc000 con 0x557682da3000 2024-04-25T09:13:46.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f3656000640 1 -- 172.21.15.175:0/371262157 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557681ed0c40 con 0x557682da3000 2024-04-25T09:13:46.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f3656000640 1 -- 172.21.15.175:0/371262157 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557681ebc4e0 con 0x557682da3000 2024-04-25T09:13:46.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365f731400 1 -- 172.21.15.175:0/371262157 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557682c3fe00 con 0x557682da3000 2024-04-25T09:13:46.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365f731400 1 -- 172.21.15.175:0/371262157 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557682c3fc20 con 0x557682da3000 2024-04-25T09:13:46.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365f731400 4 main: resolving pool 14 2024-04-25T09:13:46.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f3656000640 1 -- 172.21.15.175:0/371262157 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x557682de0c00 con 0x557682da3000 2024-04-25T09:13:46.289 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f3656000640 1 --2- 172.21.15.175:0/371262157 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x557682e0ec00 0x557682043700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f3656000640 1 -- 172.21.15.175:0/371262157 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5881+0+0 (secure 0 0 0) 0x5576821c6400 con 0x557682da3000 2024-04-25T09:13:46.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.296+0000 7f365f731400 4 main: creating IoCtx.. 2024-04-25T09:13:46.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.300+0000 7f365f731400 1 --2- 172.21.15.175:0/371262157 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x557682da3800 0x557682042100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.300+0000 7f365e200640 1 --2- 172.21.15.175:0/371262157 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x557682e0ec00 0x557682043700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.300+0000 7f365f731400 1 -- 172.21.15.175:0/371262157 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e102) v9 -- 0x557682da3c00 con 0x557682da3800 2024-04-25T09:13:46.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.300+0000 7f365ce00640 1 --2- 172.21.15.175:0/371262157 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x557682da3800 0x557682042100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.300+0000 7f365e200640 1 --2- 172.21.15.175:0/371262157 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x557682e0ec00 0x557682043700 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x557681ed79b0 tx=0x557681f3fec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:46.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.300+0000 7f365ce00640 1 --2- 172.21.15.175:0/371262157 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x557682da3800 0x557682042100 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:46.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.300+0000 7f365ce00640 1 -- 172.21.15.175:0/371262157 <== osd.2 v2:172.21.15.175:6821/3247063283 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv7 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x557681f92000 con 0x557682da3800 2024-04-25T09:13:46.290 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:13:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "0": { 2024-04-25T09:13:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "data": { 2024-04-25T09:13:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "version": 5, 2024-04-25T09:13:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "inotable": { 2024-04-25T09:13:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "projected_free": [ 2024-04-25T09:13:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:13:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "start": 1099511627779, 2024-04-25T09:13:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "len": 1099511627773 2024-04-25T09:13:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:13:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: ], 2024-04-25T09:13:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "free": [ 2024-04-25T09:13:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:13:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "start": 1099511627779, 2024-04-25T09:13:46.291 INFO:teuthology.orchestra.run.smithi175.stdout: "len": 1099511627773 2024-04-25T09:13:46.292 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:13:46.292 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-25T09:13:46.292 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:13:46.292 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:13:46.292 INFO:teuthology.orchestra.run.smithi175.stdout: "result": 0 2024-04-25T09:13:46.292 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:13:46.292 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:13:46.292 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:13:46.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.300+0000 7f365f731400 1 -- 172.21.15.175:0/371262157 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x557682da3800 msgr2=0x557682042100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.300+0000 7f365f731400 1 --2- 172.21.15.175:0/371262157 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x557682da3800 0x557682042100 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.300+0000 7f365f731400 1 -- 172.21.15.175:0/371262157 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x557682e0ec00 msgr2=0x557682043700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.300+0000 7f365f731400 1 --2- 172.21.15.175:0/371262157 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x557682e0ec00 0x557682043700 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x557681ed79b0 tx=0x557681f3fec0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.300+0000 7f365f731400 1 -- 172.21.15.175:0/371262157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557682da3000 msgr2=0x557682042c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.300+0000 7f365f731400 1 --2- 172.21.15.175:0/371262157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557682da3000 0x557682042c00 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x557682e0d320 tx=0x5576821b8b40 comp rx=0 tx=0).stop 2024-04-25T09:13:46.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.300+0000 7f365d800640 1 -- 172.21.15.175:0/371262157 reap_dead start 2024-04-25T09:13:46.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.300+0000 7f365f731400 1 -- 172.21.15.175:0/371262157 shutdown_connections 2024-04-25T09:13:46.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.300+0000 7f365f731400 1 -- 172.21.15.175:0/371262157 >> 172.21.15.175:0/371262157 conn(0x557681e86c00 msgr2=0x557681eb5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:46.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.300+0000 7f365f731400 1 -- 172.21.15.175:0/371262157 shutdown_connections 2024-04-25T09:13:46.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.300+0000 7f365f731400 1 -- 172.21.15.175:0/371262157 wait complete. 2024-04-25T09:13:46.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.304+0000 7f365f731400 1 -- 172.21.15.175:0/2232868741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557681e87400 msgr2=0x557682040b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.304+0000 7f365f731400 1 --2- 172.21.15.175:0/2232868741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557681e87400 0x557682040b00 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x557682ce91a0 tx=0x557682d96120 comp rx=0 tx=0).stop 2024-04-25T09:13:46.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.304+0000 7f365f731400 1 -- 172.21.15.175:0/2232868741 shutdown_connections 2024-04-25T09:13:46.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.304+0000 7f365f731400 1 --2- 172.21.15.175:0/2232868741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557681e87000 0x557682041080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.304+0000 7f365f731400 1 --2- 172.21.15.175:0/2232868741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557681e87400 0x557682040b00 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.304+0000 7f365f731400 1 --2- 172.21.15.175:0/2232868741 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557681e87800 0x557682040580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.304+0000 7f365f731400 1 -- 172.21.15.175:0/2232868741 >> 172.21.15.175:0/2232868741 conn(0x557681e87c00 msgr2=0x557681eb5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:46.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.304+0000 7f365f731400 1 -- 172.21.15.175:0/2232868741 shutdown_connections 2024-04-25T09:13:46.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.304+0000 7f365f731400 1 -- 172.21.15.175:0/2232868741 wait complete. 2024-04-25T09:13:46.296 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'inode'] in time 0:00:00.068128, result: { "0": { "data": { "version": 5, "inotable": { "projected_free": [ { "start": 1099511627779, "len": 1099511627773 } ], "free": [ { "start": 1099511627779, "len": 1099511627773 } ] } }, "result": 0 } } 2024-04-25T09:13:46.296 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:13:46.296 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:13:46.385 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:13:46.444 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:13:46.445 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:13:46.445 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:13:46.453 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:13:46.453 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:13:46.453 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:13:46.462 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:13:46.462 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:13:46.462 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:13:46.509 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:13:46.509 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:13:46.509 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:13:46.518 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:13:46.518 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:46.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.700+0000 7fe6cde00640 1 Processor -- start 2024-04-25T09:13:46.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.700+0000 7fe6cde00640 1 -- start start 2024-04-25T09:13:46.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.700+0000 7fe6cde00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe6c80add90 0x7fe6c80ae680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.700+0000 7fe6cde00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe6c80aebc0 0x7fe6c8167700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.700+0000 7fe6cde00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c815dfb0 con 0x7fe6c815dbd0 2024-04-25T09:13:46.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.700+0000 7fe6cde00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c80ae1d0 con 0x7fe6c80add90 2024-04-25T09:13:46.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.700+0000 7fe6cde00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c80cf670 con 0x7fe6c80aebc0 2024-04-25T09:13:46.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.700+0000 7fe6be000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe6c80add90 0x7fe6c80ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.700+0000 7fe6be000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe6c80add90 0x7fe6c80ae680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41680/0 (socket says 172.21.15.175:41680) 2024-04-25T09:13:46.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.700+0000 7fe6be000640 1 -- 172.21.15.175:0/3765184173 learned_addr learned my addr 172.21.15.175:0/3765184173 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:46.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.700+0000 7fe6c7400640 1 --2- 172.21.15.175:0/3765184173 >> v2:172.21.15.177:3300/0 conn(0x7fe6c80aebc0 0x7fe6c8167700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.704+0000 7fe6be000640 1 -- 172.21.15.175:0/3765184173 >> v2:172.21.15.177:3300/0 conn(0x7fe6c80aebc0 msgr2=0x7fe6c8167700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:46.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.704+0000 7fe6be000640 1 --2- 172.21.15.175:0/3765184173 >> v2:172.21.15.177:3300/0 conn(0x7fe6c80aebc0 0x7fe6c8167700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.704+0000 7fe6be000640 1 -- 172.21.15.175:0/3765184173 >> v1:172.21.15.177:6789/0 conn(0x7fe6c815dbd0 legacy=0x7fe6c8071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:46.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.704+0000 7fe6be000640 1 -- 172.21.15.175:0/3765184173 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c80b2980 con 0x7fe6c80add90 2024-04-25T09:13:46.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.704+0000 7fe6be000640 1 --2- 172.21.15.175:0/3765184173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c80add90 0x7fe6c80ae680 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fe6c806d2f0 tx=0x7fe6b001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a31911c4f9698cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:46.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.704+0000 7fe6c6000640 1 -- 172.21.15.175:0/3765184173 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00a5670 con 0x7fe6c80add90 2024-04-25T09:13:46.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.704+0000 7fe6c6000640 1 -- 172.21.15.175:0/3765184173 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b00a5810 con 0x7fe6c80add90 2024-04-25T09:13:46.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.704+0000 7fe6c6000640 1 -- 172.21.15.175:0/3765184173 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b00a5be0 con 0x7fe6c80add90 2024-04-25T09:13:46.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.704+0000 7fe6cde00640 1 -- 172.21.15.175:0/3765184173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c80add90 msgr2=0x7fe6c80ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.704+0000 7fe6cde00640 1 --2- 172.21.15.175:0/3765184173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c80add90 0x7fe6c80ae680 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fe6c806d2f0 tx=0x7fe6b001c9b0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.704+0000 7fe6cde00640 1 -- 172.21.15.175:0/3765184173 shutdown_connections 2024-04-25T09:13:46.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.704+0000 7fe6cde00640 1 --2- 172.21.15.175:0/3765184173 >> v2:172.21.15.177:3300/0 conn(0x7fe6c80aebc0 0x7fe6c8167700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.704+0000 7fe6cde00640 1 --2- 172.21.15.175:0/3765184173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c80add90 0x7fe6c80ae680 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.704+0000 7fe6cde00640 1 -- 172.21.15.175:0/3765184173 >> 172.21.15.175:0/3765184173 conn(0x7fe6c8067150 msgr2=0x7fe6c806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:46.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.704+0000 7fe6cde00640 1 -- 172.21.15.175:0/3765184173 shutdown_connections 2024-04-25T09:13:46.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.704+0000 7fe6cde00640 1 -- 172.21.15.175:0/3765184173 wait complete. 2024-04-25T09:13:46.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6cde00640 1 Processor -- start 2024-04-25T09:13:46.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6cde00640 1 -- start start 2024-04-25T09:13:46.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6cde00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c80aebc0 0x7fe6c81487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6cde00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6c815dbd0 0x7fe6c815e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6cde00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6c814fb00 0x7fe6c815f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6cde00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c80b2700 con 0x7fe6c80aebc0 2024-04-25T09:13:46.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6cde00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c80b2580 con 0x7fe6c814fb00 2024-04-25T09:13:46.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6cde00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c816a460 con 0x7fe6c815dbd0 2024-04-25T09:13:46.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6c6a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c80aebc0 0x7fe6c81487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6c6a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c80aebc0 0x7fe6c81487a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41694/0 (socket says 172.21.15.175:41694) 2024-04-25T09:13:46.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6c6a00640 1 -- 172.21.15.175:0/1255913334 learned_addr learned my addr 172.21.15.175:0/1255913334 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:46.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6c7400640 1 --2- 172.21.15.175:0/1255913334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6c814fb00 0x7fe6c815f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6be000640 1 --2- 172.21.15.175:0/1255913334 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6c815dbd0 0x7fe6c815e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6c6a00640 1 -- 172.21.15.175:0/1255913334 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6c815dbd0 msgr2=0x7fe6c815e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6c6a00640 1 --2- 172.21.15.175:0/1255913334 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6c815dbd0 0x7fe6c815e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6c6a00640 1 -- 172.21.15.175:0/1255913334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6c814fb00 msgr2=0x7fe6c815f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.700 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6c6a00640 1 --2- 172.21.15.175:0/1255913334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6c814fb00 0x7fe6c815f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6c6a00640 1 -- 172.21.15.175:0/1255913334 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c815ea60 con 0x7fe6c80aebc0 2024-04-25T09:13:46.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6c7400640 1 --2- 172.21.15.175:0/1255913334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6c814fb00 0x7fe6c815f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:46.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6be000640 1 --2- 172.21.15.175:0/1255913334 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6c815dbd0 0x7fe6c815e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:46.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6c6a00640 1 --2- 172.21.15.175:0/1255913334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c80aebc0 0x7fe6c81487a0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800b410 tx=0x7fe6b800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:46.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6bfe00640 1 -- 172.21.15.175:0/1255913334 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8015030 con 0x7fe6c80aebc0 2024-04-25T09:13:46.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6bfe00640 1 -- 172.21.15.175:0/1255913334 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b8004020 con 0x7fe6c80aebc0 2024-04-25T09:13:46.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6bfe00640 1 -- 172.21.15.175:0/1255913334 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8004450 con 0x7fe6c80aebc0 2024-04-25T09:13:46.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.708+0000 7fe6cde00640 1 -- 172.21.15.175:0/1255913334 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c815ed40 con 0x7fe6c80aebc0 2024-04-25T09:13:46.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.712+0000 7fe6cde00640 1 -- 172.21.15.175:0/1255913334 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c815f300 con 0x7fe6c80aebc0 2024-04-25T09:13:46.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.712+0000 7fe6cde00640 1 -- 172.21.15.175:0/1255913334 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c8074a60 con 0x7fe6c80aebc0 2024-04-25T09:13:46.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.712+0000 7fe6bfe00640 1 -- 172.21.15.175:0/1255913334 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe6b8018070 con 0x7fe6c80aebc0 2024-04-25T09:13:46.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.712+0000 7fe6bfe00640 1 --2- 172.21.15.175:0/1255913334 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe6a4066f60 0x7fe6a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:46.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.712+0000 7fe6bfe00640 1 -- 172.21.15.175:0/1255913334 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fe6b8084d30 con 0x7fe6c80aebc0 2024-04-25T09:13:46.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.712+0000 7fe6be000640 1 --2- 172.21.15.175:0/1255913334 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe6a4066f60 0x7fe6a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:46.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.712+0000 7fe6be000640 1 --2- 172.21.15.175:0/1255913334 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe6a4066f60 0x7fe6a4069420 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00ae000 tx=0x7fe6b00a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:46.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.716+0000 7fe6bfe00640 1 -- 172.21.15.175:0/1255913334 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe6b808a020 con 0x7fe6c80aebc0 2024-04-25T09:13:46.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.900+0000 7fe6cde00640 1 -- 172.21.15.175:0/1255913334 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6c806b080 con 0x7fe6c80aebc0 2024-04-25T09:13:46.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.904+0000 7fe6bfe00640 1 -- 172.21.15.175:0/1255913334 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4149 (secure 0 0 0) 0x7fe6b8055bf0 con 0x7fe6c80aebc0 2024-04-25T09:13:46.890 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:13:46.890 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":85,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6998,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3519467288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3519467288},{"type":"v1","addr":"172.21.15.177:6834","nonce":3519467288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2181426238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2181426238},{"type":"v1","addr":"172.21.15.177:6835","nonce":2181426238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/936884340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":936884340},{"type":"v1","addr":"172.21.15.175:6836","nonce":936884340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74}],"filesystems":[{"mdsmap":{"epoch":85,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:23.414911+0000","modified":"2024-04-25T09:13:46.217300+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:13:46.890 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 85 2024-04-25T09:13:46.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.904+0000 7fe6cde00640 1 -- 172.21.15.175:0/1255913334 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe6a4066f60 msgr2=0x7fe6a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.904+0000 7fe6cde00640 1 --2- 172.21.15.175:0/1255913334 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe6a4066f60 0x7fe6a4069420 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00ae000 tx=0x7fe6b00a7070 comp rx=0 tx=0).stop 2024-04-25T09:13:46.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.904+0000 7fe6cde00640 1 -- 172.21.15.175:0/1255913334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c80aebc0 msgr2=0x7fe6c81487a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:46.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.904+0000 7fe6cde00640 1 --2- 172.21.15.175:0/1255913334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c80aebc0 0x7fe6c81487a0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800b410 tx=0x7fe6b800b8d0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.904+0000 7fe6cde00640 1 -- 172.21.15.175:0/1255913334 shutdown_connections 2024-04-25T09:13:46.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.904+0000 7fe6cde00640 1 --2- 172.21.15.175:0/1255913334 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe6a4066f60 0x7fe6a4069420 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.904+0000 7fe6cde00640 1 --2- 172.21.15.175:0/1255913334 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe6c814fb00 0x7fe6c815f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.904+0000 7fe6cde00640 1 --2- 172.21.15.175:0/1255913334 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe6c815dbd0 0x7fe6c815e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.904+0000 7fe6cde00640 1 --2- 172.21.15.175:0/1255913334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6c80aebc0 0x7fe6c81487a0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:46.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.904+0000 7fe6cde00640 1 -- 172.21.15.175:0/1255913334 >> 172.21.15.175:0/1255913334 conn(0x7fe6c80add90 msgr2=0x7fe6c8071240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:46.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.904+0000 7fe6cde00640 1 -- 172.21.15.175:0/1255913334 shutdown_connections 2024-04-25T09:13:46.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:46.904+0000 7fe6cde00640 1 -- 172.21.15.175:0/1255913334 wait complete. 2024-04-25T09:13:46.911 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:13:47.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.060+0000 7eff32200640 1 Processor -- start 2024-04-25T09:13:47.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.060+0000 7eff32200640 1 -- start start 2024-04-25T09:13:47.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.060+0000 7eff32200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7eff2c15bb80 0x7eff2c06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.060+0000 7eff32200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7eff2c0726f0 0x7eff2c06dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.060+0000 7eff32200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2c06f570 con 0x7eff2c0b5880 2024-04-25T09:13:47.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.060+0000 7eff32200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2c06f060 con 0x7eff2c0726f0 2024-04-25T09:13:47.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.060+0000 7eff32200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2c0cab30 con 0x7eff2c15bb80 2024-04-25T09:13:47.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.060+0000 7eff2be00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7eff2c0726f0 0x7eff2c06dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.060+0000 7eff2be00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7eff2c0726f0 0x7eff2c06dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41700/0 (socket says 172.21.15.175:41700) 2024-04-25T09:13:47.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.060+0000 7eff2be00640 1 -- 172.21.15.175:0/1487939390 learned_addr learned my addr 172.21.15.175:0/1487939390 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:47.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.060+0000 7eff2b400640 1 --2- 172.21.15.175:0/1487939390 >> v2:172.21.15.177:3300/0 conn(0x7eff2c15bb80 0x7eff2c06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.060+0000 7eff2be00640 1 -- 172.21.15.175:0/1487939390 >> v2:172.21.15.177:3300/0 conn(0x7eff2c15bb80 msgr2=0x7eff2c06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:47.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.060+0000 7eff2be00640 1 --2- 172.21.15.175:0/1487939390 >> v2:172.21.15.177:3300/0 conn(0x7eff2c15bb80 0x7eff2c06d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.060+0000 7eff2be00640 1 -- 172.21.15.175:0/1487939390 >> v1:172.21.15.177:6789/0 conn(0x7eff2c0b5880 legacy=0x7eff2c0b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.060+0000 7eff2be00640 1 -- 172.21.15.175:0/1487939390 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c0cae10 con 0x7eff2c0726f0 2024-04-25T09:13:47.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.064+0000 7eff2be00640 1 --2- 172.21.15.175:0/1487939390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff2c0726f0 0x7eff2c06dc80 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7eff2c06d660 tx=0x7eff2401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c499adf9f876926b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:47.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.064+0000 7eff2aa00640 1 -- 172.21.15.175:0/1487939390 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff240a56c0 con 0x7eff2c0726f0 2024-04-25T09:13:47.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.064+0000 7eff2aa00640 1 -- 172.21.15.175:0/1487939390 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff240a5860 con 0x7eff2c0726f0 2024-04-25T09:13:47.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.064+0000 7eff2aa00640 1 -- 172.21.15.175:0/1487939390 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff240a5c30 con 0x7eff2c0726f0 2024-04-25T09:13:47.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.064+0000 7eff32200640 1 -- 172.21.15.175:0/1487939390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff2c0726f0 msgr2=0x7eff2c06dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.064+0000 7eff32200640 1 --2- 172.21.15.175:0/1487939390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff2c0726f0 0x7eff2c06dc80 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7eff2c06d660 tx=0x7eff2401c9f0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.064+0000 7eff32200640 1 -- 172.21.15.175:0/1487939390 shutdown_connections 2024-04-25T09:13:47.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.064+0000 7eff32200640 1 --2- 172.21.15.175:0/1487939390 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff2c0726f0 0x7eff2c06dc80 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.064+0000 7eff32200640 1 --2- 172.21.15.175:0/1487939390 >> v2:172.21.15.177:3300/0 conn(0x7eff2c15bb80 0x7eff2c06d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.064+0000 7eff32200640 1 -- 172.21.15.175:0/1487939390 >> 172.21.15.175:0/1487939390 conn(0x7eff2c0cc550 msgr2=0x7eff2c0cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:47.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.064+0000 7eff32200640 1 -- 172.21.15.175:0/1487939390 shutdown_connections 2024-04-25T09:13:47.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.064+0000 7eff32200640 1 -- 172.21.15.175:0/1487939390 wait complete. 2024-04-25T09:13:47.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff32200640 1 Processor -- start 2024-04-25T09:13:47.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff32200640 1 -- start start 2024-04-25T09:13:47.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff32200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff2c0726f0 0x7eff2c1f99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff32200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff2c0b5880 0x7eff2c1565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff32200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff2c15bb80 0x7eff2c0c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff32200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c168760 con 0x7eff2c0726f0 2024-04-25T09:13:47.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff32200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c1685e0 con 0x7eff2c15bb80 2024-04-25T09:13:47.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff32200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c1688e0 con 0x7eff2c0b5880 2024-04-25T09:13:47.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff2b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff2c0726f0 0x7eff2c1f99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff2b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff2c0726f0 0x7eff2c1f99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41716/0 (socket says 172.21.15.175:41716) 2024-04-25T09:13:47.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff2b400640 1 -- 172.21.15.175:0/831469810 learned_addr learned my addr 172.21.15.175:0/831469810 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:47.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff2be00640 1 --2- 172.21.15.175:0/831469810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff2c15bb80 0x7eff2c0c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff22a00640 1 --2- 172.21.15.175:0/831469810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff2c0b5880 0x7eff2c1565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff2b400640 1 -- 172.21.15.175:0/831469810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff2c0b5880 msgr2=0x7eff2c1565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff2b400640 1 --2- 172.21.15.175:0/831469810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff2c0b5880 0x7eff2c1565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff2b400640 1 -- 172.21.15.175:0/831469810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff2c15bb80 msgr2=0x7eff2c0c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff2b400640 1 --2- 172.21.15.175:0/831469810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff2c15bb80 0x7eff2c0c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff2b400640 1 -- 172.21.15.175:0/831469810 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c156f30 con 0x7eff2c0726f0 2024-04-25T09:13:47.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff2b400640 1 --2- 172.21.15.175:0/831469810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff2c0726f0 0x7eff2c1f99d0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00e870 tx=0x7eff1c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:47.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff23e00640 1 -- 172.21.15.175:0/831469810 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c017070 con 0x7eff2c0726f0 2024-04-25T09:13:47.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff23e00640 1 -- 172.21.15.175:0/831469810 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c00c940 con 0x7eff2c0726f0 2024-04-25T09:13:47.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff23e00640 1 -- 172.21.15.175:0/831469810 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00cd10 con 0x7eff2c0726f0 2024-04-25T09:13:47.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff32200640 1 -- 172.21.15.175:0/831469810 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2c157210 con 0x7eff2c0726f0 2024-04-25T09:13:47.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff32200640 1 -- 172.21.15.175:0/831469810 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2c157ab0 con 0x7eff2c0726f0 2024-04-25T09:13:47.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.068+0000 7eff32200640 1 -- 172.21.15.175:0/831469810 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2c074a60 con 0x7eff2c0726f0 2024-04-25T09:13:47.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.072+0000 7eff23e00640 1 -- 172.21.15.175:0/831469810 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7eff1c01a070 con 0x7eff2c0726f0 2024-04-25T09:13:47.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.072+0000 7eff23e00640 1 --2- 172.21.15.175:0/831469810 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7eff08066f60 0x7eff08069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.072+0000 7eff23e00640 1 -- 172.21.15.175:0/831469810 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5881+0+0 (secure 0 0 0) 0x7eff1c0853b0 con 0x7eff2c0726f0 2024-04-25T09:13:47.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.072+0000 7eff22a00640 1 --2- 172.21.15.175:0/831469810 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7eff08066f60 0x7eff08069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.072+0000 7eff22a00640 1 --2- 172.21.15.175:0/831469810 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7eff08066f60 0x7eff08069420 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7eff2c06d880 tx=0x7eff14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:47.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.076+0000 7eff23e00640 1 -- 172.21.15.175:0/831469810 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7eff1c055c20 con 0x7eff2c0726f0 2024-04-25T09:13:47.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.236+0000 7eff32200640 1 -- 172.21.15.175:0/831469810 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff2c15eea0 con 0x7eff2c0726f0 2024-04-25T09:13:47.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.236+0000 7eff23e00640 1 -- 172.21.15.175:0/831469810 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16909 (secure 0 0 0) 0x7eff1c059cc0 con 0x7eff2c0726f0 2024-04-25T09:13:47.223 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:13:47.224 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":102,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:13:46.217312+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:12:21.141676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:12:22.422455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6837/2646458577":"2024-04-26T09:13:46.217288+0000","172.21.15.175:6835/2646458577":"2024-04-26T09:13:46.217288+0000","172.21.15.175:6837/3952378765":"2024-04-26T09:13:09.546531+0000","172.21.15.175:6835/3952378765":"2024-04-26T09:13:09.546531+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:13:47.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.236+0000 7eff32200640 1 -- 172.21.15.175:0/831469810 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7eff08066f60 msgr2=0x7eff08069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.236+0000 7eff32200640 1 --2- 172.21.15.175:0/831469810 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7eff08066f60 0x7eff08069420 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7eff2c06d880 tx=0x7eff14009040 comp rx=0 tx=0).stop 2024-04-25T09:13:47.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.236+0000 7eff32200640 1 -- 172.21.15.175:0/831469810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff2c0726f0 msgr2=0x7eff2c1f99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.236+0000 7eff32200640 1 --2- 172.21.15.175:0/831469810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff2c0726f0 0x7eff2c1f99d0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00e870 tx=0x7eff1c00ed30 comp rx=0 tx=0).stop 2024-04-25T09:13:47.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.236+0000 7eff32200640 1 -- 172.21.15.175:0/831469810 shutdown_connections 2024-04-25T09:13:47.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.236+0000 7eff32200640 1 --2- 172.21.15.175:0/831469810 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7eff08066f60 0x7eff08069420 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.236+0000 7eff32200640 1 --2- 172.21.15.175:0/831469810 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff2c15bb80 0x7eff2c0c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.236+0000 7eff32200640 1 --2- 172.21.15.175:0/831469810 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff2c0b5880 0x7eff2c1565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.236+0000 7eff32200640 1 --2- 172.21.15.175:0/831469810 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff2c0726f0 0x7eff2c1f99d0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.236+0000 7eff32200640 1 -- 172.21.15.175:0/831469810 >> 172.21.15.175:0/831469810 conn(0x7eff2c0cc550 msgr2=0x7eff2c06d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:47.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.240+0000 7eff32200640 1 -- 172.21.15.175:0/831469810 shutdown_connections 2024-04-25T09:13:47.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.240+0000 7eff32200640 1 -- 172.21.15.175:0/831469810 wait complete. 2024-04-25T09:13:47.245 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:12:21.141676+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:12:22.422455+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:13:47.245 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:13:47.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.396+0000 7fc709600640 1 Processor -- start 2024-04-25T09:13:47.384 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.396+0000 7fc709600640 1 -- start start 2024-04-25T09:13:47.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.396+0000 7fc709600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc7040cf6b0 0x7fc7041600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.396+0000 7fc709600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc7040ce970 0x7fc7040cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.396+0000 7fc709600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7040cfd10 con 0x7fc704145250 2024-04-25T09:13:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.396+0000 7fc709600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7041605e0 con 0x7fc7040cf6b0 2024-04-25T09:13:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.396+0000 7fc709600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70415f650 con 0x7fc7040ce970 2024-04-25T09:13:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.396+0000 7fc702a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc704145250 0x7fc7040cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53370/0 (socket says 172.21.15.175:53370) 2024-04-25T09:13:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.396+0000 7fc702a00640 1 -- 172.21.15.175:0/2819360898 learned_addr learned my addr 172.21.15.175:0/2819360898 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.396+0000 7fc702000640 1 --2- 172.21.15.175:0/2819360898 >> v2:172.21.15.175:3300/0 conn(0x7fc7040cf6b0 0x7fc7041600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.400+0000 7fc703400640 1 --2- 172.21.15.175:0/2819360898 >> v2:172.21.15.177:3300/0 conn(0x7fc7040ce970 0x7fc7040cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.400+0000 7fc701600640 1 -- 172.21.15.175:0/2819360898 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193601836 0 0) 0x7fc7040cfd10 con 0x7fc704145250 2024-04-25T09:13:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.400+0000 7fc701600640 1 -- 172.21.15.175:0/2819360898 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6e8003530 con 0x7fc704145250 2024-04-25T09:13:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.400+0000 7fc702000640 1 -- 172.21.15.175:0/2819360898 >> v2:172.21.15.177:3300/0 conn(0x7fc7040ce970 msgr2=0x7fc7040cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.400+0000 7fc702000640 1 --2- 172.21.15.175:0/2819360898 >> v2:172.21.15.177:3300/0 conn(0x7fc7040ce970 0x7fc7040cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.400+0000 7fc702000640 1 -- 172.21.15.175:0/2819360898 >> v1:172.21.15.175:6789/0 conn(0x7fc704145250 legacy=0x7fc7040cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.400+0000 7fc702000640 1 -- 172.21.15.175:0/2819360898 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7040cfff0 con 0x7fc7040cf6b0 2024-04-25T09:13:47.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.400+0000 7fc702000640 1 --2- 172.21.15.175:0/2819360898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7040cf6b0 0x7fc7041600a0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00097c0 tx=0x7fc6f001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f19e019bb297daa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:47.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.400+0000 7fc701600640 1 -- 172.21.15.175:0/2819360898 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f00b0070 con 0x7fc7040cf6b0 2024-04-25T09:13:47.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.400+0000 7fc701600640 1 -- 172.21.15.175:0/2819360898 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f00ab600 con 0x7fc7040cf6b0 2024-04-25T09:13:47.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.400+0000 7fc701600640 1 -- 172.21.15.175:0/2819360898 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f00ab9d0 con 0x7fc7040cf6b0 2024-04-25T09:13:47.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.400+0000 7fc709600640 1 -- 172.21.15.175:0/2819360898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7040cf6b0 msgr2=0x7fc7041600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.400+0000 7fc709600640 1 --2- 172.21.15.175:0/2819360898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7040cf6b0 0x7fc7041600a0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00097c0 tx=0x7fc6f001c3d0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc709600640 1 -- 172.21.15.175:0/2819360898 shutdown_connections 2024-04-25T09:13:47.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc709600640 1 --2- 172.21.15.175:0/2819360898 >> v2:172.21.15.177:3300/0 conn(0x7fc7040ce970 0x7fc7040cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc709600640 1 --2- 172.21.15.175:0/2819360898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7040cf6b0 0x7fc7041600a0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc709600640 1 -- 172.21.15.175:0/2819360898 >> 172.21.15.175:0/2819360898 conn(0x7fc70406ac50 msgr2=0x7fc70406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:47.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc709600640 1 -- 172.21.15.175:0/2819360898 shutdown_connections 2024-04-25T09:13:47.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc709600640 1 -- 172.21.15.175:0/2819360898 wait complete. 2024-04-25T09:13:47.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc709600640 1 Processor -- start 2024-04-25T09:13:47.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc709600640 1 -- start start 2024-04-25T09:13:47.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc709600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7040ce970 0x7fc7041652f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc709600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7040cf6b0 0x7fc7040a9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc709600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc704145250 0x7fc70406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc709600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70415c870 con 0x7fc704145250 2024-04-25T09:13:47.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc709600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc704145630 con 0x7fc7040cf6b0 2024-04-25T09:13:47.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc709600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70415c9f0 con 0x7fc7040ce970 2024-04-25T09:13:47.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc703400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc704145250 0x7fc70406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc703400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc704145250 0x7fc70406e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41724/0 (socket says 172.21.15.175:41724) 2024-04-25T09:13:47.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc703400640 1 -- 172.21.15.175:0/3591721462 learned_addr learned my addr 172.21.15.175:0/3591721462 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:47.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc702000640 1 --2- 172.21.15.175:0/3591721462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7040cf6b0 0x7fc7040a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc702a00640 1 --2- 172.21.15.175:0/3591721462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7040ce970 0x7fc7041652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc703400640 1 -- 172.21.15.175:0/3591721462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7040ce970 msgr2=0x7fc7041652f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc703400640 1 --2- 172.21.15.175:0/3591721462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7040ce970 0x7fc7041652f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc703400640 1 -- 172.21.15.175:0/3591721462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7040cf6b0 msgr2=0x7fc7040a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc703400640 1 --2- 172.21.15.175:0/3591721462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7040cf6b0 0x7fc7040a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc703400640 1 -- 172.21.15.175:0/3591721462 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7040ab170 con 0x7fc704145250 2024-04-25T09:13:47.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc702000640 1 --2- 172.21.15.175:0/3591721462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7040cf6b0 0x7fc7040a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:47.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.404+0000 7fc703400640 1 --2- 172.21.15.175:0/3591721462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc704145250 0x7fc70406e4a0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00e930 tx=0x7fc6fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:47.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.408+0000 7fc6faa00640 1 -- 172.21.15.175:0/3591721462 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc017070 con 0x7fc704145250 2024-04-25T09:13:47.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.408+0000 7fc6faa00640 1 -- 172.21.15.175:0/3591721462 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc00c9a0 con 0x7fc704145250 2024-04-25T09:13:47.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.408+0000 7fc709600640 1 -- 172.21.15.175:0/3591721462 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7040a8650 con 0x7fc704145250 2024-04-25T09:13:47.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.408+0000 7fc6faa00640 1 -- 172.21.15.175:0/3591721462 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc00cd70 con 0x7fc704145250 2024-04-25T09:13:47.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.408+0000 7fc709600640 1 -- 172.21.15.175:0/3591721462 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7040a8c10 con 0x7fc704145250 2024-04-25T09:13:47.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.408+0000 7fc709600640 1 -- 172.21.15.175:0/3591721462 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc704075160 con 0x7fc704145250 2024-04-25T09:13:47.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.408+0000 7fc6faa00640 1 -- 172.21.15.175:0/3591721462 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc6fc01a070 con 0x7fc704145250 2024-04-25T09:13:47.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.408+0000 7fc6faa00640 1 --2- 172.21.15.175:0/3591721462 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc6e4066f60 0x7fc6e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.408+0000 7fc6faa00640 1 -- 172.21.15.175:0/3591721462 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fc6fc085490 con 0x7fc704145250 2024-04-25T09:13:47.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.408+0000 7fc702a00640 1 --2- 172.21.15.175:0/3591721462 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc6e4066f60 0x7fc6e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.408+0000 7fc702a00640 1 --2- 172.21.15.175:0/3591721462 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc6e4066f60 0x7fc6e4069420 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4005c10 tx=0x7fc6f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:47.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.412+0000 7fc6faa00640 1 -- 172.21.15.175:0/3591721462 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc6fc0564a0 con 0x7fc704145250 2024-04-25T09:13:47.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.568+0000 7fc709600640 1 -- 172.21.15.175:0/3591721462 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7040cd740 con 0x7fc704145250 2024-04-25T09:13:47.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.568+0000 7fc6faa00640 1 -- 172.21.15.175:0/3591721462 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc6fc055da0 con 0x7fc704145250 2024-04-25T09:13:47.555 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:13:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.568+0000 7fc709600640 1 -- 172.21.15.175:0/3591721462 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc6e4066f60 msgr2=0x7fc6e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.568+0000 7fc709600640 1 --2- 172.21.15.175:0/3591721462 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc6e4066f60 0x7fc6e4069420 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4005c10 tx=0x7fc6f4009040 comp rx=0 tx=0).stop 2024-04-25T09:13:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.568+0000 7fc709600640 1 -- 172.21.15.175:0/3591721462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc704145250 msgr2=0x7fc70406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.568+0000 7fc709600640 1 --2- 172.21.15.175:0/3591721462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc704145250 0x7fc70406e4a0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00e930 tx=0x7fc6fc00edf0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.568+0000 7fc709600640 1 -- 172.21.15.175:0/3591721462 shutdown_connections 2024-04-25T09:13:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.568+0000 7fc709600640 1 --2- 172.21.15.175:0/3591721462 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc6e4066f60 0x7fc6e4069420 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.568+0000 7fc709600640 1 --2- 172.21.15.175:0/3591721462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc704145250 0x7fc70406e4a0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.568+0000 7fc709600640 1 --2- 172.21.15.175:0/3591721462 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7040cf6b0 0x7fc7040a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.568+0000 7fc709600640 1 --2- 172.21.15.175:0/3591721462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7040ce970 0x7fc7041652f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.568+0000 7fc709600640 1 -- 172.21.15.175:0/3591721462 >> 172.21.15.175:0/3591721462 conn(0x7fc70406ac50 msgr2=0x7fc704165fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.568+0000 7fc709600640 1 -- 172.21.15.175:0/3591721462 shutdown_connections 2024-04-25T09:13:47.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.568+0000 7fc709600640 1 -- 172.21.15.175:0/3591721462 wait complete. 2024-04-25T09:13:47.576 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:13:47.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.728+0000 7fbe94a00640 1 Processor -- start 2024-04-25T09:13:47.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.728+0000 7fbe94a00640 1 -- start start 2024-04-25T09:13:47.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.728+0000 7fbe94a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbe900cf080 0x7fbe901600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.728+0000 7fbe94a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe900cfd10 con 0x7fbe900cf6b0 2024-04-25T09:13:47.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.728+0000 7fbe94a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe900cfff0 con 0x7fbe90145250 2024-04-25T09:13:47.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.728+0000 7fbe94a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe901605e0 con 0x7fbe900cf080 2024-04-25T09:13:47.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.728+0000 7fbe85400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fbe900cf6b0 0x7fbe900ce970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53384/0 (socket says 172.21.15.175:53384) 2024-04-25T09:13:47.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.728+0000 7fbe85400640 1 -- 172.21.15.175:0/2734135568 learned_addr learned my addr 172.21.15.175:0/2734135568 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:47.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.728+0000 7fbe8e800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbe900cf080 0x7fbe901600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.728+0000 7fbe8e800640 1 -- 172.21.15.175:0/2734135568 >> v1:172.21.15.177:6789/0 conn(0x7fbe90145250 legacy=0x7fbe900cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.728+0000 7fbe8e800640 1 -- 172.21.15.175:0/2734135568 >> v1:172.21.15.175:6789/0 conn(0x7fbe900cf6b0 legacy=0x7fbe900ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.728+0000 7fbe8e800640 1 -- 172.21.15.175:0/2734135568 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9015f8a0 con 0x7fbe900cf080 2024-04-25T09:13:47.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.728+0000 7fbe8d400640 1 -- 172.21.15.175:0/2734135568 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218269829 0 0) 0x7fbe900cfd10 con 0x7fbe900cf6b0 2024-04-25T09:13:47.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.732+0000 7fbe8e800640 1 --2- 172.21.15.175:0/2734135568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe900cf080 0x7fbe901600a0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fbe880097f0 tx=0x7fbe8801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ab6544cc616521 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:47.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.732+0000 7fbe8d400640 1 -- 172.21.15.175:0/2734135568 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe880b0070 con 0x7fbe900cf080 2024-04-25T09:13:47.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.732+0000 7fbe8d400640 1 -- 172.21.15.175:0/2734135568 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe880ab600 con 0x7fbe900cf080 2024-04-25T09:13:47.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.732+0000 7fbe8d400640 1 -- 172.21.15.175:0/2734135568 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe880ab9d0 con 0x7fbe900cf080 2024-04-25T09:13:47.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.732+0000 7fbe94a00640 1 -- 172.21.15.175:0/2734135568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe900cf080 msgr2=0x7fbe901600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.732+0000 7fbe94a00640 1 --2- 172.21.15.175:0/2734135568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe900cf080 0x7fbe901600a0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fbe880097f0 tx=0x7fbe8801c410 comp rx=0 tx=0).stop 2024-04-25T09:13:47.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.732+0000 7fbe94a00640 1 -- 172.21.15.175:0/2734135568 shutdown_connections 2024-04-25T09:13:47.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.732+0000 7fbe94a00640 1 --2- 172.21.15.175:0/2734135568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe900cf080 0x7fbe901600a0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.732+0000 7fbe94a00640 1 -- 172.21.15.175:0/2734135568 >> 172.21.15.175:0/2734135568 conn(0x7fbe9006ac50 msgr2=0x7fbe9006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:47.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.732+0000 7fbe94a00640 1 -- 172.21.15.175:0/2734135568 shutdown_connections 2024-04-25T09:13:47.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.732+0000 7fbe94a00640 1 -- 172.21.15.175:0/2734135568 wait complete. 2024-04-25T09:13:47.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.732+0000 7fbe94a00640 1 Processor -- start 2024-04-25T09:13:47.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.732+0000 7fbe94a00640 1 -- start start 2024-04-25T09:13:47.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe94a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbe900cf080 0x7fbe9013c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe94a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe900cf6b0 0x7fbe900b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe94a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe90145250 0x7fbe900b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe94a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9015cc00 con 0x7fbe90145250 2024-04-25T09:13:47.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe94a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9015ca80 con 0x7fbe900cf6b0 2024-04-25T09:13:47.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe94a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe901697f0 con 0x7fbe900cf080 2024-04-25T09:13:47.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe8e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe90145250 0x7fbe900b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe8e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe90145250 0x7fbe900b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41736/0 (socket says 172.21.15.175:41736) 2024-04-25T09:13:47.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe8e800640 1 -- 172.21.15.175:0/3257140450 learned_addr learned my addr 172.21.15.175:0/3257140450 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:47.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe8e800640 1 -- 172.21.15.175:0/3257140450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbe900cf080 msgr2=0x7fbe9013c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe8e800640 1 --2- 172.21.15.175:0/3257140450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbe900cf080 0x7fbe9013c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe8e800640 1 -- 172.21.15.175:0/3257140450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe900cf6b0 msgr2=0x7fbe900b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe85400640 1 --2- 172.21.15.175:0/3257140450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe900cf6b0 0x7fbe900b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe8e800640 1 --2- 172.21.15.175:0/3257140450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe900cf6b0 0x7fbe900b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe8e800640 1 -- 172.21.15.175:0/3257140450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe900cba80 con 0x7fbe90145250 2024-04-25T09:13:47.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe85400640 1 --2- 172.21.15.175:0/3257140450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe900cf6b0 0x7fbe900b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:47.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe8e800640 1 --2- 172.21.15.175:0/3257140450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe90145250 0x7fbe900b0950 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fbe880ae040 tx=0x7fbe880191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:47.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe86a00640 1 -- 172.21.15.175:0/3257140450 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe880b0040 con 0x7fbe90145250 2024-04-25T09:13:47.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe86a00640 1 -- 172.21.15.175:0/3257140450 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe880b9070 con 0x7fbe90145250 2024-04-25T09:13:47.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe94a00640 1 -- 172.21.15.175:0/3257140450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9013c650 con 0x7fbe90145250 2024-04-25T09:13:47.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe86a00640 1 -- 172.21.15.175:0/3257140450 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe880b4630 con 0x7fbe90145250 2024-04-25T09:13:47.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe94a00640 1 -- 172.21.15.175:0/3257140450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe900adb20 con 0x7fbe90145250 2024-04-25T09:13:47.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe94a00640 1 -- 172.21.15.175:0/3257140450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe90075160 con 0x7fbe90145250 2024-04-25T09:13:47.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.736+0000 7fbe86a00640 1 -- 172.21.15.175:0/3257140450 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbe880b47d0 con 0x7fbe90145250 2024-04-25T09:13:47.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.740+0000 7fbe86a00640 1 --2- 172.21.15.175:0/3257140450 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbe6c066f60 0x7fbe6c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:47.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.740+0000 7fbe86a00640 1 -- 172.21.15.175:0/3257140450 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fbe8811eea0 con 0x7fbe90145250 2024-04-25T09:13:47.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.740+0000 7fbe8de00640 1 --2- 172.21.15.175:0/3257140450 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbe6c066f60 0x7fbe6c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:47.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.740+0000 7fbe8de00640 1 --2- 172.21.15.175:0/3257140450 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbe6c066f60 0x7fbe6c069420 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbe80007fd0 tx=0x7fbe80007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:47.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.744+0000 7fbe86a00640 1 -- 172.21.15.175:0/3257140450 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbe88016090 con 0x7fbe90145250 2024-04-25T09:13:47.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.896+0000 7fbe94a00640 1 -- 172.21.15.175:0/3257140450 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbe9006b160 con 0x7fbe90145250 2024-04-25T09:13:47.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.896+0000 7fbe86a00640 1 -- 172.21.15.175:0/3257140450 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v102) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbe880efdf0 con 0x7fbe90145250 2024-04-25T09:13:47.886 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:13:47.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.900+0000 7fbe94a00640 1 -- 172.21.15.175:0/3257140450 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbe6c066f60 msgr2=0x7fbe6c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.900+0000 7fbe94a00640 1 --2- 172.21.15.175:0/3257140450 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbe6c066f60 0x7fbe6c069420 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbe80007fd0 tx=0x7fbe80007d40 comp rx=0 tx=0).stop 2024-04-25T09:13:47.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.900+0000 7fbe94a00640 1 -- 172.21.15.175:0/3257140450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe90145250 msgr2=0x7fbe900b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:47.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.900+0000 7fbe94a00640 1 --2- 172.21.15.175:0/3257140450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe90145250 0x7fbe900b0950 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fbe880ae040 tx=0x7fbe880191b0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.900+0000 7fbe94a00640 1 -- 172.21.15.175:0/3257140450 shutdown_connections 2024-04-25T09:13:47.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.900+0000 7fbe94a00640 1 --2- 172.21.15.175:0/3257140450 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbe6c066f60 0x7fbe6c069420 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.900+0000 7fbe94a00640 1 --2- 172.21.15.175:0/3257140450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe90145250 0x7fbe900b0950 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.900+0000 7fbe94a00640 1 --2- 172.21.15.175:0/3257140450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbe900cf6b0 0x7fbe900b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.900+0000 7fbe94a00640 1 --2- 172.21.15.175:0/3257140450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbe900cf080 0x7fbe9013c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:47.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.900+0000 7fbe94a00640 1 -- 172.21.15.175:0/3257140450 >> 172.21.15.175:0/3257140450 conn(0x7fbe9006ac50 msgr2=0x7fbe9006d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:47.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.900+0000 7fbe94a00640 1 -- 172.21.15.175:0/3257140450 shutdown_connections 2024-04-25T09:13:47.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:47.900+0000 7fbe94a00640 1 -- 172.21.15.175:0/3257140450 wait complete. 2024-04-25T09:13:47.907 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:13:48.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f2727a00640 1 Processor -- start 2024-04-25T09:13:48.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f2727a00640 1 -- start start 2024-04-25T09:13:48.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f2727a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2720145250 0x7f27200cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f2727a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27200cfd10 con 0x7f27201600a0 2024-04-25T09:13:48.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f2727a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27200cfff0 con 0x7f27200ce970 2024-04-25T09:13:48.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f2727a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272015f650 con 0x7f2720145250 2024-04-25T09:13:48.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271fe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f27201600a0 0x7f27200cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53394/0 (socket says 172.21.15.175:53394) 2024-04-25T09:13:48.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271fe00640 1 -- 172.21.15.175:0/2701884678 learned_addr learned my addr 172.21.15.175:0/2701884678 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:48.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f2725000640 1 --2- 172.21.15.175:0/2701884678 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2720145250 0x7f27200cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271f400640 1 -- 172.21.15.175:0/2701884678 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70610608 0 0) 0x7f27200cfd10 con 0x7f27201600a0 2024-04-25T09:13:48.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271f400640 1 -- 172.21.15.175:0/2701884678 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2708003530 con 0x7f27201600a0 2024-04-25T09:13:48.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271f400640 1 -- 172.21.15.175:0/2701884678 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3593391529 0 0) 0x7f2708003530 con 0x7f27201600a0 2024-04-25T09:13:48.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271f400640 1 -- 172.21.15.175:0/2701884678 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2720145250 msgr2=0x7f27200cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:48.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271f400640 1 --2- 172.21.15.175:0/2701884678 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2720145250 0x7f27200cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271f400640 1 -- 172.21.15.175:0/2701884678 >> v1:172.21.15.177:6789/0 conn(0x7f27200ce970 legacy=0x7f27200cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271f400640 1 -- 172.21.15.175:0/2701884678 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272015f8a0 con 0x7f27201600a0 2024-04-25T09:13:48.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271f400640 1 -- 172.21.15.175:0/2701884678 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f270c001680 con 0x7f27201600a0 2024-04-25T09:13:48.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271f400640 1 -- 172.21.15.175:0/2701884678 >> v1:172.21.15.175:6789/0 conn(0x7f27201600a0 legacy=0x7f27200cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271f400640 1 --2- 172.21.15.175:0/2701884678 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2720145250 0x7f27080039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271f400640 1 --2- 172.21.15.175:0/2701884678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2708003f70 0x7f2708004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271f400640 1 --2- 172.21.15.175:0/2701884678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2708004d50 0x7f27080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271f400640 1 -- 172.21.15.175:0/2701884678 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272015f650 con 0x7f2708003f70 2024-04-25T09:13:48.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271f400640 1 -- 172.21.15.175:0/2701884678 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270800bc10 con 0x7f2708004d50 2024-04-25T09:13:48.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271f400640 1 -- 172.21.15.175:0/2701884678 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270800be10 con 0x7f2720145250 2024-04-25T09:13:48.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271fe00640 1 --2- 172.21.15.175:0/2701884678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2708003f70 0x7f2708004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f2725a00640 1 --2- 172.21.15.175:0/2701884678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2708004d50 0x7f27080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f2725000640 1 --2- 172.21.15.175:0/2701884678 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2720145250 0x7f27080039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271fe00640 1 -- 172.21.15.175:0/2701884678 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2720145250 msgr2=0x7f27080039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:48.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271fe00640 1 --2- 172.21.15.175:0/2701884678 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2720145250 0x7f27080039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271fe00640 1 -- 172.21.15.175:0/2701884678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2708004d50 msgr2=0x7f27080051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:48.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271fe00640 1 --2- 172.21.15.175:0/2701884678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2708004d50 0x7f27080051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f271fe00640 1 -- 172.21.15.175:0/2701884678 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2708003530 con 0x7f2708003f70 2024-04-25T09:13:48.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.060+0000 7f2725a00640 1 --2- 172.21.15.175:0/2701884678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2708004d50 0x7f27080051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:48.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.064+0000 7f271fe00640 1 --2- 172.21.15.175:0/2701884678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2708003f70 0x7f2708004810 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f270c00c1c0 tx=0x7f270c01cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5e1d973a59761f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:48.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.064+0000 7f271f400640 1 -- 172.21.15.175:0/2701884678 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c007d00 con 0x7f2708003f70 2024-04-25T09:13:48.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.064+0000 7f271f400640 1 -- 172.21.15.175:0/2701884678 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c0a9020 con 0x7f2708003f70 2024-04-25T09:13:48.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.064+0000 7f271f400640 1 -- 172.21.15.175:0/2701884678 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c005ae0 con 0x7f2708003f70 2024-04-25T09:13:48.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.064+0000 7f2727a00640 1 -- 172.21.15.175:0/2701884678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2708003f70 msgr2=0x7f2708004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.064+0000 7f2727a00640 1 --2- 172.21.15.175:0/2701884678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2708003f70 0x7f2708004810 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f270c00c1c0 tx=0x7f270c01cc30 comp rx=0 tx=0).stop 2024-04-25T09:13:48.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.064+0000 7f2725a00640 1 -- 172.21.15.175:0/2701884678 reap_dead start 2024-04-25T09:13:48.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.064+0000 7f2727a00640 1 -- 172.21.15.175:0/2701884678 shutdown_connections 2024-04-25T09:13:48.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.064+0000 7f2727a00640 1 -- 172.21.15.175:0/2701884678 >> 172.21.15.175:0/2701884678 conn(0x7f272006ac50 msgr2=0x7f272006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:48.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.064+0000 7f2727a00640 1 -- 172.21.15.175:0/2701884678 shutdown_connections 2024-04-25T09:13:48.053 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.064+0000 7f2727a00640 1 -- 172.21.15.175:0/2701884678 wait complete. 2024-04-25T09:13:48.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f2727a00640 1 Processor -- start 2024-04-25T09:13:48.054 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f2727a00640 1 -- start start 2024-04-25T09:13:48.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f2727a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2708003f70 0x7f2720143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f2727a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27200c4640 0x7f27201358f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f2727a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27200b3780 0x7f27200b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f2727a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272015c9f0 con 0x7f27200c4640 2024-04-25T09:13:48.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f2727a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272015c870 con 0x7f2708003f70 2024-04-25T09:13:48.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f2727a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272015cb70 con 0x7f27200b3780 2024-04-25T09:13:48.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f271fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27200c4640 0x7f27201358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f271fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27200c4640 0x7f27201358f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41750/0 (socket says 172.21.15.175:41750) 2024-04-25T09:13:48.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f271fe00640 1 -- 172.21.15.175:0/2454150670 learned_addr learned my addr 172.21.15.175:0/2454150670 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:48.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f2725000640 1 --2- 172.21.15.175:0/2454150670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2708003f70 0x7f2720143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f2725a00640 1 --2- 172.21.15.175:0/2454150670 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27200b3780 0x7f27200b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f271fe00640 1 -- 172.21.15.175:0/2454150670 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27200b3780 msgr2=0x7f27200b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f271fe00640 1 --2- 172.21.15.175:0/2454150670 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27200b3780 0x7f27200b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f271fe00640 1 -- 172.21.15.175:0/2454150670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2708003f70 msgr2=0x7f2720143600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f271fe00640 1 --2- 172.21.15.175:0/2454150670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2708003f70 0x7f2720143600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f271fe00640 1 -- 172.21.15.175:0/2454150670 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27200ae030 con 0x7f27200c4640 2024-04-25T09:13:48.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f2725000640 1 --2- 172.21.15.175:0/2454150670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2708003f70 0x7f2720143600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:48.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f271fe00640 1 --2- 172.21.15.175:0/2454150670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27200c4640 0x7f27201358f0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f270c007040 tx=0x7f2708005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:48.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f271cc00640 1 -- 172.21.15.175:0/2454150670 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c007d00 con 0x7f27200c4640 2024-04-25T09:13:48.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f271cc00640 1 -- 172.21.15.175:0/2454150670 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c001440 con 0x7f27200c4640 2024-04-25T09:13:48.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f2727a00640 1 -- 172.21.15.175:0/2454150670 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27200ada70 con 0x7f27200c4640 2024-04-25T09:13:48.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f271cc00640 1 -- 172.21.15.175:0/2454150670 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c001c40 con 0x7f27200c4640 2024-04-25T09:13:48.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f2727a00640 1 -- 172.21.15.175:0/2454150670 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27200c4ac0 con 0x7f27200c4640 2024-04-25T09:13:48.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.068+0000 7f2727a00640 1 -- 172.21.15.175:0/2454150670 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2720075160 con 0x7f27200c4640 2024-04-25T09:13:48.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.072+0000 7f271cc00640 1 -- 172.21.15.175:0/2454150670 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f270c0a5820 con 0x7f27200c4640 2024-04-25T09:13:48.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.072+0000 7f271cc00640 1 --2- 172.21.15.175:0/2454150670 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2700066f60 0x7f2700069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.072+0000 7f271cc00640 1 -- 172.21.15.175:0/2454150670 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f270c11ea10 con 0x7f27200c4640 2024-04-25T09:13:48.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.072+0000 7f2725000640 1 --2- 172.21.15.175:0/2454150670 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2700066f60 0x7f2700069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.072+0000 7f2725000640 1 --2- 172.21.15.175:0/2454150670 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2700066f60 0x7f2700069420 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2714009af0 tx=0x7f2714008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:48.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.076+0000 7f271cc00640 1 -- 172.21.15.175:0/2454150670 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f270c016970 con 0x7f27200c4640 2024-04-25T09:13:48.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.232+0000 7f2727a00640 1 -- 172.21.15.175:0/2454150670 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27200ce2e0 con 0x7f27200c4640 2024-04-25T09:13:48.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.232+0000 7f271cc00640 1 -- 172.21.15.175:0/2454150670 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v102) v1 ==== 100+0+11 (secure 0 0 0) 0x7f270c0ef960 con 0x7f27200c4640 2024-04-25T09:13:48.219 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:13:48.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.232+0000 7f2727a00640 1 -- 172.21.15.175:0/2454150670 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2700066f60 msgr2=0x7f2700069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.232+0000 7f2727a00640 1 --2- 172.21.15.175:0/2454150670 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2700066f60 0x7f2700069420 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2714009af0 tx=0x7f2714008040 comp rx=0 tx=0).stop 2024-04-25T09:13:48.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.232+0000 7f2727a00640 1 -- 172.21.15.175:0/2454150670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27200c4640 msgr2=0x7f27201358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.232+0000 7f2727a00640 1 --2- 172.21.15.175:0/2454150670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27200c4640 0x7f27201358f0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f270c007040 tx=0x7f2708005840 comp rx=0 tx=0).stop 2024-04-25T09:13:48.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.232+0000 7f2727a00640 1 -- 172.21.15.175:0/2454150670 shutdown_connections 2024-04-25T09:13:48.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.232+0000 7f2727a00640 1 --2- 172.21.15.175:0/2454150670 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2700066f60 0x7f2700069420 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.232+0000 7f2727a00640 1 --2- 172.21.15.175:0/2454150670 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27200b3780 0x7f27200b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.232+0000 7f2727a00640 1 --2- 172.21.15.175:0/2454150670 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27200c4640 0x7f27201358f0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.232+0000 7f2727a00640 1 --2- 172.21.15.175:0/2454150670 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2708003f70 0x7f2720143600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.232+0000 7f2727a00640 1 -- 172.21.15.175:0/2454150670 >> 172.21.15.175:0/2454150670 conn(0x7f272006ac50 msgr2=0x7f2720144520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:48.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.232+0000 7f2727a00640 1 -- 172.21.15.175:0/2454150670 shutdown_connections 2024-04-25T09:13:48.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.232+0000 7f2727a00640 1 -- 172.21.15.175:0/2454150670 wait complete. 2024-04-25T09:13:48.240 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:48.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.388+0000 7fcd99c00640 1 Processor -- start 2024-04-25T09:13:48.375 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.388+0000 7fcd99c00640 1 -- start start 2024-04-25T09:13:48.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.388+0000 7fcd99c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd9415bc10 0x7fcd940cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.388+0000 7fcd99c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcd9409abb0 0x7fcd940cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.388+0000 7fcd99c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd940cc4c0 con 0x7fcd94099a50 2024-04-25T09:13:48.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.388+0000 7fcd99c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd940d06f0 con 0x7fcd9409abb0 2024-04-25T09:13:48.376 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.388+0000 7fcd99c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940cc7a0 con 0x7fcd9415bc10 2024-04-25T09:13:48.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.388+0000 7fcd93400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcd9409abb0 0x7fcd940cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.388+0000 7fcd8a000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd9415bc10 0x7fcd940cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.388+0000 7fcd8a000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd9415bc10 0x7fcd940cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:32982/0 (socket says 172.21.15.175:32982) 2024-04-25T09:13:48.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.388+0000 7fcd92a00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fcd94099a50 0x7fcd94099e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:51962/0 (socket says 172.21.15.175:51962) 2024-04-25T09:13:48.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.388+0000 7fcd8a000640 1 -- 172.21.15.175:0/445504514 learned_addr learned my addr 172.21.15.175:0/445504514 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:48.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.392+0000 7fcd8a000640 1 -- 172.21.15.175:0/445504514 >> v2:172.21.15.177:3300/0 conn(0x7fcd9409abb0 msgr2=0x7fcd940cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:48.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.392+0000 7fcd8a000640 1 --2- 172.21.15.175:0/445504514 >> v2:172.21.15.177:3300/0 conn(0x7fcd9409abb0 0x7fcd940cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.392+0000 7fcd8a000640 1 -- 172.21.15.175:0/445504514 >> v1:172.21.15.177:6789/0 conn(0x7fcd94099a50 legacy=0x7fcd94099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.392+0000 7fcd8a000640 1 -- 172.21.15.175:0/445504514 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd940cca80 con 0x7fcd9415bc10 2024-04-25T09:13:48.378 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.392+0000 7fcd93400640 1 --2- 172.21.15.175:0/445504514 >> v2:172.21.15.177:3300/0 conn(0x7fcd9409abb0 0x7fcd940cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:48.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.392+0000 7fcd8a000640 1 --2- 172.21.15.175:0/445504514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd9415bc10 0x7fcd940cd280 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009870 tx=0x7fcd7c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a97faa81d32a48fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:48.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.392+0000 7fcd92000640 1 -- 172.21.15.175:0/445504514 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0a7070 con 0x7fcd9415bc10 2024-04-25T09:13:48.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.392+0000 7fcd92000640 1 -- 172.21.15.175:0/445504514 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd7c0b0070 con 0x7fcd9415bc10 2024-04-25T09:13:48.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.392+0000 7fcd92000640 1 -- 172.21.15.175:0/445504514 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0ab890 con 0x7fcd9415bc10 2024-04-25T09:13:48.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.392+0000 7fcd99c00640 1 -- 172.21.15.175:0/445504514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd9415bc10 msgr2=0x7fcd940cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.392+0000 7fcd99c00640 1 --2- 172.21.15.175:0/445504514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd9415bc10 0x7fcd940cd280 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c009870 tx=0x7fcd7c01c560 comp rx=0 tx=0).stop 2024-04-25T09:13:48.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.392+0000 7fcd99c00640 1 -- 172.21.15.175:0/445504514 shutdown_connections 2024-04-25T09:13:48.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.392+0000 7fcd99c00640 1 --2- 172.21.15.175:0/445504514 >> v2:172.21.15.177:3300/0 conn(0x7fcd9409abb0 0x7fcd940cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.392+0000 7fcd99c00640 1 --2- 172.21.15.175:0/445504514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd9415bc10 0x7fcd940cd280 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.392+0000 7fcd99c00640 1 -- 172.21.15.175:0/445504514 >> 172.21.15.175:0/445504514 conn(0x7fcd940b3300 msgr2=0x7fcd940b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:48.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.392+0000 7fcd99c00640 1 -- 172.21.15.175:0/445504514 shutdown_connections 2024-04-25T09:13:48.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.392+0000 7fcd99c00640 1 -- 172.21.15.175:0/445504514 wait complete. 2024-04-25T09:13:48.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd99c00640 1 Processor -- start 2024-04-25T09:13:48.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd99c00640 1 -- start start 2024-04-25T09:13:48.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd99c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd94099a50 0x7fcd9414e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd99c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd9409abb0 0x7fcd9414f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd99c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd9415bc10 0x7fcd9414f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd99c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940c5f00 con 0x7fcd94099a50 2024-04-25T09:13:48.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd99c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940c5d80 con 0x7fcd9415bc10 2024-04-25T09:13:48.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd99c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd94168850 con 0x7fcd9409abb0 2024-04-25T09:13:48.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd92a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd94099a50 0x7fcd9414e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd92a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd94099a50 0x7fcd9414e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41758/0 (socket says 172.21.15.175:41758) 2024-04-25T09:13:48.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd92a00640 1 -- 172.21.15.175:0/1231572691 learned_addr learned my addr 172.21.15.175:0/1231572691 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:48.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd8a000640 1 --2- 172.21.15.175:0/1231572691 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd9409abb0 0x7fcd9414f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd93400640 1 --2- 172.21.15.175:0/1231572691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd9415bc10 0x7fcd9414f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd92a00640 1 -- 172.21.15.175:0/1231572691 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd9409abb0 msgr2=0x7fcd9414f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd92a00640 1 --2- 172.21.15.175:0/1231572691 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd9409abb0 0x7fcd9414f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd92a00640 1 -- 172.21.15.175:0/1231572691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd9415bc10 msgr2=0x7fcd9414f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd92a00640 1 --2- 172.21.15.175:0/1231572691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd9415bc10 0x7fcd9414f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd92a00640 1 -- 172.21.15.175:0/1231572691 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd94067580 con 0x7fcd94099a50 2024-04-25T09:13:48.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd92a00640 1 --2- 172.21.15.175:0/1231572691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd94099a50 0x7fcd9414e880 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fcd8400c7c0 tx=0x7fcd8400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:48.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd8b400640 1 -- 172.21.15.175:0/1231572691 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd84017070 con 0x7fcd94099a50 2024-04-25T09:13:48.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd8b400640 1 -- 172.21.15.175:0/1231572691 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8400ce10 con 0x7fcd94099a50 2024-04-25T09:13:48.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd8b400640 1 -- 172.21.15.175:0/1231572691 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8400a840 con 0x7fcd94099a50 2024-04-25T09:13:48.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd99c00640 1 -- 172.21.15.175:0/1231572691 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd941545c0 con 0x7fcd94099a50 2024-04-25T09:13:48.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.396+0000 7fcd99c00640 1 -- 172.21.15.175:0/1231572691 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9414fea0 con 0x7fcd94099a50 2024-04-25T09:13:48.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.400+0000 7fcd99c00640 1 -- 172.21.15.175:0/1231572691 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd94074a60 con 0x7fcd94099a50 2024-04-25T09:13:48.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.400+0000 7fcd8b400640 1 -- 172.21.15.175:0/1231572691 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcd8401a070 con 0x7fcd94099a50 2024-04-25T09:13:48.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.400+0000 7fcd8b400640 1 --2- 172.21.15.175:0/1231572691 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd70066f60 0x7fcd70069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.400+0000 7fcd8b400640 1 -- 172.21.15.175:0/1231572691 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fcd84084690 con 0x7fcd94099a50 2024-04-25T09:13:48.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.400+0000 7fcd8a000640 1 --2- 172.21.15.175:0/1231572691 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd70066f60 0x7fcd70069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.400+0000 7fcd8a000640 1 --2- 172.21.15.175:0/1231572691 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd70066f60 0x7fcd70069420 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0af000 tx=0x7fcd7c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:48.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.404+0000 7fcd8b400640 1 -- 172.21.15.175:0/1231572691 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcd84054e70 con 0x7fcd94099a50 2024-04-25T09:13:48.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.588+0000 7fcd99c00640 1 -- 172.21.15.175:0/1231572691 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd940b7670 con 0x7fcd94099a50 2024-04-25T09:13:48.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.588+0000 7fcd8b400640 1 -- 172.21.15.175:0/1231572691 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fcd84058f10 con 0x7fcd94099a50 2024-04-25T09:13:48.577 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:13:48.577 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":86,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6998,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3519467288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3519467288},{"type":"v1","addr":"172.21.15.177:6834","nonce":3519467288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2181426238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2181426238},{"type":"v1","addr":"172.21.15.177:6835","nonce":2181426238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/936884340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":936884340},{"type":"v1","addr":"172.21.15.175:6836","nonce":936884340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8547,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2116018062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2116018062},{"type":"v1","addr":"172.21.15.175:6837","nonce":2116018062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":85,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:23.414911+0000","modified":"2024-04-25T09:13:46.217300+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:13:48.577 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 86 2024-04-25T09:13:48.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.592+0000 7fcd99c00640 1 -- 172.21.15.175:0/1231572691 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd70066f60 msgr2=0x7fcd70069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.592+0000 7fcd99c00640 1 --2- 172.21.15.175:0/1231572691 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd70066f60 0x7fcd70069420 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0af000 tx=0x7fcd7c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:13:48.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.592+0000 7fcd99c00640 1 -- 172.21.15.175:0/1231572691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd94099a50 msgr2=0x7fcd9414e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.592+0000 7fcd99c00640 1 --2- 172.21.15.175:0/1231572691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd94099a50 0x7fcd9414e880 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fcd8400c7c0 tx=0x7fcd8400cbc0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.592+0000 7fcd99c00640 1 -- 172.21.15.175:0/1231572691 shutdown_connections 2024-04-25T09:13:48.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.592+0000 7fcd99c00640 1 --2- 172.21.15.175:0/1231572691 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fcd70066f60 0x7fcd70069420 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.592+0000 7fcd99c00640 1 --2- 172.21.15.175:0/1231572691 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcd9415bc10 0x7fcd9414f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.592+0000 7fcd99c00640 1 --2- 172.21.15.175:0/1231572691 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcd9409abb0 0x7fcd9414f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.592+0000 7fcd99c00640 1 --2- 172.21.15.175:0/1231572691 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd94099a50 0x7fcd9414e880 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.592+0000 7fcd99c00640 1 -- 172.21.15.175:0/1231572691 >> 172.21.15.175:0/1231572691 conn(0x7fcd940b3300 msgr2=0x7fcd940c6500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:48.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.592+0000 7fcd99c00640 1 -- 172.21.15.175:0/1231572691 shutdown_connections 2024-04-25T09:13:48.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.592+0000 7fcd99c00640 1 -- 172.21.15.175:0/1231572691 wait complete. 2024-04-25T09:13:48.599 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:13:48.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.744+0000 7f3872600640 1 Processor -- start 2024-04-25T09:13:48.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.744+0000 7f3872600640 1 -- start start 2024-04-25T09:13:48.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.748+0000 7f3872600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f386c06dd30 0x7f386c0cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.748+0000 7f3872600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386c06e270 con 0x7f386c071950 2024-04-25T09:13:48.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.748+0000 7f3872600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386c06e550 con 0x7f386c1452f0 2024-04-25T09:13:48.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.748+0000 7f3872600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386c0cc2c0 con 0x7f386c06dd30 2024-04-25T09:13:48.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.748+0000 7f386aa00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f386c071950 0x7f386c06d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:53402/0 (socket says 172.21.15.175:53402) 2024-04-25T09:13:48.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.748+0000 7f386aa00640 1 -- 172.21.15.175:0/2742556319 learned_addr learned my addr 172.21.15.175:0/2742556319 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:48.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.748+0000 7f386be00640 1 --2- 172.21.15.175:0/2742556319 >> v2:172.21.15.175:3300/0 conn(0x7f386c06dd30 0x7f386c0cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.748+0000 7f386a000640 1 -- 172.21.15.175:0/2742556319 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10805509 0 0) 0x7f386c06e270 con 0x7f386c071950 2024-04-25T09:13:48.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.748+0000 7f386a000640 1 -- 172.21.15.175:0/2742556319 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3850003530 con 0x7f386c071950 2024-04-25T09:13:48.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.748+0000 7f386be00640 1 -- 172.21.15.175:0/2742556319 >> v1:172.21.15.177:6789/0 conn(0x7f386c1452f0 legacy=0x7f386c071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.748+0000 7f386be00640 1 -- 172.21.15.175:0/2742556319 >> v1:172.21.15.175:6789/0 conn(0x7f386c071950 legacy=0x7f386c06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.748+0000 7f386be00640 1 -- 172.21.15.175:0/2742556319 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c06e830 con 0x7f386c06dd30 2024-04-25T09:13:48.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.752+0000 7f386be00640 1 --2- 172.21.15.175:0/2742556319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f386c06dd30 0x7f386c0cf6e0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f3864009d90 tx=0x7f386401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34aed8c0b3b09c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:48.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.752+0000 7f386a000640 1 -- 172.21.15.175:0/2742556319 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640b2070 con 0x7f386c06dd30 2024-04-25T09:13:48.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.752+0000 7f386a000640 1 -- 172.21.15.175:0/2742556319 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38640a5940 con 0x7f386c06dd30 2024-04-25T09:13:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.752+0000 7f386a000640 1 -- 172.21.15.175:0/2742556319 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640a5d10 con 0x7f386c06dd30 2024-04-25T09:13:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.752+0000 7f3872600640 1 -- 172.21.15.175:0/2742556319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f386c06dd30 msgr2=0x7f386c0cf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.752+0000 7f3872600640 1 --2- 172.21.15.175:0/2742556319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f386c06dd30 0x7f386c0cf6e0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f3864009d90 tx=0x7f386401c970 comp rx=0 tx=0).stop 2024-04-25T09:13:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.752+0000 7f3872600640 1 -- 172.21.15.175:0/2742556319 shutdown_connections 2024-04-25T09:13:48.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.752+0000 7f3872600640 1 --2- 172.21.15.175:0/2742556319 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f386c06dd30 0x7f386c0cf6e0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.752+0000 7f3872600640 1 -- 172.21.15.175:0/2742556319 >> 172.21.15.175:0/2742556319 conn(0x7f386c067150 msgr2=0x7f386c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:48.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.752+0000 7f3872600640 1 -- 172.21.15.175:0/2742556319 shutdown_connections 2024-04-25T09:13:48.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.752+0000 7f3872600640 1 -- 172.21.15.175:0/2742556319 wait complete. 2024-04-25T09:13:48.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.752+0000 7f3872600640 1 Processor -- start 2024-04-25T09:13:48.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.752+0000 7f3872600640 1 -- start start 2024-04-25T09:13:48.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f3872600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f386c071950 0x7f386c140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f3872600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f386c1452f0 0x7f386c141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f3872600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f386c1f7b80 0x7f386c1f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f3872600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c169260 con 0x7f386c1f7b80 2024-04-25T09:13:48.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f3872600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c1690e0 con 0x7f386c1452f0 2024-04-25T09:13:48.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f3872600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386c1693e0 con 0x7f386c071950 2024-04-25T09:13:48.743 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f386be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f386c1f7b80 0x7f386c1f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f386be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f386c1f7b80 0x7f386c1f7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41778/0 (socket says 172.21.15.175:41778) 2024-04-25T09:13:48.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f386be00640 1 -- 172.21.15.175:0/4270819843 learned_addr learned my addr 172.21.15.175:0/4270819843 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:48.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f386aa00640 1 --2- 172.21.15.175:0/4270819843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f386c1452f0 0x7f386c141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f386b400640 1 --2- 172.21.15.175:0/4270819843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f386c071950 0x7f386c140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f386be00640 1 -- 172.21.15.175:0/4270819843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f386c071950 msgr2=0x7f386c140b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f386be00640 1 --2- 172.21.15.175:0/4270819843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f386c071950 0x7f386c140b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f386be00640 1 -- 172.21.15.175:0/4270819843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f386c1452f0 msgr2=0x7f386c141090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f386be00640 1 --2- 172.21.15.175:0/4270819843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f386c1452f0 0x7f386c141090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f386be00640 1 -- 172.21.15.175:0/4270819843 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c141710 con 0x7f386c1f7b80 2024-04-25T09:13:48.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f386be00640 1 --2- 172.21.15.175:0/4270819843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f386c1f7b80 0x7f386c1f7ff0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f38640b0040 tx=0x7f3864019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:48.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f3863400640 1 -- 172.21.15.175:0/4270819843 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640b2050 con 0x7f386c1f7b80 2024-04-25T09:13:48.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f3863400640 1 -- 172.21.15.175:0/4270819843 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38640be070 con 0x7f386c1f7b80 2024-04-25T09:13:48.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f3863400640 1 -- 172.21.15.175:0/4270819843 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640adab0 con 0x7f386c1f7b80 2024-04-25T09:13:48.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f3872600640 1 -- 172.21.15.175:0/4270819843 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386c1419f0 con 0x7f386c1f7b80 2024-04-25T09:13:48.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f3872600640 1 -- 172.21.15.175:0/4270819843 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386c141fb0 con 0x7f386c1f7b80 2024-04-25T09:13:48.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f3872600640 1 -- 172.21.15.175:0/4270819843 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386c074a60 con 0x7f386c1f7b80 2024-04-25T09:13:48.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.756+0000 7f3863400640 1 -- 172.21.15.175:0/4270819843 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f38640adc50 con 0x7f386c1f7b80 2024-04-25T09:13:48.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.760+0000 7f3863400640 1 --2- 172.21.15.175:0/4270819843 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f384c066f90 0x7f384c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:48.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.760+0000 7f3863400640 1 -- 172.21.15.175:0/4270819843 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f3864120300 con 0x7f386c1f7b80 2024-04-25T09:13:48.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.760+0000 7f386b400640 1 --2- 172.21.15.175:0/4270819843 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f384c066f90 0x7f384c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:48.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.760+0000 7f386b400640 1 --2- 172.21.15.175:0/4270819843 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f384c066f90 0x7f384c069450 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f385c0015b0 tx=0x7f385c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:48.750 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.764+0000 7f3863400640 1 -- 172.21.15.175:0/4270819843 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3864016560 con 0x7f386c1f7b80 2024-04-25T09:13:48.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.916+0000 7f3872600640 1 -- 172.21.15.175:0/4270819843 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f386c0b2460 con 0x7f386c1f7b80 2024-04-25T09:13:48.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.916+0000 7f3863400640 1 -- 172.21.15.175:0/4270819843 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16909 (secure 0 0 0) 0x7f38640f1250 con 0x7f386c1f7b80 2024-04-25T09:13:48.905 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:13:48.905 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":102,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:13:46.217312+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:12:21.141676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:12:22.422455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6837/2646458577":"2024-04-26T09:13:46.217288+0000","172.21.15.175:6835/2646458577":"2024-04-26T09:13:46.217288+0000","172.21.15.175:6837/3952378765":"2024-04-26T09:13:09.546531+0000","172.21.15.175:6835/3952378765":"2024-04-26T09:13:09.546531+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:13:48.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.920+0000 7f3872600640 1 -- 172.21.15.175:0/4270819843 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f384c066f90 msgr2=0x7f384c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.920+0000 7f3872600640 1 --2- 172.21.15.175:0/4270819843 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f384c066f90 0x7f384c069450 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f385c0015b0 tx=0x7f385c009040 comp rx=0 tx=0).stop 2024-04-25T09:13:48.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.920+0000 7f3872600640 1 -- 172.21.15.175:0/4270819843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f386c1f7b80 msgr2=0x7f386c1f7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:48.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.920+0000 7f3872600640 1 --2- 172.21.15.175:0/4270819843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f386c1f7b80 0x7f386c1f7ff0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f38640b0040 tx=0x7f3864019710 comp rx=0 tx=0).stop 2024-04-25T09:13:48.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.920+0000 7f3872600640 1 -- 172.21.15.175:0/4270819843 shutdown_connections 2024-04-25T09:13:48.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.920+0000 7f3872600640 1 --2- 172.21.15.175:0/4270819843 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f384c066f90 0x7f384c069450 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.920+0000 7f3872600640 1 --2- 172.21.15.175:0/4270819843 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f386c1f7b80 0x7f386c1f7ff0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.920+0000 7f3872600640 1 --2- 172.21.15.175:0/4270819843 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f386c1452f0 0x7f386c141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.920+0000 7f3872600640 1 --2- 172.21.15.175:0/4270819843 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f386c071950 0x7f386c140b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:48.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.920+0000 7f3872600640 1 -- 172.21.15.175:0/4270819843 >> 172.21.15.175:0/4270819843 conn(0x7f386c06dd30 msgr2=0x7f386c13c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:48.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.920+0000 7f3872600640 1 -- 172.21.15.175:0/4270819843 shutdown_connections 2024-04-25T09:13:48.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:48.920+0000 7f3872600640 1 -- 172.21.15.175:0/4270819843 wait complete. 2024-04-25T09:13:48.927 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:13:48.927 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:49.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.076+0000 7fc25fc00640 1 Processor -- start 2024-04-25T09:13:49.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.076+0000 7fc25fc00640 1 -- start start 2024-04-25T09:13:49.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.076+0000 7fc25fc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2580cd520 0x7fc25806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.076+0000 7fc25fc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc2580cf560 0x7fc2580cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.076+0000 7fc25fc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2580cda00 con 0x7fc25815a900 2024-04-25T09:13:49.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.076+0000 7fc25fc00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc25815bcf0 con 0x7fc2580cf560 2024-04-25T09:13:49.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.076+0000 7fc25fc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2580cfef0 con 0x7fc2580cd520 2024-04-25T09:13:49.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.076+0000 7fc25dc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc2580cf560 0x7fc2580cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.076+0000 7fc25dc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc2580cf560 0x7fc2580cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41788/0 (socket says 172.21.15.175:41788) 2024-04-25T09:13:49.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.076+0000 7fc25dc00640 1 -- 172.21.15.175:0/216062558 learned_addr learned my addr 172.21.15.175:0/216062558 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:49.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.076+0000 7fc24fe00640 1 --2- 172.21.15.175:0/216062558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2580cd520 0x7fc25806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.076+0000 7fc25dc00640 1 -- 172.21.15.175:0/216062558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2580cd520 msgr2=0x7fc25806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:49.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.076+0000 7fc25dc00640 1 --2- 172.21.15.175:0/216062558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2580cd520 0x7fc25806e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.076+0000 7fc25dc00640 1 -- 172.21.15.175:0/216062558 >> v1:172.21.15.177:6789/0 conn(0x7fc25815a900 legacy=0x7fc2580ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.076+0000 7fc25dc00640 1 -- 172.21.15.175:0/216062558 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2580cdce0 con 0x7fc2580cf560 2024-04-25T09:13:49.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.076+0000 7fc24fe00640 1 --2- 172.21.15.175:0/216062558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2580cd520 0x7fc25806e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:49.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.080+0000 7fc25dc00640 1 --2- 172.21.15.175:0/216062558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2580cf560 0x7fc2580cf9b0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fc25000d150 tx=0x7fc25001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8336bb46efa98803 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:49.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.080+0000 7fc257e00640 1 -- 172.21.15.175:0/216062558 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25000b2d0 con 0x7fc2580cf560 2024-04-25T09:13:49.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.080+0000 7fc257e00640 1 -- 172.21.15.175:0/216062558 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25000b470 con 0x7fc2580cf560 2024-04-25T09:13:49.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.080+0000 7fc257e00640 1 -- 172.21.15.175:0/216062558 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2500a7c10 con 0x7fc2580cf560 2024-04-25T09:13:49.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.080+0000 7fc25fc00640 1 -- 172.21.15.175:0/216062558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2580cf560 msgr2=0x7fc2580cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.080+0000 7fc25fc00640 1 --2- 172.21.15.175:0/216062558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2580cf560 0x7fc2580cf9b0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fc25000d150 tx=0x7fc25001ec30 comp rx=0 tx=0).stop 2024-04-25T09:13:49.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.080+0000 7fc25fc00640 1 -- 172.21.15.175:0/216062558 shutdown_connections 2024-04-25T09:13:49.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.080+0000 7fc25fc00640 1 --2- 172.21.15.175:0/216062558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2580cf560 0x7fc2580cf9b0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.080+0000 7fc25fc00640 1 --2- 172.21.15.175:0/216062558 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc2580cd520 0x7fc25806e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.080+0000 7fc25fc00640 1 -- 172.21.15.175:0/216062558 >> 172.21.15.175:0/216062558 conn(0x7fc258067150 msgr2=0x7fc25806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:49.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.080+0000 7fc25fc00640 1 -- 172.21.15.175:0/216062558 shutdown_connections 2024-04-25T09:13:49.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.080+0000 7fc25fc00640 1 -- 172.21.15.175:0/216062558 wait complete. 2024-04-25T09:13:49.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc25fc00640 1 Processor -- start 2024-04-25T09:13:49.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc25fc00640 1 -- start start 2024-04-25T09:13:49.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc25fc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2580cf560 0x7fc258151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc25fc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc25815a900 0x7fc2580b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc25fc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc258148050 0x7fc258156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc25fc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25806d530 con 0x7fc25815a900 2024-04-25T09:13:49.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc25fc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc25806d3b0 con 0x7fc2580cf560 2024-04-25T09:13:49.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc25fc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25815c790 con 0x7fc258148050 2024-04-25T09:13:49.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc24fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc25815a900 0x7fc2580b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc24fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc25815a900 0x7fc2580b1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41796/0 (socket says 172.21.15.175:41796) 2024-04-25T09:13:49.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc24fe00640 1 -- 172.21.15.175:0/1393682502 learned_addr learned my addr 172.21.15.175:0/1393682502 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:49.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc25d200640 1 --2- 172.21.15.175:0/1393682502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2580cf560 0x7fc258151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc25dc00640 1 --2- 172.21.15.175:0/1393682502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc258148050 0x7fc258156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.072 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc24fe00640 1 -- 172.21.15.175:0/1393682502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc258148050 msgr2=0x7fc258156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc24fe00640 1 --2- 172.21.15.175:0/1393682502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc258148050 0x7fc258156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc24fe00640 1 -- 172.21.15.175:0/1393682502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2580cf560 msgr2=0x7fc258151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc24fe00640 1 --2- 172.21.15.175:0/1393682502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2580cf560 0x7fc258151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc24fe00640 1 -- 172.21.15.175:0/1393682502 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25813b8f0 con 0x7fc25815a900 2024-04-25T09:13:49.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc24fe00640 1 --2- 172.21.15.175:0/1393682502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc25815a900 0x7fc2580b1be0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fc24000e810 tx=0x7fc24000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:49.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc255600640 1 -- 172.21.15.175:0/1393682502 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240017070 con 0x7fc25815a900 2024-04-25T09:13:49.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc255600640 1 -- 172.21.15.175:0/1393682502 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24000c8d0 con 0x7fc25815a900 2024-04-25T09:13:49.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc255600640 1 -- 172.21.15.175:0/1393682502 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24000f040 con 0x7fc25815a900 2024-04-25T09:13:49.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc25fc00640 1 -- 172.21.15.175:0/1393682502 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2580b2120 con 0x7fc25815a900 2024-04-25T09:13:49.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc25fc00640 1 -- 172.21.15.175:0/1393682502 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc258151ce0 con 0x7fc25815a900 2024-04-25T09:13:49.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.084+0000 7fc25fc00640 1 -- 172.21.15.175:0/1393682502 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc258074a60 con 0x7fc25815a900 2024-04-25T09:13:49.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.088+0000 7fc255600640 1 -- 172.21.15.175:0/1393682502 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc24001a070 con 0x7fc25815a900 2024-04-25T09:13:49.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.088+0000 7fc255600640 1 --2- 172.21.15.175:0/1393682502 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc234066f60 0x7fc234069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.088+0000 7fc255600640 1 -- 172.21.15.175:0/1393682502 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fc240084c90 con 0x7fc25815a900 2024-04-25T09:13:49.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.088+0000 7fc25d200640 1 --2- 172.21.15.175:0/1393682502 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc234066f60 0x7fc234069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.088+0000 7fc25d200640 1 --2- 172.21.15.175:0/1393682502 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc234066f60 0x7fc234069420 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc2480015b0 tx=0x7fc248009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:49.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.092+0000 7fc255600640 1 -- 172.21.15.175:0/1393682502 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc25813b8f0 con 0x7fc25815a900 2024-04-25T09:13:49.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.276+0000 7fc25fc00640 1 -- 172.21.15.175:0/1393682502 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc258159dc0 con 0x7fc25815a900 2024-04-25T09:13:49.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.276+0000 7fc255600640 1 -- 172.21.15.175:0/1393682502 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fc240055be0 con 0x7fc25815a900 2024-04-25T09:13:49.265 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:13:49.266 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":86,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6998,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3519467288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3519467288},{"type":"v1","addr":"172.21.15.177:6834","nonce":3519467288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2181426238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2181426238},{"type":"v1","addr":"172.21.15.177:6835","nonce":2181426238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/936884340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":936884340},{"type":"v1","addr":"172.21.15.175:6836","nonce":936884340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8547,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2116018062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2116018062},{"type":"v1","addr":"172.21.15.175:6837","nonce":2116018062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":85,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:23.414911+0000","modified":"2024-04-25T09:13:46.217300+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:13:49.266 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 86 2024-04-25T09:13:49.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.280+0000 7fc25fc00640 1 -- 172.21.15.175:0/1393682502 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc234066f60 msgr2=0x7fc234069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.280+0000 7fc25fc00640 1 --2- 172.21.15.175:0/1393682502 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc234066f60 0x7fc234069420 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc2480015b0 tx=0x7fc248009040 comp rx=0 tx=0).stop 2024-04-25T09:13:49.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.280+0000 7fc25fc00640 1 -- 172.21.15.175:0/1393682502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc25815a900 msgr2=0x7fc2580b1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.280+0000 7fc25fc00640 1 --2- 172.21.15.175:0/1393682502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc25815a900 0x7fc2580b1be0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fc24000e810 tx=0x7fc24000ecd0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.280+0000 7fc25fc00640 1 -- 172.21.15.175:0/1393682502 shutdown_connections 2024-04-25T09:13:49.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.280+0000 7fc25fc00640 1 --2- 172.21.15.175:0/1393682502 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc234066f60 0x7fc234069420 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.280+0000 7fc25fc00640 1 --2- 172.21.15.175:0/1393682502 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc258148050 0x7fc258156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.280+0000 7fc25fc00640 1 --2- 172.21.15.175:0/1393682502 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc25815a900 0x7fc2580b1be0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.280+0000 7fc25fc00640 1 --2- 172.21.15.175:0/1393682502 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc2580cf560 0x7fc258151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.280+0000 7fc25fc00640 1 -- 172.21.15.175:0/1393682502 >> 172.21.15.175:0/1393682502 conn(0x7fc2580cd520 msgr2=0x7fc25806d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:49.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.280+0000 7fc25fc00640 1 -- 172.21.15.175:0/1393682502 shutdown_connections 2024-04-25T09:13:49.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.280+0000 7fc25fc00640 1 -- 172.21.15.175:0/1393682502 wait complete. 2024-04-25T09:13:49.286 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:49.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.432+0000 7fa148200640 1 Processor -- start 2024-04-25T09:13:49.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.432+0000 7fa148200640 1 -- start start 2024-04-25T09:13:49.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.436+0000 7fa148200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa1400cd520 0x7fa14006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.436+0000 7fa148200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa1400cf560 0x7fa1400cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.436+0000 7fa148200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1400cda00 con 0x7fa14015a900 2024-04-25T09:13:49.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.436+0000 7fa148200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa14015bcf0 con 0x7fa1400cd520 2024-04-25T09:13:49.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.436+0000 7fa148200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1400cfed0 con 0x7fa1400cf560 2024-04-25T09:13:49.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.436+0000 7fa144e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa1400cd520 0x7fa14006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.436+0000 7fa144e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa1400cd520 0x7fa14006e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50952/0 (socket says 172.21.15.175:50952) 2024-04-25T09:13:49.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.436+0000 7fa144e00640 1 -- 172.21.15.175:0/972821056 learned_addr learned my addr 172.21.15.175:0/972821056 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:49.423 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.436+0000 7fa146200640 1 --2- 172.21.15.175:0/972821056 >> v2:172.21.15.177:3300/0 conn(0x7fa1400cf560 0x7fa1400cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.436+0000 7fa144e00640 1 -- 172.21.15.175:0/972821056 >> v2:172.21.15.177:3300/0 conn(0x7fa1400cf560 msgr2=0x7fa1400cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:49.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.436+0000 7fa144e00640 1 --2- 172.21.15.175:0/972821056 >> v2:172.21.15.177:3300/0 conn(0x7fa1400cf560 0x7fa1400cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.436+0000 7fa144e00640 1 -- 172.21.15.175:0/972821056 >> v1:172.21.15.177:6789/0 conn(0x7fa14015a900 legacy=0x7fa1400ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.436+0000 7fa144e00640 1 -- 172.21.15.175:0/972821056 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1400cdce0 con 0x7fa1400cd520 2024-04-25T09:13:49.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.440+0000 7fa144e00640 1 --2- 172.21.15.175:0/972821056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1400cd520 0x7fa14006e150 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fa1400af070 tx=0x7fa12c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f14618dc9d6142 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:49.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.440+0000 7fa13fe00640 1 -- 172.21.15.175:0/972821056 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c0ab610 con 0x7fa1400cd520 2024-04-25T09:13:49.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.440+0000 7fa13fe00640 1 -- 172.21.15.175:0/972821056 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c0b0070 con 0x7fa1400cd520 2024-04-25T09:13:49.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.440+0000 7fa13fe00640 1 -- 172.21.15.175:0/972821056 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c0ab9d0 con 0x7fa1400cd520 2024-04-25T09:13:49.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.440+0000 7fa148200640 1 -- 172.21.15.175:0/972821056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1400cd520 msgr2=0x7fa14006e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.440+0000 7fa148200640 1 --2- 172.21.15.175:0/972821056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1400cd520 0x7fa14006e150 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fa1400af070 tx=0x7fa12c01c520 comp rx=0 tx=0).stop 2024-04-25T09:13:49.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.440+0000 7fa148200640 1 -- 172.21.15.175:0/972821056 shutdown_connections 2024-04-25T09:13:49.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.440+0000 7fa148200640 1 --2- 172.21.15.175:0/972821056 >> v2:172.21.15.177:3300/0 conn(0x7fa1400cf560 0x7fa1400cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.440+0000 7fa148200640 1 --2- 172.21.15.175:0/972821056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1400cd520 0x7fa14006e150 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.440+0000 7fa148200640 1 -- 172.21.15.175:0/972821056 >> 172.21.15.175:0/972821056 conn(0x7fa140067150 msgr2=0x7fa14006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:49.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.440+0000 7fa148200640 1 -- 172.21.15.175:0/972821056 shutdown_connections 2024-04-25T09:13:49.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.440+0000 7fa148200640 1 -- 172.21.15.175:0/972821056 wait complete. 2024-04-25T09:13:49.428 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.440+0000 7fa148200640 1 Processor -- start 2024-04-25T09:13:49.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.440+0000 7fa148200640 1 -- start start 2024-04-25T09:13:49.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa148200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1400cf560 0x7fa1400b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa148200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa14015a900 0x7fa140155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa148200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa14014e9b0 0x7fa140158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa148200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14006d530 con 0x7fa14014e9b0 2024-04-25T09:13:49.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa148200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14006d3b0 con 0x7fa1400cf560 2024-04-25T09:13:49.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa148200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14015c790 con 0x7fa14015a900 2024-04-25T09:13:49.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa146200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa14014e9b0 0x7fa140158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa146200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa14014e9b0 0x7fa140158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50968/0 (socket says 172.21.15.175:50968) 2024-04-25T09:13:49.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa146200640 1 -- 172.21.15.175:0/4171752039 learned_addr learned my addr 172.21.15.175:0/4171752039 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:49.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa144e00640 1 --2- 172.21.15.175:0/4171752039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa14015a900 0x7fa140155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa145800640 1 --2- 172.21.15.175:0/4171752039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1400cf560 0x7fa1400b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa146200640 1 -- 172.21.15.175:0/4171752039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa14015a900 msgr2=0x7fa140155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa146200640 1 --2- 172.21.15.175:0/4171752039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa14015a900 0x7fa140155990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa146200640 1 -- 172.21.15.175:0/4171752039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1400cf560 msgr2=0x7fa1400b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa146200640 1 --2- 172.21.15.175:0/4171752039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1400cf560 0x7fa1400b17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa146200640 1 -- 172.21.15.175:0/4171752039 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa140157520 con 0x7fa14014e9b0 2024-04-25T09:13:49.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa145800640 1 --2- 172.21.15.175:0/4171752039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1400cf560 0x7fa1400b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:49.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa146200640 1 --2- 172.21.15.175:0/4171752039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa14014e9b0 0x7fa140158580 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fa13800efc0 tx=0x7fa13800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:49.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa13d600640 1 -- 172.21.15.175:0/4171752039 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138018020 con 0x7fa14014e9b0 2024-04-25T09:13:49.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa13d600640 1 -- 172.21.15.175:0/4171752039 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa138014480 con 0x7fa14014e9b0 2024-04-25T09:13:49.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa13d600640 1 -- 172.21.15.175:0/4171752039 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138014870 con 0x7fa14014e9b0 2024-04-25T09:13:49.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa148200640 1 -- 172.21.15.175:0/4171752039 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1401577c0 con 0x7fa14014e9b0 2024-04-25T09:13:49.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa148200640 1 -- 172.21.15.175:0/4171752039 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa140157d80 con 0x7fa14014e9b0 2024-04-25T09:13:49.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa148200640 1 -- 172.21.15.175:0/4171752039 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa140074a60 con 0x7fa14014e9b0 2024-04-25T09:13:49.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.444+0000 7fa13d600640 1 -- 172.21.15.175:0/4171752039 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa13801b020 con 0x7fa14014e9b0 2024-04-25T09:13:49.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.448+0000 7fa13d600640 1 --2- 172.21.15.175:0/4171752039 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa120066f60 0x7fa120069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.448+0000 7fa13d600640 1 -- 172.21.15.175:0/4171752039 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fa138085c00 con 0x7fa14014e9b0 2024-04-25T09:13:49.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.448+0000 7fa145800640 1 --2- 172.21.15.175:0/4171752039 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa120066f60 0x7fa120069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.448+0000 7fa145800640 1 --2- 172.21.15.175:0/4171752039 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa120066f60 0x7fa120069420 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa1400b3b30 tx=0x7fa134009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:49.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.452+0000 7fa13d600640 1 -- 172.21.15.175:0/4171752039 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa138022070 con 0x7fa14014e9b0 2024-04-25T09:13:49.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.640+0000 7fa148200640 1 -- 172.21.15.175:0/4171752039 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa140071e80 con 0x7fa14014e9b0 2024-04-25T09:13:49.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.640+0000 7fa13d600640 1 -- 172.21.15.175:0/4171752039 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fa138010040 con 0x7fa14014e9b0 2024-04-25T09:13:49.627 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:13:49.627 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":86,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6998,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3519467288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3519467288},{"type":"v1","addr":"172.21.15.177:6834","nonce":3519467288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2181426238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2181426238},{"type":"v1","addr":"172.21.15.177:6835","nonce":2181426238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/936884340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":936884340},{"type":"v1","addr":"172.21.15.175:6836","nonce":936884340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8547,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2116018062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2116018062},{"type":"v1","addr":"172.21.15.175:6837","nonce":2116018062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":85,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:12:23.414911+0000","modified":"2024-04-25T09:13:46.217300+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:13:49.627 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 86 2024-04-25T09:13:49.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.640+0000 7fa148200640 1 -- 172.21.15.175:0/4171752039 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa120066f60 msgr2=0x7fa120069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.640+0000 7fa148200640 1 --2- 172.21.15.175:0/4171752039 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa120066f60 0x7fa120069420 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa1400b3b30 tx=0x7fa134009040 comp rx=0 tx=0).stop 2024-04-25T09:13:49.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.640+0000 7fa148200640 1 -- 172.21.15.175:0/4171752039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa14014e9b0 msgr2=0x7fa140158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.640+0000 7fa148200640 1 --2- 172.21.15.175:0/4171752039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa14014e9b0 0x7fa140158580 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fa13800efc0 tx=0x7fa13800c490 comp rx=0 tx=0).stop 2024-04-25T09:13:49.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.640+0000 7fa148200640 1 -- 172.21.15.175:0/4171752039 shutdown_connections 2024-04-25T09:13:49.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.640+0000 7fa148200640 1 --2- 172.21.15.175:0/4171752039 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa120066f60 0x7fa120069420 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.640+0000 7fa148200640 1 --2- 172.21.15.175:0/4171752039 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa14014e9b0 0x7fa140158580 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.640+0000 7fa148200640 1 --2- 172.21.15.175:0/4171752039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa14015a900 0x7fa140155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.640+0000 7fa148200640 1 --2- 172.21.15.175:0/4171752039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1400cf560 0x7fa1400b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.640+0000 7fa148200640 1 -- 172.21.15.175:0/4171752039 >> 172.21.15.175:0/4171752039 conn(0x7fa1400cd520 msgr2=0x7fa14006ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:49.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.640+0000 7fa148200640 1 -- 172.21.15.175:0/4171752039 shutdown_connections 2024-04-25T09:13:49.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.640+0000 7fa148200640 1 -- 172.21.15.175:0/4171752039 wait complete. 2024-04-25T09:13:49.648 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:13:49.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.796+0000 7f54f0600640 1 Processor -- start 2024-04-25T09:13:49.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.796+0000 7f54f0600640 1 -- start start 2024-04-25T09:13:49.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.796+0000 7f54f0600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f54e815a900 0x7f54e806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.796+0000 7f54f0600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f54e80cf560 0x7f54e80cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.796+0000 7f54f0600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e80cda00 con 0x7f54e80cd520 2024-04-25T09:13:49.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.796+0000 7f54f0600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e815bcf0 con 0x7f54e815a900 2024-04-25T09:13:49.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.796+0000 7f54f0600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e80cfed0 con 0x7f54e80cf560 2024-04-25T09:13:49.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.796+0000 7f54edc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f54e815a900 0x7f54e806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.796+0000 7f54ed200640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f54e80cd520 0x7f54e80ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44014/0 (socket says 172.21.15.175:44014) 2024-04-25T09:13:49.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.796+0000 7f54ed200640 1 -- 172.21.15.175:0/1174086774 learned_addr learned my addr 172.21.15.175:0/1174086774 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:49.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.800+0000 7f54ee600640 1 --2- 172.21.15.175:0/1174086774 >> v2:172.21.15.177:3300/0 conn(0x7f54e80cf560 0x7f54e80cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.800+0000 7f54edc00640 1 -- 172.21.15.175:0/1174086774 >> v2:172.21.15.177:3300/0 conn(0x7f54e80cf560 msgr2=0x7f54e80cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:49.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.800+0000 7f54edc00640 1 --2- 172.21.15.175:0/1174086774 >> v2:172.21.15.177:3300/0 conn(0x7f54e80cf560 0x7f54e80cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.800+0000 7f54edc00640 1 -- 172.21.15.175:0/1174086774 >> v1:172.21.15.175:6789/0 conn(0x7f54e80cd520 legacy=0x7f54e80ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.800+0000 7f54e7e00640 1 -- 172.21.15.175:0/1174086774 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603996378 0 0) 0x7f54e80cda00 con 0x7f54e80cd520 2024-04-25T09:13:49.786 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.800+0000 7f54edc00640 1 -- 172.21.15.175:0/1174086774 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e80cdce0 con 0x7f54e815a900 2024-04-25T09:13:49.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.800+0000 7f54edc00640 1 --2- 172.21.15.175:0/1174086774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54e815a900 0x7f54e806e150 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f54e80af070 tx=0x7f54dc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4c00d29c680bf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:49.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.800+0000 7f54e7e00640 1 -- 172.21.15.175:0/1174086774 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc0b0070 con 0x7f54e815a900 2024-04-25T09:13:49.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.800+0000 7f54e7e00640 1 -- 172.21.15.175:0/1174086774 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc004230 con 0x7f54e815a900 2024-04-25T09:13:49.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.800+0000 7f54e7e00640 1 -- 172.21.15.175:0/1174086774 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc003620 con 0x7f54e815a900 2024-04-25T09:13:49.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.800+0000 7f54f0600640 1 -- 172.21.15.175:0/1174086774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54e815a900 msgr2=0x7f54e806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.800+0000 7f54f0600640 1 --2- 172.21.15.175:0/1174086774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54e815a900 0x7f54e806e150 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f54e80af070 tx=0x7f54dc01c460 comp rx=0 tx=0).stop 2024-04-25T09:13:49.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.800+0000 7f54f0600640 1 -- 172.21.15.175:0/1174086774 shutdown_connections 2024-04-25T09:13:49.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.800+0000 7f54f0600640 1 --2- 172.21.15.175:0/1174086774 >> v2:172.21.15.177:3300/0 conn(0x7f54e80cf560 0x7f54e80cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.800+0000 7f54f0600640 1 --2- 172.21.15.175:0/1174086774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54e815a900 0x7f54e806e150 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.800+0000 7f54f0600640 1 -- 172.21.15.175:0/1174086774 >> 172.21.15.175:0/1174086774 conn(0x7f54e8067150 msgr2=0x7f54e806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:49.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54f0600640 1 -- 172.21.15.175:0/1174086774 shutdown_connections 2024-04-25T09:13:49.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54f0600640 1 -- 172.21.15.175:0/1174086774 wait complete. 2024-04-25T09:13:49.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54f0600640 1 Processor -- start 2024-04-25T09:13:49.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54f0600640 1 -- start start 2024-04-25T09:13:49.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54f0600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54e80cf560 0x7f54e80b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54f0600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54e815a900 0x7f54e8151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54f0600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54e80b01c0 0x7f54e814e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54f0600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e806d530 con 0x7f54e80cf560 2024-04-25T09:13:49.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54f0600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e806d3b0 con 0x7f54e815a900 2024-04-25T09:13:49.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54f0600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e815c790 con 0x7f54e80b01c0 2024-04-25T09:13:49.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54edc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54e80cf560 0x7f54e80b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54edc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54e80cf560 0x7f54e80b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:50986/0 (socket says 172.21.15.175:50986) 2024-04-25T09:13:49.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54edc00640 1 -- 172.21.15.175:0/723219264 learned_addr learned my addr 172.21.15.175:0/723219264 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:49.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54ed200640 1 --2- 172.21.15.175:0/723219264 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54e815a900 0x7f54e8151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54ee600640 1 --2- 172.21.15.175:0/723219264 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54e80b01c0 0x7f54e814e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54edc00640 1 -- 172.21.15.175:0/723219264 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54e80b01c0 msgr2=0x7f54e814e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54edc00640 1 --2- 172.21.15.175:0/723219264 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54e80b01c0 0x7f54e814e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54edc00640 1 -- 172.21.15.175:0/723219264 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54e815a900 msgr2=0x7f54e8151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54edc00640 1 --2- 172.21.15.175:0/723219264 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54e815a900 0x7f54e8151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54edc00640 1 -- 172.21.15.175:0/723219264 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e80af160 con 0x7f54e80cf560 2024-04-25T09:13:49.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.804+0000 7f54edc00640 1 --2- 172.21.15.175:0/723219264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54e80cf560 0x7f54e80b1ca0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f54dc019070 tx=0x7f54dc019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:49.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.808+0000 7f54e5600640 1 -- 172.21.15.175:0/723219264 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc0b0040 con 0x7f54e80cf560 2024-04-25T09:13:49.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.808+0000 7f54e5600640 1 -- 172.21.15.175:0/723219264 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc0bb070 con 0x7f54e80cf560 2024-04-25T09:13:49.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.808+0000 7f54e5600640 1 -- 172.21.15.175:0/723219264 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc006e20 con 0x7f54e80cf560 2024-04-25T09:13:49.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.808+0000 7f54f0600640 1 -- 172.21.15.175:0/723219264 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e80b0670 con 0x7f54e80cf560 2024-04-25T09:13:49.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.808+0000 7f54f0600640 1 -- 172.21.15.175:0/723219264 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e80af6e0 con 0x7f54e80cf560 2024-04-25T09:13:49.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.808+0000 7f54f0600640 1 -- 172.21.15.175:0/723219264 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e8074a60 con 0x7f54e80cf560 2024-04-25T09:13:49.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.808+0000 7f54e5600640 1 -- 172.21.15.175:0/723219264 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f54dc0b3070 con 0x7f54e80cf560 2024-04-25T09:13:49.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.808+0000 7f54e5600640 1 --2- 172.21.15.175:0/723219264 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f54c8066f90 0x7f54c8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:49.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.808+0000 7f54e5600640 1 -- 172.21.15.175:0/723219264 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f54dc11ef00 con 0x7f54e80cf560 2024-04-25T09:13:49.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.808+0000 7f54ed200640 1 --2- 172.21.15.175:0/723219264 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f54c8066f90 0x7f54c8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:49.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.808+0000 7f54ed200640 1 --2- 172.21.15.175:0/723219264 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f54c8066f90 0x7f54c8069450 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f54d4000f70 tx=0x7f54d4007b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:49.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.812+0000 7f54e5600640 1 -- 172.21.15.175:0/723219264 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f54dc016050 con 0x7f54e80cf560 2024-04-25T09:13:49.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.972+0000 7f54f0600640 1 -- 172.21.15.175:0/723219264 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54e815cbd0 con 0x7f54e80cf560 2024-04-25T09:13:49.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.972+0000 7f54e5600640 1 -- 172.21.15.175:0/723219264 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16909 (secure 0 0 0) 0x7f54dc0aa3a0 con 0x7f54e80cf560 2024-04-25T09:13:49.961 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:13:49.961 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":102,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:13:46.217312+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:12:21.141676+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-25T09:12:22.422455+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6837/2646458577":"2024-04-26T09:13:46.217288+0000","172.21.15.175:6835/2646458577":"2024-04-26T09:13:46.217288+0000","172.21.15.175:6837/3952378765":"2024-04-26T09:13:09.546531+0000","172.21.15.175:6835/3952378765":"2024-04-26T09:13:09.546531+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:13:49.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.976+0000 7f54f0600640 1 -- 172.21.15.175:0/723219264 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f54c8066f90 msgr2=0x7f54c8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.976+0000 7f54f0600640 1 --2- 172.21.15.175:0/723219264 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f54c8066f90 0x7f54c8069450 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f54d4000f70 tx=0x7f54d4007b60 comp rx=0 tx=0).stop 2024-04-25T09:13:49.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.976+0000 7f54f0600640 1 -- 172.21.15.175:0/723219264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54e80cf560 msgr2=0x7f54e80b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:49.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.976+0000 7f54f0600640 1 --2- 172.21.15.175:0/723219264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54e80cf560 0x7f54e80b1ca0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f54dc019070 tx=0x7f54dc019200 comp rx=0 tx=0).stop 2024-04-25T09:13:49.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.976+0000 7f54f0600640 1 -- 172.21.15.175:0/723219264 shutdown_connections 2024-04-25T09:13:49.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.976+0000 7f54f0600640 1 --2- 172.21.15.175:0/723219264 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f54c8066f90 0x7f54c8069450 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.976+0000 7f54f0600640 1 --2- 172.21.15.175:0/723219264 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54e80b01c0 0x7f54e814e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.976+0000 7f54f0600640 1 --2- 172.21.15.175:0/723219264 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54e815a900 0x7f54e8151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.976+0000 7f54f0600640 1 --2- 172.21.15.175:0/723219264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54e80cf560 0x7f54e80b1ca0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:49.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.976+0000 7f54f0600640 1 -- 172.21.15.175:0/723219264 >> 172.21.15.175:0/723219264 conn(0x7f54e80cd520 msgr2=0x7f54e81594c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:49.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.976+0000 7f54f0600640 1 -- 172.21.15.175:0/723219264 shutdown_connections 2024-04-25T09:13:49.964 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:49.976+0000 7f54f0600640 1 -- 172.21.15.175:0/723219264 wait complete. 2024-04-25T09:13:49.982 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:13:50.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f552f000640 1 Processor -- start 2024-04-25T09:13:50.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f552f000640 1 -- start start 2024-04-25T09:13:50.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f552f000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5528145250 0x7f55280cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f552f000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55280cfd10 con 0x7f55281600a0 2024-04-25T09:13:50.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f552f000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55280cfff0 con 0x7f55280ce970 2024-04-25T09:13:50.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f552f000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552815f650 con 0x7f5528145250 2024-04-25T09:13:50.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f551f400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f55281600a0 0x7f55280cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44028/0 (socket says 172.21.15.175:44028) 2024-04-25T09:13:50.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f551f400640 1 -- 172.21.15.175:0/1550725469 learned_addr learned my addr 172.21.15.175:0/1550725469 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:50.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f5527e00640 1 --2- 172.21.15.175:0/1550725469 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5528145250 0x7f55280cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f5527400640 1 -- 172.21.15.175:0/1550725469 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772121291 0 0) 0x7f55280cfd10 con 0x7f55281600a0 2024-04-25T09:13:50.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f5527400640 1 -- 172.21.15.175:0/1550725469 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f550c003530 con 0x7f55281600a0 2024-04-25T09:13:50.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f5527400640 1 -- 172.21.15.175:0/1550725469 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1737900504 0 0) 0x7f550c003530 con 0x7f55281600a0 2024-04-25T09:13:50.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f5527400640 1 -- 172.21.15.175:0/1550725469 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5528145250 msgr2=0x7f55280cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:50.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f5527400640 1 --2- 172.21.15.175:0/1550725469 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5528145250 0x7f55280cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:50.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f5527400640 1 -- 172.21.15.175:0/1550725469 >> v1:172.21.15.177:6789/0 conn(0x7f55280ce970 legacy=0x7f55280cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:50.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f5527400640 1 -- 172.21.15.175:0/1550725469 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552815f8a0 con 0x7f55281600a0 2024-04-25T09:13:50.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f5527400640 1 -- 172.21.15.175:0/1550725469 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f5510001680 con 0x7f55281600a0 2024-04-25T09:13:50.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f5527e00640 1 --2- 172.21.15.175:0/1550725469 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5528145250 0x7f55280cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:50.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f5527400640 1 -- 172.21.15.175:0/1550725469 >> v1:172.21.15.175:6789/0 conn(0x7f55281600a0 legacy=0x7f55280cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:50.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f5527400640 1 --2- 172.21.15.175:0/1550725469 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5528145250 0x7f550c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f5527400640 1 --2- 172.21.15.175:0/1550725469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f550c003f30 0x7f550c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f5527400640 1 --2- 172.21.15.175:0/1550725469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f550c004d50 0x7f550c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f5527400640 1 -- 172.21.15.175:0/1550725469 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552815f650 con 0x7f550c004d50 2024-04-25T09:13:50.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f5527400640 1 -- 172.21.15.175:0/1550725469 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c00bbc0 con 0x7f550c003f30 2024-04-25T09:13:50.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f5527400640 1 -- 172.21.15.175:0/1550725469 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550c00bdc0 con 0x7f5528145250 2024-04-25T09:13:50.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f5527e00640 1 --2- 172.21.15.175:0/1550725469 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5528145250 0x7f550c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f552d000640 1 --2- 172.21.15.175:0/1550725469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f550c004d50 0x7f550c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.132+0000 7f551f400640 1 --2- 172.21.15.175:0/1550725469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f550c003f30 0x7f550c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.136+0000 7f5527e00640 1 -- 172.21.15.175:0/1550725469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f550c003f30 msgr2=0x7f550c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:50.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.136+0000 7f5527e00640 1 --2- 172.21.15.175:0/1550725469 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f550c003f30 0x7f550c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:50.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.136+0000 7f5527e00640 1 -- 172.21.15.175:0/1550725469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f550c004d50 msgr2=0x7f550c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:50.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.136+0000 7f5527e00640 1 --2- 172.21.15.175:0/1550725469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f550c004d50 0x7f550c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:50.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.136+0000 7f5527e00640 1 -- 172.21.15.175:0/1550725469 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c003530 con 0x7f5528145250 2024-04-25T09:13:50.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.136+0000 7f552d000640 1 --2- 172.21.15.175:0/1550725469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f550c004d50 0x7f550c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:50.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.136+0000 7f5527e00640 1 --2- 172.21.15.175:0/1550725469 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5528145250 0x7f550c0039f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5518009c70 tx=0x7f551801cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17a1a77e8d707ff5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:50.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.136+0000 7f5527400640 1 -- 172.21.15.175:0/1550725469 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518009840 con 0x7f5528145250 2024-04-25T09:13:50.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.136+0000 7f5527400640 1 -- 172.21.15.175:0/1550725469 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5518004030 con 0x7f5528145250 2024-04-25T09:13:50.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.136+0000 7f5527400640 1 -- 172.21.15.175:0/1550725469 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518004460 con 0x7f5528145250 2024-04-25T09:13:50.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.136+0000 7f552f000640 1 -- 172.21.15.175:0/1550725469 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5528145250 msgr2=0x7f550c0039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:50.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.136+0000 7f552f000640 1 --2- 172.21.15.175:0/1550725469 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5528145250 0x7f550c0039f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5518009c70 tx=0x7f551801cc50 comp rx=0 tx=0).stop 2024-04-25T09:13:50.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.136+0000 7f552d000640 1 -- 172.21.15.175:0/1550725469 reap_dead start 2024-04-25T09:13:50.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.136+0000 7f552f000640 1 -- 172.21.15.175:0/1550725469 shutdown_connections 2024-04-25T09:13:50.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.136+0000 7f552f000640 1 -- 172.21.15.175:0/1550725469 >> 172.21.15.175:0/1550725469 conn(0x7f552806ac50 msgr2=0x7f552806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:50.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.136+0000 7f552f000640 1 -- 172.21.15.175:0/1550725469 shutdown_connections 2024-04-25T09:13:50.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f552f000640 1 -- 172.21.15.175:0/1550725469 wait complete. 2024-04-25T09:13:50.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f552f000640 1 Processor -- start 2024-04-25T09:13:50.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f552f000640 1 -- start start 2024-04-25T09:13:50.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f552f000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5528145250 0x7f552815c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f552f000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55280aba30 0x7f55280aa540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f552f000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55280aaa80 0x7f55280c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f552f000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5528145630 con 0x7f55280aba30 2024-04-25T09:13:50.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f552f000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5528160500 con 0x7f5528145250 2024-04-25T09:13:50.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f552f000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55280cf6b0 con 0x7f55280aaa80 2024-04-25T09:13:50.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f551f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55280aba30 0x7f55280aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f551f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55280aba30 0x7f55280aa540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51000/0 (socket says 172.21.15.175:51000) 2024-04-25T09:13:50.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f551f400640 1 -- 172.21.15.175:0/2327304886 learned_addr learned my addr 172.21.15.175:0/2327304886 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:50.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f5527e00640 1 --2- 172.21.15.175:0/2327304886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5528145250 0x7f552815c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f552d000640 1 --2- 172.21.15.175:0/2327304886 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55280aaa80 0x7f55280c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f551f400640 1 -- 172.21.15.175:0/2327304886 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55280aaa80 msgr2=0x7f55280c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:50.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f551f400640 1 --2- 172.21.15.175:0/2327304886 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55280aaa80 0x7f55280c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:50.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f551f400640 1 -- 172.21.15.175:0/2327304886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5528145250 msgr2=0x7f552815c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:50.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f551f400640 1 --2- 172.21.15.175:0/2327304886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5528145250 0x7f552815c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:50.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f551f400640 1 -- 172.21.15.175:0/2327304886 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5528131da0 con 0x7f55280aba30 2024-04-25T09:13:50.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f5527e00640 1 --2- 172.21.15.175:0/2327304886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5528145250 0x7f552815c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:50.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f551f400640 1 --2- 172.21.15.175:0/2327304886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55280aba30 0x7f55280aa540 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f5510004ea0 tx=0x7f5510004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:50.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.140+0000 7f5524c00640 1 -- 172.21.15.175:0/2327304886 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551000f6e0 con 0x7f55280aba30 2024-04-25T09:13:50.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.144+0000 7f5524c00640 1 -- 172.21.15.175:0/2327304886 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5510018070 con 0x7f55280aba30 2024-04-25T09:13:50.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.144+0000 7f552f000640 1 -- 172.21.15.175:0/2327304886 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5528132080 con 0x7f55280aba30 2024-04-25T09:13:50.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.144+0000 7f5524c00640 1 -- 172.21.15.175:0/2327304886 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551000faa0 con 0x7f55280aba30 2024-04-25T09:13:50.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.144+0000 7f552f000640 1 -- 172.21.15.175:0/2327304886 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5528132640 con 0x7f55280aba30 2024-04-25T09:13:50.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.144+0000 7f552f000640 1 -- 172.21.15.175:0/2327304886 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55280aae60 con 0x7f55280aba30 2024-04-25T09:13:50.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.144+0000 7f5524c00640 1 -- 172.21.15.175:0/2327304886 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f551000fc40 con 0x7f55280aba30 2024-04-25T09:13:50.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.144+0000 7f5524c00640 1 --2- 172.21.15.175:0/2327304886 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5504066f90 0x7f5504069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:50.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.144+0000 7f5524c00640 1 -- 172.21.15.175:0/2327304886 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f5510085060 con 0x7f55280aba30 2024-04-25T09:13:50.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.144+0000 7f5527e00640 1 --2- 172.21.15.175:0/2327304886 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5504066f90 0x7f5504069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:50.133 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.144+0000 7f5527e00640 1 --2- 172.21.15.175:0/2327304886 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5504066f90 0x7f5504069450 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f55180ae000 tx=0x7f55180046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:50.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.148+0000 7f5524c00640 1 -- 172.21.15.175:0/2327304886 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5510055f20 con 0x7f55280aba30 2024-04-25T09:13:50.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:50.340+0000 7f552f000640 1 -- 172.21.15.175:0/2327304886 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5528075160 con 0x7f55280aba30 2024-04-25T09:13:51.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.248+0000 7f5524c00640 1 -- 172.21.15.175:0/2327304886 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v87) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5510055820 con 0x7f55280aba30 2024-04-25T09:13:51.237 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:13:51.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.252+0000 7f552f000640 1 -- 172.21.15.175:0/2327304886 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5504066f90 msgr2=0x7f5504069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:51.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.252+0000 7f552f000640 1 --2- 172.21.15.175:0/2327304886 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5504066f90 0x7f5504069450 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f55180ae000 tx=0x7f55180046d0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.252+0000 7f552f000640 1 -- 172.21.15.175:0/2327304886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55280aba30 msgr2=0x7f55280aa540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:51.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.252+0000 7f552f000640 1 --2- 172.21.15.175:0/2327304886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55280aba30 0x7f55280aa540 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f5510004ea0 tx=0x7f5510004f90 comp rx=0 tx=0).stop 2024-04-25T09:13:51.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.252+0000 7f552f000640 1 -- 172.21.15.175:0/2327304886 shutdown_connections 2024-04-25T09:13:51.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.252+0000 7f552f000640 1 --2- 172.21.15.175:0/2327304886 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5504066f90 0x7f5504069450 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.252+0000 7f552f000640 1 --2- 172.21.15.175:0/2327304886 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f55280aaa80 0x7f55280c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.252+0000 7f552f000640 1 --2- 172.21.15.175:0/2327304886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f55280aba30 0x7f55280aa540 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.252+0000 7f552f000640 1 --2- 172.21.15.175:0/2327304886 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5528145250 0x7f552815c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.252+0000 7f552f000640 1 -- 172.21.15.175:0/2327304886 >> 172.21.15.175:0/2327304886 conn(0x7f552806ac50 msgr2=0x7f55280b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:51.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.252+0000 7f552f000640 1 -- 172.21.15.175:0/2327304886 shutdown_connections 2024-04-25T09:13:51.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.252+0000 7f552f000640 1 -- 172.21.15.175:0/2327304886 wait complete. 2024-04-25T09:13:51.261 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:13:51.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.412+0000 7f0893a00640 1 Processor -- start 2024-04-25T09:13:51.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.412+0000 7f0893a00640 1 -- start start 2024-04-25T09:13:51.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.416+0000 7f0893a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f088c145250 0x7f088c0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:51.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.416+0000 7f0893a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f088c1600a0 0x7f088c0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:51.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.416+0000 7f0893a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f088c0cfd10 con 0x7f088c0ce970 2024-04-25T09:13:51.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.416+0000 7f0893a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f088c15f650 con 0x7f088c1600a0 2024-04-25T09:13:51.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.416+0000 7f0893a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088c0cfff0 con 0x7f088c145250 2024-04-25T09:13:51.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.416+0000 7f0883e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f088c1600a0 0x7f088c0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:51.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.416+0000 7f0883e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f088c1600a0 0x7f088c0cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51010/0 (socket says 172.21.15.175:51010) 2024-04-25T09:13:51.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.416+0000 7f0883e00640 1 -- 172.21.15.175:0/772073336 learned_addr learned my addr 172.21.15.175:0/772073336 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:51.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.416+0000 7f0891000640 1 --2- 172.21.15.175:0/772073336 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f088c145250 0x7f088c0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:51.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.416+0000 7f0883e00640 1 -- 172.21.15.175:0/772073336 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f088c145250 msgr2=0x7f088c0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:51.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.416+0000 7f0883e00640 1 --2- 172.21.15.175:0/772073336 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f088c145250 0x7f088c0cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.416+0000 7f0883e00640 1 -- 172.21.15.175:0/772073336 >> v1:172.21.15.177:6789/0 conn(0x7f088c0ce970 legacy=0x7f088c0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:51.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.416+0000 7f0883e00640 1 -- 172.21.15.175:0/772073336 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c15f8a0 con 0x7f088c1600a0 2024-04-25T09:13:51.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.416+0000 7f0883e00640 1 --2- 172.21.15.175:0/772073336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f088c1600a0 0x7f088c0cc410 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f0874009870 tx=0x7f087401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891f4cd9a761db91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:51.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.416+0000 7f088be00640 1 -- 172.21.15.175:0/772073336 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08740aa620 con 0x7f088c1600a0 2024-04-25T09:13:51.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.416+0000 7f088be00640 1 -- 172.21.15.175:0/772073336 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08740af070 con 0x7f088c1600a0 2024-04-25T09:13:51.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.416+0000 7f088be00640 1 -- 172.21.15.175:0/772073336 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08740aa9e0 con 0x7f088c1600a0 2024-04-25T09:13:51.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0893a00640 1 -- 172.21.15.175:0/772073336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f088c1600a0 msgr2=0x7f088c0cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:51.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0893a00640 1 --2- 172.21.15.175:0/772073336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f088c1600a0 0x7f088c0cc410 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f0874009870 tx=0x7f087401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0893a00640 1 -- 172.21.15.175:0/772073336 shutdown_connections 2024-04-25T09:13:51.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0893a00640 1 --2- 172.21.15.175:0/772073336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f088c1600a0 0x7f088c0cc410 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0893a00640 1 --2- 172.21.15.175:0/772073336 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f088c145250 0x7f088c0cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0893a00640 1 -- 172.21.15.175:0/772073336 >> 172.21.15.175:0/772073336 conn(0x7f088c06ac50 msgr2=0x7f088c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:51.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0893a00640 1 -- 172.21.15.175:0/772073336 shutdown_connections 2024-04-25T09:13:51.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0893a00640 1 -- 172.21.15.175:0/772073336 wait complete. 2024-04-25T09:13:51.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0893a00640 1 Processor -- start 2024-04-25T09:13:51.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0893a00640 1 -- start start 2024-04-25T09:13:51.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0893a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f088c0ce970 0x7f088c13f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:51.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0893a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f088c145250 0x7f088c165d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:51.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0893a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f088c1600a0 0x7f088c13fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:51.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0893a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c15c870 con 0x7f088c145250 2024-04-25T09:13:51.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0893a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088c145630 con 0x7f088c0ce970 2024-04-25T09:13:51.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0893a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088c15c9f0 con 0x7f088c1600a0 2024-04-25T09:13:51.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0883e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f088c145250 0x7f088c165d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:51.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0883e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f088c145250 0x7f088c165d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51020/0 (socket says 172.21.15.175:51020) 2024-04-25T09:13:51.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0883e00640 1 -- 172.21.15.175:0/2781557200 learned_addr learned my addr 172.21.15.175:0/2781557200 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:51.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0891000640 1 --2- 172.21.15.175:0/2781557200 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f088c0ce970 0x7f088c13f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:51.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0891a00640 1 --2- 172.21.15.175:0/2781557200 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f088c1600a0 0x7f088c13fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:51.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0883e00640 1 -- 172.21.15.175:0/2781557200 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f088c1600a0 msgr2=0x7f088c13fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:51.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0883e00640 1 --2- 172.21.15.175:0/2781557200 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f088c1600a0 0x7f088c13fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0883e00640 1 -- 172.21.15.175:0/2781557200 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f088c0ce970 msgr2=0x7f088c13f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:51.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0883e00640 1 --2- 172.21.15.175:0/2781557200 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f088c0ce970 0x7f088c13f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:51.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.420+0000 7f0883e00640 1 -- 172.21.15.175:0/2781557200 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f088c162810 con 0x7f088c145250 2024-04-25T09:13:51.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.424+0000 7f0891a00640 1 --2- 172.21.15.175:0/2781557200 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f088c1600a0 0x7f088c13fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:51.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.424+0000 7f0883e00640 1 --2- 172.21.15.175:0/2781557200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f088c145250 0x7f088c165d90 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f08740ac040 tx=0x7f0874019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:51.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.424+0000 7f0889600640 1 -- 172.21.15.175:0/2781557200 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08740aade0 con 0x7f088c145250 2024-04-25T09:13:51.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.424+0000 7f0889600640 1 -- 172.21.15.175:0/2781557200 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08740be410 con 0x7f088c145250 2024-04-25T09:13:51.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.424+0000 7f0893a00640 1 -- 172.21.15.175:0/2781557200 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088c162af0 con 0x7f088c145250 2024-04-25T09:13:51.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.424+0000 7f0889600640 1 -- 172.21.15.175:0/2781557200 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08740be800 con 0x7f088c145250 2024-04-25T09:13:51.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.424+0000 7f0893a00640 1 -- 172.21.15.175:0/2781557200 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f088c1630b0 con 0x7f088c145250 2024-04-25T09:13:51.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.424+0000 7f0893a00640 1 -- 172.21.15.175:0/2781557200 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088c075160 con 0x7f088c145250 2024-04-25T09:13:51.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.424+0000 7f0889600640 1 -- 172.21.15.175:0/2781557200 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f08740bc020 con 0x7f088c145250 2024-04-25T09:13:51.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.424+0000 7f0889600640 1 --2- 172.21.15.175:0/2781557200 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0868066f60 0x7f0868069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:51.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.424+0000 7f0889600640 1 -- 172.21.15.175:0/2781557200 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f087411f6b0 con 0x7f088c145250 2024-04-25T09:13:51.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.424+0000 7f0891000640 1 --2- 172.21.15.175:0/2781557200 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0868066f60 0x7f0868069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:51.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.428+0000 7f0891000640 1 --2- 172.21.15.175:0/2781557200 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0868066f60 0x7f0868069420 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f087c007a60 tx=0x7f087c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:51.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.428+0000 7f0889600640 1 -- 172.21.15.175:0/2781557200 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0874016150 con 0x7f088c145250 2024-04-25T09:13:51.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:51.612+0000 7f0893a00640 1 -- 172.21.15.175:0/2781557200 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f088c0d03d0 con 0x7f088c145250 2024-04-25T09:13:52.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.256+0000 7f0889600640 1 -- 172.21.15.175:0/2781557200 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v88) v1 ==== 104+0+0 (secure 0 0 0) 0x7f08740eff20 con 0x7f088c145250 2024-04-25T09:13:52.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.260+0000 7f0893a00640 1 -- 172.21.15.175:0/2781557200 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0868066f60 msgr2=0x7f0868069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.260+0000 7f0893a00640 1 --2- 172.21.15.175:0/2781557200 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0868066f60 0x7f0868069420 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f087c007a60 tx=0x7f087c008040 comp rx=0 tx=0).stop 2024-04-25T09:13:52.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.260+0000 7f0893a00640 1 -- 172.21.15.175:0/2781557200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f088c145250 msgr2=0x7f088c165d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.260+0000 7f0893a00640 1 --2- 172.21.15.175:0/2781557200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f088c145250 0x7f088c165d90 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f08740ac040 tx=0x7f0874019240 comp rx=0 tx=0).stop 2024-04-25T09:13:52.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.260+0000 7f0893a00640 1 -- 172.21.15.175:0/2781557200 shutdown_connections 2024-04-25T09:13:52.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.260+0000 7f0893a00640 1 --2- 172.21.15.175:0/2781557200 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0868066f60 0x7f0868069420 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.260+0000 7f0893a00640 1 --2- 172.21.15.175:0/2781557200 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f088c1600a0 0x7f088c13fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.260+0000 7f0893a00640 1 --2- 172.21.15.175:0/2781557200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f088c145250 0x7f088c165d90 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.260+0000 7f0893a00640 1 --2- 172.21.15.175:0/2781557200 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f088c0ce970 0x7f088c13f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.260+0000 7f0893a00640 1 -- 172.21.15.175:0/2781557200 >> 172.21.15.175:0/2781557200 conn(0x7f088c06ac50 msgr2=0x7f088c0712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:52.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.260+0000 7f0893a00640 1 -- 172.21.15.175:0/2781557200 shutdown_connections 2024-04-25T09:13:52.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.260+0000 7f0893a00640 1 -- 172.21.15.175:0/2781557200 wait complete. 2024-04-25T09:13:52.268 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:13:52.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.420+0000 7f3645a00640 1 Processor -- start 2024-04-25T09:13:52.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.420+0000 7f3645a00640 1 -- start start 2024-04-25T09:13:52.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.420+0000 7f3645a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36400aebd0 0x7f364015b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.420+0000 7f3645a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f36400b4970 0x7f364015c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.420+0000 7f3645a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364015b880 con 0x7f36400b2700 2024-04-25T09:13:52.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.420+0000 7f3645a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364015bb60 con 0x7f36400b4970 2024-04-25T09:13:52.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.420+0000 7f3645a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364015be40 con 0x7f36400aebd0 2024-04-25T09:13:52.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.424+0000 7f3636000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f36400b2700 0x7f36400b4260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44032/0 (socket says 172.21.15.175:44032) 2024-04-25T09:13:52.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.424+0000 7f3636000640 1 -- 172.21.15.175:0/3235011411 learned_addr learned my addr 172.21.15.175:0/3235011411 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:52.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.424+0000 7f363f400640 1 --2- 172.21.15.175:0/3235011411 >> v2:172.21.15.177:3300/0 conn(0x7f36400b4970 0x7f364015c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.424+0000 7f363ea00640 1 --2- 172.21.15.175:0/3235011411 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36400aebd0 0x7f364015b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.424+0000 7f363e000640 1 -- 172.21.15.175:0/3235011411 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987522282 0 0) 0x7f364015b880 con 0x7f36400b2700 2024-04-25T09:13:52.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.424+0000 7f363e000640 1 -- 172.21.15.175:0/3235011411 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3624003530 con 0x7f36400b2700 2024-04-25T09:13:52.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.424+0000 7f363f400640 1 -- 172.21.15.175:0/3235011411 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36400aebd0 msgr2=0x7f364015b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:52.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.424+0000 7f363f400640 1 --2- 172.21.15.175:0/3235011411 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36400aebd0 0x7f364015b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.424+0000 7f363f400640 1 -- 172.21.15.175:0/3235011411 >> v1:172.21.15.175:6789/0 conn(0x7f36400b2700 legacy=0x7f36400b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.424+0000 7f363f400640 1 -- 172.21.15.175:0/3235011411 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364015c400 con 0x7f36400b4970 2024-04-25T09:13:52.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f363f400640 1 --2- 172.21.15.175:0/3235011411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36400b4970 0x7f364015c920 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f36380097c0 tx=0x7f363801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39f1d132fdf4507a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:52.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f363e000640 1 -- 172.21.15.175:0/3235011411 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36380b0070 con 0x7f36400b4970 2024-04-25T09:13:52.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f363e000640 1 -- 172.21.15.175:0/3235011411 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36400af1c0 con 0x7f36400b4970 2024-04-25T09:13:52.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f363e000640 1 -- 172.21.15.175:0/3235011411 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36380ab820 con 0x7f36400b4970 2024-04-25T09:13:52.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f3645a00640 1 -- 172.21.15.175:0/3235011411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36400b4970 msgr2=0x7f364015c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f3645a00640 1 --2- 172.21.15.175:0/3235011411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36400b4970 0x7f364015c920 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f36380097c0 tx=0x7f363801c410 comp rx=0 tx=0).stop 2024-04-25T09:13:52.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f3645a00640 1 -- 172.21.15.175:0/3235011411 shutdown_connections 2024-04-25T09:13:52.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f3645a00640 1 --2- 172.21.15.175:0/3235011411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36400b4970 0x7f364015c920 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f3645a00640 1 --2- 172.21.15.175:0/3235011411 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36400aebd0 0x7f364015b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f3645a00640 1 -- 172.21.15.175:0/3235011411 >> 172.21.15.175:0/3235011411 conn(0x7f364006ac50 msgr2=0x7f364006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:52.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f3645a00640 1 -- 172.21.15.175:0/3235011411 shutdown_connections 2024-04-25T09:13:52.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f3645a00640 1 -- 172.21.15.175:0/3235011411 wait complete. 2024-04-25T09:13:52.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f3645a00640 1 Processor -- start 2024-04-25T09:13:52.416 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f3645a00640 1 -- start start 2024-04-25T09:13:52.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f3645a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36400aebd0 0x7f36400b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f3645a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36400b2700 0x7f36401551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f3645a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36400b4970 0x7f36401f9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f3645a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364015da80 con 0x7f36400aebd0 2024-04-25T09:13:52.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f3645a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364015d900 con 0x7f36400b4970 2024-04-25T09:13:52.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.428+0000 7f3645a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364015dc00 con 0x7f36400b2700 2024-04-25T09:13:52.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f363ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36400aebd0 0x7f36400b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f363ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36400aebd0 0x7f36400b1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51022/0 (socket says 172.21.15.175:51022) 2024-04-25T09:13:52.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f363ea00640 1 -- 172.21.15.175:0/1797469217 learned_addr learned my addr 172.21.15.175:0/1797469217 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:52.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f363f400640 1 --2- 172.21.15.175:0/1797469217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36400b4970 0x7f36401f9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f363ea00640 1 -- 172.21.15.175:0/1797469217 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36400b2700 msgr2=0x7f36401551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f3636000640 1 --2- 172.21.15.175:0/1797469217 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36400b2700 0x7f36401551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f363ea00640 1 --2- 172.21.15.175:0/1797469217 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36400b2700 0x7f36401551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.419 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f363ea00640 1 -- 172.21.15.175:0/1797469217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36400b4970 msgr2=0x7f36401f9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:52.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f363ea00640 1 --2- 172.21.15.175:0/1797469217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36400b4970 0x7f36401f9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:52.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f363ea00640 1 -- 172.21.15.175:0/1797469217 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36400ac8c0 con 0x7f36400aebd0 2024-04-25T09:13:52.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f363f400640 1 --2- 172.21.15.175:0/1797469217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36400b4970 0x7f36401f9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:52.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f3636000640 1 --2- 172.21.15.175:0/1797469217 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36400b2700 0x7f36401551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:52.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f363ea00640 1 --2- 172.21.15.175:0/1797469217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36400aebd0 0x7f36400b1f70 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f363000efc0 tx=0x7f363000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:52.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f3637400640 1 -- 172.21.15.175:0/1797469217 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630018020 con 0x7f36400aebd0 2024-04-25T09:13:52.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f3637400640 1 -- 172.21.15.175:0/1797469217 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3630014480 con 0x7f36400aebd0 2024-04-25T09:13:52.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f3637400640 1 -- 172.21.15.175:0/1797469217 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630014850 con 0x7f36400aebd0 2024-04-25T09:13:52.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f3645a00640 1 -- 172.21.15.175:0/1797469217 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36400acba0 con 0x7f36400aebd0 2024-04-25T09:13:52.420 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f3645a00640 1 -- 172.21.15.175:0/1797469217 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36400ad160 con 0x7f36400aebd0 2024-04-25T09:13:52.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f3645a00640 1 -- 172.21.15.175:0/1797469217 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3640075160 con 0x7f36400aebd0 2024-04-25T09:13:52.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f3637400640 1 -- 172.21.15.175:0/1797469217 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f363001b020 con 0x7f36400aebd0 2024-04-25T09:13:52.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.432+0000 7f3637400640 1 --2- 172.21.15.175:0/1797469217 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f361c066f60 0x7f361c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:52.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.436+0000 7f3637400640 1 -- 172.21.15.175:0/1797469217 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f3630085c30 con 0x7f36400aebd0 2024-04-25T09:13:52.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.436+0000 7f3636000640 1 --2- 172.21.15.175:0/1797469217 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f361c066f60 0x7f361c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:52.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.436+0000 7f3636000640 1 --2- 172.21.15.175:0/1797469217 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f361c066f60 0x7f361c069420 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3640165480 tx=0x7f3628009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:52.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.440+0000 7f3637400640 1 -- 172.21.15.175:0/1797469217 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3630022070 con 0x7f36400aebd0 2024-04-25T09:13:52.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:52.596+0000 7f3645a00640 1 -- 172.21.15.175:0/1797469217 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f364006c2d0 con 0x7f36400aebd0 2024-04-25T09:13:53.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.264+0000 7f3637400640 1 -- 172.21.15.175:0/1797469217 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v103) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3630010040 con 0x7f36400aebd0 2024-04-25T09:13:53.253 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:13:53.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.268+0000 7f3645a00640 1 -- 172.21.15.175:0/1797469217 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f361c066f60 msgr2=0x7f361c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:53.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.268+0000 7f3645a00640 1 --2- 172.21.15.175:0/1797469217 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f361c066f60 0x7f361c069420 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3640165480 tx=0x7f3628009040 comp rx=0 tx=0).stop 2024-04-25T09:13:53.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.268+0000 7f3645a00640 1 -- 172.21.15.175:0/1797469217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36400aebd0 msgr2=0x7f36400b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:53.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.268+0000 7f3645a00640 1 --2- 172.21.15.175:0/1797469217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36400aebd0 0x7f36400b1f70 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f363000efc0 tx=0x7f363000c490 comp rx=0 tx=0).stop 2024-04-25T09:13:53.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.268+0000 7f3645a00640 1 -- 172.21.15.175:0/1797469217 shutdown_connections 2024-04-25T09:13:53.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.268+0000 7f3645a00640 1 --2- 172.21.15.175:0/1797469217 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f361c066f60 0x7f361c069420 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.268+0000 7f3645a00640 1 --2- 172.21.15.175:0/1797469217 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36400b4970 0x7f36401f9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.268+0000 7f3645a00640 1 --2- 172.21.15.175:0/1797469217 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36400b2700 0x7f36401551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.268+0000 7f3645a00640 1 --2- 172.21.15.175:0/1797469217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36400aebd0 0x7f36400b1f70 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.268+0000 7f3645a00640 1 -- 172.21.15.175:0/1797469217 >> 172.21.15.175:0/1797469217 conn(0x7f364006ac50 msgr2=0x7f36400b4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:53.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.268+0000 7f3645a00640 1 -- 172.21.15.175:0/1797469217 shutdown_connections 2024-04-25T09:13:53.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.268+0000 7f3645a00640 1 -- 172.21.15.175:0/1797469217 wait complete. 2024-04-25T09:13:53.281 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:13:53.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.436+0000 7f96a9600640 1 Processor -- start 2024-04-25T09:13:53.424 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.436+0000 7f96a9600640 1 -- start start 2024-04-25T09:13:53.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.436+0000 7f96a9600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f96a40aebd0 0x7f96a415b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:53.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.436+0000 7f96a9600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f96a40b2700 0x7f96a40b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:53.425 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.436+0000 7f96a9600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a415b880 con 0x7f96a40b47a0 2024-04-25T09:13:53.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.436+0000 7f96a9600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a40b4c10 con 0x7f96a40b2700 2024-04-25T09:13:53.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.436+0000 7f96a9600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a415bb60 con 0x7f96a40aebd0 2024-04-25T09:13:53.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.440+0000 7f96a3400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f96a40b47a0 0x7f96a406d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44036/0 (socket says 172.21.15.175:44036) 2024-04-25T09:13:53.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.440+0000 7f969a000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f96a40b2700 0x7f96a40b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:53.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.440+0000 7f96a3400640 1 -- 172.21.15.175:0/3054652093 learned_addr learned my addr 172.21.15.175:0/3054652093 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:53.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.440+0000 7f96a2a00640 1 --2- 172.21.15.175:0/3054652093 >> v2:172.21.15.177:3300/0 conn(0x7f96a40aebd0 0x7f96a415b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:53.426 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.440+0000 7f969a000640 1 -- 172.21.15.175:0/3054652093 >> v2:172.21.15.177:3300/0 conn(0x7f96a40aebd0 msgr2=0x7f96a415b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:53.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.440+0000 7f969a000640 1 --2- 172.21.15.175:0/3054652093 >> v2:172.21.15.177:3300/0 conn(0x7f96a40aebd0 0x7f96a415b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.440+0000 7f969a000640 1 -- 172.21.15.175:0/3054652093 >> v1:172.21.15.175:6789/0 conn(0x7f96a40b47a0 legacy=0x7f96a406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:53.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.440+0000 7f969a000640 1 -- 172.21.15.175:0/3054652093 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a415be40 con 0x7f96a40b2700 2024-04-25T09:13:53.427 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.440+0000 7f96a2000640 1 -- 172.21.15.175:0/3054652093 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511966075 0 0) 0x7f96a415b880 con 0x7f96a40b47a0 2024-04-25T09:13:53.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.440+0000 7f969a000640 1 --2- 172.21.15.175:0/3054652093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96a40b2700 0x7f96a40b4260 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f96a40d07f0 tx=0x7f968c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8219c73ccef433 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:53.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.440+0000 7f96a2000640 1 -- 172.21.15.175:0/3054652093 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c0b0070 con 0x7f96a40b2700 2024-04-25T09:13:53.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.440+0000 7f96a2000640 1 -- 172.21.15.175:0/3054652093 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c0ab600 con 0x7f96a40b2700 2024-04-25T09:13:53.429 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.440+0000 7f96a2000640 1 -- 172.21.15.175:0/3054652093 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c0ab9d0 con 0x7f96a40b2700 2024-04-25T09:13:53.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f96a9600640 1 -- 172.21.15.175:0/3054652093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96a40b2700 msgr2=0x7f96a40b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:53.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f96a9600640 1 --2- 172.21.15.175:0/3054652093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96a40b2700 0x7f96a40b4260 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f96a40d07f0 tx=0x7f968c01c480 comp rx=0 tx=0).stop 2024-04-25T09:13:53.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f96a9600640 1 -- 172.21.15.175:0/3054652093 shutdown_connections 2024-04-25T09:13:53.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f96a9600640 1 --2- 172.21.15.175:0/3054652093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96a40b2700 0x7f96a40b4260 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f96a9600640 1 --2- 172.21.15.175:0/3054652093 >> v2:172.21.15.177:3300/0 conn(0x7f96a40aebd0 0x7f96a415b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f96a9600640 1 -- 172.21.15.175:0/3054652093 >> 172.21.15.175:0/3054652093 conn(0x7f96a406ac50 msgr2=0x7f96a406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:53.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f96a9600640 1 -- 172.21.15.175:0/3054652093 shutdown_connections 2024-04-25T09:13:53.430 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f96a9600640 1 -- 172.21.15.175:0/3054652093 wait complete. 2024-04-25T09:13:53.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f96a9600640 1 Processor -- start 2024-04-25T09:13:53.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f96a9600640 1 -- start start 2024-04-25T09:13:53.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f96a9600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96a40aebd0 0x7f96a40b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:53.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f96a9600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96a40b2700 0x7f96a40c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:53.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f96a9600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96a40b47a0 0x7f96a4155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:53.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f96a9600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a41677f0 con 0x7f96a40b2700 2024-04-25T09:13:53.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f96a9600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a4167670 con 0x7f96a40aebd0 2024-04-25T09:13:53.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f96a9600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a4167970 con 0x7f96a40b47a0 2024-04-25T09:13:53.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f969a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96a40b2700 0x7f96a40c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:53.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f969a000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96a40b2700 0x7f96a40c4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51038/0 (socket says 172.21.15.175:51038) 2024-04-25T09:13:53.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f969a000640 1 -- 172.21.15.175:0/1413434301 learned_addr learned my addr 172.21.15.175:0/1413434301 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:53.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f96a3400640 1 --2- 172.21.15.175:0/1413434301 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96a40b47a0 0x7f96a4155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:53.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f96a2a00640 1 --2- 172.21.15.175:0/1413434301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96a40aebd0 0x7f96a40b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:53.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f969a000640 1 -- 172.21.15.175:0/1413434301 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96a40b47a0 msgr2=0x7f96a4155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:53.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f969a000640 1 --2- 172.21.15.175:0/1413434301 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96a40b47a0 0x7f96a4155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f969a000640 1 -- 172.21.15.175:0/1413434301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96a40aebd0 msgr2=0x7f96a40b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:53.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f969a000640 1 --2- 172.21.15.175:0/1413434301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96a40aebd0 0x7f96a40b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:53.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f969a000640 1 -- 172.21.15.175:0/1413434301 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a40c4bb0 con 0x7f96a40b2700 2024-04-25T09:13:53.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.444+0000 7f969a000640 1 --2- 172.21.15.175:0/1413434301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96a40b2700 0x7f96a40c4670 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f968c019090 tx=0x7f968c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:53.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.448+0000 7f969b400640 1 -- 172.21.15.175:0/1413434301 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c0b0040 con 0x7f96a40b2700 2024-04-25T09:13:53.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.448+0000 7f969b400640 1 -- 172.21.15.175:0/1413434301 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c0ba070 con 0x7f96a40b2700 2024-04-25T09:13:53.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.448+0000 7f96a9600640 1 -- 172.21.15.175:0/1413434301 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a40c4e80 con 0x7f96a40b2700 2024-04-25T09:13:53.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.448+0000 7f969b400640 1 -- 172.21.15.175:0/1413434301 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c0b4630 con 0x7f96a40b2700 2024-04-25T09:13:53.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.448+0000 7f96a9600640 1 -- 172.21.15.175:0/1413434301 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a40c5440 con 0x7f96a40b2700 2024-04-25T09:13:53.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.448+0000 7f96a9600640 1 -- 172.21.15.175:0/1413434301 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a4075160 con 0x7f96a40b2700 2024-04-25T09:13:53.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.448+0000 7f969b400640 1 -- 172.21.15.175:0/1413434301 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f968c0b47d0 con 0x7f96a40b2700 2024-04-25T09:13:53.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.448+0000 7f969b400640 1 --2- 172.21.15.175:0/1413434301 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9680066f90 0x7f9680069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:53.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.448+0000 7f969b400640 1 -- 172.21.15.175:0/1413434301 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5443+0+0 (secure 0 0 0) 0x7f968c11ead0 con 0x7f96a40b2700 2024-04-25T09:13:53.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.448+0000 7f96a2a00640 1 --2- 172.21.15.175:0/1413434301 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9680066f90 0x7f9680069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:53.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.452+0000 7f96a2a00640 1 --2- 172.21.15.175:0/1413434301 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9680066f90 0x7f9680069450 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9694009ac0 tx=0x7f9694009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:53.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.452+0000 7f969b400640 1 -- 172.21.15.175:0/1413434301 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f968c016070 con 0x7f96a40b2700 2024-04-25T09:13:53.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:53.616+0000 7f96a9600640 1 -- 172.21.15.175:0/1413434301 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f96a40c5680 con 0x7f96a40b2700 2024-04-25T09:13:54.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.272+0000 7f969b400640 1 -- 172.21.15.175:0/1413434301 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v104) v1 ==== 169+0+0 (secure 0 0 0) 0x7f968c0ef4f0 con 0x7f96a40b2700 2024-04-25T09:13:54.261 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_data' removed 2024-04-25T09:13:54.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.276+0000 7f96a9600640 1 -- 172.21.15.175:0/1413434301 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9680066f90 msgr2=0x7f9680069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:54.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.276+0000 7f96a9600640 1 --2- 172.21.15.175:0/1413434301 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9680066f90 0x7f9680069450 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f9694009ac0 tx=0x7f9694009190 comp rx=0 tx=0).stop 2024-04-25T09:13:54.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.276+0000 7f96a9600640 1 -- 172.21.15.175:0/1413434301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96a40b2700 msgr2=0x7f96a40c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:54.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.276+0000 7f96a9600640 1 --2- 172.21.15.175:0/1413434301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96a40b2700 0x7f96a40c4670 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f968c019090 tx=0x7f968c019220 comp rx=0 tx=0).stop 2024-04-25T09:13:54.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.276+0000 7f96a9600640 1 -- 172.21.15.175:0/1413434301 shutdown_connections 2024-04-25T09:13:54.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.276+0000 7f96a9600640 1 --2- 172.21.15.175:0/1413434301 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9680066f90 0x7f9680069450 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.276+0000 7f96a9600640 1 --2- 172.21.15.175:0/1413434301 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f96a40b47a0 0x7f96a4155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.276+0000 7f96a9600640 1 --2- 172.21.15.175:0/1413434301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96a40b2700 0x7f96a40c4670 secure :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f968c019090 tx=0x7f968c019220 comp rx=0 tx=0).stop 2024-04-25T09:13:54.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.276+0000 7f96a9600640 1 --2- 172.21.15.175:0/1413434301 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f96a40aebd0 0x7f96a40b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.276+0000 7f96a9600640 1 -- 172.21.15.175:0/1413434301 >> 172.21.15.175:0/1413434301 conn(0x7f96a406ac50 msgr2=0x7f96a406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:54.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.280+0000 7f96a9600640 1 -- 172.21.15.175:0/1413434301 shutdown_connections 2024-04-25T09:13:54.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.280+0000 7f96a9600640 1 -- 172.21.15.175:0/1413434301 wait complete. 2024-04-25T09:13:54.292 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:13:54.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.444+0000 7fc492400640 1 Processor -- start 2024-04-25T09:13:54.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.444+0000 7fc492400640 1 -- start start 2024-04-25T09:13:54.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.448+0000 7fc492400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc48c0cf6b0 0x7fc48c1600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:54.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.448+0000 7fc492400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48c0cfd10 con 0x7fc48c0ce970 2024-04-25T09:13:54.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.448+0000 7fc492400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48c0cfff0 con 0x7fc48c145250 2024-04-25T09:13:54.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.448+0000 7fc492400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48c1605e0 con 0x7fc48c0cf6b0 2024-04-25T09:13:54.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.448+0000 7fc48aa00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc48c0cf6b0 0x7fc48c1600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:54.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.448+0000 7fc48be00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc48c0ce970 0x7fc48c0cedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44038/0 (socket says 172.21.15.175:44038) 2024-04-25T09:13:54.434 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.448+0000 7fc48be00640 1 -- 172.21.15.175:0/2496752631 learned_addr learned my addr 172.21.15.175:0/2496752631 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:54.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.448+0000 7fc48aa00640 1 -- 172.21.15.175:0/2496752631 >> v1:172.21.15.177:6789/0 conn(0x7fc48c145250 legacy=0x7fc48c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:54.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.448+0000 7fc48aa00640 1 -- 172.21.15.175:0/2496752631 >> v1:172.21.15.175:6789/0 conn(0x7fc48c0ce970 legacy=0x7fc48c0cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:54.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.448+0000 7fc48aa00640 1 -- 172.21.15.175:0/2496752631 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c15f8a0 con 0x7fc48c0cf6b0 2024-04-25T09:13:54.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.452+0000 7fc48aa00640 1 --2- 172.21.15.175:0/2496752631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c0cf6b0 0x7fc48c1600a0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fc4780097f0 tx=0x7fc47801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834a0f7059511896 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:54.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.452+0000 7fc48a000640 1 -- 172.21.15.175:0/2496752631 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4780b0070 con 0x7fc48c0cf6b0 2024-04-25T09:13:54.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.452+0000 7fc48a000640 1 -- 172.21.15.175:0/2496752631 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4780ab600 con 0x7fc48c0cf6b0 2024-04-25T09:13:54.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.452+0000 7fc48a000640 1 -- 172.21.15.175:0/2496752631 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4780a4e60 con 0x7fc48c0cf6b0 2024-04-25T09:13:54.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.452+0000 7fc492400640 1 -- 172.21.15.175:0/2496752631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c0cf6b0 msgr2=0x7fc48c1600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.452+0000 7fc492400640 1 --2- 172.21.15.175:0/2496752631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c0cf6b0 0x7fc48c1600a0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fc4780097f0 tx=0x7fc47801c3d0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.452+0000 7fc492400640 1 -- 172.21.15.175:0/2496752631 shutdown_connections 2024-04-25T09:13:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.452+0000 7fc492400640 1 --2- 172.21.15.175:0/2496752631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c0cf6b0 0x7fc48c1600a0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.452+0000 7fc492400640 1 -- 172.21.15.175:0/2496752631 >> 172.21.15.175:0/2496752631 conn(0x7fc48c06ac50 msgr2=0x7fc48c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.452+0000 7fc492400640 1 -- 172.21.15.175:0/2496752631 shutdown_connections 2024-04-25T09:13:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.452+0000 7fc492400640 1 -- 172.21.15.175:0/2496752631 wait complete. 2024-04-25T09:13:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.452+0000 7fc492400640 1 Processor -- start 2024-04-25T09:13:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.452+0000 7fc492400640 1 -- start start 2024-04-25T09:13:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.452+0000 7fc492400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c0ce970 0x7fc48c13c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.452+0000 7fc492400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc48c0cf6b0 0x7fc48c0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.452+0000 7fc492400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c145250 0x7fc48c15d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.452+0000 7fc492400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c15cc00 con 0x7fc48c0ce970 2024-04-25T09:13:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc492400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c15ca80 con 0x7fc48c0cf6b0 2024-04-25T09:13:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc492400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c1697f0 con 0x7fc48c145250 2024-04-25T09:13:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc48b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c0ce970 0x7fc48c13c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:54.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc48b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c0ce970 0x7fc48c13c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51068/0 (socket says 172.21.15.175:51068) 2024-04-25T09:13:54.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc48b400640 1 -- 172.21.15.175:0/211241001 learned_addr learned my addr 172.21.15.175:0/211241001 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:54.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc48aa00640 1 --2- 172.21.15.175:0/211241001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc48c0cf6b0 0x7fc48c0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:54.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc48be00640 1 --2- 172.21.15.175:0/211241001 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c145250 0x7fc48c15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:54.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc48b400640 1 -- 172.21.15.175:0/211241001 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c145250 msgr2=0x7fc48c15d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:54.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc48b400640 1 --2- 172.21.15.175:0/211241001 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c145250 0x7fc48c15d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc48b400640 1 -- 172.21.15.175:0/211241001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc48c0cf6b0 msgr2=0x7fc48c0ac8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:54.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc48b400640 1 --2- 172.21.15.175:0/211241001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc48c0cf6b0 0x7fc48c0ac8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc48b400640 1 -- 172.21.15.175:0/211241001 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c13c700 con 0x7fc48c0ce970 2024-04-25T09:13:54.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc48b400640 1 --2- 172.21.15.175:0/211241001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c0ce970 0x7fc48c13c1c0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00b440 tx=0x7fc47c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:54.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc483400640 1 -- 172.21.15.175:0/211241001 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c015020 con 0x7fc48c0ce970 2024-04-25T09:13:54.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc483400640 1 -- 172.21.15.175:0/211241001 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c011890 con 0x7fc48c0ce970 2024-04-25T09:13:54.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc483400640 1 -- 172.21.15.175:0/211241001 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c011c80 con 0x7fc48c0ce970 2024-04-25T09:13:54.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc492400640 1 -- 172.21.15.175:0/211241001 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48c0ad310 con 0x7fc48c0ce970 2024-04-25T09:13:54.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc492400640 1 -- 172.21.15.175:0/211241001 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48c0ad8d0 con 0x7fc48c0ce970 2024-04-25T09:13:54.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc492400640 1 -- 172.21.15.175:0/211241001 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48c075160 con 0x7fc48c0ce970 2024-04-25T09:13:54.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.456+0000 7fc483400640 1 -- 172.21.15.175:0/211241001 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc47c018020 con 0x7fc48c0ce970 2024-04-25T09:13:54.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.460+0000 7fc483400640 1 --2- 172.21.15.175:0/211241001 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc46c066f60 0x7fc46c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:54.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.460+0000 7fc483400640 1 -- 172.21.15.175:0/211241001 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc47c084b60 con 0x7fc48c0ce970 2024-04-25T09:13:54.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.460+0000 7fc48aa00640 1 --2- 172.21.15.175:0/211241001 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc46c066f60 0x7fc46c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:54.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.460+0000 7fc48aa00640 1 --2- 172.21.15.175:0/211241001 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc46c066f60 0x7fc46c069420 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc4780ad000 tx=0x7fc478008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:54.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.460+0000 7fc483400640 1 -- 172.21.15.175:0/211241001 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc47c01f030 con 0x7fc48c0ce970 2024-04-25T09:13:54.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.616+0000 7fc492400640 1 -- 172.21.15.175:0/211241001 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc48c0ced80 con 0x7fc48c0ce970 2024-04-25T09:13:54.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.620+0000 7fc483400640 1 -- 172.21.15.175:0/211241001 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc47c00d040 con 0x7fc48c0ce970 2024-04-25T09:13:54.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.624+0000 7fc492400640 1 -- 172.21.15.175:0/211241001 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc46c066f60 msgr2=0x7fc46c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:54.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.624+0000 7fc492400640 1 --2- 172.21.15.175:0/211241001 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc46c066f60 0x7fc46c069420 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc4780ad000 tx=0x7fc478008040 comp rx=0 tx=0).stop 2024-04-25T09:13:54.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.624+0000 7fc492400640 1 -- 172.21.15.175:0/211241001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c0ce970 msgr2=0x7fc48c13c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:54.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.624+0000 7fc492400640 1 --2- 172.21.15.175:0/211241001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c0ce970 0x7fc48c13c1c0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00b440 tx=0x7fc47c00b900 comp rx=0 tx=0).stop 2024-04-25T09:13:54.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.624+0000 7fc492400640 1 -- 172.21.15.175:0/211241001 shutdown_connections 2024-04-25T09:13:54.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.624+0000 7fc492400640 1 --2- 172.21.15.175:0/211241001 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc46c066f60 0x7fc46c069420 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.624+0000 7fc492400640 1 --2- 172.21.15.175:0/211241001 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c145250 0x7fc48c15d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.624+0000 7fc492400640 1 --2- 172.21.15.175:0/211241001 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc48c0cf6b0 0x7fc48c0ac8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.624+0000 7fc492400640 1 --2- 172.21.15.175:0/211241001 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c0ce970 0x7fc48c13c1c0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.624+0000 7fc492400640 1 -- 172.21.15.175:0/211241001 >> 172.21.15.175:0/211241001 conn(0x7fc48c06ac50 msgr2=0x7fc48c06d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:54.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.624+0000 7fc492400640 1 -- 172.21.15.175:0/211241001 shutdown_connections 2024-04-25T09:13:54.612 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.624+0000 7fc492400640 1 -- 172.21.15.175:0/211241001 wait complete. 2024-04-25T09:13:54.630 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-04-25T09:13:54.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.776+0000 7f77a3e00640 1 Processor -- start 2024-04-25T09:13:54.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.776+0000 7f77a3e00640 1 -- start start 2024-04-25T09:13:54.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.780+0000 7f77a3e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f779c0cd520 0x7f779c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:54.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.780+0000 7f77a3e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f779c0cf560 0x7f779c0cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:54.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.780+0000 7f77a3e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779c0cda00 con 0x7f779c15a900 2024-04-25T09:13:54.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.780+0000 7f77a3e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779c15bcf0 con 0x7f779c0cf560 2024-04-25T09:13:54.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.780+0000 7f77a3e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779c0cfed0 con 0x7f779c0cd520 2024-04-25T09:13:54.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.780+0000 7f77a1e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f779c0cf560 0x7f779c0cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:54.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.780+0000 7f77a1e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f779c0cf560 0x7f779c0cf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51078/0 (socket says 172.21.15.175:51078) 2024-04-25T09:13:54.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.780+0000 7f77a1e00640 1 -- 172.21.15.175:0/1996920551 learned_addr learned my addr 172.21.15.175:0/1996920551 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:54.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.780+0000 7f77a0a00640 1 --2- 172.21.15.175:0/1996920551 >> v2:172.21.15.177:3300/0 conn(0x7f779c0cd520 0x7f779c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:54.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.780+0000 7f77a1e00640 1 -- 172.21.15.175:0/1996920551 >> v2:172.21.15.177:3300/0 conn(0x7f779c0cd520 msgr2=0x7f779c06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:54.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.780+0000 7f77a1e00640 1 --2- 172.21.15.175:0/1996920551 >> v2:172.21.15.177:3300/0 conn(0x7f779c0cd520 0x7f779c06e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.780+0000 7f77a1e00640 1 -- 172.21.15.175:0/1996920551 >> v1:172.21.15.177:6789/0 conn(0x7f779c15a900 legacy=0x7f779c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:54.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.780+0000 7f77a1e00640 1 -- 172.21.15.175:0/1996920551 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c0cdce0 con 0x7f779c0cf560 2024-04-25T09:13:54.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.780+0000 7f77a1e00640 1 --2- 172.21.15.175:0/1996920551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f779c0cf560 0x7f779c0cf990 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f779c0cf510 tx=0x7f779401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8519f5b2423d6f86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:54.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.780+0000 7f779be00640 1 -- 172.21.15.175:0/1996920551 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77940a57a0 con 0x7f779c0cf560 2024-04-25T09:13:54.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f779be00640 1 -- 172.21.15.175:0/1996920551 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77940a5940 con 0x7f779c0cf560 2024-04-25T09:13:54.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f779be00640 1 -- 172.21.15.175:0/1996920551 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77940a5d10 con 0x7f779c0cf560 2024-04-25T09:13:54.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a3e00640 1 -- 172.21.15.175:0/1996920551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f779c0cf560 msgr2=0x7f779c0cf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:54.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a3e00640 1 --2- 172.21.15.175:0/1996920551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f779c0cf560 0x7f779c0cf990 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f779c0cf510 tx=0x7f779401c9f0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a3e00640 1 -- 172.21.15.175:0/1996920551 shutdown_connections 2024-04-25T09:13:54.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a3e00640 1 --2- 172.21.15.175:0/1996920551 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f779c0cf560 0x7f779c0cf990 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a3e00640 1 --2- 172.21.15.175:0/1996920551 >> v2:172.21.15.177:3300/0 conn(0x7f779c0cd520 0x7f779c06e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a3e00640 1 -- 172.21.15.175:0/1996920551 >> 172.21.15.175:0/1996920551 conn(0x7f779c067150 msgr2=0x7f779c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:54.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a3e00640 1 -- 172.21.15.175:0/1996920551 shutdown_connections 2024-04-25T09:13:54.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a3e00640 1 -- 172.21.15.175:0/1996920551 wait complete. 2024-04-25T09:13:54.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a3e00640 1 Processor -- start 2024-04-25T09:13:54.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a3e00640 1 -- start start 2024-04-25T09:13:54.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a3e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f779c0cf560 0x7f779c152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:54.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f779c15a900 0x7f779c14b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:54.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f779c150f30 0x7f779c14ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:54.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a3e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c06d530 con 0x7f779c15a900 2024-04-25T09:13:54.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a3e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c06d3b0 con 0x7f779c150f30 2024-04-25T09:13:54.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a3e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c15c790 con 0x7f779c0cf560 2024-04-25T09:13:54.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a0a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f779c15a900 0x7f779c14b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:54.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a0a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f779c15a900 0x7f779c14b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51094/0 (socket says 172.21.15.175:51094) 2024-04-25T09:13:54.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a0a00640 1 -- 172.21.15.175:0/3394383447 learned_addr learned my addr 172.21.15.175:0/3394383447 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:54.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a1e00640 1 --2- 172.21.15.175:0/3394383447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f779c150f30 0x7f779c14ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:54.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a1400640 1 --2- 172.21.15.175:0/3394383447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f779c0cf560 0x7f779c152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:54.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a0a00640 1 -- 172.21.15.175:0/3394383447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f779c0cf560 msgr2=0x7f779c152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:54.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a0a00640 1 --2- 172.21.15.175:0/3394383447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f779c0cf560 0x7f779c152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a0a00640 1 -- 172.21.15.175:0/3394383447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f779c150f30 msgr2=0x7f779c14ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:54.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a0a00640 1 --2- 172.21.15.175:0/3394383447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f779c150f30 0x7f779c14ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:54.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a0a00640 1 -- 172.21.15.175:0/3394383447 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c1514a0 con 0x7f779c15a900 2024-04-25T09:13:54.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.784+0000 7f77a1e00640 1 --2- 172.21.15.175:0/3394383447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f779c150f30 0x7f779c14ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:54.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.788+0000 7f77a0a00640 1 --2- 172.21.15.175:0/3394383447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f779c15a900 0x7f779c14b560 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f778800e900 tx=0x7f778800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:54.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.788+0000 7f7799600640 1 -- 172.21.15.175:0/3394383447 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788017070 con 0x7f779c15a900 2024-04-25T09:13:54.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.788+0000 7f7799600640 1 -- 172.21.15.175:0/3394383447 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778800ca00 con 0x7f779c15a900 2024-04-25T09:13:54.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.788+0000 7f77a3e00640 1 -- 172.21.15.175:0/3394383447 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779c151780 con 0x7f779c15a900 2024-04-25T09:13:54.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.788+0000 7f7799600640 1 -- 172.21.15.175:0/3394383447 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778800cdf0 con 0x7f779c15a900 2024-04-25T09:13:54.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.788+0000 7f77a3e00640 1 -- 172.21.15.175:0/3394383447 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779c151d40 con 0x7f779c15a900 2024-04-25T09:13:54.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.788+0000 7f77a3e00640 1 -- 172.21.15.175:0/3394383447 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f779c074a60 con 0x7f779c15a900 2024-04-25T09:13:54.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.788+0000 7f7799600640 1 -- 172.21.15.175:0/3394383447 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f778801a070 con 0x7f779c15a900 2024-04-25T09:13:54.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.788+0000 7f7799600640 1 --2- 172.21.15.175:0/3394383447 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f777c066f90 0x7f777c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:54.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.788+0000 7f7799600640 1 -- 172.21.15.175:0/3394383447 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7788084de0 con 0x7f779c15a900 2024-04-25T09:13:54.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.788+0000 7f77a1400640 1 --2- 172.21.15.175:0/3394383447 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f777c066f90 0x7f777c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:54.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.792+0000 7f77a1400640 1 --2- 172.21.15.175:0/3394383447 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f777c066f90 0x7f777c069450 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f77900015b0 tx=0x7f7790009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:54.781 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:54.796+0000 7f7799600640 1 -- 172.21.15.175:0/3394383447 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7788055ff0 con 0x7f779c15a900 2024-04-25T09:13:54.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.000+0000 7f77a3e00640 1 -- 172.21.15.175:0/3394383447 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) v1 -- 0x7f779c1507a0 con 0x7f779c15a900 2024-04-25T09:13:55.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.276+0000 7f7799600640 1 -- 172.21.15.175:0/3394383447 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v463) v1 ==== 146+0+0 (secure 0 0 0) 0x7f77880558f0 con 0x7f779c15a900 2024-04-25T09:13:55.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.276+0000 7f77a3e00640 1 -- 172.21.15.175:0/3394383447 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f777c066f90 msgr2=0x7f777c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.276+0000 7f77a3e00640 1 --2- 172.21.15.175:0/3394383447 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f777c066f90 0x7f777c069450 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f77900015b0 tx=0x7f7790009040 comp rx=0 tx=0).stop 2024-04-25T09:13:55.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.276+0000 7f77a3e00640 1 -- 172.21.15.175:0/3394383447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f779c15a900 msgr2=0x7f779c14b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.276+0000 7f77a3e00640 1 --2- 172.21.15.175:0/3394383447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f779c15a900 0x7f779c14b560 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f778800e900 tx=0x7f778800edc0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.276+0000 7f77a3e00640 1 -- 172.21.15.175:0/3394383447 shutdown_connections 2024-04-25T09:13:55.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.276+0000 7f77a3e00640 1 --2- 172.21.15.175:0/3394383447 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f777c066f90 0x7f777c069450 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.276+0000 7f77a3e00640 1 --2- 172.21.15.175:0/3394383447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f779c150f30 0x7f779c14ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.276+0000 7f77a3e00640 1 --2- 172.21.15.175:0/3394383447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f779c15a900 0x7f779c14b560 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.276+0000 7f77a3e00640 1 --2- 172.21.15.175:0/3394383447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f779c0cf560 0x7f779c152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.276+0000 7f77a3e00640 1 -- 172.21.15.175:0/3394383447 >> 172.21.15.175:0/3394383447 conn(0x7f779c0cd520 msgr2=0x7f779c155a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:55.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.276+0000 7f77a3e00640 1 -- 172.21.15.175:0/3394383447 shutdown_connections 2024-04-25T09:13:55.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.276+0000 7f77a3e00640 1 -- 172.21.15.175:0/3394383447 wait complete. 2024-04-25T09:13:55.285 INFO:tasks.cephfs_test_runner:test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-25T09:13:55.285 INFO:tasks.cephfs_test_runner:Starting test: test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:13:55.286 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:13:55.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.444+0000 7ff6fd800640 1 Processor -- start 2024-04-25T09:13:55.431 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.444+0000 7ff6fd800640 1 -- start start 2024-04-25T09:13:55.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.444+0000 7ff6fd800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff6f8144fc0 0x7ff6f80cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.444+0000 7ff6fd800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6f81453a0 0x7ff6f815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.444+0000 7ff6fd800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff6f80cc3b0 0x7ff6f815c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.444+0000 7ff6fd800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f815cd00 con 0x7ff6f80cc3b0 2024-04-25T09:13:55.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.444+0000 7ff6fd800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f80ce660 con 0x7ff6f8144fc0 2024-04-25T09:13:55.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.444+0000 7ff6fd800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f80cc930 con 0x7ff6f81453a0 2024-04-25T09:13:55.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.444+0000 7ff6f7400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff6f80cc3b0 0x7ff6f815c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.432 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.444+0000 7ff6f7400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff6f80cc3b0 0x7ff6f815c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51098/0 (socket says 172.21.15.175:51098) 2024-04-25T09:13:55.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.444+0000 7ff6f7400640 1 -- 172.21.15.175:0/3538043906 learned_addr learned my addr 172.21.15.175:0/3538043906 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:55.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.444+0000 7ff6f7400640 1 -- 172.21.15.175:0/3538043906 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6f81453a0 msgr2=0x7ff6f815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:55.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.444+0000 7ff6f7400640 1 --2- 172.21.15.175:0/3538043906 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6f81453a0 0x7ff6f815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.444+0000 7ff6f7400640 1 -- 172.21.15.175:0/3538043906 >> v2:172.21.15.177:3300/0 conn(0x7ff6f8144fc0 msgr2=0x7ff6f80cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:55.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.444+0000 7ff6f7400640 1 --2- 172.21.15.175:0/3538043906 >> v2:172.21.15.177:3300/0 conn(0x7ff6f8144fc0 0x7ff6f80cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.433 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.444+0000 7ff6f7400640 1 -- 172.21.15.175:0/3538043906 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f80ccc10 con 0x7ff6f80cc3b0 2024-04-25T09:13:55.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.448+0000 7ff6f7400640 1 --2- 172.21.15.175:0/3538043906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6f80cc3b0 0x7ff6f815c410 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80b4c00 tx=0x7ff6f001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73334e2b0dd657d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:55.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.448+0000 7ff6f5600640 1 -- 172.21.15.175:0/3538043906 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f00a5780 con 0x7ff6f80cc3b0 2024-04-25T09:13:55.435 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.448+0000 7ff6f5600640 1 -- 172.21.15.175:0/3538043906 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f00a5920 con 0x7ff6f80cc3b0 2024-04-25T09:13:55.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.448+0000 7ff6f5600640 1 -- 172.21.15.175:0/3538043906 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f00a5cf0 con 0x7ff6f80cc3b0 2024-04-25T09:13:55.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.448+0000 7ff6fd800640 1 -- 172.21.15.175:0/3538043906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6f80cc3b0 msgr2=0x7ff6f815c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.448+0000 7ff6fd800640 1 --2- 172.21.15.175:0/3538043906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6f80cc3b0 0x7ff6f815c410 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7ff6f80b4c00 tx=0x7ff6f001c9f0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.448+0000 7ff6fd800640 1 -- 172.21.15.175:0/3538043906 shutdown_connections 2024-04-25T09:13:55.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.448+0000 7ff6fd800640 1 --2- 172.21.15.175:0/3538043906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6f80cc3b0 0x7ff6f815c410 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.436 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.448+0000 7ff6fd800640 1 --2- 172.21.15.175:0/3538043906 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6f81453a0 0x7ff6f815bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.448+0000 7ff6fd800640 1 --2- 172.21.15.175:0/3538043906 >> v2:172.21.15.177:3300/0 conn(0x7ff6f8144fc0 0x7ff6f80cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.448+0000 7ff6fd800640 1 -- 172.21.15.175:0/3538043906 >> 172.21.15.175:0/3538043906 conn(0x7ff6f8067150 msgr2=0x7ff6f806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:55.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.448+0000 7ff6fd800640 1 -- 172.21.15.175:0/3538043906 shutdown_connections 2024-04-25T09:13:55.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.448+0000 7ff6fd800640 1 -- 172.21.15.175:0/3538043906 wait complete. 2024-04-25T09:13:55.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6fd800640 1 Processor -- start 2024-04-25T09:13:55.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6fd800640 1 -- start start 2024-04-25T09:13:55.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6fd800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6f8144fc0 0x7ff6f81f9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6fd800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6f81453a0 0x7ff6f81fa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6fd800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6f80ad280 0x7ff6f815a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6fd800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f8160060 con 0x7ff6f80ad280 2024-04-25T09:13:55.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6fd800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f815fee0 con 0x7ff6f8144fc0 2024-04-25T09:13:55.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6fd800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f81601e0 con 0x7ff6f81453a0 2024-04-25T09:13:55.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6f7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6f80ad280 0x7ff6f815a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.440 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6f7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6f80ad280 0x7ff6f815a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51112/0 (socket says 172.21.15.175:51112) 2024-04-25T09:13:55.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6f7400640 1 -- 172.21.15.175:0/2146779114 learned_addr learned my addr 172.21.15.175:0/2146779114 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:55.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6f6a00640 1 --2- 172.21.15.175:0/2146779114 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6f8144fc0 0x7ff6f81f9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6f6000640 1 --2- 172.21.15.175:0/2146779114 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6f81453a0 0x7ff6f81fa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6f7400640 1 -- 172.21.15.175:0/2146779114 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6f81453a0 msgr2=0x7ff6f81fa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6f7400640 1 --2- 172.21.15.175:0/2146779114 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6f81453a0 0x7ff6f81fa310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6f7400640 1 -- 172.21.15.175:0/2146779114 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6f8144fc0 msgr2=0x7ff6f81f9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6f7400640 1 --2- 172.21.15.175:0/2146779114 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6f8144fc0 0x7ff6f81f9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6f7400640 1 -- 172.21.15.175:0/2146779114 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f80ad740 con 0x7ff6f80ad280 2024-04-25T09:13:55.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6f6a00640 1 --2- 172.21.15.175:0/2146779114 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6f8144fc0 0x7ff6f81f9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:55.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6f6000640 1 --2- 172.21.15.175:0/2146779114 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6f81453a0 0x7ff6f81fa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:55.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6f7400640 1 --2- 172.21.15.175:0/2146779114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6f80ad280 0x7ff6f815a910 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7ff6f001b0a0 tx=0x7ff6f0019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:55.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6eea00640 1 -- 172.21.15.175:0/2146779114 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f00b8670 con 0x7ff6f80ad280 2024-04-25T09:13:55.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6eea00640 1 -- 172.21.15.175:0/2146779114 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f00be070 con 0x7ff6f80ad280 2024-04-25T09:13:55.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6fd800640 1 -- 172.21.15.175:0/2146779114 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f80ada20 con 0x7ff6f80ad280 2024-04-25T09:13:55.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6eea00640 1 -- 172.21.15.175:0/2146779114 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f00b8a50 con 0x7ff6f80ad280 2024-04-25T09:13:55.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6fd800640 1 -- 172.21.15.175:0/2146779114 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f80adfe0 con 0x7ff6f80ad280 2024-04-25T09:13:55.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.452+0000 7ff6fd800640 1 -- 172.21.15.175:0/2146779114 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f813bc70 con 0x7ff6f80ad280 2024-04-25T09:13:55.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.456+0000 7ff6eea00640 1 -- 172.21.15.175:0/2146779114 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff6f00b8bf0 con 0x7ff6f80ad280 2024-04-25T09:13:55.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.456+0000 7ff6eea00640 1 --2- 172.21.15.175:0/2146779114 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff6d8066f60 0x7ff6d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.456+0000 7ff6eea00640 1 -- 172.21.15.175:0/2146779114 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff6f011ff90 con 0x7ff6f80ad280 2024-04-25T09:13:55.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.456+0000 7ff6f6a00640 1 --2- 172.21.15.175:0/2146779114 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff6d8066f60 0x7ff6d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.456+0000 7ff6f6a00640 1 --2- 172.21.15.175:0/2146779114 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff6d8066f60 0x7ff6d8069420 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff6f806e020 tx=0x7ff6e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:55.447 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.460+0000 7ff6eea00640 1 -- 172.21.15.175:0/2146779114 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff6f00165e0 con 0x7ff6f80ad280 2024-04-25T09:13:55.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.616+0000 7ff6fd800640 1 -- 172.21.15.175:0/2146779114 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6f8074a60 con 0x7ff6f80ad280 2024-04-25T09:13:55.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.616+0000 7ff6eea00640 1 -- 172.21.15.175:0/2146779114 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+13192 (secure 0 0 0) 0x7ff6f00f11a0 con 0x7ff6f80ad280 2024-04-25T09:13:55.603 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:13:55.603 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":104,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:13:54.269705+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6837/2646458577":"2024-04-26T09:13:46.217288+0000","172.21.15.175:6835/2646458577":"2024-04-26T09:13:46.217288+0000","172.21.15.175:6837/3952378765":"2024-04-26T09:13:09.546531+0000","172.21.15.175:6835/3952378765":"2024-04-26T09:13:09.546531+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:13:55.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.616+0000 7ff6fd800640 1 -- 172.21.15.175:0/2146779114 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff6d8066f60 msgr2=0x7ff6d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.616+0000 7ff6fd800640 1 --2- 172.21.15.175:0/2146779114 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff6d8066f60 0x7ff6d8069420 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff6f806e020 tx=0x7ff6e8008040 comp rx=0 tx=0).stop 2024-04-25T09:13:55.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.616+0000 7ff6fd800640 1 -- 172.21.15.175:0/2146779114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6f80ad280 msgr2=0x7ff6f815a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.616+0000 7ff6fd800640 1 --2- 172.21.15.175:0/2146779114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6f80ad280 0x7ff6f815a910 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7ff6f001b0a0 tx=0x7ff6f0019790 comp rx=0 tx=0).stop 2024-04-25T09:13:55.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.616+0000 7ff6fd800640 1 -- 172.21.15.175:0/2146779114 shutdown_connections 2024-04-25T09:13:55.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.616+0000 7ff6fd800640 1 --2- 172.21.15.175:0/2146779114 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff6d8066f60 0x7ff6d8069420 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.616+0000 7ff6fd800640 1 --2- 172.21.15.175:0/2146779114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6f80ad280 0x7ff6f815a910 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.616+0000 7ff6fd800640 1 --2- 172.21.15.175:0/2146779114 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6f81453a0 0x7ff6f81fa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.616+0000 7ff6fd800640 1 --2- 172.21.15.175:0/2146779114 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6f8144fc0 0x7ff6f81f9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.616+0000 7ff6fd800640 1 -- 172.21.15.175:0/2146779114 >> 172.21.15.175:0/2146779114 conn(0x7ff6f80cc3b0 msgr2=0x7ff6f80cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:55.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.616+0000 7ff6fd800640 1 -- 172.21.15.175:0/2146779114 shutdown_connections 2024-04-25T09:13:55.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.616+0000 7ff6fd800640 1 -- 172.21.15.175:0/2146779114 wait complete. 2024-04-25T09:13:55.624 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:13:55.624 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:13:55.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb322c00640 1 Processor -- start 2024-04-25T09:13:55.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb322c00640 1 -- start start 2024-04-25T09:13:55.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb322c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb31c145250 0x7fb31c0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb322c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb31c0ce970 0x7fb31c0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb322c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31c0cfd10 con 0x7fb31c1600a0 2024-04-25T09:13:55.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb322c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31c15f650 con 0x7fb31c145250 2024-04-25T09:13:55.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb322c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c0cfff0 con 0x7fb31c0ce970 2024-04-25T09:13:55.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb31be00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb31c145250 0x7fb31c0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb320c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb31c0ce970 0x7fb31c0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb320c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb31c0ce970 0x7fb31c0cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:41908/0 (socket says 172.21.15.175:41908) 2024-04-25T09:13:55.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb31be00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb31c145250 0x7fb31c0cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:47052/0 (socket says 172.21.15.175:47052) 2024-04-25T09:13:55.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb320c00640 1 -- 172.21.15.175:0/3231103107 learned_addr learned my addr 172.21.15.175:0/3231103107 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:55.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb31b400640 1 --1- 172.21.15.175:0/3231103107 >> v1:172.21.15.177:6789/0 conn(0x7fb31c1600a0 0x7fb31c0cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:42990/0 (socket says 172.21.15.175:42990) 2024-04-25T09:13:55.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb31be00640 1 -- 172.21.15.175:0/3231103107 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb31c0ce970 msgr2=0x7fb31c0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:55.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb31be00640 1 --2- 172.21.15.175:0/3231103107 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb31c0ce970 0x7fb31c0cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb31be00640 1 -- 172.21.15.175:0/3231103107 >> v1:172.21.15.177:6789/0 conn(0x7fb31c1600a0 legacy=0x7fb31c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb31be00640 1 -- 172.21.15.175:0/3231103107 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c15f8a0 con 0x7fb31c145250 2024-04-25T09:13:55.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb31aa00640 1 -- 172.21.15.175:0/3231103107 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358170116 0 0) 0x7fb31c0cfd10 con 0x7fb31c1600a0 2024-04-25T09:13:55.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.776+0000 7fb320c00640 1 --2- 172.21.15.175:0/3231103107 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb31c0ce970 0x7fb31c0cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:13:55.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.780+0000 7fb31be00640 1 --2- 172.21.15.175:0/3231103107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb31c145250 0x7fb31c0cf6b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb30c009dc0 tx=0x7fb30c01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3166596ca75914d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:55.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.780+0000 7fb31aa00640 1 -- 172.21.15.175:0/3231103107 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c0b2070 con 0x7fb31c145250 2024-04-25T09:13:55.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.780+0000 7fb31aa00640 1 -- 172.21.15.175:0/3231103107 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30c0a5970 con 0x7fb31c145250 2024-04-25T09:13:55.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.780+0000 7fb31aa00640 1 -- 172.21.15.175:0/3231103107 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c0a5d40 con 0x7fb31c145250 2024-04-25T09:13:55.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.780+0000 7fb322c00640 1 -- 172.21.15.175:0/3231103107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb31c145250 msgr2=0x7fb31c0cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.780+0000 7fb322c00640 1 --2- 172.21.15.175:0/3231103107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb31c145250 0x7fb31c0cf6b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb30c009dc0 tx=0x7fb30c01c890 comp rx=0 tx=0).stop 2024-04-25T09:13:55.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.780+0000 7fb322c00640 1 -- 172.21.15.175:0/3231103107 shutdown_connections 2024-04-25T09:13:55.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.780+0000 7fb322c00640 1 --2- 172.21.15.175:0/3231103107 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb31c0ce970 0x7fb31c0cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.780+0000 7fb322c00640 1 --2- 172.21.15.175:0/3231103107 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb31c145250 0x7fb31c0cf6b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.780+0000 7fb322c00640 1 -- 172.21.15.175:0/3231103107 >> 172.21.15.175:0/3231103107 conn(0x7fb31c06ac50 msgr2=0x7fb31c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:55.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.780+0000 7fb322c00640 1 -- 172.21.15.175:0/3231103107 shutdown_connections 2024-04-25T09:13:55.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.780+0000 7fb322c00640 1 -- 172.21.15.175:0/3231103107 wait complete. 2024-04-25T09:13:55.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb322c00640 1 Processor -- start 2024-04-25T09:13:55.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb322c00640 1 -- start start 2024-04-25T09:13:55.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb322c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb31c0ce970 0x7fb31c141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb322c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb31c145250 0x7fb31c13d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb322c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb31c1600a0 0x7fb31c13f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb322c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c15c870 con 0x7fb31c1600a0 2024-04-25T09:13:55.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb322c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c145630 con 0x7fb31c0ce970 2024-04-25T09:13:55.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb322c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb31c15c9f0 con 0x7fb31c145250 2024-04-25T09:13:55.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb320c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb31c1600a0 0x7fb31c13f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb320c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb31c1600a0 0x7fb31c13f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51124/0 (socket says 172.21.15.175:51124) 2024-04-25T09:13:55.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb320c00640 1 -- 172.21.15.175:0/2767969818 learned_addr learned my addr 172.21.15.175:0/2767969818 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:55.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb31be00640 1 --2- 172.21.15.175:0/2767969818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb31c0ce970 0x7fb31c141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb31b400640 1 --2- 172.21.15.175:0/2767969818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb31c145250 0x7fb31c13d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb320c00640 1 -- 172.21.15.175:0/2767969818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb31c145250 msgr2=0x7fb31c13d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb320c00640 1 --2- 172.21.15.175:0/2767969818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb31c145250 0x7fb31c13d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb320c00640 1 -- 172.21.15.175:0/2767969818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb31c0ce970 msgr2=0x7fb31c141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb320c00640 1 --2- 172.21.15.175:0/2767969818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb31c0ce970 0x7fb31c141530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb320c00640 1 -- 172.21.15.175:0/2767969818 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c15b3e0 con 0x7fb31c1600a0 2024-04-25T09:13:55.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb31b400640 1 --2- 172.21.15.175:0/2767969818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb31c145250 0x7fb31c13d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:55.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb320c00640 1 --2- 172.21.15.175:0/2767969818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb31c1600a0 0x7fb31c13f200 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fb31400e950 tx=0x7fb31400ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:55.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb313e00640 1 -- 172.21.15.175:0/2767969818 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb314017070 con 0x7fb31c1600a0 2024-04-25T09:13:55.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb313e00640 1 -- 172.21.15.175:0/2767969818 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31400ca00 con 0x7fb31c1600a0 2024-04-25T09:13:55.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb322c00640 1 -- 172.21.15.175:0/2767969818 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb31c0b2a70 con 0x7fb31c1600a0 2024-04-25T09:13:55.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb313e00640 1 -- 172.21.15.175:0/2767969818 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31400cdd0 con 0x7fb31c1600a0 2024-04-25T09:13:55.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb322c00640 1 -- 172.21.15.175:0/2767969818 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31c0b3030 con 0x7fb31c1600a0 2024-04-25T09:13:55.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.784+0000 7fb322c00640 1 -- 172.21.15.175:0/2767969818 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb31c075160 con 0x7fb31c1600a0 2024-04-25T09:13:55.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.788+0000 7fb313e00640 1 -- 172.21.15.175:0/2767969818 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb314013470 con 0x7fb31c1600a0 2024-04-25T09:13:55.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.788+0000 7fb313e00640 1 --2- 172.21.15.175:0/2767969818 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb2fc066f60 0x7fb2fc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:55.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.788+0000 7fb313e00640 1 -- 172.21.15.175:0/2767969818 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb314084bb0 con 0x7fb31c1600a0 2024-04-25T09:13:55.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.788+0000 7fb31be00640 1 --2- 172.21.15.175:0/2767969818 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb2fc066f60 0x7fb2fc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:55.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.788+0000 7fb31be00640 1 --2- 172.21.15.175:0/2767969818 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb2fc066f60 0x7fb2fc069420 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0af000 tx=0x7fb30c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:55.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.792+0000 7fb313e00640 1 -- 172.21.15.175:0/2767969818 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb314055800 con 0x7fb31c1600a0 2024-04-25T09:13:55.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.948+0000 7fb322c00640 1 -- 172.21.15.175:0/2767969818 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb31c0ce350 con 0x7fb31c1600a0 2024-04-25T09:13:55.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.948+0000 7fb313e00640 1 -- 172.21.15.175:0/2767969818 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb3140598a0 con 0x7fb31c1600a0 2024-04-25T09:13:55.934 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:13:55.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.948+0000 7fb322c00640 1 -- 172.21.15.175:0/2767969818 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb2fc066f60 msgr2=0x7fb2fc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.948+0000 7fb322c00640 1 --2- 172.21.15.175:0/2767969818 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb2fc066f60 0x7fb2fc069420 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0af000 tx=0x7fb30c0a7070 comp rx=0 tx=0).stop 2024-04-25T09:13:55.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.948+0000 7fb322c00640 1 -- 172.21.15.175:0/2767969818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb31c1600a0 msgr2=0x7fb31c13f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:55.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.948+0000 7fb322c00640 1 --2- 172.21.15.175:0/2767969818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb31c1600a0 0x7fb31c13f200 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fb31400e950 tx=0x7fb31400ee10 comp rx=0 tx=0).stop 2024-04-25T09:13:55.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.948+0000 7fb322c00640 1 -- 172.21.15.175:0/2767969818 shutdown_connections 2024-04-25T09:13:55.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.948+0000 7fb322c00640 1 --2- 172.21.15.175:0/2767969818 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb2fc066f60 0x7fb2fc069420 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.948+0000 7fb322c00640 1 --2- 172.21.15.175:0/2767969818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb31c1600a0 0x7fb31c13f200 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.948+0000 7fb322c00640 1 --2- 172.21.15.175:0/2767969818 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb31c145250 0x7fb31c13d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.948+0000 7fb322c00640 1 --2- 172.21.15.175:0/2767969818 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb31c0ce970 0x7fb31c141530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:55.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.948+0000 7fb322c00640 1 -- 172.21.15.175:0/2767969818 >> 172.21.15.175:0/2767969818 conn(0x7fb31c06ac50 msgr2=0x7fb31c0afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:55.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.948+0000 7fb322c00640 1 -- 172.21.15.175:0/2767969818 shutdown_connections 2024-04-25T09:13:55.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:55.948+0000 7fb322c00640 1 -- 172.21.15.175:0/2767969818 wait complete. 2024-04-25T09:13:55.955 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-04-25T09:13:56.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.104+0000 7f53a6a00640 1 Processor -- start 2024-04-25T09:13:56.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.104+0000 7f53a6a00640 1 -- start start 2024-04-25T09:13:56.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.104+0000 7f53a6a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f53a00aeb30 0x7f53a0071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:56.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.104+0000 7f53a6a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f53a006e510 0x7f53a00b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:56.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.104+0000 7f53a6a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a006eba0 con 0x7f53a0071780 2024-04-25T09:13:56.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.104+0000 7f53a6a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a0071be0 con 0x7f53a00aeb30 2024-04-25T09:13:56.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.104+0000 7f53a6a00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a006e960 con 0x7f53a006e510 2024-04-25T09:13:56.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.104+0000 7f539fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f53a00aeb30 0x7f53a0071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:56.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.104+0000 7f539fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f53a00aeb30 0x7f53a0071240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51128/0 (socket says 172.21.15.175:51128) 2024-04-25T09:13:56.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.104+0000 7f539fe00640 1 -- 172.21.15.175:0/673497295 learned_addr learned my addr 172.21.15.175:0/673497295 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:56.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.104+0000 7f53a4a00640 1 --2- 172.21.15.175:0/673497295 >> v2:172.21.15.177:3300/0 conn(0x7f53a006e510 0x7f53a00b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:56.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.104+0000 7f539fe00640 1 -- 172.21.15.175:0/673497295 >> v2:172.21.15.177:3300/0 conn(0x7f53a006e510 msgr2=0x7f53a00b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:56.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.104+0000 7f539fe00640 1 --2- 172.21.15.175:0/673497295 >> v2:172.21.15.177:3300/0 conn(0x7f53a006e510 0x7f53a00b2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.104+0000 7f539fe00640 1 -- 172.21.15.175:0/673497295 >> v1:172.21.15.177:6789/0 conn(0x7f53a0071780 legacy=0x7f53a006de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:56.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.104+0000 7f539fe00640 1 -- 172.21.15.175:0/673497295 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a006ee80 con 0x7f53a00aeb30 2024-04-25T09:13:56.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.104+0000 7f53a4a00640 1 --2- 172.21.15.175:0/673497295 >> v2:172.21.15.177:3300/0 conn(0x7f53a006e510 0x7f53a00b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:13:56.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.108+0000 7f539fe00640 1 --2- 172.21.15.175:0/673497295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a00aeb30 0x7f53a0071240 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f53a0143710 tx=0x7f539001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e002a6881e5ef5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:56.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.108+0000 7f539ea00640 1 -- 172.21.15.175:0/673497295 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900a5700 con 0x7f53a00aeb30 2024-04-25T09:13:56.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.108+0000 7f539ea00640 1 -- 172.21.15.175:0/673497295 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53900a58a0 con 0x7f53a00aeb30 2024-04-25T09:13:56.096 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.108+0000 7f539ea00640 1 -- 172.21.15.175:0/673497295 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900a5c70 con 0x7f53a00aeb30 2024-04-25T09:13:56.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.108+0000 7f53a6a00640 1 -- 172.21.15.175:0/673497295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a00aeb30 msgr2=0x7f53a0071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:56.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.108+0000 7f53a6a00640 1 --2- 172.21.15.175:0/673497295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a00aeb30 0x7f53a0071240 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f53a0143710 tx=0x7f539001c9b0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.108+0000 7f53a6a00640 1 -- 172.21.15.175:0/673497295 shutdown_connections 2024-04-25T09:13:56.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.108+0000 7f53a6a00640 1 --2- 172.21.15.175:0/673497295 >> v2:172.21.15.177:3300/0 conn(0x7f53a006e510 0x7f53a00b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.108+0000 7f53a6a00640 1 --2- 172.21.15.175:0/673497295 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a00aeb30 0x7f53a0071240 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.108+0000 7f53a6a00640 1 -- 172.21.15.175:0/673497295 >> 172.21.15.175:0/673497295 conn(0x7f53a0067150 msgr2=0x7f53a006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:56.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.108+0000 7f53a6a00640 1 -- 172.21.15.175:0/673497295 shutdown_connections 2024-04-25T09:13:56.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.108+0000 7f53a6a00640 1 -- 172.21.15.175:0/673497295 wait complete. 2024-04-25T09:13:56.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f53a6a00640 1 Processor -- start 2024-04-25T09:13:56.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f53a6a00640 1 -- start start 2024-04-25T09:13:56.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f53a6a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a0071780 0x7f53a01549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:56.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f53a6a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53a00aeb30 0x7f53a0159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:56.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f53a6a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53a013c090 0x7f53a0158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:56.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f53a6a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a00b37d0 con 0x7f53a0071780 2024-04-25T09:13:56.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f53a6a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a00b3650 con 0x7f53a013c090 2024-04-25T09:13:56.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f53a6a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a00b3950 con 0x7f53a00aeb30 2024-04-25T09:13:56.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f539fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a0071780 0x7f53a01549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:56.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f539fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a0071780 0x7f53a01549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51130/0 (socket says 172.21.15.175:51130) 2024-04-25T09:13:56.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f539fe00640 1 -- 172.21.15.175:0/3930653187 learned_addr learned my addr 172.21.15.175:0/3930653187 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:56.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f53a4a00640 1 --2- 172.21.15.175:0/3930653187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53a013c090 0x7f53a0158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:56.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f539f400640 1 --2- 172.21.15.175:0/3930653187 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53a00aeb30 0x7f53a0159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:56.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f539fe00640 1 -- 172.21.15.175:0/3930653187 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53a00aeb30 msgr2=0x7f53a0159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:56.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f539fe00640 1 --2- 172.21.15.175:0/3930653187 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53a00aeb30 0x7f53a0159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f539fe00640 1 -- 172.21.15.175:0/3930653187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53a013c090 msgr2=0x7f53a0158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:56.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f539fe00640 1 --2- 172.21.15.175:0/3930653187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53a013c090 0x7f53a0158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:56.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f539fe00640 1 -- 172.21.15.175:0/3930653187 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a0159e60 con 0x7f53a0071780 2024-04-25T09:13:56.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f539fe00640 1 --2- 172.21.15.175:0/3930653187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a0071780 0x7f53a01549e0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f53900af040 tx=0x7f5390019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:56.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f5397e00640 1 -- 172.21.15.175:0/3930653187 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900b8470 con 0x7f53a0071780 2024-04-25T09:13:56.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f5397e00640 1 -- 172.21.15.175:0/3930653187 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53900b8630 con 0x7f53a0071780 2024-04-25T09:13:56.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f53a6a00640 1 -- 172.21.15.175:0/3930653187 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a0158880 con 0x7f53a0071780 2024-04-25T09:13:56.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f5397e00640 1 -- 172.21.15.175:0/3930653187 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900b8a20 con 0x7f53a0071780 2024-04-25T09:13:56.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.112+0000 7f53a6a00640 1 -- 172.21.15.175:0/3930653187 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a0158e40 con 0x7f53a0071780 2024-04-25T09:13:56.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.116+0000 7f53a6a00640 1 -- 172.21.15.175:0/3930653187 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a0074a60 con 0x7f53a0071780 2024-04-25T09:13:56.103 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.116+0000 7f5397e00640 1 -- 172.21.15.175:0/3930653187 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f53900c0030 con 0x7f53a0071780 2024-04-25T09:13:56.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.116+0000 7f5397e00640 1 --2- 172.21.15.175:0/3930653187 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5380066f60 0x7f5380069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:56.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.116+0000 7f5397e00640 1 -- 172.21.15.175:0/3930653187 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f539011f940 con 0x7f53a0071780 2024-04-25T09:13:56.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.116+0000 7f539f400640 1 --2- 172.21.15.175:0/3930653187 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5380066f60 0x7f5380069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:56.104 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.116+0000 7f539f400640 1 --2- 172.21.15.175:0/3930653187 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5380066f60 0x7f5380069420 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f53a00cbab0 tx=0x7f538c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:56.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.120+0000 7f5397e00640 1 -- 172.21.15.175:0/3930653187 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f53900c7020 con 0x7f53a0071780 2024-04-25T09:13:56.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:56.328+0000 7f53a6a00640 1 -- 172.21.15.175:0/3930653187 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) v1 -- 0x7f53a00721c0 con 0x7f53a0071780 2024-04-25T09:13:57.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.284+0000 7f5397e00640 1 -- 172.21.15.175:0/3930653187 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v465) v1 ==== 147+0+0 (secure 0 0 0) 0x7f53900165a0 con 0x7f53a0071780 2024-04-25T09:13:57.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.284+0000 7f53a6a00640 1 -- 172.21.15.175:0/3930653187 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5380066f60 msgr2=0x7f5380069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:57.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.284+0000 7f53a6a00640 1 --2- 172.21.15.175:0/3930653187 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5380066f60 0x7f5380069420 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f53a00cbab0 tx=0x7f538c009040 comp rx=0 tx=0).stop 2024-04-25T09:13:57.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.284+0000 7f53a6a00640 1 -- 172.21.15.175:0/3930653187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a0071780 msgr2=0x7f53a01549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:57.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.284+0000 7f53a6a00640 1 --2- 172.21.15.175:0/3930653187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a0071780 0x7f53a01549e0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f53900af040 tx=0x7f5390019750 comp rx=0 tx=0).stop 2024-04-25T09:13:57.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.284+0000 7f53a6a00640 1 -- 172.21.15.175:0/3930653187 shutdown_connections 2024-04-25T09:13:57.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.284+0000 7f53a6a00640 1 --2- 172.21.15.175:0/3930653187 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5380066f60 0x7f5380069420 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.284+0000 7f53a6a00640 1 --2- 172.21.15.175:0/3930653187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53a013c090 0x7f53a0158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.284+0000 7f53a6a00640 1 --2- 172.21.15.175:0/3930653187 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f53a00aeb30 0x7f53a0159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.284+0000 7f53a6a00640 1 --2- 172.21.15.175:0/3930653187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53a0071780 0x7f53a01549e0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.284+0000 7f53a6a00640 1 -- 172.21.15.175:0/3930653187 >> 172.21.15.175:0/3930653187 conn(0x7f53a006e510 msgr2=0x7f53a00cbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:57.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.284+0000 7f53a6a00640 1 -- 172.21.15.175:0/3930653187 shutdown_connections 2024-04-25T09:13:57.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.288+0000 7f53a6a00640 1 -- 172.21.15.175:0/3930653187 wait complete. 2024-04-25T09:13:57.296 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:13:57.437 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f9600640 1 Processor -- start 2024-04-25T09:13:57.438 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f9600640 1 -- start start 2024-04-25T09:13:57.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f9600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6f40cf760 0x7fa6f4099ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:57.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f9600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f415ccb0 con 0x7fa6f415f3c0 2024-04-25T09:13:57.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f9600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f40cc660 con 0x7fa6f40cc0f0 2024-04-25T09:13:57.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f9600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40cd270 con 0x7fa6f40cf760 2024-04-25T09:13:57.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa6f415f3c0 0x7fa6f415f7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44044/0 (socket says 172.21.15.175:44044) 2024-04-25T09:13:57.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3e00640 1 -- 172.21.15.175:0/875881716 learned_addr learned my addr 172.21.15.175:0/875881716 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:57.439 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6eb400640 1 --2- 172.21.15.175:0/875881716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6f40cf760 0x7fa6f4099ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:57.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3400640 1 -- 172.21.15.175:0/875881716 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283069339 0 0) 0x7fa6f415ccb0 con 0x7fa6f415f3c0 2024-04-25T09:13:57.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3400640 1 -- 172.21.15.175:0/875881716 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6d8003530 con 0x7fa6f415f3c0 2024-04-25T09:13:57.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3400640 1 -- 172.21.15.175:0/875881716 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320719654 0 0) 0x7fa6f40cc660 con 0x7fa6f40cc0f0 2024-04-25T09:13:57.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3400640 1 -- 172.21.15.175:0/875881716 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6f415ccb0 con 0x7fa6f40cc0f0 2024-04-25T09:13:57.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3400640 1 -- 172.21.15.175:0/875881716 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 535756547 0 0) 0x7fa6d8003530 con 0x7fa6f415f3c0 2024-04-25T09:13:57.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3400640 1 -- 172.21.15.175:0/875881716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6f40cf760 msgr2=0x7fa6f4099ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:57.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3400640 1 --2- 172.21.15.175:0/875881716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6f40cf760 0x7fa6f4099ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3400640 1 -- 172.21.15.175:0/875881716 >> v1:172.21.15.177:6789/0 conn(0x7fa6f40cc0f0 legacy=0x7fa6f409a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:57.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3400640 1 -- 172.21.15.175:0/875881716 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f40cc940 con 0x7fa6f415f3c0 2024-04-25T09:13:57.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3400640 1 -- 172.21.15.175:0/875881716 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fa6e4001680 con 0x7fa6f415f3c0 2024-04-25T09:13:57.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3400640 1 -- 172.21.15.175:0/875881716 >> v1:172.21.15.175:6789/0 conn(0x7fa6f415f3c0 legacy=0x7fa6f415f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:57.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3400640 1 --2- 172.21.15.175:0/875881716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6d8003b80 0x7fa6d8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:57.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3400640 1 --2- 172.21.15.175:0/875881716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6d8004810 0x7fa6d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:57.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3400640 1 --2- 172.21.15.175:0/875881716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6f40cf760 0x7fa6d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:57.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3400640 1 -- 172.21.15.175:0/875881716 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f40cd270 con 0x7fa6d8003b80 2024-04-25T09:13:57.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3400640 1 -- 172.21.15.175:0/875881716 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d800ba80 con 0x7fa6d8004810 2024-04-25T09:13:57.442 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3400640 1 -- 172.21.15.175:0/875881716 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d800bc80 con 0x7fa6f40cf760 2024-04-25T09:13:57.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3e00640 1 --2- 172.21.15.175:0/875881716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6d8003b80 0x7fa6d8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:57.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6eb400640 1 --2- 172.21.15.175:0/875881716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6d8004810 0x7fa6d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:57.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f8c00640 1 --2- 172.21.15.175:0/875881716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6f40cf760 0x7fa6d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:57.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3e00640 1 -- 172.21.15.175:0/875881716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6f40cf760 msgr2=0x7fa6d80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:57.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3e00640 1 --2- 172.21.15.175:0/875881716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6f40cf760 0x7fa6d80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3e00640 1 -- 172.21.15.175:0/875881716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6d8004810 msgr2=0x7fa6d8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:57.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3e00640 1 --2- 172.21.15.175:0/875881716 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6d8004810 0x7fa6d8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f3e00640 1 -- 172.21.15.175:0/875881716 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d8003530 con 0x7fa6d8003b80 2024-04-25T09:13:57.443 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.452+0000 7fa6f8c00640 1 --2- 172.21.15.175:0/875881716 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6f40cf760 0x7fa6d80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:57.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.456+0000 7fa6f3e00640 1 --2- 172.21.15.175:0/875881716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6d8003b80 0x7fa6d8003f80 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400c0e0 tx=0x7fa6e401cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd866e5a936833c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:57.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.456+0000 7fa6f3400640 1 -- 172.21.15.175:0/875881716 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4007c50 con 0x7fa6d8003b80 2024-04-25T09:13:57.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.456+0000 7fa6f3400640 1 -- 172.21.15.175:0/875881716 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e40a9070 con 0x7fa6d8003b80 2024-04-25T09:13:57.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.456+0000 7fa6f3400640 1 -- 172.21.15.175:0/875881716 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4005d60 con 0x7fa6d8003b80 2024-04-25T09:13:57.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.456+0000 7fa6f9600640 1 -- 172.21.15.175:0/875881716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6d8003b80 msgr2=0x7fa6d8003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:57.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.456+0000 7fa6f9600640 1 --2- 172.21.15.175:0/875881716 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6d8003b80 0x7fa6d8003f80 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400c0e0 tx=0x7fa6e401cb30 comp rx=0 tx=0).stop 2024-04-25T09:13:57.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.456+0000 7fa6f8c00640 1 -- 172.21.15.175:0/875881716 reap_dead start 2024-04-25T09:13:57.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.456+0000 7fa6f9600640 1 -- 172.21.15.175:0/875881716 shutdown_connections 2024-04-25T09:13:57.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.456+0000 7fa6f9600640 1 -- 172.21.15.175:0/875881716 >> 172.21.15.175:0/875881716 conn(0x7fa6f40b3140 msgr2=0x7fa6f40b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:57.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.456+0000 7fa6f9600640 1 -- 172.21.15.175:0/875881716 shutdown_connections 2024-04-25T09:13:57.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.456+0000 7fa6f9600640 1 -- 172.21.15.175:0/875881716 wait complete. 2024-04-25T09:13:57.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f9600640 1 Processor -- start 2024-04-25T09:13:57.446 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f9600640 1 -- start start 2024-04-25T09:13:57.448 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f9600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6d8003b80 0x7fa6f40b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:57.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f9600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6f40708c0 0x7fa6f40b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:57.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f9600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6f4070d40 0x7fa6f414d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:57.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f9600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4167ab0 con 0x7fa6d8003b80 2024-04-25T09:13:57.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f9600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4167930 con 0x7fa6f40708c0 2024-04-25T09:13:57.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f9600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4167c30 con 0x7fa6f4070d40 2024-04-25T09:13:57.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6d8003b80 0x7fa6f40b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:57.449 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6d8003b80 0x7fa6f40b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51156/0 (socket says 172.21.15.175:51156) 2024-04-25T09:13:57.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f3e00640 1 -- 172.21.15.175:0/4152549060 learned_addr learned my addr 172.21.15.175:0/4152549060 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:57.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6eb400640 1 --2- 172.21.15.175:0/4152549060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6f40708c0 0x7fa6f40b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:57.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f8c00640 1 --2- 172.21.15.175:0/4152549060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6f4070d40 0x7fa6f414d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:57.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f3e00640 1 -- 172.21.15.175:0/4152549060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6f4070d40 msgr2=0x7fa6f414d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:57.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f3e00640 1 --2- 172.21.15.175:0/4152549060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6f4070d40 0x7fa6f414d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f3e00640 1 -- 172.21.15.175:0/4152549060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6f40708c0 msgr2=0x7fa6f40b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:57.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f3e00640 1 --2- 172.21.15.175:0/4152549060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6f40708c0 0x7fa6f40b6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f3e00640 1 -- 172.21.15.175:0/4152549060 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f40d07c0 con 0x7fa6d8003b80 2024-04-25T09:13:57.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f8c00640 1 --2- 172.21.15.175:0/4152549060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6f4070d40 0x7fa6f414d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:57.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f3e00640 1 --2- 172.21.15.175:0/4152549060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6d8003b80 0x7fa6f40b42b0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400c0e0 tx=0x7fa6d8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:57.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f0c00640 1 -- 172.21.15.175:0/4152549060 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4007c50 con 0x7fa6d8003b80 2024-04-25T09:13:57.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f0c00640 1 -- 172.21.15.175:0/4152549060 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e4005d40 con 0x7fa6d8003b80 2024-04-25T09:13:57.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f9600640 1 -- 172.21.15.175:0/4152549060 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f40b71d0 con 0x7fa6d8003b80 2024-04-25T09:13:57.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f0c00640 1 -- 172.21.15.175:0/4152549060 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4001680 con 0x7fa6d8003b80 2024-04-25T09:13:57.451 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.460+0000 7fa6f9600640 1 -- 172.21.15.175:0/4152549060 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f40b6ef0 con 0x7fa6d8003b80 2024-04-25T09:13:57.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.464+0000 7fa6f9600640 1 -- 172.21.15.175:0/4152549060 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f4074a60 con 0x7fa6d8003b80 2024-04-25T09:13:57.452 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.464+0000 7fa6f0c00640 1 -- 172.21.15.175:0/4152549060 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa6e4007040 con 0x7fa6d8003b80 2024-04-25T09:13:57.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.464+0000 7fa6f0c00640 1 --2- 172.21.15.175:0/4152549060 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa6d0066f60 0x7fa6d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:57.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.464+0000 7fa6f0c00640 1 -- 172.21.15.175:0/4152549060 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa6e411e6e0 con 0x7fa6d8003b80 2024-04-25T09:13:57.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.464+0000 7fa6eb400640 1 --2- 172.21.15.175:0/4152549060 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa6d0066f60 0x7fa6d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:57.453 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.464+0000 7fa6eb400640 1 --2- 172.21.15.175:0/4152549060 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa6d0066f60 0x7fa6d0069420 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4166020 tx=0x7fa6dc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:57.455 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.468+0000 7fa6f0c00640 1 -- 172.21.15.175:0/4152549060 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa6e4016870 con 0x7fa6d8003b80 2024-04-25T09:13:57.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.624+0000 7fa6f9600640 1 -- 172.21.15.175:0/4152549060 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa6f40cd9f0 con 0x7fa6d8003b80 2024-04-25T09:13:57.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.628+0000 7fa6f0c00640 1 -- 172.21.15.175:0/4152549060 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa6e40ef900 con 0x7fa6d8003b80 2024-04-25T09:13:57.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.628+0000 7fa6f9600640 1 -- 172.21.15.175:0/4152549060 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa6d0066f60 msgr2=0x7fa6d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:57.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.628+0000 7fa6f9600640 1 --2- 172.21.15.175:0/4152549060 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa6d0066f60 0x7fa6d0069420 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4166020 tx=0x7fa6dc009190 comp rx=0 tx=0).stop 2024-04-25T09:13:57.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.628+0000 7fa6f9600640 1 -- 172.21.15.175:0/4152549060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6d8003b80 msgr2=0x7fa6f40b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:57.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.628+0000 7fa6f9600640 1 --2- 172.21.15.175:0/4152549060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6d8003b80 0x7fa6f40b42b0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400c0e0 tx=0x7fa6d8005840 comp rx=0 tx=0).stop 2024-04-25T09:13:57.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.628+0000 7fa6f9600640 1 -- 172.21.15.175:0/4152549060 shutdown_connections 2024-04-25T09:13:57.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.628+0000 7fa6f9600640 1 --2- 172.21.15.175:0/4152549060 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa6d0066f60 0x7fa6d0069420 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.628+0000 7fa6f9600640 1 --2- 172.21.15.175:0/4152549060 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6f4070d40 0x7fa6f414d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.628+0000 7fa6f9600640 1 --2- 172.21.15.175:0/4152549060 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa6f40708c0 0x7fa6f40b6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.628+0000 7fa6f9600640 1 --2- 172.21.15.175:0/4152549060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6d8003b80 0x7fa6f40b42b0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:57.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.628+0000 7fa6f9600640 1 -- 172.21.15.175:0/4152549060 >> 172.21.15.175:0/4152549060 conn(0x7fa6f40b3140 msgr2=0x7fa6f40cfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:57.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.628+0000 7fa6f9600640 1 -- 172.21.15.175:0/4152549060 shutdown_connections 2024-04-25T09:13:57.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:57.628+0000 7fa6f9600640 1 -- 172.21.15.175:0/4152549060 wait complete. 2024-04-25T09:13:57.634 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:13:57.635 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:13:57.724 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:13:57.792 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:13:57.792 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:13:57.792 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:13:57.800 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:13:57.800 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:13:57.801 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:13:57.809 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:13:57.809 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:13:57.810 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:13:57.849 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:13:57.849 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:13:57.849 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:13:57.861 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:13:57.861 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:13:57.861 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:13:58.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.040+0000 7fd1cbe00640 1 Processor -- start 2024-04-25T09:13:58.030 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1cbe00640 1 -- start start 2024-04-25T09:13:58.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1cbe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1c415a900 0x7fd1c406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1cbe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd1c40cd520 0x7fd1c40ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1cbe00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c40cda00 con 0x7fd1c40cf560 2024-04-25T09:13:58.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1cbe00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c415bcf0 con 0x7fd1c40cd520 2024-04-25T09:13:58.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1cbe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40cdce0 con 0x7fd1c415a900 2024-04-25T09:13:58.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c9e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd1c40cf560 0x7fd1c415bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44052/0 (socket says 172.21.15.175:44052) 2024-04-25T09:13:58.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c9e00640 1 -- 172.21.15.175:0/697432663 learned_addr learned my addr 172.21.15.175:0/697432663 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:58.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c8a00640 1 --2- 172.21.15.175:0/697432663 >> v2:172.21.15.177:3300/0 conn(0x7fd1c40cd520 0x7fd1c40ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c3e00640 1 -- 172.21.15.175:0/697432663 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313085150 0 0) 0x7fd1c40cda00 con 0x7fd1c40cf560 2024-04-25T09:13:58.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c9400640 1 --2- 172.21.15.175:0/697432663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1c415a900 0x7fd1c406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c3e00640 1 -- 172.21.15.175:0/697432663 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1ac003530 con 0x7fd1c40cf560 2024-04-25T09:13:58.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c3e00640 1 -- 172.21.15.175:0/697432663 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2409786385 0 0) 0x7fd1ac003530 con 0x7fd1c40cf560 2024-04-25T09:13:58.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c3e00640 1 -- 172.21.15.175:0/697432663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1c415a900 msgr2=0x7fd1c406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:58.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c3e00640 1 --2- 172.21.15.175:0/697432663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1c415a900 0x7fd1c406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c3e00640 1 -- 172.21.15.175:0/697432663 >> v2:172.21.15.177:3300/0 conn(0x7fd1c40cd520 msgr2=0x7fd1c40ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:58.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c3e00640 1 --2- 172.21.15.175:0/697432663 >> v2:172.21.15.177:3300/0 conn(0x7fd1c40cd520 0x7fd1c40ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c3e00640 1 -- 172.21.15.175:0/697432663 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c40cdfc0 con 0x7fd1c40cf560 2024-04-25T09:13:58.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c3e00640 1 -- 172.21.15.175:0/697432663 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fd1bc001a00 con 0x7fd1c40cf560 2024-04-25T09:13:58.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c3e00640 1 -- 172.21.15.175:0/697432663 >> v1:172.21.15.175:6789/0 conn(0x7fd1c40cf560 legacy=0x7fd1c415bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:58.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c3e00640 1 --2- 172.21.15.175:0/697432663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1c415a900 0x7fd1ac0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c3e00640 1 --2- 172.21.15.175:0/697432663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1ac003f90 0x7fd1ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c3e00640 1 --2- 172.21.15.175:0/697432663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1ac004d50 0x7fd1ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c3e00640 1 -- 172.21.15.175:0/697432663 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40cdce0 con 0x7fd1ac004d50 2024-04-25T09:13:58.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c3e00640 1 -- 172.21.15.175:0/697432663 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac00b9d0 con 0x7fd1ac003f90 2024-04-25T09:13:58.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c3e00640 1 -- 172.21.15.175:0/697432663 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac00bb50 con 0x7fd1c415a900 2024-04-25T09:13:58.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c9e00640 1 --2- 172.21.15.175:0/697432663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1ac004d50 0x7fd1ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c8a00640 1 --2- 172.21.15.175:0/697432663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1ac003f90 0x7fd1ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c9400640 1 --2- 172.21.15.175:0/697432663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1c415a900 0x7fd1ac0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c9e00640 1 -- 172.21.15.175:0/697432663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1c415a900 msgr2=0x7fd1ac0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:58.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c9e00640 1 --2- 172.21.15.175:0/697432663 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1c415a900 0x7fd1ac0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c9e00640 1 -- 172.21.15.175:0/697432663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1ac003f90 msgr2=0x7fd1ac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:58.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c9e00640 1 --2- 172.21.15.175:0/697432663 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1ac003f90 0x7fd1ac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.044+0000 7fd1c9e00640 1 -- 172.21.15.175:0/697432663 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac003530 con 0x7fd1ac004d50 2024-04-25T09:13:58.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.048+0000 7fd1c9e00640 1 --2- 172.21.15.175:0/697432663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1ac004d50 0x7fd1ac0051d0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00a7d0 tx=0x7fd1bc01d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ce91c1904d7feb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:58.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.048+0000 7fd1c3e00640 1 -- 172.21.15.175:0/697432663 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc00a3f0 con 0x7fd1ac004d50 2024-04-25T09:13:58.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.048+0000 7fd1c3e00640 1 -- 172.21.15.175:0/697432663 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc0ad630 con 0x7fd1ac004d50 2024-04-25T09:13:58.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.048+0000 7fd1c3e00640 1 -- 172.21.15.175:0/697432663 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0ada80 con 0x7fd1ac004d50 2024-04-25T09:13:58.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.048+0000 7fd1cbe00640 1 -- 172.21.15.175:0/697432663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1ac004d50 msgr2=0x7fd1ac0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:58.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.048+0000 7fd1cbe00640 1 --2- 172.21.15.175:0/697432663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1ac004d50 0x7fd1ac0051d0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00a7d0 tx=0x7fd1bc01d2e0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.048+0000 7fd1c9e00640 1 -- 172.21.15.175:0/697432663 reap_dead start 2024-04-25T09:13:58.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.048+0000 7fd1cbe00640 1 -- 172.21.15.175:0/697432663 shutdown_connections 2024-04-25T09:13:58.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.048+0000 7fd1cbe00640 1 -- 172.21.15.175:0/697432663 >> 172.21.15.175:0/697432663 conn(0x7fd1c4067150 msgr2=0x7fd1c406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:58.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.048+0000 7fd1cbe00640 1 -- 172.21.15.175:0/697432663 shutdown_connections 2024-04-25T09:13:58.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.048+0000 7fd1cbe00640 1 -- 172.21.15.175:0/697432663 wait complete. 2024-04-25T09:13:58.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1cbe00640 1 Processor -- start 2024-04-25T09:13:58.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1cbe00640 1 -- start start 2024-04-25T09:13:58.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1cbe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1c40b3730 0x7fd1c4144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1cbe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1c41df9f0 0x7fd1c41e3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1cbe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1c40b3b10 0x7fd1c4142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1cbe00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40cefe0 con 0x7fd1c41df9f0 2024-04-25T09:13:58.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1cbe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40ce580 con 0x7fd1c40b3730 2024-04-25T09:13:58.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1cbe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40cf160 con 0x7fd1c40b3b10 2024-04-25T09:13:58.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1c8a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1c41df9f0 0x7fd1c41e3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1c8a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1c41df9f0 0x7fd1c41e3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51174/0 (socket says 172.21.15.175:51174) 2024-04-25T09:13:58.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1c8a00640 1 -- 172.21.15.175:0/1650639827 learned_addr learned my addr 172.21.15.175:0/1650639827 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:58.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1c9400640 1 --2- 172.21.15.175:0/1650639827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1c40b3730 0x7fd1c4144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1c9e00640 1 --2- 172.21.15.175:0/1650639827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1c40b3b10 0x7fd1c4142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1c8a00640 1 -- 172.21.15.175:0/1650639827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1c40b3b10 msgr2=0x7fd1c4142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:58.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1c8a00640 1 --2- 172.21.15.175:0/1650639827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1c40b3b10 0x7fd1c4142c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1c8a00640 1 -- 172.21.15.175:0/1650639827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1c40b3730 msgr2=0x7fd1c4144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:58.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1c8a00640 1 --2- 172.21.15.175:0/1650639827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1c40b3730 0x7fd1c4144370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1c8a00640 1 -- 172.21.15.175:0/1650639827 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c41e3cb0 con 0x7fd1c41df9f0 2024-04-25T09:13:58.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1c9400640 1 --2- 172.21.15.175:0/1650639827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1c40b3730 0x7fd1c4144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:58.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1c8a00640 1 --2- 172.21.15.175:0/1650639827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1c41df9f0 0x7fd1c41e3770 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0011b20 tx=0x7fd1b0010440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:58.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1c1600640 1 -- 172.21.15.175:0/1650639827 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b001a640 con 0x7fd1c41df9f0 2024-04-25T09:13:58.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1c1600640 1 -- 172.21.15.175:0/1650639827 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b001a7e0 con 0x7fd1c41df9f0 2024-04-25T09:13:58.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1c1600640 1 -- 172.21.15.175:0/1650639827 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b001ab90 con 0x7fd1c41df9f0 2024-04-25T09:13:58.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1cbe00640 1 -- 172.21.15.175:0/1650639827 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c4144950 con 0x7fd1c41df9f0 2024-04-25T09:13:58.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1cbe00640 1 -- 172.21.15.175:0/1650639827 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c4144f10 con 0x7fd1c41df9f0 2024-04-25T09:13:58.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.052+0000 7fd1cbe00640 1 -- 172.21.15.175:0/1650639827 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c4074a60 con 0x7fd1c41df9f0 2024-04-25T09:13:58.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.056+0000 7fd1c1600640 1 -- 172.21.15.175:0/1650639827 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd1b00193e0 con 0x7fd1c41df9f0 2024-04-25T09:13:58.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.056+0000 7fd1c1600640 1 --2- 172.21.15.175:0/1650639827 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd1a4066f60 0x7fd1a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.056+0000 7fd1c1600640 1 -- 172.21.15.175:0/1650639827 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd1b0085f30 con 0x7fd1c41df9f0 2024-04-25T09:13:58.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.056+0000 7fd1c9400640 1 --2- 172.21.15.175:0/1650639827 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd1a4066f60 0x7fd1a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.056+0000 7fd1c9400640 1 --2- 172.21.15.175:0/1650639827 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd1a4066f60 0x7fd1a4069420 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8009be0 tx=0x7fd1b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:58.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.060+0000 7fd1c1600640 1 -- 172.21.15.175:0/1650639827 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd1b0010e20 con 0x7fd1c41df9f0 2024-04-25T09:13:58.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.244+0000 7fd1cbe00640 1 -- 172.21.15.175:0/1650639827 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1c41582c0 con 0x7fd1c41df9f0 2024-04-25T09:13:58.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.248+0000 7fd1c1600640 1 -- 172.21.15.175:0/1650639827 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+3708 (secure 0 0 0) 0x7fd1b0057140 con 0x7fd1c41df9f0 2024-04-25T09:13:58.234 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:13:58.234 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":88,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6998,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/3519467288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":3519467288},{"type":"v1","addr":"172.21.15.177:6834","nonce":3519467288}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":7639,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/2181426238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":2181426238},{"type":"v1","addr":"172.21.15.177:6835","nonce":2181426238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/936884340","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":936884340},{"type":"v1","addr":"172.21.15.175:6836","nonce":936884340}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":74},{"gid":8547,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/2116018062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":2116018062},{"type":"v1","addr":"172.21.15.175:6837","nonce":2116018062}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":86}],"filesystems":[]} 2024-04-25T09:13:58.234 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 88 2024-04-25T09:13:58.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.248+0000 7fd1cbe00640 1 -- 172.21.15.175:0/1650639827 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd1a4066f60 msgr2=0x7fd1a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:58.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.248+0000 7fd1cbe00640 1 --2- 172.21.15.175:0/1650639827 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd1a4066f60 0x7fd1a4069420 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8009be0 tx=0x7fd1b8008040 comp rx=0 tx=0).stop 2024-04-25T09:13:58.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.248+0000 7fd1cbe00640 1 -- 172.21.15.175:0/1650639827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1c41df9f0 msgr2=0x7fd1c41e3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:58.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.248+0000 7fd1cbe00640 1 --2- 172.21.15.175:0/1650639827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1c41df9f0 0x7fd1c41e3770 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fd1b0011b20 tx=0x7fd1b0010440 comp rx=0 tx=0).stop 2024-04-25T09:13:58.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.248+0000 7fd1cbe00640 1 -- 172.21.15.175:0/1650639827 shutdown_connections 2024-04-25T09:13:58.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.248+0000 7fd1cbe00640 1 --2- 172.21.15.175:0/1650639827 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd1a4066f60 0x7fd1a4069420 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.248+0000 7fd1cbe00640 1 --2- 172.21.15.175:0/1650639827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1c40b3b10 0x7fd1c4142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.248+0000 7fd1cbe00640 1 --2- 172.21.15.175:0/1650639827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1c41df9f0 0x7fd1c41e3770 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.248+0000 7fd1cbe00640 1 --2- 172.21.15.175:0/1650639827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1c40b3730 0x7fd1c4144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.248+0000 7fd1cbe00640 1 -- 172.21.15.175:0/1650639827 >> 172.21.15.175:0/1650639827 conn(0x7fd1ac004d50 msgr2=0x7fd1c4158e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:58.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.248+0000 7fd1cbe00640 1 -- 172.21.15.175:0/1650639827 shutdown_connections 2024-04-25T09:13:58.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.248+0000 7fd1cbe00640 1 -- 172.21.15.175:0/1650639827 wait complete. 2024-04-25T09:13:58.257 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:13:58.257 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:13:58.257 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:13:58.257 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:13:58.257 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:13:58.257 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:13:58.258 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:13:58.258 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:13:58.258 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:13:58.258 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:13:58.258 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:13:58.258 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:13:58.258 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:13:58.258 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:13:58.259 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:13:58.259 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:13:58.270 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:13:58.270 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:13:58.271 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:13:58.271 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:13:58.274 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:13:58.274 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:13:58.274 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:13:58.275 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:13:58.316 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:13:58.316 DEBUG:teuthology.parallel:result is None 2024-04-25T09:13:58.317 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:13:58.317 DEBUG:teuthology.parallel:result is None 2024-04-25T09:13:58.323 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:13:58.323 DEBUG:teuthology.parallel:result is None 2024-04-25T09:13:58.324 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:13:58.324 DEBUG:teuthology.parallel:result is None 2024-04-25T09:13:58.324 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:13:58.403 INFO:tasks.ceph.mds.c.smithi175.stdout:starting mds.c at 2024-04-25T09:13:58.403 INFO:tasks.ceph.mds.a.smithi175.stdout:starting mds.a at 2024-04-25T09:13:58.412 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2024-04-25T09:13:58.413 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2024-04-25T09:13:58.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.480+0000 7fb028000640 1 Processor -- start 2024-04-25T09:13:58.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.480+0000 7fb028000640 1 -- start start 2024-04-25T09:13:58.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.484+0000 7fb028000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb02015af20 0x7fb0200b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.484+0000 7fb028000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0200b4630 0x7fb02015c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.484+0000 7fb028000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02006db60 con 0x7fb0200cbe60 2024-04-25T09:13:58.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.484+0000 7fb028000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02006de40 con 0x7fb02015af20 2024-04-25T09:13:58.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.484+0000 7fb028000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02006e120 con 0x7fb0200b4630 2024-04-25T09:13:58.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.484+0000 7fb025600640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb0200cbe60 0x7fb02006d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:44072/0 (socket says 172.21.15.175:44072) 2024-04-25T09:13:58.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.484+0000 7fb025600640 1 -- 172.21.15.175:0/3795942624 learned_addr learned my addr 172.21.15.175:0/3795942624 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:58.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.484+0000 7fb024c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb02015af20 0x7fb0200b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.484+0000 7fb026000640 1 --2- 172.21.15.175:0/3795942624 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0200b4630 0x7fb02015c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.484+0000 7fb024c00640 1 -- 172.21.15.175:0/3795942624 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0200b4630 msgr2=0x7fb02015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:13:58.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.484+0000 7fb024c00640 1 --2- 172.21.15.175:0/3795942624 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0200b4630 0x7fb02015c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.484+0000 7fb024c00640 1 -- 172.21.15.175:0/3795942624 >> v1:172.21.15.175:6789/0 conn(0x7fb0200cbe60 legacy=0x7fb02006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:58.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.484+0000 7fb024c00640 1 -- 172.21.15.175:0/3795942624 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02015c2f0 con 0x7fb02015af20 2024-04-25T09:13:58.472 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.484+0000 7fb01fe00640 1 -- 172.21.15.175:0/3795942624 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921319720 0 0) 0x7fb02006db60 con 0x7fb0200cbe60 2024-04-25T09:13:58.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb024c00640 1 --2- 172.21.15.175:0/3795942624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb02015af20 0x7fb0200b40f0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0097c0 tx=0x7fb00c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806da8923cf7bf7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:58.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb01fe00640 1 -- 172.21.15.175:0/3795942624 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c0b0070 con 0x7fb02015af20 2024-04-25T09:13:58.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb01fe00640 1 -- 172.21.15.175:0/3795942624 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c0ab600 con 0x7fb02015af20 2024-04-25T09:13:58.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb01fe00640 1 -- 172.21.15.175:0/3795942624 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c0ab9d0 con 0x7fb02015af20 2024-04-25T09:13:58.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb028000640 1 -- 172.21.15.175:0/3795942624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb02015af20 msgr2=0x7fb0200b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:58.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb028000640 1 --2- 172.21.15.175:0/3795942624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb02015af20 0x7fb0200b40f0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0097c0 tx=0x7fb00c01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb028000640 1 -- 172.21.15.175:0/3795942624 shutdown_connections 2024-04-25T09:13:58.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb028000640 1 --2- 172.21.15.175:0/3795942624 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0200b4630 0x7fb02015c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb028000640 1 --2- 172.21.15.175:0/3795942624 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb02015af20 0x7fb0200b40f0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb028000640 1 -- 172.21.15.175:0/3795942624 >> 172.21.15.175:0/3795942624 conn(0x7fb02006ac50 msgr2=0x7fb02006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:58.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb028000640 1 -- 172.21.15.175:0/3795942624 shutdown_connections 2024-04-25T09:13:58.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb028000640 1 -- 172.21.15.175:0/3795942624 wait complete. 2024-04-25T09:13:58.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb028000640 1 Processor -- start 2024-04-25T09:13:58.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb028000640 1 -- start start 2024-04-25T09:13:58.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb028000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0200b4630 0x7fb0201fa020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb028000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0200cbe60 0x7fb020155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb028000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb02015af20 0x7fb020156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb028000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02015d970 con 0x7fb0200b4630 2024-04-25T09:13:58.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb028000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02015d7f0 con 0x7fb0200cbe60 2024-04-25T09:13:58.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb028000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02015daf0 con 0x7fb02015af20 2024-04-25T09:13:58.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb025600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0200b4630 0x7fb0201fa020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb025600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0200b4630 0x7fb0201fa020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:51230/0 (socket says 172.21.15.175:51230) 2024-04-25T09:13:58.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb025600640 1 -- 172.21.15.175:0/1795099258 learned_addr learned my addr 172.21.15.175:0/1795099258 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:58.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb026000640 1 --2- 172.21.15.175:0/1795099258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb02015af20 0x7fb020156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.488+0000 7fb024c00640 1 --2- 172.21.15.175:0/1795099258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0200cbe60 0x7fb020155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.492+0000 7fb025600640 1 -- 172.21.15.175:0/1795099258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb02015af20 msgr2=0x7fb020156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:58.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.492+0000 7fb025600640 1 --2- 172.21.15.175:0/1795099258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb02015af20 0x7fb020156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.492+0000 7fb025600640 1 -- 172.21.15.175:0/1795099258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0200cbe60 msgr2=0x7fb020155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:58.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.492+0000 7fb025600640 1 --2- 172.21.15.175:0/1795099258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0200cbe60 0x7fb020155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:58.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.492+0000 7fb025600640 1 -- 172.21.15.175:0/1795099258 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb020154430 con 0x7fb0200b4630 2024-04-25T09:13:58.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.492+0000 7fb024c00640 1 --2- 172.21.15.175:0/1795099258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0200cbe60 0x7fb020155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:13:58.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.492+0000 7fb025600640 1 --2- 172.21.15.175:0/1795099258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0200b4630 0x7fb0201fa020 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fb01400c7c0 tx=0x7fb01400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:58.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.492+0000 7fb01d600640 1 -- 172.21.15.175:0/1795099258 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014018070 con 0x7fb0200b4630 2024-04-25T09:13:58.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.492+0000 7fb01d600640 1 -- 172.21.15.175:0/1795099258 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01400a640 con 0x7fb0200b4630 2024-04-25T09:13:58.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.492+0000 7fb028000640 1 -- 172.21.15.175:0/1795099258 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb020154710 con 0x7fb0200b4630 2024-04-25T09:13:58.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.492+0000 7fb01d600640 1 -- 172.21.15.175:0/1795099258 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01400aa30 con 0x7fb0200b4630 2024-04-25T09:13:58.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.492+0000 7fb028000640 1 -- 172.21.15.175:0/1795099258 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb020154cd0 con 0x7fb0200b4630 2024-04-25T09:13:58.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.492+0000 7fb028000640 1 -- 172.21.15.175:0/1795099258 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0200ae330 con 0x7fb0200b4630 2024-04-25T09:13:58.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.492+0000 7fb01d600640 1 -- 172.21.15.175:0/1795099258 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb01401b070 con 0x7fb0200b4630 2024-04-25T09:13:58.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.492+0000 7fb01d600640 1 --2- 172.21.15.175:0/1795099258 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb000066f60 0x7fb000069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:58.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.492+0000 7fb01d600640 1 -- 172.21.15.175:0/1795099258 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fb014084350 con 0x7fb0200b4630 2024-04-25T09:13:58.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.492+0000 7fb024c00640 1 --2- 172.21.15.175:0/1795099258 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb000066f60 0x7fb000069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:58.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.496+0000 7fb024c00640 1 --2- 172.21.15.175:0/1795099258 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb000066f60 0x7fb000069420 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0ad000 tx=0x7fb00c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:58.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.496+0000 7fb01d600640 1 -- 172.21.15.175:0/1795099258 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb0200ae330 con 0x7fb0200b4630 2024-04-25T09:13:58.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:58.664+0000 7fb028000640 1 -- 172.21.15.175:0/1795099258 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb020075160 con 0x7fb0200b4630 2024-04-25T09:13:59.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.644+0000 7fb01d600640 1 -- 172.21.15.175:0/1795099258 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v109) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb014054fa0 con 0x7fb0200b4630 2024-04-25T09:13:59.632 INFO:teuthology.orchestra.run.smithi175.stderr: removed all blocklist entries 2024-04-25T09:13:59.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.648+0000 7fb028000640 1 -- 172.21.15.175:0/1795099258 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb000066f60 msgr2=0x7fb000069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.648+0000 7fb028000640 1 --2- 172.21.15.175:0/1795099258 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb000066f60 0x7fb000069420 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0ad000 tx=0x7fb00c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:13:59.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.648+0000 7fb028000640 1 -- 172.21.15.175:0/1795099258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0200b4630 msgr2=0x7fb0201fa020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.648+0000 7fb028000640 1 --2- 172.21.15.175:0/1795099258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0200b4630 0x7fb0201fa020 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fb01400c7c0 tx=0x7fb01400cc80 comp rx=0 tx=0).stop 2024-04-25T09:13:59.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.648+0000 7fb028000640 1 -- 172.21.15.175:0/1795099258 shutdown_connections 2024-04-25T09:13:59.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.648+0000 7fb028000640 1 --2- 172.21.15.175:0/1795099258 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb000066f60 0x7fb000069420 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.648+0000 7fb028000640 1 --2- 172.21.15.175:0/1795099258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb02015af20 0x7fb020156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.648+0000 7fb028000640 1 --2- 172.21.15.175:0/1795099258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0200cbe60 0x7fb020155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.635 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.648+0000 7fb028000640 1 --2- 172.21.15.175:0/1795099258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0200b4630 0x7fb0201fa020 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.648+0000 7fb028000640 1 -- 172.21.15.175:0/1795099258 >> 172.21.15.175:0/1795099258 conn(0x7fb02006ac50 msgr2=0x7fb02015a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:59.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.648+0000 7fb028000640 1 -- 172.21.15.175:0/1795099258 shutdown_connections 2024-04-25T09:13:59.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.648+0000 7fb028000640 1 -- 172.21.15.175:0/1795099258 wait complete. 2024-04-25T09:13:59.657 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:13:59.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.808+0000 7fdebf200640 1 Processor -- start 2024-04-25T09:13:59.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.808+0000 7fdebf200640 1 -- start start 2024-04-25T09:13:59.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.812+0000 7fdebf200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdeb80add90 0x7fdeb80ae680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.812+0000 7fdebf200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb815dfb0 con 0x7fdeb80aebc0 2024-04-25T09:13:59.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.812+0000 7fdebf200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb80b2980 con 0x7fdeb815dbd0 2024-04-25T09:13:59.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.812+0000 7fdebf200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb80ae1d0 con 0x7fdeb80add90 2024-04-25T09:13:59.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.812+0000 7fdebd200640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fdeb80aebc0 0x7fdeb8167700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:47656/0 (socket says 172.21.15.175:47656) 2024-04-25T09:13:59.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.812+0000 7fdebd200640 1 -- 172.21.15.175:0/2358846504 learned_addr learned my addr 172.21.15.175:0/2358846504 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:13:59.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.812+0000 7fdeaf400640 1 --2- 172.21.15.175:0/2358846504 >> v2:172.21.15.177:3300/0 conn(0x7fdeb80add90 0x7fdeb80ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.812+0000 7fdeb7400640 1 -- 172.21.15.175:0/2358846504 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531255371 0 0) 0x7fdeb815dfb0 con 0x7fdeb80aebc0 2024-04-25T09:13:59.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.812+0000 7fdeb7400640 1 -- 172.21.15.175:0/2358846504 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde9c003530 con 0x7fdeb80aebc0 2024-04-25T09:13:59.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.812+0000 7fdeaf400640 1 -- 172.21.15.175:0/2358846504 >> v1:172.21.15.177:6789/0 conn(0x7fdeb815dbd0 legacy=0x7fdeb8071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.812+0000 7fdeaf400640 1 -- 172.21.15.175:0/2358846504 >> v1:172.21.15.175:6789/0 conn(0x7fdeb80aebc0 legacy=0x7fdeb8167700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.812+0000 7fdeaf400640 1 -- 172.21.15.175:0/2358846504 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb80b2c60 con 0x7fdeb80add90 2024-04-25T09:13:59.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.816+0000 7fdeaf400640 1 --2- 172.21.15.175:0/2358846504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdeb80add90 0x7fdeb80ae680 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fdea00097c0 tx=0x7fdea001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e8fa8ab38d7999c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:59.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.816+0000 7fdeb7400640 1 -- 172.21.15.175:0/2358846504 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea00b0070 con 0x7fdeb80add90 2024-04-25T09:13:59.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.816+0000 7fdeb7400640 1 -- 172.21.15.175:0/2358846504 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea00ab600 con 0x7fdeb80add90 2024-04-25T09:13:59.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.816+0000 7fdeb7400640 1 -- 172.21.15.175:0/2358846504 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea00ab9d0 con 0x7fdeb80add90 2024-04-25T09:13:59.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.816+0000 7fdebf200640 1 -- 172.21.15.175:0/2358846504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdeb80add90 msgr2=0x7fdeb80ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.816+0000 7fdebf200640 1 --2- 172.21.15.175:0/2358846504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdeb80add90 0x7fdeb80ae680 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fdea00097c0 tx=0x7fdea001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.816+0000 7fdebf200640 1 -- 172.21.15.175:0/2358846504 shutdown_connections 2024-04-25T09:13:59.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.816+0000 7fdebf200640 1 --2- 172.21.15.175:0/2358846504 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdeb80add90 0x7fdeb80ae680 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.816+0000 7fdebf200640 1 -- 172.21.15.175:0/2358846504 >> 172.21.15.175:0/2358846504 conn(0x7fdeb8067150 msgr2=0x7fdeb806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:13:59.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.816+0000 7fdebf200640 1 -- 172.21.15.175:0/2358846504 shutdown_connections 2024-04-25T09:13:59.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.816+0000 7fdebf200640 1 -- 172.21.15.175:0/2358846504 wait complete. 2024-04-25T09:13:59.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.816+0000 7fdebf200640 1 Processor -- start 2024-04-25T09:13:59.805 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.816+0000 7fdebf200640 1 -- start start 2024-04-25T09:13:59.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdebf200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdeb80aebc0 0x7fdeb8154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdebf200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdeb815dbd0 0x7fdeb8155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdebf200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdeb815b730 0x7fdeb815bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdebf200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb816b640 con 0x7fdeb815b730 2024-04-25T09:13:59.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdebf200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb80b3590 con 0x7fdeb80aebc0 2024-04-25T09:13:59.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdebf200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb816b7c0 con 0x7fdeb815dbd0 2024-04-25T09:13:59.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdebd200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdeb815b730 0x7fdeb815bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdebd200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdeb815b730 0x7fdeb815bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60940/0 (socket says 172.21.15.175:60940) 2024-04-25T09:13:59.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdebd200640 1 -- 172.21.15.175:0/278992072 learned_addr learned my addr 172.21.15.175:0/278992072 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:13:59.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdeaf400640 1 --2- 172.21.15.175:0/278992072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdeb815dbd0 0x7fdeb8155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdeb7e00640 1 --2- 172.21.15.175:0/278992072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdeb80aebc0 0x7fdeb8154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdebd200640 1 -- 172.21.15.175:0/278992072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdeb815dbd0 msgr2=0x7fdeb8155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdebd200640 1 --2- 172.21.15.175:0/278992072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdeb815dbd0 0x7fdeb8155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.808 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdebd200640 1 -- 172.21.15.175:0/278992072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdeb80aebc0 msgr2=0x7fdeb8154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:13:59.808 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdebd200640 1 --2- 172.21.15.175:0/278992072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdeb80aebc0 0x7fdeb8154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:13:59.808 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdebd200640 1 -- 172.21.15.175:0/278992072 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb8150cb0 con 0x7fdeb815b730 2024-04-25T09:13:59.808 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdebd200640 1 --2- 172.21.15.175:0/278992072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdeb815b730 0x7fdeb815bbe0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000c3c0 tx=0x7fdeb0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:59.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdeb4c00640 1 -- 172.21.15.175:0/278992072 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb0017070 con 0x7fdeb815b730 2024-04-25T09:13:59.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdebf200640 1 -- 172.21.15.175:0/278992072 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb8156ad0 con 0x7fdeb815b730 2024-04-25T09:13:59.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdeb4c00640 1 -- 172.21.15.175:0/278992072 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb0005cf0 con 0x7fdeb815b730 2024-04-25T09:13:59.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdeb4c00640 1 -- 172.21.15.175:0/278992072 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb00072f0 con 0x7fdeb815b730 2024-04-25T09:13:59.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdebf200640 1 -- 172.21.15.175:0/278992072 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb8150f70 con 0x7fdeb815b730 2024-04-25T09:13:59.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.820+0000 7fdebf200640 1 -- 172.21.15.175:0/278992072 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb8074a60 con 0x7fdeb815b730 2024-04-25T09:13:59.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.824+0000 7fdeb4c00640 1 -- 172.21.15.175:0/278992072 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdeb001a070 con 0x7fdeb815b730 2024-04-25T09:13:59.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.824+0000 7fdeb4c00640 1 --2- 172.21.15.175:0/278992072 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde94066f60 0x7fde94069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:13:59.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.824+0000 7fdeb4c00640 1 -- 172.21.15.175:0/278992072 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdeb0083ff0 con 0x7fdeb815b730 2024-04-25T09:13:59.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.824+0000 7fdeb7e00640 1 --2- 172.21.15.175:0/278992072 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde94066f60 0x7fde94069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:13:59.811 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.824+0000 7fdeb7e00640 1 --2- 172.21.15.175:0/278992072 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde94066f60 0x7fde94069420 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fdea8001e00 tx=0x7fdea8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:13:59.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:13:59.828+0000 7fdeb4c00640 1 -- 172.21.15.175:0/278992072 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdeb0054cd0 con 0x7fdeb815b730 2024-04-25T09:14:00.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.036+0000 7fdebf200640 1 -- 172.21.15.175:0/278992072 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdeb8156220 con 0x7fdeb815b730 2024-04-25T09:14:00.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.036+0000 7fdeb4c00640 1 -- 172.21.15.175:0/278992072 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fdeb0058d70 con 0x7fdeb815b730 2024-04-25T09:14:00.023 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:00.023 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:14:00.023 INFO:teuthology.orchestra.run.smithi175.stdout: "auth_dump": [ 2024-04-25T09:14:00.023 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.024 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.a", 2024-04-25T09:14:00.024 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpm3usiKxAAROh+31LaNyuh2SdeW6pKjQ==", 2024-04-25T09:14:00.024 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.024 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:14:00.024 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:14:00.024 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:14:00.024 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:14:00.024 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.024 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:14:00.024 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.024 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.b", 2024-04-25T09:14:00.024 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmYJoRNxAAZfRvDn1aoR0wa2mEKBrr+A==", 2024-04-25T09:14:00.024 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.024 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:14:00.025 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:14:00.025 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:14:00.025 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:14:00.025 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:14:00.025 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.025 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.c", 2024-04-25T09:14:00.025 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmk8M3MhAA6aIN33aWvVcvVEFtHL8SWA==", 2024-04-25T09:14:00.025 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.025 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:14:00.025 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:14:00.025 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:14:00.025 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:14:00.025 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.025 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:14:00.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.026 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mds.d", 2024-04-25T09:14:00.026 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmLAHLAhAA+mWUfpb6izHixJa073r9Jw==", 2024-04-25T09:14:00.026 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.026 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:14:00.026 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:14:00.026 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:14:00.026 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:14:00.026 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.026 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:14:00.026 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.026 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.0", 2024-04-25T09:14:00.026 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBSHCpm2xftAxAAxs9n8AE2H3HpPHEUZA4Cng==", 2024-04-25T09:14:00.026 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.027 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:14:00.027 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:14:00.027 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:14:00.027 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:14:00.027 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.027 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.1", 2024-04-25T09:14:00.027 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBVHCpm/OOlDRAAA7zaD8qsqS2TOCKhDFheJw==", 2024-04-25T09:14:00.027 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.027 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:14:00.027 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:14:00.027 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:14:00.027 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.027 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:14:00.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.028 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.2", 2024-04-25T09:14:00.028 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBYHCpmy/kmFxAAwCADFI/jMe27gAmyuAJZHQ==", 2024-04-25T09:14:00.028 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.028 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:14:00.028 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:14:00.028 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:14:00.028 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.028 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:14:00.028 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.028 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.3", 2024-04-25T09:14:00.028 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBbHCpm89a7HhAAVTueOuS0/Ksf8SdWK+Nm1g==", 2024-04-25T09:14:00.028 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.028 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:14:00.029 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:14:00.029 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:14:00.029 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:14:00.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.029 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.4", 2024-04-25T09:14:00.029 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBhHCpm5EAtFRAAeADhjja0BOIvxY3RB+n6+A==", 2024-04-25T09:14:00.029 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.029 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:14:00.029 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:14:00.029 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:14:00.029 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.029 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:14:00.029 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.030 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.5", 2024-04-25T09:14:00.030 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBkHCpmrLilHRAA+H8Bejnk49YfaUvl3Nrrhw==", 2024-04-25T09:14:00.030 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.030 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:14:00.030 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:14:00.030 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:14:00.030 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.030 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:14:00.030 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.030 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.6", 2024-04-25T09:14:00.030 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBnHCpm6uDxJRAAX5EwEelnZXwEHnNnv+XQ6A==", 2024-04-25T09:14:00.030 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.030 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:14:00.031 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:14:00.031 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:14:00.031 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:14:00.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.031 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "osd.7", 2024-04-25T09:14:00.031 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBqHCpmwow5MBAA7b/Q9DiPO6Bfldq1+rf+/w==", 2024-04-25T09:14:00.031 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.031 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow profile osd", 2024-04-25T09:14:00.031 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile osd", 2024-04-25T09:14:00.031 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:14:00.031 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.031 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:14:00.031 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.031 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.0", 2024-04-25T09:14:00.031 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmhyCUBhAA8k9xLKIw8R04i6HSJykDfw==", 2024-04-25T09:14:00.032 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.032 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:14:00.032 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow r", 2024-04-25T09:14:00.032 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:14:00.032 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.032 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:14:00.032 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.032 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.1", 2024-04-25T09:14:00.032 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpmQigrEBAAoWfP1ZEosbLELev5z+C9/g==", 2024-04-25T09:14:00.032 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.032 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:14:00.032 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:14:00.032 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:14:00.032 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:14:00.032 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:14:00.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.033 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.2", 2024-04-25T09:14:00.033 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpm0xaSDBAAup34GS3pnMwjksVuuUGOkw==", 2024-04-25T09:14:00.033 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.033 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:14:00.033 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:14:00.033 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:14:00.033 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:14:00.033 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.033 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:14:00.033 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.033 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.3", 2024-04-25T09:14:00.033 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBPHCpm6+doFhAAA18OgwfM8gXgQ6g0KUo7Hw==", 2024-04-25T09:14:00.033 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.034 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow", 2024-04-25T09:14:00.034 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow r", 2024-04-25T09:14:00.034 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow rw", 2024-04-25T09:14:00.034 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow rwx" 2024-04-25T09:14:00.034 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.034 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:14:00.034 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.034 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "client.admin", 2024-04-25T09:14:00.034 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmRZAYDRAA9sepw/fI2OhoZXER6Rmd+g==", 2024-04-25T09:14:00.034 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.034 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:14:00.034 INFO:teuthology.orchestra.run.smithi175.stdout: "mgr": "allow *", 2024-04-25T09:14:00.034 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow *", 2024-04-25T09:14:00.034 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:14:00.035 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:14:00.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.035 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mgr.x", 2024-04-25T09:14:00.035 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpm5q4gJxAA9zPRlimxM0+Rb5RQkcoxzQ==", 2024-04-25T09:14:00.035 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.035 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:14:00.035 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile mgr", 2024-04-25T09:14:00.035 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:14:00.035 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.035 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2024-04-25T09:14:00.035 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:00.035 INFO:teuthology.orchestra.run.smithi175.stdout: "entity": "mgr.y", 2024-04-25T09:14:00.035 INFO:teuthology.orchestra.run.smithi175.stdout: "key": "AQBOHCpmMLIqIxAAiMo8+3lU0fXNoI6kBrro+Q==", 2024-04-25T09:14:00.035 INFO:teuthology.orchestra.run.smithi175.stdout: "caps": { 2024-04-25T09:14:00.036 INFO:teuthology.orchestra.run.smithi175.stdout: "mds": "allow *", 2024-04-25T09:14:00.036 INFO:teuthology.orchestra.run.smithi175.stdout: "mon": "allow profile mgr", 2024-04-25T09:14:00.036 INFO:teuthology.orchestra.run.smithi175.stdout: "osd": "allow *" 2024-04-25T09:14:00.036 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.036 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:00.036 INFO:teuthology.orchestra.run.smithi175.stdout: ] 2024-04-25T09:14:00.036 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:14:00.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.036+0000 7fdebf200640 1 -- 172.21.15.175:0/278992072 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde94066f60 msgr2=0x7fde94069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.036+0000 7fdebf200640 1 --2- 172.21.15.175:0/278992072 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde94066f60 0x7fde94069420 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fdea8001e00 tx=0x7fdea8009040 comp rx=0 tx=0).stop 2024-04-25T09:14:00.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.036+0000 7fdebf200640 1 -- 172.21.15.175:0/278992072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdeb815b730 msgr2=0x7fdeb815bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.036+0000 7fdebf200640 1 --2- 172.21.15.175:0/278992072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdeb815b730 0x7fdeb815bbe0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000c3c0 tx=0x7fdeb0001e80 comp rx=0 tx=0).stop 2024-04-25T09:14:00.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.040+0000 7fdebf200640 1 -- 172.21.15.175:0/278992072 shutdown_connections 2024-04-25T09:14:00.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.040+0000 7fdebf200640 1 --2- 172.21.15.175:0/278992072 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde94066f60 0x7fde94069420 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.040+0000 7fdebf200640 1 --2- 172.21.15.175:0/278992072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdeb815b730 0x7fdeb815bbe0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.040+0000 7fdebf200640 1 --2- 172.21.15.175:0/278992072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdeb815dbd0 0x7fdeb8155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.040+0000 7fdebf200640 1 --2- 172.21.15.175:0/278992072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdeb80aebc0 0x7fdeb8154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.040+0000 7fdebf200640 1 -- 172.21.15.175:0/278992072 >> 172.21.15.175:0/278992072 conn(0x7fdeb80add90 msgr2=0x7fdeb80affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:00.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.040+0000 7fdebf200640 1 -- 172.21.15.175:0/278992072 shutdown_connections 2024-04-25T09:14:00.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.040+0000 7fdebf200640 1 -- 172.21.15.175:0/278992072 wait complete. 2024-04-25T09:14:00.046 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:14:00.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.196+0000 7fb709e00640 1 Processor -- start 2024-04-25T09:14:00.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.196+0000 7fb709e00640 1 -- start start 2024-04-25T09:14:00.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.196+0000 7fb709e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb70415b930 0x7fb7040cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.196+0000 7fb709e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7040b2030 con 0x7fb7040d03b0 2024-04-25T09:14:00.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.196+0000 7fb709e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7040cc400 con 0x7fb70409a5f0 2024-04-25T09:14:00.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.196+0000 7fb709e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7040cc1d0 con 0x7fb70415b930 2024-04-25T09:14:00.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.196+0000 7fb709400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb7040d03b0 0x7fb7040b2480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:47668/0 (socket says 172.21.15.175:47668) 2024-04-25T09:14:00.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.196+0000 7fb709400640 1 -- 172.21.15.175:0/1177371002 learned_addr learned my addr 172.21.15.175:0/1177371002 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:00.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.196+0000 7fb708a00640 1 --2- 172.21.15.175:0/1177371002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb70415b930 0x7fb7040cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.196+0000 7fb703400640 1 -- 172.21.15.175:0/1177371002 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779869329 0 0) 0x7fb7040b2030 con 0x7fb7040d03b0 2024-04-25T09:14:00.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.196+0000 7fb703400640 1 -- 172.21.15.175:0/1177371002 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6ec003530 con 0x7fb7040d03b0 2024-04-25T09:14:00.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.196+0000 7fb708a00640 1 -- 172.21.15.175:0/1177371002 >> v1:172.21.15.177:6789/0 conn(0x7fb70409a5f0 legacy=0x7fb7040cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.196+0000 7fb703400640 1 -- 172.21.15.175:0/1177371002 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275789748 0 0) 0x7fb7040cc400 con 0x7fb70409a5f0 2024-04-25T09:14:00.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.196+0000 7fb708a00640 1 -- 172.21.15.175:0/1177371002 >> v1:172.21.15.175:6789/0 conn(0x7fb7040d03b0 legacy=0x7fb7040b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.196+0000 7fb708a00640 1 -- 172.21.15.175:0/1177371002 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7040cc6e0 con 0x7fb70415b930 2024-04-25T09:14:00.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.200+0000 7fb708a00640 1 --2- 172.21.15.175:0/1177371002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb70415b930 0x7fb7040cf290 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80097f0 tx=0x7fb6f801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bea5023b8bda2a17 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:00.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.200+0000 7fb703400640 1 -- 172.21.15.175:0/1177371002 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80ab5f0 con 0x7fb70415b930 2024-04-25T09:14:00.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.200+0000 7fb703400640 1 -- 172.21.15.175:0/1177371002 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f80b0070 con 0x7fb70415b930 2024-04-25T09:14:00.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.200+0000 7fb703400640 1 -- 172.21.15.175:0/1177371002 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80ab9b0 con 0x7fb70415b930 2024-04-25T09:14:00.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.200+0000 7fb709e00640 1 -- 172.21.15.175:0/1177371002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb70415b930 msgr2=0x7fb7040cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.200+0000 7fb709e00640 1 --2- 172.21.15.175:0/1177371002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb70415b930 0x7fb7040cf290 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80097f0 tx=0x7fb6f801c4e0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.200+0000 7fb709e00640 1 -- 172.21.15.175:0/1177371002 shutdown_connections 2024-04-25T09:14:00.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.200+0000 7fb709e00640 1 --2- 172.21.15.175:0/1177371002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb70415b930 0x7fb7040cf290 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.200+0000 7fb709e00640 1 -- 172.21.15.175:0/1177371002 >> 172.21.15.175:0/1177371002 conn(0x7fb7040b31b0 msgr2=0x7fb7040b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:00.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.200+0000 7fb709e00640 1 -- 172.21.15.175:0/1177371002 shutdown_connections 2024-04-25T09:14:00.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.200+0000 7fb709e00640 1 -- 172.21.15.175:0/1177371002 wait complete. 2024-04-25T09:14:00.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.200+0000 7fb709e00640 1 Processor -- start 2024-04-25T09:14:00.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb709e00640 1 -- start start 2024-04-25T09:14:00.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb709e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7040d03b0 0x7fb70406d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb709e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb70415b930 0x7fb70406bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb709e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb70415e920 0x7fb704156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb709e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7040cd4a0 con 0x7fb7040d03b0 2024-04-25T09:14:00.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb709e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7040ccf80 con 0x7fb70415b930 2024-04-25T09:14:00.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb709e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7040cd620 con 0x7fb70415e920 2024-04-25T09:14:00.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb708a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7040d03b0 0x7fb70406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb708a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7040d03b0 0x7fb70406d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60946/0 (socket says 172.21.15.175:60946) 2024-04-25T09:14:00.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb708a00640 1 -- 172.21.15.175:0/1713881943 learned_addr learned my addr 172.21.15.175:0/1713881943 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:00.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb709400640 1 --2- 172.21.15.175:0/1713881943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb70415e920 0x7fb704156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb703e00640 1 --2- 172.21.15.175:0/1713881943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb70415b930 0x7fb70406bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb708a00640 1 -- 172.21.15.175:0/1713881943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb70415e920 msgr2=0x7fb704156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb708a00640 1 --2- 172.21.15.175:0/1713881943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb70415e920 0x7fb704156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb708a00640 1 -- 172.21.15.175:0/1713881943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb70415b930 msgr2=0x7fb70406bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb708a00640 1 --2- 172.21.15.175:0/1713881943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb70415b930 0x7fb70406bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb708a00640 1 -- 172.21.15.175:0/1713881943 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70406c870 con 0x7fb7040d03b0 2024-04-25T09:14:00.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb708a00640 1 --2- 172.21.15.175:0/1713881943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7040d03b0 0x7fb70406d910 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80097f0 tx=0x7fb6f801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:00.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb700c00640 1 -- 172.21.15.175:0/1713881943 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80bf400 con 0x7fb7040d03b0 2024-04-25T09:14:00.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb700c00640 1 -- 172.21.15.175:0/1713881943 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f80bf5c0 con 0x7fb7040d03b0 2024-04-25T09:14:00.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb700c00640 1 -- 172.21.15.175:0/1713881943 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80bf9b0 con 0x7fb7040d03b0 2024-04-25T09:14:00.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb709e00640 1 -- 172.21.15.175:0/1713881943 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70406cb50 con 0x7fb7040d03b0 2024-04-25T09:14:00.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb709e00640 1 -- 172.21.15.175:0/1713881943 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb70406d110 con 0x7fb7040d03b0 2024-04-25T09:14:00.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.204+0000 7fb709e00640 1 -- 172.21.15.175:0/1713881943 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb704074a60 con 0x7fb7040d03b0 2024-04-25T09:14:00.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.208+0000 7fb700c00640 1 -- 172.21.15.175:0/1713881943 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb6f80b5400 con 0x7fb7040d03b0 2024-04-25T09:14:00.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.208+0000 7fb700c00640 1 --2- 172.21.15.175:0/1713881943 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb6e4066f60 0x7fb6e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.208+0000 7fb700c00640 1 -- 172.21.15.175:0/1713881943 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb6f811efb0 con 0x7fb7040d03b0 2024-04-25T09:14:00.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.208+0000 7fb703e00640 1 --2- 172.21.15.175:0/1713881943 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb6e4066f60 0x7fb6e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.208+0000 7fb703e00640 1 --2- 172.21.15.175:0/1713881943 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb6e4066f60 0x7fb6e4069420 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb7040c5140 tx=0x7fb6f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:00.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.212+0000 7fb700c00640 1 -- 172.21.15.175:0/1713881943 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb6f80160d0 con 0x7fb7040d03b0 2024-04-25T09:14:00.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.368+0000 7fb709e00640 1 -- 172.21.15.175:0/1713881943 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7040afde0 con 0x7fb7040d03b0 2024-04-25T09:14:00.354 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.368+0000 7fb700c00640 1 -- 172.21.15.175:0/1713881943 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+12929 (secure 0 0 0) 0x7fb6f80efc20 con 0x7fb7040d03b0 2024-04-25T09:14:00.355 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:00.355 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":109,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:13:59.645665+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.368+0000 7fb709e00640 1 -- 172.21.15.175:0/1713881943 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb6e4066f60 msgr2=0x7fb6e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.368+0000 7fb709e00640 1 --2- 172.21.15.175:0/1713881943 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb6e4066f60 0x7fb6e4069420 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb7040c5140 tx=0x7fb6f0009040 comp rx=0 tx=0).stop 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.368+0000 7fb709e00640 1 -- 172.21.15.175:0/1713881943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7040d03b0 msgr2=0x7fb70406d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.368+0000 7fb709e00640 1 --2- 172.21.15.175:0/1713881943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7040d03b0 0x7fb70406d910 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fb6f80097f0 tx=0x7fb6f801ad20 comp rx=0 tx=0).stop 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.368+0000 7fb709e00640 1 -- 172.21.15.175:0/1713881943 shutdown_connections 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.368+0000 7fb709e00640 1 --2- 172.21.15.175:0/1713881943 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb6e4066f60 0x7fb6e4069420 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.368+0000 7fb709e00640 1 --2- 172.21.15.175:0/1713881943 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb70415e920 0x7fb704156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.368+0000 7fb709e00640 1 --2- 172.21.15.175:0/1713881943 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb70415b930 0x7fb70406bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.368+0000 7fb709e00640 1 --2- 172.21.15.175:0/1713881943 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7040d03b0 0x7fb70406d910 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.368+0000 7fb709e00640 1 -- 172.21.15.175:0/1713881943 >> 172.21.15.175:0/1713881943 conn(0x7fb7040b31b0 msgr2=0x7fb7040ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:00.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.368+0000 7fb709e00640 1 -- 172.21.15.175:0/1713881943 shutdown_connections 2024-04-25T09:14:00.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.368+0000 7fb709e00640 1 -- 172.21.15.175:0/1713881943 wait complete. 2024-04-25T09:14:00.376 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:14:00.376 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:14:00.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f7285800640 1 Processor -- start 2024-04-25T09:14:00.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f7285800640 1 -- start start 2024-04-25T09:14:00.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f7285800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f728015ddf0 0x7f7280099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f7285800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f72800d0630 0x7f7280099f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f7285800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72800d0b40 con 0x7f72800cc3f0 2024-04-25T09:14:00.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f7285800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72800cbf60 con 0x7f72800d0630 2024-04-25T09:14:00.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f7285800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72800d0e20 con 0x7f728015ddf0 2024-04-25T09:14:00.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f7276000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f72800d0630 0x7f7280099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f727ea00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f728015ddf0 0x7f7280099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f7276000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f72800d0630 0x7f7280099f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60956/0 (socket says 172.21.15.175:60956) 2024-04-25T09:14:00.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f727f400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f72800cc3f0 0x7f72800cc8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:41052/0 (socket says 172.21.15.175:41052) 2024-04-25T09:14:00.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f7276000640 1 -- 172.21.15.175:0/404093434 learned_addr learned my addr 172.21.15.175:0/404093434 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:00.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f727e000640 1 -- 172.21.15.175:0/404093434 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957178214 0 0) 0x7f72800d0b40 con 0x7f72800cc3f0 2024-04-25T09:14:00.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f727e000640 1 -- 172.21.15.175:0/404093434 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7264003530 con 0x7f72800cc3f0 2024-04-25T09:14:00.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f727ea00640 1 -- 172.21.15.175:0/404093434 >> v2:172.21.15.175:3300/0 conn(0x7f72800d0630 msgr2=0x7f7280099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:00.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f727ea00640 1 --2- 172.21.15.175:0/404093434 >> v2:172.21.15.175:3300/0 conn(0x7f72800d0630 0x7f7280099f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f727ea00640 1 -- 172.21.15.175:0/404093434 >> v1:172.21.15.177:6789/0 conn(0x7f72800cc3f0 legacy=0x7f72800cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f727ea00640 1 -- 172.21.15.175:0/404093434 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72800d1100 con 0x7f728015ddf0 2024-04-25T09:14:00.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.528+0000 7f7276000640 1 --2- 172.21.15.175:0/404093434 >> v2:172.21.15.175:3300/0 conn(0x7f72800d0630 0x7f7280099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:00.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.532+0000 7f727ea00640 1 --2- 172.21.15.175:0/404093434 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f728015ddf0 0x7f7280099a50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f72700097c0 tx=0x7f727001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60714f6c5c66e463 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:00.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.532+0000 7f727e000640 1 -- 172.21.15.175:0/404093434 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72700b0070 con 0x7f728015ddf0 2024-04-25T09:14:00.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.532+0000 7f727e000640 1 -- 172.21.15.175:0/404093434 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72700ab600 con 0x7f728015ddf0 2024-04-25T09:14:00.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.532+0000 7f727e000640 1 -- 172.21.15.175:0/404093434 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72700ab9d0 con 0x7f728015ddf0 2024-04-25T09:14:00.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.532+0000 7f7285800640 1 -- 172.21.15.175:0/404093434 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f728015ddf0 msgr2=0x7f7280099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.532+0000 7f7285800640 1 --2- 172.21.15.175:0/404093434 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f728015ddf0 0x7f7280099a50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f72700097c0 tx=0x7f727001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.532+0000 7f7285800640 1 -- 172.21.15.175:0/404093434 shutdown_connections 2024-04-25T09:14:00.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.532+0000 7f7285800640 1 --2- 172.21.15.175:0/404093434 >> v2:172.21.15.175:3300/0 conn(0x7f72800d0630 0x7f7280099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.532+0000 7f7285800640 1 --2- 172.21.15.175:0/404093434 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f728015ddf0 0x7f7280099a50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.532+0000 7f7285800640 1 -- 172.21.15.175:0/404093434 >> 172.21.15.175:0/404093434 conn(0x7f72800b3400 msgr2=0x7f72800b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:00.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.532+0000 7f7285800640 1 -- 172.21.15.175:0/404093434 shutdown_connections 2024-04-25T09:14:00.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.532+0000 7f7285800640 1 -- 172.21.15.175:0/404093434 wait complete. 2024-04-25T09:14:00.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7285800640 1 Processor -- start 2024-04-25T09:14:00.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7285800640 1 -- start start 2024-04-25T09:14:00.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7285800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72800cc3f0 0x7f7280158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7285800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72800d0630 0x7f728013fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7285800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f728015ddf0 0x7f728015a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7285800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728016abf0 con 0x7f72800d0630 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7285800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728016aa70 con 0x7f72800cc3f0 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7285800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728016ad70 con 0x7f728015ddf0 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7276000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72800d0630 0x7f728013fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7276000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72800d0630 0x7f728013fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60960/0 (socket says 172.21.15.175:60960) 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7276000640 1 -- 172.21.15.175:0/1227497806 learned_addr learned my addr 172.21.15.175:0/1227497806 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f727ea00640 1 --2- 172.21.15.175:0/1227497806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72800cc3f0 0x7f7280158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f727f400640 1 --2- 172.21.15.175:0/1227497806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f728015ddf0 0x7f728015a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7276000640 1 -- 172.21.15.175:0/1227497806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f728015ddf0 msgr2=0x7f728015a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7276000640 1 --2- 172.21.15.175:0/1227497806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f728015ddf0 0x7f728015a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7276000640 1 -- 172.21.15.175:0/1227497806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72800cc3f0 msgr2=0x7f7280158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7276000640 1 --2- 172.21.15.175:0/1227497806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72800cc3f0 0x7f7280158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7276000640 1 -- 172.21.15.175:0/1227497806 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72800c91f0 con 0x7f72800d0630 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f727f400640 1 --2- 172.21.15.175:0/1227497806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f728015ddf0 0x7f728015a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:00.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7276000640 1 --2- 172.21.15.175:0/1227497806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72800d0630 0x7f728013fa80 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f726800e9a0 tx=0x7f726800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:00.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7277400640 1 -- 172.21.15.175:0/1227497806 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7268017070 con 0x7f72800d0630 2024-04-25T09:14:00.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7277400640 1 -- 172.21.15.175:0/1227497806 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726800ca00 con 0x7f72800d0630 2024-04-25T09:14:00.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7277400640 1 -- 172.21.15.175:0/1227497806 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726800cdb0 con 0x7f72800d0630 2024-04-25T09:14:00.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7285800640 1 -- 172.21.15.175:0/1227497806 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72800ca650 con 0x7f72800d0630 2024-04-25T09:14:00.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.536+0000 7f7285800640 1 -- 172.21.15.175:0/1227497806 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72800c8f10 con 0x7f72800d0630 2024-04-25T09:14:00.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.540+0000 7f7285800640 1 -- 172.21.15.175:0/1227497806 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7280071360 con 0x7f72800d0630 2024-04-25T09:14:00.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.540+0000 7f7277400640 1 -- 172.21.15.175:0/1227497806 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f726801a070 con 0x7f72800d0630 2024-04-25T09:14:00.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.540+0000 7f7277400640 1 --2- 172.21.15.175:0/1227497806 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f725c066f60 0x7f725c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.540+0000 7f7277400640 1 -- 172.21.15.175:0/1227497806 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7268084c50 con 0x7f72800d0630 2024-04-25T09:14:00.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.540+0000 7f727ea00640 1 --2- 172.21.15.175:0/1227497806 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f725c066f60 0x7f725c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.540+0000 7f727ea00640 1 --2- 172.21.15.175:0/1227497806 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f725c066f60 0x7f725c069420 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f72700ad000 tx=0x7f72700a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:00.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.544+0000 7f7277400640 1 -- 172.21.15.175:0/1227497806 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f72800c91f0 con 0x7f72800d0630 2024-04-25T09:14:00.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.700+0000 7f7285800640 1 -- 172.21.15.175:0/1227497806 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f728015b1a0 con 0x7f72800d0630 2024-04-25T09:14:00.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.700+0000 7f7277400640 1 -- 172.21.15.175:0/1227497806 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7268055830 con 0x7f72800d0630 2024-04-25T09:14:00.687 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:14:00.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.700+0000 7f7285800640 1 -- 172.21.15.175:0/1227497806 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f725c066f60 msgr2=0x7f725c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.700+0000 7f7285800640 1 --2- 172.21.15.175:0/1227497806 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f725c066f60 0x7f725c069420 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f72700ad000 tx=0x7f72700a6000 comp rx=0 tx=0).stop 2024-04-25T09:14:00.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.700+0000 7f7285800640 1 -- 172.21.15.175:0/1227497806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72800d0630 msgr2=0x7f728013fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.700+0000 7f7285800640 1 --2- 172.21.15.175:0/1227497806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72800d0630 0x7f728013fa80 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f726800e9a0 tx=0x7f726800ee60 comp rx=0 tx=0).stop 2024-04-25T09:14:00.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.700+0000 7f7285800640 1 -- 172.21.15.175:0/1227497806 shutdown_connections 2024-04-25T09:14:00.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.700+0000 7f7285800640 1 --2- 172.21.15.175:0/1227497806 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f725c066f60 0x7f725c069420 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.700+0000 7f7285800640 1 --2- 172.21.15.175:0/1227497806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f728015ddf0 0x7f728015a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.700+0000 7f7285800640 1 --2- 172.21.15.175:0/1227497806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72800d0630 0x7f728013fa80 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.700+0000 7f7285800640 1 --2- 172.21.15.175:0/1227497806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72800cc3f0 0x7f7280158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.700+0000 7f7285800640 1 -- 172.21.15.175:0/1227497806 >> 172.21.15.175:0/1227497806 conn(0x7f72800b3400 msgr2=0x7f72800b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:00.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.700+0000 7f7285800640 1 -- 172.21.15.175:0/1227497806 shutdown_connections 2024-04-25T09:14:00.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.700+0000 7f7285800640 1 -- 172.21.15.175:0/1227497806 wait complete. 2024-04-25T09:14:00.708 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:14:00.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.860+0000 7f0959000640 1 Processor -- start 2024-04-25T09:14:00.846 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.860+0000 7f0959000640 1 -- start start 2024-04-25T09:14:00.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.860+0000 7f0959000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09540d0d30 0x7f09540d1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.860+0000 7f0959000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f09540ccd60 0x7f09540cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.860+0000 7f0959000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09540ce290 con 0x7f095415a790 2024-04-25T09:14:00.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.860+0000 7f0959000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09540cdbc0 con 0x7f09540ccd60 2024-04-25T09:14:00.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.860+0000 7f0959000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09540cd6f0 con 0x7f09540d0d30 2024-04-25T09:14:00.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.860+0000 7f0953e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f09540ccd60 0x7f09540cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.860+0000 7f0953e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f09540ccd60 0x7f09540cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60966/0 (socket says 172.21.15.175:60966) 2024-04-25T09:14:00.847 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.860+0000 7f0953e00640 1 -- 172.21.15.175:0/368370966 learned_addr learned my addr 172.21.15.175:0/368370966 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:00.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.860+0000 7f0953e00640 1 -- 172.21.15.175:0/368370966 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09540d0d30 msgr2=0x7f09540d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:00.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.860+0000 7f0953e00640 1 --2- 172.21.15.175:0/368370966 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09540d0d30 0x7f09540d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.860+0000 7f0953e00640 1 -- 172.21.15.175:0/368370966 >> v1:172.21.15.177:6789/0 conn(0x7f095415a790 legacy=0x7f09540aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:00.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.860+0000 7f0953e00640 1 -- 172.21.15.175:0/368370966 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09540cbe90 con 0x7f09540ccd60 2024-04-25T09:14:00.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.864+0000 7f0953e00640 1 --2- 172.21.15.175:0/368370966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09540ccd60 0x7f09540cd1b0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f094c009e50 tx=0x7f094c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57aa97a9a326a6f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:00.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.864+0000 7f0952000640 1 -- 172.21.15.175:0/368370966 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c0a5760 con 0x7f09540ccd60 2024-04-25T09:14:00.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.864+0000 7f0952000640 1 -- 172.21.15.175:0/368370966 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c0a5900 con 0x7f09540ccd60 2024-04-25T09:14:00.850 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.864+0000 7f0952000640 1 -- 172.21.15.175:0/368370966 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c0a5cd0 con 0x7f09540ccd60 2024-04-25T09:14:00.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.864+0000 7f0959000640 1 -- 172.21.15.175:0/368370966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09540ccd60 msgr2=0x7f09540cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.864+0000 7f0959000640 1 --2- 172.21.15.175:0/368370966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09540ccd60 0x7f09540cd1b0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f094c009e50 tx=0x7f094c01c9f0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.864+0000 7f0959000640 1 -- 172.21.15.175:0/368370966 shutdown_connections 2024-04-25T09:14:00.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.864+0000 7f0959000640 1 --2- 172.21.15.175:0/368370966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f09540ccd60 0x7f09540cd1b0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.864+0000 7f0959000640 1 --2- 172.21.15.175:0/368370966 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09540d0d30 0x7f09540d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.864+0000 7f0959000640 1 -- 172.21.15.175:0/368370966 >> 172.21.15.175:0/368370966 conn(0x7f0954099a50 msgr2=0x7f09540d0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:00.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.864+0000 7f0959000640 1 -- 172.21.15.175:0/368370966 shutdown_connections 2024-04-25T09:14:00.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.864+0000 7f0959000640 1 -- 172.21.15.175:0/368370966 wait complete. 2024-04-25T09:14:00.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.864+0000 7f0959000640 1 Processor -- start 2024-04-25T09:14:00.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.864+0000 7f0959000640 1 -- start start 2024-04-25T09:14:00.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0959000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09540ccd60 0x7f0954153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0959000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09540d0d30 0x7f095415ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0959000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f095415a790 0x7f0954159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0959000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095415acf0 con 0x7f095415a790 2024-04-25T09:14:00.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0959000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095415ab70 con 0x7f09540ccd60 2024-04-25T09:14:00.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0959000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09540cf230 con 0x7f09540d0d30 2024-04-25T09:14:00.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0953e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f095415a790 0x7f0954159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0953400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09540ccd60 0x7f0954153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0952a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09540d0d30 0x7f095415ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0953e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f095415a790 0x7f0954159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60978/0 (socket says 172.21.15.175:60978) 2024-04-25T09:14:00.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0953e00640 1 -- 172.21.15.175:0/1923441861 learned_addr learned my addr 172.21.15.175:0/1923441861 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:00.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0953e00640 1 -- 172.21.15.175:0/1923441861 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09540d0d30 msgr2=0x7f095415ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0953e00640 1 --2- 172.21.15.175:0/1923441861 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09540d0d30 0x7f095415ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.856 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0953e00640 1 -- 172.21.15.175:0/1923441861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09540ccd60 msgr2=0x7f0954153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:00.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0953e00640 1 --2- 172.21.15.175:0/1923441861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09540ccd60 0x7f0954153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:00.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0953e00640 1 -- 172.21.15.175:0/1923441861 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09540b6370 con 0x7f095415a790 2024-04-25T09:14:00.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0953e00640 1 --2- 172.21.15.175:0/1923441861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f095415a790 0x7f0954159280 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f094c0af040 tx=0x7f094c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:00.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f094b400640 1 -- 172.21.15.175:0/1923441861 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c0b8670 con 0x7f095415a790 2024-04-25T09:14:00.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f094b400640 1 -- 172.21.15.175:0/1923441861 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c0be070 con 0x7f095415a790 2024-04-25T09:14:00.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f094b400640 1 -- 172.21.15.175:0/1923441861 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c0b8a70 con 0x7f095415a790 2024-04-25T09:14:00.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0959000640 1 -- 172.21.15.175:0/1923441861 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0954153c70 con 0x7f095415a790 2024-04-25T09:14:00.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0959000640 1 -- 172.21.15.175:0/1923441861 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0954162ab0 con 0x7f095415a790 2024-04-25T09:14:00.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.868+0000 7f0959000640 1 -- 172.21.15.175:0/1923441861 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0954074a60 con 0x7f095415a790 2024-04-25T09:14:00.857 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.872+0000 7f094b400640 1 -- 172.21.15.175:0/1923441861 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f094c0b8c10 con 0x7f095415a790 2024-04-25T09:14:00.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.872+0000 7f094b400640 1 --2- 172.21.15.175:0/1923441861 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0934066f60 0x7f0934069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:00.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.872+0000 7f094b400640 1 -- 172.21.15.175:0/1923441861 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f094c11fff0 con 0x7f095415a790 2024-04-25T09:14:00.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.872+0000 7f0953400640 1 --2- 172.21.15.175:0/1923441861 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0934066f60 0x7f0934069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:00.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.872+0000 7f0953400640 1 --2- 172.21.15.175:0/1923441861 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0934066f60 0x7f0934069420 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f09440098e0 tx=0x7f0944009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:00.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:00.876+0000 7f094b400640 1 -- 172.21.15.175:0/1923441861 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f094c0165e0 con 0x7f095415a790 2024-04-25T09:14:01.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.032+0000 7f0959000640 1 -- 172.21.15.175:0/1923441861 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f09540b65a0 con 0x7f095415a790 2024-04-25T09:14:01.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.032+0000 7f094b400640 1 -- 172.21.15.175:0/1923441861 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v109) v1 ==== 84+0+65 (secure 0 0 0) 0x7f094c0f0da0 con 0x7f095415a790 2024-04-25T09:14:01.020 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:01.020 INFO:teuthology.orchestra.run.smithi175.stdout:[ 2024-04-25T09:14:01.020 INFO:teuthology.orchestra.run.smithi175.stdout: { 2024-04-25T09:14:01.020 INFO:teuthology.orchestra.run.smithi175.stdout: "poolnum": 1, 2024-04-25T09:14:01.021 INFO:teuthology.orchestra.run.smithi175.stdout: "poolname": ".mgr" 2024-04-25T09:14:01.021 INFO:teuthology.orchestra.run.smithi175.stdout: } 2024-04-25T09:14:01.021 INFO:teuthology.orchestra.run.smithi175.stdout:] 2024-04-25T09:14:01.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.036+0000 7f0959000640 1 -- 172.21.15.175:0/1923441861 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0934066f60 msgr2=0x7f0934069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:01.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.036+0000 7f0959000640 1 --2- 172.21.15.175:0/1923441861 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0934066f60 0x7f0934069420 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f09440098e0 tx=0x7f0944009060 comp rx=0 tx=0).stop 2024-04-25T09:14:01.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.036+0000 7f0959000640 1 -- 172.21.15.175:0/1923441861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f095415a790 msgr2=0x7f0954159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:01.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.036+0000 7f0959000640 1 --2- 172.21.15.175:0/1923441861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f095415a790 0x7f0954159280 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f094c0af040 tx=0x7f094c019790 comp rx=0 tx=0).stop 2024-04-25T09:14:01.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.036+0000 7f0959000640 1 -- 172.21.15.175:0/1923441861 shutdown_connections 2024-04-25T09:14:01.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.036+0000 7f0959000640 1 --2- 172.21.15.175:0/1923441861 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0934066f60 0x7f0934069420 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.036+0000 7f0959000640 1 --2- 172.21.15.175:0/1923441861 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f095415a790 0x7f0954159280 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.036+0000 7f0959000640 1 --2- 172.21.15.175:0/1923441861 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09540d0d30 0x7f095415ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.036+0000 7f0959000640 1 --2- 172.21.15.175:0/1923441861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f09540ccd60 0x7f0954153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.036+0000 7f0959000640 1 -- 172.21.15.175:0/1923441861 >> 172.21.15.175:0/1923441861 conn(0x7f0954099a50 msgr2=0x7f09540ad400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:01.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.036+0000 7f0959000640 1 -- 172.21.15.175:0/1923441861 shutdown_connections 2024-04-25T09:14:01.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.036+0000 7f0959000640 1 -- 172.21.15.175:0/1923441861 wait complete. 2024-04-25T09:14:01.041 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:14:01.041 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:14:01.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.192+0000 7f2acf400640 1 Processor -- start 2024-04-25T09:14:01.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.192+0000 7f2acf400640 1 -- start start 2024-04-25T09:14:01.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.196+0000 7f2acf400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2ac80cfb60 0x7f2ac80ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:01.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.196+0000 7f2acf400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2ac80ced10 0x7f2ac80712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:01.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.196+0000 7f2acf400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ac80717f0 0x7f2ac806d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:01.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.196+0000 7f2acf400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac8071bf0 con 0x7f2ac80ced10 2024-04-25T09:14:01.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.196+0000 7f2acf400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac80cbed0 con 0x7f2ac80cfb60 2024-04-25T09:14:01.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.196+0000 7f2acf400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac8071e20 con 0x7f2ac80717f0 2024-04-25T09:14:01.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.196+0000 7f2abfe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2ac80ced10 0x7f2ac80712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:01.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.196+0000 7f2abfe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2ac80ced10 0x7f2ac80712b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60982/0 (socket says 172.21.15.175:60982) 2024-04-25T09:14:01.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.196+0000 7f2abfe00640 1 -- 172.21.15.175:0/2359729741 learned_addr learned my addr 172.21.15.175:0/2359729741 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:01.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.196+0000 7f2acca00640 1 --2- 172.21.15.175:0/2359729741 >> v2:172.21.15.177:3300/0 conn(0x7f2ac80cfb60 0x7f2ac80ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:01.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.196+0000 7f2acd400640 1 --2- 172.21.15.175:0/2359729741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ac80717f0 0x7f2ac806d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:01.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.196+0000 7f2abfe00640 1 -- 172.21.15.175:0/2359729741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ac80717f0 msgr2=0x7f2ac806d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:01.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.196+0000 7f2abfe00640 1 --2- 172.21.15.175:0/2359729741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ac80717f0 0x7f2ac806d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.196+0000 7f2abfe00640 1 -- 172.21.15.175:0/2359729741 >> v2:172.21.15.177:3300/0 conn(0x7f2ac80cfb60 msgr2=0x7f2ac80ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:01.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.196+0000 7f2abfe00640 1 --2- 172.21.15.175:0/2359729741 >> v2:172.21.15.177:3300/0 conn(0x7f2ac80cfb60 0x7f2ac80ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.196+0000 7f2abfe00640 1 -- 172.21.15.175:0/2359729741 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac8072100 con 0x7f2ac80ced10 2024-04-25T09:14:01.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.196+0000 7f2acca00640 1 --2- 172.21.15.175:0/2359729741 >> v2:172.21.15.177:3300/0 conn(0x7f2ac80cfb60 0x7f2ac80ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:01.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.196+0000 7f2abfe00640 1 --2- 172.21.15.175:0/2359729741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ac80ced10 0x7f2ac80712b0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f2ac806d120 tx=0x7f2ab001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0d6c93d87286e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:01.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2ac7e00640 1 -- 172.21.15.175:0/2359729741 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00b0070 con 0x7f2ac80ced10 2024-04-25T09:14:01.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2ac7e00640 1 -- 172.21.15.175:0/2359729741 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab00ab600 con 0x7f2ac80ced10 2024-04-25T09:14:01.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2ac7e00640 1 -- 172.21.15.175:0/2359729741 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00ab9d0 con 0x7f2ac80ced10 2024-04-25T09:14:01.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acf400640 1 -- 172.21.15.175:0/2359729741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ac80ced10 msgr2=0x7f2ac80712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:01.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acf400640 1 --2- 172.21.15.175:0/2359729741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ac80ced10 0x7f2ac80712b0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f2ac806d120 tx=0x7f2ab001c460 comp rx=0 tx=0).stop 2024-04-25T09:14:01.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acf400640 1 -- 172.21.15.175:0/2359729741 shutdown_connections 2024-04-25T09:14:01.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acf400640 1 --2- 172.21.15.175:0/2359729741 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ac80717f0 0x7f2ac806d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acf400640 1 --2- 172.21.15.175:0/2359729741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ac80ced10 0x7f2ac80712b0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acf400640 1 --2- 172.21.15.175:0/2359729741 >> v2:172.21.15.177:3300/0 conn(0x7f2ac80cfb60 0x7f2ac80ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acf400640 1 -- 172.21.15.175:0/2359729741 >> 172.21.15.175:0/2359729741 conn(0x7f2ac806ac50 msgr2=0x7f2ac806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:01.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acf400640 1 -- 172.21.15.175:0/2359729741 shutdown_connections 2024-04-25T09:14:01.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acf400640 1 -- 172.21.15.175:0/2359729741 wait complete. 2024-04-25T09:14:01.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acf400640 1 Processor -- start 2024-04-25T09:14:01.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acf400640 1 -- start start 2024-04-25T09:14:01.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acf400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ac80717f0 0x7f2ac8165040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:01.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acf400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ac80ced10 0x7f2ac80b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:01.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acf400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ac80cfb60 0x7f2ac8139de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:01.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acf400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac80d00c0 con 0x7f2ac80717f0 2024-04-25T09:14:01.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acf400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac80cff40 con 0x7f2ac80cfb60 2024-04-25T09:14:01.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acf400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac815f5b0 con 0x7f2ac80ced10 2024-04-25T09:14:01.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ac80717f0 0x7f2ac8165040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:01.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ac80717f0 0x7f2ac8165040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:60996/0 (socket says 172.21.15.175:60996) 2024-04-25T09:14:01.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.200+0000 7f2acca00640 1 -- 172.21.15.175:0/2093133720 learned_addr learned my addr 172.21.15.175:0/2093133720 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:01.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.204+0000 7f2abfe00640 1 --2- 172.21.15.175:0/2093133720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ac80ced10 0x7f2ac80b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:01.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.204+0000 7f2acd400640 1 --2- 172.21.15.175:0/2093133720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ac80cfb60 0x7f2ac8139de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:01.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.204+0000 7f2acca00640 1 -- 172.21.15.175:0/2093133720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ac80ced10 msgr2=0x7f2ac80b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:01.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.204+0000 7f2acca00640 1 --2- 172.21.15.175:0/2093133720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ac80ced10 0x7f2ac80b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.204+0000 7f2acca00640 1 -- 172.21.15.175:0/2093133720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ac80cfb60 msgr2=0x7f2ac8139de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:01.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.204+0000 7f2acca00640 1 --2- 172.21.15.175:0/2093133720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ac80cfb60 0x7f2ac8139de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:01.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.204+0000 7f2acca00640 1 -- 172.21.15.175:0/2093133720 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac815c580 con 0x7f2ac80717f0 2024-04-25T09:14:01.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.204+0000 7f2acd400640 1 --2- 172.21.15.175:0/2093133720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ac80cfb60 0x7f2ac8139de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:01.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.204+0000 7f2acca00640 1 --2- 172.21.15.175:0/2093133720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ac80717f0 0x7f2ac8165040 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800d800 tx=0x7f2ab800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:01.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.204+0000 7f2ac5600640 1 -- 172.21.15.175:0/2093133720 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8018020 con 0x7f2ac80717f0 2024-04-25T09:14:01.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.204+0000 7f2ac5600640 1 -- 172.21.15.175:0/2093133720 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab80096c0 con 0x7f2ac80717f0 2024-04-25T09:14:01.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.204+0000 7f2acf400640 1 -- 172.21.15.175:0/2093133720 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac815c860 con 0x7f2ac80717f0 2024-04-25T09:14:01.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.204+0000 7f2ac5600640 1 -- 172.21.15.175:0/2093133720 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8009ab0 con 0x7f2ac80717f0 2024-04-25T09:14:01.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.204+0000 7f2acf400640 1 -- 172.21.15.175:0/2093133720 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac815ce20 con 0x7f2ac80717f0 2024-04-25T09:14:01.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.204+0000 7f2acf400640 1 -- 172.21.15.175:0/2093133720 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac8075160 con 0x7f2ac80717f0 2024-04-25T09:14:01.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.204+0000 7f2ac5600640 1 -- 172.21.15.175:0/2093133720 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2ab801b020 con 0x7f2ac80717f0 2024-04-25T09:14:01.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.204+0000 7f2ac5600640 1 --2- 172.21.15.175:0/2093133720 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2aa4066f60 0x7f2aa4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:01.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.204+0000 7f2ac5600640 1 -- 172.21.15.175:0/2093133720 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2ab8085240 con 0x7f2ac80717f0 2024-04-25T09:14:01.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.208+0000 7f2abfe00640 1 --2- 172.21.15.175:0/2093133720 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2aa4066f60 0x7f2aa4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:01.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.208+0000 7f2abfe00640 1 --2- 172.21.15.175:0/2093133720 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2aa4066f60 0x7f2aa4069420 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00ad000 tx=0x7f2ab0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:01.197 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.208+0000 7f2ac5600640 1 -- 172.21.15.175:0/2093133720 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2ab8022020 con 0x7f2ac80717f0 2024-04-25T09:14:01.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:01.364+0000 7f2acf400640 1 -- 172.21.15.175:0/2093133720 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2ac815f320 con 0x7f2ac80717f0 2024-04-25T09:14:02.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.304+0000 7f2ac5600640 1 -- 172.21.15.175:0/2093133720 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v110) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2ab8056500 con 0x7f2ac80717f0 2024-04-25T09:14:02.290 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_metadata' created 2024-04-25T09:14:02.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.304+0000 7f2acf400640 1 -- 172.21.15.175:0/2093133720 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2aa4066f60 msgr2=0x7f2aa4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:02.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.304+0000 7f2acf400640 1 --2- 172.21.15.175:0/2093133720 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2aa4066f60 0x7f2aa4069420 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2ab00ad000 tx=0x7f2ab0008040 comp rx=0 tx=0).stop 2024-04-25T09:14:02.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.304+0000 7f2acf400640 1 -- 172.21.15.175:0/2093133720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ac80717f0 msgr2=0x7f2ac8165040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:02.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.304+0000 7f2acf400640 1 --2- 172.21.15.175:0/2093133720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ac80717f0 0x7f2ac8165040 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f2ab800d800 tx=0x7f2ab800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:14:02.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.304+0000 7f2acf400640 1 -- 172.21.15.175:0/2093133720 shutdown_connections 2024-04-25T09:14:02.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.304+0000 7f2acf400640 1 --2- 172.21.15.175:0/2093133720 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2aa4066f60 0x7f2aa4069420 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:02.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.304+0000 7f2acf400640 1 --2- 172.21.15.175:0/2093133720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ac80cfb60 0x7f2ac8139de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:02.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.304+0000 7f2acf400640 1 --2- 172.21.15.175:0/2093133720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ac80ced10 0x7f2ac80b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:02.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.304+0000 7f2acf400640 1 --2- 172.21.15.175:0/2093133720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ac80717f0 0x7f2ac8165040 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:02.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.304+0000 7f2acf400640 1 -- 172.21.15.175:0/2093133720 >> 172.21.15.175:0/2093133720 conn(0x7f2ac806ac50 msgr2=0x7f2ac8165f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:02.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.304+0000 7f2acf400640 1 -- 172.21.15.175:0/2093133720 shutdown_connections 2024-04-25T09:14:02.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.304+0000 7f2acf400640 1 -- 172.21.15.175:0/2093133720 wait complete. 2024-04-25T09:14:02.322 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:14:02.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.480+0000 7fd250800640 1 Processor -- start 2024-04-25T09:14:02.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.480+0000 7fd250800640 1 -- start start 2024-04-25T09:14:02.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.480+0000 7fd250800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd24815de90 0x7fd24815ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:02.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.480+0000 7fd250800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd2480b4710 0x7fd2480cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:02.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.480+0000 7fd250800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2480b3660 con 0x7fd2480ae9c0 2024-04-25T09:14:02.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.480+0000 7fd250800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2480b28a0 con 0x7fd2480b4710 2024-04-25T09:14:02.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.480+0000 7fd250800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2480b2b80 con 0x7fd24815de90 2024-04-25T09:14:02.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.484+0000 7fd24e800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd2480b4710 0x7fd2480cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:02.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.484+0000 7fd24de00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd24815de90 0x7fd24815ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:02.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.484+0000 7fd24d400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fd2480ae9c0 0x7fd2480b4000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:41076/0 (socket says 172.21.15.175:41076) 2024-04-25T09:14:02.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.484+0000 7fd24d400640 1 -- 172.21.15.175:0/776277310 learned_addr learned my addr 172.21.15.175:0/776277310 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:02.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.484+0000 7fd24e800640 1 -- 172.21.15.175:0/776277310 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd24815de90 msgr2=0x7fd24815ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:02.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.484+0000 7fd24e800640 1 --2- 172.21.15.175:0/776277310 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd24815de90 0x7fd24815ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:02.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.484+0000 7fd24e800640 1 -- 172.21.15.175:0/776277310 >> v1:172.21.15.177:6789/0 conn(0x7fd2480ae9c0 legacy=0x7fd2480b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:02.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.484+0000 7fd24e800640 1 -- 172.21.15.175:0/776277310 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2480b2e60 con 0x7fd2480b4710 2024-04-25T09:14:02.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.484+0000 7fd24ca00640 1 -- 172.21.15.175:0/776277310 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 311104847 0 0) 0x7fd2480b3660 con 0x7fd2480ae9c0 2024-04-25T09:14:02.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.484+0000 7fd24de00640 1 --2- 172.21.15.175:0/776277310 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd24815de90 0x7fd24815ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:02.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.488+0000 7fd24e800640 1 --2- 172.21.15.175:0/776277310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2480b4710 0x7fd2480cd730 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd244009dc0 tx=0x7fd24401c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4518392b5e42d4e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:02.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.488+0000 7fd24ca00640 1 -- 172.21.15.175:0/776277310 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2440b2070 con 0x7fd2480b4710 2024-04-25T09:14:02.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.488+0000 7fd24ca00640 1 -- 172.21.15.175:0/776277310 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2440a5780 con 0x7fd2480b4710 2024-04-25T09:14:02.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.488+0000 7fd24ca00640 1 -- 172.21.15.175:0/776277310 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2440a5b50 con 0x7fd2480b4710 2024-04-25T09:14:02.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.488+0000 7fd250800640 1 -- 172.21.15.175:0/776277310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2480b4710 msgr2=0x7fd2480cd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:02.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.488+0000 7fd250800640 1 --2- 172.21.15.175:0/776277310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2480b4710 0x7fd2480cd730 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd244009dc0 tx=0x7fd24401c8c0 comp rx=0 tx=0).stop 2024-04-25T09:14:02.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.488+0000 7fd250800640 1 -- 172.21.15.175:0/776277310 shutdown_connections 2024-04-25T09:14:02.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.488+0000 7fd250800640 1 --2- 172.21.15.175:0/776277310 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2480b4710 0x7fd2480cd730 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:02.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.488+0000 7fd250800640 1 --2- 172.21.15.175:0/776277310 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd24815de90 0x7fd24815ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:02.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.488+0000 7fd250800640 1 -- 172.21.15.175:0/776277310 >> 172.21.15.175:0/776277310 conn(0x7fd24806ac50 msgr2=0x7fd24806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:02.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.488+0000 7fd250800640 1 -- 172.21.15.175:0/776277310 shutdown_connections 2024-04-25T09:14:02.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.488+0000 7fd250800640 1 -- 172.21.15.175:0/776277310 wait complete. 2024-04-25T09:14:02.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.488+0000 7fd250800640 1 Processor -- start 2024-04-25T09:14:02.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.488+0000 7fd250800640 1 -- start start 2024-04-25T09:14:02.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.488+0000 7fd250800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2480ae9c0 0x7fd2480af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:02.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.488+0000 7fd250800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2480b4710 0x7fd2480b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:02.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd250800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd24815de90 0x7fd248147070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:02.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd250800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2480ce810 con 0x7fd2480b4710 2024-04-25T09:14:02.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd250800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2480ce690 con 0x7fd24815de90 2024-04-25T09:14:02.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd250800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2481677b0 con 0x7fd2480ae9c0 2024-04-25T09:14:02.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd24d400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2480b4710 0x7fd2480b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:02.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd24d400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2480b4710 0x7fd2480b0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32768/0 (socket says 172.21.15.175:32768) 2024-04-25T09:14:02.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd24d400640 1 -- 172.21.15.175:0/814305341 learned_addr learned my addr 172.21.15.175:0/814305341 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:02.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd24e800640 1 --2- 172.21.15.175:0/814305341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd24815de90 0x7fd248147070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:02.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd24de00640 1 --2- 172.21.15.175:0/814305341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2480ae9c0 0x7fd2480af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:02.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd24d400640 1 -- 172.21.15.175:0/814305341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2480ae9c0 msgr2=0x7fd2480af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:02.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd24d400640 1 --2- 172.21.15.175:0/814305341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2480ae9c0 0x7fd2480af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:02.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd24d400640 1 -- 172.21.15.175:0/814305341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd24815de90 msgr2=0x7fd248147070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:02.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd24d400640 1 --2- 172.21.15.175:0/814305341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd24815de90 0x7fd248147070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:02.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd24d400640 1 -- 172.21.15.175:0/814305341 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2480af970 con 0x7fd2480b4710 2024-04-25T09:14:02.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd24de00640 1 --2- 172.21.15.175:0/814305341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2480ae9c0 0x7fd2480af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:02.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd24d400640 1 --2- 172.21.15.175:0/814305341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2480b4710 0x7fd2480b0ce0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fd2380011f0 tx=0x7fd23800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:02.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd242000640 1 -- 172.21.15.175:0/814305341 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238018070 con 0x7fd2480b4710 2024-04-25T09:14:02.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd242000640 1 -- 172.21.15.175:0/814305341 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2380074e0 con 0x7fd2480b4710 2024-04-25T09:14:02.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd242000640 1 -- 172.21.15.175:0/814305341 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238004a10 con 0x7fd2480b4710 2024-04-25T09:14:02.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd250800640 1 -- 172.21.15.175:0/814305341 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2480afc50 con 0x7fd2480b4710 2024-04-25T09:14:02.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd250800640 1 -- 172.21.15.175:0/814305341 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2480b0210 con 0x7fd2480b4710 2024-04-25T09:14:02.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd250800640 1 -- 172.21.15.175:0/814305341 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd248074a60 con 0x7fd2480b4710 2024-04-25T09:14:02.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.492+0000 7fd242000640 1 -- 172.21.15.175:0/814305341 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd238004bb0 con 0x7fd2480b4710 2024-04-25T09:14:02.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.496+0000 7fd242000640 1 --2- 172.21.15.175:0/814305341 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd22c066f60 0x7fd22c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:02.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.496+0000 7fd242000640 1 -- 172.21.15.175:0/814305341 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd238084200 con 0x7fd2480b4710 2024-04-25T09:14:02.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.496+0000 7fd24de00640 1 --2- 172.21.15.175:0/814305341 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd22c066f60 0x7fd22c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:02.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.496+0000 7fd24de00640 1 --2- 172.21.15.175:0/814305341 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd22c066f60 0x7fd22c069420 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009b10 tx=0x7fd23c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:02.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.500+0000 7fd242000640 1 -- 172.21.15.175:0/814305341 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd238054d10 con 0x7fd2480b4710 2024-04-25T09:14:02.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:02.652+0000 7fd250800640 1 -- 172.21.15.175:0/814305341 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd24806e6a0 con 0x7fd2480b4710 2024-04-25T09:14:03.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.304+0000 7fd242000640 1 -- 172.21.15.175:0/814305341 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v111) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd238058db0 con 0x7fd2480b4710 2024-04-25T09:14:03.293 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_data' created 2024-04-25T09:14:03.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.308+0000 7fd250800640 1 -- 172.21.15.175:0/814305341 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd22c066f60 msgr2=0x7fd22c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:03.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.308+0000 7fd250800640 1 --2- 172.21.15.175:0/814305341 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd22c066f60 0x7fd22c069420 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009b10 tx=0x7fd23c008040 comp rx=0 tx=0).stop 2024-04-25T09:14:03.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.308+0000 7fd250800640 1 -- 172.21.15.175:0/814305341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2480b4710 msgr2=0x7fd2480b0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:03.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.308+0000 7fd250800640 1 --2- 172.21.15.175:0/814305341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2480b4710 0x7fd2480b0ce0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fd2380011f0 tx=0x7fd23800c9b0 comp rx=0 tx=0).stop 2024-04-25T09:14:03.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.308+0000 7fd250800640 1 -- 172.21.15.175:0/814305341 shutdown_connections 2024-04-25T09:14:03.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.308+0000 7fd250800640 1 --2- 172.21.15.175:0/814305341 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd22c066f60 0x7fd22c069420 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:03.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.308+0000 7fd250800640 1 --2- 172.21.15.175:0/814305341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd24815de90 0x7fd248147070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:03.297 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.308+0000 7fd250800640 1 --2- 172.21.15.175:0/814305341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2480b4710 0x7fd2480b0ce0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:03.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.308+0000 7fd250800640 1 --2- 172.21.15.175:0/814305341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2480ae9c0 0x7fd2480af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:03.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.308+0000 7fd250800640 1 -- 172.21.15.175:0/814305341 >> 172.21.15.175:0/814305341 conn(0x7fd24806ac50 msgr2=0x7fd248153fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:03.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.308+0000 7fd250800640 1 -- 172.21.15.175:0/814305341 shutdown_connections 2024-04-25T09:14:03.298 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.308+0000 7fd250800640 1 -- 172.21.15.175:0/814305341 wait complete. 2024-04-25T09:14:03.333 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:14:03.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.484+0000 7f3c51400640 1 Processor -- start 2024-04-25T09:14:03.473 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.484+0000 7f3c51400640 1 -- start start 2024-04-25T09:14:03.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.488+0000 7f3c51400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3c4c0cf080 0x7f3c4c1600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:03.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.488+0000 7f3c51400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4c0cfd10 con 0x7f3c4c145250 2024-04-25T09:14:03.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.488+0000 7f3c51400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4c0cfff0 con 0x7f3c4c0cf6b0 2024-04-25T09:14:03.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.488+0000 7f3c51400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c4c1605e0 con 0x7f3c4c0cf080 2024-04-25T09:14:03.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.488+0000 7f3c4b200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3c4c0cf080 0x7f3c4c1600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:03.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.488+0000 7f3c4b200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3c4c0cf080 0x7f3c4c1600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32774/0 (socket says 172.21.15.175:32774) 2024-04-25T09:14:03.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.488+0000 7f3c4b200640 1 -- 172.21.15.175:0/3776742651 learned_addr learned my addr 172.21.15.175:0/3776742651 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:03.475 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.488+0000 7f3c4a800640 1 --1- 172.21.15.175:0/3776742651 >> v1:172.21.15.175:6789/0 conn(0x7f3c4c145250 0x7f3c4c0cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:47674/0 (socket says 172.21.15.175:47674) 2024-04-25T09:14:03.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.488+0000 7f3c4b200640 1 -- 172.21.15.175:0/3776742651 >> v1:172.21.15.177:6789/0 conn(0x7f3c4c0cf6b0 legacy=0x7f3c4c0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:03.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.488+0000 7f3c4b200640 1 -- 172.21.15.175:0/3776742651 >> v1:172.21.15.175:6789/0 conn(0x7f3c4c145250 legacy=0x7f3c4c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:03.476 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.488+0000 7f3c4b200640 1 -- 172.21.15.175:0/3776742651 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c15f8a0 con 0x7f3c4c0cf080 2024-04-25T09:14:03.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.492+0000 7f3c4b200640 1 --2- 172.21.15.175:0/3776742651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c4c0cf080 0x7f3c4c1600a0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f3c440098a0 tx=0x7f3c4401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12a2110451cc9c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:03.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.492+0000 7f3c49400640 1 -- 172.21.15.175:0/3776742651 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c440b0070 con 0x7f3c4c0cf080 2024-04-25T09:14:03.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.492+0000 7f3c49400640 1 -- 172.21.15.175:0/3776742651 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c440ab600 con 0x7f3c4c0cf080 2024-04-25T09:14:03.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.492+0000 7f3c49400640 1 -- 172.21.15.175:0/3776742651 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c440ab9d0 con 0x7f3c4c0cf080 2024-04-25T09:14:03.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.492+0000 7f3c51400640 1 -- 172.21.15.175:0/3776742651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c4c0cf080 msgr2=0x7f3c4c1600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:03.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.492+0000 7f3c51400640 1 --2- 172.21.15.175:0/3776742651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c4c0cf080 0x7f3c4c1600a0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f3c440098a0 tx=0x7f3c4401c4b0 comp rx=0 tx=0).stop 2024-04-25T09:14:03.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.492+0000 7f3c51400640 1 -- 172.21.15.175:0/3776742651 shutdown_connections 2024-04-25T09:14:03.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.492+0000 7f3c51400640 1 --2- 172.21.15.175:0/3776742651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c4c0cf080 0x7f3c4c1600a0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:03.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.492+0000 7f3c51400640 1 -- 172.21.15.175:0/3776742651 >> 172.21.15.175:0/3776742651 conn(0x7f3c4c06ac50 msgr2=0x7f3c4c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:03.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.492+0000 7f3c51400640 1 -- 172.21.15.175:0/3776742651 shutdown_connections 2024-04-25T09:14:03.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.492+0000 7f3c51400640 1 -- 172.21.15.175:0/3776742651 wait complete. 2024-04-25T09:14:03.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.492+0000 7f3c51400640 1 Processor -- start 2024-04-25T09:14:03.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.492+0000 7f3c51400640 1 -- start start 2024-04-25T09:14:03.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c51400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c4c0cf080 0x7f3c4c0a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:03.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c51400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c4c0cf6b0 0x7f3c4c13c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:03.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c51400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c4c145250 0x7f3c4c0a9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:03.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c51400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c15cc80 con 0x7f3c4c0cf6b0 2024-04-25T09:14:03.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c51400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c15cb00 con 0x7f3c4c145250 2024-04-25T09:14:03.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c51400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c1697f0 con 0x7f3c4c0cf080 2024-04-25T09:14:03.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c49e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c4c0cf6b0 0x7f3c4c13c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:03.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c49e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c4c0cf6b0 0x7f3c4c13c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32790/0 (socket says 172.21.15.175:32790) 2024-04-25T09:14:03.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c49e00640 1 -- 172.21.15.175:0/3432696362 learned_addr learned my addr 172.21.15.175:0/3432696362 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:03.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c4a800640 1 --2- 172.21.15.175:0/3432696362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c4c0cf080 0x7f3c4c0a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:03.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c4b200640 1 --2- 172.21.15.175:0/3432696362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c4c145250 0x7f3c4c0a9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:03.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c49e00640 1 -- 172.21.15.175:0/3432696362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c4c0cf080 msgr2=0x7f3c4c0a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:03.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c49e00640 1 --2- 172.21.15.175:0/3432696362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c4c0cf080 0x7f3c4c0a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:03.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c49e00640 1 -- 172.21.15.175:0/3432696362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c4c145250 msgr2=0x7f3c4c0a9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:03.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c49e00640 1 --2- 172.21.15.175:0/3432696362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c4c145250 0x7f3c4c0a9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:03.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c49e00640 1 -- 172.21.15.175:0/3432696362 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c13c700 con 0x7f3c4c0cf6b0 2024-04-25T09:14:03.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c4a800640 1 --2- 172.21.15.175:0/3432696362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c4c0cf080 0x7f3c4c0a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:03.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c4b200640 1 --2- 172.21.15.175:0/3432696362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c4c145250 0x7f3c4c0a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:03.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c49e00640 1 --2- 172.21.15.175:0/3432696362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c4c0cf6b0 0x7f3c4c13c1c0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800c420 tx=0x7f3c3800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:03.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c42a00640 1 -- 172.21.15.175:0/3432696362 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c380052d0 con 0x7f3c4c0cf6b0 2024-04-25T09:14:03.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c42a00640 1 -- 172.21.15.175:0/3432696362 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c38005470 con 0x7f3c4c0cf6b0 2024-04-25T09:14:03.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c42a00640 1 -- 172.21.15.175:0/3432696362 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38007260 con 0x7f3c4c0cf6b0 2024-04-25T09:14:03.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c51400640 1 -- 172.21.15.175:0/3432696362 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4c15ed30 con 0x7f3c4c0cf6b0 2024-04-25T09:14:03.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c51400640 1 -- 172.21.15.175:0/3432696362 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4c0a8e20 con 0x7f3c4c0cf6b0 2024-04-25T09:14:03.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c51400640 1 -- 172.21.15.175:0/3432696362 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4c075160 con 0x7f3c4c0cf6b0 2024-04-25T09:14:03.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.496+0000 7f3c42a00640 1 -- 172.21.15.175:0/3432696362 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3c38007400 con 0x7f3c4c0cf6b0 2024-04-25T09:14:03.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.500+0000 7f3c42a00640 1 --2- 172.21.15.175:0/3432696362 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c2c066f60 0x7f3c2c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:03.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.500+0000 7f3c42a00640 1 -- 172.21.15.175:0/3432696362 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3c38084600 con 0x7f3c4c0cf6b0 2024-04-25T09:14:03.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.500+0000 7f3c4a800640 1 --2- 172.21.15.175:0/3432696362 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c2c066f60 0x7f3c2c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:03.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.500+0000 7f3c4a800640 1 --2- 172.21.15.175:0/3432696362 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c2c066f60 0x7f3c2c069420 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0012f0 tx=0x7f3c3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:03.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.504+0000 7f3c42a00640 1 -- 172.21.15.175:0/3432696362 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3c38055540 con 0x7f3c4c0cf6b0 2024-04-25T09:14:03.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:03.692+0000 7f3c51400640 1 -- 172.21.15.175:0/3432696362 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3c4c06b280 con 0x7f3c4c0cf6b0 2024-04-25T09:14:04.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.332+0000 7f3c42a00640 1 -- 172.21.15.175:0/3432696362 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v90) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3c38054e40 con 0x7f3c4c0cf6b0 2024-04-25T09:14:04.324 INFO:teuthology.orchestra.run.smithi175.stderr:new fs with metadata pool 16 and data pool 17 2024-04-25T09:14:04.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.340+0000 7f3c51400640 1 -- 172.21.15.175:0/3432696362 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c2c066f60 msgr2=0x7f3c2c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.340+0000 7f3c51400640 1 --2- 172.21.15.175:0/3432696362 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c2c066f60 0x7f3c2c069420 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0012f0 tx=0x7f3c3c009040 comp rx=0 tx=0).stop 2024-04-25T09:14:04.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.340+0000 7f3c51400640 1 -- 172.21.15.175:0/3432696362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c4c0cf6b0 msgr2=0x7f3c4c13c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.340+0000 7f3c51400640 1 --2- 172.21.15.175:0/3432696362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c4c0cf6b0 0x7f3c4c13c1c0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800c420 tx=0x7f3c3800c8e0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.340+0000 7f3c51400640 1 -- 172.21.15.175:0/3432696362 shutdown_connections 2024-04-25T09:14:04.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.340+0000 7f3c51400640 1 --2- 172.21.15.175:0/3432696362 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c2c066f60 0x7f3c2c069420 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.340+0000 7f3c51400640 1 --2- 172.21.15.175:0/3432696362 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c4c145250 0x7f3c4c0a9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.340+0000 7f3c51400640 1 --2- 172.21.15.175:0/3432696362 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c4c0cf6b0 0x7f3c4c13c1c0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.340+0000 7f3c51400640 1 --2- 172.21.15.175:0/3432696362 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c4c0cf080 0x7f3c4c0a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.340+0000 7f3c51400640 1 -- 172.21.15.175:0/3432696362 >> 172.21.15.175:0/3432696362 conn(0x7f3c4c06ac50 msgr2=0x7f3c4c06e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:04.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.340+0000 7f3c51400640 1 -- 172.21.15.175:0/3432696362 shutdown_connections 2024-04-25T09:14:04.331 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.340+0000 7f3c51400640 1 -- 172.21.15.175:0/3432696362 wait complete. 2024-04-25T09:14:04.365 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:14:04.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.512+0000 7f73b7200640 1 Processor -- start 2024-04-25T09:14:04.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.512+0000 7f73b7200640 1 -- start start 2024-04-25T09:14:04.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.516+0000 7f73b7200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f73b80cd4c0 0x7f73b81686e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.516+0000 7f73b7200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b809b030 con 0x7f73b80d0480 2024-04-25T09:14:04.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.516+0000 7f73b7200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b809a870 con 0x7f73b815dcf0 2024-04-25T09:14:04.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.516+0000 7f73b7200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b80d0930 con 0x7f73b80cd4c0 2024-04-25T09:14:04.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.516+0000 7f73b6800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f73b80cd4c0 0x7f73b81686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.516+0000 7f73b5400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f73b80d0480 0x7f73b809a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:47688/0 (socket says 172.21.15.175:47688) 2024-04-25T09:14:04.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.516+0000 7f73b5400640 1 -- 172.21.15.175:0/3940664328 learned_addr learned my addr 172.21.15.175:0/3940664328 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:04.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.516+0000 7f73b6800640 1 -- 172.21.15.175:0/3940664328 >> v1:172.21.15.177:6789/0 conn(0x7f73b815dcf0 legacy=0x7f73b8099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.516+0000 7f73b6800640 1 -- 172.21.15.175:0/3940664328 >> v1:172.21.15.175:6789/0 conn(0x7f73b80d0480 legacy=0x7f73b809a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.516+0000 7f73b6800640 1 -- 172.21.15.175:0/3940664328 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b80d0b60 con 0x7f73b80cd4c0 2024-04-25T09:14:04.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b6800640 1 --2- 172.21.15.175:0/3940664328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73b80cd4c0 0x7f73b81686e0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f73b0009d90 tx=0x7f73b001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3b1e1abf7ff965 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:04.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b4a00640 1 -- 172.21.15.175:0/3940664328 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b00b2070 con 0x7f73b80cd4c0 2024-04-25T09:14:04.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b4a00640 1 -- 172.21.15.175:0/3940664328 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b00a5710 con 0x7f73b80cd4c0 2024-04-25T09:14:04.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b4a00640 1 -- 172.21.15.175:0/3940664328 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b00a5ae0 con 0x7f73b80cd4c0 2024-04-25T09:14:04.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b7200640 1 -- 172.21.15.175:0/3940664328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73b80cd4c0 msgr2=0x7f73b81686e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b7200640 1 --2- 172.21.15.175:0/3940664328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73b80cd4c0 0x7f73b81686e0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f73b0009d90 tx=0x7f73b001c850 comp rx=0 tx=0).stop 2024-04-25T09:14:04.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b7200640 1 -- 172.21.15.175:0/3940664328 shutdown_connections 2024-04-25T09:14:04.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b7200640 1 --2- 172.21.15.175:0/3940664328 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73b80cd4c0 0x7f73b81686e0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b7200640 1 -- 172.21.15.175:0/3940664328 >> 172.21.15.175:0/3940664328 conn(0x7f73b80b3220 msgr2=0x7f73b80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:04.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b7200640 1 -- 172.21.15.175:0/3940664328 shutdown_connections 2024-04-25T09:14:04.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b7200640 1 -- 172.21.15.175:0/3940664328 wait complete. 2024-04-25T09:14:04.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b7200640 1 Processor -- start 2024-04-25T09:14:04.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b7200640 1 -- start start 2024-04-25T09:14:04.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b7200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73b80cd4c0 0x7f73b8153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b7200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73b80d0480 0x7f73b80cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b7200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73b815dcf0 0x7f73b80b6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b7200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b816b7d0 con 0x7f73b80cd4c0 2024-04-25T09:14:04.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b7200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b816b650 con 0x7f73b815dcf0 2024-04-25T09:14:04.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b7200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b816b950 con 0x7f73b80d0480 2024-04-25T09:14:04.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b5e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73b80cd4c0 0x7f73b8153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b5e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73b80cd4c0 0x7f73b8153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32802/0 (socket says 172.21.15.175:32802) 2024-04-25T09:14:04.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b5e00640 1 -- 172.21.15.175:0/4148244445 learned_addr learned my addr 172.21.15.175:0/4148244445 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:04.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b5400640 1 --2- 172.21.15.175:0/4148244445 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73b80d0480 0x7f73b80cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.520+0000 7f73b6800640 1 --2- 172.21.15.175:0/4148244445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73b815dcf0 0x7f73b80b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.524+0000 7f73b5e00640 1 -- 172.21.15.175:0/4148244445 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73b80d0480 msgr2=0x7f73b80cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.524+0000 7f73b5e00640 1 --2- 172.21.15.175:0/4148244445 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73b80d0480 0x7f73b80cb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.524+0000 7f73b5e00640 1 -- 172.21.15.175:0/4148244445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73b815dcf0 msgr2=0x7f73b80b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.524+0000 7f73b5e00640 1 --2- 172.21.15.175:0/4148244445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73b815dcf0 0x7f73b80b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.524+0000 7f73b5e00640 1 -- 172.21.15.175:0/4148244445 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b80cb860 con 0x7f73b80cd4c0 2024-04-25T09:14:04.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.524+0000 7f73b5400640 1 --2- 172.21.15.175:0/4148244445 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73b80d0480 0x7f73b80cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:04.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.524+0000 7f73b5e00640 1 --2- 172.21.15.175:0/4148244445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73b80cd4c0 0x7f73b8153190 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f73a800c500 tx=0x7f73a800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:04.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.524+0000 7f73ae000640 1 -- 172.21.15.175:0/4148244445 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a8016020 con 0x7f73b80cd4c0 2024-04-25T09:14:04.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.524+0000 7f73ae000640 1 -- 172.21.15.175:0/4148244445 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a8005220 con 0x7f73b80cd4c0 2024-04-25T09:14:04.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.524+0000 7f73ae000640 1 -- 172.21.15.175:0/4148244445 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a8007030 con 0x7f73b80cd4c0 2024-04-25T09:14:04.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.524+0000 7f73b7200640 1 -- 172.21.15.175:0/4148244445 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b80b56e0 con 0x7f73b80cd4c0 2024-04-25T09:14:04.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.524+0000 7f73b7200640 1 -- 172.21.15.175:0/4148244445 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b80b5ca0 con 0x7f73b80cd4c0 2024-04-25T09:14:04.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.524+0000 7f73b7200640 1 -- 172.21.15.175:0/4148244445 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b8074a60 con 0x7f73b80cd4c0 2024-04-25T09:14:04.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.524+0000 7f73ae000640 1 -- 172.21.15.175:0/4148244445 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f73a80071f0 con 0x7f73b80cd4c0 2024-04-25T09:14:04.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.524+0000 7f73ae000640 1 --2- 172.21.15.175:0/4148244445 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7394066f90 0x7f7394069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.524+0000 7f73ae000640 1 -- 172.21.15.175:0/4148244445 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73a8084980 con 0x7f73b80cd4c0 2024-04-25T09:14:04.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.524+0000 7f73b5400640 1 --2- 172.21.15.175:0/4148244445 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7394066f90 0x7f7394069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.528+0000 7f73b5400640 1 --2- 172.21.15.175:0/4148244445 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7394066f90 0x7f7394069450 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f73b80cdec0 tx=0x7f73a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:04.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.528+0000 7f73ae000640 1 -- 172.21.15.175:0/4148244445 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f73a8020020 con 0x7f73b80cd4c0 2024-04-25T09:14:04.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.684+0000 7f73b7200640 1 -- 172.21.15.175:0/4148244445 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73b81568b0 con 0x7f73b80cd4c0 2024-04-25T09:14:04.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.688+0000 7f73ae000640 1 -- 172.21.15.175:0/4148244445 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16676 (secure 0 0 0) 0x7f73a8055900 con 0x7f73b80cd4c0 2024-04-25T09:14:04.675 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:04.675 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":112,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:14:03.697987+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:14:01.413477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:14:02.699273+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:14:04.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.688+0000 7f73b7200640 1 -- 172.21.15.175:0/4148244445 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7394066f90 msgr2=0x7f7394069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.688+0000 7f73b7200640 1 --2- 172.21.15.175:0/4148244445 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7394066f90 0x7f7394069450 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f73b80cdec0 tx=0x7f73a0009040 comp rx=0 tx=0).stop 2024-04-25T09:14:04.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.688+0000 7f73b7200640 1 -- 172.21.15.175:0/4148244445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73b80cd4c0 msgr2=0x7f73b8153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.688+0000 7f73b7200640 1 --2- 172.21.15.175:0/4148244445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73b80cd4c0 0x7f73b8153190 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f73a800c500 tx=0x7f73a800c9c0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.688+0000 7f73b7200640 1 -- 172.21.15.175:0/4148244445 shutdown_connections 2024-04-25T09:14:04.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.688+0000 7f73b7200640 1 --2- 172.21.15.175:0/4148244445 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7394066f90 0x7f7394069450 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.688+0000 7f73b7200640 1 --2- 172.21.15.175:0/4148244445 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f73b815dcf0 0x7f73b80b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.688+0000 7f73b7200640 1 --2- 172.21.15.175:0/4148244445 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f73b80d0480 0x7f73b80cb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.688+0000 7f73b7200640 1 --2- 172.21.15.175:0/4148244445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73b80cd4c0 0x7f73b8153190 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.688+0000 7f73b7200640 1 -- 172.21.15.175:0/4148244445 >> 172.21.15.175:0/4148244445 conn(0x7f73b80b3220 msgr2=0x7f73b806c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:04.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.688+0000 7f73b7200640 1 -- 172.21.15.175:0/4148244445 shutdown_connections 2024-04-25T09:14:04.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.688+0000 7f73b7200640 1 -- 172.21.15.175:0/4148244445 wait complete. 2024-04-25T09:14:04.696 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:14:04.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b03e00640 1 Processor -- start 2024-04-25T09:14:04.831 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b03e00640 1 -- start start 2024-04-25T09:14:04.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b03e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9afc15a900 0x7f9afc06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b03e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9afc0cd520 0x7f9afc0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b03e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9afc0cf560 0x7f9afc0cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b03e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9afc0cfef0 con 0x7f9afc0cd520 2024-04-25T09:14:04.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b03e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9afc0cda00 con 0x7f9afc0cf560 2024-04-25T09:14:04.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b03e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc0cdce0 con 0x7f9afc15a900 2024-04-25T09:14:04.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b00a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9afc0cd520 0x7f9afc0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b00a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9afc0cd520 0x7f9afc0ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32816/0 (socket says 172.21.15.175:32816) 2024-04-25T09:14:04.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b00a00640 1 -- 172.21.15.175:0/1316889412 learned_addr learned my addr 172.21.15.175:0/1316889412 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:04.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b01400640 1 --2- 172.21.15.175:0/1316889412 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9afc15a900 0x7f9afc06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b01e00640 1 --2- 172.21.15.175:0/1316889412 >> v2:172.21.15.177:3300/0 conn(0x7f9afc0cf560 0x7f9afc0cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b00a00640 1 -- 172.21.15.175:0/1316889412 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9afc15a900 msgr2=0x7f9afc06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:04.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b00a00640 1 --2- 172.21.15.175:0/1316889412 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9afc15a900 0x7f9afc06e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b00a00640 1 -- 172.21.15.175:0/1316889412 >> v2:172.21.15.177:3300/0 conn(0x7f9afc0cf560 msgr2=0x7f9afc0cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:04.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b00a00640 1 --2- 172.21.15.175:0/1316889412 >> v2:172.21.15.177:3300/0 conn(0x7f9afc0cf560 0x7f9afc0cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b00a00640 1 -- 172.21.15.175:0/1316889412 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc0cdfc0 con 0x7f9afc0cd520 2024-04-25T09:14:04.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.844+0000 7f9b01400640 1 --2- 172.21.15.175:0/1316889412 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9afc15a900 0x7f9afc06e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:04.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.848+0000 7f9b00a00640 1 --2- 172.21.15.175:0/1316889412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc0cd520 0x7f9afc0ceaa0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f9afc15e2f0 tx=0x7f9ae801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a1f0a9fcf6ea0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:04.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.848+0000 7f9afbe00640 1 -- 172.21.15.175:0/1316889412 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80aa610 con 0x7f9afc0cd520 2024-04-25T09:14:04.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.848+0000 7f9afbe00640 1 -- 172.21.15.175:0/1316889412 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae80af070 con 0x7f9afc0cd520 2024-04-25T09:14:04.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.848+0000 7f9afbe00640 1 -- 172.21.15.175:0/1316889412 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80aa9d0 con 0x7f9afc0cd520 2024-04-25T09:14:04.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.848+0000 7f9b03e00640 1 -- 172.21.15.175:0/1316889412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc0cd520 msgr2=0x7f9afc0ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.848+0000 7f9b03e00640 1 --2- 172.21.15.175:0/1316889412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc0cd520 0x7f9afc0ceaa0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f9afc15e2f0 tx=0x7f9ae801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.848+0000 7f9b03e00640 1 -- 172.21.15.175:0/1316889412 shutdown_connections 2024-04-25T09:14:04.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.848+0000 7f9b03e00640 1 --2- 172.21.15.175:0/1316889412 >> v2:172.21.15.177:3300/0 conn(0x7f9afc0cf560 0x7f9afc0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.848+0000 7f9b03e00640 1 --2- 172.21.15.175:0/1316889412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc0cd520 0x7f9afc0ceaa0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.848+0000 7f9b03e00640 1 --2- 172.21.15.175:0/1316889412 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9afc15a900 0x7f9afc06e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.848+0000 7f9b03e00640 1 -- 172.21.15.175:0/1316889412 >> 172.21.15.175:0/1316889412 conn(0x7f9afc067150 msgr2=0x7f9afc06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:04.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.848+0000 7f9b03e00640 1 -- 172.21.15.175:0/1316889412 shutdown_connections 2024-04-25T09:14:04.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.848+0000 7f9b03e00640 1 -- 172.21.15.175:0/1316889412 wait complete. 2024-04-25T09:14:04.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b03e00640 1 Processor -- start 2024-04-25T09:14:04.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b03e00640 1 -- start start 2024-04-25T09:14:04.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b03e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9afc0cf560 0x7f9afc13cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b03e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc15a900 0x7f9afc156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b03e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9afc13d220 0x7f9afc156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b03e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc06d530 con 0x7f9afc15a900 2024-04-25T09:14:04.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b03e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc06d3b0 con 0x7f9afc0cf560 2024-04-25T09:14:04.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b03e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc15c790 con 0x7f9afc13d220 2024-04-25T09:14:04.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b00a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc15a900 0x7f9afc156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b00a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc15a900 0x7f9afc156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32824/0 (socket says 172.21.15.175:32824) 2024-04-25T09:14:04.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b00a00640 1 -- 172.21.15.175:0/4017970573 learned_addr learned my addr 172.21.15.175:0/4017970573 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:04.840 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b01400640 1 --2- 172.21.15.175:0/4017970573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9afc0cf560 0x7f9afc13cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b01e00640 1 --2- 172.21.15.175:0/4017970573 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9afc13d220 0x7f9afc156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b00a00640 1 -- 172.21.15.175:0/4017970573 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9afc13d220 msgr2=0x7f9afc156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b00a00640 1 --2- 172.21.15.175:0/4017970573 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9afc13d220 0x7f9afc156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b00a00640 1 -- 172.21.15.175:0/4017970573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9afc0cf560 msgr2=0x7f9afc13cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:04.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b00a00640 1 --2- 172.21.15.175:0/4017970573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9afc0cf560 0x7f9afc13cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:04.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b00a00640 1 -- 172.21.15.175:0/4017970573 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc155990 con 0x7f9afc15a900 2024-04-25T09:14:04.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b00a00640 1 --2- 172.21.15.175:0/4017970573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc15a900 0x7f9afc156a30 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f9ae801aba0 tx=0x7f9ae801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:04.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9af9600640 1 -- 172.21.15.175:0/4017970573 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80bd5f0 con 0x7f9afc15a900 2024-04-25T09:14:04.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9af9600640 1 -- 172.21.15.175:0/4017970573 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae80bd790 con 0x7f9afc15a900 2024-04-25T09:14:04.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b03e00640 1 -- 172.21.15.175:0/4017970573 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9afc155c70 con 0x7f9afc15a900 2024-04-25T09:14:04.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9af9600640 1 -- 172.21.15.175:0/4017970573 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80bdb40 con 0x7f9afc15a900 2024-04-25T09:14:04.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.852+0000 7f9b03e00640 1 -- 172.21.15.175:0/4017970573 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9afc156230 con 0x7f9afc15a900 2024-04-25T09:14:04.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.856+0000 7f9b03e00640 1 -- 172.21.15.175:0/4017970573 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9afc074a60 con 0x7f9afc15a900 2024-04-25T09:14:04.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.856+0000 7f9af9600640 1 -- 172.21.15.175:0/4017970573 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9ae80b33f0 con 0x7f9afc15a900 2024-04-25T09:14:04.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.856+0000 7f9af9600640 1 --2- 172.21.15.175:0/4017970573 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9adc066f60 0x7f9adc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:04.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.856+0000 7f9af9600640 1 -- 172.21.15.175:0/4017970573 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ae811fdd0 con 0x7f9afc15a900 2024-04-25T09:14:04.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.856+0000 7f9b01400640 1 --2- 172.21.15.175:0/4017970573 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9adc066f60 0x7f9adc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:04.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.856+0000 7f9b01400640 1 --2- 172.21.15.175:0/4017970573 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9adc066f60 0x7f9adc069420 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9af00045f0 tx=0x7f9af0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:04.848 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:04.860+0000 7f9af9600640 1 -- 172.21.15.175:0/4017970573 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9ae80c3060 con 0x7f9afc15a900 2024-04-25T09:14:05.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.016+0000 7f9b03e00640 1 -- 172.21.15.175:0/4017970573 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9afc152ac0 con 0x7f9afc15a900 2024-04-25T09:14:05.004 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.016+0000 7f9af9600640 1 -- 172.21.15.175:0/4017970573 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16676 (secure 0 0 0) 0x7f9ae80a7070 con 0x7f9afc15a900 2024-04-25T09:14:05.005 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:05.005 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":112,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:14:03.697987+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:14:01.413477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:14:02.699273+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:14:05.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.020+0000 7f9b03e00640 1 -- 172.21.15.175:0/4017970573 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9adc066f60 msgr2=0x7f9adc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:05.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.020+0000 7f9b03e00640 1 --2- 172.21.15.175:0/4017970573 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9adc066f60 0x7f9adc069420 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9af00045f0 tx=0x7f9af0008040 comp rx=0 tx=0).stop 2024-04-25T09:14:05.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.020+0000 7f9b03e00640 1 -- 172.21.15.175:0/4017970573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc15a900 msgr2=0x7f9afc156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:05.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.020+0000 7f9b03e00640 1 --2- 172.21.15.175:0/4017970573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc15a900 0x7f9afc156a30 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f9ae801aba0 tx=0x7f9ae801ad30 comp rx=0 tx=0).stop 2024-04-25T09:14:05.007 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.020+0000 7f9b03e00640 1 -- 172.21.15.175:0/4017970573 shutdown_connections 2024-04-25T09:14:05.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.020+0000 7f9b03e00640 1 --2- 172.21.15.175:0/4017970573 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9adc066f60 0x7f9adc069420 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.020+0000 7f9b03e00640 1 --2- 172.21.15.175:0/4017970573 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9afc13d220 0x7f9afc156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.020+0000 7f9b03e00640 1 --2- 172.21.15.175:0/4017970573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9afc15a900 0x7f9afc156a30 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.020+0000 7f9b03e00640 1 --2- 172.21.15.175:0/4017970573 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9afc0cf560 0x7f9afc13cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.020+0000 7f9b03e00640 1 -- 172.21.15.175:0/4017970573 >> 172.21.15.175:0/4017970573 conn(0x7f9afc0cd520 msgr2=0x7f9afc06ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:05.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.020+0000 7f9b03e00640 1 -- 172.21.15.175:0/4017970573 shutdown_connections 2024-04-25T09:14:05.008 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.020+0000 7f9b03e00640 1 -- 172.21.15.175:0/4017970573 wait complete. 2024-04-25T09:14:05.028 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:14:05.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.180+0000 7f5a74c00640 1 Processor -- start 2024-04-25T09:14:05.166 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.180+0000 7f5a74c00640 1 -- start start 2024-04-25T09:14:05.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.180+0000 7f5a74c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5a700cbe60 0x7f5a7015af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:05.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.180+0000 7f5a74c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7006db60 con 0x7f5a700b4800 2024-04-25T09:14:05.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.180+0000 7f5a74c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7006de40 con 0x7f5a7006d310 2024-04-25T09:14:05.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.180+0000 7f5a74c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7006e120 con 0x7f5a700cbe60 2024-04-25T09:14:05.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.180+0000 7f5a6e800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5a700b4800 0x7f5a7015c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:47692/0 (socket says 172.21.15.175:47692) 2024-04-25T09:14:05.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.180+0000 7f5a6e800640 1 -- 172.21.15.175:0/3879861139 learned_addr learned my addr 172.21.15.175:0/3879861139 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:05.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.180+0000 7f5a6de00640 1 --2- 172.21.15.175:0/3879861139 >> v2:172.21.15.177:3300/0 conn(0x7f5a700cbe60 0x7f5a7015af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:05.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.180+0000 7f5a6ca00640 1 -- 172.21.15.175:0/3879861139 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509871889 0 0) 0x7f5a7006db60 con 0x7f5a700b4800 2024-04-25T09:14:05.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.180+0000 7f5a6ca00640 1 -- 172.21.15.175:0/3879861139 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a54003530 con 0x7f5a700b4800 2024-04-25T09:14:05.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.180+0000 7f5a6ca00640 1 -- 172.21.15.175:0/3879861139 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110257763 0 0) 0x7f5a7006de40 con 0x7f5a7006d310 2024-04-25T09:14:05.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.180+0000 7f5a6ca00640 1 -- 172.21.15.175:0/3879861139 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a7006db60 con 0x7f5a7006d310 2024-04-25T09:14:05.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.180+0000 7f5a6de00640 1 -- 172.21.15.175:0/3879861139 >> v1:172.21.15.177:6789/0 conn(0x7f5a7006d310 legacy=0x7f5a700b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:05.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.180+0000 7f5a6de00640 1 -- 172.21.15.175:0/3879861139 >> v1:172.21.15.175:6789/0 conn(0x7f5a700b4800 legacy=0x7f5a7015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:05.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.180+0000 7f5a6de00640 1 -- 172.21.15.175:0/3879861139 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7015c2f0 con 0x7f5a700cbe60 2024-04-25T09:14:05.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.184+0000 7f5a6de00640 1 --2- 172.21.15.175:0/3879861139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a700cbe60 0x7f5a7015af20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5a600097c0 tx=0x7f5a6001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9101ec3566700840 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:05.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.184+0000 7f5a6ca00640 1 -- 172.21.15.175:0/3879861139 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a600b0070 con 0x7f5a700cbe60 2024-04-25T09:14:05.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.184+0000 7f5a6ca00640 1 -- 172.21.15.175:0/3879861139 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a600ab600 con 0x7f5a700cbe60 2024-04-25T09:14:05.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.184+0000 7f5a6ca00640 1 -- 172.21.15.175:0/3879861139 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a600ab9d0 con 0x7f5a700cbe60 2024-04-25T09:14:05.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.184+0000 7f5a74c00640 1 -- 172.21.15.175:0/3879861139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a700cbe60 msgr2=0x7f5a7015af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:05.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.184+0000 7f5a74c00640 1 --2- 172.21.15.175:0/3879861139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a700cbe60 0x7f5a7015af20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5a600097c0 tx=0x7f5a6001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.184+0000 7f5a74c00640 1 -- 172.21.15.175:0/3879861139 shutdown_connections 2024-04-25T09:14:05.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.184+0000 7f5a74c00640 1 --2- 172.21.15.175:0/3879861139 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a700cbe60 0x7f5a7015af20 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.184+0000 7f5a74c00640 1 -- 172.21.15.175:0/3879861139 >> 172.21.15.175:0/3879861139 conn(0x7f5a7006ac50 msgr2=0x7f5a7006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:05.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.184+0000 7f5a74c00640 1 -- 172.21.15.175:0/3879861139 shutdown_connections 2024-04-25T09:14:05.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.184+0000 7f5a74c00640 1 -- 172.21.15.175:0/3879861139 wait complete. 2024-04-25T09:14:05.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a74c00640 1 Processor -- start 2024-04-25T09:14:05.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a74c00640 1 -- start start 2024-04-25T09:14:05.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a74c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a7006d310 0x7f5a70148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:05.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a74c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a700b4800 0x7f5a701549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:05.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a74c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a700cbe60 0x7f5a700b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:05.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a74c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7015db40 con 0x7f5a7006d310 2024-04-25T09:14:05.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a74c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7015d9c0 con 0x7f5a700b4800 2024-04-25T09:14:05.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a74c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700cc450 con 0x7f5a700cbe60 2024-04-25T09:14:05.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a6de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a7006d310 0x7f5a70148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:05.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a6de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a7006d310 0x7f5a70148050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32832/0 (socket says 172.21.15.175:32832) 2024-04-25T09:14:05.176 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a6de00640 1 -- 172.21.15.175:0/1491266455 learned_addr learned my addr 172.21.15.175:0/1491266455 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:05.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a6e800640 1 --2- 172.21.15.175:0/1491266455 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a700cbe60 0x7f5a700b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:05.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a6de00640 1 -- 172.21.15.175:0/1491266455 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a700cbe60 msgr2=0x7f5a700b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:05.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a6d400640 1 --2- 172.21.15.175:0/1491266455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a700b4800 0x7f5a701549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:05.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a6de00640 1 --2- 172.21.15.175:0/1491266455 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a700cbe60 0x7f5a700b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a6de00640 1 -- 172.21.15.175:0/1491266455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a700b4800 msgr2=0x7f5a701549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:05.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a6de00640 1 --2- 172.21.15.175:0/1491266455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a700b4800 0x7f5a701549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:05.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a6de00640 1 -- 172.21.15.175:0/1491266455 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a70153190 con 0x7f5a7006d310 2024-04-25T09:14:05.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a6e800640 1 --2- 172.21.15.175:0/1491266455 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a700cbe60 0x7f5a700b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:05.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a6d400640 1 --2- 172.21.15.175:0/1491266455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a700b4800 0x7f5a701549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:05.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a6de00640 1 --2- 172.21.15.175:0/1491266455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a7006d310 0x7f5a70148050 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f5a600190b0 tx=0x7f5a60019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:05.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a66000640 1 -- 172.21.15.175:0/1491266455 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a600b0040 con 0x7f5a7006d310 2024-04-25T09:14:05.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a66000640 1 -- 172.21.15.175:0/1491266455 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a600ba070 con 0x7f5a7006d310 2024-04-25T09:14:05.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a66000640 1 -- 172.21.15.175:0/1491266455 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a60006e20 con 0x7f5a7006d310 2024-04-25T09:14:05.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a74c00640 1 -- 172.21.15.175:0/1491266455 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a70153470 con 0x7f5a7006d310 2024-04-25T09:14:05.177 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a74c00640 1 -- 172.21.15.175:0/1491266455 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a70153a30 con 0x7f5a7006d310 2024-04-25T09:14:05.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.188+0000 7f5a74c00640 1 -- 172.21.15.175:0/1491266455 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a70075160 con 0x7f5a7006d310 2024-04-25T09:14:05.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.192+0000 7f5a66000640 1 -- 172.21.15.175:0/1491266455 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5a600b4630 con 0x7f5a7006d310 2024-04-25T09:14:05.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.192+0000 7f5a66000640 1 --2- 172.21.15.175:0/1491266455 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5a50066f60 0x7f5a50069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:05.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.192+0000 7f5a66000640 1 -- 172.21.15.175:0/1491266455 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a6011f5f0 con 0x7f5a7006d310 2024-04-25T09:14:05.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.192+0000 7f5a6d400640 1 --2- 172.21.15.175:0/1491266455 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5a50066f60 0x7f5a50069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:05.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.192+0000 7f5a6d400640 1 --2- 172.21.15.175:0/1491266455 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5a50066f60 0x7f5a50069420 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5a701f5b90 tx=0x7f5a5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:05.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.196+0000 7f5a66000640 1 -- 172.21.15.175:0/1491266455 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5a60016090 con 0x7f5a7006d310 2024-04-25T09:14:05.377 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:05.388+0000 7f5a74c00640 1 -- 172.21.15.175:0/1491266455 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5a700aed40 con 0x7f5a7006d310 2024-04-25T09:14:06.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.352+0000 7f5a66000640 1 -- 172.21.15.175:0/1491266455 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v92) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5a600f06e0 con 0x7f5a7006d310 2024-04-25T09:14:06.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.356+0000 7f5a74c00640 1 -- 172.21.15.175:0/1491266455 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5a50066f60 msgr2=0x7f5a50069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.356+0000 7f5a74c00640 1 --2- 172.21.15.175:0/1491266455 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5a50066f60 0x7f5a50069420 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5a701f5b90 tx=0x7f5a5c009040 comp rx=0 tx=0).stop 2024-04-25T09:14:06.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.356+0000 7f5a74c00640 1 -- 172.21.15.175:0/1491266455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a7006d310 msgr2=0x7f5a70148050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.356+0000 7f5a74c00640 1 --2- 172.21.15.175:0/1491266455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a7006d310 0x7f5a70148050 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f5a600190b0 tx=0x7f5a60019240 comp rx=0 tx=0).stop 2024-04-25T09:14:06.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.356+0000 7f5a74c00640 1 -- 172.21.15.175:0/1491266455 shutdown_connections 2024-04-25T09:14:06.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.356+0000 7f5a74c00640 1 --2- 172.21.15.175:0/1491266455 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5a50066f60 0x7f5a50069420 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.356+0000 7f5a74c00640 1 --2- 172.21.15.175:0/1491266455 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a700cbe60 0x7f5a700b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.356+0000 7f5a74c00640 1 --2- 172.21.15.175:0/1491266455 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a700b4800 0x7f5a701549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.356+0000 7f5a74c00640 1 --2- 172.21.15.175:0/1491266455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a7006d310 0x7f5a70148050 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.356+0000 7f5a74c00640 1 -- 172.21.15.175:0/1491266455 >> 172.21.15.175:0/1491266455 conn(0x7f5a7006ac50 msgr2=0x7f5a700cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:06.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.356+0000 7f5a74c00640 1 -- 172.21.15.175:0/1491266455 shutdown_connections 2024-04-25T09:14:06.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.356+0000 7f5a74c00640 1 -- 172.21.15.175:0/1491266455 wait complete. 2024-04-25T09:14:06.367 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:14:06.367 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:14:06.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.524+0000 7f57d3a00640 1 Processor -- start 2024-04-25T09:14:06.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.524+0000 7f57d3a00640 1 -- start start 2024-04-25T09:14:06.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.524+0000 7f57d3a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f57cc145250 0x7f57cc0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.524+0000 7f57d3a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57cc0ce970 0x7f57cc0cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.524+0000 7f57d3a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57cc0cfd10 con 0x7f57cc1600a0 2024-04-25T09:14:06.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.524+0000 7f57d3a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57cc15f650 con 0x7f57cc145250 2024-04-25T09:14:06.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.524+0000 7f57d3a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc0cfff0 con 0x7f57cc0ce970 2024-04-25T09:14:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.524+0000 7f57d1000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f57cc145250 0x7f57cc0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.524+0000 7f57d1000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f57cc145250 0x7f57cc0cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32836/0 (socket says 172.21.15.175:32836) 2024-04-25T09:14:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.524+0000 7f57d1000640 1 -- 172.21.15.175:0/2104516708 learned_addr learned my addr 172.21.15.175:0/2104516708 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.524+0000 7f57d1a00640 1 --2- 172.21.15.175:0/2104516708 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57cc0ce970 0x7f57cc0cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.524+0000 7f57d1000640 1 -- 172.21.15.175:0/2104516708 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57cc0ce970 msgr2=0x7f57cc0cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.524+0000 7f57d1000640 1 --2- 172.21.15.175:0/2104516708 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57cc0ce970 0x7f57cc0cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.524+0000 7f57d1000640 1 -- 172.21.15.175:0/2104516708 >> v1:172.21.15.177:6789/0 conn(0x7f57cc1600a0 legacy=0x7f57cc0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.524+0000 7f57d1000640 1 -- 172.21.15.175:0/2104516708 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc15f8a0 con 0x7f57cc145250 2024-04-25T09:14:06.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.528+0000 7f57d1000640 1 --2- 172.21.15.175:0/2104516708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57cc145250 0x7f57cc0cf6b0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f57bc0098a0 tx=0x7f57bc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943712778660e09e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:06.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.528+0000 7f57cb400640 1 -- 172.21.15.175:0/2104516708 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc0aa600 con 0x7f57cc145250 2024-04-25T09:14:06.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.528+0000 7f57cb400640 1 -- 172.21.15.175:0/2104516708 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc0af070 con 0x7f57cc145250 2024-04-25T09:14:06.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.528+0000 7f57cb400640 1 -- 172.21.15.175:0/2104516708 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc0aa9c0 con 0x7f57cc145250 2024-04-25T09:14:06.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.528+0000 7f57d3a00640 1 -- 172.21.15.175:0/2104516708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57cc145250 msgr2=0x7f57cc0cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.528+0000 7f57d3a00640 1 --2- 172.21.15.175:0/2104516708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57cc145250 0x7f57cc0cf6b0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f57bc0098a0 tx=0x7f57bc01c480 comp rx=0 tx=0).stop 2024-04-25T09:14:06.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.528+0000 7f57d3a00640 1 -- 172.21.15.175:0/2104516708 shutdown_connections 2024-04-25T09:14:06.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.528+0000 7f57d3a00640 1 --2- 172.21.15.175:0/2104516708 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57cc0ce970 0x7f57cc0cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.528+0000 7f57d3a00640 1 --2- 172.21.15.175:0/2104516708 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57cc145250 0x7f57cc0cf6b0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.528+0000 7f57d3a00640 1 -- 172.21.15.175:0/2104516708 >> 172.21.15.175:0/2104516708 conn(0x7f57cc06ac50 msgr2=0x7f57cc06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:06.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.528+0000 7f57d3a00640 1 -- 172.21.15.175:0/2104516708 shutdown_connections 2024-04-25T09:14:06.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.528+0000 7f57d3a00640 1 -- 172.21.15.175:0/2104516708 wait complete. 2024-04-25T09:14:06.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d3a00640 1 Processor -- start 2024-04-25T09:14:06.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d3a00640 1 -- start start 2024-04-25T09:14:06.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d3a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57cc0ce970 0x7f57cc161040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d3a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57cc145250 0x7f57cc0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d3a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57cc1600a0 0x7f57cc06e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d3a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc15c870 con 0x7f57cc1600a0 2024-04-25T09:14:06.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d3a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc1604b0 con 0x7f57cc145250 2024-04-25T09:14:06.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d3a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57cc15c9f0 con 0x7f57cc0ce970 2024-04-25T09:14:06.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d1a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57cc1600a0 0x7f57cc06e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d1a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57cc1600a0 0x7f57cc06e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32838/0 (socket says 172.21.15.175:32838) 2024-04-25T09:14:06.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d1a00640 1 -- 172.21.15.175:0/1362999614 learned_addr learned my addr 172.21.15.175:0/1362999614 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:06.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57cbe00640 1 --2- 172.21.15.175:0/1362999614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57cc145250 0x7f57cc0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d1000640 1 --2- 172.21.15.175:0/1362999614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57cc0ce970 0x7f57cc161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d1a00640 1 -- 172.21.15.175:0/1362999614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57cc0ce970 msgr2=0x7f57cc161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d1a00640 1 --2- 172.21.15.175:0/1362999614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57cc0ce970 0x7f57cc161040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d1a00640 1 -- 172.21.15.175:0/1362999614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57cc145250 msgr2=0x7f57cc0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:06.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d1a00640 1 --2- 172.21.15.175:0/1362999614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57cc145250 0x7f57cc0b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:06.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d1a00640 1 -- 172.21.15.175:0/1362999614 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc161580 con 0x7f57cc1600a0 2024-04-25T09:14:06.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57cbe00640 1 --2- 172.21.15.175:0/1362999614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57cc145250 0x7f57cc0b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:06.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d1a00640 1 --2- 172.21.15.175:0/1362999614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57cc1600a0 0x7f57cc06e680 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f57c4007e40 tx=0x7f57c400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:06.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57c8c00640 1 -- 172.21.15.175:0/1362999614 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c4014620 con 0x7f57cc1600a0 2024-04-25T09:14:06.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57c8c00640 1 -- 172.21.15.175:0/1362999614 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c4019070 con 0x7f57cc1600a0 2024-04-25T09:14:06.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d3a00640 1 -- 172.21.15.175:0/1362999614 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57cc0b3310 con 0x7f57cc1600a0 2024-04-25T09:14:06.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57c8c00640 1 -- 172.21.15.175:0/1362999614 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c4014a20 con 0x7f57cc1600a0 2024-04-25T09:14:06.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d3a00640 1 -- 172.21.15.175:0/1362999614 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57cc0b38d0 con 0x7f57cc1600a0 2024-04-25T09:14:06.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.532+0000 7f57d3a00640 1 -- 172.21.15.175:0/1362999614 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57cc075160 con 0x7f57cc1600a0 2024-04-25T09:14:06.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.536+0000 7f57c8c00640 1 -- 172.21.15.175:0/1362999614 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f57c4014bc0 con 0x7f57cc1600a0 2024-04-25T09:14:06.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.536+0000 7f57c8c00640 1 --2- 172.21.15.175:0/1362999614 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f57ac066f60 0x7f57ac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:06.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.536+0000 7f57c8c00640 1 -- 172.21.15.175:0/1362999614 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57c40858f0 con 0x7f57cc1600a0 2024-04-25T09:14:06.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.536+0000 7f57d1000640 1 --2- 172.21.15.175:0/1362999614 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f57ac066f60 0x7f57ac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:06.523 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.536+0000 7f57d1000640 1 --2- 172.21.15.175:0/1362999614 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f57ac066f60 0x7f57ac069420 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f57bc0ae000 tx=0x7f57bc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:06.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.540+0000 7f57c8c00640 1 -- 172.21.15.175:0/1362999614 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f57c4056860 con 0x7f57cc1600a0 2024-04-25T09:14:06.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:06.724+0000 7f57d3a00640 1 -- 172.21.15.175:0/1362999614 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f57cc0b1870 con 0x7f57cc1600a0 2024-04-25T09:14:07.341 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.356+0000 7f57c8c00640 1 -- 172.21.15.175:0/1362999614 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v93) v1 ==== 122+0+0 (secure 0 0 0) 0x7f57c4056160 con 0x7f57cc1600a0 2024-04-25T09:14:07.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.356+0000 7f57d3a00640 1 -- 172.21.15.175:0/1362999614 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f57ac066f60 msgr2=0x7f57ac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:07.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.356+0000 7f57d3a00640 1 --2- 172.21.15.175:0/1362999614 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f57ac066f60 0x7f57ac069420 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f57bc0ae000 tx=0x7f57bc0a7000 comp rx=0 tx=0).stop 2024-04-25T09:14:07.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.356+0000 7f57d3a00640 1 -- 172.21.15.175:0/1362999614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57cc1600a0 msgr2=0x7f57cc06e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:07.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.356+0000 7f57d3a00640 1 --2- 172.21.15.175:0/1362999614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57cc1600a0 0x7f57cc06e680 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f57c4007e40 tx=0x7f57c400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:14:07.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.356+0000 7f57d3a00640 1 -- 172.21.15.175:0/1362999614 shutdown_connections 2024-04-25T09:14:07.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.356+0000 7f57d3a00640 1 --2- 172.21.15.175:0/1362999614 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f57ac066f60 0x7f57ac069420 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:07.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.356+0000 7f57d3a00640 1 --2- 172.21.15.175:0/1362999614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57cc1600a0 0x7f57cc06e680 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:07.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.356+0000 7f57d3a00640 1 --2- 172.21.15.175:0/1362999614 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f57cc145250 0x7f57cc0b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:07.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.356+0000 7f57d3a00640 1 --2- 172.21.15.175:0/1362999614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f57cc0ce970 0x7f57cc161040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:07.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.356+0000 7f57d3a00640 1 -- 172.21.15.175:0/1362999614 >> 172.21.15.175:0/1362999614 conn(0x7f57cc06ac50 msgr2=0x7f57cc0af850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:07.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.356+0000 7f57d3a00640 1 -- 172.21.15.175:0/1362999614 shutdown_connections 2024-04-25T09:14:07.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.356+0000 7f57d3a00640 1 -- 172.21.15.175:0/1362999614 wait complete. 2024-04-25T09:14:07.369 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:14:07.369 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:07.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.520+0000 7f6faf000640 1 Processor -- start 2024-04-25T09:14:07.508 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.520+0000 7f6faf000640 1 -- start start 2024-04-25T09:14:07.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.520+0000 7f6faf000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6fa815a900 0x7f6fa806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:07.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.520+0000 7f6faf000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa80cda00 con 0x7f6fa80cf560 2024-04-25T09:14:07.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.520+0000 7f6faf000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa80cdce0 con 0x7f6fa80cd520 2024-04-25T09:14:07.509 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.520+0000 7f6faf000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa815bcf0 con 0x7f6fa815a900 2024-04-25T09:14:07.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.524+0000 7f6fad000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f6fa80cf560 0x7f6fa815bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:47702/0 (socket says 172.21.15.175:47702) 2024-04-25T09:14:07.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.524+0000 7f6fad000640 1 -- 172.21.15.175:0/709470167 learned_addr learned my addr 172.21.15.175:0/709470167 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:07.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.524+0000 7f6fa7e00640 1 --2- 172.21.15.175:0/709470167 >> v2:172.21.15.177:3300/0 conn(0x7f6fa815a900 0x7f6fa806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:07.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.524+0000 7f6fa7400640 1 -- 172.21.15.175:0/709470167 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975291656 0 0) 0x7f6fa80cda00 con 0x7f6fa80cf560 2024-04-25T09:14:07.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.524+0000 7f6fa7400640 1 -- 172.21.15.175:0/709470167 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f8c003530 con 0x7f6fa80cf560 2024-04-25T09:14:07.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.524+0000 7f6fa7400640 1 -- 172.21.15.175:0/709470167 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2740765227 0 0) 0x7f6fa80cdce0 con 0x7f6fa80cd520 2024-04-25T09:14:07.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.524+0000 7f6fa7400640 1 -- 172.21.15.175:0/709470167 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fa80cda00 con 0x7f6fa80cd520 2024-04-25T09:14:07.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.524+0000 7f6fa7e00640 1 -- 172.21.15.175:0/709470167 >> v1:172.21.15.177:6789/0 conn(0x7f6fa80cd520 legacy=0x7f6fa80ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:07.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.524+0000 7f6fa7e00640 1 -- 172.21.15.175:0/709470167 >> v1:172.21.15.175:6789/0 conn(0x7f6fa80cf560 legacy=0x7f6fa815bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:07.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.524+0000 7f6fa7e00640 1 -- 172.21.15.175:0/709470167 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa80cdfc0 con 0x7f6fa815a900 2024-04-25T09:14:07.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.524+0000 7f6fa7e00640 1 --2- 172.21.15.175:0/709470167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fa815a900 0x7f6fa806e150 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6f900097c0 tx=0x7f6f9001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b9a967a75b289a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:07.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.524+0000 7f6fa7400640 1 -- 172.21.15.175:0/709470167 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f900b0070 con 0x7f6fa815a900 2024-04-25T09:14:07.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.524+0000 7f6fa7400640 1 -- 172.21.15.175:0/709470167 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f900ab600 con 0x7f6fa815a900 2024-04-25T09:14:07.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.524+0000 7f6fa7400640 1 -- 172.21.15.175:0/709470167 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f900ab9d0 con 0x7f6fa815a900 2024-04-25T09:14:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6faf000640 1 -- 172.21.15.175:0/709470167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fa815a900 msgr2=0x7f6fa806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6faf000640 1 --2- 172.21.15.175:0/709470167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fa815a900 0x7f6fa806e150 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6f900097c0 tx=0x7f6f9001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6faf000640 1 -- 172.21.15.175:0/709470167 shutdown_connections 2024-04-25T09:14:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6faf000640 1 --2- 172.21.15.175:0/709470167 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fa815a900 0x7f6fa806e150 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6faf000640 1 -- 172.21.15.175:0/709470167 >> 172.21.15.175:0/709470167 conn(0x7f6fa8067150 msgr2=0x7f6fa806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6faf000640 1 -- 172.21.15.175:0/709470167 shutdown_connections 2024-04-25T09:14:07.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6faf000640 1 -- 172.21.15.175:0/709470167 wait complete. 2024-04-25T09:14:07.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6faf000640 1 Processor -- start 2024-04-25T09:14:07.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6faf000640 1 -- start start 2024-04-25T09:14:07.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6faf000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fa80cf560 0x7f6fa80ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:07.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6faf000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fa815a900 0x7f6fa80b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:07.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6faf000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fa814fc00 0x7f6fa8140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:07.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6faf000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa806d530 con 0x7f6fa814fc00 2024-04-25T09:14:07.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6faf000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa806d3b0 con 0x7f6fa80cf560 2024-04-25T09:14:07.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6faf000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa8168c20 con 0x7f6fa815a900 2024-04-25T09:14:07.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6fad000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fa814fc00 0x7f6fa8140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6fad000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fa814fc00 0x7f6fa8140c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32846/0 (socket says 172.21.15.175:32846) 2024-04-25T09:14:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6fad000640 1 -- 172.21.15.175:0/3414857848 learned_addr learned my addr 172.21.15.175:0/3414857848 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6fa7e00640 1 --2- 172.21.15.175:0/3414857848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fa80cf560 0x7f6fa80ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6f9f400640 1 --2- 172.21.15.175:0/3414857848 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fa815a900 0x7f6fa80b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6fad000640 1 -- 172.21.15.175:0/3414857848 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fa815a900 msgr2=0x7f6fa80b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6fad000640 1 --2- 172.21.15.175:0/3414857848 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fa815a900 0x7f6fa80b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6fad000640 1 -- 172.21.15.175:0/3414857848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fa80cf560 msgr2=0x7f6fa80ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6fad000640 1 --2- 172.21.15.175:0/3414857848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fa80cf560 0x7f6fa80ae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.528+0000 7f6fad000640 1 -- 172.21.15.175:0/3414857848 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa80b2bc0 con 0x7f6fa814fc00 2024-04-25T09:14:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.532+0000 7f6fad000640 1 --2- 172.21.15.175:0/3414857848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fa814fc00 0x7f6fa8140c00 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000cbc0 tx=0x7f6fa000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:07.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.532+0000 7f6fa4c00640 1 -- 172.21.15.175:0/3414857848 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0017070 con 0x7f6fa814fc00 2024-04-25T09:14:07.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.532+0000 7f6fa4c00640 1 -- 172.21.15.175:0/3414857848 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa000ace0 con 0x7f6fa814fc00 2024-04-25T09:14:07.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.532+0000 7f6fa4c00640 1 -- 172.21.15.175:0/3414857848 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0012600 con 0x7f6fa814fc00 2024-04-25T09:14:07.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.532+0000 7f6faf000640 1 -- 172.21.15.175:0/3414857848 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa80b2ea0 con 0x7f6fa814fc00 2024-04-25T09:14:07.520 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.532+0000 7f6faf000640 1 -- 172.21.15.175:0/3414857848 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa80b3460 con 0x7f6fa814fc00 2024-04-25T09:14:07.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.532+0000 7f6faf000640 1 -- 172.21.15.175:0/3414857848 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa8074a60 con 0x7f6fa814fc00 2024-04-25T09:14:07.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.532+0000 7f6fa4c00640 1 -- 172.21.15.175:0/3414857848 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6fa001a070 con 0x7f6fa814fc00 2024-04-25T09:14:07.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.532+0000 7f6fa4c00640 1 --2- 172.21.15.175:0/3414857848 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6f84066f90 0x7f6f84069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:07.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.532+0000 7f6fa4c00640 1 -- 172.21.15.175:0/3414857848 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fa0084e40 con 0x7f6fa814fc00 2024-04-25T09:14:07.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.532+0000 7f6fa7e00640 1 --2- 172.21.15.175:0/3414857848 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6f84066f90 0x7f6f84069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:07.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.536+0000 7f6fa7e00640 1 --2- 172.21.15.175:0/3414857848 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6f84066f90 0x7f6f84069450 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6f900ad000 tx=0x7f6f90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:07.524 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.536+0000 7f6fa4c00640 1 -- 172.21.15.175:0/3414857848 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6fa00556d0 con 0x7f6fa814fc00 2024-04-25T09:14:07.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.724+0000 7f6faf000640 1 -- 172.21.15.175:0/3414857848 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6fa815c070 con 0x7f6fa814fc00 2024-04-25T09:14:07.710 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.724+0000 7f6fa4c00640 1 -- 172.21.15.175:0/3414857848 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f6fa0059770 con 0x7f6fa814fc00 2024-04-25T09:14:07.710 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:07.711 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":93,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/745891603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":745891603},{"type":"v1","addr":"172.21.15.175:6837","nonce":745891603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2312875672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2312875672},{"type":"v1","addr":"172.21.15.177:6834","nonce":2312875672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":8212,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3983919410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3983919410},{"type":"v1","addr":"172.21.15.177:6835","nonce":3983919410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:14:03.698308+0000","modified":"2024-04-25T09:14:06.729790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8712":{"gid":8712,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6836/4128642659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":4128642659},{"type":"v1","addr":"172.21.15.175:6836","nonce":4128642659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:14:07.711 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 93 2024-04-25T09:14:07.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.724+0000 7f6faf000640 1 -- 172.21.15.175:0/3414857848 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6f84066f90 msgr2=0x7f6f84069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:07.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.724+0000 7f6faf000640 1 --2- 172.21.15.175:0/3414857848 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6f84066f90 0x7f6f84069450 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6f900ad000 tx=0x7f6f90008040 comp rx=0 tx=0).stop 2024-04-25T09:14:07.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.724+0000 7f6faf000640 1 -- 172.21.15.175:0/3414857848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fa814fc00 msgr2=0x7f6fa8140c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:07.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.724+0000 7f6faf000640 1 --2- 172.21.15.175:0/3414857848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fa814fc00 0x7f6fa8140c00 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f6fa000cbc0 tx=0x7f6fa000a430 comp rx=0 tx=0).stop 2024-04-25T09:14:07.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.724+0000 7f6faf000640 1 -- 172.21.15.175:0/3414857848 shutdown_connections 2024-04-25T09:14:07.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.724+0000 7f6faf000640 1 --2- 172.21.15.175:0/3414857848 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6f84066f90 0x7f6f84069450 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:07.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.724+0000 7f6faf000640 1 --2- 172.21.15.175:0/3414857848 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fa814fc00 0x7f6fa8140c00 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:07.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.724+0000 7f6faf000640 1 --2- 172.21.15.175:0/3414857848 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6fa815a900 0x7f6fa80b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:07.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.724+0000 7f6faf000640 1 --2- 172.21.15.175:0/3414857848 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6fa80cf560 0x7f6fa80ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:07.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.724+0000 7f6faf000640 1 -- 172.21.15.175:0/3414857848 >> 172.21.15.175:0/3414857848 conn(0x7f6fa80cd520 msgr2=0x7f6fa8158bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:07.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.724+0000 7f6faf000640 1 -- 172.21.15.175:0/3414857848 shutdown_connections 2024-04-25T09:14:07.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.724+0000 7f6faf000640 1 -- 172.21.15.175:0/3414857848 wait complete. 2024-04-25T09:14:07.732 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:14:07.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.880+0000 7faebf800640 1 Processor -- start 2024-04-25T09:14:07.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.880+0000 7faebf800640 1 -- start start 2024-04-25T09:14:07.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.880+0000 7faebf800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faeb815a900 0x7faeb806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:07.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.880+0000 7faebf800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faeb80cf560 0x7faeb80cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:07.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.880+0000 7faebf800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb80cda00 con 0x7faeb80cd520 2024-04-25T09:14:07.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.880+0000 7faebf800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb815bcf0 con 0x7faeb815a900 2024-04-25T09:14:07.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.880+0000 7faebf800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb80cfef0 con 0x7faeb80cf560 2024-04-25T09:14:07.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.884+0000 7faebce00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faeb815a900 0x7faeb806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:07.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.884+0000 7faebce00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faeb815a900 0x7faeb806e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32860/0 (socket says 172.21.15.175:32860) 2024-04-25T09:14:07.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.884+0000 7faebce00640 1 -- 172.21.15.175:0/489819352 learned_addr learned my addr 172.21.15.175:0/489819352 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:07.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.884+0000 7faeafe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7faeb80cd520 0x7faeb80ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:47716/0 (socket says 172.21.15.175:47716) 2024-04-25T09:14:07.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.884+0000 7faebd800640 1 --2- 172.21.15.175:0/489819352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faeb80cf560 0x7faeb80cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:07.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.884+0000 7faeb7e00640 1 -- 172.21.15.175:0/489819352 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737308708 0 0) 0x7faeb80cda00 con 0x7faeb80cd520 2024-04-25T09:14:07.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.884+0000 7faeb7e00640 1 -- 172.21.15.175:0/489819352 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae9c003530 con 0x7faeb80cd520 2024-04-25T09:14:07.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.884+0000 7faebce00640 1 -- 172.21.15.175:0/489819352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faeb80cf560 msgr2=0x7faeb80cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:07.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.884+0000 7faebce00640 1 --2- 172.21.15.175:0/489819352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faeb80cf560 0x7faeb80cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:07.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.884+0000 7faebce00640 1 -- 172.21.15.175:0/489819352 >> v1:172.21.15.175:6789/0 conn(0x7faeb80cd520 legacy=0x7faeb80ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:07.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.884+0000 7faebce00640 1 -- 172.21.15.175:0/489819352 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb80cdce0 con 0x7faeb815a900 2024-04-25T09:14:07.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.884+0000 7faebd800640 1 --2- 172.21.15.175:0/489819352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faeb80cf560 0x7faeb80cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:07.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.884+0000 7faebce00640 1 --2- 172.21.15.175:0/489819352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb815a900 0x7faeb806e150 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7faea8009870 tx=0x7faea801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e546569944affd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:07.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.884+0000 7faeb7e00640 1 -- 172.21.15.175:0/489819352 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea80ab650 con 0x7faeb815a900 2024-04-25T09:14:07.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.884+0000 7faeb7e00640 1 -- 172.21.15.175:0/489819352 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea80b0070 con 0x7faeb815a900 2024-04-25T09:14:07.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.884+0000 7faeb7e00640 1 -- 172.21.15.175:0/489819352 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea80aba10 con 0x7faeb815a900 2024-04-25T09:14:07.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebf800640 1 -- 172.21.15.175:0/489819352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb815a900 msgr2=0x7faeb806e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:07.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebf800640 1 --2- 172.21.15.175:0/489819352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb815a900 0x7faeb806e150 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7faea8009870 tx=0x7faea801c560 comp rx=0 tx=0).stop 2024-04-25T09:14:07.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebf800640 1 -- 172.21.15.175:0/489819352 shutdown_connections 2024-04-25T09:14:07.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebf800640 1 --2- 172.21.15.175:0/489819352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faeb80cf560 0x7faeb80cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:07.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebf800640 1 --2- 172.21.15.175:0/489819352 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb815a900 0x7faeb806e150 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:07.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebf800640 1 -- 172.21.15.175:0/489819352 >> 172.21.15.175:0/489819352 conn(0x7faeb8067150 msgr2=0x7faeb806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:07.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebf800640 1 -- 172.21.15.175:0/489819352 shutdown_connections 2024-04-25T09:14:07.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebf800640 1 -- 172.21.15.175:0/489819352 wait complete. 2024-04-25T09:14:07.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebf800640 1 Processor -- start 2024-04-25T09:14:07.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebf800640 1 -- start start 2024-04-25T09:14:07.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebf800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faeb80cf560 0x7faeb80af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:07.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebf800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faeb815a900 0x7faeb8155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:07.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebf800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb80ade60 0x7faeb814da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:07.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebf800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb806d530 con 0x7faeb80ade60 2024-04-25T09:14:07.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebf800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb806d3b0 con 0x7faeb80cf560 2024-04-25T09:14:07.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebf800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb815c790 con 0x7faeb815a900 2024-04-25T09:14:07.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebd800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb80ade60 0x7faeb814da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:07.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebd800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb80ade60 0x7faeb814da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32866/0 (socket says 172.21.15.175:32866) 2024-04-25T09:14:07.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebd800640 1 -- 172.21.15.175:0/3701400767 learned_addr learned my addr 172.21.15.175:0/3701400767 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:07.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebce00640 1 --2- 172.21.15.175:0/3701400767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faeb80cf560 0x7faeb80af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:07.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faeafe00640 1 --2- 172.21.15.175:0/3701400767 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faeb815a900 0x7faeb8155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:07.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebd800640 1 -- 172.21.15.175:0/3701400767 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faeb815a900 msgr2=0x7faeb8155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:07.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebd800640 1 --2- 172.21.15.175:0/3701400767 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faeb815a900 0x7faeb8155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:07.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebd800640 1 -- 172.21.15.175:0/3701400767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faeb80cf560 msgr2=0x7faeb80af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:07.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebd800640 1 --2- 172.21.15.175:0/3701400767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faeb80cf560 0x7faeb80af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:07.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebd800640 1 -- 172.21.15.175:0/3701400767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb81557d0 con 0x7faeb80ade60 2024-04-25T09:14:07.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.888+0000 7faebce00640 1 --2- 172.21.15.175:0/3701400767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faeb80cf560 0x7faeb80af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:07.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.892+0000 7faebd800640 1 --2- 172.21.15.175:0/3701400767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb80ade60 0x7faeb814da30 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7faeb0007ef0 tx=0x7faeb000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:07.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.892+0000 7faeb5600640 1 -- 172.21.15.175:0/3701400767 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb001a070 con 0x7faeb80ade60 2024-04-25T09:14:07.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.892+0000 7faeb5600640 1 -- 172.21.15.175:0/3701400767 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb0003ba0 con 0x7faeb80ade60 2024-04-25T09:14:07.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.892+0000 7faebf800640 1 -- 172.21.15.175:0/3701400767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb8155ab0 con 0x7faeb80ade60 2024-04-25T09:14:07.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.892+0000 7faeb5600640 1 -- 172.21.15.175:0/3701400767 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb0004030 con 0x7faeb80ade60 2024-04-25T09:14:07.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.892+0000 7faebf800640 1 -- 172.21.15.175:0/3701400767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb814df70 con 0x7faeb80ade60 2024-04-25T09:14:07.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.892+0000 7faebf800640 1 -- 172.21.15.175:0/3701400767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb8074a60 con 0x7faeb80ade60 2024-04-25T09:14:07.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.892+0000 7faeb5600640 1 -- 172.21.15.175:0/3701400767 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faeb001d070 con 0x7faeb80ade60 2024-04-25T09:14:07.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.892+0000 7faeb5600640 1 --2- 172.21.15.175:0/3701400767 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fae94066f90 0x7fae94069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:07.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.892+0000 7faeb5600640 1 -- 172.21.15.175:0/3701400767 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faeb0085240 con 0x7faeb80ade60 2024-04-25T09:14:07.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.892+0000 7faebce00640 1 --2- 172.21.15.175:0/3701400767 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fae94066f90 0x7fae94069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:07.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.896+0000 7faebce00640 1 --2- 172.21.15.175:0/3701400767 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fae94066f90 0x7fae94069450 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7faea80af000 tx=0x7faea80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:07.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:07.896+0000 7faeb5600640 1 -- 172.21.15.175:0/3701400767 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faeb0010070 con 0x7faeb80ade60 2024-04-25T09:14:08.042 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.056+0000 7faebf800640 1 -- 172.21.15.175:0/3701400767 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faeb80b2370 con 0x7faeb80ade60 2024-04-25T09:14:08.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.056+0000 7faeb5600640 1 -- 172.21.15.175:0/3701400767 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16663 (secure 0 0 0) 0x7faeb0055bf0 con 0x7faeb80ade60 2024-04-25T09:14:08.044 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:08.044 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":113,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:14:05.335790+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:14:01.413477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:14:02.699273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:14:08.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.060+0000 7faebf800640 1 -- 172.21.15.175:0/3701400767 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fae94066f90 msgr2=0x7fae94069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:08.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.060+0000 7faebf800640 1 --2- 172.21.15.175:0/3701400767 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fae94066f90 0x7fae94069450 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7faea80af000 tx=0x7faea80a7000 comp rx=0 tx=0).stop 2024-04-25T09:14:08.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.060+0000 7faebf800640 1 -- 172.21.15.175:0/3701400767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb80ade60 msgr2=0x7faeb814da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:08.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.060+0000 7faebf800640 1 --2- 172.21.15.175:0/3701400767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb80ade60 0x7faeb814da30 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7faeb0007ef0 tx=0x7faeb000d4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.060+0000 7faebf800640 1 -- 172.21.15.175:0/3701400767 shutdown_connections 2024-04-25T09:14:08.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.060+0000 7faebf800640 1 --2- 172.21.15.175:0/3701400767 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fae94066f90 0x7fae94069450 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.060+0000 7faebf800640 1 --2- 172.21.15.175:0/3701400767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faeb80ade60 0x7faeb814da30 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.060+0000 7faebf800640 1 --2- 172.21.15.175:0/3701400767 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faeb815a900 0x7faeb8155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.060+0000 7faebf800640 1 --2- 172.21.15.175:0/3701400767 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faeb80cf560 0x7faeb80af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.060+0000 7faebf800640 1 -- 172.21.15.175:0/3701400767 >> 172.21.15.175:0/3701400767 conn(0x7faeb80cd520 msgr2=0x7faeb806ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:08.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.060+0000 7faebf800640 1 -- 172.21.15.175:0/3701400767 shutdown_connections 2024-04-25T09:14:08.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.060+0000 7faebf800640 1 -- 172.21.15.175:0/3701400767 wait complete. 2024-04-25T09:14:08.065 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:14:08.065 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:14:08.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.212+0000 7f9ada800640 1 Processor -- start 2024-04-25T09:14:08.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.212+0000 7f9ada800640 1 -- start start 2024-04-25T09:14:08.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.216+0000 7f9ada800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f9ad415a900 0x7f9ad406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:08.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.216+0000 7f9ada800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ad40cd520 0x7f9ad40ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:08.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.216+0000 7f9ada800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ad40cf560 0x7f9ad40cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:08.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.216+0000 7f9ada800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad40cfef0 con 0x7f9ad40cd520 2024-04-25T09:14:08.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.216+0000 7f9ada800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad40cda00 con 0x7f9ad415a900 2024-04-25T09:14:08.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.216+0000 7f9ada800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad40cdce0 con 0x7f9ad40cf560 2024-04-25T09:14:08.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.216+0000 7f9acaa00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ad40cd520 0x7f9ad40ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:08.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.216+0000 7f9acaa00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ad40cd520 0x7f9ad40ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32882/0 (socket says 172.21.15.175:32882) 2024-04-25T09:14:08.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.216+0000 7f9acaa00640 1 -- 172.21.15.175:0/4156485458 learned_addr learned my addr 172.21.15.175:0/4156485458 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:08.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.216+0000 7f9acaa00640 1 -- 172.21.15.175:0/4156485458 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ad40cf560 msgr2=0x7f9ad40cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:08.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.216+0000 7f9acaa00640 1 --2- 172.21.15.175:0/4156485458 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ad40cf560 0x7f9ad40cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.216+0000 7f9ad3400640 1 --2- 172.21.15.175:0/4156485458 >> v2:172.21.15.177:3300/0 conn(0x7f9ad415a900 0x7f9ad406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:08.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.216+0000 7f9acaa00640 1 -- 172.21.15.175:0/4156485458 >> v2:172.21.15.177:3300/0 conn(0x7f9ad415a900 msgr2=0x7f9ad406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:08.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.216+0000 7f9acaa00640 1 --2- 172.21.15.175:0/4156485458 >> v2:172.21.15.177:3300/0 conn(0x7f9ad415a900 0x7f9ad406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.216+0000 7f9acaa00640 1 -- 172.21.15.175:0/4156485458 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad40cdfc0 con 0x7f9ad40cd520 2024-04-25T09:14:08.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.216+0000 7f9ad3400640 1 --2- 172.21.15.175:0/4156485458 >> v2:172.21.15.177:3300/0 conn(0x7f9ad415a900 0x7f9ad406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:08.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.220+0000 7f9acaa00640 1 --2- 172.21.15.175:0/4156485458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad40cd520 0x7f9ad40ceaa0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f9ad40b4c70 tx=0x7f9abc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4330acd154abbe0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:08.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.220+0000 7f9ad2a00640 1 -- 172.21.15.175:0/4156485458 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0aa610 con 0x7f9ad40cd520 2024-04-25T09:14:08.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.220+0000 7f9ad2a00640 1 -- 172.21.15.175:0/4156485458 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc0af070 con 0x7f9ad40cd520 2024-04-25T09:14:08.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.220+0000 7f9ad2a00640 1 -- 172.21.15.175:0/4156485458 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0aa9d0 con 0x7f9ad40cd520 2024-04-25T09:14:08.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.220+0000 7f9ada800640 1 -- 172.21.15.175:0/4156485458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad40cd520 msgr2=0x7f9ad40ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:08.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.220+0000 7f9ada800640 1 --2- 172.21.15.175:0/4156485458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad40cd520 0x7f9ad40ceaa0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f9ad40b4c70 tx=0x7f9abc01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.220+0000 7f9ada800640 1 -- 172.21.15.175:0/4156485458 shutdown_connections 2024-04-25T09:14:08.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.220+0000 7f9ada800640 1 --2- 172.21.15.175:0/4156485458 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ad40cf560 0x7f9ad40cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.220+0000 7f9ada800640 1 --2- 172.21.15.175:0/4156485458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad40cd520 0x7f9ad40ceaa0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.220+0000 7f9ada800640 1 --2- 172.21.15.175:0/4156485458 >> v2:172.21.15.177:3300/0 conn(0x7f9ad415a900 0x7f9ad406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.220+0000 7f9ada800640 1 -- 172.21.15.175:0/4156485458 >> 172.21.15.175:0/4156485458 conn(0x7f9ad4067150 msgr2=0x7f9ad406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:08.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.220+0000 7f9ada800640 1 -- 172.21.15.175:0/4156485458 shutdown_connections 2024-04-25T09:14:08.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.220+0000 7f9ada800640 1 -- 172.21.15.175:0/4156485458 wait complete. 2024-04-25T09:14:08.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.220+0000 7f9ada800640 1 Processor -- start 2024-04-25T09:14:08.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.220+0000 7f9ada800640 1 -- start start 2024-04-25T09:14:08.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9ada800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ad40cf560 0x7f9ad4154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:08.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9ada800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad415a900 0x7f9ad4144e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:08.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9ada800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ad41511b0 0x7f9ad41569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:08.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9ada800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad406d530 con 0x7f9ad415a900 2024-04-25T09:14:08.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9ada800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad406d3b0 con 0x7f9ad41511b0 2024-04-25T09:14:08.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9ada800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad415c790 con 0x7f9ad40cf560 2024-04-25T09:14:08.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9acaa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad415a900 0x7f9ad4144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:08.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9acaa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad415a900 0x7f9ad4144e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32888/0 (socket says 172.21.15.175:32888) 2024-04-25T09:14:08.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9acaa00640 1 -- 172.21.15.175:0/1291443186 learned_addr learned my addr 172.21.15.175:0/1291443186 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:08.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9ad3400640 1 --2- 172.21.15.175:0/1291443186 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ad40cf560 0x7f9ad4154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:08.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9ad3e00640 1 --2- 172.21.15.175:0/1291443186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ad41511b0 0x7f9ad41569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:08.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9acaa00640 1 -- 172.21.15.175:0/1291443186 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ad40cf560 msgr2=0x7f9ad4154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:08.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9acaa00640 1 --2- 172.21.15.175:0/1291443186 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ad40cf560 0x7f9ad4154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9acaa00640 1 -- 172.21.15.175:0/1291443186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ad41511b0 msgr2=0x7f9ad41569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:08.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9acaa00640 1 --2- 172.21.15.175:0/1291443186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ad41511b0 0x7f9ad41569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9acaa00640 1 -- 172.21.15.175:0/1291443186 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad41533f0 con 0x7f9ad415a900 2024-04-25T09:14:08.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9ad3e00640 1 --2- 172.21.15.175:0/1291443186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ad41511b0 0x7f9ad41569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:08.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9acaa00640 1 --2- 172.21.15.175:0/1291443186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad415a900 0x7f9ad4144e80 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0ac040 tx=0x7f9abc01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:08.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9acbe00640 1 -- 172.21.15.175:0/1291443186 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0b3600 con 0x7f9ad415a900 2024-04-25T09:14:08.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9acbe00640 1 -- 172.21.15.175:0/1291443186 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc0b37c0 con 0x7f9ad415a900 2024-04-25T09:14:08.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9acbe00640 1 -- 172.21.15.175:0/1291443186 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0b3bb0 con 0x7f9ad415a900 2024-04-25T09:14:08.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9ada800640 1 -- 172.21.15.175:0/1291443186 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad4154e70 con 0x7f9ad415a900 2024-04-25T09:14:08.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9ada800640 1 -- 172.21.15.175:0/1291443186 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad40b07e0 con 0x7f9ad415a900 2024-04-25T09:14:08.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9ada800640 1 -- 172.21.15.175:0/1291443186 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad4074a60 con 0x7f9ad415a900 2024-04-25T09:14:08.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.224+0000 7f9acbe00640 1 -- 172.21.15.175:0/1291443186 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9abc0b2380 con 0x7f9ad415a900 2024-04-25T09:14:08.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.228+0000 7f9acbe00640 1 --2- 172.21.15.175:0/1291443186 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9ab0066f90 0x7f9ab0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:08.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.228+0000 7f9acbe00640 1 -- 172.21.15.175:0/1291443186 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9abc11f060 con 0x7f9ad415a900 2024-04-25T09:14:08.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.228+0000 7f9ad3400640 1 --2- 172.21.15.175:0/1291443186 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9ab0066f90 0x7f9ab0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:08.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.228+0000 7f9ad3400640 1 --2- 172.21.15.175:0/1291443186 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9ab0066f90 0x7f9ab0069450 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4006fd0 tx=0x7f9ac4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:08.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.232+0000 7f9acbe00640 1 -- 172.21.15.175:0/1291443186 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9abc0a7070 con 0x7f9ad415a900 2024-04-25T09:14:08.372 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.384+0000 7f9ada800640 1 -- 172.21.15.175:0/1291443186 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ad4159570 con 0x7f9ab0066f90 2024-04-25T09:14:08.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.392+0000 7f9acbe00640 1 -- 172.21.15.175:0/1291443186 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252483 (secure 0 0 0) 0x7f9ad4159570 con 0x7f9ab0066f90 2024-04-25T09:14:08.382 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:08.383 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:14:08.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.396+0000 7f9ada800640 1 -- 172.21.15.175:0/1291443186 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9ab0066f90 msgr2=0x7f9ab0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:08.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.396+0000 7f9ada800640 1 --2- 172.21.15.175:0/1291443186 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9ab0066f90 0x7f9ab0069450 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4006fd0 tx=0x7f9ac4008040 comp rx=0 tx=0).stop 2024-04-25T09:14:08.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.396+0000 7f9ada800640 1 -- 172.21.15.175:0/1291443186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad415a900 msgr2=0x7f9ad4144e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:08.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.396+0000 7f9ada800640 1 --2- 172.21.15.175:0/1291443186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad415a900 0x7f9ad4144e80 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0ac040 tx=0x7f9abc01ad30 comp rx=0 tx=0).stop 2024-04-25T09:14:08.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.396+0000 7f9ada800640 1 -- 172.21.15.175:0/1291443186 shutdown_connections 2024-04-25T09:14:08.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.396+0000 7f9ada800640 1 --2- 172.21.15.175:0/1291443186 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9ab0066f90 0x7f9ab0069450 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.396+0000 7f9ada800640 1 --2- 172.21.15.175:0/1291443186 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ad41511b0 0x7f9ad41569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.396+0000 7f9ada800640 1 --2- 172.21.15.175:0/1291443186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ad415a900 0x7f9ad4144e80 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.396+0000 7f9ada800640 1 --2- 172.21.15.175:0/1291443186 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ad40cf560 0x7f9ad4154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.396+0000 7f9ada800640 1 -- 172.21.15.175:0/1291443186 >> 172.21.15.175:0/1291443186 conn(0x7f9ad40cd520 msgr2=0x7f9ad415d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:08.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.396+0000 7f9ada800640 1 -- 172.21.15.175:0/1291443186 shutdown_connections 2024-04-25T09:14:08.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.396+0000 7f9ada800640 1 -- 172.21.15.175:0/1291443186 wait complete. 2024-04-25T09:14:08.402 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":411,"stamp":"2024-04-25T09:14:07.928821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261672,"kb_used_data":12200,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713048,"statfs":{"total":773094113280,"available":772826161152,"internally_reserved":0,"allocated":12492800,"data_stored":6066492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.620021"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215365+0000","last_change":"2024-04-25T09:14:04.349640+0000","last_active":"2024-04-25T09:14:06.215365+0000","last_peered":"2024-04-25T09:14:06.215365+0000","last_clean":"2024-04-25T09:14:06.215365+0000","last_became_active":"2024-04-25T09:14:04.349397+0000","last_became_peered":"2024-04-25T09:14:04.349397+0000","last_unstale":"2024-04-25T09:14:06.215365+0000","last_undegraded":"2024-04-25T09:14:06.215365+0000","last_fullsized":"2024-04-25T09:14:06.215365+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:00.660762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359611+0000","last_change":"2024-04-25T09:14:04.357484+0000","last_active":"2024-04-25T09:14:05.359611+0000","last_peered":"2024-04-25T09:14:05.359611+0000","last_clean":"2024-04-25T09:14:05.359611+0000","last_became_active":"2024-04-25T09:14:04.357215+0000","last_became_peered":"2024-04-25T09:14:04.357215+0000","last_unstale":"2024-04-25T09:14:05.359611+0000","last_undegraded":"2024-04-25T09:14:05.359611+0000","last_fullsized":"2024-04-25T09:14:05.359611+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:51.542126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981311+0000","last_change":"2024-04-25T09:14:04.352702+0000","last_active":"2024-04-25T09:14:05.981311+0000","last_peered":"2024-04-25T09:14:05.981311+0000","last_clean":"2024-04-25T09:14:05.981311+0000","last_became_active":"2024-04-25T09:14:04.352336+0000","last_became_peered":"2024-04-25T09:14:04.352336+0000","last_unstale":"2024-04-25T09:14:05.981311+0000","last_undegraded":"2024-04-25T09:14:05.981311+0000","last_fullsized":"2024-04-25T09:14:05.981311+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:29.594157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214489+0000","last_change":"2024-04-25T09:14:04.345453+0000","last_active":"2024-04-25T09:14:06.214489+0000","last_peered":"2024-04-25T09:14:06.214489+0000","last_clean":"2024-04-25T09:14:06.214489+0000","last_became_active":"2024-04-25T09:14:04.343260+0000","last_became_peered":"2024-04-25T09:14:04.343260+0000","last_unstale":"2024-04-25T09:14:06.214489+0000","last_undegraded":"2024-04-25T09:14:06.214489+0000","last_fullsized":"2024-04-25T09:14:06.214489+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:57.353751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.351738+0000","last_change":"2024-04-25T09:14:04.354054+0000","last_active":"2024-04-25T09:14:05.351738+0000","last_peered":"2024-04-25T09:14:05.351738+0000","last_clean":"2024-04-25T09:14:05.351738+0000","last_became_active":"2024-04-25T09:14:04.353720+0000","last_became_peered":"2024-04-25T09:14:04.353720+0000","last_unstale":"2024-04-25T09:14:05.351738+0000","last_undegraded":"2024-04-25T09:14:05.351738+0000","last_fullsized":"2024-04-25T09:14:05.351738+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:27.573207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214006+0000","last_change":"2024-04-25T09:14:04.339749+0000","last_active":"2024-04-25T09:14:06.214006+0000","last_peered":"2024-04-25T09:14:06.214006+0000","last_clean":"2024-04-25T09:14:06.214006+0000","last_became_active":"2024-04-25T09:14:04.339447+0000","last_became_peered":"2024-04-25T09:14:04.339447+0000","last_unstale":"2024-04-25T09:14:06.214006+0000","last_undegraded":"2024-04-25T09:14:06.214006+0000","last_fullsized":"2024-04-25T09:14:06.214006+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:16.736437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.363932+0000","last_change":"2024-04-25T09:14:04.350344+0000","last_active":"2024-04-25T09:14:05.363932+0000","last_peered":"2024-04-25T09:14:05.363932+0000","last_clean":"2024-04-25T09:14:05.363932+0000","last_became_active":"2024-04-25T09:14:04.348532+0000","last_became_peered":"2024-04-25T09:14:04.348532+0000","last_unstale":"2024-04-25T09:14:05.363932+0000","last_undegraded":"2024-04-25T09:14:05.363932+0000","last_fullsized":"2024-04-25T09:14:05.363932+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:28.737624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.980921+0000","last_change":"2024-04-25T09:14:04.353963+0000","last_active":"2024-04-25T09:14:05.980921+0000","last_peered":"2024-04-25T09:14:05.980921+0000","last_clean":"2024-04-25T09:14:05.980921+0000","last_became_active":"2024-04-25T09:14:04.353608+0000","last_became_peered":"2024-04-25T09:14:04.353608+0000","last_unstale":"2024-04-25T09:14:05.980921+0000","last_undegraded":"2024-04-25T09:14:05.980921+0000","last_fullsized":"2024-04-25T09:14:05.980921+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:17.459359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215617+0000","last_change":"2024-04-25T09:14:04.362008+0000","last_active":"2024-04-25T09:14:06.215617+0000","last_peered":"2024-04-25T09:14:06.215617+0000","last_clean":"2024-04-25T09:14:06.215617+0000","last_became_active":"2024-04-25T09:14:04.361685+0000","last_became_peered":"2024-04-25T09:14:04.361685+0000","last_unstale":"2024-04-25T09:14:06.215617+0000","last_undegraded":"2024-04-25T09:14:06.215617+0000","last_fullsized":"2024-04-25T09:14:06.215617+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:23.528251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214992+0000","last_change":"2024-04-25T09:14:04.352615+0000","last_active":"2024-04-25T09:14:06.214992+0000","last_peered":"2024-04-25T09:14:06.214992+0000","last_clean":"2024-04-25T09:14:06.214992+0000","last_became_active":"2024-04-25T09:14:04.352345+0000","last_became_peered":"2024-04-25T09:14:04.352345+0000","last_unstale":"2024-04-25T09:14:06.214992+0000","last_undegraded":"2024-04-25T09:14:06.214992+0000","last_fullsized":"2024-04-25T09:14:06.214992+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:24.201102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359294+0000","last_change":"2024-04-25T09:14:04.347825+0000","last_active":"2024-04-25T09:14:05.359294+0000","last_peered":"2024-04-25T09:14:05.359294+0000","last_clean":"2024-04-25T09:14:05.359294+0000","last_became_active":"2024-04-25T09:14:04.347528+0000","last_became_peered":"2024-04-25T09:14:04.347528+0000","last_unstale":"2024-04-25T09:14:05.359294+0000","last_undegraded":"2024-04-25T09:14:05.359294+0000","last_fullsized":"2024-04-25T09:14:05.359294+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:26.620114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214549+0000","last_change":"2024-04-25T09:14:04.347446+0000","last_active":"2024-04-25T09:14:06.214549+0000","last_peered":"2024-04-25T09:14:06.214549+0000","last_clean":"2024-04-25T09:14:06.214549+0000","last_became_active":"2024-04-25T09:14:04.347068+0000","last_became_peered":"2024-04-25T09:14:04.347068+0000","last_unstale":"2024-04-25T09:14:06.214549+0000","last_undegraded":"2024-04-25T09:14:06.214549+0000","last_fullsized":"2024-04-25T09:14:06.214549+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:13.891688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981189+0000","last_change":"2024-04-25T09:14:04.355734+0000","last_active":"2024-04-25T09:14:05.981189+0000","last_peered":"2024-04-25T09:14:05.981189+0000","last_clean":"2024-04-25T09:14:05.981189+0000","last_became_active":"2024-04-25T09:14:04.355417+0000","last_became_peered":"2024-04-25T09:14:04.355417+0000","last_unstale":"2024-04-25T09:14:05.981189+0000","last_undegraded":"2024-04-25T09:14:05.981189+0000","last_fullsized":"2024-04-25T09:14:05.981189+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:30.932981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981301+0000","last_change":"2024-04-25T09:14:04.352285+0000","last_active":"2024-04-25T09:14:05.981301+0000","last_peered":"2024-04-25T09:14:05.981301+0000","last_clean":"2024-04-25T09:14:05.981301+0000","last_became_active":"2024-04-25T09:14:04.351875+0000","last_became_peered":"2024-04-25T09:14:04.351875+0000","last_unstale":"2024-04-25T09:14:05.981301+0000","last_undegraded":"2024-04-25T09:14:05.981301+0000","last_fullsized":"2024-04-25T09:14:05.981301+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:50.265315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213848+0000","last_change":"2024-04-25T09:14:04.339660+0000","last_active":"2024-04-25T09:14:06.213848+0000","last_peered":"2024-04-25T09:14:06.213848+0000","last_clean":"2024-04-25T09:14:06.213848+0000","last_became_active":"2024-04-25T09:14:04.339385+0000","last_became_peered":"2024-04-25T09:14:04.339385+0000","last_unstale":"2024-04-25T09:14:06.213848+0000","last_undegraded":"2024-04-25T09:14:06.213848+0000","last_fullsized":"2024-04-25T09:14:06.213848+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.115971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213425+0000","last_change":"2024-04-25T09:14:04.349905+0000","last_active":"2024-04-25T09:14:06.213425+0000","last_peered":"2024-04-25T09:14:06.213425+0000","last_clean":"2024-04-25T09:14:06.213425+0000","last_became_active":"2024-04-25T09:14:04.349574+0000","last_became_peered":"2024-04-25T09:14:04.349574+0000","last_unstale":"2024-04-25T09:14:06.213425+0000","last_undegraded":"2024-04-25T09:14:06.213425+0000","last_fullsized":"2024-04-25T09:14:06.213425+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:25.685132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359608+0000","last_change":"2024-04-25T09:14:04.349402+0000","last_active":"2024-04-25T09:14:05.359608+0000","last_peered":"2024-04-25T09:14:05.359608+0000","last_clean":"2024-04-25T09:14:05.359608+0000","last_became_active":"2024-04-25T09:14:04.348802+0000","last_became_peered":"2024-04-25T09:14:04.348802+0000","last_unstale":"2024-04-25T09:14:05.359608+0000","last_undegraded":"2024-04-25T09:14:05.359608+0000","last_fullsized":"2024-04-25T09:14:05.359608+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:50.265315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.361021+0000","last_change":"2024-04-25T09:14:04.350196+0000","last_active":"2024-04-25T09:14:05.361021+0000","last_peered":"2024-04-25T09:14:05.361021+0000","last_clean":"2024-04-25T09:14:05.361021+0000","last_became_active":"2024-04-25T09:14:04.349804+0000","last_became_peered":"2024-04-25T09:14:04.349804+0000","last_unstale":"2024-04-25T09:14:05.361021+0000","last_undegraded":"2024-04-25T09:14:05.361021+0000","last_fullsized":"2024-04-25T09:14:05.361021+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:39.968424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981332+0000","last_change":"2024-04-25T09:14:04.355417+0000","last_active":"2024-04-25T09:14:05.981332+0000","last_peered":"2024-04-25T09:14:05.981332+0000","last_clean":"2024-04-25T09:14:05.981332+0000","last_became_active":"2024-04-25T09:14:04.355028+0000","last_became_peered":"2024-04-25T09:14:04.355028+0000","last_unstale":"2024-04-25T09:14:05.981332+0000","last_undegraded":"2024-04-25T09:14:05.981332+0000","last_fullsized":"2024-04-25T09:14:05.981332+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:48.137180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359384+0000","last_change":"2024-04-25T09:14:04.356353+0000","last_active":"2024-04-25T09:14:05.359384+0000","last_peered":"2024-04-25T09:14:05.359384+0000","last_clean":"2024-04-25T09:14:05.359384+0000","last_became_active":"2024-04-25T09:14:04.355955+0000","last_became_peered":"2024-04-25T09:14:04.355955+0000","last_unstale":"2024-04-25T09:14:05.359384+0000","last_undegraded":"2024-04-25T09:14:05.359384+0000","last_fullsized":"2024-04-25T09:14:05.359384+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:17.568255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359551+0000","last_change":"2024-04-25T09:14:04.350659+0000","last_active":"2024-04-25T09:14:05.359551+0000","last_peered":"2024-04-25T09:14:05.359551+0000","last_clean":"2024-04-25T09:14:05.359551+0000","last_became_active":"2024-04-25T09:14:04.350361+0000","last_became_peered":"2024-04-25T09:14:04.350361+0000","last_unstale":"2024-04-25T09:14:05.359551+0000","last_undegraded":"2024-04-25T09:14:05.359551+0000","last_fullsized":"2024-04-25T09:14:05.359551+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:17.459359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214989+0000","last_change":"2024-04-25T09:14:04.338714+0000","last_active":"2024-04-25T09:14:06.214989+0000","last_peered":"2024-04-25T09:14:06.214989+0000","last_clean":"2024-04-25T09:14:06.214989+0000","last_became_active":"2024-04-25T09:14:04.335537+0000","last_became_peered":"2024-04-25T09:14:04.335537+0000","last_unstale":"2024-04-25T09:14:06.214989+0000","last_undegraded":"2024-04-25T09:14:06.214989+0000","last_fullsized":"2024-04-25T09:14:06.214989+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:32.785404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359246+0000","last_change":"2024-04-25T09:14:04.354066+0000","last_active":"2024-04-25T09:14:05.359246+0000","last_peered":"2024-04-25T09:14:05.359246+0000","last_clean":"2024-04-25T09:14:05.359246+0000","last_became_active":"2024-04-25T09:14:04.353800+0000","last_became_peered":"2024-04-25T09:14:04.353800+0000","last_unstale":"2024-04-25T09:14:05.359246+0000","last_undegraded":"2024-04-25T09:14:05.359246+0000","last_fullsized":"2024-04-25T09:14:05.359246+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:34.607766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213507+0000","last_change":"2024-04-25T09:14:04.356539+0000","last_active":"2024-04-25T09:14:06.213507+0000","last_peered":"2024-04-25T09:14:06.213507+0000","last_clean":"2024-04-25T09:14:06.213507+0000","last_became_active":"2024-04-25T09:14:04.355966+0000","last_became_peered":"2024-04-25T09:14:04.355966+0000","last_unstale":"2024-04-25T09:14:06.213507+0000","last_undegraded":"2024-04-25T09:14:06.213507+0000","last_fullsized":"2024-04-25T09:14:06.213507+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:30.932981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359738+0000","last_change":"2024-04-25T09:14:04.349179+0000","last_active":"2024-04-25T09:14:05.359738+0000","last_peered":"2024-04-25T09:14:05.359738+0000","last_clean":"2024-04-25T09:14:05.359738+0000","last_became_active":"2024-04-25T09:14:04.348452+0000","last_became_peered":"2024-04-25T09:14:04.348452+0000","last_unstale":"2024-04-25T09:14:05.359738+0000","last_undegraded":"2024-04-25T09:14:05.359738+0000","last_fullsized":"2024-04-25T09:14:05.359738+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:20.531294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215157+0000","last_change":"2024-04-25T09:14:04.348816+0000","last_active":"2024-04-25T09:14:06.215157+0000","last_peered":"2024-04-25T09:14:06.215157+0000","last_clean":"2024-04-25T09:14:06.215157+0000","last_became_active":"2024-04-25T09:14:04.348528+0000","last_became_peered":"2024-04-25T09:14:04.348528+0000","last_unstale":"2024-04-25T09:14:06.215157+0000","last_undegraded":"2024-04-25T09:14:06.215157+0000","last_fullsized":"2024-04-25T09:14:06.215157+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:37.205818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215329+0000","last_change":"2024-04-25T09:14:04.341287+0000","last_active":"2024-04-25T09:14:06.215329+0000","last_peered":"2024-04-25T09:14:06.215329+0000","last_clean":"2024-04-25T09:14:06.215329+0000","last_became_active":"2024-04-25T09:14:04.340957+0000","last_became_peered":"2024-04-25T09:14:04.340957+0000","last_unstale":"2024-04-25T09:14:06.215329+0000","last_undegraded":"2024-04-25T09:14:06.215329+0000","last_fullsized":"2024-04-25T09:14:06.215329+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:26.876939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214419+0000","last_change":"2024-04-25T09:14:04.345989+0000","last_active":"2024-04-25T09:14:06.214419+0000","last_peered":"2024-04-25T09:14:06.214419+0000","last_clean":"2024-04-25T09:14:06.214419+0000","last_became_active":"2024-04-25T09:14:04.345581+0000","last_became_peered":"2024-04-25T09:14:04.345581+0000","last_unstale":"2024-04-25T09:14:06.214419+0000","last_undegraded":"2024-04-25T09:14:06.214419+0000","last_fullsized":"2024-04-25T09:14:06.214419+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:48.137180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359104+0000","last_change":"2024-04-25T09:14:04.358412+0000","last_active":"2024-04-25T09:14:05.359104+0000","last_peered":"2024-04-25T09:14:05.359104+0000","last_clean":"2024-04-25T09:14:05.359104+0000","last_became_active":"2024-04-25T09:14:04.357528+0000","last_became_peered":"2024-04-25T09:14:04.357528+0000","last_unstale":"2024-04-25T09:14:05.359104+0000","last_undegraded":"2024-04-25T09:14:05.359104+0000","last_fullsized":"2024-04-25T09:14:05.359104+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:48.065212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.363974+0000","last_change":"2024-04-25T09:14:04.360854+0000","last_active":"2024-04-25T09:14:05.363974+0000","last_peered":"2024-04-25T09:14:05.363974+0000","last_clean":"2024-04-25T09:14:05.363974+0000","last_became_active":"2024-04-25T09:14:04.360555+0000","last_became_peered":"2024-04-25T09:14:04.360555+0000","last_unstale":"2024-04-25T09:14:05.363974+0000","last_undegraded":"2024-04-25T09:14:05.363974+0000","last_fullsized":"2024-04-25T09:14:05.363974+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:47.112959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213341+0000","last_change":"2024-04-25T09:14:04.348633+0000","last_active":"2024-04-25T09:14:06.213341+0000","last_peered":"2024-04-25T09:14:06.213341+0000","last_clean":"2024-04-25T09:14:06.213341+0000","last_became_active":"2024-04-25T09:14:04.348361+0000","last_became_peered":"2024-04-25T09:14:04.348361+0000","last_unstale":"2024-04-25T09:14:06.213341+0000","last_undegraded":"2024-04-25T09:14:06.213341+0000","last_fullsized":"2024-04-25T09:14:06.213341+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:53.036313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213463+0000","last_change":"2024-04-25T09:14:04.358456+0000","last_active":"2024-04-25T09:14:06.213463+0000","last_peered":"2024-04-25T09:14:06.213463+0000","last_clean":"2024-04-25T09:14:06.213463+0000","last_became_active":"2024-04-25T09:14:04.354146+0000","last_became_peered":"2024-04-25T09:14:04.354146+0000","last_unstale":"2024-04-25T09:14:06.213463+0000","last_undegraded":"2024-04-25T09:14:06.213463+0000","last_fullsized":"2024-04-25T09:14:06.213463+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:34.308491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215399+0000","last_change":"2024-04-25T09:14:04.348260+0000","last_active":"2024-04-25T09:14:06.215399+0000","last_peered":"2024-04-25T09:14:06.215399+0000","last_clean":"2024-04-25T09:14:06.215399+0000","last_became_active":"2024-04-25T09:14:04.347958+0000","last_became_peered":"2024-04-25T09:14:04.347958+0000","last_unstale":"2024-04-25T09:14:06.215399+0000","last_undegraded":"2024-04-25T09:14:06.215399+0000","last_fullsized":"2024-04-25T09:14:06.215399+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:54.254146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"112'4","reported_seq":18,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.363963+0000","last_change":"2024-04-25T09:14:03.335161+0000","last_active":"2024-04-25T09:14:05.363963+0000","last_peered":"2024-04-25T09:14:05.363963+0000","last_clean":"2024-04-25T09:14:05.363963+0000","last_became_active":"2024-04-25T09:14:03.334803+0000","last_became_peered":"2024-04-25T09:14:03.334803+0000","last_unstale":"2024-04-25T09:14:05.363963+0000","last_undegraded":"2024-04-25T09:14:05.363963+0000","last_fullsized":"2024-04-25T09:14:05.363963+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:23.502103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.361282+0000","last_change":"2024-04-25T09:14:04.354215+0000","last_active":"2024-04-25T09:14:05.361282+0000","last_peered":"2024-04-25T09:14:05.361282+0000","last_clean":"2024-04-25T09:14:05.361282+0000","last_became_active":"2024-04-25T09:14:04.353929+0000","last_became_peered":"2024-04-25T09:14:04.353929+0000","last_unstale":"2024-04-25T09:14:05.361282+0000","last_undegraded":"2024-04-25T09:14:05.361282+0000","last_fullsized":"2024-04-25T09:14:05.361282+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:40.578140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981007+0000","last_change":"2024-04-25T09:14:03.331912+0000","last_active":"2024-04-25T09:14:05.981007+0000","last_peered":"2024-04-25T09:14:05.981007+0000","last_clean":"2024-04-25T09:14:05.981007+0000","last_became_active":"2024-04-25T09:14:03.331502+0000","last_became_peered":"2024-04-25T09:14:03.331502+0000","last_unstale":"2024-04-25T09:14:05.981007+0000","last_undegraded":"2024-04-25T09:14:05.981007+0000","last_fullsized":"2024-04-25T09:14:05.981007+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:39.871283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215145+0000","last_change":"2024-04-25T09:14:04.357546+0000","last_active":"2024-04-25T09:14:06.215145+0000","last_peered":"2024-04-25T09:14:06.215145+0000","last_clean":"2024-04-25T09:14:06.215145+0000","last_became_active":"2024-04-25T09:14:04.352629+0000","last_became_peered":"2024-04-25T09:14:04.352629+0000","last_unstale":"2024-04-25T09:14:06.215145+0000","last_undegraded":"2024-04-25T09:14:06.215145+0000","last_fullsized":"2024-04-25T09:14:06.215145+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:55.006416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.351752+0000","last_change":"2024-04-25T09:14:03.337144+0000","last_active":"2024-04-25T09:14:05.351752+0000","last_peered":"2024-04-25T09:14:05.351752+0000","last_clean":"2024-04-25T09:14:05.351752+0000","last_became_active":"2024-04-25T09:14:03.336807+0000","last_became_peered":"2024-04-25T09:14:03.336807+0000","last_unstale":"2024-04-25T09:14:05.351752+0000","last_undegraded":"2024-04-25T09:14:05.351752+0000","last_fullsized":"2024-04-25T09:14:05.351752+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:16.484104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981438+0000","last_change":"2024-04-25T09:14:04.355715+0000","last_active":"2024-04-25T09:14:05.981438+0000","last_peered":"2024-04-25T09:14:05.981438+0000","last_clean":"2024-04-25T09:14:05.981438+0000","last_became_active":"2024-04-25T09:14:04.355140+0000","last_became_peered":"2024-04-25T09:14:04.355140+0000","last_unstale":"2024-04-25T09:14:05.981438+0000","last_undegraded":"2024-04-25T09:14:05.981438+0000","last_fullsized":"2024-04-25T09:14:05.981438+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:07.353763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.351626+0000","last_change":"2024-04-25T09:14:03.337189+0000","last_active":"2024-04-25T09:14:05.351626+0000","last_peered":"2024-04-25T09:14:05.351626+0000","last_clean":"2024-04-25T09:14:05.351626+0000","last_became_active":"2024-04-25T09:14:03.336861+0000","last_became_peered":"2024-04-25T09:14:03.336861+0000","last_unstale":"2024-04-25T09:14:05.351626+0000","last_undegraded":"2024-04-25T09:14:05.351626+0000","last_fullsized":"2024-04-25T09:14:05.351626+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:49.528252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213922+0000","last_change":"2024-04-25T09:14:04.341828+0000","last_active":"2024-04-25T09:14:06.213922+0000","last_peered":"2024-04-25T09:14:06.213922+0000","last_clean":"2024-04-25T09:14:06.213922+0000","last_became_active":"2024-04-25T09:14:04.341545+0000","last_became_peered":"2024-04-25T09:14:04.341545+0000","last_unstale":"2024-04-25T09:14:06.213922+0000","last_undegraded":"2024-04-25T09:14:06.213922+0000","last_fullsized":"2024-04-25T09:14:06.213922+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:37:04.008011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.363648+0000","last_change":"2024-04-25T09:14:03.339983+0000","last_active":"2024-04-25T09:14:05.363648+0000","last_peered":"2024-04-25T09:14:05.363648+0000","last_clean":"2024-04-25T09:14:05.363648+0000","last_became_active":"2024-04-25T09:14:03.339671+0000","last_became_peered":"2024-04-25T09:14:03.339671+0000","last_unstale":"2024-04-25T09:14:05.363648+0000","last_undegraded":"2024-04-25T09:14:05.363648+0000","last_fullsized":"2024-04-25T09:14:05.363648+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:36.271610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359375+0000","last_change":"2024-04-25T09:14:04.350695+0000","last_active":"2024-04-25T09:14:05.359375+0000","last_peered":"2024-04-25T09:14:05.359375+0000","last_clean":"2024-04-25T09:14:05.359375+0000","last_became_active":"2024-04-25T09:14:04.350424+0000","last_became_peered":"2024-04-25T09:14:04.350424+0000","last_unstale":"2024-04-25T09:14:05.359375+0000","last_undegraded":"2024-04-25T09:14:05.359375+0000","last_fullsized":"2024-04-25T09:14:05.359375+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:58.178701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214675+0000","last_change":"2024-04-25T09:14:03.319291+0000","last_active":"2024-04-25T09:14:06.214675+0000","last_peered":"2024-04-25T09:14:06.214675+0000","last_clean":"2024-04-25T09:14:06.214675+0000","last_became_active":"2024-04-25T09:14:03.318990+0000","last_became_peered":"2024-04-25T09:14:03.318990+0000","last_unstale":"2024-04-25T09:14:06.214675+0000","last_undegraded":"2024-04-25T09:14:06.214675+0000","last_fullsized":"2024-04-25T09:14:06.214675+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:47.056967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213275+0000","last_change":"2024-04-25T09:14:04.343993+0000","last_active":"2024-04-25T09:14:06.213275+0000","last_peered":"2024-04-25T09:14:06.213275+0000","last_clean":"2024-04-25T09:14:06.213275+0000","last_became_active":"2024-04-25T09:14:04.343538+0000","last_became_peered":"2024-04-25T09:14:04.343538+0000","last_unstale":"2024-04-25T09:14:06.213275+0000","last_undegraded":"2024-04-25T09:14:06.213275+0000","last_fullsized":"2024-04-25T09:14:06.213275+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:55.451368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.358864+0000","last_change":"2024-04-25T09:14:03.325113+0000","last_active":"2024-04-25T09:14:05.358864+0000","last_peered":"2024-04-25T09:14:05.358864+0000","last_clean":"2024-04-25T09:14:05.358864+0000","last_became_active":"2024-04-25T09:14:03.324710+0000","last_became_peered":"2024-04-25T09:14:03.324710+0000","last_unstale":"2024-04-25T09:14:05.358864+0000","last_undegraded":"2024-04-25T09:14:05.358864+0000","last_fullsized":"2024-04-25T09:14:05.358864+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:25.021792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.363728+0000","last_change":"2024-04-25T09:14:04.351818+0000","last_active":"2024-04-25T09:14:05.363728+0000","last_peered":"2024-04-25T09:14:05.363728+0000","last_clean":"2024-04-25T09:14:05.363728+0000","last_became_active":"2024-04-25T09:14:04.351518+0000","last_became_peered":"2024-04-25T09:14:04.351518+0000","last_unstale":"2024-04-25T09:14:05.363728+0000","last_undegraded":"2024-04-25T09:14:05.363728+0000","last_fullsized":"2024-04-25T09:14:05.363728+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:49.541041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213332+0000","last_change":"2024-04-25T09:14:03.340681+0000","last_active":"2024-04-25T09:14:06.213332+0000","last_peered":"2024-04-25T09:14:06.213332+0000","last_clean":"2024-04-25T09:14:06.213332+0000","last_became_active":"2024-04-25T09:14:03.339982+0000","last_became_peered":"2024-04-25T09:14:03.339982+0000","last_unstale":"2024-04-25T09:14:06.213332+0000","last_undegraded":"2024-04-25T09:14:06.213332+0000","last_fullsized":"2024-04-25T09:14:06.213332+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:25.611869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.364067+0000","last_change":"2024-04-25T09:14:04.359561+0000","last_active":"2024-04-25T09:14:05.364067+0000","last_peered":"2024-04-25T09:14:05.364067+0000","last_clean":"2024-04-25T09:14:05.364067+0000","last_became_active":"2024-04-25T09:14:04.359060+0000","last_became_peered":"2024-04-25T09:14:04.359060+0000","last_unstale":"2024-04-25T09:14:05.364067+0000","last_undegraded":"2024-04-25T09:14:05.364067+0000","last_fullsized":"2024-04-25T09:14:05.364067+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:45.983328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.351864+0000","last_change":"2024-04-25T09:14:03.342321+0000","last_active":"2024-04-25T09:14:05.351864+0000","last_peered":"2024-04-25T09:14:05.351864+0000","last_clean":"2024-04-25T09:14:05.351864+0000","last_became_active":"2024-04-25T09:14:03.341934+0000","last_became_peered":"2024-04-25T09:14:03.341934+0000","last_unstale":"2024-04-25T09:14:05.351864+0000","last_undegraded":"2024-04-25T09:14:05.351864+0000","last_fullsized":"2024-04-25T09:14:05.351864+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:44.763298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.361289+0000","last_change":"2024-04-25T09:14:04.349376+0000","last_active":"2024-04-25T09:14:05.361289+0000","last_peered":"2024-04-25T09:14:05.361289+0000","last_clean":"2024-04-25T09:14:05.361289+0000","last_became_active":"2024-04-25T09:14:04.349078+0000","last_became_peered":"2024-04-25T09:14:04.349078+0000","last_unstale":"2024-04-25T09:14:05.361289+0000","last_undegraded":"2024-04-25T09:14:05.361289+0000","last_fullsized":"2024-04-25T09:14:05.361289+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:13.019189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214028+0000","last_change":"2024-04-25T09:14:03.324050+0000","last_active":"2024-04-25T09:14:06.214028+0000","last_peered":"2024-04-25T09:14:06.214028+0000","last_clean":"2024-04-25T09:14:06.214028+0000","last_became_active":"2024-04-25T09:14:03.323761+0000","last_became_peered":"2024-04-25T09:14:03.323761+0000","last_unstale":"2024-04-25T09:14:06.214028+0000","last_undegraded":"2024-04-25T09:14:06.214028+0000","last_fullsized":"2024-04-25T09:14:06.214028+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:21.789534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214611+0000","last_change":"2024-04-25T09:14:04.335719+0000","last_active":"2024-04-25T09:14:06.214611+0000","last_peered":"2024-04-25T09:14:06.214611+0000","last_clean":"2024-04-25T09:14:06.214611+0000","last_became_active":"2024-04-25T09:14:04.335420+0000","last_became_peered":"2024-04-25T09:14:04.335420+0000","last_unstale":"2024-04-25T09:14:06.214611+0000","last_undegraded":"2024-04-25T09:14:06.214611+0000","last_fullsized":"2024-04-25T09:14:06.214611+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:07.353763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"112'3","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214332+0000","last_change":"2024-04-25T09:14:03.337704+0000","last_active":"2024-04-25T09:14:06.214332+0000","last_peered":"2024-04-25T09:14:06.214332+0000","last_clean":"2024-04-25T09:14:06.214332+0000","last_became_active":"2024-04-25T09:14:03.337361+0000","last_became_peered":"2024-04-25T09:14:03.337361+0000","last_unstale":"2024-04-25T09:14:06.214332+0000","last_undegraded":"2024-04-25T09:14:06.214332+0000","last_fullsized":"2024-04-25T09:14:06.214332+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:16.560010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.363945+0000","last_change":"2024-04-25T09:14:04.355750+0000","last_active":"2024-04-25T09:14:05.363945+0000","last_peered":"2024-04-25T09:14:05.363945+0000","last_clean":"2024-04-25T09:14:05.363945+0000","last_became_active":"2024-04-25T09:14:04.355473+0000","last_became_peered":"2024-04-25T09:14:04.355473+0000","last_unstale":"2024-04-25T09:14:05.363945+0000","last_undegraded":"2024-04-25T09:14:05.363945+0000","last_fullsized":"2024-04-25T09:14:05.363945+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:50.297260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"112'6","reported_seq":20,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214907+0000","last_change":"2024-04-25T09:14:03.340179+0000","last_active":"2024-04-25T09:14:06.214907+0000","last_peered":"2024-04-25T09:14:06.214907+0000","last_clean":"2024-04-25T09:14:06.214907+0000","last_became_active":"2024-04-25T09:14:03.339870+0000","last_became_peered":"2024-04-25T09:14:03.339870+0000","last_unstale":"2024-04-25T09:14:06.214907+0000","last_undegraded":"2024-04-25T09:14:06.214907+0000","last_fullsized":"2024-04-25T09:14:06.214907+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:49.257070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214619+0000","last_change":"2024-04-25T09:14:04.352625+0000","last_active":"2024-04-25T09:14:06.214619+0000","last_peered":"2024-04-25T09:14:06.214619+0000","last_clean":"2024-04-25T09:14:06.214619+0000","last_became_active":"2024-04-25T09:14:04.352314+0000","last_became_peered":"2024-04-25T09:14:04.352314+0000","last_unstale":"2024-04-25T09:14:06.214619+0000","last_undegraded":"2024-04-25T09:14:06.214619+0000","last_fullsized":"2024-04-25T09:14:06.214619+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:52.318210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214617+0000","last_change":"2024-04-25T09:14:03.329992+0000","last_active":"2024-04-25T09:14:06.214617+0000","last_peered":"2024-04-25T09:14:06.214617+0000","last_clean":"2024-04-25T09:14:06.214617+0000","last_became_active":"2024-04-25T09:14:03.329562+0000","last_became_peered":"2024-04-25T09:14:03.329562+0000","last_unstale":"2024-04-25T09:14:06.214617+0000","last_undegraded":"2024-04-25T09:14:06.214617+0000","last_fullsized":"2024-04-25T09:14:06.214617+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:19.543443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214924+0000","last_change":"2024-04-25T09:14:04.356907+0000","last_active":"2024-04-25T09:14:06.214924+0000","last_peered":"2024-04-25T09:14:06.214924+0000","last_clean":"2024-04-25T09:14:06.214924+0000","last_became_active":"2024-04-25T09:14:04.355586+0000","last_became_peered":"2024-04-25T09:14:04.355586+0000","last_unstale":"2024-04-25T09:14:06.214924+0000","last_undegraded":"2024-04-25T09:14:06.214924+0000","last_fullsized":"2024-04-25T09:14:06.214924+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:34.372237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.360850+0000","last_change":"2024-04-25T09:14:03.337335+0000","last_active":"2024-04-25T09:14:05.360850+0000","last_peered":"2024-04-25T09:14:05.360850+0000","last_clean":"2024-04-25T09:14:05.360850+0000","last_became_active":"2024-04-25T09:14:03.336960+0000","last_became_peered":"2024-04-25T09:14:03.336960+0000","last_unstale":"2024-04-25T09:14:05.360850+0000","last_undegraded":"2024-04-25T09:14:05.360850+0000","last_fullsized":"2024-04-25T09:14:05.360850+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:16.941753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214414+0000","last_change":"2024-04-25T09:14:04.344204+0000","last_active":"2024-04-25T09:14:06.214414+0000","last_peered":"2024-04-25T09:14:06.214414+0000","last_clean":"2024-04-25T09:14:06.214414+0000","last_became_active":"2024-04-25T09:14:04.343872+0000","last_became_peered":"2024-04-25T09:14:04.343872+0000","last_unstale":"2024-04-25T09:14:06.214414+0000","last_undegraded":"2024-04-25T09:14:06.214414+0000","last_fullsized":"2024-04-25T09:14:06.214414+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:29.594157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"112'8","reported_seq":22,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.351468+0000","last_change":"2024-04-25T09:14:03.339734+0000","last_active":"2024-04-25T09:14:05.351468+0000","last_peered":"2024-04-25T09:14:05.351468+0000","last_clean":"2024-04-25T09:14:05.351468+0000","last_became_active":"2024-04-25T09:14:03.339219+0000","last_became_peered":"2024-04-25T09:14:03.339219+0000","last_unstale":"2024-04-25T09:14:05.351468+0000","last_undegraded":"2024-04-25T09:14:05.351468+0000","last_fullsized":"2024-04-25T09:14:05.351468+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:30:50.878791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.351981+0000","last_change":"2024-04-25T09:14:04.353665+0000","last_active":"2024-04-25T09:14:05.351981+0000","last_peered":"2024-04-25T09:14:05.351981+0000","last_clean":"2024-04-25T09:14:05.351981+0000","last_became_active":"2024-04-25T09:14:04.353370+0000","last_became_peered":"2024-04-25T09:14:04.353370+0000","last_unstale":"2024-04-25T09:14:05.351981+0000","last_undegraded":"2024-04-25T09:14:05.351981+0000","last_fullsized":"2024-04-25T09:14:05.351981+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:00.877922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215691+0000","last_change":"2024-04-25T09:14:03.335088+0000","last_active":"2024-04-25T09:14:06.215691+0000","last_peered":"2024-04-25T09:14:06.215691+0000","last_clean":"2024-04-25T09:14:06.215691+0000","last_became_active":"2024-04-25T09:14:03.334776+0000","last_became_peered":"2024-04-25T09:14:03.334776+0000","last_unstale":"2024-04-25T09:14:06.215691+0000","last_undegraded":"2024-04-25T09:14:06.215691+0000","last_fullsized":"2024-04-25T09:14:06.215691+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:50.533881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215405+0000","last_change":"2024-04-25T09:14:04.340292+0000","last_active":"2024-04-25T09:14:06.215405+0000","last_peered":"2024-04-25T09:14:06.215405+0000","last_clean":"2024-04-25T09:14:06.215405+0000","last_became_active":"2024-04-25T09:14:04.340036+0000","last_became_peered":"2024-04-25T09:14:04.340036+0000","last_unstale":"2024-04-25T09:14:06.215405+0000","last_undegraded":"2024-04-25T09:14:06.215405+0000","last_fullsized":"2024-04-25T09:14:06.215405+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:40.999679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.351913+0000","last_change":"2024-04-25T09:14:03.335889+0000","last_active":"2024-04-25T09:14:05.351913+0000","last_peered":"2024-04-25T09:14:05.351913+0000","last_clean":"2024-04-25T09:14:05.351913+0000","last_became_active":"2024-04-25T09:14:03.335633+0000","last_became_peered":"2024-04-25T09:14:03.335633+0000","last_unstale":"2024-04-25T09:14:05.351913+0000","last_undegraded":"2024-04-25T09:14:05.351913+0000","last_fullsized":"2024-04-25T09:14:05.351913+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:26.360637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981153+0000","last_change":"2024-04-25T09:14:04.361640+0000","last_active":"2024-04-25T09:14:05.981153+0000","last_peered":"2024-04-25T09:14:05.981153+0000","last_clean":"2024-04-25T09:14:05.981153+0000","last_became_active":"2024-04-25T09:14:04.361382+0000","last_became_peered":"2024-04-25T09:14:04.361382+0000","last_unstale":"2024-04-25T09:14:05.981153+0000","last_undegraded":"2024-04-25T09:14:05.981153+0000","last_fullsized":"2024-04-25T09:14:05.981153+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:20.531294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.360953+0000","last_change":"2024-04-25T09:14:03.322155+0000","last_active":"2024-04-25T09:14:05.360953+0000","last_peered":"2024-04-25T09:14:05.360953+0000","last_clean":"2024-04-25T09:14:05.360953+0000","last_became_active":"2024-04-25T09:14:03.321827+0000","last_became_peered":"2024-04-25T09:14:03.321827+0000","last_unstale":"2024-04-25T09:14:05.360953+0000","last_undegraded":"2024-04-25T09:14:05.360953+0000","last_fullsized":"2024-04-25T09:14:05.360953+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:00.958914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981442+0000","last_change":"2024-04-25T09:14:04.355335+0000","last_active":"2024-04-25T09:14:05.981442+0000","last_peered":"2024-04-25T09:14:05.981442+0000","last_clean":"2024-04-25T09:14:05.981442+0000","last_became_active":"2024-04-25T09:14:04.354688+0000","last_became_peered":"2024-04-25T09:14:04.354688+0000","last_unstale":"2024-04-25T09:14:05.981442+0000","last_undegraded":"2024-04-25T09:14:05.981442+0000","last_fullsized":"2024-04-25T09:14:05.981442+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:52.318210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.363673+0000","last_change":"2024-04-25T09:14:03.344644+0000","last_active":"2024-04-25T09:14:05.363673+0000","last_peered":"2024-04-25T09:14:05.363673+0000","last_clean":"2024-04-25T09:14:05.363673+0000","last_became_active":"2024-04-25T09:14:03.344378+0000","last_became_peered":"2024-04-25T09:14:03.344378+0000","last_unstale":"2024-04-25T09:14:05.363673+0000","last_undegraded":"2024-04-25T09:14:05.363673+0000","last_fullsized":"2024-04-25T09:14:05.363673+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:42.965425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981201+0000","last_change":"2024-04-25T09:14:04.354610+0000","last_active":"2024-04-25T09:14:05.981201+0000","last_peered":"2024-04-25T09:14:05.981201+0000","last_clean":"2024-04-25T09:14:05.981201+0000","last_became_active":"2024-04-25T09:14:04.354344+0000","last_became_peered":"2024-04-25T09:14:04.354344+0000","last_unstale":"2024-04-25T09:14:05.981201+0000","last_undegraded":"2024-04-25T09:14:05.981201+0000","last_fullsized":"2024-04-25T09:14:05.981201+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:12.746470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214733+0000","last_change":"2024-04-25T09:14:03.337500+0000","last_active":"2024-04-25T09:14:06.214733+0000","last_peered":"2024-04-25T09:14:06.214733+0000","last_clean":"2024-04-25T09:14:06.214733+0000","last_became_active":"2024-04-25T09:14:03.337238+0000","last_became_peered":"2024-04-25T09:14:03.337238+0000","last_unstale":"2024-04-25T09:14:06.214733+0000","last_undegraded":"2024-04-25T09:14:06.214733+0000","last_fullsized":"2024-04-25T09:14:06.214733+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:51.968883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214135+0000","last_change":"2024-04-25T09:14:04.349925+0000","last_active":"2024-04-25T09:14:06.214135+0000","last_peered":"2024-04-25T09:14:06.214135+0000","last_clean":"2024-04-25T09:14:06.214135+0000","last_became_active":"2024-04-25T09:14:04.349635+0000","last_became_peered":"2024-04-25T09:14:04.349635+0000","last_unstale":"2024-04-25T09:14:06.214135+0000","last_undegraded":"2024-04-25T09:14:06.214135+0000","last_fullsized":"2024-04-25T09:14:06.214135+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:39.441854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.351603+0000","last_change":"2024-04-25T09:14:03.337154+0000","last_active":"2024-04-25T09:14:05.351603+0000","last_peered":"2024-04-25T09:14:05.351603+0000","last_clean":"2024-04-25T09:14:05.351603+0000","last_became_active":"2024-04-25T09:14:03.336850+0000","last_became_peered":"2024-04-25T09:14:03.336850+0000","last_unstale":"2024-04-25T09:14:05.351603+0000","last_undegraded":"2024-04-25T09:14:05.351603+0000","last_fullsized":"2024-04-25T09:14:05.351603+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:31.404258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.980918+0000","last_change":"2024-04-25T09:14:04.356889+0000","last_active":"2024-04-25T09:14:05.980918+0000","last_peered":"2024-04-25T09:14:05.980918+0000","last_clean":"2024-04-25T09:14:05.980918+0000","last_became_active":"2024-04-25T09:14:04.356333+0000","last_became_peered":"2024-04-25T09:14:04.356333+0000","last_unstale":"2024-04-25T09:14:05.980918+0000","last_undegraded":"2024-04-25T09:14:05.980918+0000","last_fullsized":"2024-04-25T09:14:05.980918+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:51.542126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213756+0000","last_change":"2024-04-25T09:14:03.333663+0000","last_active":"2024-04-25T09:14:06.213756+0000","last_peered":"2024-04-25T09:14:06.213756+0000","last_clean":"2024-04-25T09:14:06.213756+0000","last_became_active":"2024-04-25T09:14:03.333401+0000","last_became_peered":"2024-04-25T09:14:03.333401+0000","last_unstale":"2024-04-25T09:14:06.213756+0000","last_undegraded":"2024-04-25T09:14:06.213756+0000","last_fullsized":"2024-04-25T09:14:06.213756+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:55.762900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213978+0000","last_change":"2024-04-25T09:14:04.336912+0000","last_active":"2024-04-25T09:14:06.213978+0000","last_peered":"2024-04-25T09:14:06.213978+0000","last_clean":"2024-04-25T09:14:06.213978+0000","last_became_active":"2024-04-25T09:14:04.336666+0000","last_became_peered":"2024-04-25T09:14:04.336666+0000","last_unstale":"2024-04-25T09:14:06.213978+0000","last_undegraded":"2024-04-25T09:14:06.213978+0000","last_fullsized":"2024-04-25T09:14:06.213978+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:52.709749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213439+0000","last_change":"2024-04-25T09:14:03.332525+0000","last_active":"2024-04-25T09:14:06.213439+0000","last_peered":"2024-04-25T09:14:06.213439+0000","last_clean":"2024-04-25T09:14:06.213439+0000","last_became_active":"2024-04-25T09:14:03.331763+0000","last_became_peered":"2024-04-25T09:14:03.331763+0000","last_unstale":"2024-04-25T09:14:06.213439+0000","last_undegraded":"2024-04-25T09:14:06.213439+0000","last_fullsized":"2024-04-25T09:14:06.213439+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:38.757399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.361280+0000","last_change":"2024-04-25T09:14:04.348584+0000","last_active":"2024-04-25T09:14:05.361280+0000","last_peered":"2024-04-25T09:14:05.361280+0000","last_clean":"2024-04-25T09:14:05.361280+0000","last_became_active":"2024-04-25T09:14:04.348030+0000","last_became_peered":"2024-04-25T09:14:04.348030+0000","last_unstale":"2024-04-25T09:14:05.361280+0000","last_undegraded":"2024-04-25T09:14:05.361280+0000","last_fullsized":"2024-04-25T09:14:05.361280+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:40.879528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214297+0000","last_change":"2024-04-25T09:14:03.337532+0000","last_active":"2024-04-25T09:14:06.214297+0000","last_peered":"2024-04-25T09:14:06.214297+0000","last_clean":"2024-04-25T09:14:06.214297+0000","last_became_active":"2024-04-25T09:14:03.337214+0000","last_became_peered":"2024-04-25T09:14:03.337214+0000","last_unstale":"2024-04-25T09:14:06.214297+0000","last_undegraded":"2024-04-25T09:14:06.214297+0000","last_fullsized":"2024-04-25T09:14:06.214297+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:16.054480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215617+0000","last_change":"2024-04-25T09:14:04.347517+0000","last_active":"2024-04-25T09:14:06.215617+0000","last_peered":"2024-04-25T09:14:06.215617+0000","last_clean":"2024-04-25T09:14:06.215617+0000","last_became_active":"2024-04-25T09:14:04.347192+0000","last_became_peered":"2024-04-25T09:14:04.347192+0000","last_unstale":"2024-04-25T09:14:06.215617+0000","last_undegraded":"2024-04-25T09:14:06.215617+0000","last_fullsized":"2024-04-25T09:14:06.215617+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:51.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"113'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.361214+0000","last_change":"2024-04-25T09:14:03.333332+0000","last_active":"2024-04-25T09:14:05.361214+0000","last_peered":"2024-04-25T09:14:05.361214+0000","last_clean":"2024-04-25T09:14:05.361214+0000","last_became_active":"2024-04-25T09:14:03.331991+0000","last_became_peered":"2024-04-25T09:14:03.331991+0000","last_unstale":"2024-04-25T09:14:05.361214+0000","last_undegraded":"2024-04-25T09:14:05.361214+0000","last_fullsized":"2024-04-25T09:14:05.361214+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:37.688449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215093+0000","last_change":"2024-04-25T09:14:04.346320+0000","last_active":"2024-04-25T09:14:06.215093+0000","last_peered":"2024-04-25T09:14:06.215093+0000","last_clean":"2024-04-25T09:14:06.215093+0000","last_became_active":"2024-04-25T09:14:04.345731+0000","last_became_peered":"2024-04-25T09:14:04.345731+0000","last_unstale":"2024-04-25T09:14:06.215093+0000","last_undegraded":"2024-04-25T09:14:06.215093+0000","last_fullsized":"2024-04-25T09:14:06.215093+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:28.655533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214455+0000","last_change":"2024-04-25T09:14:03.333389+0000","last_active":"2024-04-25T09:14:06.214455+0000","last_peered":"2024-04-25T09:14:06.214455+0000","last_clean":"2024-04-25T09:14:06.214455+0000","last_became_active":"2024-04-25T09:14:03.333114+0000","last_became_peered":"2024-04-25T09:14:03.333114+0000","last_unstale":"2024-04-25T09:14:06.214455+0000","last_undegraded":"2024-04-25T09:14:06.214455+0000","last_fullsized":"2024-04-25T09:14:06.214455+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:16.451114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.361019+0000","last_change":"2024-04-25T09:14:04.348337+0000","last_active":"2024-04-25T09:14:05.361019+0000","last_peered":"2024-04-25T09:14:05.361019+0000","last_clean":"2024-04-25T09:14:05.361019+0000","last_became_active":"2024-04-25T09:14:04.347687+0000","last_became_peered":"2024-04-25T09:14:04.347687+0000","last_unstale":"2024-04-25T09:14:05.361019+0000","last_undegraded":"2024-04-25T09:14:05.361019+0000","last_fullsized":"2024-04-25T09:14:05.361019+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:45.983328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214667+0000","last_change":"2024-04-25T09:14:03.330446+0000","last_active":"2024-04-25T09:14:06.214667+0000","last_peered":"2024-04-25T09:14:06.214667+0000","last_clean":"2024-04-25T09:14:06.214667+0000","last_became_active":"2024-04-25T09:14:03.330148+0000","last_became_peered":"2024-04-25T09:14:03.330148+0000","last_unstale":"2024-04-25T09:14:06.214667+0000","last_undegraded":"2024-04-25T09:14:06.214667+0000","last_fullsized":"2024-04-25T09:14:06.214667+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:12.181416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359060+0000","last_change":"2024-04-25T09:14:04.348362+0000","last_active":"2024-04-25T09:14:05.359060+0000","last_peered":"2024-04-25T09:14:05.359060+0000","last_clean":"2024-04-25T09:14:05.359060+0000","last_became_active":"2024-04-25T09:14:04.347457+0000","last_became_peered":"2024-04-25T09:14:04.347457+0000","last_unstale":"2024-04-25T09:14:05.359060+0000","last_undegraded":"2024-04-25T09:14:05.359060+0000","last_fullsized":"2024-04-25T09:14:05.359060+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:13.189661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.363824+0000","last_change":"2024-04-25T09:14:03.335245+0000","last_active":"2024-04-25T09:14:05.363824+0000","last_peered":"2024-04-25T09:14:05.363824+0000","last_clean":"2024-04-25T09:14:05.363824+0000","last_became_active":"2024-04-25T09:14:03.334920+0000","last_became_peered":"2024-04-25T09:14:03.334920+0000","last_unstale":"2024-04-25T09:14:05.363824+0000","last_undegraded":"2024-04-25T09:14:05.363824+0000","last_fullsized":"2024-04-25T09:14:05.363824+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:05.369694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359307+0000","last_change":"2024-04-25T09:14:04.352817+0000","last_active":"2024-04-25T09:14:05.359307+0000","last_peered":"2024-04-25T09:14:05.359307+0000","last_clean":"2024-04-25T09:14:05.359307+0000","last_became_active":"2024-04-25T09:14:04.352456+0000","last_became_peered":"2024-04-25T09:14:04.352456+0000","last_unstale":"2024-04-25T09:14:05.359307+0000","last_undegraded":"2024-04-25T09:14:05.359307+0000","last_fullsized":"2024-04-25T09:14:05.359307+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:39.765644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.358986+0000","last_change":"2024-04-25T09:14:03.334226+0000","last_active":"2024-04-25T09:14:05.358986+0000","last_peered":"2024-04-25T09:14:05.358986+0000","last_clean":"2024-04-25T09:14:05.358986+0000","last_became_active":"2024-04-25T09:14:03.333395+0000","last_became_peered":"2024-04-25T09:14:03.333395+0000","last_unstale":"2024-04-25T09:14:05.358986+0000","last_undegraded":"2024-04-25T09:14:05.358986+0000","last_fullsized":"2024-04-25T09:14:05.358986+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:48.532796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981281+0000","last_change":"2024-04-25T09:14:04.356744+0000","last_active":"2024-04-25T09:14:05.981281+0000","last_peered":"2024-04-25T09:14:05.981281+0000","last_clean":"2024-04-25T09:14:05.981281+0000","last_became_active":"2024-04-25T09:14:04.355973+0000","last_became_peered":"2024-04-25T09:14:04.355973+0000","last_unstale":"2024-04-25T09:14:05.981281+0000","last_undegraded":"2024-04-25T09:14:05.981281+0000","last_fullsized":"2024-04-25T09:14:05.981281+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:52.709749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.351474+0000","last_change":"2024-04-25T09:14:03.342252+0000","last_active":"2024-04-25T09:14:05.351474+0000","last_peered":"2024-04-25T09:14:05.351474+0000","last_clean":"2024-04-25T09:14:05.351474+0000","last_became_active":"2024-04-25T09:14:03.341939+0000","last_became_peered":"2024-04-25T09:14:03.341939+0000","last_unstale":"2024-04-25T09:14:05.351474+0000","last_undegraded":"2024-04-25T09:14:05.351474+0000","last_fullsized":"2024-04-25T09:14:05.351474+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:20.291248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213671+0000","last_change":"2024-04-25T09:14:04.342991+0000","last_active":"2024-04-25T09:14:06.213671+0000","last_peered":"2024-04-25T09:14:06.213671+0000","last_clean":"2024-04-25T09:14:06.213671+0000","last_became_active":"2024-04-25T09:14:04.341900+0000","last_became_peered":"2024-04-25T09:14:04.341900+0000","last_unstale":"2024-04-25T09:14:06.213671+0000","last_undegraded":"2024-04-25T09:14:06.213671+0000","last_fullsized":"2024-04-25T09:14:06.213671+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:37.861976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213499+0000","last_change":"2024-04-25T09:14:03.332954+0000","last_active":"2024-04-25T09:14:06.213499+0000","last_peered":"2024-04-25T09:14:06.213499+0000","last_clean":"2024-04-25T09:14:06.213499+0000","last_became_active":"2024-04-25T09:14:03.332259+0000","last_became_peered":"2024-04-25T09:14:03.332259+0000","last_unstale":"2024-04-25T09:14:06.213499+0000","last_undegraded":"2024-04-25T09:14:06.213499+0000","last_fullsized":"2024-04-25T09:14:06.213499+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:57.170456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213677+0000","last_change":"2024-04-25T09:14:04.356252+0000","last_active":"2024-04-25T09:14:06.213677+0000","last_peered":"2024-04-25T09:14:06.213677+0000","last_clean":"2024-04-25T09:14:06.213677+0000","last_became_active":"2024-04-25T09:14:04.355634+0000","last_became_peered":"2024-04-25T09:14:04.355634+0000","last_unstale":"2024-04-25T09:14:06.213677+0000","last_undegraded":"2024-04-25T09:14:06.213677+0000","last_fullsized":"2024-04-25T09:14:06.213677+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:12.746470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.363824+0000","last_change":"2024-04-25T09:14:03.344653+0000","last_active":"2024-04-25T09:14:05.363824+0000","last_peered":"2024-04-25T09:14:05.363824+0000","last_clean":"2024-04-25T09:14:05.363824+0000","last_became_active":"2024-04-25T09:14:03.344373+0000","last_became_peered":"2024-04-25T09:14:03.344373+0000","last_unstale":"2024-04-25T09:14:05.363824+0000","last_undegraded":"2024-04-25T09:14:05.363824+0000","last_fullsized":"2024-04-25T09:14:05.363824+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:54.384353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":344,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981208+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:14:05.981208+0000","last_peered":"2024-04-25T09:14:05.981208+0000","last_clean":"2024-04-25T09:14:05.981208+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:14:05.981208+0000","last_undegraded":"2024-04-25T09:14:05.981208+0000","last_fullsized":"2024-04-25T09:14:05.981208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574973,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33140,"kb_used_data":1960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338700,"statfs":{"total":96636764160,"available":96602828800,"internally_reserved":0,"allocated":2007040,"data_stored":1201101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574975,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1409024,"data_stored":610187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574972,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1413120,"data_stored":610721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574972,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1404928,"data_stored":610117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1421312,"data_stored":611799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574974,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1404928,"data_stored":610117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574973,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1413120,"data_stored":610241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574976,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33152,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338688,"statfs":{"total":96636764160,"available":96602816512,"internally_reserved":0,"allocated":2019328,"data_stored":1202209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:14:08.407 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:14:08.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.592+0000 7f841d800640 1 Processor -- start 2024-04-25T09:14:08.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.592+0000 7f841d800640 1 -- start start 2024-04-25T09:14:08.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.592+0000 7f841d800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f84180aeb30 0x7f8418071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:08.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.592+0000 7f841d800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841806eba0 con 0x7f8418071780 2024-04-25T09:14:08.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.592+0000 7f841d800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841806ee80 con 0x7f841806e510 2024-04-25T09:14:08.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.592+0000 7f841d800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8418071be0 con 0x7f84180aeb30 2024-04-25T09:14:08.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.592+0000 7f8416a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f84180aeb30 0x7f8418071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:08.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.592+0000 7f840e000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f8418071780 0x7f841806de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:47732/0 (socket says 172.21.15.175:47732) 2024-04-25T09:14:08.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.592+0000 7f840e000640 1 -- 172.21.15.175:0/228800915 learned_addr learned my addr 172.21.15.175:0/228800915 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:08.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.592+0000 7f8416a00640 1 -- 172.21.15.175:0/228800915 >> v1:172.21.15.177:6789/0 conn(0x7f841806e510 legacy=0x7f84180b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:08.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.592+0000 7f8416a00640 1 -- 172.21.15.175:0/228800915 >> v1:172.21.15.175:6789/0 conn(0x7f8418071780 legacy=0x7f841806de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:08.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.596+0000 7f8416a00640 1 -- 172.21.15.175:0/228800915 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84180b2700 con 0x7f84180aeb30 2024-04-25T09:14:08.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.596+0000 7f8416a00640 1 --2- 172.21.15.175:0/228800915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84180aeb30 0x7f8418071240 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f8408009d90 tx=0x7f840801da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70f7278920e2d6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:08.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.596+0000 7f8416000640 1 -- 172.21.15.175:0/228800915 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84080b3070 con 0x7f84180aeb30 2024-04-25T09:14:08.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.596+0000 7f8416000640 1 -- 172.21.15.175:0/228800915 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84080a69b0 con 0x7f84180aeb30 2024-04-25T09:14:08.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.596+0000 7f8416000640 1 -- 172.21.15.175:0/228800915 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84080a6d80 con 0x7f84180aeb30 2024-04-25T09:14:08.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.596+0000 7f841d800640 1 -- 172.21.15.175:0/228800915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84180aeb30 msgr2=0x7f8418071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:08.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.596+0000 7f841d800640 1 --2- 172.21.15.175:0/228800915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84180aeb30 0x7f8418071240 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f8408009d90 tx=0x7f840801da40 comp rx=0 tx=0).stop 2024-04-25T09:14:08.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.596+0000 7f841d800640 1 -- 172.21.15.175:0/228800915 shutdown_connections 2024-04-25T09:14:08.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.596+0000 7f841d800640 1 --2- 172.21.15.175:0/228800915 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84180aeb30 0x7f8418071240 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.596+0000 7f841d800640 1 -- 172.21.15.175:0/228800915 >> 172.21.15.175:0/228800915 conn(0x7f8418067150 msgr2=0x7f841806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:08.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.596+0000 7f841d800640 1 -- 172.21.15.175:0/228800915 shutdown_connections 2024-04-25T09:14:08.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.596+0000 7f841d800640 1 -- 172.21.15.175:0/228800915 wait complete. 2024-04-25T09:14:08.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f841d800640 1 Processor -- start 2024-04-25T09:14:08.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f841d800640 1 -- start start 2024-04-25T09:14:08.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f841d800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8418071780 0x7f84181529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:08.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f841d800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84180aeb30 0x7f8418153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:08.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f841d800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8418141240 0x7f841813e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:08.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f841d800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84180b2a70 con 0x7f8418071780 2024-04-25T09:14:08.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f841d800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84180b40f0 con 0x7f84180aeb30 2024-04-25T09:14:08.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f841d800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8418167f10 con 0x7f8418141240 2024-04-25T09:14:08.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f8416a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8418071780 0x7f84181529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:08.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f8416a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8418071780 0x7f84181529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32908/0 (socket says 172.21.15.175:32908) 2024-04-25T09:14:08.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f8416a00640 1 -- 172.21.15.175:0/1161874964 learned_addr learned my addr 172.21.15.175:0/1161874964 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:08.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f8417400640 1 --2- 172.21.15.175:0/1161874964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8418141240 0x7f841813e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:08.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f840e000640 1 --2- 172.21.15.175:0/1161874964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84180aeb30 0x7f8418153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:08.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f8416a00640 1 -- 172.21.15.175:0/1161874964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8418141240 msgr2=0x7f841813e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:08.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f8416a00640 1 --2- 172.21.15.175:0/1161874964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8418141240 0x7f841813e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f8416a00640 1 -- 172.21.15.175:0/1161874964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84180aeb30 msgr2=0x7f8418153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:08.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f8416a00640 1 --2- 172.21.15.175:0/1161874964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84180aeb30 0x7f8418153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f8416a00640 1 -- 172.21.15.175:0/1161874964 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8418153980 con 0x7f8418071780 2024-04-25T09:14:08.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f8417400640 1 --2- 172.21.15.175:0/1161874964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8418141240 0x7f841813e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:08.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f840e000640 1 --2- 172.21.15.175:0/1161874964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84180aeb30 0x7f8418153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:08.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f8416a00640 1 --2- 172.21.15.175:0/1161874964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8418071780 0x7f84181529e0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f840801a650 tx=0x7f840801c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:08.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f840f400640 1 -- 172.21.15.175:0/1161874964 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84080bd020 con 0x7f8418071780 2024-04-25T09:14:08.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f840f400640 1 -- 172.21.15.175:0/1161874964 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84080aea70 con 0x7f8418071780 2024-04-25T09:14:08.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f841d800640 1 -- 172.21.15.175:0/1161874964 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8418153c60 con 0x7f8418071780 2024-04-25T09:14:08.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f840f400640 1 -- 172.21.15.175:0/1161874964 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84080b3040 con 0x7f8418071780 2024-04-25T09:14:08.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.600+0000 7f841d800640 1 -- 172.21.15.175:0/1161874964 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8418154220 con 0x7f8418071780 2024-04-25T09:14:08.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.604+0000 7f841d800640 1 -- 172.21.15.175:0/1161874964 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8418074a60 con 0x7f8418071780 2024-04-25T09:14:08.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.604+0000 7f840f400640 1 -- 172.21.15.175:0/1161874964 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f84080c0020 con 0x7f8418071780 2024-04-25T09:14:08.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.604+0000 7f840f400640 1 --2- 172.21.15.175:0/1161874964 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f83f4066f90 0x7f83f4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:08.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.604+0000 7f840f400640 1 -- 172.21.15.175:0/1161874964 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f840811fc80 con 0x7f8418071780 2024-04-25T09:14:08.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.604+0000 7f840e000640 1 --2- 172.21.15.175:0/1161874964 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f83f4066f90 0x7f83f4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:08.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.604+0000 7f840e000640 1 --2- 172.21.15.175:0/1161874964 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f83f4066f90 0x7f83f4069450 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f8400007fd0 tx=0x7f8400009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:08.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.608+0000 7f840f400640 1 -- 172.21.15.175:0/1161874964 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f84080c7070 con 0x7f8418071780 2024-04-25T09:14:08.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.760+0000 7f841d800640 1 -- 172.21.15.175:0/1161874964 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f84180721c0 con 0x7f83f4066f90 2024-04-25T09:14:08.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.768+0000 7f840f400640 1 -- 172.21.15.175:0/1161874964 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252483 (secure 0 0 0) 0x7f84180721c0 con 0x7f83f4066f90 2024-04-25T09:14:08.756 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:08.757 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:14:08.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.768+0000 7f841d800640 1 -- 172.21.15.175:0/1161874964 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f83f4066f90 msgr2=0x7f83f4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:08.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.768+0000 7f841d800640 1 --2- 172.21.15.175:0/1161874964 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f83f4066f90 0x7f83f4069450 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f8400007fd0 tx=0x7f8400009040 comp rx=0 tx=0).stop 2024-04-25T09:14:08.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.768+0000 7f841d800640 1 -- 172.21.15.175:0/1161874964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8418071780 msgr2=0x7f84181529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:08.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.768+0000 7f841d800640 1 --2- 172.21.15.175:0/1161874964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8418071780 0x7f84181529e0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f840801a650 tx=0x7f840801c280 comp rx=0 tx=0).stop 2024-04-25T09:14:08.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.772+0000 7f841d800640 1 -- 172.21.15.175:0/1161874964 shutdown_connections 2024-04-25T09:14:08.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.772+0000 7f841d800640 1 --2- 172.21.15.175:0/1161874964 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f83f4066f90 0x7f83f4069450 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.772+0000 7f841d800640 1 --2- 172.21.15.175:0/1161874964 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8418141240 0x7f841813e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.772+0000 7f841d800640 1 --2- 172.21.15.175:0/1161874964 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84180aeb30 0x7f8418153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.772+0000 7f841d800640 1 --2- 172.21.15.175:0/1161874964 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8418071780 0x7f84181529e0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.772+0000 7f841d800640 1 -- 172.21.15.175:0/1161874964 >> 172.21.15.175:0/1161874964 conn(0x7f841806e510 msgr2=0x7f841815aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:08.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.772+0000 7f841d800640 1 -- 172.21.15.175:0/1161874964 shutdown_connections 2024-04-25T09:14:08.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.772+0000 7f841d800640 1 -- 172.21.15.175:0/1161874964 wait complete. 2024-04-25T09:14:08.776 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":411,"stamp":"2024-04-25T09:14:07.928821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261672,"kb_used_data":12200,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713048,"statfs":{"total":773094113280,"available":772826161152,"internally_reserved":0,"allocated":12492800,"data_stored":6066492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.620021"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215365+0000","last_change":"2024-04-25T09:14:04.349640+0000","last_active":"2024-04-25T09:14:06.215365+0000","last_peered":"2024-04-25T09:14:06.215365+0000","last_clean":"2024-04-25T09:14:06.215365+0000","last_became_active":"2024-04-25T09:14:04.349397+0000","last_became_peered":"2024-04-25T09:14:04.349397+0000","last_unstale":"2024-04-25T09:14:06.215365+0000","last_undegraded":"2024-04-25T09:14:06.215365+0000","last_fullsized":"2024-04-25T09:14:06.215365+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:00.660762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359611+0000","last_change":"2024-04-25T09:14:04.357484+0000","last_active":"2024-04-25T09:14:05.359611+0000","last_peered":"2024-04-25T09:14:05.359611+0000","last_clean":"2024-04-25T09:14:05.359611+0000","last_became_active":"2024-04-25T09:14:04.357215+0000","last_became_peered":"2024-04-25T09:14:04.357215+0000","last_unstale":"2024-04-25T09:14:05.359611+0000","last_undegraded":"2024-04-25T09:14:05.359611+0000","last_fullsized":"2024-04-25T09:14:05.359611+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:51.542126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981311+0000","last_change":"2024-04-25T09:14:04.352702+0000","last_active":"2024-04-25T09:14:05.981311+0000","last_peered":"2024-04-25T09:14:05.981311+0000","last_clean":"2024-04-25T09:14:05.981311+0000","last_became_active":"2024-04-25T09:14:04.352336+0000","last_became_peered":"2024-04-25T09:14:04.352336+0000","last_unstale":"2024-04-25T09:14:05.981311+0000","last_undegraded":"2024-04-25T09:14:05.981311+0000","last_fullsized":"2024-04-25T09:14:05.981311+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:29.594157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214489+0000","last_change":"2024-04-25T09:14:04.345453+0000","last_active":"2024-04-25T09:14:06.214489+0000","last_peered":"2024-04-25T09:14:06.214489+0000","last_clean":"2024-04-25T09:14:06.214489+0000","last_became_active":"2024-04-25T09:14:04.343260+0000","last_became_peered":"2024-04-25T09:14:04.343260+0000","last_unstale":"2024-04-25T09:14:06.214489+0000","last_undegraded":"2024-04-25T09:14:06.214489+0000","last_fullsized":"2024-04-25T09:14:06.214489+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:32:57.353751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.351738+0000","last_change":"2024-04-25T09:14:04.354054+0000","last_active":"2024-04-25T09:14:05.351738+0000","last_peered":"2024-04-25T09:14:05.351738+0000","last_clean":"2024-04-25T09:14:05.351738+0000","last_became_active":"2024-04-25T09:14:04.353720+0000","last_became_peered":"2024-04-25T09:14:04.353720+0000","last_unstale":"2024-04-25T09:14:05.351738+0000","last_undegraded":"2024-04-25T09:14:05.351738+0000","last_fullsized":"2024-04-25T09:14:05.351738+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:27.573207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214006+0000","last_change":"2024-04-25T09:14:04.339749+0000","last_active":"2024-04-25T09:14:06.214006+0000","last_peered":"2024-04-25T09:14:06.214006+0000","last_clean":"2024-04-25T09:14:06.214006+0000","last_became_active":"2024-04-25T09:14:04.339447+0000","last_became_peered":"2024-04-25T09:14:04.339447+0000","last_unstale":"2024-04-25T09:14:06.214006+0000","last_undegraded":"2024-04-25T09:14:06.214006+0000","last_fullsized":"2024-04-25T09:14:06.214006+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:16.736437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.363932+0000","last_change":"2024-04-25T09:14:04.350344+0000","last_active":"2024-04-25T09:14:05.363932+0000","last_peered":"2024-04-25T09:14:05.363932+0000","last_clean":"2024-04-25T09:14:05.363932+0000","last_became_active":"2024-04-25T09:14:04.348532+0000","last_became_peered":"2024-04-25T09:14:04.348532+0000","last_unstale":"2024-04-25T09:14:05.363932+0000","last_undegraded":"2024-04-25T09:14:05.363932+0000","last_fullsized":"2024-04-25T09:14:05.363932+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:28.737624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.980921+0000","last_change":"2024-04-25T09:14:04.353963+0000","last_active":"2024-04-25T09:14:05.980921+0000","last_peered":"2024-04-25T09:14:05.980921+0000","last_clean":"2024-04-25T09:14:05.980921+0000","last_became_active":"2024-04-25T09:14:04.353608+0000","last_became_peered":"2024-04-25T09:14:04.353608+0000","last_unstale":"2024-04-25T09:14:05.980921+0000","last_undegraded":"2024-04-25T09:14:05.980921+0000","last_fullsized":"2024-04-25T09:14:05.980921+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:17.459359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215617+0000","last_change":"2024-04-25T09:14:04.362008+0000","last_active":"2024-04-25T09:14:06.215617+0000","last_peered":"2024-04-25T09:14:06.215617+0000","last_clean":"2024-04-25T09:14:06.215617+0000","last_became_active":"2024-04-25T09:14:04.361685+0000","last_became_peered":"2024-04-25T09:14:04.361685+0000","last_unstale":"2024-04-25T09:14:06.215617+0000","last_undegraded":"2024-04-25T09:14:06.215617+0000","last_fullsized":"2024-04-25T09:14:06.215617+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:23.528251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214992+0000","last_change":"2024-04-25T09:14:04.352615+0000","last_active":"2024-04-25T09:14:06.214992+0000","last_peered":"2024-04-25T09:14:06.214992+0000","last_clean":"2024-04-25T09:14:06.214992+0000","last_became_active":"2024-04-25T09:14:04.352345+0000","last_became_peered":"2024-04-25T09:14:04.352345+0000","last_unstale":"2024-04-25T09:14:06.214992+0000","last_undegraded":"2024-04-25T09:14:06.214992+0000","last_fullsized":"2024-04-25T09:14:06.214992+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:24.201102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359294+0000","last_change":"2024-04-25T09:14:04.347825+0000","last_active":"2024-04-25T09:14:05.359294+0000","last_peered":"2024-04-25T09:14:05.359294+0000","last_clean":"2024-04-25T09:14:05.359294+0000","last_became_active":"2024-04-25T09:14:04.347528+0000","last_became_peered":"2024-04-25T09:14:04.347528+0000","last_unstale":"2024-04-25T09:14:05.359294+0000","last_undegraded":"2024-04-25T09:14:05.359294+0000","last_fullsized":"2024-04-25T09:14:05.359294+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:26.620114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214549+0000","last_change":"2024-04-25T09:14:04.347446+0000","last_active":"2024-04-25T09:14:06.214549+0000","last_peered":"2024-04-25T09:14:06.214549+0000","last_clean":"2024-04-25T09:14:06.214549+0000","last_became_active":"2024-04-25T09:14:04.347068+0000","last_became_peered":"2024-04-25T09:14:04.347068+0000","last_unstale":"2024-04-25T09:14:06.214549+0000","last_undegraded":"2024-04-25T09:14:06.214549+0000","last_fullsized":"2024-04-25T09:14:06.214549+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:13.891688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981189+0000","last_change":"2024-04-25T09:14:04.355734+0000","last_active":"2024-04-25T09:14:05.981189+0000","last_peered":"2024-04-25T09:14:05.981189+0000","last_clean":"2024-04-25T09:14:05.981189+0000","last_became_active":"2024-04-25T09:14:04.355417+0000","last_became_peered":"2024-04-25T09:14:04.355417+0000","last_unstale":"2024-04-25T09:14:05.981189+0000","last_undegraded":"2024-04-25T09:14:05.981189+0000","last_fullsized":"2024-04-25T09:14:05.981189+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:30.932981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981301+0000","last_change":"2024-04-25T09:14:04.352285+0000","last_active":"2024-04-25T09:14:05.981301+0000","last_peered":"2024-04-25T09:14:05.981301+0000","last_clean":"2024-04-25T09:14:05.981301+0000","last_became_active":"2024-04-25T09:14:04.351875+0000","last_became_peered":"2024-04-25T09:14:04.351875+0000","last_unstale":"2024-04-25T09:14:05.981301+0000","last_undegraded":"2024-04-25T09:14:05.981301+0000","last_fullsized":"2024-04-25T09:14:05.981301+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:50.265315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213848+0000","last_change":"2024-04-25T09:14:04.339660+0000","last_active":"2024-04-25T09:14:06.213848+0000","last_peered":"2024-04-25T09:14:06.213848+0000","last_clean":"2024-04-25T09:14:06.213848+0000","last_became_active":"2024-04-25T09:14:04.339385+0000","last_became_peered":"2024-04-25T09:14:04.339385+0000","last_unstale":"2024-04-25T09:14:06.213848+0000","last_undegraded":"2024-04-25T09:14:06.213848+0000","last_fullsized":"2024-04-25T09:14:06.213848+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:58:15.115971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213425+0000","last_change":"2024-04-25T09:14:04.349905+0000","last_active":"2024-04-25T09:14:06.213425+0000","last_peered":"2024-04-25T09:14:06.213425+0000","last_clean":"2024-04-25T09:14:06.213425+0000","last_became_active":"2024-04-25T09:14:04.349574+0000","last_became_peered":"2024-04-25T09:14:04.349574+0000","last_unstale":"2024-04-25T09:14:06.213425+0000","last_undegraded":"2024-04-25T09:14:06.213425+0000","last_fullsized":"2024-04-25T09:14:06.213425+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:25.685132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359608+0000","last_change":"2024-04-25T09:14:04.349402+0000","last_active":"2024-04-25T09:14:05.359608+0000","last_peered":"2024-04-25T09:14:05.359608+0000","last_clean":"2024-04-25T09:14:05.359608+0000","last_became_active":"2024-04-25T09:14:04.348802+0000","last_became_peered":"2024-04-25T09:14:04.348802+0000","last_unstale":"2024-04-25T09:14:05.359608+0000","last_undegraded":"2024-04-25T09:14:05.359608+0000","last_fullsized":"2024-04-25T09:14:05.359608+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:50.265315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.361021+0000","last_change":"2024-04-25T09:14:04.350196+0000","last_active":"2024-04-25T09:14:05.361021+0000","last_peered":"2024-04-25T09:14:05.361021+0000","last_clean":"2024-04-25T09:14:05.361021+0000","last_became_active":"2024-04-25T09:14:04.349804+0000","last_became_peered":"2024-04-25T09:14:04.349804+0000","last_unstale":"2024-04-25T09:14:05.361021+0000","last_undegraded":"2024-04-25T09:14:05.361021+0000","last_fullsized":"2024-04-25T09:14:05.361021+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:18:39.968424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981332+0000","last_change":"2024-04-25T09:14:04.355417+0000","last_active":"2024-04-25T09:14:05.981332+0000","last_peered":"2024-04-25T09:14:05.981332+0000","last_clean":"2024-04-25T09:14:05.981332+0000","last_became_active":"2024-04-25T09:14:04.355028+0000","last_became_peered":"2024-04-25T09:14:04.355028+0000","last_unstale":"2024-04-25T09:14:05.981332+0000","last_undegraded":"2024-04-25T09:14:05.981332+0000","last_fullsized":"2024-04-25T09:14:05.981332+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:48.137180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359384+0000","last_change":"2024-04-25T09:14:04.356353+0000","last_active":"2024-04-25T09:14:05.359384+0000","last_peered":"2024-04-25T09:14:05.359384+0000","last_clean":"2024-04-25T09:14:05.359384+0000","last_became_active":"2024-04-25T09:14:04.355955+0000","last_became_peered":"2024-04-25T09:14:04.355955+0000","last_unstale":"2024-04-25T09:14:05.359384+0000","last_undegraded":"2024-04-25T09:14:05.359384+0000","last_fullsized":"2024-04-25T09:14:05.359384+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:17.568255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359551+0000","last_change":"2024-04-25T09:14:04.350659+0000","last_active":"2024-04-25T09:14:05.359551+0000","last_peered":"2024-04-25T09:14:05.359551+0000","last_clean":"2024-04-25T09:14:05.359551+0000","last_became_active":"2024-04-25T09:14:04.350361+0000","last_became_peered":"2024-04-25T09:14:04.350361+0000","last_unstale":"2024-04-25T09:14:05.359551+0000","last_undegraded":"2024-04-25T09:14:05.359551+0000","last_fullsized":"2024-04-25T09:14:05.359551+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:17.459359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214989+0000","last_change":"2024-04-25T09:14:04.338714+0000","last_active":"2024-04-25T09:14:06.214989+0000","last_peered":"2024-04-25T09:14:06.214989+0000","last_clean":"2024-04-25T09:14:06.214989+0000","last_became_active":"2024-04-25T09:14:04.335537+0000","last_became_peered":"2024-04-25T09:14:04.335537+0000","last_unstale":"2024-04-25T09:14:06.214989+0000","last_undegraded":"2024-04-25T09:14:06.214989+0000","last_fullsized":"2024-04-25T09:14:06.214989+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:32.785404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359246+0000","last_change":"2024-04-25T09:14:04.354066+0000","last_active":"2024-04-25T09:14:05.359246+0000","last_peered":"2024-04-25T09:14:05.359246+0000","last_clean":"2024-04-25T09:14:05.359246+0000","last_became_active":"2024-04-25T09:14:04.353800+0000","last_became_peered":"2024-04-25T09:14:04.353800+0000","last_unstale":"2024-04-25T09:14:05.359246+0000","last_undegraded":"2024-04-25T09:14:05.359246+0000","last_fullsized":"2024-04-25T09:14:05.359246+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:34.607766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213507+0000","last_change":"2024-04-25T09:14:04.356539+0000","last_active":"2024-04-25T09:14:06.213507+0000","last_peered":"2024-04-25T09:14:06.213507+0000","last_clean":"2024-04-25T09:14:06.213507+0000","last_became_active":"2024-04-25T09:14:04.355966+0000","last_became_peered":"2024-04-25T09:14:04.355966+0000","last_unstale":"2024-04-25T09:14:06.213507+0000","last_undegraded":"2024-04-25T09:14:06.213507+0000","last_fullsized":"2024-04-25T09:14:06.213507+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:30.932981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359738+0000","last_change":"2024-04-25T09:14:04.349179+0000","last_active":"2024-04-25T09:14:05.359738+0000","last_peered":"2024-04-25T09:14:05.359738+0000","last_clean":"2024-04-25T09:14:05.359738+0000","last_became_active":"2024-04-25T09:14:04.348452+0000","last_became_peered":"2024-04-25T09:14:04.348452+0000","last_unstale":"2024-04-25T09:14:05.359738+0000","last_undegraded":"2024-04-25T09:14:05.359738+0000","last_fullsized":"2024-04-25T09:14:05.359738+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:20.531294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215157+0000","last_change":"2024-04-25T09:14:04.348816+0000","last_active":"2024-04-25T09:14:06.215157+0000","last_peered":"2024-04-25T09:14:06.215157+0000","last_clean":"2024-04-25T09:14:06.215157+0000","last_became_active":"2024-04-25T09:14:04.348528+0000","last_became_peered":"2024-04-25T09:14:04.348528+0000","last_unstale":"2024-04-25T09:14:06.215157+0000","last_undegraded":"2024-04-25T09:14:06.215157+0000","last_fullsized":"2024-04-25T09:14:06.215157+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:37.205818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215329+0000","last_change":"2024-04-25T09:14:04.341287+0000","last_active":"2024-04-25T09:14:06.215329+0000","last_peered":"2024-04-25T09:14:06.215329+0000","last_clean":"2024-04-25T09:14:06.215329+0000","last_became_active":"2024-04-25T09:14:04.340957+0000","last_became_peered":"2024-04-25T09:14:04.340957+0000","last_unstale":"2024-04-25T09:14:06.215329+0000","last_undegraded":"2024-04-25T09:14:06.215329+0000","last_fullsized":"2024-04-25T09:14:06.215329+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:26.876939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214419+0000","last_change":"2024-04-25T09:14:04.345989+0000","last_active":"2024-04-25T09:14:06.214419+0000","last_peered":"2024-04-25T09:14:06.214419+0000","last_clean":"2024-04-25T09:14:06.214419+0000","last_became_active":"2024-04-25T09:14:04.345581+0000","last_became_peered":"2024-04-25T09:14:04.345581+0000","last_unstale":"2024-04-25T09:14:06.214419+0000","last_undegraded":"2024-04-25T09:14:06.214419+0000","last_fullsized":"2024-04-25T09:14:06.214419+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:48.137180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359104+0000","last_change":"2024-04-25T09:14:04.358412+0000","last_active":"2024-04-25T09:14:05.359104+0000","last_peered":"2024-04-25T09:14:05.359104+0000","last_clean":"2024-04-25T09:14:05.359104+0000","last_became_active":"2024-04-25T09:14:04.357528+0000","last_became_peered":"2024-04-25T09:14:04.357528+0000","last_unstale":"2024-04-25T09:14:05.359104+0000","last_undegraded":"2024-04-25T09:14:05.359104+0000","last_fullsized":"2024-04-25T09:14:05.359104+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:48.065212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.363974+0000","last_change":"2024-04-25T09:14:04.360854+0000","last_active":"2024-04-25T09:14:05.363974+0000","last_peered":"2024-04-25T09:14:05.363974+0000","last_clean":"2024-04-25T09:14:05.363974+0000","last_became_active":"2024-04-25T09:14:04.360555+0000","last_became_peered":"2024-04-25T09:14:04.360555+0000","last_unstale":"2024-04-25T09:14:05.363974+0000","last_undegraded":"2024-04-25T09:14:05.363974+0000","last_fullsized":"2024-04-25T09:14:05.363974+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:47.112959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213341+0000","last_change":"2024-04-25T09:14:04.348633+0000","last_active":"2024-04-25T09:14:06.213341+0000","last_peered":"2024-04-25T09:14:06.213341+0000","last_clean":"2024-04-25T09:14:06.213341+0000","last_became_active":"2024-04-25T09:14:04.348361+0000","last_became_peered":"2024-04-25T09:14:04.348361+0000","last_unstale":"2024-04-25T09:14:06.213341+0000","last_undegraded":"2024-04-25T09:14:06.213341+0000","last_fullsized":"2024-04-25T09:14:06.213341+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:53.036313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213463+0000","last_change":"2024-04-25T09:14:04.358456+0000","last_active":"2024-04-25T09:14:06.213463+0000","last_peered":"2024-04-25T09:14:06.213463+0000","last_clean":"2024-04-25T09:14:06.213463+0000","last_became_active":"2024-04-25T09:14:04.354146+0000","last_became_peered":"2024-04-25T09:14:04.354146+0000","last_unstale":"2024-04-25T09:14:06.213463+0000","last_undegraded":"2024-04-25T09:14:06.213463+0000","last_fullsized":"2024-04-25T09:14:06.213463+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:34.308491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215399+0000","last_change":"2024-04-25T09:14:04.348260+0000","last_active":"2024-04-25T09:14:06.215399+0000","last_peered":"2024-04-25T09:14:06.215399+0000","last_clean":"2024-04-25T09:14:06.215399+0000","last_became_active":"2024-04-25T09:14:04.347958+0000","last_became_peered":"2024-04-25T09:14:04.347958+0000","last_unstale":"2024-04-25T09:14:06.215399+0000","last_undegraded":"2024-04-25T09:14:06.215399+0000","last_fullsized":"2024-04-25T09:14:06.215399+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:54.254146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"112'4","reported_seq":18,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.363963+0000","last_change":"2024-04-25T09:14:03.335161+0000","last_active":"2024-04-25T09:14:05.363963+0000","last_peered":"2024-04-25T09:14:05.363963+0000","last_clean":"2024-04-25T09:14:05.363963+0000","last_became_active":"2024-04-25T09:14:03.334803+0000","last_became_peered":"2024-04-25T09:14:03.334803+0000","last_unstale":"2024-04-25T09:14:05.363963+0000","last_undegraded":"2024-04-25T09:14:05.363963+0000","last_fullsized":"2024-04-25T09:14:05.363963+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:23.502103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.361282+0000","last_change":"2024-04-25T09:14:04.354215+0000","last_active":"2024-04-25T09:14:05.361282+0000","last_peered":"2024-04-25T09:14:05.361282+0000","last_clean":"2024-04-25T09:14:05.361282+0000","last_became_active":"2024-04-25T09:14:04.353929+0000","last_became_peered":"2024-04-25T09:14:04.353929+0000","last_unstale":"2024-04-25T09:14:05.361282+0000","last_undegraded":"2024-04-25T09:14:05.361282+0000","last_fullsized":"2024-04-25T09:14:05.361282+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:40.578140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981007+0000","last_change":"2024-04-25T09:14:03.331912+0000","last_active":"2024-04-25T09:14:05.981007+0000","last_peered":"2024-04-25T09:14:05.981007+0000","last_clean":"2024-04-25T09:14:05.981007+0000","last_became_active":"2024-04-25T09:14:03.331502+0000","last_became_peered":"2024-04-25T09:14:03.331502+0000","last_unstale":"2024-04-25T09:14:05.981007+0000","last_undegraded":"2024-04-25T09:14:05.981007+0000","last_fullsized":"2024-04-25T09:14:05.981007+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:39.871283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215145+0000","last_change":"2024-04-25T09:14:04.357546+0000","last_active":"2024-04-25T09:14:06.215145+0000","last_peered":"2024-04-25T09:14:06.215145+0000","last_clean":"2024-04-25T09:14:06.215145+0000","last_became_active":"2024-04-25T09:14:04.352629+0000","last_became_peered":"2024-04-25T09:14:04.352629+0000","last_unstale":"2024-04-25T09:14:06.215145+0000","last_undegraded":"2024-04-25T09:14:06.215145+0000","last_fullsized":"2024-04-25T09:14:06.215145+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:55.006416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.351752+0000","last_change":"2024-04-25T09:14:03.337144+0000","last_active":"2024-04-25T09:14:05.351752+0000","last_peered":"2024-04-25T09:14:05.351752+0000","last_clean":"2024-04-25T09:14:05.351752+0000","last_became_active":"2024-04-25T09:14:03.336807+0000","last_became_peered":"2024-04-25T09:14:03.336807+0000","last_unstale":"2024-04-25T09:14:05.351752+0000","last_undegraded":"2024-04-25T09:14:05.351752+0000","last_fullsized":"2024-04-25T09:14:05.351752+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:16.484104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981438+0000","last_change":"2024-04-25T09:14:04.355715+0000","last_active":"2024-04-25T09:14:05.981438+0000","last_peered":"2024-04-25T09:14:05.981438+0000","last_clean":"2024-04-25T09:14:05.981438+0000","last_became_active":"2024-04-25T09:14:04.355140+0000","last_became_peered":"2024-04-25T09:14:04.355140+0000","last_unstale":"2024-04-25T09:14:05.981438+0000","last_undegraded":"2024-04-25T09:14:05.981438+0000","last_fullsized":"2024-04-25T09:14:05.981438+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:07.353763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.351626+0000","last_change":"2024-04-25T09:14:03.337189+0000","last_active":"2024-04-25T09:14:05.351626+0000","last_peered":"2024-04-25T09:14:05.351626+0000","last_clean":"2024-04-25T09:14:05.351626+0000","last_became_active":"2024-04-25T09:14:03.336861+0000","last_became_peered":"2024-04-25T09:14:03.336861+0000","last_unstale":"2024-04-25T09:14:05.351626+0000","last_undegraded":"2024-04-25T09:14:05.351626+0000","last_fullsized":"2024-04-25T09:14:05.351626+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:49.528252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213922+0000","last_change":"2024-04-25T09:14:04.341828+0000","last_active":"2024-04-25T09:14:06.213922+0000","last_peered":"2024-04-25T09:14:06.213922+0000","last_clean":"2024-04-25T09:14:06.213922+0000","last_became_active":"2024-04-25T09:14:04.341545+0000","last_became_peered":"2024-04-25T09:14:04.341545+0000","last_unstale":"2024-04-25T09:14:06.213922+0000","last_undegraded":"2024-04-25T09:14:06.213922+0000","last_fullsized":"2024-04-25T09:14:06.213922+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:37:04.008011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.363648+0000","last_change":"2024-04-25T09:14:03.339983+0000","last_active":"2024-04-25T09:14:05.363648+0000","last_peered":"2024-04-25T09:14:05.363648+0000","last_clean":"2024-04-25T09:14:05.363648+0000","last_became_active":"2024-04-25T09:14:03.339671+0000","last_became_peered":"2024-04-25T09:14:03.339671+0000","last_unstale":"2024-04-25T09:14:05.363648+0000","last_undegraded":"2024-04-25T09:14:05.363648+0000","last_fullsized":"2024-04-25T09:14:05.363648+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:36.271610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359375+0000","last_change":"2024-04-25T09:14:04.350695+0000","last_active":"2024-04-25T09:14:05.359375+0000","last_peered":"2024-04-25T09:14:05.359375+0000","last_clean":"2024-04-25T09:14:05.359375+0000","last_became_active":"2024-04-25T09:14:04.350424+0000","last_became_peered":"2024-04-25T09:14:04.350424+0000","last_unstale":"2024-04-25T09:14:05.359375+0000","last_undegraded":"2024-04-25T09:14:05.359375+0000","last_fullsized":"2024-04-25T09:14:05.359375+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:58.178701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214675+0000","last_change":"2024-04-25T09:14:03.319291+0000","last_active":"2024-04-25T09:14:06.214675+0000","last_peered":"2024-04-25T09:14:06.214675+0000","last_clean":"2024-04-25T09:14:06.214675+0000","last_became_active":"2024-04-25T09:14:03.318990+0000","last_became_peered":"2024-04-25T09:14:03.318990+0000","last_unstale":"2024-04-25T09:14:06.214675+0000","last_undegraded":"2024-04-25T09:14:06.214675+0000","last_fullsized":"2024-04-25T09:14:06.214675+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:47.056967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213275+0000","last_change":"2024-04-25T09:14:04.343993+0000","last_active":"2024-04-25T09:14:06.213275+0000","last_peered":"2024-04-25T09:14:06.213275+0000","last_clean":"2024-04-25T09:14:06.213275+0000","last_became_active":"2024-04-25T09:14:04.343538+0000","last_became_peered":"2024-04-25T09:14:04.343538+0000","last_unstale":"2024-04-25T09:14:06.213275+0000","last_undegraded":"2024-04-25T09:14:06.213275+0000","last_fullsized":"2024-04-25T09:14:06.213275+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:55.451368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.358864+0000","last_change":"2024-04-25T09:14:03.325113+0000","last_active":"2024-04-25T09:14:05.358864+0000","last_peered":"2024-04-25T09:14:05.358864+0000","last_clean":"2024-04-25T09:14:05.358864+0000","last_became_active":"2024-04-25T09:14:03.324710+0000","last_became_peered":"2024-04-25T09:14:03.324710+0000","last_unstale":"2024-04-25T09:14:05.358864+0000","last_undegraded":"2024-04-25T09:14:05.358864+0000","last_fullsized":"2024-04-25T09:14:05.358864+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:49:25.021792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.363728+0000","last_change":"2024-04-25T09:14:04.351818+0000","last_active":"2024-04-25T09:14:05.363728+0000","last_peered":"2024-04-25T09:14:05.363728+0000","last_clean":"2024-04-25T09:14:05.363728+0000","last_became_active":"2024-04-25T09:14:04.351518+0000","last_became_peered":"2024-04-25T09:14:04.351518+0000","last_unstale":"2024-04-25T09:14:05.363728+0000","last_undegraded":"2024-04-25T09:14:05.363728+0000","last_fullsized":"2024-04-25T09:14:05.363728+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:49.541041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213332+0000","last_change":"2024-04-25T09:14:03.340681+0000","last_active":"2024-04-25T09:14:06.213332+0000","last_peered":"2024-04-25T09:14:06.213332+0000","last_clean":"2024-04-25T09:14:06.213332+0000","last_became_active":"2024-04-25T09:14:03.339982+0000","last_became_peered":"2024-04-25T09:14:03.339982+0000","last_unstale":"2024-04-25T09:14:06.213332+0000","last_undegraded":"2024-04-25T09:14:06.213332+0000","last_fullsized":"2024-04-25T09:14:06.213332+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:25.611869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.364067+0000","last_change":"2024-04-25T09:14:04.359561+0000","last_active":"2024-04-25T09:14:05.364067+0000","last_peered":"2024-04-25T09:14:05.364067+0000","last_clean":"2024-04-25T09:14:05.364067+0000","last_became_active":"2024-04-25T09:14:04.359060+0000","last_became_peered":"2024-04-25T09:14:04.359060+0000","last_unstale":"2024-04-25T09:14:05.364067+0000","last_undegraded":"2024-04-25T09:14:05.364067+0000","last_fullsized":"2024-04-25T09:14:05.364067+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:45.983328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.351864+0000","last_change":"2024-04-25T09:14:03.342321+0000","last_active":"2024-04-25T09:14:05.351864+0000","last_peered":"2024-04-25T09:14:05.351864+0000","last_clean":"2024-04-25T09:14:05.351864+0000","last_became_active":"2024-04-25T09:14:03.341934+0000","last_became_peered":"2024-04-25T09:14:03.341934+0000","last_unstale":"2024-04-25T09:14:05.351864+0000","last_undegraded":"2024-04-25T09:14:05.351864+0000","last_fullsized":"2024-04-25T09:14:05.351864+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:44.763298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.361289+0000","last_change":"2024-04-25T09:14:04.349376+0000","last_active":"2024-04-25T09:14:05.361289+0000","last_peered":"2024-04-25T09:14:05.361289+0000","last_clean":"2024-04-25T09:14:05.361289+0000","last_became_active":"2024-04-25T09:14:04.349078+0000","last_became_peered":"2024-04-25T09:14:04.349078+0000","last_unstale":"2024-04-25T09:14:05.361289+0000","last_undegraded":"2024-04-25T09:14:05.361289+0000","last_fullsized":"2024-04-25T09:14:05.361289+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:13.019189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214028+0000","last_change":"2024-04-25T09:14:03.324050+0000","last_active":"2024-04-25T09:14:06.214028+0000","last_peered":"2024-04-25T09:14:06.214028+0000","last_clean":"2024-04-25T09:14:06.214028+0000","last_became_active":"2024-04-25T09:14:03.323761+0000","last_became_peered":"2024-04-25T09:14:03.323761+0000","last_unstale":"2024-04-25T09:14:06.214028+0000","last_undegraded":"2024-04-25T09:14:06.214028+0000","last_fullsized":"2024-04-25T09:14:06.214028+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:21.789534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214611+0000","last_change":"2024-04-25T09:14:04.335719+0000","last_active":"2024-04-25T09:14:06.214611+0000","last_peered":"2024-04-25T09:14:06.214611+0000","last_clean":"2024-04-25T09:14:06.214611+0000","last_became_active":"2024-04-25T09:14:04.335420+0000","last_became_peered":"2024-04-25T09:14:04.335420+0000","last_unstale":"2024-04-25T09:14:06.214611+0000","last_undegraded":"2024-04-25T09:14:06.214611+0000","last_fullsized":"2024-04-25T09:14:06.214611+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:07.353763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"112'3","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214332+0000","last_change":"2024-04-25T09:14:03.337704+0000","last_active":"2024-04-25T09:14:06.214332+0000","last_peered":"2024-04-25T09:14:06.214332+0000","last_clean":"2024-04-25T09:14:06.214332+0000","last_became_active":"2024-04-25T09:14:03.337361+0000","last_became_peered":"2024-04-25T09:14:03.337361+0000","last_unstale":"2024-04-25T09:14:06.214332+0000","last_undegraded":"2024-04-25T09:14:06.214332+0000","last_fullsized":"2024-04-25T09:14:06.214332+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:16.560010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.363945+0000","last_change":"2024-04-25T09:14:04.355750+0000","last_active":"2024-04-25T09:14:05.363945+0000","last_peered":"2024-04-25T09:14:05.363945+0000","last_clean":"2024-04-25T09:14:05.363945+0000","last_became_active":"2024-04-25T09:14:04.355473+0000","last_became_peered":"2024-04-25T09:14:04.355473+0000","last_unstale":"2024-04-25T09:14:05.363945+0000","last_undegraded":"2024-04-25T09:14:05.363945+0000","last_fullsized":"2024-04-25T09:14:05.363945+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:50.297260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"112'6","reported_seq":20,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214907+0000","last_change":"2024-04-25T09:14:03.340179+0000","last_active":"2024-04-25T09:14:06.214907+0000","last_peered":"2024-04-25T09:14:06.214907+0000","last_clean":"2024-04-25T09:14:06.214907+0000","last_became_active":"2024-04-25T09:14:03.339870+0000","last_became_peered":"2024-04-25T09:14:03.339870+0000","last_unstale":"2024-04-25T09:14:06.214907+0000","last_undegraded":"2024-04-25T09:14:06.214907+0000","last_fullsized":"2024-04-25T09:14:06.214907+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:49.257070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214619+0000","last_change":"2024-04-25T09:14:04.352625+0000","last_active":"2024-04-25T09:14:06.214619+0000","last_peered":"2024-04-25T09:14:06.214619+0000","last_clean":"2024-04-25T09:14:06.214619+0000","last_became_active":"2024-04-25T09:14:04.352314+0000","last_became_peered":"2024-04-25T09:14:04.352314+0000","last_unstale":"2024-04-25T09:14:06.214619+0000","last_undegraded":"2024-04-25T09:14:06.214619+0000","last_fullsized":"2024-04-25T09:14:06.214619+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:52.318210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214617+0000","last_change":"2024-04-25T09:14:03.329992+0000","last_active":"2024-04-25T09:14:06.214617+0000","last_peered":"2024-04-25T09:14:06.214617+0000","last_clean":"2024-04-25T09:14:06.214617+0000","last_became_active":"2024-04-25T09:14:03.329562+0000","last_became_peered":"2024-04-25T09:14:03.329562+0000","last_unstale":"2024-04-25T09:14:06.214617+0000","last_undegraded":"2024-04-25T09:14:06.214617+0000","last_fullsized":"2024-04-25T09:14:06.214617+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:19.543443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214924+0000","last_change":"2024-04-25T09:14:04.356907+0000","last_active":"2024-04-25T09:14:06.214924+0000","last_peered":"2024-04-25T09:14:06.214924+0000","last_clean":"2024-04-25T09:14:06.214924+0000","last_became_active":"2024-04-25T09:14:04.355586+0000","last_became_peered":"2024-04-25T09:14:04.355586+0000","last_unstale":"2024-04-25T09:14:06.214924+0000","last_undegraded":"2024-04-25T09:14:06.214924+0000","last_fullsized":"2024-04-25T09:14:06.214924+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:34.372237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.360850+0000","last_change":"2024-04-25T09:14:03.337335+0000","last_active":"2024-04-25T09:14:05.360850+0000","last_peered":"2024-04-25T09:14:05.360850+0000","last_clean":"2024-04-25T09:14:05.360850+0000","last_became_active":"2024-04-25T09:14:03.336960+0000","last_became_peered":"2024-04-25T09:14:03.336960+0000","last_unstale":"2024-04-25T09:14:05.360850+0000","last_undegraded":"2024-04-25T09:14:05.360850+0000","last_fullsized":"2024-04-25T09:14:05.360850+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:16.941753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214414+0000","last_change":"2024-04-25T09:14:04.344204+0000","last_active":"2024-04-25T09:14:06.214414+0000","last_peered":"2024-04-25T09:14:06.214414+0000","last_clean":"2024-04-25T09:14:06.214414+0000","last_became_active":"2024-04-25T09:14:04.343872+0000","last_became_peered":"2024-04-25T09:14:04.343872+0000","last_unstale":"2024-04-25T09:14:06.214414+0000","last_undegraded":"2024-04-25T09:14:06.214414+0000","last_fullsized":"2024-04-25T09:14:06.214414+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:29.594157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"112'8","reported_seq":22,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.351468+0000","last_change":"2024-04-25T09:14:03.339734+0000","last_active":"2024-04-25T09:14:05.351468+0000","last_peered":"2024-04-25T09:14:05.351468+0000","last_clean":"2024-04-25T09:14:05.351468+0000","last_became_active":"2024-04-25T09:14:03.339219+0000","last_became_peered":"2024-04-25T09:14:03.339219+0000","last_unstale":"2024-04-25T09:14:05.351468+0000","last_undegraded":"2024-04-25T09:14:05.351468+0000","last_fullsized":"2024-04-25T09:14:05.351468+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:30:50.878791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.351981+0000","last_change":"2024-04-25T09:14:04.353665+0000","last_active":"2024-04-25T09:14:05.351981+0000","last_peered":"2024-04-25T09:14:05.351981+0000","last_clean":"2024-04-25T09:14:05.351981+0000","last_became_active":"2024-04-25T09:14:04.353370+0000","last_became_peered":"2024-04-25T09:14:04.353370+0000","last_unstale":"2024-04-25T09:14:05.351981+0000","last_undegraded":"2024-04-25T09:14:05.351981+0000","last_fullsized":"2024-04-25T09:14:05.351981+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:00.877922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215691+0000","last_change":"2024-04-25T09:14:03.335088+0000","last_active":"2024-04-25T09:14:06.215691+0000","last_peered":"2024-04-25T09:14:06.215691+0000","last_clean":"2024-04-25T09:14:06.215691+0000","last_became_active":"2024-04-25T09:14:03.334776+0000","last_became_peered":"2024-04-25T09:14:03.334776+0000","last_unstale":"2024-04-25T09:14:06.215691+0000","last_undegraded":"2024-04-25T09:14:06.215691+0000","last_fullsized":"2024-04-25T09:14:06.215691+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:50.533881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215405+0000","last_change":"2024-04-25T09:14:04.340292+0000","last_active":"2024-04-25T09:14:06.215405+0000","last_peered":"2024-04-25T09:14:06.215405+0000","last_clean":"2024-04-25T09:14:06.215405+0000","last_became_active":"2024-04-25T09:14:04.340036+0000","last_became_peered":"2024-04-25T09:14:04.340036+0000","last_unstale":"2024-04-25T09:14:06.215405+0000","last_undegraded":"2024-04-25T09:14:06.215405+0000","last_fullsized":"2024-04-25T09:14:06.215405+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:40.999679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.351913+0000","last_change":"2024-04-25T09:14:03.335889+0000","last_active":"2024-04-25T09:14:05.351913+0000","last_peered":"2024-04-25T09:14:05.351913+0000","last_clean":"2024-04-25T09:14:05.351913+0000","last_became_active":"2024-04-25T09:14:03.335633+0000","last_became_peered":"2024-04-25T09:14:03.335633+0000","last_unstale":"2024-04-25T09:14:05.351913+0000","last_undegraded":"2024-04-25T09:14:05.351913+0000","last_fullsized":"2024-04-25T09:14:05.351913+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:26.360637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981153+0000","last_change":"2024-04-25T09:14:04.361640+0000","last_active":"2024-04-25T09:14:05.981153+0000","last_peered":"2024-04-25T09:14:05.981153+0000","last_clean":"2024-04-25T09:14:05.981153+0000","last_became_active":"2024-04-25T09:14:04.361382+0000","last_became_peered":"2024-04-25T09:14:04.361382+0000","last_unstale":"2024-04-25T09:14:05.981153+0000","last_undegraded":"2024-04-25T09:14:05.981153+0000","last_fullsized":"2024-04-25T09:14:05.981153+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:20.531294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"112'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.360953+0000","last_change":"2024-04-25T09:14:03.322155+0000","last_active":"2024-04-25T09:14:05.360953+0000","last_peered":"2024-04-25T09:14:05.360953+0000","last_clean":"2024-04-25T09:14:05.360953+0000","last_became_active":"2024-04-25T09:14:03.321827+0000","last_became_peered":"2024-04-25T09:14:03.321827+0000","last_unstale":"2024-04-25T09:14:05.360953+0000","last_undegraded":"2024-04-25T09:14:05.360953+0000","last_fullsized":"2024-04-25T09:14:05.360953+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:00.958914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981442+0000","last_change":"2024-04-25T09:14:04.355335+0000","last_active":"2024-04-25T09:14:05.981442+0000","last_peered":"2024-04-25T09:14:05.981442+0000","last_clean":"2024-04-25T09:14:05.981442+0000","last_became_active":"2024-04-25T09:14:04.354688+0000","last_became_peered":"2024-04-25T09:14:04.354688+0000","last_unstale":"2024-04-25T09:14:05.981442+0000","last_undegraded":"2024-04-25T09:14:05.981442+0000","last_fullsized":"2024-04-25T09:14:05.981442+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:52.318210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.363673+0000","last_change":"2024-04-25T09:14:03.344644+0000","last_active":"2024-04-25T09:14:05.363673+0000","last_peered":"2024-04-25T09:14:05.363673+0000","last_clean":"2024-04-25T09:14:05.363673+0000","last_became_active":"2024-04-25T09:14:03.344378+0000","last_became_peered":"2024-04-25T09:14:03.344378+0000","last_unstale":"2024-04-25T09:14:05.363673+0000","last_undegraded":"2024-04-25T09:14:05.363673+0000","last_fullsized":"2024-04-25T09:14:05.363673+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:42.965425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981201+0000","last_change":"2024-04-25T09:14:04.354610+0000","last_active":"2024-04-25T09:14:05.981201+0000","last_peered":"2024-04-25T09:14:05.981201+0000","last_clean":"2024-04-25T09:14:05.981201+0000","last_became_active":"2024-04-25T09:14:04.354344+0000","last_became_peered":"2024-04-25T09:14:04.354344+0000","last_unstale":"2024-04-25T09:14:05.981201+0000","last_undegraded":"2024-04-25T09:14:05.981201+0000","last_fullsized":"2024-04-25T09:14:05.981201+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:12.746470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214733+0000","last_change":"2024-04-25T09:14:03.337500+0000","last_active":"2024-04-25T09:14:06.214733+0000","last_peered":"2024-04-25T09:14:06.214733+0000","last_clean":"2024-04-25T09:14:06.214733+0000","last_became_active":"2024-04-25T09:14:03.337238+0000","last_became_peered":"2024-04-25T09:14:03.337238+0000","last_unstale":"2024-04-25T09:14:06.214733+0000","last_undegraded":"2024-04-25T09:14:06.214733+0000","last_fullsized":"2024-04-25T09:14:06.214733+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:51.968883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214135+0000","last_change":"2024-04-25T09:14:04.349925+0000","last_active":"2024-04-25T09:14:06.214135+0000","last_peered":"2024-04-25T09:14:06.214135+0000","last_clean":"2024-04-25T09:14:06.214135+0000","last_became_active":"2024-04-25T09:14:04.349635+0000","last_became_peered":"2024-04-25T09:14:04.349635+0000","last_unstale":"2024-04-25T09:14:06.214135+0000","last_undegraded":"2024-04-25T09:14:06.214135+0000","last_fullsized":"2024-04-25T09:14:06.214135+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:32:39.441854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.351603+0000","last_change":"2024-04-25T09:14:03.337154+0000","last_active":"2024-04-25T09:14:05.351603+0000","last_peered":"2024-04-25T09:14:05.351603+0000","last_clean":"2024-04-25T09:14:05.351603+0000","last_became_active":"2024-04-25T09:14:03.336850+0000","last_became_peered":"2024-04-25T09:14:03.336850+0000","last_unstale":"2024-04-25T09:14:05.351603+0000","last_undegraded":"2024-04-25T09:14:05.351603+0000","last_fullsized":"2024-04-25T09:14:05.351603+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:31.404258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.980918+0000","last_change":"2024-04-25T09:14:04.356889+0000","last_active":"2024-04-25T09:14:05.980918+0000","last_peered":"2024-04-25T09:14:05.980918+0000","last_clean":"2024-04-25T09:14:05.980918+0000","last_became_active":"2024-04-25T09:14:04.356333+0000","last_became_peered":"2024-04-25T09:14:04.356333+0000","last_unstale":"2024-04-25T09:14:05.980918+0000","last_undegraded":"2024-04-25T09:14:05.980918+0000","last_fullsized":"2024-04-25T09:14:05.980918+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:51.542126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213756+0000","last_change":"2024-04-25T09:14:03.333663+0000","last_active":"2024-04-25T09:14:06.213756+0000","last_peered":"2024-04-25T09:14:06.213756+0000","last_clean":"2024-04-25T09:14:06.213756+0000","last_became_active":"2024-04-25T09:14:03.333401+0000","last_became_peered":"2024-04-25T09:14:03.333401+0000","last_unstale":"2024-04-25T09:14:06.213756+0000","last_undegraded":"2024-04-25T09:14:06.213756+0000","last_fullsized":"2024-04-25T09:14:06.213756+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:55.762900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213978+0000","last_change":"2024-04-25T09:14:04.336912+0000","last_active":"2024-04-25T09:14:06.213978+0000","last_peered":"2024-04-25T09:14:06.213978+0000","last_clean":"2024-04-25T09:14:06.213978+0000","last_became_active":"2024-04-25T09:14:04.336666+0000","last_became_peered":"2024-04-25T09:14:04.336666+0000","last_unstale":"2024-04-25T09:14:06.213978+0000","last_undegraded":"2024-04-25T09:14:06.213978+0000","last_fullsized":"2024-04-25T09:14:06.213978+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:52.709749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213439+0000","last_change":"2024-04-25T09:14:03.332525+0000","last_active":"2024-04-25T09:14:06.213439+0000","last_peered":"2024-04-25T09:14:06.213439+0000","last_clean":"2024-04-25T09:14:06.213439+0000","last_became_active":"2024-04-25T09:14:03.331763+0000","last_became_peered":"2024-04-25T09:14:03.331763+0000","last_unstale":"2024-04-25T09:14:06.213439+0000","last_undegraded":"2024-04-25T09:14:06.213439+0000","last_fullsized":"2024-04-25T09:14:06.213439+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:38.757399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.361280+0000","last_change":"2024-04-25T09:14:04.348584+0000","last_active":"2024-04-25T09:14:05.361280+0000","last_peered":"2024-04-25T09:14:05.361280+0000","last_clean":"2024-04-25T09:14:05.361280+0000","last_became_active":"2024-04-25T09:14:04.348030+0000","last_became_peered":"2024-04-25T09:14:04.348030+0000","last_unstale":"2024-04-25T09:14:05.361280+0000","last_undegraded":"2024-04-25T09:14:05.361280+0000","last_fullsized":"2024-04-25T09:14:05.361280+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:40.879528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"112'2","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214297+0000","last_change":"2024-04-25T09:14:03.337532+0000","last_active":"2024-04-25T09:14:06.214297+0000","last_peered":"2024-04-25T09:14:06.214297+0000","last_clean":"2024-04-25T09:14:06.214297+0000","last_became_active":"2024-04-25T09:14:03.337214+0000","last_became_peered":"2024-04-25T09:14:03.337214+0000","last_unstale":"2024-04-25T09:14:06.214297+0000","last_undegraded":"2024-04-25T09:14:06.214297+0000","last_fullsized":"2024-04-25T09:14:06.214297+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:32:16.054480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215617+0000","last_change":"2024-04-25T09:14:04.347517+0000","last_active":"2024-04-25T09:14:06.215617+0000","last_peered":"2024-04-25T09:14:06.215617+0000","last_clean":"2024-04-25T09:14:06.215617+0000","last_became_active":"2024-04-25T09:14:04.347192+0000","last_became_peered":"2024-04-25T09:14:04.347192+0000","last_unstale":"2024-04-25T09:14:06.215617+0000","last_undegraded":"2024-04-25T09:14:06.215617+0000","last_fullsized":"2024-04-25T09:14:06.215617+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:51.468069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"113'1","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.361214+0000","last_change":"2024-04-25T09:14:03.333332+0000","last_active":"2024-04-25T09:14:05.361214+0000","last_peered":"2024-04-25T09:14:05.361214+0000","last_clean":"2024-04-25T09:14:05.361214+0000","last_became_active":"2024-04-25T09:14:03.331991+0000","last_became_peered":"2024-04-25T09:14:03.331991+0000","last_unstale":"2024-04-25T09:14:05.361214+0000","last_undegraded":"2024-04-25T09:14:05.361214+0000","last_fullsized":"2024-04-25T09:14:05.361214+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:37.688449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.215093+0000","last_change":"2024-04-25T09:14:04.346320+0000","last_active":"2024-04-25T09:14:06.215093+0000","last_peered":"2024-04-25T09:14:06.215093+0000","last_clean":"2024-04-25T09:14:06.215093+0000","last_became_active":"2024-04-25T09:14:04.345731+0000","last_became_peered":"2024-04-25T09:14:04.345731+0000","last_unstale":"2024-04-25T09:14:06.215093+0000","last_undegraded":"2024-04-25T09:14:06.215093+0000","last_fullsized":"2024-04-25T09:14:06.215093+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:54:28.655533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214455+0000","last_change":"2024-04-25T09:14:03.333389+0000","last_active":"2024-04-25T09:14:06.214455+0000","last_peered":"2024-04-25T09:14:06.214455+0000","last_clean":"2024-04-25T09:14:06.214455+0000","last_became_active":"2024-04-25T09:14:03.333114+0000","last_became_peered":"2024-04-25T09:14:03.333114+0000","last_unstale":"2024-04-25T09:14:06.214455+0000","last_undegraded":"2024-04-25T09:14:06.214455+0000","last_fullsized":"2024-04-25T09:14:06.214455+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:56:16.451114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.361019+0000","last_change":"2024-04-25T09:14:04.348337+0000","last_active":"2024-04-25T09:14:05.361019+0000","last_peered":"2024-04-25T09:14:05.361019+0000","last_clean":"2024-04-25T09:14:05.361019+0000","last_became_active":"2024-04-25T09:14:04.347687+0000","last_became_peered":"2024-04-25T09:14:04.347687+0000","last_unstale":"2024-04-25T09:14:05.361019+0000","last_undegraded":"2024-04-25T09:14:05.361019+0000","last_fullsized":"2024-04-25T09:14:05.361019+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:45.983328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.214667+0000","last_change":"2024-04-25T09:14:03.330446+0000","last_active":"2024-04-25T09:14:06.214667+0000","last_peered":"2024-04-25T09:14:06.214667+0000","last_clean":"2024-04-25T09:14:06.214667+0000","last_became_active":"2024-04-25T09:14:03.330148+0000","last_became_peered":"2024-04-25T09:14:03.330148+0000","last_unstale":"2024-04-25T09:14:06.214667+0000","last_undegraded":"2024-04-25T09:14:06.214667+0000","last_fullsized":"2024-04-25T09:14:06.214667+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:12.181416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359060+0000","last_change":"2024-04-25T09:14:04.348362+0000","last_active":"2024-04-25T09:14:05.359060+0000","last_peered":"2024-04-25T09:14:05.359060+0000","last_clean":"2024-04-25T09:14:05.359060+0000","last_became_active":"2024-04-25T09:14:04.347457+0000","last_became_peered":"2024-04-25T09:14:04.347457+0000","last_unstale":"2024-04-25T09:14:05.359060+0000","last_undegraded":"2024-04-25T09:14:05.359060+0000","last_fullsized":"2024-04-25T09:14:05.359060+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:13.189661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.363824+0000","last_change":"2024-04-25T09:14:03.335245+0000","last_active":"2024-04-25T09:14:05.363824+0000","last_peered":"2024-04-25T09:14:05.363824+0000","last_clean":"2024-04-25T09:14:05.363824+0000","last_became_active":"2024-04-25T09:14:03.334920+0000","last_became_peered":"2024-04-25T09:14:03.334920+0000","last_unstale":"2024-04-25T09:14:05.363824+0000","last_undegraded":"2024-04-25T09:14:05.363824+0000","last_fullsized":"2024-04-25T09:14:05.363824+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:33:05.369694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.359307+0000","last_change":"2024-04-25T09:14:04.352817+0000","last_active":"2024-04-25T09:14:05.359307+0000","last_peered":"2024-04-25T09:14:05.359307+0000","last_clean":"2024-04-25T09:14:05.359307+0000","last_became_active":"2024-04-25T09:14:04.352456+0000","last_became_peered":"2024-04-25T09:14:04.352456+0000","last_unstale":"2024-04-25T09:14:05.359307+0000","last_undegraded":"2024-04-25T09:14:05.359307+0000","last_fullsized":"2024-04-25T09:14:05.359307+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:39.765644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.358986+0000","last_change":"2024-04-25T09:14:03.334226+0000","last_active":"2024-04-25T09:14:05.358986+0000","last_peered":"2024-04-25T09:14:05.358986+0000","last_clean":"2024-04-25T09:14:05.358986+0000","last_became_active":"2024-04-25T09:14:03.333395+0000","last_became_peered":"2024-04-25T09:14:03.333395+0000","last_unstale":"2024-04-25T09:14:05.358986+0000","last_undegraded":"2024-04-25T09:14:05.358986+0000","last_fullsized":"2024-04-25T09:14:05.358986+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:48.532796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981281+0000","last_change":"2024-04-25T09:14:04.356744+0000","last_active":"2024-04-25T09:14:05.981281+0000","last_peered":"2024-04-25T09:14:05.981281+0000","last_clean":"2024-04-25T09:14:05.981281+0000","last_became_active":"2024-04-25T09:14:04.355973+0000","last_became_peered":"2024-04-25T09:14:04.355973+0000","last_unstale":"2024-04-25T09:14:05.981281+0000","last_undegraded":"2024-04-25T09:14:05.981281+0000","last_fullsized":"2024-04-25T09:14:05.981281+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:52.709749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.351474+0000","last_change":"2024-04-25T09:14:03.342252+0000","last_active":"2024-04-25T09:14:05.351474+0000","last_peered":"2024-04-25T09:14:05.351474+0000","last_clean":"2024-04-25T09:14:05.351474+0000","last_became_active":"2024-04-25T09:14:03.341939+0000","last_became_peered":"2024-04-25T09:14:03.341939+0000","last_unstale":"2024-04-25T09:14:05.351474+0000","last_undegraded":"2024-04-25T09:14:05.351474+0000","last_fullsized":"2024-04-25T09:14:05.351474+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:20.291248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213671+0000","last_change":"2024-04-25T09:14:04.342991+0000","last_active":"2024-04-25T09:14:06.213671+0000","last_peered":"2024-04-25T09:14:06.213671+0000","last_clean":"2024-04-25T09:14:06.213671+0000","last_became_active":"2024-04-25T09:14:04.341900+0000","last_became_peered":"2024-04-25T09:14:04.341900+0000","last_unstale":"2024-04-25T09:14:06.213671+0000","last_undegraded":"2024-04-25T09:14:06.213671+0000","last_fullsized":"2024-04-25T09:14:06.213671+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:37.861976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213499+0000","last_change":"2024-04-25T09:14:03.332954+0000","last_active":"2024-04-25T09:14:06.213499+0000","last_peered":"2024-04-25T09:14:06.213499+0000","last_clean":"2024-04-25T09:14:06.213499+0000","last_became_active":"2024-04-25T09:14:03.332259+0000","last_became_peered":"2024-04-25T09:14:03.332259+0000","last_unstale":"2024-04-25T09:14:06.213499+0000","last_undegraded":"2024-04-25T09:14:06.213499+0000","last_fullsized":"2024-04-25T09:14:06.213499+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:57.170456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:06.213677+0000","last_change":"2024-04-25T09:14:04.356252+0000","last_active":"2024-04-25T09:14:06.213677+0000","last_peered":"2024-04-25T09:14:06.213677+0000","last_clean":"2024-04-25T09:14:06.213677+0000","last_became_active":"2024-04-25T09:14:04.355634+0000","last_became_peered":"2024-04-25T09:14:04.355634+0000","last_unstale":"2024-04-25T09:14:06.213677+0000","last_undegraded":"2024-04-25T09:14:06.213677+0000","last_fullsized":"2024-04-25T09:14:06.213677+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:03.305984+0000","last_clean_scrub_stamp":"2024-04-25T09:14:03.305984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:12.746470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.363824+0000","last_change":"2024-04-25T09:14:03.344653+0000","last_active":"2024-04-25T09:14:05.363824+0000","last_peered":"2024-04-25T09:14:05.363824+0000","last_clean":"2024-04-25T09:14:05.363824+0000","last_became_active":"2024-04-25T09:14:03.344373+0000","last_became_peered":"2024-04-25T09:14:03.344373+0000","last_unstale":"2024-04-25T09:14:05.363824+0000","last_undegraded":"2024-04-25T09:14:05.363824+0000","last_fullsized":"2024-04-25T09:14:05.363824+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:14:02.297739+0000","last_clean_scrub_stamp":"2024-04-25T09:14:02.297739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:54.384353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":344,"reported_epoch":113,"state":"active+clean","last_fresh":"2024-04-25T09:14:05.981208+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:14:05.981208+0000","last_peered":"2024-04-25T09:14:05.981208+0000","last_clean":"2024-04-25T09:14:05.981208+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:14:05.981208+0000","last_undegraded":"2024-04-25T09:14:05.981208+0000","last_fullsized":"2024-04-25T09:14:05.981208+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574973,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33140,"kb_used_data":1960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338700,"statfs":{"total":96636764160,"available":96602828800,"internally_reserved":0,"allocated":2007040,"data_stored":1201101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574975,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1409024,"data_stored":610187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574972,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1413120,"data_stored":610721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574972,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1404928,"data_stored":610117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574974,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32568,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339272,"statfs":{"total":96636764160,"available":96603414528,"internally_reserved":0,"allocated":1421312,"data_stored":611799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574974,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1404928,"data_stored":610117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574973,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1413120,"data_stored":610241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574976,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33152,"kb_used_data":1972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338688,"statfs":{"total":96636764160,"available":96602816512,"internally_reserved":0,"allocated":2019328,"data_stored":1202209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:14:08.780 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:14:08.781 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:14:08.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.972+0000 7f9959600640 1 Processor -- start 2024-04-25T09:14:08.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.972+0000 7f9959600640 1 -- start start 2024-04-25T09:14:08.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.972+0000 7f9959600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f995415be00 0x7f995415c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:08.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.972+0000 7f9959600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995409a460 0x7f995409a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:08.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.972+0000 7f9959600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995415c720 con 0x7f995415f340 2024-04-25T09:14:08.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.972+0000 7f9959600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99540cc0d0 con 0x7f995415be00 2024-04-25T09:14:08.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.972+0000 7f9959600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99540d0210 con 0x7f995409a460 2024-04-25T09:14:08.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.976+0000 7f9953400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995409a460 0x7f995409a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:08.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.976+0000 7f9953400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995409a460 0x7f995409a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:33680/0 (socket says 172.21.15.175:33680) 2024-04-25T09:14:08.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.976+0000 7f9953e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f995415be00 0x7f995415c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:08.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.976+0000 7f9953400640 1 -- 172.21.15.175:0/3441541667 learned_addr learned my addr 172.21.15.175:0/3441541667 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:08.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.976+0000 7f9958c00640 1 --1- 172.21.15.175:0/3441541667 >> v1:172.21.15.177:6789/0 conn(0x7f995415f340 0x7f995415f7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:41146/0 (socket says 172.21.15.175:41146) 2024-04-25T09:14:08.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.976+0000 7f9953400640 1 -- 172.21.15.175:0/3441541667 >> v2:172.21.15.177:3300/0 conn(0x7f995415be00 msgr2=0x7f995415c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:08.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.976+0000 7f9953400640 1 --2- 172.21.15.175:0/3441541667 >> v2:172.21.15.177:3300/0 conn(0x7f995415be00 0x7f995415c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.976+0000 7f9953400640 1 -- 172.21.15.175:0/3441541667 >> v1:172.21.15.177:6789/0 conn(0x7f995415f340 legacy=0x7f995415f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:08.962 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.976+0000 7f9953400640 1 -- 172.21.15.175:0/3441541667 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995415bbd0 con 0x7f995409a460 2024-04-25T09:14:08.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.976+0000 7f9953e00640 1 --2- 172.21.15.175:0/3441541667 >> v2:172.21.15.177:3300/0 conn(0x7f995415be00 0x7f995415c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:08.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.976+0000 7f9953400640 1 --2- 172.21.15.175:0/3441541667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995409a460 0x7f995409a8e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9940009870 tx=0x7f994001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fed5b57f05aa8ce4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:08.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.976+0000 7f9952a00640 1 -- 172.21.15.175:0/3441541667 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99400aa600 con 0x7f995409a460 2024-04-25T09:14:08.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9952a00640 1 -- 172.21.15.175:0/3441541667 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99400af070 con 0x7f995409a460 2024-04-25T09:14:08.965 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9952a00640 1 -- 172.21.15.175:0/3441541667 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99400aa9c0 con 0x7f995409a460 2024-04-25T09:14:08.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9959600640 1 -- 172.21.15.175:0/3441541667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995409a460 msgr2=0x7f995409a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:08.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9959600640 1 --2- 172.21.15.175:0/3441541667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995409a460 0x7f995409a8e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9940009870 tx=0x7f994001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9959600640 1 -- 172.21.15.175:0/3441541667 shutdown_connections 2024-04-25T09:14:08.966 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9959600640 1 --2- 172.21.15.175:0/3441541667 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995409a460 0x7f995409a8e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9959600640 1 --2- 172.21.15.175:0/3441541667 >> v2:172.21.15.177:3300/0 conn(0x7f995415be00 0x7f995415c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9959600640 1 -- 172.21.15.175:0/3441541667 >> 172.21.15.175:0/3441541667 conn(0x7f99540b3120 msgr2=0x7f99540b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:08.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9959600640 1 -- 172.21.15.175:0/3441541667 shutdown_connections 2024-04-25T09:14:08.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9959600640 1 -- 172.21.15.175:0/3441541667 wait complete. 2024-04-25T09:14:08.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9959600640 1 Processor -- start 2024-04-25T09:14:08.968 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9959600640 1 -- start start 2024-04-25T09:14:08.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9959600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995409a460 0x7f995414d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:08.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9959600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f995415be00 0x7f995415df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:08.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9959600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f995415f340 0x7f995415e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:08.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9959600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99540cce80 con 0x7f995415be00 2024-04-25T09:14:08.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9959600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99540ccba0 con 0x7f995415f340 2024-04-25T09:14:08.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9959600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995415cbc0 con 0x7f995409a460 2024-04-25T09:14:08.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9953400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f995415be00 0x7f995415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:08.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9953400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f995415be00 0x7f995415df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:32916/0 (socket says 172.21.15.175:32916) 2024-04-25T09:14:08.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.980+0000 7f9953400640 1 -- 172.21.15.175:0/158705248 learned_addr learned my addr 172.21.15.175:0/158705248 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:08.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.984+0000 7f9958c00640 1 --2- 172.21.15.175:0/158705248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f995415f340 0x7f995415e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:08.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.984+0000 7f9953e00640 1 --2- 172.21.15.175:0/158705248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995409a460 0x7f995414d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:08.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.984+0000 7f9953400640 1 -- 172.21.15.175:0/158705248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995409a460 msgr2=0x7f995414d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:08.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.984+0000 7f9953400640 1 --2- 172.21.15.175:0/158705248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995409a460 0x7f995414d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.984+0000 7f9953400640 1 -- 172.21.15.175:0/158705248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f995415f340 msgr2=0x7f995415e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:08.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.984+0000 7f9953400640 1 --2- 172.21.15.175:0/158705248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f995415f340 0x7f995415e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:08.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.984+0000 7f9953400640 1 -- 172.21.15.175:0/158705248 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99540c7940 con 0x7f995415be00 2024-04-25T09:14:08.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.984+0000 7f9953400640 1 --2- 172.21.15.175:0/158705248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f995415be00 0x7f995415df90 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f99400ac040 tx=0x7f994001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:08.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.984+0000 7f994be00640 1 -- 172.21.15.175:0/158705248 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99400bd5f0 con 0x7f995415be00 2024-04-25T09:14:08.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.984+0000 7f994be00640 1 -- 172.21.15.175:0/158705248 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99400aae50 con 0x7f995415be00 2024-04-25T09:14:08.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.984+0000 7f994be00640 1 -- 172.21.15.175:0/158705248 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99400bd9d0 con 0x7f995415be00 2024-04-25T09:14:08.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.984+0000 7f9959600640 1 -- 172.21.15.175:0/158705248 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99540c5300 con 0x7f995415be00 2024-04-25T09:14:08.971 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.984+0000 7f9959600640 1 -- 172.21.15.175:0/158705248 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99540c58c0 con 0x7f995415be00 2024-04-25T09:14:08.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.984+0000 7f9959600640 1 -- 172.21.15.175:0/158705248 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9954074a60 con 0x7f995415be00 2024-04-25T09:14:08.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.984+0000 7f994be00640 1 -- 172.21.15.175:0/158705248 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f99400a9070 con 0x7f995415be00 2024-04-25T09:14:08.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.984+0000 7f994be00640 1 --2- 172.21.15.175:0/158705248 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9934066f90 0x7f9934069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:08.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.988+0000 7f994be00640 1 -- 172.21.15.175:0/158705248 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f994011f250 con 0x7f995415be00 2024-04-25T09:14:08.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.988+0000 7f9953e00640 1 --2- 172.21.15.175:0/158705248 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9934066f90 0x7f9934069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:08.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.988+0000 7f9953e00640 1 --2- 172.21.15.175:0/158705248 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9934066f90 0x7f9934069450 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9944009a50 tx=0x7f9944008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:08.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:08.992+0000 7f994be00640 1 -- 172.21.15.175:0/158705248 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f99400c3060 con 0x7f995415be00 2024-04-25T09:14:09.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.196+0000 7f9959600640 1 -- 172.21.15.175:0/158705248 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f99540b0d70 con 0x7f995415be00 2024-04-25T09:14:09.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.200+0000 7f994be00640 1 -- 172.21.15.175:0/158705248 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+147 (secure 0 0 0) 0x7f99540c7940 con 0x7f995415be00 2024-04-25T09:14:09.188 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2024-04-25T09:14:09.188 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQBPHCpmhyCUBhAA8k9xLKIw8R04i6HSJykDfw== 2024-04-25T09:14:09.188 INFO:teuthology.orchestra.run.smithi175.stdout: caps mds = "allow" 2024-04-25T09:14:09.188 INFO:teuthology.orchestra.run.smithi175.stdout: caps mon = "allow r" 2024-04-25T09:14:09.188 INFO:teuthology.orchestra.run.smithi175.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:14:09.189 INFO:teuthology.orchestra.run.smithi175.stderr:updated caps for client.0 2024-04-25T09:14:09.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.204+0000 7f9959600640 1 -- 172.21.15.175:0/158705248 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9934066f90 msgr2=0x7f9934069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:09.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.204+0000 7f9959600640 1 --2- 172.21.15.175:0/158705248 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9934066f90 0x7f9934069450 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9944009a50 tx=0x7f9944008040 comp rx=0 tx=0).stop 2024-04-25T09:14:09.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.204+0000 7f9959600640 1 -- 172.21.15.175:0/158705248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f995415be00 msgr2=0x7f995415df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:09.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.204+0000 7f9959600640 1 --2- 172.21.15.175:0/158705248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f995415be00 0x7f995415df90 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f99400ac040 tx=0x7f994001ace0 comp rx=0 tx=0).stop 2024-04-25T09:14:09.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.204+0000 7f9959600640 1 -- 172.21.15.175:0/158705248 shutdown_connections 2024-04-25T09:14:09.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.204+0000 7f9959600640 1 --2- 172.21.15.175:0/158705248 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9934066f90 0x7f9934069450 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:09.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.204+0000 7f9959600640 1 --2- 172.21.15.175:0/158705248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f995415f340 0x7f995415e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:09.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.204+0000 7f9959600640 1 --2- 172.21.15.175:0/158705248 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f995415be00 0x7f995415df90 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:09.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.204+0000 7f9959600640 1 --2- 172.21.15.175:0/158705248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f995409a460 0x7f995414d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:09.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.204+0000 7f9959600640 1 -- 172.21.15.175:0/158705248 >> 172.21.15.175:0/158705248 conn(0x7f99540b3120 msgr2=0x7f995415f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:09.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.204+0000 7f9959600640 1 -- 172.21.15.175:0/158705248 shutdown_connections 2024-04-25T09:14:09.191 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.204+0000 7f9959600640 1 -- 172.21.15.175:0/158705248 wait complete. 2024-04-25T09:14:09.209 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:09.285 INFO:tasks.ceph.mds.c.smithi175.stderr:2024-04-25T09:14:09.296+0000 7f850f800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:14:09.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.356+0000 7ff336200640 1 Processor -- start 2024-04-25T09:14:09.345 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.356+0000 7ff336200640 1 -- start start 2024-04-25T09:14:09.346 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.360+0000 7ff336200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff33015a900 0x7ff33006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:09.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.360+0000 7ff336200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3300cf560 0x7ff3300cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:09.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.360+0000 7ff336200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3300cda00 con 0x7ff3300cd520 2024-04-25T09:14:09.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.360+0000 7ff336200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33015bcf0 con 0x7ff33015a900 2024-04-25T09:14:09.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.360+0000 7ff336200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3300cfef0 con 0x7ff3300cf560 2024-04-25T09:14:09.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.360+0000 7ff326a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff3300cd520 0x7ff3300ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:42540/0 (socket says 172.21.15.175:42540) 2024-04-25T09:14:09.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.360+0000 7ff326a00640 1 -- 172.21.15.175:0/2690320536 learned_addr learned my addr 172.21.15.175:0/2690320536 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:09.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.360+0000 7ff32fe00640 1 --2- 172.21.15.175:0/2690320536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3300cf560 0x7ff3300cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:09.347 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.360+0000 7ff32f400640 1 --2- 172.21.15.175:0/2690320536 >> v2:172.21.15.177:3300/0 conn(0x7ff33015a900 0x7ff33006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:09.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.360+0000 7ff32ea00640 1 -- 172.21.15.175:0/2690320536 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140304377 0 0) 0x7ff3300cda00 con 0x7ff3300cd520 2024-04-25T09:14:09.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.360+0000 7ff32ea00640 1 -- 172.21.15.175:0/2690320536 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff314003530 con 0x7ff3300cd520 2024-04-25T09:14:09.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.360+0000 7ff32fe00640 1 -- 172.21.15.175:0/2690320536 >> v2:172.21.15.177:3300/0 conn(0x7ff33015a900 msgr2=0x7ff33006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:09.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.360+0000 7ff32fe00640 1 --2- 172.21.15.175:0/2690320536 >> v2:172.21.15.177:3300/0 conn(0x7ff33015a900 0x7ff33006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:09.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.360+0000 7ff32fe00640 1 -- 172.21.15.175:0/2690320536 >> v1:172.21.15.175:6789/0 conn(0x7ff3300cd520 legacy=0x7ff3300ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:09.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.360+0000 7ff32fe00640 1 -- 172.21.15.175:0/2690320536 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3300cdce0 con 0x7ff3300cf560 2024-04-25T09:14:09.348 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.360+0000 7ff32f400640 1 --2- 172.21.15.175:0/2690320536 >> v2:172.21.15.177:3300/0 conn(0x7ff33015a900 0x7ff33006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:09.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.364+0000 7ff32fe00640 1 --2- 172.21.15.175:0/2690320536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3300cf560 0x7ff3300cf9b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff3280097c0 tx=0x7ff32801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce036828cb4c7aa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:09.350 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.364+0000 7ff32ea00640 1 -- 172.21.15.175:0/2690320536 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3280b2070 con 0x7ff3300cf560 2024-04-25T09:14:09.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.364+0000 7ff32ea00640 1 -- 172.21.15.175:0/2690320536 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3280ad640 con 0x7ff3300cf560 2024-04-25T09:14:09.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.364+0000 7ff32ea00640 1 -- 172.21.15.175:0/2690320536 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3280ad9f0 con 0x7ff3300cf560 2024-04-25T09:14:09.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.364+0000 7ff336200640 1 -- 172.21.15.175:0/2690320536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3300cf560 msgr2=0x7ff3300cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:09.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.364+0000 7ff336200640 1 --2- 172.21.15.175:0/2690320536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3300cf560 0x7ff3300cf9b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff3280097c0 tx=0x7ff32801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:09.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.364+0000 7ff336200640 1 -- 172.21.15.175:0/2690320536 shutdown_connections 2024-04-25T09:14:09.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.364+0000 7ff336200640 1 --2- 172.21.15.175:0/2690320536 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3300cf560 0x7ff3300cf9b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:09.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.364+0000 7ff336200640 1 --2- 172.21.15.175:0/2690320536 >> v2:172.21.15.177:3300/0 conn(0x7ff33015a900 0x7ff33006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:09.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.364+0000 7ff336200640 1 -- 172.21.15.175:0/2690320536 >> 172.21.15.175:0/2690320536 conn(0x7ff330067150 msgr2=0x7ff33006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:09.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.364+0000 7ff336200640 1 -- 172.21.15.175:0/2690320536 shutdown_connections 2024-04-25T09:14:09.352 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.364+0000 7ff336200640 1 -- 172.21.15.175:0/2690320536 wait complete. 2024-04-25T09:14:09.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.364+0000 7ff336200640 1 Processor -- start 2024-04-25T09:14:09.353 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.364+0000 7ff336200640 1 -- start start 2024-04-25T09:14:09.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff336200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3300cf560 0x7ff3301f7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:09.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff336200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff33015a900 0x7ff3300afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:09.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff336200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3300b09e0 0x7ff3300b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:09.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff336200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33006d530 con 0x7ff3300b09e0 2024-04-25T09:14:09.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff336200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33006d3b0 con 0x7ff3300cf560 2024-04-25T09:14:09.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff336200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33015c790 con 0x7ff33015a900 2024-04-25T09:14:09.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff32f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3300cf560 0x7ff3301f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:09.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff32fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3300b09e0 0x7ff3300b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:09.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff32f400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3300cf560 0x7ff3301f7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:46550/0 (socket says 172.21.15.175:46550) 2024-04-25T09:14:09.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff32f400640 1 -- 172.21.15.175:0/2363382945 learned_addr learned my addr 172.21.15.175:0/2363382945 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:09.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff326a00640 1 --2- 172.21.15.175:0/2363382945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff33015a900 0x7ff3300afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:09.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff32fe00640 1 -- 172.21.15.175:0/2363382945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff33015a900 msgr2=0x7ff3300afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:09.355 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff32fe00640 1 --2- 172.21.15.175:0/2363382945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff33015a900 0x7ff3300afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:09.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff32fe00640 1 -- 172.21.15.175:0/2363382945 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3300cf560 msgr2=0x7ff3301f7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:09.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff32fe00640 1 --2- 172.21.15.175:0/2363382945 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3300cf560 0x7ff3301f7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:09.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff32fe00640 1 -- 172.21.15.175:0/2363382945 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3300b0010 con 0x7ff3300b09e0 2024-04-25T09:14:09.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff32fe00640 1 --2- 172.21.15.175:0/2363382945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3300b09e0 0x7ff3300b0e90 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7ff3280ac000 tx=0x7ff328019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:09.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff327e00640 1 -- 172.21.15.175:0/2363382945 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3280b2040 con 0x7ff3300b09e0 2024-04-25T09:14:09.356 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff327e00640 1 -- 172.21.15.175:0/2363382945 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3280bc070 con 0x7ff3300b09e0 2024-04-25T09:14:09.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff327e00640 1 -- 172.21.15.175:0/2363382945 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff328006e20 con 0x7ff3300b09e0 2024-04-25T09:14:09.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff336200640 1 -- 172.21.15.175:0/2363382945 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3300b02b0 con 0x7ff3300b09e0 2024-04-25T09:14:09.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff336200640 1 -- 172.21.15.175:0/2363382945 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33014e010 con 0x7ff3300b09e0 2024-04-25T09:14:09.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.368+0000 7ff336200640 1 -- 172.21.15.175:0/2363382945 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33014db20 con 0x7ff3300b09e0 2024-04-25T09:14:09.357 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.372+0000 7ff327e00640 1 -- 172.21.15.175:0/2363382945 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff3280b6610 con 0x7ff3300b09e0 2024-04-25T09:14:09.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.372+0000 7ff327e00640 1 --2- 172.21.15.175:0/2363382945 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff30c066f90 0x7ff30c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:09.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.372+0000 7ff327e00640 1 -- 172.21.15.175:0/2363382945 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff32811ec90 con 0x7ff3300b09e0 2024-04-25T09:14:09.358 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.372+0000 7ff32f400640 1 --2- 172.21.15.175:0/2363382945 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff30c066f90 0x7ff30c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:09.359 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.372+0000 7ff32f400640 1 --2- 172.21.15.175:0/2363382945 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff30c066f90 0x7ff30c069450 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff3301f9790 tx=0x7ff32000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:09.363 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.376+0000 7ff327e00640 1 -- 172.21.15.175:0/2363382945 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff328016090 con 0x7ff3300b09e0 2024-04-25T09:14:09.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.560+0000 7ff336200640 1 -- 172.21.15.175:0/2363382945 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff330074a60 con 0x7ff3300b09e0 2024-04-25T09:14:09.548 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.560+0000 7ff327e00640 1 -- 172.21.15.175:0/2363382945 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4949 (secure 0 0 0) 0x7ff3280ef650 con 0x7ff3300b09e0 2024-04-25T09:14:09.548 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:09.548 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":93,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/745891603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":745891603},{"type":"v1","addr":"172.21.15.175:6837","nonce":745891603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2312875672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2312875672},{"type":"v1","addr":"172.21.15.177:6834","nonce":2312875672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":8212,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3983919410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3983919410},{"type":"v1","addr":"172.21.15.177:6835","nonce":3983919410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:14:03.698308+0000","modified":"2024-04-25T09:14:06.729790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8712":{"gid":8712,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6836/4128642659","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":4128642659},{"type":"v1","addr":"172.21.15.175:6836","nonce":4128642659}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:14:09.549 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 93 2024-04-25T09:14:09.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.564+0000 7ff336200640 1 -- 172.21.15.175:0/2363382945 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff30c066f90 msgr2=0x7ff30c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:09.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.564+0000 7ff336200640 1 --2- 172.21.15.175:0/2363382945 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff30c066f90 0x7ff30c069450 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff3301f9790 tx=0x7ff32000b040 comp rx=0 tx=0).stop 2024-04-25T09:14:09.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.564+0000 7ff336200640 1 -- 172.21.15.175:0/2363382945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3300b09e0 msgr2=0x7ff3300b0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:09.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.564+0000 7ff336200640 1 --2- 172.21.15.175:0/2363382945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3300b09e0 0x7ff3300b0e90 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7ff3280ac000 tx=0x7ff328019240 comp rx=0 tx=0).stop 2024-04-25T09:14:09.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.564+0000 7ff336200640 1 -- 172.21.15.175:0/2363382945 shutdown_connections 2024-04-25T09:14:09.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.564+0000 7ff336200640 1 --2- 172.21.15.175:0/2363382945 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff30c066f90 0x7ff30c069450 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:09.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.564+0000 7ff336200640 1 --2- 172.21.15.175:0/2363382945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3300b09e0 0x7ff3300b0e90 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:09.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.564+0000 7ff336200640 1 --2- 172.21.15.175:0/2363382945 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff33015a900 0x7ff3300afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:09.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.564+0000 7ff336200640 1 --2- 172.21.15.175:0/2363382945 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3300cf560 0x7ff3301f7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:09.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.564+0000 7ff336200640 1 -- 172.21.15.175:0/2363382945 >> 172.21.15.175:0/2363382945 conn(0x7ff3300cd520 msgr2=0x7ff33006e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:09.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.564+0000 7ff336200640 1 -- 172.21.15.175:0/2363382945 shutdown_connections 2024-04-25T09:14:09.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:09.564+0000 7ff336200640 1 -- 172.21.15.175:0/2363382945 wait complete. 2024-04-25T09:14:09.626 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:14:09.629 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:14:09.974 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 93, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:14:03.698308+0000', 'modified': '2024-04-25T09:14:06.729790+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8712}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8712': {'gid': 8712, 'name': 'c', 'rank': 0, 'incarnation': 90, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6836/4128642659', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 4128642659}, {'type': 'v1', 'addr': '172.21.15.175:6836', 'nonce': 4128642659}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:14:09.974 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:14:09.974 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:14:10.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.124+0000 7fe83aa00640 1 Processor -- start 2024-04-25T09:14:10.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.124+0000 7fe83aa00640 1 -- start start 2024-04-25T09:14:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.124+0000 7fe83aa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8340cbe60 0x7fe83415af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.124+0000 7fe83aa00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe83406d310 0x7fe8340b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.124+0000 7fe83aa00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe83406db60 con 0x7fe8340b4630 2024-04-25T09:14:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.124+0000 7fe83aa00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83406de40 con 0x7fe83406d310 2024-04-25T09:14:10.112 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.124+0000 7fe83aa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83406e120 con 0x7fe8340cbe60 2024-04-25T09:14:10.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.124+0000 7fe833e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8340cbe60 0x7fe83415af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.124+0000 7fe833e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8340cbe60 0x7fe83415af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:35818/0 (socket says 172.21.15.175:35818) 2024-04-25T09:14:10.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.124+0000 7fe833e00640 1 -- 172.21.15.175:0/3530199781 learned_addr learned my addr 172.21.15.175:0/3530199781 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:10.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.124+0000 7fe833400640 1 --2- 172.21.15.175:0/3530199781 >> v2:172.21.15.177:3300/0 conn(0x7fe83406d310 0x7fe8340b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.124+0000 7fe833e00640 1 -- 172.21.15.175:0/3530199781 >> v2:172.21.15.177:3300/0 conn(0x7fe83406d310 msgr2=0x7fe8340b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:10.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.124+0000 7fe833e00640 1 --2- 172.21.15.175:0/3530199781 >> v2:172.21.15.177:3300/0 conn(0x7fe83406d310 0x7fe8340b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.113 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.124+0000 7fe833e00640 1 -- 172.21.15.175:0/3530199781 >> v1:172.21.15.177:6789/0 conn(0x7fe8340b4630 legacy=0x7fe8340b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:10.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.124+0000 7fe833e00640 1 -- 172.21.15.175:0/3530199781 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83415c2f0 con 0x7fe8340cbe60 2024-04-25T09:14:10.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.128+0000 7fe833e00640 1 --2- 172.21.15.175:0/3530199781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8340cbe60 0x7fe83415af20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe824009e50 tx=0x7fe82401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aee38c18fe7b94c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:10.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.128+0000 7fe832a00640 1 -- 172.21.15.175:0/3530199781 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8240a5700 con 0x7fe8340cbe60 2024-04-25T09:14:10.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.128+0000 7fe832a00640 1 -- 172.21.15.175:0/3530199781 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8240a58a0 con 0x7fe8340cbe60 2024-04-25T09:14:10.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.128+0000 7fe832a00640 1 -- 172.21.15.175:0/3530199781 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8240a5c70 con 0x7fe8340cbe60 2024-04-25T09:14:10.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.128+0000 7fe83aa00640 1 -- 172.21.15.175:0/3530199781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8340cbe60 msgr2=0x7fe83415af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:10.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.128+0000 7fe83aa00640 1 --2- 172.21.15.175:0/3530199781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8340cbe60 0x7fe83415af20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe824009e50 tx=0x7fe82401ca30 comp rx=0 tx=0).stop 2024-04-25T09:14:10.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.128+0000 7fe83aa00640 1 -- 172.21.15.175:0/3530199781 shutdown_connections 2024-04-25T09:14:10.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.128+0000 7fe83aa00640 1 --2- 172.21.15.175:0/3530199781 >> v2:172.21.15.177:3300/0 conn(0x7fe83406d310 0x7fe8340b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.128+0000 7fe83aa00640 1 --2- 172.21.15.175:0/3530199781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8340cbe60 0x7fe83415af20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.128+0000 7fe83aa00640 1 -- 172.21.15.175:0/3530199781 >> 172.21.15.175:0/3530199781 conn(0x7fe83406ac50 msgr2=0x7fe83406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:10.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.128+0000 7fe83aa00640 1 -- 172.21.15.175:0/3530199781 shutdown_connections 2024-04-25T09:14:10.117 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.128+0000 7fe83aa00640 1 -- 172.21.15.175:0/3530199781 wait complete. 2024-04-25T09:14:10.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe83aa00640 1 Processor -- start 2024-04-25T09:14:10.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe83aa00640 1 -- start start 2024-04-25T09:14:10.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe83aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe83406d310 0x7fe834137a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe83aa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8340b4630 0x7fe834156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe83aa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8340cbe60 0x7fe834157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe83aa00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe834167770 con 0x7fe83406d310 2024-04-25T09:14:10.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe83aa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8340cc450 con 0x7fe8340b4630 2024-04-25T09:14:10.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe83aa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8341678f0 con 0x7fe8340cbe60 2024-04-25T09:14:10.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe833e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe83406d310 0x7fe834137a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe833e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe83406d310 0x7fe834137a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44896/0 (socket says 172.21.15.175:44896) 2024-04-25T09:14:10.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe833e00640 1 -- 172.21.15.175:0/1816031538 learned_addr learned my addr 172.21.15.175:0/1816031538 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:10.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe833400640 1 --2- 172.21.15.175:0/1816031538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8340b4630 0x7fe834156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe838a00640 1 --2- 172.21.15.175:0/1816031538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8340cbe60 0x7fe834157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe833e00640 1 -- 172.21.15.175:0/1816031538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8340cbe60 msgr2=0x7fe834157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:10.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe833e00640 1 --2- 172.21.15.175:0/1816031538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8340cbe60 0x7fe834157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe833e00640 1 -- 172.21.15.175:0/1816031538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8340b4630 msgr2=0x7fe834156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:10.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe833e00640 1 --2- 172.21.15.175:0/1816031538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8340b4630 0x7fe834156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe833e00640 1 -- 172.21.15.175:0/1816031538 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8340cebe0 con 0x7fe83406d310 2024-04-25T09:14:10.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe833e00640 1 --2- 172.21.15.175:0/1816031538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe83406d310 0x7fe834137a70 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fe8240af040 tx=0x7fe8240197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:10.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe82be00640 1 -- 172.21.15.175:0/1816031538 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8240bc020 con 0x7fe83406d310 2024-04-25T09:14:10.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe82be00640 1 -- 172.21.15.175:0/1816031538 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8240b8670 con 0x7fe83406d310 2024-04-25T09:14:10.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe83aa00640 1 -- 172.21.15.175:0/1816031538 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8340ceec0 con 0x7fe83406d310 2024-04-25T09:14:10.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe82be00640 1 -- 172.21.15.175:0/1816031538 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe824009510 con 0x7fe83406d310 2024-04-25T09:14:10.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.132+0000 7fe83aa00640 1 -- 172.21.15.175:0/1816031538 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8340cf480 con 0x7fe83406d310 2024-04-25T09:14:10.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.136+0000 7fe82be00640 1 -- 172.21.15.175:0/1816031538 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe8240bf020 con 0x7fe83406d310 2024-04-25T09:14:10.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.136+0000 7fe82be00640 1 --2- 172.21.15.175:0/1816031538 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe814066f60 0x7fe814069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.136+0000 7fe82be00640 1 -- 172.21.15.175:0/1816031538 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe82411fe10 con 0x7fe83406d310 2024-04-25T09:14:10.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.136+0000 7fe83df9c000 1 Processor -- start 2024-04-25T09:14:10.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.136+0000 7fe833400640 1 --2- 172.21.15.175:0/1816031538 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe814066f60 0x7fe814069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.136+0000 7fe83df9c000 1 -- start start 2024-04-25T09:14:10.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.136+0000 7fe833400640 1 --2- 172.21.15.175:0/1816031538 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe814066f60 0x7fe814069420 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe83414a470 tx=0x7fe820009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:10.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.136+0000 7fe83df9c000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67bb9920 0x562d67bb9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.136+0000 7fe83df9c000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bba240 0x562d67b6f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.136+0000 7fe83df9c000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67b6ff30 0x562d67b70310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.136+0000 7fe83df9c000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d67a575f0 con 0x562d67bb9920 2024-04-25T09:14:10.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.136+0000 7fe83df9c000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d679beda0 con 0x562d67b6ff30 2024-04-25T09:14:10.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.136+0000 7fe83df9c000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d67947150 con 0x562d67bba240 2024-04-25T09:14:10.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe833e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67bb9920 0x562d67bb9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe833e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67bb9920 0x562d67bb9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44908/0 (socket says 172.21.15.175:44908) 2024-04-25T09:14:10.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe833e00640 1 -- 172.21.15.175:0/3354104034 learned_addr learned my addr 172.21.15.175:0/3354104034 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:10.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe838a00640 1 --2- 172.21.15.175:0/3354104034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67b6ff30 0x562d67b70310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe833400640 1 --2- 172.21.15.175:0/3354104034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bba240 0x562d67b6f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe833e00640 1 -- 172.21.15.175:0/3354104034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bba240 msgr2=0x562d67b6f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:10.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe833e00640 1 --2- 172.21.15.175:0/3354104034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bba240 0x562d67b6f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe833e00640 1 -- 172.21.15.175:0/3354104034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67b6ff30 msgr2=0x562d67b70310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:10.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe833e00640 1 --2- 172.21.15.175:0/3354104034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67b6ff30 0x562d67b70310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe833e00640 1 -- 172.21.15.175:0/3354104034 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d67960ca0 con 0x562d67bb9920 2024-04-25T09:14:10.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe838a00640 1 --2- 172.21.15.175:0/3354104034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67b6ff30 0x562d67b70310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:10.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe833e00640 1 --2- 172.21.15.175:0/3354104034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67bb9920 0x562d67bb9d00 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fe824098420 tx=0x7fe824009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec574b29fcb5fcb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:10.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe828c00640 1 -- 172.21.15.175:0/3354104034 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8240f8f40 con 0x562d67bb9920 2024-04-25T09:14:10.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe828c00640 1 -- 172.21.15.175:0/3354104034 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82411e3b0 con 0x562d67bb9920 2024-04-25T09:14:10.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe828c00640 1 -- 172.21.15.175:0/3354104034 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8240f0b40 con 0x562d67bb9920 2024-04-25T09:14:10.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe83df9c000 1 -- 172.21.15.175:0/3354104034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67bb9920 msgr2=0x562d67bb9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:10.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe83df9c000 1 --2- 172.21.15.175:0/3354104034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67bb9920 0x562d67bb9d00 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fe824098420 tx=0x7fe824009810 comp rx=0 tx=0).stop 2024-04-25T09:14:10.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe83df9c000 1 -- 172.21.15.175:0/3354104034 shutdown_connections 2024-04-25T09:14:10.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe83df9c000 1 --2- 172.21.15.175:0/3354104034 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67b6ff30 0x562d67b70310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe83df9c000 1 --2- 172.21.15.175:0/3354104034 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bba240 0x562d67b6f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe83df9c000 1 --2- 172.21.15.175:0/3354104034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67bb9920 0x562d67bb9d00 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe83df9c000 1 -- 172.21.15.175:0/3354104034 >> 172.21.15.175:0/3354104034 conn(0x562d67b762a0 msgr2=0x562d67b6e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:10.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe83df9c000 1 -- 172.21.15.175:0/3354104034 shutdown_connections 2024-04-25T09:14:10.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe83df9c000 1 -- 172.21.15.175:0/3354104034 wait complete. 2024-04-25T09:14:10.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe83df9c000 1 -- start start 2024-04-25T09:14:10.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe83df9c000 1 Processor -- start 2024-04-25T09:14:10.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe83df9c000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67b6ff30 0x562d67bc0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe83df9c000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bb9920 0x562d67bc11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe83df9c000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67bba240 0x562d67b73aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe83df9c000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d67979990 con 0x562d67b6ff30 2024-04-25T09:14:10.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe83df9c000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d679bae40 con 0x562d67bba240 2024-04-25T09:14:10.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe83df9c000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d6794a900 con 0x562d67bb9920 2024-04-25T09:14:10.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe83df9c000 10 client.0 _ll_register_callbacks cb 0x562d67a721c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:14:10.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe833e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67b6ff30 0x562d67bc0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe833e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67b6ff30 0x562d67bc0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44910/0 (socket says 172.21.15.175:44910) 2024-04-25T09:14:10.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe833e00640 1 -- 172.21.15.175:0/2141027086 learned_addr learned my addr 172.21.15.175:0/2141027086 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:10.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe833400640 1 --2- 172.21.15.175:0/2141027086 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bb9920 0x562d67bc11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.140+0000 7fe838a00640 1 --2- 172.21.15.175:0/2141027086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67bba240 0x562d67b73aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe833e00640 1 -- 172.21.15.175:0/2141027086 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bb9920 msgr2=0x562d67bc11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:10.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe833e00640 1 --2- 172.21.15.175:0/2141027086 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bb9920 0x562d67bc11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe833e00640 1 -- 172.21.15.175:0/2141027086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67bba240 msgr2=0x562d67b73aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:10.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe833e00640 1 --2- 172.21.15.175:0/2141027086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67bba240 0x562d67b73aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe833e00640 1 -- 172.21.15.175:0/2141027086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d67977630 con 0x562d67b6ff30 2024-04-25T09:14:10.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe838a00640 1 --2- 172.21.15.175:0/2141027086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67bba240 0x562d67b73aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:10.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe833e00640 1 --2- 172.21.15.175:0/2141027086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67b6ff30 0x562d67bc0c80 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fe824098420 tx=0x7fe82401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f445af7e4508b98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:10.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe81d600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:14:10.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe81d600640 1 -- 172.21.15.175:0/2141027086 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8240f8f40 con 0x562d67b6ff30 2024-04-25T09:14:10.135 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe81d600640 1 -- 172.21.15.175:0/2141027086 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8240f8ab0 con 0x562d67b6ff30 2024-04-25T09:14:10.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 1 -- 172.21.15.175:0/2141027086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe82411e3b0 con 0x562d67b6ff30 2024-04-25T09:14:10.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe81d600640 1 -- 172.21.15.175:0/2141027086 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe824100050 con 0x562d67b6ff30 2024-04-25T09:14:10.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 10 client.8844 fetch_fsmap learned FSMap version 93 2024-04-25T09:14:10.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 1 -- 172.21.15.175:0/2141027086 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x562d679473a0 con 0x562d67b6ff30 2024-04-25T09:14:10.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe81d600640 1 -- 172.21.15.175:0/2141027086 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82411e3b0 con 0x562d67b6ff30 2024-04-25T09:14:10.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe81d600640 1 -- 172.21.15.175:0/2141027086 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 93) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe824103020 con 0x562d67b6ff30 2024-04-25T09:14:10.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 10 client.8844 fetch_fsmap finished waiting for FSMap version 93 2024-04-25T09:14:10.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 10 client.8844 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:14:10.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 20 client.8844 populate_metadata read hostname 'smithi175' 2024-04-25T09:14:10.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 1 --2- 172.21.15.175:0/2141027086 >> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] conn(0x562d67b744b0 0x562d67b74890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 4 client.8844 mds_command: new command op to 8712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:14:10.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 1 -- 172.21.15.175:0/2141027086 --> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d6795aa50 con 0x562d67b744b0 2024-04-25T09:14:10.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe833400640 1 --2- 172.21.15.175:0/2141027086 >> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] conn(0x562d67b744b0 0x562d67b74890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.136 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe81d600640 10 client.8844 ms_handle_connect on v2:172.21.15.175:6834/4128642659 2024-04-25T09:14:10.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe833400640 1 --2- 172.21.15.175:0/2141027086 >> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] conn(0x562d67b744b0 0x562d67b74890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6afbb5ee3add16c7 server_cookie=36e7c5a779249489 in_seq=0 out_seq=0 2024-04-25T09:14:10.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe81d600640 1 -- 172.21.15.175:0/2141027086 <== mds.0 v2:172.21.15.175:6834/4128642659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562d6795aa50 con 0x562d67b744b0 2024-04-25T09:14:10.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe81d600640 10 client.8844 handle_command_reply: tid=0 2024-04-25T09:14:10.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 1 client.8844 shutdown 2024-04-25T09:14:10.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 1 -- 172.21.15.175:0/2141027086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67b6ff30 msgr2=0x562d67bc0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:10.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 1 --2- 172.21.15.175:0/2141027086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67b6ff30 0x562d67bc0c80 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fe824098420 tx=0x7fe82401ca30 comp rx=0 tx=0).stop 2024-04-25T09:14:10.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 1 -- 172.21.15.175:0/2141027086 shutdown_connections 2024-04-25T09:14:10.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 1 --2- 172.21.15.175:0/2141027086 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67bba240 0x562d67b73aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 1 --2- 172.21.15.175:0/2141027086 >> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] conn(0x562d67b744b0 0x562d67b74890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 1 --2- 172.21.15.175:0/2141027086 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bb9920 0x562d67bc11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 1 --2- 172.21.15.175:0/2141027086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67b6ff30 0x562d67bc0c80 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe81d600640 0 client.8844 ms_handle_reset on v2:172.21.15.175:6834/4128642659 2024-04-25T09:14:10.137 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 1 -- 172.21.15.175:0/2141027086 >> 172.21.15.175:0/2141027086 conn(0x562d67b762a0 msgr2=0x562d67b6e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:10.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 1 -- 172.21.15.175:0/2141027086 shutdown_connections 2024-04-25T09:14:10.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 1 -- 172.21.15.175:0/2141027086 wait complete. 2024-04-25T09:14:10.138 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.144+0000 7fe83df9c000 20 client.8844 trim_cache size 0 max 16384 2024-04-25T09:14:10.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.160+0000 7fe83df9c000 1 Processor -- start 2024-04-25T09:14:10.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.160+0000 7fe83df9c000 1 -- start start 2024-04-25T09:14:10.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.160+0000 7fe83df9c000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67b6ff30 0x562d67b73330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.160+0000 7fe83df9c000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67bb9920 0x562d67b73870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.160+0000 7fe83df9c000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bba240 0x562d67bc38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.160+0000 7fe83df9c000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83413b250 con 0x562d67bb9920 2024-04-25T09:14:10.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.160+0000 7fe83df9c000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83413a650 con 0x562d67b6ff30 2024-04-25T09:14:10.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.160+0000 7fe83df9c000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83413ac50 con 0x562d67bba240 2024-04-25T09:14:10.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.160+0000 7fe833400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67bb9920 0x562d67b73870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.160+0000 7fe833400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67bb9920 0x562d67b73870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44926/0 (socket says 172.21.15.175:44926) 2024-04-25T09:14:10.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.160+0000 7fe833400640 1 -- 172.21.15.175:0/3513805997 learned_addr learned my addr 172.21.15.175:0/3513805997 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:10.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.160+0000 7fe833e00640 1 --2- 172.21.15.175:0/3513805997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67b6ff30 0x562d67b73330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.160+0000 7fe833400640 1 -- 172.21.15.175:0/3513805997 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bba240 msgr2=0x562d67bc38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:10.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.160+0000 7fe833400640 1 --2- 172.21.15.175:0/3513805997 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bba240 0x562d67bc38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.160+0000 7fe833400640 1 -- 172.21.15.175:0/3513805997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67b6ff30 msgr2=0x562d67b73330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:10.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.160+0000 7fe833400640 1 --2- 172.21.15.175:0/3513805997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67b6ff30 0x562d67b73330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.160+0000 7fe833400640 1 -- 172.21.15.175:0/3513805997 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d67a40600 con 0x562d67bb9920 2024-04-25T09:14:10.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe833400640 1 --2- 172.21.15.175:0/3513805997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67bb9920 0x562d67b73870 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x562d6795f330 tx=0x7fe820018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a4bb52577cca02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:10.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe81fe00640 1 -- 172.21.15.175:0/3513805997 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8200041c0 con 0x562d67bb9920 2024-04-25T09:14:10.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe81fe00640 1 -- 172.21.15.175:0/3513805997 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe820004360 con 0x562d67bb9920 2024-04-25T09:14:10.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe81fe00640 1 -- 172.21.15.175:0/3513805997 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82002a3e0 con 0x562d67bb9920 2024-04-25T09:14:10.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe83df9c000 1 -- 172.21.15.175:0/3513805997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67bb9920 msgr2=0x562d67b73870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:10.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe83df9c000 1 --2- 172.21.15.175:0/3513805997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67bb9920 0x562d67b73870 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x562d6795f330 tx=0x7fe820018000 comp rx=0 tx=0).stop 2024-04-25T09:14:10.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe83df9c000 1 -- 172.21.15.175:0/3513805997 shutdown_connections 2024-04-25T09:14:10.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe83df9c000 1 --2- 172.21.15.175:0/3513805997 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bba240 0x562d67bc38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe83df9c000 1 --2- 172.21.15.175:0/3513805997 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67bb9920 0x562d67b73870 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe83df9c000 1 --2- 172.21.15.175:0/3513805997 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67b6ff30 0x562d67b73330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe83df9c000 1 -- 172.21.15.175:0/3513805997 >> 172.21.15.175:0/3513805997 conn(0x562d67b762a0 msgr2=0x562d67ba5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:10.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe83df9c000 1 -- 172.21.15.175:0/3513805997 shutdown_connections 2024-04-25T09:14:10.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe83df9c000 1 -- 172.21.15.175:0/3513805997 wait complete. 2024-04-25T09:14:10.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe83df9c000 1 -- start start 2024-04-25T09:14:10.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe83df9c000 1 Processor -- start 2024-04-25T09:14:10.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe83df9c000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67b6ff30 0x562d67bc6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe83df9c000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67bb9920 0x562d67bc69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe83df9c000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bba240 0x562d67c16380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe83df9c000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d679c33d0 con 0x562d67b6ff30 2024-04-25T09:14:10.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe83df9c000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d67a7ad50 con 0x562d67bb9920 2024-04-25T09:14:10.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe83df9c000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d67959980 con 0x562d67bba240 2024-04-25T09:14:10.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe83df9c000 10 client.0 _ll_register_callbacks cb 0x7fe824009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:14:10.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe833e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67b6ff30 0x562d67bc6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe833e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67b6ff30 0x562d67bc6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44940/0 (socket says 172.21.15.175:44940) 2024-04-25T09:14:10.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe833e00640 1 -- 172.21.15.175:0/3160244816 learned_addr learned my addr 172.21.15.175:0/3160244816 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:10.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe833400640 1 --2- 172.21.15.175:0/3160244816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67bb9920 0x562d67bc69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe838a00640 1 --2- 172.21.15.175:0/3160244816 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bba240 0x562d67c16380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe833e00640 1 -- 172.21.15.175:0/3160244816 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bba240 msgr2=0x562d67c16380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:10.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe833e00640 1 --2- 172.21.15.175:0/3160244816 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bba240 0x562d67c16380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe833e00640 1 -- 172.21.15.175:0/3160244816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67bb9920 msgr2=0x562d67bc69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:10.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe833e00640 1 --2- 172.21.15.175:0/3160244816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67bb9920 0x562d67bc69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe833e00640 1 -- 172.21.15.175:0/3160244816 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d679539b0 con 0x562d67b6ff30 2024-04-25T09:14:10.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe833e00640 1 --2- 172.21.15.175:0/3160244816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67b6ff30 0x562d67bc6490 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fe8240094a0 tx=0x7fe824009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1729e22d238117 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:10.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe81d600640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:14:10.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.164+0000 7fe81d600640 1 -- 172.21.15.175:0/3160244816 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8240f8f40 con 0x562d67b6ff30 2024-04-25T09:14:10.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe81d600640 1 -- 172.21.15.175:0/3160244816 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe824109c70 con 0x562d67b6ff30 2024-04-25T09:14:10.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 1 -- 172.21.15.175:0/3160244816 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe820004360 con 0x562d67b6ff30 2024-04-25T09:14:10.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe81d600640 1 -- 172.21.15.175:0/3160244816 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8240f1b60 con 0x562d67b6ff30 2024-04-25T09:14:10.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 10 client.8850 fetch_fsmap learned FSMap version 93 2024-04-25T09:14:10.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 1 -- 172.21.15.175:0/3160244816 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x562d679660b0 con 0x562d67b6ff30 2024-04-25T09:14:10.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe81d600640 1 -- 172.21.15.175:0/3160244816 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe820004360 con 0x562d67b6ff30 2024-04-25T09:14:10.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe81d600640 1 -- 172.21.15.175:0/3160244816 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 93) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe824103070 con 0x562d67b6ff30 2024-04-25T09:14:10.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 10 client.8850 fetch_fsmap finished waiting for FSMap version 93 2024-04-25T09:14:10.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 10 client.8850 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:14:10.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 20 client.8850 populate_metadata read hostname 'smithi175' 2024-04-25T09:14:10.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 1 --2- 172.21.15.175:0/3160244816 >> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] conn(0x562d67c168c0 0x562d67c16ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 4 client.8850 mds_command: new command op to 8712 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:14:10.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 1 -- 172.21.15.175:0/3160244816 --> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562d679cc2e0 con 0x562d67c168c0 2024-04-25T09:14:10.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe833400640 1 --2- 172.21.15.175:0/3160244816 >> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] conn(0x562d67c168c0 0x562d67c16ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe81d600640 10 client.8850 ms_handle_connect on v2:172.21.15.175:6834/4128642659 2024-04-25T09:14:10.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe833400640 1 --2- 172.21.15.175:0/3160244816 >> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] conn(0x562d67c168c0 0x562d67c16ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d3da507bf469506 server_cookie=847ec77f2cbdfb29 in_seq=0 out_seq=0 2024-04-25T09:14:10.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe81d600640 1 -- 172.21.15.175:0/3160244816 <== mds.0 v2:172.21.15.175:6834/4128642659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x562d679cc2e0 con 0x562d67c168c0 2024-04-25T09:14:10.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe81d600640 10 client.8850 handle_command_reply: tid=0 2024-04-25T09:14:10.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 1 client.8850 shutdown 2024-04-25T09:14:10.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 1 -- 172.21.15.175:0/3160244816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67b6ff30 msgr2=0x562d67bc6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:10.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 1 --2- 172.21.15.175:0/3160244816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67b6ff30 0x562d67bc6490 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fe8240094a0 tx=0x7fe824009040 comp rx=0 tx=0).stop 2024-04-25T09:14:10.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 1 -- 172.21.15.175:0/3160244816 shutdown_connections 2024-04-25T09:14:10.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 1 --2- 172.21.15.175:0/3160244816 >> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] conn(0x562d67c168c0 0x562d67c16ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 1 --2- 172.21.15.175:0/3160244816 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x562d67bba240 0x562d67c16380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 1 --2- 172.21.15.175:0/3160244816 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x562d67bb9920 0x562d67bc69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe81d600640 0 client.8850 ms_handle_reset on v2:172.21.15.175:6834/4128642659 2024-04-25T09:14:10.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 1 --2- 172.21.15.175:0/3160244816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x562d67b6ff30 0x562d67bc6490 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 1 -- 172.21.15.175:0/3160244816 >> 172.21.15.175:0/3160244816 conn(0x562d67b762a0 msgr2=0x562d67b72320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:10.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 1 -- 172.21.15.175:0/3160244816 shutdown_connections 2024-04-25T09:14:10.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 1 -- 172.21.15.175:0/3160244816 wait complete. 2024-04-25T09:14:10.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83df9c000 20 client.8850 trim_cache size 0 max 16384 2024-04-25T09:14:10.161 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:14:10.161 INFO:teuthology.orchestra.run.smithi175.stdout: "cluster_fsid": "8caed986-ca08-40e2-b5a5-12e2aade6223", 2024-04-25T09:14:10.161 INFO:teuthology.orchestra.run.smithi175.stdout: "whoami": 0, 2024-04-25T09:14:10.161 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 8712, 2024-04-25T09:14:10.161 INFO:teuthology.orchestra.run.smithi175.stdout: "want_state": "up:active", 2024-04-25T09:14:10.161 INFO:teuthology.orchestra.run.smithi175.stdout: "state": "up:active", 2024-04-25T09:14:10.161 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs", 2024-04-25T09:14:10.161 INFO:teuthology.orchestra.run.smithi175.stdout: "rank_uptime": 5.8298509320000003, 2024-04-25T09:14:10.161 INFO:teuthology.orchestra.run.smithi175.stdout: "mdsmap_epoch": 93, 2024-04-25T09:14:10.161 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch": 113, 2024-04-25T09:14:10.161 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch_barrier": 113, 2024-04-25T09:14:10.161 INFO:teuthology.orchestra.run.smithi175.stdout: "uptime": 11.748659254 2024-04-25T09:14:10.161 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:14:10.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83aa00640 1 -- 172.21.15.175:0/1816031538 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe814066f60 msgr2=0x7fe814069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:10.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83aa00640 1 --2- 172.21.15.175:0/1816031538 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe814066f60 0x7fe814069420 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe83414a470 tx=0x7fe820009190 comp rx=0 tx=0).stop 2024-04-25T09:14:10.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83aa00640 1 -- 172.21.15.175:0/1816031538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe83406d310 msgr2=0x7fe834137a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:10.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83aa00640 1 --2- 172.21.15.175:0/1816031538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe83406d310 0x7fe834137a70 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fe8240af040 tx=0x7fe8240197d0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83aa00640 1 -- 172.21.15.175:0/1816031538 shutdown_connections 2024-04-25T09:14:10.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83aa00640 1 --2- 172.21.15.175:0/1816031538 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe814066f60 0x7fe814069420 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83aa00640 1 --2- 172.21.15.175:0/1816031538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe8340cbe60 0x7fe834157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83aa00640 1 --2- 172.21.15.175:0/1816031538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe8340b4630 0x7fe834156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83aa00640 1 --2- 172.21.15.175:0/1816031538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe83406d310 0x7fe834137a70 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83aa00640 1 -- 172.21.15.175:0/1816031538 >> 172.21.15.175:0/1816031538 conn(0x7fe83406ac50 msgr2=0x7fe834071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:10.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83aa00640 1 -- 172.21.15.175:0/1816031538 shutdown_connections 2024-04-25T09:14:10.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.168+0000 7fe83aa00640 1 -- 172.21.15.175:0/1816031538 wait complete. 2024-04-25T09:14:10.174 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:14:10.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.320+0000 7fedb3600640 1 Processor -- start 2024-04-25T09:14:10.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.320+0000 7fedb3600640 1 -- start start 2024-04-25T09:14:10.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.324+0000 7fedb3600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fedac144fc0 0x7fedac0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.324+0000 7fedb3600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac15cd00 con 0x7fedac1453a0 2024-04-25T09:14:10.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.324+0000 7fedb3600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac0ce660 con 0x7fedac15c5e0 2024-04-25T09:14:10.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.324+0000 7fedb3600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedac0cc930 con 0x7fedac144fc0 2024-04-25T09:14:10.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.324+0000 7fedb0c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fedac144fc0 0x7fedac0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.324+0000 7feda3e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fedac1453a0 0x7fedac15bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:42552/0 (socket says 172.21.15.175:42552) 2024-04-25T09:14:10.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.324+0000 7feda3e00640 1 -- 172.21.15.175:0/1065539452 learned_addr learned my addr 172.21.15.175:0/1065539452 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:10.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.324+0000 7fedb0c00640 1 -- 172.21.15.175:0/1065539452 >> v1:172.21.15.177:6789/0 conn(0x7fedac15c5e0 legacy=0x7fedac0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:10.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.324+0000 7fedb0c00640 1 -- 172.21.15.175:0/1065539452 >> v1:172.21.15.175:6789/0 conn(0x7fedac1453a0 legacy=0x7fedac15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:10.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.324+0000 7fedb0c00640 1 -- 172.21.15.175:0/1065539452 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac0ccc10 con 0x7fedac144fc0 2024-04-25T09:14:10.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedb0c00640 1 --2- 172.21.15.175:0/1065539452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedac144fc0 0x7fedac0cbe70 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0097f0 tx=0x7fed9c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a455a0d0520da1e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:10.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedabe00640 1 -- 172.21.15.175:0/1065539452 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c0b1070 con 0x7fedac144fc0 2024-04-25T09:14:10.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedabe00640 1 -- 172.21.15.175:0/1065539452 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c0ac5f0 con 0x7fedac144fc0 2024-04-25T09:14:10.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedabe00640 1 -- 172.21.15.175:0/1065539452 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c0ac9c0 con 0x7fedac144fc0 2024-04-25T09:14:10.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedb3600640 1 -- 172.21.15.175:0/1065539452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedac144fc0 msgr2=0x7fedac0cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:10.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedb3600640 1 --2- 172.21.15.175:0/1065539452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedac144fc0 0x7fedac0cbe70 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0097f0 tx=0x7fed9c01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedb3600640 1 -- 172.21.15.175:0/1065539452 shutdown_connections 2024-04-25T09:14:10.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedb3600640 1 --2- 172.21.15.175:0/1065539452 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedac144fc0 0x7fedac0cbe70 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedb3600640 1 -- 172.21.15.175:0/1065539452 >> 172.21.15.175:0/1065539452 conn(0x7fedac067150 msgr2=0x7fedac06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:10.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedb3600640 1 -- 172.21.15.175:0/1065539452 shutdown_connections 2024-04-25T09:14:10.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedb3600640 1 -- 172.21.15.175:0/1065539452 wait complete. 2024-04-25T09:14:10.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedb3600640 1 Processor -- start 2024-04-25T09:14:10.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedb3600640 1 -- start start 2024-04-25T09:14:10.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedb3600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fedac1453a0 0x7fedac13dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedb3600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedac15c5e0 0x7fedac159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedb3600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedac13cd90 0x7fedac159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedb3600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac169600 con 0x7fedac15c5e0 2024-04-25T09:14:10.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedb3600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0cff50 con 0x7fedac13cd90 2024-04-25T09:14:10.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.328+0000 7fedb3600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac169780 con 0x7fedac1453a0 2024-04-25T09:14:10.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7feda3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedac15c5e0 0x7fedac159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7feda3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedac15c5e0 0x7fedac159150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44964/0 (socket says 172.21.15.175:44964) 2024-04-25T09:14:10.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7feda3e00640 1 -- 172.21.15.175:0/2971958288 learned_addr learned my addr 172.21.15.175:0/2971958288 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:10.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7fedb0c00640 1 --2- 172.21.15.175:0/2971958288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fedac1453a0 0x7fedac13dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7fedb1600640 1 --2- 172.21.15.175:0/2971958288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedac13cd90 0x7fedac159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7feda3e00640 1 -- 172.21.15.175:0/2971958288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fedac1453a0 msgr2=0x7fedac13dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:10.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7feda3e00640 1 --2- 172.21.15.175:0/2971958288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fedac1453a0 0x7fedac13dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7feda3e00640 1 -- 172.21.15.175:0/2971958288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedac13cd90 msgr2=0x7fedac159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:10.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7feda3e00640 1 --2- 172.21.15.175:0/2971958288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedac13cd90 0x7fedac159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7feda3e00640 1 -- 172.21.15.175:0/2971958288 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac1f5850 con 0x7fedac15c5e0 2024-04-25T09:14:10.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7fedb1600640 1 --2- 172.21.15.175:0/2971958288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedac13cd90 0x7fedac159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:10.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7feda3e00640 1 --2- 172.21.15.175:0/2971958288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedac15c5e0 0x7fedac159150 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fed9400c480 tx=0x7fed9400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:10.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7feda9600640 1 -- 172.21.15.175:0/2971958288 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94017070 con 0x7fedac15c5e0 2024-04-25T09:14:10.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7feda9600640 1 -- 172.21.15.175:0/2971958288 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed94005cf0 con 0x7fedac15c5e0 2024-04-25T09:14:10.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7feda9600640 1 -- 172.21.15.175:0/2971958288 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94007270 con 0x7fedac15c5e0 2024-04-25T09:14:10.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7fedb3600640 1 -- 172.21.15.175:0/2971958288 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedac0ab960 con 0x7fedac15c5e0 2024-04-25T09:14:10.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7fedb3600640 1 -- 172.21.15.175:0/2971958288 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedac13e1f0 con 0x7fedac15c5e0 2024-04-25T09:14:10.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7fedb3600640 1 -- 172.21.15.175:0/2971958288 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedac074a60 con 0x7fedac15c5e0 2024-04-25T09:14:10.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7feda9600640 1 -- 172.21.15.175:0/2971958288 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fed9401a070 con 0x7fedac15c5e0 2024-04-25T09:14:10.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7feda9600640 1 --2- 172.21.15.175:0/2971958288 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fed88066f60 0x7fed88069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:10.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.332+0000 7feda9600640 1 -- 172.21.15.175:0/2971958288 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed94084250 con 0x7fedac15c5e0 2024-04-25T09:14:10.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.336+0000 7fedb0c00640 1 --2- 172.21.15.175:0/2971958288 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fed88066f60 0x7fed88069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:10.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.336+0000 7fedb0c00640 1 --2- 172.21.15.175:0/2971958288 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fed88066f60 0x7fed88069420 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0ae000 tx=0x7fed9c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:10.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.340+0000 7feda9600640 1 -- 172.21.15.175:0/2971958288 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fed94054ca0 con 0x7fedac15c5e0 2024-04-25T09:14:10.515 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.528+0000 7fedb3600640 1 -- 172.21.15.175:0/2971958288 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fedac06afd0 con 0x7fedac15c5e0 2024-04-25T09:14:10.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.528+0000 7feda9600640 1 -- 172.21.15.175:0/2971958288 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v93) v1 ==== 53+0+73 (secure 0 0 0) 0x7fed94058d40 con 0x7fedac15c5e0 2024-04-25T09:14:10.516 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:14:10.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.532+0000 7fedb3600640 1 -- 172.21.15.175:0/2971958288 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fed88066f60 msgr2=0x7fed88069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:10.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.532+0000 7fedb3600640 1 --2- 172.21.15.175:0/2971958288 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fed88066f60 0x7fed88069420 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0ae000 tx=0x7fed9c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:14:10.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.532+0000 7fedb3600640 1 -- 172.21.15.175:0/2971958288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedac15c5e0 msgr2=0x7fedac159150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:10.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.532+0000 7fedb3600640 1 --2- 172.21.15.175:0/2971958288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedac15c5e0 0x7fedac159150 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fed9400c480 tx=0x7fed9400c940 comp rx=0 tx=0).stop 2024-04-25T09:14:10.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.532+0000 7fedb3600640 1 -- 172.21.15.175:0/2971958288 shutdown_connections 2024-04-25T09:14:10.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.532+0000 7fedb3600640 1 --2- 172.21.15.175:0/2971958288 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fed88066f60 0x7fed88069420 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.532+0000 7fedb3600640 1 --2- 172.21.15.175:0/2971958288 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fedac13cd90 0x7fedac159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.532+0000 7fedb3600640 1 --2- 172.21.15.175:0/2971958288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fedac15c5e0 0x7fedac159150 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.532+0000 7fedb3600640 1 --2- 172.21.15.175:0/2971958288 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fedac1453a0 0x7fedac13dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:10.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.532+0000 7fedb3600640 1 -- 172.21.15.175:0/2971958288 >> 172.21.15.175:0/2971958288 conn(0x7fedac144fc0 msgr2=0x7fedac15e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:10.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.532+0000 7fedb3600640 1 -- 172.21.15.175:0/2971958288 shutdown_connections 2024-04-25T09:14:10.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:10.532+0000 7fedb3600640 1 -- 172.21.15.175:0/2971958288 wait complete. 2024-04-25T09:14:10.538 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:14:10.538 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:14:10.538 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-25T09:14:10.538 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:14:10.538 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:10.538 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:14:10.538 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:14:10.538 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:14:10.538 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:14:10.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:10.539 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-25T09:14:10.548 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:14:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:14:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:14:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:14:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:10.548 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:14:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:10.548 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-25T09:14:10.548 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:14:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-25T09:14:10.549 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:14:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:10.549 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:14:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:14:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 41868sec preferred_lft 41868sec 2024-04-25T09:14:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-25T09:14:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:10.549 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:14:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:0d:71:4a:a6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:14:10.549 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:10.550 INFO:teuthology.orchestra.run.smithi175.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:14:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:14:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:14:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:10.550 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:14:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:14:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:14:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:10.550 INFO:teuthology.orchestra.run.smithi175.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:14:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:14:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:14:10.550 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:10.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:10.552 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:14:10.614 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:14:10.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:10.617 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-25T09:14:10.668 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-25T09:14:10.668 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:14:10.668 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:14:10.668 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:14:10.668 INFO:teuthology.orchestra.run.smithi175.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:14:10.669 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:14:10.669 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:14:10.669 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:14:10.669 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:14:10.669 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:14:10.669 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:14:10.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:10.670 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:14:10.670 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:14:10.670 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:14:10.670 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:14:10.670 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:14:10.670 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:14:10.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:10.761 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:14:10.817 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:14:10.818 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:14:10.818 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:14:10.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:10.818 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-25T09:14:10.884 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:14:10.884 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:10.932 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:14:10.933 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:14:10.933 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:10.980 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:14:10.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:10.980 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:11.068 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:11.069 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:14:11.069 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:14:11.083 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:11.083 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:14:11.084 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:14:11.084 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:14:11.084 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:14:11.091 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:11.092 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:14:11.092 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:14:11.092 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:14:11.092 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:14:11.092 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:14:11.092 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:14:11.092 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:14:11.096 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:14:11.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:11.096 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:11.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:11.115 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:14:11.172 INFO:teuthology.orchestra.run.smithi175.stdout:client8338 2024-04-25T09:14:11.172 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:14:11.173 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:11.221 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:11.221 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:11.221 DEBUG:teuthology.orchestra.run.smithi175:> mount_point = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T09:14:11.221 DEBUG:teuthology.orchestra.run.smithi175:> parent = os.path.join(mount_point, "parent") 2024-04-25T09:14:11.221 DEBUG:teuthology.orchestra.run.smithi175:> os.mkdir(parent) 2024-04-25T09:14:11.221 DEBUG:teuthology.orchestra.run.smithi175:> flushed = os.path.join(parent, "flushed") 2024-04-25T09:14:11.221 DEBUG:teuthology.orchestra.run.smithi175:> os.mkdir(flushed) 2024-04-25T09:14:11.221 DEBUG:teuthology.orchestra.run.smithi175:> for f in ["alpha", "bravo", "charlie"]: 2024-04-25T09:14:11.221 DEBUG:teuthology.orchestra.run.smithi175:> open(os.path.join(flushed, f), '"'"'w'"'"').write(f) 2024-04-25T09:14:11.221 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:11.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:11.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:11.345 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T09:14:11.407 INFO:teuthology.orchestra.run.smithi175.stdout:./ 2024-04-25T09:14:11.407 INFO:teuthology.orchestra.run.smithi175.stdout:./parent 2024-04-25T09:14:11.407 INFO:teuthology.orchestra.run.smithi175.stdout:./parent/flushed 2024-04-25T09:14:11.407 INFO:teuthology.orchestra.run.smithi175.stdout:./parent/flushed/charlie 2024-04-25T09:14:11.407 INFO:teuthology.orchestra.run.smithi175.stdout:./parent/flushed/alpha 2024-04-25T09:14:11.407 INFO:teuthology.orchestra.run.smithi175.stdout:./parent/flushed/bravo 2024-04-25T09:14:11.408 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:11.408 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:11.408 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:11.408 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:11.408 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T09:14:11.408 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:11.517 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:14:11.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:11.526 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:11.526 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:11.526 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:11.527 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:11.527 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T09:14:11.527 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:11.632 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627776 2024-04-25T09:14:11.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:11.640 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:11.640 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:11.641 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:11.641 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:11.641 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-25T09:14:11.641 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:11.744 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627777 2024-04-25T09:14:11.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:11.754 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:11.754 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:11.754 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:11.754 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:11.754 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-25T09:14:11.754 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:11.860 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627780 2024-04-25T09:14:11.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:11.869 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:11.869 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:11.869 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:11.869 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:11.869 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-25T09:14:11.869 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:11.976 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627778 2024-04-25T09:14:11.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:11.985 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:11.985 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:11.985 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:11.985 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:11.985 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-04-25T09:14:11.985 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:12.092 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627779 2024-04-25T09:14:12.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:12.102 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:14:12.102 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:12.157 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:14:12.158 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:12.209 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:14:12.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.404+0000 7f6e29a00640 1 Processor -- start 2024-04-25T09:14:12.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.404+0000 7f6e29a00640 1 -- start start 2024-04-25T09:14:12.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.408+0000 7f6e29a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e24099a50 0x7f6e240cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:12.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.408+0000 7f6e29a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6e2409abb0 0x7f6e240cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:12.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.408+0000 7f6e29a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e240cc4c0 con 0x7f6e2415bc10 2024-04-25T09:14:12.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.408+0000 7f6e29a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e240d06f0 con 0x7f6e2409abb0 2024-04-25T09:14:12.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.408+0000 7f6e29a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e240cc7a0 con 0x7f6e24099a50 2024-04-25T09:14:12.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.408+0000 7f6e23400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6e2409abb0 0x7f6e240cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:12.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.408+0000 7f6e22000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f6e2415bc10 0x7f6e24099e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:42560/0 (socket says 172.21.15.175:42560) 2024-04-25T09:14:12.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.408+0000 7f6e22000640 1 -- 172.21.15.175:0/3031345903 learned_addr learned my addr 172.21.15.175:0/3031345903 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:12.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.408+0000 7f6e22a00640 1 --2- 172.21.15.175:0/3031345903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e24099a50 0x7f6e240cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:12.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.408+0000 7f6e23400640 1 -- 172.21.15.175:0/3031345903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e24099a50 msgr2=0x7f6e240cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:12.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.408+0000 7f6e23400640 1 --2- 172.21.15.175:0/3031345903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e24099a50 0x7f6e240cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.408+0000 7f6e23400640 1 -- 172.21.15.175:0/3031345903 >> v1:172.21.15.175:6789/0 conn(0x7f6e2415bc10 legacy=0x7f6e24099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:12.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.408+0000 7f6e23400640 1 -- 172.21.15.175:0/3031345903 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e240cca80 con 0x7f6e2409abb0 2024-04-25T09:14:12.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.408+0000 7f6e21600640 1 -- 172.21.15.175:0/3031345903 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542056102 0 0) 0x7f6e240cc4c0 con 0x7f6e2415bc10 2024-04-25T09:14:12.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.412+0000 7f6e23400640 1 --2- 172.21.15.175:0/3031345903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2409abb0 0x7f6e240cfdf0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009d90 tx=0x7f6e1c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2a5c4d5b7e2cb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:12.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.412+0000 7f6e21600640 1 -- 172.21.15.175:0/3031345903 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0b2070 con 0x7f6e2409abb0 2024-04-25T09:14:12.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.412+0000 7f6e21600640 1 -- 172.21.15.175:0/3031345903 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1c0a5830 con 0x7f6e2409abb0 2024-04-25T09:14:12.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.412+0000 7f6e21600640 1 -- 172.21.15.175:0/3031345903 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c0a5c00 con 0x7f6e2409abb0 2024-04-25T09:14:12.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.412+0000 7f6e29a00640 1 -- 172.21.15.175:0/3031345903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2409abb0 msgr2=0x7f6e240cfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:12.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.412+0000 7f6e29a00640 1 --2- 172.21.15.175:0/3031345903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2409abb0 0x7f6e240cfdf0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009d90 tx=0x7f6e1c01c970 comp rx=0 tx=0).stop 2024-04-25T09:14:12.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.412+0000 7f6e29a00640 1 -- 172.21.15.175:0/3031345903 shutdown_connections 2024-04-25T09:14:12.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.412+0000 7f6e29a00640 1 --2- 172.21.15.175:0/3031345903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2409abb0 0x7f6e240cfdf0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.412+0000 7f6e29a00640 1 --2- 172.21.15.175:0/3031345903 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e24099a50 0x7f6e240cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.412+0000 7f6e29a00640 1 -- 172.21.15.175:0/3031345903 >> 172.21.15.175:0/3031345903 conn(0x7f6e240b3300 msgr2=0x7f6e240b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:12.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.412+0000 7f6e29a00640 1 -- 172.21.15.175:0/3031345903 shutdown_connections 2024-04-25T09:14:12.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.412+0000 7f6e29a00640 1 -- 172.21.15.175:0/3031345903 wait complete. 2024-04-25T09:14:12.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.412+0000 7f6e29a00640 1 Processor -- start 2024-04-25T09:14:12.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.412+0000 7f6e29a00640 1 -- start start 2024-04-25T09:14:12.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e29a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e24099a50 0x7f6e2414cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:12.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e29a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2409abb0 0x7f6e240cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:12.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e29a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e2415bc10 0x7f6e240cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:12.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e29a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e240c5f00 con 0x7f6e2409abb0 2024-04-25T09:14:12.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e29a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e240c5d80 con 0x7f6e2415bc10 2024-04-25T09:14:12.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e29a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e24168850 con 0x7f6e24099a50 2024-04-25T09:14:12.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e22000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2409abb0 0x7f6e240cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:12.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e22000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2409abb0 0x7f6e240cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44982/0 (socket says 172.21.15.175:44982) 2024-04-25T09:14:12.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e22000640 1 -- 172.21.15.175:0/878858546 learned_addr learned my addr 172.21.15.175:0/878858546 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:12.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e22a00640 1 --2- 172.21.15.175:0/878858546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e24099a50 0x7f6e2414cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:12.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e23400640 1 --2- 172.21.15.175:0/878858546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e2415bc10 0x7f6e240cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:12.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e22000640 1 -- 172.21.15.175:0/878858546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e24099a50 msgr2=0x7f6e2414cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:12.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e22000640 1 --2- 172.21.15.175:0/878858546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e24099a50 0x7f6e2414cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e22000640 1 -- 172.21.15.175:0/878858546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e2415bc10 msgr2=0x7f6e240cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:12.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e22000640 1 --2- 172.21.15.175:0/878858546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e2415bc10 0x7f6e240cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e22000640 1 -- 172.21.15.175:0/878858546 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2414d270 con 0x7f6e2409abb0 2024-04-25T09:14:12.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e22000640 1 --2- 172.21.15.175:0/878858546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2409abb0 0x7f6e240cab40 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c4b0 tx=0x7f6e1000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:12.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e1aa00640 1 -- 172.21.15.175:0/878858546 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10018070 con 0x7f6e2409abb0 2024-04-25T09:14:12.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e1aa00640 1 -- 172.21.15.175:0/878858546 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e10007500 con 0x7f6e2409abb0 2024-04-25T09:14:12.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e1aa00640 1 -- 172.21.15.175:0/878858546 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10004a30 con 0x7f6e2409abb0 2024-04-25T09:14:12.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e29a00640 1 -- 172.21.15.175:0/878858546 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e240cdf90 con 0x7f6e2409abb0 2024-04-25T09:14:12.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e29a00640 1 -- 172.21.15.175:0/878858546 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e240ce550 con 0x7f6e2409abb0 2024-04-25T09:14:12.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e29a00640 1 -- 172.21.15.175:0/878858546 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e24074a60 con 0x7f6e2409abb0 2024-04-25T09:14:12.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.416+0000 7f6e1aa00640 1 -- 172.21.15.175:0/878858546 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6e10004bd0 con 0x7f6e2409abb0 2024-04-25T09:14:12.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.420+0000 7f6e1aa00640 1 --2- 172.21.15.175:0/878858546 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6e04066f60 0x7f6e04069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:12.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.420+0000 7f6e1aa00640 1 -- 172.21.15.175:0/878858546 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e100841f0 con 0x7f6e2409abb0 2024-04-25T09:14:12.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.420+0000 7f6e22a00640 1 --2- 172.21.15.175:0/878858546 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6e04066f60 0x7f6e04069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:12.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.420+0000 7f6e22a00640 1 --2- 172.21.15.175:0/878858546 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6e04066f60 0x7f6e04069420 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009b60 tx=0x7f6e14009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:12.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.424+0000 7f6e1aa00640 1 -- 172.21.15.175:0/878858546 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6e10054ba0 con 0x7f6e2409abb0 2024-04-25T09:14:12.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.576+0000 7f6e29a00640 1 -- 172.21.15.175:0/878858546 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e24066de0 con 0x7f6e2409abb0 2024-04-25T09:14:12.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.576+0000 7f6e1aa00640 1 -- 172.21.15.175:0/878858546 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16663 (secure 0 0 0) 0x7f6e10058c40 con 0x7f6e2409abb0 2024-04-25T09:14:12.565 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:12.565 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":113,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:14:05.335790+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:14:01.413477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:14:02.699273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:14:12.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.580+0000 7f6e29a00640 1 -- 172.21.15.175:0/878858546 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6e04066f60 msgr2=0x7f6e04069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:12.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.580+0000 7f6e29a00640 1 --2- 172.21.15.175:0/878858546 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6e04066f60 0x7f6e04069420 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009b60 tx=0x7f6e14009190 comp rx=0 tx=0).stop 2024-04-25T09:14:12.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.580+0000 7f6e29a00640 1 -- 172.21.15.175:0/878858546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2409abb0 msgr2=0x7f6e240cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:12.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.580+0000 7f6e29a00640 1 --2- 172.21.15.175:0/878858546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2409abb0 0x7f6e240cab40 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000c4b0 tx=0x7f6e1000c970 comp rx=0 tx=0).stop 2024-04-25T09:14:12.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.580+0000 7f6e29a00640 1 -- 172.21.15.175:0/878858546 shutdown_connections 2024-04-25T09:14:12.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.580+0000 7f6e29a00640 1 --2- 172.21.15.175:0/878858546 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6e04066f60 0x7f6e04069420 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.580+0000 7f6e29a00640 1 --2- 172.21.15.175:0/878858546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e2415bc10 0x7f6e240cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.580+0000 7f6e29a00640 1 --2- 172.21.15.175:0/878858546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e2409abb0 0x7f6e240cab40 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.580+0000 7f6e29a00640 1 --2- 172.21.15.175:0/878858546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e24099a50 0x7f6e2414cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.580+0000 7f6e29a00640 1 -- 172.21.15.175:0/878858546 >> 172.21.15.175:0/878858546 conn(0x7f6e240b3300 msgr2=0x7f6e240c65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:12.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.580+0000 7f6e29a00640 1 -- 172.21.15.175:0/878858546 shutdown_connections 2024-04-25T09:14:12.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.580+0000 7f6e29a00640 1 -- 172.21.15.175:0/878858546 wait complete. 2024-04-25T09:14:12.587 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:14:01.413477+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:14:02.699273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:14:12.587 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:14:12.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.736+0000 7f201a200640 1 Processor -- start 2024-04-25T09:14:12.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.736+0000 7f201a200640 1 -- start start 2024-04-25T09:14:12.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.740+0000 7f201a200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2014145250 0x7f20140cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:12.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.740+0000 7f201a200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f20140ce970 0x7f20140cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:12.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.740+0000 7f201a200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20140cfd10 con 0x7f20141600a0 2024-04-25T09:14:12.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.740+0000 7f201a200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201415f650 con 0x7f2014145250 2024-04-25T09:14:12.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.740+0000 7f201a200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20140cfff0 con 0x7f20140ce970 2024-04-25T09:14:12.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.740+0000 7f2013400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2014145250 0x7f20140cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:12.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.740+0000 7f200aa00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f20141600a0 0x7f20140cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:42572/0 (socket says 172.21.15.175:42572) 2024-04-25T09:14:12.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.740+0000 7f200aa00640 1 -- 172.21.15.175:0/536054400 learned_addr learned my addr 172.21.15.175:0/536054400 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:12.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.740+0000 7f2013e00640 1 --2- 172.21.15.175:0/536054400 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f20140ce970 0x7f20140cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:12.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.740+0000 7f2013400640 1 -- 172.21.15.175:0/536054400 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f20140ce970 msgr2=0x7f20140cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:12.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.740+0000 7f2013400640 1 --2- 172.21.15.175:0/536054400 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f20140ce970 0x7f20140cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.740+0000 7f2013400640 1 -- 172.21.15.175:0/536054400 >> v1:172.21.15.175:6789/0 conn(0x7f20141600a0 legacy=0x7f20140cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:12.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.740+0000 7f2013400640 1 -- 172.21.15.175:0/536054400 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201415f8a0 con 0x7f2014145250 2024-04-25T09:14:12.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.740+0000 7f2012a00640 1 -- 172.21.15.175:0/536054400 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 981595003 0 0) 0x7f20140cfd10 con 0x7f20141600a0 2024-04-25T09:14:12.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.744+0000 7f2013400640 1 --2- 172.21.15.175:0/536054400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2014145250 0x7f20140cf6b0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f2004009dc0 tx=0x7f200401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a8a1d499924095 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:12.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.744+0000 7f2012a00640 1 -- 172.21.15.175:0/536054400 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20040b2070 con 0x7f2014145250 2024-04-25T09:14:12.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.744+0000 7f2012a00640 1 -- 172.21.15.175:0/536054400 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20040a5970 con 0x7f2014145250 2024-04-25T09:14:12.730 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.744+0000 7f2012a00640 1 -- 172.21.15.175:0/536054400 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20040a5d40 con 0x7f2014145250 2024-04-25T09:14:12.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.744+0000 7f201a200640 1 -- 172.21.15.175:0/536054400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2014145250 msgr2=0x7f20140cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:12.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.744+0000 7f201a200640 1 --2- 172.21.15.175:0/536054400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2014145250 0x7f20140cf6b0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f2004009dc0 tx=0x7f200401c890 comp rx=0 tx=0).stop 2024-04-25T09:14:12.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.744+0000 7f201a200640 1 -- 172.21.15.175:0/536054400 shutdown_connections 2024-04-25T09:14:12.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.744+0000 7f201a200640 1 --2- 172.21.15.175:0/536054400 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f20140ce970 0x7f20140cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.744+0000 7f201a200640 1 --2- 172.21.15.175:0/536054400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2014145250 0x7f20140cf6b0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.744+0000 7f201a200640 1 -- 172.21.15.175:0/536054400 >> 172.21.15.175:0/536054400 conn(0x7f201406ac50 msgr2=0x7f201406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:12.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.744+0000 7f201a200640 1 -- 172.21.15.175:0/536054400 shutdown_connections 2024-04-25T09:14:12.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.744+0000 7f201a200640 1 -- 172.21.15.175:0/536054400 wait complete. 2024-04-25T09:14:12.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.744+0000 7f201a200640 1 Processor -- start 2024-04-25T09:14:12.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.744+0000 7f201a200640 1 -- start start 2024-04-25T09:14:12.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f201a200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20140ce970 0x7f2014142fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:12.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f201a200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2014145250 0x7f201413d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:12.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f201a200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20141600a0 0x7f20140b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:12.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f201a200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201415c870 con 0x7f20141600a0 2024-04-25T09:14:12.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f201a200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2014145630 con 0x7f20140ce970 2024-04-25T09:14:12.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f201a200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201415c9f0 con 0x7f2014145250 2024-04-25T09:14:12.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f2013e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20141600a0 0x7f20140b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:12.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f2013e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20141600a0 0x7f20140b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45000/0 (socket says 172.21.15.175:45000) 2024-04-25T09:14:12.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f2013e00640 1 -- 172.21.15.175:0/246648331 learned_addr learned my addr 172.21.15.175:0/246648331 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:12.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f2013400640 1 --2- 172.21.15.175:0/246648331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20140ce970 0x7f2014142fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:12.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f200aa00640 1 --2- 172.21.15.175:0/246648331 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2014145250 0x7f201413d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f2013e00640 1 -- 172.21.15.175:0/246648331 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2014145250 msgr2=0x7f201413d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f2013e00640 1 --2- 172.21.15.175:0/246648331 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2014145250 0x7f201413d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f2013e00640 1 -- 172.21.15.175:0/246648331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20140ce970 msgr2=0x7f2014142fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f2013e00640 1 --2- 172.21.15.175:0/246648331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20140ce970 0x7f2014142fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f2013e00640 1 -- 172.21.15.175:0/246648331 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2014144340 con 0x7f20141600a0 2024-04-25T09:14:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f200aa00640 1 --2- 172.21.15.175:0/246648331 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2014145250 0x7f201413d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f2013e00640 1 --2- 172.21.15.175:0/246648331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20141600a0 0x7f20140b0510 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f200c00d830 tx=0x7f200c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f200be00640 1 -- 172.21.15.175:0/246648331 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c00b6c0 con 0x7f20141600a0 2024-04-25T09:14:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f200be00640 1 -- 172.21.15.175:0/246648331 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200c019070 con 0x7f20141600a0 2024-04-25T09:14:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f200be00640 1 -- 172.21.15.175:0/246648331 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200c00baa0 con 0x7f20141600a0 2024-04-25T09:14:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f201a200640 1 -- 172.21.15.175:0/246648331 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2014144620 con 0x7f20141600a0 2024-04-25T09:14:12.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f201a200640 1 -- 172.21.15.175:0/246648331 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20140b29b0 con 0x7f20141600a0 2024-04-25T09:14:12.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f201a200640 1 -- 172.21.15.175:0/246648331 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2014075160 con 0x7f20141600a0 2024-04-25T09:14:12.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.748+0000 7f200be00640 1 -- 172.21.15.175:0/246648331 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f200c01e460 con 0x7f20141600a0 2024-04-25T09:14:12.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.752+0000 7f200be00640 1 --2- 172.21.15.175:0/246648331 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1ff0066f60 0x7f1ff0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:12.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.752+0000 7f200be00640 1 -- 172.21.15.175:0/246648331 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f200c085730 con 0x7f20141600a0 2024-04-25T09:14:12.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.752+0000 7f2013400640 1 --2- 172.21.15.175:0/246648331 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1ff0066f60 0x7f1ff0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:12.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.752+0000 7f2013400640 1 --2- 172.21.15.175:0/246648331 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1ff0066f60 0x7f1ff0069420 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f20040af000 tx=0x7f20040a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:12.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.756+0000 7f200be00640 1 -- 172.21.15.175:0/246648331 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f200c0566b0 con 0x7f20141600a0 2024-04-25T09:14:12.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.908+0000 7f201a200640 1 -- 172.21.15.175:0/246648331 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f20140b2b80 con 0x7f20141600a0 2024-04-25T09:14:12.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.908+0000 7f200be00640 1 -- 172.21.15.175:0/246648331 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7f200c055fb0 con 0x7f20141600a0 2024-04-25T09:14:12.897 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:14:12.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.912+0000 7f201a200640 1 -- 172.21.15.175:0/246648331 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1ff0066f60 msgr2=0x7f1ff0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:12.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.912+0000 7f201a200640 1 --2- 172.21.15.175:0/246648331 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1ff0066f60 0x7f1ff0069420 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f20040af000 tx=0x7f20040a7070 comp rx=0 tx=0).stop 2024-04-25T09:14:12.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.912+0000 7f201a200640 1 -- 172.21.15.175:0/246648331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20141600a0 msgr2=0x7f20140b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:12.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.912+0000 7f201a200640 1 --2- 172.21.15.175:0/246648331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20141600a0 0x7f20140b0510 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f200c00d830 tx=0x7f200c00dcf0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.912+0000 7f201a200640 1 -- 172.21.15.175:0/246648331 shutdown_connections 2024-04-25T09:14:12.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.912+0000 7f201a200640 1 --2- 172.21.15.175:0/246648331 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1ff0066f60 0x7f1ff0069420 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.912+0000 7f201a200640 1 --2- 172.21.15.175:0/246648331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f20141600a0 0x7f20140b0510 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.912+0000 7f201a200640 1 --2- 172.21.15.175:0/246648331 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2014145250 0x7f201413d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.912+0000 7f201a200640 1 --2- 172.21.15.175:0/246648331 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f20140ce970 0x7f2014142fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:12.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.912+0000 7f201a200640 1 -- 172.21.15.175:0/246648331 >> 172.21.15.175:0/246648331 conn(0x7f201406ac50 msgr2=0x7f20140cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:12.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.912+0000 7f201a200640 1 -- 172.21.15.175:0/246648331 shutdown_connections 2024-04-25T09:14:12.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:12.912+0000 7f201a200640 1 -- 172.21.15.175:0/246648331 wait complete. 2024-04-25T09:14:12.919 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:14:13.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.068+0000 7f7489600640 1 Processor -- start 2024-04-25T09:14:13.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.068+0000 7f7489600640 1 -- start start 2024-04-25T09:14:13.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.072+0000 7f7489600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7484145250 0x7f74840cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:13.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.072+0000 7f7489600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74840cfd10 con 0x7f74840ce970 2024-04-25T09:14:13.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.072+0000 7f7489600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74840cfff0 con 0x7f74841600a0 2024-04-25T09:14:13.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.072+0000 7f7489600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748415f650 con 0x7f7484145250 2024-04-25T09:14:13.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.072+0000 7f7483400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f74840ce970 0x7f74840cee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:42580/0 (socket says 172.21.15.175:42580) 2024-04-25T09:14:13.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.072+0000 7f7483400640 1 -- 172.21.15.175:0/179837975 learned_addr learned my addr 172.21.15.175:0/179837975 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:13.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.072+0000 7f7482a00640 1 --2- 172.21.15.175:0/179837975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7484145250 0x7f74840cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:13.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.072+0000 7f7482000640 1 -- 172.21.15.175:0/179837975 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214436019 0 0) 0x7f74840cfd10 con 0x7f74840ce970 2024-04-25T09:14:13.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.072+0000 7f7482000640 1 -- 172.21.15.175:0/179837975 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7468003530 con 0x7f74840ce970 2024-04-25T09:14:13.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.072+0000 7f7482000640 1 -- 172.21.15.175:0/179837975 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292751425 0 0) 0x7f74840cfff0 con 0x7f74841600a0 2024-04-25T09:14:13.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.072+0000 7f7482000640 1 -- 172.21.15.175:0/179837975 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74840cfd10 con 0x7f74841600a0 2024-04-25T09:14:13.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.072+0000 7f7482a00640 1 -- 172.21.15.175:0/179837975 >> v1:172.21.15.177:6789/0 conn(0x7f74841600a0 legacy=0x7f74840cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:13.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.072+0000 7f7482a00640 1 -- 172.21.15.175:0/179837975 >> v1:172.21.15.175:6789/0 conn(0x7f74840ce970 legacy=0x7f74840cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:13.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.072+0000 7f7482a00640 1 -- 172.21.15.175:0/179837975 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748415f8a0 con 0x7f7484145250 2024-04-25T09:14:13.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.076+0000 7f7482a00640 1 --2- 172.21.15.175:0/179837975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7484145250 0x7f74840cf6b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f74740097f0 tx=0x7f747401c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0e67e9115678b8f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:13.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.076+0000 7f7482000640 1 -- 172.21.15.175:0/179837975 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740b1070 con 0x7f7484145250 2024-04-25T09:14:13.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.076+0000 7f7482000640 1 -- 172.21.15.175:0/179837975 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74740ac410 con 0x7f7484145250 2024-04-25T09:14:13.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.076+0000 7f7482000640 1 -- 172.21.15.175:0/179837975 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740ac7c0 con 0x7f7484145250 2024-04-25T09:14:13.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.076+0000 7f7489600640 1 -- 172.21.15.175:0/179837975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7484145250 msgr2=0x7f74840cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:13.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.076+0000 7f7489600640 1 --2- 172.21.15.175:0/179837975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7484145250 0x7f74840cf6b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f74740097f0 tx=0x7f747401c390 comp rx=0 tx=0).stop 2024-04-25T09:14:13.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.076+0000 7f7489600640 1 -- 172.21.15.175:0/179837975 shutdown_connections 2024-04-25T09:14:13.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.076+0000 7f7489600640 1 --2- 172.21.15.175:0/179837975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7484145250 0x7f74840cf6b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.076+0000 7f7489600640 1 -- 172.21.15.175:0/179837975 >> 172.21.15.175:0/179837975 conn(0x7f748406ac50 msgr2=0x7f748406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:13.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.076+0000 7f7489600640 1 -- 172.21.15.175:0/179837975 shutdown_connections 2024-04-25T09:14:13.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.076+0000 7f7489600640 1 -- 172.21.15.175:0/179837975 wait complete. 2024-04-25T09:14:13.064 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.076+0000 7f7489600640 1 Processor -- start 2024-04-25T09:14:13.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.076+0000 7f7489600640 1 -- start start 2024-04-25T09:14:13.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7489600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74840ce970 0x7f748413fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:13.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7489600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7484145250 0x7f7484160df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:13.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7489600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74841600a0 0x7f74840af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:13.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7489600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748415c9f0 con 0x7f74840ce970 2024-04-25T09:14:13.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7489600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748415c870 con 0x7f74841600a0 2024-04-25T09:14:13.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7489600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748415cb70 con 0x7f7484145250 2024-04-25T09:14:13.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7482a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74840ce970 0x7f748413fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:13.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7482a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74840ce970 0x7f748413fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45004/0 (socket says 172.21.15.175:45004) 2024-04-25T09:14:13.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7482a00640 1 -- 172.21.15.175:0/3289014424 learned_addr learned my addr 172.21.15.175:0/3289014424 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:13.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f747a000640 1 --2- 172.21.15.175:0/3289014424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7484145250 0x7f7484160df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:13.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7483400640 1 --2- 172.21.15.175:0/3289014424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74841600a0 0x7f74840af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:13.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7482a00640 1 -- 172.21.15.175:0/3289014424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7484145250 msgr2=0x7f7484160df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:13.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7482a00640 1 --2- 172.21.15.175:0/3289014424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7484145250 0x7f7484160df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7482a00640 1 -- 172.21.15.175:0/3289014424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74841600a0 msgr2=0x7f74840af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:13.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7482a00640 1 --2- 172.21.15.175:0/3289014424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74841600a0 0x7f74840af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7482a00640 1 -- 172.21.15.175:0/3289014424 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74840b3510 con 0x7f74840ce970 2024-04-25T09:14:13.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f747a000640 1 --2- 172.21.15.175:0/3289014424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7484145250 0x7f7484160df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:13.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7483400640 1 --2- 172.21.15.175:0/3289014424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74841600a0 0x7f74840af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:13.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7482a00640 1 --2- 172.21.15.175:0/3289014424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74840ce970 0x7f748413fad0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f7474018fa0 tx=0x7f7474019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:13.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f747b400640 1 -- 172.21.15.175:0/3289014424 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740b9020 con 0x7f74840ce970 2024-04-25T09:14:13.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f747b400640 1 -- 172.21.15.175:0/3289014424 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7474003620 con 0x7f74840ce970 2024-04-25T09:14:13.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f747b400640 1 -- 172.21.15.175:0/3289014424 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740b1040 con 0x7f74840ce970 2024-04-25T09:14:13.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7489600640 1 -- 172.21.15.175:0/3289014424 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74840b37f0 con 0x7f74840ce970 2024-04-25T09:14:13.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7489600640 1 -- 172.21.15.175:0/3289014424 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74840b3db0 con 0x7f74840ce970 2024-04-25T09:14:13.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f7489600640 1 -- 172.21.15.175:0/3289014424 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7484075160 con 0x7f74840ce970 2024-04-25T09:14:13.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.080+0000 7f747b400640 1 -- 172.21.15.175:0/3289014424 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f74740bc020 con 0x7f74840ce970 2024-04-25T09:14:13.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.084+0000 7f747b400640 1 --2- 172.21.15.175:0/3289014424 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7460066f60 0x7f7460069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:13.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.084+0000 7f747b400640 1 -- 172.21.15.175:0/3289014424 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f747411e940 con 0x7f74840ce970 2024-04-25T09:14:13.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.084+0000 7f747a000640 1 --2- 172.21.15.175:0/3289014424 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7460066f60 0x7f7460069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:13.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.084+0000 7f747a000640 1 --2- 172.21.15.175:0/3289014424 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7460066f60 0x7f7460069420 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7484167770 tx=0x7f746c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:13.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.088+0000 7f747b400640 1 -- 172.21.15.175:0/3289014424 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f74740c3030 con 0x7f74840ce970 2024-04-25T09:14:13.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.240+0000 7f7489600640 1 -- 172.21.15.175:0/3289014424 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7484067fc0 con 0x7f74840ce970 2024-04-25T09:14:13.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.240+0000 7f747b400640 1 -- 172.21.15.175:0/3289014424 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7f74740160d0 con 0x7f74840ce970 2024-04-25T09:14:13.226 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:14:13.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.240+0000 7f7489600640 1 -- 172.21.15.175:0/3289014424 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7460066f60 msgr2=0x7f7460069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:13.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.240+0000 7f7489600640 1 --2- 172.21.15.175:0/3289014424 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7460066f60 0x7f7460069420 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7484167770 tx=0x7f746c009040 comp rx=0 tx=0).stop 2024-04-25T09:14:13.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.240+0000 7f7489600640 1 -- 172.21.15.175:0/3289014424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74840ce970 msgr2=0x7f748413fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:13.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.240+0000 7f7489600640 1 --2- 172.21.15.175:0/3289014424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74840ce970 0x7f748413fad0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f7474018fa0 tx=0x7f7474019130 comp rx=0 tx=0).stop 2024-04-25T09:14:13.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.240+0000 7f7489600640 1 -- 172.21.15.175:0/3289014424 shutdown_connections 2024-04-25T09:14:13.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.240+0000 7f7489600640 1 --2- 172.21.15.175:0/3289014424 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7460066f60 0x7f7460069420 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.240+0000 7f7489600640 1 --2- 172.21.15.175:0/3289014424 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74841600a0 0x7f74840af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.240+0000 7f7489600640 1 --2- 172.21.15.175:0/3289014424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7484145250 0x7f7484160df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.240+0000 7f7489600640 1 --2- 172.21.15.175:0/3289014424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f74840ce970 0x7f748413fad0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.240+0000 7f7489600640 1 -- 172.21.15.175:0/3289014424 >> 172.21.15.175:0/3289014424 conn(0x7f748406ac50 msgr2=0x7f748415eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:13.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.240+0000 7f7489600640 1 -- 172.21.15.175:0/3289014424 shutdown_connections 2024-04-25T09:14:13.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.240+0000 7f7489600640 1 -- 172.21.15.175:0/3289014424 wait complete. 2024-04-25T09:14:13.248 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:14:13.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.400+0000 7f9419c00640 1 Processor -- start 2024-04-25T09:14:13.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.400+0000 7f9419c00640 1 -- start start 2024-04-25T09:14:13.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.404+0000 7f9419c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f941415fbe0 0x7f94140cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:13.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.404+0000 7f9419c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9414160060 0x7f94140cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:13.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.404+0000 7f9419c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94140cd590 con 0x7f941415baf0 2024-04-25T09:14:13.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.404+0000 7f9419c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941415cec0 con 0x7f941415fbe0 2024-04-25T09:14:13.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.404+0000 7f9419c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94140cc4f0 con 0x7f9414160060 2024-04-25T09:14:13.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.404+0000 7f940be00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f941415fbe0 0x7f94140cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:13.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.404+0000 7f9419200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9414160060 0x7f94140cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:13.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.404+0000 7f940be00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f941415fbe0 0x7f94140cf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:46644/0 (socket says 172.21.15.175:46644) 2024-04-25T09:14:13.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.404+0000 7f940be00640 1 -- 172.21.15.175:0/508010744 learned_addr learned my addr 172.21.15.175:0/508010744 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:13.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.404+0000 7f9419200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9414160060 0x7f94140cf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:35924/0 (socket says 172.21.15.175:35924) 2024-04-25T09:14:13.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.404+0000 7f9413e00640 1 --1- 172.21.15.175:0/508010744 >> v1:172.21.15.177:6789/0 conn(0x7f941415baf0 0x7f941415f4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:45664/0 (socket says 172.21.15.175:45664) 2024-04-25T09:14:13.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.404+0000 7f940be00640 1 -- 172.21.15.175:0/508010744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9414160060 msgr2=0x7f94140cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:13.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.404+0000 7f940be00640 1 --2- 172.21.15.175:0/508010744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9414160060 0x7f94140cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.404+0000 7f940be00640 1 -- 172.21.15.175:0/508010744 >> v1:172.21.15.177:6789/0 conn(0x7f941415baf0 legacy=0x7f941415f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:13.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.404+0000 7f940be00640 1 -- 172.21.15.175:0/508010744 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94140cc7d0 con 0x7f941415fbe0 2024-04-25T09:14:13.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.404+0000 7f9419200640 1 --2- 172.21.15.175:0/508010744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9414160060 0x7f94140cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:13.393 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f940be00640 1 --2- 172.21.15.175:0/508010744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f941415fbe0 0x7f94140cf2c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f93fc009870 tx=0x7f93fc01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e221c802a725f35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:13.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9413400640 1 -- 172.21.15.175:0/508010744 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc0a95f0 con 0x7f941415fbe0 2024-04-25T09:14:13.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9413400640 1 -- 172.21.15.175:0/508010744 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93fc0a9790 con 0x7f941415fbe0 2024-04-25T09:14:13.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9413400640 1 -- 172.21.15.175:0/508010744 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc0a9b60 con 0x7f941415fbe0 2024-04-25T09:14:13.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9419c00640 1 -- 172.21.15.175:0/508010744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f941415fbe0 msgr2=0x7f94140cf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:13.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9419c00640 1 --2- 172.21.15.175:0/508010744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f941415fbe0 0x7f94140cf2c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f93fc009870 tx=0x7f93fc01c530 comp rx=0 tx=0).stop 2024-04-25T09:14:13.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9419c00640 1 -- 172.21.15.175:0/508010744 shutdown_connections 2024-04-25T09:14:13.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9419c00640 1 --2- 172.21.15.175:0/508010744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9414160060 0x7f94140cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9419c00640 1 --2- 172.21.15.175:0/508010744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f941415fbe0 0x7f94140cf2c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9419c00640 1 -- 172.21.15.175:0/508010744 >> 172.21.15.175:0/508010744 conn(0x7f94140b31e0 msgr2=0x7f94140b35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:13.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9419c00640 1 -- 172.21.15.175:0/508010744 shutdown_connections 2024-04-25T09:14:13.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9419c00640 1 -- 172.21.15.175:0/508010744 wait complete. 2024-04-25T09:14:13.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9419c00640 1 Processor -- start 2024-04-25T09:14:13.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9419c00640 1 -- start start 2024-04-25T09:14:13.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9419c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f941415baf0 0x7f94140ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:13.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9419c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f941415fbe0 0x7f941415a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:13.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9419c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9414160060 0x7f941415abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:13.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9419c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941409aa60 con 0x7f941415baf0 2024-04-25T09:14:13.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9419c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94140cc200 con 0x7f941415fbe0 2024-04-25T09:14:13.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.408+0000 7f9419c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9414168810 con 0x7f9414160060 2024-04-25T09:14:13.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9413e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f941415baf0 0x7f94140ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:13.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9413e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f941415baf0 0x7f94140ae3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45008/0 (socket says 172.21.15.175:45008) 2024-04-25T09:14:13.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9413e00640 1 -- 172.21.15.175:0/735739333 learned_addr learned my addr 172.21.15.175:0/735739333 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:13.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f940be00640 1 --2- 172.21.15.175:0/735739333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f941415fbe0 0x7f941415a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:13.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9419200640 1 --2- 172.21.15.175:0/735739333 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9414160060 0x7f941415abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:13.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9413e00640 1 -- 172.21.15.175:0/735739333 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9414160060 msgr2=0x7f941415abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:13.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9413e00640 1 --2- 172.21.15.175:0/735739333 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9414160060 0x7f941415abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9413e00640 1 -- 172.21.15.175:0/735739333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f941415fbe0 msgr2=0x7f941415a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:13.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9413e00640 1 --2- 172.21.15.175:0/735739333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f941415fbe0 0x7f941415a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9413e00640 1 -- 172.21.15.175:0/735739333 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94140ae8f0 con 0x7f941415baf0 2024-04-25T09:14:13.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f940be00640 1 --2- 172.21.15.175:0/735739333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f941415fbe0 0x7f941415a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:13.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9413e00640 1 --2- 172.21.15.175:0/735739333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f941415baf0 0x7f94140ae3b0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f940400c450 tx=0x7f940400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:13.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9410c00640 1 -- 172.21.15.175:0/735739333 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404018070 con 0x7f941415baf0 2024-04-25T09:14:13.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9410c00640 1 -- 172.21.15.175:0/735739333 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9404007480 con 0x7f941415baf0 2024-04-25T09:14:13.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9419c00640 1 -- 172.21.15.175:0/735739333 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9414151e20 con 0x7f941415baf0 2024-04-25T09:14:13.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9410c00640 1 -- 172.21.15.175:0/735739333 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94040047f0 con 0x7f941415baf0 2024-04-25T09:14:13.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9419c00640 1 -- 172.21.15.175:0/735739333 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94140ce6a0 con 0x7f941415baf0 2024-04-25T09:14:13.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9419c00640 1 -- 172.21.15.175:0/735739333 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9414074a60 con 0x7f941415baf0 2024-04-25T09:14:13.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9410c00640 1 -- 172.21.15.175:0/735739333 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f940401b070 con 0x7f941415baf0 2024-04-25T09:14:13.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9410c00640 1 --2- 172.21.15.175:0/735739333 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f93f0066f90 0x7f93f0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:13.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.412+0000 7f9410c00640 1 -- 172.21.15.175:0/735739333 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94040842d0 con 0x7f941415baf0 2024-04-25T09:14:13.401 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.416+0000 7f940be00640 1 --2- 172.21.15.175:0/735739333 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f93f0066f90 0x7f93f0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:13.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.416+0000 7f940be00640 1 --2- 172.21.15.175:0/735739333 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f93f0066f90 0x7f93f0069450 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0ae000 tx=0x7f93fc0b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:13.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.420+0000 7f9410c00640 1 -- 172.21.15.175:0/735739333 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9404055240 con 0x7f941415baf0 2024-04-25T09:14:13.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.572+0000 7f9419c00640 1 -- 172.21.15.175:0/735739333 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94140cda80 con 0x7f941415baf0 2024-04-25T09:14:13.558 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.572+0000 7f9410c00640 1 -- 172.21.15.175:0/735739333 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9404054b40 con 0x7f941415baf0 2024-04-25T09:14:13.559 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:14:13.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.572+0000 7f9419c00640 1 -- 172.21.15.175:0/735739333 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f93f0066f90 msgr2=0x7f93f0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:13.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.572+0000 7f9419c00640 1 --2- 172.21.15.175:0/735739333 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f93f0066f90 0x7f93f0069450 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0ae000 tx=0x7f93fc0b3040 comp rx=0 tx=0).stop 2024-04-25T09:14:13.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.572+0000 7f9419c00640 1 -- 172.21.15.175:0/735739333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f941415baf0 msgr2=0x7f94140ae3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:13.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.572+0000 7f9419c00640 1 --2- 172.21.15.175:0/735739333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f941415baf0 0x7f94140ae3b0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f940400c450 tx=0x7f940400c910 comp rx=0 tx=0).stop 2024-04-25T09:14:13.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.572+0000 7f9419c00640 1 -- 172.21.15.175:0/735739333 shutdown_connections 2024-04-25T09:14:13.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.572+0000 7f9419c00640 1 --2- 172.21.15.175:0/735739333 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f93f0066f90 0x7f93f0069450 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.572+0000 7f9419c00640 1 --2- 172.21.15.175:0/735739333 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9414160060 0x7f941415abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.572+0000 7f9419c00640 1 --2- 172.21.15.175:0/735739333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f941415fbe0 0x7f941415a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.572+0000 7f9419c00640 1 --2- 172.21.15.175:0/735739333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f941415baf0 0x7f94140ae3b0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.572+0000 7f9419c00640 1 -- 172.21.15.175:0/735739333 >> 172.21.15.175:0/735739333 conn(0x7f94140b31e0 msgr2=0x7f94140b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:13.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.572+0000 7f9419c00640 1 -- 172.21.15.175:0/735739333 shutdown_connections 2024-04-25T09:14:13.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.572+0000 7f9419c00640 1 -- 172.21.15.175:0/735739333 wait complete. 2024-04-25T09:14:13.580 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:14:13.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa94f000640 1 Processor -- start 2024-04-25T09:14:13.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa94f000640 1 -- start start 2024-04-25T09:14:13.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa94f000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa9480cbe60 0x7fa94815af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:13.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa94f000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa94806d310 0x7fa9480b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:13.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa94f000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9480b4630 0x7fa9480b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:13.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa94f000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94806db60 con 0x7fa9480cbe60 2024-04-25T09:14:13.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa94f000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94806de40 con 0x7fa94806d310 2024-04-25T09:14:13.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa94f000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94806e120 con 0x7fa9480b4630 2024-04-25T09:14:13.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa947e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa9480cbe60 0x7fa94815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:13.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa947e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa9480cbe60 0x7fa94815af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45024/0 (socket says 172.21.15.175:45024) 2024-04-25T09:14:13.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa947e00640 1 -- 172.21.15.175:0/2925709217 learned_addr learned my addr 172.21.15.175:0/2925709217 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:13.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa94d000640 1 --2- 172.21.15.175:0/2925709217 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9480b4630 0x7fa9480b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:13.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa947400640 1 --2- 172.21.15.175:0/2925709217 >> v2:172.21.15.177:3300/0 conn(0x7fa94806d310 0x7fa9480b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:13.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa947e00640 1 -- 172.21.15.175:0/2925709217 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9480b4630 msgr2=0x7fa9480b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:13.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa947e00640 1 --2- 172.21.15.175:0/2925709217 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9480b4630 0x7fa9480b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa947e00640 1 -- 172.21.15.175:0/2925709217 >> v2:172.21.15.177:3300/0 conn(0x7fa94806d310 msgr2=0x7fa9480b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:13.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa947e00640 1 --2- 172.21.15.175:0/2925709217 >> v2:172.21.15.177:3300/0 conn(0x7fa94806d310 0x7fa9480b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa947e00640 1 -- 172.21.15.175:0/2925709217 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94815c2f0 con 0x7fa9480cbe60 2024-04-25T09:14:13.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.728+0000 7fa947400640 1 --2- 172.21.15.175:0/2925709217 >> v2:172.21.15.177:3300/0 conn(0x7fa94806d310 0x7fa9480b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:13.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.732+0000 7fa947e00640 1 --2- 172.21.15.175:0/2925709217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9480cbe60 0x7fa94815af20 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fa948072450 tx=0x7fa93801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff012a0b4f14c25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:13.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.732+0000 7fa946a00640 1 -- 172.21.15.175:0/2925709217 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9380b0070 con 0x7fa9480cbe60 2024-04-25T09:14:13.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.732+0000 7fa946a00640 1 -- 172.21.15.175:0/2925709217 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9380ab600 con 0x7fa9480cbe60 2024-04-25T09:14:13.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.732+0000 7fa946a00640 1 -- 172.21.15.175:0/2925709217 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9380ab9d0 con 0x7fa9480cbe60 2024-04-25T09:14:13.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.732+0000 7fa94f000640 1 -- 172.21.15.175:0/2925709217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9480cbe60 msgr2=0x7fa94815af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:13.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.732+0000 7fa94f000640 1 --2- 172.21.15.175:0/2925709217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9480cbe60 0x7fa94815af20 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fa948072450 tx=0x7fa93801c260 comp rx=0 tx=0).stop 2024-04-25T09:14:13.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.732+0000 7fa94f000640 1 -- 172.21.15.175:0/2925709217 shutdown_connections 2024-04-25T09:14:13.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.732+0000 7fa94f000640 1 --2- 172.21.15.175:0/2925709217 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9480b4630 0x7fa9480b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.732+0000 7fa94f000640 1 --2- 172.21.15.175:0/2925709217 >> v2:172.21.15.177:3300/0 conn(0x7fa94806d310 0x7fa9480b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.732+0000 7fa94f000640 1 --2- 172.21.15.175:0/2925709217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9480cbe60 0x7fa94815af20 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.732+0000 7fa94f000640 1 -- 172.21.15.175:0/2925709217 >> 172.21.15.175:0/2925709217 conn(0x7fa94806ac50 msgr2=0x7fa94806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:13.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.732+0000 7fa94f000640 1 -- 172.21.15.175:0/2925709217 shutdown_connections 2024-04-25T09:14:13.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.732+0000 7fa94f000640 1 -- 172.21.15.175:0/2925709217 wait complete. 2024-04-25T09:14:13.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa94f000640 1 Processor -- start 2024-04-25T09:14:13.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa94f000640 1 -- start start 2024-04-25T09:14:13.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa94f000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa94806d310 0x7fa9481581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:13.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa94f000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9480b4630 0x7fa948156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:13.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa94f000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9480cbe60 0x7fa94814a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:13.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa94f000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94815cbe0 con 0x7fa94806d310 2024-04-25T09:14:13.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa94f000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94815ca60 con 0x7fa9480b4630 2024-04-25T09:14:13.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa94f000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa94815cd60 con 0x7fa9480cbe60 2024-04-25T09:14:13.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa947e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa94806d310 0x7fa9481581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:13.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa947e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa94806d310 0x7fa9481581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45028/0 (socket says 172.21.15.175:45028) 2024-04-25T09:14:13.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa947e00640 1 -- 172.21.15.175:0/3617948042 learned_addr learned my addr 172.21.15.175:0/3617948042 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:13.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa94d000640 1 --2- 172.21.15.175:0/3617948042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9480cbe60 0x7fa94814a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:13.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa947400640 1 --2- 172.21.15.175:0/3617948042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9480b4630 0x7fa948156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:13.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa947e00640 1 -- 172.21.15.175:0/3617948042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9480cbe60 msgr2=0x7fa94814a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:13.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa947e00640 1 --2- 172.21.15.175:0/3617948042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9480cbe60 0x7fa94814a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa947e00640 1 -- 172.21.15.175:0/3617948042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9480b4630 msgr2=0x7fa948156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:13.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa947e00640 1 --2- 172.21.15.175:0/3617948042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9480b4630 0x7fa948156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa947e00640 1 -- 172.21.15.175:0/3617948042 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa948157150 con 0x7fa94806d310 2024-04-25T09:14:13.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa947400640 1 --2- 172.21.15.175:0/3617948042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9480b4630 0x7fa948156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:13.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa947e00640 1 --2- 172.21.15.175:0/3617948042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa94806d310 0x7fa9481581f0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fa9380ae040 tx=0x7fa938019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:13.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa93fe00640 1 -- 172.21.15.175:0/3617948042 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9380b0040 con 0x7fa94806d310 2024-04-25T09:14:13.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa93fe00640 1 -- 172.21.15.175:0/3617948042 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9380b9070 con 0x7fa94806d310 2024-04-25T09:14:13.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa93fe00640 1 -- 172.21.15.175:0/3617948042 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9380b46a0 con 0x7fa94806d310 2024-04-25T09:14:13.726 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa94f000640 1 -- 172.21.15.175:0/3617948042 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa948157430 con 0x7fa94806d310 2024-04-25T09:14:13.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.736+0000 7fa94f000640 1 -- 172.21.15.175:0/3617948042 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9481579f0 con 0x7fa94806d310 2024-04-25T09:14:13.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.740+0000 7fa94f000640 1 -- 172.21.15.175:0/3617948042 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa948075160 con 0x7fa94806d310 2024-04-25T09:14:13.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.740+0000 7fa93fe00640 1 -- 172.21.15.175:0/3617948042 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa9380b4840 con 0x7fa94806d310 2024-04-25T09:14:13.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.740+0000 7fa93fe00640 1 --2- 172.21.15.175:0/3617948042 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa928066f90 0x7fa928069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:13.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.740+0000 7fa93fe00640 1 -- 172.21.15.175:0/3617948042 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa93811ed40 con 0x7fa94806d310 2024-04-25T09:14:13.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.740+0000 7fa947400640 1 --2- 172.21.15.175:0/3617948042 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa928066f90 0x7fa928069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:13.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.740+0000 7fa947400640 1 --2- 172.21.15.175:0/3617948042 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa928066f90 0x7fa928069450 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa948155e60 tx=0x7fa934008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:13.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.744+0000 7fa93fe00640 1 -- 172.21.15.175:0/3617948042 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa938016110 con 0x7fa94806d310 2024-04-25T09:14:13.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.912+0000 7fa94f000640 1 -- 172.21.15.175:0/3617948042 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa9480b3a90 con 0x7fa94806d310 2024-04-25T09:14:13.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.912+0000 7fa93fe00640 1 -- 172.21.15.175:0/3617948042 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v113) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa9380efcb0 con 0x7fa94806d310 2024-04-25T09:14:13.900 INFO:teuthology.orchestra.run.smithi175.stderr:listed 0 entries 2024-04-25T09:14:13.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.916+0000 7fa94f000640 1 -- 172.21.15.175:0/3617948042 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa928066f90 msgr2=0x7fa928069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:13.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.916+0000 7fa94f000640 1 --2- 172.21.15.175:0/3617948042 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa928066f90 0x7fa928069450 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa948155e60 tx=0x7fa934008040 comp rx=0 tx=0).stop 2024-04-25T09:14:13.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.916+0000 7fa94f000640 1 -- 172.21.15.175:0/3617948042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa94806d310 msgr2=0x7fa9481581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:13.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.916+0000 7fa94f000640 1 --2- 172.21.15.175:0/3617948042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa94806d310 0x7fa9481581f0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fa9380ae040 tx=0x7fa938019000 comp rx=0 tx=0).stop 2024-04-25T09:14:13.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.916+0000 7fa94f000640 1 -- 172.21.15.175:0/3617948042 shutdown_connections 2024-04-25T09:14:13.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.916+0000 7fa94f000640 1 --2- 172.21.15.175:0/3617948042 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa928066f90 0x7fa928069450 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.916+0000 7fa94f000640 1 --2- 172.21.15.175:0/3617948042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9480cbe60 0x7fa94814a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.916+0000 7fa94f000640 1 --2- 172.21.15.175:0/3617948042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa9480b4630 0x7fa948156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.916+0000 7fa94f000640 1 --2- 172.21.15.175:0/3617948042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa94806d310 0x7fa9481581f0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:13.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.916+0000 7fa94f000640 1 -- 172.21.15.175:0/3617948042 >> 172.21.15.175:0/3617948042 conn(0x7fa94806ac50 msgr2=0x7fa9480af2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:13.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.916+0000 7fa94f000640 1 -- 172.21.15.175:0/3617948042 shutdown_connections 2024-04-25T09:14:13.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:13.916+0000 7fa94f000640 1 -- 172.21.15.175:0/3617948042 wait complete. 2024-04-25T09:14:13.921 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:14:13.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:13.921 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:13.983 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:14:13.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:13.983 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:14:13.999 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:14:13.999 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-04-25T09:14:14.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.196+0000 7fdc65c00640 1 Processor -- start 2024-04-25T09:14:14.182 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.196+0000 7fdc65c00640 1 -- start start 2024-04-25T09:14:14.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.196+0000 7fdc65c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdc6015af20 0x7fdc600b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.196+0000 7fdc65c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc600b4630 0x7fdc6015c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.196+0000 7fdc65c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6006db60 con 0x7fdc600cbe60 2024-04-25T09:14:14.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.196+0000 7fdc65c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6006de40 con 0x7fdc6015af20 2024-04-25T09:14:14.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.196+0000 7fdc65c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6006e120 con 0x7fdc600b4630 2024-04-25T09:14:14.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.196+0000 7fdc5f400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc600b4630 0x7fdc6015c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.196+0000 7fdc56000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdc6015af20 0x7fdc600b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.196+0000 7fdc5f400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc600b4630 0x7fdc6015c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:35950/0 (socket says 172.21.15.175:35950) 2024-04-25T09:14:14.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.196+0000 7fdc5f400640 1 -- 172.21.15.175:0/3725187299 learned_addr learned my addr 172.21.15.175:0/3725187299 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:14.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.196+0000 7fdc5f400640 1 -- 172.21.15.175:0/3725187299 >> v2:172.21.15.177:3300/0 conn(0x7fdc6015af20 msgr2=0x7fdc600b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:14.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.196+0000 7fdc5f400640 1 --2- 172.21.15.175:0/3725187299 >> v2:172.21.15.177:3300/0 conn(0x7fdc6015af20 0x7fdc600b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.196+0000 7fdc5f400640 1 -- 172.21.15.175:0/3725187299 >> v1:172.21.15.177:6789/0 conn(0x7fdc600cbe60 legacy=0x7fdc6006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:14.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.196+0000 7fdc5f400640 1 -- 172.21.15.175:0/3725187299 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6015c2f0 con 0x7fdc600b4630 2024-04-25T09:14:14.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.196+0000 7fdc56000640 1 --2- 172.21.15.175:0/3725187299 >> v2:172.21.15.177:3300/0 conn(0x7fdc6015af20 0x7fdc600b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:14.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.200+0000 7fdc5f400640 1 --2- 172.21.15.175:0/3725187299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc600b4630 0x7fdc6015c810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009e50 tx=0x7fdc5801ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=159453f6a3d7c08a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:14.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.200+0000 7fdc5e000640 1 -- 172.21.15.175:0/3725187299 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc580a5700 con 0x7fdc600b4630 2024-04-25T09:14:14.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.200+0000 7fdc5e000640 1 -- 172.21.15.175:0/3725187299 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc580a58a0 con 0x7fdc600b4630 2024-04-25T09:14:14.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.200+0000 7fdc5e000640 1 -- 172.21.15.175:0/3725187299 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc580a5c70 con 0x7fdc600b4630 2024-04-25T09:14:14.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.200+0000 7fdc65c00640 1 -- 172.21.15.175:0/3725187299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc600b4630 msgr2=0x7fdc6015c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:14.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.200+0000 7fdc65c00640 1 --2- 172.21.15.175:0/3725187299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc600b4630 0x7fdc6015c810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009e50 tx=0x7fdc5801ca30 comp rx=0 tx=0).stop 2024-04-25T09:14:14.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.200+0000 7fdc65c00640 1 -- 172.21.15.175:0/3725187299 shutdown_connections 2024-04-25T09:14:14.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.200+0000 7fdc65c00640 1 --2- 172.21.15.175:0/3725187299 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc600b4630 0x7fdc6015c810 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.200+0000 7fdc65c00640 1 --2- 172.21.15.175:0/3725187299 >> v2:172.21.15.177:3300/0 conn(0x7fdc6015af20 0x7fdc600b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.200+0000 7fdc65c00640 1 -- 172.21.15.175:0/3725187299 >> 172.21.15.175:0/3725187299 conn(0x7fdc6006ac50 msgr2=0x7fdc6006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:14.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.200+0000 7fdc65c00640 1 -- 172.21.15.175:0/3725187299 shutdown_connections 2024-04-25T09:14:14.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.200+0000 7fdc65c00640 1 -- 172.21.15.175:0/3725187299 wait complete. 2024-04-25T09:14:14.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc65c00640 1 Processor -- start 2024-04-25T09:14:14.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc65c00640 1 -- start start 2024-04-25T09:14:14.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc65c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc600b4630 0x7fdc60148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc65c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc600cbe60 0x7fdc6014a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc65c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc6015af20 0x7fdc60146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc65c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6015d970 con 0x7fdc600b4630 2024-04-25T09:14:14.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc65c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6015d7f0 con 0x7fdc600cbe60 2024-04-25T09:14:14.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc65c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6015daf0 con 0x7fdc6015af20 2024-04-25T09:14:14.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc5ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc600b4630 0x7fdc60148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc5ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc600b4630 0x7fdc60148210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45030/0 (socket says 172.21.15.175:45030) 2024-04-25T09:14:14.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc56000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc600cbe60 0x7fdc6014a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc5ea00640 1 -- 172.21.15.175:0/4216929355 learned_addr learned my addr 172.21.15.175:0/4216929355 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:14.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc5f400640 1 --2- 172.21.15.175:0/4216929355 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc6015af20 0x7fdc60146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc5ea00640 1 -- 172.21.15.175:0/4216929355 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc6015af20 msgr2=0x7fdc60146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:14.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc5ea00640 1 --2- 172.21.15.175:0/4216929355 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc6015af20 0x7fdc60146560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc5ea00640 1 -- 172.21.15.175:0/4216929355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc600cbe60 msgr2=0x7fdc6014a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:14.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc5ea00640 1 --2- 172.21.15.175:0/4216929355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc600cbe60 0x7fdc6014a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc5ea00640 1 -- 172.21.15.175:0/4216929355 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc601488a0 con 0x7fdc600b4630 2024-04-25T09:14:14.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc5ea00640 1 --2- 172.21.15.175:0/4216929355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc600b4630 0x7fdc60148210 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000c370 tx=0x7fdc5000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:14.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc57400640 1 -- 172.21.15.175:0/4216929355 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc500052d0 con 0x7fdc600b4630 2024-04-25T09:14:14.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc57400640 1 -- 172.21.15.175:0/4216929355 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc50005470 con 0x7fdc600b4630 2024-04-25T09:14:14.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc57400640 1 -- 172.21.15.175:0/4216929355 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50007260 con 0x7fdc600b4630 2024-04-25T09:14:14.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc65c00640 1 -- 172.21.15.175:0/4216929355 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc60148b80 con 0x7fdc600b4630 2024-04-25T09:14:14.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.204+0000 7fdc65c00640 1 -- 172.21.15.175:0/4216929355 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc601539f0 con 0x7fdc600b4630 2024-04-25T09:14:14.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.208+0000 7fdc57400640 1 -- 172.21.15.175:0/4216929355 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdc50007400 con 0x7fdc600b4630 2024-04-25T09:14:14.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.208+0000 7fdc57400640 1 --2- 172.21.15.175:0/4216929355 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdc3c066f60 0x7fdc3c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.208+0000 7fdc57400640 1 -- 172.21.15.175:0/4216929355 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc500844b0 con 0x7fdc600b4630 2024-04-25T09:14:14.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.208+0000 7fdc56000640 1 --2- 172.21.15.175:0/4216929355 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdc3c066f60 0x7fdc3c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.208+0000 7fdc69126000 1 Processor -- start 2024-04-25T09:14:14.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.208+0000 7fdc69126000 1 -- start start 2024-04-25T09:14:14.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.208+0000 7fdc56000640 1 --2- 172.21.15.175:0/4216929355 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdc3c066f60 0x7fdc3c069420 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009580 tx=0x7fdc48009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:14.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.208+0000 7fdc69126000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 0x55ee43414210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.208+0000 7fdc69126000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee43414750 0x55ee433c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.208+0000 7fdc69126000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee433ca4b0 0x55ee433ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.208+0000 7fdc69126000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee43212ff0 con 0x55ee43413e30 2024-04-25T09:14:14.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.208+0000 7fdc69126000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4319b150 con 0x55ee43414750 2024-04-25T09:14:14.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.208+0000 7fdc69126000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee4320f090 con 0x55ee433ca4b0 2024-04-25T09:14:14.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.208+0000 7fdc5ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 0x55ee43414210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.208+0000 7fdc5ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 0x55ee43414210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45034/0 (socket says 172.21.15.175:45034) 2024-04-25T09:14:14.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.208+0000 7fdc5ea00640 1 -- 172.21.15.175:0/2953720755 learned_addr learned my addr 172.21.15.175:0/2953720755 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:14.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.208+0000 7fdc5f400640 1 --2- 172.21.15.175:0/2953720755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee433ca4b0 0x55ee433ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.208+0000 7fdc56000640 1 --2- 172.21.15.175:0/2953720755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee43414750 0x55ee433c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc5ea00640 1 -- 172.21.15.175:0/2953720755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee433ca4b0 msgr2=0x55ee433ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:14.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc5ea00640 1 --2- 172.21.15.175:0/2953720755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee433ca4b0 0x55ee433ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc5ea00640 1 -- 172.21.15.175:0/2953720755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee43414750 msgr2=0x55ee433c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:14.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc5ea00640 1 --2- 172.21.15.175:0/2953720755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee43414750 0x55ee433c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc5ea00640 1 -- 172.21.15.175:0/2953720755 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee433a90d0 con 0x55ee43413e30 2024-04-25T09:14:14.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc5ea00640 1 --2- 172.21.15.175:0/2953720755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 0x55ee43414210 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000a040 tx=0x7fdc50000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd04a6c5a4b2a860 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:14.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc4f400640 1 -- 172.21.15.175:0/2953720755 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5005d430 con 0x55ee43413e30 2024-04-25T09:14:14.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc4f400640 1 -- 172.21.15.175:0/2953720755 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc500530d0 con 0x55ee43413e30 2024-04-25T09:14:14.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc4f400640 1 -- 172.21.15.175:0/2953720755 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50051440 con 0x55ee43413e30 2024-04-25T09:14:14.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc69126000 1 -- 172.21.15.175:0/2953720755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 msgr2=0x55ee43414210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:14.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc69126000 1 --2- 172.21.15.175:0/2953720755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 0x55ee43414210 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000a040 tx=0x7fdc50000bd0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc69126000 1 -- 172.21.15.175:0/2953720755 shutdown_connections 2024-04-25T09:14:14.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc69126000 1 --2- 172.21.15.175:0/2953720755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee433ca4b0 0x55ee433ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc69126000 1 --2- 172.21.15.175:0/2953720755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee43414750 0x55ee433c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc69126000 1 --2- 172.21.15.175:0/2953720755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 0x55ee43414210 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc69126000 1 -- 172.21.15.175:0/2953720755 >> 172.21.15.175:0/2953720755 conn(0x55ee433c2020 msgr2=0x55ee433c4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:14.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc69126000 1 -- 172.21.15.175:0/2953720755 shutdown_connections 2024-04-25T09:14:14.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc69126000 1 -- 172.21.15.175:0/2953720755 wait complete. 2024-04-25T09:14:14.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc69126000 1 -- start start 2024-04-25T09:14:14.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc69126000 1 Processor -- start 2024-04-25T09:14:14.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc69126000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee433ca4b0 0x55ee434137e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc69126000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 0x55ee433d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc69126000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee43414750 0x55ee433d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc69126000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee43217620 con 0x55ee43413e30 2024-04-25T09:14:14.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc69126000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee431cd690 con 0x55ee43414750 2024-04-25T09:14:14.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc69126000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee4319ba40 con 0x55ee433ca4b0 2024-04-25T09:14:14.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc69126000 10 client.0 _ll_register_callbacks cb 0x55ee433b0e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:14:14.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc56000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 0x55ee433d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc56000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 0x55ee433d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45044/0 (socket says 172.21.15.175:45044) 2024-04-25T09:14:14.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc56000640 1 -- 172.21.15.175:0/3053403857 learned_addr learned my addr 172.21.15.175:0/3053403857 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:14.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc5f400640 1 --2- 172.21.15.175:0/3053403857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee43414750 0x55ee433d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc5ea00640 1 --2- 172.21.15.175:0/3053403857 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee433ca4b0 0x55ee434137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc56000640 1 -- 172.21.15.175:0/3053403857 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee433ca4b0 msgr2=0x55ee434137e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:14.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc56000640 1 --2- 172.21.15.175:0/3053403857 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee433ca4b0 0x55ee434137e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.212+0000 7fdc56000640 1 -- 172.21.15.175:0/3053403857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee43414750 msgr2=0x55ee433d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:14.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc56000640 1 --2- 172.21.15.175:0/3053403857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee43414750 0x55ee433d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc56000640 1 -- 172.21.15.175:0/3053403857 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee432c01c0 con 0x55ee43413e30 2024-04-25T09:14:14.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc56000640 1 --2- 172.21.15.175:0/3053403857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 0x55ee433d0360 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fdc480149f0 tx=0x7fdc480046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edda52fb79967550 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:14.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc43e00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:14:14.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc43e00640 1 -- 172.21.15.175:0/3053403857 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc48027070 con 0x55ee43413e30 2024-04-25T09:14:14.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc43e00640 1 -- 172.21.15.175:0/3053403857 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc48004020 con 0x55ee43413e30 2024-04-25T09:14:14.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 1 -- 172.21.15.175:0/3053403857 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc500530d0 con 0x55ee43413e30 2024-04-25T09:14:14.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc43e00640 1 -- 172.21.15.175:0/3053403857 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc48004220 con 0x55ee43413e30 2024-04-25T09:14:14.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 10 client.8901 fetch_fsmap learned FSMap version 93 2024-04-25T09:14:14.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 1 -- 172.21.15.175:0/3053403857 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x55ee432bc170 con 0x55ee43413e30 2024-04-25T09:14:14.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc43e00640 1 -- 172.21.15.175:0/3053403857 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc500530d0 con 0x55ee43413e30 2024-04-25T09:14:14.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc43e00640 1 -- 172.21.15.175:0/3053403857 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 93) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdc48020050 con 0x55ee43413e30 2024-04-25T09:14:14.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 10 client.8901 fetch_fsmap finished waiting for FSMap version 93 2024-04-25T09:14:14.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 10 client.8901 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:14:14.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 20 client.8901 populate_metadata read hostname 'smithi175' 2024-04-25T09:14:14.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 1 --2- 172.21.15.175:0/3053403857 >> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] conn(0x55ee433d1640 0x55ee434260f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 4 client.8901 mds_command: new command op to 8712 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:14:14.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 1 -- 172.21.15.175:0/3053403857 --> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee431aec60 con 0x55ee433d1640 2024-04-25T09:14:14.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc5ea00640 1 --2- 172.21.15.175:0/3053403857 >> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] conn(0x55ee433d1640 0x55ee434260f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc5ea00640 1 --2- 172.21.15.175:0/3053403857 >> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] conn(0x55ee433d1640 0x55ee434260f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99cd15cae77196fc server_cookie=990ea3e6bc1fd08 in_seq=0 out_seq=0 2024-04-25T09:14:14.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc43e00640 10 client.8901 ms_handle_connect on v2:172.21.15.175:6834/4128642659 2024-04-25T09:14:14.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc43e00640 1 -- 172.21.15.175:0/3053403857 <== mds.0 v2:172.21.15.175:6834/4128642659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ee431aec60 con 0x55ee433d1640 2024-04-25T09:14:14.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc43e00640 10 client.8901 handle_command_reply: tid=0 2024-04-25T09:14:14.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 1 client.8901 shutdown 2024-04-25T09:14:14.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 1 -- 172.21.15.175:0/3053403857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 msgr2=0x55ee433d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:14.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 1 --2- 172.21.15.175:0/3053403857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 0x55ee433d0360 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fdc480149f0 tx=0x7fdc480046d0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 1 -- 172.21.15.175:0/3053403857 shutdown_connections 2024-04-25T09:14:14.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 1 --2- 172.21.15.175:0/3053403857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee43414750 0x55ee433d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 1 --2- 172.21.15.175:0/3053403857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 0x55ee433d0360 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 1 --2- 172.21.15.175:0/3053403857 >> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] conn(0x55ee433d1640 0x55ee434260f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 1 --2- 172.21.15.175:0/3053403857 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee433ca4b0 0x55ee434137e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 1 -- 172.21.15.175:0/3053403857 >> 172.21.15.175:0/3053403857 conn(0x55ee433c2020 msgr2=0x55ee433cb120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:14.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc43e00640 0 client.8901 ms_handle_reset on v2:172.21.15.175:6834/4128642659 2024-04-25T09:14:14.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 1 -- 172.21.15.175:0/3053403857 shutdown_connections 2024-04-25T09:14:14.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 1 -- 172.21.15.175:0/3053403857 wait complete. 2024-04-25T09:14:14.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.216+0000 7fdc69126000 20 client.8901 trim_cache size 0 max 16384 2024-04-25T09:14:14.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.228+0000 7fdc69126000 1 Processor -- start 2024-04-25T09:14:14.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc69126000 1 -- start start 2024-04-25T09:14:14.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc69126000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee433ca4b0 0x55ee43428110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc69126000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee43413e30 0x55ee43428650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc69126000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43414750 0x55ee434212a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc69126000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc600b3fc0 con 0x55ee43414750 2024-04-25T09:14:14.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc69126000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc600b31e0 con 0x55ee433ca4b0 2024-04-25T09:14:14.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc69126000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc600b25e0 con 0x55ee43413e30 2024-04-25T09:14:14.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc5f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43414750 0x55ee434212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc5f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43414750 0x55ee434212a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45056/0 (socket says 172.21.15.175:45056) 2024-04-25T09:14:14.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc5f400640 1 -- 172.21.15.175:0/1870039312 learned_addr learned my addr 172.21.15.175:0/1870039312 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:14.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc5ea00640 1 --2- 172.21.15.175:0/1870039312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee433ca4b0 0x55ee43428110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc56000640 1 --2- 172.21.15.175:0/1870039312 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee43413e30 0x55ee43428650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc5f400640 1 -- 172.21.15.175:0/1870039312 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee43413e30 msgr2=0x55ee43428650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:14.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc5f400640 1 --2- 172.21.15.175:0/1870039312 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee43413e30 0x55ee43428650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc5f400640 1 -- 172.21.15.175:0/1870039312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee433ca4b0 msgr2=0x55ee43428110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:14.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc5f400640 1 --2- 172.21.15.175:0/1870039312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee433ca4b0 0x55ee43428110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc5f400640 1 -- 172.21.15.175:0/1870039312 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee43259de0 con 0x55ee43414750 2024-04-25T09:14:14.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc56000640 1 --2- 172.21.15.175:0/1870039312 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee43413e30 0x55ee43428650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:14.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc5f400640 1 --2- 172.21.15.175:0/1870039312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43414750 0x55ee434212a0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009e50 tx=0x7fdc58004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56420a9cbab8875 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:14.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc4ea00640 1 -- 172.21.15.175:0/1870039312 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc580091d0 con 0x55ee43414750 2024-04-25T09:14:14.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc4ea00640 1 -- 172.21.15.175:0/1870039312 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc580a5700 con 0x55ee43414750 2024-04-25T09:14:14.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc4ea00640 1 -- 172.21.15.175:0/1870039312 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc580a5af0 con 0x55ee43414750 2024-04-25T09:14:14.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc69126000 1 -- 172.21.15.175:0/1870039312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43414750 msgr2=0x55ee434212a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:14.224 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc69126000 1 --2- 172.21.15.175:0/1870039312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43414750 0x55ee434212a0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009e50 tx=0x7fdc58004ac0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc69126000 1 -- 172.21.15.175:0/1870039312 shutdown_connections 2024-04-25T09:14:14.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc69126000 1 --2- 172.21.15.175:0/1870039312 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43414750 0x55ee434212a0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc69126000 1 --2- 172.21.15.175:0/1870039312 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee43413e30 0x55ee43428650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc69126000 1 --2- 172.21.15.175:0/1870039312 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee433ca4b0 0x55ee43428110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc69126000 1 -- 172.21.15.175:0/1870039312 >> 172.21.15.175:0/1870039312 conn(0x55ee433c2020 msgr2=0x55ee43420b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:14.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc69126000 1 -- 172.21.15.175:0/1870039312 shutdown_connections 2024-04-25T09:14:14.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc69126000 1 -- 172.21.15.175:0/1870039312 wait complete. 2024-04-25T09:14:14.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc69126000 1 -- start start 2024-04-25T09:14:14.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.232+0000 7fdc69126000 1 Processor -- start 2024-04-25T09:14:14.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc69126000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee433ca4b0 0x55ee434260f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc69126000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 0x55ee43426630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc69126000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee43414750 0x55ee43426b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc69126000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee431ade00 con 0x55ee43413e30 2024-04-25T09:14:14.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc69126000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc600b2be0 con 0x55ee433ca4b0 2024-04-25T09:14:14.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc69126000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee43212300 con 0x55ee43414750 2024-04-25T09:14:14.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc69126000 10 client.0 _ll_register_callbacks cb 0x55ee43391040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:14:14.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc56000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 0x55ee43426630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc56000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 0x55ee43426630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45072/0 (socket says 172.21.15.175:45072) 2024-04-25T09:14:14.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc56000640 1 -- 172.21.15.175:0/1131849372 learned_addr learned my addr 172.21.15.175:0/1131849372 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:14.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc5ea00640 1 --2- 172.21.15.175:0/1131849372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee433ca4b0 0x55ee434260f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc5f400640 1 --2- 172.21.15.175:0/1131849372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee43414750 0x55ee43426b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc5ea00640 1 -- 172.21.15.175:0/1131849372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee43414750 msgr2=0x55ee43426b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:14.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc5ea00640 1 --2- 172.21.15.175:0/1131849372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee43414750 0x55ee43426b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc5ea00640 1 -- 172.21.15.175:0/1131849372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 msgr2=0x55ee43426630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:14.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc5ea00640 1 --2- 172.21.15.175:0/1131849372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 0x55ee43426630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc5ea00640 1 -- 172.21.15.175:0/1131849372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee431b48e0 con 0x55ee433ca4b0 2024-04-25T09:14:14.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc5f400640 1 --2- 172.21.15.175:0/1131849372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee43414750 0x55ee43426b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc56000640 1 --2- 172.21.15.175:0/1131849372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 0x55ee43426630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc5ea00640 1 --2- 172.21.15.175:0/1131849372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee433ca4b0 0x55ee434260f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdc50054d60 tx=0x7fdc50000f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d01bb46fd55ade55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc43e00640 10 client.0 ms_handle_connect on v2:172.21.15.177:3300/0 2024-04-25T09:14:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc43e00640 1 -- 172.21.15.175:0/1131849372 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50051070 con 0x55ee433ca4b0 2024-04-25T09:14:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc43e00640 1 -- 172.21.15.175:0/1131849372 <== mon.1 v2:172.21.15.177:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc50082960 con 0x55ee433ca4b0 2024-04-25T09:14:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc69126000 1 -- 172.21.15.175:0/1131849372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc580a5700 con 0x55ee433ca4b0 2024-04-25T09:14:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc43e00640 1 -- 172.21.15.175:0/1131849372 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc5005b140 con 0x55ee433ca4b0 2024-04-25T09:14:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc69126000 10 client.8380 fetch_fsmap learned FSMap version 93 2024-04-25T09:14:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc69126000 1 -- 172.21.15.175:0/1131849372 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x55ee4326c8f0 con 0x55ee433ca4b0 2024-04-25T09:14:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc43e00640 1 -- 172.21.15.175:0/1131849372 <== mon.1 v2:172.21.15.177:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc580a5700 con 0x55ee433ca4b0 2024-04-25T09:14:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc43e00640 1 -- 172.21.15.175:0/1131849372 <== mon.1 v2:172.21.15.177:3300/0 5 ==== fsmap(e 93) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fdc50068ce0 con 0x55ee433ca4b0 2024-04-25T09:14:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc69126000 10 client.8380 fetch_fsmap finished waiting for FSMap version 93 2024-04-25T09:14:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc69126000 10 client.8380 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:14:14.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc69126000 20 client.8380 populate_metadata read hostname 'smithi175' 2024-04-25T09:14:14.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc69126000 1 --2- 172.21.15.175:0/1131849372 >> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] conn(0x55ee43427530 0x55ee4347bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc69126000 4 client.8380 mds_command: new command op to 8712 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T09:14:14.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc69126000 1 -- 172.21.15.175:0/1131849372 --> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ee43220530 con 0x55ee43427530 2024-04-25T09:14:14.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc56000640 1 --2- 172.21.15.175:0/1131849372 >> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] conn(0x55ee43427530 0x55ee4347bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc56000640 1 --2- 172.21.15.175:0/1131849372 >> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] conn(0x55ee43427530 0x55ee4347bfe0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75ecbc2e3abbf226 server_cookie=537c4d2d3d6df3e3 in_seq=0 out_seq=0 2024-04-25T09:14:14.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.236+0000 7fdc43e00640 10 client.8380 ms_handle_connect on v2:172.21.15.175:6834/4128642659 2024-04-25T09:14:14.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc43e00640 1 -- 172.21.15.175:0/1131849372 <== mds.0 v2:172.21.15.175:6834/4128642659 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ee43220530 con 0x55ee43427530 2024-04-25T09:14:14.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc43e00640 10 client.8380 handle_command_reply: tid=0 2024-04-25T09:14:14.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc69126000 1 client.8380 shutdown 2024-04-25T09:14:14.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc69126000 1 -- 172.21.15.175:0/1131849372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee433ca4b0 msgr2=0x55ee434260f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:14.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc69126000 1 --2- 172.21.15.175:0/1131849372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee433ca4b0 0x55ee434260f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdc50054d60 tx=0x7fdc50000f80 comp rx=0 tx=0).stop 2024-04-25T09:14:14.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc69126000 1 -- 172.21.15.175:0/1131849372 shutdown_connections 2024-04-25T09:14:14.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc69126000 1 --2- 172.21.15.175:0/1131849372 >> [v2:172.21.15.175:6834/4128642659,v1:172.21.15.175:6836/4128642659] conn(0x55ee43427530 0x55ee4347bfe0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc69126000 1 --2- 172.21.15.175:0/1131849372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ee43414750 0x55ee43426b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc69126000 1 --2- 172.21.15.175:0/1131849372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ee43413e30 0x55ee43426630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc69126000 1 --2- 172.21.15.175:0/1131849372 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ee433ca4b0 0x55ee434260f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc43e00640 0 client.8380 ms_handle_reset on v2:172.21.15.175:6834/4128642659 2024-04-25T09:14:14.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc69126000 1 -- 172.21.15.175:0/1131849372 >> 172.21.15.175:0/1131849372 conn(0x55ee433c2020 msgr2=0x55ee43421420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:14.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc69126000 1 -- 172.21.15.175:0/1131849372 shutdown_connections 2024-04-25T09:14:14.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc69126000 1 -- 172.21.15.175:0/1131849372 wait complete. 2024-04-25T09:14:14.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc69126000 20 client.8380 trim_cache size 0 max 16384 2024-04-25T09:14:14.241 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:14:14.242 INFO:teuthology.orchestra.run.smithi175.stdout: "message": "", 2024-04-25T09:14:14.242 INFO:teuthology.orchestra.run.smithi175.stdout: "return_code": 0 2024-04-25T09:14:14.242 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:14:14.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc65c00640 1 -- 172.21.15.175:0/4216929355 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdc3c066f60 msgr2=0x7fdc3c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:14.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc65c00640 1 --2- 172.21.15.175:0/4216929355 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdc3c066f60 0x7fdc3c069420 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdc48009580 tx=0x7fdc48009190 comp rx=0 tx=0).stop 2024-04-25T09:14:14.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc65c00640 1 -- 172.21.15.175:0/4216929355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc600b4630 msgr2=0x7fdc60148210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:14.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc65c00640 1 --2- 172.21.15.175:0/4216929355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc600b4630 0x7fdc60148210 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000c370 tx=0x7fdc5000c830 comp rx=0 tx=0).stop 2024-04-25T09:14:14.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc65c00640 1 -- 172.21.15.175:0/4216929355 shutdown_connections 2024-04-25T09:14:14.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc65c00640 1 --2- 172.21.15.175:0/4216929355 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdc3c066f60 0x7fdc3c069420 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc65c00640 1 --2- 172.21.15.175:0/4216929355 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdc6015af20 0x7fdc60146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc65c00640 1 --2- 172.21.15.175:0/4216929355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdc600cbe60 0x7fdc6014a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc65c00640 1 --2- 172.21.15.175:0/4216929355 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdc600b4630 0x7fdc60148210 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.252+0000 7fdc65c00640 1 -- 172.21.15.175:0/4216929355 >> 172.21.15.175:0/4216929355 conn(0x7fdc6006ac50 msgr2=0x7fdc6015a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:14.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.256+0000 7fdc65c00640 1 -- 172.21.15.175:0/4216929355 shutdown_connections 2024-04-25T09:14:14.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.256+0000 7fdc65c00640 1 -- 172.21.15.175:0/4216929355 wait complete. 2024-04-25T09:14:14.259 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:14:14.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.408+0000 7f7c56000640 1 Processor -- start 2024-04-25T09:14:14.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.408+0000 7f7c56000640 1 -- start start 2024-04-25T09:14:14.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.412+0000 7f7c56000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7c50144fc0 0x7f7c500cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.412+0000 7f7c56000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7c5015c5e0 0x7f7c500cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.412+0000 7f7c56000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5015cd00 con 0x7f7c501453a0 2024-04-25T09:14:14.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.412+0000 7f7c56000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c500ce660 con 0x7f7c5015c5e0 2024-04-25T09:14:14.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.412+0000 7f7c56000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c500cc930 con 0x7f7c50144fc0 2024-04-25T09:14:14.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.412+0000 7f7c4fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7c5015c5e0 0x7f7c500cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.412+0000 7f7c4fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7c5015c5e0 0x7f7c500cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45078/0 (socket says 172.21.15.175:45078) 2024-04-25T09:14:14.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.412+0000 7f7c4fe00640 1 -- 172.21.15.175:0/3232272515 learned_addr learned my addr 172.21.15.175:0/3232272515 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:14.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.412+0000 7f7c4f400640 1 --2- 172.21.15.175:0/3232272515 >> v2:172.21.15.177:3300/0 conn(0x7f7c50144fc0 0x7f7c500cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.412+0000 7f7c4fe00640 1 -- 172.21.15.175:0/3232272515 >> v2:172.21.15.177:3300/0 conn(0x7f7c50144fc0 msgr2=0x7f7c500cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:14.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.412+0000 7f7c4fe00640 1 --2- 172.21.15.175:0/3232272515 >> v2:172.21.15.177:3300/0 conn(0x7f7c50144fc0 0x7f7c500cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.412+0000 7f7c4fe00640 1 -- 172.21.15.175:0/3232272515 >> v1:172.21.15.177:6789/0 conn(0x7f7c501453a0 legacy=0x7f7c5015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:14.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.412+0000 7f7c4e000640 1 -- 172.21.15.175:0/3232272515 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272017480 0 0) 0x7f7c5015cd00 con 0x7f7c501453a0 2024-04-25T09:14:14.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.412+0000 7f7c4fe00640 1 -- 172.21.15.175:0/3232272515 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c500ccc10 con 0x7f7c5015c5e0 2024-04-25T09:14:14.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c4fe00640 1 --2- 172.21.15.175:0/3232272515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c5015c5e0 0x7f7c500cee20 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009e50 tx=0x7f7c4801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86fd6b78b3421057 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:14.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c4e000640 1 -- 172.21.15.175:0/3232272515 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c480a57a0 con 0x7f7c5015c5e0 2024-04-25T09:14:14.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c4e000640 1 -- 172.21.15.175:0/3232272515 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c480a5940 con 0x7f7c5015c5e0 2024-04-25T09:14:14.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c4e000640 1 -- 172.21.15.175:0/3232272515 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c480a5d10 con 0x7f7c5015c5e0 2024-04-25T09:14:14.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c56000640 1 -- 172.21.15.175:0/3232272515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c5015c5e0 msgr2=0x7f7c500cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:14.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c56000640 1 --2- 172.21.15.175:0/3232272515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c5015c5e0 0x7f7c500cee20 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009e50 tx=0x7f7c4801c9f0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c56000640 1 -- 172.21.15.175:0/3232272515 shutdown_connections 2024-04-25T09:14:14.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c56000640 1 --2- 172.21.15.175:0/3232272515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c5015c5e0 0x7f7c500cee20 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c56000640 1 --2- 172.21.15.175:0/3232272515 >> v2:172.21.15.177:3300/0 conn(0x7f7c50144fc0 0x7f7c500cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c56000640 1 -- 172.21.15.175:0/3232272515 >> 172.21.15.175:0/3232272515 conn(0x7f7c50067150 msgr2=0x7f7c5006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:14.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c56000640 1 -- 172.21.15.175:0/3232272515 shutdown_connections 2024-04-25T09:14:14.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c56000640 1 -- 172.21.15.175:0/3232272515 wait complete. 2024-04-25T09:14:14.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c56000640 1 Processor -- start 2024-04-25T09:14:14.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c56000640 1 -- start start 2024-04-25T09:14:14.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c56000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c501453a0 0x7f7c50134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c56000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c5015c5e0 0x7f7c5014d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c56000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c501387b0 0x7f7c50143c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c56000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c500cff40 con 0x7f7c501387b0 2024-04-25T09:14:14.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c56000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c500cfdc0 con 0x7f7c5015c5e0 2024-04-25T09:14:14.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.416+0000 7f7c56000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c501685f0 con 0x7f7c501453a0 2024-04-25T09:14:14.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c4fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c501387b0 0x7f7c50143c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c4fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c501387b0 0x7f7c50143c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45084/0 (socket says 172.21.15.175:45084) 2024-04-25T09:14:14.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c4fe00640 1 -- 172.21.15.175:0/1304627947 learned_addr learned my addr 172.21.15.175:0/1304627947 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:14.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c4f400640 1 --2- 172.21.15.175:0/1304627947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c501453a0 0x7f7c50134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c4ea00640 1 --2- 172.21.15.175:0/1304627947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c5015c5e0 0x7f7c5014d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c4fe00640 1 -- 172.21.15.175:0/1304627947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c501453a0 msgr2=0x7f7c50134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:14.407 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c4fe00640 1 --2- 172.21.15.175:0/1304627947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c501453a0 0x7f7c50134ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c4fe00640 1 -- 172.21.15.175:0/1304627947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c5015c5e0 msgr2=0x7f7c5014d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:14.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c4fe00640 1 --2- 172.21.15.175:0/1304627947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c5015c5e0 0x7f7c5014d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c4fe00640 1 -- 172.21.15.175:0/1304627947 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c50138c30 con 0x7f7c501387b0 2024-04-25T09:14:14.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c4fe00640 1 --2- 172.21.15.175:0/1304627947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c501387b0 0x7f7c50143c00 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f7c480af040 tx=0x7f7c48019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:14.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c47400640 1 -- 172.21.15.175:0/1304627947 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c48009510 con 0x7f7c501387b0 2024-04-25T09:14:14.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c47400640 1 -- 172.21.15.175:0/1304627947 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c480be070 con 0x7f7c501387b0 2024-04-25T09:14:14.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c56000640 1 -- 172.21.15.175:0/1304627947 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c50144140 con 0x7f7c501387b0 2024-04-25T09:14:14.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c47400640 1 -- 172.21.15.175:0/1304627947 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c480b88b0 con 0x7f7c501387b0 2024-04-25T09:14:14.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c56000640 1 -- 172.21.15.175:0/1304627947 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c50164ab0 con 0x7f7c501387b0 2024-04-25T09:14:14.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c56000640 1 -- 172.21.15.175:0/1304627947 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c50074a60 con 0x7f7c501387b0 2024-04-25T09:14:14.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c47400640 1 -- 172.21.15.175:0/1304627947 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7c480b8a50 con 0x7f7c501387b0 2024-04-25T09:14:14.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c47400640 1 --2- 172.21.15.175:0/1304627947 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7c30066f90 0x7f7c30069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:14.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.420+0000 7f7c47400640 1 -- 172.21.15.175:0/1304627947 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c4811fca0 con 0x7f7c501387b0 2024-04-25T09:14:14.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.424+0000 7f7c4f400640 1 --2- 172.21.15.175:0/1304627947 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7c30066f90 0x7f7c30069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:14.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.424+0000 7f7c4f400640 1 --2- 172.21.15.175:0/1304627947 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7c30066f90 0x7f7c30069450 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7c40009af0 tx=0x7f7c40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:14.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.424+0000 7f7c47400640 1 -- 172.21.15.175:0/1304627947 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7c50144140 con 0x7f7c501387b0 2024-04-25T09:14:14.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.612+0000 7f7c56000640 1 -- 172.21.15.175:0/1304627947 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7c5015e320 con 0x7f7c501387b0 2024-04-25T09:14:14.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.612+0000 7f7c47400640 1 -- 172.21.15.175:0/1304627947 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v93) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7c50138c30 con 0x7f7c501387b0 2024-04-25T09:14:14.600 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:14:14.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.616+0000 7f7c56000640 1 -- 172.21.15.175:0/1304627947 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7c30066f90 msgr2=0x7f7c30069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:14.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.616+0000 7f7c56000640 1 --2- 172.21.15.175:0/1304627947 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7c30066f90 0x7f7c30069450 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7c40009af0 tx=0x7f7c40008040 comp rx=0 tx=0).stop 2024-04-25T09:14:14.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.616+0000 7f7c56000640 1 -- 172.21.15.175:0/1304627947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c501387b0 msgr2=0x7f7c50143c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:14.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.616+0000 7f7c56000640 1 --2- 172.21.15.175:0/1304627947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c501387b0 0x7f7c50143c00 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f7c480af040 tx=0x7f7c48019790 comp rx=0 tx=0).stop 2024-04-25T09:14:14.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.616+0000 7f7c56000640 1 -- 172.21.15.175:0/1304627947 shutdown_connections 2024-04-25T09:14:14.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.616+0000 7f7c56000640 1 --2- 172.21.15.175:0/1304627947 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7c30066f90 0x7f7c30069450 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.616+0000 7f7c56000640 1 --2- 172.21.15.175:0/1304627947 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c501387b0 0x7f7c50143c00 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.616+0000 7f7c56000640 1 --2- 172.21.15.175:0/1304627947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7c5015c5e0 0x7f7c5014d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.616+0000 7f7c56000640 1 --2- 172.21.15.175:0/1304627947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7c501453a0 0x7f7c50134ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:14.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.616+0000 7f7c56000640 1 -- 172.21.15.175:0/1304627947 >> 172.21.15.175:0/1304627947 conn(0x7f7c50144fc0 msgr2=0x7f7c5015d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:14.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.616+0000 7f7c56000640 1 -- 172.21.15.175:0/1304627947 shutdown_connections 2024-04-25T09:14:14.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:14.616+0000 7f7c56000640 1 -- 172.21.15.175:0/1304627947 wait complete. 2024-04-25T09:14:14.620 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:14:14.620 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:14:14.620 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-25T09:14:14.620 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:14:14.620 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:14.621 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:14:14.621 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:14:14.621 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:14:14.621 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:14:14.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:14.621 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-25T09:14:14.630 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:14:14.630 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:14:14.630 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:14:14.630 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:14.630 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:14:14.630 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:14.630 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:14:14.630 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:14.631 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-25T09:14:14.631 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:14:14.631 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:14.631 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-25T09:14:14.631 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:14:14.631 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:14.631 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:14:14.631 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:14.631 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:14:14.631 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 41864sec preferred_lft 41864sec 2024-04-25T09:14:14.631 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-25T09:14:14.631 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:14.631 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:14:14.631 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:0d:71:4a:a6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:14.631 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:14:14.632 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:14.632 INFO:teuthology.orchestra.run.smithi175.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:14:14.632 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:14.632 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:14:14.632 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:14.632 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:14:14.632 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:14.632 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:14:14.632 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:14:14.632 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:14:14.632 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:14.632 INFO:teuthology.orchestra.run.smithi175.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:14:14.632 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:14:14.632 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:14:14.633 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:14.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:14.634 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:14:14.694 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:14:14.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:14.696 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-25T09:14:14.748 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-25T09:14:14.748 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:14:14.749 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:14:14.749 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:14:14.749 INFO:teuthology.orchestra.run.smithi175.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:14:14.749 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:14:14.749 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:14:14.749 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:14:14.749 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:14:14.749 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:14:14.749 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:14:14.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:14.749 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:14:14.750 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:14:14.750 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:14:14.750 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:14:14.750 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:14:14.750 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:14:14.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:14.838 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:14:14.846 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:14:14.847 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:14:14.847 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:14:14.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:14.847 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-25T09:14:14.908 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:14:14.909 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:14.961 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:14:14.961 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:14:14.961 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:15.012 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:14:15.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:15.012 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:15.100 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:15.100 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:14:15.100 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:14:15.115 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:15.115 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:14:15.115 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:14:15.115 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:14:15.115 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:14:15.123 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:15.123 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:14:15.123 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:14:15.123 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:14:15.123 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:14:15.123 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:14:15.123 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:14:15.123 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:14:15.127 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:14:15.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:15.127 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:15.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:15.146 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:14:15.203 INFO:teuthology.orchestra.run.smithi175.stdout:client8916 2024-04-25T09:14:15.203 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:14:15.204 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:15.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:15.257 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/unflushed) 2024-04-25T09:14:15.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:15.313 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=./parent/unflushed/jfile bs=1M count=8) 2024-04-25T09:14:15.415 INFO:teuthology.orchestra.run.smithi175.stderr:8+0 records in 2024-04-25T09:14:15.416 INFO:teuthology.orchestra.run.smithi175.stderr:8+0 records out 2024-04-25T09:14:15.416 INFO:teuthology.orchestra.run.smithi175.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0460425 s, 182 MB/s 2024-04-25T09:14:15.417 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:15.417 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:15.417 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:15.417 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:15.417 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-25T09:14:15.417 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:15.481 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627781 2024-04-25T09:14:15.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:15.490 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:15.490 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:15.490 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:15.490 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:15.490 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-25T09:14:15.490 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:15.601 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627782 2024-04-25T09:14:15.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:15.609 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:14:15.610 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:15.665 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:14:15.665 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:15.721 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:14:15.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.908+0000 7f35dc800640 1 Processor -- start 2024-04-25T09:14:15.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.908+0000 7f35dc800640 1 -- start start 2024-04-25T09:14:15.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35dc800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f35d415a900 0x7f35d406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:15.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35dc800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d40cda00 con 0x7f35d40cf560 2024-04-25T09:14:15.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35dc800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d40cdce0 con 0x7f35d40cd520 2024-04-25T09:14:15.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35dc800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d415bcf0 con 0x7f35d415a900 2024-04-25T09:14:15.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35da800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f35d40cf560 0x7f35d415bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:42588/0 (socket says 172.21.15.175:42588) 2024-04-25T09:14:15.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35da800640 1 -- 172.21.15.175:0/250943577 learned_addr learned my addr 172.21.15.175:0/250943577 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:15.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35d8a00640 1 -- 172.21.15.175:0/250943577 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154920014 0 0) 0x7f35d40cda00 con 0x7f35d40cf560 2024-04-25T09:14:15.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35d9e00640 1 --2- 172.21.15.175:0/250943577 >> v2:172.21.15.177:3300/0 conn(0x7f35d415a900 0x7f35d406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:15.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35d8a00640 1 -- 172.21.15.175:0/250943577 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35bc003530 con 0x7f35d40cf560 2024-04-25T09:14:15.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35d8a00640 1 -- 172.21.15.175:0/250943577 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 302105457 0 0) 0x7f35bc003530 con 0x7f35d40cf560 2024-04-25T09:14:15.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35d8a00640 1 -- 172.21.15.175:0/250943577 >> v2:172.21.15.177:3300/0 conn(0x7f35d415a900 msgr2=0x7f35d406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:15.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35d8a00640 1 --2- 172.21.15.175:0/250943577 >> v2:172.21.15.177:3300/0 conn(0x7f35d415a900 0x7f35d406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:15.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35d8a00640 1 -- 172.21.15.175:0/250943577 >> v1:172.21.15.177:6789/0 conn(0x7f35d40cd520 legacy=0x7f35d40ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:15.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35d8a00640 1 -- 172.21.15.175:0/250943577 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d40cdfc0 con 0x7f35d40cf560 2024-04-25T09:14:15.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35d8a00640 1 -- 172.21.15.175:0/250943577 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f35d0001a00 con 0x7f35d40cf560 2024-04-25T09:14:15.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35d8a00640 1 -- 172.21.15.175:0/250943577 >> v1:172.21.15.175:6789/0 conn(0x7f35d40cf560 legacy=0x7f35d415bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:15.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35d8a00640 1 --2- 172.21.15.175:0/250943577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35bc003a10 0x7f35bc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:15.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35d8a00640 1 --2- 172.21.15.175:0/250943577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35bc004810 0x7f35bc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:15.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35d8a00640 1 --2- 172.21.15.175:0/250943577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35bc0051d0 0x7f35bc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:15.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35d8a00640 1 -- 172.21.15.175:0/250943577 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc00c0a0 con 0x7f35bc0051d0 2024-04-25T09:14:15.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35d8a00640 1 -- 172.21.15.175:0/250943577 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc00c250 con 0x7f35bc004810 2024-04-25T09:14:15.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35d8a00640 1 -- 172.21.15.175:0/250943577 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc00c450 con 0x7f35bc003a10 2024-04-25T09:14:15.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35da800640 1 --2- 172.21.15.175:0/250943577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35bc0051d0 0x7f35bc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:15.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35d9400640 1 --2- 172.21.15.175:0/250943577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35bc004810 0x7f35bc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:15.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35d9e00640 1 --2- 172.21.15.175:0/250943577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35bc003a10 0x7f35bc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:15.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35da800640 1 -- 172.21.15.175:0/250943577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35bc003a10 msgr2=0x7f35bc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:15.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35da800640 1 --2- 172.21.15.175:0/250943577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35bc003a10 0x7f35bc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:15.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35da800640 1 -- 172.21.15.175:0/250943577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35bc004810 msgr2=0x7f35bc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:15.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35da800640 1 --2- 172.21.15.175:0/250943577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35bc004810 0x7f35bc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:15.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.912+0000 7f35da800640 1 -- 172.21.15.175:0/250943577 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc003530 con 0x7f35bc0051d0 2024-04-25T09:14:15.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.916+0000 7f35da800640 1 -- 172.21.15.175:0/250943577 reap_dead start 2024-04-25T09:14:15.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.916+0000 7f35da800640 1 --2- 172.21.15.175:0/250943577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35bc0051d0 0x7f35bc00b9d0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f35d000a770 tx=0x7f35d001d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd77155954937e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:15.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.916+0000 7f35d8a00640 1 -- 172.21.15.175:0/250943577 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d000a390 con 0x7f35bc0051d0 2024-04-25T09:14:15.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.916+0000 7f35d8a00640 1 -- 172.21.15.175:0/250943577 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d00ac640 con 0x7f35bc0051d0 2024-04-25T09:14:15.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.916+0000 7f35d8a00640 1 -- 172.21.15.175:0/250943577 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d00aca30 con 0x7f35bc0051d0 2024-04-25T09:14:15.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.916+0000 7f35dc800640 1 -- 172.21.15.175:0/250943577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35bc0051d0 msgr2=0x7f35bc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:15.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.916+0000 7f35dc800640 1 --2- 172.21.15.175:0/250943577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35bc0051d0 0x7f35bc00b9d0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f35d000a770 tx=0x7f35d001d2a0 comp rx=0 tx=0).stop 2024-04-25T09:14:15.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.916+0000 7f35dc800640 1 -- 172.21.15.175:0/250943577 shutdown_connections 2024-04-25T09:14:15.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.916+0000 7f35dc800640 1 --2- 172.21.15.175:0/250943577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35bc0051d0 0x7f35bc00b9d0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:15.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.916+0000 7f35dc800640 1 -- 172.21.15.175:0/250943577 >> 172.21.15.175:0/250943577 conn(0x7f35d4067150 msgr2=0x7f35d406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:15.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.916+0000 7f35dc800640 1 -- 172.21.15.175:0/250943577 shutdown_connections 2024-04-25T09:14:15.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.916+0000 7f35dc800640 1 -- 172.21.15.175:0/250943577 wait complete. 2024-04-25T09:14:15.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35dc800640 1 Processor -- start 2024-04-25T09:14:15.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35dc800640 1 -- start start 2024-04-25T09:14:15.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35dc800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35d41502b0 0x7f35d41eec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:15.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35dc800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35d40b3770 0x7f35d4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:15.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35dc800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35d4150690 0x7f35d4150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:15.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35dc800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d406d3b0 con 0x7f35d4150690 2024-04-25T09:14:15.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35dc800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40ce580 con 0x7f35d40b3770 2024-04-25T09:14:15.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35dc800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d406d530 con 0x7f35d41502b0 2024-04-25T09:14:15.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35da800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35d4150690 0x7f35d4150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:15.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35d9e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35d41502b0 0x7f35d41eec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:15.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35da800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35d4150690 0x7f35d4150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45094/0 (socket says 172.21.15.175:45094) 2024-04-25T09:14:15.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35da800640 1 -- 172.21.15.175:0/3331630261 learned_addr learned my addr 172.21.15.175:0/3331630261 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:15.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35d9400640 1 --2- 172.21.15.175:0/3331630261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35d40b3770 0x7f35d4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:15.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35da800640 1 -- 172.21.15.175:0/3331630261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35d41502b0 msgr2=0x7f35d41eec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:15.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35da800640 1 --2- 172.21.15.175:0/3331630261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35d41502b0 0x7f35d41eec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:15.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35da800640 1 -- 172.21.15.175:0/3331630261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35d40b3770 msgr2=0x7f35d4151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:15.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35da800640 1 --2- 172.21.15.175:0/3331630261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35d40b3770 0x7f35d4151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:15.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35da800640 1 -- 172.21.15.175:0/3331630261 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d40b3ca0 con 0x7f35d4150690 2024-04-25T09:14:15.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35da800640 1 --2- 172.21.15.175:0/3331630261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35d4150690 0x7f35d4150af0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f35d001d0d0 tx=0x7f35bc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:15.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35ce000640 1 -- 172.21.15.175:0/3331630261 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d0001a00 con 0x7f35d4150690 2024-04-25T09:14:15.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35ce000640 1 -- 172.21.15.175:0/3331630261 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d0001260 con 0x7f35d4150690 2024-04-25T09:14:15.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35ce000640 1 -- 172.21.15.175:0/3331630261 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d00ac9f0 con 0x7f35d4150690 2024-04-25T09:14:15.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35dc800640 1 -- 172.21.15.175:0/3331630261 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d414cf80 con 0x7f35d4150690 2024-04-25T09:14:15.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35dc800640 1 -- 172.21.15.175:0/3331630261 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d414d540 con 0x7f35d4150690 2024-04-25T09:14:15.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.920+0000 7f35dc800640 1 -- 172.21.15.175:0/3331630261 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d4074a60 con 0x7f35d4150690 2024-04-25T09:14:15.910 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.924+0000 7f35ce000640 1 -- 172.21.15.175:0/3331630261 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f35d00b7420 con 0x7f35d4150690 2024-04-25T09:14:15.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.924+0000 7f35ce000640 1 --2- 172.21.15.175:0/3331630261 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f35b8066f60 0x7f35b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:15.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.924+0000 7f35ce000640 1 -- 172.21.15.175:0/3331630261 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35d011e890 con 0x7f35d4150690 2024-04-25T09:14:15.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.924+0000 7f35d9e00640 1 --2- 172.21.15.175:0/3331630261 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f35b8066f60 0x7f35b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:15.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.924+0000 7f35d9e00640 1 --2- 172.21.15.175:0/3331630261 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f35b8066f60 0x7f35b8069420 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f35c8009b60 tx=0x7f35c8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:15.915 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:15.928+0000 7f35ce000640 1 -- 172.21.15.175:0/3331630261 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f35d00bd020 con 0x7f35d4150690 2024-04-25T09:14:16.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.084+0000 7f35dc800640 1 -- 172.21.15.175:0/3331630261 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35d415d9e0 con 0x7f35d4150690 2024-04-25T09:14:16.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.088+0000 7f35ce000640 1 -- 172.21.15.175:0/3331630261 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16663 (secure 0 0 0) 0x7f35d0016fb0 con 0x7f35d4150690 2024-04-25T09:14:16.074 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:16.074 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":113,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:14:05.335790+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:14:01.413477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:14:02.699273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:14:16.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.088+0000 7f35dc800640 1 -- 172.21.15.175:0/3331630261 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f35b8066f60 msgr2=0x7f35b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:16.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.088+0000 7f35dc800640 1 --2- 172.21.15.175:0/3331630261 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f35b8066f60 0x7f35b8069420 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f35c8009b60 tx=0x7f35c8009190 comp rx=0 tx=0).stop 2024-04-25T09:14:16.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.088+0000 7f35dc800640 1 -- 172.21.15.175:0/3331630261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35d4150690 msgr2=0x7f35d4150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:16.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.088+0000 7f35dc800640 1 --2- 172.21.15.175:0/3331630261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35d4150690 0x7f35d4150af0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f35d001d0d0 tx=0x7f35bc005840 comp rx=0 tx=0).stop 2024-04-25T09:14:16.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.088+0000 7f35dc800640 1 -- 172.21.15.175:0/3331630261 shutdown_connections 2024-04-25T09:14:16.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.088+0000 7f35dc800640 1 --2- 172.21.15.175:0/3331630261 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f35b8066f60 0x7f35b8069420 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.088+0000 7f35dc800640 1 --2- 172.21.15.175:0/3331630261 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35d4150690 0x7f35d4150af0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.088+0000 7f35dc800640 1 --2- 172.21.15.175:0/3331630261 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35d40b3770 0x7f35d4151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.088+0000 7f35dc800640 1 --2- 172.21.15.175:0/3331630261 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35d41502b0 0x7f35d41eec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.088+0000 7f35dc800640 1 -- 172.21.15.175:0/3331630261 >> 172.21.15.175:0/3331630261 conn(0x7f35bc0051d0 msgr2=0x7f35d415bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:16.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.088+0000 7f35dc800640 1 -- 172.21.15.175:0/3331630261 shutdown_connections 2024-04-25T09:14:16.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.088+0000 7f35dc800640 1 -- 172.21.15.175:0/3331630261 wait complete. 2024-04-25T09:14:16.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:14:01.413477+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:14:02.699273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:14:16.095 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:14:16.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4229600640 1 Processor -- start 2024-04-25T09:14:16.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4229600640 1 -- start start 2024-04-25T09:14:16.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4229600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f42240ace00 0x7f4224168a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4229600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422406de20 con 0x7f42240cdb60 2024-04-25T09:14:16.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4229600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422415dfe0 con 0x7f422406ad50 2024-04-25T09:14:16.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4229600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422406e090 con 0x7f42240ace00 2024-04-25T09:14:16.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4222a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f42240cdb60 0x7f42240cdf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:42602/0 (socket says 172.21.15.175:42602) 2024-04-25T09:14:16.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4222a00640 1 -- 172.21.15.175:0/3866608231 learned_addr learned my addr 172.21.15.175:0/3866608231 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:16.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4223400640 1 --2- 172.21.15.175:0/3866608231 >> v2:172.21.15.177:3300/0 conn(0x7f42240ace00 0x7f4224168a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4221600640 1 -- 172.21.15.175:0/3866608231 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073555357 0 0) 0x7f422406de20 con 0x7f42240cdb60 2024-04-25T09:14:16.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4221600640 1 -- 172.21.15.175:0/3866608231 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4208003530 con 0x7f42240cdb60 2024-04-25T09:14:16.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4221600640 1 -- 172.21.15.175:0/3866608231 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4276131378 0 0) 0x7f4208003530 con 0x7f42240cdb60 2024-04-25T09:14:16.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4221600640 1 -- 172.21.15.175:0/3866608231 >> v2:172.21.15.177:3300/0 conn(0x7f42240ace00 msgr2=0x7f4224168a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:16.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4221600640 1 --2- 172.21.15.175:0/3866608231 >> v2:172.21.15.177:3300/0 conn(0x7f42240ace00 0x7f4224168a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4221600640 1 -- 172.21.15.175:0/3866608231 >> v1:172.21.15.177:6789/0 conn(0x7f422406ad50 legacy=0x7f422406bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:16.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4221600640 1 -- 172.21.15.175:0/3866608231 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422406e370 con 0x7f42240cdb60 2024-04-25T09:14:16.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4221600640 1 -- 172.21.15.175:0/3866608231 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f4214001680 con 0x7f42240cdb60 2024-04-25T09:14:16.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4221600640 1 -- 172.21.15.175:0/3866608231 >> v1:172.21.15.175:6789/0 conn(0x7f42240cdb60 legacy=0x7f42240cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:16.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4221600640 1 --2- 172.21.15.175:0/3866608231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42080039c0 0x7f4208003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4221600640 1 --2- 172.21.15.175:0/3866608231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4208004810 0x7f4208004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4221600640 1 --2- 172.21.15.175:0/3866608231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42080051d0 0x7f420800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4221600640 1 -- 172.21.15.175:0/3866608231 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422406e090 con 0x7f42080039c0 2024-04-25T09:14:16.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4221600640 1 -- 172.21.15.175:0/3866608231 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420800c070 con 0x7f4208004810 2024-04-25T09:14:16.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4221600640 1 -- 172.21.15.175:0/3866608231 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420800c270 con 0x7f42080051d0 2024-04-25T09:14:16.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4222a00640 1 --2- 172.21.15.175:0/3866608231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42080039c0 0x7f4208003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4222000640 1 --2- 172.21.15.175:0/3866608231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4208004810 0x7f4208004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4223400640 1 --2- 172.21.15.175:0/3866608231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42080051d0 0x7f420800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4222a00640 1 -- 172.21.15.175:0/3866608231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42080051d0 msgr2=0x7f420800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:16.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4222a00640 1 --2- 172.21.15.175:0/3866608231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42080051d0 0x7f420800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4222a00640 1 -- 172.21.15.175:0/3866608231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4208004810 msgr2=0x7f4208004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:16.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4222a00640 1 --2- 172.21.15.175:0/3866608231 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4208004810 0x7f4208004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4222a00640 1 -- 172.21.15.175:0/3866608231 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4208003530 con 0x7f42080039c0 2024-04-25T09:14:16.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4223400640 1 --2- 172.21.15.175:0/3866608231 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42080051d0 0x7f420800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:16.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.248+0000 7f4223400640 1 -- 172.21.15.175:0/3866608231 reap_dead start 2024-04-25T09:14:16.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.252+0000 7f4222a00640 1 --2- 172.21.15.175:0/3866608231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42080039c0 0x7f4208003de0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f421400c240 tx=0x7f421401cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326e910d2831527 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:16.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.252+0000 7f4221600640 1 -- 172.21.15.175:0/3866608231 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214007d20 con 0x7f42080039c0 2024-04-25T09:14:16.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.252+0000 7f4221600640 1 -- 172.21.15.175:0/3866608231 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42140a9070 con 0x7f42080039c0 2024-04-25T09:14:16.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.252+0000 7f4221600640 1 -- 172.21.15.175:0/3866608231 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214005d80 con 0x7f42080039c0 2024-04-25T09:14:16.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.252+0000 7f4229600640 1 -- 172.21.15.175:0/3866608231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42080039c0 msgr2=0x7f4208003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:16.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.252+0000 7f4229600640 1 --2- 172.21.15.175:0/3866608231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42080039c0 0x7f4208003de0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f421400c240 tx=0x7f421401cbd0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.252+0000 7f4229600640 1 -- 172.21.15.175:0/3866608231 shutdown_connections 2024-04-25T09:14:16.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.252+0000 7f4229600640 1 --2- 172.21.15.175:0/3866608231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42080039c0 0x7f4208003de0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.252+0000 7f4229600640 1 -- 172.21.15.175:0/3866608231 >> 172.21.15.175:0/3866608231 conn(0x7f42240cca10 msgr2=0x7f42240cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:16.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.252+0000 7f4229600640 1 -- 172.21.15.175:0/3866608231 shutdown_connections 2024-04-25T09:14:16.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.252+0000 7f4229600640 1 -- 172.21.15.175:0/3866608231 wait complete. 2024-04-25T09:14:16.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4229600640 1 Processor -- start 2024-04-25T09:14:16.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4229600640 1 -- start start 2024-04-25T09:14:16.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4229600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42080039c0 0x7f422414c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4229600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42240c64f0 0x7f422415e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4229600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f422415e710 0x7f42240b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4229600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42240aef40 con 0x7f422415e710 2024-04-25T09:14:16.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4229600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42240aedc0 con 0x7f42080039c0 2024-04-25T09:14:16.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4229600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42241616d0 con 0x7f42240c64f0 2024-04-25T09:14:16.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4223400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f422415e710 0x7f42240b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4223400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f422415e710 0x7f42240b08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45122/0 (socket says 172.21.15.175:45122) 2024-04-25T09:14:16.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4223400640 1 -- 172.21.15.175:0/304684744 learned_addr learned my addr 172.21.15.175:0/304684744 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:16.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4222000640 1 --2- 172.21.15.175:0/304684744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42240c64f0 0x7f422415e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4222a00640 1 --2- 172.21.15.175:0/304684744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42080039c0 0x7f422414c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4223400640 1 -- 172.21.15.175:0/304684744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42240c64f0 msgr2=0x7f422415e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:16.246 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4223400640 1 --2- 172.21.15.175:0/304684744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42240c64f0 0x7f422415e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4223400640 1 -- 172.21.15.175:0/304684744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42080039c0 msgr2=0x7f422414c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:16.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4223400640 1 --2- 172.21.15.175:0/304684744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42080039c0 0x7f422414c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4223400640 1 -- 172.21.15.175:0/304684744 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4224160980 con 0x7f422415e710 2024-04-25T09:14:16.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4223400640 1 --2- 172.21.15.175:0/304684744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f422415e710 0x7f42240b08b0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f42240671f0 tx=0x7f421c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:16.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f421aa00640 1 -- 172.21.15.175:0/304684744 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c010da0 con 0x7f422415e710 2024-04-25T09:14:16.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f421aa00640 1 -- 172.21.15.175:0/304684744 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c0039a0 con 0x7f422415e710 2024-04-25T09:14:16.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f421aa00640 1 -- 172.21.15.175:0/304684744 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c003dd0 con 0x7f422415e710 2024-04-25T09:14:16.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4229600640 1 -- 172.21.15.175:0/304684744 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4224160c60 con 0x7f422415e710 2024-04-25T09:14:16.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.256+0000 7f4229600640 1 -- 172.21.15.175:0/304684744 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4224161220 con 0x7f422415e710 2024-04-25T09:14:16.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.260+0000 7f4229600640 1 -- 172.21.15.175:0/304684744 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4224161420 con 0x7f422415e710 2024-04-25T09:14:16.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.260+0000 7f421aa00640 1 -- 172.21.15.175:0/304684744 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f421c01e020 con 0x7f422415e710 2024-04-25T09:14:16.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.260+0000 7f421aa00640 1 --2- 172.21.15.175:0/304684744 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4204066f60 0x7f4204069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.260+0000 7f421aa00640 1 -- 172.21.15.175:0/304684744 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f421c085650 con 0x7f422415e710 2024-04-25T09:14:16.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.260+0000 7f4222a00640 1 --2- 172.21.15.175:0/304684744 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4204066f60 0x7f4204069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.260+0000 7f4222a00640 1 --2- 172.21.15.175:0/304684744 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4204066f60 0x7f4204069420 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f42140ab000 tx=0x7f42140b1040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:16.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.264+0000 7f421aa00640 1 -- 172.21.15.175:0/304684744 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f421c025020 con 0x7f422415e710 2024-04-25T09:14:16.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.420+0000 7f4229600640 1 -- 172.21.15.175:0/304684744 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4224075160 con 0x7f422415e710 2024-04-25T09:14:16.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.420+0000 7f421aa00640 1 -- 172.21.15.175:0/304684744 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7f421c055ee0 con 0x7f422415e710 2024-04-25T09:14:16.409 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:14:16.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.424+0000 7f4229600640 1 -- 172.21.15.175:0/304684744 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4204066f60 msgr2=0x7f4204069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:16.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.424+0000 7f4229600640 1 --2- 172.21.15.175:0/304684744 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4204066f60 0x7f4204069420 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f42140ab000 tx=0x7f42140b1040 comp rx=0 tx=0).stop 2024-04-25T09:14:16.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.424+0000 7f4229600640 1 -- 172.21.15.175:0/304684744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f422415e710 msgr2=0x7f42240b08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:16.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.424+0000 7f4229600640 1 --2- 172.21.15.175:0/304684744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f422415e710 0x7f42240b08b0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f42240671f0 tx=0x7f421c010590 comp rx=0 tx=0).stop 2024-04-25T09:14:16.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.424+0000 7f4229600640 1 -- 172.21.15.175:0/304684744 shutdown_connections 2024-04-25T09:14:16.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.424+0000 7f4229600640 1 --2- 172.21.15.175:0/304684744 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4204066f60 0x7f4204069420 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.424+0000 7f4229600640 1 --2- 172.21.15.175:0/304684744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f422415e710 0x7f42240b08b0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.424+0000 7f4229600640 1 --2- 172.21.15.175:0/304684744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f42240c64f0 0x7f422415e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.424+0000 7f4229600640 1 --2- 172.21.15.175:0/304684744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f42080039c0 0x7f422414c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.424+0000 7f4229600640 1 -- 172.21.15.175:0/304684744 >> 172.21.15.175:0/304684744 conn(0x7f42240cca10 msgr2=0x7f42240ad210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:16.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.424+0000 7f4229600640 1 -- 172.21.15.175:0/304684744 shutdown_connections 2024-04-25T09:14:16.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.424+0000 7f4229600640 1 -- 172.21.15.175:0/304684744 wait complete. 2024-04-25T09:14:16.430 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:14:16.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.580+0000 7f0f51200640 1 Processor -- start 2024-04-25T09:14:16.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.580+0000 7f0f51200640 1 -- start start 2024-04-25T09:14:16.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.584+0000 7f0f51200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0f4c0b3230 0x7f0f4c0b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.584+0000 7f0f51200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0f4c0b3d20 0x7f0f4c0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.584+0000 7f0f51200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c0712d0 0x7f0f4c071740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.584+0000 7f0f51200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f4c071c80 con 0x7f0f4c0b3d20 2024-04-25T09:14:16.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.584+0000 7f0f51200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f4c15dd10 con 0x7f0f4c0b3230 2024-04-25T09:14:16.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.584+0000 7f0f51200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c15dff0 con 0x7f0f4c0712d0 2024-04-25T09:14:16.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.584+0000 7f0f41400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0f4c0b3d20 0x7f0f4c0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.584+0000 7f0f41400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0f4c0b3d20 0x7f0f4c0b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45130/0 (socket says 172.21.15.175:45130) 2024-04-25T09:14:16.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.584+0000 7f0f41400640 1 -- 172.21.15.175:0/4250367045 learned_addr learned my addr 172.21.15.175:0/4250367045 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:16.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.584+0000 7f0f49e00640 1 --2- 172.21.15.175:0/4250367045 >> v2:172.21.15.177:3300/0 conn(0x7f0f4c0b3230 0x7f0f4c0b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.584+0000 7f0f41400640 1 -- 172.21.15.175:0/4250367045 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c0712d0 msgr2=0x7f0f4c071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:16.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.584+0000 7f0f4a800640 1 --2- 172.21.15.175:0/4250367045 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c0712d0 0x7f0f4c071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.584+0000 7f0f41400640 1 --2- 172.21.15.175:0/4250367045 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c0712d0 0x7f0f4c071740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.584+0000 7f0f41400640 1 -- 172.21.15.175:0/4250367045 >> v2:172.21.15.177:3300/0 conn(0x7f0f4c0b3230 msgr2=0x7f0f4c0b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:16.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.584+0000 7f0f41400640 1 --2- 172.21.15.175:0/4250367045 >> v2:172.21.15.177:3300/0 conn(0x7f0f4c0b3230 0x7f0f4c0b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.584+0000 7f0f41400640 1 -- 172.21.15.175:0/4250367045 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c15e2d0 con 0x7f0f4c0b3d20 2024-04-25T09:14:16.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.584+0000 7f0f49e00640 1 --2- 172.21.15.175:0/4250367045 >> v2:172.21.15.177:3300/0 conn(0x7f0f4c0b3230 0x7f0f4c0b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:16.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.584+0000 7f0f4a800640 1 --2- 172.21.15.175:0/4250367045 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c0712d0 0x7f0f4c071740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:16.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.588+0000 7f0f41400640 1 --2- 172.21.15.175:0/4250367045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f4c0b3d20 0x7f0f4c0b41b0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0b4d50 tx=0x7f0f3401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21076500d4d318d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:16.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.588+0000 7f0f49400640 1 -- 172.21.15.175:0/4250367045 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f340ab430 con 0x7f0f4c0b3d20 2024-04-25T09:14:16.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.588+0000 7f0f49400640 1 -- 172.21.15.175:0/4250367045 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f340b0070 con 0x7f0f4c0b3d20 2024-04-25T09:14:16.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.588+0000 7f0f49400640 1 -- 172.21.15.175:0/4250367045 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f340ab7f0 con 0x7f0f4c0b3d20 2024-04-25T09:14:16.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.588+0000 7f0f51200640 1 -- 172.21.15.175:0/4250367045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f4c0b3d20 msgr2=0x7f0f4c0b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:16.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.588+0000 7f0f51200640 1 --2- 172.21.15.175:0/4250367045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f4c0b3d20 0x7f0f4c0b41b0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0b4d50 tx=0x7f0f3401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.588+0000 7f0f51200640 1 -- 172.21.15.175:0/4250367045 shutdown_connections 2024-04-25T09:14:16.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.588+0000 7f0f51200640 1 --2- 172.21.15.175:0/4250367045 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c0712d0 0x7f0f4c071740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.588+0000 7f0f51200640 1 --2- 172.21.15.175:0/4250367045 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f4c0b3d20 0x7f0f4c0b41b0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.588+0000 7f0f51200640 1 --2- 172.21.15.175:0/4250367045 >> v2:172.21.15.177:3300/0 conn(0x7f0f4c0b3230 0x7f0f4c0b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.588+0000 7f0f51200640 1 -- 172.21.15.175:0/4250367045 >> 172.21.15.175:0/4250367045 conn(0x7f0f4c06ac50 msgr2=0x7f0f4c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:16.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.588+0000 7f0f51200640 1 -- 172.21.15.175:0/4250367045 shutdown_connections 2024-04-25T09:14:16.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.588+0000 7f0f51200640 1 -- 172.21.15.175:0/4250367045 wait complete. 2024-04-25T09:14:16.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.588+0000 7f0f51200640 1 Processor -- start 2024-04-25T09:14:16.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.588+0000 7f0f51200640 1 -- start start 2024-04-25T09:14:16.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f51200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f4c0712d0 0x7f0f4c0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f51200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f4c0b3230 0x7f0f4c151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f51200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c0b3d20 0x7f0f4c0b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f51200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c0b3790 con 0x7f0f4c0712d0 2024-04-25T09:14:16.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f51200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c0b3610 con 0x7f0f4c0b3230 2024-04-25T09:14:16.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f51200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c15aa50 con 0x7f0f4c0b3d20 2024-04-25T09:14:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f49e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f4c0712d0 0x7f0f4c0b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f49e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f4c0712d0 0x7f0f4c0b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45132/0 (socket says 172.21.15.175:45132) 2024-04-25T09:14:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f49e00640 1 -- 172.21.15.175:0/2207826528 learned_addr learned my addr 172.21.15.175:0/2207826528 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f41400640 1 --2- 172.21.15.175:0/2207826528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f4c0b3230 0x7f0f4c151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f4a800640 1 --2- 172.21.15.175:0/2207826528 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c0b3d20 0x7f0f4c0b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f49e00640 1 -- 172.21.15.175:0/2207826528 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c0b3d20 msgr2=0x7f0f4c0b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f49e00640 1 --2- 172.21.15.175:0/2207826528 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c0b3d20 0x7f0f4c0b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f49e00640 1 -- 172.21.15.175:0/2207826528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f4c0b3230 msgr2=0x7f0f4c151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f49e00640 1 --2- 172.21.15.175:0/2207826528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f4c0b3230 0x7f0f4c151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f49e00640 1 -- 172.21.15.175:0/2207826528 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c0ac960 con 0x7f0f4c0712d0 2024-04-25T09:14:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f49e00640 1 --2- 172.21.15.175:0/2207826528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f4c0712d0 0x7f0f4c0b0a10 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00cf60 tx=0x7f0f3c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f42a00640 1 -- 172.21.15.175:0/2207826528 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c01a070 con 0x7f0f4c0712d0 2024-04-25T09:14:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f42a00640 1 -- 172.21.15.175:0/2207826528 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3c00d840 con 0x7f0f4c0712d0 2024-04-25T09:14:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f42a00640 1 -- 172.21.15.175:0/2207826528 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c00dc10 con 0x7f0f4c0712d0 2024-04-25T09:14:16.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f51200640 1 -- 172.21.15.175:0/2207826528 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f4c1578d0 con 0x7f0f4c0712d0 2024-04-25T09:14:16.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f51200640 1 -- 172.21.15.175:0/2207826528 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4c0acee0 con 0x7f0f4c0712d0 2024-04-25T09:14:16.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f51200640 1 -- 172.21.15.175:0/2207826528 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f4c075160 con 0x7f0f4c0712d0 2024-04-25T09:14:16.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.592+0000 7f0f42a00640 1 -- 172.21.15.175:0/2207826528 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0f3c01d070 con 0x7f0f4c0712d0 2024-04-25T09:14:16.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.596+0000 7f0f42a00640 1 --2- 172.21.15.175:0/2207826528 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f28066f90 0x7f0f28069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.596+0000 7f0f42a00640 1 -- 172.21.15.175:0/2207826528 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f3c085790 con 0x7f0f4c0712d0 2024-04-25T09:14:16.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.596+0000 7f0f41400640 1 --2- 172.21.15.175:0/2207826528 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f28066f90 0x7f0f28069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.596+0000 7f0f41400640 1 --2- 172.21.15.175:0/2207826528 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f28066f90 0x7f0f28069450 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0f340af000 tx=0x7f0f340a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:16.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.600+0000 7f0f42a00640 1 -- 172.21.15.175:0/2207826528 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0f3c056140 con 0x7f0f4c0712d0 2024-04-25T09:14:16.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.756+0000 7f0f51200640 1 -- 172.21.15.175:0/2207826528 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f4c072370 con 0x7f0f4c0712d0 2024-04-25T09:14:16.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.756+0000 7f0f42a00640 1 -- 172.21.15.175:0/2207826528 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f3c05a1e0 con 0x7f0f4c0712d0 2024-04-25T09:14:16.742 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:14:16.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.756+0000 7f0f51200640 1 -- 172.21.15.175:0/2207826528 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f28066f90 msgr2=0x7f0f28069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:16.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.756+0000 7f0f51200640 1 --2- 172.21.15.175:0/2207826528 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f28066f90 0x7f0f28069450 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f0f340af000 tx=0x7f0f340a7000 comp rx=0 tx=0).stop 2024-04-25T09:14:16.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.756+0000 7f0f51200640 1 -- 172.21.15.175:0/2207826528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f4c0712d0 msgr2=0x7f0f4c0b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:16.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.756+0000 7f0f51200640 1 --2- 172.21.15.175:0/2207826528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f4c0712d0 0x7f0f4c0b0a10 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c00cf60 tx=0x7f0f3c00cf90 comp rx=0 tx=0).stop 2024-04-25T09:14:16.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.756+0000 7f0f51200640 1 -- 172.21.15.175:0/2207826528 shutdown_connections 2024-04-25T09:14:16.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.756+0000 7f0f51200640 1 --2- 172.21.15.175:0/2207826528 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f28066f90 0x7f0f28069450 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.756+0000 7f0f51200640 1 --2- 172.21.15.175:0/2207826528 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f4c0b3d20 0x7f0f4c0b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.756+0000 7f0f51200640 1 --2- 172.21.15.175:0/2207826528 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f4c0b3230 0x7f0f4c151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.756+0000 7f0f51200640 1 --2- 172.21.15.175:0/2207826528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f4c0712d0 0x7f0f4c0b0a10 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.756+0000 7f0f51200640 1 -- 172.21.15.175:0/2207826528 >> 172.21.15.175:0/2207826528 conn(0x7f0f4c06ac50 msgr2=0x7f0f4c06b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:16.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.756+0000 7f0f51200640 1 -- 172.21.15.175:0/2207826528 shutdown_connections 2024-04-25T09:14:16.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.756+0000 7f0f51200640 1 -- 172.21.15.175:0/2207826528 wait complete. 2024-04-25T09:14:16.762 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:14:16.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.912+0000 7fe633e00640 1 Processor -- start 2024-04-25T09:14:16.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.912+0000 7fe633e00640 1 -- start start 2024-04-25T09:14:16.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.916+0000 7fe633e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe634099cb0 0x7fe63406c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.916+0000 7fe633e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe63409a090 0x7fe6340cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.916+0000 7fe633e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63406cef0 con 0x7fe6340b27c0 2024-04-25T09:14:16.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.916+0000 7fe633e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6340cf8b0 con 0x7fe634099cb0 2024-04-25T09:14:16.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.916+0000 7fe633e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63406ccb0 con 0x7fe63409a090 2024-04-25T09:14:16.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.916+0000 7fe62a000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe63409a090 0x7fe6340cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.916+0000 7fe62a000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe63409a090 0x7fe6340cbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:36030/0 (socket says 172.21.15.175:36030) 2024-04-25T09:14:16.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.916+0000 7fe633400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe6340b27c0 0x7fe63415d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:45690/0 (socket says 172.21.15.175:45690) 2024-04-25T09:14:16.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.916+0000 7fe62a000640 1 -- 172.21.15.175:0/2507534771 learned_addr learned my addr 172.21.15.175:0/2507534771 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:16.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.916+0000 7fe632a00640 1 --2- 172.21.15.175:0/2507534771 >> v2:172.21.15.177:3300/0 conn(0x7fe634099cb0 0x7fe63406c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.916+0000 7fe62a000640 1 -- 172.21.15.175:0/2507534771 >> v2:172.21.15.177:3300/0 conn(0x7fe634099cb0 msgr2=0x7fe63406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:16.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.916+0000 7fe62a000640 1 --2- 172.21.15.175:0/2507534771 >> v2:172.21.15.177:3300/0 conn(0x7fe634099cb0 0x7fe63406c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.916+0000 7fe62a000640 1 -- 172.21.15.175:0/2507534771 >> v1:172.21.15.177:6789/0 conn(0x7fe6340b27c0 legacy=0x7fe63415d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:16.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.916+0000 7fe62a000640 1 -- 172.21.15.175:0/2507534771 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6340cfae0 con 0x7fe63409a090 2024-04-25T09:14:16.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe62a000640 1 --2- 172.21.15.175:0/2507534771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe63409a090 0x7fe6340cbcc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009870 tx=0x7fe61c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c003f6510833fbdd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:16.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe632000640 1 -- 172.21.15.175:0/2507534771 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c0b0070 con 0x7fe63409a090 2024-04-25T09:14:16.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe632000640 1 -- 172.21.15.175:0/2507534771 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61c0ab600 con 0x7fe63409a090 2024-04-25T09:14:16.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe632000640 1 -- 172.21.15.175:0/2507534771 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c0ab9d0 con 0x7fe63409a090 2024-04-25T09:14:16.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe633e00640 1 -- 172.21.15.175:0/2507534771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe63409a090 msgr2=0x7fe6340cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:16.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe633e00640 1 --2- 172.21.15.175:0/2507534771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe63409a090 0x7fe6340cbcc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009870 tx=0x7fe61c01c4d0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe633e00640 1 -- 172.21.15.175:0/2507534771 shutdown_connections 2024-04-25T09:14:16.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe633e00640 1 --2- 172.21.15.175:0/2507534771 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe63409a090 0x7fe6340cbcc0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe633e00640 1 --2- 172.21.15.175:0/2507534771 >> v2:172.21.15.177:3300/0 conn(0x7fe634099cb0 0x7fe63406c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe633e00640 1 -- 172.21.15.175:0/2507534771 >> 172.21.15.175:0/2507534771 conn(0x7fe6340b3160 msgr2=0x7fe6340b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:16.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe633e00640 1 -- 172.21.15.175:0/2507534771 shutdown_connections 2024-04-25T09:14:16.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe633e00640 1 -- 172.21.15.175:0/2507534771 wait complete. 2024-04-25T09:14:16.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe633e00640 1 Processor -- start 2024-04-25T09:14:16.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe633e00640 1 -- start start 2024-04-25T09:14:16.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe633e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe634099cb0 0x7fe634153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe633e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe63409a090 0x7fe63415c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe633e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6340b27c0 0x7fe6340c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe633e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340d0f50 con 0x7fe6340b27c0 2024-04-25T09:14:16.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe633e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340d0dd0 con 0x7fe63409a090 2024-04-25T09:14:16.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.920+0000 7fe633e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340d10d0 con 0x7fe634099cb0 2024-04-25T09:14:16.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe632a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe634099cb0 0x7fe634153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe633400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6340b27c0 0x7fe6340c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe632a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe634099cb0 0x7fe634153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:36036/0 (socket says 172.21.15.175:36036) 2024-04-25T09:14:16.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe632a00640 1 -- 172.21.15.175:0/2625565122 learned_addr learned my addr 172.21.15.175:0/2625565122 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:16.911 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe62a000640 1 --2- 172.21.15.175:0/2625565122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe63409a090 0x7fe63415c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe633400640 1 -- 172.21.15.175:0/2625565122 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe634099cb0 msgr2=0x7fe634153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:16.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe633400640 1 --2- 172.21.15.175:0/2625565122 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe634099cb0 0x7fe634153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe633400640 1 -- 172.21.15.175:0/2625565122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe63409a090 msgr2=0x7fe63415c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:16.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe633400640 1 --2- 172.21.15.175:0/2625565122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe63409a090 0x7fe63415c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:16.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe633400640 1 -- 172.21.15.175:0/2625565122 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6340c7ff0 con 0x7fe6340b27c0 2024-04-25T09:14:16.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe632a00640 1 --2- 172.21.15.175:0/2625565122 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe634099cb0 0x7fe634153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:16.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe633400640 1 --2- 172.21.15.175:0/2625565122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6340b27c0 0x7fe6340c7430 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00c730 tx=0x7fe62c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:16.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe62b400640 1 -- 172.21.15.175:0/2625565122 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c017070 con 0x7fe6340b27c0 2024-04-25T09:14:16.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe62b400640 1 -- 172.21.15.175:0/2625565122 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c00ce40 con 0x7fe6340b27c0 2024-04-25T09:14:16.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe62b400640 1 -- 172.21.15.175:0/2625565122 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c00a840 con 0x7fe6340b27c0 2024-04-25T09:14:16.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe633e00640 1 -- 172.21.15.175:0/2625565122 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63415b910 con 0x7fe6340b27c0 2024-04-25T09:14:16.912 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe633e00640 1 -- 172.21.15.175:0/2625565122 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63415bed0 con 0x7fe6340b27c0 2024-04-25T09:14:16.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe633e00640 1 -- 172.21.15.175:0/2625565122 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe634074a60 con 0x7fe6340b27c0 2024-04-25T09:14:16.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.924+0000 7fe62b400640 1 -- 172.21.15.175:0/2625565122 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe62c01a070 con 0x7fe6340b27c0 2024-04-25T09:14:16.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.928+0000 7fe62b400640 1 --2- 172.21.15.175:0/2625565122 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe610066f60 0x7fe610069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:16.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.928+0000 7fe62b400640 1 -- 172.21.15.175:0/2625565122 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe62c0845c0 con 0x7fe6340b27c0 2024-04-25T09:14:16.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.928+0000 7fe632a00640 1 --2- 172.21.15.175:0/2625565122 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe610066f60 0x7fe610069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:16.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.928+0000 7fe632a00640 1 --2- 172.21.15.175:0/2625565122 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe610066f60 0x7fe610069420 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe624009f70 tx=0x7fe624009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:16.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:16.932+0000 7fe62b400640 1 -- 172.21.15.175:0/2625565122 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe62c054f70 con 0x7fe6340b27c0 2024-04-25T09:14:17.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.084+0000 7fe633e00640 1 -- 172.21.15.175:0/2625565122 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6340b3f70 con 0x7fe6340b27c0 2024-04-25T09:14:17.071 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.084+0000 7fe62b400640 1 -- 172.21.15.175:0/2625565122 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe62c059010 con 0x7fe6340b27c0 2024-04-25T09:14:17.071 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:14:17.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.084+0000 7fe633e00640 1 -- 172.21.15.175:0/2625565122 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe610066f60 msgr2=0x7fe610069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:17.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.084+0000 7fe633e00640 1 --2- 172.21.15.175:0/2625565122 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe610066f60 0x7fe610069420 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe624009f70 tx=0x7fe624009190 comp rx=0 tx=0).stop 2024-04-25T09:14:17.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.084+0000 7fe633e00640 1 -- 172.21.15.175:0/2625565122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6340b27c0 msgr2=0x7fe6340c7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:17.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.084+0000 7fe633e00640 1 --2- 172.21.15.175:0/2625565122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6340b27c0 0x7fe6340c7430 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00c730 tx=0x7fe62c00cbf0 comp rx=0 tx=0).stop 2024-04-25T09:14:17.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.084+0000 7fe633e00640 1 -- 172.21.15.175:0/2625565122 shutdown_connections 2024-04-25T09:14:17.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.084+0000 7fe633e00640 1 --2- 172.21.15.175:0/2625565122 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe610066f60 0x7fe610069420 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:17.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.084+0000 7fe633e00640 1 --2- 172.21.15.175:0/2625565122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6340b27c0 0x7fe6340c7430 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:17.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.084+0000 7fe633e00640 1 --2- 172.21.15.175:0/2625565122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe63409a090 0x7fe63415c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:17.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.084+0000 7fe633e00640 1 --2- 172.21.15.175:0/2625565122 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe634099cb0 0x7fe634153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:17.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.084+0000 7fe633e00640 1 -- 172.21.15.175:0/2625565122 >> 172.21.15.175:0/2625565122 conn(0x7fe6340b3160 msgr2=0x7fe6340b5470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:17.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.088+0000 7fe633e00640 1 -- 172.21.15.175:0/2625565122 shutdown_connections 2024-04-25T09:14:17.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.088+0000 7fe633e00640 1 -- 172.21.15.175:0/2625565122 wait complete. 2024-04-25T09:14:17.092 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:14:17.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.240+0000 7fbaf6c00640 1 Processor -- start 2024-04-25T09:14:17.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.240+0000 7fbaf6c00640 1 -- start start 2024-04-25T09:14:17.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.240+0000 7fbaf6c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbaf0145250 0x7fbaf00cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:17.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.240+0000 7fbaf6c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbaf00ce970 0x7fbaf00cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:17.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.240+0000 7fbaf6c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaf00cfd10 con 0x7fbaf01600a0 2024-04-25T09:14:17.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.240+0000 7fbaf6c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaf015f650 con 0x7fbaf00ce970 2024-04-25T09:14:17.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.240+0000 7fbaf6c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf00cfff0 con 0x7fbaf0145250 2024-04-25T09:14:17.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.244+0000 7fbaf4c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbaf00ce970 0x7fbaf00cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:17.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.244+0000 7fbaefe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbaf0145250 0x7fbaf00cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:17.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.244+0000 7fbae7400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fbaf01600a0 0x7fbaf00cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:45694/0 (socket says 172.21.15.175:45694) 2024-04-25T09:14:17.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.244+0000 7fbae7400640 1 -- 172.21.15.175:0/3789620871 learned_addr learned my addr 172.21.15.175:0/3789620871 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:17.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.244+0000 7fbaf4c00640 1 -- 172.21.15.175:0/3789620871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbaf0145250 msgr2=0x7fbaf00cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:17.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.244+0000 7fbaf4c00640 1 --2- 172.21.15.175:0/3789620871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbaf0145250 0x7fbaf00cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:17.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.244+0000 7fbaf4c00640 1 -- 172.21.15.175:0/3789620871 >> v1:172.21.15.177:6789/0 conn(0x7fbaf01600a0 legacy=0x7fbaf00cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:17.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.244+0000 7fbaf4c00640 1 -- 172.21.15.175:0/3789620871 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf015f8a0 con 0x7fbaf00ce970 2024-04-25T09:14:17.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.244+0000 7fbaf4c00640 1 --2- 172.21.15.175:0/3789620871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbaf00ce970 0x7fbaf00cee00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbae80097c0 tx=0x7fbae801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0da35cac89e36df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:17.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.244+0000 7fbaef400640 1 -- 172.21.15.175:0/3789620871 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae80ab600 con 0x7fbaf00ce970 2024-04-25T09:14:17.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.244+0000 7fbaef400640 1 -- 172.21.15.175:0/3789620871 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae80b0070 con 0x7fbaf00ce970 2024-04-25T09:14:17.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.244+0000 7fbaef400640 1 -- 172.21.15.175:0/3789620871 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae80ab9c0 con 0x7fbaf00ce970 2024-04-25T09:14:17.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf6c00640 1 -- 172.21.15.175:0/3789620871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbaf00ce970 msgr2=0x7fbaf00cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:17.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf6c00640 1 --2- 172.21.15.175:0/3789620871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbaf00ce970 0x7fbaf00cee00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbae80097c0 tx=0x7fbae801c3e0 comp rx=0 tx=0).stop 2024-04-25T09:14:17.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf6c00640 1 -- 172.21.15.175:0/3789620871 shutdown_connections 2024-04-25T09:14:17.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf6c00640 1 --2- 172.21.15.175:0/3789620871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbaf00ce970 0x7fbaf00cee00 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:17.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf6c00640 1 --2- 172.21.15.175:0/3789620871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbaf0145250 0x7fbaf00cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:17.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf6c00640 1 -- 172.21.15.175:0/3789620871 >> 172.21.15.175:0/3789620871 conn(0x7fbaf006ac50 msgr2=0x7fbaf006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:17.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf6c00640 1 -- 172.21.15.175:0/3789620871 shutdown_connections 2024-04-25T09:14:17.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf6c00640 1 -- 172.21.15.175:0/3789620871 wait complete. 2024-04-25T09:14:17.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf6c00640 1 Processor -- start 2024-04-25T09:14:17.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf6c00640 1 -- start start 2024-04-25T09:14:17.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf6c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbaf00ce970 0x7fbaf013f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:17.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf6c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbaf0145250 0x7fbaf00b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:17.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf6c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaf01600a0 0x7fbaf0165c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:17.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf6c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf0160600 con 0x7fbaf01600a0 2024-04-25T09:14:17.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf6c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf0160480 con 0x7fbaf0145250 2024-04-25T09:14:17.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf6c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf015c870 con 0x7fbaf00ce970 2024-04-25T09:14:17.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf4c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaf01600a0 0x7fbaf0165c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:17.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf4c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaf01600a0 0x7fbaf0165c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45144/0 (socket says 172.21.15.175:45144) 2024-04-25T09:14:17.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf4c00640 1 -- 172.21.15.175:0/624187485 learned_addr learned my addr 172.21.15.175:0/624187485 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:17.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaefe00640 1 --2- 172.21.15.175:0/624187485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbaf00ce970 0x7fbaf013f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:17.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbae7400640 1 --2- 172.21.15.175:0/624187485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbaf0145250 0x7fbaf00b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:17.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf4c00640 1 -- 172.21.15.175:0/624187485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbaf00ce970 msgr2=0x7fbaf013f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:17.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf4c00640 1 --2- 172.21.15.175:0/624187485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbaf00ce970 0x7fbaf013f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:17.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf4c00640 1 -- 172.21.15.175:0/624187485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbaf0145250 msgr2=0x7fbaf00b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:17.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf4c00640 1 --2- 172.21.15.175:0/624187485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbaf0145250 0x7fbaf00b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:17.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.248+0000 7fbaf4c00640 1 -- 172.21.15.175:0/624187485 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf00b3ae0 con 0x7fbaf01600a0 2024-04-25T09:14:17.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.252+0000 7fbaf4c00640 1 --2- 172.21.15.175:0/624187485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaf01600a0 0x7fbaf0165c40 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fbae80097c0 tx=0x7fbae801ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:17.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.252+0000 7fbaecc00640 1 -- 172.21.15.175:0/624187485 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae80bf410 con 0x7fbaf01600a0 2024-04-25T09:14:17.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.252+0000 7fbaecc00640 1 -- 172.21.15.175:0/624187485 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae80bf5b0 con 0x7fbaf01600a0 2024-04-25T09:14:17.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.252+0000 7fbaecc00640 1 -- 172.21.15.175:0/624187485 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae80bf980 con 0x7fbaf01600a0 2024-04-25T09:14:17.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.252+0000 7fbaf6c00640 1 -- 172.21.15.175:0/624187485 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaf00b2ed0 con 0x7fbaf01600a0 2024-04-25T09:14:17.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.252+0000 7fbaf6c00640 1 -- 172.21.15.175:0/624187485 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf00b3490 con 0x7fbaf01600a0 2024-04-25T09:14:17.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.252+0000 7fbaf6c00640 1 -- 172.21.15.175:0/624187485 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf0075160 con 0x7fbaf01600a0 2024-04-25T09:14:17.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.252+0000 7fbaecc00640 1 -- 172.21.15.175:0/624187485 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbae80bd020 con 0x7fbaf01600a0 2024-04-25T09:14:17.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.252+0000 7fbaecc00640 1 --2- 172.21.15.175:0/624187485 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbacc066f60 0x7fbacc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:17.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.252+0000 7fbaecc00640 1 -- 172.21.15.175:0/624187485 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbae811ee50 con 0x7fbaf01600a0 2024-04-25T09:14:17.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.252+0000 7fbaefe00640 1 --2- 172.21.15.175:0/624187485 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbacc066f60 0x7fbacc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:17.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.256+0000 7fbaefe00640 1 --2- 172.21.15.175:0/624187485 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbacc066f60 0x7fbacc069420 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbae00113e0 tx=0x7fbae000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:17.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.256+0000 7fbaecc00640 1 -- 172.21.15.175:0/624187485 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbae80c6020 con 0x7fbaf01600a0 2024-04-25T09:14:17.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.424+0000 7fbaf6c00640 1 -- 172.21.15.175:0/624187485 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbaf01f6800 con 0x7fbaf01600a0 2024-04-25T09:14:17.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.424+0000 7fbaecc00640 1 -- 172.21.15.175:0/624187485 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v113) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbae8016090 con 0x7fbaf01600a0 2024-04-25T09:14:17.411 INFO:teuthology.orchestra.run.smithi175.stderr:listed 0 entries 2024-04-25T09:14:17.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.424+0000 7fbaf6c00640 1 -- 172.21.15.175:0/624187485 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbacc066f60 msgr2=0x7fbacc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:17.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.424+0000 7fbaf6c00640 1 --2- 172.21.15.175:0/624187485 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbacc066f60 0x7fbacc069420 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbae00113e0 tx=0x7fbae000b040 comp rx=0 tx=0).stop 2024-04-25T09:14:17.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.424+0000 7fbaf6c00640 1 -- 172.21.15.175:0/624187485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaf01600a0 msgr2=0x7fbaf0165c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:17.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.424+0000 7fbaf6c00640 1 --2- 172.21.15.175:0/624187485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaf01600a0 0x7fbaf0165c40 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fbae80097c0 tx=0x7fbae801ac20 comp rx=0 tx=0).stop 2024-04-25T09:14:17.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.424+0000 7fbaf6c00640 1 -- 172.21.15.175:0/624187485 shutdown_connections 2024-04-25T09:14:17.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.424+0000 7fbaf6c00640 1 --2- 172.21.15.175:0/624187485 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fbacc066f60 0x7fbacc069420 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:17.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.424+0000 7fbaf6c00640 1 --2- 172.21.15.175:0/624187485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaf01600a0 0x7fbaf0165c40 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:17.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.424+0000 7fbaf6c00640 1 --2- 172.21.15.175:0/624187485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbaf0145250 0x7fbaf00b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:17.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.424+0000 7fbaf6c00640 1 --2- 172.21.15.175:0/624187485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbaf00ce970 0x7fbaf013f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:17.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.424+0000 7fbaf6c00640 1 -- 172.21.15.175:0/624187485 >> 172.21.15.175:0/624187485 conn(0x7fbaf006ac50 msgr2=0x7fbaf0143340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:17.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.424+0000 7fbaf6c00640 1 -- 172.21.15.175:0/624187485 shutdown_connections 2024-04-25T09:14:17.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.424+0000 7fbaf6c00640 1 -- 172.21.15.175:0/624187485 wait complete. 2024-04-25T09:14:17.432 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:14:17.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:17.432 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:17.574 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:14:17.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:17.575 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:14:17.594 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:14:17.594 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:17.649 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:14:17.649 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:14:17.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:17.649 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:14:17.704 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-25T09:14:17.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:14:17.705 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:14:17.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.900+0000 7f2233800640 1 Processor -- start 2024-04-25T09:14:17.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.900+0000 7f2233800640 1 -- start start 2024-04-25T09:14:17.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.900+0000 7f2233800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f222c0cf080 0x7f222c1600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:17.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.900+0000 7f2233800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222c0cfd10 con 0x7f222c145250 2024-04-25T09:14:17.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.900+0000 7f2233800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222c0cfff0 con 0x7f222c0cf6b0 2024-04-25T09:14:17.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.900+0000 7f2233800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222c1605e0 con 0x7f222c0cf080 2024-04-25T09:14:17.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.900+0000 7f2231800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f222c0cf080 0x7f222c1600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:17.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.900+0000 7f2230e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f222c145250 0x7f222c0cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:42606/0 (socket says 172.21.15.175:42606) 2024-04-25T09:14:17.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.900+0000 7f2230e00640 1 -- 172.21.15.175:0/2657196188 learned_addr learned my addr 172.21.15.175:0/2657196188 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:17.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.900+0000 7f2231800640 1 -- 172.21.15.175:0/2657196188 >> v1:172.21.15.177:6789/0 conn(0x7f222c0cf6b0 legacy=0x7f222c0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:17.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.900+0000 7f2231800640 1 -- 172.21.15.175:0/2657196188 >> v1:172.21.15.175:6789/0 conn(0x7f222c145250 legacy=0x7f222c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:17.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.900+0000 7f2231800640 1 -- 172.21.15.175:0/2657196188 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c15f8a0 con 0x7f222c0cf080 2024-04-25T09:14:17.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.900+0000 7f222be00640 1 -- 172.21.15.175:0/2657196188 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251863290 0 0) 0x7f222c0cfd10 con 0x7f222c145250 2024-04-25T09:14:17.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.904+0000 7f2231800640 1 --2- 172.21.15.175:0/2657196188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f222c0cf080 0x7f222c1600a0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f2224009dc0 tx=0x7f222401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27256d817816d43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:17.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.904+0000 7f222be00640 1 -- 172.21.15.175:0/2657196188 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22240b2070 con 0x7f222c0cf080 2024-04-25T09:14:17.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.904+0000 7f222be00640 1 -- 172.21.15.175:0/2657196188 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22240a5740 con 0x7f222c0cf080 2024-04-25T09:14:17.891 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.904+0000 7f222be00640 1 -- 172.21.15.175:0/2657196188 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22240a5b10 con 0x7f222c0cf080 2024-04-25T09:14:17.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.904+0000 7f2233800640 1 -- 172.21.15.175:0/2657196188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f222c0cf080 msgr2=0x7f222c1600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:17.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.904+0000 7f2233800640 1 --2- 172.21.15.175:0/2657196188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f222c0cf080 0x7f222c1600a0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f2224009dc0 tx=0x7f222401c880 comp rx=0 tx=0).stop 2024-04-25T09:14:17.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.904+0000 7f2233800640 1 -- 172.21.15.175:0/2657196188 shutdown_connections 2024-04-25T09:14:17.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.904+0000 7f2233800640 1 --2- 172.21.15.175:0/2657196188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f222c0cf080 0x7f222c1600a0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:17.892 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.904+0000 7f2233800640 1 -- 172.21.15.175:0/2657196188 >> 172.21.15.175:0/2657196188 conn(0x7f222c06ac50 msgr2=0x7f222c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:17.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.904+0000 7f2233800640 1 -- 172.21.15.175:0/2657196188 shutdown_connections 2024-04-25T09:14:17.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.904+0000 7f2233800640 1 -- 172.21.15.175:0/2657196188 wait complete. 2024-04-25T09:14:17.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2233800640 1 Processor -- start 2024-04-25T09:14:17.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2233800640 1 -- start start 2024-04-25T09:14:17.895 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2233800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f222c0cf080 0x7f222c15b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:17.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2233800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f222c0cf6b0 0x7f222c0ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:17.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2233800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f222c145250 0x7f222c0ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:17.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2233800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c15cc40 con 0x7f222c0cf080 2024-04-25T09:14:17.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2233800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c15cac0 con 0x7f222c145250 2024-04-25T09:14:17.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2233800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222c1697f0 con 0x7f222c0cf6b0 2024-04-25T09:14:17.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2230e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f222c0cf080 0x7f222c15b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:17.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2230e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f222c0cf080 0x7f222c15b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45172/0 (socket says 172.21.15.175:45172) 2024-04-25T09:14:17.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2230e00640 1 -- 172.21.15.175:0/1567494877 learned_addr learned my addr 172.21.15.175:0/1567494877 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:17.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2231800640 1 --2- 172.21.15.175:0/1567494877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f222c145250 0x7f222c0ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:17.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2223e00640 1 --2- 172.21.15.175:0/1567494877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f222c0cf6b0 0x7f222c0ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:17.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2230e00640 1 -- 172.21.15.175:0/1567494877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f222c0cf6b0 msgr2=0x7f222c0ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:17.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2230e00640 1 --2- 172.21.15.175:0/1567494877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f222c0cf6b0 0x7f222c0ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:17.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2230e00640 1 -- 172.21.15.175:0/1567494877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f222c145250 msgr2=0x7f222c0ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:17.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2230e00640 1 --2- 172.21.15.175:0/1567494877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f222c145250 0x7f222c0ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:17.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2230e00640 1 -- 172.21.15.175:0/1567494877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c13eda0 con 0x7f222c0cf080 2024-04-25T09:14:17.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2230e00640 1 --2- 172.21.15.175:0/1567494877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f222c0cf080 0x7f222c15b850 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f221c00c480 tx=0x7f221c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:17.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2229600640 1 -- 172.21.15.175:0/1567494877 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c018070 con 0x7f222c0cf080 2024-04-25T09:14:17.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2229600640 1 -- 172.21.15.175:0/1567494877 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221c007500 con 0x7f222c0cf080 2024-04-25T09:14:17.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2229600640 1 -- 172.21.15.175:0/1567494877 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c004a30 con 0x7f222c0cf080 2024-04-25T09:14:17.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2233800640 1 -- 172.21.15.175:0/1567494877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f222c15e290 con 0x7f222c0cf080 2024-04-25T09:14:17.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2233800640 1 -- 172.21.15.175:0/1567494877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222c13f060 con 0x7f222c0cf080 2024-04-25T09:14:17.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.908+0000 7f2233800640 1 -- 172.21.15.175:0/1567494877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222c075160 con 0x7f222c0cf080 2024-04-25T09:14:17.897 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.912+0000 7f2229600640 1 -- 172.21.15.175:0/1567494877 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f221c004bd0 con 0x7f222c0cf080 2024-04-25T09:14:17.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.912+0000 7f2229600640 1 --2- 172.21.15.175:0/1567494877 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2208066f60 0x7f2208069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:17.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.912+0000 7f2229600640 1 -- 172.21.15.175:0/1567494877 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f221c0842e0 con 0x7f222c0cf080 2024-04-25T09:14:17.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.912+0000 7f2223e00640 1 --2- 172.21.15.175:0/1567494877 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2208066f60 0x7f2208069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:17.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.912+0000 7f2223e00640 1 --2- 172.21.15.175:0/1567494877 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2208066f60 0x7f2208069420 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f222c167480 tx=0x7f2214009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:17.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:17.916+0000 7f2229600640 1 -- 172.21.15.175:0/1567494877 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f221c0552e0 con 0x7f222c0cf080 2024-04-25T09:14:18.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.104+0000 7f2233800640 1 -- 172.21.15.175:0/1567494877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f222c06c2d0 con 0x7f222c0cf080 2024-04-25T09:14:18.090 INFO:tasks.ceph.mon.a.smithi175.stderr:2024-04-25T09:14:18.104+0000 7feb0ee00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:14:18.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.104+0000 7f2229600640 1 -- 172.21.15.175:0/1567494877 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v94) v1 ==== 161+0+0 (secure 0 0 0) 0x7f221c0840c0 con 0x7f222c0cf080 2024-04-25T09:14:18.093 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:14:18.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.108+0000 7f2233800640 1 -- 172.21.15.175:0/1567494877 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2208066f60 msgr2=0x7f2208069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:18.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.108+0000 7f2233800640 1 --2- 172.21.15.175:0/1567494877 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2208066f60 0x7f2208069420 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f222c167480 tx=0x7f2214009040 comp rx=0 tx=0).stop 2024-04-25T09:14:18.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.108+0000 7f2233800640 1 -- 172.21.15.175:0/1567494877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f222c0cf080 msgr2=0x7f222c15b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:18.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.108+0000 7f2233800640 1 --2- 172.21.15.175:0/1567494877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f222c0cf080 0x7f222c15b850 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f221c00c480 tx=0x7f221c00c940 comp rx=0 tx=0).stop 2024-04-25T09:14:18.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.108+0000 7f2233800640 1 -- 172.21.15.175:0/1567494877 shutdown_connections 2024-04-25T09:14:18.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.108+0000 7f2233800640 1 --2- 172.21.15.175:0/1567494877 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2208066f60 0x7f2208069420 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:18.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.108+0000 7f2233800640 1 --2- 172.21.15.175:0/1567494877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f222c145250 0x7f222c0ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:18.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.108+0000 7f2233800640 1 --2- 172.21.15.175:0/1567494877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f222c0cf6b0 0x7f222c0ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:18.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.108+0000 7f2233800640 1 --2- 172.21.15.175:0/1567494877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f222c0cf080 0x7f222c15b850 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:18.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.108+0000 7f2233800640 1 -- 172.21.15.175:0/1567494877 >> 172.21.15.175:0/1567494877 conn(0x7f222c06ac50 msgr2=0x7f222c06d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:18.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.108+0000 7f2233800640 1 -- 172.21.15.175:0/1567494877 shutdown_connections 2024-04-25T09:14:18.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.108+0000 7f2233800640 1 -- 172.21.15.175:0/1567494877 wait complete. 2024-04-25T09:14:18.108 INFO:tasks.ceph.mds.c.smithi175.stderr: -8128> 2024-04-25T09:14:09.296+0000 7f850f800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:14:18.118 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:14:18.121 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:14:18.158 INFO:tasks.ceph.mds.c.smithi175.stdout:starting mds.c at 2024-04-25T09:14:18.164 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2024-04-25T09:14:18.164 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2024-04-25T09:14:18.164 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:14:18.165 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2024-04-25T09:14:18.165 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.165 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2024-04-25T09:14:18.165 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.165 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2024-04-25T09:14:18.165 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.165 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2024-04-25T09:14:18.165 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2024-04-25T09:14:18.165 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.165 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2024-04-25T09:14:18.165 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2024-04-25T09:14:18.165 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.166 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:14:18.166 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2024-04-25T09:14:18.166 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.166 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:14:18.166 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:14:18.166 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.166 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2024-04-25T09:14:18.166 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.166 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2024-04-25T09:14:18.166 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2024-04-25T09:14:18.166 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:14:18.166 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:14:18.166 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2024-04-25T09:14:18.166 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:14:18.167 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2024-04-25T09:14:18.167 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:14:18.167 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:14:18.167 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2024-04-25T09:14:18.167 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.167 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:14:18.167 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.167 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2024-04-25T09:14:18.167 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.167 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2024-04-25T09:14:18.167 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.167 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2024-04-25T09:14:18.167 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2024-04-25T09:14:18.167 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2024-04-25T09:14:18.167 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.175,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]" 2024-04-25T09:14:18.167 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on skipped message = False 2024-04-25T09:14:18.168 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = 8caed986-ca08-40e2-b5a5-12e2aade6223 2024-04-25T09:14:18.168 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.168 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2024-04-25T09:14:18.168 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2024-04-25T09:14:18.168 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.168 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2024-04-25T09:14:18.168 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2024-04-25T09:14:18.168 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:14:18.168 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.168 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2024-04-25T09:14:18.168 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2024-04-25T09:14:18.168 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.168 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2024-04-25T09:14:18.168 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2024-04-25T09:14:18.168 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2024-04-25T09:14:18.169 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug trim objects = true 2024-04-25T09:14:18.169 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.169 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2024-04-25T09:14:18.169 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2024-04-25T09:14:18.169 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.169 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:14:18.169 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.169 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2024-04-25T09:14:18.169 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.169 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2024-04-25T09:14:18.169 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.169 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:14:18.169 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2024-04-25T09:14:18.170 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.170 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2024-04-25T09:14:18.170 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2024-04-25T09:14:18.170 INFO:teuthology.orchestra.run.smithi175.stdout: bdev async discard = True 2024-04-25T09:14:18.170 INFO:teuthology.orchestra.run.smithi175.stdout: bdev enable discard = True 2024-04-25T09:14:18.170 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore allocator = bitmap 2024-04-25T09:14:18.170 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2024-04-25T09:14:18.170 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2024-04-25T09:14:18.170 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 1/20 2024-04-25T09:14:18.170 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 1/20 2024-04-25T09:14:18.170 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:18.170 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2024-04-25T09:14:18.170 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 4/10 2024-04-25T09:14:18.170 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:14:18.170 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2024-04-25T09:14:18.171 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:14:18.171 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:14:18.171 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2024-04-25T09:14:18.171 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-04-25T09:14:18.171 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.171 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2024-04-25T09:14:18.171 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:18.171 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2024-04-25T09:14:18.171 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-25T09:14:18.171 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-25T09:14:18.171 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:14:18.171 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:14:18.171 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2024-04-25T09:14:18.171 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.171 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2024-04-25T09:14:18.171 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:18.172 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-25T09:14:18.172 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2024-04-25T09:14:18.172 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-25T09:14:18.172 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2024-04-25T09:14:18.172 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2024-04-25T09:14:18.172 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:14:18.172 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2024-04-25T09:14:18.172 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2024-04-25T09:14:18.172 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:14:18.172 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.172 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:14:18.172 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:14:18.172 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:14:18.172 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.172 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:14:18.172 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:14:18.172 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:14:18.173 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.173 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2024-04-25T09:14:18.173 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:14:18.173 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.173 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:14:18.173 INFO:teuthology.orchestra.run.smithi175.stdout: mon op complaint time = 120 2024-04-25T09:14:18.173 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.173 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2024-04-25T09:14:18.173 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2024-04-25T09:14:18.173 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2024-04-25T09:14:18.173 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2024-04-25T09:14:18.173 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:14:18.173 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:14:18.173 INFO:teuthology.orchestra.run.smithi175.stdout: client mount timeout = 600 2024-04-25T09:14:18.173 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2024-04-25T09:14:18.174 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:18.174 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = "" 2024-04-25T09:14:18.174 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-04-25T09:14:18.174 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-04-25T09:14:18.174 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2024-04-25T09:14:18.174 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2024-04-25T09:14:18.174 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2024-04-25T09:14:18.174 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-04-25T09:14:18.174 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2024-04-25T09:14:18.174 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-04-25T09:14:18.174 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2024-04-25T09:14:18.174 INFO:teuthology.orchestra.run.smithi175.stdout:[mds] 2024-04-25T09:14:18.174 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds = 20 2024-04-25T09:14:18.174 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds balancer = 20 2024-04-25T09:14:18.174 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:18.175 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug frag = True 2024-04-25T09:14:18.175 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug scatterstat = True 2024-04-25T09:14:18.175 INFO:teuthology.orchestra.run.smithi175.stdout: mds op complaint time = 180 2024-04-25T09:14:18.175 INFO:teuthology.orchestra.run.smithi175.stdout: mds verify scatter = False 2024-04-25T09:14:18.175 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-04-25T09:14:18.175 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-04-25T09:14:18.175 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-04-25T09:14:18.175 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2024-04-25T09:14:18.175 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2024-04-25T09:14:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:14:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2024-04-25T09:14:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2024-04-25T09:14:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2024-04-25T09:14:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2024-04-25T09:14:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2024-04-25T09:14:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2024-04-25T09:14:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2024-04-25T09:14:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:14:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2024-04-25T09:14:18.176 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:14:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:14:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2024-04-25T09:14:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2024-04-25T09:14:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2024-04-25T09:14:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:14:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:14:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2024-04-25T09:14:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:14:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2024-04-25T09:14:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:14:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:14:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: mon_allow_pool_size_one = true 2024-04-25T09:14:18.177 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.178 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:14:18.178 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.178 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2024-04-25T09:14:18.178 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.178 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2024-04-25T09:14:18.178 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.178 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2024-04-25T09:14:18.178 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2024-04-25T09:14:18.178 INFO:teuthology.orchestra.run.smithi177.stdout: mon health detail to clog = false 2024-04-25T09:14:18.178 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = "172.21.15.175,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]" 2024-04-25T09:14:18.178 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on skipped message = False 2024-04-25T09:14:18.178 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = 8caed986-ca08-40e2-b5a5-12e2aade6223 2024-04-25T09:14:18.178 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.179 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2024-04-25T09:14:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2024-04-25T09:14:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2024-04-25T09:14:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2024-04-25T09:14:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:14:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2024-04-25T09:14:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2024-04-25T09:14:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2024-04-25T09:14:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2024-04-25T09:14:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2024-04-25T09:14:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug trim objects = true 2024-04-25T09:14:18.179 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2024-04-25T09:14:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2024-04-25T09:14:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:14:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2024-04-25T09:14:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2024-04-25T09:14:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:14:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2024-04-25T09:14:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2024-04-25T09:14:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2024-04-25T09:14:18.180 INFO:teuthology.orchestra.run.smithi177.stdout: bdev async discard = True 2024-04-25T09:14:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: bdev enable discard = True 2024-04-25T09:14:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore allocator = bitmap 2024-04-25T09:14:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2024-04-25T09:14:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2024-04-25T09:14:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 1/20 2024-04-25T09:14:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 1/20 2024-04-25T09:14:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 20 2024-04-25T09:14:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 4/10 2024-04-25T09:14:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:14:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2024-04-25T09:14:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:14:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:14:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = bluestore 2024-04-25T09:14:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2024-04-25T09:14:18.181 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.181 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2024-04-25T09:14:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2024-04-25T09:14:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-04-25T09:14:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-04-25T09:14:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:14:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:14:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2024-04-25T09:14:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.182 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2024-04-25T09:14:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-04-25T09:14:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2024-04-25T09:14:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-04-25T09:14:18.182 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2024-04-25T09:14:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2024-04-25T09:14:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:14:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2024-04-25T09:14:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2024-04-25T09:14:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:14:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:14:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:14:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:14:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:14:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:14:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:14:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.183 INFO:teuthology.orchestra.run.smithi177.stdout: # 1m isn't quite enough 2024-04-25T09:14:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:14:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:14:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: mon op complaint time = 120 2024-04-25T09:14:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.184 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2024-04-25T09:14:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2024-04-25T09:14:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2024-04-25T09:14:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2024-04-25T09:14:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:14:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:14:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: client mount timeout = 600 2024-04-25T09:14:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: debug client = 20 2024-04-25T09:14:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:18.184 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = "" 2024-04-25T09:14:18.185 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2024-04-25T09:14:18.185 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2024-04-25T09:14:18.185 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2024-04-25T09:14:18.185 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.b] 2024-04-25T09:14:18.185 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.c] 2024-04-25T09:14:18.185 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2024-04-25T09:14:18.185 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2024-04-25T09:14:18.185 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2024-04-25T09:14:18.185 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2024-04-25T09:14:18.185 INFO:teuthology.orchestra.run.smithi177.stdout:[mds] 2024-04-25T09:14:18.185 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds = 20 2024-04-25T09:14:18.185 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds balancer = 20 2024-04-25T09:14:18.185 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:18.185 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug frag = True 2024-04-25T09:14:18.185 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug scatterstat = True 2024-04-25T09:14:18.185 INFO:teuthology.orchestra.run.smithi177.stdout: mds op complaint time = 180 2024-04-25T09:14:18.185 INFO:teuthology.orchestra.run.smithi177.stdout: mds verify scatter = False 2024-04-25T09:14:18.186 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2024-04-25T09:14:18.186 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2024-04-25T09:14:18.186 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2024-04-25T09:14:18.188 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:14:18.232 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:14:18.270 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2024-04-25T09:14:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2024-04-25T09:14:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:14:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2024-04-25T09:14:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2024-04-25T09:14:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2024-04-25T09:14:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2024-04-25T09:14:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2024-04-25T09:14:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2024-04-25T09:14:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2024-04-25T09:14:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.271 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:14:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2024-04-25T09:14:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:14:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:14:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2024-04-25T09:14:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2024-04-25T09:14:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2024-04-25T09:14:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:14:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:14:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2024-04-25T09:14:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:14:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2024-04-25T09:14:18.272 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:14:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:14:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2024-04-25T09:14:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:14:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2024-04-25T09:14:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2024-04-25T09:14:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2024-04-25T09:14:18.273 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2024-04-25T09:14:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2024-04-25T09:14:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.175,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]" 2024-04-25T09:14:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on skipped message = False 2024-04-25T09:14:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = 8caed986-ca08-40e2-b5a5-12e2aade6223 2024-04-25T09:14:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.274 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2024-04-25T09:14:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2024-04-25T09:14:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2024-04-25T09:14:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2024-04-25T09:14:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:14:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2024-04-25T09:14:18.274 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2024-04-25T09:14:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2024-04-25T09:14:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2024-04-25T09:14:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2024-04-25T09:14:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug trim objects = true 2024-04-25T09:14:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2024-04-25T09:14:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2024-04-25T09:14:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:14:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2024-04-25T09:14:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2024-04-25T09:14:18.275 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:14:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2024-04-25T09:14:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2024-04-25T09:14:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2024-04-25T09:14:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: bdev async discard = True 2024-04-25T09:14:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: bdev enable discard = True 2024-04-25T09:14:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore allocator = bitmap 2024-04-25T09:14:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2024-04-25T09:14:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2024-04-25T09:14:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 1/20 2024-04-25T09:14:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 1/20 2024-04-25T09:14:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:18.276 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2024-04-25T09:14:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 4/10 2024-04-25T09:14:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:14:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2024-04-25T09:14:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:14:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:14:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2024-04-25T09:14:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-04-25T09:14:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.277 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2024-04-25T09:14:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2024-04-25T09:14:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-25T09:14:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-25T09:14:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:14:18.277 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:14:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2024-04-25T09:14:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.278 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2024-04-25T09:14:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-25T09:14:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2024-04-25T09:14:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-25T09:14:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2024-04-25T09:14:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2024-04-25T09:14:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:14:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2024-04-25T09:14:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2024-04-25T09:14:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:14:18.278 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:14:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:14:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:14:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:14:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:14:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:14:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2024-04-25T09:14:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:14:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:14:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: mon op complaint time = 120 2024-04-25T09:14:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:18.279 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2024-04-25T09:14:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2024-04-25T09:14:18.279 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2024-04-25T09:14:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2024-04-25T09:14:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:14:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:14:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: client mount timeout = 600 2024-04-25T09:14:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2024-04-25T09:14:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = "" 2024-04-25T09:14:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-04-25T09:14:18.280 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-04-25T09:14:18.280 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2024-04-25T09:14:18.280 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2024-04-25T09:14:18.280 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2024-04-25T09:14:18.280 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-04-25T09:14:18.280 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2024-04-25T09:14:18.280 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-04-25T09:14:18.280 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2024-04-25T09:14:18.280 INFO:teuthology.orchestra.run.smithi175.stdout:[mds] 2024-04-25T09:14:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds = 20 2024-04-25T09:14:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds balancer = 20 2024-04-25T09:14:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug frag = True 2024-04-25T09:14:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug scatterstat = False 2024-04-25T09:14:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: mds op complaint time = 180 2024-04-25T09:14:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: mds verify scatter = False 2024-04-25T09:14:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-04-25T09:14:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-04-25T09:14:18.281 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-04-25T09:14:18.281 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2024-04-25T09:14:18.282 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2024-04-25T09:14:18.282 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:14:18.282 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2024-04-25T09:14:18.282 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.282 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2024-04-25T09:14:18.282 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.282 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2024-04-25T09:14:18.282 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.282 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2024-04-25T09:14:18.282 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2024-04-25T09:14:18.282 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.282 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2024-04-25T09:14:18.282 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2024-04-25T09:14:18.282 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.282 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:14:18.283 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2024-04-25T09:14:18.283 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.283 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:14:18.283 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:14:18.283 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.283 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2024-04-25T09:14:18.283 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.283 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2024-04-25T09:14:18.283 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2024-04-25T09:14:18.283 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:14:18.283 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:14:18.283 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2024-04-25T09:14:18.283 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:14:18.283 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2024-04-25T09:14:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:14:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:14:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: mon_allow_pool_size_one = true 2024-04-25T09:14:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:14:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2024-04-25T09:14:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2024-04-25T09:14:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2024-04-25T09:14:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2024-04-25T09:14:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: mon health detail to clog = false 2024-04-25T09:14:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = "172.21.15.175,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]" 2024-04-25T09:14:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on skipped message = False 2024-04-25T09:14:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = 8caed986-ca08-40e2-b5a5-12e2aade6223 2024-04-25T09:14:18.285 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.285 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2024-04-25T09:14:18.285 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2024-04-25T09:14:18.285 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.285 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2024-04-25T09:14:18.285 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2024-04-25T09:14:18.285 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:14:18.285 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.285 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2024-04-25T09:14:18.285 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2024-04-25T09:14:18.285 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.285 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2024-04-25T09:14:18.285 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2024-04-25T09:14:18.285 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2024-04-25T09:14:18.285 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug trim objects = true 2024-04-25T09:14:18.286 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.286 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2024-04-25T09:14:18.286 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2024-04-25T09:14:18.286 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.286 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:14:18.286 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.286 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2024-04-25T09:14:18.286 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.286 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2024-04-25T09:14:18.286 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.286 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:14:18.286 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2024-04-25T09:14:18.286 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.286 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2024-04-25T09:14:18.286 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2024-04-25T09:14:18.287 INFO:teuthology.orchestra.run.smithi177.stdout: bdev async discard = True 2024-04-25T09:14:18.287 INFO:teuthology.orchestra.run.smithi177.stdout: bdev enable discard = True 2024-04-25T09:14:18.287 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore allocator = bitmap 2024-04-25T09:14:18.287 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2024-04-25T09:14:18.287 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2024-04-25T09:14:18.287 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 1/20 2024-04-25T09:14:18.287 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 1/20 2024-04-25T09:14:18.287 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:18.287 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 20 2024-04-25T09:14:18.287 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 4/10 2024-04-25T09:14:18.287 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:14:18.287 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2024-04-25T09:14:18.287 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:14:18.287 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:14:18.287 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = bluestore 2024-04-25T09:14:18.287 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2024-04-25T09:14:18.287 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.288 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2024-04-25T09:14:18.288 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:18.288 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2024-04-25T09:14:18.288 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-04-25T09:14:18.288 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-04-25T09:14:18.288 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:14:18.288 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:14:18.288 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2024-04-25T09:14:18.288 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.288 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2024-04-25T09:14:18.288 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:18.288 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-04-25T09:14:18.288 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2024-04-25T09:14:18.288 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-04-25T09:14:18.288 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2024-04-25T09:14:18.288 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2024-04-25T09:14:18.289 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:14:18.289 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2024-04-25T09:14:18.289 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2024-04-25T09:14:18.289 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:14:18.289 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.289 INFO:teuthology.orchestra.run.smithi177.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:14:18.289 INFO:teuthology.orchestra.run.smithi177.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:14:18.289 INFO:teuthology.orchestra.run.smithi177.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:14:18.289 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.290 INFO:teuthology.orchestra.run.smithi177.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:14:18.290 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:14:18.290 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:14:18.290 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.290 INFO:teuthology.orchestra.run.smithi177.stdout: # 1m isn't quite enough 2024-04-25T09:14:18.290 INFO:teuthology.orchestra.run.smithi177.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:14:18.290 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.290 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:14:18.290 INFO:teuthology.orchestra.run.smithi177.stdout: mon op complaint time = 120 2024-04-25T09:14:18.290 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:18.290 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2024-04-25T09:14:18.290 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2024-04-25T09:14:18.290 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2024-04-25T09:14:18.290 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2024-04-25T09:14:18.291 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:14:18.291 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:14:18.291 INFO:teuthology.orchestra.run.smithi177.stdout: client mount timeout = 600 2024-04-25T09:14:18.291 INFO:teuthology.orchestra.run.smithi177.stdout: debug client = 20 2024-04-25T09:14:18.291 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:18.291 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = "" 2024-04-25T09:14:18.291 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2024-04-25T09:14:18.291 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2024-04-25T09:14:18.291 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2024-04-25T09:14:18.291 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.b] 2024-04-25T09:14:18.291 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.c] 2024-04-25T09:14:18.291 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2024-04-25T09:14:18.291 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2024-04-25T09:14:18.291 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2024-04-25T09:14:18.292 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2024-04-25T09:14:18.292 INFO:teuthology.orchestra.run.smithi177.stdout:[mds] 2024-04-25T09:14:18.292 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds = 20 2024-04-25T09:14:18.292 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds balancer = 20 2024-04-25T09:14:18.292 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:18.292 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug frag = True 2024-04-25T09:14:18.292 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug scatterstat = False 2024-04-25T09:14:18.292 INFO:teuthology.orchestra.run.smithi177.stdout: mds op complaint time = 180 2024-04-25T09:14:18.292 INFO:teuthology.orchestra.run.smithi177.stdout: mds verify scatter = False 2024-04-25T09:14:18.292 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2024-04-25T09:14:18.292 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2024-04-25T09:14:18.292 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2024-04-25T09:14:18.293 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000001.00000000 bravo_head 2024-04-25T09:14:18.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f45618ee080 1 Processor -- start 2024-04-25T09:14:18.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f45618ee080 1 -- start start 2024-04-25T09:14:18.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f45618ee080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecd7edc80 0x563ecd816f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:18.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f45618ee080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ecd832490 0x563ecd817450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:18.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f45618ee080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ecd8bf650 0x563ecd82b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:18.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f45618ee080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ecd7909f0 con 0x563ecd7edc80 2024-04-25T09:14:18.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f45618ee080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ecd794950 con 0x563ecd832490 2024-04-25T09:14:18.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f45618ee080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ecd81c040 con 0x563ecd8bf650 2024-04-25T09:14:18.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f455ec00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecd7edc80 0x563ecd816f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:18.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f455ec00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecd7edc80 0x563ecd816f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45190/0 (socket says 172.21.15.175:45190) 2024-04-25T09:14:18.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f455ec00640 1 -- 172.21.15.175:0/2741126398 learned_addr learned my addr 172.21.15.175:0/2741126398 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:18.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f455e200640 1 --2- 172.21.15.175:0/2741126398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ecd832490 0x563ecd817450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:18.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f455f600640 1 --2- 172.21.15.175:0/2741126398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ecd8bf650 0x563ecd82b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:18.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f455ec00640 1 -- 172.21.15.175:0/2741126398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ecd8bf650 msgr2=0x563ecd82b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:18.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f455ec00640 1 --2- 172.21.15.175:0/2741126398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ecd8bf650 0x563ecd82b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:18.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f455ec00640 1 -- 172.21.15.175:0/2741126398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ecd832490 msgr2=0x563ecd817450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:18.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f455ec00640 1 --2- 172.21.15.175:0/2741126398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ecd832490 0x563ecd817450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:18.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f455ec00640 1 -- 172.21.15.175:0/2741126398 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ecd8befc0 con 0x563ecd7edc80 2024-04-25T09:14:18.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.400+0000 7f455ec00640 1 --2- 172.21.15.175:0/2741126398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecd7edc80 0x563ecd816f10 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f455000a530 tx=0x7f4550003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a181377e4ec23746 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:18.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f455ce00640 1 -- 172.21.15.175:0/2741126398 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45500af040 con 0x563ecd7edc80 2024-04-25T09:14:18.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f455ce00640 1 -- 172.21.15.175:0/2741126398 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45500b9070 con 0x563ecd7edc80 2024-04-25T09:14:18.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f455ce00640 1 -- 172.21.15.175:0/2741126398 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45500aa9b0 con 0x563ecd7edc80 2024-04-25T09:14:18.390 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f45618ee080 1 -- 172.21.15.175:0/2741126398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecd7edc80 msgr2=0x563ecd816f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:18.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f45618ee080 1 --2- 172.21.15.175:0/2741126398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecd7edc80 0x563ecd816f10 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f455000a530 tx=0x7f4550003030 comp rx=0 tx=0).stop 2024-04-25T09:14:18.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f45618ee080 1 -- 172.21.15.175:0/2741126398 shutdown_connections 2024-04-25T09:14:18.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f45618ee080 1 --2- 172.21.15.175:0/2741126398 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ecd8bf650 0x563ecd82b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:18.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f45618ee080 1 --2- 172.21.15.175:0/2741126398 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ecd832490 0x563ecd817450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:18.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f45618ee080 1 --2- 172.21.15.175:0/2741126398 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecd7edc80 0x563ecd816f10 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:18.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f45618ee080 1 -- 172.21.15.175:0/2741126398 >> 172.21.15.175:0/2741126398 conn(0x563ecd7e9420 msgr2=0x563ecd8ca890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:18.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f45618ee080 1 -- 172.21.15.175:0/2741126398 shutdown_connections 2024-04-25T09:14:18.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f45618ee080 1 -- 172.21.15.175:0/2741126398 wait complete. 2024-04-25T09:14:18.391 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f45618ee080 1 Processor -- start 2024-04-25T09:14:18.392 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f45618ee080 1 -- start start 2024-04-25T09:14:18.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f45618ee080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecd7edc80 0x563ecd8bc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:18.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f45618ee080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ecd832490 0x563ecd8124c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:18.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f45618ee080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ecd8bf650 0x563ecd7eb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:18.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f45618ee080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ecd7e9c60 con 0x563ecd7edc80 2024-04-25T09:14:18.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f45618ee080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ecd7e99c0 con 0x563ecd832490 2024-04-25T09:14:18.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.404+0000 7f45618ee080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ecd8cb0f0 con 0x563ecd8bf650 2024-04-25T09:14:18.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.408+0000 7f455ec00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecd7edc80 0x563ecd8bc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:18.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.408+0000 7f455ec00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecd7edc80 0x563ecd8bc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45204/0 (socket says 172.21.15.175:45204) 2024-04-25T09:14:18.394 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.408+0000 7f455ec00640 1 -- 172.21.15.175:0/1822920773 learned_addr learned my addr 172.21.15.175:0/1822920773 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:18.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.408+0000 7f455f600640 1 --2- 172.21.15.175:0/1822920773 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ecd8bf650 0x563ecd7eb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:18.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.408+0000 7f455e200640 1 --2- 172.21.15.175:0/1822920773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ecd832490 0x563ecd8124c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:18.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.408+0000 7f455ec00640 1 -- 172.21.15.175:0/1822920773 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ecd8bf650 msgr2=0x563ecd7eb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:18.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.408+0000 7f455ec00640 1 --2- 172.21.15.175:0/1822920773 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563ecd8bf650 0x563ecd7eb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:18.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.408+0000 7f455ec00640 1 -- 172.21.15.175:0/1822920773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ecd832490 msgr2=0x563ecd8124c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:18.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.408+0000 7f455ec00640 1 --2- 172.21.15.175:0/1822920773 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563ecd832490 0x563ecd8124c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:18.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.408+0000 7f455ec00640 1 -- 172.21.15.175:0/1822920773 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ecd812fd0 con 0x563ecd7edc80 2024-04-25T09:14:18.395 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.408+0000 7f455ec00640 1 --2- 172.21.15.175:0/1822920773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecd7edc80 0x563ecd8bc050 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f4550005880 tx=0x7f4550018100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:18.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.408+0000 7f4557400640 1 -- 172.21.15.175:0/1822920773 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45500af030 con 0x563ecd7edc80 2024-04-25T09:14:18.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.408+0000 7f4557400640 1 -- 172.21.15.175:0/1822920773 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45500b4410 con 0x563ecd7edc80 2024-04-25T09:14:18.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.408+0000 7f45618ee080 1 -- 172.21.15.175:0/1822920773 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563ecd813270 con 0x563ecd7edc80 2024-04-25T09:14:18.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.408+0000 7f4557400640 1 -- 172.21.15.175:0/1822920773 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45500b47e0 con 0x563ecd7edc80 2024-04-25T09:14:18.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.408+0000 7f45618ee080 1 -- 172.21.15.175:0/1822920773 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ecd8137b0 con 0x563ecd7edc80 2024-04-25T09:14:18.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.408+0000 7f4557400640 1 -- 172.21.15.175:0/1822920773 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f45500b4980 con 0x563ecd7edc80 2024-04-25T09:14:18.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.408+0000 7f4557400640 1 --2- 172.21.15.175:0/1822920773 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4540065970 0x7f4540067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:18.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.412+0000 7f4557400640 1 -- 172.21.15.175:0/1822920773 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4550120450 con 0x563ecd7edc80 2024-04-25T09:14:18.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.412+0000 7f455e200640 1 --2- 172.21.15.175:0/1822920773 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4540065970 0x7f4540067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:18.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.412+0000 7f45618ee080 1 --2- 172.21.15.175:0/1822920773 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x563ecd813ef0 0x563ecd82dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:18.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.412+0000 7f45618ee080 1 -- 172.21.15.175:0/1822920773 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:1 16.7 16:e2e07930:::10000000001.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114) v9 -- 0x563ecd8bc590 con 0x563ecd813ef0 2024-04-25T09:14:18.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.412+0000 7f455f600640 1 --2- 172.21.15.175:0/1822920773 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x563ecd813ef0 0x563ecd82dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:18.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.412+0000 7f455e200640 1 --2- 172.21.15.175:0/1822920773 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4540065970 0x7f4540067e30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f454c000f70 tx=0x7f454c010040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:18.398 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.412+0000 7f455f600640 1 --2- 172.21.15.175:0/1822920773 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x563ecd813ef0 0x563ecd82dbe0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:18.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.416+0000 7f455f600640 1 -- 172.21.15.175:0/1822920773 <== osd.3 v2:172.21.15.175:6816/4078277957 1 ==== osd_op_reply(1 10000000001.00000000 [omap-rm-keys] v114'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f4558003950 con 0x563ecd813ef0 2024-04-25T09:14:18.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.416+0000 7f45618ee080 1 -- 172.21.15.175:0/1822920773 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x563ecd813ef0 msgr2=0x563ecd82dbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:18.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.416+0000 7f45618ee080 1 --2- 172.21.15.175:0/1822920773 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x563ecd813ef0 0x563ecd82dbe0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:18.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.416+0000 7f45618ee080 1 -- 172.21.15.175:0/1822920773 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4540065970 msgr2=0x7f4540067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:18.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.416+0000 7f45618ee080 1 --2- 172.21.15.175:0/1822920773 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4540065970 0x7f4540067e30 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f454c000f70 tx=0x7f454c010040 comp rx=0 tx=0).stop 2024-04-25T09:14:18.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.416+0000 7f45618ee080 1 -- 172.21.15.175:0/1822920773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecd7edc80 msgr2=0x563ecd8bc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:18.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.416+0000 7f45618ee080 1 --2- 172.21.15.175:0/1822920773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563ecd7edc80 0x563ecd8bc050 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f4550005880 tx=0x7f4550018100 comp rx=0 tx=0).stop 2024-04-25T09:14:18.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.416+0000 7f455f600640 1 -- 172.21.15.175:0/1822920773 reap_dead start 2024-04-25T09:14:18.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.416+0000 7f45618ee080 1 -- 172.21.15.175:0/1822920773 shutdown_connections 2024-04-25T09:14:18.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.416+0000 7f45618ee080 1 -- 172.21.15.175:0/1822920773 >> 172.21.15.175:0/1822920773 conn(0x563ecd7e9420 msgr2=0x563ecd819ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:18.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.416+0000 7f45618ee080 1 -- 172.21.15.175:0/1822920773 shutdown_connections 2024-04-25T09:14:18.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.416+0000 7f45618ee080 1 -- 172.21.15.175:0/1822920773 wait complete. 2024-04-25T09:14:18.407 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T09:14:18.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.604+0000 7fb773e00640 1 Processor -- start 2024-04-25T09:14:18.590 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.604+0000 7fb773e00640 1 -- start start 2024-04-25T09:14:18.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.604+0000 7fb773e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb774099cb0 0x7fb77406c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:18.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.604+0000 7fb773e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb7740b27c0 0x7fb77415d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:18.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.604+0000 7fb773e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77406cef0 con 0x7fb77409a090 2024-04-25T09:14:18.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.604+0000 7fb773e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7740cf8b0 con 0x7fb7740b27c0 2024-04-25T09:14:18.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.604+0000 7fb773e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77406ccb0 con 0x7fb774099cb0 2024-04-25T09:14:18.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.604+0000 7fb773400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb7740b27c0 0x7fb77415d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:18.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.604+0000 7fb76a000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb77409a090 0x7fb7740cbcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:42626/0 (socket says 172.21.15.175:42626) 2024-04-25T09:14:18.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.604+0000 7fb76a000640 1 -- 172.21.15.175:0/45078395 learned_addr learned my addr 172.21.15.175:0/45078395 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:18.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.604+0000 7fb772a00640 1 --2- 172.21.15.175:0/45078395 >> v2:172.21.15.177:3300/0 conn(0x7fb774099cb0 0x7fb77406c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:18.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.604+0000 7fb773400640 1 -- 172.21.15.175:0/45078395 >> v2:172.21.15.177:3300/0 conn(0x7fb774099cb0 msgr2=0x7fb77406c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:18.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.604+0000 7fb773400640 1 --2- 172.21.15.175:0/45078395 >> v2:172.21.15.177:3300/0 conn(0x7fb774099cb0 0x7fb77406c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:18.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.604+0000 7fb773400640 1 -- 172.21.15.175:0/45078395 >> v1:172.21.15.175:6789/0 conn(0x7fb77409a090 legacy=0x7fb7740cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:18.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.604+0000 7fb773400640 1 -- 172.21.15.175:0/45078395 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7740cfae0 con 0x7fb7740b27c0 2024-04-25T09:14:18.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.608+0000 7fb773400640 1 --2- 172.21.15.175:0/45078395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7740b27c0 0x7fb77415d830 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fb774072a10 tx=0x7fb76c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dad8ab502267011 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:18.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.608+0000 7fb772000640 1 -- 172.21.15.175:0/45078395 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0b2070 con 0x7fb7740b27c0 2024-04-25T09:14:18.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.608+0000 7fb772000640 1 -- 172.21.15.175:0/45078395 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c0a5760 con 0x7fb7740b27c0 2024-04-25T09:14:18.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.608+0000 7fb772000640 1 -- 172.21.15.175:0/45078395 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0a5b30 con 0x7fb7740b27c0 2024-04-25T09:14:18.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.608+0000 7fb773e00640 1 -- 172.21.15.175:0/45078395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7740b27c0 msgr2=0x7fb77415d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:18.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.608+0000 7fb773e00640 1 --2- 172.21.15.175:0/45078395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7740b27c0 0x7fb77415d830 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fb774072a10 tx=0x7fb76c01c8a0 comp rx=0 tx=0).stop 2024-04-25T09:14:18.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.608+0000 7fb773e00640 1 -- 172.21.15.175:0/45078395 shutdown_connections 2024-04-25T09:14:18.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.608+0000 7fb773e00640 1 --2- 172.21.15.175:0/45078395 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7740b27c0 0x7fb77415d830 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:18.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.608+0000 7fb773e00640 1 --2- 172.21.15.175:0/45078395 >> v2:172.21.15.177:3300/0 conn(0x7fb774099cb0 0x7fb77406c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:18.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.608+0000 7fb773e00640 1 -- 172.21.15.175:0/45078395 >> 172.21.15.175:0/45078395 conn(0x7fb7740b3160 msgr2=0x7fb7740b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:18.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.608+0000 7fb773e00640 1 -- 172.21.15.175:0/45078395 shutdown_connections 2024-04-25T09:14:18.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.608+0000 7fb773e00640 1 -- 172.21.15.175:0/45078395 wait complete. 2024-04-25T09:14:18.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.608+0000 7fb773e00640 1 Processor -- start 2024-04-25T09:14:18.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.608+0000 7fb773e00640 1 -- start start 2024-04-25T09:14:18.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb773e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb774099cb0 0x7fb774151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:18.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb773e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb77409a090 0x7fb7740b6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:18.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb773e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7740b27c0 0x7fb7740b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:18.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb773e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740d0f50 con 0x7fb774099cb0 2024-04-25T09:14:18.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb773e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740d0dd0 con 0x7fb7740b27c0 2024-04-25T09:14:18.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb773e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740d10d0 con 0x7fb77409a090 2024-04-25T09:14:18.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb772a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb774099cb0 0x7fb774151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:18.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb772a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb774099cb0 0x7fb774151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45214/0 (socket says 172.21.15.175:45214) 2024-04-25T09:14:18.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb772a00640 1 -- 172.21.15.175:0/3434976258 learned_addr learned my addr 172.21.15.175:0/3434976258 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:18.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb76a000640 1 --2- 172.21.15.175:0/3434976258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb77409a090 0x7fb7740b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:18.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb773400640 1 --2- 172.21.15.175:0/3434976258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7740b27c0 0x7fb7740b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:18.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb772a00640 1 -- 172.21.15.175:0/3434976258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb77409a090 msgr2=0x7fb7740b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:18.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb772a00640 1 --2- 172.21.15.175:0/3434976258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb77409a090 0x7fb7740b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:18.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb772a00640 1 -- 172.21.15.175:0/3434976258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7740b27c0 msgr2=0x7fb7740b6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:18.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb772a00640 1 --2- 172.21.15.175:0/3434976258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7740b27c0 0x7fb7740b6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:18.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb772a00640 1 -- 172.21.15.175:0/3434976258 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb774150a80 con 0x7fb774099cb0 2024-04-25T09:14:18.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb772a00640 1 --2- 172.21.15.175:0/3434976258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb774099cb0 0x7fb774151b20 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fb76400e8a0 tx=0x7fb76400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:18.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb76b400640 1 -- 172.21.15.175:0/3434976258 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764017070 con 0x7fb774099cb0 2024-04-25T09:14:18.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb76b400640 1 -- 172.21.15.175:0/3434976258 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76400c940 con 0x7fb774099cb0 2024-04-25T09:14:18.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb76b400640 1 -- 172.21.15.175:0/3434976258 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76400ccf0 con 0x7fb774099cb0 2024-04-25T09:14:18.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb773e00640 1 -- 172.21.15.175:0/3434976258 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb774150d60 con 0x7fb774099cb0 2024-04-25T09:14:18.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb773e00640 1 -- 172.21.15.175:0/3434976258 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb774151320 con 0x7fb774099cb0 2024-04-25T09:14:18.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb773e00640 1 -- 172.21.15.175:0/3434976258 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb774074a60 con 0x7fb774099cb0 2024-04-25T09:14:18.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.612+0000 7fb76b400640 1 -- 172.21.15.175:0/3434976258 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb76401a070 con 0x7fb774099cb0 2024-04-25T09:14:18.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.616+0000 7fb76b400640 1 --2- 172.21.15.175:0/3434976258 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb750066f60 0x7fb750069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:18.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.616+0000 7fb76b400640 1 -- 172.21.15.175:0/3434976258 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb764084ef0 con 0x7fb774099cb0 2024-04-25T09:14:18.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.616+0000 7fb76a000640 1 --2- 172.21.15.175:0/3434976258 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb750066f60 0x7fb750069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:18.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.616+0000 7fb76a000640 1 --2- 172.21.15.175:0/3434976258 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb750066f60 0x7fb750069420 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb7740c7800 tx=0x7fb75c007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:18.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.620+0000 7fb76b400640 1 -- 172.21.15.175:0/3434976258 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb764055840 con 0x7fb774099cb0 2024-04-25T09:14:18.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:18.804+0000 7fb773e00640 1 -- 172.21.15.175:0/3434976258 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fb7740c80d0 con 0x7fb774099cb0 2024-04-25T09:14:19.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.108+0000 7fb76b400640 1 -- 172.21.15.175:0/3434976258 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v95) v1 ==== 162+0+0 (secure 0 0 0) 0x7fb7640598e0 con 0x7fb774099cb0 2024-04-25T09:14:19.095 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T09:14:19.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.108+0000 7fb773e00640 1 -- 172.21.15.175:0/3434976258 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb750066f60 msgr2=0x7fb750069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:19.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.108+0000 7fb773e00640 1 --2- 172.21.15.175:0/3434976258 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb750066f60 0x7fb750069420 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb7740c7800 tx=0x7fb75c007e90 comp rx=0 tx=0).stop 2024-04-25T09:14:19.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.108+0000 7fb773e00640 1 -- 172.21.15.175:0/3434976258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb774099cb0 msgr2=0x7fb774151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:19.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.108+0000 7fb773e00640 1 --2- 172.21.15.175:0/3434976258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb774099cb0 0x7fb774151b20 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fb76400e8a0 tx=0x7fb76400eca0 comp rx=0 tx=0).stop 2024-04-25T09:14:19.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.108+0000 7fb773e00640 1 -- 172.21.15.175:0/3434976258 shutdown_connections 2024-04-25T09:14:19.097 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.108+0000 7fb773e00640 1 --2- 172.21.15.175:0/3434976258 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fb750066f60 0x7fb750069420 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:19.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.108+0000 7fb773e00640 1 --2- 172.21.15.175:0/3434976258 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7740b27c0 0x7fb7740b6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:19.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.108+0000 7fb773e00640 1 --2- 172.21.15.175:0/3434976258 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb77409a090 0x7fb7740b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:19.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.108+0000 7fb773e00640 1 --2- 172.21.15.175:0/3434976258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb774099cb0 0x7fb774151b20 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:19.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.108+0000 7fb773e00640 1 -- 172.21.15.175:0/3434976258 >> 172.21.15.175:0/3434976258 conn(0x7fb7740b3160 msgr2=0x7fb7740cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:19.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.108+0000 7fb773e00640 1 -- 172.21.15.175:0/3434976258 shutdown_connections 2024-04-25T09:14:19.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.108+0000 7fb773e00640 1 -- 172.21.15.175:0/3434976258 wait complete. 2024-04-25T09:14:19.121 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:19.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.268+0000 7f3a8b200640 1 Processor -- start 2024-04-25T09:14:19.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.268+0000 7f3a8b200640 1 -- start start 2024-04-25T09:14:19.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.272+0000 7f3a8b200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3a8415a900 0x7f3a8406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:19.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.272+0000 7f3a8b200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a840cd520 0x7f3a840ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:19.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.272+0000 7f3a8b200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3a840cf560 0x7f3a840cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:19.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.272+0000 7f3a8b200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a840cfef0 con 0x7f3a840cf560 2024-04-25T09:14:19.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.272+0000 7f3a8b200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a840cda00 con 0x7f3a8415a900 2024-04-25T09:14:19.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.272+0000 7f3a8b200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840cdce0 con 0x7f3a840cd520 2024-04-25T09:14:19.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.272+0000 7f3a89200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3a840cf560 0x7f3a840cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:19.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.272+0000 7f3a89200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3a840cf560 0x7f3a840cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45230/0 (socket says 172.21.15.175:45230) 2024-04-25T09:14:19.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.272+0000 7f3a89200640 1 -- 172.21.15.175:0/1193072015 learned_addr learned my addr 172.21.15.175:0/1193072015 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:19.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.272+0000 7f3a83e00640 1 --2- 172.21.15.175:0/1193072015 >> v2:172.21.15.177:3300/0 conn(0x7f3a8415a900 0x7f3a8406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:19.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.272+0000 7f3a7b400640 1 --2- 172.21.15.175:0/1193072015 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a840cd520 0x7f3a840ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:19.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.272+0000 7f3a89200640 1 -- 172.21.15.175:0/1193072015 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a840cd520 msgr2=0x7f3a840ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:19.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.272+0000 7f3a89200640 1 --2- 172.21.15.175:0/1193072015 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a840cd520 0x7f3a840ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:19.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.272+0000 7f3a89200640 1 -- 172.21.15.175:0/1193072015 >> v2:172.21.15.177:3300/0 conn(0x7f3a8415a900 msgr2=0x7f3a8406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:19.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.272+0000 7f3a89200640 1 --2- 172.21.15.175:0/1193072015 >> v2:172.21.15.177:3300/0 conn(0x7f3a8415a900 0x7f3a8406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:19.260 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.272+0000 7f3a89200640 1 -- 172.21.15.175:0/1193072015 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a840cdfc0 con 0x7f3a840cf560 2024-04-25T09:14:19.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.276+0000 7f3a89200640 1 --2- 172.21.15.175:0/1193072015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a840cf560 0x7f3a840cf9b0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f3a840b4c70 tx=0x7f3a7c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d1d9a0b90862ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:19.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.276+0000 7f3a83400640 1 -- 172.21.15.175:0/1193072015 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c0a5840 con 0x7f3a840cf560 2024-04-25T09:14:19.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.276+0000 7f3a83400640 1 -- 172.21.15.175:0/1193072015 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c0a59e0 con 0x7f3a840cf560 2024-04-25T09:14:19.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.276+0000 7f3a83400640 1 -- 172.21.15.175:0/1193072015 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c0a5db0 con 0x7f3a840cf560 2024-04-25T09:14:19.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.276+0000 7f3a8b200640 1 -- 172.21.15.175:0/1193072015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a840cf560 msgr2=0x7f3a840cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:19.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.276+0000 7f3a8b200640 1 --2- 172.21.15.175:0/1193072015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a840cf560 0x7f3a840cf9b0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f3a840b4c70 tx=0x7f3a7c01c9c0 comp rx=0 tx=0).stop 2024-04-25T09:14:19.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.276+0000 7f3a8b200640 1 -- 172.21.15.175:0/1193072015 shutdown_connections 2024-04-25T09:14:19.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.276+0000 7f3a8b200640 1 --2- 172.21.15.175:0/1193072015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a840cf560 0x7f3a840cf9b0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:19.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.276+0000 7f3a8b200640 1 --2- 172.21.15.175:0/1193072015 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a840cd520 0x7f3a840ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:19.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.276+0000 7f3a8b200640 1 --2- 172.21.15.175:0/1193072015 >> v2:172.21.15.177:3300/0 conn(0x7f3a8415a900 0x7f3a8406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:19.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.276+0000 7f3a8b200640 1 -- 172.21.15.175:0/1193072015 >> 172.21.15.175:0/1193072015 conn(0x7f3a84067150 msgr2=0x7f3a8406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:19.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.276+0000 7f3a8b200640 1 -- 172.21.15.175:0/1193072015 shutdown_connections 2024-04-25T09:14:19.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.276+0000 7f3a8b200640 1 -- 172.21.15.175:0/1193072015 wait complete. 2024-04-25T09:14:19.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.276+0000 7f3a8b200640 1 Processor -- start 2024-04-25T09:14:19.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.276+0000 7f3a8b200640 1 -- start start 2024-04-25T09:14:19.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.276+0000 7f3a8b200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a840cf560 0x7f3a840b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:19.266 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a8b200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a8415a900 0x7f3a841532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:19.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a8b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a840b2370 0x7f3a840b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:19.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a8b200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8406d530 con 0x7f3a840b2370 2024-04-25T09:14:19.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a8b200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8406d3b0 con 0x7f3a8415a900 2024-04-25T09:14:19.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a8b200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8415c790 con 0x7f3a840cf560 2024-04-25T09:14:19.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a89200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a840b2370 0x7f3a840b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:19.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a89200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a840b2370 0x7f3a840b2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45246/0 (socket says 172.21.15.175:45246) 2024-04-25T09:14:19.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a89200640 1 -- 172.21.15.175:0/1540772296 learned_addr learned my addr 172.21.15.175:0/1540772296 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:19.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a83e00640 1 --2- 172.21.15.175:0/1540772296 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a840cf560 0x7f3a840b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:19.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a7b400640 1 --2- 172.21.15.175:0/1540772296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a8415a900 0x7f3a841532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:19.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a89200640 1 -- 172.21.15.175:0/1540772296 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a840cf560 msgr2=0x7f3a840b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:19.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a89200640 1 --2- 172.21.15.175:0/1540772296 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a840cf560 0x7f3a840b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:19.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a89200640 1 -- 172.21.15.175:0/1540772296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a8415a900 msgr2=0x7f3a841532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:19.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a89200640 1 --2- 172.21.15.175:0/1540772296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a8415a900 0x7f3a841532b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:19.267 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a89200640 1 -- 172.21.15.175:0/1540772296 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a840b2f80 con 0x7f3a840b2370 2024-04-25T09:14:19.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a89200640 1 --2- 172.21.15.175:0/1540772296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a840b2370 0x7f3a840b2820 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0af040 tx=0x7f3a7c019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:19.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a80c00640 1 -- 172.21.15.175:0/1540772296 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c0b8880 con 0x7f3a840b2370 2024-04-25T09:14:19.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a80c00640 1 -- 172.21.15.175:0/1540772296 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a7c0be070 con 0x7f3a840b2370 2024-04-25T09:14:19.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a80c00640 1 -- 172.21.15.175:0/1540772296 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c0b8ca0 con 0x7f3a840b2370 2024-04-25T09:14:19.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a8b200640 1 -- 172.21.15.175:0/1540772296 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a840b3260 con 0x7f3a840b2370 2024-04-25T09:14:19.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a8b200640 1 -- 172.21.15.175:0/1540772296 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a840b3820 con 0x7f3a840b2370 2024-04-25T09:14:19.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a8b200640 1 -- 172.21.15.175:0/1540772296 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a84074a60 con 0x7f3a840b2370 2024-04-25T09:14:19.269 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.280+0000 7f3a80c00640 1 -- 172.21.15.175:0/1540772296 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3a7c0c3460 con 0x7f3a840b2370 2024-04-25T09:14:19.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.284+0000 7f3a80c00640 1 --2- 172.21.15.175:0/1540772296 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3a60066f60 0x7f3a60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:19.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.284+0000 7f3a80c00640 1 -- 172.21.15.175:0/1540772296 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3a7c120230 con 0x7f3a840b2370 2024-04-25T09:14:19.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.284+0000 7f3a83e00640 1 --2- 172.21.15.175:0/1540772296 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3a60066f60 0x7f3a60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:19.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.284+0000 7f3a83e00640 1 --2- 172.21.15.175:0/1540772296 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3a60066f60 0x7f3a60069420 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3a740079c0 tx=0x7f3a74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:19.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.288+0000 7f3a80c00640 1 -- 172.21.15.175:0/1540772296 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3a7c0165e0 con 0x7f3a840b2370 2024-04-25T09:14:19.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.480+0000 7f3a8b200640 1 -- 172.21.15.175:0/1540772296 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a8406ad80 con 0x7f3a840b2370 2024-04-25T09:14:19.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.480+0000 7f3a80c00640 1 -- 172.21.15.175:0/1540772296 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f3a7c0f0b70 con 0x7f3a840b2370 2024-04-25T09:14:19.468 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:19.468 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/745891603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":745891603},{"type":"v1","addr":"172.21.15.175:6837","nonce":745891603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2312875672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2312875672},{"type":"v1","addr":"172.21.15.177:6834","nonce":2312875672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":8212,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3983919410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3983919410},{"type":"v1","addr":"172.21.15.177:6835","nonce":3983919410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:14:03.698308+0000","modified":"2024-04-25T09:14:19.113156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8955":{"gid":8955,"name":"c","rank":0,"incarnation":96,"state":"up:replay","state_seq":1,"addr":"172.21.15.175:6836/386187898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":386187898},{"type":"v1","addr":"172.21.15.175:6836","nonce":386187898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:14:19.469 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 96 2024-04-25T09:14:19.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.484+0000 7f3a8b200640 1 -- 172.21.15.175:0/1540772296 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3a60066f60 msgr2=0x7f3a60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:19.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.484+0000 7f3a8b200640 1 --2- 172.21.15.175:0/1540772296 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3a60066f60 0x7f3a60069420 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3a740079c0 tx=0x7f3a74008040 comp rx=0 tx=0).stop 2024-04-25T09:14:19.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.484+0000 7f3a8b200640 1 -- 172.21.15.175:0/1540772296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a840b2370 msgr2=0x7f3a840b2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:19.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.484+0000 7f3a8b200640 1 --2- 172.21.15.175:0/1540772296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a840b2370 0x7f3a840b2820 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0af040 tx=0x7f3a7c019760 comp rx=0 tx=0).stop 2024-04-25T09:14:19.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.484+0000 7f3a8b200640 1 -- 172.21.15.175:0/1540772296 shutdown_connections 2024-04-25T09:14:19.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.484+0000 7f3a8b200640 1 --2- 172.21.15.175:0/1540772296 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3a60066f60 0x7f3a60069420 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:19.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.484+0000 7f3a8b200640 1 --2- 172.21.15.175:0/1540772296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a840b2370 0x7f3a840b2820 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:19.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.484+0000 7f3a8b200640 1 --2- 172.21.15.175:0/1540772296 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3a8415a900 0x7f3a841532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:19.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.484+0000 7f3a8b200640 1 --2- 172.21.15.175:0/1540772296 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3a840cf560 0x7f3a840b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:19.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.484+0000 7f3a8b200640 1 -- 172.21.15.175:0/1540772296 >> 172.21.15.175:0/1540772296 conn(0x7f3a840cd520 msgr2=0x7f3a8415dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:19.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.484+0000 7f3a8b200640 1 -- 172.21.15.175:0/1540772296 shutdown_connections 2024-04-25T09:14:19.471 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:19.484+0000 7f3a8b200640 1 -- 172.21.15.175:0/1540772296 wait complete. 2024-04-25T09:14:19.891 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 96, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:14:03.698308+0000', 'modified': '2024-04-25T09:14:19.113156+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 114, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8955}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8955': {'gid': 8955, 'name': 'c', 'rank': 0, 'incarnation': 96, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.175:6836/386187898', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 386187898}, {'type': 'v1', 'addr': '172.21.15.175:6836', 'nonce': 386187898}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:14:19.891 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8955:up:replay 2024-04-25T09:14:20.892 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:21.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.052+0000 7fe0a4200640 1 Processor -- start 2024-04-25T09:14:21.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.052+0000 7fe0a4200640 1 -- start start 2024-04-25T09:14:21.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.052+0000 7fe0a4200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe09c0cd520 0x7fe09c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:21.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.052+0000 7fe0a4200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe09c0cf560 0x7fe09c0cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:21.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.052+0000 7fe0a4200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09c0cda00 con 0x7fe09c15a900 2024-04-25T09:14:21.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.052+0000 7fe0a4200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09c15bcf0 con 0x7fe09c0cd520 2024-04-25T09:14:21.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.052+0000 7fe0a4200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0cfef0 con 0x7fe09c0cf560 2024-04-25T09:14:21.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.052+0000 7fe0a1800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe09c15a900 0x7fe09c0ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:48182/0 (socket says 172.21.15.175:48182) 2024-04-25T09:14:21.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.052+0000 7fe0a0e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe09c0cd520 0x7fe09c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:21.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.052+0000 7fe0a1800640 1 -- 172.21.15.175:0/1293365655 learned_addr learned my addr 172.21.15.175:0/1293365655 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:21.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.052+0000 7fe0a2200640 1 --2- 172.21.15.175:0/1293365655 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe09c0cf560 0x7fe09c0cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:21.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.052+0000 7fe0a0e00640 1 -- 172.21.15.175:0/1293365655 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe09c0cf560 msgr2=0x7fe09c0cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:21.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.052+0000 7fe0a0e00640 1 --2- 172.21.15.175:0/1293365655 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe09c0cf560 0x7fe09c0cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:21.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.052+0000 7fe0a0e00640 1 -- 172.21.15.175:0/1293365655 >> v1:172.21.15.175:6789/0 conn(0x7fe09c15a900 legacy=0x7fe09c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:21.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.052+0000 7fe0a0e00640 1 -- 172.21.15.175:0/1293365655 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c0cdce0 con 0x7fe09c0cd520 2024-04-25T09:14:21.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.052+0000 7fe09be00640 1 -- 172.21.15.175:0/1293365655 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087954602 0 0) 0x7fe09c0cda00 con 0x7fe09c15a900 2024-04-25T09:14:21.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.056+0000 7fe0a0e00640 1 --2- 172.21.15.175:0/1293365655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe09c0cd520 0x7fe09c06e150 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fe0880097c0 tx=0x7fe08801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea235b69c65ced server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:21.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.056+0000 7fe09be00640 1 -- 172.21.15.175:0/1293365655 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0880b2070 con 0x7fe09c0cd520 2024-04-25T09:14:21.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.056+0000 7fe09be00640 1 -- 172.21.15.175:0/1293365655 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0880ad640 con 0x7fe09c0cd520 2024-04-25T09:14:21.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.056+0000 7fe09be00640 1 -- 172.21.15.175:0/1293365655 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0880ada10 con 0x7fe09c0cd520 2024-04-25T09:14:21.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.056+0000 7fe0a4200640 1 -- 172.21.15.175:0/1293365655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe09c0cd520 msgr2=0x7fe09c06e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:21.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.056+0000 7fe0a4200640 1 --2- 172.21.15.175:0/1293365655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe09c0cd520 0x7fe09c06e150 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fe0880097c0 tx=0x7fe08801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:21.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.056+0000 7fe0a4200640 1 -- 172.21.15.175:0/1293365655 shutdown_connections 2024-04-25T09:14:21.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.056+0000 7fe0a4200640 1 --2- 172.21.15.175:0/1293365655 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe09c0cf560 0x7fe09c0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:21.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.056+0000 7fe0a4200640 1 --2- 172.21.15.175:0/1293365655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe09c0cd520 0x7fe09c06e150 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:21.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.056+0000 7fe0a4200640 1 -- 172.21.15.175:0/1293365655 >> 172.21.15.175:0/1293365655 conn(0x7fe09c067150 msgr2=0x7fe09c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:21.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.056+0000 7fe0a4200640 1 -- 172.21.15.175:0/1293365655 shutdown_connections 2024-04-25T09:14:21.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.056+0000 7fe0a4200640 1 -- 172.21.15.175:0/1293365655 wait complete. 2024-04-25T09:14:21.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a4200640 1 Processor -- start 2024-04-25T09:14:21.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a4200640 1 -- start start 2024-04-25T09:14:21.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a4200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe09c0cf560 0x7fe09c14bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:21.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a4200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe09c15a900 0x7fe09c0b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:21.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a4200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe09c14ea70 0x7fe09c0adc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:21.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a4200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c06d530 con 0x7fe09c0cf560 2024-04-25T09:14:21.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a4200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c06d3b0 con 0x7fe09c15a900 2024-04-25T09:14:21.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a4200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c15c790 con 0x7fe09c14ea70 2024-04-25T09:14:21.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a1800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe09c0cf560 0x7fe09c14bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:21.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a1800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe09c0cf560 0x7fe09c14bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43638/0 (socket says 172.21.15.175:43638) 2024-04-25T09:14:21.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a1800640 1 -- 172.21.15.175:0/3296731344 learned_addr learned my addr 172.21.15.175:0/3296731344 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:21.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a2200640 1 --2- 172.21.15.175:0/3296731344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe09c14ea70 0x7fe09c0adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:21.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a0e00640 1 --2- 172.21.15.175:0/3296731344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe09c15a900 0x7fe09c0b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:21.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a1800640 1 -- 172.21.15.175:0/3296731344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe09c14ea70 msgr2=0x7fe09c0adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:21.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a1800640 1 --2- 172.21.15.175:0/3296731344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe09c14ea70 0x7fe09c0adc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:21.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a1800640 1 -- 172.21.15.175:0/3296731344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe09c15a900 msgr2=0x7fe09c0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:21.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a1800640 1 --2- 172.21.15.175:0/3296731344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe09c15a900 0x7fe09c0b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:21.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a1800640 1 -- 172.21.15.175:0/3296731344 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c15a180 con 0x7fe09c0cf560 2024-04-25T09:14:21.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a0e00640 1 --2- 172.21.15.175:0/3296731344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe09c15a900 0x7fe09c0b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:21.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a1800640 1 --2- 172.21.15.175:0/3296731344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe09c0cf560 0x7fe09c14bef0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fe09000c4b0 tx=0x7fe09000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:21.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe099600640 1 -- 172.21.15.175:0/3296731344 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090018070 con 0x7fe09c0cf560 2024-04-25T09:14:21.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe099600640 1 -- 172.21.15.175:0/3296731344 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe090007500 con 0x7fe09c0cf560 2024-04-25T09:14:21.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe099600640 1 -- 172.21.15.175:0/3296731344 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090004a30 con 0x7fe09c0cf560 2024-04-25T09:14:21.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a4200640 1 -- 172.21.15.175:0/3296731344 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09c0b0c90 con 0x7fe09c0cf560 2024-04-25T09:14:21.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.060+0000 7fe0a4200640 1 -- 172.21.15.175:0/3296731344 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09c0ad470 con 0x7fe09c0cf560 2024-04-25T09:14:21.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.064+0000 7fe0a4200640 1 -- 172.21.15.175:0/3296731344 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09c074a60 con 0x7fe09c0cf560 2024-04-25T09:14:21.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.064+0000 7fe099600640 1 -- 172.21.15.175:0/3296731344 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe090004bd0 con 0x7fe09c0cf560 2024-04-25T09:14:21.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.064+0000 7fe099600640 1 --2- 172.21.15.175:0/3296731344 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe07c066f60 0x7fe07c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:21.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.064+0000 7fe099600640 1 -- 172.21.15.175:0/3296731344 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe0900843b0 con 0x7fe09c0cf560 2024-04-25T09:14:21.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.064+0000 7fe0a0e00640 1 --2- 172.21.15.175:0/3296731344 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe07c066f60 0x7fe07c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:21.052 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.064+0000 7fe0a0e00640 1 --2- 172.21.15.175:0/3296731344 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe07c066f60 0x7fe07c069420 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe0880af000 tx=0x7fe0880a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:21.055 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.068+0000 7fe099600640 1 -- 172.21.15.175:0/3296731344 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe0900552c0 con 0x7fe09c0cf560 2024-04-25T09:14:21.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.256+0000 7fe0a4200640 1 -- 172.21.15.175:0/3296731344 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe09c15cb30 con 0x7fe09c0cf560 2024-04-25T09:14:21.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.256+0000 7fe099600640 1 -- 172.21.15.175:0/3296731344 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4948 (secure 0 0 0) 0x7fe090054bc0 con 0x7fe09c0cf560 2024-04-25T09:14:21.245 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:21.245 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":98,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/745891603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":745891603},{"type":"v1","addr":"172.21.15.175:6837","nonce":745891603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2312875672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2312875672},{"type":"v1","addr":"172.21.15.177:6834","nonce":2312875672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":8212,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3983919410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3983919410},{"type":"v1","addr":"172.21.15.177:6835","nonce":3983919410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:14:03.698308+0000","modified":"2024-04-25T09:14:20.119803+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8955":{"gid":8955,"name":"c","rank":0,"incarnation":96,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.175:6836/386187898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":386187898},{"type":"v1","addr":"172.21.15.175:6836","nonce":386187898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:14:21.245 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 98 2024-04-25T09:14:21.247 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.260+0000 7fe0a4200640 1 -- 172.21.15.175:0/3296731344 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe07c066f60 msgr2=0x7fe07c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:21.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.260+0000 7fe0a4200640 1 --2- 172.21.15.175:0/3296731344 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe07c066f60 0x7fe07c069420 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe0880af000 tx=0x7fe0880a7070 comp rx=0 tx=0).stop 2024-04-25T09:14:21.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.260+0000 7fe0a4200640 1 -- 172.21.15.175:0/3296731344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe09c0cf560 msgr2=0x7fe09c14bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:21.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.260+0000 7fe0a4200640 1 --2- 172.21.15.175:0/3296731344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe09c0cf560 0x7fe09c14bef0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fe09000c4b0 tx=0x7fe09000c970 comp rx=0 tx=0).stop 2024-04-25T09:14:21.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.260+0000 7fe0a4200640 1 -- 172.21.15.175:0/3296731344 shutdown_connections 2024-04-25T09:14:21.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.260+0000 7fe0a4200640 1 --2- 172.21.15.175:0/3296731344 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe07c066f60 0x7fe07c069420 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:21.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.260+0000 7fe0a4200640 1 --2- 172.21.15.175:0/3296731344 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe09c14ea70 0x7fe09c0adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:21.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.260+0000 7fe0a4200640 1 --2- 172.21.15.175:0/3296731344 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe09c15a900 0x7fe09c0b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:21.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.260+0000 7fe0a4200640 1 --2- 172.21.15.175:0/3296731344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe09c0cf560 0x7fe09c14bef0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:21.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.260+0000 7fe0a4200640 1 -- 172.21.15.175:0/3296731344 >> 172.21.15.175:0/3296731344 conn(0x7fe09c0cd520 msgr2=0x7fe09c06ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:21.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.260+0000 7fe0a4200640 1 -- 172.21.15.175:0/3296731344 shutdown_connections 2024-04-25T09:14:21.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:21.260+0000 7fe0a4200640 1 -- 172.21.15.175:0/3296731344 wait complete. 2024-04-25T09:14:21.669 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 98, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:14:03.698308+0000', 'modified': '2024-04-25T09:14:20.119803+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 114, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8955}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8955': {'gid': 8955, 'name': 'c', 'rank': 0, 'incarnation': 96, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.175:6836/386187898', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 386187898}, {'type': 'v1', 'addr': '172.21.15.175:6836', 'nonce': 386187898}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:14:21.669 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8955:up:rejoin 2024-04-25T09:14:22.669 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:22.816 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.828+0000 7f8b17800640 1 Processor -- start 2024-04-25T09:14:22.817 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.828+0000 7f8b17800640 1 -- start start 2024-04-25T09:14:22.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.832+0000 7f8b17800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8b1015a900 0x7f8b1006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:22.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.832+0000 7f8b17800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8b100cf560 0x7f8b100cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:22.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.832+0000 7f8b17800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b100cda00 con 0x7f8b100cd520 2024-04-25T09:14:22.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.832+0000 7f8b17800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1015bcf0 con 0x7f8b1015a900 2024-04-25T09:14:22.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.832+0000 7f8b17800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b100cfed0 con 0x7f8b100cf560 2024-04-25T09:14:22.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.832+0000 7f8b14e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8b1015a900 0x7f8b1006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:22.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.832+0000 7f8b07e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f8b100cd520 0x7f8b100ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:48198/0 (socket says 172.21.15.175:48198) 2024-04-25T09:14:22.820 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.832+0000 7f8b07e00640 1 -- 172.21.15.175:0/3292639726 learned_addr learned my addr 172.21.15.175:0/3292639726 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:22.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.832+0000 7f8b15800640 1 --2- 172.21.15.175:0/3292639726 >> v2:172.21.15.177:3300/0 conn(0x7f8b100cf560 0x7f8b100cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:22.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.832+0000 7f8b0fe00640 1 -- 172.21.15.175:0/3292639726 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265384782 0 0) 0x7f8b100cda00 con 0x7f8b100cd520 2024-04-25T09:14:22.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.832+0000 7f8b0fe00640 1 -- 172.21.15.175:0/3292639726 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8af4003530 con 0x7f8b100cd520 2024-04-25T09:14:22.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.832+0000 7f8b14e00640 1 -- 172.21.15.175:0/3292639726 >> v2:172.21.15.177:3300/0 conn(0x7f8b100cf560 msgr2=0x7f8b100cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:22.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.832+0000 7f8b14e00640 1 --2- 172.21.15.175:0/3292639726 >> v2:172.21.15.177:3300/0 conn(0x7f8b100cf560 0x7f8b100cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:22.821 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.832+0000 7f8b14e00640 1 -- 172.21.15.175:0/3292639726 >> v1:172.21.15.175:6789/0 conn(0x7f8b100cd520 legacy=0x7f8b100ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:22.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.832+0000 7f8b14e00640 1 -- 172.21.15.175:0/3292639726 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b100cdce0 con 0x7f8b1015a900 2024-04-25T09:14:22.822 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.832+0000 7f8b15800640 1 --2- 172.21.15.175:0/3292639726 >> v2:172.21.15.177:3300/0 conn(0x7f8b100cf560 0x7f8b100cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:22.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.836+0000 7f8b14e00640 1 --2- 172.21.15.175:0/3292639726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1015a900 0x7f8b1006e150 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f8b100af070 tx=0x7f8b0001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875d38d9d50c11c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:22.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.836+0000 7f8b0fe00640 1 -- 172.21.15.175:0/3292639726 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b000b0070 con 0x7f8b1015a900 2024-04-25T09:14:22.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.836+0000 7f8b0fe00640 1 -- 172.21.15.175:0/3292639726 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b00004230 con 0x7f8b1015a900 2024-04-25T09:14:22.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.836+0000 7f8b0fe00640 1 -- 172.21.15.175:0/3292639726 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b00003620 con 0x7f8b1015a900 2024-04-25T09:14:22.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.836+0000 7f8b17800640 1 -- 172.21.15.175:0/3292639726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1015a900 msgr2=0x7f8b1006e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:22.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.836+0000 7f8b17800640 1 --2- 172.21.15.175:0/3292639726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1015a900 0x7f8b1006e150 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f8b100af070 tx=0x7f8b0001c460 comp rx=0 tx=0).stop 2024-04-25T09:14:22.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.836+0000 7f8b17800640 1 -- 172.21.15.175:0/3292639726 shutdown_connections 2024-04-25T09:14:22.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.836+0000 7f8b17800640 1 --2- 172.21.15.175:0/3292639726 >> v2:172.21.15.177:3300/0 conn(0x7f8b100cf560 0x7f8b100cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:22.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.836+0000 7f8b17800640 1 --2- 172.21.15.175:0/3292639726 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1015a900 0x7f8b1006e150 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:22.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.836+0000 7f8b17800640 1 -- 172.21.15.175:0/3292639726 >> 172.21.15.175:0/3292639726 conn(0x7f8b10067150 msgr2=0x7f8b1006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:22.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.836+0000 7f8b17800640 1 -- 172.21.15.175:0/3292639726 shutdown_connections 2024-04-25T09:14:22.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.836+0000 7f8b17800640 1 -- 172.21.15.175:0/3292639726 wait complete. 2024-04-25T09:14:22.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.836+0000 7f8b17800640 1 Processor -- start 2024-04-25T09:14:22.827 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.836+0000 7f8b17800640 1 -- start start 2024-04-25T09:14:22.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.836+0000 7f8b17800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b100cf560 0x7f8b101477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:22.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b17800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1015a900 0x7f8b10147d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:22.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b17800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b100b3ab0 0x7f8b10150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:22.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b17800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1006d530 con 0x7f8b1015a900 2024-04-25T09:14:22.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b17800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1006d3b0 con 0x7f8b100cf560 2024-04-25T09:14:22.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b17800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1015c790 con 0x7f8b100b3ab0 2024-04-25T09:14:22.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b07e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1015a900 0x7f8b10147d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:22.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b07e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1015a900 0x7f8b10147d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43658/0 (socket says 172.21.15.175:43658) 2024-04-25T09:14:22.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b07e00640 1 -- 172.21.15.175:0/3800144023 learned_addr learned my addr 172.21.15.175:0/3800144023 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:22.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b14e00640 1 --2- 172.21.15.175:0/3800144023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b100cf560 0x7f8b101477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:22.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b15800640 1 --2- 172.21.15.175:0/3800144023 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b100b3ab0 0x7f8b10150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:22.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b07e00640 1 -- 172.21.15.175:0/3800144023 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b100b3ab0 msgr2=0x7f8b10150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:22.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b07e00640 1 --2- 172.21.15.175:0/3800144023 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b100b3ab0 0x7f8b10150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:22.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b07e00640 1 -- 172.21.15.175:0/3800144023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b100cf560 msgr2=0x7f8b101477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:22.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b07e00640 1 --2- 172.21.15.175:0/3800144023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b100cf560 0x7f8b101477d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:22.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b07e00640 1 -- 172.21.15.175:0/3800144023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b10151080 con 0x7f8b1015a900 2024-04-25T09:14:22.834 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b14e00640 1 --2- 172.21.15.175:0/3800144023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b100cf560 0x7f8b101477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:22.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b07e00640 1 --2- 172.21.15.175:0/3800144023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1015a900 0x7f8b10147d10 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f8af800c420 tx=0x7f8af800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:22.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b0d600640 1 -- 172.21.15.175:0/3800144023 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8017070 con 0x7f8b1015a900 2024-04-25T09:14:22.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b0d600640 1 -- 172.21.15.175:0/3800144023 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af8005d10 con 0x7f8b1015a900 2024-04-25T09:14:22.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b0d600640 1 -- 172.21.15.175:0/3800144023 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8007310 con 0x7f8b1015a900 2024-04-25T09:14:22.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b17800640 1 -- 172.21.15.175:0/3800144023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b100b2fd0 con 0x7f8b1015a900 2024-04-25T09:14:22.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b17800640 1 -- 172.21.15.175:0/3800144023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b100ae4c0 con 0x7f8b1015a900 2024-04-25T09:14:22.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b17800640 1 -- 172.21.15.175:0/3800144023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b10074a40 con 0x7f8b1015a900 2024-04-25T09:14:22.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.840+0000 7f8b0d600640 1 -- 172.21.15.175:0/3800144023 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8af801a070 con 0x7f8b1015a900 2024-04-25T09:14:22.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.844+0000 7f8b0d600640 1 --2- 172.21.15.175:0/3800144023 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8aec066f90 0x7f8aec069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:22.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.844+0000 7f8b0d600640 1 -- 172.21.15.175:0/3800144023 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8af80844a0 con 0x7f8b1015a900 2024-04-25T09:14:22.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.844+0000 7f8b14e00640 1 --2- 172.21.15.175:0/3800144023 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8aec066f90 0x7f8aec069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:22.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.844+0000 7f8b14e00640 1 --2- 172.21.15.175:0/3800144023 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8aec066f90 0x7f8aec069450 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8b000ad000 tx=0x7f8b000a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:22.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:22.848+0000 7f8b0d600640 1 -- 172.21.15.175:0/3800144023 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8af8055470 con 0x7f8b1015a900 2024-04-25T09:14:23.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.036+0000 7f8b17800640 1 -- 172.21.15.175:0/3800144023 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b1006adf0 con 0x7f8b1015a900 2024-04-25T09:14:23.024 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.036+0000 7f8b0d600640 1 -- 172.21.15.175:0/3800144023 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f8af8054d70 con 0x7f8b1015a900 2024-04-25T09:14:23.024 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:23.024 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":99,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/745891603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":745891603},{"type":"v1","addr":"172.21.15.175:6837","nonce":745891603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2312875672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2312875672},{"type":"v1","addr":"172.21.15.177:6834","nonce":2312875672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":8212,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3983919410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3983919410},{"type":"v1","addr":"172.21.15.177:6835","nonce":3983919410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:14:03.698308+0000","modified":"2024-04-25T09:14:21.121352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8955":{"gid":8955,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6836/386187898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":386187898},{"type":"v1","addr":"172.21.15.175:6836","nonce":386187898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:14:23.025 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 99 2024-04-25T09:14:23.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.040+0000 7f8b17800640 1 -- 172.21.15.175:0/3800144023 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8aec066f90 msgr2=0x7f8aec069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:23.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.040+0000 7f8b17800640 1 --2- 172.21.15.175:0/3800144023 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8aec066f90 0x7f8aec069450 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8b000ad000 tx=0x7f8b000a6000 comp rx=0 tx=0).stop 2024-04-25T09:14:23.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.040+0000 7f8b17800640 1 -- 172.21.15.175:0/3800144023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1015a900 msgr2=0x7f8b10147d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:23.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.040+0000 7f8b17800640 1 --2- 172.21.15.175:0/3800144023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1015a900 0x7f8b10147d10 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f8af800c420 tx=0x7f8af800c8e0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.040+0000 7f8b17800640 1 -- 172.21.15.175:0/3800144023 shutdown_connections 2024-04-25T09:14:23.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.040+0000 7f8b17800640 1 --2- 172.21.15.175:0/3800144023 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8aec066f90 0x7f8aec069450 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.040+0000 7f8b17800640 1 --2- 172.21.15.175:0/3800144023 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b100b3ab0 0x7f8b10150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.040+0000 7f8b17800640 1 --2- 172.21.15.175:0/3800144023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b1015a900 0x7f8b10147d10 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.040+0000 7f8b17800640 1 --2- 172.21.15.175:0/3800144023 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b100cf560 0x7f8b101477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.040+0000 7f8b17800640 1 -- 172.21.15.175:0/3800144023 >> 172.21.15.175:0/3800144023 conn(0x7f8b100cd520 msgr2=0x7f8b10148830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:23.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.040+0000 7f8b17800640 1 -- 172.21.15.175:0/3800144023 shutdown_connections 2024-04-25T09:14:23.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.040+0000 7f8b17800640 1 -- 172.21.15.175:0/3800144023 wait complete. 2024-04-25T09:14:23.447 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 99, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:14:03.698308+0000', 'modified': '2024-04-25T09:14:21.121352+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 114, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8955}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8955': {'gid': 8955, 'name': 'c', 'rank': 0, 'incarnation': 96, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.175:6836/386187898', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 386187898}, {'type': 'v1', 'addr': '172.21.15.175:6836', 'nonce': 386187898}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:14:23.448 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:14:23.448 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:14:23.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.600+0000 7f8964800640 1 Processor -- start 2024-04-25T09:14:23.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.600+0000 7f8964800640 1 -- start start 2024-04-25T09:14:23.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.600+0000 7f8964800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f895c0cbe60 0x7f895c15af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.600+0000 7f8964800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895c06db60 con 0x7f895c0b4800 2024-04-25T09:14:23.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.600+0000 7f8964800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895c06de40 con 0x7f895c06d310 2024-04-25T09:14:23.591 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.600+0000 7f8964800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895c06e120 con 0x7f895c0cbe60 2024-04-25T09:14:23.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8962800640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f895c0b4800 0x7f895c15c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:48206/0 (socket says 172.21.15.175:48206) 2024-04-25T09:14:23.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8962800640 1 -- 172.21.15.175:0/900432161 learned_addr learned my addr 172.21.15.175:0/900432161 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:23.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8961e00640 1 --2- 172.21.15.175:0/900432161 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f895c0cbe60 0x7f895c15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8960a00640 1 -- 172.21.15.175:0/900432161 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930486328 0 0) 0x7f895c06db60 con 0x7f895c0b4800 2024-04-25T09:14:23.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8960a00640 1 -- 172.21.15.175:0/900432161 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8944003530 con 0x7f895c0b4800 2024-04-25T09:14:23.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8960a00640 1 -- 172.21.15.175:0/900432161 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499395890 0 0) 0x7f895c06de40 con 0x7f895c06d310 2024-04-25T09:14:23.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8960a00640 1 -- 172.21.15.175:0/900432161 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f895c06db60 con 0x7f895c06d310 2024-04-25T09:14:23.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8960a00640 1 -- 172.21.15.175:0/900432161 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1775338430 0 0) 0x7f8944003530 con 0x7f895c0b4800 2024-04-25T09:14:23.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8960a00640 1 -- 172.21.15.175:0/900432161 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f895c0cbe60 msgr2=0x7f895c15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:23.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8960a00640 1 --2- 172.21.15.175:0/900432161 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f895c0cbe60 0x7f895c15af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.592 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8960a00640 1 -- 172.21.15.175:0/900432161 >> v1:172.21.15.177:6789/0 conn(0x7f895c06d310 legacy=0x7f895c0b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:23.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8960a00640 1 -- 172.21.15.175:0/900432161 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c15c2f0 con 0x7f895c0b4800 2024-04-25T09:14:23.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8960a00640 1 -- 172.21.15.175:0/900432161 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f8958001a00 con 0x7f895c0b4800 2024-04-25T09:14:23.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8960a00640 1 -- 172.21.15.175:0/900432161 >> v1:172.21.15.175:6789/0 conn(0x7f895c0b4800 legacy=0x7f895c15c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:23.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8960a00640 1 --2- 172.21.15.175:0/900432161 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f895c0cbe60 0x7f8944003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8960a00640 1 --2- 172.21.15.175:0/900432161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89440040e0 0x7f8944004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8960a00640 1 --2- 172.21.15.175:0/900432161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8944004d50 0x7f89440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8960a00640 1 -- 172.21.15.175:0/900432161 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c06e120 con 0x7f8944004d50 2024-04-25T09:14:23.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8960a00640 1 -- 172.21.15.175:0/900432161 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894400bab0 con 0x7f89440040e0 2024-04-25T09:14:23.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8960a00640 1 -- 172.21.15.175:0/900432161 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894400dec0 con 0x7f895c0cbe60 2024-04-25T09:14:23.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8962800640 1 --2- 172.21.15.175:0/900432161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8944004d50 0x7f89440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8961e00640 1 --2- 172.21.15.175:0/900432161 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f895c0cbe60 0x7f8944003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.593 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8961400640 1 --2- 172.21.15.175:0/900432161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89440040e0 0x7f8944004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8962800640 1 -- 172.21.15.175:0/900432161 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f895c0cbe60 msgr2=0x7f8944003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:23.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8962800640 1 --2- 172.21.15.175:0/900432161 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f895c0cbe60 0x7f8944003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8962800640 1 -- 172.21.15.175:0/900432161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89440040e0 msgr2=0x7f8944004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:23.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8962800640 1 --2- 172.21.15.175:0/900432161 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f89440040e0 0x7f8944004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8962800640 1 -- 172.21.15.175:0/900432161 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8944003530 con 0x7f8944004d50 2024-04-25T09:14:23.594 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.604+0000 7f8961e00640 1 --2- 172.21.15.175:0/900432161 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f895c0cbe60 0x7f8944003b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:23.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.608+0000 7f8962800640 1 --2- 172.21.15.175:0/900432161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8944004d50 0x7f89440051d0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f895800a7c0 tx=0x7f895801fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca3a814a652cb1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:23.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.608+0000 7f8960a00640 1 -- 172.21.15.175:0/900432161 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895800a410 con 0x7f8944004d50 2024-04-25T09:14:23.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.608+0000 7f8960a00640 1 -- 172.21.15.175:0/900432161 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89580aa690 con 0x7f8944004d50 2024-04-25T09:14:23.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.608+0000 7f8960a00640 1 -- 172.21.15.175:0/900432161 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89580aaac0 con 0x7f8944004d50 2024-04-25T09:14:23.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.608+0000 7f8964800640 1 -- 172.21.15.175:0/900432161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8944004d50 msgr2=0x7f89440051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:23.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.608+0000 7f8964800640 1 --2- 172.21.15.175:0/900432161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8944004d50 0x7f89440051d0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f895800a7c0 tx=0x7f895801fa40 comp rx=0 tx=0).stop 2024-04-25T09:14:23.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.608+0000 7f8962800640 1 -- 172.21.15.175:0/900432161 reap_dead start 2024-04-25T09:14:23.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.608+0000 7f8964800640 1 -- 172.21.15.175:0/900432161 shutdown_connections 2024-04-25T09:14:23.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.608+0000 7f8964800640 1 -- 172.21.15.175:0/900432161 >> 172.21.15.175:0/900432161 conn(0x7f895c06ac50 msgr2=0x7f895c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:23.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.608+0000 7f8964800640 1 -- 172.21.15.175:0/900432161 shutdown_connections 2024-04-25T09:14:23.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.608+0000 7f8964800640 1 -- 172.21.15.175:0/900432161 wait complete. 2024-04-25T09:14:23.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.608+0000 7f8964800640 1 Processor -- start 2024-04-25T09:14:23.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.608+0000 7f8964800640 1 -- start start 2024-04-25T09:14:23.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8964800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8944004d50 0x7f895c141d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8964800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f895c142240 0x7f895c150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8964800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f895c150870 0x7f895c150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8964800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c0cc3c0 con 0x7f895c142240 2024-04-25T09:14:23.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8964800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c0cc240 con 0x7f8944004d50 2024-04-25T09:14:23.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8964800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895c15af20 con 0x7f895c150870 2024-04-25T09:14:23.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8961400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f895c142240 0x7f895c150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8961400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f895c142240 0x7f895c150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43676/0 (socket says 172.21.15.175:43676) 2024-04-25T09:14:23.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8961400640 1 -- 172.21.15.175:0/3422107753 learned_addr learned my addr 172.21.15.175:0/3422107753 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:23.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8961400640 1 -- 172.21.15.175:0/3422107753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f895c150870 msgr2=0x7f895c150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:23.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8961400640 1 --2- 172.21.15.175:0/3422107753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f895c150870 0x7f895c150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8961400640 1 -- 172.21.15.175:0/3422107753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8944004d50 msgr2=0x7f895c141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:23.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8961400640 1 --2- 172.21.15.175:0/3422107753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8944004d50 0x7f895c141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8961400640 1 -- 172.21.15.175:0/3422107753 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c1426c0 con 0x7f895c142240 2024-04-25T09:14:23.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8961400640 1 --2- 172.21.15.175:0/3422107753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f895c142240 0x7f895c150330 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f894c00f6c0 tx=0x7f894c00fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:23.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8956000640 1 -- 172.21.15.175:0/3422107753 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c0050d0 con 0x7f895c142240 2024-04-25T09:14:23.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8956000640 1 -- 172.21.15.175:0/3422107753 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c018070 con 0x7f895c142240 2024-04-25T09:14:23.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8956000640 1 -- 172.21.15.175:0/3422107753 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c00d6b0 con 0x7f895c142240 2024-04-25T09:14:23.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8964800640 1 -- 172.21.15.175:0/3422107753 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895c0af520 con 0x7f895c142240 2024-04-25T09:14:23.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8964800640 1 -- 172.21.15.175:0/3422107753 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895c1535c0 con 0x7f895c142240 2024-04-25T09:14:23.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.612+0000 7f8956000640 1 -- 172.21.15.175:0/3422107753 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f894c00d850 con 0x7f895c142240 2024-04-25T09:14:23.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8967cab000 1 Processor -- start 2024-04-25T09:14:23.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8956000640 1 --2- 172.21.15.175:0/3422107753 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8940066f90 0x7f8940069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8967cab000 1 -- start start 2024-04-25T09:14:23.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8956000640 1 -- 172.21.15.175:0/3422107753 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f894c084f80 con 0x7f895c142240 2024-04-25T09:14:23.602 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8962800640 1 --2- 172.21.15.175:0/3422107753 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8940066f90 0x7f8940069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8962800640 1 --2- 172.21.15.175:0/3422107753 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8940066f90 0x7f8940069450 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f89580b0000 tx=0x7f89580b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:23.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8967cab000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708522920 0x556708522d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8967cab000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556708523240 0x5567084d89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8967cab000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 0x5567084d9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8967cab000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567083c05f0 con 0x5567084d8f30 2024-04-25T09:14:23.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8967cab000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x556708327da0 con 0x556708522920 2024-04-25T09:14:23.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8967cab000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5567082b0150 con 0x556708523240 2024-04-25T09:14:23.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8962800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 0x5567084d9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8962800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 0x5567084d9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43686/0 (socket says 172.21.15.175:43686) 2024-04-25T09:14:23.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8962800640 1 -- 172.21.15.175:0/3774535042 learned_addr learned my addr 172.21.15.175:0/3774535042 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:23.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8961400640 1 --2- 172.21.15.175:0/3774535042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556708523240 0x5567084d89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8961e00640 1 --2- 172.21.15.175:0/3774535042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708522920 0x556708522d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8962800640 1 -- 172.21.15.175:0/3774535042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556708523240 msgr2=0x5567084d89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:23.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8962800640 1 --2- 172.21.15.175:0/3774535042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556708523240 0x5567084d89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8962800640 1 -- 172.21.15.175:0/3774535042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708522920 msgr2=0x556708522d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:23.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8962800640 1 --2- 172.21.15.175:0/3774535042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708522920 0x556708522d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8962800640 1 -- 172.21.15.175:0/3774535042 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567082c9ca0 con 0x5567084d8f30 2024-04-25T09:14:23.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8961e00640 1 --2- 172.21.15.175:0/3774535042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708522920 0x556708522d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:23.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8962800640 1 --2- 172.21.15.175:0/3774535042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 0x5567084d9310 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f89580202e0 tx=0x7f895c06e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9528612ec79d97d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:23.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f894aa00640 1 -- 172.21.15.175:0/3774535042 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89580cc070 con 0x5567084d8f30 2024-04-25T09:14:23.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f894aa00640 1 -- 172.21.15.175:0/3774535042 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895800a480 con 0x5567084d8f30 2024-04-25T09:14:23.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f894aa00640 1 -- 172.21.15.175:0/3774535042 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89500096b0 con 0x5567084d8f30 2024-04-25T09:14:23.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8967cab000 1 -- 172.21.15.175:0/3774535042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 msgr2=0x5567084d9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:23.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8967cab000 1 --2- 172.21.15.175:0/3774535042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 0x5567084d9310 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f89580202e0 tx=0x7f895c06e010 comp rx=0 tx=0).stop 2024-04-25T09:14:23.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8967cab000 1 -- 172.21.15.175:0/3774535042 shutdown_connections 2024-04-25T09:14:23.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8967cab000 1 --2- 172.21.15.175:0/3774535042 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 0x5567084d9310 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8967cab000 1 --2- 172.21.15.175:0/3774535042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556708523240 0x5567084d89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8967cab000 1 --2- 172.21.15.175:0/3774535042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708522920 0x556708522d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8967cab000 1 -- 172.21.15.175:0/3774535042 >> 172.21.15.175:0/3774535042 conn(0x5567084df2a0 msgr2=0x5567084d72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:23.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8967cab000 1 -- 172.21.15.175:0/3774535042 shutdown_connections 2024-04-25T09:14:23.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.616+0000 7f8967cab000 1 -- 172.21.15.175:0/3774535042 wait complete. 2024-04-25T09:14:23.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8967cab000 1 -- start start 2024-04-25T09:14:23.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8967cab000 1 Processor -- start 2024-04-25T09:14:23.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8967cab000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 0x556708529d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8967cab000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708522920 0x55670852a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8967cab000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556708523240 0x5567084dcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8967cab000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567082e2990 con 0x5567084d8f30 2024-04-25T09:14:23.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8967cab000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x556708323e40 con 0x556708522920 2024-04-25T09:14:23.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8967cab000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5567082b3900 con 0x556708523240 2024-04-25T09:14:23.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8967cab000 10 client.0 _ll_register_callbacks cb 0x5567083db1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:14:23.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8961e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 0x556708529d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8961e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 0x556708529d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43694/0 (socket says 172.21.15.175:43694) 2024-04-25T09:14:23.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8961e00640 1 -- 172.21.15.175:0/522835845 learned_addr learned my addr 172.21.15.175:0/522835845 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:23.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8962800640 1 --2- 172.21.15.175:0/522835845 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556708523240 0x5567084dcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8961400640 1 --2- 172.21.15.175:0/522835845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708522920 0x55670852a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8961e00640 1 -- 172.21.15.175:0/522835845 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556708523240 msgr2=0x5567084dcaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:23.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8961e00640 1 --2- 172.21.15.175:0/522835845 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556708523240 0x5567084dcaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8961e00640 1 -- 172.21.15.175:0/522835845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708522920 msgr2=0x55670852a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:23.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8961e00640 1 --2- 172.21.15.175:0/522835845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708522920 0x55670852a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8961e00640 1 -- 172.21.15.175:0/522835845 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5567082e0630 con 0x5567084d8f30 2024-04-25T09:14:23.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8961e00640 1 --2- 172.21.15.175:0/522835845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 0x556708529d60 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f8950014600 tx=0x7f8950009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77ba4f6cf2addcc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:23.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f893f400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:14:23.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f893f400640 1 -- 172.21.15.175:0/522835845 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950012760 con 0x5567084d8f30 2024-04-25T09:14:23.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f893f400640 1 -- 172.21.15.175:0/522835845 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f8950012900 con 0x5567084d8f30 2024-04-25T09:14:23.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8967cab000 1 -- 172.21.15.175:0/522835845 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f895800a480 con 0x5567084d8f30 2024-04-25T09:14:23.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f893f400640 1 -- 172.21.15.175:0/522835845 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8950028050 con 0x5567084d8f30 2024-04-25T09:14:23.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8967cab000 10 client.9009 fetch_fsmap learned FSMap version 99 2024-04-25T09:14:23.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8967cab000 1 -- 172.21.15.175:0/522835845 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) v3 -- 0x5567082b03a0 con 0x5567084d8f30 2024-04-25T09:14:23.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f893f400640 1 -- 172.21.15.175:0/522835845 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895800a480 con 0x5567084d8f30 2024-04-25T09:14:23.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f893f400640 1 -- 172.21.15.175:0/522835845 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 99) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f895002b020 con 0x5567084d8f30 2024-04-25T09:14:23.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8967cab000 10 client.9009 fetch_fsmap finished waiting for FSMap version 99 2024-04-25T09:14:23.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8967cab000 10 client.9009 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:14:23.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8967cab000 20 client.9009 populate_metadata read hostname 'smithi175' 2024-04-25T09:14:23.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8967cab000 1 --2- 172.21.15.175:0/522835845 >> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] conn(0x5567084dd4b0 0x5567084dd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8967cab000 4 client.9009 mds_command: new command op to 8955 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:14:23.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8967cab000 1 -- 172.21.15.175:0/522835845 --> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5567082c3a50 con 0x5567084dd4b0 2024-04-25T09:14:23.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.620+0000 7f8961400640 1 --2- 172.21.15.175:0/522835845 >> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] conn(0x5567084dd4b0 0x5567084dd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.624+0000 7f8961400640 1 --2- 172.21.15.175:0/522835845 >> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] conn(0x5567084dd4b0 0x5567084dd890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22367d3645d37a00 server_cookie=eb48765697843bfb in_seq=0 out_seq=0 2024-04-25T09:14:23.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.624+0000 7f893f400640 10 client.9009 ms_handle_connect on v2:172.21.15.175:6834/386187898 2024-04-25T09:14:23.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.624+0000 7f893f400640 1 -- 172.21.15.175:0/522835845 <== mds.0 v2:172.21.15.175:6834/386187898 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5567082c3a50 con 0x5567084dd4b0 2024-04-25T09:14:23.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.624+0000 7f893f400640 10 client.9009 handle_command_reply: tid=0 2024-04-25T09:14:23.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.624+0000 7f8967cab000 1 client.9009 shutdown 2024-04-25T09:14:23.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.624+0000 7f8967cab000 1 -- 172.21.15.175:0/522835845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 msgr2=0x556708529d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:23.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.624+0000 7f8967cab000 1 --2- 172.21.15.175:0/522835845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 0x556708529d60 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f8950014600 tx=0x7f8950009f90 comp rx=0 tx=0).stop 2024-04-25T09:14:23.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.624+0000 7f8967cab000 1 -- 172.21.15.175:0/522835845 shutdown_connections 2024-04-25T09:14:23.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.624+0000 7f8967cab000 1 --2- 172.21.15.175:0/522835845 >> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] conn(0x5567084dd4b0 0x5567084dd890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.624+0000 7f8967cab000 1 --2- 172.21.15.175:0/522835845 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556708523240 0x5567084dcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.624+0000 7f8967cab000 1 --2- 172.21.15.175:0/522835845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708522920 0x55670852a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.624+0000 7f8967cab000 1 --2- 172.21.15.175:0/522835845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 0x556708529d60 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.624+0000 7f893f400640 0 client.9009 ms_handle_reset on v2:172.21.15.175:6834/386187898 2024-04-25T09:14:23.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.624+0000 7f8967cab000 1 -- 172.21.15.175:0/522835845 >> 172.21.15.175:0/522835845 conn(0x5567084df2a0 msgr2=0x5567084d79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:23.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.624+0000 7f8967cab000 1 -- 172.21.15.175:0/522835845 shutdown_connections 2024-04-25T09:14:23.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.624+0000 7f8967cab000 1 -- 172.21.15.175:0/522835845 wait complete. 2024-04-25T09:14:23.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.624+0000 7f8967cab000 20 client.9009 trim_cache size 0 max 16384 2024-04-25T09:14:23.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8967cab000 1 Processor -- start 2024-04-25T09:14:23.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8967cab000 1 -- start start 2024-04-25T09:14:23.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8967cab000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 0x55670857e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8967cab000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556708522920 0x55670857e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8967cab000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708523240 0x55670857eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8967cab000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c1fb300 con 0x5567084d8f30 2024-04-25T09:14:23.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8967cab000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c154cc0 con 0x556708523240 2024-04-25T09:14:23.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8967cab000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895c1fad00 con 0x556708522920 2024-04-25T09:14:23.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8961e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 0x55670857e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8961e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 0x55670857e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43696/0 (socket says 172.21.15.175:43696) 2024-04-25T09:14:23.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8961e00640 1 -- 172.21.15.175:0/3350684877 learned_addr learned my addr 172.21.15.175:0/3350684877 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:23.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8961400640 1 --2- 172.21.15.175:0/3350684877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556708522920 0x55670857e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.630 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8962800640 1 --2- 172.21.15.175:0/3350684877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708523240 0x55670857eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8961e00640 1 -- 172.21.15.175:0/3350684877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556708522920 msgr2=0x55670857e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:23.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8961e00640 1 --2- 172.21.15.175:0/3350684877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556708522920 0x55670857e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8961e00640 1 -- 172.21.15.175:0/3350684877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708523240 msgr2=0x55670857eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:23.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8961e00640 1 --2- 172.21.15.175:0/3350684877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708523240 0x55670857eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8961e00640 1 -- 172.21.15.175:0/3350684877 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556708523070 con 0x5567084d8f30 2024-04-25T09:14:23.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8962800640 1 --2- 172.21.15.175:0/3350684877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708523240 0x55670857eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:23.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8961e00640 1 --2- 172.21.15.175:0/3350684877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 0x55670857e0b0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f8950006f80 tx=0x7f8950019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2581911e285be4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:23.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f894a000640 1 -- 172.21.15.175:0/3350684877 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950012960 con 0x5567084d8f30 2024-04-25T09:14:23.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f894a000640 1 -- 172.21.15.175:0/3350684877 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8950000e50 con 0x5567084d8f30 2024-04-25T09:14:23.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f894a000640 1 -- 172.21.15.175:0/3350684877 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89500166b0 con 0x5567084d8f30 2024-04-25T09:14:23.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8967cab000 1 -- 172.21.15.175:0/3350684877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 msgr2=0x55670857e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:23.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8967cab000 1 --2- 172.21.15.175:0/3350684877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 0x55670857e0b0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f8950006f80 tx=0x7f8950019000 comp rx=0 tx=0).stop 2024-04-25T09:14:23.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8967cab000 1 -- 172.21.15.175:0/3350684877 shutdown_connections 2024-04-25T09:14:23.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8967cab000 1 --2- 172.21.15.175:0/3350684877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708523240 0x55670857eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8967cab000 1 --2- 172.21.15.175:0/3350684877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556708522920 0x55670857e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8967cab000 1 --2- 172.21.15.175:0/3350684877 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567084d8f30 0x55670857e0b0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8967cab000 1 -- 172.21.15.175:0/3350684877 >> 172.21.15.175:0/3350684877 conn(0x5567084df2a0 msgr2=0x5567084dc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:23.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8967cab000 1 -- 172.21.15.175:0/3350684877 shutdown_connections 2024-04-25T09:14:23.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.640+0000 7f8967cab000 1 -- 172.21.15.175:0/3350684877 wait complete. 2024-04-25T09:14:23.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8967cab000 1 -- start start 2024-04-25T09:14:23.633 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8967cab000 1 Processor -- start 2024-04-25T09:14:23.636 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8967cab000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5567084d8f30 0x55670852f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8967cab000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556708522920 0x55670852f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8967cab000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708523240 0x556708583ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8967cab000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55670832c3d0 con 0x556708522920 2024-04-25T09:14:23.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8967cab000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567083e3d50 con 0x556708523240 2024-04-25T09:14:23.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8967cab000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5567082c2980 con 0x5567084d8f30 2024-04-25T09:14:23.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8967cab000 10 client.0 _ll_register_callbacks cb 0x7f8944003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:14:23.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8961400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556708522920 0x55670852f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8961400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556708522920 0x55670852f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43704/0 (socket says 172.21.15.175:43704) 2024-04-25T09:14:23.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8961400640 1 -- 172.21.15.175:0/31713404 learned_addr learned my addr 172.21.15.175:0/31713404 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:23.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8961e00640 1 --2- 172.21.15.175:0/31713404 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5567084d8f30 0x55670852f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8962800640 1 --2- 172.21.15.175:0/31713404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708523240 0x556708583ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8961400640 1 -- 172.21.15.175:0/31713404 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5567084d8f30 msgr2=0x55670852f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:23.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8961400640 1 --2- 172.21.15.175:0/31713404 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5567084d8f30 0x55670852f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8961400640 1 -- 172.21.15.175:0/31713404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708523240 msgr2=0x556708583ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:23.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8961400640 1 --2- 172.21.15.175:0/31713404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708523240 0x556708583ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8961400640 1 -- 172.21.15.175:0/31713404 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5567083a9600 con 0x556708522920 2024-04-25T09:14:23.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8962800640 1 --2- 172.21.15.175:0/31713404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708523240 0x556708583ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:23.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8961400640 1 --2- 172.21.15.175:0/31713404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556708522920 0x55670852f7e0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f894c0050a0 tx=0x7f894c007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe3ffd783d4f5cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:23.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f893f400640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:14:23.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f893f400640 1 -- 172.21.15.175:0/31713404 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c051e90 con 0x556708522920 2024-04-25T09:14:23.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f893f400640 1 -- 172.21.15.175:0/31713404 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f894c06ecc0 con 0x556708522920 2024-04-25T09:14:23.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8967cab000 1 -- 172.21.15.175:0/31713404 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8950000e50 con 0x556708522920 2024-04-25T09:14:23.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f893f400640 1 -- 172.21.15.175:0/31713404 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) v2 ==== 24+0+0 (secure 0 0 0) 0x7f894c052030 con 0x556708522920 2024-04-25T09:14:23.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8967cab000 10 client.9015 fetch_fsmap learned FSMap version 99 2024-04-25T09:14:23.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8967cab000 1 -- 172.21.15.175:0/31713404 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) v3 -- 0x5567082bc9b0 con 0x556708522920 2024-04-25T09:14:23.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f893f400640 1 -- 172.21.15.175:0/31713404 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8950000e50 con 0x556708522920 2024-04-25T09:14:23.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f893f400640 1 -- 172.21.15.175:0/31713404 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 99) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f894c05daa0 con 0x556708522920 2024-04-25T09:14:23.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8967cab000 10 client.9015 fetch_fsmap finished waiting for FSMap version 99 2024-04-25T09:14:23.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8967cab000 10 client.9015 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:14:23.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8967cab000 20 client.9015 populate_metadata read hostname 'smithi175' 2024-04-25T09:14:23.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8967cab000 1 --2- 172.21.15.175:0/31713404 >> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] conn(0x556708584000 0x5567085843e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8967cab000 4 client.9015 mds_command: new command op to 8955 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:14:23.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8967cab000 1 -- 172.21.15.175:0/31713404 --> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5567083352e0 con 0x556708584000 2024-04-25T09:14:23.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8961e00640 1 --2- 172.21.15.175:0/31713404 >> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] conn(0x556708584000 0x5567085843e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f893f400640 10 client.9015 ms_handle_connect on v2:172.21.15.175:6834/386187898 2024-04-25T09:14:23.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.644+0000 7f8961e00640 1 --2- 172.21.15.175:0/31713404 >> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] conn(0x556708584000 0x5567085843e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a59a72a7e75391f9 server_cookie=dc5dc0a0acaf8412 in_seq=0 out_seq=0 2024-04-25T09:14:23.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f893f400640 1 -- 172.21.15.175:0/31713404 <== mds.0 v2:172.21.15.175:6834/386187898 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x5567083352e0 con 0x556708584000 2024-04-25T09:14:23.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f893f400640 10 client.9015 handle_command_reply: tid=0 2024-04-25T09:14:23.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8967cab000 1 client.9015 shutdown 2024-04-25T09:14:23.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8967cab000 1 -- 172.21.15.175:0/31713404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556708522920 msgr2=0x55670852f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:23.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8967cab000 1 --2- 172.21.15.175:0/31713404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556708522920 0x55670852f7e0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f894c0050a0 tx=0x7f894c007c50 comp rx=0 tx=0).stop 2024-04-25T09:14:23.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8967cab000 1 -- 172.21.15.175:0/31713404 shutdown_connections 2024-04-25T09:14:23.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8967cab000 1 --2- 172.21.15.175:0/31713404 >> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] conn(0x556708584000 0x5567085843e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8967cab000 1 --2- 172.21.15.175:0/31713404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556708523240 0x556708583ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8967cab000 1 --2- 172.21.15.175:0/31713404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x556708522920 0x55670852f7e0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f893f400640 0 client.9015 ms_handle_reset on v2:172.21.15.175:6834/386187898 2024-04-25T09:14:23.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8967cab000 1 --2- 172.21.15.175:0/31713404 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5567084d8f30 0x55670852f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8967cab000 1 -- 172.21.15.175:0/31713404 >> 172.21.15.175:0/31713404 conn(0x5567084df2a0 msgr2=0x55670852a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:23.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8967cab000 1 -- 172.21.15.175:0/31713404 shutdown_connections 2024-04-25T09:14:23.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8967cab000 1 -- 172.21.15.175:0/31713404 wait complete. 2024-04-25T09:14:23.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8967cab000 20 client.9015 trim_cache size 0 max 16384 2024-04-25T09:14:23.641 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:14:23.641 INFO:teuthology.orchestra.run.smithi175.stdout: "cluster_fsid": "8caed986-ca08-40e2-b5a5-12e2aade6223", 2024-04-25T09:14:23.641 INFO:teuthology.orchestra.run.smithi175.stdout: "whoami": 0, 2024-04-25T09:14:23.641 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 8955, 2024-04-25T09:14:23.642 INFO:teuthology.orchestra.run.smithi175.stdout: "want_state": "up:active", 2024-04-25T09:14:23.642 INFO:teuthology.orchestra.run.smithi175.stdout: "state": "up:active", 2024-04-25T09:14:23.642 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs", 2024-04-25T09:14:23.642 INFO:teuthology.orchestra.run.smithi175.stdout: "rank_uptime": 4.5312709819999997, 2024-04-25T09:14:23.642 INFO:teuthology.orchestra.run.smithi175.stdout: "mdsmap_epoch": 99, 2024-04-25T09:14:23.642 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch": 114, 2024-04-25T09:14:23.642 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch_barrier": 114, 2024-04-25T09:14:23.642 INFO:teuthology.orchestra.run.smithi175.stdout: "uptime": 5.4704637930000004 2024-04-25T09:14:23.642 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:14:23.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8964800640 1 -- 172.21.15.175:0/3422107753 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8940066f90 msgr2=0x7f8940069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:23.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8964800640 1 --2- 172.21.15.175:0/3422107753 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8940066f90 0x7f8940069450 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f89580b0000 tx=0x7f89580b5040 comp rx=0 tx=0).stop 2024-04-25T09:14:23.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8964800640 1 -- 172.21.15.175:0/3422107753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f895c142240 msgr2=0x7f895c150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:23.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8964800640 1 --2- 172.21.15.175:0/3422107753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f895c142240 0x7f895c150330 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f894c00f6c0 tx=0x7f894c00fb80 comp rx=0 tx=0).stop 2024-04-25T09:14:23.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8964800640 1 -- 172.21.15.175:0/3422107753 shutdown_connections 2024-04-25T09:14:23.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8964800640 1 --2- 172.21.15.175:0/3422107753 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8940066f90 0x7f8940069450 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8964800640 1 --2- 172.21.15.175:0/3422107753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f895c150870 0x7f895c150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8964800640 1 --2- 172.21.15.175:0/3422107753 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f895c142240 0x7f895c150330 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8964800640 1 --2- 172.21.15.175:0/3422107753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8944004d50 0x7f895c141d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8964800640 1 -- 172.21.15.175:0/3422107753 >> 172.21.15.175:0/3422107753 conn(0x7f895c06ac50 msgr2=0x7f895c1593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:23.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8964800640 1 -- 172.21.15.175:0/3422107753 shutdown_connections 2024-04-25T09:14:23.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.648+0000 7f8964800640 1 -- 172.21.15.175:0/3422107753 wait complete. 2024-04-25T09:14:23.654 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:14:23.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.800+0000 7f45d6c00640 1 Processor -- start 2024-04-25T09:14:23.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.800+0000 7f45d6c00640 1 -- start start 2024-04-25T09:14:23.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45d6c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f45d0144fc0 0x7f45d00cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45d6c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d015c5e0 0x7f45d00cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45d6c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d015cd00 con 0x7f45d01453a0 2024-04-25T09:14:23.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45d6c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d00ce660 con 0x7f45d0144fc0 2024-04-25T09:14:23.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45d6c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00cc930 con 0x7f45d015c5e0 2024-04-25T09:14:23.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45c7400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f45d01453a0 0x7f45d015bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:48212/0 (socket says 172.21.15.175:48212) 2024-04-25T09:14:23.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45c7400640 1 -- 172.21.15.175:0/3228179690 learned_addr learned my addr 172.21.15.175:0/3228179690 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:23.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cfe00640 1 --2- 172.21.15.175:0/3228179690 >> v2:172.21.15.177:3300/0 conn(0x7f45d0144fc0 0x7f45d00cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45d4c00640 1 --2- 172.21.15.175:0/3228179690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d015c5e0 0x7f45d00cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cf400640 1 -- 172.21.15.175:0/3228179690 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282678826 0 0) 0x7f45d015cd00 con 0x7f45d01453a0 2024-04-25T09:14:23.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cf400640 1 -- 172.21.15.175:0/3228179690 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45b4003530 con 0x7f45d01453a0 2024-04-25T09:14:23.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cf400640 1 -- 172.21.15.175:0/3228179690 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2456381063 0 0) 0x7f45b4003530 con 0x7f45d01453a0 2024-04-25T09:14:23.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cf400640 1 -- 172.21.15.175:0/3228179690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d015c5e0 msgr2=0x7f45d00cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:23.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cf400640 1 --2- 172.21.15.175:0/3228179690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d015c5e0 0x7f45d00cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cf400640 1 -- 172.21.15.175:0/3228179690 >> v2:172.21.15.177:3300/0 conn(0x7f45d0144fc0 msgr2=0x7f45d00cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:23.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cf400640 1 --2- 172.21.15.175:0/3228179690 >> v2:172.21.15.177:3300/0 conn(0x7f45d0144fc0 0x7f45d00cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cf400640 1 -- 172.21.15.175:0/3228179690 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d00ccc10 con 0x7f45d01453a0 2024-04-25T09:14:23.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cf400640 1 -- 172.21.15.175:0/3228179690 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f45b8001680 con 0x7f45d01453a0 2024-04-25T09:14:23.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cfe00640 1 --2- 172.21.15.175:0/3228179690 >> v2:172.21.15.177:3300/0 conn(0x7f45d0144fc0 0x7f45d00cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:23.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cf400640 1 -- 172.21.15.175:0/3228179690 >> v1:172.21.15.175:6789/0 conn(0x7f45d01453a0 legacy=0x7f45d015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:23.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cf400640 1 --2- 172.21.15.175:0/3228179690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45b40039c0 0x7f45b4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cf400640 1 --2- 172.21.15.175:0/3228179690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d015c5e0 0x7f45b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cf400640 1 --2- 172.21.15.175:0/3228179690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45b4004d50 0x7f45b40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cf400640 1 -- 172.21.15.175:0/3228179690 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00ce660 con 0x7f45b40039c0 2024-04-25T09:14:23.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cf400640 1 -- 172.21.15.175:0/3228179690 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00cc930 con 0x7f45b4004d50 2024-04-25T09:14:23.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cf400640 1 -- 172.21.15.175:0/3228179690 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b400b9d0 con 0x7f45d015c5e0 2024-04-25T09:14:23.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cfe00640 1 --2- 172.21.15.175:0/3228179690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45b40039c0 0x7f45b4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45c7400640 1 --2- 172.21.15.175:0/3228179690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d015c5e0 0x7f45b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45d4c00640 1 --2- 172.21.15.175:0/3228179690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45b4004d50 0x7f45b40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cfe00640 1 -- 172.21.15.175:0/3228179690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d015c5e0 msgr2=0x7f45b4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:23.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cfe00640 1 --2- 172.21.15.175:0/3228179690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d015c5e0 0x7f45b4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cfe00640 1 -- 172.21.15.175:0/3228179690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45b4004d50 msgr2=0x7f45b40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:23.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cfe00640 1 --2- 172.21.15.175:0/3228179690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45b4004d50 0x7f45b40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.804+0000 7f45cfe00640 1 -- 172.21.15.175:0/3228179690 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4003530 con 0x7f45b40039c0 2024-04-25T09:14:23.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.808+0000 7f45cfe00640 1 --2- 172.21.15.175:0/3228179690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45b40039c0 0x7f45b4003de0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f45c0009cb0 tx=0x7f45c001cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82286d9ecfca1c5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:23.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.808+0000 7f45cf400640 1 -- 172.21.15.175:0/3228179690 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c00b2070 con 0x7f45b40039c0 2024-04-25T09:14:23.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.808+0000 7f45cf400640 1 -- 172.21.15.175:0/3228179690 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c00a5820 con 0x7f45b40039c0 2024-04-25T09:14:23.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.808+0000 7f45cf400640 1 -- 172.21.15.175:0/3228179690 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0009880 con 0x7f45b40039c0 2024-04-25T09:14:23.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.808+0000 7f45d6c00640 1 -- 172.21.15.175:0/3228179690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45b40039c0 msgr2=0x7f45b4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:23.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.808+0000 7f45d6c00640 1 --2- 172.21.15.175:0/3228179690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45b40039c0 0x7f45b4003de0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f45c0009cb0 tx=0x7f45c001cc90 comp rx=0 tx=0).stop 2024-04-25T09:14:23.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.808+0000 7f45d4c00640 1 -- 172.21.15.175:0/3228179690 reap_dead start 2024-04-25T09:14:23.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.808+0000 7f45d6c00640 1 -- 172.21.15.175:0/3228179690 shutdown_connections 2024-04-25T09:14:23.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.808+0000 7f45d6c00640 1 -- 172.21.15.175:0/3228179690 >> 172.21.15.175:0/3228179690 conn(0x7f45d0067150 msgr2=0x7f45d006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:23.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.808+0000 7f45d6c00640 1 -- 172.21.15.175:0/3228179690 shutdown_connections 2024-04-25T09:14:23.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.808+0000 7f45d6c00640 1 -- 172.21.15.175:0/3228179690 wait complete. 2024-04-25T09:14:23.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45d6c00640 1 Processor -- start 2024-04-25T09:14:23.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45d6c00640 1 -- start start 2024-04-25T09:14:23.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45d6c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d013c040 0x7f45d014a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45d6c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45d014a600 0x7f45d00ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45d6c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d013c420 0x7f45d00ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45d6c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00cfa00 con 0x7f45d013c040 2024-04-25T09:14:23.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45d6c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00cf880 con 0x7f45d014a600 2024-04-25T09:14:23.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45d6c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d00cfb80 con 0x7f45d013c420 2024-04-25T09:14:23.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45cfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d013c040 0x7f45d014a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45cfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d013c040 0x7f45d014a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43720/0 (socket says 172.21.15.175:43720) 2024-04-25T09:14:23.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45cfe00640 1 -- 172.21.15.175:0/927353561 learned_addr learned my addr 172.21.15.175:0/927353561 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:23.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45c7400640 1 --2- 172.21.15.175:0/927353561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45d014a600 0x7f45d00ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45d4c00640 1 --2- 172.21.15.175:0/927353561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d013c420 0x7f45d00ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45cfe00640 1 -- 172.21.15.175:0/927353561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d013c420 msgr2=0x7f45d00ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:23.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45cfe00640 1 --2- 172.21.15.175:0/927353561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d013c420 0x7f45d00ace30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45cfe00640 1 -- 172.21.15.175:0/927353561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45d014a600 msgr2=0x7f45d00ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:23.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45cfe00640 1 --2- 172.21.15.175:0/927353561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45d014a600 0x7f45d00ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:23.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45cfe00640 1 -- 172.21.15.175:0/927353561 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d0142e50 con 0x7f45d013c040 2024-04-25T09:14:23.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45cfe00640 1 --2- 172.21.15.175:0/927353561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d013c040 0x7f45d014a0c0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f45c001cac0 tx=0x7f45c0019a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:23.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45ccc00640 1 -- 172.21.15.175:0/927353561 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c00b2040 con 0x7f45d013c040 2024-04-25T09:14:23.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45ccc00640 1 -- 172.21.15.175:0/927353561 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c00bd070 con 0x7f45d013c040 2024-04-25T09:14:23.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45ccc00640 1 -- 172.21.15.175:0/927353561 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c0009880 con 0x7f45d013c040 2024-04-25T09:14:23.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45d6c00640 1 -- 172.21.15.175:0/927353561 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d01430d0 con 0x7f45d013c040 2024-04-25T09:14:23.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45d6c00640 1 -- 172.21.15.175:0/927353561 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d0143690 con 0x7f45d013c040 2024-04-25T09:14:23.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.812+0000 7f45d6c00640 1 -- 172.21.15.175:0/927353561 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45d0074a60 con 0x7f45d013c040 2024-04-25T09:14:23.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.816+0000 7f45ccc00640 1 -- 172.21.15.175:0/927353561 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f45c00b8670 con 0x7f45d013c040 2024-04-25T09:14:23.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.816+0000 7f45ccc00640 1 --2- 172.21.15.175:0/927353561 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f45ac066f60 0x7f45ac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:23.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.816+0000 7f45ccc00640 1 -- 172.21.15.175:0/927353561 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f45c011efb0 con 0x7f45d013c040 2024-04-25T09:14:23.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.816+0000 7f45c7400640 1 --2- 172.21.15.175:0/927353561 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f45ac066f60 0x7f45ac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:23.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.816+0000 7f45c7400640 1 --2- 172.21.15.175:0/927353561 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f45ac066f60 0x7f45ac069420 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f45d014a9e0 tx=0x7f45b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:23.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:23.820+0000 7f45ccc00640 1 -- 172.21.15.175:0/927353561 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f45c00c6020 con 0x7f45d013c040 2024-04-25T09:14:23.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:24.008+0000 7f45d6c00640 1 -- 172.21.15.175:0/927353561 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f45d015fbe0 con 0x7f45d013c040 2024-04-25T09:14:23.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:24.008+0000 7f45ccc00640 1 -- 172.21.15.175:0/927353561 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v99) v1 ==== 53+0+73 (secure 0 0 0) 0x7f45d0142e50 con 0x7f45d013c040 2024-04-25T09:14:23.997 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:14:23.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:24.012+0000 7f45d6c00640 1 -- 172.21.15.175:0/927353561 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f45ac066f60 msgr2=0x7f45ac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:23.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:24.012+0000 7f45d6c00640 1 --2- 172.21.15.175:0/927353561 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f45ac066f60 0x7f45ac069420 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f45d014a9e0 tx=0x7f45b8009040 comp rx=0 tx=0).stop 2024-04-25T09:14:23.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:24.012+0000 7f45d6c00640 1 -- 172.21.15.175:0/927353561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d013c040 msgr2=0x7f45d014a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:24.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:24.012+0000 7f45d6c00640 1 --2- 172.21.15.175:0/927353561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d013c040 0x7f45d014a0c0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f45c001cac0 tx=0x7f45c0019a30 comp rx=0 tx=0).stop 2024-04-25T09:14:24.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:24.012+0000 7f45d6c00640 1 -- 172.21.15.175:0/927353561 shutdown_connections 2024-04-25T09:14:24.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:24.012+0000 7f45d6c00640 1 --2- 172.21.15.175:0/927353561 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f45ac066f60 0x7f45ac069420 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:24.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:24.012+0000 7f45d6c00640 1 --2- 172.21.15.175:0/927353561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f45d013c420 0x7f45d00ace30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:24.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:24.012+0000 7f45d6c00640 1 --2- 172.21.15.175:0/927353561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f45d014a600 0x7f45d00ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:24.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:24.012+0000 7f45d6c00640 1 --2- 172.21.15.175:0/927353561 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45d013c040 0x7f45d014a0c0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:24.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:24.012+0000 7f45d6c00640 1 -- 172.21.15.175:0/927353561 >> 172.21.15.175:0/927353561 conn(0x7f45d00d0210 msgr2=0x7f45d015d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:24.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:24.012+0000 7f45d6c00640 1 -- 172.21.15.175:0/927353561 shutdown_connections 2024-04-25T09:14:24.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:24.012+0000 7f45d6c00640 1 -- 172.21.15.175:0/927353561 wait complete. 2024-04-25T09:14:24.018 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:14:24.018 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:14:24.018 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-25T09:14:24.018 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:14:24.018 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:24.018 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:14:24.018 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:14:24.018 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:14:24.018 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:14:24.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:24.019 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-25T09:14:24.027 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:14:24.027 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:14:24.027 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:14:24.027 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:24.028 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:14:24.028 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:24.028 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:14:24.028 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:24.028 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-25T09:14:24.028 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:14:24.028 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:24.028 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-25T09:14:24.028 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:14:24.028 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:24.028 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:14:24.028 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:24.028 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:14:24.028 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 41855sec preferred_lft 41855sec 2024-04-25T09:14:24.028 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-25T09:14:24.029 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:24.029 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:14:24.029 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:0d:71:4a:a6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:24.029 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:14:24.029 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:24.029 INFO:teuthology.orchestra.run.smithi175.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:14:24.029 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:24.029 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:14:24.029 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:24.029 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:14:24.029 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:24.029 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:14:24.029 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:14:24.030 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:14:24.030 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:24.030 INFO:teuthology.orchestra.run.smithi175.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:14:24.030 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:14:24.030 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:14:24.030 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:24.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:24.031 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:14:24.090 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:14:24.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:24.092 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-25T09:14:24.104 INFO:tasks.ceph.mds.c.smithi175.stderr:2024-04-25T09:14:24.116+0000 7f3160a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:14:24.115 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-25T09:14:24.115 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:14:24.116 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:14:24.116 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:14:24.116 INFO:teuthology.orchestra.run.smithi175.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:14:24.116 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:14:24.116 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:14:24.116 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:14:24.116 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:14:24.116 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:14:24.116 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:14:24.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:24.116 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:14:24.117 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:14:24.117 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:14:24.117 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:14:24.117 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:14:24.117 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:14:24.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:24.205 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:14:24.257 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:14:24.257 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:14:24.257 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:14:24.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:24.258 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-25T09:14:24.321 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:14:24.321 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:24.377 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:14:24.377 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:14:24.377 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:24.429 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:14:24.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:24.429 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:24.524 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:24.524 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:14:24.524 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:14:24.539 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:24.539 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:14:24.540 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:14:24.540 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:14:24.540 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:14:24.550 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:24.550 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:14:24.550 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:14:24.550 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:14:24.550 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:14:24.550 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:14:24.550 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:14:24.551 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:14:24.554 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:14:24.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:24.554 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:24.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:24.620 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:14:24.675 INFO:teuthology.orchestra.run.smithi175.stdout:client7655 2024-04-25T09:14:24.676 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:14:24.676 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:24.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:24.725 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T09:14:24.781 INFO:teuthology.orchestra.run.smithi175.stdout:./ 2024-04-25T09:14:24.782 INFO:teuthology.orchestra.run.smithi175.stdout:./parent 2024-04-25T09:14:24.782 INFO:teuthology.orchestra.run.smithi175.stdout:./parent/flushed 2024-04-25T09:14:24.782 INFO:teuthology.orchestra.run.smithi175.stdout:./parent/flushed/charlie 2024-04-25T09:14:24.782 INFO:teuthology.orchestra.run.smithi175.stdout:./parent/flushed/alpha 2024-04-25T09:14:24.782 INFO:teuthology.orchestra.run.smithi175.stdout:./parent/unflushed 2024-04-25T09:14:24.782 INFO:teuthology.orchestra.run.smithi175.stdout:./parent/unflushed/jfile 2024-04-25T09:14:24.783 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:24.783 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:24.784 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:24.784 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:24.784 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T09:14:24.784 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:24.890 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:14:24.890 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:24.897 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:24.897 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:24.897 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:24.897 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:24.897 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T09:14:24.897 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:25.001 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627776 2024-04-25T09:14:25.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:25.010 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:25.010 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:25.010 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:25.011 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:25.011 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-25T09:14:25.011 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:25.117 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627777 2024-04-25T09:14:25.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:25.126 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:25.126 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:25.126 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:25.126 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:25.126 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-25T09:14:25.126 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:25.232 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627780 2024-04-25T09:14:25.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:25.242 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:25.242 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:25.242 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:25.242 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:25.242 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-25T09:14:25.242 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:25.349 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627778 2024-04-25T09:14:25.351 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:25.358 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:25.358 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:25.358 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:25.358 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:25.358 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-25T09:14:25.358 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:25.464 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627781 2024-04-25T09:14:25.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:25.474 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:25.474 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:25.474 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:25.474 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:25.474 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-25T09:14:25.475 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:25.579 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627782 2024-04-25T09:14:25.582 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:25.588 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:14:25.588 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:25.637 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:14:25.637 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:25.689 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:14:25.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.879+0000 7f5179c00640 1 Processor -- start 2024-04-25T09:14:25.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.879+0000 7f5179c00640 1 -- start start 2024-04-25T09:14:25.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.883+0000 7f5179c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51740cd890 0x7f517409a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:25.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.883+0000 7f5179c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f517409ab50 0x7f5174099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:25.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.883+0000 7f5179c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51740cf740 con 0x7f5174099f90 2024-04-25T09:14:25.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.883+0000 7f5179c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517406c6e0 con 0x7f517409ab50 2024-04-25T09:14:25.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.883+0000 7f5179c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517406c9c0 con 0x7f51740cd890 2024-04-25T09:14:25.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.883+0000 7f5173e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51740cd890 0x7f517409a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:25.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.883+0000 7f5173e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51740cd890 0x7f517409a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:47348/0 (socket says 172.21.15.175:47348) 2024-04-25T09:14:25.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.883+0000 7f5173e00640 1 -- 172.21.15.175:0/584414462 learned_addr learned my addr 172.21.15.175:0/584414462 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:25.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.883+0000 7f516b400640 1 --2- 172.21.15.175:0/584414462 >> v2:172.21.15.177:3300/0 conn(0x7f517409ab50 0x7f5174099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:25.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.883+0000 7f5179200640 1 --1- 172.21.15.175:0/584414462 >> v1:172.21.15.177:6789/0 conn(0x7f5174099f90 0x7f51741618b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:43788/0 (socket says 172.21.15.175:43788) 2024-04-25T09:14:25.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.883+0000 7f5173e00640 1 -- 172.21.15.175:0/584414462 >> v2:172.21.15.177:3300/0 conn(0x7f517409ab50 msgr2=0x7f5174099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:25.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.883+0000 7f5173e00640 1 --2- 172.21.15.175:0/584414462 >> v2:172.21.15.177:3300/0 conn(0x7f517409ab50 0x7f5174099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:25.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.883+0000 7f5173e00640 1 -- 172.21.15.175:0/584414462 >> v1:172.21.15.177:6789/0 conn(0x7f5174099f90 legacy=0x7f51741618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:25.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.883+0000 7f5173e00640 1 -- 172.21.15.175:0/584414462 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517406cca0 con 0x7f51740cd890 2024-04-25T09:14:25.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.887+0000 7f5173e00640 1 --2- 172.21.15.175:0/584414462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51740cd890 0x7f517409a610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5164009870 tx=0x7f516401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a8259e45daf4cfd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:25.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.887+0000 7f5173400640 1 -- 172.21.15.175:0/584414462 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51640b0070 con 0x7f51740cd890 2024-04-25T09:14:25.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.887+0000 7f5173400640 1 -- 172.21.15.175:0/584414462 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51640ab600 con 0x7f51740cd890 2024-04-25T09:14:25.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.887+0000 7f5173400640 1 -- 172.21.15.175:0/584414462 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51640ab9d0 con 0x7f51740cd890 2024-04-25T09:14:25.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.887+0000 7f5179c00640 1 -- 172.21.15.175:0/584414462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51740cd890 msgr2=0x7f517409a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:25.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.887+0000 7f5179c00640 1 --2- 172.21.15.175:0/584414462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51740cd890 0x7f517409a610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5164009870 tx=0x7f516401c560 comp rx=0 tx=0).stop 2024-04-25T09:14:25.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.887+0000 7f5179c00640 1 -- 172.21.15.175:0/584414462 shutdown_connections 2024-04-25T09:14:25.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.887+0000 7f5179c00640 1 --2- 172.21.15.175:0/584414462 >> v2:172.21.15.177:3300/0 conn(0x7f517409ab50 0x7f5174099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:25.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.887+0000 7f5179c00640 1 --2- 172.21.15.175:0/584414462 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f51740cd890 0x7f517409a610 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:25.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.887+0000 7f5179c00640 1 -- 172.21.15.175:0/584414462 >> 172.21.15.175:0/584414462 conn(0x7f51740b31b0 msgr2=0x7f51740b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:25.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.887+0000 7f5179c00640 1 -- 172.21.15.175:0/584414462 shutdown_connections 2024-04-25T09:14:25.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.887+0000 7f5179c00640 1 -- 172.21.15.175:0/584414462 wait complete. 2024-04-25T09:14:25.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.887+0000 7f5179c00640 1 Processor -- start 2024-04-25T09:14:25.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.887+0000 7f5179c00640 1 -- start start 2024-04-25T09:14:25.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.887+0000 7f5179c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5174099f90 0x7f517414dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:25.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.887+0000 7f5179c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f517409ab50 0x7f5174159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:25.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f5179c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51740cd890 0x7f517406fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:25.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f5179c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51740ccd20 con 0x7f517409ab50 2024-04-25T09:14:25.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f5179c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517406d780 con 0x7f51740cd890 2024-04-25T09:14:25.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f5179c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517416abf0 con 0x7f5174099f90 2024-04-25T09:14:25.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f516b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f517409ab50 0x7f5174159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:25.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f516b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f517409ab50 0x7f5174159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43722/0 (socket says 172.21.15.175:43722) 2024-04-25T09:14:25.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f516b400640 1 -- 172.21.15.175:0/2005430920 learned_addr learned my addr 172.21.15.175:0/2005430920 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:25.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f5179200640 1 --2- 172.21.15.175:0/2005430920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51740cd890 0x7f517406fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:25.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f5173e00640 1 --2- 172.21.15.175:0/2005430920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5174099f90 0x7f517414dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:25.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f516b400640 1 -- 172.21.15.175:0/2005430920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5174099f90 msgr2=0x7f517414dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:25.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f516b400640 1 --2- 172.21.15.175:0/2005430920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5174099f90 0x7f517414dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:25.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f516b400640 1 -- 172.21.15.175:0/2005430920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51740cd890 msgr2=0x7f517406fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:25.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f516b400640 1 --2- 172.21.15.175:0/2005430920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51740cd890 0x7f517406fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:25.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f516b400640 1 -- 172.21.15.175:0/2005430920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51740c6ce0 con 0x7f517409ab50 2024-04-25T09:14:25.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f516b400640 1 --2- 172.21.15.175:0/2005430920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f517409ab50 0x7f5174159800 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f515c00e9e0 tx=0x7f515c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:25.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f5170c00640 1 -- 172.21.15.175:0/2005430920 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c017070 con 0x7f517409ab50 2024-04-25T09:14:25.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f5170c00640 1 -- 172.21.15.175:0/2005430920 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c00c9d0 con 0x7f517409ab50 2024-04-25T09:14:25.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f5179c00640 1 -- 172.21.15.175:0/2005430920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51740c6f80 con 0x7f517409ab50 2024-04-25T09:14:25.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f5170c00640 1 -- 172.21.15.175:0/2005430920 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c00cda0 con 0x7f517409ab50 2024-04-25T09:14:25.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f5179c00640 1 -- 172.21.15.175:0/2005430920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51740c7500 con 0x7f517409ab50 2024-04-25T09:14:25.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f5179c00640 1 -- 172.21.15.175:0/2005430920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5174074a60 con 0x7f517409ab50 2024-04-25T09:14:25.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.891+0000 7f5170c00640 1 -- 172.21.15.175:0/2005430920 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f515c01a070 con 0x7f517409ab50 2024-04-25T09:14:25.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.895+0000 7f5170c00640 1 --2- 172.21.15.175:0/2005430920 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5150066f60 0x7f5150069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:25.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.895+0000 7f5170c00640 1 -- 172.21.15.175:0/2005430920 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f515c085110 con 0x7f517409ab50 2024-04-25T09:14:25.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.895+0000 7f5173e00640 1 --2- 172.21.15.175:0/2005430920 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5150066f60 0x7f5150069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:25.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.895+0000 7f5173e00640 1 --2- 172.21.15.175:0/2005430920 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5150066f60 0x7f5150069420 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f51640ad000 tx=0x7f51640a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:25.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:25.899+0000 7f5170c00640 1 -- 172.21.15.175:0/2005430920 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f515c055a60 con 0x7f517409ab50 2024-04-25T09:14:26.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.055+0000 7f5179c00640 1 -- 172.21.15.175:0/2005430920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f517414e800 con 0x7f517409ab50 2024-04-25T09:14:26.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.055+0000 7f5170c00640 1 -- 172.21.15.175:0/2005430920 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+16794 (secure 0 0 0) 0x7f515c059b00 con 0x7f517409ab50 2024-04-25T09:14:26.044 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:26.045 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":114,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:14:18.106915+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:14:01.413477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:14:02.699273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6836/4128642659":"2024-04-26T09:14:18.106892+0000","172.21.15.175:6834/4128642659":"2024-04-26T09:14:18.106892+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:14:26.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.059+0000 7f5179c00640 1 -- 172.21.15.175:0/2005430920 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5150066f60 msgr2=0x7f5150069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.059+0000 7f5179c00640 1 --2- 172.21.15.175:0/2005430920 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5150066f60 0x7f5150069420 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f51640ad000 tx=0x7f51640a6000 comp rx=0 tx=0).stop 2024-04-25T09:14:26.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.059+0000 7f5179c00640 1 -- 172.21.15.175:0/2005430920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f517409ab50 msgr2=0x7f5174159800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.059+0000 7f5179c00640 1 --2- 172.21.15.175:0/2005430920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f517409ab50 0x7f5174159800 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f515c00e9e0 tx=0x7f515c00eea0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.059+0000 7f5179c00640 1 -- 172.21.15.175:0/2005430920 shutdown_connections 2024-04-25T09:14:26.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.059+0000 7f5179c00640 1 --2- 172.21.15.175:0/2005430920 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5150066f60 0x7f5150069420 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.059+0000 7f5179c00640 1 --2- 172.21.15.175:0/2005430920 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51740cd890 0x7f517406fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.059+0000 7f5179c00640 1 --2- 172.21.15.175:0/2005430920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f517409ab50 0x7f5174159800 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.047 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.059+0000 7f5179c00640 1 --2- 172.21.15.175:0/2005430920 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5174099f90 0x7f517414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.059+0000 7f5179c00640 1 -- 172.21.15.175:0/2005430920 >> 172.21.15.175:0/2005430920 conn(0x7f51740b31b0 msgr2=0x7f51740cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:26.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.059+0000 7f5179c00640 1 -- 172.21.15.175:0/2005430920 shutdown_connections 2024-04-25T09:14:26.048 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.059+0000 7f5179c00640 1 -- 172.21.15.175:0/2005430920 wait complete. 2024-04-25T09:14:26.066 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:14:01.413477+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:14:02.699273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:14:26.066 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:14:26.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.215+0000 7f5b06e00640 1 Processor -- start 2024-04-25T09:14:26.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5b06e00640 1 -- start start 2024-04-25T09:14:26.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5b06e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b000b4800 0x7f5b00165550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5b06e00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0006db60 con 0x7f5b0015af20 2024-04-25T09:14:26.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5b06e00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0006de40 con 0x7f5b000cbe60 2024-04-25T09:14:26.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5b06e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0006e120 con 0x7f5b000b4800 2024-04-25T09:14:26.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5aff400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5b0015af20 0x7f5b000b40f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:48214/0 (socket says 172.21.15.175:48214) 2024-04-25T09:14:26.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5aff400640 1 -- 172.21.15.175:0/420548318 learned_addr learned my addr 172.21.15.175:0/420548318 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:26.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5b04e00640 1 --2- 172.21.15.175:0/420548318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b000b4800 0x7f5b00165550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5afea00640 1 -- 172.21.15.175:0/420548318 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566689699 0 0) 0x7f5b0006db60 con 0x7f5b0015af20 2024-04-25T09:14:26.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5afea00640 1 -- 172.21.15.175:0/420548318 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ae4005740 con 0x7f5b0015af20 2024-04-25T09:14:26.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5afea00640 1 -- 172.21.15.175:0/420548318 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3858328771 0 0) 0x7f5ae4005740 con 0x7f5b0015af20 2024-04-25T09:14:26.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5afea00640 1 -- 172.21.15.175:0/420548318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b000b4800 msgr2=0x7f5b00165550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:26.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5afea00640 1 --2- 172.21.15.175:0/420548318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b000b4800 0x7f5b00165550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5afea00640 1 -- 172.21.15.175:0/420548318 >> v1:172.21.15.177:6789/0 conn(0x7f5b000cbe60 legacy=0x7f5b0006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5afea00640 1 -- 172.21.15.175:0/420548318 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0015c2f0 con 0x7f5b0015af20 2024-04-25T09:14:26.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5afea00640 1 -- 172.21.15.175:0/420548318 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f5aec001680 con 0x7f5b0015af20 2024-04-25T09:14:26.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5afea00640 1 -- 172.21.15.175:0/420548318 >> v1:172.21.15.175:6789/0 conn(0x7f5b0015af20 legacy=0x7f5b000b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5afea00640 1 --2- 172.21.15.175:0/420548318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b000b4800 0x7f5ae4005c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5afea00640 1 --2- 172.21.15.175:0/420548318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae4006140 0x7f5ae4006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5afea00640 1 --2- 172.21.15.175:0/420548318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ae4006f60 0x7f5ae40073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5afea00640 1 -- 172.21.15.175:0/420548318 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0006e120 con 0x7f5ae4006140 2024-04-25T09:14:26.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5afea00640 1 -- 172.21.15.175:0/420548318 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae400dc90 con 0x7f5ae4006f60 2024-04-25T09:14:26.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5afea00640 1 -- 172.21.15.175:0/420548318 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae400de90 con 0x7f5b000b4800 2024-04-25T09:14:26.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5aff400640 1 --2- 172.21.15.175:0/420548318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae4006140 0x7f5ae4006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5affe00640 1 --2- 172.21.15.175:0/420548318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b000b4800 0x7f5ae4005c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5b04e00640 1 --2- 172.21.15.175:0/420548318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ae4006f60 0x7f5ae40073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5aff400640 1 -- 172.21.15.175:0/420548318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b000b4800 msgr2=0x7f5ae4005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:26.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5aff400640 1 --2- 172.21.15.175:0/420548318 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b000b4800 0x7f5ae4005c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5aff400640 1 -- 172.21.15.175:0/420548318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ae4006f60 msgr2=0x7f5ae40073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:26.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5aff400640 1 --2- 172.21.15.175:0/420548318 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ae4006f60 0x7f5ae40073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.219+0000 7f5aff400640 1 -- 172.21.15.175:0/420548318 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae4005740 con 0x7f5ae4006140 2024-04-25T09:14:26.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.223+0000 7f5aff400640 1 --2- 172.21.15.175:0/420548318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae4006140 0x7f5ae4006a20 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00c110 tx=0x7f5aec01cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936f60831c9751a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:26.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.223+0000 7f5afea00640 1 -- 172.21.15.175:0/420548318 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec007c50 con 0x7f5ae4006140 2024-04-25T09:14:26.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.223+0000 7f5afea00640 1 -- 172.21.15.175:0/420548318 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec0a9020 con 0x7f5ae4006140 2024-04-25T09:14:26.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.223+0000 7f5afea00640 1 -- 172.21.15.175:0/420548318 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec005b20 con 0x7f5ae4006140 2024-04-25T09:14:26.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.223+0000 7f5b06e00640 1 -- 172.21.15.175:0/420548318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae4006140 msgr2=0x7f5ae4006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.223+0000 7f5b06e00640 1 --2- 172.21.15.175:0/420548318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae4006140 0x7f5ae4006a20 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00c110 tx=0x7f5aec01cba0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.223+0000 7f5b04e00640 1 -- 172.21.15.175:0/420548318 reap_dead start 2024-04-25T09:14:26.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.223+0000 7f5b06e00640 1 -- 172.21.15.175:0/420548318 shutdown_connections 2024-04-25T09:14:26.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.223+0000 7f5b06e00640 1 -- 172.21.15.175:0/420548318 >> 172.21.15.175:0/420548318 conn(0x7f5b0006ac50 msgr2=0x7f5b0006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:26.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.223+0000 7f5b06e00640 1 -- 172.21.15.175:0/420548318 shutdown_connections 2024-04-25T09:14:26.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.223+0000 7f5b06e00640 1 -- 172.21.15.175:0/420548318 wait complete. 2024-04-25T09:14:26.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5b06e00640 1 Processor -- start 2024-04-25T09:14:26.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5b06e00640 1 -- start start 2024-04-25T09:14:26.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5b06e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae4006140 0x7f5b001f3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5b06e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b000ad280 0x7f5b000ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5b06e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b001e56b0 0x7f5b001e5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5b06e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0015d820 con 0x7f5ae4006140 2024-04-25T09:14:26.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5b06e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b000cc450 con 0x7f5b000ad280 2024-04-25T09:14:26.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5b06e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0015d9a0 con 0x7f5b001e56b0 2024-04-25T09:14:26.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5affe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae4006140 0x7f5b001f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5affe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae4006140 0x7f5b001f3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43754/0 (socket says 172.21.15.175:43754) 2024-04-25T09:14:26.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5affe00640 1 -- 172.21.15.175:0/540139521 learned_addr learned my addr 172.21.15.175:0/540139521 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:26.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5aff400640 1 --2- 172.21.15.175:0/540139521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b000ad280 0x7f5b000ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5b04e00640 1 --2- 172.21.15.175:0/540139521 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b001e56b0 0x7f5b001e5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5affe00640 1 -- 172.21.15.175:0/540139521 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b001e56b0 msgr2=0x7f5b001e5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5affe00640 1 --2- 172.21.15.175:0/540139521 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b001e56b0 0x7f5b001e5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5affe00640 1 -- 172.21.15.175:0/540139521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b000ad280 msgr2=0x7f5b000ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5affe00640 1 --2- 172.21.15.175:0/540139521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b000ad280 0x7f5b000ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5affe00640 1 -- 172.21.15.175:0/540139521 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0014bd20 con 0x7f5ae4006140 2024-04-25T09:14:26.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5b04e00640 1 --2- 172.21.15.175:0/540139521 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b001e56b0 0x7f5b001e5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:26.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5affe00640 1 --2- 172.21.15.175:0/540139521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae4006140 0x7f5b001f3180 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f5af0011bb0 tx=0x7f5af000f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:26.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5af7e00640 1 -- 172.21.15.175:0/540139521 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af0019020 con 0x7f5ae4006140 2024-04-25T09:14:26.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5af7e00640 1 -- 172.21.15.175:0/540139521 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af000fc50 con 0x7f5ae4006140 2024-04-25T09:14:26.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5b06e00640 1 -- 172.21.15.175:0/540139521 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b001f36c0 con 0x7f5ae4006140 2024-04-25T09:14:26.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5af7e00640 1 -- 172.21.15.175:0/540139521 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af00050d0 con 0x7f5ae4006140 2024-04-25T09:14:26.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5b06e00640 1 -- 172.21.15.175:0/540139521 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b000ae120 con 0x7f5ae4006140 2024-04-25T09:14:26.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.227+0000 7f5b06e00640 1 -- 172.21.15.175:0/540139521 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b00075160 con 0x7f5ae4006140 2024-04-25T09:14:26.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.231+0000 7f5af7e00640 1 -- 172.21.15.175:0/540139521 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5af001c020 con 0x7f5ae4006140 2024-04-25T09:14:26.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.231+0000 7f5af7e00640 1 --2- 172.21.15.175:0/540139521 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ae0066f90 0x7f5ae0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.231+0000 7f5af7e00640 1 -- 172.21.15.175:0/540139521 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5af0088800 con 0x7f5ae4006140 2024-04-25T09:14:26.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.231+0000 7f5aff400640 1 --2- 172.21.15.175:0/540139521 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ae0066f90 0x7f5ae0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.231+0000 7f5aff400640 1 --2- 172.21.15.175:0/540139521 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ae0066f90 0x7f5ae0069450 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00c110 tx=0x7f5aec0b0040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:26.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.235+0000 7f5af7e00640 1 -- 172.21.15.175:0/540139521 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5af0023020 con 0x7f5ae4006140 2024-04-25T09:14:26.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.391+0000 7f5b06e00640 1 -- 172.21.15.175:0/540139521 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b000712d0 con 0x7f5ae4006140 2024-04-25T09:14:26.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.391+0000 7f5af7e00640 1 -- 172.21.15.175:0/540139521 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v114) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5af0013330 con 0x7f5ae4006140 2024-04-25T09:14:26.381 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:14:26.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.391+0000 7f5b06e00640 1 -- 172.21.15.175:0/540139521 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ae0066f90 msgr2=0x7f5ae0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.391+0000 7f5b06e00640 1 --2- 172.21.15.175:0/540139521 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ae0066f90 0x7f5ae0069450 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00c110 tx=0x7f5aec0b0040 comp rx=0 tx=0).stop 2024-04-25T09:14:26.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.391+0000 7f5b06e00640 1 -- 172.21.15.175:0/540139521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae4006140 msgr2=0x7f5b001f3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.391+0000 7f5b06e00640 1 --2- 172.21.15.175:0/540139521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae4006140 0x7f5b001f3180 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f5af0011bb0 tx=0x7f5af000f5a0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.395+0000 7f5b06e00640 1 -- 172.21.15.175:0/540139521 shutdown_connections 2024-04-25T09:14:26.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.395+0000 7f5b06e00640 1 --2- 172.21.15.175:0/540139521 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ae0066f90 0x7f5ae0069450 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.395+0000 7f5b06e00640 1 --2- 172.21.15.175:0/540139521 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b001e56b0 0x7f5b001e5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.395+0000 7f5b06e00640 1 --2- 172.21.15.175:0/540139521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b000ad280 0x7f5b000ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.395+0000 7f5b06e00640 1 --2- 172.21.15.175:0/540139521 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5ae4006140 0x7f5b001f3180 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.395+0000 7f5b06e00640 1 -- 172.21.15.175:0/540139521 >> 172.21.15.175:0/540139521 conn(0x7f5b0006ac50 msgr2=0x7f5b00071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:26.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.395+0000 7f5b06e00640 1 -- 172.21.15.175:0/540139521 shutdown_connections 2024-04-25T09:14:26.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.395+0000 7f5b06e00640 1 -- 172.21.15.175:0/540139521 wait complete. 2024-04-25T09:14:26.401 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:14:26.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.551+0000 7f514b200640 1 Processor -- start 2024-04-25T09:14:26.540 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.551+0000 7f514b200640 1 -- start start 2024-04-25T09:14:26.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.555+0000 7f514b200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f514415df00 0x7f51440ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.555+0000 7f514b200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f51440ce930 0x7f51440cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.555+0000 7f514b200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51440b1bc0 con 0x7f51440ae640 2024-04-25T09:14:26.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.555+0000 7f514b200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51440ae1b0 con 0x7f51440ce930 2024-04-25T09:14:26.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.555+0000 7f514b200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51440cf400 con 0x7f514415df00 2024-04-25T09:14:26.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.555+0000 7f5149400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f51440ce930 0x7f51440cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.555+0000 7f5149400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f51440ce930 0x7f51440cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43758/0 (socket says 172.21.15.175:43758) 2024-04-25T09:14:26.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.555+0000 7f5149e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f514415df00 0x7f51440ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.555+0000 7f5149400640 1 -- 172.21.15.175:0/3574862122 learned_addr learned my addr 172.21.15.175:0/3574862122 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:26.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.555+0000 7f5149400640 1 -- 172.21.15.175:0/3574862122 >> v2:172.21.15.177:3300/0 conn(0x7f514415df00 msgr2=0x7f51440ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:26.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.555+0000 7f5149400640 1 --2- 172.21.15.175:0/3574862122 >> v2:172.21.15.177:3300/0 conn(0x7f514415df00 0x7f51440ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.555+0000 7f5149400640 1 -- 172.21.15.175:0/3574862122 >> v1:172.21.15.175:6789/0 conn(0x7f51440ae640 legacy=0x7f51440aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.555+0000 7f5149400640 1 -- 172.21.15.175:0/3574862122 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51440b1e80 con 0x7f51440ce930 2024-04-25T09:14:26.543 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.555+0000 7f5148a00640 1 -- 172.21.15.175:0/3574862122 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004172364 0 0) 0x7f51440b1bc0 con 0x7f51440ae640 2024-04-25T09:14:26.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.555+0000 7f5149400640 1 --2- 172.21.15.175:0/3574862122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51440ce930 0x7f51440cedc0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f51440d1620 tx=0x7f513401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50999100e198c690 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:26.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f5148a00640 1 -- 172.21.15.175:0/3574862122 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51340b0070 con 0x7f51440ce930 2024-04-25T09:14:26.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f5148a00640 1 -- 172.21.15.175:0/3574862122 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51340ab600 con 0x7f51440ce930 2024-04-25T09:14:26.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f5148a00640 1 -- 172.21.15.175:0/3574862122 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51340ab9d0 con 0x7f51440ce930 2024-04-25T09:14:26.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f514b200640 1 -- 172.21.15.175:0/3574862122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51440ce930 msgr2=0x7f51440cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f514b200640 1 --2- 172.21.15.175:0/3574862122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51440ce930 0x7f51440cedc0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f51440d1620 tx=0x7f513401c490 comp rx=0 tx=0).stop 2024-04-25T09:14:26.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f514b200640 1 -- 172.21.15.175:0/3574862122 shutdown_connections 2024-04-25T09:14:26.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f514b200640 1 --2- 172.21.15.175:0/3574862122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51440ce930 0x7f51440cedc0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f514b200640 1 --2- 172.21.15.175:0/3574862122 >> v2:172.21.15.177:3300/0 conn(0x7f514415df00 0x7f51440ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f514b200640 1 -- 172.21.15.175:0/3574862122 >> 172.21.15.175:0/3574862122 conn(0x7f5144099a50 msgr2=0x7f51440b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:26.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f514b200640 1 -- 172.21.15.175:0/3574862122 shutdown_connections 2024-04-25T09:14:26.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f514b200640 1 -- 172.21.15.175:0/3574862122 wait complete. 2024-04-25T09:14:26.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f514b200640 1 Processor -- start 2024-04-25T09:14:26.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f514b200640 1 -- start start 2024-04-25T09:14:26.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f514b200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51440ae640 0x7f5144153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f514b200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51440ce930 0x7f51441676f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f514b200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f514415df00 0x7f51440c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f514b200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51440afb20 con 0x7f51440ce930 2024-04-25T09:14:26.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f514b200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51440b12e0 con 0x7f51440ae640 2024-04-25T09:14:26.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f514b200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5144165ce0 con 0x7f514415df00 2024-04-25T09:14:26.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f5149400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51440ce930 0x7f51441676f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f5149400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51440ce930 0x7f51441676f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43768/0 (socket says 172.21.15.175:43768) 2024-04-25T09:14:26.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f5149400640 1 -- 172.21.15.175:0/445372924 learned_addr learned my addr 172.21.15.175:0/445372924 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:26.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f5149e00640 1 --2- 172.21.15.175:0/445372924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51440ae640 0x7f5144153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f514a800640 1 --2- 172.21.15.175:0/445372924 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f514415df00 0x7f51440c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f5149400640 1 -- 172.21.15.175:0/445372924 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f514415df00 msgr2=0x7f51440c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f5149400640 1 --2- 172.21.15.175:0/445372924 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f514415df00 0x7f51440c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f5149400640 1 -- 172.21.15.175:0/445372924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51440ae640 msgr2=0x7f5144153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f5149400640 1 --2- 172.21.15.175:0/445372924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51440ae640 0x7f5144153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.559+0000 7f5149400640 1 -- 172.21.15.175:0/445372924 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5144168090 con 0x7f51440ce930 2024-04-25T09:14:26.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.563+0000 7f5149400640 1 --2- 172.21.15.175:0/445372924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51440ce930 0x7f51441676f0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f51340190a0 tx=0x7f5134019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:26.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.563+0000 7f513e000640 1 -- 172.21.15.175:0/445372924 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51340b0040 con 0x7f51440ce930 2024-04-25T09:14:26.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.563+0000 7f513e000640 1 -- 172.21.15.175:0/445372924 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51340b4420 con 0x7f51440ce930 2024-04-25T09:14:26.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.563+0000 7f513e000640 1 -- 172.21.15.175:0/445372924 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51340b47f0 con 0x7f51440ce930 2024-04-25T09:14:26.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.563+0000 7f514b200640 1 -- 172.21.15.175:0/445372924 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5144168370 con 0x7f51440ce930 2024-04-25T09:14:26.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.563+0000 7f514b200640 1 -- 172.21.15.175:0/445372924 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51440c8de0 con 0x7f51440ce930 2024-04-25T09:14:26.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.563+0000 7f514b200640 1 -- 172.21.15.175:0/445372924 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5144074a60 con 0x7f51440ce930 2024-04-25T09:14:26.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.563+0000 7f513e000640 1 -- 172.21.15.175:0/445372924 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f51340b4990 con 0x7f51440ce930 2024-04-25T09:14:26.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.563+0000 7f513e000640 1 --2- 172.21.15.175:0/445372924 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5128066f60 0x7f5128069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.563+0000 7f513e000640 1 -- 172.21.15.175:0/445372924 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f513411ebd0 con 0x7f51440ce930 2024-04-25T09:14:26.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.563+0000 7f5149e00640 1 --2- 172.21.15.175:0/445372924 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5128066f60 0x7f5128069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.567+0000 7f5149e00640 1 --2- 172.21.15.175:0/445372924 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5128066f60 0x7f5128069420 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5138009a50 tx=0x7f5138008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:26.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.567+0000 7f513e000640 1 -- 172.21.15.175:0/445372924 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5134016110 con 0x7f51440ce930 2024-04-25T09:14:26.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.719+0000 7f514b200640 1 -- 172.21.15.175:0/445372924 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51440af900 con 0x7f51440ce930 2024-04-25T09:14:26.709 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.719+0000 7f513e000640 1 -- 172.21.15.175:0/445372924 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v114) v1 ==== 104+0+11 (secure 0 0 0) 0x7f51340efc90 con 0x7f51440ce930 2024-04-25T09:14:26.709 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:14:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.723+0000 7f514b200640 1 -- 172.21.15.175:0/445372924 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5128066f60 msgr2=0x7f5128069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.723+0000 7f514b200640 1 --2- 172.21.15.175:0/445372924 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5128066f60 0x7f5128069420 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5138009a50 tx=0x7f5138008040 comp rx=0 tx=0).stop 2024-04-25T09:14:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.723+0000 7f514b200640 1 -- 172.21.15.175:0/445372924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51440ce930 msgr2=0x7f51441676f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.723+0000 7f514b200640 1 --2- 172.21.15.175:0/445372924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51440ce930 0x7f51441676f0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f51340190a0 tx=0x7f5134019230 comp rx=0 tx=0).stop 2024-04-25T09:14:26.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.723+0000 7f514b200640 1 -- 172.21.15.175:0/445372924 shutdown_connections 2024-04-25T09:14:26.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.723+0000 7f514b200640 1 --2- 172.21.15.175:0/445372924 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5128066f60 0x7f5128069420 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.723+0000 7f514b200640 1 --2- 172.21.15.175:0/445372924 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f514415df00 0x7f51440c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.723+0000 7f514b200640 1 --2- 172.21.15.175:0/445372924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f51440ce930 0x7f51441676f0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.723+0000 7f514b200640 1 --2- 172.21.15.175:0/445372924 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f51440ae640 0x7f5144153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.723+0000 7f514b200640 1 -- 172.21.15.175:0/445372924 >> 172.21.15.175:0/445372924 conn(0x7f5144099a50 msgr2=0x7f51440afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:26.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.723+0000 7f514b200640 1 -- 172.21.15.175:0/445372924 shutdown_connections 2024-04-25T09:14:26.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.723+0000 7f514b200640 1 -- 172.21.15.175:0/445372924 wait complete. 2024-04-25T09:14:26.730 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:14:26.868 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.879+0000 7fce5fe00640 1 Processor -- start 2024-04-25T09:14:26.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.879+0000 7fce5fe00640 1 -- start start 2024-04-25T09:14:26.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.883+0000 7fce5fe00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fce6015db00 0x7fce6006ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.883+0000 7fce5fe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce60066a10 0x7fce6006b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.883+0000 7fce5fe00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce60066ed0 con 0x7fce600b2cb0 2024-04-25T09:14:26.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.883+0000 7fce5fe00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce600cdc00 con 0x7fce6015db00 2024-04-25T09:14:26.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.883+0000 7fce5fe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce600cde50 con 0x7fce60066a10 2024-04-25T09:14:26.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.883+0000 7fce56000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce60066a10 0x7fce6006b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.883+0000 7fce5ea00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fce6015db00 0x7fce6006ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.883+0000 7fce56000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce60066a10 0x7fce6006b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:47384/0 (socket says 172.21.15.175:47384) 2024-04-25T09:14:26.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.883+0000 7fce56000640 1 -- 172.21.15.175:0/28804416 learned_addr learned my addr 172.21.15.175:0/28804416 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:26.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.883+0000 7fce5f400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fce600b2cb0 0x7fce600ce930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:43810/0 (socket says 172.21.15.175:43810) 2024-04-25T09:14:26.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.883+0000 7fce56000640 1 -- 172.21.15.175:0/28804416 >> v2:172.21.15.177:3300/0 conn(0x7fce6015db00 msgr2=0x7fce6006ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:26.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.883+0000 7fce56000640 1 --2- 172.21.15.175:0/28804416 >> v2:172.21.15.177:3300/0 conn(0x7fce6015db00 0x7fce6006ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.883+0000 7fce56000640 1 -- 172.21.15.175:0/28804416 >> v1:172.21.15.177:6789/0 conn(0x7fce600b2cb0 legacy=0x7fce600ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.883+0000 7fce56000640 1 -- 172.21.15.175:0/28804416 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce600ce130 con 0x7fce60066a10 2024-04-25T09:14:26.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.887+0000 7fce56000640 1 --2- 172.21.15.175:0/28804416 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce60066a10 0x7fce6006b190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fce48009870 tx=0x7fce4801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b33a2b709316dec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:26.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.887+0000 7fce5e000640 1 -- 172.21.15.175:0/28804416 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce480b2070 con 0x7fce60066a10 2024-04-25T09:14:26.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.887+0000 7fce5e000640 1 -- 172.21.15.175:0/28804416 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce480a9070 con 0x7fce60066a10 2024-04-25T09:14:26.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.887+0000 7fce5e000640 1 -- 172.21.15.175:0/28804416 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce480ad880 con 0x7fce60066a10 2024-04-25T09:14:26.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.887+0000 7fce5fe00640 1 -- 172.21.15.175:0/28804416 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce60066a10 msgr2=0x7fce6006b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.887+0000 7fce5fe00640 1 --2- 172.21.15.175:0/28804416 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce60066a10 0x7fce6006b190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fce48009870 tx=0x7fce4801c560 comp rx=0 tx=0).stop 2024-04-25T09:14:26.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.887+0000 7fce5fe00640 1 -- 172.21.15.175:0/28804416 shutdown_connections 2024-04-25T09:14:26.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.887+0000 7fce5fe00640 1 --2- 172.21.15.175:0/28804416 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce60066a10 0x7fce6006b190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.887+0000 7fce5fe00640 1 --2- 172.21.15.175:0/28804416 >> v2:172.21.15.177:3300/0 conn(0x7fce6015db00 0x7fce6006ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.887+0000 7fce5fe00640 1 -- 172.21.15.175:0/28804416 >> 172.21.15.175:0/28804416 conn(0x7fce600cc780 msgr2=0x7fce600ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:26.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.887+0000 7fce5fe00640 1 -- 172.21.15.175:0/28804416 shutdown_connections 2024-04-25T09:14:26.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.887+0000 7fce5fe00640 1 -- 172.21.15.175:0/28804416 wait complete. 2024-04-25T09:14:26.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.887+0000 7fce5fe00640 1 Processor -- start 2024-04-25T09:14:26.876 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.887+0000 7fce5fe00640 1 -- start start 2024-04-25T09:14:26.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce60066a10 0x7fce6014bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5fe00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce600b2cb0 0x7fce600adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5fe00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce6015db00 0x7fce60154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5fe00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6016a8c0 con 0x7fce60066a10 2024-04-25T09:14:26.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5fe00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6016a740 con 0x7fce6015db00 2024-04-25T09:14:26.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5fe00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6016aa40 con 0x7fce600b2cb0 2024-04-25T09:14:26.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce60066a10 0x7fce6014bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5ea00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce60066a10 0x7fce6014bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43774/0 (socket says 172.21.15.175:43774) 2024-04-25T09:14:26.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5ea00640 1 -- 172.21.15.175:0/2601927273 learned_addr learned my addr 172.21.15.175:0/2601927273 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:26.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce56000640 1 --2- 172.21.15.175:0/2601927273 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce600b2cb0 0x7fce600adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5f400640 1 --2- 172.21.15.175:0/2601927273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce6015db00 0x7fce60154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5ea00640 1 -- 172.21.15.175:0/2601927273 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce600b2cb0 msgr2=0x7fce600adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5ea00640 1 --2- 172.21.15.175:0/2601927273 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce600b2cb0 0x7fce600adbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5ea00640 1 -- 172.21.15.175:0/2601927273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce6015db00 msgr2=0x7fce60154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:26.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5ea00640 1 --2- 172.21.15.175:0/2601927273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce6015db00 0x7fce60154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:26.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5ea00640 1 -- 172.21.15.175:0/2601927273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce600ae410 con 0x7fce60066a10 2024-04-25T09:14:26.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5ea00640 1 --2- 172.21.15.175:0/2601927273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce60066a10 0x7fce6014bae0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fce5000e870 tx=0x7fce5000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:26.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce57400640 1 -- 172.21.15.175:0/2601927273 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50017070 con 0x7fce60066a10 2024-04-25T09:14:26.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce57400640 1 -- 172.21.15.175:0/2601927273 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5000c940 con 0x7fce60066a10 2024-04-25T09:14:26.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5fe00640 1 -- 172.21.15.175:0/2601927273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce600ae6f0 con 0x7fce60066a10 2024-04-25T09:14:26.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce57400640 1 -- 172.21.15.175:0/2601927273 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5000ccf0 con 0x7fce60066a10 2024-04-25T09:14:26.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5fe00640 1 -- 172.21.15.175:0/2601927273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6015f1a0 con 0x7fce60066a10 2024-04-25T09:14:26.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.891+0000 7fce5fe00640 1 -- 172.21.15.175:0/2601927273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce60074a60 con 0x7fce60066a10 2024-04-25T09:14:26.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.895+0000 7fce57400640 1 -- 172.21.15.175:0/2601927273 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fce5001a070 con 0x7fce60066a10 2024-04-25T09:14:26.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.895+0000 7fce57400640 1 --2- 172.21.15.175:0/2601927273 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fce3c066f60 0x7fce3c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:26.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.895+0000 7fce57400640 1 -- 172.21.15.175:0/2601927273 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fce500851e0 con 0x7fce60066a10 2024-04-25T09:14:26.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.895+0000 7fce56000640 1 --2- 172.21.15.175:0/2601927273 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fce3c066f60 0x7fce3c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:26.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.895+0000 7fce56000640 1 --2- 172.21.15.175:0/2601927273 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fce3c066f60 0x7fce3c069420 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fce480af000 tx=0x7fce48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:26.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:26.899+0000 7fce57400640 1 -- 172.21.15.175:0/2601927273 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fce50055bd0 con 0x7fce60066a10 2024-04-25T09:14:27.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.051+0000 7fce5fe00640 1 -- 172.21.15.175:0/2601927273 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fce60155e40 con 0x7fce60066a10 2024-04-25T09:14:27.041 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.051+0000 7fce57400640 1 -- 172.21.15.175:0/2601927273 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v114) v1 ==== 100+0+11 (secure 0 0 0) 0x7fce50059c70 con 0x7fce60066a10 2024-04-25T09:14:27.041 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:14:27.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.055+0000 7fce5fe00640 1 -- 172.21.15.175:0/2601927273 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fce3c066f60 msgr2=0x7fce3c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.055+0000 7fce5fe00640 1 --2- 172.21.15.175:0/2601927273 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fce3c066f60 0x7fce3c069420 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fce480af000 tx=0x7fce48008040 comp rx=0 tx=0).stop 2024-04-25T09:14:27.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.055+0000 7fce5fe00640 1 -- 172.21.15.175:0/2601927273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce60066a10 msgr2=0x7fce6014bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.055+0000 7fce5fe00640 1 --2- 172.21.15.175:0/2601927273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce60066a10 0x7fce6014bae0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fce5000e870 tx=0x7fce5000ec70 comp rx=0 tx=0).stop 2024-04-25T09:14:27.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.055+0000 7fce5fe00640 1 -- 172.21.15.175:0/2601927273 shutdown_connections 2024-04-25T09:14:27.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.055+0000 7fce5fe00640 1 --2- 172.21.15.175:0/2601927273 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fce3c066f60 0x7fce3c069420 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.055+0000 7fce5fe00640 1 --2- 172.21.15.175:0/2601927273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce6015db00 0x7fce60154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.055+0000 7fce5fe00640 1 --2- 172.21.15.175:0/2601927273 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce600b2cb0 0x7fce600adbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.055+0000 7fce5fe00640 1 --2- 172.21.15.175:0/2601927273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce60066a10 0x7fce6014bae0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.055+0000 7fce5fe00640 1 -- 172.21.15.175:0/2601927273 >> 172.21.15.175:0/2601927273 conn(0x7fce600cc780 msgr2=0x7fce600af650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:27.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.055+0000 7fce5fe00640 1 -- 172.21.15.175:0/2601927273 shutdown_connections 2024-04-25T09:14:27.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.055+0000 7fce5fe00640 1 -- 172.21.15.175:0/2601927273 wait complete. 2024-04-25T09:14:27.062 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:14:27.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.211+0000 7fe0ace00640 1 Processor -- start 2024-04-25T09:14:27.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.211+0000 7fe0ace00640 1 -- start start 2024-04-25T09:14:27.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.211+0000 7fe0ace00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe0a8161360 0x7fe0a80ad990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:27.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.211+0000 7fe0ace00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0a80ae660 0x7fe0a806e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:27.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.211+0000 7fe0ace00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a80ae250 con 0x7fe0a806ef10 2024-04-25T09:14:27.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.211+0000 7fe0ace00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a80adf70 con 0x7fe0a8161360 2024-04-25T09:14:27.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.211+0000 7fe0ace00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a806def0 con 0x7fe0a80ae660 2024-04-25T09:14:27.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.211+0000 7fe09d400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0a80ae660 0x7fe0a806e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:27.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.211+0000 7fe09d400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0a80ae660 0x7fe0a806e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:47392/0 (socket says 172.21.15.175:47392) 2024-04-25T09:14:27.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.211+0000 7fe09d400640 1 -- 172.21.15.175:0/72060514 learned_addr learned my addr 172.21.15.175:0/72060514 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:27.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.211+0000 7fe0a6800640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe0a806ef10 0x7fe0a80712d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:43814/0 (socket says 172.21.15.175:43814) 2024-04-25T09:14:27.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.211+0000 7fe0a5e00640 1 --2- 172.21.15.175:0/72060514 >> v2:172.21.15.177:3300/0 conn(0x7fe0a8161360 0x7fe0a80ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:27.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.211+0000 7fe09d400640 1 -- 172.21.15.175:0/72060514 >> v2:172.21.15.177:3300/0 conn(0x7fe0a8161360 msgr2=0x7fe0a80ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:27.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.211+0000 7fe09d400640 1 --2- 172.21.15.175:0/72060514 >> v2:172.21.15.177:3300/0 conn(0x7fe0a8161360 0x7fe0a80ad990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.211+0000 7fe0a5400640 1 -- 172.21.15.175:0/72060514 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685791653 0 0) 0x7fe0a80ae250 con 0x7fe0a806ef10 2024-04-25T09:14:27.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.211+0000 7fe09d400640 1 -- 172.21.15.175:0/72060514 >> v1:172.21.15.177:6789/0 conn(0x7fe0a806ef10 legacy=0x7fe0a80712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.211+0000 7fe09d400640 1 -- 172.21.15.175:0/72060514 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a806e1d0 con 0x7fe0a80ae660 2024-04-25T09:14:27.203 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.215+0000 7fe09d400640 1 --2- 172.21.15.175:0/72060514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0a80ae660 0x7fe0a806e9d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe090009870 tx=0x7fe09001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec3630a782938b59 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:27.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.215+0000 7fe0a5400640 1 -- 172.21.15.175:0/72060514 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0900aa620 con 0x7fe0a80ae660 2024-04-25T09:14:27.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.215+0000 7fe0a5400640 1 -- 172.21.15.175:0/72060514 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0900af070 con 0x7fe0a80ae660 2024-04-25T09:14:27.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.215+0000 7fe0a5400640 1 -- 172.21.15.175:0/72060514 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0900aa9e0 con 0x7fe0a80ae660 2024-04-25T09:14:27.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.215+0000 7fe0ace00640 1 -- 172.21.15.175:0/72060514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0a80ae660 msgr2=0x7fe0a806e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.215+0000 7fe0ace00640 1 --2- 172.21.15.175:0/72060514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0a80ae660 0x7fe0a806e9d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe090009870 tx=0x7fe09001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.215+0000 7fe0ace00640 1 -- 172.21.15.175:0/72060514 shutdown_connections 2024-04-25T09:14:27.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.215+0000 7fe0ace00640 1 --2- 172.21.15.175:0/72060514 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0a80ae660 0x7fe0a806e9d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.215+0000 7fe0ace00640 1 --2- 172.21.15.175:0/72060514 >> v2:172.21.15.177:3300/0 conn(0x7fe0a8161360 0x7fe0a80ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.215+0000 7fe0ace00640 1 -- 172.21.15.175:0/72060514 >> 172.21.15.175:0/72060514 conn(0x7fe0a806ac50 msgr2=0x7fe0a806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:27.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.215+0000 7fe0ace00640 1 -- 172.21.15.175:0/72060514 shutdown_connections 2024-04-25T09:14:27.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.215+0000 7fe0ace00640 1 -- 172.21.15.175:0/72060514 wait complete. 2024-04-25T09:14:27.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe0ace00640 1 Processor -- start 2024-04-25T09:14:27.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe0ace00640 1 -- start start 2024-04-25T09:14:27.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe0ace00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0a806ef10 0x7fe0a814d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:27.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe0ace00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0a80ae660 0x7fe0a8147950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:27.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe0ace00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0a8161360 0x7fe0a814f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:27.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe0ace00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a8071b60 con 0x7fe0a80ae660 2024-04-25T09:14:27.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe0ace00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a80719e0 con 0x7fe0a806ef10 2024-04-25T09:14:27.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe0ace00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a816a900 con 0x7fe0a8161360 2024-04-25T09:14:27.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe09d400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0a80ae660 0x7fe0a8147950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:27.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe09d400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0a80ae660 0x7fe0a8147950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43778/0 (socket says 172.21.15.175:43778) 2024-04-25T09:14:27.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe09d400640 1 -- 172.21.15.175:0/1661459834 learned_addr learned my addr 172.21.15.175:0/1661459834 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:27.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe0a5e00640 1 --2- 172.21.15.175:0/1661459834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0a806ef10 0x7fe0a814d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:27.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe0a6800640 1 --2- 172.21.15.175:0/1661459834 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0a8161360 0x7fe0a814f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:27.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe09d400640 1 -- 172.21.15.175:0/1661459834 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0a8161360 msgr2=0x7fe0a814f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe09d400640 1 --2- 172.21.15.175:0/1661459834 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0a8161360 0x7fe0a814f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe09d400640 1 -- 172.21.15.175:0/1661459834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0a806ef10 msgr2=0x7fe0a814d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe09d400640 1 --2- 172.21.15.175:0/1661459834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0a806ef10 0x7fe0a814d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe09d400640 1 -- 172.21.15.175:0/1661459834 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a814fc00 con 0x7fe0a80ae660 2024-04-25T09:14:27.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe0a6800640 1 --2- 172.21.15.175:0/1661459834 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0a8161360 0x7fe0a814f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:27.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe09d400640 1 --2- 172.21.15.175:0/1661459834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0a80ae660 0x7fe0a8147950 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fe0900ac040 tx=0x7fe09001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:27.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe09ea00640 1 -- 172.21.15.175:0/1661459834 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0900aace0 con 0x7fe0a80ae660 2024-04-25T09:14:27.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe09ea00640 1 -- 172.21.15.175:0/1661459834 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0900bd3f0 con 0x7fe0a80ae660 2024-04-25T09:14:27.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe09ea00640 1 -- 172.21.15.175:0/1661459834 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0900bd7e0 con 0x7fe0a80ae660 2024-04-25T09:14:27.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe0ace00640 1 -- 172.21.15.175:0/1661459834 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a814fee0 con 0x7fe0a80ae660 2024-04-25T09:14:27.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.219+0000 7fe0ace00640 1 -- 172.21.15.175:0/1661459834 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a81504a0 con 0x7fe0a80ae660 2024-04-25T09:14:27.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.223+0000 7fe0ace00640 1 -- 172.21.15.175:0/1661459834 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a8075160 con 0x7fe0a80ae660 2024-04-25T09:14:27.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.223+0000 7fe09ea00640 1 -- 172.21.15.175:0/1661459834 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe0900b33f0 con 0x7fe0a80ae660 2024-04-25T09:14:27.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.223+0000 7fe09ea00640 1 --2- 172.21.15.175:0/1661459834 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe084066f60 0x7fe084069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:27.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.223+0000 7fe09ea00640 1 -- 172.21.15.175:0/1661459834 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe09011f0c0 con 0x7fe0a80ae660 2024-04-25T09:14:27.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.223+0000 7fe0a5e00640 1 --2- 172.21.15.175:0/1661459834 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe084066f60 0x7fe084069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:27.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.223+0000 7fe0a5e00640 1 --2- 172.21.15.175:0/1661459834 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe084066f60 0x7fe084069420 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8160290 tx=0x7fe098009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:27.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.227+0000 7fe09ea00640 1 -- 172.21.15.175:0/1661459834 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe090016150 con 0x7fe0a80ae660 2024-04-25T09:14:27.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.395+0000 7fe0ace00640 1 -- 172.21.15.175:0/1661459834 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe0a80b0a90 con 0x7fe0a80ae660 2024-04-25T09:14:27.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.395+0000 7fe09ea00640 1 -- 172.21.15.175:0/1661459834 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v114) v1 ==== 80+0+124 (secure 0 0 0) 0x7fe0900ef980 con 0x7fe0a80ae660 2024-04-25T09:14:27.384 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175:6836/4128642659 2024-04-26T09:14:18.106892+0000 2024-04-25T09:14:27.384 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175:6834/4128642659 2024-04-26T09:14:18.106892+0000 2024-04-25T09:14:27.384 INFO:teuthology.orchestra.run.smithi175.stderr:listed 2 entries 2024-04-25T09:14:27.385 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.395+0000 7fe0ace00640 1 -- 172.21.15.175:0/1661459834 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe084066f60 msgr2=0x7fe084069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.395+0000 7fe0ace00640 1 --2- 172.21.15.175:0/1661459834 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe084066f60 0x7fe084069420 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8160290 tx=0x7fe098009190 comp rx=0 tx=0).stop 2024-04-25T09:14:27.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.395+0000 7fe0ace00640 1 -- 172.21.15.175:0/1661459834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0a80ae660 msgr2=0x7fe0a8147950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.395+0000 7fe0ace00640 1 --2- 172.21.15.175:0/1661459834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0a80ae660 0x7fe0a8147950 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fe0900ac040 tx=0x7fe09001ace0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.399+0000 7fe0ace00640 1 -- 172.21.15.175:0/1661459834 shutdown_connections 2024-04-25T09:14:27.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.399+0000 7fe0ace00640 1 --2- 172.21.15.175:0/1661459834 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe084066f60 0x7fe084069420 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.399+0000 7fe0ace00640 1 --2- 172.21.15.175:0/1661459834 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe0a8161360 0x7fe0a814f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.399+0000 7fe0ace00640 1 --2- 172.21.15.175:0/1661459834 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe0a80ae660 0x7fe0a8147950 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.399+0000 7fe0ace00640 1 --2- 172.21.15.175:0/1661459834 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe0a806ef10 0x7fe0a814d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.399+0000 7fe0ace00640 1 -- 172.21.15.175:0/1661459834 >> 172.21.15.175:0/1661459834 conn(0x7fe0a806ac50 msgr2=0x7fe0a80af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:27.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.399+0000 7fe0ace00640 1 -- 172.21.15.175:0/1661459834 shutdown_connections 2024-04-25T09:14:27.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.399+0000 7fe0ace00640 1 -- 172.21.15.175:0/1661459834 wait complete. 2024-04-25T09:14:27.405 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:14:27.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:27.406 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:27.430 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:14:27.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:27.431 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:14:27.486 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:27.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.679+0000 7fa5d7400640 1 Processor -- start 2024-04-25T09:14:27.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.679+0000 7fa5d7400640 1 -- start start 2024-04-25T09:14:27.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.679+0000 7fa5d7400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa5d0099a50 0x7fa5d006cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:27.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.679+0000 7fa5d7400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d00cfcb0 con 0x7fa5d006bd60 2024-04-25T09:14:27.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.679+0000 7fa5d7400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5d00cff90 con 0x7fa5d00d0d50 2024-04-25T09:14:27.668 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.679+0000 7fa5d7400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5d00d0270 con 0x7fa5d0099a50 2024-04-25T09:14:27.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.679+0000 7fa5c7e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa5d006bd60 0x7fa5d0099e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:48220/0 (socket says 172.21.15.175:48220) 2024-04-25T09:14:27.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.679+0000 7fa5c7e00640 1 -- 172.21.15.175:0/3309320871 learned_addr learned my addr 172.21.15.175:0/3309320871 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:27.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.679+0000 7fa5d4a00640 1 --2- 172.21.15.175:0/3309320871 >> v2:172.21.15.177:3300/0 conn(0x7fa5d0099a50 0x7fa5d006cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:27.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.679+0000 7fa5cfe00640 1 -- 172.21.15.175:0/3309320871 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947010941 0 0) 0x7fa5d00cfcb0 con 0x7fa5d006bd60 2024-04-25T09:14:27.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.679+0000 7fa5cfe00640 1 -- 172.21.15.175:0/3309320871 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5b4003530 con 0x7fa5d006bd60 2024-04-25T09:14:27.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.679+0000 7fa5cfe00640 1 -- 172.21.15.175:0/3309320871 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1454201621 0 0) 0x7fa5b4003530 con 0x7fa5d006bd60 2024-04-25T09:14:27.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.679+0000 7fa5d4a00640 1 -- 172.21.15.175:0/3309320871 >> v1:172.21.15.177:6789/0 conn(0x7fa5d00d0d50 legacy=0x7fa5d00cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.679+0000 7fa5d4a00640 1 -- 172.21.15.175:0/3309320871 >> v1:172.21.15.175:6789/0 conn(0x7fa5d006bd60 legacy=0x7fa5d0099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.679+0000 7fa5d4a00640 1 -- 172.21.15.175:0/3309320871 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d00d0550 con 0x7fa5d0099a50 2024-04-25T09:14:27.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.683+0000 7fa5d4a00640 1 --2- 172.21.15.175:0/3309320871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5d0099a50 0x7fa5d006cc50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00097c0 tx=0x7fa5c001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f638aeea2dee859 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:27.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.683+0000 7fa5cfe00640 1 -- 172.21.15.175:0/3309320871 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c00b0070 con 0x7fa5d0099a50 2024-04-25T09:14:27.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.683+0000 7fa5cfe00640 1 -- 172.21.15.175:0/3309320871 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c00ab400 con 0x7fa5d0099a50 2024-04-25T09:14:27.672 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.683+0000 7fa5cfe00640 1 -- 172.21.15.175:0/3309320871 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8001680 con 0x7fa5d0099a50 2024-04-25T09:14:27.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.683+0000 7fa5d7400640 1 -- 172.21.15.175:0/3309320871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5d0099a50 msgr2=0x7fa5d006cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.683+0000 7fa5d7400640 1 --2- 172.21.15.175:0/3309320871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5d0099a50 0x7fa5d006cc50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00097c0 tx=0x7fa5c001c3c0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.683+0000 7fa5d7400640 1 -- 172.21.15.175:0/3309320871 shutdown_connections 2024-04-25T09:14:27.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.683+0000 7fa5d7400640 1 --2- 172.21.15.175:0/3309320871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5d0099a50 0x7fa5d006cc50 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.683+0000 7fa5d7400640 1 -- 172.21.15.175:0/3309320871 >> 172.21.15.175:0/3309320871 conn(0x7fa5d00b3300 msgr2=0x7fa5d00b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:27.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.683+0000 7fa5d7400640 1 -- 172.21.15.175:0/3309320871 shutdown_connections 2024-04-25T09:14:27.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.683+0000 7fa5d7400640 1 -- 172.21.15.175:0/3309320871 wait complete. 2024-04-25T09:14:27.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5d7400640 1 Processor -- start 2024-04-25T09:14:27.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5d7400640 1 -- start start 2024-04-25T09:14:27.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5d7400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5d006bd60 0x7fa5d014df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:27.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5d7400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5d0099a50 0x7fa5d01585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:27.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5d7400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5d00d0d50 0x7fa5d0155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:27.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5d7400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d016c270 con 0x7fa5d0099a50 2024-04-25T09:14:27.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5d7400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d015e070 con 0x7fa5d00d0d50 2024-04-25T09:14:27.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5d7400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d016c3f0 con 0x7fa5d006bd60 2024-04-25T09:14:27.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5c7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5d0099a50 0x7fa5d01585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:27.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5c7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5d0099a50 0x7fa5d01585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43788/0 (socket says 172.21.15.175:43788) 2024-04-25T09:14:27.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5c7e00640 1 -- 172.21.15.175:0/3338911709 learned_addr learned my addr 172.21.15.175:0/3338911709 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:27.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5d4a00640 1 --2- 172.21.15.175:0/3338911709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5d006bd60 0x7fa5d014df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:27.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5d5400640 1 --2- 172.21.15.175:0/3338911709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5d00d0d50 0x7fa5d0155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:27.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5c7e00640 1 -- 172.21.15.175:0/3338911709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5d006bd60 msgr2=0x7fa5d014df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5c7e00640 1 --2- 172.21.15.175:0/3338911709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5d006bd60 0x7fa5d014df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5c7e00640 1 -- 172.21.15.175:0/3338911709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5d00d0d50 msgr2=0x7fa5d0155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5c7e00640 1 --2- 172.21.15.175:0/3338911709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5d00d0d50 0x7fa5d0155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5c7e00640 1 -- 172.21.15.175:0/3338911709 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d014e4c0 con 0x7fa5d0099a50 2024-04-25T09:14:27.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5c7e00640 1 --2- 172.21.15.175:0/3338911709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5d0099a50 0x7fa5d01585b0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800c520 tx=0x7fa5b800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:27.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5cd600640 1 -- 172.21.15.175:0/3338911709 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8017070 con 0x7fa5d0099a50 2024-04-25T09:14:27.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5cd600640 1 -- 172.21.15.175:0/3338911709 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b8005d10 con 0x7fa5d0099a50 2024-04-25T09:14:27.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5cd600640 1 -- 172.21.15.175:0/3338911709 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b80072b0 con 0x7fa5d0099a50 2024-04-25T09:14:27.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5d7400640 1 -- 172.21.15.175:0/3338911709 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d0158e00 con 0x7fa5d0099a50 2024-04-25T09:14:27.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.687+0000 7fa5d7400640 1 -- 172.21.15.175:0/3338911709 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d01593c0 con 0x7fa5d0099a50 2024-04-25T09:14:27.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.691+0000 7fa5d7400640 1 -- 172.21.15.175:0/3338911709 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5d0074a60 con 0x7fa5d0099a50 2024-04-25T09:14:27.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.691+0000 7fa5cd600640 1 -- 172.21.15.175:0/3338911709 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa5b801a070 con 0x7fa5d0099a50 2024-04-25T09:14:27.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.691+0000 7fa5cd600640 1 --2- 172.21.15.175:0/3338911709 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa5ac066f90 0x7fa5ac069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:27.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.691+0000 7fa5cd600640 1 -- 172.21.15.175:0/3338911709 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa5b80844f0 con 0x7fa5d0099a50 2024-04-25T09:14:27.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.691+0000 7fa5d4a00640 1 --2- 172.21.15.175:0/3338911709 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa5ac066f90 0x7fa5ac069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:27.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.691+0000 7fa5d4a00640 1 --2- 172.21.15.175:0/3338911709 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa5ac066f90 0x7fa5ac069450 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00ad000 tx=0x7fa5c00a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:27.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.695+0000 7fa5cd600640 1 -- 172.21.15.175:0/3338911709 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa5b8054db0 con 0x7fa5d0099a50 2024-04-25T09:14:27.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.883+0000 7fa5d7400640 1 -- 172.21.15.175:0/3338911709 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5d006cc50 con 0x7fa5d0099a50 2024-04-25T09:14:27.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.883+0000 7fa5cd600640 1 -- 172.21.15.175:0/3338911709 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4948 (secure 0 0 0) 0x7fa5b8058e50 con 0x7fa5d0099a50 2024-04-25T09:14:27.871 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:27.871 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":99,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/745891603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":745891603},{"type":"v1","addr":"172.21.15.175:6837","nonce":745891603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2312875672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2312875672},{"type":"v1","addr":"172.21.15.177:6834","nonce":2312875672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":8212,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3983919410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3983919410},{"type":"v1","addr":"172.21.15.177:6835","nonce":3983919410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:14:03.698308+0000","modified":"2024-04-25T09:14:21.121352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":114,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8955":{"gid":8955,"name":"c","rank":0,"incarnation":96,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6836/386187898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":386187898},{"type":"v1","addr":"172.21.15.175:6836","nonce":386187898}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:14:27.871 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 99 2024-04-25T09:14:27.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.883+0000 7fa5d7400640 1 -- 172.21.15.175:0/3338911709 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa5ac066f90 msgr2=0x7fa5ac069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.883+0000 7fa5d7400640 1 --2- 172.21.15.175:0/3338911709 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa5ac066f90 0x7fa5ac069450 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa5c00ad000 tx=0x7fa5c00a6000 comp rx=0 tx=0).stop 2024-04-25T09:14:27.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.883+0000 7fa5d7400640 1 -- 172.21.15.175:0/3338911709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5d0099a50 msgr2=0x7fa5d01585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:27.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.883+0000 7fa5d7400640 1 --2- 172.21.15.175:0/3338911709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5d0099a50 0x7fa5d01585b0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800c520 tx=0x7fa5b800c9e0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.883+0000 7fa5d7400640 1 -- 172.21.15.175:0/3338911709 shutdown_connections 2024-04-25T09:14:27.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.883+0000 7fa5d7400640 1 --2- 172.21.15.175:0/3338911709 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fa5ac066f90 0x7fa5ac069450 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.883+0000 7fa5d7400640 1 --2- 172.21.15.175:0/3338911709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5d00d0d50 0x7fa5d0155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.883+0000 7fa5d7400640 1 --2- 172.21.15.175:0/3338911709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5d0099a50 0x7fa5d01585b0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.873 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.883+0000 7fa5d7400640 1 --2- 172.21.15.175:0/3338911709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5d006bd60 0x7fa5d014df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:27.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.883+0000 7fa5d7400640 1 -- 172.21.15.175:0/3338911709 >> 172.21.15.175:0/3338911709 conn(0x7fa5d00b3300 msgr2=0x7fa5d00ae4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:27.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.883+0000 7fa5d7400640 1 -- 172.21.15.175:0/3338911709 shutdown_connections 2024-04-25T09:14:27.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:27.883+0000 7fa5d7400640 1 -- 172.21.15.175:0/3338911709 wait complete. 2024-04-25T09:14:27.893 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json tag path /parent mytag123 2024-04-25T09:14:28.053 INFO:teuthology.orchestra.run.smithi175.stdout:{"return_code":0,"scrub_tag":"mytag123","mode":"asynchronous"} 2024-04-25T09:14:28.054 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag123" } 2024-04-25T09:14:28.054 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000003.00000000 scrub_tag 2024-04-25T09:14:28.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ed1069080 1 Processor -- start 2024-04-25T09:14:28.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ed1069080 1 -- start start 2024-04-25T09:14:28.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ed1069080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5578b978a740 0x5578b971acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ed1069080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578b978ab20 0x5578b96fc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ed1069080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5578b978b000 0x5578b9712fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ed1069080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578b978bc50 con 0x5578b978ab20 2024-04-25T09:14:28.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ed1069080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578b96789f0 con 0x5578b978b000 2024-04-25T09:14:28.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ed1069080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578b978bef0 con 0x5578b978a740 2024-04-25T09:14:28.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ecd800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578b978ab20 0x5578b96fc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ecd800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578b978ab20 0x5578b96fc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43804/0 (socket says 172.21.15.175:43804) 2024-04-25T09:14:28.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ecd800640 1 -- 172.21.15.175:0/369185040 learned_addr learned my addr 172.21.15.175:0/369185040 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:28.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ecec00640 1 --2- 172.21.15.175:0/369185040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5578b978b000 0x5578b9712fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ece200640 1 --2- 172.21.15.175:0/369185040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5578b978a740 0x5578b971acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ecd800640 1 -- 172.21.15.175:0/369185040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5578b978a740 msgr2=0x5578b971acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:28.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ecd800640 1 --2- 172.21.15.175:0/369185040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5578b978a740 0x5578b971acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ecd800640 1 -- 172.21.15.175:0/369185040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5578b978b000 msgr2=0x5578b9712fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:28.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ecd800640 1 --2- 172.21.15.175:0/369185040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5578b978b000 0x5578b9712fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ecd800640 1 -- 172.21.15.175:0/369185040 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578b97aa490 con 0x5578b978ab20 2024-04-25T09:14:28.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ecd800640 1 --2- 172.21.15.175:0/369185040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578b978ab20 0x5578b96fc940 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc001e70 tx=0x7f5ebc00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13841796bc416c52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ec7e00640 1 -- 172.21.15.175:0/369185040 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc012020 con 0x5578b978ab20 2024-04-25T09:14:28.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ec7e00640 1 -- 172.21.15.175:0/369185040 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc00e690 con 0x5578b978ab20 2024-04-25T09:14:28.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.111+0000 7f5ec7e00640 1 -- 172.21.15.175:0/369185040 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc00ea80 con 0x5578b978ab20 2024-04-25T09:14:28.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 -- 172.21.15.175:0/369185040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578b978ab20 msgr2=0x5578b96fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 --2- 172.21.15.175:0/369185040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578b978ab20 0x5578b96fc940 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc001e70 tx=0x7f5ebc00b790 comp rx=0 tx=0).stop 2024-04-25T09:14:28.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 -- 172.21.15.175:0/369185040 shutdown_connections 2024-04-25T09:14:28.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 --2- 172.21.15.175:0/369185040 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5578b978b000 0x5578b9712fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 --2- 172.21.15.175:0/369185040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578b978ab20 0x5578b96fc940 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 --2- 172.21.15.175:0/369185040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5578b978a740 0x5578b971acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 -- 172.21.15.175:0/369185040 >> 172.21.15.175:0/369185040 conn(0x5578b96d2420 msgr2=0x5578b978cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:28.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 -- 172.21.15.175:0/369185040 shutdown_connections 2024-04-25T09:14:28.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 -- 172.21.15.175:0/369185040 wait complete. 2024-04-25T09:14:28.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 Processor -- start 2024-04-25T09:14:28.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 -- start start 2024-04-25T09:14:28.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5578b978a740 0x5578b9842100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.105 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5578b978ab20 0x5578b97a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578b978b000 0x5578b97a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578b97aa730 con 0x5578b978b000 2024-04-25T09:14:28.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578b97aa9d0 con 0x5578b978ab20 2024-04-25T09:14:28.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578b983fae0 con 0x5578b978a740 2024-04-25T09:14:28.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ecec00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578b978b000 0x5578b97a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ecec00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578b978b000 0x5578b97a5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43816/0 (socket says 172.21.15.175:43816) 2024-04-25T09:14:28.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ecec00640 1 -- 172.21.15.175:0/1117360921 learned_addr learned my addr 172.21.15.175:0/1117360921 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:28.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ece200640 1 --2- 172.21.15.175:0/1117360921 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5578b978a740 0x5578b9842100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ecd800640 1 --2- 172.21.15.175:0/1117360921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5578b978ab20 0x5578b97a57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ecec00640 1 -- 172.21.15.175:0/1117360921 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5578b978a740 msgr2=0x5578b9842100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ecec00640 1 --2- 172.21.15.175:0/1117360921 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5578b978a740 0x5578b9842100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ecec00640 1 -- 172.21.15.175:0/1117360921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5578b978ab20 msgr2=0x5578b97a57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ecec00640 1 --2- 172.21.15.175:0/1117360921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5578b978ab20 0x5578b97a57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.106 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ecec00640 1 -- 172.21.15.175:0/1117360921 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578b971a0d0 con 0x5578b978b000 2024-04-25T09:14:28.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ecd800640 1 --2- 172.21.15.175:0/1117360921 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5578b978ab20 0x5578b97a57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:28.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ecec00640 1 --2- 172.21.15.175:0/1117360921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578b978b000 0x5578b97a5d20 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80ae040 tx=0x7f5ec8017d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ec6a00640 1 -- 172.21.15.175:0/1117360921 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec80b9070 con 0x5578b978b000 2024-04-25T09:14:28.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ec6a00640 1 -- 172.21.15.175:0/1117360921 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec80abba0 con 0x5578b978b000 2024-04-25T09:14:28.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ec6a00640 1 -- 172.21.15.175:0/1117360921 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec80b0040 con 0x5578b978b000 2024-04-25T09:14:28.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 -- 172.21.15.175:0/1117360921 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5578b971a370 con 0x5578b978b000 2024-04-25T09:14:28.107 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.115+0000 7f5ed1069080 1 -- 172.21.15.175:0/1117360921 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5578b9714870 con 0x5578b978b000 2024-04-25T09:14:28.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.119+0000 7f5ec6a00640 1 -- 172.21.15.175:0/1117360921 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5ec80bc070 con 0x5578b978b000 2024-04-25T09:14:28.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.119+0000 7f5ec6a00640 1 --2- 172.21.15.175:0/1117360921 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5eb0065970 0x7f5eb0067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.108 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.119+0000 7f5ec6a00640 1 -- 172.21.15.175:0/1117360921 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5ec811e3e0 con 0x5578b978b000 2024-04-25T09:14:28.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.119+0000 7f5ece200640 1 --2- 172.21.15.175:0/1117360921 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5eb0065970 0x7f5eb0067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.119+0000 7f5ed1069080 1 --2- 172.21.15.175:0/1117360921 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x5578b9842640 0x5578b9714fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.119+0000 7f5ed1069080 1 -- 172.21.15.175:0/1117360921 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:1 17.32 17:4def72d4:::10000000003.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e114) v9 -- 0x5578b97154f0 con 0x5578b9842640 2024-04-25T09:14:28.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.119+0000 7f5ecd800640 1 --2- 172.21.15.175:0/1117360921 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x5578b9842640 0x5578b9714fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.119+0000 7f5ece200640 1 --2- 172.21.15.175:0/1117360921 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5eb0065970 0x7f5eb0067e30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0005410 tx=0x7f5ec000c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.109 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.119+0000 7f5ecd800640 1 --2- 172.21.15.175:0/1117360921 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x5578b9842640 0x5578b9714fb0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.119+0000 7f5ecd800640 1 -- 172.21.15.175:0/1117360921 <== osd.7 v2:172.21.15.177:6800/3881136076 1 ==== osd_op_reply(1 10000000003.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5ebc008030 con 0x5578b9842640 2024-04-25T09:14:28.110 INFO:teuthology.orchestra.run.smithi175.stderr:error getting xattr cephfs_data/10000000003.00000000/scrub_tag: (61) No data available 2024-04-25T09:14:28.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.119+0000 7f5ed1069080 1 -- 172.21.15.175:0/1117360921 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x5578b9842640 msgr2=0x5578b9714fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.119+0000 7f5ed1069080 1 --2- 172.21.15.175:0/1117360921 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x5578b9842640 0x5578b9714fb0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.123+0000 7f5ed1069080 1 -- 172.21.15.175:0/1117360921 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5eb0065970 msgr2=0x7f5eb0067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.110 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.123+0000 7f5ed1069080 1 --2- 172.21.15.175:0/1117360921 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5eb0065970 0x7f5eb0067e30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0005410 tx=0x7f5ec000c040 comp rx=0 tx=0).stop 2024-04-25T09:14:28.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.123+0000 7f5ed1069080 1 -- 172.21.15.175:0/1117360921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578b978b000 msgr2=0x5578b97a5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.123+0000 7f5ed1069080 1 --2- 172.21.15.175:0/1117360921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5578b978b000 0x5578b97a5d20 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f5ec80ae040 tx=0x7f5ec8017d60 comp rx=0 tx=0).stop 2024-04-25T09:14:28.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.123+0000 7f5ecec00640 1 -- 172.21.15.175:0/1117360921 reap_dead start 2024-04-25T09:14:28.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.123+0000 7f5ed1069080 1 -- 172.21.15.175:0/1117360921 shutdown_connections 2024-04-25T09:14:28.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.123+0000 7f5ed1069080 1 -- 172.21.15.175:0/1117360921 >> 172.21.15.175:0/1117360921 conn(0x5578b96d2420 msgr2=0x5578b978cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:28.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.123+0000 7f5ed1069080 1 -- 172.21.15.175:0/1117360921 shutdown_connections 2024-04-25T09:14:28.111 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.123+0000 7f5ed1069080 1 -- 172.21.15.175:0/1117360921 wait complete. 2024-04-25T09:14:28.114 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:14:28.114 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-04-25T09:14:28.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 Processor -- start 2024-04-25T09:14:28.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 -- start start 2024-04-25T09:14:28.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c1f5d4bf0 0x563c1f601af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563c1f6a95d0 0x563c1f5fd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c1f6a99b0 0x563c1f600840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1f616070 con 0x563c1f5d4bf0 2024-04-25T09:14:28.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1f5789f0 con 0x563c1f6a99b0 2024-04-25T09:14:28.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c1f616310 con 0x563c1f6a95d0 2024-04-25T09:14:28.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb6f200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c1f5d4bf0 0x563c1f601af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb6f200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c1f5d4bf0 0x563c1f601af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43838/0 (socket says 172.21.15.175:43838) 2024-04-25T09:14:28.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb6f200640 1 -- 172.21.15.175:0/2302804980 learned_addr learned my addr 172.21.15.175:0/2302804980 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:28.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb6fc00640 1 --2- 172.21.15.175:0/2302804980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c1f6a99b0 0x563c1f600840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb6e800640 1 --2- 172.21.15.175:0/2302804980 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563c1f6a95d0 0x563c1f5fd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb6f200640 1 -- 172.21.15.175:0/2302804980 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563c1f6a95d0 msgr2=0x563c1f5fd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:28.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb6f200640 1 --2- 172.21.15.175:0/2302804980 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563c1f6a95d0 0x563c1f5fd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb6f200640 1 -- 172.21.15.175:0/2302804980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c1f6a99b0 msgr2=0x563c1f600840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:28.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb6f200640 1 --2- 172.21.15.175:0/2302804980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c1f6a99b0 0x563c1f600840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb6f200640 1 -- 172.21.15.175:0/2302804980 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c1f6022e0 con 0x563c1f5d4bf0 2024-04-25T09:14:28.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb6f200640 1 --2- 172.21.15.175:0/2302804980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c1f5d4bf0 0x563c1f601af0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000b2a0 tx=0x7fdb6000b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60078db31fb3397d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb6d400640 1 -- 172.21.15.175:0/2302804980 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6000a040 con 0x563c1f5d4bf0 2024-04-25T09:14:28.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb6d400640 1 -- 172.21.15.175:0/2302804980 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6000f620 con 0x563c1f5d4bf0 2024-04-25T09:14:28.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb6d400640 1 -- 172.21.15.175:0/2302804980 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6000f9f0 con 0x563c1f5d4bf0 2024-04-25T09:14:28.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 -- 172.21.15.175:0/2302804980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c1f5d4bf0 msgr2=0x563c1f601af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 --2- 172.21.15.175:0/2302804980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c1f5d4bf0 0x563c1f601af0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000b2a0 tx=0x7fdb6000b760 comp rx=0 tx=0).stop 2024-04-25T09:14:28.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 -- 172.21.15.175:0/2302804980 shutdown_connections 2024-04-25T09:14:28.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 --2- 172.21.15.175:0/2302804980 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c1f6a99b0 0x563c1f600840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 --2- 172.21.15.175:0/2302804980 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563c1f6a95d0 0x563c1f5fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 --2- 172.21.15.175:0/2302804980 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c1f5d4bf0 0x563c1f601af0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 -- 172.21.15.175:0/2302804980 >> 172.21.15.175:0/2302804980 conn(0x563c1f5d2420 msgr2=0x563c1f6a8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:28.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 -- 172.21.15.175:0/2302804980 shutdown_connections 2024-04-25T09:14:28.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 -- 172.21.15.175:0/2302804980 wait complete. 2024-04-25T09:14:28.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 Processor -- start 2024-04-25T09:14:28.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.215+0000 7fdb72014080 1 -- start start 2024-04-25T09:14:28.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb72014080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563c1f5d4bf0 0x563c1f6a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb72014080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c1f6a95d0 0x563c1f6182a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb72014080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c1f6a99b0 0x563c1f6187e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb72014080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1f5ffe60 con 0x563c1f6a95d0 2024-04-25T09:14:28.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb72014080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1f602580 con 0x563c1f6a99b0 2024-04-25T09:14:28.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb72014080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c1f600100 con 0x563c1f5d4bf0 2024-04-25T09:14:28.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb6e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c1f6a95d0 0x563c1f6182a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb6e800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c1f6a95d0 0x563c1f6182a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43846/0 (socket says 172.21.15.175:43846) 2024-04-25T09:14:28.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb6e800640 1 -- 172.21.15.175:0/1188779314 learned_addr learned my addr 172.21.15.175:0/1188779314 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:28.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb6f200640 1 --2- 172.21.15.175:0/1188779314 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563c1f5d4bf0 0x563c1f6a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb6fc00640 1 --2- 172.21.15.175:0/1188779314 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c1f6a99b0 0x563c1f6187e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb6e800640 1 -- 172.21.15.175:0/1188779314 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563c1f5d4bf0 msgr2=0x563c1f6a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb6e800640 1 --2- 172.21.15.175:0/1188779314 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563c1f5d4bf0 0x563c1f6a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb6e800640 1 -- 172.21.15.175:0/1188779314 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c1f6a99b0 msgr2=0x563c1f6187e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb6e800640 1 --2- 172.21.15.175:0/1188779314 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563c1f6a99b0 0x563c1f6187e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb6e800640 1 -- 172.21.15.175:0/1188779314 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c1f6a4c50 con 0x563c1f6a95d0 2024-04-25T09:14:28.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb6f200640 1 --2- 172.21.15.175:0/1188779314 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563c1f5d4bf0 0x563c1f6a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:28.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb6e800640 1 --2- 172.21.15.175:0/1188779314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c1f6a95d0 0x563c1f6182a0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c018ff0 tx=0x7fdb5c018160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb67e00640 1 -- 172.21.15.175:0/1188779314 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c0bc020 con 0x563c1f6a95d0 2024-04-25T09:14:28.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb67e00640 1 -- 172.21.15.175:0/1188779314 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c0b5440 con 0x563c1f6a95d0 2024-04-25T09:14:28.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb67e00640 1 -- 172.21.15.175:0/1188779314 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c0b0040 con 0x563c1f6a95d0 2024-04-25T09:14:28.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb72014080 1 -- 172.21.15.175:0/1188779314 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563c1f7422b0 con 0x563c1f6a95d0 2024-04-25T09:14:28.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb72014080 1 -- 172.21.15.175:0/1188779314 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c1f7427f0 con 0x563c1f6a95d0 2024-04-25T09:14:28.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.219+0000 7fdb67e00640 1 -- 172.21.15.175:0/1188779314 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdb5c0bf020 con 0x563c1f6a95d0 2024-04-25T09:14:28.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb67e00640 1 --2- 172.21.15.175:0/1188779314 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdb50065940 0x7fdb50067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb67e00640 1 -- 172.21.15.175:0/1188779314 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fdb5c11e7b0 con 0x563c1f6a95d0 2024-04-25T09:14:28.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb6f200640 1 --2- 172.21.15.175:0/1188779314 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdb50065940 0x7fdb50067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb72014080 1 --2- 172.21.15.175:0/1188779314 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x563c1f742f30 0x563c1f743310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb72014080 1 -- 172.21.15.175:0/1188779314 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:1 17.12 17:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e114) v9 -- 0x563c1f743850 con 0x563c1f742f30 2024-04-25T09:14:28.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb6fc00640 1 --2- 172.21.15.175:0/1188779314 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x563c1f742f30 0x563c1f743310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb6f200640 1 --2- 172.21.15.175:0/1188779314 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdb50065940 0x7fdb50067e00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdb60000fe0 tx=0x7fdb60009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb6fc00640 1 --2- 172.21.15.175:0/1188779314 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x563c1f742f30 0x563c1f743310 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb6fc00640 1 -- 172.21.15.175:0/1188779314 <== osd.3 v2:172.21.15.175:6816/4078277957 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (12) out=12b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7fdb6800d7f0 con 0x563c1f742f30 2024-04-25T09:14:28.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb72014080 1 -- 172.21.15.175:0/1188779314 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x563c1f742f30 msgr2=0x563c1f743310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb72014080 1 --2- 172.21.15.175:0/1188779314 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x563c1f742f30 0x563c1f743310 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb72014080 1 -- 172.21.15.175:0/1188779314 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdb50065940 msgr2=0x7fdb50067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb72014080 1 --2- 172.21.15.175:0/1188779314 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fdb50065940 0x7fdb50067e00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdb60000fe0 tx=0x7fdb60009000 comp rx=0 tx=0).stop 2024-04-25T09:14:28.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb72014080 1 -- 172.21.15.175:0/1188779314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c1f6a95d0 msgr2=0x563c1f6182a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb72014080 1 --2- 172.21.15.175:0/1188779314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563c1f6a95d0 0x563c1f6182a0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c018ff0 tx=0x7fdb5c018160 comp rx=0 tx=0).stop 2024-04-25T09:14:28.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb6fc00640 1 -- 172.21.15.175:0/1188779314 reap_dead start 2024-04-25T09:14:28.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb72014080 1 -- 172.21.15.175:0/1188779314 shutdown_connections 2024-04-25T09:14:28.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb72014080 1 -- 172.21.15.175:0/1188779314 >> 172.21.15.175:0/1188779314 conn(0x563c1f5d2420 msgr2=0x563c1f5fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:28.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb72014080 1 -- 172.21.15.175:0/1188779314 shutdown_connections 2024-04-25T09:14:28.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.223+0000 7fdb72014080 1 -- 172.21.15.175:0/1188779314 wait complete. 2024-04-25T09:14:28.216 INFO:teuthology.orchestra.run.smithi175.stdout:mytag123 2024-04-25T09:14:28.216 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000004.00000000 scrub_tag 2024-04-25T09:14:28.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e0964e080 1 Processor -- start 2024-04-25T09:14:28.303 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e0964e080 1 -- start start 2024-04-25T09:14:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e0964e080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556793191c30 0x556793260210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e0964e080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556793192010 0x5567931d55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e0964e080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567931dfce0 0x5567931d5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e0964e080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567931389f0 con 0x5567931dfce0 2024-04-25T09:14:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e0964e080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55679313c950 con 0x556793192010 2024-04-25T09:14:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e0964e080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5567931dd9e0 con 0x556793191c30 2024-04-25T09:14:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e07200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567931dfce0 0x5567931d5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e07200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567931dfce0 0x5567931d5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43858/0 (socket says 172.21.15.175:43858) 2024-04-25T09:14:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e07200640 1 -- 172.21.15.175:0/3333203830 learned_addr learned my addr 172.21.15.175:0/3333203830 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e06800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556793191c30 0x556793260210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e05e00640 1 --2- 172.21.15.175:0/3333203830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556793192010 0x5567931d55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e07200640 1 -- 172.21.15.175:0/3333203830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556793191c30 msgr2=0x556793260210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e07200640 1 --2- 172.21.15.175:0/3333203830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556793191c30 0x556793260210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e07200640 1 -- 172.21.15.175:0/3333203830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556793192010 msgr2=0x5567931d55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:28.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e07200640 1 --2- 172.21.15.175:0/3333203830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556793192010 0x5567931d55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e07200640 1 -- 172.21.15.175:0/3333203830 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556793262c50 con 0x5567931dfce0 2024-04-25T09:14:28.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.315+0000 7f5e07200640 1 --2- 172.21.15.175:0/3333203830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567931dfce0 0x5567931d5ae0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f5e00001740 tx=0x7f5e00006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3bbf04d204d1f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e04a00640 1 -- 172.21.15.175:0/3333203830 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e00016070 con 0x5567931dfce0 2024-04-25T09:14:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e04a00640 1 -- 172.21.15.175:0/3333203830 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e00010790 con 0x5567931dfce0 2024-04-25T09:14:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e04a00640 1 -- 172.21.15.175:0/3333203830 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e00010b60 con 0x5567931dfce0 2024-04-25T09:14:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 -- 172.21.15.175:0/3333203830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567931dfce0 msgr2=0x5567931d5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 --2- 172.21.15.175:0/3333203830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567931dfce0 0x5567931d5ae0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f5e00001740 tx=0x7f5e00006f90 comp rx=0 tx=0).stop 2024-04-25T09:14:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 -- 172.21.15.175:0/3333203830 shutdown_connections 2024-04-25T09:14:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 --2- 172.21.15.175:0/3333203830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567931dfce0 0x5567931d5ae0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 --2- 172.21.15.175:0/3333203830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556793192010 0x5567931d55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 --2- 172.21.15.175:0/3333203830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556793191c30 0x556793260210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 -- 172.21.15.175:0/3333203830 >> 172.21.15.175:0/3333203830 conn(0x556793192880 msgr2=0x5567931c31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:28.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 -- 172.21.15.175:0/3333203830 shutdown_connections 2024-04-25T09:14:28.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 -- 172.21.15.175:0/3333203830 wait complete. 2024-04-25T09:14:28.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 Processor -- start 2024-04-25T09:14:28.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 -- start start 2024-04-25T09:14:28.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556793191c30 0x55679325ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556793192010 0x556793302380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567931dfce0 0x556793260640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567932629f0 con 0x5567931dfce0 2024-04-25T09:14:28.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x556793264550 con 0x556793191c30 2024-04-25T09:14:28.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x556793263b70 con 0x556793192010 2024-04-25T09:14:28.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e07200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567931dfce0 0x556793260640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e07200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567931dfce0 0x556793260640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43862/0 (socket says 172.21.15.175:43862) 2024-04-25T09:14:28.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e07200640 1 -- 172.21.15.175:0/3526281533 learned_addr learned my addr 172.21.15.175:0/3526281533 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:28.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e05e00640 1 --2- 172.21.15.175:0/3526281533 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556793192010 0x556793302380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e06800640 1 --2- 172.21.15.175:0/3526281533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556793191c30 0x55679325ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e07200640 1 -- 172.21.15.175:0/3526281533 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556793192010 msgr2=0x556793302380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e07200640 1 --2- 172.21.15.175:0/3526281533 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x556793192010 0x556793302380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e07200640 1 -- 172.21.15.175:0/3526281533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556793191c30 msgr2=0x55679325ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e07200640 1 --2- 172.21.15.175:0/3526281533 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x556793191c30 0x55679325ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e07200640 1 -- 172.21.15.175:0/3526281533 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567931db0e0 con 0x5567931dfce0 2024-04-25T09:14:28.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e07200640 1 --2- 172.21.15.175:0/3526281533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567931dfce0 0x556793260640 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f5e00001570 tx=0x7f5e00001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5dff400640 1 -- 172.21.15.175:0/3526281533 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e00021020 con 0x5567931dfce0 2024-04-25T09:14:28.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5dff400640 1 -- 172.21.15.175:0/3526281533 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e00017040 con 0x5567931dfce0 2024-04-25T09:14:28.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 -- 172.21.15.175:0/3526281533 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5567931db380 con 0x5567931dfce0 2024-04-25T09:14:28.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5dff400640 1 -- 172.21.15.175:0/3526281533 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e00016070 con 0x5567931dfce0 2024-04-25T09:14:28.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.319+0000 7f5e0964e080 1 -- 172.21.15.175:0/3526281533 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556793274030 con 0x5567931dfce0 2024-04-25T09:14:28.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.323+0000 7f5dff400640 1 -- 172.21.15.175:0/3526281533 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5e00024020 con 0x5567931dfce0 2024-04-25T09:14:28.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.323+0000 7f5dff400640 1 --2- 172.21.15.175:0/3526281533 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5de8065940 0x7f5de8067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.323+0000 7f5dff400640 1 -- 172.21.15.175:0/3526281533 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5e00085210 con 0x5567931dfce0 2024-04-25T09:14:28.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.323+0000 7f5e06800640 1 --2- 172.21.15.175:0/3526281533 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5de8065940 0x7f5de8067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.323+0000 7f5e0964e080 1 --2- 172.21.15.175:0/3526281533 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55679325f370 0x5567931d8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.323+0000 7f5e0964e080 1 -- 172.21.15.175:0/3526281533 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:1 17.5 17:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e114) v9 -- 0x5567933028c0 con 0x55679325f370 2024-04-25T09:14:28.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.323+0000 7f5e05e00640 1 --2- 172.21.15.175:0/3526281533 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55679325f370 0x5567931d8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.323+0000 7f5e06800640 1 --2- 172.21.15.175:0/3526281533 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5de8065940 0x7f5de8067e00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5df8001ee0 tx=0x7f5df8010040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.323+0000 7f5e05e00640 1 --2- 172.21.15.175:0/3526281533 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55679325f370 0x5567931d8080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.327+0000 7f5e05e00640 1 -- 172.21.15.175:0/3526281533 <== osd.6 v2:172.21.15.177:6822/4132808595 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (12) out=12b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7f5df40b2040 con 0x55679325f370 2024-04-25T09:14:28.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.327+0000 7f5e0964e080 1 -- 172.21.15.175:0/3526281533 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55679325f370 msgr2=0x5567931d8080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.327+0000 7f5e0964e080 1 --2- 172.21.15.175:0/3526281533 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x55679325f370 0x5567931d8080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.327+0000 7f5e0964e080 1 -- 172.21.15.175:0/3526281533 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5de8065940 msgr2=0x7f5de8067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.327+0000 7f5e0964e080 1 --2- 172.21.15.175:0/3526281533 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5de8065940 0x7f5de8067e00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5df8001ee0 tx=0x7f5df8010040 comp rx=0 tx=0).stop 2024-04-25T09:14:28.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.327+0000 7f5e0964e080 1 -- 172.21.15.175:0/3526281533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567931dfce0 msgr2=0x556793260640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.327+0000 7f5e0964e080 1 --2- 172.21.15.175:0/3526281533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5567931dfce0 0x556793260640 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f5e00001570 tx=0x7f5e00001260 comp rx=0 tx=0).stop 2024-04-25T09:14:28.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.327+0000 7f5e07200640 1 -- 172.21.15.175:0/3526281533 reap_dead start 2024-04-25T09:14:28.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.327+0000 7f5e0964e080 1 -- 172.21.15.175:0/3526281533 shutdown_connections 2024-04-25T09:14:28.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.327+0000 7f5e0964e080 1 -- 172.21.15.175:0/3526281533 >> 172.21.15.175:0/3526281533 conn(0x556793192880 msgr2=0x5567931c31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:28.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.327+0000 7f5e0964e080 1 -- 172.21.15.175:0/3526281533 shutdown_connections 2024-04-25T09:14:28.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.327+0000 7f5e0964e080 1 -- 172.21.15.175:0/3526281533 wait complete. 2024-04-25T09:14:28.318 INFO:teuthology.orchestra.run.smithi175.stdout:mytag123 2024-04-25T09:14:28.318 DEBUG:teuthology.orchestra.run.smithi175:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000006.00000000 scrub_tag 2024-04-25T09:14:28.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643fe47080 1 Processor -- start 2024-04-25T09:14:28.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643fe47080 1 -- start start 2024-04-25T09:14:28.412 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643fe47080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cad883510 0x563cad86a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643fe47080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563cad884d00 0x563cad8f4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643fe47080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cad910550 0x563cad912ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643fe47080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cad86d360 con 0x563cad910550 2024-04-25T09:14:28.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643fe47080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cad7df9f0 con 0x563cad883510 2024-04-25T09:14:28.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643fe47080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cad839ad0 con 0x563cad884d00 2024-04-25T09:14:28.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643da00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cad910550 0x563cad912ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643d000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cad883510 0x563cad86a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643da00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cad910550 0x563cad912ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43874/0 (socket says 172.21.15.175:43874) 2024-04-25T09:14:28.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643da00640 1 -- 172.21.15.175:0/3265750845 learned_addr learned my addr 172.21.15.175:0/3265750845 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:28.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f6437e00640 1 --2- 172.21.15.175:0/3265750845 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563cad884d00 0x563cad8f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643da00640 1 -- 172.21.15.175:0/3265750845 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563cad884d00 msgr2=0x563cad8f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:28.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643da00640 1 --2- 172.21.15.175:0/3265750845 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563cad884d00 0x563cad8f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643da00640 1 -- 172.21.15.175:0/3265750845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cad883510 msgr2=0x563cad86a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:28.413 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643da00640 1 --2- 172.21.15.175:0/3265750845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cad883510 0x563cad86a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643da00640 1 -- 172.21.15.175:0/3265750845 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cad911c70 con 0x563cad910550 2024-04-25T09:14:28.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643d000640 1 --2- 172.21.15.175:0/3265750845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cad883510 0x563cad86a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:28.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643da00640 1 --2- 172.21.15.175:0/3265750845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cad910550 0x563cad912ca0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f643800a7b0 tx=0x7f643800ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3d07c57aa0a9f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f6436a00640 1 -- 172.21.15.175:0/3265750845 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6438016020 con 0x563cad910550 2024-04-25T09:14:28.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f6436a00640 1 -- 172.21.15.175:0/3265750845 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643800d960 con 0x563cad910550 2024-04-25T09:14:28.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f6436a00640 1 -- 172.21.15.175:0/3265750845 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643800ae60 con 0x563cad910550 2024-04-25T09:14:28.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643fe47080 1 -- 172.21.15.175:0/3265750845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cad910550 msgr2=0x563cad912ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643fe47080 1 --2- 172.21.15.175:0/3265750845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cad910550 0x563cad912ca0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f643800a7b0 tx=0x7f643800ac70 comp rx=0 tx=0).stop 2024-04-25T09:14:28.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643fe47080 1 -- 172.21.15.175:0/3265750845 shutdown_connections 2024-04-25T09:14:28.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643fe47080 1 --2- 172.21.15.175:0/3265750845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cad910550 0x563cad912ca0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643fe47080 1 --2- 172.21.15.175:0/3265750845 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563cad884d00 0x563cad8f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643fe47080 1 --2- 172.21.15.175:0/3265750845 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cad883510 0x563cad86a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643fe47080 1 -- 172.21.15.175:0/3265750845 >> 172.21.15.175:0/3265750845 conn(0x563cad867430 msgr2=0x563cad86c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:28.414 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643fe47080 1 -- 172.21.15.175:0/3265750845 shutdown_connections 2024-04-25T09:14:28.415 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.423+0000 7f643fe47080 1 -- 172.21.15.175:0/3265750845 wait complete. 2024-04-25T09:14:28.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643fe47080 1 Processor -- start 2024-04-25T09:14:28.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643fe47080 1 -- start start 2024-04-25T09:14:28.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643fe47080 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cad883510 0x563cad90a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643fe47080 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563cad884d00 0x563cad915090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643fe47080 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cad910550 0x563cad90db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643fe47080 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cad86a6d0 con 0x563cad883510 2024-04-25T09:14:28.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643fe47080 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cad86a910 con 0x563cad910550 2024-04-25T09:14:28.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643fe47080 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cad911f10 con 0x563cad884d00 2024-04-25T09:14:28.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643d000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cad883510 0x563cad90a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643d000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cad883510 0x563cad90a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43880/0 (socket says 172.21.15.175:43880) 2024-04-25T09:14:28.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643d000640 1 -- 172.21.15.175:0/907324151 learned_addr learned my addr 172.21.15.175:0/907324151 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:28.417 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f6437e00640 1 --2- 172.21.15.175:0/907324151 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563cad884d00 0x563cad915090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643da00640 1 --2- 172.21.15.175:0/907324151 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cad910550 0x563cad90db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643d000640 1 -- 172.21.15.175:0/907324151 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563cad884d00 msgr2=0x563cad915090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643d000640 1 --2- 172.21.15.175:0/907324151 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x563cad884d00 0x563cad915090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643d000640 1 -- 172.21.15.175:0/907324151 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cad910550 msgr2=0x563cad90db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643d000640 1 --2- 172.21.15.175:0/907324151 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x563cad910550 0x563cad90db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643d000640 1 -- 172.21.15.175:0/907324151 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cad915af0 con 0x563cad883510 2024-04-25T09:14:28.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643d000640 1 --2- 172.21.15.175:0/907324151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cad883510 0x563cad90a530 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f643000a500 tx=0x7f6430018150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f6435600640 1 -- 172.21.15.175:0/907324151 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64300bc070 con 0x563cad883510 2024-04-25T09:14:28.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f6435600640 1 -- 172.21.15.175:0/907324151 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64300b1040 con 0x563cad883510 2024-04-25T09:14:28.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643fe47080 1 -- 172.21.15.175:0/907324151 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563cad915d90 con 0x563cad883510 2024-04-25T09:14:28.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f6435600640 1 -- 172.21.15.175:0/907324151 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64300b0040 con 0x563cad883510 2024-04-25T09:14:28.418 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.427+0000 7f643fe47080 1 -- 172.21.15.175:0/907324151 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563cad9162d0 con 0x563cad883510 2024-04-25T09:14:28.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f6435600640 1 -- 172.21.15.175:0/907324151 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f64300bf070 con 0x563cad883510 2024-04-25T09:14:28.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f6435600640 1 --2- 172.21.15.175:0/907324151 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f641c065970 0x7f641c067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f6435600640 1 -- 172.21.15.175:0/907324151 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f643011e950 con 0x563cad883510 2024-04-25T09:14:28.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f6437e00640 1 --2- 172.21.15.175:0/907324151 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f641c065970 0x7f641c067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f643fe47080 1 --2- 172.21.15.175:0/907324151 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x563cad9155d0 0x563cad918390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f643fe47080 1 -- 172.21.15.175:0/907324151 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:1 17.25 17:a5feb6f3:::10000000006.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e114) v9 -- 0x563cad9188d0 con 0x563cad9155d0 2024-04-25T09:14:28.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f643da00640 1 --2- 172.21.15.175:0/907324151 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x563cad9155d0 0x563cad918390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f6437e00640 1 --2- 172.21.15.175:0/907324151 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f641c065970 0x7f641c067e30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6428002fd0 tx=0x7f6428001700 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f643da00640 1 --2- 172.21.15.175:0/907324151 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x563cad9155d0 0x563cad918390 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f643da00640 1 -- 172.21.15.175:0/907324151 <== osd.1 v2:172.21.15.175:6802/594808902 1 ==== osd_op_reply(1 10000000006.00000000 [getxattr (12) out=12b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7f6438012470 con 0x563cad9155d0 2024-04-25T09:14:28.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f643fe47080 1 -- 172.21.15.175:0/907324151 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x563cad9155d0 msgr2=0x563cad918390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f643fe47080 1 --2- 172.21.15.175:0/907324151 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x563cad9155d0 0x563cad918390 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f643fe47080 1 -- 172.21.15.175:0/907324151 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f641c065970 msgr2=0x7f641c067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.421 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f643fe47080 1 --2- 172.21.15.175:0/907324151 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f641c065970 0x7f641c067e30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6428002fd0 tx=0x7f6428001700 comp rx=0 tx=0).stop 2024-04-25T09:14:28.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f643fe47080 1 -- 172.21.15.175:0/907324151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cad883510 msgr2=0x563cad90a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f643fe47080 1 --2- 172.21.15.175:0/907324151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x563cad883510 0x563cad90a530 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f643000a500 tx=0x7f6430018150 comp rx=0 tx=0).stop 2024-04-25T09:14:28.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f643da00640 1 -- 172.21.15.175:0/907324151 reap_dead start 2024-04-25T09:14:28.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f643fe47080 1 -- 172.21.15.175:0/907324151 shutdown_connections 2024-04-25T09:14:28.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f643fe47080 1 -- 172.21.15.175:0/907324151 >> 172.21.15.175:0/907324151 conn(0x563cad867430 msgr2=0x563cad86bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:28.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f643fe47080 1 -- 172.21.15.175:0/907324151 shutdown_connections 2024-04-25T09:14:28.422 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.431+0000 7f643fe47080 1 -- 172.21.15.175:0/907324151 wait complete. 2024-04-25T09:14:28.425 INFO:teuthology.orchestra.run.smithi175.stdout:mytag123 2024-04-25T09:14:28.425 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:14:28.425 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-04-25T09:14:28.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.575+0000 7f9422800640 1 Processor -- start 2024-04-25T09:14:28.562 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.575+0000 7f9422800640 1 -- start start 2024-04-25T09:14:28.563 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.575+0000 7f9422800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f941c145250 0x7f941c0cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.575+0000 7f9422800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941c0cfd10 con 0x7f941c1600a0 2024-04-25T09:14:28.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.575+0000 7f9422800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941c0cfff0 con 0x7f941c0ce970 2024-04-25T09:14:28.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.575+0000 7f9422800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c15f650 con 0x7f941c145250 2024-04-25T09:14:28.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.575+0000 7f941b400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f941c145250 0x7f941c0cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.575+0000 7f9412a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f941c1600a0 0x7f941c0cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:48252/0 (socket says 172.21.15.175:48252) 2024-04-25T09:14:28.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.575+0000 7f9412a00640 1 -- 172.21.15.175:0/1517696979 learned_addr learned my addr 172.21.15.175:0/1517696979 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:28.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.575+0000 7f941b400640 1 -- 172.21.15.175:0/1517696979 >> v1:172.21.15.177:6789/0 conn(0x7f941c0ce970 legacy=0x7f941c0cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.564 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.575+0000 7f941b400640 1 -- 172.21.15.175:0/1517696979 >> v1:172.21.15.175:6789/0 conn(0x7f941c1600a0 legacy=0x7f941c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.575+0000 7f941b400640 1 -- 172.21.15.175:0/1517696979 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c15f8a0 con 0x7f941c145250 2024-04-25T09:14:28.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.579+0000 7f941b400640 1 --2- 172.21.15.175:0/1517696979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f941c145250 0x7f941c0cf6b0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f941c15f7d0 tx=0x7f940c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a600acd754a6b29d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.579+0000 7f941aa00640 1 -- 172.21.15.175:0/1517696979 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c0b1070 con 0x7f941c145250 2024-04-25T09:14:28.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.579+0000 7f941aa00640 1 -- 172.21.15.175:0/1517696979 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c0a8050 con 0x7f941c145250 2024-04-25T09:14:28.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.579+0000 7f941aa00640 1 -- 172.21.15.175:0/1517696979 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c0ac860 con 0x7f941c145250 2024-04-25T09:14:28.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.579+0000 7f9422800640 1 -- 172.21.15.175:0/1517696979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f941c145250 msgr2=0x7f941c0cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.579+0000 7f9422800640 1 --2- 172.21.15.175:0/1517696979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f941c145250 0x7f941c0cf6b0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f941c15f7d0 tx=0x7f940c01c3c0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.579+0000 7f9422800640 1 -- 172.21.15.175:0/1517696979 shutdown_connections 2024-04-25T09:14:28.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.579+0000 7f9422800640 1 --2- 172.21.15.175:0/1517696979 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f941c145250 0x7f941c0cf6b0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.579+0000 7f9422800640 1 -- 172.21.15.175:0/1517696979 >> 172.21.15.175:0/1517696979 conn(0x7f941c06ac50 msgr2=0x7f941c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:28.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.579+0000 7f9422800640 1 -- 172.21.15.175:0/1517696979 shutdown_connections 2024-04-25T09:14:28.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.579+0000 7f9422800640 1 -- 172.21.15.175:0/1517696979 wait complete. 2024-04-25T09:14:28.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9422800640 1 Processor -- start 2024-04-25T09:14:28.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9422800640 1 -- start start 2024-04-25T09:14:28.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9422800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f941c0ce970 0x7f941c13c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9422800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f941c145250 0x7f941c0ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9422800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f941c1600a0 0x7f941c1f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9422800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c15c9f0 con 0x7f941c145250 2024-04-25T09:14:28.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9422800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c15c870 con 0x7f941c1600a0 2024-04-25T09:14:28.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9422800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c15cb70 con 0x7f941c0ce970 2024-04-25T09:14:28.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9412a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f941c145250 0x7f941c0ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f941b400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f941c0ce970 0x7f941c13c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9412a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f941c145250 0x7f941c0ad2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43886/0 (socket says 172.21.15.175:43886) 2024-04-25T09:14:28.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9412a00640 1 -- 172.21.15.175:0/1025732134 learned_addr learned my addr 172.21.15.175:0/1025732134 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:28.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f941be00640 1 --2- 172.21.15.175:0/1025732134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f941c1600a0 0x7f941c1f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9412a00640 1 -- 172.21.15.175:0/1025732134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f941c0ce970 msgr2=0x7f941c13c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9412a00640 1 --2- 172.21.15.175:0/1025732134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f941c0ce970 0x7f941c13c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9412a00640 1 -- 172.21.15.175:0/1025732134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f941c1600a0 msgr2=0x7f941c1f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9412a00640 1 --2- 172.21.15.175:0/1025732134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f941c1600a0 0x7f941c1f6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9412a00640 1 -- 172.21.15.175:0/1025732134 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0b29c0 con 0x7f941c145250 2024-04-25T09:14:28.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9412a00640 1 --2- 172.21.15.175:0/1025732134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f941c145250 0x7f941c0ad2d0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f940400c500 tx=0x7f940400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9413e00640 1 -- 172.21.15.175:0/1025732134 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404017070 con 0x7f941c145250 2024-04-25T09:14:28.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9413e00640 1 -- 172.21.15.175:0/1025732134 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9404005cf0 con 0x7f941c145250 2024-04-25T09:14:28.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9413e00640 1 -- 172.21.15.175:0/1025732134 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94040072f0 con 0x7f941c145250 2024-04-25T09:14:28.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9422800640 1 -- 172.21.15.175:0/1025732134 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c0b2c80 con 0x7f941c145250 2024-04-25T09:14:28.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.583+0000 7f9422800640 1 -- 172.21.15.175:0/1025732134 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c0b3240 con 0x7f941c145250 2024-04-25T09:14:28.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.587+0000 7f9413e00640 1 -- 172.21.15.175:0/1025732134 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f940401a070 con 0x7f941c145250 2024-04-25T09:14:28.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.587+0000 7f9413e00640 1 --2- 172.21.15.175:0/1025732134 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f93f8066f60 0x7f93f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.587+0000 7f9413e00640 1 -- 172.21.15.175:0/1025732134 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f9404084360 con 0x7f941c145250 2024-04-25T09:14:28.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.587+0000 7f941b400640 1 --2- 172.21.15.175:0/1025732134 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f93f8066f60 0x7f93f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.587+0000 7f9425d46000 1 Processor -- start 2024-04-25T09:14:28.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.587+0000 7f9425d46000 1 -- start start 2024-04-25T09:14:28.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.587+0000 7f941b400640 1 --2- 172.21.15.175:0/1025732134 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f93f8066f60 0x7f93f8069420 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f940c0ae000 tx=0x7f940c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.587+0000 7f9425d46000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651e04db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.587+0000 7f9425d46000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651e052f0 0x564651dbab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.587+0000 7f9425d46000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651dbb0a0 0x564651dbb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.587+0000 7f9425d46000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564651c07ff0 con 0x564651e049d0 2024-04-25T09:14:28.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.587+0000 7f9425d46000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x564651b90150 con 0x564651e052f0 2024-04-25T09:14:28.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.587+0000 7f9425d46000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x564651c04090 con 0x564651dbb0a0 2024-04-25T09:14:28.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.587+0000 7f941b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651e04db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.587+0000 7f941b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651e04db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43900/0 (socket says 172.21.15.175:43900) 2024-04-25T09:14:28.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.587+0000 7f941b400640 1 -- 172.21.15.175:0/3753987781 learned_addr learned my addr 172.21.15.175:0/3753987781 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:28.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.587+0000 7f9412a00640 1 --2- 172.21.15.175:0/3753987781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651e052f0 0x564651dbab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.587+0000 7f941be00640 1 --2- 172.21.15.175:0/3753987781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651dbb0a0 0x564651dbb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f941b400640 1 -- 172.21.15.175:0/3753987781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651dbb0a0 msgr2=0x564651dbb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:28.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f941b400640 1 --2- 172.21.15.175:0/3753987781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651dbb0a0 0x564651dbb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f941b400640 1 -- 172.21.15.175:0/3753987781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651e052f0 msgr2=0x564651dbab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:28.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f941b400640 1 --2- 172.21.15.175:0/3753987781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651e052f0 0x564651dbab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f941b400640 1 -- 172.21.15.175:0/3753987781 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564651d9e0d0 con 0x564651e049d0 2024-04-25T09:14:28.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f941b400640 1 --2- 172.21.15.175:0/3753987781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651e04db0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f940c018fd0 tx=0x7f940c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a88e490308805df4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f940be00640 1 -- 172.21.15.175:0/3753987781 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c0b1040 con 0x564651e049d0 2024-04-25T09:14:28.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f940be00640 1 -- 172.21.15.175:0/3753987781 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c0c7070 con 0x564651e049d0 2024-04-25T09:14:28.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f940be00640 1 -- 172.21.15.175:0/3753987781 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c0b7dd0 con 0x564651e049d0 2024-04-25T09:14:28.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9425d46000 1 -- 172.21.15.175:0/3753987781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 msgr2=0x564651e04db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9425d46000 1 --2- 172.21.15.175:0/3753987781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651e04db0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f940c018fd0 tx=0x7f940c004740 comp rx=0 tx=0).stop 2024-04-25T09:14:28.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9425d46000 1 -- 172.21.15.175:0/3753987781 shutdown_connections 2024-04-25T09:14:28.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9425d46000 1 --2- 172.21.15.175:0/3753987781 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651dbb0a0 0x564651dbb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9425d46000 1 --2- 172.21.15.175:0/3753987781 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651e052f0 0x564651dbab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9425d46000 1 --2- 172.21.15.175:0/3753987781 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651e04db0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9425d46000 1 -- 172.21.15.175:0/3753987781 >> 172.21.15.175:0/3753987781 conn(0x564651db7020 msgr2=0x564651db9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:28.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9425d46000 1 -- 172.21.15.175:0/3753987781 shutdown_connections 2024-04-25T09:14:28.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9425d46000 1 -- 172.21.15.175:0/3753987781 wait complete. 2024-04-25T09:14:28.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9425d46000 1 -- start start 2024-04-25T09:14:28.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9425d46000 1 Processor -- start 2024-04-25T09:14:28.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9425d46000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651dbb0a0 0x564651de97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9425d46000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651de9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9425d46000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651e052f0 0x564651dea270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9425d46000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564651bcc250 con 0x564651e049d0 2024-04-25T09:14:28.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9425d46000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x564651bc2690 con 0x564651e052f0 2024-04-25T09:14:28.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9425d46000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x564651b90a40 con 0x564651dbb0a0 2024-04-25T09:14:28.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9425d46000 10 client.0 _ll_register_callbacks cb 0x564651da5e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:14:28.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f941b400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651dbb0a0 0x564651de97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9412a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651de9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f941b400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651dbb0a0 0x564651de97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:47548/0 (socket says 172.21.15.175:47548) 2024-04-25T09:14:28.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f941b400640 1 -- 172.21.15.175:0/3246795280 learned_addr learned my addr 172.21.15.175:0/3246795280 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:28.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f941be00640 1 --2- 172.21.15.175:0/3246795280 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651e052f0 0x564651dea270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9412a00640 1 -- 172.21.15.175:0/3246795280 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651dbb0a0 msgr2=0x564651de97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:28.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9412a00640 1 --2- 172.21.15.175:0/3246795280 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651dbb0a0 0x564651de97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9412a00640 1 -- 172.21.15.175:0/3246795280 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651e052f0 msgr2=0x564651dea270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:28.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9412a00640 1 --2- 172.21.15.175:0/3246795280 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651e052f0 0x564651dea270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f9412a00640 1 -- 172.21.15.175:0/3246795280 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564651cb51c0 con 0x564651e049d0 2024-04-25T09:14:28.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.591+0000 7f941b400640 1 --2- 172.21.15.175:0/3246795280 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651dbb0a0 0x564651de97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:28.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9412a00640 1 --2- 172.21.15.175:0/3246795280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651de9d30 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f9404082820 tx=0x7f9404054d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931e5b468f7dd854 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9408c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:14:28.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9408c00640 1 -- 172.21.15.175:0/3246795280 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940405ce80 con 0x564651e049d0 2024-04-25T09:14:28.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9408c00640 1 -- 172.21.15.175:0/3246795280 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f940405d020 con 0x564651e049d0 2024-04-25T09:14:28.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 1 -- 172.21.15.175:0/3246795280 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f940c0c7070 con 0x564651e049d0 2024-04-25T09:14:28.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9408c00640 1 -- 172.21.15.175:0/3246795280 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9404068bc0 con 0x564651e049d0 2024-04-25T09:14:28.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 10 client.9102 fetch_fsmap learned FSMap version 99 2024-04-25T09:14:28.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 1 -- 172.21.15.175:0/3246795280 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) v3 -- 0x564651cb1170 con 0x564651e049d0 2024-04-25T09:14:28.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9408c00640 1 -- 172.21.15.175:0/3246795280 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c0c7070 con 0x564651e049d0 2024-04-25T09:14:28.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9408c00640 1 -- 172.21.15.175:0/3246795280 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 99) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9404007490 con 0x564651e049d0 2024-04-25T09:14:28.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 10 client.9102 fetch_fsmap finished waiting for FSMap version 99 2024-04-25T09:14:28.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 10 client.9102 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:14:28.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 20 client.9102 populate_metadata read hostname 'smithi175' 2024-04-25T09:14:28.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 1 --2- 172.21.15.175:0/3246795280 >> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] conn(0x564651e14c80 0x564651e17070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 4 client.9102 mds_command: new command op to 8955 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:14:28.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 1 -- 172.21.15.175:0/3246795280 --> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564651ba3c60 con 0x564651e14c80 2024-04-25T09:14:28.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f941b400640 1 --2- 172.21.15.175:0/3246795280 >> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] conn(0x564651e14c80 0x564651e17070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f941b400640 1 --2- 172.21.15.175:0/3246795280 >> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] conn(0x564651e14c80 0x564651e17070 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d6de8b9bfdcd39b server_cookie=197fe475d0e0c7eb in_seq=0 out_seq=0 2024-04-25T09:14:28.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9408c00640 10 client.9102 ms_handle_connect on v2:172.21.15.175:6834/386187898 2024-04-25T09:14:28.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9408c00640 1 -- 172.21.15.175:0/3246795280 <== mds.0 v2:172.21.15.175:6834/386187898 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564651ba3c60 con 0x564651e14c80 2024-04-25T09:14:28.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9408c00640 10 client.9102 handle_command_reply: tid=0 2024-04-25T09:14:28.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 1 client.9102 shutdown 2024-04-25T09:14:28.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 1 -- 172.21.15.175:0/3246795280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 msgr2=0x564651de9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 1 --2- 172.21.15.175:0/3246795280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651de9d30 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f9404082820 tx=0x7f9404054d80 comp rx=0 tx=0).stop 2024-04-25T09:14:28.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 1 -- 172.21.15.175:0/3246795280 shutdown_connections 2024-04-25T09:14:28.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 1 --2- 172.21.15.175:0/3246795280 >> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] conn(0x564651e14c80 0x564651e17070 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 1 --2- 172.21.15.175:0/3246795280 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651e052f0 0x564651dea270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 1 --2- 172.21.15.175:0/3246795280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651de9d30 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.588 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 1 --2- 172.21.15.175:0/3246795280 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651dbb0a0 0x564651de97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9408c00640 0 client.9102 ms_handle_reset on v2:172.21.15.175:6834/386187898 2024-04-25T09:14:28.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 1 -- 172.21.15.175:0/3246795280 >> 172.21.15.175:0/3246795280 conn(0x564651db7020 msgr2=0x564651db9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:28.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 1 -- 172.21.15.175:0/3246795280 shutdown_connections 2024-04-25T09:14:28.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 1 -- 172.21.15.175:0/3246795280 wait complete. 2024-04-25T09:14:28.589 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.595+0000 7f9425d46000 20 client.9102 trim_cache size 0 max 16384 2024-04-25T09:14:28.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.607+0000 7f9425d46000 1 Processor -- start 2024-04-25T09:14:28.597 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.607+0000 7f9425d46000 1 -- start start 2024-04-25T09:14:28.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9425d46000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651dbb0a0 0x564651e03e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9425d46000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651dba420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9425d46000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651e052f0 0x564651dba960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9425d46000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c202af0 con 0x564651e049d0 2024-04-25T09:14:28.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9425d46000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c140b30 con 0x564651dbb0a0 2024-04-25T09:14:28.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9425d46000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c13ff30 con 0x564651e052f0 2024-04-25T09:14:28.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9412a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651dba420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9412a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651dba420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43920/0 (socket says 172.21.15.175:43920) 2024-04-25T09:14:28.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9412a00640 1 -- 172.21.15.175:0/765526099 learned_addr learned my addr 172.21.15.175:0/765526099 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:28.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f941be00640 1 --2- 172.21.15.175:0/765526099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651e052f0 0x564651dba960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f941b400640 1 --2- 172.21.15.175:0/765526099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651dbb0a0 0x564651e03e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9412a00640 1 -- 172.21.15.175:0/765526099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651e052f0 msgr2=0x564651dba960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:28.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9412a00640 1 --2- 172.21.15.175:0/765526099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651e052f0 0x564651dba960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9412a00640 1 -- 172.21.15.175:0/765526099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651dbb0a0 msgr2=0x564651e03e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:28.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9412a00640 1 --2- 172.21.15.175:0/765526099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651dbb0a0 0x564651e03e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9412a00640 1 -- 172.21.15.175:0/765526099 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564651c4ede0 con 0x564651e049d0 2024-04-25T09:14:28.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9412a00640 1 --2- 172.21.15.175:0/765526099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651dba420 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f940400cec0 tx=0x7f9404057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6566daa6f1a05988 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f940b400640 1 -- 172.21.15.175:0/765526099 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404078070 con 0x564651e049d0 2024-04-25T09:14:28.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f940b400640 1 -- 172.21.15.175:0/765526099 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940407d060 con 0x564651e049d0 2024-04-25T09:14:28.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f940b400640 1 -- 172.21.15.175:0/765526099 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94040547f0 con 0x564651e049d0 2024-04-25T09:14:28.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9425d46000 1 -- 172.21.15.175:0/765526099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 msgr2=0x564651dba420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9425d46000 1 --2- 172.21.15.175:0/765526099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651dba420 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f940400cec0 tx=0x7f9404057000 comp rx=0 tx=0).stop 2024-04-25T09:14:28.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9425d46000 1 -- 172.21.15.175:0/765526099 shutdown_connections 2024-04-25T09:14:28.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9425d46000 1 --2- 172.21.15.175:0/765526099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651e052f0 0x564651dba960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9425d46000 1 --2- 172.21.15.175:0/765526099 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651dba420 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9425d46000 1 --2- 172.21.15.175:0/765526099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651dbb0a0 0x564651e03e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9425d46000 1 -- 172.21.15.175:0/765526099 >> 172.21.15.175:0/765526099 conn(0x564651db7020 msgr2=0x564651e030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:28.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9425d46000 1 -- 172.21.15.175:0/765526099 shutdown_connections 2024-04-25T09:14:28.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9425d46000 1 -- 172.21.15.175:0/765526099 wait complete. 2024-04-25T09:14:28.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9425d46000 1 -- start start 2024-04-25T09:14:28.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.611+0000 7f9425d46000 1 Processor -- start 2024-04-25T09:14:28.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9425d46000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651dbb0a0 0x564651e65520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9425d46000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651e65a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9425d46000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651e052f0 0x564651e17380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9425d46000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x564651ba2e00 con 0x564651e049d0 2024-04-25T09:14:28.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9425d46000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c140530 con 0x564651dbb0a0 2024-04-25T09:14:28.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9425d46000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x564651c07300 con 0x564651e052f0 2024-04-25T09:14:28.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9425d46000 10 client.0 _ll_register_callbacks cb 0x564651d86040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:14:28.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9412a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651e65a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9412a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651e65a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43922/0 (socket says 172.21.15.175:43922) 2024-04-25T09:14:28.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9412a00640 1 -- 172.21.15.175:0/322058065 learned_addr learned my addr 172.21.15.175:0/322058065 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:28.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f941be00640 1 --2- 172.21.15.175:0/322058065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651e052f0 0x564651e17380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f941b400640 1 --2- 172.21.15.175:0/322058065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651dbb0a0 0x564651e65520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9412a00640 1 -- 172.21.15.175:0/322058065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651e052f0 msgr2=0x564651e17380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:28.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9412a00640 1 --2- 172.21.15.175:0/322058065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651e052f0 0x564651e17380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9412a00640 1 -- 172.21.15.175:0/322058065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651dbb0a0 msgr2=0x564651e65520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:28.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9412a00640 1 --2- 172.21.15.175:0/322058065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651dbb0a0 0x564651e65520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9412a00640 1 -- 172.21.15.175:0/322058065 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564651ba98e0 con 0x564651e049d0 2024-04-25T09:14:28.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9412a00640 1 --2- 172.21.15.175:0/322058065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651e65a60 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f940405cde0 tx=0x7f94040826f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ebc1960835e1559 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9408c00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:14:28.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9408c00640 1 -- 172.21.15.175:0/322058065 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404078030 con 0x564651e049d0 2024-04-25T09:14:28.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9408c00640 1 -- 172.21.15.175:0/322058065 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f940405ec70 con 0x564651e049d0 2024-04-25T09:14:28.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9425d46000 1 -- 172.21.15.175:0/322058065 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f940407d060 con 0x564651e049d0 2024-04-25T09:14:28.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9408c00640 1 -- 172.21.15.175:0/322058065 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9404065050 con 0x564651e049d0 2024-04-25T09:14:28.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9425d46000 10 client.9108 fetch_fsmap learned FSMap version 99 2024-04-25T09:14:28.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9425d46000 1 -- 172.21.15.175:0/322058065 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) v3 -- 0x564651c618f0 con 0x564651e049d0 2024-04-25T09:14:28.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9408c00640 1 -- 172.21.15.175:0/322058065 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940407d060 con 0x564651e049d0 2024-04-25T09:14:28.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9408c00640 1 -- 172.21.15.175:0/322058065 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 99) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9404068020 con 0x564651e049d0 2024-04-25T09:14:28.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9425d46000 10 client.9108 fetch_fsmap finished waiting for FSMap version 99 2024-04-25T09:14:28.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9425d46000 10 client.9108 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:14:28.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9425d46000 20 client.9108 populate_metadata read hostname 'smithi175' 2024-04-25T09:14:28.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9425d46000 1 --2- 172.21.15.175:0/322058065 >> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] conn(0x564651e17ce0 0x564651e180f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9425d46000 4 client.9108 mds_command: new command op to 8955 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T09:14:28.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9425d46000 1 -- 172.21.15.175:0/322058065 --> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564651c15530 con 0x564651e17ce0 2024-04-25T09:14:28.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f941b400640 1 --2- 172.21.15.175:0/322058065 >> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] conn(0x564651e17ce0 0x564651e180f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f9408c00640 10 client.9108 ms_handle_connect on v2:172.21.15.175:6834/386187898 2024-04-25T09:14:28.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.615+0000 7f941b400640 1 --2- 172.21.15.175:0/322058065 >> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] conn(0x564651e17ce0 0x564651e180f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6dd41099440789a server_cookie=9ee2490e38cdf836 in_seq=0 out_seq=0 2024-04-25T09:14:28.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9408c00640 1 -- 172.21.15.175:0/322058065 <== mds.0 v2:172.21.15.175:6834/386187898 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564651c15530 con 0x564651e17ce0 2024-04-25T09:14:28.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9408c00640 10 client.9108 handle_command_reply: tid=0 2024-04-25T09:14:28.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9425d46000 1 client.9108 shutdown 2024-04-25T09:14:28.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9425d46000 1 -- 172.21.15.175:0/322058065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 msgr2=0x564651e65a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9425d46000 1 --2- 172.21.15.175:0/322058065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651e65a60 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f940405cde0 tx=0x7f94040826f0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9425d46000 1 -- 172.21.15.175:0/322058065 shutdown_connections 2024-04-25T09:14:28.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9425d46000 1 --2- 172.21.15.175:0/322058065 >> [v2:172.21.15.175:6834/386187898,v1:172.21.15.175:6836/386187898] conn(0x564651e17ce0 0x564651e180f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9425d46000 1 --2- 172.21.15.175:0/322058065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x564651e052f0 0x564651e17380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9425d46000 1 --2- 172.21.15.175:0/322058065 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x564651e049d0 0x564651e65a60 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9408c00640 0 client.9108 ms_handle_reset on v2:172.21.15.175:6834/386187898 2024-04-25T09:14:28.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9425d46000 1 --2- 172.21.15.175:0/322058065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x564651dbb0a0 0x564651e65520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9425d46000 1 -- 172.21.15.175:0/322058065 >> 172.21.15.175:0/322058065 conn(0x564651db7020 msgr2=0x564651e03960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:28.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9425d46000 1 -- 172.21.15.175:0/322058065 shutdown_connections 2024-04-25T09:14:28.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9425d46000 1 -- 172.21.15.175:0/322058065 wait complete. 2024-04-25T09:14:28.621 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9425d46000 20 client.9108 trim_cache size 0 max 16384 2024-04-25T09:14:28.621 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:14:28.622 INFO:teuthology.orchestra.run.smithi175.stdout: "message": "", 2024-04-25T09:14:28.622 INFO:teuthology.orchestra.run.smithi175.stdout: "return_code": 0 2024-04-25T09:14:28.622 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:14:28.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9422800640 1 -- 172.21.15.175:0/1025732134 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f93f8066f60 msgr2=0x7f93f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.622 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9422800640 1 --2- 172.21.15.175:0/1025732134 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f93f8066f60 0x7f93f8069420 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f940c0ae000 tx=0x7f940c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:14:28.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9422800640 1 -- 172.21.15.175:0/1025732134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f941c145250 msgr2=0x7f941c0ad2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9422800640 1 --2- 172.21.15.175:0/1025732134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f941c145250 0x7f941c0ad2d0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f940400c500 tx=0x7f940400c9c0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9422800640 1 -- 172.21.15.175:0/1025732134 shutdown_connections 2024-04-25T09:14:28.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9422800640 1 --2- 172.21.15.175:0/1025732134 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f93f8066f60 0x7f93f8069420 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9422800640 1 --2- 172.21.15.175:0/1025732134 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f941c1600a0 0x7f941c1f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9422800640 1 --2- 172.21.15.175:0/1025732134 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f941c145250 0x7f941c0ad2d0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9422800640 1 --2- 172.21.15.175:0/1025732134 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f941c0ce970 0x7f941c13c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9422800640 1 -- 172.21.15.175:0/1025732134 >> 172.21.15.175:0/1025732134 conn(0x7f941c06ac50 msgr2=0x7f941c0cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:28.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9422800640 1 -- 172.21.15.175:0/1025732134 shutdown_connections 2024-04-25T09:14:28.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.631+0000 7f9422800640 1 -- 172.21.15.175:0/1025732134 wait complete. 2024-04-25T09:14:28.639 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:14:28.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.791+0000 7fd2e4c00640 1 Processor -- start 2024-04-25T09:14:28.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.791+0000 7fd2e4c00640 1 -- start start 2024-04-25T09:14:28.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.791+0000 7fd2e4c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd2e0145250 0x7fd2e00cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.791+0000 7fd2e4c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd2e01600a0 0x7fd2e00cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.791+0000 7fd2e4c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e00cfd10 con 0x7fd2e00ce970 2024-04-25T09:14:28.779 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.791+0000 7fd2e4c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e015f650 con 0x7fd2e01600a0 2024-04-25T09:14:28.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.791+0000 7fd2e4c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e00cfff0 con 0x7fd2e0145250 2024-04-25T09:14:28.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.791+0000 7fd2dd400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd2e01600a0 0x7fd2e00cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.791+0000 7fd2dd400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd2e01600a0 0x7fd2e00cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43938/0 (socket says 172.21.15.175:43938) 2024-04-25T09:14:28.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.791+0000 7fd2dd400640 1 -- 172.21.15.175:0/1367506503 learned_addr learned my addr 172.21.15.175:0/1367506503 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:28.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.791+0000 7fd2dde00640 1 --2- 172.21.15.175:0/1367506503 >> v2:172.21.15.177:3300/0 conn(0x7fd2e0145250 0x7fd2e00cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.791+0000 7fd2dd400640 1 -- 172.21.15.175:0/1367506503 >> v2:172.21.15.177:3300/0 conn(0x7fd2e0145250 msgr2=0x7fd2e00cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:28.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.791+0000 7fd2dd400640 1 --2- 172.21.15.175:0/1367506503 >> v2:172.21.15.177:3300/0 conn(0x7fd2e0145250 0x7fd2e00cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.791+0000 7fd2dd400640 1 -- 172.21.15.175:0/1367506503 >> v1:172.21.15.177:6789/0 conn(0x7fd2e00ce970 legacy=0x7fd2e00cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.780 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.791+0000 7fd2dd400640 1 -- 172.21.15.175:0/1367506503 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e015f8a0 con 0x7fd2e01600a0 2024-04-25T09:14:28.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.795+0000 7fd2dd400640 1 --2- 172.21.15.175:0/1367506503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e01600a0 0x7fd2e00cc410 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc009870 tx=0x7fd2cc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0d015c2375cd33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.795+0000 7fd2dca00640 1 -- 172.21.15.175:0/1367506503 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc0aa430 con 0x7fd2e01600a0 2024-04-25T09:14:28.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.795+0000 7fd2dca00640 1 -- 172.21.15.175:0/1367506503 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2cc0af070 con 0x7fd2e01600a0 2024-04-25T09:14:28.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.795+0000 7fd2dca00640 1 -- 172.21.15.175:0/1367506503 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc0aa7f0 con 0x7fd2e01600a0 2024-04-25T09:14:28.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.795+0000 7fd2e4c00640 1 -- 172.21.15.175:0/1367506503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e01600a0 msgr2=0x7fd2e00cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.795+0000 7fd2e4c00640 1 --2- 172.21.15.175:0/1367506503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e01600a0 0x7fd2e00cc410 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc009870 tx=0x7fd2cc01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.795+0000 7fd2e4c00640 1 -- 172.21.15.175:0/1367506503 shutdown_connections 2024-04-25T09:14:28.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.795+0000 7fd2e4c00640 1 --2- 172.21.15.175:0/1367506503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e01600a0 0x7fd2e00cc410 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.795+0000 7fd2e4c00640 1 --2- 172.21.15.175:0/1367506503 >> v2:172.21.15.177:3300/0 conn(0x7fd2e0145250 0x7fd2e00cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.795+0000 7fd2e4c00640 1 -- 172.21.15.175:0/1367506503 >> 172.21.15.175:0/1367506503 conn(0x7fd2e006ac50 msgr2=0x7fd2e006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:28.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.795+0000 7fd2e4c00640 1 -- 172.21.15.175:0/1367506503 shutdown_connections 2024-04-25T09:14:28.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.795+0000 7fd2e4c00640 1 -- 172.21.15.175:0/1367506503 wait complete. 2024-04-25T09:14:28.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.795+0000 7fd2e4c00640 1 Processor -- start 2024-04-25T09:14:28.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.795+0000 7fd2e4c00640 1 -- start start 2024-04-25T09:14:28.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2e4c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2e00ce970 0x7fd2e01433c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2e4c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e0145250 0x7fd2e00ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2e4c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e01600a0 0x7fd2e00ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2e4c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e015c870 con 0x7fd2e01600a0 2024-04-25T09:14:28.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2e4c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e0145630 con 0x7fd2e0145250 2024-04-25T09:14:28.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2e4c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e015c9f0 con 0x7fd2e00ce970 2024-04-25T09:14:28.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2de800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e01600a0 0x7fd2e00ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2dd400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e0145250 0x7fd2e00ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2de800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e01600a0 0x7fd2e00ad3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43940/0 (socket says 172.21.15.175:43940) 2024-04-25T09:14:28.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2de800640 1 -- 172.21.15.175:0/482418603 learned_addr learned my addr 172.21.15.175:0/482418603 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:28.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2dde00640 1 --2- 172.21.15.175:0/482418603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2e00ce970 0x7fd2e01433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2de800640 1 -- 172.21.15.175:0/482418603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2e00ce970 msgr2=0x7fd2e01433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2de800640 1 --2- 172.21.15.175:0/482418603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2e00ce970 0x7fd2e01433c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2de800640 1 -- 172.21.15.175:0/482418603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e0145250 msgr2=0x7fd2e00ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2de800640 1 --2- 172.21.15.175:0/482418603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e0145250 0x7fd2e00ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2de800640 1 -- 172.21.15.175:0/482418603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e00a91a0 con 0x7fd2e01600a0 2024-04-25T09:14:28.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2de800640 1 --2- 172.21.15.175:0/482418603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e01600a0 0x7fd2e00ad3c0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800c7a0 tx=0x7fd2d800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2d6000640 1 -- 172.21.15.175:0/482418603 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8003b80 con 0x7fd2e01600a0 2024-04-25T09:14:28.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2d6000640 1 -- 172.21.15.175:0/482418603 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d8003d20 con 0x7fd2e01600a0 2024-04-25T09:14:28.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2e4c00640 1 -- 172.21.15.175:0/482418603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e00a9480 con 0x7fd2e01600a0 2024-04-25T09:14:28.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2d6000640 1 -- 172.21.15.175:0/482418603 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d800aa90 con 0x7fd2e01600a0 2024-04-25T09:14:28.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2e4c00640 1 -- 172.21.15.175:0/482418603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e00a9a40 con 0x7fd2e01600a0 2024-04-25T09:14:28.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.799+0000 7fd2e4c00640 1 -- 172.21.15.175:0/482418603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e0075160 con 0x7fd2e01600a0 2024-04-25T09:14:28.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.803+0000 7fd2d6000640 1 -- 172.21.15.175:0/482418603 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd2d800ac30 con 0x7fd2e01600a0 2024-04-25T09:14:28.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.803+0000 7fd2d6000640 1 --2- 172.21.15.175:0/482418603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd2c0066f90 0x7fd2c0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:28.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.803+0000 7fd2d6000640 1 -- 172.21.15.175:0/482418603 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd2d8084f10 con 0x7fd2e01600a0 2024-04-25T09:14:28.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.803+0000 7fd2dde00640 1 --2- 172.21.15.175:0/482418603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd2c0066f90 0x7fd2c0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:28.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.803+0000 7fd2dde00640 1 --2- 172.21.15.175:0/482418603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd2c0066f90 0x7fd2c0069450 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd2e01654c0 tx=0x7fd2d0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:28.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.807+0000 7fd2d6000640 1 -- 172.21.15.175:0/482418603 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd2d80557d0 con 0x7fd2e01600a0 2024-04-25T09:14:28.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.995+0000 7fd2e4c00640 1 -- 172.21.15.175:0/482418603 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd2e00cbb60 con 0x7fd2e01600a0 2024-04-25T09:14:28.983 INFO:tasks.ceph.mon.a.smithi175.stderr:2024-04-25T09:14:28.995+0000 7feb0ee00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:14:28.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.995+0000 7fd2d6000640 1 -- 172.21.15.175:0/482418603 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v100) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd2d8059870 con 0x7fd2e01600a0 2024-04-25T09:14:28.985 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:14:28.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.999+0000 7fd2e4c00640 1 -- 172.21.15.175:0/482418603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd2c0066f90 msgr2=0x7fd2c0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.999+0000 7fd2e4c00640 1 --2- 172.21.15.175:0/482418603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd2c0066f90 0x7fd2c0069450 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd2e01654c0 tx=0x7fd2d0009190 comp rx=0 tx=0).stop 2024-04-25T09:14:28.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.999+0000 7fd2e4c00640 1 -- 172.21.15.175:0/482418603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e01600a0 msgr2=0x7fd2e00ad3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:28.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.999+0000 7fd2e4c00640 1 --2- 172.21.15.175:0/482418603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e01600a0 0x7fd2e00ad3c0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800c7a0 tx=0x7fd2d800cc60 comp rx=0 tx=0).stop 2024-04-25T09:14:28.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.999+0000 7fd2e4c00640 1 -- 172.21.15.175:0/482418603 shutdown_connections 2024-04-25T09:14:28.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.999+0000 7fd2e4c00640 1 --2- 172.21.15.175:0/482418603 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd2c0066f90 0x7fd2c0069450 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.999+0000 7fd2e4c00640 1 --2- 172.21.15.175:0/482418603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2e01600a0 0x7fd2e00ad3c0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.999+0000 7fd2e4c00640 1 --2- 172.21.15.175:0/482418603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd2e0145250 0x7fd2e00ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.999+0000 7fd2e4c00640 1 --2- 172.21.15.175:0/482418603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd2e00ce970 0x7fd2e01433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:28.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.999+0000 7fd2e4c00640 1 -- 172.21.15.175:0/482418603 >> 172.21.15.175:0/482418603 conn(0x7fd2e006ac50 msgr2=0x7fd2e015e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:28.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.999+0000 7fd2e4c00640 1 -- 172.21.15.175:0/482418603 shutdown_connections 2024-04-25T09:14:28.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:28.999+0000 7fd2e4c00640 1 -- 172.21.15.175:0/482418603 wait complete. 2024-04-25T09:14:28.995 INFO:tasks.ceph.mds.c.smithi175.stderr: -1747> 2024-04-25T09:14:24.116+0000 7f3160a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:14:29.008 DEBUG:teuthology.orchestra.run.smithi175:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force 2024-04-25T09:14:29.042 INFO:tasks.ceph.mds.c.smithi175.stdout:starting mds.c at 2024-04-25T09:14:29.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.067+0000 7f894de45400 1 -- start start 2024-04-25T09:14:29.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.067+0000 7f894de45400 1 Processor -- start 2024-04-25T09:14:29.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef571cb800 0x55ef57384580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef571cb400 0x55ef57384b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef571cb000 0x55ef57385080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef57f98180 con 0x55ef571cb800 2024-04-25T09:14:29.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef57f98300 con 0x55ef571cb000 2024-04-25T09:14:29.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ef57f98480 con 0x55ef571cb400 2024-04-25T09:14:29.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894c000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef571cb800 0x55ef57384580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894c000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef571cb800 0x55ef57384580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43982/0 (socket says 172.21.15.175:43982) 2024-04-25T09:14:29.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894c000640 1 -- 172.21.15.175:0/441959306 learned_addr learned my addr 172.21.15.175:0/441959306 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:29.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894ca00640 1 --2- 172.21.15.175:0/441959306 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef571cb000 0x55ef57385080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894b600640 1 --2- 172.21.15.175:0/441959306 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef571cb400 0x55ef57384b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894c000640 1 -- 172.21.15.175:0/441959306 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef571cb400 msgr2=0x55ef57384b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894c000640 1 --2- 172.21.15.175:0/441959306 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef571cb400 0x55ef57384b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894c000640 1 -- 172.21.15.175:0/441959306 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef571cb000 msgr2=0x55ef57385080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894c000640 1 --2- 172.21.15.175:0/441959306 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef571cb000 0x55ef57385080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894c000640 1 -- 172.21.15.175:0/441959306 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef5726c960 con 0x55ef571cb800 2024-04-25T09:14:29.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894c000640 1 --2- 172.21.15.175:0/441959306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef571cb800 0x55ef57384580 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x55ef5802d380 tx=0x55ef580dc120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f645eb8c77c2cadd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f8948e00640 1 -- 172.21.15.175:0/441959306 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ef572004e0 con 0x55ef571cb800 2024-04-25T09:14:29.060 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f8948e00640 1 -- 172.21.15.175:0/441959306 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ef57214540 con 0x55ef571cb800 2024-04-25T09:14:29.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f8948e00640 1 -- 172.21.15.175:0/441959306 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ef57200b60 con 0x55ef571cb800 2024-04-25T09:14:29.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 1 -- 172.21.15.175:0/441959306 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef5726cd20 con 0x55ef571cb800 2024-04-25T09:14:29.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 1 -- 172.21.15.175:0/441959306 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55ef5726cf00 con 0x55ef571cb800 2024-04-25T09:14:29.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 4 waiting for MDS map... 2024-04-25T09:14:29.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f8948e00640 1 -- 172.21.15.175:0/441959306 <== mon.0 v2:172.21.15.175:3300/0 4 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x55ef580ee600 con 0x55ef571cb800 2024-04-25T09:14:29.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f8948e00640 1 -- 172.21.15.175:0/441959306 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 100) v1 ==== 2723+0+0 (secure 0 0 0) 0x55ef57221180 con 0x55ef571cb800 2024-04-25T09:14:29.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 4 Got MDS map 100 2024-04-25T09:14:29.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 10 main: JournalTool::main 2024-04-25T09:14:29.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 4 main: JournalTool: connecting to RADOS... 2024-04-25T09:14:29.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 1 Processor -- start 2024-04-25T09:14:29.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 1 -- start start 2024-04-25T09:14:29.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef580f0c00 0x55ef57385600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1000 0x55ef57385b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef580f1400 0x55ef57386100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef57f98600 con 0x55ef580f1000 2024-04-25T09:14:29.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef57f98780 con 0x55ef580f1400 2024-04-25T09:14:29.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.071+0000 7f894de45400 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ef57f98900 con 0x55ef580f0c00 2024-04-25T09:14:29.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894c000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1000 0x55ef57385b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894c000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1000 0x55ef57385b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43990/0 (socket says 172.21.15.175:43990) 2024-04-25T09:14:29.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894c000640 1 -- 172.21.15.175:0/1160515874 learned_addr learned my addr 172.21.15.175:0/1160515874 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:29.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894ca00640 1 --2- 172.21.15.175:0/1160515874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef580f0c00 0x55ef57385600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894b600640 1 --2- 172.21.15.175:0/1160515874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef580f1400 0x55ef57386100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894c000640 1 -- 172.21.15.175:0/1160515874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef580f0c00 msgr2=0x55ef57385600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894c000640 1 --2- 172.21.15.175:0/1160515874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef580f0c00 0x55ef57385600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894c000640 1 -- 172.21.15.175:0/1160515874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef580f1400 msgr2=0x55ef57386100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894c000640 1 --2- 172.21.15.175:0/1160515874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef580f1400 0x55ef57386100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894c000640 1 -- 172.21.15.175:0/1160515874 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef5726cd20 con 0x55ef580f1000 2024-04-25T09:14:29.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894b600640 1 --2- 172.21.15.175:0/1160515874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef580f1400 0x55ef57386100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:29.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894ca00640 1 --2- 172.21.15.175:0/1160515874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef580f0c00 0x55ef57385600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:29.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894c000640 1 --2- 172.21.15.175:0/1160515874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1000 0x55ef57385b80 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x55ef5802d770 tx=0x55ef580dc060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e492d9c837e80868 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f8946600640 1 -- 172.21.15.175:0/1160515874 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ef57200340 con 0x55ef580f1000 2024-04-25T09:14:29.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f8946600640 1 -- 172.21.15.175:0/1160515874 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ef57214e00 con 0x55ef580f1000 2024-04-25T09:14:29.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f8946600640 1 -- 172.21.15.175:0/1160515874 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ef572004e0 con 0x55ef580f1000 2024-04-25T09:14:29.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894de45400 1 -- 172.21.15.175:0/1160515874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1000 msgr2=0x55ef57385b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894de45400 1 --2- 172.21.15.175:0/1160515874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1000 0x55ef57385b80 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x55ef5802d770 tx=0x55ef580dc060 comp rx=0 tx=0).stop 2024-04-25T09:14:29.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894de45400 1 -- 172.21.15.175:0/1160515874 shutdown_connections 2024-04-25T09:14:29.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894de45400 1 --2- 172.21.15.175:0/1160515874 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef580f1400 0x55ef57386100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894de45400 1 --2- 172.21.15.175:0/1160515874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1000 0x55ef57385b80 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894de45400 1 --2- 172.21.15.175:0/1160515874 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef580f0c00 0x55ef57385600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894de45400 1 -- 172.21.15.175:0/1160515874 >> 172.21.15.175:0/1160515874 conn(0x55ef571cac00 msgr2=0x55ef571f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:29.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894de45400 1 -- 172.21.15.175:0/1160515874 shutdown_connections 2024-04-25T09:14:29.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894de45400 1 -- 172.21.15.175:0/1160515874 wait complete. 2024-04-25T09:14:29.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894de45400 1 Processor -- start 2024-04-25T09:14:29.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894de45400 1 -- start start 2024-04-25T09:14:29.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894de45400 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef580f0c00 0x55ef57387180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894de45400 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1000 0x55ef57386c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894de45400 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef580f1400 0x55ef57386680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894de45400 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef57f99c80 con 0x55ef580f1000 2024-04-25T09:14:29.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894de45400 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef57f99b00 con 0x55ef580f1400 2024-04-25T09:14:29.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894de45400 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ef57f99980 con 0x55ef580f0c00 2024-04-25T09:14:29.068 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894c000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1000 0x55ef57386c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894c000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1000 0x55ef57386c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43992/0 (socket says 172.21.15.175:43992) 2024-04-25T09:14:29.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894c000640 1 -- 172.21.15.175:0/2952811374 learned_addr learned my addr 172.21.15.175:0/2952811374 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:29.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894ca00640 1 --2- 172.21.15.175:0/2952811374 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef580f0c00 0x55ef57387180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894b600640 1 --2- 172.21.15.175:0/2952811374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef580f1400 0x55ef57386680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894c000640 1 -- 172.21.15.175:0/2952811374 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef580f0c00 msgr2=0x55ef57387180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894c000640 1 --2- 172.21.15.175:0/2952811374 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef580f0c00 0x55ef57387180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894c000640 1 -- 172.21.15.175:0/2952811374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef580f1400 msgr2=0x55ef57386680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894c000640 1 --2- 172.21.15.175:0/2952811374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef580f1400 0x55ef57386680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894c000640 1 -- 172.21.15.175:0/2952811374 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef5726da40 con 0x55ef580f1000 2024-04-25T09:14:29.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894c000640 1 --2- 172.21.15.175:0/2952811374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1000 0x55ef57386c00 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x55ef581027e0 tx=0x55ef580dc1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f8944800640 1 -- 172.21.15.175:0/2952811374 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ef57200b60 con 0x55ef580f1000 2024-04-25T09:14:29.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f8944800640 1 -- 172.21.15.175:0/2952811374 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ef57214c40 con 0x55ef580f1000 2024-04-25T09:14:29.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f8944800640 1 -- 172.21.15.175:0/2952811374 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ef57200000 con 0x55ef580f1000 2024-04-25T09:14:29.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.075+0000 7f894de45400 1 -- 172.21.15.175:0/2952811374 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ef5726dc20 con 0x55ef580f1000 2024-04-25T09:14:29.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.079+0000 7f894de45400 1 -- 172.21.15.175:0/2952811374 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef57508000 con 0x55ef580f1000 2024-04-25T09:14:29.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.079+0000 7f894de45400 4 main: JournalTool: resolving pool 16 2024-04-25T09:14:29.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.079+0000 7f8944800640 1 -- 172.21.15.175:0/2952811374 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x55ef580e0c00 con 0x55ef580f1000 2024-04-25T09:14:29.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.079+0000 7f8944800640 1 --2- 172.21.15.175:0/2952811374 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55ef57503000 0x55ef57387700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.079+0000 7f8944800640 1 -- 172.21.15.175:0/2952811374 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x55ef57500600 con 0x55ef580f1000 2024-04-25T09:14:29.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.079+0000 7f894de45400 4 main: JournalTool: creating IoCtx.. 2024-04-25T09:14:29.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.079+0000 7f894de45400 4 main: Executing for rank 0 2024-04-25T09:14:29.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.079+0000 7f894ca00640 1 --2- 172.21.15.175:0/2952811374 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55ef57503000 0x55ef57387700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.079+0000 7f894ca00640 1 --2- 172.21.15.175:0/2952811374 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55ef57503000 0x55ef57387700 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x55ef572d86f0 tx=0x55ef575f2c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.079+0000 7f894de45400 1 -- start start 2024-04-25T09:14:29.073 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.079+0000 7f894de45400 1 Processor -- start 2024-04-25T09:14:29.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894de45400 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1c00 0x55ef57386100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894de45400 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef5764c000 0x55ef57385b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894de45400 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef5764c400 0x55ef57385600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894de45400 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef57f98780 con 0x55ef580f1c00 2024-04-25T09:14:29.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894de45400 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef57f98900 con 0x55ef5764c000 2024-04-25T09:14:29.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894de45400 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ef57f99680 con 0x55ef5764c400 2024-04-25T09:14:29.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894ca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1c00 0x55ef57386100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894ca00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1c00 0x55ef57386100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:43996/0 (socket says 172.21.15.175:43996) 2024-04-25T09:14:29.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894ca00640 1 -- 172.21.15.175:0/2263349524 learned_addr learned my addr 172.21.15.175:0/2263349524 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:29.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894b600640 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef5764c400 0x55ef57385600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894c000640 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef5764c000 0x55ef57385b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894ca00640 1 -- 172.21.15.175:0/2263349524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef5764c400 msgr2=0x55ef57385600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.074 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894ca00640 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef5764c400 0x55ef57385600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894ca00640 1 -- 172.21.15.175:0/2263349524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef5764c000 msgr2=0x55ef57385b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894ca00640 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef5764c000 0x55ef57385b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894ca00640 1 -- 172.21.15.175:0/2263349524 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef57508b40 con 0x55ef580f1c00 2024-04-25T09:14:29.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894ca00640 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1c00 0x55ef57386100 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x55ef575b38c0 tx=0x55ef5728d620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa73ede71842b5ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f8940c00640 1 -- 172.21.15.175:0/2263349524 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ef575381a0 con 0x55ef580f1c00 2024-04-25T09:14:29.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f8940c00640 1 -- 172.21.15.175:0/2263349524 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ef57215340 con 0x55ef580f1c00 2024-04-25T09:14:29.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f8940c00640 1 -- 172.21.15.175:0/2263349524 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ef57538000 con 0x55ef580f1c00 2024-04-25T09:14:29.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef57508d20 con 0x55ef580f1c00 2024-04-25T09:14:29.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55ef57508f00 con 0x55ef580f1c00 2024-04-25T09:14:29.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894de45400 4 waiting for MDS map... 2024-04-25T09:14:29.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f8940c00640 1 -- 172.21.15.175:0/2263349524 <== mon.0 v2:172.21.15.175:3300/0 4 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x55ef57652600 con 0x55ef580f1c00 2024-04-25T09:14:29.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f8940c00640 1 -- 172.21.15.175:0/2263349524 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 100) v1 ==== 2723+0+0 (secure 0 0 0) 0x55ef5765e000 con 0x55ef580f1c00 2024-04-25T09:14:29.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894de45400 4 Got MDS map 100 2024-04-25T09:14:29.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894de45400 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55ef5764c800 0x55ef57668000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.075 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:1 16.f 16:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v9 -- 0x55ef5764cc00 con 0x55ef5764c800 2024-04-25T09:14:29.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894c000640 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55ef5764c800 0x55ef57668000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.083+0000 7f894c000640 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55ef5764c800 0x55ef57668000 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=ec5b7e46a4145875 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.087+0000 7f894c000640 1 -- 172.21.15.175:0/2263349524 <== osd.0 v2:172.21.15.175:6800/1093269849 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v115'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55ef57346000 con 0x55ef5764c800 2024-04-25T09:14:29.076 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.087+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:2 16.14 16:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v9 -- 0x55ef5764d000 con 0x55ef5764c800 2024-04-25T09:14:29.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894c000640 1 -- 172.21.15.175:0/2263349524 <== osd.0 v2:172.21.15.175:6800/1093269849 2 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v115'39 uv39 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55ef57346000 con 0x55ef5764c800 2024-04-25T09:14:29.079 INFO:teuthology.orchestra.run.smithi175.stdout:writing EResetJournal entry 2024-04-25T09:14:29.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:3 16.14 16:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v9 -- 0x55ef5764d400 con 0x55ef5764c800 2024-04-25T09:14:29.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894de45400 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55ef5764d800 0x55ef57668580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:4 16.1b 16:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v9 -- 0x55ef57655400 con 0x55ef5764d800 2024-04-25T09:14:29.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894de45400 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55ef57655800 0x55ef57668b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:5 16.b 16:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v9 -- 0x55ef57655c00 con 0x55ef57655800 2024-04-25T09:14:29.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:6 16.1f 16:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v9 -- 0x55ef5764cc00 con 0x55ef5764d800 2024-04-25T09:14:29.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894de45400 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55ef5764d000 0x55ef57669080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.080 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:7 16.1a 16:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v9 -- 0x55ef5764d400 con 0x55ef5764d000 2024-04-25T09:14:29.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894de45400 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55ef57502c00 0x55ef57669600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:8 16.1e 16:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v9 -- 0x55ef57502800 con 0x55ef57502c00 2024-04-25T09:14:29.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894c000640 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55ef5764d000 0x55ef57669080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894b600640 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55ef5764d800 0x55ef57668580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894ca00640 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55ef57655800 0x55ef57668b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894b600640 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55ef57502c00 0x55ef57669600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894ca00640 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55ef57655800 0x55ef57668b00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=93e71a8a8364eeca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894b600640 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55ef5764d800 0x55ef57668580 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=dab9cdf24e1c1072 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894c000640 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55ef5764d000 0x55ef57669080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=cd54e719ccd07ea0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.081 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.091+0000 7f894b600640 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55ef57502c00 0x55ef57669600 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=2f139846229689d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894b600640 1 -- 172.21.15.175:0/2263349524 <== osd.5 v2:172.21.15.177:6816/3311807078 1 ==== osd_op_reply(4 200.00000002 [delete] v115'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55ef57346500 con 0x55ef5764d800 2024-04-25T09:14:29.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894b600640 1 -- 172.21.15.175:0/2263349524 <== osd.5 v2:172.21.15.177:6816/3311807078 2 ==== osd_op_reply(6 200.00000004 [delete] v115'9 uv8 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55ef57346500 con 0x55ef5764d800 2024-04-25T09:14:29.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894c000640 1 -- 172.21.15.175:0/2263349524 <== osd.0 v2:172.21.15.175:6800/1093269849 3 ==== osd_op_reply(3 200.00000001 [delete] v115'40 uv40 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55ef57346000 con 0x55ef5764c800 2024-04-25T09:14:29.082 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f893ee00640 1 -- 172.21.15.175:0/2263349524 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:9 16.14 16:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v9 -- 0x55ef57f9f400 con 0x55ef5764c800 2024-04-25T09:14:29.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894c000640 1 -- 172.21.15.175:0/2263349524 <== osd.3 v2:172.21.15.175:6816/4078277957 1 ==== osd_op_reply(7 200.00000005 [delete] v115'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55ef57346000 con 0x55ef5764d000 2024-04-25T09:14:29.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894b600640 1 -- 172.21.15.175:0/2263349524 <== osd.7 v2:172.21.15.177:6800/3881136076 1 ==== osd_op_reply(8 200.00000006 [delete] v115'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55ef57346500 con 0x55ef57502c00 2024-04-25T09:14:29.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894c000640 1 -- 172.21.15.175:0/2263349524 <== osd.0 v2:172.21.15.175:6800/1093269849 4 ==== osd_op_reply(9 200.00000001 [write 0~48] v115'41 uv41 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55ef57346000 con 0x55ef5764c800 2024-04-25T09:14:29.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894ca00640 1 -- 172.21.15.175:0/2263349524 <== osd.1 v2:172.21.15.175:6802/594808902 1 ==== osd_op_reply(5 200.00000003 [delete] v115'6 uv5 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55ef57346780 con 0x55ef57655800 2024-04-25T09:14:29.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 4 Successfully wrote new journal pointer and header for rank 8:0 2024-04-25T09:14:29.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55ef5764c800 msgr2=0x55ef57668000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x55ef5764c800 0x55ef57668000 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55ef57655800 msgr2=0x55ef57668b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55ef57655800 0x55ef57668b00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55ef5764d000 msgr2=0x55ef57669080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55ef5764d000 0x55ef57669080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55ef5764d800 msgr2=0x55ef57668580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55ef5764d800 0x55ef57668580 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894b600640 1 -- 172.21.15.175:0/2263349524 reap_dead start 2024-04-25T09:14:29.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55ef57502c00 msgr2=0x55ef57669600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55ef57502c00 0x55ef57669600 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1c00 msgr2=0x55ef57386100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1c00 0x55ef57386100 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x55ef575b38c0 tx=0x55ef5728d620 comp rx=0 tx=0).stop 2024-04-25T09:14:29.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 shutdown_connections 2024-04-25T09:14:29.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x55ef5764d800 0x55ef57668580 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x55ef57502c00 0x55ef57669600 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 --2- 172.21.15.175:0/2263349524 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1c00 0x55ef57386100 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 >> 172.21.15.175:0/2263349524 conn(0x55ef580f1800 msgr2=0x55ef5763c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:29.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 shutdown_connections 2024-04-25T09:14:29.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.095+0000 7f894de45400 1 -- 172.21.15.175:0/2263349524 wait complete. 2024-04-25T09:14:29.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 -- 172.21.15.175:0/2952811374 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55ef57503000 msgr2=0x55ef57387700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 --2- 172.21.15.175:0/2952811374 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55ef57503000 0x55ef57387700 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x55ef572d86f0 tx=0x55ef575f2c00 comp rx=0 tx=0).stop 2024-04-25T09:14:29.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 -- 172.21.15.175:0/2952811374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1000 msgr2=0x55ef57386c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 --2- 172.21.15.175:0/2952811374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1000 0x55ef57386c00 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x55ef581027e0 tx=0x55ef580dc1e0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 -- 172.21.15.175:0/2952811374 shutdown_connections 2024-04-25T09:14:29.087 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 --2- 172.21.15.175:0/2952811374 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x55ef57503000 0x55ef57387700 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 --2- 172.21.15.175:0/2952811374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef580f1400 0x55ef57386680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 --2- 172.21.15.175:0/2952811374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef580f1000 0x55ef57386c00 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 --2- 172.21.15.175:0/2952811374 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef580f0c00 0x55ef57387180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 -- 172.21.15.175:0/2952811374 >> 172.21.15.175:0/2952811374 conn(0x55ef571cac00 msgr2=0x55ef571f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:29.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 -- 172.21.15.175:0/2952811374 shutdown_connections 2024-04-25T09:14:29.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 -- 172.21.15.175:0/2952811374 wait complete. 2024-04-25T09:14:29.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 -- 172.21.15.175:0/441959306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef571cb800 msgr2=0x55ef57384580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 --2- 172.21.15.175:0/441959306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef571cb800 0x55ef57384580 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x55ef5802d380 tx=0x55ef580dc120 comp rx=0 tx=0).stop 2024-04-25T09:14:29.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 -- 172.21.15.175:0/441959306 shutdown_connections 2024-04-25T09:14:29.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 --2- 172.21.15.175:0/441959306 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55ef571cb000 0x55ef57385080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 --2- 172.21.15.175:0/441959306 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55ef571cb400 0x55ef57384b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 --2- 172.21.15.175:0/441959306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ef571cb800 0x55ef57384580 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 -- 172.21.15.175:0/441959306 >> 172.21.15.175:0/441959306 conn(0x55ef571cbc00 msgr2=0x55ef571f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:29.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 -- 172.21.15.175:0/441959306 shutdown_connections 2024-04-25T09:14:29.089 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.099+0000 7f894de45400 1 -- 172.21.15.175:0/441959306 wait complete. 2024-04-25T09:14:29.091 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force'] in time 0:00:00.082344, result: writing EResetJournal entry 2024-04-25T09:14:29.091 DEBUG:teuthology.orchestra.run.smithi175:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-04-25T09:14:29.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b030198c0 1 -- start start 2024-04-25T09:14:29.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b030198c0 1 Processor -- start 2024-04-25T09:14:29.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b030198c0 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56145fd43800 0x56145fefc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.183 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b030198c0 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56145fd43400 0x56145fefcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b030198c0 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56145fd43000 0x56145fefd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b030198c0 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561460c40180 con 0x56145fd43800 2024-04-25T09:14:29.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b030198c0 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x561460c40300 con 0x56145fd43400 2024-04-25T09:14:29.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b030198c0 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x561460c40480 con 0x56145fd43000 2024-04-25T09:14:29.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b01000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56145fd43800 0x56145fefc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b01000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56145fd43800 0x56145fefc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44020/0 (socket says 172.21.15.175:44020) 2024-04-25T09:14:29.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b01000640 1 -- 172.21.15.175:0/1232136831 learned_addr learned my addr 172.21.15.175:0/1232136831 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:29.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b00600640 1 --2- 172.21.15.175:0/1232136831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56145fd43400 0x56145fefcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b01a00640 1 --2- 172.21.15.175:0/1232136831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56145fd43000 0x56145fefd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b01000640 1 -- 172.21.15.175:0/1232136831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56145fd43000 msgr2=0x56145fefd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b01000640 1 --2- 172.21.15.175:0/1232136831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56145fd43000 0x56145fefd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b01000640 1 -- 172.21.15.175:0/1232136831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56145fd43400 msgr2=0x56145fefcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b01000640 1 --2- 172.21.15.175:0/1232136831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56145fd43400 0x56145fefcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b01000640 1 -- 172.21.15.175:0/1232136831 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56145fd681e0 con 0x56145fd43800 2024-04-25T09:14:29.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b01a00640 1 --2- 172.21.15.175:0/1232136831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56145fd43000 0x56145fefd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:29.184 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b01000640 1 --2- 172.21.15.175:0/1232136831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56145fd43800 0x56145fefc580 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x561460b85860 tx=0x56145fdfde60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95f1c55a101b2bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0afde00640 1 -- 172.21.15.175:0/1232136831 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56145fd789c0 con 0x56145fd43800 2024-04-25T09:14:29.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0afde00640 1 -- 172.21.15.175:0/1232136831 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56145fd8ce00 con 0x56145fd43800 2024-04-25T09:14:29.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0afde00640 1 -- 172.21.15.175:0/1232136831 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56145fd784e0 con 0x56145fd43800 2024-04-25T09:14:29.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b030198c0 1 -- 172.21.15.175:0/1232136831 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56145fd694a0 con 0x56145fd43800 2024-04-25T09:14:29.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b030198c0 1 -- 172.21.15.175:0/1232136831 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56145fd683c0 con 0x56145fd43800 2024-04-25T09:14:29.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b030198c0 4 waiting for MDS map... 2024-04-25T09:14:29.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0afde00640 1 -- 172.21.15.175:0/1232136831 <== mon.0 v2:172.21.15.175:3300/0 4 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x561460c50200 con 0x56145fd43800 2024-04-25T09:14:29.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0afde00640 1 -- 172.21.15.175:0/1232136831 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 100) v1 ==== 2723+0+0 (secure 0 0 0) 0x56145fd99180 con 0x56145fd43800 2024-04-25T09:14:29.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b030198c0 4 Got MDS map 100 2024-04-25T09:14:29.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b030198c0 4 datascan.main: Using metadata pool output 2024-04-25T09:14:29.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.187+0000 7f0b030198c0 4 datascan.main: connecting to RADOS... 2024-04-25T09:14:29.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b030198c0 1 Processor -- start 2024-04-25T09:14:29.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b030198c0 1 -- start start 2024-04-25T09:14:29.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b030198c0 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56145fe3d800 0x56145fefd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b030198c0 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56145fe3dc00 0x56145fefdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b030198c0 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561460cb6000 0x56145fefe100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b030198c0 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561460c40600 con 0x561460cb6000 2024-04-25T09:14:29.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b030198c0 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x561460c40780 con 0x56145fe3dc00 2024-04-25T09:14:29.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b030198c0 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x561460c40900 con 0x56145fe3d800 2024-04-25T09:14:29.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b00600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561460cb6000 0x56145fefe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b01a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56145fe3d800 0x56145fefd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b01000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56145fe3dc00 0x56145fefdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b01a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56145fe3d800 0x56145fefd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:47666/0 (socket says 172.21.15.175:47666) 2024-04-25T09:14:29.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b01000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56145fe3dc00 0x56145fefdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.175:38886/0 (socket says 172.21.15.175:38886) 2024-04-25T09:14:29.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b00600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561460cb6000 0x56145fefe100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44034/0 (socket says 172.21.15.175:44034) 2024-04-25T09:14:29.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b01a00640 1 -- 172.21.15.175:0/1904570939 learned_addr learned my addr 172.21.15.175:0/1904570939 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:29.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b00600640 1 -- 172.21.15.175:0/1904570939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56145fe3d800 msgr2=0x56145fefd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b00600640 1 --2- 172.21.15.175:0/1904570939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56145fe3d800 0x56145fefd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b00600640 1 -- 172.21.15.175:0/1904570939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56145fe3dc00 msgr2=0x56145fefdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.186 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b00600640 1 --2- 172.21.15.175:0/1904570939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56145fe3dc00 0x56145fefdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b00600640 1 -- 172.21.15.175:0/1904570939 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56145fd681e0 con 0x561460cb6000 2024-04-25T09:14:29.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b00600640 1 --2- 172.21.15.175:0/1904570939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561460cb6000 0x56145fefe100 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x561460c5ee70 tx=0x561460c4fe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2d5631b639f5de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0afb600640 1 -- 172.21.15.175:0/1904570939 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56145fd789c0 con 0x561460cb6000 2024-04-25T09:14:29.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0afb600640 1 -- 172.21.15.175:0/1904570939 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56145fd8ca80 con 0x561460cb6000 2024-04-25T09:14:29.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0afb600640 1 -- 172.21.15.175:0/1904570939 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56145fd784e0 con 0x561460cb6000 2024-04-25T09:14:29.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b030198c0 1 -- 172.21.15.175:0/1904570939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561460cb6000 msgr2=0x56145fefe100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b030198c0 1 --2- 172.21.15.175:0/1904570939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561460cb6000 0x56145fefe100 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x561460c5ee70 tx=0x561460c4fe00 comp rx=0 tx=0).stop 2024-04-25T09:14:29.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b030198c0 1 -- 172.21.15.175:0/1904570939 shutdown_connections 2024-04-25T09:14:29.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b030198c0 1 --2- 172.21.15.175:0/1904570939 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x561460cb6000 0x56145fefe100 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b030198c0 1 --2- 172.21.15.175:0/1904570939 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56145fe3dc00 0x56145fefdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b030198c0 1 --2- 172.21.15.175:0/1904570939 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56145fe3d800 0x56145fefd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b030198c0 1 -- 172.21.15.175:0/1904570939 >> 172.21.15.175:0/1904570939 conn(0x56145fd42c00 msgr2=0x56145fd71800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:29.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b030198c0 1 -- 172.21.15.175:0/1904570939 shutdown_connections 2024-04-25T09:14:29.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.191+0000 7f0b030198c0 1 -- 172.21.15.175:0/1904570939 wait complete. 2024-04-25T09:14:29.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b030198c0 1 Processor -- start 2024-04-25T09:14:29.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b030198c0 1 -- start start 2024-04-25T09:14:29.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b030198c0 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56145fe3dc00 0x56145feff180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b030198c0 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56145fe3d800 0x56145fefec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b030198c0 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561460cb7800 0x56145fefe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b030198c0 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x561460c41c80 con 0x56145fe3dc00 2024-04-25T09:14:29.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b030198c0 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x561460c41b00 con 0x561460cb7800 2024-04-25T09:14:29.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b030198c0 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x561460c41980 con 0x56145fe3d800 2024-04-25T09:14:29.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b01a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56145fe3dc00 0x56145feff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b01a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56145fe3dc00 0x56145feff180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:44048/0 (socket says 172.21.15.175:44048) 2024-04-25T09:14:29.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 learned_addr learned my addr 172.21.15.175:0/918945759 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:29.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b00600640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561460cb7800 0x56145fefe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b01000640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56145fe3d800 0x56145fefec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56145fe3d800 msgr2=0x56145fefec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b01a00640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56145fe3d800 0x56145fefec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561460cb7800 msgr2=0x56145fefe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b01a00640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561460cb7800 0x56145fefe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56145fd692c0 con 0x56145fe3dc00 2024-04-25T09:14:29.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b01000640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56145fe3d800 0x56145fefec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:29.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b00600640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x561460cb7800 0x56145fefe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:29.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b01a00640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56145fe3dc00 0x56145feff180 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x561460c5faa0 tx=0x561460074000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0af9800640 1 -- 172.21.15.175:0/918945759 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56145fd789c0 con 0x56145fe3dc00 2024-04-25T09:14:29.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0af9800640 1 -- 172.21.15.175:0/918945759 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56145fd8c540 con 0x56145fe3dc00 2024-04-25T09:14:29.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0af9800640 1 -- 172.21.15.175:0/918945759 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56145fd784e0 con 0x56145fe3dc00 2024-04-25T09:14:29.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56145fd69a40 con 0x56145fe3dc00 2024-04-25T09:14:29.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56145fd69c20 con 0x56145fe3dc00 2024-04-25T09:14:29.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0b030198c0 4 datascan.init: resolving metadata pool 16 2024-04-25T09:14:29.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.195+0000 7f0af9800640 1 -- 172.21.15.175:0/918945759 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x561460ccac00 con 0x56145fe3dc00 2024-04-25T09:14:29.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0af9800640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x561460cc9400 0x56145feff700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0af9800640 1 -- 172.21.15.175:0/918945759 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x561460cb9800 con 0x56145fe3dc00 2024-04-25T09:14:29.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0b030198c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T09:14:29.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0b030198c0 4 datascan.main: data pool 'cephfs_data' has ID 17 2024-04-25T09:14:29.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0b030198c0 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T09:14:29.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0b01000640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x561460cc9400 0x56145feff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0b030198c0 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x561460cb7400 0x56145fefe100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:1 17.0 17:00000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cb7000 con 0x561460cb7400 2024-04-25T09:14:29.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0b00600640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x561460cb7400 0x56145fefe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0b01000640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x561460cc9400 0x56145feff700 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x561460b858c0 tx=0x56145fdfdce0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0b00600640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x561460cb7400 0x56145fefe100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.7 v2:172.21.15.177:6800/3881136076 1 ==== osd_op_reply(1 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cb7400 2024-04-25T09:14:29.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0afac00640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x561460cc8400 0x561460166000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:2 17.20 17:04000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cb7c00 con 0x561460cc8400 2024-04-25T09:14:29.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0b01a00640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x561460cc8400 0x561460166000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0b01a00640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x561460cc8400 0x561460166000 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.1 v2:172.21.15.175:6802/594808902 1 ==== osd_op_reply(2 [pgnls start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460cc8400 2024-04-25T09:14:29.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0afb600640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x561460cb7000 0x561460166580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:3 17.10 17:08000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460172000 con 0x561460cb7000 2024-04-25T09:14:29.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0b01000640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x561460cb7000 0x561460166580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0b01000640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x561460cb7000 0x561460166580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0b01000640 1 -- 172.21.15.175:0/918945759 <== osd.3 v2:172.21.15.175:6816/4078277957 1 ==== osd_op_reply(3 [pgnls start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6780 con 0x561460cb7000 2024-04-25T09:14:29.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0afac00640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x561460cc8000 0x561460166b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.199+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:4 17.30 17:0c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460172800 con 0x561460cc8000 2024-04-25T09:14:29.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.203+0000 7f0b00600640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x561460cc8000 0x561460166b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.203+0000 7f0b00600640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x561460cc8000 0x561460166b00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.203+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.0 v2:172.21.15.175:6800/1093269849 1 ==== osd_op_reply(4 [pgnls start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cc8000 2024-04-25T09:14:29.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.203+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:5 17.8 17:10000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460172400 con 0x561460cb7400 2024-04-25T09:14:29.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.203+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.7 v2:172.21.15.177:6800/3881136076 2 ==== osd_op_reply(5 [pgnls start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cb7400 2024-04-25T09:14:29.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.203+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:6 17.28 17:14000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460172c00 con 0x561460cb7000 2024-04-25T09:14:29.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.203+0000 7f0b01000640 1 -- 172.21.15.175:0/918945759 <== osd.3 v2:172.21.15.175:6816/4078277957 2 ==== osd_op_reply(6 [pgnls start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6780 con 0x561460cb7000 2024-04-25T09:14:29.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.203+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:7 17.18 17:18000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460173400 con 0x561460cc8000 2024-04-25T09:14:29.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.203+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.0 v2:172.21.15.175:6800/1093269849 2 ==== osd_op_reply(7 [pgnls start_epoch 115 out=81b] v113'17 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56145fdf6000 con 0x561460cc8000 2024-04-25T09:14:29.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.203+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:8 17.18 17:1ad8d55b:::10000000006.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cb6c00 con 0x561460cc8000 2024-04-25T09:14:29.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.203+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.0 v2:172.21.15.175:6800/1093269849 3 ==== osd_op_reply(8 10000000006.00000001 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56145fdf6000 con 0x561460cc8000 2024-04-25T09:14:29.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.203+0000 7f0b030198c0 10 datascan.operator(): handling object 1099511627782.1 2024-04-25T09:14:29.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.203+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:9 17.25 17:a5feb6f3:::10000000006.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cb6800 con 0x561460cc8400 2024-04-25T09:14:29.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.203+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.1 v2:172.21.15.175:6802/594808902 2 ==== osd_op_reply(9 10000000006.00000000 [call] v115'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56145fdf6500 con 0x561460cc8400 2024-04-25T09:14:29.196 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.203+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:10 17.38 17:1c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cb6400 con 0x561460cb7400 2024-04-25T09:14:29.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.207+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.7 v2:172.21.15.177:6800/3881136076 3 ==== osd_op_reply(10 [pgnls start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cb7400 2024-04-25T09:14:29.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.207+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:11 17.4 17:20000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460173800 con 0x561460cc8000 2024-04-25T09:14:29.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.207+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.0 v2:172.21.15.175:6800/1093269849 4 ==== osd_op_reply(11 [pgnls start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cc8000 2024-04-25T09:14:29.198 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.207+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:12 17.24 17:24000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460173000 con 0x561460cb7000 2024-04-25T09:14:29.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.207+0000 7f0b01000640 1 -- 172.21.15.175:0/918945759 <== osd.3 v2:172.21.15.175:6816/4078277957 3 ==== osd_op_reply(12 [pgnls start_epoch 115 out=49b] v113'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6780 con 0x561460cb7000 2024-04-25T09:14:29.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.207+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:13 17.14 17:28000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460173c00 con 0x561460cb7000 2024-04-25T09:14:29.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.207+0000 7f0b01000640 1 -- 172.21.15.175:0/918945759 <== osd.3 v2:172.21.15.175:6816/4078277957 4 ==== osd_op_reply(13 [pgnls start_epoch 115 out=49b] v113'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6780 con 0x561460cb7000 2024-04-25T09:14:29.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.207+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:14 17.34 17:2c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cb6c00 con 0x561460cc8000 2024-04-25T09:14:29.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.207+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.0 v2:172.21.15.175:6800/1093269849 5 ==== osd_op_reply(14 [pgnls start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cc8000 2024-04-25T09:14:29.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.207+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:15 17.c 17:30000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cb6400 con 0x561460cb7400 2024-04-25T09:14:29.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.207+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.7 v2:172.21.15.177:6800/3881136076 4 ==== osd_op_reply(15 [pgnls start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cb7400 2024-04-25T09:14:29.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.207+0000 7f0afac00640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x561460172800 0x561460167080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.207+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:16 17.2c 17:34000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460172400 con 0x561460172800 2024-04-25T09:14:29.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.207+0000 7f0b01a00640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x561460172800 0x561460167080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.207+0000 7f0b01a00640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x561460172800 0x561460167080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.207+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.4 v2:172.21.15.177:6808/236493968 1 ==== osd_op_reply(16 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460172800 2024-04-25T09:14:29.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.207+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:17 17.1c 17:38000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146018a000 con 0x561460cc8400 2024-04-25T09:14:29.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.211+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.1 v2:172.21.15.175:6802/594808902 3 ==== osd_op_reply(17 [pgnls start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460cc8400 2024-04-25T09:14:29.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.211+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:18 17.3c 17:3c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460173400 con 0x561460cc8000 2024-04-25T09:14:29.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.211+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.0 v2:172.21.15.175:6800/1093269849 6 ==== osd_op_reply(18 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cc8000 2024-04-25T09:14:29.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.211+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:19 17.2 17:40000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146018a400 con 0x561460172800 2024-04-25T09:14:29.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.211+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.4 v2:172.21.15.177:6808/236493968 2 ==== osd_op_reply(19 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460172800 2024-04-25T09:14:29.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.211+0000 7f0afac00640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x56146018a000 0x561460167600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.211+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:20 17.22 17:44000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146018b400 con 0x56146018a000 2024-04-25T09:14:29.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.211+0000 7f0b01000640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x56146018a000 0x561460167600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.200 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.211+0000 7f0b01000640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x56146018a000 0x561460167600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.211+0000 7f0b01000640 1 -- 172.21.15.175:0/918945759 <== osd.5 v2:172.21.15.177:6816/3311807078 1 ==== osd_op_reply(20 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6780 con 0x56146018a000 2024-04-25T09:14:29.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.211+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:21 17.12 17:48000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146018a800 con 0x561460cb7000 2024-04-25T09:14:29.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.211+0000 7f0b01000640 1 -- 172.21.15.175:0/918945759 <== osd.3 v2:172.21.15.175:6816/4078277957 5 ==== osd_op_reply(21 [pgnls start_epoch 115 out=81b] v114'22 uv22 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56145fdf6780 con 0x561460cb7000 2024-04-25T09:14:29.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.211+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:22 17.12 17:4bec3886:::10000000002.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cb6000 con 0x561460cb7000 2024-04-25T09:14:29.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.211+0000 7f0b01000640 1 -- 172.21.15.175:0/918945759 <== osd.3 v2:172.21.15.175:6816/4078277957 6 ==== osd_op_reply(22 10000000002.00000000 [stat out=16b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56145fdf6780 con 0x561460cb7000 2024-04-25T09:14:29.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.211+0000 7f0b030198c0 10 datascan.operator(): handling object 1099511627778.0 2024-04-25T09:14:29.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.211+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:23 17.12 17:4bec3886:::10000000002.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146018b400 con 0x561460cb7000 2024-04-25T09:14:29.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.211+0000 7f0b01000640 1 -- 172.21.15.175:0/918945759 <== osd.3 v2:172.21.15.175:6816/4078277957 7 ==== osd_op_reply(23 10000000002.00000000 [call] v115'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56145fdf6780 con 0x561460cb7000 2024-04-25T09:14:29.201 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.211+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:24 17.32 17:4c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146018b800 con 0x561460cb7400 2024-04-25T09:14:29.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.215+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.7 v2:172.21.15.177:6800/3881136076 5 ==== osd_op_reply(24 [pgnls start_epoch 115 out=81b] v113'16 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56145fdf6000 con 0x561460cb7400 2024-04-25T09:14:29.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.215+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:25 17.32 17:4def72d4:::10000000003.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146018bc00 con 0x561460cb7400 2024-04-25T09:14:29.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.215+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.7 v2:172.21.15.177:6800/3881136076 6 ==== osd_op_reply(25 10000000003.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56145fdf6000 con 0x561460cb7400 2024-04-25T09:14:29.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.215+0000 7f0b030198c0 10 datascan.operator(): handling object 1099511627779.0 2024-04-25T09:14:29.202 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.215+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:26 17.32 17:4def72d4:::10000000003.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460172000 con 0x561460cb7400 2024-04-25T09:14:29.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.215+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.7 v2:172.21.15.177:6800/3881136076 7 ==== osd_op_reply(26 10000000003.00000000 [call] v115'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56145fdf6000 con 0x561460cb7400 2024-04-25T09:14:29.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.215+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:27 17.a 17:50000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460172c00 con 0x561460cb7400 2024-04-25T09:14:29.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.215+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.7 v2:172.21.15.177:6800/3881136076 8 ==== osd_op_reply(27 [pgnls start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cb7400 2024-04-25T09:14:29.204 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.215+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:28 17.2a 17:54000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460172400 con 0x561460cb7000 2024-04-25T09:14:29.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.215+0000 7f0b01000640 1 -- 172.21.15.175:0/918945759 <== osd.3 v2:172.21.15.175:6816/4078277957 8 ==== osd_op_reply(28 [pgnls start_epoch 115 out=49b] v113'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6780 con 0x561460cb7000 2024-04-25T09:14:29.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.215+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:29 17.1a 17:58000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146018ac00 con 0x561460cc8000 2024-04-25T09:14:29.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.215+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.0 v2:172.21.15.175:6800/1093269849 7 ==== osd_op_reply(29 [pgnls start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cc8000 2024-04-25T09:14:29.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.215+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:30 17.3a 17:5c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cb7c00 con 0x561460cc8400 2024-04-25T09:14:29.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.215+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.1 v2:172.21.15.175:6802/594808902 4 ==== osd_op_reply(30 [pgnls start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460cc8400 2024-04-25T09:14:29.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.215+0000 7f0afb600640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x56146018b000 0x561460168680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.205 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.215+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:31 17.6 17:60000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146018b800 con 0x56146018b000 2024-04-25T09:14:29.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0b00600640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x56146018b000 0x561460168680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0b00600640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x56146018b000 0x561460168680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.6 v2:172.21.15.177:6822/4132808595 1 ==== osd_op_reply(31 [pgnls start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x56146018b000 2024-04-25T09:14:29.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:32 17.26 17:64000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cb6800 con 0x561460cc8000 2024-04-25T09:14:29.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.0 v2:172.21.15.175:6800/1093269849 8 ==== osd_op_reply(32 [pgnls start_epoch 115 out=49b] v113'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cc8000 2024-04-25T09:14:29.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:33 17.16 17:68000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146018bc00 con 0x56146018a000 2024-04-25T09:14:29.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0b01000640 1 -- 172.21.15.175:0/918945759 <== osd.5 v2:172.21.15.177:6816/3311807078 2 ==== osd_op_reply(33 [pgnls start_epoch 115 out=49b] v113'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6780 con 0x56146018a000 2024-04-25T09:14:29.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:34 17.36 17:6c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146019c000 con 0x561460cc8000 2024-04-25T09:14:29.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.0 v2:172.21.15.175:6800/1093269849 9 ==== osd_op_reply(34 [pgnls start_epoch 115 out=49b] v113'32 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cc8000 2024-04-25T09:14:29.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0afb600640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x561460173800 0x561460168c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:35 17.e 17:70000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460173400 con 0x561460173800 2024-04-25T09:14:29.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0b01a00640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x561460173800 0x561460168c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0b01a00640 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x561460173800 0x561460168c00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.2 v2:172.21.15.175:6821/3247063283 1 ==== osd_op_reply(35 [pgnls start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460173800 2024-04-25T09:14:29.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:36 17.2e 17:74000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146019c400 con 0x56146018b000 2024-04-25T09:14:29.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.6 v2:172.21.15.177:6822/4132808595 2 ==== osd_op_reply(36 [pgnls start_epoch 115 out=49b] v113'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x56146018b000 2024-04-25T09:14:29.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:37 17.1e 17:78000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cb6c00 con 0x561460cc8400 2024-04-25T09:14:29.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.1 v2:172.21.15.175:6802/594808902 5 ==== osd_op_reply(37 [pgnls start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460cc8400 2024-04-25T09:14:29.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.219+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:38 17.3e 17:7c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146019c800 con 0x561460172800 2024-04-25T09:14:29.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.4 v2:172.21.15.177:6808/236493968 3 ==== osd_op_reply(38 [pgnls start_epoch 115 out=49b] v113'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460172800 2024-04-25T09:14:29.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:39 17.1 17:80000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cb6400 con 0x561460cc8000 2024-04-25T09:14:29.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.0 v2:172.21.15.175:6800/1093269849 10 ==== osd_op_reply(39 [pgnls start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cc8000 2024-04-25T09:14:29.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:40 17.21 17:84000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146019cc00 con 0x561460cc8000 2024-04-25T09:14:29.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.0 v2:172.21.15.175:6800/1093269849 11 ==== osd_op_reply(40 [pgnls start_epoch 115 out=49b] v113'24 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cc8000 2024-04-25T09:14:29.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:41 17.11 17:88000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cb7c00 con 0x561460cb7000 2024-04-25T09:14:29.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0b01000640 1 -- 172.21.15.175:0/918945759 <== osd.3 v2:172.21.15.175:6816/4078277957 9 ==== osd_op_reply(41 [pgnls start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6780 con 0x561460cb7000 2024-04-25T09:14:29.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:42 17.31 17:8c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146019d000 con 0x561460cc8400 2024-04-25T09:14:29.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.1 v2:172.21.15.175:6802/594808902 6 ==== osd_op_reply(42 [pgnls start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460cc8400 2024-04-25T09:14:29.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:43 17.9 17:90000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146018a400 con 0x561460cb7000 2024-04-25T09:14:29.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0b01000640 1 -- 172.21.15.175:0/918945759 <== osd.3 v2:172.21.15.175:6816/4078277957 10 ==== osd_op_reply(43 [pgnls start_epoch 115 out=49b] v113'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6780 con 0x561460cb7000 2024-04-25T09:14:29.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:44 17.29 17:94000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146019d400 con 0x561460172800 2024-04-25T09:14:29.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.4 v2:172.21.15.177:6808/236493968 4 ==== osd_op_reply(44 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460172800 2024-04-25T09:14:29.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:45 17.19 17:98000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146018ac00 con 0x56146018a000 2024-04-25T09:14:29.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0b01000640 1 -- 172.21.15.175:0/918945759 <== osd.5 v2:172.21.15.177:6816/3311807078 3 ==== osd_op_reply(45 [pgnls start_epoch 115 out=49b] v113'21 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6780 con 0x56146018a000 2024-04-25T09:14:29.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:46 17.39 17:9c000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cb6000 con 0x56146018a000 2024-04-25T09:14:29.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0b01000640 1 -- 172.21.15.175:0/918945759 <== osd.5 v2:172.21.15.177:6816/3311807078 4 ==== osd_op_reply(46 [pgnls start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6780 con 0x56146018a000 2024-04-25T09:14:29.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:47 17.5 17:a0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146018b800 con 0x56146018b000 2024-04-25T09:14:29.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.6 v2:172.21.15.177:6822/4132808595 3 ==== osd_op_reply(47 [pgnls start_epoch 115 out=81b] v114'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56145fdf6000 con 0x56146018b000 2024-04-25T09:14:29.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:48 17.5 17:a367a3e8:::10000000004.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460173000 con 0x56146018b000 2024-04-25T09:14:29.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.6 v2:172.21.15.177:6822/4132808595 4 ==== osd_op_reply(48 10000000004.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56145fdf6000 con 0x56146018b000 2024-04-25T09:14:29.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0b030198c0 10 datascan.operator(): handling object 1099511627780.0 2024-04-25T09:14:29.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.223+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:49 17.5 17:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460173c00 con 0x56146018b000 2024-04-25T09:14:29.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.227+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.6 v2:172.21.15.177:6822/4132808595 5 ==== osd_op_reply(49 10000000004.00000000 [call] v115'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56145fdf6000 con 0x56146018b000 2024-04-25T09:14:29.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.227+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:50 17.25 17:a4000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cc9c00 con 0x561460cc8400 2024-04-25T09:14:29.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.227+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.1 v2:172.21.15.175:6802/594808902 7 ==== osd_op_reply(50 [pgnls start_epoch 115 out=81b] v115'16 uv16 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56145fdf6500 con 0x561460cc8400 2024-04-25T09:14:29.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.227+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:51 17.25 17:a5feb6f3:::10000000006.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146019c800 con 0x561460cc8400 2024-04-25T09:14:29.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.227+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.1 v2:172.21.15.175:6802/594808902 8 ==== osd_op_reply(51 10000000006.00000000 [stat out=16b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56145fdf6500 con 0x561460cc8400 2024-04-25T09:14:29.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.227+0000 7f0b030198c0 10 datascan.operator(): handling object 1099511627782.0 2024-04-25T09:14:29.215 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.227+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:52 17.25 17:a5feb6f3:::10000000006.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146019c000 con 0x561460cc8400 2024-04-25T09:14:29.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.227+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.1 v2:172.21.15.175:6802/594808902 9 ==== osd_op_reply(52 10000000006.00000000 [call] v115'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56145fdf6500 con 0x561460cc8400 2024-04-25T09:14:29.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.227+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:53 17.15 17:a8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146019c400 con 0x56146018a000 2024-04-25T09:14:29.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.227+0000 7f0b01000640 1 -- 172.21.15.175:0/918945759 <== osd.5 v2:172.21.15.177:6816/3311807078 5 ==== osd_op_reply(53 [pgnls start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6780 con 0x56146018a000 2024-04-25T09:14:29.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.227+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:54 17.35 17:ac000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cb7c00 con 0x561460172800 2024-04-25T09:14:29.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.227+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.4 v2:172.21.15.177:6808/236493968 5 ==== osd_op_reply(54 [pgnls start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460172800 2024-04-25T09:14:29.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.227+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:55 17.d 17:b0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460173400 con 0x561460cb7400 2024-04-25T09:14:29.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.7 v2:172.21.15.177:6800/3881136076 9 ==== osd_op_reply(55 [pgnls start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cb7400 2024-04-25T09:14:29.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:56 17.2d 17:b4000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146018a800 con 0x561460cb7400 2024-04-25T09:14:29.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.7 v2:172.21.15.177:6800/3881136076 10 ==== osd_op_reply(56 [pgnls start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cb7400 2024-04-25T09:14:29.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:57 17.1d 17:b8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460172000 con 0x561460cb7400 2024-04-25T09:14:29.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.7 v2:172.21.15.177:6800/3881136076 11 ==== osd_op_reply(57 [pgnls start_epoch 115 out=49b] v113'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cb7400 2024-04-25T09:14:29.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:58 17.3d 17:bc000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146018b400 con 0x561460cb7400 2024-04-25T09:14:29.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.7 v2:172.21.15.177:6800/3881136076 12 ==== osd_op_reply(58 [pgnls start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cb7400 2024-04-25T09:14:29.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:59 17.3 17:c0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460172c00 con 0x561460172800 2024-04-25T09:14:29.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.4 v2:172.21.15.177:6808/236493968 6 ==== osd_op_reply(59 [pgnls start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460172800 2024-04-25T09:14:29.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:60 17.23 17:c4000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146018bc00 con 0x561460172800 2024-04-25T09:14:29.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.4 v2:172.21.15.177:6808/236493968 7 ==== osd_op_reply(60 [pgnls start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460172800 2024-04-25T09:14:29.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:61 17.13 17:c8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146019cc00 con 0x561460cb7000 2024-04-25T09:14:29.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0b01000640 1 -- 172.21.15.175:0/918945759 <== osd.3 v2:172.21.15.175:6816/4078277957 11 ==== osd_op_reply(61 [pgnls start_epoch 115 out=49b] v113'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6780 con 0x561460cb7000 2024-04-25T09:14:29.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:62 17.33 17:cc000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146018a400 con 0x561460cb7400 2024-04-25T09:14:29.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.7 v2:172.21.15.177:6800/3881136076 13 ==== osd_op_reply(62 [pgnls start_epoch 115 out=49b] v113'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cb7400 2024-04-25T09:14:29.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:63 17.b 17:d0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cc9c00 con 0x561460cc8000 2024-04-25T09:14:29.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.0 v2:172.21.15.175:6800/1093269849 12 ==== osd_op_reply(63 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cc8000 2024-04-25T09:14:29.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:64 17.2b 17:d4000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460172400 con 0x561460172800 2024-04-25T09:14:29.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.4 v2:172.21.15.177:6808/236493968 8 ==== osd_op_reply(64 [pgnls start_epoch 115 out=49b] v113'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460172800 2024-04-25T09:14:29.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:65 17.1b 17:d8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460173000 con 0x561460172800 2024-04-25T09:14:29.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.4 v2:172.21.15.177:6808/236493968 9 ==== osd_op_reply(65 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460172800 2024-04-25T09:14:29.221 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:66 17.3b 17:dc000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cb6400 con 0x561460173800 2024-04-25T09:14:29.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.2 v2:172.21.15.175:6821/3247063283 2 ==== osd_op_reply(66 [pgnls start_epoch 115 out=49b] v113'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460173800 2024-04-25T09:14:29.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.231+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:67 17.7 17:e0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460173c00 con 0x561460cc8000 2024-04-25T09:14:29.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.0 v2:172.21.15.175:6800/1093269849 13 ==== osd_op_reply(67 [pgnls start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cc8000 2024-04-25T09:14:29.222 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:68 17.27 17:e4000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460cb7c00 con 0x561460172800 2024-04-25T09:14:29.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.4 v2:172.21.15.177:6808/236493968 10 ==== osd_op_reply(68 [pgnls start_epoch 115 out=49b] v113'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460172800 2024-04-25T09:14:29.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:69 17.17 17:e8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460173400 con 0x56146018b000 2024-04-25T09:14:29.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.6 v2:172.21.15.177:6822/4132808595 6 ==== osd_op_reply(69 [pgnls start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x56146018b000 2024-04-25T09:14:29.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:70 17.37 17:ec000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146019d000 con 0x561460cc8000 2024-04-25T09:14:29.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.0 v2:172.21.15.175:6800/1093269849 14 ==== osd_op_reply(70 [pgnls start_epoch 115 out=49b] v113'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cc8000 2024-04-25T09:14:29.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:71 17.f 17:f0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x561460172000 con 0x561460cc8400 2024-04-25T09:14:29.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.1 v2:172.21.15.175:6802/594808902 10 ==== osd_op_reply(71 [pgnls start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460cc8400 2024-04-25T09:14:29.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:72 17.2f 17:f4000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146019d400 con 0x561460172800 2024-04-25T09:14:29.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b01a00640 1 -- 172.21.15.175:0/918945759 <== osd.4 v2:172.21.15.177:6808/236493968 11 ==== osd_op_reply(72 [pgnls start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6500 con 0x561460172800 2024-04-25T09:14:29.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0afb600640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:73 17.1f 17:f8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146018b800 con 0x56146018b000 2024-04-25T09:14:29.225 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.6 v2:172.21.15.177:6822/4132808595 7 ==== osd_op_reply(73 [pgnls start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x56146018b000 2024-04-25T09:14:29.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0afac00640 1 -- 172.21.15.175:0/918945759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:74 17.3f 17:fc000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x56146019c800 con 0x561460cc8000 2024-04-25T09:14:29.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 <== osd.0 v2:172.21.15.175:6800/1093269849 15 ==== osd_op_reply(74 [pgnls start_epoch 115 out=49b] v113'17 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56145fdf6000 con 0x561460cc8000 2024-04-25T09:14:29.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x561460cc8000 msgr2=0x561460166b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x561460cc8000 0x561460166b00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x561460cc8400 msgr2=0x561460166000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x561460cc8400 0x561460166000 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x561460173800 msgr2=0x561460168c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x561460173800 0x561460168c00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x561460cb7000 msgr2=0x561460166580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x561460cb7000 0x561460166580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x561460172800 msgr2=0x561460167080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x561460172800 0x561460167080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x56146018a000 msgr2=0x561460167600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x56146018a000 0x561460167600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x56146018b000 msgr2=0x561460168680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b00600640 1 -- 172.21.15.175:0/918945759 reap_dead start 2024-04-25T09:14:29.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x56146018b000 0x561460168680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x561460cb7400 msgr2=0x56145fefe100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x561460cb7400 0x56145fefe100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x561460cc9400 msgr2=0x56145feff700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x561460cc9400 0x56145feff700 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x561460b858c0 tx=0x56145fdfdce0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56145fe3dc00 msgr2=0x56145feff180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56145fe3dc00 0x56145feff180 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x561460c5faa0 tx=0x561460074000 comp rx=0 tx=0).stop 2024-04-25T09:14:29.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 shutdown_connections 2024-04-25T09:14:29.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x56146018b000 0x561460168680 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x561460cc9400 0x56145feff700 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x561460cb7400 0x56145fefe100 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 --2- 172.21.15.175:0/918945759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56145fe3dc00 0x56145feff180 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.227 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 >> 172.21.15.175:0/918945759 conn(0x56145fd42c00 msgr2=0x56145fd71800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:29.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 shutdown_connections 2024-04-25T09:14:29.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 -- 172.21.15.175:0/918945759 wait complete. 2024-04-25T09:14:29.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 -- 172.21.15.175:0/1232136831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56145fd43800 msgr2=0x56145fefc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.235+0000 7f0b030198c0 1 --2- 172.21.15.175:0/1232136831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56145fd43800 0x56145fefc580 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x561460b85860 tx=0x56145fdfde60 comp rx=0 tx=0).stop 2024-04-25T09:14:29.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.239+0000 7f0b030198c0 1 -- 172.21.15.175:0/1232136831 shutdown_connections 2024-04-25T09:14:29.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.239+0000 7f0b030198c0 1 --2- 172.21.15.175:0/1232136831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x56145fd43000 0x56145fefd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.239+0000 7f0b030198c0 1 --2- 172.21.15.175:0/1232136831 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x56145fd43400 0x56145fefcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.239+0000 7f0b030198c0 1 --2- 172.21.15.175:0/1232136831 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x56145fd43800 0x56145fefc580 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.239+0000 7f0b030198c0 1 -- 172.21.15.175:0/1232136831 >> 172.21.15.175:0/1232136831 conn(0x56145fd43c00 msgr2=0x56145fd71000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:29.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.239+0000 7f0b030198c0 1 -- 172.21.15.175:0/1232136831 shutdown_connections 2024-04-25T09:14:29.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.239+0000 7f0b030198c0 1 -- 172.21.15.175:0/1232136831 wait complete. 2024-04-25T09:14:29.230 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.139024, result: 2024-04-25T09:14:29.230 DEBUG:teuthology.orchestra.run.smithi175:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --filter-tag mytag123 cephfs_data 2024-04-25T09:14:29.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f222a79f8c0 1 -- start start 2024-04-25T09:14:29.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f222a79f8c0 1 Processor -- start 2024-04-25T09:14:29.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f222a79f8c0 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557750129000 0x5577502e2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f222a79f8c0 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557750129400 0x5577502e2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f222a79f8c0 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557750129800 0x5577502e3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f222a79f8c0 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557750f02600 con 0x557750129400 2024-04-25T09:14:29.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f222a79f8c0 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x557750f02480 con 0x557750129800 2024-04-25T09:14:29.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f222a79f8c0 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x557750f02300 con 0x557750129000 2024-04-25T09:14:29.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f2227e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557750129400 0x5577502e2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f2227e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557750129400 0x5577502e2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48572/0 (socket says 172.21.15.175:48572) 2024-04-25T09:14:29.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f2227e00640 1 -- 172.21.15.175:0/1607582447 learned_addr learned my addr 172.21.15.175:0/1607582447 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:29.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f2228800640 1 --2- 172.21.15.175:0/1607582447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557750129000 0x5577502e2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f2229200640 1 --2- 172.21.15.175:0/1607582447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557750129800 0x5577502e3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f2227e00640 1 -- 172.21.15.175:0/1607582447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557750129000 msgr2=0x5577502e2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f2227e00640 1 --2- 172.21.15.175:0/1607582447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557750129000 0x5577502e2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f2227e00640 1 -- 172.21.15.175:0/1607582447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557750129800 msgr2=0x5577502e3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f2227e00640 1 --2- 172.21.15.175:0/1607582447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557750129800 0x5577502e3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f2227e00640 1 -- 172.21.15.175:0/1607582447 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55775014e1e0 con 0x557750129400 2024-04-25T09:14:29.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f2227e00640 1 --2- 172.21.15.175:0/1607582447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557750129400 0x5577502e2b00 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x557750f71560 tx=0x5577501c0600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5dc1a98333e8151 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f2225600640 1 -- 172.21.15.175:0/1607582447 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55775015e4e0 con 0x557750129400 2024-04-25T09:14:29.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f2225600640 1 -- 172.21.15.175:0/1607582447 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5577501721c0 con 0x557750129400 2024-04-25T09:14:29.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f2225600640 1 -- 172.21.15.175:0/1607582447 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55775015eb60 con 0x557750129400 2024-04-25T09:14:29.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f222a79f8c0 1 -- 172.21.15.175:0/1607582447 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55775014f2c0 con 0x557750129400 2024-04-25T09:14:29.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f222a79f8c0 1 -- 172.21.15.175:0/1607582447 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55775014fa40 con 0x557750129400 2024-04-25T09:14:29.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f222a79f8c0 4 waiting for MDS map... 2024-04-25T09:14:29.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f2225600640 1 -- 172.21.15.175:0/1607582447 <== mon.0 v2:172.21.15.175:3300/0 4 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x557750227000 con 0x557750129400 2024-04-25T09:14:29.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f2225600640 1 -- 172.21.15.175:0/1607582447 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 100) v1 ==== 2723+0+0 (secure 0 0 0) 0x55775017f180 con 0x557750129400 2024-04-25T09:14:29.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f222a79f8c0 4 Got MDS map 100 2024-04-25T09:14:29.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f222a79f8c0 10 datascan.parse_kwarg: Applying tag filter: 'mytag123' 2024-04-25T09:14:29.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f222a79f8c0 4 datascan.main: Using metadata pool output 2024-04-25T09:14:29.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f222a79f8c0 4 datascan.main: connecting to RADOS... 2024-04-25T09:14:29.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f222a79f8c0 1 Processor -- start 2024-04-25T09:14:29.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.331+0000 7f222a79f8c0 1 -- start start 2024-04-25T09:14:29.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557751094400 0x5577502e3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557751094800 0x5577502e3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557751094c00 0x5577502e4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557750f02180 con 0x557751094800 2024-04-25T09:14:29.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x557750188480 con 0x557751094400 2024-04-25T09:14:29.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x557750188900 con 0x557751094c00 2024-04-25T09:14:29.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2228800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557751094800 0x5577502e3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2228800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557751094800 0x5577502e3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48576/0 (socket says 172.21.15.175:48576) 2024-04-25T09:14:29.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2228800640 1 -- 172.21.15.175:0/2763560187 learned_addr learned my addr 172.21.15.175:0/2763560187 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:29.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2227e00640 1 --2- 172.21.15.175:0/2763560187 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557751094c00 0x5577502e4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2229200640 1 --2- 172.21.15.175:0/2763560187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557751094400 0x5577502e3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2228800640 1 -- 172.21.15.175:0/2763560187 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557751094c00 msgr2=0x5577502e4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2228800640 1 --2- 172.21.15.175:0/2763560187 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557751094c00 0x5577502e4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2228800640 1 -- 172.21.15.175:0/2763560187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557751094400 msgr2=0x5577502e3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2228800640 1 --2- 172.21.15.175:0/2763560187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557751094400 0x5577502e3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2228800640 1 -- 172.21.15.175:0/2763560187 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55775014fc20 con 0x557751094800 2024-04-25T09:14:29.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2227e00640 1 --2- 172.21.15.175:0/2763560187 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557751094c00 0x5577502e4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:29.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2229200640 1 --2- 172.21.15.175:0/2763560187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557751094400 0x5577502e3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:29.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2228800640 1 --2- 172.21.15.175:0/2763560187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557751094800 0x5577502e3b80 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x557751040870 tx=0x557750454000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60a1a250a52fd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2222e00640 1 -- 172.21.15.175:0/2763560187 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55775015e4e0 con 0x557751094800 2024-04-25T09:14:29.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2222e00640 1 -- 172.21.15.175:0/2763560187 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557750172540 con 0x557751094800 2024-04-25T09:14:29.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2222e00640 1 -- 172.21.15.175:0/2763560187 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55775015eb60 con 0x557751094800 2024-04-25T09:14:29.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 -- 172.21.15.175:0/2763560187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557751094800 msgr2=0x5577502e3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/2763560187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557751094800 0x5577502e3b80 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x557751040870 tx=0x557750454000 comp rx=0 tx=0).stop 2024-04-25T09:14:29.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 -- 172.21.15.175:0/2763560187 shutdown_connections 2024-04-25T09:14:29.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/2763560187 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557751094c00 0x5577502e4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.758 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/2763560187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557751094800 0x5577502e3b80 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/2763560187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557751094400 0x5577502e3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 -- 172.21.15.175:0/2763560187 >> 172.21.15.175:0/2763560187 conn(0x557751094000 msgr2=0x557750156000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:29.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 -- 172.21.15.175:0/2763560187 shutdown_connections 2024-04-25T09:14:29.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 -- 172.21.15.175:0/2763560187 wait complete. 2024-04-25T09:14:29.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 Processor -- start 2024-04-25T09:14:29.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 -- start start 2024-04-25T09:14:29.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557751094400 0x5577502e5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557751094800 0x5577502e4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557751094c00 0x5577502e4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x557750f03380 con 0x557751094800 2024-04-25T09:14:29.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x557750f02180 con 0x557751094400 2024-04-25T09:14:29.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f222a79f8c0 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x557750f03500 con 0x557751094c00 2024-04-25T09:14:29.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2228800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557751094800 0x5577502e4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2228800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557751094800 0x5577502e4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48592/0 (socket says 172.21.15.175:48592) 2024-04-25T09:14:29.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 learned_addr learned my addr 172.21.15.175:0/508277837 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:29.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2227e00640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557751094c00 0x5577502e4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.335+0000 7f2229200640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557751094400 0x5577502e5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557751094c00 msgr2=0x5577502e4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f2228800640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557751094c00 0x5577502e4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557751094400 msgr2=0x5577502e5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f2228800640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557751094400 0x5577502e5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55775014e1e0 con 0x557751094800 2024-04-25T09:14:29.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f2228800640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557751094800 0x5577502e4c00 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x557751041b30 tx=0x5577501c05a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f2221000640 1 -- 172.21.15.175:0/508277837 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55775015e000 con 0x557751094800 2024-04-25T09:14:29.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f2221000640 1 -- 172.21.15.175:0/508277837 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557750172a80 con 0x557751094800 2024-04-25T09:14:29.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f2221000640 1 -- 172.21.15.175:0/508277837 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55775015e4e0 con 0x557751094800 2024-04-25T09:14:29.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55775014f2c0 con 0x557751094800 2024-04-25T09:14:29.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55775014fe00 con 0x557751094800 2024-04-25T09:14:29.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f222a79f8c0 4 datascan.init: resolving metadata pool 16 2024-04-25T09:14:29.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f2221000640 1 -- 172.21.15.175:0/508277837 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x55775045ec00 con 0x557751094800 2024-04-25T09:14:29.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f2221000640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x557751095c00 0x5577502e5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f2221000640 1 -- 172.21.15.175:0/508277837 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x557750456a00 con 0x557751094800 2024-04-25T09:14:29.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f222a79f8c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T09:14:29.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f222a79f8c0 4 datascan.main: data pool 'cephfs_data' has ID 17 2024-04-25T09:14:29.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f222a79f8c0 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T09:14:29.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x557750550000 0x5577502e4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f2229200640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x557751095c00 0x5577502e5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:1 16.14 16:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750550400 con 0x557750550000 2024-04-25T09:14:29.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f2227e00640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x557750550000 0x5577502e4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f2229200640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x557751095c00 0x5577502e5700 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x55775044f500 tx=0x5577501c0000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.339+0000 7f2227e00640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x557750550000 0x5577502e4100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.343+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv34 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.343+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x557750550800 0x5577502e3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.343+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:2 16.1f 16:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750550c00 con 0x557750550800 2024-04-25T09:14:29.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.343+0000 7f2229200640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x557750550800 0x5577502e3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.343+0000 7f2229200640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x557750550800 0x5577502e3b80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.343+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.5 v2:172.21.15.177:6816/3311807078 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x557750238500 con 0x557750550800 2024-04-25T09:14:29.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.343+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x557750551000 0x5577502e3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.343+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:3 17.0 17:00000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750551400 con 0x557750551000 2024-04-25T09:14:29.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.343+0000 7f2228800640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x557750551000 0x5577502e3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.343+0000 7f2228800640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x557750551000 0x5577502e3600 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.343+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.7 v2:172.21.15.177:6800/3881136076 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750551000 2024-04-25T09:14:29.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.343+0000 7f2222400640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55775056a000 0x557750570000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.343+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:4 17.20 17:04000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056a400 con 0x55775056a000 2024-04-25T09:14:29.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.343+0000 7f2227e00640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55775056a000 0x557750570000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.343+0000 7f2227e00640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55775056a000 0x557750570000 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.1 v2:172.21.15.175:6802/594808902 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x55775056a000 2024-04-25T09:14:29.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2222e00640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55775056ac00 0x557750570580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:5 17.10 17:08000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056b000 con 0x55775056ac00 2024-04-25T09:14:29.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2229200640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55775056ac00 0x557750570580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2229200640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55775056ac00 0x557750570580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.3 v2:172.21.15.175:6816/4078277957 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x55775056ac00 2024-04-25T09:14:29.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:6 17.30 17:0c000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056a800 con 0x557750550000 2024-04-25T09:14:29.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 2 ==== osd_op_reply(6 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:7 17.8 17:10000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056b400 con 0x557750551000 2024-04-25T09:14:29.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.7 v2:172.21.15.177:6800/3881136076 2 ==== osd_op_reply(7 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750551000 2024-04-25T09:14:29.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:8 17.28 17:14000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056b800 con 0x55775056ac00 2024-04-25T09:14:29.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.3 v2:172.21.15.175:6816/4078277957 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x55775056ac00 2024-04-25T09:14:29.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:9 17.18 17:18000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750550c00 con 0x557750550000 2024-04-25T09:14:29.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 3 ==== osd_op_reply(9 [pgnls-filter start_epoch 115 out=49b] v113'17 uv9 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:10 17.38 17:1c000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056bc00 con 0x557750551000 2024-04-25T09:14:29.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.7 v2:172.21.15.177:6800/3881136076 3 ==== osd_op_reply(10 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750551000 2024-04-25T09:14:29.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:11 17.4 17:20000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750efd000 con 0x557750550000 2024-04-25T09:14:29.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 4 ==== osd_op_reply(11 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:12 17.24 17:24000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056a400 con 0x55775056ac00 2024-04-25T09:14:29.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.3 v2:172.21.15.175:6816/4078277957 3 ==== osd_op_reply(12 [pgnls-filter start_epoch 115 out=49b] v113'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x55775056ac00 2024-04-25T09:14:29.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:13 17.14 17:28000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750efcc00 con 0x55775056ac00 2024-04-25T09:14:29.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.3 v2:172.21.15.175:6816/4078277957 4 ==== osd_op_reply(13 [pgnls-filter start_epoch 115 out=49b] v113'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x55775056ac00 2024-04-25T09:14:29.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:14 17.34 17:2c000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056a800 con 0x557750550000 2024-04-25T09:14:29.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 5 ==== osd_op_reply(14 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.347+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:15 17.c 17:30000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056b000 con 0x557750551000 2024-04-25T09:14:29.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.7 v2:172.21.15.177:6800/3881136076 4 ==== osd_op_reply(15 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750551000 2024-04-25T09:14:29.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f2222400640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x557750550400 0x557750570b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:16 17.2c 17:34000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750550c00 con 0x557750550400 2024-04-25T09:14:29.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f2228800640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x557750550400 0x557750570b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f2228800640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x557750550400 0x557750570b00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.4 v2:172.21.15.177:6808/236493968 1 ==== osd_op_reply(16 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750550400 2024-04-25T09:14:29.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:17 17.1c 17:38000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056b800 con 0x55775056a000 2024-04-25T09:14:29.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.1 v2:172.21.15.175:6802/594808902 2 ==== osd_op_reply(17 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x55775056a000 2024-04-25T09:14:29.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:18 17.3c 17:3c000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056b400 con 0x557750550000 2024-04-25T09:14:29.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 6 ==== osd_op_reply(18 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:19 17.2 17:40000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057c000 con 0x557750550400 2024-04-25T09:14:29.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.4 v2:172.21.15.177:6808/236493968 2 ==== osd_op_reply(19 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750550400 2024-04-25T09:14:29.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:20 17.22 17:44000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056bc00 con 0x557750550800 2024-04-25T09:14:29.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.5 v2:172.21.15.177:6816/3311807078 2 ==== osd_op_reply(20 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x557750550800 2024-04-25T09:14:29.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:21 17.12 17:48000000::::head [pgnls-filter start_epoch 115 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057c400 con 0x55775056ac00 2024-04-25T09:14:29.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.3 v2:172.21.15.175:6816/4078277957 5 ==== osd_op_reply(21 [pgnls-filter start_epoch 115 out=81b] v115'23 uv23 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x557750238500 con 0x55775056ac00 2024-04-25T09:14:29.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:22 17.0 17:00000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750551800 con 0x557750551000 2024-04-25T09:14:29.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.7 v2:172.21.15.177:6800/3881136076 5 ==== osd_op_reply(22 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750551000 2024-04-25T09:14:29.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.351+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:23 17.20 17:04000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057c800 con 0x55775056a000 2024-04-25T09:14:29.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.1 v2:172.21.15.175:6802/594808902 3 ==== osd_op_reply(23 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x55775056a000 2024-04-25T09:14:29.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:24 17.10 17:08000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056b000 con 0x55775056ac00 2024-04-25T09:14:29.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.3 v2:172.21.15.175:6816/4078277957 6 ==== osd_op_reply(24 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x55775056ac00 2024-04-25T09:14:29.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:25 17.30 17:0c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057cc00 con 0x557750550000 2024-04-25T09:14:29.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 7 ==== osd_op_reply(25 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:26 17.8 17:10000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750551400 con 0x557750551000 2024-04-25T09:14:29.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.7 v2:172.21.15.177:6800/3881136076 6 ==== osd_op_reply(26 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750551000 2024-04-25T09:14:29.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:27 17.28 17:14000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057d000 con 0x55775056ac00 2024-04-25T09:14:29.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.3 v2:172.21.15.175:6816/4078277957 7 ==== osd_op_reply(27 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x55775056ac00 2024-04-25T09:14:29.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:28 17.18 17:18000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056a400 con 0x557750550000 2024-04-25T09:14:29.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 8 ==== osd_op_reply(28 [pgnls-filter start_epoch 115 out=49b] v113'17 uv9 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:29 17.38 17:1c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057c400 con 0x557750551000 2024-04-25T09:14:29.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.7 v2:172.21.15.177:6800/3881136076 7 ==== osd_op_reply(29 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750551000 2024-04-25T09:14:29.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:30 17.4 17:20000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056bc00 con 0x557750550000 2024-04-25T09:14:29.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 9 ==== osd_op_reply(30 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:31 17.24 17:24000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057d000 con 0x55775056ac00 2024-04-25T09:14:29.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.3 v2:172.21.15.175:6816/4078277957 8 ==== osd_op_reply(31 [pgnls-filter start_epoch 115 out=49b] v113'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x55775056ac00 2024-04-25T09:14:29.766 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:32 17.14 17:28000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056b000 con 0x55775056ac00 2024-04-25T09:14:29.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.3 v2:172.21.15.175:6816/4078277957 9 ==== osd_op_reply(32 [pgnls-filter start_epoch 115 out=49b] v113'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x55775056ac00 2024-04-25T09:14:29.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:33 17.34 17:2c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057c800 con 0x557750550000 2024-04-25T09:14:29.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 10 ==== osd_op_reply(33 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:34 17.c 17:30000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056a800 con 0x557750551000 2024-04-25T09:14:29.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.7 v2:172.21.15.177:6800/3881136076 8 ==== osd_op_reply(34 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750551000 2024-04-25T09:14:29.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:35 17.2c 17:34000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057d400 con 0x557750550400 2024-04-25T09:14:29.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.4 v2:172.21.15.177:6808/236493968 3 ==== osd_op_reply(35 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750550400 2024-04-25T09:14:29.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.355+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:36 17.1c 17:38000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750efcc00 con 0x55775056a000 2024-04-25T09:14:29.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.1 v2:172.21.15.175:6802/594808902 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x55775056a000 2024-04-25T09:14:29.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:37 17.3c 17:3c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056b800 con 0x557750550000 2024-04-25T09:14:29.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 11 ==== osd_op_reply(37 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:38 17.2 17:40000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750efd000 con 0x557750550400 2024-04-25T09:14:29.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.4 v2:172.21.15.177:6808/236493968 4 ==== osd_op_reply(38 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750550400 2024-04-25T09:14:29.767 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:39 17.22 17:44000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056b400 con 0x557750550800 2024-04-25T09:14:29.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.5 v2:172.21.15.177:6816/3311807078 3 ==== osd_op_reply(39 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x557750550800 2024-04-25T09:14:29.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:40 17.12 17:48000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750550c00 con 0x55775056ac00 2024-04-25T09:14:29.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.3 v2:172.21.15.175:6816/4078277957 10 ==== osd_op_reply(40 [pgnls-filter start_epoch 115 out=49b] v115'23 uv23 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x55775056ac00 2024-04-25T09:14:29.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:41 17.32 17:4c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057cc00 con 0x557750551000 2024-04-25T09:14:29.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.7 v2:172.21.15.177:6800/3881136076 9 ==== osd_op_reply(41 [pgnls-filter start_epoch 115 out=81b] v115'17 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x557750238780 con 0x557750551000 2024-04-25T09:14:29.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f222a79f8c0 20 datascan.forall_objects: OSD matched oid 10000000003.00000000 2024-04-25T09:14:29.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f222a79f8c0 10 datascan.operator(): handling object 10000000003.0 2024-04-25T09:14:29.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:42 17.32 17:4def72d4:::10000000003.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058a000 con 0x557750551000 2024-04-25T09:14:29.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.7 v2:172.21.15.177:6800/3881136076 10 ==== osd_op_reply(42 10000000003.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (126) out=126b,getxattr (30) out=30b,getxattr] v0'0 uv17 ondisk = 0) v8 ==== 416+0+194 (crc 0 0 0) 0x557750238780 con 0x557750551000 2024-04-25T09:14:29.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f222a79f8c0 10 datascan.inject_with_backtrace: inode: 0x0x10000000003 2024-04-25T09:14:29.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f222a79f8c0 10 datascan.inject_with_backtrace: backptr: 0x0x10000000001/bravo 2024-04-25T09:14:29.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f222a79f8c0 20 datascan.get_frag_of: dirino=0x10000000001 target_dname=bravo 2024-04-25T09:14:29.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:43 16.7 16:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058a400 con 0x55775056ac00 2024-04-25T09:14:29.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.3 v2:172.21.15.175:6816/4078277957 11 ==== osd_op_reply(43 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x557750238500 con 0x55775056ac00 2024-04-25T09:14:29.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f222a79f8c0 20 datascan.get_frag_of: got backtrace parent 0x10000000000/flushed 2024-04-25T09:14:29.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x55775058a800 0x557750571600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:44 16.10 16:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058ac00 con 0x55775058a800 2024-04-25T09:14:29.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f2227e00640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x55775058a800 0x557750571600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f2227e00640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x55775058a800 0x557750571600 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.2 v2:172.21.15.175:6821/3247063283 1 ==== osd_op_reply(44 10000000000.00000000 [omap-get-vals-by-keys out=524b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+524 (crc 0 0 0) 0x557750238000 con 0x55775058a800 2024-04-25T09:14:29.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f222a79f8c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed frag=*, r=0 2024-04-25T09:14:29.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f222a79f8c0 20 datascan.get_frag_of: fast path, fragtree is fragtree_t() 2024-04-25T09:14:29.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f222a79f8c0 20 datascan.get_frag_of: frag is * 2024-04-25T09:14:29.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:45 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058b000 con 0x55775056ac00 2024-04-25T09:14:29.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.3 v2:172.21.15.175:6816/4078277957 12 ==== osd_op_reply(45 10000000001.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x557750238500 con 0x55775056ac00 2024-04-25T09:14:29.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f222a79f8c0 10 datascan.find_or_create_dirfrag: read_version = 8 2024-04-25T09:14:29.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f222a79f8c0 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000001 * 2024-04-25T09:14:29.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.359+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:46 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058b400 con 0x55775056ac00 2024-04-25T09:14:29.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.363+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.3 v2:172.21.15.175:6816/4078277957 13 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x557750238500 con 0x55775056ac00 2024-04-25T09:14:29.769 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.363+0000 7f222a79f8c0 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-04-25T09:14:29.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.363+0000 7f222a79f8c0 20 datascan.read_dentry: bravo_head not found in result 2024-04-25T09:14:29.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.363+0000 7f222a79f8c0 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000003 at 0x0x10000000001/bravo with size=5 bytes 2024-04-25T09:14:29.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.363+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:47 16.7 16:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058b800 con 0x55775056ac00 2024-04-25T09:14:29.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.363+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.3 v2:172.21.15.175:6816/4078277957 14 ==== osd_op_reply(47 10000000001.00000000 [omap-set-vals] v115'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x557750238500 con 0x55775056ac00 2024-04-25T09:14:29.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.363+0000 7f222a79f8c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x10000000003 2024-04-25T09:14:29.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.363+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:48 17.a 17:50000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750550c00 con 0x557750551000 2024-04-25T09:14:29.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.363+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.7 v2:172.21.15.177:6800/3881136076 11 ==== osd_op_reply(48 [pgnls-filter start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750551000 2024-04-25T09:14:29.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.363+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:49 17.2a 17:54000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057c800 con 0x55775056ac00 2024-04-25T09:14:29.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.363+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.3 v2:172.21.15.175:6816/4078277957 15 ==== osd_op_reply(49 [pgnls-filter start_epoch 115 out=49b] v113'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x55775056ac00 2024-04-25T09:14:29.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.363+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:50 17.1a 17:58000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750551800 con 0x557750550000 2024-04-25T09:14:29.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.363+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 12 ==== osd_op_reply(50 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.363+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:51 17.3a 17:5c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057c000 con 0x55775056a000 2024-04-25T09:14:29.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.363+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.1 v2:172.21.15.175:6802/594808902 5 ==== osd_op_reply(51 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x55775056a000 2024-04-25T09:14:29.770 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.363+0000 7f2222400640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x557750551400 0x557750571080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.363+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:52 17.6 17:60000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056a400 con 0x557750551400 2024-04-25T09:14:29.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.363+0000 7f2229200640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x557750551400 0x557750571080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2229200640 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x557750551400 0x557750571080 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.6 v2:172.21.15.177:6822/4132808595 1 ==== osd_op_reply(52 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x557750551400 2024-04-25T09:14:29.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:53 17.26 17:64000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057c400 con 0x557750550000 2024-04-25T09:14:29.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 13 ==== osd_op_reply(53 [pgnls-filter start_epoch 115 out=49b] v113'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:54 17.16 17:68000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056bc00 con 0x557750550800 2024-04-25T09:14:29.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.5 v2:172.21.15.177:6816/3311807078 4 ==== osd_op_reply(54 [pgnls-filter start_epoch 115 out=49b] v113'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x557750550800 2024-04-25T09:14:29.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:55 17.36 17:6c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057d800 con 0x557750550000 2024-04-25T09:14:29.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 14 ==== osd_op_reply(55 [pgnls-filter start_epoch 115 out=49b] v113'32 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:56 17.e 17:70000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056b800 con 0x55775058a800 2024-04-25T09:14:29.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.2 v2:172.21.15.175:6821/3247063283 2 ==== osd_op_reply(56 [pgnls-filter start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x55775058a800 2024-04-25T09:14:29.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:57 17.2e 17:74000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057dc00 con 0x557750551400 2024-04-25T09:14:29.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.6 v2:172.21.15.177:6822/4132808595 2 ==== osd_op_reply(57 [pgnls-filter start_epoch 115 out=49b] v113'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x557750551400 2024-04-25T09:14:29.771 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:58 17.1e 17:78000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750efcc00 con 0x55775056a000 2024-04-25T09:14:29.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.1 v2:172.21.15.175:6802/594808902 6 ==== osd_op_reply(58 [pgnls-filter start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x55775056a000 2024-04-25T09:14:29.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:59 17.3e 17:7c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058ac00 con 0x557750550400 2024-04-25T09:14:29.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.4 v2:172.21.15.177:6808/236493968 5 ==== osd_op_reply(59 [pgnls-filter start_epoch 115 out=49b] v113'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750550400 2024-04-25T09:14:29.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:60 17.1 17:80000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058a400 con 0x557750550000 2024-04-25T09:14:29.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 15 ==== osd_op_reply(60 [pgnls-filter start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:61 17.21 17:84000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750551800 con 0x557750550000 2024-04-25T09:14:29.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 16 ==== osd_op_reply(61 [pgnls-filter start_epoch 115 out=49b] v113'24 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:62 17.11 17:88000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058b000 con 0x55775056ac00 2024-04-25T09:14:29.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.3 v2:172.21.15.175:6816/4078277957 16 ==== osd_op_reply(62 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x55775056ac00 2024-04-25T09:14:29.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.367+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:63 17.31 17:8c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750551c00 con 0x55775056a000 2024-04-25T09:14:29.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.1 v2:172.21.15.175:6802/594808902 7 ==== osd_op_reply(63 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x55775056a000 2024-04-25T09:14:29.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:64 17.9 17:90000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058b400 con 0x55775056ac00 2024-04-25T09:14:29.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.3 v2:172.21.15.175:6816/4078277957 17 ==== osd_op_reply(64 [pgnls-filter start_epoch 115 out=49b] v113'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x55775056ac00 2024-04-25T09:14:29.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:65 17.29 17:94000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750efcc00 con 0x557750550400 2024-04-25T09:14:29.772 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.4 v2:172.21.15.177:6808/236493968 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750550400 2024-04-25T09:14:29.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:66 17.19 17:98000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058a000 con 0x557750550800 2024-04-25T09:14:29.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.5 v2:172.21.15.177:6816/3311807078 5 ==== osd_op_reply(66 [pgnls-filter start_epoch 115 out=49b] v113'21 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x557750550800 2024-04-25T09:14:29.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:67 17.39 17:9c000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056b800 con 0x557750550800 2024-04-25T09:14:29.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.5 v2:172.21.15.177:6816/3311807078 6 ==== osd_op_reply(67 [pgnls-filter start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x557750550800 2024-04-25T09:14:29.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:68 17.5 17:a0000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058bc00 con 0x557750551400 2024-04-25T09:14:29.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.6 v2:172.21.15.177:6822/4132808595 3 ==== osd_op_reply(68 [pgnls-filter start_epoch 115 out=49b] v115'12 uv12 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x557750551400 2024-04-25T09:14:29.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:69 17.25 17:a4000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057c000 con 0x55775056a000 2024-04-25T09:14:29.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.1 v2:172.21.15.175:6802/594808902 8 ==== osd_op_reply(69 [pgnls-filter start_epoch 115 out=49b] v115'17 uv17 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x55775056a000 2024-04-25T09:14:29.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:70 17.15 17:a8000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058b800 con 0x557750550800 2024-04-25T09:14:29.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.5 v2:172.21.15.177:6816/3311807078 7 ==== osd_op_reply(70 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x557750550800 2024-04-25T09:14:29.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:71 17.35 17:ac000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057c400 con 0x557750550400 2024-04-25T09:14:29.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.4 v2:172.21.15.177:6808/236493968 7 ==== osd_op_reply(71 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750550400 2024-04-25T09:14:29.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:72 17.d 17:b0000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058b000 con 0x557750551000 2024-04-25T09:14:29.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.7 v2:172.21.15.177:6800/3881136076 12 ==== osd_op_reply(72 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750551000 2024-04-25T09:14:29.773 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.371+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:73 17.2d 17:b4000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057d800 con 0x557750551000 2024-04-25T09:14:29.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.7 v2:172.21.15.177:6800/3881136076 13 ==== osd_op_reply(73 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750551000 2024-04-25T09:14:29.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:74 17.1d 17:b8000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058b400 con 0x557750551000 2024-04-25T09:14:29.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.7 v2:172.21.15.177:6800/3881136076 14 ==== osd_op_reply(74 [pgnls-filter start_epoch 115 out=49b] v113'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750551000 2024-04-25T09:14:29.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:75 17.3d 17:bc000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058ac00 con 0x557750551000 2024-04-25T09:14:29.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.7 v2:172.21.15.177:6800/3881136076 15 ==== osd_op_reply(75 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750551000 2024-04-25T09:14:29.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:76 17.3 17:c0000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058a000 con 0x557750550400 2024-04-25T09:14:29.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.4 v2:172.21.15.177:6808/236493968 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750550400 2024-04-25T09:14:29.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:77 17.23 17:c4000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058b000 con 0x557750550400 2024-04-25T09:14:29.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.4 v2:172.21.15.177:6808/236493968 9 ==== osd_op_reply(77 [pgnls-filter start_epoch 115 out=49b] v113'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750550400 2024-04-25T09:14:29.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:78 17.13 17:c8000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057c800 con 0x55775056ac00 2024-04-25T09:14:29.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.3 v2:172.21.15.175:6816/4078277957 18 ==== osd_op_reply(78 [pgnls-filter start_epoch 115 out=49b] v113'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x55775056ac00 2024-04-25T09:14:29.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:79 17.33 17:cc000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775058b400 con 0x557750551000 2024-04-25T09:14:29.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.7 v2:172.21.15.177:6800/3881136076 16 ==== osd_op_reply(79 [pgnls-filter start_epoch 115 out=49b] v113'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750551000 2024-04-25T09:14:29.774 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:80 17.b 17:d0000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057dc00 con 0x557750550000 2024-04-25T09:14:29.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 17 ==== osd_op_reply(80 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:81 17.2b 17:d4000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057c400 con 0x557750550400 2024-04-25T09:14:29.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.4 v2:172.21.15.177:6808/236493968 10 ==== osd_op_reply(81 [pgnls-filter start_epoch 115 out=49b] v113'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750550400 2024-04-25T09:14:29.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:82 17.1b 17:d8000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056a400 con 0x557750550400 2024-04-25T09:14:29.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.4 v2:172.21.15.177:6808/236493968 11 ==== osd_op_reply(82 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750550400 2024-04-25T09:14:29.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:83 17.3b 17:dc000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775057d800 con 0x55775058a800 2024-04-25T09:14:29.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.2 v2:172.21.15.175:6821/3247063283 3 ==== osd_op_reply(83 [pgnls-filter start_epoch 115 out=49b] v113'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x55775058a800 2024-04-25T09:14:29.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:84 17.7 17:e0000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x55775056bc00 con 0x557750550000 2024-04-25T09:14:29.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 18 ==== osd_op_reply(84 [pgnls-filter start_epoch 115 out=49b] v113'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.375+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:85 17.27 17:e4000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750efcc00 con 0x557750550400 2024-04-25T09:14:29.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.4 v2:172.21.15.177:6808/236493968 12 ==== osd_op_reply(85 [pgnls-filter start_epoch 115 out=49b] v113'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750550400 2024-04-25T09:14:29.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:86 17.17 17:e8000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x5577505a2000 con 0x557750551400 2024-04-25T09:14:29.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.6 v2:172.21.15.177:6822/4132808595 4 ==== osd_op_reply(86 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x557750551400 2024-04-25T09:14:29.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:87 17.37 17:ec000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750550c00 con 0x557750550000 2024-04-25T09:14:29.775 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 19 ==== osd_op_reply(87 [pgnls-filter start_epoch 115 out=49b] v113'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:88 17.f 17:f0000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x5577505a2400 con 0x55775056a000 2024-04-25T09:14:29.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.1 v2:172.21.15.175:6802/594808902 9 ==== osd_op_reply(88 [pgnls-filter start_epoch 115 out=49b] v113'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x55775056a000 2024-04-25T09:14:29.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:89 17.2f 17:f4000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750551800 con 0x557750550400 2024-04-25T09:14:29.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 <== osd.4 v2:172.21.15.177:6808/236493968 13 ==== osd_op_reply(89 [pgnls-filter start_epoch 115 out=49b] v113'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238780 con 0x557750550400 2024-04-25T09:14:29.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f2222400640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:90 17.1f 17:f8000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x5577505a2800 con 0x557750551400 2024-04-25T09:14:29.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f2229200640 1 -- 172.21.15.175:0/508277837 <== osd.6 v2:172.21.15.177:6822/4132808595 5 ==== osd_op_reply(90 [pgnls-filter start_epoch 115 out=49b] v113'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238500 con 0x557750551400 2024-04-25T09:14:29.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f2222e00640 1 -- 172.21.15.175:0/508277837 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:91 17.3f 17:fc000000::::head [pgnls-filter start_epoch 115 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x557750551c00 con 0x557750550000 2024-04-25T09:14:29.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f2227e00640 1 -- 172.21.15.175:0/508277837 <== osd.0 v2:172.21.15.175:6800/1093269849 20 ==== osd_op_reply(91 [pgnls-filter start_epoch 115 out=49b] v113'17 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557750238000 con 0x557750550000 2024-04-25T09:14:29.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x557750550000 msgr2=0x5577502e4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x557750550000 0x5577502e4100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55775056a000 msgr2=0x557750570000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x55775056a000 0x557750570000 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x55775058a800 msgr2=0x557750571600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x55775058a800 0x557750571600 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55775056ac00 msgr2=0x557750570580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.776 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x55775056ac00 0x557750570580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x557750550400 msgr2=0x557750570b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 reap_dead start 2024-04-25T09:14:29.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x557750550400 0x557750570b00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x557750550800 msgr2=0x5577502e3b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x557750550800 0x5577502e3b80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x557750551400 msgr2=0x557750571080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x557750551400 0x557750571080 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x557750551000 msgr2=0x5577502e3600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x557750551000 0x5577502e3600 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x557751095c00 msgr2=0x5577502e5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x557751095c00 0x5577502e5700 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x55775044f500 tx=0x5577501c0000 comp rx=0 tx=0).stop 2024-04-25T09:14:29.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557751094800 msgr2=0x5577502e4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/508277837 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557751094800 0x5577502e4c00 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x557751041b30 tx=0x5577501c05a0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 reap_dead start 2024-04-25T09:14:29.777 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 shutdown_connections 2024-04-25T09:14:29.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f2228800640 1 -- 172.21.15.175:0/508277837 reap_dead start 2024-04-25T09:14:29.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 >> 172.21.15.175:0/508277837 conn(0x557751094000 msgr2=0x557750156000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:29.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 shutdown_connections 2024-04-25T09:14:29.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/508277837 wait complete. 2024-04-25T09:14:29.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/1607582447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557750129400 msgr2=0x5577502e2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/1607582447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557750129400 0x5577502e2b00 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x557750f71560 tx=0x5577501c0600 comp rx=0 tx=0).stop 2024-04-25T09:14:29.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/1607582447 shutdown_connections 2024-04-25T09:14:29.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/1607582447 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x557750129800 0x5577502e3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/1607582447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x557750129400 0x5577502e2b00 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 --2- 172.21.15.175:0/1607582447 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x557750129000 0x5577502e2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/1607582447 >> 172.21.15.175:0/1607582447 conn(0x557750128c00 msgr2=0x557750155800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:29.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/1607582447 shutdown_connections 2024-04-25T09:14:29.778 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.379+0000 7f222a79f8c0 1 -- 172.21.15.175:0/1607582447 wait complete. 2024-04-25T09:14:29.779 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--filter-tag', 'mytag123', 'cephfs_data'] in time 0:00:00.548442, result: 2024-04-25T09:14:29.779 DEBUG:teuthology.orchestra.run.smithi175:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-04-25T09:14:29.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.851+0000 7f28fd3bd8c0 1 -- start start 2024-04-25T09:14:29.841 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.851+0000 7f28fd3bd8c0 1 Processor -- start 2024-04-25T09:14:29.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590737e5800 0x55907399e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590737e5400 0x55907399eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5590737e5000 0x55907399f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559073886780 con 0x5590737e5400 2024-04-25T09:14:29.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x559073886600 con 0x5590737e5800 2024-04-25T09:14:29.843 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x559073886480 con 0x5590737e5000 2024-04-25T09:14:29.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28faa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590737e5400 0x55907399eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28faa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590737e5400 0x55907399eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48596/0 (socket says 172.21.15.175:48596) 2024-04-25T09:14:29.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28faa00640 1 -- 172.21.15.175:0/3171858806 learned_addr learned my addr 172.21.15.175:0/3171858806 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:29.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fbe00640 1 --2- 172.21.15.175:0/3171858806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5590737e5000 0x55907399f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fb400640 1 --2- 172.21.15.175:0/3171858806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590737e5800 0x55907399e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28faa00640 1 -- 172.21.15.175:0/3171858806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5590737e5000 msgr2=0x55907399f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28faa00640 1 --2- 172.21.15.175:0/3171858806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5590737e5000 0x55907399f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28faa00640 1 -- 172.21.15.175:0/3171858806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590737e5800 msgr2=0x55907399e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28faa00640 1 --2- 172.21.15.175:0/3171858806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590737e5800 0x55907399e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28faa00640 1 -- 172.21.15.175:0/3171858806 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55907380a1e0 con 0x5590737e5400 2024-04-25T09:14:29.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28faa00640 1 --2- 172.21.15.175:0/3171858806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590737e5400 0x55907399eb00 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x5590746238c0 tx=0x5590746f6120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb74c7e77234770 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28f8200640 1 -- 172.21.15.175:0/3171858806 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55907381a4e0 con 0x5590737e5400 2024-04-25T09:14:29.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28f8200640 1 -- 172.21.15.175:0/3171858806 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55907382e540 con 0x5590737e5400 2024-04-25T09:14:29.844 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28f8200640 1 -- 172.21.15.175:0/3171858806 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55907381ab60 con 0x5590737e5400 2024-04-25T09:14:29.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/3171858806 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55907380b2c0 con 0x5590737e5400 2024-04-25T09:14:29.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/3171858806 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55907380ba40 con 0x5590737e5400 2024-04-25T09:14:29.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 4 waiting for MDS map... 2024-04-25T09:14:29.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28f8200640 1 -- 172.21.15.175:0/3171858806 <== mon.0 v2:172.21.15.175:3300/0 4 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x55907470c600 con 0x5590737e5400 2024-04-25T09:14:29.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28f8200640 1 -- 172.21.15.175:0/3171858806 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 100) v1 ==== 2723+0+0 (secure 0 0 0) 0x55907383b180 con 0x5590737e5400 2024-04-25T09:14:29.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 4 Got MDS map 100 2024-04-25T09:14:29.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 4 datascan.main: Using metadata pool output 2024-04-25T09:14:29.845 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 4 datascan.main: connecting to RADOS... 2024-04-25T09:14:29.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 1 Processor -- start 2024-04-25T09:14:29.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 1 -- start start 2024-04-25T09:14:29.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5590746fcc00 0x55907399f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590746fd000 0x55907399fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590746fd400 0x5590739a0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559073886300 con 0x5590746fd400 2024-04-25T09:14:29.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x559073886000 con 0x5590746fd000 2024-04-25T09:14:29.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.855+0000 7f28fd3bd8c0 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x559073844900 con 0x5590746fcc00 2024-04-25T09:14:29.851 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28faa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590746fd400 0x5590739a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28faa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590746fd400 0x5590739a0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48600/0 (socket says 172.21.15.175:48600) 2024-04-25T09:14:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28faa00640 1 -- 172.21.15.175:0/1617323300 learned_addr learned my addr 172.21.15.175:0/1617323300 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28faa00640 1 -- 172.21.15.175:0/1617323300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5590746fcc00 msgr2=0x55907399f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28faa00640 1 --2- 172.21.15.175:0/1617323300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5590746fcc00 0x55907399f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28faa00640 1 -- 172.21.15.175:0/1617323300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590746fd000 msgr2=0x55907399fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fb400640 1 --2- 172.21.15.175:0/1617323300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590746fd000 0x55907399fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28faa00640 1 --2- 172.21.15.175:0/1617323300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590746fd000 0x55907399fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28faa00640 1 -- 172.21.15.175:0/1617323300 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55907380bc20 con 0x5590746fd400 2024-04-25T09:14:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fb400640 1 --2- 172.21.15.175:0/1617323300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590746fd000 0x55907399fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28faa00640 1 --2- 172.21.15.175:0/1617323300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590746fd400 0x5590739a0100 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x5590746f86f0 tx=0x5590746f6060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845f1fdd70cfe1da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28f5a00640 1 -- 172.21.15.175:0/1617323300 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55907381a340 con 0x5590746fd400 2024-04-25T09:14:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28f5a00640 1 -- 172.21.15.175:0/1617323300 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55907382ee00 con 0x5590746fd400 2024-04-25T09:14:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28f5a00640 1 -- 172.21.15.175:0/1617323300 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55907381a4e0 con 0x5590746fd400 2024-04-25T09:14:29.852 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/1617323300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590746fd400 msgr2=0x5590739a0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/1617323300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590746fd400 0x5590739a0100 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x5590746f86f0 tx=0x5590746f6060 comp rx=0 tx=0).stop 2024-04-25T09:14:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/1617323300 shutdown_connections 2024-04-25T09:14:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/1617323300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590746fd400 0x5590739a0100 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/1617323300 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590746fd000 0x55907399fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/1617323300 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5590746fcc00 0x55907399f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/1617323300 >> 172.21.15.175:0/1617323300 conn(0x5590737e4c00 msgr2=0x559073813800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/1617323300 shutdown_connections 2024-04-25T09:14:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/1617323300 wait complete. 2024-04-25T09:14:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fd3bd8c0 1 Processor -- start 2024-04-25T09:14:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fd3bd8c0 1 -- start start 2024-04-25T09:14:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fd3bd8c0 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5590746fcc00 0x5590739a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fd3bd8c0 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590746fd000 0x5590739a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fd3bd8c0 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590746fd400 0x5590739a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fd3bd8c0 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x559073887500 con 0x5590746fd000 2024-04-25T09:14:29.853 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fd3bd8c0 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x559073887680 con 0x5590746fd400 2024-04-25T09:14:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fd3bd8c0 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x559073886000 con 0x5590746fcc00 2024-04-25T09:14:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fb400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590746fd000 0x5590739a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fb400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590746fd000 0x5590739a0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48604/0 (socket says 172.21.15.175:48604) 2024-04-25T09:14:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 learned_addr learned my addr 172.21.15.175:0/4081930759 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fbe00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5590746fcc00 0x5590739a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28faa00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590746fd400 0x5590739a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5590746fcc00 msgr2=0x5590739a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.854 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.859+0000 7f28fb400640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5590746fcc00 0x5590739a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590746fd400 msgr2=0x5590739a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28fb400640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590746fd400 0x5590739a0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55907380a1e0 con 0x5590746fd000 2024-04-25T09:14:29.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28fb400640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590746fd000 0x5590739a0c00 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x5590746f98f0 tx=0x559073b0cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28f3c00640 1 -- 172.21.15.175:0/4081930759 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55907381a340 con 0x5590746fd000 2024-04-25T09:14:29.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28f3c00640 1 -- 172.21.15.175:0/4081930759 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55907382ec40 con 0x5590746fd000 2024-04-25T09:14:29.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55907380b2c0 con 0x5590746fd000 2024-04-25T09:14:29.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28f3c00640 1 -- 172.21.15.175:0/4081930759 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55907381a4e0 con 0x5590746fd000 2024-04-25T09:14:29.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55907380be00 con 0x5590746fd000 2024-04-25T09:14:29.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28fd3bd8c0 4 datascan.init: resolving metadata pool 16 2024-04-25T09:14:29.855 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28f3c00640 1 -- 172.21.15.175:0/4081930759 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x5590745a8c00 con 0x5590746fd000 2024-04-25T09:14:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28f3c00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x559073b1ac00 0x5590739a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28f3c00640 1 -- 172.21.15.175:0/4081930759 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x559073b1ca00 con 0x5590746fd000 2024-04-25T09:14:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28fd3bd8c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T09:14:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28fd3bd8c0 4 datascan.main: resolving metadata pool 16 2024-04-25T09:14:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x5590746fd800 0x5590739a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28fbe00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x559073b1ac00 0x5590739a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:1 16.0 16:00000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x5590746fdc00 con 0x5590746fd800 2024-04-25T09:14:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28faa00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x5590746fd800 0x5590739a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28fbe00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x559073b1ac00 0x5590739a1700 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x5590738c01e0 tx=0x55907389ff20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.863+0000 7f28faa00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x5590746fd800 0x5590739a0100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.0 v2:172.21.15.175:6800/1093269849 1 ==== osd_op_reply(1 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4000 con 0x5590746fd800 2024-04-25T09:14:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28faa00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x5590746fdc00 0x559073c06000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.860 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:2 16.10 16:08000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x5590746fc800 con 0x5590746fdc00 2024-04-25T09:14:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28fbe00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x5590746fdc00 0x559073c06000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28fbe00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x5590746fdc00 0x559073c06000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 1 ==== osd_op_reply(2 [pgnls start_epoch 115 out=177b] v114'16 uv16 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:3 16.8 16:10000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x5590746fc800 con 0x5590746fd800 2024-04-25T09:14:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.0 v2:172.21.15.175:6800/1093269849 2 ==== osd_op_reply(3 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4000 con 0x5590746fd800 2024-04-25T09:14:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:4 16.18 16:18000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x5590746fc800 con 0x5590746fd800 2024-04-25T09:14:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.0 v2:172.21.15.175:6800/1093269849 3 ==== osd_op_reply(4 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4000 con 0x5590746fd800 2024-04-25T09:14:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28faa00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x5590746fc800 0x559073c06580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:5 16.4 16:20000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x5590746fc400 con 0x5590746fc800 2024-04-25T09:14:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28fb400640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x5590746fc800 0x559073c06580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28fb400640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x5590746fc800 0x559073c06580 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.3 v2:172.21.15.175:6816/4078277957 1 ==== osd_op_reply(5 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4780 con 0x5590746fc800 2024-04-25T09:14:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:6 16.14 16:28000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x5590746fc400 con 0x5590746fd800 2024-04-25T09:14:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.0 v2:172.21.15.175:6800/1093269849 4 ==== osd_op_reply(6 [pgnls start_epoch 115 out=149b] v115'41 uv41 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x5590738f4000 con 0x5590746fd800 2024-04-25T09:14:29.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28faa00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x5590746fc400 0x559073c06b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:7 16.c 16:30000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1b000 con 0x5590746fc400 2024-04-25T09:14:29.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.867+0000 7f28faa00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x5590746fc400 0x559073c06b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.871+0000 7f28faa00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x5590746fc400 0x559073c06b00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.871+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.5 v2:172.21.15.177:6816/3311807078 1 ==== osd_op_reply(7 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4000 con 0x5590746fc400 2024-04-25T09:14:29.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.871+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:8 16.1c 16:38000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1b000 con 0x5590746fdc00 2024-04-25T09:14:29.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.871+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 2 ==== osd_op_reply(8 [pgnls start_epoch 115 out=73b] v114'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.871+0000 7f28fbe00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x559073b1b000 0x559073c07080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.871+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:9 16.2 16:40000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x5590738e3000 con 0x559073b1b000 2024-04-25T09:14:29.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.871+0000 7f28fbe00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x559073b1b000 0x559073c07080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.871+0000 7f28fbe00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x559073b1b000 0x559073c07080 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.871+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.4 v2:172.21.15.177:6808/236493968 1 ==== osd_op_reply(9 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4500 con 0x559073b1b000 2024-04-25T09:14:29.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.871+0000 7f28fbe00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x5590738e3000 0x559073c07600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.871+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:10 16.12 16:48000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x5590738e3400 con 0x5590738e3000 2024-04-25T09:14:29.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.871+0000 7f28fb400640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x5590738e3000 0x559073c07600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.871+0000 7f28fb400640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x5590738e3000 0x559073c07600 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.871+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.6 v2:172.21.15.177:6822/4132808595 1 ==== osd_op_reply(10 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4780 con 0x5590738e3000 2024-04-25T09:14:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.871+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:11 16.a 16:50000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x5590738e3400 con 0x5590746fdc00 2024-04-25T09:14:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.871+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 3 ==== osd_op_reply(11 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.871+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:12 16.1a 16:58000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x5590738e3400 con 0x5590746fc800 2024-04-25T09:14:29.865 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.3 v2:172.21.15.175:6816/4078277957 2 ==== osd_op_reply(12 [pgnls start_epoch 115 out=49b] v115'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4780 con 0x5590746fc800 2024-04-25T09:14:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:13 16.6 16:60000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x5590738e3400 con 0x5590738e3000 2024-04-25T09:14:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.6 v2:172.21.15.177:6822/4132808595 2 ==== osd_op_reply(13 [pgnls start_epoch 115 out=77b] v114'10 uv10 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x5590738f4780 con 0x5590738e3000 2024-04-25T09:14:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:14 16.16 16:68000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x5590738e3400 con 0x5590746fc800 2024-04-25T09:14:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.3 v2:172.21.15.175:6816/4078277957 3 ==== osd_op_reply(14 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4780 con 0x5590746fc800 2024-04-25T09:14:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:15 16.e 16:70000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x5590738e3400 con 0x5590746fdc00 2024-04-25T09:14:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 4 ==== osd_op_reply(15 [pgnls start_epoch 115 out=73b] v114'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28fbe00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x5590738e3400 0x559073c07b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:16 16.1e 16:78000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2a000 con 0x5590738e3400 2024-04-25T09:14:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28faa00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x5590738e3400 0x559073c07b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28faa00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x5590738e3400 0x559073c07b80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.7 v2:172.21.15.177:6800/3881136076 1 ==== osd_op_reply(16 [pgnls start_epoch 115 out=49b] v115'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4000 con 0x5590738e3400 2024-04-25T09:14:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:17 16.1 16:80000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2a000 con 0x5590746fdc00 2024-04-25T09:14:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 5 ==== osd_op_reply(17 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.866 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:18 16.11 16:88000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2a000 con 0x5590746fc400 2024-04-25T09:14:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.5 v2:172.21.15.177:6816/3311807078 2 ==== osd_op_reply(18 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4000 con 0x5590746fc400 2024-04-25T09:14:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28faa00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x559073c2a000 0x559073c08100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:19 16.9 16:90000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1b400 con 0x559073c2a000 2024-04-25T09:14:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28fbe00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x559073c2a000 0x559073c08100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.875+0000 7f28fbe00640 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x559073c2a000 0x559073c08100 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.1 v2:172.21.15.175:6802/594808902 1 ==== osd_op_reply(19 [pgnls start_epoch 115 out=81b] v114'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5590738f4500 con 0x559073c2a000 2024-04-25T09:14:29.867 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:20 16.19 16:98000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1b400 con 0x559073b1b000 2024-04-25T09:14:29.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.4 v2:172.21.15.177:6808/236493968 2 ==== osd_op_reply(20 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4500 con 0x559073b1b000 2024-04-25T09:14:29.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:21 16.5 16:a0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1b400 con 0x5590746fd800 2024-04-25T09:14:29.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.0 v2:172.21.15.175:6800/1093269849 5 ==== osd_op_reply(21 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4000 con 0x5590746fd800 2024-04-25T09:14:29.869 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:22 16.15 16:a8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1b400 con 0x5590746fd800 2024-04-25T09:14:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.0 v2:172.21.15.175:6800/1093269849 6 ==== osd_op_reply(22 [pgnls start_epoch 115 out=97b] v114'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x5590738f4000 con 0x5590746fd800 2024-04-25T09:14:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:23 16.d 16:b0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1b400 con 0x5590738e3000 2024-04-25T09:14:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.6 v2:172.21.15.177:6822/4132808595 3 ==== osd_op_reply(23 [pgnls start_epoch 115 out=74b] v112'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x5590738f4780 con 0x5590738e3000 2024-04-25T09:14:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:24 16.1d 16:b8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1b400 con 0x5590746fdc00 2024-04-25T09:14:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 6 ==== osd_op_reply(24 [pgnls start_epoch 115 out=73b] v114'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:25 16.3 16:c0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1b400 con 0x5590746fc400 2024-04-25T09:14:29.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.5 v2:172.21.15.177:6816/3311807078 3 ==== osd_op_reply(25 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4000 con 0x5590746fc400 2024-04-25T09:14:29.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:26 16.13 16:c8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1b400 con 0x559073c2a000 2024-04-25T09:14:29.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.1 v2:172.21.15.175:6802/594808902 2 ==== osd_op_reply(26 [pgnls start_epoch 115 out=98b] v114'5 uv5 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x5590738f4500 con 0x559073c2a000 2024-04-25T09:14:29.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:27 16.b 16:d0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1b400 con 0x559073c2a000 2024-04-25T09:14:29.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.1 v2:172.21.15.175:6802/594808902 3 ==== osd_op_reply(27 [pgnls start_epoch 115 out=76b] v115'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x5590738f4500 con 0x559073c2a000 2024-04-25T09:14:29.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:28 16.1b 16:d8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1b400 con 0x5590746fc400 2024-04-25T09:14:29.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.5 v2:172.21.15.177:6816/3311807078 4 ==== osd_op_reply(28 [pgnls start_epoch 115 out=49b] v115'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4000 con 0x5590746fc400 2024-04-25T09:14:29.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.879+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:29 16.7 16:e0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1b400 con 0x5590746fc800 2024-04-25T09:14:29.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.3 v2:172.21.15.175:6816/4078277957 4 ==== osd_op_reply(29 [pgnls start_epoch 115 out=105b] v115'9 uv9 ondisk = 1) v8 ==== 144+0+105 (crc 0 0 0) 0x5590738f4780 con 0x5590746fc800 2024-04-25T09:14:29.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:30 16.17 16:e8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1b400 con 0x5590746fdc00 2024-04-25T09:14:29.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 7 ==== osd_op_reply(30 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.872 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:31 16.f 16:f0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1b400 con 0x5590746fd800 2024-04-25T09:14:29.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.0 v2:172.21.15.175:6800/1093269849 7 ==== osd_op_reply(31 [pgnls start_epoch 115 out=73b] v115'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5590738f4000 con 0x5590746fd800 2024-04-25T09:14:29.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:32 16.1f 16:f8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1b400 con 0x5590746fc400 2024-04-25T09:14:29.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.5 v2:172.21.15.177:6816/3311807078 5 ==== osd_op_reply(32 [pgnls start_epoch 115 out=101b] v115'9 uv8 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x5590738f4000 con 0x5590746fc400 2024-04-25T09:14:29.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 601.00000000 2024-04-25T09:14:29.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:33 16.10 16:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2b000 con 0x5590746fdc00 2024-04-25T09:14:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 8 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 602.00000000 2024-04-25T09:14:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:34 16.10 16:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2b400 con 0x5590746fdc00 2024-04-25T09:14:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 9 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-25T09:14:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:35 16.10 16:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2b800 con 0x5590746fdc00 2024-04-25T09:14:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 10 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=1047b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+1047 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 600.00000000 2024-04-25T09:14:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:36 16.10 16:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2bc00 con 0x5590746fdc00 2024-04-25T09:14:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 11 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 603.00000000 2024-04-25T09:14:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:37 16.10 16:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2ac00 con 0x5590746fdc00 2024-04-25T09:14:29.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 12 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-25T09:14:29.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T09:14:29.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 200.00000000 2024-04-25T09:14:29.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T09:14:29.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 200.00000001 2024-04-25T09:14:29.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T09:14:29.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 606.00000000 2024-04-25T09:14:29.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:38 16.14 16:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2a800 con 0x5590746fd800 2024-04-25T09:14:29.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.0 v2:172.21.15.175:6800/1093269849 8 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv36 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4000 con 0x5590746fd800 2024-04-25T09:14:29.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 607.00000000 2024-04-25T09:14:29.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:39 16.1c 16:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2a400 con 0x5590746fdc00 2024-04-25T09:14:29.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 13 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-04-25T09:14:29.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T09:14:29.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 608.00000000 2024-04-25T09:14:29.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:40 16.e 16:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2b000 con 0x5590746fdc00 2024-04-25T09:14:29.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 14 ==== osd_op_reply(40 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 10000000005.00000000 2024-04-25T09:14:29.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.883+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:41 16.9 16:9258b67d:::10000000005.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2b400 con 0x559073c2a000 2024-04-25T09:14:29.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.1 v2:172.21.15.175:6802/594808902 4 ==== osd_op_reply(41 10000000005.00000000 [omap-get-vals out=531b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+531 (crc 0 0 0) 0x5590738f4500 con 0x559073c2a000 2024-04-25T09:14:29.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 604.00000000 2024-04-25T09:14:29.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:42 16.15 16:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2b800 con 0x5590746fd800 2024-04-25T09:14:29.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.0 v2:172.21.15.175:6800/1093269849 9 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4000 con 0x5590746fd800 2024-04-25T09:14:29.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 500.00000000 2024-04-25T09:14:29.883 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T09:14:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-25T09:14:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T09:14:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 605.00000000 2024-04-25T09:14:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:43 16.1d 16:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c32000 con 0x5590746fdc00 2024-04-25T09:14:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 15 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-25T09:14:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T09:14:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-25T09:14:29.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:44 16.13 16:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c32400 con 0x559073c2a000 2024-04-25T09:14:29.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.1 v2:172.21.15.175:6802/594808902 5 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x5590738f4500 con 0x559073c2a000 2024-04-25T09:14:29.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-25T09:14:29.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T09:14:29.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 609.00000000 2024-04-25T09:14:29.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:45 16.7 16:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c32800 con 0x5590746fc800 2024-04-25T09:14:29.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.3 v2:172.21.15.175:6816/4078277957 5 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4780 con 0x5590746fc800 2024-04-25T09:14:29.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 10000000001.00000000 2024-04-25T09:14:29.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:46 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c32c00 con 0x5590746fc800 2024-04-25T09:14:29.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.3 v2:172.21.15.175:6816/4078277957 6 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals out=1561b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+1561 (crc 0 0 0) 0x5590738f4780 con 0x5590746fc800 2024-04-25T09:14:29.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 20 datascan.scan_links: injected ino detected 2024-04-25T09:14:29.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 400.00000000 2024-04-25T09:14:29.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T09:14:29.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-25T09:14:29.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T09:14:29.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-25T09:14:29.886 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:47 16.1f 16:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33000 con 0x5590746fc400 2024-04-25T09:14:29.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.5 v2:172.21.15.177:6816/3311807078 6 ==== osd_op_reply(47 1.00000000 [omap-get-vals out=524b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+524 (crc 0 0 0) 0x5590738f4000 con 0x5590746fc400 2024-04-25T09:14:29.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:48 16.0 16:00000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fd800 2024-04-25T09:14:29.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.0 v2:172.21.15.175:6800/1093269849 10 ==== osd_op_reply(48 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4000 con 0x5590746fd800 2024-04-25T09:14:29.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:49 16.10 16:08000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fdc00 2024-04-25T09:14:29.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 16 ==== osd_op_reply(49 [pgnls start_epoch 115 out=177b] v114'16 uv16 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:50 16.8 16:10000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fd800 2024-04-25T09:14:29.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.0 v2:172.21.15.175:6800/1093269849 11 ==== osd_op_reply(50 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4000 con 0x5590746fd800 2024-04-25T09:14:29.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:51 16.18 16:18000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fd800 2024-04-25T09:14:29.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.0 v2:172.21.15.175:6800/1093269849 12 ==== osd_op_reply(51 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4000 con 0x5590746fd800 2024-04-25T09:14:29.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.887+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:52 16.4 16:20000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fc800 2024-04-25T09:14:29.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.3 v2:172.21.15.175:6816/4078277957 7 ==== osd_op_reply(52 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4780 con 0x5590746fc800 2024-04-25T09:14:29.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:53 16.14 16:28000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fd800 2024-04-25T09:14:29.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.0 v2:172.21.15.175:6800/1093269849 13 ==== osd_op_reply(53 [pgnls start_epoch 115 out=149b] v115'41 uv41 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x5590738f4000 con 0x5590746fd800 2024-04-25T09:14:29.887 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:54 16.c 16:30000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fc400 2024-04-25T09:14:29.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.5 v2:172.21.15.177:6816/3311807078 7 ==== osd_op_reply(54 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4000 con 0x5590746fc400 2024-04-25T09:14:29.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:55 16.1c 16:38000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fdc00 2024-04-25T09:14:29.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 17 ==== osd_op_reply(55 [pgnls start_epoch 115 out=73b] v114'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:56 16.2 16:40000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x559073b1b000 2024-04-25T09:14:29.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.4 v2:172.21.15.177:6808/236493968 3 ==== osd_op_reply(56 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4500 con 0x559073b1b000 2024-04-25T09:14:29.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:57 16.12 16:48000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590738e3000 2024-04-25T09:14:29.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.6 v2:172.21.15.177:6822/4132808595 4 ==== osd_op_reply(57 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4780 con 0x5590738e3000 2024-04-25T09:14:29.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:58 16.a 16:50000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fdc00 2024-04-25T09:14:29.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 18 ==== osd_op_reply(58 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:59 16.1a 16:58000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fc800 2024-04-25T09:14:29.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.3 v2:172.21.15.175:6816/4078277957 8 ==== osd_op_reply(59 [pgnls start_epoch 115 out=49b] v115'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4780 con 0x5590746fc800 2024-04-25T09:14:29.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:60 16.6 16:60000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590738e3000 2024-04-25T09:14:29.888 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.6 v2:172.21.15.177:6822/4132808595 5 ==== osd_op_reply(60 [pgnls start_epoch 115 out=77b] v114'10 uv10 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x5590738f4780 con 0x5590738e3000 2024-04-25T09:14:29.889 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:61 16.16 16:68000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fc800 2024-04-25T09:14:29.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.3 v2:172.21.15.175:6816/4078277957 9 ==== osd_op_reply(61 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4780 con 0x5590746fc800 2024-04-25T09:14:29.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:62 16.e 16:70000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fdc00 2024-04-25T09:14:29.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 19 ==== osd_op_reply(62 [pgnls start_epoch 115 out=73b] v114'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.891+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- osd_op(unknown.0.0:63 16.1e 16:78000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590738e3400 2024-04-25T09:14:29.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.7 v2:172.21.15.177:6800/3881136076 2 ==== osd_op_reply(63 [pgnls start_epoch 115 out=49b] v115'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4000 con 0x5590738e3400 2024-04-25T09:14:29.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:64 16.1 16:80000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fdc00 2024-04-25T09:14:29.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 20 ==== osd_op_reply(64 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:65 16.11 16:88000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fc400 2024-04-25T09:14:29.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.5 v2:172.21.15.177:6816/3311807078 8 ==== osd_op_reply(65 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4000 con 0x5590746fc400 2024-04-25T09:14:29.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:66 16.9 16:90000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x559073c2a000 2024-04-25T09:14:29.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.1 v2:172.21.15.175:6802/594808902 6 ==== osd_op_reply(66 [pgnls start_epoch 115 out=81b] v114'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5590738f4500 con 0x559073c2a000 2024-04-25T09:14:29.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- osd_op(unknown.0.0:67 16.19 16:98000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x559073b1b000 2024-04-25T09:14:29.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.4 v2:172.21.15.177:6808/236493968 4 ==== osd_op_reply(67 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4500 con 0x559073b1b000 2024-04-25T09:14:29.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:68 16.5 16:a0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fd800 2024-04-25T09:14:29.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.0 v2:172.21.15.175:6800/1093269849 14 ==== osd_op_reply(68 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4000 con 0x5590746fd800 2024-04-25T09:14:29.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:69 16.15 16:a8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fd800 2024-04-25T09:14:29.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.0 v2:172.21.15.175:6800/1093269849 15 ==== osd_op_reply(69 [pgnls start_epoch 115 out=97b] v114'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x5590738f4000 con 0x5590746fd800 2024-04-25T09:14:29.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:70 16.d 16:b0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590738e3000 2024-04-25T09:14:29.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.6 v2:172.21.15.177:6822/4132808595 6 ==== osd_op_reply(70 [pgnls start_epoch 115 out=74b] v112'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x5590738f4780 con 0x5590738e3000 2024-04-25T09:14:29.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:71 16.1d 16:b8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fdc00 2024-04-25T09:14:29.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 21 ==== osd_op_reply(71 [pgnls start_epoch 115 out=73b] v114'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:72 16.3 16:c0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fc400 2024-04-25T09:14:29.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.5 v2:172.21.15.177:6816/3311807078 9 ==== osd_op_reply(72 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4000 con 0x5590746fc400 2024-04-25T09:14:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:73 16.13 16:c8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x559073c2a000 2024-04-25T09:14:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.1 v2:172.21.15.175:6802/594808902 7 ==== osd_op_reply(73 [pgnls start_epoch 115 out=98b] v114'5 uv5 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x5590738f4500 con 0x559073c2a000 2024-04-25T09:14:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:74 16.b 16:d0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x559073c2a000 2024-04-25T09:14:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.1 v2:172.21.15.175:6802/594808902 8 ==== osd_op_reply(74 [pgnls start_epoch 115 out=76b] v115'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x5590738f4500 con 0x559073c2a000 2024-04-25T09:14:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:75 16.1b 16:d8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fc400 2024-04-25T09:14:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.5 v2:172.21.15.177:6816/3311807078 10 ==== osd_op_reply(75 [pgnls start_epoch 115 out=49b] v115'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4000 con 0x5590746fc400 2024-04-25T09:14:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.895+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:76 16.7 16:e0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fc800 2024-04-25T09:14:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.3 v2:172.21.15.175:6816/4078277957 10 ==== osd_op_reply(76 [pgnls start_epoch 115 out=105b] v115'9 uv9 ondisk = 1) v8 ==== 144+0+105 (crc 0 0 0) 0x5590738f4780 con 0x5590746fc800 2024-04-25T09:14:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:77 16.17 16:e8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fdc00 2024-04-25T09:14:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 22 ==== osd_op_reply(77 [pgnls start_epoch 115 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:78 16.f 16:f0000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fd800 2024-04-25T09:14:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.0 v2:172.21.15.175:6800/1093269849 16 ==== osd_op_reply(78 [pgnls start_epoch 115 out=73b] v115'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5590738f4000 con 0x5590746fd800 2024-04-25T09:14:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:79 16.1f 16:f8000000::::head [pgnls start_epoch 115 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33400 con 0x5590746fc400 2024-04-25T09:14:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.5 v2:172.21.15.177:6816/3311807078 11 ==== osd_op_reply(79 [pgnls start_epoch 115 out=101b] v115'9 uv8 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x5590738f4000 con 0x5590746fc400 2024-04-25T09:14:29.900 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 601.00000000 2024-04-25T09:14:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:80 16.10 16:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33800 con 0x5590746fdc00 2024-04-25T09:14:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 23 ==== osd_op_reply(80 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 602.00000000 2024-04-25T09:14:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:81 16.10 16:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33c00 con 0x5590746fdc00 2024-04-25T09:14:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 24 ==== osd_op_reply(81 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-25T09:14:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:82 16.10 16:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2a800 con 0x5590746fdc00 2024-04-25T09:14:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 25 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals out=1047b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+1047 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 600.00000000 2024-04-25T09:14:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:83 16.10 16:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2b800 con 0x5590746fdc00 2024-04-25T09:14:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 26 ==== osd_op_reply(83 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 603.00000000 2024-04-25T09:14:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:84 16.10 16:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2bc00 con 0x5590746fdc00 2024-04-25T09:14:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 27 ==== osd_op_reply(84 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-25T09:14:29.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T09:14:29.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 200.00000000 2024-04-25T09:14:29.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T09:14:29.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 200.00000001 2024-04-25T09:14:29.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T09:14:29.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 606.00000000 2024-04-25T09:14:29.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:85 16.14 16:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2ac00 con 0x5590746fd800 2024-04-25T09:14:29.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.0 v2:172.21.15.175:6800/1093269849 17 ==== osd_op_reply(85 606.00000000 [omap-get-vals out=5b] v0'0 uv36 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4000 con 0x5590746fd800 2024-04-25T09:14:29.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 607.00000000 2024-04-25T09:14:29.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:86 16.1c 16:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2a400 con 0x5590746fdc00 2024-04-25T09:14:29.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 28 ==== osd_op_reply(86 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-04-25T09:14:29.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T09:14:29.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 608.00000000 2024-04-25T09:14:29.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:87 16.e 16:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2b000 con 0x5590746fdc00 2024-04-25T09:14:29.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 29 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 10000000005.00000000 2024-04-25T09:14:29.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.899+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:88 16.9 16:9258b67d:::10000000005.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2b400 con 0x559073c2a000 2024-04-25T09:14:29.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.1 v2:172.21.15.175:6802/594808902 9 ==== osd_op_reply(88 10000000005.00000000 [omap-get-vals out=531b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+531 (crc 0 0 0) 0x5590738f4500 con 0x559073c2a000 2024-04-25T09:14:29.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 604.00000000 2024-04-25T09:14:29.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- osd_op(unknown.0.0:89 16.15 16:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1bc00 con 0x5590746fd800 2024-04-25T09:14:29.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.0 v2:172.21.15.175:6800/1093269849 18 ==== osd_op_reply(89 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4000 con 0x5590746fd800 2024-04-25T09:14:29.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 500.00000000 2024-04-25T09:14:29.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T09:14:29.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-25T09:14:29.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T09:14:29.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 605.00000000 2024-04-25T09:14:29.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- osd_op(unknown.0.0:90 16.1d 16:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1b800 con 0x5590746fdc00 2024-04-25T09:14:29.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.2 v2:172.21.15.175:6821/3247063283 30 ==== osd_op_reply(90 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4500 con 0x5590746fdc00 2024-04-25T09:14:29.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-25T09:14:29.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T09:14:29.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-25T09:14:29.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:91 16.13 16:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073b1b400 con 0x559073c2a000 2024-04-25T09:14:29.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.1 v2:172.21.15.175:6802/594808902 10 ==== osd_op_reply(91 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x5590738f4500 con 0x559073c2a000 2024-04-25T09:14:29.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-25T09:14:29.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T09:14:29.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 609.00000000 2024-04-25T09:14:29.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:92 16.7 16:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33800 con 0x5590746fc800 2024-04-25T09:14:29.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.3 v2:172.21.15.175:6816/4078277957 11 ==== osd_op_reply(92 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5590738f4780 con 0x5590746fc800 2024-04-25T09:14:29.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 10000000001.00000000 2024-04-25T09:14:29.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:93 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33c00 con 0x5590746fc800 2024-04-25T09:14:29.904 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.3 v2:172.21.15.175:6816/4078277957 12 ==== osd_op_reply(93 10000000001.00000000 [omap-get-vals out=1561b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+1561 (crc 0 0 0) 0x5590738f4780 con 0x5590746fc800 2024-04-25T09:14:29.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 20 datascan.scan_links: injected ino detected 2024-04-25T09:14:29.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 20 datascan.scan_links: adding 0x10000000003 for future processing to fix dnfirst 2024-04-25T09:14:29.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 400.00000000 2024-04-25T09:14:29.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T09:14:29.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-25T09:14:29.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T09:14:29.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-25T09:14:29.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- osd_op(unknown.0.0:94 16.1f 16:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c33000 con 0x5590746fc400 2024-04-25T09:14:29.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28faa00640 1 -- 172.21.15.175:0/4081930759 <== osd.5 v2:172.21.15.177:6816/3311807078 12 ==== osd_op_reply(94 1.00000000 [omap-get-vals out=524b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+524 (crc 0 0 0) 0x5590738f4000 con 0x5590746fc400 2024-04-25T09:14:29.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2024-04-25T09:14:29.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-25T09:14:29.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: processing 0 bad_nlink_inos 2024-04-25T09:14:29.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: processing 1 injected_inos 2024-04-25T09:14:29.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: handling injected_ino 0x10000000003 2024-04-25T09:14:29.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000001:bravo 2024-04-25T09:14:29.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:95 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c32000 con 0x5590746fc800 2024-04-25T09:14:29.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.3 v2:172.21.15.175:6816/4078277957 13 ==== osd_op_reply(95 10000000001.00000000 [omap-get-vals-by-keys out=506b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x5590738f4780 con 0x5590746fc800 2024-04-25T09:14:29.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-04-25T09:14:29.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 20 datascan.scan_links: first is now 2 2024-04-25T09:14:29.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- osd_op(unknown.0.0:96 16.7 16:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c32400 con 0x5590746fc800 2024-04-25T09:14:29.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.3 v2:172.21.15.175:6816/4078277957 14 ==== osd_op_reply(96 10000000001.00000000 [omap-set-vals] v115'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5590738f4780 con 0x5590746fc800 2024-04-25T09:14:29.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x10000000003 2024-04-25T09:14:29.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 10 datascan.scan_links: updating inotable 2024-04-25T09:14:29.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.903+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- osd_op(unknown.0.0:97 16.13 16:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2a800 con 0x559073c2a000 2024-04-25T09:14:29.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fbe00640 1 -- 172.21.15.175:0/4081930759 <== osd.1 v2:172.21.15.175:6802/594808902 11 ==== osd_op_reply(97 mds0_inotable [read 0~34 out=34b] v0'0 uv4 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x5590738f4500 con 0x559073c2a000 2024-04-25T09:14:29.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 10 datascan.scan_links: updating snaptable 2024-04-25T09:14:29.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- osd_op(unknown.0.0:98 16.d 16:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e115) v9 -- 0x559073c2b800 con 0x5590738e3000 2024-04-25T09:14:29.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 <== osd.6 v2:172.21.15.177:6822/4132808595 7 ==== osd_op_reply(98 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x5590738f4780 con 0x5590738e3000 2024-04-25T09:14:29.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x5590746fd800 msgr2=0x5590739a0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x5590746fd800 0x5590739a0100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x559073c2a000 msgr2=0x559073c08100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x559073c2a000 0x559073c08100 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x5590746fdc00 msgr2=0x559073c06000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x5590746fdc00 0x559073c06000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x5590746fc800 msgr2=0x559073c06580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 reap_dead start 2024-04-25T09:14:29.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x5590746fc800 0x559073c06580 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x559073b1b000 msgr2=0x559073c07080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x559073b1b000 0x559073c07080 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x5590746fc400 msgr2=0x559073c06b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x5590746fc400 0x559073c06b00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x5590738e3000 msgr2=0x559073c07600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x5590738e3000 0x559073c07600 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x5590738e3400 msgr2=0x559073c07b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x5590738e3400 0x559073c07b80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fb400640 1 -- 172.21.15.175:0/4081930759 reap_dead start 2024-04-25T09:14:29.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x559073b1ac00 msgr2=0x5590739a1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x559073b1ac00 0x5590739a1700 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x5590738c01e0 tx=0x55907389ff20 comp rx=0 tx=0).stop 2024-04-25T09:14:29.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590746fd000 msgr2=0x5590739a0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590746fd000 0x5590739a0c00 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x5590746f98f0 tx=0x559073b0cc00 comp rx=0 tx=0).stop 2024-04-25T09:14:29.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 shutdown_connections 2024-04-25T09:14:29.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x559073b1ac00 0x5590739a1700 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/4081930759 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590746fd000 0x5590739a0c00 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 >> 172.21.15.175:0/4081930759 conn(0x5590737e4c00 msgr2=0x559073813800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:29.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 shutdown_connections 2024-04-25T09:14:29.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/4081930759 wait complete. 2024-04-25T09:14:29.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/3171858806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590737e5400 msgr2=0x55907399eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:29.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/3171858806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590737e5400 0x55907399eb00 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x5590746238c0 tx=0x5590746f6120 comp rx=0 tx=0).stop 2024-04-25T09:14:29.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/3171858806 shutdown_connections 2024-04-25T09:14:29.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/3171858806 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5590737e5000 0x55907399f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/3171858806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5590737e5400 0x55907399eb00 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 --2- 172.21.15.175:0/3171858806 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5590737e5800 0x55907399e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:29.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/3171858806 >> 172.21.15.175:0/3171858806 conn(0x5590737e5c00 msgr2=0x559073813000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:29.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/3171858806 shutdown_connections 2024-04-25T09:14:29.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:29.907+0000 7f28fd3bd8c0 1 -- 172.21.15.175:0/3171858806 wait complete. 2024-04-25T09:14:29.910 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.131269, result: 2024-04-25T09:14:29.911 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:14:29.956 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:14:29.998 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2024-04-25T09:14:29.998 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2024-04-25T09:14:29.998 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:14:29.998 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2024-04-25T09:14:29.998 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:29.999 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2024-04-25T09:14:29.999 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:29.999 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2024-04-25T09:14:29.999 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:29.999 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2024-04-25T09:14:29.999 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2024-04-25T09:14:30.000 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.000 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2024-04-25T09:14:30.000 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2024-04-25T09:14:30.000 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.000 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:14:30.000 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2024-04-25T09:14:30.000 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.000 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:14:30.000 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:14:30.000 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.001 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2024-04-25T09:14:30.001 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.001 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2024-04-25T09:14:30.001 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2024-04-25T09:14:30.001 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:14:30.001 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:14:30.001 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2024-04-25T09:14:30.001 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:14:30.001 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2024-04-25T09:14:30.002 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:14:30.002 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:14:30.002 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2024-04-25T09:14:30.002 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.002 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:14:30.002 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.002 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2024-04-25T09:14:30.002 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.002 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2024-04-25T09:14:30.002 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.003 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2024-04-25T09:14:30.003 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2024-04-25T09:14:30.003 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2024-04-25T09:14:30.003 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.175,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]" 2024-04-25T09:14:30.003 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on skipped message = False 2024-04-25T09:14:30.003 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = 8caed986-ca08-40e2-b5a5-12e2aade6223 2024-04-25T09:14:30.003 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.003 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2024-04-25T09:14:30.003 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2024-04-25T09:14:30.003 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.003 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2024-04-25T09:14:30.003 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2024-04-25T09:14:30.003 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:14:30.004 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.004 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2024-04-25T09:14:30.004 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2024-04-25T09:14:30.004 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.004 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2024-04-25T09:14:30.004 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2024-04-25T09:14:30.004 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2024-04-25T09:14:30.004 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug trim objects = true 2024-04-25T09:14:30.004 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.004 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2024-04-25T09:14:30.004 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2024-04-25T09:14:30.004 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.004 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:14:30.004 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.004 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2024-04-25T09:14:30.005 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.005 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2024-04-25T09:14:30.005 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.005 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:14:30.005 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2024-04-25T09:14:30.005 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.005 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2024-04-25T09:14:30.005 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2024-04-25T09:14:30.005 INFO:teuthology.orchestra.run.smithi175.stdout: bdev async discard = True 2024-04-25T09:14:30.005 INFO:teuthology.orchestra.run.smithi175.stdout: bdev enable discard = True 2024-04-25T09:14:30.005 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore allocator = bitmap 2024-04-25T09:14:30.005 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2024-04-25T09:14:30.005 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2024-04-25T09:14:30.006 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 1/20 2024-04-25T09:14:30.006 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 1/20 2024-04-25T09:14:30.006 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:30.006 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2024-04-25T09:14:30.006 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 4/10 2024-04-25T09:14:30.006 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:14:30.006 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2024-04-25T09:14:30.006 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:14:30.007 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:14:30.007 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2024-04-25T09:14:30.007 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-04-25T09:14:30.007 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.007 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2024-04-25T09:14:30.007 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:30.007 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2024-04-25T09:14:30.007 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-25T09:14:30.007 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-25T09:14:30.007 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:14:30.007 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:14:30.007 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2024-04-25T09:14:30.007 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.007 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2024-04-25T09:14:30.008 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:30.008 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-25T09:14:30.008 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2024-04-25T09:14:30.008 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-25T09:14:30.008 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2024-04-25T09:14:30.008 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2024-04-25T09:14:30.008 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:14:30.008 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2024-04-25T09:14:30.008 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2024-04-25T09:14:30.008 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:14:30.008 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.008 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:14:30.009 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:14:30.009 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:14:30.009 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.009 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:14:30.009 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:14:30.009 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:14:30.009 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.009 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2024-04-25T09:14:30.009 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:14:30.009 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.009 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:14:30.009 INFO:teuthology.orchestra.run.smithi175.stdout: mon op complaint time = 120 2024-04-25T09:14:30.009 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.009 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2024-04-25T09:14:30.010 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2024-04-25T09:14:30.010 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2024-04-25T09:14:30.010 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2024-04-25T09:14:30.010 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:14:30.010 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:14:30.010 INFO:teuthology.orchestra.run.smithi175.stdout: client mount timeout = 600 2024-04-25T09:14:30.010 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2024-04-25T09:14:30.010 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:30.010 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = "" 2024-04-25T09:14:30.010 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-04-25T09:14:30.010 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-04-25T09:14:30.010 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2024-04-25T09:14:30.010 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2024-04-25T09:14:30.011 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2024-04-25T09:14:30.011 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-04-25T09:14:30.011 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2024-04-25T09:14:30.011 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-04-25T09:14:30.011 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2024-04-25T09:14:30.011 INFO:teuthology.orchestra.run.smithi175.stdout:[mds] 2024-04-25T09:14:30.011 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds = 20 2024-04-25T09:14:30.011 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds balancer = 20 2024-04-25T09:14:30.011 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:30.011 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug frag = True 2024-04-25T09:14:30.011 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug scatterstat = False 2024-04-25T09:14:30.011 INFO:teuthology.orchestra.run.smithi175.stdout: mds op complaint time = 180 2024-04-25T09:14:30.011 INFO:teuthology.orchestra.run.smithi175.stdout: mds verify scatter = True 2024-04-25T09:14:30.011 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-04-25T09:14:30.012 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-04-25T09:14:30.012 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-04-25T09:14:30.012 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2024-04-25T09:14:30.012 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2024-04-25T09:14:30.013 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:14:30.013 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2024-04-25T09:14:30.013 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.013 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2024-04-25T09:14:30.013 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.013 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2024-04-25T09:14:30.013 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.013 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2024-04-25T09:14:30.013 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2024-04-25T09:14:30.013 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.013 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2024-04-25T09:14:30.013 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2024-04-25T09:14:30.013 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.013 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:14:30.013 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2024-04-25T09:14:30.013 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.014 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:14:30.014 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:14:30.014 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.014 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2024-04-25T09:14:30.014 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.014 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2024-04-25T09:14:30.014 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2024-04-25T09:14:30.014 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:14:30.014 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:14:30.014 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2024-04-25T09:14:30.014 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:14:30.014 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2024-04-25T09:14:30.015 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:14:30.015 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:14:30.015 INFO:teuthology.orchestra.run.smithi177.stdout: mon_allow_pool_size_one = true 2024-04-25T09:14:30.015 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.015 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:14:30.015 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.015 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2024-04-25T09:14:30.015 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.015 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2024-04-25T09:14:30.015 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.015 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2024-04-25T09:14:30.015 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2024-04-25T09:14:30.015 INFO:teuthology.orchestra.run.smithi177.stdout: mon health detail to clog = false 2024-04-25T09:14:30.015 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = "172.21.15.175,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]" 2024-04-25T09:14:30.015 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on skipped message = False 2024-04-25T09:14:30.016 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = 8caed986-ca08-40e2-b5a5-12e2aade6223 2024-04-25T09:14:30.016 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.016 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2024-04-25T09:14:30.016 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2024-04-25T09:14:30.016 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.016 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2024-04-25T09:14:30.016 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2024-04-25T09:14:30.016 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:14:30.016 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.016 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2024-04-25T09:14:30.016 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2024-04-25T09:14:30.016 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2024-04-25T09:14:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2024-04-25T09:14:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2024-04-25T09:14:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug trim objects = true 2024-04-25T09:14:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2024-04-25T09:14:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2024-04-25T09:14:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:14:30.017 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2024-04-25T09:14:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2024-04-25T09:14:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:14:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2024-04-25T09:14:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2024-04-25T09:14:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2024-04-25T09:14:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: bdev async discard = True 2024-04-25T09:14:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: bdev enable discard = True 2024-04-25T09:14:30.018 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore allocator = bitmap 2024-04-25T09:14:30.019 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2024-04-25T09:14:30.019 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2024-04-25T09:14:30.019 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 1/20 2024-04-25T09:14:30.019 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 1/20 2024-04-25T09:14:30.019 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:30.019 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 20 2024-04-25T09:14:30.019 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 4/10 2024-04-25T09:14:30.019 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:14:30.019 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2024-04-25T09:14:30.019 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:14:30.019 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:14:30.019 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = bluestore 2024-04-25T09:14:30.020 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2024-04-25T09:14:30.020 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.020 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2024-04-25T09:14:30.020 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:30.020 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2024-04-25T09:14:30.020 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-04-25T09:14:30.020 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-04-25T09:14:30.020 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:14:30.020 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:14:30.020 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2024-04-25T09:14:30.020 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.020 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2024-04-25T09:14:30.020 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:30.020 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-04-25T09:14:30.020 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2024-04-25T09:14:30.020 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-04-25T09:14:30.021 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2024-04-25T09:14:30.021 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2024-04-25T09:14:30.021 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:14:30.021 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2024-04-25T09:14:30.021 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2024-04-25T09:14:30.021 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:14:30.021 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.021 INFO:teuthology.orchestra.run.smithi177.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:14:30.021 INFO:teuthology.orchestra.run.smithi177.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:14:30.021 INFO:teuthology.orchestra.run.smithi177.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:14:30.021 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.021 INFO:teuthology.orchestra.run.smithi177.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:14:30.021 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:14:30.022 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:14:30.022 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.022 INFO:teuthology.orchestra.run.smithi177.stdout: # 1m isn't quite enough 2024-04-25T09:14:30.022 INFO:teuthology.orchestra.run.smithi177.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:14:30.022 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.022 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:14:30.022 INFO:teuthology.orchestra.run.smithi177.stdout: mon op complaint time = 120 2024-04-25T09:14:30.022 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.022 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2024-04-25T09:14:30.022 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2024-04-25T09:14:30.022 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2024-04-25T09:14:30.022 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2024-04-25T09:14:30.022 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:14:30.022 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:14:30.023 INFO:teuthology.orchestra.run.smithi177.stdout: client mount timeout = 600 2024-04-25T09:14:30.023 INFO:teuthology.orchestra.run.smithi177.stdout: debug client = 20 2024-04-25T09:14:30.023 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:30.023 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = "" 2024-04-25T09:14:30.023 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2024-04-25T09:14:30.023 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2024-04-25T09:14:30.023 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2024-04-25T09:14:30.023 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.b] 2024-04-25T09:14:30.023 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.c] 2024-04-25T09:14:30.023 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2024-04-25T09:14:30.023 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2024-04-25T09:14:30.023 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2024-04-25T09:14:30.023 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2024-04-25T09:14:30.023 INFO:teuthology.orchestra.run.smithi177.stdout:[mds] 2024-04-25T09:14:30.023 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds = 20 2024-04-25T09:14:30.024 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds balancer = 20 2024-04-25T09:14:30.024 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:30.024 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug frag = True 2024-04-25T09:14:30.024 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug scatterstat = False 2024-04-25T09:14:30.024 INFO:teuthology.orchestra.run.smithi177.stdout: mds op complaint time = 180 2024-04-25T09:14:30.024 INFO:teuthology.orchestra.run.smithi177.stdout: mds verify scatter = True 2024-04-25T09:14:30.024 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2024-04-25T09:14:30.024 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2024-04-25T09:14:30.024 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2024-04-25T09:14:30.026 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:14:30.071 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:14:30.114 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2024-04-25T09:14:30.114 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2024-04-25T09:14:30.114 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:14:30.114 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2024-04-25T09:14:30.114 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.114 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2024-04-25T09:14:30.114 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2024-04-25T09:14:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2024-04-25T09:14:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2024-04-25T09:14:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2024-04-25T09:14:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2024-04-25T09:14:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:14:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2024-04-25T09:14:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:14:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:14:30.115 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: mon_allow_pool_size_one = true 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.116 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2024-04-25T09:14:30.117 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.117 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2024-04-25T09:14:30.117 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.117 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2024-04-25T09:14:30.117 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2024-04-25T09:14:30.117 INFO:teuthology.orchestra.run.smithi177.stdout: mon health detail to clog = false 2024-04-25T09:14:30.117 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = "172.21.15.175,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]" 2024-04-25T09:14:30.117 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on skipped message = False 2024-04-25T09:14:30.117 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = 8caed986-ca08-40e2-b5a5-12e2aade6223 2024-04-25T09:14:30.117 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.117 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2024-04-25T09:14:30.117 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2024-04-25T09:14:30.117 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.118 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2024-04-25T09:14:30.118 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2024-04-25T09:14:30.118 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:14:30.118 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.118 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2024-04-25T09:14:30.118 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2024-04-25T09:14:30.118 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.118 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2024-04-25T09:14:30.118 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2024-04-25T09:14:30.118 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2024-04-25T09:14:30.118 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug trim objects = true 2024-04-25T09:14:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2024-04-25T09:14:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2024-04-25T09:14:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:14:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2024-04-25T09:14:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2024-04-25T09:14:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:14:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2024-04-25T09:14:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2024-04-25T09:14:30.119 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2024-04-25T09:14:30.120 INFO:teuthology.orchestra.run.smithi177.stdout: bdev async discard = True 2024-04-25T09:14:30.120 INFO:teuthology.orchestra.run.smithi177.stdout: bdev enable discard = True 2024-04-25T09:14:30.120 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore allocator = bitmap 2024-04-25T09:14:30.120 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2024-04-25T09:14:30.120 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2024-04-25T09:14:30.120 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 1/20 2024-04-25T09:14:30.120 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 1/20 2024-04-25T09:14:30.120 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:30.120 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 20 2024-04-25T09:14:30.120 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 4/10 2024-04-25T09:14:30.120 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:14:30.120 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2024-04-25T09:14:30.121 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:14:30.121 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:14:30.121 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = bluestore 2024-04-25T09:14:30.121 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2024-04-25T09:14:30.121 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.121 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2024-04-25T09:14:30.121 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:30.121 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2024-04-25T09:14:30.121 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-04-25T09:14:30.121 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-04-25T09:14:30.121 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:14:30.122 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:14:30.122 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2024-04-25T09:14:30.122 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.122 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2024-04-25T09:14:30.122 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:30.122 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-04-25T09:14:30.122 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2024-04-25T09:14:30.122 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-04-25T09:14:30.122 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2024-04-25T09:14:30.122 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2024-04-25T09:14:30.122 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:14:30.122 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2024-04-25T09:14:30.122 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2024-04-25T09:14:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:14:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:14:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:14:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:14:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:14:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:14:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:14:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: # 1m isn't quite enough 2024-04-25T09:14:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:14:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.123 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:14:30.124 INFO:teuthology.orchestra.run.smithi177.stdout: mon op complaint time = 120 2024-04-25T09:14:30.124 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-04-25T09:14:30.124 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2024-04-25T09:14:30.124 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2024-04-25T09:14:30.124 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2024-04-25T09:14:30.124 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2024-04-25T09:14:30.124 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:14:30.124 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:14:30.124 INFO:teuthology.orchestra.run.smithi177.stdout: client mount timeout = 600 2024-04-25T09:14:30.124 INFO:teuthology.orchestra.run.smithi177.stdout: debug client = 20 2024-04-25T09:14:30.124 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:30.124 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = "" 2024-04-25T09:14:30.124 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2024-04-25T09:14:30.124 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2024-04-25T09:14:30.124 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2024-04-25T09:14:30.125 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.b] 2024-04-25T09:14:30.125 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.c] 2024-04-25T09:14:30.125 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2024-04-25T09:14:30.125 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2024-04-25T09:14:30.125 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2024-04-25T09:14:30.125 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2024-04-25T09:14:30.125 INFO:teuthology.orchestra.run.smithi177.stdout:[mds] 2024-04-25T09:14:30.125 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds = 20 2024-04-25T09:14:30.125 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds balancer = 20 2024-04-25T09:14:30.125 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-04-25T09:14:30.125 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug frag = True 2024-04-25T09:14:30.125 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug scatterstat = True 2024-04-25T09:14:30.125 INFO:teuthology.orchestra.run.smithi177.stdout: mds op complaint time = 180 2024-04-25T09:14:30.125 INFO:teuthology.orchestra.run.smithi177.stdout: mds verify scatter = True 2024-04-25T09:14:30.125 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2024-04-25T09:14:30.126 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2024-04-25T09:14:30.126 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2024-04-25T09:14:30.127 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2024-04-25T09:14:30.127 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2024-04-25T09:14:30.127 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:14:30.128 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2024-04-25T09:14:30.128 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.128 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2024-04-25T09:14:30.128 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.128 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2024-04-25T09:14:30.128 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.128 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2024-04-25T09:14:30.128 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2024-04-25T09:14:30.128 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.128 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2024-04-25T09:14:30.128 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2024-04-25T09:14:30.128 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.128 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:14:30.128 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2024-04-25T09:14:30.128 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.129 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:14:30.129 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:14:30.129 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.129 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2024-04-25T09:14:30.129 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.129 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2024-04-25T09:14:30.129 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2024-04-25T09:14:30.129 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:14:30.129 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:14:30.129 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2024-04-25T09:14:30.129 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:14:30.129 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2024-04-25T09:14:30.130 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:14:30.130 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:14:30.130 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2024-04-25T09:14:30.130 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.130 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:14:30.130 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.130 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2024-04-25T09:14:30.130 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.130 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2024-04-25T09:14:30.130 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.130 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2024-04-25T09:14:30.130 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2024-04-25T09:14:30.130 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2024-04-25T09:14:30.131 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.175,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]" 2024-04-25T09:14:30.131 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on skipped message = False 2024-04-25T09:14:30.131 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = 8caed986-ca08-40e2-b5a5-12e2aade6223 2024-04-25T09:14:30.131 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.131 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2024-04-25T09:14:30.131 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2024-04-25T09:14:30.131 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.131 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2024-04-25T09:14:30.131 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2024-04-25T09:14:30.132 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:14:30.132 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.132 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2024-04-25T09:14:30.132 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2024-04-25T09:14:30.132 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.132 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2024-04-25T09:14:30.132 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2024-04-25T09:14:30.132 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2024-04-25T09:14:30.132 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug trim objects = true 2024-04-25T09:14:30.132 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.132 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2024-04-25T09:14:30.132 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2024-04-25T09:14:30.132 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.132 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:14:30.132 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.133 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2024-04-25T09:14:30.133 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.133 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2024-04-25T09:14:30.133 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.133 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:14:30.133 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2024-04-25T09:14:30.133 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.133 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2024-04-25T09:14:30.133 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2024-04-25T09:14:30.133 INFO:teuthology.orchestra.run.smithi175.stdout: bdev async discard = True 2024-04-25T09:14:30.133 INFO:teuthology.orchestra.run.smithi175.stdout: bdev enable discard = True 2024-04-25T09:14:30.133 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore allocator = bitmap 2024-04-25T09:14:30.133 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2024-04-25T09:14:30.133 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2024-04-25T09:14:30.133 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 1/20 2024-04-25T09:14:30.134 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 1/20 2024-04-25T09:14:30.134 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:30.134 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2024-04-25T09:14:30.134 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 4/10 2024-04-25T09:14:30.134 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:14:30.134 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2024-04-25T09:14:30.134 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:14:30.134 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:14:30.134 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2024-04-25T09:14:30.134 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-04-25T09:14:30.134 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.134 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2024-04-25T09:14:30.134 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:30.135 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2024-04-25T09:14:30.135 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-25T09:14:30.135 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-25T09:14:30.135 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:14:30.135 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:14:30.135 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2024-04-25T09:14:30.135 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.135 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2024-04-25T09:14:30.135 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:30.135 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-25T09:14:30.135 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2024-04-25T09:14:30.135 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-25T09:14:30.135 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2024-04-25T09:14:30.135 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2024-04-25T09:14:30.135 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:14:30.135 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2024-04-25T09:14:30.136 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2024-04-25T09:14:30.136 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:14:30.136 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.136 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:14:30.136 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:14:30.136 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:14:30.136 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.136 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:14:30.136 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:14:30.136 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:14:30.136 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.136 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2024-04-25T09:14:30.136 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:14:30.136 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.137 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:14:30.137 INFO:teuthology.orchestra.run.smithi175.stdout: mon op complaint time = 120 2024-04-25T09:14:30.137 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:30.137 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2024-04-25T09:14:30.137 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2024-04-25T09:14:30.137 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2024-04-25T09:14:30.137 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2024-04-25T09:14:30.137 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:14:30.137 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:14:30.137 INFO:teuthology.orchestra.run.smithi175.stdout: client mount timeout = 600 2024-04-25T09:14:30.137 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2024-04-25T09:14:30.137 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:30.137 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = "" 2024-04-25T09:14:30.137 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-04-25T09:14:30.137 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-04-25T09:14:30.138 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2024-04-25T09:14:30.138 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2024-04-25T09:14:30.138 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2024-04-25T09:14:30.138 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-04-25T09:14:30.138 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2024-04-25T09:14:30.138 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-04-25T09:14:30.138 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2024-04-25T09:14:30.138 INFO:teuthology.orchestra.run.smithi175.stdout:[mds] 2024-04-25T09:14:30.138 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds = 20 2024-04-25T09:14:30.138 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds balancer = 20 2024-04-25T09:14:30.138 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-25T09:14:30.138 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug frag = True 2024-04-25T09:14:30.138 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug scatterstat = True 2024-04-25T09:14:30.138 INFO:teuthology.orchestra.run.smithi175.stdout: mds op complaint time = 180 2024-04-25T09:14:30.139 INFO:teuthology.orchestra.run.smithi175.stdout: mds verify scatter = True 2024-04-25T09:14:30.139 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-04-25T09:14:30.139 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-04-25T09:14:30.139 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-04-25T09:14:30.142 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T09:14:30.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.339+0000 7fd65a200640 1 Processor -- start 2024-04-25T09:14:30.327 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.339+0000 7fd65a200640 1 -- start start 2024-04-25T09:14:30.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.339+0000 7fd65a200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd654145250 0x7fd6540cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.339+0000 7fd65a200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd6540ce970 0x7fd6540cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.339+0000 7fd65a200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6540cfd10 con 0x7fd6541600a0 2024-04-25T09:14:30.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.339+0000 7fd65a200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd65415f650 con 0x7fd6540ce970 2024-04-25T09:14:30.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.339+0000 7fd65a200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540cfff0 con 0x7fd654145250 2024-04-25T09:14:30.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.339+0000 7fd64aa00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd6541600a0 0x7fd6540cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:47732/0 (socket says 172.21.15.175:47732) 2024-04-25T09:14:30.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.339+0000 7fd64aa00640 1 -- 172.21.15.175:0/3242631880 learned_addr learned my addr 172.21.15.175:0/3242631880 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:30.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.339+0000 7fd653400640 1 --2- 172.21.15.175:0/3242631880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd654145250 0x7fd6540cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.339+0000 7fd653e00640 1 --2- 172.21.15.175:0/3242631880 >> v2:172.21.15.177:3300/0 conn(0x7fd6540ce970 0x7fd6540cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.343+0000 7fd652a00640 1 -- 172.21.15.175:0/3242631880 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987623549 0 0) 0x7fd6540cfd10 con 0x7fd6541600a0 2024-04-25T09:14:30.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.343+0000 7fd652a00640 1 -- 172.21.15.175:0/3242631880 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd638003530 con 0x7fd6541600a0 2024-04-25T09:14:30.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.343+0000 7fd653400640 1 -- 172.21.15.175:0/3242631880 >> v2:172.21.15.177:3300/0 conn(0x7fd6540ce970 msgr2=0x7fd6540cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:30.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.343+0000 7fd653400640 1 --2- 172.21.15.175:0/3242631880 >> v2:172.21.15.177:3300/0 conn(0x7fd6540ce970 0x7fd6540cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.343+0000 7fd653400640 1 -- 172.21.15.175:0/3242631880 >> v1:172.21.15.175:6789/0 conn(0x7fd6541600a0 legacy=0x7fd6540cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.330 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.343+0000 7fd653400640 1 -- 172.21.15.175:0/3242631880 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65415f8a0 con 0x7fd654145250 2024-04-25T09:14:30.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.343+0000 7fd653400640 1 --2- 172.21.15.175:0/3242631880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd654145250 0x7fd6540cf6b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd6440097c0 tx=0x7fd64401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5879fbf0ff308804 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:30.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.343+0000 7fd652a00640 1 -- 172.21.15.175:0/3242631880 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6440ab600 con 0x7fd654145250 2024-04-25T09:14:30.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.343+0000 7fd652a00640 1 -- 172.21.15.175:0/3242631880 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6440b0070 con 0x7fd654145250 2024-04-25T09:14:30.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.343+0000 7fd652a00640 1 -- 172.21.15.175:0/3242631880 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6440ab9c0 con 0x7fd654145250 2024-04-25T09:14:30.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd65a200640 1 -- 172.21.15.175:0/3242631880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd654145250 msgr2=0x7fd6540cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.333 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd65a200640 1 --2- 172.21.15.175:0/3242631880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd654145250 0x7fd6540cf6b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd6440097c0 tx=0x7fd64401c3e0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd65a200640 1 -- 172.21.15.175:0/3242631880 shutdown_connections 2024-04-25T09:14:30.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd65a200640 1 --2- 172.21.15.175:0/3242631880 >> v2:172.21.15.177:3300/0 conn(0x7fd6540ce970 0x7fd6540cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd65a200640 1 --2- 172.21.15.175:0/3242631880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd654145250 0x7fd6540cf6b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd65a200640 1 -- 172.21.15.175:0/3242631880 >> 172.21.15.175:0/3242631880 conn(0x7fd65406ac50 msgr2=0x7fd65406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:30.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd65a200640 1 -- 172.21.15.175:0/3242631880 shutdown_connections 2024-04-25T09:14:30.334 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd65a200640 1 -- 172.21.15.175:0/3242631880 wait complete. 2024-04-25T09:14:30.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd65a200640 1 Processor -- start 2024-04-25T09:14:30.335 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd65a200640 1 -- start start 2024-04-25T09:14:30.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd65a200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6540ce970 0x7fd654140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd65a200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd654145250 0x7fd6540b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd65a200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6541600a0 0x7fd6540b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd65a200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd654160600 con 0x7fd6540ce970 2024-04-25T09:14:30.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd65a200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd654160480 con 0x7fd6541600a0 2024-04-25T09:14:30.337 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd65a200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65415c870 con 0x7fd654145250 2024-04-25T09:14:30.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd653400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6540ce970 0x7fd654140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd653400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6540ce970 0x7fd654140bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48612/0 (socket says 172.21.15.175:48612) 2024-04-25T09:14:30.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd653400640 1 -- 172.21.15.175:0/2390592742 learned_addr learned my addr 172.21.15.175:0/2390592742 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:30.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd64aa00640 1 --2- 172.21.15.175:0/2390592742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd654145250 0x7fd6540b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd653e00640 1 --2- 172.21.15.175:0/2390592742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6541600a0 0x7fd6540b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd653400640 1 -- 172.21.15.175:0/2390592742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd654145250 msgr2=0x7fd6540b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd653400640 1 --2- 172.21.15.175:0/2390592742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd654145250 0x7fd6540b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd653400640 1 -- 172.21.15.175:0/2390592742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6541600a0 msgr2=0x7fd6540b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd653400640 1 --2- 172.21.15.175:0/2390592742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6541600a0 0x7fd6540b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd653400640 1 -- 172.21.15.175:0/2390592742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65415a9e0 con 0x7fd6540ce970 2024-04-25T09:14:30.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd653e00640 1 --2- 172.21.15.175:0/2390592742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6541600a0 0x7fd6540b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:30.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd64aa00640 1 --2- 172.21.15.175:0/2390592742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd654145250 0x7fd6540b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:30.338 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd653400640 1 --2- 172.21.15.175:0/2390592742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6540ce970 0x7fd654140bc0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fd6440ad040 tx=0x7fd64401ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:30.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd64be00640 1 -- 172.21.15.175:0/2390592742 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6440bf410 con 0x7fd6540ce970 2024-04-25T09:14:30.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd64be00640 1 -- 172.21.15.175:0/2390592742 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6440bf5b0 con 0x7fd6540ce970 2024-04-25T09:14:30.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.347+0000 7fd65a200640 1 -- 172.21.15.175:0/2390592742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65415acc0 con 0x7fd6540ce970 2024-04-25T09:14:30.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.351+0000 7fd64be00640 1 -- 172.21.15.175:0/2390592742 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6440bf9a0 con 0x7fd6540ce970 2024-04-25T09:14:30.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.351+0000 7fd65a200640 1 -- 172.21.15.175:0/2390592742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd654141100 con 0x7fd6540ce970 2024-04-25T09:14:30.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.351+0000 7fd65a200640 1 -- 172.21.15.175:0/2390592742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd654075160 con 0x7fd6540ce970 2024-04-25T09:14:30.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.351+0000 7fd64be00640 1 -- 172.21.15.175:0/2390592742 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd6440bd020 con 0x7fd6540ce970 2024-04-25T09:14:30.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.351+0000 7fd64be00640 1 --2- 172.21.15.175:0/2390592742 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd630066f60 0x7fd630069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:30.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.351+0000 7fd64be00640 1 -- 172.21.15.175:0/2390592742 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fd64411f690 con 0x7fd6540ce970 2024-04-25T09:14:30.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.351+0000 7fd64aa00640 1 --2- 172.21.15.175:0/2390592742 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd630066f60 0x7fd630069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:30.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.351+0000 7fd64aa00640 1 --2- 172.21.15.175:0/2390592742 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd630066f60 0x7fd630069420 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd654140b10 tx=0x7fd63c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:30.344 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.355+0000 7fd64be00640 1 -- 172.21.15.175:0/2390592742 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd644016090 con 0x7fd6540ce970 2024-04-25T09:14:30.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:30.543+0000 7fd65a200640 1 -- 172.21.15.175:0/2390592742 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fd654067cb0 con 0x7fd6540ce970 2024-04-25T09:14:30.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.003+0000 7fd64be00640 1 -- 172.21.15.175:0/2390592742 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v102) v1 ==== 162+0+0 (secure 0 0 0) 0x7fd6440f0700 con 0x7fd6540ce970 2024-04-25T09:14:30.992 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T09:14:30.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.007+0000 7fd65a200640 1 -- 172.21.15.175:0/2390592742 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd630066f60 msgr2=0x7fd630069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.007+0000 7fd65a200640 1 --2- 172.21.15.175:0/2390592742 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd630066f60 0x7fd630069420 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd654140b10 tx=0x7fd63c009040 comp rx=0 tx=0).stop 2024-04-25T09:14:30.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.007+0000 7fd65a200640 1 -- 172.21.15.175:0/2390592742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6540ce970 msgr2=0x7fd654140bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:30.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.007+0000 7fd65a200640 1 --2- 172.21.15.175:0/2390592742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6540ce970 0x7fd654140bc0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fd6440ad040 tx=0x7fd64401ac20 comp rx=0 tx=0).stop 2024-04-25T09:14:30.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.007+0000 7fd65a200640 1 -- 172.21.15.175:0/2390592742 shutdown_connections 2024-04-25T09:14:30.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.007+0000 7fd65a200640 1 --2- 172.21.15.175:0/2390592742 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd630066f60 0x7fd630069420 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.007+0000 7fd65a200640 1 --2- 172.21.15.175:0/2390592742 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6541600a0 0x7fd6540b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.007+0000 7fd65a200640 1 --2- 172.21.15.175:0/2390592742 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd654145250 0x7fd6540b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.007+0000 7fd65a200640 1 --2- 172.21.15.175:0/2390592742 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6540ce970 0x7fd654140bc0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:30.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.007+0000 7fd65a200640 1 -- 172.21.15.175:0/2390592742 >> 172.21.15.175:0/2390592742 conn(0x7fd65406ac50 msgr2=0x7fd654165bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:30.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.007+0000 7fd65a200640 1 -- 172.21.15.175:0/2390592742 shutdown_connections 2024-04-25T09:14:30.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.007+0000 7fd65a200640 1 -- 172.21.15.175:0/2390592742 wait complete. 2024-04-25T09:14:31.019 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:31.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.167+0000 7f72b5200640 1 Processor -- start 2024-04-25T09:14:31.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.167+0000 7f72b5200640 1 -- start start 2024-04-25T09:14:31.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.171+0000 7f72b5200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72b00cd520 0x7f72b006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.171+0000 7f72b5200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b00cda00 con 0x7f72b015a900 2024-04-25T09:14:31.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.171+0000 7f72b5200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b00cdce0 con 0x7f72b00cf560 2024-04-25T09:14:31.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.171+0000 7f72b5200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b015bcf0 con 0x7f72b00cd520 2024-04-25T09:14:31.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.171+0000 7f72ade00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f72b015a900 0x7f72b00ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:47734/0 (socket says 172.21.15.175:47734) 2024-04-25T09:14:31.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.171+0000 7f72ade00640 1 -- 172.21.15.175:0/2051881333 learned_addr learned my addr 172.21.15.175:0/2051881333 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:31.158 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.171+0000 7f72a5400640 1 --2- 172.21.15.175:0/2051881333 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72b00cd520 0x7f72b006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.171+0000 7f72ad400640 1 -- 172.21.15.175:0/2051881333 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952736767 0 0) 0x7f72b00cda00 con 0x7f72b015a900 2024-04-25T09:14:31.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.171+0000 7f72ad400640 1 -- 172.21.15.175:0/2051881333 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7294003530 con 0x7f72b015a900 2024-04-25T09:14:31.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.171+0000 7f72ad400640 1 -- 172.21.15.175:0/2051881333 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202601171 0 0) 0x7f72b00cdce0 con 0x7f72b00cf560 2024-04-25T09:14:31.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.171+0000 7f72a5400640 1 -- 172.21.15.175:0/2051881333 >> v1:172.21.15.177:6789/0 conn(0x7f72b00cf560 legacy=0x7f72b015bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:31.159 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.171+0000 7f72a5400640 1 -- 172.21.15.175:0/2051881333 >> v1:172.21.15.175:6789/0 conn(0x7f72b015a900 legacy=0x7f72b00ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:31.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.171+0000 7f72a5400640 1 -- 172.21.15.175:0/2051881333 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00cdfc0 con 0x7f72b00cd520 2024-04-25T09:14:31.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.175+0000 7f72a5400640 1 --2- 172.21.15.175:0/2051881333 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72b00cd520 0x7f72b006e150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f72980097f0 tx=0x7f729801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc774b65c614701e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:31.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.175+0000 7f72ad400640 1 -- 172.21.15.175:0/2051881333 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72980b0070 con 0x7f72b00cd520 2024-04-25T09:14:31.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.175+0000 7f72ad400640 1 -- 172.21.15.175:0/2051881333 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72980ab600 con 0x7f72b00cd520 2024-04-25T09:14:31.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.175+0000 7f72ad400640 1 -- 172.21.15.175:0/2051881333 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72980ab9b0 con 0x7f72b00cd520 2024-04-25T09:14:31.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.175+0000 7f72b5200640 1 -- 172.21.15.175:0/2051881333 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72b00cd520 msgr2=0x7f72b006e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:31.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.175+0000 7f72b5200640 1 --2- 172.21.15.175:0/2051881333 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72b00cd520 0x7f72b006e150 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f72980097f0 tx=0x7f729801c4e0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.175+0000 7f72b5200640 1 -- 172.21.15.175:0/2051881333 shutdown_connections 2024-04-25T09:14:31.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.175+0000 7f72b5200640 1 --2- 172.21.15.175:0/2051881333 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72b00cd520 0x7f72b006e150 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.175+0000 7f72b5200640 1 -- 172.21.15.175:0/2051881333 >> 172.21.15.175:0/2051881333 conn(0x7f72b0067150 msgr2=0x7f72b006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:31.163 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.175+0000 7f72b5200640 1 -- 172.21.15.175:0/2051881333 shutdown_connections 2024-04-25T09:14:31.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.175+0000 7f72b5200640 1 -- 172.21.15.175:0/2051881333 wait complete. 2024-04-25T09:14:31.164 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.175+0000 7f72b5200640 1 Processor -- start 2024-04-25T09:14:31.165 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.175+0000 7f72b5200640 1 -- start start 2024-04-25T09:14:31.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72b5200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72b00cf560 0x7f72b014f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72b5200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72b015a900 0x7f72b00b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72b5200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72b00b0950 0x7f72b01f4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72b5200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b006d530 con 0x7f72b00b0950 2024-04-25T09:14:31.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72b5200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b006d3b0 con 0x7f72b015a900 2024-04-25T09:14:31.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72b5200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b0168c20 con 0x7f72b00cf560 2024-04-25T09:14:31.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72ae800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72b00b0950 0x7f72b01f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72ae800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72b00b0950 0x7f72b01f4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48622/0 (socket says 172.21.15.175:48622) 2024-04-25T09:14:31.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72ae800640 1 -- 172.21.15.175:0/1173353958 learned_addr learned my addr 172.21.15.175:0/1173353958 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:31.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72a5400640 1 --2- 172.21.15.175:0/1173353958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72b015a900 0x7f72b00b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72ade00640 1 --2- 172.21.15.175:0/1173353958 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72b00cf560 0x7f72b014f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72ae800640 1 -- 172.21.15.175:0/1173353958 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72b00cf560 msgr2=0x7f72b014f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:31.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72ae800640 1 --2- 172.21.15.175:0/1173353958 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72b00cf560 0x7f72b014f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72ae800640 1 -- 172.21.15.175:0/1173353958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72b015a900 msgr2=0x7f72b00b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:31.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72ae800640 1 --2- 172.21.15.175:0/1173353958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72b015a900 0x7f72b00b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72ae800640 1 -- 172.21.15.175:0/1173353958 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00b1140 con 0x7f72b00b0950 2024-04-25T09:14:31.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72ade00640 1 --2- 172.21.15.175:0/1173353958 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72b00cf560 0x7f72b014f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:31.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72ae800640 1 --2- 172.21.15.175:0/1173353958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72b00b0950 0x7f72b01f4d60 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f72a800c7b0 tx=0x7f72a800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:31.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72a6a00640 1 -- 172.21.15.175:0/1173353958 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a8003db0 con 0x7f72b00b0950 2024-04-25T09:14:31.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72a6a00640 1 -- 172.21.15.175:0/1173353958 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a8005070 con 0x7f72b00b0950 2024-04-25T09:14:31.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72a6a00640 1 -- 172.21.15.175:0/1173353958 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a8005460 con 0x7f72b00b0950 2024-04-25T09:14:31.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72b5200640 1 -- 172.21.15.175:0/1173353958 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b00b1420 con 0x7f72b00b0950 2024-04-25T09:14:31.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72b5200640 1 -- 172.21.15.175:0/1173353958 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b00b19e0 con 0x7f72b00b0950 2024-04-25T09:14:31.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72b5200640 1 -- 172.21.15.175:0/1173353958 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b0074a60 con 0x7f72b00b0950 2024-04-25T09:14:31.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.179+0000 7f72a6a00640 1 -- 172.21.15.175:0/1173353958 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f72a8005600 con 0x7f72b00b0950 2024-04-25T09:14:31.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.183+0000 7f72a6a00640 1 --2- 172.21.15.175:0/1173353958 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f728c066f60 0x7f728c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:31.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.183+0000 7f72a6a00640 1 -- 172.21.15.175:0/1173353958 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f72a8084f70 con 0x7f72b00b0950 2024-04-25T09:14:31.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.183+0000 7f72ade00640 1 --2- 172.21.15.175:0/1173353958 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f728c066f60 0x7f728c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:31.171 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.183+0000 7f72ade00640 1 --2- 172.21.15.175:0/1173353958 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f728c066f60 0x7f728c069420 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f72a0005890 tx=0x7f72a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:31.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.187+0000 7f72a6a00640 1 -- 172.21.15.175:0/1173353958 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f72a8055ed0 con 0x7f72b00b0950 2024-04-25T09:14:31.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.371+0000 7f72b5200640 1 -- 172.21.15.175:0/1173353958 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72b0072020 con 0x7f72b00b0950 2024-04-25T09:14:31.361 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.375+0000 7f72a6a00640 1 -- 172.21.15.175:0/1173353958 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4954 (secure 0 0 0) 0x7f72a80557d0 con 0x7f72b00b0950 2024-04-25T09:14:31.362 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:31.362 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":103,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/745891603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":745891603},{"type":"v1","addr":"172.21.15.175:6837","nonce":745891603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2312875672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2312875672},{"type":"v1","addr":"172.21.15.177:6834","nonce":2312875672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":8212,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3983919410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3983919410},{"type":"v1","addr":"172.21.15.177:6835","nonce":3983919410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:14:03.698308+0000","modified":"2024-04-25T09:14:31.011077+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9120":{"gid":9120,"name":"c","rank":0,"incarnation":103,"state":"up:replay","state_seq":1,"addr":"172.21.15.175:6836/4159793972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":4159793972},{"type":"v1","addr":"172.21.15.175:6836","nonce":4159793972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:14:31.362 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 103 2024-04-25T09:14:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.375+0000 7f72b5200640 1 -- 172.21.15.175:0/1173353958 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f728c066f60 msgr2=0x7f728c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.375+0000 7f72b5200640 1 --2- 172.21.15.175:0/1173353958 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f728c066f60 0x7f728c069420 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f72a0005890 tx=0x7f72a0009040 comp rx=0 tx=0).stop 2024-04-25T09:14:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.375+0000 7f72b5200640 1 -- 172.21.15.175:0/1173353958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72b00b0950 msgr2=0x7f72b01f4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.375+0000 7f72b5200640 1 --2- 172.21.15.175:0/1173353958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72b00b0950 0x7f72b01f4d60 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f72a800c7b0 tx=0x7f72a800cc70 comp rx=0 tx=0).stop 2024-04-25T09:14:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.375+0000 7f72b5200640 1 -- 172.21.15.175:0/1173353958 shutdown_connections 2024-04-25T09:14:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.375+0000 7f72b5200640 1 --2- 172.21.15.175:0/1173353958 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f728c066f60 0x7f728c069420 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.375+0000 7f72b5200640 1 --2- 172.21.15.175:0/1173353958 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f72b00b0950 0x7f72b01f4d60 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.375+0000 7f72b5200640 1 --2- 172.21.15.175:0/1173353958 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72b015a900 0x7f72b00b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.375+0000 7f72b5200640 1 --2- 172.21.15.175:0/1173353958 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72b00cf560 0x7f72b014f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.375+0000 7f72b5200640 1 -- 172.21.15.175:0/1173353958 >> 172.21.15.175:0/1173353958 conn(0x7f72b00cd520 msgr2=0x7f72b0159ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.375+0000 7f72b5200640 1 -- 172.21.15.175:0/1173353958 shutdown_connections 2024-04-25T09:14:31.364 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:31.375+0000 7f72b5200640 1 -- 172.21.15.175:0/1173353958 wait complete. 2024-04-25T09:14:31.785 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 103, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:14:03.698308+0000', 'modified': '2024-04-25T09:14:31.011077+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 115, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9120}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9120': {'gid': 9120, 'name': 'c', 'rank': 0, 'incarnation': 103, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.175:6836/4159793972', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 4159793972}, {'type': 'v1', 'addr': '172.21.15.175:6836', 'nonce': 4159793972}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:14:31.785 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9120:up:replay 2024-04-25T09:14:32.786 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:32.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.947+0000 7f3657600640 1 Processor -- start 2024-04-25T09:14:32.934 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.947+0000 7f3657600640 1 -- start start 2024-04-25T09:14:32.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.947+0000 7f3657600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3650144fc0 0x7f36500cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.947+0000 7f3657600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f365015c5e0 0x7f36500cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.935 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.947+0000 7f3657600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365015cd00 con 0x7f36501453a0 2024-04-25T09:14:32.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.947+0000 7f3657600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36500ce660 con 0x7f3650144fc0 2024-04-25T09:14:32.936 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.947+0000 7f3657600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36500cc930 con 0x7f365015c5e0 2024-04-25T09:14:32.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.947+0000 7f3655600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f365015c5e0 0x7f36500cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.947+0000 7f3655600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f365015c5e0 0x7f36500cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:51094/0 (socket says 172.21.15.175:51094) 2024-04-25T09:14:32.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.947+0000 7f364fe00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f36501453a0 0x7f365015bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:38920/0 (socket says 172.21.15.175:38920) 2024-04-25T09:14:32.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.947+0000 7f3655600640 1 -- 172.21.15.175:0/178985372 learned_addr learned my addr 172.21.15.175:0/178985372 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:32.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.947+0000 7f3654c00640 1 --2- 172.21.15.175:0/178985372 >> v2:172.21.15.177:3300/0 conn(0x7f3650144fc0 0x7f36500cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.947+0000 7f364f400640 1 -- 172.21.15.175:0/178985372 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793342264 0 0) 0x7f365015cd00 con 0x7f36501453a0 2024-04-25T09:14:32.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.947+0000 7f364f400640 1 -- 172.21.15.175:0/178985372 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3634003530 con 0x7f36501453a0 2024-04-25T09:14:32.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.947+0000 7f3655600640 1 -- 172.21.15.175:0/178985372 >> v2:172.21.15.177:3300/0 conn(0x7f3650144fc0 msgr2=0x7f36500cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:32.937 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.947+0000 7f3655600640 1 --2- 172.21.15.175:0/178985372 >> v2:172.21.15.177:3300/0 conn(0x7f3650144fc0 0x7f36500cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.947+0000 7f3655600640 1 -- 172.21.15.175:0/178985372 >> v1:172.21.15.177:6789/0 conn(0x7f36501453a0 legacy=0x7f365015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.938 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.947+0000 7f3655600640 1 -- 172.21.15.175:0/178985372 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36500ccc10 con 0x7f365015c5e0 2024-04-25T09:14:32.939 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.951+0000 7f3655600640 1 --2- 172.21.15.175:0/178985372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f365015c5e0 0x7f36500cee20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f36480098a0 tx=0x7f364801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c42c4854ddd37fa3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:32.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.951+0000 7f364f400640 1 -- 172.21.15.175:0/178985372 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36480ab430 con 0x7f365015c5e0 2024-04-25T09:14:32.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.951+0000 7f364f400640 1 -- 172.21.15.175:0/178985372 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36480b0070 con 0x7f365015c5e0 2024-04-25T09:14:32.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.951+0000 7f364f400640 1 -- 172.21.15.175:0/178985372 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36480ab7f0 con 0x7f365015c5e0 2024-04-25T09:14:32.940 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.951+0000 7f3657600640 1 -- 172.21.15.175:0/178985372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f365015c5e0 msgr2=0x7f36500cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.951+0000 7f3657600640 1 --2- 172.21.15.175:0/178985372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f365015c5e0 0x7f36500cee20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f36480098a0 tx=0x7f364801c540 comp rx=0 tx=0).stop 2024-04-25T09:14:32.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.951+0000 7f3657600640 1 -- 172.21.15.175:0/178985372 shutdown_connections 2024-04-25T09:14:32.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.951+0000 7f3657600640 1 --2- 172.21.15.175:0/178985372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f365015c5e0 0x7f36500cee20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.951+0000 7f3657600640 1 --2- 172.21.15.175:0/178985372 >> v2:172.21.15.177:3300/0 conn(0x7f3650144fc0 0x7f36500cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.951+0000 7f3657600640 1 -- 172.21.15.175:0/178985372 >> 172.21.15.175:0/178985372 conn(0x7f3650067150 msgr2=0x7f365006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:32.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.951+0000 7f3657600640 1 -- 172.21.15.175:0/178985372 shutdown_connections 2024-04-25T09:14:32.941 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.951+0000 7f3657600640 1 -- 172.21.15.175:0/178985372 wait complete. 2024-04-25T09:14:32.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f3657600640 1 Processor -- start 2024-04-25T09:14:32.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f3657600640 1 -- start start 2024-04-25T09:14:32.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f3657600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36501453a0 0x7f36501597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f3657600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f365015c5e0 0x7f3650139180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f3657600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3650159e30 0x7f36501396c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f3657600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36500cff40 con 0x7f365015c5e0 2024-04-25T09:14:32.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f3657600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36500cfdc0 con 0x7f3650159e30 2024-04-25T09:14:32.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f3657600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36501685f0 con 0x7f36501453a0 2024-04-25T09:14:32.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f364fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f365015c5e0 0x7f3650139180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f364fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f365015c5e0 0x7f3650139180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48626/0 (socket says 172.21.15.175:48626) 2024-04-25T09:14:32.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f364fe00640 1 -- 172.21.15.175:0/358731214 learned_addr learned my addr 172.21.15.175:0/358731214 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:32.944 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f3655600640 1 --2- 172.21.15.175:0/358731214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3650159e30 0x7f36501396c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f3654c00640 1 --2- 172.21.15.175:0/358731214 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36501453a0 0x7f36501597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f364fe00640 1 -- 172.21.15.175:0/358731214 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36501453a0 msgr2=0x7f36501597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f364fe00640 1 --2- 172.21.15.175:0/358731214 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36501453a0 0x7f36501597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f364fe00640 1 -- 172.21.15.175:0/358731214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3650159e30 msgr2=0x7f36501396c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:32.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f364fe00640 1 --2- 172.21.15.175:0/358731214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3650159e30 0x7f36501396c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:32.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f364fe00640 1 -- 172.21.15.175:0/358731214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365015a2c0 con 0x7f365015c5e0 2024-04-25T09:14:32.945 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f364fe00640 1 --2- 172.21.15.175:0/358731214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f365015c5e0 0x7f3650139180 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f363c0010f0 tx=0x7f363c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:32.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f364cc00640 1 -- 172.21.15.175:0/358731214 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c0074e0 con 0x7f365015c5e0 2024-04-25T09:14:32.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f364cc00640 1 -- 172.21.15.175:0/358731214 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c007680 con 0x7f365015c5e0 2024-04-25T09:14:32.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f364cc00640 1 -- 172.21.15.175:0/358731214 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c004a30 con 0x7f365015c5e0 2024-04-25T09:14:32.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f3657600640 1 -- 172.21.15.175:0/358731214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f365015a5a0 con 0x7f365015c5e0 2024-04-25T09:14:32.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.955+0000 7f3657600640 1 -- 172.21.15.175:0/358731214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f365015ab60 con 0x7f365015c5e0 2024-04-25T09:14:32.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.959+0000 7f3657600640 1 -- 172.21.15.175:0/358731214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3650074a60 con 0x7f365015c5e0 2024-04-25T09:14:32.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.959+0000 7f364cc00640 1 -- 172.21.15.175:0/358731214 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f363c01a020 con 0x7f365015c5e0 2024-04-25T09:14:32.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.959+0000 7f364cc00640 1 --2- 172.21.15.175:0/358731214 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3630066f60 0x7f3630069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:32.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.959+0000 7f364cc00640 1 -- 172.21.15.175:0/358731214 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f363c084860 con 0x7f365015c5e0 2024-04-25T09:14:32.947 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.959+0000 7f3654c00640 1 --2- 172.21.15.175:0/358731214 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3630066f60 0x7f3630069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:32.948 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.959+0000 7f3654c00640 1 --2- 172.21.15.175:0/358731214 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3630066f60 0x7f3630069420 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3650141d30 tx=0x7f364000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:32.951 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:32.963+0000 7f364cc00640 1 -- 172.21.15.175:0/358731214 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f363c0550e0 con 0x7f365015c5e0 2024-04-25T09:14:33.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:33.155+0000 7f3657600640 1 -- 172.21.15.175:0/358731214 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f365013e530 con 0x7f365015c5e0 2024-04-25T09:14:33.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:33.155+0000 7f364cc00640 1 -- 172.21.15.175:0/358731214 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4954 (secure 0 0 0) 0x7f363c059180 con 0x7f365015c5e0 2024-04-25T09:14:33.145 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:33.145 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":105,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/745891603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":745891603},{"type":"v1","addr":"172.21.15.175:6837","nonce":745891603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2312875672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2312875672},{"type":"v1","addr":"172.21.15.177:6834","nonce":2312875672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":8212,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3983919410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3983919410},{"type":"v1","addr":"172.21.15.177:6835","nonce":3983919410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:14:03.698308+0000","modified":"2024-04-25T09:14:32.020583+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9120":{"gid":9120,"name":"c","rank":0,"incarnation":103,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.175:6836/4159793972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":4159793972},{"type":"v1","addr":"172.21.15.175:6836","nonce":4159793972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:14:33.145 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 105 2024-04-25T09:14:33.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:33.159+0000 7f3657600640 1 -- 172.21.15.175:0/358731214 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3630066f60 msgr2=0x7f3630069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:33.146 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:33.159+0000 7f3657600640 1 --2- 172.21.15.175:0/358731214 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3630066f60 0x7f3630069420 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f3650141d30 tx=0x7f364000b040 comp rx=0 tx=0).stop 2024-04-25T09:14:33.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:33.159+0000 7f3657600640 1 -- 172.21.15.175:0/358731214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f365015c5e0 msgr2=0x7f3650139180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:33.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:33.159+0000 7f3657600640 1 --2- 172.21.15.175:0/358731214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f365015c5e0 0x7f3650139180 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f363c0010f0 tx=0x7f363c00c890 comp rx=0 tx=0).stop 2024-04-25T09:14:33.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:33.159+0000 7f3657600640 1 -- 172.21.15.175:0/358731214 shutdown_connections 2024-04-25T09:14:33.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:33.159+0000 7f3657600640 1 --2- 172.21.15.175:0/358731214 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3630066f60 0x7f3630069420 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:33.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:33.159+0000 7f3657600640 1 --2- 172.21.15.175:0/358731214 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3650159e30 0x7f36501396c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:33.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:33.159+0000 7f3657600640 1 --2- 172.21.15.175:0/358731214 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f365015c5e0 0x7f3650139180 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:33.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:33.159+0000 7f3657600640 1 --2- 172.21.15.175:0/358731214 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36501453a0 0x7f36501597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:33.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:33.159+0000 7f3657600640 1 -- 172.21.15.175:0/358731214 >> 172.21.15.175:0/358731214 conn(0x7f3650144fc0 msgr2=0x7f365015d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:33.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:33.159+0000 7f3657600640 1 -- 172.21.15.175:0/358731214 shutdown_connections 2024-04-25T09:14:33.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:33.159+0000 7f3657600640 1 -- 172.21.15.175:0/358731214 wait complete. 2024-04-25T09:14:33.568 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 105, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:14:03.698308+0000', 'modified': '2024-04-25T09:14:32.020583+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 115, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9120}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9120': {'gid': 9120, 'name': 'c', 'rank': 0, 'incarnation': 103, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.175:6836/4159793972', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 4159793972}, {'type': 'v1', 'addr': '172.21.15.175:6836', 'nonce': 4159793972}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:14:33.569 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9120:up:rejoin 2024-04-25T09:14:34.569 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:34.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.723+0000 7f07e3600640 1 Processor -- start 2024-04-25T09:14:34.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.723+0000 7f07e3600640 1 -- start start 2024-04-25T09:14:34.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07e3600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f07dc144fc0 0x7f07dc0cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07e3600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc15cd00 con 0x7f07dc15c5e0 2024-04-25T09:14:34.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07e3600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07dc0ce660 con 0x7f07dc1453a0 2024-04-25T09:14:34.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07e3600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07dc0cc930 con 0x7f07dc144fc0 2024-04-25T09:14:34.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07e1600640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f07dc15c5e0 0x7f07dc0cee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:47740/0 (socket says 172.21.15.175:47740) 2024-04-25T09:14:34.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07e1600640 1 -- 172.21.15.175:0/1428942146 learned_addr learned my addr 172.21.15.175:0/1428942146 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:34.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07e0c00640 1 --2- 172.21.15.175:0/1428942146 >> v2:172.21.15.177:3300/0 conn(0x7f07dc144fc0 0x7f07dc0cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07dbe00640 1 -- 172.21.15.175:0/1428942146 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1234639344 0 0) 0x7f07dc15cd00 con 0x7f07dc15c5e0 2024-04-25T09:14:34.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07dbe00640 1 -- 172.21.15.175:0/1428942146 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07c0003530 con 0x7f07dc15c5e0 2024-04-25T09:14:34.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07dbe00640 1 -- 172.21.15.175:0/1428942146 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 118526603 0 0) 0x7f07c0003530 con 0x7f07dc15c5e0 2024-04-25T09:14:34.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07dbe00640 1 -- 172.21.15.175:0/1428942146 >> v2:172.21.15.177:3300/0 conn(0x7f07dc144fc0 msgr2=0x7f07dc0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:34.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07dbe00640 1 --2- 172.21.15.175:0/1428942146 >> v2:172.21.15.177:3300/0 conn(0x7f07dc144fc0 0x7f07dc0cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.716 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07dbe00640 1 -- 172.21.15.175:0/1428942146 >> v1:172.21.15.177:6789/0 conn(0x7f07dc1453a0 legacy=0x7f07dc15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07dbe00640 1 -- 172.21.15.175:0/1428942146 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc0ccc10 con 0x7f07dc15c5e0 2024-04-25T09:14:34.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07dbe00640 1 -- 172.21.15.175:0/1428942146 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f07d4001a00 con 0x7f07dc15c5e0 2024-04-25T09:14:34.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07dbe00640 1 -- 172.21.15.175:0/1428942146 >> v1:172.21.15.175:6789/0 conn(0x7f07dc15c5e0 legacy=0x7f07dc0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07dbe00640 1 --2- 172.21.15.175:0/1428942146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07c00039c0 0x7f07c0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07dbe00640 1 --2- 172.21.15.175:0/1428942146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07c00043c0 0x7f07c0004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07dbe00640 1 --2- 172.21.15.175:0/1428942146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07c0005090 0x7f07c000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07dbe00640 1 -- 172.21.15.175:0/1428942146 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc0cc930 con 0x7f07c00043c0 2024-04-25T09:14:34.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07dbe00640 1 -- 172.21.15.175:0/1428942146 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c000bff0 con 0x7f07c0005090 2024-04-25T09:14:34.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07dbe00640 1 -- 172.21.15.175:0/1428942146 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c000c1f0 con 0x7f07c00039c0 2024-04-25T09:14:34.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07d3e00640 1 --2- 172.21.15.175:0/1428942146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07c00043c0 0x7f07c0004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07e0c00640 1 --2- 172.21.15.175:0/1428942146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07c00039c0 0x7f07c0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07e1600640 1 --2- 172.21.15.175:0/1428942146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07c0005090 0x7f07c000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07d3e00640 1 -- 172.21.15.175:0/1428942146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07c00039c0 msgr2=0x7f07c0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:34.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07d3e00640 1 --2- 172.21.15.175:0/1428942146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07c00039c0 0x7f07c0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07d3e00640 1 -- 172.21.15.175:0/1428942146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07c0005090 msgr2=0x7f07c000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:34.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07d3e00640 1 --2- 172.21.15.175:0/1428942146 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07c0005090 0x7f07c000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07e1600640 1 -- 172.21.15.175:0/1428942146 reap_dead start 2024-04-25T09:14:34.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.727+0000 7f07d3e00640 1 -- 172.21.15.175:0/1428942146 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c0003530 con 0x7f07c00043c0 2024-04-25T09:14:34.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.731+0000 7f07d3e00640 1 --2- 172.21.15.175:0/1428942146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07c00043c0 0x7f07c0004890 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f07dc06b850 tx=0x7f07c401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5094e49dfc0848ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:34.718 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.731+0000 7f07dbe00640 1 -- 172.21.15.175:0/1428942146 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c4001460 con 0x7f07c00043c0 2024-04-25T09:14:34.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.731+0000 7f07dbe00640 1 -- 172.21.15.175:0/1428942146 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c40052d0 con 0x7f07c00043c0 2024-04-25T09:14:34.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.731+0000 7f07dbe00640 1 -- 172.21.15.175:0/1428942146 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c40054c0 con 0x7f07c00043c0 2024-04-25T09:14:34.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.731+0000 7f07e3600640 1 -- 172.21.15.175:0/1428942146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07c00043c0 msgr2=0x7f07c0004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.731+0000 7f07e3600640 1 --2- 172.21.15.175:0/1428942146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07c00043c0 0x7f07c0004890 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f07dc06b850 tx=0x7f07c401c440 comp rx=0 tx=0).stop 2024-04-25T09:14:34.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.731+0000 7f07e3600640 1 -- 172.21.15.175:0/1428942146 shutdown_connections 2024-04-25T09:14:34.719 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.731+0000 7f07e3600640 1 --2- 172.21.15.175:0/1428942146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07c00043c0 0x7f07c0004890 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.731+0000 7f07e3600640 1 -- 172.21.15.175:0/1428942146 >> 172.21.15.175:0/1428942146 conn(0x7f07dc067150 msgr2=0x7f07dc06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:34.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.731+0000 7f07e3600640 1 -- 172.21.15.175:0/1428942146 shutdown_connections 2024-04-25T09:14:34.720 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.731+0000 7f07e3600640 1 -- 172.21.15.175:0/1428942146 wait complete. 2024-04-25T09:14:34.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.731+0000 7f07e3600640 1 Processor -- start 2024-04-25T09:14:34.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.731+0000 7f07e3600640 1 -- start start 2024-04-25T09:14:34.722 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e3600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07dc15b0d0 0x7f07dc0ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e3600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07dc0ad810 0x7f07dc0b3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e3600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07dc0b3670 0x7f07dc0b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e3600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc15f600 con 0x7f07dc0b3670 2024-04-25T09:14:34.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e3600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc15f480 con 0x7f07dc0ad810 2024-04-25T09:14:34.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e3600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc15f780 con 0x7f07dc15b0d0 2024-04-25T09:14:34.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e1600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07dc0b3670 0x7f07dc0b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e1600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07dc0b3670 0x7f07dc0b3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48658/0 (socket says 172.21.15.175:48658) 2024-04-25T09:14:34.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e1600640 1 -- 172.21.15.175:0/627736056 learned_addr learned my addr 172.21.15.175:0/627736056 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:34.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e0c00640 1 --2- 172.21.15.175:0/627736056 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07dc15b0d0 0x7f07dc0ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07d3e00640 1 --2- 172.21.15.175:0/627736056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07dc0ad810 0x7f07dc0b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e1600640 1 -- 172.21.15.175:0/627736056 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07dc15b0d0 msgr2=0x7f07dc0ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e1600640 1 --2- 172.21.15.175:0/627736056 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07dc15b0d0 0x7f07dc0ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e1600640 1 -- 172.21.15.175:0/627736056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07dc0ad810 msgr2=0x7f07dc0b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e1600640 1 --2- 172.21.15.175:0/627736056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07dc0ad810 0x7f07dc0b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e1600640 1 -- 172.21.15.175:0/627736056 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc0b4480 con 0x7f07dc0b3670 2024-04-25T09:14:34.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e1600640 1 --2- 172.21.15.175:0/627736056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07dc0b3670 0x7f07dc0b3b00 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f07d4001eb0 tx=0x7f07d4007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:34.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07d9600640 1 -- 172.21.15.175:0/627736056 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d400ab10 con 0x7f07dc0b3670 2024-04-25T09:14:34.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07d9600640 1 -- 172.21.15.175:0/627736056 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d4018070 con 0x7f07dc0b3670 2024-04-25T09:14:34.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07d9600640 1 -- 172.21.15.175:0/627736056 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40133f0 con 0x7f07dc0b3670 2024-04-25T09:14:34.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e3600640 1 -- 172.21.15.175:0/627736056 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07dc0adeb0 con 0x7f07dc0b3670 2024-04-25T09:14:34.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e3600640 1 -- 172.21.15.175:0/627736056 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07dc13c850 con 0x7f07dc0b3670 2024-04-25T09:14:34.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07e3600640 1 -- 172.21.15.175:0/627736056 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07dc0b4670 con 0x7f07dc0b3670 2024-04-25T09:14:34.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.735+0000 7f07d9600640 1 -- 172.21.15.175:0/627736056 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f07d4013590 con 0x7f07dc0b3670 2024-04-25T09:14:34.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.739+0000 7f07d9600640 1 --2- 172.21.15.175:0/627736056 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f07b8066f60 0x7f07b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:34.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.739+0000 7f07d9600640 1 -- 172.21.15.175:0/627736056 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f07d4085530 con 0x7f07dc0b3670 2024-04-25T09:14:34.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.739+0000 7f07e0c00640 1 --2- 172.21.15.175:0/627736056 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f07b8066f60 0x7f07b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:34.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.739+0000 7f07e0c00640 1 --2- 172.21.15.175:0/627736056 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f07b8066f60 0x7f07b8069420 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0b2340 tx=0x7f07cc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:34.731 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.743+0000 7f07d9600640 1 -- 172.21.15.175:0/627736056 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f07d40563f0 con 0x7f07dc0b3670 2024-04-25T09:14:34.916 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.927+0000 7f07e3600640 1 -- 172.21.15.175:0/627736056 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07dc0adbf0 con 0x7f07dc0b3670 2024-04-25T09:14:34.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.927+0000 7f07d9600640 1 -- 172.21.15.175:0/627736056 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4954 (secure 0 0 0) 0x7f07d4055cf0 con 0x7f07dc0b3670 2024-04-25T09:14:34.919 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:34.919 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/745891603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":745891603},{"type":"v1","addr":"172.21.15.175:6837","nonce":745891603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2312875672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2312875672},{"type":"v1","addr":"172.21.15.177:6834","nonce":2312875672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":8212,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3983919410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3983919410},{"type":"v1","addr":"172.21.15.177:6835","nonce":3983919410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:14:03.698308+0000","modified":"2024-04-25T09:14:33.028975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9120":{"gid":9120,"name":"c","rank":0,"incarnation":103,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6836/4159793972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":4159793972},{"type":"v1","addr":"172.21.15.175:6836","nonce":4159793972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:14:34.919 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 106 2024-04-25T09:14:34.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.931+0000 7f07e3600640 1 -- 172.21.15.175:0/627736056 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f07b8066f60 msgr2=0x7f07b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.931+0000 7f07e3600640 1 --2- 172.21.15.175:0/627736056 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f07b8066f60 0x7f07b8069420 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f07dc0b2340 tx=0x7f07cc009190 comp rx=0 tx=0).stop 2024-04-25T09:14:34.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.931+0000 7f07e3600640 1 -- 172.21.15.175:0/627736056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07dc0b3670 msgr2=0x7f07dc0b3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:34.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.931+0000 7f07e3600640 1 --2- 172.21.15.175:0/627736056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07dc0b3670 0x7f07dc0b3b00 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f07d4001eb0 tx=0x7f07d4007b10 comp rx=0 tx=0).stop 2024-04-25T09:14:34.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.931+0000 7f07e3600640 1 -- 172.21.15.175:0/627736056 shutdown_connections 2024-04-25T09:14:34.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.931+0000 7f07e3600640 1 --2- 172.21.15.175:0/627736056 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f07b8066f60 0x7f07b8069420 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.931+0000 7f07e3600640 1 --2- 172.21.15.175:0/627736056 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07dc0b3670 0x7f07dc0b3b00 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.931+0000 7f07e3600640 1 --2- 172.21.15.175:0/627736056 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f07dc0ad810 0x7f07dc0b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.931+0000 7f07e3600640 1 --2- 172.21.15.175:0/627736056 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07dc15b0d0 0x7f07dc0ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:34.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.931+0000 7f07e3600640 1 -- 172.21.15.175:0/627736056 >> 172.21.15.175:0/627736056 conn(0x7f07c00043c0 msgr2=0x7f07dc0cee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:34.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.931+0000 7f07e3600640 1 -- 172.21.15.175:0/627736056 shutdown_connections 2024-04-25T09:14:34.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:34.931+0000 7f07e3600640 1 -- 172.21.15.175:0/627736056 wait complete. 2024-04-25T09:14:34.996 INFO:tasks.ceph.mds.c.smithi175.stderr:2024-04-25T09:14:35.007+0000 7f773e800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:14:35.341 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 106, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:14:03.698308+0000', 'modified': '2024-04-25T09:14:33.028975+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 115, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9120}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9120': {'gid': 9120, 'name': 'c', 'rank': 0, 'incarnation': 103, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.175:6836/4159793972', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 4159793972}, {'type': 'v1', 'addr': '172.21.15.175:6836', 'nonce': 4159793972}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:14:35.341 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:14:35.341 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:14:35.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.491+0000 7fc783000640 1 Processor -- start 2024-04-25T09:14:35.478 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.491+0000 7fc783000640 1 -- start start 2024-04-25T09:14:35.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.491+0000 7fc783000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc77c15b970 0x7fc77c0c7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.491+0000 7fc783000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc77c15f4e0 0x7fc77c15f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.491+0000 7fc783000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77c099a50 con 0x7fc77c09aaf0 2024-04-25T09:14:35.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.491+0000 7fc783000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77c099d30 con 0x7fc77c15f4e0 2024-04-25T09:14:35.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.491+0000 7fc783000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c09a010 con 0x7fc77c15b970 2024-04-25T09:14:35.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.491+0000 7fc781c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc77c15b970 0x7fc77c0c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.491+0000 7fc782600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc77c15f4e0 0x7fc77c15f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.491+0000 7fc781c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc77c15b970 0x7fc77c0c7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:51116/0 (socket says 172.21.15.175:51116) 2024-04-25T09:14:35.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.491+0000 7fc781c00640 1 -- 172.21.15.175:0/2423277196 learned_addr learned my addr 172.21.15.175:0/2423277196 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:35.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.491+0000 7fc781c00640 1 -- 172.21.15.175:0/2423277196 >> v2:172.21.15.177:3300/0 conn(0x7fc77c15f4e0 msgr2=0x7fc77c15f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:35.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.491+0000 7fc781c00640 1 --2- 172.21.15.175:0/2423277196 >> v2:172.21.15.177:3300/0 conn(0x7fc77c15f4e0 0x7fc77c15f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.491+0000 7fc781c00640 1 -- 172.21.15.175:0/2423277196 >> v1:172.21.15.177:6789/0 conn(0x7fc77c09aaf0 legacy=0x7fc77c0c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.491+0000 7fc781c00640 1 -- 172.21.15.175:0/2423277196 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c09a2f0 con 0x7fc77c15b970 2024-04-25T09:14:35.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.491+0000 7fc77be00640 1 -- 172.21.15.175:0/2423277196 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001303445 0 0) 0x7fc77c099a50 con 0x7fc77c09aaf0 2024-04-25T09:14:35.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.495+0000 7fc781c00640 1 --2- 172.21.15.175:0/2423277196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc77c15b970 0x7fc77c0c7440 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc770009e50 tx=0x7fc77001c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bce77aab0ec7d33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.495+0000 7fc77be00640 1 -- 172.21.15.175:0/2423277196 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7700a5660 con 0x7fc77c15b970 2024-04-25T09:14:35.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.495+0000 7fc77be00640 1 -- 172.21.15.175:0/2423277196 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7700a5800 con 0x7fc77c15b970 2024-04-25T09:14:35.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.495+0000 7fc77be00640 1 -- 172.21.15.175:0/2423277196 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7700a5bd0 con 0x7fc77c15b970 2024-04-25T09:14:35.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.495+0000 7fc783000640 1 -- 172.21.15.175:0/2423277196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc77c15b970 msgr2=0x7fc77c0c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.495+0000 7fc783000640 1 --2- 172.21.15.175:0/2423277196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc77c15b970 0x7fc77c0c7440 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc770009e50 tx=0x7fc77001c9a0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.495+0000 7fc783000640 1 -- 172.21.15.175:0/2423277196 shutdown_connections 2024-04-25T09:14:35.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.495+0000 7fc783000640 1 --2- 172.21.15.175:0/2423277196 >> v2:172.21.15.177:3300/0 conn(0x7fc77c15f4e0 0x7fc77c15f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.495+0000 7fc783000640 1 --2- 172.21.15.175:0/2423277196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc77c15b970 0x7fc77c0c7440 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.495+0000 7fc783000640 1 -- 172.21.15.175:0/2423277196 >> 172.21.15.175:0/2423277196 conn(0x7fc77c0b3160 msgr2=0x7fc77c0b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:35.485 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.495+0000 7fc783000640 1 -- 172.21.15.175:0/2423277196 shutdown_connections 2024-04-25T09:14:35.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.495+0000 7fc783000640 1 -- 172.21.15.175:0/2423277196 wait complete. 2024-04-25T09:14:35.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc783000640 1 Processor -- start 2024-04-25T09:14:35.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc783000640 1 -- start start 2024-04-25T09:14:35.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc783000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc77c09aaf0 0x7fc77c0c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc783000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc77c15b970 0x7fc77c148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc783000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc77c15f4e0 0x7fc77c159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc783000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c0ccaa0 con 0x7fc77c09aaf0 2024-04-25T09:14:35.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc783000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c0cc920 con 0x7fc77c15f4e0 2024-04-25T09:14:35.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc783000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c0ccc20 con 0x7fc77c15b970 2024-04-25T09:14:35.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc781c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc77c09aaf0 0x7fc77c0c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc781c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc77c09aaf0 0x7fc77c0c8740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48674/0 (socket says 172.21.15.175:48674) 2024-04-25T09:14:35.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc781c00640 1 -- 172.21.15.175:0/2399548525 learned_addr learned my addr 172.21.15.175:0/2399548525 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:35.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc782600640 1 --2- 172.21.15.175:0/2399548525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc77c15f4e0 0x7fc77c159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc781200640 1 --2- 172.21.15.175:0/2399548525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc77c15b970 0x7fc77c148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc781c00640 1 -- 172.21.15.175:0/2399548525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc77c15b970 msgr2=0x7fc77c148c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc781c00640 1 --2- 172.21.15.175:0/2399548525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc77c15b970 0x7fc77c148c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc781c00640 1 -- 172.21.15.175:0/2399548525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc77c15f4e0 msgr2=0x7fc77c159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc781c00640 1 --2- 172.21.15.175:0/2399548525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc77c15f4e0 0x7fc77c159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc781c00640 1 -- 172.21.15.175:0/2399548525 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c164a30 con 0x7fc77c09aaf0 2024-04-25T09:14:35.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc782600640 1 --2- 172.21.15.175:0/2399548525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc77c15f4e0 0x7fc77c159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:35.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc781c00640 1 --2- 172.21.15.175:0/2399548525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc77c09aaf0 0x7fc77c0c8740 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fc7700af040 tx=0x7fc770019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc779600640 1 -- 172.21.15.175:0/2399548525 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7700bc020 con 0x7fc77c09aaf0 2024-04-25T09:14:35.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc779600640 1 -- 172.21.15.175:0/2399548525 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7700b8670 con 0x7fc77c09aaf0 2024-04-25T09:14:35.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc779600640 1 -- 172.21.15.175:0/2399548525 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7700b8a60 con 0x7fc77c09aaf0 2024-04-25T09:14:35.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.499+0000 7fc783000640 1 -- 172.21.15.175:0/2399548525 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77c164d10 con 0x7fc77c09aaf0 2024-04-25T09:14:35.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.503+0000 7fc783000640 1 -- 172.21.15.175:0/2399548525 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77c156e30 con 0x7fc77c09aaf0 2024-04-25T09:14:35.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.503+0000 7fc779600640 1 -- 172.21.15.175:0/2399548525 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc7700bf020 con 0x7fc77c09aaf0 2024-04-25T09:14:35.491 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.503+0000 7fc779600640 1 --2- 172.21.15.175:0/2399548525 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc75c066f60 0x7fc75c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.503+0000 7fc779600640 1 -- 172.21.15.175:0/2399548525 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fc770120130 con 0x7fc77c09aaf0 2024-04-25T09:14:35.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.503+0000 7fc781200640 1 --2- 172.21.15.175:0/2399548525 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc75c066f60 0x7fc75c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.503+0000 7fc781200640 1 --2- 172.21.15.175:0/2399548525 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc75c066f60 0x7fc75c069420 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc77c157100 tx=0x7fc768009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.503+0000 7fc7879bc000 1 Processor -- start 2024-04-25T09:14:35.492 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.503+0000 7fc7879bc000 1 -- start start 2024-04-25T09:14:35.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc7879bc000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3dba920 0x5558e3dbad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc7879bc000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3dbb240 0x5558e3d709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc7879bc000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3d70f30 0x5558e3d71310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc7879bc000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558e3c585f0 con 0x5558e3dba920 2024-04-25T09:14:35.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc7879bc000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558e3bbfda0 con 0x5558e3d70f30 2024-04-25T09:14:35.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc7879bc000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558e3b48150 con 0x5558e3dbb240 2024-04-25T09:14:35.494 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc781c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3dba920 0x5558e3dbad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc781c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3dba920 0x5558e3dbad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48690/0 (socket says 172.21.15.175:48690) 2024-04-25T09:14:35.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc781c00640 1 -- 172.21.15.175:0/1514883386 learned_addr learned my addr 172.21.15.175:0/1514883386 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:35.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc781200640 1 --2- 172.21.15.175:0/1514883386 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3dbb240 0x5558e3d709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc782600640 1 --2- 172.21.15.175:0/1514883386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3d70f30 0x5558e3d71310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc781c00640 1 -- 172.21.15.175:0/1514883386 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3dbb240 msgr2=0x5558e3d709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:35.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc781c00640 1 --2- 172.21.15.175:0/1514883386 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3dbb240 0x5558e3d709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc781c00640 1 -- 172.21.15.175:0/1514883386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3d70f30 msgr2=0x5558e3d71310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:35.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc781c00640 1 --2- 172.21.15.175:0/1514883386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3d70f30 0x5558e3d71310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.495 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc781c00640 1 -- 172.21.15.175:0/1514883386 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558e3b61ca0 con 0x5558e3dba920 2024-04-25T09:14:35.496 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc781c00640 1 --2- 172.21.15.175:0/1514883386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3dba920 0x5558e3dbad00 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fc7700ecf00 tx=0x7fc770009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2496398b72dfada7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc76e000640 1 -- 172.21.15.175:0/1514883386 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7700f11a0 con 0x5558e3dba920 2024-04-25T09:14:35.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc76e000640 1 -- 172.21.15.175:0/1514883386 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7700f0aa0 con 0x5558e3dba920 2024-04-25T09:14:35.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc76e000640 1 -- 172.21.15.175:0/1514883386 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7700f4bf0 con 0x5558e3dba920 2024-04-25T09:14:35.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc7879bc000 1 -- 172.21.15.175:0/1514883386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3dba920 msgr2=0x5558e3dbad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc7879bc000 1 --2- 172.21.15.175:0/1514883386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3dba920 0x5558e3dbad00 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fc7700ecf00 tx=0x7fc770009810 comp rx=0 tx=0).stop 2024-04-25T09:14:35.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc7879bc000 1 -- 172.21.15.175:0/1514883386 shutdown_connections 2024-04-25T09:14:35.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc7879bc000 1 --2- 172.21.15.175:0/1514883386 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3d70f30 0x5558e3d71310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc7879bc000 1 --2- 172.21.15.175:0/1514883386 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3dbb240 0x5558e3d709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc7879bc000 1 --2- 172.21.15.175:0/1514883386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3dba920 0x5558e3dbad00 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc7879bc000 1 -- 172.21.15.175:0/1514883386 >> 172.21.15.175:0/1514883386 conn(0x5558e3d772a0 msgr2=0x5558e3d6f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:35.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc7879bc000 1 -- 172.21.15.175:0/1514883386 shutdown_connections 2024-04-25T09:14:35.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc7879bc000 1 -- 172.21.15.175:0/1514883386 wait complete. 2024-04-25T09:14:35.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc7879bc000 1 -- start start 2024-04-25T09:14:35.497 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.507+0000 7fc7879bc000 1 Processor -- start 2024-04-25T09:14:35.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3d70f30 0x5558e3dc1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3dba920 0x5558e3dc2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3dbb240 0x5558e3d74aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558e3b7a990 con 0x5558e3d70f30 2024-04-25T09:14:35.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558e3bbbe40 con 0x5558e3dbb240 2024-04-25T09:14:35.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558e3b4b900 con 0x5558e3dba920 2024-04-25T09:14:35.501 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 10 client.0 _ll_register_callbacks cb 0x5558e3c731c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:14:35.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc781c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3d70f30 0x5558e3dc1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc781c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3d70f30 0x5558e3dc1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48704/0 (socket says 172.21.15.175:48704) 2024-04-25T09:14:35.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc781c00640 1 -- 172.21.15.175:0/929432986 learned_addr learned my addr 172.21.15.175:0/929432986 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:35.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc781c00640 1 -- 172.21.15.175:0/929432986 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3dba920 msgr2=0x5558e3dc2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:35.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc781c00640 1 --2- 172.21.15.175:0/929432986 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3dba920 0x5558e3dc2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc781c00640 1 -- 172.21.15.175:0/929432986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3dbb240 msgr2=0x5558e3d74aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:35.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc781c00640 1 --2- 172.21.15.175:0/929432986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3dbb240 0x5558e3d74aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc781c00640 1 -- 172.21.15.175:0/929432986 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558e3b78630 con 0x5558e3d70f30 2024-04-25T09:14:35.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc781c00640 1 --2- 172.21.15.175:0/929432986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3d70f30 0x5558e3dc1cf0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fc7700a5980 tx=0x7fc77001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ac6cea37958a32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc762a00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:14:35.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc762a00640 1 -- 172.21.15.175:0/929432986 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7700f0f00 con 0x5558e3d70f30 2024-04-25T09:14:35.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc762a00640 1 -- 172.21.15.175:0/929432986 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fc7700f8d20 con 0x5558e3d70f30 2024-04-25T09:14:35.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 -- 172.21.15.175:0/929432986 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc7700f0aa0 con 0x5558e3d70f30 2024-04-25T09:14:35.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc762a00640 1 -- 172.21.15.175:0/929432986 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc770101050 con 0x5558e3d70f30 2024-04-25T09:14:35.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 10 client.9201 fetch_fsmap learned FSMap version 106 2024-04-25T09:14:35.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 -- 172.21.15.175:0/929432986 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x5558e3b483a0 con 0x5558e3d70f30 2024-04-25T09:14:35.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc762a00640 1 -- 172.21.15.175:0/929432986 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7700f0aa0 con 0x5558e3d70f30 2024-04-25T09:14:35.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc762a00640 1 -- 172.21.15.175:0/929432986 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 106) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc770104020 con 0x5558e3d70f30 2024-04-25T09:14:35.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 10 client.9201 fetch_fsmap finished waiting for FSMap version 106 2024-04-25T09:14:35.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 10 client.9201 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:14:35.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 20 client.9201 populate_metadata read hostname 'smithi175' 2024-04-25T09:14:35.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 --2- 172.21.15.175:0/929432986 >> [v2:172.21.15.175:6834/4159793972,v1:172.21.15.175:6836/4159793972] conn(0x5558e3d76160 0x5558e3dcbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 4 client.9201 mds_command: new command op to 9120 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:14:35.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 -- 172.21.15.175:0/929432986 --> [v2:172.21.15.175:6834/4159793972,v1:172.21.15.175:6836/4159793972] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5558e3b5ba50 con 0x5558e3d76160 2024-04-25T09:14:35.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc781200640 1 --2- 172.21.15.175:0/929432986 >> [v2:172.21.15.175:6834/4159793972,v1:172.21.15.175:6836/4159793972] conn(0x5558e3d76160 0x5558e3dcbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc762a00640 10 client.9201 ms_handle_connect on v2:172.21.15.175:6834/4159793972 2024-04-25T09:14:35.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc781200640 1 --2- 172.21.15.175:0/929432986 >> [v2:172.21.15.175:6834/4159793972,v1:172.21.15.175:6836/4159793972] conn(0x5558e3d76160 0x5558e3dcbd50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e77b755f16c34a0a server_cookie=2bd38c6fec0498a1 in_seq=0 out_seq=0 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc762a00640 1 -- 172.21.15.175:0/929432986 <== mds.0 v2:172.21.15.175:6834/4159793972 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5558e3b5ba50 con 0x5558e3d76160 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc762a00640 10 client.9201 handle_command_reply: tid=0 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 client.9201 shutdown 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 -- 172.21.15.175:0/929432986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3d70f30 msgr2=0x5558e3dc1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 --2- 172.21.15.175:0/929432986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3d70f30 0x5558e3dc1cf0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fc7700a5980 tx=0x7fc77001c9a0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 -- 172.21.15.175:0/929432986 shutdown_connections 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 --2- 172.21.15.175:0/929432986 >> [v2:172.21.15.175:6834/4159793972,v1:172.21.15.175:6836/4159793972] conn(0x5558e3d76160 0x5558e3dcbd50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 --2- 172.21.15.175:0/929432986 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3dbb240 0x5558e3d74aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 --2- 172.21.15.175:0/929432986 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3dba920 0x5558e3dc2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc762a00640 0 client.9201 ms_handle_reset on v2:172.21.15.175:6834/4159793972 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 --2- 172.21.15.175:0/929432986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3d70f30 0x5558e3dc1cf0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.511+0000 7fc7879bc000 1 -- 172.21.15.175:0/929432986 >> 172.21.15.175:0/929432986 conn(0x5558e3d772a0 msgr2=0x5558e3d6f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.515+0000 7fc7879bc000 1 -- 172.21.15.175:0/929432986 shutdown_connections 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.515+0000 7fc7879bc000 1 -- 172.21.15.175:0/929432986 wait complete. 2024-04-25T09:14:35.504 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.515+0000 7fc7879bc000 20 client.9201 trim_cache size 0 max 16384 2024-04-25T09:14:35.516 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.527+0000 7fc7879bc000 1 Processor -- start 2024-04-25T09:14:35.517 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.527+0000 7fc7879bc000 1 -- start start 2024-04-25T09:14:35.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3d70f30 0x5558e3e1ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3dba920 0x5558e3e1ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3dbb240 0x5558e3e1f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c166800 con 0x5558e3dba920 2024-04-25T09:14:35.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c15cb90 con 0x5558e3dbb240 2024-04-25T09:14:35.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c166200 con 0x5558e3d70f30 2024-04-25T09:14:35.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc781200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3dba920 0x5558e3e1ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc781200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3dba920 0x5558e3e1ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48708/0 (socket says 172.21.15.175:48708) 2024-04-25T09:14:35.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc781200640 1 -- 172.21.15.175:0/2720319109 learned_addr learned my addr 172.21.15.175:0/2720319109 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:35.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc781c00640 1 --2- 172.21.15.175:0/2720319109 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3d70f30 0x5558e3e1ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc782600640 1 --2- 172.21.15.175:0/2720319109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3dbb240 0x5558e3e1f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc781200640 1 -- 172.21.15.175:0/2720319109 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3d70f30 msgr2=0x5558e3e1ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:35.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc781200640 1 --2- 172.21.15.175:0/2720319109 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3d70f30 0x5558e3e1ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc781200640 1 -- 172.21.15.175:0/2720319109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3dbb240 msgr2=0x5558e3e1f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:35.521 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc781200640 1 --2- 172.21.15.175:0/2720319109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3dbb240 0x5558e3e1f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc781200640 1 -- 172.21.15.175:0/2720319109 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558e3c41600 con 0x5558e3dba920 2024-04-25T09:14:35.522 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc781200640 1 --2- 172.21.15.175:0/2720319109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3dba920 0x5558e3e1ef50 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fc768005040 tx=0x7fc768011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb75b29cca6f7a65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc76d600640 1 -- 172.21.15.175:0/2720319109 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768003600 con 0x5558e3dba920 2024-04-25T09:14:35.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc76d600640 1 -- 172.21.15.175:0/2720319109 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc768029070 con 0x5558e3dba920 2024-04-25T09:14:35.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc76d600640 1 -- 172.21.15.175:0/2720319109 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7680037a0 con 0x5558e3dba920 2024-04-25T09:14:35.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 -- 172.21.15.175:0/2720319109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3dba920 msgr2=0x5558e3e1ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 --2- 172.21.15.175:0/2720319109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3dba920 0x5558e3e1ef50 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fc768005040 tx=0x7fc768011000 comp rx=0 tx=0).stop 2024-04-25T09:14:35.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 -- 172.21.15.175:0/2720319109 shutdown_connections 2024-04-25T09:14:35.526 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 --2- 172.21.15.175:0/2720319109 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3dbb240 0x5558e3e1f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 --2- 172.21.15.175:0/2720319109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3dba920 0x5558e3e1ef50 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 --2- 172.21.15.175:0/2720319109 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3d70f30 0x5558e3e1ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 -- 172.21.15.175:0/2720319109 >> 172.21.15.175:0/2720319109 conn(0x5558e3d772a0 msgr2=0x5558e3dc27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:35.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 -- 172.21.15.175:0/2720319109 shutdown_connections 2024-04-25T09:14:35.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 -- 172.21.15.175:0/2720319109 wait complete. 2024-04-25T09:14:35.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 -- start start 2024-04-25T09:14:35.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 Processor -- start 2024-04-25T09:14:35.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3d70f30 0x5558e3dc83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3dba920 0x5558e3e07fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3dbb240 0x5558e3e084f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558e3bc43d0 con 0x5558e3d70f30 2024-04-25T09:14:35.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558e3c7bd50 con 0x5558e3dbb240 2024-04-25T09:14:35.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558e3b5a980 con 0x5558e3dba920 2024-04-25T09:14:35.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.531+0000 7fc7879bc000 10 client.0 _ll_register_callbacks cb 0x7fc7700095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:14:35.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc781c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3d70f30 0x5558e3dc83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc781c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3d70f30 0x5558e3dc83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48724/0 (socket says 172.21.15.175:48724) 2024-04-25T09:14:35.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc781c00640 1 -- 172.21.15.175:0/2537402586 learned_addr learned my addr 172.21.15.175:0/2537402586 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:35.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc782600640 1 --2- 172.21.15.175:0/2537402586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3dbb240 0x5558e3e084f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc781200640 1 --2- 172.21.15.175:0/2537402586 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3dba920 0x5558e3e07fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc781c00640 1 -- 172.21.15.175:0/2537402586 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3dba920 msgr2=0x5558e3e07fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:35.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc781c00640 1 --2- 172.21.15.175:0/2537402586 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3dba920 0x5558e3e07fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc781c00640 1 -- 172.21.15.175:0/2537402586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3dbb240 msgr2=0x5558e3e084f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:35.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc781c00640 1 --2- 172.21.15.175:0/2537402586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3dbb240 0x5558e3e084f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc781c00640 1 -- 172.21.15.175:0/2537402586 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558e3b549b0 con 0x5558e3d70f30 2024-04-25T09:14:35.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc781c00640 1 --2- 172.21.15.175:0/2537402586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3d70f30 0x5558e3dc83a0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fc7700070b0 tx=0x7fc770009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476d0216ed95af83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc762a00640 10 client.0 ms_handle_connect on v2:172.21.15.175:3300/0 2024-04-25T09:14:35.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc762a00640 1 -- 172.21.15.175:0/2537402586 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7700f0400 con 0x5558e3d70f30 2024-04-25T09:14:35.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc762a00640 1 -- 172.21.15.175:0/2537402586 <== mon.0 v2:172.21.15.175:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fc7700f5b10 con 0x5558e3d70f30 2024-04-25T09:14:35.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 1 -- 172.21.15.175:0/2537402586 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc768029070 con 0x5558e3d70f30 2024-04-25T09:14:35.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc762a00640 1 -- 172.21.15.175:0/2537402586 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc77011e2c0 con 0x5558e3d70f30 2024-04-25T09:14:35.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 10 client.9207 fetch_fsmap learned FSMap version 106 2024-04-25T09:14:35.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 1 -- 172.21.15.175:0/2537402586 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=2+}) v3 -- 0x5558e3b670b0 con 0x5558e3d70f30 2024-04-25T09:14:35.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc762a00640 1 -- 172.21.15.175:0/2537402586 <== mon.0 v2:172.21.15.175:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc768029070 con 0x5558e3d70f30 2024-04-25T09:14:35.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc762a00640 1 -- 172.21.15.175:0/2537402586 <== mon.0 v2:172.21.15.175:3300/0 5 ==== fsmap(e 106) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc770104040 con 0x5558e3d70f30 2024-04-25T09:14:35.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 10 client.9207 fetch_fsmap finished waiting for FSMap version 106 2024-04-25T09:14:35.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 10 client.9207 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:14:35.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 20 client.9207 populate_metadata read hostname 'smithi175' 2024-04-25T09:14:35.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 1 --2- 172.21.15.175:0/2537402586 >> [v2:172.21.15.175:6834/4159793972,v1:172.21.15.175:6836/4159793972] conn(0x5558e3e08a30 0x5558e3e23f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 4 client.9207 mds_command: new command op to 9120 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:14:35.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 1 -- 172.21.15.175:0/2537402586 --> [v2:172.21.15.175:6834/4159793972,v1:172.21.15.175:6836/4159793972] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5558e3bcd2e0 con 0x5558e3e08a30 2024-04-25T09:14:35.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc781200640 1 --2- 172.21.15.175:0/2537402586 >> [v2:172.21.15.175:6834/4159793972,v1:172.21.15.175:6836/4159793972] conn(0x5558e3e08a30 0x5558e3e23f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc781200640 1 --2- 172.21.15.175:0/2537402586 >> [v2:172.21.15.175:6834/4159793972,v1:172.21.15.175:6836/4159793972] conn(0x5558e3e08a30 0x5558e3e23f70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce816980ea68e69a server_cookie=ee9284b7f0484c0a in_seq=0 out_seq=0 2024-04-25T09:14:35.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc762a00640 10 client.9207 ms_handle_connect on v2:172.21.15.175:6834/4159793972 2024-04-25T09:14:35.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc762a00640 1 -- 172.21.15.175:0/2537402586 <== mds.0 v2:172.21.15.175:6834/4159793972 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x5558e3bcd2e0 con 0x5558e3e08a30 2024-04-25T09:14:35.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc762a00640 10 client.9207 handle_command_reply: tid=0 2024-04-25T09:14:35.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 1 client.9207 shutdown 2024-04-25T09:14:35.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 1 -- 172.21.15.175:0/2537402586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3d70f30 msgr2=0x5558e3dc83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 1 --2- 172.21.15.175:0/2537402586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3d70f30 0x5558e3dc83a0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fc7700070b0 tx=0x7fc770009040 comp rx=0 tx=0).stop 2024-04-25T09:14:35.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 1 -- 172.21.15.175:0/2537402586 shutdown_connections 2024-04-25T09:14:35.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 1 --2- 172.21.15.175:0/2537402586 >> [v2:172.21.15.175:6834/4159793972,v1:172.21.15.175:6836/4159793972] conn(0x5558e3e08a30 0x5558e3e23f70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 1 --2- 172.21.15.175:0/2537402586 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5558e3dbb240 0x5558e3e084f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 1 --2- 172.21.15.175:0/2537402586 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5558e3dba920 0x5558e3e07fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc762a00640 0 client.9207 ms_handle_reset on v2:172.21.15.175:6834/4159793972 2024-04-25T09:14:35.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 1 --2- 172.21.15.175:0/2537402586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5558e3d70f30 0x5558e3dc83a0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 1 -- 172.21.15.175:0/2537402586 >> 172.21.15.175:0/2537402586 conn(0x5558e3d772a0 msgr2=0x5558e3db8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:35.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 1 -- 172.21.15.175:0/2537402586 shutdown_connections 2024-04-25T09:14:35.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 1 -- 172.21.15.175:0/2537402586 wait complete. 2024-04-25T09:14:35.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc7879bc000 20 client.9207 trim_cache size 0 max 16384 2024-04-25T09:14:35.531 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:14:35.531 INFO:teuthology.orchestra.run.smithi175.stdout: "cluster_fsid": "8caed986-ca08-40e2-b5a5-12e2aade6223", 2024-04-25T09:14:35.531 INFO:teuthology.orchestra.run.smithi175.stdout: "whoami": 0, 2024-04-25T09:14:35.531 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 9120, 2024-04-25T09:14:35.531 INFO:teuthology.orchestra.run.smithi175.stdout: "want_state": "up:active", 2024-04-25T09:14:35.531 INFO:teuthology.orchestra.run.smithi175.stdout: "state": "up:active", 2024-04-25T09:14:35.531 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs", 2024-04-25T09:14:35.531 INFO:teuthology.orchestra.run.smithi175.stdout: "rank_uptime": 4.5268161229999997, 2024-04-25T09:14:35.531 INFO:teuthology.orchestra.run.smithi175.stdout: "mdsmap_epoch": 106, 2024-04-25T09:14:35.531 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch": 115, 2024-04-25T09:14:35.531 INFO:teuthology.orchestra.run.smithi175.stdout: "osdmap_epoch_barrier": 115, 2024-04-25T09:14:35.531 INFO:teuthology.orchestra.run.smithi175.stdout: "uptime": 6.4783477290000002 2024-04-25T09:14:35.532 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:14:35.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc783000640 1 -- 172.21.15.175:0/2399548525 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc75c066f60 msgr2=0x7fc75c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc783000640 1 --2- 172.21.15.175:0/2399548525 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc75c066f60 0x7fc75c069420 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc77c157100 tx=0x7fc768009040 comp rx=0 tx=0).stop 2024-04-25T09:14:35.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc783000640 1 -- 172.21.15.175:0/2399548525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc77c09aaf0 msgr2=0x7fc77c0c8740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc783000640 1 --2- 172.21.15.175:0/2399548525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc77c09aaf0 0x7fc77c0c8740 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fc7700af040 tx=0x7fc770019740 comp rx=0 tx=0).stop 2024-04-25T09:14:35.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc783000640 1 -- 172.21.15.175:0/2399548525 shutdown_connections 2024-04-25T09:14:35.532 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc783000640 1 --2- 172.21.15.175:0/2399548525 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc75c066f60 0x7fc75c069420 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc783000640 1 --2- 172.21.15.175:0/2399548525 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc77c15f4e0 0x7fc77c159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc783000640 1 --2- 172.21.15.175:0/2399548525 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc77c15b970 0x7fc77c148c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc783000640 1 --2- 172.21.15.175:0/2399548525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc77c09aaf0 0x7fc77c0c8740 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc783000640 1 -- 172.21.15.175:0/2399548525 >> 172.21.15.175:0/2399548525 conn(0x7fc77c0b3160 msgr2=0x7fc77c15a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:35.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc783000640 1 -- 172.21.15.175:0/2399548525 shutdown_connections 2024-04-25T09:14:35.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.535+0000 7fc783000640 1 -- 172.21.15.175:0/2399548525 wait complete. 2024-04-25T09:14:35.543 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:14:35.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe813800640 1 Processor -- start 2024-04-25T09:14:35.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe813800640 1 -- start start 2024-04-25T09:14:35.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe813800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe80c0b0c50 0x7fe80c0cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe813800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c0d0450 con 0x7fe80c06b0e0 2024-04-25T09:14:35.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe813800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80c0afe90 con 0x7fe80c0b1090 2024-04-25T09:14:35.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe813800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80c06bbd0 con 0x7fe80c0b0c50 2024-04-25T09:14:35.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe810e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe80c06b0e0 0x7fe80c06b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:47742/0 (socket says 172.21.15.175:47742) 2024-04-25T09:14:35.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe810e00640 1 -- 172.21.15.175:0/1056655833 learned_addr learned my addr 172.21.15.175:0/1056655833 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:35.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe80be00640 1 --2- 172.21.15.175:0/1056655833 >> v2:172.21.15.177:3300/0 conn(0x7fe80c0b0c50 0x7fe80c0cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe80b400640 1 -- 172.21.15.175:0/1056655833 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404400110 0 0) 0x7fe80c0d0450 con 0x7fe80c06b0e0 2024-04-25T09:14:35.682 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe80b400640 1 -- 172.21.15.175:0/1056655833 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7f0003530 con 0x7fe80c06b0e0 2024-04-25T09:14:35.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe80b400640 1 -- 172.21.15.175:0/1056655833 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3605019923 0 0) 0x7fe7f0003530 con 0x7fe80c06b0e0 2024-04-25T09:14:35.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe80b400640 1 -- 172.21.15.175:0/1056655833 >> v2:172.21.15.177:3300/0 conn(0x7fe80c0b0c50 msgr2=0x7fe80c0cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:35.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe80b400640 1 --2- 172.21.15.175:0/1056655833 >> v2:172.21.15.177:3300/0 conn(0x7fe80c0b0c50 0x7fe80c0cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe80b400640 1 -- 172.21.15.175:0/1056655833 >> v1:172.21.15.177:6789/0 conn(0x7fe80c0b1090 legacy=0x7fe80c0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe80b400640 1 -- 172.21.15.175:0/1056655833 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c0b0170 con 0x7fe80c06b0e0 2024-04-25T09:14:35.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe80b400640 1 -- 172.21.15.175:0/1056655833 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7fe7fc001a00 con 0x7fe80c06b0e0 2024-04-25T09:14:35.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe80b400640 1 -- 172.21.15.175:0/1056655833 >> v1:172.21.15.175:6789/0 conn(0x7fe80c06b0e0 legacy=0x7fe80c06b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe80b400640 1 --2- 172.21.15.175:0/1056655833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7f00039c0 0x7fe7f0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe80b400640 1 --2- 172.21.15.175:0/1056655833 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7f00043c0 0x7fe7f0004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe80b400640 1 --2- 172.21.15.175:0/1056655833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7f0005090 0x7fe7f000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe80b400640 1 -- 172.21.15.175:0/1056655833 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f000bf10 con 0x7fe7f0005090 2024-04-25T09:14:35.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe80b400640 1 -- 172.21.15.175:0/1056655833 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f000c0c0 con 0x7fe7f00039c0 2024-04-25T09:14:35.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.691+0000 7fe80b400640 1 -- 172.21.15.175:0/1056655833 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f000c2c0 con 0x7fe7f00043c0 2024-04-25T09:14:35.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.695+0000 7fe811800640 1 --2- 172.21.15.175:0/1056655833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7f0005090 0x7fe7f000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.695+0000 7fe810e00640 1 --2- 172.21.15.175:0/1056655833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7f00039c0 0x7fe7f0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.695+0000 7fe80be00640 1 --2- 172.21.15.175:0/1056655833 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7f00043c0 0x7fe7f0004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.695+0000 7fe811800640 1 -- 172.21.15.175:0/1056655833 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7f00043c0 msgr2=0x7fe7f0004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:35.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.695+0000 7fe811800640 1 --2- 172.21.15.175:0/1056655833 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7f00043c0 0x7fe7f0004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.695+0000 7fe811800640 1 -- 172.21.15.175:0/1056655833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7f00039c0 msgr2=0x7fe7f0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:35.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.695+0000 7fe811800640 1 --2- 172.21.15.175:0/1056655833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7f00039c0 0x7fe7f0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.695+0000 7fe811800640 1 -- 172.21.15.175:0/1056655833 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f0003530 con 0x7fe7f0005090 2024-04-25T09:14:35.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.695+0000 7fe80be00640 1 --2- 172.21.15.175:0/1056655833 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe7f00043c0 0x7fe7f0004890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:35.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.695+0000 7fe811800640 1 -- 172.21.15.175:0/1056655833 reap_dead start 2024-04-25T09:14:35.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.695+0000 7fe811800640 1 --2- 172.21.15.175:0/1056655833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7f0005090 0x7fe7f000b9d0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0b14e0 tx=0x7fe80401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12e7735fe71da8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.695+0000 7fe80b400640 1 -- 172.21.15.175:0/1056655833 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8040b1070 con 0x7fe7f0005090 2024-04-25T09:14:35.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.695+0000 7fe80b400640 1 -- 172.21.15.175:0/1056655833 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8040a8050 con 0x7fe7f0005090 2024-04-25T09:14:35.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.695+0000 7fe80b400640 1 -- 172.21.15.175:0/1056655833 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804001460 con 0x7fe7f0005090 2024-04-25T09:14:35.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe813800640 1 -- 172.21.15.175:0/1056655833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7f0005090 msgr2=0x7fe7f000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe813800640 1 --2- 172.21.15.175:0/1056655833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7f0005090 0x7fe7f000b9d0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fe80c0b14e0 tx=0x7fe80401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe813800640 1 -- 172.21.15.175:0/1056655833 shutdown_connections 2024-04-25T09:14:35.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe813800640 1 --2- 172.21.15.175:0/1056655833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7f0005090 0x7fe7f000b9d0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe813800640 1 -- 172.21.15.175:0/1056655833 >> 172.21.15.175:0/1056655833 conn(0x7fe80c0d06c0 msgr2=0x7fe80c0d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:35.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe813800640 1 -- 172.21.15.175:0/1056655833 shutdown_connections 2024-04-25T09:14:35.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe813800640 1 -- 172.21.15.175:0/1056655833 wait complete. 2024-04-25T09:14:35.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe813800640 1 Processor -- start 2024-04-25T09:14:35.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe813800640 1 -- start start 2024-04-25T09:14:35.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe813800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7f0005090 0x7fe80c0c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe813800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c0c41f0 0x7fe80c155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe813800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe80c0c6570 0x7fe80c0c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe813800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c06b4c0 con 0x7fe80c0c41f0 2024-04-25T09:14:35.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe813800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0b07c0 con 0x7fe7f0005090 2024-04-25T09:14:35.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe813800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c06b640 con 0x7fe80c0c6570 2024-04-25T09:14:35.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe80be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c0c41f0 0x7fe80c155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe80be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c0c41f0 0x7fe80c155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48744/0 (socket says 172.21.15.175:48744) 2024-04-25T09:14:35.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe80be00640 1 -- 172.21.15.175:0/3102174830 learned_addr learned my addr 172.21.15.175:0/3102174830 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:35.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe810e00640 1 --2- 172.21.15.175:0/3102174830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7f0005090 0x7fe80c0c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe811800640 1 --2- 172.21.15.175:0/3102174830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe80c0c6570 0x7fe80c0c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe80be00640 1 -- 172.21.15.175:0/3102174830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe80c0c6570 msgr2=0x7fe80c0c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe80be00640 1 --2- 172.21.15.175:0/3102174830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe80c0c6570 0x7fe80c0c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe80be00640 1 -- 172.21.15.175:0/3102174830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7f0005090 msgr2=0x7fe80c0c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe80be00640 1 --2- 172.21.15.175:0/3102174830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7f0005090 0x7fe80c0c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe80be00640 1 -- 172.21.15.175:0/3102174830 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c160130 con 0x7fe80c0c41f0 2024-04-25T09:14:35.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe810e00640 1 --2- 172.21.15.175:0/3102174830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7f0005090 0x7fe80c0c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:35.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.699+0000 7fe811800640 1 --2- 172.21.15.175:0/3102174830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe80c0c6570 0x7fe80c0c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:35.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.703+0000 7fe80be00640 1 --2- 172.21.15.175:0/3102174830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c0c41f0 0x7fe80c155d30 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8011560 tx=0x7fe7f8011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.703+0000 7fe808c00640 1 -- 172.21.15.175:0/3102174830 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8004220 con 0x7fe80c0c41f0 2024-04-25T09:14:35.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.703+0000 7fe808c00640 1 -- 172.21.15.175:0/3102174830 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f80043c0 con 0x7fe80c0c41f0 2024-04-25T09:14:35.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.703+0000 7fe808c00640 1 -- 172.21.15.175:0/3102174830 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8015870 con 0x7fe80c0c41f0 2024-04-25T09:14:35.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.703+0000 7fe813800640 1 -- 172.21.15.175:0/3102174830 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80c156270 con 0x7fe80c0c41f0 2024-04-25T09:14:35.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.703+0000 7fe813800640 1 -- 172.21.15.175:0/3102174830 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c0c49d0 con 0x7fe80c0c41f0 2024-04-25T09:14:35.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.703+0000 7fe813800640 1 -- 172.21.15.175:0/3102174830 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c074a60 con 0x7fe80c0c41f0 2024-04-25T09:14:35.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.703+0000 7fe808c00640 1 -- 172.21.15.175:0/3102174830 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe7f8015a10 con 0x7fe80c0c41f0 2024-04-25T09:14:35.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.703+0000 7fe808c00640 1 --2- 172.21.15.175:0/3102174830 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe7ec066f90 0x7fe7ec069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:35.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.703+0000 7fe808c00640 1 -- 172.21.15.175:0/3102174830 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fe7f80856e0 con 0x7fe80c0c41f0 2024-04-25T09:14:35.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.703+0000 7fe810e00640 1 --2- 172.21.15.175:0/3102174830 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe7ec066f90 0x7fe7ec069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:35.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.707+0000 7fe810e00640 1 --2- 172.21.15.175:0/3102174830 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe7ec066f90 0x7fe7ec069450 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc000f90 tx=0x7fe7fc006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:35.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.707+0000 7fe808c00640 1 -- 172.21.15.175:0/3102174830 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe7f8019030 con 0x7fe80c0c41f0 2024-04-25T09:14:35.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.895+0000 7fe813800640 1 -- 172.21.15.175:0/3102174830 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe80c0b63f0 con 0x7fe80c0c41f0 2024-04-25T09:14:35.882 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.895+0000 7fe808c00640 1 -- 172.21.15.175:0/3102174830 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v106) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe7f80565b0 con 0x7fe80c0c41f0 2024-04-25T09:14:35.883 INFO:teuthology.orchestra.run.smithi175.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:14:35.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.895+0000 7fe813800640 1 -- 172.21.15.175:0/3102174830 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe7ec066f90 msgr2=0x7fe7ec069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.895+0000 7fe813800640 1 --2- 172.21.15.175:0/3102174830 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe7ec066f90 0x7fe7ec069450 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc000f90 tx=0x7fe7fc006040 comp rx=0 tx=0).stop 2024-04-25T09:14:35.884 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.895+0000 7fe813800640 1 -- 172.21.15.175:0/3102174830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c0c41f0 msgr2=0x7fe80c155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:35.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.895+0000 7fe813800640 1 --2- 172.21.15.175:0/3102174830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c0c41f0 0x7fe80c155d30 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8011560 tx=0x7fe7f8011a20 comp rx=0 tx=0).stop 2024-04-25T09:14:35.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.895+0000 7fe813800640 1 -- 172.21.15.175:0/3102174830 shutdown_connections 2024-04-25T09:14:35.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.895+0000 7fe813800640 1 --2- 172.21.15.175:0/3102174830 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe7ec066f90 0x7fe7ec069450 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.895+0000 7fe813800640 1 --2- 172.21.15.175:0/3102174830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe80c0c6570 0x7fe80c0c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.895+0000 7fe813800640 1 --2- 172.21.15.175:0/3102174830 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c0c41f0 0x7fe80c155d30 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.895+0000 7fe813800640 1 --2- 172.21.15.175:0/3102174830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe7f0005090 0x7fe80c0c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:35.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.895+0000 7fe813800640 1 -- 172.21.15.175:0/3102174830 >> 172.21.15.175:0/3102174830 conn(0x7fe80c0d06c0 msgr2=0x7fe80c161ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:35.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.895+0000 7fe813800640 1 -- 172.21.15.175:0/3102174830 shutdown_connections 2024-04-25T09:14:35.885 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:35.895+0000 7fe813800640 1 -- 172.21.15.175:0/3102174830 wait complete. 2024-04-25T09:14:35.903 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:14:35.904 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:14:35.904 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-25T09:14:35.904 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:14:35.904 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:35.904 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:14:35.904 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:14:35.904 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:14:35.904 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:14:35.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:35.904 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-25T09:14:35.913 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:14:35.913 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:14:35.913 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:14:35.913 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:35.913 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-25T09:14:35.913 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:35.913 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:14:35.914 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:35.914 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-25T09:14:35.914 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:14:35.914 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:35.914 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-25T09:14:35.914 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:14:35.914 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:35.914 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:14:35.914 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:35.914 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:14:35.914 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 41843sec preferred_lft 41843sec 2024-04-25T09:14:35.914 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2024-04-25T09:14:35.914 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:35.914 INFO:teuthology.orchestra.run.smithi175.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:14:35.914 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 02:42:0d:71:4a:a6 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:35.915 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:14:35.915 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:35.915 INFO:teuthology.orchestra.run.smithi175.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:14:35.915 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:14:35.915 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:14:35.915 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:35.915 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:14:35.915 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:35.915 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:14:35.915 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:14:35.915 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:14:35.915 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:35.915 INFO:teuthology.orchestra.run.smithi175.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:14:35.915 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:14:35.915 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:14:35.916 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:14:35.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:35.916 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:14:35.974 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:14:35.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:35.976 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-25T09:14:36.027 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-25T09:14:36.028 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:14:36.028 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:14:36.028 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:14:36.028 INFO:teuthology.orchestra.run.smithi175.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:14:36.028 INFO:teuthology.orchestra.run.smithi175.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:14:36.028 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:14:36.028 INFO:teuthology.orchestra.run.smithi175.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:14:36.028 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:14:36.028 INFO:teuthology.orchestra.run.smithi175.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:14:36.028 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:14:36.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:36.029 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2024-04-25T09:14:36.029 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-25T09:14:36.029 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:14:36.029 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:14:36.029 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:14:36.029 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-25T09:14:36.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:36.118 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:14:36.127 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:14:36.127 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:14:36.127 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:14:36.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:36.128 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-25T09:14:36.192 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:14:36.192 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:36.245 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:14:36.245 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:14:36.245 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:36.296 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:14:36.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:36.296 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:36.385 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:36.385 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:14:36.385 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:14:36.400 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:36.400 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:14:36.400 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:14:36.400 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:14:36.400 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:14:36.409 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:14:36.409 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:14:36.409 INFO:teuthology.orchestra.run.smithi175.stdout:invalid new device string format 2024-04-25T09:14:36.410 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:3300,172.21.15.177:3300,172.21.15.177:3301" 2024-04-25T09:14:36.410 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:14:36.410 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790" 2024-04-25T09:14:36.410 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.175:6789,172.21.15.177:6789,172.21.15.177:6790:/ 2024-04-25T09:14:36.410 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=8caed986-ca08-40e2-b5a5-12e2aade6223" will pass to kernel 2024-04-25T09:14:36.413 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:14:36.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:36.414 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:36.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:36.435 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:14:36.488 INFO:teuthology.orchestra.run.smithi175.stdout:client7808 2024-04-25T09:14:36.488 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:14:36.488 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:36.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:36.541 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T09:14:36.597 INFO:teuthology.orchestra.run.smithi175.stdout:./ 2024-04-25T09:14:36.597 INFO:teuthology.orchestra.run.smithi175.stdout:./parent 2024-04-25T09:14:36.597 INFO:teuthology.orchestra.run.smithi175.stdout:./parent/flushed 2024-04-25T09:14:36.597 INFO:teuthology.orchestra.run.smithi175.stdout:./parent/flushed/charlie 2024-04-25T09:14:36.597 INFO:teuthology.orchestra.run.smithi175.stdout:./parent/flushed/alpha 2024-04-25T09:14:36.597 INFO:teuthology.orchestra.run.smithi175.stdout:./parent/flushed/bravo 2024-04-25T09:14:36.597 INFO:teuthology.orchestra.run.smithi175.stdout:./parent/unflushed 2024-04-25T09:14:36.597 INFO:teuthology.orchestra.run.smithi175.stdout:./parent/unflushed/jfile 2024-04-25T09:14:36.598 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:36.598 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:36.598 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:36.598 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:36.598 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T09:14:36.598 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:36.703 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-25T09:14:36.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:36.713 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:36.713 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:36.713 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:36.713 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:36.713 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T09:14:36.713 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:36.821 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627776 2024-04-25T09:14:36.823 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:36.830 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:36.830 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:36.830 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:36.830 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:36.831 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-25T09:14:36.831 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:36.940 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627777 2024-04-25T09:14:36.942 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:36.950 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:36.950 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:36.950 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:36.950 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:36.950 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-25T09:14:36.950 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:37.057 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627780 2024-04-25T09:14:37.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:37.066 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:37.066 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:37.066 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:37.066 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:37.067 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-25T09:14:37.067 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:37.172 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627778 2024-04-25T09:14:37.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:37.181 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:37.181 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:37.181 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:37.181 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:37.182 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-04-25T09:14:37.182 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:37.292 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627779 2024-04-25T09:14:37.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:37.302 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:37.302 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:37.302 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:37.302 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:37.302 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-25T09:14:37.302 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:37.408 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627781 2024-04-25T09:14:37.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:37.417 DEBUG:teuthology.orchestra.run.smithi175:> stdin-killer -- python3 -c ' 2024-04-25T09:14:37.417 DEBUG:teuthology.orchestra.run.smithi175:> import os 2024-04-25T09:14:37.418 DEBUG:teuthology.orchestra.run.smithi175:> import stat 2024-04-25T09:14:37.418 DEBUG:teuthology.orchestra.run.smithi175:> 2024-04-25T09:14:37.418 DEBUG:teuthology.orchestra.run.smithi175:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-25T09:14:37.418 DEBUG:teuthology.orchestra.run.smithi175:> ' 2024-04-25T09:14:37.528 INFO:teuthology.orchestra.run.smithi175.stdout:1099511627782 2024-04-25T09:14:37.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:14:37.538 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:14:37.538 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:14:37.656 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:14:37.735 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:14:37.735 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:14:37.735 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:37.744 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:14:37.744 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:37.797 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:14:37.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.987+0000 7fc583200640 1 Processor -- start 2024-04-25T09:14:37.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.987+0000 7fc583200640 1 -- start start 2024-04-25T09:14:37.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.987+0000 7fc583200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5840cd890 0x7fc58409a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:37.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.987+0000 7fc583200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc58409ab50 0x7fc584099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:37.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.987+0000 7fc583200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5840cf740 con 0x7fc584099f90 2024-04-25T09:14:37.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.987+0000 7fc583200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58406c6e0 con 0x7fc58409ab50 2024-04-25T09:14:37.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.987+0000 7fc583200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58406c9c0 con 0x7fc5840cd890 2024-04-25T09:14:37.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.987+0000 7fc581e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5840cd890 0x7fc58409a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:37.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.987+0000 7fc581e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5840cd890 0x7fc58409a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:51180/0 (socket says 172.21.15.175:51180) 2024-04-25T09:14:37.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.987+0000 7fc581e00640 1 -- 172.21.15.175:0/974810799 learned_addr learned my addr 172.21.15.175:0/974810799 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:37.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.987+0000 7fc579400640 1 --2- 172.21.15.175:0/974810799 >> v2:172.21.15.177:3300/0 conn(0x7fc58409ab50 0x7fc584099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:37.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.987+0000 7fc581e00640 1 -- 172.21.15.175:0/974810799 >> v2:172.21.15.177:3300/0 conn(0x7fc58409ab50 msgr2=0x7fc584099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:37.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.987+0000 7fc581e00640 1 --2- 172.21.15.175:0/974810799 >> v2:172.21.15.177:3300/0 conn(0x7fc58409ab50 0x7fc584099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.987+0000 7fc581e00640 1 -- 172.21.15.175:0/974810799 >> v1:172.21.15.177:6789/0 conn(0x7fc584099f90 legacy=0x7fc5841618b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:37.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.987+0000 7fc581e00640 1 -- 172.21.15.175:0/974810799 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58406cca0 con 0x7fc5840cd890 2024-04-25T09:14:37.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.991+0000 7fc581e00640 1 --2- 172.21.15.175:0/974810799 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5840cd890 0x7fc58409a610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc574009e50 tx=0x7fc57401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4589aea98e59df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:37.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.991+0000 7fc581400640 1 -- 172.21.15.175:0/974810799 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740a5610 con 0x7fc5840cd890 2024-04-25T09:14:37.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.991+0000 7fc581400640 1 -- 172.21.15.175:0/974810799 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5740a57b0 con 0x7fc5840cd890 2024-04-25T09:14:37.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.991+0000 7fc581400640 1 -- 172.21.15.175:0/974810799 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740a5b80 con 0x7fc5840cd890 2024-04-25T09:14:37.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.991+0000 7fc583200640 1 -- 172.21.15.175:0/974810799 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5840cd890 msgr2=0x7fc58409a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:37.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.991+0000 7fc583200640 1 --2- 172.21.15.175:0/974810799 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5840cd890 0x7fc58409a610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc574009e50 tx=0x7fc57401ca30 comp rx=0 tx=0).stop 2024-04-25T09:14:37.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.991+0000 7fc583200640 1 -- 172.21.15.175:0/974810799 shutdown_connections 2024-04-25T09:14:37.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.991+0000 7fc583200640 1 --2- 172.21.15.175:0/974810799 >> v2:172.21.15.177:3300/0 conn(0x7fc58409ab50 0x7fc584099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.991+0000 7fc583200640 1 --2- 172.21.15.175:0/974810799 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc5840cd890 0x7fc58409a610 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.991+0000 7fc583200640 1 -- 172.21.15.175:0/974810799 >> 172.21.15.175:0/974810799 conn(0x7fc5840b31b0 msgr2=0x7fc5840b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:37.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.991+0000 7fc583200640 1 -- 172.21.15.175:0/974810799 shutdown_connections 2024-04-25T09:14:37.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.991+0000 7fc583200640 1 -- 172.21.15.175:0/974810799 wait complete. 2024-04-25T09:14:37.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc583200640 1 Processor -- start 2024-04-25T09:14:37.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc583200640 1 -- start start 2024-04-25T09:14:37.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc583200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc584099f90 0x7fc58415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:37.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc583200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc58409ab50 0x7fc5841603e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:37.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc583200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5840cd890 0x7fc584160920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:37.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc583200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5840ccd20 con 0x7fc584099f90 2024-04-25T09:14:37.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc583200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58406d780 con 0x7fc5840cd890 2024-04-25T09:14:37.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc583200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58416abf0 con 0x7fc58409ab50 2024-04-25T09:14:37.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc581e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc584099f90 0x7fc58415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:37.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc581e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc584099f90 0x7fc58415ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48750/0 (socket says 172.21.15.175:48750) 2024-04-25T09:14:37.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc581e00640 1 -- 172.21.15.175:0/647551263 learned_addr learned my addr 172.21.15.175:0/647551263 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:37.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc579400640 1 --2- 172.21.15.175:0/647551263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc58409ab50 0x7fc5841603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:37.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc582800640 1 --2- 172.21.15.175:0/647551263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5840cd890 0x7fc584160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:37.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc581e00640 1 -- 172.21.15.175:0/647551263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc58409ab50 msgr2=0x7fc5841603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:37.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc581e00640 1 --2- 172.21.15.175:0/647551263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc58409ab50 0x7fc5841603e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc581e00640 1 -- 172.21.15.175:0/647551263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5840cd890 msgr2=0x7fc584160920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:37.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc581e00640 1 --2- 172.21.15.175:0/647551263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5840cd890 0x7fc584160920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:37.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc581e00640 1 -- 172.21.15.175:0/647551263 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58415b320 con 0x7fc584099f90 2024-04-25T09:14:37.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc579400640 1 --2- 172.21.15.175:0/647551263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc58409ab50 0x7fc5841603e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:37.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc581e00640 1 --2- 172.21.15.175:0/647551263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc584099f90 0x7fc58415ade0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fc5740af040 tx=0x7fc5740197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:37.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc57aa00640 1 -- 172.21.15.175:0/647551263 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574009510 con 0x7fc584099f90 2024-04-25T09:14:37.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc57aa00640 1 -- 172.21.15.175:0/647551263 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5740be070 con 0x7fc584099f90 2024-04-25T09:14:37.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc57aa00640 1 -- 172.21.15.175:0/647551263 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740b88f0 con 0x7fc584099f90 2024-04-25T09:14:37.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc583200640 1 -- 172.21.15.175:0/647551263 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5841fa710 con 0x7fc584099f90 2024-04-25T09:14:37.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc583200640 1 -- 172.21.15.175:0/647551263 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58415b720 con 0x7fc584099f90 2024-04-25T09:14:37.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.995+0000 7fc583200640 1 -- 172.21.15.175:0/647551263 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58415b510 con 0x7fc584099f90 2024-04-25T09:14:37.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.999+0000 7fc57aa00640 1 -- 172.21.15.175:0/647551263 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc5740b8a90 con 0x7fc584099f90 2024-04-25T09:14:37.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.999+0000 7fc57aa00640 1 --2- 172.21.15.175:0/647551263 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc560066f90 0x7fc560069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:37.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.999+0000 7fc57aa00640 1 -- 172.21.15.175:0/647551263 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fc57411fb70 con 0x7fc584099f90 2024-04-25T09:14:37.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.999+0000 7fc579400640 1 --2- 172.21.15.175:0/647551263 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc560066f90 0x7fc560069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:37.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:37.999+0000 7fc579400640 1 --2- 172.21.15.175:0/647551263 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc560066f90 0x7fc560069450 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc58415d730 tx=0x7fc56c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:37.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.003+0000 7fc57aa00640 1 -- 172.21.15.175:0/647551263 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc5740c7020 con 0x7fc584099f90 2024-04-25T09:14:38.149 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.159+0000 7fc583200640 1 -- 172.21.15.175:0/647551263 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc584074a60 con 0x7fc584099f90 2024-04-25T09:14:38.150 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.163+0000 7fc57aa00640 1 -- 172.21.15.175:0/647551263 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+16924 (secure 0 0 0) 0x7fc574016620 con 0x7fc584099f90 2024-04-25T09:14:38.151 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:38.151 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":115,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:14:28.999711+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:14:01.413477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:14:02.699273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6836/386187898":"2024-04-26T09:14:28.999694+0000","172.21.15.175:6836/4128642659":"2024-04-26T09:14:18.106892+0000","172.21.15.175:6834/386187898":"2024-04-26T09:14:28.999694+0000","172.21.15.175:6834/4128642659":"2024-04-26T09:14:18.106892+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:14:38.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.163+0000 7fc583200640 1 -- 172.21.15.175:0/647551263 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc560066f90 msgr2=0x7fc560069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.163+0000 7fc583200640 1 --2- 172.21.15.175:0/647551263 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc560066f90 0x7fc560069450 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fc58415d730 tx=0x7fc56c008040 comp rx=0 tx=0).stop 2024-04-25T09:14:38.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.163+0000 7fc583200640 1 -- 172.21.15.175:0/647551263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc584099f90 msgr2=0x7fc58415ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.163+0000 7fc583200640 1 --2- 172.21.15.175:0/647551263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc584099f90 0x7fc58415ade0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fc5740af040 tx=0x7fc5740197d0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.163+0000 7fc583200640 1 -- 172.21.15.175:0/647551263 shutdown_connections 2024-04-25T09:14:38.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.163+0000 7fc583200640 1 --2- 172.21.15.175:0/647551263 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc560066f90 0x7fc560069450 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.163+0000 7fc583200640 1 --2- 172.21.15.175:0/647551263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc5840cd890 0x7fc584160920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.163+0000 7fc583200640 1 --2- 172.21.15.175:0/647551263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc58409ab50 0x7fc5841603e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.163+0000 7fc583200640 1 --2- 172.21.15.175:0/647551263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc584099f90 0x7fc58415ade0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.163+0000 7fc583200640 1 -- 172.21.15.175:0/647551263 >> 172.21.15.175:0/647551263 conn(0x7fc5840b31b0 msgr2=0x7fc5840cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:38.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.163+0000 7fc583200640 1 -- 172.21.15.175:0/647551263 shutdown_connections 2024-04-25T09:14:38.153 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.163+0000 7fc583200640 1 -- 172.21.15.175:0/647551263 wait complete. 2024-04-25T09:14:38.172 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:14:01.413477+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:14:02.699273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:14:38.172 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:14:38.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.319+0000 7fd8e9800640 1 Processor -- start 2024-04-25T09:14:38.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.323+0000 7fd8e9800640 1 -- start start 2024-04-25T09:14:38.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.323+0000 7fd8e9800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd8e4145250 0x7fd8e40cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.323+0000 7fd8e9800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd8e41600a0 0x7fd8e40cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.323+0000 7fd8e9800640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e40cfd10 con 0x7fd8e40ce970 2024-04-25T09:14:38.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.323+0000 7fd8e9800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e415f650 con 0x7fd8e41600a0 2024-04-25T09:14:38.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.323+0000 7fd8e9800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e40cfff0 con 0x7fd8e4145250 2024-04-25T09:14:38.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.323+0000 7fd8e2000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd8e41600a0 0x7fd8e40cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.323+0000 7fd8e2000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd8e41600a0 0x7fd8e40cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48764/0 (socket says 172.21.15.175:48764) 2024-04-25T09:14:38.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.323+0000 7fd8e2000640 1 -- 172.21.15.175:0/3467541859 learned_addr learned my addr 172.21.15.175:0/3467541859 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:38.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.323+0000 7fd8e2a00640 1 --2- 172.21.15.175:0/3467541859 >> v2:172.21.15.177:3300/0 conn(0x7fd8e4145250 0x7fd8e40cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.323+0000 7fd8e2000640 1 -- 172.21.15.175:0/3467541859 >> v2:172.21.15.177:3300/0 conn(0x7fd8e4145250 msgr2=0x7fd8e40cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:38.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.323+0000 7fd8e2000640 1 --2- 172.21.15.175:0/3467541859 >> v2:172.21.15.177:3300/0 conn(0x7fd8e4145250 0x7fd8e40cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.323+0000 7fd8e2000640 1 -- 172.21.15.175:0/3467541859 >> v1:172.21.15.177:6789/0 conn(0x7fd8e40ce970 legacy=0x7fd8e40cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.323+0000 7fd8e2000640 1 -- 172.21.15.175:0/3467541859 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e415f8a0 con 0x7fd8e41600a0 2024-04-25T09:14:38.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.327+0000 7fd8e2000640 1 --2- 172.21.15.175:0/3467541859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8e41600a0 0x7fd8e40cc410 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4009870 tx=0x7fd8d401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fdee79b26f49c54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:38.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.327+0000 7fd8e1600640 1 -- 172.21.15.175:0/3467541859 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d40aa430 con 0x7fd8e41600a0 2024-04-25T09:14:38.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.327+0000 7fd8e1600640 1 -- 172.21.15.175:0/3467541859 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d40af070 con 0x7fd8e41600a0 2024-04-25T09:14:38.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.327+0000 7fd8e1600640 1 -- 172.21.15.175:0/3467541859 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d40aa7f0 con 0x7fd8e41600a0 2024-04-25T09:14:38.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.327+0000 7fd8e9800640 1 -- 172.21.15.175:0/3467541859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8e41600a0 msgr2=0x7fd8e40cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.327+0000 7fd8e9800640 1 --2- 172.21.15.175:0/3467541859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8e41600a0 0x7fd8e40cc410 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4009870 tx=0x7fd8d401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.327+0000 7fd8e9800640 1 -- 172.21.15.175:0/3467541859 shutdown_connections 2024-04-25T09:14:38.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.327+0000 7fd8e9800640 1 --2- 172.21.15.175:0/3467541859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8e41600a0 0x7fd8e40cc410 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.327+0000 7fd8e9800640 1 --2- 172.21.15.175:0/3467541859 >> v2:172.21.15.177:3300/0 conn(0x7fd8e4145250 0x7fd8e40cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.327+0000 7fd8e9800640 1 -- 172.21.15.175:0/3467541859 >> 172.21.15.175:0/3467541859 conn(0x7fd8e406ac50 msgr2=0x7fd8e406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:38.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.327+0000 7fd8e9800640 1 -- 172.21.15.175:0/3467541859 shutdown_connections 2024-04-25T09:14:38.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.327+0000 7fd8e9800640 1 -- 172.21.15.175:0/3467541859 wait complete. 2024-04-25T09:14:38.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.327+0000 7fd8e9800640 1 Processor -- start 2024-04-25T09:14:38.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.327+0000 7fd8e9800640 1 -- start start 2024-04-25T09:14:38.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e9800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd8e40ce970 0x7fd8e40aa500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e9800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8e4145250 0x7fd8e40ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e9800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8e41600a0 0x7fd8e4143720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e9800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e415c870 con 0x7fd8e41600a0 2024-04-25T09:14:38.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e9800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e4145630 con 0x7fd8e4145250 2024-04-25T09:14:38.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e9800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e415c9f0 con 0x7fd8e40ce970 2024-04-25T09:14:38.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8e41600a0 0x7fd8e4143720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e3400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8e41600a0 0x7fd8e4143720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48766/0 (socket says 172.21.15.175:48766) 2024-04-25T09:14:38.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e2a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd8e40ce970 0x7fd8e40aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e3400640 1 -- 172.21.15.175:0/217147002 learned_addr learned my addr 172.21.15.175:0/217147002 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:38.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e2000640 1 --2- 172.21.15.175:0/217147002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8e4145250 0x7fd8e40ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e3400640 1 -- 172.21.15.175:0/217147002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd8e40ce970 msgr2=0x7fd8e40aa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e3400640 1 --2- 172.21.15.175:0/217147002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd8e40ce970 0x7fd8e40aa500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e3400640 1 -- 172.21.15.175:0/217147002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8e4145250 msgr2=0x7fd8e40ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e3400640 1 --2- 172.21.15.175:0/217147002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8e4145250 0x7fd8e40ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e3400640 1 -- 172.21.15.175:0/217147002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e40aae30 con 0x7fd8e41600a0 2024-04-25T09:14:38.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e3400640 1 --2- 172.21.15.175:0/217147002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8e41600a0 0x7fd8e4143720 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00c770 tx=0x7fd8dc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:38.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8daa00640 1 -- 172.21.15.175:0/217147002 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc003b80 con 0x7fd8e41600a0 2024-04-25T09:14:38.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8daa00640 1 -- 172.21.15.175:0/217147002 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8dc003d20 con 0x7fd8e41600a0 2024-04-25T09:14:38.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8daa00640 1 -- 172.21.15.175:0/217147002 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc00aa90 con 0x7fd8e41600a0 2024-04-25T09:14:38.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e9800640 1 -- 172.21.15.175:0/217147002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e40ab3c0 con 0x7fd8e41600a0 2024-04-25T09:14:38.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e9800640 1 -- 172.21.15.175:0/217147002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e40ab980 con 0x7fd8e41600a0 2024-04-25T09:14:38.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8e9800640 1 -- 172.21.15.175:0/217147002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e4075160 con 0x7fd8e41600a0 2024-04-25T09:14:38.321 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.331+0000 7fd8daa00640 1 -- 172.21.15.175:0/217147002 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd8dc00ac30 con 0x7fd8e41600a0 2024-04-25T09:14:38.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.335+0000 7fd8daa00640 1 --2- 172.21.15.175:0/217147002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd8c0066f60 0x7fd8c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.335+0000 7fd8daa00640 1 -- 172.21.15.175:0/217147002 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fd8dc084ff0 con 0x7fd8e41600a0 2024-04-25T09:14:38.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.335+0000 7fd8e2a00640 1 --2- 172.21.15.175:0/217147002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd8c0066f60 0x7fd8c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.335+0000 7fd8e2a00640 1 --2- 172.21.15.175:0/217147002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd8c0066f60 0x7fd8c0069420 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd8e41447b0 tx=0x7fd8cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:38.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.339+0000 7fd8daa00640 1 -- 172.21.15.175:0/217147002 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd8dc0557f0 con 0x7fd8e41600a0 2024-04-25T09:14:38.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.491+0000 7fd8e9800640 1 -- 172.21.15.175:0/217147002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8e40abb50 con 0x7fd8e41600a0 2024-04-25T09:14:38.479 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.491+0000 7fd8daa00640 1 -- 172.21.15.175:0/217147002 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8dc059890 con 0x7fd8e41600a0 2024-04-25T09:14:38.479 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:14:38.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.491+0000 7fd8e9800640 1 -- 172.21.15.175:0/217147002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd8c0066f60 msgr2=0x7fd8c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.491+0000 7fd8e9800640 1 --2- 172.21.15.175:0/217147002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd8c0066f60 0x7fd8c0069420 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fd8e41447b0 tx=0x7fd8cc008040 comp rx=0 tx=0).stop 2024-04-25T09:14:38.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.491+0000 7fd8e9800640 1 -- 172.21.15.175:0/217147002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8e41600a0 msgr2=0x7fd8e4143720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.491+0000 7fd8e9800640 1 --2- 172.21.15.175:0/217147002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8e41600a0 0x7fd8e4143720 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc00c770 tx=0x7fd8dc00cc30 comp rx=0 tx=0).stop 2024-04-25T09:14:38.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.491+0000 7fd8e9800640 1 -- 172.21.15.175:0/217147002 shutdown_connections 2024-04-25T09:14:38.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.491+0000 7fd8e9800640 1 --2- 172.21.15.175:0/217147002 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd8c0066f60 0x7fd8c0069420 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.491+0000 7fd8e9800640 1 --2- 172.21.15.175:0/217147002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8e41600a0 0x7fd8e4143720 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.491+0000 7fd8e9800640 1 --2- 172.21.15.175:0/217147002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8e4145250 0x7fd8e40ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.491+0000 7fd8e9800640 1 --2- 172.21.15.175:0/217147002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd8e40ce970 0x7fd8e40aa500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.491+0000 7fd8e9800640 1 -- 172.21.15.175:0/217147002 >> 172.21.15.175:0/217147002 conn(0x7fd8e406ac50 msgr2=0x7fd8e406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:38.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.491+0000 7fd8e9800640 1 -- 172.21.15.175:0/217147002 shutdown_connections 2024-04-25T09:14:38.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.491+0000 7fd8e9800640 1 -- 172.21.15.175:0/217147002 wait complete. 2024-04-25T09:14:38.499 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:14:38.637 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab7e00640 1 Processor -- start 2024-04-25T09:14:38.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab7e00640 1 -- start start 2024-04-25T09:14:38.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab7e00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8ab015bca0 0x7f8ab00b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab7e00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8ab009aa90 0x7f8ab0099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab7e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ab0099f90 0x7f8ab00cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab7e00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab00cd7f0 con 0x7f8ab015bca0 2024-04-25T09:14:38.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab7e00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab00cff90 con 0x7f8ab009aa90 2024-04-25T09:14:38.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab7e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab009af10 con 0x7f8ab0099f90 2024-04-25T09:14:38.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab5400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8ab015bca0 0x7f8ab00b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab5400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8ab015bca0 0x7f8ab00b0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48768/0 (socket says 172.21.15.175:48768) 2024-04-25T09:14:38.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab5400640 1 -- 172.21.15.175:0/1346067016 learned_addr learned my addr 172.21.15.175:0/1346067016 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:38.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab4a00640 1 --2- 172.21.15.175:0/1346067016 >> v2:172.21.15.177:3300/0 conn(0x7f8ab009aa90 0x7f8ab0099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab5e00640 1 --2- 172.21.15.175:0/1346067016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ab0099f90 0x7f8ab00cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab5400640 1 -- 172.21.15.175:0/1346067016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ab0099f90 msgr2=0x7f8ab00cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:38.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab5400640 1 --2- 172.21.15.175:0/1346067016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ab0099f90 0x7f8ab00cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab5400640 1 -- 172.21.15.175:0/1346067016 >> v2:172.21.15.177:3300/0 conn(0x7f8ab009aa90 msgr2=0x7f8ab0099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:38.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab5400640 1 --2- 172.21.15.175:0/1346067016 >> v2:172.21.15.177:3300/0 conn(0x7f8ab009aa90 0x7f8ab0099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab5400640 1 -- 172.21.15.175:0/1346067016 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab00d0230 con 0x7f8ab015bca0 2024-04-25T09:14:38.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.651+0000 7f8ab5e00640 1 --2- 172.21.15.175:0/1346067016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ab0099f90 0x7f8ab00cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:38.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.655+0000 7f8ab5400640 1 --2- 172.21.15.175:0/1346067016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ab015bca0 0x7f8ab00b0ac0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0073180 tx=0x7f8aa401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ef7a4150cbf02e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:38.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.655+0000 7f8aafe00640 1 -- 172.21.15.175:0/1346067016 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40b1070 con 0x7f8ab015bca0 2024-04-25T09:14:38.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.655+0000 7f8aafe00640 1 -- 172.21.15.175:0/1346067016 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa40ac630 con 0x7f8ab015bca0 2024-04-25T09:14:38.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.655+0000 7f8aafe00640 1 -- 172.21.15.175:0/1346067016 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40a8050 con 0x7f8ab015bca0 2024-04-25T09:14:38.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.655+0000 7f8ab7e00640 1 -- 172.21.15.175:0/1346067016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ab015bca0 msgr2=0x7f8ab00b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.655+0000 7f8ab7e00640 1 --2- 172.21.15.175:0/1346067016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ab015bca0 0x7f8ab00b0ac0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0073180 tx=0x7f8aa401c520 comp rx=0 tx=0).stop 2024-04-25T09:14:38.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.655+0000 7f8ab7e00640 1 -- 172.21.15.175:0/1346067016 shutdown_connections 2024-04-25T09:14:38.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.655+0000 7f8ab7e00640 1 --2- 172.21.15.175:0/1346067016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ab0099f90 0x7f8ab00cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.655+0000 7f8ab7e00640 1 --2- 172.21.15.175:0/1346067016 >> v2:172.21.15.177:3300/0 conn(0x7f8ab009aa90 0x7f8ab0099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.655+0000 7f8ab7e00640 1 --2- 172.21.15.175:0/1346067016 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ab015bca0 0x7f8ab00b0ac0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.655+0000 7f8ab7e00640 1 -- 172.21.15.175:0/1346067016 >> 172.21.15.175:0/1346067016 conn(0x7f8ab00b3400 msgr2=0x7f8ab00b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:38.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.655+0000 7f8ab7e00640 1 -- 172.21.15.175:0/1346067016 shutdown_connections 2024-04-25T09:14:38.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.655+0000 7f8ab7e00640 1 -- 172.21.15.175:0/1346067016 wait complete. 2024-04-25T09:14:38.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab7e00640 1 Processor -- start 2024-04-25T09:14:38.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab7e00640 1 -- start start 2024-04-25T09:14:38.647 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab7e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ab0099f90 0x7f8ab0158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab7e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ab009aa90 0x7f8ab00b6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab7e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ab015bca0 0x7f8ab015db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab7e00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab00b19b0 con 0x7f8ab015bca0 2024-04-25T09:14:38.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab7e00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab00b1830 con 0x7f8ab009aa90 2024-04-25T09:14:38.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab7e00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab00b1b30 con 0x7f8ab0099f90 2024-04-25T09:14:38.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab5e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ab015bca0 0x7f8ab015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab5e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ab015bca0 0x7f8ab015db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48782/0 (socket says 172.21.15.175:48782) 2024-04-25T09:14:38.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab5e00640 1 -- 172.21.15.175:0/3837886175 learned_addr learned my addr 172.21.15.175:0/3837886175 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:38.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab4a00640 1 --2- 172.21.15.175:0/3837886175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ab009aa90 0x7f8ab00b6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab5400640 1 --2- 172.21.15.175:0/3837886175 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ab0099f90 0x7f8ab0158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab5e00640 1 -- 172.21.15.175:0/3837886175 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ab0099f90 msgr2=0x7f8ab0158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab5e00640 1 --2- 172.21.15.175:0/3837886175 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ab0099f90 0x7f8ab0158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab5e00640 1 -- 172.21.15.175:0/3837886175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ab009aa90 msgr2=0x7f8ab00b6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab5e00640 1 --2- 172.21.15.175:0/3837886175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ab009aa90 0x7f8ab00b6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab5e00640 1 -- 172.21.15.175:0/3837886175 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab015c510 con 0x7f8ab015bca0 2024-04-25T09:14:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab5e00640 1 --2- 172.21.15.175:0/3837886175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ab015bca0 0x7f8ab015db70 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8007e10 tx=0x7f8aa800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8aad600640 1 -- 172.21.15.175:0/3837886175 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa801a070 con 0x7f8ab015bca0 2024-04-25T09:14:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8aad600640 1 -- 172.21.15.175:0/3837886175 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa8003ba0 con 0x7f8ab015bca0 2024-04-25T09:14:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8aad600640 1 -- 172.21.15.175:0/3837886175 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8004030 con 0x7f8ab015bca0 2024-04-25T09:14:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab7e00640 1 -- 172.21.15.175:0/3837886175 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab00afda0 con 0x7f8ab015bca0 2024-04-25T09:14:38.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab7e00640 1 -- 172.21.15.175:0/3837886175 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab0159240 con 0x7f8ab015bca0 2024-04-25T09:14:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.659+0000 7f8ab7e00640 1 -- 172.21.15.175:0/3837886175 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab0075160 con 0x7f8ab015bca0 2024-04-25T09:14:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.663+0000 7f8aad600640 1 -- 172.21.15.175:0/3837886175 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8aa801d070 con 0x7f8ab015bca0 2024-04-25T09:14:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.663+0000 7f8aad600640 1 --2- 172.21.15.175:0/3837886175 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8a90066f60 0x7f8a90069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.663+0000 7f8aad600640 1 -- 172.21.15.175:0/3837886175 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f8aa8085440 con 0x7f8ab015bca0 2024-04-25T09:14:38.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.663+0000 7f8ab5400640 1 --2- 172.21.15.175:0/3837886175 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8a90066f60 0x7f8a90069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.663+0000 7f8ab5400640 1 --2- 172.21.15.175:0/3837886175 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8a90066f60 0x7f8a90069420 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40ae000 tx=0x7f8aa4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:38.654 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.667+0000 7f8aad600640 1 -- 172.21.15.175:0/3837886175 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8aa8010070 con 0x7f8ab015bca0 2024-04-25T09:14:38.806 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.819+0000 7f8ab7e00640 1 -- 172.21.15.175:0/3837886175 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ab006e450 con 0x7f8ab015bca0 2024-04-25T09:14:38.807 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.819+0000 7f8aad600640 1 -- 172.21.15.175:0/3837886175 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v115) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8aa8056300 con 0x7f8ab015bca0 2024-04-25T09:14:38.807 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:14:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.819+0000 7f8ab7e00640 1 -- 172.21.15.175:0/3837886175 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8a90066f60 msgr2=0x7f8a90069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.819+0000 7f8ab7e00640 1 --2- 172.21.15.175:0/3837886175 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8a90066f60 0x7f8a90069420 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40ae000 tx=0x7f8aa4008040 comp rx=0 tx=0).stop 2024-04-25T09:14:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.819+0000 7f8ab7e00640 1 -- 172.21.15.175:0/3837886175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ab015bca0 msgr2=0x7f8ab015db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.819+0000 7f8ab7e00640 1 --2- 172.21.15.175:0/3837886175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ab015bca0 0x7f8ab015db70 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8007e10 tx=0x7f8aa800d4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.819+0000 7f8ab7e00640 1 -- 172.21.15.175:0/3837886175 shutdown_connections 2024-04-25T09:14:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.819+0000 7f8ab7e00640 1 --2- 172.21.15.175:0/3837886175 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8a90066f60 0x7f8a90069420 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.819+0000 7f8ab7e00640 1 --2- 172.21.15.175:0/3837886175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ab015bca0 0x7f8ab015db70 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.819+0000 7f8ab7e00640 1 --2- 172.21.15.175:0/3837886175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8ab009aa90 0x7f8ab00b6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.819+0000 7f8ab7e00640 1 --2- 172.21.15.175:0/3837886175 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8ab0099f90 0x7f8ab0158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.809 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.819+0000 7f8ab7e00640 1 -- 172.21.15.175:0/3837886175 >> 172.21.15.175:0/3837886175 conn(0x7f8ab00b3400 msgr2=0x7f8ab006cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:38.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.819+0000 7f8ab7e00640 1 -- 172.21.15.175:0/3837886175 shutdown_connections 2024-04-25T09:14:38.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.819+0000 7f8ab7e00640 1 -- 172.21.15.175:0/3837886175 wait complete. 2024-04-25T09:14:38.827 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:14:38.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.979+0000 7f7138000640 1 Processor -- start 2024-04-25T09:14:38.967 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.979+0000 7f7138000640 1 -- start start 2024-04-25T09:14:38.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.979+0000 7f7138000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71300719e0 0x7f713015aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.979+0000 7f7138000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713015dd10 con 0x7f71300b3230 2024-04-25T09:14:38.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.979+0000 7f7138000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713015dff0 con 0x7f71300b2660 2024-04-25T09:14:38.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.979+0000 7f7138000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713015e2d0 con 0x7f71300719e0 2024-04-25T09:14:38.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.979+0000 7f7135600640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f71300b3230 0x7f71300b3d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:47746/0 (socket says 172.21.15.175:47746) 2024-04-25T09:14:38.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.979+0000 7f7135600640 1 -- 172.21.15.175:0/2118570615 learned_addr learned my addr 172.21.15.175:0/2118570615 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:38.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.979+0000 7f7136000640 1 --2- 172.21.15.175:0/2118570615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71300719e0 0x7f713015aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.979+0000 7f712fe00640 1 -- 172.21.15.175:0/2118570615 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594988118 0 0) 0x7f713015dd10 con 0x7f71300b3230 2024-04-25T09:14:38.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.979+0000 7f712fe00640 1 -- 172.21.15.175:0/2118570615 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7118004640 con 0x7f71300b3230 2024-04-25T09:14:38.969 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.979+0000 7f712fe00640 1 -- 172.21.15.175:0/2118570615 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705715889 0 0) 0x7f713015dff0 con 0x7f71300b2660 2024-04-25T09:14:38.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.979+0000 7f712fe00640 1 -- 172.21.15.175:0/2118570615 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f713015dd10 con 0x7f71300b2660 2024-04-25T09:14:38.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.979+0000 7f712fe00640 1 -- 172.21.15.175:0/2118570615 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 223509336 0 0) 0x7f7118004640 con 0x7f71300b3230 2024-04-25T09:14:38.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.979+0000 7f7136000640 1 -- 172.21.15.175:0/2118570615 >> v1:172.21.15.177:6789/0 conn(0x7f71300b2660 legacy=0x7f71300712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.979+0000 7f7136000640 1 -- 172.21.15.175:0/2118570615 >> v1:172.21.15.175:6789/0 conn(0x7f71300b3230 legacy=0x7f71300b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.970 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.983+0000 7f7136000640 1 -- 172.21.15.175:0/2118570615 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713015e5b0 con 0x7f71300719e0 2024-04-25T09:14:38.972 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.983+0000 7f7136000640 1 --2- 172.21.15.175:0/2118570615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71300719e0 0x7f713015aa70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7128009dc0 tx=0x7f712801c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82be0de28c0d3ca0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:38.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.983+0000 7f712fe00640 1 -- 172.21.15.175:0/2118570615 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71280b2070 con 0x7f71300719e0 2024-04-25T09:14:38.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.983+0000 7f712fe00640 1 -- 172.21.15.175:0/2118570615 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71280a5670 con 0x7f71300719e0 2024-04-25T09:14:38.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.983+0000 7f712fe00640 1 -- 172.21.15.175:0/2118570615 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7124001680 con 0x7f71300719e0 2024-04-25T09:14:38.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.983+0000 7f7138000640 1 -- 172.21.15.175:0/2118570615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71300719e0 msgr2=0x7f713015aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.983+0000 7f7138000640 1 --2- 172.21.15.175:0/2118570615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71300719e0 0x7f713015aa70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7128009dc0 tx=0x7f712801c8b0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.983+0000 7f7138000640 1 -- 172.21.15.175:0/2118570615 shutdown_connections 2024-04-25T09:14:38.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.983+0000 7f7138000640 1 --2- 172.21.15.175:0/2118570615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71300719e0 0x7f713015aa70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.983+0000 7f7138000640 1 -- 172.21.15.175:0/2118570615 >> 172.21.15.175:0/2118570615 conn(0x7f713006ac50 msgr2=0x7f713006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:38.973 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.983+0000 7f7138000640 1 -- 172.21.15.175:0/2118570615 shutdown_connections 2024-04-25T09:14:38.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.983+0000 7f7138000640 1 -- 172.21.15.175:0/2118570615 wait complete. 2024-04-25T09:14:38.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7138000640 1 Processor -- start 2024-04-25T09:14:38.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7138000640 1 -- start start 2024-04-25T09:14:38.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7138000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71300719e0 0x7f7130153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7138000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71300b2660 0x7f71300adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7138000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71300b3230 0x7f7130140cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7138000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71300b45b0 con 0x7f71300b2660 2024-04-25T09:14:38.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7138000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71300b4430 con 0x7f71300b3230 2024-04-25T09:14:38.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7138000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713015afb0 con 0x7f71300719e0 2024-04-25T09:14:38.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7134c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71300b2660 0x7f71300adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7134c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71300b2660 0x7f71300adca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:48798/0 (socket says 172.21.15.175:48798) 2024-04-25T09:14:38.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7134c00640 1 -- 172.21.15.175:0/1254026239 learned_addr learned my addr 172.21.15.175:0/1254026239 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:38.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7134c00640 1 -- 172.21.15.175:0/1254026239 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71300719e0 msgr2=0x7f7130153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7135600640 1 --2- 172.21.15.175:0/1254026239 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71300719e0 0x7f7130153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7136000640 1 --2- 172.21.15.175:0/1254026239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71300b3230 0x7f7130140cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7134c00640 1 --2- 172.21.15.175:0/1254026239 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71300719e0 0x7f7130153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7134c00640 1 -- 172.21.15.175:0/1254026239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71300b3230 msgr2=0x7f7130140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:38.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7134c00640 1 --2- 172.21.15.175:0/1254026239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71300b3230 0x7f7130140cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:38.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7134c00640 1 -- 172.21.15.175:0/1254026239 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7130154130 con 0x7f71300b2660 2024-04-25T09:14:38.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7136000640 1 --2- 172.21.15.175:0/1254026239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71300b3230 0x7f7130140cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:38.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7135600640 1 --2- 172.21.15.175:0/1254026239 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71300719e0 0x7f7130153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:38.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7134c00640 1 --2- 172.21.15.175:0/1254026239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71300b2660 0x7f71300adca0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f711c00c500 tx=0x7f711c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:38.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f712d600640 1 -- 172.21.15.175:0/1254026239 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c0052d0 con 0x7f71300b2660 2024-04-25T09:14:38.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f712d600640 1 -- 172.21.15.175:0/1254026239 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c005490 con 0x7f71300b2660 2024-04-25T09:14:38.978 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f712d600640 1 -- 172.21.15.175:0/1254026239 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c012850 con 0x7f71300b2660 2024-04-25T09:14:38.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7138000640 1 -- 172.21.15.175:0/1254026239 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71301552a0 con 0x7f71300b2660 2024-04-25T09:14:38.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.987+0000 7f7138000640 1 -- 172.21.15.175:0/1254026239 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71301576f0 con 0x7f71300b2660 2024-04-25T09:14:38.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.991+0000 7f7138000640 1 -- 172.21.15.175:0/1254026239 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7130075160 con 0x7f71300b2660 2024-04-25T09:14:38.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.991+0000 7f712d600640 1 -- 172.21.15.175:0/1254026239 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f711c0129f0 con 0x7f71300b2660 2024-04-25T09:14:38.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.991+0000 7f712d600640 1 --2- 172.21.15.175:0/1254026239 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7110066f60 0x7f7110069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:38.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.991+0000 7f712d600640 1 -- 172.21.15.175:0/1254026239 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f711c084e40 con 0x7f71300b2660 2024-04-25T09:14:38.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.991+0000 7f7135600640 1 --2- 172.21.15.175:0/1254026239 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7110066f60 0x7f7110069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:38.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.991+0000 7f7135600640 1 --2- 172.21.15.175:0/1254026239 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7110066f60 0x7f7110069420 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f71240011f0 tx=0x7f7124009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:38.983 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:38.995+0000 7f712d600640 1 -- 172.21.15.175:0/1254026239 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f711c0556c0 con 0x7f71300b2660 2024-04-25T09:14:39.140 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.151+0000 7f7138000640 1 -- 172.21.15.175:0/1254026239 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7130072370 con 0x7f71300b2660 2024-04-25T09:14:39.141 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.155+0000 7f712d600640 1 -- 172.21.15.175:0/1254026239 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v115) v1 ==== 100+0+11 (secure 0 0 0) 0x7f711c059760 con 0x7f71300b2660 2024-04-25T09:14:39.141 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:14:39.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.155+0000 7f7138000640 1 -- 172.21.15.175:0/1254026239 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7110066f60 msgr2=0x7f7110069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.155+0000 7f7138000640 1 --2- 172.21.15.175:0/1254026239 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7110066f60 0x7f7110069420 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f71240011f0 tx=0x7f7124009040 comp rx=0 tx=0).stop 2024-04-25T09:14:39.143 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.155+0000 7f7138000640 1 -- 172.21.15.175:0/1254026239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71300b2660 msgr2=0x7f71300adca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.155+0000 7f7138000640 1 --2- 172.21.15.175:0/1254026239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71300b2660 0x7f71300adca0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f711c00c500 tx=0x7f711c00c9c0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.155+0000 7f7138000640 1 -- 172.21.15.175:0/1254026239 shutdown_connections 2024-04-25T09:14:39.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.155+0000 7f7138000640 1 --2- 172.21.15.175:0/1254026239 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7110066f60 0x7f7110069420 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.155+0000 7f7138000640 1 --2- 172.21.15.175:0/1254026239 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71300b3230 0x7f7130140cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.155+0000 7f7138000640 1 --2- 172.21.15.175:0/1254026239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f71300b2660 0x7f71300adca0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.155+0000 7f7138000640 1 --2- 172.21.15.175:0/1254026239 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71300719e0 0x7f7130153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.155+0000 7f7138000640 1 -- 172.21.15.175:0/1254026239 >> 172.21.15.175:0/1254026239 conn(0x7f713006ac50 msgr2=0x7f71300b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:39.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.155+0000 7f7138000640 1 -- 172.21.15.175:0/1254026239 shutdown_connections 2024-04-25T09:14:39.144 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.155+0000 7f7138000640 1 -- 172.21.15.175:0/1254026239 wait complete. 2024-04-25T09:14:39.163 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:14:39.299 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.311+0000 7f1d10600640 1 Processor -- start 2024-04-25T09:14:39.300 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.311+0000 7f1d10600640 1 -- start start 2024-04-25T09:14:39.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.311+0000 7f1d10600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1d080cf6b0 0x7f1d081600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.311+0000 7f1d10600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d080ce970 0x7f1d080cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.301 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.311+0000 7f1d10600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d080cfd10 con 0x7f1d08145250 2024-04-25T09:14:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.311+0000 7f1d10600640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d081605e0 con 0x7f1d080cf6b0 2024-04-25T09:14:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.311+0000 7f1d10600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0815f650 con 0x7f1d080ce970 2024-04-25T09:14:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.311+0000 7f1d0d200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1d080cf6b0 0x7f1d081600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.311+0000 7f1d0dc00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f1d08145250 0x7f1d080cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:47750/0 (socket says 172.21.15.175:47750) 2024-04-25T09:14:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.315+0000 7f1d0dc00640 1 -- 172.21.15.175:0/67438053 learned_addr learned my addr 172.21.15.175:0/67438053 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.315+0000 7f1d0e600640 1 --2- 172.21.15.175:0/67438053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d080ce970 0x7f1d080cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.315+0000 7f1d0d200640 1 -- 172.21.15.175:0/67438053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d080ce970 msgr2=0x7f1d080cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.315+0000 7f1d0d200640 1 --2- 172.21.15.175:0/67438053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d080ce970 0x7f1d080cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.315+0000 7f1d0d200640 1 -- 172.21.15.175:0/67438053 >> v1:172.21.15.175:6789/0 conn(0x7f1d08145250 legacy=0x7f1d080cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.315+0000 7f1d0d200640 1 -- 172.21.15.175:0/67438053 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d080cfff0 con 0x7f1d080cf6b0 2024-04-25T09:14:39.302 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.315+0000 7f1d07e00640 1 -- 172.21.15.175:0/67438053 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055814866 0 0) 0x7f1d080cfd10 con 0x7f1d08145250 2024-04-25T09:14:39.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.315+0000 7f1d0d200640 1 --2- 172.21.15.175:0/67438053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d080cf6b0 0x7f1d081600a0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40097f0 tx=0x7f1cf401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1125a2d6b73528be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:39.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.315+0000 7f1d07e00640 1 -- 172.21.15.175:0/67438053 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40b0070 con 0x7f1d080cf6b0 2024-04-25T09:14:39.304 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.315+0000 7f1d07e00640 1 -- 172.21.15.175:0/67438053 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf40ab600 con 0x7f1d080cf6b0 2024-04-25T09:14:39.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.315+0000 7f1d07e00640 1 -- 172.21.15.175:0/67438053 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40ab9d0 con 0x7f1d080cf6b0 2024-04-25T09:14:39.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d10600640 1 -- 172.21.15.175:0/67438053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d080cf6b0 msgr2=0x7f1d081600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d10600640 1 --2- 172.21.15.175:0/67438053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d080cf6b0 0x7f1d081600a0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f1cf40097f0 tx=0x7f1cf401c410 comp rx=0 tx=0).stop 2024-04-25T09:14:39.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d10600640 1 -- 172.21.15.175:0/67438053 shutdown_connections 2024-04-25T09:14:39.305 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d10600640 1 --2- 172.21.15.175:0/67438053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d080ce970 0x7f1d080cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d10600640 1 --2- 172.21.15.175:0/67438053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d080cf6b0 0x7f1d081600a0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d10600640 1 -- 172.21.15.175:0/67438053 >> 172.21.15.175:0/67438053 conn(0x7f1d0806ac50 msgr2=0x7f1d0806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:39.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d10600640 1 -- 172.21.15.175:0/67438053 shutdown_connections 2024-04-25T09:14:39.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d10600640 1 -- 172.21.15.175:0/67438053 wait complete. 2024-04-25T09:14:39.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d10600640 1 Processor -- start 2024-04-25T09:14:39.307 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d10600640 1 -- start start 2024-04-25T09:14:39.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d10600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d080ce970 0x7f1d0813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d10600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d080cf6b0 0x7f1d0813cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d10600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d08145250 0x7f1d0815e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d10600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0815c870 con 0x7f1d080cf6b0 2024-04-25T09:14:39.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d10600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d08145630 con 0x7f1d08145250 2024-04-25T09:14:39.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d10600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0815c9f0 con 0x7f1d080ce970 2024-04-25T09:14:39.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d0d200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d080cf6b0 0x7f1d0813cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d0d200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d080cf6b0 0x7f1d0813cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41138/0 (socket says 172.21.15.175:41138) 2024-04-25T09:14:39.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d0d200640 1 -- 172.21.15.175:0/2636139136 learned_addr learned my addr 172.21.15.175:0/2636139136 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:39.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d0dc00640 1 --2- 172.21.15.175:0/2636139136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d080ce970 0x7f1d0813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d0e600640 1 --2- 172.21.15.175:0/2636139136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d08145250 0x7f1d0815e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d0d200640 1 -- 172.21.15.175:0/2636139136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d080ce970 msgr2=0x7f1d0813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d0d200640 1 --2- 172.21.15.175:0/2636139136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d080ce970 0x7f1d0813ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d0d200640 1 -- 172.21.15.175:0/2636139136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d08145250 msgr2=0x7f1d0815e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d0d200640 1 --2- 172.21.15.175:0/2636139136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d08145250 0x7f1d0815e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.310 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d0d200640 1 -- 172.21.15.175:0/2636139136 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0815d410 con 0x7f1d080cf6b0 2024-04-25T09:14:39.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d0d200640 1 --2- 172.21.15.175:0/2636139136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d080cf6b0 0x7f1d0813cd40 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f1cf401a040 tx=0x7f1cf40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:39.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d05600640 1 -- 172.21.15.175:0/2636139136 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40b8030 con 0x7f1d080cf6b0 2024-04-25T09:14:39.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d05600640 1 -- 172.21.15.175:0/2636139136 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf40b4410 con 0x7f1d080cf6b0 2024-04-25T09:14:39.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d10600640 1 -- 172.21.15.175:0/2636139136 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0815d6f0 con 0x7f1d080cf6b0 2024-04-25T09:14:39.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.319+0000 7f1d05600640 1 -- 172.21.15.175:0/2636139136 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40b0040 con 0x7f1d080cf6b0 2024-04-25T09:14:39.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.323+0000 7f1d10600640 1 -- 172.21.15.175:0/2636139136 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0815dcb0 con 0x7f1d080cf6b0 2024-04-25T09:14:39.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.323+0000 7f1d10600640 1 -- 172.21.15.175:0/2636139136 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d08075160 con 0x7f1d080cf6b0 2024-04-25T09:14:39.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.323+0000 7f1d05600640 1 -- 172.21.15.175:0/2636139136 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1cf40bb070 con 0x7f1d080cf6b0 2024-04-25T09:14:39.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.323+0000 7f1d05600640 1 --2- 172.21.15.175:0/2636139136 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1ce8066f60 0x7f1ce8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.323+0000 7f1d05600640 1 -- 172.21.15.175:0/2636139136 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f1cf411e7f0 con 0x7f1d080cf6b0 2024-04-25T09:14:39.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.323+0000 7f1d0dc00640 1 --2- 172.21.15.175:0/2636139136 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1ce8066f60 0x7f1ce8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.323+0000 7f1d0dc00640 1 --2- 172.21.15.175:0/2636139136 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1ce8066f60 0x7f1ce8069420 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc000f70 tx=0x7f1cfc007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:39.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.327+0000 7f1d05600640 1 -- 172.21.15.175:0/2636139136 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1cf4016090 con 0x7f1d080cf6b0 2024-04-25T09:14:39.486 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.499+0000 7f1d10600640 1 -- 172.21.15.175:0/2636139136 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1d080cbbf0 con 0x7f1d080cf6b0 2024-04-25T09:14:39.487 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.499+0000 7f1d05600640 1 -- 172.21.15.175:0/2636139136 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v115) v1 ==== 80+0+246 (secure 0 0 0) 0x7f1cf40ef6b0 con 0x7f1d080cf6b0 2024-04-25T09:14:39.487 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175:6836/386187898 2024-04-26T09:14:28.999694+0000 2024-04-25T09:14:39.487 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175:6836/4128642659 2024-04-26T09:14:18.106892+0000 2024-04-25T09:14:39.487 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175:6834/386187898 2024-04-26T09:14:28.999694+0000 2024-04-25T09:14:39.487 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175:6834/4128642659 2024-04-26T09:14:18.106892+0000 2024-04-25T09:14:39.487 INFO:teuthology.orchestra.run.smithi175.stderr:listed 4 entries 2024-04-25T09:14:39.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.499+0000 7f1d10600640 1 -- 172.21.15.175:0/2636139136 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1ce8066f60 msgr2=0x7f1ce8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.499+0000 7f1d10600640 1 --2- 172.21.15.175:0/2636139136 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1ce8066f60 0x7f1ce8069420 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc000f70 tx=0x7f1cfc007c10 comp rx=0 tx=0).stop 2024-04-25T09:14:39.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.499+0000 7f1d10600640 1 -- 172.21.15.175:0/2636139136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d080cf6b0 msgr2=0x7f1d0813cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.499+0000 7f1d10600640 1 --2- 172.21.15.175:0/2636139136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d080cf6b0 0x7f1d0813cd40 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f1cf401a040 tx=0x7f1cf40191b0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.499+0000 7f1d10600640 1 -- 172.21.15.175:0/2636139136 shutdown_connections 2024-04-25T09:14:39.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.499+0000 7f1d10600640 1 --2- 172.21.15.175:0/2636139136 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f1ce8066f60 0x7f1ce8069420 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.499+0000 7f1d10600640 1 --2- 172.21.15.175:0/2636139136 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1d08145250 0x7f1d0815e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.499+0000 7f1d10600640 1 --2- 172.21.15.175:0/2636139136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d080cf6b0 0x7f1d0813cd40 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.489 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.499+0000 7f1d10600640 1 --2- 172.21.15.175:0/2636139136 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1d080ce970 0x7f1d0813ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.499+0000 7f1d10600640 1 -- 172.21.15.175:0/2636139136 >> 172.21.15.175:0/2636139136 conn(0x7f1d0806ac50 msgr2=0x7f1d08144020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:39.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.499+0000 7f1d10600640 1 -- 172.21.15.175:0/2636139136 shutdown_connections 2024-04-25T09:14:39.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.499+0000 7f1d10600640 1 -- 172.21.15.175:0/2636139136 wait complete. 2024-04-25T09:14:39.507 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:14:39.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:39.508 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:14:39.533 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:14:39.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:39.533 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:14:39.589 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:14:39.590 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:39.599 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:14:39.599 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:14:39.600 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:39.645 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:14:39.645 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:14:39.645 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:39.654 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:14:39.655 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:39.698 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:14:39.739 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:14:39.824 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.835+0000 7f241bc00640 1 Processor -- start 2024-04-25T09:14:39.825 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.835+0000 7f241bc00640 1 -- start start 2024-04-25T09:14:39.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f241bc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f241415a900 0x7f241406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f241bc00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24140cda00 con 0x7f24140cd520 2024-04-25T09:14:39.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f241bc00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24140cdce0 con 0x7f24140cf560 2024-04-25T09:14:39.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f241bc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241415bcf0 con 0x7f241415a900 2024-04-25T09:14:39.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f240be00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f24140cd520 0x7f24140ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:36126/0 (socket says 172.21.15.175:36126) 2024-04-25T09:14:39.826 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f240be00640 1 -- 172.21.15.175:0/1632537774 learned_addr learned my addr 172.21.15.175:0/1632537774 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:39.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2419200640 1 --2- 172.21.15.175:0/1632537774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f241415a900 0x7f241406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.828 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2413e00640 1 -- 172.21.15.175:0/1632537774 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227443566 0 0) 0x7f24140cda00 con 0x7f24140cd520 2024-04-25T09:14:39.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2413e00640 1 -- 172.21.15.175:0/1632537774 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23f8003530 con 0x7f24140cd520 2024-04-25T09:14:39.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2413e00640 1 -- 172.21.15.175:0/1632537774 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494195081 0 0) 0x7f24140cdce0 con 0x7f24140cf560 2024-04-25T09:14:39.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2413e00640 1 -- 172.21.15.175:0/1632537774 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24140cda00 con 0x7f24140cf560 2024-04-25T09:14:39.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2413e00640 1 -- 172.21.15.175:0/1632537774 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 480289405 0 0) 0x7f23f8003530 con 0x7f24140cd520 2024-04-25T09:14:39.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2413e00640 1 -- 172.21.15.175:0/1632537774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f241415a900 msgr2=0x7f241406e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:39.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2413e00640 1 --2- 172.21.15.175:0/1632537774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f241415a900 0x7f241406e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2413e00640 1 -- 172.21.15.175:0/1632537774 >> v1:172.21.15.177:6789/0 conn(0x7f24140cf560 legacy=0x7f241415bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2413e00640 1 -- 172.21.15.175:0/1632537774 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24140cdfc0 con 0x7f24140cd520 2024-04-25T09:14:39.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2413e00640 1 -- 172.21.15.175:0/1632537774 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f23fc001680 con 0x7f24140cd520 2024-04-25T09:14:39.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2413e00640 1 -- 172.21.15.175:0/1632537774 >> v1:172.21.15.175:6789/0 conn(0x7f24140cd520 legacy=0x7f24140ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2413e00640 1 --2- 172.21.15.175:0/1632537774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23f8003b80 0x7f23f8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2413e00640 1 --2- 172.21.15.175:0/1632537774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23f8004810 0x7f23f8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2413e00640 1 --2- 172.21.15.175:0/1632537774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23f80051d0 0x7f23f800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2413e00640 1 -- 172.21.15.175:0/1632537774 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f800bfc0 con 0x7f23f8004810 2024-04-25T09:14:39.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2413e00640 1 -- 172.21.15.175:0/1632537774 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f800c140 con 0x7f23f80051d0 2024-04-25T09:14:39.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2413e00640 1 -- 172.21.15.175:0/1632537774 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f800c340 con 0x7f23f8003b80 2024-04-25T09:14:39.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2419200640 1 --2- 172.21.15.175:0/1632537774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f241415a900 0x7f241406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:39.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f240be00640 1 --2- 172.21.15.175:0/1632537774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23f8004810 0x7f23f8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2419c00640 1 --2- 172.21.15.175:0/1632537774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23f80051d0 0x7f23f800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2419200640 1 --2- 172.21.15.175:0/1632537774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23f8003b80 0x7f23f8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f240be00640 1 -- 172.21.15.175:0/1632537774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23f8003b80 msgr2=0x7f23f8003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:39.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f240be00640 1 --2- 172.21.15.175:0/1632537774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23f8003b80 0x7f23f8003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f240be00640 1 -- 172.21.15.175:0/1632537774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23f80051d0 msgr2=0x7f23f800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:39.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f240be00640 1 --2- 172.21.15.175:0/1632537774 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23f80051d0 0x7f23f800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f240be00640 1 -- 172.21.15.175:0/1632537774 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f8003530 con 0x7f23f8004810 2024-04-25T09:14:39.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.839+0000 7f2419200640 1 --2- 172.21.15.175:0/1632537774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23f8003b80 0x7f23f8003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:39.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.843+0000 7f240be00640 1 --2- 172.21.15.175:0/1632537774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23f8004810 0x7f23f8004c90 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00c160 tx=0x7f23fc01cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7182b8a9b449da2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:39.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.843+0000 7f2413e00640 1 -- 172.21.15.175:0/1632537774 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc007cb0 con 0x7f23f8004810 2024-04-25T09:14:39.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.843+0000 7f2413e00640 1 -- 172.21.15.175:0/1632537774 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23fc0a9020 con 0x7f23f8004810 2024-04-25T09:14:39.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.843+0000 7f2413e00640 1 -- 172.21.15.175:0/1632537774 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23fc005ae0 con 0x7f23f8004810 2024-04-25T09:14:39.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.843+0000 7f241bc00640 1 -- 172.21.15.175:0/1632537774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23f8004810 msgr2=0x7f23f8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.843+0000 7f241bc00640 1 --2- 172.21.15.175:0/1632537774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23f8004810 0x7f23f8004c90 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00c160 tx=0x7f23fc01cbe0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.843+0000 7f2419c00640 1 -- 172.21.15.175:0/1632537774 reap_dead start 2024-04-25T09:14:39.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.843+0000 7f241bc00640 1 -- 172.21.15.175:0/1632537774 shutdown_connections 2024-04-25T09:14:39.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.843+0000 7f241bc00640 1 -- 172.21.15.175:0/1632537774 >> 172.21.15.175:0/1632537774 conn(0x7f2414067150 msgr2=0x7f241406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:39.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.843+0000 7f241bc00640 1 -- 172.21.15.175:0/1632537774 shutdown_connections 2024-04-25T09:14:39.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.843+0000 7f241bc00640 1 -- 172.21.15.175:0/1632537774 wait complete. 2024-04-25T09:14:39.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f241bc00640 1 Processor -- start 2024-04-25T09:14:39.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f241bc00640 1 -- start start 2024-04-25T09:14:39.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f241bc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f241414bcf0 0x7f24140b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f241bc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f241414c410 0x7f2414152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f241bc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2414155ff0 0x7f2414156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f241bc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241406d3b0 con 0x7f241414bcf0 2024-04-25T09:14:39.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f241bc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24140ce580 con 0x7f2414155ff0 2024-04-25T09:14:39.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f241bc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241406d530 con 0x7f241414c410 2024-04-25T09:14:39.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f2419200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f241414bcf0 0x7f24140b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f2419200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f241414bcf0 0x7f24140b3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41166/0 (socket says 172.21.15.175:41166) 2024-04-25T09:14:39.835 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f2419200640 1 -- 172.21.15.175:0/922548422 learned_addr learned my addr 172.21.15.175:0/922548422 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:39.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f2419200640 1 -- 172.21.15.175:0/922548422 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f241414c410 msgr2=0x7f2414152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f2419c00640 1 --2- 172.21.15.175:0/922548422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2414155ff0 0x7f2414156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f240be00640 1 --2- 172.21.15.175:0/922548422 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f241414c410 0x7f2414152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f2419200640 1 --2- 172.21.15.175:0/922548422 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f241414c410 0x7f2414152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f2419200640 1 -- 172.21.15.175:0/922548422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2414155ff0 msgr2=0x7f2414156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:39.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f2419200640 1 --2- 172.21.15.175:0/922548422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2414155ff0 0x7f2414156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:39.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f2419200640 1 -- 172.21.15.175:0/922548422 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24140b4370 con 0x7f241414bcf0 2024-04-25T09:14:39.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f2419c00640 1 --2- 172.21.15.175:0/922548422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2414155ff0 0x7f2414156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:39.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f240be00640 1 --2- 172.21.15.175:0/922548422 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f241414c410 0x7f2414152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:39.836 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f2419200640 1 --2- 172.21.15.175:0/922548422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f241414bcf0 0x7f24140b3e30 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f24040118b0 tx=0x7f2404011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:39.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f2411600640 1 -- 172.21.15.175:0/922548422 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240400f970 con 0x7f241414bcf0 2024-04-25T09:14:39.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f2411600640 1 -- 172.21.15.175:0/922548422 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240400fb10 con 0x7f241414bcf0 2024-04-25T09:14:39.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f241bc00640 1 -- 172.21.15.175:0/922548422 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24140b2670 con 0x7f241414bcf0 2024-04-25T09:14:39.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f2411600640 1 -- 172.21.15.175:0/922548422 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2404015460 con 0x7f241414bcf0 2024-04-25T09:14:39.837 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f241bc00640 1 -- 172.21.15.175:0/922548422 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2414152700 con 0x7f241414bcf0 2024-04-25T09:14:39.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.847+0000 7f241bc00640 1 -- 172.21.15.175:0/922548422 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24141569b0 con 0x7f241414bcf0 2024-04-25T09:14:39.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.851+0000 7f2411600640 1 -- 172.21.15.175:0/922548422 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2404015600 con 0x7f241414bcf0 2024-04-25T09:14:39.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.851+0000 7f2411600640 1 --2- 172.21.15.175:0/922548422 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f23f0066fc0 0x7f23f0069480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:39.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.851+0000 7f2411600640 1 -- 172.21.15.175:0/922548422 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f24040859d0 con 0x7f241414bcf0 2024-04-25T09:14:39.838 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.851+0000 7f240be00640 1 --2- 172.21.15.175:0/922548422 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f23f0066fc0 0x7f23f0069480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:39.839 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.851+0000 7f240be00640 1 --2- 172.21.15.175:0/922548422 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f23f0066fc0 0x7f23f0069480 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0aa000 tx=0x7f24140cdeb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:39.842 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:39.855+0000 7f2411600640 1 -- 172.21.15.175:0/922548422 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f24140b4370 con 0x7f241414bcf0 2024-04-25T09:14:40.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.047+0000 7f241bc00640 1 -- 172.21.15.175:0/922548422 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2414159720 con 0x7f241414bcf0 2024-04-25T09:14:40.034 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.047+0000 7f2411600640 1 -- 172.21.15.175:0/922548422 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4954 (secure 0 0 0) 0x7f2404019030 con 0x7f241414bcf0 2024-04-25T09:14:40.035 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:40.035 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/745891603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":745891603},{"type":"v1","addr":"172.21.15.175:6837","nonce":745891603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2312875672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2312875672},{"type":"v1","addr":"172.21.15.177:6834","nonce":2312875672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":8212,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3983919410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3983919410},{"type":"v1","addr":"172.21.15.177:6835","nonce":3983919410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:14:03.698308+0000","modified":"2024-04-25T09:14:33.028975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9120":{"gid":9120,"name":"c","rank":0,"incarnation":103,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6836/4159793972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":4159793972},{"type":"v1","addr":"172.21.15.175:6836","nonce":4159793972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:14:40.035 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 106 2024-04-25T09:14:40.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.047+0000 7f241bc00640 1 -- 172.21.15.175:0/922548422 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f23f0066fc0 msgr2=0x7f23f0069480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.047+0000 7f241bc00640 1 --2- 172.21.15.175:0/922548422 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f23f0066fc0 0x7f23f0069480 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0aa000 tx=0x7f24140cdeb0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.047+0000 7f241bc00640 1 -- 172.21.15.175:0/922548422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f241414bcf0 msgr2=0x7f24140b3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.047+0000 7f241bc00640 1 --2- 172.21.15.175:0/922548422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f241414bcf0 0x7f24140b3e30 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f24040118b0 tx=0x7f2404011d70 comp rx=0 tx=0).stop 2024-04-25T09:14:40.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.047+0000 7f241bc00640 1 -- 172.21.15.175:0/922548422 shutdown_connections 2024-04-25T09:14:40.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.047+0000 7f241bc00640 1 --2- 172.21.15.175:0/922548422 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f23f0066fc0 0x7f23f0069480 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.047+0000 7f241bc00640 1 --2- 172.21.15.175:0/922548422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2414155ff0 0x7f2414156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.037 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.047+0000 7f241bc00640 1 --2- 172.21.15.175:0/922548422 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f241414c410 0x7f2414152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.047+0000 7f241bc00640 1 --2- 172.21.15.175:0/922548422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f241414bcf0 0x7f24140b3e30 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.047+0000 7f241bc00640 1 -- 172.21.15.175:0/922548422 >> 172.21.15.175:0/922548422 conn(0x7f23f8004810 msgr2=0x7f2414071240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:40.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.047+0000 7f241bc00640 1 -- 172.21.15.175:0/922548422 shutdown_connections 2024-04-25T09:14:40.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.047+0000 7f241bc00640 1 -- 172.21.15.175:0/922548422 wait complete. 2024-04-25T09:14:40.056 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:14:40.231 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.243+0000 7f4b85400640 1 Processor -- start 2024-04-25T09:14:40.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.243+0000 7f4b85400640 1 -- start start 2024-04-25T09:14:40.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.243+0000 7f4b85400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4b800d0480 0x7f4b800cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.243+0000 7f4b85400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b800d08f0 con 0x7f4b80161650 2024-04-25T09:14:40.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.243+0000 7f4b85400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b800cc710 con 0x7f4b800cc2e0 2024-04-25T09:14:40.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.243+0000 7f4b85400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b8006d1b0 con 0x7f4b800d0480 2024-04-25T09:14:40.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.243+0000 7f4b7fe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4b80161650 0x7f4b8009a6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:36128/0 (socket says 172.21.15.175:36128) 2024-04-25T09:14:40.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.243+0000 7f4b7fe00640 1 -- 172.21.15.175:0/4177808840 learned_addr learned my addr 172.21.15.175:0/4177808840 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:40.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.247+0000 7f4b77400640 1 --2- 172.21.15.175:0/4177808840 >> v2:172.21.15.177:3300/0 conn(0x7f4b800d0480 0x7f4b800cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.247+0000 7f4b7f400640 1 -- 172.21.15.175:0/4177808840 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518269283 0 0) 0x7f4b800d08f0 con 0x7f4b80161650 2024-04-25T09:14:40.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.247+0000 7f4b7f400640 1 -- 172.21.15.175:0/4177808840 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b64003530 con 0x7f4b80161650 2024-04-25T09:14:40.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.247+0000 7f4b7f400640 1 -- 172.21.15.175:0/4177808840 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3272930397 0 0) 0x7f4b64003530 con 0x7f4b80161650 2024-04-25T09:14:40.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.247+0000 7f4b77400640 1 -- 172.21.15.175:0/4177808840 >> v1:172.21.15.177:6789/0 conn(0x7f4b800cc2e0 legacy=0x7f4b80161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.247+0000 7f4b77400640 1 -- 172.21.15.175:0/4177808840 >> v1:172.21.15.175:6789/0 conn(0x7f4b80161650 legacy=0x7f4b8009a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.234 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.247+0000 7f4b77400640 1 -- 172.21.15.175:0/4177808840 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800d0bb0 con 0x7f4b800d0480 2024-04-25T09:14:40.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.247+0000 7f4b77400640 1 --2- 172.21.15.175:0/4177808840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b800d0480 0x7f4b800cbda0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4b680097f0 tx=0x7f4b6801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ba31c9314c62b8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:40.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.247+0000 7f4b7f400640 1 -- 172.21.15.175:0/4177808840 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b680b0070 con 0x7f4b800d0480 2024-04-25T09:14:40.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.247+0000 7f4b7f400640 1 -- 172.21.15.175:0/4177808840 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b680ab400 con 0x7f4b800d0480 2024-04-25T09:14:40.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.247+0000 7f4b7f400640 1 -- 172.21.15.175:0/4177808840 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b70001680 con 0x7f4b800d0480 2024-04-25T09:14:40.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b85400640 1 -- 172.21.15.175:0/4177808840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b800d0480 msgr2=0x7f4b800cbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b85400640 1 --2- 172.21.15.175:0/4177808840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b800d0480 0x7f4b800cbda0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4b680097f0 tx=0x7f4b6801c330 comp rx=0 tx=0).stop 2024-04-25T09:14:40.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b85400640 1 -- 172.21.15.175:0/4177808840 shutdown_connections 2024-04-25T09:14:40.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b85400640 1 --2- 172.21.15.175:0/4177808840 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b800d0480 0x7f4b800cbda0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b85400640 1 -- 172.21.15.175:0/4177808840 >> 172.21.15.175:0/4177808840 conn(0x7f4b800b3240 msgr2=0x7f4b800b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:40.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b85400640 1 -- 172.21.15.175:0/4177808840 shutdown_connections 2024-04-25T09:14:40.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b85400640 1 -- 172.21.15.175:0/4177808840 wait complete. 2024-04-25T09:14:40.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b85400640 1 Processor -- start 2024-04-25T09:14:40.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b85400640 1 -- start start 2024-04-25T09:14:40.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b85400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b800cc2e0 0x7f4b80154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b85400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b800d0480 0x7f4b80158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b85400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b80161650 0x7f4b80159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b85400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b80161220 con 0x7f4b80161650 2024-04-25T09:14:40.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b85400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b80162550 con 0x7f4b800cc2e0 2024-04-25T09:14:40.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b85400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b801613a0 con 0x7f4b800d0480 2024-04-25T09:14:40.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b84a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b80161650 0x7f4b80159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b84a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b80161650 0x7f4b80159500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41178/0 (socket says 172.21.15.175:41178) 2024-04-25T09:14:40.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b84a00640 1 -- 172.21.15.175:0/1126650628 learned_addr learned my addr 172.21.15.175:0/1126650628 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:40.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b7fe00640 1 --2- 172.21.15.175:0/1126650628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b800cc2e0 0x7f4b80154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b77400640 1 --2- 172.21.15.175:0/1126650628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b800d0480 0x7f4b80158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b84a00640 1 -- 172.21.15.175:0/1126650628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b800d0480 msgr2=0x7f4b80158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b84a00640 1 --2- 172.21.15.175:0/1126650628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b800d0480 0x7f4b80158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b84a00640 1 -- 172.21.15.175:0/1126650628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b800cc2e0 msgr2=0x7f4b80154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b84a00640 1 --2- 172.21.15.175:0/1126650628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b800cc2e0 0x7f4b80154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b84a00640 1 -- 172.21.15.175:0/1126650628 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800c88c0 con 0x7f4b80161650 2024-04-25T09:14:40.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b77400640 1 --2- 172.21.15.175:0/1126650628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b800d0480 0x7f4b80158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:40.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.251+0000 7f4b7fe00640 1 --2- 172.21.15.175:0/1126650628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b800cc2e0 0x7f4b80154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:40.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.255+0000 7f4b84a00640 1 --2- 172.21.15.175:0/1126650628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b80161650 0x7f4b80159500 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800c760 tx=0x7f4b7800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:40.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.255+0000 7f4b7cc00640 1 -- 172.21.15.175:0/1126650628 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78003b80 con 0x7f4b80161650 2024-04-25T09:14:40.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.255+0000 7f4b7cc00640 1 -- 172.21.15.175:0/1126650628 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b78003d20 con 0x7f4b80161650 2024-04-25T09:14:40.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.255+0000 7f4b85400640 1 -- 172.21.15.175:0/1126650628 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b800c8ba0 con 0x7f4b80161650 2024-04-25T09:14:40.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.255+0000 7f4b7cc00640 1 -- 172.21.15.175:0/1126650628 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7800aa30 con 0x7f4b80161650 2024-04-25T09:14:40.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.255+0000 7f4b85400640 1 -- 172.21.15.175:0/1126650628 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b800c9160 con 0x7f4b80161650 2024-04-25T09:14:40.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.255+0000 7f4b85400640 1 -- 172.21.15.175:0/1126650628 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b80074a60 con 0x7f4b80161650 2024-04-25T09:14:40.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.255+0000 7f4b7cc00640 1 -- 172.21.15.175:0/1126650628 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4b7800abd0 con 0x7f4b80161650 2024-04-25T09:14:40.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.255+0000 7f4b7cc00640 1 --2- 172.21.15.175:0/1126650628 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4b5c066f60 0x7f4b5c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.255+0000 7f4b7cc00640 1 -- 172.21.15.175:0/1126650628 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f4b78084ff0 con 0x7f4b80161650 2024-04-25T09:14:40.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.255+0000 7f4b7fe00640 1 --2- 172.21.15.175:0/1126650628 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4b5c066f60 0x7f4b5c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.255+0000 7f4b7fe00640 1 --2- 172.21.15.175:0/1126650628 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4b5c066f60 0x7f4b5c069420 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4b70001ec0 tx=0x7f4b70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:40.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.259+0000 7f4b7cc00640 1 -- 172.21.15.175:0/1126650628 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4b78055eb0 con 0x7f4b80161650 2024-04-25T09:14:40.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.415+0000 7f4b85400640 1 -- 172.21.15.175:0/1126650628 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b80160a50 con 0x7f4b80161650 2024-04-25T09:14:40.403 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.415+0000 7f4b7cc00640 1 -- 172.21.15.175:0/1126650628 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+16924 (secure 0 0 0) 0x7f4b780557b0 con 0x7f4b80161650 2024-04-25T09:14:40.404 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:40.404 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":115,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:14:28.999711+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:14:01.413477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:14:02.699273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6836/386187898":"2024-04-26T09:14:28.999694+0000","172.21.15.175:6836/4128642659":"2024-04-26T09:14:18.106892+0000","172.21.15.175:6834/386187898":"2024-04-26T09:14:28.999694+0000","172.21.15.175:6834/4128642659":"2024-04-26T09:14:18.106892+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:14:40.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.419+0000 7f4b85400640 1 -- 172.21.15.175:0/1126650628 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4b5c066f60 msgr2=0x7f4b5c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.419+0000 7f4b85400640 1 --2- 172.21.15.175:0/1126650628 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4b5c066f60 0x7f4b5c069420 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4b70001ec0 tx=0x7f4b70009040 comp rx=0 tx=0).stop 2024-04-25T09:14:40.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.419+0000 7f4b85400640 1 -- 172.21.15.175:0/1126650628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b80161650 msgr2=0x7f4b80159500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.419+0000 7f4b85400640 1 --2- 172.21.15.175:0/1126650628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b80161650 0x7f4b80159500 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800c760 tx=0x7f4b7800cc20 comp rx=0 tx=0).stop 2024-04-25T09:14:40.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.419+0000 7f4b85400640 1 -- 172.21.15.175:0/1126650628 shutdown_connections 2024-04-25T09:14:40.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.419+0000 7f4b85400640 1 --2- 172.21.15.175:0/1126650628 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f4b5c066f60 0x7f4b5c069420 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.419+0000 7f4b85400640 1 --2- 172.21.15.175:0/1126650628 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b80161650 0x7f4b80159500 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.419+0000 7f4b85400640 1 --2- 172.21.15.175:0/1126650628 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b800d0480 0x7f4b80158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.419+0000 7f4b85400640 1 --2- 172.21.15.175:0/1126650628 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b800cc2e0 0x7f4b80154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.419+0000 7f4b85400640 1 -- 172.21.15.175:0/1126650628 >> 172.21.15.175:0/1126650628 conn(0x7f4b800b3240 msgr2=0x7f4b801555e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:40.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.419+0000 7f4b85400640 1 -- 172.21.15.175:0/1126650628 shutdown_connections 2024-04-25T09:14:40.406 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.419+0000 7f4b85400640 1 -- 172.21.15.175:0/1126650628 wait complete. 2024-04-25T09:14:40.426 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:03:57.852011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:14:01.413477+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:14:02.699273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:14:40.426 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:14:40.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.579+0000 7f93b4000640 1 Processor -- start 2024-04-25T09:14:40.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.579+0000 7f93b4000640 1 -- start start 2024-04-25T09:14:40.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.579+0000 7f93b4000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93ac0cbe60 0x7f93ac15af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.579+0000 7f93b4000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f93ac06d310 0x7f93ac0b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.579+0000 7f93b4000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f93ac0b4630 0x7f93ac0b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.579+0000 7f93b4000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac06db60 con 0x7f93ac06d310 2024-04-25T09:14:40.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.579+0000 7f93b4000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac06de40 con 0x7f93ac0b4630 2024-04-25T09:14:40.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.579+0000 7f93b4000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac06e120 con 0x7f93ac0cbe60 2024-04-25T09:14:40.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.579+0000 7f93b0c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f93ac06d310 0x7f93ac0b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.579+0000 7f93b0c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f93ac06d310 0x7f93ac0b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41184/0 (socket says 172.21.15.175:41184) 2024-04-25T09:14:40.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.579+0000 7f93b0c00640 1 -- 172.21.15.175:0/126422053 learned_addr learned my addr 172.21.15.175:0/126422053 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:40.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.579+0000 7f93b2000640 1 --2- 172.21.15.175:0/126422053 >> v2:172.21.15.177:3300/0 conn(0x7f93ac0b4630 0x7f93ac0b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.579+0000 7f93b1600640 1 --2- 172.21.15.175:0/126422053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93ac0cbe60 0x7f93ac15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.579+0000 7f93b0c00640 1 -- 172.21.15.175:0/126422053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93ac0cbe60 msgr2=0x7f93ac15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:40.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.579+0000 7f93b0c00640 1 --2- 172.21.15.175:0/126422053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93ac0cbe60 0x7f93ac15af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.579+0000 7f93b0c00640 1 -- 172.21.15.175:0/126422053 >> v2:172.21.15.177:3300/0 conn(0x7f93ac0b4630 msgr2=0x7f93ac0b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:40.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.579+0000 7f93b0c00640 1 --2- 172.21.15.175:0/126422053 >> v2:172.21.15.177:3300/0 conn(0x7f93ac0b4630 0x7f93ac0b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.579+0000 7f93b0c00640 1 -- 172.21.15.175:0/126422053 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac15c2f0 con 0x7f93ac06d310 2024-04-25T09:14:40.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.583+0000 7f93b0c00640 1 --2- 172.21.15.175:0/126422053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ac06d310 0x7f93ac0b40f0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f93ac06ec50 tx=0x7f939801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b024e11dcd36b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:40.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.583+0000 7f93abe00640 1 -- 172.21.15.175:0/126422053 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93980b0070 con 0x7f93ac06d310 2024-04-25T09:14:40.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.583+0000 7f93abe00640 1 -- 172.21.15.175:0/126422053 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93980ab600 con 0x7f93ac06d310 2024-04-25T09:14:40.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.583+0000 7f93abe00640 1 -- 172.21.15.175:0/126422053 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93980ab9d0 con 0x7f93ac06d310 2024-04-25T09:14:40.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.583+0000 7f93b4000640 1 -- 172.21.15.175:0/126422053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ac06d310 msgr2=0x7f93ac0b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.583+0000 7f93b4000640 1 --2- 172.21.15.175:0/126422053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ac06d310 0x7f93ac0b40f0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f93ac06ec50 tx=0x7f939801c260 comp rx=0 tx=0).stop 2024-04-25T09:14:40.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.583+0000 7f93b4000640 1 -- 172.21.15.175:0/126422053 shutdown_connections 2024-04-25T09:14:40.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.583+0000 7f93b4000640 1 --2- 172.21.15.175:0/126422053 >> v2:172.21.15.177:3300/0 conn(0x7f93ac0b4630 0x7f93ac0b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.583+0000 7f93b4000640 1 --2- 172.21.15.175:0/126422053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ac06d310 0x7f93ac0b40f0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.583+0000 7f93b4000640 1 --2- 172.21.15.175:0/126422053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93ac0cbe60 0x7f93ac15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.583+0000 7f93b4000640 1 -- 172.21.15.175:0/126422053 >> 172.21.15.175:0/126422053 conn(0x7f93ac06ac50 msgr2=0x7f93ac06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:40.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.583+0000 7f93b4000640 1 -- 172.21.15.175:0/126422053 shutdown_connections 2024-04-25T09:14:40.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.583+0000 7f93b4000640 1 -- 172.21.15.175:0/126422053 wait complete. 2024-04-25T09:14:40.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b4000640 1 Processor -- start 2024-04-25T09:14:40.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b4000640 1 -- start start 2024-04-25T09:14:40.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b4000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93ac06d310 0x7f93ac1442d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b4000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ac0b4630 0x7f93ac156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b4000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93ac0cbe60 0x7f93ac153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b4000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0716a0 con 0x7f93ac0b4630 2024-04-25T09:14:40.574 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b4000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac071520 con 0x7f93ac0cbe60 2024-04-25T09:14:40.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b4000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac071820 con 0x7f93ac06d310 2024-04-25T09:14:40.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b0c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ac0b4630 0x7f93ac156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b1600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93ac06d310 0x7f93ac1442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b0c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ac0b4630 0x7f93ac156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41198/0 (socket says 172.21.15.175:41198) 2024-04-25T09:14:40.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b0c00640 1 -- 172.21.15.175:0/1622515676 learned_addr learned my addr 172.21.15.175:0/1622515676 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:40.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b2000640 1 --2- 172.21.15.175:0/1622515676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93ac0cbe60 0x7f93ac153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b0c00640 1 -- 172.21.15.175:0/1622515676 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93ac06d310 msgr2=0x7f93ac1442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b0c00640 1 --2- 172.21.15.175:0/1622515676 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93ac06d310 0x7f93ac1442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b0c00640 1 -- 172.21.15.175:0/1622515676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93ac0cbe60 msgr2=0x7f93ac153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b0c00640 1 --2- 172.21.15.175:0/1622515676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93ac0cbe60 0x7f93ac153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b0c00640 1 -- 172.21.15.175:0/1622515676 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac1569d0 con 0x7f93ac0b4630 2024-04-25T09:14:40.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b0c00640 1 --2- 172.21.15.175:0/1622515676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ac0b4630 0x7f93ac156060 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f939801a910 tx=0x7f9398019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:40.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93a9600640 1 -- 172.21.15.175:0/1622515676 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93980b9070 con 0x7f93ac0b4630 2024-04-25T09:14:40.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93a9600640 1 -- 172.21.15.175:0/1622515676 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93980b4400 con 0x7f93ac0b4630 2024-04-25T09:14:40.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93a9600640 1 -- 172.21.15.175:0/1622515676 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93980b0040 con 0x7f93ac0b4630 2024-04-25T09:14:40.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b4000640 1 -- 172.21.15.175:0/1622515676 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ac156cb0 con 0x7f93ac0b4630 2024-04-25T09:14:40.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b4000640 1 -- 172.21.15.175:0/1622515676 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ac157270 con 0x7f93ac0b4630 2024-04-25T09:14:40.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.587+0000 7f93b4000640 1 -- 172.21.15.175:0/1622515676 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ac075160 con 0x7f93ac0b4630 2024-04-25T09:14:40.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.591+0000 7f93a9600640 1 -- 172.21.15.175:0/1622515676 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f93980bc070 con 0x7f93ac0b4630 2024-04-25T09:14:40.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.591+0000 7f93a9600640 1 --2- 172.21.15.175:0/1622515676 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f938c066f60 0x7f938c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.591+0000 7f93a9600640 1 -- 172.21.15.175:0/1622515676 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f939811e0b0 con 0x7f93ac0b4630 2024-04-25T09:14:40.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.591+0000 7f93b1600640 1 --2- 172.21.15.175:0/1622515676 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f938c066f60 0x7f938c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.591+0000 7f93b1600640 1 --2- 172.21.15.175:0/1622515676 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f938c066f60 0x7f938c069420 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f93a0007940 tx=0x7f93a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:40.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.595+0000 7f93a9600640 1 -- 172.21.15.175:0/1622515676 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9398016110 con 0x7f93ac0b4630 2024-04-25T09:14:40.736 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.747+0000 7f93b4000640 1 -- 172.21.15.175:0/1622515676 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93ac072110 con 0x7f93ac0b4630 2024-04-25T09:14:40.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.747+0000 7f93a9600640 1 -- 172.21.15.175:0/1622515676 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) v1 ==== 93+0+10 (secure 0 0 0) 0x7f93980ee920 con 0x7f93ac0b4630 2024-04-25T09:14:40.737 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 1 2024-04-25T09:14:40.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.751+0000 7f93b4000640 1 -- 172.21.15.175:0/1622515676 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f938c066f60 msgr2=0x7f938c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.751+0000 7f93b4000640 1 --2- 172.21.15.175:0/1622515676 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f938c066f60 0x7f938c069420 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f93a0007940 tx=0x7f93a0008040 comp rx=0 tx=0).stop 2024-04-25T09:14:40.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.751+0000 7f93b4000640 1 -- 172.21.15.175:0/1622515676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ac0b4630 msgr2=0x7f93ac156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.751+0000 7f93b4000640 1 --2- 172.21.15.175:0/1622515676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ac0b4630 0x7f93ac156060 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f939801a910 tx=0x7f9398019000 comp rx=0 tx=0).stop 2024-04-25T09:14:40.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.751+0000 7f93b4000640 1 -- 172.21.15.175:0/1622515676 shutdown_connections 2024-04-25T09:14:40.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.751+0000 7f93b4000640 1 --2- 172.21.15.175:0/1622515676 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f938c066f60 0x7f938c069420 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.751+0000 7f93b4000640 1 --2- 172.21.15.175:0/1622515676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93ac0cbe60 0x7f93ac153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.751+0000 7f93b4000640 1 --2- 172.21.15.175:0/1622515676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93ac0b4630 0x7f93ac156060 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.751+0000 7f93b4000640 1 --2- 172.21.15.175:0/1622515676 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93ac06d310 0x7f93ac1442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.751+0000 7f93b4000640 1 -- 172.21.15.175:0/1622515676 >> 172.21.15.175:0/1622515676 conn(0x7f93ac06ac50 msgr2=0x7f93ac0b3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:40.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.751+0000 7f93b4000640 1 -- 172.21.15.175:0/1622515676 shutdown_connections 2024-04-25T09:14:40.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.751+0000 7f93b4000640 1 -- 172.21.15.175:0/1622515676 wait complete. 2024-04-25T09:14:40.758 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:14:40.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.907+0000 7f5b0be00640 1 Processor -- start 2024-04-25T09:14:40.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.907+0000 7f5b0be00640 1 -- start start 2024-04-25T09:14:40.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.907+0000 7f5b0be00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5b040cf6b0 0x7f5b041600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.907+0000 7f5b0be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b040ce970 0x7f5b040cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.907+0000 7f5b0be00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b040cfd10 con 0x7f5b04145250 2024-04-25T09:14:40.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.911+0000 7f5b0be00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b041605e0 con 0x7f5b040cf6b0 2024-04-25T09:14:40.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.911+0000 7f5b0be00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0415f650 con 0x7f5b040ce970 2024-04-25T09:14:40.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.911+0000 7f5b09e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b040ce970 0x7f5b040cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.911+0000 7f5b08a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5b040cf6b0 0x7f5b041600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.911+0000 7f5b09400640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f5b04145250 0x7f5b040cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:51154/0 (socket says 172.21.15.175:51154) 2024-04-25T09:14:40.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.911+0000 7f5b09400640 1 -- 172.21.15.175:0/1045508074 learned_addr learned my addr 172.21.15.175:0/1045508074 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:40.898 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.911+0000 7f5b09e00640 1 --2- 172.21.15.175:0/1045508074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b040ce970 0x7f5b040cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.175:41270/0 (socket says 172.21.15.175:41270) 2024-04-25T09:14:40.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.911+0000 7f5b09e00640 1 -- 172.21.15.175:0/1045508074 >> v2:172.21.15.177:3300/0 conn(0x7f5b040cf6b0 msgr2=0x7f5b041600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:40.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.911+0000 7f5b09e00640 1 --2- 172.21.15.175:0/1045508074 >> v2:172.21.15.177:3300/0 conn(0x7f5b040cf6b0 0x7f5b041600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.911+0000 7f5b09e00640 1 -- 172.21.15.175:0/1045508074 >> v1:172.21.15.177:6789/0 conn(0x7f5b04145250 legacy=0x7f5b040cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.899 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.911+0000 7f5b09e00640 1 -- 172.21.15.175:0/1045508074 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b040cfff0 con 0x7f5b040ce970 2024-04-25T09:14:40.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.911+0000 7f5b09e00640 1 --2- 172.21.15.175:0/1045508074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b040ce970 0x7f5b040cee00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009dc0 tx=0x7f5afc01c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58db91dc0b1d1f56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:40.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b03e00640 1 -- 172.21.15.175:0/1045508074 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0b2070 con 0x7f5b040ce970 2024-04-25T09:14:40.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b03e00640 1 -- 172.21.15.175:0/1045508074 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc0a5870 con 0x7f5b040ce970 2024-04-25T09:14:40.901 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b03e00640 1 -- 172.21.15.175:0/1045508074 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0a5c40 con 0x7f5b040ce970 2024-04-25T09:14:40.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b0be00640 1 -- 172.21.15.175:0/1045508074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b040ce970 msgr2=0x7f5b040cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b0be00640 1 --2- 172.21.15.175:0/1045508074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b040ce970 0x7f5b040cee00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009dc0 tx=0x7f5afc01c8c0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b0be00640 1 -- 172.21.15.175:0/1045508074 shutdown_connections 2024-04-25T09:14:40.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b0be00640 1 --2- 172.21.15.175:0/1045508074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b040ce970 0x7f5b040cee00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b0be00640 1 --2- 172.21.15.175:0/1045508074 >> v2:172.21.15.177:3300/0 conn(0x7f5b040cf6b0 0x7f5b041600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.902 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b0be00640 1 -- 172.21.15.175:0/1045508074 >> 172.21.15.175:0/1045508074 conn(0x7f5b0406ac50 msgr2=0x7f5b0406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:40.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b0be00640 1 -- 172.21.15.175:0/1045508074 shutdown_connections 2024-04-25T09:14:40.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b0be00640 1 -- 172.21.15.175:0/1045508074 wait complete. 2024-04-25T09:14:40.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b0be00640 1 Processor -- start 2024-04-25T09:14:40.903 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b0be00640 1 -- start start 2024-04-25T09:14:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b0be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b040ce970 0x7f5b040af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b0be00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b040cf6b0 0x7f5b04139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b0be00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b04145250 0x7f5b0413a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b0be00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0415c870 con 0x7f5b040ce970 2024-04-25T09:14:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b0be00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b04145630 con 0x7f5b040cf6b0 2024-04-25T09:14:40.905 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b0be00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0415c9f0 con 0x7f5b04145250 2024-04-25T09:14:40.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b09400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b040ce970 0x7f5b040af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b09400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b040ce970 0x7f5b040af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41206/0 (socket says 172.21.15.175:41206) 2024-04-25T09:14:40.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b09400640 1 -- 172.21.15.175:0/3883098972 learned_addr learned my addr 172.21.15.175:0/3883098972 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:40.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b09e00640 1 --2- 172.21.15.175:0/3883098972 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b04145250 0x7f5b0413a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.915+0000 7f5b08a00640 1 --2- 172.21.15.175:0/3883098972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b040cf6b0 0x7f5b04139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.919+0000 7f5b09400640 1 -- 172.21.15.175:0/3883098972 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b04145250 msgr2=0x7f5b0413a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.919+0000 7f5b09400640 1 --2- 172.21.15.175:0/3883098972 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b04145250 0x7f5b0413a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.919+0000 7f5b09400640 1 -- 172.21.15.175:0/3883098972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b040cf6b0 msgr2=0x7f5b04139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:40.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.919+0000 7f5b09400640 1 --2- 172.21.15.175:0/3883098972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b040cf6b0 0x7f5b04139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:40.906 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.919+0000 7f5b09400640 1 -- 172.21.15.175:0/3883098972 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0413ddb0 con 0x7f5b040ce970 2024-04-25T09:14:40.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.919+0000 7f5b09400640 1 --2- 172.21.15.175:0/3883098972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b040ce970 0x7f5b040af710 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f5af800c400 tx=0x7f5af800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:40.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.919+0000 7f5b01600640 1 -- 172.21.15.175:0/3883098972 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8017070 con 0x7f5b040ce970 2024-04-25T09:14:40.907 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.919+0000 7f5b01600640 1 -- 172.21.15.175:0/3883098972 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af8005cf0 con 0x7f5b040ce970 2024-04-25T09:14:40.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.919+0000 7f5b0be00640 1 -- 172.21.15.175:0/3883098972 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0413e090 con 0x7f5b040ce970 2024-04-25T09:14:40.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.919+0000 7f5b01600640 1 -- 172.21.15.175:0/3883098972 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af80072d0 con 0x7f5b040ce970 2024-04-25T09:14:40.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.919+0000 7f5b0be00640 1 -- 172.21.15.175:0/3883098972 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0413a720 con 0x7f5b040ce970 2024-04-25T09:14:40.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.919+0000 7f5b0be00640 1 -- 172.21.15.175:0/3883098972 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b04075160 con 0x7f5b040ce970 2024-04-25T09:14:40.908 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.919+0000 7f5b01600640 1 -- 172.21.15.175:0/3883098972 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5af801a070 con 0x7f5b040ce970 2024-04-25T09:14:40.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.919+0000 7f5b01600640 1 --2- 172.21.15.175:0/3883098972 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ae4066f60 0x7f5ae4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:40.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.919+0000 7f5b01600640 1 -- 172.21.15.175:0/3883098972 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f5af8084390 con 0x7f5b040ce970 2024-04-25T09:14:40.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.919+0000 7f5b08a00640 1 --2- 172.21.15.175:0/3883098972 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ae4066f60 0x7f5ae4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:40.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.923+0000 7f5b08a00640 1 --2- 172.21.15.175:0/3883098972 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ae4066f60 0x7f5ae4069420 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5b040cb810 tx=0x7f5af0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:40.913 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:40.923+0000 7f5b01600640 1 -- 172.21.15.175:0/3883098972 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5af8054ca0 con 0x7f5b040ce970 2024-04-25T09:14:41.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.079+0000 7f5b0be00640 1 -- 172.21.15.175:0/3883098972 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5b0413e820 con 0x7f5b040ce970 2024-04-25T09:14:41.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.079+0000 7f5b01600640 1 -- 172.21.15.175:0/3883098972 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v115) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5af8058d40 con 0x7f5b040ce970 2024-04-25T09:14:41.067 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 32 2024-04-25T09:14:41.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.079+0000 7f5b0be00640 1 -- 172.21.15.175:0/3883098972 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ae4066f60 msgr2=0x7f5ae4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.079+0000 7f5b0be00640 1 --2- 172.21.15.175:0/3883098972 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ae4066f60 0x7f5ae4069420 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5b040cb810 tx=0x7f5af0009190 comp rx=0 tx=0).stop 2024-04-25T09:14:41.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.079+0000 7f5b0be00640 1 -- 172.21.15.175:0/3883098972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b040ce970 msgr2=0x7f5b040af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.079+0000 7f5b0be00640 1 --2- 172.21.15.175:0/3883098972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b040ce970 0x7f5b040af710 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f5af800c400 tx=0x7f5af800c8c0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.079+0000 7f5b0be00640 1 -- 172.21.15.175:0/3883098972 shutdown_connections 2024-04-25T09:14:41.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.079+0000 7f5b0be00640 1 --2- 172.21.15.175:0/3883098972 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ae4066f60 0x7f5ae4069420 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.079+0000 7f5b0be00640 1 --2- 172.21.15.175:0/3883098972 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b04145250 0x7f5b0413a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.079+0000 7f5b0be00640 1 --2- 172.21.15.175:0/3883098972 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b040cf6b0 0x7f5b04139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.079+0000 7f5b0be00640 1 --2- 172.21.15.175:0/3883098972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b040ce970 0x7f5b040af710 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.079+0000 7f5b0be00640 1 -- 172.21.15.175:0/3883098972 >> 172.21.15.175:0/3883098972 conn(0x7f5b0406ac50 msgr2=0x7f5b0406d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:41.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.079+0000 7f5b0be00640 1 -- 172.21.15.175:0/3883098972 shutdown_connections 2024-04-25T09:14:41.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.079+0000 7f5b0be00640 1 -- 172.21.15.175:0/3883098972 wait complete. 2024-04-25T09:14:41.089 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:14:41.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.239+0000 7fe51e000640 1 Processor -- start 2024-04-25T09:14:41.226 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.239+0000 7fe51e000640 1 -- start start 2024-04-25T09:14:41.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.239+0000 7fe51e000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe51815af20 0x7fe5180b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.239+0000 7fe51e000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe5180b4630 0x7fe51815c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.239+0000 7fe51e000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe51806db60 con 0x7fe5180cbe60 2024-04-25T09:14:41.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.239+0000 7fe51e000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5180b4aa0 con 0x7fe51815af20 2024-04-25T09:14:41.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.239+0000 7fe51e000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe51806de40 con 0x7fe5180b4630 2024-04-25T09:14:41.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.239+0000 7fe50ea00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe51815af20 0x7fe5180b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.239+0000 7fe50ea00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe51815af20 0x7fe5180b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41222/0 (socket says 172.21.15.175:41222) 2024-04-25T09:14:41.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.239+0000 7fe50ea00640 1 -- 172.21.15.175:0/3270250643 learned_addr learned my addr 172.21.15.175:0/3270250643 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:41.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.239+0000 7fe517e00640 1 --2- 172.21.15.175:0/3270250643 >> v2:172.21.15.177:3300/0 conn(0x7fe5180b4630 0x7fe51815c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.228 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.239+0000 7fe50ea00640 1 -- 172.21.15.175:0/3270250643 >> v2:172.21.15.177:3300/0 conn(0x7fe5180b4630 msgr2=0x7fe51815c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:41.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.239+0000 7fe50ea00640 1 --2- 172.21.15.175:0/3270250643 >> v2:172.21.15.177:3300/0 conn(0x7fe5180b4630 0x7fe51815c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.239+0000 7fe50ea00640 1 -- 172.21.15.175:0/3270250643 >> v1:172.21.15.177:6789/0 conn(0x7fe5180cbe60 legacy=0x7fe51806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:41.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.239+0000 7fe50ea00640 1 -- 172.21.15.175:0/3270250643 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51806e120 con 0x7fe51815af20 2024-04-25T09:14:41.229 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.239+0000 7fe517e00640 1 --2- 172.21.15.175:0/3270250643 >> v2:172.21.15.177:3300/0 conn(0x7fe5180b4630 0x7fe51815c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:41.230 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.243+0000 7fe50ea00640 1 --2- 172.21.15.175:0/3270250643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe51815af20 0x7fe5180b40f0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fe5180b3700 tx=0x7fe50001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85256abda2722765 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:41.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.243+0000 7fe516a00640 1 -- 172.21.15.175:0/3270250643 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5000ab5f0 con 0x7fe51815af20 2024-04-25T09:14:41.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.243+0000 7fe516a00640 1 -- 172.21.15.175:0/3270250643 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5000b0070 con 0x7fe51815af20 2024-04-25T09:14:41.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.243+0000 7fe516a00640 1 -- 172.21.15.175:0/3270250643 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5000ab9b0 con 0x7fe51815af20 2024-04-25T09:14:41.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.243+0000 7fe51e000640 1 -- 172.21.15.175:0/3270250643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe51815af20 msgr2=0x7fe5180b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.243+0000 7fe51e000640 1 --2- 172.21.15.175:0/3270250643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe51815af20 0x7fe5180b40f0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fe5180b3700 tx=0x7fe50001c4e0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.243+0000 7fe51e000640 1 -- 172.21.15.175:0/3270250643 shutdown_connections 2024-04-25T09:14:41.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.243+0000 7fe51e000640 1 --2- 172.21.15.175:0/3270250643 >> v2:172.21.15.177:3300/0 conn(0x7fe5180b4630 0x7fe51815c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.243+0000 7fe51e000640 1 --2- 172.21.15.175:0/3270250643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe51815af20 0x7fe5180b40f0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.243+0000 7fe51e000640 1 -- 172.21.15.175:0/3270250643 >> 172.21.15.175:0/3270250643 conn(0x7fe51806ac50 msgr2=0x7fe51806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:41.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.243+0000 7fe51e000640 1 -- 172.21.15.175:0/3270250643 shutdown_connections 2024-04-25T09:14:41.232 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.243+0000 7fe51e000640 1 -- 172.21.15.175:0/3270250643 wait complete. 2024-04-25T09:14:41.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe51e000640 1 Processor -- start 2024-04-25T09:14:41.233 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe51e000640 1 -- start start 2024-04-25T09:14:41.235 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe51e000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5180b4630 0x7fe51813f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe51e000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5180cbe60 0x7fe518152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe51e000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe51815af20 0x7fe518152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe51e000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51815d930 con 0x7fe5180b4630 2024-04-25T09:14:41.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe51e000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51815d7b0 con 0x7fe51815af20 2024-04-25T09:14:41.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe51e000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe51815dab0 con 0x7fe5180cbe60 2024-04-25T09:14:41.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe517400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5180b4630 0x7fe51813f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe517400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5180b4630 0x7fe51813f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41224/0 (socket says 172.21.15.175:41224) 2024-04-25T09:14:41.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe517400640 1 -- 172.21.15.175:0/1444922415 learned_addr learned my addr 172.21.15.175:0/1444922415 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:41.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe50ea00640 1 --2- 172.21.15.175:0/1444922415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5180cbe60 0x7fe518152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe517e00640 1 --2- 172.21.15.175:0/1444922415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe51815af20 0x7fe518152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe517400640 1 -- 172.21.15.175:0/1444922415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5180cbe60 msgr2=0x7fe518152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe517400640 1 --2- 172.21.15.175:0/1444922415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5180cbe60 0x7fe518152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe517400640 1 -- 172.21.15.175:0/1444922415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe51815af20 msgr2=0x7fe518152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.236 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe517400640 1 --2- 172.21.15.175:0/1444922415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe51815af20 0x7fe518152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe517400640 1 -- 172.21.15.175:0/1444922415 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5180cf7c0 con 0x7fe5180b4630 2024-04-25T09:14:41.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe517e00640 1 --2- 172.21.15.175:0/1444922415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe51815af20 0x7fe518152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:41.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe517400640 1 --2- 172.21.15.175:0/1444922415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5180b4630 0x7fe51813f2f0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fe50800b410 tx=0x7fe50800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:41.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe50fe00640 1 -- 172.21.15.175:0/1444922415 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe508015030 con 0x7fe5180b4630 2024-04-25T09:14:41.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe50fe00640 1 -- 172.21.15.175:0/1444922415 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe508004020 con 0x7fe5180b4630 2024-04-25T09:14:41.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe51e000640 1 -- 172.21.15.175:0/1444922415 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5180ce720 con 0x7fe5180b4630 2024-04-25T09:14:41.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe50fe00640 1 -- 172.21.15.175:0/1444922415 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe508004450 con 0x7fe5180b4630 2024-04-25T09:14:41.237 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe51e000640 1 -- 172.21.15.175:0/1444922415 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5180cece0 con 0x7fe5180b4630 2024-04-25T09:14:41.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.247+0000 7fe51e000640 1 -- 172.21.15.175:0/1444922415 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe518075160 con 0x7fe5180b4630 2024-04-25T09:14:41.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.251+0000 7fe50fe00640 1 -- 172.21.15.175:0/1444922415 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe508018070 con 0x7fe5180b4630 2024-04-25T09:14:41.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.251+0000 7fe50fe00640 1 --2- 172.21.15.175:0/1444922415 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe4f4066f60 0x7fe4f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.251+0000 7fe50fe00640 1 -- 172.21.15.175:0/1444922415 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fe508084c10 con 0x7fe5180b4630 2024-04-25T09:14:41.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.251+0000 7fe50ea00640 1 --2- 172.21.15.175:0/1444922415 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe4f4066f60 0x7fe4f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.251+0000 7fe50ea00640 1 --2- 172.21.15.175:0/1444922415 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe4f4066f60 0x7fe4f4069420 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe5000af000 tx=0x7fe5000a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:41.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.255+0000 7fe50fe00640 1 -- 172.21.15.175:0/1444922415 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe508055ad0 con 0x7fe5180b4630 2024-04-25T09:14:41.396 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.407+0000 7fe51e000640 1 -- 172.21.15.175:0/1444922415 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe5180b2670 con 0x7fe5180b4630 2024-04-25T09:14:41.397 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.407+0000 7fe50fe00640 1 -- 172.21.15.175:0/1444922415 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v115) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe5080553d0 con 0x7fe5180b4630 2024-04-25T09:14:41.397 INFO:teuthology.orchestra.run.smithi175.stdout:pg_num: 64 2024-04-25T09:14:41.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.411+0000 7fe51e000640 1 -- 172.21.15.175:0/1444922415 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe4f4066f60 msgr2=0x7fe4f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.411+0000 7fe51e000640 1 --2- 172.21.15.175:0/1444922415 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe4f4066f60 0x7fe4f4069420 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe5000af000 tx=0x7fe5000a7000 comp rx=0 tx=0).stop 2024-04-25T09:14:41.399 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.411+0000 7fe51e000640 1 -- 172.21.15.175:0/1444922415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5180b4630 msgr2=0x7fe51813f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.411+0000 7fe51e000640 1 --2- 172.21.15.175:0/1444922415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5180b4630 0x7fe51813f2f0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fe50800b410 tx=0x7fe50800b8d0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.411+0000 7fe51e000640 1 -- 172.21.15.175:0/1444922415 shutdown_connections 2024-04-25T09:14:41.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.411+0000 7fe51e000640 1 --2- 172.21.15.175:0/1444922415 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe4f4066f60 0x7fe4f4069420 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.411+0000 7fe51e000640 1 --2- 172.21.15.175:0/1444922415 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe51815af20 0x7fe518152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.411+0000 7fe51e000640 1 --2- 172.21.15.175:0/1444922415 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5180cbe60 0x7fe518152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.411+0000 7fe51e000640 1 --2- 172.21.15.175:0/1444922415 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5180b4630 0x7fe51813f2f0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.411+0000 7fe51e000640 1 -- 172.21.15.175:0/1444922415 >> 172.21.15.175:0/1444922415 conn(0x7fe51806ac50 msgr2=0x7fe5180ad9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:41.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.411+0000 7fe51e000640 1 -- 172.21.15.175:0/1444922415 shutdown_connections 2024-04-25T09:14:41.400 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.411+0000 7fe51e000640 1 -- 172.21.15.175:0/1444922415 wait complete. 2024-04-25T09:14:41.419 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:41.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.567+0000 7f2f92400640 1 Processor -- start 2024-04-25T09:14:41.554 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.567+0000 7f2f92400640 1 -- start start 2024-04-25T09:14:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.567+0000 7f2f92400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2f8c06bd60 0x7f2f8c06cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.567+0000 7f2f92400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2f8c0d0d50 0x7f2f8c0cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.567+0000 7f2f92400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8c0cfcb0 con 0x7f2f8c099a50 2024-04-25T09:14:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.567+0000 7f2f92400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8c0cff90 con 0x7f2f8c06bd60 2024-04-25T09:14:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.567+0000 7f2f92400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8c0d0270 con 0x7f2f8c0d0d50 2024-04-25T09:14:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.567+0000 7f2f8aa00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2f8c06bd60 0x7f2f8c06cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.567+0000 7f2f8aa00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2f8c06bd60 0x7f2f8c06cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41236/0 (socket says 172.21.15.175:41236) 2024-04-25T09:14:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.567+0000 7f2f8aa00640 1 -- 172.21.15.175:0/4144792960 learned_addr learned my addr 172.21.15.175:0/4144792960 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:41.556 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.567+0000 7f2f8be00640 1 --2- 172.21.15.175:0/4144792960 >> v2:172.21.15.177:3300/0 conn(0x7f2f8c0d0d50 0x7f2f8c0cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.567+0000 7f2f8aa00640 1 -- 172.21.15.175:0/4144792960 >> v2:172.21.15.177:3300/0 conn(0x7f2f8c0d0d50 msgr2=0x7f2f8c0cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.567+0000 7f2f8aa00640 1 --2- 172.21.15.175:0/4144792960 >> v2:172.21.15.177:3300/0 conn(0x7f2f8c0d0d50 0x7f2f8c0cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.567+0000 7f2f8aa00640 1 -- 172.21.15.175:0/4144792960 >> v1:172.21.15.177:6789/0 conn(0x7f2f8c099a50 legacy=0x7f2f8c099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.567+0000 7f2f8aa00640 1 -- 172.21.15.175:0/4144792960 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0d0550 con 0x7f2f8c06bd60 2024-04-25T09:14:41.557 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.567+0000 7f2f8be00640 1 --2- 172.21.15.175:0/4144792960 >> v2:172.21.15.177:3300/0 conn(0x7f2f8c0d0d50 0x7f2f8c0cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:41.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.571+0000 7f2f8aa00640 1 --2- 172.21.15.175:0/4144792960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f8c06bd60 0x7f2f8c06cc50 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c06f330 tx=0x7f2f7801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3305116ed7638eb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:41.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.571+0000 7f2f8a000640 1 -- 172.21.15.175:0/4144792960 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780b0070 con 0x7f2f8c06bd60 2024-04-25T09:14:41.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.571+0000 7f2f8a000640 1 -- 172.21.15.175:0/4144792960 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f780ab600 con 0x7f2f8c06bd60 2024-04-25T09:14:41.559 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.571+0000 7f2f8a000640 1 -- 172.21.15.175:0/4144792960 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f780ab9d0 con 0x7f2f8c06bd60 2024-04-25T09:14:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.571+0000 7f2f92400640 1 -- 172.21.15.175:0/4144792960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f8c06bd60 msgr2=0x7f2f8c06cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.571+0000 7f2f92400640 1 --2- 172.21.15.175:0/4144792960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f8c06bd60 0x7f2f8c06cc50 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c06f330 tx=0x7f2f7801c520 comp rx=0 tx=0).stop 2024-04-25T09:14:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.571+0000 7f2f92400640 1 -- 172.21.15.175:0/4144792960 shutdown_connections 2024-04-25T09:14:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.571+0000 7f2f92400640 1 --2- 172.21.15.175:0/4144792960 >> v2:172.21.15.177:3300/0 conn(0x7f2f8c0d0d50 0x7f2f8c0cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.571+0000 7f2f92400640 1 --2- 172.21.15.175:0/4144792960 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f8c06bd60 0x7f2f8c06cc50 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.571+0000 7f2f92400640 1 -- 172.21.15.175:0/4144792960 >> 172.21.15.175:0/4144792960 conn(0x7f2f8c0b3300 msgr2=0x7f2f8c0b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.571+0000 7f2f92400640 1 -- 172.21.15.175:0/4144792960 shutdown_connections 2024-04-25T09:14:41.560 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.571+0000 7f2f92400640 1 -- 172.21.15.175:0/4144792960 wait complete. 2024-04-25T09:14:41.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f92400640 1 Processor -- start 2024-04-25T09:14:41.561 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f92400640 1 -- start start 2024-04-25T09:14:41.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f92400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f8c06bd60 0x7f2f8c0b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f92400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f8c099a50 0x7f2f8c15cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f92400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f8c0d0d50 0x7f2f8c0b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f92400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c15dfe0 con 0x7f2f8c0d0d50 2024-04-25T09:14:41.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f92400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c15de60 con 0x7f2f8c06bd60 2024-04-25T09:14:41.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f92400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c16b260 con 0x7f2f8c099a50 2024-04-25T09:14:41.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f8be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f8c0d0d50 0x7f2f8c0b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f8be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f8c0d0d50 0x7f2f8c0b6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41248/0 (socket says 172.21.15.175:41248) 2024-04-25T09:14:41.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f8be00640 1 -- 172.21.15.175:0/1465592532 learned_addr learned my addr 172.21.15.175:0/1465592532 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:41.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f8aa00640 1 --2- 172.21.15.175:0/1465592532 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f8c099a50 0x7f2f8c15cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f8b400640 1 --2- 172.21.15.175:0/1465592532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f8c06bd60 0x7f2f8c0b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f8be00640 1 -- 172.21.15.175:0/1465592532 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f8c099a50 msgr2=0x7f2f8c15cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f8be00640 1 --2- 172.21.15.175:0/1465592532 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f8c099a50 0x7f2f8c15cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f8be00640 1 -- 172.21.15.175:0/1465592532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f8c06bd60 msgr2=0x7f2f8c0b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.565 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f8be00640 1 --2- 172.21.15.175:0/1465592532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f8c06bd60 0x7f2f8c0b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f8be00640 1 -- 172.21.15.175:0/1465592532 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0b1dc0 con 0x7f2f8c0d0d50 2024-04-25T09:14:41.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f8aa00640 1 --2- 172.21.15.175:0/1465592532 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f8c099a50 0x7f2f8c15cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:41.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f8b400640 1 --2- 172.21.15.175:0/1465592532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f8c06bd60 0x7f2f8c0b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:41.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f8be00640 1 --2- 172.21.15.175:0/1465592532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f8c0d0d50 0x7f2f8c0b6560 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f2f84007f20 tx=0x7f2f8400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:41.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f83400640 1 -- 172.21.15.175:0/1465592532 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8401a070 con 0x7f2f8c0d0d50 2024-04-25T09:14:41.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f83400640 1 -- 172.21.15.175:0/1465592532 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f84003ba0 con 0x7f2f8c0d0d50 2024-04-25T09:14:41.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f83400640 1 -- 172.21.15.175:0/1465592532 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84004030 con 0x7f2f8c0d0d50 2024-04-25T09:14:41.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f92400640 1 -- 172.21.15.175:0/1465592532 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8c0b57a0 con 0x7f2f8c0d0d50 2024-04-25T09:14:41.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f92400640 1 -- 172.21.15.175:0/1465592532 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c0b5d60 con 0x7f2f8c0d0d50 2024-04-25T09:14:41.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.575+0000 7f2f92400640 1 -- 172.21.15.175:0/1465592532 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8c074a60 con 0x7f2f8c0d0d50 2024-04-25T09:14:41.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.579+0000 7f2f83400640 1 -- 172.21.15.175:0/1465592532 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2f8401d070 con 0x7f2f8c0d0d50 2024-04-25T09:14:41.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.579+0000 7f2f83400640 1 --2- 172.21.15.175:0/1465592532 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2f6c066f60 0x7f2f6c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.579+0000 7f2f83400640 1 -- 172.21.15.175:0/1465592532 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f2f84085440 con 0x7f2f8c0d0d50 2024-04-25T09:14:41.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.579+0000 7f2f8b400640 1 --2- 172.21.15.175:0/1465592532 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2f6c066f60 0x7f2f6c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.579+0000 7f2f8b400640 1 --2- 172.21.15.175:0/1465592532 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2f6c066f60 0x7f2f6c069420 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c001710 tx=0x7f2f7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:41.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.583+0000 7f2f83400640 1 -- 172.21.15.175:0/1465592532 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2f84010070 con 0x7f2f8c0d0d50 2024-04-25T09:14:41.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.767+0000 7f2f92400640 1 -- 172.21.15.175:0/1465592532 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f8c0cf120 con 0x7f2f8c0d0d50 2024-04-25T09:14:41.756 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.767+0000 7f2f83400640 1 -- 172.21.15.175:0/1465592532 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4954 (secure 0 0 0) 0x7f2f84056390 con 0x7f2f8c0d0d50 2024-04-25T09:14:41.757 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:41.757 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/745891603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":745891603},{"type":"v1","addr":"172.21.15.175:6837","nonce":745891603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2312875672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2312875672},{"type":"v1","addr":"172.21.15.177:6834","nonce":2312875672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":8212,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3983919410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3983919410},{"type":"v1","addr":"172.21.15.177:6835","nonce":3983919410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:14:03.698308+0000","modified":"2024-04-25T09:14:33.028975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9120":{"gid":9120,"name":"c","rank":0,"incarnation":103,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6836/4159793972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":4159793972},{"type":"v1","addr":"172.21.15.175:6836","nonce":4159793972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:14:41.759 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 106 2024-04-25T09:14:41.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.771+0000 7f2f92400640 1 -- 172.21.15.175:0/1465592532 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2f6c066f60 msgr2=0x7f2f6c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.771+0000 7f2f92400640 1 --2- 172.21.15.175:0/1465592532 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2f6c066f60 0x7f2f6c069420 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c001710 tx=0x7f2f7c009040 comp rx=0 tx=0).stop 2024-04-25T09:14:41.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.771+0000 7f2f92400640 1 -- 172.21.15.175:0/1465592532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f8c0d0d50 msgr2=0x7f2f8c0b6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.771+0000 7f2f92400640 1 --2- 172.21.15.175:0/1465592532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f8c0d0d50 0x7f2f8c0b6560 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f2f84007f20 tx=0x7f2f8400d560 comp rx=0 tx=0).stop 2024-04-25T09:14:41.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.771+0000 7f2f92400640 1 -- 172.21.15.175:0/1465592532 shutdown_connections 2024-04-25T09:14:41.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.771+0000 7f2f92400640 1 --2- 172.21.15.175:0/1465592532 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2f6c066f60 0x7f2f6c069420 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.771+0000 7f2f92400640 1 --2- 172.21.15.175:0/1465592532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2f8c0d0d50 0x7f2f8c0b6560 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.771+0000 7f2f92400640 1 --2- 172.21.15.175:0/1465592532 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f8c099a50 0x7f2f8c15cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.771+0000 7f2f92400640 1 --2- 172.21.15.175:0/1465592532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f8c06bd60 0x7f2f8c0b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.771+0000 7f2f92400640 1 -- 172.21.15.175:0/1465592532 >> 172.21.15.175:0/1465592532 conn(0x7f2f8c0b3300 msgr2=0x7f2f8c06fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:41.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.771+0000 7f2f92400640 1 -- 172.21.15.175:0/1465592532 shutdown_connections 2024-04-25T09:14:41.761 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.771+0000 7f2f92400640 1 -- 172.21.15.175:0/1465592532 wait complete. 2024-04-25T09:14:41.779 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:14:41.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.927+0000 7fc7d9c00640 1 Processor -- start 2024-04-25T09:14:41.914 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.927+0000 7fc7d9c00640 1 -- start start 2024-04-25T09:14:41.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.927+0000 7fc7d9c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc7d40cd520 0x7fc7d406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.927+0000 7fc7d9c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d40cf560 0x7fc7d40cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.927+0000 7fc7d9c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d40cda00 con 0x7fc7d415a900 2024-04-25T09:14:41.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.927+0000 7fc7d9c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d415bcf0 con 0x7fc7d40cd520 2024-04-25T09:14:41.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.927+0000 7fc7d9c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d40cfef0 con 0x7fc7d40cf560 2024-04-25T09:14:41.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.927+0000 7fc7d2000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc7d40cd520 0x7fc7d406e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.917 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.927+0000 7fc7d2a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc7d415a900 0x7fc7d40ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:36140/0 (socket says 172.21.15.175:36140) 2024-04-25T09:14:41.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.927+0000 7fc7d2a00640 1 -- 172.21.15.175:0/3581247858 learned_addr learned my addr 172.21.15.175:0/3581247858 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:41.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.927+0000 7fc7d2000640 1 -- 172.21.15.175:0/3581247858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d40cf560 msgr2=0x7fc7d40cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:41.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.927+0000 7fc7d3400640 1 --2- 172.21.15.175:0/3581247858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d40cf560 0x7fc7d40cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.927+0000 7fc7d1600640 1 -- 172.21.15.175:0/3581247858 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643782892 0 0) 0x7fc7d40cda00 con 0x7fc7d415a900 2024-04-25T09:14:41.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.927+0000 7fc7d2000640 1 --2- 172.21.15.175:0/3581247858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d40cf560 0x7fc7d40cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.927+0000 7fc7d2000640 1 -- 172.21.15.175:0/3581247858 >> v1:172.21.15.175:6789/0 conn(0x7fc7d415a900 legacy=0x7fc7d40ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.927+0000 7fc7d2000640 1 -- 172.21.15.175:0/3581247858 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d40cdce0 con 0x7fc7d40cd520 2024-04-25T09:14:41.918 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.927+0000 7fc7d3400640 1 --2- 172.21.15.175:0/3581247858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d40cf560 0x7fc7d40cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:41.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.931+0000 7fc7d2000640 1 --2- 172.21.15.175:0/3581247858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7d40cd520 0x7fc7d406e150 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00097c0 tx=0x7fc7c001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2d914d60886123 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:41.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.931+0000 7fc7d1600640 1 -- 172.21.15.175:0/3581247858 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c00b2070 con 0x7fc7d40cd520 2024-04-25T09:14:41.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.931+0000 7fc7d1600640 1 -- 172.21.15.175:0/3581247858 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c00ad640 con 0x7fc7d40cd520 2024-04-25T09:14:41.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.931+0000 7fc7d1600640 1 -- 172.21.15.175:0/3581247858 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c00ada10 con 0x7fc7d40cd520 2024-04-25T09:14:41.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.931+0000 7fc7d9c00640 1 -- 172.21.15.175:0/3581247858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7d40cd520 msgr2=0x7fc7d406e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.931+0000 7fc7d9c00640 1 --2- 172.21.15.175:0/3581247858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7d40cd520 0x7fc7d406e150 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00097c0 tx=0x7fc7c001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.920 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.931+0000 7fc7d9c00640 1 -- 172.21.15.175:0/3581247858 shutdown_connections 2024-04-25T09:14:41.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.931+0000 7fc7d9c00640 1 --2- 172.21.15.175:0/3581247858 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d40cf560 0x7fc7d40cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.931+0000 7fc7d9c00640 1 --2- 172.21.15.175:0/3581247858 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7d40cd520 0x7fc7d406e150 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.931+0000 7fc7d9c00640 1 -- 172.21.15.175:0/3581247858 >> 172.21.15.175:0/3581247858 conn(0x7fc7d4067150 msgr2=0x7fc7d406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:41.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.931+0000 7fc7d9c00640 1 -- 172.21.15.175:0/3581247858 shutdown_connections 2024-04-25T09:14:41.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.931+0000 7fc7d9c00640 1 -- 172.21.15.175:0/3581247858 wait complete. 2024-04-25T09:14:41.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.931+0000 7fc7d9c00640 1 Processor -- start 2024-04-25T09:14:41.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d9c00640 1 -- start start 2024-04-25T09:14:41.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d9c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d40cf560 0x7fc7d4150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d9c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7d415a900 0x7fc7d4133be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d9c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7d4150ff0 0x7fc7d4134120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d9c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d406d530 con 0x7fc7d415a900 2024-04-25T09:14:41.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d9c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d406d3b0 con 0x7fc7d4150ff0 2024-04-25T09:14:41.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d9c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d415c790 con 0x7fc7d40cf560 2024-04-25T09:14:41.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d2000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7d415a900 0x7fc7d4133be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d2000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7d415a900 0x7fc7d4133be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41280/0 (socket says 172.21.15.175:41280) 2024-04-25T09:14:41.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d2000640 1 -- 172.21.15.175:0/1249709459 learned_addr learned my addr 172.21.15.175:0/1249709459 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:41.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d2a00640 1 --2- 172.21.15.175:0/1249709459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d40cf560 0x7fc7d4150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d3400640 1 --2- 172.21.15.175:0/1249709459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7d4150ff0 0x7fc7d4134120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d2000640 1 -- 172.21.15.175:0/1249709459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d40cf560 msgr2=0x7fc7d4150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d2000640 1 --2- 172.21.15.175:0/1249709459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d40cf560 0x7fc7d4150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d2000640 1 -- 172.21.15.175:0/1249709459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7d4150ff0 msgr2=0x7fc7d4134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:41.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d2000640 1 --2- 172.21.15.175:0/1249709459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7d4150ff0 0x7fc7d4134120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:41.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d2000640 1 -- 172.21.15.175:0/1249709459 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d414df40 con 0x7fc7d415a900 2024-04-25T09:14:41.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d2a00640 1 --2- 172.21.15.175:0/1249709459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d40cf560 0x7fc7d4150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:41.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d3400640 1 --2- 172.21.15.175:0/1249709459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7d4150ff0 0x7fc7d4134120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:41.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d2000640 1 --2- 172.21.15.175:0/1249709459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7d415a900 0x7fc7d4133be0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00b0040 tx=0x7fc7c0019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:41.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7caa00640 1 -- 172.21.15.175:0/1249709459 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c00b2040 con 0x7fc7d415a900 2024-04-25T09:14:41.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7caa00640 1 -- 172.21.15.175:0/1249709459 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c0004220 con 0x7fc7d415a900 2024-04-25T09:14:41.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7caa00640 1 -- 172.21.15.175:0/1249709459 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0003620 con 0x7fc7d415a900 2024-04-25T09:14:41.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d9c00640 1 -- 172.21.15.175:0/1249709459 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d414e220 con 0x7fc7d415a900 2024-04-25T09:14:41.926 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d9c00640 1 -- 172.21.15.175:0/1249709459 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d414e7e0 con 0x7fc7d415a900 2024-04-25T09:14:41.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.935+0000 7fc7d9c00640 1 -- 172.21.15.175:0/1249709459 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d4074a60 con 0x7fc7d415a900 2024-04-25T09:14:41.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.939+0000 7fc7caa00640 1 -- 172.21.15.175:0/1249709459 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc7c00bf060 con 0x7fc7d415a900 2024-04-25T09:14:41.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.939+0000 7fc7caa00640 1 --2- 172.21.15.175:0/1249709459 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc7b4066f60 0x7fc7b4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:41.927 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.939+0000 7fc7caa00640 1 -- 172.21.15.175:0/1249709459 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fc7c011e6b0 con 0x7fc7d415a900 2024-04-25T09:14:41.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.939+0000 7fc7d2a00640 1 --2- 172.21.15.175:0/1249709459 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc7b4066f60 0x7fc7b4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:41.928 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.939+0000 7fc7d2a00640 1 --2- 172.21.15.175:0/1249709459 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc7b4066f60 0x7fc7b4069420 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4000f70 tx=0x7fc7c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:41.930 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:41.943+0000 7fc7caa00640 1 -- 172.21.15.175:0/1249709459 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc7c0016090 con 0x7fc7d415a900 2024-04-25T09:14:42.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.103+0000 7fc7d9c00640 1 -- 172.21.15.175:0/1249709459 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7d4158900 con 0x7fc7d415a900 2024-04-25T09:14:42.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.103+0000 7fc7caa00640 1 -- 172.21.15.175:0/1249709459 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+16924 (secure 0 0 0) 0x7fc7c00ac3a0 con 0x7fc7d415a900 2024-04-25T09:14:42.093 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:42.093 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":115,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:14:28.999711+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:14:01.413477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:14:02.699273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6836/386187898":"2024-04-26T09:14:28.999694+0000","172.21.15.175:6836/4128642659":"2024-04-26T09:14:18.106892+0000","172.21.15.175:6834/386187898":"2024-04-26T09:14:28.999694+0000","172.21.15.175:6834/4128642659":"2024-04-26T09:14:18.106892+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:14:42.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.107+0000 7fc7d9c00640 1 -- 172.21.15.175:0/1249709459 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc7b4066f60 msgr2=0x7fc7b4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.107+0000 7fc7d9c00640 1 --2- 172.21.15.175:0/1249709459 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc7b4066f60 0x7fc7b4069420 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4000f70 tx=0x7fc7c4009040 comp rx=0 tx=0).stop 2024-04-25T09:14:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.107+0000 7fc7d9c00640 1 -- 172.21.15.175:0/1249709459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7d415a900 msgr2=0x7fc7d4133be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.107+0000 7fc7d9c00640 1 --2- 172.21.15.175:0/1249709459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7d415a900 0x7fc7d4133be0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00b0040 tx=0x7fc7c0019240 comp rx=0 tx=0).stop 2024-04-25T09:14:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.107+0000 7fc7d9c00640 1 -- 172.21.15.175:0/1249709459 shutdown_connections 2024-04-25T09:14:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.107+0000 7fc7d9c00640 1 --2- 172.21.15.175:0/1249709459 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc7b4066f60 0x7fc7b4069420 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.107+0000 7fc7d9c00640 1 --2- 172.21.15.175:0/1249709459 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7d4150ff0 0x7fc7d4134120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.107+0000 7fc7d9c00640 1 --2- 172.21.15.175:0/1249709459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7d415a900 0x7fc7d4133be0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.107+0000 7fc7d9c00640 1 --2- 172.21.15.175:0/1249709459 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d40cf560 0x7fc7d4150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.107+0000 7fc7d9c00640 1 -- 172.21.15.175:0/1249709459 >> 172.21.15.175:0/1249709459 conn(0x7fc7d40cd520 msgr2=0x7fc7d406dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.107+0000 7fc7d9c00640 1 -- 172.21.15.175:0/1249709459 shutdown_connections 2024-04-25T09:14:42.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.107+0000 7fc7d9c00640 1 -- 172.21.15.175:0/1249709459 wait complete. 2024-04-25T09:14:42.113 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:14:42.113 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:42.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.263+0000 7f8715c00640 1 Processor -- start 2024-04-25T09:14:42.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.263+0000 7f8715c00640 1 -- start start 2024-04-25T09:14:42.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.263+0000 7f8715c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f87100cd520 0x7f871006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.263+0000 7f8715c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100cf560 0x7f87100cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.263+0000 7f8715c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87100cda00 con 0x7f871015a900 2024-04-25T09:14:42.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.263+0000 7f8715c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871015bcf0 con 0x7f87100cd520 2024-04-25T09:14:42.252 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.263+0000 7f8715c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87100cfef0 con 0x7f87100cf560 2024-04-25T09:14:42.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.263+0000 7f8706000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f87100cd520 0x7f871006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.263+0000 7f870ea00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f871015a900 0x7f87100ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:51182/0 (socket says 172.21.15.175:51182) 2024-04-25T09:14:42.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.263+0000 7f870f400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100cf560 0x7f87100cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.263+0000 7f870ea00640 1 -- 172.21.15.175:0/4010023856 learned_addr learned my addr 172.21.15.175:0/4010023856 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:42.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.263+0000 7f8706000640 1 -- 172.21.15.175:0/4010023856 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100cf560 msgr2=0x7f87100cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:42.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.263+0000 7f8706000640 1 --2- 172.21.15.175:0/4010023856 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100cf560 0x7f87100cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.263+0000 7f8706000640 1 -- 172.21.15.175:0/4010023856 >> v1:172.21.15.177:6789/0 conn(0x7f871015a900 legacy=0x7f87100ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.253 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.263+0000 7f8706000640 1 -- 172.21.15.175:0/4010023856 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87100cdce0 con 0x7f87100cd520 2024-04-25T09:14:42.255 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.267+0000 7f8706000640 1 --2- 172.21.15.175:0/4010023856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87100cd520 0x7f871006e150 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f86f80097c0 tx=0x7f86f801e6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5ba112a3e9583fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:42.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.267+0000 7f870e000640 1 -- 172.21.15.175:0/4010023856 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f80ab670 con 0x7f87100cd520 2024-04-25T09:14:42.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.267+0000 7f870e000640 1 -- 172.21.15.175:0/4010023856 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f80ab810 con 0x7f87100cd520 2024-04-25T09:14:42.256 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.267+0000 7f870e000640 1 -- 172.21.15.175:0/4010023856 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f80abbe0 con 0x7f87100cd520 2024-04-25T09:14:42.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.267+0000 7f8715c00640 1 -- 172.21.15.175:0/4010023856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87100cd520 msgr2=0x7f871006e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.267+0000 7f8715c00640 1 --2- 172.21.15.175:0/4010023856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87100cd520 0x7f871006e150 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f86f80097c0 tx=0x7f86f801e6b0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.267+0000 7f8715c00640 1 -- 172.21.15.175:0/4010023856 shutdown_connections 2024-04-25T09:14:42.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.267+0000 7f8715c00640 1 --2- 172.21.15.175:0/4010023856 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100cf560 0x7f87100cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.257 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.267+0000 7f8715c00640 1 --2- 172.21.15.175:0/4010023856 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87100cd520 0x7f871006e150 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.267+0000 7f8715c00640 1 -- 172.21.15.175:0/4010023856 >> 172.21.15.175:0/4010023856 conn(0x7f8710067150 msgr2=0x7f871006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:42.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f8715c00640 1 -- 172.21.15.175:0/4010023856 shutdown_connections 2024-04-25T09:14:42.258 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f8715c00640 1 -- 172.21.15.175:0/4010023856 wait complete. 2024-04-25T09:14:42.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f8715c00640 1 Processor -- start 2024-04-25T09:14:42.259 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f8715c00640 1 -- start start 2024-04-25T09:14:42.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f8715c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100cf560 0x7f87101499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f8715c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f871015a900 0x7f871014d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f8715c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f871014a020 0x7f8710154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f8715c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871006d530 con 0x7f871014a020 2024-04-25T09:14:42.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f8715c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871006d3b0 con 0x7f871015a900 2024-04-25T09:14:42.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f8715c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871015c790 con 0x7f87100cf560 2024-04-25T09:14:42.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f870f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f871014a020 0x7f8710154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f870f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f871014a020 0x7f8710154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41294/0 (socket says 172.21.15.175:41294) 2024-04-25T09:14:42.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f870f400640 1 -- 172.21.15.175:0/2981930714 learned_addr learned my addr 172.21.15.175:0/2981930714 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:42.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f870ea00640 1 --2- 172.21.15.175:0/2981930714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100cf560 0x7f87101499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f8706000640 1 --2- 172.21.15.175:0/2981930714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f871015a900 0x7f871014d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f870f400640 1 -- 172.21.15.175:0/2981930714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100cf560 msgr2=0x7f87101499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.261 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f870f400640 1 --2- 172.21.15.175:0/2981930714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100cf560 0x7f87101499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f870f400640 1 -- 172.21.15.175:0/2981930714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f871015a900 msgr2=0x7f871014d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f870f400640 1 --2- 172.21.15.175:0/2981930714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f871015a900 0x7f871014d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f870f400640 1 -- 172.21.15.175:0/2981930714 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871014dff0 con 0x7f871014a020 2024-04-25T09:14:42.262 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.271+0000 7f870f400640 1 --2- 172.21.15.175:0/2981930714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f871014a020 0x7f8710154370 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f870800efc0 tx=0x7f870800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:42.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.275+0000 7f8707400640 1 -- 172.21.15.175:0/2981930714 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708018020 con 0x7f871014a020 2024-04-25T09:14:42.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.275+0000 7f8707400640 1 -- 172.21.15.175:0/2981930714 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8708014480 con 0x7f871014a020 2024-04-25T09:14:42.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.275+0000 7f8707400640 1 -- 172.21.15.175:0/2981930714 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708014870 con 0x7f871014a020 2024-04-25T09:14:42.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.275+0000 7f8715c00640 1 -- 172.21.15.175:0/2981930714 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871014e330 con 0x7f871014a020 2024-04-25T09:14:42.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.275+0000 7f8715c00640 1 -- 172.21.15.175:0/2981930714 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871014e5d0 con 0x7f871014a020 2024-04-25T09:14:42.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.275+0000 7f8715c00640 1 -- 172.21.15.175:0/2981930714 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8710074a60 con 0x7f871014a020 2024-04-25T09:14:42.263 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.275+0000 7f8707400640 1 -- 172.21.15.175:0/2981930714 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f870801b020 con 0x7f871014a020 2024-04-25T09:14:42.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.275+0000 7f8707400640 1 --2- 172.21.15.175:0/2981930714 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86ec066f90 0x7f86ec069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.275+0000 7f8707400640 1 -- 172.21.15.175:0/2981930714 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f8708085dd0 con 0x7f871014a020 2024-04-25T09:14:42.264 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.275+0000 7f870ea00640 1 --2- 172.21.15.175:0/2981930714 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86ec066f90 0x7f86ec069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.275+0000 7f870ea00640 1 --2- 172.21.15.175:0/2981930714 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86ec066f90 0x7f86ec069450 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f8700000f70 tx=0x7f8700007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:42.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.279+0000 7f8707400640 1 -- 172.21.15.175:0/2981930714 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8708022030 con 0x7f871014a020 2024-04-25T09:14:42.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.467+0000 7f8715c00640 1 -- 172.21.15.175:0/2981930714 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f871006adf0 con 0x7f871014a020 2024-04-25T09:14:42.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.467+0000 7f8707400640 1 -- 172.21.15.175:0/2981930714 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4954 (secure 0 0 0) 0x7f8708010040 con 0x7f871014a020 2024-04-25T09:14:42.457 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:42.457 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/745891603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":745891603},{"type":"v1","addr":"172.21.15.175:6837","nonce":745891603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2312875672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2312875672},{"type":"v1","addr":"172.21.15.177:6834","nonce":2312875672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":8212,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3983919410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3983919410},{"type":"v1","addr":"172.21.15.177:6835","nonce":3983919410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:14:03.698308+0000","modified":"2024-04-25T09:14:33.028975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9120":{"gid":9120,"name":"c","rank":0,"incarnation":103,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6836/4159793972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":4159793972},{"type":"v1","addr":"172.21.15.175:6836","nonce":4159793972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:14:42.457 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 106 2024-04-25T09:14:42.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.471+0000 7f8715c00640 1 -- 172.21.15.175:0/2981930714 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86ec066f90 msgr2=0x7f86ec069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.471+0000 7f8715c00640 1 --2- 172.21.15.175:0/2981930714 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86ec066f90 0x7f86ec069450 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f8700000f70 tx=0x7f8700007e90 comp rx=0 tx=0).stop 2024-04-25T09:14:42.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.471+0000 7f8715c00640 1 -- 172.21.15.175:0/2981930714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f871014a020 msgr2=0x7f8710154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.471+0000 7f8715c00640 1 --2- 172.21.15.175:0/2981930714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f871014a020 0x7f8710154370 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f870800efc0 tx=0x7f870800c490 comp rx=0 tx=0).stop 2024-04-25T09:14:42.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.471+0000 7f8715c00640 1 -- 172.21.15.175:0/2981930714 shutdown_connections 2024-04-25T09:14:42.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.471+0000 7f8715c00640 1 --2- 172.21.15.175:0/2981930714 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f86ec066f90 0x7f86ec069450 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.471+0000 7f8715c00640 1 --2- 172.21.15.175:0/2981930714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f871014a020 0x7f8710154370 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.471+0000 7f8715c00640 1 --2- 172.21.15.175:0/2981930714 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f871015a900 0x7f871014d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.471+0000 7f8715c00640 1 --2- 172.21.15.175:0/2981930714 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87100cf560 0x7f87101499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.471+0000 7f8715c00640 1 -- 172.21.15.175:0/2981930714 >> 172.21.15.175:0/2981930714 conn(0x7f87100cd520 msgr2=0x7f871006d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:42.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.471+0000 7f8715c00640 1 -- 172.21.15.175:0/2981930714 shutdown_connections 2024-04-25T09:14:42.460 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.471+0000 7f8715c00640 1 -- 172.21.15.175:0/2981930714 wait complete. 2024-04-25T09:14:42.477 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:14:42.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.623+0000 7f2dc6600640 1 Processor -- start 2024-04-25T09:14:42.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.623+0000 7f2dc6600640 1 -- start start 2024-04-25T09:14:42.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.627+0000 7f2dc6600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2dc0071950 0x7f2dc006de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.627+0000 7f2dc6600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc006eba0 con 0x7f2dc006e340 2024-04-25T09:14:42.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.627+0000 7f2dc6600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc006ee80 con 0x7f2dc00aeb30 2024-04-25T09:14:42.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.627+0000 7f2dc6600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dc00b2a70 con 0x7f2dc0071950 2024-04-25T09:14:42.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.627+0000 7f2dbfe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f2dc006e340 0x7f2dc00b2f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:36148/0 (socket says 172.21.15.175:36148) 2024-04-25T09:14:42.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.627+0000 7f2dbfe00640 1 -- 172.21.15.175:0/3789546613 learned_addr learned my addr 172.21.15.175:0/3789546613 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:42.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.627+0000 7f2dbea00640 1 --2- 172.21.15.175:0/3789546613 >> v2:172.21.15.177:3300/0 conn(0x7f2dc0071950 0x7f2dc006de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.627+0000 7f2dbe000640 1 -- 172.21.15.175:0/3789546613 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976780224 0 0) 0x7f2dc006eba0 con 0x7f2dc006e340 2024-04-25T09:14:42.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.627+0000 7f2dbe000640 1 -- 172.21.15.175:0/3789546613 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2da4003530 con 0x7f2dc006e340 2024-04-25T09:14:42.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.627+0000 7f2dbea00640 1 -- 172.21.15.175:0/3789546613 >> v1:172.21.15.177:6789/0 conn(0x7f2dc00aeb30 legacy=0x7f2dc0071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.627+0000 7f2dbea00640 1 -- 172.21.15.175:0/3789546613 >> v1:172.21.15.175:6789/0 conn(0x7f2dc006e340 legacy=0x7f2dc00b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.627+0000 7f2dbea00640 1 -- 172.21.15.175:0/3789546613 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc00b2700 con 0x7f2dc0071950 2024-04-25T09:14:42.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dbea00640 1 --2- 172.21.15.175:0/3789546613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc0071950 0x7f2dc006de00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00b2bf0 tx=0x7f2dac01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ade1f932e5e5ad2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:42.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dbe000640 1 -- 172.21.15.175:0/3789546613 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac0ab640 con 0x7f2dc0071950 2024-04-25T09:14:42.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dbe000640 1 -- 172.21.15.175:0/3789546613 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac0b0070 con 0x7f2dc0071950 2024-04-25T09:14:42.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dbe000640 1 -- 172.21.15.175:0/3789546613 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac0aba00 con 0x7f2dc0071950 2024-04-25T09:14:42.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dc6600640 1 -- 172.21.15.175:0/3789546613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc0071950 msgr2=0x7f2dc006de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dc6600640 1 --2- 172.21.15.175:0/3789546613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc0071950 0x7f2dc006de00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00b2bf0 tx=0x7f2dac01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dc6600640 1 -- 172.21.15.175:0/3789546613 shutdown_connections 2024-04-25T09:14:42.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dc6600640 1 --2- 172.21.15.175:0/3789546613 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc0071950 0x7f2dc006de00 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dc6600640 1 -- 172.21.15.175:0/3789546613 >> 172.21.15.175:0/3789546613 conn(0x7f2dc0067150 msgr2=0x7f2dc006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:42.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dc6600640 1 -- 172.21.15.175:0/3789546613 shutdown_connections 2024-04-25T09:14:42.619 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dc6600640 1 -- 172.21.15.175:0/3789546613 wait complete. 2024-04-25T09:14:42.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dc6600640 1 Processor -- start 2024-04-25T09:14:42.620 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dc6600640 1 -- start start 2024-04-25T09:14:42.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dc6600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2dc0071950 0x7f2dc00b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dc6600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc00aeb30 0x7f2dc014b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dc6600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2dc01fa980 0x7f2dc00b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dc6600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc00b3a20 con 0x7f2dc01fa980 2024-04-25T09:14:42.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dc6600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc00b38a0 con 0x7f2dc00aeb30 2024-04-25T09:14:42.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.631+0000 7f2dc6600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc00b3ba0 con 0x7f2dc0071950 2024-04-25T09:14:42.623 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.635+0000 7f2dbfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2dc01fa980 0x7f2dc00b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.635+0000 7f2dbfe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2dc01fa980 0x7f2dc00b1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41306/0 (socket says 172.21.15.175:41306) 2024-04-25T09:14:42.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.635+0000 7f2dbfe00640 1 -- 172.21.15.175:0/1134680888 learned_addr learned my addr 172.21.15.175:0/1134680888 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:42.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.635+0000 7f2dbfe00640 1 -- 172.21.15.175:0/1134680888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2dc0071950 msgr2=0x7f2dc00b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.635+0000 7f2dbfe00640 1 --2- 172.21.15.175:0/1134680888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2dc0071950 0x7f2dc00b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.635+0000 7f2dbfe00640 1 -- 172.21.15.175:0/1134680888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc00aeb30 msgr2=0x7f2dc014b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.635+0000 7f2dbfe00640 1 --2- 172.21.15.175:0/1134680888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc00aeb30 0x7f2dc014b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.635+0000 7f2dbfe00640 1 -- 172.21.15.175:0/1134680888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc00b2290 con 0x7f2dc01fa980 2024-04-25T09:14:42.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.635+0000 7f2dbfe00640 1 --2- 172.21.15.175:0/1134680888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2dc01fa980 0x7f2dc00b1d50 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f2db800c450 tx=0x7f2db800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:42.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.635+0000 7f2db7400640 1 -- 172.21.15.175:0/1134680888 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db8017070 con 0x7f2dc01fa980 2024-04-25T09:14:42.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.635+0000 7f2db7400640 1 -- 172.21.15.175:0/1134680888 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db8005cf0 con 0x7f2dc01fa980 2024-04-25T09:14:42.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.635+0000 7f2db7400640 1 -- 172.21.15.175:0/1134680888 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db80072b0 con 0x7f2dc01fa980 2024-04-25T09:14:42.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.635+0000 7f2dc6600640 1 -- 172.21.15.175:0/1134680888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc01fae00 con 0x7f2dc01fa980 2024-04-25T09:14:42.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.635+0000 7f2dc6600640 1 -- 172.21.15.175:0/1134680888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc00b0f90 con 0x7f2dc01fa980 2024-04-25T09:14:42.626 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.635+0000 7f2dc6600640 1 -- 172.21.15.175:0/1134680888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc0074a60 con 0x7f2dc01fa980 2024-04-25T09:14:42.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.635+0000 7f2db7400640 1 -- 172.21.15.175:0/1134680888 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2db801a070 con 0x7f2dc01fa980 2024-04-25T09:14:42.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.639+0000 7f2db7400640 1 --2- 172.21.15.175:0/1134680888 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2da0066f60 0x7f2da0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.639+0000 7f2db7400640 1 -- 172.21.15.175:0/1134680888 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f2db8084390 con 0x7f2dc01fa980 2024-04-25T09:14:42.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.639+0000 7f2dbf400640 1 --2- 172.21.15.175:0/1134680888 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2da0066f60 0x7f2da0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.639+0000 7f2dbf400640 1 --2- 172.21.15.175:0/1134680888 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2da0066f60 0x7f2da0069420 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2db0007fd0 tx=0x7f2db0007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:42.629 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.643+0000 7f2db7400640 1 -- 172.21.15.175:0/1134680888 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2db80552d0 con 0x7f2dc01fa980 2024-04-25T09:14:42.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.827+0000 7f2dc6600640 1 -- 172.21.15.175:0/1134680888 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2dc00b24e0 con 0x7f2dc01fa980 2024-04-25T09:14:42.815 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.827+0000 7f2db7400640 1 -- 172.21.15.175:0/1134680888 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4954 (secure 0 0 0) 0x7f2db8054bd0 con 0x7f2dc01fa980 2024-04-25T09:14:42.815 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:42.815 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/745891603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":745891603},{"type":"v1","addr":"172.21.15.175:6837","nonce":745891603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2312875672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2312875672},{"type":"v1","addr":"172.21.15.177:6834","nonce":2312875672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":8212,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3983919410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3983919410},{"type":"v1","addr":"172.21.15.177:6835","nonce":3983919410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:14:03.698308+0000","modified":"2024-04-25T09:14:33.028975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":115,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9120},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9120":{"gid":9120,"name":"c","rank":0,"incarnation":103,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6836/4159793972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":4159793972},{"type":"v1","addr":"172.21.15.175:6836","nonce":4159793972}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:14:42.816 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 106 2024-04-25T09:14:42.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.831+0000 7f2dc6600640 1 -- 172.21.15.175:0/1134680888 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2da0066f60 msgr2=0x7f2da0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.831+0000 7f2dc6600640 1 --2- 172.21.15.175:0/1134680888 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2da0066f60 0x7f2da0069420 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f2db0007fd0 tx=0x7f2db0007d60 comp rx=0 tx=0).stop 2024-04-25T09:14:42.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.831+0000 7f2dc6600640 1 -- 172.21.15.175:0/1134680888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2dc01fa980 msgr2=0x7f2dc00b1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.831+0000 7f2dc6600640 1 --2- 172.21.15.175:0/1134680888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2dc01fa980 0x7f2dc00b1d50 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f2db800c450 tx=0x7f2db800c910 comp rx=0 tx=0).stop 2024-04-25T09:14:42.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.831+0000 7f2dc6600640 1 -- 172.21.15.175:0/1134680888 shutdown_connections 2024-04-25T09:14:42.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.831+0000 7f2dc6600640 1 --2- 172.21.15.175:0/1134680888 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f2da0066f60 0x7f2da0069420 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.831+0000 7f2dc6600640 1 --2- 172.21.15.175:0/1134680888 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2dc01fa980 0x7f2dc00b1d50 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.831+0000 7f2dc6600640 1 --2- 172.21.15.175:0/1134680888 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2dc00aeb30 0x7f2dc014b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.818 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.831+0000 7f2dc6600640 1 --2- 172.21.15.175:0/1134680888 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2dc0071950 0x7f2dc00b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.831+0000 7f2dc6600640 1 -- 172.21.15.175:0/1134680888 >> 172.21.15.175:0/1134680888 conn(0x7f2dc006e340 msgr2=0x7f2dc00b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:42.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.831+0000 7f2dc6600640 1 -- 172.21.15.175:0/1134680888 shutdown_connections 2024-04-25T09:14:42.819 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.831+0000 7f2dc6600640 1 -- 172.21.15.175:0/1134680888 wait complete. 2024-04-25T09:14:42.838 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:14:42.974 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.987+0000 7f5b22200640 1 Processor -- start 2024-04-25T09:14:42.975 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.987+0000 7f5b22200640 1 -- start start 2024-04-25T09:14:42.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.987+0000 7f5b22200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5b1c09abb0 0x7f5b1c0cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.987+0000 7f5b22200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1c0cc4c0 con 0x7f5b1c099a50 2024-04-25T09:14:42.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.987+0000 7f5b22200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1c0cc7a0 con 0x7f5b1c15bc10 2024-04-25T09:14:42.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.987+0000 7f5b22200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1c0d06f0 con 0x7f5b1c09abb0 2024-04-25T09:14:42.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.987+0000 7f5b1be00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5b1c09abb0 0x7f5b1c0cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.987+0000 7f5b1b400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5b1c099a50 0x7f5b1c099e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:36164/0 (socket says 172.21.15.175:36164) 2024-04-25T09:14:42.976 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.987+0000 7f5b1b400640 1 -- 172.21.15.175:0/1538896118 learned_addr learned my addr 172.21.15.175:0/1538896118 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:42.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.987+0000 7f5b1be00640 1 -- 172.21.15.175:0/1538896118 >> v1:172.21.15.177:6789/0 conn(0x7f5b1c15bc10 legacy=0x7f5b1c0cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:42.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.987+0000 7f5b1be00640 1 -- 172.21.15.175:0/1538896118 >> v1:172.21.15.175:6789/0 conn(0x7f5b1c099a50 legacy=0x7f5b1c099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.987+0000 7f5b1be00640 1 -- 172.21.15.175:0/1538896118 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c0cca80 con 0x7f5b1c09abb0 2024-04-25T09:14:42.977 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.987+0000 7f5b1a000640 1 -- 172.21.15.175:0/1538896118 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912583794 0 0) 0x7f5b1c0cc4c0 con 0x7f5b1c099a50 2024-04-25T09:14:42.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.991+0000 7f5b1be00640 1 --2- 172.21.15.175:0/1538896118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b1c09abb0 0x7f5b1c0cd280 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009d90 tx=0x7f5b1401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b63d1cbff489bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:42.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.991+0000 7f5b1a000640 1 -- 172.21.15.175:0/1538896118 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b140b2070 con 0x7f5b1c09abb0 2024-04-25T09:14:42.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.991+0000 7f5b1a000640 1 -- 172.21.15.175:0/1538896118 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b140a5830 con 0x7f5b1c09abb0 2024-04-25T09:14:42.979 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.991+0000 7f5b1a000640 1 -- 172.21.15.175:0/1538896118 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b140a5c00 con 0x7f5b1c09abb0 2024-04-25T09:14:42.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.991+0000 7f5b22200640 1 -- 172.21.15.175:0/1538896118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b1c09abb0 msgr2=0x7f5b1c0cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.991+0000 7f5b22200640 1 --2- 172.21.15.175:0/1538896118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b1c09abb0 0x7f5b1c0cd280 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009d90 tx=0x7f5b1401c970 comp rx=0 tx=0).stop 2024-04-25T09:14:42.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.991+0000 7f5b22200640 1 -- 172.21.15.175:0/1538896118 shutdown_connections 2024-04-25T09:14:42.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.991+0000 7f5b22200640 1 --2- 172.21.15.175:0/1538896118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b1c09abb0 0x7f5b1c0cd280 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.991+0000 7f5b22200640 1 -- 172.21.15.175:0/1538896118 >> 172.21.15.175:0/1538896118 conn(0x7f5b1c0b3300 msgr2=0x7f5b1c0b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:42.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.991+0000 7f5b22200640 1 -- 172.21.15.175:0/1538896118 shutdown_connections 2024-04-25T09:14:42.980 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.991+0000 7f5b22200640 1 -- 172.21.15.175:0/1538896118 wait complete. 2024-04-25T09:14:42.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b22200640 1 Processor -- start 2024-04-25T09:14:42.981 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b22200640 1 -- start start 2024-04-25T09:14:42.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b22200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b1c099a50 0x7f5b1c15c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b22200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c09abb0 0x7f5b1c15c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b22200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b1c15bc10 0x7f5b1c147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b22200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c0c5f00 con 0x7f5b1c099a50 2024-04-25T09:14:42.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b22200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c0c5d80 con 0x7f5b1c09abb0 2024-04-25T09:14:42.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b22200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1c169860 con 0x7f5b1c15bc10 2024-04-25T09:14:42.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b1b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b1c099a50 0x7f5b1c15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b1b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b1c099a50 0x7f5b1c15c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41336/0 (socket says 172.21.15.175:41336) 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b1b400640 1 -- 172.21.15.175:0/3719433175 learned_addr learned my addr 172.21.15.175:0/3719433175 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b1aa00640 1 --2- 172.21.15.175:0/3719433175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c09abb0 0x7f5b1c15c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b1be00640 1 --2- 172.21.15.175:0/3719433175 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b1c15bc10 0x7f5b1c147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b1b400640 1 -- 172.21.15.175:0/3719433175 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b1c15bc10 msgr2=0x7f5b1c147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b1b400640 1 --2- 172.21.15.175:0/3719433175 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b1c15bc10 0x7f5b1c147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b1b400640 1 -- 172.21.15.175:0/3719433175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c09abb0 msgr2=0x7f5b1c15c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b1b400640 1 --2- 172.21.15.175:0/3719433175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c09abb0 0x7f5b1c15c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b1b400640 1 -- 172.21.15.175:0/3719433175 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c154960 con 0x7f5b1c099a50 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b1aa00640 1 --2- 172.21.15.175:0/3719433175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c09abb0 0x7f5b1c15c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b1b400640 1 --2- 172.21.15.175:0/3719433175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b1c099a50 0x7f5b1c15c010 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400c4a0 tx=0x7f5b0400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b13400640 1 -- 172.21.15.175:0/3719433175 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b04018070 con 0x7f5b1c099a50 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b13400640 1 -- 172.21.15.175:0/3719433175 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b040074e0 con 0x7f5b1c099a50 2024-04-25T09:14:42.985 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b13400640 1 -- 172.21.15.175:0/3719433175 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b04004a30 con 0x7f5b1c099a50 2024-04-25T09:14:42.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b22200640 1 -- 172.21.15.175:0/3719433175 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1c1f54a0 con 0x7f5b1c099a50 2024-04-25T09:14:42.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b22200640 1 -- 172.21.15.175:0/3719433175 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1c1f5a60 con 0x7f5b1c099a50 2024-04-25T09:14:42.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.995+0000 7f5b22200640 1 -- 172.21.15.175:0/3719433175 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1c167670 con 0x7f5b1c099a50 2024-04-25T09:14:42.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.999+0000 7f5b13400640 1 -- 172.21.15.175:0/3719433175 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5b04004bd0 con 0x7f5b1c099a50 2024-04-25T09:14:42.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.999+0000 7f5b13400640 1 --2- 172.21.15.175:0/3719433175 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5af8066f60 0x7f5af8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:42.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.999+0000 7f5b13400640 1 -- 172.21.15.175:0/3719433175 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f5b040844f0 con 0x7f5b1c099a50 2024-04-25T09:14:42.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.999+0000 7f5b1aa00640 1 --2- 172.21.15.175:0/3719433175 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5af8066f60 0x7f5af8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:42.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:42.999+0000 7f5b1aa00640 1 --2- 172.21.15.175:0/3719433175 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5af8066f60 0x7f5af8069420 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c14db10 tx=0x7f5b0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:42.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.003+0000 7f5b13400640 1 -- 172.21.15.175:0/3719433175 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5b1c167670 con 0x7f5b1c099a50 2024-04-25T09:14:43.147 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.159+0000 7f5b22200640 1 -- 172.21.15.175:0/3719433175 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b1c074a60 con 0x7f5b1c099a50 2024-04-25T09:14:43.148 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.159+0000 7f5b13400640 1 -- 172.21.15.175:0/3719433175 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+16924 (secure 0 0 0) 0x7f5b040553b0 con 0x7f5b1c099a50 2024-04-25T09:14:43.149 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:43.149 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":115,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:14:28.999711+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:14:01.413477+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-25T09:14:02.699273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6836/386187898":"2024-04-26T09:14:28.999694+0000","172.21.15.175:6836/4128642659":"2024-04-26T09:14:18.106892+0000","172.21.15.175:6834/386187898":"2024-04-26T09:14:28.999694+0000","172.21.15.175:6834/4128642659":"2024-04-26T09:14:18.106892+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:14:43.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.163+0000 7f5b22200640 1 -- 172.21.15.175:0/3719433175 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5af8066f60 msgr2=0x7f5af8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.163+0000 7f5b22200640 1 --2- 172.21.15.175:0/3719433175 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5af8066f60 0x7f5af8069420 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c14db10 tx=0x7f5b0c009040 comp rx=0 tx=0).stop 2024-04-25T09:14:43.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.163+0000 7f5b22200640 1 -- 172.21.15.175:0/3719433175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b1c099a50 msgr2=0x7f5b1c15c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.163+0000 7f5b22200640 1 --2- 172.21.15.175:0/3719433175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b1c099a50 0x7f5b1c15c010 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f5b0400c4a0 tx=0x7f5b0400c960 comp rx=0 tx=0).stop 2024-04-25T09:14:43.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.163+0000 7f5b22200640 1 -- 172.21.15.175:0/3719433175 shutdown_connections 2024-04-25T09:14:43.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.163+0000 7f5b22200640 1 --2- 172.21.15.175:0/3719433175 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5af8066f60 0x7f5af8069420 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.163+0000 7f5b22200640 1 --2- 172.21.15.175:0/3719433175 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b1c15bc10 0x7f5b1c147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.163+0000 7f5b22200640 1 --2- 172.21.15.175:0/3719433175 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b1c09abb0 0x7f5b1c15c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.151 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.163+0000 7f5b22200640 1 --2- 172.21.15.175:0/3719433175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b1c099a50 0x7f5b1c15c010 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.163+0000 7f5b22200640 1 -- 172.21.15.175:0/3719433175 >> 172.21.15.175:0/3719433175 conn(0x7f5b1c0b3300 msgr2=0x7f5b1c099e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:43.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.163+0000 7f5b22200640 1 -- 172.21.15.175:0/3719433175 shutdown_connections 2024-04-25T09:14:43.152 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.163+0000 7f5b22200640 1 -- 172.21.15.175:0/3719433175 wait complete. 2024-04-25T09:14:43.170 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:14:43.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.319+0000 7f0f96200640 1 Processor -- start 2024-04-25T09:14:43.306 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.319+0000 7f0f96200640 1 -- start start 2024-04-25T09:14:43.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.319+0000 7f0f96200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0f90145250 0x7f0f900cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.319+0000 7f0f96200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f901600a0 0x7f0f900cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.319+0000 7f0f96200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0f900ce970 0x7f0f900cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.319+0000 7f0f96200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9015f650 con 0x7f0f900ce970 2024-04-25T09:14:43.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.319+0000 7f0f96200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f900cfd10 con 0x7f0f90145250 2024-04-25T09:14:43.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.319+0000 7f0f96200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900cfff0 con 0x7f0f901600a0 2024-04-25T09:14:43.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.319+0000 7f0f8fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0f900ce970 0x7f0f900cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.319+0000 7f0f8fe00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0f900ce970 0x7f0f900cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41344/0 (socket says 172.21.15.175:41344) 2024-04-25T09:14:43.308 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.319+0000 7f0f8fe00640 1 -- 172.21.15.175:0/3021519918 learned_addr learned my addr 172.21.15.175:0/3021519918 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:43.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.319+0000 7f0f86a00640 1 --2- 172.21.15.175:0/3021519918 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f901600a0 0x7f0f900cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.319+0000 7f0f8f400640 1 --2- 172.21.15.175:0/3021519918 >> v2:172.21.15.177:3300/0 conn(0x7f0f90145250 0x7f0f900cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.319+0000 7f0f8fe00640 1 -- 172.21.15.175:0/3021519918 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f901600a0 msgr2=0x7f0f900cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:43.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.319+0000 7f0f8fe00640 1 --2- 172.21.15.175:0/3021519918 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f901600a0 0x7f0f900cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.319+0000 7f0f8fe00640 1 -- 172.21.15.175:0/3021519918 >> v2:172.21.15.177:3300/0 conn(0x7f0f90145250 msgr2=0x7f0f900cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:43.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.319+0000 7f0f8fe00640 1 --2- 172.21.15.175:0/3021519918 >> v2:172.21.15.177:3300/0 conn(0x7f0f90145250 0x7f0f900cf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.309 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.319+0000 7f0f8fe00640 1 -- 172.21.15.175:0/3021519918 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9015f8a0 con 0x7f0f900ce970 2024-04-25T09:14:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.323+0000 7f0f8fe00640 1 --2- 172.21.15.175:0/3021519918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f900ce970 0x7f0f900cee00 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f0f900b4ad0 tx=0x7f0f8801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7439b2191ed205b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.323+0000 7f0f8ea00640 1 -- 172.21.15.175:0/3021519918 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f880aa430 con 0x7f0f900ce970 2024-04-25T09:14:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.323+0000 7f0f8ea00640 1 -- 172.21.15.175:0/3021519918 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f880af070 con 0x7f0f900ce970 2024-04-25T09:14:43.311 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.323+0000 7f0f8ea00640 1 -- 172.21.15.175:0/3021519918 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f880aa7f0 con 0x7f0f900ce970 2024-04-25T09:14:43.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.323+0000 7f0f96200640 1 -- 172.21.15.175:0/3021519918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f900ce970 msgr2=0x7f0f900cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.323+0000 7f0f96200640 1 --2- 172.21.15.175:0/3021519918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f900ce970 0x7f0f900cee00 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f0f900b4ad0 tx=0x7f0f8801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.323+0000 7f0f96200640 1 -- 172.21.15.175:0/3021519918 shutdown_connections 2024-04-25T09:14:43.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.323+0000 7f0f96200640 1 --2- 172.21.15.175:0/3021519918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f900ce970 0x7f0f900cee00 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.323+0000 7f0f96200640 1 --2- 172.21.15.175:0/3021519918 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f901600a0 0x7f0f900cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.323+0000 7f0f96200640 1 --2- 172.21.15.175:0/3021519918 >> v2:172.21.15.177:3300/0 conn(0x7f0f90145250 0x7f0f900cf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.323+0000 7f0f96200640 1 -- 172.21.15.175:0/3021519918 >> 172.21.15.175:0/3021519918 conn(0x7f0f9006ac50 msgr2=0x7f0f9006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:43.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.323+0000 7f0f96200640 1 -- 172.21.15.175:0/3021519918 shutdown_connections 2024-04-25T09:14:43.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.323+0000 7f0f96200640 1 -- 172.21.15.175:0/3021519918 wait complete. 2024-04-25T09:14:43.313 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f96200640 1 Processor -- start 2024-04-25T09:14:43.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f96200640 1 -- start start 2024-04-25T09:14:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f96200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f900ce970 0x7f0f901f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f96200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f90145250 0x7f0f9006ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f96200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f901600a0 0x7f0f9015ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f96200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f90160480 con 0x7f0f901600a0 2024-04-25T09:14:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f96200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f90145630 con 0x7f0f900ce970 2024-04-25T09:14:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f96200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f90160600 con 0x7f0f90145250 2024-04-25T09:14:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f8fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f901600a0 0x7f0f9015ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f8fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f901600a0 0x7f0f9015ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41354/0 (socket says 172.21.15.175:41354) 2024-04-25T09:14:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f8fe00640 1 -- 172.21.15.175:0/3442517566 learned_addr learned my addr 172.21.15.175:0/3442517566 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f86a00640 1 --2- 172.21.15.175:0/3442517566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f90145250 0x7f0f9006ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f8f400640 1 --2- 172.21.15.175:0/3442517566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f900ce970 0x7f0f901f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f8fe00640 1 -- 172.21.15.175:0/3442517566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f90145250 msgr2=0x7f0f9006ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.316 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f8fe00640 1 --2- 172.21.15.175:0/3442517566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f90145250 0x7f0f9006ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f8fe00640 1 -- 172.21.15.175:0/3442517566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f900ce970 msgr2=0x7f0f901f6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f8fe00640 1 --2- 172.21.15.175:0/3442517566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f900ce970 0x7f0f901f6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f8fe00640 1 -- 172.21.15.175:0/3442517566 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f900a8700 con 0x7f0f901600a0 2024-04-25T09:14:43.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f8fe00640 1 --2- 172.21.15.175:0/3442517566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f901600a0 0x7f0f9015ab30 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f0f880ac040 tx=0x7f0f8801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:43.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f87e00640 1 -- 172.21.15.175:0/3442517566 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f880bd3f0 con 0x7f0f901600a0 2024-04-25T09:14:43.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f87e00640 1 -- 172.21.15.175:0/3442517566 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f880bd590 con 0x7f0f901600a0 2024-04-25T09:14:43.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f87e00640 1 -- 172.21.15.175:0/3442517566 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f880bd940 con 0x7f0f901600a0 2024-04-25T09:14:43.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f96200640 1 -- 172.21.15.175:0/3442517566 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f900a89e0 con 0x7f0f901600a0 2024-04-25T09:14:43.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.327+0000 7f0f96200640 1 -- 172.21.15.175:0/3442517566 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f900b35f0 con 0x7f0f901600a0 2024-04-25T09:14:43.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.331+0000 7f0f96200640 1 -- 172.21.15.175:0/3442517566 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f90075160 con 0x7f0f901600a0 2024-04-25T09:14:43.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.331+0000 7f0f87e00640 1 -- 172.21.15.175:0/3442517566 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0f880b33f0 con 0x7f0f901600a0 2024-04-25T09:14:43.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.331+0000 7f0f87e00640 1 --2- 172.21.15.175:0/3442517566 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f6c066fb0 0x7f0f6c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.331+0000 7f0f87e00640 1 -- 172.21.15.175:0/3442517566 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f0f8811f4e0 con 0x7f0f901600a0 2024-04-25T09:14:43.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.331+0000 7f0f8f400640 1 --2- 172.21.15.175:0/3442517566 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f6c066fb0 0x7f0f6c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.331+0000 7f0f8f400640 1 --2- 172.21.15.175:0/3442517566 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f6c066fb0 0x7f0f6c069470 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0f80011360 tx=0x7f0f8000d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:43.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.335+0000 7f0f87e00640 1 -- 172.21.15.175:0/3442517566 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0f880c3060 con 0x7f0f901600a0 2024-04-25T09:14:43.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.523+0000 7f0f96200640 1 -- 172.21.15.175:0/3442517566 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0f90165740 con 0x7f0f901600a0 2024-04-25T09:14:43.512 INFO:tasks.ceph.mon.a.smithi175.stderr:2024-04-25T09:14:43.523+0000 7feb0ee00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:14:43.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.527+0000 7f0f87e00640 1 -- 172.21.15.175:0/3442517566 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v107) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0f88016110 con 0x7f0f901600a0 2024-04-25T09:14:43.515 INFO:teuthology.orchestra.run.smithi175.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:14:43.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.531+0000 7f0f96200640 1 -- 172.21.15.175:0/3442517566 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f6c066fb0 msgr2=0x7f0f6c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.518 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.531+0000 7f0f96200640 1 --2- 172.21.15.175:0/3442517566 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f6c066fb0 0x7f0f6c069470 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0f80011360 tx=0x7f0f8000d040 comp rx=0 tx=0).stop 2024-04-25T09:14:43.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.531+0000 7f0f96200640 1 -- 172.21.15.175:0/3442517566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f901600a0 msgr2=0x7f0f9015ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.531+0000 7f0f96200640 1 --2- 172.21.15.175:0/3442517566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f901600a0 0x7f0f9015ab30 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f0f880ac040 tx=0x7f0f8801ad30 comp rx=0 tx=0).stop 2024-04-25T09:14:43.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.531+0000 7f0f96200640 1 -- 172.21.15.175:0/3442517566 shutdown_connections 2024-04-25T09:14:43.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.531+0000 7f0f96200640 1 --2- 172.21.15.175:0/3442517566 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f6c066fb0 0x7f0f6c069470 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.531+0000 7f0f96200640 1 --2- 172.21.15.175:0/3442517566 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f901600a0 0x7f0f9015ab30 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.531+0000 7f0f96200640 1 --2- 172.21.15.175:0/3442517566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f90145250 0x7f0f9006ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.531+0000 7f0f96200640 1 --2- 172.21.15.175:0/3442517566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f900ce970 0x7f0f901f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.531+0000 7f0f96200640 1 -- 172.21.15.175:0/3442517566 >> 172.21.15.175:0/3442517566 conn(0x7f0f9006ac50 msgr2=0x7f0f90165c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:43.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.531+0000 7f0f96200640 1 -- 172.21.15.175:0/3442517566 shutdown_connections 2024-04-25T09:14:43.519 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.531+0000 7f0f96200640 1 -- 172.21.15.175:0/3442517566 wait complete. 2024-04-25T09:14:43.523 INFO:tasks.ceph.mds.c.smithi175.stderr: -1227> 2024-04-25T09:14:35.007+0000 7f773e800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:14:43.538 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:14:43.565 INFO:tasks.ceph.mds.c.smithi175.stdout:starting mds.c at 2024-04-25T09:14:43.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.691+0000 7f0f7b000640 1 Processor -- start 2024-04-25T09:14:43.678 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.691+0000 7f0f7b000640 1 -- start start 2024-04-25T09:14:43.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.691+0000 7f0f7b000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f74145250 0x7f0f740cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.691+0000 7f0f7b000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f740cfd10 con 0x7f0f741600a0 2024-04-25T09:14:43.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.691+0000 7f0f7b000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f740cfff0 con 0x7f0f740ce970 2024-04-25T09:14:43.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.691+0000 7f0f7b000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7415f650 con 0x7f0f74145250 2024-04-25T09:14:43.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.691+0000 7f0f6b400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f0f741600a0 0x7f0f740cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:36178/0 (socket says 172.21.15.175:36178) 2024-04-25T09:14:43.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.691+0000 7f0f6b400640 1 -- 172.21.15.175:0/662381759 learned_addr learned my addr 172.21.15.175:0/662381759 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:43.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.691+0000 7f0f73e00640 1 --2- 172.21.15.175:0/662381759 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f74145250 0x7f0f740cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.691+0000 7f0f73400640 1 -- 172.21.15.175:0/662381759 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093778061 0 0) 0x7f0f740cfd10 con 0x7f0f741600a0 2024-04-25T09:14:43.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.691+0000 7f0f73400640 1 -- 172.21.15.175:0/662381759 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f58003530 con 0x7f0f741600a0 2024-04-25T09:14:43.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.691+0000 7f0f73400640 1 -- 172.21.15.175:0/662381759 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2408836497 0 0) 0x7f0f740cfff0 con 0x7f0f740ce970 2024-04-25T09:14:43.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.691+0000 7f0f73400640 1 -- 172.21.15.175:0/662381759 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f740cfd10 con 0x7f0f740ce970 2024-04-25T09:14:43.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.691+0000 7f0f73400640 1 -- 172.21.15.175:0/662381759 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3202094986 0 0) 0x7f0f58003530 con 0x7f0f741600a0 2024-04-25T09:14:43.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.691+0000 7f0f73e00640 1 -- 172.21.15.175:0/662381759 >> v1:172.21.15.177:6789/0 conn(0x7f0f740ce970 legacy=0x7f0f740cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.691+0000 7f0f73e00640 1 -- 172.21.15.175:0/662381759 >> v1:172.21.15.175:6789/0 conn(0x7f0f741600a0 legacy=0x7f0f740cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.681 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.691+0000 7f0f73e00640 1 -- 172.21.15.175:0/662381759 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7415f8a0 con 0x7f0f74145250 2024-04-25T09:14:43.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.695+0000 7f0f73e00640 1 --2- 172.21.15.175:0/662381759 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f74145250 0x7f0f740cf6b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0f640097f0 tx=0x7f0f6401cd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e535bddec1b88ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:43.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.695+0000 7f0f73400640 1 -- 172.21.15.175:0/662381759 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f640b0070 con 0x7f0f74145250 2024-04-25T09:14:43.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.695+0000 7f0f73400640 1 -- 172.21.15.175:0/662381759 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f640ab400 con 0x7f0f74145250 2024-04-25T09:14:43.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.695+0000 7f0f73400640 1 -- 172.21.15.175:0/662381759 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c001680 con 0x7f0f74145250 2024-04-25T09:14:43.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.695+0000 7f0f7b000640 1 -- 172.21.15.175:0/662381759 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f74145250 msgr2=0x7f0f740cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.695+0000 7f0f7b000640 1 --2- 172.21.15.175:0/662381759 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f74145250 0x7f0f740cf6b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0f640097f0 tx=0x7f0f6401cd10 comp rx=0 tx=0).stop 2024-04-25T09:14:43.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.695+0000 7f0f7b000640 1 -- 172.21.15.175:0/662381759 shutdown_connections 2024-04-25T09:14:43.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.695+0000 7f0f7b000640 1 --2- 172.21.15.175:0/662381759 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f74145250 0x7f0f740cf6b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.695+0000 7f0f7b000640 1 -- 172.21.15.175:0/662381759 >> 172.21.15.175:0/662381759 conn(0x7f0f7406ac50 msgr2=0x7f0f7406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:43.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.695+0000 7f0f7b000640 1 -- 172.21.15.175:0/662381759 shutdown_connections 2024-04-25T09:14:43.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.695+0000 7f0f7b000640 1 -- 172.21.15.175:0/662381759 wait complete. 2024-04-25T09:14:43.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f7b000640 1 Processor -- start 2024-04-25T09:14:43.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f7b000640 1 -- start start 2024-04-25T09:14:43.687 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f7b000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f740ce970 0x7f0f7415e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f7b000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f74145250 0x7f0f74140a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f7b000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f741600a0 0x7f0f7415a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f7b000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7415c9f0 con 0x7f0f741600a0 2024-04-25T09:14:43.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f7b000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7415c870 con 0x7f0f740ce970 2024-04-25T09:14:43.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f7b000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7415cb70 con 0x7f0f74145250 2024-04-25T09:14:43.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f79000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f741600a0 0x7f0f7415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f79000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f741600a0 0x7f0f7415a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41382/0 (socket says 172.21.15.175:41382) 2024-04-25T09:14:43.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f79000640 1 -- 172.21.15.175:0/3489360183 learned_addr learned my addr 172.21.15.175:0/3489360183 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:43.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f73e00640 1 --2- 172.21.15.175:0/3489360183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f740ce970 0x7f0f7415e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f6b400640 1 --2- 172.21.15.175:0/3489360183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f74145250 0x7f0f74140a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f79000640 1 -- 172.21.15.175:0/3489360183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f74145250 msgr2=0x7f0f74140a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f79000640 1 --2- 172.21.15.175:0/3489360183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f74145250 0x7f0f74140a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.688 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f79000640 1 -- 172.21.15.175:0/3489360183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f740ce970 msgr2=0x7f0f7415e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:43.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f79000640 1 --2- 172.21.15.175:0/3489360183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f740ce970 0x7f0f7415e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:43.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f79000640 1 -- 172.21.15.175:0/3489360183 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f740add10 con 0x7f0f741600a0 2024-04-25T09:14:43.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f79000640 1 --2- 172.21.15.175:0/3489360183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f741600a0 0x7f0f7415a670 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00c730 tx=0x7f0f6c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:43.689 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f70c00640 1 -- 172.21.15.175:0/3489360183 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c003b80 con 0x7f0f741600a0 2024-04-25T09:14:43.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f70c00640 1 -- 172.21.15.175:0/3489360183 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6c003d20 con 0x7f0f741600a0 2024-04-25T09:14:43.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f70c00640 1 -- 172.21.15.175:0/3489360183 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c00aa90 con 0x7f0f741600a0 2024-04-25T09:14:43.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f7b000640 1 -- 172.21.15.175:0/3489360183 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f740adff0 con 0x7f0f741600a0 2024-04-25T09:14:43.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.699+0000 7f0f7b000640 1 -- 172.21.15.175:0/3489360183 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f740ae5b0 con 0x7f0f741600a0 2024-04-25T09:14:43.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.703+0000 7f0f7b000640 1 -- 172.21.15.175:0/3489360183 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f74075160 con 0x7f0f741600a0 2024-04-25T09:14:43.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.703+0000 7f0f70c00640 1 -- 172.21.15.175:0/3489360183 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0f6c00ac30 con 0x7f0f741600a0 2024-04-25T09:14:43.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.703+0000 7f0f70c00640 1 --2- 172.21.15.175:0/3489360183 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f50066f60 0x7f0f50069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:43.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.703+0000 7f0f70c00640 1 -- 172.21.15.175:0/3489360183 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f0f6c084f80 con 0x7f0f741600a0 2024-04-25T09:14:43.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.703+0000 7f0f73e00640 1 --2- 172.21.15.175:0/3489360183 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f50066f60 0x7f0f50069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:43.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.703+0000 7f0f73e00640 1 --2- 172.21.15.175:0/3489360183 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f50066f60 0x7f0f50069420 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0f640ad000 tx=0x7f0f64004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:43.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.707+0000 7f0f70c00640 1 -- 172.21.15.175:0/3489360183 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0f6c0557a0 con 0x7f0f741600a0 2024-04-25T09:14:43.881 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:43.891+0000 7f0f7b000640 1 -- 172.21.15.175:0/3489360183 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0f74067cb0 con 0x7f0f741600a0 2024-04-25T09:14:44.525 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.535+0000 7f0f70c00640 1 -- 172.21.15.175:0/3489360183 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v108) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0f6c059840 con 0x7f0f741600a0 2024-04-25T09:14:44.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.539+0000 7f0f7b000640 1 -- 172.21.15.175:0/3489360183 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f50066f60 msgr2=0x7f0f50069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:44.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.539+0000 7f0f7b000640 1 --2- 172.21.15.175:0/3489360183 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f50066f60 0x7f0f50069420 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0f640ad000 tx=0x7f0f64004740 comp rx=0 tx=0).stop 2024-04-25T09:14:44.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.539+0000 7f0f7b000640 1 -- 172.21.15.175:0/3489360183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f741600a0 msgr2=0x7f0f7415a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:44.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.539+0000 7f0f7b000640 1 --2- 172.21.15.175:0/3489360183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f741600a0 0x7f0f7415a670 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00c730 tx=0x7f0f6c00cbf0 comp rx=0 tx=0).stop 2024-04-25T09:14:44.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.539+0000 7f0f7b000640 1 -- 172.21.15.175:0/3489360183 shutdown_connections 2024-04-25T09:14:44.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.539+0000 7f0f7b000640 1 --2- 172.21.15.175:0/3489360183 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f50066f60 0x7f0f50069420 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:44.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.539+0000 7f0f7b000640 1 --2- 172.21.15.175:0/3489360183 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f741600a0 0x7f0f7415a670 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:44.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.539+0000 7f0f7b000640 1 --2- 172.21.15.175:0/3489360183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f74145250 0x7f0f74140a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:44.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.539+0000 7f0f7b000640 1 --2- 172.21.15.175:0/3489360183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f740ce970 0x7f0f7415e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:44.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.539+0000 7f0f7b000640 1 -- 172.21.15.175:0/3489360183 >> 172.21.15.175:0/3489360183 conn(0x7f0f7406ac50 msgr2=0x7f0f7406d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:44.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.539+0000 7f0f7b000640 1 -- 172.21.15.175:0/3489360183 shutdown_connections 2024-04-25T09:14:44.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.539+0000 7f0f7b000640 1 -- 172.21.15.175:0/3489360183 wait complete. 2024-04-25T09:14:44.550 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:14:44.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e99400640 1 Processor -- start 2024-04-25T09:14:44.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e99400640 1 -- start start 2024-04-25T09:14:44.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e99400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e940712b0 0x7f7e94071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:44.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e99400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e94071e20 con 0x7f7e9406d860 2024-04-25T09:14:44.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e99400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e94072100 con 0x7f7e940cfb60 2024-04-25T09:14:44.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e99400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940cbed0 con 0x7f7e940712b0 2024-04-25T09:14:44.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e93200640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7e9406d860 0x7f7e940cc920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:36194/0 (socket says 172.21.15.175:36194) 2024-04-25T09:14:44.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e93200640 1 -- 172.21.15.175:0/2676226240 learned_addr learned my addr 172.21.15.175:0/2676226240 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:44.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91e00640 1 --2- 172.21.15.175:0/2676226240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e940712b0 0x7f7e94071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:44.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91400640 1 -- 172.21.15.175:0/2676226240 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960891331 0 0) 0x7f7e94071e20 con 0x7f7e9406d860 2024-04-25T09:14:44.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91400640 1 -- 172.21.15.175:0/2676226240 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e78003530 con 0x7f7e9406d860 2024-04-25T09:14:44.737 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91400640 1 -- 172.21.15.175:0/2676226240 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1050221226 0 0) 0x7f7e78003530 con 0x7f7e9406d860 2024-04-25T09:14:44.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91400640 1 -- 172.21.15.175:0/2676226240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e940712b0 msgr2=0x7f7e94071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:44.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91400640 1 --2- 172.21.15.175:0/2676226240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e940712b0 0x7f7e94071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:44.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91400640 1 -- 172.21.15.175:0/2676226240 >> v1:172.21.15.177:6789/0 conn(0x7f7e940cfb60 legacy=0x7f7e940ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:44.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91400640 1 -- 172.21.15.175:0/2676226240 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e940cc120 con 0x7f7e9406d860 2024-04-25T09:14:44.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91400640 1 -- 172.21.15.175:0/2676226240 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7f7e8c001680 con 0x7f7e9406d860 2024-04-25T09:14:44.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91400640 1 -- 172.21.15.175:0/2676226240 >> v1:172.21.15.175:6789/0 conn(0x7f7e9406d860 legacy=0x7f7e940cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:44.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91400640 1 --2- 172.21.15.175:0/2676226240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e780039f0 0x7f7e78003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:44.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91400640 1 --2- 172.21.15.175:0/2676226240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e78004810 0x7f7e78004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:44.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91400640 1 --2- 172.21.15.175:0/2676226240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e940712b0 0x7f7e78005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:44.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91400640 1 -- 172.21.15.175:0/2676226240 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940cbed0 con 0x7f7e78004810 2024-04-25T09:14:44.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91400640 1 -- 172.21.15.175:0/2676226240 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7800bbc0 con 0x7f7e780039f0 2024-04-25T09:14:44.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91400640 1 -- 172.21.15.175:0/2676226240 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7800bdc0 con 0x7f7e940712b0 2024-04-25T09:14:44.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91e00640 1 --2- 172.21.15.175:0/2676226240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e78004810 0x7f7e78004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:44.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e92800640 1 --2- 172.21.15.175:0/2676226240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e780039f0 0x7f7e78003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:44.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e93200640 1 --2- 172.21.15.175:0/2676226240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e940712b0 0x7f7e78005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:44.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91e00640 1 -- 172.21.15.175:0/2676226240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e940712b0 msgr2=0x7f7e78005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:44.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91e00640 1 --2- 172.21.15.175:0/2676226240 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e940712b0 0x7f7e78005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:44.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91e00640 1 -- 172.21.15.175:0/2676226240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e780039f0 msgr2=0x7f7e78003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:44.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91e00640 1 --2- 172.21.15.175:0/2676226240 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e780039f0 0x7f7e78003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:44.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.747+0000 7f7e91e00640 1 -- 172.21.15.175:0/2676226240 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e78003530 con 0x7f7e78004810 2024-04-25T09:14:44.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.751+0000 7f7e91e00640 1 --2- 172.21.15.175:0/2676226240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e78004810 0x7f7e78004c90 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f7e80009ae0 tx=0x7f7e8001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8583b2a37c7da242 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:44.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.751+0000 7f7e91400640 1 -- 172.21.15.175:0/2676226240 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e800b2070 con 0x7f7e78004810 2024-04-25T09:14:44.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.751+0000 7f7e91400640 1 -- 172.21.15.175:0/2676226240 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e800a5630 con 0x7f7e78004810 2024-04-25T09:14:44.740 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.751+0000 7f7e91400640 1 -- 172.21.15.175:0/2676226240 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e800096b0 con 0x7f7e78004810 2024-04-25T09:14:44.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.751+0000 7f7e99400640 1 -- 172.21.15.175:0/2676226240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e78004810 msgr2=0x7f7e78004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:44.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.751+0000 7f7e99400640 1 --2- 172.21.15.175:0/2676226240 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e78004810 0x7f7e78004c90 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f7e80009ae0 tx=0x7f7e8001ca40 comp rx=0 tx=0).stop 2024-04-25T09:14:44.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.751+0000 7f7e93200640 1 -- 172.21.15.175:0/2676226240 reap_dead start 2024-04-25T09:14:44.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.751+0000 7f7e99400640 1 -- 172.21.15.175:0/2676226240 shutdown_connections 2024-04-25T09:14:44.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.751+0000 7f7e99400640 1 -- 172.21.15.175:0/2676226240 >> 172.21.15.175:0/2676226240 conn(0x7f7e9406ac50 msgr2=0x7f7e9406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:44.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.751+0000 7f7e99400640 1 -- 172.21.15.175:0/2676226240 shutdown_connections 2024-04-25T09:14:44.741 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.751+0000 7f7e99400640 1 -- 172.21.15.175:0/2676226240 wait complete. 2024-04-25T09:14:44.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e99400640 1 Processor -- start 2024-04-25T09:14:44.742 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e99400640 1 -- start start 2024-04-25T09:14:44.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e99400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e78004810 0x7f7e94141ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:44.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e99400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e940b2800 0x7f7e940af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:44.744 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e99400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e94141220 0x7f7e940b1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:44.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e99400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940d00c0 con 0x7f7e78004810 2024-04-25T09:14:44.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e99400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940cff40 con 0x7f7e94141220 2024-04-25T09:14:44.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e99400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940ceee0 con 0x7f7e940b2800 2024-04-25T09:14:44.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e92800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e78004810 0x7f7e94141ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:44.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e92800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e78004810 0x7f7e94141ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41402/0 (socket says 172.21.15.175:41402) 2024-04-25T09:14:44.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e92800640 1 -- 172.21.15.175:0/113312116 learned_addr learned my addr 172.21.15.175:0/113312116 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:44.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e93200640 1 --2- 172.21.15.175:0/113312116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e94141220 0x7f7e940b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:44.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e91e00640 1 --2- 172.21.15.175:0/113312116 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e940b2800 0x7f7e940af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:44.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e92800640 1 -- 172.21.15.175:0/113312116 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e940b2800 msgr2=0x7f7e940af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:44.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e92800640 1 --2- 172.21.15.175:0/113312116 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e940b2800 0x7f7e940af9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:44.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e92800640 1 -- 172.21.15.175:0/113312116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e94141220 msgr2=0x7f7e940b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:44.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e92800640 1 --2- 172.21.15.175:0/113312116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e94141220 0x7f7e940b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:44.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e92800640 1 -- 172.21.15.175:0/113312116 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e940aed90 con 0x7f7e78004810 2024-04-25T09:14:44.745 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e92800640 1 --2- 172.21.15.175:0/113312116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e78004810 0x7f7e94141ef0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400fbc0 tx=0x7f7e8400d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:44.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e8aa00640 1 -- 172.21.15.175:0/113312116 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8400dbd0 con 0x7f7e78004810 2024-04-25T09:14:44.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e8aa00640 1 -- 172.21.15.175:0/113312116 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e84018070 con 0x7f7e78004810 2024-04-25T09:14:44.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e8aa00640 1 -- 172.21.15.175:0/113312116 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84003980 con 0x7f7e78004810 2024-04-25T09:14:44.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e99400640 1 -- 172.21.15.175:0/113312116 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e94141c10 con 0x7f7e78004810 2024-04-25T09:14:44.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.755+0000 7f7e99400640 1 -- 172.21.15.175:0/113312116 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e940b1fc0 con 0x7f7e78004810 2024-04-25T09:14:44.746 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.759+0000 7f7e99400640 1 -- 172.21.15.175:0/113312116 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e94075160 con 0x7f7e78004810 2024-04-25T09:14:44.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.759+0000 7f7e8aa00640 1 -- 172.21.15.175:0/113312116 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7e84003b20 con 0x7f7e78004810 2024-04-25T09:14:44.747 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.759+0000 7f7e8aa00640 1 --2- 172.21.15.175:0/113312116 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7e74066f60 0x7f7e74069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:44.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.759+0000 7f7e8aa00640 1 -- 172.21.15.175:0/113312116 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5967+0+0 (secure 0 0 0) 0x7f7e840851e0 con 0x7f7e78004810 2024-04-25T09:14:44.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.759+0000 7f7e91e00640 1 --2- 172.21.15.175:0/113312116 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7e74066f60 0x7f7e74069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:44.748 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.759+0000 7f7e91e00640 1 --2- 172.21.15.175:0/113312116 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7e74066f60 0x7f7e74069420 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7e800af000 tx=0x7f7e800046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:44.752 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.763+0000 7f7e8aa00640 1 -- 172.21.15.175:0/113312116 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7e84055a90 con 0x7f7e78004810 2024-04-25T09:14:44.909 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:44.919+0000 7f7e99400640 1 -- 172.21.15.175:0/113312116 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7e940af620 con 0x7f7e78004810 2024-04-25T09:14:45.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.539+0000 7f7e8aa00640 1 -- 172.21.15.175:0/113312116 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v117) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7e84059b30 con 0x7f7e78004810 2024-04-25T09:14:45.527 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:14:45.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.543+0000 7f7e99400640 1 -- 172.21.15.175:0/113312116 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7e74066f60 msgr2=0x7f7e74069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.543+0000 7f7e99400640 1 --2- 172.21.15.175:0/113312116 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7e74066f60 0x7f7e74069420 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f7e800af000 tx=0x7f7e800046d0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.543+0000 7f7e99400640 1 -- 172.21.15.175:0/113312116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e78004810 msgr2=0x7f7e94141ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.543+0000 7f7e99400640 1 --2- 172.21.15.175:0/113312116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e78004810 0x7f7e94141ef0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400fbc0 tx=0x7f7e8400d520 comp rx=0 tx=0).stop 2024-04-25T09:14:45.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.543+0000 7f7e99400640 1 -- 172.21.15.175:0/113312116 shutdown_connections 2024-04-25T09:14:45.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.543+0000 7f7e99400640 1 --2- 172.21.15.175:0/113312116 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f7e74066f60 0x7f7e74069420 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.543+0000 7f7e99400640 1 --2- 172.21.15.175:0/113312116 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7e94141220 0x7f7e940b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.530 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.543+0000 7f7e99400640 1 --2- 172.21.15.175:0/113312116 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7e940b2800 0x7f7e940af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.543+0000 7f7e99400640 1 --2- 172.21.15.175:0/113312116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e78004810 0x7f7e94141ef0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.543+0000 7f7e99400640 1 -- 172.21.15.175:0/113312116 >> 172.21.15.175:0/113312116 conn(0x7f7e9406ac50 msgr2=0x7f7e940741d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:45.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.543+0000 7f7e99400640 1 -- 172.21.15.175:0/113312116 shutdown_connections 2024-04-25T09:14:45.531 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.543+0000 7f7e99400640 1 -- 172.21.15.175:0/113312116 wait complete. 2024-04-25T09:14:45.552 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:14:45.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.703+0000 7efeef200640 1 Processor -- start 2024-04-25T09:14:45.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.703+0000 7efeef200640 1 -- start start 2024-04-25T09:14:45.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.703+0000 7efeef200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efef00cfe30 0x7efef006ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.703+0000 7efeef200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efef006b190 0x7efef00b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.703+0000 7efeef200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efef00b1bc0 0x7efef015d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.693 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.703+0000 7efeef200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef006b5f0 con 0x7efef006b190 2024-04-25T09:14:45.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.703+0000 7efeef200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efef00b2050 con 0x7efef00b1bc0 2024-04-25T09:14:45.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.703+0000 7efeef200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef00b0de0 con 0x7efef00cfe30 2024-04-25T09:14:45.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.707+0000 7efeed400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efef006b190 0x7efef00b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.707+0000 7efeed400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efef006b190 0x7efef00b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41406/0 (socket says 172.21.15.175:41406) 2024-04-25T09:14:45.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.707+0000 7efeed400640 1 -- 172.21.15.175:0/2032273366 learned_addr learned my addr 172.21.15.175:0/2032273366 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:45.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.707+0000 7efeede00640 1 --2- 172.21.15.175:0/2032273366 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efef00cfe30 0x7efef006ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.707+0000 7efeee800640 1 --2- 172.21.15.175:0/2032273366 >> v2:172.21.15.177:3300/0 conn(0x7efef00b1bc0 0x7efef015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.707+0000 7efeed400640 1 -- 172.21.15.175:0/2032273366 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efef00cfe30 msgr2=0x7efef006ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:45.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.707+0000 7efeed400640 1 --2- 172.21.15.175:0/2032273366 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efef00cfe30 0x7efef006ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.707+0000 7efeed400640 1 -- 172.21.15.175:0/2032273366 >> v2:172.21.15.177:3300/0 conn(0x7efef00b1bc0 msgr2=0x7efef015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:45.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.707+0000 7efeed400640 1 --2- 172.21.15.175:0/2032273366 >> v2:172.21.15.177:3300/0 conn(0x7efef00b1bc0 0x7efef015d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.707+0000 7efeed400640 1 -- 172.21.15.175:0/2032273366 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef00b01d0 con 0x7efef006b190 2024-04-25T09:14:45.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.707+0000 7efeede00640 1 --2- 172.21.15.175:0/2032273366 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efef00cfe30 0x7efef006ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:45.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.707+0000 7efeed400640 1 --2- 172.21.15.175:0/2032273366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efef006b190 0x7efef00b1680 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7efef006e200 tx=0x7efed801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba508d7393adca30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:45.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.707+0000 7efeeca00640 1 -- 172.21.15.175:0/2032273366 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed80aa410 con 0x7efef006b190 2024-04-25T09:14:45.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.707+0000 7efeeca00640 1 -- 172.21.15.175:0/2032273366 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed80af070 con 0x7efef006b190 2024-04-25T09:14:45.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.707+0000 7efeeca00640 1 -- 172.21.15.175:0/2032273366 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed80aa7d0 con 0x7efef006b190 2024-04-25T09:14:45.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeef200640 1 -- 172.21.15.175:0/2032273366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efef006b190 msgr2=0x7efef00b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeef200640 1 --2- 172.21.15.175:0/2032273366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efef006b190 0x7efef00b1680 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7efef006e200 tx=0x7efed801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeef200640 1 -- 172.21.15.175:0/2032273366 shutdown_connections 2024-04-25T09:14:45.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeef200640 1 --2- 172.21.15.175:0/2032273366 >> v2:172.21.15.177:3300/0 conn(0x7efef00b1bc0 0x7efef015d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeef200640 1 --2- 172.21.15.175:0/2032273366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efef006b190 0x7efef00b1680 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeef200640 1 --2- 172.21.15.175:0/2032273366 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efef00cfe30 0x7efef006ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeef200640 1 -- 172.21.15.175:0/2032273366 >> 172.21.15.175:0/2032273366 conn(0x7efef0099a50 msgr2=0x7efef00b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:45.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeef200640 1 -- 172.21.15.175:0/2032273366 shutdown_connections 2024-04-25T09:14:45.698 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeef200640 1 -- 172.21.15.175:0/2032273366 wait complete. 2024-04-25T09:14:45.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeef200640 1 Processor -- start 2024-04-25T09:14:45.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeef200640 1 -- start start 2024-04-25T09:14:45.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeef200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efef006b190 0x7efef014c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeef200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efef00b1bc0 0x7efef00b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeef200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efef00cfe30 0x7efef00b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeef200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef00d0210 con 0x7efef006b190 2024-04-25T09:14:45.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeef200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efef00b1250 con 0x7efef00cfe30 2024-04-25T09:14:45.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeef200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efef00d0390 con 0x7efef00b1bc0 2024-04-25T09:14:45.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeede00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efef006b190 0x7efef014c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeede00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efef006b190 0x7efef014c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41416/0 (socket says 172.21.15.175:41416) 2024-04-25T09:14:45.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeede00640 1 -- 172.21.15.175:0/414799668 learned_addr learned my addr 172.21.15.175:0/414799668 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:45.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeee800640 1 --2- 172.21.15.175:0/414799668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efef00cfe30 0x7efef00b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeed400640 1 --2- 172.21.15.175:0/414799668 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efef00b1bc0 0x7efef00b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeede00640 1 -- 172.21.15.175:0/414799668 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efef00b1bc0 msgr2=0x7efef00b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeede00640 1 --2- 172.21.15.175:0/414799668 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efef00b1bc0 0x7efef00b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeede00640 1 -- 172.21.15.175:0/414799668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efef00cfe30 msgr2=0x7efef00b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:45.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeede00640 1 --2- 172.21.15.175:0/414799668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efef00cfe30 0x7efef00b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:45.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.711+0000 7efeede00640 1 -- 172.21.15.175:0/414799668 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef00c9d80 con 0x7efef006b190 2024-04-25T09:14:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.715+0000 7efeede00640 1 --2- 172.21.15.175:0/414799668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efef006b190 0x7efef014c610 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7efee0007f20 tx=0x7efee000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.715+0000 7efee6000640 1 -- 172.21.15.175:0/414799668 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee001a070 con 0x7efef006b190 2024-04-25T09:14:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.715+0000 7efee6000640 1 -- 172.21.15.175:0/414799668 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee0003ba0 con 0x7efef006b190 2024-04-25T09:14:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.715+0000 7efeef200640 1 -- 172.21.15.175:0/414799668 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efef00ca060 con 0x7efef006b190 2024-04-25T09:14:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.715+0000 7efee6000640 1 -- 172.21.15.175:0/414799668 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee0004030 con 0x7efef006b190 2024-04-25T09:14:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.715+0000 7efeef200640 1 -- 172.21.15.175:0/414799668 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efef00ca620 con 0x7efef006b190 2024-04-25T09:14:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.715+0000 7efeef200640 1 -- 172.21.15.175:0/414799668 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efef00ca860 con 0x7efef006b190 2024-04-25T09:14:45.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.715+0000 7efee6000640 1 -- 172.21.15.175:0/414799668 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efee001d070 con 0x7efef006b190 2024-04-25T09:14:45.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.715+0000 7efee6000640 1 --2- 172.21.15.175:0/414799668 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efecc066f90 0x7efecc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:45.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.715+0000 7efee6000640 1 -- 172.21.15.175:0/414799668 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5529+0+0 (secure 0 0 0) 0x7efee00850f0 con 0x7efef006b190 2024-04-25T09:14:45.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.715+0000 7efeed400640 1 --2- 172.21.15.175:0/414799668 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efecc066f90 0x7efecc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:45.705 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.719+0000 7efeed400640 1 --2- 172.21.15.175:0/414799668 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efecc066f90 0x7efecc069450 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7efed80ae000 tx=0x7efed80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:45.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.719+0000 7efee6000640 1 -- 172.21.15.175:0/414799668 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efef00ca860 con 0x7efef006b190 2024-04-25T09:14:45.863 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:45.875+0000 7efeef200640 1 -- 172.21.15.175:0/414799668 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efef0074a60 con 0x7efef006b190 2024-04-25T09:14:46.533 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.543+0000 7efee6000640 1 -- 172.21.15.175:0/414799668 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v118) v1 ==== 169+0+0 (secure 0 0 0) 0x7efee0010070 con 0x7efef006b190 2024-04-25T09:14:46.533 INFO:teuthology.orchestra.run.smithi175.stderr:pool 'cephfs_data' removed 2024-04-25T09:14:46.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.547+0000 7efeef200640 1 -- 172.21.15.175:0/414799668 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efecc066f90 msgr2=0x7efecc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.547+0000 7efeef200640 1 --2- 172.21.15.175:0/414799668 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efecc066f90 0x7efecc069450 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7efed80ae000 tx=0x7efed80a7000 comp rx=0 tx=0).stop 2024-04-25T09:14:46.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.547+0000 7efeef200640 1 -- 172.21.15.175:0/414799668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efef006b190 msgr2=0x7efef014c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.547+0000 7efeef200640 1 --2- 172.21.15.175:0/414799668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efef006b190 0x7efef014c610 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7efee0007f20 tx=0x7efee000d560 comp rx=0 tx=0).stop 2024-04-25T09:14:46.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.547+0000 7efeef200640 1 -- 172.21.15.175:0/414799668 shutdown_connections 2024-04-25T09:14:46.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.547+0000 7efeef200640 1 --2- 172.21.15.175:0/414799668 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efecc066f90 0x7efecc069450 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.547+0000 7efeef200640 1 --2- 172.21.15.175:0/414799668 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efef00cfe30 0x7efef00b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.547+0000 7efeef200640 1 --2- 172.21.15.175:0/414799668 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efef00b1bc0 0x7efef00b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.536 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.547+0000 7efeef200640 1 --2- 172.21.15.175:0/414799668 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efef006b190 0x7efef014c610 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.547+0000 7efeef200640 1 -- 172.21.15.175:0/414799668 >> 172.21.15.175:0/414799668 conn(0x7efef0099a50 msgr2=0x7efef00b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:46.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.547+0000 7efeef200640 1 -- 172.21.15.175:0/414799668 shutdown_connections 2024-04-25T09:14:46.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.547+0000 7efeef200640 1 -- 172.21.15.175:0/414799668 wait complete. 2024-04-25T09:14:46.562 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:14:46.701 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.711+0000 7fe113200640 1 Processor -- start 2024-04-25T09:14:46.702 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.715+0000 7fe113200640 1 -- start start 2024-04-25T09:14:46.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.715+0000 7fe113200640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe11415bd30 0x7fe11406e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.715+0000 7fe113200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1140713b0 con 0x7fe1140ce340 2024-04-25T09:14:46.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.715+0000 7fe113200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe114071690 con 0x7fe11415f5d0 2024-04-25T09:14:46.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.715+0000 7fe113200640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe114071970 con 0x7fe11415bd30 2024-04-25T09:14:46.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.715+0000 7fe111400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe11415bd30 0x7fe11406e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.715+0000 7fe111e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe1140ce340 0x7fe1140ce720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:36196/0 (socket says 172.21.15.175:36196) 2024-04-25T09:14:46.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.715+0000 7fe111400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe11415bd30 0x7fe11406e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41424/0 (socket says 172.21.15.175:41424) 2024-04-25T09:14:46.703 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.715+0000 7fe111e00640 1 -- 172.21.15.175:0/2521597359 learned_addr learned my addr 172.21.15.175:0/2521597359 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:46.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.715+0000 7fe111400640 1 -- 172.21.15.175:0/2521597359 >> v1:172.21.15.177:6789/0 conn(0x7fe11415f5d0 legacy=0x7fe11415fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.715+0000 7fe111400640 1 -- 172.21.15.175:0/2521597359 >> v1:172.21.15.175:6789/0 conn(0x7fe1140ce340 legacy=0x7fe1140ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.715+0000 7fe111400640 1 -- 172.21.15.175:0/2521597359 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe114071c50 con 0x7fe11415bd30 2024-04-25T09:14:46.704 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.715+0000 7fe110a00640 1 -- 172.21.15.175:0/2521597359 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837417002 0 0) 0x7fe1140713b0 con 0x7fe1140ce340 2024-04-25T09:14:46.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.719+0000 7fe111400640 1 --2- 172.21.15.175:0/2521597359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe11415bd30 0x7fe11406e110 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fe1000097c0 tx=0x7fe10001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f4d03947540696 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:46.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.719+0000 7fe110a00640 1 -- 172.21.15.175:0/2521597359 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1000b0070 con 0x7fe11415bd30 2024-04-25T09:14:46.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.719+0000 7fe110a00640 1 -- 172.21.15.175:0/2521597359 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1000ab600 con 0x7fe11415bd30 2024-04-25T09:14:46.706 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.719+0000 7fe110a00640 1 -- 172.21.15.175:0/2521597359 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1000ab9d0 con 0x7fe11415bd30 2024-04-25T09:14:46.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.719+0000 7fe113200640 1 -- 172.21.15.175:0/2521597359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe11415bd30 msgr2=0x7fe11406e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.719+0000 7fe113200640 1 --2- 172.21.15.175:0/2521597359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe11415bd30 0x7fe11406e110 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fe1000097c0 tx=0x7fe10001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.719+0000 7fe113200640 1 -- 172.21.15.175:0/2521597359 shutdown_connections 2024-04-25T09:14:46.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.719+0000 7fe113200640 1 --2- 172.21.15.175:0/2521597359 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe11415bd30 0x7fe11406e110 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.707 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.719+0000 7fe113200640 1 -- 172.21.15.175:0/2521597359 >> 172.21.15.175:0/2521597359 conn(0x7fe11406ac50 msgr2=0x7fe11406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:46.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.719+0000 7fe113200640 1 -- 172.21.15.175:0/2521597359 shutdown_connections 2024-04-25T09:14:46.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.719+0000 7fe113200640 1 -- 172.21.15.175:0/2521597359 wait complete. 2024-04-25T09:14:46.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.719+0000 7fe113200640 1 Processor -- start 2024-04-25T09:14:46.708 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.719+0000 7fe113200640 1 -- start start 2024-04-25T09:14:46.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe113200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1140ce340 0x7fe11415a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe113200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe11415bd30 0x7fe11415aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe113200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe11415f5d0 0x7fe114139160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe113200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1141602f0 con 0x7fe11415f5d0 2024-04-25T09:14:46.711 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe113200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe114160170 con 0x7fe11415bd30 2024-04-25T09:14:46.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe113200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe114145310 con 0x7fe1140ce340 2024-04-25T09:14:46.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe112800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe11415f5d0 0x7fe114139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe112800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe11415f5d0 0x7fe114139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41432/0 (socket says 172.21.15.175:41432) 2024-04-25T09:14:46.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe112800640 1 -- 172.21.15.175:0/2681998640 learned_addr learned my addr 172.21.15.175:0/2681998640 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:46.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe111400640 1 --2- 172.21.15.175:0/2681998640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe11415bd30 0x7fe11415aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe111e00640 1 --2- 172.21.15.175:0/2681998640 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1140ce340 0x7fe11415a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe112800640 1 -- 172.21.15.175:0/2681998640 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1140ce340 msgr2=0x7fe11415a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe112800640 1 --2- 172.21.15.175:0/2681998640 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1140ce340 0x7fe11415a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe112800640 1 -- 172.21.15.175:0/2681998640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe11415bd30 msgr2=0x7fe11415aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe112800640 1 --2- 172.21.15.175:0/2681998640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe11415bd30 0x7fe11415aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe112800640 1 -- 172.21.15.175:0/2681998640 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11413d9b0 con 0x7fe11415f5d0 2024-04-25T09:14:46.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe111400640 1 --2- 172.21.15.175:0/2681998640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe11415bd30 0x7fe11415aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:46.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe112800640 1 --2- 172.21.15.175:0/2681998640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe11415f5d0 0x7fe114139160 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00c430 tx=0x7fe10c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:46.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe10a000640 1 -- 172.21.15.175:0/2681998640 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c005220 con 0x7fe11415f5d0 2024-04-25T09:14:46.712 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe10a000640 1 -- 172.21.15.175:0/2681998640 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c0053c0 con 0x7fe11415f5d0 2024-04-25T09:14:46.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe113200640 1 -- 172.21.15.175:0/2681998640 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11413dc90 con 0x7fe11415f5d0 2024-04-25T09:14:46.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe10a000640 1 -- 172.21.15.175:0/2681998640 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c007270 con 0x7fe11415f5d0 2024-04-25T09:14:46.713 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe113200640 1 -- 172.21.15.175:0/2681998640 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11413e250 con 0x7fe11415f5d0 2024-04-25T09:14:46.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe113200640 1 -- 172.21.15.175:0/2681998640 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe114074a60 con 0x7fe11415f5d0 2024-04-25T09:14:46.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.723+0000 7fe10a000640 1 -- 172.21.15.175:0/2681998640 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe10c019020 con 0x7fe11415f5d0 2024-04-25T09:14:46.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.727+0000 7fe10a000640 1 --2- 172.21.15.175:0/2681998640 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe0f4066f90 0x7fe0f4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:46.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.727+0000 7fe10a000640 1 -- 172.21.15.175:0/2681998640 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fe10c084060 con 0x7fe11415f5d0 2024-04-25T09:14:46.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.727+0000 7fe111e00640 1 --2- 172.21.15.175:0/2681998640 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe0f4066f90 0x7fe0f4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:46.714 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.727+0000 7fe111e00640 1 --2- 172.21.15.175:0/2681998640 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe0f4066f90 0x7fe0f4069450 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe104005fd0 tx=0x7fe104005c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:46.717 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.731+0000 7fe10a000640 1 -- 172.21.15.175:0/2681998640 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe10c054c60 con 0x7fe11415f5d0 2024-04-25T09:14:46.871 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.883+0000 7fe113200640 1 -- 172.21.15.175:0/2681998640 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe11406d550 con 0x7fe11415f5d0 2024-04-25T09:14:46.874 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.887+0000 7fe10a000640 1 -- 172.21.15.175:0/2681998640 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe10c058d00 con 0x7fe11415f5d0 2024-04-25T09:14:46.877 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.887+0000 7fe113200640 1 -- 172.21.15.175:0/2681998640 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe0f4066f90 msgr2=0x7fe0f4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.891+0000 7fe113200640 1 --2- 172.21.15.175:0/2681998640 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe0f4066f90 0x7fe0f4069450 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe104005fd0 tx=0x7fe104005c20 comp rx=0 tx=0).stop 2024-04-25T09:14:46.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.891+0000 7fe113200640 1 -- 172.21.15.175:0/2681998640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe11415f5d0 msgr2=0x7fe114139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:46.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.891+0000 7fe113200640 1 --2- 172.21.15.175:0/2681998640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe11415f5d0 0x7fe114139160 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00c430 tx=0x7fe10c00c8f0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.891+0000 7fe113200640 1 -- 172.21.15.175:0/2681998640 shutdown_connections 2024-04-25T09:14:46.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.891+0000 7fe113200640 1 --2- 172.21.15.175:0/2681998640 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fe0f4066f90 0x7fe0f4069450 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.891+0000 7fe113200640 1 --2- 172.21.15.175:0/2681998640 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe11415f5d0 0x7fe114139160 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.891+0000 7fe113200640 1 --2- 172.21.15.175:0/2681998640 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe11415bd30 0x7fe11415aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.891+0000 7fe113200640 1 --2- 172.21.15.175:0/2681998640 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1140ce340 0x7fe11415a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:46.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.891+0000 7fe113200640 1 -- 172.21.15.175:0/2681998640 >> 172.21.15.175:0/2681998640 conn(0x7fe11406ac50 msgr2=0x7fe11415d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:46.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.891+0000 7fe113200640 1 -- 172.21.15.175:0/2681998640 shutdown_connections 2024-04-25T09:14:46.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:46.891+0000 7fe113200640 1 -- 172.21.15.175:0/2681998640 wait complete. 2024-04-25T09:14:46.896 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-04-25T09:14:47.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.043+0000 7f9aece00640 1 Processor -- start 2024-04-25T09:14:47.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.043+0000 7f9aece00640 1 -- start start 2024-04-25T09:14:47.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.047+0000 7f9aece00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ae80cfe30 0x7f9ae81665e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.047+0000 7f9aece00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae815cd00 con 0x7f9ae81453a0 2024-04-25T09:14:47.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.047+0000 7f9aece00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae80ce660 con 0x7f9ae8144fc0 2024-04-25T09:14:47.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.047+0000 7f9aece00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae80cc930 con 0x7f9ae80cfe30 2024-04-25T09:14:47.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.047+0000 7f9ae6800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ae80cfe30 0x7f9ae81665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.047+0000 7f9ae5400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f9ae81453a0 0x7f9ae815bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:36212/0 (socket says 172.21.15.175:36212) 2024-04-25T09:14:47.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.047+0000 7f9ae6800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ae80cfe30 0x7f9ae81665e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41448/0 (socket says 172.21.15.175:41448) 2024-04-25T09:14:47.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.047+0000 7f9ae5400640 1 -- 172.21.15.175:0/749658946 learned_addr learned my addr 172.21.15.175:0/749658946 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:47.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.047+0000 7f9ae6800640 1 -- 172.21.15.175:0/749658946 >> v1:172.21.15.177:6789/0 conn(0x7f9ae8144fc0 legacy=0x7f9ae80cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.047+0000 7f9ae6800640 1 -- 172.21.15.175:0/749658946 >> v1:172.21.15.175:6789/0 conn(0x7f9ae81453a0 legacy=0x7f9ae815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.047+0000 7f9ae6800640 1 -- 172.21.15.175:0/749658946 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae80ccc10 con 0x7f9ae80cfe30 2024-04-25T09:14:47.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.051+0000 7f9ae6800640 1 --2- 172.21.15.175:0/749658946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ae80cfe30 0x7f9ae81665e0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00097f0 tx=0x7f9ae001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81fbade55cf5e68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:47.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.051+0000 7f9ae4a00640 1 -- 172.21.15.175:0/749658946 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae00b1070 con 0x7f9ae80cfe30 2024-04-25T09:14:47.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.051+0000 7f9ae4a00640 1 -- 172.21.15.175:0/749658946 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae00ac5f0 con 0x7f9ae80cfe30 2024-04-25T09:14:47.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.051+0000 7f9ae4a00640 1 -- 172.21.15.175:0/749658946 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae00ac9c0 con 0x7f9ae80cfe30 2024-04-25T09:14:47.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.051+0000 7f9aece00640 1 -- 172.21.15.175:0/749658946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ae80cfe30 msgr2=0x7f9ae81665e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.051+0000 7f9aece00640 1 --2- 172.21.15.175:0/749658946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ae80cfe30 0x7f9ae81665e0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f9ae00097f0 tx=0x7f9ae001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.051+0000 7f9aece00640 1 -- 172.21.15.175:0/749658946 shutdown_connections 2024-04-25T09:14:47.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.051+0000 7f9aece00640 1 --2- 172.21.15.175:0/749658946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ae80cfe30 0x7f9ae81665e0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.051+0000 7f9aece00640 1 -- 172.21.15.175:0/749658946 >> 172.21.15.175:0/749658946 conn(0x7f9ae8067150 msgr2=0x7f9ae806ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:47.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.051+0000 7f9aece00640 1 -- 172.21.15.175:0/749658946 shutdown_connections 2024-04-25T09:14:47.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.051+0000 7f9aece00640 1 -- 172.21.15.175:0/749658946 wait complete. 2024-04-25T09:14:47.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.051+0000 7f9aece00640 1 Processor -- start 2024-04-25T09:14:47.040 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.051+0000 7f9aece00640 1 -- start start 2024-04-25T09:14:47.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9aece00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ae8144fc0 0x7f9ae8141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9aece00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ae81453a0 0x7f9ae813f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9aece00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ae813c4f0 0x7f9ae8158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9aece00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae81698d0 con 0x7f9ae81453a0 2024-04-25T09:14:47.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9aece00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae8169750 con 0x7f9ae8144fc0 2024-04-25T09:14:47.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9aece00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae8169a50 con 0x7f9ae813c4f0 2024-04-25T09:14:47.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9ae5400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ae81453a0 0x7f9ae813f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.043 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9ae5400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ae81453a0 0x7f9ae813f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41454/0 (socket says 172.21.15.175:41454) 2024-04-25T09:14:47.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9ae5400640 1 -- 172.21.15.175:0/4290462651 learned_addr learned my addr 172.21.15.175:0/4290462651 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:47.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9ae5e00640 1 --2- 172.21.15.175:0/4290462651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ae8144fc0 0x7f9ae8141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9ae6800640 1 --2- 172.21.15.175:0/4290462651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ae813c4f0 0x7f9ae8158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9ae5400640 1 -- 172.21.15.175:0/4290462651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ae813c4f0 msgr2=0x7f9ae8158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9ae5400640 1 --2- 172.21.15.175:0/4290462651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ae813c4f0 0x7f9ae8158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9ae5400640 1 -- 172.21.15.175:0/4290462651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ae8144fc0 msgr2=0x7f9ae8141ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9ae5400640 1 --2- 172.21.15.175:0/4290462651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ae8144fc0 0x7f9ae8141ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9ae5400640 1 -- 172.21.15.175:0/4290462651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae8140230 con 0x7f9ae81453a0 2024-04-25T09:14:47.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9ae6800640 1 --2- 172.21.15.175:0/4290462651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ae813c4f0 0x7f9ae8158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:47.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9ae5400640 1 --2- 172.21.15.175:0/4290462651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ae81453a0 0x7f9ae813f850 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f9ad400c410 tx=0x7f9ad400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:47.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9ade000640 1 -- 172.21.15.175:0/4290462651 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad4017070 con 0x7f9ae81453a0 2024-04-25T09:14:47.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9ade000640 1 -- 172.21.15.175:0/4290462651 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad4005cf0 con 0x7f9ae81453a0 2024-04-25T09:14:47.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9ade000640 1 -- 172.21.15.175:0/4290462651 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad40072d0 con 0x7f9ae81453a0 2024-04-25T09:14:47.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9aece00640 1 -- 172.21.15.175:0/4290462651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae815ae20 con 0x7f9ae81453a0 2024-04-25T09:14:47.044 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9aece00640 1 -- 172.21.15.175:0/4290462651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae815b3e0 con 0x7f9ae81453a0 2024-04-25T09:14:47.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9aece00640 1 -- 172.21.15.175:0/4290462651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae815b8d0 con 0x7f9ae81453a0 2024-04-25T09:14:47.045 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.055+0000 7f9ade000640 1 -- 172.21.15.175:0/4290462651 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9ad401a070 con 0x7f9ae81453a0 2024-04-25T09:14:47.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.059+0000 7f9ade000640 1 --2- 172.21.15.175:0/4290462651 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9ac8066f60 0x7f9ac8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:47.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.059+0000 7f9ade000640 1 -- 172.21.15.175:0/4290462651 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f9ad4083f20 con 0x7f9ae81453a0 2024-04-25T09:14:47.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.059+0000 7f9ae5e00640 1 --2- 172.21.15.175:0/4290462651 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9ac8066f60 0x7f9ac8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:47.046 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.059+0000 7f9ae5e00640 1 --2- 172.21.15.175:0/4290462651 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9ac8066f60 0x7f9ac8069420 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8001ea0 tx=0x7f9ad8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:47.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.063+0000 7f9ade000640 1 -- 172.21.15.175:0/4290462651 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9ad4054bc0 con 0x7f9ae81453a0 2024-04-25T09:14:47.268 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.279+0000 7f9aece00640 1 -- 172.21.15.175:0/4290462651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) v1 -- 0x7f9ae8074a60 con 0x7f9ae81453a0 2024-04-25T09:14:47.535 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.547+0000 7f9ade000640 1 -- 172.21.15.175:0/4290462651 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v511) v1 ==== 144+0+0 (secure 0 0 0) 0x7f9ad4058c60 con 0x7f9ae81453a0 2024-04-25T09:14:47.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.547+0000 7f9aece00640 1 -- 172.21.15.175:0/4290462651 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9ac8066f60 msgr2=0x7f9ac8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.537 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.547+0000 7f9aece00640 1 --2- 172.21.15.175:0/4290462651 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9ac8066f60 0x7f9ac8069420 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8001ea0 tx=0x7f9ad8009040 comp rx=0 tx=0).stop 2024-04-25T09:14:47.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.547+0000 7f9aece00640 1 -- 172.21.15.175:0/4290462651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ae81453a0 msgr2=0x7f9ae813f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:47.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.547+0000 7f9aece00640 1 --2- 172.21.15.175:0/4290462651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ae81453a0 0x7f9ae813f850 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f9ad400c410 tx=0x7f9ad400c8d0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.551+0000 7f9aece00640 1 -- 172.21.15.175:0/4290462651 shutdown_connections 2024-04-25T09:14:47.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.551+0000 7f9aece00640 1 --2- 172.21.15.175:0/4290462651 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9ac8066f60 0x7f9ac8069420 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.551+0000 7f9aece00640 1 --2- 172.21.15.175:0/4290462651 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9ae813c4f0 0x7f9ae8158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.551+0000 7f9aece00640 1 --2- 172.21.15.175:0/4290462651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ae81453a0 0x7f9ae813f850 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.551+0000 7f9aece00640 1 --2- 172.21.15.175:0/4290462651 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9ae8144fc0 0x7f9ae8141ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:47.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.551+0000 7f9aece00640 1 -- 172.21.15.175:0/4290462651 >> 172.21.15.175:0/4290462651 conn(0x7f9ae80cfe30 msgr2=0x7f9ae813d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:47.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.551+0000 7f9aece00640 1 -- 172.21.15.175:0/4290462651 shutdown_connections 2024-04-25T09:14:47.538 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:47.551+0000 7f9aece00640 1 -- 172.21.15.175:0/4290462651 wait complete. 2024-04-25T09:14:47.557 INFO:tasks.cephfs_test_runner:test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-25T09:14:47.558 INFO:tasks.cephfs_test_runner: 2024-04-25T09:14:47.558 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T09:14:47.558 INFO:tasks.cephfs_test_runner:Ran 7 tests in 609.604s 2024-04-25T09:14:47.558 INFO:tasks.cephfs_test_runner: 2024-04-25T09:14:47.558 INFO:tasks.cephfs_test_runner:OK 2024-04-25T09:14:47.558 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-25T09:14:47.568 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T09:14:47.641 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T09:14:47.641 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:14:47.641 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:47.650 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:14:47.650 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-25T09:14:47.650 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:47.700 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3577 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:14:47.700 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:14:47.701 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:47.710 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:14:47.710 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-04-25T09:14:47.710 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:14:47.760 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350140k,nr_inodes=4087535,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2831 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274956k,nr_inodes=818739,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274960k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:14:47.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:47.760 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:14:47.769 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:14:47.769 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:14:47.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:47.769 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:14:47.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:47.833 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:14:47.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:47.901 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2024-04-25T09:14:48.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:48.052 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-25T09:14:48.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:48.061 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2024-04-25T09:14:48.130 INFO:teuthology.orchestra.run.smithi175.stderr:Cannot find device "ceph-brx" 2024-04-25T09:14:48.132 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:14:48.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:48.133 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-04-25T09:14:48.142 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T09:14:48.142 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T09:14:48.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:48.143 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T09:14:48.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:48.207 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T09:14:48.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:48.270 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2024-04-25T09:14:48.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:48.435 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2024-04-25T09:14:48.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:14:48.444 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2024-04-25T09:14:48.510 INFO:teuthology.orchestra.run.smithi177.stderr:Cannot find device "ceph-brx" 2024-04-25T09:14:48.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:14:48.514 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T09:14:48.526 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T09:14:48.526 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:14:48.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.675+0000 7f5854200640 1 Processor -- start 2024-04-25T09:14:48.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.675+0000 7f5854200640 1 -- start start 2024-04-25T09:14:48.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.675+0000 7f5854200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f584c06b0e0 0x7f584c06b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.679+0000 7f5854200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f584c0b1090 0x7f584c0b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.679+0000 7f5854200640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c0d01d0 con 0x7f584c0b0c50 2024-04-25T09:14:48.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.679+0000 7f5854200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f584c0b07c0 con 0x7f584c06b0e0 2024-04-25T09:14:48.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.679+0000 7f5854200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c0d0450 con 0x7f584c0b1090 2024-04-25T09:14:48.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.679+0000 7f5851800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f584c06b0e0 0x7f584c06b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.679+0000 7f5852200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f584c0b1090 0x7f584c0b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.679+0000 7f5850e00640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f584c0b0c50 0x7f584c0cfac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:51238/0 (socket says 172.21.15.175:51238) 2024-04-25T09:14:48.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.679+0000 7f5850e00640 1 -- 172.21.15.175:0/1790955366 learned_addr learned my addr 172.21.15.175:0/1790955366 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:48.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.679+0000 7f584be00640 1 -- 172.21.15.175:0/1790955366 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252814400 0 0) 0x7f5838001120 con 0x7f584c0b0c50 2024-04-25T09:14:48.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.679+0000 7f5851800640 1 -- 172.21.15.175:0/1790955366 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f584c0b1090 msgr2=0x7f584c0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:48.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.679+0000 7f5851800640 1 --2- 172.21.15.175:0/1790955366 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f584c0b1090 0x7f584c0b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.666 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.679+0000 7f5851800640 1 -- 172.21.15.175:0/1790955366 >> v1:172.21.15.177:6789/0 conn(0x7f584c0b0c50 legacy=0x7f584c0cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.679+0000 7f5851800640 1 -- 172.21.15.175:0/1790955366 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c0afe90 con 0x7f584c06b0e0 2024-04-25T09:14:48.667 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.679+0000 7f5852200640 1 --2- 172.21.15.175:0/1790955366 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f584c0b1090 0x7f584c0b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:48.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.679+0000 7f5851800640 1 --2- 172.21.15.175:0/1790955366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f584c06b0e0 0x7f584c06b4c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f58400097c0 tx=0x7f584001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=609cab9119167642 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:48.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f584be00640 1 -- 172.21.15.175:0/1790955366 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58400b5070 con 0x7f584c06b0e0 2024-04-25T09:14:48.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f584be00640 1 -- 172.21.15.175:0/1790955366 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58400a8990 con 0x7f584c06b0e0 2024-04-25T09:14:48.669 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f584be00640 1 -- 172.21.15.175:0/1790955366 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58400a8d60 con 0x7f584c06b0e0 2024-04-25T09:14:48.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5854200640 1 -- 172.21.15.175:0/1790955366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f584c06b0e0 msgr2=0x7f584c06b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5854200640 1 --2- 172.21.15.175:0/1790955366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f584c06b0e0 0x7f584c06b4c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f58400097c0 tx=0x7f584001ec90 comp rx=0 tx=0).stop 2024-04-25T09:14:48.670 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5854200640 1 -- 172.21.15.175:0/1790955366 shutdown_connections 2024-04-25T09:14:48.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5854200640 1 --2- 172.21.15.175:0/1790955366 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f584c0b1090 0x7f584c0b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5854200640 1 --2- 172.21.15.175:0/1790955366 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f584c06b0e0 0x7f584c06b4c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5854200640 1 -- 172.21.15.175:0/1790955366 >> 172.21.15.175:0/1790955366 conn(0x7f584c0d06c0 msgr2=0x7f584c0d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:48.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5854200640 1 -- 172.21.15.175:0/1790955366 shutdown_connections 2024-04-25T09:14:48.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5854200640 1 -- 172.21.15.175:0/1790955366 wait complete. 2024-04-25T09:14:48.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5854200640 1 Processor -- start 2024-04-25T09:14:48.671 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5854200640 1 -- start start 2024-04-25T09:14:48.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5854200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f584c06b0e0 0x7f584c09e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.673 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5854200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f584c0b0c50 0x7f584c1f7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5854200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f584c0b1090 0x7f584c1f76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5854200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c06ba00 con 0x7f584c06b0e0 2024-04-25T09:14:48.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5854200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c0b0450 con 0x7f584c0b1090 2024-04-25T09:14:48.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5854200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c06bb80 con 0x7f584c0b0c50 2024-04-25T09:14:48.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5851800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f584c06b0e0 0x7f584c09e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5851800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f584c06b0e0 0x7f584c09e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41464/0 (socket says 172.21.15.175:41464) 2024-04-25T09:14:48.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.683+0000 7f5851800640 1 -- 172.21.15.175:0/4172452847 learned_addr learned my addr 172.21.15.175:0/4172452847 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:48.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.687+0000 7f5852200640 1 --2- 172.21.15.175:0/4172452847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f584c0b1090 0x7f584c1f76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.687+0000 7f5850e00640 1 --2- 172.21.15.175:0/4172452847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f584c0b0c50 0x7f584c1f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.687+0000 7f5851800640 1 -- 172.21.15.175:0/4172452847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f584c0b0c50 msgr2=0x7f584c1f7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.687+0000 7f5851800640 1 --2- 172.21.15.175:0/4172452847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f584c0b0c50 0x7f584c1f7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.687+0000 7f5851800640 1 -- 172.21.15.175:0/4172452847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f584c0b1090 msgr2=0x7f584c1f76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.674 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.687+0000 7f5851800640 1 --2- 172.21.15.175:0/4172452847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f584c0b1090 0x7f584c1f76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.687+0000 7f5851800640 1 -- 172.21.15.175:0/4172452847 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c1f7f10 con 0x7f584c06b0e0 2024-04-25T09:14:48.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.687+0000 7f5851800640 1 --2- 172.21.15.175:0/4172452847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f584c06b0e0 0x7f584c09e0d0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f584001c8c0 tx=0x7f584001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:48.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.687+0000 7f5849600640 1 -- 172.21.15.175:0/4172452847 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58400b5040 con 0x7f584c06b0e0 2024-04-25T09:14:48.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.687+0000 7f5849600640 1 -- 172.21.15.175:0/4172452847 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58400bf070 con 0x7f584c06b0e0 2024-04-25T09:14:48.675 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.687+0000 7f5849600640 1 -- 172.21.15.175:0/4172452847 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58400b08a0 con 0x7f584c06b0e0 2024-04-25T09:14:48.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.687+0000 7f5854200640 1 -- 172.21.15.175:0/4172452847 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584c0b44b0 con 0x7f584c06b0e0 2024-04-25T09:14:48.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.687+0000 7f5854200640 1 -- 172.21.15.175:0/4172452847 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584c1f7c10 con 0x7f584c06b0e0 2024-04-25T09:14:48.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.687+0000 7f5854200640 1 -- 172.21.15.175:0/4172452847 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f584c0b4b70 con 0x7f584c06b0e0 2024-04-25T09:14:48.676 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.687+0000 7f5849600640 1 -- 172.21.15.175:0/4172452847 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f58400b0a40 con 0x7f584c06b0e0 2024-04-25T09:14:48.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.687+0000 7f5849600640 1 --2- 172.21.15.175:0/4172452847 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f582c066f60 0x7f582c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.687+0000 7f5849600640 1 -- 172.21.15.175:0/4172452847 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f58401220f0 con 0x7f584c06b0e0 2024-04-25T09:14:48.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.691+0000 7f5850e00640 1 --2- 172.21.15.175:0/4172452847 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f582c066f60 0x7f582c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.677 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.691+0000 7f5850e00640 1 --2- 172.21.15.175:0/4172452847 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f582c066f60 0x7f582c069420 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f584c0ae160 tx=0x7f5838007b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:48.680 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.691+0000 7f5849600640 1 -- 172.21.15.175:0/4172452847 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f584c0b4b70 con 0x7f584c06b0e0 2024-04-25T09:14:48.829 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.843+0000 7f5854200640 1 -- 172.21.15.175:0/4172452847 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f584c06cd10 con 0x7f582c066f60 2024-04-25T09:14:48.830 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.843+0000 7f5849600640 1 -- 172.21.15.175:0/4172452847 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13516 (secure 0 0 0) 0x7f584c06cd10 con 0x7f582c066f60 2024-04-25T09:14:48.831 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:48.831 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:14:48.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.843+0000 7f5854200640 1 -- 172.21.15.175:0/4172452847 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f582c066f60 msgr2=0x7f582c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.843+0000 7f5854200640 1 --2- 172.21.15.175:0/4172452847 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f582c066f60 0x7f582c069420 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f584c0ae160 tx=0x7f5838007b60 comp rx=0 tx=0).stop 2024-04-25T09:14:48.832 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.843+0000 7f5854200640 1 -- 172.21.15.175:0/4172452847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f584c06b0e0 msgr2=0x7f584c09e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.843+0000 7f5854200640 1 --2- 172.21.15.175:0/4172452847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f584c06b0e0 0x7f584c09e0d0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f584001c8c0 tx=0x7f584001ba30 comp rx=0 tx=0).stop 2024-04-25T09:14:48.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.843+0000 7f5854200640 1 -- 172.21.15.175:0/4172452847 shutdown_connections 2024-04-25T09:14:48.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.843+0000 7f5854200640 1 --2- 172.21.15.175:0/4172452847 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f582c066f60 0x7f582c069420 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.843+0000 7f5854200640 1 --2- 172.21.15.175:0/4172452847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f584c0b1090 0x7f584c1f76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.843+0000 7f5854200640 1 --2- 172.21.15.175:0/4172452847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f584c0b0c50 0x7f584c1f7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.843+0000 7f5854200640 1 --2- 172.21.15.175:0/4172452847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f584c06b0e0 0x7f584c09e0d0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.843+0000 7f5854200640 1 -- 172.21.15.175:0/4172452847 >> 172.21.15.175:0/4172452847 conn(0x7f584c0d06c0 msgr2=0x7f584c0d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:48.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.843+0000 7f5854200640 1 -- 172.21.15.175:0/4172452847 shutdown_connections 2024-04-25T09:14:48.833 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:48.843+0000 7f5854200640 1 -- 172.21.15.175:0/4172452847 wait complete. 2024-04-25T09:14:48.852 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":436,"stamp":"2024-04-25T09:14:47.937554+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262112,"kb_used_data":12660,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712608,"statfs":{"total":773094113280,"available":772825710592,"internally_reserved":0,"allocated":12963840,"data_stored":6293673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390401,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-267,"num_write":-174,"num_write_kb":-8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001155"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":353,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-25T09:14:46.889659+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:14:46.889659+0000","last_peered":"2024-04-25T09:14:46.889659+0000","last_clean":"2024-04-25T09:14:46.889659+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:14:46.889659+0000","last_undegraded":"2024-04-25T09:14:46.889659+0000","last_fullsized":"2024-04-25T09:14:46.889659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574981,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2068480,"data_stored":1230898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574983,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574980,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32600,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1454080,"data_stored":629227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574982,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574982,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574984,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2068480,"data_stored":1230898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:14:48.853 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:14:48.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.003+0000 7ff7d4000640 1 Processor -- start 2024-04-25T09:14:48.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.003+0000 7ff7d4000640 1 -- start start 2024-04-25T09:14:48.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.003+0000 7ff7d4000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff7cc1453a0 0x7ff7cc15bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.003+0000 7ff7d4000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff7cc15c410 0x7ff7cc0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.003+0000 7ff7d4000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7cc15c8a0 con 0x7ff7cc144fc0 2024-04-25T09:14:48.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.003+0000 7ff7d4000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc15cd00 con 0x7ff7cc15c410 2024-04-25T09:14:48.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.003+0000 7ff7d4000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7cc0ce660 con 0x7ff7cc1453a0 2024-04-25T09:14:48.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.003+0000 7ff7d2000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff7cc15c410 0x7ff7cc0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.003+0000 7ff7d2000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff7cc15c410 0x7ff7cc0cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41474/0 (socket says 172.21.15.175:41474) 2024-04-25T09:14:48.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.003+0000 7ff7d2000640 1 -- 172.21.15.175:0/423602368 learned_addr learned my addr 172.21.15.175:0/423602368 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:48.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.003+0000 7ff7d0c00640 1 --2- 172.21.15.175:0/423602368 >> v2:172.21.15.177:3300/0 conn(0x7ff7cc1453a0 0x7ff7cc15bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:48.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.003+0000 7ff7d2000640 1 -- 172.21.15.175:0/423602368 >> v2:172.21.15.177:3300/0 conn(0x7ff7cc1453a0 msgr2=0x7ff7cc15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:48.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.003+0000 7ff7d2000640 1 --2- 172.21.15.175:0/423602368 >> v2:172.21.15.177:3300/0 conn(0x7ff7cc1453a0 0x7ff7cc15bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.003+0000 7ff7d2000640 1 -- 172.21.15.175:0/423602368 >> v1:172.21.15.177:6789/0 conn(0x7ff7cc144fc0 legacy=0x7ff7cc0cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:48.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.003+0000 7ff7d2000640 1 -- 172.21.15.175:0/423602368 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc0cc930 con 0x7ff7cc15c410 2024-04-25T09:14:48.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.003+0000 7ff7d0c00640 1 --2- 172.21.15.175:0/423602368 >> v2:172.21.15.177:3300/0 conn(0x7ff7cc1453a0 0x7ff7cc15bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:48.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.007+0000 7ff7d2000640 1 --2- 172.21.15.175:0/423602368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc15c410 0x7ff7cc0cee20 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009e50 tx=0x7ff7c401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70312a9d972d9ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:48.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.007+0000 7ff7cbe00640 1 -- 172.21.15.175:0/423602368 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c40a5760 con 0x7ff7cc15c410 2024-04-25T09:14:48.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.007+0000 7ff7cbe00640 1 -- 172.21.15.175:0/423602368 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c40a5900 con 0x7ff7cc15c410 2024-04-25T09:14:48.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.007+0000 7ff7cbe00640 1 -- 172.21.15.175:0/423602368 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c40a5cd0 con 0x7ff7cc15c410 2024-04-25T09:14:48.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.007+0000 7ff7d4000640 1 -- 172.21.15.175:0/423602368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc15c410 msgr2=0x7ff7cc0cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:48.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.007+0000 7ff7d4000640 1 --2- 172.21.15.175:0/423602368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc15c410 0x7ff7cc0cee20 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4009e50 tx=0x7ff7c401c9b0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.007+0000 7ff7d4000640 1 -- 172.21.15.175:0/423602368 shutdown_connections 2024-04-25T09:14:48.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.007+0000 7ff7d4000640 1 --2- 172.21.15.175:0/423602368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc15c410 0x7ff7cc0cee20 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.007+0000 7ff7d4000640 1 --2- 172.21.15.175:0/423602368 >> v2:172.21.15.177:3300/0 conn(0x7ff7cc1453a0 0x7ff7cc15bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:48.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.007+0000 7ff7d4000640 1 -- 172.21.15.175:0/423602368 >> 172.21.15.175:0/423602368 conn(0x7ff7cc067150 msgr2=0x7ff7cc06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:48.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.007+0000 7ff7d4000640 1 -- 172.21.15.175:0/423602368 shutdown_connections 2024-04-25T09:14:48.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.007+0000 7ff7d4000640 1 -- 172.21.15.175:0/423602368 wait complete. 2024-04-25T09:14:48.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.007+0000 7ff7d4000640 1 Processor -- start 2024-04-25T09:14:48.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.007+0000 7ff7d4000640 1 -- start start 2024-04-25T09:14:48.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d4000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7cc1453a0 0x7ff7cc143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d4000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7cc15c410 0x7ff7cc0af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d4000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc15a7e0 0x7ff7cc0b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:48.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d4000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0cc580 con 0x7ff7cc15a7e0 2024-04-25T09:14:48.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d4000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0cfb70 con 0x7ff7cc15c410 2024-04-25T09:14:48.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d4000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7cc0af710 con 0x7ff7cc1453a0 2024-04-25T09:14:48.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d2000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc15a7e0 0x7ff7cc0b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d2000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc15a7e0 0x7ff7cc0b3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:41478/0 (socket says 172.21.15.175:41478) 2024-04-25T09:14:49.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d2000640 1 -- 172.21.15.175:0/2623338326 learned_addr learned my addr 172.21.15.175:0/2623338326 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:49.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d1600640 1 --2- 172.21.15.175:0/2623338326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7cc1453a0 0x7ff7cc143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d0c00640 1 --2- 172.21.15.175:0/2623338326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7cc15c410 0x7ff7cc0af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d2000640 1 -- 172.21.15.175:0/2623338326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7cc1453a0 msgr2=0x7ff7cc143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d2000640 1 --2- 172.21.15.175:0/2623338326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7cc1453a0 0x7ff7cc143280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d2000640 1 -- 172.21.15.175:0/2623338326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7cc15c410 msgr2=0x7ff7cc0af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d2000640 1 --2- 172.21.15.175:0/2623338326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7cc15c410 0x7ff7cc0af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d2000640 1 -- 172.21.15.175:0/2623338326 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc144620 con 0x7ff7cc15a7e0 2024-04-25T09:14:49.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d2000640 1 --2- 172.21.15.175:0/2623338326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc15a7e0 0x7ff7cc0b3c70 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40af040 tx=0x7ff7c4019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:49.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7c9600640 1 -- 172.21.15.175:0/2623338326 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c40b8670 con 0x7ff7cc15a7e0 2024-04-25T09:14:49.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7c9600640 1 -- 172.21.15.175:0/2623338326 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c40be070 con 0x7ff7cc15a7e0 2024-04-25T09:14:49.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7c9600640 1 -- 172.21.15.175:0/2623338326 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c40b8a70 con 0x7ff7cc15a7e0 2024-04-25T09:14:49.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d4000640 1 -- 172.21.15.175:0/2623338326 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7cc1427a0 con 0x7ff7cc15a7e0 2024-04-25T09:14:49.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d4000640 1 -- 172.21.15.175:0/2623338326 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7cc142d60 con 0x7ff7cc15a7e0 2024-04-25T09:14:49.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.011+0000 7ff7d4000640 1 -- 172.21.15.175:0/2623338326 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7cc1425c0 con 0x7ff7cc15a7e0 2024-04-25T09:14:49.001 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.015+0000 7ff7c9600640 1 -- 172.21.15.175:0/2623338326 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff7c40b8c10 con 0x7ff7cc15a7e0 2024-04-25T09:14:49.002 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.015+0000 7ff7c9600640 1 --2- 172.21.15.175:0/2623338326 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7ac066f60 0x7ff7ac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.015+0000 7ff7c9600640 1 -- 172.21.15.175:0/2623338326 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7ff7c411ffd0 con 0x7ff7cc15a7e0 2024-04-25T09:14:49.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.015+0000 7ff7d1600640 1 --2- 172.21.15.175:0/2623338326 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7ac066f60 0x7ff7ac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.003 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.015+0000 7ff7d1600640 1 --2- 172.21.15.175:0/2623338326 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7ac066f60 0x7ff7ac069420 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0007fd0 tx=0x7ff7c0007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:49.006 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.019+0000 7ff7c9600640 1 -- 172.21.15.175:0/2623338326 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff7cc1425c0 con 0x7ff7cc15a7e0 2024-04-25T09:14:49.156 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.167+0000 7ff7d4000640 1 -- 172.21.15.175:0/2623338326 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff7cc142f60 con 0x7ff7ac066f60 2024-04-25T09:14:49.157 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.167+0000 7ff7c9600640 1 -- 172.21.15.175:0/2623338326 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13516 (secure 0 0 0) 0x7ff7cc142f60 con 0x7ff7ac066f60 2024-04-25T09:14:49.157 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:49.158 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:14:49.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.171+0000 7ff7d4000640 1 -- 172.21.15.175:0/2623338326 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7ac066f60 msgr2=0x7ff7ac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.171+0000 7ff7d4000640 1 --2- 172.21.15.175:0/2623338326 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7ac066f60 0x7ff7ac069420 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0007fd0 tx=0x7ff7c0007e40 comp rx=0 tx=0).stop 2024-04-25T09:14:49.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.171+0000 7ff7d4000640 1 -- 172.21.15.175:0/2623338326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc15a7e0 msgr2=0x7ff7cc0b3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.160 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.171+0000 7ff7d4000640 1 --2- 172.21.15.175:0/2623338326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc15a7e0 0x7ff7cc0b3c70 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40af040 tx=0x7ff7c4019750 comp rx=0 tx=0).stop 2024-04-25T09:14:49.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.171+0000 7ff7d4000640 1 -- 172.21.15.175:0/2623338326 shutdown_connections 2024-04-25T09:14:49.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.171+0000 7ff7d4000640 1 --2- 172.21.15.175:0/2623338326 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7ff7ac066f60 0x7ff7ac069420 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.171+0000 7ff7d4000640 1 --2- 172.21.15.175:0/2623338326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff7cc15a7e0 0x7ff7cc0b3c70 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.171+0000 7ff7d4000640 1 --2- 172.21.15.175:0/2623338326 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff7cc15c410 0x7ff7cc0af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.171+0000 7ff7d4000640 1 --2- 172.21.15.175:0/2623338326 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff7cc1453a0 0x7ff7cc143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.171+0000 7ff7d4000640 1 -- 172.21.15.175:0/2623338326 >> 172.21.15.175:0/2623338326 conn(0x7ff7cc144fc0 msgr2=0x7ff7cc13c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:49.161 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.171+0000 7ff7d4000640 1 -- 172.21.15.175:0/2623338326 shutdown_connections 2024-04-25T09:14:49.162 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.171+0000 7ff7d4000640 1 -- 172.21.15.175:0/2623338326 wait complete. 2024-04-25T09:14:49.177 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":436,"stamp":"2024-04-25T09:14:47.937554+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262112,"kb_used_data":12660,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712608,"statfs":{"total":773094113280,"available":772825710592,"internally_reserved":0,"allocated":12963840,"data_stored":6293673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390401,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-267,"num_write":-174,"num_write_kb":-8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001155"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":353,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-25T09:14:46.889659+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:14:46.889659+0000","last_peered":"2024-04-25T09:14:46.889659+0000","last_clean":"2024-04-25T09:14:46.889659+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:14:46.889659+0000","last_undegraded":"2024-04-25T09:14:46.889659+0000","last_fullsized":"2024-04-25T09:14:46.889659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574981,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2068480,"data_stored":1230898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574983,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574980,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32600,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1454080,"data_stored":629227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574982,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574982,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574984,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2068480,"data_stored":1230898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:14:49.178 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T09:14:49.178 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:14:49.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.323+0000 7f8418000640 1 Processor -- start 2024-04-25T09:14:49.312 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.323+0000 7f8418000640 1 -- start start 2024-04-25T09:14:49.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.327+0000 7f8418000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f84100b40a0 0x7f84100b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.327+0000 7f8418000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84100b3cc0 con 0x7f84100b2f60 2024-04-25T09:14:49.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.327+0000 7f8418000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841006e080 con 0x7f84100cf350 2024-04-25T09:14:49.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.327+0000 7f8418000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84100cd630 con 0x7f84100b40a0 2024-04-25T09:14:49.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.327+0000 7f8415600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f84100b40a0 0x7f84100b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.327+0000 7f8415600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f84100b40a0 0x7f84100b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45452/0 (socket says 172.21.15.175:45452) 2024-04-25T09:14:49.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.327+0000 7f8414c00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f84100b2f60 0x7f841006d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59918/0 (socket says 172.21.15.175:59918) 2024-04-25T09:14:49.314 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.327+0000 7f8415600640 1 -- 172.21.15.175:0/3705535076 learned_addr learned my addr 172.21.15.175:0/3705535076 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:49.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.327+0000 7f8415600640 1 -- 172.21.15.175:0/3705535076 >> v1:172.21.15.177:6789/0 conn(0x7f84100cf350 legacy=0x7f841006d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.327+0000 7f8415600640 1 -- 172.21.15.175:0/3705535076 >> v1:172.21.15.175:6789/0 conn(0x7f84100b2f60 legacy=0x7f841006d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.315 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.327+0000 7f8415600640 1 -- 172.21.15.175:0/3705535076 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84100b49c0 con 0x7f84100b40a0 2024-04-25T09:14:49.317 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8415600640 1 --2- 172.21.15.175:0/3705535076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84100b40a0 0x7f84100b4480 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f8404009870 tx=0x7f840401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b173cb598c8b9fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:49.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f840fe00640 1 -- 172.21.15.175:0/3705535076 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84040b1070 con 0x7f84100b40a0 2024-04-25T09:14:49.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f840fe00640 1 -- 172.21.15.175:0/3705535076 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84040ac410 con 0x7f84100b40a0 2024-04-25T09:14:49.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f840fe00640 1 -- 172.21.15.175:0/3705535076 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84040ac7e0 con 0x7f84100b40a0 2024-04-25T09:14:49.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8418000640 1 -- 172.21.15.175:0/3705535076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84100b40a0 msgr2=0x7f84100b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8418000640 1 --2- 172.21.15.175:0/3705535076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84100b40a0 0x7f84100b4480 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f8404009870 tx=0x7f840401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8418000640 1 -- 172.21.15.175:0/3705535076 shutdown_connections 2024-04-25T09:14:49.318 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8418000640 1 --2- 172.21.15.175:0/3705535076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84100b40a0 0x7f84100b4480 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8418000640 1 -- 172.21.15.175:0/3705535076 >> 172.21.15.175:0/3705535076 conn(0x7f8410067150 msgr2=0x7f841006ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:49.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8418000640 1 -- 172.21.15.175:0/3705535076 shutdown_connections 2024-04-25T09:14:49.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8418000640 1 -- 172.21.15.175:0/3705535076 wait complete. 2024-04-25T09:14:49.319 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8418000640 1 Processor -- start 2024-04-25T09:14:49.320 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8418000640 1 -- start start 2024-04-25T09:14:49.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8418000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84100b40a0 0x7f8410141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8418000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84100cf350 0x7f8410150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8418000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8410151420 0x7f84100b1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8418000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84100cbf10 con 0x7f84100b40a0 2024-04-25T09:14:49.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8418000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84100cde20 con 0x7f84100cf350 2024-04-25T09:14:49.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8418000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84100cc090 con 0x7f8410151420 2024-04-25T09:14:49.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8415600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84100b40a0 0x7f8410141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8415600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84100b40a0 0x7f8410141ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45460/0 (socket says 172.21.15.175:45460) 2024-04-25T09:14:49.322 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8415600640 1 -- 172.21.15.175:0/1442888053 learned_addr learned my addr 172.21.15.175:0/1442888053 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:49.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.331+0000 7f8414c00640 1 --2- 172.21.15.175:0/1442888053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84100cf350 0x7f8410150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.335+0000 7f8416000640 1 --2- 172.21.15.175:0/1442888053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8410151420 0x7f84100b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.335+0000 7f8415600640 1 -- 172.21.15.175:0/1442888053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8410151420 msgr2=0x7f84100b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.335+0000 7f8415600640 1 --2- 172.21.15.175:0/1442888053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8410151420 0x7f84100b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.335+0000 7f8415600640 1 -- 172.21.15.175:0/1442888053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84100cf350 msgr2=0x7f8410150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.335+0000 7f8415600640 1 --2- 172.21.15.175:0/1442888053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84100cf350 0x7f8410150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.335+0000 7f8415600640 1 -- 172.21.15.175:0/1442888053 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84101518c0 con 0x7f84100b40a0 2024-04-25T09:14:49.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.335+0000 7f8415600640 1 --2- 172.21.15.175:0/1442888053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84100b40a0 0x7f8410141ee0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f84040af040 tx=0x7f8404019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:49.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.335+0000 7f840d600640 1 -- 172.21.15.175:0/1442888053 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84040bc070 con 0x7f84100b40a0 2024-04-25T09:14:49.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.335+0000 7f840d600640 1 -- 172.21.15.175:0/1442888053 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84040ace40 con 0x7f84100b40a0 2024-04-25T09:14:49.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.335+0000 7f8418000640 1 -- 172.21.15.175:0/1442888053 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8410151ba0 con 0x7f84100b40a0 2024-04-25T09:14:49.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.335+0000 7f840d600640 1 -- 172.21.15.175:0/1442888053 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84040b1070 con 0x7f84100b40a0 2024-04-25T09:14:49.323 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.335+0000 7f8418000640 1 -- 172.21.15.175:0/1442888053 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8410152160 con 0x7f84100b40a0 2024-04-25T09:14:49.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.335+0000 7f8402a00640 1 -- 172.21.15.175:0/1442888053 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e40052a0 con 0x7f84100b40a0 2024-04-25T09:14:49.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.335+0000 7f840d600640 1 -- 172.21.15.175:0/1442888053 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f84040bf070 con 0x7f84100b40a0 2024-04-25T09:14:49.324 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.335+0000 7f840d600640 1 --2- 172.21.15.175:0/1442888053 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f83f0066f60 0x7f83f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.335+0000 7f840d600640 1 -- 172.21.15.175:0/1442888053 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f840411e720 con 0x7f84100b40a0 2024-04-25T09:14:49.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.335+0000 7f8414c00640 1 --2- 172.21.15.175:0/1442888053 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f83f0066f60 0x7f83f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.339+0000 7f8414c00640 1 --2- 172.21.15.175:0/1442888053 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f83f0066f60 0x7f83f0069420 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f84101507a0 tx=0x7f83fc007e50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:49.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.339+0000 7f840d600640 1 -- 172.21.15.175:0/1442888053 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8404016150 con 0x7f84100b40a0 2024-04-25T09:14:49.480 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.491+0000 7f8402a00640 1 -- 172.21.15.175:0/1442888053 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83e4000bd0 con 0x7f83f0066f60 2024-04-25T09:14:49.481 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.491+0000 7f840d600640 1 -- 172.21.15.175:0/1442888053 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13516 (secure 0 0 0) 0x7f83e4000bd0 con 0x7f83f0066f60 2024-04-25T09:14:49.481 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:49.481 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:14:49.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.495+0000 7f8402a00640 1 -- 172.21.15.175:0/1442888053 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f83f0066f60 msgr2=0x7f83f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.495+0000 7f8402a00640 1 --2- 172.21.15.175:0/1442888053 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f83f0066f60 0x7f83f0069420 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f84101507a0 tx=0x7f83fc007e50 comp rx=0 tx=0).stop 2024-04-25T09:14:49.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.495+0000 7f8402a00640 1 -- 172.21.15.175:0/1442888053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84100b40a0 msgr2=0x7f8410141ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.495+0000 7f8402a00640 1 --2- 172.21.15.175:0/1442888053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84100b40a0 0x7f8410141ee0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f84040af040 tx=0x7f8404019240 comp rx=0 tx=0).stop 2024-04-25T09:14:49.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.495+0000 7f8402a00640 1 -- 172.21.15.175:0/1442888053 shutdown_connections 2024-04-25T09:14:49.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.495+0000 7f8402a00640 1 --2- 172.21.15.175:0/1442888053 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f83f0066f60 0x7f83f0069420 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.495+0000 7f8402a00640 1 --2- 172.21.15.175:0/1442888053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8410151420 0x7f84100b1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.495+0000 7f8402a00640 1 --2- 172.21.15.175:0/1442888053 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84100cf350 0x7f8410150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.495+0000 7f8402a00640 1 --2- 172.21.15.175:0/1442888053 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f84100b40a0 0x7f8410141ee0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.483 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.495+0000 7f8402a00640 1 -- 172.21.15.175:0/1442888053 >> 172.21.15.175:0/1442888053 conn(0x7f84100b2f60 msgr2=0x7f84101532c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:49.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.495+0000 7f8402a00640 1 -- 172.21.15.175:0/1442888053 shutdown_connections 2024-04-25T09:14:49.484 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.495+0000 7f8402a00640 1 -- 172.21.15.175:0/1442888053 wait complete. 2024-04-25T09:14:49.501 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":436,"stamp":"2024-04-25T09:14:47.937554+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262112,"kb_used_data":12660,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712608,"statfs":{"total":773094113280,"available":772825710592,"internally_reserved":0,"allocated":12963840,"data_stored":6293673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390401,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-267,"num_write":-174,"num_write_kb":-8300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001155"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":353,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-25T09:14:46.889659+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:14:46.889659+0000","last_peered":"2024-04-25T09:14:46.889659+0000","last_clean":"2024-04-25T09:14:46.889659+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:14:46.889659+0000","last_undegraded":"2024-04-25T09:14:46.889659+0000","last_fullsized":"2024-04-25T09:14:46.889659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574981,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2068480,"data_stored":1230898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574983,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574980,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32600,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1454080,"data_stored":629227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574982,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574982,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574984,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2068480,"data_stored":1230898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:14:49.502 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:14:49.638 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.651+0000 7fde2da00640 1 Processor -- start 2024-04-25T09:14:49.639 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.651+0000 7fde2da00640 1 -- start start 2024-04-25T09:14:49.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.651+0000 7fde2da00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fde28099a50 0x7fde2806cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.651+0000 7fde2da00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fde280d0d50 0x7fde280cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.651+0000 7fde2da00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde280cfcb0 con 0x7fde2806bd60 2024-04-25T09:14:49.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.651+0000 7fde2da00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde280cff90 con 0x7fde28099a50 2024-04-25T09:14:49.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.651+0000 7fde2da00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde280d0270 con 0x7fde280d0d50 2024-04-25T09:14:49.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.651+0000 7fde26a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fde28099a50 0x7fde2806cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.651+0000 7fde26a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fde28099a50 0x7fde2806cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45462/0 (socket says 172.21.15.175:45462) 2024-04-25T09:14:49.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.651+0000 7fde26a00640 1 -- 172.21.15.175:0/1422470244 learned_addr learned my addr 172.21.15.175:0/1422470244 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:49.640 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.651+0000 7fde27400640 1 --2- 172.21.15.175:0/1422470244 >> v2:172.21.15.177:3300/0 conn(0x7fde280d0d50 0x7fde280cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.651+0000 7fde26a00640 1 -- 172.21.15.175:0/1422470244 >> v2:172.21.15.177:3300/0 conn(0x7fde280d0d50 msgr2=0x7fde280cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:49.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.651+0000 7fde26a00640 1 --2- 172.21.15.175:0/1422470244 >> v2:172.21.15.177:3300/0 conn(0x7fde280d0d50 0x7fde280cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.651+0000 7fde26a00640 1 -- 172.21.15.175:0/1422470244 >> v1:172.21.15.175:6789/0 conn(0x7fde2806bd60 legacy=0x7fde28099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.641 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.651+0000 7fde26a00640 1 -- 172.21.15.175:0/1422470244 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde280d0550 con 0x7fde28099a50 2024-04-25T09:14:49.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.655+0000 7fde26a00640 1 --2- 172.21.15.175:0/1422470244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde28099a50 0x7fde2806cc50 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fde2806f330 tx=0x7fde1801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cff2c205559bf11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:49.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.655+0000 7fde25600640 1 -- 172.21.15.175:0/1422470244 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde180b0070 con 0x7fde28099a50 2024-04-25T09:14:49.643 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.655+0000 7fde25600640 1 -- 172.21.15.175:0/1422470244 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde180ab600 con 0x7fde28099a50 2024-04-25T09:14:49.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.655+0000 7fde25600640 1 -- 172.21.15.175:0/1422470244 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde180ab9d0 con 0x7fde28099a50 2024-04-25T09:14:49.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.655+0000 7fde2da00640 1 -- 172.21.15.175:0/1422470244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde28099a50 msgr2=0x7fde2806cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.655+0000 7fde2da00640 1 --2- 172.21.15.175:0/1422470244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde28099a50 0x7fde2806cc50 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fde2806f330 tx=0x7fde1801c520 comp rx=0 tx=0).stop 2024-04-25T09:14:49.644 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.655+0000 7fde2da00640 1 -- 172.21.15.175:0/1422470244 shutdown_connections 2024-04-25T09:14:49.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.655+0000 7fde2da00640 1 --2- 172.21.15.175:0/1422470244 >> v2:172.21.15.177:3300/0 conn(0x7fde280d0d50 0x7fde280cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.655+0000 7fde2da00640 1 --2- 172.21.15.175:0/1422470244 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde28099a50 0x7fde2806cc50 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.655+0000 7fde2da00640 1 -- 172.21.15.175:0/1422470244 >> 172.21.15.175:0/1422470244 conn(0x7fde280b3300 msgr2=0x7fde280b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:49.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.655+0000 7fde2da00640 1 -- 172.21.15.175:0/1422470244 shutdown_connections 2024-04-25T09:14:49.645 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.655+0000 7fde2da00640 1 -- 172.21.15.175:0/1422470244 wait complete. 2024-04-25T09:14:49.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde2da00640 1 Processor -- start 2024-04-25T09:14:49.646 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde2da00640 1 -- start start 2024-04-25T09:14:49.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde2da00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde2806bd60 0x7fde2814fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde2da00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde28099a50 0x7fde280b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde2da00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde280d0d50 0x7fde28153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde2da00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2815dfe0 con 0x7fde28099a50 2024-04-25T09:14:49.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde2da00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2815de60 con 0x7fde280d0d50 2024-04-25T09:14:49.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde2da00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2816b260 con 0x7fde2806bd60 2024-04-25T09:14:49.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde26000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde28099a50 0x7fde280b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde26000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde28099a50 0x7fde280b6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45468/0 (socket says 172.21.15.175:45468) 2024-04-25T09:14:49.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde26000640 1 -- 172.21.15.175:0/3166280631 learned_addr learned my addr 172.21.15.175:0/3166280631 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:49.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde26a00640 1 --2- 172.21.15.175:0/3166280631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde2806bd60 0x7fde2814fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.648 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde27400640 1 --2- 172.21.15.175:0/3166280631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde280d0d50 0x7fde28153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde26000640 1 -- 172.21.15.175:0/3166280631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde2806bd60 msgr2=0x7fde2814fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde26000640 1 --2- 172.21.15.175:0/3166280631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde2806bd60 0x7fde2814fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde26000640 1 -- 172.21.15.175:0/3166280631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde280d0d50 msgr2=0x7fde28153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde26000640 1 --2- 172.21.15.175:0/3166280631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde280d0d50 0x7fde28153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde26000640 1 -- 172.21.15.175:0/3166280631 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde280b13c0 con 0x7fde28099a50 2024-04-25T09:14:49.649 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde26000640 1 --2- 172.21.15.175:0/3166280631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde28099a50 0x7fde280b6ea0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fde1400c3a0 tx=0x7fde1400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:49.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde1ea00640 1 -- 172.21.15.175:0/3166280631 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde140052d0 con 0x7fde28099a50 2024-04-25T09:14:49.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde1ea00640 1 -- 172.21.15.175:0/3166280631 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde14005470 con 0x7fde28099a50 2024-04-25T09:14:49.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde1ea00640 1 -- 172.21.15.175:0/3166280631 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde14007260 con 0x7fde28099a50 2024-04-25T09:14:49.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde2da00640 1 -- 172.21.15.175:0/3166280631 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde280b16a0 con 0x7fde28099a50 2024-04-25T09:14:49.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.659+0000 7fde2da00640 1 -- 172.21.15.175:0/3166280631 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde280b73e0 con 0x7fde28099a50 2024-04-25T09:14:49.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.663+0000 7fde2da00640 1 -- 172.21.15.175:0/3166280631 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde28074a60 con 0x7fde28099a50 2024-04-25T09:14:49.650 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.663+0000 7fde1ea00640 1 -- 172.21.15.175:0/3166280631 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fde14007400 con 0x7fde28099a50 2024-04-25T09:14:49.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.663+0000 7fde1ea00640 1 --2- 172.21.15.175:0/3166280631 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde08066f60 0x7fde08069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:49.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.663+0000 7fde1ea00640 1 -- 172.21.15.175:0/3166280631 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fde140840e0 con 0x7fde28099a50 2024-04-25T09:14:49.651 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.663+0000 7fde26a00640 1 --2- 172.21.15.175:0/3166280631 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde08066f60 0x7fde08069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:49.652 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.663+0000 7fde26a00640 1 --2- 172.21.15.175:0/3166280631 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde08066f60 0x7fde08069420 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fde180ad000 tx=0x7fde18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:49.655 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.667+0000 7fde1ea00640 1 -- 172.21.15.175:0/3166280631 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fde14054d80 con 0x7fde28099a50 2024-04-25T09:14:49.810 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.823+0000 7fde2da00640 1 -- 172.21.15.175:0/3166280631 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde2809aee0 con 0x7fde28099a50 2024-04-25T09:14:49.811 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.823+0000 7fde1ea00640 1 -- 172.21.15.175:0/3166280631 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+13330 (secure 0 0 0) 0x7fde14058e20 con 0x7fde28099a50 2024-04-25T09:14:49.811 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:49.811 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":118,"fsid":"8caed986-ca08-40e2-b5a5-12e2aade6223","created":"2024-04-25T09:03:44.843222+0000","modified":"2024-04-25T09:14:46.544373+0000","last_up_change":"2024-04-25T09:03:56.982154+0000","last_in_change":"2024-04-25T09:03:47.383066+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:03:57.852011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0745fb32-c2e9-448d-bdad-37261e394426","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6801","nonce":1093269849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6803","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6806","nonce":1093269849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6815","nonce":1093269849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1093269849},{"type":"v1","addr":"172.21.15.175:6811","nonce":1093269849}]},"public_addr":"172.21.15.175:6801/1093269849","cluster_addr":"172.21.15.175:6806/1093269849","heartbeat_back_addr":"172.21.15.175:6815/1093269849","heartbeat_front_addr":"172.21.15.175:6811/1093269849","state":["exists","up"]},{"osd":1,"uuid":"2e55658c-2693-49a6-b05b-589449c3a37a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6804","nonce":594808902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6805","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6807","nonce":594808902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6813","nonce":594808902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":594808902},{"type":"v1","addr":"172.21.15.175:6810","nonce":594808902}]},"public_addr":"172.21.15.175:6804/594808902","cluster_addr":"172.21.15.175:6807/594808902","heartbeat_back_addr":"172.21.15.175:6813/594808902","heartbeat_front_addr":"172.21.15.175:6810/594808902","state":["exists","up"]},{"osd":2,"uuid":"6a9d68da-55da-412f-9054-627d879d9686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6823","nonce":3247063283}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6826","nonce":3247063283}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6831","nonce":3247063283}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6827","nonce":3247063283},{"type":"v1","addr":"172.21.15.175:6829","nonce":3247063283}]},"public_addr":"172.21.15.175:6823/3247063283","cluster_addr":"172.21.15.175:6826/3247063283","heartbeat_back_addr":"172.21.15.175:6831/3247063283","heartbeat_front_addr":"172.21.15.175:6829/3247063283","state":["exists","up"]},{"osd":3,"uuid":"56d615ab-66a8-4730-bd43-25c1d1d76b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6817","nonce":4078277957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6819","nonce":4078277957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6828","nonce":4078277957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":4078277957},{"type":"v1","addr":"172.21.15.175:6822","nonce":4078277957}]},"public_addr":"172.21.15.175:6817/4078277957","cluster_addr":"172.21.15.175:6819/4078277957","heartbeat_back_addr":"172.21.15.175:6828/4078277957","heartbeat_front_addr":"172.21.15.175:6822/4078277957","state":["exists","up"]},{"osd":4,"uuid":"7900a8ee-9817-4cfe-900d-6cee224d1472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6809","nonce":236493968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6811","nonce":236493968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6815","nonce":236493968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":236493968},{"type":"v1","addr":"172.21.15.177:6813","nonce":236493968}]},"public_addr":"172.21.15.177:6809/236493968","cluster_addr":"172.21.15.177:6811/236493968","heartbeat_back_addr":"172.21.15.177:6815/236493968","heartbeat_front_addr":"172.21.15.177:6813/236493968","state":["exists","up"]},{"osd":5,"uuid":"4ff0c873-8046-4eaf-a5d1-d18b0d5b52fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6817","nonce":3311807078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6819","nonce":3311807078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6823","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6825","nonce":3311807078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3311807078},{"type":"v1","addr":"172.21.15.177:6821","nonce":3311807078}]},"public_addr":"172.21.15.177:6817/3311807078","cluster_addr":"172.21.15.177:6819/3311807078","heartbeat_back_addr":"172.21.15.177:6825/3311807078","heartbeat_front_addr":"172.21.15.177:6821/3311807078","state":["exists","up"]},{"osd":6,"uuid":"af876c6d-e1a3-41fc-98ec-c69d63c38e1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6824","nonce":4132808595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6827","nonce":4132808595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6831","nonce":4132808595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":4132808595},{"type":"v1","addr":"172.21.15.177:6829","nonce":4132808595}]},"public_addr":"172.21.15.177:6824/4132808595","cluster_addr":"172.21.15.177:6827/4132808595","heartbeat_back_addr":"172.21.15.177:6831/4132808595","heartbeat_front_addr":"172.21.15.177:6829/4132808595","state":["exists","up"]},{"osd":7,"uuid":"cd2847a7-6ddb-4bee-9011-f15f7d592435","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6801","nonce":3881136076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6803","nonce":3881136076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6807","nonce":3881136076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3881136076},{"type":"v1","addr":"172.21.15.177:6805","nonce":3881136076}]},"public_addr":"172.21.15.177:6801/3881136076","cluster_addr":"172.21.15.177:6803/3881136076","heartbeat_back_addr":"172.21.15.177:6807/3881136076","heartbeat_front_addr":"172.21.15.177:6805/3881136076","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.001992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.000312+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.166418+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.048221+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.110234+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.191961+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:53.178720+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:03:52.939476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6834/4159793972":"2024-04-26T09:14:43.529224+0000","172.21.15.175:6836/4159793972":"2024-04-26T09:14:43.529224+0000","172.21.15.175:6836/386187898":"2024-04-26T09:14:28.999694+0000","172.21.15.175:6836/4128642659":"2024-04-26T09:14:18.106892+0000","172.21.15.175:6834/386187898":"2024-04-26T09:14:28.999694+0000","172.21.15.175:6834/4128642659":"2024-04-26T09:14:18.106892+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:14:49.813 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.823+0000 7fde2da00640 1 -- 172.21.15.175:0/3166280631 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde08066f60 msgr2=0x7fde08069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.813 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.823+0000 7fde2da00640 1 --2- 172.21.15.175:0/3166280631 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde08066f60 0x7fde08069420 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fde180ad000 tx=0x7fde18008040 comp rx=0 tx=0).stop 2024-04-25T09:14:49.813 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.823+0000 7fde2da00640 1 -- 172.21.15.175:0/3166280631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde28099a50 msgr2=0x7fde280b6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:49.813 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.823+0000 7fde2da00640 1 --2- 172.21.15.175:0/3166280631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde28099a50 0x7fde280b6ea0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fde1400c3a0 tx=0x7fde1400c860 comp rx=0 tx=0).stop 2024-04-25T09:14:49.813 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.823+0000 7fde2da00640 1 -- 172.21.15.175:0/3166280631 shutdown_connections 2024-04-25T09:14:49.813 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.823+0000 7fde2da00640 1 --2- 172.21.15.175:0/3166280631 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fde08066f60 0x7fde08069420 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.813 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.823+0000 7fde2da00640 1 --2- 172.21.15.175:0/3166280631 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde280d0d50 0x7fde28153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.823+0000 7fde2da00640 1 --2- 172.21.15.175:0/3166280631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde28099a50 0x7fde280b6ea0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.823+0000 7fde2da00640 1 --2- 172.21.15.175:0/3166280631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde2806bd60 0x7fde2814fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:49.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.823+0000 7fde2da00640 1 -- 172.21.15.175:0/3166280631 >> 172.21.15.175:0/3166280631 conn(0x7fde280b3300 msgr2=0x7fde280741d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:49.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.823+0000 7fde2da00640 1 -- 172.21.15.175:0/3166280631 shutdown_connections 2024-04-25T09:14:49.814 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:49.823+0000 7fde2da00640 1 -- 172.21.15.175:0/3166280631 wait complete. 2024-04-25T09:14:50.834 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T09:14:50.834 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:14:50.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:50.995+0000 7efd27000640 1 Processor -- start 2024-04-25T09:14:50.984 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:50.995+0000 7efd27000640 1 -- start start 2024-04-25T09:14:50.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:50.999+0000 7efd27000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efd200cfb60 0x7efd200ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:50.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:50.999+0000 7efd27000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd200ced10 0x7efd200712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:50.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:50.999+0000 7efd27000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd20071e20 con 0x7efd200717f0 2024-04-25T09:14:50.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:50.999+0000 7efd27000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd200cbed0 con 0x7efd200ced10 2024-04-25T09:14:50.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:50.999+0000 7efd27000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd20072100 con 0x7efd200cfb60 2024-04-25T09:14:50.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:50.999+0000 7efd17400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd200ced10 0x7efd200712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:50.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:50.999+0000 7efd17400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd200ced10 0x7efd200712b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45472/0 (socket says 172.21.15.175:45472) 2024-04-25T09:14:50.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:50.999+0000 7efd17400640 1 -- 172.21.15.175:0/1999175698 learned_addr learned my addr 172.21.15.175:0/1999175698 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:50.986 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:50.999+0000 7efd1fe00640 1 --2- 172.21.15.175:0/1999175698 >> v2:172.21.15.177:3300/0 conn(0x7efd200cfb60 0x7efd200ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:50.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:50.999+0000 7efd17400640 1 -- 172.21.15.175:0/1999175698 >> v2:172.21.15.177:3300/0 conn(0x7efd200cfb60 msgr2=0x7efd200ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:50.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:50.999+0000 7efd17400640 1 --2- 172.21.15.175:0/1999175698 >> v2:172.21.15.177:3300/0 conn(0x7efd200cfb60 0x7efd200ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:50.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:50.999+0000 7efd17400640 1 -- 172.21.15.175:0/1999175698 >> v1:172.21.15.177:6789/0 conn(0x7efd200717f0 legacy=0x7efd2006d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:50.987 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:50.999+0000 7efd17400640 1 -- 172.21.15.175:0/1999175698 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd200cc120 con 0x7efd200ced10 2024-04-25T09:14:50.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd17400640 1 --2- 172.21.15.175:0/1999175698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd200ced10 0x7efd200712b0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7efd2006d120 tx=0x7efd0801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43b5c607971e20d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:50.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd1f400640 1 -- 172.21.15.175:0/1999175698 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd080b1070 con 0x7efd200ced10 2024-04-25T09:14:50.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd1f400640 1 -- 172.21.15.175:0/1999175698 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd080ac600 con 0x7efd200ced10 2024-04-25T09:14:50.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd1f400640 1 -- 172.21.15.175:0/1999175698 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd080ac9d0 con 0x7efd200ced10 2024-04-25T09:14:50.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd27000640 1 -- 172.21.15.175:0/1999175698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd200ced10 msgr2=0x7efd200712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:50.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd27000640 1 --2- 172.21.15.175:0/1999175698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd200ced10 0x7efd200712b0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7efd2006d120 tx=0x7efd0801c490 comp rx=0 tx=0).stop 2024-04-25T09:14:50.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd27000640 1 -- 172.21.15.175:0/1999175698 shutdown_connections 2024-04-25T09:14:50.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd27000640 1 --2- 172.21.15.175:0/1999175698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd200ced10 0x7efd200712b0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:50.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd27000640 1 --2- 172.21.15.175:0/1999175698 >> v2:172.21.15.177:3300/0 conn(0x7efd200cfb60 0x7efd200ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:50.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd27000640 1 -- 172.21.15.175:0/1999175698 >> 172.21.15.175:0/1999175698 conn(0x7efd2006ac50 msgr2=0x7efd2006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:50.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd27000640 1 -- 172.21.15.175:0/1999175698 shutdown_connections 2024-04-25T09:14:50.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd27000640 1 -- 172.21.15.175:0/1999175698 wait complete. 2024-04-25T09:14:50.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd27000640 1 Processor -- start 2024-04-25T09:14:50.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd27000640 1 -- start start 2024-04-25T09:14:50.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd27000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd200717f0 0x7efd2013cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:50.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd27000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd200ced10 0x7efd201561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:50.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd27000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd200cfb60 0x7efd201566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:50.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd27000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd200cd2b0 con 0x7efd200717f0 2024-04-25T09:14:50.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd27000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd200cd130 con 0x7efd200ced10 2024-04-25T09:14:50.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.003+0000 7efd27000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2006df70 con 0x7efd200cfb60 2024-04-25T09:14:50.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd1fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd200717f0 0x7efd2013cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:50.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd1fe00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd200717f0 0x7efd2013cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45480/0 (socket says 172.21.15.175:45480) 2024-04-25T09:14:50.994 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd1fe00640 1 -- 172.21.15.175:0/4033271743 learned_addr learned my addr 172.21.15.175:0/4033271743 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:50.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd1fe00640 1 -- 172.21.15.175:0/4033271743 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd200cfb60 msgr2=0x7efd201566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:50.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd1fe00640 1 --2- 172.21.15.175:0/4033271743 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd200cfb60 0x7efd201566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:50.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd1fe00640 1 -- 172.21.15.175:0/4033271743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd200ced10 msgr2=0x7efd201561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:50.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd17400640 1 --2- 172.21.15.175:0/4033271743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd200ced10 0x7efd201561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:50.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd1fe00640 1 --2- 172.21.15.175:0/4033271743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd200ced10 0x7efd201561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:50.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd1fe00640 1 -- 172.21.15.175:0/4033271743 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd200b33b0 con 0x7efd200717f0 2024-04-25T09:14:50.995 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd17400640 1 --2- 172.21.15.175:0/4033271743 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd200ced10 0x7efd201561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:50.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd1fe00640 1 --2- 172.21.15.175:0/4033271743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd200717f0 0x7efd2013cfb0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7efd1000e8a0 tx=0x7efd1000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:50.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd1cc00640 1 -- 172.21.15.175:0/4033271743 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd10017070 con 0x7efd200717f0 2024-04-25T09:14:50.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd1cc00640 1 -- 172.21.15.175:0/4033271743 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1000c940 con 0x7efd200717f0 2024-04-25T09:14:50.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd27000640 1 -- 172.21.15.175:0/4033271743 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd200b3690 con 0x7efd200717f0 2024-04-25T09:14:50.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd1cc00640 1 -- 172.21.15.175:0/4033271743 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1000ccf0 con 0x7efd200717f0 2024-04-25T09:14:50.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd27000640 1 -- 172.21.15.175:0/4033271743 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd200b3c50 con 0x7efd200717f0 2024-04-25T09:14:50.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd27000640 1 -- 172.21.15.175:0/4033271743 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd200b4030 con 0x7efd200717f0 2024-04-25T09:14:50.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd1cc00640 1 -- 172.21.15.175:0/4033271743 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efd1001a070 con 0x7efd200717f0 2024-04-25T09:14:50.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.007+0000 7efd1cc00640 1 --2- 172.21.15.175:0/4033271743 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efcfc066f60 0x7efcfc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:50.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.011+0000 7efd1cc00640 1 -- 172.21.15.175:0/4033271743 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7efd10084ff0 con 0x7efd200717f0 2024-04-25T09:14:50.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.011+0000 7efd1cc00640 1 --2- 172.21.15.175:0/4033271743 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x7efcfc06cf60 0x7efcfc06f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:50.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.011+0000 7efd17400640 1 --2- 172.21.15.175:0/4033271743 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efcfc066f60 0x7efcfc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:50.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.011+0000 7efd1cc00640 1 -- 172.21.15.175:0/4033271743 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd1000ce90 con 0x7efcfc06cf60 2024-04-25T09:14:50.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.011+0000 7efd1cc00640 1 -- 172.21.15.175:0/4033271743 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd1008c050 con 0x7efd200717f0 2024-04-25T09:14:50.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.011+0000 7efd25000640 1 --2- 172.21.15.175:0/4033271743 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x7efcfc06cf60 0x7efcfc06f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:50.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.011+0000 7efd17400640 1 --2- 172.21.15.175:0/4033271743 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efcfc066f60 0x7efcfc069420 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7efd080ae000 tx=0x7efd08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:50.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.011+0000 7efd25000640 1 --2- 172.21.15.175:0/4033271743 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x7efcfc06cf60 0x7efcfc06f380 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:50.999 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.011+0000 7efd1cc00640 1 -- 172.21.15.175:0/4033271743 <== osd.0 v2:172.21.15.175:6800/1093269849 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7efd1000ce90 con 0x7efcfc06cf60 2024-04-25T09:14:51.011 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.023+0000 7efd27000640 1 -- 172.21.15.175:0/4033271743 --> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efd20075160 con 0x7efcfc06cf60 2024-04-25T09:14:51.012 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.023+0000 7efd1cc00640 1 -- 172.21.15.175:0/4033271743 <== osd.0 v2:172.21.15.175:6800/1093269849 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efd20075160 con 0x7efcfc06cf60 2024-04-25T09:14:51.012 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:14:51.012 INFO:teuthology.orchestra.run.smithi175.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:14:51.012 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:14:51.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.023+0000 7efd27000640 1 -- 172.21.15.175:0/4033271743 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x7efcfc06cf60 msgr2=0x7efcfc06f380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.023+0000 7efd27000640 1 --2- 172.21.15.175:0/4033271743 >> [v2:172.21.15.175:6800/1093269849,v1:172.21.15.175:6801/1093269849] conn(0x7efcfc06cf60 0x7efcfc06f380 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.023+0000 7efd27000640 1 -- 172.21.15.175:0/4033271743 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efcfc066f60 msgr2=0x7efcfc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.023+0000 7efd27000640 1 --2- 172.21.15.175:0/4033271743 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7efcfc066f60 0x7efcfc069420 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7efd080ae000 tx=0x7efd08008040 comp rx=0 tx=0).stop 2024-04-25T09:14:51.013 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.023+0000 7efd27000640 1 -- 172.21.15.175:0/4033271743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd200717f0 msgr2=0x7efd2013cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.023+0000 7efd27000640 1 --2- 172.21.15.175:0/4033271743 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd200717f0 0x7efd2013cfb0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7efd1000e8a0 tx=0x7efd1000eca0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.023+0000 7efd25000640 1 -- 172.21.15.175:0/4033271743 reap_dead start 2024-04-25T09:14:51.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.023+0000 7efd27000640 1 -- 172.21.15.175:0/4033271743 shutdown_connections 2024-04-25T09:14:51.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.023+0000 7efd27000640 1 -- 172.21.15.175:0/4033271743 >> 172.21.15.175:0/4033271743 conn(0x7efd2006ac50 msgr2=0x7efd200ae6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:51.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.023+0000 7efd27000640 1 -- 172.21.15.175:0/4033271743 shutdown_connections 2024-04-25T09:14:51.014 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.023+0000 7efd27000640 1 -- 172.21.15.175:0/4033271743 wait complete. 2024-04-25T09:14:51.031 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T09:14:51.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.179+0000 7f5ccae00640 1 Processor -- start 2024-04-25T09:14:51.167 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.179+0000 7f5ccae00640 1 -- start start 2024-04-25T09:14:51.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.179+0000 7f5ccae00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc4145250 0x7f5cc40cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:51.168 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.179+0000 7f5ccae00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc40cfd10 con 0x7f5cc40ce970 2024-04-25T09:14:51.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.179+0000 7f5ccae00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc40cfff0 con 0x7f5cc41600a0 2024-04-25T09:14:51.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.179+0000 7f5ccae00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc415f650 con 0x7f5cc4145250 2024-04-25T09:14:51.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.179+0000 7f5cc8e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5cc40ce970 0x7f5cc40cee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59946/0 (socket says 172.21.15.175:59946) 2024-04-25T09:14:51.169 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.179+0000 7f5cc8e00640 1 -- 172.21.15.175:0/121151740 learned_addr learned my addr 172.21.15.175:0/121151740 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:51.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.179+0000 7f5cc3e00640 1 --2- 172.21.15.175:0/121151740 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc4145250 0x7f5cc40cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:51.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.183+0000 7f5cc3400640 1 -- 172.21.15.175:0/121151740 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842010656 0 0) 0x7f5cc40cfd10 con 0x7f5cc40ce970 2024-04-25T09:14:51.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.183+0000 7f5cc3400640 1 -- 172.21.15.175:0/121151740 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ca8003530 con 0x7f5cc40ce970 2024-04-25T09:14:51.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.183+0000 7f5cc3400640 1 -- 172.21.15.175:0/121151740 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646515578 0 0) 0x7f5cc40cfff0 con 0x7f5cc41600a0 2024-04-25T09:14:51.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.183+0000 7f5cc3400640 1 -- 172.21.15.175:0/121151740 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cc40cfd10 con 0x7f5cc41600a0 2024-04-25T09:14:51.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.183+0000 7f5cc3e00640 1 -- 172.21.15.175:0/121151740 >> v1:172.21.15.177:6789/0 conn(0x7f5cc41600a0 legacy=0x7f5cc40cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.183+0000 7f5cc3400640 1 -- 172.21.15.175:0/121151740 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2089470914 0 0) 0x7f5ca8003530 con 0x7f5cc40ce970 2024-04-25T09:14:51.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.183+0000 7f5cc3e00640 1 -- 172.21.15.175:0/121151740 >> v1:172.21.15.175:6789/0 conn(0x7f5cc40ce970 legacy=0x7f5cc40cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.170 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.183+0000 7f5cc3e00640 1 -- 172.21.15.175:0/121151740 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc415f8a0 con 0x7f5cc4145250 2024-04-25T09:14:51.172 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.183+0000 7f5cc3e00640 1 --2- 172.21.15.175:0/121151740 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc4145250 0x7f5cc40cf6b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5cb40097f0 tx=0x7f5cb401c2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff3c4a7da18fda5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:51.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.183+0000 7f5cc3400640 1 -- 172.21.15.175:0/121151740 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb40b0070 con 0x7f5cc4145250 2024-04-25T09:14:51.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.183+0000 7f5cc3400640 1 -- 172.21.15.175:0/121151740 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb40ab400 con 0x7f5cc4145250 2024-04-25T09:14:51.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.183+0000 7f5cc3400640 1 -- 172.21.15.175:0/121151740 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc001a00 con 0x7f5cc4145250 2024-04-25T09:14:51.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5ccae00640 1 -- 172.21.15.175:0/121151740 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc4145250 msgr2=0x7f5cc40cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.173 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5ccae00640 1 --2- 172.21.15.175:0/121151740 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc4145250 0x7f5cc40cf6b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5cb40097f0 tx=0x7f5cb401c2b0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5ccae00640 1 -- 172.21.15.175:0/121151740 shutdown_connections 2024-04-25T09:14:51.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5ccae00640 1 --2- 172.21.15.175:0/121151740 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc4145250 0x7f5cc40cf6b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5ccae00640 1 -- 172.21.15.175:0/121151740 >> 172.21.15.175:0/121151740 conn(0x7f5cc406ac50 msgr2=0x7f5cc406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:51.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5ccae00640 1 -- 172.21.15.175:0/121151740 shutdown_connections 2024-04-25T09:14:51.174 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5ccae00640 1 -- 172.21.15.175:0/121151740 wait complete. 2024-04-25T09:14:51.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5ccae00640 1 Processor -- start 2024-04-25T09:14:51.175 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5ccae00640 1 -- start start 2024-04-25T09:14:51.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5ccae00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cc40ce970 0x7f5cc4157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:51.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5ccae00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc4145250 0x7f5cc415e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:51.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5ccae00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc41600a0 0x7f5cc4143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:51.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5ccae00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc415c9f0 con 0x7f5cc41600a0 2024-04-25T09:14:51.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5ccae00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc415c870 con 0x7f5cc40ce970 2024-04-25T09:14:51.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5ccae00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc415cb70 con 0x7f5cc4145250 2024-04-25T09:14:51.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5cc8e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc41600a0 0x7f5cc4143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:51.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5cc3e00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cc40ce970 0x7f5cc4157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:51.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5cc8e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc41600a0 0x7f5cc4143130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45494/0 (socket says 172.21.15.175:45494) 2024-04-25T09:14:51.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5cc8e00640 1 -- 172.21.15.175:0/1073323117 learned_addr learned my addr 172.21.15.175:0/1073323117 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:51.178 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.187+0000 7f5cbb400640 1 --2- 172.21.15.175:0/1073323117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc4145250 0x7f5cc415e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:51.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.191+0000 7f5cc8e00640 1 -- 172.21.15.175:0/1073323117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc4145250 msgr2=0x7f5cc415e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.191+0000 7f5cc8e00640 1 --2- 172.21.15.175:0/1073323117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc4145250 0x7f5cc415e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.191+0000 7f5cc8e00640 1 -- 172.21.15.175:0/1073323117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cc40ce970 msgr2=0x7f5cc4157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.191+0000 7f5cc8e00640 1 --2- 172.21.15.175:0/1073323117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cc40ce970 0x7f5cc4157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.191+0000 7f5cc8e00640 1 -- 172.21.15.175:0/1073323117 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc41581b0 con 0x7f5cc41600a0 2024-04-25T09:14:51.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.191+0000 7f5cc8e00640 1 --2- 172.21.15.175:0/1073323117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc41600a0 0x7f5cc4143130 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00cc20 tx=0x7f5cbc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:51.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.191+0000 7f5cc0c00640 1 -- 172.21.15.175:0/1073323117 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc00ce30 con 0x7f5cc41600a0 2024-04-25T09:14:51.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.191+0000 7f5cc0c00640 1 -- 172.21.15.175:0/1073323117 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cbc012400 con 0x7f5cc41600a0 2024-04-25T09:14:51.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.191+0000 7f5cc0c00640 1 -- 172.21.15.175:0/1073323117 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc012830 con 0x7f5cc41600a0 2024-04-25T09:14:51.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.191+0000 7f5ccae00640 1 -- 172.21.15.175:0/1073323117 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc40a8750 con 0x7f5cc41600a0 2024-04-25T09:14:51.179 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.191+0000 7f5ccae00640 1 -- 172.21.15.175:0/1073323117 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc40b2a40 con 0x7f5cc41600a0 2024-04-25T09:14:51.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.191+0000 7f5ccae00640 1 -- 172.21.15.175:0/1073323117 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc4075160 con 0x7f5cc41600a0 2024-04-25T09:14:51.180 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.191+0000 7f5cc0c00640 1 -- 172.21.15.175:0/1073323117 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5cbc0129d0 con 0x7f5cc41600a0 2024-04-25T09:14:51.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.191+0000 7f5cc0c00640 1 --2- 172.21.15.175:0/1073323117 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ca0066f90 0x7f5ca0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:51.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.191+0000 7f5cc0c00640 1 -- 172.21.15.175:0/1073323117 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f5cbc085420 con 0x7f5cc41600a0 2024-04-25T09:14:51.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.195+0000 7f5cc3e00640 1 --2- 172.21.15.175:0/1073323117 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ca0066f90 0x7f5ca0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:51.181 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.195+0000 7f5cc3e00640 1 --2- 172.21.15.175:0/1073323117 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ca0066f90 0x7f5ca0069450 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f5cb40ad000 tx=0x7f5cb40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:51.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.199+0000 7f5cc0c00640 1 -- 172.21.15.175:0/1073323117 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5cbc056030 con 0x7f5cc41600a0 2024-04-25T09:14:51.339 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.351+0000 7f5ccae00640 1 -- 172.21.15.175:0/1073323117 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cc40cc300 con 0x7f5ca0066f90 2024-04-25T09:14:51.340 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.351+0000 7f5cc0c00640 1 -- 172.21.15.175:0/1073323117 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5cc40cc300 con 0x7f5ca0066f90 2024-04-25T09:14:51.340 INFO:teuthology.orchestra.run.smithi175.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T09:14:51.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.355+0000 7f5ccae00640 1 -- 172.21.15.175:0/1073323117 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ca0066f90 msgr2=0x7f5ca0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.355+0000 7f5ccae00640 1 --2- 172.21.15.175:0/1073323117 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ca0066f90 0x7f5ca0069450 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f5cb40ad000 tx=0x7f5cb40a6000 comp rx=0 tx=0).stop 2024-04-25T09:14:51.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.355+0000 7f5ccae00640 1 -- 172.21.15.175:0/1073323117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc41600a0 msgr2=0x7f5cc4143130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.355+0000 7f5ccae00640 1 --2- 172.21.15.175:0/1073323117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc41600a0 0x7f5cc4143130 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00cc20 tx=0x7f5cbc00a430 comp rx=0 tx=0).stop 2024-04-25T09:14:51.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.355+0000 7f5ccae00640 1 -- 172.21.15.175:0/1073323117 shutdown_connections 2024-04-25T09:14:51.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.355+0000 7f5ccae00640 1 --2- 172.21.15.175:0/1073323117 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5ca0066f90 0x7f5ca0069450 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.355+0000 7f5ccae00640 1 --2- 172.21.15.175:0/1073323117 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5cc41600a0 0x7f5cc4143130 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.355+0000 7f5ccae00640 1 --2- 172.21.15.175:0/1073323117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5cc4145250 0x7f5cc415e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.342 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.355+0000 7f5ccae00640 1 --2- 172.21.15.175:0/1073323117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5cc40ce970 0x7f5cc4157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.355+0000 7f5ccae00640 1 -- 172.21.15.175:0/1073323117 >> 172.21.15.175:0/1073323117 conn(0x7f5cc406ac50 msgr2=0x7f5cc40b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:51.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.355+0000 7f5ccae00640 1 -- 172.21.15.175:0/1073323117 shutdown_connections 2024-04-25T09:14:51.343 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.355+0000 7f5ccae00640 1 -- 172.21.15.175:0/1073323117 wait complete. 2024-04-25T09:14:51.361 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T09:14:51.361 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:14:51.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.511+0000 7f3c96200640 1 Processor -- start 2024-04-25T09:14:51.500 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.511+0000 7f3c96200640 1 -- start start 2024-04-25T09:14:51.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.511+0000 7f3c96200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c900aebd0 0x7f3c9015b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:51.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.511+0000 7f3c96200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3c900b2700 0x7f3c900b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:51.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.511+0000 7f3c96200640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c900b4be0 con 0x7f3c900b47a0 2024-04-25T09:14:51.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.511+0000 7f3c96200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c9015b880 con 0x7f3c900b2700 2024-04-25T09:14:51.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.511+0000 7f3c96200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9015bb60 con 0x7f3c900aebd0 2024-04-25T09:14:51.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.515+0000 7f3c8fe00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f3c900b47a0 0x7f3c9006d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59950/0 (socket says 172.21.15.175:59950) 2024-04-25T09:14:51.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.515+0000 7f3c8fe00640 1 -- 172.21.15.175:0/3957804915 learned_addr learned my addr 172.21.15.175:0/3957804915 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:51.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.515+0000 7f3c86a00640 1 --2- 172.21.15.175:0/3957804915 >> v2:172.21.15.177:3300/0 conn(0x7f3c900b2700 0x7f3c900b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:51.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.515+0000 7f3c8f400640 1 --2- 172.21.15.175:0/3957804915 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c900aebd0 0x7f3c9015b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:51.502 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.515+0000 7f3c8ea00640 1 -- 172.21.15.175:0/3957804915 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605017086 0 0) 0x7f3c900b4be0 con 0x7f3c900b47a0 2024-04-25T09:14:51.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.515+0000 7f3c8ea00640 1 -- 172.21.15.175:0/3957804915 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c74003530 con 0x7f3c900b47a0 2024-04-25T09:14:51.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.515+0000 7f3c86a00640 1 -- 172.21.15.175:0/3957804915 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c900aebd0 msgr2=0x7f3c9015b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:51.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.515+0000 7f3c86a00640 1 --2- 172.21.15.175:0/3957804915 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c900aebd0 0x7f3c9015b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.515+0000 7f3c86a00640 1 -- 172.21.15.175:0/3957804915 >> v1:172.21.15.175:6789/0 conn(0x7f3c900b47a0 legacy=0x7f3c9006d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.515+0000 7f3c86a00640 1 -- 172.21.15.175:0/3957804915 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9015be40 con 0x7f3c900b2700 2024-04-25T09:14:51.503 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.515+0000 7f3c8f400640 1 --2- 172.21.15.175:0/3957804915 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c900aebd0 0x7f3c9015b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:51.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.515+0000 7f3c86a00640 1 --2- 172.21.15.175:0/3957804915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c900b2700 0x7f3c900b4260 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3c780097c0 tx=0x7f3c7801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b23df91f3c81cc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:51.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c8ea00640 1 -- 172.21.15.175:0/3957804915 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c780b0070 con 0x7f3c900b2700 2024-04-25T09:14:51.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c8ea00640 1 -- 172.21.15.175:0/3957804915 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c780ab600 con 0x7f3c900b2700 2024-04-25T09:14:51.505 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c8ea00640 1 -- 172.21.15.175:0/3957804915 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c780ab9d0 con 0x7f3c900b2700 2024-04-25T09:14:51.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c96200640 1 -- 172.21.15.175:0/3957804915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c900b2700 msgr2=0x7f3c900b4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c96200640 1 --2- 172.21.15.175:0/3957804915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c900b2700 0x7f3c900b4260 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3c780097c0 tx=0x7f3c7801c410 comp rx=0 tx=0).stop 2024-04-25T09:14:51.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c96200640 1 -- 172.21.15.175:0/3957804915 shutdown_connections 2024-04-25T09:14:51.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c96200640 1 --2- 172.21.15.175:0/3957804915 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c900b2700 0x7f3c900b4260 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c96200640 1 --2- 172.21.15.175:0/3957804915 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c900aebd0 0x7f3c9015b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c96200640 1 -- 172.21.15.175:0/3957804915 >> 172.21.15.175:0/3957804915 conn(0x7f3c9006ac50 msgr2=0x7f3c9006b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:51.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c96200640 1 -- 172.21.15.175:0/3957804915 shutdown_connections 2024-04-25T09:14:51.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c96200640 1 -- 172.21.15.175:0/3957804915 wait complete. 2024-04-25T09:14:51.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c96200640 1 Processor -- start 2024-04-25T09:14:51.507 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c96200640 1 -- start start 2024-04-25T09:14:51.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c96200640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c900aebd0 0x7f3c901522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:51.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c96200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c900b2700 0x7f3c901595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:51.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c96200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c900b47a0 0x7f3c900cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:51.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c96200640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c901677f0 con 0x7f3c900aebd0 2024-04-25T09:14:51.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c96200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c90167670 con 0x7f3c900b47a0 2024-04-25T09:14:51.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c96200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c90167970 con 0x7f3c900b2700 2024-04-25T09:14:51.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c8f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c900aebd0 0x7f3c901522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:51.510 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c8f400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c900aebd0 0x7f3c901522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45508/0 (socket says 172.21.15.175:45508) 2024-04-25T09:14:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c8f400640 1 -- 172.21.15.175:0/4115431722 learned_addr learned my addr 172.21.15.175:0/4115431722 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c86a00640 1 --2- 172.21.15.175:0/4115431722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c900b2700 0x7f3c901595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c8fe00640 1 --2- 172.21.15.175:0/4115431722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c900b47a0 0x7f3c900cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c8f400640 1 -- 172.21.15.175:0/4115431722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c900b2700 msgr2=0x7f3c901595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c8f400640 1 --2- 172.21.15.175:0/4115431722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c900b2700 0x7f3c901595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.519+0000 7f3c8f400640 1 -- 172.21.15.175:0/4115431722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c900b47a0 msgr2=0x7f3c900cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.523+0000 7f3c8f400640 1 --2- 172.21.15.175:0/4115431722 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c900b47a0 0x7f3c900cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.523+0000 7f3c8f400640 1 -- 172.21.15.175:0/4115431722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c901527e0 con 0x7f3c900aebd0 2024-04-25T09:14:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.523+0000 7f3c86a00640 1 --2- 172.21.15.175:0/4115431722 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c900b2700 0x7f3c901595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.523+0000 7f3c8f400640 1 --2- 172.21.15.175:0/4115431722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c900aebd0 0x7f3c901522a0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000efc0 tx=0x7f3c8000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.523+0000 7f3c87e00640 1 -- 172.21.15.175:0/4115431722 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c80018020 con 0x7f3c900aebd0 2024-04-25T09:14:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.523+0000 7f3c87e00640 1 -- 172.21.15.175:0/4115431722 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c80014680 con 0x7f3c900aebd0 2024-04-25T09:14:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.523+0000 7f3c96200640 1 -- 172.21.15.175:0/4115431722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c900adb30 con 0x7f3c900aebd0 2024-04-25T09:14:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.523+0000 7f3c87e00640 1 -- 172.21.15.175:0/4115431722 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c80014a50 con 0x7f3c900aebd0 2024-04-25T09:14:51.511 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.523+0000 7f3c96200640 1 -- 172.21.15.175:0/4115431722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c900ae0f0 con 0x7f3c900aebd0 2024-04-25T09:14:51.512 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.523+0000 7f3c96200640 1 -- 172.21.15.175:0/4115431722 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c90075160 con 0x7f3c900aebd0 2024-04-25T09:14:51.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.523+0000 7f3c87e00640 1 -- 172.21.15.175:0/4115431722 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3c8001b020 con 0x7f3c900aebd0 2024-04-25T09:14:51.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.523+0000 7f3c87e00640 1 --2- 172.21.15.175:0/4115431722 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c6c066f60 0x7f3c6c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:51.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.523+0000 7f3c87e00640 1 -- 172.21.15.175:0/4115431722 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f3c800864d0 con 0x7f3c900aebd0 2024-04-25T09:14:51.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.523+0000 7f3c87e00640 1 --2- 172.21.15.175:0/4115431722 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x7f3c6c06cf60 0x7f3c6c06f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:51.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.523+0000 7f3c87e00640 1 -- 172.21.15.175:0/4115431722 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c6c06fa30 con 0x7f3c6c06cf60 2024-04-25T09:14:51.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.523+0000 7f3c86a00640 1 --2- 172.21.15.175:0/4115431722 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c6c066f60 0x7f3c6c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:51.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.523+0000 7f3c87e00640 1 -- 172.21.15.175:0/4115431722 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c80086880 con 0x7f3c900aebd0 2024-04-25T09:14:51.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.523+0000 7f3c8fe00640 1 --2- 172.21.15.175:0/4115431722 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x7f3c6c06cf60 0x7f3c6c06f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:51.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.527+0000 7f3c86a00640 1 --2- 172.21.15.175:0/4115431722 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c6c066f60 0x7f3c6c069420 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f3c780ad000 tx=0x7f3c78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:51.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.527+0000 7f3c8fe00640 1 --2- 172.21.15.175:0/4115431722 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x7f3c6c06cf60 0x7f3c6c06f380 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:51.514 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.527+0000 7f3c87e00640 1 -- 172.21.15.175:0/4115431722 <== osd.1 v2:172.21.15.175:6802/594808902 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3c6c06fa30 con 0x7f3c6c06cf60 2024-04-25T09:14:51.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.539+0000 7f3c96200640 1 -- 172.21.15.175:0/4115431722 --> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3c90164e90 con 0x7f3c6c06cf60 2024-04-25T09:14:51.527 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.539+0000 7f3c87e00640 1 -- 172.21.15.175:0/4115431722 <== osd.1 v2:172.21.15.175:6802/594808902 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3c90164e90 con 0x7f3c6c06cf60 2024-04-25T09:14:51.527 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:14:51.527 INFO:teuthology.orchestra.run.smithi175.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:14:51.528 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:14:51.528 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.539+0000 7f3c96200640 1 -- 172.21.15.175:0/4115431722 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x7f3c6c06cf60 msgr2=0x7f3c6c06f380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.539+0000 7f3c96200640 1 --2- 172.21.15.175:0/4115431722 >> [v2:172.21.15.175:6802/594808902,v1:172.21.15.175:6804/594808902] conn(0x7f3c6c06cf60 0x7f3c6c06f380 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.539+0000 7f3c96200640 1 -- 172.21.15.175:0/4115431722 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c6c066f60 msgr2=0x7f3c6c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.539+0000 7f3c96200640 1 --2- 172.21.15.175:0/4115431722 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f3c6c066f60 0x7f3c6c069420 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f3c780ad000 tx=0x7f3c78008040 comp rx=0 tx=0).stop 2024-04-25T09:14:51.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.539+0000 7f3c96200640 1 -- 172.21.15.175:0/4115431722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c900aebd0 msgr2=0x7f3c901522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.539+0000 7f3c96200640 1 --2- 172.21.15.175:0/4115431722 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c900aebd0 0x7f3c901522a0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000efc0 tx=0x7f3c8000c490 comp rx=0 tx=0).stop 2024-04-25T09:14:51.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.539+0000 7f3c8fe00640 1 -- 172.21.15.175:0/4115431722 reap_dead start 2024-04-25T09:14:51.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.539+0000 7f3c96200640 1 -- 172.21.15.175:0/4115431722 shutdown_connections 2024-04-25T09:14:51.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.539+0000 7f3c96200640 1 -- 172.21.15.175:0/4115431722 >> 172.21.15.175:0/4115431722 conn(0x7f3c9006ac50 msgr2=0x7f3c9006b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:51.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.539+0000 7f3c96200640 1 -- 172.21.15.175:0/4115431722 shutdown_connections 2024-04-25T09:14:51.529 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.539+0000 7f3c96200640 1 -- 172.21.15.175:0/4115431722 wait complete. 2024-04-25T09:14:51.547 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T09:14:51.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.695+0000 7f44cec00640 1 Processor -- start 2024-04-25T09:14:51.683 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.695+0000 7f44cec00640 1 -- start start 2024-04-25T09:14:51.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.695+0000 7f44cec00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f44c815af20 0x7f44c80b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:51.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.695+0000 7f44cec00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f44c80b4630 0x7f44c815c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:51.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.695+0000 7f44cec00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c806db60 con 0x7f44c80cbe60 2024-04-25T09:14:51.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.695+0000 7f44cec00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c80b4aa0 con 0x7f44c80b4630 2024-04-25T09:14:51.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.695+0000 7f44cec00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c806de40 con 0x7f44c815af20 2024-04-25T09:14:51.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.695+0000 7f44ccc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f44c80b4630 0x7f44c815c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:51.685 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.695+0000 7f44ccc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f44c80b4630 0x7f44c815c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45514/0 (socket says 172.21.15.175:45514) 2024-04-25T09:14:51.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.695+0000 7f44ccc00640 1 -- 172.21.15.175:0/1306296717 learned_addr learned my addr 172.21.15.175:0/1306296717 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:51.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.695+0000 7f44bf400640 1 --2- 172.21.15.175:0/1306296717 >> v2:172.21.15.177:3300/0 conn(0x7f44c815af20 0x7f44c80b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:51.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.699+0000 7f44ccc00640 1 -- 172.21.15.175:0/1306296717 >> v2:172.21.15.177:3300/0 conn(0x7f44c815af20 msgr2=0x7f44c80b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:51.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.699+0000 7f44ccc00640 1 --2- 172.21.15.175:0/1306296717 >> v2:172.21.15.177:3300/0 conn(0x7f44c815af20 0x7f44c80b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.699+0000 7f44ccc00640 1 -- 172.21.15.175:0/1306296717 >> v1:172.21.15.177:6789/0 conn(0x7f44c80cbe60 legacy=0x7f44c806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.699+0000 7f44ccc00640 1 -- 172.21.15.175:0/1306296717 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c806e120 con 0x7f44c80b4630 2024-04-25T09:14:51.690 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.699+0000 7f44ccc00640 1 --2- 172.21.15.175:0/1306296717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44c80b4630 0x7f44c815c810 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f44c8072450 tx=0x7f44c001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58422286daca7127 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:51.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.699+0000 7f44c7400640 1 -- 172.21.15.175:0/1306296717 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c00a56c0 con 0x7f44c80b4630 2024-04-25T09:14:51.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.699+0000 7f44c7400640 1 -- 172.21.15.175:0/1306296717 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c00a5860 con 0x7f44c80b4630 2024-04-25T09:14:51.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.699+0000 7f44c7400640 1 -- 172.21.15.175:0/1306296717 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c00a5c30 con 0x7f44c80b4630 2024-04-25T09:14:51.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.699+0000 7f44cec00640 1 -- 172.21.15.175:0/1306296717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44c80b4630 msgr2=0x7f44c815c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.699+0000 7f44cec00640 1 --2- 172.21.15.175:0/1306296717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44c80b4630 0x7f44c815c810 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f44c8072450 tx=0x7f44c001c9f0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.699+0000 7f44cec00640 1 -- 172.21.15.175:0/1306296717 shutdown_connections 2024-04-25T09:14:51.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.699+0000 7f44cec00640 1 --2- 172.21.15.175:0/1306296717 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44c80b4630 0x7f44c815c810 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.699+0000 7f44cec00640 1 --2- 172.21.15.175:0/1306296717 >> v2:172.21.15.177:3300/0 conn(0x7f44c815af20 0x7f44c80b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.699+0000 7f44cec00640 1 -- 172.21.15.175:0/1306296717 >> 172.21.15.175:0/1306296717 conn(0x7f44c806ac50 msgr2=0x7f44c806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:51.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.699+0000 7f44cec00640 1 -- 172.21.15.175:0/1306296717 shutdown_connections 2024-04-25T09:14:51.691 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44cec00640 1 -- 172.21.15.175:0/1306296717 wait complete. 2024-04-25T09:14:51.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44cec00640 1 Processor -- start 2024-04-25T09:14:51.692 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44cec00640 1 -- start start 2024-04-25T09:14:51.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44cec00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44c80b4630 0x7f44c8156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:51.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44cec00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44c80cbe60 0x7f44c813e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:51.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44cec00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44c815af20 0x7f44c80ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:51.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44cec00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c815d930 con 0x7f44c815af20 2024-04-25T09:14:51.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44cec00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c815d7b0 con 0x7f44c80cbe60 2024-04-25T09:14:51.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44cec00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c815dab0 con 0x7f44c80b4630 2024-04-25T09:14:51.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44ccc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44c815af20 0x7f44c80ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:51.694 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44ccc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44c815af20 0x7f44c80ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45516/0 (socket says 172.21.15.175:45516) 2024-04-25T09:14:51.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44ccc00640 1 -- 172.21.15.175:0/4194191325 learned_addr learned my addr 172.21.15.175:0/4194191325 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:51.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44bf400640 1 --2- 172.21.15.175:0/4194191325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44c80cbe60 0x7f44c813e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:51.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44c7e00640 1 --2- 172.21.15.175:0/4194191325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44c80b4630 0x7f44c8156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:51.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44ccc00640 1 -- 172.21.15.175:0/4194191325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44c80b4630 msgr2=0x7f44c8156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44ccc00640 1 --2- 172.21.15.175:0/4194191325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44c80b4630 0x7f44c8156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44ccc00640 1 -- 172.21.15.175:0/4194191325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44c80cbe60 msgr2=0x7f44c813e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44ccc00640 1 --2- 172.21.15.175:0/4194191325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44c80cbe60 0x7f44c813e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44ccc00640 1 -- 172.21.15.175:0/4194191325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c8157430 con 0x7f44c815af20 2024-04-25T09:14:51.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44ccc00640 1 --2- 172.21.15.175:0/4194191325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44c815af20 0x7f44c80ad5b0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f44c0019600 tx=0x7f44c0019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:51.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44c4c00640 1 -- 172.21.15.175:0/4194191325 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c00bc020 con 0x7f44c815af20 2024-04-25T09:14:51.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44c4c00640 1 -- 172.21.15.175:0/4194191325 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c00b8670 con 0x7f44c815af20 2024-04-25T09:14:51.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.703+0000 7f44c4c00640 1 -- 172.21.15.175:0/4194191325 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0009510 con 0x7f44c815af20 2024-04-25T09:14:51.695 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.707+0000 7f44cec00640 1 -- 172.21.15.175:0/4194191325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c8157710 con 0x7f44c815af20 2024-04-25T09:14:51.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.707+0000 7f44cec00640 1 -- 172.21.15.175:0/4194191325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c814a950 con 0x7f44c815af20 2024-04-25T09:14:51.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.707+0000 7f44cec00640 1 -- 172.21.15.175:0/4194191325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c8075160 con 0x7f44c815af20 2024-04-25T09:14:51.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.707+0000 7f44c4c00640 1 -- 172.21.15.175:0/4194191325 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f44c00bf020 con 0x7f44c815af20 2024-04-25T09:14:51.696 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.707+0000 7f44c4c00640 1 --2- 172.21.15.175:0/4194191325 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f44a4066f60 0x7f44a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:51.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.707+0000 7f44c4c00640 1 -- 172.21.15.175:0/4194191325 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f44c011fbe0 con 0x7f44c815af20 2024-04-25T09:14:51.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.707+0000 7f44c7e00640 1 --2- 172.21.15.175:0/4194191325 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f44a4066f60 0x7f44a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:51.697 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.707+0000 7f44c7e00640 1 --2- 172.21.15.175:0/4194191325 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f44a4066f60 0x7f44a4069420 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f44b8001770 tx=0x7f44b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:51.699 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.711+0000 7f44c4c00640 1 -- 172.21.15.175:0/4194191325 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f44c00c6030 con 0x7f44c815af20 2024-04-25T09:14:51.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.871+0000 7f44cec00640 1 -- 172.21.15.175:0/4194191325 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f44c813e560 con 0x7f44a4066f60 2024-04-25T09:14:51.859 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.871+0000 7f44c4c00640 1 -- 172.21.15.175:0/4194191325 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f44c813e560 con 0x7f44a4066f60 2024-04-25T09:14:51.859 INFO:teuthology.orchestra.run.smithi175.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T09:14:51.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.871+0000 7f44cec00640 1 -- 172.21.15.175:0/4194191325 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f44a4066f60 msgr2=0x7f44a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.871+0000 7f44cec00640 1 --2- 172.21.15.175:0/4194191325 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f44a4066f60 0x7f44a4069420 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f44b8001770 tx=0x7f44b8009040 comp rx=0 tx=0).stop 2024-04-25T09:14:51.861 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.871+0000 7f44cec00640 1 -- 172.21.15.175:0/4194191325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44c815af20 msgr2=0x7f44c80ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:51.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.871+0000 7f44cec00640 1 --2- 172.21.15.175:0/4194191325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44c815af20 0x7f44c80ad5b0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f44c0019600 tx=0x7f44c0019790 comp rx=0 tx=0).stop 2024-04-25T09:14:51.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.871+0000 7f44cec00640 1 -- 172.21.15.175:0/4194191325 shutdown_connections 2024-04-25T09:14:51.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.871+0000 7f44cec00640 1 --2- 172.21.15.175:0/4194191325 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f44a4066f60 0x7f44a4069420 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.871+0000 7f44cec00640 1 --2- 172.21.15.175:0/4194191325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f44c815af20 0x7f44c80ad5b0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.871+0000 7f44cec00640 1 --2- 172.21.15.175:0/4194191325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44c80cbe60 0x7f44c813e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.871+0000 7f44cec00640 1 --2- 172.21.15.175:0/4194191325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44c80b4630 0x7f44c8156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:51.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.871+0000 7f44cec00640 1 -- 172.21.15.175:0/4194191325 >> 172.21.15.175:0/4194191325 conn(0x7f44c806ac50 msgr2=0x7f44c80d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:51.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.871+0000 7f44cec00640 1 -- 172.21.15.175:0/4194191325 shutdown_connections 2024-04-25T09:14:51.862 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:51.875+0000 7f44cec00640 1 -- 172.21.15.175:0/4194191325 wait complete. 2024-04-25T09:14:51.880 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T09:14:51.880 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:14:52.020 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.031+0000 7feaa4000640 1 Processor -- start 2024-04-25T09:14:52.021 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.031+0000 7feaa4000640 1 -- start start 2024-04-25T09:14:52.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.035+0000 7feaa4000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fea9c0cfb60 0x7fea9c0ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.035+0000 7feaa4000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fea9c06d860 0x7fea9c06dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.035+0000 7feaa4000640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea9c071e20 con 0x7fea9c0ced10 2024-04-25T09:14:52.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.035+0000 7feaa4000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea9c0cbed0 con 0x7fea9c0cfb60 2024-04-25T09:14:52.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.035+0000 7feaa4000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea9c06e1d0 con 0x7fea9c06d860 2024-04-25T09:14:52.022 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.035+0000 7feaa1600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fea9c0cfb60 0x7fea9c0ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.035+0000 7feaa1600640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fea9c0cfb60 0x7fea9c0ce7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45528/0 (socket says 172.21.15.175:45528) 2024-04-25T09:14:52.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.035+0000 7feaa1600640 1 -- 172.21.15.175:0/4245560422 learned_addr learned my addr 172.21.15.175:0/4245560422 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:52.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.035+0000 7feaa2000640 1 --2- 172.21.15.175:0/4245560422 >> v2:172.21.15.177:3300/0 conn(0x7fea9c06d860 0x7fea9c06dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.035+0000 7feaa1600640 1 -- 172.21.15.175:0/4245560422 >> v2:172.21.15.177:3300/0 conn(0x7fea9c06d860 msgr2=0x7fea9c06dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:52.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.035+0000 7feaa1600640 1 --2- 172.21.15.175:0/4245560422 >> v2:172.21.15.177:3300/0 conn(0x7fea9c06d860 0x7fea9c06dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.035+0000 7feaa1600640 1 -- 172.21.15.175:0/4245560422 >> v1:172.21.15.177:6789/0 conn(0x7fea9c0ced10 legacy=0x7fea9c0712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:52.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.035+0000 7feaa1600640 1 -- 172.21.15.175:0/4245560422 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c072100 con 0x7fea9c0cfb60 2024-04-25T09:14:52.023 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.035+0000 7feaa2000640 1 --2- 172.21.15.175:0/4245560422 >> v2:172.21.15.177:3300/0 conn(0x7fea9c06d860 0x7fea9c06dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:52.025 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.039+0000 7feaa1600640 1 --2- 172.21.15.175:0/4245560422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea9c0cfb60 0x7fea9c0ce7d0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fea9c15bfc0 tx=0x7fea9001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5082dbaa3c70201 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:52.026 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.039+0000 7fea9be00640 1 -- 172.21.15.175:0/4245560422 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea900ab680 con 0x7fea9c0cfb60 2024-04-25T09:14:52.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.039+0000 7fea9be00640 1 -- 172.21.15.175:0/4245560422 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea900b0070 con 0x7fea9c0cfb60 2024-04-25T09:14:52.027 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.039+0000 7fea9be00640 1 -- 172.21.15.175:0/4245560422 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea900aba40 con 0x7fea9c0cfb60 2024-04-25T09:14:52.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.039+0000 7feaa4000640 1 -- 172.21.15.175:0/4245560422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea9c0cfb60 msgr2=0x7fea9c0ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.039+0000 7feaa4000640 1 --2- 172.21.15.175:0/4245560422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea9c0cfb60 0x7fea9c0ce7d0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fea9c15bfc0 tx=0x7fea9001c460 comp rx=0 tx=0).stop 2024-04-25T09:14:52.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.039+0000 7feaa4000640 1 -- 172.21.15.175:0/4245560422 shutdown_connections 2024-04-25T09:14:52.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.039+0000 7feaa4000640 1 --2- 172.21.15.175:0/4245560422 >> v2:172.21.15.177:3300/0 conn(0x7fea9c06d860 0x7fea9c06dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.039+0000 7feaa4000640 1 --2- 172.21.15.175:0/4245560422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea9c0cfb60 0x7fea9c0ce7d0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.039+0000 7feaa4000640 1 -- 172.21.15.175:0/4245560422 >> 172.21.15.175:0/4245560422 conn(0x7fea9c06ac50 msgr2=0x7fea9c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:52.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.039+0000 7feaa4000640 1 -- 172.21.15.175:0/4245560422 shutdown_connections 2024-04-25T09:14:52.028 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.039+0000 7feaa4000640 1 -- 172.21.15.175:0/4245560422 wait complete. 2024-04-25T09:14:52.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa4000640 1 Processor -- start 2024-04-25T09:14:52.029 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa4000640 1 -- start start 2024-04-25T09:14:52.031 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa4000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea9c06d860 0x7fea9c15a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa4000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea9c0ced10 0x7fea9c1f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa4000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea9c0cfb60 0x7fea9c143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa4000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0d00c0 con 0x7fea9c0ced10 2024-04-25T09:14:52.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa4000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0cff40 con 0x7fea9c06d860 2024-04-25T09:14:52.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa4000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0719c0 con 0x7fea9c0cfb60 2024-04-25T09:14:52.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa0c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea9c0ced10 0x7fea9c1f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa0c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea9c0ced10 0x7fea9c1f6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45540/0 (socket says 172.21.15.175:45540) 2024-04-25T09:14:52.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa0c00640 1 -- 172.21.15.175:0/2640785140 learned_addr learned my addr 172.21.15.175:0/2640785140 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:52.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa1600640 1 --2- 172.21.15.175:0/2640785140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea9c06d860 0x7fea9c15a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa2000640 1 --2- 172.21.15.175:0/2640785140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea9c0cfb60 0x7fea9c143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.032 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa0c00640 1 -- 172.21.15.175:0/2640785140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea9c0cfb60 msgr2=0x7fea9c143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa0c00640 1 --2- 172.21.15.175:0/2640785140 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea9c0cfb60 0x7fea9c143620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa0c00640 1 -- 172.21.15.175:0/2640785140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea9c06d860 msgr2=0x7fea9c15a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa0c00640 1 --2- 172.21.15.175:0/2640785140 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea9c06d860 0x7fea9c15a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa0c00640 1 -- 172.21.15.175:0/2640785140 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c1407c0 con 0x7fea9c0ced10 2024-04-25T09:14:52.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa0c00640 1 --2- 172.21.15.175:0/2640785140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea9c0ced10 0x7fea9c1f6c40 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fea8800c370 tx=0x7fea8800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:52.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7fea99600640 1 -- 172.21.15.175:0/2640785140 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea880052d0 con 0x7fea9c0ced10 2024-04-25T09:14:52.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7fea99600640 1 -- 172.21.15.175:0/2640785140 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea88005470 con 0x7fea9c0ced10 2024-04-25T09:14:52.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa4000640 1 -- 172.21.15.175:0/2640785140 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9c140aa0 con 0x7fea9c0ced10 2024-04-25T09:14:52.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7fea99600640 1 -- 172.21.15.175:0/2640785140 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea88007260 con 0x7fea9c0ced10 2024-04-25T09:14:52.033 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa4000640 1 -- 172.21.15.175:0/2640785140 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c0b37b0 con 0x7fea9c0ced10 2024-04-25T09:14:52.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.043+0000 7feaa4000640 1 -- 172.21.15.175:0/2640785140 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea9c075160 con 0x7fea9c0ced10 2024-04-25T09:14:52.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.047+0000 7fea99600640 1 -- 172.21.15.175:0/2640785140 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fea88007400 con 0x7fea9c0ced10 2024-04-25T09:14:52.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.047+0000 7fea99600640 1 --2- 172.21.15.175:0/2640785140 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea7c066f90 0x7fea7c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.047+0000 7fea99600640 1 -- 172.21.15.175:0/2640785140 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fea880840e0 con 0x7fea9c0ced10 2024-04-25T09:14:52.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.047+0000 7feaa1600640 1 --2- 172.21.15.175:0/2640785140 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea7c066f90 0x7fea7c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.047+0000 7fea99600640 1 --2- 172.21.15.175:0/2640785140 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x7fea7c06cf90 0x7fea7c06f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.047+0000 7fea99600640 1 -- 172.21.15.175:0/2640785140 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea7c06fa60 con 0x7fea7c06cf90 2024-04-25T09:14:52.035 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.047+0000 7fea99600640 1 -- 172.21.15.175:0/2640785140 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea8808b050 con 0x7fea9c0ced10 2024-04-25T09:14:52.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.047+0000 7feaa2000640 1 --2- 172.21.15.175:0/2640785140 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x7fea7c06cf90 0x7fea7c06f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.047+0000 7feaa1600640 1 --2- 172.21.15.175:0/2640785140 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea7c066f90 0x7fea7c069450 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fea900af000 tx=0x7fea900a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:52.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.047+0000 7feaa2000640 1 --2- 172.21.15.175:0/2640785140 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x7fea7c06cf90 0x7fea7c06f3b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:52.036 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.047+0000 7fea99600640 1 -- 172.21.15.175:0/2640785140 <== osd.2 v2:172.21.15.175:6821/3247063283 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fea7c06fa60 con 0x7fea7c06cf90 2024-04-25T09:14:52.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.059+0000 7feaa4000640 1 -- 172.21.15.175:0/2640785140 --> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fea9c1410e0 con 0x7fea7c06cf90 2024-04-25T09:14:52.049 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.063+0000 7fea99600640 1 -- 172.21.15.175:0/2640785140 <== osd.2 v2:172.21.15.175:6821/3247063283 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fea9c1410e0 con 0x7fea7c06cf90 2024-04-25T09:14:52.049 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:14:52.049 INFO:teuthology.orchestra.run.smithi175.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:14:52.050 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:14:52.050 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.063+0000 7feaa4000640 1 -- 172.21.15.175:0/2640785140 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x7fea7c06cf90 msgr2=0x7fea7c06f3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.063+0000 7feaa4000640 1 --2- 172.21.15.175:0/2640785140 >> [v2:172.21.15.175:6821/3247063283,v1:172.21.15.175:6823/3247063283] conn(0x7fea7c06cf90 0x7fea7c06f3b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.063+0000 7feaa4000640 1 -- 172.21.15.175:0/2640785140 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea7c066f90 msgr2=0x7fea7c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.063+0000 7feaa4000640 1 --2- 172.21.15.175:0/2640785140 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fea7c066f90 0x7fea7c069450 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fea900af000 tx=0x7fea900a7000 comp rx=0 tx=0).stop 2024-04-25T09:14:52.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.063+0000 7feaa4000640 1 -- 172.21.15.175:0/2640785140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea9c0ced10 msgr2=0x7fea9c1f6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.063+0000 7feaa4000640 1 --2- 172.21.15.175:0/2640785140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fea9c0ced10 0x7fea9c1f6c40 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fea8800c370 tx=0x7fea8800c830 comp rx=0 tx=0).stop 2024-04-25T09:14:52.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.063+0000 7feaa2000640 1 -- 172.21.15.175:0/2640785140 reap_dead start 2024-04-25T09:14:52.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.063+0000 7feaa4000640 1 -- 172.21.15.175:0/2640785140 shutdown_connections 2024-04-25T09:14:52.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.063+0000 7feaa4000640 1 -- 172.21.15.175:0/2640785140 >> 172.21.15.175:0/2640785140 conn(0x7fea9c06ac50 msgr2=0x7fea9c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:52.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.063+0000 7feaa4000640 1 -- 172.21.15.175:0/2640785140 shutdown_connections 2024-04-25T09:14:52.051 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.063+0000 7feaa4000640 1 -- 172.21.15.175:0/2640785140 wait complete. 2024-04-25T09:14:52.069 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T09:14:52.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.219+0000 7f6492000640 1 Processor -- start 2024-04-25T09:14:52.206 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.219+0000 7f6492000640 1 -- start start 2024-04-25T09:14:52.207 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.219+0000 7f6492000640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f648c0b3880 0x7f648c169c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.219+0000 7f6492000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c0b2660 0x7f648c16c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.219+0000 7f6492000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648c162630 con 0x7f648c15c6e0 2024-04-25T09:14:52.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.219+0000 7f6492000640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648c15cac0 con 0x7f648c0b3880 2024-04-25T09:14:52.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.219+0000 7f6492000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c1628f0 con 0x7f648c0b2660 2024-04-25T09:14:52.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.219+0000 7f648b400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f648c15c6e0 0x7f648c0b3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59960/0 (socket says 172.21.15.175:59960) 2024-04-25T09:14:52.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.219+0000 7f648b400640 1 -- 172.21.15.175:0/3146804614 learned_addr learned my addr 172.21.15.175:0/3146804614 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:52.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.219+0000 7f6482a00640 1 --2- 172.21.15.175:0/3146804614 >> v2:172.21.15.177:3300/0 conn(0x7f648c0b3880 0x7f648c169c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.219+0000 7f648be00640 1 --2- 172.21.15.175:0/3146804614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c0b2660 0x7f648c16c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.219+0000 7f648aa00640 1 -- 172.21.15.175:0/3146804614 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453218680 0 0) 0x7f648c162630 con 0x7f648c15c6e0 2024-04-25T09:14:52.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.219+0000 7f648aa00640 1 -- 172.21.15.175:0/3146804614 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6470003530 con 0x7f648c15c6e0 2024-04-25T09:14:52.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.219+0000 7f648be00640 1 -- 172.21.15.175:0/3146804614 >> v2:172.21.15.177:3300/0 conn(0x7f648c0b3880 msgr2=0x7f648c169c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:52.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.219+0000 7f648be00640 1 --2- 172.21.15.175:0/3146804614 >> v2:172.21.15.177:3300/0 conn(0x7f648c0b3880 0x7f648c169c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.219+0000 7f648be00640 1 -- 172.21.15.175:0/3146804614 >> v1:172.21.15.175:6789/0 conn(0x7f648c15c6e0 legacy=0x7f648c0b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.219+0000 7f648be00640 1 -- 172.21.15.175:0/3146804614 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c162bd0 con 0x7f648c0b2660 2024-04-25T09:14:52.209 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.219+0000 7f6482a00640 1 --2- 172.21.15.175:0/3146804614 >> v2:172.21.15.177:3300/0 conn(0x7f648c0b3880 0x7f648c169c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:52.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.223+0000 7f648be00640 1 --2- 172.21.15.175:0/3146804614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c0b2660 0x7f648c16c1a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f64840097c0 tx=0x7f648401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb91d33ed7442165 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:52.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.223+0000 7f648aa00640 1 -- 172.21.15.175:0/3146804614 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64840b1070 con 0x7f648c0b2660 2024-04-25T09:14:52.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.223+0000 7f648aa00640 1 -- 172.21.15.175:0/3146804614 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64840ac410 con 0x7f648c0b2660 2024-04-25T09:14:52.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.223+0000 7f648aa00640 1 -- 172.21.15.175:0/3146804614 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64840ac7e0 con 0x7f648c0b2660 2024-04-25T09:14:52.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.223+0000 7f6492000640 1 -- 172.21.15.175:0/3146804614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c0b2660 msgr2=0x7f648c16c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.223+0000 7f6492000640 1 --2- 172.21.15.175:0/3146804614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c0b2660 0x7f648c16c1a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f64840097c0 tx=0x7f648401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.223+0000 7f6492000640 1 -- 172.21.15.175:0/3146804614 shutdown_connections 2024-04-25T09:14:52.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.223+0000 7f6492000640 1 --2- 172.21.15.175:0/3146804614 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c0b2660 0x7f648c16c1a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.223+0000 7f6492000640 1 --2- 172.21.15.175:0/3146804614 >> v2:172.21.15.177:3300/0 conn(0x7f648c0b3880 0x7f648c169c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.223+0000 7f6492000640 1 -- 172.21.15.175:0/3146804614 >> 172.21.15.175:0/3146804614 conn(0x7f648c06ac50 msgr2=0x7f648c06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:52.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.223+0000 7f6492000640 1 -- 172.21.15.175:0/3146804614 shutdown_connections 2024-04-25T09:14:52.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.223+0000 7f6492000640 1 -- 172.21.15.175:0/3146804614 wait complete. 2024-04-25T09:14:52.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f6492000640 1 Processor -- start 2024-04-25T09:14:52.214 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f6492000640 1 -- start start 2024-04-25T09:14:52.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f6492000640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c0b2660 0x7f648c0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f6492000640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f648c0b3880 0x7f648c0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f6492000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f648c15c6e0 0x7f648c0cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f6492000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c165980 con 0x7f648c15c6e0 2024-04-25T09:14:52.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f6492000640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c165800 con 0x7f648c0b3880 2024-04-25T09:14:52.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f6492000640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c16ef00 con 0x7f648c0b2660 2024-04-25T09:14:52.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f648be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f648c15c6e0 0x7f648c0cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f648be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f648c15c6e0 0x7f648c0cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45548/0 (socket says 172.21.15.175:45548) 2024-04-25T09:14:52.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f648be00640 1 -- 172.21.15.175:0/4154583339 learned_addr learned my addr 172.21.15.175:0/4154583339 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:52.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f6482a00640 1 --2- 172.21.15.175:0/4154583339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f648c0b3880 0x7f648c0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f648b400640 1 --2- 172.21.15.175:0/4154583339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c0b2660 0x7f648c0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f648be00640 1 -- 172.21.15.175:0/4154583339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c0b2660 msgr2=0x7f648c0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f648be00640 1 --2- 172.21.15.175:0/4154583339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c0b2660 0x7f648c0cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f648be00640 1 -- 172.21.15.175:0/4154583339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f648c0b3880 msgr2=0x7f648c0cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f648be00640 1 --2- 172.21.15.175:0/4154583339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f648c0b3880 0x7f648c0cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f648be00640 1 -- 172.21.15.175:0/4154583339 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c153660 con 0x7f648c15c6e0 2024-04-25T09:14:52.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f648be00640 1 --2- 172.21.15.175:0/4154583339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f648c15c6e0 0x7f648c0cccc0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f64840af040 tx=0x7f6484019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:52.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f6483e00640 1 -- 172.21.15.175:0/4154583339 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64840b1040 con 0x7f648c15c6e0 2024-04-25T09:14:52.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f6483e00640 1 -- 172.21.15.175:0/4154583339 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64840bb070 con 0x7f648c15c6e0 2024-04-25T09:14:52.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f6492000640 1 -- 172.21.15.175:0/4154583339 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648c153940 con 0x7f648c15c6e0 2024-04-25T09:14:52.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f6483e00640 1 -- 172.21.15.175:0/4154583339 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64840b5410 con 0x7f648c15c6e0 2024-04-25T09:14:52.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.227+0000 7f6492000640 1 -- 172.21.15.175:0/4154583339 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648c160e40 con 0x7f648c15c6e0 2024-04-25T09:14:52.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.231+0000 7f6492000640 1 -- 172.21.15.175:0/4154583339 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648c075160 con 0x7f648c15c6e0 2024-04-25T09:14:52.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.231+0000 7f6483e00640 1 -- 172.21.15.175:0/4154583339 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f64840b55b0 con 0x7f648c15c6e0 2024-04-25T09:14:52.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.231+0000 7f6483e00640 1 --2- 172.21.15.175:0/4154583339 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6468066f60 0x7f6468069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.231+0000 7f6483e00640 1 -- 172.21.15.175:0/4154583339 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f648411e770 con 0x7f648c15c6e0 2024-04-25T09:14:52.219 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.231+0000 7f648b400640 1 --2- 172.21.15.175:0/4154583339 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6468066f60 0x7f6468069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.220 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.231+0000 7f648b400640 1 --2- 172.21.15.175:0/4154583339 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6468066f60 0x7f6468069420 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f647c005c10 tx=0x7f647c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:52.223 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.235+0000 7f6483e00640 1 -- 172.21.15.175:0/4154583339 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6484016090 con 0x7f648c15c6e0 2024-04-25T09:14:52.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.391+0000 7f6492000640 1 -- 172.21.15.175:0/4154583339 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f648c0b3220 con 0x7f6468066f60 2024-04-25T09:14:52.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.391+0000 7f6483e00640 1 -- 172.21.15.175:0/4154583339 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f648c0b3220 con 0x7f6468066f60 2024-04-25T09:14:52.380 INFO:teuthology.orchestra.run.smithi175.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T09:14:52.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.395+0000 7f6492000640 1 -- 172.21.15.175:0/4154583339 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6468066f60 msgr2=0x7f6468069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.395+0000 7f6492000640 1 --2- 172.21.15.175:0/4154583339 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6468066f60 0x7f6468069420 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f647c005c10 tx=0x7f647c009040 comp rx=0 tx=0).stop 2024-04-25T09:14:52.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.395+0000 7f6492000640 1 -- 172.21.15.175:0/4154583339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f648c15c6e0 msgr2=0x7f648c0cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.395+0000 7f6492000640 1 --2- 172.21.15.175:0/4154583339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f648c15c6e0 0x7f648c0cccc0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f64840af040 tx=0x7f6484019240 comp rx=0 tx=0).stop 2024-04-25T09:14:52.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.395+0000 7f6492000640 1 -- 172.21.15.175:0/4154583339 shutdown_connections 2024-04-25T09:14:52.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.395+0000 7f6492000640 1 --2- 172.21.15.175:0/4154583339 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f6468066f60 0x7f6468069420 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.395+0000 7f6492000640 1 --2- 172.21.15.175:0/4154583339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f648c15c6e0 0x7f648c0cccc0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.395+0000 7f6492000640 1 --2- 172.21.15.175:0/4154583339 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f648c0b3880 0x7f648c0cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.395+0000 7f6492000640 1 --2- 172.21.15.175:0/4154583339 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f648c0b2660 0x7f648c0cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.395+0000 7f6492000640 1 -- 172.21.15.175:0/4154583339 >> 172.21.15.175:0/4154583339 conn(0x7f648c06ac50 msgr2=0x7f648c0afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:52.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.395+0000 7f6492000640 1 -- 172.21.15.175:0/4154583339 shutdown_connections 2024-04-25T09:14:52.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.395+0000 7f6492000640 1 -- 172.21.15.175:0/4154583339 wait complete. 2024-04-25T09:14:52.401 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T09:14:52.401 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:14:52.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.551+0000 7fd1e1a00640 1 Processor -- start 2024-04-25T09:14:52.539 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.551+0000 7fd1e1a00640 1 -- start start 2024-04-25T09:14:52.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.551+0000 7fd1e1a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd1dc0cfb60 0x7fd1dc0ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.551+0000 7fd1e1a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1dc06d860 0x7fd1dc06dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.551+0000 7fd1e1a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1dc06e1a0 con 0x7fd1dc0ced10 2024-04-25T09:14:52.541 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.551+0000 7fd1e1a00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1dc0cbed0 con 0x7fd1dc0cfb60 2024-04-25T09:14:52.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.551+0000 7fd1e1a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc071e20 con 0x7fd1dc06d860 2024-04-25T09:14:52.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.551+0000 7fd1daa00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd1dc0cfb60 0x7fd1dc0ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.551+0000 7fd1daa00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd1dc0cfb60 0x7fd1dc0ce7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45564/0 (socket says 172.21.15.175:45564) 2024-04-25T09:14:52.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.551+0000 7fd1daa00640 1 -- 172.21.15.175:0/1311145734 learned_addr learned my addr 172.21.15.175:0/1311145734 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:52.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.555+0000 7fd1db400640 1 --2- 172.21.15.175:0/1311145734 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1dc06d860 0x7fd1dc06dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.555+0000 7fd1daa00640 1 -- 172.21.15.175:0/1311145734 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1dc06d860 msgr2=0x7fd1dc06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:52.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.555+0000 7fd1daa00640 1 --2- 172.21.15.175:0/1311145734 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1dc06d860 0x7fd1dc06dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.555+0000 7fd1daa00640 1 -- 172.21.15.175:0/1311145734 >> v1:172.21.15.175:6789/0 conn(0x7fd1dc0ced10 legacy=0x7fd1dc0712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.542 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.555+0000 7fd1daa00640 1 -- 172.21.15.175:0/1311145734 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc072100 con 0x7fd1dc0cfb60 2024-04-25T09:14:52.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.555+0000 7fd1daa00640 1 --2- 172.21.15.175:0/1311145734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1dc0cfb60 0x7fd1dc0ce7d0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc009e50 tx=0x7fd1cc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77899e3bf9ef14b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:52.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.555+0000 7fd1da000640 1 -- 172.21.15.175:0/1311145734 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0a5850 con 0x7fd1dc0cfb60 2024-04-25T09:14:52.544 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.555+0000 7fd1da000640 1 -- 172.21.15.175:0/1311145734 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc0a59f0 con 0x7fd1dc0cfb60 2024-04-25T09:14:52.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.555+0000 7fd1da000640 1 -- 172.21.15.175:0/1311145734 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0a5dc0 con 0x7fd1dc0cfb60 2024-04-25T09:14:52.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.555+0000 7fd1e1a00640 1 -- 172.21.15.175:0/1311145734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1dc0cfb60 msgr2=0x7fd1dc0ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.545 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.555+0000 7fd1e1a00640 1 --2- 172.21.15.175:0/1311145734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1dc0cfb60 0x7fd1dc0ce7d0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc009e50 tx=0x7fd1cc01c970 comp rx=0 tx=0).stop 2024-04-25T09:14:52.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1e1a00640 1 -- 172.21.15.175:0/1311145734 shutdown_connections 2024-04-25T09:14:52.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1e1a00640 1 --2- 172.21.15.175:0/1311145734 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1dc06d860 0x7fd1dc06dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1e1a00640 1 --2- 172.21.15.175:0/1311145734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1dc0cfb60 0x7fd1dc0ce7d0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1e1a00640 1 -- 172.21.15.175:0/1311145734 >> 172.21.15.175:0/1311145734 conn(0x7fd1dc06ac50 msgr2=0x7fd1dc06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:52.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1e1a00640 1 -- 172.21.15.175:0/1311145734 shutdown_connections 2024-04-25T09:14:52.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1e1a00640 1 -- 172.21.15.175:0/1311145734 wait complete. 2024-04-25T09:14:52.546 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1e1a00640 1 Processor -- start 2024-04-25T09:14:52.547 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1e1a00640 1 -- start start 2024-04-25T09:14:52.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1e1a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1dc06d860 0x7fd1dc15e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1e1a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1dc0ced10 0x7fd1dc13fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1e1a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1dc0cfb60 0x7fd1dc142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1e1a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0d00c0 con 0x7fd1dc0ced10 2024-04-25T09:14:52.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1e1a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0cff40 con 0x7fd1dc0cfb60 2024-04-25T09:14:52.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1e1a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0719c0 con 0x7fd1dc06d860 2024-04-25T09:14:52.549 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1d2000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1dc0ced10 0x7fd1dc13fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1d2000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1dc0ced10 0x7fd1dc13fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45576/0 (socket says 172.21.15.175:45576) 2024-04-25T09:14:52.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1d2000640 1 -- 172.21.15.175:0/488896365 learned_addr learned my addr 172.21.15.175:0/488896365 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:52.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1daa00640 1 --2- 172.21.15.175:0/488896365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1dc06d860 0x7fd1dc15e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1db400640 1 --2- 172.21.15.175:0/488896365 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1dc0cfb60 0x7fd1dc142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1d2000640 1 -- 172.21.15.175:0/488896365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1dc06d860 msgr2=0x7fd1dc15e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1d2000640 1 --2- 172.21.15.175:0/488896365 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd1dc06d860 0x7fd1dc15e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1d2000640 1 -- 172.21.15.175:0/488896365 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1dc0cfb60 msgr2=0x7fd1dc142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1d2000640 1 --2- 172.21.15.175:0/488896365 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd1dc0cfb60 0x7fd1dc142d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1d2000640 1 -- 172.21.15.175:0/488896365 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc140290 con 0x7fd1dc0ced10 2024-04-25T09:14:52.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1d2000640 1 --2- 172.21.15.175:0/488896365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1dc0ced10 0x7fd1dc13fb10 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400c420 tx=0x7fd1c400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:52.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1d3400640 1 -- 172.21.15.175:0/488896365 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40052d0 con 0x7fd1dc0ced10 2024-04-25T09:14:52.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1d3400640 1 -- 172.21.15.175:0/488896365 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c4005470 con 0x7fd1dc0ced10 2024-04-25T09:14:52.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1e1a00640 1 -- 172.21.15.175:0/488896365 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1dc140570 con 0x7fd1dc0ced10 2024-04-25T09:14:52.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.559+0000 7fd1d3400640 1 -- 172.21.15.175:0/488896365 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4007260 con 0x7fd1dc0ced10 2024-04-25T09:14:52.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.563+0000 7fd1e1a00640 1 -- 172.21.15.175:0/488896365 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1dc140b30 con 0x7fd1dc0ced10 2024-04-25T09:14:52.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.563+0000 7fd1e1a00640 1 -- 172.21.15.175:0/488896365 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1dc140f10 con 0x7fd1dc0ced10 2024-04-25T09:14:52.551 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.563+0000 7fd1d3400640 1 -- 172.21.15.175:0/488896365 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd1c4007400 con 0x7fd1dc0ced10 2024-04-25T09:14:52.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.563+0000 7fd1d3400640 1 --2- 172.21.15.175:0/488896365 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd1b8066f90 0x7fd1b8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.563+0000 7fd1d3400640 1 -- 172.21.15.175:0/488896365 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fd1c40841f0 con 0x7fd1dc0ced10 2024-04-25T09:14:52.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.563+0000 7fd1d3400640 1 --2- 172.21.15.175:0/488896365 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x7fd1b806cf90 0x7fd1b806f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.563+0000 7fd1d3400640 1 -- 172.21.15.175:0/488896365 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1b806fa60 con 0x7fd1b806cf90 2024-04-25T09:14:52.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.563+0000 7fd1daa00640 1 --2- 172.21.15.175:0/488896365 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd1b8066f90 0x7fd1b8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.552 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.563+0000 7fd1d3400640 1 -- 172.21.15.175:0/488896365 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1c408b050 con 0x7fd1dc0ced10 2024-04-25T09:14:52.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.563+0000 7fd1db400640 1 --2- 172.21.15.175:0/488896365 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x7fd1b806cf90 0x7fd1b806f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.563+0000 7fd1daa00640 1 --2- 172.21.15.175:0/488896365 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd1b8066f90 0x7fd1b8069450 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0ae000 tx=0x7fd1cc0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:52.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.563+0000 7fd1db400640 1 --2- 172.21.15.175:0/488896365 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x7fd1b806cf90 0x7fd1b806f3b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:52.553 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.567+0000 7fd1d3400640 1 -- 172.21.15.175:0/488896365 <== osd.3 v2:172.21.15.175:6816/4078277957 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd1b806fa60 con 0x7fd1b806cf90 2024-04-25T09:14:52.566 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.579+0000 7fd1e1a00640 1 -- 172.21.15.175:0/488896365 --> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd1dc13bf30 con 0x7fd1b806cf90 2024-04-25T09:14:52.567 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.579+0000 7fd1d3400640 1 -- 172.21.15.175:0/488896365 <== osd.3 v2:172.21.15.175:6816/4078277957 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd1dc13bf30 con 0x7fd1b806cf90 2024-04-25T09:14:52.567 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:14:52.567 INFO:teuthology.orchestra.run.smithi175.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:14:52.567 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:14:52.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.579+0000 7fd1e1a00640 1 -- 172.21.15.175:0/488896365 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x7fd1b806cf90 msgr2=0x7fd1b806f3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.579+0000 7fd1e1a00640 1 --2- 172.21.15.175:0/488896365 >> [v2:172.21.15.175:6816/4078277957,v1:172.21.15.175:6817/4078277957] conn(0x7fd1b806cf90 0x7fd1b806f3b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.579+0000 7fd1e1a00640 1 -- 172.21.15.175:0/488896365 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd1b8066f90 msgr2=0x7fd1b8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.579+0000 7fd1e1a00640 1 --2- 172.21.15.175:0/488896365 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd1b8066f90 0x7fd1b8069450 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0ae000 tx=0x7fd1cc0a7070 comp rx=0 tx=0).stop 2024-04-25T09:14:52.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.579+0000 7fd1e1a00640 1 -- 172.21.15.175:0/488896365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1dc0ced10 msgr2=0x7fd1dc13fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.579+0000 7fd1e1a00640 1 --2- 172.21.15.175:0/488896365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1dc0ced10 0x7fd1dc13fb10 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400c420 tx=0x7fd1c400c8e0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.579+0000 7fd1db400640 1 -- 172.21.15.175:0/488896365 reap_dead start 2024-04-25T09:14:52.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.579+0000 7fd1e1a00640 1 -- 172.21.15.175:0/488896365 shutdown_connections 2024-04-25T09:14:52.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.579+0000 7fd1e1a00640 1 -- 172.21.15.175:0/488896365 >> 172.21.15.175:0/488896365 conn(0x7fd1dc06ac50 msgr2=0x7fd1dc06b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:52.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.579+0000 7fd1e1a00640 1 -- 172.21.15.175:0/488896365 shutdown_connections 2024-04-25T09:14:52.569 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.579+0000 7fd1e1a00640 1 -- 172.21.15.175:0/488896365 wait complete. 2024-04-25T09:14:52.585 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T09:14:52.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.735+0000 7f900b400640 1 Processor -- start 2024-04-25T09:14:52.721 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.735+0000 7f900b400640 1 -- start start 2024-04-25T09:14:52.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.735+0000 7f900b400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90040cf6b0 0x7f90041600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.735+0000 7f900b400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90040cfd10 con 0x7f9004145250 2024-04-25T09:14:52.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.735+0000 7f900b400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90040cfff0 con 0x7f90040ce970 2024-04-25T09:14:52.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.735+0000 7f900b400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90041605e0 con 0x7f90040cf6b0 2024-04-25T09:14:52.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.735+0000 7f9008a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f9004145250 0x7f90040cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59982/0 (socket says 172.21.15.175:59982) 2024-04-25T09:14:52.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.735+0000 7f9008a00640 1 -- 172.21.15.175:0/944986971 learned_addr learned my addr 172.21.15.175:0/944986971 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:52.723 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.735+0000 7f8ffbe00640 1 --2- 172.21.15.175:0/944986971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90040cf6b0 0x7f90041600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.735+0000 7f9003e00640 1 -- 172.21.15.175:0/944986971 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 734046810 0 0) 0x7f90040cfd10 con 0x7f9004145250 2024-04-25T09:14:52.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.735+0000 7f9003e00640 1 -- 172.21.15.175:0/944986971 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fe8003530 con 0x7f9004145250 2024-04-25T09:14:52.724 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.735+0000 7f9003e00640 1 -- 172.21.15.175:0/944986971 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360220065 0 0) 0x7f90040cfff0 con 0x7f90040ce970 2024-04-25T09:14:52.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.735+0000 7f9003e00640 1 -- 172.21.15.175:0/944986971 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90040cfd10 con 0x7f90040ce970 2024-04-25T09:14:52.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.735+0000 7f8ffbe00640 1 -- 172.21.15.175:0/944986971 >> v1:172.21.15.177:6789/0 conn(0x7f90040ce970 legacy=0x7f90040cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.735+0000 7f9003e00640 1 -- 172.21.15.175:0/944986971 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 103058686 0 0) 0x7f8fe8003530 con 0x7f9004145250 2024-04-25T09:14:52.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.735+0000 7f8ffbe00640 1 -- 172.21.15.175:0/944986971 >> v1:172.21.15.175:6789/0 conn(0x7f9004145250 legacy=0x7f90040cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.725 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.735+0000 7f8ffbe00640 1 -- 172.21.15.175:0/944986971 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900415f8a0 con 0x7f90040cf6b0 2024-04-25T09:14:52.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.739+0000 7f8ffbe00640 1 --2- 172.21.15.175:0/944986971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90040cf6b0 0x7f90041600a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0097f0 tx=0x7f8fec01c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f73b972bf5990674 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:52.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.739+0000 7f9003e00640 1 -- 172.21.15.175:0/944986971 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0b0070 con 0x7f90040cf6b0 2024-04-25T09:14:52.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.739+0000 7f9003e00640 1 -- 172.21.15.175:0/944986971 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec0ab400 con 0x7f90040cf6b0 2024-04-25T09:14:52.727 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.739+0000 7f9003e00640 1 -- 172.21.15.175:0/944986971 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4001680 con 0x7f90040cf6b0 2024-04-25T09:14:52.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.739+0000 7f900b400640 1 -- 172.21.15.175:0/944986971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90040cf6b0 msgr2=0x7f90041600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.739+0000 7f900b400640 1 --2- 172.21.15.175:0/944986971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90040cf6b0 0x7f90041600a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0097f0 tx=0x7f8fec01c2e0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.739+0000 7f900b400640 1 -- 172.21.15.175:0/944986971 shutdown_connections 2024-04-25T09:14:52.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.739+0000 7f900b400640 1 --2- 172.21.15.175:0/944986971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90040cf6b0 0x7f90041600a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.739+0000 7f900b400640 1 -- 172.21.15.175:0/944986971 >> 172.21.15.175:0/944986971 conn(0x7f900406ac50 msgr2=0x7f900406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:52.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.739+0000 7f900b400640 1 -- 172.21.15.175:0/944986971 shutdown_connections 2024-04-25T09:14:52.728 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.739+0000 7f900b400640 1 -- 172.21.15.175:0/944986971 wait complete. 2024-04-25T09:14:52.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f900b400640 1 Processor -- start 2024-04-25T09:14:52.729 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f900b400640 1 -- start start 2024-04-25T09:14:52.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f900b400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90040ce970 0x7f90040b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f900b400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90040cf6b0 0x7f900413f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f900b400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9004145250 0x7f90040b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f900b400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900415cc00 con 0x7f9004145250 2024-04-25T09:14:52.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f900b400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900415ca80 con 0x7f90040cf6b0 2024-04-25T09:14:52.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f900b400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90041697f0 con 0x7f90040ce970 2024-04-25T09:14:52.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f9009400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9004145250 0x7f90040b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f9009400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9004145250 0x7f90040b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45582/0 (socket says 172.21.15.175:45582) 2024-04-25T09:14:52.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f9009400640 1 -- 172.21.15.175:0/4111436721 learned_addr learned my addr 172.21.15.175:0/4111436721 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:52.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f8ffbe00640 1 --2- 172.21.15.175:0/4111436721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90040cf6b0 0x7f900413f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.732 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f9008a00640 1 --2- 172.21.15.175:0/4111436721 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90040ce970 0x7f90040b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f9009400640 1 -- 172.21.15.175:0/4111436721 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90040ce970 msgr2=0x7f90040b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f9009400640 1 --2- 172.21.15.175:0/4111436721 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90040ce970 0x7f90040b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f9009400640 1 -- 172.21.15.175:0/4111436721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90040cf6b0 msgr2=0x7f900413f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f9009400640 1 --2- 172.21.15.175:0/4111436721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90040cf6b0 0x7f900413f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f9009400640 1 -- 172.21.15.175:0/4111436721 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90040b4590 con 0x7f9004145250 2024-04-25T09:14:52.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f8ffbe00640 1 --2- 172.21.15.175:0/4111436721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90040cf6b0 0x7f900413f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:52.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f9008a00640 1 --2- 172.21.15.175:0/4111436721 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90040ce970 0x7f90040b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:52.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f9009400640 1 --2- 172.21.15.175:0/4111436721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9004145250 0x7f90040b33d0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00c730 tx=0x7f8ffc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:52.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f9001600640 1 -- 172.21.15.175:0/4111436721 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc003b80 con 0x7f9004145250 2024-04-25T09:14:52.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f9001600640 1 -- 172.21.15.175:0/4111436721 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ffc003d20 con 0x7f9004145250 2024-04-25T09:14:52.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f9001600640 1 -- 172.21.15.175:0/4111436721 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ffc00aa90 con 0x7f9004145250 2024-04-25T09:14:52.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f900b400640 1 -- 172.21.15.175:0/4111436721 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90040aea70 con 0x7f9004145250 2024-04-25T09:14:52.733 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f900b400640 1 -- 172.21.15.175:0/4111436721 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900413ee30 con 0x7f9004145250 2024-04-25T09:14:52.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.743+0000 7f900b400640 1 -- 172.21.15.175:0/4111436721 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9004075160 con 0x7f9004145250 2024-04-25T09:14:52.734 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.747+0000 7f9001600640 1 -- 172.21.15.175:0/4111436721 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8ffc00ac30 con 0x7f9004145250 2024-04-25T09:14:52.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.747+0000 7f9001600640 1 --2- 172.21.15.175:0/4111436721 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8fe0066f90 0x7f8fe0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:52.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.747+0000 7f9001600640 1 -- 172.21.15.175:0/4111436721 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f8ffc084d60 con 0x7f9004145250 2024-04-25T09:14:52.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.747+0000 7f9008a00640 1 --2- 172.21.15.175:0/4111436721 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8fe0066f90 0x7f8fe0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:52.735 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.747+0000 7f9008a00640 1 --2- 172.21.15.175:0/4111436721 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8fe0066f90 0x7f8fe0069450 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40010f0 tx=0x7f8ff4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:52.739 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.751+0000 7f9001600640 1 -- 172.21.15.175:0/4111436721 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f90040aea70 con 0x7f9004145250 2024-04-25T09:14:52.893 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.907+0000 7f900b400640 1 -- 172.21.15.175:0/4111436721 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f90040af730 con 0x7f8fe0066f90 2024-04-25T09:14:52.894 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.907+0000 7f9001600640 1 -- 172.21.15.175:0/4111436721 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f90040af730 con 0x7f8fe0066f90 2024-04-25T09:14:52.894 INFO:teuthology.orchestra.run.smithi175.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T09:14:52.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.907+0000 7f900b400640 1 -- 172.21.15.175:0/4111436721 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8fe0066f90 msgr2=0x7f8fe0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.907+0000 7f900b400640 1 --2- 172.21.15.175:0/4111436721 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8fe0066f90 0x7f8fe0069450 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f8ff40010f0 tx=0x7f8ff4009040 comp rx=0 tx=0).stop 2024-04-25T09:14:52.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.907+0000 7f900b400640 1 -- 172.21.15.175:0/4111436721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9004145250 msgr2=0x7f90040b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:52.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.907+0000 7f900b400640 1 --2- 172.21.15.175:0/4111436721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9004145250 0x7f90040b33d0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc00c730 tx=0x7f8ffc00cbf0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.907+0000 7f900b400640 1 -- 172.21.15.175:0/4111436721 shutdown_connections 2024-04-25T09:14:52.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.907+0000 7f900b400640 1 --2- 172.21.15.175:0/4111436721 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8fe0066f90 0x7f8fe0069450 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.907+0000 7f900b400640 1 --2- 172.21.15.175:0/4111436721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9004145250 0x7f90040b33d0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.907+0000 7f900b400640 1 --2- 172.21.15.175:0/4111436721 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90040cf6b0 0x7f900413f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.907+0000 7f900b400640 1 --2- 172.21.15.175:0/4111436721 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90040ce970 0x7f90040b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:52.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.907+0000 7f900b400640 1 -- 172.21.15.175:0/4111436721 >> 172.21.15.175:0/4111436721 conn(0x7f900406ac50 msgr2=0x7f90040afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:52.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.907+0000 7f900b400640 1 -- 172.21.15.175:0/4111436721 shutdown_connections 2024-04-25T09:14:52.896 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:52.907+0000 7f900b400640 1 -- 172.21.15.175:0/4111436721 wait complete. 2024-04-25T09:14:52.914 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T09:14:52.915 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:14:53.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.067+0000 7f9e94c00640 1 Processor -- start 2024-04-25T09:14:53.056 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.067+0000 7f9e94c00640 1 -- start start 2024-04-25T09:14:53.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.071+0000 7f9e94c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9e9015ba00 0x7f9e9006bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.071+0000 7f9e94c00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9006c5f0 con 0x7f9e900cacd0 2024-04-25T09:14:53.057 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.071+0000 7f9e94c00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e900cdc70 con 0x7f9e9006c0b0 2024-04-25T09:14:53.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.071+0000 7f9e94c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e900cdf50 con 0x7f9e9015ba00 2024-04-25T09:14:53.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.071+0000 7f9e8de00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9e9015ba00 0x7f9e9006bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.071+0000 7f9e8de00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9e9015ba00 0x7f9e9006bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45596/0 (socket says 172.21.15.175:45596) 2024-04-25T09:14:53.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.071+0000 7f9e8de00640 1 -- 172.21.15.175:0/2276605202 learned_addr learned my addr 172.21.15.175:0/2276605202 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:53.058 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.071+0000 7f9e8e800640 1 --1- 172.21.15.175:0/2276605202 >> v1:172.21.15.175:6789/0 conn(0x7f9e900cacd0 0x7f9e900cea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:59988/0 (socket says 172.21.15.175:59988) 2024-04-25T09:14:53.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.071+0000 7f9e8de00640 1 -- 172.21.15.175:0/2276605202 >> v1:172.21.15.177:6789/0 conn(0x7f9e9006c0b0 legacy=0x7f9e900ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.071+0000 7f9e8de00640 1 -- 172.21.15.175:0/2276605202 >> v1:172.21.15.175:6789/0 conn(0x7f9e900cacd0 legacy=0x7f9e900cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.071+0000 7f9e8de00640 1 -- 172.21.15.175:0/2276605202 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e900ce230 con 0x7f9e9015ba00 2024-04-25T09:14:53.059 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.071+0000 7f9e8ca00640 1 -- 172.21.15.175:0/2276605202 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857459113 0 0) 0x7f9e9006c5f0 con 0x7f9e900cacd0 2024-04-25T09:14:53.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.071+0000 7f9e8de00640 1 --2- 172.21.15.175:0/2276605202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e9015ba00 0x7f9e9006bb70 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f9e80009870 tx=0x7f9e8001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad53a579e7de023f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:53.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.071+0000 7f9e8ca00640 1 -- 172.21.15.175:0/2276605202 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e800b1070 con 0x7f9e9015ba00 2024-04-25T09:14:53.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.071+0000 7f9e8ca00640 1 -- 172.21.15.175:0/2276605202 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e800a8050 con 0x7f9e9015ba00 2024-04-25T09:14:53.061 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.071+0000 7f9e8ca00640 1 -- 172.21.15.175:0/2276605202 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e800ac860 con 0x7f9e9015ba00 2024-04-25T09:14:53.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e94c00640 1 -- 172.21.15.175:0/2276605202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e9015ba00 msgr2=0x7f9e9006bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e94c00640 1 --2- 172.21.15.175:0/2276605202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e9015ba00 0x7f9e9006bb70 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f9e80009870 tx=0x7f9e8001c4d0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e94c00640 1 -- 172.21.15.175:0/2276605202 shutdown_connections 2024-04-25T09:14:53.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e94c00640 1 --2- 172.21.15.175:0/2276605202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e9015ba00 0x7f9e9006bb70 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e94c00640 1 -- 172.21.15.175:0/2276605202 >> 172.21.15.175:0/2276605202 conn(0x7f9e900cc9f0 msgr2=0x7f9e900cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:53.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e94c00640 1 -- 172.21.15.175:0/2276605202 shutdown_connections 2024-04-25T09:14:53.062 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e94c00640 1 -- 172.21.15.175:0/2276605202 wait complete. 2024-04-25T09:14:53.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e94c00640 1 Processor -- start 2024-04-25T09:14:53.063 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e94c00640 1 -- start start 2024-04-25T09:14:53.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e94c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e9006c0b0 0x7f9e90155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e94c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e900cacd0 0x7f9e9014ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e94c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e9015ba00 0x7f9e90150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e94c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e901699f0 con 0x7f9e9006c0b0 2024-04-25T09:14:53.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e94c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e90169870 con 0x7f9e900cacd0 2024-04-25T09:14:53.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e94c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e90169b70 con 0x7f9e9015ba00 2024-04-25T09:14:53.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e8de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e9006c0b0 0x7f9e90155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e8de00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e9006c0b0 0x7f9e90155380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45598/0 (socket says 172.21.15.175:45598) 2024-04-25T09:14:53.065 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e8de00640 1 -- 172.21.15.175:0/3509990673 learned_addr learned my addr 172.21.15.175:0/3509990673 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:53.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e8d400640 1 --2- 172.21.15.175:0/3509990673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e900cacd0 0x7f9e9014ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e8e800640 1 --2- 172.21.15.175:0/3509990673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e9015ba00 0x7f9e90150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e8de00640 1 -- 172.21.15.175:0/3509990673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e9015ba00 msgr2=0x7f9e90150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e8de00640 1 --2- 172.21.15.175:0/3509990673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9e9015ba00 0x7f9e90150440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e8de00640 1 -- 172.21.15.175:0/3509990673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e900cacd0 msgr2=0x7f9e9014ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e8de00640 1 --2- 172.21.15.175:0/3509990673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9e900cacd0 0x7f9e9014ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.075+0000 7f9e8de00640 1 -- 172.21.15.175:0/3509990673 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e900ae780 con 0x7f9e9006c0b0 2024-04-25T09:14:53.066 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.079+0000 7f9e8de00640 1 --2- 172.21.15.175:0/3509990673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e9006c0b0 0x7f9e90155380 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f9e8001a100 tx=0x7f9e8001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:53.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.079+0000 7f9e86000640 1 -- 172.21.15.175:0/3509990673 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e800bb020 con 0x7f9e9006c0b0 2024-04-25T09:14:53.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.079+0000 7f9e86000640 1 -- 172.21.15.175:0/3509990673 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e800b7420 con 0x7f9e9006c0b0 2024-04-25T09:14:53.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.079+0000 7f9e94c00640 1 -- 172.21.15.175:0/3509990673 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e900af500 con 0x7f9e9006c0b0 2024-04-25T09:14:53.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.079+0000 7f9e86000640 1 -- 172.21.15.175:0/3509990673 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e800b1040 con 0x7f9e9006c0b0 2024-04-25T09:14:53.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.079+0000 7f9e94c00640 1 -- 172.21.15.175:0/3509990673 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e900aed00 con 0x7f9e9006c0b0 2024-04-25T09:14:53.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.079+0000 7f9e94c00640 1 -- 172.21.15.175:0/3509990673 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9e90075160 con 0x7f9e9006c0b0 2024-04-25T09:14:53.067 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.079+0000 7f9e86000640 1 -- 172.21.15.175:0/3509990673 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9e800be020 con 0x7f9e9006c0b0 2024-04-25T09:14:53.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.079+0000 7f9e86000640 1 --2- 172.21.15.175:0/3509990673 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9e70066f60 0x7f9e70069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.079+0000 7f9e86000640 1 -- 172.21.15.175:0/3509990673 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f9e8011f4c0 con 0x7f9e9006c0b0 2024-04-25T09:14:53.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.079+0000 7f9e8d400640 1 --2- 172.21.15.175:0/3509990673 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9e70066f60 0x7f9e70069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.079+0000 7f9e86000640 1 --2- 172.21.15.175:0/3509990673 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x7f9e7006cf60 0x7f9e7006f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.079+0000 7f9e86000640 1 -- 172.21.15.175:0/3509990673 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9e7006fa30 con 0x7f9e7006cf60 2024-04-25T09:14:53.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.079+0000 7f9e86000640 1 -- 172.21.15.175:0/3509990673 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e8011f950 con 0x7f9e9006c0b0 2024-04-25T09:14:53.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.079+0000 7f9e8e800640 1 --2- 172.21.15.175:0/3509990673 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x7f9e7006cf60 0x7f9e7006f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.079+0000 7f9e8d400640 1 --2- 172.21.15.175:0/3509990673 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9e70066f60 0x7f9e70069420 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9e901552d0 tx=0x7f9e7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:53.069 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.083+0000 7f9e8e800640 1 --2- 172.21.15.175:0/3509990673 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x7f9e7006cf60 0x7f9e7006f380 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:53.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.083+0000 7f9e86000640 1 -- 172.21.15.175:0/3509990673 <== osd.4 v2:172.21.15.177:6808/236493968 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9e7006fa30 con 0x7f9e7006cf60 2024-04-25T09:14:53.083 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.095+0000 7f9e94c00640 1 -- 172.21.15.175:0/3509990673 --> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9e900b17c0 con 0x7f9e7006cf60 2024-04-25T09:14:53.084 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.095+0000 7f9e86000640 1 -- 172.21.15.175:0/3509990673 <== osd.4 v2:172.21.15.177:6808/236493968 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9e900b17c0 con 0x7f9e7006cf60 2024-04-25T09:14:53.084 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:14:53.084 INFO:teuthology.orchestra.run.smithi175.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:14:53.085 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:14:53.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.095+0000 7f9e94c00640 1 -- 172.21.15.175:0/3509990673 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x7f9e7006cf60 msgr2=0x7f9e7006f380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.085 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.095+0000 7f9e94c00640 1 --2- 172.21.15.175:0/3509990673 >> [v2:172.21.15.177:6808/236493968,v1:172.21.15.177:6809/236493968] conn(0x7f9e7006cf60 0x7f9e7006f380 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.095+0000 7f9e94c00640 1 -- 172.21.15.175:0/3509990673 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9e70066f60 msgr2=0x7f9e70069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.095+0000 7f9e94c00640 1 --2- 172.21.15.175:0/3509990673 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f9e70066f60 0x7f9e70069420 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9e901552d0 tx=0x7f9e7c009040 comp rx=0 tx=0).stop 2024-04-25T09:14:53.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.095+0000 7f9e94c00640 1 -- 172.21.15.175:0/3509990673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e9006c0b0 msgr2=0x7f9e90155380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.095+0000 7f9e94c00640 1 --2- 172.21.15.175:0/3509990673 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e9006c0b0 0x7f9e90155380 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f9e8001a100 tx=0x7f9e8001ad10 comp rx=0 tx=0).stop 2024-04-25T09:14:53.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.095+0000 7f9e8e800640 1 -- 172.21.15.175:0/3509990673 reap_dead start 2024-04-25T09:14:53.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.095+0000 7f9e94c00640 1 -- 172.21.15.175:0/3509990673 shutdown_connections 2024-04-25T09:14:53.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.095+0000 7f9e94c00640 1 -- 172.21.15.175:0/3509990673 >> 172.21.15.175:0/3509990673 conn(0x7f9e900cc9f0 msgr2=0x7f9e900ad010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:53.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.095+0000 7f9e94c00640 1 -- 172.21.15.175:0/3509990673 shutdown_connections 2024-04-25T09:14:53.086 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.095+0000 7f9e94c00640 1 -- 172.21.15.175:0/3509990673 wait complete. 2024-04-25T09:14:53.103 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T09:14:53.238 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.251+0000 7f0f9dc00640 1 Processor -- start 2024-04-25T09:14:53.239 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.251+0000 7f0f9dc00640 1 -- start start 2024-04-25T09:14:53.240 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.251+0000 7f0f9dc00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0f980cdb60 0x7f0f980cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.251+0000 7f0f9dc00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0f9806ad50 0x7f0f9806bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.251+0000 7f0f9dc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f9806c080 0x7f0f981616d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.251+0000 7f0f9dc00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9806de20 con 0x7f0f980cdb60 2024-04-25T09:14:53.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.251+0000 7f0f9dc00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9815dfe0 con 0x7f0f9806ad50 2024-04-25T09:14:53.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.251+0000 7f0f9dc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f980ce480 con 0x7f0f9806c080 2024-04-25T09:14:53.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.251+0000 7f0f96a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0f980cdb60 0x7f0f980cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.251+0000 7f0f96a00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0f980cdb60 0x7f0f980cdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45602/0 (socket says 172.21.15.175:45602) 2024-04-25T09:14:53.241 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.251+0000 7f0f96a00640 1 -- 172.21.15.175:0/1401017961 learned_addr learned my addr 172.21.15.175:0/1401017961 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:53.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.251+0000 7f0f97400640 1 --2- 172.21.15.175:0/1401017961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f9806c080 0x7f0f981616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.251+0000 7f0f96000640 1 --2- 172.21.15.175:0/1401017961 >> v2:172.21.15.177:3300/0 conn(0x7f0f9806ad50 0x7f0f9806bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.251+0000 7f0f96a00640 1 -- 172.21.15.175:0/1401017961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f9806c080 msgr2=0x7f0f981616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:53.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.251+0000 7f0f96a00640 1 --2- 172.21.15.175:0/1401017961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f9806c080 0x7f0f981616d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.251+0000 7f0f96a00640 1 -- 172.21.15.175:0/1401017961 >> v2:172.21.15.177:3300/0 conn(0x7f0f9806ad50 msgr2=0x7f0f9806bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:53.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.251+0000 7f0f96a00640 1 --2- 172.21.15.175:0/1401017961 >> v2:172.21.15.177:3300/0 conn(0x7f0f9806ad50 0x7f0f9806bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.242 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.251+0000 7f0f96a00640 1 -- 172.21.15.175:0/1401017961 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9806e090 con 0x7f0f980cdb60 2024-04-25T09:14:53.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.255+0000 7f0f96a00640 1 --2- 172.21.15.175:0/1401017961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f980cdb60 0x7f0f980cdf40 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f0f980cc9e0 tx=0x7f0f8801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53570c15a25a1c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:53.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.255+0000 7f0f95600640 1 -- 172.21.15.175:0/1401017961 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f880a5840 con 0x7f0f980cdb60 2024-04-25T09:14:53.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.255+0000 7f0f95600640 1 -- 172.21.15.175:0/1401017961 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f880a59e0 con 0x7f0f980cdb60 2024-04-25T09:14:53.243 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.255+0000 7f0f95600640 1 -- 172.21.15.175:0/1401017961 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f880a5db0 con 0x7f0f980cdb60 2024-04-25T09:14:53.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.255+0000 7f0f9dc00640 1 -- 172.21.15.175:0/1401017961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f980cdb60 msgr2=0x7f0f980cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.255+0000 7f0f9dc00640 1 --2- 172.21.15.175:0/1401017961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f980cdb60 0x7f0f980cdf40 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f0f980cc9e0 tx=0x7f0f8801c9c0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.255+0000 7f0f9dc00640 1 -- 172.21.15.175:0/1401017961 shutdown_connections 2024-04-25T09:14:53.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.255+0000 7f0f9dc00640 1 --2- 172.21.15.175:0/1401017961 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f9806c080 0x7f0f981616d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.255+0000 7f0f9dc00640 1 --2- 172.21.15.175:0/1401017961 >> v2:172.21.15.177:3300/0 conn(0x7f0f9806ad50 0x7f0f9806bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.255+0000 7f0f9dc00640 1 --2- 172.21.15.175:0/1401017961 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f980cdb60 0x7f0f980cdf40 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.244 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.255+0000 7f0f9dc00640 1 -- 172.21.15.175:0/1401017961 >> 172.21.15.175:0/1401017961 conn(0x7f0f980cca10 msgr2=0x7f0f980cce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:53.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.255+0000 7f0f9dc00640 1 -- 172.21.15.175:0/1401017961 shutdown_connections 2024-04-25T09:14:53.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.255+0000 7f0f9dc00640 1 -- 172.21.15.175:0/1401017961 wait complete. 2024-04-25T09:14:53.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f9dc00640 1 Processor -- start 2024-04-25T09:14:53.245 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f9dc00640 1 -- start start 2024-04-25T09:14:53.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f9dc00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f9806ad50 0x7f0f98143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f9dc00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9806c080 0x7f0f981535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f9dc00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f980cdb60 0x7f0f98153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f9dc00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f980aef40 con 0x7f0f9806c080 2024-04-25T09:14:53.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f9dc00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f980aedc0 con 0x7f0f980cdb60 2024-04-25T09:14:53.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f9dc00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9806eb70 con 0x7f0f9806ad50 2024-04-25T09:14:53.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f96000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9806c080 0x7f0f981535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f96000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9806c080 0x7f0f981535f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45610/0 (socket says 172.21.15.175:45610) 2024-04-25T09:14:53.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f96000640 1 -- 172.21.15.175:0/1145030222 learned_addr learned my addr 172.21.15.175:0/1145030222 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:53.248 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f96a00640 1 --2- 172.21.15.175:0/1145030222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f9806ad50 0x7f0f98143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f97400640 1 --2- 172.21.15.175:0/1145030222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f980cdb60 0x7f0f98153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f96000640 1 -- 172.21.15.175:0/1145030222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f9806ad50 msgr2=0x7f0f98143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f96000640 1 --2- 172.21.15.175:0/1145030222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f9806ad50 0x7f0f98143230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f96000640 1 -- 172.21.15.175:0/1145030222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f980cdb60 msgr2=0x7f0f98153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f96000640 1 --2- 172.21.15.175:0/1145030222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f980cdb60 0x7f0f98153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f96000640 1 -- 172.21.15.175:0/1145030222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f98143770 con 0x7f0f9806c080 2024-04-25T09:14:53.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f97400640 1 --2- 172.21.15.175:0/1145030222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f980cdb60 0x7f0f98153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:53.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f96000640 1 --2- 172.21.15.175:0/1145030222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9806c080 0x7f0f981535f0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400d830 tx=0x7f0f8400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:53.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f8ea00640 1 -- 172.21.15.175:0/1145030222 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f84018020 con 0x7f0f9806c080 2024-04-25T09:14:53.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f8ea00640 1 -- 172.21.15.175:0/1145030222 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f840096a0 con 0x7f0f9806c080 2024-04-25T09:14:53.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f8ea00640 1 -- 172.21.15.175:0/1145030222 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f84009a50 con 0x7f0f9806c080 2024-04-25T09:14:53.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f9dc00640 1 -- 172.21.15.175:0/1145030222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f98151580 con 0x7f0f9806c080 2024-04-25T09:14:53.249 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f9dc00640 1 -- 172.21.15.175:0/1145030222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f98151b40 con 0x7f0f9806c080 2024-04-25T09:14:53.250 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.259+0000 7f0f9dc00640 1 -- 172.21.15.175:0/1145030222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f98075160 con 0x7f0f9806c080 2024-04-25T09:14:53.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.263+0000 7f0f8ea00640 1 -- 172.21.15.175:0/1145030222 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0f8401b020 con 0x7f0f9806c080 2024-04-25T09:14:53.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.263+0000 7f0f8ea00640 1 --2- 172.21.15.175:0/1145030222 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f78066f60 0x7f0f78069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.263+0000 7f0f8ea00640 1 -- 172.21.15.175:0/1145030222 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f0f84085480 con 0x7f0f9806c080 2024-04-25T09:14:53.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.263+0000 7f0f96a00640 1 --2- 172.21.15.175:0/1145030222 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f78066f60 0x7f0f78069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.251 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.263+0000 7f0f96a00640 1 --2- 172.21.15.175:0/1145030222 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f78066f60 0x7f0f78069420 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0f880ae000 tx=0x7f0f880a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:53.254 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.267+0000 7f0f8ea00640 1 -- 172.21.15.175:0/1145030222 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0f84022020 con 0x7f0f9806c080 2024-04-25T09:14:53.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.419+0000 7f0f9dc00640 1 -- 172.21.15.175:0/1145030222 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f98066bc0 con 0x7f0f78066f60 2024-04-25T09:14:53.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.419+0000 7f0f8ea00640 1 -- 172.21.15.175:0/1145030222 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0f98066bc0 con 0x7f0f78066f60 2024-04-25T09:14:53.408 INFO:teuthology.orchestra.run.smithi175.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T09:14:53.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.423+0000 7f0f9dc00640 1 -- 172.21.15.175:0/1145030222 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f78066f60 msgr2=0x7f0f78069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.423+0000 7f0f9dc00640 1 --2- 172.21.15.175:0/1145030222 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f78066f60 0x7f0f78069420 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0f880ae000 tx=0x7f0f880a7070 comp rx=0 tx=0).stop 2024-04-25T09:14:53.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.423+0000 7f0f9dc00640 1 -- 172.21.15.175:0/1145030222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9806c080 msgr2=0x7f0f981535f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.423+0000 7f0f9dc00640 1 --2- 172.21.15.175:0/1145030222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9806c080 0x7f0f981535f0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400d830 tx=0x7f0f8400dcf0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.423+0000 7f0f9dc00640 1 -- 172.21.15.175:0/1145030222 shutdown_connections 2024-04-25T09:14:53.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.423+0000 7f0f9dc00640 1 --2- 172.21.15.175:0/1145030222 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f0f78066f60 0x7f0f78069420 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.423+0000 7f0f9dc00640 1 --2- 172.21.15.175:0/1145030222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f980cdb60 0x7f0f98153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.423+0000 7f0f9dc00640 1 --2- 172.21.15.175:0/1145030222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9806c080 0x7f0f981535f0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.423+0000 7f0f9dc00640 1 --2- 172.21.15.175:0/1145030222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f9806ad50 0x7f0f98143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.423+0000 7f0f9dc00640 1 -- 172.21.15.175:0/1145030222 >> 172.21.15.175:0/1145030222 conn(0x7f0f980cca10 msgr2=0x7f0f980afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:53.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.423+0000 7f0f9dc00640 1 -- 172.21.15.175:0/1145030222 shutdown_connections 2024-04-25T09:14:53.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.423+0000 7f0f9dc00640 1 -- 172.21.15.175:0/1145030222 wait complete. 2024-04-25T09:14:53.429 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T09:14:53.429 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:14:53.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.579+0000 7fd101600640 1 Processor -- start 2024-04-25T09:14:53.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.579+0000 7fd101600640 1 -- start start 2024-04-25T09:14:53.570 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.579+0000 7fd101600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0fc0b4970 0x7fd0fc165660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.579+0000 7fd101600640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc15b880 con 0x7fd0fc0b2700 2024-04-25T09:14:53.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.579+0000 7fd101600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc15bb60 con 0x7fd0fc0aebd0 2024-04-25T09:14:53.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.579+0000 7fd101600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc15be40 con 0x7fd0fc0b4970 2024-04-25T09:14:53.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.579+0000 7fd0f2000640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd0fc0b2700 0x7fd0fc0b4260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:60004/0 (socket says 172.21.15.175:60004) 2024-04-25T09:14:53.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.579+0000 7fd0f2000640 1 -- 172.21.15.175:0/282051309 learned_addr learned my addr 172.21.15.175:0/282051309 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:53.571 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.583+0000 7fd0fb400640 1 --2- 172.21.15.175:0/282051309 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0fc0b4970 0x7fd0fc165660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.583+0000 7fd0fa000640 1 -- 172.21.15.175:0/282051309 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085042209 0 0) 0x7fd0fc15b880 con 0x7fd0fc0b2700 2024-04-25T09:14:53.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.583+0000 7fd0fa000640 1 -- 172.21.15.175:0/282051309 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0e0003530 con 0x7fd0fc0b2700 2024-04-25T09:14:53.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.583+0000 7fd0fa000640 1 -- 172.21.15.175:0/282051309 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160051998 0 0) 0x7fd0fc15bb60 con 0x7fd0fc0aebd0 2024-04-25T09:14:53.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.583+0000 7fd0fa000640 1 -- 172.21.15.175:0/282051309 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0fc15b880 con 0x7fd0fc0aebd0 2024-04-25T09:14:53.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.583+0000 7fd0fb400640 1 -- 172.21.15.175:0/282051309 >> v1:172.21.15.177:6789/0 conn(0x7fd0fc0aebd0 legacy=0x7fd0fc15b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.572 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.583+0000 7fd0fb400640 1 -- 172.21.15.175:0/282051309 >> v1:172.21.15.175:6789/0 conn(0x7fd0fc0b2700 legacy=0x7fd0fc0b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.583+0000 7fd0fa000640 1 -- 172.21.15.175:0/282051309 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 68634498 0 0) 0x7fd0e0003530 con 0x7fd0fc0b2700 2024-04-25T09:14:53.573 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.583+0000 7fd0fb400640 1 -- 172.21.15.175:0/282051309 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc15c400 con 0x7fd0fc0b4970 2024-04-25T09:14:53.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.583+0000 7fd0fb400640 1 --2- 172.21.15.175:0/282051309 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0fc0b4970 0x7fd0fc165660 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009dc0 tx=0x7fd0f401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afbfe26c7e57ba54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:53.575 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.583+0000 7fd0fa000640 1 -- 172.21.15.175:0/282051309 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4001680 con 0x7fd0fc0b4970 2024-04-25T09:14:53.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.583+0000 7fd0fa000640 1 -- 172.21.15.175:0/282051309 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f40a6500 con 0x7fd0fc0b4970 2024-04-25T09:14:53.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd0fa000640 1 -- 172.21.15.175:0/282051309 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40a68d0 con 0x7fd0fc0b4970 2024-04-25T09:14:53.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd101600640 1 -- 172.21.15.175:0/282051309 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0fc0b4970 msgr2=0x7fd0fc165660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd101600640 1 --2- 172.21.15.175:0/282051309 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0fc0b4970 0x7fd0fc165660 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009dc0 tx=0x7fd0f401c8b0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd101600640 1 -- 172.21.15.175:0/282051309 shutdown_connections 2024-04-25T09:14:53.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd101600640 1 --2- 172.21.15.175:0/282051309 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0fc0b4970 0x7fd0fc165660 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd101600640 1 -- 172.21.15.175:0/282051309 >> 172.21.15.175:0/282051309 conn(0x7fd0fc06ac50 msgr2=0x7fd0fc06b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:53.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd101600640 1 -- 172.21.15.175:0/282051309 shutdown_connections 2024-04-25T09:14:53.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd101600640 1 -- 172.21.15.175:0/282051309 wait complete. 2024-04-25T09:14:53.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd101600640 1 Processor -- start 2024-04-25T09:14:53.577 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd101600640 1 -- start start 2024-04-25T09:14:53.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd101600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0fc0aebd0 0x7fd0fc1450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd101600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0fc0b2700 0x7fd0fc0b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd101600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0fc0b4970 0x7fd0fc0b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd101600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc168b60 con 0x7fd0fc0aebd0 2024-04-25T09:14:53.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd101600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc1689e0 con 0x7fd0fc0b2700 2024-04-25T09:14:53.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd101600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc168ce0 con 0x7fd0fc0b4970 2024-04-25T09:14:53.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd0faa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0fc0aebd0 0x7fd0fc1450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd0faa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0fc0aebd0 0x7fd0fc1450d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45620/0 (socket says 172.21.15.175:45620) 2024-04-25T09:14:53.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd0faa00640 1 -- 172.21.15.175:0/3080456341 learned_addr learned my addr 172.21.15.175:0/3080456341 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:53.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd0faa00640 1 -- 172.21.15.175:0/3080456341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0fc0b4970 msgr2=0x7fd0fc0b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.587+0000 7fd0fb400640 1 --2- 172.21.15.175:0/3080456341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0fc0b4970 0x7fd0fc0b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd0f2000640 1 --2- 172.21.15.175:0/3080456341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0fc0b2700 0x7fd0fc0b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd0faa00640 1 --2- 172.21.15.175:0/3080456341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0fc0b4970 0x7fd0fc0b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd0faa00640 1 -- 172.21.15.175:0/3080456341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0fc0b2700 msgr2=0x7fd0fc0b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd0faa00640 1 --2- 172.21.15.175:0/3080456341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0fc0b2700 0x7fd0fc0b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd0faa00640 1 -- 172.21.15.175:0/3080456341 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc153690 con 0x7fd0fc0aebd0 2024-04-25T09:14:53.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd0fb400640 1 --2- 172.21.15.175:0/3080456341 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0fc0b4970 0x7fd0fc0b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:53.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd0f2000640 1 --2- 172.21.15.175:0/3080456341 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0fc0b2700 0x7fd0fc0b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:53.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd0faa00640 1 --2- 172.21.15.175:0/3080456341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0fc0aebd0 0x7fd0fc1450d0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec00c460 tx=0x7fd0ec00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:53.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd0f3400640 1 -- 172.21.15.175:0/3080456341 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec0052d0 con 0x7fd0fc0aebd0 2024-04-25T09:14:53.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd0f3400640 1 -- 172.21.15.175:0/3080456341 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ec005490 con 0x7fd0fc0aebd0 2024-04-25T09:14:53.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd0f3400640 1 -- 172.21.15.175:0/3080456341 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec012850 con 0x7fd0fc0aebd0 2024-04-25T09:14:53.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd101600640 1 -- 172.21.15.175:0/3080456341 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0fc153970 con 0x7fd0fc0aebd0 2024-04-25T09:14:53.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd101600640 1 -- 172.21.15.175:0/3080456341 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0fc153f30 con 0x7fd0fc0aebd0 2024-04-25T09:14:53.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd101600640 1 -- 172.21.15.175:0/3080456341 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd0fc075160 con 0x7fd0fc0aebd0 2024-04-25T09:14:53.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd0f3400640 1 -- 172.21.15.175:0/3080456341 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd0ec0129f0 con 0x7fd0fc0aebd0 2024-04-25T09:14:53.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd0f3400640 1 --2- 172.21.15.175:0/3080456341 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd0d8066f60 0x7fd0d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd0f3400640 1 -- 172.21.15.175:0/3080456341 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fd0ec0849d0 con 0x7fd0fc0aebd0 2024-04-25T09:14:53.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd0f2000640 1 --2- 172.21.15.175:0/3080456341 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd0d8066f60 0x7fd0d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd0f3400640 1 --2- 172.21.15.175:0/3080456341 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x7fd0d806cf60 0x7fd0d806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd0f3400640 1 -- 172.21.15.175:0/3080456341 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd0ec020e50 con 0x7fd0d806cf60 2024-04-25T09:14:53.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.591+0000 7fd0f3400640 1 -- 172.21.15.175:0/3080456341 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0ec0892c0 con 0x7fd0fc0aebd0 2024-04-25T09:14:53.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.595+0000 7fd0f2000640 1 --2- 172.21.15.175:0/3080456341 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd0d8066f60 0x7fd0d8069420 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40010f0 tx=0x7fd0e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:53.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.595+0000 7fd0fb400640 1 --2- 172.21.15.175:0/3080456341 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x7fd0d806cf60 0x7fd0d806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.595+0000 7fd0fb400640 1 --2- 172.21.15.175:0/3080456341 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x7fd0d806cf60 0x7fd0d806f380 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:53.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.595+0000 7fd0f3400640 1 -- 172.21.15.175:0/3080456341 <== osd.5 v2:172.21.15.177:6816/3311807078 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd0ec020e50 con 0x7fd0d806cf60 2024-04-25T09:14:53.595 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.607+0000 7fd101600640 1 -- 172.21.15.175:0/3080456341 --> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd0fc0b4600 con 0x7fd0d806cf60 2024-04-25T09:14:53.596 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.607+0000 7fd0f3400640 1 -- 172.21.15.175:0/3080456341 <== osd.5 v2:172.21.15.177:6816/3311807078 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd0fc0b4600 con 0x7fd0d806cf60 2024-04-25T09:14:53.597 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:14:53.597 INFO:teuthology.orchestra.run.smithi175.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:14:53.597 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:14:53.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.607+0000 7fd101600640 1 -- 172.21.15.175:0/3080456341 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x7fd0d806cf60 msgr2=0x7fd0d806f380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.611+0000 7fd101600640 1 --2- 172.21.15.175:0/3080456341 >> [v2:172.21.15.177:6816/3311807078,v1:172.21.15.177:6817/3311807078] conn(0x7fd0d806cf60 0x7fd0d806f380 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.611+0000 7fd101600640 1 -- 172.21.15.175:0/3080456341 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd0d8066f60 msgr2=0x7fd0d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.611+0000 7fd101600640 1 --2- 172.21.15.175:0/3080456341 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fd0d8066f60 0x7fd0d8069420 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40010f0 tx=0x7fd0e4009040 comp rx=0 tx=0).stop 2024-04-25T09:14:53.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.611+0000 7fd101600640 1 -- 172.21.15.175:0/3080456341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0fc0aebd0 msgr2=0x7fd0fc1450d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.598 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.611+0000 7fd101600640 1 --2- 172.21.15.175:0/3080456341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0fc0aebd0 0x7fd0fc1450d0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec00c460 tx=0x7fd0ec00c920 comp rx=0 tx=0).stop 2024-04-25T09:14:53.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.611+0000 7fd0fb400640 1 -- 172.21.15.175:0/3080456341 reap_dead start 2024-04-25T09:14:53.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.611+0000 7fd101600640 1 -- 172.21.15.175:0/3080456341 shutdown_connections 2024-04-25T09:14:53.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.611+0000 7fd101600640 1 -- 172.21.15.175:0/3080456341 >> 172.21.15.175:0/3080456341 conn(0x7fd0fc06ac50 msgr2=0x7fd0fc0712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:53.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.611+0000 7fd101600640 1 -- 172.21.15.175:0/3080456341 shutdown_connections 2024-04-25T09:14:53.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.611+0000 7fd101600640 1 -- 172.21.15.175:0/3080456341 wait complete. 2024-04-25T09:14:53.615 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T09:14:53.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.763+0000 7f83a6800640 1 Processor -- start 2024-04-25T09:14:53.751 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.763+0000 7f83a6800640 1 -- start start 2024-04-25T09:14:53.753 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.763+0000 7f83a6800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83a015df60 0x7f83a00cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.763+0000 7f83a6800640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f83a00b2940 0x7f83a006c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.763+0000 7f83a6800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a009aee0 con 0x7f83a00b2310 2024-04-25T09:14:53.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.763+0000 7f83a6800640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a006c000 con 0x7f83a00b2940 2024-04-25T09:14:53.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.763+0000 7f83a6800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a015ee90 con 0x7f83a015df60 2024-04-25T09:14:53.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.763+0000 7f83a5e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f83a00b2310 0x7f83a0099a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:60016/0 (socket says 172.21.15.175:60016) 2024-04-25T09:14:53.754 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.763+0000 7f83a5e00640 1 -- 172.21.15.175:0/3235734877 learned_addr learned my addr 172.21.15.175:0/3235734877 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:53.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.763+0000 7f83a5400640 1 --2- 172.21.15.175:0/3235734877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83a015df60 0x7f83a00cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.763+0000 7f83a4a00640 1 --2- 172.21.15.175:0/3235734877 >> v2:172.21.15.177:3300/0 conn(0x7f83a00b2940 0x7f83a006c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.763+0000 7f839fe00640 1 -- 172.21.15.175:0/3235734877 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930284175 0 0) 0x7f83a009aee0 con 0x7f83a00b2310 2024-04-25T09:14:53.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.763+0000 7f839fe00640 1 -- 172.21.15.175:0/3235734877 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8388003530 con 0x7f83a00b2310 2024-04-25T09:14:53.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.763+0000 7f83a5400640 1 -- 172.21.15.175:0/3235734877 >> v2:172.21.15.177:3300/0 conn(0x7f83a00b2940 msgr2=0x7f83a006c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:53.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.763+0000 7f83a5400640 1 --2- 172.21.15.175:0/3235734877 >> v2:172.21.15.177:3300/0 conn(0x7f83a00b2940 0x7f83a006c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.763+0000 7f83a5400640 1 -- 172.21.15.175:0/3235734877 >> v1:172.21.15.175:6789/0 conn(0x7f83a00b2310 legacy=0x7f83a0099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.755 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.763+0000 7f83a5400640 1 -- 172.21.15.175:0/3235734877 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a015f170 con 0x7f83a015df60 2024-04-25T09:14:53.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.767+0000 7f83a5400640 1 --2- 172.21.15.175:0/3235734877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83a015df60 0x7f83a00cf810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f83940097c0 tx=0x7f839401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cff6e01f7212190 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:53.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.767+0000 7f839fe00640 1 -- 172.21.15.175:0/3235734877 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a009aca0 con 0x7f83a015df60 2024-04-25T09:14:53.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.767+0000 7f839fe00640 1 -- 172.21.15.175:0/3235734877 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83940af070 con 0x7f83a015df60 2024-04-25T09:14:53.757 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.767+0000 7f839fe00640 1 -- 172.21.15.175:0/3235734877 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83940aa810 con 0x7f83a015df60 2024-04-25T09:14:53.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a6800640 1 -- 172.21.15.175:0/3235734877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83a015df60 msgr2=0x7f83a00cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a6800640 1 --2- 172.21.15.175:0/3235734877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83a015df60 0x7f83a00cf810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f83940097c0 tx=0x7f839401c470 comp rx=0 tx=0).stop 2024-04-25T09:14:53.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a6800640 1 -- 172.21.15.175:0/3235734877 shutdown_connections 2024-04-25T09:14:53.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a6800640 1 --2- 172.21.15.175:0/3235734877 >> v2:172.21.15.177:3300/0 conn(0x7f83a00b2940 0x7f83a006c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a6800640 1 --2- 172.21.15.175:0/3235734877 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83a015df60 0x7f83a00cf810 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.759 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a6800640 1 -- 172.21.15.175:0/3235734877 >> 172.21.15.175:0/3235734877 conn(0x7f83a00b30e0 msgr2=0x7f83a00b34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:53.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a6800640 1 -- 172.21.15.175:0/3235734877 shutdown_connections 2024-04-25T09:14:53.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a6800640 1 -- 172.21.15.175:0/3235734877 wait complete. 2024-04-25T09:14:53.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a6800640 1 Processor -- start 2024-04-25T09:14:53.760 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a6800640 1 -- start start 2024-04-25T09:14:53.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a6800640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83a00b2310 0x7f83a0154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a6800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83a00b2940 0x7f83a00cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a6800640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83a015df60 0x7f83a00b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a6800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00cfd50 con 0x7f83a00b2940 2024-04-25T09:14:53.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a6800640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a009a3b0 con 0x7f83a015df60 2024-04-25T09:14:53.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a6800640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a00cfed0 con 0x7f83a00b2310 2024-04-25T09:14:53.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a4a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83a00b2940 0x7f83a00cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a4a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83a00b2940 0x7f83a00cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45622/0 (socket says 172.21.15.175:45622) 2024-04-25T09:14:53.762 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a4a00640 1 -- 172.21.15.175:0/2199642426 learned_addr learned my addr 172.21.15.175:0/2199642426 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a5400640 1 --2- 172.21.15.175:0/2199642426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83a00b2310 0x7f83a0154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a5e00640 1 --2- 172.21.15.175:0/2199642426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83a015df60 0x7f83a00b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a4a00640 1 -- 172.21.15.175:0/2199642426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83a00b2310 msgr2=0x7f83a0154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a4a00640 1 --2- 172.21.15.175:0/2199642426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83a00b2310 0x7f83a0154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a4a00640 1 -- 172.21.15.175:0/2199642426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83a015df60 msgr2=0x7f83a00b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a4a00640 1 --2- 172.21.15.175:0/2199642426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83a015df60 0x7f83a00b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a4a00640 1 -- 172.21.15.175:0/2199642426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a01fa2f0 con 0x7f83a00b2940 2024-04-25T09:14:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a5e00640 1 --2- 172.21.15.175:0/2199642426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83a015df60 0x7f83a00b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.771+0000 7f83a4a00640 1 --2- 172.21.15.175:0/2199642426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83a00b2940 0x7f83a00cae50 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f838c00e840 tx=0x7f838c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.775+0000 7f839d600640 1 -- 172.21.15.175:0/2199642426 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c017070 con 0x7f83a00b2940 2024-04-25T09:14:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.775+0000 7f839d600640 1 -- 172.21.15.175:0/2199642426 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c00ee90 con 0x7f83a00b2940 2024-04-25T09:14:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.775+0000 7f839d600640 1 -- 172.21.15.175:0/2199642426 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c00cb80 con 0x7f83a00b2940 2024-04-25T09:14:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.775+0000 7f83a6800640 1 -- 172.21.15.175:0/2199642426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a01fa5d0 con 0x7f83a00b2940 2024-04-25T09:14:53.763 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.775+0000 7f83a6800640 1 -- 172.21.15.175:0/2199642426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a01fab90 con 0x7f83a00b2940 2024-04-25T09:14:53.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.775+0000 7f83a6800640 1 -- 172.21.15.175:0/2199642426 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a0074a60 con 0x7f83a00b2940 2024-04-25T09:14:53.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.775+0000 7f839d600640 1 -- 172.21.15.175:0/2199642426 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f838c01a070 con 0x7f83a00b2940 2024-04-25T09:14:53.764 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.775+0000 7f839d600640 1 --2- 172.21.15.175:0/2199642426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8380066f60 0x7f8380069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:53.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.775+0000 7f839d600640 1 -- 172.21.15.175:0/2199642426 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f838c084c30 con 0x7f83a00b2940 2024-04-25T09:14:53.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.775+0000 7f83a5400640 1 --2- 172.21.15.175:0/2199642426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8380066f60 0x7f8380069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:53.765 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.775+0000 7f83a5400640 1 --2- 172.21.15.175:0/2199642426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8380066f60 0x7f8380069420 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f83940ae000 tx=0x7f83940a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:53.768 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.779+0000 7f839d600640 1 -- 172.21.15.175:0/2199642426 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f838c055f20 con 0x7f83a00b2940 2024-04-25T09:14:53.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.931+0000 7f83a6800640 1 -- 172.21.15.175:0/2199642426 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f83a00b3ff0 con 0x7f8380066f60 2024-04-25T09:14:53.921 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.935+0000 7f839d600640 1 -- 172.21.15.175:0/2199642426 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f83a00b3ff0 con 0x7f8380066f60 2024-04-25T09:14:53.921 INFO:teuthology.orchestra.run.smithi175.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T09:14:53.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.935+0000 7f83a6800640 1 -- 172.21.15.175:0/2199642426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8380066f60 msgr2=0x7f8380069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.935+0000 7f83a6800640 1 --2- 172.21.15.175:0/2199642426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8380066f60 0x7f8380069420 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f83940ae000 tx=0x7f83940a7000 comp rx=0 tx=0).stop 2024-04-25T09:14:53.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.935+0000 7f83a6800640 1 -- 172.21.15.175:0/2199642426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83a00b2940 msgr2=0x7f83a00cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:53.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.935+0000 7f83a6800640 1 --2- 172.21.15.175:0/2199642426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83a00b2940 0x7f83a00cae50 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f838c00e840 tx=0x7f838c00ec40 comp rx=0 tx=0).stop 2024-04-25T09:14:53.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.935+0000 7f83a6800640 1 -- 172.21.15.175:0/2199642426 shutdown_connections 2024-04-25T09:14:53.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.935+0000 7f83a6800640 1 --2- 172.21.15.175:0/2199642426 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8380066f60 0x7f8380069420 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.935+0000 7f83a6800640 1 --2- 172.21.15.175:0/2199642426 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83a015df60 0x7f83a00b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.924 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.935+0000 7f83a6800640 1 --2- 172.21.15.175:0/2199642426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f83a00b2940 0x7f83a00cae50 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.935+0000 7f83a6800640 1 --2- 172.21.15.175:0/2199642426 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83a00b2310 0x7f83a0154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:53.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.935+0000 7f83a6800640 1 -- 172.21.15.175:0/2199642426 >> 172.21.15.175:0/2199642426 conn(0x7f83a00b30e0 msgr2=0x7f83a006f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:53.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.935+0000 7f83a6800640 1 -- 172.21.15.175:0/2199642426 shutdown_connections 2024-04-25T09:14:53.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:53.935+0000 7f83a6800640 1 -- 172.21.15.175:0/2199642426 wait complete. 2024-04-25T09:14:53.946 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T09:14:53.946 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:14:54.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.099+0000 7fc969c00640 1 Processor -- start 2024-04-25T09:14:54.088 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.099+0000 7fc969c00640 1 -- start start 2024-04-25T09:14:54.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc969c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9640aebd0 0x7fc96415b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc969c00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc9640b2700 0x7fc9640b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc969c00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc9640b47a0 0x7fc96406d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc969c00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9640b4be0 con 0x7fc9640b47a0 2024-04-25T09:14:54.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc969c00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96415b880 con 0x7fc9640b2700 2024-04-25T09:14:54.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc969c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96415bb60 con 0x7fc9640aebd0 2024-04-25T09:14:54.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc963400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc9640b47a0 0x7fc96406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.090 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc963400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc9640b47a0 0x7fc96406d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45634/0 (socket says 172.21.15.175:45634) 2024-04-25T09:14:54.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc963400640 1 -- 172.21.15.175:0/798566605 learned_addr learned my addr 172.21.15.175:0/798566605 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:54.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc962000640 1 --2- 172.21.15.175:0/798566605 >> v2:172.21.15.177:3300/0 conn(0x7fc9640b2700 0x7fc9640b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc962a00640 1 --2- 172.21.15.175:0/798566605 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9640aebd0 0x7fc96415b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc963400640 1 -- 172.21.15.175:0/798566605 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9640aebd0 msgr2=0x7fc96415b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:54.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc963400640 1 --2- 172.21.15.175:0/798566605 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9640aebd0 0x7fc96415b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc963400640 1 -- 172.21.15.175:0/798566605 >> v2:172.21.15.177:3300/0 conn(0x7fc9640b2700 msgr2=0x7fc9640b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:54.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc963400640 1 --2- 172.21.15.175:0/798566605 >> v2:172.21.15.177:3300/0 conn(0x7fc9640b2700 0x7fc9640b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc963400640 1 -- 172.21.15.175:0/798566605 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96415be40 con 0x7fc9640b47a0 2024-04-25T09:14:54.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc962a00640 1 --2- 172.21.15.175:0/798566605 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9640aebd0 0x7fc96415b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:54.091 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc962000640 1 --2- 172.21.15.175:0/798566605 >> v2:172.21.15.177:3300/0 conn(0x7fc9640b2700 0x7fc9640b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:54.092 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc963400640 1 --2- 172.21.15.175:0/798566605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9640b47a0 0x7fc96406d310 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fc96406d150 tx=0x7fc95c01e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634b922ddfa737bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:54.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc961600640 1 -- 172.21.15.175:0/798566605 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0b4070 con 0x7fc9640b47a0 2024-04-25T09:14:54.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc961600640 1 -- 172.21.15.175:0/798566605 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c0a77e0 con 0x7fc9640b47a0 2024-04-25T09:14:54.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.103+0000 7fc961600640 1 -- 172.21.15.175:0/798566605 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0a7bb0 con 0x7fc9640b47a0 2024-04-25T09:14:54.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc969c00640 1 -- 172.21.15.175:0/798566605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9640b47a0 msgr2=0x7fc96406d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc969c00640 1 --2- 172.21.15.175:0/798566605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9640b47a0 0x7fc96406d310 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7fc96406d150 tx=0x7fc95c01e8a0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc969c00640 1 -- 172.21.15.175:0/798566605 shutdown_connections 2024-04-25T09:14:54.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc969c00640 1 --2- 172.21.15.175:0/798566605 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9640b47a0 0x7fc96406d310 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc969c00640 1 --2- 172.21.15.175:0/798566605 >> v2:172.21.15.177:3300/0 conn(0x7fc9640b2700 0x7fc9640b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc969c00640 1 --2- 172.21.15.175:0/798566605 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9640aebd0 0x7fc96415b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc969c00640 1 -- 172.21.15.175:0/798566605 >> 172.21.15.175:0/798566605 conn(0x7fc96406ac50 msgr2=0x7fc96406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:54.094 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc969c00640 1 -- 172.21.15.175:0/798566605 shutdown_connections 2024-04-25T09:14:54.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc969c00640 1 -- 172.21.15.175:0/798566605 wait complete. 2024-04-25T09:14:54.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc969c00640 1 Processor -- start 2024-04-25T09:14:54.095 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc969c00640 1 -- start start 2024-04-25T09:14:54.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc969c00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9640aebd0 0x7fc9640cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc969c00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9640b2700 0x7fc9641f9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc969c00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9640b47a0 0x7fc9640ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc969c00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc964071430 con 0x7fc9640aebd0 2024-04-25T09:14:54.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc969c00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640712b0 con 0x7fc9640b47a0 2024-04-25T09:14:54.098 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc969c00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640715b0 con 0x7fc9640b2700 2024-04-25T09:14:54.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc962a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9640aebd0 0x7fc9640cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc962a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9640aebd0 0x7fc9640cb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45648/0 (socket says 172.21.15.175:45648) 2024-04-25T09:14:54.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc962a00640 1 -- 172.21.15.175:0/1188761669 learned_addr learned my addr 172.21.15.175:0/1188761669 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:54.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc962000640 1 --2- 172.21.15.175:0/1188761669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9640b2700 0x7fc9641f9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.107+0000 7fc963400640 1 --2- 172.21.15.175:0/1188761669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9640b47a0 0x7fc9640ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc962a00640 1 -- 172.21.15.175:0/1188761669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9640b2700 msgr2=0x7fc9641f9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc962a00640 1 --2- 172.21.15.175:0/1188761669 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc9640b2700 0x7fc9641f9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc962a00640 1 -- 172.21.15.175:0/1188761669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9640b47a0 msgr2=0x7fc9640ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc962a00640 1 --2- 172.21.15.175:0/1188761669 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc9640b47a0 0x7fc9640ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc962a00640 1 -- 172.21.15.175:0/1188761669 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9641f9e50 con 0x7fc9640aebd0 2024-04-25T09:14:54.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc962a00640 1 --2- 172.21.15.175:0/1188761669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9640aebd0 0x7fc9640cb1c0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fc954007ef0 tx=0x7fc95400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:54.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc95aa00640 1 -- 172.21.15.175:0/1188761669 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95401a070 con 0x7fc9640aebd0 2024-04-25T09:14:54.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc95aa00640 1 -- 172.21.15.175:0/1188761669 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc954003ba0 con 0x7fc9640aebd0 2024-04-25T09:14:54.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc95aa00640 1 -- 172.21.15.175:0/1188761669 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954004030 con 0x7fc9640aebd0 2024-04-25T09:14:54.099 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc969c00640 1 -- 172.21.15.175:0/1188761669 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9641fa0f0 con 0x7fc9640aebd0 2024-04-25T09:14:54.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc969c00640 1 -- 172.21.15.175:0/1188761669 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9641fa6b0 con 0x7fc9640aebd0 2024-04-25T09:14:54.100 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc969c00640 1 -- 172.21.15.175:0/1188761669 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc964075160 con 0x7fc9640aebd0 2024-04-25T09:14:54.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc95aa00640 1 -- 172.21.15.175:0/1188761669 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc95401d070 con 0x7fc9640aebd0 2024-04-25T09:14:54.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc95aa00640 1 --2- 172.21.15.175:0/1188761669 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc944066f60 0x7fc944069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc95aa00640 1 -- 172.21.15.175:0/1188761669 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fc954085080 con 0x7fc9640aebd0 2024-04-25T09:14:54.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc962000640 1 --2- 172.21.15.175:0/1188761669 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc944066f60 0x7fc944069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc95aa00640 1 --2- 172.21.15.175:0/1188761669 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x7fc94406cf60 0x7fc94406f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc95aa00640 1 -- 172.21.15.175:0/1188761669 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc954006ba0 con 0x7fc94406cf60 2024-04-25T09:14:54.101 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.111+0000 7fc95aa00640 1 -- 172.21.15.175:0/1188761669 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc95408c050 con 0x7fc9640aebd0 2024-04-25T09:14:54.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.115+0000 7fc963400640 1 --2- 172.21.15.175:0/1188761669 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x7fc94406cf60 0x7fc94406f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.115+0000 7fc962000640 1 --2- 172.21.15.175:0/1188761669 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc944066f60 0x7fc944069420 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc96414b420 tx=0x7fc950008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:54.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.115+0000 7fc963400640 1 --2- 172.21.15.175:0/1188761669 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x7fc94406cf60 0x7fc94406f380 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:54.102 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.115+0000 7fc95aa00640 1 -- 172.21.15.175:0/1188761669 <== osd.6 v2:172.21.15.177:6822/4132808595 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc954006ba0 con 0x7fc94406cf60 2024-04-25T09:14:54.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.127+0000 7fc969c00640 1 -- 172.21.15.175:0/1188761669 --> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc964148f20 con 0x7fc94406cf60 2024-04-25T09:14:54.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.127+0000 7fc95aa00640 1 -- 172.21.15.175:0/1188761669 <== osd.6 v2:172.21.15.177:6822/4132808595 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc964148f20 con 0x7fc94406cf60 2024-04-25T09:14:54.117 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:14:54.117 INFO:teuthology.orchestra.run.smithi175.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:14:54.117 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:14:54.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.127+0000 7fc969c00640 1 -- 172.21.15.175:0/1188761669 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x7fc94406cf60 msgr2=0x7fc94406f380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.127+0000 7fc969c00640 1 --2- 172.21.15.175:0/1188761669 >> [v2:172.21.15.177:6822/4132808595,v1:172.21.15.177:6824/4132808595] conn(0x7fc94406cf60 0x7fc94406f380 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.127+0000 7fc969c00640 1 -- 172.21.15.175:0/1188761669 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc944066f60 msgr2=0x7fc944069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.127+0000 7fc969c00640 1 --2- 172.21.15.175:0/1188761669 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7fc944066f60 0x7fc944069420 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc96414b420 tx=0x7fc950008040 comp rx=0 tx=0).stop 2024-04-25T09:14:54.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.127+0000 7fc969c00640 1 -- 172.21.15.175:0/1188761669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9640aebd0 msgr2=0x7fc9640cb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.127+0000 7fc969c00640 1 --2- 172.21.15.175:0/1188761669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc9640aebd0 0x7fc9640cb1c0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fc954007ef0 tx=0x7fc95400d4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.127+0000 7fc963400640 1 -- 172.21.15.175:0/1188761669 reap_dead start 2024-04-25T09:14:54.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.131+0000 7fc969c00640 1 -- 172.21.15.175:0/1188761669 shutdown_connections 2024-04-25T09:14:54.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.131+0000 7fc969c00640 1 -- 172.21.15.175:0/1188761669 >> 172.21.15.175:0/1188761669 conn(0x7fc96406ac50 msgr2=0x7fc9640ae1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:54.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.131+0000 7fc969c00640 1 -- 172.21.15.175:0/1188761669 shutdown_connections 2024-04-25T09:14:54.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.131+0000 7fc969c00640 1 -- 172.21.15.175:0/1188761669 wait complete. 2024-04-25T09:14:54.135 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T09:14:54.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.283+0000 7f87bf400640 1 Processor -- start 2024-04-25T09:14:54.271 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.283+0000 7f87bf400640 1 -- start start 2024-04-25T09:14:54.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.283+0000 7f87bf400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f87b80cf6b0 0x7f87b81600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.283+0000 7f87bf400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f87b80ce970 0x7f87b80cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.283+0000 7f87bf400640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b80cfd10 con 0x7f87b8145250 2024-04-25T09:14:54.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.283+0000 7f87bf400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b81605e0 con 0x7f87b80ce970 2024-04-25T09:14:54.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.283+0000 7f87bf400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b815f650 con 0x7f87b80cf6b0 2024-04-25T09:14:54.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.287+0000 7f87bd400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f87b80ce970 0x7f87b80cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.273 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.287+0000 7f87bd400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f87b80ce970 0x7f87b80cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45658/0 (socket says 172.21.15.175:45658) 2024-04-25T09:14:54.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.287+0000 7f87bd400640 1 -- 172.21.15.175:0/2873202703 learned_addr learned my addr 172.21.15.175:0/2873202703 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:54.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.287+0000 7f87bca00640 1 --1- 172.21.15.175:0/2873202703 >> v1:172.21.15.175:6789/0 conn(0x7f87b8145250 0x7f87b80cc410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:60032/0 (socket says 172.21.15.175:60032) 2024-04-25T09:14:54.274 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.287+0000 7f87afe00640 1 --2- 172.21.15.175:0/2873202703 >> v2:172.21.15.177:3300/0 conn(0x7f87b80cf6b0 0x7f87b81600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.287+0000 7f87bd400640 1 -- 172.21.15.175:0/2873202703 >> v2:172.21.15.177:3300/0 conn(0x7f87b80cf6b0 msgr2=0x7f87b81600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:54.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.287+0000 7f87bd400640 1 --2- 172.21.15.175:0/2873202703 >> v2:172.21.15.177:3300/0 conn(0x7f87b80cf6b0 0x7f87b81600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.287+0000 7f87bd400640 1 -- 172.21.15.175:0/2873202703 >> v1:172.21.15.175:6789/0 conn(0x7f87b8145250 legacy=0x7f87b80cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.287+0000 7f87bd400640 1 -- 172.21.15.175:0/2873202703 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b80cfff0 con 0x7f87b80ce970 2024-04-25T09:14:54.275 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.287+0000 7f87b7e00640 1 -- 172.21.15.175:0/2873202703 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3562311309 0 0) 0x7f87b80cfd10 con 0x7f87b8145250 2024-04-25T09:14:54.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.287+0000 7f87bd400640 1 --2- 172.21.15.175:0/2873202703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87b80ce970 0x7f87b80cedc0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009e50 tx=0x7f87b001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb0a8198f195b75 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:54.277 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.287+0000 7f87b7e00640 1 -- 172.21.15.175:0/2873202703 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b00a5710 con 0x7f87b80ce970 2024-04-25T09:14:54.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.287+0000 7f87b7e00640 1 -- 172.21.15.175:0/2873202703 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b00a58b0 con 0x7f87b80ce970 2024-04-25T09:14:54.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.287+0000 7f87b7e00640 1 -- 172.21.15.175:0/2873202703 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b00a5c80 con 0x7f87b80ce970 2024-04-25T09:14:54.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bf400640 1 -- 172.21.15.175:0/2873202703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87b80ce970 msgr2=0x7f87b80cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bf400640 1 --2- 172.21.15.175:0/2873202703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87b80ce970 0x7f87b80cedc0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009e50 tx=0x7f87b001c960 comp rx=0 tx=0).stop 2024-04-25T09:14:54.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bf400640 1 -- 172.21.15.175:0/2873202703 shutdown_connections 2024-04-25T09:14:54.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bf400640 1 --2- 172.21.15.175:0/2873202703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87b80ce970 0x7f87b80cedc0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bf400640 1 --2- 172.21.15.175:0/2873202703 >> v2:172.21.15.177:3300/0 conn(0x7f87b80cf6b0 0x7f87b81600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bf400640 1 -- 172.21.15.175:0/2873202703 >> 172.21.15.175:0/2873202703 conn(0x7f87b806ac50 msgr2=0x7f87b806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:54.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bf400640 1 -- 172.21.15.175:0/2873202703 shutdown_connections 2024-04-25T09:14:54.278 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bf400640 1 -- 172.21.15.175:0/2873202703 wait complete. 2024-04-25T09:14:54.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bf400640 1 Processor -- start 2024-04-25T09:14:54.279 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bf400640 1 -- start start 2024-04-25T09:14:54.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bf400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87b80ce970 0x7f87b8143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bf400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87b80cf6b0 0x7f87b80af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bf400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87b8145250 0x7f87b80af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bf400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b815c870 con 0x7f87b8145250 2024-04-25T09:14:54.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bf400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b8145630 con 0x7f87b80cf6b0 2024-04-25T09:14:54.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bf400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b815c9f0 con 0x7f87b80ce970 2024-04-25T09:14:54.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bd400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87b8145250 0x7f87b80af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bd400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87b8145250 0x7f87b80af810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45672/0 (socket says 172.21.15.175:45672) 2024-04-25T09:14:54.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bd400640 1 -- 172.21.15.175:0/1761574012 learned_addr learned my addr 172.21.15.175:0/1761574012 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:54.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87afe00640 1 --2- 172.21.15.175:0/1761574012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87b80cf6b0 0x7f87b80af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.282 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bca00640 1 --2- 172.21.15.175:0/1761574012 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87b80ce970 0x7f87b8143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bd400640 1 -- 172.21.15.175:0/1761574012 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87b80ce970 msgr2=0x7f87b8143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bd400640 1 --2- 172.21.15.175:0/1761574012 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87b80ce970 0x7f87b8143850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bd400640 1 -- 172.21.15.175:0/1761574012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87b80cf6b0 msgr2=0x7f87b80af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bd400640 1 --2- 172.21.15.175:0/1761574012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87b80cf6b0 0x7f87b80af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bd400640 1 -- 172.21.15.175:0/1761574012 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b81427b0 con 0x7f87b8145250 2024-04-25T09:14:54.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bca00640 1 --2- 172.21.15.175:0/1761574012 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87b80ce970 0x7f87b8143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:14:54.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87afe00640 1 --2- 172.21.15.175:0/1761574012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87b80cf6b0 0x7f87b80af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:54.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.291+0000 7f87bd400640 1 --2- 172.21.15.175:0/1761574012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87b8145250 0x7f87b80af810 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f87b0019570 tx=0x7f87b0019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:54.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.295+0000 7f87b5600640 1 -- 172.21.15.175:0/1761574012 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b00bc030 con 0x7f87b8145250 2024-04-25T09:14:54.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.295+0000 7f87b5600640 1 -- 172.21.15.175:0/1761574012 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b00b8470 con 0x7f87b8145250 2024-04-25T09:14:54.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.295+0000 7f87bf400640 1 -- 172.21.15.175:0/1761574012 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b8142a90 con 0x7f87b8145250 2024-04-25T09:14:54.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.295+0000 7f87b5600640 1 -- 172.21.15.175:0/1761574012 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b00b8860 con 0x7f87b8145250 2024-04-25T09:14:54.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.295+0000 7f87bf400640 1 -- 172.21.15.175:0/1761574012 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b8143050 con 0x7f87b8145250 2024-04-25T09:14:54.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.295+0000 7f87bf400640 1 -- 172.21.15.175:0/1761574012 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b8075160 con 0x7f87b8145250 2024-04-25T09:14:54.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.295+0000 7f87b5600640 1 -- 172.21.15.175:0/1761574012 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f87b00bf070 con 0x7f87b8145250 2024-04-25T09:14:54.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.295+0000 7f87b5600640 1 --2- 172.21.15.175:0/1761574012 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8794066f60 0x7f8794069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.295+0000 7f87b5600640 1 -- 172.21.15.175:0/1761574012 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f87b011fbb0 con 0x7f87b8145250 2024-04-25T09:14:54.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.295+0000 7f87bca00640 1 --2- 172.21.15.175:0/1761574012 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8794066f60 0x7f8794069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.285 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.295+0000 7f87bca00640 1 --2- 172.21.15.175:0/1761574012 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8794066f60 0x7f8794069420 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f87a8007fd0 tx=0x7f87a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:54.288 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.299+0000 7f87b5600640 1 -- 172.21.15.175:0/1761574012 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f87b00c6070 con 0x7f87b8145250 2024-04-25T09:14:54.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.455+0000 7f87bf400640 1 -- 172.21.15.175:0/1761574012 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f87b80676b0 con 0x7f8794066f60 2024-04-25T09:14:54.441 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.455+0000 7f87b5600640 1 -- 172.21.15.175:0/1761574012 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f87b80676b0 con 0x7f8794066f60 2024-04-25T09:14:54.442 INFO:teuthology.orchestra.run.smithi175.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T09:14:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.455+0000 7f87bf400640 1 -- 172.21.15.175:0/1761574012 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8794066f60 msgr2=0x7f8794069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.455+0000 7f87bf400640 1 --2- 172.21.15.175:0/1761574012 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8794066f60 0x7f8794069420 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f87a8007fd0 tx=0x7f87a8009040 comp rx=0 tx=0).stop 2024-04-25T09:14:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.455+0000 7f87bf400640 1 -- 172.21.15.175:0/1761574012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87b8145250 msgr2=0x7f87b80af810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.455+0000 7f87bf400640 1 --2- 172.21.15.175:0/1761574012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87b8145250 0x7f87b80af810 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f87b0019570 tx=0x7f87b0019700 comp rx=0 tx=0).stop 2024-04-25T09:14:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.455+0000 7f87bf400640 1 -- 172.21.15.175:0/1761574012 shutdown_connections 2024-04-25T09:14:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.455+0000 7f87bf400640 1 --2- 172.21.15.175:0/1761574012 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f8794066f60 0x7f8794069420 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.455+0000 7f87bf400640 1 --2- 172.21.15.175:0/1761574012 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87b8145250 0x7f87b80af810 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.455+0000 7f87bf400640 1 --2- 172.21.15.175:0/1761574012 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f87b80cf6b0 0x7f87b80af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.455+0000 7f87bf400640 1 --2- 172.21.15.175:0/1761574012 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f87b80ce970 0x7f87b8143850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.455+0000 7f87bf400640 1 -- 172.21.15.175:0/1761574012 >> 172.21.15.175:0/1761574012 conn(0x7f87b806ac50 msgr2=0x7f87b806b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:54.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.455+0000 7f87bf400640 1 -- 172.21.15.175:0/1761574012 shutdown_connections 2024-04-25T09:14:54.445 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.455+0000 7f87bf400640 1 -- 172.21.15.175:0/1761574012 wait complete. 2024-04-25T09:14:54.464 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T09:14:54.464 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:14:54.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.615+0000 7f507d600640 1 Processor -- start 2024-04-25T09:14:54.603 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.615+0000 7f507d600640 1 -- start start 2024-04-25T09:14:54.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.615+0000 7f507d600640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f50780cfb60 0x7f50780ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.615+0000 7f507d600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f507806d860 0x7f507806dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.615+0000 7f507d600640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507806e1a0 con 0x7f50780ced10 2024-04-25T09:14:54.604 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.615+0000 7f507d600640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50780cbed0 con 0x7f50780cfb60 2024-04-25T09:14:54.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.615+0000 7f507d600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5078071e20 con 0x7f507806d860 2024-04-25T09:14:54.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.615+0000 7f5076a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f50780cfb60 0x7f50780ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.615+0000 7f5076000640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f50780ced10 0x7f50780712b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:47136/0 (socket says 172.21.15.175:47136) 2024-04-25T09:14:54.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.615+0000 7f5077400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f507806d860 0x7f507806dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.615+0000 7f5076000640 1 -- 172.21.15.175:0/1461659390 learned_addr learned my addr 172.21.15.175:0/1461659390 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:54.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.619+0000 7f5076a00640 1 -- 172.21.15.175:0/1461659390 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f507806d860 msgr2=0x7f507806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:54.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.619+0000 7f5076a00640 1 --2- 172.21.15.175:0/1461659390 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f507806d860 0x7f507806dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.619+0000 7f5076a00640 1 -- 172.21.15.175:0/1461659390 >> v1:172.21.15.177:6789/0 conn(0x7f50780ced10 legacy=0x7f50780712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.619+0000 7f5076a00640 1 -- 172.21.15.175:0/1461659390 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5078072100 con 0x7f50780cfb60 2024-04-25T09:14:54.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.619+0000 7f5076a00640 1 --2- 172.21.15.175:0/1461659390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50780cfb60 0x7f50780ce7d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5068009d90 tx=0x7f506801c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e02d755c104b84d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:54.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.619+0000 7f5075600640 1 -- 172.21.15.175:0/1461659390 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50680b2070 con 0x7f50780cfb60 2024-04-25T09:14:54.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.619+0000 7f5075600640 1 -- 172.21.15.175:0/1461659390 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50680a5990 con 0x7f50780cfb60 2024-04-25T09:14:54.609 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.619+0000 7f5075600640 1 -- 172.21.15.175:0/1461659390 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50680a5d60 con 0x7f50780cfb60 2024-04-25T09:14:54.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f507d600640 1 -- 172.21.15.175:0/1461659390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50780cfb60 msgr2=0x7f50780ce7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f507d600640 1 --2- 172.21.15.175:0/1461659390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50780cfb60 0x7f50780ce7d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5068009d90 tx=0x7f506801c8b0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f507d600640 1 -- 172.21.15.175:0/1461659390 shutdown_connections 2024-04-25T09:14:54.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f507d600640 1 --2- 172.21.15.175:0/1461659390 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f507806d860 0x7f507806dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f507d600640 1 --2- 172.21.15.175:0/1461659390 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50780cfb60 0x7f50780ce7d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f507d600640 1 -- 172.21.15.175:0/1461659390 >> 172.21.15.175:0/1461659390 conn(0x7f507806ac50 msgr2=0x7f507806b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:54.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f507d600640 1 -- 172.21.15.175:0/1461659390 shutdown_connections 2024-04-25T09:14:54.610 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f507d600640 1 -- 172.21.15.175:0/1461659390 wait complete. 2024-04-25T09:14:54.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f507d600640 1 Processor -- start 2024-04-25T09:14:54.611 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f507d600640 1 -- start start 2024-04-25T09:14:54.613 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f507d600640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f507806d860 0x7f5078139230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f507d600640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50780ced10 0x7f5078164ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f507d600640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50780cfb60 0x7f507815d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f507d600640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50780d00c0 con 0x7f50780ced10 2024-04-25T09:14:54.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f507d600640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50780cff40 con 0x7f50780cfb60 2024-04-25T09:14:54.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f507d600640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50780719c0 con 0x7f507806d860 2024-04-25T09:14:54.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f5076000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50780ced10 0x7f5078164ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f5076000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50780ced10 0x7f5078164ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45682/0 (socket says 172.21.15.175:45682) 2024-04-25T09:14:54.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f5076000640 1 -- 172.21.15.175:0/3740639970 learned_addr learned my addr 172.21.15.175:0/3740639970 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:54.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f5076a00640 1 --2- 172.21.15.175:0/3740639970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f507806d860 0x7f5078139230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f5077400640 1 --2- 172.21.15.175:0/3740639970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50780cfb60 0x7f507815d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f5076000640 1 -- 172.21.15.175:0/3740639970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f507806d860 msgr2=0x7f5078139230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f5076000640 1 --2- 172.21.15.175:0/3740639970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f507806d860 0x7f5078139230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.614 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f5076000640 1 -- 172.21.15.175:0/3740639970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50780cfb60 msgr2=0x7f507815d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f5076000640 1 --2- 172.21.15.175:0/3740639970 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50780cfb60 0x7f507815d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.623+0000 7f5076000640 1 -- 172.21.15.175:0/3740639970 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5078139770 con 0x7f50780ced10 2024-04-25T09:14:54.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.627+0000 7f5076000640 1 --2- 172.21.15.175:0/3740639970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50780ced10 0x7f5078164ab0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f506400c450 tx=0x7f506400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:54.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.627+0000 7f506ea00640 1 -- 172.21.15.175:0/3740639970 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064017070 con 0x7f50780ced10 2024-04-25T09:14:54.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.627+0000 7f506ea00640 1 -- 172.21.15.175:0/3740639970 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5064005cf0 con 0x7f50780ced10 2024-04-25T09:14:54.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.627+0000 7f507d600640 1 -- 172.21.15.175:0/3740639970 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f507813efe0 con 0x7f50780ced10 2024-04-25T09:14:54.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.627+0000 7f506ea00640 1 -- 172.21.15.175:0/3740639970 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064007290 con 0x7f50780ced10 2024-04-25T09:14:54.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.627+0000 7f507d600640 1 -- 172.21.15.175:0/3740639970 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50780b3670 con 0x7f50780ced10 2024-04-25T09:14:54.615 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.627+0000 7f507d600640 1 -- 172.21.15.175:0/3740639970 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5078075160 con 0x7f50780ced10 2024-04-25T09:14:54.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.627+0000 7f506ea00640 1 -- 172.21.15.175:0/3740639970 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f506401a070 con 0x7f50780ced10 2024-04-25T09:14:54.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.627+0000 7f506ea00640 1 --2- 172.21.15.175:0/3740639970 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5058066f60 0x7f5058069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.627+0000 7f506ea00640 1 -- 172.21.15.175:0/3740639970 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f5064084770 con 0x7f50780ced10 2024-04-25T09:14:54.616 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.627+0000 7f5076a00640 1 --2- 172.21.15.175:0/3740639970 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5058066f60 0x7f5058069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.627+0000 7f506ea00640 1 --2- 172.21.15.175:0/3740639970 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x7f505806cf60 0x7f505806f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.627+0000 7f506ea00640 1 -- 172.21.15.175:0/3740639970 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f506401dec0 con 0x7f505806cf60 2024-04-25T09:14:54.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.627+0000 7f506ea00640 1 -- 172.21.15.175:0/3740639970 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=118) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5064084b20 con 0x7f50780ced10 2024-04-25T09:14:54.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.627+0000 7f5077400640 1 --2- 172.21.15.175:0/3740639970 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x7f505806cf60 0x7f505806f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.631+0000 7f5076a00640 1 --2- 172.21.15.175:0/3740639970 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5058066f60 0x7f5058069420 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f50680af000 tx=0x7f50680a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:54.617 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.631+0000 7f5077400640 1 --2- 172.21.15.175:0/3740639970 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x7f505806cf60 0x7f505806f380 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:54.618 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.631+0000 7f506ea00640 1 -- 172.21.15.175:0/3740639970 <== osd.7 v2:172.21.15.177:6800/3881136076 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f506401dec0 con 0x7f505806cf60 2024-04-25T09:14:54.631 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.643+0000 7f507d600640 1 -- 172.21.15.175:0/3740639970 --> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f507815f320 con 0x7f505806cf60 2024-04-25T09:14:54.632 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.643+0000 7f506ea00640 1 -- 172.21.15.175:0/3740639970 <== osd.7 v2:172.21.15.177:6800/3881136076 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f507815f320 con 0x7f505806cf60 2024-04-25T09:14:54.633 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2024-04-25T09:14:54.633 INFO:teuthology.orchestra.run.smithi175.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:14:54.633 INFO:teuthology.orchestra.run.smithi175.stdout:} 2024-04-25T09:14:54.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.643+0000 7f507d600640 1 -- 172.21.15.175:0/3740639970 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x7f505806cf60 msgr2=0x7f505806f380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.643+0000 7f507d600640 1 --2- 172.21.15.175:0/3740639970 >> [v2:172.21.15.177:6800/3881136076,v1:172.21.15.177:6801/3881136076] conn(0x7f505806cf60 0x7f505806f380 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.647+0000 7f507d600640 1 -- 172.21.15.175:0/3740639970 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5058066f60 msgr2=0x7f5058069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.647+0000 7f507d600640 1 --2- 172.21.15.175:0/3740639970 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f5058066f60 0x7f5058069420 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f50680af000 tx=0x7f50680a7070 comp rx=0 tx=0).stop 2024-04-25T09:14:54.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.647+0000 7f507d600640 1 -- 172.21.15.175:0/3740639970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50780ced10 msgr2=0x7f5078164ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.647+0000 7f507d600640 1 --2- 172.21.15.175:0/3740639970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50780ced10 0x7f5078164ab0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f506400c450 tx=0x7f506400c910 comp rx=0 tx=0).stop 2024-04-25T09:14:54.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.647+0000 7f5077400640 1 -- 172.21.15.175:0/3740639970 reap_dead start 2024-04-25T09:14:54.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.647+0000 7f507d600640 1 -- 172.21.15.175:0/3740639970 shutdown_connections 2024-04-25T09:14:54.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.647+0000 7f507d600640 1 -- 172.21.15.175:0/3740639970 >> 172.21.15.175:0/3740639970 conn(0x7f507806ac50 msgr2=0x7f50780aff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:54.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.647+0000 7f507d600640 1 -- 172.21.15.175:0/3740639970 shutdown_connections 2024-04-25T09:14:54.634 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.647+0000 7f507d600640 1 -- 172.21.15.175:0/3740639970 wait complete. 2024-04-25T09:14:54.651 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T09:14:54.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.799+0000 7fab1ba00640 1 Processor -- start 2024-04-25T09:14:54.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.799+0000 7fab1ba00640 1 -- start start 2024-04-25T09:14:54.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.799+0000 7fab1ba00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab1415c6e0 0x7fab140b3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.799+0000 7fab1ba00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fab140b2660 0x7fab140b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.799+0000 7fab1ba00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab14162630 con 0x7fab1406e7d0 2024-04-25T09:14:54.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.799+0000 7fab1ba00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1415cac0 con 0x7fab140b2660 2024-04-25T09:14:54.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.799+0000 7fab1ba00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab141628f0 con 0x7fab1415c6e0 2024-04-25T09:14:54.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.799+0000 7fab0be00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fab140b2660 0x7fab140b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.799+0000 7fab19a00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fab1406e7d0 0x7fab140712d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:60040/0 (socket says 172.21.15.175:60040) 2024-04-25T09:14:54.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.799+0000 7fab19a00640 1 -- 172.21.15.175:0/2834399461 learned_addr learned my addr 172.21.15.175:0/2834399461 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:54.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.799+0000 7fab19000640 1 --2- 172.21.15.175:0/2834399461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab1415c6e0 0x7fab140b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.803+0000 7fab0be00640 1 -- 172.21.15.175:0/2834399461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab1415c6e0 msgr2=0x7fab140b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:54.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.803+0000 7fab0be00640 1 --2- 172.21.15.175:0/2834399461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab1415c6e0 0x7fab140b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.803+0000 7fab0be00640 1 -- 172.21.15.175:0/2834399461 >> v1:172.21.15.175:6789/0 conn(0x7fab1406e7d0 legacy=0x7fab140712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.803+0000 7fab0be00640 1 -- 172.21.15.175:0/2834399461 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab14162bd0 con 0x7fab140b2660 2024-04-25T09:14:54.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.803+0000 7fab13e00640 1 -- 172.21.15.175:0/2834399461 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601071434 0 0) 0x7fab14162630 con 0x7fab1406e7d0 2024-04-25T09:14:54.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.803+0000 7fab0be00640 1 --2- 172.21.15.175:0/2834399461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab140b2660 0x7fab140b36b0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7faafc0097c0 tx=0x7faafc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80cca70df4a5fed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:54.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.803+0000 7fab13e00640 1 -- 172.21.15.175:0/2834399461 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc0b0070 con 0x7fab140b2660 2024-04-25T09:14:54.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.803+0000 7fab13e00640 1 -- 172.21.15.175:0/2834399461 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc0ab600 con 0x7fab140b2660 2024-04-25T09:14:54.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.803+0000 7fab13e00640 1 -- 172.21.15.175:0/2834399461 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc0ab9d0 con 0x7fab140b2660 2024-04-25T09:14:54.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.803+0000 7fab1ba00640 1 -- 172.21.15.175:0/2834399461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab140b2660 msgr2=0x7fab140b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.803+0000 7fab1ba00640 1 --2- 172.21.15.175:0/2834399461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab140b2660 0x7fab140b36b0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7faafc0097c0 tx=0x7faafc01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.803+0000 7fab1ba00640 1 -- 172.21.15.175:0/2834399461 shutdown_connections 2024-04-25T09:14:54.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.803+0000 7fab1ba00640 1 --2- 172.21.15.175:0/2834399461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab140b2660 0x7fab140b36b0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.803+0000 7fab1ba00640 1 --2- 172.21.15.175:0/2834399461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab1415c6e0 0x7fab140b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.803+0000 7fab1ba00640 1 -- 172.21.15.175:0/2834399461 >> 172.21.15.175:0/2834399461 conn(0x7fab1406ac50 msgr2=0x7fab1406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:54.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab1ba00640 1 -- 172.21.15.175:0/2834399461 shutdown_connections 2024-04-25T09:14:54.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab1ba00640 1 -- 172.21.15.175:0/2834399461 wait complete. 2024-04-25T09:14:54.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab1ba00640 1 Processor -- start 2024-04-25T09:14:54.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab1ba00640 1 -- start start 2024-04-25T09:14:54.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab1ba00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab1406e7d0 0x7fab1414f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab1ba00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab140b2660 0x7fab14164ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab1ba00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab1415c6e0 0x7fab1415d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab1ba00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab14165980 con 0x7fab140b2660 2024-04-25T09:14:54.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab1ba00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab14165800 con 0x7fab1415c6e0 2024-04-25T09:14:54.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab1ba00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1416ec80 con 0x7fab1406e7d0 2024-04-25T09:14:54.796 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab0be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab140b2660 0x7fab14164ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab0be00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab140b2660 0x7fab14164ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45694/0 (socket says 172.21.15.175:45694) 2024-04-25T09:14:54.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab0be00640 1 -- 172.21.15.175:0/4012891804 learned_addr learned my addr 172.21.15.175:0/4012891804 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:54.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab0be00640 1 -- 172.21.15.175:0/4012891804 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab1406e7d0 msgr2=0x7fab1414f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab0be00640 1 --2- 172.21.15.175:0/4012891804 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab1406e7d0 0x7fab1414f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab0be00640 1 -- 172.21.15.175:0/4012891804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab1415c6e0 msgr2=0x7fab1415d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab0be00640 1 --2- 172.21.15.175:0/4012891804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab1415c6e0 0x7fab1415d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab0be00640 1 -- 172.21.15.175:0/4012891804 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab14163a20 con 0x7fab140b2660 2024-04-25T09:14:54.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab0be00640 1 --2- 172.21.15.175:0/4012891804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab140b2660 0x7fab14164ac0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7faafc01a0d0 tx=0x7faafc019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:54.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab11600640 1 -- 172.21.15.175:0/4012891804 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc0ba070 con 0x7fab140b2660 2024-04-25T09:14:54.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab11600640 1 -- 172.21.15.175:0/4012891804 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faafc0b43f0 con 0x7fab140b2660 2024-04-25T09:14:54.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab11600640 1 -- 172.21.15.175:0/4012891804 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faafc0b0040 con 0x7fab140b2660 2024-04-25T09:14:54.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab1ba00640 1 -- 172.21.15.175:0/4012891804 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab14163d00 con 0x7fab140b2660 2024-04-25T09:14:54.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.807+0000 7fab1ba00640 1 -- 172.21.15.175:0/4012891804 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab141642c0 con 0x7fab140b2660 2024-04-25T09:14:54.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.811+0000 7fab1ba00640 1 -- 172.21.15.175:0/4012891804 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab14075160 con 0x7fab140b2660 2024-04-25T09:14:54.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.811+0000 7fab11600640 1 -- 172.21.15.175:0/4012891804 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faafc0b47c0 con 0x7fab140b2660 2024-04-25T09:14:54.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.811+0000 7fab11600640 1 --2- 172.21.15.175:0/4012891804 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faaf0066f90 0x7faaf0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:54.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.811+0000 7fab11600640 1 -- 172.21.15.175:0/4012891804 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7faafc11de10 con 0x7fab140b2660 2024-04-25T09:14:54.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.811+0000 7fab19000640 1 --2- 172.21.15.175:0/4012891804 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faaf0066f90 0x7faaf0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:54.800 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.811+0000 7fab19000640 1 --2- 172.21.15.175:0/4012891804 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faaf0066f90 0x7faaf0069450 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fab04006aa0 tx=0x7fab04006a30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:54.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.815+0000 7fab11600640 1 -- 172.21.15.175:0/4012891804 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faafc121030 con 0x7fab140b2660 2024-04-25T09:14:54.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.967+0000 7fab1ba00640 1 -- 172.21.15.175:0/4012891804 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fab141637d0 con 0x7faaf0066f90 2024-04-25T09:14:54.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.967+0000 7fab11600640 1 -- 172.21.15.175:0/4012891804 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fab141637d0 con 0x7faaf0066f90 2024-04-25T09:14:54.957 INFO:teuthology.orchestra.run.smithi175.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T09:14:54.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.971+0000 7fab1ba00640 1 -- 172.21.15.175:0/4012891804 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faaf0066f90 msgr2=0x7faaf0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.971+0000 7fab1ba00640 1 --2- 172.21.15.175:0/4012891804 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faaf0066f90 0x7faaf0069450 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fab04006aa0 tx=0x7fab04006a30 comp rx=0 tx=0).stop 2024-04-25T09:14:54.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.971+0000 7fab1ba00640 1 -- 172.21.15.175:0/4012891804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab140b2660 msgr2=0x7fab14164ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:54.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.971+0000 7fab1ba00640 1 --2- 172.21.15.175:0/4012891804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab140b2660 0x7fab14164ac0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7faafc01a0d0 tx=0x7faafc019240 comp rx=0 tx=0).stop 2024-04-25T09:14:54.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.971+0000 7fab1ba00640 1 -- 172.21.15.175:0/4012891804 shutdown_connections 2024-04-25T09:14:54.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.971+0000 7fab1ba00640 1 --2- 172.21.15.175:0/4012891804 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faaf0066f90 0x7faaf0069450 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.971+0000 7fab1ba00640 1 --2- 172.21.15.175:0/4012891804 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fab1415c6e0 0x7fab1415d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.971+0000 7fab1ba00640 1 --2- 172.21.15.175:0/4012891804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab140b2660 0x7fab14164ac0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.971+0000 7fab1ba00640 1 --2- 172.21.15.175:0/4012891804 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fab1406e7d0 0x7fab1414f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:54.959 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.971+0000 7fab1ba00640 1 -- 172.21.15.175:0/4012891804 >> 172.21.15.175:0/4012891804 conn(0x7fab1406ac50 msgr2=0x7fab140b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:54.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.971+0000 7fab1ba00640 1 -- 172.21.15.175:0/4012891804 shutdown_connections 2024-04-25T09:14:54.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:54.971+0000 7fab1ba00640 1 -- 172.21.15.175:0/4012891804 wait complete. 2024-04-25T09:14:54.978 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:14:55.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf3aa00640 1 Processor -- start 2024-04-25T09:14:55.114 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf3aa00640 1 -- start start 2024-04-25T09:14:55.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf3aa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3406b0e0 0x7faf3406b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:55.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf3aa00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7faf340b1090 0x7faf340b1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:55.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf3aa00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf340d01d0 con 0x7faf340b0c50 2024-04-25T09:14:55.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf3aa00640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf340b07c0 con 0x7faf340b1090 2024-04-25T09:14:55.115 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf3aa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf340d0450 con 0x7faf3406b0e0 2024-04-25T09:14:55.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf2b400640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7faf340b0c50 0x7faf340cfac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:60044/0 (socket says 172.21.15.175:60044) 2024-04-25T09:14:55.116 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf2b400640 1 -- 172.21.15.175:0/3402110944 learned_addr learned my addr 172.21.15.175:0/3402110944 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:14:55.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf33e00640 1 --2- 172.21.15.175:0/3402110944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3406b0e0 0x7faf3406b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:55.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf38a00640 1 --2- 172.21.15.175:0/3402110944 >> v2:172.21.15.177:3300/0 conn(0x7faf340b1090 0x7faf340b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:55.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf33400640 1 -- 172.21.15.175:0/3402110944 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350820735 0 0) 0x7faf1c001120 con 0x7faf340b0c50 2024-04-25T09:14:55.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf33400640 1 -- 172.21.15.175:0/3402110944 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf18003530 con 0x7faf340b0c50 2024-04-25T09:14:55.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf33400640 1 -- 172.21.15.175:0/3402110944 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3728319483 0 0) 0x7faf18003530 con 0x7faf340b0c50 2024-04-25T09:14:55.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf33400640 1 -- 172.21.15.175:0/3402110944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3406b0e0 msgr2=0x7faf3406b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:55.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf33400640 1 --2- 172.21.15.175:0/3402110944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3406b0e0 0x7faf3406b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:55.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf33400640 1 -- 172.21.15.175:0/3402110944 >> v2:172.21.15.177:3300/0 conn(0x7faf340b1090 msgr2=0x7faf340b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:55.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf33400640 1 --2- 172.21.15.175:0/3402110944 >> v2:172.21.15.177:3300/0 conn(0x7faf340b1090 0x7faf340b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:55.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf33400640 1 -- 172.21.15.175:0/3402110944 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf340afe90 con 0x7faf340b0c50 2024-04-25T09:14:55.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf33400640 1 -- 172.21.15.175:0/3402110944 <== mon.0 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1348324260 0 0) 0x7faf1c001850 con 0x7faf340b0c50 2024-04-25T09:14:55.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf38a00640 1 --2- 172.21.15.175:0/3402110944 >> v2:172.21.15.177:3300/0 conn(0x7faf340b1090 0x7faf340b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:14:55.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf33400640 1 -- 172.21.15.175:0/3402110944 >> v1:172.21.15.175:6789/0 conn(0x7faf340b0c50 legacy=0x7faf340cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:55.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf33400640 1 --2- 172.21.15.175:0/3402110944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3406b0e0 0x7faf180039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:55.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf33400640 1 --2- 172.21.15.175:0/3402110944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18003f40 0x7faf18004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:55.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf33400640 1 --2- 172.21.15.175:0/3402110944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf18004d50 0x7faf180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:55.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf33400640 1 -- 172.21.15.175:0/3402110944 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf340b07c0 con 0x7faf18003f40 2024-04-25T09:14:55.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf33400640 1 -- 172.21.15.175:0/3402110944 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf340d0450 con 0x7faf18004d50 2024-04-25T09:14:55.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf33400640 1 -- 172.21.15.175:0/3402110944 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1800ba00 con 0x7faf3406b0e0 2024-04-25T09:14:55.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf2b400640 1 --2- 172.21.15.175:0/3402110944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18003f40 0x7faf18004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:55.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf33e00640 1 --2- 172.21.15.175:0/3402110944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3406b0e0 0x7faf180039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:55.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.127+0000 7faf38a00640 1 --2- 172.21.15.175:0/3402110944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf18004d50 0x7faf180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:55.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.131+0000 7faf2b400640 1 -- 172.21.15.175:0/3402110944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3406b0e0 msgr2=0x7faf180039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:55.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.131+0000 7faf2b400640 1 --2- 172.21.15.175:0/3402110944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3406b0e0 0x7faf180039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:55.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.131+0000 7faf2b400640 1 -- 172.21.15.175:0/3402110944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf18004d50 msgr2=0x7faf180051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:14:55.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.131+0000 7faf2b400640 1 --2- 172.21.15.175:0/3402110944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf18004d50 0x7faf180051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:55.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.131+0000 7faf2b400640 1 -- 172.21.15.175:0/3402110944 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf18003530 con 0x7faf18003f40 2024-04-25T09:14:55.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.131+0000 7faf2b400640 1 --2- 172.21.15.175:0/3402110944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18003f40 0x7faf18004810 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00c4c0 tx=0x7faf1c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e808eb21a2e9dc54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:55.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.131+0000 7faf33400640 1 -- 172.21.15.175:0/3402110944 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00c0e0 con 0x7faf18003f40 2024-04-25T09:14:55.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.131+0000 7faf33400640 1 -- 172.21.15.175:0/3402110944 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c0a9020 con 0x7faf18003f40 2024-04-25T09:14:55.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.131+0000 7faf33400640 1 -- 172.21.15.175:0/3402110944 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c0a5bc0 con 0x7faf18003f40 2024-04-25T09:14:55.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.131+0000 7faf3aa00640 1 -- 172.21.15.175:0/3402110944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18003f40 msgr2=0x7faf18004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:55.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.131+0000 7faf3aa00640 1 --2- 172.21.15.175:0/3402110944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18003f40 0x7faf18004810 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00c4c0 tx=0x7faf1c01ccc0 comp rx=0 tx=0).stop 2024-04-25T09:14:55.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.131+0000 7faf38a00640 1 -- 172.21.15.175:0/3402110944 reap_dead start 2024-04-25T09:14:55.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.131+0000 7faf3aa00640 1 -- 172.21.15.175:0/3402110944 shutdown_connections 2024-04-25T09:14:55.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.131+0000 7faf3aa00640 1 -- 172.21.15.175:0/3402110944 >> 172.21.15.175:0/3402110944 conn(0x7faf340d06c0 msgr2=0x7faf340d0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:55.121 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.131+0000 7faf3aa00640 1 -- 172.21.15.175:0/3402110944 shutdown_connections 2024-04-25T09:14:55.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.131+0000 7faf3aa00640 1 -- 172.21.15.175:0/3402110944 wait complete. 2024-04-25T09:14:55.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf3aa00640 1 Processor -- start 2024-04-25T09:14:55.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf3aa00640 1 -- start start 2024-04-25T09:14:55.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf3aa00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18003f40 0x7faf3409a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:55.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf3aa00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf3409d6c0 0x7faf3406ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:55.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf3aa00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3415e6b0 0x7faf34154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:55.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf3aa00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf340b1b50 con 0x7faf18003f40 2024-04-25T09:14:55.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf3aa00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf340b0450 con 0x7faf3409d6c0 2024-04-25T09:14:55.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf3aa00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf340b1cd0 con 0x7faf3415e6b0 2024-04-25T09:14:55.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf33e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18003f40 0x7faf3409a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:55.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf33e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18003f40 0x7faf3409a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:45718/0 (socket says 172.21.15.175:45718) 2024-04-25T09:14:55.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf33e00640 1 -- 172.21.15.175:0/309554475 learned_addr learned my addr 172.21.15.175:0/309554475 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:14:55.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf2b400640 1 --2- 172.21.15.175:0/309554475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf3409d6c0 0x7faf3406ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:55.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf38a00640 1 --2- 172.21.15.175:0/309554475 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3415e6b0 0x7faf34154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:55.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf33e00640 1 -- 172.21.15.175:0/309554475 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3415e6b0 msgr2=0x7faf34154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:55.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf33e00640 1 --2- 172.21.15.175:0/309554475 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3415e6b0 0x7faf34154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:55.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf33e00640 1 -- 172.21.15.175:0/309554475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf3409d6c0 msgr2=0x7faf3406ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:55.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf33e00640 1 --2- 172.21.15.175:0/309554475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf3409d6c0 0x7faf3406ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:55.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf33e00640 1 -- 172.21.15.175:0/309554475 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3409dba0 con 0x7faf18003f40 2024-04-25T09:14:55.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf2b400640 1 --2- 172.21.15.175:0/309554475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf3409d6c0 0x7faf3406ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:55.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf38a00640 1 --2- 172.21.15.175:0/309554475 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3415e6b0 0x7faf34154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:14:55.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf33e00640 1 --2- 172.21.15.175:0/309554475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18003f40 0x7faf3409a5b0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7faf24011990 tx=0x7faf24011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:55.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf30c00640 1 -- 172.21.15.175:0/309554475 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2400fad0 con 0x7faf18003f40 2024-04-25T09:14:55.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf30c00640 1 -- 172.21.15.175:0/309554475 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2400fc70 con 0x7faf18003f40 2024-04-25T09:14:55.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf3aa00640 1 -- 172.21.15.175:0/309554475 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3409de80 con 0x7faf18003f40 2024-04-25T09:14:55.126 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf30c00640 1 -- 172.21.15.175:0/309554475 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24014440 con 0x7faf18003f40 2024-04-25T09:14:55.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.135+0000 7faf3aa00640 1 -- 172.21.15.175:0/309554475 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3409e440 con 0x7faf18003f40 2024-04-25T09:14:55.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.139+0000 7faf3aa00640 1 -- 172.21.15.175:0/309554475 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf34074a60 con 0x7faf18003f40 2024-04-25T09:14:55.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.139+0000 7faf30c00640 1 -- 172.21.15.175:0/309554475 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faf24012040 con 0x7faf18003f40 2024-04-25T09:14:55.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.139+0000 7faf30c00640 1 --2- 172.21.15.175:0/309554475 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faf10066f60 0x7faf10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:14:55.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.139+0000 7faf30c00640 1 -- 172.21.15.175:0/309554475 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7faf240853e0 con 0x7faf18003f40 2024-04-25T09:14:55.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.139+0000 7faf2b400640 1 --2- 172.21.15.175:0/309554475 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faf10066f60 0x7faf10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:14:55.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.139+0000 7faf2b400640 1 --2- 172.21.15.175:0/309554475 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faf10066f60 0x7faf10069420 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0aa000 tx=0x7faf1c001c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:14:55.132 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.143+0000 7faf30c00640 1 -- 172.21.15.175:0/309554475 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faf24019030 con 0x7faf18003f40 2024-04-25T09:14:55.283 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.295+0000 7faf3aa00640 1 -- 172.21.15.175:0/309554475 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf34070bd0 con 0x7faf10066f60 2024-04-25T09:14:55.284 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.295+0000 7faf30c00640 1 -- 172.21.15.175:0/309554475 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13390 (secure 0 0 0) 0x7faf34070bd0 con 0x7faf10066f60 2024-04-25T09:14:55.284 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:14:55.284 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:14:55.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.299+0000 7faf3aa00640 1 -- 172.21.15.175:0/309554475 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faf10066f60 msgr2=0x7faf10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:55.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.299+0000 7faf3aa00640 1 --2- 172.21.15.175:0/309554475 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faf10066f60 0x7faf10069420 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0aa000 tx=0x7faf1c001c90 comp rx=0 tx=0).stop 2024-04-25T09:14:55.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.299+0000 7faf3aa00640 1 -- 172.21.15.175:0/309554475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18003f40 msgr2=0x7faf3409a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:14:55.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.299+0000 7faf3aa00640 1 --2- 172.21.15.175:0/309554475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18003f40 0x7faf3409a5b0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7faf24011990 tx=0x7faf24011e50 comp rx=0 tx=0).stop 2024-04-25T09:14:55.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.299+0000 7faf3aa00640 1 -- 172.21.15.175:0/309554475 shutdown_connections 2024-04-25T09:14:55.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.299+0000 7faf3aa00640 1 --2- 172.21.15.175:0/309554475 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7faf10066f60 0x7faf10069420 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:55.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.299+0000 7faf3aa00640 1 --2- 172.21.15.175:0/309554475 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf3415e6b0 0x7faf34154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:55.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.299+0000 7faf3aa00640 1 --2- 172.21.15.175:0/309554475 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf3409d6c0 0x7faf3406ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:55.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.299+0000 7faf3aa00640 1 --2- 172.21.15.175:0/309554475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf18003f40 0x7faf3409a5b0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:14:55.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.299+0000 7faf3aa00640 1 -- 172.21.15.175:0/309554475 >> 172.21.15.175:0/309554475 conn(0x7faf340d06c0 msgr2=0x7faf340b2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:14:55.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.299+0000 7faf3aa00640 1 -- 172.21.15.175:0/309554475 shutdown_connections 2024-04-25T09:14:55.287 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:14:55.299+0000 7faf3aa00640 1 -- 172.21.15.175:0/309554475 wait complete. 2024-04-25T09:14:55.305 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":439,"stamp":"2024-04-25T09:14:53.938433+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262132,"kb_used_data":12680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712588,"statfs":{"total":773094113280,"available":772825690112,"internally_reserved":0,"allocated":12984320,"data_stored":6304976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8388625,"num_objects":-5,"num_object_clones":0,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":-32,"num_read_kb":-13,"num_write":-29,"num_write_kb":-8195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.394029"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":353,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-25T09:14:46.889659+0000","last_change":"2024-04-25T09:03:59.035372+0000","last_active":"2024-04-25T09:14:46.889659+0000","last_peered":"2024-04-25T09:14:46.889659+0000","last_clean":"2024-04-25T09:14:46.889659+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:14:46.889659+0000","last_undegraded":"2024-04-25T09:14:46.889659+0000","last_fullsized":"2024-04-25T09:14:46.889659+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:57.984727+0000","last_clean_scrub_stamp":"2024-04-25T09:03:57.984727+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:28.344449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574982,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2068480,"data_stored":1230898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574983,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574985,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2068480,"data_stored":1230898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:14:55.308 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T09:03:57.984727+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=3, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=14, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:14:55.308 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T09:15:09.795 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:15:09.799 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:15:15.310 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:15:15.456 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.467+0000 7f6146400640 1 Processor -- start 2024-04-25T09:15:15.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.467+0000 7f6146400640 1 -- start start 2024-04-25T09:15:15.457 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.471+0000 7f6146400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f614015a010 0x7f61400b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:15.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.471+0000 7f6146400640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f61400b3b20 0x7f614006d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:15.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.471+0000 7f6146400640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614006d460 con 0x7f6140159c30 2024-04-25T09:15:15.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.471+0000 7f6146400640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61400cf110 con 0x7f61400b3b20 2024-04-25T09:15:15.458 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.471+0000 7f6146400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61400ce870 con 0x7f614015a010 2024-04-25T09:15:15.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.471+0000 7f6137e00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f614015a010 0x7f61400b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:15.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.471+0000 7f6145a00640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f61400b3b20 0x7f614006d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:15.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.471+0000 7f6145000640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f6140159c30 0x7f61400b3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.175:46610/0 (socket says 172.21.15.175:46610) 2024-04-25T09:15:15.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.471+0000 7f6145000640 1 -- 172.21.15.175:0/1104213709 learned_addr learned my addr 172.21.15.175:0/1104213709 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:15:15.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.471+0000 7f613fe00640 1 -- 172.21.15.175:0/1104213709 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843069592 0 0) 0x7f614006d460 con 0x7f6140159c30 2024-04-25T09:15:15.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.471+0000 7f613fe00640 1 -- 172.21.15.175:0/1104213709 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6124003530 con 0x7f6140159c30 2024-04-25T09:15:15.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.471+0000 7f6145a00640 1 -- 172.21.15.175:0/1104213709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f614015a010 msgr2=0x7f61400b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:15:15.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.471+0000 7f6145a00640 1 --2- 172.21.15.175:0/1104213709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f614015a010 0x7f61400b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:15.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.471+0000 7f6145a00640 1 -- 172.21.15.175:0/1104213709 >> v1:172.21.15.177:6789/0 conn(0x7f6140159c30 legacy=0x7f61400b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:15.459 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.471+0000 7f6145a00640 1 -- 172.21.15.175:0/1104213709 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61400ceb50 con 0x7f61400b3b20 2024-04-25T09:15:15.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.475+0000 7f6145a00640 1 --2- 172.21.15.175:0/1104213709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61400b3b20 0x7f614006d940 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6138009d90 tx=0x7f613801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4a36acad6e68cc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:15:15.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.475+0000 7f613fe00640 1 -- 172.21.15.175:0/1104213709 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61380b2070 con 0x7f61400b3b20 2024-04-25T09:15:15.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.475+0000 7f613fe00640 1 -- 172.21.15.175:0/1104213709 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61380a57b0 con 0x7f61400b3b20 2024-04-25T09:15:15.462 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.475+0000 7f613fe00640 1 -- 172.21.15.175:0/1104213709 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61380a5b80 con 0x7f61400b3b20 2024-04-25T09:15:15.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.475+0000 7f6146400640 1 -- 172.21.15.175:0/1104213709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61400b3b20 msgr2=0x7f614006d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:15.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.475+0000 7f6146400640 1 --2- 172.21.15.175:0/1104213709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61400b3b20 0x7f614006d940 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6138009d90 tx=0x7f613801c970 comp rx=0 tx=0).stop 2024-04-25T09:15:15.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.475+0000 7f6146400640 1 -- 172.21.15.175:0/1104213709 shutdown_connections 2024-04-25T09:15:15.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.475+0000 7f6146400640 1 --2- 172.21.15.175:0/1104213709 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61400b3b20 0x7f614006d940 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:15.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.475+0000 7f6146400640 1 --2- 172.21.15.175:0/1104213709 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f614015a010 0x7f61400b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:15.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.475+0000 7f6146400640 1 -- 172.21.15.175:0/1104213709 >> 172.21.15.175:0/1104213709 conn(0x7f614006b250 msgr2=0x7f61400b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:15:15.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.475+0000 7f6146400640 1 -- 172.21.15.175:0/1104213709 shutdown_connections 2024-04-25T09:15:15.463 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.475+0000 7f6146400640 1 -- 172.21.15.175:0/1104213709 wait complete. 2024-04-25T09:15:15.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.475+0000 7f6146400640 1 Processor -- start 2024-04-25T09:15:15.464 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.475+0000 7f6146400640 1 -- start start 2024-04-25T09:15:15.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6146400640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61400b3b20 0x7f61401430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:15.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6146400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6140159c30 0x7f6140158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:15.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6146400640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f614015a010 0x7f61401588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:15.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6146400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614006e210 con 0x7f6140159c30 2024-04-25T09:15:15.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6146400640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614006e090 con 0x7f61400b3b20 2024-04-25T09:15:15.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6146400640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614006e390 con 0x7f614015a010 2024-04-25T09:15:15.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6137e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6140159c30 0x7f6140158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:15.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6137e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6140159c30 0x7f6140158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35614/0 (socket says 172.21.15.175:35614) 2024-04-25T09:15:15.466 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6137e00640 1 -- 172.21.15.175:0/1300327860 learned_addr learned my addr 172.21.15.175:0/1300327860 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:15:15.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6145a00640 1 --2- 172.21.15.175:0/1300327860 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f614015a010 0x7f61401588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:15.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6145000640 1 --2- 172.21.15.175:0/1300327860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61400b3b20 0x7f61401430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:15.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6137e00640 1 -- 172.21.15.175:0/1300327860 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f614015a010 msgr2=0x7f61401588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:15.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6137e00640 1 --2- 172.21.15.175:0/1300327860 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f614015a010 0x7f61401588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:15.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6137e00640 1 -- 172.21.15.175:0/1300327860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61400b3b20 msgr2=0x7f61401430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:15.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6137e00640 1 --2- 172.21.15.175:0/1300327860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61400b3b20 0x7f61401430c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:15.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6137e00640 1 -- 172.21.15.175:0/1300327860 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61401573d0 con 0x7f6140159c30 2024-04-25T09:15:15.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6137e00640 1 --2- 172.21.15.175:0/1300327860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6140159c30 0x7f6140158360 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f612800e8a0 tx=0x7f612800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:15:15.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f613d600640 1 -- 172.21.15.175:0/1300327860 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128017070 con 0x7f6140159c30 2024-04-25T09:15:15.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f613d600640 1 -- 172.21.15.175:0/1300327860 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612800ee90 con 0x7f6140159c30 2024-04-25T09:15:15.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6146400640 1 -- 172.21.15.175:0/1300327860 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61400cbf40 con 0x7f6140159c30 2024-04-25T09:15:15.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f613d600640 1 -- 172.21.15.175:0/1300327860 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612800cb40 con 0x7f6140159c30 2024-04-25T09:15:15.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6146400640 1 -- 172.21.15.175:0/1300327860 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6140157670 con 0x7f6140159c30 2024-04-25T09:15:15.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f6146400640 1 -- 172.21.15.175:0/1300327860 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6140074a60 con 0x7f6140159c30 2024-04-25T09:15:15.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.479+0000 7f613d600640 1 -- 172.21.15.175:0/1300327860 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f612801a070 con 0x7f6140159c30 2024-04-25T09:15:15.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.483+0000 7f613d600640 1 --2- 172.21.15.175:0/1300327860 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f611c066f60 0x7f611c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:15.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.483+0000 7f613d600640 1 -- 172.21.15.175:0/1300327860 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f6128084c80 con 0x7f6140159c30 2024-04-25T09:15:15.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.483+0000 7f6145000640 1 --2- 172.21.15.175:0/1300327860 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f611c066f60 0x7f611c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:15.470 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.483+0000 7f6145000640 1 --2- 172.21.15.175:0/1300327860 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f611c066f60 0x7f611c069420 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6130007fd0 tx=0x7f6130000bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:15:15.474 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.487+0000 7f613d600640 1 -- 172.21.15.175:0/1300327860 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f61280557f0 con 0x7f6140159c30 2024-04-25T09:15:15.624 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.635+0000 7f6146400640 1 -- 172.21.15.175:0/1300327860 --> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6140155af0 con 0x7f611c066f60 2024-04-25T09:15:15.625 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.635+0000 7f613d600640 1 -- 172.21.15.175:0/1300327860 <== mgr.4104 v2:172.21.15.175:6832/768986364 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13379 (secure 0 0 0) 0x7f6140155af0 con 0x7f611c066f60 2024-04-25T09:15:15.625 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:15:15.625 INFO:teuthology.orchestra.run.smithi175.stderr:dumped all 2024-04-25T09:15:15.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.639+0000 7f6146400640 1 -- 172.21.15.175:0/1300327860 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f611c066f60 msgr2=0x7f611c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:15.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.639+0000 7f6146400640 1 --2- 172.21.15.175:0/1300327860 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f611c066f60 0x7f611c069420 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6130007fd0 tx=0x7f6130000bd0 comp rx=0 tx=0).stop 2024-04-25T09:15:15.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.639+0000 7f6146400640 1 -- 172.21.15.175:0/1300327860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6140159c30 msgr2=0x7f6140158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:15.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.639+0000 7f6146400640 1 --2- 172.21.15.175:0/1300327860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6140159c30 0x7f6140158360 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f612800e8a0 tx=0x7f612800ed60 comp rx=0 tx=0).stop 2024-04-25T09:15:15.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.639+0000 7f6146400640 1 -- 172.21.15.175:0/1300327860 shutdown_connections 2024-04-25T09:15:15.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.639+0000 7f6146400640 1 --2- 172.21.15.175:0/1300327860 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f611c066f60 0x7f611c069420 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:15.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.639+0000 7f6146400640 1 --2- 172.21.15.175:0/1300327860 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f614015a010 0x7f61401588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:15.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.639+0000 7f6146400640 1 --2- 172.21.15.175:0/1300327860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6140159c30 0x7f6140158360 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:15.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.639+0000 7f6146400640 1 --2- 172.21.15.175:0/1300327860 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f61400b3b20 0x7f61401430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:15.627 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.639+0000 7f6146400640 1 -- 172.21.15.175:0/1300327860 >> 172.21.15.175:0/1300327860 conn(0x7f614006b250 msgr2=0x7f61400cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:15:15.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.639+0000 7f6146400640 1 -- 172.21.15.175:0/1300327860 shutdown_connections 2024-04-25T09:15:15.628 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.639+0000 7f6146400640 1 -- 172.21.15.175:0/1300327860 wait complete. 2024-04-25T09:15:15.646 INFO:teuthology.orchestra.run.smithi175.stdout:{"pg_ready":true,"pg_map":{"version":449,"stamp":"2024-04-25T09:15:13.942628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262124,"kb_used_data":12680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712596,"statfs":{"total":773094113280,"available":772825698304,"internally_reserved":0,"allocated":12984320,"data_stored":6304976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002756"},"pg_stats":[{"pgid":"1.0","version":"118'119","reported_seq":364,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-25T09:14:55.475090+0000","last_change":"2024-04-25T09:14:55.475129+0000","last_active":"2024-04-25T09:14:55.475090+0000","last_peered":"2024-04-25T09:14:55.475090+0000","last_clean":"2024-04-25T09:14:55.475090+0000","last_became_active":"2024-04-25T09:03:59.032360+0000","last_became_peered":"2024-04-25T09:03:59.032360+0000","last_unstale":"2024-04-25T09:14:55.475090+0000","last_undegraded":"2024-04-25T09:14:55.475090+0000","last_fullsized":"2024-04-25T09:14:55.475090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"118'119","last_scrub_stamp":"2024-04-25T09:14:55.474996+0000","last_deep_scrub":"118'119","last_deep_scrub_stamp":"2024-04-25T09:14:55.474996+0000","last_clean_scrub_stamp":"2024-04-25T09:14:55.474996+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:20.824545+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574986,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2068480,"data_stored":1230898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574985,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574985,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32624,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1474560,"data_stored":640530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574989,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2068480,"data_stored":1230898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:15:15.647 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T09:15:15.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.795+0000 7f31e8a00640 1 Processor -- start 2024-04-25T09:15:15.782 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.795+0000 7f31e8a00640 1 -- start start 2024-04-25T09:15:15.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.795+0000 7f31e8a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e415af20 0x7f31e40b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:15.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.795+0000 7f31e8a00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e406db60 con 0x7f31e40cbe60 2024-04-25T09:15:15.783 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.795+0000 7f31e8a00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e406de40 con 0x7f31e40b4630 2024-04-25T09:15:15.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.795+0000 7f31e8a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e406e120 con 0x7f31e415af20 2024-04-25T09:15:15.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.795+0000 7f31e1e00640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f31e40cbe60 0x7f31e406d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:60498/0 (socket says 172.21.15.175:60498) 2024-04-25T09:15:15.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.795+0000 7f31e1e00640 1 -- 172.21.15.175:0/3305125144 learned_addr learned my addr 172.21.15.175:0/3305125144 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-25T09:15:15.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.795+0000 7f31d9400640 1 --2- 172.21.15.175:0/3305125144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e415af20 0x7f31e40b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:15.784 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.795+0000 7f31e1400640 1 -- 172.21.15.175:0/3305125144 <== mon.0 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182240491 0 0) 0x7f31e406db60 con 0x7f31e40cbe60 2024-04-25T09:15:15.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.795+0000 7f31e1400640 1 -- 172.21.15.175:0/3305125144 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31c8005740 con 0x7f31e40cbe60 2024-04-25T09:15:15.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.795+0000 7f31e1400640 1 -- 172.21.15.175:0/3305125144 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072937211 0 0) 0x7f31e406de40 con 0x7f31e40b4630 2024-04-25T09:15:15.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.795+0000 7f31e1400640 1 -- 172.21.15.175:0/3305125144 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31e406db60 con 0x7f31e40b4630 2024-04-25T09:15:15.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.795+0000 7f31e1400640 1 -- 172.21.15.175:0/3305125144 <== mon.0 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1424622575 0 0) 0x7f31c8005740 con 0x7f31e40cbe60 2024-04-25T09:15:15.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.795+0000 7f31d9400640 1 -- 172.21.15.175:0/3305125144 >> v1:172.21.15.177:6789/0 conn(0x7f31e40b4630 legacy=0x7f31e415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:15.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.795+0000 7f31d9400640 1 -- 172.21.15.175:0/3305125144 >> v1:172.21.15.175:6789/0 conn(0x7f31e40cbe60 legacy=0x7f31e406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:15.785 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.795+0000 7f31d9400640 1 -- 172.21.15.175:0/3305125144 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e415c2f0 con 0x7f31e415af20 2024-04-25T09:15:15.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.799+0000 7f31d9400640 1 --2- 172.21.15.175:0/3305125144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e415af20 0x7f31e40b40f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0097f0 tx=0x7f31cc01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4cecad9f596e742 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:15:15.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.799+0000 7f31e1400640 1 -- 172.21.15.175:0/3305125144 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc0b0070 con 0x7f31e415af20 2024-04-25T09:15:15.787 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.799+0000 7f31e1400640 1 -- 172.21.15.175:0/3305125144 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc0ab400 con 0x7f31e415af20 2024-04-25T09:15:15.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.799+0000 7f31e1400640 1 -- 172.21.15.175:0/3305125144 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d4001680 con 0x7f31e415af20 2024-04-25T09:15:15.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.799+0000 7f31e8a00640 1 -- 172.21.15.175:0/3305125144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e415af20 msgr2=0x7f31e40b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:15.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.799+0000 7f31e8a00640 1 --2- 172.21.15.175:0/3305125144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e415af20 0x7f31e40b40f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0097f0 tx=0x7f31cc01c400 comp rx=0 tx=0).stop 2024-04-25T09:15:15.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.799+0000 7f31e8a00640 1 -- 172.21.15.175:0/3305125144 shutdown_connections 2024-04-25T09:15:15.788 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.799+0000 7f31e8a00640 1 --2- 172.21.15.175:0/3305125144 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e415af20 0x7f31e40b40f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:15.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.799+0000 7f31e8a00640 1 -- 172.21.15.175:0/3305125144 >> 172.21.15.175:0/3305125144 conn(0x7f31e406ac50 msgr2=0x7f31e406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:15:15.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.799+0000 7f31e8a00640 1 -- 172.21.15.175:0/3305125144 shutdown_connections 2024-04-25T09:15:15.789 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.799+0000 7f31e8a00640 1 -- 172.21.15.175:0/3305125144 wait complete. 2024-04-25T09:15:15.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e8a00640 1 Processor -- start 2024-04-25T09:15:15.790 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e8a00640 1 -- start start 2024-04-25T09:15:15.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e8a00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e40b4630 0x7f31e40cf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:15.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e8a00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e40cbe60 0x7f31e4158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:15.791 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e8a00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e415af20 0x7f31e4159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:15.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e8a00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e415db40 con 0x7f31e415af20 2024-04-25T09:15:15.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e8a00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e415d9c0 con 0x7f31e40b4630 2024-04-25T09:15:15.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e8a00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e40cc450 con 0x7f31e40cbe60 2024-04-25T09:15:15.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e2800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e415af20 0x7f31e4159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:15.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e2800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e415af20 0x7f31e4159850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35626/0 (socket says 172.21.15.175:35626) 2024-04-25T09:15:15.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e2800640 1 -- 172.21.15.175:0/3309288036 learned_addr learned my addr 172.21.15.175:0/3309288036 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:15:15.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31d9400640 1 --2- 172.21.15.175:0/3309288036 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e40cbe60 0x7f31e4158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:15.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e1e00640 1 --2- 172.21.15.175:0/3309288036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e40b4630 0x7f31e40cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:15.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e2800640 1 -- 172.21.15.175:0/3309288036 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e40cbe60 msgr2=0x7f31e4158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:15.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e2800640 1 --2- 172.21.15.175:0/3309288036 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e40cbe60 0x7f31e4158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:15.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e2800640 1 -- 172.21.15.175:0/3309288036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e40b4630 msgr2=0x7f31e40cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:15.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e2800640 1 --2- 172.21.15.175:0/3309288036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e40b4630 0x7f31e40cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:15.792 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e2800640 1 -- 172.21.15.175:0/3309288036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e41391f0 con 0x7f31e415af20 2024-04-25T09:15:15.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e2800640 1 --2- 172.21.15.175:0/3309288036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e415af20 0x7f31e4159850 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00c760 tx=0x7f31dc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:15:15.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31daa00640 1 -- 172.21.15.175:0/3309288036 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc003b80 con 0x7f31e415af20 2024-04-25T09:15:15.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31daa00640 1 -- 172.21.15.175:0/3309288036 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31dc003d20 con 0x7f31e415af20 2024-04-25T09:15:15.793 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31daa00640 1 -- 172.21.15.175:0/3309288036 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc00aa90 con 0x7f31e415af20 2024-04-25T09:15:15.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e8a00640 1 -- 172.21.15.175:0/3309288036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e4139490 con 0x7f31e415af20 2024-04-25T09:15:15.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.803+0000 7f31e8a00640 1 -- 172.21.15.175:0/3309288036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e4139a50 con 0x7f31e415af20 2024-04-25T09:15:15.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.807+0000 7f31e8a00640 1 -- 172.21.15.175:0/3309288036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e4075160 con 0x7f31e415af20 2024-04-25T09:15:15.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.807+0000 7f31daa00640 1 -- 172.21.15.175:0/3309288036 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f31dc00ac30 con 0x7f31e415af20 2024-04-25T09:15:15.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.807+0000 7f31daa00640 1 --2- 172.21.15.175:0/3309288036 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f31c0066f60 0x7f31c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:15.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.807+0000 7f31daa00640 1 -- 172.21.15.175:0/3309288036 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f31dc084cf0 con 0x7f31e415af20 2024-04-25T09:15:15.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.807+0000 7f31e1e00640 1 --2- 172.21.15.175:0/3309288036 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f31c0066f60 0x7f31c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:15.795 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.807+0000 7f31e1e00640 1 --2- 172.21.15.175:0/3309288036 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f31c0066f60 0x7f31c0069420 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f31d40011f0 tx=0x7f31d40016a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:15:15.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.811+0000 7f31daa00640 1 -- 172.21.15.175:0/3309288036 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f31dc0557d0 con 0x7f31e415af20 2024-04-25T09:15:15.954 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.967+0000 7f31e8a00640 1 -- 172.21.15.175:0/3309288036 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f31e415ca20 con 0x7f31e415af20 2024-04-25T09:15:15.957 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.971+0000 7f31daa00640 1 -- 172.21.15.175:0/3309288036 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v24)=0 v24) v1 ==== 123+0+0 (secure 0 0 0) 0x7f31dc059870 con 0x7f31e415af20 2024-04-25T09:15:15.958 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.971+0000 7f31daa00640 1 -- 172.21.15.175:0/3309288036 <== mon.0 v2:172.21.15.175:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f31dc05dec0 con 0x7f31e415af20 2024-04-25T09:15:15.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.971+0000 7f31e8a00640 1 -- 172.21.15.175:0/3309288036 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f31c0066f60 msgr2=0x7f31c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:15.960 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.971+0000 7f31e8a00640 1 --2- 172.21.15.175:0/3309288036 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f31c0066f60 0x7f31c0069420 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f31d40011f0 tx=0x7f31d40016a0 comp rx=0 tx=0).stop 2024-04-25T09:15:15.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.971+0000 7f31e8a00640 1 -- 172.21.15.175:0/3309288036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e415af20 msgr2=0x7f31e4159850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:15.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.971+0000 7f31e8a00640 1 --2- 172.21.15.175:0/3309288036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e415af20 0x7f31e4159850 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00c760 tx=0x7f31dc00cc20 comp rx=0 tx=0).stop 2024-04-25T09:15:15.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.971+0000 7f31e8a00640 1 -- 172.21.15.175:0/3309288036 shutdown_connections 2024-04-25T09:15:15.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.971+0000 7f31e8a00640 1 --2- 172.21.15.175:0/3309288036 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f31c0066f60 0x7f31c0069420 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:15.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.971+0000 7f31e8a00640 1 --2- 172.21.15.175:0/3309288036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e415af20 0x7f31e4159850 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:15.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.971+0000 7f31e8a00640 1 --2- 172.21.15.175:0/3309288036 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f31e40cbe60 0x7f31e4158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:15.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.971+0000 7f31e8a00640 1 --2- 172.21.15.175:0/3309288036 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f31e40b4630 0x7f31e40cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:15.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.971+0000 7f31e8a00640 1 -- 172.21.15.175:0/3309288036 >> 172.21.15.175:0/3309288036 conn(0x7f31e406ac50 msgr2=0x7f31e415a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:15:15.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.971+0000 7f31e8a00640 1 -- 172.21.15.175:0/3309288036 shutdown_connections 2024-04-25T09:15:15.961 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:15.971+0000 7f31e8a00640 1 -- 172.21.15.175:0/3309288036 wait complete. 2024-04-25T09:15:15.981 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:15:15.981 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:15:16.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.131+0000 7f67dac00640 1 Processor -- start 2024-04-25T09:15:16.118 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.131+0000 7f67dac00640 1 -- start start 2024-04-25T09:15:16.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.131+0000 7f67dac00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f67d415bc10 0x7f67d40cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:16.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.131+0000 7f67dac00640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d40cc4c0 con 0x7f67d4099a50 2024-04-25T09:15:16.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.131+0000 7f67dac00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d40cc7a0 con 0x7f67d409abb0 2024-04-25T09:15:16.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.131+0000 7f67dac00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d40d06f0 con 0x7f67d415bc10 2024-04-25T09:15:16.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.131+0000 7f67d3400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f67d415bc10 0x7f67d40cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:16.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.131+0000 7f67d3400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f67d415bc10 0x7f67d40cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35628/0 (socket says 172.21.15.175:35628) 2024-04-25T09:15:16.119 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.131+0000 7f67d3400640 1 -- 172.21.15.175:0/155051829 learned_addr learned my addr 172.21.15.175:0/155051829 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:15:16.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.131+0000 7f67d3400640 1 -- 172.21.15.175:0/155051829 >> v1:172.21.15.177:6789/0 conn(0x7f67d409abb0 legacy=0x7f67d40cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:16.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.131+0000 7f67d3400640 1 -- 172.21.15.175:0/155051829 >> v1:172.21.15.175:6789/0 conn(0x7f67d4099a50 legacy=0x7f67d4099e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:16.120 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.131+0000 7f67d3400640 1 -- 172.21.15.175:0/155051829 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d40cca80 con 0x7f67d415bc10 2024-04-25T09:15:16.122 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.135+0000 7f67d3400640 1 --2- 172.21.15.175:0/155051829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d415bc10 0x7f67d40cd280 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f67bc009870 tx=0x7f67bc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422bde141353b841 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:15:16.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.135+0000 7f67d2a00640 1 -- 172.21.15.175:0/155051829 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0a7070 con 0x7f67d415bc10 2024-04-25T09:15:16.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.135+0000 7f67d2a00640 1 -- 172.21.15.175:0/155051829 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f67bc0b0070 con 0x7f67d415bc10 2024-04-25T09:15:16.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.135+0000 7f67d2a00640 1 -- 172.21.15.175:0/155051829 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc0ab8b0 con 0x7f67d415bc10 2024-04-25T09:15:16.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.135+0000 7f67dac00640 1 -- 172.21.15.175:0/155051829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d415bc10 msgr2=0x7f67d40cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:16.123 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.135+0000 7f67dac00640 1 --2- 172.21.15.175:0/155051829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d415bc10 0x7f67d40cd280 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f67bc009870 tx=0x7f67bc01c560 comp rx=0 tx=0).stop 2024-04-25T09:15:16.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.135+0000 7f67dac00640 1 -- 172.21.15.175:0/155051829 shutdown_connections 2024-04-25T09:15:16.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.135+0000 7f67dac00640 1 --2- 172.21.15.175:0/155051829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d415bc10 0x7f67d40cd280 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:16.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.135+0000 7f67dac00640 1 -- 172.21.15.175:0/155051829 >> 172.21.15.175:0/155051829 conn(0x7f67d40b3300 msgr2=0x7f67d40b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:15:16.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.135+0000 7f67dac00640 1 -- 172.21.15.175:0/155051829 shutdown_connections 2024-04-25T09:15:16.124 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.135+0000 7f67dac00640 1 -- 172.21.15.175:0/155051829 wait complete. 2024-04-25T09:15:16.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67dac00640 1 Processor -- start 2024-04-25T09:15:16.125 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67dac00640 1 -- start start 2024-04-25T09:15:16.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67dac00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d4099a50 0x7f67d4152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:16.127 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67dac00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67d409abb0 0x7f67d414f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:16.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67dac00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67d415bc10 0x7f67d40ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:16.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67dac00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d40c5f00 con 0x7f67d4099a50 2024-04-25T09:15:16.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67dac00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d40c5d80 con 0x7f67d409abb0 2024-04-25T09:15:16.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67dac00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d4169860 con 0x7f67d415bc10 2024-04-25T09:15:16.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67d3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d4099a50 0x7f67d4152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:16.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67d3e00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d4099a50 0x7f67d4152f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:35634/0 (socket says 172.21.15.175:35634) 2024-04-25T09:15:16.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67d3e00640 1 -- 172.21.15.175:0/3120012160 learned_addr learned my addr 172.21.15.175:0/3120012160 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-25T09:15:16.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67d3e00640 1 -- 172.21.15.175:0/3120012160 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67d415bc10 msgr2=0x7f67d40ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:16.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67d3400640 1 --2- 172.21.15.175:0/3120012160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67d409abb0 0x7f67d414f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:16.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67d8c00640 1 --2- 172.21.15.175:0/3120012160 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67d415bc10 0x7f67d40ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:16.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67d3e00640 1 --2- 172.21.15.175:0/3120012160 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67d415bc10 0x7f67d40ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:16.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67d3e00640 1 -- 172.21.15.175:0/3120012160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67d409abb0 msgr2=0x7f67d414f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:16.128 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67d3e00640 1 --2- 172.21.15.175:0/3120012160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67d409abb0 0x7f67d414f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:16.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67d3e00640 1 -- 172.21.15.175:0/3120012160 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d4164fd0 con 0x7f67d4099a50 2024-04-25T09:15:16.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67d3400640 1 --2- 172.21.15.175:0/3120012160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67d409abb0 0x7f67d414f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:15:16.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67d8c00640 1 --2- 172.21.15.175:0/3120012160 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67d415bc10 0x7f67d40ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:15:16.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67d3e00640 1 --2- 172.21.15.175:0/3120012160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d4099a50 0x7f67d4152f10 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f67c400c500 tx=0x7f67c400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:15:16.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67cbe00640 1 -- 172.21.15.175:0/3120012160 <== mon.0 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c4016020 con 0x7f67d4099a50 2024-04-25T09:15:16.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67cbe00640 1 -- 172.21.15.175:0/3120012160 <== mon.0 v2:172.21.15.175:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f67c4005220 con 0x7f67d4099a50 2024-04-25T09:15:16.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67cbe00640 1 -- 172.21.15.175:0/3120012160 <== mon.0 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c4007030 con 0x7f67d4099a50 2024-04-25T09:15:16.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67dac00640 1 -- 172.21.15.175:0/3120012160 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d41652b0 con 0x7f67d4099a50 2024-04-25T09:15:16.129 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67dac00640 1 -- 172.21.15.175:0/3120012160 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d414fd50 con 0x7f67d4099a50 2024-04-25T09:15:16.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.139+0000 7f67dac00640 1 -- 172.21.15.175:0/3120012160 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d4074a60 con 0x7f67d4099a50 2024-04-25T09:15:16.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.143+0000 7f67cbe00640 1 -- 172.21.15.175:0/3120012160 <== mon.0 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f67c40071d0 con 0x7f67d4099a50 2024-04-25T09:15:16.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.143+0000 7f67cbe00640 1 --2- 172.21.15.175:0/3120012160 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f67b0066f60 0x7f67b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:15:16.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.143+0000 7f67cbe00640 1 -- 172.21.15.175:0/3120012160 <== mon.0 v2:172.21.15.175:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f67c40848b0 con 0x7f67d4099a50 2024-04-25T09:15:16.130 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.143+0000 7f67d3400640 1 --2- 172.21.15.175:0/3120012160 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f67b0066f60 0x7f67b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:15:16.131 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.143+0000 7f67d3400640 1 --2- 172.21.15.175:0/3120012160 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f67b0066f60 0x7f67b0069420 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f67bc0af000 tx=0x7f67bc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:15:16.134 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.147+0000 7f67cbe00640 1 -- 172.21.15.175:0/3120012160 <== mon.0 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f67c4020020 con 0x7f67d4099a50 2024-04-25T09:15:16.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.335+0000 7f67dac00640 1 -- 172.21.15.175:0/3120012160 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67d40c5140 con 0x7f67d4099a50 2024-04-25T09:15:16.325 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.339+0000 7f67cbe00640 1 -- 172.21.15.175:0/3120012160 <== mon.0 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+3710 (secure 0 0 0) 0x7f67c40074c0 con 0x7f67d4099a50 2024-04-25T09:15:16.326 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-25T09:15:16.326 INFO:teuthology.orchestra.run.smithi175.stdout:{"epoch":108,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7430,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/745891603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":745891603},{"type":"v1","addr":"172.21.15.175:6837","nonce":745891603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6834/2312875672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":2312875672},{"type":"v1","addr":"172.21.15.177:6834","nonce":2312875672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":8212,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6835/3983919410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6833","nonce":3983919410},{"type":"v1","addr":"172.21.15.177:6835","nonce":3983919410}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":89},{"gid":9315,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/1375053710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1375053710},{"type":"v1","addr":"172.21.15.175:6836","nonce":1375053710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":108}],"filesystems":[]} 2024-04-25T09:15:16.326 INFO:teuthology.orchestra.run.smithi175.stderr:dumped fsmap epoch 108 2024-04-25T09:15:16.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.339+0000 7f67dac00640 1 -- 172.21.15.175:0/3120012160 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f67b0066f60 msgr2=0x7f67b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:16.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.339+0000 7f67dac00640 1 --2- 172.21.15.175:0/3120012160 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f67b0066f60 0x7f67b0069420 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f67bc0af000 tx=0x7f67bc0a7000 comp rx=0 tx=0).stop 2024-04-25T09:15:16.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.339+0000 7f67dac00640 1 -- 172.21.15.175:0/3120012160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d4099a50 msgr2=0x7f67d4152f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:15:16.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.339+0000 7f67dac00640 1 --2- 172.21.15.175:0/3120012160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d4099a50 0x7f67d4152f10 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f67c400c500 tx=0x7f67c400c9c0 comp rx=0 tx=0).stop 2024-04-25T09:15:16.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.339+0000 7f67dac00640 1 -- 172.21.15.175:0/3120012160 shutdown_connections 2024-04-25T09:15:16.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.339+0000 7f67dac00640 1 --2- 172.21.15.175:0/3120012160 >> [v2:172.21.15.175:6832/768986364,v1:172.21.15.175:6833/768986364] conn(0x7f67b0066f60 0x7f67b0069420 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:16.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.339+0000 7f67dac00640 1 --2- 172.21.15.175:0/3120012160 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67d415bc10 0x7f67d40ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:16.328 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.339+0000 7f67dac00640 1 --2- 172.21.15.175:0/3120012160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67d409abb0 0x7f67d414f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:16.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.339+0000 7f67dac00640 1 --2- 172.21.15.175:0/3120012160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f67d4099a50 0x7f67d4152f10 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:15:16.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.339+0000 7f67dac00640 1 -- 172.21.15.175:0/3120012160 >> 172.21.15.175:0/3120012160 conn(0x7f67d40b3300 msgr2=0x7f67d4070d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:15:16.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.339+0000 7f67dac00640 1 -- 172.21.15.175:0/3120012160 shutdown_connections 2024-04-25T09:15:16.329 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-25T09:15:16.339+0000 7f67dac00640 1 -- 172.21.15.175:0/3120012160 wait complete. 2024-04-25T09:15:16.347 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-25T09:15:16.347 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T09:15:16.347 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:15:16.347 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:16.358 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:15:16.359 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:15:16.359 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:16.413 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:15:16.413 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:15:16.413 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:16.427 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:15:16.427 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:15:16.427 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:16.481 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:15:16.481 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T09:15:16.481 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T09:15:16.482 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:16.582 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T09:15:16.582 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T09:15:16.582 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:16.677 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T09:15:16.677 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T09:15:16.677 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:16.743 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T09:15:16.744 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T09:15:16.744 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:16.844 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T09:15:16.845 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T09:15:16.845 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:16.919 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T09:15:16.919 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T09:15:16.919 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:17.012 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T09:15:17.012 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T09:15:17.013 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:17.104 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T09:15:17.104 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T09:15:17.104 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:17.187 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T09:15:17.187 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T09:15:17.187 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T09:15:17.187 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:17.245 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T09:15:17.245 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T09:15:17.245 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:17.297 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T09:15:17.297 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T09:15:17.298 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T09:15:17.298 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:17.316 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T09:15:17.316 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T09:15:17.316 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:17.332 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T09:15:17.332 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T09:15:17.332 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:15:17.391 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T09:15:17.391 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T09:15:17.391 DEBUG:teuthology.orchestra.run.smithi175:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-04-25T09:15:17.423 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:15:17.423 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T09:15:17.771 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:15:17.771 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T09:15:17.978 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:15:17.979 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T09:15:18.184 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:15:18.184 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T09:15:18.369 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi177.front.sepia.ceph.com 2024-04-25T09:15:18.369 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T09:15:18.616 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi177.front.sepia.ceph.com 2024-04-25T09:15:18.616 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T09:15:18.801 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi177.front.sepia.ceph.com 2024-04-25T09:15:18.801 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T09:15:18.958 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi177.front.sepia.ceph.com 2024-04-25T09:15:18.959 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T09:15:19.146 INFO:tasks.ceph:Archiving mon data... 2024-04-25T09:15:19.148 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673005/data/mon.a.tgz 2024-04-25T09:15:19.148 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-04-25T09:15:19.156 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.lvJ6f0biXq 2024-04-25T09:15:19.156 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.lvJ6f0biXq 2024-04-25T09:15:19.289 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.lvJ6f0biXq 2024-04-25T09:15:19.361 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.lvJ6f0biXq is 393KB 2024-04-25T09:15:19.424 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.lvJ6f0biXq 2024-04-25T09:15:19.433 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673005/data/mon.b.tgz 2024-04-25T09:15:19.433 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-04-25T09:15:19.442 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.JrdDlVeMCw 2024-04-25T09:15:19.442 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.JrdDlVeMCw 2024-04-25T09:15:19.586 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.JrdDlVeMCw 2024-04-25T09:15:19.664 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.JrdDlVeMCw is 397KB 2024-04-25T09:15:19.728 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.JrdDlVeMCw 2024-04-25T09:15:19.736 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673005/data/mon.c.tgz 2024-04-25T09:15:19.736 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-04-25T09:15:19.788 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.LmDga0Zx5b 2024-04-25T09:15:19.788 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.LmDga0Zx5b 2024-04-25T09:15:19.925 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.LmDga0Zx5b 2024-04-25T09:15:20.000 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.LmDga0Zx5b is 397KB 2024-04-25T09:15:20.066 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.LmDga0Zx5b 2024-04-25T09:15:20.074 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T09:15:20.074 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T09:15:20.077 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T09:15:20.147 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T09:15:20.183 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T09:15:20.183 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T09:15:20.185 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673005/remote/smithi175/crash 2024-04-25T09:15:20.186 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T09:15:20.207 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673005/remote/smithi177/crash 2024-04-25T09:15:20.208 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T09:15:20.241 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T09:15:20.241 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:15:20.255 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:15:20.333 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T09:15:20.352 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T09:15:20.371 INFO:tasks.ceph:Compressing logs... 2024-04-25T09:15:20.371 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T09:15:20.399 DEBUG:teuthology.orchestra.run.smithi177:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T09:15:20.429 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40637.log 2024-04-25T09:15:20.430 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52280.log 2024-04-25T09:15:20.431 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44622.log 2024-04-25T09:15:20.431 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40637.log.gz 2024-04-25T09:15:20.432 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38650.log 2024-04-25T09:15:20.432 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44622.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52280.log.gz 2024-04-25T09:15:20.433 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35939.log 2024-04-25T09:15:20.433 INFO:teuthology.orchestra.run.smithi175.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44622.log.gz 2024-04-25T09:15:20.433 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46733.log 2024-04-25T09:15:20.433 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38650.log.gz 2024-04-25T09:15:20.434 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48274.log 2024-04-25T09:15:20.434 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35939.log.gz 2024-04-25T09:15:20.435 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46863.log 2024-04-25T09:15:20.435 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46733.log.gz 2024-04-25T09:15:20.436 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33193.log 2024-04-25T09:15:20.436 INFO:teuthology.orchestra.run.smithi175.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48274.log.gz 2024-04-25T09:15:20.436 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39533.log 2024-04-25T09:15:20.437 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46863.log.gz 2024-04-25T09:15:20.437 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51935.log 2024-04-25T09:15:20.438 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33193.log.gz 2024-04-25T09:15:20.439 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43161.log 2024-04-25T09:15:20.439 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39533.log.gz 2024-04-25T09:15:20.439 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37406.log 2024-04-25T09:15:20.440 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43161.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51935.log.gz 2024-04-25T09:15:20.440 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36922.log 2024-04-25T09:15:20.440 INFO:teuthology.orchestra.run.smithi175.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43161.log.gz 2024-04-25T09:15:20.441 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33534.log 2024-04-25T09:15:20.441 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27841.log 2024-04-25T09:15:20.443 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53125.log 2024-04-25T09:15:20.443 INFO:teuthology.orchestra.run.smithi175.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37406.log.gz 2024-04-25T09:15:20.443 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37755.log 2024-04-25T09:15:20.443 INFO:teuthology.orchestra.run.smithi175.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36922.log.gz 2024-04-25T09:15:20.443 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40810.log 2024-04-25T09:15:20.443 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53125.log.gz 2024-04-25T09:15:20.443 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36334.log 2024-04-25T09:15:20.443 INFO:teuthology.orchestra.run.smithi175.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.37755.log.gz 2024-04-25T09:15:20.450 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.3.33534.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.3.33534.log.gz /var/log/ceph/ceph-client.admin.27697.log 2024-04-25T09:15:20.450 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-04-25T09:15:20.450 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.27841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33435.log 2024-04-25T09:15:20.450 INFO:teuthology.orchestra.run.smithi177.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27841.log.gz 2024-04-25T09:15:20.450 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.27697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33453.log 2024-04-25T09:15:20.450 INFO:teuthology.orchestra.run.smithi177.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27697.log.gz 2024-04-25T09:15:20.450 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.33435.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T09:15:20.450 INFO:teuthology.orchestra.run.smithi177.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33435.log.gz 2024-04-25T09:15:20.450 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.33453.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T09:15:20.450 INFO:teuthology.orchestra.run.smithi177.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33453.log.gz 2024-04-25T09:15:20.450 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27769.log 2024-04-25T09:15:20.451 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27793.log 2024-04-25T09:15:20.451 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.27769.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T09:15:20.451 INFO:teuthology.orchestra.run.smithi177.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27769.log.gz 2024-04-25T09:15:20.451 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.27793.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T09:15:20.451 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27793.log.gz 2024-04-25T09:15:20.451 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27721.log 2024-04-25T09:15:20.451 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T09:15:20.452 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38324.log 2024-04-25T09:15:20.453 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40810.log.gz 2024-04-25T09:15:20.453 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39111.log 2024-04-25T09:15:20.453 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36334.log.gz 2024-04-25T09:15:20.453 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44006.log 2024-04-25T09:15:20.453 INFO:teuthology.orchestra.run.smithi175.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.38324.log.gz 2024-04-25T09:15:20.453 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36658.log 2024-04-25T09:15:20.453 INFO:teuthology.orchestra.run.smithi175.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.39111.log.gz 2024-04-25T09:15:20.453 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.44006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44006.log.gz 2024-04-25T09:15:20.453 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T09:15:20.453 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37068.log 2024-04-25T09:15:20.453 INFO:teuthology.orchestra.run.smithi175.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36658.log.gz 2024-04-25T09:15:20.453 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36711.log 2024-04-25T09:15:20.453 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51031.log 2024-04-25T09:15:20.454 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37068.log.gz 2024-04-25T09:15:20.454 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45917.log 2024-04-25T09:15:20.454 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36711.log.gz 2024-04-25T09:15:20.454 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50584.log 2024-04-25T09:15:20.454 INFO:teuthology.orchestra.run.smithi175.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51031.log.gz 2024-04-25T09:15:20.454 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39312.log 2024-04-25T09:15:20.454 INFO:teuthology.orchestra.run.smithi175.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.45917.log.gz 2024-04-25T09:15:20.454 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33574.log 2024-04-25T09:15:20.454 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50584.log.gz 2024-04-25T09:15:20.459 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.27721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27866.log 2024-04-25T09:15:20.459 INFO:teuthology.orchestra.run.smithi177.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27721.log.gz 2024-04-25T09:15:20.459 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27745.log 2024-04-25T09:15:20.460 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.27866.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T09:15:20.460 INFO:teuthology.orchestra.run.smithi177.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27866.log.gz 2024-04-25T09:15:20.460 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.27745.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T09:15:20.460 INFO:teuthology.orchestra.run.smithi177.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.27745.log.gz 2024-04-25T09:15:20.460 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27817.log 2024-04-25T09:15:20.460 INFO:teuthology.orchestra.run.smithi177.stderr: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T09:15:20.460 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T09:15:20.460 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.27817.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27817.log.gz 2024-04-25T09:15:20.460 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mds.d.log: 94.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T09:15:20.460 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T09:15:20.462 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T09:15:20.462 INFO:teuthology.orchestra.run.smithi177.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T09:15:20.462 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T09:15:20.464 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52817.log 2024-04-25T09:15:20.464 INFO:teuthology.orchestra.run.smithi175.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.39312.log.gz 2024-04-25T09:15:20.464 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53151.log 2024-04-25T09:15:20.464 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33574.log.gz 2024-04-25T09:15:20.464 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39182.log 2024-04-25T09:15:20.464 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52817.log.gz 2024-04-25T09:15:20.464 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50099.log 2024-04-25T09:15:20.465 INFO:teuthology.orchestra.run.smithi175.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53151.log.gz 2024-04-25T09:15:20.465 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52420.log 2024-04-25T09:15:20.465 INFO:teuthology.orchestra.run.smithi175.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.39182.log.gz 2024-04-25T09:15:20.465 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42888.log 2024-04-25T09:15:20.465 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50099.log.gz 2024-04-25T09:15:20.465 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50521.log 2024-04-25T09:15:20.465 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52420.log.gz 2024-04-25T09:15:20.465 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52226.log 2024-04-25T09:15:20.465 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42888.log.gz 2024-04-25T09:15:20.465 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47537.log 2024-04-25T09:15:20.465 INFO:teuthology.orchestra.run.smithi175.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50521.log.gz 2024-04-25T09:15:20.465 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35193.log 2024-04-25T09:15:20.465 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52226.log.gz 2024-04-25T09:15:20.465 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45471.log 2024-04-25T09:15:20.465 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47537.log.gz 2024-04-25T09:15:20.466 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35749.log 2024-04-25T09:15:20.466 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35193.log.gz 2024-04-25T09:15:20.466 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39663.log 2024-04-25T09:15:20.466 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45471.log.gz 2024-04-25T09:15:20.466 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42451.log 2024-04-25T09:15:20.466 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35749.log.gz 2024-04-25T09:15:20.468 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52966.log 2024-04-25T09:15:20.468 INFO:teuthology.orchestra.run.smithi175.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39663.log.gz 2024-04-25T09:15:20.468 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46813.log 2024-04-25T09:15:20.468 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42451.log.gz 2024-04-25T09:15:20.468 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36867.log 2024-04-25T09:15:20.468 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52966.log.gz 2024-04-25T09:15:20.468 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50229.log 2024-04-25T09:15:20.468 INFO:teuthology.orchestra.run.smithi175.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46813.log.gz 2024-04-25T09:15:20.469 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36017.log 2024-04-25T09:15:20.469 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T09:15:20.469 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33529.log 2024-04-25T09:15:20.470 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36867.log.gz 2024-04-25T09:15:20.470 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38782.log 2024-04-25T09:15:20.470 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50229.log.gz 2024-04-25T09:15:20.470 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47353.log 2024-04-25T09:15:20.470 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36017.log.gz 2024-04-25T09:15:20.472 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.3.33529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.33529.log.gz 2024-04-25T09:15:20.472 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38782.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T09:15:20.472 INFO:teuthology.orchestra.run.smithi175.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38782.log.gz 2024-04-25T09:15:20.472 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38455.log 2024-04-25T09:15:20.473 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47353.log.gz 2024-04-25T09:15:20.473 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48051.log 2024-04-25T09:15:20.473 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35913.log 2024-04-25T09:15:20.474 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38455.log.gz 2024-04-25T09:15:20.474 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48051.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48051.log.gz 2024-04-25T09:15:20.474 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52330.log 2024-04-25T09:15:20.475 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43625.log 2024-04-25T09:15:20.475 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35913.log.gz 2024-04-25T09:15:20.476 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52330.log: gzip 89.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.52330.log.gz 2024-04-25T09:15:20.476 INFO:teuthology.orchestra.run.smithi175.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43853.log 2024-04-25T09:15:20.477 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38095.log 2024-04-25T09:15:20.477 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43853.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.43625.log.gz 2024-04-25T09:15:20.479 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43853.log.gz 2024-04-25T09:15:20.479 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45108.log 2024-04-25T09:15:20.479 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42940.log 2024-04-25T09:15:20.480 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38095.log: /var/log/ceph/ceph-client.admin.45108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34904.log 2024-04-25T09:15:20.480 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38095.log.gz 2024-04-25T09:15:20.480 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45108.log.gz 2024-04-25T09:15:20.480 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33652.log 2024-04-25T09:15:20.481 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42940.log.gz 2024-04-25T09:15:20.481 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34904.log: gzip 89.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.34904.log.gz --verbose 2024-04-25T09:15:20.481 INFO:teuthology.orchestra.run.smithi175.stderr: -- /var/log/ceph/ceph-client.admin.36841.log 2024-04-25T09:15:20.482 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38962.log 2024-04-25T09:15:20.483 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33652.log.gz 2024-04-25T09:15:20.483 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34302.log 2024-04-25T09:15:20.483 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36841.log.gz 2024-04-25T09:15:20.484 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41294.log 2024-04-25T09:15:20.484 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38962.log.gz 2024-04-25T09:15:20.485 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39110.log 2024-04-25T09:15:20.485 INFO:teuthology.orchestra.run.smithi175.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34302.log.gz 2024-04-25T09:15:20.486 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50610.log 2024-04-25T09:15:20.486 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41294.log.gz 2024-04-25T09:15:20.487 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51211.log 2024-04-25T09:15:20.487 INFO:teuthology.orchestra.run.smithi175.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.39110.log.gz 2024-04-25T09:15:20.488 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36360.log 2024-04-25T09:15:20.488 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50610.log.gz 2024-04-25T09:15:20.489 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40455.log 2024-04-25T09:15:20.489 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51211.log.gz 2024-04-25T09:15:20.490 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51600.log 2024-04-25T09:15:20.490 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36360.log.gz 2024-04-25T09:15:20.491 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41592.log 2024-04-25T09:15:20.491 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40455.log.gz 2024-04-25T09:15:20.492 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45292.log 2024-04-25T09:15:20.492 INFO:teuthology.orchestra.run.smithi175.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51600.log.gz 2024-04-25T09:15:20.493 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41540.log 2024-04-25T09:15:20.493 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41592.log.gz 2024-04-25T09:15:20.494 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41774.log 2024-04-25T09:15:20.494 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41540.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.45292.log.gz 2024-04-25T09:15:20.495 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52008.log 2024-04-25T09:15:20.495 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41540.log.gz 2024-04-25T09:15:20.495 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50021.log 2024-04-25T09:15:20.496 INFO:teuthology.orchestra.run.smithi175.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41774.log.gz 2024-04-25T09:15:20.497 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48686.log 2024-04-25T09:15:20.497 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50021.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.52008.log.gz 2024-04-25T09:15:20.498 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50021.log.gz 2024-04-25T09:15:20.498 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44368.log 2024-04-25T09:15:20.498 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39285.log 2024-04-25T09:15:20.499 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48686.log: /var/log/ceph/ceph-client.admin.44368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43283.log 2024-04-25T09:15:20.499 INFO:teuthology.orchestra.run.smithi175.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48686.log.gz 2024-04-25T09:15:20.499 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44368.log.gz 2024-04-25T09:15:20.500 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36815.log 2024-04-25T09:15:20.500 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39285.log.gz 2024-04-25T09:15:20.501 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.43283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43283.log.gz 2024-04-25T09:15:20.501 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39994.log 2024-04-25T09:15:20.502 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52163.log 2024-04-25T09:15:20.502 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36815.log.gz 2024-04-25T09:15:20.503 INFO:teuthology.orchestra.run.smithi177.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T09:15:20.504 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34432.log 2024-04-25T09:15:20.504 INFO:teuthology.orchestra.run.smithi175.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39994.log.gz 2024-04-25T09:15:20.504 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47483.log 2024-04-25T09:15:20.504 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52163.log.gz 2024-04-25T09:15:20.505 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44290.log 2024-04-25T09:15:20.505 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34432.log.gz 2024-04-25T09:15:20.506 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41244.log 2024-04-25T09:15:20.506 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47483.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47483.log.gz 2024-04-25T09:15:20.507 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44290.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44290.log.gz 2024-04-25T09:15:20.507 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35349.log 2024-04-25T09:15:20.507 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44517.log 2024-04-25T09:15:20.508 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41244.log: /var/log/ceph/ceph-client.admin.35349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53515.log 2024-04-25T09:15:20.508 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35349.log.gz 2024-04-25T09:15:20.509 INFO:teuthology.orchestra.run.smithi175.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.41244.log.gz 2024-04-25T09:15:20.509 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36100.log 2024-04-25T09:15:20.509 INFO:teuthology.orchestra.run.smithi175.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44517.log.gz 2024-04-25T09:15:20.510 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36535.log 2024-04-25T09:15:20.510 INFO:teuthology.orchestra.run.smithi175.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53515.log.gz 2024-04-25T09:15:20.511 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35297.log 2024-04-25T09:15:20.511 INFO:teuthology.orchestra.run.smithi175.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36100.log.gz 2024-04-25T09:15:20.512 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41800.log 2024-04-25T09:15:20.512 INFO:teuthology.orchestra.run.smithi175.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36535.log.gz 2024-04-25T09:15:20.513 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34866.log 2024-04-25T09:15:20.513 INFO:teuthology.orchestra.run.smithi175.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35297.log.gz 2024-04-25T09:15:20.514 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37457.log 2024-04-25T09:15:20.514 INFO:teuthology.orchestra.run.smithi175.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41800.log.gz 2024-04-25T09:15:20.515 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.34866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46928.log 2024-04-25T09:15:20.515 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34866.log.gz 2024-04-25T09:15:20.515 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.37457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37457.log.gz 2024-04-25T09:15:20.516 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43133.log 2024-04-25T09:15:20.516 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36308.log 2024-04-25T09:15:20.517 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43133.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.46928.log.gz 2024-04-25T09:15:20.518 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40935.log 2024-04-25T09:15:20.518 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43133.log.gz 2024-04-25T09:15:20.519 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37094.log 2024-04-25T09:15:20.519 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36308.log.gz 2024-04-25T09:15:20.519 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35479.log 2024-04-25T09:15:20.520 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37094.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.40935.log.gz 2024-04-25T09:15:20.520 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37094.log.gz 2024-04-25T09:15:20.521 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35219.log 2024-04-25T09:15:20.521 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39449.log 2024-04-25T09:15:20.522 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35479.log: /var/log/ceph/ceph-client.admin.35219.log: gzip -5 --verbose 89.2% -- /var/log/ceph/ceph-client.admin.50662.log -- replaced with /var/log/ceph/ceph-client.admin.35479.log.gz 2024-04-25T09:15:20.522 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-04-25T09:15:20.523 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35219.log.gz 2024-04-25T09:15:20.523 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37523.log 2024-04-25T09:15:20.523 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39449.log.gz 2024-04-25T09:15:20.524 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39397.log 2024-04-25T09:15:20.525 INFO:teuthology.orchestra.run.smithi175.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50662.log.gz 2024-04-25T09:15:20.525 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34484.log 2024-04-25T09:15:20.525 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37523.log.gz 2024-04-25T09:15:20.526 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39397.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39397.log.gz 2024-04-25T09:15:20.526 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47875.log 2024-04-25T09:15:20.527 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38507.log 2024-04-25T09:15:20.527 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34484.log.gz 2024-04-25T09:15:20.528 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42373.log 2024-04-25T09:15:20.528 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47875.log.gz 2024-04-25T09:15:20.529 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45850.log 2024-04-25T09:15:20.529 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38507.log.gz 2024-04-25T09:15:20.530 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40350.log 2024-04-25T09:15:20.530 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42373.log.gz 2024-04-25T09:15:20.531 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40127.log 2024-04-25T09:15:20.531 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45850.log.gz 2024-04-25T09:15:20.532 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39371.log 2024-04-25T09:15:20.532 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40350.log.gz 2024-04-25T09:15:20.533 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46665.log 2024-04-25T09:15:20.533 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40127.log.gz 2024-04-25T09:15:20.534 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51188.log 2024-04-25T09:15:20.534 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39371.log.gz 2024-04-25T09:15:20.535 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40860.log 2024-04-25T09:15:20.536 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.51188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51188.log.gz 2024-04-25T09:15:20.536 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35141.log 2024-04-25T09:15:20.536 INFO:teuthology.orchestra.run.smithi175.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.46665.log.gz 2024-04-25T09:15:20.537 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37146.log 2024-04-25T09:15:20.537 INFO:teuthology.orchestra.run.smithi175.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.40860.log.gz 2024-04-25T09:15:20.538 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35671.log 2024-04-25T09:15:20.538 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35141.log.gz 2024-04-25T09:15:20.539 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37146.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37146.log.gz 2024-04-25T09:15:20.539 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41430.log 2024-04-25T09:15:20.540 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36256.log 2024-04-25T09:15:20.540 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35671.log.gz 2024-04-25T09:15:20.541 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44019.log 2024-04-25T09:15:20.541 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41430.log.gz 2024-04-25T09:15:20.541 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36412.log 2024-04-25T09:15:20.542 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36256.log.gz 2024-04-25T09:15:20.543 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44019.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T09:15:20.543 INFO:teuthology.orchestra.run.smithi175.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.44019.log.gz 2024-04-25T09:15:20.544 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44446.log 2024-04-25T09:15:20.544 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36412.log.gz 2024-04-25T09:15:20.544 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41192.log 2024-04-25T09:15:20.546 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37809.log 2024-04-25T09:15:20.546 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44446.log.gz 2024-04-25T09:15:20.546 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45682.log 2024-04-25T09:15:20.551 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37809.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41192.log.gz 2024-04-25T09:15:20.551 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42347.log 2024-04-25T09:15:20.551 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37809.log.gz 2024-04-25T09:15:20.551 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53463.log 2024-04-25T09:15:20.551 INFO:teuthology.orchestra.run.smithi175.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45682.log.gz 2024-04-25T09:15:20.551 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42347.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42347.log.gz 2024-04-25T09:15:20.551 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34113.log 2024-04-25T09:15:20.551 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33470.log 2024-04-25T09:15:20.552 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53463.log: /var/log/ceph/ceph-client.admin.34113.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53463.log.gz 2024-04-25T09:15:20.552 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39689.log 2024-04-25T09:15:20.552 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34113.log.gz 2024-04-25T09:15:20.553 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34510.log 2024-04-25T09:15:20.553 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33470.log.gz 2024-04-25T09:15:20.554 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51888.log 2024-04-25T09:15:20.554 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39689.log.gz 2024-04-25T09:15:20.555 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37172.log 2024-04-25T09:15:20.555 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34510.log.gz 2024-04-25T09:15:20.556 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51888.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51888.log.gz 2024-04-25T09:15:20.556 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44316.log 2024-04-25T09:15:20.557 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37601.log 2024-04-25T09:15:20.557 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37172.log.gz 2024-04-25T09:15:20.558 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27702.log 2024-04-25T09:15:20.558 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44316.log.gz 2024-04-25T09:15:20.559 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33901.log 2024-04-25T09:15:20.559 INFO:teuthology.orchestra.run.smithi175.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37601.log.gz 2024-04-25T09:15:20.560 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.27702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36953.log 2024-04-25T09:15:20.560 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27702.log.gz 2024-04-25T09:15:20.561 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50294.log 2024-04-25T09:15:20.561 INFO:teuthology.orchestra.run.smithi175.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33901.log.gz 2024-04-25T09:15:20.562 INFO:teuthology.orchestra.run.smithi175.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T09:15:20.562 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51289.log 2024-04-25T09:15:20.563 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36953.log.gz 2024-04-25T09:15:20.563 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49015.log 2024-04-25T09:15:20.563 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50294.log.gz 2024-04-25T09:15:20.564 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35559.log 2024-04-25T09:15:20.564 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51289.log.gz 2024-04-25T09:15:20.565 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47589.log 2024-04-25T09:15:20.565 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35559.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.49015.log.gz 2024-04-25T09:15:20.566 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35559.log.gz 2024-04-25T09:15:20.566 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46759.log 2024-04-25T09:15:20.567 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51651.log 2024-04-25T09:15:20.567 INFO:teuthology.orchestra.run.smithi175.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47589.log.gz 2024-04-25T09:15:20.567 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49287.log 2024-04-25T09:15:20.568 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46759.log.gz 2024-04-25T09:15:20.568 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.51651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51651.log.gz 2024-04-25T09:15:20.568 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47712.log 2024-04-25T09:15:20.569 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41403.log 2024-04-25T09:15:20.569 INFO:teuthology.orchestra.run.smithi175.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49287.log.gz 2024-04-25T09:15:20.570 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51550.log 2024-04-25T09:15:20.570 INFO:teuthology.orchestra.run.smithi175.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47712.log.gz 2024-04-25T09:15:20.571 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49482.log 2024-04-25T09:15:20.571 INFO:teuthology.orchestra.run.smithi175.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41403.log.gz 2024-04-25T09:15:20.572 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45746.log 2024-04-25T09:15:20.572 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49482.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51550.log.gz 2024-04-25T09:15:20.573 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T09:15:20.573 INFO:teuthology.orchestra.run.smithi175.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.49482.log.gz 2024-04-25T09:15:20.574 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45266.log 2024-04-25T09:15:20.574 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45746.log.gz 2024-04-25T09:15:20.575 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48552.log 2024-04-25T09:15:20.576 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35453.log 2024-04-25T09:15:20.576 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45266.log.gz 2024-04-25T09:15:20.577 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50493.log 2024-04-25T09:15:20.577 INFO:teuthology.orchestra.run.smithi175.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48552.log.gz 2024-04-25T09:15:20.578 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49140.log 2024-04-25T09:15:20.578 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35453.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35453.log.gz 2024-04-25T09:15:20.579 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53573.log 2024-04-25T09:15:20.579 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50493.log.gz 2024-04-25T09:15:20.580 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33600.log 2024-04-25T09:15:20.580 INFO:teuthology.orchestra.run.smithi175.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49140.log.gz 2024-04-25T09:15:20.581 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43879.log 2024-04-25T09:15:20.582 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53573.log.gz 2024-04-25T09:15:20.582 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39741.log 2024-04-25T09:15:20.582 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33600.log.gz 2024-04-25T09:15:20.583 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42581.log 2024-04-25T09:15:20.584 INFO:teuthology.orchestra.run.smithi175.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.43879.log.gz 2024-04-25T09:15:20.584 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44858.log 2024-04-25T09:15:20.585 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39741.log.gz 2024-04-25T09:15:20.586 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42581.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42581.log.gz 2024-04-25T09:15:20.586 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33140.log 2024-04-25T09:15:20.586 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39585.log 2024-04-25T09:15:20.587 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33140.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44858.log.gz 2024-04-25T09:15:20.588 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38140.log 2024-04-25T09:15:20.588 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33140.log.gz 2024-04-25T09:15:20.589 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39585.log: gzip -5 88.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.39585.log.gz -- 2024-04-25T09:15:20.589 INFO:teuthology.orchestra.run.smithi175.stderr: /var/log/ceph/ceph-client.admin.41508.log 2024-04-25T09:15:20.589 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49350.log 2024-04-25T09:15:20.590 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38140.log: /var/log/ceph/ceph-client.admin.41508.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38140.log.gz 2024-04-25T09:15:20.591 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40739.log 2024-04-25T09:15:20.591 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41508.log.gz 2024-04-25T09:15:20.592 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46276.log 2024-04-25T09:15:20.592 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49350.log.gz 2024-04-25T09:15:20.593 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49839.log 2024-04-25T09:15:20.593 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40739.log: /var/log/ceph/ceph-client.admin.46276.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40739.log.gz 2024-04-25T09:15:20.594 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35991.log 2024-04-25T09:15:20.594 INFO:teuthology.orchestra.run.smithi175.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46276.log.gz 2024-04-25T09:15:20.595 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52791.log 2024-04-25T09:15:20.595 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49839.log.gz 2024-04-25T09:15:20.596 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51761.log 2024-04-25T09:15:20.596 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35991.log.gz 2024-04-25T09:15:20.597 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45212.log 2024-04-25T09:15:20.597 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52791.log.gz 2024-04-25T09:15:20.598 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34107.log 2024-04-25T09:15:20.598 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51761.log.gz 2024-04-25T09:15:20.599 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36074.log 2024-04-25T09:15:20.599 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45212.log: /var/log/ceph/ceph-client.admin.34107.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45212.log.gz 2024-04-25T09:15:20.600 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43107.log 2024-04-25T09:15:20.600 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34107.log.gz 2024-04-25T09:15:20.601 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42185.log 2024-04-25T09:15:20.601 INFO:teuthology.orchestra.run.smithi175.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36074.log.gz 2024-04-25T09:15:20.602 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.43107.log: -- /var/log/ceph/ceph-client.admin.35965.log 2024-04-25T09:15:20.602 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42185.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43107.log.gz 2024-04-25T09:15:20.603 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39890.log 2024-04-25T09:15:20.603 INFO:teuthology.orchestra.run.smithi175.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42185.log.gz 2024-04-25T09:15:20.604 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48168.log 2024-04-25T09:15:20.604 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35965.log.gz 2024-04-25T09:15:20.605 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38730.log 2024-04-25T09:15:20.605 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48168.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39890.log.gz 2024-04-25T09:15:20.606 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51985.log 2024-04-25T09:15:20.606 INFO:teuthology.orchestra.run.smithi175.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48168.log.gz 2024-04-25T09:15:20.607 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34098.log 2024-04-25T09:15:20.607 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38730.log.gz 2024-04-25T09:15:20.608 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.51985.log: -- /var/log/ceph/ceph-client.admin.48077.log 2024-04-25T09:15:20.608 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34098.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51985.log.gz 2024-04-25T09:15:20.609 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37330.log 2024-04-25T09:15:20.609 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34098.log.gz 2024-04-25T09:15:20.610 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50916.log 2024-04-25T09:15:20.610 INFO:teuthology.orchestra.run.smithi175.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48077.log.gz 2024-04-25T09:15:20.611 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41566.log 2024-04-25T09:15:20.611 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37330.log: /var/log/ceph/ceph-client.0.50916.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37330.log.gz 2024-04-25T09:15:20.612 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50916.log.gz 2024-04-25T09:15:20.612 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51817.log 2024-04-25T09:15:20.613 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37632.log 2024-04-25T09:15:20.613 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41566.log.gz 2024-04-25T09:15:20.614 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45800.log 2024-04-25T09:15:20.614 INFO:teuthology.orchestra.run.smithi175.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51817.log.gz 2024-04-25T09:15:20.615 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47686.log 2024-04-25T09:15:20.616 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37632.log: /var/log/ceph/ceph-client.admin.45800.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37632.log.gz 2024-04-25T09:15:20.616 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39507.log 2024-04-25T09:15:20.617 INFO:teuthology.orchestra.run.smithi175.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.45800.log.gz 2024-04-25T09:15:20.617 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40259.log 2024-04-25T09:15:20.618 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47686.log.gz 2024-04-25T09:15:20.618 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33075.log 2024-04-25T09:15:20.619 INFO:teuthology.orchestra.run.smithi175.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39507.log.gz 2024-04-25T09:15:20.619 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35037.log 2024-04-25T09:15:20.619 INFO:teuthology.orchestra.run.smithi175.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40259.log.gz 2024-04-25T09:15:20.621 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45056.log 2024-04-25T09:15:20.621 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33075.log.gz 2024-04-25T09:15:20.621 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41977.log 2024-04-25T09:15:20.622 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35037.log.gz 2024-04-25T09:15:20.623 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45967.log 2024-04-25T09:15:20.623 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45056.log.gz 2024-04-25T09:15:20.624 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49087.log 2024-04-25T09:15:20.624 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41977.log.gz 2024-04-25T09:15:20.624 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37711.log 2024-04-25T09:15:20.626 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46914.log 2024-04-25T09:15:20.626 INFO:teuthology.orchestra.run.smithi175.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.45967.log.gz 2024-04-25T09:15:20.626 INFO:teuthology.orchestra.run.smithi175.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49087.log.gz 2024-04-25T09:15:20.626 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5/var/log/ceph/ceph-client.admin.37711.log: --verbose -- /var/log/ceph/ceph-client.0.40785.log 2024-04-25T09:15:20.627 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.46914.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.37711.log.gz 2024-04-25T09:15:20.627 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46914.log.gz 2024-04-25T09:15:20.628 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38702.log 2024-04-25T09:15:20.629 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.40785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.40785.log.gz 2024-04-25T09:15:20.629 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39767.log 2024-04-25T09:15:20.630 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49679.log 2024-04-25T09:15:20.630 INFO:teuthology.orchestra.run.smithi175.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38702.log.gz 2024-04-25T09:15:20.631 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39942.log 2024-04-25T09:15:20.631 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39767.log.gz 2024-04-25T09:15:20.632 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44596.log 2024-04-25T09:15:20.633 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49679.log: /var/log/ceph/ceph-client.admin.39942.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49679.log.gz 2024-04-25T09:15:20.633 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47158.log 2024-04-25T09:15:20.633 INFO:teuthology.orchestra.run.smithi175.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39942.log.gz 2024-04-25T09:15:20.634 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34640.log 2024-04-25T09:15:20.634 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44596.log.gz 2024-04-25T09:15:20.635 INFO:teuthology.orchestra.run.smithi175.stderr:gzip/var/log/ceph/ceph-client.admin.47158.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40507.log 2024-04-25T09:15:20.635 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34640.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47158.log.gz 2024-04-25T09:15:20.636 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38756.log 2024-04-25T09:15:20.636 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34640.log.gz 2024-04-25T09:15:20.637 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40507.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40507.log.gz 2024-04-25T09:15:20.637 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43929.log 2024-04-25T09:15:20.638 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47660.log 2024-04-25T09:15:20.639 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38756.log: /var/log/ceph/ceph-client.admin.43929.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38756.log.gz 2024-04-25T09:15:20.639 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44700.log 2024-04-25T09:15:20.639 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43929.log.gz 2024-04-25T09:15:20.640 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34614.log 2024-04-25T09:15:20.640 INFO:teuthology.orchestra.run.smithi175.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47660.log.gz 2024-04-25T09:15:20.641 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33297.log 2024-04-25T09:15:20.641 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4%/var/log/ceph/ceph-client.admin.34614.log: -- replaced with /var/log/ceph/ceph-client.admin.44700.log.gz 2024-04-25T09:15:20.642 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53541.log 2024-04-25T09:15:20.642 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34614.log.gz 2024-04-25T09:15:20.643 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33692.log 2024-04-25T09:15:20.643 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33297.log.gz 2024-04-25T09:15:20.644 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49787.log 2024-04-25T09:15:20.645 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53541.log: /var/log/ceph/ceph-client.admin.33692.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53541.log.gz 2024-04-25T09:15:20.645 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39611.log 2024-04-25T09:15:20.645 INFO:teuthology.orchestra.run.smithi175.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33692.log.gz 2024-04-25T09:15:20.646 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44832.log 2024-04-25T09:15:20.646 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49787.log.gz 2024-04-25T09:15:20.647 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35323.log 2024-04-25T09:15:20.648 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39611.log: /var/log/ceph/ceph-client.admin.44832.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39611.log.gz 2024-04-25T09:15:20.648 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51866.log 2024-04-25T09:15:20.648 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44832.log.gz 2024-04-25T09:15:20.649 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35323.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35323.log.gz 2024-04-25T09:15:20.650 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38559.log 2024-04-25T09:15:20.651 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37777.log 2024-04-25T09:15:20.651 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51866.log: /var/log/ceph/ceph-client.admin.38559.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.51866.log.gz 2024-04-25T09:15:20.652 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36438.log 2024-04-25T09:15:20.652 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38559.log.gz 2024-04-25T09:15:20.652 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36464.log 2024-04-25T09:15:20.653 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37777.log.gz 2024-04-25T09:15:20.653 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38166.log 2024-04-25T09:15:20.654 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36438.log.gz 2024-04-25T09:15:20.655 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35723.log 2024-04-25T09:15:20.655 INFO:teuthology.orchestra.run.smithi175.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36464.log.gz 2024-04-25T09:15:20.656 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38166.log: gzip -5 88.9% --verbose -- replaced with /var/log/ceph/ceph-client.admin.38166.log.gz -- 2024-04-25T09:15:20.656 INFO:teuthology.orchestra.run.smithi175.stderr: /var/log/ceph/ceph-client.admin.46509.log 2024-04-25T09:15:20.657 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45553.log 2024-04-25T09:15:20.657 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35723.log: /var/log/ceph/ceph-client.admin.46509.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35723.log.gz 2024-04-25T09:15:20.658 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36567.log 2024-04-25T09:15:20.658 INFO:teuthology.orchestra.run.smithi175.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46509.log.gz 2024-04-25T09:15:20.659 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45553.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.45553.log.gz 2024-04-25T09:15:20.659 INFO:teuthology.orchestra.run.smithi175.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37991.log 2024-04-25T09:15:20.660 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.36567.log: /var/log/ceph/ceph-client.admin.44051.log 2024-04-25T09:15:20.660 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37991.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36567.log.gz 2024-04-25T09:15:20.661 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40481.log 2024-04-25T09:15:20.661 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37991.log.gz 2024-04-25T09:15:20.662 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44051.log: gzip -5 88.5% --verbose -- replaced with /var/log/ceph/ceph-client.admin.44051.log.gz 2024-04-25T09:15:20.662 INFO:teuthology.orchestra.run.smithi175.stderr: -- /var/log/ceph/ceph-client.admin.40611.log 2024-04-25T09:15:20.663 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38218.log 2024-04-25T09:15:20.663 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40481.log: /var/log/ceph/ceph-client.admin.40611.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40481.log.gz 2024-04-25T09:15:20.664 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34380.log 2024-04-25T09:15:20.664 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40611.log.gz 2024-04-25T09:15:20.665 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50636.log 2024-04-25T09:15:20.665 INFO:teuthology.orchestra.run.smithi175.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38218.log.gz 2024-04-25T09:15:20.666 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39013.log 2024-04-25T09:15:20.666 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34380.log: /var/log/ceph/ceph-client.admin.50636.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34380.log.gz 2024-04-25T09:15:20.667 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35115.log 2024-04-25T09:15:20.667 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50636.log.gz 2024-04-25T09:15:20.668 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.39013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39013.log.gz 2024-04-25T09:15:20.668 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33219.log 2024-04-25T09:15:20.669 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41644.log 2024-04-25T09:15:20.669 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35115.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35115.log.gz 2024-04-25T09:15:20.670 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42425.log 2024-04-25T09:15:20.670 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33219.log.gz 2024-04-25T09:15:20.671 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40402.log 2024-04-25T09:15:20.671 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41644.log.gz 2024-04-25T09:15:20.672 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48950.log 2024-04-25T09:15:20.672 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40402.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42425.log.gz 2024-04-25T09:15:20.673 INFO:teuthology.orchestra.run.smithi175.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40402.log.gz 2024-04-25T09:15:20.673 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41826.log 2024-04-25T09:15:20.674 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45388.log 2024-04-25T09:15:20.675 INFO:teuthology.orchestra.run.smithi175.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48950.log.gz 2024-04-25T09:15:20.676 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52524.log 2024-04-25T09:15:20.676 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41826.log.gz 2024-04-25T09:15:20.677 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41116.log 2024-04-25T09:15:20.677 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.45388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45388.log.gz 2024-04-25T09:15:20.677 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47511.log 2024-04-25T09:15:20.678 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52524.log.gz 2024-04-25T09:15:20.679 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50792.log 2024-04-25T09:15:20.679 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41116.log.gz 2024-04-25T09:15:20.679 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34666.log 2024-04-25T09:15:20.680 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47511.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.47511.log.gz 2024-04-25T09:15:20.680 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52635.log 2024-04-25T09:15:20.681 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50792.log.gz 2024-04-25T09:15:20.682 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52254.log 2024-04-25T09:15:20.682 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34666.log.gz 2024-04-25T09:15:20.682 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46570.log 2024-04-25T09:15:20.683 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52635.log: /var/log/ceph/ceph-client.admin.52254.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52635.log.gz 2024-04-25T09:15:20.684 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37861.log 2024-04-25T09:15:20.684 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52254.log.gz 2024-04-25T09:15:20.685 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46787.log 87.6% 2024-04-25T09:15:20.685 INFO:teuthology.orchestra.run.smithi175.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46570.log.gz 2024-04-25T09:15:20.685 INFO:teuthology.orchestra.run.smithi175.stderr:gzip/var/log/ceph/ceph-client.admin.37861.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51709.log 2024-04-25T09:15:20.686 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46787.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37861.log.gz 2024-04-25T09:15:20.687 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46787.log.gz 2024-04-25T09:15:20.687 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34406.log 2024-04-25T09:15:20.688 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46070.log 2024-04-25T09:15:20.688 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51709.log.gz 2024-04-25T09:15:20.689 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33704.log 2024-04-25T09:15:20.689 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34406.log.gz 2024-04-25T09:15:20.690 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39033.log 2024-04-25T09:15:20.690 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46070.log.gz 2024-04-25T09:15:20.691 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33704.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T09:15:20.691 INFO:teuthology.orchestra.run.smithi175.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33704.log.gz 2024-04-25T09:15:20.692 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33905.log 2024-04-25T09:15:20.692 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39033.log.gz 2024-04-25T09:15:20.693 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48328.log 2024-04-25T09:15:20.694 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44734.log 2024-04-25T09:15:20.694 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33905.log.gz 2024-04-25T09:15:20.695 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47563.log 2024-04-25T09:15:20.695 INFO:teuthology.orchestra.run.smithi175.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48328.log.gz 2024-04-25T09:15:20.696 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27820.log 2024-04-25T09:15:20.697 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44734.log: /var/log/ceph/ceph-client.admin.47563.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44734.log.gz 2024-04-25T09:15:20.697 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39637.log 2024-04-25T09:15:20.698 INFO:teuthology.orchestra.run.smithi175.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47563.log.gz 2024-04-25T09:15:20.698 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.27820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35167.log 2024-04-25T09:15:20.698 INFO:teuthology.orchestra.run.smithi175.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27820.log.gz 2024-04-25T09:15:20.699 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49760.log 2024-04-25T09:15:20.700 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39637.log.gz 2024-04-25T09:15:20.700 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44394.log 2024-04-25T09:15:20.700 INFO:teuthology.orchestra.run.smithi175.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35167.log.gz 2024-04-25T09:15:20.701 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41925.log 2024-04-25T09:15:20.702 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49760.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49760.log.gz 2024-04-25T09:15:20.702 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38270.log 2024-04-25T09:15:20.702 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44394.log.gz 2024-04-25T09:15:20.704 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35645.log 2024-04-25T09:15:20.704 INFO:teuthology.orchestra.run.smithi175.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.41925.log.gz 2024-04-25T09:15:20.704 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37224.log 2024-04-25T09:15:20.705 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38270.log.gz 2024-04-25T09:15:20.706 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52888.log 2024-04-25T09:15:20.706 INFO:teuthology.orchestra.run.smithi175.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35645.log.gz 2024-04-25T09:15:20.706 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35063.log 2024-04-25T09:15:20.707 INFO:teuthology.orchestra.run.smithi175.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37224.log.gz 2024-04-25T09:15:20.708 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41456.log 2024-04-25T09:15:20.708 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52888.log.gz 2024-04-25T09:15:20.709 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36230.log 2024-04-25T09:15:20.709 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35063.log.gz 2024-04-25T09:15:20.710 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44674.log 2024-04-25T09:15:20.711 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41456.log.gz 2024-04-25T09:15:20.711 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53597.log 2024-04-25T09:15:20.711 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36230.log.gz 2024-04-25T09:15:20.712 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46593.log 2024-04-25T09:15:20.713 INFO:teuthology.orchestra.run.smithi175.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44674.log.gz 2024-04-25T09:15:20.713 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52086.log 2024-04-25T09:15:20.714 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53597.log.gz 2024-04-25T09:15:20.715 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43070.log 2024-04-25T09:15:20.715 INFO:teuthology.orchestra.run.smithi175.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.46593.log.gz/var/log/ceph/ceph-client.admin.52086.log: 2024-04-25T09:15:20.715 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33694.log 2024-04-25T09:15:20.717 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40059.log 2024-04-25T09:15:20.717 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43070.log: 92.2% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43070.log.gz 2024-04-25T09:15:20.718 INFO:teuthology.orchestra.run.smithi175.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52086.log.gz/var/log/ceph/ceph-client.admin.33694.log: 2024-04-25T09:15:20.718 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39235.log 2024-04-25T09:15:20.718 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33694.log.gz 2024-04-25T09:15:20.719 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40059.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.40059.log.gz 2024-04-25T09:15:20.719 INFO:teuthology.orchestra.run.smithi175.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40663.log 2024-04-25T09:15:20.719 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36152.log 2024-04-25T09:15:20.721 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40663.log: 91.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.39235.log.gz 2024-04-25T09:15:20.721 INFO:teuthology.orchestra.run.smithi175.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39968.log 2024-04-25T09:15:20.721 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40663.log.gz 2024-04-25T09:15:20.722 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47738.log 2024-04-25T09:15:20.722 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36152.log.gz 2024-04-25T09:15:20.722 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33271.log 2024-04-25T09:15:20.723 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39968.log.gz 2024-04-25T09:15:20.724 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51646.log 2024-04-25T09:15:20.724 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47738.log.gz 2024-04-25T09:15:20.725 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47907.log 2024-04-25T09:15:20.725 INFO:teuthology.orchestra.run.smithi175.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33271.log.gz 2024-04-25T09:15:20.726 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.51646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51646.log.gz 2024-04-25T09:15:20.726 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42529.log 2024-04-25T09:15:20.727 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41670.log 2024-04-25T09:15:20.728 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47907.log: /var/log/ceph/ceph-client.admin.42529.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47907.log.gz 2024-04-25T09:15:20.728 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43416.log 2024-04-25T09:15:20.728 INFO:teuthology.orchestra.run.smithi175.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42529.log.gz 2024-04-25T09:15:20.729 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41670.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41670.log.gz 2024-04-25T09:15:20.730 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33442.log 2024-04-25T09:15:20.730 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43416.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43416.log.gz 2024-04-25T09:15:20.730 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45523.log 2024-04-25T09:15:20.731 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44264.log 2024-04-25T09:15:20.732 INFO:teuthology.orchestra.run.smithi175.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33442.log.gz 2024-04-25T09:15:20.733 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50047.log 2024-04-25T09:15:20.733 INFO:teuthology.orchestra.run.smithi175.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45523.log.gz 2024-04-25T09:15:20.734 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45342.log 2024-04-25T09:15:20.734 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44264.log.gz 2024-04-25T09:15:20.735 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41871.log 2024-04-25T09:15:20.735 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50047.log.gz 2024-04-25T09:15:20.736 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34328.log 2024-04-25T09:15:20.736 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45342.log.gz 2024-04-25T09:15:20.737 INFO:teuthology.orchestra.run.smithi175.stderr:gzip/var/log/ceph/ceph-client.admin.41871.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38860.log 2024-04-25T09:15:20.737 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41871.log.gz 2024-04-25T09:15:20.738 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36632.log 2024-04-25T09:15:20.738 INFO:teuthology.orchestra.run.smithi175.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34328.log.gz 2024-04-25T09:15:20.739 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51137.log 2024-04-25T09:15:20.739 INFO:teuthology.orchestra.run.smithi175.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38860.log.gz 2024-04-25T09:15:20.741 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38587.log 2024-04-25T09:15:20.741 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36632.log.gz 2024-04-25T09:15:20.741 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35585.log 2024-04-25T09:15:20.741 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51137.log.gz 2024-04-25T09:15:20.742 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48533.log 2024-04-25T09:15:20.742 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38587.log.gz 2024-04-25T09:15:20.744 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51407.log 2024-04-25T09:15:20.744 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35585.log.gz 2024-04-25T09:15:20.744 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.48533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48533.log.gz 2024-04-25T09:15:20.744 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49554.log 2024-04-25T09:15:20.745 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48846.log 2024-04-25T09:15:20.745 INFO:teuthology.orchestra.run.smithi175.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51407.log.gz 2024-04-25T09:15:20.746 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52609.log 2024-04-25T09:15:20.747 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48846.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49554.log.gz 2024-04-25T09:15:20.747 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48846.log.gz 2024-04-25T09:15:20.749 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52609.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52609.log.gz 2024-04-25T09:15:20.749 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48194.log 2024-04-25T09:15:20.750 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.34986.log 2024-04-25T09:15:20.751 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33913.log 2024-04-25T09:15:20.751 INFO:teuthology.orchestra.run.smithi175.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48194.log.gz 2024-04-25T09:15:20.752 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.2.34986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.34986.log.gz 2024-04-25T09:15:20.752 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36763.log 2024-04-25T09:15:20.753 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43338.log 2024-04-25T09:15:20.754 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33913.log.gz 2024-04-25T09:15:20.754 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37278.log 2024-04-25T09:15:20.754 INFO:teuthology.orchestra.run.smithi175.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36763.log.gz 2024-04-25T09:15:20.755 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39345.log 2024-04-25T09:15:20.756 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43338.log.gz 2024-04-25T09:15:20.756 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37278.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T09:15:20.757 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37278.log.gz 2024-04-25T09:15:20.758 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34097.log 2024-04-25T09:15:20.758 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39345.log.gz 2024-04-25T09:15:20.758 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36684.log 2024-04-25T09:15:20.760 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.34097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48656.log 2024-04-25T09:15:20.760 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34097.log.gz 2024-04-25T09:15:20.761 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37497.log 2024-04-25T09:15:20.761 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36684.log.gz 2024-04-25T09:15:20.762 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48528.log 2024-04-25T09:15:20.762 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48656.log.gz 2024-04-25T09:15:20.763 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51005.log 2024-04-25T09:15:20.763 INFO:teuthology.orchestra.run.smithi175.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37497.log.gz 2024-04-25T09:15:20.764 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.48528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48528.log.gz 2024-04-25T09:15:20.764 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40533.log 2024-04-25T09:15:20.766 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34588.log 2024-04-25T09:15:20.766 INFO:teuthology.orchestra.run.smithi175.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51005.log.gz 2024-04-25T09:15:20.767 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47032.log 2024-04-25T09:15:20.767 INFO:teuthology.orchestra.run.smithi175.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40533.log.gz 2024-04-25T09:15:20.767 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34588.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34588.log.gz 2024-04-25T09:15:20.767 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46456.log 2024-04-25T09:15:20.768 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52446.log 2024-04-25T09:15:20.769 INFO:teuthology.orchestra.run.smithi175.stderr: 91.3%/var/log/ceph/ceph-client.admin.46456.log: -- replaced with /var/log/ceph/ceph-client.admin.47032.log.gz 2024-04-25T09:15:20.770 INFO:teuthology.orchestra.run.smithi175.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46456.log.gz 2024-04-25T09:15:20.770 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44544.log 2024-04-25T09:15:20.771 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52446.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52446.log.gz 2024-04-25T09:15:20.771 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44212.log 2024-04-25T09:15:20.772 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39083.log 2024-04-25T09:15:20.773 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44544.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44544.log.gz 2024-04-25T09:15:20.774 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44212.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44212.log.gz 2024-04-25T09:15:20.774 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46482.log 2024-04-25T09:15:20.776 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39083.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.39083.log.gz 2024-04-25T09:15:20.776 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39060.log 2024-04-25T09:15:20.777 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40429.log 2024-04-25T09:15:20.777 INFO:teuthology.orchestra.run.smithi175.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46482.log.gz 2024-04-25T09:15:20.778 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35401.log 2024-04-25T09:15:20.778 INFO:teuthology.orchestra.run.smithi175.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.39060.log.gz 2024-04-25T09:15:20.779 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43288.log 2024-04-25T09:15:20.780 INFO:teuthology.orchestra.run.smithi177.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T09:15:20.780 INFO:teuthology.orchestra.run.smithi175.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40429.log.gz 2024-04-25T09:15:20.780 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50203.log 2024-04-25T09:15:20.780 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35401.log.gz 2024-04-25T09:15:20.781 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.43288.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.0.43288.log.gz -5 2024-04-25T09:15:20.781 INFO:teuthology.orchestra.run.smithi175.stderr: --verbose -- /var/log/ceph/ceph-client.admin.35089.log 2024-04-25T09:15:20.783 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40027.log 2024-04-25T09:15:20.783 INFO:teuthology.orchestra.run.smithi175.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50203.log.gz 2024-04-25T09:15:20.784 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51315.log 2024-04-25T09:15:20.784 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35089.log.gz 2024-04-25T09:15:20.785 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44965.log 2024-04-25T09:15:20.785 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40027.log.gz 2024-04-25T09:15:20.786 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48432.log 2024-04-25T09:15:20.786 INFO:teuthology.orchestra.run.smithi175.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51315.log.gz 2024-04-25T09:15:20.787 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32974.log 2024-04-25T09:15:20.787 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44965.log.gz 2024-04-25T09:15:20.788 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48133.log 2024-04-25T09:15:20.789 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.32974.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.48432.log.gz 2024-04-25T09:15:20.789 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32974.log.gz 2024-04-25T09:15:20.790 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38533.log 2024-04-25T09:15:20.791 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48133.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48133.log.gz 2024-04-25T09:15:20.791 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50125.log 2024-04-25T09:15:20.792 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42914.log 2024-04-25T09:15:20.793 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38533.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38533.log.gz 2024-04-25T09:15:20.793 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50125.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50125.log.gz 2024-04-25T09:15:20.794 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48354.log 2024-04-25T09:15:20.795 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42914.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42914.log.gz 2024-04-25T09:15:20.795 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42996.log 2024-04-25T09:15:20.796 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50556.log 2024-04-25T09:15:20.797 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48354.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48354.log.gz/var/log/ceph/ceph-client.admin.42996.log: 2024-04-25T09:15:20.798 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42996.log.gz 2024-04-25T09:15:20.798 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45497.log 2024-04-25T09:15:20.798 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50556.log.gz 2024-04-25T09:15:20.799 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34752.log 2024-04-25T09:15:20.800 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41722.log 2024-04-25T09:15:20.801 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45497.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45497.log.gz 2024-04-25T09:15:20.801 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34752.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34752.log.gz 2024-04-25T09:15:20.802 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39423.log 2024-04-25T09:15:20.802 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41722.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41722.log.gz 2024-04-25T09:15:20.803 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46020.log 2024-04-25T09:15:20.804 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38017.log 2024-04-25T09:15:20.805 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39423.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39423.log.gz 2024-04-25T09:15:20.806 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46020.log: /var/log/ceph/ceph-client.admin.38017.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46020.log.gz 2024-04-25T09:15:20.806 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50820.log 2024-04-25T09:15:20.806 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38017.log.gz 2024-04-25T09:15:20.807 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47108.log 2024-04-25T09:15:20.809 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37452.log 2024-04-25T09:15:20.809 INFO:teuthology.orchestra.run.smithi175.stderr: 91.3%/var/log/ceph/ceph-client.admin.47108.log: -- replaced with /var/log/ceph/ceph-client.admin.50820.log.gz 2024-04-25T09:15:20.810 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49404.log 2024-04-25T09:15:20.811 INFO:teuthology.orchestra.run.smithi175.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.47108.log.gz 2024-04-25T09:15:20.811 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.37452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37452.log.gz 2024-04-25T09:15:20.811 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41142.log 2024-04-25T09:15:20.812 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37965.log 2024-04-25T09:15:20.813 INFO:teuthology.orchestra.run.smithi175.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49404.log.gz 2024-04-25T09:15:20.814 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34354.log 2024-04-25T09:15:20.814 INFO:teuthology.orchestra.run.smithi175.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41142.log.gz/var/log/ceph/ceph-client.admin.37965.log: 2024-04-25T09:15:20.815 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45393.log 2024-04-25T09:15:20.815 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37965.log.gz 2024-04-25T09:15:20.816 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34354.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34354.log.gz 2024-04-25T09:15:20.817 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46326.log 2024-04-25T09:15:20.817 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.45393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45393.log.gz 2024-04-25T09:15:20.818 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27585.log 2024-04-25T09:15:20.819 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42120.log 2024-04-25T09:15:20.819 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46326.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46326.log.gz/var/log/ceph/ceph-client.admin.27585.log: 2024-04-25T09:15:20.820 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27585.log.gz 2024-04-25T09:15:20.821 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34110.log 2024-04-25T09:15:20.821 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42120.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42120.log.gz 2024-04-25T09:15:20.822 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35011.log 2024-04-25T09:15:20.823 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34110.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.34110.log.gz 2024-04-25T09:15:20.823 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33390.log 2024-04-25T09:15:20.824 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43237.log 2024-04-25T09:15:20.825 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35011.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35011.log.gz 2024-04-25T09:15:20.826 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33390.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33390.log.gz 2024-04-25T09:15:20.826 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53437.log 2024-04-25T09:15:20.827 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43237.log.gz 2024-04-25T09:15:20.827 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52940.log 2024-04-25T09:15:20.828 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38886.log 2024-04-25T09:15:20.829 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53437.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53437.log.gz/var/log/ceph/ceph-client.admin.52940.log: 2024-04-25T09:15:20.829 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52940.log.gz 2024-04-25T09:15:20.830 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49483.log 2024-04-25T09:15:20.831 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38886.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38886.log.gz 2024-04-25T09:15:20.831 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41370.log 2024-04-25T09:15:20.832 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35245.log 2024-04-25T09:15:20.833 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49483.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49483.log.gz/var/log/ceph/ceph-client.admin.41370.log: 2024-04-25T09:15:20.833 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50688.log 2024-04-25T09:15:20.834 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41370.log.gz 2024-04-25T09:15:20.835 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47457.log 2024-04-25T09:15:20.835 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35245.log.gz 2024-04-25T09:15:20.836 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48380.log 2024-04-25T09:15:20.836 INFO:teuthology.orchestra.run.smithi175.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50688.log.gz 2024-04-25T09:15:20.837 INFO:teuthology.orchestra.run.smithi177.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T09:15:20.837 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47457.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47457.log.gz 2024-04-25T09:15:20.838 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43312.log 2024-04-25T09:15:20.838 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48380.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48380.log.gz 2024-04-25T09:15:20.839 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52713.log 2024-04-25T09:15:20.840 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33548.log 2024-04-25T09:15:20.840 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43312.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43312.log.gz 2024-04-25T09:15:20.841 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33245.log 2024-04-25T09:15:20.841 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52713.log.gz 2024-04-25T09:15:20.842 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33548.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33548.log.gz 2024-04-25T09:15:20.842 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51844.log 2024-04-25T09:15:20.843 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37120.log 2024-04-25T09:15:20.843 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33245.log.gz 2024-04-25T09:15:20.845 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49016.log 2024-04-25T09:15:20.845 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51844.log.gz 2024-04-25T09:15:20.846 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37120.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37120.log.gz 2024-04-25T09:15:20.846 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T09:15:20.847 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49734.log 2024-04-25T09:15:20.847 INFO:teuthology.orchestra.run.smithi175.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49016.log.gz 2024-04-25T09:15:20.848 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35505.log 2024-04-25T09:15:20.850 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49734.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49734.log.gz 2024-04-25T09:15:20.850 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33702.log 2024-04-25T09:15:20.851 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35505.log.gz 2024-04-25T09:15:20.851 INFO:teuthology.orchestra.run.smithi175.stderr: 86.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T09:15:20.851 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46430.log 2024-04-25T09:15:20.852 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48898.log 2024-04-25T09:15:20.853 INFO:teuthology.orchestra.run.smithi175.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33702.log.gz 2024-04-25T09:15:20.854 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40990.log 2024-04-25T09:15:20.854 INFO:teuthology.orchestra.run.smithi175.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46430.log.gz 2024-04-25T09:15:20.855 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36126.log 2024-04-25T09:15:20.855 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48898.log.gz 2024-04-25T09:15:20.856 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47790.log 2024-04-25T09:15:20.856 INFO:teuthology.orchestra.run.smithi175.stderr: 91.4%/var/log/ceph/ceph-client.admin.36126.log: -- replaced with /var/log/ceph/ceph-client.admin.40990.log.gz 2024-04-25T09:15:20.857 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44186.log 2024-04-25T09:15:20.858 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36126.log.gz 2024-04-25T09:15:20.858 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41320.log 2024-04-25T09:15:20.858 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47790.log.gz 2024-04-25T09:15:20.860 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36204.log 2024-04-25T09:15:20.860 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44186.log.gz 2024-04-25T09:15:20.861 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33914.log 2024-04-25T09:15:20.861 INFO:teuthology.orchestra.run.smithi175.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.41320.log.gz 2024-04-25T09:15:20.862 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50465.log 2024-04-25T09:15:20.862 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36204.log.gz 2024-04-25T09:15:20.864 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41482.log 2024-04-25T09:15:20.864 INFO:teuthology.orchestra.run.smithi175.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33914.log.gz 2024-04-25T09:15:20.864 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50465.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50465.log.gz 2024-04-25T09:15:20.865 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33894.log 2024-04-25T09:15:20.866 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41748.log 2024-04-25T09:15:20.867 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41482.log.gz 2024-04-25T09:15:20.867 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37887.log 2024-04-25T09:15:20.867 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33894.log.gz 2024-04-25T09:15:20.868 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41748.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41748.log.gz 2024-04-25T09:15:20.868 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33906.log 2024-04-25T09:15:20.869 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45646.log 2024-04-25T09:15:20.869 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37887.log.gz 2024-04-25T09:15:20.871 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37040.log 2024-04-25T09:15:20.871 INFO:teuthology.orchestra.run.smithi175.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33906.log.gz 2024-04-25T09:15:20.872 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45646.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45646.log.gz 2024-04-25T09:15:20.872 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42838.log 2024-04-25T09:15:20.873 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37040.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37040.log.gzgzip 2024-04-25T09:15:20.873 INFO:teuthology.orchestra.run.smithi175.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52765.log 2024-04-25T09:15:20.874 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.42838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42838.log.gz 2024-04-25T09:15:20.874 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53047.log 2024-04-25T09:15:20.875 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42265.log 2024-04-25T09:15:20.876 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52765.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52765.log.gz 2024-04-25T09:15:20.876 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46540.log 2024-04-25T09:15:20.876 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53047.log.gz 2024-04-25T09:15:20.877 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42265.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42265.log.gz 2024-04-25T09:15:20.878 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33706.log 2024-04-25T09:15:20.879 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49943.log 2024-04-25T09:15:20.879 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46540.log.gz 2024-04-25T09:15:20.880 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49891.log 2024-04-25T09:15:20.880 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33706.log.gz 2024-04-25T09:15:20.881 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49943.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49943.log.gz 2024-04-25T09:15:20.882 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41951.log 2024-04-25T09:15:20.883 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51910.log 2024-04-25T09:15:20.883 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49891.log.gz 2024-04-25T09:15:20.884 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48739.log 2024-04-25T09:15:20.884 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41951.log.gz 2024-04-25T09:15:20.885 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50979.log 2024-04-25T09:15:20.885 INFO:teuthology.orchestra.run.smithi175.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.51910.log.gz 2024-04-25T09:15:20.886 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51087.log 2024-04-25T09:15:20.886 INFO:teuthology.orchestra.run.smithi175.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48739.log.gz 2024-04-25T09:15:20.887 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50979.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50979.log.gz 2024-04-25T09:15:20.888 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41066.log 2024-04-25T09:15:20.889 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51087.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.51087.log.gz 2024-04-25T09:15:20.889 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51470.log 2024-04-25T09:15:20.890 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42685.log 2024-04-25T09:15:20.891 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51470.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.41066.log.gz 2024-04-25T09:15:20.891 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51470.log.gz 2024-04-25T09:15:20.892 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46222.log 2024-04-25T09:15:20.893 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42685.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42685.log.gz 2024-04-25T09:15:20.893 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49969.log 2024-04-25T09:15:20.894 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52376.log 2024-04-25T09:15:20.895 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46222.log: /var/log/ceph/ceph-client.admin.49969.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46222.log.gz 2024-04-25T09:15:20.895 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49969.log.gz 2024-04-25T09:15:20.896 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49376.log 2024-04-25T09:15:20.896 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.52376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52376.log.gz 2024-04-25T09:15:20.896 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36893.log 2024-04-25T09:15:20.898 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49376.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49376.log.gz 2024-04-25T09:15:20.898 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49225.log 2024-04-25T09:15:20.900 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52661.log 2024-04-25T09:15:20.900 INFO:teuthology.orchestra.run.smithi175.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36893.log.gz 2024-04-25T09:15:20.901 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33899.log 2024-04-25T09:15:20.901 INFO:teuthology.orchestra.run.smithi175.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.49225.log.gz 2024-04-25T09:15:20.902 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52661.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52661.log.gz 2024-04-25T09:15:20.902 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50439.log 2024-04-25T09:15:20.903 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38244.log 2024-04-25T09:15:20.904 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33899.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33899.log.gz 2024-04-25T09:15:20.904 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50439.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50439.log.gz 2024-04-25T09:15:20.905 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38069.log 2024-04-25T09:15:20.905 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38244.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38244.log.gz 2024-04-25T09:15:20.906 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33689.log 2024-04-25T09:15:20.907 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38808.log 2024-04-25T09:15:20.907 INFO:teuthology.orchestra.run.smithi175.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38069.log.gz 2024-04-25T09:15:20.908 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36048.log 2024-04-25T09:15:20.908 INFO:teuthology.orchestra.run.smithi175.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33689.log.gz 2024-04-25T09:15:20.909 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53333.log 2024-04-25T09:15:20.910 INFO:teuthology.orchestra.run.smithi175.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38808.log.gz 2024-04-25T09:15:20.911 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36048.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36048.log.gz 2024-04-25T09:15:20.911 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34458.log 2024-04-25T09:15:20.912 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53333.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53333.log.gz 2024-04-25T09:15:20.912 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47217.log 2024-04-25T09:15:20.913 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43803.log 2024-04-25T09:15:20.914 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34458.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34458.log.gz 2024-04-25T09:15:20.914 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47217.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47217.log.gz 2024-04-25T09:15:20.915 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49865.log 2024-04-25T09:15:20.916 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43803.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.43803.log.gz 2024-04-25T09:15:20.916 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48578.log 2024-04-25T09:15:20.918 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51496.log 2024-04-25T09:15:20.918 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49865.log.gz 2024-04-25T09:15:20.919 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48578.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48578.log.gz 2024-04-25T09:15:20.919 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38296.log 2024-04-25T09:15:20.920 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51496.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51496.log.gz 2024-04-25T09:15:20.920 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46978.log 2024-04-25T09:15:20.921 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42211.log 2024-04-25T09:15:20.924 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38296.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38296.log.gz/var/log/ceph/ceph-client.admin.46978.log: 2024-04-25T09:15:20.924 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42211.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46978.log.gz 2024-04-25T09:15:20.924 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49917.log 2024-04-25T09:15:20.924 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42211.log.gz 2024-04-25T09:15:20.925 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42833.log 2024-04-25T09:15:20.926 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40376.log 2024-04-25T09:15:20.926 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49917.log.gz 2024-04-25T09:15:20.927 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.42833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44155.log 2024-04-25T09:15:20.927 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42833.log.gz 2024-04-25T09:15:20.929 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40376.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40376.log.gz 2024-04-25T09:15:20.929 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35427.log 2024-04-25T09:15:20.929 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44155.log.gz 2024-04-25T09:15:20.930 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44103.log 2024-04-25T09:15:20.931 INFO:teuthology.orchestra.run.smithi177.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T09:15:20.932 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45028.log 2024-04-25T09:15:20.932 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35427.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35427.log.gz/var/log/ceph/ceph-client.admin.44103.log: 2024-04-25T09:15:20.932 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44103.log.gz 2024-04-25T09:15:20.933 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52059.log 2024-04-25T09:15:20.934 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45028.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45028.log.gz 2024-04-25T09:15:20.934 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33522.log 2024-04-25T09:15:20.935 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42659.log 2024-04-25T09:15:20.937 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52059.log: /var/log/ceph/ceph-client.admin.33522.log: 89.2% 92.4% -- replaced with /var/log/ceph/ceph-client.admin.52059.log.gz 2024-04-25T09:15:20.938 INFO:teuthology.orchestra.run.smithi175.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33522.log.gz 2024-04-25T09:15:20.938 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42659.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42659.log.gz 2024-04-25T09:15:20.938 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42055.log 2024-04-25T09:15:20.938 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48924.log 2024-04-25T09:15:20.940 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51183.log 2024-04-25T09:15:20.940 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42055.log.gz 2024-04-25T09:15:20.941 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44911.log 2024-04-25T09:15:20.941 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48924.log.gz 2024-04-25T09:15:20.942 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.51183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51183.log.gz 2024-04-25T09:15:20.942 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37304.log 2024-04-25T09:15:20.943 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44911.log: 89.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50921.log 2024-04-25T09:15:20.944 INFO:teuthology.orchestra.run.smithi175.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44911.log.gz 2024-04-25T09:15:20.945 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53255.log 2024-04-25T09:15:20.945 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37304.log.gz 2024-04-25T09:15:20.946 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.50921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50740.log 2024-04-25T09:15:20.946 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50921.log.gz 2024-04-25T09:15:20.947 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33700.log 2024-04-25T09:15:20.947 INFO:teuthology.orchestra.run.smithi175.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53255.log.gz 2024-04-25T09:15:20.948 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37014.log 2024-04-25T09:15:20.948 INFO:teuthology.orchestra.run.smithi175.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50740.log.gz 2024-04-25T09:15:20.949 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38357.log 2024-04-25T09:15:20.950 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33700.log.gz 2024-04-25T09:15:20.950 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33496.log 2024-04-25T09:15:20.951 INFO:teuthology.orchestra.run.smithi175.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37014.log.gz 2024-04-25T09:15:20.951 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49813.log 2024-04-25T09:15:20.951 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38357.log.gz 2024-04-25T09:15:20.953 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51787.log 2024-04-25T09:15:20.953 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33496.log.gz 2024-04-25T09:15:20.954 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49813.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49813.log.gz 2024-04-25T09:15:20.954 INFO:teuthology.orchestra.run.smithi175.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36386.log 2024-04-25T09:15:20.955 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52583.log 2024-04-25T09:15:20.955 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51787.log.gz 2024-04-25T09:15:20.957 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51263.log 2024-04-25T09:15:20.957 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36386.log.gz 2024-04-25T09:15:20.958 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37198.log 2024-04-25T09:15:20.958 INFO:teuthology.orchestra.run.smithi175.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52583.log.gz 2024-04-25T09:15:20.959 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42319.log 2024-04-25T09:15:20.959 INFO:teuthology.orchestra.run.smithi175.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.51263.log.gz 2024-04-25T09:15:20.960 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53281.log 2024-04-25T09:15:20.961 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37198.log.gz 2024-04-25T09:15:20.961 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42319.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42319.log.gz 2024-04-25T09:15:20.962 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38615.log 2024-04-25T09:15:20.962 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52472.log 2024-04-25T09:15:20.963 INFO:teuthology.orchestra.run.smithi175.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53281.log.gz 2024-04-25T09:15:20.964 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35533.log 2024-04-25T09:15:20.964 INFO:teuthology.orchestra.run.smithi175.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38615.log.gz 2024-04-25T09:15:20.965 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35780.log 2024-04-25T09:15:20.965 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52472.log.gz 2024-04-25T09:15:20.966 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38389.log 2024-04-25T09:15:20.966 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35533.log.gz 2024-04-25T09:15:20.967 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47816.log 2024-04-25T09:15:20.968 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35780.log.gz 2024-04-25T09:15:20.969 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53203.log 2024-04-25T09:15:20.969 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38389.log.gz 2024-04-25T09:15:20.970 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47816.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47816.log.gz 2024-04-25T09:15:20.970 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39559.log 2024-04-25T09:15:20.971 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53203.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53203.log.gz 2024-04-25T09:15:20.971 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43446.log 2024-04-25T09:15:20.972 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42088.log 2024-04-25T09:15:20.973 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39559.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39559.log.gz 2024-04-25T09:15:20.974 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43446.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43446.log.gz 2024-04-25T09:15:20.975 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42088.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T09:15:20.975 INFO:teuthology.orchestra.run.smithi175.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42088.log.gz 2024-04-25T09:15:20.975 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43390.log 2024-04-25T09:15:20.977 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40231.log 2024-04-25T09:15:20.979 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43390.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43390.log.gz 2024-04-25T09:15:20.980 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40231.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40231.log.gz 2024-04-25T09:15:20.980 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T09:15:20.980 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33889.log 2024-04-25T09:15:20.981 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43751.log 2024-04-25T09:15:20.982 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33889.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T09:15:20.982 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33889.log.gz 2024-04-25T09:15:20.984 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52381.log 2024-04-25T09:15:20.984 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mds.c.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.43751.log.gz 2024-04-25T09:15:20.985 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.52381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52381.log.gz 2024-04-25T09:15:20.985 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49190.log 2024-04-25T09:15:20.987 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47764.log 2024-04-25T09:15:20.988 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49190.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49190.log.gz 2024-04-25T09:15:20.988 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47764.log: -- /var/log/ceph/ceph-client.admin.51057.log 2024-04-25T09:15:20.989 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47764.log.gz 2024-04-25T09:15:20.989 INFO:teuthology.orchestra.run.smithi177.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T09:15:20.991 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51057.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51057.log.gz 2024-04-25T09:15:20.991 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53177.log 2024-04-25T09:15:20.992 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37250.log 2024-04-25T09:15:20.994 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53177.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53177.log.gz 2024-04-25T09:15:20.995 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48248.log 2024-04-25T09:15:20.995 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37250.log.gz 2024-04-25T09:15:20.996 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52555.log 2024-04-25T09:15:20.997 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48248.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48248.log.gz 2024-04-25T09:15:20.998 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T09:15:20.999 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52555.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52555.log.gz 2024-04-25T09:15:21.005 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50386.log 2024-04-25T09:15:21.007 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44884.log 2024-04-25T09:15:21.008 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50766.log 2024-04-25T09:15:21.008 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50386.log.gz 2024-04-25T09:15:21.009 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44884.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44884.log.gz 2024-04-25T09:15:21.010 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42003.log 2024-04-25T09:15:21.012 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50766.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50766.log.gz 2024-04-25T09:15:21.013 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48716.log 2024-04-25T09:15:21.015 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42003.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42003.log.gz 2024-04-25T09:15:21.018 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47082.log 2024-04-25T09:15:21.020 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48716.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48716.log.gz 2024-04-25T09:15:21.021 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48025.log 2024-04-25T09:15:21.025 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47082.log: /var/log/ceph/ceph-client.admin.48025.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45082.log 2024-04-25T09:15:21.025 INFO:teuthology.orchestra.run.smithi175.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47082.log.gz 2024-04-25T09:15:21.026 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48025.log.gz 2024-04-25T09:15:21.031 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43675.log 2024-04-25T09:15:21.032 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45082.log.gz 2024-04-25T09:15:21.034 INFO:teuthology.orchestra.run.smithi175.stderr:gzip/var/log/ceph/ceph-client.admin.43675.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43496.log 2024-04-25T09:15:21.037 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52498.log 2024-04-25T09:15:21.037 INFO:teuthology.orchestra.run.smithi175.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.43496.log.gz 2024-04-25T09:15:21.038 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43675.log.gz 2024-04-25T09:15:21.041 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42966.log 2024-04-25T09:15:21.041 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52498.log.gz 2024-04-25T09:15:21.042 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48872.log 2024-04-25T09:15:21.043 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42966.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42966.log.gz 2024-04-25T09:15:21.047 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42862.log 2024-04-25T09:15:21.048 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48872.log.gz 2024-04-25T09:15:21.051 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36737.log 2024-04-25T09:15:21.055 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36737.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36737.log.gz 2024-04-25T09:15:21.055 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42862.log.gz 2024-04-25T09:15:21.055 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34114.log 2024-04-25T09:15:21.058 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34114.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34114.log.gz 2024-04-25T09:15:21.058 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40153.log 2024-04-25T09:15:21.061 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36282.log 2024-04-25T09:15:21.061 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40153.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40153.log.gz 2024-04-25T09:15:21.064 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36282.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36282.log.gz 2024-04-25T09:15:21.064 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41696.log 2024-04-25T09:15:21.066 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41696.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41696.log.gz 2024-04-25T09:15:21.067 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35858.log 2024-04-25T09:15:21.070 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35858.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35858.log.gz 2024-04-25T09:15:21.070 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48815.log 2024-04-25T09:15:21.072 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.48815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48815.log.gz 2024-04-25T09:15:21.072 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51348.log 2024-04-25T09:15:21.075 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51348.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51348.log.gz 2024-04-25T09:15:21.075 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40205.log 2024-04-25T09:15:21.078 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43549.log 2024-04-25T09:15:21.078 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40205.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40205.log.gz 2024-04-25T09:15:21.080 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34121.log 2024-04-25T09:15:21.084 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34121.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34121.log.gz 2024-04-25T09:15:21.084 INFO:teuthology.orchestra.run.smithi175.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.43549.log.gz 2024-04-25T09:15:21.084 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44472.log 2024-04-25T09:15:21.087 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44472.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44472.log.gz 2024-04-25T09:15:21.087 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47999.log 2024-04-25T09:15:21.089 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50151.log 2024-04-25T09:15:21.093 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50151.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50151.log.gz 2024-04-25T09:15:21.094 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47999.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47999.log.gz 2024-04-25T09:15:21.094 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37913.log 2024-04-25T09:15:21.099 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37913.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37913.log.gz 2024-04-25T09:15:21.099 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47243.log 2024-04-25T09:15:21.100 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47243.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47243.log.gz 2024-04-25T09:15:21.100 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33416.log 2024-04-25T09:15:21.102 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33416.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33416.log.gz 2024-04-25T09:15:21.102 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48482.log 2024-04-25T09:15:21.105 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42787.log 2024-04-25T09:15:21.106 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48482.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.48482.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51432.log 2024-04-25T09:15:21.106 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-04-25T09:15:21.109 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42787.log: /var/log/ceph/ceph-client.admin.51432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33626.log 2024-04-25T09:15:21.110 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51432.log.gz 2024-04-25T09:15:21.110 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53489.log 2024-04-25T09:15:21.117 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33626.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33626.log.gz 2024-04-25T09:15:21.117 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53489.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53489.log.gz 2024-04-25T09:15:21.117 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47269.log 2024-04-25T09:15:21.117 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42787.log.gz 2024-04-25T09:15:21.117 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47269.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47269.log.gz 2024-04-25T09:15:21.117 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37939.log 2024-04-25T09:15:21.118 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37939.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37939.log.gz 2024-04-25T09:15:21.119 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47191.log 2024-04-25T09:15:21.121 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43022.log 2024-04-25T09:15:21.122 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47191.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47191.log.gz 2024-04-25T09:15:21.124 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43045.log 2024-04-25T09:15:21.124 INFO:teuthology.orchestra.run.smithi177.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T09:15:21.125 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43022.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43022.log.gz 2024-04-25T09:15:21.126 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.43045.log: /var/log/ceph/ceph-client.admin.52849.log 2024-04-25T09:15:21.126 INFO:teuthology.orchestra.run.smithi177.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T09:15:21.128 INFO:teuthology.orchestra.run.smithi175.stderr: 90.0%/var/log/ceph/ceph-client.admin.52849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48810.log 2024-04-25T09:15:21.129 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-04-25T09:15:21.129 INFO:teuthology.orchestra.run.smithi177.stderr:real 0m0.707s 2024-04-25T09:15:21.129 INFO:teuthology.orchestra.run.smithi177.stderr:user 0m2.929s 2024-04-25T09:15:21.129 INFO:teuthology.orchestra.run.smithi177.stderr:sys 0m0.278s 2024-04-25T09:15:21.130 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53073.log 2024-04-25T09:15:21.130 INFO:teuthology.orchestra.run.smithi175.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52849.log.gz 2024-04-25T09:15:21.132 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.48810.log: /var/log/ceph/ceph-client.admin.53073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38043.log 2024-04-25T09:15:21.133 INFO:teuthology.orchestra.run.smithi175.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43045.log.gz 2024-04-25T09:15:21.133 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53073.log.gz 2024-04-25T09:15:21.134 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45134.log 2024-04-25T09:15:21.136 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38043.log: /var/log/ceph/ceph-client.admin.45134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48604.log 2024-04-25T09:15:21.137 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48810.log.gz 2024-04-25T09:15:21.137 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45583.log 2024-04-25T09:15:21.139 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48604.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48604.log.gz 2024-04-25T09:15:21.140 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45583.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45583.log.gz 2024-04-25T09:15:21.140 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45134.log.gz 2024-04-25T09:15:21.141 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40885.log 2024-04-25T09:15:21.142 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38043.log.gz 2024-04-25T09:15:21.145 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40885.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.40885.log.gz 2024-04-25T09:15:21.145 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44993.log 2024-04-25T09:15:21.148 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44993.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44993.log.gz 2024-04-25T09:15:21.148 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50262.log 2024-04-25T09:15:21.150 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50262.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50262.log.gz 2024-04-25T09:15:21.151 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45720.log 2024-04-25T09:15:21.154 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45720.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45720.log.gz 2024-04-25T09:15:21.154 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42291.log 2024-04-25T09:15:21.157 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42291.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42291.log.gz 2024-04-25T09:15:21.157 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47615.log 2024-04-25T09:15:21.160 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47615.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47615.log.gz 2024-04-25T09:15:21.160 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22733.log 2024-04-25T09:15:21.162 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.tmp-client.admin.22733.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22733.log.gz 2024-04-25T09:15:21.163 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38192.log 2024-04-25T09:15:21.166 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38192.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38192.log.gz 2024-04-25T09:15:21.166 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41897.log 2024-04-25T09:15:21.169 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41897.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41897.log.gz 2024-04-25T09:15:21.169 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53307.log 2024-04-25T09:15:21.172 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53307.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53307.log.gz 2024-04-25T09:15:21.172 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.34991.log 2024-04-25T09:15:21.177 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42711.log 2024-04-25T09:15:21.177 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.2.34991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.34991.log.gz 2024-04-25T09:15:21.177 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42711.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42711.log.gz 2024-04-25T09:15:21.177 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42238.log 2024-04-25T09:15:21.180 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42238.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42238.log.gz 2024-04-25T09:15:21.181 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52739.log 2024-04-25T09:15:21.183 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52739.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52739.log.gz 2024-04-25T09:15:21.184 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40322.log 2024-04-25T09:15:21.187 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43955.log 2024-04-25T09:15:21.187 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40322.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40322.log.gz 2024-04-25T09:15:21.189 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43955.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43955.log.gz 2024-04-25T09:15:21.190 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53099.log 2024-04-25T09:15:21.193 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53099.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53099.log.gz 2024-04-25T09:15:21.193 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48105.log 2024-04-25T09:15:21.196 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48105.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48105.log.gz 2024-04-25T09:15:21.196 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40559.log 2024-04-25T09:15:21.199 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40559.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40559.log.gz 2024-04-25T09:15:21.199 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39008.log 2024-04-25T09:15:21.199 INFO:teuthology.orchestra.run.smithi175.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T09:15:21.200 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37356.log 2024-04-25T09:15:21.201 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.39008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39008.log.gz 2024-04-25T09:15:21.201 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50714.log 2024-04-25T09:15:21.203 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37356.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.37356.log.gz 2024-04-25T09:15:21.203 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42737.log 2024-04-25T09:15:21.204 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50714.log.gz 2024-04-25T09:15:21.204 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43599.log 2024-04-25T09:15:21.206 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42737.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.42737.log.gz 2024-04-25T09:15:21.207 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49995.log 2024-04-25T09:15:21.207 INFO:teuthology.orchestra.run.smithi175.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43599.log.gz 2024-04-25T09:15:21.208 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50870.log 2024-04-25T09:15:21.210 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49995.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49995.log.gz 2024-04-25T09:15:21.210 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49260.log 2024-04-25T09:15:21.211 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50870.log.gz 2024-04-25T09:15:21.211 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37835.log 2024-04-25T09:15:21.213 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49260.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.49260.log.gz 2024-04-25T09:15:21.214 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37835.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T09:15:21.214 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53229.log 2024-04-25T09:15:21.214 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37835.log.gz 2024-04-25T09:15:21.215 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40287.log 2024-04-25T09:15:21.216 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53229.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.50073.log -- replaced with /var/log/ceph/ceph-client.admin.53229.log.gz 2024-04-25T09:15:21.216 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-04-25T09:15:21.217 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36789.log 2024-04-25T09:15:21.217 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40287.log.gz 2024-04-25T09:15:21.218 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49606.log 2024-04-25T09:15:21.218 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50073.log.gz 2024-04-25T09:15:21.219 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36789.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36789.log.gz 2024-04-25T09:15:21.221 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49606.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49606.log.gz 2024-04-25T09:15:21.221 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53385.log 2024-04-25T09:15:21.222 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46172.log 2024-04-25T09:15:21.224 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33705.log 2024-04-25T09:15:21.224 INFO:teuthology.orchestra.run.smithi175.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53385.log.gz 2024-04-25T09:15:21.225 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42029.log 2024-04-25T09:15:21.226 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33705.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46172.log.gz 2024-04-25T09:15:21.226 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33705.log.gz 2024-04-25T09:15:21.227 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42029.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42029.log.gz 2024-04-25T09:15:21.227 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42607.log 2024-04-25T09:15:21.227 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34692.log 2024-04-25T09:15:21.229 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39715.log 2024-04-25T09:15:21.229 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42607.log.gz 2024-04-25T09:15:21.230 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44648.log 2024-04-25T09:15:21.232 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39715.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.34692.log.gz 2024-04-25T09:15:21.232 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45160.log 2024-04-25T09:15:21.232 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39715.log.gz 2024-04-25T09:15:21.232 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44342.log 2024-04-25T09:15:21.232 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44648.log.gz 2024-04-25T09:15:21.234 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50953.log 2024-04-25T09:15:21.234 INFO:teuthology.orchestra.run.smithi175.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45160.log.gz 2024-04-25T09:15:21.234 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44342.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44342.log.gz 2024-04-25T09:15:21.234 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43701.log 2024-04-25T09:15:21.236 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52687.log 2024-04-25T09:15:21.236 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50953.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50953.log.gz 2024-04-25T09:15:21.237 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47327.log 2024-04-25T09:15:21.238 INFO:teuthology.orchestra.run.smithi175.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43701.log.gz 2024-04-25T09:15:21.239 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33327.log 2024-04-25T09:15:21.239 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52687.log.gz 2024-04-25T09:15:21.239 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35697.log 2024-04-25T09:15:21.240 INFO:teuthology.orchestra.run.smithi175.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47327.log.gz 2024-04-25T09:15:21.240 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42477.log 2024-04-25T09:15:21.241 INFO:teuthology.orchestra.run.smithi175.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33327.log.gz 2024-04-25T09:15:21.242 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42399.log 2024-04-25T09:15:21.242 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35697.log.gz 2024-04-25T09:15:21.243 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39812.log 2024-04-25T09:15:21.243 INFO:teuthology.orchestra.run.smithi175.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.42477.log.gz 2024-04-25T09:15:21.244 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42399.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42399.log.gz 2024-04-25T09:15:21.244 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37575.log 2024-04-25T09:15:21.245 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39812.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39812.log.gz 2024-04-25T09:15:21.246 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53021.log 2024-04-25T09:15:21.247 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51683.log 2024-04-25T09:15:21.248 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37575.log.gz 2024-04-25T09:15:21.248 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49656.log 2024-04-25T09:15:21.248 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53021.log.gz 2024-04-25T09:15:21.249 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51683.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51683.log.gz 2024-04-25T09:15:21.250 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51237.log 2024-04-25T09:15:21.251 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35611.log 2024-04-25T09:15:21.251 INFO:teuthology.orchestra.run.smithi175.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49656.log.gz 2024-04-25T09:15:21.252 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51237.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51237.log.gz 2024-04-25T09:15:21.252 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45896.log 2024-04-25T09:15:21.253 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35611.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35611.log.gz 2024-04-25T09:15:21.253 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48222.log 2024-04-25T09:15:21.254 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.45896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45896.log.gz 2024-04-25T09:15:21.255 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36988.log 2024-04-25T09:15:21.256 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40689.log 2024-04-25T09:15:21.256 INFO:teuthology.orchestra.run.smithi175.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48222.log.gz 2024-04-25T09:15:21.257 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36988.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36988.log.gz 2024-04-25T09:15:21.259 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40689.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.40689.log.gz 2024-04-25T09:15:21.259 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47295.log 2024-04-25T09:15:21.260 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47842.log 2024-04-25T09:15:21.261 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44077.log 2024-04-25T09:15:21.261 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47295.log.gz 2024-04-25T09:15:21.262 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47842.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47842.log.gz 2024-04-25T09:15:21.264 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44077.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44077.log.gz 2024-04-25T09:15:21.264 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50360.log 2024-04-25T09:15:21.265 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45419.log 2024-04-25T09:15:21.267 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47973.log 2024-04-25T09:15:21.267 INFO:teuthology.orchestra.run.smithi175.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50360.log.gz 2024-04-25T09:15:21.268 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44238.log 2024-04-25T09:15:21.268 INFO:teuthology.orchestra.run.smithi175.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45419.log.gz 2024-04-25T09:15:21.269 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46146.log 2024-04-25T09:15:21.269 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44238.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47973.log.gz 2024-04-25T09:15:21.270 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48764.log 2024-04-25T09:15:21.270 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44238.log.gz 2024-04-25T09:15:21.271 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46146.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.46146.log.gz 2024-04-25T09:15:21.271 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53359.log 2024-04-25T09:15:21.272 INFO:teuthology.orchestra.run.smithi175.stderr:gzip/var/log/ceph/ceph-client.admin.48764.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45445.log 2024-04-25T09:15:21.273 INFO:teuthology.orchestra.run.smithi175.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48764.log.gz 2024-04-25T09:15:21.273 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38912.log 2024-04-25T09:15:21.273 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53359.log.gz 2024-04-25T09:15:21.274 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45445.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45445.log.gz 2024-04-25T09:15:21.274 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35884.log 2024-04-25T09:15:21.275 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37689.log 2024-04-25T09:15:21.277 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38912.log: /var/log/ceph/ceph-client.admin.35884.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.38912.log.gz 2024-04-25T09:15:21.277 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48980.log 2024-04-25T09:15:21.277 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35884.log.gz 2024-04-25T09:15:21.278 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37689.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.37689.log.gz 2024-04-25T09:15:21.279 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48980.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48980.log.gz 2024-04-25T09:15:21.280 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52200.log 2024-04-25T09:15:21.280 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38676.log 2024-04-25T09:15:21.282 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51524.log 2024-04-25T09:15:21.282 INFO:teuthology.orchestra.run.smithi175.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52200.log.gz 2024-04-25T09:15:21.283 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38676.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38676.log.gz 2024-04-25T09:15:21.283 INFO:teuthology.orchestra.run.smithi175.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T09:15:21.284 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.51524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47405.log 2024-04-25T09:15:21.284 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51524.log.gz 2024-04-25T09:15:21.285 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36178.log 2024-04-25T09:15:21.286 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39864.log 2024-04-25T09:15:21.286 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47405.log.gz 2024-04-25T09:15:21.287 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40179.log 2024-04-25T09:15:21.287 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36178.log.gz 2024-04-25T09:15:21.288 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35271.log 2024-04-25T09:15:21.288 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39864.log.gz 2024-04-25T09:15:21.288 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44001.log 2024-04-25T09:15:21.289 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40179.log.gz 2024-04-25T09:15:21.290 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37733.log 2024-04-25T09:15:21.290 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35271.log.gz 2024-04-25T09:15:21.291 INFO:teuthology.orchestra.run.smithi175.stderr:gzip/var/log/ceph/ceph-client.0.44001.log: -5 --verbose -- /var/log/ceph/ceph-client.0.46909.log 2024-04-25T09:15:21.291 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44001.log.gz 2024-04-25T09:15:21.292 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41040.log 2024-04-25T09:15:21.292 INFO:teuthology.orchestra.run.smithi175.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.37733.log.gz 2024-04-25T09:15:21.292 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.46909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46909.log.gz 2024-04-25T09:15:21.293 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34536.log 2024-04-25T09:15:21.293 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52114.log 2024-04-25T09:15:21.294 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41040.log.gz 2024-04-25T09:15:21.295 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46404.log 2024-04-25T09:15:21.295 INFO:teuthology.orchestra.run.smithi175.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.34536.log.gz 2024-04-25T09:15:21.295 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47379.log 2024-04-25T09:15:21.297 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40585.log 2024-04-25T09:15:21.297 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46404.log.gz 2024-04-25T09:15:21.297 INFO:teuthology.orchestra.run.smithi175.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.52114.log.gz 2024-04-25T09:15:21.297 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36509.log 2024-04-25T09:15:21.298 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47379.log.gz 2024-04-25T09:15:21.299 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46638.log 2024-04-25T09:15:21.299 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40585.log.gz 2024-04-25T09:15:21.300 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.36509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44937.log 2024-04-25T09:15:21.300 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36509.log.gz 2024-04-25T09:15:21.301 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34122.log 2024-04-25T09:15:21.302 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49430.log 2024-04-25T09:15:21.302 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44937.log.gz 2024-04-25T09:15:21.302 INFO:teuthology.orchestra.run.smithi175.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.46638.log.gz 2024-04-25T09:15:21.303 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38834.log 2024-04-25T09:15:21.303 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34122.log.gz 2024-04-25T09:15:21.304 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46695.log 2024-04-25T09:15:21.304 INFO:teuthology.orchestra.run.smithi175.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.49430.log.gz 2024-04-25T09:15:21.305 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34562.log 2024-04-25T09:15:21.305 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38834.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38834.log.gz/var/log/ceph/ceph-client.admin.46695.log: 2024-04-25T09:15:21.306 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35832.log 2024-04-25T09:15:21.306 INFO:teuthology.orchestra.run.smithi175.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46695.log.gz 2024-04-25T09:15:21.307 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.34562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44570.log 2024-04-25T09:15:21.307 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34562.log.gz 2024-04-25T09:15:21.308 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45901.log 2024-04-25T09:15:21.308 INFO:teuthology.orchestra.run.smithi175.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35832.log.gz 2024-04-25T09:15:21.309 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42633.log 2024-04-25T09:15:21.309 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44570.log.gz 2024-04-25T09:15:21.310 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.45901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42503.log 2024-04-25T09:15:21.310 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45901.log.gz 2024-04-25T09:15:21.311 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48630.log 2024-04-25T09:15:21.311 INFO:teuthology.orchestra.run.smithi175.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42633.log.gz 2024-04-25T09:15:21.311 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45186.log 2024-04-25T09:15:21.312 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42503.log.gz 2024-04-25T09:15:21.312 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35375.log 2024-04-25T09:15:21.313 INFO:teuthology.orchestra.run.smithi175.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48630.log.gz 2024-04-25T09:15:21.314 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38481.log 2024-04-25T09:15:21.314 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45186.log.gz 2024-04-25T09:15:21.315 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37662.log 2024-04-25T09:15:21.315 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35375.log.gz 2024-04-25T09:15:21.316 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.38481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50412.log 2024-04-25T09:15:21.316 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38481.log.gz 2024-04-25T09:15:21.317 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44766.log 2024-04-25T09:15:21.317 INFO:teuthology.orchestra.run.smithi175.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37662.log.gz 2024-04-25T09:15:21.318 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53411.log 2024-04-25T09:15:21.318 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50412.log.gz 2024-04-25T09:15:21.319 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44129.log 2024-04-25T09:15:21.319 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44766.log.gz 2024-04-25T09:15:21.319 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46096.log 2024-04-25T09:15:21.320 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53411.log.gz 2024-04-25T09:15:21.321 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51735.log 2024-04-25T09:15:21.321 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44129.log.gz 2024-04-25T09:15:21.321 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53623.log 2024-04-25T09:15:21.323 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46096.log: /var/log/ceph/ceph-client.admin.51735.log: 91.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.46096.log.gz 2024-04-25T09:15:21.323 INFO:teuthology.orchestra.run.smithi175.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39916.log 2024-04-25T09:15:21.323 INFO:teuthology.orchestra.run.smithi175.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51735.log.gz 2024-04-25T09:15:21.324 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.53623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33166.log 2024-04-25T09:15:21.324 INFO:teuthology.orchestra.run.smithi175.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53623.log.gz 2024-04-25T09:15:21.324 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40790.log 2024-04-25T09:15:21.325 INFO:teuthology.orchestra.run.smithi175.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39916.log.gz 2024-04-25T09:15:21.326 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43187.log 2024-04-25T09:15:21.326 INFO:teuthology.orchestra.run.smithi175.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33166.log.gz 2024-04-25T09:15:21.327 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.40790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47431.log 2024-04-25T09:15:21.327 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.40790.log.gz 2024-04-25T09:15:21.327 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34884.log 2024-04-25T09:15:21.328 INFO:teuthology.orchestra.run.smithi175.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43187.log.gz 2024-04-25T09:15:21.329 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.47431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45238.log 2024-04-25T09:15:21.329 INFO:teuthology.orchestra.run.smithi175.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47431.log.gz 2024-04-25T09:15:21.330 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.0.34884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34884.log.gz 2024-04-25T09:15:21.330 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40837.log 2024-04-25T09:15:21.331 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39838.log 2024-04-25T09:15:21.331 INFO:teuthology.orchestra.run.smithi175.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45238.log.gz 2024-04-25T09:15:21.331 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.40837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43364.log 2024-04-25T09:15:21.332 INFO:teuthology.orchestra.run.smithi175.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.40837.log.gz 2024-04-25T09:15:21.332 INFO:teuthology.orchestra.run.smithi175.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T09:15:21.333 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42555.log 2024-04-25T09:15:21.333 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39838.log.gz 2024-04-25T09:15:21.334 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.43364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41618.log 2024-04-25T09:15:21.334 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43364.log.gz 2024-04-25T09:15:21.334 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.42555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39481.log 2024-04-25T09:15:21.335 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42555.log.gz 2024-04-25T09:15:21.335 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.41618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45774.log 2024-04-25T09:15:21.336 INFO:teuthology.orchestra.run.smithi175.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.41618.log.gz 2024-04-25T09:15:21.336 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.39481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49312.log 2024-04-25T09:15:21.337 INFO:teuthology.orchestra.run.smithi175.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39481.log.gz 2024-04-25T09:15:21.338 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45774.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45774.log.gz 2024-04-25T09:15:21.338 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33042.log 2024-04-25T09:15:21.338 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.49312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48302.log 2024-04-25T09:15:21.339 INFO:teuthology.orchestra.run.smithi175.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49312.log.gz 2024-04-25T09:15:21.340 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50177.log 2024-04-25T09:15:21.340 INFO:teuthology.orchestra.run.smithi175.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33042.log.gz 2024-04-25T09:15:21.340 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37549.log 2024-04-25T09:15:21.341 INFO:teuthology.orchestra.run.smithi175.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48302.log.gz 2024-04-25T09:15:21.341 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.50177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52914.log 2024-04-25T09:15:21.342 INFO:teuthology.orchestra.run.smithi175.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50177.log.gz 2024-04-25T09:15:21.342 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.37549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46352.log 2024-04-25T09:15:21.342 INFO:teuthology.orchestra.run.smithi175.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37549.log.gz 2024-04-25T09:15:21.343 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.52914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35806.log 2024-04-25T09:15:21.344 INFO:teuthology.orchestra.run.smithi175.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52914.log.gz 2024-04-25T09:15:21.344 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.46352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48406.log 2024-04-25T09:15:21.345 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.35806.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.46352.log.gz 2024-04-25T09:15:21.345 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45606.log 2024-04-25T09:15:21.346 INFO:teuthology.orchestra.run.smithi175.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35806.log.gz 2024-04-25T09:15:21.346 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44420.log 2024-04-25T09:15:21.347 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.48406.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48406.log.gz 2024-04-25T09:15:21.347 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.45606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33355.log 2024-04-25T09:15:21.347 INFO:teuthology.orchestra.run.smithi175.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.45606.log.gz 2024-04-25T09:15:21.348 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.44420.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44420.log.gz 2024-04-25T09:15:21.349 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.33355.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33355.log.gz 2024-04-25T09:15:21.453 INFO:teuthology.orchestra.run.smithi175.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T09:15:21.489 INFO:teuthology.orchestra.run.smithi175.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T09:15:21.500 INFO:teuthology.orchestra.run.smithi175.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T09:15:21.502 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-04-25T09:15:21.502 INFO:teuthology.orchestra.run.smithi175.stderr:real 0m1.099s 2024-04-25T09:15:21.502 INFO:teuthology.orchestra.run.smithi175.stderr:user 0m4.982s 2024-04-25T09:15:21.502 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m1.516s 2024-04-25T09:15:21.503 INFO:tasks.ceph:Archiving logs... 2024-04-25T09:15:21.503 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673005/remote/smithi175/log 2024-04-25T09:15:21.504 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T09:15:22.651 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/log/ceph to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673005/remote/smithi177/log 2024-04-25T09:15:22.651 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T09:15:23.023 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T09:15:23.033 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T09:15:23.033 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T09:15:23.037 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T09:15:23.111 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T09:15:23.120 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T09:15:23.120 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:15:23.123 DEBUG:teuthology.orchestra.run.smithi177:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:15:23.135 INFO:teuthology.orchestra.run.smithi175.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T09:15:23.135 INFO:teuthology.orchestra.run.smithi175.stdout:============================================================================== 2024-04-25T09:15:23.135 INFO:teuthology.orchestra.run.smithi175.stdout:+hv01.front.sepi 44.4.53.2 2 u 63 64 377 0.062 -3.584 0.913 2024-04-25T09:15:23.135 INFO:teuthology.orchestra.run.smithi175.stdout:+hv02.front.sepi 63.231.80.2 3 u 54 64 377 0.063 -0.120 0.869 2024-04-25T09:15:23.135 INFO:teuthology.orchestra.run.smithi175.stdout:*hv03.front.sepi 74.6.168.72 3 u 53 64 377 0.074 -3.209 1.531 2024-04-25T09:15:23.135 INFO:teuthology.orchestra.run.smithi175.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-25T09:15:23.138 INFO:teuthology.orchestra.run.smithi177.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T09:15:23.138 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================== 2024-04-25T09:15:23.138 INFO:teuthology.orchestra.run.smithi177.stdout:+hv01.front.sepi 44.4.53.2 2 u 61 64 377 0.096 -2.926 3.946 2024-04-25T09:15:23.138 INFO:teuthology.orchestra.run.smithi177.stdout:*hv02.front.sepi 63.231.80.2 3 u 53 64 377 0.094 -7.294 5.111 2024-04-25T09:15:23.139 INFO:teuthology.orchestra.run.smithi177.stdout:+hv03.front.sepi 74.6.168.72 3 u 50 64 377 0.116 -6.437 3.283 2024-04-25T09:15:23.139 INFO:teuthology.orchestra.run.smithi177.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-25T09:15:23.139 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T09:15:23.197 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T09:15:23.198 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T09:15:23.259 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T09:15:23.325 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T09:15:23.379 INFO:teuthology.task.internal:Duration was 1379.538916 seconds 2024-04-25T09:15:23.380 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T09:15:23.421 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T09:15:23.421 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T09:15:23.424 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T09:15:23.538 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T09:15:23.538 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-04-25T09:15:23.538 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T09:15:23.559 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi177.front.sepia.ceph.com 2024-04-25T09:15:23.559 DEBUG:teuthology.orchestra.run.smithi177:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T09:15:23.580 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T09:15:23.580 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T09:15:23.603 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T09:15:23.665 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T09:15:23.666 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T09:15:23.687 DEBUG:teuthology.orchestra.run.smithi177:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T09:15:23.777 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T09:15:23.787 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T09:15:23.787 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T09:15:23.807 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T09:15:23.827 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T09:15:23.989 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:15:23.992 DEBUG:teuthology.orchestra.run.smithi177:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:15:24.006 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-04-25T09:15:24.010 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = core 2024-04-25T09:15:24.028 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:15:24.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:15:24.076 DEBUG:teuthology.orchestra.run.smithi177:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:15:24.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:15:24.083 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T09:15:24.094 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T09:15:24.094 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673005/remote/smithi175 2024-04-25T09:15:24.095 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T09:15:24.143 DEBUG:teuthology.misc:Transferring archived files from smithi177:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673005/remote/smithi177 2024-04-25T09:15:24.143 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T09:15:24.169 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T09:15:24.169 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T09:15:24.183 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T09:15:24.216 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T09:15:24.227 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T09:15:24.228 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T09:15:24.288 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T09:15:24.289 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T09:15:24.292 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T09:15:24.297 INFO:teuthology.orchestra.run.smithi175.stdout: 655475 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 09:15 /home/ubuntu/cephtest 2024-04-25T09:15:24.300 INFO:teuthology.orchestra.run.smithi177.stdout: 658123 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 09:15 /home/ubuntu/cephtest 2024-04-25T09:15:24.302 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T09:15:24.348 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T09:15:24.585 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 client.1-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/forward-scrub} duration: 1379.5389161109924 flavor: default owner: scheduled_neesingh@teuthology success: true 2024-04-25T09:15:24.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T09:15:24.653 INFO:teuthology.run:pass